2024-04-25T02:00:33.838 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T02:00:33.838 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672374 --owner scheduled_teuthology@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} --name teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi --verbose -- /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672374/orig.config.yaml 2024-04-25T02:00:33.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T02:00:33.976 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672374 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} email: ceph-qa@ceph.com first_in_suite: false job_id: '7672374' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8528 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 122/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFVk+mxqqzpQuTaWYDVy22LRaRkW7NUElcb+GEYGQnKQ01Yp2g7Ja45DIeFQeAbR3MHrqk/y6Z0wcQFtmriNt78= smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCtA81/It4Pk5rMYdjJWMWznoba+oYvZkyH2+UF8mJ6ZT7MZ0Xr3ht5lJGOASybvxw/1K7mJnLFTi5xxk9V6SQI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T02:00:33.976 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa; will attempt to use it 2024-04-25T02:00:33.977 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks 2024-04-25T02:00:33.977 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T02:00:33.978 INFO:teuthology.task.internal:Checking packages... 2024-04-25T02:00:34.002 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-25T02:00:34.002 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:00:34.002 INFO:teuthology.packaging:ref: None 2024-04-25T02:00:34.002 INFO:teuthology.packaging:tag: None 2024-04-25T02:00:34.003 INFO:teuthology.packaging:branch: squid 2024-04-25T02:00:34.003 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:00:34.003 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-25T02:00:34.305 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2445.gd2c45d97 2024-04-25T02:00:34.307 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T02:00:34.314 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T02:00:34.314 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T02:00:34.323 INFO:teuthology.task.internal:Saving configuration 2024-04-25T02:00:34.341 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T02:00:34.348 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T02:00:34.370 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672374', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:55:25.142189', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFVk+mxqqzpQuTaWYDVy22LRaRkW7NUElcb+GEYGQnKQ01Yp2g7Ja45DIeFQeAbR3MHrqk/y6Z0wcQFtmriNt78='} 2024-04-25T02:00:34.392 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672374', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:55:25.140724', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCtA81/It4Pk5rMYdjJWMWznoba+oYvZkyH2+UF8mJ6ZT7MZ0Xr3ht5lJGOASybvxw/1K7mJnLFTi5xxk9V6SQI='} 2024-04-25T02:00:34.392 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T02:00:34.398 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-25T02:00:34.398 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-25T02:00:34.398 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T02:00:34.472 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd7988da0d0>, signals=[15]) 2024-04-25T02:00:34.473 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T02:00:34.482 INFO:teuthology.task.internal:Opening connections... 2024-04-25T02:00:34.482 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:00:34.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:00:34.571 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2024-04-25T02:00:34.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:00:34.656 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T02:00:34.663 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-04-25T02:00:34.681 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-04-25T02:00:34.682 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-04-25T02:00:34.739 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-04-25T02:00:34.739 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-04-25T02:00:34.739 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-04-25T02:00:34.739 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-04-25T02:00:34.739 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-04-25T02:00:34.739 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-04-25T02:00:34.739 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T02:00:34.739 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-04-25T02:00:34.739 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-04-25T02:00:34.740 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T02:00:34.740 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-04-25T02:00:34.740 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T02:00:34.740 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T02:00:34.740 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T02:00:34.740 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-04-25T02:00:34.755 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-04-25T02:00:34.774 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-04-25T02:00:34.774 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-04-25T02:00:34.832 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-04-25T02:00:34.832 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-04-25T02:00:34.832 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-04-25T02:00:34.832 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-04-25T02:00:34.832 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-04-25T02:00:34.832 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-04-25T02:00:34.832 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T02:00:34.832 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-04-25T02:00:34.832 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-04-25T02:00:34.832 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T02:00:34.832 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-04-25T02:00:34.832 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T02:00:34.833 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T02:00:34.833 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T02:00:34.833 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-04-25T02:00:34.855 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T02:00:34.867 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T02:00:34.872 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T02:00:34.872 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2024-04-25T02:00:34.875 DEBUG:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2024-04-25T02:00:34.892 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T02:00:34.898 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T02:00:34.898 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2024-04-25T02:00:34.932 DEBUG:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2024-04-25T02:00:35.041 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T02:00:35.092 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T02:00:35.109 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-04-25T02:00:35.109 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-04-25T02:00:35.109 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-25T02:00:35.110 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T02:00:35.110 DEBUG:teuthology.orchestra.run.smithi189:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T02:00:35.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:00:35.127 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-04-25T02:00:35.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:00:35.128 DEBUG:teuthology.orchestra.run.smithi189:> uname -r 2024-04-25T02:00:35.184 INFO:teuthology.orchestra.run.smithi079.stdout:5.14.0-437.el9.x86_64 2024-04-25T02:00:35.184 INFO:teuthology.task.kernel:Running kernel on smithi079: 5.14.0-437.el9.x86_64 2024-04-25T02:00:35.184 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum install -y kernel 2024-04-25T02:00:35.187 INFO:teuthology.orchestra.run.smithi189.stdout:5.14.0-437.el9.x86_64 2024-04-25T02:00:35.187 INFO:teuthology.task.kernel:Running kernel on smithi189: 5.14.0-437.el9.x86_64 2024-04-25T02:00:35.187 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum install -y kernel 2024-04-25T02:00:37.793 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 7.7 MB/s | 8.0 MB 00:01 2024-04-25T02:00:37.856 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 8.7 MB/s | 8.0 MB 00:00 2024-04-25T02:00:41.931 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 19 MB 00:03 2024-04-25T02:00:43.494 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 4.1 MB/s | 19 MB 00:04 2024-04-25T02:00:46.148 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-25T02:00:47.782 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 16 kB 00:00 2024-04-25T02:00:49.561 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.2 MB 00:02 2024-04-25T02:00:49.717 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-25T02:00:50.920 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 16 kB 00:00 2024-04-25T02:00:52.132 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-25T02:00:54.849 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-25T02:00:56.714 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T02:00:56.714 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T02:00:56.807 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-04-25T02:00:56.808 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-04-25T02:00:56.808 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-04-25T02:00:56.925 DEBUG:teuthology.orchestra.run.smithi079:> echo no | sudo yum reinstall kernel || true 2024-04-25T02:00:57.271 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-25T02:00:57.426 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 02:00:54 AM UTC. 2024-04-25T02:00:57.545 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-04-25T02:00:57.561 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-04-25T02:00:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-04-25T02:00:57.561 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-04-25T02:00:57.561 INFO:teuthology.orchestra.run.smithi079.stdout:Reinstalling: 2024-04-25T02:00:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T02:00:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:00:57.561 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-04-25T02:00:57.561 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-04-25T02:00:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:00:57.562 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 255 k 2024-04-25T02:00:57.562 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 0 2024-04-25T02:00:57.562 INFO:teuthology.orchestra.run.smithi079.stderr:Operation aborted. 2024-04-25T02:00:57.619 INFO:teuthology.orchestra.run.smithi079.stdout:Is this ok [y/N]: 2024-04-25T02:00:57.619 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum reinstall -y kernel || true 2024-04-25T02:00:58.110 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:04 ago on Thu 25 Apr 2024 02:00:54 AM UTC. 2024-04-25T02:00:58.226 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-04-25T02:00:58.227 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-04-25T02:00:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-04-25T02:00:58.229 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-04-25T02:00:58.229 INFO:teuthology.orchestra.run.smithi079.stdout:Reinstalling: 2024-04-25T02:00:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T02:00:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:00:58.230 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-04-25T02:00:58.230 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-04-25T02:00:58.230 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:00:58.230 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 255 k 2024-04-25T02:00:58.230 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 0 2024-04-25T02:00:58.230 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-04-25T02:00:58.977 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-5.14.0-437.el9.x86_64.rpm 537 kB/s | 255 kB 00:00 2024-04-25T02:00:58.977 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:00:58.977 INFO:teuthology.orchestra.run.smithi079.stdout:Total 340 kB/s | 255 kB 00:00 2024-04-25T02:00:58.999 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-04-25T02:00:59.136 INFO:teuthology.orchestra.run.smithi189.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T02:00:59.136 INFO:teuthology.orchestra.run.smithi189.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T02:00:59.183 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-04-25T02:00:59.184 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-04-25T02:00:59.188 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-04-25T02:00:59.189 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-04-25T02:00:59.224 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-04-25T02:00:59.225 INFO:teuthology.orchestra.run.smithi189.stdout:Nothing to do. 2024-04-25T02:00:59.225 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-04-25T02:00:59.327 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-04-25T02:00:59.362 DEBUG:teuthology.orchestra.run.smithi189:> echo no | sudo yum reinstall kernel || true 2024-04-25T02:00:59.402 INFO:teuthology.orchestra.run.smithi079.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T02:00:59.403 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T02:00:59.863 INFO:teuthology.orchestra.run.smithi189.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 02:00:57 AM UTC. 2024-04-25T02:00:59.991 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-04-25T02:01:00.003 INFO:teuthology.orchestra.run.smithi189.stdout:================================================================================ 2024-04-25T02:01:00.003 INFO:teuthology.orchestra.run.smithi189.stdout: Package Architecture Version Repository Size 2024-04-25T02:01:00.003 INFO:teuthology.orchestra.run.smithi189.stdout:================================================================================ 2024-04-25T02:01:00.003 INFO:teuthology.orchestra.run.smithi189.stdout:Reinstalling: 2024-04-25T02:01:00.003 INFO:teuthology.orchestra.run.smithi189.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T02:01:00.003 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:01:00.003 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-04-25T02:01:00.003 INFO:teuthology.orchestra.run.smithi189.stdout:================================================================================ 2024-04-25T02:01:00.003 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:01:00.003 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 255 k 2024-04-25T02:01:00.003 INFO:teuthology.orchestra.run.smithi189.stdout:Installed size: 0 2024-04-25T02:01:00.004 INFO:teuthology.orchestra.run.smithi189.stderr:Operation aborted. 2024-04-25T02:01:00.065 INFO:teuthology.orchestra.run.smithi189.stdout:Is this ok [y/N]: 2024-04-25T02:01:00.065 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum reinstall -y kernel || true 2024-04-25T02:01:00.083 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T02:01:00.083 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T02:01:00.558 INFO:teuthology.orchestra.run.smithi189.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 02:00:57 AM UTC. 2024-04-25T02:01:00.674 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-04-25T02:01:00.675 INFO:teuthology.orchestra.run.smithi189.stdout:================================================================================ 2024-04-25T02:01:00.675 INFO:teuthology.orchestra.run.smithi189.stdout: Package Architecture Version Repository Size 2024-04-25T02:01:00.675 INFO:teuthology.orchestra.run.smithi189.stdout:================================================================================ 2024-04-25T02:01:00.675 INFO:teuthology.orchestra.run.smithi189.stdout:Reinstalling: 2024-04-25T02:01:00.675 INFO:teuthology.orchestra.run.smithi189.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T02:01:00.676 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:01:00.676 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-04-25T02:01:00.676 INFO:teuthology.orchestra.run.smithi189.stdout:================================================================================ 2024-04-25T02:01:00.676 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:01:00.676 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 255 k 2024-04-25T02:01:00.676 INFO:teuthology.orchestra.run.smithi189.stdout:Installed size: 0 2024-04-25T02:01:00.676 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading Packages: 2024-04-25T02:01:00.801 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T02:01:00.801 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:01:00.801 INFO:teuthology.orchestra.run.smithi079.stdout:Reinstalled: 2024-04-25T02:01:00.801 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T02:01:00.801 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:01:00.801 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-04-25T02:01:00.998 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T02:01:01.085 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T02:01:01.086 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T02:01:01.087 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T02:01:01.087 DEBUG:teuthology.parallel:result is None 2024-04-25T02:01:01.424 INFO:teuthology.orchestra.run.smithi189.stdout:kernel-5.14.0-437.el9.x86_64.rpm 515 kB/s | 255 kB 00:00 2024-04-25T02:01:01.424 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:01:01.424 INFO:teuthology.orchestra.run.smithi189.stdout:Total 341 kB/s | 255 kB 00:00 2024-04-25T02:01:01.440 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2024-04-25T02:01:01.645 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction check succeeded. 2024-04-25T02:01:01.645 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2024-04-25T02:01:01.650 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded. 2024-04-25T02:01:01.651 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2024-04-25T02:01:01.813 INFO:teuthology.orchestra.run.smithi189.stdout: Preparing : 1/1 2024-04-25T02:01:01.891 INFO:teuthology.orchestra.run.smithi189.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T02:01:01.892 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T02:01:02.601 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T02:01:02.601 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T02:01:03.295 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T02:01:03.295 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:01:03.295 INFO:teuthology.orchestra.run.smithi189.stdout:Reinstalled: 2024-04-25T02:01:03.295 INFO:teuthology.orchestra.run.smithi189.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T02:01:03.295 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:01:03.295 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-04-25T02:01:03.461 DEBUG:teuthology.orchestra.run.smithi189:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T02:01:03.507 INFO:teuthology.orchestra.run.smithi189.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T02:01:03.508 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T02:01:03.509 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T02:01:03.509 DEBUG:teuthology.parallel:result is None 2024-04-25T02:01:03.509 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T02:01:03.516 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T02:01:03.516 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T02:01:03.519 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T02:01:03.534 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T02:01:03.541 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T02:01:03.599 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T02:01:03.600 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T02:01:03.602 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T02:01:03.722 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T02:01:03.729 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T02:01:03.730 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T02:01:03.732 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T02:01:03.761 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:01:03.762 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:01:03.775 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:01:03.780 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:01:03.782 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T02:01:03.789 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T02:01:03.790 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T02:01:03.825 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T02:01:03.849 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T02:01:03.858 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T02:01:03.858 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T02:01:03.892 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T02:01:03.906 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:01:03.991 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:01:04.032 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:01:04.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:01:04.154 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:01:04.154 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T02:01:04.219 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:01:04.257 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:01:04.309 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:01:04.391 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:01:04.430 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:01:04.430 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T02:01:04.494 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2024-04-25T02:01:04.496 DEBUG:teuthology.orchestra.run.smithi189:> sudo service rsyslog restart 2024-04-25T02:01:04.530 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:01:04.565 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:01:04.982 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T02:01:04.995 INFO:teuthology.task.internal:Starting timer... 2024-04-25T02:01:04.995 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T02:01:05.008 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T02:01:05.018 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-25T02:01:05.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo service auditd rotate 2024-04-25T02:01:05.091 INFO:teuthology.orchestra.run.smithi079.stdout:Rotating logs: 2024-04-25T02:01:05.094 DEBUG:teuthology.orchestra.run.smithi189:> sudo service auditd rotate 2024-04-25T02:01:05.145 INFO:teuthology.orchestra.run.smithi189.stdout:Rotating logs: 2024-04-25T02:01:05.147 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T02:01:05.147 DEBUG:teuthology.orchestra.run.smithi079:> /usr/sbin/getenforce 2024-04-25T02:01:05.173 INFO:teuthology.orchestra.run.smithi079.stdout:Permissive 2024-04-25T02:01:05.173 DEBUG:teuthology.orchestra.run.smithi189:> /usr/sbin/getenforce 2024-04-25T02:01:05.195 INFO:teuthology.orchestra.run.smithi189.stdout:Permissive 2024-04-25T02:01:05.195 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi079.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi189.front.sepia.ceph.com': 'permissive'} 2024-04-25T02:01:05.196 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T02:01:05.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:01:05.239 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T02:01:05.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:01:05.264 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T02:01:05.264 DEBUG:teuthology.orchestra.run.smithi079:> sudo /usr/sbin/setenforce permissive 2024-04-25T02:01:05.303 DEBUG:teuthology.orchestra.run.smithi189:> sudo /usr/sbin/setenforce permissive 2024-04-25T02:01:05.339 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T02:01:05.349 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T02:01:05.356 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T02:01:05.496 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T02:01:05.515 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T02:01:05.517 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi079.front.sepia.ceph.com,smithi189.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T02:04:39.724 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi189.front.sepia.ceph.com')] 2024-04-25T02:04:39.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-04-25T02:04:39.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:04:39.801 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-04-25T02:04:39.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-04-25T02:04:39.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-04-25T02:04:39.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:04:39.911 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-04-25T02:04:39.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-04-25T02:04:39.990 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T02:04:39.999 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T02:04:40.000 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T02:04:40.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:04:40.002 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T02:04:40.002 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:04:40.029 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T02:04:40.043 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T02:04:40.056 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T02:04:40.066 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: ntpd: command not found 2024-04-25T02:04:40.070 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T02:04:40.076 INFO:teuthology.orchestra.run.smithi079.stdout:506 Cannot talk to daemon 2024-04-25T02:04:40.090 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T02:04:40.092 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: ntpd: command not found 2024-04-25T02:04:40.102 INFO:teuthology.orchestra.run.smithi189.stdout:506 Cannot talk to daemon 2024-04-25T02:04:40.103 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T02:04:40.115 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T02:04:40.128 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T02:04:40.155 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-04-25T02:04:40.159 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:04:40.159 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-04-25T02:04:40.159 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:04:40.159 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:04:40.159 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:04:40.159 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:04:40.184 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-04-25T02:04:40.187 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:04:40.188 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-04-25T02:04:40.188 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:04:40.188 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:04:40.188 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:04:40.188 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:04:40.188 INFO:teuthology.run_tasks:Running task install... 2024-04-25T02:04:40.197 DEBUG:teuthology.task.install:project ceph 2024-04-25T02:04:40.197 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-25T02:04:40.197 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T02:04:40.197 INFO:teuthology.task.install:Using flavor: default 2024-04-25T02:04:40.203 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T02:04:40.203 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T02:04:40.203 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T02:04:40.204 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:04:40.206 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T02:04:40.206 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:04:40.351 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-25T02:04:40.352 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-25T02:04:40.355 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-25T02:04:40.356 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-25T02:04:40.642 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T02:04:40.643 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:04:40.643 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T02:04:40.668 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T02:04:40.669 DEBUG:teuthology.orchestra.run.smithi189:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T02:04:40.700 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T02:04:40.700 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:04:40.700 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T02:04:40.724 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T02:04:40.725 DEBUG:teuthology.orchestra.run.smithi079:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T02:04:40.733 DEBUG:teuthology.orchestra.run.smithi189:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T02:04:40.789 DEBUG:teuthology.orchestra.run.smithi079:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T02:04:40.807 DEBUG:teuthology.orchestra.run.smithi189:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T02:04:40.863 DEBUG:teuthology.orchestra.run.smithi079:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T02:04:40.870 INFO:teuthology.orchestra.run.smithi189.stdout:check_obsoletes = 1 2024-04-25T02:04:40.871 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum clean all 2024-04-25T02:04:40.926 INFO:teuthology.orchestra.run.smithi079.stdout:check_obsoletes = 1 2024-04-25T02:04:40.928 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum clean all 2024-04-25T02:04:41.097 INFO:teuthology.orchestra.run.smithi189.stdout:48 files removed 2024-04-25T02:04:41.124 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T02:04:41.151 INFO:teuthology.orchestra.run.smithi079.stdout:48 files removed 2024-04-25T02:04:41.177 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T02:04:42.344 INFO:teuthology.orchestra.run.smithi079.stdout:ceph packages for x86_64 91 kB/s | 83 kB 00:00 2024-04-25T02:04:42.540 INFO:teuthology.orchestra.run.smithi189.stdout:ceph packages for x86_64 72 kB/s | 83 kB 00:01 2024-04-25T02:04:43.120 INFO:teuthology.orchestra.run.smithi079.stdout:ceph noarch packages 16 kB/s | 11 kB 00:00 2024-04-25T02:04:43.275 INFO:teuthology.orchestra.run.smithi189.stdout:ceph noarch packages 17 kB/s | 11 kB 00:00 2024-04-25T02:04:43.996 INFO:teuthology.orchestra.run.smithi079.stdout:ceph source packages 2.3 kB/s | 1.9 kB 00:00 2024-04-25T02:04:46.117 INFO:teuthology.orchestra.run.smithi189.stdout:ceph source packages 690 B/s | 1.9 kB 00:02 2024-04-25T02:04:46.858 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-25T02:04:46.937 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.0 MB 00:02 2024-04-25T02:04:48.634 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-04-25T02:04:48.746 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-25T02:04:53.922 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.2 MB 00:01 2024-04-25T02:04:54.394 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.2 MB 00:02 2024-04-25T02:04:55.355 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 16 kB 00:00 2024-04-25T02:04:55.936 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 16 kB 00:00 2024-04-25T02:04:58.415 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 7.1 MB/s | 21 MB 00:02 2024-04-25T02:04:58.787 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 21 MB 00:02 2024-04-25T02:05:03.456 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-25T02:05:03.820 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-25T02:05:05.607 INFO:teuthology.orchestra.run.smithi079.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T02:05:05.608 INFO:teuthology.orchestra.run.smithi079.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T02:05:05.619 INFO:teuthology.orchestra.run.smithi079.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T02:05:05.620 INFO:teuthology.orchestra.run.smithi079.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T02:05:05.620 INFO:teuthology.orchestra.run.smithi079.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T02:05:05.621 INFO:teuthology.orchestra.run.smithi079.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T02:05:05.623 INFO:teuthology.orchestra.run.smithi079.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T02:05:05.625 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T02:05:05.626 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T02:05:05.686 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-04-25T02:05:05.694 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-04-25T02:05:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-04-25T02:05:05.695 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-04-25T02:05:05.695 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-04-25T02:05:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T02:05:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-25T02:05:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-25T02:05:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-25T02:05:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-25T02:05:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-25T02:05:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-25T02:05:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-25T02:05:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-25T02:05:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-25T02:05:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-25T02:05:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-25T02:05:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-25T02:05:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-25T02:05:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 222 k 2024-04-25T02:05:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-shell x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 27 k 2024-04-25T02:05:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 18 k 2024-04-25T02:05:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T02:05:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T02:05:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T02:05:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-25T02:05:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-25T02:05:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-25T02:05:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T02:05:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T02:05:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T02:05:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T02:05:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T02:05:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T02:05:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-25T02:05:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-25T02:05:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-25T02:05:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-25T02:05:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-25T02:05:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T02:05:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-25T02:05:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T02:05:05.698 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrading: 2024-04-25T02:05:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-25T02:05:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T02:05:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T02:05:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T02:05:05.699 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-04-25T02:05:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T02:05:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T02:05:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T02:05:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-25T02:05:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-25T02:05:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-25T02:05:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-25T02:05:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-25T02:05:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-25T02:05:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-25T02:05:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-25T02:05:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T02:05:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T02:05:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T02:05:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T02:05:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T02:05:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T02:05:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T02:05:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T02:05:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-25T02:05:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T02:05:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T02:05:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T02:05:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T02:05:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T02:05:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-25T02:05:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T02:05:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-25T02:05:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T02:05:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T02:05:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T02:05:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T02:05:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T02:05:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T02:05:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T02:05:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T02:05:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T02:05:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T02:05:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T02:05:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T02:05:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T02:05:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T02:05:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T02:05:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T02:05:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T02:05:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-25T02:05:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-25T02:05:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T02:05:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T02:05:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T02:05:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T02:05:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T02:05:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T02:05:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T02:05:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T02:05:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T02:05:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T02:05:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T02:05:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T02:05:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T02:05:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T02:05:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T02:05:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T02:05:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T02:05:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T02:05:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T02:05:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T02:05:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T02:05:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T02:05:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T02:05:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T02:05:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T02:05:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T02:05:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T02:05:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T02:05:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T02:05:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T02:05:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T02:05:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T02:05:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T02:05:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T02:05:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T02:05:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T02:05:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T02:05:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T02:05:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T02:05:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T02:05:05.714 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T02:05:05.714 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T02:05:05.714 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T02:05:05.714 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T02:05:05.714 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T02:05:05.714 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T02:05:05.714 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T02:05:05.714 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T02:05:05.714 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T02:05:05.714 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T02:05:05.714 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T02:05:05.714 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T02:05:05.714 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T02:05:05.715 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T02:05:05.715 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T02:05:05.715 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T02:05:05.715 INFO:teuthology.orchestra.run.smithi079.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T02:05:05.715 INFO:teuthology.orchestra.run.smithi079.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T02:05:05.715 INFO:teuthology.orchestra.run.smithi079.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T02:05:05.715 INFO:teuthology.orchestra.run.smithi079.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T02:05:05.715 INFO:teuthology.orchestra.run.smithi079.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T02:05:05.715 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T02:05:05.715 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T02:05:05.715 INFO:teuthology.orchestra.run.smithi079.stdout:Installing weak dependencies: 2024-04-25T02:05:05.715 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T02:05:05.715 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:05:05.716 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-04-25T02:05:05.716 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-04-25T02:05:05.716 INFO:teuthology.orchestra.run.smithi079.stdout:Install 148 Packages 2024-04-25T02:05:05.716 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade 4 Packages 2024-04-25T02:05:05.716 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:05:05.717 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 220 M 2024-04-25T02:05:05.717 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-04-25T02:05:05.946 INFO:teuthology.orchestra.run.smithi189.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T02:05:05.947 INFO:teuthology.orchestra.run.smithi189.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T02:05:05.958 INFO:teuthology.orchestra.run.smithi189.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T02:05:05.958 INFO:teuthology.orchestra.run.smithi189.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T02:05:05.959 INFO:teuthology.orchestra.run.smithi189.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T02:05:05.960 INFO:teuthology.orchestra.run.smithi189.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T02:05:05.962 INFO:teuthology.orchestra.run.smithi189.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T02:05:05.964 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T02:05:05.965 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T02:05:06.026 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-04-25T02:05:06.035 INFO:teuthology.orchestra.run.smithi189.stdout:======================================================================================= 2024-04-25T02:05:06.035 INFO:teuthology.orchestra.run.smithi189.stdout: Package Arch Version Repository Size 2024-04-25T02:05:06.035 INFO:teuthology.orchestra.run.smithi189.stdout:======================================================================================= 2024-04-25T02:05:06.035 INFO:teuthology.orchestra.run.smithi189.stdout:Installing: 2024-04-25T02:05:06.035 INFO:teuthology.orchestra.run.smithi189.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T02:05:06.035 INFO:teuthology.orchestra.run.smithi189.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-25T02:05:06.035 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-25T02:05:06.035 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-25T02:05:06.035 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-25T02:05:06.035 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-25T02:05:06.036 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-25T02:05:06.036 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-25T02:05:06.036 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-25T02:05:06.036 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-25T02:05:06.036 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-25T02:05:06.036 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-25T02:05:06.036 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-25T02:05:06.036 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-25T02:05:06.036 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 222 k 2024-04-25T02:05:06.036 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 27 k 2024-04-25T02:05:06.036 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 18 k 2024-04-25T02:05:06.036 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T02:05:06.036 INFO:teuthology.orchestra.run.smithi189.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T02:05:06.036 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T02:05:06.036 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-25T02:05:06.037 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-25T02:05:06.037 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-25T02:05:06.037 INFO:teuthology.orchestra.run.smithi189.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T02:05:06.037 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T02:05:06.037 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T02:05:06.037 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T02:05:06.037 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T02:05:06.037 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T02:05:06.037 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-25T02:05:06.037 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-25T02:05:06.037 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-25T02:05:06.037 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-25T02:05:06.037 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-25T02:05:06.037 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T02:05:06.038 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-25T02:05:06.038 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T02:05:06.038 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrading: 2024-04-25T02:05:06.038 INFO:teuthology.orchestra.run.smithi189.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-25T02:05:06.038 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T02:05:06.038 INFO:teuthology.orchestra.run.smithi189.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T02:05:06.038 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T02:05:06.038 INFO:teuthology.orchestra.run.smithi189.stdout:Installing dependencies: 2024-04-25T02:05:06.038 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T02:05:06.038 INFO:teuthology.orchestra.run.smithi189.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T02:05:06.038 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T02:05:06.038 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-25T02:05:06.038 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-25T02:05:06.039 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-25T02:05:06.039 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-25T02:05:06.039 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-25T02:05:06.039 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-25T02:05:06.039 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-25T02:05:06.039 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-25T02:05:06.039 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T02:05:06.039 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T02:05:06.039 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T02:05:06.039 INFO:teuthology.orchestra.run.smithi189.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T02:05:06.039 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T02:05:06.039 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T02:05:06.039 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T02:05:06.039 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T02:05:06.040 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-25T02:05:06.040 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T02:05:06.040 INFO:teuthology.orchestra.run.smithi189.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T02:05:06.040 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T02:05:06.040 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T02:05:06.040 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T02:05:06.040 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-25T02:05:06.040 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T02:05:06.040 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-25T02:05:06.040 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T02:05:06.040 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T02:05:06.040 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T02:05:06.040 INFO:teuthology.orchestra.run.smithi189.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T02:05:06.040 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T02:05:06.041 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T02:05:06.041 INFO:teuthology.orchestra.run.smithi189.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T02:05:06.041 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T02:05:06.041 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T02:05:06.041 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T02:05:06.041 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T02:05:06.041 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T02:05:06.041 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T02:05:06.041 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T02:05:06.041 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T02:05:06.041 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T02:05:06.041 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T02:05:06.041 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-25T02:05:06.041 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-25T02:05:06.041 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T02:05:06.042 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T02:05:06.042 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T02:05:06.042 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T02:05:06.042 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T02:05:06.042 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T02:05:06.042 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T02:05:06.042 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T02:05:06.042 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T02:05:06.042 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T02:05:06.042 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T02:05:06.042 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T02:05:06.042 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T02:05:06.043 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T02:05:06.043 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T02:05:06.043 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T02:05:06.043 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T02:05:06.043 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T02:05:06.043 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T02:05:06.043 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T02:05:06.043 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T02:05:06.043 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T02:05:06.043 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T02:05:06.043 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T02:05:06.043 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T02:05:06.043 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T02:05:06.043 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T02:05:06.044 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T02:05:06.044 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T02:05:06.044 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T02:05:06.044 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T02:05:06.044 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T02:05:06.044 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T02:05:06.044 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T02:05:06.044 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T02:05:06.044 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T02:05:06.044 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T02:05:06.044 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T02:05:06.044 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T02:05:06.044 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T02:05:06.044 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T02:05:06.045 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T02:05:06.045 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T02:05:06.045 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T02:05:06.045 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T02:05:06.045 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T02:05:06.045 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T02:05:06.045 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T02:05:06.045 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T02:05:06.045 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T02:05:06.045 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T02:05:06.045 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T02:05:06.045 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T02:05:06.045 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T02:05:06.045 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T02:05:06.046 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T02:05:06.046 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T02:05:06.046 INFO:teuthology.orchestra.run.smithi189.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T02:05:06.046 INFO:teuthology.orchestra.run.smithi189.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T02:05:06.046 INFO:teuthology.orchestra.run.smithi189.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T02:05:06.046 INFO:teuthology.orchestra.run.smithi189.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T02:05:06.047 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T02:05:06.047 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T02:05:06.047 INFO:teuthology.orchestra.run.smithi189.stdout:Installing weak dependencies: 2024-04-25T02:05:06.047 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T02:05:06.047 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:05:06.047 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-04-25T02:05:06.047 INFO:teuthology.orchestra.run.smithi189.stdout:======================================================================================= 2024-04-25T02:05:06.047 INFO:teuthology.orchestra.run.smithi189.stdout:Install 148 Packages 2024-04-25T02:05:06.047 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrade 4 Packages 2024-04-25T02:05:06.047 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:05:06.048 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 220 M 2024-04-25T02:05:06.048 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading Packages: 2024-04-25T02:05:07.082 INFO:teuthology.orchestra.run.smithi079.stdout:(1/152): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 12 kB/s | 6.6 kB 00:00 2024-04-25T02:05:07.363 INFO:teuthology.orchestra.run.smithi189.stdout:(1/152): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 12 kB/s | 6.6 kB 00:00 2024-04-25T02:05:07.997 INFO:teuthology.orchestra.run.smithi189.stdout:(2/152): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.4 MB/s | 890 kB 00:00 2024-04-25T02:05:08.139 INFO:teuthology.orchestra.run.smithi189.stdout:(3/152): ceph-immutable-object-cache-19.0.0-244 1.0 MB/s | 145 kB 00:00 2024-04-25T02:05:08.622 INFO:teuthology.orchestra.run.smithi189.stdout:(4/152): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 4.9 MB/s | 2.4 MB 00:00 2024-04-25T02:05:08.640 INFO:teuthology.orchestra.run.smithi079.stdout:(2/152): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 571 kB/s | 890 kB 00:01 2024-04-25T02:05:08.907 INFO:teuthology.orchestra.run.smithi079.stdout:(3/152): ceph-immutable-object-cache-19.0.0-244 543 kB/s | 145 kB 00:00 2024-04-25T02:05:08.973 INFO:teuthology.orchestra.run.smithi189.stdout:(5/152): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 4.3 MB/s | 1.5 MB 00:00 2024-04-25T02:05:09.533 INFO:teuthology.orchestra.run.smithi079.stdout:(4/152): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 1.8 MB/s | 5.4 MB 00:02 2024-04-25T02:05:09.898 INFO:teuthology.orchestra.run.smithi189.stdout:(6/152): ceph-mon-19.0.0-2445.gd2c45d97.el9.x86 5.1 MB/s | 4.7 MB 00:00 2024-04-25T02:05:10.216 INFO:teuthology.orchestra.run.smithi079.stdout:(5/152): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 2.2 MB/s | 1.5 MB 00:00 2024-04-25T02:05:11.774 INFO:teuthology.orchestra.run.smithi079.stdout:(6/152): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 844 kB/s | 2.4 MB 00:02 2024-04-25T02:05:12.066 INFO:teuthology.orchestra.run.smithi079.stdout:(7/152): ceph-mon-19.0.0-2445.gd2c45d97.el9.x86 2.5 MB/s | 4.7 MB 00:01 2024-04-25T02:05:12.556 INFO:teuthology.orchestra.run.smithi189.stdout:(7/152): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 959 kB/s | 5.4 MB 00:05 2024-04-25T02:05:12.823 INFO:teuthology.orchestra.run.smithi189.stdout:(8/152): ceph-osd-19.0.0-2445.gd2c45d97.el9.x86 5.7 MB/s | 17 MB 00:02 2024-04-25T02:05:12.923 INFO:teuthology.orchestra.run.smithi189.stdout:(9/152): ceph-selinux-19.0.0-2445.gd2c45d97.el9 252 kB/s | 25 kB 00:00 2024-04-25T02:05:16.391 INFO:teuthology.orchestra.run.smithi079.stdout:(8/152): ceph-radosgw-19.0.0-2445.gd2c45d97.el9 2.4 MB/s | 10 MB 00:04 2024-04-25T02:05:16.490 INFO:teuthology.orchestra.run.smithi079.stdout:(9/152): ceph-selinux-19.0.0-2445.gd2c45d97.el9 253 kB/s | 25 kB 00:00 2024-04-25T02:05:21.564 INFO:teuthology.orchestra.run.smithi189.stdout:(10/152): ceph-common-19.0.0-2445.gd2c45d97.el9 1.4 MB/s | 21 MB 00:14 2024-04-25T02:05:21.797 INFO:teuthology.orchestra.run.smithi189.stdout:(11/152): cephfs-mirror-19.0.0-2445.gd2c45d97.e 954 kB/s | 222 kB 00:00 2024-04-25T02:05:21.905 INFO:teuthology.orchestra.run.smithi189.stdout:(12/152): cephfs-shell-19.0.0-2445.gd2c45d97.el 253 kB/s | 27 kB 00:00 2024-04-25T02:05:21.998 INFO:teuthology.orchestra.run.smithi189.stdout:(13/152): libcephfs-devel-19.0.0-2445.gd2c45d97 342 kB/s | 32 kB 00:00 2024-04-25T02:05:22.306 INFO:teuthology.orchestra.run.smithi189.stdout:(14/152): ceph-radosgw-19.0.0-2445.gd2c45d97.el 1.0 MB/s | 10 MB 00:09 2024-04-25T02:05:22.615 INFO:teuthology.orchestra.run.smithi189.stdout:(15/152): libcephfs2-19.0.0-2445.gd2c45d97.el9. 1.2 MB/s | 745 kB 00:00 2024-04-25T02:05:22.632 INFO:teuthology.orchestra.run.smithi189.stdout:(16/152): libcephsqlite-19.0.0-2445.gd2c45d97.e 503 kB/s | 163 kB 00:00 2024-04-25T02:05:22.707 INFO:teuthology.orchestra.run.smithi189.stdout:(17/152): librados-devel-19.0.0-2445.gd2c45d97. 1.3 MB/s | 127 kB 00:00 2024-04-25T02:05:23.083 INFO:teuthology.orchestra.run.smithi189.stdout:(18/152): libradosstriper1-19.0.0-2445.gd2c45d9 1.1 MB/s | 501 kB 00:00 2024-04-25T02:05:23.191 INFO:teuthology.orchestra.run.smithi189.stdout:(19/152): python3-ceph-argparse-19.0.0-2445.gd2 417 kB/s | 45 kB 00:00 2024-04-25T02:05:23.400 INFO:teuthology.orchestra.run.smithi189.stdout:(20/152): python3-ceph-common-19.0.0-2445.gd2c4 638 kB/s | 133 kB 00:00 2024-04-25T02:05:23.601 INFO:teuthology.orchestra.run.smithi189.stdout:(21/152): python3-cephfs-19.0.0-2445.gd2c45d97. 808 kB/s | 162 kB 00:00 2024-04-25T02:05:23.976 INFO:teuthology.orchestra.run.smithi189.stdout:(22/152): python3-rados-19.0.0-2445.gd2c45d97.e 856 kB/s | 321 kB 00:00 2024-04-25T02:05:24.276 INFO:teuthology.orchestra.run.smithi189.stdout:(23/152): python3-rbd-19.0.0-2445.gd2c45d97.el9 997 kB/s | 299 kB 00:00 2024-04-25T02:05:24.393 INFO:teuthology.orchestra.run.smithi189.stdout:(24/152): python3-rgw-19.0.0-2445.gd2c45d97.el9 854 kB/s | 99 kB 00:00 2024-04-25T02:05:24.518 INFO:teuthology.orchestra.run.smithi189.stdout:(25/152): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 682 kB/s | 85 kB 00:00 2024-04-25T02:05:25.319 INFO:teuthology.orchestra.run.smithi189.stdout:(26/152): librgw2-19.0.0-2445.gd2c45d97.el9.x86 2.0 MB/s | 5.3 MB 00:02 2024-04-25T02:05:25.410 INFO:teuthology.orchestra.run.smithi189.stdout:(27/152): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 1.8 MB/s | 171 kB 00:00 2024-04-25T02:05:25.494 INFO:teuthology.orchestra.run.smithi189.stdout:(28/152): ceph-grafana-dashboards-19.0.0-2445.g 381 kB/s | 32 kB 00:00 2024-04-25T02:05:25.586 INFO:teuthology.orchestra.run.smithi189.stdout:(29/152): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 1.5 MB/s | 141 kB 00:00 2024-04-25T02:05:27.161 INFO:teuthology.orchestra.run.smithi189.stdout:(30/152): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 1.2 MB/s | 3.1 MB 00:02 2024-04-25T02:05:27.211 INFO:teuthology.orchestra.run.smithi189.stdout:(31/152): ceph-mgr-dashboard-19.0.0-2445.gd2c45 2.2 MB/s | 3.5 MB 00:01 2024-04-25T02:05:27.387 INFO:teuthology.orchestra.run.smithi189.stdout:(32/152): ceph-mgr-modules-core-19.0.0-2445.gd2 1.4 MB/s | 249 kB 00:00 2024-04-25T02:05:27.487 INFO:teuthology.orchestra.run.smithi189.stdout:(33/152): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 494 kB/s | 49 kB 00:00 2024-04-25T02:05:27.579 INFO:teuthology.orchestra.run.smithi189.stdout:(34/152): ceph-prometheus-alerts-19.0.0-2445.gd 167 kB/s | 15 kB 00:00 2024-04-25T02:05:27.754 INFO:teuthology.orchestra.run.smithi189.stdout:(35/152): ceph-volume-19.0.0-2445.gd2c45d97.el9 1.5 MB/s | 264 kB 00:00 2024-04-25T02:05:28.114 INFO:teuthology.orchestra.run.smithi079.stdout:(10/152): ceph-osd-19.0.0-2445.gd2c45d97.el9.x8 1.0 MB/s | 17 MB 00:16 2024-04-25T02:05:28.154 INFO:teuthology.orchestra.run.smithi189.stdout:(36/152): cephadm-19.0.0-2445.gd2c45d97.el9.noa 1.9 MB/s | 762 kB 00:00 2024-04-25T02:05:28.255 INFO:teuthology.orchestra.run.smithi189.stdout:(37/152): cephfs-top-19.0.0-2445.gd2c45d97.el9. 183 kB/s | 18 kB 00:00 2024-04-25T02:05:28.406 INFO:teuthology.orchestra.run.smithi079.stdout:(11/152): cephfs-mirror-19.0.0-2445.gd2c45d97.e 762 kB/s | 222 kB 00:00 2024-04-25T02:05:28.522 INFO:teuthology.orchestra.run.smithi079.stdout:(12/152): cephfs-shell-19.0.0-2445.gd2c45d97.el 232 kB/s | 27 kB 00:00 2024-04-25T02:05:28.597 INFO:teuthology.orchestra.run.smithi189.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 235 kB/s | 80 kB 00:00 2024-04-25T02:05:28.631 INFO:teuthology.orchestra.run.smithi079.stdout:(13/152): libcephfs-devel-19.0.0-2445.gd2c45d97 293 kB/s | 32 kB 00:00 2024-04-25T02:05:28.832 INFO:teuthology.orchestra.run.smithi079.stdout:(14/152): ceph-common-19.0.0-2445.gd2c45d97.el9 964 kB/s | 21 MB 00:22 2024-04-25T02:05:28.949 INFO:teuthology.orchestra.run.smithi079.stdout:(15/152): libcephsqlite-19.0.0-2445.gd2c45d97.e 1.4 MB/s | 163 kB 00:00 2024-04-25T02:05:29.022 INFO:teuthology.orchestra.run.smithi189.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 803 kB 00:00 2024-04-25T02:05:29.066 INFO:teuthology.orchestra.run.smithi079.stdout:(16/152): librados-devel-19.0.0-2445.gd2c45d97. 1.1 MB/s | 127 kB 00:00 2024-04-25T02:05:29.116 INFO:teuthology.orchestra.run.smithi079.stdout:(17/152): libcephfs2-19.0.0-2445.gd2c45d97.el9. 1.5 MB/s | 745 kB 00:00 2024-04-25T02:05:29.130 INFO:teuthology.orchestra.run.smithi189.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-04-25T02:05:29.239 INFO:teuthology.orchestra.run.smithi189.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-04-25T02:05:29.383 INFO:teuthology.orchestra.run.smithi079.stdout:(18/152): libradosstriper1-19.0.0-2445.gd2c45d9 1.5 MB/s | 501 kB 00:00 2024-04-25T02:05:29.514 INFO:teuthology.orchestra.run.smithi189.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 4.5 MB/s | 1.2 MB 00:00 2024-04-25T02:05:29.575 INFO:teuthology.orchestra.run.smithi079.stdout:(19/152): python3-ceph-argparse-19.0.0-2445.gd2 235 kB/s | 45 kB 00:00 2024-04-25T02:05:29.614 INFO:teuthology.orchestra.run.smithi189.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-04-25T02:05:29.683 INFO:teuthology.orchestra.run.smithi079.stdout:(20/152): python3-ceph-common-19.0.0-2445.gd2c4 1.2 MB/s | 133 kB 00:00 2024-04-25T02:05:29.723 INFO:teuthology.orchestra.run.smithi189.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-04-25T02:05:29.809 INFO:teuthology.orchestra.run.smithi079.stdout:(21/152): python3-cephfs-19.0.0-2445.gd2c45d97. 1.3 MB/s | 162 kB 00:00 2024-04-25T02:05:29.832 INFO:teuthology.orchestra.run.smithi189.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-04-25T02:05:29.932 INFO:teuthology.orchestra.run.smithi189.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-04-25T02:05:30.042 INFO:teuthology.orchestra.run.smithi079.stdout:(22/152): python3-rados-19.0.0-2445.gd2c45d97.e 1.3 MB/s | 321 kB 00:00 2024-04-25T02:05:30.066 INFO:teuthology.orchestra.run.smithi189.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 5.1 MB/s | 689 kB 00:00 2024-04-25T02:05:30.182 INFO:teuthology.orchestra.run.smithi189.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 7.9 MB/s | 943 kB 00:00 2024-04-25T02:05:30.234 INFO:teuthology.orchestra.run.smithi079.stdout:(23/152): python3-rbd-19.0.0-2445.gd2c45d97.el9 1.5 MB/s | 299 kB 00:00 2024-04-25T02:05:30.291 INFO:teuthology.orchestra.run.smithi189.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 987 kB/s | 107 kB 00:00 2024-04-25T02:05:30.351 INFO:teuthology.orchestra.run.smithi079.stdout:(24/152): python3-rgw-19.0.0-2445.gd2c45d97.el9 853 kB/s | 99 kB 00:00 2024-04-25T02:05:30.392 INFO:teuthology.orchestra.run.smithi189.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 214 kB/s | 21 kB 00:00 2024-04-25T02:05:30.468 INFO:teuthology.orchestra.run.smithi079.stdout:(25/152): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 731 kB/s | 85 kB 00:00 2024-04-25T02:05:30.501 INFO:teuthology.orchestra.run.smithi189.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-04-25T02:05:30.601 INFO:teuthology.orchestra.run.smithi189.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 328 kB/s | 33 kB 00:00 2024-04-25T02:05:31.485 INFO:teuthology.orchestra.run.smithi079.stdout:(26/152): librgw2-19.0.0-2445.gd2c45d97.el9.x86 2.2 MB/s | 5.3 MB 00:02 2024-04-25T02:05:31.602 INFO:teuthology.orchestra.run.smithi079.stdout:(27/152): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 1.4 MB/s | 171 kB 00:00 2024-04-25T02:05:31.702 INFO:teuthology.orchestra.run.smithi079.stdout:(28/152): ceph-grafana-dashboards-19.0.0-2445.g 318 kB/s | 32 kB 00:00 2024-04-25T02:05:31.777 INFO:teuthology.orchestra.run.smithi079.stdout:(29/152): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 2.4 MB/s | 3.1 MB 00:01 2024-04-25T02:05:31.828 INFO:teuthology.orchestra.run.smithi079.stdout:(30/152): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 1.1 MB/s | 141 kB 00:00 2024-04-25T02:05:32.534 INFO:teuthology.orchestra.run.smithi189.stdout:(53/152): ceph-mgr-diskprediction-local-19.0.0- 1.4 MB/s | 7.4 MB 00:05 2024-04-25T02:05:32.593 INFO:teuthology.orchestra.run.smithi189.stdout:(54/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.5 MB/s | 3.0 MB 00:01 2024-04-25T02:05:32.693 INFO:teuthology.orchestra.run.smithi189.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-04-25T02:05:32.785 INFO:teuthology.orchestra.run.smithi189.stdout:(56/152): flexiblas-openblas-openmp-3.0.4-8.el9 73 kB/s | 18 kB 00:00 2024-04-25T02:05:32.977 INFO:teuthology.orchestra.run.smithi189.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 565 kB/s | 160 kB 00:00 2024-04-25T02:05:32.994 INFO:teuthology.orchestra.run.smithi189.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 217 kB/s | 45 kB 00:00 2024-04-25T02:05:33.536 INFO:teuthology.orchestra.run.smithi079.stdout:(31/152): ceph-mgr-dashboard-19.0.0-2445.gd2c45 2.0 MB/s | 3.5 MB 00:01 2024-04-25T02:05:33.645 INFO:teuthology.orchestra.run.smithi079.stdout:(32/152): ceph-mgr-modules-core-19.0.0-2445.gd2 2.2 MB/s | 249 kB 00:00 2024-04-25T02:05:33.711 INFO:teuthology.orchestra.run.smithi189.stdout:(59/152): ceph-test-19.0.0-2445.gd2c45d97.el9.x 2.3 MB/s | 48 MB 00:20 2024-04-25T02:05:33.744 INFO:teuthology.orchestra.run.smithi189.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 776 kB/s | 582 kB 00:00 2024-04-25T02:05:33.745 INFO:teuthology.orchestra.run.smithi079.stdout:(33/152): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 494 kB/s | 49 kB 00:00 2024-04-25T02:05:33.862 INFO:teuthology.orchestra.run.smithi079.stdout:(34/152): ceph-prometheus-alerts-19.0.0-2445.gd 131 kB/s | 15 kB 00:00 2024-04-25T02:05:33.869 INFO:teuthology.orchestra.run.smithi189.stdout:(61/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 380 kB/s | 47 kB 00:00 2024-04-25T02:05:33.987 INFO:teuthology.orchestra.run.smithi189.stdout:(62/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-04-25T02:05:34.029 INFO:teuthology.orchestra.run.smithi189.stdout:(63/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 80 kB/s | 25 kB 00:00 2024-04-25T02:05:34.054 INFO:teuthology.orchestra.run.smithi079.stdout:(35/152): ceph-volume-19.0.0-2445.gd2c45d97.el9 1.3 MB/s | 264 kB 00:00 2024-04-25T02:05:34.112 INFO:teuthology.orchestra.run.smithi189.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-04-25T02:05:34.163 INFO:teuthology.orchestra.run.smithi189.stdout:(65/152): librdkafka-1.6.1-102.el9.x86_64.rpm 559 kB/s | 662 kB 00:01 2024-04-25T02:05:34.263 INFO:teuthology.orchestra.run.smithi189.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 151 kB/s | 35 kB 00:00 2024-04-25T02:05:34.354 INFO:teuthology.orchestra.run.smithi079.stdout:(36/152): cephadm-19.0.0-2445.gd2c45d97.el9.noa 2.5 MB/s | 762 kB 00:00 2024-04-25T02:05:34.463 INFO:teuthology.orchestra.run.smithi079.stdout:(37/152): cephfs-top-19.0.0-2445.gd2c45d97.el9. 168 kB/s | 18 kB 00:00 2024-04-25T02:05:34.863 INFO:teuthology.orchestra.run.smithi079.stdout:(38/152): ceph-mgr-diskprediction-local-19.0.0- 2.4 MB/s | 7.4 MB 00:03 2024-04-25T02:05:34.888 INFO:teuthology.orchestra.run.smithi079.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 189 kB/s | 80 kB 00:00 2024-04-25T02:05:35.022 INFO:teuthology.orchestra.run.smithi079.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 5.0 MB/s | 803 kB 00:00 2024-04-25T02:05:35.072 INFO:teuthology.orchestra.run.smithi079.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-04-25T02:05:35.096 INFO:teuthology.orchestra.run.smithi189.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 1.9 MB/s | 1.6 MB 00:00 2024-04-25T02:05:35.097 INFO:teuthology.orchestra.run.smithi079.stdout:(42/152): libquadmath-11.4.1-3.el9.x86_64.rpm 936 kB/s | 195 kB 00:00 2024-04-25T02:05:35.156 INFO:teuthology.orchestra.run.smithi079.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-04-25T02:05:35.181 INFO:teuthology.orchestra.run.smithi079.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-04-25T02:05:35.223 INFO:teuthology.orchestra.run.smithi079.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-04-25T02:05:35.248 INFO:teuthology.orchestra.run.smithi079.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-25T02:05:35.290 INFO:teuthology.orchestra.run.smithi079.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-04-25T02:05:35.322 INFO:teuthology.orchestra.run.smithi189.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 4.0 MB/s | 911 kB 00:00 2024-04-25T02:05:35.430 INFO:teuthology.orchestra.run.smithi189.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 1.2 MB/s | 133 kB 00:00 2024-04-25T02:05:35.599 INFO:teuthology.orchestra.run.smithi079.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 1.9 MB/s | 689 kB 00:00 2024-04-25T02:05:35.899 INFO:teuthology.orchestra.run.smithi079.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 357 kB/s | 107 kB 00:00 2024-04-25T02:05:35.974 INFO:teuthology.orchestra.run.smithi079.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 943 kB 00:00 2024-04-25T02:05:36.041 INFO:teuthology.orchestra.run.smithi079.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 151 kB/s | 21 kB 00:00 2024-04-25T02:05:36.200 INFO:teuthology.orchestra.run.smithi079.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 207 kB/s | 33 kB 00:00 2024-04-25T02:05:36.233 INFO:teuthology.orchestra.run.smithi079.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 1.2 MB/s | 313 kB 00:00 2024-04-25T02:05:36.239 INFO:teuthology.orchestra.run.smithi189.stdout:(70/152): openblas-openmp-0.3.21-2.el9.x86_64.r 2.2 MB/s | 4.7 MB 00:02 2024-04-25T02:05:36.401 INFO:teuthology.orchestra.run.smithi079.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 109 kB/s | 18 kB 00:00 2024-04-25T02:05:36.545 INFO:teuthology.orchestra.run.smithi079.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 77 kB/s | 11 kB 00:00 2024-04-25T02:05:36.784 INFO:teuthology.orchestra.run.smithi079.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 671 kB/s | 160 kB 00:00 2024-04-25T02:05:36.985 INFO:teuthology.orchestra.run.smithi079.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 226 kB/s | 45 kB 00:00 2024-04-25T02:05:37.227 INFO:teuthology.orchestra.run.smithi079.stdout:(58/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-04-25T02:05:37.460 INFO:teuthology.orchestra.run.smithi079.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 1.4 MB/s | 662 kB 00:00 2024-04-25T02:05:37.569 INFO:teuthology.orchestra.run.smithi079.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 1.7 MB/s | 582 kB 00:00 2024-04-25T02:05:37.594 INFO:teuthology.orchestra.run.smithi079.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 191 kB/s | 25 kB 00:00 2024-04-25T02:05:37.744 INFO:teuthology.orchestra.run.smithi079.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 271 kB/s | 47 kB 00:00 2024-04-25T02:05:37.805 INFO:teuthology.orchestra.run.smithi189.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 660 kB/s | 1.0 MB 00:01 2024-04-25T02:05:37.919 INFO:teuthology.orchestra.run.smithi079.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 899 kB/s | 292 kB 00:00 2024-04-25T02:05:37.989 INFO:teuthology.orchestra.run.smithi189.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 477 kB/s | 87 kB 00:00 2024-04-25T02:05:37.994 INFO:teuthology.orchestra.run.smithi079.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 753 kB/s | 188 kB 00:00 2024-04-25T02:05:38.062 INFO:teuthology.orchestra.run.smithi079.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 248 kB/s | 35 kB 00:00 2024-04-25T02:05:39.320 INFO:teuthology.orchestra.run.smithi079.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 3.6 MB/s | 4.7 MB 00:01 2024-04-25T02:05:39.895 INFO:teuthology.orchestra.run.smithi079.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 2.8 MB/s | 1.6 MB 00:00 2024-04-25T02:05:40.129 INFO:teuthology.orchestra.run.smithi079.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 2.1 MB/s | 4.4 MB 00:02 2024-04-25T02:05:40.373 INFO:teuthology.orchestra.run.smithi079.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 552 kB/s | 133 kB 00:00 2024-04-25T02:05:40.529 INFO:teuthology.orchestra.run.smithi079.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 1.4 MB/s | 911 kB 00:00 2024-04-25T02:05:40.539 INFO:teuthology.orchestra.run.smithi189.stdout:(73/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 710 kB/s | 4.4 MB 00:06 2024-04-25T02:05:40.881 INFO:teuthology.orchestra.run.smithi189.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 714 kB/s | 244 kB 00:00 2024-04-25T02:05:40.955 INFO:teuthology.orchestra.run.smithi079.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 2.4 MB/s | 1.0 MB 00:00 2024-04-25T02:05:41.181 INFO:teuthology.orchestra.run.smithi189.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 826 kB/s | 248 kB 00:00 2024-04-25T02:05:41.230 INFO:teuthology.orchestra.run.smithi079.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 318 kB/s | 87 kB 00:00 2024-04-25T02:05:41.281 INFO:teuthology.orchestra.run.smithi189.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-04-25T02:05:41.348 INFO:teuthology.orchestra.run.smithi189.stdout:(77/152): postgresql-server-13.14-1.el9.x86_64. 1.0 MB/s | 5.8 MB 00:05 2024-04-25T02:05:41.384 INFO:teuthology.orchestra.run.smithi189.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 187 kB/s | 19 kB 00:00 2024-04-25T02:05:41.484 INFO:teuthology.orchestra.run.smithi189.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 347 kB/s | 35 kB 00:00 2024-04-25T02:05:41.605 INFO:teuthology.orchestra.run.smithi079.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 4.7 MB/s | 5.8 MB 00:01 2024-04-25T02:05:41.626 INFO:teuthology.orchestra.run.smithi189.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 620 kB/s | 172 kB 00:00 2024-04-25T02:05:41.727 INFO:teuthology.orchestra.run.smithi189.stdout:(81/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 5.1 MB 00:00 2024-04-25T02:05:41.835 INFO:teuthology.orchestra.run.smithi189.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-04-25T02:05:41.855 INFO:teuthology.orchestra.run.smithi079.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 977 kB/s | 244 kB 00:00 2024-04-25T02:05:41.935 INFO:teuthology.orchestra.run.smithi189.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 771 kB/s | 77 kB 00:00 2024-04-25T02:05:42.027 INFO:teuthology.orchestra.run.smithi189.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 462 kB/s | 42 kB 00:00 2024-04-25T02:05:42.052 INFO:teuthology.orchestra.run.smithi189.stdout:(85/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 588 kB/s | 250 kB 00:00 2024-04-25T02:05:42.106 INFO:teuthology.orchestra.run.smithi079.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 992 kB/s | 248 kB 00:00 2024-04-25T02:05:42.136 INFO:teuthology.orchestra.run.smithi189.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-04-25T02:05:42.239 INFO:teuthology.orchestra.run.smithi079.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 192 kB/s | 26 kB 00:00 2024-04-25T02:05:42.245 INFO:teuthology.orchestra.run.smithi189.stdout:(87/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-04-25T02:05:42.353 INFO:teuthology.orchestra.run.smithi189.stdout:(88/152): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-04-25T02:05:42.378 INFO:teuthology.orchestra.run.smithi189.stdout:(89/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 487 kB/s | 159 kB 00:00 2024-04-25T02:05:42.398 INFO:teuthology.orchestra.run.smithi079.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 121 kB/s | 19 kB 00:00 2024-04-25T02:05:42.454 INFO:teuthology.orchestra.run.smithi189.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 535 kB/s | 54 kB 00:00 2024-04-25T02:05:42.546 INFO:teuthology.orchestra.run.smithi189.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 454 kB/s | 42 kB 00:00 2024-04-25T02:05:42.565 INFO:teuthology.orchestra.run.smithi079.stdout:(78/152): python3-babel-2.9.1-2.el9.noarch.rpm 4.5 MB/s | 6.0 MB 00:01 2024-04-25T02:05:42.638 INFO:teuthology.orchestra.run.smithi189.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 482 kB/s | 44 kB 00:00 2024-04-25T02:05:42.657 INFO:teuthology.orchestra.run.smithi079.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 665 kB/s | 172 kB 00:00 2024-04-25T02:05:42.724 INFO:teuthology.orchestra.run.smithi079.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 219 kB/s | 35 kB 00:00 2024-04-25T02:05:42.746 INFO:teuthology.orchestra.run.smithi189.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-04-25T02:05:42.838 INFO:teuthology.orchestra.run.smithi189.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 391 kB/s | 36 kB 00:00 2024-04-25T02:05:42.930 INFO:teuthology.orchestra.run.smithi189.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 517 kB/s | 47 kB 00:00 2024-04-25T02:05:42.982 INFO:teuthology.orchestra.run.smithi079.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 969 kB/s | 250 kB 00:00 2024-04-25T02:05:43.039 INFO:teuthology.orchestra.run.smithi189.stdout:(96/152): socat-1.7.4.1-5.el9.x86_64.rpm 2.7 MB/s | 305 kB 00:00 2024-04-25T02:05:43.139 INFO:teuthology.orchestra.run.smithi189.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 579 kB/s | 58 kB 00:00 2024-04-25T02:05:43.240 INFO:teuthology.orchestra.run.smithi189.stdout:(98/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 938 kB/s | 94 kB 00:00 2024-04-25T02:05:43.258 INFO:teuthology.orchestra.run.smithi079.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 808 kB/s | 222 kB 00:00 2024-04-25T02:05:43.332 INFO:teuthology.orchestra.run.smithi189.stdout:(99/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 696 kB/s | 64 kB 00:00 2024-04-25T02:05:43.423 INFO:teuthology.orchestra.run.smithi189.stdout:(100/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 489 kB/s | 45 kB 00:00 2024-04-25T02:05:43.466 INFO:teuthology.orchestra.run.smithi079.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 370 kB/s | 77 kB 00:00 2024-04-25T02:05:43.532 INFO:teuthology.orchestra.run.smithi189.stdout:(101/152): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-04-25T02:05:43.633 INFO:teuthology.orchestra.run.smithi079.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 253 kB/s | 42 kB 00:00 2024-04-25T02:05:43.742 INFO:teuthology.orchestra.run.smithi079.stdout:(85/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.7 MB/s | 5.1 MB 00:01 2024-04-25T02:05:43.791 INFO:teuthology.orchestra.run.smithi189.stdout:(102/152): protobuf-compiler-3.14.0-13.el9.x86_ 3.3 MB/s | 863 kB 00:00 2024-04-25T02:05:43.951 INFO:teuthology.orchestra.run.smithi079.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 850 kB/s | 269 kB 00:00 2024-04-25T02:05:43.993 INFO:teuthology.orchestra.run.smithi079.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 634 kB/s | 159 kB 00:00 2024-04-25T02:05:44.193 INFO:teuthology.orchestra.run.smithi079.stdout:(88/152): python3-pytz-2021.1-5.el9.noarch.rpm 255 kB/s | 51 kB 00:00 2024-04-25T02:05:44.224 INFO:teuthology.orchestra.run.smithi189.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-04-25T02:05:44.259 INFO:teuthology.orchestra.run.smithi079.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 903 kB/s | 279 kB 00:00 2024-04-25T02:05:44.316 INFO:teuthology.orchestra.run.smithi189.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-04-25T02:05:44.376 INFO:teuthology.orchestra.run.smithi079.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 292 kB/s | 54 kB 00:00 2024-04-25T02:05:44.383 INFO:teuthology.orchestra.run.smithi189.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 292 kB/s | 19 kB 00:00 2024-04-25T02:05:44.577 INFO:teuthology.orchestra.run.smithi079.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 208 kB/s | 42 kB 00:00 2024-04-25T02:05:44.659 INFO:teuthology.orchestra.run.smithi189.stdout:(106/152): libarrow-9.0.0-10.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-04-25T02:05:44.726 INFO:teuthology.orchestra.run.smithi189.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 390 kB/s | 26 kB 00:00 2024-04-25T02:05:44.777 INFO:teuthology.orchestra.run.smithi079.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 221 kB/s | 44 kB 00:00 2024-04-25T02:05:44.793 INFO:teuthology.orchestra.run.smithi189.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 727 kB/s | 49 kB 00:00 2024-04-25T02:05:44.877 INFO:teuthology.orchestra.run.smithi189.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 808 kB/s | 67 kB 00:00 2024-04-25T02:05:44.968 INFO:teuthology.orchestra.run.smithi189.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-04-25T02:05:45.060 INFO:teuthology.orchestra.run.smithi189.stdout:(111/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 8.9 MB/s | 838 kB 00:00 2024-04-25T02:05:45.069 INFO:teuthology.orchestra.run.smithi079.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 757 kB/s | 221 kB 00:00 2024-04-25T02:05:45.152 INFO:teuthology.orchestra.run.smithi189.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-04-25T02:05:45.219 INFO:teuthology.orchestra.run.smithi189.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 652 kB/s | 43 kB 00:00 2024-04-25T02:05:45.220 INFO:teuthology.orchestra.run.smithi079.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 239 kB/s | 36 kB 00:00 2024-04-25T02:05:45.419 INFO:teuthology.orchestra.run.smithi079.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 237 kB/s | 47 kB 00:00 2024-04-25T02:05:45.703 INFO:teuthology.orchestra.run.smithi189.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 67 kB/s | 32 kB 00:00 2024-04-25T02:05:45.770 INFO:teuthology.orchestra.run.smithi189.stdout:(115/152): python3-certifi-2021.10.8-2.el9.noar 225 kB/s | 15 kB 00:00 2024-04-25T02:05:45.778 INFO:teuthology.orchestra.run.smithi079.stdout:(96/152): socat-1.7.4.1-5.el9.x86_64.rpm 851 kB/s | 305 kB 00:00 2024-04-25T02:05:45.837 INFO:teuthology.orchestra.run.smithi189.stdout:(116/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-04-25T02:05:45.912 INFO:teuthology.orchestra.run.smithi189.stdout:(117/152): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-04-25T02:05:45.953 INFO:teuthology.orchestra.run.smithi079.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 330 kB/s | 58 kB 00:00 2024-04-25T02:05:45.987 INFO:teuthology.orchestra.run.smithi189.stdout:(118/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2024-04-25T02:05:46.054 INFO:teuthology.orchestra.run.smithi189.stdout:(119/152): python3-colorama-0.4.4-12.el9.noarch 528 kB/s | 35 kB 00:00 2024-04-25T02:05:46.130 INFO:teuthology.orchestra.run.smithi189.stdout:(120/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-25T02:05:46.214 INFO:teuthology.orchestra.run.smithi079.stdout:(98/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.3 MB/s | 16 MB 00:01 2024-04-25T02:05:46.221 INFO:teuthology.orchestra.run.smithi189.stdout:(121/152): python3-babel-2.9.1-2.el9.noarch.rpm 742 kB/s | 6.0 MB 00:08 2024-04-25T02:05:46.280 INFO:teuthology.orchestra.run.smithi189.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-04-25T02:05:46.364 INFO:teuthology.orchestra.run.smithi189.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-04-25T02:05:46.455 INFO:teuthology.orchestra.run.smithi189.stdout:(124/152): python3-jaraco-classes-3.2.1-5.el9.n 193 kB/s | 18 kB 00:00 2024-04-25T02:05:46.522 INFO:teuthology.orchestra.run.smithi189.stdout:(125/152): python3-jaraco-collections-3.0.0-8.e 348 kB/s | 23 kB 00:00 2024-04-25T02:05:46.598 INFO:teuthology.orchestra.run.smithi189.stdout:(126/152): python3-jaraco-functools-3.5.0-2.el9 259 kB/s | 19 kB 00:00 2024-04-25T02:05:46.637 INFO:teuthology.orchestra.run.smithi079.stdout:(99/152): ceph-test-19.0.0-2445.gd2c45d97.el9.x 1.6 MB/s | 48 MB 00:30 2024-04-25T02:05:46.662 INFO:teuthology.orchestra.run.smithi079.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 132 kB/s | 94 kB 00:00 2024-04-25T02:05:46.665 INFO:teuthology.orchestra.run.smithi189.stdout:(127/152): python3-grpcio-tools-1.46.7-10.el9.x 326 kB/s | 144 kB 00:00 2024-04-25T02:05:46.690 INFO:teuthology.orchestra.run.smithi189.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2024-04-25T02:05:46.749 INFO:teuthology.orchestra.run.smithi189.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 793 kB/s | 46 kB 00:00 2024-04-25T02:05:46.779 INFO:teuthology.orchestra.run.smithi079.stdout:(101/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 112 kB/s | 64 kB 00:00 2024-04-25T02:05:46.824 INFO:teuthology.orchestra.run.smithi189.stdout:(130/152): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-04-25T02:05:46.829 INFO:teuthology.orchestra.run.smithi079.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 234 kB/s | 45 kB 00:00 2024-04-25T02:05:46.883 INFO:teuthology.orchestra.run.smithi189.stdout:(131/152): python3-natsort-7.1.1-5.el9.noarch.r 990 kB/s | 58 kB 00:00 2024-04-25T02:05:46.916 INFO:teuthology.orchestra.run.smithi189.stdout:(132/152): python3-kubernetes-26.1.0-2.el9.noar 4.1 MB/s | 1.0 MB 00:00 2024-04-25T02:05:46.929 INFO:teuthology.orchestra.run.smithi079.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 84 kB/s | 22 kB 00:00 2024-04-25T02:05:46.958 INFO:teuthology.orchestra.run.smithi189.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-25T02:05:46.984 INFO:teuthology.orchestra.run.smithi189.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-04-25T02:05:47.026 INFO:teuthology.orchestra.run.smithi189.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-25T02:05:47.051 INFO:teuthology.orchestra.run.smithi189.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 421 kB/s | 28 kB 00:00 2024-04-25T02:05:47.093 INFO:teuthology.orchestra.run.smithi189.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-04-25T02:05:47.126 INFO:teuthology.orchestra.run.smithi189.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-25T02:05:47.152 INFO:teuthology.orchestra.run.smithi189.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-25T02:05:47.185 INFO:teuthology.orchestra.run.smithi189.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 611 kB/s | 36 kB 00:00 2024-04-25T02:05:47.210 INFO:teuthology.orchestra.run.smithi189.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 869 kB/s | 51 kB 00:00 2024-04-25T02:05:47.277 INFO:teuthology.orchestra.run.smithi189.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-25T02:05:47.292 INFO:teuthology.orchestra.run.smithi079.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-04-25T02:05:47.303 INFO:teuthology.orchestra.run.smithi189.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 976 kB/s | 90 kB 00:00 2024-04-25T02:05:47.369 INFO:teuthology.orchestra.run.smithi189.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-04-25T02:05:47.372 INFO:teuthology.orchestra.run.smithi079.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 246 kB/s | 19 kB 00:00 2024-04-25T02:05:47.395 INFO:teuthology.orchestra.run.smithi189.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-04-25T02:05:47.448 INFO:teuthology.orchestra.run.smithi079.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 596 kB/s | 309 kB 00:00 2024-04-25T02:05:47.453 INFO:teuthology.orchestra.run.smithi189.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-04-25T02:05:47.512 INFO:teuthology.orchestra.run.smithi189.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-04-25T02:05:47.530 INFO:teuthology.orchestra.run.smithi079.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 317 kB/s | 26 kB 00:00 2024-04-25T02:05:47.589 INFO:teuthology.orchestra.run.smithi079.stdout:(108/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-04-25T02:05:47.614 INFO:teuthology.orchestra.run.smithi079.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 580 kB/s | 49 kB 00:00 2024-04-25T02:05:47.699 INFO:teuthology.orchestra.run.smithi079.stdout:(110/152): libarrow-9.0.0-10.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-25T02:05:47.749 INFO:teuthology.orchestra.run.smithi079.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-04-25T02:05:47.807 INFO:teuthology.orchestra.run.smithi079.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 10 MB/s | 838 kB 00:00 2024-04-25T02:05:47.874 INFO:teuthology.orchestra.run.smithi079.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 653 kB/s | 43 kB 00:00 2024-04-25T02:05:47.916 INFO:teuthology.orchestra.run.smithi079.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-04-25T02:05:47.941 INFO:teuthology.orchestra.run.smithi079.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 482 kB/s | 32 kB 00:00 2024-04-25T02:05:47.967 INFO:teuthology.orchestra.run.smithi079.stdout:(116/152): libunwind-1.6.2-1.el9.x86_64.rpm 179 kB/s | 67 kB 00:00 2024-04-25T02:05:47.992 INFO:teuthology.orchestra.run.smithi079.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-04-25T02:05:48.025 INFO:teuthology.orchestra.run.smithi079.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-25T02:05:48.067 INFO:teuthology.orchestra.run.smithi079.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-04-25T02:05:48.101 INFO:teuthology.orchestra.run.smithi079.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 469 kB/s | 35 kB 00:00 2024-04-25T02:05:48.160 INFO:teuthology.orchestra.run.smithi079.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 2.2 MB/s | 206 kB 00:00 2024-04-25T02:05:48.243 INFO:teuthology.orchestra.run.smithi079.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-04-25T02:05:48.268 INFO:teuthology.orchestra.run.smithi079.stdout:(123/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.1 MB/s | 303 kB 00:00 2024-04-25T02:05:48.293 INFO:teuthology.orchestra.run.smithi079.stdout:(124/152): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-25T02:05:48.319 INFO:teuthology.orchestra.run.smithi079.stdout:(125/152): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-04-25T02:05:48.345 INFO:teuthology.orchestra.run.smithi079.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-04-25T02:05:48.394 INFO:teuthology.orchestra.run.smithi079.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-04-25T02:05:48.419 INFO:teuthology.orchestra.run.smithi079.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-25T02:05:48.495 INFO:teuthology.orchestra.run.smithi079.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 617 kB/s | 46 kB 00:00 2024-04-25T02:05:48.537 INFO:teuthology.orchestra.run.smithi079.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-04-25T02:05:48.579 INFO:teuthology.orchestra.run.smithi079.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 944 kB/s | 79 kB 00:00 2024-04-25T02:05:48.612 INFO:teuthology.orchestra.run.smithi079.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 767 kB/s | 58 kB 00:00 2024-04-25T02:05:48.679 INFO:teuthology.orchestra.run.smithi079.stdout:(133/152): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-04-25T02:05:48.704 INFO:teuthology.orchestra.run.smithi079.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-04-25T02:05:48.755 INFO:teuthology.orchestra.run.smithi079.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-25T02:05:48.780 INFO:teuthology.orchestra.run.smithi079.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 375 kB/s | 28 kB 00:00 2024-04-25T02:05:48.822 INFO:teuthology.orchestra.run.smithi079.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 460 kB/s | 31 kB 00:00 2024-04-25T02:05:48.872 INFO:teuthology.orchestra.run.smithi079.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-04-25T02:05:48.898 INFO:teuthology.orchestra.run.smithi079.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 782 kB/s | 59 kB 00:00 2024-04-25T02:05:48.965 INFO:teuthology.orchestra.run.smithi079.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-04-25T02:05:48.990 INFO:teuthology.orchestra.run.smithi079.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 554 kB/s | 51 kB 00:00 2024-04-25T02:05:49.065 INFO:teuthology.orchestra.run.smithi079.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-04-25T02:05:49.090 INFO:teuthology.orchestra.run.smithi079.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 895 kB/s | 90 kB 00:00 2024-04-25T02:05:49.157 INFO:teuthology.orchestra.run.smithi079.stdout:(144/152): python3-zc-lockfile-2.0-10.el9.noarc 300 kB/s | 20 kB 00:00 2024-04-25T02:05:49.183 INFO:teuthology.orchestra.run.smithi079.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-04-25T02:05:49.233 INFO:teuthology.orchestra.run.smithi079.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-25T02:05:49.366 INFO:teuthology.orchestra.run.smithi079.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-04-25T02:05:49.604 INFO:teuthology.orchestra.run.smithi189.stdout:(148/152): librbd1-19.0.0-2445.gd2c45d97.el9.x8 1.5 MB/s | 3.1 MB 00:02 2024-04-25T02:05:49.691 INFO:teuthology.orchestra.run.smithi079.stdout:(148/152): python3-jaraco-collections-3.0.0-8.e 17 kB/s | 23 kB 00:01 2024-04-25T02:05:49.933 INFO:teuthology.orchestra.run.smithi079.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 5.6 MB/s | 1.3 MB 00:00 2024-04-25T02:05:50.075 INFO:teuthology.orchestra.run.smithi079.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-04-25T02:05:50.446 INFO:teuthology.orchestra.run.smithi189.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 1.6 MB/s | 1.3 MB 00:00 2024-04-25T02:05:50.829 INFO:teuthology.orchestra.run.smithi189.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 6.2 MB/s | 2.4 MB 00:00 2024-04-25T02:05:50.967 INFO:teuthology.orchestra.run.smithi079.stdout:(151/152): librados2-19.0.0-2445.gd2c45d97.el9. 2.0 MB/s | 3.4 MB 00:01 2024-04-25T02:05:51.247 INFO:teuthology.orchestra.run.smithi189.stdout:(151/152): librados2-19.0.0-2445.gd2c45d97.el9. 914 kB/s | 3.4 MB 00:03 2024-04-25T02:05:51.609 INFO:teuthology.orchestra.run.smithi079.stdout:(152/152): librbd1-19.0.0-2445.gd2c45d97.el9.x8 1.4 MB/s | 3.1 MB 00:02 2024-04-25T02:05:51.615 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:05:51.615 INFO:teuthology.orchestra.run.smithi079.stdout:Total 4.8 MB/s | 220 MB 00:45 2024-04-25T02:05:52.715 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-04-25T02:05:52.857 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-04-25T02:05:52.857 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-04-25T02:05:54.607 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-04-25T02:05:54.607 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-04-25T02:06:00.535 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-04-25T02:06:00.628 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T02:06:00.667 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T02:06:00.720 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T02:06:00.728 INFO:teuthology.orchestra.run.smithi189.stdout:(152/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 907 kB/s | 16 MB 00:18 2024-04-25T02:06:00.734 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:06:00.734 INFO:teuthology.orchestra.run.smithi189.stdout:Total 4.0 MB/s | 220 MB 00:54 2024-04-25T02:06:00.754 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T02:06:00.780 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T02:06:00.822 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T02:06:01.154 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T02:06:01.306 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T02:06:01.409 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T02:06:01.440 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T02:06:01.531 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T02:06:01.569 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T02:06:01.721 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T02:06:01.774 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T02:06:01.782 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2024-04-25T02:06:01.802 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T02:06:01.888 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T02:06:01.912 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T02:06:01.928 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction check succeeded. 2024-04-25T02:06:01.928 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2024-04-25T02:06:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T02:06:02.004 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T02:06:02.028 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T02:06:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T02:06:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T02:06:02.328 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T02:06:02.424 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T02:06:02.453 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T02:06:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T02:06:02.552 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T02:06:02.594 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T02:06:02.638 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T02:06:02.671 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T02:06:02.699 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T02:06:02.768 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T02:06:02.821 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T02:06:02.851 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T02:06:02.886 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T02:06:02.963 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T02:06:02.997 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 31/156 2024-04-25T02:06:03.041 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 32/156 2024-04-25T02:06:03.069 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 33/156 2024-04-25T02:06:03.140 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T02:06:03.192 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T02:06:03.267 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T02:06:03.402 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T02:06:03.453 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T02:06:03.690 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded. 2024-04-25T02:06:03.691 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2024-04-25T02:06:03.986 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T02:06:04.065 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T02:06:04.094 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T02:06:04.137 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T02:06:04.175 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 43/156 2024-04-25T02:06:04.217 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T02:06:04.383 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T02:06:04.436 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T02:06:04.491 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T02:06:04.564 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T02:06:04.595 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T02:06:04.631 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T02:06:04.678 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T02:06:04.722 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T02:06:04.766 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T02:06:04.816 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T02:06:04.952 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T02:06:04.996 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T02:06:05.026 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T02:06:05.068 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T02:06:05.162 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T02:06:05.232 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T02:06:05.274 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T02:06:05.300 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T02:06:05.333 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T02:06:05.408 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T02:06:05.538 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T02:06:05.573 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T02:06:05.593 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T02:06:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T02:06:05.683 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T02:06:05.715 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T02:06:05.745 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T02:06:05.779 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T02:06:05.812 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T02:06:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T02:06:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T02:06:05.976 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T02:06:06.018 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T02:06:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T02:06:06.097 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T02:06:06.196 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T02:06:06.250 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T02:06:06.976 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T02:06:07.023 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T02:06:07.056 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T02:06:07.157 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T02:06:07.215 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T02:06:07.303 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T02:06:07.342 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T02:06:07.528 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T02:06:07.556 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T02:06:07.634 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T02:06:08.288 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T02:06:08.405 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T02:06:09.638 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T02:06:09.666 INFO:teuthology.orchestra.run.smithi189.stdout: Preparing : 1/1 2024-04-25T02:06:09.710 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T02:06:09.729 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T02:06:09.754 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T02:06:09.757 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T02:06:09.796 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T02:06:09.849 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T02:06:09.883 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T02:06:09.909 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T02:06:09.952 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T02:06:10.068 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T02:06:10.117 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T02:06:10.191 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T02:06:10.221 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 100/156 2024-04-25T02:06:10.258 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T02:06:10.283 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T02:06:10.384 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T02:06:10.505 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T02:06:10.535 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T02:06:10.627 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T02:06:10.656 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T02:06:10.728 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T02:06:10.753 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T02:06:10.810 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T02:06:10.824 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T02:06:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 104/156 2024-04-25T02:06:10.861 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T02:06:10.889 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T02:06:10.977 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T02:06:10.999 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T02:06:11.061 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T02:06:11.075 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T02:06:11.096 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T02:06:11.283 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T02:06:11.316 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T02:06:11.423 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T02:06:11.520 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T02:06:11.557 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T02:06:11.591 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T02:06:11.656 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T02:06:11.691 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T02:06:11.740 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T02:06:11.775 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T02:06:11.803 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T02:06:11.873 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T02:06:11.926 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T02:06:11.956 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T02:06:12.009 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T02:06:12.087 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T02:06:12.119 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 31/156 2024-04-25T02:06:12.163 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 32/156 2024-04-25T02:06:12.191 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 33/156 2024-04-25T02:06:12.262 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T02:06:12.316 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T02:06:12.389 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T02:06:12.533 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T02:06:12.592 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T02:06:13.128 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T02:06:13.152 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T02:06:13.194 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T02:06:13.212 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T02:06:13.241 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T02:06:13.283 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T02:06:13.321 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 43/156 2024-04-25T02:06:13.363 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T02:06:13.534 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T02:06:13.591 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T02:06:13.646 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T02:06:13.719 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T02:06:13.734 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T02:06:13.750 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T02:06:13.772 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T02:06:13.786 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T02:06:13.834 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T02:06:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T02:06:13.868 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T02:06:13.868 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T02:06:13.868 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:06:13.869 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T02:06:13.898 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T02:06:13.912 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T02:06:13.954 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T02:06:14.100 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T02:06:14.152 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T02:06:14.182 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T02:06:14.223 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T02:06:14.318 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T02:06:14.348 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T02:06:14.388 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T02:06:14.414 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T02:06:14.438 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T02:06:14.515 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T02:06:14.642 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T02:06:14.679 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T02:06:14.707 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T02:06:14.741 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T02:06:14.781 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T02:06:14.812 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T02:06:14.842 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T02:06:14.876 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T02:06:14.909 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T02:06:14.951 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T02:06:14.986 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T02:06:15.073 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T02:06:15.124 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T02:06:15.155 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T02:06:15.202 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T02:06:15.302 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T02:06:15.357 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T02:06:16.094 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T02:06:16.137 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T02:06:16.171 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T02:06:16.281 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T02:06:16.338 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T02:06:16.426 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T02:06:16.465 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T02:06:16.643 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T02:06:16.679 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T02:06:16.758 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T02:06:17.408 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T02:06:17.528 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T02:06:18.773 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T02:06:18.850 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T02:06:18.878 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T02:06:18.910 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T02:06:19.222 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T02:06:19.265 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T02:06:19.356 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T02:06:19.386 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 100/156 2024-04-25T02:06:19.423 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T02:06:19.894 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T02:06:19.926 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T02:06:19.997 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T02:06:20.036 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 104/156 2024-04-25T02:06:22.276 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T02:06:22.316 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T02:06:22.862 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T02:06:22.911 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T02:06:23.002 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T02:06:23.003 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T02:06:23.003 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T02:06:23.003 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:06:23.029 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T02:06:25.405 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T02:06:25.406 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /sys 2024-04-25T02:06:25.406 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /proc 2024-04-25T02:06:25.406 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /mnt 2024-04-25T02:06:25.406 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /var/tmp 2024-04-25T02:06:25.406 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /home 2024-04-25T02:06:25.406 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /root 2024-04-25T02:06:25.406 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /tmp 2024-04-25T02:06:25.406 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:06:25.583 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T02:06:25.598 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T02:06:25.599 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:25.599 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T02:06:25.599 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:06:27.094 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T02:06:27.120 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T02:06:27.120 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:27.120 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T02:06:27.120 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T02:06:27.120 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T02:06:27.120 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:06:27.345 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T02:06:27.368 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T02:06:27.368 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:27.368 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T02:06:27.368 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T02:06:27.368 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T02:06:27.368 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:06:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T02:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T02:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T02:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T02:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T02:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:06:27.942 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T02:06:27.991 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T02:06:28.047 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T02:06:28.233 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T02:06:28.288 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T02:06:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T02:06:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T02:06:28.595 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T02:06:28.638 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T02:06:28.670 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T02:06:28.709 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T02:06:29.128 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T02:06:29.154 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T02:06:29.185 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 124/156 2024-04-25T02:06:29.247 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 125/156 2024-04-25T02:06:29.277 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T02:06:30.311 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T02:06:30.360 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T02:06:31.331 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T02:06:31.362 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T02:06:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T02:06:31.625 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 129/156 2024-04-25T02:06:31.664 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T02:06:31.686 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T02:06:31.687 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:31.687 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T02:06:31.687 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T02:06:31.687 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T02:06:31.687 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:06:31.731 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T02:06:31.742 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T02:06:31.840 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/156 2024-04-25T02:06:31.888 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 133/156 2024-04-25T02:06:32.783 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T02:06:32.817 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T02:06:32.839 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T02:06:32.839 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:32.839 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T02:06:32.839 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T02:06:32.840 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T02:06:32.840 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:06:32.884 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T02:06:32.906 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T02:06:32.906 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:32.906 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T02:06:32.906 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:06:32.952 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T02:06:32.974 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T02:06:32.974 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:32.974 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T02:06:32.974 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T02:06:32.974 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T02:06:32.974 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:06:33.280 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T02:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T02:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T02:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T02:06:33.303 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T02:06:33.303 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:06:34.362 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T02:06:34.362 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /sys 2024-04-25T02:06:34.362 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /proc 2024-04-25T02:06:34.362 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /mnt 2024-04-25T02:06:34.363 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /var/tmp 2024-04-25T02:06:34.363 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /home 2024-04-25T02:06:34.363 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /root 2024-04-25T02:06:34.363 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /tmp 2024-04-25T02:06:34.363 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:06:34.525 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T02:06:34.539 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T02:06:34.539 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:34.539 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T02:06:34.540 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:06:36.011 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T02:06:36.036 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T02:06:36.036 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:36.036 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T02:06:36.036 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T02:06:36.037 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T02:06:36.037 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:06:36.261 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T02:06:36.283 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T02:06:36.283 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:36.283 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T02:06:36.283 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T02:06:36.283 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T02:06:36.283 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:06:36.729 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T02:06:36.750 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T02:06:36.750 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:36.750 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T02:06:36.750 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T02:06:36.750 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T02:06:36.751 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:06:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T02:06:36.916 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T02:06:36.972 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T02:06:37.160 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T02:06:37.213 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T02:06:37.292 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T02:06:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T02:06:37.530 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T02:06:37.571 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T02:06:37.603 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T02:06:37.631 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T02:06:37.824 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 139/156 2024-04-25T02:06:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 140/156 2024-04-25T02:06:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 141/156 2024-04-25T02:06:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T02:06:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T02:06:38.113 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T02:06:38.146 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T02:06:38.156 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 144/156 2024-04-25T02:06:38.177 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 124/156 2024-04-25T02:06:38.204 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T02:06:38.234 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 146/156 2024-04-25T02:06:38.240 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 125/156 2024-04-25T02:06:38.277 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T02:06:38.823 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T02:06:38.865 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T02:06:38.885 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T02:06:39.314 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T02:06:39.346 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T02:06:39.710 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 148/156 2024-04-25T02:06:39.803 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T02:06:39.844 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T02:06:39.936 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T02:06:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T02:06:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T02:06:40.067 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T02:06:40.099 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T02:06:40.099 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T02:06:40.170 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T02:06:40.241 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T02:06:40.310 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T02:06:40.338 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T02:06:40.441 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T02:06:40.601 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 129/156 2024-04-25T02:06:40.632 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T02:06:40.654 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T02:06:40.654 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:40.654 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T02:06:40.654 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T02:06:40.654 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T02:06:40.654 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:06:40.699 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T02:06:40.709 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T02:06:40.808 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/156 2024-04-25T02:06:40.856 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 133/156 2024-04-25T02:06:41.751 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T02:06:41.785 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T02:06:41.807 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T02:06:41.807 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:41.807 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T02:06:41.808 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T02:06:41.808 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T02:06:41.808 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:06:41.852 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T02:06:41.873 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T02:06:41.874 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:41.874 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T02:06:41.874 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:06:41.919 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T02:06:41.941 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T02:06:41.941 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:41.941 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T02:06:41.941 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T02:06:41.941 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T02:06:41.941 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:06:42.237 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T02:06:42.258 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T02:06:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:06:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T02:06:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T02:06:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T02:06:42.259 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:06:46.223 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T02:06:46.224 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/156 2024-04-25T02:06:46.224 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/156 2024-04-25T02:06:46.224 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/156 2024-04-25T02:06:46.224 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/156 2024-04-25T02:06:46.224 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/156 2024-04-25T02:06:46.224 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/156 2024-04-25T02:06:46.224 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/156 2024-04-25T02:06:46.224 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T02:06:46.224 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T02:06:46.224 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T02:06:46.224 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/156 2024-04-25T02:06:46.224 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/156 2024-04-25T02:06:46.224 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T02:06:46.225 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/156 2024-04-25T02:06:46.225 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 15/156 2024-04-25T02:06:46.225 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 16/156 2024-04-25T02:06:46.225 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 17/156 2024-04-25T02:06:46.225 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 18/156 2024-04-25T02:06:46.225 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 19/156 2024-04-25T02:06:46.225 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 20/156 2024-04-25T02:06:46.225 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 21/156 2024-04-25T02:06:46.225 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 22/156 2024-04-25T02:06:46.225 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 23/156 2024-04-25T02:06:46.225 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/156 2024-04-25T02:06:46.225 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/156 2024-04-25T02:06:46.225 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/156 2024-04-25T02:06:46.225 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/156 2024-04-25T02:06:46.225 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 28/156 2024-04-25T02:06:46.226 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 29/156 2024-04-25T02:06:46.238 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 30/156 2024-04-25T02:06:46.238 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 31/156 2024-04-25T02:06:46.238 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 32/156 2024-04-25T02:06:46.238 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 33/156 2024-04-25T02:06:46.238 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 34/156 2024-04-25T02:06:46.239 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 35/156 2024-04-25T02:06:46.239 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 36/156 2024-04-25T02:06:46.239 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 37/156 2024-04-25T02:06:46.239 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 38/156 2024-04-25T02:06:46.239 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 39/156 2024-04-25T02:06:46.239 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T02:06:46.239 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T02:06:46.239 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T02:06:46.239 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T02:06:46.239 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T02:06:46.239 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T02:06:46.239 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T02:06:46.240 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T02:06:46.240 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T02:06:46.240 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T02:06:46.240 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T02:06:46.240 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T02:06:46.240 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T02:06:46.240 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T02:06:46.240 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T02:06:46.240 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T02:06:46.240 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T02:06:46.240 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T02:06:46.240 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T02:06:46.240 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T02:06:46.241 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T02:06:46.241 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T02:06:46.241 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T02:06:46.241 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T02:06:46.241 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T02:06:46.241 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T02:06:46.241 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T02:06:46.241 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T02:06:46.241 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T02:06:46.241 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T02:06:46.241 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T02:06:46.241 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T02:06:46.241 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T02:06:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T02:06:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T02:06:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T02:06:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T02:06:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T02:06:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T02:06:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T02:06:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T02:06:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T02:06:46.243 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T02:06:46.243 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T02:06:46.243 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T02:06:46.243 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T02:06:46.243 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T02:06:46.243 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T02:06:46.243 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T02:06:46.243 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T02:06:46.243 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T02:06:46.243 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T02:06:46.243 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T02:06:46.244 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T02:06:46.244 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T02:06:46.244 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T02:06:46.244 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T02:06:46.244 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T02:06:46.244 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T02:06:46.244 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T02:06:46.244 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T02:06:46.244 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T02:06:46.244 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T02:06:46.244 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T02:06:46.244 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T02:06:46.244 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T02:06:46.244 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T02:06:46.244 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T02:06:46.245 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T02:06:46.245 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T02:06:46.245 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T02:06:46.245 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T02:06:46.245 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T02:06:46.245 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T02:06:46.245 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T02:06:46.245 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T02:06:46.245 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T02:06:46.245 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T02:06:46.245 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T02:06:46.245 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T02:06:46.245 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T02:06:46.246 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T02:06:46.246 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T02:06:46.246 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T02:06:46.246 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T02:06:46.246 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T02:06:46.246 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T02:06:46.246 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T02:06:46.246 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T02:06:46.246 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T02:06:46.246 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T02:06:46.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T02:06:46.248 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T02:06:46.248 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T02:06:46.248 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 149/156 2024-04-25T02:06:46.248 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T02:06:46.248 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 151/156 2024-04-25T02:06:46.248 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T02:06:46.248 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T02:06:46.248 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T02:06:46.248 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T02:06:46.749 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 139/156 2024-04-25T02:06:46.790 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 140/156 2024-04-25T02:06:46.831 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 141/156 2024-04-25T02:06:46.863 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T02:06:46.902 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T02:06:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 144/156 2024-04-25T02:06:47.137 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T02:06:47.167 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 146/156 2024-04-25T02:06:47.751 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T02:06:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T02:06:47.817 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T02:06:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T02:06:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:06:48.295 INFO:teuthology.orchestra.run.smithi079.stdout:Upgraded: 2024-04-25T02:06:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T02:06:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T02:06:48.295 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-04-25T02:06:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T02:06:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T02:06:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T02:06:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T02:06:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T02:06:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T02:06:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T02:06:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T02:06:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T02:06:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T02:06:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T02:06:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T02:06:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T02:06:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T02:06:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T02:06:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T02:06:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T02:06:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T02:06:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T02:06:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T02:06:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T02:06:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T02:06:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T02:06:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T02:06:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T02:06:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T02:06:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T02:06:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T02:06:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T02:06:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T02:06:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T02:06:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T02:06:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T02:06:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T02:06:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T02:06:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T02:06:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T02:06:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T02:06:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T02:06:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T02:06:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T02:06:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T02:06:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T02:06:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T02:06:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T02:06:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T02:06:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T02:06:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T02:06:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T02:06:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T02:06:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T02:06:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T02:06:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T02:06:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T02:06:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T02:06:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T02:06:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T02:06:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T02:06:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T02:06:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T02:06:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T02:06:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T02:06:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T02:06:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T02:06:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T02:06:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T02:06:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T02:06:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T02:06:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T02:06:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T02:06:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T02:06:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T02:06:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T02:06:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T02:06:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T02:06:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T02:06:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T02:06:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T02:06:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T02:06:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T02:06:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T02:06:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T02:06:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T02:06:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:06:48.306 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-04-25T02:06:48.679 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 148/156 2024-04-25T02:06:48.708 DEBUG:teuthology.parallel:result is None 2024-04-25T02:06:48.769 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T02:06:48.810 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T02:06:48.893 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T02:06:48.923 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T02:06:48.923 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T02:06:49.007 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T02:06:49.040 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T02:06:49.041 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T02:06:49.130 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T02:06:49.196 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T02:06:54.927 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T02:06:54.927 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/156 2024-04-25T02:06:54.927 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/156 2024-04-25T02:06:54.927 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/156 2024-04-25T02:06:54.928 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/156 2024-04-25T02:06:54.928 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/156 2024-04-25T02:06:54.928 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/156 2024-04-25T02:06:54.928 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/156 2024-04-25T02:06:54.928 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T02:06:54.928 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T02:06:54.928 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T02:06:54.928 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/156 2024-04-25T02:06:54.928 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/156 2024-04-25T02:06:54.928 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T02:06:54.928 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/156 2024-04-25T02:06:54.928 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 15/156 2024-04-25T02:06:54.928 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 16/156 2024-04-25T02:06:54.928 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 17/156 2024-04-25T02:06:54.928 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 18/156 2024-04-25T02:06:54.929 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 19/156 2024-04-25T02:06:54.929 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 20/156 2024-04-25T02:06:54.929 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 21/156 2024-04-25T02:06:54.929 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 22/156 2024-04-25T02:06:54.929 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 23/156 2024-04-25T02:06:54.929 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/156 2024-04-25T02:06:54.929 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/156 2024-04-25T02:06:54.929 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/156 2024-04-25T02:06:54.929 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/156 2024-04-25T02:06:54.929 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 28/156 2024-04-25T02:06:54.929 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 29/156 2024-04-25T02:06:54.929 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 30/156 2024-04-25T02:06:54.929 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 31/156 2024-04-25T02:06:54.929 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 32/156 2024-04-25T02:06:54.929 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 33/156 2024-04-25T02:06:54.930 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 34/156 2024-04-25T02:06:54.930 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 35/156 2024-04-25T02:06:54.930 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 36/156 2024-04-25T02:06:54.930 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 37/156 2024-04-25T02:06:54.930 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 38/156 2024-04-25T02:06:54.930 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 39/156 2024-04-25T02:06:54.930 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T02:06:54.930 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T02:06:54.930 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T02:06:54.930 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T02:06:54.930 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T02:06:54.930 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T02:06:54.930 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T02:06:54.930 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T02:06:54.931 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T02:06:54.931 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T02:06:54.931 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T02:06:54.931 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T02:06:54.931 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T02:06:54.931 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T02:06:54.931 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T02:06:54.931 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T02:06:54.931 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T02:06:54.931 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T02:06:54.931 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T02:06:54.931 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T02:06:54.931 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T02:06:54.931 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T02:06:54.931 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T02:06:54.932 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T02:06:54.932 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T02:06:54.932 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T02:06:54.932 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T02:06:54.932 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T02:06:54.932 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T02:06:54.932 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T02:06:54.932 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T02:06:54.932 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T02:06:54.932 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T02:06:54.932 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T02:06:54.932 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T02:06:54.932 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T02:06:54.932 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T02:06:54.932 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T02:06:54.933 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T02:06:54.933 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T02:06:54.933 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T02:06:54.933 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T02:06:54.933 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T02:06:54.933 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T02:06:54.933 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T02:06:54.933 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T02:06:54.933 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T02:06:54.933 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T02:06:54.933 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T02:06:54.933 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T02:06:54.933 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T02:06:54.933 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T02:06:54.933 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T02:06:54.934 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T02:06:54.934 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T02:06:54.934 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T02:06:54.934 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T02:06:54.934 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T02:06:54.934 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T02:06:54.934 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T02:06:54.934 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T02:06:54.934 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T02:06:54.934 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T02:06:54.934 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T02:06:54.934 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T02:06:54.934 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T02:06:54.934 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T02:06:54.936 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T02:06:54.936 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T02:06:54.936 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T02:06:54.936 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T02:06:54.936 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T02:06:54.936 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T02:06:54.936 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T02:06:54.936 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T02:06:54.936 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T02:06:54.936 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T02:06:54.936 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T02:06:54.936 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T02:06:54.936 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T02:06:54.936 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T02:06:54.936 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 149/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 151/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T02:06:54.938 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T02:06:54.938 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T02:06:56.986 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T02:06:56.986 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:06:56.987 INFO:teuthology.orchestra.run.smithi189.stdout:Upgraded: 2024-04-25T02:06:56.987 INFO:teuthology.orchestra.run.smithi189.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.987 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.987 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T02:06:56.987 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T02:06:56.987 INFO:teuthology.orchestra.run.smithi189.stdout:Installed: 2024-04-25T02:06:56.987 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T02:06:56.987 INFO:teuthology.orchestra.run.smithi189.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T02:06:56.987 INFO:teuthology.orchestra.run.smithi189.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T02:06:56.987 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T02:06:56.987 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.987 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.987 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.987 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.988 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:56.988 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.988 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.988 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.988 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:56.988 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:56.988 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:56.988 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:56.988 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:56.988 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.988 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.988 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:56.988 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.988 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.989 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.989 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:56.989 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:56.989 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.989 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.989 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:06:56.989 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T02:06:56.989 INFO:teuthology.orchestra.run.smithi189.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T02:06:56.989 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T02:06:56.989 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T02:06:56.989 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T02:06:56.989 INFO:teuthology.orchestra.run.smithi189.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T02:06:56.989 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T02:06:56.989 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T02:06:56.990 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T02:06:56.990 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T02:06:56.990 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T02:06:56.990 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.990 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.990 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.990 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T02:06:56.990 INFO:teuthology.orchestra.run.smithi189.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T02:06:56.990 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T02:06:56.990 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T02:06:56.990 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T02:06:56.990 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.990 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.991 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T02:06:56.991 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.991 INFO:teuthology.orchestra.run.smithi189.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T02:06:56.991 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T02:06:56.991 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T02:06:56.991 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T02:06:56.991 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T02:06:56.991 INFO:teuthology.orchestra.run.smithi189.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T02:06:56.991 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T02:06:56.991 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T02:06:56.991 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T02:06:56.992 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T02:06:56.992 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T02:06:56.992 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T02:06:56.992 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T02:06:56.992 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T02:06:56.992 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T02:06:56.992 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T02:06:56.992 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T02:06:56.992 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T02:06:56.992 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T02:06:56.992 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T02:06:56.992 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T02:06:56.992 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T02:06:56.992 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T02:06:56.993 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.993 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.993 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.993 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T02:06:56.993 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T02:06:56.993 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T02:06:56.993 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T02:06:56.993 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T02:06:56.993 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T02:06:56.993 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T02:06:56.993 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T02:06:56.993 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T02:06:56.993 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T02:06:56.994 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T02:06:56.994 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T02:06:56.994 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T02:06:56.994 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T02:06:56.994 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T02:06:56.994 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T02:06:56.994 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T02:06:56.994 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T02:06:56.994 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T02:06:56.994 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T02:06:56.994 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T02:06:56.994 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T02:06:56.994 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T02:06:56.995 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T02:06:56.995 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T02:06:56.995 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T02:06:56.995 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T02:06:56.995 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T02:06:56.995 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T02:06:56.995 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T02:06:56.995 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T02:06:56.995 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T02:06:56.995 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T02:06:56.995 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T02:06:56.995 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T02:06:56.995 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T02:06:56.995 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T02:06:56.996 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T02:06:56.996 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T02:06:56.996 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T02:06:56.996 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.996 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.996 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T02:06:56.996 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T02:06:56.996 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T02:06:56.996 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.996 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T02:06:56.996 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T02:06:56.996 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T02:06:56.996 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T02:06:56.996 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T02:06:56.997 INFO:teuthology.orchestra.run.smithi189.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T02:06:56.998 INFO:teuthology.orchestra.run.smithi189.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T02:06:56.998 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T02:06:56.998 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T02:06:56.998 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T02:06:56.998 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:06:56.998 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-04-25T02:06:57.397 DEBUG:teuthology.parallel:result is None 2024-04-25T02:06:57.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:06:57.616 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:06:57.643 INFO:teuthology.orchestra.run.smithi079.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-25T02:06:57.643 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-25T02:06:57.643 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-25T02:06:57.645 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:06:57.869 DEBUG:teuthology.orchestra.run.smithi189:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:06:57.890 INFO:teuthology.orchestra.run.smithi189.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-25T02:06:57.890 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-25T02:06:57.890 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-25T02:06:57.892 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T02:06:57.893 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:06:57.893 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T02:06:57.924 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:06:57.924 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T02:06:57.956 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T02:06:57.957 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:06:57.957 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T02:06:57.991 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T02:06:58.057 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:06:58.057 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T02:06:58.080 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T02:06:58.144 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T02:06:58.144 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:06:58.145 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T02:06:58.171 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T02:06:58.236 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:06:58.237 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T02:06:58.260 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T02:06:58.324 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T02:06:58.324 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:06:58.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T02:06:58.350 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T02:06:58.416 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:06:58.416 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T02:06:58.440 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T02:06:58.503 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T02:06:58.588 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T02:06:58.588 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2024-04-25T02:06:58.591 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 777 /var/log/ceph 2024-04-25T02:06:58.615 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T02:06:58.615 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T02:06:58.657 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T02:06:58.680 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T02:06:58.681 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T02:06:58.723 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T02:06:58.753 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T02:06:58.753 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T02:06:58.753 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T02:06:58.753 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:06:58.753 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T02:06:58.803 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T02:06:58.908 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T02:06:58.933 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:06:58.933 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T02:06:58.948 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T02:06:59.057 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T02:06:59.105 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T02:06:59.105 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T02:06:59.106 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672374', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7672374', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8528, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '122/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi079.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFVk+mxqqzpQuTaWYDVy22LRaRkW7NUElcb+GEYGQnKQ01Yp2g7Ja45DIeFQeAbR3MHrqk/y6Z0wcQFtmriNt78=', 'smithi189.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCtA81/It4Pk5rMYdjJWMWznoba+oYvZkyH2+UF8mJ6ZT7MZ0Xr3ht5lJGOASybvxw/1K7mJnLFTi5xxk9V6SQI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-24_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T02:06:59.107 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T02:06:59.110 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T02:06:59.150 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T02:06:59.165 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T02:06:59.214 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:06:59.214 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T02:06:59.241 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T02:06:59.242 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2024-04-25T02:06:59.297 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T02:06:59.297 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:06:59.297 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T02:06:59.297 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:06:59.298 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:06:59.298 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-04-25 02:06:40.590596228 +0000 2024-04-25T02:06:59.298 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-04-25 02:04:14.441398709 +0000 2024-04-25T02:06:59.298 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-04-25 02:04:14.441398709 +0000 2024-04-25T02:06:59.298 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-04-25 02:04:14.441398709 +0000 2024-04-25T02:06:59.298 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T02:06:59.359 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-04-25T02:06:59.405 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-04-25T02:06:59.405 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000204919 s, 2.5 MB/s 2024-04-25T02:06:59.406 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T02:06:59.462 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2024-04-25T02:06:59.517 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T02:06:59.518 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:06:59.518 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-25T02:06:59.518 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:06:59.518 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:06:59.518 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-04-25 02:06:40.590596228 +0000 2024-04-25T02:06:59.518 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-04-25 02:04:14.791391088 +0000 2024-04-25T02:06:59.518 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-04-25 02:04:14.791391088 +0000 2024-04-25T02:06:59.518 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-04-25 02:04:14.791391088 +0000 2024-04-25T02:06:59.518 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T02:06:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-04-25T02:06:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-04-25T02:06:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000192562 s, 2.7 MB/s 2024-04-25T02:06:59.583 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T02:06:59.640 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2024-04-25T02:06:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T02:06:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:06:59.695 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-25T02:06:59.695 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:06:59.695 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:06:59.695 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-04-25 02:06:40.590596228 +0000 2024-04-25T02:06:59.696 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-04-25 02:04:15.132383663 +0000 2024-04-25T02:06:59.696 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-04-25 02:04:15.132383663 +0000 2024-04-25T02:06:59.696 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-04-25 02:04:15.132383663 +0000 2024-04-25T02:06:59.696 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T02:06:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-04-25T02:06:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-04-25T02:06:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000191614 s, 2.7 MB/s 2024-04-25T02:06:59.759 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T02:06:59.815 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2024-04-25T02:06:59.870 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T02:06:59.871 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:06:59.871 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-25T02:06:59.871 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:06:59.871 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:06:59.871 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-04-25 02:06:40.591596206 +0000 2024-04-25T02:06:59.871 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-04-25 02:04:15.461376500 +0000 2024-04-25T02:06:59.871 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-04-25 02:04:15.461376500 +0000 2024-04-25T02:06:59.871 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-04-25 02:04:15.461376500 +0000 2024-04-25T02:06:59.871 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T02:06:59.933 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-04-25T02:06:59.933 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-04-25T02:06:59.933 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000174309 s, 2.9 MB/s 2024-04-25T02:06:59.934 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T02:06:59.991 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:06:59.991 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:06:59.991 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T02:07:00.006 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T02:07:00.006 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_1 2024-04-25T02:07:00.061 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T02:07:00.061 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:07:00.061 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-25T02:07:00.061 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:07:00.061 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:07:00.061 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-04-25 02:06:49.581136482 +0000 2024-04-25T02:07:00.062 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-04-25 02:04:21.794675679 +0000 2024-04-25T02:07:00.062 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-04-25 02:04:21.794675679 +0000 2024-04-25T02:07:00.062 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-04-25 02:04:21.794675679 +0000 2024-04-25T02:07:00.062 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T02:07:00.123 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-04-25T02:07:00.123 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-04-25T02:07:00.123 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000264381 s, 1.9 MB/s 2024-04-25T02:07:00.125 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T02:07:00.181 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_2 2024-04-25T02:07:00.235 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T02:07:00.236 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:07:00.236 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-25T02:07:00.236 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:07:00.236 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:07:00.236 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-04-25 02:06:49.582136463 +0000 2024-04-25T02:07:00.236 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-04-25 02:04:22.144668880 +0000 2024-04-25T02:07:00.236 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-04-25 02:04:22.144668880 +0000 2024-04-25T02:07:00.236 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-04-25 02:04:22.144668880 +0000 2024-04-25T02:07:00.236 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T02:07:00.298 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-04-25T02:07:00.298 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-04-25T02:07:00.298 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000206615 s, 2.5 MB/s 2024-04-25T02:07:00.299 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T02:07:00.355 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_3 2024-04-25T02:07:00.410 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T02:07:00.410 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:07:00.410 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-25T02:07:00.410 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:07:00.410 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:07:00.410 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-04-25 02:06:49.582136463 +0000 2024-04-25T02:07:00.410 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-04-25 02:04:22.479662372 +0000 2024-04-25T02:07:00.410 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-04-25 02:04:22.479662372 +0000 2024-04-25T02:07:00.410 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-04-25 02:04:22.479662372 +0000 2024-04-25T02:07:00.411 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T02:07:00.471 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-04-25T02:07:00.472 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-04-25T02:07:00.472 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000211179 s, 2.4 MB/s 2024-04-25T02:07:00.473 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T02:07:00.528 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_4 2024-04-25T02:07:00.583 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T02:07:00.583 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:07:00.583 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-25T02:07:00.583 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:07:00.583 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:07:00.583 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-04-25 02:06:49.582136463 +0000 2024-04-25T02:07:00.583 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-04-25 02:04:22.819655767 +0000 2024-04-25T02:07:00.584 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-04-25 02:04:22.819655767 +0000 2024-04-25T02:07:00.584 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-04-25 02:04:22.819655767 +0000 2024-04-25T02:07:00.584 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T02:07:00.646 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-04-25T02:07:00.646 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-04-25T02:07:00.646 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000207122 s, 2.5 MB/s 2024-04-25T02:07:00.647 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T02:07:00.702 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T02:07:00.703 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi189.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T02:07:00.703 INFO:tasks.ceph:Generating config... 2024-04-25T02:07:00.704 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T02:07:00.704 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T02:07:00.704 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T02:07:00.704 INFO:tasks.ceph:[client] pid file = 2024-04-25T02:07:00.704 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T02:07:00.704 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T02:07:00.704 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T02:07:00.704 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T02:07:00.704 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T02:07:00.705 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T02:07:00.705 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T02:07:00.705 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T02:07:00.705 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T02:07:00.705 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T02:07:00.705 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T02:07:00.705 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T02:07:00.705 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T02:07:00.705 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T02:07:00.705 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T02:07:00.705 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T02:07:00.705 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T02:07:00.705 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T02:07:00.705 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T02:07:00.706 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T02:07:00.706 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T02:07:00.706 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T02:07:00.706 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T02:07:00.706 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T02:07:00.706 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T02:07:00.706 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T02:07:00.706 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T02:07:00.706 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T02:07:00.706 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T02:07:00.706 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T02:07:00.706 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T02:07:00.706 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T02:07:00.706 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T02:07:00.707 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T02:07:00.707 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T02:07:00.707 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T02:07:00.707 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T02:07:00.707 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T02:07:00.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T02:07:00.757 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T02:07:00.759 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T02:07:00.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:07:00.863 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.79'), ('mon.b', '172.21.15.189'), ('mon.c', '[v2:172.21.15.189:3301,v1:172.21.15.189:6790]')] 2024-04-25T02:07:00.863 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.79,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T02:07:00.864 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:00.864 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T02:07:00.918 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.79 --add b 172.21.15.189 --addv c '[v2:172.21.15.189:3301,v1:172.21.15.189:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:07:01.004 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:07:01.004 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: generated fsid 696648c4-3e52-400b-a780-2e8863c56c42 2024-04-25T02:07:01.004 INFO:teuthology.orchestra.run.smithi079.stdout:setting min_mon_release = quincy 2024-04-25T02:07:01.004 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 0 2024-04-25T02:07:01.004 INFO:teuthology.orchestra.run.smithi079.stdout:fsid 696648c4-3e52-400b-a780-2e8863c56c42 2024-04-25T02:07:01.004 INFO:teuthology.orchestra.run.smithi079.stdout:last_changed 2024-04-25T02:07:00.998562+0000 2024-04-25T02:07:01.004 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-04-25T02:07:00.998562+0000 2024-04-25T02:07:01.004 INFO:teuthology.orchestra.run.smithi079.stdout:min_mon_release 17 (quincy) 2024-04-25T02:07:01.004 INFO:teuthology.orchestra.run.smithi079.stdout:election_strategy: 1 2024-04-25T02:07:01.005 INFO:teuthology.orchestra.run.smithi079.stdout:0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-04-25T02:07:01.005 INFO:teuthology.orchestra.run.smithi079.stdout:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-04-25T02:07:01.005 INFO:teuthology.orchestra.run.smithi079.stdout:2: [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] mon.c 2024-04-25T02:07:01.005 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T02:07:01.006 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T02:07:01.020 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 696648c4-3e52-400b-a780-2e8863c56c42... 2024-04-25T02:07:01.021 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:07:01.062 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:07:01.100 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-04-25T02:07:01.100 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-04-25T02:07:01.100 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:07:01.100 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-04-25T02:07:01.100 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.100 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-04-25T02:07:01.100 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.101 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-04-25T02:07:01.101 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.101 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-04-25T02:07:01.101 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-04-25T02:07:01.101 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.101 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-04-25T02:07:01.101 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-04-25T02:07:01.101 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.101 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:07:01.101 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-04-25T02:07:01.101 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.101 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:07:01.101 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:07:01.101 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.101 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-04-25T02:07:01.102 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.102 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-04-25T02:07:01.102 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-04-25T02:07:01.102 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:07:01.102 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:07:01.102 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-04-25T02:07:01.102 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:07:01.102 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-04-25T02:07:01.102 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:07:01.102 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:07:01.102 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-04-25T02:07:01.102 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.102 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:07:01.103 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.103 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-04-25T02:07:01.103 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.103 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-04-25T02:07:01.103 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.103 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-04-25T02:07:01.103 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-04-25T02:07:01.103 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-04-25T02:07:01.103 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]" 2024-04-25T02:07:01.103 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on skipped message = False 2024-04-25T02:07:01.103 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 696648c4-3e52-400b-a780-2e8863c56c42 2024-04-25T02:07:01.103 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.103 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-04-25T02:07:01.103 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-04-25T02:07:01.103 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.104 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-04-25T02:07:01.104 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-04-25T02:07:01.104 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:07:01.104 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.104 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-04-25T02:07:01.104 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-04-25T02:07:01.104 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.104 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-04-25T02:07:01.104 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-04-25T02:07:01.104 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-04-25T02:07:01.104 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug trim objects = true 2024-04-25T02:07:01.104 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.105 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-04-25T02:07:01.105 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-04-25T02:07:01.105 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.105 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:07:01.105 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.105 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-04-25T02:07:01.105 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.105 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-04-25T02:07:01.105 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.105 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:07:01.105 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-04-25T02:07:01.105 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.105 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-04-25T02:07:01.105 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-04-25T02:07:01.105 INFO:teuthology.orchestra.run.smithi079.stdout: bdev async discard = True 2024-04-25T02:07:01.106 INFO:teuthology.orchestra.run.smithi079.stdout: bdev enable discard = True 2024-04-25T02:07:01.106 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore allocator = bitmap 2024-04-25T02:07:01.106 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-04-25T02:07:01.106 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-04-25T02:07:01.106 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 1/20 2024-04-25T02:07:01.106 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 1/20 2024-04-25T02:07:01.106 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:07:01.106 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-04-25T02:07:01.106 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 4/10 2024-04-25T02:07:01.106 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:07:01.106 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-04-25T02:07:01.106 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:07:01.106 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:07:01.106 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-04-25T02:07:01.107 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-04-25T02:07:01.107 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.107 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-04-25T02:07:01.107 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:07:01.107 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-04-25T02:07:01.107 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-04-25T02:07:01.107 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-04-25T02:07:01.107 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:07:01.107 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:07:01.107 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-04-25T02:07:01.107 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-04-25T02:07:01.107 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.107 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-04-25T02:07:01.107 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:07:01.108 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-04-25T02:07:01.108 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-04-25T02:07:01.108 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-04-25T02:07:01.108 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-04-25T02:07:01.108 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-04-25T02:07:01.108 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:07:01.108 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-04-25T02:07:01.108 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-04-25T02:07:01.108 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:07:01.108 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.108 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:07:01.108 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:07:01.108 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:07:01.108 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.108 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:07:01.109 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:07:01.109 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:07:01.109 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.109 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-04-25T02:07:01.109 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:07:01.109 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.109 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:07:01.109 INFO:teuthology.orchestra.run.smithi079.stdout: mon down mkfs grace = 300 2024-04-25T02:07:01.109 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2024-04-25T02:07:01.109 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:01.109 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-04-25T02:07:01.109 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-04-25T02:07:01.109 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-04-25T02:07:01.109 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-04-25T02:07:01.110 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:07:01.110 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:07:01.110 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2024-04-25T02:07:01.110 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-04-25T02:07:01.110 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:07:01.110 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = "" 2024-04-25T02:07:01.110 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-04-25T02:07:01.110 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-04-25T02:07:01.110 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-04-25T02:07:01.110 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2024-04-25T02:07:01.110 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2024-04-25T02:07:01.110 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-04-25T02:07:01.110 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2024-04-25T02:07:01.110 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2024-04-25T02:07:01.110 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2024-04-25T02:07:01.111 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2024-04-25T02:07:01.111 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2024-04-25T02:07:01.111 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2024-04-25T02:07:01.111 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:07:01.111 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2024-04-25T02:07:01.111 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2024-04-25T02:07:01.111 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2024-04-25T02:07:01.111 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2024-04-25T02:07:01.111 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-04-25T02:07:01.111 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-04-25T02:07:01.111 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-04-25T02:07:01.112 INFO:teuthology.orchestra.run.smithi189.stdout:[global] 2024-04-25T02:07:01.112 INFO:teuthology.orchestra.run.smithi189.stdout: chdir = "" 2024-04-25T02:07:01.112 INFO:teuthology.orchestra.run.smithi189.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:07:01.112 INFO:teuthology.orchestra.run.smithi189.stdout: auth supported = cephx 2024-04-25T02:07:01.112 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.112 INFO:teuthology.orchestra.run.smithi189.stdout: filestore xattr use omap = true 2024-04-25T02:07:01.112 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.112 INFO:teuthology.orchestra.run.smithi189.stdout: mon clock drift allowed = 1.000 2024-04-25T02:07:01.112 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.113 INFO:teuthology.orchestra.run.smithi189.stdout: osd crush chooseleaf type = 0 2024-04-25T02:07:01.113 INFO:teuthology.orchestra.run.smithi189.stdout: auth debug = true 2024-04-25T02:07:01.113 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.113 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on old message = true 2024-04-25T02:07:01.113 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on bug = true 2024-04-25T02:07:01.113 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.113 INFO:teuthology.orchestra.run.smithi189.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:07:01.113 INFO:teuthology.orchestra.run.smithi189.stdout: mon pg warn max object skew = 0 2024-04-25T02:07:01.113 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.113 INFO:teuthology.orchestra.run.smithi189.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:07:01.113 INFO:teuthology.orchestra.run.smithi189.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:07:01.113 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.113 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default size = 2 2024-04-25T02:07:01.113 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.113 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow primary affinity = true 2024-04-25T02:07:01.114 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow pg remap = true 2024-04-25T02:07:01.114 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:07:01.114 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:07:01.114 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on no sortbitwise = false 2024-04-25T02:07:01.114 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:07:01.114 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on too few osds = false 2024-04-25T02:07:01.114 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:07:01.114 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:07:01.114 INFO:teuthology.orchestra.run.smithi189.stdout: mon_allow_pool_size_one = true 2024-04-25T02:07:01.114 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.114 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:07:01.114 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.114 INFO:teuthology.orchestra.run.smithi189.stdout: osd default data pool replay window = 5 2024-04-25T02:07:01.115 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.115 INFO:teuthology.orchestra.run.smithi189.stdout: mon allow pool delete = true 2024-04-25T02:07:01.115 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.115 INFO:teuthology.orchestra.run.smithi189.stdout: mon cluster log file level = debug 2024-04-25T02:07:01.115 INFO:teuthology.orchestra.run.smithi189.stdout: debug asserts on shutdown = true 2024-04-25T02:07:01.115 INFO:teuthology.orchestra.run.smithi189.stdout: mon health detail to clog = false 2024-04-25T02:07:01.115 INFO:teuthology.orchestra.run.smithi189.stdout: mon host = "172.21.15.79,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]" 2024-04-25T02:07:01.115 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on skipped message = False 2024-04-25T02:07:01.115 INFO:teuthology.orchestra.run.smithi189.stdout: fsid = 696648c4-3e52-400b-a780-2e8863c56c42 2024-04-25T02:07:01.115 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.115 INFO:teuthology.orchestra.run.smithi189.stdout:[osd] 2024-04-25T02:07:01.115 INFO:teuthology.orchestra.run.smithi189.stdout: osd journal size = 100 2024-04-25T02:07:01.115 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.115 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub load threshold = 5.0 2024-04-25T02:07:01.115 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub max interval = 600 2024-04-25T02:07:01.116 INFO:teuthology.orchestra.run.smithi189.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:07:01.116 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.116 INFO:teuthology.orchestra.run.smithi189.stdout: osd recover clone overlap = true 2024-04-25T02:07:01.116 INFO:teuthology.orchestra.run.smithi189.stdout: osd recovery max chunk = 1048576 2024-04-25T02:07:01.116 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.116 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug shutdown = true 2024-04-25T02:07:01.116 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug op order = true 2024-04-25T02:07:01.116 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug verify stray on activate = true 2024-04-25T02:07:01.116 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug trim objects = true 2024-04-25T02:07:01.116 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.116 INFO:teuthology.orchestra.run.smithi189.stdout: osd open classes on start = true 2024-04-25T02:07:01.116 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug pg log writeout = true 2024-04-25T02:07:01.116 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.116 INFO:teuthology.orchestra.run.smithi189.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:07:01.116 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.117 INFO:teuthology.orchestra.run.smithi189.stdout: osd map max advance = 10 2024-04-25T02:07:01.117 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.117 INFO:teuthology.orchestra.run.smithi189.stdout: journal zero on create = true 2024-04-25T02:07:01.117 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.117 INFO:teuthology.orchestra.run.smithi189.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:07:01.117 INFO:teuthology.orchestra.run.smithi189.stdout: filestore apply finisher threads = 3 2024-04-25T02:07:01.117 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.117 INFO:teuthology.orchestra.run.smithi189.stdout: bdev debug aio = true 2024-04-25T02:07:01.117 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug misdirected ops = true 2024-04-25T02:07:01.117 INFO:teuthology.orchestra.run.smithi189.stdout: bdev async discard = True 2024-04-25T02:07:01.117 INFO:teuthology.orchestra.run.smithi189.stdout: bdev enable discard = True 2024-04-25T02:07:01.117 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore allocator = bitmap 2024-04-25T02:07:01.117 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore block size = 96636764160 2024-04-25T02:07:01.117 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore fsck on mount = True 2024-04-25T02:07:01.118 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluefs = 1/20 2024-04-25T02:07:01.118 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluestore = 1/20 2024-04-25T02:07:01.118 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:07:01.118 INFO:teuthology.orchestra.run.smithi189.stdout: debug osd = 20 2024-04-25T02:07:01.118 INFO:teuthology.orchestra.run.smithi189.stdout: debug rocksdb = 4/10 2024-04-25T02:07:01.118 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:07:01.118 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd full ratio = 0.9 2024-04-25T02:07:01.118 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:07:01.118 INFO:teuthology.orchestra.run.smithi189.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:07:01.118 INFO:teuthology.orchestra.run.smithi189.stdout: osd objectstore = bluestore 2024-04-25T02:07:01.118 INFO:teuthology.orchestra.run.smithi189.stdout: osd op complaint time = 180 2024-04-25T02:07:01.118 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.118 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr] 2024-04-25T02:07:01.118 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: debug mgr = 20 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: mgr/telemetry/nag = false 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: debug client = 20 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout:[mon] 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: debug paxos = 20 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: mon data avail warn = 5 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: mon mgr mkfs grace = 240 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:07:01.119 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd reporter subtree level = osd 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd prime pg temp = true 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: # 1m isn't quite enough 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: mon down mkfs grace = 300 2024-04-25T02:07:01.120 INFO:teuthology.orchestra.run.smithi189.stdout: mon op complaint time = 120 2024-04-25T02:07:01.121 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:07:01.121 INFO:teuthology.orchestra.run.smithi189.stdout:[client] 2024-04-25T02:07:01.121 INFO:teuthology.orchestra.run.smithi189.stdout: rgw cache enabled = true 2024-04-25T02:07:01.121 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable ops log = true 2024-04-25T02:07:01.121 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable usage log = true 2024-04-25T02:07:01.121 INFO:teuthology.orchestra.run.smithi189.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:07:01.121 INFO:teuthology.orchestra.run.smithi189.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:07:01.121 INFO:teuthology.orchestra.run.smithi189.stdout: client mount timeout = 600 2024-04-25T02:07:01.121 INFO:teuthology.orchestra.run.smithi189.stdout: debug client = 20 2024-04-25T02:07:01.121 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:07:01.121 INFO:teuthology.orchestra.run.smithi189.stdout: pid file = "" 2024-04-25T02:07:01.121 INFO:teuthology.orchestra.run.smithi189.stdout: rados mon op timeout = 900 2024-04-25T02:07:01.121 INFO:teuthology.orchestra.run.smithi189.stdout: rados osd op timeout = 900 2024-04-25T02:07:01.121 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.a] 2024-04-25T02:07:01.121 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.b] 2024-04-25T02:07:01.122 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.c] 2024-04-25T02:07:01.122 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.a] 2024-04-25T02:07:01.122 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.c] 2024-04-25T02:07:01.122 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.b] 2024-04-25T02:07:01.122 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.d] 2024-04-25T02:07:01.122 INFO:teuthology.orchestra.run.smithi189.stdout:[mds] 2024-04-25T02:07:01.122 INFO:teuthology.orchestra.run.smithi189.stdout: debug mds = 20 2024-04-25T02:07:01.122 INFO:teuthology.orchestra.run.smithi189.stdout: debug mds balancer = 20 2024-04-25T02:07:01.122 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:07:01.122 INFO:teuthology.orchestra.run.smithi189.stdout: mds debug frag = True 2024-04-25T02:07:01.122 INFO:teuthology.orchestra.run.smithi189.stdout: mds debug scatterstat = True 2024-04-25T02:07:01.122 INFO:teuthology.orchestra.run.smithi189.stdout: mds op complaint time = 180 2024-04-25T02:07:01.122 INFO:teuthology.orchestra.run.smithi189.stdout: mds verify scatter = True 2024-04-25T02:07:01.123 INFO:teuthology.orchestra.run.smithi189.stdout: osd op complaint time = 180 2024-04-25T02:07:01.123 INFO:teuthology.orchestra.run.smithi189.stdout: rados mon op timeout = 900 2024-04-25T02:07:01.123 INFO:teuthology.orchestra.run.smithi189.stdout: rados osd op timeout = 900 2024-04-25T02:07:01.124 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T02:07:01.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T02:07:01.215 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T02:07:01.215 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:01.215 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T02:07:01.231 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:01.231 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T02:07:01.285 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:07:01.285 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:01.285 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T02:07:01.285 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:07:01.357 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:01.357 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:07:01.412 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi189.front.sepia.ceph.com 2024-04-25T02:07:01.412 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:07:01.412 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T02:07:01.412 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:07:01.446 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:07:01.446 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:07:01.501 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T02:07:01.502 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T02:07:01.502 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T02:07:01.549 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T02:07:01.552 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T02:07:01.607 INFO:teuthology.orchestra.run.smithi189.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T02:07:01.609 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T02:07:01.610 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T02:07:01.658 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T02:07:01.660 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T02:07:01.683 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T02:07:01.771 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T02:07:01.773 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T02:07:01.796 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T02:07:01.845 INFO:teuthology.orchestra.run.smithi189.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T02:07:01.848 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T02:07:01.871 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T02:07:01.960 INFO:teuthology.orchestra.run.smithi189.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T02:07:01.962 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T02:07:01.985 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T02:07:01.986 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T02:07:02.024 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T02:07:02.037 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-25T02:07:02.116 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-25T02:07:02.127 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T02:07:02.166 INFO:teuthology.orchestra.run.smithi189.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T02:07:02.178 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-25T02:07:02.258 INFO:teuthology.orchestra.run.smithi189.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-25T02:07:02.270 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T02:07:02.270 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi189.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T02:07:02.270 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T02:07:02.293 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:07:02.293 INFO:tasks.ceph:role: osd.0 2024-04-25T02:07:02.293 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:07:02.293 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T02:07:02.363 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:07:02.364 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:07:02.364 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:07:02.364 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:07:02.364 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:07:02.364 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:07:02.364 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:07:02.364 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:07:02.364 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:07:02.364 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:07:02.892 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-04-25T02:07:02.894 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-04-25T02:07:02.894 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T02:07:03.029 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T02:07:03.060 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T02:07:03.125 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:07:03.125 INFO:tasks.ceph:role: osd.1 2024-04-25T02:07:03.125 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:07:03.125 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T02:07:03.197 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:07:03.197 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:07:03.197 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:07:03.197 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:07:03.197 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:07:03.197 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:07:03.197 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:07:03.197 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:07:03.197 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:07:03.197 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:07:03.640 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-04-25T02:07:03.643 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-04-25T02:07:03.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T02:07:03.732 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T02:07:03.758 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T02:07:03.822 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:07:03.822 INFO:tasks.ceph:role: osd.2 2024-04-25T02:07:03.822 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:07:03.822 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T02:07:03.892 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:07:03.893 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:07:03.893 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:07:03.893 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:07:03.893 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:07:03.893 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:07:03.893 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:07:03.893 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:07:03.893 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:07:03.893 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:07:04.386 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-04-25T02:07:04.389 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-04-25T02:07:04.389 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T02:07:04.508 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T02:07:04.537 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T02:07:04.601 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:07:04.601 INFO:tasks.ceph:role: osd.3 2024-04-25T02:07:04.601 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:07:04.601 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T02:07:04.672 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:07:04.672 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:07:04.673 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:07:04.673 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:07:04.673 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:07:04.673 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:07:04.673 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:07:04.673 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:07:04.673 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:07:04.673 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:07:05.157 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-04-25T02:07:05.159 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-04-25T02:07:05.159 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T02:07:05.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T02:07:05.320 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:07:05.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:05.403+0000 7f7d11218640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T02:07:05.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:05.404+0000 7f7d11218640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T02:07:05.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:05.404+0000 7f7d11218640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T02:07:05.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:05.404+0000 7f7d11218640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T02:07:05.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:05.404+0000 7f7d11218640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T02:07:05.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:05.404+0000 7f7d11218640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T02:07:08.264 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T02:07:08.292 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:07:08.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:08.371+0000 7f061b49b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T02:07:08.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:08.372+0000 7f061b49b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T02:07:08.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:08.372+0000 7f061b49b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T02:07:08.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:08.372+0000 7f061b49b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T02:07:08.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:08.372+0000 7f061b49b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T02:07:08.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:08.372+0000 7f061b49b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T02:07:11.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T02:07:11.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:07:11.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:11.337+0000 7f105be15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T02:07:11.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:11.337+0000 7f105be15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T02:07:11.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:11.337+0000 7f105be15640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T02:07:11.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:11.338+0000 7f105be15640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T02:07:11.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:11.338+0000 7f105be15640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T02:07:11.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:11.338+0000 7f105be15640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T02:07:14.195 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T02:07:14.223 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:07:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:14.304+0000 7f0ca240f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T02:07:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:14.304+0000 7f0ca240f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T02:07:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:14.304+0000 7f0ca240f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T02:07:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:14.304+0000 7f0ca240f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T02:07:14.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:14.304+0000 7f0ca240f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T02:07:14.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:14.305+0000 7f0ca240f640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T02:07:17.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T02:07:17.184 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T02:07:17.212 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T02:07:17.212 INFO:tasks.ceph:role: osd.4 2024-04-25T02:07:17.212 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-25T02:07:17.213 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T02:07:17.287 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:07:17.287 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:07:17.287 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:07:17.288 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:07:17.288 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:07:17.288 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:07:17.288 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:07:17.288 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:07:17.288 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:07:17.289 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:07:17.802 INFO:teuthology.orchestra.run.smithi189.stdout:Discarding blocks...Done. 2024-04-25T02:07:17.804 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-04-25T02:07:17.804 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T02:07:17.933 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T02:07:17.964 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T02:07:18.028 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T02:07:18.028 INFO:tasks.ceph:role: osd.5 2024-04-25T02:07:18.028 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-25T02:07:18.029 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T02:07:18.100 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:07:18.100 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:07:18.100 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:07:18.100 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:07:18.100 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:07:18.101 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:07:18.101 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:07:18.101 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:07:18.101 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:07:18.101 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:07:18.548 INFO:teuthology.orchestra.run.smithi189.stdout:Discarding blocks...Done. 2024-04-25T02:07:18.549 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-04-25T02:07:18.550 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T02:07:18.634 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T02:07:18.702 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T02:07:18.765 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T02:07:18.766 INFO:tasks.ceph:role: osd.6 2024-04-25T02:07:18.766 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-25T02:07:18.766 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T02:07:18.836 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:07:18.836 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:07:18.836 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:07:18.836 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:07:18.836 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:07:18.836 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:07:18.837 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:07:18.837 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:07:18.837 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:07:18.837 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:07:19.324 INFO:teuthology.orchestra.run.smithi189.stdout:Discarding blocks...Done. 2024-04-25T02:07:19.326 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-04-25T02:07:19.326 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T02:07:19.476 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T02:07:19.505 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T02:07:19.569 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T02:07:19.569 INFO:tasks.ceph:role: osd.7 2024-04-25T02:07:19.569 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-25T02:07:19.569 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T02:07:19.641 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:07:19.641 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:07:19.641 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:07:19.641 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:07:19.642 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:07:19.642 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:07:19.642 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:07:19.642 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:07:19.642 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:07:19.642 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:07:20.174 INFO:teuthology.orchestra.run.smithi189.stdout:Discarding blocks...Done. 2024-04-25T02:07:20.176 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-04-25T02:07:20.176 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T02:07:20.308 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T02:07:20.340 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:07:20.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:20.429+0000 7fce08331640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T02:07:20.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:20.430+0000 7fce08331640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T02:07:20.437 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:20.430+0000 7fce08331640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T02:07:20.437 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:20.430+0000 7fce08331640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T02:07:20.437 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:20.430+0000 7fce08331640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T02:07:20.437 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:20.430+0000 7fce08331640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T02:07:23.287 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T02:07:23.316 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:07:23.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:23.397+0000 7f50697d8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T02:07:23.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:23.397+0000 7f50697d8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T02:07:23.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:23.397+0000 7f50697d8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T02:07:23.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:23.397+0000 7f50697d8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T02:07:23.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:23.397+0000 7f50697d8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T02:07:23.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:23.398+0000 7f50697d8640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T02:07:26.249 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T02:07:26.276 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:07:26.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:26.358+0000 7fa3c6018640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T02:07:26.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:26.359+0000 7fa3c6018640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T02:07:26.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:26.359+0000 7fa3c6018640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T02:07:26.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:26.359+0000 7fa3c6018640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T02:07:26.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:26.359+0000 7fa3c6018640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T02:07:26.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:26.359+0000 7fa3c6018640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T02:07:29.108 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:07:29.111 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:07:29.220 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T02:07:29.245 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:07:29.331 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:29.324+0000 7faa2021a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T02:07:29.331 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:29.324+0000 7faa2021a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T02:07:29.331 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:29.324+0000 7faa2021a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T02:07:29.331 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:29.324+0000 7faa2021a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T02:07:29.331 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:29.324+0000 7faa2021a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T02:07:29.331 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:29.325+0000 7faa2021a640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T02:07:32.180 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T02:07:32.209 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T02:07:32.209 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:32.209 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T02:07:32.238 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:32.238 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T02:07:32.305 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:32.305 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T02:07:32.371 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:32.371 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T02:07:32.437 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:32.437 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T02:07:32.502 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:32.502 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T02:07:32.567 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:32.567 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T02:07:32.631 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:07:32.631 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T02:07:32.659 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:07:32.659 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T02:07:32.726 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:07:32.726 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T02:07:32.792 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:07:32.793 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T02:07:32.858 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:07:32.858 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T02:07:32.924 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:07:32.925 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T02:07:32.989 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:07:32.989 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T02:07:33.054 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:33.055 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T02:07:33.071 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:33.071 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-25T02:07:33.127 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:07:33.127 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T02:07:33.143 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:07:33.143 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-25T02:07:33.199 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T02:07:33.199 DEBUG:teuthology.orchestra.run.smithi079:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T02:07:33.201 DEBUG:teuthology.orchestra.run.smithi189:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T02:07:33.242 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.y] 2024-04-25T02:07:33.242 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDFuilmV8dxIBAA8GX2T/ZqZF+3qDjtddh/ZQ== 2024-04-25T02:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-04-25T02:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDFuilmkSfsJhAAEP9aqirUawsrrvVUkxkO0w== 2024-04-25T02:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2024-04-25T02:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDFuilmiqSiLRAAmCUWUrHC31tkg0dkXS54cA== 2024-04-25T02:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.0] 2024-04-25T02:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDJuilmP1AdGBAAS0IkH2E3XQvkxA33GInm5w== 2024-04-25T02:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.1] 2024-04-25T02:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDMuilm479HFhAA8iIjBC94pqHikS5kPHipCQ== 2024-04-25T02:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.2] 2024-04-25T02:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDPuilmE+k9FBAARX3P/kjt7ybeVHGGyYaWwg== 2024-04-25T02:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.3] 2024-04-25T02:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDSuilmUF41EhAA1HhTXWnhVwETe+4hxmxjFw== 2024-04-25T02:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.x] 2024-04-25T02:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDFuilmXrLhIxAAiq13px9HksQtu+qjoRi1qQ== 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDFuilm8wYYMhAA98c3h9c80Y9zYzVv+kY7qQ== 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDFuilmiPbkOBAA+rBwAypY5jrR3xafG9h1sw== 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.4] 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDYuilm2pisGRAAFBmWVAGib2guJobYooLQoA== 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.5] 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDbuilm28m9FxAA8GOmzxRAlK6o/RTe+FpL7g== 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.6] 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDeuilmzDRyFRAAKk7JWPVRxxE+B4OCJhaXvg== 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.7] 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDhuilmQABhExAA40Inq4eg4oohO3tmNdCyPQ== 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g== 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout:[client.2] 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDGuilmHUedBhAA84h2PNUgReBGQ3rubcEDsw== 2024-04-25T02:07:33.244 INFO:teuthology.orchestra.run.smithi079.stdout:[client.1] 2024-04-25T02:07:33.245 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDGuilm8EWZCRAAjRomNRANd7sC+tpYZ1uE6w== 2024-04-25T02:07:33.245 INFO:teuthology.orchestra.run.smithi079.stdout:[client.3] 2024-04-25T02:07:33.245 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDGuilmCx4UDxAAZmQdQB8RdTMr2JKr7TMySg== 2024-04-25T02:07:33.262 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr.y] 2024-04-25T02:07:33.263 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDFuilmV8dxIBAA8GX2T/ZqZF+3qDjtddh/ZQ== 2024-04-25T02:07:33.263 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.a] 2024-04-25T02:07:33.263 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDFuilmkSfsJhAAEP9aqirUawsrrvVUkxkO0w== 2024-04-25T02:07:33.263 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.c] 2024-04-25T02:07:33.263 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDFuilmiqSiLRAAmCUWUrHC31tkg0dkXS54cA== 2024-04-25T02:07:33.263 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.0] 2024-04-25T02:07:33.263 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDJuilmP1AdGBAAS0IkH2E3XQvkxA33GInm5w== 2024-04-25T02:07:33.263 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.1] 2024-04-25T02:07:33.263 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDMuilm479HFhAA8iIjBC94pqHikS5kPHipCQ== 2024-04-25T02:07:33.263 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.2] 2024-04-25T02:07:33.263 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDPuilmE+k9FBAARX3P/kjt7ybeVHGGyYaWwg== 2024-04-25T02:07:33.263 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.3] 2024-04-25T02:07:33.263 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDSuilmUF41EhAA1HhTXWnhVwETe+4hxmxjFw== 2024-04-25T02:07:33.263 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr.x] 2024-04-25T02:07:33.263 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDFuilmXrLhIxAAiq13px9HksQtu+qjoRi1qQ== 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.b] 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDFuilm8wYYMhAA98c3h9c80Y9zYzVv+kY7qQ== 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.d] 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDFuilmiPbkOBAA+rBwAypY5jrR3xafG9h1sw== 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.4] 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDYuilm2pisGRAAFBmWVAGib2guJobYooLQoA== 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.5] 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDbuilm28m9FxAA8GOmzxRAlK6o/RTe+FpL7g== 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.6] 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDeuilmzDRyFRAAKk7JWPVRxxE+B4OCJhaXvg== 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.7] 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDhuilmQABhExAA40Inq4eg4oohO3tmNdCyPQ== 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout:[client.0] 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g== 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout:[client.2] 2024-04-25T02:07:33.264 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDGuilmHUedBhAA84h2PNUgReBGQ3rubcEDsw== 2024-04-25T02:07:33.265 INFO:teuthology.orchestra.run.smithi189.stdout:[client.1] 2024-04-25T02:07:33.265 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDGuilm8EWZCRAAjRomNRANd7sC+tpYZ1uE6w== 2024-04-25T02:07:33.265 INFO:teuthology.orchestra.run.smithi189.stdout:[client.3] 2024-04-25T02:07:33.265 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDGuilmCx4UDxAAZmQdQB8RdTMr2JKr7TMySg== 2024-04-25T02:07:33.266 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T02:07:33.288 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T02:07:33.356 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:07:33.358 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:07:33.409 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:07:33.412 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:07:33.463 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:33.465 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:33.513 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:33.515 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:33.564 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:33.567 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:33.615 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:33.617 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:33.666 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T02:07:33.668 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T02:07:33.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:07:33.719 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:07:33.770 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:07:33.772 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:07:33.824 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:33.826 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:33.874 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:33.877 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:33.926 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:33.928 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:33.977 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:33.979 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:07:34.028 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:07:34.030 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:07:34.081 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:07:34.084 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:07:34.135 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:07:34.138 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:07:34.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:07:34.191 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:07:34.242 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T02:07:34.242 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T02:07:34.265 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T02:07:34.359 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T02:07:34.382 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T02:07:34.406 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T02:07:34.500 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T02:07:34.523 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T02:07:34.587 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T02:07:34.680 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T02:07:34.703 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:07:34.706 DEBUG:teuthology.orchestra.run.smithi189:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:07:34.758 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T02:07:34.758 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T02:07:34.759 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T02:07:34.761 INFO:tasks.ceph.mon.a:Started 2024-04-25T02:07:34.761 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T02:07:34.761 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T02:07:34.801 INFO:tasks.ceph.mon.b:Started 2024-04-25T02:07:34.801 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T02:07:34.801 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T02:07:34.803 INFO:tasks.ceph.mon.c:Started 2024-04-25T02:07:34.803 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T02:07:34.803 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T02:07:34.803 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T02:07:34.806 INFO:tasks.ceph.mgr.y:Started 2024-04-25T02:07:34.806 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T02:07:34.806 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T02:07:34.808 INFO:tasks.ceph.mgr.x:Started 2024-04-25T02:07:34.808 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T02:07:34.808 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T02:07:34.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.898+0000 7f43c4295640 1 Processor -- start 2024-04-25T02:07:34.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.898+0000 7f43c4295640 1 -- start start 2024-04-25T02:07:34.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.899+0000 7f43c4295640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f43bc145af0 0x7f43bc072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:34.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.899+0000 7f43c4295640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc15fb20 0x7f43bc0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:34.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.899+0000 7f43c4295640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43bc072610 con 0x7f43bc0cde90 2024-04-25T02:07:34.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.899+0000 7f43c4295640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f43bc073220 con 0x7f43bc145af0 2024-04-25T02:07:34.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.899+0000 7f43c4295640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f43bc0728f0 con 0x7f43bc15fb20 2024-04-25T02:07:34.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.899+0000 7f43c2832640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f43bc0cde90 0x7f43bc06b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49078/0 (socket says 172.21.15.79:49078) 2024-04-25T02:07:34.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.899+0000 7f43c2832640 1 -- 172.21.15.79:0/1778717069 learned_addr learned my addr 172.21.15.79:0/1778717069 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:07:34.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.900+0000 7f43c1830640 1 --2- 172.21.15.79:0/1778717069 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc15fb20 0x7f43bc0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:34.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.900+0000 7f43c2031640 1 --2- 172.21.15.79:0/1778717069 >> v2:172.21.15.189:3300/0 conn(0x7f43bc145af0 0x7f43bc072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:34.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.900+0000 7f43c1830640 1 -- 172.21.15.79:0/1778717069 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc15fb20 msgr2=0x7f43bc0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T02:07:34.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.900+0000 7f43c1830640 1 -- 172.21.15.79:0/1778717069 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc15fb20 msgr2=0x7f43bc0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:07:34.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.900+0000 7f43c1830640 1 --2- 172.21.15.79:0/1778717069 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc15fb20 0x7f43bc0cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T02:07:34.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.900+0000 7f43c1830640 1 --2- 172.21.15.79:0/1778717069 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc15fb20 0x7f43bc0cd950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:07:34.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.900+0000 7f43c2031640 1 -- 172.21.15.79:0/1778717069 >> v2:172.21.15.189:3300/0 conn(0x7f43bc145af0 msgr2=0x7f43bc072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:07:34.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.900+0000 7f43c2031640 1 -- 172.21.15.79:0/1778717069 >> v2:172.21.15.189:3300/0 conn(0x7f43bc145af0 msgr2=0x7f43bc072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:07:34.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.900+0000 7f43c2031640 1 --2- 172.21.15.79:0/1778717069 >> v2:172.21.15.189:3300/0 conn(0x7f43bc145af0 0x7f43bc072030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T02:07:34.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:34.900+0000 7f43c2031640 1 --2- 172.21.15.79:0/1778717069 >> v2:172.21.15.189:3300/0 conn(0x7f43bc145af0 0x7f43bc072030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:07:35.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.065+0000 7f43c102f640 1 -- 172.21.15.79:0/1778717069 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1404847598 0 0) 0x7f43bc072610 con 0x7f43bc0cde90 2024-04-25T02:07:35.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c102f640 1 -- 172.21.15.79:0/1778717069 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43a8003520 con 0x7f43bc0cde90 2024-04-25T02:07:35.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c102f640 1 -- 172.21.15.79:0/1778717069 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1979007790 0 0) 0x7f43a8003520 con 0x7f43bc0cde90 2024-04-25T02:07:35.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c102f640 1 -- 172.21.15.79:0/1778717069 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc15fb20 msgr2=0x7f43bc0cd950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:07:35.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c102f640 1 --2- 172.21.15.79:0/1778717069 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc15fb20 0x7f43bc0cd950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c102f640 1 -- 172.21.15.79:0/1778717069 >> v2:172.21.15.189:3300/0 conn(0x7f43bc145af0 msgr2=0x7f43bc072030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:07:35.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c102f640 1 --2- 172.21.15.79:0/1778717069 >> v2:172.21.15.189:3300/0 conn(0x7f43bc145af0 0x7f43bc072030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c102f640 1 -- 172.21.15.79:0/1778717069 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43bc072bd0 con 0x7f43bc0cde90 2024-04-25T02:07:35.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c102f640 1 -- 172.21.15.79:0/1778717069 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f43b40019f0 con 0x7f43bc0cde90 2024-04-25T02:07:35.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c102f640 1 -- 172.21.15.79:0/1778717069 >> v1:172.21.15.79:6789/0 conn(0x7f43bc0cde90 legacy=0x7f43bc06b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:35.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c102f640 1 --2- 172.21.15.79:0/1778717069 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc15fb20 0x7f43a80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c102f640 1 --2- 172.21.15.79:0/1778717069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43a8004030 0x7f43a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c102f640 1 --2- 172.21.15.79:0/1778717069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43a8004d40 0x7f43a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c102f640 1 -- 172.21.15.79:0/1778717069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc0728f0 con 0x7f43a8004d40 2024-04-25T02:07:35.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c102f640 1 -- 172.21.15.79:0/1778717069 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f43a800baa0 con 0x7f43a8004030 2024-04-25T02:07:35.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c102f640 1 -- 172.21.15.79:0/1778717069 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f43a800bca0 con 0x7f43bc15fb20 2024-04-25T02:07:35.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c2832640 1 --2- 172.21.15.79:0/1778717069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43a8004d40 0x7f43a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c1830640 1 --2- 172.21.15.79:0/1778717069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43a8004030 0x7f43a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c2031640 1 --2- 172.21.15.79:0/1778717069 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc15fb20 0x7f43a80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c2832640 1 -- 172.21.15.79:0/1778717069 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc15fb20 msgr2=0x7f43a80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:35.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c2832640 1 --2- 172.21.15.79:0/1778717069 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc15fb20 0x7f43a80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c2832640 1 -- 172.21.15.79:0/1778717069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43a8004030 msgr2=0x7f43a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:35.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c2832640 1 --2- 172.21.15.79:0/1778717069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43a8004030 0x7f43a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.066+0000 7f43c2832640 1 -- 172.21.15.79:0/1778717069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a8003520 con 0x7f43a8004d40 2024-04-25T02:07:35.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.067+0000 7f43c2832640 1 --2- 172.21.15.79:0/1778717069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43a8004d40 0x7f43a80051c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f43b400a7b0 tx=0x7f43a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b481c89a97d6d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:35.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.067+0000 7f43c102f640 1 -- 172.21.15.79:0/1778717069 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b400a3d0 con 0x7f43a8004d40 2024-04-25T02:07:35.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.067+0000 7f43c102f640 1 -- 172.21.15.79:0/1778717069 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b402f070 con 0x7f43a8004d40 2024-04-25T02:07:35.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.067+0000 7f43c102f640 1 -- 172.21.15.79:0/1778717069 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b402bc20 con 0x7f43a8004d40 2024-04-25T02:07:35.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.068+0000 7f43c4295640 1 -- 172.21.15.79:0/1778717069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43a8004d40 msgr2=0x7f43a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:35.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.068+0000 7f43c4295640 1 --2- 172.21.15.79:0/1778717069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43a8004d40 0x7f43a80051c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f43b400a7b0 tx=0x7f43a8005830 comp rx=0 tx=0).stop 2024-04-25T02:07:35.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.068+0000 7f43c2832640 1 -- 172.21.15.79:0/1778717069 reap_dead start 2024-04-25T02:07:35.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.068+0000 7f43c4295640 1 -- 172.21.15.79:0/1778717069 shutdown_connections 2024-04-25T02:07:35.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.068+0000 7f43c4295640 1 -- 172.21.15.79:0/1778717069 >> 172.21.15.79:0/1778717069 conn(0x7f43bc0d0f40 msgr2=0x7f43bc0d1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:35.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.068+0000 7f43c4295640 1 -- 172.21.15.79:0/1778717069 shutdown_connections 2024-04-25T02:07:35.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.068+0000 7f43c4295640 1 -- 172.21.15.79:0/1778717069 wait complete. 2024-04-25T02:07:35.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.069+0000 7f43c4295640 1 Processor -- start 2024-04-25T02:07:35.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.069+0000 7f43c4295640 1 -- start start 2024-04-25T02:07:35.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.070+0000 7f43c4295640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43a8004d40 0x7f43bc15e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.070+0000 7f43c4295640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43bc1428e0 0x7f43bc142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.070+0000 7f43c4295640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc139ac0 0x7f43bc139f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.070+0000 7f43c4295640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc0d1e70 con 0x7f43bc1428e0 2024-04-25T02:07:35.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.070+0000 7f43c4295640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc0d1cf0 con 0x7f43a8004d40 2024-04-25T02:07:35.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.070+0000 7f43c4295640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f43bc0d0ab0 con 0x7f43bc139ac0 2024-04-25T02:07:35.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.070+0000 7f43c2031640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43a8004d40 0x7f43bc15e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.070+0000 7f43c1830640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43bc1428e0 0x7f43bc142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.070+0000 7f43c2031640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43a8004d40 0x7f43bc15e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:37192/0 (socket says 172.21.15.79:37192) 2024-04-25T02:07:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.070+0000 7f43c2031640 1 -- 172.21.15.79:0/557551449 learned_addr learned my addr 172.21.15.79:0/557551449 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.070+0000 7f43c2832640 1 --2- 172.21.15.79:0/557551449 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc139ac0 0x7f43bc139f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.071+0000 7f43c1830640 1 -- 172.21.15.79:0/557551449 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc139ac0 msgr2=0x7f43bc139f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.071+0000 7f43c1830640 1 --2- 172.21.15.79:0/557551449 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc139ac0 0x7f43bc139f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.071+0000 7f43c1830640 1 -- 172.21.15.79:0/557551449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43a8004d40 msgr2=0x7f43bc15e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.071+0000 7f43c1830640 1 --2- 172.21.15.79:0/557551449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43a8004d40 0x7f43bc15e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.071+0000 7f43c1830640 1 -- 172.21.15.79:0/557551449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43bc143450 con 0x7f43bc1428e0 2024-04-25T02:07:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.071+0000 7f43c1830640 1 --2- 172.21.15.79:0/557551449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43bc1428e0 0x7f43bc142d40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0108c0 tx=0x7f43ac010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.071+0000 7f43b2ffd640 1 -- 172.21.15.79:0/557551449 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac01a020 con 0x7f43bc1428e0 2024-04-25T02:07:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.071+0000 7f43b2ffd640 1 -- 172.21.15.79:0/557551449 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ac00e9c0 con 0x7f43bc1428e0 2024-04-25T02:07:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.071+0000 7f43c4295640 1 -- 172.21.15.79:0/557551449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43bc143730 con 0x7f43bc1428e0 2024-04-25T02:07:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.071+0000 7f43b2ffd640 1 -- 172.21.15.79:0/557551449 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac00ed90 con 0x7f43bc1428e0 2024-04-25T02:07:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.071+0000 7f43c4295640 1 -- 172.21.15.79:0/557551449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43bc143cf0 con 0x7f43bc1428e0 2024-04-25T02:07:35.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.071+0000 7f43b2ffd640 1 -- 172.21.15.79:0/557551449 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f43ac01d020 con 0x7f43bc1428e0 2024-04-25T02:07:35.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.071+0000 7f43b2ffd640 1 -- 172.21.15.79:0/557551449 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f43ac014810 con 0x7f43bc1428e0 2024-04-25T02:07:35.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.072+0000 7f43c4295640 1 -- 172.21.15.79:0/557551449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43bc0734e0 con 0x7f43bc1428e0 2024-04-25T02:07:35.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.074+0000 7f43b2ffd640 1 -- 172.21.15.79:0/557551449 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f43ac024020 con 0x7f43bc1428e0 2024-04-25T02:07:35.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.140+0000 7f43c4295640 1 -- 172.21.15.79:0/557551449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f43bc0681e0 con 0x7f43bc1428e0 2024-04-25T02:07:35.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.141+0000 7f43b2ffd640 1 -- 172.21.15.79:0/557551449 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f43ac014a60 con 0x7f43bc1428e0 2024-04-25T02:07:35.148 INFO:teuthology.orchestra.run.smithi079.stderr:adjusted tunables profile to default 2024-04-25T02:07:35.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.142+0000 7f43c4295640 1 -- 172.21.15.79:0/557551449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43bc1428e0 msgr2=0x7f43bc142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:35.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.142+0000 7f43c4295640 1 --2- 172.21.15.79:0/557551449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43bc1428e0 0x7f43bc142d40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0108c0 tx=0x7f43ac010d80 comp rx=0 tx=0).stop 2024-04-25T02:07:35.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.142+0000 7f43c4295640 1 -- 172.21.15.79:0/557551449 shutdown_connections 2024-04-25T02:07:35.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.142+0000 7f43c4295640 1 --2- 172.21.15.79:0/557551449 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43bc139ac0 0x7f43bc139f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.142+0000 7f43c4295640 1 --2- 172.21.15.79:0/557551449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43bc1428e0 0x7f43bc142d40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.142+0000 7f43c4295640 1 --2- 172.21.15.79:0/557551449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43a8004d40 0x7f43bc15e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.142+0000 7f43c4295640 1 -- 172.21.15.79:0/557551449 >> 172.21.15.79:0/557551449 conn(0x7f43bc0d0f40 msgr2=0x7f43bc140210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:35.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.142+0000 7f43c4295640 1 -- 172.21.15.79:0/557551449 shutdown_connections 2024-04-25T02:07:35.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:35.142+0000 7f43c4295640 1 -- 172.21.15.79:0/557551449 wait complete. 2024-04-25T02:07:35.159 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T02:07:35.159 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T02:07:35.160 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:35.160 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T02:07:35.183 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:35.183 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T02:07:35.184 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:35.177+0000 7f129952f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T02:07:35.194 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:35.187+0000 7f16d7c12040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T02:07:35.216 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:35.217 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T02:07:35.280 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:07:35.280 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T02:07:35.330 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:35.324+0000 7f129952f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:07:35.343 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:07:35.344 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T02:07:35.367 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:07:35.367 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T02:07:35.380 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:35.374+0000 7f16d7c12040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:07:35.386 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:35.380+0000 7f129952f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T02:07:35.409 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:07:35.409 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T02:07:35.433 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:35.427+0000 7f16d7c12040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T02:07:35.473 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:07:35.473 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T02:07:35.537 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 0ebc5722-e360-466e-9772-ea294d40fd42 0 2024-04-25T02:07:35.668 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:35.662+0000 7f16d7c12040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T02:07:35.673 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.667+0000 7fee26553640 1 Processor -- start 2024-04-25T02:07:35.673 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.667+0000 7fee26553640 1 -- start start 2024-04-25T02:07:35.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.667+0000 7fee26553640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fee2015e4f0 0x7fee200d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.667+0000 7fee26553640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee200d10c0 0x7fee2006bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.667+0000 7fee26553640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee200d1ee0 con 0x7fee200cf7f0 2024-04-25T02:07:35.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.667+0000 7fee26553640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fee200d21c0 con 0x7fee2015e4f0 2024-04-25T02:07:35.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.667+0000 7fee26553640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fee200d24a0 con 0x7fee200d10c0 2024-04-25T02:07:35.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.667+0000 7fee1ffff640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fee2015e4f0 0x7fee200d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.667+0000 7fee1ffff640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fee2015e4f0 0x7fee200d2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:56460/0 (socket says 172.21.15.189:56460) 2024-04-25T02:07:35.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.668+0000 7fee1ffff640 1 -- 172.21.15.189:0/1838094905 learned_addr learned my addr 172.21.15.189:0/1838094905 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-25T02:07:35.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.668+0000 7fee24af0640 1 --2- 172.21.15.189:0/1838094905 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee200d10c0 0x7fee2006bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.668+0000 7fee1ffff640 1 -- 172.21.15.189:0/1838094905 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee200d10c0 msgr2=0x7fee2006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:35.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.668+0000 7fee1ffff640 1 --2- 172.21.15.189:0/1838094905 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee200d10c0 0x7fee2006bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.668+0000 7fee1ffff640 1 -- 172.21.15.189:0/1838094905 >> v1:172.21.15.79:6789/0 conn(0x7fee200cf7f0 legacy=0x7fee200d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:35.676 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.668+0000 7fee1ffff640 1 -- 172.21.15.189:0/1838094905 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee200d2780 con 0x7fee2015e4f0 2024-04-25T02:07:35.676 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.668+0000 7fee24af0640 1 --2- 172.21.15.189:0/1838094905 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee200d10c0 0x7fee2006bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:35.677 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.668+0000 7fee1ffff640 1 --2- 172.21.15.189:0/1838094905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee2015e4f0 0x7fee200d2ca0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fee140098a0 tx=0x7fee1402a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38f1d2333477db19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:35.677 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.669+0000 7fee1effd640 1 -- 172.21.15.189:0/1838094905 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14037070 con 0x7fee2015e4f0 2024-04-25T02:07:35.677 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.669+0000 7fee1effd640 1 -- 172.21.15.189:0/1838094905 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee14032440 con 0x7fee2015e4f0 2024-04-25T02:07:35.677 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.669+0000 7fee1effd640 1 -- 172.21.15.189:0/1838094905 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14032810 con 0x7fee2015e4f0 2024-04-25T02:07:35.677 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.669+0000 7fee26553640 1 -- 172.21.15.189:0/1838094905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee2015e4f0 msgr2=0x7fee200d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:35.678 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.669+0000 7fee26553640 1 --2- 172.21.15.189:0/1838094905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee2015e4f0 0x7fee200d2ca0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fee140098a0 tx=0x7fee1402a290 comp rx=0 tx=0).stop 2024-04-25T02:07:35.678 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.669+0000 7fee26553640 1 -- 172.21.15.189:0/1838094905 shutdown_connections 2024-04-25T02:07:35.678 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.669+0000 7fee26553640 1 --2- 172.21.15.189:0/1838094905 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee200d10c0 0x7fee2006bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.678 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.669+0000 7fee26553640 1 --2- 172.21.15.189:0/1838094905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee2015e4f0 0x7fee200d2ca0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.678 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.669+0000 7fee26553640 1 -- 172.21.15.189:0/1838094905 >> 172.21.15.189:0/1838094905 conn(0x7fee2009d4a0 msgr2=0x7fee200d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:35.678 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.669+0000 7fee26553640 1 -- 172.21.15.189:0/1838094905 shutdown_connections 2024-04-25T02:07:35.678 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.669+0000 7fee26553640 1 -- 172.21.15.189:0/1838094905 wait complete. 2024-04-25T02:07:35.678 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.670+0000 7fee26553640 1 Processor -- start 2024-04-25T02:07:35.678 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.671+0000 7fee26553640 1 -- start start 2024-04-25T02:07:35.680 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.671+0000 7fee26553640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee200cf7f0 0x7fee201f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.681 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.671+0000 7fee26553640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee200d10c0 0x7fee200b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.681 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.671+0000 7fee26553640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee2015e4f0 0x7fee200b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.681 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.671+0000 7fee26553640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fee200cfe00 con 0x7fee200cf7f0 2024-04-25T02:07:35.681 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.671+0000 7fee26553640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fee200cfc80 con 0x7fee2015e4f0 2024-04-25T02:07:35.681 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.671+0000 7fee26553640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fee200cff80 con 0x7fee200d10c0 2024-04-25T02:07:35.681 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee1f7fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee200d10c0 0x7fee200b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.681 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee24af0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee2015e4f0 0x7fee200b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.681 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee1f7fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee200d10c0 0x7fee200b2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:50786/0 (socket says 172.21.15.189:50786) 2024-04-25T02:07:35.681 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee1f7fe640 1 -- 172.21.15.189:0/1253044165 learned_addr learned my addr 172.21.15.189:0/1253044165 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-25T02:07:35.681 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee1ffff640 1 --2- 172.21.15.189:0/1253044165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee200cf7f0 0x7fee201f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.681 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee24af0640 1 -- 172.21.15.189:0/1253044165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee200d10c0 msgr2=0x7fee200b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:35.681 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee24af0640 1 --2- 172.21.15.189:0/1253044165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee200d10c0 0x7fee200b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.681 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee24af0640 1 -- 172.21.15.189:0/1253044165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee200cf7f0 msgr2=0x7fee201f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:35.681 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee24af0640 1 --2- 172.21.15.189:0/1253044165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee200cf7f0 0x7fee201f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.681 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee24af0640 1 -- 172.21.15.189:0/1253044165 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee200c9280 con 0x7fee2015e4f0 2024-04-25T02:07:35.682 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee24af0640 1 --2- 172.21.15.189:0/1253044165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee2015e4f0 0x7fee200b2b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fee1800efc0 tx=0x7fee1800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:35.682 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee1cff9640 1 -- 172.21.15.189:0/1253044165 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee18018030 con 0x7fee2015e4f0 2024-04-25T02:07:35.682 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee1cff9640 1 -- 172.21.15.189:0/1253044165 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1800cd30 con 0x7fee2015e4f0 2024-04-25T02:07:35.682 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee26553640 1 -- 172.21.15.189:0/1253044165 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee201f7f10 con 0x7fee2015e4f0 2024-04-25T02:07:35.682 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee1cff9640 1 -- 172.21.15.189:0/1253044165 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee18003bb0 con 0x7fee2015e4f0 2024-04-25T02:07:35.682 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.672+0000 7fee26553640 1 -- 172.21.15.189:0/1253044165 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee201f84d0 con 0x7fee2015e4f0 2024-04-25T02:07:35.682 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.673+0000 7fee1cff9640 1 -- 172.21.15.189:0/1253044165 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fee1801b070 con 0x7fee2015e4f0 2024-04-25T02:07:35.682 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.673+0000 7fee1cff9640 1 -- 172.21.15.189:0/1253044165 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fee1801d8c0 con 0x7fee2015e4f0 2024-04-25T02:07:35.682 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.674+0000 7fee26553640 1 -- 172.21.15.189:0/1253044165 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee200686c0 con 0x7fee2015e4f0 2024-04-25T02:07:35.682 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.676+0000 7fee1cff9640 1 -- 172.21.15.189:0/1253044165 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fee18010040 con 0x7fee2015e4f0 2024-04-25T02:07:35.685 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:35.679+0000 7f129952f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T02:07:35.714 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:35.707+0000 7f16d7c12040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T02:07:35.732 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:35.726+0000 7f129952f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T02:07:35.754 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.748+0000 7fee26553640 1 -- 172.21.15.189:0/1253044165 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0ebc5722-e360-466e-9772-ea294d40fd42", "id": 0} v 0) -- 0x7fee200c9450 con 0x7fee2015e4f0 2024-04-25T02:07:35.760 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.754+0000 7fee1cff9640 1 -- 172.21.15.189:0/1253044165 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0ebc5722-e360-466e-9772-ea294d40fd42", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fee1801dc40 con 0x7fee2015e4f0 2024-04-25T02:07:35.760 INFO:teuthology.orchestra.run.smithi189.stdout:0 2024-04-25T02:07:35.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.755+0000 7fee26553640 1 -- 172.21.15.189:0/1253044165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee2015e4f0 msgr2=0x7fee200b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:35.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.755+0000 7fee26553640 1 --2- 172.21.15.189:0/1253044165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee2015e4f0 0x7fee200b2b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fee1800efc0 tx=0x7fee1800c490 comp rx=0 tx=0).stop 2024-04-25T02:07:35.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.755+0000 7fee26553640 1 -- 172.21.15.189:0/1253044165 shutdown_connections 2024-04-25T02:07:35.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.755+0000 7fee26553640 1 --2- 172.21.15.189:0/1253044165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee2015e4f0 0x7fee200b2b90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.755+0000 7fee26553640 1 --2- 172.21.15.189:0/1253044165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee200d10c0 0x7fee200b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.755+0000 7fee26553640 1 --2- 172.21.15.189:0/1253044165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee200cf7f0 0x7fee201f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.755+0000 7fee26553640 1 -- 172.21.15.189:0/1253044165 >> 172.21.15.189:0/1253044165 conn(0x7fee2009d4a0 msgr2=0x7fee2015a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:35.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.755+0000 7fee26553640 1 -- 172.21.15.189:0/1253044165 shutdown_connections 2024-04-25T02:07:35.763 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.755+0000 7fee26553640 1 -- 172.21.15.189:0/1253044165 wait complete. 2024-04-25T02:07:35.776 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6 1 2024-04-25T02:07:35.874 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.867+0000 7efe7b57e640 1 Processor -- start 2024-04-25T02:07:35.874 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.867+0000 7efe7b57e640 1 -- start start 2024-04-25T02:07:35.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe7b57e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe7415e250 0x7efe740cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe7b57e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7efe740cfbc0 0x7efe740d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe7b57e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe740d0f50 0x7efe740b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe7b57e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7efe740d13c0 con 0x7efe740d0f50 2024-04-25T02:07:35.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe7b57e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7efe740d00b0 con 0x7efe740cfbc0 2024-04-25T02:07:35.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe7b57e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efe740b7050 con 0x7efe7415e250 2024-04-25T02:07:35.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe78b19640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7efe740cfbc0 0x7efe740d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe7931a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe7415e250 0x7efe740cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe7931a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe7415e250 0x7efe740cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:50794/0 (socket says 172.21.15.189:50794) 2024-04-25T02:07:35.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe7931a640 1 -- 172.21.15.189:0/3630147625 learned_addr learned my addr 172.21.15.189:0/3630147625 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-25T02:07:35.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe78b19640 1 --2- 172.21.15.189:0/3630147625 >> v2:172.21.15.189:3300/0 conn(0x7efe740cfbc0 0x7efe740d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:56476/0 (socket says 172.21.15.189:56476) 2024-04-25T02:07:35.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe79b1b640 1 --2- 172.21.15.189:0/3630147625 >> v2:172.21.15.79:3300/0 conn(0x7efe740d0f50 0x7efe740b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.877 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe7931a640 1 -- 172.21.15.189:0/3630147625 >> v2:172.21.15.189:3300/0 conn(0x7efe740cfbc0 msgr2=0x7efe740d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:35.877 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe7931a640 1 --2- 172.21.15.189:0/3630147625 >> v2:172.21.15.189:3300/0 conn(0x7efe740cfbc0 0x7efe740d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.877 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe7931a640 1 -- 172.21.15.189:0/3630147625 >> v2:172.21.15.79:3300/0 conn(0x7efe740d0f50 msgr2=0x7efe740b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:35.877 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe7931a640 1 --2- 172.21.15.189:0/3630147625 >> v2:172.21.15.79:3300/0 conn(0x7efe740d0f50 0x7efe740b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.877 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.868+0000 7efe7931a640 1 -- 172.21.15.189:0/3630147625 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe740b7330 con 0x7efe7415e250 2024-04-25T02:07:35.877 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.869+0000 7efe7931a640 1 --2- 172.21.15.189:0/3630147625 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe7415e250 0x7efe740cf680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efe7408e5e0 tx=0x7efe6402a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b68047ebe5e5569c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:35.877 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.869+0000 7efe6bfff640 1 -- 172.21.15.189:0/3630147625 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe64037070 con 0x7efe7415e250 2024-04-25T02:07:35.877 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.869+0000 7efe6bfff640 1 -- 172.21.15.189:0/3630147625 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe64032440 con 0x7efe7415e250 2024-04-25T02:07:35.877 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.869+0000 7efe6bfff640 1 -- 172.21.15.189:0/3630147625 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe64032810 con 0x7efe7415e250 2024-04-25T02:07:35.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.870+0000 7efe7b57e640 1 -- 172.21.15.189:0/3630147625 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe7415e250 msgr2=0x7efe740cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:35.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.870+0000 7efe7b57e640 1 --2- 172.21.15.189:0/3630147625 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe7415e250 0x7efe740cf680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efe7408e5e0 tx=0x7efe6402a140 comp rx=0 tx=0).stop 2024-04-25T02:07:35.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.870+0000 7efe7b57e640 1 -- 172.21.15.189:0/3630147625 shutdown_connections 2024-04-25T02:07:35.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.870+0000 7efe7b57e640 1 --2- 172.21.15.189:0/3630147625 >> v2:172.21.15.79:3300/0 conn(0x7efe740d0f50 0x7efe740b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.870+0000 7efe7b57e640 1 --2- 172.21.15.189:0/3630147625 >> v2:172.21.15.189:3300/0 conn(0x7efe740cfbc0 0x7efe740d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.870+0000 7efe7b57e640 1 --2- 172.21.15.189:0/3630147625 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe7415e250 0x7efe740cf680 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.870+0000 7efe7b57e640 1 -- 172.21.15.189:0/3630147625 >> 172.21.15.189:0/3630147625 conn(0x7efe7409d3a0 msgr2=0x7efe740d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:35.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.870+0000 7efe7b57e640 1 -- 172.21.15.189:0/3630147625 shutdown_connections 2024-04-25T02:07:35.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.870+0000 7efe7b57e640 1 -- 172.21.15.189:0/3630147625 wait complete. 2024-04-25T02:07:35.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.871+0000 7efe7b57e640 1 Processor -- start 2024-04-25T02:07:35.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.871+0000 7efe7b57e640 1 -- start start 2024-04-25T02:07:35.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe7b57e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe740cfbc0 0x7efe741525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe7b57e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe740d0f50 0x7efe740b8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe7b57e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe7415e250 0x7efe740b8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:35.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe7b57e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efe7415e630 con 0x7efe740cfbc0 2024-04-25T02:07:35.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe7b57e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efe740b78f0 con 0x7efe7415e250 2024-04-25T02:07:35.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe7b57e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efe7415e7b0 con 0x7efe740d0f50 2024-04-25T02:07:35.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe78b19640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe740d0f50 0x7efe740b8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe79b1b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe7415e250 0x7efe740b8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe78b19640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe740d0f50 0x7efe740b8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:50800/0 (socket says 172.21.15.189:50800) 2024-04-25T02:07:35.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe78b19640 1 -- 172.21.15.189:0/1008415002 learned_addr learned my addr 172.21.15.189:0/1008415002 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-25T02:07:35.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe7931a640 1 --2- 172.21.15.189:0/1008415002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe740cfbc0 0x7efe741525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:35.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe78b19640 1 -- 172.21.15.189:0/1008415002 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe7415e250 msgr2=0x7efe740b8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:35.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe78b19640 1 --2- 172.21.15.189:0/1008415002 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe7415e250 0x7efe740b8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe78b19640 1 -- 172.21.15.189:0/1008415002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe740cfbc0 msgr2=0x7efe741525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:35.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe78b19640 1 --2- 172.21.15.189:0/1008415002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe740cfbc0 0x7efe741525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.883 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe78b19640 1 -- 172.21.15.189:0/1008415002 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7415f600 con 0x7efe740d0f50 2024-04-25T02:07:35.883 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe78b19640 1 --2- 172.21.15.189:0/1008415002 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe740d0f50 0x7efe740b8200 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efe7000e860 tx=0x7efe7000ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:35.883 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe69ffb640 1 -- 172.21.15.189:0/1008415002 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70017070 con 0x7efe740d0f50 2024-04-25T02:07:35.883 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe69ffb640 1 -- 172.21.15.189:0/1008415002 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7000c940 con 0x7efe740d0f50 2024-04-25T02:07:35.883 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe69ffb640 1 -- 172.21.15.189:0/1008415002 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7000cd10 con 0x7efe740d0f50 2024-04-25T02:07:35.883 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.872+0000 7efe7b57e640 1 -- 172.21.15.189:0/1008415002 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe7415f8e0 con 0x7efe740d0f50 2024-04-25T02:07:35.883 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.873+0000 7efe7b57e640 1 -- 172.21.15.189:0/1008415002 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efe7415fea0 con 0x7efe740d0f50 2024-04-25T02:07:35.883 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.873+0000 7efe69ffb640 1 -- 172.21.15.189:0/1008415002 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efe7001a070 con 0x7efe740d0f50 2024-04-25T02:07:35.883 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.873+0000 7efe69ffb640 1 -- 172.21.15.189:0/1008415002 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7efe7001c910 con 0x7efe740d0f50 2024-04-25T02:07:35.883 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.874+0000 7efe7b57e640 1 -- 172.21.15.189:0/1008415002 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe740681e0 con 0x7efe740d0f50 2024-04-25T02:07:35.883 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.876+0000 7efe69ffb640 1 -- 172.21.15.189:0/1008415002 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7efe7001cb60 con 0x7efe740d0f50 2024-04-25T02:07:35.955 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.948+0000 7efe7b57e640 1 -- 172.21.15.189:0/1008415002 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6", "id": 1} v 0) -- 0x7efe7406c510 con 0x7efe740d0f50 2024-04-25T02:07:35.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.954+0000 7efe69ffb640 1 -- 172.21.15.189:0/1008415002 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7efe7001cd40 con 0x7efe740d0f50 2024-04-25T02:07:35.961 INFO:teuthology.orchestra.run.smithi189.stdout:1 2024-04-25T02:07:35.962 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.955+0000 7efe7b57e640 1 -- 172.21.15.189:0/1008415002 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe740d0f50 msgr2=0x7efe740b8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:35.962 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.955+0000 7efe7b57e640 1 --2- 172.21.15.189:0/1008415002 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe740d0f50 0x7efe740b8200 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efe7000e860 tx=0x7efe7000ed20 comp rx=0 tx=0).stop 2024-04-25T02:07:35.962 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.955+0000 7efe7b57e640 1 -- 172.21.15.189:0/1008415002 shutdown_connections 2024-04-25T02:07:35.962 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.955+0000 7efe7b57e640 1 --2- 172.21.15.189:0/1008415002 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe7415e250 0x7efe740b8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.962 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.955+0000 7efe7b57e640 1 --2- 172.21.15.189:0/1008415002 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe740d0f50 0x7efe740b8200 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.963 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.955+0000 7efe7b57e640 1 --2- 172.21.15.189:0/1008415002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe740cfbc0 0x7efe741525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:35.963 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.955+0000 7efe7b57e640 1 -- 172.21.15.189:0/1008415002 >> 172.21.15.189:0/1008415002 conn(0x7efe7409d3a0 msgr2=0x7efe740ca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:35.963 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.955+0000 7efe7b57e640 1 -- 172.21.15.189:0/1008415002 shutdown_connections 2024-04-25T02:07:35.963 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:35.955+0000 7efe7b57e640 1 -- 172.21.15.189:0/1008415002 wait complete. 2024-04-25T02:07:35.972 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 9720c83a-6aa9-4956-a0b0-8eb53c39e83e 2 2024-04-25T02:07:36.070 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.063+0000 7f53e0910640 1 Processor -- start 2024-04-25T02:07:36.070 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.063+0000 7f53e0910640 1 -- start start 2024-04-25T02:07:36.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.064+0000 7f53e0910640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f53dc147420 0x7f53dc0670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.064+0000 7f53e0910640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53dc06bac0 con 0x7f53dc0b3c90 2024-04-25T02:07:36.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.064+0000 7f53e0910640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53dc06bda0 con 0x7f53dc06f220 2024-04-25T02:07:36.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.064+0000 7f53e0910640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f53dc06c080 con 0x7f53dc147420 2024-04-25T02:07:36.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.064+0000 7f53da59c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f53dc06f220 0x7f53dc0b3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:44264/0 (socket says 172.21.15.189:44264) 2024-04-25T02:07:36.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.064+0000 7f53da59c640 1 -- 172.21.15.189:0/98137692 learned_addr learned my addr 172.21.15.189:0/98137692 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-04-25T02:07:36.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.064+0000 7f53dad9d640 1 --2- 172.21.15.189:0/98137692 >> v2:172.21.15.79:3300/0 conn(0x7f53dc147420 0x7f53dc0670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.064+0000 7f53d959a640 1 -- 172.21.15.189:0/98137692 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2204780668 0 0) 0x7f53dc06bda0 con 0x7f53dc06f220 2024-04-25T02:07:36.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.064+0000 7f53d959a640 1 -- 172.21.15.189:0/98137692 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53c8003520 con 0x7f53dc06f220 2024-04-25T02:07:36.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.064+0000 7f53dad9d640 1 -- 172.21.15.189:0/98137692 >> v1:172.21.15.189:6789/0 conn(0x7f53dc06f220 legacy=0x7f53dc0b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.065+0000 7f53dad9d640 1 -- 172.21.15.189:0/98137692 >> v1:172.21.15.79:6789/0 conn(0x7f53dc0b3c90 legacy=0x7f53dc06d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.065+0000 7f53dad9d640 1 -- 172.21.15.189:0/98137692 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53dc06c360 con 0x7f53dc147420 2024-04-25T02:07:36.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.065+0000 7f53d959a640 1 -- 172.21.15.189:0/98137692 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1420880783 0 0) 0x7f53dc06bac0 con 0x7f53dc0b3c90 2024-04-25T02:07:36.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.065+0000 7f53dad9d640 1 --2- 172.21.15.189:0/98137692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53dc147420 0x7f53dc0670b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009dc0 tx=0x7f53cc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1d66019fb49e40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:36.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.065+0000 7f53d959a640 1 -- 172.21.15.189:0/98137692 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc007740 con 0x7f53dc147420 2024-04-25T02:07:36.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.065+0000 7f53d959a640 1 -- 172.21.15.189:0/98137692 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc0078e0 con 0x7f53dc147420 2024-04-25T02:07:36.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.065+0000 7f53d959a640 1 -- 172.21.15.189:0/98137692 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc007cb0 con 0x7f53dc147420 2024-04-25T02:07:36.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.066+0000 7f53e0910640 1 -- 172.21.15.189:0/98137692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53dc147420 msgr2=0x7f53dc0670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.066+0000 7f53e0910640 1 --2- 172.21.15.189:0/98137692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53dc147420 0x7f53dc0670b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009dc0 tx=0x7f53cc02a6a0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.075 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.066+0000 7f53e0910640 1 -- 172.21.15.189:0/98137692 shutdown_connections 2024-04-25T02:07:36.075 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.066+0000 7f53e0910640 1 --2- 172.21.15.189:0/98137692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53dc147420 0x7f53dc0670b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.075 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.066+0000 7f53e0910640 1 -- 172.21.15.189:0/98137692 >> 172.21.15.189:0/98137692 conn(0x7f53dc0d0510 msgr2=0x7f53dc0d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:36.075 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.066+0000 7f53e0910640 1 -- 172.21.15.189:0/98137692 shutdown_connections 2024-04-25T02:07:36.075 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.066+0000 7f53e0910640 1 -- 172.21.15.189:0/98137692 wait complete. 2024-04-25T02:07:36.075 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.068+0000 7f53e0910640 1 Processor -- start 2024-04-25T02:07:36.075 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.068+0000 7f53e0910640 1 -- start start 2024-04-25T02:07:36.078 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.068+0000 7f53e0910640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53dc06f220 0x7f53dc1f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.078 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.068+0000 7f53e0910640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53dc0b3c90 0x7f53dc1435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.078 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.068+0000 7f53e0910640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53dc147420 0x7f53dc131bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.078 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.068+0000 7f53e0910640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc06de30 con 0x7f53dc147420 2024-04-25T02:07:36.078 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.068+0000 7f53e0910640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc06c920 con 0x7f53dc06f220 2024-04-25T02:07:36.078 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.068+0000 7f53e0910640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f53dc06dfb0 con 0x7f53dc0b3c90 2024-04-25T02:07:36.078 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.068+0000 7f53da59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53dc06f220 0x7f53dc1f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.078 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.068+0000 7f53da59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53dc06f220 0x7f53dc1f31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:56488/0 (socket says 172.21.15.189:56488) 2024-04-25T02:07:36.078 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.068+0000 7f53da59c640 1 -- 172.21.15.189:0/1776148754 learned_addr learned my addr 172.21.15.189:0/1776148754 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-25T02:07:36.078 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.068+0000 7f53d9d9b640 1 --2- 172.21.15.189:0/1776148754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53dc0b3c90 0x7f53dc1435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.078 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.068+0000 7f53dad9d640 1 --2- 172.21.15.189:0/1776148754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53dc147420 0x7f53dc131bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.078 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.069+0000 7f53da59c640 1 -- 172.21.15.189:0/1776148754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53dc0b3c90 msgr2=0x7f53dc1435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.078 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.069+0000 7f53da59c640 1 --2- 172.21.15.189:0/1776148754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53dc0b3c90 0x7f53dc1435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.079 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.069+0000 7f53da59c640 1 -- 172.21.15.189:0/1776148754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53dc147420 msgr2=0x7f53dc131bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.079 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.069+0000 7f53da59c640 1 --2- 172.21.15.189:0/1776148754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53dc147420 0x7f53dc131bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.079 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.069+0000 7f53da59c640 1 -- 172.21.15.189:0/1776148754 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53dc142510 con 0x7f53dc06f220 2024-04-25T02:07:36.079 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.069+0000 7f53da59c640 1 --2- 172.21.15.189:0/1776148754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53dc06f220 0x7f53dc1f31d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c430 tx=0x7f53d400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:36.079 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.069+0000 7f53d2ffd640 1 -- 172.21.15.189:0/1776148754 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4017070 con 0x7f53dc06f220 2024-04-25T02:07:36.079 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.069+0000 7f53d2ffd640 1 -- 172.21.15.189:0/1776148754 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d4005ce0 con 0x7f53dc06f220 2024-04-25T02:07:36.079 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.069+0000 7f53d2ffd640 1 -- 172.21.15.189:0/1776148754 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d40072f0 con 0x7f53dc06f220 2024-04-25T02:07:36.079 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.069+0000 7f53e0910640 1 -- 172.21.15.189:0/1776148754 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53dc1427f0 con 0x7f53dc06f220 2024-04-25T02:07:36.079 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.069+0000 7f53e0910640 1 -- 172.21.15.189:0/1776148754 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53dc142db0 con 0x7f53dc06f220 2024-04-25T02:07:36.079 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.069+0000 7f53d2ffd640 1 -- 172.21.15.189:0/1776148754 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f53d401a070 con 0x7f53dc06f220 2024-04-25T02:07:36.079 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.069+0000 7f53d2ffd640 1 -- 172.21.15.189:0/1776148754 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f53d401c440 con 0x7f53dc06f220 2024-04-25T02:07:36.079 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.070+0000 7f53e0910640 1 -- 172.21.15.189:0/1776148754 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53dc0681e0 con 0x7f53dc06f220 2024-04-25T02:07:36.080 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.072+0000 7f53d2ffd640 1 -- 172.21.15.189:0/1776148754 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f53d4021070 con 0x7f53dc06f220 2024-04-25T02:07:36.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.145+0000 7f53e0910640 1 -- 172.21.15.189:0/1776148754 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9720c83a-6aa9-4956-a0b0-8eb53c39e83e", "id": 2} v 0) -- 0x7f53dc0cff30 con 0x7f53dc06f220 2024-04-25T02:07:36.157 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.151+0000 7f53d2ffd640 1 -- 172.21.15.189:0/1776148754 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9720c83a-6aa9-4956-a0b0-8eb53c39e83e", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f53d401c7f0 con 0x7f53dc06f220 2024-04-25T02:07:36.157 INFO:teuthology.orchestra.run.smithi189.stdout:2 2024-04-25T02:07:36.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.151+0000 7f53e0910640 1 -- 172.21.15.189:0/1776148754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53dc06f220 msgr2=0x7f53dc1f31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.151+0000 7f53e0910640 1 --2- 172.21.15.189:0/1776148754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53dc06f220 0x7f53dc1f31d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c430 tx=0x7f53d400c8f0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.151+0000 7f53e0910640 1 -- 172.21.15.189:0/1776148754 shutdown_connections 2024-04-25T02:07:36.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.151+0000 7f53e0910640 1 --2- 172.21.15.189:0/1776148754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53dc147420 0x7f53dc131bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.151+0000 7f53e0910640 1 --2- 172.21.15.189:0/1776148754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53dc0b3c90 0x7f53dc1435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.151+0000 7f53e0910640 1 --2- 172.21.15.189:0/1776148754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53dc06f220 0x7f53dc1f31d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.152+0000 7f53e0910640 1 -- 172.21.15.189:0/1776148754 >> 172.21.15.189:0/1776148754 conn(0x7f53dc0d0510 msgr2=0x7f53dc0b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:36.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.152+0000 7f53e0910640 1 -- 172.21.15.189:0/1776148754 shutdown_connections 2024-04-25T02:07:36.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.152+0000 7f53e0910640 1 -- 172.21.15.189:0/1776148754 wait complete. 2024-04-25T02:07:36.169 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 97df9030-94b6-4d52-85b8-e6f65d28aa94 3 2024-04-25T02:07:36.266 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.260+0000 7ff4b0e2a640 1 Processor -- start 2024-04-25T02:07:36.267 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.260+0000 7ff4b0e2a640 1 -- start start 2024-04-25T02:07:36.268 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.261+0000 7ff4b0e2a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff4ac15e9d0 0x7ff4ac070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.268 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.261+0000 7ff4b0e2a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4ac0d0c60 0x7ff4ac15fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.268 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.261+0000 7ff4b0e2a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4ac06f250 con 0x7ff4ac15f5e0 2024-04-25T02:07:36.268 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.261+0000 7ff4b0e2a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff4ac06fb80 con 0x7ff4ac15e9d0 2024-04-25T02:07:36.268 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.261+0000 7ff4b0e2a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ac06f530 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.268 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.261+0000 7ff4aad9d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4ac0d0c60 0x7ff4ac15fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.268 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.261+0000 7ff4a9d9b640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7ff4ac15f5e0 0x7ff4ac15edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:44276/0 (socket says 172.21.15.189:44276) 2024-04-25T02:07:36.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.261+0000 7ff4aad9d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4ac0d0c60 0x7ff4ac15fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:50818/0 (socket says 172.21.15.189:50818) 2024-04-25T02:07:36.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.261+0000 7ff4a9d9b640 1 -- 172.21.15.189:0/3681646277 learned_addr learned my addr 172.21.15.189:0/3681646277 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-04-25T02:07:36.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.261+0000 7ff4aa59c640 1 --2- 172.21.15.189:0/3681646277 >> v2:172.21.15.79:3300/0 conn(0x7ff4ac15e9d0 0x7ff4ac070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.261+0000 7ff4aad9d640 1 -- 172.21.15.189:0/3681646277 >> v2:172.21.15.79:3300/0 conn(0x7ff4ac15e9d0 msgr2=0x7ff4ac070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:36.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.261+0000 7ff4a959a640 1 -- 172.21.15.189:0/3681646277 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1724016005 0 0) 0x7ff4ac06f250 con 0x7ff4ac15f5e0 2024-04-25T02:07:36.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.261+0000 7ff4aad9d640 1 --2- 172.21.15.189:0/3681646277 >> v2:172.21.15.79:3300/0 conn(0x7ff4ac15e9d0 0x7ff4ac070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.261+0000 7ff4aad9d640 1 -- 172.21.15.189:0/3681646277 >> v1:172.21.15.189:6789/0 conn(0x7ff4ac15f5e0 legacy=0x7ff4ac15edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.261+0000 7ff4aad9d640 1 -- 172.21.15.189:0/3681646277 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ac06f810 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.262+0000 7ff4aad9d640 1 --2- 172.21.15.189:0/3681646277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4ac0d0c60 0x7ff4ac15fcd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009d90 tx=0x7ff4a402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d95307e34f0d21ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:36.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.262+0000 7ff4a959a640 1 -- 172.21.15.189:0/3681646277 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4007740 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.262+0000 7ff4a959a640 1 -- 172.21.15.189:0/3681646277 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a40078e0 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.262+0000 7ff4a959a640 1 -- 172.21.15.189:0/3681646277 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4007cb0 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.263+0000 7ff4b0e2a640 1 -- 172.21.15.189:0/3681646277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4ac0d0c60 msgr2=0x7ff4ac15fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.263+0000 7ff4b0e2a640 1 --2- 172.21.15.189:0/3681646277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4ac0d0c60 0x7ff4ac15fcd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009d90 tx=0x7ff4a402a660 comp rx=0 tx=0).stop 2024-04-25T02:07:36.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.263+0000 7ff4b0e2a640 1 -- 172.21.15.189:0/3681646277 shutdown_connections 2024-04-25T02:07:36.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.263+0000 7ff4b0e2a640 1 --2- 172.21.15.189:0/3681646277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4ac0d0c60 0x7ff4ac15fcd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.263+0000 7ff4b0e2a640 1 --2- 172.21.15.189:0/3681646277 >> v2:172.21.15.79:3300/0 conn(0x7ff4ac15e9d0 0x7ff4ac070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.263+0000 7ff4b0e2a640 1 -- 172.21.15.189:0/3681646277 >> 172.21.15.189:0/3681646277 conn(0x7ff4ac0d1e80 msgr2=0x7ff4ac0d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:36.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.263+0000 7ff4b0e2a640 1 -- 172.21.15.189:0/3681646277 shutdown_connections 2024-04-25T02:07:36.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.263+0000 7ff4b0e2a640 1 -- 172.21.15.189:0/3681646277 wait complete. 2024-04-25T02:07:36.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.264+0000 7ff4b0e2a640 1 Processor -- start 2024-04-25T02:07:36.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.264+0000 7ff4b0e2a640 1 -- start start 2024-04-25T02:07:36.274 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4b0e2a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4ac0d0c60 0x7ff4ac09dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.274 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4b0e2a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4ac15e9d0 0x7ff4ac09bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.274 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4b0e2a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4ac15f5e0 0x7ff4ac14e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.274 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4b0e2a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac0d1270 con 0x7ff4ac15e9d0 2024-04-25T02:07:36.274 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4b0e2a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac0d10f0 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.274 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4b0e2a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ac160210 con 0x7ff4ac15f5e0 2024-04-25T02:07:36.274 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4aad9d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4ac15f5e0 0x7ff4ac14e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.274 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4aa59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4ac0d0c60 0x7ff4ac09dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.274 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4aad9d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4ac15f5e0 0x7ff4ac14e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:50828/0 (socket says 172.21.15.189:50828) 2024-04-25T02:07:36.274 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4aad9d640 1 -- 172.21.15.189:0/3583099053 learned_addr learned my addr 172.21.15.189:0/3583099053 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-25T02:07:36.274 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4a9d9b640 1 --2- 172.21.15.189:0/3583099053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4ac15e9d0 0x7ff4ac09bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.274 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4aa59c640 1 -- 172.21.15.189:0/3583099053 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4ac15f5e0 msgr2=0x7ff4ac14e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4aa59c640 1 --2- 172.21.15.189:0/3583099053 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4ac15f5e0 0x7ff4ac14e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4aa59c640 1 -- 172.21.15.189:0/3583099053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4ac15e9d0 msgr2=0x7ff4ac09bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4aa59c640 1 --2- 172.21.15.189:0/3583099053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4ac15e9d0 0x7ff4ac09bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4aa59c640 1 -- 172.21.15.189:0/3583099053 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ac14c110 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4aad9d640 1 --2- 172.21.15.189:0/3583099053 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4ac15f5e0 0x7ff4ac14e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:36.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.265+0000 7ff4aa59c640 1 --2- 172.21.15.189:0/3583099053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4ac0d0c60 0x7ff4ac09dbd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00e850 tx=0x7ff49c00ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:36.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.266+0000 7ff49affd640 1 -- 172.21.15.189:0/3583099053 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c017070 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.266+0000 7ff49affd640 1 -- 172.21.15.189:0/3583099053 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49c00c940 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.266+0000 7ff4b0e2a640 1 -- 172.21.15.189:0/3583099053 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ac14c3f0 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.266+0000 7ff49affd640 1 -- 172.21.15.189:0/3583099053 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c00cd10 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.266+0000 7ff4b0e2a640 1 -- 172.21.15.189:0/3583099053 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ac09c480 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.266+0000 7ff49affd640 1 -- 172.21.15.189:0/3583099053 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff49c01a070 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.266+0000 7ff49affd640 1 -- 172.21.15.189:0/3583099053 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7ff49c01c8e0 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.267+0000 7ff4b0e2a640 1 -- 172.21.15.189:0/3583099053 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4ac0681e0 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.269+0000 7ff49affd640 1 -- 172.21.15.189:0/3583099053 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff49c01cbb0 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.341+0000 7ff4b0e2a640 1 -- 172.21.15.189:0/3583099053 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd new", "uuid": "97df9030-94b6-4d52-85b8-e6f65d28aa94", "id": 3} v 0) -- 0x7ff4ac067c90 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.353 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.347+0000 7ff49affd640 1 -- 172.21.15.189:0/3583099053 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "97df9030-94b6-4d52-85b8-e6f65d28aa94", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7ff49c01c450 con 0x7ff4ac0d0c60 2024-04-25T02:07:36.353 INFO:teuthology.orchestra.run.smithi189.stdout:3 2024-04-25T02:07:36.354 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.347+0000 7ff4b0e2a640 1 -- 172.21.15.189:0/3583099053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4ac0d0c60 msgr2=0x7ff4ac09dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.354 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.347+0000 7ff4b0e2a640 1 --2- 172.21.15.189:0/3583099053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4ac0d0c60 0x7ff4ac09dbd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00e850 tx=0x7ff49c00ed10 comp rx=0 tx=0).stop 2024-04-25T02:07:36.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.348+0000 7ff4b0e2a640 1 -- 172.21.15.189:0/3583099053 shutdown_connections 2024-04-25T02:07:36.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.348+0000 7ff4b0e2a640 1 --2- 172.21.15.189:0/3583099053 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4ac15f5e0 0x7ff4ac14e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.348+0000 7ff4b0e2a640 1 --2- 172.21.15.189:0/3583099053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4ac15e9d0 0x7ff4ac09bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.348+0000 7ff4b0e2a640 1 --2- 172.21.15.189:0/3583099053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4ac0d0c60 0x7ff4ac09dbd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.348+0000 7ff4b0e2a640 1 -- 172.21.15.189:0/3583099053 >> 172.21.15.189:0/3583099053 conn(0x7ff4ac0d1e80 msgr2=0x7ff4ac0cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:36.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.348+0000 7ff4b0e2a640 1 -- 172.21.15.189:0/3583099053 shutdown_connections 2024-04-25T02:07:36.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.348+0000 7ff4b0e2a640 1 -- 172.21.15.189:0/3583099053 wait complete. 2024-04-25T02:07:36.365 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 01998311-0652-4821-9bd0-2b71efbf2374 4 2024-04-25T02:07:36.427 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:36.421+0000 7f16d7c12040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T02:07:36.458 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:36.452+0000 7f129952f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T02:07:36.461 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.455+0000 7f5d68763640 1 Processor -- start 2024-04-25T02:07:36.461 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.455+0000 7f5d68763640 1 -- start start 2024-04-25T02:07:36.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.456+0000 7f5d68763640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6006f220 0x7f5d600670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.456+0000 7f5d68763640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5d600b3c90 0x7f5d6006d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.456+0000 7f5d68763640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d6006bac0 con 0x7f5d60147420 2024-04-25T02:07:36.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.456+0000 7f5d68763640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5d6006bda0 con 0x7f5d600b3c90 2024-04-25T02:07:36.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.456+0000 7f5d68763640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5d6006c080 con 0x7f5d6006f220 2024-04-25T02:07:36.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.456+0000 7f5d664ff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6006f220 0x7f5d600670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.456+0000 7f5d65cfe640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f5d60147420 0x7f5d600b3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:44292/0 (socket says 172.21.15.189:44292) 2024-04-25T02:07:36.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.456+0000 7f5d65cfe640 1 -- 172.21.15.189:0/2801078787 learned_addr learned my addr 172.21.15.189:0/2801078787 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-04-25T02:07:36.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.456+0000 7f5d66d00640 1 --2- 172.21.15.189:0/2801078787 >> v2:172.21.15.79:3300/0 conn(0x7f5d600b3c90 0x7f5d6006d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.456+0000 7f5d664ff640 1 -- 172.21.15.189:0/2801078787 >> v2:172.21.15.79:3300/0 conn(0x7f5d600b3c90 msgr2=0x7f5d6006d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:36.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.456+0000 7f5d664ff640 1 --2- 172.21.15.189:0/2801078787 >> v2:172.21.15.79:3300/0 conn(0x7f5d600b3c90 0x7f5d6006d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.456+0000 7f5d664ff640 1 -- 172.21.15.189:0/2801078787 >> v1:172.21.15.189:6789/0 conn(0x7f5d60147420 legacy=0x7f5d600b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.456+0000 7f5d654fd640 1 -- 172.21.15.189:0/2801078787 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3464006795 0 0) 0x7f5d6006bac0 con 0x7f5d60147420 2024-04-25T02:07:36.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.456+0000 7f5d664ff640 1 -- 172.21.15.189:0/2801078787 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6006c360 con 0x7f5d6006f220 2024-04-25T02:07:36.465 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.457+0000 7f5d664ff640 1 --2- 172.21.15.189:0/2801078787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6006f220 0x7f5d600670b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0097a0 tx=0x7f5d5c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab9d33768cc940fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:36.466 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.457+0000 7f5d654fd640 1 -- 172.21.15.189:0/2801078787 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c037070 con 0x7f5d6006f220 2024-04-25T02:07:36.466 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.457+0000 7f5d654fd640 1 -- 172.21.15.189:0/2801078787 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d5c02ae50 con 0x7f5d6006f220 2024-04-25T02:07:36.466 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.457+0000 7f5d654fd640 1 -- 172.21.15.189:0/2801078787 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c032660 con 0x7f5d6006f220 2024-04-25T02:07:36.466 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.458+0000 7f5d68763640 1 -- 172.21.15.189:0/2801078787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6006f220 msgr2=0x7f5d600670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.466 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.458+0000 7f5d68763640 1 --2- 172.21.15.189:0/2801078787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6006f220 0x7f5d600670b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0097a0 tx=0x7f5d5c02a100 comp rx=0 tx=0).stop 2024-04-25T02:07:36.466 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.458+0000 7f5d68763640 1 -- 172.21.15.189:0/2801078787 shutdown_connections 2024-04-25T02:07:36.466 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.458+0000 7f5d68763640 1 --2- 172.21.15.189:0/2801078787 >> v2:172.21.15.79:3300/0 conn(0x7f5d600b3c90 0x7f5d6006d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.466 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.458+0000 7f5d68763640 1 --2- 172.21.15.189:0/2801078787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6006f220 0x7f5d600670b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.466 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.458+0000 7f5d68763640 1 -- 172.21.15.189:0/2801078787 >> 172.21.15.189:0/2801078787 conn(0x7f5d600d0510 msgr2=0x7f5d600d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:36.466 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.458+0000 7f5d68763640 1 -- 172.21.15.189:0/2801078787 shutdown_connections 2024-04-25T02:07:36.466 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.458+0000 7f5d68763640 1 -- 172.21.15.189:0/2801078787 wait complete. 2024-04-25T02:07:36.466 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.459+0000 7f5d68763640 1 Processor -- start 2024-04-25T02:07:36.466 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.459+0000 7f5d68763640 1 -- start start 2024-04-25T02:07:36.469 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d68763640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d6006f220 0x7f5d601441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.469 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d68763640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d600b3c90 0x7f5d6013eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.469 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d68763640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d60147420 0x7f5d600b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.469 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d68763640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6006dc60 con 0x7f5d6006f220 2024-04-25T02:07:36.469 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d68763640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6006c920 con 0x7f5d60147420 2024-04-25T02:07:36.469 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d68763640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5d6006dde0 con 0x7f5d600b3c90 2024-04-25T02:07:36.470 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d66d00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d60147420 0x7f5d600b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.470 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d65cfe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d600b3c90 0x7f5d6013eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.470 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d66d00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d60147420 0x7f5d600b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:56504/0 (socket says 172.21.15.189:56504) 2024-04-25T02:07:36.470 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d66d00640 1 -- 172.21.15.189:0/1790136380 learned_addr learned my addr 172.21.15.189:0/1790136380 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-25T02:07:36.470 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d664ff640 1 --2- 172.21.15.189:0/1790136380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d6006f220 0x7f5d601441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.470 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d66d00640 1 -- 172.21.15.189:0/1790136380 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d600b3c90 msgr2=0x7f5d6013eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.470 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d66d00640 1 --2- 172.21.15.189:0/1790136380 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d600b3c90 0x7f5d6013eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.470 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d66d00640 1 -- 172.21.15.189:0/1790136380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d6006f220 msgr2=0x7f5d601441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.470 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d66d00640 1 --2- 172.21.15.189:0/1790136380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d6006f220 0x7f5d601441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.470 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d66d00640 1 -- 172.21.15.189:0/1790136380 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d60143140 con 0x7f5d60147420 2024-04-25T02:07:36.470 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d65cfe640 1 --2- 172.21.15.189:0/1790136380 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d600b3c90 0x7f5d6013eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:36.470 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.460+0000 7f5d66d00640 1 --2- 172.21.15.189:0/1790136380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d60147420 0x7f5d600b0cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800efc0 tx=0x7f5d5800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:36.470 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.461+0000 7f5d56ffd640 1 -- 172.21.15.189:0/1790136380 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d58018020 con 0x7f5d60147420 2024-04-25T02:07:36.471 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.461+0000 7f5d56ffd640 1 -- 172.21.15.189:0/1790136380 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d58014480 con 0x7f5d60147420 2024-04-25T02:07:36.471 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.461+0000 7f5d68763640 1 -- 172.21.15.189:0/1790136380 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d60143420 con 0x7f5d60147420 2024-04-25T02:07:36.471 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.461+0000 7f5d56ffd640 1 -- 172.21.15.189:0/1790136380 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d58014870 con 0x7f5d60147420 2024-04-25T02:07:36.471 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.461+0000 7f5d68763640 1 -- 172.21.15.189:0/1790136380 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d601439e0 con 0x7f5d60147420 2024-04-25T02:07:36.471 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.461+0000 7f5d56ffd640 1 -- 172.21.15.189:0/1790136380 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5d58005d10 con 0x7f5d60147420 2024-04-25T02:07:36.471 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.461+0000 7f5d56ffd640 1 -- 172.21.15.189:0/1790136380 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f5d580138f0 con 0x7f5d60147420 2024-04-25T02:07:36.471 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.462+0000 7f5d68763640 1 -- 172.21.15.189:0/1790136380 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d600681e0 con 0x7f5d60147420 2024-04-25T02:07:36.472 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.464+0000 7f5d56ffd640 1 -- 172.21.15.189:0/1790136380 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5d58022070 con 0x7f5d60147420 2024-04-25T02:07:36.515 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:36.509+0000 7f16d7c12040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T02:07:36.543 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.536+0000 7f5d68763640 1 -- 172.21.15.189:0/1790136380 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd new", "uuid": "01998311-0652-4821-9bd0-2b71efbf2374", "id": 4} v 0) -- 0x7f5d600cfa50 con 0x7f5d60147420 2024-04-25T02:07:36.548 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.542+0000 7f5d56ffd640 1 -- 172.21.15.189:0/1790136380 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01998311-0652-4821-9bd0-2b71efbf2374", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f5d58010040 con 0x7f5d60147420 2024-04-25T02:07:36.548 INFO:teuthology.orchestra.run.smithi189.stdout:4 2024-04-25T02:07:36.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.543+0000 7f5d68763640 1 -- 172.21.15.189:0/1790136380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d60147420 msgr2=0x7f5d600b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.543+0000 7f5d68763640 1 --2- 172.21.15.189:0/1790136380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d60147420 0x7f5d600b0cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800efc0 tx=0x7f5d5800c490 comp rx=0 tx=0).stop 2024-04-25T02:07:36.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.543+0000 7f5d68763640 1 -- 172.21.15.189:0/1790136380 shutdown_connections 2024-04-25T02:07:36.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.543+0000 7f5d68763640 1 --2- 172.21.15.189:0/1790136380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d60147420 0x7f5d600b0cc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.543+0000 7f5d68763640 1 --2- 172.21.15.189:0/1790136380 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d600b3c90 0x7f5d6013eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.543+0000 7f5d68763640 1 --2- 172.21.15.189:0/1790136380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d6006f220 0x7f5d601441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.543+0000 7f5d68763640 1 -- 172.21.15.189:0/1790136380 >> 172.21.15.189:0/1790136380 conn(0x7f5d600d0510 msgr2=0x7f5d600d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:36.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.543+0000 7f5d68763640 1 -- 172.21.15.189:0/1790136380 shutdown_connections 2024-04-25T02:07:36.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.543+0000 7f5d68763640 1 -- 172.21.15.189:0/1790136380 wait complete. 2024-04-25T02:07:36.551 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:36.544+0000 7f129952f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T02:07:36.558 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:36.552+0000 7f16d7c12040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T02:07:36.560 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 753b1def-8b53-410f-aa76-247b4e9af214 5 2024-04-25T02:07:36.596 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:36.589+0000 7f129952f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T02:07:36.657 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.651+0000 7f2cb10cd640 1 Processor -- start 2024-04-25T02:07:36.658 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.651+0000 7f2cb10cd640 1 -- start start 2024-04-25T02:07:36.659 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.652+0000 7f2cb10cd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2cac0d0760 0x7f2cac06f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.659 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.652+0000 7f2cb10cd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cac0cfab0 0x7f2cac0b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.659 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.652+0000 7f2cb10cd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cac15c6d0 con 0x7f2cac15c2f0 2024-04-25T02:07:36.659 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.652+0000 7f2cb10cd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2cac0b12e0 con 0x7f2cac0d0760 2024-04-25T02:07:36.659 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.652+0000 7f2cb10cd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2cac0ccc20 con 0x7f2cac0cfab0 2024-04-25T02:07:36.659 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.652+0000 7f2cab59e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cac0cfab0 0x7f2cac0b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.659 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.652+0000 7f2cab59e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cac0cfab0 0x7f2cac0b44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:50842/0 (socket says 172.21.15.189:50842) 2024-04-25T02:07:36.659 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.652+0000 7f2cab59e640 1 -- 172.21.15.189:0/3553657974 learned_addr learned my addr 172.21.15.189:0/3553657974 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-25T02:07:36.659 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.652+0000 7f2caa59c640 1 --2- 172.21.15.189:0/3553657974 >> v2:172.21.15.79:3300/0 conn(0x7f2cac0d0760 0x7f2cac06f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.659 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.652+0000 7f2cab59e640 1 -- 172.21.15.189:0/3553657974 >> v2:172.21.15.79:3300/0 conn(0x7f2cac0d0760 msgr2=0x7f2cac06f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:36.660 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.652+0000 7f2cab59e640 1 --2- 172.21.15.189:0/3553657974 >> v2:172.21.15.79:3300/0 conn(0x7f2cac0d0760 0x7f2cac06f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.660 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.652+0000 7f2cab59e640 1 -- 172.21.15.189:0/3553657974 >> v1:172.21.15.79:6789/0 conn(0x7f2cac15c2f0 legacy=0x7f2cac0d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.660 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.652+0000 7f2cab59e640 1 -- 172.21.15.189:0/3553657974 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cac0b1530 con 0x7f2cac0cfab0 2024-04-25T02:07:36.661 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.653+0000 7f2cab59e640 1 --2- 172.21.15.189:0/3553657974 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cac0cfab0 0x7f2cac0b44f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009e50 tx=0x7f2ca402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=526f0ea1a8983a56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:36.661 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.653+0000 7f2ca9d9b640 1 -- 172.21.15.189:0/3553657974 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4036070 con 0x7f2cac0cfab0 2024-04-25T02:07:36.661 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.653+0000 7f2ca9d9b640 1 -- 172.21.15.189:0/3553657974 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca4031600 con 0x7f2cac0cfab0 2024-04-25T02:07:36.661 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.653+0000 7f2ca9d9b640 1 -- 172.21.15.189:0/3553657974 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca40319d0 con 0x7f2cac0cfab0 2024-04-25T02:07:36.661 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.653+0000 7f2cb10cd640 1 -- 172.21.15.189:0/3553657974 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cac0cfab0 msgr2=0x7f2cac0b44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.661 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.653+0000 7f2cb10cd640 1 --2- 172.21.15.189:0/3553657974 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cac0cfab0 0x7f2cac0b44f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009e50 tx=0x7f2ca402a710 comp rx=0 tx=0).stop 2024-04-25T02:07:36.661 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.653+0000 7f2cb10cd640 1 -- 172.21.15.189:0/3553657974 shutdown_connections 2024-04-25T02:07:36.662 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.653+0000 7f2cb10cd640 1 --2- 172.21.15.189:0/3553657974 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cac0cfab0 0x7f2cac0b44f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.662 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.653+0000 7f2cb10cd640 1 --2- 172.21.15.189:0/3553657974 >> v2:172.21.15.79:3300/0 conn(0x7f2cac0d0760 0x7f2cac06f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.662 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.653+0000 7f2cb10cd640 1 -- 172.21.15.189:0/3553657974 >> 172.21.15.189:0/3553657974 conn(0x7f2cac0b39d0 msgr2=0x7f2cac0b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:36.662 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.653+0000 7f2cb10cd640 1 -- 172.21.15.189:0/3553657974 shutdown_connections 2024-04-25T02:07:36.662 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.653+0000 7f2cb10cd640 1 -- 172.21.15.189:0/3553657974 wait complete. 2024-04-25T02:07:36.664 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.655+0000 7f2cb10cd640 1 Processor -- start 2024-04-25T02:07:36.664 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.655+0000 7f2cb10cd640 1 -- start start 2024-04-25T02:07:36.664 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2cb10cd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cac0cfab0 0x7f2cac0cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2cb10cd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cac0d0760 0x7f2cac0c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2cb10cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cac15c2f0 0x7f2cac1f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2cb10cd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac0cd0b0 con 0x7f2cac15c2f0 2024-04-25T02:07:36.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2cb10cd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac09b900 con 0x7f2cac0cfab0 2024-04-25T02:07:36.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2cb10cd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2cac0cd230 con 0x7f2cac0d0760 2024-04-25T02:07:36.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2caa59c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cac0d0760 0x7f2cac0c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2caad9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cac0cfab0 0x7f2cac0cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2caa59c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cac0d0760 0x7f2cac0c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:50852/0 (socket says 172.21.15.189:50852) 2024-04-25T02:07:36.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2caa59c640 1 -- 172.21.15.189:0/1407174448 learned_addr learned my addr 172.21.15.189:0/1407174448 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-25T02:07:36.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2cab59e640 1 --2- 172.21.15.189:0/1407174448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cac15c2f0 0x7f2cac1f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2caad9d640 1 -- 172.21.15.189:0/1407174448 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cac0d0760 msgr2=0x7f2cac0c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2caad9d640 1 --2- 172.21.15.189:0/1407174448 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cac0d0760 0x7f2cac0c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2caad9d640 1 -- 172.21.15.189:0/1407174448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cac15c2f0 msgr2=0x7f2cac1f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2caad9d640 1 --2- 172.21.15.189:0/1407174448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cac15c2f0 0x7f2cac1f4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2caad9d640 1 -- 172.21.15.189:0/1407174448 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cac0c4ac0 con 0x7f2cac0cfab0 2024-04-25T02:07:36.666 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2caa59c640 1 --2- 172.21.15.189:0/1407174448 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cac0d0760 0x7f2cac0c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:36.666 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.656+0000 7f2caad9d640 1 --2- 172.21.15.189:0/1407174448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cac0cfab0 0x7f2cac0cb590 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00c3c0 tx=0x7f2c9c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:36.666 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.657+0000 7f2ca37fe640 1 -- 172.21.15.189:0/1407174448 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c0052d0 con 0x7f2cac0cfab0 2024-04-25T02:07:36.666 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.657+0000 7f2ca37fe640 1 -- 172.21.15.189:0/1407174448 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c9c005490 con 0x7f2cac0cfab0 2024-04-25T02:07:36.666 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.657+0000 7f2cb10cd640 1 -- 172.21.15.189:0/1407174448 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cac0c84c0 con 0x7f2cac0cfab0 2024-04-25T02:07:36.666 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.657+0000 7f2ca37fe640 1 -- 172.21.15.189:0/1407174448 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c007260 con 0x7f2cac0cfab0 2024-04-25T02:07:36.666 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.657+0000 7f2cb10cd640 1 -- 172.21.15.189:0/1407174448 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cac0caab0 con 0x7f2cac0cfab0 2024-04-25T02:07:36.666 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.657+0000 7f2ca37fe640 1 -- 172.21.15.189:0/1407174448 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2c9c007400 con 0x7f2cac0cfab0 2024-04-25T02:07:36.666 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.657+0000 7f2ca37fe640 1 -- 172.21.15.189:0/1407174448 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f2c9c003ae0 con 0x7f2cac0cfab0 2024-04-25T02:07:36.666 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.658+0000 7f2cb10cd640 1 -- 172.21.15.189:0/1407174448 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cac0681e0 con 0x7f2cac0cfab0 2024-04-25T02:07:36.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.661+0000 7f2ca37fe640 1 -- 172.21.15.189:0/1407174448 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f2c9c003d30 con 0x7f2cac0cfab0 2024-04-25T02:07:36.722 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:36.715+0000 7f16d7c12040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T02:07:36.741 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.734+0000 7f2cb10cd640 1 -- 172.21.15.189:0/1407174448 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd new", "uuid": "753b1def-8b53-410f-aa76-247b4e9af214", "id": 5} v 0) -- 0x7f2cac0c5360 con 0x7f2cac0cfab0 2024-04-25T02:07:36.744 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.738+0000 7f2ca37fe640 1 -- 172.21.15.189:0/1407174448 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "753b1def-8b53-410f-aa76-247b4e9af214", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f2c9c0035f0 con 0x7f2cac0cfab0 2024-04-25T02:07:36.745 INFO:teuthology.orchestra.run.smithi189.stdout:5 2024-04-25T02:07:36.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.739+0000 7f2cb10cd640 1 -- 172.21.15.189:0/1407174448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cac0cfab0 msgr2=0x7f2cac0cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.739+0000 7f2cb10cd640 1 --2- 172.21.15.189:0/1407174448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cac0cfab0 0x7f2cac0cb590 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00c3c0 tx=0x7f2c9c00c880 comp rx=0 tx=0).stop 2024-04-25T02:07:36.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.739+0000 7f2cb10cd640 1 -- 172.21.15.189:0/1407174448 shutdown_connections 2024-04-25T02:07:36.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.739+0000 7f2cb10cd640 1 --2- 172.21.15.189:0/1407174448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cac15c2f0 0x7f2cac1f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.739+0000 7f2cb10cd640 1 --2- 172.21.15.189:0/1407174448 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cac0d0760 0x7f2cac0c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.739+0000 7f2cb10cd640 1 --2- 172.21.15.189:0/1407174448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cac0cfab0 0x7f2cac0cb590 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.739+0000 7f2cb10cd640 1 -- 172.21.15.189:0/1407174448 >> 172.21.15.189:0/1407174448 conn(0x7f2cac0b39d0 msgr2=0x7f2cac09aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:36.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.739+0000 7f2cb10cd640 1 -- 172.21.15.189:0/1407174448 shutdown_connections 2024-04-25T02:07:36.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.739+0000 7f2cb10cd640 1 -- 172.21.15.189:0/1407174448 wait complete. 2024-04-25T02:07:36.756 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 7df7d139-c9b1-482d-a2d1-2ef0a2cb098d 6 2024-04-25T02:07:36.772 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:36.765+0000 7f129952f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T02:07:36.779 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:36.772+0000 7f16d7c12040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T02:07:36.830 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:36.823+0000 7f129952f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T02:07:36.831 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:36.824+0000 7f16d7c12040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T02:07:36.870 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.863+0000 7f6bc5a1c640 1 Processor -- start 2024-04-25T02:07:36.870 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.864+0000 7f6bc5a1c640 1 -- start start 2024-04-25T02:07:36.872 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.864+0000 7f6bc5a1c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6bc00ceb40 0x7f6bc0071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.872 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.864+0000 7f6bc5a1c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6bc0071690 0x7f6bc00cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.872 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.864+0000 7f6bc5a1c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc00cf040 con 0x7f6bc015e230 2024-04-25T02:07:36.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.864+0000 7f6bc5a1c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6bc00ca6c0 con 0x7f6bc00ceb40 2024-04-25T02:07:36.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.864+0000 7f6bc5a1c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6bc00ca9a0 con 0x7f6bc0071690 2024-04-25T02:07:36.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.865+0000 7f6bbf7fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6bc0071690 0x7f6bc00cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.865+0000 7f6bbf7fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6bc0071690 0x7f6bc00cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:56510/0 (socket says 172.21.15.189:56510) 2024-04-25T02:07:36.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.865+0000 7f6bbf7fe640 1 -- 172.21.15.189:0/621799543 learned_addr learned my addr 172.21.15.189:0/621799543 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-25T02:07:36.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.865+0000 7f6bbe7fc640 1 --2- 172.21.15.189:0/621799543 >> v2:172.21.15.79:3300/0 conn(0x7f6bc00ceb40 0x7f6bc0071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.865+0000 7f6bbf7fe640 1 -- 172.21.15.189:0/621799543 >> v2:172.21.15.79:3300/0 conn(0x7f6bc00ceb40 msgr2=0x7f6bc0071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:36.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.865+0000 7f6bbf7fe640 1 --2- 172.21.15.189:0/621799543 >> v2:172.21.15.79:3300/0 conn(0x7f6bc00ceb40 0x7f6bc0071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.865+0000 7f6bbf7fe640 1 -- 172.21.15.189:0/621799543 >> v1:172.21.15.79:6789/0 conn(0x7f6bc015e230 legacy=0x7f6bc006f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.865+0000 7f6bbf7fe640 1 -- 172.21.15.189:0/621799543 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc00cf320 con 0x7f6bc0071690 2024-04-25T02:07:36.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.865+0000 7f6bbf7fe640 1 --2- 172.21.15.189:0/621799543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc0071690 0x7f6bc00cae30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6bc009dda0 tx=0x7f6bb802a7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ce9707fd00e717f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:36.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.866+0000 7f6bbdffb640 1 -- 172.21.15.189:0/621799543 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8036070 con 0x7f6bc0071690 2024-04-25T02:07:36.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.866+0000 7f6bbdffb640 1 -- 172.21.15.189:0/621799543 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb8031600 con 0x7f6bc0071690 2024-04-25T02:07:36.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.866+0000 7f6bbdffb640 1 -- 172.21.15.189:0/621799543 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80319f0 con 0x7f6bc0071690 2024-04-25T02:07:36.877 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.866+0000 7f6bc5a1c640 1 -- 172.21.15.189:0/621799543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc0071690 msgr2=0x7f6bc00cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.878 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.866+0000 7f6bc5a1c640 1 --2- 172.21.15.189:0/621799543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc0071690 0x7f6bc00cae30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6bc009dda0 tx=0x7f6bb802a7c0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.878 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.866+0000 7f6bc5a1c640 1 -- 172.21.15.189:0/621799543 shutdown_connections 2024-04-25T02:07:36.878 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.866+0000 7f6bc5a1c640 1 --2- 172.21.15.189:0/621799543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc0071690 0x7f6bc00cae30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.878 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.866+0000 7f6bc5a1c640 1 --2- 172.21.15.189:0/621799543 >> v2:172.21.15.79:3300/0 conn(0x7f6bc00ceb40 0x7f6bc0071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.878 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.866+0000 7f6bc5a1c640 1 -- 172.21.15.189:0/621799543 >> 172.21.15.189:0/621799543 conn(0x7f6bc00d0070 msgr2=0x7f6bc00d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:36.878 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.866+0000 7f6bc5a1c640 1 -- 172.21.15.189:0/621799543 shutdown_connections 2024-04-25T02:07:36.878 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.866+0000 7f6bc5a1c640 1 -- 172.21.15.189:0/621799543 wait complete. 2024-04-25T02:07:36.878 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.868+0000 7f6bc5a1c640 1 Processor -- start 2024-04-25T02:07:36.878 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.868+0000 7f6bc5a1c640 1 -- start start 2024-04-25T02:07:36.878 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.868+0000 7f6bc5a1c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc0071690 0x7f6bc009bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.878 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.868+0000 7f6bc5a1c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bc00ceb40 0x7f6bc0160110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.878 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.868+0000 7f6bc5a1c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc015e230 0x7f6bc015e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.868+0000 7f6bc5a1c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc015e610 con 0x7f6bc00ceb40 2024-04-25T02:07:36.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.868+0000 7f6bc5a1c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc0071ac0 con 0x7f6bc015e230 2024-04-25T02:07:36.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.868+0000 7f6bc5a1c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc015e790 con 0x7f6bc0071690 2024-04-25T02:07:36.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6bbf7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc015e230 0x7f6bc015e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6bbf7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc015e230 0x7f6bc015e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:56520/0 (socket says 172.21.15.189:56520) 2024-04-25T02:07:36.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6bbf7fe640 1 -- 172.21.15.189:0/2638809697 learned_addr learned my addr 172.21.15.189:0/2638809697 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-25T02:07:36.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6bbeffd640 1 --2- 172.21.15.189:0/2638809697 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc0071690 0x7f6bc009bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6bbe7fc640 1 --2- 172.21.15.189:0/2638809697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bc00ceb40 0x7f6bc0160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6bbf7fe640 1 -- 172.21.15.189:0/2638809697 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc0071690 msgr2=0x7f6bc009bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6bbf7fe640 1 --2- 172.21.15.189:0/2638809697 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc0071690 0x7f6bc009bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6bbf7fe640 1 -- 172.21.15.189:0/2638809697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bc00ceb40 msgr2=0x7f6bc0160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6bbf7fe640 1 --2- 172.21.15.189:0/2638809697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bc00ceb40 0x7f6bc0160110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6bbf7fe640 1 -- 172.21.15.189:0/2638809697 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc015f070 con 0x7f6bc015e230 2024-04-25T02:07:36.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6bbf7fe640 1 --2- 172.21.15.189:0/2638809697 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc015e230 0x7f6bc015e970 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6bb802a800 tx=0x7f6bb8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:36.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6ba7fff640 1 -- 172.21.15.189:0/2638809697 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8036050 con 0x7f6bc015e230 2024-04-25T02:07:36.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6ba7fff640 1 -- 172.21.15.189:0/2638809697 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb8042070 con 0x7f6bc015e230 2024-04-25T02:07:36.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6bc5a1c640 1 -- 172.21.15.189:0/2638809697 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc015f350 con 0x7f6bc015e230 2024-04-25T02:07:36.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6ba7fff640 1 -- 172.21.15.189:0/2638809697 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8009510 con 0x7f6bc015e230 2024-04-25T02:07:36.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6bc5a1c640 1 -- 172.21.15.189:0/2638809697 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc015f910 con 0x7f6bc015e230 2024-04-25T02:07:36.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6ba7fff640 1 -- 172.21.15.189:0/2638809697 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6bb8004450 con 0x7f6bc015e230 2024-04-25T02:07:36.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.869+0000 7f6ba7fff640 1 -- 172.21.15.189:0/2638809697 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f6bb803d450 con 0x7f6bc015e230 2024-04-25T02:07:36.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.870+0000 7f6bc5a1c640 1 -- 172.21.15.189:0/2638809697 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc00690a0 con 0x7f6bc015e230 2024-04-25T02:07:36.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.872+0000 7f6ba7fff640 1 -- 172.21.15.189:0/2638809697 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6bb8047460 con 0x7f6bc015e230 2024-04-25T02:07:36.887 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:36.880+0000 7f129952f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T02:07:36.942 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:36.935+0000 7f16d7c12040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:07:36.951 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.944+0000 7f6bc5a1c640 1 -- 172.21.15.189:0/2638809697 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7df7d139-c9b1-482d-a2d1-2ef0a2cb098d", "id": 6} v 0) -- 0x7f6bc00ce7a0 con 0x7f6bc015e230 2024-04-25T02:07:36.956 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.950+0000 7f6ba7fff640 1 -- 172.21.15.189:0/2638809697 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7df7d139-c9b1-482d-a2d1-2ef0a2cb098d", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f6bb8047960 con 0x7f6bc015e230 2024-04-25T02:07:36.957 INFO:teuthology.orchestra.run.smithi189.stdout:6 2024-04-25T02:07:36.957 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.951+0000 7f6bc5a1c640 1 -- 172.21.15.189:0/2638809697 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc015e230 msgr2=0x7f6bc015e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.951+0000 7f6bc5a1c640 1 --2- 172.21.15.189:0/2638809697 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc015e230 0x7f6bc015e970 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6bb802a800 tx=0x7f6bb8004a40 comp rx=0 tx=0).stop 2024-04-25T02:07:36.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.951+0000 7f6bc5a1c640 1 -- 172.21.15.189:0/2638809697 shutdown_connections 2024-04-25T02:07:36.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.951+0000 7f6bc5a1c640 1 --2- 172.21.15.189:0/2638809697 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc015e230 0x7f6bc015e970 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.951+0000 7f6bc5a1c640 1 --2- 172.21.15.189:0/2638809697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bc00ceb40 0x7f6bc0160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.951+0000 7f6bc5a1c640 1 --2- 172.21.15.189:0/2638809697 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc0071690 0x7f6bc009bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.951+0000 7f6bc5a1c640 1 -- 172.21.15.189:0/2638809697 >> 172.21.15.189:0/2638809697 conn(0x7f6bc00d0070 msgr2=0x7f6bc00b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:36.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.951+0000 7f6bc5a1c640 1 -- 172.21.15.189:0/2638809697 shutdown_connections 2024-04-25T02:07:36.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:36.951+0000 7f6bc5a1c640 1 -- 172.21.15.189:0/2638809697 wait complete. 2024-04-25T02:07:36.968 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 42a478b7-1359-452f-970a-77a15f006b84 7 2024-04-25T02:07:37.005 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:36.998+0000 7f129952f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:07:37.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.058+0000 7fe115d34640 1 Processor -- start 2024-04-25T02:07:37.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.058+0000 7fe115d34640 1 -- start start 2024-04-25T02:07:37.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.059+0000 7fe115d34640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe11015e2a0 0x7fe1100d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:37.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.059+0000 7fe115d34640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe11006b0b0 0x7fe11006b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:37.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.059+0000 7fe115d34640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1100affd0 con 0x7fe1100b0430 2024-04-25T02:07:37.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.059+0000 7fe115d34640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe11006ba40 con 0x7fe11006b0b0 2024-04-25T02:07:37.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.059+0000 7fe115d34640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe110072030 con 0x7fe11015e2a0 2024-04-25T02:07:37.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.059+0000 7fe10f7fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe11015e2a0 0x7fe1100d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:37.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.059+0000 7fe10f7fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe11015e2a0 0x7fe1100d1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:56534/0 (socket says 172.21.15.189:56534) 2024-04-25T02:07:37.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.059+0000 7fe10f7fe640 1 -- 172.21.15.189:0/2440819337 learned_addr learned my addr 172.21.15.189:0/2440819337 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-25T02:07:37.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.059+0000 7fe10ffff640 1 --2- 172.21.15.189:0/2440819337 >> v2:172.21.15.79:3300/0 conn(0x7fe11006b0b0 0x7fe11006b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:37.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.060+0000 7fe10f7fe640 1 -- 172.21.15.189:0/2440819337 >> v2:172.21.15.79:3300/0 conn(0x7fe11006b0b0 msgr2=0x7fe11006b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:37.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.060+0000 7fe10f7fe640 1 --2- 172.21.15.189:0/2440819337 >> v2:172.21.15.79:3300/0 conn(0x7fe11006b0b0 0x7fe11006b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.060+0000 7fe10f7fe640 1 -- 172.21.15.189:0/2440819337 >> v1:172.21.15.79:6789/0 conn(0x7fe1100b0430 legacy=0x7fe11006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:37.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.060+0000 7fe10f7fe640 1 -- 172.21.15.189:0/2440819337 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11015e680 con 0x7fe11015e2a0 2024-04-25T02:07:37.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.060+0000 7fe10f7fe640 1 --2- 172.21.15.189:0/2440819337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11015e2a0 0x7fe1100d1a30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe1100b7150 tx=0x7fe10402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b5f6a6d5d0c8289 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:37.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.061+0000 7fe10e7fc640 1 -- 172.21.15.189:0/2440819337 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104037070 con 0x7fe11015e2a0 2024-04-25T02:07:37.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.061+0000 7fe10e7fc640 1 -- 172.21.15.189:0/2440819337 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe104032440 con 0x7fe11015e2a0 2024-04-25T02:07:37.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.061+0000 7fe10e7fc640 1 -- 172.21.15.189:0/2440819337 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104032810 con 0x7fe11015e2a0 2024-04-25T02:07:37.071 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.061+0000 7fe115d34640 1 -- 172.21.15.189:0/2440819337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11015e2a0 msgr2=0x7fe1100d1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:37.071 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.061+0000 7fe115d34640 1 --2- 172.21.15.189:0/2440819337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11015e2a0 0x7fe1100d1a30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe1100b7150 tx=0x7fe10402a270 comp rx=0 tx=0).stop 2024-04-25T02:07:37.071 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.061+0000 7fe115d34640 1 -- 172.21.15.189:0/2440819337 shutdown_connections 2024-04-25T02:07:37.071 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.061+0000 7fe115d34640 1 --2- 172.21.15.189:0/2440819337 >> v2:172.21.15.79:3300/0 conn(0x7fe11006b0b0 0x7fe11006b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.071 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.061+0000 7fe115d34640 1 --2- 172.21.15.189:0/2440819337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11015e2a0 0x7fe1100d1a30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.071 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.061+0000 7fe115d34640 1 -- 172.21.15.189:0/2440819337 >> 172.21.15.189:0/2440819337 conn(0x7fe1100d0f40 msgr2=0x7fe1100d1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:37.071 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.061+0000 7fe115d34640 1 -- 172.21.15.189:0/2440819337 shutdown_connections 2024-04-25T02:07:37.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.061+0000 7fe115d34640 1 -- 172.21.15.189:0/2440819337 wait complete. 2024-04-25T02:07:37.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.062+0000 7fe115d34640 1 Processor -- start 2024-04-25T02:07:37.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.063+0000 7fe115d34640 1 -- start start 2024-04-25T02:07:37.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.063+0000 7fe115d34640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe11006b0b0 0x7fe1101529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:37.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.063+0000 7fe115d34640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1100b0430 0x7fe1100cf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:37.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.063+0000 7fe115d34640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11015e2a0 0x7fe1100aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:37.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.063+0000 7fe115d34640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe11006fbe0 con 0x7fe1100b0430 2024-04-25T02:07:37.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.063+0000 7fe115d34640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe1100725f0 con 0x7fe11015e2a0 2024-04-25T02:07:37.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.063+0000 7fe115d34640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe110162b00 con 0x7fe11006b0b0 2024-04-25T02:07:37.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.063+0000 7fe10f7fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe11006b0b0 0x7fe1101529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:37.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.064+0000 7fe10ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11015e2a0 0x7fe1100aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:37.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.064+0000 7fe10f7fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe11006b0b0 0x7fe1101529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:50874/0 (socket says 172.21.15.189:50874) 2024-04-25T02:07:37.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.064+0000 7fe10f7fe640 1 -- 172.21.15.189:0/4290026295 learned_addr learned my addr 172.21.15.189:0/4290026295 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-25T02:07:37.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.064+0000 7fe10effd640 1 --2- 172.21.15.189:0/4290026295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1100b0430 0x7fe1100cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:37.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.064+0000 7fe10f7fe640 1 -- 172.21.15.189:0/4290026295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11015e2a0 msgr2=0x7fe1100aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:37.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.064+0000 7fe10f7fe640 1 --2- 172.21.15.189:0/4290026295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11015e2a0 0x7fe1100aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.064+0000 7fe10f7fe640 1 -- 172.21.15.189:0/4290026295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1100b0430 msgr2=0x7fe1100cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:37.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.064+0000 7fe10f7fe640 1 --2- 172.21.15.189:0/4290026295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1100b0430 0x7fe1100cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.064+0000 7fe10f7fe640 1 -- 172.21.15.189:0/4290026295 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe110152f10 con 0x7fe11006b0b0 2024-04-25T02:07:37.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.064+0000 7fe10ffff640 1 --2- 172.21.15.189:0/4290026295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11015e2a0 0x7fe1100aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:37.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.064+0000 7fe10f7fe640 1 --2- 172.21.15.189:0/4290026295 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe11006b0b0 0x7fe1101529d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe10402a2b0 tx=0x7fe1040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:37.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.066+0000 7fe0f7fff640 1 -- 172.21.15.189:0/4290026295 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104037040 con 0x7fe11006b0b0 2024-04-25T02:07:37.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.066+0000 7fe0f7fff640 1 -- 172.21.15.189:0/4290026295 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe104042070 con 0x7fe11006b0b0 2024-04-25T02:07:37.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.066+0000 7fe115d34640 1 -- 172.21.15.189:0/4290026295 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1100cfc30 con 0x7fe11006b0b0 2024-04-25T02:07:37.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.066+0000 7fe0f7fff640 1 -- 172.21.15.189:0/4290026295 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104030880 con 0x7fe11006b0b0 2024-04-25T02:07:37.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.066+0000 7fe115d34640 1 -- 172.21.15.189:0/4290026295 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1100d01f0 con 0x7fe11006b0b0 2024-04-25T02:07:37.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.066+0000 7fe0f7fff640 1 -- 172.21.15.189:0/4290026295 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe104030a20 con 0x7fe11006b0b0 2024-04-25T02:07:37.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.066+0000 7fe0f7fff640 1 -- 172.21.15.189:0/4290026295 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fe104047b40 con 0x7fe11006b0b0 2024-04-25T02:07:37.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.067+0000 7fe115d34640 1 -- 172.21.15.189:0/4290026295 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1100d08b0 con 0x7fe11006b0b0 2024-04-25T02:07:37.075 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.069+0000 7fe0f7fff640 1 -- 172.21.15.189:0/4290026295 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe1100d08b0 con 0x7fe11006b0b0 2024-04-25T02:07:37.148 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.141+0000 7fe115d34640 1 -- 172.21.15.189:0/4290026295 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd new", "uuid": "42a478b7-1359-452f-970a-77a15f006b84", "id": 7} v 0) -- 0x7fe1100681e0 con 0x7fe11006b0b0 2024-04-25T02:07:37.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.147+0000 7fe0f7fff640 1 -- 172.21.15.189:0/4290026295 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42a478b7-1359-452f-970a-77a15f006b84", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fe104047460 con 0x7fe11006b0b0 2024-04-25T02:07:37.153 INFO:teuthology.orchestra.run.smithi189.stdout:7 2024-04-25T02:07:37.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.148+0000 7fe115d34640 1 -- 172.21.15.189:0/4290026295 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe11006b0b0 msgr2=0x7fe1101529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:37.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.148+0000 7fe115d34640 1 --2- 172.21.15.189:0/4290026295 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe11006b0b0 0x7fe1101529d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe10402a2b0 tx=0x7fe1040046c0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.148+0000 7fe115d34640 1 -- 172.21.15.189:0/4290026295 shutdown_connections 2024-04-25T02:07:37.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.148+0000 7fe115d34640 1 --2- 172.21.15.189:0/4290026295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11015e2a0 0x7fe1100aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.148+0000 7fe115d34640 1 --2- 172.21.15.189:0/4290026295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1100b0430 0x7fe1100cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.148+0000 7fe115d34640 1 --2- 172.21.15.189:0/4290026295 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe11006b0b0 0x7fe1101529d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.148+0000 7fe115d34640 1 -- 172.21.15.189:0/4290026295 >> 172.21.15.189:0/4290026295 conn(0x7fe1100d0f40 msgr2=0x7fe1100b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:37.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.148+0000 7fe115d34640 1 -- 172.21.15.189:0/4290026295 shutdown_connections 2024-04-25T02:07:37.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:07:37.148+0000 7fe115d34640 1 -- 172.21.15.189:0/4290026295 wait complete. 2024-04-25T02:07:37.165 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T02:07:37.165 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T02:07:37.167 INFO:tasks.ceph.osd.0:Started 2024-04-25T02:07:37.167 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T02:07:37.168 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T02:07:37.170 INFO:tasks.ceph.osd.1:Started 2024-04-25T02:07:37.170 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T02:07:37.170 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T02:07:37.173 INFO:tasks.ceph.osd.2:Started 2024-04-25T02:07:37.173 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T02:07:37.173 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T02:07:37.175 INFO:tasks.ceph.osd.3:Started 2024-04-25T02:07:37.175 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T02:07:37.175 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T02:07:37.207 INFO:tasks.ceph.osd.4:Started 2024-04-25T02:07:37.207 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T02:07:37.207 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T02:07:37.209 INFO:tasks.ceph.osd.5:Started 2024-04-25T02:07:37.209 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T02:07:37.209 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T02:07:37.212 INFO:tasks.ceph.osd.6:Started 2024-04-25T02:07:37.212 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T02:07:37.212 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T02:07:37.216 INFO:tasks.ceph.osd.7:Started 2024-04-25T02:07:37.216 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:07:37.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.318+0000 7f96d7990640 1 Processor -- start 2024-04-25T02:07:37.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.318+0000 7f96d7990640 1 -- start start 2024-04-25T02:07:37.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.319+0000 7f96d7990640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f96d00d4740 0x7f96d00cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:37.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.319+0000 7f96d7990640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d00cf5d0 0x7f96d00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:37.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.319+0000 7f96d7990640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96d00cfdc0 con 0x7f96d015e440 2024-04-25T02:07:37.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.319+0000 7f96d7990640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f96d00d00a0 con 0x7f96d00d4740 2024-04-25T02:07:37.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.319+0000 7f96d7990640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f96d00d0380 con 0x7f96d00cf5d0 2024-04-25T02:07:37.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.319+0000 7f96d5f2d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d00cf5d0 0x7f96d00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:37.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.319+0000 7f96d4f2b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f96d00d4740 0x7f96d00cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:37.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.319+0000 7f96d572c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f96d015e440 0x7f96d00d4030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:56034/0 (socket says 172.21.15.79:56034) 2024-04-25T02:07:37.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.319+0000 7f96d572c640 1 -- 172.21.15.79:0/2457544104 learned_addr learned my addr 172.21.15.79:0/2457544104 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:07:37.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.320+0000 7f96d5f2d640 1 -- 172.21.15.79:0/2457544104 >> v2:172.21.15.189:3300/0 conn(0x7f96d00d4740 msgr2=0x7f96d00cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:37.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.320+0000 7f96d5f2d640 1 --2- 172.21.15.79:0/2457544104 >> v2:172.21.15.189:3300/0 conn(0x7f96d00d4740 0x7f96d00cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.320+0000 7f96d5f2d640 1 -- 172.21.15.79:0/2457544104 >> v1:172.21.15.189:6789/0 conn(0x7f96d015e440 legacy=0x7f96d00d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:37.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.320+0000 7f96d5f2d640 1 -- 172.21.15.79:0/2457544104 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d00d0660 con 0x7f96d00cf5d0 2024-04-25T02:07:37.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.320+0000 7f96d4f2b640 1 --2- 172.21.15.79:0/2457544104 >> v2:172.21.15.189:3300/0 conn(0x7f96d00d4740 0x7f96d00cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:37.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.320+0000 7f96d5f2d640 1 --2- 172.21.15.79:0/2457544104 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d00cf5d0 0x7f96d00b3940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009d90 tx=0x7f96cc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae052bc372e670b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:37.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.320+0000 7f96c7fff640 1 -- 172.21.15.79:0/2457544104 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc007740 con 0x7f96d00cf5d0 2024-04-25T02:07:37.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.320+0000 7f96c7fff640 1 -- 172.21.15.79:0/2457544104 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96cc0078e0 con 0x7f96d00cf5d0 2024-04-25T02:07:37.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.320+0000 7f96c7fff640 1 -- 172.21.15.79:0/2457544104 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc007cb0 con 0x7f96d00cf5d0 2024-04-25T02:07:37.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.321+0000 7f96d7990640 1 -- 172.21.15.79:0/2457544104 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d00cf5d0 msgr2=0x7f96d00b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:37.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.321+0000 7f96d7990640 1 --2- 172.21.15.79:0/2457544104 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d00cf5d0 0x7f96d00b3940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009d90 tx=0x7f96cc02a660 comp rx=0 tx=0).stop 2024-04-25T02:07:37.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.321+0000 7f96d7990640 1 -- 172.21.15.79:0/2457544104 shutdown_connections 2024-04-25T02:07:37.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.321+0000 7f96d7990640 1 --2- 172.21.15.79:0/2457544104 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d00cf5d0 0x7f96d00b3940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.321+0000 7f96d7990640 1 --2- 172.21.15.79:0/2457544104 >> v2:172.21.15.189:3300/0 conn(0x7f96d00d4740 0x7f96d00cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.321+0000 7f96d7990640 1 -- 172.21.15.79:0/2457544104 >> 172.21.15.79:0/2457544104 conn(0x7f96d008db50 msgr2=0x7f96d009d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:37.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.321+0000 7f96d7990640 1 -- 172.21.15.79:0/2457544104 shutdown_connections 2024-04-25T02:07:37.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.321+0000 7f96d7990640 1 -- 172.21.15.79:0/2457544104 wait complete. 2024-04-25T02:07:37.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.322+0000 7f96d7990640 1 Processor -- start 2024-04-25T02:07:37.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.322+0000 7f96d7990640 1 -- start start 2024-04-25T02:07:37.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.323+0000 7f96d7990640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d00cf5d0 0x7f96d0157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:37.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.323+0000 7f96d7990640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d00d4740 0x7f96d00ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:37.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.323+0000 7f96d7990640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015e440 0x7f96d00b9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:37.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.323+0000 7f96d7990640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f96d00cfba0 con 0x7f96d00cf5d0 2024-04-25T02:07:37.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.323+0000 7f96d7990640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96d00cfa20 con 0x7f96d00d4740 2024-04-25T02:07:37.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.323+0000 7f96d7990640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f96d00b3e80 con 0x7f96d015e440 2024-04-25T02:07:37.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.323+0000 7f96d572c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d00cf5d0 0x7f96d0157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:37.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.323+0000 7f96d572c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d00cf5d0 0x7f96d0157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57478/0 (socket says 172.21.15.79:57478) 2024-04-25T02:07:37.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.323+0000 7f96d572c640 1 -- 172.21.15.79:0/428993587 learned_addr learned my addr 172.21.15.79:0/428993587 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:37.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.323+0000 7f96d4f2b640 1 --2- 172.21.15.79:0/428993587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d00d4740 0x7f96d00ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:37.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.323+0000 7f96d5f2d640 1 --2- 172.21.15.79:0/428993587 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015e440 0x7f96d00b9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.324+0000 7f96d572c640 1 -- 172.21.15.79:0/428993587 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015e440 msgr2=0x7f96d00b9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.324+0000 7f96d572c640 1 --2- 172.21.15.79:0/428993587 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015e440 0x7f96d00b9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.324+0000 7f96d572c640 1 -- 172.21.15.79:0/428993587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d00d4740 msgr2=0x7f96d00ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.324+0000 7f96d572c640 1 --2- 172.21.15.79:0/428993587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d00d4740 0x7f96d00ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.324+0000 7f96d572c640 1 -- 172.21.15.79:0/428993587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d00c9340 con 0x7f96d00cf5d0 2024-04-25T02:07:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.324+0000 7f96d572c640 1 --2- 172.21.15.79:0/428993587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d00cf5d0 0x7f96d0157f00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f96c800c4b0 tx=0x7f96c800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.324+0000 7f96c5ffb640 1 -- 172.21.15.79:0/428993587 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8017070 con 0x7f96d00cf5d0 2024-04-25T02:07:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.324+0000 7f96c5ffb640 1 -- 172.21.15.79:0/428993587 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c8005ce0 con 0x7f96d00cf5d0 2024-04-25T02:07:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.324+0000 7f96c5ffb640 1 -- 172.21.15.79:0/428993587 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8007270 con 0x7f96d00cf5d0 2024-04-25T02:07:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.324+0000 7f96d7990640 1 -- 172.21.15.79:0/428993587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d00c9620 con 0x7f96d00cf5d0 2024-04-25T02:07:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.324+0000 7f96c5ffb640 1 -- 172.21.15.79:0/428993587 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f96c801a070 con 0x7f96d00cf5d0 2024-04-25T02:07:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.324+0000 7f96d7990640 1 -- 172.21.15.79:0/428993587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d00c9be0 con 0x7f96d00cf5d0 2024-04-25T02:07:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.324+0000 7f96c5ffb640 1 -- 172.21.15.79:0/428993587 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f96c8007520 con 0x7f96d00cf5d0 2024-04-25T02:07:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.325+0000 7f96d7990640 1 -- 172.21.15.79:0/428993587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d00690a0 con 0x7f96d00cf5d0 2024-04-25T02:07:37.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.329+0000 7f96c5ffb640 1 -- 172.21.15.79:0/428993587 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f96c8021070 con 0x7f96d00cf5d0 2024-04-25T02:07:37.355 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:37.348+0000 7f16d7c12040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T02:07:37.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.390+0000 7f96d7990640 1 -- 172.21.15.79:0/428993587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96d00d2b60 con 0x7f96d00cf5d0 2024-04-25T02:07:37.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.391+0000 7f96c5ffb640 1 -- 172.21.15.79:0/428993587 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f96c8012400 con 0x7f96d00cf5d0 2024-04-25T02:07:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:37.397 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":10,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:07:37.143202+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:07:37.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.391+0000 7f96d7990640 1 -- 172.21.15.79:0/428993587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d00cf5d0 msgr2=0x7f96d0157f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:37.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.391+0000 7f96d7990640 1 --2- 172.21.15.79:0/428993587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d00cf5d0 0x7f96d0157f00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f96c800c4b0 tx=0x7f96c800c970 comp rx=0 tx=0).stop 2024-04-25T02:07:37.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.391+0000 7f96d7990640 1 -- 172.21.15.79:0/428993587 shutdown_connections 2024-04-25T02:07:37.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.391+0000 7f96d7990640 1 --2- 172.21.15.79:0/428993587 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015e440 0x7f96d00b9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.391+0000 7f96d7990640 1 --2- 172.21.15.79:0/428993587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d00d4740 0x7f96d00ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.391+0000 7f96d7990640 1 --2- 172.21.15.79:0/428993587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d00cf5d0 0x7f96d0157f00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:37.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.391+0000 7f96d7990640 1 -- 172.21.15.79:0/428993587 >> 172.21.15.79:0/428993587 conn(0x7f96d008db50 msgr2=0x7f96d00b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:37.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.391+0000 7f96d7990640 1 -- 172.21.15.79:0/428993587 shutdown_connections 2024-04-25T02:07:37.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:37.392+0000 7f96d7990640 1 -- 172.21.15.79:0/428993587 wait complete. 2024-04-25T02:07:37.408 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T02:07:37.409 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T02:07:37.427 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:37.420+0000 7f129952f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T02:07:37.615 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:37.608+0000 7f16d7c12040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T02:07:37.666 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:37.659+0000 7f16d7c12040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T02:07:37.684 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:37.678+0000 7f129952f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T02:07:37.738 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:37.731+0000 7f129952f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T02:07:37.782 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-04-25T02:07:37.775+0000 7f343e3a3640 -1 Falling back to public interface 2024-04-25T02:07:37.782 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-04-25T02:07:37.775+0000 7f851e944640 -1 Falling back to public interface 2024-04-25T02:07:37.783 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:37.775+0000 7f16d7c12040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T02:07:37.784 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-04-25T02:07:37.775+0000 7f343d352640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-25T02:07:37.784 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-04-25T02:07:37.775+0000 7f343d352640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-04-25T02:07:37.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T02:07:37.785+0000 7fab1d012640 -1 Falling back to public interface 2024-04-25T02:07:37.792 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-04-25T02:07:37.785+0000 7f25b0f01640 -1 Falling back to public interface 2024-04-25T02:07:37.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T02:07:37.788+0000 7fab1ba6a640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6830/0: (98) Address already in use 2024-04-25T02:07:37.806 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-04-25T02:07:37.799+0000 7fcb1ba0d640 -1 Falling back to public interface 2024-04-25T02:07:37.806 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-04-25T02:07:37.799+0000 7f56ae2df640 -1 Falling back to public interface 2024-04-25T02:07:37.807 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-04-25T02:07:37.799+0000 7f56ad28e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-25T02:07:37.807 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-04-25T02:07:37.800+0000 7f56ad28e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-04-25T02:07:37.816 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-04-25T02:07:37.809+0000 7f42eea1e640 -1 Falling back to public interface 2024-04-25T02:07:37.831 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-04-25T02:07:37.825+0000 7fb894486640 -1 Falling back to public interface 2024-04-25T02:07:37.860 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:37.853+0000 7f129952f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T02:07:38.064 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:38.057+0000 7f16d7c12040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T02:07:38.113 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:38.106+0000 7f16d7c12040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T02:07:38.143 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:38.137+0000 7f129952f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T02:07:38.191 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:38.184+0000 7f129952f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T02:07:38.213 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T02:07:38.270 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:38.264+0000 7f16d7c12040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T02:07:38.302 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.295+0000 7f829f390640 1 Processor -- start 2024-04-25T02:07:38.302 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.295+0000 7f829f390640 1 -- start start 2024-04-25T02:07:38.303 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.296+0000 7f829f390640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f829815b080 0x7f829815f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:38.303 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.296+0000 7f829f390640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8298071f00 0x7f8298072380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:38.303 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.296+0000 7f829f390640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f829815b460 con 0x7f82980705d0 2024-04-25T02:07:38.303 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.296+0000 7f829f390640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f82980cd0c0 con 0x7f829815b080 2024-04-25T02:07:38.303 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.296+0000 7f829f390640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f82980ccde0 con 0x7f8298071f00 2024-04-25T02:07:38.303 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.296+0000 7f829d12c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f829815b080 0x7f829815f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:38.304 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.296+0000 7f829d92d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8298071f00 0x7f8298072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:38.304 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.296+0000 7f829c92b640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f82980705d0 0x7f82980cc4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:56044/0 (socket says 172.21.15.79:56044) 2024-04-25T02:07:38.304 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.296+0000 7f829c92b640 1 -- 172.21.15.79:0/1879122685 learned_addr learned my addr 172.21.15.79:0/1879122685 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:07:38.304 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.297+0000 7f829d92d640 1 -- 172.21.15.79:0/1879122685 >> v2:172.21.15.189:3300/0 conn(0x7f829815b080 msgr2=0x7f829815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:38.304 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.297+0000 7f829d92d640 1 --2- 172.21.15.79:0/1879122685 >> v2:172.21.15.189:3300/0 conn(0x7f829815b080 0x7f829815f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:38.304 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.297+0000 7f829d92d640 1 -- 172.21.15.79:0/1879122685 >> v1:172.21.15.189:6789/0 conn(0x7f82980705d0 legacy=0x7f82980cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:38.304 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.297+0000 7f829d92d640 1 -- 172.21.15.79:0/1879122685 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829815ebf0 con 0x7f8298071f00 2024-04-25T02:07:38.304 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.297+0000 7f829d12c640 1 --2- 172.21.15.79:0/1879122685 >> v2:172.21.15.189:3300/0 conn(0x7f829815b080 0x7f829815f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:38.305 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.297+0000 7f829d92d640 1 --2- 172.21.15.79:0/1879122685 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8298071f00 0x7f8298072380 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8290009d90 tx=0x7f829002c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f5b47bea61a9090 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:38.305 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.297+0000 7f828bfff640 1 -- 172.21.15.79:0/1879122685 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8290036020 con 0x7f8298071f00 2024-04-25T02:07:38.305 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.297+0000 7f828bfff640 1 -- 172.21.15.79:0/1879122685 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8290032800 con 0x7f8298071f00 2024-04-25T02:07:38.306 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.297+0000 7f828bfff640 1 -- 172.21.15.79:0/1879122685 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8290032bd0 con 0x7f8298071f00 2024-04-25T02:07:38.306 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.298+0000 7f829f390640 1 -- 172.21.15.79:0/1879122685 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8298071f00 msgr2=0x7f8298072380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:38.306 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.298+0000 7f829f390640 1 --2- 172.21.15.79:0/1879122685 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8298071f00 0x7f8298072380 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8290009d90 tx=0x7f829002c900 comp rx=0 tx=0).stop 2024-04-25T02:07:38.306 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.298+0000 7f829f390640 1 -- 172.21.15.79:0/1879122685 shutdown_connections 2024-04-25T02:07:38.306 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.298+0000 7f829f390640 1 --2- 172.21.15.79:0/1879122685 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8298071f00 0x7f8298072380 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:38.306 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.298+0000 7f829f390640 1 --2- 172.21.15.79:0/1879122685 >> v2:172.21.15.189:3300/0 conn(0x7f829815b080 0x7f829815f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:38.306 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.298+0000 7f829f390640 1 -- 172.21.15.79:0/1879122685 >> 172.21.15.79:0/1879122685 conn(0x7f82980d0de0 msgr2=0x7f82980d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:38.306 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.298+0000 7f829f390640 1 -- 172.21.15.79:0/1879122685 shutdown_connections 2024-04-25T02:07:38.306 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.298+0000 7f829f390640 1 -- 172.21.15.79:0/1879122685 wait complete. 2024-04-25T02:07:38.308 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.299+0000 7f829f390640 1 Processor -- start 2024-04-25T02:07:38.308 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.299+0000 7f829f390640 1 -- start start 2024-04-25T02:07:38.309 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829f390640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82980705d0 0x7f82981f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:38.309 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829f390640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8298071f00 0x7f82980c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:38.309 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829f390640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f829815b080 0x7f829814aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:38.309 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829f390640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f82980ce9b0 con 0x7f82980705d0 2024-04-25T02:07:38.309 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829f390640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f829815f1b0 con 0x7f8298071f00 2024-04-25T02:07:38.309 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829f390640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f82980ceb30 con 0x7f829815b080 2024-04-25T02:07:38.309 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829d12c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82980705d0 0x7f82981f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:38.309 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829d12c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82980705d0 0x7f82981f3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57490/0 (socket says 172.21.15.79:57490) 2024-04-25T02:07:38.309 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829d12c640 1 -- 172.21.15.79:0/2812750467 learned_addr learned my addr 172.21.15.79:0/2812750467 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:38.309 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829d92d640 1 --2- 172.21.15.79:0/2812750467 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f829815b080 0x7f829814aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:38.309 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829c92b640 1 --2- 172.21.15.79:0/2812750467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8298071f00 0x7f82980c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:38.309 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829d12c640 1 -- 172.21.15.79:0/2812750467 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f829815b080 msgr2=0x7f829814aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:38.309 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829d12c640 1 --2- 172.21.15.79:0/2812750467 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f829815b080 0x7f829814aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:38.309 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829d12c640 1 -- 172.21.15.79:0/2812750467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8298071f00 msgr2=0x7f82980c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:38.310 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829d12c640 1 --2- 172.21.15.79:0/2812750467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8298071f00 0x7f82980c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:38.310 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829d12c640 1 -- 172.21.15.79:0/2812750467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82980c4530 con 0x7f82980705d0 2024-04-25T02:07:38.310 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.300+0000 7f829d92d640 1 --2- 172.21.15.79:0/2812750467 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f829815b080 0x7f829814aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:38.310 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.301+0000 7f829d12c640 1 --2- 172.21.15.79:0/2812750467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82980705d0 0x7f82981f3c10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f828c00e960 tx=0x7f828c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:38.310 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.301+0000 7f8289ffb640 1 -- 172.21.15.79:0/2812750467 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c017070 con 0x7f82980705d0 2024-04-25T02:07:38.310 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.301+0000 7f8289ffb640 1 -- 172.21.15.79:0/2812750467 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828c00c9a0 con 0x7f82980705d0 2024-04-25T02:07:38.310 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.301+0000 7f829f390640 1 -- 172.21.15.79:0/2812750467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82980c4810 con 0x7f82980705d0 2024-04-25T02:07:38.310 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.301+0000 7f8289ffb640 1 -- 172.21.15.79:0/2812750467 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c00cd70 con 0x7f82980705d0 2024-04-25T02:07:38.310 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.301+0000 7f829f390640 1 -- 172.21.15.79:0/2812750467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82980c4dd0 con 0x7f82980705d0 2024-04-25T02:07:38.310 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.301+0000 7f8289ffb640 1 -- 172.21.15.79:0/2812750467 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f828c01a070 con 0x7f82980705d0 2024-04-25T02:07:38.310 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.301+0000 7f8289ffb640 1 -- 172.21.15.79:0/2812750467 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f828c01cb20 con 0x7f82980705d0 2024-04-25T02:07:38.310 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.302+0000 7f829f390640 1 -- 172.21.15.79:0/2812750467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f829804f500 con 0x7f82980705d0 2024-04-25T02:07:38.311 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.304+0000 7f8289ffb640 1 -- 172.21.15.79:0/2812750467 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f828c009400 con 0x7f82980705d0 2024-04-25T02:07:38.346 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:38.339+0000 7f129952f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T02:07:38.372 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.365+0000 7f829f390640 1 -- 172.21.15.79:0/2812750467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8298073020 con 0x7f82980705d0 2024-04-25T02:07:38.373 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.366+0000 7f8289ffb640 1 -- 172.21.15.79:0/2812750467 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f828c0059f0 con 0x7f82980705d0 2024-04-25T02:07:38.373 INFO:teuthology.misc.health.smithi079.stdout: 2024-04-25T02:07:38.373 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":10,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:07:37.143202+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:07:38.374 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.367+0000 7f829f390640 1 -- 172.21.15.79:0/2812750467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82980705d0 msgr2=0x7f82981f3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:38.374 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.367+0000 7f829f390640 1 --2- 172.21.15.79:0/2812750467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82980705d0 0x7f82981f3c10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f828c00e960 tx=0x7f828c00ee20 comp rx=0 tx=0).stop 2024-04-25T02:07:38.374 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.367+0000 7f829f390640 1 -- 172.21.15.79:0/2812750467 shutdown_connections 2024-04-25T02:07:38.374 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.367+0000 7f829f390640 1 --2- 172.21.15.79:0/2812750467 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f829815b080 0x7f829814aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:38.374 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.367+0000 7f829f390640 1 --2- 172.21.15.79:0/2812750467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8298071f00 0x7f82980c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:38.374 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.367+0000 7f829f390640 1 --2- 172.21.15.79:0/2812750467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82980705d0 0x7f82981f3c10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:38.375 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.367+0000 7f829f390640 1 -- 172.21.15.79:0/2812750467 >> 172.21.15.79:0/2812750467 conn(0x7f82980d0de0 msgr2=0x7f82980d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:38.375 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.367+0000 7f829f390640 1 -- 172.21.15.79:0/2812750467 shutdown_connections 2024-04-25T02:07:38.375 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:38.367+0000 7f829f390640 1 -- 172.21.15.79:0/2812750467 wait complete. 2024-04-25T02:07:38.383 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T02:07:38.412 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:38.406+0000 7f16d7c12040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T02:07:38.462 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:38.455+0000 7f16d7c12040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T02:07:38.482 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:38.475+0000 7f129952f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T02:07:38.531 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:38.525+0000 7f129952f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T02:07:38.531 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:38.525+0000 7f16d7c12040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T02:07:38.576 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:38.570+0000 7f16d7c12040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T02:07:38.601 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:38.594+0000 7f129952f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T02:07:38.648 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:38.641+0000 7f129952f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T02:07:39.054 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:39.047+0000 7f16d7c12040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T02:07:39.128 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:39.122+0000 7f129952f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T02:07:39.169 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:39.162+0000 7f16d7c12040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T02:07:39.249 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-25T02:07:39.242+0000 7f129952f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T02:07:40.184 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:40.177+0000 7f16782fc640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T02:07:40.186 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-04-25T02:07:40.180+0000 7f16782fc640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T02:07:41.278 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-04-25T02:07:41.272+0000 7fcb1ba0d640 -1 osd.4 0 log_to_monitors true 2024-04-25T02:07:41.287 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-04-25T02:07:41.281+0000 7f343e3a3640 -1 osd.0 0 log_to_monitors true 2024-04-25T02:07:41.306 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-04-25T02:07:41.299+0000 7f851e944640 -1 osd.2 0 log_to_monitors true 2024-04-25T02:07:41.316 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-04-25T02:07:41.310+0000 7f56ae2df640 -1 osd.5 0 log_to_monitors true 2024-04-25T02:07:41.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T02:07:41.315+0000 7fab1d012640 -1 osd.1 0 log_to_monitors true 2024-04-25T02:07:41.332 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-04-25T02:07:41.325+0000 7f42eea1e640 -1 osd.6 0 log_to_monitors true 2024-04-25T02:07:41.337 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-04-25T02:07:41.331+0000 7f25b0f01640 -1 osd.3 0 log_to_monitors true 2024-04-25T02:07:41.356 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-04-25T02:07:41.349+0000 7fb894486640 -1 osd.7 0 log_to_monitors true 2024-04-25T02:07:45.045 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-04-25T02:07:45.038+0000 7f56a9a52640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T02:07:45.064 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-04-25T02:07:45.058+0000 7f56a2084640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:07:45.075 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-04-25T02:07:45.068+0000 7fcb16b75640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T02:07:45.084 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-04-25T02:07:45.078+0000 7fcb0f1a7640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:07:45.108 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-04-25T02:07:45.101+0000 7f42e9afa640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T02:07:45.123 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-04-25T02:07:45.117+0000 7f42e212c640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:07:45.189 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T02:07:45.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T02:07:45.259+0000 7fab1822e640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T02:07:45.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T02:07:45.277+0000 7fab10860640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:07:45.285 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-04-25T02:07:45.278+0000 7f3439b16640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T02:07:45.300 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-04-25T02:07:45.294+0000 7f3432148640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:07:45.323 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.317+0000 7f437e1f9640 1 Processor -- start 2024-04-25T02:07:45.323 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.317+0000 7f437e1f9640 1 -- start start 2024-04-25T02:07:45.324 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-04-25T02:07:45.317+0000 7f851a0b7640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T02:07:45.325 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.318+0000 7f437e1f9640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f437815e570 0x7f43780d4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:45.325 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.318+0000 7f437e1f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43780d0a40 0x7f43780d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:45.325 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.318+0000 7f437e1f9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43780b7020 con 0x7f43780b4c40 2024-04-25T02:07:45.325 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.318+0000 7f437e1f9640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f43780b7bf0 con 0x7f437815e570 2024-04-25T02:07:45.325 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.318+0000 7f437e1f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f43780d13c0 con 0x7f43780d0a40 2024-04-25T02:07:45.325 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.318+0000 7f43777fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f437815e570 0x7f43780d4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:45.326 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.318+0000 7f4376ffd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43780d0a40 0x7f43780d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:45.326 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.318+0000 7f4377fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f43780b4c40 0x7f43780b50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:56362/0 (socket says 172.21.15.79:56362) 2024-04-25T02:07:45.326 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.318+0000 7f4377fff640 1 -- 172.21.15.79:0/3898525830 learned_addr learned my addr 172.21.15.79:0/3898525830 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:07:45.326 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.318+0000 7f43777fe640 1 -- 172.21.15.79:0/3898525830 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43780d0a40 msgr2=0x7f43780d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:45.326 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.318+0000 7f43777fe640 1 --2- 172.21.15.79:0/3898525830 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43780d0a40 0x7f43780d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:45.326 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.318+0000 7f43777fe640 1 -- 172.21.15.79:0/3898525830 >> v1:172.21.15.189:6789/0 conn(0x7f43780b4c40 legacy=0x7f43780b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:45.326 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.318+0000 7f43777fe640 1 -- 172.21.15.79:0/3898525830 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43780b72c0 con 0x7f437815e570 2024-04-25T02:07:45.326 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.318+0000 7f4376ffd640 1 --2- 172.21.15.79:0/3898525830 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43780d0a40 0x7f43780d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:45.326 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.319+0000 7f43777fe640 1 --2- 172.21.15.79:0/3898525830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f437815e570 0x7f43780d4b50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f43680097a0 tx=0x7f436802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa2f118a47976ba5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:45.327 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-04-25T02:07:45.320+0000 7f25ac674640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T02:07:45.328 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.321+0000 7f43767fc640 1 -- 172.21.15.79:0/3898525830 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4368037070 con 0x7f437815e570 2024-04-25T02:07:45.328 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.321+0000 7f43767fc640 1 -- 172.21.15.79:0/3898525830 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4368032440 con 0x7f437815e570 2024-04-25T02:07:45.328 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.321+0000 7f43767fc640 1 -- 172.21.15.79:0/3898525830 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4368032810 con 0x7f437815e570 2024-04-25T02:07:45.329 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.322+0000 7f437e1f9640 1 -- 172.21.15.79:0/3898525830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f437815e570 msgr2=0x7f43780d4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:45.329 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.322+0000 7f437e1f9640 1 --2- 172.21.15.79:0/3898525830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f437815e570 0x7f43780d4b50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f43680097a0 tx=0x7f436802a210 comp rx=0 tx=0).stop 2024-04-25T02:07:45.329 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.322+0000 7f437e1f9640 1 -- 172.21.15.79:0/3898525830 shutdown_connections 2024-04-25T02:07:45.329 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.322+0000 7f437e1f9640 1 --2- 172.21.15.79:0/3898525830 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43780d0a40 0x7f43780d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:45.329 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.322+0000 7f437e1f9640 1 --2- 172.21.15.79:0/3898525830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f437815e570 0x7f43780d4b50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:45.329 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.322+0000 7f437e1f9640 1 -- 172.21.15.79:0/3898525830 >> 172.21.15.79:0/3898525830 conn(0x7f43780d4030 msgr2=0x7f43780d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:45.329 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.322+0000 7f437e1f9640 1 -- 172.21.15.79:0/3898525830 shutdown_connections 2024-04-25T02:07:45.329 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.322+0000 7f437e1f9640 1 -- 172.21.15.79:0/3898525830 wait complete. 2024-04-25T02:07:45.330 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.323+0000 7f437e1f9640 1 Processor -- start 2024-04-25T02:07:45.330 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.323+0000 7f437e1f9640 1 -- start start 2024-04-25T02:07:45.333 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.324+0000 7f437e1f9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43780b4c40 0x7f437814c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:45.333 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.324+0000 7f437e1f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43780d0a40 0x7f437815e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:45.333 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.324+0000 7f437e1f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f437815e570 0x7f43780c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:45.333 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.324+0000 7f437e1f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43780b57e0 con 0x7f43780d0a40 2024-04-25T02:07:45.333 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.324+0000 7f437e1f9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f43780b7880 con 0x7f43780b4c40 2024-04-25T02:07:45.333 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.324+0000 7f437e1f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f43780b5960 con 0x7f437815e570 2024-04-25T02:07:45.333 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f4376ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43780d0a40 0x7f437815e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:45.333 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f43777fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43780b4c40 0x7f437814c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:45.333 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f43777fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43780b4c40 0x7f437814c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:41626/0 (socket says 172.21.15.79:41626) 2024-04-25T02:07:45.333 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f43777fe640 1 -- 172.21.15.79:0/1231736670 learned_addr learned my addr 172.21.15.79:0/1231736670 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:45.333 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f4377fff640 1 --2- 172.21.15.79:0/1231736670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f437815e570 0x7f43780c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:45.333 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f43777fe640 1 -- 172.21.15.79:0/1231736670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f437815e570 msgr2=0x7f43780c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:45.333 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f43777fe640 1 --2- 172.21.15.79:0/1231736670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f437815e570 0x7f43780c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:45.333 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f43777fe640 1 -- 172.21.15.79:0/1231736670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43780d0a40 msgr2=0x7f437815e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:45.334 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f43777fe640 1 --2- 172.21.15.79:0/1231736670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43780d0a40 0x7f437815e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:45.334 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f43777fe640 1 -- 172.21.15.79:0/1231736670 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437814cd40 con 0x7f43780b4c40 2024-04-25T02:07:45.334 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f4377fff640 1 --2- 172.21.15.79:0/1231736670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f437815e570 0x7f43780c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:45.334 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f43777fe640 1 --2- 172.21.15.79:0/1231736670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43780b4c40 0x7f437814c800 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43680098c0 tx=0x7f43680046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:45.334 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f435ffff640 1 -- 172.21.15.79:0/1231736670 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4368037040 con 0x7f43780b4c40 2024-04-25T02:07:45.334 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f435ffff640 1 -- 172.21.15.79:0/1231736670 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4368030500 con 0x7f43780b4c40 2024-04-25T02:07:45.334 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f435ffff640 1 -- 172.21.15.79:0/1231736670 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43680308d0 con 0x7f43780b4c40 2024-04-25T02:07:45.334 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f437e1f9640 1 -- 172.21.15.79:0/1231736670 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43780c83e0 con 0x7f43780b4c40 2024-04-25T02:07:45.334 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.325+0000 7f437e1f9640 1 -- 172.21.15.79:0/1231736670 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43780cb210 con 0x7f43780b4c40 2024-04-25T02:07:45.335 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.326+0000 7f437e1f9640 1 -- 172.21.15.79:0/1231736670 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43780cac80 con 0x7f43780b4c40 2024-04-25T02:07:45.335 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.327+0000 7f435ffff640 1 -- 172.21.15.79:0/1231736670 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f4368044020 con 0x7f43780b4c40 2024-04-25T02:07:45.335 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.327+0000 7f435ffff640 1 --2- 172.21.15.79:0/1231736670 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f436406bda0 0x7f436406e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:45.335 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.327+0000 7f4376ffd640 1 --2- 172.21.15.79:0/1231736670 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f436406bda0 0x7f436406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:45.335 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.327+0000 7f435ffff640 1 -- 172.21.15.79:0/1231736670 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f43680aa0b0 con 0x7f43780b4c40 2024-04-25T02:07:45.335 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.327+0000 7f4376ffd640 1 --2- 172.21.15.79:0/1231736670 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f436406bda0 0x7f436406e260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f436c009560 tx=0x7f436c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:45.336 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-04-25T02:07:45.329+0000 7f85126e9640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:07:45.338 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.332+0000 7f435ffff640 1 -- 172.21.15.79:0/1231736670 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f43780cac80 con 0x7f43780b4c40 2024-04-25T02:07:45.341 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-04-25T02:07:45.335+0000 7f25a4ca6640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:07:45.345 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-04-25T02:07:45.339+0000 7fb891431640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T02:07:45.355 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-04-25T02:07:45.349+0000 7fb88822b640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:07:45.514 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.508+0000 7f437e1f9640 1 -- 172.21.15.79:0/1231736670 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f437808bfe0 con 0x7f43780b4c40 2024-04-25T02:07:45.515 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.509+0000 7f435ffff640 1 -- 172.21.15.79:0/1231736670 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f437808bfe0 con 0x7f43780b4c40 2024-04-25T02:07:45.515 INFO:teuthology.misc.health.smithi079.stdout: 2024-04-25T02:07:45.516 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":12,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:07:43.182889+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:07:45.518 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.511+0000 7f437e1f9640 1 -- 172.21.15.79:0/1231736670 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f436406bda0 msgr2=0x7f436406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:45.518 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.511+0000 7f437e1f9640 1 --2- 172.21.15.79:0/1231736670 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f436406bda0 0x7f436406e260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f436c009560 tx=0x7f436c009190 comp rx=0 tx=0).stop 2024-04-25T02:07:45.518 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.511+0000 7f437e1f9640 1 -- 172.21.15.79:0/1231736670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43780b4c40 msgr2=0x7f437814c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:45.518 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.511+0000 7f437e1f9640 1 --2- 172.21.15.79:0/1231736670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43780b4c40 0x7f437814c800 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43680098c0 tx=0x7f43680046c0 comp rx=0 tx=0).stop 2024-04-25T02:07:45.518 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.511+0000 7f437e1f9640 1 -- 172.21.15.79:0/1231736670 shutdown_connections 2024-04-25T02:07:45.518 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.511+0000 7f437e1f9640 1 --2- 172.21.15.79:0/1231736670 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f436406bda0 0x7f436406e260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:45.518 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.511+0000 7f437e1f9640 1 --2- 172.21.15.79:0/1231736670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f437815e570 0x7f43780c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:45.519 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.511+0000 7f437e1f9640 1 --2- 172.21.15.79:0/1231736670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43780d0a40 0x7f437815e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:45.519 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.511+0000 7f437e1f9640 1 --2- 172.21.15.79:0/1231736670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43780b4c40 0x7f437814c800 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:45.519 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.511+0000 7f437e1f9640 1 -- 172.21.15.79:0/1231736670 >> 172.21.15.79:0/1231736670 conn(0x7f43780d4030 msgr2=0x7f437806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:45.519 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.511+0000 7f437e1f9640 1 -- 172.21.15.79:0/1231736670 shutdown_connections 2024-04-25T02:07:45.519 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:45.511+0000 7f437e1f9640 1 -- 172.21.15.79:0/1231736670 wait complete. 2024-04-25T02:07:45.527 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T02:07:52.334 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T02:07:52.433 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.426+0000 7ff13ff41640 1 Processor -- start 2024-04-25T02:07:52.433 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.426+0000 7ff13ff41640 1 -- start start 2024-04-25T02:07:52.438 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.427+0000 7ff13ff41640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff13806d670 0x7ff1380b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:52.438 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.427+0000 7ff13ff41640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1380d0d90 0x7ff1380b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:52.438 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.427+0000 7ff13ff41640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff13806b1f0 con 0x7ff13815e1d0 2024-04-25T02:07:52.438 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.427+0000 7ff13ff41640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff13815e5b0 con 0x7ff13806d670 2024-04-25T02:07:52.438 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.427+0000 7ff13ff41640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff13806be00 con 0x7ff1380d0d90 2024-04-25T02:07:52.438 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.427+0000 7ff13dcdd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff13815e1d0 0x7ff13806c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51116/0 (socket says 172.21.15.79:51116) 2024-04-25T02:07:52.438 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.427+0000 7ff13dcdd640 1 -- 172.21.15.79:0/1087769617 learned_addr learned my addr 172.21.15.79:0/1087769617 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:07:52.439 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.427+0000 7ff13ccdb640 1 -- 172.21.15.79:0/1087769617 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 670323258 0 0) 0x7ff13806b1f0 con 0x7ff13815e1d0 2024-04-25T02:07:52.439 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13ccdb640 1 -- 172.21.15.79:0/1087769617 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff124003520 con 0x7ff13815e1d0 2024-04-25T02:07:52.439 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13d4dc640 1 --2- 172.21.15.79:0/1087769617 >> v2:172.21.15.189:3300/0 conn(0x7ff13806d670 0x7ff1380b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:52.439 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13e4de640 1 --2- 172.21.15.79:0/1087769617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1380d0d90 0x7ff1380b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:52.439 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13ccdb640 1 -- 172.21.15.79:0/1087769617 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2191533189 0 0) 0x7ff124003520 con 0x7ff13815e1d0 2024-04-25T02:07:52.439 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13ccdb640 1 -- 172.21.15.79:0/1087769617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1380d0d90 msgr2=0x7ff1380b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:52.439 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13ccdb640 1 --2- 172.21.15.79:0/1087769617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1380d0d90 0x7ff1380b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.439 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13ccdb640 1 -- 172.21.15.79:0/1087769617 >> v2:172.21.15.189:3300/0 conn(0x7ff13806d670 msgr2=0x7ff1380b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:52.439 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13ccdb640 1 --2- 172.21.15.79:0/1087769617 >> v2:172.21.15.189:3300/0 conn(0x7ff13806d670 0x7ff1380b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.439 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13ccdb640 1 -- 172.21.15.79:0/1087769617 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13806b4d0 con 0x7ff13815e1d0 2024-04-25T02:07:52.439 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13d4dc640 1 --2- 172.21.15.79:0/1087769617 >> v2:172.21.15.189:3300/0 conn(0x7ff13806d670 0x7ff1380b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:07:52.440 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13ccdb640 1 -- 172.21.15.79:0/1087769617 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7ff134001670 con 0x7ff13815e1d0 2024-04-25T02:07:52.440 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13ccdb640 1 -- 172.21.15.79:0/1087769617 >> v1:172.21.15.79:6789/0 conn(0x7ff13815e1d0 legacy=0x7ff13806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:52.440 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13ccdb640 1 --2- 172.21.15.79:0/1087769617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1240039b0 0x7ff124003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:52.440 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13ccdb640 1 --2- 172.21.15.79:0/1087769617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1380d0d90 0x7ff124004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:52.440 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13ccdb640 1 --2- 172.21.15.79:0/1087769617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff124004d40 0x7ff1240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:52.440 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13ccdb640 1 -- 172.21.15.79:0/1087769617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff13815e5b0 con 0x7ff1240039b0 2024-04-25T02:07:52.440 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13ccdb640 1 -- 172.21.15.79:0/1087769617 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff13806be00 con 0x7ff124004d40 2024-04-25T02:07:52.440 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13ccdb640 1 -- 172.21.15.79:0/1087769617 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff12400baa0 con 0x7ff1380d0d90 2024-04-25T02:07:52.441 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13dcdd640 1 --2- 172.21.15.79:0/1087769617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1240039b0 0x7ff124003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:52.441 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13d4dc640 1 --2- 172.21.15.79:0/1087769617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1380d0d90 0x7ff124004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:52.441 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13e4de640 1 --2- 172.21.15.79:0/1087769617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff124004d40 0x7ff1240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:52.441 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13dcdd640 1 -- 172.21.15.79:0/1087769617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1380d0d90 msgr2=0x7ff124004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:52.441 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13dcdd640 1 --2- 172.21.15.79:0/1087769617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1380d0d90 0x7ff124004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.441 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13dcdd640 1 -- 172.21.15.79:0/1087769617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff124004d40 msgr2=0x7ff1240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:52.441 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13dcdd640 1 --2- 172.21.15.79:0/1087769617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff124004d40 0x7ff1240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.442 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.428+0000 7ff13dcdd640 1 -- 172.21.15.79:0/1087769617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff124003520 con 0x7ff1240039b0 2024-04-25T02:07:52.442 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.429+0000 7ff13dcdd640 1 --2- 172.21.15.79:0/1087769617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1240039b0 0x7ff124003df0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff13400c290 tx=0x7ff124005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503e2c5b82acfddb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:52.442 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.429+0000 7ff13ccdb640 1 -- 172.21.15.79:0/1087769617 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff134007d50 con 0x7ff1240039b0 2024-04-25T02:07:52.442 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.429+0000 7ff13ccdb640 1 -- 172.21.15.79:0/1087769617 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff134005ad0 con 0x7ff1240039b0 2024-04-25T02:07:52.442 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.429+0000 7ff13ccdb640 1 -- 172.21.15.79:0/1087769617 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff134007070 con 0x7ff1240039b0 2024-04-25T02:07:52.443 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.430+0000 7ff13ff41640 1 -- 172.21.15.79:0/1087769617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1240039b0 msgr2=0x7ff124003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:52.443 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.430+0000 7ff13ff41640 1 --2- 172.21.15.79:0/1087769617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1240039b0 0x7ff124003df0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff13400c290 tx=0x7ff124005830 comp rx=0 tx=0).stop 2024-04-25T02:07:52.443 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.430+0000 7ff13e4de640 1 -- 172.21.15.79:0/1087769617 reap_dead start 2024-04-25T02:07:52.443 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.430+0000 7ff13ff41640 1 -- 172.21.15.79:0/1087769617 shutdown_connections 2024-04-25T02:07:52.443 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.430+0000 7ff13ff41640 1 -- 172.21.15.79:0/1087769617 >> 172.21.15.79:0/1087769617 conn(0x7ff1380b2890 msgr2=0x7ff1380d04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:52.443 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.430+0000 7ff13ff41640 1 -- 172.21.15.79:0/1087769617 shutdown_connections 2024-04-25T02:07:52.444 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.430+0000 7ff13ff41640 1 -- 172.21.15.79:0/1087769617 wait complete. 2024-04-25T02:07:52.444 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.431+0000 7ff13ff41640 1 Processor -- start 2024-04-25T02:07:52.444 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.431+0000 7ff13ff41640 1 -- start start 2024-04-25T02:07:52.449 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13ff41640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1240039b0 0x7ff138155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:52.449 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13ff41640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13815f140 0x7ff1380b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:52.449 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13ff41640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13813b7f0 0x7ff13813bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:52.449 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13ff41640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff13806c9a0 con 0x7ff1240039b0 2024-04-25T02:07:52.449 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13ff41640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff13806ba90 con 0x7ff13813b7f0 2024-04-25T02:07:52.449 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13ff41640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff1380b5980 con 0x7ff13815f140 2024-04-25T02:07:52.449 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13dcdd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1240039b0 0x7ff138155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:52.449 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13dcdd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1240039b0 0x7ff138155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47628/0 (socket says 172.21.15.79:47628) 2024-04-25T02:07:52.449 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13dcdd640 1 -- 172.21.15.79:0/797145234 learned_addr learned my addr 172.21.15.79:0/797145234 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:52.449 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13d4dc640 1 --2- 172.21.15.79:0/797145234 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13815f140 0x7ff1380b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:52.450 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13e4de640 1 --2- 172.21.15.79:0/797145234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13813b7f0 0x7ff13813bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:52.450 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13dcdd640 1 -- 172.21.15.79:0/797145234 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13815f140 msgr2=0x7ff1380b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:52.450 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13dcdd640 1 --2- 172.21.15.79:0/797145234 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13815f140 0x7ff1380b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.450 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13dcdd640 1 -- 172.21.15.79:0/797145234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13813b7f0 msgr2=0x7ff13813bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:52.450 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13dcdd640 1 --2- 172.21.15.79:0/797145234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13813b7f0 0x7ff13813bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.450 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13dcdd640 1 -- 172.21.15.79:0/797145234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13815f6b0 con 0x7ff1240039b0 2024-04-25T02:07:52.450 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13e4de640 1 --2- 172.21.15.79:0/797145234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13813b7f0 0x7ff13813bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:07:52.450 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13dcdd640 1 --2- 172.21.15.79:0/797145234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1240039b0 0x7ff138155e40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff13402ae50 tx=0x7ff13806bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:52.450 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff12e7fc640 1 -- 172.21.15.79:0/797145234 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff134042070 con 0x7ff1240039b0 2024-04-25T02:07:52.450 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff12e7fc640 1 -- 172.21.15.79:0/797145234 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff134007480 con 0x7ff1240039b0 2024-04-25T02:07:52.450 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff13ff41640 1 -- 172.21.15.79:0/797145234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff13815f990 con 0x7ff1240039b0 2024-04-25T02:07:52.450 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.432+0000 7ff12e7fc640 1 -- 172.21.15.79:0/797145234 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff134001c80 con 0x7ff1240039b0 2024-04-25T02:07:52.450 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.433+0000 7ff13ff41640 1 -- 172.21.15.79:0/797145234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff13815ff50 con 0x7ff1240039b0 2024-04-25T02:07:52.451 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.433+0000 7ff13ff41640 1 -- 172.21.15.79:0/797145234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff13804f500 con 0x7ff1240039b0 2024-04-25T02:07:52.451 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.434+0000 7ff12e7fc640 1 -- 172.21.15.79:0/797145234 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff134045070 con 0x7ff1240039b0 2024-04-25T02:07:52.451 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.434+0000 7ff12e7fc640 1 --2- 172.21.15.79:0/797145234 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff11c06be30 0x7ff11c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:52.451 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.434+0000 7ff12e7fc640 1 -- 172.21.15.79:0/797145234 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7ff1340ab6a0 con 0x7ff1240039b0 2024-04-25T02:07:52.451 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.434+0000 7ff13d4dc640 1 --2- 172.21.15.79:0/797145234 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff11c06be30 0x7ff11c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:52.451 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.435+0000 7ff13d4dc640 1 --2- 172.21.15.79:0/797145234 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff11c06be30 0x7ff11c06e2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff1380b13c0 tx=0x7ff128008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:52.451 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.439+0000 7ff12e7fc640 1 -- 172.21.15.79:0/797145234 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff13404c030 con 0x7ff1240039b0 2024-04-25T02:07:52.620 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.614+0000 7ff13ff41640 1 -- 172.21.15.79:0/797145234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1381605a0 con 0x7ff1240039b0 2024-04-25T02:07:52.621 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.614+0000 7ff12e7fc640 1 -- 172.21.15.79:0/797145234 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12896 (secure 0 0 0) 0x7ff13407a430 con 0x7ff1240039b0 2024-04-25T02:07:52.622 INFO:teuthology.misc.health.smithi079.stdout: 2024-04-25T02:07:52.622 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":17,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:07:50.059679+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:07:52.624 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.616+0000 7ff13ff41640 1 -- 172.21.15.79:0/797145234 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff11c06be30 msgr2=0x7ff11c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:52.624 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.616+0000 7ff13ff41640 1 --2- 172.21.15.79:0/797145234 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff11c06be30 0x7ff11c06e2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff1380b13c0 tx=0x7ff128008040 comp rx=0 tx=0).stop 2024-04-25T02:07:52.625 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.616+0000 7ff13ff41640 1 -- 172.21.15.79:0/797145234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1240039b0 msgr2=0x7ff138155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:52.625 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.616+0000 7ff13ff41640 1 --2- 172.21.15.79:0/797145234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1240039b0 0x7ff138155e40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff13402ae50 tx=0x7ff13806bd70 comp rx=0 tx=0).stop 2024-04-25T02:07:52.625 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.616+0000 7ff13ff41640 1 -- 172.21.15.79:0/797145234 shutdown_connections 2024-04-25T02:07:52.625 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.616+0000 7ff13ff41640 1 --2- 172.21.15.79:0/797145234 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff11c06be30 0x7ff11c06e2f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.625 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.616+0000 7ff13ff41640 1 --2- 172.21.15.79:0/797145234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13813b7f0 0x7ff13813bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.625 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.616+0000 7ff13ff41640 1 --2- 172.21.15.79:0/797145234 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13815f140 0x7ff1380b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.626 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.616+0000 7ff13ff41640 1 --2- 172.21.15.79:0/797145234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1240039b0 0x7ff138155e40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.626 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.616+0000 7ff13ff41640 1 -- 172.21.15.79:0/797145234 >> 172.21.15.79:0/797145234 conn(0x7ff1380b2890 msgr2=0x7ff13806c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:52.626 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.616+0000 7ff13ff41640 1 -- 172.21.15.79:0/797145234 shutdown_connections 2024-04-25T02:07:52.626 INFO:teuthology.misc.health.smithi079.stderr:2024-04-25T02:07:52.617+0000 7ff13ff41640 1 -- 172.21.15.79:0/797145234 wait complete. 2024-04-25T02:07:52.633 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T02:07:52.634 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T02:07:52.634 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T02:07:52.634 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T02:07:52.637 INFO:tasks.ceph.mds.a:Started 2024-04-25T02:07:52.638 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T02:07:52.638 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T02:07:52.640 INFO:tasks.ceph.mds.c:Started 2024-04-25T02:07:52.641 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T02:07:52.641 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T02:07:52.644 INFO:tasks.ceph.mds.b:Started 2024-04-25T02:07:52.645 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T02:07:52.645 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T02:07:52.648 INFO:tasks.ceph.mds.d:Started 2024-04-25T02:07:52.648 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T02:07:52.649 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:07:52.711 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:07:52.712 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-04-25T02:07:52.728 INFO:tasks.ceph.mds.b.smithi189.stdout:starting mds.b at 2024-04-25T02:07:52.729 INFO:tasks.ceph.mds.d.smithi189.stdout:starting mds.d at 2024-04-25T02:07:52.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.746+0000 7fcc28eee640 1 Processor -- start 2024-04-25T02:07:52.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.746+0000 7fcc28eee640 1 -- start start 2024-04-25T02:07:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc28eee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc2415c230 0x7fcc240cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc28eee640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcc240d2940 0x7fcc240d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc28eee640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc240cff30 con 0x7fcc240d0940 2024-04-25T02:07:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc28eee640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fcc240cf720 con 0x7fcc240d2940 2024-04-25T02:07:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc28eee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcc240cf440 con 0x7fcc2415c230 2024-04-25T02:07:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc21d9b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcc240d2940 0x7fcc240d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc2259c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc2415c230 0x7fcc240cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc21d9b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcc240d2940 0x7fcc240d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:41696/0 (socket says 172.21.15.79:41696) 2024-04-25T02:07:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc21d9b640 1 -- 172.21.15.79:0/2328382225 learned_addr learned my addr 172.21.15.79:0/2328382225 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc22d9d640 1 --1- 172.21.15.79:0/2328382225 >> v1:172.21.15.189:6789/0 conn(0x7fcc240d0940 0x7fcc240cc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:56374/0 (socket says 172.21.15.79:56374) 2024-04-25T02:07:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc21d9b640 1 -- 172.21.15.79:0/2328382225 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc2415c230 msgr2=0x7fcc240cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc21d9b640 1 --2- 172.21.15.79:0/2328382225 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc2415c230 0x7fcc240cee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc21d9b640 1 -- 172.21.15.79:0/2328382225 >> v1:172.21.15.189:6789/0 conn(0x7fcc240d0940 legacy=0x7fcc240cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc21d9b640 1 -- 172.21.15.79:0/2328382225 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc240b1390 con 0x7fcc240d2940 2024-04-25T02:07:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc2159a640 1 -- 172.21.15.79:0/2328382225 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4048238736 0 0) 0x7fcc1c001490 con 0x7fcc240d0940 2024-04-25T02:07:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.747+0000 7fcc2259c640 1 --2- 172.21.15.79:0/2328382225 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc2415c230 0x7fcc240cee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.748+0000 7fcc21d9b640 1 --2- 172.21.15.79:0/2328382225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc240d2940 0x7fcc240d0400 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009870 tx=0x7fcc1802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e065174e983d1dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.748+0000 7fcc2159a640 1 -- 172.21.15.79:0/2328382225 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc18037070 con 0x7fcc240d2940 2024-04-25T02:07:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.748+0000 7fcc2159a640 1 -- 172.21.15.79:0/2328382225 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc18032440 con 0x7fcc240d2940 2024-04-25T02:07:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.748+0000 7fcc2159a640 1 -- 172.21.15.79:0/2328382225 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc18032810 con 0x7fcc240d2940 2024-04-25T02:07:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.748+0000 7fcc28eee640 1 -- 172.21.15.79:0/2328382225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc240d2940 msgr2=0x7fcc240d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.748+0000 7fcc28eee640 1 --2- 172.21.15.79:0/2328382225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc240d2940 0x7fcc240d0400 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009870 tx=0x7fcc1802a1c0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.748+0000 7fcc28eee640 1 -- 172.21.15.79:0/2328382225 shutdown_connections 2024-04-25T02:07:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.748+0000 7fcc28eee640 1 --2- 172.21.15.79:0/2328382225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc240d2940 0x7fcc240d0400 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.748+0000 7fcc28eee640 1 --2- 172.21.15.79:0/2328382225 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc2415c230 0x7fcc240cee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.748+0000 7fcc28eee640 1 -- 172.21.15.79:0/2328382225 >> 172.21.15.79:0/2328382225 conn(0x7fcc240d1e20 msgr2=0x7fcc240d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.748+0000 7fcc28eee640 1 -- 172.21.15.79:0/2328382225 shutdown_connections 2024-04-25T02:07:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.748+0000 7fcc28eee640 1 -- 172.21.15.79:0/2328382225 wait complete. 2024-04-25T02:07:52.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.750+0000 7fcc28eee640 1 Processor -- start 2024-04-25T02:07:52.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.750+0000 7fcc28eee640 1 -- start start 2024-04-25T02:07:52.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.750+0000 7fcc28eee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc240d0940 0x7fcc241f1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:52.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.750+0000 7fcc28eee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d2940 0x7fcc240b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:52.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.750+0000 7fcc28eee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc2415c230 0x7fcc240b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:52.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.750+0000 7fcc28eee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcc240b2e80 con 0x7fcc240d2940 2024-04-25T02:07:52.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.750+0000 7fcc28eee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2415c610 con 0x7fcc240d0940 2024-04-25T02:07:52.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.750+0000 7fcc28eee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcc240b3000 con 0x7fcc2415c230 2024-04-25T02:07:52.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc21d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d2940 0x7fcc240b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:52.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc21d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d2940 0x7fcc240b6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47668/0 (socket says 172.21.15.79:47668) 2024-04-25T02:07:52.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc21d9b640 1 -- 172.21.15.79:0/1676500581 learned_addr learned my addr 172.21.15.79:0/1676500581 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:52.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc22d9d640 1 --2- 172.21.15.79:0/1676500581 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc2415c230 0x7fcc240b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:52.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc2259c640 1 --2- 172.21.15.79:0/1676500581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc240d0940 0x7fcc241f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc21d9b640 1 -- 172.21.15.79:0/1676500581 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc2415c230 msgr2=0x7fcc240b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc21d9b640 1 --2- 172.21.15.79:0/1676500581 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc2415c230 0x7fcc240b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc21d9b640 1 -- 172.21.15.79:0/1676500581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc240d0940 msgr2=0x7fcc241f1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc21d9b640 1 --2- 172.21.15.79:0/1676500581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc240d0940 0x7fcc241f1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc21d9b640 1 -- 172.21.15.79:0/1676500581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc24155a30 con 0x7fcc240d2940 2024-04-25T02:07:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc21d9b640 1 --2- 172.21.15.79:0/1676500581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d2940 0x7fcc240b6d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcc18035040 tx=0x7fcc180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc12ffd640 1 -- 172.21.15.79:0/1676500581 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc18037040 con 0x7fcc240d2940 2024-04-25T02:07:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc12ffd640 1 -- 172.21.15.79:0/1676500581 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc18004230 con 0x7fcc240d2940 2024-04-25T02:07:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc28eee640 1 -- 172.21.15.79:0/1676500581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc24155d10 con 0x7fcc240d2940 2024-04-25T02:07:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc12ffd640 1 -- 172.21.15.79:0/1676500581 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc18003610 con 0x7fcc240d2940 2024-04-25T02:07:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.751+0000 7fcc28eee640 1 -- 172.21.15.79:0/1676500581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc241565b0 con 0x7fcc240d2940 2024-04-25T02:07:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.752+0000 7fcc28eee640 1 -- 172.21.15.79:0/1676500581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc24156100 con 0x7fcc240d2940 2024-04-25T02:07:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.753+0000 7fcc12ffd640 1 -- 172.21.15.79:0/1676500581 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc1802ad10 con 0x7fcc240d2940 2024-04-25T02:07:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.753+0000 7fcc12ffd640 1 --2- 172.21.15.79:0/1676500581 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc0406be30 0x7fcc0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:52.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.753+0000 7fcc12ffd640 1 -- 172.21.15.79:0/1676500581 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fcc180ab4d0 con 0x7fcc240d2940 2024-04-25T02:07:52.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.753+0000 7fcc2259c640 1 --2- 172.21.15.79:0/1676500581 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc0406be30 0x7fcc0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:52.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.753+0000 7fcc2259c640 1 --2- 172.21.15.79:0/1676500581 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc0406be30 0x7fcc0406e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009560 tx=0x7fcc14009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.757+0000 7fcc12ffd640 1 -- 172.21.15.79:0/1676500581 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcc18079c10 con 0x7fcc240d2940 2024-04-25T02:07:52.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.931+0000 7fcc28eee640 1 -- 172.21.15.79:0/1676500581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc240681e0 con 0x7fcc240d2940 2024-04-25T02:07:52.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.932+0000 7fcc12ffd640 1 -- 172.21.15.79:0/1676500581 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12896 (secure 0 0 0) 0x7fcc1807df10 con 0x7fcc240d2940 2024-04-25T02:07:52.939 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:52.939 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":17,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:07:50.059679+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:07:52.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.934+0000 7fcc28eee640 1 -- 172.21.15.79:0/1676500581 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc0406be30 msgr2=0x7fcc0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:52.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.934+0000 7fcc28eee640 1 --2- 172.21.15.79:0/1676500581 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc0406be30 0x7fcc0406e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009560 tx=0x7fcc14009190 comp rx=0 tx=0).stop 2024-04-25T02:07:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.934+0000 7fcc28eee640 1 -- 172.21.15.79:0/1676500581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d2940 msgr2=0x7fcc240b6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.934+0000 7fcc28eee640 1 --2- 172.21.15.79:0/1676500581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d2940 0x7fcc240b6d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcc18035040 tx=0x7fcc180046c0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.934+0000 7fcc28eee640 1 -- 172.21.15.79:0/1676500581 shutdown_connections 2024-04-25T02:07:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.934+0000 7fcc28eee640 1 --2- 172.21.15.79:0/1676500581 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc0406be30 0x7fcc0406e2f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.934+0000 7fcc28eee640 1 --2- 172.21.15.79:0/1676500581 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc2415c230 0x7fcc240b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.934+0000 7fcc28eee640 1 --2- 172.21.15.79:0/1676500581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d2940 0x7fcc240b6d00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.934+0000 7fcc28eee640 1 --2- 172.21.15.79:0/1676500581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc240d0940 0x7fcc241f1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.934+0000 7fcc28eee640 1 -- 172.21.15.79:0/1676500581 >> 172.21.15.79:0/1676500581 conn(0x7fcc240d1e20 msgr2=0x7fcc240b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.934+0000 7fcc28eee640 1 -- 172.21.15.79:0/1676500581 shutdown_connections 2024-04-25T02:07:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:52.934+0000 7fcc28eee640 1 -- 172.21.15.79:0/1676500581 wait complete. 2024-04-25T02:07:52.952 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:07:52.952 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:07:53.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.044+0000 7f62a1d7e640 1 Processor -- start 2024-04-25T02:07:53.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.045+0000 7f62a1d7e640 1 -- start start 2024-04-25T02:07:53.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.045+0000 7f62a1d7e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f629c0cf7a0 0x7f629c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:53.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.045+0000 7f62a1d7e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f629c15ec20 con 0x7f629c06e6b0 2024-04-25T02:07:53.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.045+0000 7f62a1d7e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f629c15ef00 con 0x7f629c06b2f0 2024-04-25T02:07:53.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.045+0000 7f62a1d7e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f629c15f830 con 0x7f629c0cf7a0 2024-04-25T02:07:53.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.045+0000 7f629affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f629c0cf7a0 0x7f629c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:53.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.045+0000 7f629bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f629c06e6b0 0x7f629c15b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51118/0 (socket says 172.21.15.79:51118) 2024-04-25T02:07:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.045+0000 7f629bfff640 1 -- 172.21.15.79:0/3124717613 learned_addr learned my addr 172.21.15.79:0/3124717613 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:07:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.046+0000 7f629affd640 1 -- 172.21.15.79:0/3124717613 >> v1:172.21.15.189:6789/0 conn(0x7f629c06b2f0 legacy=0x7f629c06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.046+0000 7f629affd640 1 -- 172.21.15.79:0/3124717613 >> v1:172.21.15.79:6789/0 conn(0x7f629c06e6b0 legacy=0x7f629c15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.046+0000 7f629affd640 1 -- 172.21.15.79:0/3124717613 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629c15f1e0 con 0x7f629c0cf7a0 2024-04-25T02:07:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.046+0000 7f629a7fc640 1 -- 172.21.15.79:0/3124717613 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4073514243 0 0) 0x7f629c15ec20 con 0x7f629c06e6b0 2024-04-25T02:07:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.046+0000 7f629affd640 1 --2- 172.21.15.79:0/3124717613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f629c0cf7a0 0x7f629c0b4b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f62900097a0 tx=0x7f629002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c9b4918db76f3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.046+0000 7f629a7fc640 1 -- 172.21.15.79:0/3124717613 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6290037070 con 0x7f629c0cf7a0 2024-04-25T02:07:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.047+0000 7f629a7fc640 1 -- 172.21.15.79:0/3124717613 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f629002ae50 con 0x7f629c0cf7a0 2024-04-25T02:07:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.047+0000 7f629a7fc640 1 -- 172.21.15.79:0/3124717613 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6290032660 con 0x7f629c0cf7a0 2024-04-25T02:07:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.047+0000 7f62a1d7e640 1 -- 172.21.15.79:0/3124717613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f629c0cf7a0 msgr2=0x7f629c0b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.047+0000 7f62a1d7e640 1 --2- 172.21.15.79:0/3124717613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f629c0cf7a0 0x7f629c0b4b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f62900097a0 tx=0x7f629002a140 comp rx=0 tx=0).stop 2024-04-25T02:07:53.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.047+0000 7f62a1d7e640 1 -- 172.21.15.79:0/3124717613 shutdown_connections 2024-04-25T02:07:53.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.047+0000 7f62a1d7e640 1 --2- 172.21.15.79:0/3124717613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f629c0cf7a0 0x7f629c0b4b50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.047+0000 7f62a1d7e640 1 -- 172.21.15.79:0/3124717613 >> 172.21.15.79:0/3124717613 conn(0x7f629c0b1cd0 msgr2=0x7f629c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:53.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.047+0000 7f62a1d7e640 1 -- 172.21.15.79:0/3124717613 shutdown_connections 2024-04-25T02:07:53.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.047+0000 7f62a1d7e640 1 -- 172.21.15.79:0/3124717613 wait complete. 2024-04-25T02:07:53.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.048+0000 7f62a1d7e640 1 Processor -- start 2024-04-25T02:07:53.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.048+0000 7f62a1d7e640 1 -- start start 2024-04-25T02:07:53.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.049+0000 7f62a1d7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f629c06b2f0 0x7f629c0c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:53.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.049+0000 7f62a1d7e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f629c06e6b0 0x7f629c14d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:53.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.049+0000 7f62a1d7e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f629c0cf7a0 0x7f629c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:53.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.049+0000 7f62a1d7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f629c06d160 con 0x7f629c06b2f0 2024-04-25T02:07:53.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.049+0000 7f62a1d7e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f629c06cfe0 con 0x7f629c0cf7a0 2024-04-25T02:07:53.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.049+0000 7f62a1d7e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f629c15b9e0 con 0x7f629c06e6b0 2024-04-25T02:07:53.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.049+0000 7f629b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f629c06b2f0 0x7f629c0c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:53.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.049+0000 7f629b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f629c06b2f0 0x7f629c0c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47690/0 (socket says 172.21.15.79:47690) 2024-04-25T02:07:53.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.049+0000 7f629b7fe640 1 -- 172.21.15.79:0/966631562 learned_addr learned my addr 172.21.15.79:0/966631562 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:53.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.049+0000 7f629b7fe640 1 -- 172.21.15.79:0/966631562 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f629c06e6b0 msgr2=0x7f629c14d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:53.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.049+0000 7f629b7fe640 1 --2- 172.21.15.79:0/966631562 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f629c06e6b0 0x7f629c14d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.049+0000 7f629b7fe640 1 -- 172.21.15.79:0/966631562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f629c0cf7a0 msgr2=0x7f629c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:53.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.049+0000 7f629b7fe640 1 --2- 172.21.15.79:0/966631562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f629c0cf7a0 0x7f629c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.050+0000 7f629b7fe640 1 -- 172.21.15.79:0/966631562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629c0ae720 con 0x7f629c06b2f0 2024-04-25T02:07:53.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.050+0000 7f629b7fe640 1 --2- 172.21.15.79:0/966631562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f629c06b2f0 0x7f629c0c8f60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c410 tx=0x7f628c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:53.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.050+0000 7f6283fff640 1 -- 172.21.15.79:0/966631562 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c017070 con 0x7f629c06b2f0 2024-04-25T02:07:53.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.050+0000 7f6283fff640 1 -- 172.21.15.79:0/966631562 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f628c0035f0 con 0x7f629c06b2f0 2024-04-25T02:07:53.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.050+0000 7f62a1d7e640 1 -- 172.21.15.79:0/966631562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f629c0aea00 con 0x7f629c06b2f0 2024-04-25T02:07:53.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.050+0000 7f6283fff640 1 -- 172.21.15.79:0/966631562 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c003a20 con 0x7f629c06b2f0 2024-04-25T02:07:53.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.050+0000 7f62a1d7e640 1 -- 172.21.15.79:0/966631562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f629c0aefc0 con 0x7f629c06b2f0 2024-04-25T02:07:53.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.051+0000 7f62a1d7e640 1 -- 172.21.15.79:0/966631562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f629c0690a0 con 0x7f629c06b2f0 2024-04-25T02:07:53.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.051+0000 7f6283fff640 1 -- 172.21.15.79:0/966631562 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f628c01a070 con 0x7f629c06b2f0 2024-04-25T02:07:53.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.052+0000 7f6283fff640 1 --2- 172.21.15.79:0/966631562 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f628806be60 0x7f628806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:53.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.052+0000 7f6283fff640 1 -- 172.21.15.79:0/966631562 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f628c089ff0 con 0x7f629c06b2f0 2024-04-25T02:07:53.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.052+0000 7f629affd640 1 --2- 172.21.15.79:0/966631562 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f628806be60 0x7f628806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:53.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.052+0000 7f629affd640 1 --2- 172.21.15.79:0/966631562 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f628806be60 0x7f628806e320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6290034000 tx=0x7f629002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:53.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.056+0000 7f6283fff640 1 -- 172.21.15.79:0/966631562 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f628c058cf0 con 0x7f629c06b2f0 2024-04-25T02:07:53.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.229+0000 7f62a1d7e640 1 -- 172.21.15.79:0/966631562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f629c0cf4f0 con 0x7f629c06b2f0 2024-04-25T02:07:53.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.230+0000 7f6283fff640 1 -- 172.21.15.79:0/966631562 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f628c0010c0 con 0x7f629c06b2f0 2024-04-25T02:07:53.237 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:07:53.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.232+0000 7f62a1d7e640 1 -- 172.21.15.79:0/966631562 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f628806be60 msgr2=0x7f628806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:53.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.232+0000 7f62a1d7e640 1 --2- 172.21.15.79:0/966631562 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f628806be60 0x7f628806e320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6290034000 tx=0x7f629002c000 comp rx=0 tx=0).stop 2024-04-25T02:07:53.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.232+0000 7f62a1d7e640 1 -- 172.21.15.79:0/966631562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f629c06b2f0 msgr2=0x7f629c0c8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:53.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.232+0000 7f62a1d7e640 1 --2- 172.21.15.79:0/966631562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f629c06b2f0 0x7f629c0c8f60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c410 tx=0x7f628c00c8d0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.232+0000 7f62a1d7e640 1 -- 172.21.15.79:0/966631562 shutdown_connections 2024-04-25T02:07:53.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.232+0000 7f62a1d7e640 1 --2- 172.21.15.79:0/966631562 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f628806be60 0x7f628806e320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.232+0000 7f62a1d7e640 1 --2- 172.21.15.79:0/966631562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f629c0cf7a0 0x7f629c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.232+0000 7f62a1d7e640 1 --2- 172.21.15.79:0/966631562 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f629c06e6b0 0x7f629c14d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.232+0000 7f62a1d7e640 1 --2- 172.21.15.79:0/966631562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f629c06b2f0 0x7f629c0c8f60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.232+0000 7f62a1d7e640 1 -- 172.21.15.79:0/966631562 >> 172.21.15.79:0/966631562 conn(0x7f629c0b1cd0 msgr2=0x7f629c15b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:53.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.232+0000 7f62a1d7e640 1 -- 172.21.15.79:0/966631562 shutdown_connections 2024-04-25T02:07:53.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.232+0000 7f62a1d7e640 1 -- 172.21.15.79:0/966631562 wait complete. 2024-04-25T02:07:53.249 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:07:53.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.339+0000 7f5e5f5b6640 1 Processor -- start 2024-04-25T02:07:53.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.339+0000 7f5e5f5b6640 1 -- start start 2024-04-25T02:07:53.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.340+0000 7f5e5f5b6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5e58143bc0 0x7f5e5815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:53.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.340+0000 7f5e5f5b6640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5e580b3d40 0x7f5e5806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:53.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.340+0000 7f5e5f5b6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e5815fa40 con 0x7f5e5806df50 2024-04-25T02:07:53.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.340+0000 7f5e5f5b6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5e5806e8f0 con 0x7f5e58143bc0 2024-04-25T02:07:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.340+0000 7f5e5f5b6640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f5e58072cb0 con 0x7f5e580b3d40 2024-04-25T02:07:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.340+0000 7f5e5d352640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5e58143bc0 0x7f5e5815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.340+0000 7f5e5d352640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5e58143bc0 0x7f5e5815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47704/0 (socket says 172.21.15.79:47704) 2024-04-25T02:07:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.340+0000 7f5e5d352640 1 -- 172.21.15.79:0/1186280345 learned_addr learned my addr 172.21.15.79:0/1186280345 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.340+0000 7f5e5db53640 1 --2- 172.21.15.79:0/1186280345 >> v2:172.21.15.189:3300/0 conn(0x7f5e580b3d40 0x7f5e5806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.340+0000 7f5e5d352640 1 -- 172.21.15.79:0/1186280345 >> v2:172.21.15.189:3300/0 conn(0x7f5e580b3d40 msgr2=0x7f5e5806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.340+0000 7f5e5d352640 1 --2- 172.21.15.79:0/1186280345 >> v2:172.21.15.189:3300/0 conn(0x7f5e580b3d40 0x7f5e5806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.340+0000 7f5e5d352640 1 -- 172.21.15.79:0/1186280345 >> v1:172.21.15.189:6789/0 conn(0x7f5e5806df50 legacy=0x7f5e580b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.340+0000 7f5e5d352640 1 -- 172.21.15.79:0/1186280345 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e58071e00 con 0x7f5e58143bc0 2024-04-25T02:07:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.341+0000 7f5e5d352640 1 --2- 172.21.15.79:0/1186280345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e58143bc0 0x7f5e5815f500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e58144cd0 tx=0x7f5e5402c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5e4bf0ea21140c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.341+0000 7f5e4ffff640 1 -- 172.21.15.79:0/1186280345 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e54032710 con 0x7f5e58143bc0 2024-04-25T02:07:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.341+0000 7f5e4ffff640 1 -- 172.21.15.79:0/1186280345 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e540328b0 con 0x7f5e58143bc0 2024-04-25T02:07:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.341+0000 7f5e4ffff640 1 -- 172.21.15.79:0/1186280345 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e54032ca0 con 0x7f5e58143bc0 2024-04-25T02:07:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.341+0000 7f5e5f5b6640 1 -- 172.21.15.79:0/1186280345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e58143bc0 msgr2=0x7f5e5815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.341+0000 7f5e5f5b6640 1 --2- 172.21.15.79:0/1186280345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e58143bc0 0x7f5e5815f500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e58144cd0 tx=0x7f5e5402c850 comp rx=0 tx=0).stop 2024-04-25T02:07:53.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.341+0000 7f5e5f5b6640 1 -- 172.21.15.79:0/1186280345 shutdown_connections 2024-04-25T02:07:53.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.341+0000 7f5e5f5b6640 1 --2- 172.21.15.79:0/1186280345 >> v2:172.21.15.189:3300/0 conn(0x7f5e580b3d40 0x7f5e5806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.341+0000 7f5e5f5b6640 1 --2- 172.21.15.79:0/1186280345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e58143bc0 0x7f5e5815f500 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.341+0000 7f5e5f5b6640 1 -- 172.21.15.79:0/1186280345 >> 172.21.15.79:0/1186280345 conn(0x7f5e580cfc80 msgr2=0x7f5e580d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:53.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.341+0000 7f5e5f5b6640 1 -- 172.21.15.79:0/1186280345 shutdown_connections 2024-04-25T02:07:53.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.341+0000 7f5e5f5b6640 1 -- 172.21.15.79:0/1186280345 wait complete. 2024-04-25T02:07:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.343+0000 7f5e5f5b6640 1 Processor -- start 2024-04-25T02:07:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.343+0000 7f5e5f5b6640 1 -- start start 2024-04-25T02:07:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.343+0000 7f5e5f5b6640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e5806df50 0x7f5e58140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.343+0000 7f5e5f5b6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e580b3d40 0x7f5e580abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.343+0000 7f5e5f5b6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e58143bc0 0x7f5e5813f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.343+0000 7f5e5f5b6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5e58072660 con 0x7f5e58143bc0 2024-04-25T02:07:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.343+0000 7f5e5f5b6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5e58072380 con 0x7f5e580b3d40 2024-04-25T02:07:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.343+0000 7f5e5f5b6640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5e58072940 con 0x7f5e5806df50 2024-04-25T02:07:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.343+0000 7f5e5db53640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e58143bc0 0x7f5e5813f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.343+0000 7f5e5db53640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e58143bc0 0x7f5e5813f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47718/0 (socket says 172.21.15.79:47718) 2024-04-25T02:07:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.343+0000 7f5e5db53640 1 -- 172.21.15.79:0/1640093909 learned_addr learned my addr 172.21.15.79:0/1640093909 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.344+0000 7f5e5d352640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e5806df50 0x7f5e58140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.344+0000 7f5e5cb51640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e580b3d40 0x7f5e580abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.344+0000 7f5e5db53640 1 -- 172.21.15.79:0/1640093909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e5806df50 msgr2=0x7f5e58140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.344+0000 7f5e5db53640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e5806df50 0x7f5e58140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.344+0000 7f5e5db53640 1 -- 172.21.15.79:0/1640093909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e580b3d40 msgr2=0x7f5e580abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.344+0000 7f5e5db53640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e580b3d40 0x7f5e580abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.344+0000 7f5e5db53640 1 -- 172.21.15.79:0/1640093909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e58141400 con 0x7f5e58143bc0 2024-04-25T02:07:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.344+0000 7f5e5d352640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e5806df50 0x7f5e58140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:07:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.344+0000 7f5e5cb51640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e580b3d40 0x7f5e580abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:07:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.344+0000 7f5e5db53640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e58143bc0 0x7f5e5813f200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e50007d80 tx=0x7f5e5000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.344+0000 7f5e4dffb640 1 -- 172.21.15.79:0/1640093909 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e50014420 con 0x7f5e58143bc0 2024-04-25T02:07:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.344+0000 7f5e4dffb640 1 -- 172.21.15.79:0/1640093909 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e50019070 con 0x7f5e58143bc0 2024-04-25T02:07:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.344+0000 7f5e4dffb640 1 -- 172.21.15.79:0/1640093909 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e50014800 con 0x7f5e58143bc0 2024-04-25T02:07:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.344+0000 7f5e5f5b6640 1 -- 172.21.15.79:0/1640093909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e581416e0 con 0x7f5e58143bc0 2024-04-25T02:07:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.344+0000 7f5e5f5b6640 1 -- 172.21.15.79:0/1640093909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e58141120 con 0x7f5e58143bc0 2024-04-25T02:07:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.345+0000 7f5e5f5b6640 1 -- 172.21.15.79:0/1640093909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e580690a0 con 0x7f5e58143bc0 2024-04-25T02:07:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.346+0000 7f5e4dffb640 1 -- 172.21.15.79:0/1640093909 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e500149a0 con 0x7f5e58143bc0 2024-04-25T02:07:53.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.346+0000 7f5e4dffb640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e3c06be30 0x7f5e3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:53.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.346+0000 7f5e4dffb640 1 -- 172.21.15.79:0/1640093909 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f5e5008b2f0 con 0x7f5e58143bc0 2024-04-25T02:07:53.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.346+0000 7f5e5d352640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e3c06be30 0x7f5e3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:53.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.346+0000 7f5e5d352640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e3c06be30 0x7f5e3c06e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5e54037000 tx=0x7f5e54032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:53.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.350+0000 7f5e4dffb640 1 -- 172.21.15.79:0/1640093909 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5e5005a080 con 0x7f5e58143bc0 2024-04-25T02:07:53.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.556+0000 7f5e5f5b6640 1 -- 172.21.15.79:0/1640093909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e58071a40 con 0x7f5e58143bc0 2024-04-25T02:07:53.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.556+0000 7f5e4dffb640 1 -- 172.21.15.79:0/1640093909 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f5e50059980 con 0x7f5e58143bc0 2024-04-25T02:07:53.563 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:53.563 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2093278785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2093278785},{"type":"v1","addr":"172.21.15.79:6836","nonce":2093278785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T02:07:53.563 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 2 2024-04-25T02:07:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.558+0000 7f5e5f5b6640 1 -- 172.21.15.79:0/1640093909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e3c06be30 msgr2=0x7f5e3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.558+0000 7f5e5f5b6640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e3c06be30 0x7f5e3c06e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5e54037000 tx=0x7f5e54032000 comp rx=0 tx=0).stop 2024-04-25T02:07:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.558+0000 7f5e5f5b6640 1 -- 172.21.15.79:0/1640093909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e58143bc0 msgr2=0x7f5e5813f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.558+0000 7f5e5f5b6640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e58143bc0 0x7f5e5813f200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e50007d80 tx=0x7f5e5000e4b0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.558+0000 7f5e5f5b6640 1 -- 172.21.15.79:0/1640093909 shutdown_connections 2024-04-25T02:07:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.558+0000 7f5e5f5b6640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e3c06be30 0x7f5e3c06e2f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.558+0000 7f5e5f5b6640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e58143bc0 0x7f5e5813f200 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.558+0000 7f5e5f5b6640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e580b3d40 0x7f5e580abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.558+0000 7f5e5f5b6640 1 --2- 172.21.15.79:0/1640093909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e5806df50 0x7f5e58140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.558+0000 7f5e5f5b6640 1 -- 172.21.15.79:0/1640093909 >> 172.21.15.79:0/1640093909 conn(0x7f5e580cfc80 msgr2=0x7f5e580cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.558+0000 7f5e5f5b6640 1 -- 172.21.15.79:0/1640093909 shutdown_connections 2024-04-25T02:07:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:53.558+0000 7f5e5f5b6640 1 -- 172.21.15.79:0/1640093909 wait complete. 2024-04-25T02:07:55.576 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:07:55.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.676+0000 7f4d52c88640 1 Processor -- start 2024-04-25T02:07:55.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.677+0000 7f4d52c88640 1 -- start start 2024-04-25T02:07:55.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.677+0000 7f4d52c88640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d4c0b24d0 0x7f4d4c0b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:55.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.677+0000 7f4d52c88640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f4d4c0b2b80 0x7f4d4c0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:55.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.677+0000 7f4d52c88640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d4c0cefc0 con 0x7f4d4c0cebb0 2024-04-25T02:07:55.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.677+0000 7f4d52c88640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4d4c0d29b0 con 0x7f4d4c0b24d0 2024-04-25T02:07:55.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.677+0000 7f4d52c88640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f4d4c0d2c90 con 0x7f4d4c0b2b80 2024-04-25T02:07:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.677+0000 7f4d50a24640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d4c0b24d0 0x7f4d4c0b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.677+0000 7f4d50a24640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d4c0b24d0 0x7f4d4c0b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51646/0 (socket says 172.21.15.79:51646) 2024-04-25T02:07:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.677+0000 7f4d50a24640 1 -- 172.21.15.79:0/3879564599 learned_addr learned my addr 172.21.15.79:0/3879564599 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.678+0000 7f4d4bfff640 1 --2- 172.21.15.79:0/3879564599 >> v2:172.21.15.189:3300/0 conn(0x7f4d4c0b2b80 0x7f4d4c0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.678+0000 7f4d50a24640 1 -- 172.21.15.79:0/3879564599 >> v2:172.21.15.189:3300/0 conn(0x7f4d4c0b2b80 msgr2=0x7f4d4c0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.678+0000 7f4d50a24640 1 --2- 172.21.15.79:0/3879564599 >> v2:172.21.15.189:3300/0 conn(0x7f4d4c0b2b80 0x7f4d4c0ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.678+0000 7f4d50a24640 1 -- 172.21.15.79:0/3879564599 >> v1:172.21.15.189:6789/0 conn(0x7f4d4c0cebb0 legacy=0x7f4d4c06c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.678+0000 7f4d50a24640 1 -- 172.21.15.79:0/3879564599 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4c0d0b80 con 0x7f4d4c0b24d0 2024-04-25T02:07:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.678+0000 7f4d4bfff640 1 --2- 172.21.15.79:0/3879564599 >> v2:172.21.15.189:3300/0 conn(0x7f4d4c0b2b80 0x7f4d4c0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:07:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.678+0000 7f4d50a24640 1 --2- 172.21.15.79:0/3879564599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d4c0b24d0 0x7f4d4c0b30b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0733c0 tx=0x7f4d3402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09b1df44d2d3676 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.679+0000 7f4d4b7fe640 1 -- 172.21.15.79:0/3879564599 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34037070 con 0x7f4d4c0b24d0 2024-04-25T02:07:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.679+0000 7f4d4b7fe640 1 -- 172.21.15.79:0/3879564599 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d34032440 con 0x7f4d4c0b24d0 2024-04-25T02:07:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.679+0000 7f4d4b7fe640 1 -- 172.21.15.79:0/3879564599 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34032810 con 0x7f4d4c0b24d0 2024-04-25T02:07:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.679+0000 7f4d52c88640 1 -- 172.21.15.79:0/3879564599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d4c0b24d0 msgr2=0x7f4d4c0b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:55.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.679+0000 7f4d52c88640 1 --2- 172.21.15.79:0/3879564599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d4c0b24d0 0x7f4d4c0b30b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0733c0 tx=0x7f4d3402a1a0 comp rx=0 tx=0).stop 2024-04-25T02:07:55.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.679+0000 7f4d52c88640 1 -- 172.21.15.79:0/3879564599 shutdown_connections 2024-04-25T02:07:55.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.679+0000 7f4d52c88640 1 --2- 172.21.15.79:0/3879564599 >> v2:172.21.15.189:3300/0 conn(0x7f4d4c0b2b80 0x7f4d4c0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:55.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.679+0000 7f4d52c88640 1 --2- 172.21.15.79:0/3879564599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d4c0b24d0 0x7f4d4c0b30b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:55.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.679+0000 7f4d52c88640 1 -- 172.21.15.79:0/3879564599 >> 172.21.15.79:0/3879564599 conn(0x7f4d4c0d1df0 msgr2=0x7f4d4c0d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:55.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.679+0000 7f4d52c88640 1 -- 172.21.15.79:0/3879564599 shutdown_connections 2024-04-25T02:07:55.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.679+0000 7f4d52c88640 1 -- 172.21.15.79:0/3879564599 wait complete. 2024-04-25T02:07:55.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.680+0000 7f4d52c88640 1 Processor -- start 2024-04-25T02:07:55.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.681+0000 7f4d52c88640 1 -- start start 2024-04-25T02:07:55.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.681+0000 7f4d52c88640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d4c0b24d0 0x7f4d4c0cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:55.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.681+0000 7f4d52c88640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4d4c0b2b80 0x7f4d4c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:55.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.681+0000 7f4d52c88640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d4c0cebb0 0x7f4d4c0b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.681+0000 7f4d52c88640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c0b28b0 con 0x7f4d4c0cebb0 2024-04-25T02:07:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.681+0000 7f4d52c88640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c0d1140 con 0x7f4d4c0b24d0 2024-04-25T02:07:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.681+0000 7f4d52c88640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4d4c0cf5f0 con 0x7f4d4c0b2b80 2024-04-25T02:07:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d51225640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d4c0cebb0 0x7f4d4c0b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d51225640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d4c0cebb0 0x7f4d4c0b03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51660/0 (socket says 172.21.15.79:51660) 2024-04-25T02:07:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d51225640 1 -- 172.21.15.79:0/1105100728 learned_addr learned my addr 172.21.15.79:0/1105100728 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d50a24640 1 --2- 172.21.15.79:0/1105100728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d4c0b24d0 0x7f4d4c0cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d4bfff640 1 --2- 172.21.15.79:0/1105100728 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4d4c0b2b80 0x7f4d4c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d51225640 1 -- 172.21.15.79:0/1105100728 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4d4c0b2b80 msgr2=0x7f4d4c0b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d51225640 1 --2- 172.21.15.79:0/1105100728 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4d4c0b2b80 0x7f4d4c0b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d51225640 1 -- 172.21.15.79:0/1105100728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d4c0b24d0 msgr2=0x7f4d4c0cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d51225640 1 --2- 172.21.15.79:0/1105100728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d4c0b24d0 0x7f4d4c0cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d51225640 1 -- 172.21.15.79:0/1105100728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4c0ca910 con 0x7f4d4c0cebb0 2024-04-25T02:07:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d51225640 1 --2- 172.21.15.79:0/1105100728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d4c0cebb0 0x7f4d4c0b03a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c410 tx=0x7f4d4400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d497fa640 1 -- 172.21.15.79:0/1105100728 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44011790 con 0x7f4d4c0cebb0 2024-04-25T02:07:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d497fa640 1 -- 172.21.15.79:0/1105100728 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d44017070 con 0x7f4d4c0cebb0 2024-04-25T02:07:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d52c88640 1 -- 172.21.15.79:0/1105100728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d4c0cabf0 con 0x7f4d4c0cebb0 2024-04-25T02:07:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d497fa640 1 -- 172.21.15.79:0/1105100728 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44011bb0 con 0x7f4d4c0cebb0 2024-04-25T02:07:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.682+0000 7f4d52c88640 1 -- 172.21.15.79:0/1105100728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d4c0cb490 con 0x7f4d4c0cebb0 2024-04-25T02:07:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.683+0000 7f4d52c88640 1 -- 172.21.15.79:0/1105100728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d4c0cb690 con 0x7f4d4c0cebb0 2024-04-25T02:07:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.684+0000 7f4d497fa640 1 -- 172.21.15.79:0/1105100728 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d4401c460 con 0x7f4d4c0cebb0 2024-04-25T02:07:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.684+0000 7f4d497fa640 1 --2- 172.21.15.79:0/1105100728 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d2c06be30 0x7f4d2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.684+0000 7f4d497fa640 1 -- 172.21.15.79:0/1105100728 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4d4408a5d0 con 0x7f4d4c0cebb0 2024-04-25T02:07:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.684+0000 7f4d50a24640 1 --2- 172.21.15.79:0/1105100728 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d2c06be30 0x7f4d2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.685+0000 7f4d50a24640 1 --2- 172.21.15.79:0/1105100728 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d2c06be30 0x7f4d2c06e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4d34034000 tx=0x7f4d3402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:55.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.689+0000 7f4d497fa640 1 -- 172.21.15.79:0/1105100728 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4d4c0cb690 con 0x7f4d4c0cebb0 2024-04-25T02:07:55.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.903+0000 7f4d52c88640 1 -- 172.21.15.79:0/1105100728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d4c0690a0 con 0x7f4d4c0cebb0 2024-04-25T02:07:55.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.903+0000 7f4d497fa640 1 -- 172.21.15.79:0/1105100728 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3867 (secure 0 0 0) 0x7f4d44021020 con 0x7f4d4c0cebb0 2024-04-25T02:07:55.911 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:55.911 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/465663373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":465663373},{"type":"v1","addr":"172.21.15.189:6833","nonce":465663373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2093278785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2093278785},{"type":"v1","addr":"172.21.15.79:6836","nonce":2093278785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2415912880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2415912880},{"type":"v1","addr":"172.21.15.189:6835","nonce":2415912880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2942986974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2942986974},{"type":"v1","addr":"172.21.15.79:6837","nonce":2942986974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T02:07:55.912 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 3 2024-04-25T02:07:55.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.905+0000 7f4d52c88640 1 -- 172.21.15.79:0/1105100728 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d2c06be30 msgr2=0x7f4d2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:55.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.905+0000 7f4d52c88640 1 --2- 172.21.15.79:0/1105100728 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d2c06be30 0x7f4d2c06e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4d34034000 tx=0x7f4d3402e000 comp rx=0 tx=0).stop 2024-04-25T02:07:55.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.905+0000 7f4d52c88640 1 -- 172.21.15.79:0/1105100728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d4c0cebb0 msgr2=0x7f4d4c0b03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:55.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.905+0000 7f4d52c88640 1 --2- 172.21.15.79:0/1105100728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d4c0cebb0 0x7f4d4c0b03a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c410 tx=0x7f4d4400c8d0 comp rx=0 tx=0).stop 2024-04-25T02:07:55.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.905+0000 7f4d52c88640 1 -- 172.21.15.79:0/1105100728 shutdown_connections 2024-04-25T02:07:55.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.905+0000 7f4d52c88640 1 --2- 172.21.15.79:0/1105100728 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d2c06be30 0x7f4d2c06e2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:55.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.905+0000 7f4d52c88640 1 --2- 172.21.15.79:0/1105100728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d4c0cebb0 0x7f4d4c0b03a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:55.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.905+0000 7f4d52c88640 1 --2- 172.21.15.79:0/1105100728 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4d4c0b2b80 0x7f4d4c0b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:55.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.905+0000 7f4d52c88640 1 --2- 172.21.15.79:0/1105100728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d4c0b24d0 0x7f4d4c0cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:55.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.905+0000 7f4d52c88640 1 -- 172.21.15.79:0/1105100728 >> 172.21.15.79:0/1105100728 conn(0x7f4d4c0d1df0 msgr2=0x7f4d4c0cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:55.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.905+0000 7f4d52c88640 1 -- 172.21.15.79:0/1105100728 shutdown_connections 2024-04-25T02:07:55.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:55.905+0000 7f4d52c88640 1 -- 172.21.15.79:0/1105100728 wait complete. 2024-04-25T02:07:55.924 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:07:56.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.012+0000 7ff1f9c4d640 1 Processor -- start 2024-04-25T02:07:56.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.012+0000 7ff1f9c4d640 1 -- start start 2024-04-25T02:07:56.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.013+0000 7ff1f9c4d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1f415e440 0x7ff1f40d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.013+0000 7ff1f9c4d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1f40cf7a0 0x7ff1f40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.013+0000 7ff1f9c4d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1f40cfdc0 con 0x7ff1f40d4570 2024-04-25T02:07:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.013+0000 7ff1f9c4d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff1f40d49b0 con 0x7ff1f40cf7a0 2024-04-25T02:07:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.013+0000 7ff1f9c4d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f40d00a0 con 0x7ff1f415e440 2024-04-25T02:07:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.013+0000 7ff1f3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1f40cf7a0 0x7ff1f40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.013+0000 7ff1f2ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff1f40d4570 0x7ff1f40cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47516/0 (socket says 172.21.15.79:47516) 2024-04-25T02:07:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.013+0000 7ff1f2ffd640 1 -- 172.21.15.79:0/1059775278 learned_addr learned my addr 172.21.15.79:0/1059775278 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:07:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.013+0000 7ff1f37fe640 1 --2- 172.21.15.79:0/1059775278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1f415e440 0x7ff1f40d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.013+0000 7ff1f3fff640 1 -- 172.21.15.79:0/1059775278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1f415e440 msgr2=0x7ff1f40d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.013+0000 7ff1f3fff640 1 --2- 172.21.15.79:0/1059775278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1f415e440 0x7ff1f40d4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.013+0000 7ff1f3fff640 1 -- 172.21.15.79:0/1059775278 >> v1:172.21.15.79:6789/0 conn(0x7ff1f40d4570 legacy=0x7ff1f40cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.013+0000 7ff1f3fff640 1 -- 172.21.15.79:0/1059775278 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f40d0380 con 0x7ff1f40cf7a0 2024-04-25T02:07:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.014+0000 7ff1f3fff640 1 --2- 172.21.15.79:0/1059775278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1f40cf7a0 0x7ff1f40b3940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec009d90 tx=0x7ff1ec02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd1c0696017f92f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.014+0000 7ff1f27fc640 1 -- 172.21.15.79:0/1059775278 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec007740 con 0x7ff1f40cf7a0 2024-04-25T02:07:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.014+0000 7ff1f27fc640 1 -- 172.21.15.79:0/1059775278 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ec0078e0 con 0x7ff1f40cf7a0 2024-04-25T02:07:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.014+0000 7ff1f27fc640 1 -- 172.21.15.79:0/1059775278 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec007cb0 con 0x7ff1f40cf7a0 2024-04-25T02:07:56.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.014+0000 7ff1f9c4d640 1 -- 172.21.15.79:0/1059775278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1f40cf7a0 msgr2=0x7ff1f40b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.014+0000 7ff1f9c4d640 1 --2- 172.21.15.79:0/1059775278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1f40cf7a0 0x7ff1f40b3940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec009d90 tx=0x7ff1ec02a660 comp rx=0 tx=0).stop 2024-04-25T02:07:56.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.014+0000 7ff1f9c4d640 1 -- 172.21.15.79:0/1059775278 shutdown_connections 2024-04-25T02:07:56.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.014+0000 7ff1f9c4d640 1 --2- 172.21.15.79:0/1059775278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1f40cf7a0 0x7ff1f40b3940 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.014+0000 7ff1f9c4d640 1 --2- 172.21.15.79:0/1059775278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1f415e440 0x7ff1f40d4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.015+0000 7ff1f9c4d640 1 -- 172.21.15.79:0/1059775278 >> 172.21.15.79:0/1059775278 conn(0x7ff1f408db50 msgr2=0x7ff1f409d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:56.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.015+0000 7ff1f9c4d640 1 -- 172.21.15.79:0/1059775278 shutdown_connections 2024-04-25T02:07:56.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.015+0000 7ff1f9c4d640 1 -- 172.21.15.79:0/1059775278 wait complete. 2024-04-25T02:07:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.016+0000 7ff1f9c4d640 1 Processor -- start 2024-04-25T02:07:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.016+0000 7ff1f9c4d640 1 -- start start 2024-04-25T02:07:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.016+0000 7ff1f9c4d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1f40cf7a0 0x7ff1f41613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.016+0000 7ff1f9c4d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1f40d4570 0x7ff1f414e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.016+0000 7ff1f9c4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1f415e440 0x7ff1f40b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.016+0000 7ff1f9c4d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f40b3e80 con 0x7ff1f415e440 2024-04-25T02:07:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.016+0000 7ff1f9c4d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f415e820 con 0x7ff1f40d4570 2024-04-25T02:07:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.016+0000 7ff1f9c4d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f40b4000 con 0x7ff1f40cf7a0 2024-04-25T02:07:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1f3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1f415e440 0x7ff1f40b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1f3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1f415e440 0x7ff1f40b8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51672/0 (socket says 172.21.15.79:51672) 2024-04-25T02:07:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1f3fff640 1 -- 172.21.15.79:0/211062551 learned_addr learned my addr 172.21.15.79:0/211062551 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1f2ffd640 1 --2- 172.21.15.79:0/211062551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1f40d4570 0x7ff1f414e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1f37fe640 1 --2- 172.21.15.79:0/211062551 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1f40cf7a0 0x7ff1f41613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1f3fff640 1 -- 172.21.15.79:0/211062551 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1f40cf7a0 msgr2=0x7ff1f41613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1f3fff640 1 --2- 172.21.15.79:0/211062551 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1f40cf7a0 0x7ff1f41613e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1f3fff640 1 -- 172.21.15.79:0/211062551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1f40d4570 msgr2=0x7ff1f414e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1f3fff640 1 --2- 172.21.15.79:0/211062551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1f40d4570 0x7ff1f414e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1f3fff640 1 -- 172.21.15.79:0/211062551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f40b7e40 con 0x7ff1f415e440 2024-04-25T02:07:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1f3fff640 1 --2- 172.21.15.79:0/211062551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1f415e440 0x7ff1f40b8ec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec009eb0 tx=0x7ff1ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1dbfff640 1 -- 172.21.15.79:0/211062551 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec040070 con 0x7ff1f415e440 2024-04-25T02:07:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1dbfff640 1 -- 172.21.15.79:0/211062551 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ec031bc0 con 0x7ff1f415e440 2024-04-25T02:07:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1f9c4d640 1 -- 172.21.15.79:0/211062551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f40b8100 con 0x7ff1f415e440 2024-04-25T02:07:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1dbfff640 1 -- 172.21.15.79:0/211062551 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec045460 con 0x7ff1f415e440 2024-04-25T02:07:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.017+0000 7ff1f9c4d640 1 -- 172.21.15.79:0/211062551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f40b86c0 con 0x7ff1f415e440 2024-04-25T02:07:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.018+0000 7ff1f9c4d640 1 -- 172.21.15.79:0/211062551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1f40690a0 con 0x7ff1f415e440 2024-04-25T02:07:56.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.019+0000 7ff1dbfff640 1 -- 172.21.15.79:0/211062551 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1ec039040 con 0x7ff1f415e440 2024-04-25T02:07:56.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.019+0000 7ff1dbfff640 1 --2- 172.21.15.79:0/211062551 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1e006be30 0x7ff1e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.019+0000 7ff1dbfff640 1 -- 172.21.15.79:0/211062551 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7ff1ec0ac3b0 con 0x7ff1f415e440 2024-04-25T02:07:56.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.019+0000 7ff1f37fe640 1 --2- 172.21.15.79:0/211062551 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1e006be30 0x7ff1e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.019+0000 7ff1f37fe640 1 --2- 172.21.15.79:0/211062551 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1e006be30 0x7ff1e006e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4006fd0 tx=0x7ff1e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:56.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.023+0000 7ff1dbfff640 1 -- 172.21.15.79:0/211062551 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff1ec043360 con 0x7ff1f415e440 2024-04-25T02:07:56.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.198+0000 7ff1f9c4d640 1 -- 172.21.15.79:0/211062551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1f40d2460 con 0x7ff1f415e440 2024-04-25T02:07:56.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.199+0000 7ff1dbfff640 1 -- 172.21.15.79:0/211062551 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12896 (secure 0 0 0) 0x7ff1ec07b140 con 0x7ff1f415e440 2024-04-25T02:07:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:56.207 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":17,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:07:50.059679+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:07:56.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.201+0000 7ff1f9c4d640 1 -- 172.21.15.79:0/211062551 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1e006be30 msgr2=0x7ff1e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.201+0000 7ff1f9c4d640 1 --2- 172.21.15.79:0/211062551 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1e006be30 0x7ff1e006e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4006fd0 tx=0x7ff1e4008040 comp rx=0 tx=0).stop 2024-04-25T02:07:56.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.201+0000 7ff1f9c4d640 1 -- 172.21.15.79:0/211062551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1f415e440 msgr2=0x7ff1f40b8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.201+0000 7ff1f9c4d640 1 --2- 172.21.15.79:0/211062551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1f415e440 0x7ff1f40b8ec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec009eb0 tx=0x7ff1ec004a40 comp rx=0 tx=0).stop 2024-04-25T02:07:56.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.201+0000 7ff1f9c4d640 1 -- 172.21.15.79:0/211062551 shutdown_connections 2024-04-25T02:07:56.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.201+0000 7ff1f9c4d640 1 --2- 172.21.15.79:0/211062551 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1e006be30 0x7ff1e006e2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.201+0000 7ff1f9c4d640 1 --2- 172.21.15.79:0/211062551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1f415e440 0x7ff1f40b8ec0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.201+0000 7ff1f9c4d640 1 --2- 172.21.15.79:0/211062551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1f40d4570 0x7ff1f414e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.201+0000 7ff1f9c4d640 1 --2- 172.21.15.79:0/211062551 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1f40cf7a0 0x7ff1f41613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.201+0000 7ff1f9c4d640 1 -- 172.21.15.79:0/211062551 >> 172.21.15.79:0/211062551 conn(0x7ff1f408db50 msgr2=0x7ff1f406c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:56.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.202+0000 7ff1f9c4d640 1 -- 172.21.15.79:0/211062551 shutdown_connections 2024-04-25T02:07:56.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.202+0000 7ff1f9c4d640 1 -- 172.21.15.79:0/211062551 wait complete. 2024-04-25T02:07:56.221 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:07:56.221 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:07:56.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.312+0000 7fd72015a640 1 Processor -- start 2024-04-25T02:07:56.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.313+0000 7fd72015a640 1 -- start start 2024-04-25T02:07:56.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.313+0000 7fd72015a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd71806fe20 0x7fd71815e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.313+0000 7fd72015a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd71806dc90 0x7fd7180ae370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.313+0000 7fd72015a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd71815ed80 con 0x7fd7180b0320 2024-04-25T02:07:56.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.313+0000 7fd72015a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd71815f060 con 0x7fd71806dc90 2024-04-25T02:07:56.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.313+0000 7fd72015a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd71815f340 con 0x7fd71806fe20 2024-04-25T02:07:56.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71d6f5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd7180b0320 0x7fd718070200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47532/0 (socket says 172.21.15.79:47532) 2024-04-25T02:07:56.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71d6f5640 1 -- 172.21.15.79:0/4188641860 learned_addr learned my addr 172.21.15.79:0/4188641860 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:07:56.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 -- 172.21.15.79:0/4188641860 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3939664107 0 0) 0x7fd71815ed80 con 0x7fd7180b0320 2024-04-25T02:07:56.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 -- 172.21.15.79:0/4188641860 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd704003520 con 0x7fd7180b0320 2024-04-25T02:07:56.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71def6640 1 --2- 172.21.15.79:0/4188641860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd71806fe20 0x7fd71815e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71e6f7640 1 --2- 172.21.15.79:0/4188641860 >> v2:172.21.15.189:3300/0 conn(0x7fd71806dc90 0x7fd7180ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 -- 172.21.15.79:0/4188641860 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3794445824 0 0) 0x7fd704003520 con 0x7fd7180b0320 2024-04-25T02:07:56.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 -- 172.21.15.79:0/4188641860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd71806fe20 msgr2=0x7fd71815e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:56.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 --2- 172.21.15.79:0/4188641860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd71806fe20 0x7fd71815e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 -- 172.21.15.79:0/4188641860 >> v2:172.21.15.189:3300/0 conn(0x7fd71806dc90 msgr2=0x7fd7180ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:56.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 --2- 172.21.15.79:0/4188641860 >> v2:172.21.15.189:3300/0 conn(0x7fd71806dc90 0x7fd7180ae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 -- 172.21.15.79:0/4188641860 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7180ade50 con 0x7fd7180b0320 2024-04-25T02:07:56.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 -- 172.21.15.79:0/4188641860 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fd714001670 con 0x7fd7180b0320 2024-04-25T02:07:56.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 -- 172.21.15.79:0/4188641860 >> v1:172.21.15.79:6789/0 conn(0x7fd7180b0320 legacy=0x7fd718070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 --2- 172.21.15.79:0/4188641860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd71806fe20 0x7fd7040039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 --2- 172.21.15.79:0/4188641860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd704003f30 0x7fd704004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 --2- 172.21.15.79:0/4188641860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd704004d40 0x7fd7040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 -- 172.21.15.79:0/4188641860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd71815f060 con 0x7fd704004d40 2024-04-25T02:07:56.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 -- 172.21.15.79:0/4188641860 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd71815f340 con 0x7fd704003f30 2024-04-25T02:07:56.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71cef4640 1 -- 172.21.15.79:0/4188641860 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd70400b9c0 con 0x7fd71806fe20 2024-04-25T02:07:56.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71e6f7640 1 --2- 172.21.15.79:0/4188641860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd704004d40 0x7fd7040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71def6640 1 --2- 172.21.15.79:0/4188641860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd71806fe20 0x7fd7040039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71d6f5640 1 --2- 172.21.15.79:0/4188641860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd704003f30 0x7fd704004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71e6f7640 1 -- 172.21.15.79:0/4188641860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd71806fe20 msgr2=0x7fd7040039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:56.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71e6f7640 1 --2- 172.21.15.79:0/4188641860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd71806fe20 0x7fd7040039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71e6f7640 1 -- 172.21.15.79:0/4188641860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd704003f30 msgr2=0x7fd704004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:56.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71e6f7640 1 --2- 172.21.15.79:0/4188641860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd704003f30 0x7fd704004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.314+0000 7fd71e6f7640 1 -- 172.21.15.79:0/4188641860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd704003520 con 0x7fd704004d40 2024-04-25T02:07:56.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.315+0000 7fd71e6f7640 1 --2- 172.21.15.79:0/4188641860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd704004d40 0x7fd7040051c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd710009fc0 tx=0x7fd704005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e210ec7c0201560 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:56.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.315+0000 7fd71cef4640 1 -- 172.21.15.79:0/4188641860 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd710009c10 con 0x7fd704004d40 2024-04-25T02:07:56.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.315+0000 7fd71cef4640 1 -- 172.21.15.79:0/4188641860 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd710036070 con 0x7fd704004d40 2024-04-25T02:07:56.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.315+0000 7fd71cef4640 1 -- 172.21.15.79:0/4188641860 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71002d070 con 0x7fd704004d40 2024-04-25T02:07:56.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.316+0000 7fd72015a640 1 -- 172.21.15.79:0/4188641860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd704004d40 msgr2=0x7fd7040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.316+0000 7fd72015a640 1 --2- 172.21.15.79:0/4188641860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd704004d40 0x7fd7040051c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd710009fc0 tx=0x7fd704005830 comp rx=0 tx=0).stop 2024-04-25T02:07:56.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.316+0000 7fd71e6f7640 1 -- 172.21.15.79:0/4188641860 reap_dead start 2024-04-25T02:07:56.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.316+0000 7fd72015a640 1 -- 172.21.15.79:0/4188641860 shutdown_connections 2024-04-25T02:07:56.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.316+0000 7fd72015a640 1 -- 172.21.15.79:0/4188641860 >> 172.21.15.79:0/4188641860 conn(0x7fd7180d0e00 msgr2=0x7fd7180d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:56.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.316+0000 7fd72015a640 1 -- 172.21.15.79:0/4188641860 shutdown_connections 2024-04-25T02:07:56.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.316+0000 7fd72015a640 1 -- 172.21.15.79:0/4188641860 wait complete. 2024-04-25T02:07:56.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.317+0000 7fd72015a640 1 Processor -- start 2024-04-25T02:07:56.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.317+0000 7fd72015a640 1 -- start start 2024-04-25T02:07:56.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd72015a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd704004d40 0x7fd718155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd72015a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7181e45d0 0x7fd718146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd72015a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7181f4200 0x7fd7181f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd72015a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7180d1b50 con 0x7fd7181e45d0 2024-04-25T02:07:56.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd72015a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd7180d19d0 con 0x7fd7181f4200 2024-04-25T02:07:56.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd72015a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd71815bf80 con 0x7fd704004d40 2024-04-25T02:07:56.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd71d6f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7181e45d0 0x7fd718146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd71d6f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7181e45d0 0x7fd718146870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51688/0 (socket says 172.21.15.79:51688) 2024-04-25T02:07:56.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd71d6f5640 1 -- 172.21.15.79:0/1875278756 learned_addr learned my addr 172.21.15.79:0/1875278756 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:56.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd71def6640 1 --2- 172.21.15.79:0/1875278756 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd704004d40 0x7fd718155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd71d6f5640 1 -- 172.21.15.79:0/1875278756 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd704004d40 msgr2=0x7fd718155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd71d6f5640 1 --2- 172.21.15.79:0/1875278756 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd704004d40 0x7fd718155b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd71d6f5640 1 -- 172.21.15.79:0/1875278756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7181f4200 msgr2=0x7fd7181f4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd71d6f5640 1 --2- 172.21.15.79:0/1875278756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7181f4200 0x7fd7181f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd71d6f5640 1 -- 172.21.15.79:0/1875278756 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7181f4bc0 con 0x7fd7181e45d0 2024-04-25T02:07:56.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd71d6f5640 1 --2- 172.21.15.79:0/1875278756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7181e45d0 0x7fd718146870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7140017e0 tx=0x7fd7140077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:56.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd70e7fc640 1 -- 172.21.15.79:0/1875278756 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71400f940 con 0x7fd7181e45d0 2024-04-25T02:07:56.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd70e7fc640 1 -- 172.21.15.79:0/1875278756 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd714018070 con 0x7fd7181e45d0 2024-04-25T02:07:56.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd70e7fc640 1 -- 172.21.15.79:0/1875278756 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71400fd60 con 0x7fd7181e45d0 2024-04-25T02:07:56.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd72015a640 1 -- 172.21.15.79:0/1875278756 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7181562c0 con 0x7fd7181e45d0 2024-04-25T02:07:56.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.318+0000 7fd72015a640 1 -- 172.21.15.79:0/1875278756 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd718156880 con 0x7fd7181e45d0 2024-04-25T02:07:56.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.319+0000 7fd72015a640 1 -- 172.21.15.79:0/1875278756 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7180690a0 con 0x7fd7181e45d0 2024-04-25T02:07:56.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.320+0000 7fd70e7fc640 1 -- 172.21.15.79:0/1875278756 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd71401c410 con 0x7fd7181e45d0 2024-04-25T02:07:56.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.320+0000 7fd70e7fc640 1 --2- 172.21.15.79:0/1875278756 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd6fc06be60 0x7fd6fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.320+0000 7fd70e7fc640 1 -- 172.21.15.79:0/1875278756 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd71408a7f0 con 0x7fd7181e45d0 2024-04-25T02:07:56.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.320+0000 7fd71def6640 1 --2- 172.21.15.79:0/1875278756 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd6fc06be60 0x7fd6fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.321+0000 7fd71def6640 1 --2- 172.21.15.79:0/1875278756 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd6fc06be60 0x7fd6fc06e320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd7080099e0 tx=0x7fd708008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:56.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.325+0000 7fd70e7fc640 1 -- 172.21.15.79:0/1875278756 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd7181f4bc0 con 0x7fd7181e45d0 2024-04-25T02:07:56.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.497+0000 7fd72015a640 1 -- 172.21.15.79:0/1875278756 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd71815e130 con 0x7fd7181e45d0 2024-04-25T02:07:56.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.498+0000 7fd70e7fc640 1 -- 172.21.15.79:0/1875278756 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7fd7140594f0 con 0x7fd7181e45d0 2024-04-25T02:07:56.506 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:07:56.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.500+0000 7fd72015a640 1 -- 172.21.15.79:0/1875278756 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd6fc06be60 msgr2=0x7fd6fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.500+0000 7fd72015a640 1 --2- 172.21.15.79:0/1875278756 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd6fc06be60 0x7fd6fc06e320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd7080099e0 tx=0x7fd708008040 comp rx=0 tx=0).stop 2024-04-25T02:07:56.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.500+0000 7fd72015a640 1 -- 172.21.15.79:0/1875278756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7181e45d0 msgr2=0x7fd718146870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.500+0000 7fd72015a640 1 --2- 172.21.15.79:0/1875278756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7181e45d0 0x7fd718146870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7140017e0 tx=0x7fd7140077a0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.500+0000 7fd72015a640 1 -- 172.21.15.79:0/1875278756 shutdown_connections 2024-04-25T02:07:56.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.500+0000 7fd72015a640 1 --2- 172.21.15.79:0/1875278756 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd6fc06be60 0x7fd6fc06e320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.500+0000 7fd72015a640 1 --2- 172.21.15.79:0/1875278756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7181f4200 0x7fd7181f4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.500+0000 7fd72015a640 1 --2- 172.21.15.79:0/1875278756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7181e45d0 0x7fd718146870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.500+0000 7fd72015a640 1 --2- 172.21.15.79:0/1875278756 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd704004d40 0x7fd718155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.500+0000 7fd72015a640 1 -- 172.21.15.79:0/1875278756 >> 172.21.15.79:0/1875278756 conn(0x7fd7180d0e00 msgr2=0x7fd71806efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:56.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.500+0000 7fd72015a640 1 -- 172.21.15.79:0/1875278756 shutdown_connections 2024-04-25T02:07:56.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.500+0000 7fd72015a640 1 -- 172.21.15.79:0/1875278756 wait complete. 2024-04-25T02:07:56.519 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T02:07:56.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.608+0000 7fbf4331b640 1 Processor -- start 2024-04-25T02:07:56.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.608+0000 7fbf4331b640 1 -- start start 2024-04-25T02:07:56.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf4331b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbf3c0d29a0 0x7fbf3c0d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf4331b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf3c15daf0 0x7fbf3c15df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf4331b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf3c0d14e0 con 0x7fbf3c0ce860 2024-04-25T02:07:56.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf4331b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbf3c0ce340 con 0x7fbf3c15daf0 2024-04-25T02:07:56.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf4331b640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fbf3c0cc570 con 0x7fbf3c0d29a0 2024-04-25T02:07:56.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf418b8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf3c15daf0 0x7fbf3c15df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf410b7640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbf3c0ce860 0x7fbf3c0cec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47548/0 (socket says 172.21.15.79:47548) 2024-04-25T02:07:56.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf418b8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf3c15daf0 0x7fbf3c15df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51692/0 (socket says 172.21.15.79:51692) 2024-04-25T02:07:56.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf410b7640 1 -- 172.21.15.79:0/3205103485 learned_addr learned my addr 172.21.15.79:0/3205103485 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:07:56.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf408b6640 1 --2- 172.21.15.79:0/3205103485 >> v2:172.21.15.189:3300/0 conn(0x7fbf3c0d29a0 0x7fbf3c0d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf418b8640 1 -- 172.21.15.79:0/3205103485 >> v2:172.21.15.189:3300/0 conn(0x7fbf3c0d29a0 msgr2=0x7fbf3c0d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:56.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf418b8640 1 --2- 172.21.15.79:0/3205103485 >> v2:172.21.15.189:3300/0 conn(0x7fbf3c0d29a0 0x7fbf3c0d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf418b8640 1 -- 172.21.15.79:0/3205103485 >> v1:172.21.15.79:6789/0 conn(0x7fbf3c0ce860 legacy=0x7fbf3c0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf33fff640 1 -- 172.21.15.79:0/3205103485 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3461201350 0 0) 0x7fbf3c0d14e0 con 0x7fbf3c0ce860 2024-04-25T02:07:56.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf418b8640 1 -- 172.21.15.79:0/3205103485 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3c0cc850 con 0x7fbf3c15daf0 2024-04-25T02:07:56.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.609+0000 7fbf408b6640 1 --2- 172.21.15.79:0/3205103485 >> v2:172.21.15.189:3300/0 conn(0x7fbf3c0d29a0 0x7fbf3c0d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:07:56.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.610+0000 7fbf418b8640 1 --2- 172.21.15.79:0/3205103485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c15daf0 0x7fbf3c15df40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009d90 tx=0x7fbf3402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1b38eace018312 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:56.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.610+0000 7fbf33fff640 1 -- 172.21.15.79:0/3205103485 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf34007740 con 0x7fbf3c15daf0 2024-04-25T02:07:56.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.610+0000 7fbf33fff640 1 -- 172.21.15.79:0/3205103485 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf340078e0 con 0x7fbf3c15daf0 2024-04-25T02:07:56.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.610+0000 7fbf33fff640 1 -- 172.21.15.79:0/3205103485 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf34007cb0 con 0x7fbf3c15daf0 2024-04-25T02:07:56.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.610+0000 7fbf4331b640 1 -- 172.21.15.79:0/3205103485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c15daf0 msgr2=0x7fbf3c15df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.610+0000 7fbf4331b640 1 --2- 172.21.15.79:0/3205103485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c15daf0 0x7fbf3c15df40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009d90 tx=0x7fbf3402a6a0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.610+0000 7fbf4331b640 1 -- 172.21.15.79:0/3205103485 shutdown_connections 2024-04-25T02:07:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.610+0000 7fbf4331b640 1 --2- 172.21.15.79:0/3205103485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c15daf0 0x7fbf3c15df40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.610+0000 7fbf4331b640 1 --2- 172.21.15.79:0/3205103485 >> v2:172.21.15.189:3300/0 conn(0x7fbf3c0d29a0 0x7fbf3c0d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.610+0000 7fbf4331b640 1 -- 172.21.15.79:0/3205103485 >> 172.21.15.79:0/3205103485 conn(0x7fbf3c0d1e80 msgr2=0x7fbf3c0d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.611+0000 7fbf4331b640 1 -- 172.21.15.79:0/3205103485 shutdown_connections 2024-04-25T02:07:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.611+0000 7fbf4331b640 1 -- 172.21.15.79:0/3205103485 wait complete. 2024-04-25T02:07:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.612+0000 7fbf4331b640 1 Processor -- start 2024-04-25T02:07:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.612+0000 7fbf4331b640 1 -- start start 2024-04-25T02:07:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.612+0000 7fbf4331b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c0ce860 0x7fbf3c1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.612+0000 7fbf4331b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf3c0d29a0 0x7fbf3c0c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.612+0000 7fbf4331b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf3c15daf0 0x7fbf3c15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.612+0000 7fbf4331b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c06c1c0 con 0x7fbf3c0ce860 2024-04-25T02:07:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.612+0000 7fbf4331b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c0cce10 con 0x7fbf3c15daf0 2024-04-25T02:07:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.612+0000 7fbf4331b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbf3c157820 con 0x7fbf3c0d29a0 2024-04-25T02:07:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.612+0000 7fbf410b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c0ce860 0x7fbf3c1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.612+0000 7fbf410b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c0ce860 0x7fbf3c1572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51702/0 (socket says 172.21.15.79:51702) 2024-04-25T02:07:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.612+0000 7fbf410b7640 1 -- 172.21.15.79:0/2496689394 learned_addr learned my addr 172.21.15.79:0/2496689394 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.613+0000 7fbf410b7640 1 -- 172.21.15.79:0/2496689394 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf3c0d29a0 msgr2=0x7fbf3c0c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.613+0000 7fbf410b7640 1 --2- 172.21.15.79:0/2496689394 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf3c0d29a0 0x7fbf3c0c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.613+0000 7fbf410b7640 1 -- 172.21.15.79:0/2496689394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf3c15daf0 msgr2=0x7fbf3c15a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.613+0000 7fbf410b7640 1 --2- 172.21.15.79:0/2496689394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf3c15daf0 0x7fbf3c15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.613+0000 7fbf410b7640 1 -- 172.21.15.79:0/2496689394 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3c157ee0 con 0x7fbf3c0ce860 2024-04-25T02:07:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.613+0000 7fbf410b7640 1 --2- 172.21.15.79:0/2496689394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c0ce860 0x7fbf3c1572e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c460 tx=0x7fbf3800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.613+0000 7fbf31ffb640 1 -- 172.21.15.79:0/2496689394 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38018070 con 0x7fbf3c0ce860 2024-04-25T02:07:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.613+0000 7fbf31ffb640 1 -- 172.21.15.79:0/2496689394 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf38007500 con 0x7fbf3c0ce860 2024-04-25T02:07:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.613+0000 7fbf4331b640 1 -- 172.21.15.79:0/2496689394 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf3c1581c0 con 0x7fbf3c0ce860 2024-04-25T02:07:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.613+0000 7fbf31ffb640 1 -- 172.21.15.79:0/2496689394 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38004a20 con 0x7fbf3c0ce860 2024-04-25T02:07:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.613+0000 7fbf4331b640 1 -- 172.21.15.79:0/2496689394 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3c158780 con 0x7fbf3c0ce860 2024-04-25T02:07:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.614+0000 7fbf4331b640 1 -- 172.21.15.79:0/2496689394 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf3c0690a0 con 0x7fbf3c0ce860 2024-04-25T02:07:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.614+0000 7fbf31ffb640 1 -- 172.21.15.79:0/2496689394 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf3801b070 con 0x7fbf3c0ce860 2024-04-25T02:07:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.615+0000 7fbf31ffb640 1 --2- 172.21.15.79:0/2496689394 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbf2006be30 0x7fbf2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.615+0000 7fbf31ffb640 1 -- 172.21.15.79:0/2496689394 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fbf38089d30 con 0x7fbf3c0ce860 2024-04-25T02:07:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.615+0000 7fbf408b6640 1 --2- 172.21.15.79:0/2496689394 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbf2006be30 0x7fbf2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.615+0000 7fbf408b6640 1 --2- 172.21.15.79:0/2496689394 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbf2006be30 0x7fbf2006e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c006fd0 tx=0x7fbf2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:56.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.619+0000 7fbf31ffb640 1 -- 172.21.15.79:0/2496689394 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbf38058ac0 con 0x7fbf3c0ce860 2024-04-25T02:07:56.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.795+0000 7fbf4331b640 1 -- 172.21.15.79:0/2496689394 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbf3c06fe60 con 0x7fbf3c0ce860 2024-04-25T02:07:56.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.795+0000 7fbf31ffb640 1 -- 172.21.15.79:0/2496689394 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fbf380583c0 con 0x7fbf3c0ce860 2024-04-25T02:07:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:07:56.804 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-04-25T02:07:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:07:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-04-25T02:07:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-04-25T02:07:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:07:56.804 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-04-25T02:07:56.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.797+0000 7fbf4331b640 1 -- 172.21.15.79:0/2496689394 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbf2006be30 msgr2=0x7fbf2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.797+0000 7fbf4331b640 1 --2- 172.21.15.79:0/2496689394 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbf2006be30 0x7fbf2006e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c006fd0 tx=0x7fbf2c008040 comp rx=0 tx=0).stop 2024-04-25T02:07:56.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.797+0000 7fbf4331b640 1 -- 172.21.15.79:0/2496689394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c0ce860 msgr2=0x7fbf3c1572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.797+0000 7fbf4331b640 1 --2- 172.21.15.79:0/2496689394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c0ce860 0x7fbf3c1572e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c460 tx=0x7fbf3800c920 comp rx=0 tx=0).stop 2024-04-25T02:07:56.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.797+0000 7fbf4331b640 1 -- 172.21.15.79:0/2496689394 shutdown_connections 2024-04-25T02:07:56.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.797+0000 7fbf4331b640 1 --2- 172.21.15.79:0/2496689394 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbf2006be30 0x7fbf2006e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.797+0000 7fbf4331b640 1 --2- 172.21.15.79:0/2496689394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf3c15daf0 0x7fbf3c15a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.797+0000 7fbf4331b640 1 --2- 172.21.15.79:0/2496689394 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf3c0d29a0 0x7fbf3c0c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.797+0000 7fbf4331b640 1 --2- 172.21.15.79:0/2496689394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c0ce860 0x7fbf3c1572e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.797+0000 7fbf4331b640 1 -- 172.21.15.79:0/2496689394 >> 172.21.15.79:0/2496689394 conn(0x7fbf3c0d1e80 msgr2=0x7fbf3c0afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:56.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.797+0000 7fbf4331b640 1 -- 172.21.15.79:0/2496689394 shutdown_connections 2024-04-25T02:07:56.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.797+0000 7fbf4331b640 1 -- 172.21.15.79:0/2496689394 wait complete. 2024-04-25T02:07:56.816 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T02:07:56.816 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T02:07:56.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.908+0000 7fd769aa5640 1 Processor -- start 2024-04-25T02:07:56.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.908+0000 7fd769aa5640 1 -- start start 2024-04-25T02:07:56.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.909+0000 7fd769aa5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd76415f0e0 0x7fd7640ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.909+0000 7fd769aa5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd7640cea10 0x7fd7640b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.909+0000 7fd769aa5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7640cf2e0 con 0x7fd76413de20 2024-04-25T02:07:56.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.909+0000 7fd769aa5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd7640cf5c0 con 0x7fd7640cea10 2024-04-25T02:07:56.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.909+0000 7fd769aa5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd7640cf8a0 con 0x7fd76415f0e0 2024-04-25T02:07:56.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.909+0000 7fd762ffd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd76415f0e0 0x7fd7640ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.909+0000 7fd763fff640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd7640cea10 0x7fd7640b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.909+0000 7fd7637fe640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fd76413de20 0x7fd76415e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:40428/0 (socket says 172.21.15.79:40428) 2024-04-25T02:07:56.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.909+0000 7fd762ffd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd76415f0e0 0x7fd7640ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:34338/0 (socket says 172.21.15.79:34338) 2024-04-25T02:07:56.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.909+0000 7fd7637fe640 1 -- 172.21.15.79:0/525455973 learned_addr learned my addr 172.21.15.79:0/525455973 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:07:56.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.909+0000 7fd762ffd640 1 -- 172.21.15.79:0/525455973 >> v2:172.21.15.189:3300/0 conn(0x7fd7640cea10 msgr2=0x7fd7640b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:56.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.909+0000 7fd762ffd640 1 --2- 172.21.15.79:0/525455973 >> v2:172.21.15.189:3300/0 conn(0x7fd7640cea10 0x7fd7640b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.909+0000 7fd762ffd640 1 -- 172.21.15.79:0/525455973 >> v1:172.21.15.189:6789/0 conn(0x7fd76413de20 legacy=0x7fd76415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.909+0000 7fd762ffd640 1 -- 172.21.15.79:0/525455973 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7640b2f40 con 0x7fd76415f0e0 2024-04-25T02:07:56.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.910+0000 7fd762ffd640 1 --2- 172.21.15.79:0/525455973 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd76415f0e0 0x7fd7640ce4d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd7580097a0 tx=0x7fd75802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c3ab6da348c0fdd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:56.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.910+0000 7fd7627fc640 1 -- 172.21.15.79:0/525455973 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758037070 con 0x7fd76415f0e0 2024-04-25T02:07:56.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.910+0000 7fd7627fc640 1 -- 172.21.15.79:0/525455973 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd75802ae50 con 0x7fd76415f0e0 2024-04-25T02:07:56.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.910+0000 7fd7627fc640 1 -- 172.21.15.79:0/525455973 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758032660 con 0x7fd76415f0e0 2024-04-25T02:07:56.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.911+0000 7fd769aa5640 1 -- 172.21.15.79:0/525455973 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd76415f0e0 msgr2=0x7fd7640ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.911+0000 7fd769aa5640 1 --2- 172.21.15.79:0/525455973 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd76415f0e0 0x7fd7640ce4d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd7580097a0 tx=0x7fd75802a100 comp rx=0 tx=0).stop 2024-04-25T02:07:56.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.911+0000 7fd769aa5640 1 -- 172.21.15.79:0/525455973 shutdown_connections 2024-04-25T02:07:56.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.911+0000 7fd769aa5640 1 --2- 172.21.15.79:0/525455973 >> v2:172.21.15.189:3300/0 conn(0x7fd7640cea10 0x7fd7640b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.911+0000 7fd769aa5640 1 --2- 172.21.15.79:0/525455973 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd76415f0e0 0x7fd7640ce4d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.911+0000 7fd769aa5640 1 -- 172.21.15.79:0/525455973 >> 172.21.15.79:0/525455973 conn(0x7fd76406b4a0 msgr2=0x7fd76406b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:56.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.911+0000 7fd769aa5640 1 -- 172.21.15.79:0/525455973 shutdown_connections 2024-04-25T02:07:56.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.911+0000 7fd769aa5640 1 -- 172.21.15.79:0/525455973 wait complete. 2024-04-25T02:07:56.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.912+0000 7fd769aa5640 1 Processor -- start 2024-04-25T02:07:56.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.912+0000 7fd769aa5640 1 -- start start 2024-04-25T02:07:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd769aa5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7640cea10 0x7fd7641388a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd769aa5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd76413de20 0x7fd764152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd769aa5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd76415f0e0 0x7fd76413e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd769aa5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7640cefa0 con 0x7fd76413de20 2024-04-25T02:07:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd769aa5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd7640cee20 con 0x7fd7640cea10 2024-04-25T02:07:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd769aa5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd7640b39a0 con 0x7fd76415f0e0 2024-04-25T02:07:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd762ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd76413de20 0x7fd764152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd762ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd76413de20 0x7fd764152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51708/0 (socket says 172.21.15.79:51708) 2024-04-25T02:07:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd762ffd640 1 -- 172.21.15.79:0/3401970892 learned_addr learned my addr 172.21.15.79:0/3401970892 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd763fff640 1 --2- 172.21.15.79:0/3401970892 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd76415f0e0 0x7fd76413e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd7637fe640 1 --2- 172.21.15.79:0/3401970892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7640cea10 0x7fd7641388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd762ffd640 1 -- 172.21.15.79:0/3401970892 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd76415f0e0 msgr2=0x7fd76413e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd762ffd640 1 --2- 172.21.15.79:0/3401970892 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd76415f0e0 0x7fd76413e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd762ffd640 1 -- 172.21.15.79:0/3401970892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7640cea10 msgr2=0x7fd7641388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:56.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd762ffd640 1 --2- 172.21.15.79:0/3401970892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7640cea10 0x7fd7641388a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:56.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd762ffd640 1 -- 172.21.15.79:0/3401970892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd764138de0 con 0x7fd76413de20 2024-04-25T02:07:56.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.913+0000 7fd762ffd640 1 --2- 172.21.15.79:0/3401970892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd76413de20 0x7fd764152a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd758000c00 tx=0x7fd7580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:56.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.914+0000 7fd74bfff640 1 -- 172.21.15.79:0/3401970892 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758041070 con 0x7fd76413de20 2024-04-25T02:07:56.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.914+0000 7fd74bfff640 1 -- 172.21.15.79:0/3401970892 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd75803c460 con 0x7fd76413de20 2024-04-25T02:07:56.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.914+0000 7fd74bfff640 1 -- 172.21.15.79:0/3401970892 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758037040 con 0x7fd76413de20 2024-04-25T02:07:56.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.914+0000 7fd769aa5640 1 -- 172.21.15.79:0/3401970892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd764139c60 con 0x7fd76413de20 2024-04-25T02:07:56.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.914+0000 7fd769aa5640 1 -- 172.21.15.79:0/3401970892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd764135fa0 con 0x7fd76413de20 2024-04-25T02:07:56.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.915+0000 7fd769aa5640 1 -- 172.21.15.79:0/3401970892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7640690a0 con 0x7fd76413de20 2024-04-25T02:07:56.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.915+0000 7fd74bfff640 1 -- 172.21.15.79:0/3401970892 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd758044070 con 0x7fd76413de20 2024-04-25T02:07:56.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.915+0000 7fd74bfff640 1 --2- 172.21.15.79:0/3401970892 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd75006be30 0x7fd75006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:56.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.916+0000 7fd74bfff640 1 -- 172.21.15.79:0/3401970892 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd7580ab520 con 0x7fd76413de20 2024-04-25T02:07:56.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.916+0000 7fd7637fe640 1 --2- 172.21.15.79:0/3401970892 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd75006be30 0x7fd75006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:56.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.916+0000 7fd7637fe640 1 --2- 172.21.15.79:0/3401970892 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd75006be30 0x7fd75006e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7641414f0 tx=0x7fd754007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:56.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:56.920+0000 7fd74bfff640 1 -- 172.21.15.79:0/3401970892 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd764138de0 con 0x7fd76413de20 2024-04-25T02:07:57.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:57.095+0000 7fd769aa5640 1 -- 172.21.15.79:0/3401970892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd76415ae20 con 0x7fd76413de20 2024-04-25T02:07:58.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.091+0000 7fd74bfff640 1 -- 172.21.15.79:0/3401970892 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fd758079c70 con 0x7fd76413de20 2024-04-25T02:07:58.099 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-04-25T02:07:58.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.095+0000 7fd769aa5640 1 -- 172.21.15.79:0/3401970892 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd75006be30 msgr2=0x7fd75006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:58.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.095+0000 7fd769aa5640 1 --2- 172.21.15.79:0/3401970892 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd75006be30 0x7fd75006e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7641414f0 tx=0x7fd754007e80 comp rx=0 tx=0).stop 2024-04-25T02:07:58.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.095+0000 7fd769aa5640 1 -- 172.21.15.79:0/3401970892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd76413de20 msgr2=0x7fd764152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:58.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.095+0000 7fd769aa5640 1 --2- 172.21.15.79:0/3401970892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd76413de20 0x7fd764152a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd758000c00 tx=0x7fd7580046c0 comp rx=0 tx=0).stop 2024-04-25T02:07:58.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.095+0000 7fd769aa5640 1 -- 172.21.15.79:0/3401970892 shutdown_connections 2024-04-25T02:07:58.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.095+0000 7fd769aa5640 1 --2- 172.21.15.79:0/3401970892 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd75006be30 0x7fd75006e2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:58.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.095+0000 7fd769aa5640 1 --2- 172.21.15.79:0/3401970892 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd76415f0e0 0x7fd76413e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:58.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.095+0000 7fd769aa5640 1 --2- 172.21.15.79:0/3401970892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd76413de20 0x7fd764152a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:58.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.095+0000 7fd769aa5640 1 --2- 172.21.15.79:0/3401970892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7640cea10 0x7fd7641388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:58.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.095+0000 7fd769aa5640 1 -- 172.21.15.79:0/3401970892 >> 172.21.15.79:0/3401970892 conn(0x7fd76406b4a0 msgr2=0x7fd7640aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:58.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.095+0000 7fd769aa5640 1 -- 172.21.15.79:0/3401970892 shutdown_connections 2024-04-25T02:07:58.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.095+0000 7fd769aa5640 1 -- 172.21.15.79:0/3401970892 wait complete. 2024-04-25T02:07:58.118 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T02:07:58.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.215+0000 7f3b928fc640 1 Processor -- start 2024-04-25T02:07:58.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.215+0000 7f3b928fc640 1 -- start start 2024-04-25T02:07:58.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.216+0000 7f3b928fc640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f3b8c06b2f0 0x7f3b8c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:58.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.216+0000 7f3b928fc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b8c0cf7a0 0x7f3b8c06b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:58.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.216+0000 7f3b928fc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8c06bc10 con 0x7f3b8c06e6b0 2024-04-25T02:07:58.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.216+0000 7f3b928fc640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3b8c15f830 con 0x7f3b8c06b2f0 2024-04-25T02:07:58.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.216+0000 7f3b928fc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3b8c15ec20 con 0x7f3b8c0cf7a0 2024-04-25T02:07:58.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.216+0000 7f3b90e99640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3b8c06e6b0 0x7f3b8c0cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47564/0 (socket says 172.21.15.79:47564) 2024-04-25T02:07:58.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.216+0000 7f3b90e99640 1 -- 172.21.15.79:0/1319047895 learned_addr learned my addr 172.21.15.79:0/1319047895 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:07:58.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.216+0000 7f3b8bfff640 1 --2- 172.21.15.79:0/1319047895 >> v2:172.21.15.189:3300/0 conn(0x7f3b8c06b2f0 0x7f3b8c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:58.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.216+0000 7f3b8b7fe640 1 --2- 172.21.15.79:0/1319047895 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b8c0cf7a0 0x7f3b8c06b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:58.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 -- 172.21.15.79:0/1319047895 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3409492026 0 0) 0x7f3b8c06bc10 con 0x7f3b8c06e6b0 2024-04-25T02:07:58.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 -- 172.21.15.79:0/1319047895 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b74003520 con 0x7f3b8c06e6b0 2024-04-25T02:07:58.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 -- 172.21.15.79:0/1319047895 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3378551334 0 0) 0x7f3b74003520 con 0x7f3b8c06e6b0 2024-04-25T02:07:58.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 -- 172.21.15.79:0/1319047895 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b8c0cf7a0 msgr2=0x7f3b8c06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:58.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 --2- 172.21.15.79:0/1319047895 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b8c0cf7a0 0x7f3b8c06b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:58.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 -- 172.21.15.79:0/1319047895 >> v2:172.21.15.189:3300/0 conn(0x7f3b8c06b2f0 msgr2=0x7f3b8c0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:58.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 --2- 172.21.15.79:0/1319047895 >> v2:172.21.15.189:3300/0 conn(0x7f3b8c06b2f0 0x7f3b8c0b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:58.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 -- 172.21.15.79:0/1319047895 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c15ef00 con 0x7f3b8c06e6b0 2024-04-25T02:07:58.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 -- 172.21.15.79:0/1319047895 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f3b840019f0 con 0x7f3b8c06e6b0 2024-04-25T02:07:58.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 -- 172.21.15.79:0/1319047895 >> v1:172.21.15.79:6789/0 conn(0x7f3b8c06e6b0 legacy=0x7f3b8c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:58.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 --2- 172.21.15.79:0/1319047895 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b8c0cf7a0 0x7f3b740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:58.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 --2- 172.21.15.79:0/1319047895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b74003f30 0x7f3b74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:58.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 --2- 172.21.15.79:0/1319047895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b74004d40 0x7f3b740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:58.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 -- 172.21.15.79:0/1319047895 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c15f830 con 0x7f3b74003f30 2024-04-25T02:07:58.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 -- 172.21.15.79:0/1319047895 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c15ec20 con 0x7f3b74004d40 2024-04-25T02:07:58.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8affd640 1 -- 172.21.15.79:0/1319047895 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7400ba10 con 0x7f3b8c0cf7a0 2024-04-25T02:07:58.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8b7fe640 1 --2- 172.21.15.79:0/1319047895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b74003f30 0x7f3b74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:58.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8bfff640 1 --2- 172.21.15.79:0/1319047895 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b8c0cf7a0 0x7f3b740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:58.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b90e99640 1 --2- 172.21.15.79:0/1319047895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b74004d40 0x7f3b740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:58.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8b7fe640 1 -- 172.21.15.79:0/1319047895 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b8c0cf7a0 msgr2=0x7f3b740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:58.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8b7fe640 1 --2- 172.21.15.79:0/1319047895 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b8c0cf7a0 0x7f3b740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:58.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8b7fe640 1 -- 172.21.15.79:0/1319047895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b74004d40 msgr2=0x7f3b740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:58.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8b7fe640 1 --2- 172.21.15.79:0/1319047895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b74004d40 0x7f3b740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:58.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.217+0000 7f3b8b7fe640 1 -- 172.21.15.79:0/1319047895 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b74003520 con 0x7f3b74003f30 2024-04-25T02:07:58.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.218+0000 7f3b8b7fe640 1 --2- 172.21.15.79:0/1319047895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b74003f30 0x7f3b74004800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009af0 tx=0x7f3b74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8f7da1e4c82be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:58.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.218+0000 7f3b8affd640 1 -- 172.21.15.79:0/1319047895 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80036070 con 0x7f3b74003f30 2024-04-25T02:07:58.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.218+0000 7f3b8affd640 1 -- 172.21.15.79:0/1319047895 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b80031400 con 0x7f3b74003f30 2024-04-25T02:07:58.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.218+0000 7f3b8affd640 1 -- 172.21.15.79:0/1319047895 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80009690 con 0x7f3b74003f30 2024-04-25T02:07:58.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.219+0000 7f3b928fc640 1 -- 172.21.15.79:0/1319047895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b74003f30 msgr2=0x7f3b74004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:58.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.219+0000 7f3b928fc640 1 --2- 172.21.15.79:0/1319047895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b74003f30 0x7f3b74004800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009af0 tx=0x7f3b74005830 comp rx=0 tx=0).stop 2024-04-25T02:07:58.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.219+0000 7f3b90e99640 1 -- 172.21.15.79:0/1319047895 reap_dead start 2024-04-25T02:07:58.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.219+0000 7f3b928fc640 1 -- 172.21.15.79:0/1319047895 shutdown_connections 2024-04-25T02:07:58.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.219+0000 7f3b928fc640 1 -- 172.21.15.79:0/1319047895 >> 172.21.15.79:0/1319047895 conn(0x7f3b8c0b1cd0 msgr2=0x7f3b8c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:58.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.219+0000 7f3b928fc640 1 -- 172.21.15.79:0/1319047895 shutdown_connections 2024-04-25T02:07:58.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.219+0000 7f3b928fc640 1 -- 172.21.15.79:0/1319047895 wait complete. 2024-04-25T02:07:58.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.220+0000 7f3b928fc640 1 Processor -- start 2024-04-25T02:07:58.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.220+0000 7f3b928fc640 1 -- start start 2024-04-25T02:07:58.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b928fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b74003f30 0x7f3b8c09ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:58.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b928fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c15cee0 0x7f3b8c09d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:58.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b928fc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b8c09b280 0x7f3b8c09b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:58.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b928fc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c06cfe0 con 0x7f3b8c15cee0 2024-04-25T02:07:58.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b928fc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c15f4c0 con 0x7f3b74003f30 2024-04-25T02:07:58.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b928fc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3b8c06d160 con 0x7f3b8c09b280 2024-04-25T02:07:58.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b8b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c15cee0 0x7f3b8c09d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:58.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b8b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c15cee0 0x7f3b8c09d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51716/0 (socket says 172.21.15.79:51716) 2024-04-25T02:07:58.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b8b7fe640 1 -- 172.21.15.79:0/2487910116 learned_addr learned my addr 172.21.15.79:0/2487910116 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:58.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b90e99640 1 --2- 172.21.15.79:0/2487910116 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b8c09b280 0x7f3b8c09b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:58.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b8bfff640 1 --2- 172.21.15.79:0/2487910116 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b74003f30 0x7f3b8c09ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:58.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b8b7fe640 1 -- 172.21.15.79:0/2487910116 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b8c09b280 msgr2=0x7f3b8c09b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:58.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b8b7fe640 1 --2- 172.21.15.79:0/2487910116 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b8c09b280 0x7f3b8c09b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:58.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b8b7fe640 1 -- 172.21.15.79:0/2487910116 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b74003f30 msgr2=0x7f3b8c09ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:58.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b8b7fe640 1 --2- 172.21.15.79:0/2487910116 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b74003f30 0x7f3b8c09ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:58.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b8b7fe640 1 -- 172.21.15.79:0/2487910116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c09d9d0 con 0x7f3b8c15cee0 2024-04-25T02:07:58.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b8b7fe640 1 --2- 172.21.15.79:0/2487910116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c15cee0 0x7f3b8c09d0f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009af0 tx=0x7f3b80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:58.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b88ff9640 1 -- 172.21.15.79:0/2487910116 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80040020 con 0x7f3b8c15cee0 2024-04-25T02:07:58.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b88ff9640 1 -- 172.21.15.79:0/2487910116 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b80003c60 con 0x7f3b8c15cee0 2024-04-25T02:07:58.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b928fc640 1 -- 172.21.15.79:0/2487910116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8c09dcb0 con 0x7f3b8c15cee0 2024-04-25T02:07:58.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b88ff9640 1 -- 172.21.15.79:0/2487910116 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80036040 con 0x7f3b8c15cee0 2024-04-25T02:07:58.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.221+0000 7f3b928fc640 1 -- 172.21.15.79:0/2487910116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8c153700 con 0x7f3b8c15cee0 2024-04-25T02:07:58.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.223+0000 7f3b928fc640 1 -- 172.21.15.79:0/2487910116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b8c0690a0 con 0x7f3b8c15cee0 2024-04-25T02:07:58.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.223+0000 7f3b88ff9640 1 -- 172.21.15.79:0/2487910116 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b80043020 con 0x7f3b8c15cee0 2024-04-25T02:07:58.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.223+0000 7f3b88ff9640 1 --2- 172.21.15.79:0/2487910116 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3b7806be60 0x7f3b7806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:58.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.223+0000 7f3b8bfff640 1 --2- 172.21.15.79:0/2487910116 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3b7806be60 0x7f3b7806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:58.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.223+0000 7f3b88ff9640 1 -- 172.21.15.79:0/2487910116 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f3b800aab80 con 0x7f3b8c15cee0 2024-04-25T02:07:58.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.224+0000 7f3b8bfff640 1 --2- 172.21.15.79:0/2487910116 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3b7806be60 0x7f3b7806e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009c40 tx=0x7f3b7c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:58.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.228+0000 7f3b88ff9640 1 -- 172.21.15.79:0/2487910116 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3b8004a070 con 0x7f3b8c15cee0 2024-04-25T02:07:58.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:58.401+0000 7f3b928fc640 1 -- 172.21.15.79:0/2487910116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3b8c0cf4f0 con 0x7f3b8c15cee0 2024-04-25T02:07:59.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.094+0000 7f3b88ff9640 1 -- 172.21.15.79:0/2487910116 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f3b800044e0 con 0x7f3b8c15cee0 2024-04-25T02:07:59.101 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-04-25T02:07:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.096+0000 7f3b928fc640 1 -- 172.21.15.79:0/2487910116 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3b7806be60 msgr2=0x7f3b7806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:59.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.096+0000 7f3b928fc640 1 --2- 172.21.15.79:0/2487910116 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3b7806be60 0x7f3b7806e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009c40 tx=0x7f3b7c009190 comp rx=0 tx=0).stop 2024-04-25T02:07:59.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.096+0000 7f3b928fc640 1 -- 172.21.15.79:0/2487910116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c15cee0 msgr2=0x7f3b8c09d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:59.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.097+0000 7f3b928fc640 1 --2- 172.21.15.79:0/2487910116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c15cee0 0x7f3b8c09d0f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009af0 tx=0x7f3b80004730 comp rx=0 tx=0).stop 2024-04-25T02:07:59.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.098+0000 7f3b928fc640 1 -- 172.21.15.79:0/2487910116 shutdown_connections 2024-04-25T02:07:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.098+0000 7f3b928fc640 1 --2- 172.21.15.79:0/2487910116 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3b7806be60 0x7f3b7806e320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.098+0000 7f3b928fc640 1 --2- 172.21.15.79:0/2487910116 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b8c09b280 0x7f3b8c09b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.098+0000 7f3b928fc640 1 --2- 172.21.15.79:0/2487910116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c15cee0 0x7f3b8c09d0f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.098+0000 7f3b928fc640 1 --2- 172.21.15.79:0/2487910116 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b74003f30 0x7f3b8c09ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.098+0000 7f3b928fc640 1 -- 172.21.15.79:0/2487910116 >> 172.21.15.79:0/2487910116 conn(0x7f3b8c0b1cd0 msgr2=0x7f3b8c0b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.098+0000 7f3b928fc640 1 -- 172.21.15.79:0/2487910116 shutdown_connections 2024-04-25T02:07:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.099+0000 7f3b928fc640 1 -- 172.21.15.79:0/2487910116 wait complete. 2024-04-25T02:07:59.128 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T02:07:59.176 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:07:59.178 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:07:59.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.224+0000 7f1fcff4f640 1 Processor -- start 2024-04-25T02:07:59.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.225+0000 7f1fcff4f640 1 -- start start 2024-04-25T02:07:59.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.225+0000 7f1fcff4f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1fc815c3b0 0x7f1fc80cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:59.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.225+0000 7f1fcff4f640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1fc80d2a20 0x7f1fc80d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:59.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.225+0000 7f1fcff4f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc815c790 con 0x7f1fc80d0990 2024-04-25T02:07:59.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.225+0000 7f1fcff4f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1fc815ca10 con 0x7f1fc815c3b0 2024-04-25T02:07:59.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.225+0000 7f1fcff4f640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f1fc815ccf0 con 0x7f1fc80d2a20 2024-04-25T02:07:59.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.225+0000 7f1fcdceb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1fc815c3b0 0x7f1fc80cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:59.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.225+0000 7f1fcdceb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1fc815c3b0 0x7f1fc80cfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51732/0 (socket says 172.21.15.79:51732) 2024-04-25T02:07:59.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.225+0000 7f1fcdceb640 1 -- 172.21.15.79:0/1122110106 learned_addr learned my addr 172.21.15.79:0/1122110106 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:59.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.226+0000 7f1fcd4ea640 1 --2- 172.21.15.79:0/1122110106 >> v2:172.21.15.189:3300/0 conn(0x7f1fc80d2a20 0x7f1fc80d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:59.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.226+0000 7f1fcdceb640 1 -- 172.21.15.79:0/1122110106 >> v2:172.21.15.189:3300/0 conn(0x7f1fc80d2a20 msgr2=0x7f1fc80d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:59.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.226+0000 7f1fcdceb640 1 --2- 172.21.15.79:0/1122110106 >> v2:172.21.15.189:3300/0 conn(0x7f1fc80d2a20 0x7f1fc80d0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:59.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.226+0000 7f1fcdceb640 1 -- 172.21.15.79:0/1122110106 >> v1:172.21.15.189:6789/0 conn(0x7f1fc80d0990 legacy=0x7f1fc815fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:59.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.226+0000 7f1fcdceb640 1 -- 172.21.15.79:0/1122110106 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc815cfd0 con 0x7f1fc815c3b0 2024-04-25T02:07:59.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.226+0000 7f1fcdceb640 1 --2- 172.21.15.79:0/1122110106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc815c3b0 0x7f1fc80cfa60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8071c20 tx=0x7f1fb802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8586c0128d3f515b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:59.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.227+0000 7f1fccce9640 1 -- 172.21.15.79:0/1122110106 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8037070 con 0x7f1fc815c3b0 2024-04-25T02:07:59.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.227+0000 7f1fccce9640 1 -- 172.21.15.79:0/1122110106 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb8032440 con 0x7f1fc815c3b0 2024-04-25T02:07:59.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.227+0000 7f1fccce9640 1 -- 172.21.15.79:0/1122110106 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8032810 con 0x7f1fc815c3b0 2024-04-25T02:07:59.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.227+0000 7f1fcff4f640 1 -- 172.21.15.79:0/1122110106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc815c3b0 msgr2=0x7f1fc80cfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:59.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.227+0000 7f1fcff4f640 1 --2- 172.21.15.79:0/1122110106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc815c3b0 0x7f1fc80cfa60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8071c20 tx=0x7f1fb802a230 comp rx=0 tx=0).stop 2024-04-25T02:07:59.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.227+0000 7f1fcff4f640 1 -- 172.21.15.79:0/1122110106 shutdown_connections 2024-04-25T02:07:59.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.227+0000 7f1fcff4f640 1 --2- 172.21.15.79:0/1122110106 >> v2:172.21.15.189:3300/0 conn(0x7f1fc80d2a20 0x7f1fc80d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:59.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.227+0000 7f1fcff4f640 1 --2- 172.21.15.79:0/1122110106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc815c3b0 0x7f1fc80cfa60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:59.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.227+0000 7f1fcff4f640 1 -- 172.21.15.79:0/1122110106 >> 172.21.15.79:0/1122110106 conn(0x7f1fc80d1e90 msgr2=0x7f1fc80d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:59.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.227+0000 7f1fcff4f640 1 -- 172.21.15.79:0/1122110106 shutdown_connections 2024-04-25T02:07:59.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.227+0000 7f1fcff4f640 1 -- 172.21.15.79:0/1122110106 wait complete. 2024-04-25T02:07:59.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.228+0000 7f1fcff4f640 1 Processor -- start 2024-04-25T02:07:59.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.228+0000 7f1fcff4f640 1 -- start start 2024-04-25T02:07:59.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fcff4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc80d0990 0x7f1fc8156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:59.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fcff4f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc80d2a20 0x7f1fc8158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:59.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fcff4f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc815c3b0 0x7f1fc8158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:59.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fcff4f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc80cda40 con 0x7f1fc80d0990 2024-04-25T02:07:59.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fcff4f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc80cffa0 con 0x7f1fc80d2a20 2024-04-25T02:07:59.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fcff4f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc80cdbc0 con 0x7f1fc815c3b0 2024-04-25T02:07:59.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fcdceb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc80d0990 0x7f1fc8156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:59.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fcdceb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc80d0990 0x7f1fc8156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51744/0 (socket says 172.21.15.79:51744) 2024-04-25T02:07:59.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fcdceb640 1 -- 172.21.15.79:0/4017457312 learned_addr learned my addr 172.21.15.79:0/4017457312 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:07:59.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fcd4ea640 1 --2- 172.21.15.79:0/4017457312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc80d2a20 0x7f1fc8158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:59.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fce4ec640 1 --2- 172.21.15.79:0/4017457312 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc815c3b0 0x7f1fc8158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:59.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fcdceb640 1 -- 172.21.15.79:0/4017457312 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc815c3b0 msgr2=0x7f1fc8158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:59.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fcdceb640 1 --2- 172.21.15.79:0/4017457312 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc815c3b0 0x7f1fc8158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:59.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fcdceb640 1 -- 172.21.15.79:0/4017457312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc80d2a20 msgr2=0x7f1fc8158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:59.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fcdceb640 1 --2- 172.21.15.79:0/4017457312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc80d2a20 0x7f1fc8158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:59.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.229+0000 7f1fcdceb640 1 -- 172.21.15.79:0/4017457312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc80c7360 con 0x7f1fc80d0990 2024-04-25T02:07:59.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.230+0000 7f1fcdceb640 1 --2- 172.21.15.79:0/4017457312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc80d0990 0x7f1fc8156e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1fb802a270 tx=0x7f1fb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:59.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.230+0000 7f1fbe7fc640 1 -- 172.21.15.79:0/4017457312 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8037040 con 0x7f1fc80d0990 2024-04-25T02:07:59.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.230+0000 7f1fbe7fc640 1 -- 172.21.15.79:0/4017457312 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb8042070 con 0x7f1fc80d0990 2024-04-25T02:07:59.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.230+0000 7f1fcff4f640 1 -- 172.21.15.79:0/4017457312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc80c7640 con 0x7f1fc80d0990 2024-04-25T02:07:59.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.230+0000 7f1fbe7fc640 1 -- 172.21.15.79:0/4017457312 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8030bb0 con 0x7f1fc80d0990 2024-04-25T02:07:59.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.230+0000 7f1fcff4f640 1 -- 172.21.15.79:0/4017457312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc80c7c00 con 0x7f1fc80d0990 2024-04-25T02:07:59.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.231+0000 7f1fcff4f640 1 -- 172.21.15.79:0/4017457312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc80681e0 con 0x7f1fc80d0990 2024-04-25T02:07:59.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.231+0000 7f1fbe7fc640 1 -- 172.21.15.79:0/4017457312 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fb8047460 con 0x7f1fc80d0990 2024-04-25T02:07:59.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.232+0000 7f1fbe7fc640 1 --2- 172.21.15.79:0/4017457312 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fac06be30 0x7f1fac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:59.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.232+0000 7f1fcd4ea640 1 --2- 172.21.15.79:0/4017457312 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fac06be30 0x7f1fac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:59.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.232+0000 7f1fbe7fc640 1 -- 172.21.15.79:0/4017457312 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f1fb80aba40 con 0x7f1fc80d0990 2024-04-25T02:07:59.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.232+0000 7f1fcd4ea640 1 --2- 172.21.15.79:0/4017457312 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fac06be30 0x7f1fac06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4006fd0 tx=0x7f1fc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:59.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.236+0000 7f1fbe7fc640 1 -- 172.21.15.79:0/4017457312 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1fc815c790 con 0x7f1fc80d0990 2024-04-25T02:07:59.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:07:59.450+0000 7f1fcff4f640 1 -- 172.21.15.79:0/4017457312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1fc80c5760 con 0x7f1fc80d0990 2024-04-25T02:08:00.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.109+0000 7f1fbe7fc640 1 -- 172.21.15.79:0/4017457312 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f1fb80abe20 con 0x7f1fc80d0990 2024-04-25T02:08:00.116 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T02:08:00.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.112+0000 7f1fcff4f640 1 -- 172.21.15.79:0/4017457312 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fac06be30 msgr2=0x7f1fac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.112+0000 7f1fcff4f640 1 --2- 172.21.15.79:0/4017457312 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fac06be30 0x7f1fac06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4006fd0 tx=0x7f1fc4008040 comp rx=0 tx=0).stop 2024-04-25T02:08:00.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.112+0000 7f1fcff4f640 1 -- 172.21.15.79:0/4017457312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc80d0990 msgr2=0x7f1fc8156e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.112+0000 7f1fcff4f640 1 --2- 172.21.15.79:0/4017457312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc80d0990 0x7f1fc8156e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1fb802a270 tx=0x7f1fb80046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.112+0000 7f1fcff4f640 1 -- 172.21.15.79:0/4017457312 shutdown_connections 2024-04-25T02:08:00.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.112+0000 7f1fcff4f640 1 --2- 172.21.15.79:0/4017457312 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fac06be30 0x7f1fac06e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.112+0000 7f1fcff4f640 1 --2- 172.21.15.79:0/4017457312 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc815c3b0 0x7f1fc8158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.112+0000 7f1fcff4f640 1 --2- 172.21.15.79:0/4017457312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc80d2a20 0x7f1fc8158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.112+0000 7f1fcff4f640 1 --2- 172.21.15.79:0/4017457312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc80d0990 0x7f1fc8156e70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.112+0000 7f1fcff4f640 1 -- 172.21.15.79:0/4017457312 >> 172.21.15.79:0/4017457312 conn(0x7f1fc80d1e90 msgr2=0x7f1fc815edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:00.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.112+0000 7f1fcff4f640 1 -- 172.21.15.79:0/4017457312 shutdown_connections 2024-04-25T02:08:00.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.112+0000 7f1fcff4f640 1 -- 172.21.15.79:0/4017457312 wait complete. 2024-04-25T02:08:00.145 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:00.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.275+0000 7f9964ca5640 1 Processor -- start 2024-04-25T02:08:00.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.275+0000 7f9964ca5640 1 -- start start 2024-04-25T02:08:00.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.276+0000 7f9964ca5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f996015e4d0 0x7f996006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.276+0000 7f9964ca5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99600d2e20 0x7f99600cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.276+0000 7f9964ca5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99600d1660 con 0x7f99600b3570 2024-04-25T02:08:00.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.276+0000 7f9964ca5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f99600d1380 con 0x7f99600d2e20 2024-04-25T02:08:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.276+0000 7f9964ca5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f99600cede0 con 0x7f996015e4d0 2024-04-25T02:08:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.276+0000 7f995ed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99600d2e20 0x7f99600cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.276+0000 7f995dd9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f99600b3570 0x7f99600d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47574/0 (socket says 172.21.15.79:47574) 2024-04-25T02:08:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.276+0000 7f995dd9b640 1 -- 172.21.15.79:0/4165225556 learned_addr learned my addr 172.21.15.79:0/4165225556 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.276+0000 7f995ed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99600d2e20 0x7f99600cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51752/0 (socket says 172.21.15.79:51752) 2024-04-25T02:08:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.277+0000 7f995e59c640 1 --2- 172.21.15.79:0/4165225556 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f996015e4d0 0x7f996006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.277+0000 7f995ed9d640 1 -- 172.21.15.79:0/4165225556 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f996015e4d0 msgr2=0x7f996006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.277+0000 7f995ed9d640 1 --2- 172.21.15.79:0/4165225556 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f996015e4d0 0x7f996006bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.277+0000 7f995ed9d640 1 -- 172.21.15.79:0/4165225556 >> v1:172.21.15.79:6789/0 conn(0x7f99600b3570 legacy=0x7f99600d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.277+0000 7f995d59a640 1 -- 172.21.15.79:0/4165225556 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3789251350 0 0) 0x7f99600d1660 con 0x7f99600b3570 2024-04-25T02:08:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.277+0000 7f995ed9d640 1 -- 172.21.15.79:0/4165225556 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99600cf0c0 con 0x7f99600d2e20 2024-04-25T02:08:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.277+0000 7f995ed9d640 1 --2- 172.21.15.79:0/4165225556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99600d2e20 0x7f99600cf5e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99500097a0 tx=0x7f995002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2402a44fc4b8a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.278+0000 7f995d59a640 1 -- 172.21.15.79:0/4165225556 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950037070 con 0x7f99600d2e20 2024-04-25T02:08:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.278+0000 7f995d59a640 1 -- 172.21.15.79:0/4165225556 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9950032440 con 0x7f99600d2e20 2024-04-25T02:08:00.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.278+0000 7f995d59a640 1 -- 172.21.15.79:0/4165225556 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950032810 con 0x7f99600d2e20 2024-04-25T02:08:00.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.278+0000 7f9964ca5640 1 -- 172.21.15.79:0/4165225556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99600d2e20 msgr2=0x7f99600cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.278+0000 7f9964ca5640 1 --2- 172.21.15.79:0/4165225556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99600d2e20 0x7f99600cf5e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99500097a0 tx=0x7f995002a180 comp rx=0 tx=0).stop 2024-04-25T02:08:00.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.278+0000 7f9964ca5640 1 -- 172.21.15.79:0/4165225556 shutdown_connections 2024-04-25T02:08:00.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.278+0000 7f9964ca5640 1 --2- 172.21.15.79:0/4165225556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99600d2e20 0x7f99600cf5e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.278+0000 7f9964ca5640 1 --2- 172.21.15.79:0/4165225556 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f996015e4d0 0x7f996006bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.278+0000 7f9964ca5640 1 -- 172.21.15.79:0/4165225556 >> 172.21.15.79:0/4165225556 conn(0x7f996009d460 msgr2=0x7f99600d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:00.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.278+0000 7f9964ca5640 1 -- 172.21.15.79:0/4165225556 shutdown_connections 2024-04-25T02:08:00.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.278+0000 7f9964ca5640 1 -- 172.21.15.79:0/4165225556 wait complete. 2024-04-25T02:08:00.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.279+0000 7f9964ca5640 1 Processor -- start 2024-04-25T02:08:00.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.279+0000 7f9964ca5640 1 -- start start 2024-04-25T02:08:00.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.280+0000 7f9964ca5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99600b3570 0x7f9960155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.280+0000 7f9964ca5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99600d2e20 0x7f99600b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.280+0000 7f9964ca5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996015e4d0 0x7f99600b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.280+0000 7f9964ca5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99600d2250 con 0x7f996015e4d0 2024-04-25T02:08:00.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.280+0000 7f9964ca5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99600d20d0 con 0x7f99600d2e20 2024-04-25T02:08:00.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.280+0000 7f9964ca5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f996006c1b0 con 0x7f99600b3570 2024-04-25T02:08:00.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.280+0000 7f995ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996015e4d0 0x7f99600b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.280+0000 7f995ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996015e4d0 0x7f99600b83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51762/0 (socket says 172.21.15.79:51762) 2024-04-25T02:08:00.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.280+0000 7f995ed9d640 1 -- 172.21.15.79:0/1980595353 learned_addr learned my addr 172.21.15.79:0/1980595353 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:00.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.280+0000 7f995dd9b640 1 --2- 172.21.15.79:0/1980595353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99600d2e20 0x7f99600b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.280+0000 7f995e59c640 1 --2- 172.21.15.79:0/1980595353 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99600b3570 0x7f9960155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.281+0000 7f995ed9d640 1 -- 172.21.15.79:0/1980595353 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99600b3570 msgr2=0x7f9960155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.281+0000 7f995ed9d640 1 --2- 172.21.15.79:0/1980595353 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99600b3570 0x7f9960155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.281+0000 7f995ed9d640 1 -- 172.21.15.79:0/1980595353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99600d2e20 msgr2=0x7f99600b7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.281+0000 7f995ed9d640 1 --2- 172.21.15.79:0/1980595353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99600d2e20 0x7f99600b7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.281+0000 7f995ed9d640 1 -- 172.21.15.79:0/1980595353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99600b8a10 con 0x7f996015e4d0 2024-04-25T02:08:00.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.281+0000 7f995ed9d640 1 --2- 172.21.15.79:0/1980595353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996015e4d0 0x7f99600b83e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f99500098c0 tx=0x7f99500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:00.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.281+0000 7f994effd640 1 -- 172.21.15.79:0/1980595353 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950037040 con 0x7f996015e4d0 2024-04-25T02:08:00.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.281+0000 7f994effd640 1 -- 172.21.15.79:0/1980595353 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9950042070 con 0x7f996015e4d0 2024-04-25T02:08:00.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.281+0000 7f9964ca5640 1 -- 172.21.15.79:0/1980595353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99600b8cf0 con 0x7f996015e4d0 2024-04-25T02:08:00.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.281+0000 7f994effd640 1 -- 172.21.15.79:0/1980595353 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950030b50 con 0x7f996015e4d0 2024-04-25T02:08:00.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.281+0000 7f9964ca5640 1 -- 172.21.15.79:0/1980595353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99600b9590 con 0x7f996015e4d0 2024-04-25T02:08:00.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.282+0000 7f9964ca5640 1 -- 172.21.15.79:0/1980595353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99600b8ec0 con 0x7f996015e4d0 2024-04-25T02:08:00.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.282+0000 7f994effd640 1 -- 172.21.15.79:0/1980595353 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9950030cf0 con 0x7f996015e4d0 2024-04-25T02:08:00.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.283+0000 7f994effd640 1 --2- 172.21.15.79:0/1980595353 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f994006be30 0x7f994006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.283+0000 7f994effd640 1 -- 172.21.15.79:0/1980595353 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f99500ab910 con 0x7f996015e4d0 2024-04-25T02:08:00.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.283+0000 7f995e59c640 1 --2- 172.21.15.79:0/1980595353 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f994006be30 0x7f994006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.283+0000 7f995e59c640 1 --2- 172.21.15.79:0/1980595353 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f994006be30 0x7f994006e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9958009fd0 tx=0x7f9958009800 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:00.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.287+0000 7f994effd640 1 -- 172.21.15.79:0/1980595353 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9950032e20 con 0x7f996015e4d0 2024-04-25T02:08:00.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.464+0000 7f9964ca5640 1 -- 172.21.15.79:0/1980595353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99600690a0 con 0x7f996015e4d0 2024-04-25T02:08:00.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.465+0000 7f994effd640 1 -- 172.21.15.79:0/1980595353 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16630 (secure 0 0 0) 0x7f9950079be0 con 0x7f996015e4d0 2024-04-25T02:08:00.472 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:00.472 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:07:59.451784+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.467+0000 7f9964ca5640 1 -- 172.21.15.79:0/1980595353 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f994006be30 msgr2=0x7f994006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.467+0000 7f9964ca5640 1 --2- 172.21.15.79:0/1980595353 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f994006be30 0x7f994006e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9958009fd0 tx=0x7f9958009800 comp rx=0 tx=0).stop 2024-04-25T02:08:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.467+0000 7f9964ca5640 1 -- 172.21.15.79:0/1980595353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996015e4d0 msgr2=0x7f99600b83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.467+0000 7f9964ca5640 1 --2- 172.21.15.79:0/1980595353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996015e4d0 0x7f99600b83e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f99500098c0 tx=0x7f99500046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.467+0000 7f9964ca5640 1 -- 172.21.15.79:0/1980595353 shutdown_connections 2024-04-25T02:08:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.467+0000 7f9964ca5640 1 --2- 172.21.15.79:0/1980595353 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f994006be30 0x7f994006e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.467+0000 7f9964ca5640 1 --2- 172.21.15.79:0/1980595353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996015e4d0 0x7f99600b83e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.467+0000 7f9964ca5640 1 --2- 172.21.15.79:0/1980595353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99600d2e20 0x7f99600b7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.467+0000 7f9964ca5640 1 --2- 172.21.15.79:0/1980595353 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99600b3570 0x7f9960155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.467+0000 7f9964ca5640 1 -- 172.21.15.79:0/1980595353 >> 172.21.15.79:0/1980595353 conn(0x7f996009d460 msgr2=0x7f99600d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.467+0000 7f9964ca5640 1 -- 172.21.15.79:0/1980595353 shutdown_connections 2024-04-25T02:08:00.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.467+0000 7f9964ca5640 1 -- 172.21.15.79:0/1980595353 wait complete. 2024-04-25T02:08:00.485 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.574+0000 7f93411b7640 1 Processor -- start 2024-04-25T02:08:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.574+0000 7f93411b7640 1 -- start start 2024-04-25T02:08:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f93411b7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f933c0cc100 0x7f933c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f93411b7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f933c0b04c0 con 0x7f933c0b00e0 2024-04-25T02:08:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f93411b7640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f933c0d02b0 con 0x7f933c06b5f0 2024-04-25T02:08:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f93411b7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f933c0d0590 con 0x7f933c0cc100 2024-04-25T02:08:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f933ad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f933c0b00e0 0x7f933c0cfa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47582/0 (socket says 172.21.15.79:47582) 2024-04-25T02:08:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f933ad9d640 1 -- 172.21.15.79:0/4183112706 learned_addr learned my addr 172.21.15.79:0/4183112706 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f9339d9b640 1 -- 172.21.15.79:0/4183112706 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987979716 0 0) 0x7f933c0b04c0 con 0x7f933c0b00e0 2024-04-25T02:08:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f9339d9b640 1 -- 172.21.15.79:0/4183112706 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9324003520 con 0x7f933c0b00e0 2024-04-25T02:08:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f933a59c640 1 --2- 172.21.15.79:0/4183112706 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f933c0cc100 0x7f933c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f9339d9b640 1 -- 172.21.15.79:0/4183112706 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1250117210 0 0) 0x7f9324003520 con 0x7f933c0b00e0 2024-04-25T02:08:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f9339d9b640 1 -- 172.21.15.79:0/4183112706 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f933c0cc100 msgr2=0x7f933c06b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f9339d9b640 1 --2- 172.21.15.79:0/4183112706 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f933c0cc100 0x7f933c06b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f9339d9b640 1 -- 172.21.15.79:0/4183112706 >> v1:172.21.15.189:6789/0 conn(0x7f933c06b5f0 legacy=0x7f933c06e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f9339d9b640 1 -- 172.21.15.79:0/4183112706 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c0d0870 con 0x7f933c0b00e0 2024-04-25T02:08:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f9339d9b640 1 -- 172.21.15.79:0/4183112706 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f932c001670 con 0x7f933c0b00e0 2024-04-25T02:08:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f9339d9b640 1 -- 172.21.15.79:0/4183112706 >> v1:172.21.15.79:6789/0 conn(0x7f933c0b00e0 legacy=0x7f933c0cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f9339d9b640 1 --2- 172.21.15.79:0/4183112706 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f933c0cc100 0x7f93240039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f9339d9b640 1 --2- 172.21.15.79:0/4183112706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9324003f60 0x7f9324004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f9339d9b640 1 --2- 172.21.15.79:0/4183112706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9324004d40 0x7f93240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f9339d9b640 1 -- 172.21.15.79:0/4183112706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f933c0d0590 con 0x7f9324004d40 2024-04-25T02:08:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f9339d9b640 1 -- 172.21.15.79:0/4183112706 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f932400bb30 con 0x7f9324003f60 2024-04-25T02:08:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.575+0000 7f9339d9b640 1 -- 172.21.15.79:0/4183112706 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f932400bd30 con 0x7f933c0cc100 2024-04-25T02:08:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.576+0000 7f933b59e640 1 --2- 172.21.15.79:0/4183112706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9324004d40 0x7f93240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.576+0000 7f933ad9d640 1 --2- 172.21.15.79:0/4183112706 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f933c0cc100 0x7f93240039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.576+0000 7f933a59c640 1 --2- 172.21.15.79:0/4183112706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9324003f60 0x7f9324004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.576+0000 7f933b59e640 1 -- 172.21.15.79:0/4183112706 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f933c0cc100 msgr2=0x7f93240039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.576+0000 7f933b59e640 1 --2- 172.21.15.79:0/4183112706 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f933c0cc100 0x7f93240039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.576+0000 7f933b59e640 1 -- 172.21.15.79:0/4183112706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9324003f60 msgr2=0x7f9324004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.576+0000 7f933b59e640 1 --2- 172.21.15.79:0/4183112706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9324003f60 0x7f9324004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.576+0000 7f933b59e640 1 -- 172.21.15.79:0/4183112706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9324003520 con 0x7f9324004d40 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.576+0000 7f933b59e640 1 --2- 172.21.15.79:0/4183112706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9324004d40 0x7f93240051c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9334001e50 tx=0x7f9324005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520d55018a5bb1b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.577+0000 7f9339d9b640 1 -- 172.21.15.79:0/4183112706 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9334001a70 con 0x7f9324004d40 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.577+0000 7f9339d9b640 1 -- 172.21.15.79:0/4183112706 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9334003970 con 0x7f9324004d40 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.577+0000 7f9339d9b640 1 -- 172.21.15.79:0/4183112706 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9334003d60 con 0x7f9324004d40 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.577+0000 7f93411b7640 1 -- 172.21.15.79:0/4183112706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9324004d40 msgr2=0x7f93240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.577+0000 7f93411b7640 1 --2- 172.21.15.79:0/4183112706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9324004d40 0x7f93240051c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9334001e50 tx=0x7f9324005830 comp rx=0 tx=0).stop 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.577+0000 7f933b59e640 1 -- 172.21.15.79:0/4183112706 reap_dead start 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.577+0000 7f93411b7640 1 -- 172.21.15.79:0/4183112706 shutdown_connections 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.577+0000 7f93411b7640 1 -- 172.21.15.79:0/4183112706 >> 172.21.15.79:0/4183112706 conn(0x7f933c0cd770 msgr2=0x7f933c0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.577+0000 7f93411b7640 1 -- 172.21.15.79:0/4183112706 shutdown_connections 2024-04-25T02:08:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.577+0000 7f93411b7640 1 -- 172.21.15.79:0/4183112706 wait complete. 2024-04-25T02:08:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.579+0000 7f93411b7640 1 Processor -- start 2024-04-25T02:08:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.579+0000 7f93411b7640 1 -- start start 2024-04-25T02:08:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.579+0000 7f93411b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c150050 0x7f933c0b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.579+0000 7f93411b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f933c150430 0x7f933c0ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.579+0000 7f93411b7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f933c0ae550 0x7f933c0aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.579+0000 7f93411b7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f933c06b0b0 con 0x7f933c150050 2024-04-25T02:08:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.579+0000 7f93411b7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f933c06dfd0 con 0x7f933c150430 2024-04-25T02:08:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.579+0000 7f93411b7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f933c06b230 con 0x7f933c0ae550 2024-04-25T02:08:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.579+0000 7f933ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c150050 0x7f933c0b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.579+0000 7f933ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c150050 0x7f933c0b3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51770/0 (socket says 172.21.15.79:51770) 2024-04-25T02:08:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.579+0000 7f933ad9d640 1 -- 172.21.15.79:0/3352354938 learned_addr learned my addr 172.21.15.79:0/3352354938 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.580+0000 7f933b59e640 1 --2- 172.21.15.79:0/3352354938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f933c0ae550 0x7f933c0aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.580+0000 7f933a59c640 1 --2- 172.21.15.79:0/3352354938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f933c150430 0x7f933c0ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.580+0000 7f933ad9d640 1 -- 172.21.15.79:0/3352354938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f933c0ae550 msgr2=0x7f933c0aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.580+0000 7f933ad9d640 1 --2- 172.21.15.79:0/3352354938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f933c0ae550 0x7f933c0aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.580+0000 7f933ad9d640 1 -- 172.21.15.79:0/3352354938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f933c150430 msgr2=0x7f933c0ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.580+0000 7f933ad9d640 1 --2- 172.21.15.79:0/3352354938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f933c150430 0x7f933c0ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.580+0000 7f933ad9d640 1 -- 172.21.15.79:0/3352354938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c0caca0 con 0x7f933c150050 2024-04-25T02:08:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.580+0000 7f933ad9d640 1 --2- 172.21.15.79:0/3352354938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c150050 0x7f933c0b3950 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f932c0072c0 tx=0x7f932c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.580+0000 7f93237fe640 1 -- 172.21.15.79:0/3352354938 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c00f9c0 con 0x7f933c150050 2024-04-25T02:08:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.580+0000 7f93237fe640 1 -- 172.21.15.79:0/3352354938 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f932c018070 con 0x7f933c150050 2024-04-25T02:08:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.580+0000 7f93411b7640 1 -- 172.21.15.79:0/3352354938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933c0c96c0 con 0x7f933c150050 2024-04-25T02:08:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.580+0000 7f93237fe640 1 -- 172.21.15.79:0/3352354938 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c00fdc0 con 0x7f933c150050 2024-04-25T02:08:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.580+0000 7f93411b7640 1 -- 172.21.15.79:0/3352354938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f933c0c9c80 con 0x7f933c150050 2024-04-25T02:08:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.581+0000 7f93411b7640 1 -- 172.21.15.79:0/3352354938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f933c0690a0 con 0x7f933c150050 2024-04-25T02:08:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.581+0000 7f93237fe640 1 -- 172.21.15.79:0/3352354938 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f932c01d460 con 0x7f933c150050 2024-04-25T02:08:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.582+0000 7f93237fe640 1 --2- 172.21.15.79:0/3352354938 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f932806be60 0x7f932806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.582+0000 7f933a59c640 1 --2- 172.21.15.79:0/3352354938 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f932806be60 0x7f932806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.582+0000 7f93237fe640 1 -- 172.21.15.79:0/3352354938 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f932c08b040 con 0x7f933c150050 2024-04-25T02:08:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.582+0000 7f933a59c640 1 --2- 172.21.15.79:0/3352354938 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f932806be60 0x7f932806e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f933c15e880 tx=0x7f9330008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.586+0000 7f93237fe640 1 -- 172.21.15.79:0/3352354938 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f932c0599f0 con 0x7f933c150050 2024-04-25T02:08:00.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.758+0000 7f93411b7640 1 -- 172.21.15.79:0/3352354938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f933c0cbce0 con 0x7f933c150050 2024-04-25T02:08:00.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.759+0000 7f93237fe640 1 -- 172.21.15.79:0/3352354938 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16630 (secure 0 0 0) 0x7f932c0592f0 con 0x7f933c150050 2024-04-25T02:08:00.766 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:00.766 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:07:59.451784+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:00.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.761+0000 7f93411b7640 1 -- 172.21.15.79:0/3352354938 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f932806be60 msgr2=0x7f932806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.761+0000 7f93411b7640 1 --2- 172.21.15.79:0/3352354938 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f932806be60 0x7f932806e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f933c15e880 tx=0x7f9330008040 comp rx=0 tx=0).stop 2024-04-25T02:08:00.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.761+0000 7f93411b7640 1 -- 172.21.15.79:0/3352354938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c150050 msgr2=0x7f933c0b3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.761+0000 7f93411b7640 1 --2- 172.21.15.79:0/3352354938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c150050 0x7f933c0b3950 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f932c0072c0 tx=0x7f932c007780 comp rx=0 tx=0).stop 2024-04-25T02:08:00.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.761+0000 7f93411b7640 1 -- 172.21.15.79:0/3352354938 shutdown_connections 2024-04-25T02:08:00.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.761+0000 7f93411b7640 1 --2- 172.21.15.79:0/3352354938 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f932806be60 0x7f932806e320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.761+0000 7f93411b7640 1 --2- 172.21.15.79:0/3352354938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f933c0ae550 0x7f933c0aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.761+0000 7f93411b7640 1 --2- 172.21.15.79:0/3352354938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f933c150430 0x7f933c0ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.761+0000 7f93411b7640 1 --2- 172.21.15.79:0/3352354938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c150050 0x7f933c0b3950 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.761+0000 7f93411b7640 1 -- 172.21.15.79:0/3352354938 >> 172.21.15.79:0/3352354938 conn(0x7f933c0cd770 msgr2=0x7f933c0c6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:00.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.761+0000 7f93411b7640 1 -- 172.21.15.79:0/3352354938 shutdown_connections 2024-04-25T02:08:00.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.761+0000 7f93411b7640 1 -- 172.21.15.79:0/3352354938 wait complete. 2024-04-25T02:08:00.779 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T02:08:00.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.871+0000 7f39a51c1640 1 Processor -- start 2024-04-25T02:08:00.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.871+0000 7f39a51c1640 1 -- start start 2024-04-25T02:08:00.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.871+0000 7f39a51c1640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f39a00d2ca0 0x7f39a00d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.871+0000 7f39a51c1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39a00d0ef0 0x7f39a006bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.871+0000 7f39a51c1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a00d1ee0 con 0x7f39a015e4f0 2024-04-25T02:08:00.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.871+0000 7f39a51c1640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f39a00d3130 con 0x7f39a00d2ca0 2024-04-25T02:08:00.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.871+0000 7f39a51c1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f39a00d21c0 con 0x7f39a00d0ef0 2024-04-25T02:08:00.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399ed9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f39a015e4f0 0x7f39a00cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47588/0 (socket says 172.21.15.79:47588) 2024-04-25T02:08:00.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399ed9d640 1 -- 172.21.15.79:0/3579437663 learned_addr learned my addr 172.21.15.79:0/3579437663 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:00.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 -- 172.21.15.79:0/3579437663 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2905025459 0 0) 0x7f39a00d1ee0 con 0x7f39a015e4f0 2024-04-25T02:08:00.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 -- 172.21.15.79:0/3579437663 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f398c003520 con 0x7f39a015e4f0 2024-04-25T02:08:00.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f3997fff640 1 --2- 172.21.15.79:0/3579437663 >> v2:172.21.15.189:3300/0 conn(0x7f39a00d2ca0 0x7f39a00d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399f59e640 1 --2- 172.21.15.79:0/3579437663 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39a00d0ef0 0x7f39a006bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 -- 172.21.15.79:0/3579437663 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1417008983 0 0) 0x7f398c003520 con 0x7f39a015e4f0 2024-04-25T02:08:00.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 -- 172.21.15.79:0/3579437663 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39a00d0ef0 msgr2=0x7f39a006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:00.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 --2- 172.21.15.79:0/3579437663 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39a00d0ef0 0x7f39a006bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 -- 172.21.15.79:0/3579437663 >> v2:172.21.15.189:3300/0 conn(0x7f39a00d2ca0 msgr2=0x7f39a00d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 --2- 172.21.15.79:0/3579437663 >> v2:172.21.15.189:3300/0 conn(0x7f39a00d2ca0 0x7f39a00d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 -- 172.21.15.79:0/3579437663 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a00d24a0 con 0x7f39a015e4f0 2024-04-25T02:08:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 -- 172.21.15.79:0/3579437663 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f3990001670 con 0x7f39a015e4f0 2024-04-25T02:08:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 -- 172.21.15.79:0/3579437663 >> v1:172.21.15.79:6789/0 conn(0x7f39a015e4f0 legacy=0x7f39a00cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 --2- 172.21.15.79:0/3579437663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c0039b0 0x7f398c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 --2- 172.21.15.79:0/3579437663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f398c004800 0x7f398c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 --2- 172.21.15.79:0/3579437663 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39a00d0ef0 0x7f398c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 -- 172.21.15.79:0/3579437663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f39a00d21c0 con 0x7f398c0039b0 2024-04-25T02:08:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 -- 172.21.15.79:0/3579437663 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f398c00b9c0 con 0x7f398c004800 2024-04-25T02:08:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399e59c640 1 -- 172.21.15.79:0/3579437663 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f398c00bb40 con 0x7f39a00d0ef0 2024-04-25T02:08:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399ed9d640 1 --2- 172.21.15.79:0/3579437663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c0039b0 0x7f398c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f3997fff640 1 --2- 172.21.15.79:0/3579437663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f398c004800 0x7f398c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399f59e640 1 --2- 172.21.15.79:0/3579437663 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39a00d0ef0 0x7f398c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.872+0000 7f399ed9d640 1 -- 172.21.15.79:0/3579437663 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39a00d0ef0 msgr2=0x7f398c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:00.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.873+0000 7f399ed9d640 1 --2- 172.21.15.79:0/3579437663 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39a00d0ef0 0x7f398c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.873+0000 7f399ed9d640 1 -- 172.21.15.79:0/3579437663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f398c004800 msgr2=0x7f398c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:00.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.873+0000 7f399ed9d640 1 --2- 172.21.15.79:0/3579437663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f398c004800 0x7f398c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.873+0000 7f399ed9d640 1 -- 172.21.15.79:0/3579437663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c003520 con 0x7f398c0039b0 2024-04-25T02:08:00.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.873+0000 7f399f59e640 1 --2- 172.21.15.79:0/3579437663 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39a00d0ef0 0x7f398c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:00.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.873+0000 7f399ed9d640 1 --2- 172.21.15.79:0/3579437663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c0039b0 0x7f398c003dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f399000c240 tx=0x7f398c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e543ffce1517ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:00.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.873+0000 7f399e59c640 1 -- 172.21.15.79:0/3579437663 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3990007d10 con 0x7f398c0039b0 2024-04-25T02:08:00.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.873+0000 7f399e59c640 1 -- 172.21.15.79:0/3579437663 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3990005ad0 con 0x7f398c0039b0 2024-04-25T02:08:00.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.873+0000 7f399e59c640 1 -- 172.21.15.79:0/3579437663 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3990007070 con 0x7f398c0039b0 2024-04-25T02:08:00.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.874+0000 7f39a51c1640 1 -- 172.21.15.79:0/3579437663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c0039b0 msgr2=0x7f398c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.874+0000 7f39a51c1640 1 --2- 172.21.15.79:0/3579437663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c0039b0 0x7f398c003dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f399000c240 tx=0x7f398c005830 comp rx=0 tx=0).stop 2024-04-25T02:08:00.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.874+0000 7f399f59e640 1 -- 172.21.15.79:0/3579437663 reap_dead start 2024-04-25T02:08:00.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.874+0000 7f39a51c1640 1 -- 172.21.15.79:0/3579437663 shutdown_connections 2024-04-25T02:08:00.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.874+0000 7f39a51c1640 1 -- 172.21.15.79:0/3579437663 >> 172.21.15.79:0/3579437663 conn(0x7f39a009d4a0 msgr2=0x7f39a00d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:00.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.874+0000 7f39a51c1640 1 -- 172.21.15.79:0/3579437663 shutdown_connections 2024-04-25T02:08:00.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.874+0000 7f39a51c1640 1 -- 172.21.15.79:0/3579437663 wait complete. 2024-04-25T02:08:00.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.875+0000 7f39a51c1640 1 Processor -- start 2024-04-25T02:08:00.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.875+0000 7f39a51c1640 1 -- start start 2024-04-25T02:08:00.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f39a51c1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f398c0039b0 0x7f39a0150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f39a51c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a00cdbb0 0x7f39a0151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f39a51c1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39a0151890 0x7f39a00b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f39a51c1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f39a00d4ee0 con 0x7f39a00cdbb0 2024-04-25T02:08:00.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f39a51c1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39a00cff00 con 0x7f398c0039b0 2024-04-25T02:08:00.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f39a51c1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f39a00d5060 con 0x7f39a0151890 2024-04-25T02:08:00.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f3997fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a00cdbb0 0x7f39a0151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f3997fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a00cdbb0 0x7f39a0151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51782/0 (socket says 172.21.15.79:51782) 2024-04-25T02:08:00.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f3997fff640 1 -- 172.21.15.79:0/3448279942 learned_addr learned my addr 172.21.15.79:0/3448279942 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:00.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f399ed9d640 1 --2- 172.21.15.79:0/3448279942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f398c0039b0 0x7f39a0150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f399f59e640 1 --2- 172.21.15.79:0/3448279942 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39a0151890 0x7f39a00b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f3997fff640 1 -- 172.21.15.79:0/3448279942 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39a0151890 msgr2=0x7f39a00b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f3997fff640 1 --2- 172.21.15.79:0/3448279942 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39a0151890 0x7f39a00b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f3997fff640 1 -- 172.21.15.79:0/3448279942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f398c0039b0 msgr2=0x7f39a0150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f3997fff640 1 --2- 172.21.15.79:0/3448279942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f398c0039b0 0x7f39a0150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f3997fff640 1 -- 172.21.15.79:0/3448279942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a00cc8e0 con 0x7f39a00cdbb0 2024-04-25T02:08:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f3997fff640 1 --2- 172.21.15.79:0/3448279942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a00cdbb0 0x7f39a0151350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3988011990 tx=0x7f3988011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.876+0000 7f39977fe640 1 -- 172.21.15.79:0/3448279942 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398800fad0 con 0x7f39a00cdbb0 2024-04-25T02:08:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.877+0000 7f39977fe640 1 -- 172.21.15.79:0/3448279942 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398800fc70 con 0x7f39a00cdbb0 2024-04-25T02:08:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.877+0000 7f39a51c1640 1 -- 172.21.15.79:0/3448279942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a00cacd0 con 0x7f39a00cdbb0 2024-04-25T02:08:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.877+0000 7f39977fe640 1 -- 172.21.15.79:0/3448279942 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3988014440 con 0x7f39a00cdbb0 2024-04-25T02:08:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.877+0000 7f39a51c1640 1 -- 172.21.15.79:0/3448279942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a00cd0d0 con 0x7f39a00cdbb0 2024-04-25T02:08:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.878+0000 7f39a51c1640 1 -- 172.21.15.79:0/3448279942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a00686c0 con 0x7f39a00cdbb0 2024-04-25T02:08:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.878+0000 7f39977fe640 1 -- 172.21.15.79:0/3448279942 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3988012040 con 0x7f39a00cdbb0 2024-04-25T02:08:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.878+0000 7f39977fe640 1 --2- 172.21.15.79:0/3448279942 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f398006be30 0x7f398006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.878+0000 7f39977fe640 1 -- 172.21.15.79:0/3448279942 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f398808b300 con 0x7f39a00cdbb0 2024-04-25T02:08:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.878+0000 7f399ed9d640 1 --2- 172.21.15.79:0/3448279942 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f398006be30 0x7f398006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.879+0000 7f399ed9d640 1 --2- 172.21.15.79:0/3448279942 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f398006be30 0x7f398006e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3990033000 tx=0x7f399002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:00.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:00.883+0000 7f39977fe640 1 -- 172.21.15.79:0/3448279942 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3988019030 con 0x7f39a00cdbb0 2024-04-25T02:08:01.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.098+0000 7f39a51c1640 1 -- 172.21.15.79:0/3448279942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f39a00d39d0 con 0x7f39a00cdbb0 2024-04-25T02:08:01.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.122+0000 7f39977fe640 1 -- 172.21.15.79:0/3448279942 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f39a00d39d0 con 0x7f39a00cdbb0 2024-04-25T02:08:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.124+0000 7f39a51c1640 1 -- 172.21.15.79:0/3448279942 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f398006be30 msgr2=0x7f398006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.124+0000 7f39a51c1640 1 --2- 172.21.15.79:0/3448279942 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f398006be30 0x7f398006e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3990033000 tx=0x7f399002e000 comp rx=0 tx=0).stop 2024-04-25T02:08:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.124+0000 7f39a51c1640 1 -- 172.21.15.79:0/3448279942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a00cdbb0 msgr2=0x7f39a0151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.124+0000 7f39a51c1640 1 --2- 172.21.15.79:0/3448279942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a00cdbb0 0x7f39a0151350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3988011990 tx=0x7f3988011e50 comp rx=0 tx=0).stop 2024-04-25T02:08:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.124+0000 7f39a51c1640 1 -- 172.21.15.79:0/3448279942 shutdown_connections 2024-04-25T02:08:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.124+0000 7f39a51c1640 1 --2- 172.21.15.79:0/3448279942 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f398006be30 0x7f398006e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.124+0000 7f39a51c1640 1 --2- 172.21.15.79:0/3448279942 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39a0151890 0x7f39a00b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.124+0000 7f39a51c1640 1 --2- 172.21.15.79:0/3448279942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a00cdbb0 0x7f39a0151350 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.124+0000 7f39a51c1640 1 --2- 172.21.15.79:0/3448279942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f398c0039b0 0x7f39a0150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.124+0000 7f39a51c1640 1 -- 172.21.15.79:0/3448279942 >> 172.21.15.79:0/3448279942 conn(0x7f39a009d4a0 msgr2=0x7f39a00d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.125+0000 7f39a51c1640 1 -- 172.21.15.79:0/3448279942 shutdown_connections 2024-04-25T02:08:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.125+0000 7f39a51c1640 1 -- 172.21.15.79:0/3448279942 wait complete. 2024-04-25T02:08:01.142 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T02:08:01.143 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T02:08:01.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.236+0000 7f58523a2640 1 Processor -- start 2024-04-25T02:08:01.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.236+0000 7f58523a2640 1 -- start start 2024-04-25T02:08:01.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f58523a2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f584c0cdb60 0x7f584c1691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:01.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f58523a2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f584c06d1f0 con 0x7f584c0d2a60 2024-04-25T02:08:01.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f58523a2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f584c0d1460 con 0x7f584c15e5a0 2024-04-25T02:08:01.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f58523a2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f584c0cc6c0 con 0x7f584c0cdb60 2024-04-25T02:08:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584b7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f584c0d2a60 0x7f584c06cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47598/0 (socket says 172.21.15.79:47598) 2024-04-25T02:08:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584b7fe640 1 -- 172.21.15.79:0/1494955608 learned_addr learned my addr 172.21.15.79:0/1494955608 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584affd640 1 -- 172.21.15.79:0/1494955608 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1964771520 0 0) 0x7f584c06d1f0 con 0x7f584c0d2a60 2024-04-25T02:08:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584affd640 1 -- 172.21.15.79:0/1494955608 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5838003520 con 0x7f584c0d2a60 2024-04-25T02:08:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f585093f640 1 --2- 172.21.15.79:0/1494955608 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f584c0cdb60 0x7f584c1691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584affd640 1 -- 172.21.15.79:0/1494955608 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 221137790 0 0) 0x7f5838003520 con 0x7f584c0d2a60 2024-04-25T02:08:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584affd640 1 -- 172.21.15.79:0/1494955608 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f584c0cdb60 msgr2=0x7f584c1691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584affd640 1 --2- 172.21.15.79:0/1494955608 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f584c0cdb60 0x7f584c1691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584affd640 1 -- 172.21.15.79:0/1494955608 >> v1:172.21.15.189:6789/0 conn(0x7f584c15e5a0 legacy=0x7f584c06c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584affd640 1 -- 172.21.15.79:0/1494955608 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584c0d0bc0 con 0x7f584c0d2a60 2024-04-25T02:08:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584affd640 1 -- 172.21.15.79:0/1494955608 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f583c001670 con 0x7f584c0d2a60 2024-04-25T02:08:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584affd640 1 -- 172.21.15.79:0/1494955608 >> v1:172.21.15.79:6789/0 conn(0x7f584c0d2a60 legacy=0x7f584c06cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584affd640 1 --2- 172.21.15.79:0/1494955608 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f584c0cdb60 0x7f58380039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584affd640 1 --2- 172.21.15.79:0/1494955608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5838003f60 0x7f5838004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584affd640 1 --2- 172.21.15.79:0/1494955608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838004d40 0x7f58380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584affd640 1 -- 172.21.15.79:0/1494955608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f584c0cc6c0 con 0x7f5838004d40 2024-04-25T02:08:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584affd640 1 -- 172.21.15.79:0/1494955608 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f583800baa0 con 0x7f5838003f60 2024-04-25T02:08:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f584affd640 1 -- 172.21.15.79:0/1494955608 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f583800bca0 con 0x7f584c0cdb60 2024-04-25T02:08:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.237+0000 7f585093f640 1 --2- 172.21.15.79:0/1494955608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838004d40 0x7f58380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.238+0000 7f584b7fe640 1 --2- 172.21.15.79:0/1494955608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5838003f60 0x7f5838004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.238+0000 7f584bfff640 1 --2- 172.21.15.79:0/1494955608 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f584c0cdb60 0x7f58380039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.238+0000 7f585093f640 1 -- 172.21.15.79:0/1494955608 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f584c0cdb60 msgr2=0x7f58380039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.238+0000 7f585093f640 1 --2- 172.21.15.79:0/1494955608 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f584c0cdb60 0x7f58380039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.238+0000 7f585093f640 1 -- 172.21.15.79:0/1494955608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5838003f60 msgr2=0x7f5838004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.238+0000 7f585093f640 1 --2- 172.21.15.79:0/1494955608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5838003f60 0x7f5838004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.238+0000 7f585093f640 1 -- 172.21.15.79:0/1494955608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5838003520 con 0x7f5838004d40 2024-04-25T02:08:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.238+0000 7f585093f640 1 --2- 172.21.15.79:0/1494955608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838004d40 0x7f58380051c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5844009f90 tx=0x7f5838005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fc1f98ad0ff4e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:01.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.238+0000 7f584affd640 1 -- 172.21.15.79:0/1494955608 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844009c10 con 0x7f5838004d40 2024-04-25T02:08:01.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.239+0000 7f584affd640 1 -- 172.21.15.79:0/1494955608 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5844036070 con 0x7f5838004d40 2024-04-25T02:08:01.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.239+0000 7f584affd640 1 -- 172.21.15.79:0/1494955608 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844031810 con 0x7f5838004d40 2024-04-25T02:08:01.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.239+0000 7f58523a2640 1 -- 172.21.15.79:0/1494955608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838004d40 msgr2=0x7f58380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:01.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.239+0000 7f58523a2640 1 --2- 172.21.15.79:0/1494955608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838004d40 0x7f58380051c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5844009f90 tx=0x7f5838005830 comp rx=0 tx=0).stop 2024-04-25T02:08:01.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.239+0000 7f585093f640 1 -- 172.21.15.79:0/1494955608 reap_dead start 2024-04-25T02:08:01.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.239+0000 7f58523a2640 1 -- 172.21.15.79:0/1494955608 shutdown_connections 2024-04-25T02:08:01.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.239+0000 7f58523a2640 1 -- 172.21.15.79:0/1494955608 >> 172.21.15.79:0/1494955608 conn(0x7f584c0d1f40 msgr2=0x7f584c0d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:01.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.239+0000 7f58523a2640 1 -- 172.21.15.79:0/1494955608 shutdown_connections 2024-04-25T02:08:01.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.239+0000 7f58523a2640 1 -- 172.21.15.79:0/1494955608 wait complete. 2024-04-25T02:08:01.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.240+0000 7f58523a2640 1 Processor -- start 2024-04-25T02:08:01.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.240+0000 7f58523a2640 1 -- start start 2024-04-25T02:08:01.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.241+0000 7f58523a2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838004d40 0x7f584c09c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:01.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.241+0000 7f58523a2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f584c150f30 0x7f584c151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:01.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.241+0000 7f58523a2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f584c159e00 0x7f584c15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:01.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.241+0000 7f58523a2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f584c0d1180 con 0x7f5838004d40 2024-04-25T02:08:01.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.241+0000 7f58523a2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f584c0cf7d0 con 0x7f584c159e00 2024-04-25T02:08:01.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.241+0000 7f58523a2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f584c15e980 con 0x7f584c150f30 2024-04-25T02:08:01.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.241+0000 7f584bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838004d40 0x7f584c09c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:01.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.241+0000 7f584bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838004d40 0x7f584c09c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51806/0 (socket says 172.21.15.79:51806) 2024-04-25T02:08:01.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.241+0000 7f584bfff640 1 -- 172.21.15.79:0/1156319556 learned_addr learned my addr 172.21.15.79:0/1156319556 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:01.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.241+0000 7f585093f640 1 --2- 172.21.15.79:0/1156319556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f584c159e00 0x7f584c15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:01.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.241+0000 7f584b7fe640 1 --2- 172.21.15.79:0/1156319556 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f584c150f30 0x7f584c151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.241+0000 7f584bfff640 1 -- 172.21.15.79:0/1156319556 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f584c150f30 msgr2=0x7f584c151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.241+0000 7f584bfff640 1 --2- 172.21.15.79:0/1156319556 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f584c150f30 0x7f584c151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.241+0000 7f584bfff640 1 -- 172.21.15.79:0/1156319556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f584c159e00 msgr2=0x7f584c15a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.241+0000 7f584bfff640 1 --2- 172.21.15.79:0/1156319556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f584c159e00 0x7f584c15a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.242+0000 7f584bfff640 1 -- 172.21.15.79:0/1156319556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584c1518b0 con 0x7f5838004d40 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.242+0000 7f585093f640 1 --2- 172.21.15.79:0/1156319556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f584c159e00 0x7f584c15a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.242+0000 7f584bfff640 1 --2- 172.21.15.79:0/1156319556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838004d40 0x7f584c09c190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f583400f820 tx=0x7f583400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.242+0000 7f5848ff9640 1 -- 172.21.15.79:0/1156319556 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58340050d0 con 0x7f5838004d40 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.242+0000 7f5848ff9640 1 -- 172.21.15.79:0/1156319556 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5834018070 con 0x7f5838004d40 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.242+0000 7f5848ff9640 1 -- 172.21.15.79:0/1156319556 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5834005490 con 0x7f5838004d40 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.242+0000 7f58523a2640 1 -- 172.21.15.79:0/1156319556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f584c0c6340 con 0x7f5838004d40 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.242+0000 7f58523a2640 1 -- 172.21.15.79:0/1156319556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f584c0c6600 con 0x7f5838004d40 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.243+0000 7f58523a2640 1 -- 172.21.15.79:0/1156319556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f584c0690a0 con 0x7f5838004d40 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.243+0000 7f5848ff9640 1 -- 172.21.15.79:0/1156319556 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f583400d730 con 0x7f5838004d40 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.244+0000 7f5848ff9640 1 --2- 172.21.15.79:0/1156319556 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f582c06be60 0x7f582c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:01.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.244+0000 7f584b7fe640 1 --2- 172.21.15.79:0/1156319556 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f582c06be60 0x7f582c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:01.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.244+0000 7f5848ff9640 1 -- 172.21.15.79:0/1156319556 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f583408acb0 con 0x7f5838004d40 2024-04-25T02:08:01.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.244+0000 7f584b7fe640 1 --2- 172.21.15.79:0/1156319556 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f582c06be60 0x7f582c06e320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f584c0ca500 tx=0x7f583c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:01.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.248+0000 7f5848ff9640 1 -- 172.21.15.79:0/1156319556 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f58340596f0 con 0x7f5838004d40 2024-04-25T02:08:01.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:01.456+0000 7f58523a2640 1 -- 172.21.15.79:0/1156319556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f584c06fe20 con 0x7f5838004d40 2024-04-25T02:08:02.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.131+0000 7f5848ff9640 1 -- 172.21.15.79:0/1156319556 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f5834058ff0 con 0x7f5838004d40 2024-04-25T02:08:02.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.133+0000 7f58523a2640 1 -- 172.21.15.79:0/1156319556 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f582c06be60 msgr2=0x7f582c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.133+0000 7f58523a2640 1 --2- 172.21.15.79:0/1156319556 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f582c06be60 0x7f582c06e320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f584c0ca500 tx=0x7f583c009040 comp rx=0 tx=0).stop 2024-04-25T02:08:02.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.133+0000 7f58523a2640 1 -- 172.21.15.79:0/1156319556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838004d40 msgr2=0x7f584c09c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.133+0000 7f58523a2640 1 --2- 172.21.15.79:0/1156319556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838004d40 0x7f584c09c190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f583400f820 tx=0x7f583400fce0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.134+0000 7f58523a2640 1 -- 172.21.15.79:0/1156319556 shutdown_connections 2024-04-25T02:08:02.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.134+0000 7f58523a2640 1 --2- 172.21.15.79:0/1156319556 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f582c06be60 0x7f582c06e320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.134+0000 7f58523a2640 1 --2- 172.21.15.79:0/1156319556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f584c159e00 0x7f584c15a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.134+0000 7f58523a2640 1 --2- 172.21.15.79:0/1156319556 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f584c150f30 0x7f584c151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.134+0000 7f58523a2640 1 --2- 172.21.15.79:0/1156319556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838004d40 0x7f584c09c190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.134+0000 7f58523a2640 1 -- 172.21.15.79:0/1156319556 >> 172.21.15.79:0/1156319556 conn(0x7f584c0d1f40 msgr2=0x7f584c15d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:02.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.134+0000 7f58523a2640 1 -- 172.21.15.79:0/1156319556 shutdown_connections 2024-04-25T02:08:02.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.134+0000 7f58523a2640 1 -- 172.21.15.79:0/1156319556 wait complete. 2024-04-25T02:08:02.153 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T02:08:02.154 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:08:02.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.249+0000 7fdb88d30640 1 Processor -- start 2024-04-25T02:08:02.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.249+0000 7fdb88d30640 1 -- start start 2024-04-25T02:08:02.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.250+0000 7fdb88d30640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fdb84066ea0 0x7fdb840c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.250+0000 7fdb88d30640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb8406b7c0 con 0x7fdb8415e140 2024-04-25T02:08:02.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.250+0000 7fdb88d30640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb840cea70 con 0x7fdb8415e520 2024-04-25T02:08:02.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.250+0000 7fdb88d30640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fdb84067480 con 0x7fdb84066ea0 2024-04-25T02:08:02.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.250+0000 7fdb8259c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdb8415e140 0x7fdb840af8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47604/0 (socket says 172.21.15.79:47604) 2024-04-25T02:08:02.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.250+0000 7fdb8259c640 1 -- 172.21.15.79:0/3565064235 learned_addr learned my addr 172.21.15.79:0/3565064235 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:02.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.250+0000 7fdb8159a640 1 -- 172.21.15.79:0/3565064235 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2415892301 0 0) 0x7fdb8406b7c0 con 0x7fdb8415e140 2024-04-25T02:08:02.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.250+0000 7fdb82d9d640 1 --2- 172.21.15.79:0/3565064235 >> v2:172.21.15.189:3300/0 conn(0x7fdb84066ea0 0x7fdb840c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.250+0000 7fdb8159a640 1 -- 172.21.15.79:0/3565064235 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb6c003520 con 0x7fdb8415e140 2024-04-25T02:08:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.250+0000 7fdb8159a640 1 -- 172.21.15.79:0/3565064235 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 565048036 0 0) 0x7fdb6c003520 con 0x7fdb8415e140 2024-04-25T02:08:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.250+0000 7fdb8159a640 1 -- 172.21.15.79:0/3565064235 >> v2:172.21.15.189:3300/0 conn(0x7fdb84066ea0 msgr2=0x7fdb840c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.250+0000 7fdb8159a640 1 --2- 172.21.15.79:0/3565064235 >> v2:172.21.15.189:3300/0 conn(0x7fdb84066ea0 0x7fdb840c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8159a640 1 -- 172.21.15.79:0/3565064235 >> v1:172.21.15.189:6789/0 conn(0x7fdb8415e520 legacy=0x7fdb8406b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8159a640 1 -- 172.21.15.79:0/3565064235 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb840ced50 con 0x7fdb8415e140 2024-04-25T02:08:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8159a640 1 -- 172.21.15.79:0/3565064235 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fdb740019f0 con 0x7fdb8415e140 2024-04-25T02:08:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8159a640 1 -- 172.21.15.79:0/3565064235 >> v1:172.21.15.79:6789/0 conn(0x7fdb8415e140 legacy=0x7fdb840af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8159a640 1 --2- 172.21.15.79:0/3565064235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb6c0039b0 0x7fdb6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8159a640 1 --2- 172.21.15.79:0/3565064235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb6c004800 0x7fdb6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8159a640 1 --2- 172.21.15.79:0/3565064235 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdb6c0051c0 0x7fdb6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8159a640 1 -- 172.21.15.79:0/3565064235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdb84067480 con 0x7fdb6c0039b0 2024-04-25T02:08:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8159a640 1 -- 172.21.15.79:0/3565064235 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c00c160 con 0x7fdb6c004800 2024-04-25T02:08:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8159a640 1 -- 172.21.15.79:0/3565064235 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdb6c00c360 con 0x7fdb6c0051c0 2024-04-25T02:08:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8259c640 1 --2- 172.21.15.79:0/3565064235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb6c0039b0 0x7fdb6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb82d9d640 1 --2- 172.21.15.79:0/3565064235 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdb6c0051c0 0x7fdb6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb81d9b640 1 --2- 172.21.15.79:0/3565064235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb6c004800 0x7fdb6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8259c640 1 -- 172.21.15.79:0/3565064235 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdb6c0051c0 msgr2=0x7fdb6c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8259c640 1 --2- 172.21.15.79:0/3565064235 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdb6c0051c0 0x7fdb6c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8259c640 1 -- 172.21.15.79:0/3565064235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb6c004800 msgr2=0x7fdb6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8259c640 1 --2- 172.21.15.79:0/3565064235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb6c004800 0x7fdb6c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb8259c640 1 -- 172.21.15.79:0/3565064235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6c003520 con 0x7fdb6c0039b0 2024-04-25T02:08:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb82d9d640 1 --2- 172.21.15.79:0/3565064235 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdb6c0051c0 0x7fdb6c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.251+0000 7fdb82d9d640 1 -- 172.21.15.79:0/3565064235 reap_dead start 2024-04-25T02:08:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.252+0000 7fdb8259c640 1 --2- 172.21.15.79:0/3565064235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb6c0039b0 0x7fdb6c003dd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400a840 tx=0x7fdb6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b76bb3d9223ec48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.252+0000 7fdb8159a640 1 -- 172.21.15.79:0/3565064235 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400a460 con 0x7fdb6c0039b0 2024-04-25T02:08:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.252+0000 7fdb8159a640 1 -- 172.21.15.79:0/3565064235 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7402f070 con 0x7fdb6c0039b0 2024-04-25T02:08:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.252+0000 7fdb8159a640 1 -- 172.21.15.79:0/3565064235 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7402bc50 con 0x7fdb6c0039b0 2024-04-25T02:08:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.252+0000 7fdb88d30640 1 -- 172.21.15.79:0/3565064235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb6c0039b0 msgr2=0x7fdb6c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.252+0000 7fdb88d30640 1 --2- 172.21.15.79:0/3565064235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb6c0039b0 0x7fdb6c003dd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400a840 tx=0x7fdb6c005830 comp rx=0 tx=0).stop 2024-04-25T02:08:02.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.252+0000 7fdb88d30640 1 -- 172.21.15.79:0/3565064235 shutdown_connections 2024-04-25T02:08:02.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.252+0000 7fdb88d30640 1 --2- 172.21.15.79:0/3565064235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb6c0039b0 0x7fdb6c003dd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.252+0000 7fdb88d30640 1 -- 172.21.15.79:0/3565064235 >> 172.21.15.79:0/3565064235 conn(0x7fdb840ccee0 msgr2=0x7fdb840cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:02.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.252+0000 7fdb88d30640 1 -- 172.21.15.79:0/3565064235 shutdown_connections 2024-04-25T02:08:02.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.252+0000 7fdb88d30640 1 -- 172.21.15.79:0/3565064235 wait complete. 2024-04-25T02:08:02.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.254+0000 7fdb88d30640 1 Processor -- start 2024-04-25T02:08:02.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.254+0000 7fdb88d30640 1 -- start start 2024-04-25T02:08:02.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.254+0000 7fdb88d30640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb6c0039b0 0x7fdb84146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.254+0000 7fdb88d30640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdb84148340 0x7fdb841455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.254+0000 7fdb88d30640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb841f4130 0x7fdb84147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.254+0000 7fdb88d30640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8406b0b0 con 0x7fdb6c0039b0 2024-04-25T02:08:02.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.254+0000 7fdb88d30640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdb840cf3a0 con 0x7fdb841f4130 2024-04-25T02:08:02.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.254+0000 7fdb88d30640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdb8406b230 con 0x7fdb84148340 2024-04-25T02:08:02.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb8259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb6c0039b0 0x7fdb84146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb8259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb6c0039b0 0x7fdb84146f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51818/0 (socket says 172.21.15.79:51818) 2024-04-25T02:08:02.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb8259c640 1 -- 172.21.15.79:0/728445024 learned_addr learned my addr 172.21.15.79:0/728445024 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:02.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb82d9d640 1 --2- 172.21.15.79:0/728445024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb841f4130 0x7fdb84147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb81d9b640 1 --2- 172.21.15.79:0/728445024 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdb84148340 0x7fdb841455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb8259c640 1 -- 172.21.15.79:0/728445024 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdb84148340 msgr2=0x7fdb841455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb8259c640 1 --2- 172.21.15.79:0/728445024 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdb84148340 0x7fdb841455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb8259c640 1 -- 172.21.15.79:0/728445024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb841f4130 msgr2=0x7fdb84147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb8259c640 1 --2- 172.21.15.79:0/728445024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb841f4130 0x7fdb84147680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb8259c640 1 -- 172.21.15.79:0/728445024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb84145ef0 con 0x7fdb6c0039b0 2024-04-25T02:08:02.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb8259c640 1 --2- 172.21.15.79:0/728445024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb6c0039b0 0x7fdb84146f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400a840 tx=0x7fdb840cec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:02.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb72ffd640 1 -- 172.21.15.79:0/728445024 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74001fb0 con 0x7fdb6c0039b0 2024-04-25T02:08:02.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb72ffd640 1 -- 172.21.15.79:0/728445024 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb74034670 con 0x7fdb6c0039b0 2024-04-25T02:08:02.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb72ffd640 1 -- 172.21.15.79:0/728445024 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74034a20 con 0x7fdb6c0039b0 2024-04-25T02:08:02.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb88d30640 1 -- 172.21.15.79:0/728445024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb841461d0 con 0x7fdb6c0039b0 2024-04-25T02:08:02.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.255+0000 7fdb88d30640 1 -- 172.21.15.79:0/728445024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb84146790 con 0x7fdb6c0039b0 2024-04-25T02:08:02.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.256+0000 7fdb88d30640 1 -- 172.21.15.79:0/728445024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb840690a0 con 0x7fdb6c0039b0 2024-04-25T02:08:02.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.257+0000 7fdb72ffd640 1 -- 172.21.15.79:0/728445024 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb74034bc0 con 0x7fdb6c0039b0 2024-04-25T02:08:02.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.257+0000 7fdb72ffd640 1 --2- 172.21.15.79:0/728445024 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdb6406be60 0x7fdb6406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.257+0000 7fdb81d9b640 1 --2- 172.21.15.79:0/728445024 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdb6406be60 0x7fdb6406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.257+0000 7fdb72ffd640 1 -- 172.21.15.79:0/728445024 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdb740ab0b0 con 0x7fdb6c0039b0 2024-04-25T02:08:02.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.257+0000 7fdb81d9b640 1 --2- 172.21.15.79:0/728445024 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdb6406be60 0x7fdb6406e320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdb840cc1f0 tx=0x7fdb78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:02.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.261+0000 7fdb72ffd640 1 -- 172.21.15.79:0/728445024 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdb74079410 con 0x7fdb6c0039b0 2024-04-25T02:08:02.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.470+0000 7fdb88d30640 1 -- 172.21.15.79:0/728445024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb840cdc50 con 0x7fdb6c0039b0 2024-04-25T02:08:02.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.471+0000 7fdb72ffd640 1 -- 172.21.15.79:0/728445024 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7fdb7407d710 con 0x7fdb6c0039b0 2024-04-25T02:08:02.478 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:02.478 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/465663373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":465663373},{"type":"v1","addr":"172.21.15.189:6833","nonce":465663373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2093278785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2093278785},{"type":"v1","addr":"172.21.15.79:6836","nonce":2093278785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2415912880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2415912880},{"type":"v1","addr":"172.21.15.189:6835","nonce":2415912880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:07:59.452096+0000","modified":"2024-04-25T02:08:01.458029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2942986974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2942986974},{"type":"v1","addr":"172.21.15.79:6837","nonce":2942986974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-25T02:08:02.478 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2024-04-25T02:08:02.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.473+0000 7fdb88d30640 1 -- 172.21.15.79:0/728445024 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdb6406be60 msgr2=0x7fdb6406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.473+0000 7fdb88d30640 1 --2- 172.21.15.79:0/728445024 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdb6406be60 0x7fdb6406e320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdb840cc1f0 tx=0x7fdb78009040 comp rx=0 tx=0).stop 2024-04-25T02:08:02.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.473+0000 7fdb88d30640 1 -- 172.21.15.79:0/728445024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb6c0039b0 msgr2=0x7fdb84146f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.473+0000 7fdb88d30640 1 --2- 172.21.15.79:0/728445024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb6c0039b0 0x7fdb84146f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400a840 tx=0x7fdb840cec40 comp rx=0 tx=0).stop 2024-04-25T02:08:02.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.473+0000 7fdb88d30640 1 -- 172.21.15.79:0/728445024 shutdown_connections 2024-04-25T02:08:02.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.473+0000 7fdb88d30640 1 --2- 172.21.15.79:0/728445024 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdb6406be60 0x7fdb6406e320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.473+0000 7fdb88d30640 1 --2- 172.21.15.79:0/728445024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb841f4130 0x7fdb84147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.473+0000 7fdb88d30640 1 --2- 172.21.15.79:0/728445024 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdb84148340 0x7fdb841455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.473+0000 7fdb88d30640 1 --2- 172.21.15.79:0/728445024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb6c0039b0 0x7fdb84146f90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.473+0000 7fdb88d30640 1 -- 172.21.15.79:0/728445024 >> 172.21.15.79:0/728445024 conn(0x7fdb840ccee0 msgr2=0x7fdb840cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:02.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.473+0000 7fdb88d30640 1 -- 172.21.15.79:0/728445024 shutdown_connections 2024-04-25T02:08:02.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.473+0000 7fdb88d30640 1 -- 172.21.15.79:0/728445024 wait complete. 2024-04-25T02:08:02.490 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:02.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.579+0000 7f4259942640 1 Processor -- start 2024-04-25T02:08:02.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.579+0000 7f4259942640 1 -- start start 2024-04-25T02:08:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.580+0000 7f4259942640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f42540d2a90 0x7f42540cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.580+0000 7f4259942640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f425415e610 0x7f42540d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.580+0000 7f4259942640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f425415f000 con 0x7f42540d26b0 2024-04-25T02:08:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.580+0000 7f4259942640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f425415f2e0 con 0x7f42540d2a90 2024-04-25T02:08:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.580+0000 7f4259942640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f425415f5c0 con 0x7f425415e610 2024-04-25T02:08:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.580+0000 7f42527fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f42540d2a90 0x7f42540cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.580+0000 7f4252ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f42540d26b0 0x7f42540d1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47618/0 (socket says 172.21.15.79:47618) 2024-04-25T02:08:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.580+0000 7f4252ffd640 1 -- 172.21.15.79:0/2037488061 learned_addr learned my addr 172.21.15.79:0/2037488061 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.580+0000 7f42537fe640 1 --2- 172.21.15.79:0/2037488061 >> v2:172.21.15.189:3300/0 conn(0x7f425415e610 0x7f42540d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.580+0000 7f42527fc640 1 -- 172.21.15.79:0/2037488061 >> v2:172.21.15.189:3300/0 conn(0x7f425415e610 msgr2=0x7f42540d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.580+0000 7f42527fc640 1 --2- 172.21.15.79:0/2037488061 >> v2:172.21.15.189:3300/0 conn(0x7f425415e610 0x7f42540d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.580+0000 7f42527fc640 1 -- 172.21.15.79:0/2037488061 >> v1:172.21.15.79:6789/0 conn(0x7f42540d26b0 legacy=0x7f42540d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.581+0000 7f42527fc640 1 -- 172.21.15.79:0/2037488061 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42540d0ad0 con 0x7f42540d2a90 2024-04-25T02:08:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.580+0000 7f4251ffb640 1 -- 172.21.15.79:0/2037488061 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2644288238 0 0) 0x7f425415f000 con 0x7f42540d26b0 2024-04-25T02:08:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.581+0000 7f42527fc640 1 --2- 172.21.15.79:0/2037488061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42540d2a90 0x7f42540cecc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4254161e80 tx=0x7f424802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5567e1b5d888bed0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.581+0000 7f4251ffb640 1 -- 172.21.15.79:0/2037488061 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4248037070 con 0x7f42540d2a90 2024-04-25T02:08:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.581+0000 7f4251ffb640 1 -- 172.21.15.79:0/2037488061 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4248032440 con 0x7f42540d2a90 2024-04-25T02:08:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.581+0000 7f4251ffb640 1 -- 172.21.15.79:0/2037488061 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4248032810 con 0x7f42540d2a90 2024-04-25T02:08:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.582+0000 7f4259942640 1 -- 172.21.15.79:0/2037488061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42540d2a90 msgr2=0x7f42540cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.582+0000 7f4259942640 1 --2- 172.21.15.79:0/2037488061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42540d2a90 0x7f42540cecc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4254161e80 tx=0x7f424802a230 comp rx=0 tx=0).stop 2024-04-25T02:08:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.582+0000 7f4259942640 1 -- 172.21.15.79:0/2037488061 shutdown_connections 2024-04-25T02:08:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.582+0000 7f4259942640 1 --2- 172.21.15.79:0/2037488061 >> v2:172.21.15.189:3300/0 conn(0x7f425415e610 0x7f42540d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.582+0000 7f4259942640 1 --2- 172.21.15.79:0/2037488061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42540d2a90 0x7f42540cecc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.582+0000 7f4259942640 1 -- 172.21.15.79:0/2037488061 >> 172.21.15.79:0/2037488061 conn(0x7f42540d40d0 msgr2=0x7f42540d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.582+0000 7f4259942640 1 -- 172.21.15.79:0/2037488061 shutdown_connections 2024-04-25T02:08:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.582+0000 7f4259942640 1 -- 172.21.15.79:0/2037488061 wait complete. 2024-04-25T02:08:02.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.583+0000 7f4259942640 1 Processor -- start 2024-04-25T02:08:02.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.583+0000 7f4259942640 1 -- start start 2024-04-25T02:08:02.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f4259942640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42540d26b0 0x7f4254156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f4259942640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42540d2a90 0x7f42540b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f4259942640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f425415e610 0x7f42540b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f4259942640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f42540d2ed0 con 0x7f425415e610 2024-04-25T02:08:02.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f4259942640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f42540cf200 con 0x7f42540d26b0 2024-04-25T02:08:02.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f4259942640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f42540b7a20 con 0x7f42540d2a90 2024-04-25T02:08:02.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f42537fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f425415e610 0x7f42540b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f42537fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f425415e610 0x7f42540b8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51828/0 (socket says 172.21.15.79:51828) 2024-04-25T02:08:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f42537fe640 1 -- 172.21.15.79:0/476664076 learned_addr learned my addr 172.21.15.79:0/476664076 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f4252ffd640 1 --2- 172.21.15.79:0/476664076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42540d26b0 0x7f4254156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f42527fc640 1 --2- 172.21.15.79:0/476664076 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42540d2a90 0x7f42540b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f42537fe640 1 -- 172.21.15.79:0/476664076 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42540d2a90 msgr2=0x7f42540b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f42537fe640 1 --2- 172.21.15.79:0/476664076 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42540d2a90 0x7f42540b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f42537fe640 1 -- 172.21.15.79:0/476664076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42540d26b0 msgr2=0x7f4254156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f42537fe640 1 --2- 172.21.15.79:0/476664076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42540d26b0 0x7f4254156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f42537fe640 1 -- 172.21.15.79:0/476664076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42540b7ca0 con 0x7f425415e610 2024-04-25T02:08:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f4252ffd640 1 --2- 172.21.15.79:0/476664076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42540d26b0 0x7f4254156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.584+0000 7f42537fe640 1 --2- 172.21.15.79:0/476664076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f425415e610 0x7f42540b8a60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f424c00d5d0 tx=0x7f424c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.585+0000 7f423bfff640 1 -- 172.21.15.79:0/476664076 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c0125f0 con 0x7f425415e610 2024-04-25T02:08:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.585+0000 7f423bfff640 1 -- 172.21.15.79:0/476664076 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f424c019070 con 0x7f425415e610 2024-04-25T02:08:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.585+0000 7f4259942640 1 -- 172.21.15.79:0/476664076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42540b7f80 con 0x7f425415e610 2024-04-25T02:08:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.585+0000 7f423bfff640 1 -- 172.21.15.79:0/476664076 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c0129f0 con 0x7f425415e610 2024-04-25T02:08:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.585+0000 7f4259942640 1 -- 172.21.15.79:0/476664076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42540b8540 con 0x7f425415e610 2024-04-25T02:08:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.586+0000 7f4259942640 1 -- 172.21.15.79:0/476664076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42541574c0 con 0x7f425415e610 2024-04-25T02:08:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.586+0000 7f423bfff640 1 -- 172.21.15.79:0/476664076 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f424c012b90 con 0x7f425415e610 2024-04-25T02:08:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.586+0000 7f423bfff640 1 --2- 172.21.15.79:0/476664076 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f424006be30 0x7f424006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.586+0000 7f423bfff640 1 -- 172.21.15.79:0/476664076 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f424c08b1d0 con 0x7f425415e610 2024-04-25T02:08:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.586+0000 7f4252ffd640 1 --2- 172.21.15.79:0/476664076 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f424006be30 0x7f424006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.587+0000 7f4252ffd640 1 --2- 172.21.15.79:0/476664076 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f424006be30 0x7f424006e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f42440012e0 tx=0x7f4244007f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:02.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.591+0000 7f423bfff640 1 -- 172.21.15.79:0/476664076 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f42541574c0 con 0x7f425415e610 2024-04-25T02:08:02.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.762+0000 7f4259942640 1 -- 172.21.15.79:0/476664076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42540681e0 con 0x7f425415e610 2024-04-25T02:08:02.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.763+0000 7f423bfff640 1 -- 172.21.15.79:0/476664076 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f424c059b90 con 0x7f425415e610 2024-04-25T02:08:02.771 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:02.771 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:02.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.765+0000 7f4259942640 1 -- 172.21.15.79:0/476664076 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f424006be30 msgr2=0x7f424006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.765+0000 7f4259942640 1 --2- 172.21.15.79:0/476664076 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f424006be30 0x7f424006e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f42440012e0 tx=0x7f4244007f90 comp rx=0 tx=0).stop 2024-04-25T02:08:02.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.765+0000 7f4259942640 1 -- 172.21.15.79:0/476664076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f425415e610 msgr2=0x7f42540b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.765+0000 7f4259942640 1 --2- 172.21.15.79:0/476664076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f425415e610 0x7f42540b8a60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f424c00d5d0 tx=0x7f424c00da90 comp rx=0 tx=0).stop 2024-04-25T02:08:02.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.765+0000 7f4259942640 1 -- 172.21.15.79:0/476664076 shutdown_connections 2024-04-25T02:08:02.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.765+0000 7f4259942640 1 --2- 172.21.15.79:0/476664076 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f424006be30 0x7f424006e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.765+0000 7f4259942640 1 --2- 172.21.15.79:0/476664076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f425415e610 0x7f42540b8a60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.765+0000 7f4259942640 1 --2- 172.21.15.79:0/476664076 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42540d2a90 0x7f42540b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.765+0000 7f4259942640 1 --2- 172.21.15.79:0/476664076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42540d26b0 0x7f4254156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.765+0000 7f4259942640 1 -- 172.21.15.79:0/476664076 >> 172.21.15.79:0/476664076 conn(0x7f42540d40d0 msgr2=0x7f425406cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:02.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.766+0000 7f4259942640 1 -- 172.21.15.79:0/476664076 shutdown_connections 2024-04-25T02:08:02.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.766+0000 7f4259942640 1 -- 172.21.15.79:0/476664076 wait complete. 2024-04-25T02:08:02.784 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T02:08:02.784 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:08:02.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.873+0000 7f0020aae640 1 Processor -- start 2024-04-25T02:08:02.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.873+0000 7f0020aae640 1 -- start start 2024-04-25T02:08:02.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.874+0000 7f0020aae640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f001c15e4d0 0x7f001c06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.874+0000 7f0020aae640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f001c0d2e20 0x7f001c0cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.874+0000 7f0020aae640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f001c0d1660 con 0x7f001c0b3570 2024-04-25T02:08:02.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.874+0000 7f0020aae640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f001c0d1380 con 0x7f001c15e4d0 2024-04-25T02:08:02.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.874+0000 7f0020aae640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f001c0cede0 con 0x7f001c0d2e20 2024-04-25T02:08:02.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.874+0000 7f001a59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f001c15e4d0 0x7f001c06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.874+0000 7f001a59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f001c15e4d0 0x7f001c06bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51844/0 (socket says 172.21.15.79:51844) 2024-04-25T02:08:02.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.874+0000 7f001a59c640 1 -- 172.21.15.79:0/1995976345 learned_addr learned my addr 172.21.15.79:0/1995976345 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:02.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.875+0000 7f001a59c640 1 -- 172.21.15.79:0/1995976345 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f001c0d2e20 msgr2=0x7f001c0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:02.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.875+0000 7f001ad9d640 1 --2- 172.21.15.79:0/1995976345 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f001c0d2e20 0x7f001c0cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.875+0000 7f001a59c640 1 --2- 172.21.15.79:0/1995976345 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f001c0d2e20 0x7f001c0cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.875+0000 7f001a59c640 1 -- 172.21.15.79:0/1995976345 >> v1:172.21.15.189:6789/0 conn(0x7f001c0b3570 legacy=0x7f001c0d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:02.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.875+0000 7f001a59c640 1 -- 172.21.15.79:0/1995976345 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c0cf0c0 con 0x7f001c15e4d0 2024-04-25T02:08:02.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.875+0000 7f001a59c640 1 --2- 172.21.15.79:0/1995976345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001c15e4d0 0x7f001c06bc70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f000c009e80 tx=0x7f000c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242bbb21d566e495 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:02.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.875+0000 7f001959a640 1 -- 172.21.15.79:0/1995976345 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c036070 con 0x7f001c15e4d0 2024-04-25T02:08:02.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.876+0000 7f001959a640 1 -- 172.21.15.79:0/1995976345 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c031600 con 0x7f001c15e4d0 2024-04-25T02:08:02.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.876+0000 7f001959a640 1 -- 172.21.15.79:0/1995976345 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c0319d0 con 0x7f001c15e4d0 2024-04-25T02:08:02.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.876+0000 7f0020aae640 1 -- 172.21.15.79:0/1995976345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001c15e4d0 msgr2=0x7f001c06bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.876+0000 7f0020aae640 1 --2- 172.21.15.79:0/1995976345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001c15e4d0 0x7f001c06bc70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f000c009e80 tx=0x7f000c02a6f0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.876+0000 7f0020aae640 1 -- 172.21.15.79:0/1995976345 shutdown_connections 2024-04-25T02:08:02.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.876+0000 7f0020aae640 1 --2- 172.21.15.79:0/1995976345 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f001c0d2e20 0x7f001c0cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.876+0000 7f0020aae640 1 --2- 172.21.15.79:0/1995976345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001c15e4d0 0x7f001c06bc70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.876+0000 7f0020aae640 1 -- 172.21.15.79:0/1995976345 >> 172.21.15.79:0/1995976345 conn(0x7f001c09d460 msgr2=0x7f001c0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:02.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.876+0000 7f0020aae640 1 -- 172.21.15.79:0/1995976345 shutdown_connections 2024-04-25T02:08:02.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.876+0000 7f0020aae640 1 -- 172.21.15.79:0/1995976345 wait complete. 2024-04-25T02:08:02.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.877+0000 7f0020aae640 1 Processor -- start 2024-04-25T02:08:02.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.877+0000 7f0020aae640 1 -- start start 2024-04-25T02:08:02.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.878+0000 7f0020aae640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f001c0b3570 0x7f001c1e8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.878+0000 7f0020aae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001c0d2e20 0x7f001c0b9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.878+0000 7f0020aae640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f001c15e4d0 0x7f001c14ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.878+0000 7f0020aae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f001c0d2250 con 0x7f001c0d2e20 2024-04-25T02:08:02.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.878+0000 7f0020aae640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f001c0d20d0 con 0x7f001c15e4d0 2024-04-25T02:08:02.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.878+0000 7f0020aae640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f001c06c1b0 con 0x7f001c0b3570 2024-04-25T02:08:02.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.878+0000 7f0019d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001c0d2e20 0x7f001c0b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.878+0000 7f0019d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001c0d2e20 0x7f001c0b9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51852/0 (socket says 172.21.15.79:51852) 2024-04-25T02:08:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.878+0000 7f0019d9b640 1 -- 172.21.15.79:0/1457959491 learned_addr learned my addr 172.21.15.79:0/1457959491 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.878+0000 7f001ad9d640 1 --2- 172.21.15.79:0/1457959491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f001c15e4d0 0x7f001c14ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.878+0000 7f001a59c640 1 --2- 172.21.15.79:0/1457959491 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f001c0b3570 0x7f001c1e8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.879+0000 7f0019d9b640 1 -- 172.21.15.79:0/1457959491 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f001c0b3570 msgr2=0x7f001c1e8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.879+0000 7f0019d9b640 1 --2- 172.21.15.79:0/1457959491 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f001c0b3570 0x7f001c1e8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.879+0000 7f0019d9b640 1 -- 172.21.15.79:0/1457959491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f001c15e4d0 msgr2=0x7f001c14ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.879+0000 7f0019d9b640 1 --2- 172.21.15.79:0/1457959491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f001c15e4d0 0x7f001c14ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.879+0000 7f0019d9b640 1 -- 172.21.15.79:0/1457959491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c1e9170 con 0x7f001c0d2e20 2024-04-25T02:08:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.879+0000 7f001a59c640 1 --2- 172.21.15.79:0/1457959491 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f001c0b3570 0x7f001c1e8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.879+0000 7f0019d9b640 1 --2- 172.21.15.79:0/1457959491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001c0d2e20 0x7f001c0b9160 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f001000c430 tx=0x7f001000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.879+0000 7f000affd640 1 -- 172.21.15.79:0/1457959491 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010011790 con 0x7f001c0d2e20 2024-04-25T02:08:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.879+0000 7f000affd640 1 -- 172.21.15.79:0/1457959491 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0010017070 con 0x7f001c0d2e20 2024-04-25T02:08:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.879+0000 7f0020aae640 1 -- 172.21.15.79:0/1457959491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001c1e9450 con 0x7f001c0d2e20 2024-04-25T02:08:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.879+0000 7f000affd640 1 -- 172.21.15.79:0/1457959491 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010011bb0 con 0x7f001c0d2e20 2024-04-25T02:08:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.879+0000 7f0020aae640 1 -- 172.21.15.79:0/1457959491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001c1e9cf0 con 0x7f001c0d2e20 2024-04-25T02:08:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.880+0000 7f0020aae640 1 -- 172.21.15.79:0/1457959491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001c0690a0 con 0x7f001c0d2e20 2024-04-25T02:08:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.880+0000 7f000affd640 1 -- 172.21.15.79:0/1457959491 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f001001c460 con 0x7f001c0d2e20 2024-04-25T02:08:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.881+0000 7f000affd640 1 --2- 172.21.15.79:0/1457959491 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efffc06be30 0x7efffc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.881+0000 7f001a59c640 1 --2- 172.21.15.79:0/1457959491 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efffc06be30 0x7efffc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.881+0000 7f000affd640 1 -- 172.21.15.79:0/1457959491 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f001008acb0 con 0x7f001c0d2e20 2024-04-25T02:08:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.881+0000 7f001a59c640 1 --2- 172.21.15.79:0/1457959491 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efffc06be30 0x7efffc06e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f000c033000 tx=0x7f000c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:02.885+0000 7f000affd640 1 -- 172.21.15.79:0/1457959491 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0010059660 con 0x7f001c0d2e20 2024-04-25T02:08:03.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.059+0000 7f0020aae640 1 -- 172.21.15.79:0/1457959491 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f001c0ce560 con 0x7efffc06be30 2024-04-25T02:08:03.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.065+0000 7f000affd640 1 -- 172.21.15.79:0/1457959491 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7f001c0ce560 con 0x7efffc06be30 2024-04-25T02:08:03.074 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:03.075 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:08:03.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.068+0000 7f0020aae640 1 -- 172.21.15.79:0/1457959491 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efffc06be30 msgr2=0x7efffc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.068+0000 7f0020aae640 1 --2- 172.21.15.79:0/1457959491 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efffc06be30 0x7efffc06e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f000c033000 tx=0x7f000c009000 comp rx=0 tx=0).stop 2024-04-25T02:08:03.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.068+0000 7f0020aae640 1 -- 172.21.15.79:0/1457959491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001c0d2e20 msgr2=0x7f001c0b9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.068+0000 7f0020aae640 1 --2- 172.21.15.79:0/1457959491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001c0d2e20 0x7f001c0b9160 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f001000c430 tx=0x7f001000c8f0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.068+0000 7f0020aae640 1 -- 172.21.15.79:0/1457959491 shutdown_connections 2024-04-25T02:08:03.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.068+0000 7f0020aae640 1 --2- 172.21.15.79:0/1457959491 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efffc06be30 0x7efffc06e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.068+0000 7f0020aae640 1 --2- 172.21.15.79:0/1457959491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f001c15e4d0 0x7f001c14ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.068+0000 7f0020aae640 1 --2- 172.21.15.79:0/1457959491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001c0d2e20 0x7f001c0b9160 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.068+0000 7f0020aae640 1 --2- 172.21.15.79:0/1457959491 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f001c0b3570 0x7f001c1e8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.068+0000 7f0020aae640 1 -- 172.21.15.79:0/1457959491 >> 172.21.15.79:0/1457959491 conn(0x7f001c09d460 msgr2=0x7f001c0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:03.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.068+0000 7f0020aae640 1 -- 172.21.15.79:0/1457959491 shutdown_connections 2024-04-25T02:08:03.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.068+0000 7f0020aae640 1 -- 172.21.15.79:0/1457959491 wait complete. 2024-04-25T02:08:03.085 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-25T02:08:01.174418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219220,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755500,"statfs":{"total":773094113280,"available":772869632000,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000634"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:07:50.143630+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:07:50.143630+0000","last_peered":"2024-04-25T02:07:50.143630+0000","last_clean":"2024-04-25T02:07:50.143630+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:07:50.143630+0000","last_undegraded":"2024-04-25T02:07:50.143630+0000","last_fullsized":"2024-04-25T02:07:50.143630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:59.093056+0000","last_change":"2024-04-25T02:07:59.093056+0000","last_active":"2024-04-25T02:07:59.093056+0000","last_peered":"2024-04-25T02:07:59.093056+0000","last_clean":"2024-04-25T02:07:59.093056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:59.093056+0000","last_undegraded":"2024-04-25T02:07:59.093056+0000","last_fullsized":"2024-04-25T02:07:59.093056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:07:58.088172+0000","last_change":"2024-04-25T02:07:58.088172+0000","last_active":"2024-04-25T02:07:58.088172+0000","last_peered":"2024-04-25T02:07:58.088172+0000","last_clean":"2024-04-25T02:07:58.088172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:07:58.088172+0000","last_undegraded":"2024-04-25T02:07:58.088172+0000","last_fullsized":"2024-04-25T02:07:58.088172+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28328,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343512,"statfs":{"total":96636764160,"available":96607756288,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:08:03.089 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:08:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.216+0000 7f97249c1640 1 Processor -- start 2024-04-25T02:08:03.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.217+0000 7f97249c1640 1 -- start start 2024-04-25T02:08:03.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.217+0000 7f97249c1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97200b3570 0x7f97200d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.217+0000 7f97249c1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f97200b3020 0x7f97200d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.217+0000 7f97249c1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f972006c380 con 0x7f972015e4d0 2024-04-25T02:08:03.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.217+0000 7f97249c1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f97200d1660 con 0x7f97200b3020 2024-04-25T02:08:03.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.217+0000 7f97249c1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f97200d1380 con 0x7f97200b3570 2024-04-25T02:08:03.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.217+0000 7f971ed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f97200b3020 0x7f97200d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.218+0000 7f971ed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f97200b3020 0x7f97200d2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51866/0 (socket says 172.21.15.79:51866) 2024-04-25T02:08:03.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.218+0000 7f971ed9d640 1 -- 172.21.15.79:0/3367433336 learned_addr learned my addr 172.21.15.79:0/3367433336 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:03.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.218+0000 7f9717fff640 1 --2- 172.21.15.79:0/3367433336 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97200b3570 0x7f97200d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.218+0000 7f971ed9d640 1 -- 172.21.15.79:0/3367433336 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97200b3570 msgr2=0x7f97200d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:03.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.218+0000 7f971ed9d640 1 --2- 172.21.15.79:0/3367433336 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97200b3570 0x7f97200d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.218+0000 7f971ed9d640 1 -- 172.21.15.79:0/3367433336 >> v1:172.21.15.189:6789/0 conn(0x7f972015e4d0 legacy=0x7f972006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.218+0000 7f971ed9d640 1 -- 172.21.15.79:0/3367433336 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97200cede0 con 0x7f97200b3020 2024-04-25T02:08:03.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.218+0000 7f971ed9d640 1 --2- 172.21.15.79:0/3367433336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97200b3020 0x7f97200d2c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9718009e50 tx=0x7f971802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7600d5c889ceb1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:03.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.218+0000 7f971dd9b640 1 -- 172.21.15.79:0/3367433336 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718036070 con 0x7f97200b3020 2024-04-25T02:08:03.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.219+0000 7f971dd9b640 1 -- 172.21.15.79:0/3367433336 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9718031600 con 0x7f97200b3020 2024-04-25T02:08:03.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.219+0000 7f971dd9b640 1 -- 172.21.15.79:0/3367433336 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97180319d0 con 0x7f97200b3020 2024-04-25T02:08:03.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.219+0000 7f97249c1640 1 -- 172.21.15.79:0/3367433336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97200b3020 msgr2=0x7f97200d2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.219+0000 7f97249c1640 1 --2- 172.21.15.79:0/3367433336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97200b3020 0x7f97200d2c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9718009e50 tx=0x7f971802a710 comp rx=0 tx=0).stop 2024-04-25T02:08:03.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.219+0000 7f97249c1640 1 -- 172.21.15.79:0/3367433336 shutdown_connections 2024-04-25T02:08:03.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.219+0000 7f97249c1640 1 --2- 172.21.15.79:0/3367433336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97200b3020 0x7f97200d2c50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.219+0000 7f97249c1640 1 --2- 172.21.15.79:0/3367433336 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97200b3570 0x7f97200d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.219+0000 7f97249c1640 1 -- 172.21.15.79:0/3367433336 >> 172.21.15.79:0/3367433336 conn(0x7f972009d460 msgr2=0x7f97200d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:03.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.219+0000 7f97249c1640 1 -- 172.21.15.79:0/3367433336 shutdown_connections 2024-04-25T02:08:03.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.219+0000 7f97249c1640 1 -- 172.21.15.79:0/3367433336 wait complete. 2024-04-25T02:08:03.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.220+0000 7f97249c1640 1 Processor -- start 2024-04-25T02:08:03.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.220+0000 7f97249c1640 1 -- start start 2024-04-25T02:08:03.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.221+0000 7f97249c1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97200b3020 0x7f97201f8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.221+0000 7f97249c1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97200b3570 0x7f97200cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.221+0000 7f97249c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f972015e4d0 0x7f972015d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.221+0000 7f97249c1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f97200d20d0 con 0x7f972015e4d0 2024-04-25T02:08:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.221+0000 7f97249c1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f972015e8b0 con 0x7f97200b3020 2024-04-25T02:08:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.221+0000 7f97249c1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f97200d2250 con 0x7f97200b3570 2024-04-25T02:08:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.221+0000 7f971ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f972015e4d0 0x7f972015d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.221+0000 7f971ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f972015e4d0 0x7f972015d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51878/0 (socket says 172.21.15.79:51878) 2024-04-25T02:08:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.221+0000 7f971ed9d640 1 -- 172.21.15.79:0/3433518075 learned_addr learned my addr 172.21.15.79:0/3433518075 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.221+0000 7f9717fff640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97200b3570 0x7f97200cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.221+0000 7f971e59c640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97200b3020 0x7f97201f8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.221+0000 7f971ed9d640 1 -- 172.21.15.79:0/3433518075 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97200b3570 msgr2=0x7f97200cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.221+0000 7f971ed9d640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97200b3570 0x7f97200cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.222+0000 7f971ed9d640 1 -- 172.21.15.79:0/3433518075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97200b3020 msgr2=0x7f97201f8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.222+0000 7f971ed9d640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97200b3020 0x7f97201f8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.222+0000 7f971ed9d640 1 -- 172.21.15.79:0/3433518075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97201f85b0 con 0x7f972015e4d0 2024-04-25T02:08:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.222+0000 7f9717fff640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97200b3570 0x7f97200cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.222+0000 7f971e59c640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97200b3020 0x7f97201f8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.222+0000 7f971ed9d640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f972015e4d0 0x7f972015d250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9718034040 tx=0x7f9718004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.222+0000 7f9716ffd640 1 -- 172.21.15.79:0/3433518075 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718041020 con 0x7f972015e4d0 2024-04-25T02:08:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.222+0000 7f9716ffd640 1 -- 172.21.15.79:0/3433518075 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97180077a0 con 0x7f972015e4d0 2024-04-25T02:08:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.222+0000 7f9716ffd640 1 -- 172.21.15.79:0/3433518075 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718036040 con 0x7f972015e4d0 2024-04-25T02:08:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.222+0000 7f97249c1640 1 -- 172.21.15.79:0/3433518075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97200cb450 con 0x7f972015e4d0 2024-04-25T02:08:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.222+0000 7f97249c1640 1 -- 172.21.15.79:0/3433518075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97200cba10 con 0x7f972015e4d0 2024-04-25T02:08:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.223+0000 7f97249c1640 1 -- 172.21.15.79:0/3433518075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97200690a0 con 0x7f972015e4d0 2024-04-25T02:08:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.223+0000 7f9716ffd640 1 -- 172.21.15.79:0/3433518075 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9718044020 con 0x7f972015e4d0 2024-04-25T02:08:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.224+0000 7f9716ffd640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f970006be60 0x7f970006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.224+0000 7f971e59c640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f970006be60 0x7f970006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.224+0000 7f9716ffd640 1 -- 172.21.15.79:0/3433518075 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f97180abb20 con 0x7f972015e4d0 2024-04-25T02:08:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.224+0000 7f971e59c640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f970006be60 0x7f970006e320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f97100015e0 tx=0x7f9710009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:03.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.228+0000 7f9716ffd640 1 -- 172.21.15.79:0/3433518075 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f971804b030 con 0x7f972015e4d0 2024-04-25T02:08:03.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.397+0000 7f97249c1640 1 -- 172.21.15.79:0/3433518075 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97200d1920 con 0x7f970006be60 2024-04-25T02:08:03.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.403+0000 7f9716ffd640 1 -- 172.21.15.79:0/3433518075 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251941 (secure 0 0 0) 0x7f97200d1920 con 0x7f970006be60 2024-04-25T02:08:03.412 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:03.413 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:08:03.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.405+0000 7f97249c1640 1 -- 172.21.15.79:0/3433518075 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f970006be60 msgr2=0x7f970006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.405+0000 7f97249c1640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f970006be60 0x7f970006e320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f97100015e0 tx=0x7f9710009040 comp rx=0 tx=0).stop 2024-04-25T02:08:03.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.405+0000 7f97249c1640 1 -- 172.21.15.79:0/3433518075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f972015e4d0 msgr2=0x7f972015d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.405+0000 7f97249c1640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f972015e4d0 0x7f972015d250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9718034040 tx=0x7f9718004a40 comp rx=0 tx=0).stop 2024-04-25T02:08:03.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.405+0000 7f97249c1640 1 -- 172.21.15.79:0/3433518075 shutdown_connections 2024-04-25T02:08:03.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.405+0000 7f97249c1640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f970006be60 0x7f970006e320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.405+0000 7f97249c1640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f972015e4d0 0x7f972015d250 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.405+0000 7f97249c1640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97200b3570 0x7f97200cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.405+0000 7f97249c1640 1 --2- 172.21.15.79:0/3433518075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97200b3020 0x7f97201f8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.405+0000 7f97249c1640 1 -- 172.21.15.79:0/3433518075 >> 172.21.15.79:0/3433518075 conn(0x7f972009d460 msgr2=0x7f97200d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:03.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.406+0000 7f97249c1640 1 -- 172.21.15.79:0/3433518075 shutdown_connections 2024-04-25T02:08:03.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.406+0000 7f97249c1640 1 -- 172.21.15.79:0/3433518075 wait complete. 2024-04-25T02:08:03.423 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-25T02:08:03.174731+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2891776,"data_stored":1739996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.080690"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207407+0000","last_change":"2024-04-25T02:08:00.134308+0000","last_active":"2024-04-25T02:08:01.207407+0000","last_peered":"2024-04-25T02:08:01.207407+0000","last_clean":"2024-04-25T02:08:01.207407+0000","last_became_active":"2024-04-25T02:08:00.134045+0000","last_became_peered":"2024-04-25T02:08:00.134045+0000","last_unstale":"2024-04-25T02:08:01.207407+0000","last_undegraded":"2024-04-25T02:08:01.207407+0000","last_fullsized":"2024-04-25T02:08:01.207407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:48.665413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113746+0000","last_change":"2024-04-25T02:08:00.132540+0000","last_active":"2024-04-25T02:08:01.113746+0000","last_peered":"2024-04-25T02:08:01.113746+0000","last_clean":"2024-04-25T02:08:01.113746+0000","last_became_active":"2024-04-25T02:08:00.132284+0000","last_became_peered":"2024-04-25T02:08:00.132284+0000","last_unstale":"2024-04-25T02:08:01.113746+0000","last_undegraded":"2024-04-25T02:08:01.113746+0000","last_fullsized":"2024-04-25T02:08:01.113746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:54.475986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117551+0000","last_change":"2024-04-25T02:08:00.130002+0000","last_active":"2024-04-25T02:08:01.117551+0000","last_peered":"2024-04-25T02:08:01.117551+0000","last_clean":"2024-04-25T02:08:01.117551+0000","last_became_active":"2024-04-25T02:08:00.129736+0000","last_became_peered":"2024-04-25T02:08:00.129736+0000","last_unstale":"2024-04-25T02:08:01.117551+0000","last_undegraded":"2024-04-25T02:08:01.117551+0000","last_fullsized":"2024-04-25T02:08:01.117551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:02.955874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114971+0000","last_change":"2024-04-25T02:08:00.132017+0000","last_active":"2024-04-25T02:08:01.114971+0000","last_peered":"2024-04-25T02:08:01.114971+0000","last_clean":"2024-04-25T02:08:01.114971+0000","last_became_active":"2024-04-25T02:08:00.131698+0000","last_became_peered":"2024-04-25T02:08:00.131698+0000","last_unstale":"2024-04-25T02:08:01.114971+0000","last_undegraded":"2024-04-25T02:08:01.114971+0000","last_fullsized":"2024-04-25T02:08:01.114971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:28.873330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118266+0000","last_change":"2024-04-25T02:08:00.136752+0000","last_active":"2024-04-25T02:08:01.118266+0000","last_peered":"2024-04-25T02:08:01.118266+0000","last_clean":"2024-04-25T02:08:01.118266+0000","last_became_active":"2024-04-25T02:08:00.136403+0000","last_became_peered":"2024-04-25T02:08:00.136403+0000","last_unstale":"2024-04-25T02:08:01.118266+0000","last_undegraded":"2024-04-25T02:08:01.118266+0000","last_fullsized":"2024-04-25T02:08:01.118266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:43.197680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114307+0000","last_change":"2024-04-25T02:08:00.133501+0000","last_active":"2024-04-25T02:08:01.114307+0000","last_peered":"2024-04-25T02:08:01.114307+0000","last_clean":"2024-04-25T02:08:01.114307+0000","last_became_active":"2024-04-25T02:08:00.133172+0000","last_became_peered":"2024-04-25T02:08:00.133172+0000","last_unstale":"2024-04-25T02:08:01.114307+0000","last_undegraded":"2024-04-25T02:08:01.114307+0000","last_fullsized":"2024-04-25T02:08:01.114307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:19:21.910512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118112+0000","last_change":"2024-04-25T02:08:00.138392+0000","last_active":"2024-04-25T02:08:01.118112+0000","last_peered":"2024-04-25T02:08:01.118112+0000","last_clean":"2024-04-25T02:08:01.118112+0000","last_became_active":"2024-04-25T02:08:00.138116+0000","last_became_peered":"2024-04-25T02:08:00.138116+0000","last_unstale":"2024-04-25T02:08:01.118112+0000","last_undegraded":"2024-04-25T02:08:01.118112+0000","last_fullsized":"2024-04-25T02:08:01.118112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.809054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117173+0000","last_change":"2024-04-25T02:08:00.137802+0000","last_active":"2024-04-25T02:08:01.117173+0000","last_peered":"2024-04-25T02:08:01.117173+0000","last_clean":"2024-04-25T02:08:01.117173+0000","last_became_active":"2024-04-25T02:08:00.136849+0000","last_became_peered":"2024-04-25T02:08:00.136849+0000","last_unstale":"2024-04-25T02:08:01.117173+0000","last_undegraded":"2024-04-25T02:08:01.117173+0000","last_fullsized":"2024-04-25T02:08:01.117173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:04.753150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118140+0000","last_change":"2024-04-25T02:08:00.143112+0000","last_active":"2024-04-25T02:08:01.118140+0000","last_peered":"2024-04-25T02:08:01.118140+0000","last_clean":"2024-04-25T02:08:01.118140+0000","last_became_active":"2024-04-25T02:08:00.142709+0000","last_became_peered":"2024-04-25T02:08:00.142709+0000","last_unstale":"2024-04-25T02:08:01.118140+0000","last_undegraded":"2024-04-25T02:08:01.118140+0000","last_fullsized":"2024-04-25T02:08:01.118140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:19.162081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115147+0000","last_change":"2024-04-25T02:08:00.130702+0000","last_active":"2024-04-25T02:08:01.115147+0000","last_peered":"2024-04-25T02:08:01.115147+0000","last_clean":"2024-04-25T02:08:01.115147+0000","last_became_active":"2024-04-25T02:08:00.125460+0000","last_became_peered":"2024-04-25T02:08:00.125460+0000","last_unstale":"2024-04-25T02:08:01.115147+0000","last_undegraded":"2024-04-25T02:08:01.115147+0000","last_fullsized":"2024-04-25T02:08:01.115147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:17.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114727+0000","last_change":"2024-04-25T02:08:00.125792+0000","last_active":"2024-04-25T02:08:01.114727+0000","last_peered":"2024-04-25T02:08:01.114727+0000","last_clean":"2024-04-25T02:08:01.114727+0000","last_became_active":"2024-04-25T02:08:00.125520+0000","last_became_peered":"2024-04-25T02:08:00.125520+0000","last_unstale":"2024-04-25T02:08:01.114727+0000","last_undegraded":"2024-04-25T02:08:01.114727+0000","last_fullsized":"2024-04-25T02:08:01.114727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:29.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118193+0000","last_change":"2024-04-25T02:08:00.134810+0000","last_active":"2024-04-25T02:08:01.118193+0000","last_peered":"2024-04-25T02:08:01.118193+0000","last_clean":"2024-04-25T02:08:01.118193+0000","last_became_active":"2024-04-25T02:08:00.134532+0000","last_became_peered":"2024-04-25T02:08:00.134532+0000","last_unstale":"2024-04-25T02:08:01.118193+0000","last_undegraded":"2024-04-25T02:08:01.118193+0000","last_fullsized":"2024-04-25T02:08:01.118193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:02.073911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118235+0000","last_change":"2024-04-25T02:08:00.133643+0000","last_active":"2024-04-25T02:08:01.118235+0000","last_peered":"2024-04-25T02:08:01.118235+0000","last_clean":"2024-04-25T02:08:01.118235+0000","last_became_active":"2024-04-25T02:08:00.133375+0000","last_became_peered":"2024-04-25T02:08:00.133375+0000","last_unstale":"2024-04-25T02:08:01.118235+0000","last_undegraded":"2024-04-25T02:08:01.118235+0000","last_fullsized":"2024-04-25T02:08:01.118235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:19:21.910512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117517+0000","last_change":"2024-04-25T02:08:00.127128+0000","last_active":"2024-04-25T02:08:01.117517+0000","last_peered":"2024-04-25T02:08:01.117517+0000","last_clean":"2024-04-25T02:08:01.117517+0000","last_became_active":"2024-04-25T02:08:00.126836+0000","last_became_peered":"2024-04-25T02:08:00.126836+0000","last_unstale":"2024-04-25T02:08:01.117517+0000","last_undegraded":"2024-04-25T02:08:01.117517+0000","last_fullsized":"2024-04-25T02:08:01.117517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:04.753150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113310+0000","last_change":"2024-04-25T02:08:00.119494+0000","last_active":"2024-04-25T02:08:01.113310+0000","last_peered":"2024-04-25T02:08:01.113310+0000","last_clean":"2024-04-25T02:08:01.113310+0000","last_became_active":"2024-04-25T02:08:00.119237+0000","last_became_peered":"2024-04-25T02:08:00.119237+0000","last_unstale":"2024-04-25T02:08:01.113310+0000","last_undegraded":"2024-04-25T02:08:01.113310+0000","last_fullsized":"2024-04-25T02:08:01.113310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:27.956618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114158+0000","last_change":"2024-04-25T02:08:00.133489+0000","last_active":"2024-04-25T02:08:01.114158+0000","last_peered":"2024-04-25T02:08:01.114158+0000","last_clean":"2024-04-25T02:08:01.114158+0000","last_became_active":"2024-04-25T02:08:00.133134+0000","last_became_peered":"2024-04-25T02:08:00.133134+0000","last_unstale":"2024-04-25T02:08:01.114158+0000","last_undegraded":"2024-04-25T02:08:01.114158+0000","last_fullsized":"2024-04-25T02:08:01.114158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:17.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115169+0000","last_change":"2024-04-25T02:08:00.141819+0000","last_active":"2024-04-25T02:08:01.115169+0000","last_peered":"2024-04-25T02:08:01.115169+0000","last_clean":"2024-04-25T02:08:01.115169+0000","last_became_active":"2024-04-25T02:08:00.141488+0000","last_became_peered":"2024-04-25T02:08:00.141488+0000","last_unstale":"2024-04-25T02:08:01.115169+0000","last_undegraded":"2024-04-25T02:08:01.115169+0000","last_fullsized":"2024-04-25T02:08:01.115169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:46.350349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117853+0000","last_change":"2024-04-25T02:08:00.133178+0000","last_active":"2024-04-25T02:08:01.117853+0000","last_peered":"2024-04-25T02:08:01.117853+0000","last_clean":"2024-04-25T02:08:01.117853+0000","last_became_active":"2024-04-25T02:08:00.132881+0000","last_became_peered":"2024-04-25T02:08:00.132881+0000","last_unstale":"2024-04-25T02:08:01.117853+0000","last_undegraded":"2024-04-25T02:08:01.117853+0000","last_fullsized":"2024-04-25T02:08:01.117853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:46.930603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207506+0000","last_change":"2024-04-25T02:08:00.139667+0000","last_active":"2024-04-25T02:08:01.207506+0000","last_peered":"2024-04-25T02:08:01.207506+0000","last_clean":"2024-04-25T02:08:01.207506+0000","last_became_active":"2024-04-25T02:08:00.139398+0000","last_became_peered":"2024-04-25T02:08:00.139398+0000","last_unstale":"2024-04-25T02:08:01.207506+0000","last_undegraded":"2024-04-25T02:08:01.207506+0000","last_fullsized":"2024-04-25T02:08:01.207506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:39.354188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114335+0000","last_change":"2024-04-25T02:08:00.124339+0000","last_active":"2024-04-25T02:08:01.114335+0000","last_peered":"2024-04-25T02:08:01.114335+0000","last_clean":"2024-04-25T02:08:01.114335+0000","last_became_active":"2024-04-25T02:08:00.124078+0000","last_became_peered":"2024-04-25T02:08:00.124078+0000","last_unstale":"2024-04-25T02:08:01.114335+0000","last_undegraded":"2024-04-25T02:08:01.114335+0000","last_fullsized":"2024-04-25T02:08:01.114335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:02.955874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117681+0000","last_change":"2024-04-25T02:08:00.140606+0000","last_active":"2024-04-25T02:08:01.117681+0000","last_peered":"2024-04-25T02:08:01.117681+0000","last_clean":"2024-04-25T02:08:01.117681+0000","last_became_active":"2024-04-25T02:08:00.140357+0000","last_became_peered":"2024-04-25T02:08:00.140357+0000","last_unstale":"2024-04-25T02:08:01.117681+0000","last_undegraded":"2024-04-25T02:08:01.117681+0000","last_fullsized":"2024-04-25T02:08:01.117681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:27:41.665005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114519+0000","last_change":"2024-04-25T02:08:00.142382+0000","last_active":"2024-04-25T02:08:01.114519+0000","last_peered":"2024-04-25T02:08:01.114519+0000","last_clean":"2024-04-25T02:08:01.114519+0000","last_became_active":"2024-04-25T02:08:00.142008+0000","last_became_peered":"2024-04-25T02:08:00.142008+0000","last_unstale":"2024-04-25T02:08:01.114519+0000","last_undegraded":"2024-04-25T02:08:01.114519+0000","last_fullsized":"2024-04-25T02:08:01.114519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.809054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117888+0000","last_change":"2024-04-25T02:08:00.137764+0000","last_active":"2024-04-25T02:08:01.117888+0000","last_peered":"2024-04-25T02:08:01.117888+0000","last_clean":"2024-04-25T02:08:01.117888+0000","last_became_active":"2024-04-25T02:08:00.136712+0000","last_became_peered":"2024-04-25T02:08:00.136712+0000","last_unstale":"2024-04-25T02:08:01.117888+0000","last_undegraded":"2024-04-25T02:08:01.117888+0000","last_fullsized":"2024-04-25T02:08:01.117888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:27:41.665005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114262+0000","last_change":"2024-04-25T02:08:00.132628+0000","last_active":"2024-04-25T02:08:01.114262+0000","last_peered":"2024-04-25T02:08:01.114262+0000","last_clean":"2024-04-25T02:08:01.114262+0000","last_became_active":"2024-04-25T02:08:00.132290+0000","last_became_peered":"2024-04-25T02:08:00.132290+0000","last_unstale":"2024-04-25T02:08:01.114262+0000","last_undegraded":"2024-04-25T02:08:01.114262+0000","last_fullsized":"2024-04-25T02:08:01.114262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:54.475986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118051+0000","last_change":"2024-04-25T02:08:00.136212+0000","last_active":"2024-04-25T02:08:01.118051+0000","last_peered":"2024-04-25T02:08:01.118051+0000","last_clean":"2024-04-25T02:08:01.118051+0000","last_became_active":"2024-04-25T02:08:00.135931+0000","last_became_peered":"2024-04-25T02:08:00.135931+0000","last_unstale":"2024-04-25T02:08:01.118051+0000","last_undegraded":"2024-04-25T02:08:01.118051+0000","last_fullsized":"2024-04-25T02:08:01.118051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:29.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115305+0000","last_change":"2024-04-25T02:08:00.137685+0000","last_active":"2024-04-25T02:08:01.115305+0000","last_peered":"2024-04-25T02:08:01.115305+0000","last_clean":"2024-04-25T02:08:01.115305+0000","last_became_active":"2024-04-25T02:08:00.137442+0000","last_became_peered":"2024-04-25T02:08:00.137442+0000","last_unstale":"2024-04-25T02:08:01.115305+0000","last_undegraded":"2024-04-25T02:08:01.115305+0000","last_fullsized":"2024-04-25T02:08:01.115305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:54.475986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113612+0000","last_change":"2024-04-25T02:08:00.131268+0000","last_active":"2024-04-25T02:08:01.113612+0000","last_peered":"2024-04-25T02:08:01.113612+0000","last_clean":"2024-04-25T02:08:01.113612+0000","last_became_active":"2024-04-25T02:08:00.130015+0000","last_became_peered":"2024-04-25T02:08:00.130015+0000","last_unstale":"2024-04-25T02:08:01.113612+0000","last_undegraded":"2024-04-25T02:08:01.113612+0000","last_fullsized":"2024-04-25T02:08:01.113612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:17.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118432+0000","last_change":"2024-04-25T02:08:00.135564+0000","last_active":"2024-04-25T02:08:01.118432+0000","last_peered":"2024-04-25T02:08:01.118432+0000","last_clean":"2024-04-25T02:08:01.118432+0000","last_became_active":"2024-04-25T02:08:00.135043+0000","last_became_peered":"2024-04-25T02:08:00.135043+0000","last_unstale":"2024-04-25T02:08:01.118432+0000","last_undegraded":"2024-04-25T02:08:01.118432+0000","last_fullsized":"2024-04-25T02:08:01.118432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:28.873330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117735+0000","last_change":"2024-04-25T02:08:00.140028+0000","last_active":"2024-04-25T02:08:01.117735+0000","last_peered":"2024-04-25T02:08:01.117735+0000","last_clean":"2024-04-25T02:08:01.117735+0000","last_became_active":"2024-04-25T02:08:00.139690+0000","last_became_peered":"2024-04-25T02:08:00.139690+0000","last_unstale":"2024-04-25T02:08:01.117735+0000","last_undegraded":"2024-04-25T02:08:01.117735+0000","last_fullsized":"2024-04-25T02:08:01.117735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:29.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115205+0000","last_change":"2024-04-25T02:08:00.136871+0000","last_active":"2024-04-25T02:08:01.115205+0000","last_peered":"2024-04-25T02:08:01.115205+0000","last_clean":"2024-04-25T02:08:01.115205+0000","last_became_active":"2024-04-25T02:08:00.136394+0000","last_became_peered":"2024-04-25T02:08:00.136394+0000","last_unstale":"2024-04-25T02:08:01.115205+0000","last_undegraded":"2024-04-25T02:08:01.115205+0000","last_fullsized":"2024-04-25T02:08:01.115205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:19.162081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117127+0000","last_change":"2024-04-25T02:08:00.126418+0000","last_active":"2024-04-25T02:08:01.117127+0000","last_peered":"2024-04-25T02:08:01.117127+0000","last_clean":"2024-04-25T02:08:01.117127+0000","last_became_active":"2024-04-25T02:08:00.126139+0000","last_became_peered":"2024-04-25T02:08:00.126139+0000","last_unstale":"2024-04-25T02:08:01.117127+0000","last_undegraded":"2024-04-25T02:08:01.117127+0000","last_fullsized":"2024-04-25T02:08:01.117127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:18.092551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114405+0000","last_change":"2024-04-25T02:08:00.135252+0000","last_active":"2024-04-25T02:08:01.114405+0000","last_peered":"2024-04-25T02:08:01.114405+0000","last_clean":"2024-04-25T02:08:01.114405+0000","last_became_active":"2024-04-25T02:08:00.133592+0000","last_became_peered":"2024-04-25T02:08:00.133592+0000","last_unstale":"2024-04-25T02:08:01.114405+0000","last_undegraded":"2024-04-25T02:08:01.114405+0000","last_fullsized":"2024-04-25T02:08:01.114405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:27:41.665005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117711+0000","last_change":"2024-04-25T02:08:00.127933+0000","last_active":"2024-04-25T02:08:01.117711+0000","last_peered":"2024-04-25T02:08:01.117711+0000","last_clean":"2024-04-25T02:08:01.117711+0000","last_became_active":"2024-04-25T02:08:00.127073+0000","last_became_peered":"2024-04-25T02:08:00.127073+0000","last_unstale":"2024-04-25T02:08:01.117711+0000","last_undegraded":"2024-04-25T02:08:01.117711+0000","last_fullsized":"2024-04-25T02:08:01.117711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:27.208335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118446+0000","last_change":"2024-04-25T02:07:59.116340+0000","last_active":"2024-04-25T02:08:01.118446+0000","last_peered":"2024-04-25T02:08:01.118446+0000","last_clean":"2024-04-25T02:08:01.118446+0000","last_became_active":"2024-04-25T02:07:59.116056+0000","last_became_peered":"2024-04-25T02:07:59.116056+0000","last_unstale":"2024-04-25T02:08:01.118446+0000","last_undegraded":"2024-04-25T02:08:01.118446+0000","last_fullsized":"2024-04-25T02:08:01.118446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:52:35.221325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117809+0000","last_change":"2024-04-25T02:08:00.133885+0000","last_active":"2024-04-25T02:08:01.117809+0000","last_peered":"2024-04-25T02:08:01.117809+0000","last_clean":"2024-04-25T02:08:01.117809+0000","last_became_active":"2024-04-25T02:08:00.133640+0000","last_became_peered":"2024-04-25T02:08:00.133640+0000","last_unstale":"2024-04-25T02:08:01.117809+0000","last_undegraded":"2024-04-25T02:08:01.117809+0000","last_fullsized":"2024-04-25T02:08:01.117809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:54.475986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114528+0000","last_change":"2024-04-25T02:07:59.111628+0000","last_active":"2024-04-25T02:08:01.114528+0000","last_peered":"2024-04-25T02:08:01.114528+0000","last_clean":"2024-04-25T02:08:01.114528+0000","last_became_active":"2024-04-25T02:07:59.111154+0000","last_became_peered":"2024-04-25T02:07:59.111154+0000","last_unstale":"2024-04-25T02:08:01.114528+0000","last_undegraded":"2024-04-25T02:08:01.114528+0000","last_fullsized":"2024-04-25T02:08:01.114528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:44:38.307212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117995+0000","last_change":"2024-04-25T02:07:59.116279+0000","last_active":"2024-04-25T02:08:01.117995+0000","last_peered":"2024-04-25T02:08:01.117995+0000","last_clean":"2024-04-25T02:08:01.117995+0000","last_became_active":"2024-04-25T02:07:59.115993+0000","last_became_peered":"2024-04-25T02:07:59.115993+0000","last_unstale":"2024-04-25T02:08:01.117995+0000","last_undegraded":"2024-04-25T02:08:01.117995+0000","last_fullsized":"2024-04-25T02:08:01.117995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:19.399199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117236+0000","last_change":"2024-04-25T02:08:00.137646+0000","last_active":"2024-04-25T02:08:01.117236+0000","last_peered":"2024-04-25T02:08:01.117236+0000","last_clean":"2024-04-25T02:08:01.117236+0000","last_became_active":"2024-04-25T02:08:00.137395+0000","last_became_peered":"2024-04-25T02:08:00.137395+0000","last_unstale":"2024-04-25T02:08:01.117236+0000","last_undegraded":"2024-04-25T02:08:01.117236+0000","last_fullsized":"2024-04-25T02:08:01.117236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:02.955874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114277+0000","last_change":"2024-04-25T02:07:59.115698+0000","last_active":"2024-04-25T02:08:01.114277+0000","last_peered":"2024-04-25T02:08:01.114277+0000","last_clean":"2024-04-25T02:08:01.114277+0000","last_became_active":"2024-04-25T02:07:59.115462+0000","last_became_peered":"2024-04-25T02:07:59.115462+0000","last_unstale":"2024-04-25T02:08:01.114277+0000","last_undegraded":"2024-04-25T02:08:01.114277+0000","last_fullsized":"2024-04-25T02:08:01.114277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:19.399199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113305+0000","last_change":"2024-04-25T02:08:00.131043+0000","last_active":"2024-04-25T02:08:01.113305+0000","last_peered":"2024-04-25T02:08:01.113305+0000","last_clean":"2024-04-25T02:08:01.113305+0000","last_became_active":"2024-04-25T02:08:00.129225+0000","last_became_peered":"2024-04-25T02:08:00.129225+0000","last_unstale":"2024-04-25T02:08:01.113305+0000","last_undegraded":"2024-04-25T02:08:01.113305+0000","last_fullsized":"2024-04-25T02:08:01.113305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:02.955874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115331+0000","last_change":"2024-04-25T02:07:59.117828+0000","last_active":"2024-04-25T02:08:01.115331+0000","last_peered":"2024-04-25T02:08:01.115331+0000","last_clean":"2024-04-25T02:08:01.115331+0000","last_became_active":"2024-04-25T02:07:59.117497+0000","last_became_peered":"2024-04-25T02:07:59.117497+0000","last_unstale":"2024-04-25T02:08:01.115331+0000","last_undegraded":"2024-04-25T02:08:01.115331+0000","last_fullsized":"2024-04-25T02:08:01.115331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:50.979492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115383+0000","last_change":"2024-04-25T02:08:00.142794+0000","last_active":"2024-04-25T02:08:01.115383+0000","last_peered":"2024-04-25T02:08:01.115383+0000","last_clean":"2024-04-25T02:08:01.115383+0000","last_became_active":"2024-04-25T02:08:00.142308+0000","last_became_peered":"2024-04-25T02:08:00.142308+0000","last_unstale":"2024-04-25T02:08:01.115383+0000","last_undegraded":"2024-04-25T02:08:01.115383+0000","last_fullsized":"2024-04-25T02:08:01.115383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:02.221034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115265+0000","last_change":"2024-04-25T02:07:59.120424+0000","last_active":"2024-04-25T02:08:01.115265+0000","last_peered":"2024-04-25T02:08:01.115265+0000","last_clean":"2024-04-25T02:08:01.115265+0000","last_became_active":"2024-04-25T02:07:59.120173+0000","last_became_peered":"2024-04-25T02:07:59.120173+0000","last_unstale":"2024-04-25T02:08:01.115265+0000","last_undegraded":"2024-04-25T02:08:01.115265+0000","last_fullsized":"2024-04-25T02:08:01.115265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:44:38.307212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117861+0000","last_change":"2024-04-25T02:08:00.135525+0000","last_active":"2024-04-25T02:08:01.117861+0000","last_peered":"2024-04-25T02:08:01.117861+0000","last_clean":"2024-04-25T02:08:01.117861+0000","last_became_active":"2024-04-25T02:08:00.134949+0000","last_became_peered":"2024-04-25T02:08:00.134949+0000","last_unstale":"2024-04-25T02:08:01.117861+0000","last_undegraded":"2024-04-25T02:08:01.117861+0000","last_fullsized":"2024-04-25T02:08:01.117861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:19:21.910512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113595+0000","last_change":"2024-04-25T02:07:59.114638+0000","last_active":"2024-04-25T02:08:01.113595+0000","last_peered":"2024-04-25T02:08:01.113595+0000","last_clean":"2024-04-25T02:08:01.113595+0000","last_became_active":"2024-04-25T02:07:59.114338+0000","last_became_peered":"2024-04-25T02:07:59.114338+0000","last_unstale":"2024-04-25T02:08:01.113595+0000","last_undegraded":"2024-04-25T02:08:01.113595+0000","last_fullsized":"2024-04-25T02:08:01.113595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:26.203451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118240+0000","last_change":"2024-04-25T02:08:00.124104+0000","last_active":"2024-04-25T02:08:01.118240+0000","last_peered":"2024-04-25T02:08:01.118240+0000","last_clean":"2024-04-25T02:08:01.118240+0000","last_became_active":"2024-04-25T02:08:00.123799+0000","last_became_peered":"2024-04-25T02:08:00.123799+0000","last_unstale":"2024-04-25T02:08:01.118240+0000","last_undegraded":"2024-04-25T02:08:01.118240+0000","last_fullsized":"2024-04-25T02:08:01.118240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:56.058112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114450+0000","last_change":"2024-04-25T02:07:59.116463+0000","last_active":"2024-04-25T02:08:01.114450+0000","last_peered":"2024-04-25T02:08:01.114450+0000","last_clean":"2024-04-25T02:08:01.114450+0000","last_became_active":"2024-04-25T02:07:59.116202+0000","last_became_peered":"2024-04-25T02:07:59.116202+0000","last_unstale":"2024-04-25T02:08:01.114450+0000","last_undegraded":"2024-04-25T02:08:01.114450+0000","last_fullsized":"2024-04-25T02:08:01.114450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:26.203451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118149+0000","last_change":"2024-04-25T02:08:00.140394+0000","last_active":"2024-04-25T02:08:01.118149+0000","last_peered":"2024-04-25T02:08:01.118149+0000","last_clean":"2024-04-25T02:08:01.118149+0000","last_became_active":"2024-04-25T02:08:00.140115+0000","last_became_peered":"2024-04-25T02:08:00.140115+0000","last_unstale":"2024-04-25T02:08:01.118149+0000","last_undegraded":"2024-04-25T02:08:01.118149+0000","last_fullsized":"2024-04-25T02:08:01.118149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:28.873330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117847+0000","last_change":"2024-04-25T02:07:59.107413+0000","last_active":"2024-04-25T02:08:01.117847+0000","last_peered":"2024-04-25T02:08:01.117847+0000","last_clean":"2024-04-25T02:08:01.117847+0000","last_became_active":"2024-04-25T02:07:59.107130+0000","last_became_peered":"2024-04-25T02:07:59.107130+0000","last_unstale":"2024-04-25T02:08:01.117847+0000","last_undegraded":"2024-04-25T02:08:01.117847+0000","last_fullsized":"2024-04-25T02:08:01.117847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:00.403236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117661+0000","last_change":"2024-04-25T02:08:00.138818+0000","last_active":"2024-04-25T02:08:01.117661+0000","last_peered":"2024-04-25T02:08:01.117661+0000","last_clean":"2024-04-25T02:08:01.117661+0000","last_became_active":"2024-04-25T02:08:00.136665+0000","last_became_peered":"2024-04-25T02:08:00.136665+0000","last_unstale":"2024-04-25T02:08:01.117661+0000","last_undegraded":"2024-04-25T02:08:01.117661+0000","last_fullsized":"2024-04-25T02:08:01.117661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:27.956618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115772+0000","last_change":"2024-04-25T02:07:59.116545+0000","last_active":"2024-04-25T02:08:01.115772+0000","last_peered":"2024-04-25T02:08:01.115772+0000","last_clean":"2024-04-25T02:08:01.115772+0000","last_became_active":"2024-04-25T02:07:59.116250+0000","last_became_peered":"2024-04-25T02:07:59.116250+0000","last_unstale":"2024-04-25T02:08:01.115772+0000","last_undegraded":"2024-04-25T02:08:01.115772+0000","last_fullsized":"2024-04-25T02:08:01.115772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:50.979492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207453+0000","last_change":"2024-04-25T02:08:00.135486+0000","last_active":"2024-04-25T02:08:01.207453+0000","last_peered":"2024-04-25T02:08:01.207453+0000","last_clean":"2024-04-25T02:08:01.207453+0000","last_became_active":"2024-04-25T02:08:00.135113+0000","last_became_peered":"2024-04-25T02:08:00.135113+0000","last_unstale":"2024-04-25T02:08:01.207453+0000","last_undegraded":"2024-04-25T02:08:01.207453+0000","last_fullsized":"2024-04-25T02:08:01.207453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:08:42.030490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114589+0000","last_change":"2024-04-25T02:07:59.114698+0000","last_active":"2024-04-25T02:08:01.114589+0000","last_peered":"2024-04-25T02:08:01.114589+0000","last_clean":"2024-04-25T02:08:01.114589+0000","last_became_active":"2024-04-25T02:07:59.114388+0000","last_became_peered":"2024-04-25T02:07:59.114388+0000","last_unstale":"2024-04-25T02:08:01.114589+0000","last_undegraded":"2024-04-25T02:08:01.114589+0000","last_fullsized":"2024-04-25T02:08:01.114589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:19.399199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114299+0000","last_change":"2024-04-25T02:08:00.131335+0000","last_active":"2024-04-25T02:08:01.114299+0000","last_peered":"2024-04-25T02:08:01.114299+0000","last_clean":"2024-04-25T02:08:01.114299+0000","last_became_active":"2024-04-25T02:08:00.130929+0000","last_became_peered":"2024-04-25T02:08:00.130929+0000","last_unstale":"2024-04-25T02:08:01.114299+0000","last_undegraded":"2024-04-25T02:08:01.114299+0000","last_fullsized":"2024-04-25T02:08:01.114299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:04.753150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117010+0000","last_change":"2024-04-25T02:07:59.113230+0000","last_active":"2024-04-25T02:08:01.117010+0000","last_peered":"2024-04-25T02:08:01.117010+0000","last_clean":"2024-04-25T02:08:01.117010+0000","last_became_active":"2024-04-25T02:07:59.112920+0000","last_became_peered":"2024-04-25T02:07:59.112920+0000","last_unstale":"2024-04-25T02:08:01.117010+0000","last_undegraded":"2024-04-25T02:08:01.117010+0000","last_fullsized":"2024-04-25T02:08:01.117010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:19.399199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207322+0000","last_change":"2024-04-25T02:08:00.135668+0000","last_active":"2024-04-25T02:08:01.207322+0000","last_peered":"2024-04-25T02:08:01.207322+0000","last_clean":"2024-04-25T02:08:01.207322+0000","last_became_active":"2024-04-25T02:08:00.135381+0000","last_became_peered":"2024-04-25T02:08:00.135381+0000","last_unstale":"2024-04-25T02:08:01.207322+0000","last_undegraded":"2024-04-25T02:08:01.207322+0000","last_fullsized":"2024-04-25T02:08:01.207322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:46.350349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118215+0000","last_change":"2024-04-25T02:07:59.108897+0000","last_active":"2024-04-25T02:08:01.118215+0000","last_peered":"2024-04-25T02:08:01.118215+0000","last_clean":"2024-04-25T02:08:01.118215+0000","last_became_active":"2024-04-25T02:07:59.108622+0000","last_became_peered":"2024-04-25T02:07:59.108622+0000","last_unstale":"2024-04-25T02:08:01.118215+0000","last_undegraded":"2024-04-25T02:08:01.118215+0000","last_fullsized":"2024-04-25T02:08:01.118215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:00.403236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207360+0000","last_change":"2024-04-25T02:08:00.136207+0000","last_active":"2024-04-25T02:08:01.207360+0000","last_peered":"2024-04-25T02:08:01.207360+0000","last_clean":"2024-04-25T02:08:01.207360+0000","last_became_active":"2024-04-25T02:08:00.135952+0000","last_became_peered":"2024-04-25T02:08:00.135952+0000","last_unstale":"2024-04-25T02:08:01.207360+0000","last_undegraded":"2024-04-25T02:08:01.207360+0000","last_fullsized":"2024-04-25T02:08:01.207360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:02.221034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117957+0000","last_change":"2024-04-25T02:07:59.117277+0000","last_active":"2024-04-25T02:08:01.117957+0000","last_peered":"2024-04-25T02:08:01.117957+0000","last_clean":"2024-04-25T02:08:01.117957+0000","last_became_active":"2024-04-25T02:07:59.116747+0000","last_became_peered":"2024-04-25T02:07:59.116747+0000","last_unstale":"2024-04-25T02:08:01.117957+0000","last_undegraded":"2024-04-25T02:08:01.117957+0000","last_fullsized":"2024-04-25T02:08:01.117957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:44:38.307212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118279+0000","last_change":"2024-04-25T02:08:00.139343+0000","last_active":"2024-04-25T02:08:01.118279+0000","last_peered":"2024-04-25T02:08:01.118279+0000","last_clean":"2024-04-25T02:08:01.118279+0000","last_became_active":"2024-04-25T02:08:00.138642+0000","last_became_peered":"2024-04-25T02:08:00.138642+0000","last_unstale":"2024-04-25T02:08:01.118279+0000","last_undegraded":"2024-04-25T02:08:01.118279+0000","last_fullsized":"2024-04-25T02:08:01.118279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:36.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113704+0000","last_change":"2024-04-25T02:07:59.112377+0000","last_active":"2024-04-25T02:08:01.113704+0000","last_peered":"2024-04-25T02:08:01.113704+0000","last_clean":"2024-04-25T02:08:01.113704+0000","last_became_active":"2024-04-25T02:07:59.112103+0000","last_became_peered":"2024-04-25T02:07:59.112103+0000","last_unstale":"2024-04-25T02:08:01.113704+0000","last_undegraded":"2024-04-25T02:08:01.113704+0000","last_fullsized":"2024-04-25T02:08:01.113704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:50.979492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115219+0000","last_change":"2024-04-25T02:08:00.133208+0000","last_active":"2024-04-25T02:08:01.115219+0000","last_peered":"2024-04-25T02:08:01.115219+0000","last_clean":"2024-04-25T02:08:01.115219+0000","last_became_active":"2024-04-25T02:08:00.132881+0000","last_became_peered":"2024-04-25T02:08:00.132881+0000","last_unstale":"2024-04-25T02:08:01.115219+0000","last_undegraded":"2024-04-25T02:08:01.115219+0000","last_fullsized":"2024-04-25T02:08:01.115219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:41.987311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117687+0000","last_change":"2024-04-25T02:07:59.117515+0000","last_active":"2024-04-25T02:08:01.117687+0000","last_peered":"2024-04-25T02:08:01.117687+0000","last_clean":"2024-04-25T02:08:01.117687+0000","last_became_active":"2024-04-25T02:07:59.117244+0000","last_became_peered":"2024-04-25T02:07:59.117244+0000","last_unstale":"2024-04-25T02:08:01.117687+0000","last_undegraded":"2024-04-25T02:08:01.117687+0000","last_fullsized":"2024-04-25T02:08:01.117687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:50.979492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207349+0000","last_change":"2024-04-25T02:08:00.143967+0000","last_active":"2024-04-25T02:08:01.207349+0000","last_peered":"2024-04-25T02:08:01.207349+0000","last_clean":"2024-04-25T02:08:01.207349+0000","last_became_active":"2024-04-25T02:08:00.143648+0000","last_became_peered":"2024-04-25T02:08:00.143648+0000","last_unstale":"2024-04-25T02:08:01.207349+0000","last_undegraded":"2024-04-25T02:08:01.207349+0000","last_fullsized":"2024-04-25T02:08:01.207349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:41.987311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117708+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:08:01.117708+0000","last_peered":"2024-04-25T02:08:01.117708+0000","last_clean":"2024-04-25T02:08:01.117708+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:08:01.117708+0000","last_undegraded":"2024-04-25T02:08:01.117708+0000","last_fullsized":"2024-04-25T02:08:01.117708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114625+0000","last_change":"2024-04-25T02:07:59.117637+0000","last_active":"2024-04-25T02:08:01.114625+0000","last_peered":"2024-04-25T02:08:01.114625+0000","last_clean":"2024-04-25T02:08:01.114625+0000","last_became_active":"2024-04-25T02:07:59.116977+0000","last_became_peered":"2024-04-25T02:07:59.116977+0000","last_unstale":"2024-04-25T02:08:01.114625+0000","last_undegraded":"2024-04-25T02:08:01.114625+0000","last_fullsized":"2024-04-25T02:08:01.114625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:26.203451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118264+0000","last_change":"2024-04-25T02:08:00.141683+0000","last_active":"2024-04-25T02:08:01.118264+0000","last_peered":"2024-04-25T02:08:01.118264+0000","last_clean":"2024-04-25T02:08:01.118264+0000","last_became_active":"2024-04-25T02:08:00.141434+0000","last_became_peered":"2024-04-25T02:08:00.141434+0000","last_unstale":"2024-04-25T02:08:01.118264+0000","last_undegraded":"2024-04-25T02:08:01.118264+0000","last_fullsized":"2024-04-25T02:08:01.118264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.809054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117679+0000","last_change":"2024-04-25T02:07:59.117708+0000","last_active":"2024-04-25T02:08:01.117679+0000","last_peered":"2024-04-25T02:08:01.117679+0000","last_clean":"2024-04-25T02:08:01.117679+0000","last_became_active":"2024-04-25T02:07:59.117400+0000","last_became_peered":"2024-04-25T02:07:59.117400+0000","last_unstale":"2024-04-25T02:08:01.117679+0000","last_undegraded":"2024-04-25T02:08:01.117679+0000","last_fullsized":"2024-04-25T02:08:01.117679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:45.925719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117332+0000","last_change":"2024-04-25T02:08:00.134117+0000","last_active":"2024-04-25T02:08:01.117332+0000","last_peered":"2024-04-25T02:08:01.117332+0000","last_clean":"2024-04-25T02:08:01.117332+0000","last_became_active":"2024-04-25T02:08:00.133834+0000","last_became_peered":"2024-04-25T02:08:00.133834+0000","last_unstale":"2024-04-25T02:08:01.117332+0000","last_undegraded":"2024-04-25T02:08:01.117332+0000","last_fullsized":"2024-04-25T02:08:01.117332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:03.610376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117110+0000","last_change":"2024-04-25T02:07:59.117339+0000","last_active":"2024-04-25T02:08:01.117110+0000","last_peered":"2024-04-25T02:08:01.117110+0000","last_clean":"2024-04-25T02:08:01.117110+0000","last_became_active":"2024-04-25T02:07:59.116562+0000","last_became_peered":"2024-04-25T02:07:59.116562+0000","last_unstale":"2024-04-25T02:08:01.117110+0000","last_undegraded":"2024-04-25T02:08:01.117110+0000","last_fullsized":"2024-04-25T02:08:01.117110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:52:35.221325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113308+0000","last_change":"2024-04-25T02:08:00.127645+0000","last_active":"2024-04-25T02:08:01.113308+0000","last_peered":"2024-04-25T02:08:01.113308+0000","last_clean":"2024-04-25T02:08:01.113308+0000","last_became_active":"2024-04-25T02:08:00.127261+0000","last_became_peered":"2024-04-25T02:08:00.127261+0000","last_unstale":"2024-04-25T02:08:01.113308+0000","last_undegraded":"2024-04-25T02:08:01.113308+0000","last_fullsized":"2024-04-25T02:08:01.113308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:27:41.665005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115821+0000","last_change":"2024-04-25T02:07:59.114633+0000","last_active":"2024-04-25T02:08:01.115821+0000","last_peered":"2024-04-25T02:08:01.115821+0000","last_clean":"2024-04-25T02:08:01.115821+0000","last_became_active":"2024-04-25T02:07:59.114349+0000","last_became_peered":"2024-04-25T02:07:59.114349+0000","last_unstale":"2024-04-25T02:08:01.115821+0000","last_undegraded":"2024-04-25T02:08:01.115821+0000","last_fullsized":"2024-04-25T02:08:01.115821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:06.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117977+0000","last_change":"2024-04-25T02:08:00.131106+0000","last_active":"2024-04-25T02:08:01.117977+0000","last_peered":"2024-04-25T02:08:01.117977+0000","last_clean":"2024-04-25T02:08:01.117977+0000","last_became_active":"2024-04-25T02:08:00.130507+0000","last_became_peered":"2024-04-25T02:08:00.130507+0000","last_unstale":"2024-04-25T02:08:01.117977+0000","last_undegraded":"2024-04-25T02:08:01.117977+0000","last_fullsized":"2024-04-25T02:08:01.117977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:46.930603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113534+0000","last_change":"2024-04-25T02:07:59.108809+0000","last_active":"2024-04-25T02:08:01.113534+0000","last_peered":"2024-04-25T02:08:01.113534+0000","last_clean":"2024-04-25T02:08:01.113534+0000","last_became_active":"2024-04-25T02:07:59.108512+0000","last_became_peered":"2024-04-25T02:07:59.108512+0000","last_unstale":"2024-04-25T02:08:01.113534+0000","last_undegraded":"2024-04-25T02:08:01.113534+0000","last_fullsized":"2024-04-25T02:08:01.113534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:06.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115650+0000","last_change":"2024-04-25T02:08:00.132084+0000","last_active":"2024-04-25T02:08:01.115650+0000","last_peered":"2024-04-25T02:08:01.115650+0000","last_clean":"2024-04-25T02:08:01.115650+0000","last_became_active":"2024-04-25T02:08:00.131767+0000","last_became_peered":"2024-04-25T02:08:00.131767+0000","last_unstale":"2024-04-25T02:08:01.115650+0000","last_undegraded":"2024-04-25T02:08:01.115650+0000","last_fullsized":"2024-04-25T02:08:01.115650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:08:42.030490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207466+0000","last_change":"2024-04-25T02:07:59.118487+0000","last_active":"2024-04-25T02:08:01.207466+0000","last_peered":"2024-04-25T02:08:01.207466+0000","last_clean":"2024-04-25T02:08:01.207466+0000","last_became_active":"2024-04-25T02:07:59.118201+0000","last_became_peered":"2024-04-25T02:07:59.118201+0000","last_unstale":"2024-04-25T02:08:01.207466+0000","last_undegraded":"2024-04-25T02:08:01.207466+0000","last_fullsized":"2024-04-25T02:08:01.207466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:55.053228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113576+0000","last_change":"2024-04-25T02:08:00.131978+0000","last_active":"2024-04-25T02:08:01.113576+0000","last_peered":"2024-04-25T02:08:01.113576+0000","last_clean":"2024-04-25T02:08:01.113576+0000","last_became_active":"2024-04-25T02:08:00.131731+0000","last_became_peered":"2024-04-25T02:08:00.131731+0000","last_unstale":"2024-04-25T02:08:01.113576+0000","last_undegraded":"2024-04-25T02:08:01.113576+0000","last_fullsized":"2024-04-25T02:08:01.113576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:29.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113718+0000","last_change":"2024-04-25T02:07:59.112512+0000","last_active":"2024-04-25T02:08:01.113718+0000","last_peered":"2024-04-25T02:08:01.113718+0000","last_clean":"2024-04-25T02:08:01.113718+0000","last_became_active":"2024-04-25T02:07:59.112246+0000","last_became_peered":"2024-04-25T02:07:59.112246+0000","last_unstale":"2024-04-25T02:08:01.113718+0000","last_undegraded":"2024-04-25T02:08:01.113718+0000","last_fullsized":"2024-04-25T02:08:01.113718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:45.925719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118217+0000","last_change":"2024-04-25T02:08:00.140610+0000","last_active":"2024-04-25T02:08:01.118217+0000","last_peered":"2024-04-25T02:08:01.118217+0000","last_clean":"2024-04-25T02:08:01.118217+0000","last_became_active":"2024-04-25T02:08:00.140314+0000","last_became_peered":"2024-04-25T02:08:00.140314+0000","last_unstale":"2024-04-25T02:08:01.118217+0000","last_undegraded":"2024-04-25T02:08:01.118217+0000","last_fullsized":"2024-04-25T02:08:01.118217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:54.475986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115418+0000","last_change":"2024-04-25T02:07:59.119301+0000","last_active":"2024-04-25T02:08:01.115418+0000","last_peered":"2024-04-25T02:08:01.115418+0000","last_clean":"2024-04-25T02:08:01.115418+0000","last_became_active":"2024-04-25T02:07:59.119015+0000","last_became_peered":"2024-04-25T02:07:59.119015+0000","last_unstale":"2024-04-25T02:08:01.115418+0000","last_undegraded":"2024-04-25T02:08:01.115418+0000","last_fullsized":"2024-04-25T02:08:01.115418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:06.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117449+0000","last_change":"2024-04-25T02:08:00.127146+0000","last_active":"2024-04-25T02:08:01.117449+0000","last_peered":"2024-04-25T02:08:01.117449+0000","last_clean":"2024-04-25T02:08:01.117449+0000","last_became_active":"2024-04-25T02:08:00.126871+0000","last_became_peered":"2024-04-25T02:08:00.126871+0000","last_unstale":"2024-04-25T02:08:01.117449+0000","last_undegraded":"2024-04-25T02:08:01.117449+0000","last_fullsized":"2024-04-25T02:08:01.117449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:03:37.966520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117574+0000","last_change":"2024-04-25T02:07:59.119153+0000","last_active":"2024-04-25T02:08:01.117574+0000","last_peered":"2024-04-25T02:08:01.117574+0000","last_clean":"2024-04-25T02:08:01.117574+0000","last_became_active":"2024-04-25T02:07:59.118830+0000","last_became_peered":"2024-04-25T02:07:59.118830+0000","last_unstale":"2024-04-25T02:08:01.117574+0000","last_undegraded":"2024-04-25T02:08:01.117574+0000","last_fullsized":"2024-04-25T02:08:01.117574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:17.087667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117757+0000","last_change":"2024-04-25T02:08:00.130764+0000","last_active":"2024-04-25T02:08:01.117757+0000","last_peered":"2024-04-25T02:08:01.117757+0000","last_clean":"2024-04-25T02:08:01.117757+0000","last_became_active":"2024-04-25T02:08:00.130490+0000","last_became_peered":"2024-04-25T02:08:00.130490+0000","last_unstale":"2024-04-25T02:08:01.117757+0000","last_undegraded":"2024-04-25T02:08:01.117757+0000","last_fullsized":"2024-04-25T02:08:01.117757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:18.092551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113394+0000","last_change":"2024-04-25T02:07:59.115182+0000","last_active":"2024-04-25T02:08:01.113394+0000","last_peered":"2024-04-25T02:08:01.113394+0000","last_clean":"2024-04-25T02:08:01.113394+0000","last_became_active":"2024-04-25T02:07:59.114863+0000","last_became_peered":"2024-04-25T02:07:59.114863+0000","last_unstale":"2024-04-25T02:08:01.113394+0000","last_undegraded":"2024-04-25T02:08:01.113394+0000","last_fullsized":"2024-04-25T02:08:01.113394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:17.087667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117302+0000","last_change":"2024-04-25T02:08:00.138786+0000","last_active":"2024-04-25T02:08:01.117302+0000","last_peered":"2024-04-25T02:08:01.117302+0000","last_clean":"2024-04-25T02:08:01.117302+0000","last_became_active":"2024-04-25T02:08:00.138517+0000","last_became_peered":"2024-04-25T02:08:00.138517+0000","last_unstale":"2024-04-25T02:08:01.117302+0000","last_undegraded":"2024-04-25T02:08:01.117302+0000","last_fullsized":"2024-04-25T02:08:01.117302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:27.956618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113528+0000","last_change":"2024-04-25T02:07:59.113581+0000","last_active":"2024-04-25T02:08:01.113528+0000","last_peered":"2024-04-25T02:08:01.113528+0000","last_clean":"2024-04-25T02:08:01.113528+0000","last_became_active":"2024-04-25T02:07:59.113310+0000","last_became_peered":"2024-04-25T02:07:59.113310+0000","last_unstale":"2024-04-25T02:08:01.113528+0000","last_undegraded":"2024-04-25T02:08:01.113528+0000","last_fullsized":"2024-04-25T02:08:01.113528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:44:38.307212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118372+0000","last_change":"2024-04-25T02:08:00.137561+0000","last_active":"2024-04-25T02:08:01.118372+0000","last_peered":"2024-04-25T02:08:01.118372+0000","last_clean":"2024-04-25T02:08:01.118372+0000","last_became_active":"2024-04-25T02:08:00.137252+0000","last_became_peered":"2024-04-25T02:08:00.137252+0000","last_unstale":"2024-04-25T02:08:01.118372+0000","last_undegraded":"2024-04-25T02:08:01.118372+0000","last_fullsized":"2024-04-25T02:08:01.118372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:19.162081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207479+0000","last_change":"2024-04-25T02:07:59.118237+0000","last_active":"2024-04-25T02:08:01.207479+0000","last_peered":"2024-04-25T02:08:01.207479+0000","last_clean":"2024-04-25T02:08:01.207479+0000","last_became_active":"2024-04-25T02:07:59.117917+0000","last_became_peered":"2024-04-25T02:07:59.117917+0000","last_unstale":"2024-04-25T02:08:01.207479+0000","last_undegraded":"2024-04-25T02:08:01.207479+0000","last_fullsized":"2024-04-25T02:08:01.207479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:26.203451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114395+0000","last_change":"2024-04-25T02:08:00.126329+0000","last_active":"2024-04-25T02:08:01.114395+0000","last_peered":"2024-04-25T02:08:01.114395+0000","last_clean":"2024-04-25T02:08:01.114395+0000","last_became_active":"2024-04-25T02:08:00.125975+0000","last_became_peered":"2024-04-25T02:08:00.125975+0000","last_unstale":"2024-04-25T02:08:01.114395+0000","last_undegraded":"2024-04-25T02:08:01.114395+0000","last_fullsized":"2024-04-25T02:08:01.114395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:27.956618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115608+0000","last_change":"2024-04-25T02:08:00.120645+0000","last_active":"2024-04-25T02:08:01.115608+0000","last_peered":"2024-04-25T02:08:01.115608+0000","last_clean":"2024-04-25T02:08:01.115608+0000","last_became_active":"2024-04-25T02:08:00.120310+0000","last_became_peered":"2024-04-25T02:08:00.120310+0000","last_unstale":"2024-04-25T02:08:01.115608+0000","last_undegraded":"2024-04-25T02:08:01.115608+0000","last_fullsized":"2024-04-25T02:08:01.115608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:48.665413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117952+0000","last_change":"2024-04-25T02:07:59.120716+0000","last_active":"2024-04-25T02:08:01.117952+0000","last_peered":"2024-04-25T02:08:01.117952+0000","last_clean":"2024-04-25T02:08:01.117952+0000","last_became_active":"2024-04-25T02:07:59.120392+0000","last_became_peered":"2024-04-25T02:07:59.120392+0000","last_unstale":"2024-04-25T02:08:01.117952+0000","last_undegraded":"2024-04-25T02:08:01.117952+0000","last_fullsized":"2024-04-25T02:08:01.117952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:06.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115035+0000","last_change":"2024-04-25T02:08:00.121830+0000","last_active":"2024-04-25T02:08:01.115035+0000","last_peered":"2024-04-25T02:08:01.115035+0000","last_clean":"2024-04-25T02:08:01.115035+0000","last_became_active":"2024-04-25T02:08:00.121537+0000","last_became_peered":"2024-04-25T02:08:00.121537+0000","last_unstale":"2024-04-25T02:08:01.115035+0000","last_undegraded":"2024-04-25T02:08:01.115035+0000","last_fullsized":"2024-04-25T02:08:01.115035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:36.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207392+0000","last_change":"2024-04-25T02:07:59.118155+0000","last_active":"2024-04-25T02:08:01.207392+0000","last_peered":"2024-04-25T02:08:01.207392+0000","last_clean":"2024-04-25T02:08:01.207392+0000","last_became_active":"2024-04-25T02:07:59.117780+0000","last_became_peered":"2024-04-25T02:07:59.117780+0000","last_unstale":"2024-04-25T02:08:01.207392+0000","last_undegraded":"2024-04-25T02:08:01.207392+0000","last_fullsized":"2024-04-25T02:08:01.207392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:01.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117736+0000","last_change":"2024-04-25T02:08:00.135738+0000","last_active":"2024-04-25T02:08:01.117736+0000","last_peered":"2024-04-25T02:08:01.117736+0000","last_clean":"2024-04-25T02:08:01.117736+0000","last_became_active":"2024-04-25T02:08:00.135274+0000","last_became_peered":"2024-04-25T02:08:00.135274+0000","last_unstale":"2024-04-25T02:08:01.117736+0000","last_undegraded":"2024-04-25T02:08:01.117736+0000","last_fullsized":"2024-04-25T02:08:01.117736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:17.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118294+0000","last_change":"2024-04-25T02:07:59.112926+0000","last_active":"2024-04-25T02:08:01.118294+0000","last_peered":"2024-04-25T02:08:01.118294+0000","last_clean":"2024-04-25T02:08:01.118294+0000","last_became_active":"2024-04-25T02:07:59.112649+0000","last_became_peered":"2024-04-25T02:07:59.112649+0000","last_unstale":"2024-04-25T02:08:01.118294+0000","last_undegraded":"2024-04-25T02:08:01.118294+0000","last_fullsized":"2024-04-25T02:08:01.118294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:58.131371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118217+0000","last_change":"2024-04-25T02:08:00.133666+0000","last_active":"2024-04-25T02:08:01.118217+0000","last_peered":"2024-04-25T02:08:01.118217+0000","last_clean":"2024-04-25T02:08:01.118217+0000","last_became_active":"2024-04-25T02:08:00.133392+0000","last_became_peered":"2024-04-25T02:08:00.133392+0000","last_unstale":"2024-04-25T02:08:01.118217+0000","last_undegraded":"2024-04-25T02:08:01.118217+0000","last_fullsized":"2024-04-25T02:08:01.118217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:17.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117965+0000","last_change":"2024-04-25T02:07:59.115590+0000","last_active":"2024-04-25T02:08:01.117965+0000","last_peered":"2024-04-25T02:08:01.117965+0000","last_clean":"2024-04-25T02:08:01.117965+0000","last_became_active":"2024-04-25T02:07:59.115307+0000","last_became_peered":"2024-04-25T02:07:59.115307+0000","last_unstale":"2024-04-25T02:08:01.117965+0000","last_undegraded":"2024-04-25T02:08:01.117965+0000","last_fullsized":"2024-04-25T02:08:01.117965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:58.131371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":660255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":69395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":69431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":69465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":660311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:08:03.427 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T02:08:03.427 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T02:08:03.427 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T02:08:03.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T02:08:03.427 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T02:08:03.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.552+0000 7f7ce824c640 1 Processor -- start 2024-04-25T02:08:03.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.552+0000 7f7ce824c640 1 -- start start 2024-04-25T02:08:03.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.553+0000 7f7ce824c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7ce015c8d0 0x7f7ce015dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.553+0000 7f7ce824c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce015a040 con 0x7f7ce0066ea0 2024-04-25T02:08:03.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.553+0000 7f7ce824c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce006b250 con 0x7f7ce006c010 2024-04-25T02:08:03.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.553+0000 7f7ce824c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f7ce0072930 con 0x7f7ce015c8d0 2024-04-25T02:08:03.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.553+0000 7f7ce57e7640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7ce0066ea0 0x7f7ce015ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47672/0 (socket says 172.21.15.79:47672) 2024-04-25T02:08:03.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.553+0000 7f7ce57e7640 1 -- 172.21.15.79:0/847248086 learned_addr learned my addr 172.21.15.79:0/847248086 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:03.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce4fe6640 1 -- 172.21.15.79:0/847248086 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181734383 0 0) 0x7f7ce015a040 con 0x7f7ce0066ea0 2024-04-25T02:08:03.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce5fe8640 1 --2- 172.21.15.79:0/847248086 >> v2:172.21.15.189:3300/0 conn(0x7f7ce015c8d0 0x7f7ce015dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce4fe6640 1 -- 172.21.15.79:0/847248086 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ccc003520 con 0x7f7ce0066ea0 2024-04-25T02:08:03.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce4fe6640 1 -- 172.21.15.79:0/847248086 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1320627888 0 0) 0x7f7ccc003520 con 0x7f7ce0066ea0 2024-04-25T02:08:03.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce4fe6640 1 -- 172.21.15.79:0/847248086 >> v2:172.21.15.189:3300/0 conn(0x7f7ce015c8d0 msgr2=0x7f7ce015dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:03.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce4fe6640 1 --2- 172.21.15.79:0/847248086 >> v2:172.21.15.189:3300/0 conn(0x7f7ce015c8d0 0x7f7ce015dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce4fe6640 1 -- 172.21.15.79:0/847248086 >> v1:172.21.15.189:6789/0 conn(0x7f7ce006c010 legacy=0x7f7ce006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce4fe6640 1 -- 172.21.15.79:0/847248086 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce006b530 con 0x7f7ce0066ea0 2024-04-25T02:08:03.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce4fe6640 1 -- 172.21.15.79:0/847248086 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f7cd0001670 con 0x7f7ce0066ea0 2024-04-25T02:08:03.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce4fe6640 1 -- 172.21.15.79:0/847248086 >> v1:172.21.15.79:6789/0 conn(0x7f7ce0066ea0 legacy=0x7f7ce015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce4fe6640 1 --2- 172.21.15.79:0/847248086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ccc0039b0 0x7f7ccc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce4fe6640 1 --2- 172.21.15.79:0/847248086 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ccc004800 0x7f7ccc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce4fe6640 1 --2- 172.21.15.79:0/847248086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ccc0051c0 0x7f7ccc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce4fe6640 1 -- 172.21.15.79:0/847248086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc00c0e0 con 0x7f7ccc0039b0 2024-04-25T02:08:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce4fe6640 1 -- 172.21.15.79:0/847248086 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc00c290 con 0x7f7ccc0051c0 2024-04-25T02:08:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce4fe6640 1 -- 172.21.15.79:0/847248086 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7ccc00c490 con 0x7f7ccc004800 2024-04-25T02:08:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce5fe8640 1 --2- 172.21.15.79:0/847248086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ccc0039b0 0x7f7ccc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce67e9640 1 --2- 172.21.15.79:0/847248086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ccc0051c0 0x7f7ccc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce57e7640 1 --2- 172.21.15.79:0/847248086 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ccc004800 0x7f7ccc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce5fe8640 1 -- 172.21.15.79:0/847248086 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ccc004800 msgr2=0x7f7ccc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce5fe8640 1 --2- 172.21.15.79:0/847248086 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ccc004800 0x7f7ccc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce5fe8640 1 -- 172.21.15.79:0/847248086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ccc0051c0 msgr2=0x7f7ccc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce5fe8640 1 --2- 172.21.15.79:0/847248086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ccc0051c0 0x7f7ccc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce67e9640 1 -- 172.21.15.79:0/847248086 reap_dead start 2024-04-25T02:08:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce5fe8640 1 -- 172.21.15.79:0/847248086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ccc003520 con 0x7f7ccc0039b0 2024-04-25T02:08:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.554+0000 7f7ce57e7640 1 --2- 172.21.15.79:0/847248086 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ccc004800 0x7f7ccc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.555+0000 7f7ce5fe8640 1 --2- 172.21.15.79:0/847248086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ccc0039b0 0x7f7ccc003dd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc007360 tx=0x7f7ccc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e481135c1a3b691e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.555+0000 7f7ce4fe6640 1 -- 172.21.15.79:0/847248086 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc009be0 con 0x7f7ccc0039b0 2024-04-25T02:08:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.555+0000 7f7ce4fe6640 1 -- 172.21.15.79:0/847248086 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cdc036600 con 0x7f7ccc0039b0 2024-04-25T02:08:03.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.555+0000 7f7ce4fe6640 1 -- 172.21.15.79:0/847248086 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc0369d0 con 0x7f7ccc0039b0 2024-04-25T02:08:03.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.556+0000 7f7ce824c640 1 -- 172.21.15.79:0/847248086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ccc0039b0 msgr2=0x7f7ccc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.556+0000 7f7ce824c640 1 --2- 172.21.15.79:0/847248086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ccc0039b0 0x7f7ccc003dd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc007360 tx=0x7f7ccc005830 comp rx=0 tx=0).stop 2024-04-25T02:08:03.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.556+0000 7f7ce824c640 1 -- 172.21.15.79:0/847248086 shutdown_connections 2024-04-25T02:08:03.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.556+0000 7f7ce824c640 1 --2- 172.21.15.79:0/847248086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ccc0039b0 0x7f7ccc003dd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.556+0000 7f7ce824c640 1 -- 172.21.15.79:0/847248086 >> 172.21.15.79:0/847248086 conn(0x7f7ce00ccee0 msgr2=0x7f7ce00cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:03.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.556+0000 7f7ce824c640 1 -- 172.21.15.79:0/847248086 shutdown_connections 2024-04-25T02:08:03.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.556+0000 7f7ce824c640 1 -- 172.21.15.79:0/847248086 wait complete. 2024-04-25T02:08:03.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.557+0000 7f7ce824c640 1 Processor -- start 2024-04-25T02:08:03.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.557+0000 7f7ce824c640 1 -- start start 2024-04-25T02:08:03.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.557+0000 7f7ce824c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ccc0039b0 0x7f7ce0145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.557+0000 7f7ce824c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ce00c53a0 0x7f7ce00c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce824c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ce0157c50 0x7f7ce01580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce824c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce00caab0 con 0x7f7ce0157c50 2024-04-25T02:08:03.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce824c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce006baf0 con 0x7f7ccc0039b0 2024-04-25T02:08:03.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce824c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7ce00cac30 con 0x7f7ce00c53a0 2024-04-25T02:08:03.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce67e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ce0157c50 0x7f7ce01580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce67e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ce0157c50 0x7f7ce01580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34744/0 (socket says 172.21.15.79:34744) 2024-04-25T02:08:03.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce67e9640 1 -- 172.21.15.79:0/431015703 learned_addr learned my addr 172.21.15.79:0/431015703 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce5fe8640 1 --2- 172.21.15.79:0/431015703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ccc0039b0 0x7f7ce0145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce57e7640 1 --2- 172.21.15.79:0/431015703 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ce00c53a0 0x7f7ce00c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce67e9640 1 -- 172.21.15.79:0/431015703 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ce00c53a0 msgr2=0x7f7ce00c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce67e9640 1 --2- 172.21.15.79:0/431015703 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ce00c53a0 0x7f7ce00c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce67e9640 1 -- 172.21.15.79:0/431015703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ccc0039b0 msgr2=0x7f7ce0145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce67e9640 1 --2- 172.21.15.79:0/431015703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ccc0039b0 0x7f7ce0145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce67e9640 1 -- 172.21.15.79:0/431015703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce0154380 con 0x7f7ce0157c50 2024-04-25T02:08:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce67e9640 1 --2- 172.21.15.79:0/431015703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ce0157c50 0x7f7ce01580d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800f470 tx=0x7f7cd800f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7cd67fc640 1 -- 172.21.15.79:0/431015703 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd801a070 con 0x7f7ce0157c50 2024-04-25T02:08:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7cd67fc640 1 -- 172.21.15.79:0/431015703 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd8005280 con 0x7f7ce0157c50 2024-04-25T02:08:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7cd67fc640 1 -- 172.21.15.79:0/431015703 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8007030 con 0x7f7ce0157c50 2024-04-25T02:08:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce824c640 1 -- 172.21.15.79:0/431015703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce01589b0 con 0x7f7ce0157c50 2024-04-25T02:08:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.558+0000 7f7ce824c640 1 -- 172.21.15.79:0/431015703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce0146190 con 0x7f7ce0157c50 2024-04-25T02:08:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.559+0000 7f7ce824c640 1 -- 172.21.15.79:0/431015703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce00690a0 con 0x7f7ce0157c50 2024-04-25T02:08:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.560+0000 7f7cd67fc640 1 -- 172.21.15.79:0/431015703 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7cd801d070 con 0x7f7ce0157c50 2024-04-25T02:08:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.560+0000 7f7cd67fc640 1 --2- 172.21.15.79:0/431015703 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7cc406be30 0x7f7cc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.560+0000 7f7ce5fe8640 1 --2- 172.21.15.79:0/431015703 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7cc406be30 0x7f7cc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.560+0000 7f7cd67fc640 1 -- 172.21.15.79:0/431015703 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7cd8089f40 con 0x7f7ce0157c50 2024-04-25T02:08:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.561+0000 7f7ce5fe8640 1 --2- 172.21.15.79:0/431015703 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7cc406be30 0x7f7cc406e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc035000 tx=0x7f7cdc00b030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.565+0000 7f7cd67fc640 1 -- 172.21.15.79:0/431015703 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7ce0154380 con 0x7f7ce0157c50 2024-04-25T02:08:03.723 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-04-25T02:08:03.717+0000 7f7602f74640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:08:03.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.785+0000 7f7ce824c640 1 -- 172.21.15.79:0/431015703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f7ce00b5bd0 con 0x7f7ce0157c50 2024-04-25T02:08:03.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.788+0000 7f7cd67fc640 1 -- 172.21.15.79:0/431015703 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172933 (secure 0 0 0) 0x7f7cd80582a0 con 0x7f7ce0157c50 2024-04-25T02:08:03.796 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:03.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.790+0000 7f7ce824c640 1 -- 172.21.15.79:0/431015703 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7cc406be30 msgr2=0x7f7cc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.790+0000 7f7ce824c640 1 --2- 172.21.15.79:0/431015703 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7cc406be30 0x7f7cc406e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc035000 tx=0x7f7cdc00b030 comp rx=0 tx=0).stop 2024-04-25T02:08:03.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.790+0000 7f7ce824c640 1 -- 172.21.15.79:0/431015703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ce0157c50 msgr2=0x7f7ce01580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.790+0000 7f7ce824c640 1 --2- 172.21.15.79:0/431015703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ce0157c50 0x7f7ce01580d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800f470 tx=0x7f7cd800f930 comp rx=0 tx=0).stop 2024-04-25T02:08:03.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.790+0000 7f7ce824c640 1 -- 172.21.15.79:0/431015703 shutdown_connections 2024-04-25T02:08:03.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.790+0000 7f7ce824c640 1 --2- 172.21.15.79:0/431015703 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7cc406be30 0x7f7cc406e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.790+0000 7f7ce824c640 1 --2- 172.21.15.79:0/431015703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ce0157c50 0x7f7ce01580d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.790+0000 7f7ce824c640 1 --2- 172.21.15.79:0/431015703 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ce00c53a0 0x7f7ce00c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.790+0000 7f7ce824c640 1 --2- 172.21.15.79:0/431015703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ccc0039b0 0x7f7ce0145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.790+0000 7f7ce824c640 1 -- 172.21.15.79:0/431015703 >> 172.21.15.79:0/431015703 conn(0x7f7ce00ccee0 msgr2=0x7f7ce00b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:03.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.790+0000 7f7ce824c640 1 -- 172.21.15.79:0/431015703 shutdown_connections 2024-04-25T02:08:03.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.790+0000 7f7ce824c640 1 -- 172.21.15.79:0/431015703 wait complete. 2024-04-25T02:08:03.810 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":73399441},{"type":"v1","addr":"172.21.15.79:6833","nonce":73399441}]},"active_addr":"172.21.15.79:6833/73399441","active_change":"2024-04-25T02:07:39.164816+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":1844987364}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":3359827422}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":2661886832}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":3260788599}]}]} 2024-04-25T02:08:03.813 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T02:08:03.813 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T02:08:03.814 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:03.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.904+0000 7fc3e1bb7640 1 Processor -- start 2024-04-25T02:08:03.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.904+0000 7fc3e1bb7640 1 -- start start 2024-04-25T02:08:03.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.904+0000 7fc3e1bb7640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc3dc0d0b10 0x7fc3dc0cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.904+0000 7fc3e1bb7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3dc0cff30 con 0x7fc3dc0d2940 2024-04-25T02:08:03.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.904+0000 7fc3e1bb7640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3dc0cf720 con 0x7fc3dc15c230 2024-04-25T02:08:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.904+0000 7fc3e1bb7640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc3dc0d2d50 con 0x7fc3dc0d0b10 2024-04-25T02:08:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3dbfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc3dc0d2940 0x7fc3dc0b1e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47678/0 (socket says 172.21.15.79:47678) 2024-04-25T02:08:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3dbfff640 1 -- 172.21.15.79:0/315630340 learned_addr learned my addr 172.21.15.79:0/315630340 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3daffd640 1 --2- 172.21.15.79:0/315630340 >> v2:172.21.15.189:3300/0 conn(0x7fc3dc0d0b10 0x7fc3dc0cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2111739911 0 0) 0x7fc3d4001490 con 0x7fc3dc0d2940 2024-04-25T02:08:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3c4003520 con 0x7fc3dc0d2940 2024-04-25T02:08:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1626453658 0 0) 0x7fc3dc0cf720 con 0x7fc3dc15c230 2024-04-25T02:08:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d4001490 con 0x7fc3dc15c230 2024-04-25T02:08:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3733583557 0 0) 0x7fc3c4003520 con 0x7fc3dc0d2940 2024-04-25T02:08:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 >> v2:172.21.15.189:3300/0 conn(0x7fc3dc0d0b10 msgr2=0x7fc3dc0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 --2- 172.21.15.79:0/315630340 >> v2:172.21.15.189:3300/0 conn(0x7fc3dc0d0b10 0x7fc3dc0cee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 >> v1:172.21.15.189:6789/0 conn(0x7fc3dc15c230 legacy=0x7fc3dc0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3dc0cf440 con 0x7fc3dc0d2940 2024-04-25T02:08:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fc3d4001bc0 con 0x7fc3dc0d2940 2024-04-25T02:08:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 >> v1:172.21.15.79:6789/0 conn(0x7fc3dc0d2940 legacy=0x7fc3dc0b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 --2- 172.21.15.79:0/315630340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c4003b90 0x7fc3c4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 --2- 172.21.15.79:0/315630340 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc3c4004800 0x7fc3c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 --2- 172.21.15.79:0/315630340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3c4005210 0x7fc3c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc0d2d50 con 0x7fc3c4003b90 2024-04-25T02:08:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c400c140 con 0x7fc3c4005210 2024-04-25T02:08:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c400c340 con 0x7fc3c4004800 2024-04-25T02:08:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3db7fe640 1 --2- 172.21.15.79:0/315630340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c4003b90 0x7fc3c4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3dbfff640 1 --2- 172.21.15.79:0/315630340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3c4005210 0x7fc3c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.905+0000 7fc3daffd640 1 --2- 172.21.15.79:0/315630340 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc3c4004800 0x7fc3c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.906+0000 7fc3db7fe640 1 -- 172.21.15.79:0/315630340 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc3c4004800 msgr2=0x7fc3c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.906+0000 7fc3db7fe640 1 --2- 172.21.15.79:0/315630340 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc3c4004800 0x7fc3c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.906+0000 7fc3db7fe640 1 -- 172.21.15.79:0/315630340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3c4005210 msgr2=0x7fc3c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.906+0000 7fc3db7fe640 1 --2- 172.21.15.79:0/315630340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3c4005210 0x7fc3c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.906+0000 7fc3db7fe640 1 -- 172.21.15.79:0/315630340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c4003520 con 0x7fc3c4003b90 2024-04-25T02:08:03.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.906+0000 7fc3dbfff640 1 -- 172.21.15.79:0/315630340 reap_dead start 2024-04-25T02:08:03.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.906+0000 7fc3db7fe640 1 --2- 172.21.15.79:0/315630340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c4003b90 0x7fc3c4003f90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0018d0 tx=0x7fc3c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2592ca3cfc27b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:03.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.906+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc0014f0 con 0x7fc3c4003b90 2024-04-25T02:08:03.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.906+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3cc0052d0 con 0x7fc3c4003b90 2024-04-25T02:08:03.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.906+0000 7fc3da7fc640 1 -- 172.21.15.79:0/315630340 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc02ac70 con 0x7fc3c4003b90 2024-04-25T02:08:03.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.907+0000 7fc3e1bb7640 1 -- 172.21.15.79:0/315630340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c4003b90 msgr2=0x7fc3c4003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.907+0000 7fc3e1bb7640 1 --2- 172.21.15.79:0/315630340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c4003b90 0x7fc3c4003f90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0018d0 tx=0x7fc3c4005830 comp rx=0 tx=0).stop 2024-04-25T02:08:03.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.907+0000 7fc3e1bb7640 1 -- 172.21.15.79:0/315630340 shutdown_connections 2024-04-25T02:08:03.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.907+0000 7fc3e1bb7640 1 --2- 172.21.15.79:0/315630340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c4003b90 0x7fc3c4003f90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.907+0000 7fc3e1bb7640 1 -- 172.21.15.79:0/315630340 >> 172.21.15.79:0/315630340 conn(0x7fc3dc0d1e20 msgr2=0x7fc3dc0d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:03.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.907+0000 7fc3e1bb7640 1 -- 172.21.15.79:0/315630340 shutdown_connections 2024-04-25T02:08:03.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.907+0000 7fc3e1bb7640 1 -- 172.21.15.79:0/315630340 wait complete. 2024-04-25T02:08:03.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.908+0000 7fc3e1bb7640 1 Processor -- start 2024-04-25T02:08:03.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.908+0000 7fc3e1bb7640 1 -- start start 2024-04-25T02:08:03.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3e1bb7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3c4003b90 0x7fc3dc0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3e1bb7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc3dc15f5a0 0x7fc3dc0c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3e1bb7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3dc15d460 0x7fc3dc15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3e1bb7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc15c610 con 0x7fc3dc15d460 2024-04-25T02:08:03.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3e1bb7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc0b1670 con 0x7fc3c4003b90 2024-04-25T02:08:03.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3e1bb7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc3dc0cee60 con 0x7fc3dc15f5a0 2024-04-25T02:08:03.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3dbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3dc15d460 0x7fc3dc15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3dbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3dc15d460 0x7fc3dc15d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34752/0 (socket says 172.21.15.79:34752) 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3dbfff640 1 -- 172.21.15.79:0/2660769274 learned_addr learned my addr 172.21.15.79:0/2660769274 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3daffd640 1 --2- 172.21.15.79:0/2660769274 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc3dc15f5a0 0x7fc3dc0c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3db7fe640 1 --2- 172.21.15.79:0/2660769274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3c4003b90 0x7fc3dc0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3dbfff640 1 -- 172.21.15.79:0/2660769274 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc3dc15f5a0 msgr2=0x7fc3dc0c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3dbfff640 1 --2- 172.21.15.79:0/2660769274 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc3dc15f5a0 0x7fc3dc0c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3dbfff640 1 -- 172.21.15.79:0/2660769274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3c4003b90 msgr2=0x7fc3dc0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3dbfff640 1 --2- 172.21.15.79:0/2660769274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3c4003b90 0x7fc3dc0b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3dbfff640 1 -- 172.21.15.79:0/2660769274 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3dc15cd20 con 0x7fc3dc15d460 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3dbfff640 1 --2- 172.21.15.79:0/2660769274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3dc15d460 0x7fc3dc15d8c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0b1250 tx=0x7fc3d400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3c3fff640 1 -- 172.21.15.79:0/2660769274 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d400eb30 con 0x7fc3dc15d460 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3c3fff640 1 -- 172.21.15.79:0/2660769274 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d400ecd0 con 0x7fc3dc15d460 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3e1bb7640 1 -- 172.21.15.79:0/2660769274 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3dc15d000 con 0x7fc3dc15d460 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3c3fff640 1 -- 172.21.15.79:0/2660769274 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4014670 con 0x7fc3dc15d460 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.909+0000 7fc3e1bb7640 1 -- 172.21.15.79:0/2660769274 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3dc0b6a50 con 0x7fc3dc15d460 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.910+0000 7fc3e1bb7640 1 -- 172.21.15.79:0/2660769274 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3dc0681e0 con 0x7fc3dc15d460 2024-04-25T02:08:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.911+0000 7fc3c3fff640 1 -- 172.21.15.79:0/2660769274 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3d4014810 con 0x7fc3dc15d460 2024-04-25T02:08:03.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.911+0000 7fc3c3fff640 1 --2- 172.21.15.79:0/2660769274 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc3c806be60 0x7fc3c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.911+0000 7fc3c3fff640 1 -- 172.21.15.79:0/2660769274 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc3d408aba0 con 0x7fc3dc15d460 2024-04-25T02:08:03.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.911+0000 7fc3db7fe640 1 --2- 172.21.15.79:0/2660769274 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc3c806be60 0x7fc3c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.912+0000 7fc3db7fe640 1 --2- 172.21.15.79:0/2660769274 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc3c806be60 0x7fc3c806e320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc032000 tx=0x7fc3cc009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:03.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:03.915+0000 7fc3c3fff640 1 -- 172.21.15.79:0/2660769274 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc3dc0cff30 con 0x7fc3dc15d460 2024-04-25T02:08:04.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.089+0000 7fc3e1bb7640 1 -- 172.21.15.79:0/2660769274 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3dc0b2c70 con 0x7fc3dc15d460 2024-04-25T02:08:04.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.090+0000 7fc3c3fff640 1 -- 172.21.15.79:0/2660769274 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7fc3d40595e0 con 0x7fc3dc15d460 2024-04-25T02:08:04.097 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:04.097 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:04.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.092+0000 7fc3e1bb7640 1 -- 172.21.15.79:0/2660769274 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc3c806be60 msgr2=0x7fc3c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.092+0000 7fc3e1bb7640 1 --2- 172.21.15.79:0/2660769274 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc3c806be60 0x7fc3c806e320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc032000 tx=0x7fc3cc009030 comp rx=0 tx=0).stop 2024-04-25T02:08:04.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.092+0000 7fc3e1bb7640 1 -- 172.21.15.79:0/2660769274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3dc15d460 msgr2=0x7fc3dc15d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.092+0000 7fc3e1bb7640 1 --2- 172.21.15.79:0/2660769274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3dc15d460 0x7fc3dc15d8c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0b1250 tx=0x7fc3d400e530 comp rx=0 tx=0).stop 2024-04-25T02:08:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.092+0000 7fc3e1bb7640 1 -- 172.21.15.79:0/2660769274 shutdown_connections 2024-04-25T02:08:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.092+0000 7fc3e1bb7640 1 --2- 172.21.15.79:0/2660769274 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc3c806be60 0x7fc3c806e320 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.092+0000 7fc3e1bb7640 1 --2- 172.21.15.79:0/2660769274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3dc15d460 0x7fc3dc15d8c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.092+0000 7fc3e1bb7640 1 --2- 172.21.15.79:0/2660769274 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc3dc15f5a0 0x7fc3dc0c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.092+0000 7fc3e1bb7640 1 --2- 172.21.15.79:0/2660769274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3c4003b90 0x7fc3dc0b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.092+0000 7fc3e1bb7640 1 -- 172.21.15.79:0/2660769274 >> 172.21.15.79:0/2660769274 conn(0x7fc3dc0d1e20 msgr2=0x7fc3dc0b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.092+0000 7fc3e1bb7640 1 -- 172.21.15.79:0/2660769274 shutdown_connections 2024-04-25T02:08:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.092+0000 7fc3e1bb7640 1 -- 172.21.15.79:0/2660769274 wait complete. 2024-04-25T02:08:04.110 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T02:08:04.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:04.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.201+0000 7f98c79e9640 1 Processor -- start 2024-04-25T02:08:04.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.201+0000 7f98c79e9640 1 -- start start 2024-04-25T02:08:04.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.202+0000 7f98c79e9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98c015e520 0x7f98c0066ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.202+0000 7f98c79e9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98c00cea70 con 0x7f98c006b0b0 2024-04-25T02:08:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.202+0000 7f98c79e9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98c00ced50 con 0x7f98c015e140 2024-04-25T02:08:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.202+0000 7f98c79e9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f98c0067480 con 0x7f98c015e520 2024-04-25T02:08:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.202+0000 7f98c5f86640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f98c006b0b0 0x7f98c00c97b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47688/0 (socket says 172.21.15.79:47688) 2024-04-25T02:08:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.202+0000 7f98c5f86640 1 -- 172.21.15.79:0/710718022 learned_addr learned my addr 172.21.15.79:0/710718022 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.202+0000 7f98b7fff640 1 -- 172.21.15.79:0/710718022 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2604909251 0 0) 0x7f98c00cea70 con 0x7f98c006b0b0 2024-04-25T02:08:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.202+0000 7f98b7fff640 1 -- 172.21.15.79:0/710718022 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98ac003520 con 0x7f98c006b0b0 2024-04-25T02:08:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.202+0000 7f98c4f84640 1 --2- 172.21.15.79:0/710718022 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98c015e520 0x7f98c0066ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98b7fff640 1 -- 172.21.15.79:0/710718022 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3220552710 0 0) 0x7f98ac003520 con 0x7f98c006b0b0 2024-04-25T02:08:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98b7fff640 1 -- 172.21.15.79:0/710718022 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98c015e520 msgr2=0x7f98c0066ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98b7fff640 1 --2- 172.21.15.79:0/710718022 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98c015e520 0x7f98c0066ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98b7fff640 1 -- 172.21.15.79:0/710718022 >> v1:172.21.15.189:6789/0 conn(0x7f98c015e140 legacy=0x7f98c00af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98b7fff640 1 -- 172.21.15.79:0/710718022 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c00cf030 con 0x7f98c006b0b0 2024-04-25T02:08:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98b7fff640 1 -- 172.21.15.79:0/710718022 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f98b8001670 con 0x7f98c006b0b0 2024-04-25T02:08:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98b7fff640 1 -- 172.21.15.79:0/710718022 >> v1:172.21.15.79:6789/0 conn(0x7f98c006b0b0 legacy=0x7f98c00c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98b7fff640 1 --2- 172.21.15.79:0/710718022 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98c015e520 0x7f98ac0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98b7fff640 1 --2- 172.21.15.79:0/710718022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98ac003f60 0x7f98ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98b7fff640 1 --2- 172.21.15.79:0/710718022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98ac004d40 0x7f98ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98b7fff640 1 -- 172.21.15.79:0/710718022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f98c0067480 con 0x7f98ac004d40 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98b7fff640 1 -- 172.21.15.79:0/710718022 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac00bb50 con 0x7f98ac003f60 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98b7fff640 1 -- 172.21.15.79:0/710718022 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f98ac00bd50 con 0x7f98c015e520 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98c5f86640 1 --2- 172.21.15.79:0/710718022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98ac004d40 0x7f98ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98c4f84640 1 --2- 172.21.15.79:0/710718022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98ac003f60 0x7f98ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98c5785640 1 --2- 172.21.15.79:0/710718022 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98c015e520 0x7f98ac0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98c5f86640 1 -- 172.21.15.79:0/710718022 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98c015e520 msgr2=0x7f98ac0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98c5f86640 1 --2- 172.21.15.79:0/710718022 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98c015e520 0x7f98ac0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98c5f86640 1 -- 172.21.15.79:0/710718022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98ac003f60 msgr2=0x7f98ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98c5f86640 1 --2- 172.21.15.79:0/710718022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98ac003f60 0x7f98ac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.203+0000 7f98c5f86640 1 -- 172.21.15.79:0/710718022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ac003520 con 0x7f98ac004d40 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.204+0000 7f98c5f86640 1 --2- 172.21.15.79:0/710718022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98ac004d40 0x7f98ac0051c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c240 tx=0x7f98ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b205ce2c6e312229 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.204+0000 7f98b7fff640 1 -- 172.21.15.79:0/710718022 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b8007cf0 con 0x7f98ac004d40 2024-04-25T02:08:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.204+0000 7f98b7fff640 1 -- 172.21.15.79:0/710718022 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b80058d0 con 0x7f98ac004d40 2024-04-25T02:08:04.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.204+0000 7f98b7fff640 1 -- 172.21.15.79:0/710718022 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b8005ce0 con 0x7f98ac004d40 2024-04-25T02:08:04.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.204+0000 7f98c79e9640 1 -- 172.21.15.79:0/710718022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98ac004d40 msgr2=0x7f98ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.204+0000 7f98c79e9640 1 --2- 172.21.15.79:0/710718022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98ac004d40 0x7f98ac0051c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c240 tx=0x7f98ac005830 comp rx=0 tx=0).stop 2024-04-25T02:08:04.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.204+0000 7f98c5f86640 1 -- 172.21.15.79:0/710718022 reap_dead start 2024-04-25T02:08:04.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.204+0000 7f98c79e9640 1 -- 172.21.15.79:0/710718022 shutdown_connections 2024-04-25T02:08:04.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.204+0000 7f98c79e9640 1 -- 172.21.15.79:0/710718022 >> 172.21.15.79:0/710718022 conn(0x7f98c00ccee0 msgr2=0x7f98c00cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.205+0000 7f98c79e9640 1 -- 172.21.15.79:0/710718022 shutdown_connections 2024-04-25T02:08:04.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.205+0000 7f98c79e9640 1 -- 172.21.15.79:0/710718022 wait complete. 2024-04-25T02:08:04.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.206+0000 7f98c79e9640 1 Processor -- start 2024-04-25T02:08:04.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.206+0000 7f98c79e9640 1 -- start start 2024-04-25T02:08:04.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.206+0000 7f98c79e9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98ac004d40 0x7f98c01f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.206+0000 7f98c79e9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98c014fb30 0x7f98c01f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.206+0000 7f98c79e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98c01f7b50 0x7f98c0155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.206+0000 7f98c79e9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f98c00cf3a0 con 0x7f98c01f7b50 2024-04-25T02:08:04.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.206+0000 7f98c79e9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f98c00ca0d0 con 0x7f98ac004d40 2024-04-25T02:08:04.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.206+0000 7f98c79e9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f98c006b510 con 0x7f98c014fb30 2024-04-25T02:08:04.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.206+0000 7f98c5f86640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98c01f7b50 0x7f98c0155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98c5f86640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98c01f7b50 0x7f98c0155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34764/0 (socket says 172.21.15.79:34764) 2024-04-25T02:08:04.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98c5f86640 1 -- 172.21.15.79:0/1056381716 learned_addr learned my addr 172.21.15.79:0/1056381716 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98c5785640 1 --2- 172.21.15.79:0/1056381716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98ac004d40 0x7f98c01f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98c4f84640 1 --2- 172.21.15.79:0/1056381716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98c014fb30 0x7f98c01f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98c5f86640 1 -- 172.21.15.79:0/1056381716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98c014fb30 msgr2=0x7f98c01f7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98c5f86640 1 --2- 172.21.15.79:0/1056381716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98c014fb30 0x7f98c01f7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98c5f86640 1 -- 172.21.15.79:0/1056381716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98ac004d40 msgr2=0x7f98c01f81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98c5f86640 1 --2- 172.21.15.79:0/1056381716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98ac004d40 0x7f98c01f81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98c5f86640 1 -- 172.21.15.79:0/1056381716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c0151590 con 0x7f98c01f7b50 2024-04-25T02:08:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98c4f84640 1 --2- 172.21.15.79:0/1056381716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98c014fb30 0x7f98c01f7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98c5f86640 1 --2- 172.21.15.79:0/1056381716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98c01f7b50 0x7f98c0155800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f98b802adf0 tx=0x7f98c00cef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98b5ffb640 1 -- 172.21.15.79:0/1056381716 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b8001c30 con 0x7f98c01f7b50 2024-04-25T02:08:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98b5ffb640 1 -- 172.21.15.79:0/1056381716 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b8000e40 con 0x7f98c01f7b50 2024-04-25T02:08:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98c79e9640 1 -- 172.21.15.79:0/1056381716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98c0151870 con 0x7f98c01f7b50 2024-04-25T02:08:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98b5ffb640 1 -- 172.21.15.79:0/1056381716 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b80049f0 con 0x7f98c01f7b50 2024-04-25T02:08:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.207+0000 7f98c79e9640 1 -- 172.21.15.79:0/1056381716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98c0151e30 con 0x7f98c01f7b50 2024-04-25T02:08:04.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.208+0000 7f98c79e9640 1 -- 172.21.15.79:0/1056381716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98c00690a0 con 0x7f98c01f7b50 2024-04-25T02:08:04.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.209+0000 7f98b5ffb640 1 -- 172.21.15.79:0/1056381716 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98b803b070 con 0x7f98c01f7b50 2024-04-25T02:08:04.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.209+0000 7f98b5ffb640 1 --2- 172.21.15.79:0/1056381716 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98a406be30 0x7f98a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.209+0000 7f98c5785640 1 --2- 172.21.15.79:0/1056381716 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98a406be30 0x7f98a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.209+0000 7f98b5ffb640 1 -- 172.21.15.79:0/1056381716 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f98b80aa3e0 con 0x7f98c01f7b50 2024-04-25T02:08:04.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.210+0000 7f98c5785640 1 --2- 172.21.15.79:0/1056381716 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98a406be30 0x7f98a406e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f98bc003fb0 tx=0x7f98bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.213+0000 7f98b5ffb640 1 -- 172.21.15.79:0/1056381716 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f98b8044060 con 0x7f98c01f7b50 2024-04-25T02:08:04.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.386+0000 7f98c79e9640 1 -- 172.21.15.79:0/1056381716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98c006daa0 con 0x7f98c01f7b50 2024-04-25T02:08:04.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.387+0000 7f98b5ffb640 1 -- 172.21.15.79:0/1056381716 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f98b8047390 con 0x7f98c01f7b50 2024-04-25T02:08:04.394 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:04.395 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:04.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.389+0000 7f98c79e9640 1 -- 172.21.15.79:0/1056381716 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98a406be30 msgr2=0x7f98a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.389+0000 7f98c79e9640 1 --2- 172.21.15.79:0/1056381716 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98a406be30 0x7f98a406e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f98bc003fb0 tx=0x7f98bc009040 comp rx=0 tx=0).stop 2024-04-25T02:08:04.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.389+0000 7f98c79e9640 1 -- 172.21.15.79:0/1056381716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98c01f7b50 msgr2=0x7f98c0155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.389+0000 7f98c79e9640 1 --2- 172.21.15.79:0/1056381716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98c01f7b50 0x7f98c0155800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f98b802adf0 tx=0x7f98c00cef20 comp rx=0 tx=0).stop 2024-04-25T02:08:04.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.389+0000 7f98c79e9640 1 -- 172.21.15.79:0/1056381716 shutdown_connections 2024-04-25T02:08:04.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.389+0000 7f98c79e9640 1 --2- 172.21.15.79:0/1056381716 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98a406be30 0x7f98a406e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.389+0000 7f98c79e9640 1 --2- 172.21.15.79:0/1056381716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98c01f7b50 0x7f98c0155800 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.389+0000 7f98c79e9640 1 --2- 172.21.15.79:0/1056381716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98c014fb30 0x7f98c01f7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.389+0000 7f98c79e9640 1 --2- 172.21.15.79:0/1056381716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98ac004d40 0x7f98c01f81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.389+0000 7f98c79e9640 1 -- 172.21.15.79:0/1056381716 >> 172.21.15.79:0/1056381716 conn(0x7f98c00ccee0 msgr2=0x7f98c015e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.390+0000 7f98c79e9640 1 -- 172.21.15.79:0/1056381716 shutdown_connections 2024-04-25T02:08:04.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.390+0000 7f98c79e9640 1 -- 172.21.15.79:0/1056381716 wait complete. 2024-04-25T02:08:04.407 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T02:08:04.408 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T02:08:04.408 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T02:08:04.409 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T02:08:04.409 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T02:08:04.409 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T02:08:04.410 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T02:08:04.410 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T02:08:04.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.568+0000 7fed92c4d640 1 Processor -- start 2024-04-25T02:08:04.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.568+0000 7fed92c4d640 1 -- start start 2024-04-25T02:08:04.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.568+0000 7f96d54ba640 1 Processor -- start 2024-04-25T02:08:04.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.568+0000 7f96d54ba640 1 -- start start 2024-04-25T02:08:04.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.568+0000 7f2675cdf640 1 Processor -- start 2024-04-25T02:08:04.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.568+0000 7f2675cdf640 1 -- start start 2024-04-25T02:08:04.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.569+0000 7fa102868640 1 Processor -- start 2024-04-25T02:08:04.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.569+0000 7fa102868640 1 -- start start 2024-04-25T02:08:04.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.569+0000 7fed92c4d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fed840e6920 0x7fed84056370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.569+0000 7fed92c4d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fed840e6d00 0x7fed84054bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.569+0000 7fed92c4d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed84055570 con 0x7fed84055100 2024-04-25T02:08:04.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.569+0000 7fed92c4d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fed84008910 con 0x7fed840e6d00 2024-04-25T02:08:04.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.569+0000 7fee26154640 1 Processor -- start 2024-04-25T02:08:04.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.569+0000 7f2675cdf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f267015dbc0 0x7f2670140180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.569+0000 7f2675cdf640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f267006ec70 0x7f267013d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.569+0000 7f2675cdf640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f267015e050 con 0x7f26700cfe10 2024-04-25T02:08:04.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.569+0000 7f2675cdf640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f267013d460 con 0x7f267015dbc0 2024-04-25T02:08:04.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.569+0000 7f2675cdf640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f267015a5d0 con 0x7f267006ec70 2024-04-25T02:08:04.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7f76eb59e640 1 Processor -- start 2024-04-25T02:08:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.569+0000 7fed92c4d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fed84006b40 con 0x7fed840e6920 2024-04-25T02:08:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7f266ffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f26700cfe10 0x7f267015aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47708/0 (socket says 172.21.15.79:47708) 2024-04-25T02:08:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7f266ffff640 1 -- 172.21.15.79:0/4077054852 learned_addr learned my addr 172.21.15.79:0/4077054852 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7f266effd640 1 --2- 172.21.15.79:0/4077054852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f267006ec70 0x7f267013d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.569+0000 7fed911ea640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fed84055100 0x7fed840e7170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47696/0 (socket says 172.21.15.79:47696) 2024-04-25T02:08:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7f266f7fe640 1 --2- 172.21.15.79:0/4077054852 >> v2:172.21.15.79:3300/0 conn(0x7f267015dbc0 0x7f2670140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7f76eb59e640 1 -- start start 2024-04-25T02:08:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7fed911ea640 1 -- 172.21.15.79:0/1235918197 learned_addr learned my addr 172.21.15.79:0/1235918197 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7fed909e9640 1 --2- 172.21.15.79:0/1235918197 >> v2:172.21.15.189:3300/0 conn(0x7fed840e6920 0x7fed84056370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7fed909e9640 1 -- 172.21.15.79:0/1235918197 >> v2:172.21.15.79:3300/0 conn(0x7fed840e6d00 msgr2=0x7fed84054bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7fed909e9640 1 --2- 172.21.15.79:0/1235918197 >> v2:172.21.15.79:3300/0 conn(0x7fed840e6d00 0x7fed84054bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7fed909e9640 1 -- 172.21.15.79:0/1235918197 >> v1:172.21.15.79:6789/0 conn(0x7fed84055100 legacy=0x7fed840e7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7f96d54ba640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015b220 0x7f96d00d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7fed909e9640 1 -- 172.21.15.79:0/1235918197 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed84006e20 con 0x7fed840e6920 2024-04-25T02:08:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7fa102868640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0fc0b5450 0x7fa0fc0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7fa102868640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa0fc0cf4b0 0x7fa0fc0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7fa102868640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa0fc0d0dc0 0x7fa0fc0d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7f2f09f29640 1 Processor -- start 2024-04-25T02:08:04.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7f2f09f29640 1 -- start start 2024-04-25T02:08:04.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7f96d54ba640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f96d009aa70 0x7f96d009af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7f96d54ba640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96d006b150 con 0x7f96d009b840 2024-04-25T02:08:04.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7fa102868640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa0fc0b7180 con 0x7fa0fc0b5450 2024-04-25T02:08:04.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7fa102868640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fa0fc0d1210 con 0x7fa0fc0cf4b0 2024-04-25T02:08:04.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7fa102868640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa0fc0cffe0 con 0x7fa0fc0d0dc0 2024-04-25T02:08:04.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7f96d54ba640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f96d009b440 con 0x7f96d009aa70 2024-04-25T02:08:04.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7f96ce7fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f96d009b840 0x7f96d006bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47716/0 (socket says 172.21.15.79:47716) 2024-04-25T02:08:04.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7f96ce7fc640 1 -- 172.21.15.79:0/922405154 learned_addr learned my addr 172.21.15.79:0/922405154 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:04.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7f96d54ba640 1 -- 172.21.15.79:0/922405154 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f96d006b430 con 0x7f96d015b220 2024-04-25T02:08:04.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7f96cffff640 1 --2- 172.21.15.79:0/922405154 >> v2:172.21.15.189:3300/0 conn(0x7f96d009aa70 0x7f96d009af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7fa101866640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0fc0b5450 0x7fa0fc0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fa101866640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0fc0b5450 0x7fa0fc0c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34796/0 (socket says 172.21.15.79:34796) 2024-04-25T02:08:04.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fa101866640 1 -- 172.21.15.79:0/2781093127 learned_addr learned my addr 172.21.15.79:0/2781093127 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.570+0000 7fee26154640 1 -- start start 2024-04-25T02:08:04.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fa101065640 1 --2- 172.21.15.79:0/2781093127 >> v2:172.21.15.189:3300/0 conn(0x7fa0fc0cf4b0 0x7fa0fc0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7f266effd640 1 -- 172.21.15.79:0/4077054852 >> v2:172.21.15.79:3300/0 conn(0x7f267015dbc0 msgr2=0x7f2670140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7f266effd640 1 --2- 172.21.15.79:0/4077054852 >> v2:172.21.15.79:3300/0 conn(0x7f267015dbc0 0x7f2670140180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7f266effd640 1 -- 172.21.15.79:0/4077054852 >> v1:172.21.15.79:6789/0 conn(0x7f26700cfe10 legacy=0x7f267015aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7f266effd640 1 -- 172.21.15.79:0/4077054852 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267015e330 con 0x7f267006ec70 2024-04-25T02:08:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7f96ceffd640 1 --2- 172.21.15.79:0/922405154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015b220 0x7f96d00d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7f76eb59e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f76ec1446c0 0x7f76ec071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7f76eb59e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76ec0b4870 con 0x7f76ec072230 2024-04-25T02:08:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fee26154640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee18005e90 0x7fee180062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fee26154640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fee18006810 0x7fee18006ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fee26154640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee18053720 con 0x7fee180ead00 2024-04-25T02:08:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fee26154640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fee18054330 con 0x7fee18006810 2024-04-25T02:08:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fee26154640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fee18053a00 con 0x7fee18005e90 2024-04-25T02:08:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7f76eb59e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76ec144aa0 con 0x7f76ec0b4460 2024-04-25T02:08:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7f76eb59e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f76ec06e5b0 con 0x7f76ec1446c0 2024-04-25T02:08:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fee25152640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fee180ead00 0x7fee1804fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47726/0 (socket says 172.21.15.79:47726) 2024-04-25T02:08:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fee25152640 1 -- 172.21.15.79:0/1655319236 learned_addr learned my addr 172.21.15.79:0/1655319236 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7f76ea59c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f76ec1446c0 0x7f76ec071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7f76ead9d640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f76ec0b4460 0x7f76ec06ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:34848/0 (socket says 172.21.15.79:34848) 2024-04-25T02:08:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7f76ead9d640 1 -- 172.21.15.79:0/1834841291 learned_addr learned my addr 172.21.15.79:0/1834841291 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:04.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7f76ea59c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f76ec1446c0 0x7f76ec071cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:36128/0 (socket says 172.21.15.79:36128) 2024-04-25T02:08:04.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 -- 172.21.15.79:0/1655319236 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1478709890 0 0) 0x7fee18053720 con 0x7fee180ead00 2024-04-25T02:08:04.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fef6dd16640 1 Processor -- start 2024-04-25T02:08:04.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7f2f09f29640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2efc0e7850 0x7f2efc0382b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7f2f09f29640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2efc0e7c30 con 0x7f2efc0061d0 2024-04-25T02:08:04.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7f2f09f29640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2efc057f50 con 0x7f2efc0eb330 2024-04-25T02:08:04.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7f2f09f29640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2efc058230 con 0x7f2efc0e7850 2024-04-25T02:08:04.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7f96cffff640 1 -- 172.21.15.79:0/922405154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015b220 msgr2=0x7f96d00d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7f96cffff640 1 --2- 172.21.15.79:0/922405154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015b220 0x7f96d00d1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7f96cffff640 1 -- 172.21.15.79:0/922405154 >> v1:172.21.15.79:6789/0 conn(0x7f96d009b840 legacy=0x7f96d006bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7f96cffff640 1 -- 172.21.15.79:0/922405154 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d006b710 con 0x7f96d009aa70 2024-04-25T02:08:04.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 -- 172.21.15.79:0/1655319236 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee0c003520 con 0x7fee180ead00 2024-04-25T02:08:04.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 -- 172.21.15.79:0/1655319236 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2033336190 0 0) 0x7fee0c003520 con 0x7fee180ead00 2024-04-25T02:08:04.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 -- 172.21.15.79:0/1655319236 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee18005e90 msgr2=0x7fee180062d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:08:04.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fa101866640 1 -- 172.21.15.79:0/2781093127 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa0fc0d0dc0 msgr2=0x7fa0fc0d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fa101866640 1 --2- 172.21.15.79:0/2781093127 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa0fc0d0dc0 0x7fa0fc0d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fa101866640 1 -- 172.21.15.79:0/2781093127 >> v2:172.21.15.189:3300/0 conn(0x7fa0fc0cf4b0 msgr2=0x7fa0fc0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fa101866640 1 --2- 172.21.15.79:0/2781093127 >> v2:172.21.15.189:3300/0 conn(0x7fa0fc0cf4b0 0x7fa0fc0d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fa101866640 1 -- 172.21.15.79:0/2781093127 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0fc0cfa20 con 0x7fa0fc0b5450 2024-04-25T02:08:04.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fed909e9640 1 --2- 172.21.15.79:0/1235918197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed840e6920 0x7fed84056370 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed8400ed20 tx=0x7fed7802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f4cb3d0ec31a7d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.571+0000 7fed8b7fe640 1 -- 172.21.15.79:0/1235918197 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78037070 con 0x7fed840e6920 2024-04-25T02:08:04.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fed8b7fe640 1 -- 172.21.15.79:0/1235918197 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed78032440 con 0x7fed840e6920 2024-04-25T02:08:04.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fed8b7fe640 1 -- 172.21.15.79:0/1235918197 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78037070 con 0x7fed840e6920 2024-04-25T02:08:04.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7f76e959a640 1 -- 172.21.15.79:0/1834841291 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3779457962 0 0) 0x7f76ec144aa0 con 0x7f76ec0b4460 2024-04-25T02:08:04.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7f76e959a640 1 -- 172.21.15.79:0/1834841291 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76d4003520 con 0x7f76ec0b4460 2024-04-25T02:08:04.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7f2f037fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2efc0e7850 0x7f2efc0382b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7f2f037fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2efc0e7850 0x7f2efc0382b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49276/0 (socket says 172.21.15.79:49276) 2024-04-25T02:08:04.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7f2f037fe640 1 -- 172.21.15.79:0/2924248304 learned_addr learned my addr 172.21.15.79:0/2924248304 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 --2- 172.21.15.79:0/1655319236 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee18005e90 0x7fee180062d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7f76ea59c640 1 -- 172.21.15.79:0/1834841291 >> v1:172.21.15.189:6789/0 conn(0x7f76ec0b4460 legacy=0x7f76ec06ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7f76ea59c640 1 -- 172.21.15.79:0/1834841291 >> v1:172.21.15.79:6789/0 conn(0x7f76ec072230 legacy=0x7f76ec0b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fef6dd16640 1 -- start start 2024-04-25T02:08:04.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fef6dd16640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fef68072b00 0x7fef680b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fef6dd16640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef680719b0 0x7fef680b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fef6dd16640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef68073050 con 0x7fef6815a270 2024-04-25T02:08:04.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fef6dd16640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fef6806cf40 con 0x7fef68072b00 2024-04-25T02:08:04.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fef6dd16640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fef6806d7e0 con 0x7fef680719b0 2024-04-25T02:08:04.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7f266effd640 1 --2- 172.21.15.79:0/4077054852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f267006ec70 0x7f267013d6e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f266800be90 tx=0x7f266802c660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34728dd4c7b1b7ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7f266e7fc640 1 -- 172.21.15.79:0/4077054852 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266803a070 con 0x7f267006ec70 2024-04-25T02:08:04.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7f266e7fc640 1 -- 172.21.15.79:0/4077054852 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2668032480 con 0x7f267006ec70 2024-04-25T02:08:04.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7f266e7fc640 1 -- 172.21.15.79:0/4077054852 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668032850 con 0x7f267006ec70 2024-04-25T02:08:04.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7f96cffff640 1 --2- 172.21.15.79:0/922405154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d009aa70 0x7f96d009af00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009d90 tx=0x7f96c802c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee5a29d3897b1843 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7f96cdffb640 1 -- 172.21.15.79:0/922405154 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8032770 con 0x7f96d009aa70 2024-04-25T02:08:04.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7f96cdffb640 1 -- 172.21.15.79:0/922405154 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c8038070 con 0x7f96d009aa70 2024-04-25T02:08:04.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7f96cdffb640 1 -- 172.21.15.79:0/922405154 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8032b30 con 0x7f96d009aa70 2024-04-25T02:08:04.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fed92c4d640 1 -- 172.21.15.79:0/1235918197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed840e6920 msgr2=0x7fed84056370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fed92c4d640 1 --2- 172.21.15.79:0/1235918197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed840e6920 0x7fed84056370 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed8400ed20 tx=0x7fed7802a1c0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fed92c4d640 1 -- 172.21.15.79:0/1235918197 shutdown_connections 2024-04-25T02:08:04.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fed92c4d640 1 --2- 172.21.15.79:0/1235918197 >> v2:172.21.15.79:3300/0 conn(0x7fed840e6d00 0x7fed84054bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fed92c4d640 1 --2- 172.21.15.79:0/1235918197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed840e6920 0x7fed84056370 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fed92c4d640 1 -- 172.21.15.79:0/1235918197 >> 172.21.15.79:0/1235918197 conn(0x7fed8401ef30 msgr2=0x7fed84055c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fa101866640 1 --2- 172.21.15.79:0/2781093127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0fc0b5450 0x7fa0fc0c72e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc072730 tx=0x7fa0f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae5d61d2302c356 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fa100864640 1 -- 172.21.15.79:0/2781093127 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8037070 con 0x7fa0fc0b5450 2024-04-25T02:08:04.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fa100864640 1 -- 172.21.15.79:0/2781093127 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f8032440 con 0x7fa0fc0b5450 2024-04-25T02:08:04.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fa100864640 1 -- 172.21.15.79:0/2781093127 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8032850 con 0x7fa0fc0b5450 2024-04-25T02:08:04.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7f76ea59c640 1 -- 172.21.15.79:0/1834841291 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec0b4af0 con 0x7f76ec1446c0 2024-04-25T02:08:04.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7f2f037fe640 1 -- 172.21.15.79:0/2924248304 >> v1:172.21.15.189:6789/0 conn(0x7f2efc0eb330 legacy=0x7f2efc0eb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7f2f037fe640 1 -- 172.21.15.79:0/2924248304 >> v1:172.21.15.79:6789/0 conn(0x7f2efc0061d0 legacy=0x7f2efc006660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7f2f037fe640 1 -- 172.21.15.79:0/2924248304 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc058510 con 0x7f2efc0e7850 2024-04-25T02:08:04.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7f76ea59c640 1 --2- 172.21.15.79:0/1834841291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76ec1446c0 0x7f76ec071cf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009d90 tx=0x7f76e402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a35ff1a452657a2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 -- 172.21.15.79:0/1655319236 >> v2:172.21.15.79:3300/0 conn(0x7fee18006810 msgr2=0x7fee18006ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 --2- 172.21.15.79:0/1655319236 >> v2:172.21.15.79:3300/0 conn(0x7fee18006810 0x7fee18006ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7f76e959a640 1 -- 172.21.15.79:0/1834841291 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e4007740 con 0x7f76ec1446c0 2024-04-25T02:08:04.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7f76e959a640 1 -- 172.21.15.79:0/1834841291 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e40078e0 con 0x7f76ec1446c0 2024-04-25T02:08:04.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7f76e959a640 1 -- 172.21.15.79:0/1834841291 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e4007cb0 con 0x7f76ec1446c0 2024-04-25T02:08:04.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fa102868640 1 -- 172.21.15.79:0/2781093127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0fc0b5450 msgr2=0x7fa0fc0c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fa102868640 1 --2- 172.21.15.79:0/2781093127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0fc0b5450 0x7fa0fc0c72e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc072730 tx=0x7fa0f802a1a0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7f2f037fe640 1 --2- 172.21.15.79:0/2924248304 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2efc0e7850 0x7f2efc0382b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009820 tx=0x7f2ef802a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0eb3a3bc2cef022 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 -- 172.21.15.79:0/1655319236 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee18053ce0 con 0x7fee180ead00 2024-04-25T02:08:04.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 -- 172.21.15.79:0/1655319236 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fee1c001650 con 0x7fee180ead00 2024-04-25T02:08:04.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 -- 172.21.15.79:0/1655319236 >> v1:172.21.15.79:6789/0 conn(0x7fee180ead00 legacy=0x7fee1804fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 --2- 172.21.15.79:0/1655319236 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee0c0039d0 0x7fee0c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 --2- 172.21.15.79:0/1655319236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee0c004800 0x7fee0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 --2- 172.21.15.79:0/1655319236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee0c005210 0x7fee0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 -- 172.21.15.79:0/1655319236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fee18054330 con 0x7fee0c005210 2024-04-25T02:08:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 -- 172.21.15.79:0/1655319236 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fee18053a00 con 0x7fee0c004800 2024-04-25T02:08:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fa102868640 1 -- 172.21.15.79:0/2781093127 shutdown_connections 2024-04-25T02:08:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fa102868640 1 --2- 172.21.15.79:0/2781093127 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa0fc0d0dc0 0x7fa0fc0d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fa102868640 1 --2- 172.21.15.79:0/2781093127 >> v2:172.21.15.189:3300/0 conn(0x7fa0fc0cf4b0 0x7fa0fc0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fa102868640 1 --2- 172.21.15.79:0/2781093127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0fc0b5450 0x7fa0fc0c72e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fa102868640 1 -- 172.21.15.79:0/2781093127 >> 172.21.15.79:0/2781093127 conn(0x7fa0fc0d3e90 msgr2=0x7fa0fc0d42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.572+0000 7fee17fff640 1 -- 172.21.15.79:0/1655319236 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fee0c00c220 con 0x7fee0c0039d0 2024-04-25T02:08:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fee25152640 1 --2- 172.21.15.79:0/1655319236 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee0c0039d0 0x7fee0c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fee25953640 1 --2- 172.21.15.79:0/1655319236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee0c005210 0x7fee0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fee24951640 1 --2- 172.21.15.79:0/1655319236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee0c004800 0x7fee0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fee25953640 1 -- 172.21.15.79:0/1655319236 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee0c0039d0 msgr2=0x7fee0c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fee25953640 1 --2- 172.21.15.79:0/1655319236 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee0c0039d0 0x7fee0c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fee25953640 1 -- 172.21.15.79:0/1655319236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee0c004800 msgr2=0x7fee0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fee25953640 1 --2- 172.21.15.79:0/1655319236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee0c004800 0x7fee0c004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.573+0000 7fee25953640 1 -- 172.21.15.79:0/1655319236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee18053ce0 con 0x7fee0c005210 2024-04-25T02:08:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fee25953640 1 --2- 172.21.15.79:0/1655319236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee0c005210 0x7fee0c00b9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee10009880 tx=0x7fee0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7178f0e6303d111f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fee17fff640 1 -- 172.21.15.79:0/1655319236 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10037070 con 0x7fee0c005210 2024-04-25T02:08:04.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7f2675cdf640 1 -- 172.21.15.79:0/4077054852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f267006ec70 msgr2=0x7f267013d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7f2675cdf640 1 --2- 172.21.15.79:0/4077054852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f267006ec70 0x7f267013d6e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f266800be90 tx=0x7f266802c660 comp rx=0 tx=0).stop 2024-04-25T02:08:04.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7f2f027fc640 1 -- 172.21.15.79:0/2924248304 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8037070 con 0x7f2efc0e7850 2024-04-25T02:08:04.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7f2f027fc640 1 -- 172.21.15.79:0/2924248304 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef802ade0 con 0x7f2efc0e7850 2024-04-25T02:08:04.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7f2675cdf640 1 -- 172.21.15.79:0/4077054852 shutdown_connections 2024-04-25T02:08:04.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7f2675cdf640 1 --2- 172.21.15.79:0/4077054852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f267006ec70 0x7f267013d6e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7f2675cdf640 1 --2- 172.21.15.79:0/4077054852 >> v2:172.21.15.79:3300/0 conn(0x7f267015dbc0 0x7f2670140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7f2675cdf640 1 -- 172.21.15.79:0/4077054852 >> 172.21.15.79:0/4077054852 conn(0x7f267006b290 msgr2=0x7f267006b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f96d54ba640 1 -- 172.21.15.79:0/922405154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d009aa70 msgr2=0x7f96d009af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f96d54ba640 1 --2- 172.21.15.79:0/922405154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d009aa70 0x7f96d009af00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009d90 tx=0x7f96c802c870 comp rx=0 tx=0).stop 2024-04-25T02:08:04.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7fa102868640 1 -- 172.21.15.79:0/2781093127 shutdown_connections 2024-04-25T02:08:04.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7fa102868640 1 -- 172.21.15.79:0/2781093127 wait complete. 2024-04-25T02:08:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f96d54ba640 1 -- 172.21.15.79:0/922405154 shutdown_connections 2024-04-25T02:08:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f96d54ba640 1 --2- 172.21.15.79:0/922405154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d009aa70 0x7f96d009af00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f96d54ba640 1 --2- 172.21.15.79:0/922405154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015b220 0x7f96d00d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f96d54ba640 1 -- 172.21.15.79:0/922405154 >> 172.21.15.79:0/922405154 conn(0x7f96d00b3f80 msgr2=0x7f96d00b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fef67fff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef680719b0 0x7fef680b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fef67fff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef680719b0 0x7fef680b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49294/0 (socket says 172.21.15.79:49294) 2024-04-25T02:08:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fef67fff640 1 -- 172.21.15.79:0/3490396182 learned_addr learned my addr 172.21.15.79:0/3490396182 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fef66ffd640 1 --2- 172.21.15.79:0/3490396182 >> v2:172.21.15.189:3300/0 conn(0x7fef68072b00 0x7fef680b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7fef66ffd640 1 -- 172.21.15.79:0/3490396182 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef680719b0 msgr2=0x7fef680b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7fef66ffd640 1 --2- 172.21.15.79:0/3490396182 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef680719b0 0x7fef680b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7fef66ffd640 1 -- 172.21.15.79:0/3490396182 >> v1:172.21.15.189:6789/0 conn(0x7fef6815a270 legacy=0x7fef6815a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7fef66ffd640 1 -- 172.21.15.79:0/3490396182 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6806d190 con 0x7fef68072b00 2024-04-25T02:08:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f96d54ba640 1 -- 172.21.15.79:0/922405154 shutdown_connections 2024-04-25T02:08:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fee17fff640 1 -- 172.21.15.79:0/1655319236 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1002aaa0 con 0x7fee0c005210 2024-04-25T02:08:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.574+0000 7fee17fff640 1 -- 172.21.15.79:0/1655319236 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10037070 con 0x7fee0c005210 2024-04-25T02:08:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f96d54ba640 1 -- 172.21.15.79:0/922405154 wait complete. 2024-04-25T02:08:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f2f027fc640 1 -- 172.21.15.79:0/2924248304 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8037070 con 0x7f2efc0e7850 2024-04-25T02:08:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f2675cdf640 1 -- 172.21.15.79:0/4077054852 shutdown_connections 2024-04-25T02:08:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f76eb59e640 1 -- 172.21.15.79:0/1834841291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76ec1446c0 msgr2=0x7f76ec071cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f76eb59e640 1 --2- 172.21.15.79:0/1834841291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76ec1446c0 0x7f76ec071cf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009d90 tx=0x7f76e402a6f0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7fee26154640 1 -- 172.21.15.79:0/1655319236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee0c005210 msgr2=0x7fee0c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7fee26154640 1 --2- 172.21.15.79:0/1655319236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee0c005210 0x7fee0c00b9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee10009880 tx=0x7fee0c005830 comp rx=0 tx=0).stop 2024-04-25T02:08:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7fee25953640 1 -- 172.21.15.79:0/1655319236 reap_dead start 2024-04-25T02:08:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7fee26154640 1 -- 172.21.15.79:0/1655319236 shutdown_connections 2024-04-25T02:08:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7fee26154640 1 -- 172.21.15.79:0/1655319236 >> 172.21.15.79:0/1655319236 conn(0x7fee18009fb0 msgr2=0x7fee1800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f2f09f29640 1 -- 172.21.15.79:0/2924248304 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2efc0e7850 msgr2=0x7f2efc0382b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f2f09f29640 1 --2- 172.21.15.79:0/2924248304 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2efc0e7850 0x7f2efc0382b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009820 tx=0x7f2ef802a0d0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7fee26154640 1 -- 172.21.15.79:0/1655319236 shutdown_connections 2024-04-25T02:08:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f2f09f29640 1 -- 172.21.15.79:0/2924248304 shutdown_connections 2024-04-25T02:08:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f2f09f29640 1 --2- 172.21.15.79:0/2924248304 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2efc0e7850 0x7f2efc0382b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f2f09f29640 1 -- 172.21.15.79:0/2924248304 >> 172.21.15.79:0/2924248304 conn(0x7f2efc055a10 msgr2=0x7f2efc055e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7f2675cdf640 1 -- 172.21.15.79:0/4077054852 wait complete. 2024-04-25T02:08:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.576+0000 7fee26154640 1 -- 172.21.15.79:0/1655319236 wait complete. 2024-04-25T02:08:04.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.576+0000 7f2f09f29640 1 -- 172.21.15.79:0/2924248304 shutdown_connections 2024-04-25T02:08:04.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.576+0000 7f2f09f29640 1 -- 172.21.15.79:0/2924248304 wait complete. 2024-04-25T02:08:04.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.575+0000 7fed92c4d640 1 -- 172.21.15.79:0/1235918197 shutdown_connections 2024-04-25T02:08:04.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.576+0000 7f76eb59e640 1 -- 172.21.15.79:0/1834841291 shutdown_connections 2024-04-25T02:08:04.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.576+0000 7f76eb59e640 1 --2- 172.21.15.79:0/1834841291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76ec1446c0 0x7f76ec071cf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.576+0000 7f76eb59e640 1 -- 172.21.15.79:0/1834841291 >> 172.21.15.79:0/1834841291 conn(0x7f76ec0b2850 msgr2=0x7f76ec0b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.576+0000 7fef66ffd640 1 --2- 172.21.15.79:0/3490396182 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef68072b00 0x7fef680b3df0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fef5000dbc0 tx=0x7fef50032850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d7c7fdb1b6c62fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.576+0000 7f76eb59e640 1 -- 172.21.15.79:0/1834841291 shutdown_connections 2024-04-25T02:08:04.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.576+0000 7f76eb59e640 1 -- 172.21.15.79:0/1834841291 wait complete. 2024-04-25T02:08:04.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.576+0000 7fef667fc640 1 -- 172.21.15.79:0/3490396182 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5003f070 con 0x7fef68072b00 2024-04-25T02:08:04.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.576+0000 7fef667fc640 1 -- 172.21.15.79:0/3490396182 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef5000b650 con 0x7fef68072b00 2024-04-25T02:08:04.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.577+0000 7fef6dd16640 1 -- 172.21.15.79:0/3490396182 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef68072b00 msgr2=0x7fef680b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.577+0000 7fef6dd16640 1 --2- 172.21.15.79:0/3490396182 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef68072b00 0x7fef680b3df0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fef5000dbc0 tx=0x7fef50032850 comp rx=0 tx=0).stop 2024-04-25T02:08:04.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.577+0000 7fee26154640 1 Processor -- start 2024-04-25T02:08:04.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.577+0000 7f96d54ba640 1 Processor -- start 2024-04-25T02:08:04.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.577+0000 7f96d54ba640 1 -- start start 2024-04-25T02:08:04.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.576+0000 7fed92c4d640 1 -- 172.21.15.79:0/1235918197 wait complete. 2024-04-25T02:08:04.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.577+0000 7fed92c4d640 1 Processor -- start 2024-04-25T02:08:04.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.577+0000 7fa102868640 1 Processor -- start 2024-04-25T02:08:04.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.577+0000 7f2f09f29640 1 Processor -- start 2024-04-25T02:08:04.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7f2f09f29640 1 -- start start 2024-04-25T02:08:04.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.577+0000 7fee26154640 1 -- start start 2024-04-25T02:08:04.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.577+0000 7fa102868640 1 -- start start 2024-04-25T02:08:04.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7fa102868640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0fc0b5450 0x7fa0fc15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7fa102868640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa0fc0cf4b0 0x7fa0fc0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7fa102868640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0fc0d0dc0 0x7fa0fc163ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7fed92c4d640 1 -- start start 2024-04-25T02:08:04.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7fa101065640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa0fc0cf4b0 0x7fa0fc0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.577+0000 7f2675cdf640 1 Processor -- start 2024-04-25T02:08:04.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.577+0000 7f2675cdf640 1 -- start start 2024-04-25T02:08:04.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7f2675cdf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f267006ec70 0x7f26701f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7f2675cdf640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26700cfe10 0x7f267013adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7f2675cdf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26701540c0 0x7f2670154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7f2675cdf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f267015e8f0 con 0x7f267006ec70 2024-04-25T02:08:04.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7f2675cdf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f26701406c0 con 0x7f26701540c0 2024-04-25T02:08:04.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7f2675cdf640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f267013dc20 con 0x7f26700cfe10 2024-04-25T02:08:04.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7fa101866640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0fc0b5450 0x7fa0fc15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7fa101065640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa0fc0cf4b0 0x7fa0fc0cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49306/0 (socket says 172.21.15.79:49306) 2024-04-25T02:08:04.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7fa101866640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0fc0b5450 0x7fa0fc15bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:36160/0 (socket says 172.21.15.79:36160) 2024-04-25T02:08:04.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7f266ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26701540c0 0x7f2670154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7f266ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26701540c0 0x7f2670154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:36172/0 (socket says 172.21.15.79:36172) 2024-04-25T02:08:04.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7f266ffff640 1 -- 172.21.15.79:0/1638629359 learned_addr learned my addr 172.21.15.79:0/1638629359 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7f76eb59e640 1 Processor -- start 2024-04-25T02:08:04.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7fa102067640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0fc0d0dc0 0x7fa0fc163ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96d54ba640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d009aa70 0x7f96d00c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7f266effd640 1 --2- 172.21.15.79:0/1638629359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26700cfe10 0x7f267013adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f76eb59e640 1 -- start start 2024-04-25T02:08:04.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96d54ba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d009b840 0x7f96d00ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fee26154640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee180df100 0x7fee1817d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f2f09f29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2efc0061d0 0x7f2efc17e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96d54ba640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015b220 0x7f96d00cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96d54ba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f96d00d21c0 con 0x7f96d009b840 2024-04-25T02:08:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96d54ba640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96d009bca0 con 0x7f96d009aa70 2024-04-25T02:08:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96d54ba640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f96d00ccae0 con 0x7f96d015b220 2024-04-25T02:08:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96ceffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d009aa70 0x7f96d00c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f2f09f29640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2efc0e7850 0x7f2efc039a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f2f09f29640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2efc0eb330 0x7f2efc04ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f266ffff640 1 -- 172.21.15.79:0/1638629359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26700cfe10 msgr2=0x7f267013adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f266ffff640 1 --2- 172.21.15.79:0/1638629359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26700cfe10 0x7f267013adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f266ffff640 1 -- 172.21.15.79:0/1638629359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f267006ec70 msgr2=0x7f26701f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96cffff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015b220 0x7f96d00cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96cffff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015b220 0x7f96d00cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49330/0 (socket says 172.21.15.79:49330) 2024-04-25T02:08:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96cffff640 1 -- 172.21.15.79:0/1775805606 learned_addr learned my addr 172.21.15.79:0/1775805606 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fee26154640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee180df4e0 0x7fee1804e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f266ffff640 1 --2- 172.21.15.79:0/1638629359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f267006ec70 0x7f26701f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f266ffff640 1 -- 172.21.15.79:0/1638629359 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26701f8410 con 0x7f26701540c0 2024-04-25T02:08:04.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96ce7fc640 1 --2- 172.21.15.79:0/1775805606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d009b840 0x7f96d00ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fee26154640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee1803a220 0x7fee1803a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f2f02ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2efc0e7850 0x7f2efc039a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fee25152640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee180df100 0x7fee1817d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fee25152640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee180df100 0x7fee1817d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:36188/0 (socket says 172.21.15.79:36188) 2024-04-25T02:08:04.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f266ffff640 1 --2- 172.21.15.79:0/1638629359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26701540c0 0x7f2670154540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f266000c750 tx=0x7f266000cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.578+0000 7fa102067640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0fc0d0dc0 0x7fa0fc163ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34832/0 (socket says 172.21.15.79:34832) 2024-04-25T02:08:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fa101065640 1 -- 172.21.15.79:0/2130282749 learned_addr learned my addr 172.21.15.79:0/2130282749 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fa102868640 1 -- 172.21.15.79:0/2130282749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc0d1570 con 0x7fa0fc0d0dc0 2024-04-25T02:08:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fa102868640 1 -- 172.21.15.79:0/2130282749 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc0b6e10 con 0x7fa0fc0b5450 2024-04-25T02:08:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fa102868640 1 -- 172.21.15.79:0/2130282749 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa0fc0d16f0 con 0x7fa0fc0cf4b0 2024-04-25T02:08:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fee24951640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee180df4e0 0x7fee1804e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f2f09f29640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc0ebec0 con 0x7f2efc0061d0 2024-04-25T02:08:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f2f02ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2efc0e7850 0x7f2efc039a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:36184/0 (socket says 172.21.15.79:36184) 2024-04-25T02:08:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fee24951640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee180df4e0 0x7fee1804e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34858/0 (socket says 172.21.15.79:34858) 2024-04-25T02:08:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fed92c4d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed84055100 0x7fed840d3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fed92c4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed840e6920 0x7fed840d7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fed92c4d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed840e6d00 0x7fed840d84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f2f02ffd640 1 -- 172.21.15.79:0/3087636179 learned_addr learned my addr 172.21.15.79:0/3087636179 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fee26154640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fee180547c0 con 0x7fee180df4e0 2024-04-25T02:08:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fee26154640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fee180501a0 con 0x7fee180df100 2024-04-25T02:08:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96cffff640 1 -- 172.21.15.79:0/1775805606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d009aa70 msgr2=0x7f96d00c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96cffff640 1 --2- 172.21.15.79:0/1775805606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d009aa70 0x7f96d00c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96cffff640 1 -- 172.21.15.79:0/1775805606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d009b840 msgr2=0x7f96d00ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96cffff640 1 --2- 172.21.15.79:0/1775805606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d009b840 0x7f96d00ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fed92c4d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fed840502b0 con 0x7fed840e6920 2024-04-25T02:08:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fed92c4d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fed840073e0 con 0x7fed84055100 2024-04-25T02:08:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fed92c4d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fed8403b790 con 0x7fed840e6d00 2024-04-25T02:08:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fee25152640 1 -- 172.21.15.79:0/733919088 learned_addr learned my addr 172.21.15.79:0/733919088 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fee26154640 1 -- 172.21.15.79:0/733919088 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fee18054940 con 0x7fee1803a220 2024-04-25T02:08:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96cffff640 1 -- 172.21.15.79:0/1775805606 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d00c60f0 con 0x7f96d015b220 2024-04-25T02:08:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7f96ceffd640 1 --2- 172.21.15.79:0/1775805606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d009aa70 0x7f96d00c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fee25953640 1 --2- 172.21.15.79:0/733919088 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee1803a220 0x7fee1803a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fa101866640 1 -- 172.21.15.79:0/2130282749 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa0fc0cf4b0 msgr2=0x7fa0fc0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fa101866640 1 --2- 172.21.15.79:0/2130282749 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa0fc0cf4b0 0x7fa0fc0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f2f09f29640 1 -- 172.21.15.79:0/3087636179 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc0ec1d0 con 0x7f2efc0e7850 2024-04-25T02:08:04.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fa101866640 1 -- 172.21.15.79:0/2130282749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0fc0d0dc0 msgr2=0x7fa0fc163ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fa101866640 1 --2- 172.21.15.79:0/2130282749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0fc0d0dc0 0x7fa0fc163ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fa101866640 1 -- 172.21.15.79:0/2130282749 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0fc0cbfa0 con 0x7fa0fc0b5450 2024-04-25T02:08:04.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fef6dd16640 1 -- 172.21.15.79:0/3490396182 shutdown_connections 2024-04-25T02:08:04.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fef6dd16640 1 --2- 172.21.15.79:0/3490396182 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef680719b0 0x7fef680b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fef6dd16640 1 --2- 172.21.15.79:0/3490396182 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef68072b00 0x7fef680b3df0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.579+0000 7fef6dd16640 1 -- 172.21.15.79:0/3490396182 >> 172.21.15.79:0/3490396182 conn(0x7fef680b1a30 msgr2=0x7fef680b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f96cffff640 1 --2- 172.21.15.79:0/1775805606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015b220 0x7f96d00cc1e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009d90 tx=0x7f96c8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f2f09f29640 1 -- 172.21.15.79:0/3087636179 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2efc058d10 con 0x7f2efc0eb330 2024-04-25T02:08:04.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fed909e9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed84055100 0x7fed840d3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fed909e9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed84055100 0x7fed840d3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:36200/0 (socket says 172.21.15.79:36200) 2024-04-25T02:08:04.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fed909e9640 1 -- 172.21.15.79:0/4117279388 learned_addr learned my addr 172.21.15.79:0/4117279388 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fed8bfff640 1 --2- 172.21.15.79:0/4117279388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed840e6920 0x7fed840d7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fed911ea640 1 --2- 172.21.15.79:0/4117279388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed840e6d00 0x7fed840d84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f2657fff640 1 -- 172.21.15.79:0/1638629359 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660018070 con 0x7f26701540c0 2024-04-25T02:08:04.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fee25152640 1 -- 172.21.15.79:0/733919088 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee1803a220 msgr2=0x7fee1803a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fee25152640 1 --2- 172.21.15.79:0/733919088 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee1803a220 0x7fee1803a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fef6dd16640 1 -- 172.21.15.79:0/3490396182 shutdown_connections 2024-04-25T02:08:04.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f76eb59e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f76ec072230 0x7f76ec1efc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f76eb59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76ec0b4460 0x7f76ec15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f76eb59e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76ec1446c0 0x7f76ec138c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f2f037fe640 1 --2- 172.21.15.79:0/3087636179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2efc0061d0 0x7f2efc17e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f76eb59e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec06f150 con 0x7f76ec0b4460 2024-04-25T02:08:04.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f2657fff640 1 -- 172.21.15.79:0/1638629359 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26600072d0 con 0x7f26701540c0 2024-04-25T02:08:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fed8bfff640 1 -- 172.21.15.79:0/4117279388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed840e6d00 msgr2=0x7fed840d84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fed8bfff640 1 --2- 172.21.15.79:0/4117279388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed840e6d00 0x7fed840d84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fed8bfff640 1 -- 172.21.15.79:0/4117279388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed84055100 msgr2=0x7fed840d3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fee25152640 1 -- 172.21.15.79:0/733919088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee180df4e0 msgr2=0x7fee1804e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fee25152640 1 --2- 172.21.15.79:0/733919088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee180df4e0 0x7fee1804e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fee25152640 1 -- 172.21.15.79:0/733919088 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee18045360 con 0x7fee180df100 2024-04-25T02:08:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fee24951640 1 --2- 172.21.15.79:0/733919088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee180df4e0 0x7fee1804e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fee25953640 1 --2- 172.21.15.79:0/733919088 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee1803a220 0x7fee1803a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:04.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f2657fff640 1 -- 172.21.15.79:0/1638629359 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26600047e0 con 0x7f26701540c0 2024-04-25T02:08:04.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f76eb59e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec06e240 con 0x7f76ec1446c0 2024-04-25T02:08:04.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f76eb59e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f76ec06f2d0 con 0x7f76ec072230 2024-04-25T02:08:04.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f2f03fff640 1 --2- 172.21.15.79:0/3087636179 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2efc0eb330 0x7f2efc04ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fef6dd16640 1 -- 172.21.15.79:0/3490396182 wait complete. 2024-04-25T02:08:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fee25152640 1 --2- 172.21.15.79:0/733919088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee180df100 0x7fee1817d3a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0072e0 tx=0x7fee1c0077a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f2675cdf640 1 -- 172.21.15.79:0/1638629359 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26701f86b0 con 0x7f26701540c0 2024-04-25T02:08:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fed8bfff640 1 --2- 172.21.15.79:0/4117279388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed84055100 0x7fed840d3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fed8bfff640 1 -- 172.21.15.79:0/4117279388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed840e62d0 con 0x7fed840e6920 2024-04-25T02:08:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fed909e9640 1 --2- 172.21.15.79:0/4117279388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed84055100 0x7fed840d3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7fa101866640 1 --2- 172.21.15.79:0/2130282749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0fc0b5450 0x7fa0fc15bc20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc08c3f0 tx=0x7fa0f80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f96b77fe640 1 -- 172.21.15.79:0/1775805606 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8048070 con 0x7f96d015b220 2024-04-25T02:08:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f96b77fe640 1 -- 172.21.15.79:0/1775805606 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c8042880 con 0x7f96d015b220 2024-04-25T02:08:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f96b77fe640 1 -- 172.21.15.79:0/1775805606 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8042c70 con 0x7f96d015b220 2024-04-25T02:08:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7f96d54ba640 1 -- 172.21.15.79:0/1775805606 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d00c63d0 con 0x7f96d015b220 2024-04-25T02:08:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7f2f037fe640 1 -- 172.21.15.79:0/3087636179 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2efc0eb330 msgr2=0x7f2efc04ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7f2f037fe640 1 --2- 172.21.15.79:0/3087636179 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2efc0eb330 0x7f2efc04ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7f2f037fe640 1 -- 172.21.15.79:0/3087636179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2efc0e7850 msgr2=0x7f2efc039a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7fed8bfff640 1 --2- 172.21.15.79:0/4117279388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed840e6920 0x7fed840d7f70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fed8000b420 tx=0x7fed8000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7f2f037fe640 1 --2- 172.21.15.79:0/3087636179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2efc0e7850 0x7f2efc039a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7f2f037fe640 1 -- 172.21.15.79:0/3087636179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc04f280 con 0x7f2efc0061d0 2024-04-25T02:08:04.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7f96d54ba640 1 -- 172.21.15.79:0/1775805606 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d00c6990 con 0x7f96d015b220 2024-04-25T02:08:04.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7f2f03fff640 1 --2- 172.21.15.79:0/3087636179 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2efc0eb330 0x7f2efc04ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:04.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7fed897fa640 1 -- 172.21.15.79:0/4117279388 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed80011830 con 0x7fed840e6920 2024-04-25T02:08:04.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7fa0f27fc640 1 -- 172.21.15.79:0/2130282749 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8037040 con 0x7fa0fc0b5450 2024-04-25T02:08:04.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7fa0f27fc640 1 -- 172.21.15.79:0/2130282749 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f8042070 con 0x7fa0fc0b5450 2024-04-25T02:08:04.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7fa0f27fc640 1 -- 172.21.15.79:0/2130282749 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8030c70 con 0x7fa0fc0b5450 2024-04-25T02:08:04.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7fa102868640 1 -- 172.21.15.79:0/2130282749 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0fc0cc280 con 0x7fa0fc0b5450 2024-04-25T02:08:04.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f76ead9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76ec1446c0 0x7f76ec138c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7f76e9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76ec0b4460 0x7f76ec15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7f76e9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76ec0b4460 0x7f76ec15ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34898/0 (socket says 172.21.15.79:34898) 2024-04-25T02:08:04.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7f76e9d9b640 1 -- 172.21.15.79:0/3331063201 learned_addr learned my addr 172.21.15.79:0/3331063201 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7f76ea59c640 1 --2- 172.21.15.79:0/3331063201 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f76ec072230 0x7f76ec1efc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7fed92c4d640 1 -- 172.21.15.79:0/4117279388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed840e65b0 con 0x7fed840e6920 2024-04-25T02:08:04.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7fed92c4d640 1 -- 172.21.15.79:0/4117279388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed8404f9f0 con 0x7fed840e6920 2024-04-25T02:08:04.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7fa102868640 1 -- 172.21.15.79:0/2130282749 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0fc15dcd0 con 0x7fa0fc0b5450 2024-04-25T02:08:04.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.581+0000 7f2f037fe640 1 --2- 172.21.15.79:0/3087636179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2efc0061d0 0x7f2efc17e760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0086b0 tx=0x7f2ef8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.582+0000 7fef6dd16640 1 Processor -- start 2024-04-25T02:08:04.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.582+0000 7f76ead9d640 1 -- 172.21.15.79:0/3331063201 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f76ec072230 msgr2=0x7f76ec1efc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.582+0000 7f76ead9d640 1 --2- 172.21.15.79:0/3331063201 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f76ec072230 0x7f76ec1efc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.582+0000 7f76ead9d640 1 -- 172.21.15.79:0/3331063201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76ec0b4460 msgr2=0x7f76ec15ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.582+0000 7f76ead9d640 1 --2- 172.21.15.79:0/3331063201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76ec0b4460 0x7f76ec15ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.582+0000 7f76ead9d640 1 -- 172.21.15.79:0/3331063201 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec1f02e0 con 0x7f76ec1446c0 2024-04-25T02:08:04.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.582+0000 7fef6dd16640 1 -- start start 2024-04-25T02:08:04.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.582+0000 7f76ead9d640 1 --2- 172.21.15.79:0/3331063201 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76ec1446c0 0x7f76ec138c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f76e000c3f0 tx=0x7f76e000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.580+0000 7f2675cdf640 1 -- 172.21.15.79:0/1638629359 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26701f8c70 con 0x7f26701540c0 2024-04-25T02:08:04.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.582+0000 7f76daffd640 1 -- 172.21.15.79:0/3331063201 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0017070 con 0x7f76ec1446c0 2024-04-25T02:08:04.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.583+0000 7f76daffd640 1 -- 172.21.15.79:0/3331063201 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e0005ce0 con 0x7f76ec1446c0 2024-04-25T02:08:04.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.583+0000 7f76daffd640 1 -- 172.21.15.79:0/3331063201 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e00072d0 con 0x7f76ec1446c0 2024-04-25T02:08:04.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.583+0000 7f76eb59e640 1 -- 172.21.15.79:0/3331063201 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ec1f05c0 con 0x7f76ec1446c0 2024-04-25T02:08:04.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.583+0000 7f76eb59e640 1 -- 172.21.15.79:0/3331063201 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ec1f0b80 con 0x7f76ec1446c0 2024-04-25T02:08:04.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.582+0000 7fee15ffb640 1 -- 172.21.15.79:0/733919088 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c00f9c0 con 0x7fee180df100 2024-04-25T02:08:04.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.582+0000 7fee15ffb640 1 -- 172.21.15.79:0/733919088 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1c018070 con 0x7fee180df100 2024-04-25T02:08:04.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.582+0000 7fee15ffb640 1 -- 172.21.15.79:0/733919088 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c00fda0 con 0x7fee180df100 2024-04-25T02:08:04.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.583+0000 7fee26154640 1 -- 172.21.15.79:0/733919088 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee18045600 con 0x7fee180df100 2024-04-25T02:08:04.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.582+0000 7fed897fa640 1 -- 172.21.15.79:0/4117279388 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed80016070 con 0x7fed840e6920 2024-04-25T02:08:04.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.583+0000 7f2eeffff640 1 -- 172.21.15.79:0/3087636179 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8042070 con 0x7f2efc0061d0 2024-04-25T02:08:04.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.583+0000 7f2eeffff640 1 -- 172.21.15.79:0/3087636179 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef8003d40 con 0x7f2efc0061d0 2024-04-25T02:08:04.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.583+0000 7fed897fa640 1 -- 172.21.15.79:0/4117279388 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed80011c10 con 0x7fed840e6920 2024-04-25T02:08:04.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.583+0000 7fed92c4d640 1 -- 172.21.15.79:0/4117279388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed840e6080 con 0x7fed840e6920 2024-04-25T02:08:04.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.583+0000 7fef6dd16640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef680719b0 0x7fef681ef900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.583+0000 7f2675cdf640 1 -- 172.21.15.79:0/1638629359 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f26700b4490 con 0x7f26701540c0 2024-04-25T02:08:04.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.583+0000 7fa0f27fc640 1 -- 172.21.15.79:0/2130282749 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0f8047460 con 0x7fa0fc0b5450 2024-04-25T02:08:04.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.583+0000 7fee26154640 1 -- 172.21.15.79:0/733919088 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee18045bc0 con 0x7fee180df100 2024-04-25T02:08:04.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.583+0000 7f2f09f29640 1 -- 172.21.15.79:0/3087636179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2efc03a1e0 con 0x7f2efc0061d0 2024-04-25T02:08:04.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.583+0000 7f96d54ba640 1 -- 172.21.15.79:0/1775805606 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f96d015a000 con 0x7f96d015b220 2024-04-25T02:08:04.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.584+0000 7f2f09f29640 1 -- 172.21.15.79:0/3087636179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2efc03a7a0 con 0x7f2efc0061d0 2024-04-25T02:08:04.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.584+0000 7f2eeffff640 1 -- 172.21.15.79:0/3087636179 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8042070 con 0x7f2efc0061d0 2024-04-25T02:08:04.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.584+0000 7fef6dd16640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef68072b00 0x7fef681521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.584+0000 7fef6dd16640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef6815a270 0x7fef6814ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.584+0000 7fef6dd16640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fef680b3b50 con 0x7fef680719b0 2024-04-25T02:08:04.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.584+0000 7fef6dd16640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef680b39d0 con 0x7fef6815a270 2024-04-25T02:08:04.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.584+0000 7fef6dd16640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fef680b2520 con 0x7fef68072b00 2024-04-25T02:08:04.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.584+0000 7fa0dffff640 1 -- 172.21.15.79:0/2130282749 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa0fc0cc7a0 con 0x7fa0fc0b5450 2024-04-25T02:08:04.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.584+0000 7fa0f27fc640 1 --2- 172.21.15.79:0/2130282749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa0e006bf00 0x7fa0e006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.584+0000 7fef677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef680719b0 0x7fef681ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.585+0000 7fa0f27fc640 1 -- 172.21.15.79:0/2130282749 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa0f80ab930 con 0x7fa0fc0b5450 2024-04-25T02:08:04.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.585+0000 7f2f09f29640 1 -- 172.21.15.79:0/3087636179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2efc039f80 con 0x7f2efc0061d0 2024-04-25T02:08:04.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.585+0000 7fa0f27fc640 1 --2- 172.21.15.79:0/2130282749 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x7fa0e0074180 0x7fa0e00765a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.585+0000 7fa101065640 1 --2- 172.21.15.79:0/2130282749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa0e006bf00 0x7fa0e006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.585+0000 7f76daffd640 1 -- 172.21.15.79:0/3331063201 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76e001a070 con 0x7f76ec1446c0 2024-04-25T02:08:04.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.585+0000 7f76daffd640 1 --2- 172.21.15.79:0/3331063201 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f76cc06bf30 0x7f76cc06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7f76daffd640 1 -- 172.21.15.79:0/3331063201 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f76e008a0f0 con 0x7f76ec1446c0 2024-04-25T02:08:04.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.585+0000 7fa0f27fc640 1 -- 172.21.15.79:0/2130282749 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa0f8008f30 con 0x7fa0e0074180 2024-04-25T02:08:04.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.585+0000 7fa0f27fc640 1 -- 172.21.15.79:0/2130282749 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa0f80b2050 con 0x7fa0fc0b5450 2024-04-25T02:08:04.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7fa102067640 1 --2- 172.21.15.79:0/2130282749 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x7fa0e0074180 0x7fa0e00765a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7fed897fa640 1 -- 172.21.15.79:0/4117279388 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed8001b460 con 0x7fed840e6920 2024-04-25T02:08:04.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7f76ea59c640 1 --2- 172.21.15.79:0/3331063201 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f76cc06bf30 0x7f76cc06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7f76eb59e640 1 --2- 172.21.15.79:0/3331063201 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x7f76ec1f0d50 0x7f76ec0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7f76eb59e640 1 -- 172.21.15.79:0/3331063201 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76ec143ee0 con 0x7f76ec1f0d50 2024-04-25T02:08:04.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7f96b77fe640 1 -- 172.21.15.79:0/1775805606 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96c804b070 con 0x7f96d015b220 2024-04-25T02:08:04.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7fa102067640 1 --2- 172.21.15.79:0/2130282749 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x7fa0e0074180 0x7fa0e00765a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.585+0000 7fef66ffd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef68072b00 0x7fef681521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.585+0000 7fef66ffd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef68072b00 0x7fef681521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49378/0 (socket says 172.21.15.79:49378) 2024-04-25T02:08:04.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.585+0000 7fef66ffd640 1 -- 172.21.15.79:0/809097313 learned_addr learned my addr 172.21.15.79:0/809097313 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7fef66ffd640 1 -- 172.21.15.79:0/809097313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef6815a270 msgr2=0x7fef6814ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7f76e9d9b640 1 --2- 172.21.15.79:0/3331063201 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x7f76ec1f0d50 0x7f76ec0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.584+0000 7fef67fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef6815a270 0x7fef6814ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7fa101065640 1 --2- 172.21.15.79:0/2130282749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa0e006bf00 0x7fa0e006e3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc1fbb60 tx=0x7fa0ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7fef66ffd640 1 --2- 172.21.15.79:0/809097313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef6815a270 0x7fef6814ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7fef66ffd640 1 -- 172.21.15.79:0/809097313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef680719b0 msgr2=0x7fef681ef900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7f96b77fe640 1 --2- 172.21.15.79:0/1775805606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f96bc06bf30 0x7f96bc06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7fed897fa640 1 --2- 172.21.15.79:0/4117279388 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fed7006be30 0x7fed7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7fef66ffd640 1 --2- 172.21.15.79:0/809097313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef680719b0 0x7fef681ef900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7fef66ffd640 1 -- 172.21.15.79:0/809097313 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef681e1b20 con 0x7fef68072b00 2024-04-25T02:08:04.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fef67fff640 1 --2- 172.21.15.79:0/809097313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef6815a270 0x7fef6814ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:04.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7f96b77fe640 1 -- 172.21.15.79:0/1775805606 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f96c80af890 con 0x7f96d015b220 2024-04-25T02:08:04.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7f96b77fe640 1 --2- 172.21.15.79:0/1775805606 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x7f96bc074150 0x7f96bc076570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7f96b77fe640 1 -- 172.21.15.79:0/1775805606 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96c8031e50 con 0x7f96bc074150 2024-04-25T02:08:04.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7f96b77fe640 1 -- 172.21.15.79:0/1775805606 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f96c80b42a0 con 0x7f96d015b220 2024-04-25T02:08:04.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fed897fa640 1 -- 172.21.15.79:0/4117279388 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fed8008b4d0 con 0x7fed840e6920 2024-04-25T02:08:04.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fef677fe640 1 --2- 172.21.15.79:0/809097313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef680719b0 0x7fef681ef900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:04.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7f76ea59c640 1 --2- 172.21.15.79:0/3331063201 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f76cc06bf30 0x7f76cc06e3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f76e4034000 tx=0x7f76e4033040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7f2657fff640 1 -- 172.21.15.79:0/1638629359 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f266001b070 con 0x7f26701540c0 2024-04-25T02:08:04.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fed897fa640 1 --2- 172.21.15.79:0/4117279388 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x7fed700740b0 0x7fed700764d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fed897fa640 1 -- 172.21.15.79:0/4117279388 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed80026e50 con 0x7fed700740b0 2024-04-25T02:08:04.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fed897fa640 1 -- 172.21.15.79:0/4117279388 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fed8008b8c0 con 0x7fed840e6920 2024-04-25T02:08:04.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7f76e9d9b640 1 --2- 172.21.15.79:0/3331063201 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x7f76ec1f0d50 0x7f76ec0b08c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fef66ffd640 1 --2- 172.21.15.79:0/809097313 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef68072b00 0x7fef681521f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fef5000dce0 tx=0x7fef500046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fed909e9640 1 --2- 172.21.15.79:0/4117279388 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fed7006be30 0x7fed7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7f96ceffd640 1 --2- 172.21.15.79:0/1775805606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f96bc06bf30 0x7f96bc06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fa0f27fc640 1 -- 172.21.15.79:0/2130282749 <== osd.5 v2:172.21.15.189:6802/1246927196 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa0f8008f30 con 0x7fa0e0074180 2024-04-25T02:08:04.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fed911ea640 1 --2- 172.21.15.79:0/4117279388 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x7fed700740b0 0x7fed700764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7f2eeffff640 1 -- 172.21.15.79:0/3087636179 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ef8032440 con 0x7f2efc0061d0 2024-04-25T02:08:04.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7f2657fff640 1 --2- 172.21.15.79:0/1638629359 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f265c06bf00 0x7f265c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7f96ce7fc640 1 --2- 172.21.15.79:0/1775805606 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x7f96bc074150 0x7f96bc076570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.585+0000 7fee15ffb640 1 -- 172.21.15.79:0/733919088 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee1c01d460 con 0x7fee180df100 2024-04-25T02:08:04.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.586+0000 7fee26154640 1 -- 172.21.15.79:0/733919088 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fee18043780 con 0x7fee180df100 2024-04-25T02:08:04.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fee15ffb640 1 --2- 172.21.15.79:0/733919088 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fee0406bf00 0x7fee0406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fee15ffb640 1 -- 172.21.15.79:0/733919088 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fee1c08afa0 con 0x7fee180df100 2024-04-25T02:08:04.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fee24951640 1 --2- 172.21.15.79:0/733919088 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fee0406bf00 0x7fee0406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fee15ffb640 1 --2- 172.21.15.79:0/733919088 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x7fee040740a0 0x7fee040764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fee15ffb640 1 -- 172.21.15.79:0/733919088 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee1c00ae50 con 0x7fee040740a0 2024-04-25T02:08:04.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.587+0000 7fee25953640 1 --2- 172.21.15.79:0/733919088 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x7fee040740a0 0x7fee040764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7fed909e9640 1 --2- 172.21.15.79:0/4117279388 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fed7006be30 0x7fed7006e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed780325c0 tx=0x7fed7802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7f2eeffff640 1 --2- 172.21.15.79:0/3087636179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ee806c230 0x7f2ee806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7f266f7fe640 1 --2- 172.21.15.79:0/1638629359 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f265c06bf00 0x7f265c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7fef5ffff640 1 -- 172.21.15.79:0/809097313 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5003f050 con 0x7fef68072b00 2024-04-25T02:08:04.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7f2657fff640 1 -- 172.21.15.79:0/1638629359 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f266008ae40 con 0x7f26701540c0 2024-04-25T02:08:04.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7f76daffd640 1 -- 172.21.15.79:0/3331063201 <== osd.6 v2:172.21.15.189:6816/1254358257 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f76ec143ee0 con 0x7f76ec1f0d50 2024-04-25T02:08:04.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7f2f02ffd640 1 --2- 172.21.15.79:0/3087636179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ee806c230 0x7f2ee806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7f96ce7fc640 1 --2- 172.21.15.79:0/1775805606 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x7f96bc074150 0x7f96bc076570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7fef6dd16640 1 -- 172.21.15.79:0/809097313 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef681e1e00 con 0x7fef68072b00 2024-04-25T02:08:04.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7fee15ffb640 1 -- 172.21.15.79:0/733919088 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fee1c055560 con 0x7fee180df100 2024-04-25T02:08:04.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7f2657fff640 1 --2- 172.21.15.79:0/1638629359 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x7f265c074120 0x7f265c076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7fef6dd16640 1 -- 172.21.15.79:0/809097313 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fef681e23c0 con 0x7fef68072b00 2024-04-25T02:08:04.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7fef5ffff640 1 -- 172.21.15.79:0/809097313 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef50040040 con 0x7fef68072b00 2024-04-25T02:08:04.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7fef5ffff640 1 -- 172.21.15.79:0/809097313 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef500044c0 con 0x7fef68072b00 2024-04-25T02:08:04.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7f266f7fe640 1 --2- 172.21.15.79:0/1638629359 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f265c06bf00 0x7f265c06e3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2664006a90 tx=0x7f2664006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.589+0000 7fed911ea640 1 --2- 172.21.15.79:0/4117279388 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x7fed700740b0 0x7fed700764d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.589+0000 7f2f02ffd640 1 --2- 172.21.15.79:0/3087636179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ee806c230 0x7f2ee806e6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2f0407a8c0 tx=0x7f2f04067f60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.588+0000 7fee25953640 1 --2- 172.21.15.79:0/733919088 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x7fee040740a0 0x7fee040764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.589+0000 7f2eeffff640 1 -- 172.21.15.79:0/3087636179 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2ef802abe0 con 0x7f2efc0061d0 2024-04-25T02:08:04.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.589+0000 7f2eeffff640 1 --2- 172.21.15.79:0/3087636179 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x7f2ee8074e90 0x7f2ee8077330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.589+0000 7f2eeffff640 1 -- 172.21.15.79:0/3087636179 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ee8077a00 con 0x7f2ee8074e90 2024-04-25T02:08:04.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.589+0000 7f2eeffff640 1 -- 172.21.15.79:0/3087636179 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2ef8074fa0 con 0x7f2efc0061d0 2024-04-25T02:08:04.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.589+0000 7f96ceffd640 1 --2- 172.21.15.79:0/1775805606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f96bc06bf30 0x7f96bc06e3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96c0006fd0 tx=0x7f96c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.589+0000 7fee24951640 1 --2- 172.21.15.79:0/733919088 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fee0406bf00 0x7fee0406e3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee20050ce0 tx=0x7fee20067eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.589+0000 7f2657fff640 1 -- 172.21.15.79:0/1638629359 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2660024e50 con 0x7f265c074120 2024-04-25T02:08:04.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.589+0000 7f2657fff640 1 -- 172.21.15.79:0/1638629359 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f266008b230 con 0x7f26701540c0 2024-04-25T02:08:04.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.589+0000 7f2f03fff640 1 --2- 172.21.15.79:0/3087636179 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x7f2ee8074e90 0x7f2ee8077330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.589+0000 7fef6dd16640 1 -- 172.21.15.79:0/809097313 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef4c001030 con 0x7fef68072b00 2024-04-25T02:08:04.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.589+0000 7f96b77fe640 1 -- 172.21.15.79:0/1775805606 <== osd.3 v2:172.21.15.79:6817/3072297369 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f96c8031e50 con 0x7f96bc074150 2024-04-25T02:08:04.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.589+0000 7f266effd640 1 --2- 172.21.15.79:0/1638629359 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x7f265c074120 0x7f265c076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.589+0000 7fed897fa640 1 -- 172.21.15.79:0/4117279388 <== osd.4 v2:172.21.15.189:6800/1910571406 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed80026e50 con 0x7fed700740b0 2024-04-25T02:08:04.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.590+0000 7f2f03fff640 1 --2- 172.21.15.79:0/3087636179 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x7f2ee8074e90 0x7f2ee8077330 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.590+0000 7fee15ffb640 1 -- 172.21.15.79:0/733919088 <== osd.1 v2:172.21.15.79:6816/2311596149 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fee1c00ae50 con 0x7fee040740a0 2024-04-25T02:08:04.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.590+0000 7fef5ffff640 1 -- 172.21.15.79:0/809097313 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef5004d020 con 0x7fef68072b00 2024-04-25T02:08:04.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.590+0000 7f266effd640 1 --2- 172.21.15.79:0/1638629359 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x7f265c074120 0x7f265c076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.590+0000 7fef5ffff640 1 --2- 172.21.15.79:0/809097313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fef4806bf00 0x7fef4806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.591+0000 7fef677fe640 1 --2- 172.21.15.79:0/809097313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fef4806bf00 0x7fef4806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.591+0000 7f2657fff640 1 -- 172.21.15.79:0/1638629359 <== osd.2 v2:172.21.15.79:6800/3397511354 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2660024e50 con 0x7f265c074120 2024-04-25T02:08:04.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.590+0000 7f2eeffff640 1 -- 172.21.15.79:0/3087636179 <== osd.7 v2:172.21.15.189:6824/3421948491 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2ee8077a00 con 0x7f2ee8074e90 2024-04-25T02:08:04.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.591+0000 7fef677fe640 1 --2- 172.21.15.79:0/809097313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fef4806bf00 0x7fef4806e3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fef58007fd0 tx=0x7fef58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.592+0000 7fef5ffff640 1 -- 172.21.15.79:0/809097313 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fef500b3670 con 0x7fef68072b00 2024-04-25T02:08:04.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.592+0000 7fef5ffff640 1 --2- 172.21.15.79:0/809097313 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x7fef480740a0 0x7fef480764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.592+0000 7fef67fff640 1 --2- 172.21.15.79:0/809097313 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x7fef480740a0 0x7fef480764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.593+0000 7fef67fff640 1 --2- 172.21.15.79:0/809097313 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x7fef480740a0 0x7fef480764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.593+0000 7fef5ffff640 1 -- 172.21.15.79:0/809097313 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef50007e40 con 0x7fef480740a0 2024-04-25T02:08:04.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.594+0000 7fef5ffff640 1 -- 172.21.15.79:0/809097313 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fef500ba050 con 0x7fef68072b00 2024-04-25T02:08:04.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.594+0000 7fef5ffff640 1 -- 172.21.15.79:0/809097313 <== osd.0 v2:172.21.15.79:6802/1526100659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fef50007e40 con 0x7fef480740a0 2024-04-25T02:08:04.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.620+0000 7fa0dffff640 1 -- 172.21.15.79:0/2130282749 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa0fc04f500 con 0x7fa0e0074180 2024-04-25T02:08:04.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.621+0000 7fa0f27fc640 1 -- 172.21.15.79:0/2130282749 <== osd.5 v2:172.21.15.189:6802/1246927196 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa0fc04f500 con 0x7fa0e0074180 2024-04-25T02:08:04.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.621+0000 7f96d54ba640 1 -- 172.21.15.79:0/1775805606 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f96d00681e0 con 0x7f96bc074150 2024-04-25T02:08:04.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.621+0000 7fa0dffff640 1 -- 172.21.15.79:0/2130282749 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x7fa0e0074180 msgr2=0x7fa0e00765a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.621+0000 7fa0dffff640 1 --2- 172.21.15.79:0/2130282749 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x7fa0e0074180 0x7fa0e00765a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.621+0000 7f96b77fe640 1 -- 172.21.15.79:0/1775805606 <== osd.3 v2:172.21.15.79:6817/3072297369 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f96d00681e0 con 0x7f96bc074150 2024-04-25T02:08:04.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.621+0000 7fa0dffff640 1 -- 172.21.15.79:0/2130282749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa0e006bf00 msgr2=0x7fa0e006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.621+0000 7f76eb59e640 1 -- 172.21.15.79:0/3331063201 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f76ec0b4ea0 con 0x7f76ec1f0d50 2024-04-25T02:08:04.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.621+0000 7fa0dffff640 1 --2- 172.21.15.79:0/2130282749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa0e006bf00 0x7fa0e006e3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc1fbb60 tx=0x7fa0ec008040 comp rx=0 tx=0).stop 2024-04-25T02:08:04.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7fa0dffff640 1 -- 172.21.15.79:0/2130282749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0fc0b5450 msgr2=0x7fa0fc15bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7fa0dffff640 1 --2- 172.21.15.79:0/2130282749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0fc0b5450 0x7fa0fc15bc20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc08c3f0 tx=0x7fa0f80046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7fa102067640 1 -- 172.21.15.79:0/2130282749 reap_dead start 2024-04-25T02:08:04.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7f96b57fa640 1 -- 172.21.15.79:0/1775805606 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x7f96bc074150 msgr2=0x7f96bc076570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7f96b57fa640 1 --2- 172.21.15.79:0/1775805606 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x7f96bc074150 0x7f96bc076570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7f96b57fa640 1 -- 172.21.15.79:0/1775805606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f96bc06bf30 msgr2=0x7f96bc06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7f96b57fa640 1 --2- 172.21.15.79:0/1775805606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f96bc06bf30 0x7f96bc06e3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96c0006fd0 tx=0x7f96c0008040 comp rx=0 tx=0).stop 2024-04-25T02:08:04.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7f96b57fa640 1 -- 172.21.15.79:0/1775805606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015b220 msgr2=0x7f96d00cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7f96b57fa640 1 --2- 172.21.15.79:0/1775805606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96d015b220 0x7f96d00cc1e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009d90 tx=0x7f96c8004a40 comp rx=0 tx=0).stop 2024-04-25T02:08:04.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7fed92c4d640 1 -- 172.21.15.79:0/4117279388 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fed840057d0 con 0x7fed700740b0 2024-04-25T02:08:04.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7fa0dffff640 1 -- 172.21.15.79:0/2130282749 shutdown_connections 2024-04-25T02:08:04.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7f76daffd640 1 -- 172.21.15.79:0/3331063201 <== osd.6 v2:172.21.15.189:6816/1254358257 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f76ec0b4ea0 con 0x7f76ec1f0d50 2024-04-25T02:08:04.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7f96cffff640 1 -- 172.21.15.79:0/1775805606 reap_dead start 2024-04-25T02:08:04.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7fa0dffff640 1 -- 172.21.15.79:0/2130282749 >> 172.21.15.79:0/2130282749 conn(0x7fa0fc0d3e90 msgr2=0x7fa0fc0d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7f96b57fa640 1 -- 172.21.15.79:0/1775805606 shutdown_connections 2024-04-25T02:08:04.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7f96b57fa640 1 -- 172.21.15.79:0/1775805606 >> 172.21.15.79:0/1775805606 conn(0x7f96d00b3f80 msgr2=0x7f96d015d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7f96b57fa640 1 -- 172.21.15.79:0/1775805606 shutdown_connections 2024-04-25T02:08:04.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7f2f09f29640 1 -- 172.21.15.79:0/3087636179 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2efc005810 con 0x7f2ee8074e90 2024-04-25T02:08:04.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7f96b57fa640 1 -- 172.21.15.79:0/1775805606 wait complete. 2024-04-25T02:08:04.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7fa0dffff640 1 -- 172.21.15.79:0/2130282749 shutdown_connections 2024-04-25T02:08:04.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7fa0dffff640 1 -- 172.21.15.79:0/2130282749 wait complete. 2024-04-25T02:08:04.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f2eeffff640 1 -- 172.21.15.79:0/3087636179 <== osd.7 v2:172.21.15.189:6824/3421948491 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2efc005810 con 0x7f2ee8074e90 2024-04-25T02:08:04.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.622+0000 7f76eb59e640 1 -- 172.21.15.79:0/3331063201 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x7f76ec1f0d50 msgr2=0x7f76ec0b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f76eb59e640 1 --2- 172.21.15.79:0/3331063201 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x7f76ec1f0d50 0x7f76ec0b08c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7fed897fa640 1 -- 172.21.15.79:0/4117279388 <== osd.4 v2:172.21.15.189:6800/1910571406 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fed840057d0 con 0x7fed700740b0 2024-04-25T02:08:04.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7fee26154640 1 -- 172.21.15.79:0/733919088 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fee18005390 con 0x7fee040740a0 2024-04-25T02:08:04.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f76eb59e640 1 -- 172.21.15.79:0/3331063201 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f76cc06bf30 msgr2=0x7f76cc06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f76eb59e640 1 --2- 172.21.15.79:0/3331063201 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f76cc06bf30 0x7f76cc06e3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f76e4034000 tx=0x7f76e4033040 comp rx=0 tx=0).stop 2024-04-25T02:08:04.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f76eb59e640 1 -- 172.21.15.79:0/3331063201 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76ec1446c0 msgr2=0x7f76ec138c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f76eb59e640 1 --2- 172.21.15.79:0/3331063201 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76ec1446c0 0x7f76ec138c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f76e000c3f0 tx=0x7f76e000c8b0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f76ead9d640 1 -- 172.21.15.79:0/3331063201 reap_dead start 2024-04-25T02:08:04.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f76eb59e640 1 -- 172.21.15.79:0/3331063201 shutdown_connections 2024-04-25T02:08:04.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f76eb59e640 1 -- 172.21.15.79:0/3331063201 >> 172.21.15.79:0/3331063201 conn(0x7f76ec0b2850 msgr2=0x7f76ec1423c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f2eedffb640 1 -- 172.21.15.79:0/3087636179 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x7f2ee8074e90 msgr2=0x7f2ee8077330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7fed76ffd640 1 -- 172.21.15.79:0/4117279388 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x7fed700740b0 msgr2=0x7fed700764d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7fed76ffd640 1 --2- 172.21.15.79:0/4117279388 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x7fed700740b0 0x7fed700764d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f76eb59e640 1 -- 172.21.15.79:0/3331063201 shutdown_connections 2024-04-25T02:08:04.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f2eedffb640 1 --2- 172.21.15.79:0/3087636179 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x7f2ee8074e90 0x7f2ee8077330 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.624+0000 7fed76ffd640 1 -- 172.21.15.79:0/4117279388 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fed7006be30 msgr2=0x7fed7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.624+0000 7fed76ffd640 1 --2- 172.21.15.79:0/4117279388 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fed7006be30 0x7fed7006e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed780325c0 tx=0x7fed7802e000 comp rx=0 tx=0).stop 2024-04-25T02:08:04.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.624+0000 7fed76ffd640 1 -- 172.21.15.79:0/4117279388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed840e6920 msgr2=0x7fed840d7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.624+0000 7fed76ffd640 1 --2- 172.21.15.79:0/4117279388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed840e6920 0x7fed840d7f70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fed8000b420 tx=0x7fed8000b8e0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.624+0000 7fed911ea640 1 -- 172.21.15.79:0/4117279388 reap_dead start 2024-04-25T02:08:04.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.624+0000 7f76eb59e640 1 -- 172.21.15.79:0/3331063201 wait complete. 2024-04-25T02:08:04.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f2eedffb640 1 -- 172.21.15.79:0/3087636179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ee806c230 msgr2=0x7f2ee806e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f2eedffb640 1 --2- 172.21.15.79:0/3087636179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ee806c230 0x7f2ee806e6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2f0407a8c0 tx=0x7f2f04067f60 comp rx=0 tx=0).stop 2024-04-25T02:08:04.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f2eedffb640 1 -- 172.21.15.79:0/3087636179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2efc0061d0 msgr2=0x7f2efc17e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.623+0000 7f2eedffb640 1 --2- 172.21.15.79:0/3087636179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2efc0061d0 0x7f2efc17e760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0086b0 tx=0x7f2ef8004730 comp rx=0 tx=0).stop 2024-04-25T02:08:04.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.624+0000 7f2f03fff640 1 -- 172.21.15.79:0/3087636179 reap_dead start 2024-04-25T02:08:04.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.624+0000 7f2eedffb640 1 -- 172.21.15.79:0/3087636179 shutdown_connections 2024-04-25T02:08:04.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.624+0000 7f2eedffb640 1 -- 172.21.15.79:0/3087636179 >> 172.21.15.79:0/3087636179 conn(0x7f2efc055a10 msgr2=0x7f2efc0e81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.624+0000 7fed76ffd640 1 -- 172.21.15.79:0/4117279388 shutdown_connections 2024-04-25T02:08:04.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.624+0000 7fed76ffd640 1 -- 172.21.15.79:0/4117279388 >> 172.21.15.79:0/4117279388 conn(0x7fed8401ef30 msgr2=0x7fed84007d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.624+0000 7fed76ffd640 1 -- 172.21.15.79:0/4117279388 shutdown_connections 2024-04-25T02:08:04.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.624+0000 7fed76ffd640 1 -- 172.21.15.79:0/4117279388 wait complete. 2024-04-25T02:08:04.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.625+0000 7fee15ffb640 1 -- 172.21.15.79:0/733919088 <== osd.1 v2:172.21.15.79:6816/2311596149 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fee18005390 con 0x7fee040740a0 2024-04-25T02:08:04.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.625+0000 7f2eedffb640 1 -- 172.21.15.79:0/3087636179 shutdown_connections 2024-04-25T02:08:04.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.625+0000 7f2eedffb640 1 -- 172.21.15.79:0/3087636179 wait complete. 2024-04-25T02:08:04.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.625+0000 7f2675cdf640 1 -- 172.21.15.79:0/1638629359 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f26700b4490 con 0x7f265c074120 2024-04-25T02:08:04.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.625+0000 7fee26154640 1 -- 172.21.15.79:0/733919088 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x7fee040740a0 msgr2=0x7fee040764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.625+0000 7fee26154640 1 --2- 172.21.15.79:0/733919088 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x7fee040740a0 0x7fee040764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.625+0000 7f2657fff640 1 -- 172.21.15.79:0/1638629359 <== osd.2 v2:172.21.15.79:6800/3397511354 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f26700b4490 con 0x7f265c074120 2024-04-25T02:08:04.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7fee26154640 1 -- 172.21.15.79:0/733919088 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fee0406bf00 msgr2=0x7fee0406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7fee26154640 1 --2- 172.21.15.79:0/733919088 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fee0406bf00 0x7fee0406e3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee20050ce0 tx=0x7fee20067eb0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7fee26154640 1 -- 172.21.15.79:0/733919088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee180df100 msgr2=0x7fee1817d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7fee26154640 1 --2- 172.21.15.79:0/733919088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee180df100 0x7fee1817d3a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0072e0 tx=0x7fee1c0077a0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7fee25953640 1 -- 172.21.15.79:0/733919088 reap_dead start 2024-04-25T02:08:04.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7fee26154640 1 -- 172.21.15.79:0/733919088 shutdown_connections 2024-04-25T02:08:04.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7fee26154640 1 -- 172.21.15.79:0/733919088 >> 172.21.15.79:0/733919088 conn(0x7fee18009fb0 msgr2=0x7fee180386e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7f2675cdf640 1 -- 172.21.15.79:0/1638629359 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x7f265c074120 msgr2=0x7f265c076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7f2675cdf640 1 --2- 172.21.15.79:0/1638629359 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x7f265c074120 0x7f265c076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7f2675cdf640 1 -- 172.21.15.79:0/1638629359 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f265c06bf00 msgr2=0x7f265c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7f2675cdf640 1 --2- 172.21.15.79:0/1638629359 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f265c06bf00 0x7f265c06e3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2664006a90 tx=0x7f2664006a20 comp rx=0 tx=0).stop 2024-04-25T02:08:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7f2675cdf640 1 -- 172.21.15.79:0/1638629359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26701540c0 msgr2=0x7f2670154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7f2675cdf640 1 --2- 172.21.15.79:0/1638629359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26701540c0 0x7f2670154540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f266000c750 tx=0x7f266000cc10 comp rx=0 tx=0).stop 2024-04-25T02:08:04.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7fef6dd16640 1 -- 172.21.15.79:0/809097313 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fef4c002dd0 con 0x7fef480740a0 2024-04-25T02:08:04.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7f266ffff640 1 -- 172.21.15.79:0/1638629359 reap_dead start 2024-04-25T02:08:04.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7f2675cdf640 1 -- 172.21.15.79:0/1638629359 shutdown_connections 2024-04-25T02:08:04.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7f2675cdf640 1 -- 172.21.15.79:0/1638629359 >> 172.21.15.79:0/1638629359 conn(0x7f267006b290 msgr2=0x7f267006e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.626+0000 7fee26154640 1 -- 172.21.15.79:0/733919088 shutdown_connections 2024-04-25T02:08:04.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.627+0000 7fee26154640 1 -- 172.21.15.79:0/733919088 wait complete. 2024-04-25T02:08:04.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.627+0000 7fef5ffff640 1 -- 172.21.15.79:0/809097313 <== osd.0 v2:172.21.15.79:6802/1526100659 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fef4c002dd0 con 0x7fef480740a0 2024-04-25T02:08:04.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.627+0000 7f2675cdf640 1 -- 172.21.15.79:0/1638629359 shutdown_connections 2024-04-25T02:08:04.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.627+0000 7f2675cdf640 1 -- 172.21.15.79:0/1638629359 wait complete. 2024-04-25T02:08:04.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.627+0000 7fef6dd16640 1 -- 172.21.15.79:0/809097313 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x7fef480740a0 msgr2=0x7fef480764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.627+0000 7fef6dd16640 1 --2- 172.21.15.79:0/809097313 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x7fef480740a0 0x7fef480764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.628+0000 7fef6dd16640 1 -- 172.21.15.79:0/809097313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fef4806bf00 msgr2=0x7fef4806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.628+0000 7fef6dd16640 1 --2- 172.21.15.79:0/809097313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fef4806bf00 0x7fef4806e3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fef58007fd0 tx=0x7fef58009040 comp rx=0 tx=0).stop 2024-04-25T02:08:04.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.628+0000 7fef6dd16640 1 -- 172.21.15.79:0/809097313 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef68072b00 msgr2=0x7fef681521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.628+0000 7fef6dd16640 1 --2- 172.21.15.79:0/809097313 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef68072b00 0x7fef681521f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fef5000dce0 tx=0x7fef500046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.628+0000 7fef67fff640 1 -- 172.21.15.79:0/809097313 reap_dead start 2024-04-25T02:08:04.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.628+0000 7fef6dd16640 1 -- 172.21.15.79:0/809097313 shutdown_connections 2024-04-25T02:08:04.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.628+0000 7fef6dd16640 1 -- 172.21.15.79:0/809097313 >> 172.21.15.79:0/809097313 conn(0x7fef680b1a30 msgr2=0x7fef68156df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.629+0000 7fef6dd16640 1 -- 172.21.15.79:0/809097313 shutdown_connections 2024-04-25T02:08:04.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.629+0000 7fef6dd16640 1 -- 172.21.15.79:0/809097313 wait complete. 2024-04-25T02:08:04.719 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-04-25T02:08:04.720 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:08:04.720 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-04-25T02:08:04.721 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T02:08:04.721 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-04-25T02:08:04.722 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T02:08:04.723 INFO:teuthology.orchestra.run.smithi079.stdout:55834574855 2024-04-25T02:08:04.723 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T02:08:04.724 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-04-25T02:08:04.725 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:08:04.726 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-04-25T02:08:04.726 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T02:08:04.727 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-04-25T02:08:04.728 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:08:04.729 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-04-25T02:08:04.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:08:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.917+0000 7f32b8329640 1 Processor -- start 2024-04-25T02:08:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.918+0000 7f32b8329640 1 -- start start 2024-04-25T02:08:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.918+0000 7f77971a5640 1 Processor -- start 2024-04-25T02:08:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.918+0000 7f77971a5640 1 -- start start 2024-04-25T02:08:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.918+0000 7f1b4890e640 1 Processor -- start 2024-04-25T02:08:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.918+0000 7f1b4890e640 1 -- start start 2024-04-25T02:08:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.919+0000 7fbc07501640 1 Processor -- start 2024-04-25T02:08:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.919+0000 7fbc07501640 1 -- start start 2024-04-25T02:08:04.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.919+0000 7f32b8329640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f32b00d0410 0x7f32b0165f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.919+0000 7f32b8329640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b0166b90 con 0x7f32b00b32b0 2024-04-25T02:08:04.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.919+0000 7f32b8329640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b0162b60 con 0x7f32b0163640 2024-04-25T02:08:04.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.919+0000 7f32b8329640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f32b01457a0 con 0x7f32b00d0410 2024-04-25T02:08:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.919+0000 7f77971a5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7788048040 0x7f778804fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.919+0000 7f77971a5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7788038720 0x7f7788006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.919+0000 7f77971a5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7788048420 con 0x7f7788037bb0 2024-04-25T02:08:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.919+0000 7f77971a5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f77880547a0 con 0x7f7788048040 2024-04-25T02:08:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.919+0000 7f77971a5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f7788053700 con 0x7f7788038720 2024-04-25T02:08:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.919+0000 7f32b60c5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f32b00b32b0 0x7f32b00cfd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47746/0 (socket says 172.21.15.79:47746) 2024-04-25T02:08:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f32b60c5640 1 -- 172.21.15.79:0/1765501819 learned_addr learned my addr 172.21.15.79:0/1765501819 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f8e0d1ba640 1 Processor -- start 2024-04-25T02:08:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.919+0000 7f778ffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7788037bb0 0x7f7788038010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47742/0 (socket says 172.21.15.79:47742) 2024-04-25T02:08:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.919+0000 7f778ffff640 1 -- 172.21.15.79:0/1806506008 learned_addr learned my addr 172.21.15.79:0/1806506008 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f7794f41640 1 --2- 172.21.15.79:0/1806506008 >> v2:172.21.15.79:3300/0 conn(0x7f7788048040 0x7f778804fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f1b4890e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b440b3070 0x7f1b440b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f1b4890e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b44070e80 0x7f1b44071310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f8e0d1ba640 1 -- start start 2024-04-25T02:08:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2766537050 0 0) 0x7f32b0162b60 con 0x7f32b0163640 2024-04-25T02:08:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f329c003520 con 0x7f32b0163640 2024-04-25T02:08:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f1b43fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b44070e80 0x7f1b44071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7fbc07501640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc0015e200 0x7fbc000d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7fbc07501640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbc000b2d70 0x7fbc000d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7fbc07501640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc000b32c0 0x7fbc000cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1008242441 0 0) 0x7f32b0166b90 con 0x7f32b00b32b0 2024-04-25T02:08:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f32b58c4640 1 --2- 172.21.15.79:0/1765501819 >> v2:172.21.15.79:3300/0 conn(0x7f32b00d0410 0x7f32b0165f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7fbc07501640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbc000d2bb0 con 0x7fbc000b32c0 2024-04-25T02:08:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7fbc07501640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fbc000d1540 con 0x7fbc000b2d70 2024-04-25T02:08:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7fbc07501640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbc000d1820 con 0x7fbc0015e200 2024-04-25T02:08:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f1b43fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b44070e80 0x7f1b44071310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34938/0 (socket says 172.21.15.79:34938) 2024-04-25T02:08:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f7794f41640 1 -- 172.21.15.79:0/1806506008 >> v2:172.21.15.189:3300/0 conn(0x7f7788038720 msgr2=0x7f7788006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f7794f41640 1 --2- 172.21.15.79:0/1806506008 >> v2:172.21.15.189:3300/0 conn(0x7f7788038720 0x7f7788006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f1191d3b640 1 Processor -- start 2024-04-25T02:08:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.920+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32b0162b60 con 0x7f32b00b32b0 2024-04-25T02:08:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7fbc064ff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc0015e200 0x7fbc000d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7fbc064ff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc0015e200 0x7fbc000d0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49400/0 (socket says 172.21.15.79:49400) 2024-04-25T02:08:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7fbc064ff640 1 -- 172.21.15.79:0/2478282850 learned_addr learned my addr 172.21.15.79:0/2478282850 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7fbc05cfe640 1 --2- 172.21.15.79:0/2478282850 >> v2:172.21.15.189:3300/0 conn(0x7fbc000b2d70 0x7fbc000d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1620291431 0 0) 0x7f32b0162b60 con 0x7f32b00b32b0 2024-04-25T02:08:04.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 >> v2:172.21.15.79:3300/0 conn(0x7f32b00d0410 msgr2=0x7f32b0165f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f1b437fe640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f1b44143b50 0x7f1b440cc5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:34870/0 (socket says 172.21.15.79:34870) 2024-04-25T02:08:04.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f32b50c3640 1 --2- 172.21.15.79:0/1765501819 >> v2:172.21.15.79:3300/0 conn(0x7f32b00d0410 0x7f32b0165f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f1b42ffd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b440b3070 0x7f1b440b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 >> v1:172.21.15.189:6789/0 conn(0x7f32b0163640 legacy=0x7f32b0147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f1b42ffd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b440b3070 0x7f1b440b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49394/0 (socket says 172.21.15.79:49394) 2024-04-25T02:08:04.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f1b43fff640 1 -- 172.21.15.79:0/496413977 learned_addr learned my addr 172.21.15.79:0/496413977 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f1191d3b640 1 -- start start 2024-04-25T02:08:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7fbc064ff640 1 -- 172.21.15.79:0/2478282850 >> v2:172.21.15.189:3300/0 conn(0x7fbc000b2d70 msgr2=0x7fbc000d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7fbc064ff640 1 --2- 172.21.15.79:0/2478282850 >> v2:172.21.15.189:3300/0 conn(0x7fbc000b2d70 0x7fbc000d0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7fbc064ff640 1 -- 172.21.15.79:0/2478282850 >> v2:172.21.15.79:3300/0 conn(0x7fbc000b32c0 msgr2=0x7fbc000cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7fbc064ff640 1 --2- 172.21.15.79:0/2478282850 >> v2:172.21.15.79:3300/0 conn(0x7fbc000b32c0 0x7fbc000cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7fbc064ff640 1 -- 172.21.15.79:0/2478282850 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc000d2560 con 0x7fbc0015e200 2024-04-25T02:08:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f1b4890e640 1 -- 172.21.15.79:0/496413977 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4406cd40 con 0x7f1b44143b50 2024-04-25T02:08:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f1b4890e640 1 -- 172.21.15.79:0/496413977 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1b440ccce0 con 0x7f1b44070e80 2024-04-25T02:08:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f1b4890e640 1 -- 172.21.15.79:0/496413977 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1b440b44d0 con 0x7f1b440b3070 2024-04-25T02:08:04.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b0162e40 con 0x7f32b00b32b0 2024-04-25T02:08:04.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f32a80019f0 con 0x7f32b00b32b0 2024-04-25T02:08:04.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f8e0d1ba640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8e0004fa90 0x7f8e0004fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f8e0d1ba640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e000df420 0x7f8e000382c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7fb55c8f5640 1 Processor -- start 2024-04-25T02:08:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f8e0d1ba640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e000503b0 con 0x7f8e00038800 2024-04-25T02:08:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f8e0d1ba640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f8e000068a0 con 0x7f8e0004fa90 2024-04-25T02:08:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f8e0d1ba640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8e00006af0 con 0x7f8e000df420 2024-04-25T02:08:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f8e077fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e000df420 0x7f8e000382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 >> v1:172.21.15.79:6789/0 conn(0x7f32b00b32b0 legacy=0x7f32b00cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f8e07fff640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8e0004fa90 0x7f8e0004fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f32b50c3640 1 --2- 172.21.15.79:0/1765501819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f329c003b70 0x7f329c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f8e07fff640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8e0004fa90 0x7f8e0004fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:36238/0 (socket says 172.21.15.79:36238) 2024-04-25T02:08:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f32b50c3640 1 --2- 172.21.15.79:0/1765501819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f329c004800 0x7f329c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f1b42ffd640 1 -- 172.21.15.79:0/496413977 >> v2:172.21.15.79:3300/0 conn(0x7f1b44070e80 msgr2=0x7f1b44071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f1191d3b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1184005e90 0x7f11840062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f1191d3b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1184006810 0x7f1184006c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.921+0000 7f778f7fe640 1 -- 172.21.15.79:0/1806506008 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 900652947 0 0) 0x7f7788048420 con 0x7f7788037bb0 2024-04-25T02:08:04.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f1191d3b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1184053720 con 0x7f11840ead00 2024-04-25T02:08:04.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f1191d3b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1184054330 con 0x7f1184005e90 2024-04-25T02:08:04.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f1191d3b640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f1184053a00 con 0x7f1184006810 2024-04-25T02:08:04.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7fbf1ab7e640 1 Processor -- start 2024-04-25T02:08:04.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f32b50c3640 1 --2- 172.21.15.79:0/1765501819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f329c0051c0 0x7f329c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f7794f41640 1 -- 172.21.15.79:0/1806506008 >> v1:172.21.15.79:6789/0 conn(0x7f7788037bb0 legacy=0x7f7788038010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f118affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1184005e90 0x7f11840062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f32b01457a0 con 0x7f329c004800 2024-04-25T02:08:04.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f1b427fc640 1 -- 172.21.15.79:0/496413977 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1784037012 0 0) 0x7f1b4406cd40 con 0x7f1b44143b50 2024-04-25T02:08:04.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f1b42ffd640 1 --2- 172.21.15.79:0/496413977 >> v2:172.21.15.79:3300/0 conn(0x7f1b44070e80 0x7f1b44071310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f329c00c060 con 0x7f329c003b70 2024-04-25T02:08:04.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f1b42ffd640 1 -- 172.21.15.79:0/496413977 >> v1:172.21.15.189:6789/0 conn(0x7f1b44143b50 legacy=0x7f1b440cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f118affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1184005e90 0x7f11840062d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34944/0 (socket says 172.21.15.79:34944) 2024-04-25T02:08:04.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f118affd640 1 -- 172.21.15.79:0/744521533 learned_addr learned my addr 172.21.15.79:0/744521533 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f329c00c260 con 0x7f329c0051c0 2024-04-25T02:08:04.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f32b60c5640 1 --2- 172.21.15.79:0/1765501819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f329c003b70 0x7f329c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f1b42ffd640 1 -- 172.21.15.79:0/496413977 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4406d020 con 0x7f1b440b3070 2024-04-25T02:08:04.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7fb55c8f5640 1 -- start start 2024-04-25T02:08:04.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f32b68c6640 1 --2- 172.21.15.79:0/1765501819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f329c0051c0 0x7f329c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f118bfff640 1 --2- 172.21.15.79:0/744521533 >> v2:172.21.15.189:3300/0 conn(0x7f1184006810 0x7f1184006c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f8e077fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e000df420 0x7f8e000382c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49404/0 (socket says 172.21.15.79:49404) 2024-04-25T02:08:04.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f8e07fff640 1 -- 172.21.15.79:0/362198059 learned_addr learned my addr 172.21.15.79:0/362198059 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7f32b58c4640 1 --2- 172.21.15.79:0/1765501819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f329c004800 0x7f329c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f7794f41640 1 -- 172.21.15.79:0/1806506008 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77880539e0 con 0x7f7788048040 2024-04-25T02:08:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f1b43fff640 1 --2- 172.21.15.79:0/496413977 >> v2:172.21.15.79:3300/0 conn(0x7f1b44070e80 0x7f1b44071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7fbf1ab7e640 1 -- start start 2024-04-25T02:08:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f118affd640 1 -- 172.21.15.79:0/744521533 >> v2:172.21.15.189:3300/0 conn(0x7f1184006810 msgr2=0x7f1184006c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f118affd640 1 --2- 172.21.15.79:0/744521533 >> v2:172.21.15.189:3300/0 conn(0x7f1184006810 0x7f1184006c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f118affd640 1 -- 172.21.15.79:0/744521533 >> v1:172.21.15.189:6789/0 conn(0x7f11840ead00 legacy=0x7f118404fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.922+0000 7f118affd640 1 -- 172.21.15.79:0/744521533 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1184053ce0 con 0x7f1184005e90 2024-04-25T02:08:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7f118bfff640 1 --2- 172.21.15.79:0/744521533 >> v2:172.21.15.189:3300/0 conn(0x7f1184006810 0x7f1184006c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7fbc064ff640 1 --2- 172.21.15.79:0/2478282850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc0015e200 0x7fbc000d0970 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbc0008e780 tx=0x7fbbfc02a1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d40754a70a86d49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7f8e07fff640 1 -- 172.21.15.79:0/362198059 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e000df420 msgr2=0x7f8e000382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7f8e07fff640 1 --2- 172.21.15.79:0/362198059 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e000df420 0x7f8e000382c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7f8e07fff640 1 -- 172.21.15.79:0/362198059 >> v1:172.21.15.189:6789/0 conn(0x7f8e00038800 legacy=0x7f8e00038c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7f8e07fff640 1 -- 172.21.15.79:0/362198059 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e00006dd0 con 0x7f8e0004fa90 2024-04-25T02:08:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7f32b68c6640 1 -- 172.21.15.79:0/1765501819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f329c003b70 msgr2=0x7f329c003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7f32b68c6640 1 --2- 172.21.15.79:0/1765501819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f329c003b70 0x7f329c003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7f32b68c6640 1 -- 172.21.15.79:0/1765501819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f329c004800 msgr2=0x7f329c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7f32b68c6640 1 --2- 172.21.15.79:0/1765501819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f329c004800 0x7f329c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7f32b68c6640 1 -- 172.21.15.79:0/1765501819 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b0162b60 con 0x7f329c0051c0 2024-04-25T02:08:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7f32b58c4640 1 --2- 172.21.15.79:0/1765501819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f329c004800 0x7f329c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7f7794f41640 1 --2- 172.21.15.79:0/1806506008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7788048040 0x7f778804fa90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f77880344d0 tx=0x7f778402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfb68338700e5f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7fb55c8f5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55806b7d0 0x7fb5580ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7fb55c8f5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb5580d0510 0x7fb5580b7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7fbf1ab7e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbf140cfd30 0x7fbf140d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7fbf1ab7e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf140cf5a0 con 0x7fbf14161a00 2024-04-25T02:08:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7fbf1ab7e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf140d1750 con 0x7fbf14161620 2024-04-25T02:08:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7fbf1ab7e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fbf140cf8a0 con 0x7fbf140cfd30 2024-04-25T02:08:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7fb55c8f5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5580d3d20 con 0x7fb55809c370 2024-04-25T02:08:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7fb55c8f5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb5580d3a80 con 0x7fb5580d0510 2024-04-25T02:08:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7fb55c8f5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb55806d480 con 0x7fb55806b7d0 2024-04-25T02:08:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7fb555d9b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55806b7d0 0x7fb5580ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7fb555d9b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55806b7d0 0x7fb5580ce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49414/0 (socket says 172.21.15.79:49414) 2024-04-25T02:08:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.923+0000 7fb555d9b640 1 -- 172.21.15.79:0/2825013706 learned_addr learned my addr 172.21.15.79:0/2825013706 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7fbf13fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbf14161a00 0x7fbf140d1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47758/0 (socket says 172.21.15.79:47758) 2024-04-25T02:08:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7fbf13fff640 1 -- 172.21.15.79:0/3626566329 learned_addr learned my addr 172.21.15.79:0/3626566329 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f778f7fe640 1 -- 172.21.15.79:0/1806506008 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784037070 con 0x7f7788048040 2024-04-25T02:08:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f778f7fe640 1 -- 172.21.15.79:0/1806506008 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7784032440 con 0x7f7788048040 2024-04-25T02:08:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f778f7fe640 1 -- 172.21.15.79:0/1806506008 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784032810 con 0x7f7788048040 2024-04-25T02:08:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f118affd640 1 --2- 172.21.15.79:0/744521533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1184005e90 0x7f11840062d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f11840528a0 tx=0x7f117802a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fef0053c842dfc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f32b68c6640 1 -- 172.21.15.79:0/1765501819 reap_dead start 2024-04-25T02:08:04.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f1b42ffd640 1 --2- 172.21.15.79:0/496413977 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b440b3070 0x7f1b440b3f90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800d7b0 tx=0x7f1b3802c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=411435152702606c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7fb555d9b640 1 -- 172.21.15.79:0/2825013706 >> v2:172.21.15.189:3300/0 conn(0x7fb5580d0510 msgr2=0x7fb5580b7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:04.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7fb555d9b640 1 --2- 172.21.15.79:0/2825013706 >> v2:172.21.15.189:3300/0 conn(0x7fb5580d0510 0x7fb5580b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7fbf1911b640 1 --2- 172.21.15.79:0/3626566329 >> v2:172.21.15.189:3300/0 conn(0x7fbf140cfd30 0x7fbf140d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:04.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f8e07fff640 1 --2- 172.21.15.79:0/362198059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e0004fa90 0x7f8e0004fe70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0091e0 tx=0x7f8dfc02a320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b12387a062c14de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f118a7fc640 1 -- 172.21.15.79:0/744521533 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178037070 con 0x7f1184005e90 2024-04-25T02:08:04.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7fbc054fd640 1 -- 172.21.15.79:0/2478282850 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc037070 con 0x7fbc0015e200 2024-04-25T02:08:04.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7fb555d9b640 1 -- 172.21.15.79:0/2825013706 >> v1:172.21.15.189:6789/0 conn(0x7fb55809c370 legacy=0x7fb5580cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7fb55559a640 1 -- 172.21.15.79:0/2825013706 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3686667520 0 0) 0x7fb5580d3d20 con 0x7fb55809c370 2024-04-25T02:08:04.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7fb555d9b640 1 -- 172.21.15.79:0/2825013706 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55806d1a0 con 0x7fb55806b7d0 2024-04-25T02:08:04.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f118a7fc640 1 -- 172.21.15.79:0/744521533 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1178032440 con 0x7f1184005e90 2024-04-25T02:08:04.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7fbc054fd640 1 -- 172.21.15.79:0/2478282850 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbfc032440 con 0x7fbc0015e200 2024-04-25T02:08:04.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f118a7fc640 1 -- 172.21.15.79:0/744521533 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178032810 con 0x7f1184005e90 2024-04-25T02:08:04.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f32b68c6640 1 --2- 172.21.15.79:0/1765501819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f329c0051c0 0x7f329c00b9c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f32ac007ef0 tx=0x7f329c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5269fd440f3f637 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7fbc054fd640 1 -- 172.21.15.79:0/2478282850 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc032850 con 0x7fbc0015e200 2024-04-25T02:08:04.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f8e06ffd640 1 -- 172.21.15.79:0/362198059 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc037070 con 0x7f8e0004fa90 2024-04-25T02:08:04.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f8e06ffd640 1 -- 172.21.15.79:0/362198059 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dfc032640 con 0x7f8e0004fa90 2024-04-25T02:08:04.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f8e06ffd640 1 -- 172.21.15.79:0/362198059 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc037070 con 0x7f8e0004fa90 2024-04-25T02:08:04.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f1b427fc640 1 -- 172.21.15.79:0/496413977 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38038070 con 0x7f1b440b3070 2024-04-25T02:08:04.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f1b427fc640 1 -- 172.21.15.79:0/496413977 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b38031710 con 0x7f1b440b3070 2024-04-25T02:08:04.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7f1b427fc640 1 -- 172.21.15.79:0/496413977 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38031ae0 con 0x7f1b440b3070 2024-04-25T02:08:04.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7fbf1911b640 1 -- 172.21.15.79:0/3626566329 >> v1:172.21.15.189:6789/0 conn(0x7fbf14161620 legacy=0x7fbf140d0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7fbf1911b640 1 -- 172.21.15.79:0/3626566329 >> v1:172.21.15.79:6789/0 conn(0x7fbf14161a00 legacy=0x7fbf140d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.924+0000 7fbf1911b640 1 -- 172.21.15.79:0/3626566329 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf140d27a0 con 0x7fbf140cfd30 2024-04-25T02:08:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f77971a5640 1 -- 172.21.15.79:0/1806506008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7788048040 msgr2=0x7f778804fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f77971a5640 1 --2- 172.21.15.79:0/1806506008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7788048040 0x7f778804fa90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f77880344d0 tx=0x7f778402a270 comp rx=0 tx=0).stop 2024-04-25T02:08:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac007af0 con 0x7f329c0051c0 2024-04-25T02:08:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ac0050d0 con 0x7f329c0051c0 2024-04-25T02:08:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f32b50c3640 1 -- 172.21.15.79:0/1765501819 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0054a0 con 0x7f329c0051c0 2024-04-25T02:08:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7fbc07501640 1 -- 172.21.15.79:0/2478282850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc0015e200 msgr2=0x7fbc000d0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7fbc07501640 1 --2- 172.21.15.79:0/2478282850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc0015e200 0x7fbc000d0970 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbc0008e780 tx=0x7fbbfc02a1f0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f1191d3b640 1 -- 172.21.15.79:0/744521533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1184005e90 msgr2=0x7f11840062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f77971a5640 1 -- 172.21.15.79:0/1806506008 shutdown_connections 2024-04-25T02:08:04.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f77971a5640 1 --2- 172.21.15.79:0/1806506008 >> v2:172.21.15.189:3300/0 conn(0x7f7788038720 0x7f7788006ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f77971a5640 1 --2- 172.21.15.79:0/1806506008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7788048040 0x7f778804fa90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f77971a5640 1 -- 172.21.15.79:0/1806506008 >> 172.21.15.79:0/1806506008 conn(0x7f7788009fb0 msgr2=0x7f778800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f1191d3b640 1 --2- 172.21.15.79:0/744521533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1184005e90 0x7f11840062d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f11840528a0 tx=0x7f117802a280 comp rx=0 tx=0).stop 2024-04-25T02:08:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/362198059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e0004fa90 msgr2=0x7f8e0004fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f8e0d1ba640 1 --2- 172.21.15.79:0/362198059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e0004fa90 0x7f8e0004fe70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0091e0 tx=0x7f8dfc02a320 comp rx=0 tx=0).stop 2024-04-25T02:08:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7fb555d9b640 1 --2- 172.21.15.79:0/2825013706 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55806b7d0 0x7fb5580ce560 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb550009e50 tx=0x7fb55002a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=929887306d47476f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/362198059 shutdown_connections 2024-04-25T02:08:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f8e0d1ba640 1 --2- 172.21.15.79:0/362198059 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e000df420 0x7f8e000382c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f8e0d1ba640 1 --2- 172.21.15.79:0/362198059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e0004fa90 0x7f8e0004fe70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/362198059 >> 172.21.15.79:0/362198059 conn(0x7f8e00009fb0 msgr2=0x7f8e0000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f77971a5640 1 -- 172.21.15.79:0/1806506008 shutdown_connections 2024-04-25T02:08:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f1191d3b640 1 -- 172.21.15.79:0/744521533 shutdown_connections 2024-04-25T02:08:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f1191d3b640 1 --2- 172.21.15.79:0/744521533 >> v2:172.21.15.189:3300/0 conn(0x7f1184006810 0x7f1184006c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f1191d3b640 1 --2- 172.21.15.79:0/744521533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1184005e90 0x7f11840062d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f1191d3b640 1 -- 172.21.15.79:0/744521533 >> 172.21.15.79:0/744521533 conn(0x7f1184009fb0 msgr2=0x7f118400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7fbf1911b640 1 --2- 172.21.15.79:0/3626566329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf140cfd30 0x7fbf140d20c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c009d90 tx=0x7fbf0c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19ca74320dfe5ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7fbc07501640 1 -- 172.21.15.79:0/2478282850 shutdown_connections 2024-04-25T02:08:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7fbc07501640 1 --2- 172.21.15.79:0/2478282850 >> v2:172.21.15.79:3300/0 conn(0x7fbc000b32c0 0x7fbc000cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7fbc07501640 1 --2- 172.21.15.79:0/2478282850 >> v2:172.21.15.189:3300/0 conn(0x7fbc000b2d70 0x7fbc000d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7fbc07501640 1 --2- 172.21.15.79:0/2478282850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc0015e200 0x7fbc000d0970 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7fbc07501640 1 -- 172.21.15.79:0/2478282850 >> 172.21.15.79:0/2478282850 conn(0x7fbc000d3f80 msgr2=0x7fbc000d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7fbc07501640 1 -- 172.21.15.79:0/2478282850 shutdown_connections 2024-04-25T02:08:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f1b4890e640 1 -- 172.21.15.79:0/496413977 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b440b3070 msgr2=0x7f1b440b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f1b4890e640 1 --2- 172.21.15.79:0/496413977 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b440b3070 0x7f1b440b3f90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800d7b0 tx=0x7f1b3802c4f0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7fbc07501640 1 -- 172.21.15.79:0/2478282850 wait complete. 2024-04-25T02:08:04.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7fbf137fe640 1 -- 172.21.15.79:0/3626566329 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c007740 con 0x7fbf140cfd30 2024-04-25T02:08:04.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7fbf137fe640 1 -- 172.21.15.79:0/3626566329 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0078e0 con 0x7fbf140cfd30 2024-04-25T02:08:04.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7fbf137fe640 1 -- 172.21.15.79:0/3626566329 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c007cb0 con 0x7fbf140cfd30 2024-04-25T02:08:04.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f1b4890e640 1 -- 172.21.15.79:0/496413977 shutdown_connections 2024-04-25T02:08:04.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f1b4890e640 1 --2- 172.21.15.79:0/496413977 >> v2:172.21.15.79:3300/0 conn(0x7f1b44070e80 0x7f1b44071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f1b4890e640 1 --2- 172.21.15.79:0/496413977 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b440b3070 0x7f1b440b3f90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f1b4890e640 1 -- 172.21.15.79:0/496413977 >> 172.21.15.79:0/496413977 conn(0x7f1b440b18b0 msgr2=0x7f1b440b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7fb55559a640 1 -- 172.21.15.79:0/2825013706 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550036070 con 0x7fb55806b7d0 2024-04-25T02:08:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7fb55559a640 1 -- 172.21.15.79:0/2825013706 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb550031600 con 0x7fb55806b7d0 2024-04-25T02:08:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f1b4890e640 1 -- 172.21.15.79:0/496413977 shutdown_connections 2024-04-25T02:08:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f1b4890e640 1 -- 172.21.15.79:0/496413977 wait complete. 2024-04-25T02:08:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f32b8329640 1 -- 172.21.15.79:0/1765501819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f329c0051c0 msgr2=0x7f329c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f32b8329640 1 --2- 172.21.15.79:0/1765501819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f329c0051c0 0x7f329c00b9c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f32ac007ef0 tx=0x7f329c005830 comp rx=0 tx=0).stop 2024-04-25T02:08:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f32b8329640 1 -- 172.21.15.79:0/1765501819 shutdown_connections 2024-04-25T02:08:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f32b8329640 1 --2- 172.21.15.79:0/1765501819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f329c0051c0 0x7f329c00b9c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f32b8329640 1 -- 172.21.15.79:0/1765501819 >> 172.21.15.79:0/1765501819 conn(0x7f32b006b290 msgr2=0x7f32b006b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f32b8329640 1 -- 172.21.15.79:0/1765501819 shutdown_connections 2024-04-25T02:08:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.925+0000 7f77971a5640 1 -- 172.21.15.79:0/1806506008 wait complete. 2024-04-25T02:08:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7fbf1ab7e640 1 -- 172.21.15.79:0/3626566329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf140cfd30 msgr2=0x7fbf140d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7fbf1ab7e640 1 --2- 172.21.15.79:0/3626566329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf140cfd30 0x7fbf140d20c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c009d90 tx=0x7fbf0c02a6f0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7fb55c8f5640 1 -- 172.21.15.79:0/2825013706 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55806b7d0 msgr2=0x7fb5580ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7fb55c8f5640 1 --2- 172.21.15.79:0/2825013706 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55806b7d0 0x7fb5580ce560 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb550009e50 tx=0x7fb55002a730 comp rx=0 tx=0).stop 2024-04-25T02:08:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/362198059 shutdown_connections 2024-04-25T02:08:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/362198059 wait complete. 2024-04-25T02:08:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7fbf1ab7e640 1 -- 172.21.15.79:0/3626566329 shutdown_connections 2024-04-25T02:08:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7fbf1ab7e640 1 --2- 172.21.15.79:0/3626566329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf140cfd30 0x7fbf140d20c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7fbf1ab7e640 1 -- 172.21.15.79:0/3626566329 >> 172.21.15.79:0/3626566329 conn(0x7fbf1409d200 msgr2=0x7fbf140d3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7fbf1ab7e640 1 -- 172.21.15.79:0/3626566329 shutdown_connections 2024-04-25T02:08:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7fbf1ab7e640 1 -- 172.21.15.79:0/3626566329 wait complete. 2024-04-25T02:08:04.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7fbc07501640 1 Processor -- start 2024-04-25T02:08:04.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7fbc07501640 1 -- start start 2024-04-25T02:08:04.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7fb55c8f5640 1 -- 172.21.15.79:0/2825013706 shutdown_connections 2024-04-25T02:08:04.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7fb55c8f5640 1 --2- 172.21.15.79:0/2825013706 >> v2:172.21.15.189:3300/0 conn(0x7fb5580d0510 0x7fb5580b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7fb55c8f5640 1 --2- 172.21.15.79:0/2825013706 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55806b7d0 0x7fb5580ce560 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:04.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7fb55c8f5640 1 -- 172.21.15.79:0/2825013706 >> 172.21.15.79:0/2825013706 conn(0x7fb5580d4330 msgr2=0x7fb5580d4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:04.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7fb55c8f5640 1 -- 172.21.15.79:0/2825013706 shutdown_connections 2024-04-25T02:08:04.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7f77971a5640 1 Processor -- start 2024-04-25T02:08:04.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7f77971a5640 1 -- start start 2024-04-25T02:08:04.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.927+0000 7fb55c8f5640 1 -- 172.21.15.79:0/2825013706 wait complete. 2024-04-25T02:08:04.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.926+0000 7f32b8329640 1 -- 172.21.15.79:0/1765501819 wait complete. 2024-04-25T02:08:04.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.928+0000 7f32b8329640 1 Processor -- start 2024-04-25T02:08:04.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.928+0000 7f1b4890e640 1 Processor -- start 2024-04-25T02:08:04.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.928+0000 7f1b4890e640 1 -- start start 2024-04-25T02:08:04.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f8e0d1ba640 1 Processor -- start 2024-04-25T02:08:04.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f8e0d1ba640 1 -- start start 2024-04-25T02:08:04.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.928+0000 7f1191d3b640 1 -- 172.21.15.79:0/744521533 shutdown_connections 2024-04-25T02:08:04.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.928+0000 7fbf1ab7e640 1 Processor -- start 2024-04-25T02:08:04.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7fbf1ab7e640 1 -- start start 2024-04-25T02:08:04.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.928+0000 7fbc07501640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc000b2d70 0x7fbc0015ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.928+0000 7fbc07501640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc000b32c0 0x7fbc000b5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.928+0000 7fbc07501640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc0015e200 0x7fbc000b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:04.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.928+0000 7fbc07501640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc000cff10 con 0x7fbc000b32c0 2024-04-25T02:08:04.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.928+0000 7fbc07501640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbc000d3040 con 0x7fbc000b2d70 2024-04-25T02:08:04.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.928+0000 7fbc07501640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbc000d0090 con 0x7fbc0015e200 2024-04-25T02:08:04.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7fbc05cfe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc000b32c0 0x7fbc000b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7fbc05cfe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc000b32c0 0x7fbc000b5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34960/0 (socket says 172.21.15.79:34960) 2024-04-25T02:08:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7fbc05cfe640 1 -- 172.21.15.79:0/638685985 learned_addr learned my addr 172.21.15.79:0/638685985 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7fbc064ff640 1 --2- 172.21.15.79:0/638685985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc000b2d70 0x7fbc0015ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7fbc06d00640 1 --2- 172.21.15.79:0/638685985 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc0015e200 0x7fbc000b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f77971a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7788037bb0 0x7f77880d5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f77971a5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7788038720 0x7f778804bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f77971a5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7788048040 0x7f778804dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f77971a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7788054280 con 0x7f7788037bb0 2024-04-25T02:08:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f77971a5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7788053fa0 con 0x7f7788038720 2024-04-25T02:08:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f77971a5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f778804ffd0 con 0x7f7788048040 2024-04-25T02:08:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f778ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7788038720 0x7f778804bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f778ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7788038720 0x7f778804bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:36280/0 (socket says 172.21.15.79:36280) 2024-04-25T02:08:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f778ffff640 1 -- 172.21.15.79:0/556493574 learned_addr learned my addr 172.21.15.79:0/556493574 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f7795742640 1 --2- 172.21.15.79:0/556493574 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7788048040 0x7f778804dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.928+0000 7f32b8329640 1 -- start start 2024-04-25T02:08:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f32b8329640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f329c0051c0 0x7f32b00a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f32b8329640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32b00b1110 0x7f32b01f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f32b8329640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32b00aa000 0x7f32b00aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f32b8329640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f32b00cfd00 con 0x7f329c0051c0 2024-04-25T02:08:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f32b60c5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f329c0051c0 0x7f32b00a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.928+0000 7f1191d3b640 1 -- 172.21.15.79:0/744521533 wait complete. 2024-04-25T02:08:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7fbc064ff640 1 -- 172.21.15.79:0/638685985 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc0015e200 msgr2=0x7fbc000b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f32b60c5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f329c0051c0 0x7f32b00a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34984/0 (socket says 172.21.15.79:34984) 2024-04-25T02:08:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f32b68c6640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32b00aa000 0x7f32b00aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f1191d3b640 1 Processor -- start 2024-04-25T02:08:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f1b4890e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b44070e80 0x7f1b441ef3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f32b68c6640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32b00aa000 0x7f32b00aa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49442/0 (socket says 172.21.15.79:49442) 2024-04-25T02:08:05.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f32b68c6640 1 -- 172.21.15.79:0/3108122681 learned_addr learned my addr 172.21.15.79:0/3108122681 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:05.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f32b8329640 1 -- 172.21.15.79:0/3108122681 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f32b00b4df0 con 0x7f32b00b1110 2024-04-25T02:08:05.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f32b8329640 1 -- 172.21.15.79:0/3108122681 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f32b00cfe80 con 0x7f32b00aa000 2024-04-25T02:08:05.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f1b4890e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b440b3070 0x7f1b440c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f778ffff640 1 -- 172.21.15.79:0/556493574 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7788048040 msgr2=0x7f778804dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f778ffff640 1 --2- 172.21.15.79:0/556493574 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7788048040 0x7f778804dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f778ffff640 1 -- 172.21.15.79:0/556493574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7788037bb0 msgr2=0x7f77880d5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f778ffff640 1 --2- 172.21.15.79:0/556493574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7788037bb0 0x7f77880d5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7f778ffff640 1 -- 172.21.15.79:0/556493574 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f778804c3c0 con 0x7f7788038720 2024-04-25T02:08:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f1b437fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b44070e80 0x7f1b441ef3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f1b437fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b44070e80 0x7f1b441ef3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49456/0 (socket says 172.21.15.79:49456) 2024-04-25T02:08:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f1b437fe640 1 -- 172.21.15.79:0/1120969658 learned_addr learned my addr 172.21.15.79:0/1120969658 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f778ffff640 1 --2- 172.21.15.79:0/556493574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7788038720 0x7f778804bb90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f777c00c480 tx=0x7f777c00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f1191d3b640 1 -- start start 2024-04-25T02:08:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f1b4890e640 1 --2- 172.21.15.79:0/1120969658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b44143b50 0x7f1b440c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f32b58c4640 1 --2- 172.21.15.79:0/3108122681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32b00b1110 0x7f32b01f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f1b4890e640 1 -- 172.21.15.79:0/1120969658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b440b23d0 con 0x7f1b440b3070 2024-04-25T02:08:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f1b42ffd640 1 --2- 172.21.15.79:0/1120969658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b440b3070 0x7f1b440c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f1b4890e640 1 -- 172.21.15.79:0/1120969658 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4406d670 con 0x7f1b44143b50 2024-04-25T02:08:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f1b4890e640 1 -- 172.21.15.79:0/1120969658 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1b440b2550 con 0x7f1b44070e80 2024-04-25T02:08:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f1b43fff640 1 --2- 172.21.15.79:0/1120969658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b44143b50 0x7f1b440c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7fbf1ab7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf140cfd30 0x7fbf140b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7fbf1ab7e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf14161620 0x7fbf140b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7fbf1ab7e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf14161a00 0x7fbf141576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7fb55c8f5640 1 Processor -- start 2024-04-25T02:08:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7fb55c8f5640 1 -- start start 2024-04-25T02:08:05.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7fbf1ab7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf140d2ee0 con 0x7fbf140cfd30 2024-04-25T02:08:05.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7fbf1ab7e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbf140d2d60 con 0x7fbf14161620 2024-04-25T02:08:05.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f8e0d1ba640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e00038800 0x7f8e000e1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7fbf1ab7e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbf141691d0 con 0x7fbf14161a00 2024-04-25T02:08:05.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f778d7fa640 1 -- 172.21.15.79:0/556493574 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c018070 con 0x7f7788038720 2024-04-25T02:08:05.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f778d7fa640 1 -- 172.21.15.79:0/556493574 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f777c0074e0 con 0x7f7788038720 2024-04-25T02:08:05.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f1b437fe640 1 -- 172.21.15.79:0/1120969658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b44143b50 msgr2=0x7f1b440c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f778d7fa640 1 -- 172.21.15.79:0/556493574 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c004a20 con 0x7f7788038720 2024-04-25T02:08:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f77971a5640 1 -- 172.21.15.79:0/556493574 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f778804c6a0 con 0x7f7788038720 2024-04-25T02:08:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7f77971a5640 1 -- 172.21.15.79:0/556493574 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f778804cc60 con 0x7f7788038720 2024-04-25T02:08:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f1b437fe640 1 --2- 172.21.15.79:0/1120969658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b44143b50 0x7f1b440c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f8e0d1ba640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e0004fa90 0x7f8e000dd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f1b437fe640 1 -- 172.21.15.79:0/1120969658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b440b3070 msgr2=0x7f1b440c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f1b437fe640 1 --2- 172.21.15.79:0/1120969658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b440b3070 0x7f1b440c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f8e07fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e00038800 0x7f8e000e1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f8e07fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e00038800 0x7f8e000e1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:36314/0 (socket says 172.21.15.79:36314) 2024-04-25T02:08:05.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7fbf1911b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf14161a00 0x7fbf141576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f1b437fe640 1 -- 172.21.15.79:0/1120969658 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b440c57c0 con 0x7f1b44070e80 2024-04-25T02:08:05.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f8e0d1ba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e000df420 0x7f8e000d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f8e077fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e0004fa90 0x7f8e000dd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f8e077fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e0004fa90 0x7f8e000dd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49468/0 (socket says 172.21.15.79:49468) 2024-04-25T02:08:05.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f8e07fff640 1 -- 172.21.15.79:0/3345564810 learned_addr learned my addr 172.21.15.79:0/3345564810 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:05.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7fbf1891a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf140cfd30 0x7fbf140b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7fbf1891a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf140cfd30 0x7fbf140b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34998/0 (socket says 172.21.15.79:34998) 2024-04-25T02:08:05.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7fbf1891a640 1 -- 172.21.15.79:0/850443735 learned_addr learned my addr 172.21.15.79:0/850443735 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:05.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f32b60c5640 1 -- 172.21.15.79:0/3108122681 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32b00aa000 msgr2=0x7f32b00aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f32b60c5640 1 --2- 172.21.15.79:0/3108122681 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32b00aa000 0x7f32b00aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f32b60c5640 1 -- 172.21.15.79:0/3108122681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32b00b1110 msgr2=0x7f32b01f72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f32b60c5640 1 --2- 172.21.15.79:0/3108122681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32b00b1110 0x7f32b01f72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f32b60c5640 1 -- 172.21.15.79:0/3108122681 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b015c520 con 0x7f329c0051c0 2024-04-25T02:08:05.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f8e0c9b9640 1 --2- 172.21.15.79:0/3345564810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e000df420 0x7f8e000d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/3345564810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e00052b40 con 0x7f8e000df420 2024-04-25T02:08:05.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/3345564810 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8e00007390 con 0x7f8e00038800 2024-04-25T02:08:05.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/3345564810 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8e00052cc0 con 0x7f8e0004fa90 2024-04-25T02:08:05.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7fbc064ff640 1 --2- 172.21.15.79:0/638685985 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc0015e200 0x7fbc000b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7fbc064ff640 1 -- 172.21.15.79:0/638685985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc000b32c0 msgr2=0x7fbc000b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7fbc064ff640 1 --2- 172.21.15.79:0/638685985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc000b32c0 0x7fbc000b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.929+0000 7fbc064ff640 1 -- 172.21.15.79:0/638685985 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc000b8440 con 0x7fbc000b2d70 2024-04-25T02:08:05.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.930+0000 7fbc06d00640 1 --2- 172.21.15.79:0/638685985 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc0015e200 0x7fbc000b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:05.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7fbc064ff640 1 --2- 172.21.15.79:0/638685985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc000b2d70 0x7fbc0015ab60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc031000 tx=0x7fbbfc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7fbbf6ffd640 1 -- 172.21.15.79:0/638685985 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc041020 con 0x7fbc000b2d70 2024-04-25T02:08:05.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f1191d3b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1184005e90 0x7f118402b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7fbbf6ffd640 1 -- 172.21.15.79:0/638685985 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbfc03d640 con 0x7fbc000b2d70 2024-04-25T02:08:05.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7fbbf6ffd640 1 -- 172.21.15.79:0/638685985 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc037040 con 0x7fbc000b2d70 2024-04-25T02:08:05.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.931+0000 7f1191d3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1184006810 0x7f1184185750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb55c8f5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55806b7d0 0x7fb5581d9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f1191d3b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11840ead00 0x7f1184189560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb55c8f5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb55809c370 0x7fb5580a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f77971a5640 1 -- 172.21.15.79:0/556493574 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7770005290 con 0x7f7788038720 2024-04-25T02:08:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f118b7fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1184005e90 0x7f118402b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f1191d3b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f11840547c0 con 0x7f1184006810 2024-04-25T02:08:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f1191d3b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f11840501a0 con 0x7f11840ead00 2024-04-25T02:08:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f1191d3b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1184054940 con 0x7f1184005e90 2024-04-25T02:08:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f118b7fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1184005e90 0x7f118402b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49472/0 (socket says 172.21.15.79:49472) 2024-04-25T02:08:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f118b7fe640 1 -- 172.21.15.79:0/574563214 learned_addr learned my addr 172.21.15.79:0/574563214 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f118affd640 1 --2- 172.21.15.79:0/574563214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1184006810 0x7f1184185750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f118bfff640 1 --2- 172.21.15.79:0/574563214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11840ead00 0x7f1184189560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fbf13fff640 1 --2- 172.21.15.79:0/850443735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf14161620 0x7fbf140b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fbf1891a640 1 -- 172.21.15.79:0/850443735 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf14161a00 msgr2=0x7fbf141576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fbf1891a640 1 --2- 172.21.15.79:0/850443735 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf14161a00 0x7fbf141576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fbf1891a640 1 -- 172.21.15.79:0/850443735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf14161620 msgr2=0x7fbf140b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fbf1891a640 1 --2- 172.21.15.79:0/850443735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf14161620 0x7fbf140b3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fbf1891a640 1 -- 172.21.15.79:0/850443735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf140cd2c0 con 0x7fbf140cfd30 2024-04-25T02:08:05.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fbf1911b640 1 --2- 172.21.15.79:0/850443735 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf14161a00 0x7fbf141576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:05.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb55c8f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5580d0510 0x7fb5580b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb55c8f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb55806c2f0 con 0x7fb5580d0510 2024-04-25T02:08:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb55c8f5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb55806c170 con 0x7fb55809c370 2024-04-25T02:08:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb55c8f5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb5580b8ae0 con 0x7fb55806b7d0 2024-04-25T02:08:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb556d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5580d0510 0x7fb5580b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb556d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5580d0510 0x7fb5580b4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35032/0 (socket says 172.21.15.79:35032) 2024-04-25T02:08:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb556d9d640 1 -- 172.21.15.79:0/35013071 learned_addr learned my addr 172.21.15.79:0/35013071 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb55659c640 1 --2- 172.21.15.79:0/35013071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55806b7d0 0x7fb5581d9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f118b7fe640 1 -- 172.21.15.79:0/574563214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11840ead00 msgr2=0x7f1184189560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f118b7fe640 1 --2- 172.21.15.79:0/574563214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11840ead00 0x7f1184189560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f118b7fe640 1 -- 172.21.15.79:0/574563214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1184006810 msgr2=0x7f1184185750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f118b7fe640 1 --2- 172.21.15.79:0/574563214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1184006810 0x7f1184185750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f118b7fe640 1 -- 172.21.15.79:0/574563214 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11840da7e0 con 0x7f1184005e90 2024-04-25T02:08:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb555d9b640 1 --2- 172.21.15.79:0/35013071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb55809c370 0x7fb5580a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f32b60c5640 1 --2- 172.21.15.79:0/3108122681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f329c0051c0 0x7f32b00a94d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f32a8005ba0 tx=0x7f32a8008430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f8e0c9b9640 1 -- 172.21.15.79:0/3345564810 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e0004fa90 msgr2=0x7f8e000dd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f8e0c9b9640 1 --2- 172.21.15.79:0/3345564810 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e0004fa90 0x7f8e000dd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f8e0c9b9640 1 -- 172.21.15.79:0/3345564810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e00038800 msgr2=0x7f8e000e1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f8e0c9b9640 1 --2- 172.21.15.79:0/3345564810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e00038800 0x7f8e000e1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f8e0c9b9640 1 -- 172.21.15.79:0/3345564810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e000d2c10 con 0x7f8e000df420 2024-04-25T02:08:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7f118b7fe640 1 --2- 172.21.15.79:0/574563214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1184005e90 0x7f118402b470 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f118c000b60 tx=0x7f118c068cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fbc07501640 1 -- 172.21.15.79:0/638685985 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc000b8720 con 0x7fbc000b2d70 2024-04-25T02:08:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fbc07501640 1 -- 172.21.15.79:0/638685985 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc000b8ce0 con 0x7fbc000b2d70 2024-04-25T02:08:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7f1b437fe640 1 --2- 172.21.15.79:0/1120969658 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b44070e80 0x7f1b441ef3c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400c4a0 tx=0x7f1b3400c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7f32a6ffd640 1 -- 172.21.15.79:0/3108122681 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a80143f0 con 0x7f329c0051c0 2024-04-25T02:08:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7f1b2bfff640 1 -- 172.21.15.79:0/1120969658 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34018070 con 0x7f1b44070e80 2024-04-25T02:08:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7f1b2bfff640 1 -- 172.21.15.79:0/1120969658 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b340074e0 con 0x7f1b44070e80 2024-04-25T02:08:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb556d9d640 1 -- 172.21.15.79:0/35013071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55806b7d0 msgr2=0x7fb5581d9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb556d9d640 1 --2- 172.21.15.79:0/35013071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55806b7d0 0x7fb5581d9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb556d9d640 1 -- 172.21.15.79:0/35013071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb55809c370 msgr2=0x7fb5580a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb556d9d640 1 --2- 172.21.15.79:0/35013071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb55809c370 0x7fb5580a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb556d9d640 1 -- 172.21.15.79:0/35013071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5581d9c60 con 0x7fb5580d0510 2024-04-25T02:08:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.932+0000 7fb55659c640 1 --2- 172.21.15.79:0/35013071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55806b7d0 0x7fb5581d9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7fb556d9d640 1 --2- 172.21.15.79:0/35013071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5580d0510 0x7fb5580b4780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00b410 tx=0x7fb54c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7f32b8329640 1 -- 172.21.15.79:0/3108122681 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b015c800 con 0x7f329c0051c0 2024-04-25T02:08:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7f32b8329640 1 -- 172.21.15.79:0/3108122681 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b015cdc0 con 0x7f329c0051c0 2024-04-25T02:08:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7f32a6ffd640 1 -- 172.21.15.79:0/3108122681 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a8019070 con 0x7f329c0051c0 2024-04-25T02:08:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7f32a6ffd640 1 -- 172.21.15.79:0/3108122681 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a80147d0 con 0x7f329c0051c0 2024-04-25T02:08:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7f1b2bfff640 1 -- 172.21.15.79:0/1120969658 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34004a20 con 0x7f1b44070e80 2024-04-25T02:08:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7f1b4890e640 1 -- 172.21.15.79:0/1120969658 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b440c5aa0 con 0x7f1b44070e80 2024-04-25T02:08:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7f8e0c9b9640 1 --2- 172.21.15.79:0/3345564810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e000df420 0x7f8e000d0d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8e08068890 tx=0x7f8e08068670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7f8e04ff9640 1 -- 172.21.15.79:0/3345564810 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e080736a0 con 0x7f8e000df420 2024-04-25T02:08:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/3345564810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e000e1f60 con 0x7f8e000df420 2024-04-25T02:08:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7f1177fff640 1 -- 172.21.15.79:0/574563214 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c0732b0 con 0x7f1184005e90 2024-04-25T02:08:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7f1177fff640 1 -- 172.21.15.79:0/574563214 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f118c073450 con 0x7f1184005e90 2024-04-25T02:08:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7f1191d3b640 1 -- 172.21.15.79:0/574563214 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118402b9b0 con 0x7f1184005e90 2024-04-25T02:08:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7f1191d3b640 1 -- 172.21.15.79:0/574563214 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1184179b50 con 0x7f1184005e90 2024-04-25T02:08:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7f1177fff640 1 -- 172.21.15.79:0/574563214 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c071720 con 0x7f1184005e90 2024-04-25T02:08:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7fbf1891a640 1 --2- 172.21.15.79:0/850443735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf140cfd30 0x7fbf140b1400 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800c450 tx=0x7fbf0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7fbc07501640 1 -- 172.21.15.79:0/638685985 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc000a1ed0 con 0x7fbc000b2d70 2024-04-25T02:08:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.933+0000 7f778d7fa640 1 -- 172.21.15.79:0/556493574 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f777c01b070 con 0x7f7788038720 2024-04-25T02:08:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7f778d7fa640 1 --2- 172.21.15.79:0/556493574 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f777406bf30 0x7f777406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7f778d7fa640 1 -- 172.21.15.79:0/556493574 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f777c08a950 con 0x7f7788038720 2024-04-25T02:08:05.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7f1b4890e640 1 -- 172.21.15.79:0/1120969658 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b440c6060 con 0x7f1b44070e80 2024-04-25T02:08:05.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/3345564810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e000e24e0 con 0x7f8e000df420 2024-04-25T02:08:05.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7fb546ffd640 1 -- 172.21.15.79:0/35013071 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c015020 con 0x7fb5580d0510 2024-04-25T02:08:05.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7fb546ffd640 1 -- 172.21.15.79:0/35013071 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54c011830 con 0x7fb5580d0510 2024-04-25T02:08:05.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7fbf117fa640 1 -- 172.21.15.79:0/850443735 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf080052d0 con 0x7fbf140cfd30 2024-04-25T02:08:05.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7f1191d3b640 1 -- 172.21.15.79:0/574563214 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1184005390 con 0x7f1184005e90 2024-04-25T02:08:05.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7fbf1ab7e640 1 -- 172.21.15.79:0/850443735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf140cd5a0 con 0x7fbf140cfd30 2024-04-25T02:08:05.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.934+0000 7fbf1ab7e640 1 -- 172.21.15.79:0/850443735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf140cdb60 con 0x7fbf140cfd30 2024-04-25T02:08:05.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.935+0000 7f7794f41640 1 --2- 172.21.15.79:0/556493574 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f777406bf30 0x7f777406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.935+0000 7f1177fff640 1 -- 172.21.15.79:0/574563214 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f118c0718c0 con 0x7f1184005e90 2024-04-25T02:08:05.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.935+0000 7fb546ffd640 1 -- 172.21.15.79:0/35013071 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c011c20 con 0x7fb5580d0510 2024-04-25T02:08:05.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.935+0000 7fb55c8f5640 1 -- 172.21.15.79:0/35013071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5581d9f40 con 0x7fb5580d0510 2024-04-25T02:08:05.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.935+0000 7fb55c8f5640 1 -- 172.21.15.79:0/35013071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5581da500 con 0x7fb5580d0510 2024-04-25T02:08:05.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.936+0000 7fbf117fa640 1 -- 172.21.15.79:0/850443735 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf08005470 con 0x7fbf140cfd30 2024-04-25T02:08:05.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.936+0000 7fbf117fa640 1 -- 172.21.15.79:0/850443735 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08012870 con 0x7fbf140cfd30 2024-04-25T02:08:05.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.936+0000 7f1b4890e640 1 -- 172.21.15.79:0/1120969658 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b44073150 con 0x7f1b44070e80 2024-04-25T02:08:05.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.935+0000 7f32b8329640 1 -- 172.21.15.79:0/3108122681 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3298005290 con 0x7f329c0051c0 2024-04-25T02:08:05.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.936+0000 7f1177fff640 1 --2- 172.21.15.79:0/574563214 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f117006be80 0x7f117006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.936+0000 7f1177fff640 1 -- 172.21.15.79:0/574563214 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f118c105d40 con 0x7f1184005e90 2024-04-25T02:08:05.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.936+0000 7f32a6ffd640 1 -- 172.21.15.79:0/3108122681 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32a8014970 con 0x7f329c0051c0 2024-04-25T02:08:05.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.936+0000 7f7794f41640 1 --2- 172.21.15.79:0/556493574 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f777406bf30 0x7f777406e3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7784034000 tx=0x7f778402c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.936+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/3345564810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e000089d0 con 0x7f8e000df420 2024-04-25T02:08:05.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.936+0000 7f8e04ff9640 1 -- 172.21.15.79:0/3345564810 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e08090410 con 0x7f8e000df420 2024-04-25T02:08:05.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.936+0000 7f8e04ff9640 1 -- 172.21.15.79:0/3345564810 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0809d020 con 0x7f8e000df420 2024-04-25T02:08:05.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.937+0000 7f8e04ff9640 1 -- 172.21.15.79:0/3345564810 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e08090920 con 0x7f8e000df420 2024-04-25T02:08:05.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.937+0000 7f32a6ffd640 1 --2- 172.21.15.79:0/3108122681 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f329406be60 0x7f329406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.937+0000 7f118affd640 1 --2- 172.21.15.79:0/574563214 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f117006be80 0x7f117006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.937+0000 7f32a6ffd640 1 -- 172.21.15.79:0/3108122681 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f32a808b690 con 0x7f329c0051c0 2024-04-25T02:08:05.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.937+0000 7fb55c8f5640 1 -- 172.21.15.79:0/35013071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb55804f500 con 0x7fb5580d0510 2024-04-25T02:08:05.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.937+0000 7f1b2bfff640 1 -- 172.21.15.79:0/1120969658 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b3401b070 con 0x7f1b44070e80 2024-04-25T02:08:05.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.937+0000 7f8e04ff9640 1 --2- 172.21.15.79:0/3345564810 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8dec06be30 0x7f8dec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.937+0000 7f8e04ff9640 1 -- 172.21.15.79:0/3345564810 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8e0810a1c0 con 0x7f8e000df420 2024-04-25T02:08:05.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.937+0000 7fbf1ab7e640 1 -- 172.21.15.79:0/850443735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef4005290 con 0x7fbf140cfd30 2024-04-25T02:08:05.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.937+0000 7f8e07fff640 1 --2- 172.21.15.79:0/3345564810 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8dec06be30 0x7f8dec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.937+0000 7f32b58c4640 1 --2- 172.21.15.79:0/3108122681 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f329406be60 0x7f329406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.937+0000 7f118affd640 1 --2- 172.21.15.79:0/574563214 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f117006be80 0x7f117006e340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1178034000 tx=0x7f117802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.938+0000 7f1b2bfff640 1 --2- 172.21.15.79:0/1120969658 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b3006be80 0x7f1b3006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.938+0000 7f1b42ffd640 1 --2- 172.21.15.79:0/1120969658 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b3006be80 0x7f1b3006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.938+0000 7f778d7fa640 1 -- 172.21.15.79:0/556493574 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f777c058d20 con 0x7f7788038720 2024-04-25T02:08:05.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.938+0000 7f8e07fff640 1 --2- 172.21.15.79:0/3345564810 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8dec06be30 0x7f8dec06e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0091e0 tx=0x7f8dfc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.938+0000 7f1b2bfff640 1 -- 172.21.15.79:0/1120969658 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1b3408a920 con 0x7f1b44070e80 2024-04-25T02:08:05.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.938+0000 7fb546ffd640 1 -- 172.21.15.79:0/35013071 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb54c018020 con 0x7fb5580d0510 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.938+0000 7f1b42ffd640 1 --2- 172.21.15.79:0/1120969658 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b3006be80 0x7f1b3006e340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b38035000 tx=0x7f1b38008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.939+0000 7f32b58c4640 1 --2- 172.21.15.79:0/3108122681 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f329406be60 0x7f329406e320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f32b0160460 tx=0x7f32a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.939+0000 7fb546ffd640 1 --2- 172.21.15.79:0/35013071 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb53806beb0 0x7fb53806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.939+0000 7fb55659c640 1 --2- 172.21.15.79:0/35013071 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb53806beb0 0x7fb53806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.939+0000 7fbbf6ffd640 1 -- 172.21.15.79:0/638685985 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbbfc044020 con 0x7fbc000b2d70 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.939+0000 7fb546ffd640 1 -- 172.21.15.79:0/35013071 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb54c08ac80 con 0x7fb5580d0510 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.939+0000 7fb55659c640 1 --2- 172.21.15.79:0/35013071 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb53806beb0 0x7fb53806e370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb548000f60 tx=0x7fb548009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.939+0000 7fbf117fa640 1 -- 172.21.15.79:0/850443735 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf08012a10 con 0x7fbf140cfd30 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.939+0000 7fbbf6ffd640 1 --2- 172.21.15.79:0/638685985 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbbe406bf30 0x7fbbe406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.940+0000 7fbbf6ffd640 1 -- 172.21.15.79:0/638685985 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbbfc0ab810 con 0x7fbc000b2d70 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.940+0000 7fbf117fa640 1 --2- 172.21.15.79:0/850443735 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbef806be30 0x7fbef806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.940+0000 7fbc05cfe640 1 --2- 172.21.15.79:0/638685985 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbbe406bf30 0x7fbbe406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.940+0000 7fbf13fff640 1 --2- 172.21.15.79:0/850443735 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbef806be30 0x7fbef806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.940+0000 7fbf117fa640 1 -- 172.21.15.79:0/850443735 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbf0808b3c0 con 0x7fbf140cfd30 2024-04-25T02:08:05.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.940+0000 7fbc05cfe640 1 --2- 172.21.15.79:0/638685985 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbbe406bf30 0x7fbbe406e3f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc000b6a50 tx=0x7fbbf0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.940+0000 7fbf13fff640 1 --2- 172.21.15.79:0/850443735 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbef806be30 0x7fbef806e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbf140ca900 tx=0x7fbf00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.941+0000 7f1177fff640 1 -- 172.21.15.79:0/574563214 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f11840da7e0 con 0x7f1184005e90 2024-04-25T02:08:05.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.943+0000 7fbbf6ffd640 1 -- 172.21.15.79:0/638685985 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbbfc04b030 con 0x7fbc000b2d70 2024-04-25T02:08:05.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.945+0000 7f1b2bfff640 1 -- 172.21.15.79:0/1120969658 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1b34058cd0 con 0x7f1b44070e80 2024-04-25T02:08:05.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.947+0000 7f32a6ffd640 1 -- 172.21.15.79:0/3108122681 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f32a80599f0 con 0x7f329c0051c0 2024-04-25T02:08:05.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.956+0000 7fbf117fa640 1 -- 172.21.15.79:0/850443735 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbf08059e50 con 0x7fbf140cfd30 2024-04-25T02:08:05.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.965+0000 7f8e04ff9640 1 -- 172.21.15.79:0/3345564810 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8e000d2c10 con 0x7f8e000df420 2024-04-25T02:08:05.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:04.974+0000 7fb546ffd640 1 -- 172.21.15.79:0/35013071 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb54c01f020 con 0x7fb5580d0510 2024-04-25T02:08:05.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.354+0000 7f77971a5640 1 -- 172.21.15.79:0/556493574 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7770005850 con 0x7f7788038720 2024-04-25T02:08:05.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.355+0000 7f778d7fa640 1 -- 172.21.15.79:0/556493574 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f777c05f020 con 0x7f7788038720 2024-04-25T02:08:05.362 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-04-25T02:08:05.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.358+0000 7f777affd640 1 -- 172.21.15.79:0/556493574 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f777406bf30 msgr2=0x7f777406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.358+0000 7f777affd640 1 --2- 172.21.15.79:0/556493574 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f777406bf30 0x7f777406e3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7784034000 tx=0x7f778402c000 comp rx=0 tx=0).stop 2024-04-25T02:08:05.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.358+0000 7f777affd640 1 -- 172.21.15.79:0/556493574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7788038720 msgr2=0x7f778804bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.358+0000 7f777affd640 1 --2- 172.21.15.79:0/556493574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7788038720 0x7f778804bb90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f777c00c480 tx=0x7f777c00c940 comp rx=0 tx=0).stop 2024-04-25T02:08:05.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.358+0000 7f777affd640 1 -- 172.21.15.79:0/556493574 shutdown_connections 2024-04-25T02:08:05.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.358+0000 7f777affd640 1 --2- 172.21.15.79:0/556493574 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f777406bf30 0x7f777406e3f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.358+0000 7f777affd640 1 --2- 172.21.15.79:0/556493574 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7788048040 0x7f778804dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.358+0000 7f777affd640 1 --2- 172.21.15.79:0/556493574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7788038720 0x7f778804bb90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.358+0000 7f777affd640 1 --2- 172.21.15.79:0/556493574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7788037bb0 0x7f77880d5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.358+0000 7f777affd640 1 -- 172.21.15.79:0/556493574 >> 172.21.15.79:0/556493574 conn(0x7f7788009fb0 msgr2=0x7f778803a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:05.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.359+0000 7f777affd640 1 -- 172.21.15.79:0/556493574 shutdown_connections 2024-04-25T02:08:05.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.359+0000 7f777affd640 1 -- 172.21.15.79:0/556493574 wait complete. 2024-04-25T02:08:05.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.359+0000 7f1191d3b640 1 -- 172.21.15.79:0/574563214 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1184052e80 con 0x7f1184005e90 2024-04-25T02:08:05.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.360+0000 7f1177fff640 1 -- 172.21.15.79:0/574563214 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f118c08f030 con 0x7f1184005e90 2024-04-25T02:08:05.367 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-04-25T02:08:05.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.362+0000 7fbc07501640 1 -- 172.21.15.79:0/638685985 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fbc0004f5e0 con 0x7fbc000b2d70 2024-04-25T02:08:05.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.363+0000 7f1175ffb640 1 -- 172.21.15.79:0/574563214 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f117006be80 msgr2=0x7f117006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.363+0000 7f1175ffb640 1 --2- 172.21.15.79:0/574563214 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f117006be80 0x7f117006e340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1178034000 tx=0x7f117802e000 comp rx=0 tx=0).stop 2024-04-25T02:08:05.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.363+0000 7f1175ffb640 1 -- 172.21.15.79:0/574563214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1184005e90 msgr2=0x7f118402b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.363+0000 7f1175ffb640 1 --2- 172.21.15.79:0/574563214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1184005e90 0x7f118402b470 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f118c000b60 tx=0x7f118c068cc0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.363+0000 7fbbf6ffd640 1 -- 172.21.15.79:0/638685985 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbbfc079b50 con 0x7fbc000b2d70 2024-04-25T02:08:05.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.363+0000 7f1175ffb640 1 -- 172.21.15.79:0/574563214 shutdown_connections 2024-04-25T02:08:05.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.363+0000 7f1175ffb640 1 --2- 172.21.15.79:0/574563214 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f117006be80 0x7f117006e340 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.371 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-04-25T02:08:05.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.363+0000 7f1175ffb640 1 --2- 172.21.15.79:0/574563214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11840ead00 0x7f1184189560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.363+0000 7f1175ffb640 1 --2- 172.21.15.79:0/574563214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1184006810 0x7f1184185750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.363+0000 7f1175ffb640 1 --2- 172.21.15.79:0/574563214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1184005e90 0x7f118402b470 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.364+0000 7f1175ffb640 1 -- 172.21.15.79:0/574563214 >> 172.21.15.79:0/574563214 conn(0x7f1184009fb0 msgr2=0x7f118404f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:05.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.364+0000 7f1175ffb640 1 -- 172.21.15.79:0/574563214 shutdown_connections 2024-04-25T02:08:05.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.364+0000 7f1175ffb640 1 -- 172.21.15.79:0/574563214 wait complete. 2024-04-25T02:08:05.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.366+0000 7fbc07501640 1 -- 172.21.15.79:0/638685985 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbbe406bf30 msgr2=0x7fbbe406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.366+0000 7fbc07501640 1 --2- 172.21.15.79:0/638685985 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbbe406bf30 0x7fbbe406e3f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc000b6a50 tx=0x7fbbf0009190 comp rx=0 tx=0).stop 2024-04-25T02:08:05.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.367+0000 7fbc07501640 1 -- 172.21.15.79:0/638685985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc000b2d70 msgr2=0x7fbc0015ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.367+0000 7fbc07501640 1 --2- 172.21.15.79:0/638685985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc000b2d70 0x7fbc0015ab60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc031000 tx=0x7fbbfc0046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.367+0000 7fbc07501640 1 -- 172.21.15.79:0/638685985 shutdown_connections 2024-04-25T02:08:05.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.367+0000 7fbc07501640 1 --2- 172.21.15.79:0/638685985 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbbe406bf30 0x7fbbe406e3f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.367+0000 7fbc07501640 1 --2- 172.21.15.79:0/638685985 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc0015e200 0x7fbc000b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.367+0000 7fbc07501640 1 --2- 172.21.15.79:0/638685985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc000b32c0 0x7fbc000b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.367+0000 7fbc07501640 1 --2- 172.21.15.79:0/638685985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc000b2d70 0x7fbc0015ab60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.367+0000 7fbc07501640 1 -- 172.21.15.79:0/638685985 >> 172.21.15.79:0/638685985 conn(0x7fbc000d3f80 msgr2=0x7fbc000c8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:05.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.367+0000 7fbf1ab7e640 1 -- 172.21.15.79:0/850443735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fbef4005850 con 0x7fbf140cfd30 2024-04-25T02:08:05.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.367+0000 7fbc07501640 1 -- 172.21.15.79:0/638685985 shutdown_connections 2024-04-25T02:08:05.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.368+0000 7fbc07501640 1 -- 172.21.15.79:0/638685985 wait complete. 2024-04-25T02:08:05.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.368+0000 7f1b4890e640 1 -- 172.21.15.79:0/1120969658 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1b44071820 con 0x7f1b44070e80 2024-04-25T02:08:05.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.368+0000 7fbf117fa640 1 -- 172.21.15.79:0/850443735 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbf08059750 con 0x7fbf140cfd30 2024-04-25T02:08:05.376 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-04-25T02:08:05.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.368+0000 7f1b2bfff640 1 -- 172.21.15.79:0/1120969658 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1b3405cfd0 con 0x7f1b44070e80 2024-04-25T02:08:05.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.369+0000 7f32b8329640 1 -- 172.21.15.79:0/3108122681 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3298005850 con 0x7f329c0051c0 2024-04-25T02:08:05.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.369+0000 7f32a6ffd640 1 -- 172.21.15.79:0/3108122681 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32a805dcf0 con 0x7f329c0051c0 2024-04-25T02:08:05.377 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-04-25T02:08:05.378 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-04-25T02:08:05.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7fbefeffd640 1 -- 172.21.15.79:0/850443735 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbef806be30 msgr2=0x7fbef806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7f1b4890e640 1 -- 172.21.15.79:0/1120969658 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b3006be80 msgr2=0x7f1b3006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7f1b4890e640 1 --2- 172.21.15.79:0/1120969658 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b3006be80 0x7f1b3006e340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b38035000 tx=0x7f1b38008030 comp rx=0 tx=0).stop 2024-04-25T02:08:05.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7fbefeffd640 1 --2- 172.21.15.79:0/850443735 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbef806be30 0x7fbef806e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbf140ca900 tx=0x7fbf00009040 comp rx=0 tx=0).stop 2024-04-25T02:08:05.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7fbefeffd640 1 -- 172.21.15.79:0/850443735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf140cfd30 msgr2=0x7fbf140b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7fbefeffd640 1 --2- 172.21.15.79:0/850443735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf140cfd30 0x7fbf140b1400 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800c450 tx=0x7fbf0800c910 comp rx=0 tx=0).stop 2024-04-25T02:08:05.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7f1b4890e640 1 -- 172.21.15.79:0/1120969658 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b44070e80 msgr2=0x7f1b441ef3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7f1b4890e640 1 --2- 172.21.15.79:0/1120969658 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b44070e80 0x7f1b441ef3c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400c4a0 tx=0x7f1b3400c960 comp rx=0 tx=0).stop 2024-04-25T02:08:05.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7fbefeffd640 1 -- 172.21.15.79:0/850443735 shutdown_connections 2024-04-25T02:08:05.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7fbefeffd640 1 --2- 172.21.15.79:0/850443735 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbef806be30 0x7fbef806e2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7fbefeffd640 1 --2- 172.21.15.79:0/850443735 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf14161a00 0x7fbf141576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7fbefeffd640 1 --2- 172.21.15.79:0/850443735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf14161620 0x7fbf140b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7fbefeffd640 1 --2- 172.21.15.79:0/850443735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf140cfd30 0x7fbf140b1400 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7fbefeffd640 1 -- 172.21.15.79:0/850443735 >> 172.21.15.79:0/850443735 conn(0x7fbf1409d200 msgr2=0x7fbf1406cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:05.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7fbefeffd640 1 -- 172.21.15.79:0/850443735 shutdown_connections 2024-04-25T02:08:05.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.372+0000 7fbefeffd640 1 -- 172.21.15.79:0/850443735 wait complete. 2024-04-25T02:08:05.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.373+0000 7f1b4890e640 1 -- 172.21.15.79:0/1120969658 shutdown_connections 2024-04-25T02:08:05.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.373+0000 7f1b4890e640 1 --2- 172.21.15.79:0/1120969658 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b3006be80 0x7f1b3006e340 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.373+0000 7f1b4890e640 1 --2- 172.21.15.79:0/1120969658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b44143b50 0x7f1b440c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.373+0000 7f1b4890e640 1 --2- 172.21.15.79:0/1120969658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b440b3070 0x7f1b440c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.373+0000 7f1b4890e640 1 --2- 172.21.15.79:0/1120969658 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b44070e80 0x7f1b441ef3c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.373+0000 7f1b4890e640 1 -- 172.21.15.79:0/1120969658 >> 172.21.15.79:0/1120969658 conn(0x7f1b440b18b0 msgr2=0x7f1b4415be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:05.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.373+0000 7f1b4890e640 1 -- 172.21.15.79:0/1120969658 shutdown_connections 2024-04-25T02:08:05.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.373+0000 7f1b4890e640 1 -- 172.21.15.79:0/1120969658 wait complete. 2024-04-25T02:08:05.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.373+0000 7f32b8329640 1 -- 172.21.15.79:0/3108122681 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f329406be60 msgr2=0x7f329406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.373+0000 7f32b8329640 1 --2- 172.21.15.79:0/3108122681 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f329406be60 0x7f329406e320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f32b0160460 tx=0x7f32a0008040 comp rx=0 tx=0).stop 2024-04-25T02:08:05.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.373+0000 7f32b8329640 1 -- 172.21.15.79:0/3108122681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f329c0051c0 msgr2=0x7f32b00a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.373+0000 7f32b8329640 1 --2- 172.21.15.79:0/3108122681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f329c0051c0 0x7f32b00a94d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f32a8005ba0 tx=0x7f32a8008430 comp rx=0 tx=0).stop 2024-04-25T02:08:05.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.374+0000 7f32b8329640 1 -- 172.21.15.79:0/3108122681 shutdown_connections 2024-04-25T02:08:05.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.374+0000 7f32b8329640 1 --2- 172.21.15.79:0/3108122681 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f329406be60 0x7f329406e320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.374+0000 7f32b8329640 1 --2- 172.21.15.79:0/3108122681 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32b00aa000 0x7f32b00aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.374+0000 7f32b8329640 1 --2- 172.21.15.79:0/3108122681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32b00b1110 0x7f32b01f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.374+0000 7f32b8329640 1 --2- 172.21.15.79:0/3108122681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f329c0051c0 0x7f32b00a94d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.374+0000 7f32b8329640 1 -- 172.21.15.79:0/3108122681 >> 172.21.15.79:0/3108122681 conn(0x7f32b006b290 msgr2=0x7f32b0164d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:05.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.374+0000 7f32b8329640 1 -- 172.21.15.79:0/3108122681 shutdown_connections 2024-04-25T02:08:05.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.374+0000 7f32b8329640 1 -- 172.21.15.79:0/3108122681 wait complete. 2024-04-25T02:08:05.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-04-25T02:08:05.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-04-25T02:08:05.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.386+0000 7fb55c8f5640 1 -- 172.21.15.79:0/35013071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb55809d290 con 0x7fb5580d0510 2024-04-25T02:08:05.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.387+0000 7fb546ffd640 1 -- 172.21.15.79:0/35013071 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb54c0172c0 con 0x7fb5580d0510 2024-04-25T02:08:05.394 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-04-25T02:08:05.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.387+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/3345564810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8e0004f210 con 0x7f8e000df420 2024-04-25T02:08:05.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.388+0000 7f8e04ff9640 1 -- 172.21.15.79:0/3345564810 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e08094030 con 0x7f8e000df420 2024-04-25T02:08:05.395 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-04-25T02:08:05.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.390+0000 7fb55c8f5640 1 -- 172.21.15.79:0/35013071 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb53806beb0 msgr2=0x7fb53806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-04-25T02:08:05.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.390+0000 7fb55c8f5640 1 --2- 172.21.15.79:0/35013071 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb53806beb0 0x7fb53806e370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb548000f60 tx=0x7fb548009040 comp rx=0 tx=0).stop 2024-04-25T02:08:05.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.390+0000 7fb55c8f5640 1 -- 172.21.15.79:0/35013071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5580d0510 msgr2=0x7fb5580b4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.390+0000 7fb55c8f5640 1 --2- 172.21.15.79:0/35013071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5580d0510 0x7fb5580b4780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00b410 tx=0x7fb54c00b8d0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.390+0000 7fb55c8f5640 1 -- 172.21.15.79:0/35013071 shutdown_connections 2024-04-25T02:08:05.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.390+0000 7fb55c8f5640 1 --2- 172.21.15.79:0/35013071 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb53806beb0 0x7fb53806e370 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.390+0000 7fb55c8f5640 1 --2- 172.21.15.79:0/35013071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5580d0510 0x7fb5580b4780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.390+0000 7fb55c8f5640 1 --2- 172.21.15.79:0/35013071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb55809c370 0x7fb5580a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.390+0000 7fb55c8f5640 1 --2- 172.21.15.79:0/35013071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55806b7d0 0x7fb5581d9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.390+0000 7fb55c8f5640 1 -- 172.21.15.79:0/35013071 >> 172.21.15.79:0/35013071 conn(0x7fb5580d4330 msgr2=0x7fb5580b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:05.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.390+0000 7fb55c8f5640 1 -- 172.21.15.79:0/35013071 shutdown_connections 2024-04-25T02:08:05.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.390+0000 7fb55c8f5640 1 -- 172.21.15.79:0/35013071 wait complete. 2024-04-25T02:08:05.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.391+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/3345564810 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8dec06be30 msgr2=0x7f8dec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.391+0000 7f8e0d1ba640 1 --2- 172.21.15.79:0/3345564810 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8dec06be30 0x7f8dec06e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0091e0 tx=0x7f8dfc02e000 comp rx=0 tx=0).stop 2024-04-25T02:08:05.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.391+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/3345564810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e000df420 msgr2=0x7f8e000d0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.391+0000 7f8e0d1ba640 1 --2- 172.21.15.79:0/3345564810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e000df420 0x7f8e000d0d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8e08068890 tx=0x7f8e08068670 comp rx=0 tx=0).stop 2024-04-25T02:08:05.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.391+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/3345564810 shutdown_connections 2024-04-25T02:08:05.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.391+0000 7f8e0d1ba640 1 --2- 172.21.15.79:0/3345564810 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8dec06be30 0x7f8dec06e2f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.391+0000 7f8e0d1ba640 1 --2- 172.21.15.79:0/3345564810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e000df420 0x7f8e000d0d40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.391+0000 7f8e0d1ba640 1 --2- 172.21.15.79:0/3345564810 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e0004fa90 0x7f8e000dd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.391+0000 7f8e0d1ba640 1 --2- 172.21.15.79:0/3345564810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e00038800 0x7f8e000e1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.391+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/3345564810 >> 172.21.15.79:0/3345564810 conn(0x7f8e00009fb0 msgr2=0x7f8e00039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:05.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.391+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/3345564810 shutdown_connections 2024-04-25T02:08:05.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:05.391+0000 7f8e0d1ba640 1 -- 172.21.15.79:0/3345564810 wait complete. 2024-04-25T02:08:05.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-04-25T02:08:05.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-04-25T02:08:05.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-04-25T02:08:05.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-04-25T02:08:05.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-04-25T02:08:06.387 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T02:08:06.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:08:06.398 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:08:06.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:08:06.403 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T02:08:06.403 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T02:08:06.414 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:08:06.414 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T02:08:06.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.540+0000 7f875d9ed640 1 Processor -- start 2024-04-25T02:08:06.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.540+0000 7f875d9ed640 1 -- start start 2024-04-25T02:08:06.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.541+0000 7f875d9ed640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8750007da0 0x7f8750056890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.541+0000 7f875d9ed640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87500093a0 0x7f8750053a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.541+0000 7f875d9ed640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8750036df0 con 0x7f87500e3550 2024-04-25T02:08:06.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.541+0000 7f875d9ed640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8750053250 con 0x7f87500093a0 2024-04-25T02:08:06.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.541+0000 7f875d9ed640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f8750037630 con 0x7f8750007da0 2024-04-25T02:08:06.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.542+0000 7f8757fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87500093a0 0x7f8750053a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.542+0000 7f8757fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87500093a0 0x7f8750053a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35046/0 (socket says 172.21.15.79:35046) 2024-04-25T02:08:06.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.542+0000 7f8757fff640 1 -- 172.21.15.79:0/2278879263 learned_addr learned my addr 172.21.15.79:0/2278879263 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:06.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.542+0000 7f8757fff640 1 -- 172.21.15.79:0/2278879263 >> v2:172.21.15.189:3300/0 conn(0x7f8750007da0 msgr2=0x7f8750056890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:08:06.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.542+0000 7f8757fff640 1 --2- 172.21.15.79:0/2278879263 >> v2:172.21.15.189:3300/0 conn(0x7f8750007da0 0x7f8750056890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.542+0000 7f8757fff640 1 -- 172.21.15.79:0/2278879263 >> v1:172.21.15.79:6789/0 conn(0x7f87500e3550 legacy=0x7f8750008c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:08:06.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.542+0000 7f8757fff640 1 -- 172.21.15.79:0/2278879263 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87500086f0 con 0x7f87500093a0 2024-04-25T02:08:06.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.543+0000 7f8757fff640 1 --2- 172.21.15.79:0/2278879263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87500093a0 0x7f8750053a20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8758069880 tx=0x7f87580a5a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66eb8e65c9f6cba7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.544+0000 7f8755ffb640 1 -- 172.21.15.79:0/2278879263 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87580ae070 con 0x7f87500093a0 2024-04-25T02:08:06.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.544+0000 7f8755ffb640 1 -- 172.21.15.79:0/2278879263 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87580aa4f0 con 0x7f87500093a0 2024-04-25T02:08:06.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.545+0000 7f875d9ed640 1 -- 172.21.15.79:0/2278879263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87500093a0 msgr2=0x7f8750053a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.545+0000 7f875d9ed640 1 --2- 172.21.15.79:0/2278879263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87500093a0 0x7f8750053a20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8758069880 tx=0x7f87580a5a20 comp rx=0 tx=0).stop 2024-04-25T02:08:06.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.545+0000 7f875d9ed640 1 -- 172.21.15.79:0/2278879263 shutdown_connections 2024-04-25T02:08:06.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.545+0000 7f875d9ed640 1 --2- 172.21.15.79:0/2278879263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87500093a0 0x7f8750053a20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.545+0000 7f875d9ed640 1 --2- 172.21.15.79:0/2278879263 >> v2:172.21.15.189:3300/0 conn(0x7f8750007da0 0x7f8750056890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.545+0000 7f875d9ed640 1 -- 172.21.15.79:0/2278879263 >> 172.21.15.79:0/2278879263 conn(0x7f875001f120 msgr2=0x7f8750055e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:06.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.545+0000 7f875d9ed640 1 -- 172.21.15.79:0/2278879263 shutdown_connections 2024-04-25T02:08:06.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.545+0000 7f875d9ed640 1 -- 172.21.15.79:0/2278879263 wait complete. 2024-04-25T02:08:06.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.547+0000 7f875d9ed640 1 Processor -- start 2024-04-25T02:08:06.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.547+0000 7f875d9ed640 1 -- start start 2024-04-25T02:08:06.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.549+0000 7f875d9ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8750007da0 0x7f87500d7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.549+0000 7f8756ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8750007da0 0x7f87500d7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.549+0000 7f8756ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8750007da0 0x7f87500d7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35060/0 (socket says 172.21.15.79:35060) 2024-04-25T02:08:06.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.549+0000 7f8756ffd640 1 -- 172.21.15.79:0/2543093855 learned_addr learned my addr 172.21.15.79:0/2543093855 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:06.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.549+0000 7f875d9ed640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f87500e3550 0x7f8750053a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.549+0000 7f875d9ed640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87500d83f0 0x7f8750053f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.549+0000 7f875d9ed640 1 -- 172.21.15.79:0/2543093855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8750053610 con 0x7f8750007da0 2024-04-25T02:08:06.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.549+0000 7f875d9ed640 1 -- 172.21.15.79:0/2543093855 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8750037350 con 0x7f87500d83f0 2024-04-25T02:08:06.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.549+0000 7f875d9ed640 1 -- 172.21.15.79:0/2543093855 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8750053790 con 0x7f87500e3550 2024-04-25T02:08:06.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.550+0000 7f87567fc640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f87500e3550 0x7f8750053a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.550+0000 7f8757fff640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87500d83f0 0x7f8750053f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.550+0000 7f8756ffd640 1 -- 172.21.15.79:0/2543093855 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f87500e3550 msgr2=0x7f8750053a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.550+0000 7f8756ffd640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f87500e3550 0x7f8750053a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.550+0000 7f8756ffd640 1 -- 172.21.15.79:0/2543093855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87500d83f0 msgr2=0x7f8750053f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.550+0000 7f8756ffd640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87500d83f0 0x7f8750053f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.550+0000 7f8756ffd640 1 -- 172.21.15.79:0/2543093855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87500c4450 con 0x7f8750007da0 2024-04-25T02:08:06.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.550+0000 7f8756ffd640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8750007da0 0x7f87500d7eb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f874800b780 tx=0x7f874800bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.553+0000 7f873ffff640 1 -- 172.21.15.79:0/2543093855 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748019070 con 0x7f8750007da0 2024-04-25T02:08:06.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.553+0000 7f875d9ed640 1 -- 172.21.15.79:0/2543093855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87500f2160 con 0x7f8750007da0 2024-04-25T02:08:06.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.553+0000 7f875d9ed640 1 -- 172.21.15.79:0/2543093855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87500c49f0 con 0x7f8750007da0 2024-04-25T02:08:06.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.556+0000 7f873ffff640 1 -- 172.21.15.79:0/2543093855 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f874800c740 con 0x7f8750007da0 2024-04-25T02:08:06.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.556+0000 7f873ffff640 1 -- 172.21.15.79:0/2543093855 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874800cb30 con 0x7f8750007da0 2024-04-25T02:08:06.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.557+0000 7f873ffff640 1 -- 172.21.15.79:0/2543093855 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f874801c070 con 0x7f8750007da0 2024-04-25T02:08:06.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.558+0000 7f873ffff640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f874406bf30 0x7f874406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.558+0000 7f87567fc640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f874406bf30 0x7f874406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.558+0000 7f873ffff640 1 -- 172.21.15.79:0/2543093855 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f874808a440 con 0x7f8750007da0 2024-04-25T02:08:06.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.559+0000 7f87567fc640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f874406bf30 0x7f874406e3f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f874c006fd0 tx=0x7f874c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.559+0000 7f875d9ed640 1 -- 172.21.15.79:0/2543093855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8738005290 con 0x7f8750007da0 2024-04-25T02:08:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.569+0000 7f873ffff640 1 -- 172.21.15.79:0/2543093855 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8748058e60 con 0x7f8750007da0 2024-04-25T02:08:06.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.590+0000 7f7a4d2f8640 1 Processor -- start 2024-04-25T02:08:06.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.591+0000 7f7a4d2f8640 1 -- start start 2024-04-25T02:08:06.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.592+0000 7f7a4d2f8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7a4004fa90 0x7f7a4004fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.592+0000 7f7a4d2f8640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7a400df420 0x7f7a400382c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.592+0000 7f7a4d2f8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a400503b0 con 0x7f7a40038800 2024-04-25T02:08:06.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.592+0000 7f7a4d2f8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7a400068a0 con 0x7f7a4004fa90 2024-04-25T02:08:06.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.592+0000 7f7a4d2f8640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7a40006af0 con 0x7f7a400df420 2024-04-25T02:08:06.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.592+0000 7f7a47fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7a4004fa90 0x7f7a4004fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.592+0000 7f7a47fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7a4004fa90 0x7f7a4004fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35064/0 (socket says 172.21.15.79:35064) 2024-04-25T02:08:06.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.592+0000 7f7a47fff640 1 -- 172.21.15.79:0/3931340375 learned_addr learned my addr 172.21.15.79:0/3931340375 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:06.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.593+0000 7f7a47fff640 1 -- 172.21.15.79:0/3931340375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7a400df420 msgr2=0x7f7a400382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:06.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.593+0000 7f7a477fe640 1 --2- 172.21.15.79:0/3931340375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7a400df420 0x7f7a400382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.593+0000 7f7a47fff640 1 --2- 172.21.15.79:0/3931340375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7a400df420 0x7f7a400382c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.593+0000 7f7a47fff640 1 -- 172.21.15.79:0/3931340375 >> v1:172.21.15.79:6789/0 conn(0x7f7a40038800 legacy=0x7f7a40038c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.593+0000 7f7a47fff640 1 -- 172.21.15.79:0/3931340375 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a40006dd0 con 0x7f7a4004fa90 2024-04-25T02:08:06.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.594+0000 7f7a47fff640 1 --2- 172.21.15.79:0/3931340375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a4004fa90 0x7f7a4004fe70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7a48075450 tx=0x7f7a480a7670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb640ed4feb1bea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.595+0000 7f7a46ffd640 1 -- 172.21.15.79:0/3931340375 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480b5070 con 0x7f7a4004fa90 2024-04-25T02:08:06.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.595+0000 7f7a46ffd640 1 -- 172.21.15.79:0/3931340375 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a480ad540 con 0x7f7a4004fa90 2024-04-25T02:08:06.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.595+0000 7f7a46ffd640 1 -- 172.21.15.79:0/3931340375 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480ad970 con 0x7f7a4004fa90 2024-04-25T02:08:06.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.596+0000 7f7a4d2f8640 1 -- 172.21.15.79:0/3931340375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a4004fa90 msgr2=0x7f7a4004fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.596+0000 7f7a4d2f8640 1 --2- 172.21.15.79:0/3931340375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a4004fa90 0x7f7a4004fe70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7a48075450 tx=0x7f7a480a7670 comp rx=0 tx=0).stop 2024-04-25T02:08:06.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.596+0000 7f7a4d2f8640 1 -- 172.21.15.79:0/3931340375 shutdown_connections 2024-04-25T02:08:06.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.596+0000 7f7a4d2f8640 1 --2- 172.21.15.79:0/3931340375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7a400df420 0x7f7a400382c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.596+0000 7f7a4d2f8640 1 --2- 172.21.15.79:0/3931340375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a4004fa90 0x7f7a4004fe70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.596+0000 7f7a4d2f8640 1 -- 172.21.15.79:0/3931340375 >> 172.21.15.79:0/3931340375 conn(0x7f7a40009fb0 msgr2=0x7f7a4000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:06.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.596+0000 7f7a4d2f8640 1 -- 172.21.15.79:0/3931340375 shutdown_connections 2024-04-25T02:08:06.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.596+0000 7f7a4d2f8640 1 -- 172.21.15.79:0/3931340375 wait complete. 2024-04-25T02:08:06.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.596+0000 7f564a7ce640 1 Processor -- start 2024-04-25T02:08:06.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.596+0000 7f564a7ce640 1 -- start start 2024-04-25T02:08:06.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.598+0000 7f564a7ce640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f564406c7d0 0x7f5644162b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.598+0000 7f564a7ce640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56440afa20 0x7f5644164370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.598+0000 7f564a7ce640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56441605a0 con 0x7f56441601c0 2024-04-25T02:08:06.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.598+0000 7f564a7ce640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5644163ee0 con 0x7f564406c7d0 2024-04-25T02:08:06.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.598+0000 7f564a7ce640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5644163b00 con 0x7f56440afa20 2024-04-25T02:08:06.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.598+0000 7fa423d6a640 1 Processor -- start 2024-04-25T02:08:06.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.598+0000 7fa423d6a640 1 -- start start 2024-04-25T02:08:06.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.598+0000 7f5643fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f56441601c0 0x7f564406c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47786/0 (socket says 172.21.15.79:47786) 2024-04-25T02:08:06.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.598+0000 7f5643fff640 1 -- 172.21.15.79:0/4025122696 learned_addr learned my addr 172.21.15.79:0/4025122696 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:06.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.598+0000 7f7a4d2f8640 1 Processor -- start 2024-04-25T02:08:06.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.598+0000 7f47d011b640 1 Processor -- start 2024-04-25T02:08:06.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.598+0000 7f47d011b640 1 -- start start 2024-04-25T02:08:06.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.598+0000 7f7a4d2f8640 1 -- start start 2024-04-25T02:08:06.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7f5648d6b640 1 --2- 172.21.15.79:0/4025122696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56440afa20 0x7f5644164370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7f5642ffd640 1 -- 172.21.15.79:0/4025122696 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 941479782 0 0) 0x7f563c001490 con 0x7f56441601c0 2024-04-25T02:08:06.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7f5642ffd640 1 -- 172.21.15.79:0/4025122696 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f562c003520 con 0x7f56441601c0 2024-04-25T02:08:06.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7f56437fe640 1 --2- 172.21.15.79:0/4025122696 >> v2:172.21.15.79:3300/0 conn(0x7f564406c7d0 0x7f5644162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7fa423d6a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa41c0d0900 0x7fa41c0b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7fa423d6a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa41c166150 0x7fa41c06d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7f10a1563640 1 Processor -- start 2024-04-25T02:08:06.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7fa423d6a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa41c1670b0 con 0x7fa41c0d0520 2024-04-25T02:08:06.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7f5642ffd640 1 -- 172.21.15.79:0/4025122696 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 132147564 0 0) 0x7f562c003520 con 0x7f56441601c0 2024-04-25T02:08:06.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7fa423d6a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa41c1665e0 con 0x7fa41c166150 2024-04-25T02:08:06.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7fa423d6a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa41c0afa40 con 0x7fa41c0d0900 2024-04-25T02:08:06.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7ff728615640 1 Processor -- start 2024-04-25T02:08:06.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7f5642ffd640 1 -- 172.21.15.79:0/4025122696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56440afa20 msgr2=0x7f5644164370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:06.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7f5642ffd640 1 --2- 172.21.15.79:0/4025122696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56440afa20 0x7f5644164370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7f5642ffd640 1 -- 172.21.15.79:0/4025122696 >> v2:172.21.15.79:3300/0 conn(0x7f564406c7d0 msgr2=0x7f5644162b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:06.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7f5642ffd640 1 --2- 172.21.15.79:0/4025122696 >> v2:172.21.15.79:3300/0 conn(0x7f564406c7d0 0x7f5644162b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.599+0000 7ff388b42640 1 Processor -- start 2024-04-25T02:08:06.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f5642ffd640 1 -- 172.21.15.79:0/4025122696 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56440afe90 con 0x7f56441601c0 2024-04-25T02:08:06.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f7a4d2f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a40038800 0x7f7a4004e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7fa422307640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa41c166150 0x7fa41c06d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7fa421305640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa41c0d0900 0x7fa41c0b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f7a4d2f8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a4004fa90 0x7f7a400d3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f7a4d2f8640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7a400df420 0x7f7a400d6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f7a4d2f8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7a40052b40 con 0x7f7a40038800 2024-04-25T02:08:06.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7fa421305640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa41c0d0900 0x7fa41c0b4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49520/0 (socket says 172.21.15.79:49520) 2024-04-25T02:08:06.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7fa421305640 1 -- 172.21.15.79:0/3424971549 learned_addr learned my addr 172.21.15.79:0/3424971549 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:06.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f7a4d2f8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7a40007390 con 0x7f7a4004fa90 2024-04-25T02:08:06.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f7a4d2f8640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7a40052cc0 con 0x7f7a400df420 2024-04-25T02:08:06.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f47d011b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f47c815a7a0 0x7f47c806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f47d011b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f47c8072230 0x7f47c80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f47d011b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c806e290 con 0x7f47c80b3650 2024-04-25T02:08:06.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f47d011b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f47c80cd100 con 0x7f47c815a7a0 2024-04-25T02:08:06.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f47d011b640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f47c806e570 con 0x7f47c8072230 2024-04-25T02:08:06.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7ff388b42640 1 -- start start 2024-04-25T02:08:06.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f5642ffd640 1 -- 172.21.15.79:0/4025122696 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f563c001bc0 con 0x7f56441601c0 2024-04-25T02:08:06.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f56437fe640 1 --2- 172.21.15.79:0/4025122696 >> v2:172.21.15.79:3300/0 conn(0x7f564406c7d0 0x7f5644162b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:06.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f10a1563640 1 -- start start 2024-04-25T02:08:06.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7ff728615640 1 -- start start 2024-04-25T02:08:06.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f47cdeb7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f47c815a7a0 0x7f47c806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f7a47fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a40038800 0x7f7a4004e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f7a47fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a40038800 0x7f7a4004e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35086/0 (socket says 172.21.15.79:35086) 2024-04-25T02:08:06.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f7a47fff640 1 -- 172.21.15.79:0/1428882317 learned_addr learned my addr 172.21.15.79:0/1428882317 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:06.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f47ce6b8640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f47c8072230 0x7f47c80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f47ce6b8640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f47c8072230 0x7f47c80cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:36364/0 (socket says 172.21.15.79:36364) 2024-04-25T02:08:06.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f47ce6b8640 1 -- 172.21.15.79:0/15933348 learned_addr learned my addr 172.21.15.79:0/15933348 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:06.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f7a477fe640 1 --2- 172.21.15.79:0/1428882317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a4004fa90 0x7f7a400d3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.600+0000 7f7a4caf7640 1 --2- 172.21.15.79:0/1428882317 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7a400df420 0x7f7a400d6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f5642ffd640 1 -- 172.21.15.79:0/4025122696 >> v1:172.21.15.79:6789/0 conn(0x7f56441601c0 legacy=0x7f564406c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f5642ffd640 1 --2- 172.21.15.79:0/4025122696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f562c003a30 0x7f562c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f7a477fe640 1 -- 172.21.15.79:0/1428882317 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7a400df420 msgr2=0x7f7a400d6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f7a477fe640 1 --2- 172.21.15.79:0/1428882317 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7a400df420 0x7f7a400d6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f7a477fe640 1 -- 172.21.15.79:0/1428882317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a40038800 msgr2=0x7f7a4004e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f7a477fe640 1 --2- 172.21.15.79:0/1428882317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a40038800 0x7f7a4004e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f7a477fe640 1 -- 172.21.15.79:0/1428882317 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a400d7470 con 0x7f7a4004fa90 2024-04-25T02:08:06.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f5642ffd640 1 --2- 172.21.15.79:0/4025122696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f562c004800 0x7f562c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff728615640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff720143c70 0x7ff7200acf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff728615640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7200ad4a0 0x7ff720072740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff728615640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7200716a0 con 0x7ff7200711a0 2024-04-25T02:08:06.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff728615640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff720144050 con 0x7ff720143c70 2024-04-25T02:08:06.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff728615640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff720071980 con 0x7ff7200ad4a0 2024-04-25T02:08:06.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff388b42640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff3840d0520 0x7ff3840b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff388b42640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff3840d0900 0x7ff384166150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff388b42640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3841670b0 con 0x7ff38406d140 2024-04-25T02:08:06.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff388b42640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff3840afa40 con 0x7ff3840d0520 2024-04-25T02:08:06.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff388b42640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff3840ad090 con 0x7ff3840d0900 2024-04-25T02:08:06.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f5642ffd640 1 --2- 172.21.15.79:0/4025122696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56440afa20 0x7f562c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f5642ffd640 1 -- 172.21.15.79:0/4025122696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5644163ee0 con 0x7f562c004800 2024-04-25T02:08:06.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f47ce6b8640 1 -- 172.21.15.79:0/15933348 >> v2:172.21.15.79:3300/0 conn(0x7f47c815a7a0 msgr2=0x7f47c806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:06.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f47ce6b8640 1 --2- 172.21.15.79:0/15933348 >> v2:172.21.15.79:3300/0 conn(0x7f47c815a7a0 0x7f47c806dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f47ce6b8640 1 -- 172.21.15.79:0/15933348 >> v1:172.21.15.79:6789/0 conn(0x7f47c80b3650 legacy=0x7f47c8071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:06.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f47ce6b8640 1 -- 172.21.15.79:0/15933348 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c806e850 con 0x7f47c8072230 2024-04-25T02:08:06.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff725bb0640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7200ad4a0 0x7ff720072740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff725bb0640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7200ad4a0 0x7ff720072740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49550/0 (socket says 172.21.15.79:49550) 2024-04-25T02:08:06.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff725bb0640 1 -- 172.21.15.79:0/1498643110 learned_addr learned my addr 172.21.15.79:0/1498643110 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:06.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff38259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff3840d0520 0x7ff3840b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff7263b1640 1 --2- 172.21.15.79:0/1498643110 >> v2:172.21.15.79:3300/0 conn(0x7ff720143c70 0x7ff7200acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f10a1563640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1094048c70 0x7f10940490c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7f109affd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f10940091c0 0x7f1094052f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47810/0 (socket says 172.21.15.79:47810) 2024-04-25T02:08:06.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f10a1563640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f109403aa50 0x7f109403ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f10a1563640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10940095a0 con 0x7f10940091c0 2024-04-25T02:08:06.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f10a1563640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f1094049600 con 0x7f109403aa50 2024-04-25T02:08:06.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f10a1563640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f10940359a0 con 0x7f1094048c70 2024-04-25T02:08:06.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f109affd640 1 -- 172.21.15.79:0/950217998 learned_addr learned my addr 172.21.15.79:0/950217998 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:06.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7fa420b04640 1 -- 172.21.15.79:0/3424971549 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3041380314 0 0) 0x7fa41c1670b0 con 0x7fa41c0d0520 2024-04-25T02:08:06.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7fa420b04640 1 -- 172.21.15.79:0/3424971549 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa408003520 con 0x7fa41c0d0520 2024-04-25T02:08:06.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7fa421305640 1 -- 172.21.15.79:0/3424971549 >> v2:172.21.15.79:3300/0 conn(0x7fa41c166150 msgr2=0x7fa41c06d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:06.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7fa421305640 1 --2- 172.21.15.79:0/3424971549 >> v2:172.21.15.79:3300/0 conn(0x7fa41c166150 0x7fa41c06d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7fa421305640 1 -- 172.21.15.79:0/3424971549 >> v1:172.21.15.189:6789/0 conn(0x7fa41c0d0520 legacy=0x7fa41c06d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7fa421305640 1 -- 172.21.15.79:0/3424971549 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa41c0ad090 con 0x7fa41c0d0900 2024-04-25T02:08:06.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7ff725bb0640 1 -- 172.21.15.79:0/1498643110 >> v2:172.21.15.79:3300/0 conn(0x7ff720143c70 msgr2=0x7ff7200acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:06.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f109a7fc640 1 --2- 172.21.15.79:0/950217998 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1094048c70 0x7f10940490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f5643fff640 1 --2- 172.21.15.79:0/4025122696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f562c003a30 0x7f562c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f7a477fe640 1 --2- 172.21.15.79:0/1428882317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a4004fa90 0x7f7a400d3d90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00c5c0 tx=0x7f7a3c00ca80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f56437fe640 1 --2- 172.21.15.79:0/4025122696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f562c004800 0x7f562c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f5642ffd640 1 -- 172.21.15.79:0/4025122696 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5644163b00 con 0x7f562c003a30 2024-04-25T02:08:06.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f47ce6b8640 1 --2- 172.21.15.79:0/15933348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47c8072230 0x7f47c80cd570 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f47c806d920 tx=0x7f47b802b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae76a752a5ee557e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f5642ffd640 1 -- 172.21.15.79:0/4025122696 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f562c00baf0 con 0x7f56440afa20 2024-04-25T02:08:06.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f5648d6b640 1 --2- 172.21.15.79:0/4025122696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56440afa20 0x7f562c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f109b7fe640 1 --2- 172.21.15.79:0/950217998 >> v2:172.21.15.189:3300/0 conn(0x7f109403aa50 0x7f109403ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7ff725bb0640 1 --2- 172.21.15.79:0/1498643110 >> v2:172.21.15.79:3300/0 conn(0x7ff720143c70 0x7ff7200acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7ff725bb0640 1 -- 172.21.15.79:0/1498643110 >> v1:172.21.15.189:6789/0 conn(0x7ff7200711a0 legacy=0x7ff7200d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:06.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7ff725bb0640 1 -- 172.21.15.79:0/1498643110 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff720071c60 con 0x7ff7200ad4a0 2024-04-25T02:08:06.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7ff7263b1640 1 --2- 172.21.15.79:0/1498643110 >> v2:172.21.15.79:3300/0 conn(0x7ff720143c70 0x7ff7200acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:06.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff381d9b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff3840d0900 0x7ff384166150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff382d9d640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7ff38406d140 0x7ff38406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:34914/0 (socket says 172.21.15.79:34914) 2024-04-25T02:08:06.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.601+0000 7ff382d9d640 1 -- 172.21.15.79:0/1677603792 learned_addr learned my addr 172.21.15.79:0/1677603792 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:06.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7ff381d9b640 1 -- 172.21.15.79:0/1677603792 >> v2:172.21.15.79:3300/0 conn(0x7ff3840d0520 msgr2=0x7ff3840b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:06.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7ff381d9b640 1 --2- 172.21.15.79:0/1677603792 >> v2:172.21.15.79:3300/0 conn(0x7ff3840d0520 0x7ff3840b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7ff381d9b640 1 -- 172.21.15.79:0/1677603792 >> v1:172.21.15.189:6789/0 conn(0x7ff38406d140 legacy=0x7ff38406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7ff381d9b640 1 -- 172.21.15.79:0/1677603792 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff384166810 con 0x7ff3840d0900 2024-04-25T02:08:06.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7ff38259c640 1 --2- 172.21.15.79:0/1677603792 >> v2:172.21.15.79:3300/0 conn(0x7ff3840d0520 0x7ff3840b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:06.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f7a44ff9640 1 -- 172.21.15.79:0/1428882317 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c015070 con 0x7f7a4004fa90 2024-04-25T02:08:06.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f7a44ff9640 1 -- 172.21.15.79:0/1428882317 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a3c004220 con 0x7f7a4004fa90 2024-04-25T02:08:06.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f7a44ff9640 1 -- 172.21.15.79:0/1428882317 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c003610 con 0x7f7a4004fa90 2024-04-25T02:08:06.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f1099ffb640 1 -- 172.21.15.79:0/950217998 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1509926294 0 0) 0x7f10940095a0 con 0x7f10940091c0 2024-04-25T02:08:06.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.602+0000 7f47cceb5640 1 -- 172.21.15.79:0/15933348 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8037070 con 0x7f47c8072230 2024-04-25T02:08:06.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f47cceb5640 1 -- 172.21.15.79:0/15933348 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b8030710 con 0x7f47c8072230 2024-04-25T02:08:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f1099ffb640 1 -- 172.21.15.79:0/950217998 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1084003520 con 0x7f10940091c0 2024-04-25T02:08:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f47cceb5640 1 -- 172.21.15.79:0/15933348 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8030ac0 con 0x7f47c8072230 2024-04-25T02:08:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f109b7fe640 1 -- 172.21.15.79:0/950217998 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1094048c70 msgr2=0x7f10940490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f109b7fe640 1 --2- 172.21.15.79:0/950217998 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1094048c70 0x7f10940490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f109b7fe640 1 -- 172.21.15.79:0/950217998 >> v1:172.21.15.79:6789/0 conn(0x7f10940091c0 legacy=0x7f1094052f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f109b7fe640 1 -- 172.21.15.79:0/950217998 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1094035c60 con 0x7f109403aa50 2024-04-25T02:08:06.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f5643fff640 1 -- 172.21.15.79:0/4025122696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56440afa20 msgr2=0x7f562c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:06.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f5643fff640 1 --2- 172.21.15.79:0/4025122696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56440afa20 0x7f562c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f5643fff640 1 -- 172.21.15.79:0/4025122696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f562c004800 msgr2=0x7f562c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:06.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f5643fff640 1 --2- 172.21.15.79:0/4025122696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f562c004800 0x7f562c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f5643fff640 1 -- 172.21.15.79:0/4025122696 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562c003520 con 0x7f562c003a30 2024-04-25T02:08:06.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7ff725bb0640 1 --2- 172.21.15.79:0/1498643110 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7200ad4a0 0x7ff720072740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00b9f0 tx=0x7ff71c02c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83fafffd178ec90e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7fa421305640 1 --2- 172.21.15.79:0/3424971549 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa41c0d0900 0x7fa41c0b4f90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa418009870 tx=0x7fa41802a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c116c4e07769d95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f56437fe640 1 --2- 172.21.15.79:0/4025122696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f562c004800 0x7f562c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7ff381d9b640 1 --2- 172.21.15.79:0/1677603792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3840d0900 0x7ff384166150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff3780097a0 tx=0x7ff37802a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5d0771fbb3a96f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7fa420b04640 1 -- 172.21.15.79:0/3424971549 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418037070 con 0x7fa41c0d0900 2024-04-25T02:08:06.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f7a4d2f8640 1 -- 172.21.15.79:0/1428882317 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4004e970 con 0x7f7a4004fa90 2024-04-25T02:08:06.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7f7a4d2f8640 1 -- 172.21.15.79:0/1428882317 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a400db1b0 con 0x7f7a4004fa90 2024-04-25T02:08:06.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7ff7253af640 1 -- 172.21.15.79:0/1498643110 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c038070 con 0x7ff7200ad4a0 2024-04-25T02:08:06.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7ff7253af640 1 -- 172.21.15.79:0/1498643110 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff71c031710 con 0x7ff7200ad4a0 2024-04-25T02:08:06.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7f47d011b640 1 -- 172.21.15.79:0/15933348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47c8072230 msgr2=0x7f47c80cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7f47d011b640 1 --2- 172.21.15.79:0/15933348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47c8072230 0x7f47c80cd570 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f47c806d920 tx=0x7f47b802b4f0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7ff7253af640 1 -- 172.21.15.79:0/1498643110 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c031ae0 con 0x7ff7200ad4a0 2024-04-25T02:08:06.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7fa420b04640 1 -- 172.21.15.79:0/3424971549 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa418032440 con 0x7fa41c0d0900 2024-04-25T02:08:06.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.603+0000 7fa420b04640 1 -- 172.21.15.79:0/3424971549 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418032850 con 0x7fa41c0d0900 2024-04-25T02:08:06.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7f5648d6b640 1 --2- 172.21.15.79:0/4025122696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56440afa20 0x7f562c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:06.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7f47d011b640 1 -- 172.21.15.79:0/15933348 shutdown_connections 2024-04-25T02:08:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7f47d011b640 1 --2- 172.21.15.79:0/15933348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47c8072230 0x7f47c80cd570 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7f47d011b640 1 --2- 172.21.15.79:0/15933348 >> v2:172.21.15.79:3300/0 conn(0x7f47c815a7a0 0x7f47c806dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7f47d011b640 1 -- 172.21.15.79:0/15933348 >> 172.21.15.79:0/15933348 conn(0x7f47c80b25c0 msgr2=0x7f47c80b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7ff38159a640 1 -- 172.21.15.79:0/1677603792 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378037070 con 0x7ff3840d0900 2024-04-25T02:08:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7f5643fff640 1 --2- 172.21.15.79:0/4025122696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f562c003a30 0x7f562c003e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f563c005bb0 tx=0x7f562c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6424f021598ffb81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7ff38159a640 1 -- 172.21.15.79:0/1677603792 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37802acd0 con 0x7ff3840d0900 2024-04-25T02:08:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7f109b7fe640 1 --2- 172.21.15.79:0/950217998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f109403aa50 0x7f109403ae60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f109c02d700 tx=0x7f109c0a5ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=414ed8fc39d4f66e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7f5642ffd640 1 -- 172.21.15.79:0/4025122696 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c005800 con 0x7f562c003a30 2024-04-25T02:08:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7fa423d6a640 1 -- 172.21.15.79:0/3424971549 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa41c0d0900 msgr2=0x7fa41c0b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7ff38159a640 1 -- 172.21.15.79:0/1677603792 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378032660 con 0x7ff3840d0900 2024-04-25T02:08:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7fa423d6a640 1 --2- 172.21.15.79:0/3424971549 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa41c0d0900 0x7fa41c0b4f90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa418009870 tx=0x7fa41802a1e0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7f5642ffd640 1 -- 172.21.15.79:0/4025122696 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563c0082d0 con 0x7f562c003a30 2024-04-25T02:08:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7f1099ffb640 1 -- 172.21.15.79:0/950217998 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c0a74e0 con 0x7f109403aa50 2024-04-25T02:08:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7f5642ffd640 1 -- 172.21.15.79:0/4025122696 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c008700 con 0x7f562c003a30 2024-04-25T02:08:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.604+0000 7f7a4d2f8640 1 -- 172.21.15.79:0/1428882317 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a400089d0 con 0x7f7a4004fa90 2024-04-25T02:08:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7f1099ffb640 1 -- 172.21.15.79:0/950217998 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109c0a7680 con 0x7f109403aa50 2024-04-25T02:08:06.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7fa423d6a640 1 -- 172.21.15.79:0/3424971549 shutdown_connections 2024-04-25T02:08:06.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7f1099ffb640 1 -- 172.21.15.79:0/950217998 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c0a7b30 con 0x7f109403aa50 2024-04-25T02:08:06.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7fa423d6a640 1 --2- 172.21.15.79:0/3424971549 >> v2:172.21.15.79:3300/0 conn(0x7fa41c166150 0x7fa41c06d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7fa423d6a640 1 --2- 172.21.15.79:0/3424971549 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa41c0d0900 0x7fa41c0b4f90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7fa423d6a640 1 -- 172.21.15.79:0/3424971549 >> 172.21.15.79:0/3424971549 conn(0x7fa41c06b290 msgr2=0x7fa41c06b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:06.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7ff728615640 1 -- 172.21.15.79:0/1498643110 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7200ad4a0 msgr2=0x7ff720072740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7f47d011b640 1 -- 172.21.15.79:0/15933348 shutdown_connections 2024-04-25T02:08:06.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7ff728615640 1 --2- 172.21.15.79:0/1498643110 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7200ad4a0 0x7ff720072740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00b9f0 tx=0x7ff71c02c420 comp rx=0 tx=0).stop 2024-04-25T02:08:06.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7ff728615640 1 -- 172.21.15.79:0/1498643110 shutdown_connections 2024-04-25T02:08:06.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7ff728615640 1 --2- 172.21.15.79:0/1498643110 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7200ad4a0 0x7ff720072740 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00b9f0 tx=0x7ff71c02c420 comp rx=0 tx=0).stop 2024-04-25T02:08:06.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7ff728615640 1 --2- 172.21.15.79:0/1498643110 >> v2:172.21.15.79:3300/0 conn(0x7ff720143c70 0x7ff7200acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7ff728615640 1 -- 172.21.15.79:0/1498643110 >> 172.21.15.79:0/1498643110 conn(0x7ff72006b290 msgr2=0x7ff72006b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7fa423d6a640 1 -- 172.21.15.79:0/3424971549 shutdown_connections 2024-04-25T02:08:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7fa423d6a640 1 -- 172.21.15.79:0/3424971549 wait complete. 2024-04-25T02:08:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7ff388b42640 1 -- 172.21.15.79:0/1677603792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3840d0900 msgr2=0x7ff384166150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7ff388b42640 1 --2- 172.21.15.79:0/1677603792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3840d0900 0x7ff384166150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff3780097a0 tx=0x7ff37802a040 comp rx=0 tx=0).stop 2024-04-25T02:08:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7f47d011b640 1 -- 172.21.15.79:0/15933348 wait complete. 2024-04-25T02:08:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7ff728615640 1 -- 172.21.15.79:0/1498643110 shutdown_connections 2024-04-25T02:08:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7ff388b42640 1 -- 172.21.15.79:0/1677603792 shutdown_connections 2024-04-25T02:08:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7ff388b42640 1 --2- 172.21.15.79:0/1677603792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3840d0900 0x7ff384166150 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7ff388b42640 1 --2- 172.21.15.79:0/1677603792 >> v2:172.21.15.79:3300/0 conn(0x7ff3840d0520 0x7ff3840b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7ff388b42640 1 -- 172.21.15.79:0/1677603792 >> 172.21.15.79:0/1677603792 conn(0x7ff38406b290 msgr2=0x7ff38406b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7f7a44ff9640 1 -- 172.21.15.79:0/1428882317 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a3c0037b0 con 0x7f7a4004fa90 2024-04-25T02:08:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7f7a44ff9640 1 --2- 172.21.15.79:0/1428882317 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7a2c06bf00 0x7f7a2c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.606+0000 7f7a44ff9640 1 -- 172.21.15.79:0/1428882317 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7a3c08ae40 con 0x7f7a4004fa90 2024-04-25T02:08:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.606+0000 7f564a7ce640 1 -- 172.21.15.79:0/4025122696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f562c003a30 msgr2=0x7f562c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.606+0000 7f564a7ce640 1 --2- 172.21.15.79:0/4025122696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f562c003a30 0x7f562c003e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f563c005bb0 tx=0x7f562c005830 comp rx=0 tx=0).stop 2024-04-25T02:08:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.606+0000 7f5648d6b640 1 -- 172.21.15.79:0/4025122696 reap_dead start 2024-04-25T02:08:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.605+0000 7ff728615640 1 -- 172.21.15.79:0/1498643110 wait complete. 2024-04-25T02:08:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.606+0000 7ff388b42640 1 -- 172.21.15.79:0/1677603792 shutdown_connections 2024-04-25T02:08:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.606+0000 7f564a7ce640 1 -- 172.21.15.79:0/4025122696 shutdown_connections 2024-04-25T02:08:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.606+0000 7f564a7ce640 1 -- 172.21.15.79:0/4025122696 >> 172.21.15.79:0/4025122696 conn(0x7f5644071640 msgr2=0x7f5644071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.606+0000 7f10a1563640 1 -- 172.21.15.79:0/950217998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f109403aa50 msgr2=0x7f109403ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.606+0000 7f10a1563640 1 --2- 172.21.15.79:0/950217998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f109403aa50 0x7f109403ae60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f109c02d700 tx=0x7f109c0a5ad0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.606+0000 7f7a47fff640 1 --2- 172.21.15.79:0/1428882317 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7a2c06bf00 0x7f7a2c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.607+0000 7f7a47fff640 1 --2- 172.21.15.79:0/1428882317 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7a2c06bf00 0x7f7a2c06e3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7a48000b60 tx=0x7f7a480ab000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.606+0000 7ff388b42640 1 -- 172.21.15.79:0/1677603792 wait complete. 2024-04-25T02:08:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.607+0000 7f564a7ce640 1 -- 172.21.15.79:0/4025122696 shutdown_connections 2024-04-25T02:08:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.607+0000 7f10a1563640 1 -- 172.21.15.79:0/950217998 shutdown_connections 2024-04-25T02:08:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.607+0000 7f10a1563640 1 --2- 172.21.15.79:0/950217998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f109403aa50 0x7f109403ae60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.607+0000 7f10a1563640 1 --2- 172.21.15.79:0/950217998 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1094048c70 0x7f10940490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.607+0000 7f10a1563640 1 -- 172.21.15.79:0/950217998 >> 172.21.15.79:0/950217998 conn(0x7f109401ef70 msgr2=0x7f1094055ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.607+0000 7f10a1563640 1 -- 172.21.15.79:0/950217998 shutdown_connections 2024-04-25T02:08:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.607+0000 7fa423d6a640 1 Processor -- start 2024-04-25T02:08:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.607+0000 7ff728615640 1 Processor -- start 2024-04-25T02:08:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.607+0000 7f10a1563640 1 -- 172.21.15.79:0/950217998 wait complete. 2024-04-25T02:08:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.607+0000 7fa423d6a640 1 -- start start 2024-04-25T02:08:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.607+0000 7f564a7ce640 1 -- 172.21.15.79:0/4025122696 wait complete. 2024-04-25T02:08:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.607+0000 7f47d011b640 1 Processor -- start 2024-04-25T02:08:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.607+0000 7f47d011b640 1 -- start start 2024-04-25T02:08:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.607+0000 7ff728615640 1 -- start start 2024-04-25T02:08:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.608+0000 7ff388b42640 1 Processor -- start 2024-04-25T02:08:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.608+0000 7f564a7ce640 1 Processor -- start 2024-04-25T02:08:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.608+0000 7ff728615640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7200711a0 0x7ff720159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.608+0000 7ff728615640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff720143c70 0x7ff72009bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.608+0000 7f564a7ce640 1 -- start start 2024-04-25T02:08:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7ff728615640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7200ceba0 0x7ff7200cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7ff725bb0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff720143c70 0x7ff72009bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7ff7263b1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7200711a0 0x7ff720159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7ff725bb0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff720143c70 0x7ff72009bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35116/0 (socket says 172.21.15.79:35116) 2024-04-25T02:08:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7f47d011b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47c8072230 0x7f47c81f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7fa423d6a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa41c0d0520 0x7fa41c1f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7f47d011b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47c80b3650 0x7f47c813cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7ff7263b1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7200711a0 0x7ff720159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:36414/0 (socket says 172.21.15.79:36414) 2024-04-25T02:08:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7f47d011b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47c815a7a0 0x7f47c8155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.608+0000 7ff388b42640 1 -- start start 2024-04-25T02:08:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7fa421b06640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa41c0d0520 0x7fa41c1f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7fa421b06640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa41c0d0520 0x7fa41c1f7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35118/0 (socket says 172.21.15.79:35118) 2024-04-25T02:08:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7fa421b06640 1 -- 172.21.15.79:0/3128641444 learned_addr learned my addr 172.21.15.79:0/3128641444 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7f10a1563640 1 Processor -- start 2024-04-25T02:08:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7ff728615640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff72009df40 con 0x7ff720143c70 2024-04-25T02:08:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7ff725bb0640 1 -- 172.21.15.79:0/3645738693 learned_addr learned my addr 172.21.15.79:0/3645738693 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7ff728615640 1 -- 172.21.15.79:0/3645738693 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff720072220 con 0x7ff7200711a0 2024-04-25T02:08:06.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7f47cdeb7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47c8072230 0x7f47c81f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7f47cd6b6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47c80b3650 0x7f47c813cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7f47cdeb7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47c8072230 0x7f47c81f05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49580/0 (socket says 172.21.15.79:49580) 2024-04-25T02:08:06.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7f47cdeb7640 1 -- 172.21.15.79:0/4232069828 learned_addr learned my addr 172.21.15.79:0/4232069828 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:06.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7ff728615640 1 -- 172.21.15.79:0/3645738693 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff72009e0c0 con 0x7ff7200ceba0 2024-04-25T02:08:06.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7f10a1563640 1 -- start start 2024-04-25T02:08:06.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7f47ce6b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47c815a7a0 0x7f47c8155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7f47d011b640 1 -- 172.21.15.79:0/4232069828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f47c80b3b00 con 0x7f47c815a7a0 2024-04-25T02:08:06.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7f564a7ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f564414dca0 0x7f56441523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7f564a7ce640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56440b5460 0x7f56440b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7ff388b42640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff38406d140 0x7ff38415ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7ff388b42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3840d0520 0x7ff3841fb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7ff388b42640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff3840d0900 0x7ff3841fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7ff388b42640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff38406dce0 con 0x7ff3840d0520 2024-04-25T02:08:06.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7ff388b42640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff384166dd0 con 0x7ff38406d140 2024-04-25T02:08:06.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7ff388b42640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff38406de60 con 0x7ff3840d0900 2024-04-25T02:08:06.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7fa423d6a640 1 --2- 172.21.15.79:0/3128641444 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa41c0d0900 0x7fa41c09c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.609+0000 7f564a7ce640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5644150590 0x7f5644150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f564a7ce640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5644163820 con 0x7f564414dca0 2024-04-25T02:08:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f564a7ce640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5644163540 con 0x7f5644150590 2024-04-25T02:08:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7fa423d6a640 1 --2- 172.21.15.79:0/3128641444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa41c166150 0x7fa41c1653c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f564a7ce640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5644164370 con 0x7f56440b5460 2024-04-25T02:08:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7fa423d6a640 1 -- 172.21.15.79:0/3128641444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa41c166dd0 con 0x7fa41c0d0520 2024-04-25T02:08:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7fa423d6a640 1 -- 172.21.15.79:0/3128641444 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa41c166af0 con 0x7fa41c166150 2024-04-25T02:08:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7fa423d6a640 1 -- 172.21.15.79:0/3128641444 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa41c06dd90 con 0x7fa41c0d0900 2024-04-25T02:08:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f47d011b640 1 -- 172.21.15.79:0/4232069828 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47c806ee10 con 0x7f47c80b3650 2024-04-25T02:08:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff38259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff38406d140 0x7ff38415ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f5643fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f564414dca0 0x7f56441523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f5643fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f564414dca0 0x7f56441523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35144/0 (socket says 172.21.15.79:35144) 2024-04-25T02:08:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f5643fff640 1 -- 172.21.15.79:0/4051300661 learned_addr learned my addr 172.21.15.79:0/4051300661 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f47d011b640 1 -- 172.21.15.79:0/4232069828 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f47c8066ea0 con 0x7f47c8072230 2024-04-25T02:08:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff7263b1640 1 -- 172.21.15.79:0/3645738693 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7200ceba0 msgr2=0x7ff7200cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff726bb2640 1 --2- 172.21.15.79:0/3645738693 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7200ceba0 0x7ff7200cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff7263b1640 1 --2- 172.21.15.79:0/3645738693 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7200ceba0 0x7ff7200cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff7263b1640 1 -- 172.21.15.79:0/3645738693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff720143c70 msgr2=0x7ff72009bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff7263b1640 1 --2- 172.21.15.79:0/3645738693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff720143c70 0x7ff72009bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff7263b1640 1 -- 172.21.15.79:0/3645738693 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff720159ea0 con 0x7ff7200711a0 2024-04-25T02:08:06.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f5648d6b640 1 --2- 172.21.15.79:0/4051300661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5644150590 0x7f5644150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff381d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3840d0520 0x7ff3841fb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7fa421305640 1 --2- 172.21.15.79:0/3128641444 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa41c0d0900 0x7fa41c09c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff726bb2640 1 --2- 172.21.15.79:0/3645738693 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7200ceba0 0x7ff7200cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:06.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff725bb0640 1 --2- 172.21.15.79:0/3645738693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff720143c70 0x7ff72009bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:06.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff381d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3840d0520 0x7ff3841fb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35140/0 (socket says 172.21.15.79:35140) 2024-04-25T02:08:06.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f56437fe640 1 --2- 172.21.15.79:0/4051300661 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56440b5460 0x7f56440b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff381d9b640 1 -- 172.21.15.79:0/3136437192 learned_addr learned my addr 172.21.15.79:0/3136437192 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff382d9d640 1 --2- 172.21.15.79:0/3136437192 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff3840d0900 0x7ff3841fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f5643fff640 1 -- 172.21.15.79:0/4051300661 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56440b5460 msgr2=0x7f56440b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f5643fff640 1 --2- 172.21.15.79:0/4051300661 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56440b5460 0x7f56440b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f5643fff640 1 -- 172.21.15.79:0/4051300661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5644150590 msgr2=0x7f5644150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f5643fff640 1 --2- 172.21.15.79:0/4051300661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5644150590 0x7f5644150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f5643fff640 1 -- 172.21.15.79:0/4051300661 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56441528f0 con 0x7f564414dca0 2024-04-25T02:08:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f5648d6b640 1 --2- 172.21.15.79:0/4051300661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5644150590 0x7f5644150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff381d9b640 1 -- 172.21.15.79:0/3136437192 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff3840d0900 msgr2=0x7ff3841fbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff381d9b640 1 --2- 172.21.15.79:0/3136437192 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff3840d0900 0x7ff3841fbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff381d9b640 1 -- 172.21.15.79:0/3136437192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff38406d140 msgr2=0x7ff38415ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff381d9b640 1 --2- 172.21.15.79:0/3136437192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff38406d140 0x7ff38415ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff381d9b640 1 -- 172.21.15.79:0/3136437192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38415f200 con 0x7ff3840d0520 2024-04-25T02:08:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7ff38259c640 1 --2- 172.21.15.79:0/3136437192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff38406d140 0x7ff38415ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.610+0000 7f7a44ff9640 1 -- 172.21.15.79:0/1428882317 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7a400d7470 con 0x7f7a4004fa90 2024-04-25T02:08:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f10a1563640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10940091c0 0x7f10940e50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f10a1563640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f109403aa50 0x7f10940dc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7fa421b06640 1 -- 172.21.15.79:0/3128641444 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa41c0d0900 msgr2=0x7fa41c09c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7fa421b06640 1 --2- 172.21.15.79:0/3128641444 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa41c0d0900 0x7fa41c09c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7fa421b06640 1 -- 172.21.15.79:0/3128641444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa41c166150 msgr2=0x7fa41c1653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7fa421b06640 1 --2- 172.21.15.79:0/3128641444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa41c166150 0x7fa41c1653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7ff381d9b640 1 --2- 172.21.15.79:0/3136437192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3840d0520 0x7ff3841fb870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff378009890 tx=0x7ff3780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f10a1563640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1094048c70 0x7f1094033e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f47cdeb7640 1 -- 172.21.15.79:0/4232069828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47c80b3650 msgr2=0x7f47c813cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f47cdeb7640 1 --2- 172.21.15.79:0/4232069828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47c80b3650 0x7f47c813cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f47cdeb7640 1 -- 172.21.15.79:0/4232069828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47c815a7a0 msgr2=0x7f47c8155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f47cdeb7640 1 --2- 172.21.15.79:0/4232069828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47c815a7a0 0x7f47c8155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f47cdeb7640 1 -- 172.21.15.79:0/4232069828 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c813da70 con 0x7f47c8072230 2024-04-25T02:08:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f47ce6b8640 1 --2- 172.21.15.79:0/4232069828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47c815a7a0 0x7f47c8155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f10a1563640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1094036500 con 0x7f109403aa50 2024-04-25T02:08:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f10a1563640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1094036220 con 0x7f1094048c70 2024-04-25T02:08:06.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7ff7263b1640 1 --2- 172.21.15.79:0/3645738693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7200711a0 0x7ff720159960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff71000e900 tx=0x7ff71000edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f109a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f109403aa50 0x7f10940dc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f10a1563640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f10940367e0 con 0x7f10940091c0 2024-04-25T02:08:06.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7fa421b06640 1 -- 172.21.15.79:0/3128641444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa41c162c90 con 0x7fa41c0d0520 2024-04-25T02:08:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f47cdeb7640 1 --2- 172.21.15.79:0/4232069828 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47c8072230 0x7f47c81f05d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f47c0007e40 tx=0x7f47c000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7ff372ffd640 1 -- 172.21.15.79:0/3136437192 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378037050 con 0x7ff3840d0520 2024-04-25T02:08:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7ff372ffd640 1 -- 172.21.15.79:0/3136437192 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff378038040 con 0x7ff3840d0520 2024-04-25T02:08:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7ff372ffd640 1 -- 172.21.15.79:0/3136437192 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378004490 con 0x7ff3840d0520 2024-04-25T02:08:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f5643fff640 1 --2- 172.21.15.79:0/4051300661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f564414dca0 0x7f56441523b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f563c005bb0 tx=0x7f563c004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7ff716ffd640 1 -- 172.21.15.79:0/3645738693 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff710017070 con 0x7ff7200711a0 2024-04-25T02:08:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f5640ff9640 1 -- 172.21.15.79:0/4051300661 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c044070 con 0x7f564414dca0 2024-04-25T02:08:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f564a7ce640 1 -- 172.21.15.79:0/4051300661 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56441512c0 con 0x7f564414dca0 2024-04-25T02:08:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f564a7ce640 1 -- 172.21.15.79:0/4051300661 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5644151bb0 con 0x7f564414dca0 2024-04-25T02:08:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f5640ff9640 1 -- 172.21.15.79:0/4051300661 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563c0080d0 con 0x7f564414dca0 2024-04-25T02:08:06.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f47be7fc640 1 -- 172.21.15.79:0/4232069828 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c001a070 con 0x7f47c8072230 2024-04-25T02:08:06.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f109affd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10940091c0 0x7f10940e50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f109b7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1094048c70 0x7f1094033e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f109affd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10940091c0 0x7f10940e50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49634/0 (socket says 172.21.15.79:49634) 2024-04-25T02:08:06.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f109affd640 1 -- 172.21.15.79:0/1214533398 learned_addr learned my addr 172.21.15.79:0/1214533398 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:06.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7ff728615640 1 -- 172.21.15.79:0/3645738693 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff72009c3a0 con 0x7ff7200711a0 2024-04-25T02:08:06.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7ff728615640 1 -- 172.21.15.79:0/3645738693 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff72009c960 con 0x7ff7200711a0 2024-04-25T02:08:06.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7ff716ffd640 1 -- 172.21.15.79:0/3645738693 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff710009300 con 0x7ff7200711a0 2024-04-25T02:08:06.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.612+0000 7ff716ffd640 1 -- 172.21.15.79:0/3645738693 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff710017070 con 0x7ff7200711a0 2024-04-25T02:08:06.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.612+0000 7f5640ff9640 1 -- 172.21.15.79:0/4051300661 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c0020c0 con 0x7f564414dca0 2024-04-25T02:08:06.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f47be7fc640 1 -- 172.21.15.79:0/4232069828 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c0015770 con 0x7f47c8072230 2024-04-25T02:08:06.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f47be7fc640 1 -- 172.21.15.79:0/4232069828 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0015b20 con 0x7f47c8072230 2024-04-25T02:08:06.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.613+0000 7ff388b42640 1 -- 172.21.15.79:0/3136437192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff384161600 con 0x7ff3840d0520 2024-04-25T02:08:06.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f47d011b640 1 -- 172.21.15.79:0/4232069828 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c813dd50 con 0x7f47c8072230 2024-04-25T02:08:06.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.611+0000 7f47d011b640 1 -- 172.21.15.79:0/4232069828 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c813e310 con 0x7f47c8072230 2024-04-25T02:08:06.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.613+0000 7ff388b42640 1 -- 172.21.15.79:0/3136437192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff384161bc0 con 0x7ff3840d0520 2024-04-25T02:08:06.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.613+0000 7fa421b06640 1 --2- 172.21.15.79:0/3128641444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa41c0d0520 0x7fa41c1f7b70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa41400c800 tx=0x7fa41400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.613+0000 7f109b7fe640 1 -- 172.21.15.79:0/1214533398 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10940091c0 msgr2=0x7f10940e50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.613+0000 7f109b7fe640 1 --2- 172.21.15.79:0/1214533398 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10940091c0 0x7f10940e50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.613+0000 7f109b7fe640 1 -- 172.21.15.79:0/1214533398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f109403aa50 msgr2=0x7f10940dc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.613+0000 7f109b7fe640 1 --2- 172.21.15.79:0/1214533398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f109403aa50 0x7f10940dc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.613+0000 7f109b7fe640 1 -- 172.21.15.79:0/1214533398 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1094032dd0 con 0x7f1094048c70 2024-04-25T02:08:06.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.613+0000 7f109b7fe640 1 --2- 172.21.15.79:0/1214533398 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1094048c70 0x7f1094033e70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f109c06a000 tx=0x7f109c06a2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.613+0000 7f47abfff640 1 -- 172.21.15.79:0/4232069828 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47a4005290 con 0x7f47c8072230 2024-04-25T02:08:06.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.614+0000 7f10837fe640 1 -- 172.21.15.79:0/1214533398 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c0b1610 con 0x7f1094048c70 2024-04-25T02:08:06.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.614+0000 7f10837fe640 1 -- 172.21.15.79:0/1214533398 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109c0b17b0 con 0x7f1094048c70 2024-04-25T02:08:06.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.614+0000 7f10837fe640 1 -- 172.21.15.79:0/1214533398 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c0b1b60 con 0x7f1094048c70 2024-04-25T02:08:06.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.614+0000 7ff388b42640 1 -- 172.21.15.79:0/3136437192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff384161fa0 con 0x7ff3840d0520 2024-04-25T02:08:06.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.615+0000 7f10a1563640 1 -- 172.21.15.79:0/1214533398 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10940330b0 con 0x7f1094048c70 2024-04-25T02:08:06.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.615+0000 7fa4127fc640 1 -- 172.21.15.79:0/3128641444 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa414003b70 con 0x7fa41c0d0520 2024-04-25T02:08:06.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.615+0000 7f10a1563640 1 -- 172.21.15.79:0/1214533398 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1094033670 con 0x7f1094048c70 2024-04-25T02:08:06.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.614+0000 7f5640ff9640 1 -- 172.21.15.79:0/4051300661 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f563c047070 con 0x7f564414dca0 2024-04-25T02:08:06.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.615+0000 7ff728615640 1 -- 172.21.15.79:0/3645738693 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff708005290 con 0x7ff7200711a0 2024-04-25T02:08:06.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.615+0000 7fa423d6a640 1 -- 172.21.15.79:0/3128641444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa41c1f80b0 con 0x7fa41c0d0520 2024-04-25T02:08:06.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.615+0000 7fa423d6a640 1 -- 172.21.15.79:0/3128641444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa41c163210 con 0x7fa41c0d0520 2024-04-25T02:08:06.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.615+0000 7f564a7ce640 1 -- 172.21.15.79:0/4051300661 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5624005290 con 0x7f564414dca0 2024-04-25T02:08:06.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.615+0000 7f47be7fc640 1 -- 172.21.15.79:0/4232069828 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47c001d070 con 0x7f47c8072230 2024-04-25T02:08:06.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.616+0000 7f47be7fc640 1 --2- 172.21.15.79:0/4232069828 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47ac06bf00 0x7f47ac06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.616+0000 7f47be7fc640 1 -- 172.21.15.79:0/4232069828 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f47c008b1d0 con 0x7f47c8072230 2024-04-25T02:08:06.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.616+0000 7f47cd6b6640 1 --2- 172.21.15.79:0/4232069828 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47ac06bf00 0x7f47ac06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.616+0000 7fa4127fc640 1 -- 172.21.15.79:0/3128641444 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa414003d10 con 0x7fa41c0d0520 2024-04-25T02:08:06.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.616+0000 7fa4127fc640 1 -- 172.21.15.79:0/3128641444 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41400aa30 con 0x7fa41c0d0520 2024-04-25T02:08:06.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.615+0000 7f5640ff9640 1 --2- 172.21.15.79:0/4051300661 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f563006bf00 0x7f563006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.615+0000 7f5640ff9640 1 -- 172.21.15.79:0/4051300661 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f563c0aaf40 con 0x7f564414dca0 2024-04-25T02:08:06.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.616+0000 7f56437fe640 1 --2- 172.21.15.79:0/4051300661 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f563006bf00 0x7f563006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.617+0000 7f10a1563640 1 -- 172.21.15.79:0/1214533398 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1094005810 con 0x7f1094048c70 2024-04-25T02:08:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.617+0000 7f47cd6b6640 1 --2- 172.21.15.79:0/4232069828 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47ac06bf00 0x7f47ac06e3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47c8152230 tx=0x7f47c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.616+0000 7ff716ffd640 1 -- 172.21.15.79:0/3645738693 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff71001a070 con 0x7ff7200711a0 2024-04-25T02:08:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.617+0000 7ff716ffd640 1 --2- 172.21.15.79:0/3645738693 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff70406c230 0x7ff70406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.617+0000 7ff725bb0640 1 --2- 172.21.15.79:0/3645738693 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff70406c230 0x7ff70406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.617+0000 7f56437fe640 1 --2- 172.21.15.79:0/4051300661 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f563006bf00 0x7f563006e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5644160170 tx=0x7f5638008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.617+0000 7ff372ffd640 1 -- 172.21.15.79:0/3136437192 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff378003610 con 0x7ff3840d0520 2024-04-25T02:08:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.617+0000 7ff716ffd640 1 -- 172.21.15.79:0/3645738693 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff71000f040 con 0x7ff7200711a0 2024-04-25T02:08:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.618+0000 7ff725bb0640 1 --2- 172.21.15.79:0/3645738693 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff70406c230 0x7ff70406e6f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff71c000c00 tx=0x7ff71c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.618+0000 7fa423d6a640 1 -- 172.21.15.79:0/3128641444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa404005290 con 0x7fa41c0d0520 2024-04-25T02:08:06.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.618+0000 7ff372ffd640 1 --2- 172.21.15.79:0/3136437192 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff36406bf00 0x7ff36406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.618+0000 7ff372ffd640 1 -- 172.21.15.79:0/3136437192 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff3780ab450 con 0x7ff3840d0520 2024-04-25T02:08:06.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.618+0000 7ff38259c640 1 --2- 172.21.15.79:0/3136437192 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff36406bf00 0x7ff36406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.618+0000 7f10837fe640 1 -- 172.21.15.79:0/1214533398 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f109c0c3030 con 0x7f1094048c70 2024-04-25T02:08:06.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.618+0000 7f10837fe640 1 --2- 172.21.15.79:0/1214533398 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f108806bf30 0x7f108806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.619+0000 7ff38259c640 1 --2- 172.21.15.79:0/3136437192 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff36406bf00 0x7ff36406e3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff37400af30 tx=0x7ff374008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.619+0000 7f10837fe640 1 -- 172.21.15.79:0/1214533398 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f109c1268f0 con 0x7f1094048c70 2024-04-25T02:08:06.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.619+0000 7f109affd640 1 --2- 172.21.15.79:0/1214533398 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f108806bf30 0x7f108806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.619+0000 7f109affd640 1 --2- 172.21.15.79:0/1214533398 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f108806bf30 0x7f108806e3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f108c005880 tx=0x7f108c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.619+0000 7f47be7fc640 1 -- 172.21.15.79:0/4232069828 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f47c0024020 con 0x7f47c8072230 2024-04-25T02:08:06.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.621+0000 7f5640ff9640 1 -- 172.21.15.79:0/4051300661 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f56441605a0 con 0x7f564414dca0 2024-04-25T02:08:06.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.622+0000 7ff716ffd640 1 -- 172.21.15.79:0/3645738693 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff710058cd0 con 0x7ff7200711a0 2024-04-25T02:08:06.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.623+0000 7fa4127fc640 1 -- 172.21.15.79:0/3128641444 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa41400abd0 con 0x7fa41c0d0520 2024-04-25T02:08:06.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.623+0000 7fa4127fc640 1 --2- 172.21.15.79:0/3128641444 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa40006be30 0x7fa40006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:06.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.624+0000 7fa421305640 1 --2- 172.21.15.79:0/3128641444 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa40006be30 0x7fa40006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:06.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.624+0000 7fa421305640 1 --2- 172.21.15.79:0/3128641444 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa40006be30 0x7fa40006e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa418034000 tx=0x7fa41802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:06.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.627+0000 7f10837fe640 1 -- 172.21.15.79:0/1214533398 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f109c0ca020 con 0x7f1094048c70 2024-04-25T02:08:06.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.627+0000 7fa4127fc640 1 -- 172.21.15.79:0/3128641444 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa414057b90 con 0x7fa41c0d0520 2024-04-25T02:08:06.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.628+0000 7ff372ffd640 1 -- 172.21.15.79:0/3136437192 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff384161fa0 con 0x7ff3840d0520 2024-04-25T02:08:06.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.632+0000 7fa4127fc640 1 -- 172.21.15.79:0/3128641444 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa41405a1f0 con 0x7fa41c0d0520 2024-04-25T02:08:06.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.966+0000 7f875d9ed640 1 -- 172.21.15.79:0/2543093855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8738005580 con 0x7f8750007da0 2024-04-25T02:08:06.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.967+0000 7f873ffff640 1 -- 172.21.15.79:0/2543093855 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8748058760 con 0x7f8750007da0 2024-04-25T02:08:06.974 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-04-25T02:08:06.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.970+0000 7f873dffb640 1 -- 172.21.15.79:0/2543093855 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f874406bf30 msgr2=0x7f874406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.970+0000 7f873dffb640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f874406bf30 0x7f874406e3f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f874c006fd0 tx=0x7f874c008040 comp rx=0 tx=0).stop 2024-04-25T02:08:06.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.970+0000 7f873dffb640 1 -- 172.21.15.79:0/2543093855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8750007da0 msgr2=0x7f87500d7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:06.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.970+0000 7f873dffb640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8750007da0 0x7f87500d7eb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f874800b780 tx=0x7f874800bc40 comp rx=0 tx=0).stop 2024-04-25T02:08:06.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.970+0000 7f873dffb640 1 -- 172.21.15.79:0/2543093855 shutdown_connections 2024-04-25T02:08:06.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.971+0000 7f873dffb640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f874406bf30 0x7f874406e3f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.971+0000 7f873dffb640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87500d83f0 0x7f8750053f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.971+0000 7f873dffb640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f87500e3550 0x7f8750053a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.971+0000 7f873dffb640 1 --2- 172.21.15.79:0/2543093855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8750007da0 0x7f87500d7eb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:06.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.971+0000 7f873dffb640 1 -- 172.21.15.79:0/2543093855 >> 172.21.15.79:0/2543093855 conn(0x7f875001f120 msgr2=0x7f87500e1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:06.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.971+0000 7f873dffb640 1 -- 172.21.15.79:0/2543093855 shutdown_connections 2024-04-25T02:08:06.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:06.971+0000 7f873dffb640 1 -- 172.21.15.79:0/2543093855 wait complete. 2024-04-25T02:08:06.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-04-25T02:08:06.995 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:07.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.007+0000 7ff388b42640 1 -- 172.21.15.79:0/3136437192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff3840681e0 con 0x7ff3840d0520 2024-04-25T02:08:07.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.007+0000 7ff372ffd640 1 -- 172.21.15.79:0/3136437192 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff378079e70 con 0x7ff3840d0520 2024-04-25T02:08:07.014 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-04-25T02:08:07.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.009+0000 7ff388b42640 1 -- 172.21.15.79:0/3136437192 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff36406bf00 msgr2=0x7ff36406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.009+0000 7ff388b42640 1 --2- 172.21.15.79:0/3136437192 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff36406bf00 0x7ff36406e3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff37400af30 tx=0x7ff374008040 comp rx=0 tx=0).stop 2024-04-25T02:08:07.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.010+0000 7ff388b42640 1 -- 172.21.15.79:0/3136437192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3840d0520 msgr2=0x7ff3841fb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.010+0000 7ff388b42640 1 --2- 172.21.15.79:0/3136437192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3840d0520 0x7ff3841fb870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff378009890 tx=0x7ff3780046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.011+0000 7ff388b42640 1 -- 172.21.15.79:0/3136437192 shutdown_connections 2024-04-25T02:08:07.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.011+0000 7ff388b42640 1 --2- 172.21.15.79:0/3136437192 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff36406bf00 0x7ff36406e3c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.011+0000 7ff388b42640 1 --2- 172.21.15.79:0/3136437192 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff3840d0900 0x7ff3841fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.011+0000 7ff388b42640 1 --2- 172.21.15.79:0/3136437192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3840d0520 0x7ff3841fb870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.011+0000 7ff388b42640 1 --2- 172.21.15.79:0/3136437192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff38406d140 0x7ff38415ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.011+0000 7ff388b42640 1 -- 172.21.15.79:0/3136437192 >> 172.21.15.79:0/3136437192 conn(0x7ff38406b290 msgr2=0x7ff3840ae680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:07.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.011+0000 7ff388b42640 1 -- 172.21.15.79:0/3136437192 shutdown_connections 2024-04-25T02:08:07.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.011+0000 7ff388b42640 1 -- 172.21.15.79:0/3136437192 wait complete. 2024-04-25T02:08:07.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-04-25T02:08:07.029 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.029+0000 7f7a4d2f8640 1 -- 172.21.15.79:0/1428882317 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7a40005390 con 0x7f7a4004fa90 2024-04-25T02:08:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.030+0000 7f7a44ff9640 1 -- 172.21.15.79:0/1428882317 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7a3c059190 con 0x7f7a4004fa90 2024-04-25T02:08:07.037 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-04-25T02:08:07.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.032+0000 7f7a4d2f8640 1 -- 172.21.15.79:0/1428882317 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7a2c06bf00 msgr2=0x7f7a2c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.033+0000 7f7a4d2f8640 1 --2- 172.21.15.79:0/1428882317 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7a2c06bf00 0x7f7a2c06e3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7a48000b60 tx=0x7f7a480ab000 comp rx=0 tx=0).stop 2024-04-25T02:08:07.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.033+0000 7f7a4d2f8640 1 -- 172.21.15.79:0/1428882317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a4004fa90 msgr2=0x7f7a400d3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.033+0000 7f7a4d2f8640 1 --2- 172.21.15.79:0/1428882317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a4004fa90 0x7f7a400d3d90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00c5c0 tx=0x7f7a3c00ca80 comp rx=0 tx=0).stop 2024-04-25T02:08:07.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.033+0000 7f7a4d2f8640 1 -- 172.21.15.79:0/1428882317 shutdown_connections 2024-04-25T02:08:07.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.033+0000 7f7a4d2f8640 1 --2- 172.21.15.79:0/1428882317 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7a2c06bf00 0x7f7a2c06e3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.033+0000 7f7a4d2f8640 1 --2- 172.21.15.79:0/1428882317 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7a400df420 0x7f7a400d6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.033+0000 7f7a4d2f8640 1 --2- 172.21.15.79:0/1428882317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a4004fa90 0x7f7a400d3d90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.033+0000 7f7a4d2f8640 1 --2- 172.21.15.79:0/1428882317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a40038800 0x7f7a4004e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.033+0000 7f7a4d2f8640 1 -- 172.21.15.79:0/1428882317 >> 172.21.15.79:0/1428882317 conn(0x7f7a40009fb0 msgr2=0x7f7a400de5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:07.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.033+0000 7f7a4d2f8640 1 -- 172.21.15.79:0/1428882317 shutdown_connections 2024-04-25T02:08:07.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.033+0000 7f7a4d2f8640 1 -- 172.21.15.79:0/1428882317 wait complete. 2024-04-25T02:08:07.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.041+0000 7f564a7ce640 1 -- 172.21.15.79:0/4051300661 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5624005580 con 0x7f564414dca0 2024-04-25T02:08:07.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.041+0000 7ff728615640 1 -- 172.21.15.79:0/3645738693 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff708005850 con 0x7ff7200711a0 2024-04-25T02:08:07.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.041+0000 7f5640ff9640 1 -- 172.21.15.79:0/4051300661 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f563c0798d0 con 0x7f564414dca0 2024-04-25T02:08:07.049 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-04-25T02:08:07.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.042+0000 7ff716ffd640 1 -- 172.21.15.79:0/3645738693 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff7100585d0 con 0x7ff7200711a0 2024-04-25T02:08:07.049 INFO:teuthology.orchestra.run.smithi079.stdout:55834574855 2024-04-25T02:08:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.044+0000 7f564a7ce640 1 -- 172.21.15.79:0/4051300661 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f563006bf00 msgr2=0x7f563006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.044+0000 7f564a7ce640 1 --2- 172.21.15.79:0/4051300661 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f563006bf00 0x7f563006e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5644160170 tx=0x7f5638008040 comp rx=0 tx=0).stop 2024-04-25T02:08:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.044+0000 7f564a7ce640 1 -- 172.21.15.79:0/4051300661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f564414dca0 msgr2=0x7f56441523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.044+0000 7f564a7ce640 1 --2- 172.21.15.79:0/4051300661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f564414dca0 0x7f56441523b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f563c005bb0 tx=0x7f563c004e20 comp rx=0 tx=0).stop 2024-04-25T02:08:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.044+0000 7f564a7ce640 1 -- 172.21.15.79:0/4051300661 shutdown_connections 2024-04-25T02:08:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.044+0000 7f564a7ce640 1 --2- 172.21.15.79:0/4051300661 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f563006bf00 0x7f563006e3c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.044+0000 7f564a7ce640 1 --2- 172.21.15.79:0/4051300661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5644150590 0x7f5644150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.044+0000 7f564a7ce640 1 --2- 172.21.15.79:0/4051300661 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56440b5460 0x7f56440b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.044+0000 7f564a7ce640 1 --2- 172.21.15.79:0/4051300661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f564414dca0 0x7f56441523b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.044+0000 7f564a7ce640 1 -- 172.21.15.79:0/4051300661 >> 172.21.15.79:0/4051300661 conn(0x7f5644071640 msgr2=0x7f56440b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:07.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.044+0000 7f564a7ce640 1 -- 172.21.15.79:0/4051300661 shutdown_connections 2024-04-25T02:08:07.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.044+0000 7f564a7ce640 1 -- 172.21.15.79:0/4051300661 wait complete. 2024-04-25T02:08:07.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.045+0000 7ff728615640 1 -- 172.21.15.79:0/3645738693 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff70406c230 msgr2=0x7ff70406e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.045+0000 7ff728615640 1 --2- 172.21.15.79:0/3645738693 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff70406c230 0x7ff70406e6f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff71c000c00 tx=0x7ff71c008030 comp rx=0 tx=0).stop 2024-04-25T02:08:07.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.045+0000 7ff728615640 1 -- 172.21.15.79:0/3645738693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7200711a0 msgr2=0x7ff720159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.045+0000 7ff728615640 1 --2- 172.21.15.79:0/3645738693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7200711a0 0x7ff720159960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff71000e900 tx=0x7ff71000edc0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.045+0000 7ff728615640 1 -- 172.21.15.79:0/3645738693 shutdown_connections 2024-04-25T02:08:07.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.045+0000 7ff728615640 1 --2- 172.21.15.79:0/3645738693 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff70406c230 0x7ff70406e6f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.045+0000 7ff728615640 1 --2- 172.21.15.79:0/3645738693 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7200ceba0 0x7ff7200cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.045+0000 7ff728615640 1 --2- 172.21.15.79:0/3645738693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff720143c70 0x7ff72009bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.045+0000 7ff728615640 1 --2- 172.21.15.79:0/3645738693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7200711a0 0x7ff720159960 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.045+0000 7ff728615640 1 -- 172.21.15.79:0/3645738693 >> 172.21.15.79:0/3645738693 conn(0x7ff72006b290 msgr2=0x7ff7200b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:07.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.045+0000 7ff728615640 1 -- 172.21.15.79:0/3645738693 shutdown_connections 2024-04-25T02:08:07.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.045+0000 7ff728615640 1 -- 172.21.15.79:0/3645738693 wait complete. 2024-04-25T02:08:07.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.045+0000 7f10a1563640 1 -- 172.21.15.79:0/1214533398 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f109404cae0 con 0x7f1094048c70 2024-04-25T02:08:07.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.046+0000 7f10837fe640 1 -- 172.21.15.79:0/1214533398 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f109c0b7040 con 0x7f1094048c70 2024-04-25T02:08:07.056 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-04-25T02:08:07.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-04-25T02:08:07.057 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:07.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.048+0000 7f10a1563640 1 -- 172.21.15.79:0/1214533398 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f108806bf30 msgr2=0x7f108806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.048+0000 7f10a1563640 1 --2- 172.21.15.79:0/1214533398 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f108806bf30 0x7f108806e3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f108c005880 tx=0x7f108c009040 comp rx=0 tx=0).stop 2024-04-25T02:08:07.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.049+0000 7f10a1563640 1 -- 172.21.15.79:0/1214533398 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1094048c70 msgr2=0x7f1094033e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.049+0000 7f10a1563640 1 --2- 172.21.15.79:0/1214533398 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1094048c70 0x7f1094033e70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f109c06a000 tx=0x7f109c06a2d0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.049+0000 7f10a1563640 1 -- 172.21.15.79:0/1214533398 shutdown_connections 2024-04-25T02:08:07.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.049+0000 7f10a1563640 1 --2- 172.21.15.79:0/1214533398 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f108806bf30 0x7f108806e3f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.049+0000 7f10a1563640 1 --2- 172.21.15.79:0/1214533398 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1094048c70 0x7f1094033e70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.049+0000 7f10a1563640 1 --2- 172.21.15.79:0/1214533398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f109403aa50 0x7f10940dc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.049+0000 7f10a1563640 1 --2- 172.21.15.79:0/1214533398 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10940091c0 0x7f10940e50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.049+0000 7f10a1563640 1 -- 172.21.15.79:0/1214533398 >> 172.21.15.79:0/1214533398 conn(0x7f109401ef70 msgr2=0x7f109400b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:07.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.049+0000 7f10a1563640 1 -- 172.21.15.79:0/1214533398 shutdown_connections 2024-04-25T02:08:07.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.049+0000 7f10a1563640 1 -- 172.21.15.79:0/1214533398 wait complete. 2024-04-25T02:08:07.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.050+0000 7f47abfff640 1 -- 172.21.15.79:0/4232069828 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f47a4005850 con 0x7f47c8072230 2024-04-25T02:08:07.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.051+0000 7f47be7fc640 1 -- 172.21.15.79:0/4232069828 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f47c0059bf0 con 0x7f47c8072230 2024-04-25T02:08:07.060 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-04-25T02:08:07.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.052+0000 7fa423d6a640 1 -- 172.21.15.79:0/3128641444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa404005850 con 0x7fa41c0d0520 2024-04-25T02:08:07.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.053+0000 7fa4127fc640 1 -- 172.21.15.79:0/3128641444 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa41405ae20 con 0x7fa41c0d0520 2024-04-25T02:08:07.061 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-04-25T02:08:07.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.054+0000 7f47abfff640 1 -- 172.21.15.79:0/4232069828 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47ac06bf00 msgr2=0x7f47ac06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.054+0000 7f47abfff640 1 --2- 172.21.15.79:0/4232069828 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47ac06bf00 0x7f47ac06e3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47c8152230 tx=0x7f47c4009040 comp rx=0 tx=0).stop 2024-04-25T02:08:07.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.054+0000 7f47abfff640 1 -- 172.21.15.79:0/4232069828 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47c8072230 msgr2=0x7f47c81f05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.054+0000 7f47abfff640 1 --2- 172.21.15.79:0/4232069828 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47c8072230 0x7f47c81f05d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f47c0007e40 tx=0x7f47c000e4b0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.054+0000 7f47abfff640 1 -- 172.21.15.79:0/4232069828 shutdown_connections 2024-04-25T02:08:07.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.054+0000 7f47abfff640 1 --2- 172.21.15.79:0/4232069828 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47ac06bf00 0x7f47ac06e3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.054+0000 7f47abfff640 1 --2- 172.21.15.79:0/4232069828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47c815a7a0 0x7f47c8155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.054+0000 7f47abfff640 1 --2- 172.21.15.79:0/4232069828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47c80b3650 0x7f47c813cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.054+0000 7f47abfff640 1 --2- 172.21.15.79:0/4232069828 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47c8072230 0x7f47c81f05d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.054+0000 7f47abfff640 1 -- 172.21.15.79:0/4232069828 >> 172.21.15.79:0/4232069828 conn(0x7f47c80b25c0 msgr2=0x7f47c80b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:07.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.054+0000 7f47abfff640 1 -- 172.21.15.79:0/4232069828 shutdown_connections 2024-04-25T02:08:07.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.054+0000 7f47abfff640 1 -- 172.21.15.79:0/4232069828 wait complete. 2024-04-25T02:08:07.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.055+0000 7fa423d6a640 1 -- 172.21.15.79:0/3128641444 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa40006be30 msgr2=0x7fa40006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.055+0000 7fa423d6a640 1 --2- 172.21.15.79:0/3128641444 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa40006be30 0x7fa40006e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa418034000 tx=0x7fa41802e000 comp rx=0 tx=0).stop 2024-04-25T02:08:07.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.055+0000 7fa423d6a640 1 -- 172.21.15.79:0/3128641444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa41c0d0520 msgr2=0x7fa41c1f7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.055+0000 7fa423d6a640 1 --2- 172.21.15.79:0/3128641444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa41c0d0520 0x7fa41c1f7b70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa41400c800 tx=0x7fa41400ccc0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.055+0000 7fa423d6a640 1 -- 172.21.15.79:0/3128641444 shutdown_connections 2024-04-25T02:08:07.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.055+0000 7fa423d6a640 1 --2- 172.21.15.79:0/3128641444 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa40006be30 0x7fa40006e2f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.055+0000 7fa423d6a640 1 --2- 172.21.15.79:0/3128641444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa41c166150 0x7fa41c1653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.056+0000 7fa423d6a640 1 --2- 172.21.15.79:0/3128641444 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa41c0d0900 0x7fa41c09c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.056+0000 7fa423d6a640 1 --2- 172.21.15.79:0/3128641444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa41c0d0520 0x7fa41c1f7b70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.056+0000 7fa423d6a640 1 -- 172.21.15.79:0/3128641444 >> 172.21.15.79:0/3128641444 conn(0x7fa41c06b290 msgr2=0x7fa41c072530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:07.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.056+0000 7fa423d6a640 1 -- 172.21.15.79:0/3128641444 shutdown_connections 2024-04-25T02:08:07.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.056+0000 7fa423d6a640 1 -- 172.21.15.79:0/3128641444 wait complete. 2024-04-25T02:08:07.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-04-25T02:08:07.067 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:07.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-04-25T02:08:07.070 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:07.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-04-25T02:08:07.073 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:07.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-04-25T02:08:07.079 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:07.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-04-25T02:08:07.080 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:07.080 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T02:08:07.080 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:08:07.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.210+0000 7fa36b3a2640 1 Processor -- start 2024-04-25T02:08:07.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.210+0000 7fa36b3a2640 1 -- start start 2024-04-25T02:08:07.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.211+0000 7fa36b3a2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa36406e3e0 0x7fa364071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.211+0000 7fa36b3a2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa364070d90 con 0x7fa364144cb0 2024-04-25T02:08:07.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.211+0000 7fa36b3a2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3640cf130 con 0x7fa36406df50 2024-04-25T02:08:07.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.211+0000 7fa36b3a2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa3640cf410 con 0x7fa36406e3e0 2024-04-25T02:08:07.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.211+0000 7fa36993f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa36406e3e0 0x7fa364071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.211+0000 7fa36913e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa364144cb0 0x7fa3640b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47824/0 (socket says 172.21.15.79:47824) 2024-04-25T02:08:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.211+0000 7fa36913e640 1 -- 172.21.15.79:0/4271896526 learned_addr learned my addr 172.21.15.79:0/4271896526 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.211+0000 7fa36993f640 1 -- 172.21.15.79:0/4271896526 >> v1:172.21.15.189:6789/0 conn(0x7fa36406df50 legacy=0x7fa364071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.211+0000 7fa36993f640 1 -- 172.21.15.79:0/4271896526 >> v1:172.21.15.79:6789/0 conn(0x7fa364144cb0 legacy=0x7fa3640b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.211+0000 7fa35bfff640 1 -- 172.21.15.79:0/4271896526 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1094546116 0 0) 0x7fa364070d90 con 0x7fa364144cb0 2024-04-25T02:08:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.211+0000 7fa36993f640 1 -- 172.21.15.79:0/4271896526 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3640cf6f0 con 0x7fa36406e3e0 2024-04-25T02:08:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.212+0000 7fa36993f640 1 --2- 172.21.15.79:0/4271896526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa36406e3e0 0x7fa364071950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0097a0 tx=0x7fa35c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddd06d9bc66efe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.212+0000 7fa35bfff640 1 -- 172.21.15.79:0/4271896526 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c037070 con 0x7fa36406e3e0 2024-04-25T02:08:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.212+0000 7fa35bfff640 1 -- 172.21.15.79:0/4271896526 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa35c02adc0 con 0x7fa36406e3e0 2024-04-25T02:08:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.212+0000 7fa35bfff640 1 -- 172.21.15.79:0/4271896526 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c032660 con 0x7fa36406e3e0 2024-04-25T02:08:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.213+0000 7fa36b3a2640 1 -- 172.21.15.79:0/4271896526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa36406e3e0 msgr2=0x7fa364071950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.213+0000 7fa36b3a2640 1 --2- 172.21.15.79:0/4271896526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa36406e3e0 0x7fa364071950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0097a0 tx=0x7fa35c02a0b0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.213+0000 7fa36b3a2640 1 -- 172.21.15.79:0/4271896526 shutdown_connections 2024-04-25T02:08:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.213+0000 7fa36b3a2640 1 --2- 172.21.15.79:0/4271896526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa36406e3e0 0x7fa364071950 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.213+0000 7fa36b3a2640 1 -- 172.21.15.79:0/4271896526 >> 172.21.15.79:0/4271896526 conn(0x7fa3640cfc80 msgr2=0x7fa3640d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.213+0000 7fa36b3a2640 1 -- 172.21.15.79:0/4271896526 shutdown_connections 2024-04-25T02:08:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.213+0000 7fa36b3a2640 1 -- 172.21.15.79:0/4271896526 wait complete. 2024-04-25T02:08:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.214+0000 7fa36b3a2640 1 Processor -- start 2024-04-25T02:08:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.214+0000 7fa36b3a2640 1 -- start start 2024-04-25T02:08:07.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36b3a2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa36406df50 0x7fa36415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36b3a2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36406e3e0 0x7fa36413af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36b3a2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa364144cb0 0x7fa36413b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36b3a2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa3640cf9d0 con 0x7fa36406df50 2024-04-25T02:08:07.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36b3a2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa3640b5750 con 0x7fa364144cb0 2024-04-25T02:08:07.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36b3a2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa364145090 con 0x7fa36406e3e0 2024-04-25T02:08:07.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36913e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa36406df50 0x7fa36415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36913e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa36406df50 0x7fa36415d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35184/0 (socket says 172.21.15.79:35184) 2024-04-25T02:08:07.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36913e640 1 -- 172.21.15.79:0/1241231184 learned_addr learned my addr 172.21.15.79:0/1241231184 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:07.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36993f640 1 --2- 172.21.15.79:0/1241231184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa364144cb0 0x7fa36413b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36893d640 1 --2- 172.21.15.79:0/1241231184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36406e3e0 0x7fa36413af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36913e640 1 -- 172.21.15.79:0/1241231184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36406e3e0 msgr2=0x7fa36413af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36913e640 1 --2- 172.21.15.79:0/1241231184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36406e3e0 0x7fa36413af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36913e640 1 -- 172.21.15.79:0/1241231184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa364144cb0 msgr2=0x7fa36413b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36913e640 1 --2- 172.21.15.79:0/1241231184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa364144cb0 0x7fa36413b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36913e640 1 -- 172.21.15.79:0/1241231184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36413fda0 con 0x7fa36406df50 2024-04-25T02:08:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36913e640 1 --2- 172.21.15.79:0/1241231184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa36406df50 0x7fa36415d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa36000c7c0 tx=0x7fa36000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa359ffb640 1 -- 172.21.15.79:0/1241231184 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360018070 con 0x7fa36406df50 2024-04-25T02:08:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa359ffb640 1 -- 172.21.15.79:0/1241231184 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36000a640 con 0x7fa36406df50 2024-04-25T02:08:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa359ffb640 1 -- 172.21.15.79:0/1241231184 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36000aa30 con 0x7fa36406df50 2024-04-25T02:08:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.215+0000 7fa36b3a2640 1 -- 172.21.15.79:0/1241231184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3641e66c0 con 0x7fa36406df50 2024-04-25T02:08:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.216+0000 7fa36b3a2640 1 -- 172.21.15.79:0/1241231184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3641e6c80 con 0x7fa36406df50 2024-04-25T02:08:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.217+0000 7fa36b3a2640 1 -- 172.21.15.79:0/1241231184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3640690a0 con 0x7fa36406df50 2024-04-25T02:08:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.217+0000 7fa359ffb640 1 -- 172.21.15.79:0/1241231184 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa36001b070 con 0x7fa36406df50 2024-04-25T02:08:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.217+0000 7fa359ffb640 1 --2- 172.21.15.79:0/1241231184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa34806be30 0x7fa34806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.217+0000 7fa359ffb640 1 -- 172.21.15.79:0/1241231184 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa36008a460 con 0x7fa36406df50 2024-04-25T02:08:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.217+0000 7fa36893d640 1 --2- 172.21.15.79:0/1241231184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa34806be30 0x7fa34806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.218+0000 7fa36893d640 1 --2- 172.21.15.79:0/1241231184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa34806be30 0x7fa34806e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa354007fd0 tx=0x7fa354009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.221+0000 7fa359ffb640 1 -- 172.21.15.79:0/1241231184 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa360058ea0 con 0x7fa36406df50 2024-04-25T02:08:07.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.392+0000 7fa36b3a2640 1 -- 172.21.15.79:0/1241231184 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3640d0b90 con 0x7fa34806be30 2024-04-25T02:08:07.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.398+0000 7fa359ffb640 1 -- 172.21.15.79:0/1241231184 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fa3640d0b90 con 0x7fa34806be30 2024-04-25T02:08:07.408 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:07.409 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:08:07.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.401+0000 7fa36b3a2640 1 -- 172.21.15.79:0/1241231184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa34806be30 msgr2=0x7fa34806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.401+0000 7fa36b3a2640 1 --2- 172.21.15.79:0/1241231184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa34806be30 0x7fa34806e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa354007fd0 tx=0x7fa354009040 comp rx=0 tx=0).stop 2024-04-25T02:08:07.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.401+0000 7fa36b3a2640 1 -- 172.21.15.79:0/1241231184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa36406df50 msgr2=0x7fa36415d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.401+0000 7fa36b3a2640 1 --2- 172.21.15.79:0/1241231184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa36406df50 0x7fa36415d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa36000c7c0 tx=0x7fa36000cc80 comp rx=0 tx=0).stop 2024-04-25T02:08:07.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.401+0000 7fa36b3a2640 1 -- 172.21.15.79:0/1241231184 shutdown_connections 2024-04-25T02:08:07.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.401+0000 7fa36b3a2640 1 --2- 172.21.15.79:0/1241231184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa34806be30 0x7fa34806e2f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.401+0000 7fa36b3a2640 1 --2- 172.21.15.79:0/1241231184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa364144cb0 0x7fa36413b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.401+0000 7fa36b3a2640 1 --2- 172.21.15.79:0/1241231184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36406e3e0 0x7fa36413af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.401+0000 7fa36b3a2640 1 --2- 172.21.15.79:0/1241231184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa36406df50 0x7fa36415d1a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.401+0000 7fa36b3a2640 1 -- 172.21.15.79:0/1241231184 >> 172.21.15.79:0/1241231184 conn(0x7fa3640cfc80 msgr2=0x7fa3640741a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:07.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.401+0000 7fa36b3a2640 1 -- 172.21.15.79:0/1241231184 shutdown_connections 2024-04-25T02:08:07.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.401+0000 7fa36b3a2640 1 -- 172.21.15.79:0/1241231184 wait complete. 2024-04-25T02:08:07.419 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T02:08:07.175675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219108,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755612,"statfs":{"total":773094113280,"available":772869746688,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001546"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207407+0000","last_change":"2024-04-25T02:08:00.134308+0000","last_active":"2024-04-25T02:08:01.207407+0000","last_peered":"2024-04-25T02:08:01.207407+0000","last_clean":"2024-04-25T02:08:01.207407+0000","last_became_active":"2024-04-25T02:08:00.134045+0000","last_became_peered":"2024-04-25T02:08:00.134045+0000","last_unstale":"2024-04-25T02:08:01.207407+0000","last_undegraded":"2024-04-25T02:08:01.207407+0000","last_fullsized":"2024-04-25T02:08:01.207407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:48.665413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113746+0000","last_change":"2024-04-25T02:08:00.132540+0000","last_active":"2024-04-25T02:08:01.113746+0000","last_peered":"2024-04-25T02:08:01.113746+0000","last_clean":"2024-04-25T02:08:01.113746+0000","last_became_active":"2024-04-25T02:08:00.132284+0000","last_became_peered":"2024-04-25T02:08:00.132284+0000","last_unstale":"2024-04-25T02:08:01.113746+0000","last_undegraded":"2024-04-25T02:08:01.113746+0000","last_fullsized":"2024-04-25T02:08:01.113746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:54.475986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117551+0000","last_change":"2024-04-25T02:08:00.130002+0000","last_active":"2024-04-25T02:08:01.117551+0000","last_peered":"2024-04-25T02:08:01.117551+0000","last_clean":"2024-04-25T02:08:01.117551+0000","last_became_active":"2024-04-25T02:08:00.129736+0000","last_became_peered":"2024-04-25T02:08:00.129736+0000","last_unstale":"2024-04-25T02:08:01.117551+0000","last_undegraded":"2024-04-25T02:08:01.117551+0000","last_fullsized":"2024-04-25T02:08:01.117551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:02.955874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114971+0000","last_change":"2024-04-25T02:08:00.132017+0000","last_active":"2024-04-25T02:08:01.114971+0000","last_peered":"2024-04-25T02:08:01.114971+0000","last_clean":"2024-04-25T02:08:01.114971+0000","last_became_active":"2024-04-25T02:08:00.131698+0000","last_became_peered":"2024-04-25T02:08:00.131698+0000","last_unstale":"2024-04-25T02:08:01.114971+0000","last_undegraded":"2024-04-25T02:08:01.114971+0000","last_fullsized":"2024-04-25T02:08:01.114971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:28.873330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118266+0000","last_change":"2024-04-25T02:08:00.136752+0000","last_active":"2024-04-25T02:08:01.118266+0000","last_peered":"2024-04-25T02:08:01.118266+0000","last_clean":"2024-04-25T02:08:01.118266+0000","last_became_active":"2024-04-25T02:08:00.136403+0000","last_became_peered":"2024-04-25T02:08:00.136403+0000","last_unstale":"2024-04-25T02:08:01.118266+0000","last_undegraded":"2024-04-25T02:08:01.118266+0000","last_fullsized":"2024-04-25T02:08:01.118266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:43.197680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114307+0000","last_change":"2024-04-25T02:08:00.133501+0000","last_active":"2024-04-25T02:08:01.114307+0000","last_peered":"2024-04-25T02:08:01.114307+0000","last_clean":"2024-04-25T02:08:01.114307+0000","last_became_active":"2024-04-25T02:08:00.133172+0000","last_became_peered":"2024-04-25T02:08:00.133172+0000","last_unstale":"2024-04-25T02:08:01.114307+0000","last_undegraded":"2024-04-25T02:08:01.114307+0000","last_fullsized":"2024-04-25T02:08:01.114307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:19:21.910512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118112+0000","last_change":"2024-04-25T02:08:00.138392+0000","last_active":"2024-04-25T02:08:01.118112+0000","last_peered":"2024-04-25T02:08:01.118112+0000","last_clean":"2024-04-25T02:08:01.118112+0000","last_became_active":"2024-04-25T02:08:00.138116+0000","last_became_peered":"2024-04-25T02:08:00.138116+0000","last_unstale":"2024-04-25T02:08:01.118112+0000","last_undegraded":"2024-04-25T02:08:01.118112+0000","last_fullsized":"2024-04-25T02:08:01.118112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.809054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117173+0000","last_change":"2024-04-25T02:08:00.137802+0000","last_active":"2024-04-25T02:08:01.117173+0000","last_peered":"2024-04-25T02:08:01.117173+0000","last_clean":"2024-04-25T02:08:01.117173+0000","last_became_active":"2024-04-25T02:08:00.136849+0000","last_became_peered":"2024-04-25T02:08:00.136849+0000","last_unstale":"2024-04-25T02:08:01.117173+0000","last_undegraded":"2024-04-25T02:08:01.117173+0000","last_fullsized":"2024-04-25T02:08:01.117173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:04.753150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118140+0000","last_change":"2024-04-25T02:08:00.143112+0000","last_active":"2024-04-25T02:08:01.118140+0000","last_peered":"2024-04-25T02:08:01.118140+0000","last_clean":"2024-04-25T02:08:01.118140+0000","last_became_active":"2024-04-25T02:08:00.142709+0000","last_became_peered":"2024-04-25T02:08:00.142709+0000","last_unstale":"2024-04-25T02:08:01.118140+0000","last_undegraded":"2024-04-25T02:08:01.118140+0000","last_fullsized":"2024-04-25T02:08:01.118140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:19.162081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115147+0000","last_change":"2024-04-25T02:08:00.130702+0000","last_active":"2024-04-25T02:08:01.115147+0000","last_peered":"2024-04-25T02:08:01.115147+0000","last_clean":"2024-04-25T02:08:01.115147+0000","last_became_active":"2024-04-25T02:08:00.125460+0000","last_became_peered":"2024-04-25T02:08:00.125460+0000","last_unstale":"2024-04-25T02:08:01.115147+0000","last_undegraded":"2024-04-25T02:08:01.115147+0000","last_fullsized":"2024-04-25T02:08:01.115147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:17.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114727+0000","last_change":"2024-04-25T02:08:00.125792+0000","last_active":"2024-04-25T02:08:01.114727+0000","last_peered":"2024-04-25T02:08:01.114727+0000","last_clean":"2024-04-25T02:08:01.114727+0000","last_became_active":"2024-04-25T02:08:00.125520+0000","last_became_peered":"2024-04-25T02:08:00.125520+0000","last_unstale":"2024-04-25T02:08:01.114727+0000","last_undegraded":"2024-04-25T02:08:01.114727+0000","last_fullsized":"2024-04-25T02:08:01.114727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:29.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118193+0000","last_change":"2024-04-25T02:08:00.134810+0000","last_active":"2024-04-25T02:08:01.118193+0000","last_peered":"2024-04-25T02:08:01.118193+0000","last_clean":"2024-04-25T02:08:01.118193+0000","last_became_active":"2024-04-25T02:08:00.134532+0000","last_became_peered":"2024-04-25T02:08:00.134532+0000","last_unstale":"2024-04-25T02:08:01.118193+0000","last_undegraded":"2024-04-25T02:08:01.118193+0000","last_fullsized":"2024-04-25T02:08:01.118193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:02.073911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118235+0000","last_change":"2024-04-25T02:08:00.133643+0000","last_active":"2024-04-25T02:08:01.118235+0000","last_peered":"2024-04-25T02:08:01.118235+0000","last_clean":"2024-04-25T02:08:01.118235+0000","last_became_active":"2024-04-25T02:08:00.133375+0000","last_became_peered":"2024-04-25T02:08:00.133375+0000","last_unstale":"2024-04-25T02:08:01.118235+0000","last_undegraded":"2024-04-25T02:08:01.118235+0000","last_fullsized":"2024-04-25T02:08:01.118235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:19:21.910512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117517+0000","last_change":"2024-04-25T02:08:00.127128+0000","last_active":"2024-04-25T02:08:01.117517+0000","last_peered":"2024-04-25T02:08:01.117517+0000","last_clean":"2024-04-25T02:08:01.117517+0000","last_became_active":"2024-04-25T02:08:00.126836+0000","last_became_peered":"2024-04-25T02:08:00.126836+0000","last_unstale":"2024-04-25T02:08:01.117517+0000","last_undegraded":"2024-04-25T02:08:01.117517+0000","last_fullsized":"2024-04-25T02:08:01.117517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:04.753150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113310+0000","last_change":"2024-04-25T02:08:00.119494+0000","last_active":"2024-04-25T02:08:01.113310+0000","last_peered":"2024-04-25T02:08:01.113310+0000","last_clean":"2024-04-25T02:08:01.113310+0000","last_became_active":"2024-04-25T02:08:00.119237+0000","last_became_peered":"2024-04-25T02:08:00.119237+0000","last_unstale":"2024-04-25T02:08:01.113310+0000","last_undegraded":"2024-04-25T02:08:01.113310+0000","last_fullsized":"2024-04-25T02:08:01.113310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:27.956618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114158+0000","last_change":"2024-04-25T02:08:00.133489+0000","last_active":"2024-04-25T02:08:01.114158+0000","last_peered":"2024-04-25T02:08:01.114158+0000","last_clean":"2024-04-25T02:08:01.114158+0000","last_became_active":"2024-04-25T02:08:00.133134+0000","last_became_peered":"2024-04-25T02:08:00.133134+0000","last_unstale":"2024-04-25T02:08:01.114158+0000","last_undegraded":"2024-04-25T02:08:01.114158+0000","last_fullsized":"2024-04-25T02:08:01.114158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:17.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115169+0000","last_change":"2024-04-25T02:08:00.141819+0000","last_active":"2024-04-25T02:08:01.115169+0000","last_peered":"2024-04-25T02:08:01.115169+0000","last_clean":"2024-04-25T02:08:01.115169+0000","last_became_active":"2024-04-25T02:08:00.141488+0000","last_became_peered":"2024-04-25T02:08:00.141488+0000","last_unstale":"2024-04-25T02:08:01.115169+0000","last_undegraded":"2024-04-25T02:08:01.115169+0000","last_fullsized":"2024-04-25T02:08:01.115169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:46.350349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117853+0000","last_change":"2024-04-25T02:08:00.133178+0000","last_active":"2024-04-25T02:08:01.117853+0000","last_peered":"2024-04-25T02:08:01.117853+0000","last_clean":"2024-04-25T02:08:01.117853+0000","last_became_active":"2024-04-25T02:08:00.132881+0000","last_became_peered":"2024-04-25T02:08:00.132881+0000","last_unstale":"2024-04-25T02:08:01.117853+0000","last_undegraded":"2024-04-25T02:08:01.117853+0000","last_fullsized":"2024-04-25T02:08:01.117853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:46.930603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207506+0000","last_change":"2024-04-25T02:08:00.139667+0000","last_active":"2024-04-25T02:08:01.207506+0000","last_peered":"2024-04-25T02:08:01.207506+0000","last_clean":"2024-04-25T02:08:01.207506+0000","last_became_active":"2024-04-25T02:08:00.139398+0000","last_became_peered":"2024-04-25T02:08:00.139398+0000","last_unstale":"2024-04-25T02:08:01.207506+0000","last_undegraded":"2024-04-25T02:08:01.207506+0000","last_fullsized":"2024-04-25T02:08:01.207506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:39.354188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114335+0000","last_change":"2024-04-25T02:08:00.124339+0000","last_active":"2024-04-25T02:08:01.114335+0000","last_peered":"2024-04-25T02:08:01.114335+0000","last_clean":"2024-04-25T02:08:01.114335+0000","last_became_active":"2024-04-25T02:08:00.124078+0000","last_became_peered":"2024-04-25T02:08:00.124078+0000","last_unstale":"2024-04-25T02:08:01.114335+0000","last_undegraded":"2024-04-25T02:08:01.114335+0000","last_fullsized":"2024-04-25T02:08:01.114335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:02.955874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117681+0000","last_change":"2024-04-25T02:08:00.140606+0000","last_active":"2024-04-25T02:08:01.117681+0000","last_peered":"2024-04-25T02:08:01.117681+0000","last_clean":"2024-04-25T02:08:01.117681+0000","last_became_active":"2024-04-25T02:08:00.140357+0000","last_became_peered":"2024-04-25T02:08:00.140357+0000","last_unstale":"2024-04-25T02:08:01.117681+0000","last_undegraded":"2024-04-25T02:08:01.117681+0000","last_fullsized":"2024-04-25T02:08:01.117681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:27:41.665005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114519+0000","last_change":"2024-04-25T02:08:00.142382+0000","last_active":"2024-04-25T02:08:01.114519+0000","last_peered":"2024-04-25T02:08:01.114519+0000","last_clean":"2024-04-25T02:08:01.114519+0000","last_became_active":"2024-04-25T02:08:00.142008+0000","last_became_peered":"2024-04-25T02:08:00.142008+0000","last_unstale":"2024-04-25T02:08:01.114519+0000","last_undegraded":"2024-04-25T02:08:01.114519+0000","last_fullsized":"2024-04-25T02:08:01.114519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.809054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117888+0000","last_change":"2024-04-25T02:08:00.137764+0000","last_active":"2024-04-25T02:08:01.117888+0000","last_peered":"2024-04-25T02:08:01.117888+0000","last_clean":"2024-04-25T02:08:01.117888+0000","last_became_active":"2024-04-25T02:08:00.136712+0000","last_became_peered":"2024-04-25T02:08:00.136712+0000","last_unstale":"2024-04-25T02:08:01.117888+0000","last_undegraded":"2024-04-25T02:08:01.117888+0000","last_fullsized":"2024-04-25T02:08:01.117888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:27:41.665005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114262+0000","last_change":"2024-04-25T02:08:00.132628+0000","last_active":"2024-04-25T02:08:01.114262+0000","last_peered":"2024-04-25T02:08:01.114262+0000","last_clean":"2024-04-25T02:08:01.114262+0000","last_became_active":"2024-04-25T02:08:00.132290+0000","last_became_peered":"2024-04-25T02:08:00.132290+0000","last_unstale":"2024-04-25T02:08:01.114262+0000","last_undegraded":"2024-04-25T02:08:01.114262+0000","last_fullsized":"2024-04-25T02:08:01.114262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:54.475986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118051+0000","last_change":"2024-04-25T02:08:00.136212+0000","last_active":"2024-04-25T02:08:01.118051+0000","last_peered":"2024-04-25T02:08:01.118051+0000","last_clean":"2024-04-25T02:08:01.118051+0000","last_became_active":"2024-04-25T02:08:00.135931+0000","last_became_peered":"2024-04-25T02:08:00.135931+0000","last_unstale":"2024-04-25T02:08:01.118051+0000","last_undegraded":"2024-04-25T02:08:01.118051+0000","last_fullsized":"2024-04-25T02:08:01.118051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:29.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115305+0000","last_change":"2024-04-25T02:08:00.137685+0000","last_active":"2024-04-25T02:08:01.115305+0000","last_peered":"2024-04-25T02:08:01.115305+0000","last_clean":"2024-04-25T02:08:01.115305+0000","last_became_active":"2024-04-25T02:08:00.137442+0000","last_became_peered":"2024-04-25T02:08:00.137442+0000","last_unstale":"2024-04-25T02:08:01.115305+0000","last_undegraded":"2024-04-25T02:08:01.115305+0000","last_fullsized":"2024-04-25T02:08:01.115305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:54.475986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113612+0000","last_change":"2024-04-25T02:08:00.131268+0000","last_active":"2024-04-25T02:08:01.113612+0000","last_peered":"2024-04-25T02:08:01.113612+0000","last_clean":"2024-04-25T02:08:01.113612+0000","last_became_active":"2024-04-25T02:08:00.130015+0000","last_became_peered":"2024-04-25T02:08:00.130015+0000","last_unstale":"2024-04-25T02:08:01.113612+0000","last_undegraded":"2024-04-25T02:08:01.113612+0000","last_fullsized":"2024-04-25T02:08:01.113612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:17.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118432+0000","last_change":"2024-04-25T02:08:00.135564+0000","last_active":"2024-04-25T02:08:01.118432+0000","last_peered":"2024-04-25T02:08:01.118432+0000","last_clean":"2024-04-25T02:08:01.118432+0000","last_became_active":"2024-04-25T02:08:00.135043+0000","last_became_peered":"2024-04-25T02:08:00.135043+0000","last_unstale":"2024-04-25T02:08:01.118432+0000","last_undegraded":"2024-04-25T02:08:01.118432+0000","last_fullsized":"2024-04-25T02:08:01.118432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:28.873330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117735+0000","last_change":"2024-04-25T02:08:00.140028+0000","last_active":"2024-04-25T02:08:01.117735+0000","last_peered":"2024-04-25T02:08:01.117735+0000","last_clean":"2024-04-25T02:08:01.117735+0000","last_became_active":"2024-04-25T02:08:00.139690+0000","last_became_peered":"2024-04-25T02:08:00.139690+0000","last_unstale":"2024-04-25T02:08:01.117735+0000","last_undegraded":"2024-04-25T02:08:01.117735+0000","last_fullsized":"2024-04-25T02:08:01.117735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:29.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115205+0000","last_change":"2024-04-25T02:08:00.136871+0000","last_active":"2024-04-25T02:08:01.115205+0000","last_peered":"2024-04-25T02:08:01.115205+0000","last_clean":"2024-04-25T02:08:01.115205+0000","last_became_active":"2024-04-25T02:08:00.136394+0000","last_became_peered":"2024-04-25T02:08:00.136394+0000","last_unstale":"2024-04-25T02:08:01.115205+0000","last_undegraded":"2024-04-25T02:08:01.115205+0000","last_fullsized":"2024-04-25T02:08:01.115205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:19.162081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117127+0000","last_change":"2024-04-25T02:08:00.126418+0000","last_active":"2024-04-25T02:08:01.117127+0000","last_peered":"2024-04-25T02:08:01.117127+0000","last_clean":"2024-04-25T02:08:01.117127+0000","last_became_active":"2024-04-25T02:08:00.126139+0000","last_became_peered":"2024-04-25T02:08:00.126139+0000","last_unstale":"2024-04-25T02:08:01.117127+0000","last_undegraded":"2024-04-25T02:08:01.117127+0000","last_fullsized":"2024-04-25T02:08:01.117127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:18.092551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114405+0000","last_change":"2024-04-25T02:08:00.135252+0000","last_active":"2024-04-25T02:08:01.114405+0000","last_peered":"2024-04-25T02:08:01.114405+0000","last_clean":"2024-04-25T02:08:01.114405+0000","last_became_active":"2024-04-25T02:08:00.133592+0000","last_became_peered":"2024-04-25T02:08:00.133592+0000","last_unstale":"2024-04-25T02:08:01.114405+0000","last_undegraded":"2024-04-25T02:08:01.114405+0000","last_fullsized":"2024-04-25T02:08:01.114405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:27:41.665005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117711+0000","last_change":"2024-04-25T02:08:00.127933+0000","last_active":"2024-04-25T02:08:01.117711+0000","last_peered":"2024-04-25T02:08:01.117711+0000","last_clean":"2024-04-25T02:08:01.117711+0000","last_became_active":"2024-04-25T02:08:00.127073+0000","last_became_peered":"2024-04-25T02:08:00.127073+0000","last_unstale":"2024-04-25T02:08:01.117711+0000","last_undegraded":"2024-04-25T02:08:01.117711+0000","last_fullsized":"2024-04-25T02:08:01.117711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:27.208335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118446+0000","last_change":"2024-04-25T02:07:59.116340+0000","last_active":"2024-04-25T02:08:01.118446+0000","last_peered":"2024-04-25T02:08:01.118446+0000","last_clean":"2024-04-25T02:08:01.118446+0000","last_became_active":"2024-04-25T02:07:59.116056+0000","last_became_peered":"2024-04-25T02:07:59.116056+0000","last_unstale":"2024-04-25T02:08:01.118446+0000","last_undegraded":"2024-04-25T02:08:01.118446+0000","last_fullsized":"2024-04-25T02:08:01.118446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:52:35.221325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117809+0000","last_change":"2024-04-25T02:08:00.133885+0000","last_active":"2024-04-25T02:08:01.117809+0000","last_peered":"2024-04-25T02:08:01.117809+0000","last_clean":"2024-04-25T02:08:01.117809+0000","last_became_active":"2024-04-25T02:08:00.133640+0000","last_became_peered":"2024-04-25T02:08:00.133640+0000","last_unstale":"2024-04-25T02:08:01.117809+0000","last_undegraded":"2024-04-25T02:08:01.117809+0000","last_fullsized":"2024-04-25T02:08:01.117809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:54.475986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114528+0000","last_change":"2024-04-25T02:07:59.111628+0000","last_active":"2024-04-25T02:08:01.114528+0000","last_peered":"2024-04-25T02:08:01.114528+0000","last_clean":"2024-04-25T02:08:01.114528+0000","last_became_active":"2024-04-25T02:07:59.111154+0000","last_became_peered":"2024-04-25T02:07:59.111154+0000","last_unstale":"2024-04-25T02:08:01.114528+0000","last_undegraded":"2024-04-25T02:08:01.114528+0000","last_fullsized":"2024-04-25T02:08:01.114528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:44:38.307212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117995+0000","last_change":"2024-04-25T02:07:59.116279+0000","last_active":"2024-04-25T02:08:01.117995+0000","last_peered":"2024-04-25T02:08:01.117995+0000","last_clean":"2024-04-25T02:08:01.117995+0000","last_became_active":"2024-04-25T02:07:59.115993+0000","last_became_peered":"2024-04-25T02:07:59.115993+0000","last_unstale":"2024-04-25T02:08:01.117995+0000","last_undegraded":"2024-04-25T02:08:01.117995+0000","last_fullsized":"2024-04-25T02:08:01.117995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:19.399199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117236+0000","last_change":"2024-04-25T02:08:00.137646+0000","last_active":"2024-04-25T02:08:01.117236+0000","last_peered":"2024-04-25T02:08:01.117236+0000","last_clean":"2024-04-25T02:08:01.117236+0000","last_became_active":"2024-04-25T02:08:00.137395+0000","last_became_peered":"2024-04-25T02:08:00.137395+0000","last_unstale":"2024-04-25T02:08:01.117236+0000","last_undegraded":"2024-04-25T02:08:01.117236+0000","last_fullsized":"2024-04-25T02:08:01.117236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:02.955874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114277+0000","last_change":"2024-04-25T02:07:59.115698+0000","last_active":"2024-04-25T02:08:01.114277+0000","last_peered":"2024-04-25T02:08:01.114277+0000","last_clean":"2024-04-25T02:08:01.114277+0000","last_became_active":"2024-04-25T02:07:59.115462+0000","last_became_peered":"2024-04-25T02:07:59.115462+0000","last_unstale":"2024-04-25T02:08:01.114277+0000","last_undegraded":"2024-04-25T02:08:01.114277+0000","last_fullsized":"2024-04-25T02:08:01.114277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:19.399199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113305+0000","last_change":"2024-04-25T02:08:00.131043+0000","last_active":"2024-04-25T02:08:01.113305+0000","last_peered":"2024-04-25T02:08:01.113305+0000","last_clean":"2024-04-25T02:08:01.113305+0000","last_became_active":"2024-04-25T02:08:00.129225+0000","last_became_peered":"2024-04-25T02:08:00.129225+0000","last_unstale":"2024-04-25T02:08:01.113305+0000","last_undegraded":"2024-04-25T02:08:01.113305+0000","last_fullsized":"2024-04-25T02:08:01.113305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:02.955874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115331+0000","last_change":"2024-04-25T02:07:59.117828+0000","last_active":"2024-04-25T02:08:01.115331+0000","last_peered":"2024-04-25T02:08:01.115331+0000","last_clean":"2024-04-25T02:08:01.115331+0000","last_became_active":"2024-04-25T02:07:59.117497+0000","last_became_peered":"2024-04-25T02:07:59.117497+0000","last_unstale":"2024-04-25T02:08:01.115331+0000","last_undegraded":"2024-04-25T02:08:01.115331+0000","last_fullsized":"2024-04-25T02:08:01.115331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:50.979492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115383+0000","last_change":"2024-04-25T02:08:00.142794+0000","last_active":"2024-04-25T02:08:01.115383+0000","last_peered":"2024-04-25T02:08:01.115383+0000","last_clean":"2024-04-25T02:08:01.115383+0000","last_became_active":"2024-04-25T02:08:00.142308+0000","last_became_peered":"2024-04-25T02:08:00.142308+0000","last_unstale":"2024-04-25T02:08:01.115383+0000","last_undegraded":"2024-04-25T02:08:01.115383+0000","last_fullsized":"2024-04-25T02:08:01.115383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:02.221034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115265+0000","last_change":"2024-04-25T02:07:59.120424+0000","last_active":"2024-04-25T02:08:01.115265+0000","last_peered":"2024-04-25T02:08:01.115265+0000","last_clean":"2024-04-25T02:08:01.115265+0000","last_became_active":"2024-04-25T02:07:59.120173+0000","last_became_peered":"2024-04-25T02:07:59.120173+0000","last_unstale":"2024-04-25T02:08:01.115265+0000","last_undegraded":"2024-04-25T02:08:01.115265+0000","last_fullsized":"2024-04-25T02:08:01.115265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:44:38.307212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117861+0000","last_change":"2024-04-25T02:08:00.135525+0000","last_active":"2024-04-25T02:08:01.117861+0000","last_peered":"2024-04-25T02:08:01.117861+0000","last_clean":"2024-04-25T02:08:01.117861+0000","last_became_active":"2024-04-25T02:08:00.134949+0000","last_became_peered":"2024-04-25T02:08:00.134949+0000","last_unstale":"2024-04-25T02:08:01.117861+0000","last_undegraded":"2024-04-25T02:08:01.117861+0000","last_fullsized":"2024-04-25T02:08:01.117861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:19:21.910512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113595+0000","last_change":"2024-04-25T02:07:59.114638+0000","last_active":"2024-04-25T02:08:01.113595+0000","last_peered":"2024-04-25T02:08:01.113595+0000","last_clean":"2024-04-25T02:08:01.113595+0000","last_became_active":"2024-04-25T02:07:59.114338+0000","last_became_peered":"2024-04-25T02:07:59.114338+0000","last_unstale":"2024-04-25T02:08:01.113595+0000","last_undegraded":"2024-04-25T02:08:01.113595+0000","last_fullsized":"2024-04-25T02:08:01.113595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:26.203451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118240+0000","last_change":"2024-04-25T02:08:00.124104+0000","last_active":"2024-04-25T02:08:01.118240+0000","last_peered":"2024-04-25T02:08:01.118240+0000","last_clean":"2024-04-25T02:08:01.118240+0000","last_became_active":"2024-04-25T02:08:00.123799+0000","last_became_peered":"2024-04-25T02:08:00.123799+0000","last_unstale":"2024-04-25T02:08:01.118240+0000","last_undegraded":"2024-04-25T02:08:01.118240+0000","last_fullsized":"2024-04-25T02:08:01.118240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:56.058112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114450+0000","last_change":"2024-04-25T02:07:59.116463+0000","last_active":"2024-04-25T02:08:01.114450+0000","last_peered":"2024-04-25T02:08:01.114450+0000","last_clean":"2024-04-25T02:08:01.114450+0000","last_became_active":"2024-04-25T02:07:59.116202+0000","last_became_peered":"2024-04-25T02:07:59.116202+0000","last_unstale":"2024-04-25T02:08:01.114450+0000","last_undegraded":"2024-04-25T02:08:01.114450+0000","last_fullsized":"2024-04-25T02:08:01.114450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:26.203451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118149+0000","last_change":"2024-04-25T02:08:00.140394+0000","last_active":"2024-04-25T02:08:01.118149+0000","last_peered":"2024-04-25T02:08:01.118149+0000","last_clean":"2024-04-25T02:08:01.118149+0000","last_became_active":"2024-04-25T02:08:00.140115+0000","last_became_peered":"2024-04-25T02:08:00.140115+0000","last_unstale":"2024-04-25T02:08:01.118149+0000","last_undegraded":"2024-04-25T02:08:01.118149+0000","last_fullsized":"2024-04-25T02:08:01.118149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:28.873330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117847+0000","last_change":"2024-04-25T02:07:59.107413+0000","last_active":"2024-04-25T02:08:01.117847+0000","last_peered":"2024-04-25T02:08:01.117847+0000","last_clean":"2024-04-25T02:08:01.117847+0000","last_became_active":"2024-04-25T02:07:59.107130+0000","last_became_peered":"2024-04-25T02:07:59.107130+0000","last_unstale":"2024-04-25T02:08:01.117847+0000","last_undegraded":"2024-04-25T02:08:01.117847+0000","last_fullsized":"2024-04-25T02:08:01.117847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:00.403236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117661+0000","last_change":"2024-04-25T02:08:00.138818+0000","last_active":"2024-04-25T02:08:01.117661+0000","last_peered":"2024-04-25T02:08:01.117661+0000","last_clean":"2024-04-25T02:08:01.117661+0000","last_became_active":"2024-04-25T02:08:00.136665+0000","last_became_peered":"2024-04-25T02:08:00.136665+0000","last_unstale":"2024-04-25T02:08:01.117661+0000","last_undegraded":"2024-04-25T02:08:01.117661+0000","last_fullsized":"2024-04-25T02:08:01.117661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:27.956618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115772+0000","last_change":"2024-04-25T02:07:59.116545+0000","last_active":"2024-04-25T02:08:01.115772+0000","last_peered":"2024-04-25T02:08:01.115772+0000","last_clean":"2024-04-25T02:08:01.115772+0000","last_became_active":"2024-04-25T02:07:59.116250+0000","last_became_peered":"2024-04-25T02:07:59.116250+0000","last_unstale":"2024-04-25T02:08:01.115772+0000","last_undegraded":"2024-04-25T02:08:01.115772+0000","last_fullsized":"2024-04-25T02:08:01.115772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:50.979492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207453+0000","last_change":"2024-04-25T02:08:00.135486+0000","last_active":"2024-04-25T02:08:01.207453+0000","last_peered":"2024-04-25T02:08:01.207453+0000","last_clean":"2024-04-25T02:08:01.207453+0000","last_became_active":"2024-04-25T02:08:00.135113+0000","last_became_peered":"2024-04-25T02:08:00.135113+0000","last_unstale":"2024-04-25T02:08:01.207453+0000","last_undegraded":"2024-04-25T02:08:01.207453+0000","last_fullsized":"2024-04-25T02:08:01.207453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:08:42.030490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114589+0000","last_change":"2024-04-25T02:07:59.114698+0000","last_active":"2024-04-25T02:08:01.114589+0000","last_peered":"2024-04-25T02:08:01.114589+0000","last_clean":"2024-04-25T02:08:01.114589+0000","last_became_active":"2024-04-25T02:07:59.114388+0000","last_became_peered":"2024-04-25T02:07:59.114388+0000","last_unstale":"2024-04-25T02:08:01.114589+0000","last_undegraded":"2024-04-25T02:08:01.114589+0000","last_fullsized":"2024-04-25T02:08:01.114589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:19.399199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114299+0000","last_change":"2024-04-25T02:08:00.131335+0000","last_active":"2024-04-25T02:08:01.114299+0000","last_peered":"2024-04-25T02:08:01.114299+0000","last_clean":"2024-04-25T02:08:01.114299+0000","last_became_active":"2024-04-25T02:08:00.130929+0000","last_became_peered":"2024-04-25T02:08:00.130929+0000","last_unstale":"2024-04-25T02:08:01.114299+0000","last_undegraded":"2024-04-25T02:08:01.114299+0000","last_fullsized":"2024-04-25T02:08:01.114299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:04.753150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117010+0000","last_change":"2024-04-25T02:07:59.113230+0000","last_active":"2024-04-25T02:08:01.117010+0000","last_peered":"2024-04-25T02:08:01.117010+0000","last_clean":"2024-04-25T02:08:01.117010+0000","last_became_active":"2024-04-25T02:07:59.112920+0000","last_became_peered":"2024-04-25T02:07:59.112920+0000","last_unstale":"2024-04-25T02:08:01.117010+0000","last_undegraded":"2024-04-25T02:08:01.117010+0000","last_fullsized":"2024-04-25T02:08:01.117010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:19.399199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207322+0000","last_change":"2024-04-25T02:08:00.135668+0000","last_active":"2024-04-25T02:08:01.207322+0000","last_peered":"2024-04-25T02:08:01.207322+0000","last_clean":"2024-04-25T02:08:01.207322+0000","last_became_active":"2024-04-25T02:08:00.135381+0000","last_became_peered":"2024-04-25T02:08:00.135381+0000","last_unstale":"2024-04-25T02:08:01.207322+0000","last_undegraded":"2024-04-25T02:08:01.207322+0000","last_fullsized":"2024-04-25T02:08:01.207322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:46.350349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118215+0000","last_change":"2024-04-25T02:07:59.108897+0000","last_active":"2024-04-25T02:08:01.118215+0000","last_peered":"2024-04-25T02:08:01.118215+0000","last_clean":"2024-04-25T02:08:01.118215+0000","last_became_active":"2024-04-25T02:07:59.108622+0000","last_became_peered":"2024-04-25T02:07:59.108622+0000","last_unstale":"2024-04-25T02:08:01.118215+0000","last_undegraded":"2024-04-25T02:08:01.118215+0000","last_fullsized":"2024-04-25T02:08:01.118215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:00.403236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207360+0000","last_change":"2024-04-25T02:08:00.136207+0000","last_active":"2024-04-25T02:08:01.207360+0000","last_peered":"2024-04-25T02:08:01.207360+0000","last_clean":"2024-04-25T02:08:01.207360+0000","last_became_active":"2024-04-25T02:08:00.135952+0000","last_became_peered":"2024-04-25T02:08:00.135952+0000","last_unstale":"2024-04-25T02:08:01.207360+0000","last_undegraded":"2024-04-25T02:08:01.207360+0000","last_fullsized":"2024-04-25T02:08:01.207360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:02.221034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117957+0000","last_change":"2024-04-25T02:07:59.117277+0000","last_active":"2024-04-25T02:08:01.117957+0000","last_peered":"2024-04-25T02:08:01.117957+0000","last_clean":"2024-04-25T02:08:01.117957+0000","last_became_active":"2024-04-25T02:07:59.116747+0000","last_became_peered":"2024-04-25T02:07:59.116747+0000","last_unstale":"2024-04-25T02:08:01.117957+0000","last_undegraded":"2024-04-25T02:08:01.117957+0000","last_fullsized":"2024-04-25T02:08:01.117957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:44:38.307212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118279+0000","last_change":"2024-04-25T02:08:00.139343+0000","last_active":"2024-04-25T02:08:01.118279+0000","last_peered":"2024-04-25T02:08:01.118279+0000","last_clean":"2024-04-25T02:08:01.118279+0000","last_became_active":"2024-04-25T02:08:00.138642+0000","last_became_peered":"2024-04-25T02:08:00.138642+0000","last_unstale":"2024-04-25T02:08:01.118279+0000","last_undegraded":"2024-04-25T02:08:01.118279+0000","last_fullsized":"2024-04-25T02:08:01.118279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:36.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113704+0000","last_change":"2024-04-25T02:07:59.112377+0000","last_active":"2024-04-25T02:08:01.113704+0000","last_peered":"2024-04-25T02:08:01.113704+0000","last_clean":"2024-04-25T02:08:01.113704+0000","last_became_active":"2024-04-25T02:07:59.112103+0000","last_became_peered":"2024-04-25T02:07:59.112103+0000","last_unstale":"2024-04-25T02:08:01.113704+0000","last_undegraded":"2024-04-25T02:08:01.113704+0000","last_fullsized":"2024-04-25T02:08:01.113704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:50.979492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115219+0000","last_change":"2024-04-25T02:08:00.133208+0000","last_active":"2024-04-25T02:08:01.115219+0000","last_peered":"2024-04-25T02:08:01.115219+0000","last_clean":"2024-04-25T02:08:01.115219+0000","last_became_active":"2024-04-25T02:08:00.132881+0000","last_became_peered":"2024-04-25T02:08:00.132881+0000","last_unstale":"2024-04-25T02:08:01.115219+0000","last_undegraded":"2024-04-25T02:08:01.115219+0000","last_fullsized":"2024-04-25T02:08:01.115219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:41.987311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117687+0000","last_change":"2024-04-25T02:07:59.117515+0000","last_active":"2024-04-25T02:08:01.117687+0000","last_peered":"2024-04-25T02:08:01.117687+0000","last_clean":"2024-04-25T02:08:01.117687+0000","last_became_active":"2024-04-25T02:07:59.117244+0000","last_became_peered":"2024-04-25T02:07:59.117244+0000","last_unstale":"2024-04-25T02:08:01.117687+0000","last_undegraded":"2024-04-25T02:08:01.117687+0000","last_fullsized":"2024-04-25T02:08:01.117687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:50.979492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207349+0000","last_change":"2024-04-25T02:08:00.143967+0000","last_active":"2024-04-25T02:08:01.207349+0000","last_peered":"2024-04-25T02:08:01.207349+0000","last_clean":"2024-04-25T02:08:01.207349+0000","last_became_active":"2024-04-25T02:08:00.143648+0000","last_became_peered":"2024-04-25T02:08:00.143648+0000","last_unstale":"2024-04-25T02:08:01.207349+0000","last_undegraded":"2024-04-25T02:08:01.207349+0000","last_fullsized":"2024-04-25T02:08:01.207349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:41.987311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117708+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:08:01.117708+0000","last_peered":"2024-04-25T02:08:01.117708+0000","last_clean":"2024-04-25T02:08:01.117708+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:08:01.117708+0000","last_undegraded":"2024-04-25T02:08:01.117708+0000","last_fullsized":"2024-04-25T02:08:01.117708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114625+0000","last_change":"2024-04-25T02:07:59.117637+0000","last_active":"2024-04-25T02:08:01.114625+0000","last_peered":"2024-04-25T02:08:01.114625+0000","last_clean":"2024-04-25T02:08:01.114625+0000","last_became_active":"2024-04-25T02:07:59.116977+0000","last_became_peered":"2024-04-25T02:07:59.116977+0000","last_unstale":"2024-04-25T02:08:01.114625+0000","last_undegraded":"2024-04-25T02:08:01.114625+0000","last_fullsized":"2024-04-25T02:08:01.114625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:26.203451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118264+0000","last_change":"2024-04-25T02:08:00.141683+0000","last_active":"2024-04-25T02:08:01.118264+0000","last_peered":"2024-04-25T02:08:01.118264+0000","last_clean":"2024-04-25T02:08:01.118264+0000","last_became_active":"2024-04-25T02:08:00.141434+0000","last_became_peered":"2024-04-25T02:08:00.141434+0000","last_unstale":"2024-04-25T02:08:01.118264+0000","last_undegraded":"2024-04-25T02:08:01.118264+0000","last_fullsized":"2024-04-25T02:08:01.118264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.809054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117679+0000","last_change":"2024-04-25T02:07:59.117708+0000","last_active":"2024-04-25T02:08:01.117679+0000","last_peered":"2024-04-25T02:08:01.117679+0000","last_clean":"2024-04-25T02:08:01.117679+0000","last_became_active":"2024-04-25T02:07:59.117400+0000","last_became_peered":"2024-04-25T02:07:59.117400+0000","last_unstale":"2024-04-25T02:08:01.117679+0000","last_undegraded":"2024-04-25T02:08:01.117679+0000","last_fullsized":"2024-04-25T02:08:01.117679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:45.925719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117332+0000","last_change":"2024-04-25T02:08:00.134117+0000","last_active":"2024-04-25T02:08:01.117332+0000","last_peered":"2024-04-25T02:08:01.117332+0000","last_clean":"2024-04-25T02:08:01.117332+0000","last_became_active":"2024-04-25T02:08:00.133834+0000","last_became_peered":"2024-04-25T02:08:00.133834+0000","last_unstale":"2024-04-25T02:08:01.117332+0000","last_undegraded":"2024-04-25T02:08:01.117332+0000","last_fullsized":"2024-04-25T02:08:01.117332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:03.610376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117110+0000","last_change":"2024-04-25T02:07:59.117339+0000","last_active":"2024-04-25T02:08:01.117110+0000","last_peered":"2024-04-25T02:08:01.117110+0000","last_clean":"2024-04-25T02:08:01.117110+0000","last_became_active":"2024-04-25T02:07:59.116562+0000","last_became_peered":"2024-04-25T02:07:59.116562+0000","last_unstale":"2024-04-25T02:08:01.117110+0000","last_undegraded":"2024-04-25T02:08:01.117110+0000","last_fullsized":"2024-04-25T02:08:01.117110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:52:35.221325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113308+0000","last_change":"2024-04-25T02:08:00.127645+0000","last_active":"2024-04-25T02:08:01.113308+0000","last_peered":"2024-04-25T02:08:01.113308+0000","last_clean":"2024-04-25T02:08:01.113308+0000","last_became_active":"2024-04-25T02:08:00.127261+0000","last_became_peered":"2024-04-25T02:08:00.127261+0000","last_unstale":"2024-04-25T02:08:01.113308+0000","last_undegraded":"2024-04-25T02:08:01.113308+0000","last_fullsized":"2024-04-25T02:08:01.113308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:27:41.665005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115821+0000","last_change":"2024-04-25T02:07:59.114633+0000","last_active":"2024-04-25T02:08:01.115821+0000","last_peered":"2024-04-25T02:08:01.115821+0000","last_clean":"2024-04-25T02:08:01.115821+0000","last_became_active":"2024-04-25T02:07:59.114349+0000","last_became_peered":"2024-04-25T02:07:59.114349+0000","last_unstale":"2024-04-25T02:08:01.115821+0000","last_undegraded":"2024-04-25T02:08:01.115821+0000","last_fullsized":"2024-04-25T02:08:01.115821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:06.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117977+0000","last_change":"2024-04-25T02:08:00.131106+0000","last_active":"2024-04-25T02:08:01.117977+0000","last_peered":"2024-04-25T02:08:01.117977+0000","last_clean":"2024-04-25T02:08:01.117977+0000","last_became_active":"2024-04-25T02:08:00.130507+0000","last_became_peered":"2024-04-25T02:08:00.130507+0000","last_unstale":"2024-04-25T02:08:01.117977+0000","last_undegraded":"2024-04-25T02:08:01.117977+0000","last_fullsized":"2024-04-25T02:08:01.117977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:46.930603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113534+0000","last_change":"2024-04-25T02:07:59.108809+0000","last_active":"2024-04-25T02:08:01.113534+0000","last_peered":"2024-04-25T02:08:01.113534+0000","last_clean":"2024-04-25T02:08:01.113534+0000","last_became_active":"2024-04-25T02:07:59.108512+0000","last_became_peered":"2024-04-25T02:07:59.108512+0000","last_unstale":"2024-04-25T02:08:01.113534+0000","last_undegraded":"2024-04-25T02:08:01.113534+0000","last_fullsized":"2024-04-25T02:08:01.113534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:06.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115650+0000","last_change":"2024-04-25T02:08:00.132084+0000","last_active":"2024-04-25T02:08:01.115650+0000","last_peered":"2024-04-25T02:08:01.115650+0000","last_clean":"2024-04-25T02:08:01.115650+0000","last_became_active":"2024-04-25T02:08:00.131767+0000","last_became_peered":"2024-04-25T02:08:00.131767+0000","last_unstale":"2024-04-25T02:08:01.115650+0000","last_undegraded":"2024-04-25T02:08:01.115650+0000","last_fullsized":"2024-04-25T02:08:01.115650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:08:42.030490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207466+0000","last_change":"2024-04-25T02:07:59.118487+0000","last_active":"2024-04-25T02:08:01.207466+0000","last_peered":"2024-04-25T02:08:01.207466+0000","last_clean":"2024-04-25T02:08:01.207466+0000","last_became_active":"2024-04-25T02:07:59.118201+0000","last_became_peered":"2024-04-25T02:07:59.118201+0000","last_unstale":"2024-04-25T02:08:01.207466+0000","last_undegraded":"2024-04-25T02:08:01.207466+0000","last_fullsized":"2024-04-25T02:08:01.207466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:55.053228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113576+0000","last_change":"2024-04-25T02:08:00.131978+0000","last_active":"2024-04-25T02:08:01.113576+0000","last_peered":"2024-04-25T02:08:01.113576+0000","last_clean":"2024-04-25T02:08:01.113576+0000","last_became_active":"2024-04-25T02:08:00.131731+0000","last_became_peered":"2024-04-25T02:08:00.131731+0000","last_unstale":"2024-04-25T02:08:01.113576+0000","last_undegraded":"2024-04-25T02:08:01.113576+0000","last_fullsized":"2024-04-25T02:08:01.113576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:29.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.197797+0000","last_change":"2024-04-25T02:07:59.112512+0000","last_active":"2024-04-25T02:08:01.197797+0000","last_peered":"2024-04-25T02:08:01.197797+0000","last_clean":"2024-04-25T02:08:01.197797+0000","last_became_active":"2024-04-25T02:07:59.112246+0000","last_became_peered":"2024-04-25T02:07:59.112246+0000","last_unstale":"2024-04-25T02:08:01.197797+0000","last_undegraded":"2024-04-25T02:08:01.197797+0000","last_fullsized":"2024-04-25T02:08:01.197797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:45.925719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118217+0000","last_change":"2024-04-25T02:08:00.140610+0000","last_active":"2024-04-25T02:08:01.118217+0000","last_peered":"2024-04-25T02:08:01.118217+0000","last_clean":"2024-04-25T02:08:01.118217+0000","last_became_active":"2024-04-25T02:08:00.140314+0000","last_became_peered":"2024-04-25T02:08:00.140314+0000","last_unstale":"2024-04-25T02:08:01.118217+0000","last_undegraded":"2024-04-25T02:08:01.118217+0000","last_fullsized":"2024-04-25T02:08:01.118217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:54.475986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115418+0000","last_change":"2024-04-25T02:07:59.119301+0000","last_active":"2024-04-25T02:08:01.115418+0000","last_peered":"2024-04-25T02:08:01.115418+0000","last_clean":"2024-04-25T02:08:01.115418+0000","last_became_active":"2024-04-25T02:07:59.119015+0000","last_became_peered":"2024-04-25T02:07:59.119015+0000","last_unstale":"2024-04-25T02:08:01.115418+0000","last_undegraded":"2024-04-25T02:08:01.115418+0000","last_fullsized":"2024-04-25T02:08:01.115418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:06.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117449+0000","last_change":"2024-04-25T02:08:00.127146+0000","last_active":"2024-04-25T02:08:01.117449+0000","last_peered":"2024-04-25T02:08:01.117449+0000","last_clean":"2024-04-25T02:08:01.117449+0000","last_became_active":"2024-04-25T02:08:00.126871+0000","last_became_peered":"2024-04-25T02:08:00.126871+0000","last_unstale":"2024-04-25T02:08:01.117449+0000","last_undegraded":"2024-04-25T02:08:01.117449+0000","last_fullsized":"2024-04-25T02:08:01.117449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:03:37.966520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117574+0000","last_change":"2024-04-25T02:07:59.119153+0000","last_active":"2024-04-25T02:08:01.117574+0000","last_peered":"2024-04-25T02:08:01.117574+0000","last_clean":"2024-04-25T02:08:01.117574+0000","last_became_active":"2024-04-25T02:07:59.118830+0000","last_became_peered":"2024-04-25T02:07:59.118830+0000","last_unstale":"2024-04-25T02:08:01.117574+0000","last_undegraded":"2024-04-25T02:08:01.117574+0000","last_fullsized":"2024-04-25T02:08:01.117574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:17.087667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117757+0000","last_change":"2024-04-25T02:08:00.130764+0000","last_active":"2024-04-25T02:08:01.117757+0000","last_peered":"2024-04-25T02:08:01.117757+0000","last_clean":"2024-04-25T02:08:01.117757+0000","last_became_active":"2024-04-25T02:08:00.130490+0000","last_became_peered":"2024-04-25T02:08:00.130490+0000","last_unstale":"2024-04-25T02:08:01.117757+0000","last_undegraded":"2024-04-25T02:08:01.117757+0000","last_fullsized":"2024-04-25T02:08:01.117757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:18.092551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113394+0000","last_change":"2024-04-25T02:07:59.115182+0000","last_active":"2024-04-25T02:08:01.113394+0000","last_peered":"2024-04-25T02:08:01.113394+0000","last_clean":"2024-04-25T02:08:01.113394+0000","last_became_active":"2024-04-25T02:07:59.114863+0000","last_became_peered":"2024-04-25T02:07:59.114863+0000","last_unstale":"2024-04-25T02:08:01.113394+0000","last_undegraded":"2024-04-25T02:08:01.113394+0000","last_fullsized":"2024-04-25T02:08:01.113394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:17.087667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117302+0000","last_change":"2024-04-25T02:08:00.138786+0000","last_active":"2024-04-25T02:08:01.117302+0000","last_peered":"2024-04-25T02:08:01.117302+0000","last_clean":"2024-04-25T02:08:01.117302+0000","last_became_active":"2024-04-25T02:08:00.138517+0000","last_became_peered":"2024-04-25T02:08:00.138517+0000","last_unstale":"2024-04-25T02:08:01.117302+0000","last_undegraded":"2024-04-25T02:08:01.117302+0000","last_fullsized":"2024-04-25T02:08:01.117302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:27.956618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113528+0000","last_change":"2024-04-25T02:07:59.113581+0000","last_active":"2024-04-25T02:08:01.113528+0000","last_peered":"2024-04-25T02:08:01.113528+0000","last_clean":"2024-04-25T02:08:01.113528+0000","last_became_active":"2024-04-25T02:07:59.113310+0000","last_became_peered":"2024-04-25T02:07:59.113310+0000","last_unstale":"2024-04-25T02:08:01.113528+0000","last_undegraded":"2024-04-25T02:08:01.113528+0000","last_fullsized":"2024-04-25T02:08:01.113528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:44:38.307212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118372+0000","last_change":"2024-04-25T02:08:00.137561+0000","last_active":"2024-04-25T02:08:01.118372+0000","last_peered":"2024-04-25T02:08:01.118372+0000","last_clean":"2024-04-25T02:08:01.118372+0000","last_became_active":"2024-04-25T02:08:00.137252+0000","last_became_peered":"2024-04-25T02:08:00.137252+0000","last_unstale":"2024-04-25T02:08:01.118372+0000","last_undegraded":"2024-04-25T02:08:01.118372+0000","last_fullsized":"2024-04-25T02:08:01.118372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:19.162081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207479+0000","last_change":"2024-04-25T02:07:59.118237+0000","last_active":"2024-04-25T02:08:01.207479+0000","last_peered":"2024-04-25T02:08:01.207479+0000","last_clean":"2024-04-25T02:08:01.207479+0000","last_became_active":"2024-04-25T02:07:59.117917+0000","last_became_peered":"2024-04-25T02:07:59.117917+0000","last_unstale":"2024-04-25T02:08:01.207479+0000","last_undegraded":"2024-04-25T02:08:01.207479+0000","last_fullsized":"2024-04-25T02:08:01.207479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:26.203451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114395+0000","last_change":"2024-04-25T02:08:00.126329+0000","last_active":"2024-04-25T02:08:01.114395+0000","last_peered":"2024-04-25T02:08:01.114395+0000","last_clean":"2024-04-25T02:08:01.114395+0000","last_became_active":"2024-04-25T02:08:00.125975+0000","last_became_peered":"2024-04-25T02:08:00.125975+0000","last_unstale":"2024-04-25T02:08:01.114395+0000","last_undegraded":"2024-04-25T02:08:01.114395+0000","last_fullsized":"2024-04-25T02:08:01.114395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:27.956618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115608+0000","last_change":"2024-04-25T02:08:00.120645+0000","last_active":"2024-04-25T02:08:01.115608+0000","last_peered":"2024-04-25T02:08:01.115608+0000","last_clean":"2024-04-25T02:08:01.115608+0000","last_became_active":"2024-04-25T02:08:00.120310+0000","last_became_peered":"2024-04-25T02:08:00.120310+0000","last_unstale":"2024-04-25T02:08:01.115608+0000","last_undegraded":"2024-04-25T02:08:01.115608+0000","last_fullsized":"2024-04-25T02:08:01.115608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:48.665413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117952+0000","last_change":"2024-04-25T02:07:59.120716+0000","last_active":"2024-04-25T02:08:01.117952+0000","last_peered":"2024-04-25T02:08:01.117952+0000","last_clean":"2024-04-25T02:08:01.117952+0000","last_became_active":"2024-04-25T02:07:59.120392+0000","last_became_peered":"2024-04-25T02:07:59.120392+0000","last_unstale":"2024-04-25T02:08:01.117952+0000","last_undegraded":"2024-04-25T02:08:01.117952+0000","last_fullsized":"2024-04-25T02:08:01.117952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:06.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115035+0000","last_change":"2024-04-25T02:08:00.121830+0000","last_active":"2024-04-25T02:08:01.115035+0000","last_peered":"2024-04-25T02:08:01.115035+0000","last_clean":"2024-04-25T02:08:01.115035+0000","last_became_active":"2024-04-25T02:08:00.121537+0000","last_became_peered":"2024-04-25T02:08:00.121537+0000","last_unstale":"2024-04-25T02:08:01.115035+0000","last_undegraded":"2024-04-25T02:08:01.115035+0000","last_fullsized":"2024-04-25T02:08:01.115035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:36.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207392+0000","last_change":"2024-04-25T02:07:59.118155+0000","last_active":"2024-04-25T02:08:01.207392+0000","last_peered":"2024-04-25T02:08:01.207392+0000","last_clean":"2024-04-25T02:08:01.207392+0000","last_became_active":"2024-04-25T02:07:59.117780+0000","last_became_peered":"2024-04-25T02:07:59.117780+0000","last_unstale":"2024-04-25T02:08:01.207392+0000","last_undegraded":"2024-04-25T02:08:01.207392+0000","last_fullsized":"2024-04-25T02:08:01.207392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:01.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117736+0000","last_change":"2024-04-25T02:08:00.135738+0000","last_active":"2024-04-25T02:08:01.117736+0000","last_peered":"2024-04-25T02:08:01.117736+0000","last_clean":"2024-04-25T02:08:01.117736+0000","last_became_active":"2024-04-25T02:08:00.135274+0000","last_became_peered":"2024-04-25T02:08:00.135274+0000","last_unstale":"2024-04-25T02:08:01.117736+0000","last_undegraded":"2024-04-25T02:08:01.117736+0000","last_fullsized":"2024-04-25T02:08:01.117736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:17.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118294+0000","last_change":"2024-04-25T02:07:59.112926+0000","last_active":"2024-04-25T02:08:01.118294+0000","last_peered":"2024-04-25T02:08:01.118294+0000","last_clean":"2024-04-25T02:08:01.118294+0000","last_became_active":"2024-04-25T02:07:59.112649+0000","last_became_peered":"2024-04-25T02:07:59.112649+0000","last_unstale":"2024-04-25T02:08:01.118294+0000","last_undegraded":"2024-04-25T02:08:01.118294+0000","last_fullsized":"2024-04-25T02:08:01.118294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:58.131371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118217+0000","last_change":"2024-04-25T02:08:00.133666+0000","last_active":"2024-04-25T02:08:01.118217+0000","last_peered":"2024-04-25T02:08:01.118217+0000","last_clean":"2024-04-25T02:08:01.118217+0000","last_became_active":"2024-04-25T02:08:00.133392+0000","last_became_peered":"2024-04-25T02:08:00.133392+0000","last_unstale":"2024-04-25T02:08:01.118217+0000","last_undegraded":"2024-04-25T02:08:01.118217+0000","last_fullsized":"2024-04-25T02:08:01.118217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:17.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117965+0000","last_change":"2024-04-25T02:07:59.115590+0000","last_active":"2024-04-25T02:08:01.117965+0000","last_peered":"2024-04-25T02:08:01.117965+0000","last_clean":"2024-04-25T02:08:01.117965+0000","last_became_active":"2024-04-25T02:07:59.115307+0000","last_became_peered":"2024-04-25T02:07:59.115307+0000","last_unstale":"2024-04-25T02:08:01.117965+0000","last_undegraded":"2024-04-25T02:08:01.117965+0000","last_fullsized":"2024-04-25T02:08:01.117965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:58.131371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:08:07.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:08:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.548+0000 7fcba4da2640 1 Processor -- start 2024-04-25T02:08:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.548+0000 7fcba4da2640 1 -- start start 2024-04-25T02:08:07.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.549+0000 7fcba4da2640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcba015a720 0x7fcba015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.549+0000 7fcba4da2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcba00d07a0 0x7fcba00b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.549+0000 7fcba4da2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcba015f1c0 con 0x7fcba00b47e0 2024-04-25T02:08:07.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.549+0000 7fcba4da2640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fcba00b2e60 con 0x7fcba015a720 2024-04-25T02:08:07.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.549+0000 7fcba4da2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcba00b3140 con 0x7fcba00d07a0 2024-04-25T02:08:07.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.549+0000 7fcb9dd9b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcba00d07a0 0x7fcba00b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.549+0000 7fcb9dd9b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcba00d07a0 0x7fcba00b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49664/0 (socket says 172.21.15.79:49664) 2024-04-25T02:08:07.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.549+0000 7fcb9e59c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcba015a720 0x7fcba015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.549+0000 7fcb9dd9b640 1 -- 172.21.15.79:0/4137714901 learned_addr learned my addr 172.21.15.79:0/4137714901 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:07.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.549+0000 7fcb9dd9b640 1 -- 172.21.15.79:0/4137714901 >> v2:172.21.15.189:3300/0 conn(0x7fcba015a720 msgr2=0x7fcba015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:07.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.549+0000 7fcb9dd9b640 1 --2- 172.21.15.79:0/4137714901 >> v2:172.21.15.189:3300/0 conn(0x7fcba015a720 0x7fcba015ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.549+0000 7fcb9dd9b640 1 -- 172.21.15.79:0/4137714901 >> v1:172.21.15.189:6789/0 conn(0x7fcba00b47e0 legacy=0x7fcba015ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.549+0000 7fcb9dd9b640 1 -- 172.21.15.79:0/4137714901 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba00b3420 con 0x7fcba00d07a0 2024-04-25T02:08:07.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.549+0000 7fcb9e59c640 1 --2- 172.21.15.79:0/4137714901 >> v2:172.21.15.189:3300/0 conn(0x7fcba015a720 0x7fcba015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.550+0000 7fcb9dd9b640 1 --2- 172.21.15.79:0/4137714901 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcba00d07a0 0x7fcba00b42a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400aa10 tx=0x7fcb9402b580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ab98530e8ca594b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.550+0000 7fcb9d59a640 1 -- 172.21.15.79:0/4137714901 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9400b040 con 0x7fcba00d07a0 2024-04-25T02:08:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.550+0000 7fcb9d59a640 1 -- 172.21.15.79:0/4137714901 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb94030710 con 0x7fcba00d07a0 2024-04-25T02:08:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.550+0000 7fcb9d59a640 1 -- 172.21.15.79:0/4137714901 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94030ae0 con 0x7fcba00d07a0 2024-04-25T02:08:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.551+0000 7fcba4da2640 1 -- 172.21.15.79:0/4137714901 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcba00d07a0 msgr2=0x7fcba00b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.551+0000 7fcba4da2640 1 --2- 172.21.15.79:0/4137714901 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcba00d07a0 0x7fcba00b42a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400aa10 tx=0x7fcb9402b580 comp rx=0 tx=0).stop 2024-04-25T02:08:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.551+0000 7fcba4da2640 1 -- 172.21.15.79:0/4137714901 shutdown_connections 2024-04-25T02:08:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.551+0000 7fcba4da2640 1 --2- 172.21.15.79:0/4137714901 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcba00d07a0 0x7fcba00b42a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.551+0000 7fcba4da2640 1 --2- 172.21.15.79:0/4137714901 >> v2:172.21.15.189:3300/0 conn(0x7fcba015a720 0x7fcba015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.551+0000 7fcba4da2640 1 -- 172.21.15.79:0/4137714901 >> 172.21.15.79:0/4137714901 conn(0x7fcba00cfc80 msgr2=0x7fcba00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.551+0000 7fcba4da2640 1 -- 172.21.15.79:0/4137714901 shutdown_connections 2024-04-25T02:08:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.551+0000 7fcba4da2640 1 -- 172.21.15.79:0/4137714901 wait complete. 2024-04-25T02:08:07.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.552+0000 7fcba4da2640 1 Processor -- start 2024-04-25T02:08:07.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.552+0000 7fcba4da2640 1 -- start start 2024-04-25T02:08:07.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcba4da2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcba00b47e0 0x7fcba013f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcba4da2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba00d07a0 0x7fcba0153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcba4da2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcba015a720 0x7fcba01419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcba4da2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcba0071d00 con 0x7fcba00b47e0 2024-04-25T02:08:07.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcba4da2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcba00b39e0 con 0x7fcba00d07a0 2024-04-25T02:08:07.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcba4da2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcba0071e80 con 0x7fcba015a720 2024-04-25T02:08:07.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcb9e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcba00b47e0 0x7fcba013f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcb9e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcba00b47e0 0x7fcba013f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35188/0 (socket says 172.21.15.79:35188) 2024-04-25T02:08:07.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcb9e59c640 1 -- 172.21.15.79:0/4077800276 learned_addr learned my addr 172.21.15.79:0/4077800276 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:07.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcb9ed9d640 1 --2- 172.21.15.79:0/4077800276 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcba015a720 0x7fcba01419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcb9e59c640 1 -- 172.21.15.79:0/4077800276 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcba015a720 msgr2=0x7fcba01419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcb9e59c640 1 --2- 172.21.15.79:0/4077800276 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcba015a720 0x7fcba01419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcb9e59c640 1 -- 172.21.15.79:0/4077800276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba00d07a0 msgr2=0x7fcba0153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcb9e59c640 1 --2- 172.21.15.79:0/4077800276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba00d07a0 0x7fcba0153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcb9e59c640 1 -- 172.21.15.79:0/4077800276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba0153d70 con 0x7fcba00b47e0 2024-04-25T02:08:07.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.553+0000 7fcb9ed9d640 1 --2- 172.21.15.79:0/4077800276 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcba015a720 0x7fcba01419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:07.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.554+0000 7fcb9e59c640 1 --2- 172.21.15.79:0/4077800276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcba00b47e0 0x7fcba013f250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000ebe0 tx=0x7fcb9000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:07.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.554+0000 7fcb8effd640 1 -- 172.21.15.79:0/4077800276 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90017070 con 0x7fcba00b47e0 2024-04-25T02:08:07.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.554+0000 7fcb8effd640 1 -- 172.21.15.79:0/4077800276 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9000cc30 con 0x7fcba00b47e0 2024-04-25T02:08:07.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.554+0000 7fcba4da2640 1 -- 172.21.15.79:0/4077800276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba0154050 con 0x7fcba00b47e0 2024-04-25T02:08:07.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.554+0000 7fcb8effd640 1 -- 172.21.15.79:0/4077800276 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90013470 con 0x7fcba00b47e0 2024-04-25T02:08:07.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.554+0000 7fcba4da2640 1 -- 172.21.15.79:0/4077800276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba0154610 con 0x7fcba00b47e0 2024-04-25T02:08:07.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.555+0000 7fcba4da2640 1 -- 172.21.15.79:0/4077800276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba00690a0 con 0x7fcba00b47e0 2024-04-25T02:08:07.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.555+0000 7fcb8effd640 1 -- 172.21.15.79:0/4077800276 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb9001a070 con 0x7fcba00b47e0 2024-04-25T02:08:07.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.556+0000 7fcb8effd640 1 --2- 172.21.15.79:0/4077800276 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcb8006be30 0x7fcb8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.556+0000 7fcb8effd640 1 -- 172.21.15.79:0/4077800276 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcb9008b0f0 con 0x7fcba00b47e0 2024-04-25T02:08:07.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.556+0000 7fcb9dd9b640 1 --2- 172.21.15.79:0/4077800276 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcb8006be30 0x7fcb8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.556+0000 7fcb9dd9b640 1 --2- 172.21.15.79:0/4077800276 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcb8006be30 0x7fcb8006e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcb94035000 tx=0x7fcb9402f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:07.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.560+0000 7fcb8effd640 1 -- 172.21.15.79:0/4077800276 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcb90059b30 con 0x7fcba00b47e0 2024-04-25T02:08:07.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.729+0000 7fcba4da2640 1 -- 172.21.15.79:0/4077800276 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcba006daf0 con 0x7fcb8006be30 2024-04-25T02:08:07.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.735+0000 7fcb8effd640 1 -- 172.21.15.79:0/4077800276 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fcba006daf0 con 0x7fcb8006be30 2024-04-25T02:08:07.745 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:07.746 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:08:07.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.738+0000 7fcba4da2640 1 -- 172.21.15.79:0/4077800276 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcb8006be30 msgr2=0x7fcb8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.738+0000 7fcba4da2640 1 --2- 172.21.15.79:0/4077800276 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcb8006be30 0x7fcb8006e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcb94035000 tx=0x7fcb9402f000 comp rx=0 tx=0).stop 2024-04-25T02:08:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.738+0000 7fcba4da2640 1 -- 172.21.15.79:0/4077800276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcba00b47e0 msgr2=0x7fcba013f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.738+0000 7fcba4da2640 1 --2- 172.21.15.79:0/4077800276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcba00b47e0 0x7fcba013f250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000ebe0 tx=0x7fcb9000c520 comp rx=0 tx=0).stop 2024-04-25T02:08:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.738+0000 7fcba4da2640 1 -- 172.21.15.79:0/4077800276 shutdown_connections 2024-04-25T02:08:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.738+0000 7fcba4da2640 1 --2- 172.21.15.79:0/4077800276 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcb8006be30 0x7fcb8006e2f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.738+0000 7fcba4da2640 1 --2- 172.21.15.79:0/4077800276 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcba015a720 0x7fcba01419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.738+0000 7fcba4da2640 1 --2- 172.21.15.79:0/4077800276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba00d07a0 0x7fcba0153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.738+0000 7fcba4da2640 1 --2- 172.21.15.79:0/4077800276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcba00b47e0 0x7fcba013f250 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.738+0000 7fcba4da2640 1 -- 172.21.15.79:0/4077800276 >> 172.21.15.79:0/4077800276 conn(0x7fcba00cfc80 msgr2=0x7fcba006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.738+0000 7fcba4da2640 1 -- 172.21.15.79:0/4077800276 shutdown_connections 2024-04-25T02:08:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.738+0000 7fcba4da2640 1 -- 172.21.15.79:0/4077800276 wait complete. 2024-04-25T02:08:07.756 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T02:08:07.175675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219108,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755612,"statfs":{"total":773094113280,"available":772869746688,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001546"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207407+0000","last_change":"2024-04-25T02:08:00.134308+0000","last_active":"2024-04-25T02:08:01.207407+0000","last_peered":"2024-04-25T02:08:01.207407+0000","last_clean":"2024-04-25T02:08:01.207407+0000","last_became_active":"2024-04-25T02:08:00.134045+0000","last_became_peered":"2024-04-25T02:08:00.134045+0000","last_unstale":"2024-04-25T02:08:01.207407+0000","last_undegraded":"2024-04-25T02:08:01.207407+0000","last_fullsized":"2024-04-25T02:08:01.207407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:48.665413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113746+0000","last_change":"2024-04-25T02:08:00.132540+0000","last_active":"2024-04-25T02:08:01.113746+0000","last_peered":"2024-04-25T02:08:01.113746+0000","last_clean":"2024-04-25T02:08:01.113746+0000","last_became_active":"2024-04-25T02:08:00.132284+0000","last_became_peered":"2024-04-25T02:08:00.132284+0000","last_unstale":"2024-04-25T02:08:01.113746+0000","last_undegraded":"2024-04-25T02:08:01.113746+0000","last_fullsized":"2024-04-25T02:08:01.113746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:54.475986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117551+0000","last_change":"2024-04-25T02:08:00.130002+0000","last_active":"2024-04-25T02:08:01.117551+0000","last_peered":"2024-04-25T02:08:01.117551+0000","last_clean":"2024-04-25T02:08:01.117551+0000","last_became_active":"2024-04-25T02:08:00.129736+0000","last_became_peered":"2024-04-25T02:08:00.129736+0000","last_unstale":"2024-04-25T02:08:01.117551+0000","last_undegraded":"2024-04-25T02:08:01.117551+0000","last_fullsized":"2024-04-25T02:08:01.117551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:02.955874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114971+0000","last_change":"2024-04-25T02:08:00.132017+0000","last_active":"2024-04-25T02:08:01.114971+0000","last_peered":"2024-04-25T02:08:01.114971+0000","last_clean":"2024-04-25T02:08:01.114971+0000","last_became_active":"2024-04-25T02:08:00.131698+0000","last_became_peered":"2024-04-25T02:08:00.131698+0000","last_unstale":"2024-04-25T02:08:01.114971+0000","last_undegraded":"2024-04-25T02:08:01.114971+0000","last_fullsized":"2024-04-25T02:08:01.114971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:28.873330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118266+0000","last_change":"2024-04-25T02:08:00.136752+0000","last_active":"2024-04-25T02:08:01.118266+0000","last_peered":"2024-04-25T02:08:01.118266+0000","last_clean":"2024-04-25T02:08:01.118266+0000","last_became_active":"2024-04-25T02:08:00.136403+0000","last_became_peered":"2024-04-25T02:08:00.136403+0000","last_unstale":"2024-04-25T02:08:01.118266+0000","last_undegraded":"2024-04-25T02:08:01.118266+0000","last_fullsized":"2024-04-25T02:08:01.118266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:43.197680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114307+0000","last_change":"2024-04-25T02:08:00.133501+0000","last_active":"2024-04-25T02:08:01.114307+0000","last_peered":"2024-04-25T02:08:01.114307+0000","last_clean":"2024-04-25T02:08:01.114307+0000","last_became_active":"2024-04-25T02:08:00.133172+0000","last_became_peered":"2024-04-25T02:08:00.133172+0000","last_unstale":"2024-04-25T02:08:01.114307+0000","last_undegraded":"2024-04-25T02:08:01.114307+0000","last_fullsized":"2024-04-25T02:08:01.114307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:19:21.910512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118112+0000","last_change":"2024-04-25T02:08:00.138392+0000","last_active":"2024-04-25T02:08:01.118112+0000","last_peered":"2024-04-25T02:08:01.118112+0000","last_clean":"2024-04-25T02:08:01.118112+0000","last_became_active":"2024-04-25T02:08:00.138116+0000","last_became_peered":"2024-04-25T02:08:00.138116+0000","last_unstale":"2024-04-25T02:08:01.118112+0000","last_undegraded":"2024-04-25T02:08:01.118112+0000","last_fullsized":"2024-04-25T02:08:01.118112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.809054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117173+0000","last_change":"2024-04-25T02:08:00.137802+0000","last_active":"2024-04-25T02:08:01.117173+0000","last_peered":"2024-04-25T02:08:01.117173+0000","last_clean":"2024-04-25T02:08:01.117173+0000","last_became_active":"2024-04-25T02:08:00.136849+0000","last_became_peered":"2024-04-25T02:08:00.136849+0000","last_unstale":"2024-04-25T02:08:01.117173+0000","last_undegraded":"2024-04-25T02:08:01.117173+0000","last_fullsized":"2024-04-25T02:08:01.117173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:04.753150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118140+0000","last_change":"2024-04-25T02:08:00.143112+0000","last_active":"2024-04-25T02:08:01.118140+0000","last_peered":"2024-04-25T02:08:01.118140+0000","last_clean":"2024-04-25T02:08:01.118140+0000","last_became_active":"2024-04-25T02:08:00.142709+0000","last_became_peered":"2024-04-25T02:08:00.142709+0000","last_unstale":"2024-04-25T02:08:01.118140+0000","last_undegraded":"2024-04-25T02:08:01.118140+0000","last_fullsized":"2024-04-25T02:08:01.118140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:19.162081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115147+0000","last_change":"2024-04-25T02:08:00.130702+0000","last_active":"2024-04-25T02:08:01.115147+0000","last_peered":"2024-04-25T02:08:01.115147+0000","last_clean":"2024-04-25T02:08:01.115147+0000","last_became_active":"2024-04-25T02:08:00.125460+0000","last_became_peered":"2024-04-25T02:08:00.125460+0000","last_unstale":"2024-04-25T02:08:01.115147+0000","last_undegraded":"2024-04-25T02:08:01.115147+0000","last_fullsized":"2024-04-25T02:08:01.115147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:17.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114727+0000","last_change":"2024-04-25T02:08:00.125792+0000","last_active":"2024-04-25T02:08:01.114727+0000","last_peered":"2024-04-25T02:08:01.114727+0000","last_clean":"2024-04-25T02:08:01.114727+0000","last_became_active":"2024-04-25T02:08:00.125520+0000","last_became_peered":"2024-04-25T02:08:00.125520+0000","last_unstale":"2024-04-25T02:08:01.114727+0000","last_undegraded":"2024-04-25T02:08:01.114727+0000","last_fullsized":"2024-04-25T02:08:01.114727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:29.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118193+0000","last_change":"2024-04-25T02:08:00.134810+0000","last_active":"2024-04-25T02:08:01.118193+0000","last_peered":"2024-04-25T02:08:01.118193+0000","last_clean":"2024-04-25T02:08:01.118193+0000","last_became_active":"2024-04-25T02:08:00.134532+0000","last_became_peered":"2024-04-25T02:08:00.134532+0000","last_unstale":"2024-04-25T02:08:01.118193+0000","last_undegraded":"2024-04-25T02:08:01.118193+0000","last_fullsized":"2024-04-25T02:08:01.118193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:02.073911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118235+0000","last_change":"2024-04-25T02:08:00.133643+0000","last_active":"2024-04-25T02:08:01.118235+0000","last_peered":"2024-04-25T02:08:01.118235+0000","last_clean":"2024-04-25T02:08:01.118235+0000","last_became_active":"2024-04-25T02:08:00.133375+0000","last_became_peered":"2024-04-25T02:08:00.133375+0000","last_unstale":"2024-04-25T02:08:01.118235+0000","last_undegraded":"2024-04-25T02:08:01.118235+0000","last_fullsized":"2024-04-25T02:08:01.118235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:19:21.910512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117517+0000","last_change":"2024-04-25T02:08:00.127128+0000","last_active":"2024-04-25T02:08:01.117517+0000","last_peered":"2024-04-25T02:08:01.117517+0000","last_clean":"2024-04-25T02:08:01.117517+0000","last_became_active":"2024-04-25T02:08:00.126836+0000","last_became_peered":"2024-04-25T02:08:00.126836+0000","last_unstale":"2024-04-25T02:08:01.117517+0000","last_undegraded":"2024-04-25T02:08:01.117517+0000","last_fullsized":"2024-04-25T02:08:01.117517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:04.753150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113310+0000","last_change":"2024-04-25T02:08:00.119494+0000","last_active":"2024-04-25T02:08:01.113310+0000","last_peered":"2024-04-25T02:08:01.113310+0000","last_clean":"2024-04-25T02:08:01.113310+0000","last_became_active":"2024-04-25T02:08:00.119237+0000","last_became_peered":"2024-04-25T02:08:00.119237+0000","last_unstale":"2024-04-25T02:08:01.113310+0000","last_undegraded":"2024-04-25T02:08:01.113310+0000","last_fullsized":"2024-04-25T02:08:01.113310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:27.956618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114158+0000","last_change":"2024-04-25T02:08:00.133489+0000","last_active":"2024-04-25T02:08:01.114158+0000","last_peered":"2024-04-25T02:08:01.114158+0000","last_clean":"2024-04-25T02:08:01.114158+0000","last_became_active":"2024-04-25T02:08:00.133134+0000","last_became_peered":"2024-04-25T02:08:00.133134+0000","last_unstale":"2024-04-25T02:08:01.114158+0000","last_undegraded":"2024-04-25T02:08:01.114158+0000","last_fullsized":"2024-04-25T02:08:01.114158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:17.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115169+0000","last_change":"2024-04-25T02:08:00.141819+0000","last_active":"2024-04-25T02:08:01.115169+0000","last_peered":"2024-04-25T02:08:01.115169+0000","last_clean":"2024-04-25T02:08:01.115169+0000","last_became_active":"2024-04-25T02:08:00.141488+0000","last_became_peered":"2024-04-25T02:08:00.141488+0000","last_unstale":"2024-04-25T02:08:01.115169+0000","last_undegraded":"2024-04-25T02:08:01.115169+0000","last_fullsized":"2024-04-25T02:08:01.115169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:46.350349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117853+0000","last_change":"2024-04-25T02:08:00.133178+0000","last_active":"2024-04-25T02:08:01.117853+0000","last_peered":"2024-04-25T02:08:01.117853+0000","last_clean":"2024-04-25T02:08:01.117853+0000","last_became_active":"2024-04-25T02:08:00.132881+0000","last_became_peered":"2024-04-25T02:08:00.132881+0000","last_unstale":"2024-04-25T02:08:01.117853+0000","last_undegraded":"2024-04-25T02:08:01.117853+0000","last_fullsized":"2024-04-25T02:08:01.117853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:46.930603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207506+0000","last_change":"2024-04-25T02:08:00.139667+0000","last_active":"2024-04-25T02:08:01.207506+0000","last_peered":"2024-04-25T02:08:01.207506+0000","last_clean":"2024-04-25T02:08:01.207506+0000","last_became_active":"2024-04-25T02:08:00.139398+0000","last_became_peered":"2024-04-25T02:08:00.139398+0000","last_unstale":"2024-04-25T02:08:01.207506+0000","last_undegraded":"2024-04-25T02:08:01.207506+0000","last_fullsized":"2024-04-25T02:08:01.207506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:39.354188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114335+0000","last_change":"2024-04-25T02:08:00.124339+0000","last_active":"2024-04-25T02:08:01.114335+0000","last_peered":"2024-04-25T02:08:01.114335+0000","last_clean":"2024-04-25T02:08:01.114335+0000","last_became_active":"2024-04-25T02:08:00.124078+0000","last_became_peered":"2024-04-25T02:08:00.124078+0000","last_unstale":"2024-04-25T02:08:01.114335+0000","last_undegraded":"2024-04-25T02:08:01.114335+0000","last_fullsized":"2024-04-25T02:08:01.114335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:02.955874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117681+0000","last_change":"2024-04-25T02:08:00.140606+0000","last_active":"2024-04-25T02:08:01.117681+0000","last_peered":"2024-04-25T02:08:01.117681+0000","last_clean":"2024-04-25T02:08:01.117681+0000","last_became_active":"2024-04-25T02:08:00.140357+0000","last_became_peered":"2024-04-25T02:08:00.140357+0000","last_unstale":"2024-04-25T02:08:01.117681+0000","last_undegraded":"2024-04-25T02:08:01.117681+0000","last_fullsized":"2024-04-25T02:08:01.117681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:27:41.665005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114519+0000","last_change":"2024-04-25T02:08:00.142382+0000","last_active":"2024-04-25T02:08:01.114519+0000","last_peered":"2024-04-25T02:08:01.114519+0000","last_clean":"2024-04-25T02:08:01.114519+0000","last_became_active":"2024-04-25T02:08:00.142008+0000","last_became_peered":"2024-04-25T02:08:00.142008+0000","last_unstale":"2024-04-25T02:08:01.114519+0000","last_undegraded":"2024-04-25T02:08:01.114519+0000","last_fullsized":"2024-04-25T02:08:01.114519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.809054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117888+0000","last_change":"2024-04-25T02:08:00.137764+0000","last_active":"2024-04-25T02:08:01.117888+0000","last_peered":"2024-04-25T02:08:01.117888+0000","last_clean":"2024-04-25T02:08:01.117888+0000","last_became_active":"2024-04-25T02:08:00.136712+0000","last_became_peered":"2024-04-25T02:08:00.136712+0000","last_unstale":"2024-04-25T02:08:01.117888+0000","last_undegraded":"2024-04-25T02:08:01.117888+0000","last_fullsized":"2024-04-25T02:08:01.117888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:27:41.665005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114262+0000","last_change":"2024-04-25T02:08:00.132628+0000","last_active":"2024-04-25T02:08:01.114262+0000","last_peered":"2024-04-25T02:08:01.114262+0000","last_clean":"2024-04-25T02:08:01.114262+0000","last_became_active":"2024-04-25T02:08:00.132290+0000","last_became_peered":"2024-04-25T02:08:00.132290+0000","last_unstale":"2024-04-25T02:08:01.114262+0000","last_undegraded":"2024-04-25T02:08:01.114262+0000","last_fullsized":"2024-04-25T02:08:01.114262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:54.475986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118051+0000","last_change":"2024-04-25T02:08:00.136212+0000","last_active":"2024-04-25T02:08:01.118051+0000","last_peered":"2024-04-25T02:08:01.118051+0000","last_clean":"2024-04-25T02:08:01.118051+0000","last_became_active":"2024-04-25T02:08:00.135931+0000","last_became_peered":"2024-04-25T02:08:00.135931+0000","last_unstale":"2024-04-25T02:08:01.118051+0000","last_undegraded":"2024-04-25T02:08:01.118051+0000","last_fullsized":"2024-04-25T02:08:01.118051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:29.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115305+0000","last_change":"2024-04-25T02:08:00.137685+0000","last_active":"2024-04-25T02:08:01.115305+0000","last_peered":"2024-04-25T02:08:01.115305+0000","last_clean":"2024-04-25T02:08:01.115305+0000","last_became_active":"2024-04-25T02:08:00.137442+0000","last_became_peered":"2024-04-25T02:08:00.137442+0000","last_unstale":"2024-04-25T02:08:01.115305+0000","last_undegraded":"2024-04-25T02:08:01.115305+0000","last_fullsized":"2024-04-25T02:08:01.115305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:54.475986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113612+0000","last_change":"2024-04-25T02:08:00.131268+0000","last_active":"2024-04-25T02:08:01.113612+0000","last_peered":"2024-04-25T02:08:01.113612+0000","last_clean":"2024-04-25T02:08:01.113612+0000","last_became_active":"2024-04-25T02:08:00.130015+0000","last_became_peered":"2024-04-25T02:08:00.130015+0000","last_unstale":"2024-04-25T02:08:01.113612+0000","last_undegraded":"2024-04-25T02:08:01.113612+0000","last_fullsized":"2024-04-25T02:08:01.113612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:17.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118432+0000","last_change":"2024-04-25T02:08:00.135564+0000","last_active":"2024-04-25T02:08:01.118432+0000","last_peered":"2024-04-25T02:08:01.118432+0000","last_clean":"2024-04-25T02:08:01.118432+0000","last_became_active":"2024-04-25T02:08:00.135043+0000","last_became_peered":"2024-04-25T02:08:00.135043+0000","last_unstale":"2024-04-25T02:08:01.118432+0000","last_undegraded":"2024-04-25T02:08:01.118432+0000","last_fullsized":"2024-04-25T02:08:01.118432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:28.873330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117735+0000","last_change":"2024-04-25T02:08:00.140028+0000","last_active":"2024-04-25T02:08:01.117735+0000","last_peered":"2024-04-25T02:08:01.117735+0000","last_clean":"2024-04-25T02:08:01.117735+0000","last_became_active":"2024-04-25T02:08:00.139690+0000","last_became_peered":"2024-04-25T02:08:00.139690+0000","last_unstale":"2024-04-25T02:08:01.117735+0000","last_undegraded":"2024-04-25T02:08:01.117735+0000","last_fullsized":"2024-04-25T02:08:01.117735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:29.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115205+0000","last_change":"2024-04-25T02:08:00.136871+0000","last_active":"2024-04-25T02:08:01.115205+0000","last_peered":"2024-04-25T02:08:01.115205+0000","last_clean":"2024-04-25T02:08:01.115205+0000","last_became_active":"2024-04-25T02:08:00.136394+0000","last_became_peered":"2024-04-25T02:08:00.136394+0000","last_unstale":"2024-04-25T02:08:01.115205+0000","last_undegraded":"2024-04-25T02:08:01.115205+0000","last_fullsized":"2024-04-25T02:08:01.115205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:19.162081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117127+0000","last_change":"2024-04-25T02:08:00.126418+0000","last_active":"2024-04-25T02:08:01.117127+0000","last_peered":"2024-04-25T02:08:01.117127+0000","last_clean":"2024-04-25T02:08:01.117127+0000","last_became_active":"2024-04-25T02:08:00.126139+0000","last_became_peered":"2024-04-25T02:08:00.126139+0000","last_unstale":"2024-04-25T02:08:01.117127+0000","last_undegraded":"2024-04-25T02:08:01.117127+0000","last_fullsized":"2024-04-25T02:08:01.117127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:18.092551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114405+0000","last_change":"2024-04-25T02:08:00.135252+0000","last_active":"2024-04-25T02:08:01.114405+0000","last_peered":"2024-04-25T02:08:01.114405+0000","last_clean":"2024-04-25T02:08:01.114405+0000","last_became_active":"2024-04-25T02:08:00.133592+0000","last_became_peered":"2024-04-25T02:08:00.133592+0000","last_unstale":"2024-04-25T02:08:01.114405+0000","last_undegraded":"2024-04-25T02:08:01.114405+0000","last_fullsized":"2024-04-25T02:08:01.114405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:27:41.665005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117711+0000","last_change":"2024-04-25T02:08:00.127933+0000","last_active":"2024-04-25T02:08:01.117711+0000","last_peered":"2024-04-25T02:08:01.117711+0000","last_clean":"2024-04-25T02:08:01.117711+0000","last_became_active":"2024-04-25T02:08:00.127073+0000","last_became_peered":"2024-04-25T02:08:00.127073+0000","last_unstale":"2024-04-25T02:08:01.117711+0000","last_undegraded":"2024-04-25T02:08:01.117711+0000","last_fullsized":"2024-04-25T02:08:01.117711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:27.208335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118446+0000","last_change":"2024-04-25T02:07:59.116340+0000","last_active":"2024-04-25T02:08:01.118446+0000","last_peered":"2024-04-25T02:08:01.118446+0000","last_clean":"2024-04-25T02:08:01.118446+0000","last_became_active":"2024-04-25T02:07:59.116056+0000","last_became_peered":"2024-04-25T02:07:59.116056+0000","last_unstale":"2024-04-25T02:08:01.118446+0000","last_undegraded":"2024-04-25T02:08:01.118446+0000","last_fullsized":"2024-04-25T02:08:01.118446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:52:35.221325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117809+0000","last_change":"2024-04-25T02:08:00.133885+0000","last_active":"2024-04-25T02:08:01.117809+0000","last_peered":"2024-04-25T02:08:01.117809+0000","last_clean":"2024-04-25T02:08:01.117809+0000","last_became_active":"2024-04-25T02:08:00.133640+0000","last_became_peered":"2024-04-25T02:08:00.133640+0000","last_unstale":"2024-04-25T02:08:01.117809+0000","last_undegraded":"2024-04-25T02:08:01.117809+0000","last_fullsized":"2024-04-25T02:08:01.117809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:54.475986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114528+0000","last_change":"2024-04-25T02:07:59.111628+0000","last_active":"2024-04-25T02:08:01.114528+0000","last_peered":"2024-04-25T02:08:01.114528+0000","last_clean":"2024-04-25T02:08:01.114528+0000","last_became_active":"2024-04-25T02:07:59.111154+0000","last_became_peered":"2024-04-25T02:07:59.111154+0000","last_unstale":"2024-04-25T02:08:01.114528+0000","last_undegraded":"2024-04-25T02:08:01.114528+0000","last_fullsized":"2024-04-25T02:08:01.114528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:44:38.307212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117995+0000","last_change":"2024-04-25T02:07:59.116279+0000","last_active":"2024-04-25T02:08:01.117995+0000","last_peered":"2024-04-25T02:08:01.117995+0000","last_clean":"2024-04-25T02:08:01.117995+0000","last_became_active":"2024-04-25T02:07:59.115993+0000","last_became_peered":"2024-04-25T02:07:59.115993+0000","last_unstale":"2024-04-25T02:08:01.117995+0000","last_undegraded":"2024-04-25T02:08:01.117995+0000","last_fullsized":"2024-04-25T02:08:01.117995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:19.399199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117236+0000","last_change":"2024-04-25T02:08:00.137646+0000","last_active":"2024-04-25T02:08:01.117236+0000","last_peered":"2024-04-25T02:08:01.117236+0000","last_clean":"2024-04-25T02:08:01.117236+0000","last_became_active":"2024-04-25T02:08:00.137395+0000","last_became_peered":"2024-04-25T02:08:00.137395+0000","last_unstale":"2024-04-25T02:08:01.117236+0000","last_undegraded":"2024-04-25T02:08:01.117236+0000","last_fullsized":"2024-04-25T02:08:01.117236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:02.955874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114277+0000","last_change":"2024-04-25T02:07:59.115698+0000","last_active":"2024-04-25T02:08:01.114277+0000","last_peered":"2024-04-25T02:08:01.114277+0000","last_clean":"2024-04-25T02:08:01.114277+0000","last_became_active":"2024-04-25T02:07:59.115462+0000","last_became_peered":"2024-04-25T02:07:59.115462+0000","last_unstale":"2024-04-25T02:08:01.114277+0000","last_undegraded":"2024-04-25T02:08:01.114277+0000","last_fullsized":"2024-04-25T02:08:01.114277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:19.399199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113305+0000","last_change":"2024-04-25T02:08:00.131043+0000","last_active":"2024-04-25T02:08:01.113305+0000","last_peered":"2024-04-25T02:08:01.113305+0000","last_clean":"2024-04-25T02:08:01.113305+0000","last_became_active":"2024-04-25T02:08:00.129225+0000","last_became_peered":"2024-04-25T02:08:00.129225+0000","last_unstale":"2024-04-25T02:08:01.113305+0000","last_undegraded":"2024-04-25T02:08:01.113305+0000","last_fullsized":"2024-04-25T02:08:01.113305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:02.955874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115331+0000","last_change":"2024-04-25T02:07:59.117828+0000","last_active":"2024-04-25T02:08:01.115331+0000","last_peered":"2024-04-25T02:08:01.115331+0000","last_clean":"2024-04-25T02:08:01.115331+0000","last_became_active":"2024-04-25T02:07:59.117497+0000","last_became_peered":"2024-04-25T02:07:59.117497+0000","last_unstale":"2024-04-25T02:08:01.115331+0000","last_undegraded":"2024-04-25T02:08:01.115331+0000","last_fullsized":"2024-04-25T02:08:01.115331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:50.979492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115383+0000","last_change":"2024-04-25T02:08:00.142794+0000","last_active":"2024-04-25T02:08:01.115383+0000","last_peered":"2024-04-25T02:08:01.115383+0000","last_clean":"2024-04-25T02:08:01.115383+0000","last_became_active":"2024-04-25T02:08:00.142308+0000","last_became_peered":"2024-04-25T02:08:00.142308+0000","last_unstale":"2024-04-25T02:08:01.115383+0000","last_undegraded":"2024-04-25T02:08:01.115383+0000","last_fullsized":"2024-04-25T02:08:01.115383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:02.221034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115265+0000","last_change":"2024-04-25T02:07:59.120424+0000","last_active":"2024-04-25T02:08:01.115265+0000","last_peered":"2024-04-25T02:08:01.115265+0000","last_clean":"2024-04-25T02:08:01.115265+0000","last_became_active":"2024-04-25T02:07:59.120173+0000","last_became_peered":"2024-04-25T02:07:59.120173+0000","last_unstale":"2024-04-25T02:08:01.115265+0000","last_undegraded":"2024-04-25T02:08:01.115265+0000","last_fullsized":"2024-04-25T02:08:01.115265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:44:38.307212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117861+0000","last_change":"2024-04-25T02:08:00.135525+0000","last_active":"2024-04-25T02:08:01.117861+0000","last_peered":"2024-04-25T02:08:01.117861+0000","last_clean":"2024-04-25T02:08:01.117861+0000","last_became_active":"2024-04-25T02:08:00.134949+0000","last_became_peered":"2024-04-25T02:08:00.134949+0000","last_unstale":"2024-04-25T02:08:01.117861+0000","last_undegraded":"2024-04-25T02:08:01.117861+0000","last_fullsized":"2024-04-25T02:08:01.117861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:19:21.910512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113595+0000","last_change":"2024-04-25T02:07:59.114638+0000","last_active":"2024-04-25T02:08:01.113595+0000","last_peered":"2024-04-25T02:08:01.113595+0000","last_clean":"2024-04-25T02:08:01.113595+0000","last_became_active":"2024-04-25T02:07:59.114338+0000","last_became_peered":"2024-04-25T02:07:59.114338+0000","last_unstale":"2024-04-25T02:08:01.113595+0000","last_undegraded":"2024-04-25T02:08:01.113595+0000","last_fullsized":"2024-04-25T02:08:01.113595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:26.203451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118240+0000","last_change":"2024-04-25T02:08:00.124104+0000","last_active":"2024-04-25T02:08:01.118240+0000","last_peered":"2024-04-25T02:08:01.118240+0000","last_clean":"2024-04-25T02:08:01.118240+0000","last_became_active":"2024-04-25T02:08:00.123799+0000","last_became_peered":"2024-04-25T02:08:00.123799+0000","last_unstale":"2024-04-25T02:08:01.118240+0000","last_undegraded":"2024-04-25T02:08:01.118240+0000","last_fullsized":"2024-04-25T02:08:01.118240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:56.058112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114450+0000","last_change":"2024-04-25T02:07:59.116463+0000","last_active":"2024-04-25T02:08:01.114450+0000","last_peered":"2024-04-25T02:08:01.114450+0000","last_clean":"2024-04-25T02:08:01.114450+0000","last_became_active":"2024-04-25T02:07:59.116202+0000","last_became_peered":"2024-04-25T02:07:59.116202+0000","last_unstale":"2024-04-25T02:08:01.114450+0000","last_undegraded":"2024-04-25T02:08:01.114450+0000","last_fullsized":"2024-04-25T02:08:01.114450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:26.203451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118149+0000","last_change":"2024-04-25T02:08:00.140394+0000","last_active":"2024-04-25T02:08:01.118149+0000","last_peered":"2024-04-25T02:08:01.118149+0000","last_clean":"2024-04-25T02:08:01.118149+0000","last_became_active":"2024-04-25T02:08:00.140115+0000","last_became_peered":"2024-04-25T02:08:00.140115+0000","last_unstale":"2024-04-25T02:08:01.118149+0000","last_undegraded":"2024-04-25T02:08:01.118149+0000","last_fullsized":"2024-04-25T02:08:01.118149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:28.873330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117847+0000","last_change":"2024-04-25T02:07:59.107413+0000","last_active":"2024-04-25T02:08:01.117847+0000","last_peered":"2024-04-25T02:08:01.117847+0000","last_clean":"2024-04-25T02:08:01.117847+0000","last_became_active":"2024-04-25T02:07:59.107130+0000","last_became_peered":"2024-04-25T02:07:59.107130+0000","last_unstale":"2024-04-25T02:08:01.117847+0000","last_undegraded":"2024-04-25T02:08:01.117847+0000","last_fullsized":"2024-04-25T02:08:01.117847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:00.403236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117661+0000","last_change":"2024-04-25T02:08:00.138818+0000","last_active":"2024-04-25T02:08:01.117661+0000","last_peered":"2024-04-25T02:08:01.117661+0000","last_clean":"2024-04-25T02:08:01.117661+0000","last_became_active":"2024-04-25T02:08:00.136665+0000","last_became_peered":"2024-04-25T02:08:00.136665+0000","last_unstale":"2024-04-25T02:08:01.117661+0000","last_undegraded":"2024-04-25T02:08:01.117661+0000","last_fullsized":"2024-04-25T02:08:01.117661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:27.956618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115772+0000","last_change":"2024-04-25T02:07:59.116545+0000","last_active":"2024-04-25T02:08:01.115772+0000","last_peered":"2024-04-25T02:08:01.115772+0000","last_clean":"2024-04-25T02:08:01.115772+0000","last_became_active":"2024-04-25T02:07:59.116250+0000","last_became_peered":"2024-04-25T02:07:59.116250+0000","last_unstale":"2024-04-25T02:08:01.115772+0000","last_undegraded":"2024-04-25T02:08:01.115772+0000","last_fullsized":"2024-04-25T02:08:01.115772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:50.979492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207453+0000","last_change":"2024-04-25T02:08:00.135486+0000","last_active":"2024-04-25T02:08:01.207453+0000","last_peered":"2024-04-25T02:08:01.207453+0000","last_clean":"2024-04-25T02:08:01.207453+0000","last_became_active":"2024-04-25T02:08:00.135113+0000","last_became_peered":"2024-04-25T02:08:00.135113+0000","last_unstale":"2024-04-25T02:08:01.207453+0000","last_undegraded":"2024-04-25T02:08:01.207453+0000","last_fullsized":"2024-04-25T02:08:01.207453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:08:42.030490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114589+0000","last_change":"2024-04-25T02:07:59.114698+0000","last_active":"2024-04-25T02:08:01.114589+0000","last_peered":"2024-04-25T02:08:01.114589+0000","last_clean":"2024-04-25T02:08:01.114589+0000","last_became_active":"2024-04-25T02:07:59.114388+0000","last_became_peered":"2024-04-25T02:07:59.114388+0000","last_unstale":"2024-04-25T02:08:01.114589+0000","last_undegraded":"2024-04-25T02:08:01.114589+0000","last_fullsized":"2024-04-25T02:08:01.114589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:19.399199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114299+0000","last_change":"2024-04-25T02:08:00.131335+0000","last_active":"2024-04-25T02:08:01.114299+0000","last_peered":"2024-04-25T02:08:01.114299+0000","last_clean":"2024-04-25T02:08:01.114299+0000","last_became_active":"2024-04-25T02:08:00.130929+0000","last_became_peered":"2024-04-25T02:08:00.130929+0000","last_unstale":"2024-04-25T02:08:01.114299+0000","last_undegraded":"2024-04-25T02:08:01.114299+0000","last_fullsized":"2024-04-25T02:08:01.114299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:04.753150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117010+0000","last_change":"2024-04-25T02:07:59.113230+0000","last_active":"2024-04-25T02:08:01.117010+0000","last_peered":"2024-04-25T02:08:01.117010+0000","last_clean":"2024-04-25T02:08:01.117010+0000","last_became_active":"2024-04-25T02:07:59.112920+0000","last_became_peered":"2024-04-25T02:07:59.112920+0000","last_unstale":"2024-04-25T02:08:01.117010+0000","last_undegraded":"2024-04-25T02:08:01.117010+0000","last_fullsized":"2024-04-25T02:08:01.117010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:19.399199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207322+0000","last_change":"2024-04-25T02:08:00.135668+0000","last_active":"2024-04-25T02:08:01.207322+0000","last_peered":"2024-04-25T02:08:01.207322+0000","last_clean":"2024-04-25T02:08:01.207322+0000","last_became_active":"2024-04-25T02:08:00.135381+0000","last_became_peered":"2024-04-25T02:08:00.135381+0000","last_unstale":"2024-04-25T02:08:01.207322+0000","last_undegraded":"2024-04-25T02:08:01.207322+0000","last_fullsized":"2024-04-25T02:08:01.207322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:46.350349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118215+0000","last_change":"2024-04-25T02:07:59.108897+0000","last_active":"2024-04-25T02:08:01.118215+0000","last_peered":"2024-04-25T02:08:01.118215+0000","last_clean":"2024-04-25T02:08:01.118215+0000","last_became_active":"2024-04-25T02:07:59.108622+0000","last_became_peered":"2024-04-25T02:07:59.108622+0000","last_unstale":"2024-04-25T02:08:01.118215+0000","last_undegraded":"2024-04-25T02:08:01.118215+0000","last_fullsized":"2024-04-25T02:08:01.118215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:00.403236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207360+0000","last_change":"2024-04-25T02:08:00.136207+0000","last_active":"2024-04-25T02:08:01.207360+0000","last_peered":"2024-04-25T02:08:01.207360+0000","last_clean":"2024-04-25T02:08:01.207360+0000","last_became_active":"2024-04-25T02:08:00.135952+0000","last_became_peered":"2024-04-25T02:08:00.135952+0000","last_unstale":"2024-04-25T02:08:01.207360+0000","last_undegraded":"2024-04-25T02:08:01.207360+0000","last_fullsized":"2024-04-25T02:08:01.207360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:02.221034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117957+0000","last_change":"2024-04-25T02:07:59.117277+0000","last_active":"2024-04-25T02:08:01.117957+0000","last_peered":"2024-04-25T02:08:01.117957+0000","last_clean":"2024-04-25T02:08:01.117957+0000","last_became_active":"2024-04-25T02:07:59.116747+0000","last_became_peered":"2024-04-25T02:07:59.116747+0000","last_unstale":"2024-04-25T02:08:01.117957+0000","last_undegraded":"2024-04-25T02:08:01.117957+0000","last_fullsized":"2024-04-25T02:08:01.117957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:44:38.307212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118279+0000","last_change":"2024-04-25T02:08:00.139343+0000","last_active":"2024-04-25T02:08:01.118279+0000","last_peered":"2024-04-25T02:08:01.118279+0000","last_clean":"2024-04-25T02:08:01.118279+0000","last_became_active":"2024-04-25T02:08:00.138642+0000","last_became_peered":"2024-04-25T02:08:00.138642+0000","last_unstale":"2024-04-25T02:08:01.118279+0000","last_undegraded":"2024-04-25T02:08:01.118279+0000","last_fullsized":"2024-04-25T02:08:01.118279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:36.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113704+0000","last_change":"2024-04-25T02:07:59.112377+0000","last_active":"2024-04-25T02:08:01.113704+0000","last_peered":"2024-04-25T02:08:01.113704+0000","last_clean":"2024-04-25T02:08:01.113704+0000","last_became_active":"2024-04-25T02:07:59.112103+0000","last_became_peered":"2024-04-25T02:07:59.112103+0000","last_unstale":"2024-04-25T02:08:01.113704+0000","last_undegraded":"2024-04-25T02:08:01.113704+0000","last_fullsized":"2024-04-25T02:08:01.113704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:50.979492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115219+0000","last_change":"2024-04-25T02:08:00.133208+0000","last_active":"2024-04-25T02:08:01.115219+0000","last_peered":"2024-04-25T02:08:01.115219+0000","last_clean":"2024-04-25T02:08:01.115219+0000","last_became_active":"2024-04-25T02:08:00.132881+0000","last_became_peered":"2024-04-25T02:08:00.132881+0000","last_unstale":"2024-04-25T02:08:01.115219+0000","last_undegraded":"2024-04-25T02:08:01.115219+0000","last_fullsized":"2024-04-25T02:08:01.115219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:41.987311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117687+0000","last_change":"2024-04-25T02:07:59.117515+0000","last_active":"2024-04-25T02:08:01.117687+0000","last_peered":"2024-04-25T02:08:01.117687+0000","last_clean":"2024-04-25T02:08:01.117687+0000","last_became_active":"2024-04-25T02:07:59.117244+0000","last_became_peered":"2024-04-25T02:07:59.117244+0000","last_unstale":"2024-04-25T02:08:01.117687+0000","last_undegraded":"2024-04-25T02:08:01.117687+0000","last_fullsized":"2024-04-25T02:08:01.117687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:50.979492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207349+0000","last_change":"2024-04-25T02:08:00.143967+0000","last_active":"2024-04-25T02:08:01.207349+0000","last_peered":"2024-04-25T02:08:01.207349+0000","last_clean":"2024-04-25T02:08:01.207349+0000","last_became_active":"2024-04-25T02:08:00.143648+0000","last_became_peered":"2024-04-25T02:08:00.143648+0000","last_unstale":"2024-04-25T02:08:01.207349+0000","last_undegraded":"2024-04-25T02:08:01.207349+0000","last_fullsized":"2024-04-25T02:08:01.207349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:41.987311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117708+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:08:01.117708+0000","last_peered":"2024-04-25T02:08:01.117708+0000","last_clean":"2024-04-25T02:08:01.117708+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:08:01.117708+0000","last_undegraded":"2024-04-25T02:08:01.117708+0000","last_fullsized":"2024-04-25T02:08:01.117708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114625+0000","last_change":"2024-04-25T02:07:59.117637+0000","last_active":"2024-04-25T02:08:01.114625+0000","last_peered":"2024-04-25T02:08:01.114625+0000","last_clean":"2024-04-25T02:08:01.114625+0000","last_became_active":"2024-04-25T02:07:59.116977+0000","last_became_peered":"2024-04-25T02:07:59.116977+0000","last_unstale":"2024-04-25T02:08:01.114625+0000","last_undegraded":"2024-04-25T02:08:01.114625+0000","last_fullsized":"2024-04-25T02:08:01.114625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:26.203451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118264+0000","last_change":"2024-04-25T02:08:00.141683+0000","last_active":"2024-04-25T02:08:01.118264+0000","last_peered":"2024-04-25T02:08:01.118264+0000","last_clean":"2024-04-25T02:08:01.118264+0000","last_became_active":"2024-04-25T02:08:00.141434+0000","last_became_peered":"2024-04-25T02:08:00.141434+0000","last_unstale":"2024-04-25T02:08:01.118264+0000","last_undegraded":"2024-04-25T02:08:01.118264+0000","last_fullsized":"2024-04-25T02:08:01.118264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.809054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117679+0000","last_change":"2024-04-25T02:07:59.117708+0000","last_active":"2024-04-25T02:08:01.117679+0000","last_peered":"2024-04-25T02:08:01.117679+0000","last_clean":"2024-04-25T02:08:01.117679+0000","last_became_active":"2024-04-25T02:07:59.117400+0000","last_became_peered":"2024-04-25T02:07:59.117400+0000","last_unstale":"2024-04-25T02:08:01.117679+0000","last_undegraded":"2024-04-25T02:08:01.117679+0000","last_fullsized":"2024-04-25T02:08:01.117679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:45.925719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117332+0000","last_change":"2024-04-25T02:08:00.134117+0000","last_active":"2024-04-25T02:08:01.117332+0000","last_peered":"2024-04-25T02:08:01.117332+0000","last_clean":"2024-04-25T02:08:01.117332+0000","last_became_active":"2024-04-25T02:08:00.133834+0000","last_became_peered":"2024-04-25T02:08:00.133834+0000","last_unstale":"2024-04-25T02:08:01.117332+0000","last_undegraded":"2024-04-25T02:08:01.117332+0000","last_fullsized":"2024-04-25T02:08:01.117332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:03.610376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117110+0000","last_change":"2024-04-25T02:07:59.117339+0000","last_active":"2024-04-25T02:08:01.117110+0000","last_peered":"2024-04-25T02:08:01.117110+0000","last_clean":"2024-04-25T02:08:01.117110+0000","last_became_active":"2024-04-25T02:07:59.116562+0000","last_became_peered":"2024-04-25T02:07:59.116562+0000","last_unstale":"2024-04-25T02:08:01.117110+0000","last_undegraded":"2024-04-25T02:08:01.117110+0000","last_fullsized":"2024-04-25T02:08:01.117110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:52:35.221325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113308+0000","last_change":"2024-04-25T02:08:00.127645+0000","last_active":"2024-04-25T02:08:01.113308+0000","last_peered":"2024-04-25T02:08:01.113308+0000","last_clean":"2024-04-25T02:08:01.113308+0000","last_became_active":"2024-04-25T02:08:00.127261+0000","last_became_peered":"2024-04-25T02:08:00.127261+0000","last_unstale":"2024-04-25T02:08:01.113308+0000","last_undegraded":"2024-04-25T02:08:01.113308+0000","last_fullsized":"2024-04-25T02:08:01.113308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:27:41.665005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115821+0000","last_change":"2024-04-25T02:07:59.114633+0000","last_active":"2024-04-25T02:08:01.115821+0000","last_peered":"2024-04-25T02:08:01.115821+0000","last_clean":"2024-04-25T02:08:01.115821+0000","last_became_active":"2024-04-25T02:07:59.114349+0000","last_became_peered":"2024-04-25T02:07:59.114349+0000","last_unstale":"2024-04-25T02:08:01.115821+0000","last_undegraded":"2024-04-25T02:08:01.115821+0000","last_fullsized":"2024-04-25T02:08:01.115821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:06.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117977+0000","last_change":"2024-04-25T02:08:00.131106+0000","last_active":"2024-04-25T02:08:01.117977+0000","last_peered":"2024-04-25T02:08:01.117977+0000","last_clean":"2024-04-25T02:08:01.117977+0000","last_became_active":"2024-04-25T02:08:00.130507+0000","last_became_peered":"2024-04-25T02:08:00.130507+0000","last_unstale":"2024-04-25T02:08:01.117977+0000","last_undegraded":"2024-04-25T02:08:01.117977+0000","last_fullsized":"2024-04-25T02:08:01.117977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:46.930603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113534+0000","last_change":"2024-04-25T02:07:59.108809+0000","last_active":"2024-04-25T02:08:01.113534+0000","last_peered":"2024-04-25T02:08:01.113534+0000","last_clean":"2024-04-25T02:08:01.113534+0000","last_became_active":"2024-04-25T02:07:59.108512+0000","last_became_peered":"2024-04-25T02:07:59.108512+0000","last_unstale":"2024-04-25T02:08:01.113534+0000","last_undegraded":"2024-04-25T02:08:01.113534+0000","last_fullsized":"2024-04-25T02:08:01.113534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:06.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115650+0000","last_change":"2024-04-25T02:08:00.132084+0000","last_active":"2024-04-25T02:08:01.115650+0000","last_peered":"2024-04-25T02:08:01.115650+0000","last_clean":"2024-04-25T02:08:01.115650+0000","last_became_active":"2024-04-25T02:08:00.131767+0000","last_became_peered":"2024-04-25T02:08:00.131767+0000","last_unstale":"2024-04-25T02:08:01.115650+0000","last_undegraded":"2024-04-25T02:08:01.115650+0000","last_fullsized":"2024-04-25T02:08:01.115650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:08:42.030490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207466+0000","last_change":"2024-04-25T02:07:59.118487+0000","last_active":"2024-04-25T02:08:01.207466+0000","last_peered":"2024-04-25T02:08:01.207466+0000","last_clean":"2024-04-25T02:08:01.207466+0000","last_became_active":"2024-04-25T02:07:59.118201+0000","last_became_peered":"2024-04-25T02:07:59.118201+0000","last_unstale":"2024-04-25T02:08:01.207466+0000","last_undegraded":"2024-04-25T02:08:01.207466+0000","last_fullsized":"2024-04-25T02:08:01.207466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:55.053228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113576+0000","last_change":"2024-04-25T02:08:00.131978+0000","last_active":"2024-04-25T02:08:01.113576+0000","last_peered":"2024-04-25T02:08:01.113576+0000","last_clean":"2024-04-25T02:08:01.113576+0000","last_became_active":"2024-04-25T02:08:00.131731+0000","last_became_peered":"2024-04-25T02:08:00.131731+0000","last_unstale":"2024-04-25T02:08:01.113576+0000","last_undegraded":"2024-04-25T02:08:01.113576+0000","last_fullsized":"2024-04-25T02:08:01.113576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:29.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.197797+0000","last_change":"2024-04-25T02:07:59.112512+0000","last_active":"2024-04-25T02:08:01.197797+0000","last_peered":"2024-04-25T02:08:01.197797+0000","last_clean":"2024-04-25T02:08:01.197797+0000","last_became_active":"2024-04-25T02:07:59.112246+0000","last_became_peered":"2024-04-25T02:07:59.112246+0000","last_unstale":"2024-04-25T02:08:01.197797+0000","last_undegraded":"2024-04-25T02:08:01.197797+0000","last_fullsized":"2024-04-25T02:08:01.197797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:45.925719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118217+0000","last_change":"2024-04-25T02:08:00.140610+0000","last_active":"2024-04-25T02:08:01.118217+0000","last_peered":"2024-04-25T02:08:01.118217+0000","last_clean":"2024-04-25T02:08:01.118217+0000","last_became_active":"2024-04-25T02:08:00.140314+0000","last_became_peered":"2024-04-25T02:08:00.140314+0000","last_unstale":"2024-04-25T02:08:01.118217+0000","last_undegraded":"2024-04-25T02:08:01.118217+0000","last_fullsized":"2024-04-25T02:08:01.118217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:54.475986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115418+0000","last_change":"2024-04-25T02:07:59.119301+0000","last_active":"2024-04-25T02:08:01.115418+0000","last_peered":"2024-04-25T02:08:01.115418+0000","last_clean":"2024-04-25T02:08:01.115418+0000","last_became_active":"2024-04-25T02:07:59.119015+0000","last_became_peered":"2024-04-25T02:07:59.119015+0000","last_unstale":"2024-04-25T02:08:01.115418+0000","last_undegraded":"2024-04-25T02:08:01.115418+0000","last_fullsized":"2024-04-25T02:08:01.115418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:06.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117449+0000","last_change":"2024-04-25T02:08:00.127146+0000","last_active":"2024-04-25T02:08:01.117449+0000","last_peered":"2024-04-25T02:08:01.117449+0000","last_clean":"2024-04-25T02:08:01.117449+0000","last_became_active":"2024-04-25T02:08:00.126871+0000","last_became_peered":"2024-04-25T02:08:00.126871+0000","last_unstale":"2024-04-25T02:08:01.117449+0000","last_undegraded":"2024-04-25T02:08:01.117449+0000","last_fullsized":"2024-04-25T02:08:01.117449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:03:37.966520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117574+0000","last_change":"2024-04-25T02:07:59.119153+0000","last_active":"2024-04-25T02:08:01.117574+0000","last_peered":"2024-04-25T02:08:01.117574+0000","last_clean":"2024-04-25T02:08:01.117574+0000","last_became_active":"2024-04-25T02:07:59.118830+0000","last_became_peered":"2024-04-25T02:07:59.118830+0000","last_unstale":"2024-04-25T02:08:01.117574+0000","last_undegraded":"2024-04-25T02:08:01.117574+0000","last_fullsized":"2024-04-25T02:08:01.117574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:17.087667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117757+0000","last_change":"2024-04-25T02:08:00.130764+0000","last_active":"2024-04-25T02:08:01.117757+0000","last_peered":"2024-04-25T02:08:01.117757+0000","last_clean":"2024-04-25T02:08:01.117757+0000","last_became_active":"2024-04-25T02:08:00.130490+0000","last_became_peered":"2024-04-25T02:08:00.130490+0000","last_unstale":"2024-04-25T02:08:01.117757+0000","last_undegraded":"2024-04-25T02:08:01.117757+0000","last_fullsized":"2024-04-25T02:08:01.117757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:18.092551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113394+0000","last_change":"2024-04-25T02:07:59.115182+0000","last_active":"2024-04-25T02:08:01.113394+0000","last_peered":"2024-04-25T02:08:01.113394+0000","last_clean":"2024-04-25T02:08:01.113394+0000","last_became_active":"2024-04-25T02:07:59.114863+0000","last_became_peered":"2024-04-25T02:07:59.114863+0000","last_unstale":"2024-04-25T02:08:01.113394+0000","last_undegraded":"2024-04-25T02:08:01.113394+0000","last_fullsized":"2024-04-25T02:08:01.113394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:17.087667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117302+0000","last_change":"2024-04-25T02:08:00.138786+0000","last_active":"2024-04-25T02:08:01.117302+0000","last_peered":"2024-04-25T02:08:01.117302+0000","last_clean":"2024-04-25T02:08:01.117302+0000","last_became_active":"2024-04-25T02:08:00.138517+0000","last_became_peered":"2024-04-25T02:08:00.138517+0000","last_unstale":"2024-04-25T02:08:01.117302+0000","last_undegraded":"2024-04-25T02:08:01.117302+0000","last_fullsized":"2024-04-25T02:08:01.117302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:27.956618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.113528+0000","last_change":"2024-04-25T02:07:59.113581+0000","last_active":"2024-04-25T02:08:01.113528+0000","last_peered":"2024-04-25T02:08:01.113528+0000","last_clean":"2024-04-25T02:08:01.113528+0000","last_became_active":"2024-04-25T02:07:59.113310+0000","last_became_peered":"2024-04-25T02:07:59.113310+0000","last_unstale":"2024-04-25T02:08:01.113528+0000","last_undegraded":"2024-04-25T02:08:01.113528+0000","last_fullsized":"2024-04-25T02:08:01.113528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:44:38.307212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118372+0000","last_change":"2024-04-25T02:08:00.137561+0000","last_active":"2024-04-25T02:08:01.118372+0000","last_peered":"2024-04-25T02:08:01.118372+0000","last_clean":"2024-04-25T02:08:01.118372+0000","last_became_active":"2024-04-25T02:08:00.137252+0000","last_became_peered":"2024-04-25T02:08:00.137252+0000","last_unstale":"2024-04-25T02:08:01.118372+0000","last_undegraded":"2024-04-25T02:08:01.118372+0000","last_fullsized":"2024-04-25T02:08:01.118372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:19.162081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207479+0000","last_change":"2024-04-25T02:07:59.118237+0000","last_active":"2024-04-25T02:08:01.207479+0000","last_peered":"2024-04-25T02:08:01.207479+0000","last_clean":"2024-04-25T02:08:01.207479+0000","last_became_active":"2024-04-25T02:07:59.117917+0000","last_became_peered":"2024-04-25T02:07:59.117917+0000","last_unstale":"2024-04-25T02:08:01.207479+0000","last_undegraded":"2024-04-25T02:08:01.207479+0000","last_fullsized":"2024-04-25T02:08:01.207479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:26.203451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.114395+0000","last_change":"2024-04-25T02:08:00.126329+0000","last_active":"2024-04-25T02:08:01.114395+0000","last_peered":"2024-04-25T02:08:01.114395+0000","last_clean":"2024-04-25T02:08:01.114395+0000","last_became_active":"2024-04-25T02:08:00.125975+0000","last_became_peered":"2024-04-25T02:08:00.125975+0000","last_unstale":"2024-04-25T02:08:01.114395+0000","last_undegraded":"2024-04-25T02:08:01.114395+0000","last_fullsized":"2024-04-25T02:08:01.114395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:27.956618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115608+0000","last_change":"2024-04-25T02:08:00.120645+0000","last_active":"2024-04-25T02:08:01.115608+0000","last_peered":"2024-04-25T02:08:01.115608+0000","last_clean":"2024-04-25T02:08:01.115608+0000","last_became_active":"2024-04-25T02:08:00.120310+0000","last_became_peered":"2024-04-25T02:08:00.120310+0000","last_unstale":"2024-04-25T02:08:01.115608+0000","last_undegraded":"2024-04-25T02:08:01.115608+0000","last_fullsized":"2024-04-25T02:08:01.115608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:48.665413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117952+0000","last_change":"2024-04-25T02:07:59.120716+0000","last_active":"2024-04-25T02:08:01.117952+0000","last_peered":"2024-04-25T02:08:01.117952+0000","last_clean":"2024-04-25T02:08:01.117952+0000","last_became_active":"2024-04-25T02:07:59.120392+0000","last_became_peered":"2024-04-25T02:07:59.120392+0000","last_unstale":"2024-04-25T02:08:01.117952+0000","last_undegraded":"2024-04-25T02:08:01.117952+0000","last_fullsized":"2024-04-25T02:08:01.117952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:06.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.115035+0000","last_change":"2024-04-25T02:08:00.121830+0000","last_active":"2024-04-25T02:08:01.115035+0000","last_peered":"2024-04-25T02:08:01.115035+0000","last_clean":"2024-04-25T02:08:01.115035+0000","last_became_active":"2024-04-25T02:08:00.121537+0000","last_became_peered":"2024-04-25T02:08:00.121537+0000","last_unstale":"2024-04-25T02:08:01.115035+0000","last_undegraded":"2024-04-25T02:08:01.115035+0000","last_fullsized":"2024-04-25T02:08:01.115035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:36.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.207392+0000","last_change":"2024-04-25T02:07:59.118155+0000","last_active":"2024-04-25T02:08:01.207392+0000","last_peered":"2024-04-25T02:08:01.207392+0000","last_clean":"2024-04-25T02:08:01.207392+0000","last_became_active":"2024-04-25T02:07:59.117780+0000","last_became_peered":"2024-04-25T02:07:59.117780+0000","last_unstale":"2024-04-25T02:08:01.207392+0000","last_undegraded":"2024-04-25T02:08:01.207392+0000","last_fullsized":"2024-04-25T02:08:01.207392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:01.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117736+0000","last_change":"2024-04-25T02:08:00.135738+0000","last_active":"2024-04-25T02:08:01.117736+0000","last_peered":"2024-04-25T02:08:01.117736+0000","last_clean":"2024-04-25T02:08:01.117736+0000","last_became_active":"2024-04-25T02:08:00.135274+0000","last_became_peered":"2024-04-25T02:08:00.135274+0000","last_unstale":"2024-04-25T02:08:01.117736+0000","last_undegraded":"2024-04-25T02:08:01.117736+0000","last_fullsized":"2024-04-25T02:08:01.117736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:17.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118294+0000","last_change":"2024-04-25T02:07:59.112926+0000","last_active":"2024-04-25T02:08:01.118294+0000","last_peered":"2024-04-25T02:08:01.118294+0000","last_clean":"2024-04-25T02:08:01.118294+0000","last_became_active":"2024-04-25T02:07:59.112649+0000","last_became_peered":"2024-04-25T02:07:59.112649+0000","last_unstale":"2024-04-25T02:08:01.118294+0000","last_undegraded":"2024-04-25T02:08:01.118294+0000","last_fullsized":"2024-04-25T02:08:01.118294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:58.131371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.118217+0000","last_change":"2024-04-25T02:08:00.133666+0000","last_active":"2024-04-25T02:08:01.118217+0000","last_peered":"2024-04-25T02:08:01.118217+0000","last_clean":"2024-04-25T02:08:01.118217+0000","last_became_active":"2024-04-25T02:08:00.133392+0000","last_became_peered":"2024-04-25T02:08:00.133392+0000","last_unstale":"2024-04-25T02:08:01.118217+0000","last_undegraded":"2024-04-25T02:08:01.118217+0000","last_fullsized":"2024-04-25T02:08:01.118217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:59.093056+0000","last_clean_scrub_stamp":"2024-04-25T02:07:59.093056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:17.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T02:08:01.117965+0000","last_change":"2024-04-25T02:07:59.115590+0000","last_active":"2024-04-25T02:08:01.117965+0000","last_peered":"2024-04-25T02:08:01.117965+0000","last_clean":"2024-04-25T02:08:01.117965+0000","last_became_active":"2024-04-25T02:07:59.115307+0000","last_became_peered":"2024-04-25T02:07:59.115307+0000","last_unstale":"2024-04-25T02:08:01.117965+0000","last_undegraded":"2024-04-25T02:08:01.117965+0000","last_fullsized":"2024-04-25T02:08:01.117965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:58.088172+0000","last_clean_scrub_stamp":"2024-04-25T02:07:58.088172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:58.131371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:08:07.760 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T02:08:07.760 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T02:08:07.761 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T02:08:07.761 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T02:08:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.885+0000 7f3110b77640 1 Processor -- start 2024-04-25T02:08:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.885+0000 7f3110b77640 1 -- start start 2024-04-25T02:08:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3110b77640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f310c158910 0x7f310c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3110b77640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f310c071a40 con 0x7f310c15f2a0 2024-04-25T02:08:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3110b77640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f310c071d20 con 0x7f310c06e900 2024-04-25T02:08:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3110b77640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f310c072650 con 0x7f310c158910 2024-04-25T02:08:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f310ad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f310c15f2a0 0x7f310c0b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47840/0 (socket says 172.21.15.79:47840) 2024-04-25T02:08:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f310ad9d640 1 -- 172.21.15.79:0/3991477428 learned_addr learned my addr 172.21.15.79:0/3991477428 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f310a59c640 1 --2- 172.21.15.79:0/3991477428 >> v2:172.21.15.189:3300/0 conn(0x7f310c158910 0x7f310c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3109d9b640 1 -- 172.21.15.79:0/3991477428 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 894394325 0 0) 0x7f310c071a40 con 0x7f310c15f2a0 2024-04-25T02:08:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3109d9b640 1 -- 172.21.15.79:0/3991477428 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30f8003520 con 0x7f310c15f2a0 2024-04-25T02:08:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3109d9b640 1 -- 172.21.15.79:0/3991477428 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2549387191 0 0) 0x7f30f8003520 con 0x7f310c15f2a0 2024-04-25T02:08:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3109d9b640 1 -- 172.21.15.79:0/3991477428 >> v2:172.21.15.189:3300/0 conn(0x7f310c158910 msgr2=0x7f310c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3109d9b640 1 --2- 172.21.15.79:0/3991477428 >> v2:172.21.15.189:3300/0 conn(0x7f310c158910 0x7f310c06e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3109d9b640 1 -- 172.21.15.79:0/3991477428 >> v1:172.21.15.189:6789/0 conn(0x7f310c06e900 legacy=0x7f310c15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3109d9b640 1 -- 172.21.15.79:0/3991477428 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310c072000 con 0x7f310c15f2a0 2024-04-25T02:08:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3109d9b640 1 -- 172.21.15.79:0/3991477428 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f31040019f0 con 0x7f310c15f2a0 2024-04-25T02:08:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3109d9b640 1 -- 172.21.15.79:0/3991477428 >> v1:172.21.15.79:6789/0 conn(0x7f310c15f2a0 legacy=0x7f310c0b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3109d9b640 1 --2- 172.21.15.79:0/3991477428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30f80039b0 0x7f30f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3109d9b640 1 --2- 172.21.15.79:0/3991477428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f8004800 0x7f30f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3109d9b640 1 --2- 172.21.15.79:0/3991477428 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f30f80051c0 0x7f30f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3109d9b640 1 -- 172.21.15.79:0/3991477428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f310c072650 con 0x7f30f80039b0 2024-04-25T02:08:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3109d9b640 1 -- 172.21.15.79:0/3991477428 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f30f800c060 con 0x7f30f8004800 2024-04-25T02:08:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f3109d9b640 1 -- 172.21.15.79:0/3991477428 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f30f800c260 con 0x7f30f80051c0 2024-04-25T02:08:07.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.886+0000 7f310a59c640 1 --2- 172.21.15.79:0/3991477428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30f80039b0 0x7f30f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.887+0000 7f3101d9b640 1 --2- 172.21.15.79:0/3991477428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f8004800 0x7f30f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.887+0000 7f310ad9d640 1 --2- 172.21.15.79:0/3991477428 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f30f80051c0 0x7f30f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.887+0000 7f310a59c640 1 -- 172.21.15.79:0/3991477428 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f30f80051c0 msgr2=0x7f30f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:07.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.887+0000 7f310a59c640 1 --2- 172.21.15.79:0/3991477428 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f30f80051c0 0x7f30f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.887+0000 7f310a59c640 1 -- 172.21.15.79:0/3991477428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f8004800 msgr2=0x7f30f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:07.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.887+0000 7f310a59c640 1 --2- 172.21.15.79:0/3991477428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f8004800 0x7f30f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.887+0000 7f310a59c640 1 -- 172.21.15.79:0/3991477428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f8003520 con 0x7f30f80039b0 2024-04-25T02:08:07.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.887+0000 7f310ad9d640 1 --2- 172.21.15.79:0/3991477428 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f30f80051c0 0x7f30f800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:07.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.887+0000 7f3101d9b640 1 --2- 172.21.15.79:0/3991477428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f8004800 0x7f30f8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:07.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.887+0000 7f310ad9d640 1 -- 172.21.15.79:0/3991477428 reap_dead start 2024-04-25T02:08:07.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.887+0000 7f310a59c640 1 --2- 172.21.15.79:0/3991477428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30f80039b0 0x7f30f8003dd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009ac0 tx=0x7f30f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de42ea66fd4deb3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:07.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.887+0000 7f3109d9b640 1 -- 172.21.15.79:0/3991477428 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc036070 con 0x7f30f80039b0 2024-04-25T02:08:07.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.888+0000 7f3109d9b640 1 -- 172.21.15.79:0/3991477428 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30fc031400 con 0x7f30f80039b0 2024-04-25T02:08:07.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.888+0000 7f3109d9b640 1 -- 172.21.15.79:0/3991477428 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc009690 con 0x7f30f80039b0 2024-04-25T02:08:07.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.888+0000 7f3110b77640 1 -- 172.21.15.79:0/3991477428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30f80039b0 msgr2=0x7f30f8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.888+0000 7f3110b77640 1 --2- 172.21.15.79:0/3991477428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30f80039b0 0x7f30f8003dd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009ac0 tx=0x7f30f8005830 comp rx=0 tx=0).stop 2024-04-25T02:08:07.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.888+0000 7f3110b77640 1 -- 172.21.15.79:0/3991477428 shutdown_connections 2024-04-25T02:08:07.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.888+0000 7f3110b77640 1 --2- 172.21.15.79:0/3991477428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30f80039b0 0x7f30f8003dd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.888+0000 7f3110b77640 1 -- 172.21.15.79:0/3991477428 >> 172.21.15.79:0/3991477428 conn(0x7f310c0cfc80 msgr2=0x7f310c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:07.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.888+0000 7f3110b77640 1 -- 172.21.15.79:0/3991477428 shutdown_connections 2024-04-25T02:08:07.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.888+0000 7f3110b77640 1 -- 172.21.15.79:0/3991477428 wait complete. 2024-04-25T02:08:07.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.889+0000 7f3110b77640 1 Processor -- start 2024-04-25T02:08:07.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.890+0000 7f3110b77640 1 -- start start 2024-04-25T02:08:07.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.890+0000 7f3110b77640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f80039b0 0x7f310c1417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.890+0000 7f3110b77640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f310c06d950 0x7f310c06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.890+0000 7f3110b77640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f310c1506a0 0x7f310c150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.890+0000 7f3110b77640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f310c158cf0 con 0x7f310c06d950 2024-04-25T02:08:07.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.890+0000 7f3110b77640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f310c15f930 con 0x7f30f80039b0 2024-04-25T02:08:07.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.890+0000 7f3110b77640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f310c158e70 con 0x7f310c1506a0 2024-04-25T02:08:07.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.890+0000 7f3101d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f310c06d950 0x7f310c06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.890+0000 7f3101d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f310c06d950 0x7f310c06ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35208/0 (socket says 172.21.15.79:35208) 2024-04-25T02:08:07.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.890+0000 7f3101d9b640 1 -- 172.21.15.79:0/2090145760 learned_addr learned my addr 172.21.15.79:0/2090145760 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:07.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.890+0000 7f310ad9d640 1 --2- 172.21.15.79:0/2090145760 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f310c1506a0 0x7f310c150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.891+0000 7f3101d9b640 1 -- 172.21.15.79:0/2090145760 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f310c1506a0 msgr2=0x7f310c150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.891+0000 7f310a59c640 1 --2- 172.21.15.79:0/2090145760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f80039b0 0x7f310c1417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.891+0000 7f3101d9b640 1 --2- 172.21.15.79:0/2090145760 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f310c1506a0 0x7f310c150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.891+0000 7f3101d9b640 1 -- 172.21.15.79:0/2090145760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f80039b0 msgr2=0x7f310c1417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.891+0000 7f3101d9b640 1 --2- 172.21.15.79:0/2090145760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f80039b0 0x7f310c1417c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.891+0000 7f3101d9b640 1 -- 172.21.15.79:0/2090145760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310c141d00 con 0x7f310c06d950 2024-04-25T02:08:07.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.891+0000 7f3101d9b640 1 --2- 172.21.15.79:0/2090145760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f310c06d950 0x7f310c06ddd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f30f400e550 tx=0x7f30f400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:07.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.891+0000 7f31037fe640 1 -- 172.21.15.79:0/2090145760 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f40052e0 con 0x7f310c06d950 2024-04-25T02:08:07.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.891+0000 7f31037fe640 1 -- 172.21.15.79:0/2090145760 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f4018070 con 0x7f310c06d950 2024-04-25T02:08:07.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.891+0000 7f3110b77640 1 -- 172.21.15.79:0/2090145760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f310c14f5a0 con 0x7f310c06d950 2024-04-25T02:08:07.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.891+0000 7f31037fe640 1 -- 172.21.15.79:0/2090145760 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4003830 con 0x7f310c06d950 2024-04-25T02:08:07.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.891+0000 7f3110b77640 1 -- 172.21.15.79:0/2090145760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f310c14fb60 con 0x7f310c06d950 2024-04-25T02:08:07.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.892+0000 7f3110b77640 1 -- 172.21.15.79:0/2090145760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f310c14f330 con 0x7f310c06d950 2024-04-25T02:08:07.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.892+0000 7f31037fe640 1 -- 172.21.15.79:0/2090145760 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30f40039d0 con 0x7f310c06d950 2024-04-25T02:08:07.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.893+0000 7f31037fe640 1 --2- 172.21.15.79:0/2090145760 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30ec06be30 0x7f30ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.893+0000 7f310a59c640 1 --2- 172.21.15.79:0/2090145760 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30ec06be30 0x7f30ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.893+0000 7f31037fe640 1 -- 172.21.15.79:0/2090145760 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f30f408ab30 con 0x7f310c06d950 2024-04-25T02:08:07.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.893+0000 7f310a59c640 1 --2- 172.21.15.79:0/2090145760 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30ec06be30 0x7f30ec06e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f30fc033000 tx=0x7f30fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:07.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:07.897+0000 7f31037fe640 1 -- 172.21.15.79:0/2090145760 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f30f400ce20 con 0x7f310c06d950 2024-04-25T02:08:08.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.105+0000 7f3110b77640 1 -- 172.21.15.79:0/2090145760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f310c0690a0 con 0x7f310c06d950 2024-04-25T02:08:08.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.105+0000 7f31037fe640 1 -- 172.21.15.79:0/2090145760 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f30f40594e0 con 0x7f310c06d950 2024-04-25T02:08:08.113 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:08.113 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T02:08:08.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.107+0000 7f3110b77640 1 -- 172.21.15.79:0/2090145760 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30ec06be30 msgr2=0x7f30ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.107+0000 7f3110b77640 1 --2- 172.21.15.79:0/2090145760 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30ec06be30 0x7f30ec06e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f30fc033000 tx=0x7f30fc008030 comp rx=0 tx=0).stop 2024-04-25T02:08:08.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.107+0000 7f3110b77640 1 -- 172.21.15.79:0/2090145760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f310c06d950 msgr2=0x7f310c06ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.107+0000 7f3110b77640 1 --2- 172.21.15.79:0/2090145760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f310c06d950 0x7f310c06ddd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f30f400e550 tx=0x7f30f400ea10 comp rx=0 tx=0).stop 2024-04-25T02:08:08.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.107+0000 7f3110b77640 1 -- 172.21.15.79:0/2090145760 shutdown_connections 2024-04-25T02:08:08.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.107+0000 7f3110b77640 1 --2- 172.21.15.79:0/2090145760 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30ec06be30 0x7f30ec06e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.107+0000 7f3110b77640 1 --2- 172.21.15.79:0/2090145760 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f310c1506a0 0x7f310c150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.107+0000 7f3110b77640 1 --2- 172.21.15.79:0/2090145760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f310c06d950 0x7f310c06ddd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.107+0000 7f3110b77640 1 --2- 172.21.15.79:0/2090145760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f80039b0 0x7f310c1417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.107+0000 7f3110b77640 1 -- 172.21.15.79:0/2090145760 >> 172.21.15.79:0/2090145760 conn(0x7f310c0cfc80 msgr2=0x7f310c0b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.108+0000 7f3110b77640 1 -- 172.21.15.79:0/2090145760 shutdown_connections 2024-04-25T02:08:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.108+0000 7f3110b77640 1 -- 172.21.15.79:0/2090145760 wait complete. 2024-04-25T02:08:08.125 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T02:08:08.126 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:08.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.217+0000 7f6206d9e640 1 Processor -- start 2024-04-25T02:08:08.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.217+0000 7f6206d9e640 1 -- start start 2024-04-25T02:08:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f6206d9e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f620006e3e0 0x7f6200071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f6206d9e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6200070d90 con 0x7f620006df50 2024-04-25T02:08:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f6206d9e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62000cf130 con 0x7f6200144cb0 2024-04-25T02:08:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f6206d9e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f62000cf410 con 0x7f620006e3e0 2024-04-25T02:08:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61fffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f620006df50 0x7f6200071240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47852/0 (socket says 172.21.15.79:47852) 2024-04-25T02:08:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61fffff640 1 -- 172.21.15.79:0/3666478536 learned_addr learned my addr 172.21.15.79:0/3666478536 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f620533b640 1 --2- 172.21.15.79:0/3666478536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f620006e3e0 0x7f6200071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274925535 0 0) 0x7f6200070d90 con 0x7f620006df50 2024-04-25T02:08:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61f0003520 con 0x7f620006df50 2024-04-25T02:08:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2451195943 0 0) 0x7f62000cf130 con 0x7f6200144cb0 2024-04-25T02:08:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6200070d90 con 0x7f6200144cb0 2024-04-25T02:08:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3416226311 0 0) 0x7f61f0003520 con 0x7f620006df50 2024-04-25T02:08:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f620006e3e0 msgr2=0x7f6200071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61ff7fe640 1 --2- 172.21.15.79:0/3666478536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f620006e3e0 0x7f6200071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 >> v1:172.21.15.189:6789/0 conn(0x7f6200144cb0 legacy=0x7f62000b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62000cf6f0 con 0x7f620006df50 2024-04-25T02:08:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f61ec001670 con 0x7f620006df50 2024-04-25T02:08:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 >> v1:172.21.15.79:6789/0 conn(0x7f620006df50 legacy=0x7f6200071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61ff7fe640 1 --2- 172.21.15.79:0/3666478536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61f0003b70 0x7f61f0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61ff7fe640 1 --2- 172.21.15.79:0/3666478536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61f0004800 0x7f61f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.218+0000 7f61ff7fe640 1 --2- 172.21.15.79:0/3666478536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f620006e3e0 0x7f61f00052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.219+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f62000cf410 con 0x7f61f0004800 2024-04-25T02:08:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.219+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f61f000bbc0 con 0x7f61f0003b70 2024-04-25T02:08:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.219+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f61f000bdc0 con 0x7f620006e3e0 2024-04-25T02:08:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.219+0000 7f61fffff640 1 --2- 172.21.15.79:0/3666478536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61f0004800 0x7f61f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.219+0000 7f6204b3a640 1 --2- 172.21.15.79:0/3666478536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61f0003b70 0x7f61f0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.219+0000 7f620533b640 1 --2- 172.21.15.79:0/3666478536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f620006e3e0 0x7f61f00052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.219+0000 7f61fffff640 1 -- 172.21.15.79:0/3666478536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f620006e3e0 msgr2=0x7f61f00052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.219+0000 7f61fffff640 1 --2- 172.21.15.79:0/3666478536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f620006e3e0 0x7f61f00052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.219+0000 7f61fffff640 1 -- 172.21.15.79:0/3666478536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61f0003b70 msgr2=0x7f61f0003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.219+0000 7f61fffff640 1 --2- 172.21.15.79:0/3666478536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61f0003b70 0x7f61f0003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.219+0000 7f61fffff640 1 -- 172.21.15.79:0/3666478536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f0003520 con 0x7f61f0004800 2024-04-25T02:08:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.219+0000 7f6204b3a640 1 --2- 172.21.15.79:0/3666478536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61f0003b70 0x7f61f0003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.219+0000 7f620533b640 1 --2- 172.21.15.79:0/3666478536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f620006e3e0 0x7f61f00052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.219+0000 7f61fffff640 1 --2- 172.21.15.79:0/3666478536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61f0004800 0x7f61f0004c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00c0e0 tx=0x7f61f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e4df9634930a73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:08.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.220+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec007c00 con 0x7f61f0004800 2024-04-25T02:08:08.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.220+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ec005ad0 con 0x7f61f0004800 2024-04-25T02:08:08.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.220+0000 7f61ff7fe640 1 -- 172.21.15.79:0/3666478536 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec007070 con 0x7f61f0004800 2024-04-25T02:08:08.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.220+0000 7f6206d9e640 1 -- 172.21.15.79:0/3666478536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61f0004800 msgr2=0x7f61f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.220+0000 7f6206d9e640 1 --2- 172.21.15.79:0/3666478536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61f0004800 0x7f61f0004c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00c0e0 tx=0x7f61f0005830 comp rx=0 tx=0).stop 2024-04-25T02:08:08.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.220+0000 7f620533b640 1 -- 172.21.15.79:0/3666478536 reap_dead start 2024-04-25T02:08:08.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.220+0000 7f6206d9e640 1 -- 172.21.15.79:0/3666478536 shutdown_connections 2024-04-25T02:08:08.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.220+0000 7f6206d9e640 1 -- 172.21.15.79:0/3666478536 >> 172.21.15.79:0/3666478536 conn(0x7f62000cfc80 msgr2=0x7f62000d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:08.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.220+0000 7f6206d9e640 1 -- 172.21.15.79:0/3666478536 shutdown_connections 2024-04-25T02:08:08.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.220+0000 7f6206d9e640 1 -- 172.21.15.79:0/3666478536 wait complete. 2024-04-25T02:08:08.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.221+0000 7f6206d9e640 1 Processor -- start 2024-04-25T02:08:08.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.221+0000 7f6206d9e640 1 -- start start 2024-04-25T02:08:08.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f6206d9e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61f0004800 0x7f62001407b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f6206d9e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62000b0320 0x7f62000b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f6206d9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f620015ad40 0x7f620015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f6206d9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f62000cf9d0 con 0x7f620015ad40 2024-04-25T02:08:08.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f6206d9e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f62000b5750 con 0x7f62000b0320 2024-04-25T02:08:08.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f6206d9e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6200145090 con 0x7f61f0004800 2024-04-25T02:08:08.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f620533b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f620015ad40 0x7f620015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f620533b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f620015ad40 0x7f620015b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35224/0 (socket says 172.21.15.79:35224) 2024-04-25T02:08:08.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f620533b640 1 -- 172.21.15.79:0/2633279841 learned_addr learned my addr 172.21.15.79:0/2633279841 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:08.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f61fffff640 1 --2- 172.21.15.79:0/2633279841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62000b0320 0x7f62000b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f620533b640 1 -- 172.21.15.79:0/2633279841 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61f0004800 msgr2=0x7f62001407b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f620533b640 1 --2- 172.21.15.79:0/2633279841 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61f0004800 0x7f62001407b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f620533b640 1 -- 172.21.15.79:0/2633279841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62000b0320 msgr2=0x7f62000b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f620533b640 1 --2- 172.21.15.79:0/2633279841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62000b0320 0x7f62000b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f620533b640 1 -- 172.21.15.79:0/2633279841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62001f1fb0 con 0x7f620015ad40 2024-04-25T02:08:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.222+0000 7f61fffff640 1 --2- 172.21.15.79:0/2633279841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62000b0320 0x7f62000b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.223+0000 7f620533b640 1 --2- 172.21.15.79:0/2633279841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f620015ad40 0x7f620015b1c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f620006f8a0 tx=0x7f61f8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.223+0000 7f61fd7fa640 1 -- 172.21.15.79:0/2633279841 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8010e50 con 0x7f620015ad40 2024-04-25T02:08:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.223+0000 7f61fd7fa640 1 -- 172.21.15.79:0/2633279841 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f8003990 con 0x7f620015ad40 2024-04-25T02:08:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.223+0000 7f6206d9e640 1 -- 172.21.15.79:0/2633279841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62001f2290 con 0x7f620015ad40 2024-04-25T02:08:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.223+0000 7f61fd7fa640 1 -- 172.21.15.79:0/2633279841 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8003dc0 con 0x7f620015ad40 2024-04-25T02:08:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.223+0000 7f6206d9e640 1 -- 172.21.15.79:0/2633279841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f620015b700 con 0x7f620015ad40 2024-04-25T02:08:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.224+0000 7f6206d9e640 1 -- 172.21.15.79:0/2633279841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62000b0ce0 con 0x7f620015ad40 2024-04-25T02:08:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.224+0000 7f61fd7fa640 1 -- 172.21.15.79:0/2633279841 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61f801e020 con 0x7f620015ad40 2024-04-25T02:08:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.225+0000 7f61fd7fa640 1 --2- 172.21.15.79:0/2633279841 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f61e406be30 0x7f61e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.225+0000 7f6204b3a640 1 --2- 172.21.15.79:0/2633279841 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f61e406be30 0x7f61e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.225+0000 7f61fd7fa640 1 -- 172.21.15.79:0/2633279841 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f61f808b530 con 0x7f620015ad40 2024-04-25T02:08:08.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.225+0000 7f6204b3a640 1 --2- 172.21.15.79:0/2633279841 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f61e406be30 0x7f61e406e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61f40079a0 tx=0x7f61f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:08.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.229+0000 7f61fd7fa640 1 -- 172.21.15.79:0/2633279841 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f61f8059ee0 con 0x7f620015ad40 2024-04-25T02:08:08.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.405+0000 7f6206d9e640 1 -- 172.21.15.79:0/2633279841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62000707d0 con 0x7f620015ad40 2024-04-25T02:08:08.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.406+0000 7f61fd7fa640 1 -- 172.21.15.79:0/2633279841 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f62000707d0 con 0x7f620015ad40 2024-04-25T02:08:08.413 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:08.413 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:08.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.408+0000 7f6206d9e640 1 -- 172.21.15.79:0/2633279841 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f61e406be30 msgr2=0x7f61e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.408+0000 7f6206d9e640 1 --2- 172.21.15.79:0/2633279841 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f61e406be30 0x7f61e406e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61f40079a0 tx=0x7f61f4009040 comp rx=0 tx=0).stop 2024-04-25T02:08:08.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.408+0000 7f6206d9e640 1 -- 172.21.15.79:0/2633279841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f620015ad40 msgr2=0x7f620015b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.408+0000 7f6206d9e640 1 --2- 172.21.15.79:0/2633279841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f620015ad40 0x7f620015b1c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f620006f8a0 tx=0x7f61f8009f90 comp rx=0 tx=0).stop 2024-04-25T02:08:08.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.408+0000 7f6206d9e640 1 -- 172.21.15.79:0/2633279841 shutdown_connections 2024-04-25T02:08:08.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.408+0000 7f6206d9e640 1 --2- 172.21.15.79:0/2633279841 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f61e406be30 0x7f61e406e2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.408+0000 7f6206d9e640 1 --2- 172.21.15.79:0/2633279841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f620015ad40 0x7f620015b1c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.408+0000 7f6206d9e640 1 --2- 172.21.15.79:0/2633279841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62000b0320 0x7f62000b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.408+0000 7f6206d9e640 1 --2- 172.21.15.79:0/2633279841 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61f0004800 0x7f62001407b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.408+0000 7f6206d9e640 1 -- 172.21.15.79:0/2633279841 >> 172.21.15.79:0/2633279841 conn(0x7f62000cfc80 msgr2=0x7f62000ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:08.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.408+0000 7f6206d9e640 1 -- 172.21.15.79:0/2633279841 shutdown_connections 2024-04-25T02:08:08.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.408+0000 7f6206d9e640 1 -- 172.21.15.79:0/2633279841 wait complete. 2024-04-25T02:08:08.426 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:57.115253+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:58.421392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:08:08.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:08:08.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.519+0000 7f200aea5640 1 Processor -- start 2024-04-25T02:08:08.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.519+0000 7f200aea5640 1 -- start start 2024-04-25T02:08:08.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f200aea5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f200415e230 0x7f200406f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f200aea5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f20040ceb40 0x7f2004071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f200aea5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20040cf040 con 0x7f2004071690 2024-04-25T02:08:08.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f200aea5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f20040ca6c0 con 0x7f200415e230 2024-04-25T02:08:08.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f200aea5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f20040ca9a0 con 0x7f20040ceb40 2024-04-25T02:08:08.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f2009442640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2004071690 0x7f2004161e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47854/0 (socket says 172.21.15.79:47854) 2024-04-25T02:08:08.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f2009442640 1 -- 172.21.15.79:0/2932570131 learned_addr learned my addr 172.21.15.79:0/2932570131 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:08.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 -- 172.21.15.79:0/2932570131 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2590310586 0 0) 0x7f20040cf040 con 0x7f2004071690 2024-04-25T02:08:08.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 -- 172.21.15.79:0/2932570131 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ff4003520 con 0x7f2004071690 2024-04-25T02:08:08.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f2003fff640 1 --2- 172.21.15.79:0/2932570131 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f20040ceb40 0x7f2004071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f2008c41640 1 --2- 172.21.15.79:0/2932570131 >> v2:172.21.15.189:3300/0 conn(0x7f200415e230 0x7f200406f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 -- 172.21.15.79:0/2932570131 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1964443920 0 0) 0x7f1ff4003520 con 0x7f2004071690 2024-04-25T02:08:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 -- 172.21.15.79:0/2932570131 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f20040ceb40 msgr2=0x7f2004071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 --2- 172.21.15.79:0/2932570131 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f20040ceb40 0x7f2004071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 -- 172.21.15.79:0/2932570131 >> v2:172.21.15.189:3300/0 conn(0x7f200415e230 msgr2=0x7f200406f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 --2- 172.21.15.79:0/2932570131 >> v2:172.21.15.189:3300/0 conn(0x7f200415e230 0x7f200406f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 -- 172.21.15.79:0/2932570131 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20040cf320 con 0x7f2004071690 2024-04-25T02:08:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 -- 172.21.15.79:0/2932570131 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f1ffc0019f0 con 0x7f2004071690 2024-04-25T02:08:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 -- 172.21.15.79:0/2932570131 >> v1:172.21.15.79:6789/0 conn(0x7f2004071690 legacy=0x7f2004161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 --2- 172.21.15.79:0/2932570131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ff40039b0 0x7f1ff4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 --2- 172.21.15.79:0/2932570131 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f20040ceb40 0x7f1ff4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 --2- 172.21.15.79:0/2932570131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ff4004d40 0x7f1ff40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 -- 172.21.15.79:0/2932570131 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f20040ca6c0 con 0x7f1ff40039b0 2024-04-25T02:08:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 -- 172.21.15.79:0/2932570131 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f20040ca9a0 con 0x7f1ff4004d40 2024-04-25T02:08:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f20037fe640 1 -- 172.21.15.79:0/2932570131 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff400baf0 con 0x7f20040ceb40 2024-04-25T02:08:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f2008c41640 1 --2- 172.21.15.79:0/2932570131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ff40039b0 0x7f1ff4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f2003fff640 1 --2- 172.21.15.79:0/2932570131 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f20040ceb40 0x7f1ff4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.520+0000 7f2009442640 1 --2- 172.21.15.79:0/2932570131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ff4004d40 0x7f1ff40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.521+0000 7f2008c41640 1 -- 172.21.15.79:0/2932570131 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f20040ceb40 msgr2=0x7f1ff4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.521+0000 7f2008c41640 1 --2- 172.21.15.79:0/2932570131 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f20040ceb40 0x7f1ff4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.521+0000 7f2008c41640 1 -- 172.21.15.79:0/2932570131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ff4004d40 msgr2=0x7f1ff40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.521+0000 7f2008c41640 1 --2- 172.21.15.79:0/2932570131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ff4004d40 0x7f1ff40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.521+0000 7f2008c41640 1 -- 172.21.15.79:0/2932570131 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff4003520 con 0x7f1ff40039b0 2024-04-25T02:08:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.521+0000 7f2008c41640 1 --2- 172.21.15.79:0/2932570131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ff40039b0 0x7f1ff4003dd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800ba30 tx=0x7f1ff4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38226309529f3a20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.521+0000 7f20037fe640 1 -- 172.21.15.79:0/2932570131 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8030070 con 0x7f1ff40039b0 2024-04-25T02:08:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.521+0000 7f20037fe640 1 -- 172.21.15.79:0/2932570131 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff802ae10 con 0x7f1ff40039b0 2024-04-25T02:08:08.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.521+0000 7f20037fe640 1 -- 172.21.15.79:0/2932570131 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff800b600 con 0x7f1ff40039b0 2024-04-25T02:08:08.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.522+0000 7f200aea5640 1 -- 172.21.15.79:0/2932570131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ff40039b0 msgr2=0x7f1ff4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.522+0000 7f200aea5640 1 --2- 172.21.15.79:0/2932570131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ff40039b0 0x7f1ff4003dd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800ba30 tx=0x7f1ff4005830 comp rx=0 tx=0).stop 2024-04-25T02:08:08.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.522+0000 7f2009442640 1 -- 172.21.15.79:0/2932570131 reap_dead start 2024-04-25T02:08:08.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.522+0000 7f200aea5640 1 -- 172.21.15.79:0/2932570131 shutdown_connections 2024-04-25T02:08:08.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.522+0000 7f200aea5640 1 -- 172.21.15.79:0/2932570131 >> 172.21.15.79:0/2932570131 conn(0x7f20040d0070 msgr2=0x7f20040d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:08.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.522+0000 7f200aea5640 1 -- 172.21.15.79:0/2932570131 shutdown_connections 2024-04-25T02:08:08.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.522+0000 7f200aea5640 1 -- 172.21.15.79:0/2932570131 wait complete. 2024-04-25T02:08:08.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.523+0000 7f200aea5640 1 Processor -- start 2024-04-25T02:08:08.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.523+0000 7f200aea5640 1 -- start start 2024-04-25T02:08:08.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f200aea5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ff40039b0 0x7f200409cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f200aea5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f200415c6d0 0x7f200409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f200aea5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f200415cb50 0x7f200409afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f200aea5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f200406fb50 con 0x7f200415c6d0 2024-04-25T02:08:08.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f200aea5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f200406f9d0 con 0x7f1ff40039b0 2024-04-25T02:08:08.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f200aea5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f200415e610 con 0x7f200415cb50 2024-04-25T02:08:08.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f2003fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f200415c6d0 0x7f200409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f2003fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f200415c6d0 0x7f200409aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35234/0 (socket says 172.21.15.79:35234) 2024-04-25T02:08:08.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f2003fff640 1 -- 172.21.15.79:0/3541078606 learned_addr learned my addr 172.21.15.79:0/3541078606 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:08.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f2009442640 1 --2- 172.21.15.79:0/3541078606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f200415cb50 0x7f200409afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f2008c41640 1 --2- 172.21.15.79:0/3541078606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ff40039b0 0x7f200409cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f2003fff640 1 -- 172.21.15.79:0/3541078606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f200415cb50 msgr2=0x7f200409afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f2003fff640 1 --2- 172.21.15.79:0/3541078606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f200415cb50 0x7f200409afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f2003fff640 1 -- 172.21.15.79:0/3541078606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ff40039b0 msgr2=0x7f200409cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f2003fff640 1 --2- 172.21.15.79:0/3541078606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ff40039b0 0x7f200409cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f2003fff640 1 -- 172.21.15.79:0/3541078606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200409d050 con 0x7f200415c6d0 2024-04-25T02:08:08.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.524+0000 7f2003fff640 1 --2- 172.21.15.79:0/3541078606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f200415c6d0 0x7f200409aa70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000b820 tx=0x7f1ff000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:08.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.525+0000 7f20017fa640 1 -- 172.21.15.79:0/3541078606 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0018070 con 0x7f200415c6d0 2024-04-25T02:08:08.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.525+0000 7f20017fa640 1 -- 172.21.15.79:0/3541078606 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff000be10 con 0x7f200415c6d0 2024-04-25T02:08:08.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.525+0000 7f200aea5640 1 -- 172.21.15.79:0/3541078606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20040b3b40 con 0x7f200415c6d0 2024-04-25T02:08:08.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.525+0000 7f20017fa640 1 -- 172.21.15.79:0/3541078606 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0010c60 con 0x7f200415c6d0 2024-04-25T02:08:08.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.525+0000 7f200aea5640 1 -- 172.21.15.79:0/3541078606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20040b32a0 con 0x7f200415c6d0 2024-04-25T02:08:08.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.526+0000 7f200aea5640 1 -- 172.21.15.79:0/3541078606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20040690a0 con 0x7f200415c6d0 2024-04-25T02:08:08.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.526+0000 7f20017fa640 1 -- 172.21.15.79:0/3541078606 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ff001b070 con 0x7f200415c6d0 2024-04-25T02:08:08.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.526+0000 7f20017fa640 1 --2- 172.21.15.79:0/3541078606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fe806be30 0x7f1fe806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.526+0000 7f20017fa640 1 -- 172.21.15.79:0/3541078606 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1ff008b310 con 0x7f200415c6d0 2024-04-25T02:08:08.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.526+0000 7f2008c41640 1 --2- 172.21.15.79:0/3541078606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fe806be30 0x7f1fe806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.527+0000 7f2008c41640 1 --2- 172.21.15.79:0/3541078606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fe806be30 0x7f1fe806e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800ba00 tx=0x7f1ff8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:08.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.531+0000 7f20017fa640 1 -- 172.21.15.79:0/3541078606 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f200409d050 con 0x7f200415c6d0 2024-04-25T02:08:08.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.705+0000 7f200aea5640 1 -- 172.21.15.79:0/3541078606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f20040b5ff0 con 0x7f200415c6d0 2024-04-25T02:08:08.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.706+0000 7f20017fa640 1 -- 172.21.15.79:0/3541078606 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f1ff0059c20 con 0x7f200415c6d0 2024-04-25T02:08:08.713 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:08:08.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.708+0000 7f200aea5640 1 -- 172.21.15.79:0/3541078606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fe806be30 msgr2=0x7f1fe806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.708+0000 7f200aea5640 1 --2- 172.21.15.79:0/3541078606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fe806be30 0x7f1fe806e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800ba00 tx=0x7f1ff8030000 comp rx=0 tx=0).stop 2024-04-25T02:08:08.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.708+0000 7f200aea5640 1 -- 172.21.15.79:0/3541078606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f200415c6d0 msgr2=0x7f200409aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.708+0000 7f200aea5640 1 --2- 172.21.15.79:0/3541078606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f200415c6d0 0x7f200409aa70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000b820 tx=0x7f1ff000bce0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.708+0000 7f200aea5640 1 -- 172.21.15.79:0/3541078606 shutdown_connections 2024-04-25T02:08:08.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.708+0000 7f200aea5640 1 --2- 172.21.15.79:0/3541078606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fe806be30 0x7f1fe806e2f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.708+0000 7f200aea5640 1 --2- 172.21.15.79:0/3541078606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f200415cb50 0x7f200409afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.708+0000 7f200aea5640 1 --2- 172.21.15.79:0/3541078606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f200415c6d0 0x7f200409aa70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.708+0000 7f200aea5640 1 --2- 172.21.15.79:0/3541078606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ff40039b0 0x7f200409cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.708+0000 7f200aea5640 1 -- 172.21.15.79:0/3541078606 >> 172.21.15.79:0/3541078606 conn(0x7f20040d0070 msgr2=0x7f200406ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:08.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.708+0000 7f200aea5640 1 -- 172.21.15.79:0/3541078606 shutdown_connections 2024-04-25T02:08:08.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.708+0000 7f200aea5640 1 -- 172.21.15.79:0/3541078606 wait complete. 2024-04-25T02:08:08.726 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:08:08.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.818+0000 7ff3641ed640 1 Processor -- start 2024-04-25T02:08:08.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.819+0000 7ff3641ed640 1 -- start start 2024-04-25T02:08:08.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.819+0000 7ff3641ed640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff35c15e3b0 0x7ff35c0721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.819+0000 7ff3641ed640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff35c06c7d0 0x7ff35c0c9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.820+0000 7ff3641ed640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff35c15e790 con 0x7ff35c06fdd0 2024-04-25T02:08:08.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.820+0000 7ff3641ed640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff35c161e80 con 0x7ff35c15e3b0 2024-04-25T02:08:08.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.820+0000 7ff3641ed640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff35c1620d0 con 0x7ff35c06c7d0 2024-04-25T02:08:08.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.820+0000 7ff361f89640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff35c15e3b0 0x7ff35c0721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.820+0000 7ff36278a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff35c06c7d0 0x7ff35c0c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.820+0000 7ff361f89640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff35c15e3b0 0x7ff35c0721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:36578/0 (socket says 172.21.15.79:36578) 2024-04-25T02:08:08.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.820+0000 7ff361f89640 1 -- 172.21.15.79:0/2496713680 learned_addr learned my addr 172.21.15.79:0/2496713680 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:08.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.820+0000 7ff361f89640 1 -- 172.21.15.79:0/2496713680 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff35c06c7d0 msgr2=0x7ff35c0c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:08.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.820+0000 7ff361f89640 1 --2- 172.21.15.79:0/2496713680 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff35c06c7d0 0x7ff35c0c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.820+0000 7ff361f89640 1 -- 172.21.15.79:0/2496713680 >> v1:172.21.15.189:6789/0 conn(0x7ff35c06fdd0 legacy=0x7ff35c06c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.820+0000 7ff361f89640 1 -- 172.21.15.79:0/2496713680 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35c1623b0 con 0x7ff35c15e3b0 2024-04-25T02:08:08.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.820+0000 7ff36278a640 1 --2- 172.21.15.79:0/2496713680 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff35c06c7d0 0x7ff35c0c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:08.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.821+0000 7ff361f89640 1 --2- 172.21.15.79:0/2496713680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff35c15e3b0 0x7ff35c0721a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff358009e50 tx=0x7ff35802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b923ae34c67ce32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:08.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.821+0000 7ff360f87640 1 -- 172.21.15.79:0/2496713680 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff358036070 con 0x7ff35c15e3b0 2024-04-25T02:08:08.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.821+0000 7ff360f87640 1 -- 172.21.15.79:0/2496713680 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff358031600 con 0x7ff35c15e3b0 2024-04-25T02:08:08.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.821+0000 7ff360f87640 1 -- 172.21.15.79:0/2496713680 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3580319d0 con 0x7ff35c15e3b0 2024-04-25T02:08:08.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.821+0000 7ff3641ed640 1 -- 172.21.15.79:0/2496713680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff35c15e3b0 msgr2=0x7ff35c0721a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.821+0000 7ff3641ed640 1 --2- 172.21.15.79:0/2496713680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff35c15e3b0 0x7ff35c0721a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff358009e50 tx=0x7ff35802a5f0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.822+0000 7ff3641ed640 1 -- 172.21.15.79:0/2496713680 shutdown_connections 2024-04-25T02:08:08.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.822+0000 7ff3641ed640 1 --2- 172.21.15.79:0/2496713680 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff35c06c7d0 0x7ff35c0c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.822+0000 7ff3641ed640 1 --2- 172.21.15.79:0/2496713680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff35c15e3b0 0x7ff35c0721a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.822+0000 7ff3641ed640 1 -- 172.21.15.79:0/2496713680 >> 172.21.15.79:0/2496713680 conn(0x7ff35c0716b0 msgr2=0x7ff35c071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:08.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.822+0000 7ff3641ed640 1 -- 172.21.15.79:0/2496713680 shutdown_connections 2024-04-25T02:08:08.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.822+0000 7ff3641ed640 1 -- 172.21.15.79:0/2496713680 wait complete. 2024-04-25T02:08:08.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.823+0000 7ff3641ed640 1 Processor -- start 2024-04-25T02:08:08.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.823+0000 7ff3641ed640 1 -- start start 2024-04-25T02:08:08.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.823+0000 7ff3641ed640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff35c06c7d0 0x7ff35c152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.823+0000 7ff3641ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35c06fdd0 0x7ff35c14cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.823+0000 7ff3641ed640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff35c15e3b0 0x7ff35c14d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.823+0000 7ff3641ed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c0cf150 con 0x7ff35c06fdd0 2024-04-25T02:08:08.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.823+0000 7ff3641ed640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c162970 con 0x7ff35c06c7d0 2024-04-25T02:08:08.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.823+0000 7ff3641ed640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff35c0cf2d0 con 0x7ff35c15e3b0 2024-04-25T02:08:08.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff361788640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35c06fdd0 0x7ff35c14cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff361788640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35c06fdd0 0x7ff35c14cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35250/0 (socket says 172.21.15.79:35250) 2024-04-25T02:08:08.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff361788640 1 -- 172.21.15.79:0/105428277 learned_addr learned my addr 172.21.15.79:0/105428277 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:08.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff36278a640 1 --2- 172.21.15.79:0/105428277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff35c15e3b0 0x7ff35c14d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff361f89640 1 --2- 172.21.15.79:0/105428277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff35c06c7d0 0x7ff35c152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff361788640 1 -- 172.21.15.79:0/105428277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff35c15e3b0 msgr2=0x7ff35c14d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff361788640 1 --2- 172.21.15.79:0/105428277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff35c15e3b0 0x7ff35c14d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff361788640 1 -- 172.21.15.79:0/105428277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff35c06c7d0 msgr2=0x7ff35c152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:08.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff361788640 1 --2- 172.21.15.79:0/105428277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff35c06c7d0 0x7ff35c152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:08.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff361788640 1 -- 172.21.15.79:0/105428277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35c1608d0 con 0x7ff35c06fdd0 2024-04-25T02:08:08.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff361788640 1 --2- 172.21.15.79:0/105428277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35c06fdd0 0x7ff35c14cd10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00c400 tx=0x7ff34c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:08.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff3527fc640 1 -- 172.21.15.79:0/105428277 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c0052d0 con 0x7ff35c06fdd0 2024-04-25T02:08:08.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff3527fc640 1 -- 172.21.15.79:0/105428277 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34c005490 con 0x7ff35c06fdd0 2024-04-25T02:08:08.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff3641ed640 1 -- 172.21.15.79:0/105428277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff35c160bb0 con 0x7ff35c06fdd0 2024-04-25T02:08:08.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff3527fc640 1 -- 172.21.15.79:0/105428277 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c007260 con 0x7ff35c06fdd0 2024-04-25T02:08:08.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.824+0000 7ff3641ed640 1 -- 172.21.15.79:0/105428277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff35c161170 con 0x7ff35c06fdd0 2024-04-25T02:08:08.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.825+0000 7ff3641ed640 1 -- 172.21.15.79:0/105428277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff35c0690a0 con 0x7ff35c06fdd0 2024-04-25T02:08:08.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.826+0000 7ff3527fc640 1 -- 172.21.15.79:0/105428277 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff34c007400 con 0x7ff35c06fdd0 2024-04-25T02:08:08.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.826+0000 7ff3527fc640 1 --2- 172.21.15.79:0/105428277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff34006be30 0x7ff34006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:08.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.826+0000 7ff361f89640 1 --2- 172.21.15.79:0/105428277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff34006be30 0x7ff34006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:08.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.826+0000 7ff3527fc640 1 -- 172.21.15.79:0/105428277 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff34c08a2c0 con 0x7ff35c06fdd0 2024-04-25T02:08:08.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.827+0000 7ff361f89640 1 --2- 172.21.15.79:0/105428277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff34006be30 0x7ff34006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff358033000 tx=0x7ff358009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:08.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:08.831+0000 7ff3527fc640 1 -- 172.21.15.79:0/105428277 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff34c0585a0 con 0x7ff35c06fdd0 2024-04-25T02:08:09.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.003+0000 7ff3641ed640 1 -- 172.21.15.79:0/105428277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff35c0c9c10 con 0x7ff35c06fdd0 2024-04-25T02:08:09.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.004+0000 7ff3527fc640 1 -- 172.21.15.79:0/105428277 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7ff34c05c8a0 con 0x7ff35c06fdd0 2024-04-25T02:08:09.011 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:08:09.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.006+0000 7ff3641ed640 1 -- 172.21.15.79:0/105428277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff34006be30 msgr2=0x7ff34006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.006+0000 7ff3641ed640 1 --2- 172.21.15.79:0/105428277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff34006be30 0x7ff34006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff358033000 tx=0x7ff358009000 comp rx=0 tx=0).stop 2024-04-25T02:08:09.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.006+0000 7ff3641ed640 1 -- 172.21.15.79:0/105428277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35c06fdd0 msgr2=0x7ff35c14cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.006+0000 7ff3641ed640 1 --2- 172.21.15.79:0/105428277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35c06fdd0 0x7ff35c14cd10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00c400 tx=0x7ff34c00c800 comp rx=0 tx=0).stop 2024-04-25T02:08:09.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.006+0000 7ff3641ed640 1 -- 172.21.15.79:0/105428277 shutdown_connections 2024-04-25T02:08:09.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.006+0000 7ff3641ed640 1 --2- 172.21.15.79:0/105428277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff34006be30 0x7ff34006e2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.006+0000 7ff3641ed640 1 --2- 172.21.15.79:0/105428277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff35c15e3b0 0x7ff35c14d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.006+0000 7ff3641ed640 1 --2- 172.21.15.79:0/105428277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35c06fdd0 0x7ff35c14cd10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.006+0000 7ff3641ed640 1 --2- 172.21.15.79:0/105428277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff35c06c7d0 0x7ff35c152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.006+0000 7ff3641ed640 1 -- 172.21.15.79:0/105428277 >> 172.21.15.79:0/105428277 conn(0x7ff35c0716b0 msgr2=0x7ff35c15d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:09.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.006+0000 7ff3641ed640 1 -- 172.21.15.79:0/105428277 shutdown_connections 2024-04-25T02:08:09.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.006+0000 7ff3641ed640 1 -- 172.21.15.79:0/105428277 wait complete. 2024-04-25T02:08:09.024 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:08:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.116+0000 7ff371b7e640 1 Processor -- start 2024-04-25T02:08:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.116+0000 7ff371b7e640 1 -- start start 2024-04-25T02:08:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.117+0000 7ff371b7e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff36c06fe20 0x7ff36c15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.117+0000 7ff371b7e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff36c06dc90 0x7ff36c0ae370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.117+0000 7ff371b7e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff36c15ed80 con 0x7ff36c0b0320 2024-04-25T02:08:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.117+0000 7ff371b7e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff36c15f060 con 0x7ff36c06dc90 2024-04-25T02:08:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.117+0000 7ff371b7e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff36c15f340 con 0x7ff36c06fe20 2024-04-25T02:08:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.117+0000 7ff36bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff36c06dc90 0x7ff36c0ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.117+0000 7ff36bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff36c06dc90 0x7ff36c0ae370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35252/0 (socket says 172.21.15.79:35252) 2024-04-25T02:08:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.117+0000 7ff36bfff640 1 -- 172.21.15.79:0/1831886249 learned_addr learned my addr 172.21.15.79:0/1831886249 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.117+0000 7ff36b7fe640 1 --2- 172.21.15.79:0/1831886249 >> v2:172.21.15.189:3300/0 conn(0x7ff36c06fe20 0x7ff36c15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.117+0000 7ff36bfff640 1 -- 172.21.15.79:0/1831886249 >> v2:172.21.15.189:3300/0 conn(0x7ff36c06fe20 msgr2=0x7ff36c15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.117+0000 7ff36bfff640 1 --2- 172.21.15.79:0/1831886249 >> v2:172.21.15.189:3300/0 conn(0x7ff36c06fe20 0x7ff36c15e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.117+0000 7ff36bfff640 1 -- 172.21.15.79:0/1831886249 >> v1:172.21.15.189:6789/0 conn(0x7ff36c0b0320 legacy=0x7ff36c070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.117+0000 7ff36bfff640 1 -- 172.21.15.79:0/1831886249 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36c0ade50 con 0x7ff36c06dc90 2024-04-25T02:08:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.118+0000 7ff36bfff640 1 --2- 172.21.15.79:0/1831886249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff36c06dc90 0x7ff36c0ae370 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff36c09f0c0 tx=0x7ff36402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91e69cdf2f50fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.118+0000 7ff36a7fc640 1 -- 172.21.15.79:0/1831886249 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364036070 con 0x7ff36c06dc90 2024-04-25T02:08:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.118+0000 7ff36a7fc640 1 -- 172.21.15.79:0/1831886249 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff364031600 con 0x7ff36c06dc90 2024-04-25T02:08:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.118+0000 7ff36a7fc640 1 -- 172.21.15.79:0/1831886249 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3640319d0 con 0x7ff36c06dc90 2024-04-25T02:08:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.119+0000 7ff371b7e640 1 -- 172.21.15.79:0/1831886249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff36c06dc90 msgr2=0x7ff36c0ae370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.119+0000 7ff371b7e640 1 --2- 172.21.15.79:0/1831886249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff36c06dc90 0x7ff36c0ae370 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff36c09f0c0 tx=0x7ff36402a6f0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.119+0000 7ff371b7e640 1 -- 172.21.15.79:0/1831886249 shutdown_connections 2024-04-25T02:08:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.119+0000 7ff371b7e640 1 --2- 172.21.15.79:0/1831886249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff36c06dc90 0x7ff36c0ae370 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.119+0000 7ff371b7e640 1 --2- 172.21.15.79:0/1831886249 >> v2:172.21.15.189:3300/0 conn(0x7ff36c06fe20 0x7ff36c15e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.119+0000 7ff371b7e640 1 -- 172.21.15.79:0/1831886249 >> 172.21.15.79:0/1831886249 conn(0x7ff36c0d0e00 msgr2=0x7ff36c0d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.119+0000 7ff371b7e640 1 -- 172.21.15.79:0/1831886249 shutdown_connections 2024-04-25T02:08:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.119+0000 7ff371b7e640 1 -- 172.21.15.79:0/1831886249 wait complete. 2024-04-25T02:08:09.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.120+0000 7ff371b7e640 1 Processor -- start 2024-04-25T02:08:09.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.120+0000 7ff371b7e640 1 -- start start 2024-04-25T02:08:09.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff371b7e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff36c06dc90 0x7ff36c146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff371b7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff36c06fe20 0x7ff36c14a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff371b7e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff36c0b0320 0x7ff36c0b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff371b7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c0d1b50 con 0x7ff36c06fe20 2024-04-25T02:08:09.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff371b7e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c0d19d0 con 0x7ff36c0b0320 2024-04-25T02:08:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff371b7e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff36c15bf80 con 0x7ff36c06dc90 2024-04-25T02:08:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff36affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff36c06fe20 0x7ff36c14a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff36affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff36c06fe20 0x7ff36c14a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35268/0 (socket says 172.21.15.79:35268) 2024-04-25T02:08:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff36affd640 1 -- 172.21.15.79:0/4056779634 learned_addr learned my addr 172.21.15.79:0/4056779634 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff36b7fe640 1 --2- 172.21.15.79:0/4056779634 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff36c06dc90 0x7ff36c146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff36bfff640 1 --2- 172.21.15.79:0/4056779634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff36c0b0320 0x7ff36c0b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff36affd640 1 -- 172.21.15.79:0/4056779634 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff36c06dc90 msgr2=0x7ff36c146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff36affd640 1 --2- 172.21.15.79:0/4056779634 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff36c06dc90 0x7ff36c146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff36affd640 1 -- 172.21.15.79:0/4056779634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff36c0b0320 msgr2=0x7ff36c0b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff36affd640 1 --2- 172.21.15.79:0/4056779634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff36c0b0320 0x7ff36c0b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff36affd640 1 -- 172.21.15.79:0/4056779634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36c157400 con 0x7ff36c06fe20 2024-04-25T02:08:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff36bfff640 1 --2- 172.21.15.79:0/4056779634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff36c0b0320 0x7ff36c0b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff36affd640 1 --2- 172.21.15.79:0/4056779634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff36c06fe20 0x7ff36c14a4f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff36000c410 tx=0x7ff36000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff353fff640 1 -- 172.21.15.79:0/4056779634 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360017070 con 0x7ff36c06fe20 2024-04-25T02:08:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff353fff640 1 -- 172.21.15.79:0/4056779634 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3600035f0 con 0x7ff36c06fe20 2024-04-25T02:08:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff371b7e640 1 -- 172.21.15.79:0/4056779634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff36c1576e0 con 0x7ff36c06fe20 2024-04-25T02:08:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.121+0000 7ff353fff640 1 -- 172.21.15.79:0/4056779634 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360003a20 con 0x7ff36c06fe20 2024-04-25T02:08:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.122+0000 7ff371b7e640 1 -- 172.21.15.79:0/4056779634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff36c0cd4f0 con 0x7ff36c06fe20 2024-04-25T02:08:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.122+0000 7ff371b7e640 1 -- 172.21.15.79:0/4056779634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff36c0744d0 con 0x7ff36c06fe20 2024-04-25T02:08:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.123+0000 7ff353fff640 1 -- 172.21.15.79:0/4056779634 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff36001a070 con 0x7ff36c06fe20 2024-04-25T02:08:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.123+0000 7ff353fff640 1 --2- 172.21.15.79:0/4056779634 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff35806be30 0x7ff35806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.123+0000 7ff36b7fe640 1 --2- 172.21.15.79:0/4056779634 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff35806be30 0x7ff35806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.124+0000 7ff353fff640 1 -- 172.21.15.79:0/4056779634 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff36008a2c0 con 0x7ff36c06fe20 2024-04-25T02:08:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.124+0000 7ff36b7fe640 1 --2- 172.21.15.79:0/4056779634 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff35806be30 0x7ff35806e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00aa20 tx=0x7ff35c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:09.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.128+0000 7ff353fff640 1 -- 172.21.15.79:0/4056779634 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff36c0744d0 con 0x7ff36c06fe20 2024-04-25T02:08:09.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.303+0000 7ff371b7e640 1 -- 172.21.15.79:0/4056779634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff36c0690a0 con 0x7ff36c06fe20 2024-04-25T02:08:09.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.304+0000 7ff353fff640 1 -- 172.21.15.79:0/4056779634 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7ff3600010c0 con 0x7ff36c06fe20 2024-04-25T02:08:09.311 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:08:09.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.306+0000 7ff371b7e640 1 -- 172.21.15.79:0/4056779634 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff35806be30 msgr2=0x7ff35806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.306+0000 7ff371b7e640 1 --2- 172.21.15.79:0/4056779634 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff35806be30 0x7ff35806e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00aa20 tx=0x7ff35c008040 comp rx=0 tx=0).stop 2024-04-25T02:08:09.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.306+0000 7ff371b7e640 1 -- 172.21.15.79:0/4056779634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff36c06fe20 msgr2=0x7ff36c14a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.306+0000 7ff371b7e640 1 --2- 172.21.15.79:0/4056779634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff36c06fe20 0x7ff36c14a4f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff36000c410 tx=0x7ff36000c8d0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.306+0000 7ff371b7e640 1 -- 172.21.15.79:0/4056779634 shutdown_connections 2024-04-25T02:08:09.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.306+0000 7ff371b7e640 1 --2- 172.21.15.79:0/4056779634 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff35806be30 0x7ff35806e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.306+0000 7ff371b7e640 1 --2- 172.21.15.79:0/4056779634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff36c0b0320 0x7ff36c0b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.306+0000 7ff371b7e640 1 --2- 172.21.15.79:0/4056779634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff36c06fe20 0x7ff36c14a4f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.306+0000 7ff371b7e640 1 --2- 172.21.15.79:0/4056779634 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff36c06dc90 0x7ff36c146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.306+0000 7ff371b7e640 1 -- 172.21.15.79:0/4056779634 >> 172.21.15.79:0/4056779634 conn(0x7ff36c0d0e00 msgr2=0x7ff36c0b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:09.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.306+0000 7ff371b7e640 1 -- 172.21.15.79:0/4056779634 shutdown_connections 2024-04-25T02:08:09.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.306+0000 7ff371b7e640 1 -- 172.21.15.79:0/4056779634 wait complete. 2024-04-25T02:08:09.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:08:09.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.412+0000 7f602f264640 1 Processor -- start 2024-04-25T02:08:09.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.412+0000 7f602f264640 1 -- start start 2024-04-25T02:08:09.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.413+0000 7f602f264640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6028144cb0 0x7f60280b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.413+0000 7f602f264640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60280b5580 0x7f602806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.413+0000 7f602f264640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6028070d90 con 0x7f602806e490 2024-04-25T02:08:09.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.413+0000 7f602f264640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f602806e900 con 0x7f6028144cb0 2024-04-25T02:08:09.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.413+0000 7f602f264640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f60280cf130 con 0x7f60280b5580 2024-04-25T02:08:09.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.414+0000 7f6027fff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60280b5580 0x7f602806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.414+0000 7f602d000640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6028144cb0 0x7f60280b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.414+0000 7f6027fff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60280b5580 0x7f602806df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49784/0 (socket says 172.21.15.79:49784) 2024-04-25T02:08:09.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.414+0000 7f6027fff640 1 -- 172.21.15.79:0/3026367476 learned_addr learned my addr 172.21.15.79:0/3026367476 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:09.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.414+0000 7f6027fff640 1 -- 172.21.15.79:0/3026367476 >> v2:172.21.15.189:3300/0 conn(0x7f6028144cb0 msgr2=0x7f60280b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:09.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.414+0000 7f6027fff640 1 --2- 172.21.15.79:0/3026367476 >> v2:172.21.15.189:3300/0 conn(0x7f6028144cb0 0x7f60280b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.414+0000 7f6027fff640 1 -- 172.21.15.79:0/3026367476 >> v1:172.21.15.189:6789/0 conn(0x7f602806e490 legacy=0x7f602815fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.414+0000 7f6027fff640 1 -- 172.21.15.79:0/3026367476 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60280cf410 con 0x7f60280b5580 2024-04-25T02:08:09.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.415+0000 7f6027fff640 1 --2- 172.21.15.79:0/3026367476 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60280b5580 0x7f602806df50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6018009870 tx=0x7f601802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dd897609613dc50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:09.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.415+0000 7f60277fe640 1 -- 172.21.15.79:0/3026367476 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018037070 con 0x7f60280b5580 2024-04-25T02:08:09.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.415+0000 7f60277fe640 1 -- 172.21.15.79:0/3026367476 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6018032440 con 0x7f60280b5580 2024-04-25T02:08:09.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.415+0000 7f60277fe640 1 -- 172.21.15.79:0/3026367476 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018032810 con 0x7f60280b5580 2024-04-25T02:08:09.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.416+0000 7f602f264640 1 -- 172.21.15.79:0/3026367476 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60280b5580 msgr2=0x7f602806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.416+0000 7f602f264640 1 --2- 172.21.15.79:0/3026367476 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60280b5580 0x7f602806df50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6018009870 tx=0x7f601802a130 comp rx=0 tx=0).stop 2024-04-25T02:08:09.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.416+0000 7f602f264640 1 -- 172.21.15.79:0/3026367476 shutdown_connections 2024-04-25T02:08:09.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.416+0000 7f602f264640 1 --2- 172.21.15.79:0/3026367476 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60280b5580 0x7f602806df50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.416+0000 7f602f264640 1 --2- 172.21.15.79:0/3026367476 >> v2:172.21.15.189:3300/0 conn(0x7f6028144cb0 0x7f60280b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.416+0000 7f602f264640 1 -- 172.21.15.79:0/3026367476 >> 172.21.15.79:0/3026367476 conn(0x7f60280cfc80 msgr2=0x7f60280d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:09.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.416+0000 7f602f264640 1 -- 172.21.15.79:0/3026367476 shutdown_connections 2024-04-25T02:08:09.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.416+0000 7f602f264640 1 -- 172.21.15.79:0/3026367476 wait complete. 2024-04-25T02:08:09.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.417+0000 7f602f264640 1 Processor -- start 2024-04-25T02:08:09.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.417+0000 7f602f264640 1 -- start start 2024-04-25T02:08:09.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f602f264640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f602806e490 0x7f60281544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f602f264640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60280b5580 0x7f602815e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f602f264640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6028144cb0 0x7f602815d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f602f264640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6028145090 con 0x7f60280b5580 2024-04-25T02:08:09.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f602f264640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f60280cf9d0 con 0x7f6028144cb0 2024-04-25T02:08:09.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f602f264640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6028145ab0 con 0x7f602806e490 2024-04-25T02:08:09.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f6027fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60280b5580 0x7f602815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f6027fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60280b5580 0x7f602815e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35280/0 (socket says 172.21.15.79:35280) 2024-04-25T02:08:09.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f6027fff640 1 -- 172.21.15.79:0/3257160440 learned_addr learned my addr 172.21.15.79:0/3257160440 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:09.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f602d000640 1 --2- 172.21.15.79:0/3257160440 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f602806e490 0x7f60281544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f602d801640 1 --2- 172.21.15.79:0/3257160440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6028144cb0 0x7f602815d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f6027fff640 1 -- 172.21.15.79:0/3257160440 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f602806e490 msgr2=0x7f60281544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f6027fff640 1 --2- 172.21.15.79:0/3257160440 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f602806e490 0x7f60281544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f6027fff640 1 -- 172.21.15.79:0/3257160440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6028144cb0 msgr2=0x7f602815d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f6027fff640 1 --2- 172.21.15.79:0/3257160440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6028144cb0 0x7f602815d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f6027fff640 1 -- 172.21.15.79:0/3257160440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6028155880 con 0x7f60280b5580 2024-04-25T02:08:09.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.418+0000 7f602d801640 1 --2- 172.21.15.79:0/3257160440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6028144cb0 0x7f602815d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:09.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.419+0000 7f6027fff640 1 --2- 172.21.15.79:0/3257160440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60280b5580 0x7f602815e750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6018000c00 tx=0x7f60180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:09.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.419+0000 7f60257fa640 1 -- 172.21.15.79:0/3257160440 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018041020 con 0x7f60280b5580 2024-04-25T02:08:09.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.419+0000 7f60257fa640 1 -- 172.21.15.79:0/3257160440 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6018030640 con 0x7f60280b5580 2024-04-25T02:08:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.419+0000 7f602f264640 1 -- 172.21.15.79:0/3257160440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6028157ca0 con 0x7f60280b5580 2024-04-25T02:08:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.419+0000 7f60257fa640 1 -- 172.21.15.79:0/3257160440 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018037040 con 0x7f60280b5580 2024-04-25T02:08:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.419+0000 7f602f264640 1 -- 172.21.15.79:0/3257160440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6028158260 con 0x7f60280b5580 2024-04-25T02:08:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.420+0000 7f602f264640 1 -- 172.21.15.79:0/3257160440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60280690a0 con 0x7f60280b5580 2024-04-25T02:08:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.420+0000 7f60257fa640 1 -- 172.21.15.79:0/3257160440 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6018044020 con 0x7f60280b5580 2024-04-25T02:08:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.421+0000 7f60257fa640 1 --2- 172.21.15.79:0/3257160440 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f601406be30 0x7f601406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.421+0000 7f60257fa640 1 -- 172.21.15.79:0/3257160440 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f60180ab5a0 con 0x7f60280b5580 2024-04-25T02:08:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.421+0000 7f602d000640 1 --2- 172.21.15.79:0/3257160440 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f601406be30 0x7f601406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.421+0000 7f602d000640 1 --2- 172.21.15.79:0/3257160440 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f601406be30 0x7f601406e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f601c009b40 tx=0x7f601c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:09.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.425+0000 7f60257fa640 1 -- 172.21.15.79:0/3257160440 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f601804b030 con 0x7f60280b5580 2024-04-25T02:08:09.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.635+0000 7f602f264640 1 -- 172.21.15.79:0/3257160440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60280cde20 con 0x7f60280b5580 2024-04-25T02:08:09.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.635+0000 7f60257fa640 1 -- 172.21.15.79:0/3257160440 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7f6018079f60 con 0x7f60280b5580 2024-04-25T02:08:09.642 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:09.643 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/465663373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":465663373},{"type":"v1","addr":"172.21.15.189:6833","nonce":465663373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2093278785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2093278785},{"type":"v1","addr":"172.21.15.79:6836","nonce":2093278785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2415912880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2415912880},{"type":"v1","addr":"172.21.15.189:6835","nonce":2415912880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:07:59.452096+0000","modified":"2024-04-25T02:08:01.458029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2942986974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2942986974},{"type":"v1","addr":"172.21.15.79:6837","nonce":2942986974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-25T02:08:09.643 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2024-04-25T02:08:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.637+0000 7f602f264640 1 -- 172.21.15.79:0/3257160440 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f601406be30 msgr2=0x7f601406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.637+0000 7f602f264640 1 --2- 172.21.15.79:0/3257160440 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f601406be30 0x7f601406e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f601c009b40 tx=0x7f601c009190 comp rx=0 tx=0).stop 2024-04-25T02:08:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.637+0000 7f602f264640 1 -- 172.21.15.79:0/3257160440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60280b5580 msgr2=0x7f602815e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.637+0000 7f602f264640 1 --2- 172.21.15.79:0/3257160440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60280b5580 0x7f602815e750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6018000c00 tx=0x7f60180046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.637+0000 7f602f264640 1 -- 172.21.15.79:0/3257160440 shutdown_connections 2024-04-25T02:08:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.637+0000 7f602f264640 1 --2- 172.21.15.79:0/3257160440 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f601406be30 0x7f601406e2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.637+0000 7f602f264640 1 --2- 172.21.15.79:0/3257160440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6028144cb0 0x7f602815d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.637+0000 7f602f264640 1 --2- 172.21.15.79:0/3257160440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60280b5580 0x7f602815e750 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.637+0000 7f602f264640 1 --2- 172.21.15.79:0/3257160440 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f602806e490 0x7f60281544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.637+0000 7f602f264640 1 -- 172.21.15.79:0/3257160440 >> 172.21.15.79:0/3257160440 conn(0x7f60280cfc80 msgr2=0x7f6028141000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.637+0000 7f602f264640 1 -- 172.21.15.79:0/3257160440 shutdown_connections 2024-04-25T02:08:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.637+0000 7f602f264640 1 -- 172.21.15.79:0/3257160440 wait complete. 2024-04-25T02:08:09.655 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:09.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.745+0000 7f7e7b2fc640 1 Processor -- start 2024-04-25T02:08:09.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.745+0000 7f7e7b2fc640 1 -- start start 2024-04-25T02:08:09.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.746+0000 7f7e7b2fc640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7e7415e140 0x7f7e74066ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.746+0000 7f7e7b2fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e7415e520 0x7f7e740af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.746+0000 7f7e7b2fc640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e740cea70 con 0x7f7e7406b0b0 2024-04-25T02:08:09.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.746+0000 7f7e7b2fc640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7e74067480 con 0x7f7e7415e520 2024-04-25T02:08:09.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.746+0000 7f7e7b2fc640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f7e740cf3a0 con 0x7f7e7415e140 2024-04-25T02:08:09.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.746+0000 7f7e78897640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e7415e520 0x7f7e740af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.746+0000 7f7e78897640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e7415e520 0x7f7e740af8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35286/0 (socket says 172.21.15.79:35286) 2024-04-25T02:08:09.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.746+0000 7f7e78897640 1 -- 172.21.15.79:0/1774327047 learned_addr learned my addr 172.21.15.79:0/1774327047 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:09.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.746+0000 7f7e79098640 1 --2- 172.21.15.79:0/1774327047 >> v2:172.21.15.189:3300/0 conn(0x7f7e7415e140 0x7f7e74066ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.746+0000 7f7e78897640 1 -- 172.21.15.79:0/1774327047 >> v2:172.21.15.189:3300/0 conn(0x7f7e7415e140 msgr2=0x7f7e74066ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:09.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.746+0000 7f7e78897640 1 --2- 172.21.15.79:0/1774327047 >> v2:172.21.15.189:3300/0 conn(0x7f7e7415e140 0x7f7e74066ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.746+0000 7f7e78897640 1 -- 172.21.15.79:0/1774327047 >> v1:172.21.15.189:6789/0 conn(0x7f7e7406b0b0 legacy=0x7f7e740c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:09.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.746+0000 7f7e78897640 1 -- 172.21.15.79:0/1774327047 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e740ced50 con 0x7f7e7415e520 2024-04-25T02:08:09.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.746+0000 7f7e79098640 1 --2- 172.21.15.79:0/1774327047 >> v2:172.21.15.189:3300/0 conn(0x7f7e7415e140 0x7f7e74066ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:09.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.747+0000 7f7e78897640 1 --2- 172.21.15.79:0/1774327047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e7415e520 0x7f7e740af8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e7406d180 tx=0x7f7e7002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629bb4372e3bea4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:09.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.747+0000 7f7e6bfff640 1 -- 172.21.15.79:0/1774327047 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70037070 con 0x7f7e7415e520 2024-04-25T02:08:09.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.747+0000 7f7e6bfff640 1 -- 172.21.15.79:0/1774327047 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e70032440 con 0x7f7e7415e520 2024-04-25T02:08:09.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.747+0000 7f7e6bfff640 1 -- 172.21.15.79:0/1774327047 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70032810 con 0x7f7e7415e520 2024-04-25T02:08:09.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.747+0000 7f7e7b2fc640 1 -- 172.21.15.79:0/1774327047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e7415e520 msgr2=0x7f7e740af8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.747+0000 7f7e7b2fc640 1 --2- 172.21.15.79:0/1774327047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e7415e520 0x7f7e740af8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e7406d180 tx=0x7f7e7002a1a0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.747+0000 7f7e7b2fc640 1 -- 172.21.15.79:0/1774327047 shutdown_connections 2024-04-25T02:08:09.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.747+0000 7f7e7b2fc640 1 --2- 172.21.15.79:0/1774327047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e7415e520 0x7f7e740af8f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.747+0000 7f7e7b2fc640 1 --2- 172.21.15.79:0/1774327047 >> v2:172.21.15.189:3300/0 conn(0x7f7e7415e140 0x7f7e74066ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.747+0000 7f7e7b2fc640 1 -- 172.21.15.79:0/1774327047 >> 172.21.15.79:0/1774327047 conn(0x7f7e740ccee0 msgr2=0x7f7e740cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:09.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.747+0000 7f7e7b2fc640 1 -- 172.21.15.79:0/1774327047 shutdown_connections 2024-04-25T02:08:09.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.747+0000 7f7e7b2fc640 1 -- 172.21.15.79:0/1774327047 wait complete. 2024-04-25T02:08:09.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.748+0000 7f7e7b2fc640 1 Processor -- start 2024-04-25T02:08:09.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.749+0000 7f7e7b2fc640 1 -- start start 2024-04-25T02:08:09.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.749+0000 7f7e7b2fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e7406b0b0 0x7f7e7414f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.749+0000 7f7e7b2fc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e7415e140 0x7f7e741f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.749+0000 7f7e7b2fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e7415e520 0x7f7e7414e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.749+0000 7f7e7b2fc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e740c9ec0 con 0x7f7e7415e520 2024-04-25T02:08:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.749+0000 7f7e7b2fc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7e740afe30 con 0x7f7e7406b0b0 2024-04-25T02:08:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.749+0000 7f7e7b2fc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7e740ca040 con 0x7f7e7415e140 2024-04-25T02:08:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.749+0000 7f7e79899640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e7415e520 0x7f7e7414e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.749+0000 7f7e79899640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e7415e520 0x7f7e7414e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35300/0 (socket says 172.21.15.79:35300) 2024-04-25T02:08:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.749+0000 7f7e79899640 1 -- 172.21.15.79:0/1061211122 learned_addr learned my addr 172.21.15.79:0/1061211122 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.750+0000 7f7e79899640 1 -- 172.21.15.79:0/1061211122 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e7415e140 msgr2=0x7f7e741f7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.750+0000 7f7e79899640 1 --2- 172.21.15.79:0/1061211122 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e7415e140 0x7f7e741f7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.750+0000 7f7e79899640 1 -- 172.21.15.79:0/1061211122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e7406b0b0 msgr2=0x7f7e7414f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.750+0000 7f7e79899640 1 --2- 172.21.15.79:0/1061211122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e7406b0b0 0x7f7e7414f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.750+0000 7f7e79899640 1 -- 172.21.15.79:0/1061211122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7415cbf0 con 0x7f7e7415e520 2024-04-25T02:08:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.750+0000 7f7e79899640 1 --2- 172.21.15.79:0/1061211122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e7415e520 0x7f7e7414e8a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00c780 tx=0x7f7e6c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.750+0000 7f7e69ffb640 1 -- 172.21.15.79:0/1061211122 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c004b60 con 0x7f7e7415e520 2024-04-25T02:08:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.750+0000 7f7e69ffb640 1 -- 172.21.15.79:0/1061211122 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6c004d00 con 0x7f7e7415e520 2024-04-25T02:08:09.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.750+0000 7f7e69ffb640 1 -- 172.21.15.79:0/1061211122 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00aa90 con 0x7f7e7415e520 2024-04-25T02:08:09.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.750+0000 7f7e7b2fc640 1 -- 172.21.15.79:0/1061211122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7415ced0 con 0x7f7e7415e520 2024-04-25T02:08:09.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.750+0000 7f7e7b2fc640 1 -- 172.21.15.79:0/1061211122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e741f7930 con 0x7f7e7415e520 2024-04-25T02:08:09.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.751+0000 7f7e7b2fc640 1 -- 172.21.15.79:0/1061211122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e740690a0 con 0x7f7e7415e520 2024-04-25T02:08:09.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.751+0000 7f7e69ffb640 1 -- 172.21.15.79:0/1061211122 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e6c00ac30 con 0x7f7e7415e520 2024-04-25T02:08:09.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.752+0000 7f7e69ffb640 1 --2- 172.21.15.79:0/1061211122 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7e5806be30 0x7f7e5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.752+0000 7f7e79098640 1 --2- 172.21.15.79:0/1061211122 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7e5806be30 0x7f7e5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.752+0000 7f7e69ffb640 1 -- 172.21.15.79:0/1061211122 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7e6c08b1a0 con 0x7f7e7415e520 2024-04-25T02:08:09.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.752+0000 7f7e79098640 1 --2- 172.21.15.79:0/1061211122 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7e5806be30 0x7f7e5806e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e64006fd0 tx=0x7f7e64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:09.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.756+0000 7f7e69ffb640 1 -- 172.21.15.79:0/1061211122 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7e6c020070 con 0x7f7e7415e520 2024-04-25T02:08:09.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.932+0000 7f7e7b2fc640 1 -- 172.21.15.79:0/1061211122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e7406daa0 con 0x7f7e7415e520 2024-04-25T02:08:09.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.933+0000 7f7e69ffb640 1 -- 172.21.15.79:0/1061211122 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f7e6c059b50 con 0x7f7e7415e520 2024-04-25T02:08:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:09.940 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.935+0000 7f7e7b2fc640 1 -- 172.21.15.79:0/1061211122 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7e5806be30 msgr2=0x7f7e5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.935+0000 7f7e7b2fc640 1 --2- 172.21.15.79:0/1061211122 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7e5806be30 0x7f7e5806e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e64006fd0 tx=0x7f7e64008040 comp rx=0 tx=0).stop 2024-04-25T02:08:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.935+0000 7f7e7b2fc640 1 -- 172.21.15.79:0/1061211122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e7415e520 msgr2=0x7f7e7414e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.935+0000 7f7e7b2fc640 1 --2- 172.21.15.79:0/1061211122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e7415e520 0x7f7e7414e8a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00c780 tx=0x7f7e6c00cc40 comp rx=0 tx=0).stop 2024-04-25T02:08:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.935+0000 7f7e7b2fc640 1 -- 172.21.15.79:0/1061211122 shutdown_connections 2024-04-25T02:08:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.935+0000 7f7e7b2fc640 1 --2- 172.21.15.79:0/1061211122 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7e5806be30 0x7f7e5806e2f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.935+0000 7f7e7b2fc640 1 --2- 172.21.15.79:0/1061211122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e7415e520 0x7f7e7414e8a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.935+0000 7f7e7b2fc640 1 --2- 172.21.15.79:0/1061211122 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e7415e140 0x7f7e741f7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.935+0000 7f7e7b2fc640 1 --2- 172.21.15.79:0/1061211122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e7406b0b0 0x7f7e7414f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.935+0000 7f7e7b2fc640 1 -- 172.21.15.79:0/1061211122 >> 172.21.15.79:0/1061211122 conn(0x7f7e740ccee0 msgr2=0x7f7e740b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.935+0000 7f7e7b2fc640 1 -- 172.21.15.79:0/1061211122 shutdown_connections 2024-04-25T02:08:09.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:09.935+0000 7f7e7b2fc640 1 -- 172.21.15.79:0/1061211122 wait complete. 2024-04-25T02:08:09.952 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:57.115253+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:58.421392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:08:09.953 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:08:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.045+0000 7f01366a5640 1 Processor -- start 2024-04-25T02:08:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.045+0000 7f01366a5640 1 -- start start 2024-04-25T02:08:10.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.046+0000 7f01366a5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f01300cf200 0x7f01300cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.046+0000 7f01366a5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013006b2f0 0x7f013006b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.046+0000 7f01366a5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f013015f4c0 con 0x7f0130162a40 2024-04-25T02:08:10.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.046+0000 7f01366a5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f013006bca0 con 0x7f01300cf200 2024-04-25T02:08:10.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.046+0000 7f01366a5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0130161ff0 con 0x7f013006b2f0 2024-04-25T02:08:10.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.046+0000 7f012ffff640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f01300cf200 0x7f01300cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.046+0000 7f0134c42640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013006b2f0 0x7f013006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.047+0000 7f0134c42640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013006b2f0 0x7f013006b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49824/0 (socket says 172.21.15.79:49824) 2024-04-25T02:08:10.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.047+0000 7f012f7fe640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f0130162a40 0x7f013015ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:35002/0 (socket says 172.21.15.79:35002) 2024-04-25T02:08:10.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.047+0000 7f0134c42640 1 -- 172.21.15.79:0/1088960370 learned_addr learned my addr 172.21.15.79:0/1088960370 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:10.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.047+0000 7f012ffff640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f01300cf200 0x7f01300cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:36638/0 (socket says 172.21.15.79:36638) 2024-04-25T02:08:10.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.047+0000 7f0134c42640 1 -- 172.21.15.79:0/1088960370 >> v2:172.21.15.189:3300/0 conn(0x7f01300cf200 msgr2=0x7f01300cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:10.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.047+0000 7f0134c42640 1 --2- 172.21.15.79:0/1088960370 >> v2:172.21.15.189:3300/0 conn(0x7f01300cf200 0x7f01300cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.047+0000 7f0134c42640 1 -- 172.21.15.79:0/1088960370 >> v1:172.21.15.189:6789/0 conn(0x7f0130162a40 legacy=0x7f013015ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.047+0000 7f0134c42640 1 -- 172.21.15.79:0/1088960370 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013015f7a0 con 0x7f013006b2f0 2024-04-25T02:08:10.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.048+0000 7f0134c42640 1 --2- 172.21.15.79:0/1088960370 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013006b2f0 0x7f013006b760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0128009e50 tx=0x7f012802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72f652d8479a7a40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:10.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.048+0000 7f012effd640 1 -- 172.21.15.79:0/1088960370 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128036070 con 0x7f013006b2f0 2024-04-25T02:08:10.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.048+0000 7f012effd640 1 -- 172.21.15.79:0/1088960370 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0128031600 con 0x7f013006b2f0 2024-04-25T02:08:10.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.048+0000 7f012effd640 1 -- 172.21.15.79:0/1088960370 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01280319d0 con 0x7f013006b2f0 2024-04-25T02:08:10.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.048+0000 7f01366a5640 1 -- 172.21.15.79:0/1088960370 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013006b2f0 msgr2=0x7f013006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.048+0000 7f01366a5640 1 --2- 172.21.15.79:0/1088960370 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013006b2f0 0x7f013006b760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0128009e50 tx=0x7f012802a710 comp rx=0 tx=0).stop 2024-04-25T02:08:10.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.048+0000 7f01366a5640 1 -- 172.21.15.79:0/1088960370 shutdown_connections 2024-04-25T02:08:10.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.048+0000 7f01366a5640 1 --2- 172.21.15.79:0/1088960370 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013006b2f0 0x7f013006b760 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.048+0000 7f01366a5640 1 --2- 172.21.15.79:0/1088960370 >> v2:172.21.15.189:3300/0 conn(0x7f01300cf200 0x7f01300cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.048+0000 7f01366a5640 1 -- 172.21.15.79:0/1088960370 >> 172.21.15.79:0/1088960370 conn(0x7f01300b1cd0 msgr2=0x7f01300b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:10.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.048+0000 7f01366a5640 1 -- 172.21.15.79:0/1088960370 shutdown_connections 2024-04-25T02:08:10.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.048+0000 7f01366a5640 1 -- 172.21.15.79:0/1088960370 wait complete. 2024-04-25T02:08:10.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.049+0000 7f01366a5640 1 Processor -- start 2024-04-25T02:08:10.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.050+0000 7f01366a5640 1 -- start start 2024-04-25T02:08:10.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.050+0000 7f01366a5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f013006b2f0 0x7f01300ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.050+0000 7f01366a5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01300cf200 0x7f01301f8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.050+0000 7f01366a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0130162a40 0x7f0130151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.050+0000 7f01366a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f013015f110 con 0x7f0130162a40 2024-04-25T02:08:10.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.050+0000 7f01366a5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0130162520 con 0x7f013006b2f0 2024-04-25T02:08:10.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.050+0000 7f01366a5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f01300ad490 con 0x7f01300cf200 2024-04-25T02:08:10.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.050+0000 7f0134c42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0130162a40 0x7f0130151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.050+0000 7f0134c42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0130162a40 0x7f0130151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35316/0 (socket says 172.21.15.79:35316) 2024-04-25T02:08:10.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.050+0000 7f0134c42640 1 -- 172.21.15.79:0/2023434999 learned_addr learned my addr 172.21.15.79:0/2023434999 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:10.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.051+0000 7f012ffff640 1 --2- 172.21.15.79:0/2023434999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f013006b2f0 0x7f01300ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.051+0000 7f012f7fe640 1 --2- 172.21.15.79:0/2023434999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01300cf200 0x7f01301f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.051+0000 7f0134c42640 1 -- 172.21.15.79:0/2023434999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01300cf200 msgr2=0x7f01301f8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.051+0000 7f0134c42640 1 --2- 172.21.15.79:0/2023434999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01300cf200 0x7f01301f8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.051+0000 7f0134c42640 1 -- 172.21.15.79:0/2023434999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f013006b2f0 msgr2=0x7f01300ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.051+0000 7f0134c42640 1 --2- 172.21.15.79:0/2023434999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f013006b2f0 0x7f01300ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.051+0000 7f0134c42640 1 -- 172.21.15.79:0/2023434999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01300ad770 con 0x7f0130162a40 2024-04-25T02:08:10.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.051+0000 7f0134c42640 1 --2- 172.21.15.79:0/2023434999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0130162a40 0x7f0130151350 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0128009e50 tx=0x7f0128004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:10.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.051+0000 7f012cff9640 1 -- 172.21.15.79:0/2023434999 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128036050 con 0x7f0130162a40 2024-04-25T02:08:10.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.051+0000 7f012cff9640 1 -- 172.21.15.79:0/2023434999 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0128042070 con 0x7f0130162a40 2024-04-25T02:08:10.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.051+0000 7f01366a5640 1 -- 172.21.15.79:0/2023434999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01300ada50 con 0x7f0130162a40 2024-04-25T02:08:10.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.051+0000 7f012cff9640 1 -- 172.21.15.79:0/2023434999 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128009510 con 0x7f0130162a40 2024-04-25T02:08:10.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.051+0000 7f01366a5640 1 -- 172.21.15.79:0/2023434999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01300ae010 con 0x7f0130162a40 2024-04-25T02:08:10.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.052+0000 7f01366a5640 1 -- 172.21.15.79:0/2023434999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01300690a0 con 0x7f0130162a40 2024-04-25T02:08:10.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.053+0000 7f012cff9640 1 -- 172.21.15.79:0/2023434999 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0128007bf0 con 0x7f0130162a40 2024-04-25T02:08:10.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.053+0000 7f012cff9640 1 --2- 172.21.15.79:0/2023434999 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f011c06be60 0x7f011c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.053+0000 7f012cff9640 1 -- 172.21.15.79:0/2023434999 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f01280abc00 con 0x7f0130162a40 2024-04-25T02:08:10.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.053+0000 7f012ffff640 1 --2- 172.21.15.79:0/2023434999 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f011c06be60 0x7f011c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.053+0000 7f012ffff640 1 --2- 172.21.15.79:0/2023434999 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f011c06be60 0x7f011c06e320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0120009ad0 tx=0x7f0120008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:10.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.057+0000 7f012cff9640 1 -- 172.21.15.79:0/2023434999 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f01280b2080 con 0x7f0130162a40 2024-04-25T02:08:10.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.230+0000 7f01366a5640 1 -- 172.21.15.79:0/2023434999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f01300ce3c0 con 0x7f0130162a40 2024-04-25T02:08:10.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.231+0000 7f012cff9640 1 -- 172.21.15.79:0/2023434999 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f012807a5b0 con 0x7f0130162a40 2024-04-25T02:08:10.238 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:08:10.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.232+0000 7f01366a5640 1 -- 172.21.15.79:0/2023434999 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f011c06be60 msgr2=0x7f011c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.232+0000 7f01366a5640 1 --2- 172.21.15.79:0/2023434999 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f011c06be60 0x7f011c06e320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0120009ad0 tx=0x7f0120008040 comp rx=0 tx=0).stop 2024-04-25T02:08:10.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.232+0000 7f01366a5640 1 -- 172.21.15.79:0/2023434999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0130162a40 msgr2=0x7f0130151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.232+0000 7f01366a5640 1 --2- 172.21.15.79:0/2023434999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0130162a40 0x7f0130151350 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0128009e50 tx=0x7f0128004a40 comp rx=0 tx=0).stop 2024-04-25T02:08:10.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.233+0000 7f01366a5640 1 -- 172.21.15.79:0/2023434999 shutdown_connections 2024-04-25T02:08:10.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.233+0000 7f01366a5640 1 --2- 172.21.15.79:0/2023434999 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f011c06be60 0x7f011c06e320 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.233+0000 7f01366a5640 1 --2- 172.21.15.79:0/2023434999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0130162a40 0x7f0130151350 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.233+0000 7f01366a5640 1 --2- 172.21.15.79:0/2023434999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01300cf200 0x7f01301f8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.233+0000 7f01366a5640 1 --2- 172.21.15.79:0/2023434999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f013006b2f0 0x7f01300ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.233+0000 7f01366a5640 1 -- 172.21.15.79:0/2023434999 >> 172.21.15.79:0/2023434999 conn(0x7f01300b1cd0 msgr2=0x7f01300b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:10.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.233+0000 7f01366a5640 1 -- 172.21.15.79:0/2023434999 shutdown_connections 2024-04-25T02:08:10.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.233+0000 7f01366a5640 1 -- 172.21.15.79:0/2023434999 wait complete. 2024-04-25T02:08:10.250 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:08:10.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.343+0000 7ff45b49a640 1 Processor -- start 2024-04-25T02:08:10.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.343+0000 7ff45b49a640 1 -- start start 2024-04-25T02:08:10.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.344+0000 7ff45b49a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff45406fdd0 0x7ff45406c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.344+0000 7ff45b49a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff45406c600 0x7ff4540c9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.344+0000 7ff45b49a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45415e790 con 0x7ff45415e3b0 2024-04-25T02:08:10.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.344+0000 7ff45b49a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff4540728b0 con 0x7ff45406c600 2024-04-25T02:08:10.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.344+0000 7ff45b49a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff454161e80 con 0x7ff45406fdd0 2024-04-25T02:08:10.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.344+0000 7ff459a37640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff45406c600 0x7ff4540c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.344+0000 7ff459236640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff45415e3b0 0x7ff4540721a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47858/0 (socket says 172.21.15.79:47858) 2024-04-25T02:08:10.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.344+0000 7ff459236640 1 -- 172.21.15.79:0/4030518547 learned_addr learned my addr 172.21.15.79:0/4030518547 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:10.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.344+0000 7ff458a35640 1 --2- 172.21.15.79:0/4030518547 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff45406fdd0 0x7ff45406c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.344+0000 7ff459a37640 1 -- 172.21.15.79:0/4030518547 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff45406fdd0 msgr2=0x7ff45406c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:10.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.344+0000 7ff459a37640 1 --2- 172.21.15.79:0/4030518547 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff45406fdd0 0x7ff45406c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.344+0000 7ff459a37640 1 -- 172.21.15.79:0/4030518547 >> v1:172.21.15.79:6789/0 conn(0x7ff45415e3b0 legacy=0x7ff4540721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.344+0000 7ff44bfff640 1 -- 172.21.15.79:0/4030518547 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1843394216 0 0) 0x7ff45415e790 con 0x7ff45415e3b0 2024-04-25T02:08:10.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.344+0000 7ff459a37640 1 -- 172.21.15.79:0/4030518547 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4541620d0 con 0x7ff45406c600 2024-04-25T02:08:10.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.345+0000 7ff459a37640 1 --2- 172.21.15.79:0/4030518547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45406c600 0x7ff4540c9890 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0097a0 tx=0x7ff44c02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ae0347edfe9c08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:10.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.345+0000 7ff44bfff640 1 -- 172.21.15.79:0/4030518547 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c037070 con 0x7ff45406c600 2024-04-25T02:08:10.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.345+0000 7ff44bfff640 1 -- 172.21.15.79:0/4030518547 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c02adb0 con 0x7ff45406c600 2024-04-25T02:08:10.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.345+0000 7ff44bfff640 1 -- 172.21.15.79:0/4030518547 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c032660 con 0x7ff45406c600 2024-04-25T02:08:10.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.346+0000 7ff45b49a640 1 -- 172.21.15.79:0/4030518547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45406c600 msgr2=0x7ff4540c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.346+0000 7ff45b49a640 1 --2- 172.21.15.79:0/4030518547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45406c600 0x7ff4540c9890 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0097a0 tx=0x7ff44c02a060 comp rx=0 tx=0).stop 2024-04-25T02:08:10.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.346+0000 7ff45b49a640 1 -- 172.21.15.79:0/4030518547 shutdown_connections 2024-04-25T02:08:10.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.346+0000 7ff45b49a640 1 --2- 172.21.15.79:0/4030518547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45406c600 0x7ff4540c9890 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.346+0000 7ff45b49a640 1 --2- 172.21.15.79:0/4030518547 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff45406fdd0 0x7ff45406c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.346+0000 7ff45b49a640 1 -- 172.21.15.79:0/4030518547 >> 172.21.15.79:0/4030518547 conn(0x7ff4540716b0 msgr2=0x7ff454071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:10.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.346+0000 7ff45b49a640 1 -- 172.21.15.79:0/4030518547 shutdown_connections 2024-04-25T02:08:10.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.346+0000 7ff45b49a640 1 -- 172.21.15.79:0/4030518547 wait complete. 2024-04-25T02:08:10.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.347+0000 7ff45b49a640 1 Processor -- start 2024-04-25T02:08:10.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.347+0000 7ff45b49a640 1 -- start start 2024-04-25T02:08:10.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff45b49a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff45406c600 0x7ff45406b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff45b49a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45406fdd0 0x7ff454158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff45b49a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff45415e3b0 0x7ff45414fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff45b49a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff454162690 con 0x7ff45406fdd0 2024-04-25T02:08:10.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff45b49a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff45406ca30 con 0x7ff45415e3b0 2024-04-25T02:08:10.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff45b49a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff454162970 con 0x7ff45406c600 2024-04-25T02:08:10.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff458a35640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45406fdd0 0x7ff454158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff458a35640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45406fdd0 0x7ff454158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35328/0 (socket says 172.21.15.79:35328) 2024-04-25T02:08:10.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff458a35640 1 -- 172.21.15.79:0/15748850 learned_addr learned my addr 172.21.15.79:0/15748850 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:10.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff459236640 1 --2- 172.21.15.79:0/15748850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff45406c600 0x7ff45406b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff459a37640 1 --2- 172.21.15.79:0/15748850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff45415e3b0 0x7ff45414fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff458a35640 1 -- 172.21.15.79:0/15748850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff45406c600 msgr2=0x7ff45406b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff458a35640 1 --2- 172.21.15.79:0/15748850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff45406c600 0x7ff45406b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff458a35640 1 -- 172.21.15.79:0/15748850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff45415e3b0 msgr2=0x7ff45414fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff458a35640 1 --2- 172.21.15.79:0/15748850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff45415e3b0 0x7ff45414fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff458a35640 1 -- 172.21.15.79:0/15748850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff454155460 con 0x7ff45406fdd0 2024-04-25T02:08:10.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff459a37640 1 --2- 172.21.15.79:0/15748850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff45415e3b0 0x7ff45414fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:10.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff458a35640 1 --2- 172.21.15.79:0/15748850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45406fdd0 0x7ff454158eb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff44400d800 tx=0x7ff44400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:10.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff449ffb640 1 -- 172.21.15.79:0/15748850 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44400b660 con 0x7ff45406fdd0 2024-04-25T02:08:10.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff449ffb640 1 -- 172.21.15.79:0/15748850 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff444019070 con 0x7ff45406fdd0 2024-04-25T02:08:10.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff45b49a640 1 -- 172.21.15.79:0/15748850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff454159830 con 0x7ff45406fdd0 2024-04-25T02:08:10.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.348+0000 7ff449ffb640 1 -- 172.21.15.79:0/15748850 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44400ba20 con 0x7ff45406fdd0 2024-04-25T02:08:10.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.349+0000 7ff45b49a640 1 -- 172.21.15.79:0/15748850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff454159df0 con 0x7ff45406fdd0 2024-04-25T02:08:10.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.349+0000 7ff45b49a640 1 -- 172.21.15.79:0/15748850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4540690a0 con 0x7ff45406fdd0 2024-04-25T02:08:10.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.350+0000 7ff449ffb640 1 -- 172.21.15.79:0/15748850 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff44400bbc0 con 0x7ff45406fdd0 2024-04-25T02:08:10.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.350+0000 7ff449ffb640 1 --2- 172.21.15.79:0/15748850 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff43806be30 0x7ff43806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.350+0000 7ff449ffb640 1 -- 172.21.15.79:0/15748850 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff44408b1e0 con 0x7ff45406fdd0 2024-04-25T02:08:10.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.350+0000 7ff459236640 1 --2- 172.21.15.79:0/15748850 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff43806be30 0x7ff43806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.350+0000 7ff459236640 1 --2- 172.21.15.79:0/15748850 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff43806be30 0x7ff43806e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff4500012e0 tx=0x7ff450001630 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:10.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.354+0000 7ff449ffb640 1 -- 172.21.15.79:0/15748850 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff444059b90 con 0x7ff45406fdd0 2024-04-25T02:08:10.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.526+0000 7ff45b49a640 1 -- 172.21.15.79:0/15748850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff454153a60 con 0x7ff45406fdd0 2024-04-25T02:08:10.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.526+0000 7ff449ffb640 1 -- 172.21.15.79:0/15748850 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7ff444059490 con 0x7ff45406fdd0 2024-04-25T02:08:10.534 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:08:10.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.528+0000 7ff45b49a640 1 -- 172.21.15.79:0/15748850 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff43806be30 msgr2=0x7ff43806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.528+0000 7ff45b49a640 1 --2- 172.21.15.79:0/15748850 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff43806be30 0x7ff43806e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff4500012e0 tx=0x7ff450001630 comp rx=0 tx=0).stop 2024-04-25T02:08:10.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.528+0000 7ff45b49a640 1 -- 172.21.15.79:0/15748850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45406fdd0 msgr2=0x7ff454158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.528+0000 7ff45b49a640 1 --2- 172.21.15.79:0/15748850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45406fdd0 0x7ff454158eb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff44400d800 tx=0x7ff44400dcc0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.528+0000 7ff45b49a640 1 -- 172.21.15.79:0/15748850 shutdown_connections 2024-04-25T02:08:10.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.528+0000 7ff45b49a640 1 --2- 172.21.15.79:0/15748850 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff43806be30 0x7ff43806e2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.528+0000 7ff45b49a640 1 --2- 172.21.15.79:0/15748850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff45415e3b0 0x7ff45414fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.528+0000 7ff45b49a640 1 --2- 172.21.15.79:0/15748850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45406fdd0 0x7ff454158eb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.528+0000 7ff45b49a640 1 --2- 172.21.15.79:0/15748850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff45406c600 0x7ff45406b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.528+0000 7ff45b49a640 1 -- 172.21.15.79:0/15748850 >> 172.21.15.79:0/15748850 conn(0x7ff4540716b0 msgr2=0x7ff4540cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:10.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.528+0000 7ff45b49a640 1 -- 172.21.15.79:0/15748850 shutdown_connections 2024-04-25T02:08:10.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.528+0000 7ff45b49a640 1 -- 172.21.15.79:0/15748850 wait complete. 2024-04-25T02:08:10.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:08:10.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.638+0000 7efec9902640 1 Processor -- start 2024-04-25T02:08:10.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.638+0000 7efec9902640 1 -- start start 2024-04-25T02:08:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.639+0000 7efec9902640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec406fe20 0x7efec415e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.639+0000 7efec9902640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7efec406dc90 0x7efec40ae370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.639+0000 7efec9902640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec415ed80 con 0x7efec40b0320 2024-04-25T02:08:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.639+0000 7efec9902640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7efec415f060 con 0x7efec406dc90 2024-04-25T02:08:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.639+0000 7efec9902640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efec415f340 con 0x7efec406fe20 2024-04-25T02:08:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.639+0000 7efec37fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7efec406dc90 0x7efec40ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.639+0000 7efec2ffd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec406fe20 0x7efec415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.639+0000 7efec2ffd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec406fe20 0x7efec415e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:49862/0 (socket says 172.21.15.79:49862) 2024-04-25T02:08:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.639+0000 7efec37fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7efec406dc90 0x7efec40ae370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:36658/0 (socket says 172.21.15.79:36658) 2024-04-25T02:08:10.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.639+0000 7efec2ffd640 1 -- 172.21.15.79:0/2221692616 learned_addr learned my addr 172.21.15.79:0/2221692616 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:10.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.640+0000 7efec2ffd640 1 -- 172.21.15.79:0/2221692616 >> v2:172.21.15.189:3300/0 conn(0x7efec406dc90 msgr2=0x7efec40ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:10.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.640+0000 7efec2ffd640 1 --2- 172.21.15.79:0/2221692616 >> v2:172.21.15.189:3300/0 conn(0x7efec406dc90 0x7efec40ae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.640+0000 7efec2ffd640 1 -- 172.21.15.79:0/2221692616 >> v1:172.21.15.189:6789/0 conn(0x7efec40b0320 legacy=0x7efec4070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.640+0000 7efec2ffd640 1 -- 172.21.15.79:0/2221692616 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec40ade50 con 0x7efec406fe20 2024-04-25T02:08:10.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.640+0000 7efec2ffd640 1 --2- 172.21.15.79:0/2221692616 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec406fe20 0x7efec415e7a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009870 tx=0x7efeb402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f1c92405d1da35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:10.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.641+0000 7efec1ffb640 1 -- 172.21.15.79:0/2221692616 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb4037070 con 0x7efec406fe20 2024-04-25T02:08:10.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.641+0000 7efec1ffb640 1 -- 172.21.15.79:0/2221692616 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb4032440 con 0x7efec406fe20 2024-04-25T02:08:10.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.641+0000 7efec1ffb640 1 -- 172.21.15.79:0/2221692616 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb4032810 con 0x7efec406fe20 2024-04-25T02:08:10.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.641+0000 7efec9902640 1 -- 172.21.15.79:0/2221692616 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec406fe20 msgr2=0x7efec415e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.641+0000 7efec9902640 1 --2- 172.21.15.79:0/2221692616 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec406fe20 0x7efec415e7a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009870 tx=0x7efeb402a270 comp rx=0 tx=0).stop 2024-04-25T02:08:10.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.641+0000 7efec9902640 1 -- 172.21.15.79:0/2221692616 shutdown_connections 2024-04-25T02:08:10.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.641+0000 7efec9902640 1 --2- 172.21.15.79:0/2221692616 >> v2:172.21.15.189:3300/0 conn(0x7efec406dc90 0x7efec40ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.641+0000 7efec9902640 1 --2- 172.21.15.79:0/2221692616 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec406fe20 0x7efec415e7a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.641+0000 7efec9902640 1 -- 172.21.15.79:0/2221692616 >> 172.21.15.79:0/2221692616 conn(0x7efec40d0e00 msgr2=0x7efec40d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.641+0000 7efec9902640 1 -- 172.21.15.79:0/2221692616 shutdown_connections 2024-04-25T02:08:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.641+0000 7efec9902640 1 -- 172.21.15.79:0/2221692616 wait complete. 2024-04-25T02:08:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.642+0000 7efec9902640 1 Processor -- start 2024-04-25T02:08:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.642+0000 7efec9902640 1 -- start start 2024-04-25T02:08:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.643+0000 7efec9902640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec406dc90 0x7efec41e94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.643+0000 7efec9902640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec406fe20 0x7efec41550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.643+0000 7efec9902640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efec40b0320 0x7efec415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.643+0000 7efec9902640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efec40d1b50 con 0x7efec406fe20 2024-04-25T02:08:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.643+0000 7efec9902640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efec40d19d0 con 0x7efec40b0320 2024-04-25T02:08:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.643+0000 7efec9902640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efec415bf80 con 0x7efec406dc90 2024-04-25T02:08:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.643+0000 7efec27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec406fe20 0x7efec41550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.643+0000 7efec27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec406fe20 0x7efec41550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35342/0 (socket says 172.21.15.79:35342) 2024-04-25T02:08:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.643+0000 7efec27fc640 1 -- 172.21.15.79:0/2904539766 learned_addr learned my addr 172.21.15.79:0/2904539766 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.643+0000 7efec37fe640 1 --2- 172.21.15.79:0/2904539766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efec40b0320 0x7efec415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.643+0000 7efec2ffd640 1 --2- 172.21.15.79:0/2904539766 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec406dc90 0x7efec41e94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.644+0000 7efec27fc640 1 -- 172.21.15.79:0/2904539766 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec406dc90 msgr2=0x7efec41e94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.644+0000 7efec27fc640 1 --2- 172.21.15.79:0/2904539766 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec406dc90 0x7efec41e94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.644+0000 7efec27fc640 1 -- 172.21.15.79:0/2904539766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efec40b0320 msgr2=0x7efec415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.644+0000 7efec27fc640 1 --2- 172.21.15.79:0/2904539766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efec40b0320 0x7efec415a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.644+0000 7efec27fc640 1 -- 172.21.15.79:0/2904539766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec41e8410 con 0x7efec406fe20 2024-04-25T02:08:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.644+0000 7efec27fc640 1 --2- 172.21.15.79:0/2904539766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec406fe20 0x7efec41550a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efeb800c3c0 tx=0x7efeb800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.644+0000 7efeabfff640 1 -- 172.21.15.79:0/2904539766 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb80052d0 con 0x7efec406fe20 2024-04-25T02:08:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.644+0000 7efeabfff640 1 -- 172.21.15.79:0/2904539766 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb8005490 con 0x7efec406fe20 2024-04-25T02:08:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.644+0000 7efec9902640 1 -- 172.21.15.79:0/2904539766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec41e86f0 con 0x7efec406fe20 2024-04-25T02:08:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.644+0000 7efeabfff640 1 -- 172.21.15.79:0/2904539766 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb8007260 con 0x7efec406fe20 2024-04-25T02:08:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.644+0000 7efec9902640 1 -- 172.21.15.79:0/2904539766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec41e8cb0 con 0x7efec406fe20 2024-04-25T02:08:10.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.645+0000 7efec9902640 1 -- 172.21.15.79:0/2904539766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec41e9a50 con 0x7efec406fe20 2024-04-25T02:08:10.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.645+0000 7efeabfff640 1 -- 172.21.15.79:0/2904539766 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efeb8007420 con 0x7efec406fe20 2024-04-25T02:08:10.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.646+0000 7efeabfff640 1 --2- 172.21.15.79:0/2904539766 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efeb006be30 0x7efeb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.646+0000 7efeabfff640 1 -- 172.21.15.79:0/2904539766 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efeb808a330 con 0x7efec406fe20 2024-04-25T02:08:10.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.646+0000 7efec2ffd640 1 --2- 172.21.15.79:0/2904539766 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efeb006be30 0x7efeb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.646+0000 7efec2ffd640 1 --2- 172.21.15.79:0/2904539766 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efeb006be30 0x7efeb006e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efeb4034000 tx=0x7efeb402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:10.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.650+0000 7efeabfff640 1 -- 172.21.15.79:0/2904539766 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efeb8058ce0 con 0x7efec406fe20 2024-04-25T02:08:10.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.824+0000 7efec9902640 1 -- 172.21.15.79:0/2904539766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efec40690a0 con 0x7efec406fe20 2024-04-25T02:08:10.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.825+0000 7efeabfff640 1 -- 172.21.15.79:0/2904539766 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7efeb80585e0 con 0x7efec406fe20 2024-04-25T02:08:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:08:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.827+0000 7efec9902640 1 -- 172.21.15.79:0/2904539766 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efeb006be30 msgr2=0x7efeb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.827+0000 7efec9902640 1 --2- 172.21.15.79:0/2904539766 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efeb006be30 0x7efeb006e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efeb4034000 tx=0x7efeb402e000 comp rx=0 tx=0).stop 2024-04-25T02:08:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.827+0000 7efec9902640 1 -- 172.21.15.79:0/2904539766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec406fe20 msgr2=0x7efec41550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.827+0000 7efec9902640 1 --2- 172.21.15.79:0/2904539766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec406fe20 0x7efec41550a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efeb800c3c0 tx=0x7efeb800c880 comp rx=0 tx=0).stop 2024-04-25T02:08:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.827+0000 7efec9902640 1 -- 172.21.15.79:0/2904539766 shutdown_connections 2024-04-25T02:08:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.827+0000 7efec9902640 1 --2- 172.21.15.79:0/2904539766 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efeb006be30 0x7efeb006e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.827+0000 7efec9902640 1 --2- 172.21.15.79:0/2904539766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efec40b0320 0x7efec415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.827+0000 7efec9902640 1 --2- 172.21.15.79:0/2904539766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec406fe20 0x7efec41550a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.827+0000 7efec9902640 1 --2- 172.21.15.79:0/2904539766 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec406dc90 0x7efec41e94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.827+0000 7efec9902640 1 -- 172.21.15.79:0/2904539766 >> 172.21.15.79:0/2904539766 conn(0x7efec40d0e00 msgr2=0x7efec415da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:10.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.827+0000 7efec9902640 1 -- 172.21.15.79:0/2904539766 shutdown_connections 2024-04-25T02:08:10.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.827+0000 7efec9902640 1 -- 172.21.15.79:0/2904539766 wait complete. 2024-04-25T02:08:10.844 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:08:10.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.933+0000 7fdb34161640 1 Processor -- start 2024-04-25T02:08:10.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.934+0000 7fdb34161640 1 -- start start 2024-04-25T02:08:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.934+0000 7fdb34161640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb2c0b3570 0x7fdb2c0d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.934+0000 7fdb34161640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fdb2c0b3020 0x7fdb2c0d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.934+0000 7fdb34161640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb2c06c380 con 0x7fdb2c15e4d0 2024-04-25T02:08:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.934+0000 7fdb34161640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fdb2c0d1660 con 0x7fdb2c0b3570 2024-04-25T02:08:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.934+0000 7fdb34161640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fdb2c0d1380 con 0x7fdb2c0b3020 2024-04-25T02:08:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.934+0000 7fdb316fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb2c0b3570 0x7fdb2c0d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.934+0000 7fdb31efd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdb2c15e4d0 0x7fdb2c06bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47870/0 (socket says 172.21.15.79:47870) 2024-04-25T02:08:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.934+0000 7fdb31efd640 1 -- 172.21.15.79:0/3816599624 learned_addr learned my addr 172.21.15.79:0/3816599624 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.935+0000 7fdb326fe640 1 --2- 172.21.15.79:0/3816599624 >> v2:172.21.15.189:3300/0 conn(0x7fdb2c0b3020 0x7fdb2c0d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.935+0000 7fdb316fc640 1 -- 172.21.15.79:0/3816599624 >> v2:172.21.15.189:3300/0 conn(0x7fdb2c0b3020 msgr2=0x7fdb2c0d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.935+0000 7fdb316fc640 1 --2- 172.21.15.79:0/3816599624 >> v2:172.21.15.189:3300/0 conn(0x7fdb2c0b3020 0x7fdb2c0d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.935+0000 7fdb316fc640 1 -- 172.21.15.79:0/3816599624 >> v1:172.21.15.79:6789/0 conn(0x7fdb2c15e4d0 legacy=0x7fdb2c06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.935+0000 7fdb316fc640 1 -- 172.21.15.79:0/3816599624 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2c0cede0 con 0x7fdb2c0b3570 2024-04-25T02:08:10.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.935+0000 7fdb316fc640 1 --2- 172.21.15.79:0/3816599624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb2c0b3570 0x7fdb2c0d2710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdb200097a0 tx=0x7fdb2002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f900104a025e64f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:10.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.935+0000 7fdb30efb640 1 -- 172.21.15.79:0/3816599624 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb20037070 con 0x7fdb2c0b3570 2024-04-25T02:08:10.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.936+0000 7fdb30efb640 1 -- 172.21.15.79:0/3816599624 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb20032440 con 0x7fdb2c0b3570 2024-04-25T02:08:10.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.936+0000 7fdb30efb640 1 -- 172.21.15.79:0/3816599624 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb20032810 con 0x7fdb2c0b3570 2024-04-25T02:08:10.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.936+0000 7fdb34161640 1 -- 172.21.15.79:0/3816599624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb2c0b3570 msgr2=0x7fdb2c0d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.936+0000 7fdb34161640 1 --2- 172.21.15.79:0/3816599624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb2c0b3570 0x7fdb2c0d2710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdb200097a0 tx=0x7fdb2002a1e0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.936+0000 7fdb34161640 1 -- 172.21.15.79:0/3816599624 shutdown_connections 2024-04-25T02:08:10.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.936+0000 7fdb34161640 1 --2- 172.21.15.79:0/3816599624 >> v2:172.21.15.189:3300/0 conn(0x7fdb2c0b3020 0x7fdb2c0d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.936+0000 7fdb34161640 1 --2- 172.21.15.79:0/3816599624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb2c0b3570 0x7fdb2c0d2710 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.936+0000 7fdb34161640 1 -- 172.21.15.79:0/3816599624 >> 172.21.15.79:0/3816599624 conn(0x7fdb2c09d460 msgr2=0x7fdb2c0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:10.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.936+0000 7fdb34161640 1 -- 172.21.15.79:0/3816599624 shutdown_connections 2024-04-25T02:08:10.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.936+0000 7fdb34161640 1 -- 172.21.15.79:0/3816599624 wait complete. 2024-04-25T02:08:10.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.937+0000 7fdb34161640 1 Processor -- start 2024-04-25T02:08:10.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.937+0000 7fdb34161640 1 -- start start 2024-04-25T02:08:10.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb34161640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb2c0b3020 0x7fdb2c0b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb34161640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdb2c0b3570 0x7fdb2c1f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb34161640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb2c15e4d0 0x7fdb2c0b9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb34161640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c0d20d0 con 0x7fdb2c0b3020 2024-04-25T02:08:10.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb34161640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c15e8b0 con 0x7fdb2c15e4d0 2024-04-25T02:08:10.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb34161640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdb2c0d2250 con 0x7fdb2c0b3570 2024-04-25T02:08:10.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb31efd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb2c0b3020 0x7fdb2c0b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb31efd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb2c0b3020 0x7fdb2c0b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35350/0 (socket says 172.21.15.79:35350) 2024-04-25T02:08:10.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb31efd640 1 -- 172.21.15.79:0/676772405 learned_addr learned my addr 172.21.15.79:0/676772405 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:10.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb31efd640 1 -- 172.21.15.79:0/676772405 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdb2c0b3570 msgr2=0x7fdb2c1f7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb31efd640 1 --2- 172.21.15.79:0/676772405 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdb2c0b3570 0x7fdb2c1f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb31efd640 1 -- 172.21.15.79:0/676772405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb2c15e4d0 msgr2=0x7fdb2c0b9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb31efd640 1 --2- 172.21.15.79:0/676772405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb2c15e4d0 0x7fdb2c0b9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb31efd640 1 -- 172.21.15.79:0/676772405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2c0b5160 con 0x7fdb2c0b3020 2024-04-25T02:08:10.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb31efd640 1 --2- 172.21.15.79:0/676772405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb2c0b3020 0x7fdb2c0b4b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00caa0 tx=0x7fdb1c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:10.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.938+0000 7fdb2a7fc640 1 -- 172.21.15.79:0/676772405 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c017070 con 0x7fdb2c0b3020 2024-04-25T02:08:10.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.939+0000 7fdb2a7fc640 1 -- 172.21.15.79:0/676772405 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1c00ac00 con 0x7fdb2c0b3020 2024-04-25T02:08:10.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.939+0000 7fdb2a7fc640 1 -- 172.21.15.79:0/676772405 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c012400 con 0x7fdb2c0b3020 2024-04-25T02:08:10.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.939+0000 7fdb34161640 1 -- 172.21.15.79:0/676772405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2c0b5440 con 0x7fdb2c0b3020 2024-04-25T02:08:10.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.939+0000 7fdb34161640 1 -- 172.21.15.79:0/676772405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb2c0b5a00 con 0x7fdb2c0b3020 2024-04-25T02:08:10.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.939+0000 7fdb34161640 1 -- 172.21.15.79:0/676772405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb2c0690a0 con 0x7fdb2c0b3020 2024-04-25T02:08:10.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.940+0000 7fdb2a7fc640 1 -- 172.21.15.79:0/676772405 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb1c01a070 con 0x7fdb2c0b3020 2024-04-25T02:08:10.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.940+0000 7fdb2a7fc640 1 --2- 172.21.15.79:0/676772405 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdb1806be30 0x7fdb1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.940+0000 7fdb2a7fc640 1 -- 172.21.15.79:0/676772405 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdb1c08abd0 con 0x7fdb2c0b3020 2024-04-25T02:08:10.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.940+0000 7fdb316fc640 1 --2- 172.21.15.79:0/676772405 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdb1806be30 0x7fdb1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.941+0000 7fdb316fc640 1 --2- 172.21.15.79:0/676772405 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdb1806be30 0x7fdb1806e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdb20034000 tx=0x7fdb2002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:10.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:10.945+0000 7fdb2a7fc640 1 -- 172.21.15.79:0/676772405 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdb1c059580 con 0x7fdb2c0b3020 2024-04-25T02:08:11.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.155+0000 7fdb34161640 1 -- 172.21.15.79:0/676772405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb2c0d1920 con 0x7fdb2c0b3020 2024-04-25T02:08:11.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.155+0000 7fdb2a7fc640 1 -- 172.21.15.79:0/676772405 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7fdb1c058e80 con 0x7fdb2c0b3020 2024-04-25T02:08:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:11.163 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/465663373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":465663373},{"type":"v1","addr":"172.21.15.189:6833","nonce":465663373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2093278785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2093278785},{"type":"v1","addr":"172.21.15.79:6836","nonce":2093278785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2415912880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2415912880},{"type":"v1","addr":"172.21.15.189:6835","nonce":2415912880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:07:59.452096+0000","modified":"2024-04-25T02:08:01.458029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2942986974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2942986974},{"type":"v1","addr":"172.21.15.79:6837","nonce":2942986974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-25T02:08:11.163 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2024-04-25T02:08:11.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.157+0000 7fdb34161640 1 -- 172.21.15.79:0/676772405 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdb1806be30 msgr2=0x7fdb1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:11.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.157+0000 7fdb34161640 1 --2- 172.21.15.79:0/676772405 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdb1806be30 0x7fdb1806e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdb20034000 tx=0x7fdb2002c000 comp rx=0 tx=0).stop 2024-04-25T02:08:11.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.157+0000 7fdb34161640 1 -- 172.21.15.79:0/676772405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb2c0b3020 msgr2=0x7fdb2c0b4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:11.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.157+0000 7fdb34161640 1 --2- 172.21.15.79:0/676772405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb2c0b3020 0x7fdb2c0b4b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00caa0 tx=0x7fdb1c00cf60 comp rx=0 tx=0).stop 2024-04-25T02:08:11.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.157+0000 7fdb34161640 1 -- 172.21.15.79:0/676772405 shutdown_connections 2024-04-25T02:08:11.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.157+0000 7fdb34161640 1 --2- 172.21.15.79:0/676772405 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdb1806be30 0x7fdb1806e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.157+0000 7fdb34161640 1 --2- 172.21.15.79:0/676772405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb2c15e4d0 0x7fdb2c0b9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.157+0000 7fdb34161640 1 --2- 172.21.15.79:0/676772405 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdb2c0b3570 0x7fdb2c1f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.157+0000 7fdb34161640 1 --2- 172.21.15.79:0/676772405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb2c0b3020 0x7fdb2c0b4b10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.157+0000 7fdb34161640 1 -- 172.21.15.79:0/676772405 >> 172.21.15.79:0/676772405 conn(0x7fdb2c09d460 msgr2=0x7fdb2c0b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:11.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.157+0000 7fdb34161640 1 -- 172.21.15.79:0/676772405 shutdown_connections 2024-04-25T02:08:11.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.157+0000 7fdb34161640 1 -- 172.21.15.79:0/676772405 wait complete. 2024-04-25T02:08:11.175 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:11.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.265+0000 7fd94e2ae640 1 Processor -- start 2024-04-25T02:08:11.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.265+0000 7fd94e2ae640 1 -- start start 2024-04-25T02:08:11.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.266+0000 7fd94e2ae640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd9480c6b00 0x7fd9480b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:11.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.266+0000 7fd94e2ae640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9480d29b0 con 0x7fd9480d0ac0 2024-04-25T02:08:11.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.266+0000 7fd94e2ae640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9480cfa60 con 0x7fd94815f8b0 2024-04-25T02:08:11.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.266+0000 7fd94e2ae640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd9480d00b0 con 0x7fd9480c6b00 2024-04-25T02:08:11.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.266+0000 7fd9477fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd9480d0ac0 0x7fd9480cc8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47884/0 (socket says 172.21.15.79:47884) 2024-04-25T02:08:11.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.266+0000 7fd9477fe640 1 -- 172.21.15.79:0/244658967 learned_addr learned my addr 172.21.15.79:0/244658967 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:11.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.266+0000 7fd94c84b640 1 --2- 172.21.15.79:0/244658967 >> v2:172.21.15.189:3300/0 conn(0x7fd9480c6b00 0x7fd9480b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:11.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.266+0000 7fd946ffd640 1 -- 172.21.15.79:0/244658967 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 981755979 0 0) 0x7fd9480d29b0 con 0x7fd9480d0ac0 2024-04-25T02:08:11.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.266+0000 7fd946ffd640 1 -- 172.21.15.79:0/244658967 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd930003520 con 0x7fd9480d0ac0 2024-04-25T02:08:11.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd946ffd640 1 -- 172.21.15.79:0/244658967 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 217142068 0 0) 0x7fd930003520 con 0x7fd9480d0ac0 2024-04-25T02:08:11.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd946ffd640 1 -- 172.21.15.79:0/244658967 >> v2:172.21.15.189:3300/0 conn(0x7fd9480c6b00 msgr2=0x7fd9480b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:11.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd946ffd640 1 --2- 172.21.15.79:0/244658967 >> v2:172.21.15.189:3300/0 conn(0x7fd9480c6b00 0x7fd9480b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd946ffd640 1 -- 172.21.15.79:0/244658967 >> v1:172.21.15.189:6789/0 conn(0x7fd94815f8b0 legacy=0x7fd9480d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:11.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd946ffd640 1 -- 172.21.15.79:0/244658967 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9480cfd40 con 0x7fd9480d0ac0 2024-04-25T02:08:11.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd946ffd640 1 -- 172.21.15.79:0/244658967 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fd93c001670 con 0x7fd9480d0ac0 2024-04-25T02:08:11.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd946ffd640 1 -- 172.21.15.79:0/244658967 >> v1:172.21.15.79:6789/0 conn(0x7fd9480d0ac0 legacy=0x7fd9480cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:11.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd946ffd640 1 --2- 172.21.15.79:0/244658967 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9300039b0 0x7fd930003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:11.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd946ffd640 1 --2- 172.21.15.79:0/244658967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd930004800 0x7fd930004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:11.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd946ffd640 1 --2- 172.21.15.79:0/244658967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9300051c0 0x7fd93000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:11.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd946ffd640 1 -- 172.21.15.79:0/244658967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd9480d00b0 con 0x7fd930004800 2024-04-25T02:08:11.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd946ffd640 1 -- 172.21.15.79:0/244658967 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd93000c060 con 0x7fd9300051c0 2024-04-25T02:08:11.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd946ffd640 1 -- 172.21.15.79:0/244658967 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd93000c260 con 0x7fd9300039b0 2024-04-25T02:08:11.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd9477fe640 1 --2- 172.21.15.79:0/244658967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd930004800 0x7fd930004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:11.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd947fff640 1 --2- 172.21.15.79:0/244658967 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9300039b0 0x7fd930003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:11.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd94c84b640 1 --2- 172.21.15.79:0/244658967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9300051c0 0x7fd93000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:11.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd9477fe640 1 -- 172.21.15.79:0/244658967 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9300039b0 msgr2=0x7fd930003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:11.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd9477fe640 1 --2- 172.21.15.79:0/244658967 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9300039b0 0x7fd930003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd9477fe640 1 -- 172.21.15.79:0/244658967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9300051c0 msgr2=0x7fd93000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:11.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd9477fe640 1 --2- 172.21.15.79:0/244658967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9300051c0 0x7fd93000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd9477fe640 1 -- 172.21.15.79:0/244658967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd930003520 con 0x7fd930004800 2024-04-25T02:08:11.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd94c84b640 1 --2- 172.21.15.79:0/244658967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9300051c0 0x7fd93000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:11.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd947fff640 1 --2- 172.21.15.79:0/244658967 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9300039b0 0x7fd930003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:11.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.267+0000 7fd94c84b640 1 -- 172.21.15.79:0/244658967 reap_dead start 2024-04-25T02:08:11.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.268+0000 7fd9477fe640 1 --2- 172.21.15.79:0/244658967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd930004800 0x7fd930004c80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00c210 tx=0x7fd930005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce59c2f194f49c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:11.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.268+0000 7fd946ffd640 1 -- 172.21.15.79:0/244658967 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c007d30 con 0x7fd930004800 2024-04-25T02:08:11.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.268+0000 7fd946ffd640 1 -- 172.21.15.79:0/244658967 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd93c0058d0 con 0x7fd930004800 2024-04-25T02:08:11.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.268+0000 7fd946ffd640 1 -- 172.21.15.79:0/244658967 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c005d20 con 0x7fd930004800 2024-04-25T02:08:11.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.268+0000 7fd94e2ae640 1 -- 172.21.15.79:0/244658967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd930004800 msgr2=0x7fd930004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:11.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.268+0000 7fd94e2ae640 1 --2- 172.21.15.79:0/244658967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd930004800 0x7fd930004c80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00c210 tx=0x7fd930005830 comp rx=0 tx=0).stop 2024-04-25T02:08:11.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.268+0000 7fd94e2ae640 1 -- 172.21.15.79:0/244658967 shutdown_connections 2024-04-25T02:08:11.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.268+0000 7fd94e2ae640 1 --2- 172.21.15.79:0/244658967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd930004800 0x7fd930004c80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.268+0000 7fd94e2ae640 1 -- 172.21.15.79:0/244658967 >> 172.21.15.79:0/244658967 conn(0x7fd9480d1df0 msgr2=0x7fd9480d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:11.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.268+0000 7fd94e2ae640 1 -- 172.21.15.79:0/244658967 shutdown_connections 2024-04-25T02:08:11.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.268+0000 7fd94e2ae640 1 -- 172.21.15.79:0/244658967 wait complete. 2024-04-25T02:08:11.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.270+0000 7fd94e2ae640 1 Processor -- start 2024-04-25T02:08:11.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.270+0000 7fd94e2ae640 1 -- start start 2024-04-25T02:08:11.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.270+0000 7fd94e2ae640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd930004800 0x7fd9480b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:11.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.270+0000 7fd94e2ae640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd94806d350 0x7fd9480c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:11.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd94e2ae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd94806d7d0 0x7fd9480c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:11.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd94e2ae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd9480b3500 con 0x7fd94806d7d0 2024-04-25T02:08:11.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd94e2ae640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd9480d2c90 con 0x7fd94806d350 2024-04-25T02:08:11.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd94e2ae640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd9480b3680 con 0x7fd930004800 2024-04-25T02:08:11.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd94c84b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd94806d7d0 0x7fd9480c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:11.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd94c84b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd94806d7d0 0x7fd9480c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35372/0 (socket says 172.21.15.79:35372) 2024-04-25T02:08:11.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd94c84b640 1 -- 172.21.15.79:0/1691124279 learned_addr learned my addr 172.21.15.79:0/1691124279 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:11.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd947fff640 1 --2- 172.21.15.79:0/1691124279 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd930004800 0x7fd9480b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:11.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd9477fe640 1 --2- 172.21.15.79:0/1691124279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd94806d350 0x7fd9480c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:11.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd94c84b640 1 -- 172.21.15.79:0/1691124279 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd930004800 msgr2=0x7fd9480b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:11.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd94c84b640 1 --2- 172.21.15.79:0/1691124279 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd930004800 0x7fd9480b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd94c84b640 1 -- 172.21.15.79:0/1691124279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd94806d350 msgr2=0x7fd9480c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:11.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd94c84b640 1 --2- 172.21.15.79:0/1691124279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd94806d350 0x7fd9480c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd94c84b640 1 -- 172.21.15.79:0/1691124279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9480b57b0 con 0x7fd94806d7d0 2024-04-25T02:08:11.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd94c84b640 1 --2- 172.21.15.79:0/1691124279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd94806d7d0 0x7fd9480c9400 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd9480d1dc0 tx=0x7fd940010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:11.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd944ff9640 1 -- 172.21.15.79:0/1691124279 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94001a030 con 0x7fd94806d7d0 2024-04-25T02:08:11.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd944ff9640 1 -- 172.21.15.79:0/1691124279 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd940010da0 con 0x7fd94806d7d0 2024-04-25T02:08:11.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd94e2ae640 1 -- 172.21.15.79:0/1691124279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9480b5a90 con 0x7fd94806d7d0 2024-04-25T02:08:11.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd944ff9640 1 -- 172.21.15.79:0/1691124279 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940003bd0 con 0x7fd94806d7d0 2024-04-25T02:08:11.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.271+0000 7fd94e2ae640 1 -- 172.21.15.79:0/1691124279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9480b6050 con 0x7fd94806d7d0 2024-04-25T02:08:11.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.272+0000 7fd94e2ae640 1 -- 172.21.15.79:0/1691124279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9480690a0 con 0x7fd94806d7d0 2024-04-25T02:08:11.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.273+0000 7fd944ff9640 1 -- 172.21.15.79:0/1691124279 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd94001d070 con 0x7fd94806d7d0 2024-04-25T02:08:11.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.273+0000 7fd944ff9640 1 --2- 172.21.15.79:0/1691124279 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd93406be60 0x7fd93406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:11.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.273+0000 7fd947fff640 1 --2- 172.21.15.79:0/1691124279 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd93406be60 0x7fd93406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:11.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.273+0000 7fd944ff9640 1 -- 172.21.15.79:0/1691124279 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd94008b930 con 0x7fd94806d7d0 2024-04-25T02:08:11.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.273+0000 7fd947fff640 1 --2- 172.21.15.79:0/1691124279 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd93406be60 0x7fd93406e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd948050770 tx=0x7fd938009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:11.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.277+0000 7fd944ff9640 1 -- 172.21.15.79:0/1691124279 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd94005a370 con 0x7fd94806d7d0 2024-04-25T02:08:11.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.450+0000 7fd94e2ae640 1 -- 172.21.15.79:0/1691124279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9480b2f50 con 0x7fd94806d7d0 2024-04-25T02:08:11.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.451+0000 7fd944ff9640 1 -- 172.21.15.79:0/1691124279 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7fd940060030 con 0x7fd94806d7d0 2024-04-25T02:08:11.458 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:11.458 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:11.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.453+0000 7fd94e2ae640 1 -- 172.21.15.79:0/1691124279 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd93406be60 msgr2=0x7fd93406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.453+0000 7fd94e2ae640 1 --2- 172.21.15.79:0/1691124279 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd93406be60 0x7fd93406e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd948050770 tx=0x7fd938009040 comp rx=0 tx=0).stop 2024-04-25T02:08:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.453+0000 7fd94e2ae640 1 -- 172.21.15.79:0/1691124279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd94806d7d0 msgr2=0x7fd9480c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.453+0000 7fd94e2ae640 1 --2- 172.21.15.79:0/1691124279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd94806d7d0 0x7fd9480c9400 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd9480d1dc0 tx=0x7fd940010590 comp rx=0 tx=0).stop 2024-04-25T02:08:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.453+0000 7fd94e2ae640 1 -- 172.21.15.79:0/1691124279 shutdown_connections 2024-04-25T02:08:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.453+0000 7fd94e2ae640 1 --2- 172.21.15.79:0/1691124279 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd93406be60 0x7fd93406e320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.453+0000 7fd94e2ae640 1 --2- 172.21.15.79:0/1691124279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd94806d7d0 0x7fd9480c9400 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.453+0000 7fd94e2ae640 1 --2- 172.21.15.79:0/1691124279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd94806d350 0x7fd9480c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.453+0000 7fd94e2ae640 1 --2- 172.21.15.79:0/1691124279 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd930004800 0x7fd9480b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.453+0000 7fd94e2ae640 1 -- 172.21.15.79:0/1691124279 >> 172.21.15.79:0/1691124279 conn(0x7fd9480d1df0 msgr2=0x7fd9480c77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.453+0000 7fd94e2ae640 1 -- 172.21.15.79:0/1691124279 shutdown_connections 2024-04-25T02:08:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.453+0000 7fd94e2ae640 1 -- 172.21.15.79:0/1691124279 wait complete. 2024-04-25T02:08:11.471 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:08:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.560+0000 7fde68031640 1 Processor -- start 2024-04-25T02:08:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.560+0000 7fde68031640 1 -- start start 2024-04-25T02:08:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.561+0000 7fde68031640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fde6006df50 0x7fde6006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.561+0000 7fde68031640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fde600b2d30 0x7fde600b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.561+0000 7fde68031640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde60071e00 con 0x7fde60143bc0 2024-04-25T02:08:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.561+0000 7fde68031640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fde6006e8f0 con 0x7fde6006df50 2024-04-25T02:08:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.561+0000 7fde68031640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fde60072cb0 con 0x7fde600b2d30 2024-04-25T02:08:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.561+0000 7fde655cc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fde6006df50 0x7fde6006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.561+0000 7fde65dcd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fde60143bc0 0x7fde6015f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47886/0 (socket says 172.21.15.79:47886) 2024-04-25T02:08:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.561+0000 7fde65dcd640 1 -- 172.21.15.79:0/2483178005 learned_addr learned my addr 172.21.15.79:0/2483178005 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.561+0000 7fde665ce640 1 --2- 172.21.15.79:0/2483178005 >> v2:172.21.15.189:3300/0 conn(0x7fde600b2d30 0x7fde600b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.561+0000 7fde655cc640 1 -- 172.21.15.79:0/2483178005 >> v2:172.21.15.189:3300/0 conn(0x7fde600b2d30 msgr2=0x7fde600b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.561+0000 7fde655cc640 1 --2- 172.21.15.79:0/2483178005 >> v2:172.21.15.189:3300/0 conn(0x7fde600b2d30 0x7fde600b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.561+0000 7fde655cc640 1 -- 172.21.15.79:0/2483178005 >> v1:172.21.15.79:6789/0 conn(0x7fde60143bc0 legacy=0x7fde6015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.561+0000 7fde655cc640 1 -- 172.21.15.79:0/2483178005 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde600720a0 con 0x7fde6006df50 2024-04-25T02:08:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.561+0000 7fde64dcb640 1 -- 172.21.15.79:0/2483178005 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968090282 0 0) 0x7fde60071e00 con 0x7fde60143bc0 2024-04-25T02:08:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.562+0000 7fde655cc640 1 --2- 172.21.15.79:0/2483178005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde6006df50 0x7fde6006e3b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde60144d00 tx=0x7fde5002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca71e8c44f0cf4cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.562+0000 7fde64dcb640 1 -- 172.21.15.79:0/2483178005 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50037070 con 0x7fde6006df50 2024-04-25T02:08:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.562+0000 7fde64dcb640 1 -- 172.21.15.79:0/2483178005 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde50032440 con 0x7fde6006df50 2024-04-25T02:08:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.562+0000 7fde64dcb640 1 -- 172.21.15.79:0/2483178005 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5002ae60 con 0x7fde6006df50 2024-04-25T02:08:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.562+0000 7fde68031640 1 -- 172.21.15.79:0/2483178005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde6006df50 msgr2=0x7fde6006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.562+0000 7fde68031640 1 --2- 172.21.15.79:0/2483178005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde6006df50 0x7fde6006e3b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde60144d00 tx=0x7fde5002a110 comp rx=0 tx=0).stop 2024-04-25T02:08:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.562+0000 7fde68031640 1 -- 172.21.15.79:0/2483178005 shutdown_connections 2024-04-25T02:08:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.562+0000 7fde68031640 1 --2- 172.21.15.79:0/2483178005 >> v2:172.21.15.189:3300/0 conn(0x7fde600b2d30 0x7fde600b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.562+0000 7fde68031640 1 --2- 172.21.15.79:0/2483178005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde6006df50 0x7fde6006e3b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.562+0000 7fde68031640 1 -- 172.21.15.79:0/2483178005 >> 172.21.15.79:0/2483178005 conn(0x7fde600cfc80 msgr2=0x7fde600d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.563+0000 7fde68031640 1 -- 172.21.15.79:0/2483178005 shutdown_connections 2024-04-25T02:08:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.563+0000 7fde68031640 1 -- 172.21.15.79:0/2483178005 wait complete. 2024-04-25T02:08:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.564+0000 7fde68031640 1 Processor -- start 2024-04-25T02:08:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.564+0000 7fde68031640 1 -- start start 2024-04-25T02:08:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.564+0000 7fde68031640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde6006df50 0x7fde600b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.564+0000 7fde68031640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde600b2d30 0x7fde601df550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.564+0000 7fde68031640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde60143bc0 0x7fde6013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.564+0000 7fde68031640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde60072940 con 0x7fde600b2d30 2024-04-25T02:08:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.564+0000 7fde68031640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fde60072660 con 0x7fde6006df50 2024-04-25T02:08:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.564+0000 7fde68031640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fde60143fa0 con 0x7fde60143bc0 2024-04-25T02:08:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.564+0000 7fde655cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde600b2d30 0x7fde601df550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.564+0000 7fde655cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde600b2d30 0x7fde601df550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35378/0 (socket says 172.21.15.79:35378) 2024-04-25T02:08:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.564+0000 7fde655cc640 1 -- 172.21.15.79:0/529156251 learned_addr learned my addr 172.21.15.79:0/529156251 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.565+0000 7fde665ce640 1 --2- 172.21.15.79:0/529156251 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde60143bc0 0x7fde6013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.565+0000 7fde65dcd640 1 --2- 172.21.15.79:0/529156251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde6006df50 0x7fde600b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.565+0000 7fde655cc640 1 -- 172.21.15.79:0/529156251 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde60143bc0 msgr2=0x7fde6013f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.565+0000 7fde655cc640 1 --2- 172.21.15.79:0/529156251 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde60143bc0 0x7fde6013f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.565+0000 7fde655cc640 1 -- 172.21.15.79:0/529156251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde6006df50 msgr2=0x7fde600b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.565+0000 7fde655cc640 1 --2- 172.21.15.79:0/529156251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde6006df50 0x7fde600b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.565+0000 7fde655cc640 1 -- 172.21.15.79:0/529156251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde601dfa90 con 0x7fde600b2d30 2024-04-25T02:08:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.565+0000 7fde655cc640 1 --2- 172.21.15.79:0/529156251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde600b2d30 0x7fde601df550 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fde50009890 tx=0x7fde500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.565+0000 7fde567fc640 1 -- 172.21.15.79:0/529156251 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50037040 con 0x7fde600b2d30 2024-04-25T02:08:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.565+0000 7fde567fc640 1 -- 172.21.15.79:0/529156251 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde50042070 con 0x7fde600b2d30 2024-04-25T02:08:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.565+0000 7fde567fc640 1 -- 172.21.15.79:0/529156251 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50030a50 con 0x7fde600b2d30 2024-04-25T02:08:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.565+0000 7fde68031640 1 -- 172.21.15.79:0/529156251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde600b0b20 con 0x7fde600b2d30 2024-04-25T02:08:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.565+0000 7fde68031640 1 -- 172.21.15.79:0/529156251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde600b10e0 con 0x7fde600b2d30 2024-04-25T02:08:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.566+0000 7fde68031640 1 -- 172.21.15.79:0/529156251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde600690a0 con 0x7fde600b2d30 2024-04-25T02:08:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.566+0000 7fde567fc640 1 -- 172.21.15.79:0/529156251 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde50030bf0 con 0x7fde600b2d30 2024-04-25T02:08:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.567+0000 7fde567fc640 1 --2- 172.21.15.79:0/529156251 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fde4406be60 0x7fde4406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.567+0000 7fde567fc640 1 -- 172.21.15.79:0/529156251 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fde500ab8c0 con 0x7fde600b2d30 2024-04-25T02:08:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.567+0000 7fde65dcd640 1 --2- 172.21.15.79:0/529156251 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fde4406be60 0x7fde4406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.567+0000 7fde65dcd640 1 --2- 172.21.15.79:0/529156251 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fde4406be60 0x7fde4406e320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde5c000f60 tx=0x7fde5c007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:11.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.571+0000 7fde567fc640 1 -- 172.21.15.79:0/529156251 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fde601dfa90 con 0x7fde600b2d30 2024-04-25T02:08:11.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.779+0000 7fde68031640 1 -- 172.21.15.79:0/529156251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde60071950 con 0x7fde600b2d30 2024-04-25T02:08:11.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.780+0000 7fde567fc640 1 -- 172.21.15.79:0/529156251 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7fde50045360 con 0x7fde600b2d30 2024-04-25T02:08:11.787 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:11.787 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/465663373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":465663373},{"type":"v1","addr":"172.21.15.189:6833","nonce":465663373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2093278785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2093278785},{"type":"v1","addr":"172.21.15.79:6836","nonce":2093278785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2415912880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2415912880},{"type":"v1","addr":"172.21.15.189:6835","nonce":2415912880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:07:59.452096+0000","modified":"2024-04-25T02:08:01.458029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2942986974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2942986974},{"type":"v1","addr":"172.21.15.79:6837","nonce":2942986974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-25T02:08:11.787 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2024-04-25T02:08:11.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.782+0000 7fde68031640 1 -- 172.21.15.79:0/529156251 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fde4406be60 msgr2=0x7fde4406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:11.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.782+0000 7fde68031640 1 --2- 172.21.15.79:0/529156251 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fde4406be60 0x7fde4406e320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde5c000f60 tx=0x7fde5c007b50 comp rx=0 tx=0).stop 2024-04-25T02:08:11.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.782+0000 7fde68031640 1 -- 172.21.15.79:0/529156251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde600b2d30 msgr2=0x7fde601df550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:11.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.782+0000 7fde68031640 1 --2- 172.21.15.79:0/529156251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde600b2d30 0x7fde601df550 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fde50009890 tx=0x7fde500046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.782+0000 7fde68031640 1 -- 172.21.15.79:0/529156251 shutdown_connections 2024-04-25T02:08:11.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.782+0000 7fde68031640 1 --2- 172.21.15.79:0/529156251 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fde4406be60 0x7fde4406e320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.782+0000 7fde68031640 1 --2- 172.21.15.79:0/529156251 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde60143bc0 0x7fde6013f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.782+0000 7fde68031640 1 --2- 172.21.15.79:0/529156251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde600b2d30 0x7fde601df550 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.782+0000 7fde68031640 1 --2- 172.21.15.79:0/529156251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde6006df50 0x7fde600b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:11.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.782+0000 7fde68031640 1 -- 172.21.15.79:0/529156251 >> 172.21.15.79:0/529156251 conn(0x7fde600cfc80 msgr2=0x7fde601e2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:11.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.782+0000 7fde68031640 1 -- 172.21.15.79:0/529156251 shutdown_connections 2024-04-25T02:08:11.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:11.782+0000 7fde68031640 1 -- 172.21.15.79:0/529156251 wait complete. 2024-04-25T02:08:12.202 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:07:59.452096+0000', 'modified': '2024-04-25T02:08:01.458029+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6837/2942986974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 2942986974}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 2942986974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4287, 'qdb_cluster': [4287]} 2024-04-25T02:08:12.202 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:08:12.202 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T02:08:12.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.294+0000 7f3752f70640 1 Processor -- start 2024-04-25T02:08:12.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.294+0000 7f3752f70640 1 -- start start 2024-04-25T02:08:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.295+0000 7f3752f70640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f374c15bc10 0x7f374c162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.295+0000 7f3752f70640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f374c06e660 0x7f374c0b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.295+0000 7f3752f70640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f374c162d40 con 0x7f374c15bff0 2024-04-25T02:08:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.295+0000 7f3752f70640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f374c15e870 con 0x7f374c06e660 2024-04-25T02:08:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.295+0000 7f3752f70640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f374c15eb10 con 0x7f374c15bc10 2024-04-25T02:08:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.295+0000 7f375150d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f374c06e660 0x7f374c0b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.295+0000 7f374bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f374c15bff0 0x7f374c06df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47892/0 (socket says 172.21.15.79:47892) 2024-04-25T02:08:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.295+0000 7f374bfff640 1 -- 172.21.15.79:0/1580540687 learned_addr learned my addr 172.21.15.79:0/1580540687 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.295+0000 7f3750d0c640 1 --2- 172.21.15.79:0/1580540687 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f374c15bc10 0x7f374c162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.295+0000 7f375150d640 1 -- 172.21.15.79:0/1580540687 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f374c15bc10 msgr2=0x7f374c162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.295+0000 7f375150d640 1 --2- 172.21.15.79:0/1580540687 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f374c15bc10 0x7f374c162800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.295+0000 7f375150d640 1 -- 172.21.15.79:0/1580540687 >> v1:172.21.15.79:6789/0 conn(0x7f374c15bff0 legacy=0x7f374c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.295+0000 7f375150d640 1 -- 172.21.15.79:0/1580540687 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374c15edf0 con 0x7f374c06e660 2024-04-25T02:08:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.296+0000 7f375150d640 1 --2- 172.21.15.79:0/1580540687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f374c06e660 0x7f374c0b3f60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3744009d90 tx=0x7f374402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27e27cfe6da5a87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:12.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.296+0000 7f374b7fe640 1 -- 172.21.15.79:0/1580540687 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3744031600 con 0x7f374c06e660 2024-04-25T02:08:12.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.296+0000 7f374b7fe640 1 -- 172.21.15.79:0/1580540687 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37440317a0 con 0x7f374c06e660 2024-04-25T02:08:12.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.296+0000 7f374b7fe640 1 -- 172.21.15.79:0/1580540687 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3744031b70 con 0x7f374c06e660 2024-04-25T02:08:12.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.296+0000 7f3752f70640 1 -- 172.21.15.79:0/1580540687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f374c06e660 msgr2=0x7f374c0b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.296+0000 7f3752f70640 1 --2- 172.21.15.79:0/1580540687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f374c06e660 0x7f374c0b3f60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3744009d90 tx=0x7f374402a5d0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.296+0000 7f3752f70640 1 -- 172.21.15.79:0/1580540687 shutdown_connections 2024-04-25T02:08:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.296+0000 7f3752f70640 1 --2- 172.21.15.79:0/1580540687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f374c06e660 0x7f374c0b3f60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.296+0000 7f3752f70640 1 --2- 172.21.15.79:0/1580540687 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f374c15bc10 0x7f374c162800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.296+0000 7f3752f70640 1 -- 172.21.15.79:0/1580540687 >> 172.21.15.79:0/1580540687 conn(0x7f374c0cfc80 msgr2=0x7f374c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.296+0000 7f3752f70640 1 -- 172.21.15.79:0/1580540687 shutdown_connections 2024-04-25T02:08:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.296+0000 7f3752f70640 1 -- 172.21.15.79:0/1580540687 wait complete. 2024-04-25T02:08:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.298+0000 7f3752f70640 1 Processor -- start 2024-04-25T02:08:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.298+0000 7f3752f70640 1 -- start start 2024-04-25T02:08:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.298+0000 7f3752f70640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f374c06e660 0x7f374c1461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.298+0000 7f3752f70640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f374c15bc10 0x7f374c15f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.298+0000 7f3752f70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f374c15bff0 0x7f374c145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.298+0000 7f3752f70640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f374c15f690 con 0x7f374c15bff0 2024-04-25T02:08:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.298+0000 7f3752f70640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f374c15f3b0 con 0x7f374c15bc10 2024-04-25T02:08:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.298+0000 7f3752f70640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f374c0aef70 con 0x7f374c06e660 2024-04-25T02:08:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f375150d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f374c15bff0 0x7f374c145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f375150d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f374c15bff0 0x7f374c145690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35394/0 (socket says 172.21.15.79:35394) 2024-04-25T02:08:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f375150d640 1 -- 172.21.15.79:0/3145032011 learned_addr learned my addr 172.21.15.79:0/3145032011 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f3750d0c640 1 --2- 172.21.15.79:0/3145032011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f374c06e660 0x7f374c1461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f374bfff640 1 --2- 172.21.15.79:0/3145032011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f374c15bc10 0x7f374c15f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f375150d640 1 -- 172.21.15.79:0/3145032011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f374c06e660 msgr2=0x7f374c1461e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f375150d640 1 --2- 172.21.15.79:0/3145032011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f374c06e660 0x7f374c1461e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f375150d640 1 -- 172.21.15.79:0/3145032011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f374c15bc10 msgr2=0x7f374c15f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f375150d640 1 --2- 172.21.15.79:0/3145032011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f374c15bc10 0x7f374c15f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f375150d640 1 -- 172.21.15.79:0/3145032011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374c146720 con 0x7f374c15bff0 2024-04-25T02:08:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f374bfff640 1 --2- 172.21.15.79:0/3145032011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f374c15bc10 0x7f374c15f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f375150d640 1 --2- 172.21.15.79:0/3145032011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f374c15bff0 0x7f374c145690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f374402abc0 tx=0x7f3744004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:12.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f37497fa640 1 -- 172.21.15.79:0/3145032011 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374403f070 con 0x7f374c15bff0 2024-04-25T02:08:12.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f37497fa640 1 -- 172.21.15.79:0/3145032011 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3744030b60 con 0x7f374c15bff0 2024-04-25T02:08:12.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f3752f70640 1 -- 172.21.15.79:0/3145032011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f374c160630 con 0x7f374c15bff0 2024-04-25T02:08:12.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f37497fa640 1 -- 172.21.15.79:0/3145032011 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3744009450 con 0x7f374c15bff0 2024-04-25T02:08:12.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.299+0000 7f3752f70640 1 -- 172.21.15.79:0/3145032011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f374c154f40 con 0x7f374c15bff0 2024-04-25T02:08:12.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.301+0000 7f37497fa640 1 -- 172.21.15.79:0/3145032011 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f374403b410 con 0x7f374c15bff0 2024-04-25T02:08:12.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.301+0000 7f37497fa640 1 --2- 172.21.15.79:0/3145032011 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f373006be30 0x7f373006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.301+0000 7f37497fa640 1 -- 172.21.15.79:0/3145032011 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f37440ac440 con 0x7f374c15bff0 2024-04-25T02:08:12.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.301+0000 7f3750d0c640 1 --2- 172.21.15.79:0/3145032011 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f373006be30 0x7f373006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.301+0000 7f3750d0c640 1 --2- 172.21.15.79:0/3145032011 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f373006be30 0x7f373006e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3740006fd0 tx=0x7f3740008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:12.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.302+0000 7f3755922740 1 Processor -- start 2024-04-25T02:08:12.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.302+0000 7f3755922740 1 -- start start 2024-04-25T02:08:12.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f3755922740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1bcb60 0x55bfdd16f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f3755922740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd19fc80 0x55bfdd19f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f3755922740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd19f540 0x55bfdd174350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f3755922740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bfdd0d7f00 con 0x55bfdd19f540 2024-04-25T02:08:12.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f3755922740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bfdd080750 con 0x55bfdd19fc80 2024-04-25T02:08:12.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f3755922740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55bfdd0d3ec0 con 0x55bfdd1bcb60 2024-04-25T02:08:12.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f375150d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd19f540 0x55bfdd174350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f375150d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd19f540 0x55bfdd174350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35402/0 (socket says 172.21.15.79:35402) 2024-04-25T02:08:12.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f375150d640 1 -- 172.21.15.79:0/611749878 learned_addr learned my addr 172.21.15.79:0/611749878 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:12.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f3750d0c640 1 --2- 172.21.15.79:0/611749878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1bcb60 0x55bfdd16f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f374bfff640 1 --2- 172.21.15.79:0/611749878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd19fc80 0x55bfdd19f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f375150d640 1 -- 172.21.15.79:0/611749878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1bcb60 msgr2=0x55bfdd16f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:12.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f375150d640 1 --2- 172.21.15.79:0/611749878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1bcb60 0x55bfdd16f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f375150d640 1 -- 172.21.15.79:0/611749878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd19fc80 msgr2=0x55bfdd19f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:12.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f375150d640 1 --2- 172.21.15.79:0/611749878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd19fc80 0x55bfdd19f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f375150d640 1 -- 172.21.15.79:0/611749878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfdcdec2d0 con 0x55bfdd19f540 2024-04-25T02:08:12.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f375150d640 1 --2- 172.21.15.79:0/611749878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd19f540 0x55bfdd174350 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f37440aa990 tx=0x7f374407aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5515499ffcd5861f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:12.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f37367fc640 1 -- 172.21.15.79:0/611749878 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37440832d0 con 0x55bfdd19f540 2024-04-25T02:08:12.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f37367fc640 1 -- 172.21.15.79:0/611749878 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3744031700 con 0x55bfdd19f540 2024-04-25T02:08:12.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.303+0000 7f37367fc640 1 -- 172.21.15.79:0/611749878 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3744076d60 con 0x55bfdd19f540 2024-04-25T02:08:12.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.304+0000 7f3755922740 1 -- 172.21.15.79:0/611749878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd19f540 msgr2=0x55bfdd174350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.304+0000 7f3755922740 1 --2- 172.21.15.79:0/611749878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd19f540 0x55bfdd174350 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f37440aa990 tx=0x7f374407aeb0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.304+0000 7f3755922740 1 -- 172.21.15.79:0/611749878 shutdown_connections 2024-04-25T02:08:12.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.304+0000 7f3755922740 1 --2- 172.21.15.79:0/611749878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd19f540 0x55bfdd174350 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.304+0000 7f3755922740 1 --2- 172.21.15.79:0/611749878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd19fc80 0x55bfdd19f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.304+0000 7f3755922740 1 --2- 172.21.15.79:0/611749878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1bcb60 0x55bfdd16f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.304+0000 7f3755922740 1 -- 172.21.15.79:0/611749878 >> 172.21.15.79:0/611749878 conn(0x55bfdd171760 msgr2=0x55bfdd1ba000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:12.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.304+0000 7f3755922740 1 -- 172.21.15.79:0/611749878 shutdown_connections 2024-04-25T02:08:12.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.304+0000 7f3755922740 1 -- 172.21.15.79:0/611749878 wait complete. 2024-04-25T02:08:12.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.304+0000 7f3755922740 1 -- start start 2024-04-25T02:08:12.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.305+0000 7f3755922740 1 Processor -- start 2024-04-25T02:08:12.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.305+0000 7f3755922740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd19fc80 0x55bfdd18fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.305+0000 7f3755922740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1bcb60 0x55bfdd1ca250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.305+0000 7f3755922740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd1ca790 0x55bfdd1bb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.305+0000 7f3755922740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bfdd0d7f00 con 0x55bfdd1bcb60 2024-04-25T02:08:12.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.305+0000 7f3755922740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bfdd093cf0 con 0x55bfdd1ca790 2024-04-25T02:08:12.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.305+0000 7f3755922740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55bfdd173910 con 0x55bfdd19fc80 2024-04-25T02:08:12.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.305+0000 7f374bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1bcb60 0x55bfdd1ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.305+0000 7f3755922740 10 client.0 _ll_register_callbacks cb 0x55bfdd0936e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:08:12.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f374bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1bcb60 0x55bfdd1ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35404/0 (socket says 172.21.15.79:35404) 2024-04-25T02:08:12.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f374bfff640 1 -- 172.21.15.79:0/1961419118 learned_addr learned my addr 172.21.15.79:0/1961419118 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:12.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f3750d0c640 1 --2- 172.21.15.79:0/1961419118 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd19fc80 0x55bfdd18fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f375150d640 1 --2- 172.21.15.79:0/1961419118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd1ca790 0x55bfdd1bb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f374bfff640 1 -- 172.21.15.79:0/1961419118 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd19fc80 msgr2=0x55bfdd18fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:12.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f374bfff640 1 --2- 172.21.15.79:0/1961419118 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd19fc80 0x55bfdd18fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f374bfff640 1 -- 172.21.15.79:0/1961419118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd1ca790 msgr2=0x55bfdd1bb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:12.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f374bfff640 1 --2- 172.21.15.79:0/1961419118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd1ca790 0x55bfdd1bb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f374bfff640 1 -- 172.21.15.79:0/1961419118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfdceb66b0 con 0x55bfdd1bcb60 2024-04-25T02:08:12.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f375150d640 1 --2- 172.21.15.79:0/1961419118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd1ca790 0x55bfdd1bb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:12.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f374bfff640 1 --2- 172.21.15.79:0/1961419118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1bcb60 0x55bfdd1ca250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f37380076d0 tx=0x7f37380014f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea92d622f2356bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:12.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f372b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:08:12.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f372b7fe640 1 -- 172.21.15.79:0/1961419118 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37380133f0 con 0x55bfdd1bcb60 2024-04-25T02:08:12.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f372b7fe640 1 -- 172.21.15.79:0/1961419118 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3738013590 con 0x55bfdd1bcb60 2024-04-25T02:08:12.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f3755922740 1 -- 172.21.15.79:0/1961419118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3744031700 con 0x55bfdd1bcb60 2024-04-25T02:08:12.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f372b7fe640 1 -- 172.21.15.79:0/1961419118 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f3738020050 con 0x55bfdd1bcb60 2024-04-25T02:08:12.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f3755922740 10 client.4674 fetch_fsmap learned FSMap version 6 2024-04-25T02:08:12.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f3755922740 1 -- 172.21.15.79:0/1961419118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55bfdd1a0980 con 0x55bfdd1bcb60 2024-04-25T02:08:12.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f372b7fe640 1 -- 172.21.15.79:0/1961419118 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3744031700 con 0x55bfdd1bcb60 2024-04-25T02:08:12.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f372b7fe640 1 -- 172.21.15.79:0/1961419118 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f3738023020 con 0x55bfdd1bcb60 2024-04-25T02:08:12.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f3755922740 10 client.4674 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T02:08:12.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f3755922740 10 client.4674 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:08:12.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.306+0000 7f3755922740 20 client.4674 populate_metadata read hostname 'smithi079' 2024-04-25T02:08:12.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.307+0000 7f3755922740 1 --2- 172.21.15.79:0/1961419118 >> [v2:172.21.15.79:6834/2942986974,v1:172.21.15.79:6837/2942986974] conn(0x55bfdd1b0ec0 0x55bfdd1cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.307+0000 7f3755922740 4 client.4674 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:08:12.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.307+0000 7f3755922740 1 -- 172.21.15.79:0/1961419118 --> [v2:172.21.15.79:6834/2942986974,v1:172.21.15.79:6837/2942986974] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfdd0e5440 con 0x55bfdd1b0ec0 2024-04-25T02:08:12.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.307+0000 7f3750d0c640 1 --2- 172.21.15.79:0/1961419118 >> [v2:172.21.15.79:6834/2942986974,v1:172.21.15.79:6837/2942986974] conn(0x55bfdd1b0ec0 0x55bfdd1cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.307+0000 7f372b7fe640 10 client.4674 ms_handle_connect on v2:172.21.15.79:6834/2942986974 2024-04-25T02:08:12.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.307+0000 7f3750d0c640 1 --2- 172.21.15.79:0/1961419118 >> [v2:172.21.15.79:6834/2942986974,v1:172.21.15.79:6837/2942986974] conn(0x55bfdd1b0ec0 0x55bfdd1cdb20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40ebc744eb20f07d server_cookie=ea659f46c1e4e072 in_seq=0 out_seq=0 2024-04-25T02:08:12.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.307+0000 7f372b7fe640 1 -- 172.21.15.79:0/1961419118 <== mds.0 v2:172.21.15.79:6834/2942986974 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bfdd0e5440 con 0x55bfdd1b0ec0 2024-04-25T02:08:12.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.307+0000 7f372b7fe640 10 client.4674 handle_command_reply: tid=0 2024-04-25T02:08:12.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.307+0000 7f3755922740 1 client.4674 shutdown 2024-04-25T02:08:12.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.308+0000 7f3755922740 1 -- 172.21.15.79:0/1961419118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1bcb60 msgr2=0x55bfdd1ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.308+0000 7f3755922740 1 --2- 172.21.15.79:0/1961419118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1bcb60 0x55bfdd1ca250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f37380076d0 tx=0x7f37380014f0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.308+0000 7f3755922740 1 -- 172.21.15.79:0/1961419118 shutdown_connections 2024-04-25T02:08:12.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.308+0000 7f3755922740 1 --2- 172.21.15.79:0/1961419118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd1ca790 0x55bfdd1bb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.308+0000 7f3755922740 1 --2- 172.21.15.79:0/1961419118 >> [v2:172.21.15.79:6834/2942986974,v1:172.21.15.79:6837/2942986974] conn(0x55bfdd1b0ec0 0x55bfdd1cdb20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.308+0000 7f3755922740 1 --2- 172.21.15.79:0/1961419118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1bcb60 0x55bfdd1ca250 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.308+0000 7f3755922740 1 --2- 172.21.15.79:0/1961419118 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd19fc80 0x55bfdd18fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.308+0000 7f372b7fe640 0 client.4674 ms_handle_reset on v2:172.21.15.79:6834/2942986974 2024-04-25T02:08:12.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.308+0000 7f3755922740 1 -- 172.21.15.79:0/1961419118 >> 172.21.15.79:0/1961419118 conn(0x55bfdd19f540 msgr2=0x55bfdd170230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:12.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.308+0000 7f3755922740 1 -- 172.21.15.79:0/1961419118 shutdown_connections 2024-04-25T02:08:12.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.308+0000 7f3755922740 1 -- 172.21.15.79:0/1961419118 wait complete. 2024-04-25T02:08:12.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.308+0000 7f3755922740 20 client.4674 trim_cache size 0 max 16384 2024-04-25T02:08:12.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.326+0000 7f3755922740 1 Processor -- start 2024-04-25T02:08:12.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.326+0000 7f3755922740 1 -- start start 2024-04-25T02:08:12.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.326+0000 7f3755922740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd19fc80 0x55bfdd1b9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.326+0000 7f3755922740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1bcb60 0x55bfdd170290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.326+0000 7f3755922740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1ca790 0x55bfdd1bc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.326+0000 7f3755922740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f374c1ff920 con 0x55bfdd1bcb60 2024-04-25T02:08:12.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.326+0000 7f3755922740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f374c1fee50 con 0x55bfdd19fc80 2024-04-25T02:08:12.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.326+0000 7f3755922740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f374c1ff2d0 con 0x55bfdd1ca790 2024-04-25T02:08:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.326+0000 7f374bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1bcb60 0x55bfdd170290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.327+0000 7f374bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1bcb60 0x55bfdd170290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35416/0 (socket says 172.21.15.79:35416) 2024-04-25T02:08:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.327+0000 7f374bfff640 1 -- 172.21.15.79:0/2800811208 learned_addr learned my addr 172.21.15.79:0/2800811208 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.327+0000 7f3750d0c640 1 --2- 172.21.15.79:0/2800811208 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd19fc80 0x55bfdd1b9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.327+0000 7f375150d640 1 --2- 172.21.15.79:0/2800811208 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1ca790 0x55bfdd1bc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.327+0000 7f374bfff640 1 -- 172.21.15.79:0/2800811208 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1ca790 msgr2=0x55bfdd1bc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.327+0000 7f374bfff640 1 --2- 172.21.15.79:0/2800811208 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1ca790 0x55bfdd1bc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.327+0000 7f374bfff640 1 -- 172.21.15.79:0/2800811208 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd19fc80 msgr2=0x55bfdd1b9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.327+0000 7f374bfff640 1 --2- 172.21.15.79:0/2800811208 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd19fc80 0x55bfdd1b9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.327+0000 7f374bfff640 1 -- 172.21.15.79:0/2800811208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfdd1728a0 con 0x55bfdd1bcb60 2024-04-25T02:08:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.327+0000 7f374bfff640 1 --2- 172.21.15.79:0/2800811208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1bcb60 0x55bfdd170290 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3738007d00 tx=0x7f373800d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74faf8cf3ddfdab8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.327+0000 7f3735ffb640 1 -- 172.21.15.79:0/2800811208 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3738013e00 con 0x55bfdd1bcb60 2024-04-25T02:08:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.327+0000 7f3735ffb640 1 -- 172.21.15.79:0/2800811208 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3738018070 con 0x55bfdd1bcb60 2024-04-25T02:08:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.327+0000 7f3735ffb640 1 -- 172.21.15.79:0/2800811208 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3738013610 con 0x55bfdd1bcb60 2024-04-25T02:08:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.327+0000 7f3755922740 1 -- 172.21.15.79:0/2800811208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1bcb60 msgr2=0x55bfdd170290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.328+0000 7f3755922740 1 --2- 172.21.15.79:0/2800811208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1bcb60 0x55bfdd170290 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3738007d00 tx=0x7f373800d000 comp rx=0 tx=0).stop 2024-04-25T02:08:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.328+0000 7f3755922740 1 -- 172.21.15.79:0/2800811208 shutdown_connections 2024-04-25T02:08:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.328+0000 7f3755922740 1 --2- 172.21.15.79:0/2800811208 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1ca790 0x55bfdd1bc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.328+0000 7f3755922740 1 --2- 172.21.15.79:0/2800811208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1bcb60 0x55bfdd170290 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.328+0000 7f3755922740 1 --2- 172.21.15.79:0/2800811208 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd19fc80 0x55bfdd1b9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.328+0000 7f3755922740 1 -- 172.21.15.79:0/2800811208 >> 172.21.15.79:0/2800811208 conn(0x55bfdd19f540 msgr2=0x55bfdd1a2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.328+0000 7f3755922740 1 -- 172.21.15.79:0/2800811208 shutdown_connections 2024-04-25T02:08:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.328+0000 7f3755922740 1 -- 172.21.15.79:0/2800811208 wait complete. 2024-04-25T02:08:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.328+0000 7f3755922740 1 -- start start 2024-04-25T02:08:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.328+0000 7f3755922740 1 Processor -- start 2024-04-25T02:08:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f3755922740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd19fc80 0x55bfdd199a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f3755922740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1bcb60 0x55bfdd199f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f3755922740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1ca790 0x55bfdd1b8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f3755922740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bfdd1b0d40 con 0x55bfdd1ca790 2024-04-25T02:08:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f3755922740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bfdd1a1240 con 0x55bfdd19fc80 2024-04-25T02:08:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f3755922740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55bfdd1b1390 con 0x55bfdd1bcb60 2024-04-25T02:08:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f3755922740 10 client.0 _ll_register_callbacks cb 0x7f3738007280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:08:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f375150d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1ca790 0x55bfdd1b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f375150d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1ca790 0x55bfdd1b8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35424/0 (socket says 172.21.15.79:35424) 2024-04-25T02:08:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f375150d640 1 -- 172.21.15.79:0/3723019381 learned_addr learned my addr 172.21.15.79:0/3723019381 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f3750d0c640 1 --2- 172.21.15.79:0/3723019381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd19fc80 0x55bfdd199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f374bfff640 1 --2- 172.21.15.79:0/3723019381 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1bcb60 0x55bfdd199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f375150d640 1 -- 172.21.15.79:0/3723019381 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1bcb60 msgr2=0x55bfdd199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:12.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f375150d640 1 --2- 172.21.15.79:0/3723019381 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1bcb60 0x55bfdd199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f375150d640 1 -- 172.21.15.79:0/3723019381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd19fc80 msgr2=0x55bfdd199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:12.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f375150d640 1 --2- 172.21.15.79:0/3723019381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd19fc80 0x55bfdd199a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f375150d640 1 -- 172.21.15.79:0/3723019381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfdd1b0a10 con 0x55bfdd1ca790 2024-04-25T02:08:12.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.329+0000 7f374bfff640 1 --2- 172.21.15.79:0/3723019381 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1bcb60 0x55bfdd199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:12.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f375150d640 1 --2- 172.21.15.79:0/3723019381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1ca790 0x55bfdd1b8450 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f374407afa0 tx=0x7f3744033040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e624cec35c8b9b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:12.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f372b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:08:12.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f372b7fe640 1 -- 172.21.15.79:0/3723019381 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37440832d0 con 0x55bfdd1ca790 2024-04-25T02:08:12.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f372b7fe640 1 -- 172.21.15.79:0/3723019381 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f37440ac0c0 con 0x55bfdd1ca790 2024-04-25T02:08:12.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f3755922740 1 -- 172.21.15.79:0/3723019381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3738018070 con 0x55bfdd1ca790 2024-04-25T02:08:12.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f372b7fe640 1 -- 172.21.15.79:0/3723019381 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f37440433c0 con 0x55bfdd1ca790 2024-04-25T02:08:12.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f3755922740 10 client.4680 fetch_fsmap learned FSMap version 6 2024-04-25T02:08:12.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f3755922740 1 -- 172.21.15.79:0/3723019381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55bfdd1b2560 con 0x55bfdd1ca790 2024-04-25T02:08:12.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f372b7fe640 1 -- 172.21.15.79:0/3723019381 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3738018070 con 0x55bfdd1ca790 2024-04-25T02:08:12.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f372b7fe640 1 -- 172.21.15.79:0/3723019381 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f374407a950 con 0x55bfdd1ca790 2024-04-25T02:08:12.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f3755922740 10 client.4680 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T02:08:12.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f3755922740 10 client.4680 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:08:12.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f3755922740 20 client.4680 populate_metadata read hostname 'smithi079' 2024-04-25T02:08:12.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f3755922740 1 --2- 172.21.15.79:0/3723019381 >> [v2:172.21.15.79:6834/2942986974,v1:172.21.15.79:6837/2942986974] conn(0x55bfdd1b8df0 0x55bfdd1af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f3755922740 4 client.4680 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:08:12.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f3755922740 1 -- 172.21.15.79:0/3723019381 --> [v2:172.21.15.79:6834/2942986974,v1:172.21.15.79:6837/2942986974] -- command(tid 0: {"prefix": "status"}) -- 0x55bfdd0df790 con 0x55bfdd1b8df0 2024-04-25T02:08:12.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f3750d0c640 1 --2- 172.21.15.79:0/3723019381 >> [v2:172.21.15.79:6834/2942986974,v1:172.21.15.79:6837/2942986974] conn(0x55bfdd1b8df0 0x55bfdd1af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f372b7fe640 10 client.4680 ms_handle_connect on v2:172.21.15.79:6834/2942986974 2024-04-25T02:08:12.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.330+0000 7f3750d0c640 1 --2- 172.21.15.79:0/3723019381 >> [v2:172.21.15.79:6834/2942986974,v1:172.21.15.79:6837/2942986974] conn(0x55bfdd1b8df0 0x55bfdd1af990 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fc3c5ae7cc0243c server_cookie=d39d811d449cd495 in_seq=0 out_seq=0 2024-04-25T02:08:12.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f372b7fe640 1 -- 172.21.15.79:0/3723019381 <== mds.0 v2:172.21.15.79:6834/2942986974 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55bfdd0df790 con 0x55bfdd1b8df0 2024-04-25T02:08:12.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f372b7fe640 10 client.4680 handle_command_reply: tid=0 2024-04-25T02:08:12.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3755922740 1 client.4680 shutdown 2024-04-25T02:08:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3755922740 1 -- 172.21.15.79:0/3723019381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1ca790 msgr2=0x55bfdd1b8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3755922740 1 --2- 172.21.15.79:0/3723019381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1ca790 0x55bfdd1b8450 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f374407afa0 tx=0x7f3744033040 comp rx=0 tx=0).stop 2024-04-25T02:08:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3755922740 1 -- 172.21.15.79:0/3723019381 shutdown_connections 2024-04-25T02:08:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3755922740 1 --2- 172.21.15.79:0/3723019381 >> [v2:172.21.15.79:6834/2942986974,v1:172.21.15.79:6837/2942986974] conn(0x55bfdd1b8df0 0x55bfdd1af990 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3755922740 1 --2- 172.21.15.79:0/3723019381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfdd1ca790 0x55bfdd1b8450 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f372b7fe640 0 client.4680 ms_handle_reset on v2:172.21.15.79:6834/2942986974 2024-04-25T02:08:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3755922740 1 --2- 172.21.15.79:0/3723019381 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bfdd1bcb60 0x55bfdd199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3755922740 1 --2- 172.21.15.79:0/3723019381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfdd19fc80 0x55bfdd199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3755922740 1 -- 172.21.15.79:0/3723019381 >> 172.21.15.79:0/3723019381 conn(0x55bfdd19f540 msgr2=0x55bfdd1a2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3755922740 1 -- 172.21.15.79:0/3723019381 shutdown_connections 2024-04-25T02:08:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3755922740 1 -- 172.21.15.79:0/3723019381 wait complete. 2024-04-25T02:08:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3755922740 20 client.4680 trim_cache size 0 max 16384 2024-04-25T02:08:12.346 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:08:12.346 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "696648c4-3e52-400b-a780-2e8863c56c42", 2024-04-25T02:08:12.346 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-04-25T02:08:12.346 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4287, 2024-04-25T02:08:12.346 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-04-25T02:08:12.346 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-04-25T02:08:12.346 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-04-25T02:08:12.346 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 12.221164881, 2024-04-25T02:08:12.346 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 6, 2024-04-25T02:08:12.346 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 21, 2024-04-25T02:08:12.346 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 21, 2024-04-25T02:08:12.347 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 19.624206060999999 2024-04-25T02:08:12.347 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:08:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3752f70640 1 -- 172.21.15.79:0/3145032011 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f373006be30 msgr2=0x7f373006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3752f70640 1 --2- 172.21.15.79:0/3145032011 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f373006be30 0x7f373006e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3740006fd0 tx=0x7f3740008040 comp rx=0 tx=0).stop 2024-04-25T02:08:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3752f70640 1 -- 172.21.15.79:0/3145032011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f374c15bff0 msgr2=0x7f374c145690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.331+0000 7f3752f70640 1 --2- 172.21.15.79:0/3145032011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f374c15bff0 0x7f374c145690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f374402abc0 tx=0x7f3744004a40 comp rx=0 tx=0).stop 2024-04-25T02:08:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.332+0000 7f3752f70640 1 -- 172.21.15.79:0/3145032011 shutdown_connections 2024-04-25T02:08:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.332+0000 7f3752f70640 1 --2- 172.21.15.79:0/3145032011 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f373006be30 0x7f373006e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.332+0000 7f3752f70640 1 --2- 172.21.15.79:0/3145032011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f374c15bff0 0x7f374c145690 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.332+0000 7f3752f70640 1 --2- 172.21.15.79:0/3145032011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f374c15bc10 0x7f374c15f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.332+0000 7f3752f70640 1 --2- 172.21.15.79:0/3145032011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f374c06e660 0x7f374c1461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.332+0000 7f3752f70640 1 -- 172.21.15.79:0/3145032011 >> 172.21.15.79:0/3145032011 conn(0x7f374c0cfc80 msgr2=0x7f374c0b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.332+0000 7f3752f70640 1 -- 172.21.15.79:0/3145032011 shutdown_connections 2024-04-25T02:08:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.332+0000 7f3752f70640 1 -- 172.21.15.79:0/3145032011 wait complete. 2024-04-25T02:08:12.349 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T02:08:12.361 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T02:08:12.361 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T02:08:12.362 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T02:08:12.362 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T02:08:12.384 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T02:08:12.385 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-25T02:08:12.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:12.385 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:08:12.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:12.400 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-04-25T02:08:12.464 INFO:teuthology.orchestra.run.smithi079.stderr:Cannot find device "ceph-brx" 2024-04-25T02:08:12.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:08:12.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:12.466 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:08:12.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:12.521 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-04-25T02:08:12.586 INFO:teuthology.orchestra.run.smithi079.stderr:Cannot find device "ceph-brx" 2024-04-25T02:08:12.587 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:08:12.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:12.587 DEBUG:teuthology.orchestra.run.smithi189:> ip netns list 2024-04-25T02:08:12.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:12.606 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link delete ceph-brx 2024-04-25T02:08:12.676 INFO:teuthology.orchestra.run.smithi189.stderr:Cannot find device "ceph-brx" 2024-04-25T02:08:12.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:08:12.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:12.678 DEBUG:teuthology.orchestra.run.smithi189:> ip netns list 2024-04-25T02:08:12.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:12.735 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link delete ceph-brx 2024-04-25T02:08:12.802 INFO:teuthology.orchestra.run.smithi189.stderr:Cannot find device "ceph-brx" 2024-04-25T02:08:12.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:08:12.804 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-25T02:08:12.804 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T02:08:12.804 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:08:12.804 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:08:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.895+0000 7fcc9e058640 1 Processor -- start 2024-04-25T02:08:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.895+0000 7fcc9e058640 1 -- start start 2024-04-25T02:08:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.896+0000 7fcc9e058640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcc9806e3b0 0x7fcc980b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.896+0000 7fcc9e058640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc98071e00 con 0x7fcc9806df50 2024-04-25T02:08:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.896+0000 7fcc9e058640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc980720a0 con 0x7fcc98143bc0 2024-04-25T02:08:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.896+0000 7fcc9e058640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fcc98072cb0 con 0x7fcc9806e3b0 2024-04-25T02:08:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.896+0000 7fcc97fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcc9806e3b0 0x7fcc980b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.896+0000 7fcc96ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcc9806df50 0x7fcc980b2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47898/0 (socket says 172.21.15.79:47898) 2024-04-25T02:08:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.896+0000 7fcc96ffd640 1 -- 172.21.15.79:0/2018299299 learned_addr learned my addr 172.21.15.79:0/2018299299 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.896+0000 7fcc97fff640 1 -- 172.21.15.79:0/2018299299 >> v1:172.21.15.189:6789/0 conn(0x7fcc98143bc0 legacy=0x7fcc9815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.896+0000 7fcc97fff640 1 -- 172.21.15.79:0/2018299299 >> v1:172.21.15.79:6789/0 conn(0x7fcc9806df50 legacy=0x7fcc980b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.896+0000 7fcc97fff640 1 -- 172.21.15.79:0/2018299299 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc98072380 con 0x7fcc9806e3b0 2024-04-25T02:08:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.896+0000 7fcc967fc640 1 -- 172.21.15.79:0/2018299299 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1562399541 0 0) 0x7fcc98071e00 con 0x7fcc9806df50 2024-04-25T02:08:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.897+0000 7fcc97fff640 1 --2- 172.21.15.79:0/2018299299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc9806e3b0 0x7fcc980b3440 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009d90 tx=0x7fcc9002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d6baefcfbda42a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.897+0000 7fcc967fc640 1 -- 172.21.15.79:0/2018299299 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc90007740 con 0x7fcc9806e3b0 2024-04-25T02:08:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.897+0000 7fcc967fc640 1 -- 172.21.15.79:0/2018299299 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc900078e0 con 0x7fcc9806e3b0 2024-04-25T02:08:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.897+0000 7fcc967fc640 1 -- 172.21.15.79:0/2018299299 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc90007cb0 con 0x7fcc9806e3b0 2024-04-25T02:08:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.898+0000 7fcc9e058640 1 -- 172.21.15.79:0/2018299299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc9806e3b0 msgr2=0x7fcc980b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.898+0000 7fcc9e058640 1 --2- 172.21.15.79:0/2018299299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc9806e3b0 0x7fcc980b3440 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009d90 tx=0x7fcc9002a660 comp rx=0 tx=0).stop 2024-04-25T02:08:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.898+0000 7fcc9e058640 1 -- 172.21.15.79:0/2018299299 shutdown_connections 2024-04-25T02:08:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.898+0000 7fcc9e058640 1 --2- 172.21.15.79:0/2018299299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc9806e3b0 0x7fcc980b3440 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.898+0000 7fcc9e058640 1 -- 172.21.15.79:0/2018299299 >> 172.21.15.79:0/2018299299 conn(0x7fcc980cfc80 msgr2=0x7fcc980d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.898+0000 7fcc9e058640 1 -- 172.21.15.79:0/2018299299 shutdown_connections 2024-04-25T02:08:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.898+0000 7fcc9e058640 1 -- 172.21.15.79:0/2018299299 wait complete. 2024-04-25T02:08:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.899+0000 7fcc9e058640 1 Processor -- start 2024-04-25T02:08:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.899+0000 7fcc9e058640 1 -- start start 2024-04-25T02:08:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc9e058640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc9806df50 0x7fcc9813e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc9e058640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc9806e3b0 0x7fcc980a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc9e058640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc98143bc0 0x7fcc9813e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc9e058640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9806e840 con 0x7fcc98143bc0 2024-04-25T02:08:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc9e058640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcc98072940 con 0x7fcc9806e3b0 2024-04-25T02:08:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc9e058640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcc98143fa0 con 0x7fcc9806df50 2024-04-25T02:08:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc97fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc98143bc0 0x7fcc9813e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc97fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc98143bc0 0x7fcc9813e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35444/0 (socket says 172.21.15.79:35444) 2024-04-25T02:08:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc97fff640 1 -- 172.21.15.79:0/3426726909 learned_addr learned my addr 172.21.15.79:0/3426726909 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc96ffd640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc9806e3b0 0x7fcc980a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc977fe640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc9806df50 0x7fcc9813e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc97fff640 1 -- 172.21.15.79:0/3426726909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc9806df50 msgr2=0x7fcc9813e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc97fff640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc9806df50 0x7fcc9813e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc97fff640 1 -- 172.21.15.79:0/3426726909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc9806e3b0 msgr2=0x7fcc980a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc97fff640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc9806e3b0 0x7fcc980a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc97fff640 1 -- 172.21.15.79:0/3426726909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc980a9e60 con 0x7fcc98143bc0 2024-04-25T02:08:12.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc96ffd640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc9806e3b0 0x7fcc980a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:12.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc977fe640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc9806df50 0x7fcc9813e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:12.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.900+0000 7fcc97fff640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc98143bc0 0x7fcc9813e7a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009eb0 tx=0x7fcc90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:12.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.901+0000 7fcc7ffff640 1 -- 172.21.15.79:0/3426726909 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9003f070 con 0x7fcc98143bc0 2024-04-25T02:08:12.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.901+0000 7fcc7ffff640 1 -- 172.21.15.79:0/3426726909 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc90031c90 con 0x7fcc98143bc0 2024-04-25T02:08:12.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.901+0000 7fcc9e058640 1 -- 172.21.15.79:0/3426726909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc980aa140 con 0x7fcc98143bc0 2024-04-25T02:08:12.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.901+0000 7fcc7ffff640 1 -- 172.21.15.79:0/3426726909 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc90043630 con 0x7fcc98143bc0 2024-04-25T02:08:12.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.901+0000 7fcc9e058640 1 -- 172.21.15.79:0/3426726909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc980aa700 con 0x7fcc98143bc0 2024-04-25T02:08:12.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.901+0000 7fcc9e058640 1 -- 172.21.15.79:0/3426726909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc980690a0 con 0x7fcc98143bc0 2024-04-25T02:08:12.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.902+0000 7fcc7ffff640 1 -- 172.21.15.79:0/3426726909 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc9003b410 con 0x7fcc98143bc0 2024-04-25T02:08:12.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.902+0000 7fcc7ffff640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc8406be30 0x7fcc8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.902+0000 7fcc977fe640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc8406be30 0x7fcc8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.902+0000 7fcc7ffff640 1 -- 172.21.15.79:0/3426726909 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcc900ac360 con 0x7fcc98143bc0 2024-04-25T02:08:12.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.903+0000 7fcc977fe640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc8406be30 0x7fcc8406e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcc88007fd0 tx=0x7fcc88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:12.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:12.907+0000 7fcc7ffff640 1 -- 172.21.15.79:0/3426726909 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcc9007ae60 con 0x7fcc98143bc0 2024-04-25T02:08:13.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13.118+0000 7fcc9e058640 1 -- 172.21.15.79:0/3426726909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcc9806c0c0 con 0x7fcc98143bc0 2024-04-25T02:08:13.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13.118+0000 7fcc7ffff640 1 -- 172.21.15.79:0/3426726909 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fcc9007a760 con 0x7fcc98143bc0 2024-04-25T02:08:13.125 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:08:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13.120+0000 7fcc9e058640 1 -- 172.21.15.79:0/3426726909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc8406be30 msgr2=0x7fcc8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13.120+0000 7fcc9e058640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc8406be30 0x7fcc8406e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcc88007fd0 tx=0x7fcc88009040 comp rx=0 tx=0).stop 2024-04-25T02:08:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13.120+0000 7fcc9e058640 1 -- 172.21.15.79:0/3426726909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc98143bc0 msgr2=0x7fcc9813e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13.120+0000 7fcc9e058640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc98143bc0 0x7fcc9813e7a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009eb0 tx=0x7fcc90004a40 comp rx=0 tx=0).stop 2024-04-25T02:08:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13.120+0000 7fcc9e058640 1 -- 172.21.15.79:0/3426726909 shutdown_connections 2024-04-25T02:08:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13.120+0000 7fcc9e058640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc8406be30 0x7fcc8406e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13.120+0000 7fcc9e058640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc98143bc0 0x7fcc9813e7a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13.120+0000 7fcc9e058640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc9806e3b0 0x7fcc980a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13.120+0000 7fcc9e058640 1 --2- 172.21.15.79:0/3426726909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc9806df50 0x7fcc9813e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13.120+0000 7fcc9e058640 1 -- 172.21.15.79:0/3426726909 >> 172.21.15.79:0/3426726909 conn(0x7fcc980cfc80 msgr2=0x7fcc980d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13.120+0000 7fcc9e058640 1 -- 172.21.15.79:0/3426726909 shutdown_connections 2024-04-25T02:08:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13.120+0000 7fcc9e058640 1 -- 172.21.15.79:0/3426726909 wait complete. 2024-04-25T02:08:13.138 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:08:13.138 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:08:13.138 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:08:13.138 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:08:13.138 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:08:13.138 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:08:13.138 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:08:13.138 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:08:13.138 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:08:13.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:13.139 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:08:13.153 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:08:13.153 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:08:13.153 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:08:13.154 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:13.154 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:08:13.154 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:13.154 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:08:13.154 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:13.154 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:08:13.154 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:08:13.154 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:13.154 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:08:13.154 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:08:13.154 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:13.154 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:08:13.154 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:13.154 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:08:13.155 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42713sec preferred_lft 42713sec 2024-04-25T02:08:13.155 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:08:13.155 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:13.155 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T02:08:13.155 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:13.155 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:08:13.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add name ceph-brx type bridge 2024-04-25T02:08:13.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr flush dev ceph-brx 2024-04-25T02:08:13.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set ceph-brx up 2024-04-25T02:08:13.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T02:08:13.156 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:08:13.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:13.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:13.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:13.335 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:08:13.358 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:08:13.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:13.360 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:08:13.426 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:08:13.426 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:08:13.426 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:08:13.426 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:08:13.426 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:08:13.427 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:13.427 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:08:13.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:08:13.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:08:13.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:08:13.427 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:08:13.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:13.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:13.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:13.712 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:08:13.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:13.728 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2024-04-25T02:08:13.782 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:13.783 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:08:13.783 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:08:13.783 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T02:08:13.783 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:08:13.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:13.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:13.899 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T02:08:13.899 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:13.899 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:08:13.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T02:08:13.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T02:08:13.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T02:08:13.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T02:08:13.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T02:08:13.899 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:08:13.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:14.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:14.023 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:14.023 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:08:14.023 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:08:14.023 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T02:08:14.023 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:08:14.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:14.098 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:08:14.099 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:08:14.112 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:08:14.112 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:08:14.113 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:08:14.166 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:08:14.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:14.167 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:08:14.262 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:08:14.262 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:08:14.262 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:08:14.369 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:08:14.369 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:08:14.370 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:08:14.370 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:08:14.370 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:08:14.374 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:08:14.374 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:08:14.375 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:08:14.375 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:08:14.375 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:08:14.375 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:08:14.375 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:08:14.375 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:08:14.375 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:08:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:08:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:08:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:08:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:08:14.377 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:08:14.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:14.377 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:08:14.401 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:08:14.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:08:14.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:14.500 INFO:teuthology.orchestra.run.smithi079.stdout:client4505 2024-04-25T02:08:14.500 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:08:14.501 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:14.515 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:08:14.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:08:14.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:14.614 INFO:teuthology.orchestra.run.smithi079.stdout:client4505 2024-04-25T02:08:14.615 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:08:14.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:08:14.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:14.673 INFO:teuthology.orchestra.run.smithi079.stdout:client4505 2024-04-25T02:08:14.674 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/696648c4-3e52-400b-a780-2e8863c56c42.client4505/status') 2024-04-25T02:08:14.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:14.735 INFO:teuthology.orchestra.run.smithi079.stdout:instance: client.4505 (3)172.21.15.79:0/3272814023 2024-04-25T02:08:14.735 INFO:teuthology.orchestra.run.smithi079.stdout:blocklisted: false 2024-04-25T02:08:14.735 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records in 2024-04-25T02:08:14.736 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records out 2024-04-25T02:08:14.736 INFO:teuthology.orchestra.run.smithi079.stderr:70 bytes copied, 3.8891e-05 s, 1.8 MB/s 2024-04-25T02:08:14.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:14.743 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-25T02:08:14.743 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T02:08:14.743 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T02:08:14.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:08:14.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.833+0000 7f930e3ee640 1 Processor -- start 2024-04-25T02:08:14.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.833+0000 7f930e3ee640 1 -- start start 2024-04-25T02:08:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.833+0000 7f930e3ee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93080d2e20 0x7f93080cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.833+0000 7f930e3ee640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f930806c380 con 0x7f93080b3570 2024-04-25T02:08:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.833+0000 7f930e3ee640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93080d1660 con 0x7f930815e4d0 2024-04-25T02:08:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.833+0000 7f930e3ee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f93080d1380 con 0x7f93080d2e20 2024-04-25T02:08:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f93077fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f93080b3570 0x7f93080d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60056/0 (socket says 172.21.15.79:60056) 2024-04-25T02:08:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f93077fe640 1 -- 172.21.15.79:0/1454928184 learned_addr learned my addr 172.21.15.79:0/1454928184 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f930c98b640 1 --2- 172.21.15.79:0/1454928184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93080d2e20 0x7f93080cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9306ffd640 1 -- 172.21.15.79:0/1454928184 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1376253531 0 0) 0x7f930806c380 con 0x7f93080b3570 2024-04-25T02:08:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9306ffd640 1 -- 172.21.15.79:0/1454928184 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92f0003520 con 0x7f93080b3570 2024-04-25T02:08:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9306ffd640 1 -- 172.21.15.79:0/1454928184 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3203239486 0 0) 0x7f92f0003520 con 0x7f93080b3570 2024-04-25T02:08:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9306ffd640 1 -- 172.21.15.79:0/1454928184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93080d2e20 msgr2=0x7f93080cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9306ffd640 1 --2- 172.21.15.79:0/1454928184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93080d2e20 0x7f93080cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9306ffd640 1 -- 172.21.15.79:0/1454928184 >> v1:172.21.15.189:6789/0 conn(0x7f930815e4d0 legacy=0x7f930806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9306ffd640 1 -- 172.21.15.79:0/1454928184 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93080cede0 con 0x7f93080b3570 2024-04-25T02:08:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9306ffd640 1 -- 172.21.15.79:0/1454928184 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f92fc001670 con 0x7f93080b3570 2024-04-25T02:08:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9306ffd640 1 -- 172.21.15.79:0/1454928184 >> v1:172.21.15.79:6789/0 conn(0x7f93080b3570 legacy=0x7f93080d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9306ffd640 1 --2- 172.21.15.79:0/1454928184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93080d2e20 0x7f92f00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9306ffd640 1 --2- 172.21.15.79:0/1454928184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92f0003f60 0x7f92f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9306ffd640 1 --2- 172.21.15.79:0/1454928184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92f0004d40 0x7f92f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9306ffd640 1 -- 172.21.15.79:0/1454928184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93080d1380 con 0x7f92f0003f60 2024-04-25T02:08:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9306ffd640 1 -- 172.21.15.79:0/1454928184 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92f000baa0 con 0x7f92f0004d40 2024-04-25T02:08:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9306ffd640 1 -- 172.21.15.79:0/1454928184 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f92f000bca0 con 0x7f93080d2e20 2024-04-25T02:08:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f93077fe640 1 --2- 172.21.15.79:0/1454928184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92f0003f60 0x7f92f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f9307fff640 1 --2- 172.21.15.79:0/1454928184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93080d2e20 0x7f92f00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.834+0000 7f930c98b640 1 --2- 172.21.15.79:0/1454928184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92f0004d40 0x7f92f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.835+0000 7f93077fe640 1 -- 172.21.15.79:0/1454928184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93080d2e20 msgr2=0x7f92f00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.835+0000 7f93077fe640 1 --2- 172.21.15.79:0/1454928184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93080d2e20 0x7f92f00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.835+0000 7f93077fe640 1 -- 172.21.15.79:0/1454928184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92f0004d40 msgr2=0x7f92f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.835+0000 7f93077fe640 1 --2- 172.21.15.79:0/1454928184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92f0004d40 0x7f92f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.835+0000 7f93077fe640 1 -- 172.21.15.79:0/1454928184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f0003520 con 0x7f92f0003f60 2024-04-25T02:08:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.835+0000 7f930c98b640 1 --2- 172.21.15.79:0/1454928184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92f0004d40 0x7f92f00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.835+0000 7f93077fe640 1 --2- 172.21.15.79:0/1454928184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92f0003f60 0x7f92f0004800 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00c210 tx=0x7f92f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ad5110209556ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.835+0000 7f9306ffd640 1 -- 172.21.15.79:0/1454928184 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc007d30 con 0x7f92f0003f60 2024-04-25T02:08:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.835+0000 7f9306ffd640 1 -- 172.21.15.79:0/1454928184 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92fc005ad0 con 0x7f92f0003f60 2024-04-25T02:08:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.835+0000 7f9306ffd640 1 -- 172.21.15.79:0/1454928184 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc007070 con 0x7f92f0003f60 2024-04-25T02:08:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.836+0000 7f930e3ee640 1 -- 172.21.15.79:0/1454928184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92f0003f60 msgr2=0x7f92f0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.836+0000 7f930e3ee640 1 --2- 172.21.15.79:0/1454928184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92f0003f60 0x7f92f0004800 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00c210 tx=0x7f92f0005830 comp rx=0 tx=0).stop 2024-04-25T02:08:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.836+0000 7f930c98b640 1 -- 172.21.15.79:0/1454928184 reap_dead start 2024-04-25T02:08:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.836+0000 7f930e3ee640 1 -- 172.21.15.79:0/1454928184 shutdown_connections 2024-04-25T02:08:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.836+0000 7f930e3ee640 1 -- 172.21.15.79:0/1454928184 >> 172.21.15.79:0/1454928184 conn(0x7f930809d460 msgr2=0x7f93080d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:14.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.836+0000 7f930e3ee640 1 -- 172.21.15.79:0/1454928184 shutdown_connections 2024-04-25T02:08:14.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.836+0000 7f930e3ee640 1 -- 172.21.15.79:0/1454928184 wait complete. 2024-04-25T02:08:14.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.837+0000 7f930e3ee640 1 Processor -- start 2024-04-25T02:08:14.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.837+0000 7f930e3ee640 1 -- start start 2024-04-25T02:08:14.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f930e3ee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92f0003f60 0x7f93080c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:14.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f930e3ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081532b0 0x7f9308153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:14.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f930e3ee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f930815fc20 0x7f93081600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f930e3ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93080d20d0 con 0x7f93081532b0 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f930e3ee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f930815e8b0 con 0x7f92f0003f60 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f930e3ee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f93080d2250 con 0x7f930815fc20 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f93077fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081532b0 0x7f9308153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f93077fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081532b0 0x7f9308153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57298/0 (socket says 172.21.15.79:57298) 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f93077fe640 1 -- 172.21.15.79:0/3572296264 learned_addr learned my addr 172.21.15.79:0/3572296264 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f9307fff640 1 --2- 172.21.15.79:0/3572296264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92f0003f60 0x7f93080c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f930c98b640 1 --2- 172.21.15.79:0/3572296264 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f930815fc20 0x7f93081600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f93077fe640 1 -- 172.21.15.79:0/3572296264 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f930815fc20 msgr2=0x7f93081600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f93077fe640 1 --2- 172.21.15.79:0/3572296264 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f930815fc20 0x7f93081600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f93077fe640 1 -- 172.21.15.79:0/3572296264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92f0003f60 msgr2=0x7f93080c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f93077fe640 1 --2- 172.21.15.79:0/3572296264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92f0003f60 0x7f93080c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.838+0000 7f93077fe640 1 -- 172.21.15.79:0/3572296264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9308161510 con 0x7f93081532b0 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.839+0000 7f93077fe640 1 --2- 172.21.15.79:0/3572296264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081532b0 0x7f9308153730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f92fc02ae20 tx=0x7f92fc001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.839+0000 7f9304ff9640 1 -- 172.21.15.79:0/3572296264 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc042020 con 0x7f93081532b0 2024-04-25T02:08:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.839+0000 7f9304ff9640 1 -- 172.21.15.79:0/3572296264 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92fc004bf0 con 0x7f93081532b0 2024-04-25T02:08:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.839+0000 7f930e3ee640 1 -- 172.21.15.79:0/3572296264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9308160990 con 0x7f93081532b0 2024-04-25T02:08:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.839+0000 7f9304ff9640 1 -- 172.21.15.79:0/3572296264 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc007d10 con 0x7f93081532b0 2024-04-25T02:08:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.839+0000 7f930e3ee640 1 -- 172.21.15.79:0/3572296264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9308160f50 con 0x7f93081532b0 2024-04-25T02:08:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.840+0000 7f930e3ee640 1 -- 172.21.15.79:0/3572296264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93080690a0 con 0x7f93081532b0 2024-04-25T02:08:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.840+0000 7f9304ff9640 1 -- 172.21.15.79:0/3572296264 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92fc045020 con 0x7f93081532b0 2024-04-25T02:08:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.841+0000 7f9304ff9640 1 --2- 172.21.15.79:0/3572296264 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f92f406be30 0x7f92f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.841+0000 7f9307fff640 1 --2- 172.21.15.79:0/3572296264 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f92f406be30 0x7f92f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.841+0000 7f9304ff9640 1 -- 172.21.15.79:0/3572296264 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f92fc0ab210 con 0x7f93081532b0 2024-04-25T02:08:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.841+0000 7f9307fff640 1 --2- 172.21.15.79:0/3572296264 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f92f406be30 0x7f92f406e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f92f80035f0 tx=0x7f92f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:14.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:14.845+0000 7f9304ff9640 1 -- 172.21.15.79:0/3572296264 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f92fc04c070 con 0x7f93081532b0 2024-04-25T02:08:15.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15.054+0000 7f930e3ee640 1 -- 172.21.15.79:0/3572296264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f93080d1920 con 0x7f93081532b0 2024-04-25T02:08:15.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15.054+0000 7f9304ff9640 1 -- 172.21.15.79:0/3572296264 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f92fc079d30 con 0x7f93081532b0 2024-04-25T02:08:15.061 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:08:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15.056+0000 7f930e3ee640 1 -- 172.21.15.79:0/3572296264 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f92f406be30 msgr2=0x7f92f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15.056+0000 7f930e3ee640 1 --2- 172.21.15.79:0/3572296264 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f92f406be30 0x7f92f406e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f92f80035f0 tx=0x7f92f8009040 comp rx=0 tx=0).stop 2024-04-25T02:08:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15.056+0000 7f930e3ee640 1 -- 172.21.15.79:0/3572296264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081532b0 msgr2=0x7f9308153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15.056+0000 7f930e3ee640 1 --2- 172.21.15.79:0/3572296264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081532b0 0x7f9308153730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f92fc02ae20 tx=0x7f92fc001a40 comp rx=0 tx=0).stop 2024-04-25T02:08:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15.056+0000 7f930e3ee640 1 -- 172.21.15.79:0/3572296264 shutdown_connections 2024-04-25T02:08:15.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15.056+0000 7f930e3ee640 1 --2- 172.21.15.79:0/3572296264 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f92f406be30 0x7f92f406e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:15.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15.056+0000 7f930e3ee640 1 --2- 172.21.15.79:0/3572296264 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f930815fc20 0x7f93081600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:15.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15.056+0000 7f930e3ee640 1 --2- 172.21.15.79:0/3572296264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081532b0 0x7f9308153730 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:15.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15.056+0000 7f930e3ee640 1 --2- 172.21.15.79:0/3572296264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92f0003f60 0x7f93080c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:15.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15.056+0000 7f930e3ee640 1 -- 172.21.15.79:0/3572296264 >> 172.21.15.79:0/3572296264 conn(0x7f930809d460 msgr2=0x7f93080b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:15.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15.056+0000 7f930e3ee640 1 -- 172.21.15.79:0/3572296264 shutdown_connections 2024-04-25T02:08:15.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15.056+0000 7f930e3ee640 1 -- 172.21.15.79:0/3572296264 wait complete. 2024-04-25T02:08:15.074 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:08:15.074 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:08:15.074 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:08:15.074 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-25T02:08:15.074 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T02:08:15.074 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:08:15.074 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:08:15.074 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:08:15.074 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-25T02:08:15.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:15.075 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:08:15.089 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:08:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:08:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:08:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:08:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:15.090 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:08:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:08:15.090 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:08:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:08:15.090 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:08:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:15.090 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:08:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:08:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42711sec preferred_lft 42711sec 2024-04-25T02:08:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:08:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:15.091 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:08:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:08:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:08:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:15.091 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:08:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:08:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link tentative 2024-04-25T02:08:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:15.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:15.092 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:08:15.151 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:08:15.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:15.153 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:08:15.209 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:08:15.209 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:08:15.210 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:08:15.210 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:08:15.210 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:08:15.210 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:15.210 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:08:15.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:08:15.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:08:15.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:08:15.210 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:08:15.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:15.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:15.332 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:08:15.347 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:08:15.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:15.347 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2024-04-25T02:08:15.401 INFO:teuthology.orchestra.run.smithi079.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-25T02:08:15.401 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:15.401 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:08:15.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:08:15.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-25T02:08:15.401 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:08:15.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:15.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:15.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:15.515 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T02:08:15.537 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:08:15.537 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:08:15.537 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:08:15.538 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:15.538 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:08:15.538 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:15.538 INFO:teuthology.orchestra.run.smithi079.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:08:15.538 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether c6:74:f3:f2:4f:4b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T02:08:15.538 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T02:08:15.538 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:15.538 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::c474:f3ff:fef2:4f4b/64 scope link tentative 2024-04-25T02:08:15.538 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:15.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:15.539 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T02:08:15.603 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:08:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:08:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:08:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:08:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:15.603 INFO:teuthology.orchestra.run.smithi079.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:08:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether c6:74:f3:f2:4f:4b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T02:08:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T02:08:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::c474:f3ff:fef2:4f4b/64 scope link tentative 2024-04-25T02:08:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:15.605 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-25T02:08:15.605 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:15.605 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:08:15.605 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-25T02:08:15.605 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T02:08:15.605 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-25T02:08:15.605 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-25T02:08:15.606 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-25T02:08:15.606 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:08:15.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:15.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:15.751 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:15.752 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:08:15.752 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.1 up 2024-04-25T02:08:15.752 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T02:08:15.752 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:08:15.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:15.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:15.825 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:08:15.825 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-25T02:08:15.839 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-25T02:08:15.840 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:08:15.840 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-25T02:08:15.893 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:08:15.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:15.894 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T02:08:15.974 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T02:08:15.974 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T02:08:15.974 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:08:15.982 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T02:08:15.982 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T02:08:15.982 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:08:15.983 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:08:15.983 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:08:15.987 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T02:08:15.988 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T02:08:15.988 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:08:15.988 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:08:15.988 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:08:15.988 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:08:15.988 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:08:15.988 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:08:15.988 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-25T02:08:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:08:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:08:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:08:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:08:15.990 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:08:15.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:15.990 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-25T02:08:16.053 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:08:16.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:08:16.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:16.150 INFO:teuthology.orchestra.run.smithi079.stdout:client4514 2024-04-25T02:08:16.151 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:08:16.151 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:16.166 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:08:16.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:08:16.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:16.262 INFO:teuthology.orchestra.run.smithi079.stdout:client4514 2024-04-25T02:08:16.262 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:08:16.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:08:16.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:16.317 INFO:teuthology.orchestra.run.smithi079.stdout:client4514 2024-04-25T02:08:16.317 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/696648c4-3e52-400b-a780-2e8863c56c42.client4514/status') 2024-04-25T02:08:16.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:16.373 INFO:teuthology.orchestra.run.smithi079.stdout:instance: client.4514 (3)172.21.15.79:0/902167155 2024-04-25T02:08:16.374 INFO:teuthology.orchestra.run.smithi079.stdout:blocklisted: false 2024-04-25T02:08:16.374 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records in 2024-04-25T02:08:16.374 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records out 2024-04-25T02:08:16.374 INFO:teuthology.orchestra.run.smithi079.stderr:69 bytes copied, 2.2307e-05 s, 3.1 MB/s 2024-04-25T02:08:16.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:16.381 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-25T02:08:16.381 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T02:08:16.381 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T02:08:16.381 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:08:16.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.470+0000 7f79e7272640 1 Processor -- start 2024-04-25T02:08:16.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.471+0000 7f79e7272640 1 -- start start 2024-04-25T02:08:16.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.471+0000 7f79e7272640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79e015e4d0 0x7f79e006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:16.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.471+0000 7f79e7272640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f79e00b3570 0x7f79e00d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:16.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.471+0000 7f79e7272640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79e00d1660 con 0x7f79e00b3020 2024-04-25T02:08:16.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.471+0000 7f79e7272640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f79e00d1380 con 0x7f79e00b3570 2024-04-25T02:08:16.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.471+0000 7f79e7272640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f79e00cede0 con 0x7f79e015e4d0 2024-04-25T02:08:16.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79e580f640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f79e00b3020 0x7f79e00cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60068/0 (socket says 172.21.15.79:60068) 2024-04-25T02:08:16.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79e580f640 1 -- 172.21.15.79:0/1165870597 learned_addr learned my addr 172.21.15.79:0/1165870597 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:16.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79e500e640 1 --2- 172.21.15.79:0/1165870597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79e015e4d0 0x7f79e006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79e480d640 1 --2- 172.21.15.79:0/1165870597 >> v2:172.21.15.189:3300/0 conn(0x7f79e00b3570 0x7f79e00d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 -- 172.21.15.79:0/1165870597 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300872973 0 0) 0x7f79e00d1660 con 0x7f79e00b3020 2024-04-25T02:08:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 -- 172.21.15.79:0/1165870597 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79cc003520 con 0x7f79e00b3020 2024-04-25T02:08:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 -- 172.21.15.79:0/1165870597 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3663851431 0 0) 0x7f79cc003520 con 0x7f79e00b3020 2024-04-25T02:08:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 -- 172.21.15.79:0/1165870597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79e015e4d0 msgr2=0x7f79e006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 --2- 172.21.15.79:0/1165870597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79e015e4d0 0x7f79e006bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 -- 172.21.15.79:0/1165870597 >> v2:172.21.15.189:3300/0 conn(0x7f79e00b3570 msgr2=0x7f79e00d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 --2- 172.21.15.79:0/1165870597 >> v2:172.21.15.189:3300/0 conn(0x7f79e00b3570 0x7f79e00d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 -- 172.21.15.79:0/1165870597 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e00cf0c0 con 0x7f79e00b3020 2024-04-25T02:08:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 -- 172.21.15.79:0/1165870597 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f79d80019f0 con 0x7f79e00b3020 2024-04-25T02:08:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 -- 172.21.15.79:0/1165870597 >> v1:172.21.15.79:6789/0 conn(0x7f79e00b3020 legacy=0x7f79e00cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 --2- 172.21.15.79:0/1165870597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79cc0039b0 0x7f79cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 --2- 172.21.15.79:0/1165870597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79e015e4d0 0x7f79cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 --2- 172.21.15.79:0/1165870597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79cc004d40 0x7f79cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 -- 172.21.15.79:0/1165870597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f79e00d1380 con 0x7f79cc004d40 2024-04-25T02:08:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 -- 172.21.15.79:0/1165870597 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f79e00cede0 con 0x7f79cc0039b0 2024-04-25T02:08:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79d7fff640 1 -- 172.21.15.79:0/1165870597 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f79cc00b9c0 con 0x7f79e015e4d0 2024-04-25T02:08:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79e580f640 1 --2- 172.21.15.79:0/1165870597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79cc004d40 0x7f79cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79e500e640 1 --2- 172.21.15.79:0/1165870597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79cc0039b0 0x7f79cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.472+0000 7f79e480d640 1 --2- 172.21.15.79:0/1165870597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79e015e4d0 0x7f79cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.473+0000 7f79e580f640 1 -- 172.21.15.79:0/1165870597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79e015e4d0 msgr2=0x7f79cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.473+0000 7f79e580f640 1 --2- 172.21.15.79:0/1165870597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79e015e4d0 0x7f79cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.473+0000 7f79e580f640 1 -- 172.21.15.79:0/1165870597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79cc0039b0 msgr2=0x7f79cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.473+0000 7f79e580f640 1 --2- 172.21.15.79:0/1165870597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79cc0039b0 0x7f79cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.473+0000 7f79e580f640 1 -- 172.21.15.79:0/1165870597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79cc003520 con 0x7f79cc004d40 2024-04-25T02:08:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.473+0000 7f79e580f640 1 --2- 172.21.15.79:0/1165870597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79cc004d40 0x7f79cc0051c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f79d800a8a0 tx=0x7f79cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1e79e70d3383a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.473+0000 7f79d7fff640 1 -- 172.21.15.79:0/1165870597 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d800a4c0 con 0x7f79cc004d40 2024-04-25T02:08:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.473+0000 7f79d7fff640 1 -- 172.21.15.79:0/1165870597 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d802f070 con 0x7f79cc004d40 2024-04-25T02:08:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.473+0000 7f79d7fff640 1 -- 172.21.15.79:0/1165870597 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d802bd30 con 0x7f79cc004d40 2024-04-25T02:08:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.474+0000 7f79e7272640 1 -- 172.21.15.79:0/1165870597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79cc004d40 msgr2=0x7f79cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.474+0000 7f79e7272640 1 --2- 172.21.15.79:0/1165870597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79cc004d40 0x7f79cc0051c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f79d800a8a0 tx=0x7f79cc005830 comp rx=0 tx=0).stop 2024-04-25T02:08:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.474+0000 7f79e580f640 1 -- 172.21.15.79:0/1165870597 reap_dead start 2024-04-25T02:08:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.474+0000 7f79e7272640 1 -- 172.21.15.79:0/1165870597 shutdown_connections 2024-04-25T02:08:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.474+0000 7f79e7272640 1 -- 172.21.15.79:0/1165870597 >> 172.21.15.79:0/1165870597 conn(0x7f79e009d460 msgr2=0x7f79e00d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.474+0000 7f79e7272640 1 -- 172.21.15.79:0/1165870597 shutdown_connections 2024-04-25T02:08:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.474+0000 7f79e7272640 1 -- 172.21.15.79:0/1165870597 wait complete. 2024-04-25T02:08:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.475+0000 7f79e7272640 1 Processor -- start 2024-04-25T02:08:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.475+0000 7f79e7272640 1 -- start start 2024-04-25T02:08:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e7272640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79cc004d40 0x7f79e01e7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e7272640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79e00cd8c0 0x7f79e014d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e7272640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79e01e9640 0x7f79e01e9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e7272640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f79e00d2250 con 0x7f79cc004d40 2024-04-25T02:08:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e7272640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f79e00d20d0 con 0x7f79e00cd8c0 2024-04-25T02:08:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e7272640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f79e00cfcf0 con 0x7f79e01e9640 2024-04-25T02:08:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e500e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79cc004d40 0x7f79e01e7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e500e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79cc004d40 0x7f79e01e7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57322/0 (socket says 172.21.15.79:57322) 2024-04-25T02:08:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e500e640 1 -- 172.21.15.79:0/608710339 learned_addr learned my addr 172.21.15.79:0/608710339 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e480d640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79e00cd8c0 0x7f79e014d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e580f640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79e01e9640 0x7f79e01e9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e500e640 1 -- 172.21.15.79:0/608710339 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79e01e9640 msgr2=0x7f79e01e9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e500e640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79e01e9640 0x7f79e01e9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e500e640 1 -- 172.21.15.79:0/608710339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79e00cd8c0 msgr2=0x7f79e014d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e500e640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79e00cd8c0 0x7f79e014d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e500e640 1 -- 172.21.15.79:0/608710339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e01e7f60 con 0x7f79cc004d40 2024-04-25T02:08:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e480d640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79e00cd8c0 0x7f79e014d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e580f640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79e01e9640 0x7f79e01e9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79e500e640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79cc004d40 0x7f79e01e7710 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f79dc011910 tx=0x7f79dc011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.476+0000 7f79d5ffb640 1 -- 172.21.15.79:0/608710339 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc00faf0 con 0x7f79cc004d40 2024-04-25T02:08:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.477+0000 7f79d5ffb640 1 -- 172.21.15.79:0/608710339 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79dc00fc90 con 0x7f79cc004d40 2024-04-25T02:08:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.477+0000 7f79e7272640 1 -- 172.21.15.79:0/608710339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e01e8240 con 0x7f79cc004d40 2024-04-25T02:08:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.477+0000 7f79d5ffb640 1 -- 172.21.15.79:0/608710339 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc014440 con 0x7f79cc004d40 2024-04-25T02:08:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.477+0000 7f79e7272640 1 -- 172.21.15.79:0/608710339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e01e8800 con 0x7f79cc004d40 2024-04-25T02:08:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.478+0000 7f79e7272640 1 -- 172.21.15.79:0/608710339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e0067980 con 0x7f79cc004d40 2024-04-25T02:08:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.478+0000 7f79d5ffb640 1 -- 172.21.15.79:0/608710339 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79dc012040 con 0x7f79cc004d40 2024-04-25T02:08:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.478+0000 7f79d5ffb640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f79c406be60 0x7f79c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.479+0000 7f79d5ffb640 1 -- 172.21.15.79:0/608710339 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f79dc08b410 con 0x7f79cc004d40 2024-04-25T02:08:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.479+0000 7f79e480d640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f79c406be60 0x7f79c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.479+0000 7f79e480d640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f79c406be60 0x7f79c406e320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f79e00a20a0 tx=0x7f79d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.483+0000 7f79d5ffb640 1 -- 172.21.15.79:0/608710339 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f79e0067980 con 0x7f79cc004d40 2024-04-25T02:08:16.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.692+0000 7f79e7272640 1 -- 172.21.15.79:0/608710339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f79e00690a0 con 0x7f79cc004d40 2024-04-25T02:08:16.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.692+0000 7f79d5ffb640 1 -- 172.21.15.79:0/608710339 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f79dc019030 con 0x7f79cc004d40 2024-04-25T02:08:16.699 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:08:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.694+0000 7f79e7272640 1 -- 172.21.15.79:0/608710339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f79c406be60 msgr2=0x7f79c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.694+0000 7f79e7272640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f79c406be60 0x7f79c406e320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f79e00a20a0 tx=0x7f79d0008040 comp rx=0 tx=0).stop 2024-04-25T02:08:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.694+0000 7f79e7272640 1 -- 172.21.15.79:0/608710339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79cc004d40 msgr2=0x7f79e01e7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.694+0000 7f79e7272640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79cc004d40 0x7f79e01e7710 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f79dc011910 tx=0x7f79dc011dd0 comp rx=0 tx=0).stop 2024-04-25T02:08:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.694+0000 7f79e7272640 1 -- 172.21.15.79:0/608710339 shutdown_connections 2024-04-25T02:08:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.694+0000 7f79e7272640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f79c406be60 0x7f79c406e320 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.694+0000 7f79e7272640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79e01e9640 0x7f79e01e9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.694+0000 7f79e7272640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79e00cd8c0 0x7f79e014d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.694+0000 7f79e7272640 1 --2- 172.21.15.79:0/608710339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79cc004d40 0x7f79e01e7710 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.694+0000 7f79e7272640 1 -- 172.21.15.79:0/608710339 >> 172.21.15.79:0/608710339 conn(0x7f79e009d460 msgr2=0x7f79e015eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.694+0000 7f79e7272640 1 -- 172.21.15.79:0/608710339 shutdown_connections 2024-04-25T02:08:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:16.694+0000 7f79e7272640 1 -- 172.21.15.79:0/608710339 wait complete. 2024-04-25T02:08:16.712 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:08:16.712 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:08:16.712 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi189.front.sepia.ceph.com 2024-04-25T02:08:16.712 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T02:08:16.712 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T02:08:16.712 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:08:16.712 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:08:16.712 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:08:16.712 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T02:08:16.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:16.712 DEBUG:teuthology.orchestra.run.smithi189:> ip addr 2024-04-25T02:08:16.732 INFO:teuthology.orchestra.run.smithi189.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:08:16.732 INFO:teuthology.orchestra.run.smithi189.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:08:16.732 INFO:teuthology.orchestra.run.smithi189.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:08:16.732 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:16.732 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 ::1/128 scope host 2024-04-25T02:08:16.732 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:16.732 INFO:teuthology.orchestra.run.smithi189.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:08:16.732 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:d9:3b:18 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:16.732 INFO:teuthology.orchestra.run.smithi189.stdout: altname enp7s0f0 2024-04-25T02:08:16.732 INFO:teuthology.orchestra.run.smithi189.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:08:16.733 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:d9:3b:19 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:16.733 INFO:teuthology.orchestra.run.smithi189.stdout: altname enp7s0f1 2024-04-25T02:08:16.733 INFO:teuthology.orchestra.run.smithi189.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:08:16.733 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:88:6d:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:16.733 INFO:teuthology.orchestra.run.smithi189.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:08:16.733 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:88:6d:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:16.733 INFO:teuthology.orchestra.run.smithi189.stdout: inet 172.21.15.189/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:08:16.733 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft 42706sec preferred_lft 42706sec 2024-04-25T02:08:16.733 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::e3eb:fd4b:5c6c:af74/64 scope link noprefixroute 2024-04-25T02:08:16.733 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:16.733 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T02:08:16.733 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:16.734 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-04-25T02:08:16.734 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link add name ceph-brx type bridge 2024-04-25T02:08:16.734 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip addr flush dev ceph-brx 2024-04-25T02:08:16.734 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link set ceph-brx up 2024-04-25T02:08:16.734 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T02:08:16.734 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-04-25T02:08:16.827 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:17.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:17.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:17.027 DEBUG:teuthology.orchestra.run.smithi189:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:08:17.052 INFO:teuthology.orchestra.run.smithi189.stdout:1 2024-04-25T02:08:17.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:17.054 DEBUG:teuthology.orchestra.run.smithi189:> route 2024-04-25T02:08:17.120 INFO:teuthology.orchestra.run.smithi189.stdout:Kernel IP routing table 2024-04-25T02:08:17.121 INFO:teuthology.orchestra.run.smithi189.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:08:17.121 INFO:teuthology.orchestra.run.smithi189.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:08:17.121 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:08:17.121 INFO:teuthology.orchestra.run.smithi189.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:08:17.121 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:17.121 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-04-25T02:08:17.121 DEBUG:teuthology.orchestra.run.smithi189:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:08:17.121 DEBUG:teuthology.orchestra.run.smithi189:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:08:17.122 DEBUG:teuthology.orchestra.run.smithi189:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:08:17.122 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-04-25T02:08:17.210 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:17.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:17.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:17.376 DEBUG:teuthology.orchestra.run.smithi189:> ip netns list 2024-04-25T02:08:17.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:17.391 DEBUG:teuthology.orchestra.run.smithi189:> ip netns list-id 2024-04-25T02:08:17.446 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:17.447 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-04-25T02:08:17.447 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T02:08:17.447 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T02:08:17.447 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-04-25T02:08:17.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:17.557 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:17.563 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T02:08:17.563 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:17.563 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-04-25T02:08:17.563 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T02:08:17.563 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T02:08:17.563 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T02:08:17.563 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T02:08:17.564 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T02:08:17.564 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-04-25T02:08:17.613 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:17.707 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:17.713 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:17.713 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-04-25T02:08:17.713 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link set brx.0 up 2024-04-25T02:08:17.713 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T02:08:17.714 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-04-25T02:08:17.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:17.783 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:17.789 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:08:17.789 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T02:08:17.803 INFO:teuthology.orchestra.run.smithi189.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T02:08:17.803 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:08:17.803 DEBUG:teuthology.orchestra.run.smithi189:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T02:08:17.859 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:08:17.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:17.859 DEBUG:teuthology.orchestra.run.smithi189:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:08:17.947 INFO:teuthology.orchestra.run.smithi189.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:08:17.947 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T02:08:17.947 INFO:teuthology.orchestra.run.smithi189.stdout:invalid new device string format 2024-04-25T02:08:18.044 INFO:teuthology.orchestra.run.smithi189.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:08:18.044 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T02:08:18.044 INFO:teuthology.orchestra.run.smithi189.stdout:invalid new device string format 2024-04-25T02:08:18.044 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:08:18.044 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:08:18.052 INFO:teuthology.orchestra.run.smithi189.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:08:18.052 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T02:08:18.052 INFO:teuthology.orchestra.run.smithi189.stdout:invalid new device string format 2024-04-25T02:08:18.052 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:08:18.052 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:08:18.052 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:08:18.052 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:08:18.052 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:08:18.053 INFO:teuthology.orchestra.run.smithi189.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T02:08:18.053 INFO:teuthology.orchestra.run.smithi189.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:08:18.053 INFO:teuthology.orchestra.run.smithi189.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:08:18.053 INFO:teuthology.orchestra.run.smithi189.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:08:18.053 INFO:teuthology.orchestra.run.smithi189.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:08:18.055 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:08:18.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:18.055 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T02:08:18.078 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:08:18.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:08:18.168 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:18.174 INFO:teuthology.orchestra.run.smithi189.stdout:client4606 2024-04-25T02:08:18.174 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:08:18.174 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:18.189 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:08:18.278 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:08:18.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:18.286 INFO:teuthology.orchestra.run.smithi189.stdout:client4606 2024-04-25T02:08:18.286 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:08:18.333 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:08:18.335 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:18.341 INFO:teuthology.orchestra.run.smithi189.stdout:client4606 2024-04-25T02:08:18.341 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/696648c4-3e52-400b-a780-2e8863c56c42.client4606/status') 2024-04-25T02:08:18.389 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:18.399 INFO:teuthology.orchestra.run.smithi189.stdout:instance: client.4606 (3)192.168.0.1:0/1839382670 2024-04-25T02:08:18.399 INFO:teuthology.orchestra.run.smithi189.stdout:blocklisted: false 2024-04-25T02:08:18.399 INFO:teuthology.orchestra.run.smithi189.stderr:0+1 records in 2024-04-25T02:08:18.399 INFO:teuthology.orchestra.run.smithi189.stderr:0+1 records out 2024-04-25T02:08:18.399 INFO:teuthology.orchestra.run.smithi189.stderr:69 bytes copied, 2.1995e-05 s, 3.1 MB/s 2024-04-25T02:08:18.400 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:18.407 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-25T02:08:18.407 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T02:08:18.407 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T02:08:18.408 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:08:18.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.510+0000 7f2e230bd640 1 Processor -- start 2024-04-25T02:08:18.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.510+0000 7f2e230bd640 1 -- start start 2024-04-25T02:08:18.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.510+0000 7f2e230bd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2e1c0b3570 0x7f2e1c0d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:18.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.510+0000 7f2e230bd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2e1c0b3020 0x7f2e1c0d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:18.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.510+0000 7f2e230bd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e1c06c380 con 0x7f2e1c15e4d0 2024-04-25T02:08:18.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.510+0000 7f2e230bd640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f2e1c0d1660 con 0x7f2e1c0b3020 2024-04-25T02:08:18.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.510+0000 7f2e230bd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2e1c0d1380 con 0x7f2e1c0b3570 2024-04-25T02:08:18.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e20e59640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2e1c15e4d0 0x7f2e1c06bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60074/0 (socket says 172.21.15.79:60074) 2024-04-25T02:08:18.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e20e59640 1 -- 172.21.15.79:0/3586420473 learned_addr learned my addr 172.21.15.79:0/3586420473 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:18.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e2165a640 1 --2- 172.21.15.79:0/3586420473 >> v2:172.21.15.189:3300/0 conn(0x7f2e1c0b3020 0x7f2e1c0d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:18.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1bfff640 1 --2- 172.21.15.79:0/3586420473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2e1c0b3570 0x7f2e1c0d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:18.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 -- 172.21.15.79:0/3586420473 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2268342919 0 0) 0x7f2e1c06c380 con 0x7f2e1c15e4d0 2024-04-25T02:08:18.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 -- 172.21.15.79:0/3586420473 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e0c003520 con 0x7f2e1c15e4d0 2024-04-25T02:08:18.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 -- 172.21.15.79:0/3586420473 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 474291530 0 0) 0x7f2e0c003520 con 0x7f2e1c15e4d0 2024-04-25T02:08:18.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 -- 172.21.15.79:0/3586420473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2e1c0b3570 msgr2=0x7f2e1c0d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:18.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 --2- 172.21.15.79:0/3586420473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2e1c0b3570 0x7f2e1c0d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 -- 172.21.15.79:0/3586420473 >> v2:172.21.15.189:3300/0 conn(0x7f2e1c0b3020 msgr2=0x7f2e1c0d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:18.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 --2- 172.21.15.79:0/3586420473 >> v2:172.21.15.189:3300/0 conn(0x7f2e1c0b3020 0x7f2e1c0d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 -- 172.21.15.79:0/3586420473 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1c0cede0 con 0x7f2e1c15e4d0 2024-04-25T02:08:18.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 -- 172.21.15.79:0/3586420473 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f2e10001670 con 0x7f2e1c15e4d0 2024-04-25T02:08:18.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 -- 172.21.15.79:0/3586420473 >> v1:172.21.15.79:6789/0 conn(0x7f2e1c15e4d0 legacy=0x7f2e1c06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:18.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 --2- 172.21.15.79:0/3586420473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e0c0039b0 0x7f2e0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:18.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 --2- 172.21.15.79:0/3586420473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2e1c0b3570 0x7f2e0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:18.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 --2- 172.21.15.79:0/3586420473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e0c004d40 0x7f2e0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:18.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 -- 172.21.15.79:0/3586420473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c0d1660 con 0x7f2e0c0039b0 2024-04-25T02:08:18.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 -- 172.21.15.79:0/3586420473 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c0d1380 con 0x7f2e0c004d40 2024-04-25T02:08:18.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1b7fe640 1 -- 172.21.15.79:0/3586420473 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0c00b9c0 con 0x7f2e1c0b3570 2024-04-25T02:08:18.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e20e59640 1 --2- 172.21.15.79:0/3586420473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e0c0039b0 0x7f2e0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:18.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e1bfff640 1 --2- 172.21.15.79:0/3586420473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2e1c0b3570 0x7f2e0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:18.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.511+0000 7f2e2165a640 1 --2- 172.21.15.79:0/3586420473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e0c004d40 0x7f2e0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:18.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.512+0000 7f2e20e59640 1 -- 172.21.15.79:0/3586420473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2e1c0b3570 msgr2=0x7f2e0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:18.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.512+0000 7f2e20e59640 1 --2- 172.21.15.79:0/3586420473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2e1c0b3570 0x7f2e0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.512+0000 7f2e20e59640 1 -- 172.21.15.79:0/3586420473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e0c004d40 msgr2=0x7f2e0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:18.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.512+0000 7f2e20e59640 1 --2- 172.21.15.79:0/3586420473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e0c004d40 0x7f2e0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.512+0000 7f2e20e59640 1 -- 172.21.15.79:0/3586420473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0c003520 con 0x7f2e0c0039b0 2024-04-25T02:08:18.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.512+0000 7f2e20e59640 1 --2- 172.21.15.79:0/3586420473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e0c0039b0 0x7f2e0c003dd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000c210 tx=0x7f2e0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5ce1a61851cf74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:18.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.513+0000 7f2e1b7fe640 1 -- 172.21.15.79:0/3586420473 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e10007d70 con 0x7f2e0c0039b0 2024-04-25T02:08:18.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.513+0000 7f2e1b7fe640 1 -- 172.21.15.79:0/3586420473 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e10005af0 con 0x7f2e0c0039b0 2024-04-25T02:08:18.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.513+0000 7f2e1b7fe640 1 -- 172.21.15.79:0/3586420473 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e10007070 con 0x7f2e0c0039b0 2024-04-25T02:08:18.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.513+0000 7f2e230bd640 1 -- 172.21.15.79:0/3586420473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e0c0039b0 msgr2=0x7f2e0c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:18.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.513+0000 7f2e230bd640 1 --2- 172.21.15.79:0/3586420473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e0c0039b0 0x7f2e0c003dd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000c210 tx=0x7f2e0c005830 comp rx=0 tx=0).stop 2024-04-25T02:08:18.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.513+0000 7f2e2165a640 1 -- 172.21.15.79:0/3586420473 reap_dead start 2024-04-25T02:08:18.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.513+0000 7f2e230bd640 1 -- 172.21.15.79:0/3586420473 shutdown_connections 2024-04-25T02:08:18.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.513+0000 7f2e230bd640 1 -- 172.21.15.79:0/3586420473 >> 172.21.15.79:0/3586420473 conn(0x7f2e1c09d460 msgr2=0x7f2e1c0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:18.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.513+0000 7f2e230bd640 1 -- 172.21.15.79:0/3586420473 shutdown_connections 2024-04-25T02:08:18.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.513+0000 7f2e230bd640 1 -- 172.21.15.79:0/3586420473 wait complete. 2024-04-25T02:08:18.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.514+0000 7f2e230bd640 1 Processor -- start 2024-04-25T02:08:18.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.514+0000 7f2e230bd640 1 -- start start 2024-04-25T02:08:18.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.515+0000 7f2e230bd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e1c15b1f0 0x7f2e1c0a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:18.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.515+0000 7f2e230bd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2e1c09e9d0 0x7f2e1c0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:18.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.515+0000 7f2e230bd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1c0a1290 0x7f2e1c0d4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:18.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.515+0000 7f2e230bd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c0d20d0 con 0x7f2e1c0a1290 2024-04-25T02:08:18.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.515+0000 7f2e230bd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c15e8b0 con 0x7f2e1c15b1f0 2024-04-25T02:08:18.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.515+0000 7f2e230bd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2e1c0d2250 con 0x7f2e1c09e9d0 2024-04-25T02:08:18.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.515+0000 7f2e2165a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1c0a1290 0x7f2e1c0d4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:18.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.516+0000 7f2e2165a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1c0a1290 0x7f2e1c0d4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57340/0 (socket says 172.21.15.79:57340) 2024-04-25T02:08:18.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.516+0000 7f2e2165a640 1 -- 172.21.15.79:0/2111721487 learned_addr learned my addr 172.21.15.79:0/2111721487 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.516+0000 7f2e20e59640 1 --2- 172.21.15.79:0/2111721487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e1c15b1f0 0x7f2e1c0a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.516+0000 7f2e2165a640 1 -- 172.21.15.79:0/2111721487 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2e1c09e9d0 msgr2=0x7f2e1c0d4130 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.516+0000 7f2e2165a640 1 --2- 172.21.15.79:0/2111721487 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2e1c09e9d0 0x7f2e1c0d4130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.516+0000 7f2e2165a640 1 -- 172.21.15.79:0/2111721487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e1c15b1f0 msgr2=0x7f2e1c0a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.516+0000 7f2e2165a640 1 --2- 172.21.15.79:0/2111721487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e1c15b1f0 0x7f2e1c0a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.516+0000 7f2e2165a640 1 -- 172.21.15.79:0/2111721487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1c09ee90 con 0x7f2e1c0a1290 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.516+0000 7f2e2165a640 1 --2- 172.21.15.79:0/2111721487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1c0a1290 0x7f2e1c0d4670 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c163120 tx=0x7f2e140070e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.516+0000 7f2e197fa640 1 -- 172.21.15.79:0/2111721487 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1400fdc0 con 0x7f2e1c0a1290 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.516+0000 7f2e197fa640 1 -- 172.21.15.79:0/2111721487 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1401d070 con 0x7f2e1c0a1290 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.516+0000 7f2e230bd640 1 -- 172.21.15.79:0/2111721487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1c09f170 con 0x7f2e1c0a1290 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.516+0000 7f2e197fa640 1 -- 172.21.15.79:0/2111721487 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14015670 con 0x7f2e1c0a1290 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.516+0000 7f2e230bd640 1 -- 172.21.15.79:0/2111721487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e1c09f730 con 0x7f2e1c0a1290 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.517+0000 7f2e230bd640 1 -- 172.21.15.79:0/2111721487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e1c0690a0 con 0x7f2e1c0a1290 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.518+0000 7f2e197fa640 1 -- 172.21.15.79:0/2111721487 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e14015810 con 0x7f2e1c0a1290 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.518+0000 7f2e197fa640 1 --2- 172.21.15.79:0/2111721487 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2e0006be30 0x7f2e0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.518+0000 7f2e197fa640 1 -- 172.21.15.79:0/2111721487 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2e1408b5c0 con 0x7f2e1c0a1290 2024-04-25T02:08:18.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.518+0000 7f2e20e59640 1 --2- 172.21.15.79:0/2111721487 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2e0006be30 0x7f2e0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:18.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.519+0000 7f2e20e59640 1 --2- 172.21.15.79:0/2111721487 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2e0006be30 0x7f2e0006e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2e10033000 tx=0x7f2e10009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:18.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.522+0000 7f2e197fa640 1 -- 172.21.15.79:0/2111721487 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2e14010040 con 0x7f2e1c0a1290 2024-04-25T02:08:18.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.734+0000 7f2e230bd640 1 -- 172.21.15.79:0/2111721487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2e1c0d1920 con 0x7f2e1c0a1290 2024-04-25T02:08:18.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.734+0000 7f2e197fa640 1 -- 172.21.15.79:0/2111721487 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f2e1405a000 con 0x7f2e1c0a1290 2024-04-25T02:08:18.741 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:08:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.736+0000 7f2e230bd640 1 -- 172.21.15.79:0/2111721487 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2e0006be30 msgr2=0x7f2e0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.736+0000 7f2e230bd640 1 --2- 172.21.15.79:0/2111721487 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2e0006be30 0x7f2e0006e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2e10033000 tx=0x7f2e10009030 comp rx=0 tx=0).stop 2024-04-25T02:08:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.736+0000 7f2e230bd640 1 -- 172.21.15.79:0/2111721487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1c0a1290 msgr2=0x7f2e1c0d4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.736+0000 7f2e230bd640 1 --2- 172.21.15.79:0/2111721487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1c0a1290 0x7f2e1c0d4670 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c163120 tx=0x7f2e140070e0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.736+0000 7f2e230bd640 1 -- 172.21.15.79:0/2111721487 shutdown_connections 2024-04-25T02:08:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.736+0000 7f2e230bd640 1 --2- 172.21.15.79:0/2111721487 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2e0006be30 0x7f2e0006e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.736+0000 7f2e230bd640 1 --2- 172.21.15.79:0/2111721487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1c0a1290 0x7f2e1c0d4670 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.736+0000 7f2e230bd640 1 --2- 172.21.15.79:0/2111721487 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2e1c09e9d0 0x7f2e1c0d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.736+0000 7f2e230bd640 1 --2- 172.21.15.79:0/2111721487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e1c15b1f0 0x7f2e1c0a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.736+0000 7f2e230bd640 1 -- 172.21.15.79:0/2111721487 >> 172.21.15.79:0/2111721487 conn(0x7f2e1c09d460 msgr2=0x7f2e1c06bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:18.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.736+0000 7f2e230bd640 1 -- 172.21.15.79:0/2111721487 shutdown_connections 2024-04-25T02:08:18.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:18.736+0000 7f2e230bd640 1 -- 172.21.15.79:0/2111721487 wait complete. 2024-04-25T02:08:18.754 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:08:18.754 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:08:18.754 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi189.front.sepia.ceph.com 2024-04-25T02:08:18.754 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-25T02:08:18.754 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T02:08:18.754 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:08:18.754 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:08:18.754 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:08:18.754 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-25T02:08:18.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:18.755 DEBUG:teuthology.orchestra.run.smithi189:> ip addr 2024-04-25T02:08:18.770 INFO:teuthology.orchestra.run.smithi189.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:08:18.770 INFO:teuthology.orchestra.run.smithi189.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:08:18.771 INFO:teuthology.orchestra.run.smithi189.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:08:18.771 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:18.771 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 ::1/128 scope host 2024-04-25T02:08:18.771 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:18.771 INFO:teuthology.orchestra.run.smithi189.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:08:18.771 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:d9:3b:18 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:18.771 INFO:teuthology.orchestra.run.smithi189.stdout: altname enp7s0f0 2024-04-25T02:08:18.771 INFO:teuthology.orchestra.run.smithi189.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:08:18.771 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:d9:3b:19 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:18.771 INFO:teuthology.orchestra.run.smithi189.stdout: altname enp7s0f1 2024-04-25T02:08:18.771 INFO:teuthology.orchestra.run.smithi189.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:08:18.771 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:88:6d:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:18.771 INFO:teuthology.orchestra.run.smithi189.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:08:18.772 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:88:6d:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:18.772 INFO:teuthology.orchestra.run.smithi189.stdout: inet 172.21.15.189/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:08:18.772 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft 42704sec preferred_lft 42704sec 2024-04-25T02:08:18.772 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::e3eb:fd4b:5c6c:af74/64 scope link noprefixroute 2024-04-25T02:08:18.772 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:18.772 INFO:teuthology.orchestra.run.smithi189.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:08:18.772 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 46:85:42:62:a4:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:18.772 INFO:teuthology.orchestra.run.smithi189.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:08:18.772 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:18.772 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::a49d:47ff:fe38:62f2/64 scope link tentative 2024-04-25T02:08:18.772 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:18.772 INFO:teuthology.orchestra.run.smithi189.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:08:18.772 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 46:85:42:62:a4:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T02:08:18.772 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::4485:42ff:fe62:a41b/64 scope link tentative 2024-04-25T02:08:18.772 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:18.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:18.773 DEBUG:teuthology.orchestra.run.smithi189:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:08:18.834 INFO:teuthology.orchestra.run.smithi189.stdout:1 2024-04-25T02:08:18.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:18.835 DEBUG:teuthology.orchestra.run.smithi189:> route 2024-04-25T02:08:18.892 INFO:teuthology.orchestra.run.smithi189.stdout:Kernel IP routing table 2024-04-25T02:08:18.892 INFO:teuthology.orchestra.run.smithi189.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:08:18.892 INFO:teuthology.orchestra.run.smithi189.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:08:18.892 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:08:18.892 INFO:teuthology.orchestra.run.smithi189.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:08:18.892 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:18.892 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-04-25T02:08:18.892 DEBUG:teuthology.orchestra.run.smithi189:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:08:18.893 DEBUG:teuthology.orchestra.run.smithi189:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:08:18.893 DEBUG:teuthology.orchestra.run.smithi189:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:08:18.893 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-04-25T02:08:18.980 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:19.010 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:19.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:19.016 DEBUG:teuthology.orchestra.run.smithi189:> ip netns list 2024-04-25T02:08:19.030 INFO:teuthology.orchestra.run.smithi189.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T02:08:19.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:19.031 DEBUG:teuthology.orchestra.run.smithi189:> ip netns list-id 2024-04-25T02:08:19.085 INFO:teuthology.orchestra.run.smithi189.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-25T02:08:19.086 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:19.086 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-04-25T02:08:19.086 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T02:08:19.086 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-25T02:08:19.086 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-04-25T02:08:19.173 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:19.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:19.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:19.201 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T02:08:19.224 INFO:teuthology.orchestra.run.smithi189.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:08:19.224 INFO:teuthology.orchestra.run.smithi189.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:08:19.224 INFO:teuthology.orchestra.run.smithi189.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:08:19.225 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:19.225 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 ::1/128 scope host 2024-04-25T02:08:19.225 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:19.225 INFO:teuthology.orchestra.run.smithi189.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:08:19.225 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 26:81:15:79:0f:c4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T02:08:19.225 INFO:teuthology.orchestra.run.smithi189.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T02:08:19.225 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:19.225 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::2481:15ff:fe79:fc4/64 scope link 2024-04-25T02:08:19.225 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:19.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:19.226 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T02:08:19.290 INFO:teuthology.orchestra.run.smithi189.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:08:19.290 INFO:teuthology.orchestra.run.smithi189.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:08:19.290 INFO:teuthology.orchestra.run.smithi189.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:08:19.290 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:19.291 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 ::1/128 scope host 2024-04-25T02:08:19.291 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:19.291 INFO:teuthology.orchestra.run.smithi189.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:08:19.291 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 26:81:15:79:0f:c4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T02:08:19.291 INFO:teuthology.orchestra.run.smithi189.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T02:08:19.291 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:19.291 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::2481:15ff:fe79:fc4/64 scope link 2024-04-25T02:08:19.291 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:19.292 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-25T02:08:19.292 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:19.292 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-04-25T02:08:19.292 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-25T02:08:19.293 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T02:08:19.293 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-25T02:08:19.293 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-25T02:08:19.293 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-25T02:08:19.293 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-04-25T02:08:19.380 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:19.433 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:19.440 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:19.440 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-04-25T02:08:19.440 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link set brx.1 up 2024-04-25T02:08:19.440 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T02:08:19.440 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-04-25T02:08:19.488 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:19.509 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:19.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:08:19.516 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-25T02:08:19.530 INFO:teuthology.orchestra.run.smithi189.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-25T02:08:19.530 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:08:19.530 DEBUG:teuthology.orchestra.run.smithi189:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-25T02:08:19.584 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:08:19.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:19.584 DEBUG:teuthology.orchestra.run.smithi189:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T02:08:19.666 INFO:teuthology.orchestra.run.smithi189.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T02:08:19.666 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T02:08:19.666 INFO:teuthology.orchestra.run.smithi189.stdout:invalid new device string format 2024-04-25T02:08:19.674 INFO:teuthology.orchestra.run.smithi189.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T02:08:19.674 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T02:08:19.674 INFO:teuthology.orchestra.run.smithi189.stdout:invalid new device string format 2024-04-25T02:08:19.674 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:08:19.674 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:08:19.680 INFO:teuthology.orchestra.run.smithi189.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T02:08:19.680 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T02:08:19.680 INFO:teuthology.orchestra.run.smithi189.stdout:invalid new device string format 2024-04-25T02:08:19.680 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:08:19.680 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:08:19.680 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:08:19.680 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:08:19.680 INFO:teuthology.orchestra.run.smithi189.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:08:19.681 INFO:teuthology.orchestra.run.smithi189.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-25T02:08:19.681 INFO:teuthology.orchestra.run.smithi189.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:08:19.681 INFO:teuthology.orchestra.run.smithi189.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:08:19.681 INFO:teuthology.orchestra.run.smithi189.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:08:19.681 INFO:teuthology.orchestra.run.smithi189.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:08:19.682 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:08:19.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:19.683 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-25T02:08:19.747 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:08:19.836 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:08:19.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:19.843 INFO:teuthology.orchestra.run.smithi189.stdout:client4615 2024-04-25T02:08:19.844 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:08:19.844 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:19.859 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:08:19.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:08:19.949 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:19.955 INFO:teuthology.orchestra.run.smithi189.stdout:client4615 2024-04-25T02:08:19.956 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:08:20.004 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:08:20.006 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:20.011 INFO:teuthology.orchestra.run.smithi189.stdout:client4615 2024-04-25T02:08:20.012 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/696648c4-3e52-400b-a780-2e8863c56c42.client4615/status') 2024-04-25T02:08:20.059 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:20.068 INFO:teuthology.orchestra.run.smithi189.stdout:instance: client.4615 (3)192.168.0.2:0/1505898760 2024-04-25T02:08:20.068 INFO:teuthology.orchestra.run.smithi189.stdout:blocklisted: false 2024-04-25T02:08:20.068 INFO:teuthology.orchestra.run.smithi189.stderr:0+1 records in 2024-04-25T02:08:20.068 INFO:teuthology.orchestra.run.smithi189.stderr:0+1 records out 2024-04-25T02:08:20.069 INFO:teuthology.orchestra.run.smithi189.stderr:69 bytes copied, 2.1958e-05 s, 3.1 MB/s 2024-04-25T02:08:20.069 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-25T02:08:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:20.076 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-25T02:08:20.091 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.193+0000 7f9cc2258640 1 Processor -- start 2024-04-25T02:08:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.193+0000 7f9cc2258640 1 -- start start 2024-04-25T02:08:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.194+0000 7f9cc2258640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9cbc0d26b0 0x7f9cbc0d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.194+0000 7f9cc2258640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9cbc0d2a90 0x7f9cbc0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.194+0000 7f9cc2258640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cbc0d2480 con 0x7f9cbc15e610 2024-04-25T02:08:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.194+0000 7f9cc2258640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9cbc15f000 con 0x7f9cbc0d2a90 2024-04-25T02:08:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.194+0000 7f9cc2258640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9cbc15f2e0 con 0x7f9cbc0d26b0 2024-04-25T02:08:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.194+0000 7f9cbaffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9cbc0d2a90 0x7f9cbc0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.194+0000 7f9cbbfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9cbc15e610 0x7f9cbc0d0ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60076/0 (socket says 172.21.15.79:60076) 2024-04-25T02:08:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.194+0000 7f9cbbfff640 1 -- 172.21.15.79:0/1866649725 learned_addr learned my addr 172.21.15.79:0/1866649725 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.194+0000 7f9cbb7fe640 1 --2- 172.21.15.79:0/1866649725 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9cbc0d26b0 0x7f9cbc0d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.195+0000 7f9cbaffd640 1 -- 172.21.15.79:0/1866649725 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9cbc0d26b0 msgr2=0x7f9cbc0d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.195+0000 7f9cbaffd640 1 --2- 172.21.15.79:0/1866649725 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9cbc0d26b0 0x7f9cbc0d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.195+0000 7f9cbaffd640 1 -- 172.21.15.79:0/1866649725 >> v1:172.21.15.79:6789/0 conn(0x7f9cbc15e610 legacy=0x7f9cbc0d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.195+0000 7f9cbaffd640 1 -- 172.21.15.79:0/1866649725 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cbc15f5c0 con 0x7f9cbc0d2a90 2024-04-25T02:08:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.195+0000 7f9cbaffd640 1 --2- 172.21.15.79:0/1866649725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cbc0d2a90 0x7f9cbc0cecc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00097a0 tx=0x7f9cb002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645e49e1c3116ee1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.195+0000 7f9cba7fc640 1 -- 172.21.15.79:0/1866649725 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0037070 con 0x7f9cbc0d2a90 2024-04-25T02:08:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.196+0000 7f9cba7fc640 1 -- 172.21.15.79:0/1866649725 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb0032440 con 0x7f9cbc0d2a90 2024-04-25T02:08:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.196+0000 7f9cba7fc640 1 -- 172.21.15.79:0/1866649725 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0032810 con 0x7f9cbc0d2a90 2024-04-25T02:08:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.196+0000 7f9cc2258640 1 -- 172.21.15.79:0/1866649725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cbc0d2a90 msgr2=0x7f9cbc0cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.196+0000 7f9cc2258640 1 --2- 172.21.15.79:0/1866649725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cbc0d2a90 0x7f9cbc0cecc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00097a0 tx=0x7f9cb002a210 comp rx=0 tx=0).stop 2024-04-25T02:08:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.196+0000 7f9cc2258640 1 -- 172.21.15.79:0/1866649725 shutdown_connections 2024-04-25T02:08:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.196+0000 7f9cc2258640 1 --2- 172.21.15.79:0/1866649725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cbc0d2a90 0x7f9cbc0cecc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.196+0000 7f9cc2258640 1 --2- 172.21.15.79:0/1866649725 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9cbc0d26b0 0x7f9cbc0d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.196+0000 7f9cc2258640 1 -- 172.21.15.79:0/1866649725 >> 172.21.15.79:0/1866649725 conn(0x7f9cbc0d40d0 msgr2=0x7f9cbc0d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.196+0000 7f9cc2258640 1 -- 172.21.15.79:0/1866649725 shutdown_connections 2024-04-25T02:08:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.196+0000 7f9cc2258640 1 -- 172.21.15.79:0/1866649725 wait complete. 2024-04-25T02:08:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.197+0000 7f9cc2258640 1 Processor -- start 2024-04-25T02:08:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.198+0000 7f9cc2258640 1 -- start start 2024-04-25T02:08:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.198+0000 7f9cc2258640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cbc0d26b0 0x7f9cbc0b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.198+0000 7f9cc2258640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9cbc0d2a90 0x7f9cbc0b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.198+0000 7f9cc2258640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cbc15e610 0x7f9cbc0b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.198+0000 7f9cc2258640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc0d2ed0 con 0x7f9cbc15e610 2024-04-25T02:08:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.198+0000 7f9cc2258640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc15f8a0 con 0x7f9cbc0d26b0 2024-04-25T02:08:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.198+0000 7f9cc2258640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9cbc0b6460 con 0x7f9cbc0d2a90 2024-04-25T02:08:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.198+0000 7f9cbbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cbc15e610 0x7f9cbc0b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.198+0000 7f9cbbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cbc15e610 0x7f9cbc0b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57348/0 (socket says 172.21.15.79:57348) 2024-04-25T02:08:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.198+0000 7f9cbbfff640 1 -- 172.21.15.79:0/179201649 learned_addr learned my addr 172.21.15.79:0/179201649 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.199+0000 7f9cbb7fe640 1 --2- 172.21.15.79:0/179201649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cbc0d26b0 0x7f9cbc0b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.199+0000 7f9cbaffd640 1 --2- 172.21.15.79:0/179201649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9cbc0d2a90 0x7f9cbc0b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.199+0000 7f9cbbfff640 1 -- 172.21.15.79:0/179201649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9cbc0d2a90 msgr2=0x7f9cbc0b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.199+0000 7f9cbbfff640 1 --2- 172.21.15.79:0/179201649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9cbc0d2a90 0x7f9cbc0b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.199+0000 7f9cbbfff640 1 -- 172.21.15.79:0/179201649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cbc0d26b0 msgr2=0x7f9cbc0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.199+0000 7f9cbbfff640 1 --2- 172.21.15.79:0/179201649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cbc0d26b0 0x7f9cbc0b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.199+0000 7f9cbbfff640 1 -- 172.21.15.79:0/179201649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cbc0b4110 con 0x7f9cbc15e610 2024-04-25T02:08:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.199+0000 7f9cbbfff640 1 --2- 172.21.15.79:0/179201649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cbc15e610 0x7f9cbc0b1d20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400c370 tx=0x7f9cb400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.199+0000 7f9ca3fff640 1 -- 172.21.15.79:0/179201649 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4017070 con 0x7f9cbc15e610 2024-04-25T02:08:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.199+0000 7f9ca3fff640 1 -- 172.21.15.79:0/179201649 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb4005ce0 con 0x7f9cbc15e610 2024-04-25T02:08:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.199+0000 7f9cc2258640 1 -- 172.21.15.79:0/179201649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cbc0b3b50 con 0x7f9cbc15e610 2024-04-25T02:08:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.199+0000 7f9ca3fff640 1 -- 172.21.15.79:0/179201649 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40072d0 con 0x7f9cbc15e610 2024-04-25T02:08:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.199+0000 7f9cc2258640 1 -- 172.21.15.79:0/179201649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cbc0c9750 con 0x7f9cbc15e610 2024-04-25T02:08:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.200+0000 7f9cc2258640 1 -- 172.21.15.79:0/179201649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cbc0b38d0 con 0x7f9cbc15e610 2024-04-25T02:08:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.201+0000 7f9ca3fff640 1 -- 172.21.15.79:0/179201649 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9cb401a070 con 0x7f9cbc15e610 2024-04-25T02:08:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.201+0000 7f9ca3fff640 1 --2- 172.21.15.79:0/179201649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9ca806be30 0x7f9ca806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.201+0000 7f9ca3fff640 1 -- 172.21.15.79:0/179201649 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9cb4089fa0 con 0x7f9cbc15e610 2024-04-25T02:08:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.201+0000 7f9cbb7fe640 1 --2- 172.21.15.79:0/179201649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9ca806be30 0x7f9ca806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.202+0000 7f9cbb7fe640 1 --2- 172.21.15.79:0/179201649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9ca806be30 0x7f9ca806e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0113e0 tx=0x7f9cac00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.206+0000 7f9ca3fff640 1 -- 172.21.15.79:0/179201649 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9cbc0b38d0 con 0x7f9cbc15e610 2024-04-25T02:08:20.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.378+0000 7f9cc2258640 1 -- 172.21.15.79:0/179201649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9cbc0681e0 con 0x7f9cbc15e610 2024-04-25T02:08:20.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.380+0000 7f9ca3fff640 1 -- 172.21.15.79:0/179201649 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f9cbc0b4110 con 0x7f9cbc15e610 2024-04-25T02:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:20.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.382+0000 7f9cc2258640 1 -- 172.21.15.79:0/179201649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9ca806be30 msgr2=0x7f9ca806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.382+0000 7f9cc2258640 1 --2- 172.21.15.79:0/179201649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9ca806be30 0x7f9ca806e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0113e0 tx=0x7f9cac00b040 comp rx=0 tx=0).stop 2024-04-25T02:08:20.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.382+0000 7f9cc2258640 1 -- 172.21.15.79:0/179201649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cbc15e610 msgr2=0x7f9cbc0b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.382+0000 7f9cc2258640 1 --2- 172.21.15.79:0/179201649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cbc15e610 0x7f9cbc0b1d20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400c370 tx=0x7f9cb400c830 comp rx=0 tx=0).stop 2024-04-25T02:08:20.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.382+0000 7f9cc2258640 1 -- 172.21.15.79:0/179201649 shutdown_connections 2024-04-25T02:08:20.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.382+0000 7f9cc2258640 1 --2- 172.21.15.79:0/179201649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9ca806be30 0x7f9ca806e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.382+0000 7f9cc2258640 1 --2- 172.21.15.79:0/179201649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cbc15e610 0x7f9cbc0b1d20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.382+0000 7f9cc2258640 1 --2- 172.21.15.79:0/179201649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9cbc0d2a90 0x7f9cbc0b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.382+0000 7f9cc2258640 1 --2- 172.21.15.79:0/179201649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cbc0d26b0 0x7f9cbc0b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.382+0000 7f9cc2258640 1 -- 172.21.15.79:0/179201649 >> 172.21.15.79:0/179201649 conn(0x7f9cbc0d40d0 msgr2=0x7f9cbc1601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:20.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.382+0000 7f9cc2258640 1 -- 172.21.15.79:0/179201649 shutdown_connections 2024-04-25T02:08:20.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.382+0000 7f9cc2258640 1 -- 172.21.15.79:0/179201649 wait complete. 2024-04-25T02:08:20.400 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:57.115253+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:58.421392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:08:20.400 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:08:20.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.493+0000 7f4700088640 1 Processor -- start 2024-04-25T02:08:20.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.493+0000 7f4700088640 1 -- start start 2024-04-25T02:08:20.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f4700088640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46f806b2f0 0x7f46f80b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f4700088640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f46f80cf7a0 0x7f46f806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f4700088640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46f806e6b0 0x7f46f80cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f4700088640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f46f815f830 con 0x7f46f806b2f0 2024-04-25T02:08:20.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f4700088640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f46f806bc10 con 0x7f46f80cf7a0 2024-04-25T02:08:20.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f4700088640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f46f815ec20 con 0x7f46f806e6b0 2024-04-25T02:08:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f46fde24640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46f806b2f0 0x7f46f80b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f46fde24640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46f806b2f0 0x7f46f80b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57358/0 (socket says 172.21.15.79:57358) 2024-04-25T02:08:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f46fde24640 1 -- 172.21.15.79:0/849662450 learned_addr learned my addr 172.21.15.79:0/849662450 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f46fd623640 1 --2- 172.21.15.79:0/849662450 >> v2:172.21.15.189:3300/0 conn(0x7f46f80cf7a0 0x7f46f806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f46fe625640 1 --2- 172.21.15.79:0/849662450 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46f806e6b0 0x7f46f80cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f46fde24640 1 -- 172.21.15.79:0/849662450 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46f806e6b0 msgr2=0x7f46f80cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f46fde24640 1 --2- 172.21.15.79:0/849662450 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46f806e6b0 0x7f46f80cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f46fde24640 1 -- 172.21.15.79:0/849662450 >> v2:172.21.15.189:3300/0 conn(0x7f46f80cf7a0 msgr2=0x7f46f806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f46fde24640 1 --2- 172.21.15.79:0/849662450 >> v2:172.21.15.189:3300/0 conn(0x7f46f80cf7a0 0x7f46f806b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f46fde24640 1 -- 172.21.15.79:0/849662450 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f815ef00 con 0x7f46f806b2f0 2024-04-25T02:08:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.494+0000 7f46fe625640 1 --2- 172.21.15.79:0/849662450 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46f806e6b0 0x7f46f80cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:20.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.495+0000 7f46fde24640 1 --2- 172.21.15.79:0/849662450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46f806b2f0 0x7f46f80b4b50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f46f80af800 tx=0x7f46f402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186a6aaa83586f7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:20.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.495+0000 7f46fce22640 1 -- 172.21.15.79:0/849662450 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4037070 con 0x7f46f806b2f0 2024-04-25T02:08:20.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.495+0000 7f46fce22640 1 -- 172.21.15.79:0/849662450 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f4032440 con 0x7f46f806b2f0 2024-04-25T02:08:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.495+0000 7f46fce22640 1 -- 172.21.15.79:0/849662450 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4032810 con 0x7f46f806b2f0 2024-04-25T02:08:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.495+0000 7f4700088640 1 -- 172.21.15.79:0/849662450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46f806b2f0 msgr2=0x7f46f80b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.495+0000 7f4700088640 1 --2- 172.21.15.79:0/849662450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46f806b2f0 0x7f46f80b4b50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f46f80af800 tx=0x7f46f402a140 comp rx=0 tx=0).stop 2024-04-25T02:08:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.496+0000 7f4700088640 1 -- 172.21.15.79:0/849662450 shutdown_connections 2024-04-25T02:08:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.496+0000 7f4700088640 1 --2- 172.21.15.79:0/849662450 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46f806e6b0 0x7f46f80cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.496+0000 7f4700088640 1 --2- 172.21.15.79:0/849662450 >> v2:172.21.15.189:3300/0 conn(0x7f46f80cf7a0 0x7f46f806b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.496+0000 7f4700088640 1 --2- 172.21.15.79:0/849662450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46f806b2f0 0x7f46f80b4b50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.496+0000 7f4700088640 1 -- 172.21.15.79:0/849662450 >> 172.21.15.79:0/849662450 conn(0x7f46f80b1cd0 msgr2=0x7f46f80b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.496+0000 7f4700088640 1 -- 172.21.15.79:0/849662450 shutdown_connections 2024-04-25T02:08:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.496+0000 7f4700088640 1 -- 172.21.15.79:0/849662450 wait complete. 2024-04-25T02:08:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.497+0000 7f4700088640 1 Processor -- start 2024-04-25T02:08:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.497+0000 7f4700088640 1 -- start start 2024-04-25T02:08:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.497+0000 7f4700088640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46f806b2f0 0x7f46f814d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.497+0000 7f4700088640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46f806e6b0 0x7f46f81512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.497+0000 7f4700088640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46f80cf7a0 0x7f46f809d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.497+0000 7f4700088640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46f806cfe0 con 0x7f46f806b2f0 2024-04-25T02:08:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.497+0000 7f4700088640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f46f815f4c0 con 0x7f46f80cf7a0 2024-04-25T02:08:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.497+0000 7f4700088640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f46f806d160 con 0x7f46f806e6b0 2024-04-25T02:08:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.498+0000 7f46fde24640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46f806b2f0 0x7f46f814d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.498+0000 7f46fde24640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46f806b2f0 0x7f46f814d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57366/0 (socket says 172.21.15.79:57366) 2024-04-25T02:08:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.498+0000 7f46fde24640 1 -- 172.21.15.79:0/3293522643 learned_addr learned my addr 172.21.15.79:0/3293522643 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.498+0000 7f46fde24640 1 -- 172.21.15.79:0/3293522643 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46f806e6b0 msgr2=0x7f46f81512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.498+0000 7f46fde24640 1 --2- 172.21.15.79:0/3293522643 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46f806e6b0 0x7f46f81512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.498+0000 7f46fe625640 1 --2- 172.21.15.79:0/3293522643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46f80cf7a0 0x7f46f809d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.498+0000 7f46fde24640 1 -- 172.21.15.79:0/3293522643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46f80cf7a0 msgr2=0x7f46f809d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.498+0000 7f46fde24640 1 --2- 172.21.15.79:0/3293522643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46f80cf7a0 0x7f46f809d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.498+0000 7f46fde24640 1 -- 172.21.15.79:0/3293522643 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f8151d20 con 0x7f46f806b2f0 2024-04-25T02:08:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.498+0000 7f46fde24640 1 --2- 172.21.15.79:0/3293522643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46f806b2f0 0x7f46f814d760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f46f402a180 tx=0x7f46f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.498+0000 7f46ee7fc640 1 -- 172.21.15.79:0/3293522643 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4037040 con 0x7f46f806b2f0 2024-04-25T02:08:20.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.498+0000 7f46ee7fc640 1 -- 172.21.15.79:0/3293522643 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f4042070 con 0x7f46f806b2f0 2024-04-25T02:08:20.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.498+0000 7f4700088640 1 -- 172.21.15.79:0/3293522643 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f8152000 con 0x7f46f806b2f0 2024-04-25T02:08:20.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.498+0000 7f46ee7fc640 1 -- 172.21.15.79:0/3293522643 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f40308a0 con 0x7f46f806b2f0 2024-04-25T02:08:20.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.498+0000 7f4700088640 1 -- 172.21.15.79:0/3293522643 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f81525c0 con 0x7f46f806b2f0 2024-04-25T02:08:20.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.499+0000 7f4700088640 1 -- 172.21.15.79:0/3293522643 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f80690a0 con 0x7f46f806b2f0 2024-04-25T02:08:20.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.499+0000 7f46ee7fc640 1 -- 172.21.15.79:0/3293522643 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46f4030a40 con 0x7f46f806b2f0 2024-04-25T02:08:20.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.500+0000 7f46ee7fc640 1 --2- 172.21.15.79:0/3293522643 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f46dc06be30 0x7f46dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.500+0000 7f46ee7fc640 1 -- 172.21.15.79:0/3293522643 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f46f40ab700 con 0x7f46f806b2f0 2024-04-25T02:08:20.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.500+0000 7f46fd623640 1 --2- 172.21.15.79:0/3293522643 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f46dc06be30 0x7f46dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.500+0000 7f46fd623640 1 --2- 172.21.15.79:0/3293522643 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f46dc06be30 0x7f46dc06e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f46e8006a90 tx=0x7f46e8006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:20.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.504+0000 7f46ee7fc640 1 -- 172.21.15.79:0/3293522643 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f46f407a120 con 0x7f46f806b2f0 2024-04-25T02:08:20.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.676+0000 7f4700088640 1 -- 172.21.15.79:0/3293522643 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f46f80cf4f0 con 0x7f46f806b2f0 2024-04-25T02:08:20.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.677+0000 7f46ee7fc640 1 -- 172.21.15.79:0/3293522643 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f46f4079a20 con 0x7f46f806b2f0 2024-04-25T02:08:20.684 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:08:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.678+0000 7f4700088640 1 -- 172.21.15.79:0/3293522643 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f46dc06be30 msgr2=0x7f46dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.678+0000 7f4700088640 1 --2- 172.21.15.79:0/3293522643 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f46dc06be30 0x7f46dc06e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f46e8006a90 tx=0x7f46e8006a20 comp rx=0 tx=0).stop 2024-04-25T02:08:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.678+0000 7f4700088640 1 -- 172.21.15.79:0/3293522643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46f806b2f0 msgr2=0x7f46f814d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.678+0000 7f4700088640 1 --2- 172.21.15.79:0/3293522643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46f806b2f0 0x7f46f814d760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f46f402a180 tx=0x7f46f40046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.678+0000 7f4700088640 1 -- 172.21.15.79:0/3293522643 shutdown_connections 2024-04-25T02:08:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.678+0000 7f4700088640 1 --2- 172.21.15.79:0/3293522643 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f46dc06be30 0x7f46dc06e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.678+0000 7f4700088640 1 --2- 172.21.15.79:0/3293522643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46f80cf7a0 0x7f46f809d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.678+0000 7f4700088640 1 --2- 172.21.15.79:0/3293522643 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46f806e6b0 0x7f46f81512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.678+0000 7f4700088640 1 --2- 172.21.15.79:0/3293522643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46f806b2f0 0x7f46f814d760 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.678+0000 7f4700088640 1 -- 172.21.15.79:0/3293522643 >> 172.21.15.79:0/3293522643 conn(0x7f46f80b1cd0 msgr2=0x7f46f806d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.679+0000 7f4700088640 1 -- 172.21.15.79:0/3293522643 shutdown_connections 2024-04-25T02:08:20.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.679+0000 7f4700088640 1 -- 172.21.15.79:0/3293522643 wait complete. 2024-04-25T02:08:20.696 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:08:20.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.789+0000 7f9412029640 1 Processor -- start 2024-04-25T02:08:20.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.789+0000 7f9412029640 1 -- start start 2024-04-25T02:08:20.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.790+0000 7f9412029640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f940c15c100 0x7f940c06f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.790+0000 7f9412029640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f940c15c4e0 con 0x7f940c0721a0 2024-04-25T02:08:20.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.790+0000 7f9412029640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f940c06ff40 con 0x7f940c06c7d0 2024-04-25T02:08:20.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.790+0000 7f9412029640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f940c0ce110 con 0x7f940c15c100 2024-04-25T02:08:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.790+0000 7f940affd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f940c0721a0 0x7f940c06c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60090/0 (socket says 172.21.15.79:60090) 2024-04-25T02:08:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.790+0000 7f940affd640 1 -- 172.21.15.79:0/2559476748 learned_addr learned my addr 172.21.15.79:0/2559476748 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.790+0000 7f940b7fe640 1 --2- 172.21.15.79:0/2559476748 >> v2:172.21.15.189:3300/0 conn(0x7f940c15c100 0x7f940c06f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.791+0000 7f940a7fc640 1 -- 172.21.15.79:0/2559476748 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1640815650 0 0) 0x7f940c15c4e0 con 0x7f940c0721a0 2024-04-25T02:08:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.791+0000 7f940a7fc640 1 -- 172.21.15.79:0/2559476748 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93f4003520 con 0x7f940c0721a0 2024-04-25T02:08:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.791+0000 7f940a7fc640 1 -- 172.21.15.79:0/2559476748 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1454104908 0 0) 0x7f940c06ff40 con 0x7f940c06c7d0 2024-04-25T02:08:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.791+0000 7f940a7fc640 1 -- 172.21.15.79:0/2559476748 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f940c15c4e0 con 0x7f940c06c7d0 2024-04-25T02:08:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.791+0000 7f940b7fe640 1 -- 172.21.15.79:0/2559476748 >> v1:172.21.15.189:6789/0 conn(0x7f940c06c7d0 legacy=0x7f940c0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.791+0000 7f940b7fe640 1 -- 172.21.15.79:0/2559476748 >> v1:172.21.15.79:6789/0 conn(0x7f940c0721a0 legacy=0x7f940c06c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.791+0000 7f940b7fe640 1 -- 172.21.15.79:0/2559476748 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940c0ce360 con 0x7f940c15c100 2024-04-25T02:08:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.791+0000 7f940b7fe640 1 --2- 172.21.15.79:0/2559476748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f940c15c100 0x7f940c06f880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0097a0 tx=0x7f93fc02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1730c066268c6a92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.792+0000 7f940a7fc640 1 -- 172.21.15.79:0/2559476748 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc037070 con 0x7f940c15c100 2024-04-25T02:08:20.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.792+0000 7f940a7fc640 1 -- 172.21.15.79:0/2559476748 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93fc032440 con 0x7f940c15c100 2024-04-25T02:08:20.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.792+0000 7f940a7fc640 1 -- 172.21.15.79:0/2559476748 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc0327f0 con 0x7f940c15c100 2024-04-25T02:08:20.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.792+0000 7f9412029640 1 -- 172.21.15.79:0/2559476748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f940c15c100 msgr2=0x7f940c06f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.792+0000 7f9412029640 1 --2- 172.21.15.79:0/2559476748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f940c15c100 0x7f940c06f880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0097a0 tx=0x7f93fc02a230 comp rx=0 tx=0).stop 2024-04-25T02:08:20.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.792+0000 7f9412029640 1 -- 172.21.15.79:0/2559476748 shutdown_connections 2024-04-25T02:08:20.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.792+0000 7f9412029640 1 --2- 172.21.15.79:0/2559476748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f940c15c100 0x7f940c06f880 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.792+0000 7f9412029640 1 -- 172.21.15.79:0/2559476748 >> 172.21.15.79:0/2559476748 conn(0x7f940c0716b0 msgr2=0x7f940c071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:20.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.792+0000 7f9412029640 1 -- 172.21.15.79:0/2559476748 shutdown_connections 2024-04-25T02:08:20.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.792+0000 7f9412029640 1 -- 172.21.15.79:0/2559476748 wait complete. 2024-04-25T02:08:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.793+0000 7f9412029640 1 Processor -- start 2024-04-25T02:08:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.794+0000 7f9412029640 1 -- start start 2024-04-25T02:08:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.794+0000 7f9412029640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f940c06c7d0 0x7f940c1f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.794+0000 7f9412029640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f940c0721a0 0x7f940c1534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.794+0000 7f9412029640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f940c15c100 0x7f940c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.794+0000 7f9412029640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f940c0afd40 con 0x7f940c15c100 2024-04-25T02:08:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.794+0000 7f9412029640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f940c0ce920 con 0x7f940c0721a0 2024-04-25T02:08:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.794+0000 7f9412029640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f940c0cf550 con 0x7f940c06c7d0 2024-04-25T02:08:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.794+0000 7f940bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f940c15c100 0x7f940c159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.794+0000 7f940bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f940c15c100 0x7f940c159e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57378/0 (socket says 172.21.15.79:57378) 2024-04-25T02:08:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.794+0000 7f940bfff640 1 -- 172.21.15.79:0/1194902649 learned_addr learned my addr 172.21.15.79:0/1194902649 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.795+0000 7f940affd640 1 --2- 172.21.15.79:0/1194902649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f940c0721a0 0x7f940c1534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.795+0000 7f940b7fe640 1 --2- 172.21.15.79:0/1194902649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f940c06c7d0 0x7f940c1f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.795+0000 7f940bfff640 1 -- 172.21.15.79:0/1194902649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f940c06c7d0 msgr2=0x7f940c1f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.795+0000 7f940bfff640 1 --2- 172.21.15.79:0/1194902649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f940c06c7d0 0x7f940c1f50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.795+0000 7f940bfff640 1 -- 172.21.15.79:0/1194902649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f940c0721a0 msgr2=0x7f940c1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.795+0000 7f940bfff640 1 --2- 172.21.15.79:0/1194902649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f940c0721a0 0x7f940c1534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.795+0000 7f940bfff640 1 -- 172.21.15.79:0/1194902649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940c151470 con 0x7f940c15c100 2024-04-25T02:08:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.795+0000 7f940b7fe640 1 --2- 172.21.15.79:0/1194902649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f940c06c7d0 0x7f940c1f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.795+0000 7f940bfff640 1 --2- 172.21.15.79:0/1194902649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f940c15c100 0x7f940c159e40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f940400c7c0 tx=0x7f940400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.795+0000 7f93f3fff640 1 -- 172.21.15.79:0/1194902649 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9404003b70 con 0x7f940c15c100 2024-04-25T02:08:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.795+0000 7f93f3fff640 1 -- 172.21.15.79:0/1194902649 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9404003d10 con 0x7f940c15c100 2024-04-25T02:08:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.795+0000 7f9412029640 1 -- 172.21.15.79:0/1194902649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940c151750 con 0x7f940c15c100 2024-04-25T02:08:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.795+0000 7f93f3fff640 1 -- 172.21.15.79:0/1194902649 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940400aa50 con 0x7f940c15c100 2024-04-25T02:08:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.795+0000 7f9412029640 1 -- 172.21.15.79:0/1194902649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f940c151d10 con 0x7f940c15c100 2024-04-25T02:08:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.796+0000 7f9412029640 1 -- 172.21.15.79:0/1194902649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f940c0690a0 con 0x7f940c15c100 2024-04-25T02:08:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.796+0000 7f93f3fff640 1 -- 172.21.15.79:0/1194902649 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f940400abf0 con 0x7f940c15c100 2024-04-25T02:08:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.797+0000 7f93f3fff640 1 --2- 172.21.15.79:0/1194902649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f93f806be30 0x7f93f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.797+0000 7f940b7fe640 1 --2- 172.21.15.79:0/1194902649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f93f806be30 0x7f93f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.797+0000 7f93f3fff640 1 -- 172.21.15.79:0/1194902649 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f940408ad00 con 0x7f940c15c100 2024-04-25T02:08:20.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.797+0000 7f940b7fe640 1 --2- 172.21.15.79:0/1194902649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f93f806be30 0x7f93f806e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f93fc034000 tx=0x7f93fc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:20.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.801+0000 7f93f3fff640 1 -- 172.21.15.79:0/1194902649 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9404059720 con 0x7f940c15c100 2024-04-25T02:08:20.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.973+0000 7f9412029640 1 -- 172.21.15.79:0/1194902649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f940c066f70 con 0x7f940c15c100 2024-04-25T02:08:20.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.974+0000 7f93f3fff640 1 -- 172.21.15.79:0/1194902649 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f9404059020 con 0x7f940c15c100 2024-04-25T02:08:20.981 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:08:20.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.975+0000 7f9412029640 1 -- 172.21.15.79:0/1194902649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f93f806be30 msgr2=0x7f93f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.975+0000 7f9412029640 1 --2- 172.21.15.79:0/1194902649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f93f806be30 0x7f93f806e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f93fc034000 tx=0x7f93fc02e000 comp rx=0 tx=0).stop 2024-04-25T02:08:20.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.975+0000 7f9412029640 1 -- 172.21.15.79:0/1194902649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f940c15c100 msgr2=0x7f940c159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.975+0000 7f9412029640 1 --2- 172.21.15.79:0/1194902649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f940c15c100 0x7f940c159e40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f940400c7c0 tx=0x7f940400cc80 comp rx=0 tx=0).stop 2024-04-25T02:08:20.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.976+0000 7f9412029640 1 -- 172.21.15.79:0/1194902649 shutdown_connections 2024-04-25T02:08:20.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.976+0000 7f9412029640 1 --2- 172.21.15.79:0/1194902649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f93f806be30 0x7f93f806e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.976+0000 7f9412029640 1 --2- 172.21.15.79:0/1194902649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f940c15c100 0x7f940c159e40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.976+0000 7f9412029640 1 --2- 172.21.15.79:0/1194902649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f940c0721a0 0x7f940c1534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.976+0000 7f9412029640 1 --2- 172.21.15.79:0/1194902649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f940c06c7d0 0x7f940c1f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.976+0000 7f9412029640 1 -- 172.21.15.79:0/1194902649 >> 172.21.15.79:0/1194902649 conn(0x7f940c0716b0 msgr2=0x7f940c0b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:20.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.976+0000 7f9412029640 1 -- 172.21.15.79:0/1194902649 shutdown_connections 2024-04-25T02:08:20.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:20.976+0000 7f9412029640 1 -- 172.21.15.79:0/1194902649 wait complete. 2024-04-25T02:08:20.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:08:21.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.086+0000 7fc2f8c29640 1 Processor -- start 2024-04-25T02:08:21.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.086+0000 7fc2f8c29640 1 -- start start 2024-04-25T02:08:21.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.087+0000 7fc2f8c29640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2f40b41b0 0x7fc2f41605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.087+0000 7fc2f8c29640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2f406b2f0 0x7fc2f406b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.087+0000 7fc2f8c29640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc2f4155f00 0x7fc2f4156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.087+0000 7fc2f8c29640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f4071cd0 con 0x7fc2f406b2f0 2024-04-25T02:08:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.087+0000 7fc2f8c29640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f4071fb0 con 0x7fc2f4155f00 2024-04-25T02:08:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.087+0000 7fc2f8c29640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f4072290 con 0x7fc2f40b41b0 2024-04-25T02:08:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.087+0000 7fc2f1d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2f406b2f0 0x7fc2f406b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.087+0000 7fc2f1d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2f406b2f0 0x7fc2f406b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57394/0 (socket says 172.21.15.79:57394) 2024-04-25T02:08:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.087+0000 7fc2f1d9b640 1 -- 172.21.15.79:0/3237832495 learned_addr learned my addr 172.21.15.79:0/3237832495 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.087+0000 7fc2f2d9d640 1 --2- 172.21.15.79:0/3237832495 >> v2:172.21.15.189:3300/0 conn(0x7fc2f4155f00 0x7fc2f4156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.087+0000 7fc2f259c640 1 --2- 172.21.15.79:0/3237832495 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2f40b41b0 0x7fc2f41605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.088+0000 7fc2f1d9b640 1 -- 172.21.15.79:0/3237832495 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2f40b41b0 msgr2=0x7fc2f41605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.088+0000 7fc2f1d9b640 1 --2- 172.21.15.79:0/3237832495 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2f40b41b0 0x7fc2f41605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.088+0000 7fc2f1d9b640 1 -- 172.21.15.79:0/3237832495 >> v2:172.21.15.189:3300/0 conn(0x7fc2f4155f00 msgr2=0x7fc2f4156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.088+0000 7fc2f1d9b640 1 --2- 172.21.15.79:0/3237832495 >> v2:172.21.15.189:3300/0 conn(0x7fc2f4155f00 0x7fc2f4156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.088+0000 7fc2f1d9b640 1 -- 172.21.15.79:0/3237832495 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f4072570 con 0x7fc2f406b2f0 2024-04-25T02:08:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.088+0000 7fc2f1d9b640 1 --2- 172.21.15.79:0/3237832495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f406b2f0 0x7fc2f406b770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2f406f240 tx=0x7fc2e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ae2d71939defe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.088+0000 7fc2f159a640 1 -- 172.21.15.79:0/3237832495 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8037070 con 0x7fc2f406b2f0 2024-04-25T02:08:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.088+0000 7fc2f159a640 1 -- 172.21.15.79:0/3237832495 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e8032440 con 0x7fc2f406b2f0 2024-04-25T02:08:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.088+0000 7fc2f159a640 1 -- 172.21.15.79:0/3237832495 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8032810 con 0x7fc2f406b2f0 2024-04-25T02:08:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.089+0000 7fc2f8c29640 1 -- 172.21.15.79:0/3237832495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f406b2f0 msgr2=0x7fc2f406b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.089+0000 7fc2f8c29640 1 --2- 172.21.15.79:0/3237832495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f406b2f0 0x7fc2f406b770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2f406f240 tx=0x7fc2e802a1e0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.089+0000 7fc2f8c29640 1 -- 172.21.15.79:0/3237832495 shutdown_connections 2024-04-25T02:08:21.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.089+0000 7fc2f8c29640 1 --2- 172.21.15.79:0/3237832495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f406b2f0 0x7fc2f406b770 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.089+0000 7fc2f8c29640 1 --2- 172.21.15.79:0/3237832495 >> v2:172.21.15.189:3300/0 conn(0x7fc2f4155f00 0x7fc2f4156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.089+0000 7fc2f8c29640 1 --2- 172.21.15.79:0/3237832495 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2f40b41b0 0x7fc2f41605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.089+0000 7fc2f8c29640 1 -- 172.21.15.79:0/3237832495 >> 172.21.15.79:0/3237832495 conn(0x7fc2f40b1cd0 msgr2=0x7fc2f40b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:21.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.089+0000 7fc2f8c29640 1 -- 172.21.15.79:0/3237832495 shutdown_connections 2024-04-25T02:08:21.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.089+0000 7fc2f8c29640 1 -- 172.21.15.79:0/3237832495 wait complete. 2024-04-25T02:08:21.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.090+0000 7fc2f8c29640 1 Processor -- start 2024-04-25T02:08:21.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.090+0000 7fc2f8c29640 1 -- start start 2024-04-25T02:08:21.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.091+0000 7fc2f8c29640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2f406b2f0 0x7fc2f4156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.091+0000 7fc2f8c29640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2f40b41b0 0x7fc2f4142590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.091+0000 7fc2f8c29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f4155f00 0x7fc2f415de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.091+0000 7fc2f8c29640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f415c870 con 0x7fc2f4155f00 2024-04-25T02:08:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.091+0000 7fc2f8c29640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4072d70 con 0x7fc2f406b2f0 2024-04-25T02:08:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.091+0000 7fc2f8c29640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f40b4590 con 0x7fc2f40b41b0 2024-04-25T02:08:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.091+0000 7fc2f2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f4155f00 0x7fc2f415de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.091+0000 7fc2f2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f4155f00 0x7fc2f415de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57404/0 (socket says 172.21.15.79:57404) 2024-04-25T02:08:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.091+0000 7fc2f2d9d640 1 -- 172.21.15.79:0/2714297956 learned_addr learned my addr 172.21.15.79:0/2714297956 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.091+0000 7fc2f1d9b640 1 --2- 172.21.15.79:0/2714297956 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2f40b41b0 0x7fc2f4142590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.091+0000 7fc2f259c640 1 --2- 172.21.15.79:0/2714297956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2f406b2f0 0x7fc2f4156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.092+0000 7fc2f2d9d640 1 -- 172.21.15.79:0/2714297956 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2f40b41b0 msgr2=0x7fc2f4142590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.092+0000 7fc2f2d9d640 1 --2- 172.21.15.79:0/2714297956 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2f40b41b0 0x7fc2f4142590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.092+0000 7fc2f2d9d640 1 -- 172.21.15.79:0/2714297956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2f406b2f0 msgr2=0x7fc2f4156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.092+0000 7fc2f2d9d640 1 --2- 172.21.15.79:0/2714297956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2f406b2f0 0x7fc2f4156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.092+0000 7fc2f2d9d640 1 -- 172.21.15.79:0/2714297956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f41568b0 con 0x7fc2f4155f00 2024-04-25T02:08:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.092+0000 7fc2f259c640 1 --2- 172.21.15.79:0/2714297956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2f406b2f0 0x7fc2f4156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.092+0000 7fc2f2d9d640 1 --2- 172.21.15.79:0/2714297956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f4155f00 0x7fc2f415de20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec007e60 tx=0x7fc2ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.092+0000 7fc2e2ffd640 1 -- 172.21.15.79:0/2714297956 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec014420 con 0x7fc2f4155f00 2024-04-25T02:08:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.092+0000 7fc2e2ffd640 1 -- 172.21.15.79:0/2714297956 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ec019070 con 0x7fc2f4155f00 2024-04-25T02:08:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.092+0000 7fc2f8c29640 1 -- 172.21.15.79:0/2714297956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f414fb90 con 0x7fc2f4155f00 2024-04-25T02:08:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.092+0000 7fc2e2ffd640 1 -- 172.21.15.79:0/2714297956 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec014820 con 0x7fc2f4155f00 2024-04-25T02:08:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.092+0000 7fc2f8c29640 1 -- 172.21.15.79:0/2714297956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f415ec70 con 0x7fc2f4155f00 2024-04-25T02:08:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.093+0000 7fc2f8c29640 1 -- 172.21.15.79:0/2714297956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f40690a0 con 0x7fc2f4155f00 2024-04-25T02:08:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.093+0000 7fc2e2ffd640 1 -- 172.21.15.79:0/2714297956 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2ec0149c0 con 0x7fc2f4155f00 2024-04-25T02:08:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.094+0000 7fc2e2ffd640 1 --2- 172.21.15.79:0/2714297956 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2d406be30 0x7fc2d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.094+0000 7fc2f259c640 1 --2- 172.21.15.79:0/2714297956 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2d406be30 0x7fc2d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.094+0000 7fc2e2ffd640 1 -- 172.21.15.79:0/2714297956 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc2ec08b690 con 0x7fc2f4155f00 2024-04-25T02:08:21.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.094+0000 7fc2f259c640 1 --2- 172.21.15.79:0/2714297956 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2d406be30 0x7fc2d406e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4006fd0 tx=0x7fc2e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:21.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.098+0000 7fc2e2ffd640 1 -- 172.21.15.79:0/2714297956 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc2ec059f30 con 0x7fc2f4155f00 2024-04-25T02:08:21.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.274+0000 7fc2f8c29640 1 -- 172.21.15.79:0/2714297956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc2f40b21e0 con 0x7fc2f4155f00 2024-04-25T02:08:21.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.274+0000 7fc2e2ffd640 1 -- 172.21.15.79:0/2714297956 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fc2ec059830 con 0x7fc2f4155f00 2024-04-25T02:08:21.281 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:08:21.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.276+0000 7fc2f8c29640 1 -- 172.21.15.79:0/2714297956 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2d406be30 msgr2=0x7fc2d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.276+0000 7fc2f8c29640 1 --2- 172.21.15.79:0/2714297956 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2d406be30 0x7fc2d406e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4006fd0 tx=0x7fc2e4008040 comp rx=0 tx=0).stop 2024-04-25T02:08:21.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.276+0000 7fc2f8c29640 1 -- 172.21.15.79:0/2714297956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f4155f00 msgr2=0x7fc2f415de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.276+0000 7fc2f8c29640 1 --2- 172.21.15.79:0/2714297956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f4155f00 0x7fc2f415de20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec007e60 tx=0x7fc2ec00e4b0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.276+0000 7fc2f8c29640 1 -- 172.21.15.79:0/2714297956 shutdown_connections 2024-04-25T02:08:21.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.276+0000 7fc2f8c29640 1 --2- 172.21.15.79:0/2714297956 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2d406be30 0x7fc2d406e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.276+0000 7fc2f8c29640 1 --2- 172.21.15.79:0/2714297956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f4155f00 0x7fc2f415de20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.276+0000 7fc2f8c29640 1 --2- 172.21.15.79:0/2714297956 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2f40b41b0 0x7fc2f4142590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.276+0000 7fc2f8c29640 1 --2- 172.21.15.79:0/2714297956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2f406b2f0 0x7fc2f4156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.276+0000 7fc2f8c29640 1 -- 172.21.15.79:0/2714297956 >> 172.21.15.79:0/2714297956 conn(0x7fc2f40b1cd0 msgr2=0x7fc2f40acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:21.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.276+0000 7fc2f8c29640 1 -- 172.21.15.79:0/2714297956 shutdown_connections 2024-04-25T02:08:21.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.276+0000 7fc2f8c29640 1 -- 172.21.15.79:0/2714297956 wait complete. 2024-04-25T02:08:21.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:21.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.383+0000 7fd6a453b640 1 Processor -- start 2024-04-25T02:08:21.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.383+0000 7fd6a453b640 1 -- start start 2024-04-25T02:08:21.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.384+0000 7fd6a453b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd69c143bc0 0x7fd69c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.384+0000 7fd6a453b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd69c06df50 0x7fd69c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.384+0000 7fd6a453b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd69c0b48e0 0x7fd69c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.384+0000 7fd6a453b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd69c06e8f0 con 0x7fd69c0b48e0 2024-04-25T02:08:21.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.384+0000 7fd6a453b640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd69c072cb0 con 0x7fd69c143bc0 2024-04-25T02:08:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.384+0000 7fd6a453b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd69c15fa40 con 0x7fd69c06df50 2024-04-25T02:08:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.384+0000 7fd6a2ad8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd69c0b48e0 0x7fd69c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.384+0000 7fd6a2ad8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd69c0b48e0 0x7fd69c0b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57410/0 (socket says 172.21.15.79:57410) 2024-04-25T02:08:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.384+0000 7fd6a2ad8640 1 -- 172.21.15.79:0/3554233074 learned_addr learned my addr 172.21.15.79:0/3554233074 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.384+0000 7fd6a22d7640 1 --2- 172.21.15.79:0/3554233074 >> v2:172.21.15.189:3300/0 conn(0x7fd69c143bc0 0x7fd69c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.384+0000 7fd6a1ad6640 1 --2- 172.21.15.79:0/3554233074 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd69c06df50 0x7fd69c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.385+0000 7fd6a2ad8640 1 -- 172.21.15.79:0/3554233074 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd69c06df50 msgr2=0x7fd69c06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.385+0000 7fd6a2ad8640 1 --2- 172.21.15.79:0/3554233074 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd69c06df50 0x7fd69c06e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.385+0000 7fd6a2ad8640 1 -- 172.21.15.79:0/3554233074 >> v2:172.21.15.189:3300/0 conn(0x7fd69c143bc0 msgr2=0x7fd69c15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.385+0000 7fd6a2ad8640 1 --2- 172.21.15.79:0/3554233074 >> v2:172.21.15.189:3300/0 conn(0x7fd69c143bc0 0x7fd69c15f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.385+0000 7fd6a2ad8640 1 -- 172.21.15.79:0/3554233074 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c0720a0 con 0x7fd69c0b48e0 2024-04-25T02:08:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.385+0000 7fd6a2ad8640 1 --2- 172.21.15.79:0/3554233074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd69c0b48e0 0x7fd69c0b4d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd69c067b50 tx=0x7fd69402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b9ea7540b84dca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.385+0000 7fd6a12d5640 1 -- 172.21.15.79:0/3554233074 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694037070 con 0x7fd69c0b48e0 2024-04-25T02:08:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.385+0000 7fd6a12d5640 1 -- 172.21.15.79:0/3554233074 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd694032440 con 0x7fd69c0b48e0 2024-04-25T02:08:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.385+0000 7fd6a12d5640 1 -- 172.21.15.79:0/3554233074 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694032810 con 0x7fd69c0b48e0 2024-04-25T02:08:21.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.386+0000 7fd6a453b640 1 -- 172.21.15.79:0/3554233074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd69c0b48e0 msgr2=0x7fd69c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.386+0000 7fd6a453b640 1 --2- 172.21.15.79:0/3554233074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd69c0b48e0 0x7fd69c0b4d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd69c067b50 tx=0x7fd69402a140 comp rx=0 tx=0).stop 2024-04-25T02:08:21.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.386+0000 7fd6a453b640 1 -- 172.21.15.79:0/3554233074 shutdown_connections 2024-04-25T02:08:21.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.386+0000 7fd6a453b640 1 --2- 172.21.15.79:0/3554233074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd69c0b48e0 0x7fd69c0b4d40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.386+0000 7fd6a453b640 1 --2- 172.21.15.79:0/3554233074 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd69c06df50 0x7fd69c06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.386+0000 7fd6a453b640 1 --2- 172.21.15.79:0/3554233074 >> v2:172.21.15.189:3300/0 conn(0x7fd69c143bc0 0x7fd69c15f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.386+0000 7fd6a453b640 1 -- 172.21.15.79:0/3554233074 >> 172.21.15.79:0/3554233074 conn(0x7fd69c0cfc80 msgr2=0x7fd69c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:21.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.386+0000 7fd6a453b640 1 -- 172.21.15.79:0/3554233074 shutdown_connections 2024-04-25T02:08:21.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.386+0000 7fd6a453b640 1 -- 172.21.15.79:0/3554233074 wait complete. 2024-04-25T02:08:21.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.387+0000 7fd6a453b640 1 Processor -- start 2024-04-25T02:08:21.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.387+0000 7fd6a453b640 1 -- start start 2024-04-25T02:08:21.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a453b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd69c06df50 0x7fd69c1647a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a453b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd69c0b48e0 0x7fd69c162290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a453b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd69c143bc0 0x7fd69c0afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a453b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c072940 con 0x7fd69c143bc0 2024-04-25T02:08:21.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a453b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c072660 con 0x7fd69c06df50 2024-04-25T02:08:21.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a453b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd69c143fa0 con 0x7fd69c0b48e0 2024-04-25T02:08:21.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a2ad8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd69c143bc0 0x7fd69c0afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a2ad8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd69c143bc0 0x7fd69c0afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57420/0 (socket says 172.21.15.79:57420) 2024-04-25T02:08:21.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a2ad8640 1 -- 172.21.15.79:0/424115188 learned_addr learned my addr 172.21.15.79:0/424115188 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:21.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a2ad8640 1 -- 172.21.15.79:0/424115188 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd69c0b48e0 msgr2=0x7fd69c162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a2ad8640 1 --2- 172.21.15.79:0/424115188 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd69c0b48e0 0x7fd69c162290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a2ad8640 1 -- 172.21.15.79:0/424115188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd69c06df50 msgr2=0x7fd69c1647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a22d7640 1 --2- 172.21.15.79:0/424115188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd69c06df50 0x7fd69c1647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a2ad8640 1 --2- 172.21.15.79:0/424115188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd69c06df50 0x7fd69c1647a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a2ad8640 1 -- 172.21.15.79:0/424115188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c0b0bb0 con 0x7fd69c143bc0 2024-04-25T02:08:21.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.388+0000 7fd6a2ad8640 1 --2- 172.21.15.79:0/424115188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd69c143bc0 0x7fd69c0afc10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd6940090b0 tx=0x7fd6940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:21.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.389+0000 7fd692ffd640 1 -- 172.21.15.79:0/424115188 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694037040 con 0x7fd69c143bc0 2024-04-25T02:08:21.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.389+0000 7fd692ffd640 1 -- 172.21.15.79:0/424115188 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd694042070 con 0x7fd69c143bc0 2024-04-25T02:08:21.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.389+0000 7fd6a453b640 1 -- 172.21.15.79:0/424115188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69c0b0e90 con 0x7fd69c143bc0 2024-04-25T02:08:21.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.389+0000 7fd692ffd640 1 -- 172.21.15.79:0/424115188 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694030920 con 0x7fd69c143bc0 2024-04-25T02:08:21.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.389+0000 7fd6a453b640 1 -- 172.21.15.79:0/424115188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69c164280 con 0x7fd69c143bc0 2024-04-25T02:08:21.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.390+0000 7fd6a453b640 1 -- 172.21.15.79:0/424115188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69c0690a0 con 0x7fd69c143bc0 2024-04-25T02:08:21.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.390+0000 7fd692ffd640 1 -- 172.21.15.79:0/424115188 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd694030ac0 con 0x7fd69c143bc0 2024-04-25T02:08:21.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.390+0000 7fd692ffd640 1 --2- 172.21.15.79:0/424115188 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd68006be30 0x7fd68006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.390+0000 7fd692ffd640 1 -- 172.21.15.79:0/424115188 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd6940ab7a0 con 0x7fd69c143bc0 2024-04-25T02:08:21.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.390+0000 7fd6a22d7640 1 --2- 172.21.15.79:0/424115188 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd68006be30 0x7fd68006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.391+0000 7fd6a22d7640 1 --2- 172.21.15.79:0/424115188 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd68006be30 0x7fd68006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd69c13fe60 tx=0x7fd69800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:21.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.395+0000 7fd692ffd640 1 -- 172.21.15.79:0/424115188 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd694079b00 con 0x7fd69c143bc0 2024-04-25T02:08:21.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.570+0000 7fd6a453b640 1 -- 172.21.15.79:0/424115188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd69c06c0c0 con 0x7fd69c143bc0 2024-04-25T02:08:21.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.571+0000 7fd692ffd640 1 -- 172.21.15.79:0/424115188 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7fd69407de00 con 0x7fd69c143bc0 2024-04-25T02:08:21.579 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:21.579 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:21.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.573+0000 7fd6a453b640 1 -- 172.21.15.79:0/424115188 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd68006be30 msgr2=0x7fd68006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.573+0000 7fd6a453b640 1 --2- 172.21.15.79:0/424115188 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd68006be30 0x7fd68006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd69c13fe60 tx=0x7fd69800b040 comp rx=0 tx=0).stop 2024-04-25T02:08:21.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.574+0000 7fd6a453b640 1 -- 172.21.15.79:0/424115188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd69c143bc0 msgr2=0x7fd69c0afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.574+0000 7fd6a453b640 1 --2- 172.21.15.79:0/424115188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd69c143bc0 0x7fd69c0afc10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd6940090b0 tx=0x7fd6940046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.574+0000 7fd6a453b640 1 -- 172.21.15.79:0/424115188 shutdown_connections 2024-04-25T02:08:21.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.574+0000 7fd6a453b640 1 --2- 172.21.15.79:0/424115188 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd68006be30 0x7fd68006e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.574+0000 7fd6a453b640 1 --2- 172.21.15.79:0/424115188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd69c143bc0 0x7fd69c0afc10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.574+0000 7fd6a453b640 1 --2- 172.21.15.79:0/424115188 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd69c0b48e0 0x7fd69c162290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.574+0000 7fd6a453b640 1 --2- 172.21.15.79:0/424115188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd69c06df50 0x7fd69c1647a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.574+0000 7fd6a453b640 1 -- 172.21.15.79:0/424115188 >> 172.21.15.79:0/424115188 conn(0x7fd69c0cfc80 msgr2=0x7fd69c0cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:21.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.574+0000 7fd6a453b640 1 -- 172.21.15.79:0/424115188 shutdown_connections 2024-04-25T02:08:21.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.574+0000 7fd6a453b640 1 -- 172.21.15.79:0/424115188 wait complete. 2024-04-25T02:08:21.591 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:57.115253+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:58.421392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:08:21.592 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:08:21.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.684+0000 7f65aa6ba640 1 Processor -- start 2024-04-25T02:08:21.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.684+0000 7f65aa6ba640 1 -- start start 2024-04-25T02:08:21.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.685+0000 7f65aa6ba640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65a415a810 0x7f65a40cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.685+0000 7f65aa6ba640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65a415abf0 con 0x7f65a409dcb0 2024-04-25T02:08:21.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.685+0000 7f65aa6ba640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65a40ce580 con 0x7f65a4071460 2024-04-25T02:08:21.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.685+0000 7f65aa6ba640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f65a4073050 con 0x7f65a415a810 2024-04-25T02:08:21.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.685+0000 7f65a3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65a415a810 0x7f65a40cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.685+0000 7f65a37fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f65a409dcb0 0x7f65a4070d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60106/0 (socket says 172.21.15.79:60106) 2024-04-25T02:08:21.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.685+0000 7f65a37fe640 1 -- 172.21.15.79:0/1696773069 learned_addr learned my addr 172.21.15.79:0/1696773069 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:21.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.685+0000 7f65a3fff640 1 -- 172.21.15.79:0/1696773069 >> v1:172.21.15.189:6789/0 conn(0x7f65a4071460 legacy=0x7f65a40b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:21.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.685+0000 7f65a3fff640 1 -- 172.21.15.79:0/1696773069 >> v1:172.21.15.79:6789/0 conn(0x7f65a409dcb0 legacy=0x7f65a4070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.685+0000 7f65a3fff640 1 -- 172.21.15.79:0/1696773069 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a40ce860 con 0x7f65a415a810 2024-04-25T02:08:21.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.686+0000 7f65a3fff640 1 --2- 172.21.15.79:0/1696773069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a415a810 0x7f65a40cc820 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f65940097a0 tx=0x7f659402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f22cf0b3025ed4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:21.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.686+0000 7f65a2ffd640 1 -- 172.21.15.79:0/1696773069 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6594037070 con 0x7f65a415a810 2024-04-25T02:08:21.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.686+0000 7f65a2ffd640 1 -- 172.21.15.79:0/1696773069 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f659402ae50 con 0x7f65a415a810 2024-04-25T02:08:21.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.686+0000 7f65a2ffd640 1 -- 172.21.15.79:0/1696773069 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6594032660 con 0x7f65a415a810 2024-04-25T02:08:21.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.687+0000 7f65aa6ba640 1 -- 172.21.15.79:0/1696773069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a415a810 msgr2=0x7f65a40cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.687+0000 7f65aa6ba640 1 --2- 172.21.15.79:0/1696773069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a415a810 0x7f65a40cc820 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f65940097a0 tx=0x7f659402a140 comp rx=0 tx=0).stop 2024-04-25T02:08:21.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.687+0000 7f65aa6ba640 1 -- 172.21.15.79:0/1696773069 shutdown_connections 2024-04-25T02:08:21.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.687+0000 7f65aa6ba640 1 --2- 172.21.15.79:0/1696773069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a415a810 0x7f65a40cc820 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.687+0000 7f65aa6ba640 1 -- 172.21.15.79:0/1696773069 >> 172.21.15.79:0/1696773069 conn(0x7f65a40b1cd0 msgr2=0x7f65a40b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:21.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.687+0000 7f65aa6ba640 1 -- 172.21.15.79:0/1696773069 shutdown_connections 2024-04-25T02:08:21.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.687+0000 7f65aa6ba640 1 -- 172.21.15.79:0/1696773069 wait complete. 2024-04-25T02:08:21.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.688+0000 7f65aa6ba640 1 Processor -- start 2024-04-25T02:08:21.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.688+0000 7f65aa6ba640 1 -- start start 2024-04-25T02:08:21.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65aa6ba640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65a409dcb0 0x7f65a4142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65aa6ba640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f65a415a810 0x7f65a409d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65aa6ba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a40b1120 0x7f65a4148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65aa6ba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f65a40cc020 con 0x7f65a40b1120 2024-04-25T02:08:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65aa6ba640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f65a40cbdd0 con 0x7f65a409dcb0 2024-04-25T02:08:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65aa6ba640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f65a40cc300 con 0x7f65a415a810 2024-04-25T02:08:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65a8c57640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a40b1120 0x7f65a4148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65a8c57640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a40b1120 0x7f65a4148600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57432/0 (socket says 172.21.15.79:57432) 2024-04-25T02:08:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65a8c57640 1 -- 172.21.15.79:0/1084196803 learned_addr learned my addr 172.21.15.79:0/1084196803 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65a3fff640 1 --2- 172.21.15.79:0/1084196803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65a409dcb0 0x7f65a4142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65a8c57640 1 -- 172.21.15.79:0/1084196803 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f65a415a810 msgr2=0x7f65a409d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65a8c57640 1 --2- 172.21.15.79:0/1084196803 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f65a415a810 0x7f65a409d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65a8c57640 1 -- 172.21.15.79:0/1084196803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65a409dcb0 msgr2=0x7f65a4142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65a8c57640 1 --2- 172.21.15.79:0/1084196803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65a409dcb0 0x7f65a4142030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65a8c57640 1 -- 172.21.15.79:0/1084196803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a409ac50 con 0x7f65a40b1120 2024-04-25T02:08:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.689+0000 7f65a8c57640 1 --2- 172.21.15.79:0/1084196803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a40b1120 0x7f65a4148600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f659c00c7b0 tx=0x7f659c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.690+0000 7f65a0ff9640 1 -- 172.21.15.79:0/1084196803 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c017070 con 0x7f65a40b1120 2024-04-25T02:08:21.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.690+0000 7f65a0ff9640 1 -- 172.21.15.79:0/1084196803 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f659c003da0 con 0x7f65a40b1120 2024-04-25T02:08:21.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.690+0000 7f65aa6ba640 1 -- 172.21.15.79:0/1084196803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a409af30 con 0x7f65a40b1120 2024-04-25T02:08:21.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.690+0000 7f65a0ff9640 1 -- 172.21.15.79:0/1084196803 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c0052b0 con 0x7f65a40b1120 2024-04-25T02:08:21.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.690+0000 7f65aa6ba640 1 -- 172.21.15.79:0/1084196803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a409b4f0 con 0x7f65a40b1120 2024-04-25T02:08:21.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.691+0000 7f65aa6ba640 1 -- 172.21.15.79:0/1084196803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a40690a0 con 0x7f65a40b1120 2024-04-25T02:08:21.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.691+0000 7f65a0ff9640 1 -- 172.21.15.79:0/1084196803 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f659c01a070 con 0x7f65a40b1120 2024-04-25T02:08:21.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.691+0000 7f65a0ff9640 1 --2- 172.21.15.79:0/1084196803 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f659006be30 0x7f659006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.692+0000 7f65a0ff9640 1 -- 172.21.15.79:0/1084196803 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f659c08a460 con 0x7f65a40b1120 2024-04-25T02:08:21.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.692+0000 7f65a3fff640 1 --2- 172.21.15.79:0/1084196803 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f659006be30 0x7f659006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.692+0000 7f65a3fff640 1 --2- 172.21.15.79:0/1084196803 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f659006be30 0x7f659006e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6594034000 tx=0x7f659402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:21.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.696+0000 7f65a0ff9640 1 -- 172.21.15.79:0/1084196803 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f659c058e10 con 0x7f65a40b1120 2024-04-25T02:08:21.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.868+0000 7f65aa6ba640 1 -- 172.21.15.79:0/1084196803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f65a40b1650 con 0x7f65a40b1120 2024-04-25T02:08:21.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.868+0000 7f65a0ff9640 1 -- 172.21.15.79:0/1084196803 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f659c058710 con 0x7f65a40b1120 2024-04-25T02:08:21.875 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:08:21.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.870+0000 7f65aa6ba640 1 -- 172.21.15.79:0/1084196803 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f659006be30 msgr2=0x7f659006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.870+0000 7f65aa6ba640 1 --2- 172.21.15.79:0/1084196803 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f659006be30 0x7f659006e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6594034000 tx=0x7f659402e000 comp rx=0 tx=0).stop 2024-04-25T02:08:21.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.870+0000 7f65aa6ba640 1 -- 172.21.15.79:0/1084196803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a40b1120 msgr2=0x7f65a4148600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.870+0000 7f65aa6ba640 1 --2- 172.21.15.79:0/1084196803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a40b1120 0x7f65a4148600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f659c00c7b0 tx=0x7f659c00cc70 comp rx=0 tx=0).stop 2024-04-25T02:08:21.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.870+0000 7f65aa6ba640 1 -- 172.21.15.79:0/1084196803 shutdown_connections 2024-04-25T02:08:21.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.870+0000 7f65aa6ba640 1 --2- 172.21.15.79:0/1084196803 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f659006be30 0x7f659006e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.870+0000 7f65aa6ba640 1 --2- 172.21.15.79:0/1084196803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a40b1120 0x7f65a4148600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.870+0000 7f65aa6ba640 1 --2- 172.21.15.79:0/1084196803 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f65a415a810 0x7f65a409d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.870+0000 7f65aa6ba640 1 --2- 172.21.15.79:0/1084196803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65a409dcb0 0x7f65a4142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.870+0000 7f65aa6ba640 1 -- 172.21.15.79:0/1084196803 >> 172.21.15.79:0/1084196803 conn(0x7f65a40b1cd0 msgr2=0x7f65a4167960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:21.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.870+0000 7f65aa6ba640 1 -- 172.21.15.79:0/1084196803 shutdown_connections 2024-04-25T02:08:21.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.870+0000 7f65aa6ba640 1 -- 172.21.15.79:0/1084196803 wait complete. 2024-04-25T02:08:21.888 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:08:21.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.980+0000 7f74840cd640 1 Processor -- start 2024-04-25T02:08:21.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.981+0000 7f74840cd640 1 -- start start 2024-04-25T02:08:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.981+0000 7f74840cd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f747c06b2f0 0x7f747c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f74840cd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f747c15ec20 con 0x7f747c06e6b0 2024-04-25T02:08:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f74840cd640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f747c15ef00 con 0x7f747c0cf7a0 2024-04-25T02:08:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f74840cd640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f747c15f830 con 0x7f747c06b2f0 2024-04-25T02:08:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f748266a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f747c06e6b0 0x7f747c15b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60116/0 (socket says 172.21.15.79:60116) 2024-04-25T02:08:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f748266a640 1 -- 172.21.15.79:0/2026619858 learned_addr learned my addr 172.21.15.79:0/2026619858 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7481e69640 1 --2- 172.21.15.79:0/2026619858 >> v2:172.21.15.189:3300/0 conn(0x7f747c06b2f0 0x7f747c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7480e67640 1 -- 172.21.15.79:0/2026619858 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1149194277 0 0) 0x7f747c15ec20 con 0x7f747c06e6b0 2024-04-25T02:08:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7480e67640 1 -- 172.21.15.79:0/2026619858 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7468003520 con 0x7f747c06e6b0 2024-04-25T02:08:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7480e67640 1 -- 172.21.15.79:0/2026619858 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 854103387 0 0) 0x7f7468003520 con 0x7f747c06e6b0 2024-04-25T02:08:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7480e67640 1 -- 172.21.15.79:0/2026619858 >> v2:172.21.15.189:3300/0 conn(0x7f747c06b2f0 msgr2=0x7f747c0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7480e67640 1 --2- 172.21.15.79:0/2026619858 >> v2:172.21.15.189:3300/0 conn(0x7f747c06b2f0 0x7f747c0b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7480e67640 1 -- 172.21.15.79:0/2026619858 >> v1:172.21.15.189:6789/0 conn(0x7f747c0cf7a0 legacy=0x7f747c06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7480e67640 1 -- 172.21.15.79:0/2026619858 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747c15f1e0 con 0x7f747c06e6b0 2024-04-25T02:08:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7480e67640 1 -- 172.21.15.79:0/2026619858 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f74740019f0 con 0x7f747c06e6b0 2024-04-25T02:08:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7480e67640 1 -- 172.21.15.79:0/2026619858 >> v1:172.21.15.79:6789/0 conn(0x7f747c06e6b0 legacy=0x7f747c15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7480e67640 1 --2- 172.21.15.79:0/2026619858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74680039b0 0x7f7468003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7480e67640 1 --2- 172.21.15.79:0/2026619858 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7468004800 0x7f7468004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7480e67640 1 --2- 172.21.15.79:0/2026619858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74680051c0 0x7f746800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7480e67640 1 -- 172.21.15.79:0/2026619858 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f747c15f830 con 0x7f74680051c0 2024-04-25T02:08:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7480e67640 1 -- 172.21.15.79:0/2026619858 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f746800c160 con 0x7f74680039b0 2024-04-25T02:08:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7480e67640 1 -- 172.21.15.79:0/2026619858 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f746800c360 con 0x7f7468004800 2024-04-25T02:08:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f748266a640 1 --2- 172.21.15.79:0/2026619858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74680051c0 0x7f746800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7481668640 1 --2- 172.21.15.79:0/2026619858 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7468004800 0x7f7468004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.982+0000 7f7481e69640 1 --2- 172.21.15.79:0/2026619858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74680039b0 0x7f7468003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.983+0000 7f748266a640 1 -- 172.21.15.79:0/2026619858 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7468004800 msgr2=0x7f7468004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.983+0000 7f748266a640 1 --2- 172.21.15.79:0/2026619858 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7468004800 0x7f7468004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.983+0000 7f748266a640 1 -- 172.21.15.79:0/2026619858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74680039b0 msgr2=0x7f7468003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.983+0000 7f748266a640 1 --2- 172.21.15.79:0/2026619858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74680039b0 0x7f7468003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.983+0000 7f748266a640 1 -- 172.21.15.79:0/2026619858 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7468003520 con 0x7f74680051c0 2024-04-25T02:08:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.983+0000 7f748266a640 1 -- 172.21.15.79:0/2026619858 reap_dead start 2024-04-25T02:08:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.983+0000 7f748266a640 1 --2- 172.21.15.79:0/2026619858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74680051c0 0x7f746800b9c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f747400a840 tx=0x7f7468005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305a3341224dc8af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.983+0000 7f7480e67640 1 -- 172.21.15.79:0/2026619858 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747400a460 con 0x7f74680051c0 2024-04-25T02:08:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.983+0000 7f7480e67640 1 -- 172.21.15.79:0/2026619858 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f747402f070 con 0x7f74680051c0 2024-04-25T02:08:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.983+0000 7f7480e67640 1 -- 172.21.15.79:0/2026619858 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747402bcb0 con 0x7f74680051c0 2024-04-25T02:08:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.984+0000 7f74840cd640 1 -- 172.21.15.79:0/2026619858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74680051c0 msgr2=0x7f746800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.984+0000 7f74840cd640 1 --2- 172.21.15.79:0/2026619858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74680051c0 0x7f746800b9c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f747400a840 tx=0x7f7468005830 comp rx=0 tx=0).stop 2024-04-25T02:08:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.984+0000 7f74840cd640 1 -- 172.21.15.79:0/2026619858 shutdown_connections 2024-04-25T02:08:21.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.984+0000 7f74840cd640 1 --2- 172.21.15.79:0/2026619858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74680051c0 0x7f746800b9c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.984+0000 7f74840cd640 1 -- 172.21.15.79:0/2026619858 >> 172.21.15.79:0/2026619858 conn(0x7f747c0b1cd0 msgr2=0x7f747c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:21.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.984+0000 7f74840cd640 1 -- 172.21.15.79:0/2026619858 shutdown_connections 2024-04-25T02:08:21.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.984+0000 7f74840cd640 1 -- 172.21.15.79:0/2026619858 wait complete. 2024-04-25T02:08:21.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.985+0000 7f74840cd640 1 Processor -- start 2024-04-25T02:08:21.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.985+0000 7f74840cd640 1 -- start start 2024-04-25T02:08:21.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.986+0000 7f74840cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74680051c0 0x7f747c1f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.986+0000 7f74840cd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f747c1554c0 0x7f747c14dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.986+0000 7f74840cd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f747c14f7e0 0x7f747c06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.986+0000 7f74840cd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f747c06d160 con 0x7f74680051c0 2024-04-25T02:08:21.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.986+0000 7f74840cd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f747c06cfe0 con 0x7f747c14f7e0 2024-04-25T02:08:21.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.986+0000 7f74840cd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f747c0b4b50 con 0x7f747c1554c0 2024-04-25T02:08:21.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.986+0000 7f7481e69640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74680051c0 0x7f747c1f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.986+0000 7f7481e69640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74680051c0 0x7f747c1f3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57450/0 (socket says 172.21.15.79:57450) 2024-04-25T02:08:21.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.986+0000 7f7481e69640 1 -- 172.21.15.79:0/3939986645 learned_addr learned my addr 172.21.15.79:0/3939986645 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:21.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.986+0000 7f7481e69640 1 -- 172.21.15.79:0/3939986645 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f747c1554c0 msgr2=0x7f747c14dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.986+0000 7f7481e69640 1 --2- 172.21.15.79:0/3939986645 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f747c1554c0 0x7f747c14dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.986+0000 7f748266a640 1 --2- 172.21.15.79:0/3939986645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f747c14f7e0 0x7f747c06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.986+0000 7f7481e69640 1 -- 172.21.15.79:0/3939986645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f747c14f7e0 msgr2=0x7f747c06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:21.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.986+0000 7f7481e69640 1 --2- 172.21.15.79:0/3939986645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f747c14f7e0 0x7f747c06d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:21.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.986+0000 7f7481e69640 1 -- 172.21.15.79:0/3939986645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747c1f43c0 con 0x7f74680051c0 2024-04-25T02:08:21.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.987+0000 7f7481e69640 1 --2- 172.21.15.79:0/3939986645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74680051c0 0x7f747c1f3d30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f746c0118e0 tx=0x7f746c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:21.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.987+0000 7f74727fc640 1 -- 172.21.15.79:0/3939986645 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c00faf0 con 0x7f74680051c0 2024-04-25T02:08:21.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.987+0000 7f74727fc640 1 -- 172.21.15.79:0/3939986645 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746c00fc90 con 0x7f74680051c0 2024-04-25T02:08:21.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.987+0000 7f74840cd640 1 -- 172.21.15.79:0/3939986645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f747c1f46a0 con 0x7f74680051c0 2024-04-25T02:08:21.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.987+0000 7f74727fc640 1 -- 172.21.15.79:0/3939986645 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c014440 con 0x7f74680051c0 2024-04-25T02:08:21.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.987+0000 7f74840cd640 1 -- 172.21.15.79:0/3939986645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f747c155940 con 0x7f74680051c0 2024-04-25T02:08:21.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.988+0000 7f74840cd640 1 -- 172.21.15.79:0/3939986645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f747c0690a0 con 0x7f74680051c0 2024-04-25T02:08:21.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.988+0000 7f74727fc640 1 -- 172.21.15.79:0/3939986645 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f746c012040 con 0x7f74680051c0 2024-04-25T02:08:21.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.989+0000 7f74727fc640 1 --2- 172.21.15.79:0/3939986645 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f746006be60 0x7f746006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:21.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.989+0000 7f74727fc640 1 -- 172.21.15.79:0/3939986645 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f746c08b4f0 con 0x7f74680051c0 2024-04-25T02:08:21.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.989+0000 7f7481668640 1 --2- 172.21.15.79:0/3939986645 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f746006be60 0x7f746006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:21.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.989+0000 7f7481668640 1 --2- 172.21.15.79:0/3939986645 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f746006be60 0x7f746006e320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7478000c00 tx=0x7f7478009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:22.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:21.993+0000 7f74727fc640 1 -- 172.21.15.79:0/3939986645 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f746c019030 con 0x7f74680051c0 2024-04-25T02:08:22.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.169+0000 7f74840cd640 1 -- 172.21.15.79:0/3939986645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f747c0cf4f0 con 0x7f74680051c0 2024-04-25T02:08:22.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.169+0000 7f74727fc640 1 -- 172.21.15.79:0/3939986645 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f746c059f30 con 0x7f74680051c0 2024-04-25T02:08:22.176 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:08:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.171+0000 7f74840cd640 1 -- 172.21.15.79:0/3939986645 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f746006be60 msgr2=0x7f746006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.171+0000 7f74840cd640 1 --2- 172.21.15.79:0/3939986645 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f746006be60 0x7f746006e320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7478000c00 tx=0x7f7478009040 comp rx=0 tx=0).stop 2024-04-25T02:08:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.171+0000 7f74840cd640 1 -- 172.21.15.79:0/3939986645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74680051c0 msgr2=0x7f747c1f3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.171+0000 7f74840cd640 1 --2- 172.21.15.79:0/3939986645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74680051c0 0x7f747c1f3d30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f746c0118e0 tx=0x7f746c011da0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.171+0000 7f74840cd640 1 -- 172.21.15.79:0/3939986645 shutdown_connections 2024-04-25T02:08:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.171+0000 7f74840cd640 1 --2- 172.21.15.79:0/3939986645 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f746006be60 0x7f746006e320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.171+0000 7f74840cd640 1 --2- 172.21.15.79:0/3939986645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f747c14f7e0 0x7f747c06d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.171+0000 7f74840cd640 1 --2- 172.21.15.79:0/3939986645 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f747c1554c0 0x7f747c14dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.171+0000 7f74840cd640 1 --2- 172.21.15.79:0/3939986645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74680051c0 0x7f747c1f3d30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.171+0000 7f74840cd640 1 -- 172.21.15.79:0/3939986645 >> 172.21.15.79:0/3939986645 conn(0x7f747c0b1cd0 msgr2=0x7f747c070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.172+0000 7f74840cd640 1 -- 172.21.15.79:0/3939986645 shutdown_connections 2024-04-25T02:08:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.172+0000 7f74840cd640 1 -- 172.21.15.79:0/3939986645 wait complete. 2024-04-25T02:08:22.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:08:22.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.283+0000 7f5e9e238640 1 Processor -- start 2024-04-25T02:08:22.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.283+0000 7f5e9e238640 1 -- start start 2024-04-25T02:08:22.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.284+0000 7f5e9e238640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5e980ceb40 0x7f5e98071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.284+0000 7f5e9e238640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e98071690 0x7f5e980cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.284+0000 7f5e9e238640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e980cf040 con 0x7f5e9815e230 2024-04-25T02:08:22.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.284+0000 7f5e9e238640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5e98071b00 con 0x7f5e980ceb40 2024-04-25T02:08:22.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.284+0000 7f5e9e238640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5e980ca6c0 con 0x7f5e98071690 2024-04-25T02:08:22.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.284+0000 7f5e96ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5e980ceb40 0x7f5e98071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.284+0000 7f5e96ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5e980ceb40 0x7f5e98071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57458/0 (socket says 172.21.15.79:57458) 2024-04-25T02:08:22.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.284+0000 7f5e96ffd640 1 -- 172.21.15.79:0/2813028328 learned_addr learned my addr 172.21.15.79:0/2813028328 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:22.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.284+0000 7f5e97fff640 1 --2- 172.21.15.79:0/2813028328 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e98071690 0x7f5e980cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.284+0000 7f5e96ffd640 1 -- 172.21.15.79:0/2813028328 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e98071690 msgr2=0x7f5e980cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:22.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.284+0000 7f5e96ffd640 1 --2- 172.21.15.79:0/2813028328 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e98071690 0x7f5e980cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.284+0000 7f5e96ffd640 1 -- 172.21.15.79:0/2813028328 >> v1:172.21.15.189:6789/0 conn(0x7f5e9815e230 legacy=0x7f5e9806f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.284+0000 7f5e96ffd640 1 -- 172.21.15.79:0/2813028328 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e980cf320 con 0x7f5e980ceb40 2024-04-25T02:08:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.285+0000 7f5e96ffd640 1 --2- 172.21.15.79:0/2813028328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e980ceb40 0x7f5e98071150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c009870 tx=0x7f5e8c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b0f74f35b8f68f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.285+0000 7f5e967fc640 1 -- 172.21.15.79:0/2813028328 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c037070 con 0x7f5e980ceb40 2024-04-25T02:08:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.285+0000 7f5e967fc640 1 -- 172.21.15.79:0/2813028328 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e8c02ae50 con 0x7f5e980ceb40 2024-04-25T02:08:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.285+0000 7f5e967fc640 1 -- 172.21.15.79:0/2813028328 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c032860 con 0x7f5e980ceb40 2024-04-25T02:08:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.285+0000 7f5e9e238640 1 -- 172.21.15.79:0/2813028328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e980ceb40 msgr2=0x7f5e98071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.285+0000 7f5e9e238640 1 --2- 172.21.15.79:0/2813028328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e980ceb40 0x7f5e98071150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c009870 tx=0x7f5e8c02a300 comp rx=0 tx=0).stop 2024-04-25T02:08:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.285+0000 7f5e9e238640 1 -- 172.21.15.79:0/2813028328 shutdown_connections 2024-04-25T02:08:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.285+0000 7f5e9e238640 1 --2- 172.21.15.79:0/2813028328 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e98071690 0x7f5e980cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.285+0000 7f5e9e238640 1 --2- 172.21.15.79:0/2813028328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e980ceb40 0x7f5e98071150 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.285+0000 7f5e9e238640 1 -- 172.21.15.79:0/2813028328 >> 172.21.15.79:0/2813028328 conn(0x7f5e980d0070 msgr2=0x7f5e980d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.285+0000 7f5e9e238640 1 -- 172.21.15.79:0/2813028328 shutdown_connections 2024-04-25T02:08:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.285+0000 7f5e9e238640 1 -- 172.21.15.79:0/2813028328 wait complete. 2024-04-25T02:08:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.286+0000 7f5e9e238640 1 Processor -- start 2024-04-25T02:08:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.287+0000 7f5e9e238640 1 -- start start 2024-04-25T02:08:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.287+0000 7f5e9e238640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e98071690 0x7f5e981f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.287+0000 7f5e9e238640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e980ceb40 0x7f5e980b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.287+0000 7f5e9e238640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e9815e230 0x7f5e9806e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.287+0000 7f5e9e238640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9815e610 con 0x7f5e98071690 2024-04-25T02:08:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.287+0000 7f5e9e238640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5e980ca9a0 con 0x7f5e980ceb40 2024-04-25T02:08:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.287+0000 7f5e9e238640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5e9815e790 con 0x7f5e9815e230 2024-04-25T02:08:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.287+0000 7f5e977fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e98071690 0x7f5e981f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.287+0000 7f5e977fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e98071690 0x7f5e981f4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57468/0 (socket says 172.21.15.79:57468) 2024-04-25T02:08:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e977fe640 1 -- 172.21.15.79:0/117965021 learned_addr learned my addr 172.21.15.79:0/117965021 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e96ffd640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e980ceb40 0x7f5e980b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e97fff640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e9815e230 0x7f5e9806e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e977fe640 1 -- 172.21.15.79:0/117965021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e9815e230 msgr2=0x7f5e9806e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e977fe640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e9815e230 0x7f5e9806e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e977fe640 1 -- 172.21.15.79:0/117965021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e980ceb40 msgr2=0x7f5e980b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e977fe640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e980ceb40 0x7f5e980b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e977fe640 1 -- 172.21.15.79:0/117965021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e981f4e40 con 0x7f5e98071690 2024-04-25T02:08:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e96ffd640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e980ceb40 0x7f5e980b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e97fff640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e9815e230 0x7f5e9806e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e977fe640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e98071690 0x7f5e981f4900 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800c3f0 tx=0x7f5e8800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e7ffff640 1 -- 172.21.15.79:0/117965021 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e880052d0 con 0x7f5e98071690 2024-04-25T02:08:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e7ffff640 1 -- 172.21.15.79:0/117965021 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e88005490 con 0x7f5e98071690 2024-04-25T02:08:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e7ffff640 1 -- 172.21.15.79:0/117965021 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e88007260 con 0x7f5e98071690 2024-04-25T02:08:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e9e238640 1 -- 172.21.15.79:0/117965021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9815fc40 con 0x7f5e98071690 2024-04-25T02:08:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.288+0000 7f5e9e238640 1 -- 172.21.15.79:0/117965021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e980b2dc0 con 0x7f5e98071690 2024-04-25T02:08:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.289+0000 7f5e9e238640 1 -- 172.21.15.79:0/117965021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e980690a0 con 0x7f5e98071690 2024-04-25T02:08:22.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.290+0000 7f5e7ffff640 1 -- 172.21.15.79:0/117965021 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e88007400 con 0x7f5e98071690 2024-04-25T02:08:22.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.290+0000 7f5e7ffff640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e8406be30 0x7f5e8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.290+0000 7f5e96ffd640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e8406be30 0x7f5e8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.290+0000 7f5e7ffff640 1 -- 172.21.15.79:0/117965021 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5e8808a2c0 con 0x7f5e98071690 2024-04-25T02:08:22.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.290+0000 7f5e96ffd640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e8406be30 0x7f5e8406e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c034000 tx=0x7f5e8c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:22.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.294+0000 7f5e7ffff640 1 -- 172.21.15.79:0/117965021 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5e88058d00 con 0x7f5e98071690 2024-04-25T02:08:22.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.466+0000 7f5e9e238640 1 -- 172.21.15.79:0/117965021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5e980b5ff0 con 0x7f5e98071690 2024-04-25T02:08:22.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.466+0000 7f5e7ffff640 1 -- 172.21.15.79:0/117965021 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f5e88058600 con 0x7f5e98071690 2024-04-25T02:08:22.473 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:08:22.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.468+0000 7f5e9e238640 1 -- 172.21.15.79:0/117965021 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e8406be30 msgr2=0x7f5e8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.468+0000 7f5e9e238640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e8406be30 0x7f5e8406e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c034000 tx=0x7f5e8c02e000 comp rx=0 tx=0).stop 2024-04-25T02:08:22.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.468+0000 7f5e9e238640 1 -- 172.21.15.79:0/117965021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e98071690 msgr2=0x7f5e981f4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.468+0000 7f5e9e238640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e98071690 0x7f5e981f4900 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800c3f0 tx=0x7f5e8800c8b0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.468+0000 7f5e9e238640 1 -- 172.21.15.79:0/117965021 shutdown_connections 2024-04-25T02:08:22.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.468+0000 7f5e9e238640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e8406be30 0x7f5e8406e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.468+0000 7f5e9e238640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e9815e230 0x7f5e9806e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.468+0000 7f5e9e238640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e980ceb40 0x7f5e980b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.468+0000 7f5e9e238640 1 --2- 172.21.15.79:0/117965021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e98071690 0x7f5e981f4900 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.468+0000 7f5e9e238640 1 -- 172.21.15.79:0/117965021 >> 172.21.15.79:0/117965021 conn(0x7f5e980d0070 msgr2=0x7f5e980ad5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:22.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.468+0000 7f5e9e238640 1 -- 172.21.15.79:0/117965021 shutdown_connections 2024-04-25T02:08:22.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.468+0000 7f5e9e238640 1 -- 172.21.15.79:0/117965021 wait complete. 2024-04-25T02:08:22.486 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:22.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.576+0000 7f8720709640 1 Processor -- start 2024-04-25T02:08:22.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.576+0000 7f8720709640 1 -- start start 2024-04-25T02:08:22.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.577+0000 7f8720709640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8718143bc0 0x7f871815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.577+0000 7f8720709640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f871806df50 0x7f871806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.577+0000 7f8720709640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f871815fa40 con 0x7f87180b48e0 2024-04-25T02:08:22.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.577+0000 7f8720709640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f871806e8f0 con 0x7f871806df50 2024-04-25T02:08:22.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.577+0000 7f8720709640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8718072cb0 con 0x7f8718143bc0 2024-04-25T02:08:22.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.577+0000 7f871e4a5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8718143bc0 0x7f871815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.577+0000 7f871dca4640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f871806df50 0x7f871806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.577+0000 7f871eca6640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f87180b48e0 0x7f87180b4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:47046/0 (socket says 172.21.15.79:47046) 2024-04-25T02:08:22.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.577+0000 7f871eca6640 1 -- 172.21.15.79:0/1457409716 learned_addr learned my addr 172.21.15.79:0/1457409716 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:22.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.577+0000 7f871e4a5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8718143bc0 0x7f871815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:50186/0 (socket says 172.21.15.79:50186) 2024-04-25T02:08:22.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.578+0000 7f871d4a3640 1 -- 172.21.15.79:0/1457409716 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1360522201 0 0) 0x7f8710001110 con 0x7f87180b48e0 2024-04-25T02:08:22.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.578+0000 7f871d4a3640 1 -- 172.21.15.79:0/1457409716 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8704003520 con 0x7f87180b48e0 2024-04-25T02:08:22.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.578+0000 7f871e4a5640 1 -- 172.21.15.79:0/1457409716 >> v2:172.21.15.189:3300/0 conn(0x7f871806df50 msgr2=0x7f871806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.578+0000 7f871e4a5640 1 --2- 172.21.15.79:0/1457409716 >> v2:172.21.15.189:3300/0 conn(0x7f871806df50 0x7f871806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.578+0000 7f871e4a5640 1 -- 172.21.15.79:0/1457409716 >> v1:172.21.15.189:6789/0 conn(0x7f87180b48e0 legacy=0x7f87180b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.578+0000 7f871e4a5640 1 -- 172.21.15.79:0/1457409716 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8718071e00 con 0x7f8718143bc0 2024-04-25T02:08:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.578+0000 7f871e4a5640 1 --2- 172.21.15.79:0/1457409716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8718143bc0 0x7f871815f500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8714009d90 tx=0x7f871402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a0507d5b877329d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.579+0000 7f871d4a3640 1 -- 172.21.15.79:0/1457409716 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8714031600 con 0x7f8718143bc0 2024-04-25T02:08:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.579+0000 7f871d4a3640 1 -- 172.21.15.79:0/1457409716 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87140317a0 con 0x7f8718143bc0 2024-04-25T02:08:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.579+0000 7f871d4a3640 1 -- 172.21.15.79:0/1457409716 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8714031b70 con 0x7f8718143bc0 2024-04-25T02:08:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.579+0000 7f8720709640 1 -- 172.21.15.79:0/1457409716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8718143bc0 msgr2=0x7f871815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.579+0000 7f8720709640 1 --2- 172.21.15.79:0/1457409716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8718143bc0 0x7f871815f500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8714009d90 tx=0x7f871402a5d0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.579+0000 7f8720709640 1 -- 172.21.15.79:0/1457409716 shutdown_connections 2024-04-25T02:08:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.579+0000 7f8720709640 1 --2- 172.21.15.79:0/1457409716 >> v2:172.21.15.189:3300/0 conn(0x7f871806df50 0x7f871806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.579+0000 7f8720709640 1 --2- 172.21.15.79:0/1457409716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8718143bc0 0x7f871815f500 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.579+0000 7f8720709640 1 -- 172.21.15.79:0/1457409716 >> 172.21.15.79:0/1457409716 conn(0x7f87180cfc80 msgr2=0x7f87180d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.579+0000 7f8720709640 1 -- 172.21.15.79:0/1457409716 shutdown_connections 2024-04-25T02:08:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.579+0000 7f8720709640 1 -- 172.21.15.79:0/1457409716 wait complete. 2024-04-25T02:08:22.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.580+0000 7f8720709640 1 Processor -- start 2024-04-25T02:08:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.580+0000 7f8720709640 1 -- start start 2024-04-25T02:08:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.581+0000 7f8720709640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f871806df50 0x7f8718157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.581+0000 7f8720709640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87180b48e0 0x7f8718070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.581+0000 7f8720709640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8718143bc0 0x7f8718071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.581+0000 7f8720709640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8718072660 con 0x7f87180b48e0 2024-04-25T02:08:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.581+0000 7f8720709640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8718072380 con 0x7f8718143bc0 2024-04-25T02:08:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.581+0000 7f8720709640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8718072940 con 0x7f871806df50 2024-04-25T02:08:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.581+0000 7f871dca4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87180b48e0 0x7f8718070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.581+0000 7f871dca4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87180b48e0 0x7f8718070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57480/0 (socket says 172.21.15.79:57480) 2024-04-25T02:08:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.581+0000 7f871dca4640 1 -- 172.21.15.79:0/3676991939 learned_addr learned my addr 172.21.15.79:0/3676991939 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.581+0000 7f871eca6640 1 --2- 172.21.15.79:0/3676991939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8718143bc0 0x7f8718071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.581+0000 7f871dca4640 1 -- 172.21.15.79:0/3676991939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f871806df50 msgr2=0x7f8718157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.582+0000 7f871e4a5640 1 --2- 172.21.15.79:0/3676991939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f871806df50 0x7f8718157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.582+0000 7f871dca4640 1 --2- 172.21.15.79:0/3676991939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f871806df50 0x7f8718157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.582+0000 7f871dca4640 1 -- 172.21.15.79:0/3676991939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8718143bc0 msgr2=0x7f8718071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.582+0000 7f871dca4640 1 --2- 172.21.15.79:0/3676991939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8718143bc0 0x7f8718071230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.582+0000 7f871dca4640 1 -- 172.21.15.79:0/3676991939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8718133110 con 0x7f87180b48e0 2024-04-25T02:08:22.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.582+0000 7f871dca4640 1 --2- 172.21.15.79:0/3676991939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87180b48e0 0x7f8718070cf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f870800e870 tx=0x7f870800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:22.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.582+0000 7f870effd640 1 -- 172.21.15.79:0/3676991939 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708017070 con 0x7f87180b48e0 2024-04-25T02:08:22.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.582+0000 7f870effd640 1 -- 172.21.15.79:0/3676991939 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f870800c940 con 0x7f87180b48e0 2024-04-25T02:08:22.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.582+0000 7f870effd640 1 -- 172.21.15.79:0/3676991939 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870800cd30 con 0x7f87180b48e0 2024-04-25T02:08:22.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.582+0000 7f8720709640 1 -- 172.21.15.79:0/3676991939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8718130230 con 0x7f87180b48e0 2024-04-25T02:08:22.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.582+0000 7f8720709640 1 -- 172.21.15.79:0/3676991939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87181307f0 con 0x7f87180b48e0 2024-04-25T02:08:22.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.583+0000 7f8720709640 1 -- 172.21.15.79:0/3676991939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87180690a0 con 0x7f87180b48e0 2024-04-25T02:08:22.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.583+0000 7f870effd640 1 -- 172.21.15.79:0/3676991939 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f870801a070 con 0x7f87180b48e0 2024-04-25T02:08:22.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.584+0000 7f870effd640 1 --2- 172.21.15.79:0/3676991939 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f86fc06be30 0x7f86fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.584+0000 7f870effd640 1 -- 172.21.15.79:0/3676991939 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f870808aff0 con 0x7f87180b48e0 2024-04-25T02:08:22.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.584+0000 7f871e4a5640 1 --2- 172.21.15.79:0/3676991939 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f86fc06be30 0x7f86fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.584+0000 7f871e4a5640 1 --2- 172.21.15.79:0/3676991939 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f86fc06be30 0x7f86fc06e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8714034000 tx=0x7f871402f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:22.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.588+0000 7f870effd640 1 -- 172.21.15.79:0/3676991939 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8708059a30 con 0x7f87180b48e0 2024-04-25T02:08:22.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.761+0000 7f8720709640 1 -- 172.21.15.79:0/3676991939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8718144140 con 0x7f87180b48e0 2024-04-25T02:08:22.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.762+0000 7f870effd640 1 -- 172.21.15.79:0/3676991939 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f8708059330 con 0x7f87180b48e0 2024-04-25T02:08:22.769 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:22.769 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:22.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.764+0000 7f8720709640 1 -- 172.21.15.79:0/3676991939 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f86fc06be30 msgr2=0x7f86fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.764+0000 7f8720709640 1 --2- 172.21.15.79:0/3676991939 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f86fc06be30 0x7f86fc06e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8714034000 tx=0x7f871402f000 comp rx=0 tx=0).stop 2024-04-25T02:08:22.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.764+0000 7f8720709640 1 -- 172.21.15.79:0/3676991939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87180b48e0 msgr2=0x7f8718070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.764+0000 7f8720709640 1 --2- 172.21.15.79:0/3676991939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87180b48e0 0x7f8718070cf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f870800e870 tx=0x7f870800ed30 comp rx=0 tx=0).stop 2024-04-25T02:08:22.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.764+0000 7f8720709640 1 -- 172.21.15.79:0/3676991939 shutdown_connections 2024-04-25T02:08:22.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.764+0000 7f8720709640 1 --2- 172.21.15.79:0/3676991939 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f86fc06be30 0x7f86fc06e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.764+0000 7f8720709640 1 --2- 172.21.15.79:0/3676991939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8718143bc0 0x7f8718071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.764+0000 7f8720709640 1 --2- 172.21.15.79:0/3676991939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87180b48e0 0x7f8718070cf0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.764+0000 7f8720709640 1 --2- 172.21.15.79:0/3676991939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f871806df50 0x7f8718157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.764+0000 7f8720709640 1 -- 172.21.15.79:0/3676991939 >> 172.21.15.79:0/3676991939 conn(0x7f87180cfc80 msgr2=0x7f87180ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:22.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.764+0000 7f8720709640 1 -- 172.21.15.79:0/3676991939 shutdown_connections 2024-04-25T02:08:22.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.764+0000 7f8720709640 1 -- 172.21.15.79:0/3676991939 wait complete. 2024-04-25T02:08:22.782 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:57.115253+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:58.421392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:08:22.782 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:08:22.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.875+0000 7fae9f7c1640 1 Processor -- start 2024-04-25T02:08:22.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.875+0000 7fae9f7c1640 1 -- start start 2024-04-25T02:08:22.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.876+0000 7fae9f7c1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fae981443c0 0x7fae9806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.876+0000 7fae9f7c1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae980b40a0 con 0x7fae980703f0 2024-04-25T02:08:22.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.876+0000 7fae9f7c1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae980b4380 con 0x7fae98072740 2024-04-25T02:08:22.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.876+0000 7fae9f7c1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fae98144db0 con 0x7fae981443c0 2024-04-25T02:08:22.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.876+0000 7fae9d55d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fae981443c0 0x7fae9806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.876+0000 7fae9cd5c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fae980703f0 0x7fae98072030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60128/0 (socket says 172.21.15.79:60128) 2024-04-25T02:08:22.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.876+0000 7fae9cd5c640 1 -- 172.21.15.79:0/3824832217 learned_addr learned my addr 172.21.15.79:0/3824832217 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:22.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.877+0000 7fae9d55d640 1 -- 172.21.15.79:0/3824832217 >> v1:172.21.15.189:6789/0 conn(0x7fae98072740 legacy=0x7fae980b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:22.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.877+0000 7fae9d55d640 1 -- 172.21.15.79:0/3824832217 >> v1:172.21.15.79:6789/0 conn(0x7fae980703f0 legacy=0x7fae98072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.877+0000 7fae8ffff640 1 -- 172.21.15.79:0/3824832217 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1510479445 0 0) 0x7fae980b40a0 con 0x7fae980703f0 2024-04-25T02:08:22.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.877+0000 7fae9d55d640 1 -- 172.21.15.79:0/3824832217 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae980b4660 con 0x7fae981443c0 2024-04-25T02:08:22.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.877+0000 7fae9d55d640 1 --2- 172.21.15.79:0/3824832217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae981443c0 0x7fae9806feb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fae94009d90 tx=0x7fae9402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc635dd48deba61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:22.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.877+0000 7fae8ffff640 1 -- 172.21.15.79:0/3824832217 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94031600 con 0x7fae981443c0 2024-04-25T02:08:22.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.877+0000 7fae8ffff640 1 -- 172.21.15.79:0/3824832217 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae940317a0 con 0x7fae981443c0 2024-04-25T02:08:22.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.877+0000 7fae8ffff640 1 -- 172.21.15.79:0/3824832217 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94031b70 con 0x7fae981443c0 2024-04-25T02:08:22.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.878+0000 7fae9f7c1640 1 -- 172.21.15.79:0/3824832217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae981443c0 msgr2=0x7fae9806feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.878+0000 7fae9f7c1640 1 --2- 172.21.15.79:0/3824832217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae981443c0 0x7fae9806feb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fae94009d90 tx=0x7fae9402a610 comp rx=0 tx=0).stop 2024-04-25T02:08:22.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.878+0000 7fae9f7c1640 1 -- 172.21.15.79:0/3824832217 shutdown_connections 2024-04-25T02:08:22.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.878+0000 7fae9f7c1640 1 --2- 172.21.15.79:0/3824832217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae981443c0 0x7fae9806feb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.878+0000 7fae9f7c1640 1 -- 172.21.15.79:0/3824832217 >> 172.21.15.79:0/3824832217 conn(0x7fae980d0f40 msgr2=0x7fae980d1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:22.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.878+0000 7fae9f7c1640 1 -- 172.21.15.79:0/3824832217 shutdown_connections 2024-04-25T02:08:22.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.878+0000 7fae9f7c1640 1 -- 172.21.15.79:0/3824832217 wait complete. 2024-04-25T02:08:22.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.879+0000 7fae9f7c1640 1 Processor -- start 2024-04-25T02:08:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.879+0000 7fae9f7c1640 1 -- start start 2024-04-25T02:08:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9f7c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae980703f0 0x7fae98159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9f7c1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fae98072740 0x7fae9815db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9f7c1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae981443c0 0x7fae9806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9f7c1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fae980ce720 con 0x7fae980703f0 2024-04-25T02:08:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9f7c1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fae981447a0 con 0x7fae981443c0 2024-04-25T02:08:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9f7c1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fae980ce8a0 con 0x7fae98072740 2024-04-25T02:08:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9d55d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae980703f0 0x7fae98159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9d55d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae980703f0 0x7fae98159e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57496/0 (socket says 172.21.15.79:57496) 2024-04-25T02:08:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9d55d640 1 -- 172.21.15.79:0/2484676387 learned_addr learned my addr 172.21.15.79:0/2484676387 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9d55d640 1 -- 172.21.15.79:0/2484676387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fae98072740 msgr2=0x7fae9815db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9d55d640 1 --2- 172.21.15.79:0/2484676387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fae98072740 0x7fae9815db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9dd5e640 1 --2- 172.21.15.79:0/2484676387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae981443c0 0x7fae9806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9d55d640 1 -- 172.21.15.79:0/2484676387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae981443c0 msgr2=0x7fae9806b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9d55d640 1 --2- 172.21.15.79:0/2484676387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae981443c0 0x7fae9806b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9d55d640 1 -- 172.21.15.79:0/2484676387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae98158dc0 con 0x7fae980703f0 2024-04-25T02:08:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.880+0000 7fae9d55d640 1 --2- 172.21.15.79:0/2484676387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae980703f0 0x7fae98159e60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fae94009d90 tx=0x7fae94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.881+0000 7fae8dffb640 1 -- 172.21.15.79:0/2484676387 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94040070 con 0x7fae980703f0 2024-04-25T02:08:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.881+0000 7fae8dffb640 1 -- 172.21.15.79:0/2484676387 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae94030be0 con 0x7fae980703f0 2024-04-25T02:08:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.881+0000 7fae9f7c1640 1 -- 172.21.15.79:0/2484676387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae981590a0 con 0x7fae980703f0 2024-04-25T02:08:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.881+0000 7fae8dffb640 1 -- 172.21.15.79:0/2484676387 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94009450 con 0x7fae980703f0 2024-04-25T02:08:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.881+0000 7fae9f7c1640 1 -- 172.21.15.79:0/2484676387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae98159660 con 0x7fae980703f0 2024-04-25T02:08:22.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.882+0000 7fae9f7c1640 1 -- 172.21.15.79:0/2484676387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae980681e0 con 0x7fae980703f0 2024-04-25T02:08:22.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.882+0000 7fae8dffb640 1 -- 172.21.15.79:0/2484676387 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae94039040 con 0x7fae980703f0 2024-04-25T02:08:22.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.882+0000 7fae8dffb640 1 --2- 172.21.15.79:0/2484676387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fae7c06be60 0x7fae7c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.883+0000 7fae8dffb640 1 -- 172.21.15.79:0/2484676387 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fae940abc40 con 0x7fae980703f0 2024-04-25T02:08:22.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.883+0000 7fae9cd5c640 1 --2- 172.21.15.79:0/2484676387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fae7c06be60 0x7fae7c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.883+0000 7fae9cd5c640 1 --2- 172.21.15.79:0/2484676387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fae7c06be60 0x7fae7c06e320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fae88007fd0 tx=0x7fae88007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:22.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:22.887+0000 7fae8dffb640 1 -- 172.21.15.79:0/2484676387 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fae9407a5f0 con 0x7fae980703f0 2024-04-25T02:08:23.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.057+0000 7fae9f7c1640 1 -- 172.21.15.79:0/2484676387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fae98070030 con 0x7fae980703f0 2024-04-25T02:08:23.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.058+0000 7fae8dffb640 1 -- 172.21.15.79:0/2484676387 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fae94079ef0 con 0x7fae980703f0 2024-04-25T02:08:23.065 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:08:23.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.060+0000 7fae9f7c1640 1 -- 172.21.15.79:0/2484676387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fae7c06be60 msgr2=0x7fae7c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.060+0000 7fae9f7c1640 1 --2- 172.21.15.79:0/2484676387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fae7c06be60 0x7fae7c06e320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fae88007fd0 tx=0x7fae88007920 comp rx=0 tx=0).stop 2024-04-25T02:08:23.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.060+0000 7fae9f7c1640 1 -- 172.21.15.79:0/2484676387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae980703f0 msgr2=0x7fae98159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.060+0000 7fae9f7c1640 1 --2- 172.21.15.79:0/2484676387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae980703f0 0x7fae98159e60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fae94009d90 tx=0x7fae94004a40 comp rx=0 tx=0).stop 2024-04-25T02:08:23.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.060+0000 7fae9f7c1640 1 -- 172.21.15.79:0/2484676387 shutdown_connections 2024-04-25T02:08:23.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.060+0000 7fae9f7c1640 1 --2- 172.21.15.79:0/2484676387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fae7c06be60 0x7fae7c06e320 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.060+0000 7fae9f7c1640 1 --2- 172.21.15.79:0/2484676387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae981443c0 0x7fae9806b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.060+0000 7fae9f7c1640 1 --2- 172.21.15.79:0/2484676387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fae98072740 0x7fae9815db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.060+0000 7fae9f7c1640 1 --2- 172.21.15.79:0/2484676387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae980703f0 0x7fae98159e60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.060+0000 7fae9f7c1640 1 -- 172.21.15.79:0/2484676387 >> 172.21.15.79:0/2484676387 conn(0x7fae980d0f40 msgr2=0x7fae980d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:23.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.060+0000 7fae9f7c1640 1 -- 172.21.15.79:0/2484676387 shutdown_connections 2024-04-25T02:08:23.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.060+0000 7fae9f7c1640 1 -- 172.21.15.79:0/2484676387 wait complete. 2024-04-25T02:08:23.077 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:08:23.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.171+0000 7fea92e9a640 1 Processor -- start 2024-04-25T02:08:23.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.172+0000 7fea92e9a640 1 -- start start 2024-04-25T02:08:23.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.172+0000 7fea92e9a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fea8c0d2ca0 0x7fea8c0d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.172+0000 7fea92e9a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fea8c0d0ef0 0x7fea8c06bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.172+0000 7fea92e9a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea8c0d1ee0 con 0x7fea8c15e4f0 2024-04-25T02:08:23.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.172+0000 7fea92e9a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fea8c0d3130 con 0x7fea8c0d2ca0 2024-04-25T02:08:23.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.172+0000 7fea92e9a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fea8c0d21c0 con 0x7fea8c0d0ef0 2024-04-25T02:08:23.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.172+0000 7fea8bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fea8c0d2ca0 0x7fea8c0d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.172+0000 7fea90c36640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fea8c15e4f0 0x7fea8c0cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60138/0 (socket says 172.21.15.79:60138) 2024-04-25T02:08:23.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.172+0000 7fea90c36640 1 -- 172.21.15.79:0/13176130 learned_addr learned my addr 172.21.15.79:0/13176130 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:23.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.173+0000 7fea91437640 1 --2- 172.21.15.79:0/13176130 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fea8c0d0ef0 0x7fea8c06bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.173+0000 7fea8bfff640 1 -- 172.21.15.79:0/13176130 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fea8c0d0ef0 msgr2=0x7fea8c06bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:23.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.173+0000 7fea8bfff640 1 --2- 172.21.15.79:0/13176130 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fea8c0d0ef0 0x7fea8c06bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.173+0000 7fea8bfff640 1 -- 172.21.15.79:0/13176130 >> v1:172.21.15.79:6789/0 conn(0x7fea8c15e4f0 legacy=0x7fea8c0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.173+0000 7fea8b7fe640 1 -- 172.21.15.79:0/13176130 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058191 0 0) 0x7fea8c0d1ee0 con 0x7fea8c15e4f0 2024-04-25T02:08:23.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.173+0000 7fea8bfff640 1 -- 172.21.15.79:0/13176130 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8c0d24a0 con 0x7fea8c0d2ca0 2024-04-25T02:08:23.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.173+0000 7fea8bfff640 1 --2- 172.21.15.79:0/13176130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea8c0d2ca0 0x7fea8c0d09b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fea780097d0 tx=0x7fea7802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bdb35ac79d58a0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:23.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.174+0000 7fea8b7fe640 1 -- 172.21.15.79:0/13176130 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78037070 con 0x7fea8c0d2ca0 2024-04-25T02:08:23.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.174+0000 7fea8b7fe640 1 -- 172.21.15.79:0/13176130 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea78032440 con 0x7fea8c0d2ca0 2024-04-25T02:08:23.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.174+0000 7fea8b7fe640 1 -- 172.21.15.79:0/13176130 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78032810 con 0x7fea8c0d2ca0 2024-04-25T02:08:23.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.174+0000 7fea92e9a640 1 -- 172.21.15.79:0/13176130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea8c0d2ca0 msgr2=0x7fea8c0d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.174+0000 7fea92e9a640 1 --2- 172.21.15.79:0/13176130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea8c0d2ca0 0x7fea8c0d09b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fea780097d0 tx=0x7fea7802a1c0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.174+0000 7fea92e9a640 1 -- 172.21.15.79:0/13176130 shutdown_connections 2024-04-25T02:08:23.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.174+0000 7fea92e9a640 1 --2- 172.21.15.79:0/13176130 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fea8c0d0ef0 0x7fea8c06bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.174+0000 7fea92e9a640 1 --2- 172.21.15.79:0/13176130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea8c0d2ca0 0x7fea8c0d09b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.174+0000 7fea92e9a640 1 -- 172.21.15.79:0/13176130 >> 172.21.15.79:0/13176130 conn(0x7fea8c09d4a0 msgr2=0x7fea8c0d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:23.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.174+0000 7fea92e9a640 1 -- 172.21.15.79:0/13176130 shutdown_connections 2024-04-25T02:08:23.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.174+0000 7fea92e9a640 1 -- 172.21.15.79:0/13176130 wait complete. 2024-04-25T02:08:23.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.176+0000 7fea92e9a640 1 Processor -- start 2024-04-25T02:08:23.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.176+0000 7fea92e9a640 1 -- start start 2024-04-25T02:08:23.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.176+0000 7fea92e9a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fea8c0d0ef0 0x7fea8c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.176+0000 7fea92e9a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea8c0d2ca0 0x7fea8c0b8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.176+0000 7fea92e9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea8c15e4f0 0x7fea8c0cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.176+0000 7fea92e9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c0d4ee0 con 0x7fea8c15e4f0 2024-04-25T02:08:23.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.176+0000 7fea92e9a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c0cff00 con 0x7fea8c0d2ca0 2024-04-25T02:08:23.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.176+0000 7fea92e9a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fea8c0d5060 con 0x7fea8c0d0ef0 2024-04-25T02:08:23.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.176+0000 7fea91437640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea8c15e4f0 0x7fea8c0cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.177+0000 7fea91437640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea8c15e4f0 0x7fea8c0cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57520/0 (socket says 172.21.15.79:57520) 2024-04-25T02:08:23.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.177+0000 7fea91437640 1 -- 172.21.15.79:0/281458779 learned_addr learned my addr 172.21.15.79:0/281458779 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.177+0000 7fea90c36640 1 --2- 172.21.15.79:0/281458779 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fea8c0d0ef0 0x7fea8c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.177+0000 7fea91437640 1 -- 172.21.15.79:0/281458779 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fea8c0d0ef0 msgr2=0x7fea8c1551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.177+0000 7fea91437640 1 --2- 172.21.15.79:0/281458779 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fea8c0d0ef0 0x7fea8c1551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.177+0000 7fea8bfff640 1 --2- 172.21.15.79:0/281458779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea8c0d2ca0 0x7fea8c0b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.177+0000 7fea91437640 1 -- 172.21.15.79:0/281458779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea8c0d2ca0 msgr2=0x7fea8c0b8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.177+0000 7fea91437640 1 --2- 172.21.15.79:0/281458779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea8c0d2ca0 0x7fea8c0b8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.177+0000 7fea91437640 1 -- 172.21.15.79:0/281458779 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8c0b7940 con 0x7fea8c15e4f0 2024-04-25T02:08:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.177+0000 7fea91437640 1 --2- 172.21.15.79:0/281458779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea8c15e4f0 0x7fea8c0cca90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fea84007e60 tx=0x7fea8400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.177+0000 7fea897fa640 1 -- 172.21.15.79:0/281458779 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84014420 con 0x7fea8c15e4f0 2024-04-25T02:08:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.177+0000 7fea897fa640 1 -- 172.21.15.79:0/281458779 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea84019070 con 0x7fea8c15e4f0 2024-04-25T02:08:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.177+0000 7fea92e9a640 1 -- 172.21.15.79:0/281458779 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8c0b7c20 con 0x7fea8c15e4f0 2024-04-25T02:08:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.177+0000 7fea897fa640 1 -- 172.21.15.79:0/281458779 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84014820 con 0x7fea8c15e4f0 2024-04-25T02:08:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.177+0000 7fea92e9a640 1 -- 172.21.15.79:0/281458779 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea8c0ccfd0 con 0x7fea8c15e4f0 2024-04-25T02:08:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.178+0000 7fea92e9a640 1 -- 172.21.15.79:0/281458779 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea8c0686c0 con 0x7fea8c15e4f0 2024-04-25T02:08:23.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.179+0000 7fea897fa640 1 -- 172.21.15.79:0/281458779 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea840149c0 con 0x7fea8c15e4f0 2024-04-25T02:08:23.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.179+0000 7fea897fa640 1 --2- 172.21.15.79:0/281458779 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fea7006be30 0x7fea7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.179+0000 7fea90c36640 1 --2- 172.21.15.79:0/281458779 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fea7006be30 0x7fea7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.179+0000 7fea897fa640 1 -- 172.21.15.79:0/281458779 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fea8408b6f0 con 0x7fea8c15e4f0 2024-04-25T02:08:23.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.179+0000 7fea90c36640 1 --2- 172.21.15.79:0/281458779 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fea7006be30 0x7fea7006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea80007fd0 tx=0x7fea80009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:23.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.183+0000 7fea897fa640 1 -- 172.21.15.79:0/281458779 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fea8405a0a0 con 0x7fea8c15e4f0 2024-04-25T02:08:23.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.359+0000 7fea92e9a640 1 -- 172.21.15.79:0/281458779 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fea8c0ca970 con 0x7fea8c15e4f0 2024-04-25T02:08:23.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.359+0000 7fea897fa640 1 -- 172.21.15.79:0/281458779 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fea840599a0 con 0x7fea8c15e4f0 2024-04-25T02:08:23.366 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:08:23.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.361+0000 7fea92e9a640 1 -- 172.21.15.79:0/281458779 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fea7006be30 msgr2=0x7fea7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.361+0000 7fea92e9a640 1 --2- 172.21.15.79:0/281458779 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fea7006be30 0x7fea7006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea80007fd0 tx=0x7fea80009040 comp rx=0 tx=0).stop 2024-04-25T02:08:23.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.361+0000 7fea92e9a640 1 -- 172.21.15.79:0/281458779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea8c15e4f0 msgr2=0x7fea8c0cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.361+0000 7fea92e9a640 1 --2- 172.21.15.79:0/281458779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea8c15e4f0 0x7fea8c0cca90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fea84007e60 tx=0x7fea8400e4b0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.361+0000 7fea92e9a640 1 -- 172.21.15.79:0/281458779 shutdown_connections 2024-04-25T02:08:23.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.361+0000 7fea92e9a640 1 --2- 172.21.15.79:0/281458779 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fea7006be30 0x7fea7006e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.361+0000 7fea92e9a640 1 --2- 172.21.15.79:0/281458779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea8c15e4f0 0x7fea8c0cca90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.361+0000 7fea92e9a640 1 --2- 172.21.15.79:0/281458779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea8c0d2ca0 0x7fea8c0b8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.361+0000 7fea92e9a640 1 --2- 172.21.15.79:0/281458779 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fea8c0d0ef0 0x7fea8c1551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.361+0000 7fea92e9a640 1 -- 172.21.15.79:0/281458779 >> 172.21.15.79:0/281458779 conn(0x7fea8c09d4a0 msgr2=0x7fea8c06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:23.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.361+0000 7fea92e9a640 1 -- 172.21.15.79:0/281458779 shutdown_connections 2024-04-25T02:08:23.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.361+0000 7fea92e9a640 1 -- 172.21.15.79:0/281458779 wait complete. 2024-04-25T02:08:23.379 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:08:23.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.473+0000 7f834982c640 1 Processor -- start 2024-04-25T02:08:23.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.473+0000 7f834982c640 1 -- start start 2024-04-25T02:08:23.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f834982c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83440d2ca0 0x7f83440d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f834982c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83440d1ee0 con 0x7f83440d0ef0 2024-04-25T02:08:23.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f834982c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83440d21c0 con 0x7f834415e4f0 2024-04-25T02:08:23.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f834982c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f83440d3100 con 0x7f83440d2ca0 2024-04-25T02:08:23.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f83437fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f83440d0ef0 0x7f834406bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60154/0 (socket says 172.21.15.79:60154) 2024-04-25T02:08:23.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f83437fe640 1 -- 172.21.15.79:0/4118671990 learned_addr learned my addr 172.21.15.79:0/4118671990 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:23.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f833bfff640 1 --2- 172.21.15.79:0/4118671990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83440d2ca0 0x7f83440d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f83427fc640 1 -- 172.21.15.79:0/4118671990 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3165457158 0 0) 0x7f83440d1ee0 con 0x7f83440d0ef0 2024-04-25T02:08:23.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f83427fc640 1 -- 172.21.15.79:0/4118671990 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8330003520 con 0x7f83440d0ef0 2024-04-25T02:08:23.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f83427fc640 1 -- 172.21.15.79:0/4118671990 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2294225413 0 0) 0x7f8330003520 con 0x7f83440d0ef0 2024-04-25T02:08:23.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f83427fc640 1 -- 172.21.15.79:0/4118671990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83440d2ca0 msgr2=0x7f83440d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:23.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f83427fc640 1 --2- 172.21.15.79:0/4118671990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83440d2ca0 0x7f83440d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f83427fc640 1 -- 172.21.15.79:0/4118671990 >> v1:172.21.15.189:6789/0 conn(0x7f834415e4f0 legacy=0x7f83440cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f83427fc640 1 -- 172.21.15.79:0/4118671990 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83440d24a0 con 0x7f83440d0ef0 2024-04-25T02:08:23.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f83427fc640 1 -- 172.21.15.79:0/4118671990 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f833c0019f0 con 0x7f83440d0ef0 2024-04-25T02:08:23.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f83427fc640 1 -- 172.21.15.79:0/4118671990 >> v1:172.21.15.79:6789/0 conn(0x7f83440d0ef0 legacy=0x7f834406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f83427fc640 1 --2- 172.21.15.79:0/4118671990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83300039e0 0x7f8330003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.474+0000 7f83427fc640 1 --2- 172.21.15.79:0/4118671990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8330004390 0x7f8330004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.475+0000 7f83427fc640 1 --2- 172.21.15.79:0/4118671990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83440d2ca0 0x7f83300050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.475+0000 7f83427fc640 1 -- 172.21.15.79:0/4118671990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f83440d3100 con 0x7f8330004390 2024-04-25T02:08:23.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.475+0000 7f83427fc640 1 -- 172.21.15.79:0/4118671990 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f833000ba20 con 0x7f83300039e0 2024-04-25T02:08:23.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.475+0000 7f83427fc640 1 -- 172.21.15.79:0/4118671990 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f833000bc20 con 0x7f83440d2ca0 2024-04-25T02:08:23.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.475+0000 7f833bfff640 1 --2- 172.21.15.79:0/4118671990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8330004390 0x7f8330004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.475+0000 7f8342ffd640 1 --2- 172.21.15.79:0/4118671990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83300039e0 0x7f8330003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.475+0000 7f83437fe640 1 --2- 172.21.15.79:0/4118671990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83440d2ca0 0x7f83300050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.475+0000 7f833bfff640 1 -- 172.21.15.79:0/4118671990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83440d2ca0 msgr2=0x7f83300050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:23.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.475+0000 7f833bfff640 1 --2- 172.21.15.79:0/4118671990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83440d2ca0 0x7f83300050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.475+0000 7f833bfff640 1 -- 172.21.15.79:0/4118671990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83300039e0 msgr2=0x7f8330003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:23.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.475+0000 7f833bfff640 1 --2- 172.21.15.79:0/4118671990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83300039e0 0x7f8330003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.475+0000 7f833bfff640 1 -- 172.21.15.79:0/4118671990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8330003520 con 0x7f8330004390 2024-04-25T02:08:23.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.476+0000 7f833bfff640 1 --2- 172.21.15.79:0/4118671990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8330004390 0x7f8330004860 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f832c009a90 tx=0x7f8330005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ac87f3e377fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:23.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.476+0000 7f83427fc640 1 -- 172.21.15.79:0/4118671990 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c036070 con 0x7f8330004390 2024-04-25T02:08:23.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.476+0000 7f83427fc640 1 -- 172.21.15.79:0/4118671990 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832c031400 con 0x7f8330004390 2024-04-25T02:08:23.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.476+0000 7f83427fc640 1 -- 172.21.15.79:0/4118671990 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c009690 con 0x7f8330004390 2024-04-25T02:08:23.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.476+0000 7f834982c640 1 -- 172.21.15.79:0/4118671990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8330004390 msgr2=0x7f8330004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.476+0000 7f834982c640 1 --2- 172.21.15.79:0/4118671990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8330004390 0x7f8330004860 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f832c009a90 tx=0x7f8330005830 comp rx=0 tx=0).stop 2024-04-25T02:08:23.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.476+0000 7f83437fe640 1 -- 172.21.15.79:0/4118671990 reap_dead start 2024-04-25T02:08:23.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.476+0000 7f834982c640 1 -- 172.21.15.79:0/4118671990 shutdown_connections 2024-04-25T02:08:23.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.476+0000 7f834982c640 1 -- 172.21.15.79:0/4118671990 >> 172.21.15.79:0/4118671990 conn(0x7f834409d4a0 msgr2=0x7f83440d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:23.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.476+0000 7f834982c640 1 -- 172.21.15.79:0/4118671990 shutdown_connections 2024-04-25T02:08:23.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.476+0000 7f834982c640 1 -- 172.21.15.79:0/4118671990 wait complete. 2024-04-25T02:08:23.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.478+0000 7f834982c640 1 Processor -- start 2024-04-25T02:08:23.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.478+0000 7f834982c640 1 -- start start 2024-04-25T02:08:23.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.478+0000 7f834982c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8330004390 0x7f83441f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.478+0000 7f834982c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83440c9db0 0x7f83440ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.478+0000 7f834982c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f834414dcc0 0x7f834414e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.478+0000 7f834982c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f83440d4ee0 con 0x7f83440c9db0 2024-04-25T02:08:23.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.478+0000 7f834982c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f83440cff00 con 0x7f834414dcc0 2024-04-25T02:08:23.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.478+0000 7f834982c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f83440d5060 con 0x7f8330004390 2024-04-25T02:08:23.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.478+0000 7f833bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83440c9db0 0x7f83440ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.478+0000 7f833bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83440c9db0 0x7f83440ca230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57542/0 (socket says 172.21.15.79:57542) 2024-04-25T02:08:23.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.478+0000 7f833bfff640 1 -- 172.21.15.79:0/4192628547 learned_addr learned my addr 172.21.15.79:0/4192628547 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:23.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.479+0000 7f83437fe640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f834414dcc0 0x7f834414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.479+0000 7f8342ffd640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8330004390 0x7f83441f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.479+0000 7f833bfff640 1 -- 172.21.15.79:0/4192628547 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8330004390 msgr2=0x7f83441f7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.479+0000 7f833bfff640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8330004390 0x7f83441f7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.479+0000 7f833bfff640 1 -- 172.21.15.79:0/4192628547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f834414dcc0 msgr2=0x7f834414e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.479+0000 7f833bfff640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f834414dcc0 0x7f834414e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.479+0000 7f833bfff640 1 -- 172.21.15.79:0/4192628547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83440cab00 con 0x7f83440c9db0 2024-04-25T02:08:23.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.479+0000 7f83437fe640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f834414dcc0 0x7f834414e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:23.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.479+0000 7f8342ffd640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8330004390 0x7f83441f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:23.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.479+0000 7f833bfff640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83440c9db0 0x7f83440ca230 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f832c034040 tx=0x7f832c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:23.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.479+0000 7f8340ff9640 1 -- 172.21.15.79:0/4192628547 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c040020 con 0x7f83440c9db0 2024-04-25T02:08:23.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.479+0000 7f8340ff9640 1 -- 172.21.15.79:0/4192628547 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832c003b40 con 0x7f83440c9db0 2024-04-25T02:08:23.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.479+0000 7f834982c640 1 -- 172.21.15.79:0/4192628547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83440cade0 con 0x7f83440c9db0 2024-04-25T02:08:23.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.479+0000 7f8340ff9640 1 -- 172.21.15.79:0/4192628547 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c036040 con 0x7f83440c9db0 2024-04-25T02:08:23.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.479+0000 7f834982c640 1 -- 172.21.15.79:0/4192628547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83440ca770 con 0x7f83440c9db0 2024-04-25T02:08:23.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.480+0000 7f834982c640 1 -- 172.21.15.79:0/4192628547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83440686c0 con 0x7f83440c9db0 2024-04-25T02:08:23.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.480+0000 7f8340ff9640 1 -- 172.21.15.79:0/4192628547 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f832c043020 con 0x7f83440c9db0 2024-04-25T02:08:23.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.481+0000 7f8340ff9640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f832406be30 0x7f832406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.481+0000 7f8340ff9640 1 -- 172.21.15.79:0/4192628547 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f832c0ab050 con 0x7f83440c9db0 2024-04-25T02:08:23.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.481+0000 7f8342ffd640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f832406be30 0x7f832406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.481+0000 7f8342ffd640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f832406be30 0x7f832406e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f83440b74a0 tx=0x7f8334009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:23.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.485+0000 7f8340ff9640 1 -- 172.21.15.79:0/4192628547 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f832c04a070 con 0x7f83440c9db0 2024-04-25T02:08:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.657+0000 7f834982c640 1 -- 172.21.15.79:0/4192628547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f834415c820 con 0x7f83440c9db0 2024-04-25T02:08:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.657+0000 7f8340ff9640 1 -- 172.21.15.79:0/4192628547 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f834415c820 con 0x7f83440c9db0 2024-04-25T02:08:23.664 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:08:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.659+0000 7f834982c640 1 -- 172.21.15.79:0/4192628547 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f832406be30 msgr2=0x7f832406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.659+0000 7f834982c640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f832406be30 0x7f832406e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f83440b74a0 tx=0x7f8334009040 comp rx=0 tx=0).stop 2024-04-25T02:08:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.659+0000 7f834982c640 1 -- 172.21.15.79:0/4192628547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83440c9db0 msgr2=0x7f83440ca230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.659+0000 7f834982c640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83440c9db0 0x7f83440ca230 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f832c034040 tx=0x7f832c004730 comp rx=0 tx=0).stop 2024-04-25T02:08:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.659+0000 7f834982c640 1 -- 172.21.15.79:0/4192628547 shutdown_connections 2024-04-25T02:08:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.659+0000 7f834982c640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f832406be30 0x7f832406e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.659+0000 7f834982c640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f834414dcc0 0x7f834414e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.659+0000 7f834982c640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83440c9db0 0x7f83440ca230 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.659+0000 7f834982c640 1 --2- 172.21.15.79:0/4192628547 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8330004390 0x7f83441f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.659+0000 7f834982c640 1 -- 172.21.15.79:0/4192628547 >> 172.21.15.79:0/4192628547 conn(0x7f834409d4a0 msgr2=0x7f834406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.659+0000 7f834982c640 1 -- 172.21.15.79:0/4192628547 shutdown_connections 2024-04-25T02:08:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.659+0000 7f834982c640 1 -- 172.21.15.79:0/4192628547 wait complete. 2024-04-25T02:08:23.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:23.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.767+0000 7efed0328640 1 Processor -- start 2024-04-25T02:08:23.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.767+0000 7efed0328640 1 -- start start 2024-04-25T02:08:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.768+0000 7efed0328640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efec80b3570 0x7efec80d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.768+0000 7efed0328640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec80b3020 0x7efec80d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.768+0000 7efed0328640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec806c380 con 0x7efec815e4d0 2024-04-25T02:08:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.768+0000 7efed0328640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7efec80d1660 con 0x7efec80b3570 2024-04-25T02:08:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.768+0000 7efed0328640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efec80d1380 con 0x7efec80b3020 2024-04-25T02:08:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.768+0000 7efecd8c3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efec80b3570 0x7efec80d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.768+0000 7efecd8c3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efec80b3570 0x7efec80d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59624/0 (socket says 172.21.15.79:59624) 2024-04-25T02:08:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.768+0000 7efecd8c3640 1 -- 172.21.15.79:0/1171951072 learned_addr learned my addr 172.21.15.79:0/1171951072 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.769+0000 7efecd8c3640 1 -- 172.21.15.79:0/1171951072 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec80b3020 msgr2=0x7efec80d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.769+0000 7efecd8c3640 1 --2- 172.21.15.79:0/1171951072 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec80b3020 0x7efec80d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.769+0000 7efecd8c3640 1 -- 172.21.15.79:0/1171951072 >> v1:172.21.15.189:6789/0 conn(0x7efec815e4d0 legacy=0x7efec806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.769+0000 7efecd8c3640 1 -- 172.21.15.79:0/1171951072 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec80cede0 con 0x7efec80b3570 2024-04-25T02:08:23.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.769+0000 7efecd8c3640 1 --2- 172.21.15.79:0/1171951072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec80b3570 0x7efec80d2710 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efeb80098a0 tx=0x7efeb802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63513a44464d51c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:23.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.769+0000 7efecd0c2640 1 -- 172.21.15.79:0/1171951072 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb8037070 con 0x7efec80b3570 2024-04-25T02:08:23.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.769+0000 7efecd0c2640 1 -- 172.21.15.79:0/1171951072 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb8032440 con 0x7efec80b3570 2024-04-25T02:08:23.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.769+0000 7efecd0c2640 1 -- 172.21.15.79:0/1171951072 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb8032810 con 0x7efec80b3570 2024-04-25T02:08:23.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.770+0000 7efed0328640 1 -- 172.21.15.79:0/1171951072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec80b3570 msgr2=0x7efec80d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.770+0000 7efed0328640 1 --2- 172.21.15.79:0/1171951072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec80b3570 0x7efec80d2710 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efeb80098a0 tx=0x7efeb802a250 comp rx=0 tx=0).stop 2024-04-25T02:08:23.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.770+0000 7efed0328640 1 -- 172.21.15.79:0/1171951072 shutdown_connections 2024-04-25T02:08:23.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.770+0000 7efed0328640 1 --2- 172.21.15.79:0/1171951072 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec80b3020 0x7efec80d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.770+0000 7efed0328640 1 --2- 172.21.15.79:0/1171951072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec80b3570 0x7efec80d2710 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.770+0000 7efed0328640 1 -- 172.21.15.79:0/1171951072 >> 172.21.15.79:0/1171951072 conn(0x7efec809d460 msgr2=0x7efec80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:23.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.770+0000 7efed0328640 1 -- 172.21.15.79:0/1171951072 shutdown_connections 2024-04-25T02:08:23.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.770+0000 7efed0328640 1 -- 172.21.15.79:0/1171951072 wait complete. 2024-04-25T02:08:23.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.771+0000 7efed0328640 1 Processor -- start 2024-04-25T02:08:23.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.771+0000 7efed0328640 1 -- start start 2024-04-25T02:08:23.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efed0328640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efec80b3020 0x7efec815d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efed0328640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec80b3570 0x7efec80b9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efed0328640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec815e4d0 0x7efec80b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efed0328640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efec80d20d0 con 0x7efec80b3570 2024-04-25T02:08:23.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efed0328640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efec815e8b0 con 0x7efec80b3020 2024-04-25T02:08:23.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efed0328640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efec80d2250 con 0x7efec815e4d0 2024-04-25T02:08:23.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efecd8c3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec80b3570 0x7efec80b9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efecd8c3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec80b3570 0x7efec80b9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59628/0 (socket says 172.21.15.79:59628) 2024-04-25T02:08:23.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efecd8c3640 1 -- 172.21.15.79:0/1287994683 learned_addr learned my addr 172.21.15.79:0/1287994683 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:23.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efece0c4640 1 --2- 172.21.15.79:0/1287994683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efec80b3020 0x7efec815d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efecd8c3640 1 -- 172.21.15.79:0/1287994683 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec815e4d0 msgr2=0x7efec80b58d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T02:08:23.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efecd8c3640 1 --2- 172.21.15.79:0/1287994683 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec815e4d0 0x7efec80b58d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efecd8c3640 1 -- 172.21.15.79:0/1287994683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efec80b3020 msgr2=0x7efec815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efecd8c3640 1 --2- 172.21.15.79:0/1287994683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efec80b3020 0x7efec815d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efecd8c3640 1 -- 172.21.15.79:0/1287994683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec80b78d0 con 0x7efec80b3570 2024-04-25T02:08:23.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efece0c4640 1 --2- 172.21.15.79:0/1287994683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efec80b3020 0x7efec815d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:23.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efecd8c3640 1 --2- 172.21.15.79:0/1287994683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec80b3570 0x7efec80b9510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efeb80090b0 tx=0x7efeb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:23.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efebeffd640 1 -- 172.21.15.79:0/1287994683 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb8037040 con 0x7efec80b3570 2024-04-25T02:08:23.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efebeffd640 1 -- 172.21.15.79:0/1287994683 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb8004250 con 0x7efec80b3570 2024-04-25T02:08:23.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efed0328640 1 -- 172.21.15.79:0/1287994683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec80b7bb0 con 0x7efec80b3570 2024-04-25T02:08:23.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.772+0000 7efebeffd640 1 -- 172.21.15.79:0/1287994683 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb803c730 con 0x7efec80b3570 2024-04-25T02:08:23.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.773+0000 7efed0328640 1 -- 172.21.15.79:0/1287994683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec80b8170 con 0x7efec80b3570 2024-04-25T02:08:23.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.774+0000 7efed0328640 1 -- 172.21.15.79:0/1287994683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec80690a0 con 0x7efec80b3570 2024-04-25T02:08:23.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.774+0000 7efebeffd640 1 -- 172.21.15.79:0/1287994683 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efeb803a070 con 0x7efec80b3570 2024-04-25T02:08:23.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.774+0000 7efebeffd640 1 --2- 172.21.15.79:0/1287994683 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efeac06be60 0x7efeac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:23.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.774+0000 7efebeffd640 1 -- 172.21.15.79:0/1287994683 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efeb80ab7c0 con 0x7efec80b3570 2024-04-25T02:08:23.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.774+0000 7efece0c4640 1 --2- 172.21.15.79:0/1287994683 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efeac06be60 0x7efeac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:23.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.775+0000 7efece0c4640 1 --2- 172.21.15.79:0/1287994683 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efeac06be60 0x7efeac06e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efec4007e90 tx=0x7efec40073a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:23.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.778+0000 7efebeffd640 1 -- 172.21.15.79:0/1287994683 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efeb8041020 con 0x7efec80b3570 2024-04-25T02:08:23.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.952+0000 7efed0328640 1 -- 172.21.15.79:0/1287994683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efec80d1920 con 0x7efec80b3570 2024-04-25T02:08:23.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.953+0000 7efebeffd640 1 -- 172.21.15.79:0/1287994683 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7efeb807a170 con 0x7efec80b3570 2024-04-25T02:08:23.960 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:23.960 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:23.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.955+0000 7efed0328640 1 -- 172.21.15.79:0/1287994683 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efeac06be60 msgr2=0x7efeac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.955+0000 7efed0328640 1 --2- 172.21.15.79:0/1287994683 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efeac06be60 0x7efeac06e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efec4007e90 tx=0x7efec40073a0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.955+0000 7efed0328640 1 -- 172.21.15.79:0/1287994683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec80b3570 msgr2=0x7efec80b9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:23.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.955+0000 7efed0328640 1 --2- 172.21.15.79:0/1287994683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec80b3570 0x7efec80b9510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efeb80090b0 tx=0x7efeb80046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.955+0000 7efed0328640 1 -- 172.21.15.79:0/1287994683 shutdown_connections 2024-04-25T02:08:23.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.955+0000 7efed0328640 1 --2- 172.21.15.79:0/1287994683 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efeac06be60 0x7efeac06e320 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.955+0000 7efed0328640 1 --2- 172.21.15.79:0/1287994683 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efec815e4d0 0x7efec80b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.955+0000 7efed0328640 1 --2- 172.21.15.79:0/1287994683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec80b3570 0x7efec80b9510 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.955+0000 7efed0328640 1 --2- 172.21.15.79:0/1287994683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efec80b3020 0x7efec815d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.955+0000 7efed0328640 1 -- 172.21.15.79:0/1287994683 >> 172.21.15.79:0/1287994683 conn(0x7efec809d460 msgr2=0x7efec80b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.955+0000 7efed0328640 1 -- 172.21.15.79:0/1287994683 shutdown_connections 2024-04-25T02:08:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:23.955+0000 7efed0328640 1 -- 172.21.15.79:0/1287994683 wait complete. 2024-04-25T02:08:23.973 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:57.115253+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:58.421392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:08:23.973 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:08:24.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.067+0000 7f963d87b640 1 Processor -- start 2024-04-25T02:08:24.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.067+0000 7f963d87b640 1 -- start start 2024-04-25T02:08:24.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.068+0000 7f963d87b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f963815e4f0 0x7f96380d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.068+0000 7f963d87b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96380cf7f0 0x7f96380d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.068+0000 7f963d87b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96380d1ee0 con 0x7f96380cfc50 2024-04-25T02:08:24.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.068+0000 7f963d87b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f96380d21c0 con 0x7f963815e4f0 2024-04-25T02:08:24.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.068+0000 7f963d87b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f96380d24a0 con 0x7f96380cf7f0 2024-04-25T02:08:24.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.068+0000 7f9636ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f963815e4f0 0x7f96380d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.068+0000 7f9636ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f963815e4f0 0x7f96380d2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59634/0 (socket says 172.21.15.79:59634) 2024-04-25T02:08:24.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.068+0000 7f9636ffd640 1 -- 172.21.15.79:0/10873557 learned_addr learned my addr 172.21.15.79:0/10873557 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:24.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.068+0000 7f9636ffd640 1 -- 172.21.15.79:0/10873557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96380cf7f0 msgr2=0x7f96380d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:24.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.068+0000 7f9636ffd640 1 --2- 172.21.15.79:0/10873557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96380cf7f0 0x7f96380d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.068+0000 7f9636ffd640 1 -- 172.21.15.79:0/10873557 >> v1:172.21.15.189:6789/0 conn(0x7f96380cfc50 legacy=0x7f963806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:24.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.068+0000 7f9636ffd640 1 -- 172.21.15.79:0/10873557 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96380d2780 con 0x7f963815e4f0 2024-04-25T02:08:24.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.069+0000 7f9636ffd640 1 --2- 172.21.15.79:0/10873557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f963815e4f0 0x7f96380d2ca0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f96280098a0 tx=0x7f962802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84d4f0f55d323c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:24.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.069+0000 7f96367fc640 1 -- 172.21.15.79:0/10873557 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628037070 con 0x7f963815e4f0 2024-04-25T02:08:24.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.069+0000 7f96367fc640 1 -- 172.21.15.79:0/10873557 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9628032440 con 0x7f963815e4f0 2024-04-25T02:08:24.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.069+0000 7f96367fc640 1 -- 172.21.15.79:0/10873557 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628032810 con 0x7f963815e4f0 2024-04-25T02:08:24.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.069+0000 7f963d87b640 1 -- 172.21.15.79:0/10873557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f963815e4f0 msgr2=0x7f96380d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.069+0000 7f963d87b640 1 --2- 172.21.15.79:0/10873557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f963815e4f0 0x7f96380d2ca0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f96280098a0 tx=0x7f962802a250 comp rx=0 tx=0).stop 2024-04-25T02:08:24.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.070+0000 7f963d87b640 1 -- 172.21.15.79:0/10873557 shutdown_connections 2024-04-25T02:08:24.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.070+0000 7f963d87b640 1 --2- 172.21.15.79:0/10873557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96380cf7f0 0x7f96380d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.070+0000 7f963d87b640 1 --2- 172.21.15.79:0/10873557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f963815e4f0 0x7f96380d2ca0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.070+0000 7f963d87b640 1 -- 172.21.15.79:0/10873557 >> 172.21.15.79:0/10873557 conn(0x7f963809d4a0 msgr2=0x7f96380d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:24.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.070+0000 7f963d87b640 1 -- 172.21.15.79:0/10873557 shutdown_connections 2024-04-25T02:08:24.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.070+0000 7f963d87b640 1 -- 172.21.15.79:0/10873557 wait complete. 2024-04-25T02:08:24.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.071+0000 7f963d87b640 1 Processor -- start 2024-04-25T02:08:24.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.071+0000 7f963d87b640 1 -- start start 2024-04-25T02:08:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.071+0000 7f963d87b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96380cf7f0 0x7f96380cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.071+0000 7f963d87b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96380cfc50 0x7f9638152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.071+0000 7f963d87b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f963815e4f0 0x7f96380cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.071+0000 7f963d87b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f96380d0ef0 con 0x7f96380cf7f0 2024-04-25T02:08:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.071+0000 7f963d87b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96380d50f0 con 0x7f96380cfc50 2024-04-25T02:08:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.071+0000 7f963d87b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f96380d1070 con 0x7f963815e4f0 2024-04-25T02:08:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f9636ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96380cf7f0 0x7f96380cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f9636ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96380cf7f0 0x7f96380cd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59644/0 (socket says 172.21.15.79:59644) 2024-04-25T02:08:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f9636ffd640 1 -- 172.21.15.79:0/558125785 learned_addr learned my addr 172.21.15.79:0/558125785 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f96377fe640 1 --2- 172.21.15.79:0/558125785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f963815e4f0 0x7f96380cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f962ffff640 1 --2- 172.21.15.79:0/558125785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96380cfc50 0x7f9638152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f9636ffd640 1 -- 172.21.15.79:0/558125785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f963815e4f0 msgr2=0x7f96380cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f9636ffd640 1 --2- 172.21.15.79:0/558125785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f963815e4f0 0x7f96380cc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f9636ffd640 1 -- 172.21.15.79:0/558125785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96380cfc50 msgr2=0x7f9638152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f9636ffd640 1 --2- 172.21.15.79:0/558125785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96380cfc50 0x7f9638152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f9636ffd640 1 -- 172.21.15.79:0/558125785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9638155870 con 0x7f96380cf7f0 2024-04-25T02:08:24.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f9636ffd640 1 --2- 172.21.15.79:0/558125785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96380cf7f0 0x7f96380cd8f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f96280098a0 tx=0x7f96280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:24.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f9634ff9640 1 -- 172.21.15.79:0/558125785 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628037040 con 0x7f96380cf7f0 2024-04-25T02:08:24.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f9634ff9640 1 -- 172.21.15.79:0/558125785 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9628004230 con 0x7f96380cf7f0 2024-04-25T02:08:24.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f963d87b640 1 -- 172.21.15.79:0/558125785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9638155b50 con 0x7f96380cf7f0 2024-04-25T02:08:24.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f9634ff9640 1 -- 172.21.15.79:0/558125785 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962803c670 con 0x7f96380cf7f0 2024-04-25T02:08:24.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.072+0000 7f963d87b640 1 -- 172.21.15.79:0/558125785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9638156110 con 0x7f96380cf7f0 2024-04-25T02:08:24.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.073+0000 7f963d87b640 1 -- 172.21.15.79:0/558125785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96380686c0 con 0x7f96380cf7f0 2024-04-25T02:08:24.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.074+0000 7f9634ff9640 1 -- 172.21.15.79:0/558125785 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f962803a070 con 0x7f96380cf7f0 2024-04-25T02:08:24.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.074+0000 7f9634ff9640 1 --2- 172.21.15.79:0/558125785 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f961806be30 0x7f961806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.074+0000 7f9634ff9640 1 -- 172.21.15.79:0/558125785 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f96280ab760 con 0x7f96380cf7f0 2024-04-25T02:08:24.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.074+0000 7f962ffff640 1 --2- 172.21.15.79:0/558125785 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f961806be30 0x7f961806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.074+0000 7f962ffff640 1 --2- 172.21.15.79:0/558125785 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f961806be30 0x7f961806e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f963815cdb0 tx=0x7f9620008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:24.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.079+0000 7f9634ff9640 1 -- 172.21.15.79:0/558125785 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9628041020 con 0x7f96380cf7f0 2024-04-25T02:08:24.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.269+0000 7f963d87b640 1 -- 172.21.15.79:0/558125785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f963815dca0 con 0x7f96380cf7f0 2024-04-25T02:08:24.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.270+0000 7f9634ff9640 1 -- 172.21.15.79:0/558125785 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f962807a230 con 0x7f96380cf7f0 2024-04-25T02:08:24.277 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:08:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.272+0000 7f963d87b640 1 -- 172.21.15.79:0/558125785 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f961806be30 msgr2=0x7f961806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.272+0000 7f963d87b640 1 --2- 172.21.15.79:0/558125785 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f961806be30 0x7f961806e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f963815cdb0 tx=0x7f9620008040 comp rx=0 tx=0).stop 2024-04-25T02:08:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.272+0000 7f963d87b640 1 -- 172.21.15.79:0/558125785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96380cf7f0 msgr2=0x7f96380cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.272+0000 7f963d87b640 1 --2- 172.21.15.79:0/558125785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96380cf7f0 0x7f96380cd8f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f96280098a0 tx=0x7f96280046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.272+0000 7f963d87b640 1 -- 172.21.15.79:0/558125785 shutdown_connections 2024-04-25T02:08:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.272+0000 7f963d87b640 1 --2- 172.21.15.79:0/558125785 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f961806be30 0x7f961806e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.272+0000 7f963d87b640 1 --2- 172.21.15.79:0/558125785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f963815e4f0 0x7f96380cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.272+0000 7f963d87b640 1 --2- 172.21.15.79:0/558125785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96380cfc50 0x7f9638152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.272+0000 7f963d87b640 1 --2- 172.21.15.79:0/558125785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96380cf7f0 0x7f96380cd8f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.272+0000 7f963d87b640 1 -- 172.21.15.79:0/558125785 >> 172.21.15.79:0/558125785 conn(0x7f963809d4a0 msgr2=0x7f963806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.272+0000 7f963d87b640 1 -- 172.21.15.79:0/558125785 shutdown_connections 2024-04-25T02:08:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.272+0000 7f963d87b640 1 -- 172.21.15.79:0/558125785 wait complete. 2024-04-25T02:08:24.290 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:08:24.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.382+0000 7fad0ba8c640 1 Processor -- start 2024-04-25T02:08:24.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.383+0000 7fad0ba8c640 1 -- start start 2024-04-25T02:08:24.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.383+0000 7fad0ba8c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad040d2ca0 0x7fad040d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.383+0000 7fad0ba8c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad040d1ee0 con 0x7fad040d0ef0 2024-04-25T02:08:24.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.383+0000 7fad0ba8c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad040d21c0 con 0x7fad0415e4f0 2024-04-25T02:08:24.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.383+0000 7fad0ba8c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fad040d3100 con 0x7fad040d2ca0 2024-04-25T02:08:24.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.383+0000 7fad0a029640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fad040d0ef0 0x7fad0406bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58474/0 (socket says 172.21.15.79:58474) 2024-04-25T02:08:24.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad0a029640 1 -- 172.21.15.79:0/2401625538 learned_addr learned my addr 172.21.15.79:0/2401625538 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:24.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad08826640 1 -- 172.21.15.79:0/2401625538 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2273922092 0 0) 0x7fad040d1ee0 con 0x7fad040d0ef0 2024-04-25T02:08:24.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad09027640 1 --2- 172.21.15.79:0/2401625538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad040d2ca0 0x7fad040d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad08826640 1 -- 172.21.15.79:0/2401625538 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facf0003520 con 0x7fad040d0ef0 2024-04-25T02:08:24.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad08826640 1 -- 172.21.15.79:0/2401625538 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2003049417 0 0) 0x7facf0003520 con 0x7fad040d0ef0 2024-04-25T02:08:24.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad08826640 1 -- 172.21.15.79:0/2401625538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad040d2ca0 msgr2=0x7fad040d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:24.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad08826640 1 --2- 172.21.15.79:0/2401625538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad040d2ca0 0x7fad040d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad08826640 1 -- 172.21.15.79:0/2401625538 >> v1:172.21.15.189:6789/0 conn(0x7fad0415e4f0 legacy=0x7fad040cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad08826640 1 -- 172.21.15.79:0/2401625538 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad040d24a0 con 0x7fad040d0ef0 2024-04-25T02:08:24.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad08826640 1 -- 172.21.15.79:0/2401625538 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7facfc001670 con 0x7fad040d0ef0 2024-04-25T02:08:24.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad08826640 1 -- 172.21.15.79:0/2401625538 >> v1:172.21.15.79:6789/0 conn(0x7fad040d0ef0 legacy=0x7fad0406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad08826640 1 --2- 172.21.15.79:0/2401625538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad040d2ca0 0x7facf00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad08826640 1 --2- 172.21.15.79:0/2401625538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facf0003f60 0x7facf0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad08826640 1 --2- 172.21.15.79:0/2401625538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7facf0004d40 0x7facf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad08826640 1 -- 172.21.15.79:0/2401625538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad040d3100 con 0x7facf0003f60 2024-04-25T02:08:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad08826640 1 -- 172.21.15.79:0/2401625538 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7facf000baa0 con 0x7facf0004d40 2024-04-25T02:08:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad08826640 1 -- 172.21.15.79:0/2401625538 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7facf000bca0 con 0x7fad040d2ca0 2024-04-25T02:08:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad09027640 1 --2- 172.21.15.79:0/2401625538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facf0003f60 0x7facf0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad09828640 1 --2- 172.21.15.79:0/2401625538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad040d2ca0 0x7facf00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad0a029640 1 --2- 172.21.15.79:0/2401625538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7facf0004d40 0x7facf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad09027640 1 -- 172.21.15.79:0/2401625538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad040d2ca0 msgr2=0x7facf00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad09027640 1 --2- 172.21.15.79:0/2401625538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad040d2ca0 0x7facf00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad09027640 1 -- 172.21.15.79:0/2401625538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7facf0004d40 msgr2=0x7facf00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad09027640 1 --2- 172.21.15.79:0/2401625538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7facf0004d40 0x7facf00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.384+0000 7fad09027640 1 -- 172.21.15.79:0/2401625538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf0003520 con 0x7facf0003f60 2024-04-25T02:08:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.385+0000 7fad09027640 1 --2- 172.21.15.79:0/2401625538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facf0003f60 0x7facf0004800 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7facf4009ac0 tx=0x7facf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb92c69e341d847 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.385+0000 7fad08826640 1 -- 172.21.15.79:0/2401625538 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4036070 con 0x7facf0003f60 2024-04-25T02:08:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.385+0000 7fad08826640 1 -- 172.21.15.79:0/2401625538 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facf4031400 con 0x7facf0003f60 2024-04-25T02:08:24.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.385+0000 7fad08826640 1 -- 172.21.15.79:0/2401625538 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4009690 con 0x7facf0003f60 2024-04-25T02:08:24.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.386+0000 7fad0ba8c640 1 -- 172.21.15.79:0/2401625538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facf0003f60 msgr2=0x7facf0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.386+0000 7fad0ba8c640 1 --2- 172.21.15.79:0/2401625538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facf0003f60 0x7facf0004800 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7facf4009ac0 tx=0x7facf0005830 comp rx=0 tx=0).stop 2024-04-25T02:08:24.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.386+0000 7fad0a029640 1 -- 172.21.15.79:0/2401625538 reap_dead start 2024-04-25T02:08:24.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.386+0000 7fad0ba8c640 1 -- 172.21.15.79:0/2401625538 shutdown_connections 2024-04-25T02:08:24.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.386+0000 7fad0ba8c640 1 -- 172.21.15.79:0/2401625538 >> 172.21.15.79:0/2401625538 conn(0x7fad0409d4a0 msgr2=0x7fad040d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:24.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.386+0000 7fad0ba8c640 1 -- 172.21.15.79:0/2401625538 shutdown_connections 2024-04-25T02:08:24.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.386+0000 7fad0ba8c640 1 -- 172.21.15.79:0/2401625538 wait complete. 2024-04-25T02:08:24.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.387+0000 7fad0ba8c640 1 Processor -- start 2024-04-25T02:08:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.387+0000 7fad0ba8c640 1 -- start start 2024-04-25T02:08:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad0ba8c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facf0003f60 0x7fad040c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad0ba8c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad04147480 0x7fad04148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad0ba8c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad040c84f0 0x7fad04148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad0ba8c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad040d4ee0 con 0x7facf0003f60 2024-04-25T02:08:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad0ba8c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fad040cff00 con 0x7fad04147480 2024-04-25T02:08:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad0ba8c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fad040d5060 con 0x7fad040c84f0 2024-04-25T02:08:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad09828640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facf0003f60 0x7fad040c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad09828640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facf0003f60 0x7fad040c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59664/0 (socket says 172.21.15.79:59664) 2024-04-25T02:08:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad09828640 1 -- 172.21.15.79:0/1978045847 learned_addr learned my addr 172.21.15.79:0/1978045847 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad09027640 1 --2- 172.21.15.79:0/1978045847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad04147480 0x7fad04148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad0a029640 1 --2- 172.21.15.79:0/1978045847 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad040c84f0 0x7fad04148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad09828640 1 -- 172.21.15.79:0/1978045847 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad040c84f0 msgr2=0x7fad04148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad09828640 1 --2- 172.21.15.79:0/1978045847 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad040c84f0 0x7fad04148ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad09828640 1 -- 172.21.15.79:0/1978045847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad04147480 msgr2=0x7fad04148990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad09828640 1 --2- 172.21.15.79:0/1978045847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad04147480 0x7fad04148990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad09828640 1 -- 172.21.15.79:0/1978045847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad04147910 con 0x7facf0003f60 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad09828640 1 --2- 172.21.15.79:0/1978045847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facf0003f60 0x7fad040c7fb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fad0000e8c0 tx=0x7fad0000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7facfa7fc640 1 -- 172.21.15.79:0/1978045847 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00003b80 con 0x7facf0003f60 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7facfa7fc640 1 -- 172.21.15.79:0/1978045847 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad00018070 con 0x7facf0003f60 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad0ba8c640 1 -- 172.21.15.79:0/1978045847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad04147bf0 con 0x7facf0003f60 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7facfa7fc640 1 -- 172.21.15.79:0/1978045847 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad000050d0 con 0x7facf0003f60 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.388+0000 7fad0ba8c640 1 -- 172.21.15.79:0/1978045847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad041481b0 con 0x7facf0003f60 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.389+0000 7fad0ba8c640 1 -- 172.21.15.79:0/1978045847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad040686c0 con 0x7facf0003f60 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.390+0000 7facfa7fc640 1 -- 172.21.15.79:0/1978045847 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad00005270 con 0x7facf0003f60 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.390+0000 7facfa7fc640 1 --2- 172.21.15.79:0/1978045847 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7face806be30 0x7face806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.390+0000 7facfa7fc640 1 -- 172.21.15.79:0/1978045847 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fad0008ad10 con 0x7facf0003f60 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.390+0000 7fad09027640 1 --2- 172.21.15.79:0/1978045847 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7face806be30 0x7face806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.390+0000 7fad09027640 1 --2- 172.21.15.79:0/1978045847 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7face806be30 0x7face806e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7facf4033000 tx=0x7facf4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:24.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.394+0000 7facfa7fc640 1 -- 172.21.15.79:0/1978045847 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fad00059100 con 0x7facf0003f60 2024-04-25T02:08:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.566+0000 7fad0ba8c640 1 -- 172.21.15.79:0/1978045847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fad040690a0 con 0x7facf0003f60 2024-04-25T02:08:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.566+0000 7facfa7fc640 1 -- 172.21.15.79:0/1978045847 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fad0005d400 con 0x7facf0003f60 2024-04-25T02:08:24.573 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:08:24.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.568+0000 7fad0ba8c640 1 -- 172.21.15.79:0/1978045847 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7face806be30 msgr2=0x7face806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.568+0000 7fad0ba8c640 1 --2- 172.21.15.79:0/1978045847 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7face806be30 0x7face806e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7facf4033000 tx=0x7facf4008030 comp rx=0 tx=0).stop 2024-04-25T02:08:24.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.568+0000 7fad0ba8c640 1 -- 172.21.15.79:0/1978045847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facf0003f60 msgr2=0x7fad040c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.568+0000 7fad0ba8c640 1 --2- 172.21.15.79:0/1978045847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facf0003f60 0x7fad040c7fb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fad0000e8c0 tx=0x7fad0000ed80 comp rx=0 tx=0).stop 2024-04-25T02:08:24.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.568+0000 7fad0ba8c640 1 -- 172.21.15.79:0/1978045847 shutdown_connections 2024-04-25T02:08:24.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.568+0000 7fad0ba8c640 1 --2- 172.21.15.79:0/1978045847 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7face806be30 0x7face806e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.568+0000 7fad0ba8c640 1 --2- 172.21.15.79:0/1978045847 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad040c84f0 0x7fad04148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.568+0000 7fad0ba8c640 1 --2- 172.21.15.79:0/1978045847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad04147480 0x7fad04148990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.568+0000 7fad0ba8c640 1 --2- 172.21.15.79:0/1978045847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facf0003f60 0x7fad040c7fb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.568+0000 7fad0ba8c640 1 -- 172.21.15.79:0/1978045847 >> 172.21.15.79:0/1978045847 conn(0x7fad0409d4a0 msgr2=0x7fad040d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:24.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.568+0000 7fad0ba8c640 1 -- 172.21.15.79:0/1978045847 shutdown_connections 2024-04-25T02:08:24.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.568+0000 7fad0ba8c640 1 -- 172.21.15.79:0/1978045847 wait complete. 2024-04-25T02:08:24.586 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:08:24.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.681+0000 7f1fc4238640 1 Processor -- start 2024-04-25T02:08:24.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.681+0000 7f1fc4238640 1 -- start start 2024-04-25T02:08:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.682+0000 7f1fc4238640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fbc15e4f0 0x7f1fbc0d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.682+0000 7f1fc4238640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fbc0d1ee0 con 0x7f1fbc0d10c0 2024-04-25T02:08:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.682+0000 7f1fc4238640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fbc0d21c0 con 0x7f1fbc0cf7f0 2024-04-25T02:08:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.682+0000 7f1fc4238640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1fbc0d24a0 con 0x7f1fbc15e4f0 2024-04-25T02:08:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.682+0000 7f1fc27d5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1fbc0d10c0 0x7f1fbc06bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58484/0 (socket says 172.21.15.79:58484) 2024-04-25T02:08:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.682+0000 7f1fc27d5640 1 -- 172.21.15.79:0/3097292260 learned_addr learned my addr 172.21.15.79:0/3097292260 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.682+0000 7f1fc1fd4640 1 --2- 172.21.15.79:0/3097292260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fbc15e4f0 0x7f1fbc0d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.682+0000 7f1fc0fd2640 1 -- 172.21.15.79:0/3097292260 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1682709821 0 0) 0x7f1fbc0d1ee0 con 0x7f1fbc0d10c0 2024-04-25T02:08:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.682+0000 7f1fc0fd2640 1 -- 172.21.15.79:0/3097292260 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fa8003520 con 0x7f1fbc0d10c0 2024-04-25T02:08:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.682+0000 7f1fc0fd2640 1 -- 172.21.15.79:0/3097292260 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2850322568 0 0) 0x7f1fa8003520 con 0x7f1fbc0d10c0 2024-04-25T02:08:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.682+0000 7f1fc0fd2640 1 -- 172.21.15.79:0/3097292260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fbc15e4f0 msgr2=0x7f1fbc0d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.682+0000 7f1fc0fd2640 1 --2- 172.21.15.79:0/3097292260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fbc15e4f0 0x7f1fbc0d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.682+0000 7f1fc0fd2640 1 -- 172.21.15.79:0/3097292260 >> v1:172.21.15.189:6789/0 conn(0x7f1fbc0cf7f0 legacy=0x7f1fbc0d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.682+0000 7f1fc0fd2640 1 -- 172.21.15.79:0/3097292260 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc0d2780 con 0x7f1fbc0d10c0 2024-04-25T02:08:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc0fd2640 1 -- 172.21.15.79:0/3097292260 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f1fb8001670 con 0x7f1fbc0d10c0 2024-04-25T02:08:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc0fd2640 1 -- 172.21.15.79:0/3097292260 >> v1:172.21.15.79:6789/0 conn(0x7f1fbc0d10c0 legacy=0x7f1fbc06bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc0fd2640 1 --2- 172.21.15.79:0/3097292260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa80039e0 0x7f1fa8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc0fd2640 1 --2- 172.21.15.79:0/3097292260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fbc15e4f0 0x7f1fa8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc0fd2640 1 --2- 172.21.15.79:0/3097292260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fa8004d40 0x7f1fa80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc0fd2640 1 -- 172.21.15.79:0/3097292260 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc0d24a0 con 0x7f1fa80039e0 2024-04-25T02:08:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc0fd2640 1 -- 172.21.15.79:0/3097292260 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa800ba70 con 0x7f1fa8004d40 2024-04-25T02:08:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc0fd2640 1 -- 172.21.15.79:0/3097292260 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1fa800bc70 con 0x7f1fbc15e4f0 2024-04-25T02:08:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc1fd4640 1 --2- 172.21.15.79:0/3097292260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa80039e0 0x7f1fa8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc17d3640 1 --2- 172.21.15.79:0/3097292260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fbc15e4f0 0x7f1fa8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc27d5640 1 --2- 172.21.15.79:0/3097292260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fa8004d40 0x7f1fa80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc1fd4640 1 -- 172.21.15.79:0/3097292260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fbc15e4f0 msgr2=0x7f1fa8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc1fd4640 1 --2- 172.21.15.79:0/3097292260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fbc15e4f0 0x7f1fa8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc1fd4640 1 -- 172.21.15.79:0/3097292260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fa8004d40 msgr2=0x7f1fa80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc1fd4640 1 --2- 172.21.15.79:0/3097292260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fa8004d40 0x7f1fa80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.683+0000 7f1fc1fd4640 1 -- 172.21.15.79:0/3097292260 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa8003520 con 0x7f1fa80039e0 2024-04-25T02:08:24.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.684+0000 7f1fc1fd4640 1 --2- 172.21.15.79:0/3097292260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa80039e0 0x7f1fa8003e00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009f90 tx=0x7f1fa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb46c909db59082e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:24.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.684+0000 7f1fc0fd2640 1 -- 172.21.15.79:0/3097292260 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4009c10 con 0x7f1fa80039e0 2024-04-25T02:08:24.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.684+0000 7f1fc0fd2640 1 -- 172.21.15.79:0/3097292260 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb4036070 con 0x7f1fa80039e0 2024-04-25T02:08:24.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.684+0000 7f1fc0fd2640 1 -- 172.21.15.79:0/3097292260 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4031850 con 0x7f1fa80039e0 2024-04-25T02:08:24.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.684+0000 7f1fc4238640 1 -- 172.21.15.79:0/3097292260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa80039e0 msgr2=0x7f1fa8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.684+0000 7f1fc4238640 1 --2- 172.21.15.79:0/3097292260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa80039e0 0x7f1fa8003e00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009f90 tx=0x7f1fa8005830 comp rx=0 tx=0).stop 2024-04-25T02:08:24.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.684+0000 7f1fc27d5640 1 -- 172.21.15.79:0/3097292260 reap_dead start 2024-04-25T02:08:24.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.685+0000 7f1fc4238640 1 -- 172.21.15.79:0/3097292260 shutdown_connections 2024-04-25T02:08:24.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.685+0000 7f1fc4238640 1 -- 172.21.15.79:0/3097292260 >> 172.21.15.79:0/3097292260 conn(0x7f1fbc09d4a0 msgr2=0x7f1fbc0d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:24.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.685+0000 7f1fc4238640 1 -- 172.21.15.79:0/3097292260 shutdown_connections 2024-04-25T02:08:24.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.685+0000 7f1fc4238640 1 -- 172.21.15.79:0/3097292260 wait complete. 2024-04-25T02:08:24.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.686+0000 7f1fc4238640 1 Processor -- start 2024-04-25T02:08:24.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.686+0000 7f1fc4238640 1 -- start start 2024-04-25T02:08:24.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc4238640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa80039e0 0x7f1fbc150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc4238640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fbc159300 0x7f1fbc159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc4238640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fbc14d290 0x7f1fbc14d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc4238640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc0cfc50 con 0x7f1fa80039e0 2024-04-25T02:08:24.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc4238640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc0d50f0 con 0x7f1fbc159300 2024-04-25T02:08:24.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc4238640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1fbc0cfdd0 con 0x7f1fbc14d290 2024-04-25T02:08:24.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc1fd4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa80039e0 0x7f1fbc150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc1fd4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa80039e0 0x7f1fbc150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59684/0 (socket says 172.21.15.79:59684) 2024-04-25T02:08:24.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc1fd4640 1 -- 172.21.15.79:0/1059631587 learned_addr learned my addr 172.21.15.79:0/1059631587 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:24.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc27d5640 1 --2- 172.21.15.79:0/1059631587 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fbc14d290 0x7f1fbc14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc17d3640 1 --2- 172.21.15.79:0/1059631587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fbc159300 0x7f1fbc159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc1fd4640 1 -- 172.21.15.79:0/1059631587 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fbc14d290 msgr2=0x7f1fbc14d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc1fd4640 1 --2- 172.21.15.79:0/1059631587 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fbc14d290 0x7f1fbc14d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc1fd4640 1 -- 172.21.15.79:0/1059631587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fbc159300 msgr2=0x7f1fbc159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc1fd4640 1 --2- 172.21.15.79:0/1059631587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fbc159300 0x7f1fbc159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc1fd4640 1 -- 172.21.15.79:0/1059631587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc159e50 con 0x7f1fa80039e0 2024-04-25T02:08:24.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc17d3640 1 --2- 172.21.15.79:0/1059631587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fbc159300 0x7f1fbc159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:24.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc1fd4640 1 --2- 172.21.15.79:0/1059631587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa80039e0 0x7f1fbc150e60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400e230 tx=0x7f1fb4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:24.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fb27fc640 1 -- 172.21.15.79:0/1059631587 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4009c10 con 0x7f1fa80039e0 2024-04-25T02:08:24.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fb27fc640 1 -- 172.21.15.79:0/1059631587 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb4045630 con 0x7f1fa80039e0 2024-04-25T02:08:24.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc4238640 1 -- 172.21.15.79:0/1059631587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fbc15a130 con 0x7f1fa80039e0 2024-04-25T02:08:24.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fb27fc640 1 -- 172.21.15.79:0/1059631587 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4045a20 con 0x7f1fa80039e0 2024-04-25T02:08:24.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.687+0000 7f1fc4238640 1 -- 172.21.15.79:0/1059631587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fbc15a6f0 con 0x7f1fa80039e0 2024-04-25T02:08:24.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.688+0000 7f1fc4238640 1 -- 172.21.15.79:0/1059631587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fbc0686c0 con 0x7f1fa80039e0 2024-04-25T02:08:24.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.689+0000 7f1fb27fc640 1 -- 172.21.15.79:0/1059631587 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fb4005d10 con 0x7f1fa80039e0 2024-04-25T02:08:24.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.690+0000 7f1fb27fc640 1 --2- 172.21.15.79:0/1059631587 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa006be30 0x7f1fa006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:24.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.690+0000 7f1fb27fc640 1 -- 172.21.15.79:0/1059631587 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1fb40ac9a0 con 0x7f1fa80039e0 2024-04-25T02:08:24.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.690+0000 7f1fc17d3640 1 --2- 172.21.15.79:0/1059631587 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa006be30 0x7f1fa006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:24.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.690+0000 7f1fc17d3640 1 --2- 172.21.15.79:0/1059631587 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa006be30 0x7f1fa006e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc14e390 tx=0x7f1fac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:24.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.694+0000 7f1fb27fc640 1 -- 172.21.15.79:0/1059631587 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1fb402e050 con 0x7f1fa80039e0 2024-04-25T02:08:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.868+0000 7f1fc4238640 1 -- 172.21.15.79:0/1059631587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1fbc0690a0 con 0x7f1fa80039e0 2024-04-25T02:08:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.868+0000 7f1fb27fc640 1 -- 172.21.15.79:0/1059631587 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f1fb407b2d0 con 0x7f1fa80039e0 2024-04-25T02:08:24.875 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:08:24.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.870+0000 7f1fc4238640 1 -- 172.21.15.79:0/1059631587 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa006be30 msgr2=0x7f1fa006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.870+0000 7f1fc4238640 1 --2- 172.21.15.79:0/1059631587 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa006be30 0x7f1fa006e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc14e390 tx=0x7f1fac009040 comp rx=0 tx=0).stop 2024-04-25T02:08:24.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.870+0000 7f1fc4238640 1 -- 172.21.15.79:0/1059631587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa80039e0 msgr2=0x7f1fbc150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:24.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.870+0000 7f1fc4238640 1 --2- 172.21.15.79:0/1059631587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa80039e0 0x7f1fbc150e60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400e230 tx=0x7f1fb4009750 comp rx=0 tx=0).stop 2024-04-25T02:08:24.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.870+0000 7f1fc4238640 1 -- 172.21.15.79:0/1059631587 shutdown_connections 2024-04-25T02:08:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.870+0000 7f1fc4238640 1 --2- 172.21.15.79:0/1059631587 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa006be30 0x7f1fa006e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.870+0000 7f1fc4238640 1 --2- 172.21.15.79:0/1059631587 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fbc14d290 0x7f1fbc14d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.870+0000 7f1fc4238640 1 --2- 172.21.15.79:0/1059631587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fbc159300 0x7f1fbc159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.870+0000 7f1fc4238640 1 --2- 172.21.15.79:0/1059631587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa80039e0 0x7f1fbc150e60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.870+0000 7f1fc4238640 1 -- 172.21.15.79:0/1059631587 >> 172.21.15.79:0/1059631587 conn(0x7f1fbc09d4a0 msgr2=0x7f1fbc06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.870+0000 7f1fc4238640 1 -- 172.21.15.79:0/1059631587 shutdown_connections 2024-04-25T02:08:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:24.870+0000 7f1fc4238640 1 -- 172.21.15.79:0/1059631587 wait complete. 2024-04-25T02:08:24.910 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T02:08:24.911 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.000+0000 7f7920815640 1 Processor -- start 2024-04-25T02:08:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.000+0000 7f7920815640 1 -- start start 2024-04-25T02:08:25.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f7920815640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f791c143bc0 0x7f791c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f7920815640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f791c06df50 0x7f791c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f7920815640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f791c0b48e0 0x7f791c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f7920815640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f791c06e8f0 con 0x7f791c06df50 2024-04-25T02:08:25.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f7920815640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f791c072cb0 con 0x7f791c0b48e0 2024-04-25T02:08:25.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f7920815640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f791c15fa40 con 0x7f791c143bc0 2024-04-25T02:08:25.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f7919d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f791c06df50 0x7f791c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f7919d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f791c06df50 0x7f791c06e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59700/0 (socket says 172.21.15.79:59700) 2024-04-25T02:08:25.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f7919d9b640 1 -- 172.21.15.79:0/2065082619 learned_addr learned my addr 172.21.15.79:0/2065082619 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:25.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f791ad9d640 1 --2- 172.21.15.79:0/2065082619 >> v2:172.21.15.189:3300/0 conn(0x7f791c0b48e0 0x7f791c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f791a59c640 1 --2- 172.21.15.79:0/2065082619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f791c143bc0 0x7f791c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f7919d9b640 1 -- 172.21.15.79:0/2065082619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f791c143bc0 msgr2=0x7f791c15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:25.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f7919d9b640 1 --2- 172.21.15.79:0/2065082619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f791c143bc0 0x7f791c15f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f7919d9b640 1 -- 172.21.15.79:0/2065082619 >> v2:172.21.15.189:3300/0 conn(0x7f791c0b48e0 msgr2=0x7f791c0b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:25.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f7919d9b640 1 --2- 172.21.15.79:0/2065082619 >> v2:172.21.15.189:3300/0 conn(0x7f791c0b48e0 0x7f791c0b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f7919d9b640 1 -- 172.21.15.79:0/2065082619 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791c071e00 con 0x7f791c06df50 2024-04-25T02:08:25.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.001+0000 7f791ad9d640 1 --2- 172.21.15.79:0/2065082619 >> v2:172.21.15.189:3300/0 conn(0x7f791c0b48e0 0x7f791c0b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:25.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.002+0000 7f7919d9b640 1 --2- 172.21.15.79:0/2065082619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f791c06df50 0x7f791c06e3b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f791c144de0 tx=0x7f791002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0281c06d1f32571 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:25.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.002+0000 7f791959a640 1 -- 172.21.15.79:0/2065082619 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910037070 con 0x7f791c06df50 2024-04-25T02:08:25.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.002+0000 7f791959a640 1 -- 172.21.15.79:0/2065082619 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7910032440 con 0x7f791c06df50 2024-04-25T02:08:25.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.002+0000 7f791959a640 1 -- 172.21.15.79:0/2065082619 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910032810 con 0x7f791c06df50 2024-04-25T02:08:25.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.002+0000 7f7920815640 1 -- 172.21.15.79:0/2065082619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f791c06df50 msgr2=0x7f791c06e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.002+0000 7f7920815640 1 --2- 172.21.15.79:0/2065082619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f791c06df50 0x7f791c06e3b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f791c144de0 tx=0x7f791002a140 comp rx=0 tx=0).stop 2024-04-25T02:08:25.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.003+0000 7f7920815640 1 -- 172.21.15.79:0/2065082619 shutdown_connections 2024-04-25T02:08:25.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.003+0000 7f7920815640 1 --2- 172.21.15.79:0/2065082619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f791c06df50 0x7f791c06e3b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.003+0000 7f7920815640 1 --2- 172.21.15.79:0/2065082619 >> v2:172.21.15.189:3300/0 conn(0x7f791c0b48e0 0x7f791c0b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.003+0000 7f7920815640 1 --2- 172.21.15.79:0/2065082619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f791c143bc0 0x7f791c15f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.003+0000 7f7920815640 1 -- 172.21.15.79:0/2065082619 >> 172.21.15.79:0/2065082619 conn(0x7f791c0cfc80 msgr2=0x7f791c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:25.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.003+0000 7f7920815640 1 -- 172.21.15.79:0/2065082619 shutdown_connections 2024-04-25T02:08:25.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.003+0000 7f7920815640 1 -- 172.21.15.79:0/2065082619 wait complete. 2024-04-25T02:08:25.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.004+0000 7f7920815640 1 Processor -- start 2024-04-25T02:08:25.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.004+0000 7f7920815640 1 -- start start 2024-04-25T02:08:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f7920815640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f791c06df50 0x7f791c13f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f7920815640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f791c0b48e0 0x7f791c0b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f7920815640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f791c143bc0 0x7f791c0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f7920815640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f791c072660 con 0x7f791c143bc0 2024-04-25T02:08:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f7920815640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f791c072380 con 0x7f791c0b48e0 2024-04-25T02:08:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f7920815640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f791c072940 con 0x7f791c06df50 2024-04-25T02:08:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f791ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f791c143bc0 0x7f791c0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f791ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f791c143bc0 0x7f791c0b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59714/0 (socket says 172.21.15.79:59714) 2024-04-25T02:08:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f791ad9d640 1 -- 172.21.15.79:0/810029776 learned_addr learned my addr 172.21.15.79:0/810029776 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f791a59c640 1 --2- 172.21.15.79:0/810029776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f791c06df50 0x7f791c13f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f7919d9b640 1 --2- 172.21.15.79:0/810029776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f791c0b48e0 0x7f791c0b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f791ad9d640 1 -- 172.21.15.79:0/810029776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f791c06df50 msgr2=0x7f791c13f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f791ad9d640 1 --2- 172.21.15.79:0/810029776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f791c06df50 0x7f791c13f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f791ad9d640 1 -- 172.21.15.79:0/810029776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f791c0b48e0 msgr2=0x7f791c0b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f791ad9d640 1 --2- 172.21.15.79:0/810029776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f791c0b48e0 0x7f791c0b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f791ad9d640 1 -- 172.21.15.79:0/810029776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791c1f6190 con 0x7f791c143bc0 2024-04-25T02:08:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f7919d9b640 1 --2- 172.21.15.79:0/810029776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f791c0b48e0 0x7f791c0b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f791ad9d640 1 --2- 172.21.15.79:0/810029776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f791c143bc0 0x7f791c0b0570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7914007e40 tx=0x7f791400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f790affd640 1 -- 172.21.15.79:0/810029776 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791401a070 con 0x7f791c143bc0 2024-04-25T02:08:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f790affd640 1 -- 172.21.15.79:0/810029776 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7914003b90 con 0x7f791c143bc0 2024-04-25T02:08:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f790affd640 1 -- 172.21.15.79:0/810029776 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791400de80 con 0x7f791c143bc0 2024-04-25T02:08:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f7920815640 1 -- 172.21.15.79:0/810029776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f791c0ab7c0 con 0x7f791c143bc0 2024-04-25T02:08:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.005+0000 7f7920815640 1 -- 172.21.15.79:0/810029776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f791c13f790 con 0x7f791c143bc0 2024-04-25T02:08:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.006+0000 7f7920815640 1 -- 172.21.15.79:0/810029776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f791c0690a0 con 0x7f791c143bc0 2024-04-25T02:08:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.007+0000 7f790affd640 1 -- 172.21.15.79:0/810029776 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f791401d070 con 0x7f791c143bc0 2024-04-25T02:08:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.007+0000 7f790affd640 1 --2- 172.21.15.79:0/810029776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f78fc06be30 0x7f78fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.007+0000 7f790affd640 1 -- 172.21.15.79:0/810029776 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f791408b0e0 con 0x7f791c143bc0 2024-04-25T02:08:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.007+0000 7f791a59c640 1 --2- 172.21.15.79:0/810029776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f78fc06be30 0x7f78fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.007+0000 7f791a59c640 1 --2- 172.21.15.79:0/810029776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f78fc06be30 0x7f78fc06e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f790c006fd0 tx=0x7f790c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:25.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.011+0000 7f790affd640 1 -- 172.21.15.79:0/810029776 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7914010070 con 0x7f791c143bc0 2024-04-25T02:08:25.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.186+0000 7f7920815640 1 -- 172.21.15.79:0/810029776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f791c144320 con 0x7f791c143bc0 2024-04-25T02:08:25.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.187+0000 7f790affd640 1 -- 172.21.15.79:0/810029776 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f7914059b20 con 0x7f791c143bc0 2024-04-25T02:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.189+0000 7f7920815640 1 -- 172.21.15.79:0/810029776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f78fc06be30 msgr2=0x7f78fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.189+0000 7f7920815640 1 --2- 172.21.15.79:0/810029776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f78fc06be30 0x7f78fc06e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f790c006fd0 tx=0x7f790c008040 comp rx=0 tx=0).stop 2024-04-25T02:08:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.189+0000 7f7920815640 1 -- 172.21.15.79:0/810029776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f791c143bc0 msgr2=0x7f791c0b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.189+0000 7f7920815640 1 --2- 172.21.15.79:0/810029776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f791c143bc0 0x7f791c0b0570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7914007e40 tx=0x7f791400d4a0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.189+0000 7f7920815640 1 -- 172.21.15.79:0/810029776 shutdown_connections 2024-04-25T02:08:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.189+0000 7f7920815640 1 --2- 172.21.15.79:0/810029776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f78fc06be30 0x7f78fc06e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.189+0000 7f7920815640 1 --2- 172.21.15.79:0/810029776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f791c143bc0 0x7f791c0b0570 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.189+0000 7f7920815640 1 --2- 172.21.15.79:0/810029776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f791c0b48e0 0x7f791c0b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.189+0000 7f7920815640 1 --2- 172.21.15.79:0/810029776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f791c06df50 0x7f791c13f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.189+0000 7f7920815640 1 -- 172.21.15.79:0/810029776 >> 172.21.15.79:0/810029776 conn(0x7f791c0cfc80 msgr2=0x7f791c070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.189+0000 7f7920815640 1 -- 172.21.15.79:0/810029776 shutdown_connections 2024-04-25T02:08:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.189+0000 7f7920815640 1 -- 172.21.15.79:0/810029776 wait complete. 2024-04-25T02:08:25.207 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:57.115253+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:58.421392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:08:25.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:08:25.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.301+0000 7f987b1fb640 1 Processor -- start 2024-04-25T02:08:25.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.301+0000 7f987b1fb640 1 -- start start 2024-04-25T02:08:25.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f987b1fb640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f98740b41b0 0x7f98741605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f987b1fb640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f987406b770 0x7f9874156610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f987b1fb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9874071cd0 con 0x7f987406b2f0 2024-04-25T02:08:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f987b1fb640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f9874156b50 con 0x7f98740b41b0 2024-04-25T02:08:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f987b1fb640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9874071fb0 con 0x7f987406b770 2024-04-25T02:08:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f9873fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f987406b2f0 0x7f9874155f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58490/0 (socket says 172.21.15.79:58490) 2024-04-25T02:08:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f9873fff640 1 -- 172.21.15.79:0/2037432952 learned_addr learned my addr 172.21.15.79:0/2037432952 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f9878f97640 1 --2- 172.21.15.79:0/2037432952 >> v2:172.21.15.189:3300/0 conn(0x7f98740b41b0 0x7f98741605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f9879798640 1 --2- 172.21.15.79:0/2037432952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f987406b770 0x7f9874156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 -- 172.21.15.79:0/2037432952 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2163649445 0 0) 0x7f9874071cd0 con 0x7f987406b2f0 2024-04-25T02:08:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 -- 172.21.15.79:0/2037432952 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9864003520 con 0x7f987406b2f0 2024-04-25T02:08:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 -- 172.21.15.79:0/2037432952 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 490153367 0 0) 0x7f9864003520 con 0x7f987406b2f0 2024-04-25T02:08:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 -- 172.21.15.79:0/2037432952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f987406b770 msgr2=0x7f9874156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 --2- 172.21.15.79:0/2037432952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f987406b770 0x7f9874156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 -- 172.21.15.79:0/2037432952 >> v2:172.21.15.189:3300/0 conn(0x7f98740b41b0 msgr2=0x7f98741605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 --2- 172.21.15.79:0/2037432952 >> v2:172.21.15.189:3300/0 conn(0x7f98740b41b0 0x7f98741605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 -- 172.21.15.79:0/2037432952 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9874072290 con 0x7f987406b2f0 2024-04-25T02:08:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 -- 172.21.15.79:0/2037432952 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f9860001670 con 0x7f987406b2f0 2024-04-25T02:08:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 -- 172.21.15.79:0/2037432952 >> v1:172.21.15.79:6789/0 conn(0x7f987406b2f0 legacy=0x7f9874155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 --2- 172.21.15.79:0/2037432952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98640039b0 0x7f9864003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 --2- 172.21.15.79:0/2037432952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9864004800 0x7f9864004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 --2- 172.21.15.79:0/2037432952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f987406b770 0x7f98640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 -- 172.21.15.79:0/2037432952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9874071fb0 con 0x7f98640039b0 2024-04-25T02:08:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 -- 172.21.15.79:0/2037432952 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f986400b9c0 con 0x7f9864004800 2024-04-25T02:08:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f98737fe640 1 -- 172.21.15.79:0/2037432952 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f986400bb40 con 0x7f987406b770 2024-04-25T02:08:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.302+0000 7f9878f97640 1 --2- 172.21.15.79:0/2037432952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98640039b0 0x7f9864003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.303+0000 7f9873fff640 1 --2- 172.21.15.79:0/2037432952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9864004800 0x7f9864004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.303+0000 7f9879798640 1 --2- 172.21.15.79:0/2037432952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f987406b770 0x7f98640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.303+0000 7f9878f97640 1 -- 172.21.15.79:0/2037432952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f987406b770 msgr2=0x7f98640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.303+0000 7f9878f97640 1 --2- 172.21.15.79:0/2037432952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f987406b770 0x7f98640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.303+0000 7f9878f97640 1 -- 172.21.15.79:0/2037432952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9864004800 msgr2=0x7f9864004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.303+0000 7f9878f97640 1 --2- 172.21.15.79:0/2037432952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9864004800 0x7f9864004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.303+0000 7f9878f97640 1 -- 172.21.15.79:0/2037432952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9864003520 con 0x7f98640039b0 2024-04-25T02:08:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.303+0000 7f9879798640 1 --2- 172.21.15.79:0/2037432952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f987406b770 0x7f98640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.303+0000 7f9878f97640 1 --2- 172.21.15.79:0/2037432952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98640039b0 0x7f9864003dd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9868009ac0 tx=0x7f9864005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f78e3b8557a94f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.304+0000 7f98737fe640 1 -- 172.21.15.79:0/2037432952 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868036070 con 0x7f98640039b0 2024-04-25T02:08:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.304+0000 7f98737fe640 1 -- 172.21.15.79:0/2037432952 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9868031400 con 0x7f98640039b0 2024-04-25T02:08:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.304+0000 7f98737fe640 1 -- 172.21.15.79:0/2037432952 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868009690 con 0x7f98640039b0 2024-04-25T02:08:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.304+0000 7f987b1fb640 1 -- 172.21.15.79:0/2037432952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98640039b0 msgr2=0x7f9864003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.304+0000 7f987b1fb640 1 --2- 172.21.15.79:0/2037432952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98640039b0 0x7f9864003dd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9868009ac0 tx=0x7f9864005830 comp rx=0 tx=0).stop 2024-04-25T02:08:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.304+0000 7f9879798640 1 -- 172.21.15.79:0/2037432952 reap_dead start 2024-04-25T02:08:25.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.304+0000 7f987b1fb640 1 -- 172.21.15.79:0/2037432952 shutdown_connections 2024-04-25T02:08:25.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.304+0000 7f987b1fb640 1 -- 172.21.15.79:0/2037432952 >> 172.21.15.79:0/2037432952 conn(0x7f98740b1cd0 msgr2=0x7f98740b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:25.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.304+0000 7f987b1fb640 1 -- 172.21.15.79:0/2037432952 shutdown_connections 2024-04-25T02:08:25.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.304+0000 7f987b1fb640 1 -- 172.21.15.79:0/2037432952 wait complete. 2024-04-25T02:08:25.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.305+0000 7f987b1fb640 1 Processor -- start 2024-04-25T02:08:25.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.305+0000 7f987b1fb640 1 -- start start 2024-04-25T02:08:25.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f987b1fb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98640039b0 0x7f98740cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f987b1fb640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98740d0310 0x7f98740acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f987b1fb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98740d0790 0x7f98740ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f987b1fb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f987406bbc0 con 0x7f98740d0790 2024-04-25T02:08:25.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f987b1fb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9874160b10 con 0x7f98640039b0 2024-04-25T02:08:25.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f987b1fb640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9874072d70 con 0x7f98740d0310 2024-04-25T02:08:25.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f9879798640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98740d0790 0x7f98740ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f9879798640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98740d0790 0x7f98740ad4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59718/0 (socket says 172.21.15.79:59718) 2024-04-25T02:08:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f9879798640 1 -- 172.21.15.79:0/1220335846 learned_addr learned my addr 172.21.15.79:0/1220335846 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f9878f97640 1 --2- 172.21.15.79:0/1220335846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98640039b0 0x7f98740cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f9873fff640 1 --2- 172.21.15.79:0/1220335846 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98740d0310 0x7f98740acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f9879798640 1 -- 172.21.15.79:0/1220335846 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98740d0310 msgr2=0x7f98740acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f9879798640 1 --2- 172.21.15.79:0/1220335846 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98740d0310 0x7f98740acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f9879798640 1 -- 172.21.15.79:0/1220335846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98640039b0 msgr2=0x7f98740cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f9879798640 1 --2- 172.21.15.79:0/1220335846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98640039b0 0x7f98740cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f9879798640 1 -- 172.21.15.79:0/1220335846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98740af3c0 con 0x7f98740d0790 2024-04-25T02:08:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.306+0000 7f9878f97640 1 --2- 172.21.15.79:0/1220335846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98640039b0 0x7f98740cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.307+0000 7f9879798640 1 --2- 172.21.15.79:0/1220335846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98740d0790 0x7f98740ad4a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f98740af800 tx=0x7f986c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.307+0000 7f98717fa640 1 -- 172.21.15.79:0/1220335846 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c010e00 con 0x7f98740d0790 2024-04-25T02:08:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.307+0000 7f98717fa640 1 -- 172.21.15.79:0/1220335846 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986c003990 con 0x7f98740d0790 2024-04-25T02:08:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.307+0000 7f987b1fb640 1 -- 172.21.15.79:0/1220335846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98740cb680 con 0x7f98740d0790 2024-04-25T02:08:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.307+0000 7f98717fa640 1 -- 172.21.15.79:0/1220335846 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c003dc0 con 0x7f98740d0790 2024-04-25T02:08:25.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.307+0000 7f987b1fb640 1 -- 172.21.15.79:0/1220335846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98740cf550 con 0x7f98740d0790 2024-04-25T02:08:25.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.308+0000 7f987b1fb640 1 -- 172.21.15.79:0/1220335846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9874068950 con 0x7f98740d0790 2024-04-25T02:08:25.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.308+0000 7f98717fa640 1 -- 172.21.15.79:0/1220335846 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f986c01e030 con 0x7f98740d0790 2024-04-25T02:08:25.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.308+0000 7f98717fa640 1 --2- 172.21.15.79:0/1220335846 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f985806be30 0x7f985806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.309+0000 7f9878f97640 1 --2- 172.21.15.79:0/1220335846 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f985806be30 0x7f985806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.309+0000 7f98717fa640 1 -- 172.21.15.79:0/1220335846 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f986c08b660 con 0x7f98740d0790 2024-04-25T02:08:25.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.309+0000 7f9878f97640 1 --2- 172.21.15.79:0/1220335846 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f985806be30 0x7f985806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9868033000 tx=0x7f9868008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:25.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.313+0000 7f98717fa640 1 -- 172.21.15.79:0/1220335846 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9874068950 con 0x7f98740d0790 2024-04-25T02:08:25.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.485+0000 7f987b1fb640 1 -- 172.21.15.79:0/1220335846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f98740ce280 con 0x7f98740d0790 2024-04-25T02:08:25.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.485+0000 7f98717fa640 1 -- 172.21.15.79:0/1220335846 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f986c025020 con 0x7f98740d0790 2024-04-25T02:08:25.493 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:08:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.487+0000 7f987b1fb640 1 -- 172.21.15.79:0/1220335846 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f985806be30 msgr2=0x7f985806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.487+0000 7f987b1fb640 1 --2- 172.21.15.79:0/1220335846 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f985806be30 0x7f985806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9868033000 tx=0x7f9868008030 comp rx=0 tx=0).stop 2024-04-25T02:08:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.487+0000 7f987b1fb640 1 -- 172.21.15.79:0/1220335846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98740d0790 msgr2=0x7f98740ad4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.487+0000 7f987b1fb640 1 --2- 172.21.15.79:0/1220335846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98740d0790 0x7f98740ad4a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f98740af800 tx=0x7f986c010590 comp rx=0 tx=0).stop 2024-04-25T02:08:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.487+0000 7f987b1fb640 1 -- 172.21.15.79:0/1220335846 shutdown_connections 2024-04-25T02:08:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.487+0000 7f987b1fb640 1 --2- 172.21.15.79:0/1220335846 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f985806be30 0x7f985806e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.487+0000 7f987b1fb640 1 --2- 172.21.15.79:0/1220335846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98740d0790 0x7f98740ad4a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.487+0000 7f987b1fb640 1 --2- 172.21.15.79:0/1220335846 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98740d0310 0x7f98740acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.487+0000 7f987b1fb640 1 --2- 172.21.15.79:0/1220335846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98640039b0 0x7f98740cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.487+0000 7f987b1fb640 1 -- 172.21.15.79:0/1220335846 >> 172.21.15.79:0/1220335846 conn(0x7f98740b1cd0 msgr2=0x7f9874158470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.487+0000 7f987b1fb640 1 -- 172.21.15.79:0/1220335846 shutdown_connections 2024-04-25T02:08:25.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.488+0000 7f987b1fb640 1 -- 172.21.15.79:0/1220335846 wait complete. 2024-04-25T02:08:25.505 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:08:25.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.598+0000 7faaa79c1640 1 Processor -- start 2024-04-25T02:08:25.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.599+0000 7faaa79c1640 1 -- start start 2024-04-25T02:08:25.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.599+0000 7faaa79c1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faaa015e4f0 0x7faaa00d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.599+0000 7faaa79c1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa00d1ee0 con 0x7faaa00d10c0 2024-04-25T02:08:25.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.599+0000 7faaa79c1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa00d21c0 con 0x7faaa00cf7f0 2024-04-25T02:08:25.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.599+0000 7faaa79c1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7faaa00d24a0 con 0x7faaa015e4f0 2024-04-25T02:08:25.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.599+0000 7faaa575d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faaa015e4f0 0x7faaa00d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.599+0000 7faaa5f5e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faaa00d10c0 0x7faaa006bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58498/0 (socket says 172.21.15.79:58498) 2024-04-25T02:08:25.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.599+0000 7faaa5f5e640 1 -- 172.21.15.79:0/531792687 learned_addr learned my addr 172.21.15.79:0/531792687 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:25.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.600+0000 7faaa575d640 1 -- 172.21.15.79:0/531792687 >> v1:172.21.15.189:6789/0 conn(0x7faaa00cf7f0 legacy=0x7faaa00d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:25.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.600+0000 7faaa575d640 1 -- 172.21.15.79:0/531792687 >> v1:172.21.15.79:6789/0 conn(0x7faaa00d10c0 legacy=0x7faaa006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.600+0000 7faa97fff640 1 -- 172.21.15.79:0/531792687 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3997800480 0 0) 0x7faaa00d1ee0 con 0x7faaa00d10c0 2024-04-25T02:08:25.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.600+0000 7faaa575d640 1 -- 172.21.15.79:0/531792687 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa00d2780 con 0x7faaa015e4f0 2024-04-25T02:08:25.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.600+0000 7faaa575d640 1 --2- 172.21.15.79:0/531792687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa015e4f0 0x7faaa00d2ca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0097d0 tx=0x7faa9c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7b87c168311687 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:25.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.601+0000 7faa97fff640 1 -- 172.21.15.79:0/531792687 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c037070 con 0x7faaa015e4f0 2024-04-25T02:08:25.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.601+0000 7faa97fff640 1 -- 172.21.15.79:0/531792687 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9c032440 con 0x7faaa015e4f0 2024-04-25T02:08:25.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.601+0000 7faa97fff640 1 -- 172.21.15.79:0/531792687 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c032810 con 0x7faaa015e4f0 2024-04-25T02:08:25.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.601+0000 7faaa79c1640 1 -- 172.21.15.79:0/531792687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa015e4f0 msgr2=0x7faaa00d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.601+0000 7faaa79c1640 1 --2- 172.21.15.79:0/531792687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa015e4f0 0x7faaa00d2ca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0097d0 tx=0x7faa9c02a210 comp rx=0 tx=0).stop 2024-04-25T02:08:25.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.601+0000 7faaa79c1640 1 -- 172.21.15.79:0/531792687 shutdown_connections 2024-04-25T02:08:25.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.601+0000 7faaa79c1640 1 --2- 172.21.15.79:0/531792687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa015e4f0 0x7faaa00d2ca0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.601+0000 7faaa79c1640 1 -- 172.21.15.79:0/531792687 >> 172.21.15.79:0/531792687 conn(0x7faaa009d4a0 msgr2=0x7faaa00d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:25.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.601+0000 7faaa79c1640 1 -- 172.21.15.79:0/531792687 shutdown_connections 2024-04-25T02:08:25.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.601+0000 7faaa79c1640 1 -- 172.21.15.79:0/531792687 wait complete. 2024-04-25T02:08:25.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.602+0000 7faaa79c1640 1 Processor -- start 2024-04-25T02:08:25.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.602+0000 7faaa79c1640 1 -- start start 2024-04-25T02:08:25.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.603+0000 7faaa79c1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaa00cf7f0 0x7faaa00b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.603+0000 7faaa79c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa00d10c0 0x7faaa01f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.603+0000 7faaa79c1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaa015e4f0 0x7faaa0156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.603+0000 7faaa79c1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faaa00cfc80 con 0x7faaa00d10c0 2024-04-25T02:08:25.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.603+0000 7faaa79c1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faaa00d50f0 con 0x7faaa015e4f0 2024-04-25T02:08:25.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.603+0000 7faaa79c1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faaa00cfe00 con 0x7faaa00cf7f0 2024-04-25T02:08:25.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.603+0000 7faaa4f5c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa00d10c0 0x7faaa01f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.603+0000 7faaa4f5c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa00d10c0 0x7faaa01f7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59730/0 (socket says 172.21.15.79:59730) 2024-04-25T02:08:25.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.603+0000 7faaa4f5c640 1 -- 172.21.15.79:0/2245289152 learned_addr learned my addr 172.21.15.79:0/2245289152 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:25.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.603+0000 7faaa4f5c640 1 -- 172.21.15.79:0/2245289152 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaa00cf7f0 msgr2=0x7faaa00b7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.603+0000 7faaa4f5c640 1 --2- 172.21.15.79:0/2245289152 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaa00cf7f0 0x7faaa00b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.603+0000 7faaa4f5c640 1 -- 172.21.15.79:0/2245289152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaa015e4f0 msgr2=0x7faaa0156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.603+0000 7faaa4f5c640 1 --2- 172.21.15.79:0/2245289152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaa015e4f0 0x7faaa0156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.603+0000 7faaa4f5c640 1 -- 172.21.15.79:0/2245289152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa00b9d90 con 0x7faaa00d10c0 2024-04-25T02:08:25.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.604+0000 7faaa4f5c640 1 --2- 172.21.15.79:0/2245289152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa00d10c0 0x7faaa01f7b50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faa9000c460 tx=0x7faa9000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:25.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.604+0000 7faa95ffb640 1 -- 172.21.15.79:0/2245289152 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90016020 con 0x7faaa00d10c0 2024-04-25T02:08:25.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.604+0000 7faa95ffb640 1 -- 172.21.15.79:0/2245289152 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa90012870 con 0x7faaa00d10c0 2024-04-25T02:08:25.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.604+0000 7faaa79c1640 1 -- 172.21.15.79:0/2245289152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa00b8cf0 con 0x7faaa00d10c0 2024-04-25T02:08:25.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.604+0000 7faa95ffb640 1 -- 172.21.15.79:0/2245289152 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90012c60 con 0x7faaa00d10c0 2024-04-25T02:08:25.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.604+0000 7faaa79c1640 1 -- 172.21.15.79:0/2245289152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa00b92b0 con 0x7faaa00d10c0 2024-04-25T02:08:25.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.605+0000 7faaa79c1640 1 -- 172.21.15.79:0/2245289152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa00686c0 con 0x7faaa00d10c0 2024-04-25T02:08:25.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.605+0000 7faa95ffb640 1 -- 172.21.15.79:0/2245289152 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa90019020 con 0x7faaa00d10c0 2024-04-25T02:08:25.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.606+0000 7faa95ffb640 1 --2- 172.21.15.79:0/2245289152 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa8406be30 0x7faa8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.606+0000 7faa95ffb640 1 -- 172.21.15.79:0/2245289152 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faa9008a910 con 0x7faaa00d10c0 2024-04-25T02:08:25.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.606+0000 7faaa575d640 1 --2- 172.21.15.79:0/2245289152 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa8406be30 0x7faa8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.606+0000 7faaa575d640 1 --2- 172.21.15.79:0/2245289152 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa8406be30 0x7faa8406e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faa9c034000 tx=0x7faa9c02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:25.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.610+0000 7faa95ffb640 1 -- 172.21.15.79:0/2245289152 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faa90020070 con 0x7faaa00d10c0 2024-04-25T02:08:25.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.782+0000 7faaa79c1640 1 -- 172.21.15.79:0/2245289152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7faaa00d1a30 con 0x7faaa00d10c0 2024-04-25T02:08:25.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.783+0000 7faa95ffb640 1 -- 172.21.15.79:0/2245289152 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7faa900592c0 con 0x7faaa00d10c0 2024-04-25T02:08:25.790 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:08:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.785+0000 7faaa79c1640 1 -- 172.21.15.79:0/2245289152 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa8406be30 msgr2=0x7faa8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.785+0000 7faaa79c1640 1 --2- 172.21.15.79:0/2245289152 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa8406be30 0x7faa8406e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faa9c034000 tx=0x7faa9c02c000 comp rx=0 tx=0).stop 2024-04-25T02:08:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.785+0000 7faaa79c1640 1 -- 172.21.15.79:0/2245289152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa00d10c0 msgr2=0x7faaa01f7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.785+0000 7faaa79c1640 1 --2- 172.21.15.79:0/2245289152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa00d10c0 0x7faaa01f7b50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faa9000c460 tx=0x7faa9000c920 comp rx=0 tx=0).stop 2024-04-25T02:08:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.785+0000 7faaa79c1640 1 -- 172.21.15.79:0/2245289152 shutdown_connections 2024-04-25T02:08:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.785+0000 7faaa79c1640 1 --2- 172.21.15.79:0/2245289152 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa8406be30 0x7faa8406e2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.785+0000 7faaa79c1640 1 --2- 172.21.15.79:0/2245289152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaa015e4f0 0x7faaa0156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.785+0000 7faaa79c1640 1 --2- 172.21.15.79:0/2245289152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa00d10c0 0x7faaa01f7b50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.785+0000 7faaa79c1640 1 --2- 172.21.15.79:0/2245289152 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaa00cf7f0 0x7faaa00b7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.785+0000 7faaa79c1640 1 -- 172.21.15.79:0/2245289152 >> 172.21.15.79:0/2245289152 conn(0x7faaa009d4a0 msgr2=0x7faaa0156ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.785+0000 7faaa79c1640 1 -- 172.21.15.79:0/2245289152 shutdown_connections 2024-04-25T02:08:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.785+0000 7faaa79c1640 1 -- 172.21.15.79:0/2245289152 wait complete. 2024-04-25T02:08:25.802 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:08:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.895+0000 7fce92142640 1 Processor -- start 2024-04-25T02:08:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.895+0000 7fce92142640 1 -- start start 2024-04-25T02:08:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.896+0000 7fce92142640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce8c0b41b0 0x7fce8c1605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.896+0000 7fce92142640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fce8c06b2f0 0x7fce8c06b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.896+0000 7fce92142640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce8c155f00 0x7fce8c156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.896+0000 7fce92142640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fce8c071cd0 con 0x7fce8c0b41b0 2024-04-25T02:08:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.896+0000 7fce92142640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fce8c071fb0 con 0x7fce8c06b2f0 2024-04-25T02:08:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.896+0000 7fce92142640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fce8c072290 con 0x7fce8c155f00 2024-04-25T02:08:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.896+0000 7fce8b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce8c0b41b0 0x7fce8c1605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.896+0000 7fce8b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce8c0b41b0 0x7fce8c1605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59746/0 (socket says 172.21.15.79:59746) 2024-04-25T02:08:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.896+0000 7fce8b7fe640 1 -- 172.21.15.79:0/4028915739 learned_addr learned my addr 172.21.15.79:0/4028915739 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.897+0000 7fce8b7fe640 1 -- 172.21.15.79:0/4028915739 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce8c155f00 msgr2=0x7fce8c156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.897+0000 7fce8b7fe640 1 --2- 172.21.15.79:0/4028915739 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce8c155f00 0x7fce8c156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.897+0000 7fce8b7fe640 1 -- 172.21.15.79:0/4028915739 >> v2:172.21.15.189:3300/0 conn(0x7fce8c06b2f0 msgr2=0x7fce8c06b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.897+0000 7fce8b7fe640 1 --2- 172.21.15.79:0/4028915739 >> v2:172.21.15.189:3300/0 conn(0x7fce8c06b2f0 0x7fce8c06b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.897+0000 7fce8b7fe640 1 -- 172.21.15.79:0/4028915739 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8c072570 con 0x7fce8c0b41b0 2024-04-25T02:08:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.897+0000 7fce8b7fe640 1 --2- 172.21.15.79:0/4028915739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c0b41b0 0x7fce8c1605d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0d0d70 tx=0x7fce7c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f019ab8a8a58110 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.897+0000 7fce8a7fc640 1 -- 172.21.15.79:0/4028915739 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c037070 con 0x7fce8c0b41b0 2024-04-25T02:08:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.897+0000 7fce8a7fc640 1 -- 172.21.15.79:0/4028915739 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce7c032440 con 0x7fce8c0b41b0 2024-04-25T02:08:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.897+0000 7fce8a7fc640 1 -- 172.21.15.79:0/4028915739 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c032810 con 0x7fce8c0b41b0 2024-04-25T02:08:25.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.898+0000 7fce92142640 1 -- 172.21.15.79:0/4028915739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c0b41b0 msgr2=0x7fce8c1605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.898+0000 7fce92142640 1 --2- 172.21.15.79:0/4028915739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c0b41b0 0x7fce8c1605d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0d0d70 tx=0x7fce7c02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.898+0000 7fce92142640 1 -- 172.21.15.79:0/4028915739 shutdown_connections 2024-04-25T02:08:25.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.898+0000 7fce92142640 1 --2- 172.21.15.79:0/4028915739 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce8c155f00 0x7fce8c156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.898+0000 7fce92142640 1 --2- 172.21.15.79:0/4028915739 >> v2:172.21.15.189:3300/0 conn(0x7fce8c06b2f0 0x7fce8c06b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.898+0000 7fce92142640 1 --2- 172.21.15.79:0/4028915739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c0b41b0 0x7fce8c1605d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.898+0000 7fce92142640 1 -- 172.21.15.79:0/4028915739 >> 172.21.15.79:0/4028915739 conn(0x7fce8c0b1cd0 msgr2=0x7fce8c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:25.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.898+0000 7fce92142640 1 -- 172.21.15.79:0/4028915739 shutdown_connections 2024-04-25T02:08:25.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.898+0000 7fce92142640 1 -- 172.21.15.79:0/4028915739 wait complete. 2024-04-25T02:08:25.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.899+0000 7fce92142640 1 Processor -- start 2024-04-25T02:08:25.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.899+0000 7fce92142640 1 -- start start 2024-04-25T02:08:25.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce92142640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c06b2f0 0x7fce8c14a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce92142640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce8c0b41b0 0x7fce8c15d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce92142640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce8c155f00 0x7fce8c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce92142640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c15c870 con 0x7fce8c06b2f0 2024-04-25T02:08:25.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce92142640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c072d70 con 0x7fce8c155f00 2024-04-25T02:08:25.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce92142640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fce8c0b4590 con 0x7fce8c0b41b0 2024-04-25T02:08:25.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce8b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c06b2f0 0x7fce8c14a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce8b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c06b2f0 0x7fce8c14a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59762/0 (socket says 172.21.15.79:59762) 2024-04-25T02:08:25.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce8b7fe640 1 -- 172.21.15.79:0/3714407041 learned_addr learned my addr 172.21.15.79:0/3714407041 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:25.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce8b7fe640 1 -- 172.21.15.79:0/3714407041 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce8c0b41b0 msgr2=0x7fce8c15d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce8b7fe640 1 --2- 172.21.15.79:0/3714407041 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce8c0b41b0 0x7fce8c15d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce8b7fe640 1 -- 172.21.15.79:0/3714407041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce8c155f00 msgr2=0x7fce8c0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:25.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce8bfff640 1 --2- 172.21.15.79:0/3714407041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce8c155f00 0x7fce8c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce8b7fe640 1 --2- 172.21.15.79:0/3714407041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce8c155f00 0x7fce8c0c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:25.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce8b7fe640 1 -- 172.21.15.79:0/3714407041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8c14ac50 con 0x7fce8c06b2f0 2024-04-25T02:08:25.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.900+0000 7fce8bfff640 1 --2- 172.21.15.79:0/3714407041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce8c155f00 0x7fce8c0c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:25.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.901+0000 7fce8b7fe640 1 --2- 172.21.15.79:0/3714407041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c06b2f0 0x7fce8c14a710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fce7c000c00 tx=0x7fce7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:25.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.901+0000 7fce73fff640 1 -- 172.21.15.79:0/3714407041 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c041070 con 0x7fce8c06b2f0 2024-04-25T02:08:25.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.901+0000 7fce73fff640 1 -- 172.21.15.79:0/3714407041 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce7c03c890 con 0x7fce8c06b2f0 2024-04-25T02:08:25.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.901+0000 7fce92142640 1 -- 172.21.15.79:0/3714407041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce8c0ad5e0 con 0x7fce8c06b2f0 2024-04-25T02:08:25.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.901+0000 7fce73fff640 1 -- 172.21.15.79:0/3714407041 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c037040 con 0x7fce8c06b2f0 2024-04-25T02:08:25.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.901+0000 7fce92142640 1 -- 172.21.15.79:0/3714407041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce8c0adba0 con 0x7fce8c06b2f0 2024-04-25T02:08:25.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.902+0000 7fce92142640 1 -- 172.21.15.79:0/3714407041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce8c0690a0 con 0x7fce8c06b2f0 2024-04-25T02:08:25.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.902+0000 7fce73fff640 1 -- 172.21.15.79:0/3714407041 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce7c044070 con 0x7fce8c06b2f0 2024-04-25T02:08:25.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.903+0000 7fce73fff640 1 --2- 172.21.15.79:0/3714407041 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce7806be30 0x7fce7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:25.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.903+0000 7fce73fff640 1 -- 172.21.15.79:0/3714407041 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fce7c0abc10 con 0x7fce8c06b2f0 2024-04-25T02:08:25.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.903+0000 7fce8affd640 1 --2- 172.21.15.79:0/3714407041 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce7806be30 0x7fce7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:25.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.903+0000 7fce8affd640 1 --2- 172.21.15.79:0/3714407041 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce7806be30 0x7fce7806e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0af450 tx=0x7fce80006c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:25.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:25.907+0000 7fce73fff640 1 -- 172.21.15.79:0/3714407041 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fce7c07a650 con 0x7fce8c06b2f0 2024-04-25T02:08:26.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.079+0000 7fce92142640 1 -- 172.21.15.79:0/3714407041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fce8c0ce280 con 0x7fce8c06b2f0 2024-04-25T02:08:26.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.079+0000 7fce73fff640 1 -- 172.21.15.79:0/3714407041 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fce7c079f50 con 0x7fce8c06b2f0 2024-04-25T02:08:26.086 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:08:26.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.081+0000 7fce92142640 1 -- 172.21.15.79:0/3714407041 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce7806be30 msgr2=0x7fce7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:26.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.081+0000 7fce92142640 1 --2- 172.21.15.79:0/3714407041 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce7806be30 0x7fce7806e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0af450 tx=0x7fce80006c90 comp rx=0 tx=0).stop 2024-04-25T02:08:26.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.081+0000 7fce92142640 1 -- 172.21.15.79:0/3714407041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c06b2f0 msgr2=0x7fce8c14a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:26.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.081+0000 7fce92142640 1 --2- 172.21.15.79:0/3714407041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c06b2f0 0x7fce8c14a710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fce7c000c00 tx=0x7fce7c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.081+0000 7fce92142640 1 -- 172.21.15.79:0/3714407041 shutdown_connections 2024-04-25T02:08:26.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.081+0000 7fce92142640 1 --2- 172.21.15.79:0/3714407041 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce7806be30 0x7fce7806e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.081+0000 7fce92142640 1 --2- 172.21.15.79:0/3714407041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce8c155f00 0x7fce8c0c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.081+0000 7fce92142640 1 --2- 172.21.15.79:0/3714407041 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce8c0b41b0 0x7fce8c15d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.081+0000 7fce92142640 1 --2- 172.21.15.79:0/3714407041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c06b2f0 0x7fce8c14a710 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.081+0000 7fce92142640 1 -- 172.21.15.79:0/3714407041 >> 172.21.15.79:0/3714407041 conn(0x7fce8c0b1cd0 msgr2=0x7fce8c0b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:26.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.081+0000 7fce92142640 1 -- 172.21.15.79:0/3714407041 shutdown_connections 2024-04-25T02:08:26.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.081+0000 7fce92142640 1 -- 172.21.15.79:0/3714407041 wait complete. 2024-04-25T02:08:26.102 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-25T02:08:26.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.192+0000 7f8bef258640 1 Processor -- start 2024-04-25T02:08:26.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.192+0000 7f8bef258640 1 -- start start 2024-04-25T02:08:26.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.193+0000 7f8bef258640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8be80d26b0 0x7f8be80d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:26.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.193+0000 7f8bef258640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8be80cf3d0 con 0x7f8be80d2a90 2024-04-25T02:08:26.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.193+0000 7f8bef258640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8be80d2480 con 0x7f8be815e610 2024-04-25T02:08:26.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.193+0000 7f8bef258640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f8be815f000 con 0x7f8be80d26b0 2024-04-25T02:08:26.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.193+0000 7f8be7fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8be80d2a90 0x7f8be80cecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58504/0 (socket says 172.21.15.79:58504) 2024-04-25T02:08:26.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.193+0000 7f8be7fff640 1 -- 172.21.15.79:0/3442939346 learned_addr learned my addr 172.21.15.79:0/3442939346 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:26.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8becff4640 1 --2- 172.21.15.79:0/3442939346 >> v2:172.21.15.189:3300/0 conn(0x7f8be80d26b0 0x7f8be80d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:26.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be77fe640 1 -- 172.21.15.79:0/3442939346 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529401403 0 0) 0x7f8be80cf3d0 con 0x7f8be80d2a90 2024-04-25T02:08:26.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be77fe640 1 -- 172.21.15.79:0/3442939346 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bd0003520 con 0x7f8be80d2a90 2024-04-25T02:08:26.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be77fe640 1 -- 172.21.15.79:0/3442939346 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4016255679 0 0) 0x7f8bd0003520 con 0x7f8be80d2a90 2024-04-25T02:08:26.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be77fe640 1 -- 172.21.15.79:0/3442939346 >> v2:172.21.15.189:3300/0 conn(0x7f8be80d26b0 msgr2=0x7f8be80d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:26.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be77fe640 1 --2- 172.21.15.79:0/3442939346 >> v2:172.21.15.189:3300/0 conn(0x7f8be80d26b0 0x7f8be80d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be77fe640 1 -- 172.21.15.79:0/3442939346 >> v1:172.21.15.189:6789/0 conn(0x7f8be815e610 legacy=0x7f8be80d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:26.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be77fe640 1 -- 172.21.15.79:0/3442939346 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be815f2e0 con 0x7f8be80d2a90 2024-04-25T02:08:26.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be77fe640 1 -- 172.21.15.79:0/3442939346 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f8bdc001670 con 0x7f8be80d2a90 2024-04-25T02:08:26.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be77fe640 1 -- 172.21.15.79:0/3442939346 >> v1:172.21.15.79:6789/0 conn(0x7f8be80d2a90 legacy=0x7f8be80cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:26.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be77fe640 1 --2- 172.21.15.79:0/3442939346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd00039b0 0x7f8bd0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:26.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be77fe640 1 --2- 172.21.15.79:0/3442939346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bd0004800 0x7f8bd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:26.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be77fe640 1 --2- 172.21.15.79:0/3442939346 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8bd00051c0 0x7f8bd000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:26.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be77fe640 1 -- 172.21.15.79:0/3442939346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8be815f000 con 0x7f8bd0004800 2024-04-25T02:08:26.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be77fe640 1 -- 172.21.15.79:0/3442939346 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd000c070 con 0x7f8bd00039b0 2024-04-25T02:08:26.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be77fe640 1 -- 172.21.15.79:0/3442939346 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd000c270 con 0x7f8bd00051c0 2024-04-25T02:08:26.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8becff4640 1 --2- 172.21.15.79:0/3442939346 >> v2:172.21.15.189:3300/0 conn(0x7f8be80d26b0 0x7f8be80d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:26.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be7fff640 1 --2- 172.21.15.79:0/3442939346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bd0004800 0x7f8bd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:26.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8bed7f5640 1 --2- 172.21.15.79:0/3442939346 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8bd00051c0 0x7f8bd000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:26.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8becff4640 1 --2- 172.21.15.79:0/3442939346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd00039b0 0x7f8bd0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:26.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be7fff640 1 -- 172.21.15.79:0/3442939346 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8bd00051c0 msgr2=0x7f8bd000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:26.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be7fff640 1 --2- 172.21.15.79:0/3442939346 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8bd00051c0 0x7f8bd000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be7fff640 1 -- 172.21.15.79:0/3442939346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd00039b0 msgr2=0x7f8bd0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:26.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be7fff640 1 --2- 172.21.15.79:0/3442939346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd00039b0 0x7f8bd0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8be7fff640 1 -- 172.21.15.79:0/3442939346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd0003520 con 0x7f8bd0004800 2024-04-25T02:08:26.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.194+0000 7f8bed7f5640 1 -- 172.21.15.79:0/3442939346 reap_dead start 2024-04-25T02:08:26.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.195+0000 7f8be7fff640 1 --2- 172.21.15.79:0/3442939346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bd0004800 0x7f8bd0004c80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c210 tx=0x7f8bd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fdc01c0aa88556 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:26.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.195+0000 7f8be77fe640 1 -- 172.21.15.79:0/3442939346 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc007d30 con 0x7f8bd0004800 2024-04-25T02:08:26.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.195+0000 7f8be77fe640 1 -- 172.21.15.79:0/3442939346 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bdc005ad0 con 0x7f8bd0004800 2024-04-25T02:08:26.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.195+0000 7f8be77fe640 1 -- 172.21.15.79:0/3442939346 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc007070 con 0x7f8bd0004800 2024-04-25T02:08:26.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.196+0000 7f8bef258640 1 -- 172.21.15.79:0/3442939346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bd0004800 msgr2=0x7f8bd0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:26.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.196+0000 7f8bef258640 1 --2- 172.21.15.79:0/3442939346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bd0004800 0x7f8bd0004c80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c210 tx=0x7f8bd0005830 comp rx=0 tx=0).stop 2024-04-25T02:08:26.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.196+0000 7f8bef258640 1 -- 172.21.15.79:0/3442939346 shutdown_connections 2024-04-25T02:08:26.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.196+0000 7f8bef258640 1 --2- 172.21.15.79:0/3442939346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bd0004800 0x7f8bd0004c80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.196+0000 7f8bef258640 1 -- 172.21.15.79:0/3442939346 >> 172.21.15.79:0/3442939346 conn(0x7f8be80d40d0 msgr2=0x7f8be80d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:26.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.196+0000 7f8bef258640 1 -- 172.21.15.79:0/3442939346 shutdown_connections 2024-04-25T02:08:26.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.196+0000 7f8bef258640 1 -- 172.21.15.79:0/3442939346 wait complete. 2024-04-25T02:08:26.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.197+0000 7f8bef258640 1 Processor -- start 2024-04-25T02:08:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.197+0000 7f8bef258640 1 -- start start 2024-04-25T02:08:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.198+0000 7f8bef258640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd0004800 0x7f8be8159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.198+0000 7f8bef258640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8be81f5800 0x7f8be815b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.198+0000 7f8bef258640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be80c8260 0x7f8be80c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.198+0000 7f8bef258640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8be815f8a0 con 0x7f8be80c8260 2024-04-25T02:08:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.198+0000 7f8bef258640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8be80d0ad0 con 0x7f8bd0004800 2024-04-25T02:08:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.198+0000 7f8bef258640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8be80d2ed0 con 0x7f8be81f5800 2024-04-25T02:08:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.198+0000 7f8bed7f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be80c8260 0x7f8be80c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.198+0000 7f8bed7f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be80c8260 0x7f8be80c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59790/0 (socket says 172.21.15.79:59790) 2024-04-25T02:08:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.198+0000 7f8bed7f5640 1 -- 172.21.15.79:0/2894333185 learned_addr learned my addr 172.21.15.79:0/2894333185 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.198+0000 7f8be7fff640 1 --2- 172.21.15.79:0/2894333185 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8be81f5800 0x7f8be815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.198+0000 7f8becff4640 1 --2- 172.21.15.79:0/2894333185 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd0004800 0x7f8be8159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.199+0000 7f8bed7f5640 1 -- 172.21.15.79:0/2894333185 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8be81f5800 msgr2=0x7f8be815b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.199+0000 7f8bed7f5640 1 --2- 172.21.15.79:0/2894333185 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8be81f5800 0x7f8be815b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.199+0000 7f8bed7f5640 1 -- 172.21.15.79:0/2894333185 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd0004800 msgr2=0x7f8be8159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.199+0000 7f8bed7f5640 1 --2- 172.21.15.79:0/2894333185 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd0004800 0x7f8be8159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.199+0000 7f8bed7f5640 1 -- 172.21.15.79:0/2894333185 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be8159840 con 0x7f8be80c8260 2024-04-25T02:08:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.199+0000 7f8becff4640 1 --2- 172.21.15.79:0/2894333185 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd0004800 0x7f8be8159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.199+0000 7f8bed7f5640 1 --2- 172.21.15.79:0/2894333185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be80c8260 0x7f8be80c8b90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8be0007fd0 tx=0x7f8be000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.199+0000 7f8be57fa640 1 -- 172.21.15.79:0/2894333185 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0003970 con 0x7f8be80c8260 2024-04-25T02:08:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.199+0000 7f8be57fa640 1 -- 172.21.15.79:0/2894333185 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be0018070 con 0x7f8be80c8260 2024-04-25T02:08:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.199+0000 7f8be57fa640 1 -- 172.21.15.79:0/2894333185 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0003d70 con 0x7f8be80c8260 2024-04-25T02:08:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.199+0000 7f8bef258640 1 -- 172.21.15.79:0/2894333185 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be815a6e0 con 0x7f8be80c8260 2024-04-25T02:08:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.199+0000 7f8bef258640 1 -- 172.21.15.79:0/2894333185 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be815aca0 con 0x7f8be80c8260 2024-04-25T02:08:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.200+0000 7f8bef258640 1 -- 172.21.15.79:0/2894333185 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be80681e0 con 0x7f8be80c8260 2024-04-25T02:08:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.200+0000 7f8be57fa640 1 -- 172.21.15.79:0/2894333185 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8be00050d0 con 0x7f8be80c8260 2024-04-25T02:08:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.201+0000 7f8be57fa640 1 --2- 172.21.15.79:0/2894333185 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8bd406be60 0x7f8bd406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:26.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.201+0000 7f8be57fa640 1 -- 172.21.15.79:0/2894333185 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8be008a910 con 0x7f8be80c8260 2024-04-25T02:08:26.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.201+0000 7f8becff4640 1 --2- 172.21.15.79:0/2894333185 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8bd406be60 0x7f8bd406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:26.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.201+0000 7f8becff4640 1 --2- 172.21.15.79:0/2894333185 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8bd406be60 0x7f8bd406e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009ce0 tx=0x7f8bd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:26.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.205+0000 7f8be57fa640 1 -- 172.21.15.79:0/2894333185 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8be0059350 con 0x7f8be80c8260 2024-04-25T02:08:26.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:26.445+0000 7f8bef258640 1 -- 172.21.15.79:0/2894333185 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7f8be80b9e30 con 0x7f8be80c8260 2024-04-25T02:08:27.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.222+0000 7f8be57fa640 1 -- 172.21.15.79:0/2894333185 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v52) ==== 145+0+0 (secure 0 0 0) 0x7f8be0058c50 con 0x7f8be80c8260 2024-04-25T02:08:27.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.224+0000 7f8bef258640 1 -- 172.21.15.79:0/2894333185 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8bd406be60 msgr2=0x7f8bd406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:27.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.224+0000 7f8bef258640 1 --2- 172.21.15.79:0/2894333185 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8bd406be60 0x7f8bd406e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009ce0 tx=0x7f8bd8008040 comp rx=0 tx=0).stop 2024-04-25T02:08:27.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.224+0000 7f8bef258640 1 -- 172.21.15.79:0/2894333185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be80c8260 msgr2=0x7f8be80c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:27.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.224+0000 7f8bef258640 1 --2- 172.21.15.79:0/2894333185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be80c8260 0x7f8be80c8b90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8be0007fd0 tx=0x7f8be000eb90 comp rx=0 tx=0).stop 2024-04-25T02:08:27.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.224+0000 7f8bef258640 1 -- 172.21.15.79:0/2894333185 shutdown_connections 2024-04-25T02:08:27.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.224+0000 7f8bef258640 1 --2- 172.21.15.79:0/2894333185 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8bd406be60 0x7f8bd406e320 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.224+0000 7f8bef258640 1 --2- 172.21.15.79:0/2894333185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be80c8260 0x7f8be80c8b90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.224+0000 7f8bef258640 1 --2- 172.21.15.79:0/2894333185 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8be81f5800 0x7f8be815b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.224+0000 7f8bef258640 1 --2- 172.21.15.79:0/2894333185 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd0004800 0x7f8be8159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.224+0000 7f8bef258640 1 -- 172.21.15.79:0/2894333185 >> 172.21.15.79:0/2894333185 conn(0x7f8be80d40d0 msgr2=0x7f8be80d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:27.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.224+0000 7f8bef258640 1 -- 172.21.15.79:0/2894333185 shutdown_connections 2024-04-25T02:08:27.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.224+0000 7f8bef258640 1 -- 172.21.15.79:0/2894333185 wait complete. 2024-04-25T02:08:27.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T02:08:27.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.337+0000 7f6c17bee640 1 Processor -- start 2024-04-25T02:08:27.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.337+0000 7f6c17bee640 1 -- start start 2024-04-25T02:08:27.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.338+0000 7f6c17bee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c1015e4f0 0x7f6c100d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:27.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.338+0000 7f6c17bee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c100cf7f0 0x7f6c100d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.338+0000 7f6c17bee640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c100d1ee0 con 0x7f6c100cfc50 2024-04-25T02:08:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.338+0000 7f6c17bee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6c100d21c0 con 0x7f6c100cf7f0 2024-04-25T02:08:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.338+0000 7f6c17bee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6c100d24a0 con 0x7f6c1015e4f0 2024-04-25T02:08:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.338+0000 7f6c15189640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c100cf7f0 0x7f6c100d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.338+0000 7f6c15189640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c100cf7f0 0x7f6c100d09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59792/0 (socket says 172.21.15.79:59792) 2024-04-25T02:08:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.338+0000 7f6c15189640 1 -- 172.21.15.79:0/2350033269 learned_addr learned my addr 172.21.15.79:0/2350033269 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.339+0000 7f6c15189640 1 -- 172.21.15.79:0/2350033269 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c1015e4f0 msgr2=0x7f6c100d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.339+0000 7f6c1598a640 1 --2- 172.21.15.79:0/2350033269 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c1015e4f0 0x7f6c100d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.339+0000 7f6c15189640 1 --2- 172.21.15.79:0/2350033269 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c1015e4f0 0x7f6c100d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.339+0000 7f6c15189640 1 -- 172.21.15.79:0/2350033269 >> v1:172.21.15.189:6789/0 conn(0x7f6c100cfc50 legacy=0x7f6c1006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.339+0000 7f6c15189640 1 -- 172.21.15.79:0/2350033269 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c100d2780 con 0x7f6c100cf7f0 2024-04-25T02:08:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.339+0000 7f6c1598a640 1 --2- 172.21.15.79:0/2350033269 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c1015e4f0 0x7f6c100d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.339+0000 7f6c15189640 1 --2- 172.21.15.79:0/2350033269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c100cf7f0 0x7f6c100d09b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6c000098a0 tx=0x7f6c0002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b5f2aecfcac81a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:27.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.339+0000 7f6c14988640 1 -- 172.21.15.79:0/2350033269 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c00037070 con 0x7f6c100cf7f0 2024-04-25T02:08:27.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.340+0000 7f6c14988640 1 -- 172.21.15.79:0/2350033269 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c00032440 con 0x7f6c100cf7f0 2024-04-25T02:08:27.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.340+0000 7f6c14988640 1 -- 172.21.15.79:0/2350033269 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c00032810 con 0x7f6c100cf7f0 2024-04-25T02:08:27.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.340+0000 7f6c17bee640 1 -- 172.21.15.79:0/2350033269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c100cf7f0 msgr2=0x7f6c100d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:27.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.340+0000 7f6c17bee640 1 --2- 172.21.15.79:0/2350033269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c100cf7f0 0x7f6c100d09b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6c000098a0 tx=0x7f6c0002a250 comp rx=0 tx=0).stop 2024-04-25T02:08:27.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.340+0000 7f6c17bee640 1 -- 172.21.15.79:0/2350033269 shutdown_connections 2024-04-25T02:08:27.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.340+0000 7f6c17bee640 1 --2- 172.21.15.79:0/2350033269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c100cf7f0 0x7f6c100d09b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.340+0000 7f6c17bee640 1 --2- 172.21.15.79:0/2350033269 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c1015e4f0 0x7f6c100d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.340+0000 7f6c17bee640 1 -- 172.21.15.79:0/2350033269 >> 172.21.15.79:0/2350033269 conn(0x7f6c1009d4a0 msgr2=0x7f6c100d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:27.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.340+0000 7f6c17bee640 1 -- 172.21.15.79:0/2350033269 shutdown_connections 2024-04-25T02:08:27.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.340+0000 7f6c17bee640 1 -- 172.21.15.79:0/2350033269 wait complete. 2024-04-25T02:08:27.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.341+0000 7f6c17bee640 1 Processor -- start 2024-04-25T02:08:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.341+0000 7f6c17bee640 1 -- start start 2024-04-25T02:08:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.342+0000 7f6c17bee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c100cf7f0 0x7f6c100b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.342+0000 7f6c17bee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c100cfc50 0x7f6c100cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.342+0000 7f6c17bee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c1015e4f0 0x7f6c100b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.342+0000 7f6c17bee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c100d0ef0 con 0x7f6c1015e4f0 2024-04-25T02:08:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.342+0000 7f6c17bee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c100d50f0 con 0x7f6c100cfc50 2024-04-25T02:08:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.342+0000 7f6c17bee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6c100d1070 con 0x7f6c100cf7f0 2024-04-25T02:08:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.342+0000 7f6c1618b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c1015e4f0 0x7f6c100b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.342+0000 7f6c1618b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c1015e4f0 0x7f6c100b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59794/0 (socket says 172.21.15.79:59794) 2024-04-25T02:08:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.342+0000 7f6c1618b640 1 -- 172.21.15.79:0/3942219430 learned_addr learned my addr 172.21.15.79:0/3942219430 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.342+0000 7f6c1618b640 1 -- 172.21.15.79:0/3942219430 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c100cf7f0 msgr2=0x7f6c100b77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.342+0000 7f6c1618b640 1 --2- 172.21.15.79:0/3942219430 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c100cf7f0 0x7f6c100b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.342+0000 7f6c1618b640 1 -- 172.21.15.79:0/3942219430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c100cfc50 msgr2=0x7f6c100cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.342+0000 7f6c1618b640 1 --2- 172.21.15.79:0/3942219430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c100cfc50 0x7f6c100cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.342+0000 7f6c1618b640 1 -- 172.21.15.79:0/3942219430 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c100b7ce0 con 0x7f6c1015e4f0 2024-04-25T02:08:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.342+0000 7f6c1618b640 1 --2- 172.21.15.79:0/3942219430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c1015e4f0 0x7f6c100b4b20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00c440 tx=0x7f6c0c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.343+0000 7f6c067fc640 1 -- 172.21.15.79:0/3942219430 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c011790 con 0x7f6c1015e4f0 2024-04-25T02:08:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.343+0000 7f6c067fc640 1 -- 172.21.15.79:0/3942219430 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0c017070 con 0x7f6c1015e4f0 2024-04-25T02:08:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.343+0000 7f6c17bee640 1 -- 172.21.15.79:0/3942219430 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c100b8910 con 0x7f6c1015e4f0 2024-04-25T02:08:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.343+0000 7f6c067fc640 1 -- 172.21.15.79:0/3942219430 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c011b70 con 0x7f6c1015e4f0 2024-04-25T02:08:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.343+0000 7f6c17bee640 1 -- 172.21.15.79:0/3942219430 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c100b8ed0 con 0x7f6c1015e4f0 2024-04-25T02:08:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.344+0000 7f6c17bee640 1 -- 172.21.15.79:0/3942219430 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c100686c0 con 0x7f6c1015e4f0 2024-04-25T02:08:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.344+0000 7f6c067fc640 1 -- 172.21.15.79:0/3942219430 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c0c011d10 con 0x7f6c1015e4f0 2024-04-25T02:08:27.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.344+0000 7f6c067fc640 1 --2- 172.21.15.79:0/3942219430 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bf406be30 0x7f6bf406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:27.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.345+0000 7f6c067fc640 1 -- 172.21.15.79:0/3942219430 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6c0c08ac20 con 0x7f6c1015e4f0 2024-04-25T02:08:27.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.345+0000 7f6c1598a640 1 --2- 172.21.15.79:0/3942219430 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bf406be30 0x7f6bf406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:27.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.345+0000 7f6c1598a640 1 --2- 172.21.15.79:0/3942219430 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bf406be30 0x7f6bf406e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6c08008e00 tx=0x7f6c08008330 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.349+0000 7f6c067fc640 1 -- 172.21.15.79:0/3942219430 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6c100b7ce0 con 0x7f6c1015e4f0 2024-04-25T02:08:27.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.520+0000 7f6c17bee640 1 -- 172.21.15.79:0/3942219430 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6c100690a0 con 0x7f6c1015e4f0 2024-04-25T02:08:27.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.524+0000 7f6c067fc640 1 -- 172.21.15.79:0/3942219430 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f6c0c059660 con 0x7f6c1015e4f0 2024-04-25T02:08:27.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.526+0000 7f6c17bee640 1 -- 172.21.15.79:0/3942219430 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bf406be30 msgr2=0x7f6bf406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:27.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.526+0000 7f6c17bee640 1 --2- 172.21.15.79:0/3942219430 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bf406be30 0x7f6bf406e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6c08008e00 tx=0x7f6c08008330 comp rx=0 tx=0).stop 2024-04-25T02:08:27.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.526+0000 7f6c17bee640 1 -- 172.21.15.79:0/3942219430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c1015e4f0 msgr2=0x7f6c100b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:27.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.526+0000 7f6c17bee640 1 --2- 172.21.15.79:0/3942219430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c1015e4f0 0x7f6c100b4b20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00c440 tx=0x7f6c0c00c900 comp rx=0 tx=0).stop 2024-04-25T02:08:27.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.526+0000 7f6c17bee640 1 -- 172.21.15.79:0/3942219430 shutdown_connections 2024-04-25T02:08:27.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.526+0000 7f6c17bee640 1 --2- 172.21.15.79:0/3942219430 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bf406be30 0x7f6bf406e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.526+0000 7f6c17bee640 1 --2- 172.21.15.79:0/3942219430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c1015e4f0 0x7f6c100b4b20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.526+0000 7f6c17bee640 1 --2- 172.21.15.79:0/3942219430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c100cfc50 0x7f6c100cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.526+0000 7f6c17bee640 1 --2- 172.21.15.79:0/3942219430 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c100cf7f0 0x7f6c100b77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.526+0000 7f6c17bee640 1 -- 172.21.15.79:0/3942219430 >> 172.21.15.79:0/3942219430 conn(0x7f6c1009d4a0 msgr2=0x7f6c1006d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:27.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.526+0000 7f6c17bee640 1 -- 172.21.15.79:0/3942219430 shutdown_connections 2024-04-25T02:08:27.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.526+0000 7f6c17bee640 1 -- 172.21.15.79:0/3942219430 wait complete. 2024-04-25T02:08:27.544 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:08:27.544 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:08:27.576 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:08:27.619 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:08:27.619 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:08:27.620 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:27.635 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:08:27.635 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:27.691 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:08:27.691 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:27.745 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:27.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.874+0000 7f9f69742640 1 Processor -- start 2024-04-25T02:08:27.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.874+0000 7f9f69742640 1 -- start start 2024-04-25T02:08:27.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.875+0000 7f9f69742640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9f640b3570 0x7f9f640d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:27.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.875+0000 7f9f69742640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9f640b3020 0x7f9f640d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:27.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.875+0000 7f9f69742640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6406c380 con 0x7f9f6415e4d0 2024-04-25T02:08:27.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.875+0000 7f9f69742640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9f640d1660 con 0x7f9f640b3020 2024-04-25T02:08:27.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.875+0000 7f9f69742640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f9f640d1380 con 0x7f9f640b3570 2024-04-25T02:08:27.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.875+0000 7f9f637fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9f640b3020 0x7f9f640d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:27.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.875+0000 7f9f637fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9f640b3020 0x7f9f640d2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59802/0 (socket says 172.21.15.79:59802) 2024-04-25T02:08:27.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.875+0000 7f9f637fe640 1 -- 172.21.15.79:0/3235983120 learned_addr learned my addr 172.21.15.79:0/3235983120 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:27.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.875+0000 7f9f627fc640 1 --2- 172.21.15.79:0/3235983120 >> v2:172.21.15.189:3300/0 conn(0x7f9f640b3570 0x7f9f640d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:27.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.875+0000 7f9f637fe640 1 -- 172.21.15.79:0/3235983120 >> v2:172.21.15.189:3300/0 conn(0x7f9f640b3570 msgr2=0x7f9f640d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.875+0000 7f9f637fe640 1 --2- 172.21.15.79:0/3235983120 >> v2:172.21.15.189:3300/0 conn(0x7f9f640b3570 0x7f9f640d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.875+0000 7f9f637fe640 1 -- 172.21.15.79:0/3235983120 >> v1:172.21.15.189:6789/0 conn(0x7f9f6415e4d0 legacy=0x7f9f6406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.875+0000 7f9f637fe640 1 -- 172.21.15.79:0/3235983120 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f640cede0 con 0x7f9f640b3020 2024-04-25T02:08:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.876+0000 7f9f637fe640 1 --2- 172.21.15.79:0/3235983120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f640b3020 0x7f9f640d2c50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009870 tx=0x7f9f5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143953bbae6b7d18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.876+0000 7f9f61ffb640 1 -- 172.21.15.79:0/3235983120 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54037070 con 0x7f9f640b3020 2024-04-25T02:08:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.876+0000 7f9f61ffb640 1 -- 172.21.15.79:0/3235983120 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f54032440 con 0x7f9f640b3020 2024-04-25T02:08:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.876+0000 7f9f61ffb640 1 -- 172.21.15.79:0/3235983120 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54032810 con 0x7f9f640b3020 2024-04-25T02:08:27.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.876+0000 7f9f69742640 1 -- 172.21.15.79:0/3235983120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f640b3020 msgr2=0x7f9f640d2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:27.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.877+0000 7f9f69742640 1 --2- 172.21.15.79:0/3235983120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f640b3020 0x7f9f640d2c50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009870 tx=0x7f9f5402a270 comp rx=0 tx=0).stop 2024-04-25T02:08:27.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.877+0000 7f9f69742640 1 -- 172.21.15.79:0/3235983120 shutdown_connections 2024-04-25T02:08:27.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.877+0000 7f9f69742640 1 --2- 172.21.15.79:0/3235983120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f640b3020 0x7f9f640d2c50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.877+0000 7f9f69742640 1 --2- 172.21.15.79:0/3235983120 >> v2:172.21.15.189:3300/0 conn(0x7f9f640b3570 0x7f9f640d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.877+0000 7f9f69742640 1 -- 172.21.15.79:0/3235983120 >> 172.21.15.79:0/3235983120 conn(0x7f9f6409d460 msgr2=0x7f9f640d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:27.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.877+0000 7f9f69742640 1 -- 172.21.15.79:0/3235983120 shutdown_connections 2024-04-25T02:08:27.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.877+0000 7f9f69742640 1 -- 172.21.15.79:0/3235983120 wait complete. 2024-04-25T02:08:27.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.878+0000 7f9f69742640 1 Processor -- start 2024-04-25T02:08:27.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.878+0000 7f9f69742640 1 -- start start 2024-04-25T02:08:27.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f69742640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f640b3020 0x7f9f641f8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:27.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f69742640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f640b3570 0x7f9f641f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:27.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f69742640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9f6415e4d0 0x7f9f6415b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:27.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f69742640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9f640d20d0 con 0x7f9f640b3020 2024-04-25T02:08:27.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f69742640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6415e8b0 con 0x7f9f640b3570 2024-04-25T02:08:27.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f69742640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9f640d2250 con 0x7f9f6415e4d0 2024-04-25T02:08:27.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f62ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f640b3020 0x7f9f641f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:27.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f62ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f640b3020 0x7f9f641f8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59804/0 (socket says 172.21.15.79:59804) 2024-04-25T02:08:27.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f62ffd640 1 -- 172.21.15.79:0/2110692066 learned_addr learned my addr 172.21.15.79:0/2110692066 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:27.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f627fc640 1 --2- 172.21.15.79:0/2110692066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f640b3570 0x7f9f641f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:27.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f637fe640 1 --2- 172.21.15.79:0/2110692066 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9f6415e4d0 0x7f9f6415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:27.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f62ffd640 1 -- 172.21.15.79:0/2110692066 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9f6415e4d0 msgr2=0x7f9f6415b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:27.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f62ffd640 1 --2- 172.21.15.79:0/2110692066 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9f6415e4d0 0x7f9f6415b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f62ffd640 1 -- 172.21.15.79:0/2110692066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f640b3570 msgr2=0x7f9f641f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:27.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f62ffd640 1 --2- 172.21.15.79:0/2110692066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f640b3570 0x7f9f641f3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:27.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f62ffd640 1 -- 172.21.15.79:0/2110692066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f641f8840 con 0x7f9f640b3020 2024-04-25T02:08:27.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f627fc640 1 --2- 172.21.15.79:0/2110692066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f640b3570 0x7f9f641f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:27.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f62ffd640 1 --2- 172.21.15.79:0/2110692066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f640b3020 0x7f9f641f8300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c00ba50 tx=0x7f9f5c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:27.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f5b7fe640 1 -- 172.21.15.79:0/2110692066 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c019070 con 0x7f9f640b3020 2024-04-25T02:08:27.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f5b7fe640 1 -- 172.21.15.79:0/2110692066 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f5c00cc20 con 0x7f9f640b3020 2024-04-25T02:08:27.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f69742640 1 -- 172.21.15.79:0/2110692066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f641f4190 con 0x7f9f640b3020 2024-04-25T02:08:27.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f5b7fe640 1 -- 172.21.15.79:0/2110692066 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c014680 con 0x7f9f640b3020 2024-04-25T02:08:27.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.879+0000 7f9f69742640 1 -- 172.21.15.79:0/2110692066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f64158910 con 0x7f9f640b3020 2024-04-25T02:08:27.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.880+0000 7f9f69742640 1 -- 172.21.15.79:0/2110692066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f640690a0 con 0x7f9f640b3020 2024-04-25T02:08:27.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.881+0000 7f9f5b7fe640 1 -- 172.21.15.79:0/2110692066 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f5c01c070 con 0x7f9f640b3020 2024-04-25T02:08:27.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.881+0000 7f9f5b7fe640 1 --2- 172.21.15.79:0/2110692066 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9f4406be30 0x7f9f4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:27.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.881+0000 7f9f5b7fe640 1 -- 172.21.15.79:0/2110692066 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9f5c08aae0 con 0x7f9f640b3020 2024-04-25T02:08:27.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.881+0000 7f9f627fc640 1 --2- 172.21.15.79:0/2110692066 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9f4406be30 0x7f9f4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:27.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.881+0000 7f9f627fc640 1 --2- 172.21.15.79:0/2110692066 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9f4406be30 0x7f9f4406e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9f6415bfd0 tx=0x7f9f4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:27.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:27.885+0000 7f9f5b7fe640 1 -- 172.21.15.79:0/2110692066 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9f641f8840 con 0x7f9f640b3020 2024-04-25T02:08:28.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.059+0000 7f9f69742640 1 -- 172.21.15.79:0/2110692066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f6406bd80 con 0x7f9f640b3020 2024-04-25T02:08:28.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.060+0000 7f9f5b7fe640 1 -- 172.21.15.79:0/2110692066 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f9f5c058e40 con 0x7f9f640b3020 2024-04-25T02:08:28.067 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:28.067 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:28.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.061+0000 7f9f69742640 1 -- 172.21.15.79:0/2110692066 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9f4406be30 msgr2=0x7f9f4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.061+0000 7f9f69742640 1 --2- 172.21.15.79:0/2110692066 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9f4406be30 0x7f9f4406e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9f6415bfd0 tx=0x7f9f4c008040 comp rx=0 tx=0).stop 2024-04-25T02:08:28.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.061+0000 7f9f69742640 1 -- 172.21.15.79:0/2110692066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f640b3020 msgr2=0x7f9f641f8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.061+0000 7f9f69742640 1 --2- 172.21.15.79:0/2110692066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f640b3020 0x7f9f641f8300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c00ba50 tx=0x7f9f5c00bf10 comp rx=0 tx=0).stop 2024-04-25T02:08:28.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.061+0000 7f9f69742640 1 -- 172.21.15.79:0/2110692066 shutdown_connections 2024-04-25T02:08:28.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.062+0000 7f9f69742640 1 --2- 172.21.15.79:0/2110692066 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9f4406be30 0x7f9f4406e2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.062+0000 7f9f69742640 1 --2- 172.21.15.79:0/2110692066 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9f6415e4d0 0x7f9f6415b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.062+0000 7f9f69742640 1 --2- 172.21.15.79:0/2110692066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f640b3570 0x7f9f641f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.062+0000 7f9f69742640 1 --2- 172.21.15.79:0/2110692066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f640b3020 0x7f9f641f8300 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.062+0000 7f9f69742640 1 -- 172.21.15.79:0/2110692066 >> 172.21.15.79:0/2110692066 conn(0x7f9f6409d460 msgr2=0x7f9f640b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:28.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.062+0000 7f9f69742640 1 -- 172.21.15.79:0/2110692066 shutdown_connections 2024-04-25T02:08:28.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.062+0000 7f9f69742640 1 -- 172.21.15.79:0/2110692066 wait complete. 2024-04-25T02:08:28.080 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:57.115253+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:58.421392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:08:28.080 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:08:28.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.173+0000 7f529ae37640 1 Processor -- start 2024-04-25T02:08:28.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.173+0000 7f529ae37640 1 -- start start 2024-04-25T02:08:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.174+0000 7f529ae37640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f529415a810 0x7f52940cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.174+0000 7f529ae37640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f529409dcb0 0x7f5294070d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.174+0000 7f529ae37640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f529415abf0 con 0x7f52940ccd60 2024-04-25T02:08:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.174+0000 7f529ae37640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5294073050 con 0x7f529415a810 2024-04-25T02:08:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.174+0000 7f529ae37640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f52940cbdd0 con 0x7f529409dcb0 2024-04-25T02:08:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.174+0000 7f5298bd3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f529415a810 0x7f52940cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.174+0000 7f52993d4640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f52940ccd60 0x7f52940b42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58518/0 (socket says 172.21.15.79:58518) 2024-04-25T02:08:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.174+0000 7f52993d4640 1 -- 172.21.15.79:0/3825767557 learned_addr learned my addr 172.21.15.79:0/3825767557 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.174+0000 7f5298bd3640 1 -- 172.21.15.79:0/3825767557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f529409dcb0 msgr2=0x7f5294070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.174+0000 7f5298bd3640 1 --2- 172.21.15.79:0/3825767557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f529409dcb0 0x7f5294070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.175+0000 7f5298bd3640 1 -- 172.21.15.79:0/3825767557 >> v1:172.21.15.79:6789/0 conn(0x7f52940ccd60 legacy=0x7f52940b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.175+0000 7f5298bd3640 1 -- 172.21.15.79:0/3825767557 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52940ce580 con 0x7f529415a810 2024-04-25T02:08:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.175+0000 7f52937fe640 1 -- 172.21.15.79:0/3825767557 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3097758968 0 0) 0x7f529415abf0 con 0x7f52940ccd60 2024-04-25T02:08:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.175+0000 7f5298bd3640 1 --2- 172.21.15.79:0/3825767557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529415a810 0x7f52940cc820 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f52840097a0 tx=0x7f528402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd58d43c706bd0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.175+0000 7f52937fe640 1 -- 172.21.15.79:0/3825767557 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284037070 con 0x7f529415a810 2024-04-25T02:08:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.175+0000 7f52937fe640 1 -- 172.21.15.79:0/3825767557 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528402ae50 con 0x7f529415a810 2024-04-25T02:08:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.175+0000 7f52937fe640 1 -- 172.21.15.79:0/3825767557 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284032660 con 0x7f529415a810 2024-04-25T02:08:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.176+0000 7f529ae37640 1 -- 172.21.15.79:0/3825767557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529415a810 msgr2=0x7f52940cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.176+0000 7f529ae37640 1 --2- 172.21.15.79:0/3825767557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529415a810 0x7f52940cc820 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f52840097a0 tx=0x7f528402a100 comp rx=0 tx=0).stop 2024-04-25T02:08:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.176+0000 7f529ae37640 1 -- 172.21.15.79:0/3825767557 shutdown_connections 2024-04-25T02:08:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.176+0000 7f529ae37640 1 --2- 172.21.15.79:0/3825767557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f529409dcb0 0x7f5294070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.176+0000 7f529ae37640 1 --2- 172.21.15.79:0/3825767557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529415a810 0x7f52940cc820 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.176+0000 7f529ae37640 1 -- 172.21.15.79:0/3825767557 >> 172.21.15.79:0/3825767557 conn(0x7f52940b1cd0 msgr2=0x7f52940b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.176+0000 7f529ae37640 1 -- 172.21.15.79:0/3825767557 shutdown_connections 2024-04-25T02:08:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.176+0000 7f529ae37640 1 -- 172.21.15.79:0/3825767557 wait complete. 2024-04-25T02:08:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.177+0000 7f529ae37640 1 Processor -- start 2024-04-25T02:08:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.177+0000 7f529ae37640 1 -- start start 2024-04-25T02:08:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f529ae37640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529409dcb0 0x7f529414db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f529ae37640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52940ccd60 0x7f529415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f529ae37640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f529415a810 0x7f529415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f529ae37640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f52940cc020 con 0x7f529409dcb0 2024-04-25T02:08:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f529ae37640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f52940ceb40 con 0x7f52940ccd60 2024-04-25T02:08:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f529ae37640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f52940cc300 con 0x7f529415a810 2024-04-25T02:08:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f5298bd3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529409dcb0 0x7f529414db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f5298bd3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529409dcb0 0x7f529414db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59832/0 (socket says 172.21.15.79:59832) 2024-04-25T02:08:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f5298bd3640 1 -- 172.21.15.79:0/4139073719 learned_addr learned my addr 172.21.15.79:0/4139073719 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f52993d4640 1 --2- 172.21.15.79:0/4139073719 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f529415a810 0x7f529415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f5293fff640 1 --2- 172.21.15.79:0/4139073719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52940ccd60 0x7f529415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f5298bd3640 1 -- 172.21.15.79:0/4139073719 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f529415a810 msgr2=0x7f529415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f5298bd3640 1 --2- 172.21.15.79:0/4139073719 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f529415a810 0x7f529415d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f5298bd3640 1 -- 172.21.15.79:0/4139073719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52940ccd60 msgr2=0x7f529415cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f5298bd3640 1 --2- 172.21.15.79:0/4139073719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52940ccd60 0x7f529415cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.178+0000 7f5298bd3640 1 -- 172.21.15.79:0/4139073719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529415dc20 con 0x7f529409dcb0 2024-04-25T02:08:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.179+0000 7f5298bd3640 1 --2- 172.21.15.79:0/4139073719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529409dcb0 0x7f529414db80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f52840097a0 tx=0x7f52840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.179+0000 7f52917fa640 1 -- 172.21.15.79:0/4139073719 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284042070 con 0x7f529409dcb0 2024-04-25T02:08:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.179+0000 7f52917fa640 1 -- 172.21.15.79:0/4139073719 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528403e670 con 0x7f529409dcb0 2024-04-25T02:08:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.179+0000 7f529ae37640 1 -- 172.21.15.79:0/4139073719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f529415d940 con 0x7f529409dcb0 2024-04-25T02:08:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.179+0000 7f52917fa640 1 -- 172.21.15.79:0/4139073719 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284037040 con 0x7f529409dcb0 2024-04-25T02:08:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.179+0000 7f529ae37640 1 -- 172.21.15.79:0/4139073719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f529414d380 con 0x7f529409dcb0 2024-04-25T02:08:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.180+0000 7f529ae37640 1 -- 172.21.15.79:0/4139073719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52940690a0 con 0x7f529409dcb0 2024-04-25T02:08:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.180+0000 7f52917fa640 1 -- 172.21.15.79:0/4139073719 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5284045070 con 0x7f529409dcb0 2024-04-25T02:08:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.181+0000 7f52917fa640 1 --2- 172.21.15.79:0/4139073719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f528006be30 0x7f528006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.181+0000 7f52917fa640 1 -- 172.21.15.79:0/4139073719 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f52840ab6c0 con 0x7f529409dcb0 2024-04-25T02:08:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.181+0000 7f5293fff640 1 --2- 172.21.15.79:0/4139073719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f528006be30 0x7f528006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.181+0000 7f5293fff640 1 --2- 172.21.15.79:0/4139073719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f528006be30 0x7f528006e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f529414e650 tx=0x7f5288008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.185+0000 7f52917fa640 1 -- 172.21.15.79:0/4139073719 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f528407a220 con 0x7f529409dcb0 2024-04-25T02:08:28.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.359+0000 7f529ae37640 1 -- 172.21.15.79:0/4139073719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f529406e1b0 con 0x7f529409dcb0 2024-04-25T02:08:28.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.360+0000 7f52917fa640 1 -- 172.21.15.79:0/4139073719 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f5284079b20 con 0x7f529409dcb0 2024-04-25T02:08:28.367 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:08:28.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.361+0000 7f529ae37640 1 -- 172.21.15.79:0/4139073719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f528006be30 msgr2=0x7f528006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.362+0000 7f529ae37640 1 --2- 172.21.15.79:0/4139073719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f528006be30 0x7f528006e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f529414e650 tx=0x7f5288008040 comp rx=0 tx=0).stop 2024-04-25T02:08:28.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.362+0000 7f529ae37640 1 -- 172.21.15.79:0/4139073719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529409dcb0 msgr2=0x7f529414db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.362+0000 7f529ae37640 1 --2- 172.21.15.79:0/4139073719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529409dcb0 0x7f529414db80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f52840097a0 tx=0x7f52840046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.362+0000 7f529ae37640 1 -- 172.21.15.79:0/4139073719 shutdown_connections 2024-04-25T02:08:28.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.362+0000 7f529ae37640 1 --2- 172.21.15.79:0/4139073719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f528006be30 0x7f528006e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.362+0000 7f529ae37640 1 --2- 172.21.15.79:0/4139073719 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f529415a810 0x7f529415d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.362+0000 7f529ae37640 1 --2- 172.21.15.79:0/4139073719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52940ccd60 0x7f529415cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.362+0000 7f529ae37640 1 --2- 172.21.15.79:0/4139073719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529409dcb0 0x7f529414db80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.362+0000 7f529ae37640 1 -- 172.21.15.79:0/4139073719 >> 172.21.15.79:0/4139073719 conn(0x7f52940b1cd0 msgr2=0x7f52941506f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:28.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.362+0000 7f529ae37640 1 -- 172.21.15.79:0/4139073719 shutdown_connections 2024-04-25T02:08:28.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.362+0000 7f529ae37640 1 -- 172.21.15.79:0/4139073719 wait complete. 2024-04-25T02:08:28.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:08:28.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.473+0000 7f361d9a9640 1 Processor -- start 2024-04-25T02:08:28.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.473+0000 7f361d9a9640 1 -- start start 2024-04-25T02:08:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.474+0000 7f361d9a9640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f36180d2ca0 0x7f36180d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.474+0000 7f361d9a9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f36180d0ef0 0x7f361806bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.474+0000 7f361d9a9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36180d1ee0 con 0x7f361815e4f0 2024-04-25T02:08:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.474+0000 7f361d9a9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f36180d3130 con 0x7f36180d0ef0 2024-04-25T02:08:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.474+0000 7f361d9a9640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f36180d21c0 con 0x7f36180d2ca0 2024-04-25T02:08:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.474+0000 7f36177fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f36180d0ef0 0x7f361806bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.474+0000 7f36177fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f36180d0ef0 0x7f361806bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59840/0 (socket says 172.21.15.79:59840) 2024-04-25T02:08:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.474+0000 7f36177fe640 1 -- 172.21.15.79:0/52251927 learned_addr learned my addr 172.21.15.79:0/52251927 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.474+0000 7f360ffff640 1 --2- 172.21.15.79:0/52251927 >> v2:172.21.15.189:3300/0 conn(0x7f36180d2ca0 0x7f36180d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.474+0000 7f36177fe640 1 -- 172.21.15.79:0/52251927 >> v2:172.21.15.189:3300/0 conn(0x7f36180d2ca0 msgr2=0x7f36180d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.474+0000 7f36177fe640 1 --2- 172.21.15.79:0/52251927 >> v2:172.21.15.189:3300/0 conn(0x7f36180d2ca0 0x7f36180d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.474+0000 7f36177fe640 1 -- 172.21.15.79:0/52251927 >> v1:172.21.15.79:6789/0 conn(0x7f361815e4f0 legacy=0x7f36180cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.474+0000 7f36167fc640 1 -- 172.21.15.79:0/52251927 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534903242 0 0) 0x7f36180d1ee0 con 0x7f361815e4f0 2024-04-25T02:08:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.474+0000 7f36177fe640 1 -- 172.21.15.79:0/52251927 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36180d24a0 con 0x7f36180d0ef0 2024-04-25T02:08:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.474+0000 7f360ffff640 1 --2- 172.21.15.79:0/52251927 >> v2:172.21.15.189:3300/0 conn(0x7f36180d2ca0 0x7f36180d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.475+0000 7f36177fe640 1 --2- 172.21.15.79:0/52251927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d0ef0 0x7f361806bc30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3610009e50 tx=0x7f361002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6401a658409acc43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.475+0000 7f36167fc640 1 -- 172.21.15.79:0/52251927 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3610036070 con 0x7f36180d0ef0 2024-04-25T02:08:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.475+0000 7f36167fc640 1 -- 172.21.15.79:0/52251927 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3610031600 con 0x7f36180d0ef0 2024-04-25T02:08:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.475+0000 7f36167fc640 1 -- 172.21.15.79:0/52251927 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36100319d0 con 0x7f36180d0ef0 2024-04-25T02:08:28.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.475+0000 7f361d9a9640 1 -- 172.21.15.79:0/52251927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d0ef0 msgr2=0x7f361806bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.476+0000 7f361d9a9640 1 --2- 172.21.15.79:0/52251927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d0ef0 0x7f361806bc30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3610009e50 tx=0x7f361002a760 comp rx=0 tx=0).stop 2024-04-25T02:08:28.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.476+0000 7f361d9a9640 1 -- 172.21.15.79:0/52251927 shutdown_connections 2024-04-25T02:08:28.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.476+0000 7f361d9a9640 1 --2- 172.21.15.79:0/52251927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d0ef0 0x7f361806bc30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.476+0000 7f361d9a9640 1 --2- 172.21.15.79:0/52251927 >> v2:172.21.15.189:3300/0 conn(0x7f36180d2ca0 0x7f36180d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.476+0000 7f361d9a9640 1 -- 172.21.15.79:0/52251927 >> 172.21.15.79:0/52251927 conn(0x7f361809d4a0 msgr2=0x7f36180d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.476+0000 7f361d9a9640 1 -- 172.21.15.79:0/52251927 shutdown_connections 2024-04-25T02:08:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.476+0000 7f361d9a9640 1 -- 172.21.15.79:0/52251927 wait complete. 2024-04-25T02:08:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.477+0000 7f361d9a9640 1 Processor -- start 2024-04-25T02:08:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.477+0000 7f361d9a9640 1 -- start start 2024-04-25T02:08:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.477+0000 7f361d9a9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36180d0ef0 0x7f361815c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.477+0000 7f361d9a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d2ca0 0x7f36180b91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.477+0000 7f361d9a9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f361815e4f0 0x7f36180b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.477+0000 7f361d9a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f36180d4ee0 con 0x7f36180d2ca0 2024-04-25T02:08:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.477+0000 7f361d9a9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f36180cff00 con 0x7f361815e4f0 2024-04-25T02:08:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.477+0000 7f361d9a9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f36180d5060 con 0x7f36180d0ef0 2024-04-25T02:08:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f360ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d2ca0 0x7f36180b91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f360ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d2ca0 0x7f36180b91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59842/0 (socket says 172.21.15.79:59842) 2024-04-25T02:08:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f360ffff640 1 -- 172.21.15.79:0/145774792 learned_addr learned my addr 172.21.15.79:0/145774792 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f36177fe640 1 --2- 172.21.15.79:0/145774792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f361815e4f0 0x7f36180b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f3616ffd640 1 --2- 172.21.15.79:0/145774792 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36180d0ef0 0x7f361815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f360ffff640 1 -- 172.21.15.79:0/145774792 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36180d0ef0 msgr2=0x7f361815c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f360ffff640 1 --2- 172.21.15.79:0/145774792 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36180d0ef0 0x7f361815c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f360ffff640 1 -- 172.21.15.79:0/145774792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f361815e4f0 msgr2=0x7f36180b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f360ffff640 1 --2- 172.21.15.79:0/145774792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f361815e4f0 0x7f36180b96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f360ffff640 1 -- 172.21.15.79:0/145774792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36180a1d40 con 0x7f36180d2ca0 2024-04-25T02:08:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f36177fe640 1 --2- 172.21.15.79:0/145774792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f361815e4f0 0x7f36180b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f360ffff640 1 --2- 172.21.15.79:0/145774792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d2ca0 0x7f36180b91a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f360000c7f0 tx=0x7f360000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f3614ff9640 1 -- 172.21.15.79:0/145774792 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600015070 con 0x7f36180d2ca0 2024-04-25T02:08:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f3614ff9640 1 -- 172.21.15.79:0/145774792 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3600007a30 con 0x7f36180d2ca0 2024-04-25T02:08:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f361d9a9640 1 -- 172.21.15.79:0/145774792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36181f4f00 con 0x7f36180d2ca0 2024-04-25T02:08:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f3614ff9640 1 -- 172.21.15.79:0/145774792 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600007e00 con 0x7f36180d2ca0 2024-04-25T02:08:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.478+0000 7f361d9a9640 1 -- 172.21.15.79:0/145774792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36180cb650 con 0x7f36180d2ca0 2024-04-25T02:08:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.479+0000 7f361d9a9640 1 -- 172.21.15.79:0/145774792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36180686c0 con 0x7f36180d2ca0 2024-04-25T02:08:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.480+0000 7f3614ff9640 1 -- 172.21.15.79:0/145774792 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3600018070 con 0x7f36180d2ca0 2024-04-25T02:08:28.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.480+0000 7f3614ff9640 1 --2- 172.21.15.79:0/145774792 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f35f806be60 0x7f35f806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.480+0000 7f3614ff9640 1 -- 172.21.15.79:0/145774792 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f360008ad20 con 0x7f36180d2ca0 2024-04-25T02:08:28.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.480+0000 7f3616ffd640 1 --2- 172.21.15.79:0/145774792 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f35f806be60 0x7f35f806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.481+0000 7f3616ffd640 1 --2- 172.21.15.79:0/145774792 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f35f806be60 0x7f35f806e320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3608000f60 tx=0x7f3608009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:28.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.485+0000 7f3614ff9640 1 -- 172.21.15.79:0/145774792 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3600059760 con 0x7f36180d2ca0 2024-04-25T02:08:28.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.656+0000 7f361d9a9640 1 -- 172.21.15.79:0/145774792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f36180690a0 con 0x7f36180d2ca0 2024-04-25T02:08:28.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.656+0000 7f3614ff9640 1 -- 172.21.15.79:0/145774792 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f3600059060 con 0x7f36180d2ca0 2024-04-25T02:08:28.663 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:08:28.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.658+0000 7f361d9a9640 1 -- 172.21.15.79:0/145774792 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f35f806be60 msgr2=0x7f35f806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.658+0000 7f361d9a9640 1 --2- 172.21.15.79:0/145774792 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f35f806be60 0x7f35f806e320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3608000f60 tx=0x7f3608009040 comp rx=0 tx=0).stop 2024-04-25T02:08:28.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.658+0000 7f361d9a9640 1 -- 172.21.15.79:0/145774792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d2ca0 msgr2=0x7f36180b91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.658+0000 7f361d9a9640 1 --2- 172.21.15.79:0/145774792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d2ca0 0x7f36180b91a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f360000c7f0 tx=0x7f360000cbf0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.658+0000 7f361d9a9640 1 -- 172.21.15.79:0/145774792 shutdown_connections 2024-04-25T02:08:28.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.658+0000 7f361d9a9640 1 --2- 172.21.15.79:0/145774792 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f35f806be60 0x7f35f806e320 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.658+0000 7f361d9a9640 1 --2- 172.21.15.79:0/145774792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f361815e4f0 0x7f36180b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.658+0000 7f361d9a9640 1 --2- 172.21.15.79:0/145774792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d2ca0 0x7f36180b91a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.658+0000 7f361d9a9640 1 --2- 172.21.15.79:0/145774792 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36180d0ef0 0x7f361815c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.658+0000 7f361d9a9640 1 -- 172.21.15.79:0/145774792 >> 172.21.15.79:0/145774792 conn(0x7f361809d4a0 msgr2=0x7f361806be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:28.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.658+0000 7f361d9a9640 1 -- 172.21.15.79:0/145774792 shutdown_connections 2024-04-25T02:08:28.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.658+0000 7f361d9a9640 1 -- 172.21.15.79:0/145774792 wait complete. 2024-04-25T02:08:28.676 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:08:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.768+0000 7f999cc15640 1 Processor -- start 2024-04-25T02:08:28.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.768+0000 7f999cc15640 1 -- start start 2024-04-25T02:08:28.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.769+0000 7f999cc15640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f99980cf7a0 0x7f99980b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.769+0000 7f999cc15640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f999806e6b0 0x7f999815b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.769+0000 7f999cc15640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f999815ec20 con 0x7f999806b2f0 2024-04-25T02:08:28.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.769+0000 7f999cc15640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f999815f830 con 0x7f999806e6b0 2024-04-25T02:08:28.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.769+0000 7f999cc15640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f999815ef00 con 0x7f99980cf7a0 2024-04-25T02:08:28.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.770+0000 7f9996d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f999806e6b0 0x7f999815b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.770+0000 7f999659c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f999806b2f0 0x7f999806b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58522/0 (socket says 172.21.15.79:58522) 2024-04-25T02:08:28.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.770+0000 7f999659c640 1 -- 172.21.15.79:0/2088080170 learned_addr learned my addr 172.21.15.79:0/2088080170 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:28.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.770+0000 7f9995d9b640 1 --2- 172.21.15.79:0/2088080170 >> v2:172.21.15.189:3300/0 conn(0x7f99980cf7a0 0x7f99980b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.770+0000 7f9996d9d640 1 -- 172.21.15.79:0/2088080170 >> v2:172.21.15.189:3300/0 conn(0x7f99980cf7a0 msgr2=0x7f99980b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:28.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.770+0000 7f9996d9d640 1 --2- 172.21.15.79:0/2088080170 >> v2:172.21.15.189:3300/0 conn(0x7f99980cf7a0 0x7f99980b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.770+0000 7f9996d9d640 1 -- 172.21.15.79:0/2088080170 >> v1:172.21.15.79:6789/0 conn(0x7f999806b2f0 legacy=0x7f999806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.770+0000 7f9996d9d640 1 -- 172.21.15.79:0/2088080170 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999815f1e0 con 0x7f999806e6b0 2024-04-25T02:08:28.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.770+0000 7f999559a640 1 -- 172.21.15.79:0/2088080170 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2406460583 0 0) 0x7f999815ec20 con 0x7f999806b2f0 2024-04-25T02:08:28.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.771+0000 7f9996d9d640 1 --2- 172.21.15.79:0/2088080170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f999806e6b0 0x7f999815b2d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f999815f9b0 tx=0x7f999002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5324d82ce346dfe4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:28.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.771+0000 7f999559a640 1 -- 172.21.15.79:0/2088080170 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9990031600 con 0x7f999806e6b0 2024-04-25T02:08:28.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.771+0000 7f999559a640 1 -- 172.21.15.79:0/2088080170 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99900317a0 con 0x7f999806e6b0 2024-04-25T02:08:28.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.771+0000 7f999559a640 1 -- 172.21.15.79:0/2088080170 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9990031b70 con 0x7f999806e6b0 2024-04-25T02:08:28.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.771+0000 7f999cc15640 1 -- 172.21.15.79:0/2088080170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f999806e6b0 msgr2=0x7f999815b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.771+0000 7f999cc15640 1 --2- 172.21.15.79:0/2088080170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f999806e6b0 0x7f999815b2d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f999815f9b0 tx=0x7f999002a5d0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.771+0000 7f999cc15640 1 -- 172.21.15.79:0/2088080170 shutdown_connections 2024-04-25T02:08:28.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.771+0000 7f999cc15640 1 --2- 172.21.15.79:0/2088080170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f999806e6b0 0x7f999815b2d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.771+0000 7f999cc15640 1 --2- 172.21.15.79:0/2088080170 >> v2:172.21.15.189:3300/0 conn(0x7f99980cf7a0 0x7f99980b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.771+0000 7f999cc15640 1 -- 172.21.15.79:0/2088080170 >> 172.21.15.79:0/2088080170 conn(0x7f99980b1cd0 msgr2=0x7f99980b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:28.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.771+0000 7f999cc15640 1 -- 172.21.15.79:0/2088080170 shutdown_connections 2024-04-25T02:08:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.771+0000 7f999cc15640 1 -- 172.21.15.79:0/2088080170 wait complete. 2024-04-25T02:08:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.773+0000 7f999cc15640 1 Processor -- start 2024-04-25T02:08:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.773+0000 7f999cc15640 1 -- start start 2024-04-25T02:08:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.773+0000 7f999cc15640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f999806b2f0 0x7f9998072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.773+0000 7f999cc15640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f999806e6b0 0x7f999815e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.773+0000 7f999cc15640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99980cf7a0 0x7f99980ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.773+0000 7f999cc15640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f999806d160 con 0x7f999806b2f0 2024-04-25T02:08:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.773+0000 7f999cc15640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f999806cfe0 con 0x7f999806e6b0 2024-04-25T02:08:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.773+0000 7f999cc15640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f999815b810 con 0x7f99980cf7a0 2024-04-25T02:08:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.773+0000 7f999659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f999806b2f0 0x7f9998072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.774+0000 7f999659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f999806b2f0 0x7f9998072bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59866/0 (socket says 172.21.15.79:59866) 2024-04-25T02:08:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.774+0000 7f999659c640 1 -- 172.21.15.79:0/618110055 learned_addr learned my addr 172.21.15.79:0/618110055 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.774+0000 7f9995d9b640 1 --2- 172.21.15.79:0/618110055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f999806e6b0 0x7f999815e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.774+0000 7f9996d9d640 1 --2- 172.21.15.79:0/618110055 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99980cf7a0 0x7f99980ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.774+0000 7f999659c640 1 -- 172.21.15.79:0/618110055 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99980cf7a0 msgr2=0x7f99980ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.774+0000 7f999659c640 1 --2- 172.21.15.79:0/618110055 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99980cf7a0 0x7f99980ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.774+0000 7f999659c640 1 -- 172.21.15.79:0/618110055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f999806e6b0 msgr2=0x7f999815e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.774+0000 7f999659c640 1 --2- 172.21.15.79:0/618110055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f999806e6b0 0x7f999815e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.774+0000 7f999659c640 1 -- 172.21.15.79:0/618110055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9998156df0 con 0x7f999806b2f0 2024-04-25T02:08:28.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.774+0000 7f999659c640 1 --2- 172.21.15.79:0/618110055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f999806b2f0 0x7f9998072bc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f998c00c4d0 tx=0x7f998c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:28.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.774+0000 7f9986ffd640 1 -- 172.21.15.79:0/618110055 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c018070 con 0x7f999806b2f0 2024-04-25T02:08:28.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.774+0000 7f9986ffd640 1 -- 172.21.15.79:0/618110055 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f998c007500 con 0x7f999806b2f0 2024-04-25T02:08:28.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.774+0000 7f999cc15640 1 -- 172.21.15.79:0/618110055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99980c9000 con 0x7f999806b2f0 2024-04-25T02:08:28.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.774+0000 7f9986ffd640 1 -- 172.21.15.79:0/618110055 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c004a20 con 0x7f999806b2f0 2024-04-25T02:08:28.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.774+0000 7f999cc15640 1 -- 172.21.15.79:0/618110055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99980c95c0 con 0x7f999806b2f0 2024-04-25T02:08:28.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.775+0000 7f999cc15640 1 -- 172.21.15.79:0/618110055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99980690a0 con 0x7f999806b2f0 2024-04-25T02:08:28.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.776+0000 7f9986ffd640 1 -- 172.21.15.79:0/618110055 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f998c01b070 con 0x7f999806b2f0 2024-04-25T02:08:28.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.776+0000 7f9986ffd640 1 --2- 172.21.15.79:0/618110055 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f997806be30 0x7f997806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.776+0000 7f9995d9b640 1 --2- 172.21.15.79:0/618110055 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f997806be30 0x7f997806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.776+0000 7f9986ffd640 1 -- 172.21.15.79:0/618110055 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f998c08a1e0 con 0x7f999806b2f0 2024-04-25T02:08:28.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.776+0000 7f9995d9b640 1 --2- 172.21.15.79:0/618110055 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f997806be30 0x7f997806e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9988006fd0 tx=0x7f9988008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:28.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.780+0000 7f9986ffd640 1 -- 172.21.15.79:0/618110055 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f998c058b90 con 0x7f999806b2f0 2024-04-25T02:08:28.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.951+0000 7f999cc15640 1 -- 172.21.15.79:0/618110055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f99980cf4f0 con 0x7f999806b2f0 2024-04-25T02:08:28.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.952+0000 7f9986ffd640 1 -- 172.21.15.79:0/618110055 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f998c058490 con 0x7f999806b2f0 2024-04-25T02:08:28.959 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:08:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.953+0000 7f999cc15640 1 -- 172.21.15.79:0/618110055 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f997806be30 msgr2=0x7f997806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.954+0000 7f999cc15640 1 --2- 172.21.15.79:0/618110055 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f997806be30 0x7f997806e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9988006fd0 tx=0x7f9988008040 comp rx=0 tx=0).stop 2024-04-25T02:08:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.954+0000 7f999cc15640 1 -- 172.21.15.79:0/618110055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f999806b2f0 msgr2=0x7f9998072bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.954+0000 7f999cc15640 1 --2- 172.21.15.79:0/618110055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f999806b2f0 0x7f9998072bc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f998c00c4d0 tx=0x7f998c00c990 comp rx=0 tx=0).stop 2024-04-25T02:08:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.954+0000 7f999cc15640 1 -- 172.21.15.79:0/618110055 shutdown_connections 2024-04-25T02:08:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.954+0000 7f999cc15640 1 --2- 172.21.15.79:0/618110055 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f997806be30 0x7f997806e2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.954+0000 7f999cc15640 1 --2- 172.21.15.79:0/618110055 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99980cf7a0 0x7f99980ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.954+0000 7f999cc15640 1 --2- 172.21.15.79:0/618110055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f999806e6b0 0x7f999815e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.954+0000 7f999cc15640 1 --2- 172.21.15.79:0/618110055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f999806b2f0 0x7f9998072bc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.954+0000 7f999cc15640 1 -- 172.21.15.79:0/618110055 >> 172.21.15.79:0/618110055 conn(0x7f99980b1cd0 msgr2=0x7f999806b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.954+0000 7f999cc15640 1 -- 172.21.15.79:0/618110055 shutdown_connections 2024-04-25T02:08:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:28.954+0000 7f999cc15640 1 -- 172.21.15.79:0/618110055 wait complete. 2024-04-25T02:08:28.972 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:08:29.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.062+0000 7fe5df309640 1 Processor -- start 2024-04-25T02:08:29.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.063+0000 7fe5df309640 1 -- start start 2024-04-25T02:08:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.063+0000 7fe5df309640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe5d815e4d0 0x7fe5d806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.063+0000 7fe5df309640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe5d80b3570 0x7fe5d80d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.063+0000 7fe5df309640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5d80d1660 con 0x7fe5d80b3020 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.063+0000 7fe5df309640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe5d80d1380 con 0x7fe5d815e4d0 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.063+0000 7fe5df309640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe5d80cede0 con 0x7fe5d80b3570 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.063+0000 7fe5dd0a5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe5d815e4d0 0x7fe5d806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.063+0000 7fe5dd8a6640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe5d80b3020 0x7fe5d80cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58536/0 (socket says 172.21.15.79:58536) 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.063+0000 7fe5dd0a5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe5d815e4d0 0x7fe5d806bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59870/0 (socket says 172.21.15.79:59870) 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.063+0000 7fe5dd8a6640 1 -- 172.21.15.79:0/120797593 learned_addr learned my addr 172.21.15.79:0/120797593 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.064+0000 7fe5dc8a4640 1 --2- 172.21.15.79:0/120797593 >> v2:172.21.15.189:3300/0 conn(0x7fe5d80b3570 0x7fe5d80d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.064+0000 7fe5dd0a5640 1 -- 172.21.15.79:0/120797593 >> v2:172.21.15.189:3300/0 conn(0x7fe5d80b3570 msgr2=0x7fe5d80d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.064+0000 7fe5dd0a5640 1 --2- 172.21.15.79:0/120797593 >> v2:172.21.15.189:3300/0 conn(0x7fe5d80b3570 0x7fe5d80d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.064+0000 7fe5dd0a5640 1 -- 172.21.15.79:0/120797593 >> v1:172.21.15.79:6789/0 conn(0x7fe5d80b3020 legacy=0x7fe5d80cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.064+0000 7fe5dd0a5640 1 -- 172.21.15.79:0/120797593 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d80cf0c0 con 0x7fe5d815e4d0 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.064+0000 7fe5cffff640 1 -- 172.21.15.79:0/120797593 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 279780104 0 0) 0x7fe5d80d1660 con 0x7fe5d80b3020 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.064+0000 7fe5dd0a5640 1 --2- 172.21.15.79:0/120797593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d815e4d0 0x7fe5d806bc70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80097a0 tx=0x7fe5c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2e1dfcc8aff160 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.065+0000 7fe5cffff640 1 -- 172.21.15.79:0/120797593 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8037070 con 0x7fe5d815e4d0 2024-04-25T02:08:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.065+0000 7fe5cffff640 1 -- 172.21.15.79:0/120797593 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c8032440 con 0x7fe5d815e4d0 2024-04-25T02:08:29.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.065+0000 7fe5cffff640 1 -- 172.21.15.79:0/120797593 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8032810 con 0x7fe5d815e4d0 2024-04-25T02:08:29.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.065+0000 7fe5df309640 1 -- 172.21.15.79:0/120797593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d815e4d0 msgr2=0x7fe5d806bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.065+0000 7fe5df309640 1 --2- 172.21.15.79:0/120797593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d815e4d0 0x7fe5d806bc70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80097a0 tx=0x7fe5c802a1e0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.065+0000 7fe5df309640 1 -- 172.21.15.79:0/120797593 shutdown_connections 2024-04-25T02:08:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.065+0000 7fe5df309640 1 --2- 172.21.15.79:0/120797593 >> v2:172.21.15.189:3300/0 conn(0x7fe5d80b3570 0x7fe5d80d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.065+0000 7fe5df309640 1 --2- 172.21.15.79:0/120797593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d815e4d0 0x7fe5d806bc70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.065+0000 7fe5df309640 1 -- 172.21.15.79:0/120797593 >> 172.21.15.79:0/120797593 conn(0x7fe5d809d460 msgr2=0x7fe5d80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.065+0000 7fe5df309640 1 -- 172.21.15.79:0/120797593 shutdown_connections 2024-04-25T02:08:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.065+0000 7fe5df309640 1 -- 172.21.15.79:0/120797593 wait complete. 2024-04-25T02:08:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.066+0000 7fe5df309640 1 Processor -- start 2024-04-25T02:08:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.066+0000 7fe5df309640 1 -- start start 2024-04-25T02:08:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.067+0000 7fe5df309640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5d80b3020 0x7fe5d81f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.067+0000 7fe5df309640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d80b3570 0x7fe5d8155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.067+0000 7fe5df309640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d815e4d0 0x7fe5d80cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.067+0000 7fe5df309640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d80d2250 con 0x7fe5d815e4d0 2024-04-25T02:08:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.067+0000 7fe5df309640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d80d20d0 con 0x7fe5d80b3570 2024-04-25T02:08:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.067+0000 7fe5df309640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d806c1b0 con 0x7fe5d80b3020 2024-04-25T02:08:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.067+0000 7fe5dd8a6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d815e4d0 0x7fe5d80cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.067+0000 7fe5dd8a6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d815e4d0 0x7fe5d80cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59878/0 (socket says 172.21.15.79:59878) 2024-04-25T02:08:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.067+0000 7fe5dd8a6640 1 -- 172.21.15.79:0/3437423349 learned_addr learned my addr 172.21.15.79:0/3437423349 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.067+0000 7fe5dc8a4640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d80b3570 0x7fe5d8155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.067+0000 7fe5dd0a5640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5d80b3020 0x7fe5d81f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.067+0000 7fe5dd8a6640 1 -- 172.21.15.79:0/3437423349 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5d80b3020 msgr2=0x7fe5d81f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.067+0000 7fe5dd8a6640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5d80b3020 0x7fe5d81f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.067+0000 7fe5dd8a6640 1 -- 172.21.15.79:0/3437423349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d80b3570 msgr2=0x7fe5d8155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.067+0000 7fe5dd8a6640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d80b3570 0x7fe5d8155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.068+0000 7fe5dd8a6640 1 -- 172.21.15.79:0/3437423349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d80b99f0 con 0x7fe5d815e4d0 2024-04-25T02:08:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.068+0000 7fe5dc8a4640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d80b3570 0x7fe5d8155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.068+0000 7fe5dd0a5640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5d80b3020 0x7fe5d81f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.068+0000 7fe5dd8a6640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d815e4d0 0x7fe5d80cd770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000c7a0 tx=0x7fe5d000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.068+0000 7fe5cdffb640 1 -- 172.21.15.79:0/3437423349 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0018070 con 0x7fe5d815e4d0 2024-04-25T02:08:29.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.068+0000 7fe5cdffb640 1 -- 172.21.15.79:0/3437423349 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d000a640 con 0x7fe5d815e4d0 2024-04-25T02:08:29.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.068+0000 7fe5cdffb640 1 -- 172.21.15.79:0/3437423349 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d000aa70 con 0x7fe5d815e4d0 2024-04-25T02:08:29.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.068+0000 7fe5df309640 1 -- 172.21.15.79:0/3437423349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d80cbb80 con 0x7fe5d815e4d0 2024-04-25T02:08:29.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.068+0000 7fe5df309640 1 -- 172.21.15.79:0/3437423349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d80cc120 con 0x7fe5d815e4d0 2024-04-25T02:08:29.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.069+0000 7fe5df309640 1 -- 172.21.15.79:0/3437423349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d80690a0 con 0x7fe5d815e4d0 2024-04-25T02:08:29.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.069+0000 7fe5cdffb640 1 -- 172.21.15.79:0/3437423349 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe5d001b070 con 0x7fe5d815e4d0 2024-04-25T02:08:29.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.070+0000 7fe5cdffb640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe5bc06be30 0x7fe5bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.070+0000 7fe5cdffb640 1 -- 172.21.15.79:0/3437423349 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe5d008a430 con 0x7fe5d815e4d0 2024-04-25T02:08:29.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.070+0000 7fe5dd0a5640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe5bc06be30 0x7fe5bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.070+0000 7fe5dd0a5640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe5bc06be30 0x7fe5bc06e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8034000 tx=0x7fe5c802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:29.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.074+0000 7fe5cdffb640 1 -- 172.21.15.79:0/3437423349 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe5d80b99f0 con 0x7fe5d815e4d0 2024-04-25T02:08:29.239 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:08:29.241 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:08:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.263+0000 7fe5df309640 1 -- 172.21.15.79:0/3437423349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe5d80d1920 con 0x7fe5d815e4d0 2024-04-25T02:08:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.264+0000 7fe5cdffb640 1 -- 172.21.15.79:0/3437423349 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fe5d0058de0 con 0x7fe5d815e4d0 2024-04-25T02:08:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-04-25T02:08:29.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.266+0000 7fe5df309640 1 -- 172.21.15.79:0/3437423349 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe5bc06be30 msgr2=0x7fe5bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.266+0000 7fe5df309640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe5bc06be30 0x7fe5bc06e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8034000 tx=0x7fe5c802e000 comp rx=0 tx=0).stop 2024-04-25T02:08:29.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.266+0000 7fe5df309640 1 -- 172.21.15.79:0/3437423349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d815e4d0 msgr2=0x7fe5d80cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.266+0000 7fe5df309640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d815e4d0 0x7fe5d80cd770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000c7a0 tx=0x7fe5d000cc60 comp rx=0 tx=0).stop 2024-04-25T02:08:29.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.266+0000 7fe5df309640 1 -- 172.21.15.79:0/3437423349 shutdown_connections 2024-04-25T02:08:29.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.266+0000 7fe5df309640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe5bc06be30 0x7fe5bc06e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.266+0000 7fe5df309640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d815e4d0 0x7fe5d80cd770 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.266+0000 7fe5df309640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d80b3570 0x7fe5d8155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.266+0000 7fe5df309640 1 --2- 172.21.15.79:0/3437423349 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5d80b3020 0x7fe5d81f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.266+0000 7fe5df309640 1 -- 172.21.15.79:0/3437423349 >> 172.21.15.79:0/3437423349 conn(0x7fe5d809d460 msgr2=0x7fe5d815d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:29.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.266+0000 7fe5df309640 1 -- 172.21.15.79:0/3437423349 shutdown_connections 2024-04-25T02:08:29.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.266+0000 7fe5df309640 1 -- 172.21.15.79:0/3437423349 wait complete. 2024-04-25T02:08:29.284 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:08:29.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:29.284 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-25T02:08:29.352 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:08:29.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:29.352 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:08:29.413 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:08:29.413 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:29.432 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:08:29.432 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:29.493 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:08:29.493 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:29.551 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:29.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.644+0000 7f4c80fd5640 1 Processor -- start 2024-04-25T02:08:29.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.644+0000 7f4c80fd5640 1 -- start start 2024-04-25T02:08:29.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.645+0000 7f4c80fd5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f4c7c0ce860 0x7f4c7c0d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.645+0000 7f4c80fd5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4c7c15daf0 0x7f4c7c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.645+0000 7f4c80fd5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7c0d14e0 con 0x7f4c7c0d29a0 2024-04-25T02:08:29.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.645+0000 7f4c80fd5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f4c7c0ce340 con 0x7f4c7c0ce860 2024-04-25T02:08:29.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.645+0000 7f4c80fd5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7c0cc570 con 0x7f4c7c15daf0 2024-04-25T02:08:29.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.645+0000 7f4c79d9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4c7c0d29a0 0x7f4c7c0cec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58548/0 (socket says 172.21.15.79:58548) 2024-04-25T02:08:29.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.645+0000 7f4c79d9b640 1 -- 172.21.15.79:0/891940473 learned_addr learned my addr 172.21.15.79:0/891940473 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:29.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7a59c640 1 --2- 172.21.15.79:0/891940473 >> v2:172.21.15.189:3300/0 conn(0x7f4c7c0ce860 0x7f4c7c0d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7ad9d640 1 --2- 172.21.15.79:0/891940473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4c7c15daf0 0x7f4c7c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 -- 172.21.15.79:0/891940473 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544938867 0 0) 0x7f4c7c0d14e0 con 0x7f4c7c0d29a0 2024-04-25T02:08:29.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 -- 172.21.15.79:0/891940473 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c64003520 con 0x7f4c7c0d29a0 2024-04-25T02:08:29.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 -- 172.21.15.79:0/891940473 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1719210726 0 0) 0x7f4c64003520 con 0x7f4c7c0d29a0 2024-04-25T02:08:29.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 -- 172.21.15.79:0/891940473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4c7c15daf0 msgr2=0x7f4c7c15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:29.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 --2- 172.21.15.79:0/891940473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4c7c15daf0 0x7f4c7c15df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 -- 172.21.15.79:0/891940473 >> v2:172.21.15.189:3300/0 conn(0x7f4c7c0ce860 msgr2=0x7f4c7c0d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:29.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 --2- 172.21.15.79:0/891940473 >> v2:172.21.15.189:3300/0 conn(0x7f4c7c0ce860 0x7f4c7c0d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 -- 172.21.15.79:0/891940473 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c0cc850 con 0x7f4c7c0d29a0 2024-04-25T02:08:29.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 -- 172.21.15.79:0/891940473 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f4c70001670 con 0x7f4c7c0d29a0 2024-04-25T02:08:29.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 -- 172.21.15.79:0/891940473 >> v1:172.21.15.79:6789/0 conn(0x7f4c7c0d29a0 legacy=0x7f4c7c0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 --2- 172.21.15.79:0/891940473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c640039b0 0x7f4c64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 --2- 172.21.15.79:0/891940473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c64004800 0x7f4c64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 --2- 172.21.15.79:0/891940473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4c7c15daf0 0x7f4c640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 -- 172.21.15.79:0/891940473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c0ce340 con 0x7f4c64004800 2024-04-25T02:08:29.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 -- 172.21.15.79:0/891940473 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c0cc570 con 0x7f4c640039b0 2024-04-25T02:08:29.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7959a640 1 -- 172.21.15.79:0/891940473 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4c6400b9c0 con 0x7f4c7c15daf0 2024-04-25T02:08:29.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7a59c640 1 --2- 172.21.15.79:0/891940473 >> v2:172.21.15.189:3300/0 conn(0x7f4c7c0ce860 0x7f4c7c0d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:29.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c79d9b640 1 --2- 172.21.15.79:0/891940473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c64004800 0x7f4c64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7ad9d640 1 --2- 172.21.15.79:0/891940473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4c7c15daf0 0x7f4c640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.646+0000 7f4c7a59c640 1 --2- 172.21.15.79:0/891940473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c640039b0 0x7f4c64003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.647+0000 7f4c79d9b640 1 -- 172.21.15.79:0/891940473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4c7c15daf0 msgr2=0x7f4c640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:29.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.647+0000 7f4c79d9b640 1 --2- 172.21.15.79:0/891940473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4c7c15daf0 0x7f4c640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.647+0000 7f4c79d9b640 1 -- 172.21.15.79:0/891940473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c640039b0 msgr2=0x7f4c64003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:29.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.647+0000 7f4c79d9b640 1 --2- 172.21.15.79:0/891940473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c640039b0 0x7f4c64003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.647+0000 7f4c79d9b640 1 -- 172.21.15.79:0/891940473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c64003520 con 0x7f4c64004800 2024-04-25T02:08:29.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.647+0000 7f4c7a59c640 1 --2- 172.21.15.79:0/891940473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c640039b0 0x7f4c64003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:29.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.647+0000 7f4c79d9b640 1 --2- 172.21.15.79:0/891940473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c64004800 0x7f4c64004c80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000c210 tx=0x7f4c64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b4ea59423848dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:29.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.647+0000 7f4c7959a640 1 -- 172.21.15.79:0/891940473 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70007d30 con 0x7f4c64004800 2024-04-25T02:08:29.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.647+0000 7f4c7959a640 1 -- 172.21.15.79:0/891940473 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c70005ad0 con 0x7f4c64004800 2024-04-25T02:08:29.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.647+0000 7f4c7959a640 1 -- 172.21.15.79:0/891940473 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70007070 con 0x7f4c64004800 2024-04-25T02:08:29.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.648+0000 7f4c80fd5640 1 -- 172.21.15.79:0/891940473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c64004800 msgr2=0x7f4c64004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.648+0000 7f4c80fd5640 1 --2- 172.21.15.79:0/891940473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c64004800 0x7f4c64004c80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000c210 tx=0x7f4c64005830 comp rx=0 tx=0).stop 2024-04-25T02:08:29.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.648+0000 7f4c7ad9d640 1 -- 172.21.15.79:0/891940473 reap_dead start 2024-04-25T02:08:29.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.648+0000 7f4c80fd5640 1 -- 172.21.15.79:0/891940473 shutdown_connections 2024-04-25T02:08:29.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.648+0000 7f4c80fd5640 1 -- 172.21.15.79:0/891940473 >> 172.21.15.79:0/891940473 conn(0x7f4c7c0d1e80 msgr2=0x7f4c7c0d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:29.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.648+0000 7f4c80fd5640 1 -- 172.21.15.79:0/891940473 shutdown_connections 2024-04-25T02:08:29.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.648+0000 7f4c80fd5640 1 -- 172.21.15.79:0/891940473 wait complete. 2024-04-25T02:08:29.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.649+0000 7f4c80fd5640 1 Processor -- start 2024-04-25T02:08:29.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.649+0000 7f4c80fd5640 1 -- start start 2024-04-25T02:08:29.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.650+0000 7f4c80fd5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c64004800 0x7f4c7c1f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.650+0000 7f4c80fd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c7c157280 0x7f4c7c157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.650+0000 7f4c80fd5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4c7c1593c0 0x7f4c7c159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.650+0000 7f4c80fd5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c06c1c0 con 0x7f4c7c157280 2024-04-25T02:08:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.650+0000 7f4c80fd5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c0cce10 con 0x7f4c64004800 2024-04-25T02:08:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.650+0000 7f4c80fd5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7c0c6e30 con 0x7f4c7c1593c0 2024-04-25T02:08:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.650+0000 7f4c79d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c7c157280 0x7f4c7c157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.650+0000 7f4c79d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c7c157280 0x7f4c7c157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59898/0 (socket says 172.21.15.79:59898) 2024-04-25T02:08:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.650+0000 7f4c79d9b640 1 -- 172.21.15.79:0/2743565389 learned_addr learned my addr 172.21.15.79:0/2743565389 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.650+0000 7f4c7a59c640 1 --2- 172.21.15.79:0/2743565389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c64004800 0x7f4c7c1f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.650+0000 7f4c7ad9d640 1 --2- 172.21.15.79:0/2743565389 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4c7c1593c0 0x7f4c7c159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.651+0000 7f4c79d9b640 1 -- 172.21.15.79:0/2743565389 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4c7c1593c0 msgr2=0x7f4c7c159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.651+0000 7f4c79d9b640 1 --2- 172.21.15.79:0/2743565389 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4c7c1593c0 0x7f4c7c159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.651+0000 7f4c79d9b640 1 -- 172.21.15.79:0/2743565389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c64004800 msgr2=0x7f4c7c1f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.651+0000 7f4c79d9b640 1 --2- 172.21.15.79:0/2743565389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c64004800 0x7f4c7c1f1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.651+0000 7f4c79d9b640 1 -- 172.21.15.79:0/2743565389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c15a140 con 0x7f4c7c157280 2024-04-25T02:08:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.651+0000 7f4c79d9b640 1 --2- 172.21.15.79:0/2743565389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c7c157280 0x7f4c7c157700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000c330 tx=0x7f4c70001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.651+0000 7f4c6affd640 1 -- 172.21.15.79:0/2743565389 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70004bf0 con 0x7f4c7c157280 2024-04-25T02:08:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.651+0000 7f4c6affd640 1 -- 172.21.15.79:0/2743565389 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c70004d90 con 0x7f4c7c157280 2024-04-25T02:08:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.651+0000 7f4c80fd5640 1 -- 172.21.15.79:0/2743565389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7c15a420 con 0x7f4c7c157280 2024-04-25T02:08:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.651+0000 7f4c6affd640 1 -- 172.21.15.79:0/2743565389 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70007270 con 0x7f4c7c157280 2024-04-25T02:08:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.651+0000 7f4c80fd5640 1 -- 172.21.15.79:0/2743565389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7c0c7390 con 0x7f4c7c157280 2024-04-25T02:08:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.652+0000 7f4c80fd5640 1 -- 172.21.15.79:0/2743565389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c7c0690a0 con 0x7f4c7c157280 2024-04-25T02:08:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.653+0000 7f4c6affd640 1 -- 172.21.15.79:0/2743565389 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c70045020 con 0x7f4c7c157280 2024-04-25T02:08:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.653+0000 7f4c6affd640 1 --2- 172.21.15.79:0/2743565389 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4c5c06be60 0x7f4c5c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.653+0000 7f4c6affd640 1 -- 172.21.15.79:0/2743565389 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4c700aad00 con 0x7f4c7c157280 2024-04-25T02:08:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.653+0000 7f4c7a59c640 1 --2- 172.21.15.79:0/2743565389 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4c5c06be60 0x7f4c5c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.653+0000 7f4c7a59c640 1 --2- 172.21.15.79:0/2743565389 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4c5c06be60 0x7f4c5c06e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0b3670 tx=0x7f4c6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:29.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.658+0000 7f4c6affd640 1 -- 172.21.15.79:0/2743565389 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4c700796b0 con 0x7f4c7c157280 2024-04-25T02:08:29.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.838+0000 7f4c80fd5640 1 -- 172.21.15.79:0/2743565389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c7c0cdd70 con 0x7f4c7c157280 2024-04-25T02:08:29.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.839+0000 7f4c6affd640 1 -- 172.21.15.79:0/2743565389 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f4c70046e30 con 0x7f4c7c157280 2024-04-25T02:08:29.846 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:29.846 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:29.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.841+0000 7f4c80fd5640 1 -- 172.21.15.79:0/2743565389 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4c5c06be60 msgr2=0x7f4c5c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.841+0000 7f4c80fd5640 1 --2- 172.21.15.79:0/2743565389 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4c5c06be60 0x7f4c5c06e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0b3670 tx=0x7f4c6c008040 comp rx=0 tx=0).stop 2024-04-25T02:08:29.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.841+0000 7f4c80fd5640 1 -- 172.21.15.79:0/2743565389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c7c157280 msgr2=0x7f4c7c157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.841+0000 7f4c80fd5640 1 --2- 172.21.15.79:0/2743565389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c7c157280 0x7f4c7c157700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000c330 tx=0x7f4c70001a40 comp rx=0 tx=0).stop 2024-04-25T02:08:29.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.841+0000 7f4c80fd5640 1 -- 172.21.15.79:0/2743565389 shutdown_connections 2024-04-25T02:08:29.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.841+0000 7f4c80fd5640 1 --2- 172.21.15.79:0/2743565389 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4c5c06be60 0x7f4c5c06e320 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.841+0000 7f4c80fd5640 1 --2- 172.21.15.79:0/2743565389 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4c7c1593c0 0x7f4c7c159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.841+0000 7f4c80fd5640 1 --2- 172.21.15.79:0/2743565389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c7c157280 0x7f4c7c157700 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.841+0000 7f4c80fd5640 1 --2- 172.21.15.79:0/2743565389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c64004800 0x7f4c7c1f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.841+0000 7f4c80fd5640 1 -- 172.21.15.79:0/2743565389 >> 172.21.15.79:0/2743565389 conn(0x7f4c7c0d1e80 msgr2=0x7f4c7c0c9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:29.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.841+0000 7f4c80fd5640 1 -- 172.21.15.79:0/2743565389 shutdown_connections 2024-04-25T02:08:29.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.841+0000 7f4c80fd5640 1 -- 172.21.15.79:0/2743565389 wait complete. 2024-04-25T02:08:29.859 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:57.115253+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:58.421392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:08:29.860 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:08:29.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.954+0000 7fbee4cda640 1 Processor -- start 2024-04-25T02:08:29.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.955+0000 7fbee4cda640 1 -- start start 2024-04-25T02:08:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.955+0000 7fbee4cda640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbee015e4f0 0x7fbee00d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.955+0000 7fbee4cda640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbee00cf7f0 0x7fbee00d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.955+0000 7fbee4cda640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbee00cfc80 0x7fbee00d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.955+0000 7fbee4cda640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbee00d1ee0 con 0x7fbee015e4f0 2024-04-25T02:08:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.955+0000 7fbee4cda640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fbee00d21c0 con 0x7fbee00cf7f0 2024-04-25T02:08:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.955+0000 7fbee4cda640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbee00d24a0 con 0x7fbee00cfc80 2024-04-25T02:08:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.956+0000 7fbede59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbee015e4f0 0x7fbee00d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.956+0000 7fbede59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbee015e4f0 0x7fbee00d2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59902/0 (socket says 172.21.15.79:59902) 2024-04-25T02:08:29.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.956+0000 7fbede59c640 1 -- 172.21.15.79:0/2648665317 learned_addr learned my addr 172.21.15.79:0/2648665317 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:29.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.956+0000 7fbeddd9b640 1 --2- 172.21.15.79:0/2648665317 >> v2:172.21.15.189:3300/0 conn(0x7fbee00cf7f0 0x7fbee00d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.956+0000 7fbede59c640 1 -- 172.21.15.79:0/2648665317 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbee00cfc80 msgr2=0x7fbee00d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:29.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.956+0000 7fbede59c640 1 --2- 172.21.15.79:0/2648665317 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbee00cfc80 0x7fbee00d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.956+0000 7fbede59c640 1 -- 172.21.15.79:0/2648665317 >> v2:172.21.15.189:3300/0 conn(0x7fbee00cf7f0 msgr2=0x7fbee00d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:29.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.956+0000 7fbede59c640 1 --2- 172.21.15.79:0/2648665317 >> v2:172.21.15.189:3300/0 conn(0x7fbee00cf7f0 0x7fbee00d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.956+0000 7fbede59c640 1 -- 172.21.15.79:0/2648665317 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee00d2780 con 0x7fbee015e4f0 2024-04-25T02:08:29.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.956+0000 7fbeddd9b640 1 --2- 172.21.15.79:0/2648665317 >> v2:172.21.15.189:3300/0 conn(0x7fbee00cf7f0 0x7fbee00d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:29.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.957+0000 7fbede59c640 1 --2- 172.21.15.79:0/2648665317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee015e4f0 0x7fbee00d2ca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009870 tx=0x7fbed402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49df7a39b626137e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:29.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.957+0000 7fbedd59a640 1 -- 172.21.15.79:0/2648665317 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4037070 con 0x7fbee015e4f0 2024-04-25T02:08:29.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.957+0000 7fbedd59a640 1 -- 172.21.15.79:0/2648665317 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed4032440 con 0x7fbee015e4f0 2024-04-25T02:08:29.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.957+0000 7fbedd59a640 1 -- 172.21.15.79:0/2648665317 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4032810 con 0x7fbee015e4f0 2024-04-25T02:08:29.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.957+0000 7fbee4cda640 1 -- 172.21.15.79:0/2648665317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee015e4f0 msgr2=0x7fbee00d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.957+0000 7fbee4cda640 1 --2- 172.21.15.79:0/2648665317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee015e4f0 0x7fbee00d2ca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009870 tx=0x7fbed402a210 comp rx=0 tx=0).stop 2024-04-25T02:08:29.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.957+0000 7fbee4cda640 1 -- 172.21.15.79:0/2648665317 shutdown_connections 2024-04-25T02:08:29.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.957+0000 7fbee4cda640 1 --2- 172.21.15.79:0/2648665317 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbee00cfc80 0x7fbee00d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.957+0000 7fbee4cda640 1 --2- 172.21.15.79:0/2648665317 >> v2:172.21.15.189:3300/0 conn(0x7fbee00cf7f0 0x7fbee00d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.957+0000 7fbee4cda640 1 --2- 172.21.15.79:0/2648665317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee015e4f0 0x7fbee00d2ca0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.957+0000 7fbee4cda640 1 -- 172.21.15.79:0/2648665317 >> 172.21.15.79:0/2648665317 conn(0x7fbee009d4a0 msgr2=0x7fbee00d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:29.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.957+0000 7fbee4cda640 1 -- 172.21.15.79:0/2648665317 shutdown_connections 2024-04-25T02:08:29.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.957+0000 7fbee4cda640 1 -- 172.21.15.79:0/2648665317 wait complete. 2024-04-25T02:08:29.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.959+0000 7fbee4cda640 1 Processor -- start 2024-04-25T02:08:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.959+0000 7fbee4cda640 1 -- start start 2024-04-25T02:08:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbee4cda640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbee00cf7f0 0x7fbee00b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbee4cda640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbee00cfc80 0x7fbee014fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbee4cda640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee015e4f0 0x7fbee015c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbee4cda640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbee006bc30 con 0x7fbee015e4f0 2024-04-25T02:08:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbee4cda640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbee00d50f0 con 0x7fbee00cf7f0 2024-04-25T02:08:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbee4cda640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbee006bdb0 con 0x7fbee00cfc80 2024-04-25T02:08:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbeded9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee015e4f0 0x7fbee015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbeded9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee015e4f0 0x7fbee015c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59912/0 (socket says 172.21.15.79:59912) 2024-04-25T02:08:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbeded9d640 1 -- 172.21.15.79:0/1990580493 learned_addr learned my addr 172.21.15.79:0/1990580493 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbede59c640 1 --2- 172.21.15.79:0/1990580493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbee00cf7f0 0x7fbee00b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbeddd9b640 1 --2- 172.21.15.79:0/1990580493 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbee00cfc80 0x7fbee014fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbeded9d640 1 -- 172.21.15.79:0/1990580493 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbee00cfc80 msgr2=0x7fbee014fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbeded9d640 1 --2- 172.21.15.79:0/1990580493 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbee00cfc80 0x7fbee014fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbeded9d640 1 -- 172.21.15.79:0/1990580493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbee00cf7f0 msgr2=0x7fbee00b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbeded9d640 1 --2- 172.21.15.79:0/1990580493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbee00cf7f0 0x7fbee00b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbeded9d640 1 -- 172.21.15.79:0/1990580493 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee00c9700 con 0x7fbee015e4f0 2024-04-25T02:08:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbeded9d640 1 --2- 172.21.15.79:0/1990580493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee015e4f0 0x7fbee015c180 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbed800b9e0 tx=0x7fbed800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbeceffd640 1 -- 172.21.15.79:0/1990580493 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed8019070 con 0x7fbee015e4f0 2024-04-25T02:08:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbeceffd640 1 -- 172.21.15.79:0/1990580493 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed800cb20 con 0x7fbee015e4f0 2024-04-25T02:08:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbee4cda640 1 -- 172.21.15.79:0/1990580493 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee00c99e0 con 0x7fbee015e4f0 2024-04-25T02:08:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbeceffd640 1 -- 172.21.15.79:0/1990580493 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed8014440 con 0x7fbee015e4f0 2024-04-25T02:08:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.960+0000 7fbee4cda640 1 -- 172.21.15.79:0/1990580493 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee00c9fa0 con 0x7fbee015e4f0 2024-04-25T02:08:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.961+0000 7fbee4cda640 1 -- 172.21.15.79:0/1990580493 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee00686c0 con 0x7fbee015e4f0 2024-04-25T02:08:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.962+0000 7fbeceffd640 1 -- 172.21.15.79:0/1990580493 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbed801c070 con 0x7fbee015e4f0 2024-04-25T02:08:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.962+0000 7fbeceffd640 1 --2- 172.21.15.79:0/1990580493 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbec006be30 0x7fbec006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.962+0000 7fbeceffd640 1 -- 172.21.15.79:0/1990580493 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbed808aa50 con 0x7fbee015e4f0 2024-04-25T02:08:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.962+0000 7fbede59c640 1 --2- 172.21.15.79:0/1990580493 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbec006be30 0x7fbec006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.963+0000 7fbede59c640 1 --2- 172.21.15.79:0/1990580493 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbec006be30 0x7fbec006e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbed4034000 tx=0x7fbed402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:29.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:29.967+0000 7fbeceffd640 1 -- 172.21.15.79:0/1990580493 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbed8058e40 con 0x7fbee015e4f0 2024-04-25T02:08:30.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.142+0000 7fbee4cda640 1 -- 172.21.15.79:0/1990580493 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbee00690a0 con 0x7fbee015e4f0 2024-04-25T02:08:30.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.143+0000 7fbeceffd640 1 -- 172.21.15.79:0/1990580493 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fbed805d140 con 0x7fbee015e4f0 2024-04-25T02:08:30.150 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:08:30.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.145+0000 7fbee4cda640 1 -- 172.21.15.79:0/1990580493 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbec006be30 msgr2=0x7fbec006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.145+0000 7fbee4cda640 1 --2- 172.21.15.79:0/1990580493 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbec006be30 0x7fbec006e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbed4034000 tx=0x7fbed402e000 comp rx=0 tx=0).stop 2024-04-25T02:08:30.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.145+0000 7fbee4cda640 1 -- 172.21.15.79:0/1990580493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee015e4f0 msgr2=0x7fbee015c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.145+0000 7fbee4cda640 1 --2- 172.21.15.79:0/1990580493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee015e4f0 0x7fbee015c180 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbed800b9e0 tx=0x7fbed800bea0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.145+0000 7fbee4cda640 1 -- 172.21.15.79:0/1990580493 shutdown_connections 2024-04-25T02:08:30.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.145+0000 7fbee4cda640 1 --2- 172.21.15.79:0/1990580493 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbec006be30 0x7fbec006e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.145+0000 7fbee4cda640 1 --2- 172.21.15.79:0/1990580493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee015e4f0 0x7fbee015c180 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.145+0000 7fbee4cda640 1 --2- 172.21.15.79:0/1990580493 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbee00cfc80 0x7fbee014fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.145+0000 7fbee4cda640 1 --2- 172.21.15.79:0/1990580493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbee00cf7f0 0x7fbee00b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.145+0000 7fbee4cda640 1 -- 172.21.15.79:0/1990580493 >> 172.21.15.79:0/1990580493 conn(0x7fbee009d4a0 msgr2=0x7fbee006c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:30.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.145+0000 7fbee4cda640 1 -- 172.21.15.79:0/1990580493 shutdown_connections 2024-04-25T02:08:30.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.145+0000 7fbee4cda640 1 -- 172.21.15.79:0/1990580493 wait complete. 2024-04-25T02:08:30.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:08:30.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.257+0000 7f2d450f5640 1 Processor -- start 2024-04-25T02:08:30.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.257+0000 7f2d450f5640 1 -- start start 2024-04-25T02:08:30.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d450f5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2d400d0890 0x7f2d400b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d450f5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d400cd670 con 0x7f2d4015c4c0 2024-04-25T02:08:30.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d450f5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d400cd950 con 0x7f2d400cfac0 2024-04-25T02:08:30.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d450f5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f2d400cffc0 con 0x7f2d400d0890 2024-04-25T02:08:30.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3ed9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2d4015c4c0 0x7f2d400d0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58554/0 (socket says 172.21.15.79:58554) 2024-04-25T02:08:30.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3ed9d640 1 -- 172.21.15.79:0/521118607 learned_addr learned my addr 172.21.15.79:0/521118607 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:30.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3dd9b640 1 -- 172.21.15.79:0/521118607 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3571861626 0 0) 0x7f2d400cd670 con 0x7f2d4015c4c0 2024-04-25T02:08:30.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3dd9b640 1 -- 172.21.15.79:0/521118607 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d2c003520 con 0x7f2d4015c4c0 2024-04-25T02:08:30.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3e59c640 1 --2- 172.21.15.79:0/521118607 >> v2:172.21.15.189:3300/0 conn(0x7f2d400d0890 0x7f2d400b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3dd9b640 1 -- 172.21.15.79:0/521118607 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3837324566 0 0) 0x7f2d2c003520 con 0x7f2d4015c4c0 2024-04-25T02:08:30.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3dd9b640 1 -- 172.21.15.79:0/521118607 >> v2:172.21.15.189:3300/0 conn(0x7f2d400d0890 msgr2=0x7f2d400b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3dd9b640 1 --2- 172.21.15.79:0/521118607 >> v2:172.21.15.189:3300/0 conn(0x7f2d400d0890 0x7f2d400b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3dd9b640 1 -- 172.21.15.79:0/521118607 >> v1:172.21.15.189:6789/0 conn(0x7f2d400cfac0 legacy=0x7f2d4006f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3dd9b640 1 -- 172.21.15.79:0/521118607 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d400cdc30 con 0x7f2d4015c4c0 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3dd9b640 1 -- 172.21.15.79:0/521118607 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f2d28001670 con 0x7f2d4015c4c0 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3dd9b640 1 -- 172.21.15.79:0/521118607 >> v1:172.21.15.79:6789/0 conn(0x7f2d4015c4c0 legacy=0x7f2d400d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3dd9b640 1 --2- 172.21.15.79:0/521118607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d2c0039b0 0x7f2d2c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3dd9b640 1 --2- 172.21.15.79:0/521118607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d2c004800 0x7f2d2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3dd9b640 1 --2- 172.21.15.79:0/521118607 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d2c0052e0 0x7f2d2c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.258+0000 7f2d3dd9b640 1 -- 172.21.15.79:0/521118607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2d400cffc0 con 0x7f2d2c0039b0 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.259+0000 7f2d3dd9b640 1 -- 172.21.15.79:0/521118607 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c00c190 con 0x7f2d2c004800 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.259+0000 7f2d3dd9b640 1 -- 172.21.15.79:0/521118607 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2d2c00c390 con 0x7f2d2c0052e0 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.259+0000 7f2d3ed9d640 1 --2- 172.21.15.79:0/521118607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d2c0039b0 0x7f2d2c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.259+0000 7f2d3e59c640 1 --2- 172.21.15.79:0/521118607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d2c004800 0x7f2d2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.259+0000 7f2d3f59e640 1 --2- 172.21.15.79:0/521118607 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d2c0052e0 0x7f2d2c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.259+0000 7f2d3ed9d640 1 -- 172.21.15.79:0/521118607 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d2c0052e0 msgr2=0x7f2d2c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:30.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.259+0000 7f2d3ed9d640 1 --2- 172.21.15.79:0/521118607 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d2c0052e0 0x7f2d2c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.259+0000 7f2d3ed9d640 1 -- 172.21.15.79:0/521118607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d2c004800 msgr2=0x7f2d2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.259+0000 7f2d3ed9d640 1 --2- 172.21.15.79:0/521118607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d2c004800 0x7f2d2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.259+0000 7f2d3ed9d640 1 -- 172.21.15.79:0/521118607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2c003520 con 0x7f2d2c0039b0 2024-04-25T02:08:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.259+0000 7f2d3f59e640 1 --2- 172.21.15.79:0/521118607 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d2c0052e0 0x7f2d2c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.259+0000 7f2d3e59c640 1 --2- 172.21.15.79:0/521118607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d2c004800 0x7f2d2c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.259+0000 7f2d3f59e640 1 -- 172.21.15.79:0/521118607 reap_dead start 2024-04-25T02:08:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.259+0000 7f2d3ed9d640 1 --2- 172.21.15.79:0/521118607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d2c0039b0 0x7f2d2c003db0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2d28007fd0 tx=0x7f2d2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f6dc1f840013af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.260+0000 7f2d3dd9b640 1 -- 172.21.15.79:0/521118607 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d28007d50 con 0x7f2d2c0039b0 2024-04-25T02:08:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.260+0000 7f2d3dd9b640 1 -- 172.21.15.79:0/521118607 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d280058d0 con 0x7f2d2c0039b0 2024-04-25T02:08:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.260+0000 7f2d3dd9b640 1 -- 172.21.15.79:0/521118607 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d28005d20 con 0x7f2d2c0039b0 2024-04-25T02:08:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.260+0000 7f2d450f5640 1 -- 172.21.15.79:0/521118607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d2c0039b0 msgr2=0x7f2d2c003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.260+0000 7f2d450f5640 1 --2- 172.21.15.79:0/521118607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d2c0039b0 0x7f2d2c003db0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2d28007fd0 tx=0x7f2d2c005830 comp rx=0 tx=0).stop 2024-04-25T02:08:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.260+0000 7f2d450f5640 1 -- 172.21.15.79:0/521118607 shutdown_connections 2024-04-25T02:08:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.260+0000 7f2d450f5640 1 --2- 172.21.15.79:0/521118607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d2c0039b0 0x7f2d2c003db0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.260+0000 7f2d450f5640 1 -- 172.21.15.79:0/521118607 >> 172.21.15.79:0/521118607 conn(0x7f2d400d1ef0 msgr2=0x7f2d400d2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.260+0000 7f2d450f5640 1 -- 172.21.15.79:0/521118607 shutdown_connections 2024-04-25T02:08:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.260+0000 7f2d450f5640 1 -- 172.21.15.79:0/521118607 wait complete. 2024-04-25T02:08:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.262+0000 7f2d450f5640 1 Processor -- start 2024-04-25T02:08:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.262+0000 7f2d450f5640 1 -- start start 2024-04-25T02:08:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.262+0000 7f2d450f5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d2c0039b0 0x7f2d400b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.262+0000 7f2d450f5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d400b25b0 0x7f2d400b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.262+0000 7f2d450f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d400ca290 0x7f2d400ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.262+0000 7f2d450f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2d400b1340 con 0x7f2d400ca290 2024-04-25T02:08:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.262+0000 7f2d450f5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4006ef90 con 0x7f2d2c0039b0 2024-04-25T02:08:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.262+0000 7f2d450f5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2d400b14c0 con 0x7f2d400b25b0 2024-04-25T02:08:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d3f59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d400ca290 0x7f2d400ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d3f59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d400ca290 0x7f2d400ca710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59936/0 (socket says 172.21.15.79:59936) 2024-04-25T02:08:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d3f59e640 1 -- 172.21.15.79:0/404707419 learned_addr learned my addr 172.21.15.79:0/404707419 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d3ed9d640 1 --2- 172.21.15.79:0/404707419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d2c0039b0 0x7f2d400b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d3e59c640 1 --2- 172.21.15.79:0/404707419 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d400b25b0 0x7f2d400b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d3f59e640 1 -- 172.21.15.79:0/404707419 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d400b25b0 msgr2=0x7f2d400b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d3f59e640 1 --2- 172.21.15.79:0/404707419 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d400b25b0 0x7f2d400b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d3f59e640 1 -- 172.21.15.79:0/404707419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d2c0039b0 msgr2=0x7f2d400b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d3f59e640 1 --2- 172.21.15.79:0/404707419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d2c0039b0 0x7f2d400b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d3f59e640 1 -- 172.21.15.79:0/404707419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d400b4b10 con 0x7f2d400ca290 2024-04-25T02:08:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d3f59e640 1 --2- 172.21.15.79:0/404707419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d400ca290 0x7f2d400ca710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2d400cfef0 tx=0x7f2d3800d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d377fe640 1 -- 172.21.15.79:0/404707419 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d38006b50 con 0x7f2d400ca290 2024-04-25T02:08:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d377fe640 1 -- 172.21.15.79:0/404707419 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d38006d10 con 0x7f2d400ca290 2024-04-25T02:08:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d450f5640 1 -- 172.21.15.79:0/404707419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d400c5c70 con 0x7f2d400ca290 2024-04-25T02:08:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d377fe640 1 -- 172.21.15.79:0/404707419 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d38012840 con 0x7f2d400ca290 2024-04-25T02:08:30.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.263+0000 7f2d450f5640 1 -- 172.21.15.79:0/404707419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d400c6230 con 0x7f2d400ca290 2024-04-25T02:08:30.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.264+0000 7f2d450f5640 1 -- 172.21.15.79:0/404707419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d400690a0 con 0x7f2d400ca290 2024-04-25T02:08:30.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.265+0000 7f2d377fe640 1 -- 172.21.15.79:0/404707419 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d3801b020 con 0x7f2d400ca290 2024-04-25T02:08:30.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.265+0000 7f2d377fe640 1 --2- 172.21.15.79:0/404707419 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2d2006be60 0x7f2d2006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.265+0000 7f2d377fe640 1 -- 172.21.15.79:0/404707419 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2d3808a280 con 0x7f2d400ca290 2024-04-25T02:08:30.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.265+0000 7f2d3ed9d640 1 --2- 172.21.15.79:0/404707419 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2d2006be60 0x7f2d2006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.266+0000 7f2d3ed9d640 1 --2- 172.21.15.79:0/404707419 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2d2006be60 0x7f2d2006e320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d28033000 tx=0x7f2d2802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:30.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.273+0000 7f2d377fe640 1 -- 172.21.15.79:0/404707419 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2d38022020 con 0x7f2d400ca290 2024-04-25T02:08:30.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.449+0000 7f2d450f5640 1 -- 172.21.15.79:0/404707419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2d400b7740 con 0x7f2d400ca290 2024-04-25T02:08:30.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.449+0000 7f2d377fe640 1 -- 172.21.15.79:0/404707419 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f2d38058c30 con 0x7f2d400ca290 2024-04-25T02:08:30.456 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:08:30.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.451+0000 7f2d450f5640 1 -- 172.21.15.79:0/404707419 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2d2006be60 msgr2=0x7f2d2006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.451+0000 7f2d450f5640 1 --2- 172.21.15.79:0/404707419 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2d2006be60 0x7f2d2006e320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d28033000 tx=0x7f2d2802e000 comp rx=0 tx=0).stop 2024-04-25T02:08:30.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.451+0000 7f2d450f5640 1 -- 172.21.15.79:0/404707419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d400ca290 msgr2=0x7f2d400ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.451+0000 7f2d450f5640 1 --2- 172.21.15.79:0/404707419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d400ca290 0x7f2d400ca710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2d400cfef0 tx=0x7f2d3800d950 comp rx=0 tx=0).stop 2024-04-25T02:08:30.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.451+0000 7f2d450f5640 1 -- 172.21.15.79:0/404707419 shutdown_connections 2024-04-25T02:08:30.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.451+0000 7f2d450f5640 1 --2- 172.21.15.79:0/404707419 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2d2006be60 0x7f2d2006e320 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.451+0000 7f2d450f5640 1 --2- 172.21.15.79:0/404707419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d400ca290 0x7f2d400ca710 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.451+0000 7f2d450f5640 1 --2- 172.21.15.79:0/404707419 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d400b25b0 0x7f2d400b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.451+0000 7f2d450f5640 1 --2- 172.21.15.79:0/404707419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d2c0039b0 0x7f2d400b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.451+0000 7f2d450f5640 1 -- 172.21.15.79:0/404707419 >> 172.21.15.79:0/404707419 conn(0x7f2d400d1ef0 msgr2=0x7f2d4015b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:30.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.451+0000 7f2d450f5640 1 -- 172.21.15.79:0/404707419 shutdown_connections 2024-04-25T02:08:30.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.451+0000 7f2d450f5640 1 -- 172.21.15.79:0/404707419 wait complete. 2024-04-25T02:08:30.469 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:08:30.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.561+0000 7f566e1ee640 1 Processor -- start 2024-04-25T02:08:30.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.561+0000 7f566e1ee640 1 -- start start 2024-04-25T02:08:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.561+0000 7f566e1ee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56680b41b0 0x7f56681605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.561+0000 7f566e1ee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f566806b770 0x7f5668156610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.562+0000 7f566e1ee640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5668071cd0 con 0x7f566806b2f0 2024-04-25T02:08:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.562+0000 7f566e1ee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5668156b50 con 0x7f566806b770 2024-04-25T02:08:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.562+0000 7f566e1ee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5668071fb0 con 0x7f56680b41b0 2024-04-25T02:08:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.562+0000 7f5667fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f566806b770 0x7f5668156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.562+0000 7f5666ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f566806b2f0 0x7f5668155f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58560/0 (socket says 172.21.15.79:58560) 2024-04-25T02:08:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.562+0000 7f5666ffd640 1 -- 172.21.15.79:0/787421876 learned_addr learned my addr 172.21.15.79:0/787421876 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.562+0000 7f56677fe640 1 --2- 172.21.15.79:0/787421876 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56680b41b0 0x7f56681605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.562+0000 7f5667fff640 1 -- 172.21.15.79:0/787421876 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56680b41b0 msgr2=0x7f56681605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.562+0000 7f5667fff640 1 --2- 172.21.15.79:0/787421876 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56680b41b0 0x7f56681605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.562+0000 7f5667fff640 1 -- 172.21.15.79:0/787421876 >> v1:172.21.15.79:6789/0 conn(0x7f566806b2f0 legacy=0x7f5668155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.562+0000 7f5667fff640 1 -- 172.21.15.79:0/787421876 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5668072290 con 0x7f566806b770 2024-04-25T02:08:30.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.562+0000 7f56667fc640 1 -- 172.21.15.79:0/787421876 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2678911563 0 0) 0x7f5668071cd0 con 0x7f566806b2f0 2024-04-25T02:08:30.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.562+0000 7f56677fe640 1 --2- 172.21.15.79:0/787421876 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56680b41b0 0x7f56681605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:30.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.563+0000 7f5667fff640 1 --2- 172.21.15.79:0/787421876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566806b770 0x7f5668156610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5660009d90 tx=0x7f566002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ff42fd67127289 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:30.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.563+0000 7f56667fc640 1 -- 172.21.15.79:0/787421876 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660007740 con 0x7f566806b770 2024-04-25T02:08:30.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.563+0000 7f56667fc640 1 -- 172.21.15.79:0/787421876 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56600078e0 con 0x7f566806b770 2024-04-25T02:08:30.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.563+0000 7f56667fc640 1 -- 172.21.15.79:0/787421876 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660007cb0 con 0x7f566806b770 2024-04-25T02:08:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.563+0000 7f566e1ee640 1 -- 172.21.15.79:0/787421876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566806b770 msgr2=0x7f5668156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.563+0000 7f566e1ee640 1 --2- 172.21.15.79:0/787421876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566806b770 0x7f5668156610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5660009d90 tx=0x7f566002a660 comp rx=0 tx=0).stop 2024-04-25T02:08:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.563+0000 7f566e1ee640 1 -- 172.21.15.79:0/787421876 shutdown_connections 2024-04-25T02:08:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.563+0000 7f566e1ee640 1 --2- 172.21.15.79:0/787421876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566806b770 0x7f5668156610 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.563+0000 7f566e1ee640 1 --2- 172.21.15.79:0/787421876 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56680b41b0 0x7f56681605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.563+0000 7f566e1ee640 1 -- 172.21.15.79:0/787421876 >> 172.21.15.79:0/787421876 conn(0x7f56680b1cd0 msgr2=0x7f56680b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.563+0000 7f566e1ee640 1 -- 172.21.15.79:0/787421876 shutdown_connections 2024-04-25T02:08:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.563+0000 7f566e1ee640 1 -- 172.21.15.79:0/787421876 wait complete. 2024-04-25T02:08:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.565+0000 7f566e1ee640 1 Processor -- start 2024-04-25T02:08:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.565+0000 7f566e1ee640 1 -- start start 2024-04-25T02:08:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.565+0000 7f566e1ee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f566806b2f0 0x7f56681f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.565+0000 7f566e1ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566806b770 0x7f566809c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.565+0000 7f566e1ee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56680b41b0 0x7f56680ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.565+0000 7f566e1ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5668160b10 con 0x7f566806b770 2024-04-25T02:08:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.565+0000 7f566e1ee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f566806bbe0 con 0x7f566806b2f0 2024-04-25T02:08:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.565+0000 7f566e1ee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5668072d70 con 0x7f56680b41b0 2024-04-25T02:08:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.566+0000 7f5666ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566806b770 0x7f566809c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.566+0000 7f5666ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566806b770 0x7f566809c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59952/0 (socket says 172.21.15.79:59952) 2024-04-25T02:08:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.566+0000 7f5666ffd640 1 -- 172.21.15.79:0/1208859602 learned_addr learned my addr 172.21.15.79:0/1208859602 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.566+0000 7f5666ffd640 1 -- 172.21.15.79:0/1208859602 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56680b41b0 msgr2=0x7f56680ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.566+0000 7f5666ffd640 1 --2- 172.21.15.79:0/1208859602 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56680b41b0 0x7f56680ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.566+0000 7f5666ffd640 1 -- 172.21.15.79:0/1208859602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f566806b2f0 msgr2=0x7f56681f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.566+0000 7f5666ffd640 1 --2- 172.21.15.79:0/1208859602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f566806b2f0 0x7f56681f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.566+0000 7f5666ffd640 1 -- 172.21.15.79:0/1208859602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566809cb70 con 0x7f566806b770 2024-04-25T02:08:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.566+0000 7f5666ffd640 1 --2- 172.21.15.79:0/1208859602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566806b770 0x7f566809c270 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f565c00c4d0 tx=0x7f565c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.566+0000 7f564ffff640 1 -- 172.21.15.79:0/1208859602 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c018070 con 0x7f566806b770 2024-04-25T02:08:30.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.566+0000 7f564ffff640 1 -- 172.21.15.79:0/1208859602 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c007500 con 0x7f566806b770 2024-04-25T02:08:30.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.566+0000 7f566e1ee640 1 -- 172.21.15.79:0/1208859602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f566809ce50 con 0x7f566806b770 2024-04-25T02:08:30.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.566+0000 7f564ffff640 1 -- 172.21.15.79:0/1208859602 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c004a20 con 0x7f566806b770 2024-04-25T02:08:30.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.566+0000 7f566e1ee640 1 -- 172.21.15.79:0/1208859602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f566809d410 con 0x7f566806b770 2024-04-25T02:08:30.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.567+0000 7f566e1ee640 1 -- 172.21.15.79:0/1208859602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56680690a0 con 0x7f566806b770 2024-04-25T02:08:30.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.568+0000 7f564ffff640 1 -- 172.21.15.79:0/1208859602 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f565c01b070 con 0x7f566806b770 2024-04-25T02:08:30.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.568+0000 7f564ffff640 1 --2- 172.21.15.79:0/1208859602 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f565406be30 0x7f565406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.568+0000 7f564ffff640 1 -- 172.21.15.79:0/1208859602 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f565c08a1e0 con 0x7f566806b770 2024-04-25T02:08:30.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.568+0000 7f56677fe640 1 --2- 172.21.15.79:0/1208859602 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f565406be30 0x7f565406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.568+0000 7f56677fe640 1 --2- 172.21.15.79:0/1208859602 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f565406be30 0x7f565406e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5658006e80 tx=0x7f5658008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:30.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.572+0000 7f564ffff640 1 -- 172.21.15.79:0/1208859602 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f565c058b90 con 0x7f566806b770 2024-04-25T02:08:30.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.744+0000 7f566e1ee640 1 -- 172.21.15.79:0/1208859602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f56680ce280 con 0x7f566806b770 2024-04-25T02:08:30.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.745+0000 7f564ffff640 1 -- 172.21.15.79:0/1208859602 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f565c058490 con 0x7f566806b770 2024-04-25T02:08:30.752 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:08:30.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.747+0000 7f566e1ee640 1 -- 172.21.15.79:0/1208859602 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f565406be30 msgr2=0x7f565406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.747+0000 7f566e1ee640 1 --2- 172.21.15.79:0/1208859602 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f565406be30 0x7f565406e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5658006e80 tx=0x7f5658008040 comp rx=0 tx=0).stop 2024-04-25T02:08:30.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.747+0000 7f566e1ee640 1 -- 172.21.15.79:0/1208859602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566806b770 msgr2=0x7f566809c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.747+0000 7f566e1ee640 1 --2- 172.21.15.79:0/1208859602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566806b770 0x7f566809c270 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f565c00c4d0 tx=0x7f565c00c990 comp rx=0 tx=0).stop 2024-04-25T02:08:30.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.747+0000 7f566e1ee640 1 -- 172.21.15.79:0/1208859602 shutdown_connections 2024-04-25T02:08:30.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.747+0000 7f566e1ee640 1 --2- 172.21.15.79:0/1208859602 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f565406be30 0x7f565406e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.747+0000 7f566e1ee640 1 --2- 172.21.15.79:0/1208859602 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56680b41b0 0x7f56680ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.747+0000 7f566e1ee640 1 --2- 172.21.15.79:0/1208859602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566806b770 0x7f566809c270 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.747+0000 7f566e1ee640 1 --2- 172.21.15.79:0/1208859602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f566806b2f0 0x7f56681f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.747+0000 7f566e1ee640 1 -- 172.21.15.79:0/1208859602 >> 172.21.15.79:0/1208859602 conn(0x7f56680b1cd0 msgr2=0x7f56680af820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:30.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.747+0000 7f566e1ee640 1 -- 172.21.15.79:0/1208859602 shutdown_connections 2024-04-25T02:08:30.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.747+0000 7f566e1ee640 1 -- 172.21.15.79:0/1208859602 wait complete. 2024-04-25T02:08:30.764 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:08:30.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.855+0000 7f930bb90640 1 Processor -- start 2024-04-25T02:08:30.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.855+0000 7f930bb90640 1 -- start start 2024-04-25T02:08:30.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.856+0000 7f930bb90640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9304143bc0 0x7f930415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.856+0000 7f930bb90640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f930406df50 0x7f930406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.856+0000 7f930bb90640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f930415fa40 con 0x7f93040b48e0 2024-04-25T02:08:30.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.856+0000 7f930bb90640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f930406e8f0 con 0x7f930406df50 2024-04-25T02:08:30.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.856+0000 7f930bb90640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9304072cb0 con 0x7f9304143bc0 2024-04-25T02:08:30.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.856+0000 7f930912b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f930406df50 0x7f930406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.856+0000 7f930992c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9304143bc0 0x7f930415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.856+0000 7f930a12d640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f93040b48e0 0x7f93040b4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:41176/0 (socket says 172.21.15.79:41176) 2024-04-25T02:08:30.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.856+0000 7f930912b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f930406df50 0x7f930406e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:47812/0 (socket says 172.21.15.79:47812) 2024-04-25T02:08:30.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.856+0000 7f930a12d640 1 -- 172.21.15.79:0/2027540198 learned_addr learned my addr 172.21.15.79:0/2027540198 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:30.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.857+0000 7f930912b640 1 -- 172.21.15.79:0/2027540198 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9304143bc0 msgr2=0x7f930415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:30.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.857+0000 7f930912b640 1 --2- 172.21.15.79:0/2027540198 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9304143bc0 0x7f930415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.857+0000 7f930912b640 1 -- 172.21.15.79:0/2027540198 >> v1:172.21.15.189:6789/0 conn(0x7f93040b48e0 legacy=0x7f93040b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.857+0000 7f930912b640 1 -- 172.21.15.79:0/2027540198 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93040720a0 con 0x7f930406df50 2024-04-25T02:08:30.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.857+0000 7f930992c640 1 --2- 172.21.15.79:0/2027540198 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9304143bc0 0x7f930415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:30.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.857+0000 7f930912b640 1 --2- 172.21.15.79:0/2027540198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f930406df50 0x7f930406e3b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f92f40097a0 tx=0x7f92f402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f734fb5c11f48c4d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:30.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.858+0000 7f930892a640 1 -- 172.21.15.79:0/2027540198 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4037070 con 0x7f930406df50 2024-04-25T02:08:30.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.858+0000 7f930892a640 1 -- 172.21.15.79:0/2027540198 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f402ae50 con 0x7f930406df50 2024-04-25T02:08:30.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.858+0000 7f930892a640 1 -- 172.21.15.79:0/2027540198 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4032660 con 0x7f930406df50 2024-04-25T02:08:30.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.858+0000 7f930bb90640 1 -- 172.21.15.79:0/2027540198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f930406df50 msgr2=0x7f930406e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.858+0000 7f930bb90640 1 --2- 172.21.15.79:0/2027540198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f930406df50 0x7f930406e3b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f92f40097a0 tx=0x7f92f402a100 comp rx=0 tx=0).stop 2024-04-25T02:08:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.858+0000 7f930bb90640 1 -- 172.21.15.79:0/2027540198 shutdown_connections 2024-04-25T02:08:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.858+0000 7f930bb90640 1 --2- 172.21.15.79:0/2027540198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f930406df50 0x7f930406e3b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.858+0000 7f930bb90640 1 --2- 172.21.15.79:0/2027540198 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9304143bc0 0x7f930415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.858+0000 7f930bb90640 1 -- 172.21.15.79:0/2027540198 >> 172.21.15.79:0/2027540198 conn(0x7f93040cfc80 msgr2=0x7f93040d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.858+0000 7f930bb90640 1 -- 172.21.15.79:0/2027540198 shutdown_connections 2024-04-25T02:08:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.858+0000 7f930bb90640 1 -- 172.21.15.79:0/2027540198 wait complete. 2024-04-25T02:08:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.859+0000 7f930bb90640 1 Processor -- start 2024-04-25T02:08:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.859+0000 7f930bb90640 1 -- start start 2024-04-25T02:08:30.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.860+0000 7f930bb90640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f930406df50 0x7f930415bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.860+0000 7f930bb90640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93040b48e0 0x7f930413e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.860+0000 7f930bb90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9304143bc0 0x7f930413eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.860+0000 7f930bb90640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9304072940 con 0x7f9304143bc0 2024-04-25T02:08:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.860+0000 7f930bb90640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9304072660 con 0x7f930406df50 2024-04-25T02:08:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.860+0000 7f930bb90640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9304143fa0 con 0x7f93040b48e0 2024-04-25T02:08:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.860+0000 7f930a12d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9304143bc0 0x7f930413eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.860+0000 7f930a12d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9304143bc0 0x7f930413eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59968/0 (socket says 172.21.15.79:59968) 2024-04-25T02:08:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.860+0000 7f930a12d640 1 -- 172.21.15.79:0/2805377074 learned_addr learned my addr 172.21.15.79:0/2805377074 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.860+0000 7f930992c640 1 --2- 172.21.15.79:0/2805377074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f930406df50 0x7f930415bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.860+0000 7f930912b640 1 --2- 172.21.15.79:0/2805377074 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93040b48e0 0x7f930413e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.861+0000 7f930a12d640 1 -- 172.21.15.79:0/2805377074 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93040b48e0 msgr2=0x7f930413e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.861+0000 7f930a12d640 1 --2- 172.21.15.79:0/2805377074 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93040b48e0 0x7f930413e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.861+0000 7f930a12d640 1 -- 172.21.15.79:0/2805377074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f930406df50 msgr2=0x7f930415bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.861+0000 7f930a12d640 1 --2- 172.21.15.79:0/2805377074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f930406df50 0x7f930415bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.861+0000 7f930a12d640 1 -- 172.21.15.79:0/2805377074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930415c150 con 0x7f9304143bc0 2024-04-25T02:08:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.861+0000 7f930a12d640 1 --2- 172.21.15.79:0/2805377074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9304143bc0 0x7f930413eb90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00cab0 tx=0x7f92fc00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.861+0000 7f92fa7fc640 1 -- 172.21.15.79:0/2805377074 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc017070 con 0x7f9304143bc0 2024-04-25T02:08:30.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.861+0000 7f92fa7fc640 1 -- 172.21.15.79:0/2805377074 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92fc00ac30 con 0x7f9304143bc0 2024-04-25T02:08:30.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.861+0000 7f930bb90640 1 -- 172.21.15.79:0/2805377074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9304142d60 con 0x7f9304143bc0 2024-04-25T02:08:30.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.861+0000 7f92fa7fc640 1 -- 172.21.15.79:0/2805377074 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc012400 con 0x7f9304143bc0 2024-04-25T02:08:30.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.861+0000 7f930bb90640 1 -- 172.21.15.79:0/2805377074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9304143320 con 0x7f9304143bc0 2024-04-25T02:08:30.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.862+0000 7f930bb90640 1 -- 172.21.15.79:0/2805377074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93040690a0 con 0x7f9304143bc0 2024-04-25T02:08:30.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.862+0000 7f92fa7fc640 1 -- 172.21.15.79:0/2805377074 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92fc01a070 con 0x7f9304143bc0 2024-04-25T02:08:30.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.863+0000 7f92fa7fc640 1 --2- 172.21.15.79:0/2805377074 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f92e806be30 0x7f92e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.863+0000 7f92fa7fc640 1 -- 172.21.15.79:0/2805377074 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f92fc08aa00 con 0x7f9304143bc0 2024-04-25T02:08:30.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.863+0000 7f930992c640 1 --2- 172.21.15.79:0/2805377074 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f92e806be30 0x7f92e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.863+0000 7f930992c640 1 --2- 172.21.15.79:0/2805377074 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f92e806be30 0x7f92e806e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f930413f540 tx=0x7f9300009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:30.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:30.867+0000 7f92fa7fc640 1 -- 172.21.15.79:0/2805377074 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f930415fa40 con 0x7f9304143bc0 2024-04-25T02:08:31.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.051+0000 7f930bb90640 1 -- 172.21.15.79:0/2805377074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f93040cf250 con 0x7f9304143bc0 2024-04-25T02:08:31.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.051+0000 7f92fa7fc640 1 -- 172.21.15.79:0/2805377074 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f92fc058d60 con 0x7f9304143bc0 2024-04-25T02:08:31.058 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-04-25T02:08:31.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.053+0000 7f930bb90640 1 -- 172.21.15.79:0/2805377074 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f92e806be30 msgr2=0x7f92e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:31.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.053+0000 7f930bb90640 1 --2- 172.21.15.79:0/2805377074 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f92e806be30 0x7f92e806e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f930413f540 tx=0x7f9300009190 comp rx=0 tx=0).stop 2024-04-25T02:08:31.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.053+0000 7f930bb90640 1 -- 172.21.15.79:0/2805377074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9304143bc0 msgr2=0x7f930413eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:31.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.053+0000 7f930bb90640 1 --2- 172.21.15.79:0/2805377074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9304143bc0 0x7f930413eb90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00cab0 tx=0x7f92fc00cf70 comp rx=0 tx=0).stop 2024-04-25T02:08:31.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.053+0000 7f930bb90640 1 -- 172.21.15.79:0/2805377074 shutdown_connections 2024-04-25T02:08:31.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.053+0000 7f930bb90640 1 --2- 172.21.15.79:0/2805377074 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f92e806be30 0x7f92e806e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.053+0000 7f930bb90640 1 --2- 172.21.15.79:0/2805377074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9304143bc0 0x7f930413eb90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.053+0000 7f930bb90640 1 --2- 172.21.15.79:0/2805377074 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93040b48e0 0x7f930413e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.053+0000 7f930bb90640 1 --2- 172.21.15.79:0/2805377074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f930406df50 0x7f930415bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.053+0000 7f930bb90640 1 -- 172.21.15.79:0/2805377074 >> 172.21.15.79:0/2805377074 conn(0x7f93040cfc80 msgr2=0x7f93040b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:31.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.053+0000 7f930bb90640 1 -- 172.21.15.79:0/2805377074 shutdown_connections 2024-04-25T02:08:31.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.053+0000 7f930bb90640 1 -- 172.21.15.79:0/2805377074 wait complete. 2024-04-25T02:08:31.071 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T02:08:31.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:31.071 DEBUG:teuthology.orchestra.run.smithi189:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-25T02:08:31.101 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi189.front.sepia.ceph.com 2024-04-25T02:08:31.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:31.102 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T02:08:31.167 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:08:31.167 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:31.183 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:08:31.183 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:31.238 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:08:31.238 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:31.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:31.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.425+0000 7f8f30909640 1 Processor -- start 2024-04-25T02:08:31.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.425+0000 7f8f30909640 1 -- start start 2024-04-25T02:08:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.425+0000 7f8f30909640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2c15e4d0 0x7f8f2c06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.425+0000 7f8f30909640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8f2c0b3570 0x7f8f2c0d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.425+0000 7f8f30909640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f2c0d1660 con 0x7f8f2c0b3020 2024-04-25T02:08:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.425+0000 7f8f30909640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f8f2c0d1380 con 0x7f8f2c0b3570 2024-04-25T02:08:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.425+0000 7f8f30909640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2c0cede0 con 0x7f8f2c15e4d0 2024-04-25T02:08:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f2ad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8f2c0b3020 0x7f8f2c0cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58574/0 (socket says 172.21.15.79:58574) 2024-04-25T02:08:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f2ad9d640 1 -- 172.21.15.79:0/3845038597 learned_addr learned my addr 172.21.15.79:0/3845038597 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f23fff640 1 --2- 172.21.15.79:0/3845038597 >> v2:172.21.15.189:3300/0 conn(0x7f8f2c0b3570 0x7f8f2c0d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 -- 172.21.15.79:0/3845038597 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3050655438 0 0) 0x7f8f2c0d1660 con 0x7f8f2c0b3020 2024-04-25T02:08:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f2a59c640 1 --2- 172.21.15.79:0/3845038597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2c15e4d0 0x7f8f2c06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 -- 172.21.15.79:0/3845038597 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f18003520 con 0x7f8f2c0b3020 2024-04-25T02:08:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 -- 172.21.15.79:0/3845038597 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3369169900 0 0) 0x7f8f18003520 con 0x7f8f2c0b3020 2024-04-25T02:08:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 -- 172.21.15.79:0/3845038597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2c15e4d0 msgr2=0x7f8f2c06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 --2- 172.21.15.79:0/3845038597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2c15e4d0 0x7f8f2c06bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 -- 172.21.15.79:0/3845038597 >> v2:172.21.15.189:3300/0 conn(0x7f8f2c0b3570 msgr2=0x7f8f2c0d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 --2- 172.21.15.79:0/3845038597 >> v2:172.21.15.189:3300/0 conn(0x7f8f2c0b3570 0x7f8f2c0d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 -- 172.21.15.79:0/3845038597 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2c0cf0c0 con 0x7f8f2c0b3020 2024-04-25T02:08:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 -- 172.21.15.79:0/3845038597 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f8f240019f0 con 0x7f8f2c0b3020 2024-04-25T02:08:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 -- 172.21.15.79:0/3845038597 >> v1:172.21.15.79:6789/0 conn(0x7f8f2c0b3020 legacy=0x7f8f2c0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 --2- 172.21.15.79:0/3845038597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f180039b0 0x7f8f18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 --2- 172.21.15.79:0/3845038597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f18004800 0x7f8f18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 --2- 172.21.15.79:0/3845038597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2c15e4d0 0x7f8f180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 -- 172.21.15.79:0/3845038597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c0d1380 con 0x7f8f180039b0 2024-04-25T02:08:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 -- 172.21.15.79:0/3845038597 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c0cede0 con 0x7f8f18004800 2024-04-25T02:08:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f29d9b640 1 -- 172.21.15.79:0/3845038597 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1800b9c0 con 0x7f8f2c15e4d0 2024-04-25T02:08:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f2a59c640 1 --2- 172.21.15.79:0/3845038597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f180039b0 0x7f8f18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f23fff640 1 --2- 172.21.15.79:0/3845038597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f18004800 0x7f8f18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.426+0000 7f8f2ad9d640 1 --2- 172.21.15.79:0/3845038597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2c15e4d0 0x7f8f180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.427+0000 7f8f2a59c640 1 -- 172.21.15.79:0/3845038597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2c15e4d0 msgr2=0x7f8f180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.427+0000 7f8f2a59c640 1 --2- 172.21.15.79:0/3845038597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2c15e4d0 0x7f8f180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.427+0000 7f8f2a59c640 1 -- 172.21.15.79:0/3845038597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f18004800 msgr2=0x7f8f18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.427+0000 7f8f2a59c640 1 --2- 172.21.15.79:0/3845038597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f18004800 0x7f8f18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.427+0000 7f8f2a59c640 1 -- 172.21.15.79:0/3845038597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f18003520 con 0x7f8f180039b0 2024-04-25T02:08:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.427+0000 7f8f2a59c640 1 --2- 172.21.15.79:0/3845038597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f180039b0 0x7f8f18003dd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009ac0 tx=0x7f8f18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc2d71c44678bf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.427+0000 7f8f29d9b640 1 -- 172.21.15.79:0/3845038597 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c036070 con 0x7f8f180039b0 2024-04-25T02:08:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.427+0000 7f8f29d9b640 1 -- 172.21.15.79:0/3845038597 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1c031400 con 0x7f8f180039b0 2024-04-25T02:08:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.427+0000 7f8f29d9b640 1 -- 172.21.15.79:0/3845038597 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c009690 con 0x7f8f180039b0 2024-04-25T02:08:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.428+0000 7f8f30909640 1 -- 172.21.15.79:0/3845038597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f180039b0 msgr2=0x7f8f18003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.428+0000 7f8f30909640 1 --2- 172.21.15.79:0/3845038597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f180039b0 0x7f8f18003dd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009ac0 tx=0x7f8f18005830 comp rx=0 tx=0).stop 2024-04-25T02:08:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.428+0000 7f8f2ad9d640 1 -- 172.21.15.79:0/3845038597 reap_dead start 2024-04-25T02:08:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.428+0000 7f8f30909640 1 -- 172.21.15.79:0/3845038597 shutdown_connections 2024-04-25T02:08:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.428+0000 7f8f30909640 1 -- 172.21.15.79:0/3845038597 >> 172.21.15.79:0/3845038597 conn(0x7f8f2c09d460 msgr2=0x7f8f2c0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:31.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.428+0000 7f8f30909640 1 -- 172.21.15.79:0/3845038597 shutdown_connections 2024-04-25T02:08:31.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.428+0000 7f8f30909640 1 -- 172.21.15.79:0/3845038597 wait complete. 2024-04-25T02:08:31.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.429+0000 7f8f30909640 1 Processor -- start 2024-04-25T02:08:31.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.429+0000 7f8f30909640 1 -- start start 2024-04-25T02:08:31.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.430+0000 7f8f30909640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f180039b0 0x7f8f2c15c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.430+0000 7f8f30909640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2c0a15d0 0x7f8f2c1f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.430+0000 7f8f30909640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f2c0a1a50 0x7f8f2c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.430+0000 7f8f30909640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c0d2250 con 0x7f8f2c0a15d0 2024-04-25T02:08:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.430+0000 7f8f30909640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c0d20d0 con 0x7f8f2c0a1a50 2024-04-25T02:08:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.430+0000 7f8f30909640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2c0cfcf0 con 0x7f8f180039b0 2024-04-25T02:08:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.430+0000 7f8f23fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2c0a15d0 0x7f8f2c1f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.430+0000 7f8f23fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2c0a15d0 0x7f8f2c1f5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59978/0 (socket says 172.21.15.79:59978) 2024-04-25T02:08:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.430+0000 7f8f23fff640 1 -- 172.21.15.79:0/4114798211 learned_addr learned my addr 172.21.15.79:0/4114798211 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.430+0000 7f8f23fff640 1 -- 172.21.15.79:0/4114798211 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f180039b0 msgr2=0x7f8f2c15c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.430+0000 7f8f23fff640 1 --2- 172.21.15.79:0/4114798211 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f180039b0 0x7f8f2c15c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.430+0000 7f8f23fff640 1 -- 172.21.15.79:0/4114798211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f2c0a1a50 msgr2=0x7f8f2c0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.430+0000 7f8f23fff640 1 --2- 172.21.15.79:0/4114798211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f2c0a1a50 0x7f8f2c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.430+0000 7f8f23fff640 1 -- 172.21.15.79:0/4114798211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2c15ce40 con 0x7f8f2c0a15d0 2024-04-25T02:08:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.431+0000 7f8f23fff640 1 --2- 172.21.15.79:0/4114798211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2c0a15d0 0x7f8f2c1f5210 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8f14011700 tx=0x7f8f14011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.431+0000 7f8f22ffd640 1 -- 172.21.15.79:0/4114798211 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1400f9c0 con 0x7f8f2c0a15d0 2024-04-25T02:08:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.431+0000 7f8f22ffd640 1 -- 172.21.15.79:0/4114798211 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1400fb60 con 0x7f8f2c0a15d0 2024-04-25T02:08:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.431+0000 7f8f30909640 1 -- 172.21.15.79:0/4114798211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2c09e990 con 0x7f8f2c0a15d0 2024-04-25T02:08:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.431+0000 7f8f22ffd640 1 -- 172.21.15.79:0/4114798211 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14015460 con 0x7f8f2c0a15d0 2024-04-25T02:08:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.431+0000 7f8f30909640 1 -- 172.21.15.79:0/4114798211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f2c09ef50 con 0x7f8f2c0a15d0 2024-04-25T02:08:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.432+0000 7f8f30909640 1 -- 172.21.15.79:0/4114798211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f2c0690a0 con 0x7f8f2c0a15d0 2024-04-25T02:08:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.432+0000 7f8f22ffd640 1 -- 172.21.15.79:0/4114798211 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f14015600 con 0x7f8f2c0a15d0 2024-04-25T02:08:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.433+0000 7f8f22ffd640 1 --2- 172.21.15.79:0/4114798211 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f0c06be30 0x7f8f0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.433+0000 7f8f22ffd640 1 -- 172.21.15.79:0/4114798211 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8f1408b770 con 0x7f8f2c0a15d0 2024-04-25T02:08:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.433+0000 7f8f2a59c640 1 --2- 172.21.15.79:0/4114798211 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f0c06be30 0x7f8f0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.433+0000 7f8f2a59c640 1 --2- 172.21.15.79:0/4114798211 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f0c06be30 0x7f8f0c06e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c033000 tx=0x7f8f1c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:31.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.437+0000 7f8f22ffd640 1 -- 172.21.15.79:0/4114798211 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8f14019030 con 0x7f8f2c0a15d0 2024-04-25T02:08:31.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.610+0000 7f8f30909640 1 -- 172.21.15.79:0/4114798211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f2c0d1920 con 0x7f8f2c0a15d0 2024-04-25T02:08:31.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.611+0000 7f8f22ffd640 1 -- 172.21.15.79:0/4114798211 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f8f1405a120 con 0x7f8f2c0a15d0 2024-04-25T02:08:31.618 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:31.618 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:31.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.613+0000 7f8f30909640 1 -- 172.21.15.79:0/4114798211 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f0c06be30 msgr2=0x7f8f0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:31.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.613+0000 7f8f30909640 1 --2- 172.21.15.79:0/4114798211 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f0c06be30 0x7f8f0c06e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c033000 tx=0x7f8f1c02e000 comp rx=0 tx=0).stop 2024-04-25T02:08:31.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.613+0000 7f8f30909640 1 -- 172.21.15.79:0/4114798211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2c0a15d0 msgr2=0x7f8f2c1f5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:31.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.613+0000 7f8f30909640 1 --2- 172.21.15.79:0/4114798211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2c0a15d0 0x7f8f2c1f5210 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8f14011700 tx=0x7f8f14011bc0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.613+0000 7f8f30909640 1 -- 172.21.15.79:0/4114798211 shutdown_connections 2024-04-25T02:08:31.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.613+0000 7f8f30909640 1 --2- 172.21.15.79:0/4114798211 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f0c06be30 0x7f8f0c06e2f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.613+0000 7f8f30909640 1 --2- 172.21.15.79:0/4114798211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f2c0a1a50 0x7f8f2c0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.613+0000 7f8f30909640 1 --2- 172.21.15.79:0/4114798211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2c0a15d0 0x7f8f2c1f5210 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.613+0000 7f8f30909640 1 --2- 172.21.15.79:0/4114798211 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f180039b0 0x7f8f2c15c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.613+0000 7f8f30909640 1 -- 172.21.15.79:0/4114798211 >> 172.21.15.79:0/4114798211 conn(0x7f8f2c09d460 msgr2=0x7f8f2c0d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:31.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.613+0000 7f8f30909640 1 -- 172.21.15.79:0/4114798211 shutdown_connections 2024-04-25T02:08:31.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.613+0000 7f8f30909640 1 -- 172.21.15.79:0/4114798211 wait complete. 2024-04-25T02:08:31.631 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:57.115253+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:58.421392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:08:31.631 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:08:31.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.723+0000 7f3fdcc88640 1 Processor -- start 2024-04-25T02:08:31.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.723+0000 7f3fdcc88640 1 -- start start 2024-04-25T02:08:31.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.724+0000 7f3fdcc88640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f3fd80d10c0 0x7f3fd806bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.724+0000 7f3fdcc88640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd80d1ee0 con 0x7f3fd80d2ca0 2024-04-25T02:08:31.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.724+0000 7f3fdcc88640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd80d21c0 con 0x7f3fd815e4f0 2024-04-25T02:08:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.724+0000 7f3fdcc88640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3fd80d3130 con 0x7f3fd80d10c0 2024-04-25T02:08:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.724+0000 7f3fd5d9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3fd80d2ca0 0x7f3fd80d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58578/0 (socket says 172.21.15.79:58578) 2024-04-25T02:08:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.724+0000 7f3fd5d9b640 1 -- 172.21.15.79:0/3525787248 learned_addr learned my addr 172.21.15.79:0/3525787248 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd6d9d640 1 --2- 172.21.15.79:0/3525787248 >> v2:172.21.15.189:3300/0 conn(0x7f3fd80d10c0 0x7f3fd806bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd559a640 1 -- 172.21.15.79:0/3525787248 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3474782061 0 0) 0x7f3fd80d1ee0 con 0x7f3fd80d2ca0 2024-04-25T02:08:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd559a640 1 -- 172.21.15.79:0/3525787248 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fc0003520 con 0x7f3fd80d2ca0 2024-04-25T02:08:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd559a640 1 -- 172.21.15.79:0/3525787248 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2867396553 0 0) 0x7f3fc0003520 con 0x7f3fd80d2ca0 2024-04-25T02:08:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd559a640 1 -- 172.21.15.79:0/3525787248 >> v2:172.21.15.189:3300/0 conn(0x7f3fd80d10c0 msgr2=0x7f3fd806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd559a640 1 --2- 172.21.15.79:0/3525787248 >> v2:172.21.15.189:3300/0 conn(0x7f3fd80d10c0 0x7f3fd806bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd559a640 1 -- 172.21.15.79:0/3525787248 >> v1:172.21.15.189:6789/0 conn(0x7f3fd815e4f0 legacy=0x7f3fd80cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd559a640 1 -- 172.21.15.79:0/3525787248 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd80d24a0 con 0x7f3fd80d2ca0 2024-04-25T02:08:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd559a640 1 -- 172.21.15.79:0/3525787248 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f3fcc001670 con 0x7f3fd80d2ca0 2024-04-25T02:08:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd559a640 1 -- 172.21.15.79:0/3525787248 >> v1:172.21.15.79:6789/0 conn(0x7f3fd80d2ca0 legacy=0x7f3fd80d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd559a640 1 --2- 172.21.15.79:0/3525787248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fc00039b0 0x7f3fc0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd559a640 1 --2- 172.21.15.79:0/3525787248 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3fc0004800 0x7f3fc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd559a640 1 --2- 172.21.15.79:0/3525787248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fc00051c0 0x7f3fc000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd559a640 1 -- 172.21.15.79:0/3525787248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc000c030 con 0x7f3fc00039b0 2024-04-25T02:08:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd559a640 1 -- 172.21.15.79:0/3525787248 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc000c1e0 con 0x7f3fc00051c0 2024-04-25T02:08:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd559a640 1 -- 172.21.15.79:0/3525787248 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc000c3e0 con 0x7f3fc0004800 2024-04-25T02:08:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd659c640 1 --2- 172.21.15.79:0/3525787248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fc00039b0 0x7f3fc0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd6d9d640 1 --2- 172.21.15.79:0/3525787248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fc00051c0 0x7f3fc000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd5d9b640 1 --2- 172.21.15.79:0/3525787248 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3fc0004800 0x7f3fc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd659c640 1 -- 172.21.15.79:0/3525787248 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3fc0004800 msgr2=0x7f3fc0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd659c640 1 --2- 172.21.15.79:0/3525787248 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3fc0004800 0x7f3fc0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd659c640 1 -- 172.21.15.79:0/3525787248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fc00051c0 msgr2=0x7f3fc000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd659c640 1 --2- 172.21.15.79:0/3525787248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fc00051c0 0x7f3fc000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd6d9d640 1 -- 172.21.15.79:0/3525787248 reap_dead start 2024-04-25T02:08:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.725+0000 7f3fd659c640 1 -- 172.21.15.79:0/3525787248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc0003520 con 0x7f3fc00039b0 2024-04-25T02:08:31.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.726+0000 7f3fd659c640 1 --2- 172.21.15.79:0/3525787248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fc00039b0 0x7f3fc0003dd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8001e50 tx=0x7f3fc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1a0ae3311cb38a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:31.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.726+0000 7f3fd559a640 1 -- 172.21.15.79:0/3525787248 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8001a70 con 0x7f3fc00039b0 2024-04-25T02:08:31.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.726+0000 7f3fd559a640 1 -- 172.21.15.79:0/3525787248 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc802ae40 con 0x7f3fc00039b0 2024-04-25T02:08:31.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.726+0000 7f3fd559a640 1 -- 172.21.15.79:0/3525787248 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8003bb0 con 0x7f3fc00039b0 2024-04-25T02:08:31.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.727+0000 7f3fdcc88640 1 -- 172.21.15.79:0/3525787248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fc00039b0 msgr2=0x7f3fc0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:31.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.727+0000 7f3fdcc88640 1 --2- 172.21.15.79:0/3525787248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fc00039b0 0x7f3fc0003dd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8001e50 tx=0x7f3fc0005830 comp rx=0 tx=0).stop 2024-04-25T02:08:31.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.727+0000 7f3fdcc88640 1 -- 172.21.15.79:0/3525787248 shutdown_connections 2024-04-25T02:08:31.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.727+0000 7f3fdcc88640 1 --2- 172.21.15.79:0/3525787248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fc00039b0 0x7f3fc0003dd0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.727+0000 7f3fdcc88640 1 -- 172.21.15.79:0/3525787248 >> 172.21.15.79:0/3525787248 conn(0x7f3fd809d4a0 msgr2=0x7f3fd80d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:31.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.727+0000 7f3fdcc88640 1 -- 172.21.15.79:0/3525787248 shutdown_connections 2024-04-25T02:08:31.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.727+0000 7f3fdcc88640 1 -- 172.21.15.79:0/3525787248 wait complete. 2024-04-25T02:08:31.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.728+0000 7f3fdcc88640 1 Processor -- start 2024-04-25T02:08:31.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.728+0000 7f3fdcc88640 1 -- start start 2024-04-25T02:08:31.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fdcc88640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3fc00039b0 0x7f3fd81f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fdcc88640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fd81f3fd0 0x7f3fd80b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fdcc88640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd815c3f0 0x7f3fd815c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fdcc88640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd80d5060 con 0x7f3fd81f3fd0 2024-04-25T02:08:31.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fdcc88640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd80d4ee0 con 0x7f3fd815c3f0 2024-04-25T02:08:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fdcc88640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3fd80d09b0 con 0x7f3fc00039b0 2024-04-25T02:08:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fd5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fd81f3fd0 0x7f3fd80b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fd5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fd81f3fd0 0x7f3fd80b8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59998/0 (socket says 172.21.15.79:59998) 2024-04-25T02:08:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fd5d9b640 1 -- 172.21.15.79:0/2634838454 learned_addr learned my addr 172.21.15.79:0/2634838454 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fd659c640 1 --2- 172.21.15.79:0/2634838454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3fc00039b0 0x7f3fd81f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fd6d9d640 1 --2- 172.21.15.79:0/2634838454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd815c3f0 0x7f3fd815c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fd5d9b640 1 -- 172.21.15.79:0/2634838454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3fc00039b0 msgr2=0x7f3fd81f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fd5d9b640 1 --2- 172.21.15.79:0/2634838454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3fc00039b0 0x7f3fd81f5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fd5d9b640 1 -- 172.21.15.79:0/2634838454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd815c3f0 msgr2=0x7f3fd815c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fd5d9b640 1 --2- 172.21.15.79:0/2634838454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd815c3f0 0x7f3fd815c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fd5d9b640 1 -- 172.21.15.79:0/2634838454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd81f5d80 con 0x7f3fd81f3fd0 2024-04-25T02:08:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fd659c640 1 --2- 172.21.15.79:0/2634838454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3fc00039b0 0x7f3fd81f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fd5d9b640 1 --2- 172.21.15.79:0/2634838454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fd81f3fd0 0x7f3fd80b8c00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc007290 tx=0x7f3fcc007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.729+0000 7f3fc6ffd640 1 -- 172.21.15.79:0/2634838454 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00f960 con 0x7f3fd81f3fd0 2024-04-25T02:08:31.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.730+0000 7f3fc6ffd640 1 -- 172.21.15.79:0/2634838454 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fcc018070 con 0x7f3fd81f3fd0 2024-04-25T02:08:31.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.730+0000 7f3fdcc88640 1 -- 172.21.15.79:0/2634838454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd80b7c40 con 0x7f3fd81f3fd0 2024-04-25T02:08:31.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.730+0000 7f3fc6ffd640 1 -- 172.21.15.79:0/2634838454 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00fd40 con 0x7f3fd81f3fd0 2024-04-25T02:08:31.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.730+0000 7f3fdcc88640 1 -- 172.21.15.79:0/2634838454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd80b70c0 con 0x7f3fd81f3fd0 2024-04-25T02:08:31.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.730+0000 7f3fdcc88640 1 -- 172.21.15.79:0/2634838454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd80686c0 con 0x7f3fd81f3fd0 2024-04-25T02:08:31.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.731+0000 7f3fc6ffd640 1 -- 172.21.15.79:0/2634838454 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3fcc01d460 con 0x7f3fd81f3fd0 2024-04-25T02:08:31.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.731+0000 7f3fc6ffd640 1 --2- 172.21.15.79:0/2634838454 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3fb806be60 0x7f3fb806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:31.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.731+0000 7f3fc6ffd640 1 -- 172.21.15.79:0/2634838454 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3fcc08af40 con 0x7f3fd81f3fd0 2024-04-25T02:08:31.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.731+0000 7f3fd659c640 1 --2- 172.21.15.79:0/2634838454 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3fb806be60 0x7f3fb806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:31.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.732+0000 7f3fd659c640 1 --2- 172.21.15.79:0/2634838454 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3fb806be60 0x7f3fb806e320 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8032000 tx=0x7f3fc802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:31.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.736+0000 7f3fc6ffd640 1 -- 172.21.15.79:0/2634838454 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3fcc0598f0 con 0x7f3fd81f3fd0 2024-04-25T02:08:31.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.907+0000 7f3fdcc88640 1 -- 172.21.15.79:0/2634838454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3fd80690a0 con 0x7f3fd81f3fd0 2024-04-25T02:08:31.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.907+0000 7f3fc6ffd640 1 -- 172.21.15.79:0/2634838454 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f3fcc0591f0 con 0x7f3fd81f3fd0 2024-04-25T02:08:31.914 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:08:31.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.909+0000 7f3fdcc88640 1 -- 172.21.15.79:0/2634838454 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3fb806be60 msgr2=0x7f3fb806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:31.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.909+0000 7f3fdcc88640 1 --2- 172.21.15.79:0/2634838454 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3fb806be60 0x7f3fb806e320 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8032000 tx=0x7f3fc802e000 comp rx=0 tx=0).stop 2024-04-25T02:08:31.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.909+0000 7f3fdcc88640 1 -- 172.21.15.79:0/2634838454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fd81f3fd0 msgr2=0x7f3fd80b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:31.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.909+0000 7f3fdcc88640 1 --2- 172.21.15.79:0/2634838454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fd81f3fd0 0x7f3fd80b8c00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc007290 tx=0x7f3fcc007750 comp rx=0 tx=0).stop 2024-04-25T02:08:31.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.909+0000 7f3fdcc88640 1 -- 172.21.15.79:0/2634838454 shutdown_connections 2024-04-25T02:08:31.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.909+0000 7f3fdcc88640 1 --2- 172.21.15.79:0/2634838454 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3fb806be60 0x7f3fb806e320 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.909+0000 7f3fdcc88640 1 --2- 172.21.15.79:0/2634838454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd815c3f0 0x7f3fd815c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.909+0000 7f3fdcc88640 1 --2- 172.21.15.79:0/2634838454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fd81f3fd0 0x7f3fd80b8c00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.909+0000 7f3fdcc88640 1 --2- 172.21.15.79:0/2634838454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3fc00039b0 0x7f3fd81f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:31.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.909+0000 7f3fdcc88640 1 -- 172.21.15.79:0/2634838454 >> 172.21.15.79:0/2634838454 conn(0x7f3fd809d4a0 msgr2=0x7f3fd80d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:31.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.909+0000 7f3fdcc88640 1 -- 172.21.15.79:0/2634838454 shutdown_connections 2024-04-25T02:08:31.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:31.909+0000 7f3fdcc88640 1 -- 172.21.15.79:0/2634838454 wait complete. 2024-04-25T02:08:31.927 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:08:32.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.019+0000 7f623d35a640 1 Processor -- start 2024-04-25T02:08:32.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.019+0000 7f623d35a640 1 -- start start 2024-04-25T02:08:32.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f623d35a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62380d0c80 0x7f62380cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f623d35a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f62380b3100 0x7f623815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f623d35a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62380cf7d0 con 0x7f62380d1060 2024-04-25T02:08:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f623d35a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f62380cfab0 con 0x7f62380b3100 2024-04-25T02:08:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f623d35a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f62380cfd90 con 0x7f62380d0c80 2024-04-25T02:08:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62377fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f62380d1060 0x7f62380d1f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58588/0 (socket says 172.21.15.79:58588) 2024-04-25T02:08:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62377fe640 1 -- 172.21.15.79:0/1888496866 learned_addr learned my addr 172.21.15.79:0/1888496866 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f6236ffd640 1 --2- 172.21.15.79:0/1888496866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62380d0c80 0x7f62380cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f622ffff640 1 --2- 172.21.15.79:0/1888496866 >> v2:172.21.15.189:3300/0 conn(0x7f62380b3100 0x7f623815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 -- 172.21.15.79:0/1888496866 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1990969045 0 0) 0x7f62380cf7d0 con 0x7f62380d1060 2024-04-25T02:08:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 -- 172.21.15.79:0/1888496866 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6224003520 con 0x7f62380d1060 2024-04-25T02:08:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 -- 172.21.15.79:0/1888496866 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1796849821 0 0) 0x7f6224003520 con 0x7f62380d1060 2024-04-25T02:08:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 -- 172.21.15.79:0/1888496866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62380d0c80 msgr2=0x7f62380cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 --2- 172.21.15.79:0/1888496866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62380d0c80 0x7f62380cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 -- 172.21.15.79:0/1888496866 >> v2:172.21.15.189:3300/0 conn(0x7f62380b3100 msgr2=0x7f623815e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 --2- 172.21.15.79:0/1888496866 >> v2:172.21.15.189:3300/0 conn(0x7f62380b3100 0x7f623815e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 -- 172.21.15.79:0/1888496866 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62380d0070 con 0x7f62380d1060 2024-04-25T02:08:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 -- 172.21.15.79:0/1888496866 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f62300019f0 con 0x7f62380d1060 2024-04-25T02:08:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 -- 172.21.15.79:0/1888496866 >> v1:172.21.15.79:6789/0 conn(0x7f62380d1060 legacy=0x7f62380d1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 --2- 172.21.15.79:0/1888496866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62240039b0 0x7f6224003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 --2- 172.21.15.79:0/1888496866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62380d0c80 0x7f6224004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 --2- 172.21.15.79:0/1888496866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6224004d40 0x7f62240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 -- 172.21.15.79:0/1888496866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f62380cfab0 con 0x7f6224004d40 2024-04-25T02:08:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 -- 172.21.15.79:0/1888496866 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f62380cfd90 con 0x7f62240039b0 2024-04-25T02:08:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.020+0000 7f62367fc640 1 -- 172.21.15.79:0/1888496866 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f622400b9c0 con 0x7f62380d0c80 2024-04-25T02:08:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.021+0000 7f62377fe640 1 --2- 172.21.15.79:0/1888496866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6224004d40 0x7f62240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.021+0000 7f622ffff640 1 --2- 172.21.15.79:0/1888496866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62380d0c80 0x7f6224004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.021+0000 7f6236ffd640 1 --2- 172.21.15.79:0/1888496866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62240039b0 0x7f6224003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.021+0000 7f62377fe640 1 -- 172.21.15.79:0/1888496866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62380d0c80 msgr2=0x7f6224004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.021+0000 7f62377fe640 1 --2- 172.21.15.79:0/1888496866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62380d0c80 0x7f6224004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.021+0000 7f62377fe640 1 -- 172.21.15.79:0/1888496866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62240039b0 msgr2=0x7f6224003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.021+0000 7f62377fe640 1 --2- 172.21.15.79:0/1888496866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62240039b0 0x7f6224003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.021+0000 7f62377fe640 1 -- 172.21.15.79:0/1888496866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6224003520 con 0x7f6224004d40 2024-04-25T02:08:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.021+0000 7f6236ffd640 1 --2- 172.21.15.79:0/1888496866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62240039b0 0x7f6224003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.021+0000 7f62377fe640 1 --2- 172.21.15.79:0/1888496866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6224004d40 0x7f62240051c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f623000a880 tx=0x7f6224005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee508f111c82d480 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.022+0000 7f62367fc640 1 -- 172.21.15.79:0/1888496866 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623000a4a0 con 0x7f6224004d40 2024-04-25T02:08:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.022+0000 7f62367fc640 1 -- 172.21.15.79:0/1888496866 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f623002f070 con 0x7f6224004d40 2024-04-25T02:08:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.022+0000 7f62367fc640 1 -- 172.21.15.79:0/1888496866 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623002bd00 con 0x7f6224004d40 2024-04-25T02:08:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.022+0000 7f623d35a640 1 -- 172.21.15.79:0/1888496866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6224004d40 msgr2=0x7f62240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.022+0000 7f623d35a640 1 --2- 172.21.15.79:0/1888496866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6224004d40 0x7f62240051c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f623000a880 tx=0x7f6224005830 comp rx=0 tx=0).stop 2024-04-25T02:08:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.022+0000 7f62377fe640 1 -- 172.21.15.79:0/1888496866 reap_dead start 2024-04-25T02:08:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.022+0000 7f623d35a640 1 -- 172.21.15.79:0/1888496866 shutdown_connections 2024-04-25T02:08:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.022+0000 7f623d35a640 1 -- 172.21.15.79:0/1888496866 >> 172.21.15.79:0/1888496866 conn(0x7f623809d3c0 msgr2=0x7f62380d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:32.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.022+0000 7f623d35a640 1 -- 172.21.15.79:0/1888496866 shutdown_connections 2024-04-25T02:08:32.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.022+0000 7f623d35a640 1 -- 172.21.15.79:0/1888496866 wait complete. 2024-04-25T02:08:32.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.023+0000 7f623d35a640 1 Processor -- start 2024-04-25T02:08:32.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.023+0000 7f623d35a640 1 -- start start 2024-04-25T02:08:32.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f623d35a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f623815b2e0 0x7f62380b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f623d35a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f623815b6c0 0x7f62381e43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f623d35a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62381e8790 0x7f62381e8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f623d35a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f623815e6e0 con 0x7f62381e8790 2024-04-25T02:08:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f623d35a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f62380b2340 con 0x7f623815b2e0 2024-04-25T02:08:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f623d35a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f623815e860 con 0x7f623815b6c0 2024-04-25T02:08:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f62377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62381e8790 0x7f62381e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f62377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62381e8790 0x7f62381e8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60010/0 (socket says 172.21.15.79:60010) 2024-04-25T02:08:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f62377fe640 1 -- 172.21.15.79:0/3073025195 learned_addr learned my addr 172.21.15.79:0/3073025195 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f622ffff640 1 --2- 172.21.15.79:0/3073025195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f623815b6c0 0x7f62381e43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f6236ffd640 1 --2- 172.21.15.79:0/3073025195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f623815b2e0 0x7f62380b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f62377fe640 1 -- 172.21.15.79:0/3073025195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f623815b6c0 msgr2=0x7f62381e43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f62377fe640 1 --2- 172.21.15.79:0/3073025195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f623815b6c0 0x7f62381e43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f62377fe640 1 -- 172.21.15.79:0/3073025195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f623815b2e0 msgr2=0x7f62380b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f62377fe640 1 --2- 172.21.15.79:0/3073025195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f623815b2e0 0x7f62380b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f62377fe640 1 -- 172.21.15.79:0/3073025195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62380b3b00 con 0x7f62381e8790 2024-04-25T02:08:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.024+0000 7f6236ffd640 1 --2- 172.21.15.79:0/3073025195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f623815b2e0 0x7f62380b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.025+0000 7f62377fe640 1 --2- 172.21.15.79:0/3073025195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62381e8790 0x7f62381e8c20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f623000a880 tx=0x7f62380cf9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.025+0000 7f622f7fe640 1 -- 172.21.15.79:0/3073025195 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623000a4a0 con 0x7f62381e8790 2024-04-25T02:08:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.025+0000 7f622f7fe640 1 -- 172.21.15.79:0/3073025195 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62300019e0 con 0x7f62381e8790 2024-04-25T02:08:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.025+0000 7f622f7fe640 1 -- 172.21.15.79:0/3073025195 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230001ff0 con 0x7f62381e8790 2024-04-25T02:08:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.025+0000 7f623d35a640 1 -- 172.21.15.79:0/3073025195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62381e48f0 con 0x7f62381e8790 2024-04-25T02:08:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.025+0000 7f623d35a640 1 -- 172.21.15.79:0/3073025195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62381e4e70 con 0x7f62381e8790 2024-04-25T02:08:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.026+0000 7f623d35a640 1 -- 172.21.15.79:0/3073025195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62380690a0 con 0x7f62381e8790 2024-04-25T02:08:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.026+0000 7f622f7fe640 1 -- 172.21.15.79:0/3073025195 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6230034670 con 0x7f62381e8790 2024-04-25T02:08:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.027+0000 7f622f7fe640 1 --2- 172.21.15.79:0/3073025195 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f621806be30 0x7f621806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.027+0000 7f622f7fe640 1 -- 172.21.15.79:0/3073025195 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f62300aae70 con 0x7f62381e8790 2024-04-25T02:08:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.027+0000 7f6236ffd640 1 --2- 172.21.15.79:0/3073025195 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f621806be30 0x7f621806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.027+0000 7f6236ffd640 1 --2- 172.21.15.79:0/3073025195 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f621806be30 0x7f621806e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6228009a50 tx=0x7f6228008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:32.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.031+0000 7f622f7fe640 1 -- 172.21.15.79:0/3073025195 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6230046060 con 0x7f62381e8790 2024-04-25T02:08:32.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.206+0000 7f623d35a640 1 -- 172.21.15.79:0/3073025195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f62380d4fa0 con 0x7f62381e8790 2024-04-25T02:08:32.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.207+0000 7f622f7fe640 1 -- 172.21.15.79:0/3073025195 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f62300798e0 con 0x7f62381e8790 2024-04-25T02:08:32.214 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:08:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.208+0000 7f623d35a640 1 -- 172.21.15.79:0/3073025195 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f621806be30 msgr2=0x7f621806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.208+0000 7f623d35a640 1 --2- 172.21.15.79:0/3073025195 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f621806be30 0x7f621806e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6228009a50 tx=0x7f6228008040 comp rx=0 tx=0).stop 2024-04-25T02:08:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.208+0000 7f623d35a640 1 -- 172.21.15.79:0/3073025195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62381e8790 msgr2=0x7f62381e8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.208+0000 7f623d35a640 1 --2- 172.21.15.79:0/3073025195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62381e8790 0x7f62381e8c20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f623000a880 tx=0x7f62380cf9a0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.208+0000 7f623d35a640 1 -- 172.21.15.79:0/3073025195 shutdown_connections 2024-04-25T02:08:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.208+0000 7f623d35a640 1 --2- 172.21.15.79:0/3073025195 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f621806be30 0x7f621806e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.208+0000 7f623d35a640 1 --2- 172.21.15.79:0/3073025195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62381e8790 0x7f62381e8c20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.208+0000 7f623d35a640 1 --2- 172.21.15.79:0/3073025195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f623815b6c0 0x7f62381e43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.208+0000 7f623d35a640 1 --2- 172.21.15.79:0/3073025195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f623815b2e0 0x7f62380b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.208+0000 7f623d35a640 1 -- 172.21.15.79:0/3073025195 >> 172.21.15.79:0/3073025195 conn(0x7f623809d3c0 msgr2=0x7f62380d1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:32.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.209+0000 7f623d35a640 1 -- 172.21.15.79:0/3073025195 shutdown_connections 2024-04-25T02:08:32.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.209+0000 7f623d35a640 1 -- 172.21.15.79:0/3073025195 wait complete. 2024-04-25T02:08:32.226 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:08:32.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.319+0000 7f8ca5770640 1 Processor -- start 2024-04-25T02:08:32.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.319+0000 7f8ca5770640 1 -- start start 2024-04-25T02:08:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.320+0000 7f8ca5770640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8ca015e4f0 0x7f8ca00d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.320+0000 7f8ca5770640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8ca00cf7f0 0x7f8ca00d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.320+0000 7f8ca5770640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca00d1ee0 con 0x7f8ca00cfc50 2024-04-25T02:08:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.320+0000 7f8ca5770640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f8ca00d21c0 con 0x7f8ca015e4f0 2024-04-25T02:08:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.320+0000 7f8ca5770640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca00d24a0 con 0x7f8ca00cf7f0 2024-04-25T02:08:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.320+0000 7f8c9f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8ca00cfc50 0x7f8ca006bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58602/0 (socket says 172.21.15.79:58602) 2024-04-25T02:08:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.320+0000 7f8c9f7fe640 1 -- 172.21.15.79:0/3771712056 learned_addr learned my addr 172.21.15.79:0/3771712056 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 -- 172.21.15.79:0/3771712056 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2450797544 0 0) 0x7f8ca00d1ee0 con 0x7f8ca00cfc50 2024-04-25T02:08:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9e7fc640 1 --2- 172.21.15.79:0/3771712056 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8ca00cf7f0 0x7f8ca00d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 -- 172.21.15.79:0/3771712056 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c88003520 con 0x7f8ca00cfc50 2024-04-25T02:08:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9effd640 1 --2- 172.21.15.79:0/3771712056 >> v2:172.21.15.189:3300/0 conn(0x7f8ca015e4f0 0x7f8ca00d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 -- 172.21.15.79:0/3771712056 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 228158174 0 0) 0x7f8c88003520 con 0x7f8ca00cfc50 2024-04-25T02:08:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 -- 172.21.15.79:0/3771712056 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8ca00cf7f0 msgr2=0x7f8ca00d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 --2- 172.21.15.79:0/3771712056 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8ca00cf7f0 0x7f8ca00d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 -- 172.21.15.79:0/3771712056 >> v2:172.21.15.189:3300/0 conn(0x7f8ca015e4f0 msgr2=0x7f8ca00d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 --2- 172.21.15.79:0/3771712056 >> v2:172.21.15.189:3300/0 conn(0x7f8ca015e4f0 0x7f8ca00d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 -- 172.21.15.79:0/3771712056 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca00d2780 con 0x7f8ca00cfc50 2024-04-25T02:08:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 -- 172.21.15.79:0/3771712056 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f8c98001670 con 0x7f8ca00cfc50 2024-04-25T02:08:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 -- 172.21.15.79:0/3771712056 >> v1:172.21.15.79:6789/0 conn(0x7f8ca00cfc50 legacy=0x7f8ca006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 --2- 172.21.15.79:0/3771712056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c880039b0 0x7f8c88003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 --2- 172.21.15.79:0/3771712056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c88004800 0x7f8c88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 --2- 172.21.15.79:0/3771712056 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8ca00cf7f0 0x7f8c880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 -- 172.21.15.79:0/3771712056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00d21c0 con 0x7f8c880039b0 2024-04-25T02:08:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 -- 172.21.15.79:0/3771712056 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00d24a0 con 0x7f8c88004800 2024-04-25T02:08:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9dffb640 1 -- 172.21.15.79:0/3771712056 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8c8800b9c0 con 0x7f8ca00cf7f0 2024-04-25T02:08:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9effd640 1 --2- 172.21.15.79:0/3771712056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c880039b0 0x7f8c88003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9e7fc640 1 --2- 172.21.15.79:0/3771712056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c88004800 0x7f8c88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9f7fe640 1 --2- 172.21.15.79:0/3771712056 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8ca00cf7f0 0x7f8c880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9effd640 1 -- 172.21.15.79:0/3771712056 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8ca00cf7f0 msgr2=0x7f8c880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9effd640 1 --2- 172.21.15.79:0/3771712056 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8ca00cf7f0 0x7f8c880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9effd640 1 -- 172.21.15.79:0/3771712056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c88004800 msgr2=0x7f8c88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9effd640 1 --2- 172.21.15.79:0/3771712056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c88004800 0x7f8c88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9effd640 1 -- 172.21.15.79:0/3771712056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c88003520 con 0x7f8c880039b0 2024-04-25T02:08:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.321+0000 7f8c9e7fc640 1 --2- 172.21.15.79:0/3771712056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c88004800 0x7f8c88004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.322+0000 7f8c9effd640 1 --2- 172.21.15.79:0/3771712056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c880039b0 0x7f8c88003dd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009fc0 tx=0x7f8c88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a803683e4f7870 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.322+0000 7f8c9dffb640 1 -- 172.21.15.79:0/3771712056 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90009c10 con 0x7f8c880039b0 2024-04-25T02:08:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.322+0000 7f8c9dffb640 1 -- 172.21.15.79:0/3771712056 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c90036070 con 0x7f8c880039b0 2024-04-25T02:08:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.322+0000 7f8c9dffb640 1 -- 172.21.15.79:0/3771712056 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9002d070 con 0x7f8c880039b0 2024-04-25T02:08:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.323+0000 7f8ca5770640 1 -- 172.21.15.79:0/3771712056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c880039b0 msgr2=0x7f8c88003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.323+0000 7f8ca5770640 1 --2- 172.21.15.79:0/3771712056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c880039b0 0x7f8c88003dd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009fc0 tx=0x7f8c88005830 comp rx=0 tx=0).stop 2024-04-25T02:08:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.323+0000 7f8c9f7fe640 1 -- 172.21.15.79:0/3771712056 reap_dead start 2024-04-25T02:08:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.323+0000 7f8ca5770640 1 -- 172.21.15.79:0/3771712056 shutdown_connections 2024-04-25T02:08:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.323+0000 7f8ca5770640 1 -- 172.21.15.79:0/3771712056 >> 172.21.15.79:0/3771712056 conn(0x7f8ca009d4a0 msgr2=0x7f8ca00d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.323+0000 7f8ca5770640 1 -- 172.21.15.79:0/3771712056 shutdown_connections 2024-04-25T02:08:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.323+0000 7f8ca5770640 1 -- 172.21.15.79:0/3771712056 wait complete. 2024-04-25T02:08:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.324+0000 7f8ca5770640 1 Processor -- start 2024-04-25T02:08:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.324+0000 7f8ca5770640 1 -- start start 2024-04-25T02:08:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8ca5770640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8c880039b0 0x7f8ca00c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8ca5770640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ca00cdd00 0x7f8ca00ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8ca5770640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca014afc0 0x7f8ca014b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8ca5770640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca006c340 con 0x7f8ca014afc0 2024-04-25T02:08:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8ca5770640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00d50f0 con 0x7f8ca00cdd00 2024-04-25T02:08:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8ca5770640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca006c4c0 con 0x7f8c880039b0 2024-04-25T02:08:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8c9f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca014afc0 0x7f8ca014b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8c9f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca014afc0 0x7f8ca014b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60032/0 (socket says 172.21.15.79:60032) 2024-04-25T02:08:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8c9f7fe640 1 -- 172.21.15.79:0/1135703769 learned_addr learned my addr 172.21.15.79:0/1135703769 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8c9effd640 1 --2- 172.21.15.79:0/1135703769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8c880039b0 0x7f8ca00c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8c9e7fc640 1 --2- 172.21.15.79:0/1135703769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ca00cdd00 0x7f8ca00ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8c9f7fe640 1 -- 172.21.15.79:0/1135703769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8c880039b0 msgr2=0x7f8ca00c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8c9f7fe640 1 --2- 172.21.15.79:0/1135703769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8c880039b0 0x7f8ca00c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8c9f7fe640 1 -- 172.21.15.79:0/1135703769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ca00cdd00 msgr2=0x7f8ca00ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8c9f7fe640 1 --2- 172.21.15.79:0/1135703769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ca00cdd00 0x7f8ca00ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8c9f7fe640 1 -- 172.21.15.79:0/1135703769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca00c8320 con 0x7f8ca014afc0 2024-04-25T02:08:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8c9f7fe640 1 --2- 172.21.15.79:0/1135703769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca014afc0 0x7f8ca014b440 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8ca008e440 tx=0x7f8c9800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8c877fe640 1 -- 172.21.15.79:0/1135703769 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98019070 con 0x7f8ca014afc0 2024-04-25T02:08:32.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8c877fe640 1 -- 172.21.15.79:0/1135703769 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c9800c5c0 con 0x7f8ca014afc0 2024-04-25T02:08:32.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8c877fe640 1 -- 172.21.15.79:0/1135703769 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800c9b0 con 0x7f8ca014afc0 2024-04-25T02:08:32.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.325+0000 7f8ca5770640 1 -- 172.21.15.79:0/1135703769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca00c8600 con 0x7f8ca014afc0 2024-04-25T02:08:32.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.326+0000 7f8ca5770640 1 -- 172.21.15.79:0/1135703769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca00c8bc0 con 0x7f8ca014afc0 2024-04-25T02:08:32.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.326+0000 7f8ca5770640 1 -- 172.21.15.79:0/1135703769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ca00686c0 con 0x7f8ca014afc0 2024-04-25T02:08:32.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.327+0000 7f8c877fe640 1 -- 172.21.15.79:0/1135703769 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c9801c070 con 0x7f8ca014afc0 2024-04-25T02:08:32.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.327+0000 7f8c877fe640 1 --2- 172.21.15.79:0/1135703769 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8c8c06be30 0x7f8c8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.327+0000 7f8c877fe640 1 -- 172.21.15.79:0/1135703769 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8c9808a1e0 con 0x7f8ca014afc0 2024-04-25T02:08:32.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.327+0000 7f8c9effd640 1 --2- 172.21.15.79:0/1135703769 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8c8c06be30 0x7f8c8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.328+0000 7f8c9effd640 1 --2- 172.21.15.79:0/1135703769 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8c8c06be30 0x7f8c8c06e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8c90035000 tx=0x7f8c9002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:32.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.332+0000 7f8c877fe640 1 -- 172.21.15.79:0/1135703769 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8c98058540 con 0x7f8ca014afc0 2024-04-25T02:08:32.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.505+0000 7f8ca5770640 1 -- 172.21.15.79:0/1135703769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8ca00690a0 con 0x7f8ca014afc0 2024-04-25T02:08:32.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.505+0000 7f8c877fe640 1 -- 172.21.15.79:0/1135703769 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f8c9805c840 con 0x7f8ca014afc0 2024-04-25T02:08:32.512 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:08:32.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.507+0000 7f8ca5770640 1 -- 172.21.15.79:0/1135703769 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8c8c06be30 msgr2=0x7f8c8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.507+0000 7f8ca5770640 1 --2- 172.21.15.79:0/1135703769 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8c8c06be30 0x7f8c8c06e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8c90035000 tx=0x7f8c9002f000 comp rx=0 tx=0).stop 2024-04-25T02:08:32.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.507+0000 7f8ca5770640 1 -- 172.21.15.79:0/1135703769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca014afc0 msgr2=0x7f8ca014b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.507+0000 7f8ca5770640 1 --2- 172.21.15.79:0/1135703769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca014afc0 0x7f8ca014b440 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8ca008e440 tx=0x7f8c9800eb90 comp rx=0 tx=0).stop 2024-04-25T02:08:32.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.507+0000 7f8ca5770640 1 -- 172.21.15.79:0/1135703769 shutdown_connections 2024-04-25T02:08:32.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.507+0000 7f8ca5770640 1 --2- 172.21.15.79:0/1135703769 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8c8c06be30 0x7f8c8c06e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.507+0000 7f8ca5770640 1 --2- 172.21.15.79:0/1135703769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca014afc0 0x7f8ca014b440 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.507+0000 7f8ca5770640 1 --2- 172.21.15.79:0/1135703769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ca00cdd00 0x7f8ca00ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.507+0000 7f8ca5770640 1 --2- 172.21.15.79:0/1135703769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8c880039b0 0x7f8ca00c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.507+0000 7f8ca5770640 1 -- 172.21.15.79:0/1135703769 >> 172.21.15.79:0/1135703769 conn(0x7f8ca009d4a0 msgr2=0x7f8ca006c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:32.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.507+0000 7f8ca5770640 1 -- 172.21.15.79:0/1135703769 shutdown_connections 2024-04-25T02:08:32.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.507+0000 7f8ca5770640 1 -- 172.21.15.79:0/1135703769 wait complete. 2024-04-25T02:08:32.525 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:08:32.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.616+0000 7f1e5275a640 1 Processor -- start 2024-04-25T02:08:32.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.616+0000 7f1e5275a640 1 -- start start 2024-04-25T02:08:32.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.616+0000 7f1e5275a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1e4c15e4d0 0x7f1e4c06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.616+0000 7f1e5275a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e4c0d1660 con 0x7f1e4c0b3570 2024-04-25T02:08:32.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.616+0000 7f1e5275a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e4c0d1380 con 0x7f1e4c0d2e20 2024-04-25T02:08:32.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.616+0000 7f1e5275a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f1e4c0cede0 con 0x7f1e4c15e4d0 2024-04-25T02:08:32.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4b7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1e4c0b3570 0x7f1e4c0d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58616/0 (socket says 172.21.15.79:58616) 2024-04-25T02:08:32.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4b7fe640 1 -- 172.21.15.79:0/3870691937 learned_addr learned my addr 172.21.15.79:0/3870691937 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:32.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4affd640 1 -- 172.21.15.79:0/3870691937 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 270159212 0 0) 0x7f1e4c0d1660 con 0x7f1e4c0b3570 2024-04-25T02:08:32.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4affd640 1 -- 172.21.15.79:0/3870691937 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e34003520 con 0x7f1e4c0b3570 2024-04-25T02:08:32.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4bfff640 1 --2- 172.21.15.79:0/3870691937 >> v2:172.21.15.189:3300/0 conn(0x7f1e4c15e4d0 0x7f1e4c06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4affd640 1 -- 172.21.15.79:0/3870691937 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1774111394 0 0) 0x7f1e34003520 con 0x7f1e4c0b3570 2024-04-25T02:08:32.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4affd640 1 -- 172.21.15.79:0/3870691937 >> v2:172.21.15.189:3300/0 conn(0x7f1e4c15e4d0 msgr2=0x7f1e4c06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:32.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4affd640 1 --2- 172.21.15.79:0/3870691937 >> v2:172.21.15.189:3300/0 conn(0x7f1e4c15e4d0 0x7f1e4c06bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4affd640 1 -- 172.21.15.79:0/3870691937 >> v1:172.21.15.189:6789/0 conn(0x7f1e4c0d2e20 legacy=0x7f1e4c0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4affd640 1 -- 172.21.15.79:0/3870691937 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c0cf0c0 con 0x7f1e4c0b3570 2024-04-25T02:08:32.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4affd640 1 -- 172.21.15.79:0/3870691937 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f1e40001670 con 0x7f1e4c0b3570 2024-04-25T02:08:32.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4affd640 1 -- 172.21.15.79:0/3870691937 >> v1:172.21.15.79:6789/0 conn(0x7f1e4c0b3570 legacy=0x7f1e4c0d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4affd640 1 --2- 172.21.15.79:0/3870691937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e340039b0 0x7f1e34003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4affd640 1 --2- 172.21.15.79:0/3870691937 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e34004800 0x7f1e34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4affd640 1 --2- 172.21.15.79:0/3870691937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e340051c0 0x7f1e3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4affd640 1 -- 172.21.15.79:0/3870691937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c0cede0 con 0x7f1e340039b0 2024-04-25T02:08:32.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4affd640 1 -- 172.21.15.79:0/3870691937 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3400c060 con 0x7f1e340051c0 2024-04-25T02:08:32.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4affd640 1 -- 172.21.15.79:0/3870691937 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1e3400c260 con 0x7f1e34004800 2024-04-25T02:08:32.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4bfff640 1 --2- 172.21.15.79:0/3870691937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e340039b0 0x7f1e34003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e50cf7640 1 --2- 172.21.15.79:0/3870691937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e340051c0 0x7f1e3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.617+0000 7f1e4b7fe640 1 --2- 172.21.15.79:0/3870691937 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e34004800 0x7f1e34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.618+0000 7f1e4bfff640 1 -- 172.21.15.79:0/3870691937 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e34004800 msgr2=0x7f1e34004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:32.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.618+0000 7f1e4bfff640 1 --2- 172.21.15.79:0/3870691937 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e34004800 0x7f1e34004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.618+0000 7f1e4bfff640 1 -- 172.21.15.79:0/3870691937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e340051c0 msgr2=0x7f1e3400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:32.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.618+0000 7f1e4bfff640 1 --2- 172.21.15.79:0/3870691937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e340051c0 0x7f1e3400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.618+0000 7f1e4bfff640 1 -- 172.21.15.79:0/3870691937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e34003520 con 0x7f1e340039b0 2024-04-25T02:08:32.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.618+0000 7f1e50cf7640 1 --2- 172.21.15.79:0/3870691937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e340051c0 0x7f1e3400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:32.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.618+0000 7f1e50cf7640 1 -- 172.21.15.79:0/3870691937 reap_dead start 2024-04-25T02:08:32.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.618+0000 7f1e4bfff640 1 --2- 172.21.15.79:0/3870691937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e340039b0 0x7f1e34003dd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009ac0 tx=0x7f1e34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6564b440575a8abf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:32.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.618+0000 7f1e4affd640 1 -- 172.21.15.79:0/3870691937 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c036070 con 0x7f1e340039b0 2024-04-25T02:08:32.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.618+0000 7f1e4affd640 1 -- 172.21.15.79:0/3870691937 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c031400 con 0x7f1e340039b0 2024-04-25T02:08:32.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.618+0000 7f1e4affd640 1 -- 172.21.15.79:0/3870691937 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c009690 con 0x7f1e340039b0 2024-04-25T02:08:32.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.619+0000 7f1e5275a640 1 -- 172.21.15.79:0/3870691937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e340039b0 msgr2=0x7f1e34003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.619+0000 7f1e5275a640 1 --2- 172.21.15.79:0/3870691937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e340039b0 0x7f1e34003dd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009ac0 tx=0x7f1e34005830 comp rx=0 tx=0).stop 2024-04-25T02:08:32.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.619+0000 7f1e5275a640 1 -- 172.21.15.79:0/3870691937 shutdown_connections 2024-04-25T02:08:32.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.619+0000 7f1e5275a640 1 --2- 172.21.15.79:0/3870691937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e340039b0 0x7f1e34003dd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.619+0000 7f1e5275a640 1 -- 172.21.15.79:0/3870691937 >> 172.21.15.79:0/3870691937 conn(0x7f1e4c09d460 msgr2=0x7f1e4c0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:32.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.619+0000 7f1e5275a640 1 -- 172.21.15.79:0/3870691937 shutdown_connections 2024-04-25T02:08:32.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.619+0000 7f1e5275a640 1 -- 172.21.15.79:0/3870691937 wait complete. 2024-04-25T02:08:32.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.620+0000 7f1e5275a640 1 Processor -- start 2024-04-25T02:08:32.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.620+0000 7f1e5275a640 1 -- start start 2024-04-25T02:08:32.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e5275a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e340039b0 0x7f1e4c14d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e5275a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e4c0cdbc0 0x7f1e4c14e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e5275a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e4c14e7b0 0x7f1e4c09ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e5275a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c0d2250 con 0x7f1e4c0cdbc0 2024-04-25T02:08:32.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e5275a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c0d20d0 con 0x7f1e4c14e7b0 2024-04-25T02:08:32.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e5275a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4c0b3020 con 0x7f1e340039b0 2024-04-25T02:08:32.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e4b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e4c0cdbc0 0x7f1e4c14e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e4b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e4c0cdbc0 0x7f1e4c14e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60058/0 (socket says 172.21.15.79:60058) 2024-04-25T02:08:32.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e4b7fe640 1 -- 172.21.15.79:0/278656796 learned_addr learned my addr 172.21.15.79:0/278656796 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:32.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e4bfff640 1 --2- 172.21.15.79:0/278656796 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e340039b0 0x7f1e4c14d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e50cf7640 1 --2- 172.21.15.79:0/278656796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e4c14e7b0 0x7f1e4c09ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e4b7fe640 1 -- 172.21.15.79:0/278656796 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e340039b0 msgr2=0x7f1e4c14d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e4b7fe640 1 --2- 172.21.15.79:0/278656796 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e340039b0 0x7f1e4c14d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e4b7fe640 1 -- 172.21.15.79:0/278656796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e4c14e7b0 msgr2=0x7f1e4c09ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e4b7fe640 1 --2- 172.21.15.79:0/278656796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e4c14e7b0 0x7f1e4c09ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.621+0000 7f1e4b7fe640 1 -- 172.21.15.79:0/278656796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c09e220 con 0x7f1e4c0cdbc0 2024-04-25T02:08:32.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.622+0000 7f1e4b7fe640 1 --2- 172.21.15.79:0/278656796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e4c0cdbc0 0x7f1e4c14e270 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000e800 tx=0x7f1e4000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:32.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.622+0000 7f1e48ff9640 1 -- 172.21.15.79:0/278656796 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000c8d0 con 0x7f1e4c0cdbc0 2024-04-25T02:08:32.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.622+0000 7f1e48ff9640 1 -- 172.21.15.79:0/278656796 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e40018070 con 0x7f1e4c0cdbc0 2024-04-25T02:08:32.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.622+0000 7f1e5275a640 1 -- 172.21.15.79:0/278656796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4c09e500 con 0x7f1e4c0cdbc0 2024-04-25T02:08:32.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.622+0000 7f1e48ff9640 1 -- 172.21.15.79:0/278656796 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000ccf0 con 0x7f1e4c0cdbc0 2024-04-25T02:08:32.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.622+0000 7f1e5275a640 1 -- 172.21.15.79:0/278656796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4c09eac0 con 0x7f1e4c0cdbc0 2024-04-25T02:08:32.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.623+0000 7f1e5275a640 1 -- 172.21.15.79:0/278656796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e4c0ca890 con 0x7f1e4c0cdbc0 2024-04-25T02:08:32.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.623+0000 7f1e48ff9640 1 -- 172.21.15.79:0/278656796 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e40013420 con 0x7f1e4c0cdbc0 2024-04-25T02:08:32.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.623+0000 7f1e48ff9640 1 --2- 172.21.15.79:0/278656796 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1e3806be60 0x7f1e3806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.624+0000 7f1e48ff9640 1 -- 172.21.15.79:0/278656796 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1e4008aab0 con 0x7f1e4c0cdbc0 2024-04-25T02:08:32.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.624+0000 7f1e4bfff640 1 --2- 172.21.15.79:0/278656796 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1e3806be60 0x7f1e3806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.624+0000 7f1e4bfff640 1 --2- 172.21.15.79:0/278656796 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1e3806be60 0x7f1e3806e320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c033000 tx=0x7f1e3c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:32.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.628+0000 7f1e48ff9640 1 -- 172.21.15.79:0/278656796 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1e4c0ca890 con 0x7f1e4c0cdbc0 2024-04-25T02:08:32.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.812+0000 7f1e5275a640 1 -- 172.21.15.79:0/278656796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1e4c0d1920 con 0x7f1e4c0cdbc0 2024-04-25T02:08:32.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.813+0000 7f1e48ff9640 1 -- 172.21.15.79:0/278656796 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f1e40022250 con 0x7f1e4c0cdbc0 2024-04-25T02:08:32.820 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-04-25T02:08:32.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.815+0000 7f1e5275a640 1 -- 172.21.15.79:0/278656796 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1e3806be60 msgr2=0x7f1e3806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.815+0000 7f1e5275a640 1 --2- 172.21.15.79:0/278656796 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1e3806be60 0x7f1e3806e320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c033000 tx=0x7f1e3c008030 comp rx=0 tx=0).stop 2024-04-25T02:08:32.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.815+0000 7f1e5275a640 1 -- 172.21.15.79:0/278656796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e4c0cdbc0 msgr2=0x7f1e4c14e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.815+0000 7f1e5275a640 1 --2- 172.21.15.79:0/278656796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e4c0cdbc0 0x7f1e4c14e270 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000e800 tx=0x7f1e4000ecc0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.815+0000 7f1e5275a640 1 -- 172.21.15.79:0/278656796 shutdown_connections 2024-04-25T02:08:32.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.815+0000 7f1e5275a640 1 --2- 172.21.15.79:0/278656796 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1e3806be60 0x7f1e3806e320 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.815+0000 7f1e5275a640 1 --2- 172.21.15.79:0/278656796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e4c14e7b0 0x7f1e4c09ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.815+0000 7f1e5275a640 1 --2- 172.21.15.79:0/278656796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e4c0cdbc0 0x7f1e4c14e270 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.815+0000 7f1e5275a640 1 --2- 172.21.15.79:0/278656796 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e340039b0 0x7f1e4c14d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.815+0000 7f1e5275a640 1 -- 172.21.15.79:0/278656796 >> 172.21.15.79:0/278656796 conn(0x7f1e4c09d460 msgr2=0x7f1e4c15bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:32.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.815+0000 7f1e5275a640 1 -- 172.21.15.79:0/278656796 shutdown_connections 2024-04-25T02:08:32.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:32.815+0000 7f1e5275a640 1 -- 172.21.15.79:0/278656796 wait complete. 2024-04-25T02:08:32.832 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-25T02:08:32.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:32.833 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-25T02:08:32.857 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:08:32.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:32.857 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-25T02:08:32.912 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:08:32.912 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:32.931 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:08:32.931 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:32.990 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:08:32.990 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:33.048 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.139+0000 7fa720fa2640 1 Processor -- start 2024-04-25T02:08:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.139+0000 7fa720fa2640 1 -- start start 2024-04-25T02:08:33.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.140+0000 7fa720fa2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa71c143bc0 0x7fa71c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.140+0000 7fa720fa2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c06df50 0x7fa71c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.140+0000 7fa720fa2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa71c15fa40 con 0x7fa71c0b48e0 2024-04-25T02:08:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.140+0000 7fa720fa2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa71c06e8f0 con 0x7fa71c143bc0 2024-04-25T02:08:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.140+0000 7fa720fa2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa71c072cb0 con 0x7fa71c06df50 2024-04-25T02:08:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.140+0000 7fa71a59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa71c143bc0 0x7fa71c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.140+0000 7fa71ad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa71c0b48e0 0x7fa71c0b4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58624/0 (socket says 172.21.15.79:58624) 2024-04-25T02:08:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.140+0000 7fa71ad9d640 1 -- 172.21.15.79:0/2708357511 learned_addr learned my addr 172.21.15.79:0/2708357511 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.140+0000 7fa719d9b640 1 --2- 172.21.15.79:0/2708357511 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c06df50 0x7fa71c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.140+0000 7fa71a59c640 1 -- 172.21.15.79:0/2708357511 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c06df50 msgr2=0x7fa71c06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.140+0000 7fa71a59c640 1 --2- 172.21.15.79:0/2708357511 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c06df50 0x7fa71c06e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.140+0000 7fa71a59c640 1 -- 172.21.15.79:0/2708357511 >> v1:172.21.15.79:6789/0 conn(0x7fa71c0b48e0 legacy=0x7fa71c0b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.140+0000 7fa71a59c640 1 -- 172.21.15.79:0/2708357511 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71c071e00 con 0x7fa71c143bc0 2024-04-25T02:08:33.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.140+0000 7fa71959a640 1 -- 172.21.15.79:0/2708357511 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2024448314 0 0) 0x7fa70c001110 con 0x7fa71c0b48e0 2024-04-25T02:08:33.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.141+0000 7fa71a59c640 1 --2- 172.21.15.79:0/2708357511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa71c143bc0 0x7fa71c15f500 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa714009d90 tx=0x7fa71402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab659dde8b8852 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:33.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.141+0000 7fa71959a640 1 -- 172.21.15.79:0/2708357511 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa714031600 con 0x7fa71c143bc0 2024-04-25T02:08:33.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.141+0000 7fa71959a640 1 -- 172.21.15.79:0/2708357511 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7140317a0 con 0x7fa71c143bc0 2024-04-25T02:08:33.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.141+0000 7fa71959a640 1 -- 172.21.15.79:0/2708357511 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa714031b70 con 0x7fa71c143bc0 2024-04-25T02:08:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.141+0000 7fa720fa2640 1 -- 172.21.15.79:0/2708357511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa71c143bc0 msgr2=0x7fa71c15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.141+0000 7fa720fa2640 1 --2- 172.21.15.79:0/2708357511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa71c143bc0 0x7fa71c15f500 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa714009d90 tx=0x7fa71402a5d0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.141+0000 7fa720fa2640 1 -- 172.21.15.79:0/2708357511 shutdown_connections 2024-04-25T02:08:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.141+0000 7fa720fa2640 1 --2- 172.21.15.79:0/2708357511 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c06df50 0x7fa71c06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.141+0000 7fa720fa2640 1 --2- 172.21.15.79:0/2708357511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa71c143bc0 0x7fa71c15f500 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.141+0000 7fa720fa2640 1 -- 172.21.15.79:0/2708357511 >> 172.21.15.79:0/2708357511 conn(0x7fa71c0cfc80 msgr2=0x7fa71c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.141+0000 7fa720fa2640 1 -- 172.21.15.79:0/2708357511 shutdown_connections 2024-04-25T02:08:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.141+0000 7fa720fa2640 1 -- 172.21.15.79:0/2708357511 wait complete. 2024-04-25T02:08:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.143+0000 7fa720fa2640 1 Processor -- start 2024-04-25T02:08:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.143+0000 7fa720fa2640 1 -- start start 2024-04-25T02:08:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.143+0000 7fa720fa2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa71c06df50 0x7fa71c156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.143+0000 7fa720fa2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa71c0b48e0 0x7fa71c0aa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.143+0000 7fa720fa2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c143bc0 0x7fa71c0af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.143+0000 7fa720fa2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c072660 con 0x7fa71c06df50 2024-04-25T02:08:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.143+0000 7fa720fa2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c072380 con 0x7fa71c0b48e0 2024-04-25T02:08:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.143+0000 7fa720fa2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa71c072940 con 0x7fa71c143bc0 2024-04-25T02:08:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa71a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa71c06df50 0x7fa71c156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa71a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa71c06df50 0x7fa71c156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60074/0 (socket says 172.21.15.79:60074) 2024-04-25T02:08:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa71a59c640 1 -- 172.21.15.79:0/1854062846 learned_addr learned my addr 172.21.15.79:0/1854062846 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa71ad9d640 1 --2- 172.21.15.79:0/1854062846 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c143bc0 0x7fa71c0af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa719d9b640 1 --2- 172.21.15.79:0/1854062846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa71c0b48e0 0x7fa71c0aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa71a59c640 1 -- 172.21.15.79:0/1854062846 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c143bc0 msgr2=0x7fa71c0af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa71a59c640 1 --2- 172.21.15.79:0/1854062846 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c143bc0 0x7fa71c0af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa71a59c640 1 -- 172.21.15.79:0/1854062846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa71c0b48e0 msgr2=0x7fa71c0aa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa71a59c640 1 --2- 172.21.15.79:0/1854062846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa71c0b48e0 0x7fa71c0aa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa71a59c640 1 -- 172.21.15.79:0/1854062846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71c159420 con 0x7fa71c06df50 2024-04-25T02:08:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa71ad9d640 1 --2- 172.21.15.79:0/1854062846 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c143bc0 0x7fa71c0af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa71a59c640 1 --2- 172.21.15.79:0/1854062846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa71c06df50 0x7fa71c156ac0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa714009d90 tx=0x7fa714004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa712ffd640 1 -- 172.21.15.79:0/1854062846 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa714040070 con 0x7fa71c06df50 2024-04-25T02:08:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa712ffd640 1 -- 172.21.15.79:0/1854062846 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa714030be0 con 0x7fa71c06df50 2024-04-25T02:08:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa720fa2640 1 -- 172.21.15.79:0/1854062846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa71c159700 con 0x7fa71c06df50 2024-04-25T02:08:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa712ffd640 1 -- 172.21.15.79:0/1854062846 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa714009450 con 0x7fa71c06df50 2024-04-25T02:08:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.144+0000 7fa720fa2640 1 -- 172.21.15.79:0/1854062846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa71c159cc0 con 0x7fa71c06df50 2024-04-25T02:08:33.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.145+0000 7fa720fa2640 1 -- 172.21.15.79:0/1854062846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa71c0690a0 con 0x7fa71c06df50 2024-04-25T02:08:33.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.146+0000 7fa712ffd640 1 -- 172.21.15.79:0/1854062846 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa714039040 con 0x7fa71c06df50 2024-04-25T02:08:33.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.146+0000 7fa712ffd640 1 --2- 172.21.15.79:0/1854062846 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa6fc06be30 0x7fa6fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.146+0000 7fa719d9b640 1 --2- 172.21.15.79:0/1854062846 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa6fc06be30 0x7fa6fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.146+0000 7fa712ffd640 1 -- 172.21.15.79:0/1854062846 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa7140ac2d0 con 0x7fa71c06df50 2024-04-25T02:08:33.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.147+0000 7fa719d9b640 1 --2- 172.21.15.79:0/1854062846 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa6fc06be30 0x7fa6fc06e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa704006fd0 tx=0x7fa704008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:33.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.150+0000 7fa712ffd640 1 -- 172.21.15.79:0/1854062846 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa71407a630 con 0x7fa71c06df50 2024-04-25T02:08:33.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.328+0000 7fa720fa2640 1 -- 172.21.15.79:0/1854062846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa71c15e5b0 con 0x7fa71c06df50 2024-04-25T02:08:33.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.329+0000 7fa712ffd640 1 -- 172.21.15.79:0/1854062846 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7fa71407e930 con 0x7fa71c06df50 2024-04-25T02:08:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:33.336 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:33.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.331+0000 7fa720fa2640 1 -- 172.21.15.79:0/1854062846 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa6fc06be30 msgr2=0x7fa6fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.331+0000 7fa720fa2640 1 --2- 172.21.15.79:0/1854062846 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa6fc06be30 0x7fa6fc06e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa704006fd0 tx=0x7fa704008040 comp rx=0 tx=0).stop 2024-04-25T02:08:33.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.331+0000 7fa720fa2640 1 -- 172.21.15.79:0/1854062846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa71c06df50 msgr2=0x7fa71c156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.331+0000 7fa720fa2640 1 --2- 172.21.15.79:0/1854062846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa71c06df50 0x7fa71c156ac0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa714009d90 tx=0x7fa714004a40 comp rx=0 tx=0).stop 2024-04-25T02:08:33.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.331+0000 7fa720fa2640 1 -- 172.21.15.79:0/1854062846 shutdown_connections 2024-04-25T02:08:33.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.331+0000 7fa720fa2640 1 --2- 172.21.15.79:0/1854062846 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa6fc06be30 0x7fa6fc06e2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.331+0000 7fa720fa2640 1 --2- 172.21.15.79:0/1854062846 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c143bc0 0x7fa71c0af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.331+0000 7fa720fa2640 1 --2- 172.21.15.79:0/1854062846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa71c0b48e0 0x7fa71c0aa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.331+0000 7fa720fa2640 1 --2- 172.21.15.79:0/1854062846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa71c06df50 0x7fa71c156ac0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.331+0000 7fa720fa2640 1 -- 172.21.15.79:0/1854062846 >> 172.21.15.79:0/1854062846 conn(0x7fa71c0cfc80 msgr2=0x7fa71c143fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:33.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.331+0000 7fa720fa2640 1 -- 172.21.15.79:0/1854062846 shutdown_connections 2024-04-25T02:08:33.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.331+0000 7fa720fa2640 1 -- 172.21.15.79:0/1854062846 wait complete. 2024-04-25T02:08:33.349 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:57.115253+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:58.421392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:08:33.349 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:08:33.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.441+0000 7fa8abd63640 1 Processor -- start 2024-04-25T02:08:33.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.442+0000 7fa8abd63640 1 -- start start 2024-04-25T02:08:33.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.442+0000 7fa8abd63640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a415e4f0 0x7fa8a40d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.442+0000 7fa8abd63640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa8a40d10c0 0x7fa8a406bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.442+0000 7fa8abd63640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8a40d1ee0 con 0x7fa8a40cf7f0 2024-04-25T02:08:33.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.442+0000 7fa8abd63640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fa8a40d21c0 con 0x7fa8a40d10c0 2024-04-25T02:08:33.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.442+0000 7fa8abd63640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa8a40d24a0 con 0x7fa8a415e4f0 2024-04-25T02:08:33.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.443+0000 7fa8aa300640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa8a40d10c0 0x7fa8a406bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.443+0000 7fa8a9aff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a415e4f0 0x7fa8a40d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.443+0000 7fa8aa300640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa8a40d10c0 0x7fa8a406bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:47992/0 (socket says 172.21.15.79:47992) 2024-04-25T02:08:33.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.443+0000 7fa8a92fe640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fa8a40cf7f0 0x7fa8a40d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:41200/0 (socket says 172.21.15.79:41200) 2024-04-25T02:08:33.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.443+0000 7fa8aa300640 1 -- 172.21.15.79:0/218794850 learned_addr learned my addr 172.21.15.79:0/218794850 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:33.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.443+0000 7fa8a9aff640 1 -- 172.21.15.79:0/218794850 >> v2:172.21.15.189:3300/0 conn(0x7fa8a40d10c0 msgr2=0x7fa8a406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:33.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.443+0000 7fa8a9aff640 1 --2- 172.21.15.79:0/218794850 >> v2:172.21.15.189:3300/0 conn(0x7fa8a40d10c0 0x7fa8a406bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.443+0000 7fa8a9aff640 1 -- 172.21.15.79:0/218794850 >> v1:172.21.15.189:6789/0 conn(0x7fa8a40cf7f0 legacy=0x7fa8a40d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.443+0000 7fa8a9aff640 1 -- 172.21.15.79:0/218794850 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a40d2780 con 0x7fa8a415e4f0 2024-04-25T02:08:33.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.443+0000 7fa8aa300640 1 --2- 172.21.15.79:0/218794850 >> v2:172.21.15.189:3300/0 conn(0x7fa8a40d10c0 0x7fa8a406bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:33.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.444+0000 7fa8a9aff640 1 --2- 172.21.15.79:0/218794850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a415e4f0 0x7fa8a40d2ca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa8940097a0 tx=0x7fa89402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce4da90d5ff82a82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:33.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.444+0000 7fa8a8afd640 1 -- 172.21.15.79:0/218794850 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa894037070 con 0x7fa8a415e4f0 2024-04-25T02:08:33.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.444+0000 7fa8a8afd640 1 -- 172.21.15.79:0/218794850 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa894032440 con 0x7fa8a415e4f0 2024-04-25T02:08:33.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.444+0000 7fa8a8afd640 1 -- 172.21.15.79:0/218794850 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa894032810 con 0x7fa8a415e4f0 2024-04-25T02:08:33.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.445+0000 7fa8abd63640 1 -- 172.21.15.79:0/218794850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a415e4f0 msgr2=0x7fa8a40d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.445+0000 7fa8abd63640 1 --2- 172.21.15.79:0/218794850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a415e4f0 0x7fa8a40d2ca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa8940097a0 tx=0x7fa89402a180 comp rx=0 tx=0).stop 2024-04-25T02:08:33.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.445+0000 7fa8abd63640 1 -- 172.21.15.79:0/218794850 shutdown_connections 2024-04-25T02:08:33.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.445+0000 7fa8abd63640 1 --2- 172.21.15.79:0/218794850 >> v2:172.21.15.189:3300/0 conn(0x7fa8a40d10c0 0x7fa8a406bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.445+0000 7fa8abd63640 1 --2- 172.21.15.79:0/218794850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a415e4f0 0x7fa8a40d2ca0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.445+0000 7fa8abd63640 1 -- 172.21.15.79:0/218794850 >> 172.21.15.79:0/218794850 conn(0x7fa8a409d4a0 msgr2=0x7fa8a40d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:33.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.445+0000 7fa8abd63640 1 -- 172.21.15.79:0/218794850 shutdown_connections 2024-04-25T02:08:33.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.445+0000 7fa8abd63640 1 -- 172.21.15.79:0/218794850 wait complete. 2024-04-25T02:08:33.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.446+0000 7fa8abd63640 1 Processor -- start 2024-04-25T02:08:33.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.446+0000 7fa8abd63640 1 -- start start 2024-04-25T02:08:33.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8abd63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a40cf7f0 0x7fa8a414c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8abd63640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8a40d10c0 0x7fa8a414cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8abd63640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a415e4f0 0x7fa8a4152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8abd63640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a40cfc50 con 0x7fa8a40cf7f0 2024-04-25T02:08:33.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8abd63640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a40d50f0 con 0x7fa8a40d10c0 2024-04-25T02:08:33.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8abd63640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa8a40cfdd0 con 0x7fa8a415e4f0 2024-04-25T02:08:33.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8a9aff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a40cf7f0 0x7fa8a414c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8a9aff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a40cf7f0 0x7fa8a414c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60076/0 (socket says 172.21.15.79:60076) 2024-04-25T02:08:33.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8a9aff640 1 -- 172.21.15.79:0/1565462924 learned_addr learned my addr 172.21.15.79:0/1565462924 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:33.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8a92fe640 1 --2- 172.21.15.79:0/1565462924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8a40d10c0 0x7fa8a414cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8aa300640 1 --2- 172.21.15.79:0/1565462924 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a415e4f0 0x7fa8a4152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8a9aff640 1 -- 172.21.15.79:0/1565462924 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a415e4f0 msgr2=0x7fa8a4152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8a9aff640 1 --2- 172.21.15.79:0/1565462924 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a415e4f0 0x7fa8a4152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8a9aff640 1 -- 172.21.15.79:0/1565462924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8a40d10c0 msgr2=0x7fa8a414cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8a9aff640 1 --2- 172.21.15.79:0/1565462924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8a40d10c0 0x7fa8a414cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8a9aff640 1 -- 172.21.15.79:0/1565462924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a414c810 con 0x7fa8a40cf7f0 2024-04-25T02:08:33.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8aa300640 1 --2- 172.21.15.79:0/1565462924 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a415e4f0 0x7fa8a4152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:33.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8a9aff640 1 --2- 172.21.15.79:0/1565462924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a40cf7f0 0x7fa8a414c2d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa894000c00 tx=0x7fa8940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:33.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa89a7fc640 1 -- 172.21.15.79:0/1565462924 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa894037040 con 0x7fa8a40cf7f0 2024-04-25T02:08:33.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa89a7fc640 1 -- 172.21.15.79:0/1565462924 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa894042070 con 0x7fa8a40cf7f0 2024-04-25T02:08:33.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa89a7fc640 1 -- 172.21.15.79:0/1565462924 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa894030920 con 0x7fa8a40cf7f0 2024-04-25T02:08:33.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8abd63640 1 -- 172.21.15.79:0/1565462924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a414d570 con 0x7fa8a40cf7f0 2024-04-25T02:08:33.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.447+0000 7fa8abd63640 1 -- 172.21.15.79:0/1565462924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a414db30 con 0x7fa8a40cf7f0 2024-04-25T02:08:33.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.448+0000 7fa8abd63640 1 -- 172.21.15.79:0/1565462924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a40686c0 con 0x7fa8a40cf7f0 2024-04-25T02:08:33.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.449+0000 7fa89a7fc640 1 -- 172.21.15.79:0/1565462924 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa894030ac0 con 0x7fa8a40cf7f0 2024-04-25T02:08:33.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.449+0000 7fa89a7fc640 1 --2- 172.21.15.79:0/1565462924 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa88806be30 0x7fa88806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.449+0000 7fa89a7fc640 1 -- 172.21.15.79:0/1565462924 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa8940ab780 con 0x7fa8a40cf7f0 2024-04-25T02:08:33.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.449+0000 7fa8a92fe640 1 --2- 172.21.15.79:0/1565462924 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa88806be30 0x7fa88806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.450+0000 7fa8a92fe640 1 --2- 172.21.15.79:0/1565462924 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa88806be30 0x7fa88806e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa8a41588c0 tx=0x7fa8a0007c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:33.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.454+0000 7fa89a7fc640 1 -- 172.21.15.79:0/1565462924 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa894079ae0 con 0x7fa8a40cf7f0 2024-04-25T02:08:33.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.624+0000 7fa8abd63640 1 -- 172.21.15.79:0/1565462924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa8a40b4d80 con 0x7fa8a40cf7f0 2024-04-25T02:08:33.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.625+0000 7fa89a7fc640 1 -- 172.21.15.79:0/1565462924 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fa89407dde0 con 0x7fa8a40cf7f0 2024-04-25T02:08:33.632 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:08:33.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.626+0000 7fa8abd63640 1 -- 172.21.15.79:0/1565462924 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa88806be30 msgr2=0x7fa88806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.626+0000 7fa8abd63640 1 --2- 172.21.15.79:0/1565462924 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa88806be30 0x7fa88806e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa8a41588c0 tx=0x7fa8a0007c80 comp rx=0 tx=0).stop 2024-04-25T02:08:33.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.626+0000 7fa8abd63640 1 -- 172.21.15.79:0/1565462924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a40cf7f0 msgr2=0x7fa8a414c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.626+0000 7fa8abd63640 1 --2- 172.21.15.79:0/1565462924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a40cf7f0 0x7fa8a414c2d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa894000c00 tx=0x7fa8940046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.627+0000 7fa8abd63640 1 -- 172.21.15.79:0/1565462924 shutdown_connections 2024-04-25T02:08:33.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.627+0000 7fa8abd63640 1 --2- 172.21.15.79:0/1565462924 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa88806be30 0x7fa88806e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.627+0000 7fa8abd63640 1 --2- 172.21.15.79:0/1565462924 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a415e4f0 0x7fa8a4152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.627+0000 7fa8abd63640 1 --2- 172.21.15.79:0/1565462924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8a40d10c0 0x7fa8a414cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.627+0000 7fa8abd63640 1 --2- 172.21.15.79:0/1565462924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a40cf7f0 0x7fa8a414c2d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.627+0000 7fa8abd63640 1 -- 172.21.15.79:0/1565462924 >> 172.21.15.79:0/1565462924 conn(0x7fa8a409d4a0 msgr2=0x7fa8a415a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:33.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.627+0000 7fa8abd63640 1 -- 172.21.15.79:0/1565462924 shutdown_connections 2024-04-25T02:08:33.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.627+0000 7fa8abd63640 1 -- 172.21.15.79:0/1565462924 wait complete. 2024-04-25T02:08:33.644 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:08:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.736+0000 7f088be72640 1 Processor -- start 2024-04-25T02:08:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.736+0000 7f088be72640 1 -- start start 2024-04-25T02:08:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.737+0000 7f088be72640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f088415e3b0 0x7f08840721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.737+0000 7f088be72640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f088406fdd0 0x7f088406c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.737+0000 7f088be72640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f088406ca10 con 0x7f088406c600 2024-04-25T02:08:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.737+0000 7f088be72640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f0884161e80 con 0x7f088415e3b0 2024-04-25T02:08:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.737+0000 7f088be72640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f088415e790 con 0x7f088406fdd0 2024-04-25T02:08:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.737+0000 7f0889c0e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f088415e3b0 0x7f08840721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.737+0000 7f0889c0e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f088415e3b0 0x7f08840721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47162/0 (socket says 172.21.15.79:47162) 2024-04-25T02:08:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.737+0000 7f0889c0e640 1 -- 172.21.15.79:0/3970210890 learned_addr learned my addr 172.21.15.79:0/3970210890 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.737+0000 7f088940d640 1 --2- 172.21.15.79:0/3970210890 >> v2:172.21.15.189:3300/0 conn(0x7f088406fdd0 0x7f088406c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.737+0000 7f0889c0e640 1 -- 172.21.15.79:0/3970210890 >> v2:172.21.15.189:3300/0 conn(0x7f088406fdd0 msgr2=0x7f088406c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.737+0000 7f0889c0e640 1 --2- 172.21.15.79:0/3970210890 >> v2:172.21.15.189:3300/0 conn(0x7f088406fdd0 0x7f088406c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.737+0000 7f0889c0e640 1 -- 172.21.15.79:0/3970210890 >> v1:172.21.15.189:6789/0 conn(0x7f088406c600 legacy=0x7f08840cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.738+0000 7f0889c0e640 1 -- 172.21.15.79:0/3970210890 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08841620d0 con 0x7f088415e3b0 2024-04-25T02:08:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.738+0000 7f0889c0e640 1 --2- 172.21.15.79:0/3970210890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f088415e3b0 0x7f08840721a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f088406d680 tx=0x7f088002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5836b42afe037683 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.738+0000 7f0888c0c640 1 -- 172.21.15.79:0/3970210890 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880036070 con 0x7f088415e3b0 2024-04-25T02:08:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.738+0000 7f0888c0c640 1 -- 172.21.15.79:0/3970210890 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0880031600 con 0x7f088415e3b0 2024-04-25T02:08:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.738+0000 7f0888c0c640 1 -- 172.21.15.79:0/3970210890 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08800319d0 con 0x7f088415e3b0 2024-04-25T02:08:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.739+0000 7f088be72640 1 -- 172.21.15.79:0/3970210890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f088415e3b0 msgr2=0x7f08840721a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.739+0000 7f088be72640 1 --2- 172.21.15.79:0/3970210890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f088415e3b0 0x7f08840721a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f088406d680 tx=0x7f088002a5d0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.739+0000 7f088be72640 1 -- 172.21.15.79:0/3970210890 shutdown_connections 2024-04-25T02:08:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.739+0000 7f088be72640 1 --2- 172.21.15.79:0/3970210890 >> v2:172.21.15.189:3300/0 conn(0x7f088406fdd0 0x7f088406c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.739+0000 7f088be72640 1 --2- 172.21.15.79:0/3970210890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f088415e3b0 0x7f08840721a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.739+0000 7f088be72640 1 -- 172.21.15.79:0/3970210890 >> 172.21.15.79:0/3970210890 conn(0x7f08840716b0 msgr2=0x7f0884071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.739+0000 7f088be72640 1 -- 172.21.15.79:0/3970210890 shutdown_connections 2024-04-25T02:08:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.739+0000 7f088be72640 1 -- 172.21.15.79:0/3970210890 wait complete. 2024-04-25T02:08:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.740+0000 7f088be72640 1 Processor -- start 2024-04-25T02:08:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.740+0000 7f088be72640 1 -- start start 2024-04-25T02:08:33.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f088be72640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f088406c600 0x7f08840cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f088be72640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f088406fdd0 0x7f088414cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f088be72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f088415e3b0 0x7f088414d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f088be72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0884162970 con 0x7f088415e3b0 2024-04-25T02:08:33.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f088be72640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0884162690 con 0x7f088406c600 2024-04-25T02:08:33.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f088be72640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f08840ca8a0 con 0x7f088406fdd0 2024-04-25T02:08:33.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f088a40f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f088415e3b0 0x7f088414d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f088a40f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f088415e3b0 0x7f088414d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47174/0 (socket says 172.21.15.79:47174) 2024-04-25T02:08:33.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f088a40f640 1 -- 172.21.15.79:0/3603350239 learned_addr learned my addr 172.21.15.79:0/3603350239 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:33.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f088940d640 1 --2- 172.21.15.79:0/3603350239 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f088406fdd0 0x7f088414cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f0889c0e640 1 --2- 172.21.15.79:0/3603350239 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f088406c600 0x7f08840cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f088a40f640 1 -- 172.21.15.79:0/3603350239 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f088406fdd0 msgr2=0x7f088414cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f088a40f640 1 --2- 172.21.15.79:0/3603350239 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f088406fdd0 0x7f088414cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f088a40f640 1 -- 172.21.15.79:0/3603350239 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f088406c600 msgr2=0x7f08840cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f088a40f640 1 --2- 172.21.15.79:0/3603350239 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f088406c600 0x7f08840cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f088a40f640 1 -- 172.21.15.79:0/3603350239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08840b40e0 con 0x7f088415e3b0 2024-04-25T02:08:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.741+0000 7f0889c0e640 1 --2- 172.21.15.79:0/3603350239 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f088406c600 0x7f08840cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.742+0000 7f088a40f640 1 --2- 172.21.15.79:0/3603350239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f088415e3b0 0x7f088414d140 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f087c00b410 tx=0x7f087c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.742+0000 7f087a7fc640 1 -- 172.21.15.79:0/3603350239 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c015030 con 0x7f088415e3b0 2024-04-25T02:08:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.742+0000 7f087a7fc640 1 -- 172.21.15.79:0/3603350239 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087c004020 con 0x7f088415e3b0 2024-04-25T02:08:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.742+0000 7f088be72640 1 -- 172.21.15.79:0/3603350239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08840b43c0 con 0x7f088415e3b0 2024-04-25T02:08:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.742+0000 7f087a7fc640 1 -- 172.21.15.79:0/3603350239 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c004410 con 0x7f088415e3b0 2024-04-25T02:08:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.742+0000 7f088be72640 1 -- 172.21.15.79:0/3603350239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08840b4980 con 0x7f088415e3b0 2024-04-25T02:08:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.743+0000 7f088be72640 1 -- 172.21.15.79:0/3603350239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f088415a120 con 0x7f088415e3b0 2024-04-25T02:08:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.743+0000 7f087a7fc640 1 -- 172.21.15.79:0/3603350239 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f087c018070 con 0x7f088415e3b0 2024-04-25T02:08:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.743+0000 7f087a7fc640 1 --2- 172.21.15.79:0/3603350239 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f086806be30 0x7f086806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.744+0000 7f087a7fc640 1 -- 172.21.15.79:0/3603350239 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f087c08a940 con 0x7f088415e3b0 2024-04-25T02:08:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.744+0000 7f0889c0e640 1 --2- 172.21.15.79:0/3603350239 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f086806be30 0x7f086806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.744+0000 7f0889c0e640 1 --2- 172.21.15.79:0/3603350239 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f086806be30 0x7f086806e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0880033000 tx=0x7f0880009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:33.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.748+0000 7f087a7fc640 1 -- 172.21.15.79:0/3603350239 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f088415a120 con 0x7f088415e3b0 2024-04-25T02:08:33.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.920+0000 7f088be72640 1 -- 172.21.15.79:0/3603350239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0884153cd0 con 0x7f088415e3b0 2024-04-25T02:08:33.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.921+0000 7f087a7fc640 1 -- 172.21.15.79:0/3603350239 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f087c0592f0 con 0x7f088415e3b0 2024-04-25T02:08:33.928 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:08:33.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.923+0000 7f088be72640 1 -- 172.21.15.79:0/3603350239 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f086806be30 msgr2=0x7f086806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.923+0000 7f088be72640 1 --2- 172.21.15.79:0/3603350239 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f086806be30 0x7f086806e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0880033000 tx=0x7f0880009000 comp rx=0 tx=0).stop 2024-04-25T02:08:33.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.923+0000 7f088be72640 1 -- 172.21.15.79:0/3603350239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f088415e3b0 msgr2=0x7f088414d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:33.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.923+0000 7f088be72640 1 --2- 172.21.15.79:0/3603350239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f088415e3b0 0x7f088414d140 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f087c00b410 tx=0x7f087c00b8d0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.923+0000 7f088be72640 1 -- 172.21.15.79:0/3603350239 shutdown_connections 2024-04-25T02:08:33.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.923+0000 7f088be72640 1 --2- 172.21.15.79:0/3603350239 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f086806be30 0x7f086806e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.923+0000 7f088be72640 1 --2- 172.21.15.79:0/3603350239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f088415e3b0 0x7f088414d140 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.923+0000 7f088be72640 1 --2- 172.21.15.79:0/3603350239 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f088406fdd0 0x7f088414cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.923+0000 7f088be72640 1 --2- 172.21.15.79:0/3603350239 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f088406c600 0x7f08840cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.923+0000 7f088be72640 1 -- 172.21.15.79:0/3603350239 >> 172.21.15.79:0/3603350239 conn(0x7f08840716b0 msgr2=0x7f08840cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.923+0000 7f088be72640 1 -- 172.21.15.79:0/3603350239 shutdown_connections 2024-04-25T02:08:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:33.923+0000 7f088be72640 1 -- 172.21.15.79:0/3603350239 wait complete. 2024-04-25T02:08:33.940 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:08:34.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.033+0000 7f388f212640 1 Processor -- start 2024-04-25T02:08:34.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.033+0000 7f388f212640 1 -- start start 2024-04-25T02:08:34.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.033+0000 7f388f212640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f38880d2ca0 0x7f38880d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.033+0000 7f388f212640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38880d0ef0 0x7f388806bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.033+0000 7f388f212640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38880d1ee0 con 0x7f388815e4f0 2024-04-25T02:08:34.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.033+0000 7f388f212640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f38880d3130 con 0x7f38880d2ca0 2024-04-25T02:08:34.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.033+0000 7f388f212640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f38880d21c0 con 0x7f38880d0ef0 2024-04-25T02:08:34.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.033+0000 7f388cfae640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f388815e4f0 0x7f38880cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48488/0 (socket says 172.21.15.79:48488) 2024-04-25T02:08:34.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.033+0000 7f388cfae640 1 -- 172.21.15.79:0/3945791081 learned_addr learned my addr 172.21.15.79:0/3945791081 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:34.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 -- 172.21.15.79:0/3945791081 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2751995726 0 0) 0x7f38880d1ee0 con 0x7f388815e4f0 2024-04-25T02:08:34.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f388d7af640 1 --2- 172.21.15.79:0/3945791081 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38880d0ef0 0x7f388806bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 -- 172.21.15.79:0/3945791081 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3878003520 con 0x7f388815e4f0 2024-04-25T02:08:34.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f3887fff640 1 --2- 172.21.15.79:0/3945791081 >> v2:172.21.15.189:3300/0 conn(0x7f38880d2ca0 0x7f38880d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 -- 172.21.15.79:0/3945791081 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3109329569 0 0) 0x7f3878003520 con 0x7f388815e4f0 2024-04-25T02:08:34.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 -- 172.21.15.79:0/3945791081 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38880d0ef0 msgr2=0x7f388806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:34.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 --2- 172.21.15.79:0/3945791081 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38880d0ef0 0x7f388806bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 -- 172.21.15.79:0/3945791081 >> v2:172.21.15.189:3300/0 conn(0x7f38880d2ca0 msgr2=0x7f38880d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:34.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 --2- 172.21.15.79:0/3945791081 >> v2:172.21.15.189:3300/0 conn(0x7f38880d2ca0 0x7f38880d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 -- 172.21.15.79:0/3945791081 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38880d24a0 con 0x7f388815e4f0 2024-04-25T02:08:34.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 -- 172.21.15.79:0/3945791081 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f387c001670 con 0x7f388815e4f0 2024-04-25T02:08:34.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 -- 172.21.15.79:0/3945791081 >> v1:172.21.15.79:6789/0 conn(0x7f388815e4f0 legacy=0x7f38880cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 --2- 172.21.15.79:0/3945791081 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38880d0ef0 0x7f38780039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 --2- 172.21.15.79:0/3945791081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3878003f30 0x7f3878004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 --2- 172.21.15.79:0/3945791081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3878004d40 0x7f38780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 -- 172.21.15.79:0/3945791081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f38880d21c0 con 0x7f3878003f30 2024-04-25T02:08:34.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 -- 172.21.15.79:0/3945791081 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f387800b9c0 con 0x7f3878004d40 2024-04-25T02:08:34.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f38877fe640 1 -- 172.21.15.79:0/3945791081 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f387800bb40 con 0x7f38880d0ef0 2024-04-25T02:08:34.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f3887fff640 1 --2- 172.21.15.79:0/3945791081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3878003f30 0x7f3878004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f388cfae640 1 --2- 172.21.15.79:0/3945791081 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38880d0ef0 0x7f38780039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f388d7af640 1 --2- 172.21.15.79:0/3945791081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3878004d40 0x7f38780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f3887fff640 1 -- 172.21.15.79:0/3945791081 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38880d0ef0 msgr2=0x7f38780039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:34.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f3887fff640 1 --2- 172.21.15.79:0/3945791081 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38880d0ef0 0x7f38780039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f3887fff640 1 -- 172.21.15.79:0/3945791081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3878004d40 msgr2=0x7f38780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:34.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f3887fff640 1 --2- 172.21.15.79:0/3945791081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3878004d40 0x7f38780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f3887fff640 1 -- 172.21.15.79:0/3945791081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3878003520 con 0x7f3878003f30 2024-04-25T02:08:34.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f388cfae640 1 --2- 172.21.15.79:0/3945791081 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38880d0ef0 0x7f38780039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:34.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.034+0000 7f388d7af640 1 --2- 172.21.15.79:0/3945791081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3878004d40 0x7f38780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:34.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.035+0000 7f3887fff640 1 --2- 172.21.15.79:0/3945791081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3878003f30 0x7f3878004800 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3874009ac0 tx=0x7f3878005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc07229540c5f1e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:34.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.035+0000 7f38877fe640 1 -- 172.21.15.79:0/3945791081 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3874036070 con 0x7f3878003f30 2024-04-25T02:08:34.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.035+0000 7f38877fe640 1 -- 172.21.15.79:0/3945791081 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3874031400 con 0x7f3878003f30 2024-04-25T02:08:34.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.035+0000 7f38877fe640 1 -- 172.21.15.79:0/3945791081 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3874009690 con 0x7f3878003f30 2024-04-25T02:08:34.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.036+0000 7f388f212640 1 -- 172.21.15.79:0/3945791081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3878003f30 msgr2=0x7f3878004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.036+0000 7f388f212640 1 --2- 172.21.15.79:0/3945791081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3878003f30 0x7f3878004800 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3874009ac0 tx=0x7f3878005830 comp rx=0 tx=0).stop 2024-04-25T02:08:34.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.036+0000 7f388d7af640 1 -- 172.21.15.79:0/3945791081 reap_dead start 2024-04-25T02:08:34.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.036+0000 7f388f212640 1 -- 172.21.15.79:0/3945791081 shutdown_connections 2024-04-25T02:08:34.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.036+0000 7f388f212640 1 -- 172.21.15.79:0/3945791081 >> 172.21.15.79:0/3945791081 conn(0x7f388809d4a0 msgr2=0x7f38880d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:34.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.036+0000 7f388f212640 1 -- 172.21.15.79:0/3945791081 shutdown_connections 2024-04-25T02:08:34.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.036+0000 7f388f212640 1 -- 172.21.15.79:0/3945791081 wait complete. 2024-04-25T02:08:34.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.037+0000 7f388f212640 1 Processor -- start 2024-04-25T02:08:34.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.037+0000 7f388f212640 1 -- start start 2024-04-25T02:08:34.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388f212640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3878003f30 0x7f38880b9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388f212640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38880b6d50 0x7f3888159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388f212640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38880c94a0 0x7f38880c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388f212640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f38880d4ee0 con 0x7f3878003f30 2024-04-25T02:08:34.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388f212640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f38880cff00 con 0x7f38880b6d50 2024-04-25T02:08:34.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388f212640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f38880d5060 con 0x7f38880c94a0 2024-04-25T02:08:34.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388cfae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3878003f30 0x7f38880b9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388cfae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3878003f30 0x7f38880b9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47188/0 (socket says 172.21.15.79:47188) 2024-04-25T02:08:34.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388cfae640 1 -- 172.21.15.79:0/1635598512 learned_addr learned my addr 172.21.15.79:0/1635598512 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:34.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388cfae640 1 -- 172.21.15.79:0/1635598512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38880c94a0 msgr2=0x7f38880c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388d7af640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38880c94a0 0x7f38880c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f3887fff640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38880b6d50 0x7f3888159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388cfae640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38880c94a0 0x7f38880c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388cfae640 1 -- 172.21.15.79:0/1635598512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38880b6d50 msgr2=0x7f3888159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388cfae640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38880b6d50 0x7f3888159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388cfae640 1 -- 172.21.15.79:0/1635598512 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38880b71d0 con 0x7f3878003f30 2024-04-25T02:08:34.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388d7af640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38880c94a0 0x7f38880c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:34.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f3887fff640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38880b6d50 0x7f3888159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:34.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f388cfae640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3878003f30 0x7f38880b9970 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f387c00e810 tx=0x7f387c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:34.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.038+0000 7f38857fa640 1 -- 172.21.15.79:0/1635598512 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c00ee60 con 0x7f3878003f30 2024-04-25T02:08:34.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.039+0000 7f38857fa640 1 -- 172.21.15.79:0/1635598512 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387c018070 con 0x7f3878003f30 2024-04-25T02:08:34.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.039+0000 7f388f212640 1 -- 172.21.15.79:0/1635598512 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38880b74a0 con 0x7f3878003f30 2024-04-25T02:08:34.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.039+0000 7f38857fa640 1 -- 172.21.15.79:0/1635598512 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c00cad0 con 0x7f3878003f30 2024-04-25T02:08:34.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.039+0000 7f388f212640 1 -- 172.21.15.79:0/1635598512 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38880b7a60 con 0x7f3878003f30 2024-04-25T02:08:34.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.039+0000 7f388f212640 1 -- 172.21.15.79:0/1635598512 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38880686c0 con 0x7f3878003f30 2024-04-25T02:08:34.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.040+0000 7f38857fa640 1 -- 172.21.15.79:0/1635598512 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f387c00cc70 con 0x7f3878003f30 2024-04-25T02:08:34.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.040+0000 7f38857fa640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f386c06be30 0x7f386c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.040+0000 7f38857fa640 1 -- 172.21.15.79:0/1635598512 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f387c08ac60 con 0x7f3878003f30 2024-04-25T02:08:34.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.040+0000 7f3887fff640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f386c06be30 0x7f386c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.041+0000 7f3887fff640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f386c06be30 0x7f386c06e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3874033000 tx=0x7f3874008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:34.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.045+0000 7f38857fa640 1 -- 172.21.15.79:0/1635598512 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f387c059610 con 0x7f3878003f30 2024-04-25T02:08:34.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.217+0000 7f388f212640 1 -- 172.21.15.79:0/1635598512 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f38880cadf0 con 0x7f3878003f30 2024-04-25T02:08:34.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.217+0000 7f38857fa640 1 -- 172.21.15.79:0/1635598512 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f387c058f10 con 0x7f3878003f30 2024-04-25T02:08:34.224 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:08:34.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.219+0000 7f388f212640 1 -- 172.21.15.79:0/1635598512 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f386c06be30 msgr2=0x7f386c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.219+0000 7f388f212640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f386c06be30 0x7f386c06e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3874033000 tx=0x7f3874008030 comp rx=0 tx=0).stop 2024-04-25T02:08:34.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.219+0000 7f388f212640 1 -- 172.21.15.79:0/1635598512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3878003f30 msgr2=0x7f38880b9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.219+0000 7f388f212640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3878003f30 0x7f38880b9970 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f387c00e810 tx=0x7f387c00ec10 comp rx=0 tx=0).stop 2024-04-25T02:08:34.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.219+0000 7f388f212640 1 -- 172.21.15.79:0/1635598512 shutdown_connections 2024-04-25T02:08:34.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.219+0000 7f388f212640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f386c06be30 0x7f386c06e2f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.219+0000 7f388f212640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38880c94a0 0x7f38880c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.219+0000 7f388f212640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38880b6d50 0x7f3888159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.219+0000 7f388f212640 1 --2- 172.21.15.79:0/1635598512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3878003f30 0x7f38880b9970 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.219+0000 7f388f212640 1 -- 172.21.15.79:0/1635598512 >> 172.21.15.79:0/1635598512 conn(0x7f388809d4a0 msgr2=0x7f38880d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:34.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.219+0000 7f388f212640 1 -- 172.21.15.79:0/1635598512 shutdown_connections 2024-04-25T02:08:34.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.219+0000 7f388f212640 1 -- 172.21.15.79:0/1635598512 wait complete. 2024-04-25T02:08:34.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:08:34.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.327+0000 7f56e0b5a640 1 Processor -- start 2024-04-25T02:08:34.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.327+0000 7f56e0b5a640 1 -- start start 2024-04-25T02:08:34.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.328+0000 7f56e0b5a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f56dc144cb0 0x7f56dc0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.328+0000 7f56e0b5a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56dc06e660 0x7f56dc071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.328+0000 7f56e0b5a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56dc070d90 con 0x7f56dc0b5580 2024-04-25T02:08:34.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.328+0000 7f56e0b5a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f56dc0cf130 con 0x7f56dc144cb0 2024-04-25T02:08:34.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.328+0000 7f56e0b5a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f56dc0cf410 con 0x7f56dc06e660 2024-04-25T02:08:34.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.329+0000 7f56dad9d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56dc06e660 0x7f56dc071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.329+0000 7f56da59c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f56dc144cb0 0x7f56dc0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.329+0000 7f56da59c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f56dc144cb0 0x7f56dc0b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:37122/0 (socket says 172.21.15.79:37122) 2024-04-25T02:08:34.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.329+0000 7f56dad9d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56dc06e660 0x7f56dc071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:34054/0 (socket says 172.21.15.79:34054) 2024-04-25T02:08:34.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.329+0000 7f56d9d9b640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f56dc0b5580 0x7f56dc06df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:57548/0 (socket says 172.21.15.79:57548) 2024-04-25T02:08:34.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.329+0000 7f56da59c640 1 -- 172.21.15.79:0/606556678 learned_addr learned my addr 172.21.15.79:0/606556678 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:34.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.329+0000 7f56dad9d640 1 -- 172.21.15.79:0/606556678 >> v2:172.21.15.189:3300/0 conn(0x7f56dc144cb0 msgr2=0x7f56dc0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:34.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.329+0000 7f56dad9d640 1 --2- 172.21.15.79:0/606556678 >> v2:172.21.15.189:3300/0 conn(0x7f56dc144cb0 0x7f56dc0b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.329+0000 7f56dad9d640 1 -- 172.21.15.79:0/606556678 >> v1:172.21.15.189:6789/0 conn(0x7f56dc0b5580 legacy=0x7f56dc06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.329+0000 7f56dad9d640 1 -- 172.21.15.79:0/606556678 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56dc0cf6f0 con 0x7f56dc06e660 2024-04-25T02:08:34.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.329+0000 7f56da59c640 1 --2- 172.21.15.79:0/606556678 >> v2:172.21.15.189:3300/0 conn(0x7f56dc144cb0 0x7f56dc0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:34.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.330+0000 7f56dad9d640 1 --2- 172.21.15.79:0/606556678 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56dc06e660 0x7f56dc071240 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f56d40097a0 tx=0x7f56d402a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cfd73a813730799 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:34.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.330+0000 7f56d959a640 1 -- 172.21.15.79:0/606556678 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4037070 con 0x7f56dc06e660 2024-04-25T02:08:34.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.330+0000 7f56d959a640 1 -- 172.21.15.79:0/606556678 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d402adb0 con 0x7f56dc06e660 2024-04-25T02:08:34.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.330+0000 7f56d959a640 1 -- 172.21.15.79:0/606556678 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4032660 con 0x7f56dc06e660 2024-04-25T02:08:34.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.330+0000 7f56e0b5a640 1 -- 172.21.15.79:0/606556678 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56dc06e660 msgr2=0x7f56dc071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.330+0000 7f56e0b5a640 1 --2- 172.21.15.79:0/606556678 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56dc06e660 0x7f56dc071240 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f56d40097a0 tx=0x7f56d402a060 comp rx=0 tx=0).stop 2024-04-25T02:08:34.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.331+0000 7f56e0b5a640 1 -- 172.21.15.79:0/606556678 shutdown_connections 2024-04-25T02:08:34.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.331+0000 7f56e0b5a640 1 --2- 172.21.15.79:0/606556678 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56dc06e660 0x7f56dc071240 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.331+0000 7f56e0b5a640 1 --2- 172.21.15.79:0/606556678 >> v2:172.21.15.189:3300/0 conn(0x7f56dc144cb0 0x7f56dc0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.331+0000 7f56e0b5a640 1 -- 172.21.15.79:0/606556678 >> 172.21.15.79:0/606556678 conn(0x7f56dc0cfc80 msgr2=0x7f56dc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:34.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.331+0000 7f56e0b5a640 1 -- 172.21.15.79:0/606556678 shutdown_connections 2024-04-25T02:08:34.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.331+0000 7f56e0b5a640 1 -- 172.21.15.79:0/606556678 wait complete. 2024-04-25T02:08:34.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.332+0000 7f56e0b5a640 1 Processor -- start 2024-04-25T02:08:34.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.332+0000 7f56e0b5a640 1 -- start start 2024-04-25T02:08:34.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56e0b5a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56dc06e660 0x7f56dc15ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56e0b5a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56dc0b5580 0x7f56dc1f82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56e0b5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56dc144cb0 0x7f56dc1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56e0b5a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f56dc145ab0 con 0x7f56dc144cb0 2024-04-25T02:08:34.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56e0b5a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f56dc145090 con 0x7f56dc0b5580 2024-04-25T02:08:34.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56e0b5a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f56dc145c30 con 0x7f56dc06e660 2024-04-25T02:08:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56dad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56dc144cb0 0x7f56dc1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56dad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56dc144cb0 0x7f56dc1438f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47200/0 (socket says 172.21.15.79:47200) 2024-04-25T02:08:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56dad9d640 1 -- 172.21.15.79:0/2446403584 learned_addr learned my addr 172.21.15.79:0/2446403584 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56d9d9b640 1 --2- 172.21.15.79:0/2446403584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56dc0b5580 0x7f56dc1f82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56da59c640 1 --2- 172.21.15.79:0/2446403584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56dc06e660 0x7f56dc15ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56dad9d640 1 -- 172.21.15.79:0/2446403584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56dc06e660 msgr2=0x7f56dc15ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56dad9d640 1 --2- 172.21.15.79:0/2446403584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56dc06e660 0x7f56dc15ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56dad9d640 1 -- 172.21.15.79:0/2446403584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56dc0b5580 msgr2=0x7f56dc1f82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56dad9d640 1 --2- 172.21.15.79:0/2446403584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56dc0b5580 0x7f56dc1f82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56dad9d640 1 -- 172.21.15.79:0/2446403584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56dc15c150 con 0x7f56dc144cb0 2024-04-25T02:08:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56dad9d640 1 --2- 172.21.15.79:0/2446403584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56dc144cb0 0x7f56dc1438f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f56d40098c0 tx=0x7f56d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56caffd640 1 -- 172.21.15.79:0/2446403584 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4041020 con 0x7f56dc144cb0 2024-04-25T02:08:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56caffd640 1 -- 172.21.15.79:0/2446403584 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d403c670 con 0x7f56dc144cb0 2024-04-25T02:08:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56e0b5a640 1 -- 172.21.15.79:0/2446403584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56dc15c430 con 0x7f56dc144cb0 2024-04-25T02:08:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56caffd640 1 -- 172.21.15.79:0/2446403584 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4037040 con 0x7f56dc144cb0 2024-04-25T02:08:34.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.333+0000 7f56e0b5a640 1 -- 172.21.15.79:0/2446403584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56dc15c9f0 con 0x7f56dc144cb0 2024-04-25T02:08:34.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.334+0000 7f56e0b5a640 1 -- 172.21.15.79:0/2446403584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56dc0690a0 con 0x7f56dc144cb0 2024-04-25T02:08:34.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.335+0000 7f56caffd640 1 -- 172.21.15.79:0/2446403584 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56d4044020 con 0x7f56dc144cb0 2024-04-25T02:08:34.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.335+0000 7f56caffd640 1 --2- 172.21.15.79:0/2446403584 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56bc06be30 0x7f56bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.335+0000 7f56da59c640 1 --2- 172.21.15.79:0/2446403584 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56bc06be30 0x7f56bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.335+0000 7f56caffd640 1 -- 172.21.15.79:0/2446403584 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f56d40ab520 con 0x7f56dc144cb0 2024-04-25T02:08:34.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.336+0000 7f56da59c640 1 --2- 172.21.15.79:0/2446403584 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56bc06be30 0x7f56bc06e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0072c0 tx=0x7f56cc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:34.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.340+0000 7f56caffd640 1 -- 172.21.15.79:0/2446403584 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f56d404b030 con 0x7f56dc144cb0 2024-04-25T02:08:34.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.524+0000 7f56e0b5a640 1 -- 172.21.15.79:0/2446403584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f56dc0d08e0 con 0x7f56dc144cb0 2024-04-25T02:08:34.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.524+0000 7f56caffd640 1 -- 172.21.15.79:0/2446403584 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f56d4079880 con 0x7f56dc144cb0 2024-04-25T02:08:34.532 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-04-25T02:08:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.526+0000 7f56e0b5a640 1 -- 172.21.15.79:0/2446403584 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56bc06be30 msgr2=0x7f56bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.526+0000 7f56e0b5a640 1 --2- 172.21.15.79:0/2446403584 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56bc06be30 0x7f56bc06e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0072c0 tx=0x7f56cc00b040 comp rx=0 tx=0).stop 2024-04-25T02:08:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.526+0000 7f56e0b5a640 1 -- 172.21.15.79:0/2446403584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56dc144cb0 msgr2=0x7f56dc1438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.526+0000 7f56e0b5a640 1 --2- 172.21.15.79:0/2446403584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56dc144cb0 0x7f56dc1438f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f56d40098c0 tx=0x7f56d40046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.526+0000 7f56e0b5a640 1 -- 172.21.15.79:0/2446403584 shutdown_connections 2024-04-25T02:08:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.526+0000 7f56e0b5a640 1 --2- 172.21.15.79:0/2446403584 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56bc06be30 0x7f56bc06e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.526+0000 7f56e0b5a640 1 --2- 172.21.15.79:0/2446403584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56dc144cb0 0x7f56dc1438f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.526+0000 7f56e0b5a640 1 --2- 172.21.15.79:0/2446403584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56dc0b5580 0x7f56dc1f82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.526+0000 7f56e0b5a640 1 --2- 172.21.15.79:0/2446403584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56dc06e660 0x7f56dc15ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.526+0000 7f56e0b5a640 1 -- 172.21.15.79:0/2446403584 >> 172.21.15.79:0/2446403584 conn(0x7f56dc0cfc80 msgr2=0x7f56dc06cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:34.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.526+0000 7f56e0b5a640 1 -- 172.21.15.79:0/2446403584 shutdown_connections 2024-04-25T02:08:34.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.526+0000 7f56e0b5a640 1 -- 172.21.15.79:0/2446403584 wait complete. 2024-04-25T02:08:34.544 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-25T02:08:34.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:34.544 DEBUG:teuthology.orchestra.run.smithi189:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-25T02:08:34.575 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi189.front.sepia.ceph.com 2024-04-25T02:08:34.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:34.575 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-25T02:08:34.634 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T02:08:34.634 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:08:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.724+0000 7f5320990640 1 Processor -- start 2024-04-25T02:08:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.724+0000 7f5320990640 1 -- start start 2024-04-25T02:08:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.725+0000 7f5320990640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f531c15a720 0x7f531c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.725+0000 7f5320990640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f531c0b49b0 0x7f531c070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.725+0000 7f5320990640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531c15f1c0 con 0x7f531c0d07a0 2024-04-25T02:08:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.725+0000 7f5320990640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f531c15bb10 con 0x7f531c0b49b0 2024-04-25T02:08:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.725+0000 7f5320990640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f531c0b2e60 con 0x7f531c15a720 2024-04-25T02:08:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.725+0000 7f531ad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f531c0b49b0 0x7f531c070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.725+0000 7f5313fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f531c0d07a0 0x7f531c0b42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48502/0 (socket says 172.21.15.79:48502) 2024-04-25T02:08:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.725+0000 7f5313fff640 1 -- 172.21.15.79:0/3455563821 learned_addr learned my addr 172.21.15.79:0/3455563821 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.725+0000 7f531a59c640 1 --2- 172.21.15.79:0/3455563821 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f531c15a720 0x7f531c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.725+0000 7f531ad9d640 1 -- 172.21.15.79:0/3455563821 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f531c15a720 msgr2=0x7f531c15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.725+0000 7f5319d9b640 1 -- 172.21.15.79:0/3455563821 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3167788063 0 0) 0x7f5304001110 con 0x7f531c0d07a0 2024-04-25T02:08:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.725+0000 7f531ad9d640 1 --2- 172.21.15.79:0/3455563821 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f531c15a720 0x7f531c15ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.725+0000 7f531ad9d640 1 -- 172.21.15.79:0/3455563821 >> v1:172.21.15.79:6789/0 conn(0x7f531c0d07a0 legacy=0x7f531c0b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.725+0000 7f531ad9d640 1 -- 172.21.15.79:0/3455563821 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c0b3140 con 0x7f531c0b49b0 2024-04-25T02:08:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.726+0000 7f531ad9d640 1 --2- 172.21.15.79:0/3455563821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f531c0b49b0 0x7f531c070cf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5314009d90 tx=0x7f531402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ea2fafae1befa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.726+0000 7f5319d9b640 1 -- 172.21.15.79:0/3455563821 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5314031600 con 0x7f531c0b49b0 2024-04-25T02:08:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.726+0000 7f5319d9b640 1 -- 172.21.15.79:0/3455563821 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53140317a0 con 0x7f531c0b49b0 2024-04-25T02:08:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.726+0000 7f5319d9b640 1 -- 172.21.15.79:0/3455563821 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5314031b70 con 0x7f531c0b49b0 2024-04-25T02:08:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.727+0000 7f5320990640 1 -- 172.21.15.79:0/3455563821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f531c0b49b0 msgr2=0x7f531c070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.727+0000 7f5320990640 1 --2- 172.21.15.79:0/3455563821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f531c0b49b0 0x7f531c070cf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5314009d90 tx=0x7f531402a5d0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.727+0000 7f5320990640 1 -- 172.21.15.79:0/3455563821 shutdown_connections 2024-04-25T02:08:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.727+0000 7f5320990640 1 --2- 172.21.15.79:0/3455563821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f531c0b49b0 0x7f531c070cf0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.727+0000 7f5320990640 1 --2- 172.21.15.79:0/3455563821 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f531c15a720 0x7f531c15ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.727+0000 7f5320990640 1 -- 172.21.15.79:0/3455563821 >> 172.21.15.79:0/3455563821 conn(0x7f531c0cfc80 msgr2=0x7f531c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.727+0000 7f5320990640 1 -- 172.21.15.79:0/3455563821 shutdown_connections 2024-04-25T02:08:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.727+0000 7f5320990640 1 -- 172.21.15.79:0/3455563821 wait complete. 2024-04-25T02:08:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.728+0000 7f5320990640 1 Processor -- start 2024-04-25T02:08:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.728+0000 7f5320990640 1 -- start start 2024-04-25T02:08:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.729+0000 7f5320990640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f531c0b49b0 0x7f531c071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.729+0000 7f5320990640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f531c0d07a0 0x7f531c14fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.729+0000 7f5320990640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f531c15a720 0x7f531c1503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.729+0000 7f5320990640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f531c0b39e0 con 0x7f531c0b49b0 2024-04-25T02:08:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.729+0000 7f5320990640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f531c0b3700 con 0x7f531c15a720 2024-04-25T02:08:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.729+0000 7f5320990640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f531c06df50 con 0x7f531c0d07a0 2024-04-25T02:08:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.729+0000 7f531a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f531c0b49b0 0x7f531c071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.729+0000 7f531a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f531c0b49b0 0x7f531c071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47230/0 (socket says 172.21.15.79:47230) 2024-04-25T02:08:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.729+0000 7f531a59c640 1 -- 172.21.15.79:0/140422164 learned_addr learned my addr 172.21.15.79:0/140422164 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.729+0000 7f531a59c640 1 -- 172.21.15.79:0/140422164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f531c0d07a0 msgr2=0x7f531c14fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.729+0000 7f531a59c640 1 --2- 172.21.15.79:0/140422164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f531c0d07a0 0x7f531c14fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.729+0000 7f531a59c640 1 -- 172.21.15.79:0/140422164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f531c15a720 msgr2=0x7f531c1503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.729+0000 7f531a59c640 1 --2- 172.21.15.79:0/140422164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f531c15a720 0x7f531c1503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.729+0000 7f531a59c640 1 -- 172.21.15.79:0/140422164 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c0c5990 con 0x7f531c0b49b0 2024-04-25T02:08:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.729+0000 7f531a59c640 1 --2- 172.21.15.79:0/140422164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f531c0b49b0 0x7f531c071ac0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f530c00d620 tx=0x7f530c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:34.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.730+0000 7f5312ffd640 1 -- 172.21.15.79:0/140422164 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c015070 con 0x7f531c0b49b0 2024-04-25T02:08:34.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.730+0000 7f5312ffd640 1 -- 172.21.15.79:0/140422164 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f530c011870 con 0x7f531c0b49b0 2024-04-25T02:08:34.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.730+0000 7f5320990640 1 -- 172.21.15.79:0/140422164 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531c0c5c70 con 0x7f531c0b49b0 2024-04-25T02:08:34.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.730+0000 7f5312ffd640 1 -- 172.21.15.79:0/140422164 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c00b040 con 0x7f531c0b49b0 2024-04-25T02:08:34.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.730+0000 7f5320990640 1 -- 172.21.15.79:0/140422164 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f531c0c6230 con 0x7f531c0b49b0 2024-04-25T02:08:34.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.731+0000 7f5320990640 1 -- 172.21.15.79:0/140422164 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f531c0690a0 con 0x7f531c0b49b0 2024-04-25T02:08:34.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.731+0000 7f5312ffd640 1 -- 172.21.15.79:0/140422164 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f530c018070 con 0x7f531c0b49b0 2024-04-25T02:08:34.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.731+0000 7f5312ffd640 1 --2- 172.21.15.79:0/140422164 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f52fc06be60 0x7f52fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.731+0000 7f5313fff640 1 --2- 172.21.15.79:0/140422164 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f52fc06be60 0x7f52fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.731+0000 7f5312ffd640 1 -- 172.21.15.79:0/140422164 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f530c08ae20 con 0x7f531c0b49b0 2024-04-25T02:08:34.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.732+0000 7f5313fff640 1 --2- 172.21.15.79:0/140422164 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f52fc06be60 0x7f52fc06e320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f531c071080 tx=0x7f5304001310 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:34.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.736+0000 7f5312ffd640 1 -- 172.21.15.79:0/140422164 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f530c059860 con 0x7f531c0b49b0 2024-04-25T02:08:34.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.944+0000 7f5320990640 1 -- 172.21.15.79:0/140422164 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f531c0b1810 con 0x7f531c0b49b0 2024-04-25T02:08:34.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.945+0000 7f5312ffd640 1 -- 172.21.15.79:0/140422164 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7f530c059160 con 0x7f531c0b49b0 2024-04-25T02:08:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:34.952 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/465663373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":465663373},{"type":"v1","addr":"172.21.15.189:6833","nonce":465663373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2093278785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2093278785},{"type":"v1","addr":"172.21.15.79:6836","nonce":2093278785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2415912880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2415912880},{"type":"v1","addr":"172.21.15.189:6835","nonce":2415912880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:07:59.452096+0000","modified":"2024-04-25T02:08:01.458029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2942986974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2942986974},{"type":"v1","addr":"172.21.15.79:6837","nonce":2942986974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-25T02:08:34.952 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2024-04-25T02:08:34.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.947+0000 7f5320990640 1 -- 172.21.15.79:0/140422164 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f52fc06be60 msgr2=0x7f52fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.947+0000 7f5320990640 1 --2- 172.21.15.79:0/140422164 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f52fc06be60 0x7f52fc06e320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f531c071080 tx=0x7f5304001310 comp rx=0 tx=0).stop 2024-04-25T02:08:34.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.947+0000 7f5320990640 1 -- 172.21.15.79:0/140422164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f531c0b49b0 msgr2=0x7f531c071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.947+0000 7f5320990640 1 --2- 172.21.15.79:0/140422164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f531c0b49b0 0x7f531c071ac0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f530c00d620 tx=0x7f530c00dae0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.947+0000 7f5320990640 1 -- 172.21.15.79:0/140422164 shutdown_connections 2024-04-25T02:08:34.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.947+0000 7f5320990640 1 --2- 172.21.15.79:0/140422164 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f52fc06be60 0x7f52fc06e320 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.947+0000 7f5320990640 1 --2- 172.21.15.79:0/140422164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f531c15a720 0x7f531c1503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.947+0000 7f5320990640 1 --2- 172.21.15.79:0/140422164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f531c0d07a0 0x7f531c14fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.947+0000 7f5320990640 1 --2- 172.21.15.79:0/140422164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f531c0b49b0 0x7f531c071ac0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.947+0000 7f5320990640 1 -- 172.21.15.79:0/140422164 >> 172.21.15.79:0/140422164 conn(0x7f531c0cfc80 msgr2=0x7f531c1570a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:34.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.947+0000 7f5320990640 1 -- 172.21.15.79:0/140422164 shutdown_connections 2024-04-25T02:08:34.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:34.947+0000 7f5320990640 1 -- 172.21.15.79:0/140422164 wait complete. 2024-04-25T02:08:34.965 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:35.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.054+0000 7f27e935a640 1 Processor -- start 2024-04-25T02:08:35.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.054+0000 7f27e935a640 1 -- start start 2024-04-25T02:08:35.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e935a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27e40d2e20 0x7f27e40cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e935a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e406c380 con 0x7f27e40b3570 2024-04-25T02:08:35.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e935a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e40d1660 con 0x7f27e415e4d0 2024-04-25T02:08:35.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e935a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f27e40d1380 con 0x7f27e40d2e20 2024-04-25T02:08:35.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e27fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f27e40b3570 0x7f27e40d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48516/0 (socket says 172.21.15.79:48516) 2024-04-25T02:08:35.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e27fc640 1 -- 172.21.15.79:0/3750810793 learned_addr learned my addr 172.21.15.79:0/3750810793 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:35.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e37fe640 1 --2- 172.21.15.79:0/3750810793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27e40d2e20 0x7f27e40cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e1ffb640 1 -- 172.21.15.79:0/3750810793 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 848705966 0 0) 0x7f27e406c380 con 0x7f27e40b3570 2024-04-25T02:08:35.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e1ffb640 1 -- 172.21.15.79:0/3750810793 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27cc003520 con 0x7f27e40b3570 2024-04-25T02:08:35.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e1ffb640 1 -- 172.21.15.79:0/3750810793 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 12309652 0 0) 0x7f27cc003520 con 0x7f27e40b3570 2024-04-25T02:08:35.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e1ffb640 1 -- 172.21.15.79:0/3750810793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27e40d2e20 msgr2=0x7f27e40cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:35.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e1ffb640 1 --2- 172.21.15.79:0/3750810793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27e40d2e20 0x7f27e40cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e1ffb640 1 -- 172.21.15.79:0/3750810793 >> v1:172.21.15.189:6789/0 conn(0x7f27e415e4d0 legacy=0x7f27e406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e1ffb640 1 -- 172.21.15.79:0/3750810793 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e40cede0 con 0x7f27e40b3570 2024-04-25T02:08:35.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e1ffb640 1 -- 172.21.15.79:0/3750810793 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f27d8001670 con 0x7f27e40b3570 2024-04-25T02:08:35.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e1ffb640 1 -- 172.21.15.79:0/3750810793 >> v1:172.21.15.79:6789/0 conn(0x7f27e40b3570 legacy=0x7f27e40d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e1ffb640 1 --2- 172.21.15.79:0/3750810793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc0039e0 0x7f27cc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e1ffb640 1 --2- 172.21.15.79:0/3750810793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27cc004800 0x7f27cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e1ffb640 1 --2- 172.21.15.79:0/3750810793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27e40d2e20 0x7f27cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e1ffb640 1 -- 172.21.15.79:0/3750810793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27e40d1380 con 0x7f27cc0039e0 2024-04-25T02:08:35.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e1ffb640 1 -- 172.21.15.79:0/3750810793 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc00baa0 con 0x7f27cc004800 2024-04-25T02:08:35.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e1ffb640 1 -- 172.21.15.79:0/3750810793 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f27cc00bca0 con 0x7f27e40d2e20 2024-04-25T02:08:35.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.055+0000 7f27e2ffd640 1 --2- 172.21.15.79:0/3750810793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc0039e0 0x7f27cc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.056+0000 7f27e27fc640 1 --2- 172.21.15.79:0/3750810793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27cc004800 0x7f27cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.056+0000 7f27e37fe640 1 --2- 172.21.15.79:0/3750810793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27e40d2e20 0x7f27cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.056+0000 7f27e2ffd640 1 -- 172.21.15.79:0/3750810793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27e40d2e20 msgr2=0x7f27cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:35.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.056+0000 7f27e2ffd640 1 --2- 172.21.15.79:0/3750810793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27e40d2e20 0x7f27cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.056+0000 7f27e2ffd640 1 -- 172.21.15.79:0/3750810793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27cc004800 msgr2=0x7f27cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:35.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.056+0000 7f27e2ffd640 1 --2- 172.21.15.79:0/3750810793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27cc004800 0x7f27cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.056+0000 7f27e2ffd640 1 -- 172.21.15.79:0/3750810793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27cc003520 con 0x7f27cc0039e0 2024-04-25T02:08:35.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.056+0000 7f27e2ffd640 1 --2- 172.21.15.79:0/3750810793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc0039e0 0x7f27cc003e00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f27d4001720 tx=0x7f27cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a8467fd4baa780 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:35.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.056+0000 7f27e1ffb640 1 -- 172.21.15.79:0/3750810793 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d4001370 con 0x7f27cc0039e0 2024-04-25T02:08:35.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.056+0000 7f27e1ffb640 1 -- 172.21.15.79:0/3750810793 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d40052d0 con 0x7f27cc0039e0 2024-04-25T02:08:35.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.056+0000 7f27e1ffb640 1 -- 172.21.15.79:0/3750810793 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d402ab90 con 0x7f27cc0039e0 2024-04-25T02:08:35.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.057+0000 7f27e935a640 1 -- 172.21.15.79:0/3750810793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc0039e0 msgr2=0x7f27cc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.057+0000 7f27e935a640 1 --2- 172.21.15.79:0/3750810793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc0039e0 0x7f27cc003e00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f27d4001720 tx=0x7f27cc005830 comp rx=0 tx=0).stop 2024-04-25T02:08:35.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.057+0000 7f27e37fe640 1 -- 172.21.15.79:0/3750810793 reap_dead start 2024-04-25T02:08:35.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.057+0000 7f27e935a640 1 -- 172.21.15.79:0/3750810793 shutdown_connections 2024-04-25T02:08:35.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.057+0000 7f27e935a640 1 -- 172.21.15.79:0/3750810793 >> 172.21.15.79:0/3750810793 conn(0x7f27e409d460 msgr2=0x7f27e40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:35.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.057+0000 7f27e935a640 1 -- 172.21.15.79:0/3750810793 shutdown_connections 2024-04-25T02:08:35.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.057+0000 7f27e935a640 1 -- 172.21.15.79:0/3750810793 wait complete. 2024-04-25T02:08:35.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.058+0000 7f27e935a640 1 Processor -- start 2024-04-25T02:08:35.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.058+0000 7f27e935a640 1 -- start start 2024-04-25T02:08:35.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e935a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27cc0039e0 0x7f27e40cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e935a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4152740 0x7f27e41f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e935a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27e41551c0 0x7f27e4155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e935a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27e40d20d0 con 0x7f27e4152740 2024-04-25T02:08:35.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e935a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f27e415e8b0 con 0x7f27cc0039e0 2024-04-25T02:08:35.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e935a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f27e40d2250 con 0x7f27e41551c0 2024-04-25T02:08:35.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4152740 0x7f27e41f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4152740 0x7f27e41f49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47256/0 (socket says 172.21.15.79:47256) 2024-04-25T02:08:35.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e27fc640 1 -- 172.21.15.79:0/485680133 learned_addr learned my addr 172.21.15.79:0/485680133 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:35.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e2ffd640 1 --2- 172.21.15.79:0/485680133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27cc0039e0 0x7f27e40cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e37fe640 1 --2- 172.21.15.79:0/485680133 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27e41551c0 0x7f27e4155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e27fc640 1 -- 172.21.15.79:0/485680133 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27e41551c0 msgr2=0x7f27e4155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e27fc640 1 --2- 172.21.15.79:0/485680133 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27e41551c0 0x7f27e4155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e27fc640 1 -- 172.21.15.79:0/485680133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27cc0039e0 msgr2=0x7f27e40cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e27fc640 1 --2- 172.21.15.79:0/485680133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27cc0039e0 0x7f27e40cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e27fc640 1 -- 172.21.15.79:0/485680133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e41f5b40 con 0x7f27e4152740 2024-04-25T02:08:35.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.059+0000 7f27e37fe640 1 --2- 172.21.15.79:0/485680133 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27e41551c0 0x7f27e4155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:35.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.060+0000 7f27e27fc640 1 --2- 172.21.15.79:0/485680133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4152740 0x7f27e41f49e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f27d800e760 tx=0x7f27d800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:35.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.060+0000 7f27cb7fe640 1 -- 172.21.15.79:0/485680133 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d800ee70 con 0x7f27e4152740 2024-04-25T02:08:35.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.060+0000 7f27cb7fe640 1 -- 172.21.15.79:0/485680133 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d8018070 con 0x7f27e4152740 2024-04-25T02:08:35.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.060+0000 7f27cb7fe640 1 -- 172.21.15.79:0/485680133 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d800cb30 con 0x7f27e4152740 2024-04-25T02:08:35.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.060+0000 7f27e935a640 1 -- 172.21.15.79:0/485680133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e4152ba0 con 0x7f27e4152740 2024-04-25T02:08:35.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.060+0000 7f27e935a640 1 -- 172.21.15.79:0/485680133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e41f5580 con 0x7f27e4152740 2024-04-25T02:08:35.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.061+0000 7f27e935a640 1 -- 172.21.15.79:0/485680133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e40690a0 con 0x7f27e4152740 2024-04-25T02:08:35.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.061+0000 7f27cb7fe640 1 -- 172.21.15.79:0/485680133 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27d800ccd0 con 0x7f27e4152740 2024-04-25T02:08:35.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.062+0000 7f27cb7fe640 1 --2- 172.21.15.79:0/485680133 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f27d006be30 0x7f27d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.062+0000 7f27e2ffd640 1 --2- 172.21.15.79:0/485680133 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f27d006be30 0x7f27d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.062+0000 7f27cb7fe640 1 -- 172.21.15.79:0/485680133 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f27d808ac20 con 0x7f27e4152740 2024-04-25T02:08:35.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.062+0000 7f27e2ffd640 1 --2- 172.21.15.79:0/485680133 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f27d006be30 0x7f27d006e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27d4032000 tx=0x7f27d402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:35.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.066+0000 7f27cb7fe640 1 -- 172.21.15.79:0/485680133 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f27d8059660 con 0x7f27e4152740 2024-04-25T02:08:35.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.241+0000 7f27e935a640 1 -- 172.21.15.79:0/485680133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27e40d1920 con 0x7f27e4152740 2024-04-25T02:08:35.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.242+0000 7f27cb7fe640 1 -- 172.21.15.79:0/485680133 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f27d8058f60 con 0x7f27e4152740 2024-04-25T02:08:35.249 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:35.249 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:35.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.244+0000 7f27e935a640 1 -- 172.21.15.79:0/485680133 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f27d006be30 msgr2=0x7f27d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.244+0000 7f27e935a640 1 --2- 172.21.15.79:0/485680133 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f27d006be30 0x7f27d006e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27d4032000 tx=0x7f27d402e000 comp rx=0 tx=0).stop 2024-04-25T02:08:35.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.244+0000 7f27e935a640 1 -- 172.21.15.79:0/485680133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4152740 msgr2=0x7f27e41f49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.244+0000 7f27e935a640 1 --2- 172.21.15.79:0/485680133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4152740 0x7f27e41f49e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f27d800e760 tx=0x7f27d800ec20 comp rx=0 tx=0).stop 2024-04-25T02:08:35.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.244+0000 7f27e935a640 1 -- 172.21.15.79:0/485680133 shutdown_connections 2024-04-25T02:08:35.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.244+0000 7f27e935a640 1 --2- 172.21.15.79:0/485680133 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f27d006be30 0x7f27d006e2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.244+0000 7f27e935a640 1 --2- 172.21.15.79:0/485680133 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27e41551c0 0x7f27e4155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.244+0000 7f27e935a640 1 --2- 172.21.15.79:0/485680133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4152740 0x7f27e41f49e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.244+0000 7f27e935a640 1 --2- 172.21.15.79:0/485680133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27cc0039e0 0x7f27e40cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.244+0000 7f27e935a640 1 -- 172.21.15.79:0/485680133 >> 172.21.15.79:0/485680133 conn(0x7f27e409d460 msgr2=0x7f27e40cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:35.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.244+0000 7f27e935a640 1 -- 172.21.15.79:0/485680133 shutdown_connections 2024-04-25T02:08:35.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.244+0000 7f27e935a640 1 -- 172.21.15.79:0/485680133 wait complete. 2024-04-25T02:08:35.262 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:57.115253+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:58.421392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:08:35.263 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:08:35.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.355+0000 7f665ecae640 1 Processor -- start 2024-04-25T02:08:35.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.355+0000 7f665ecae640 1 -- start start 2024-04-25T02:08:35.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f665ecae640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665806b2f0 0x7f66580b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f665ecae640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f665815ec20 con 0x7f66580cf7a0 2024-04-25T02:08:35.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f665ecae640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f665815ef00 con 0x7f665806e6b0 2024-04-25T02:08:35.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f665ecae640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f665815f830 con 0x7f665806b2f0 2024-04-25T02:08:35.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f6657fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f66580cf7a0 0x7f665806b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48532/0 (socket says 172.21.15.79:48532) 2024-04-25T02:08:35.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f6657fff640 1 -- 172.21.15.79:0/3769251171 learned_addr learned my addr 172.21.15.79:0/3769251171 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:35.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f66577fe640 1 -- 172.21.15.79:0/3769251171 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897651832 0 0) 0x7f665815ec20 con 0x7f66580cf7a0 2024-04-25T02:08:35.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f66577fe640 1 -- 172.21.15.79:0/3769251171 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6648003520 con 0x7f66580cf7a0 2024-04-25T02:08:35.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f665ca4a640 1 --2- 172.21.15.79:0/3769251171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665806b2f0 0x7f66580b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f66577fe640 1 -- 172.21.15.79:0/3769251171 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 590039406 0 0) 0x7f6648003520 con 0x7f66580cf7a0 2024-04-25T02:08:35.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f66577fe640 1 -- 172.21.15.79:0/3769251171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665806b2f0 msgr2=0x7f66580b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:35.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f66577fe640 1 --2- 172.21.15.79:0/3769251171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665806b2f0 0x7f66580b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f66577fe640 1 -- 172.21.15.79:0/3769251171 >> v1:172.21.15.189:6789/0 conn(0x7f665806e6b0 legacy=0x7f665815b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f66577fe640 1 -- 172.21.15.79:0/3769251171 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665815f1e0 con 0x7f66580cf7a0 2024-04-25T02:08:35.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f66577fe640 1 -- 172.21.15.79:0/3769251171 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f6644001670 con 0x7f66580cf7a0 2024-04-25T02:08:35.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f66577fe640 1 -- 172.21.15.79:0/3769251171 >> v1:172.21.15.79:6789/0 conn(0x7f66580cf7a0 legacy=0x7f665806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f66577fe640 1 --2- 172.21.15.79:0/3769251171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665806b2f0 0x7f66480039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f66577fe640 1 --2- 172.21.15.79:0/3769251171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6648003f60 0x7f6648004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f66577fe640 1 --2- 172.21.15.79:0/3769251171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6648004d40 0x7f66480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f66577fe640 1 -- 172.21.15.79:0/3769251171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f665815f830 con 0x7f6648003f60 2024-04-25T02:08:35.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f66577fe640 1 -- 172.21.15.79:0/3769251171 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f664800bb50 con 0x7f6648004d40 2024-04-25T02:08:35.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f66577fe640 1 -- 172.21.15.79:0/3769251171 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f664800df60 con 0x7f665806b2f0 2024-04-25T02:08:35.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.356+0000 7f6657fff640 1 --2- 172.21.15.79:0/3769251171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6648003f60 0x7f6648004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.357+0000 7f665ca4a640 1 --2- 172.21.15.79:0/3769251171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665806b2f0 0x7f66480039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.357+0000 7f665d24b640 1 --2- 172.21.15.79:0/3769251171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6648004d40 0x7f66480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.357+0000 7f6657fff640 1 -- 172.21.15.79:0/3769251171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665806b2f0 msgr2=0x7f66480039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:35.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.357+0000 7f6657fff640 1 --2- 172.21.15.79:0/3769251171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665806b2f0 0x7f66480039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.357+0000 7f6657fff640 1 -- 172.21.15.79:0/3769251171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6648004d40 msgr2=0x7f66480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:35.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.357+0000 7f6657fff640 1 --2- 172.21.15.79:0/3769251171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6648004d40 0x7f66480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.357+0000 7f6657fff640 1 -- 172.21.15.79:0/3769251171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6648003520 con 0x7f6648003f60 2024-04-25T02:08:35.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.357+0000 7f665d24b640 1 --2- 172.21.15.79:0/3769251171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6648004d40 0x7f66480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:35.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.357+0000 7f6657fff640 1 --2- 172.21.15.79:0/3769251171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6648003f60 0x7f6648004800 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f664400c240 tx=0x7f6648005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1ed4151172695e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:35.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.357+0000 7f66577fe640 1 -- 172.21.15.79:0/3769251171 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644007d10 con 0x7f6648003f60 2024-04-25T02:08:35.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.357+0000 7f66577fe640 1 -- 172.21.15.79:0/3769251171 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6644005ad0 con 0x7f6648003f60 2024-04-25T02:08:35.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.358+0000 7f66577fe640 1 -- 172.21.15.79:0/3769251171 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644007070 con 0x7f6648003f60 2024-04-25T02:08:35.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.358+0000 7f665ecae640 1 -- 172.21.15.79:0/3769251171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6648003f60 msgr2=0x7f6648004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.358+0000 7f665ecae640 1 --2- 172.21.15.79:0/3769251171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6648003f60 0x7f6648004800 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f664400c240 tx=0x7f6648005830 comp rx=0 tx=0).stop 2024-04-25T02:08:35.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.358+0000 7f665d24b640 1 -- 172.21.15.79:0/3769251171 reap_dead start 2024-04-25T02:08:35.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.358+0000 7f665ecae640 1 -- 172.21.15.79:0/3769251171 shutdown_connections 2024-04-25T02:08:35.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.358+0000 7f665ecae640 1 -- 172.21.15.79:0/3769251171 >> 172.21.15.79:0/3769251171 conn(0x7f66580b1cd0 msgr2=0x7f66580b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:35.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.358+0000 7f665ecae640 1 -- 172.21.15.79:0/3769251171 shutdown_connections 2024-04-25T02:08:35.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.358+0000 7f665ecae640 1 -- 172.21.15.79:0/3769251171 wait complete. 2024-04-25T02:08:35.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.359+0000 7f665ecae640 1 Processor -- start 2024-04-25T02:08:35.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.359+0000 7f665ecae640 1 -- start start 2024-04-25T02:08:35.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f665ecae640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6648003f60 0x7f66581574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f665ecae640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66581591e0 0x7f6658148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f665ecae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6658159660 0x7f6658149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f665ecae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f665806d160 con 0x7f6658159660 2024-04-25T02:08:35.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f665ecae640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f665806cfe0 con 0x7f6648003f60 2024-04-25T02:08:35.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f665ecae640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f66580b4b50 con 0x7f66581591e0 2024-04-25T02:08:35.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f665d24b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6658159660 0x7f6658149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f665d24b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6658159660 0x7f6658149370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47284/0 (socket says 172.21.15.79:47284) 2024-04-25T02:08:35.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f665d24b640 1 -- 172.21.15.79:0/3119474928 learned_addr learned my addr 172.21.15.79:0/3119474928 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:35.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f665ca4a640 1 --2- 172.21.15.79:0/3119474928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6648003f60 0x7f66581574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f6657fff640 1 --2- 172.21.15.79:0/3119474928 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66581591e0 0x7f6658148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f665d24b640 1 -- 172.21.15.79:0/3119474928 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66581591e0 msgr2=0x7f6658148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f665d24b640 1 --2- 172.21.15.79:0/3119474928 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66581591e0 0x7f6658148e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f665d24b640 1 -- 172.21.15.79:0/3119474928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6648003f60 msgr2=0x7f66581574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f665d24b640 1 --2- 172.21.15.79:0/3119474928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6648003f60 0x7f66581574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.360+0000 7f665d24b640 1 -- 172.21.15.79:0/3119474928 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6658159be0 con 0x7f6658159660 2024-04-25T02:08:35.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.361+0000 7f665d24b640 1 --2- 172.21.15.79:0/3119474928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6658159660 0x7f6658149370 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6650000f80 tx=0x7f665000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:35.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.361+0000 7f66557fa640 1 -- 172.21.15.79:0/3119474928 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650006b50 con 0x7f6658159660 2024-04-25T02:08:35.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.361+0000 7f66557fa640 1 -- 172.21.15.79:0/3119474928 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6650006d10 con 0x7f6658159660 2024-04-25T02:08:35.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.361+0000 7f665ecae640 1 -- 172.21.15.79:0/3119474928 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6658159ec0 con 0x7f6658159660 2024-04-25T02:08:35.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.361+0000 7f66557fa640 1 -- 172.21.15.79:0/3119474928 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650003970 con 0x7f6658159660 2024-04-25T02:08:35.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.361+0000 7f665ecae640 1 -- 172.21.15.79:0/3119474928 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66581579e0 con 0x7f6658159660 2024-04-25T02:08:35.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.362+0000 7f665ecae640 1 -- 172.21.15.79:0/3119474928 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66580690a0 con 0x7f6658159660 2024-04-25T02:08:35.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.362+0000 7f66557fa640 1 -- 172.21.15.79:0/3119474928 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f665001a020 con 0x7f6658159660 2024-04-25T02:08:35.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.363+0000 7f66557fa640 1 --2- 172.21.15.79:0/3119474928 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f663c06be60 0x7f663c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.363+0000 7f665ca4a640 1 --2- 172.21.15.79:0/3119474928 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f663c06be60 0x7f663c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.363+0000 7f66557fa640 1 -- 172.21.15.79:0/3119474928 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f665008a450 con 0x7f6658159660 2024-04-25T02:08:35.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.363+0000 7f665ca4a640 1 --2- 172.21.15.79:0/3119474928 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f663c06be60 0x7f663c06e320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f664c0099e0 tx=0x7f664c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:35.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.367+0000 7f66557fa640 1 -- 172.21.15.79:0/3119474928 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6650058e90 con 0x7f6658159660 2024-04-25T02:08:35.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.540+0000 7f665ecae640 1 -- 172.21.15.79:0/3119474928 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f66580cf4f0 con 0x7f6658159660 2024-04-25T02:08:35.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.541+0000 7f66557fa640 1 -- 172.21.15.79:0/3119474928 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f6650058790 con 0x7f6658159660 2024-04-25T02:08:35.548 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:08:35.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.543+0000 7f665ecae640 1 -- 172.21.15.79:0/3119474928 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f663c06be60 msgr2=0x7f663c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.543+0000 7f665ecae640 1 --2- 172.21.15.79:0/3119474928 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f663c06be60 0x7f663c06e320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f664c0099e0 tx=0x7f664c008040 comp rx=0 tx=0).stop 2024-04-25T02:08:35.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.543+0000 7f665ecae640 1 -- 172.21.15.79:0/3119474928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6658159660 msgr2=0x7f6658149370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.543+0000 7f665ecae640 1 --2- 172.21.15.79:0/3119474928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6658159660 0x7f6658149370 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6650000f80 tx=0x7f665000eb90 comp rx=0 tx=0).stop 2024-04-25T02:08:35.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.543+0000 7f665ecae640 1 -- 172.21.15.79:0/3119474928 shutdown_connections 2024-04-25T02:08:35.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.543+0000 7f665ecae640 1 --2- 172.21.15.79:0/3119474928 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f663c06be60 0x7f663c06e320 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.543+0000 7f665ecae640 1 --2- 172.21.15.79:0/3119474928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6658159660 0x7f6658149370 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.543+0000 7f665ecae640 1 --2- 172.21.15.79:0/3119474928 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66581591e0 0x7f6658148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.543+0000 7f665ecae640 1 --2- 172.21.15.79:0/3119474928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6648003f60 0x7f66581574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.543+0000 7f665ecae640 1 -- 172.21.15.79:0/3119474928 >> 172.21.15.79:0/3119474928 conn(0x7f66580b1cd0 msgr2=0x7f66580b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:35.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.543+0000 7f665ecae640 1 -- 172.21.15.79:0/3119474928 shutdown_connections 2024-04-25T02:08:35.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.543+0000 7f665ecae640 1 -- 172.21.15.79:0/3119474928 wait complete. 2024-04-25T02:08:35.560 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:08:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.651+0000 7f4fc80dd640 1 Processor -- start 2024-04-25T02:08:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.652+0000 7f4fc80dd640 1 -- start start 2024-04-25T02:08:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.652+0000 7f4fc80dd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4fc015e4f0 0x7f4fc00d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.652+0000 7f4fc80dd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f4fc00d10c0 0x7f4fc006bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.652+0000 7f4fc80dd640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc00d1ee0 con 0x7f4fc00cf7f0 2024-04-25T02:08:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.652+0000 7f4fc80dd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4fc00d21c0 con 0x7f4fc015e4f0 2024-04-25T02:08:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.652+0000 7f4fc80dd640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f4fc00d24a0 con 0x7f4fc00d10c0 2024-04-25T02:08:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.653+0000 7f4fc5e79640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4fc015e4f0 0x7f4fc00d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.653+0000 7f4fc5e79640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4fc015e4f0 0x7f4fc00d2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47296/0 (socket says 172.21.15.79:47296) 2024-04-25T02:08:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.653+0000 7f4fc5e79640 1 -- 172.21.15.79:0/1225342453 learned_addr learned my addr 172.21.15.79:0/1225342453 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.653+0000 7f4fc667a640 1 --2- 172.21.15.79:0/1225342453 >> v2:172.21.15.189:3300/0 conn(0x7f4fc00d10c0 0x7f4fc006bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.653+0000 7f4fc5e79640 1 -- 172.21.15.79:0/1225342453 >> v2:172.21.15.189:3300/0 conn(0x7f4fc00d10c0 msgr2=0x7f4fc006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:35.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.653+0000 7f4fc5e79640 1 --2- 172.21.15.79:0/1225342453 >> v2:172.21.15.189:3300/0 conn(0x7f4fc00d10c0 0x7f4fc006bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.653+0000 7f4fc5e79640 1 -- 172.21.15.79:0/1225342453 >> v1:172.21.15.189:6789/0 conn(0x7f4fc00cf7f0 legacy=0x7f4fc00d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:35.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.653+0000 7f4fc5e79640 1 -- 172.21.15.79:0/1225342453 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc00d2780 con 0x7f4fc015e4f0 2024-04-25T02:08:35.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.653+0000 7f4fc667a640 1 --2- 172.21.15.79:0/1225342453 >> v2:172.21.15.189:3300/0 conn(0x7f4fc00d10c0 0x7f4fc006bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:35.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.653+0000 7f4fc5e79640 1 --2- 172.21.15.79:0/1225342453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc015e4f0 0x7f4fc00d2ca0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009870 tx=0x7f4fb802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7806c1f7a737bd0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:35.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.654+0000 7f4fc4e77640 1 -- 172.21.15.79:0/1225342453 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8037070 con 0x7f4fc015e4f0 2024-04-25T02:08:35.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.654+0000 7f4fc4e77640 1 -- 172.21.15.79:0/1225342453 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb8032440 con 0x7f4fc015e4f0 2024-04-25T02:08:35.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.654+0000 7f4fc4e77640 1 -- 172.21.15.79:0/1225342453 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8032810 con 0x7f4fc015e4f0 2024-04-25T02:08:35.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.654+0000 7f4fc80dd640 1 -- 172.21.15.79:0/1225342453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc015e4f0 msgr2=0x7f4fc00d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.654+0000 7f4fc80dd640 1 --2- 172.21.15.79:0/1225342453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc015e4f0 0x7f4fc00d2ca0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009870 tx=0x7f4fb802a270 comp rx=0 tx=0).stop 2024-04-25T02:08:35.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.654+0000 7f4fc80dd640 1 -- 172.21.15.79:0/1225342453 shutdown_connections 2024-04-25T02:08:35.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.654+0000 7f4fc80dd640 1 --2- 172.21.15.79:0/1225342453 >> v2:172.21.15.189:3300/0 conn(0x7f4fc00d10c0 0x7f4fc006bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.654+0000 7f4fc80dd640 1 --2- 172.21.15.79:0/1225342453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc015e4f0 0x7f4fc00d2ca0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.654+0000 7f4fc80dd640 1 -- 172.21.15.79:0/1225342453 >> 172.21.15.79:0/1225342453 conn(0x7f4fc009d4a0 msgr2=0x7f4fc00d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:35.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.654+0000 7f4fc80dd640 1 -- 172.21.15.79:0/1225342453 shutdown_connections 2024-04-25T02:08:35.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.654+0000 7f4fc80dd640 1 -- 172.21.15.79:0/1225342453 wait complete. 2024-04-25T02:08:35.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.655+0000 7f4fc80dd640 1 Processor -- start 2024-04-25T02:08:35.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.655+0000 7f4fc80dd640 1 -- start start 2024-04-25T02:08:35.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.656+0000 7f4fc80dd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fc00cf7f0 0x7f4fc014e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.656+0000 7f4fc80dd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc00d10c0 0x7f4fc014db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.656+0000 7f4fc80dd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4fc015e4f0 0x7f4fc00b90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.656+0000 7f4fc80dd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc00cfc80 con 0x7f4fc00d10c0 2024-04-25T02:08:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.656+0000 7f4fc80dd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc00d50f0 con 0x7f4fc00cf7f0 2024-04-25T02:08:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.656+0000 7f4fc80dd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc00cfe00 con 0x7f4fc015e4f0 2024-04-25T02:08:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.656+0000 7f4fc5678640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc00d10c0 0x7f4fc014db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.656+0000 7f4fc5678640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc00d10c0 0x7f4fc014db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47312/0 (socket says 172.21.15.79:47312) 2024-04-25T02:08:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.656+0000 7f4fc5678640 1 -- 172.21.15.79:0/3049089301 learned_addr learned my addr 172.21.15.79:0/3049089301 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.656+0000 7f4fc5678640 1 -- 172.21.15.79:0/3049089301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4fc015e4f0 msgr2=0x7f4fc00b90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.656+0000 7f4fc5e79640 1 --2- 172.21.15.79:0/3049089301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fc00cf7f0 0x7f4fc014e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.656+0000 7f4fc667a640 1 --2- 172.21.15.79:0/3049089301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4fc015e4f0 0x7f4fc00b90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.656+0000 7f4fc5678640 1 --2- 172.21.15.79:0/3049089301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4fc015e4f0 0x7f4fc00b90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.656+0000 7f4fc5678640 1 -- 172.21.15.79:0/3049089301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fc00cf7f0 msgr2=0x7f4fc014e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.657+0000 7f4fc5678640 1 --2- 172.21.15.79:0/3049089301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fc00cf7f0 0x7f4fc014e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.657+0000 7f4fc5678640 1 -- 172.21.15.79:0/3049089301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc014e910 con 0x7f4fc00d10c0 2024-04-25T02:08:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.657+0000 7f4fc5678640 1 --2- 172.21.15.79:0/3049089301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc00d10c0 0x7f4fc014db80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000b3f0 tx=0x7f4fb000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.657+0000 7f4fb67fc640 1 -- 172.21.15.79:0/3049089301 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0015020 con 0x7f4fc00d10c0 2024-04-25T02:08:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.657+0000 7f4fb67fc640 1 -- 172.21.15.79:0/3049089301 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb0011830 con 0x7f4fc00d10c0 2024-04-25T02:08:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.657+0000 7f4fc80dd640 1 -- 172.21.15.79:0/3049089301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc014ebf0 con 0x7f4fc00d10c0 2024-04-25T02:08:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.657+0000 7f4fb67fc640 1 -- 172.21.15.79:0/3049089301 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0011c20 con 0x7f4fc00d10c0 2024-04-25T02:08:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.657+0000 7f4fc80dd640 1 -- 172.21.15.79:0/3049089301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc014f1b0 con 0x7f4fc00d10c0 2024-04-25T02:08:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.658+0000 7f4fc80dd640 1 -- 172.21.15.79:0/3049089301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc00686c0 con 0x7f4fc00d10c0 2024-04-25T02:08:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.658+0000 7f4fb67fc640 1 -- 172.21.15.79:0/3049089301 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fb0018020 con 0x7f4fc00d10c0 2024-04-25T02:08:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.659+0000 7f4fb67fc640 1 --2- 172.21.15.79:0/3049089301 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4fa406be30 0x7f4fa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.659+0000 7f4fb67fc640 1 -- 172.21.15.79:0/3049089301 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4fb008ada0 con 0x7f4fc00d10c0 2024-04-25T02:08:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.659+0000 7f4fc5e79640 1 --2- 172.21.15.79:0/3049089301 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4fa406be30 0x7f4fa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.659+0000 7f4fc5e79640 1 --2- 172.21.15.79:0/3049089301 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4fa406be30 0x7f4fa406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8034000 tx=0x7f4fb802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:35.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.663+0000 7f4fb67fc640 1 -- 172.21.15.79:0/3049089301 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4fb001f020 con 0x7f4fc00d10c0 2024-04-25T02:08:35.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.835+0000 7f4fc80dd640 1 -- 172.21.15.79:0/3049089301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4fc006c420 con 0x7f4fc00d10c0 2024-04-25T02:08:35.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.835+0000 7f4fb67fc640 1 -- 172.21.15.79:0/3049089301 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f4fb00172c0 con 0x7f4fc00d10c0 2024-04-25T02:08:35.843 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:08:35.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.837+0000 7f4fc80dd640 1 -- 172.21.15.79:0/3049089301 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4fa406be30 msgr2=0x7f4fa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.837+0000 7f4fc80dd640 1 --2- 172.21.15.79:0/3049089301 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4fa406be30 0x7f4fa406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8034000 tx=0x7f4fb802e000 comp rx=0 tx=0).stop 2024-04-25T02:08:35.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.837+0000 7f4fc80dd640 1 -- 172.21.15.79:0/3049089301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc00d10c0 msgr2=0x7f4fc014db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.837+0000 7f4fc80dd640 1 --2- 172.21.15.79:0/3049089301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc00d10c0 0x7f4fc014db80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000b3f0 tx=0x7f4fb000b8b0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.837+0000 7f4fc80dd640 1 -- 172.21.15.79:0/3049089301 shutdown_connections 2024-04-25T02:08:35.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.837+0000 7f4fc80dd640 1 --2- 172.21.15.79:0/3049089301 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4fa406be30 0x7f4fa406e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.837+0000 7f4fc80dd640 1 --2- 172.21.15.79:0/3049089301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4fc015e4f0 0x7f4fc00b90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.837+0000 7f4fc80dd640 1 --2- 172.21.15.79:0/3049089301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc00d10c0 0x7f4fc014db80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.837+0000 7f4fc80dd640 1 --2- 172.21.15.79:0/3049089301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fc00cf7f0 0x7f4fc014e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.837+0000 7f4fc80dd640 1 -- 172.21.15.79:0/3049089301 >> 172.21.15.79:0/3049089301 conn(0x7f4fc009d4a0 msgr2=0x7f4fc015a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:35.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.837+0000 7f4fc80dd640 1 -- 172.21.15.79:0/3049089301 shutdown_connections 2024-04-25T02:08:35.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.837+0000 7f4fc80dd640 1 -- 172.21.15.79:0/3049089301 wait complete. 2024-04-25T02:08:35.855 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:08:35.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.947+0000 7fa8a8b90640 1 Processor -- start 2024-04-25T02:08:35.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.947+0000 7fa8a8b90640 1 -- start start 2024-04-25T02:08:35.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.948+0000 7fa8a8b90640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a406b2f0 0x7fa8a40b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.948+0000 7fa8a8b90640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa8a406e6b0 0x7fa8a415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.948+0000 7fa8a8b90640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8a415ec20 con 0x7fa8a40cf7a0 2024-04-25T02:08:35.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.948+0000 7fa8a8b90640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa8a415f830 con 0x7fa8a406e6b0 2024-04-25T02:08:35.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.948+0000 7fa8a8b90640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa8a415ef00 con 0x7fa8a406b2f0 2024-04-25T02:08:35.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.948+0000 7fa8a2d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa8a406e6b0 0x7fa8a415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.948+0000 7fa8a2d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa8a406e6b0 0x7fa8a415b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47328/0 (socket says 172.21.15.79:47328) 2024-04-25T02:08:35.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.948+0000 7fa8a2d9d640 1 -- 172.21.15.79:0/243251154 learned_addr learned my addr 172.21.15.79:0/243251154 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:35.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.948+0000 7fa8a1d9b640 1 --1- 172.21.15.79:0/243251154 >> v1:172.21.15.79:6789/0 conn(0x7fa8a40cf7a0 0x7fa8a406b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48548/0 (socket says 172.21.15.79:48548) 2024-04-25T02:08:35.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.948+0000 7fa8a259c640 1 --2- 172.21.15.79:0/243251154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a406b2f0 0x7fa8a40b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.949+0000 7fa8a2d9d640 1 -- 172.21.15.79:0/243251154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a406b2f0 msgr2=0x7fa8a40b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:35.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.949+0000 7fa8a2d9d640 1 --2- 172.21.15.79:0/243251154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a406b2f0 0x7fa8a40b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.949+0000 7fa8a2d9d640 1 -- 172.21.15.79:0/243251154 >> v1:172.21.15.79:6789/0 conn(0x7fa8a40cf7a0 legacy=0x7fa8a406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.949+0000 7fa8a2d9d640 1 -- 172.21.15.79:0/243251154 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a415f1e0 con 0x7fa8a406e6b0 2024-04-25T02:08:35.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.949+0000 7fa8a159a640 1 -- 172.21.15.79:0/243251154 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459827889 0 0) 0x7fa8a415ec20 con 0x7fa8a40cf7a0 2024-04-25T02:08:35.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.949+0000 7fa8a2d9d640 1 --2- 172.21.15.79:0/243251154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a406e6b0 0x7fa8a415b2d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009e50 tx=0x7fa89c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f433117eb8bdaa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:35.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.949+0000 7fa8a159a640 1 -- 172.21.15.79:0/243251154 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c036070 con 0x7fa8a406e6b0 2024-04-25T02:08:35.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.949+0000 7fa8a159a640 1 -- 172.21.15.79:0/243251154 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa89c031600 con 0x7fa8a406e6b0 2024-04-25T02:08:35.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.949+0000 7fa8a159a640 1 -- 172.21.15.79:0/243251154 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c0319d0 con 0x7fa8a406e6b0 2024-04-25T02:08:35.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.950+0000 7fa8a8b90640 1 -- 172.21.15.79:0/243251154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a406e6b0 msgr2=0x7fa8a415b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.950+0000 7fa8a8b90640 1 --2- 172.21.15.79:0/243251154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a406e6b0 0x7fa8a415b2d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009e50 tx=0x7fa89c02a680 comp rx=0 tx=0).stop 2024-04-25T02:08:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.950+0000 7fa8a8b90640 1 -- 172.21.15.79:0/243251154 shutdown_connections 2024-04-25T02:08:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.950+0000 7fa8a8b90640 1 --2- 172.21.15.79:0/243251154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a406e6b0 0x7fa8a415b2d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.950+0000 7fa8a8b90640 1 --2- 172.21.15.79:0/243251154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a406b2f0 0x7fa8a40b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.950+0000 7fa8a8b90640 1 -- 172.21.15.79:0/243251154 >> 172.21.15.79:0/243251154 conn(0x7fa8a40b1cd0 msgr2=0x7fa8a40b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.950+0000 7fa8a8b90640 1 -- 172.21.15.79:0/243251154 shutdown_connections 2024-04-25T02:08:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.950+0000 7fa8a8b90640 1 -- 172.21.15.79:0/243251154 wait complete. 2024-04-25T02:08:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.951+0000 7fa8a8b90640 1 Processor -- start 2024-04-25T02:08:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.951+0000 7fa8a8b90640 1 -- start start 2024-04-25T02:08:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a8b90640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a406b2f0 0x7fa8a414ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a8b90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a406e6b0 0x7fa8a4072770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a8b90640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8a40cf7a0 0x7fa8a41588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a8b90640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a406d160 con 0x7fa8a406e6b0 2024-04-25T02:08:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a8b90640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a406cfe0 con 0x7fa8a40cf7a0 2024-04-25T02:08:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a8b90640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa8a415b810 con 0x7fa8a406b2f0 2024-04-25T02:08:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a406e6b0 0x7fa8a4072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a406e6b0 0x7fa8a4072770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47338/0 (socket says 172.21.15.79:47338) 2024-04-25T02:08:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a1d9b640 1 -- 172.21.15.79:0/3848367463 learned_addr learned my addr 172.21.15.79:0/3848367463 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a1d9b640 1 -- 172.21.15.79:0/3848367463 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a406b2f0 msgr2=0x7fa8a414ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a259c640 1 --2- 172.21.15.79:0/3848367463 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a406b2f0 0x7fa8a414ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a1d9b640 1 --2- 172.21.15.79:0/3848367463 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a406b2f0 0x7fa8a414ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a2d9d640 1 --2- 172.21.15.79:0/3848367463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8a40cf7a0 0x7fa8a41588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a1d9b640 1 -- 172.21.15.79:0/3848367463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8a40cf7a0 msgr2=0x7fa8a41588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a1d9b640 1 --2- 172.21.15.79:0/3848367463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8a40cf7a0 0x7fa8a41588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a1d9b640 1 -- 172.21.15.79:0/3848367463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a4072cb0 con 0x7fa8a406e6b0 2024-04-25T02:08:35.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.952+0000 7fa8a259c640 1 --2- 172.21.15.79:0/3848367463 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a406b2f0 0x7fa8a414ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:35.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.953+0000 7fa8a1d9b640 1 --2- 172.21.15.79:0/3848367463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a406e6b0 0x7fa8a4072770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa89800c3f0 tx=0x7fa89800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:35.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.953+0000 7fa892ffd640 1 -- 172.21.15.79:0/3848367463 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8980074e0 con 0x7fa8a406e6b0 2024-04-25T02:08:35.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.953+0000 7fa892ffd640 1 -- 172.21.15.79:0/3848367463 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8980047e0 con 0x7fa8a406e6b0 2024-04-25T02:08:35.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.953+0000 7fa8a8b90640 1 -- 172.21.15.79:0/3848367463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a4158e00 con 0x7fa8a406e6b0 2024-04-25T02:08:35.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.953+0000 7fa892ffd640 1 -- 172.21.15.79:0/3848367463 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa898004c10 con 0x7fa8a406e6b0 2024-04-25T02:08:35.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.953+0000 7fa8a8b90640 1 -- 172.21.15.79:0/3848367463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a415c300 con 0x7fa8a406e6b0 2024-04-25T02:08:35.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.954+0000 7fa8a8b90640 1 -- 172.21.15.79:0/3848367463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a40690a0 con 0x7fa8a406e6b0 2024-04-25T02:08:35.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.954+0000 7fa892ffd640 1 -- 172.21.15.79:0/3848367463 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa898011070 con 0x7fa8a406e6b0 2024-04-25T02:08:35.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.954+0000 7fa892ffd640 1 --2- 172.21.15.79:0/3848367463 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa88406be60 0x7fa88406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:35.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.955+0000 7fa892ffd640 1 -- 172.21.15.79:0/3848367463 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa89808aab0 con 0x7fa8a406e6b0 2024-04-25T02:08:35.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.955+0000 7fa8a259c640 1 --2- 172.21.15.79:0/3848367463 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa88406be60 0x7fa88406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:35.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.955+0000 7fa8a259c640 1 --2- 172.21.15.79:0/3848367463 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa88406be60 0x7fa88406e320 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa894006fd0 tx=0x7fa894008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:35.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:35.959+0000 7fa892ffd640 1 -- 172.21.15.79:0/3848367463 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa8a4072cb0 con 0x7fa8a406e6b0 2024-04-25T02:08:36.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.131+0000 7fa8a8b90640 1 -- 172.21.15.79:0/3848367463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa8a40b3560 con 0x7fa8a406e6b0 2024-04-25T02:08:36.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.131+0000 7fa892ffd640 1 -- 172.21.15.79:0/3848367463 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fa89801a2b0 con 0x7fa8a406e6b0 2024-04-25T02:08:36.138 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:08:36.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.133+0000 7fa8a8b90640 1 -- 172.21.15.79:0/3848367463 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa88406be60 msgr2=0x7fa88406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.133+0000 7fa8a8b90640 1 --2- 172.21.15.79:0/3848367463 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa88406be60 0x7fa88406e320 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa894006fd0 tx=0x7fa894008040 comp rx=0 tx=0).stop 2024-04-25T02:08:36.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.133+0000 7fa8a8b90640 1 -- 172.21.15.79:0/3848367463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a406e6b0 msgr2=0x7fa8a4072770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.133+0000 7fa8a8b90640 1 --2- 172.21.15.79:0/3848367463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a406e6b0 0x7fa8a4072770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa89800c3f0 tx=0x7fa89800c8b0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.133+0000 7fa8a8b90640 1 -- 172.21.15.79:0/3848367463 shutdown_connections 2024-04-25T02:08:36.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.133+0000 7fa8a8b90640 1 --2- 172.21.15.79:0/3848367463 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa88406be60 0x7fa88406e320 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.133+0000 7fa8a8b90640 1 --2- 172.21.15.79:0/3848367463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8a40cf7a0 0x7fa8a41588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.133+0000 7fa8a8b90640 1 --2- 172.21.15.79:0/3848367463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8a406e6b0 0x7fa8a4072770 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.133+0000 7fa8a8b90640 1 --2- 172.21.15.79:0/3848367463 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8a406b2f0 0x7fa8a414ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.133+0000 7fa8a8b90640 1 -- 172.21.15.79:0/3848367463 >> 172.21.15.79:0/3848367463 conn(0x7fa8a40b1cd0 msgr2=0x7fa8a40b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:36.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.133+0000 7fa8a8b90640 1 -- 172.21.15.79:0/3848367463 shutdown_connections 2024-04-25T02:08:36.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.133+0000 7fa8a8b90640 1 -- 172.21.15.79:0/3848367463 wait complete. 2024-04-25T02:08:36.151 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:08:36.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.240+0000 7f4f7ffee640 1 Processor -- start 2024-04-25T02:08:36.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.240+0000 7f4f7ffee640 1 -- start start 2024-04-25T02:08:36.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.241+0000 7f4f7ffee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f7806df50 0x7f4f7806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.241+0000 7f4f7ffee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4f780b2d30 0x7f4f780b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.241+0000 7f4f7ffee640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f78071e00 con 0x7f4f78143bc0 2024-04-25T02:08:36.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.241+0000 7f4f7ffee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4f7806e8f0 con 0x7f4f780b2d30 2024-04-25T02:08:36.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.241+0000 7f4f7ffee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4f78072cb0 con 0x7f4f7806df50 2024-04-25T02:08:36.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.241+0000 7f4f7e58b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4f780b2d30 0x7f4f780b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.241+0000 7f4f7e58b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4f780b2d30 0x7f4f780b3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47342/0 (socket says 172.21.15.79:47342) 2024-04-25T02:08:36.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.241+0000 7f4f7e58b640 1 -- 172.21.15.79:0/1366216758 learned_addr learned my addr 172.21.15.79:0/1366216758 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:36.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.241+0000 7f4f7d589640 1 --2- 172.21.15.79:0/1366216758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f7806df50 0x7f4f7806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.242+0000 7f4f7e58b640 1 -- 172.21.15.79:0/1366216758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f7806df50 msgr2=0x7f4f7806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:36.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.242+0000 7f4f7e58b640 1 --2- 172.21.15.79:0/1366216758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f7806df50 0x7f4f7806e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.242+0000 7f4f7e58b640 1 -- 172.21.15.79:0/1366216758 >> v1:172.21.15.189:6789/0 conn(0x7f4f78143bc0 legacy=0x7f4f7815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:36.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.242+0000 7f4f7e58b640 1 -- 172.21.15.79:0/1366216758 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f780720a0 con 0x7f4f780b2d30 2024-04-25T02:08:36.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.242+0000 7f4f7e58b640 1 --2- 172.21.15.79:0/1366216758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f780b2d30 0x7f4f780b3190 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009870 tx=0x7f4f7002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d04d6151d2ac71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:36.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.242+0000 7f4f7cd88640 1 -- 172.21.15.79:0/1366216758 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70037070 con 0x7f4f780b2d30 2024-04-25T02:08:36.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.242+0000 7f4f7cd88640 1 -- 172.21.15.79:0/1366216758 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f70032440 con 0x7f4f780b2d30 2024-04-25T02:08:36.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.242+0000 7f4f7cd88640 1 -- 172.21.15.79:0/1366216758 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70032810 con 0x7f4f780b2d30 2024-04-25T02:08:36.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.243+0000 7f4f7ffee640 1 -- 172.21.15.79:0/1366216758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f780b2d30 msgr2=0x7f4f780b3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.243+0000 7f4f7ffee640 1 --2- 172.21.15.79:0/1366216758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f780b2d30 0x7f4f780b3190 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009870 tx=0x7f4f7002a180 comp rx=0 tx=0).stop 2024-04-25T02:08:36.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.243+0000 7f4f7ffee640 1 -- 172.21.15.79:0/1366216758 shutdown_connections 2024-04-25T02:08:36.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.243+0000 7f4f7ffee640 1 --2- 172.21.15.79:0/1366216758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f780b2d30 0x7f4f780b3190 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.243+0000 7f4f7ffee640 1 --2- 172.21.15.79:0/1366216758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f7806df50 0x7f4f7806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.243+0000 7f4f7ffee640 1 -- 172.21.15.79:0/1366216758 >> 172.21.15.79:0/1366216758 conn(0x7f4f780cfc80 msgr2=0x7f4f780d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:36.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.243+0000 7f4f7ffee640 1 -- 172.21.15.79:0/1366216758 shutdown_connections 2024-04-25T02:08:36.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.243+0000 7f4f7ffee640 1 -- 172.21.15.79:0/1366216758 wait complete. 2024-04-25T02:08:36.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.244+0000 7f4f7ffee640 1 Processor -- start 2024-04-25T02:08:36.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.244+0000 7f4f7ffee640 1 -- start start 2024-04-25T02:08:36.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.245+0000 7f4f7ffee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f7806df50 0x7f4f78159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.245+0000 7f4f7ffee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f780b2d30 0x7f4f7813f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.245+0000 7f4f7ffee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f78143bc0 0x7f4f7815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.245+0000 7f4f7ffee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4f78072940 con 0x7f4f78143bc0 2024-04-25T02:08:36.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.245+0000 7f4f7ffee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4f78072660 con 0x7f4f7806df50 2024-04-25T02:08:36.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.245+0000 7f4f7ffee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4f78143fa0 con 0x7f4f780b2d30 2024-04-25T02:08:36.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.245+0000 7f4f7e58b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f78143bc0 0x7f4f7815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.245+0000 7f4f7e58b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f78143bc0 0x7f4f7815aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47350/0 (socket says 172.21.15.79:47350) 2024-04-25T02:08:36.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.245+0000 7f4f7e58b640 1 -- 172.21.15.79:0/703529572 learned_addr learned my addr 172.21.15.79:0/703529572 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:36.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.245+0000 7f4f7e58b640 1 -- 172.21.15.79:0/703529572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f780b2d30 msgr2=0x7f4f7813f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.245+0000 7f4f7e58b640 1 --2- 172.21.15.79:0/703529572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f780b2d30 0x7f4f7813f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.245+0000 7f4f7e58b640 1 -- 172.21.15.79:0/703529572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f7806df50 msgr2=0x7f4f78159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.245+0000 7f4f7e58b640 1 --2- 172.21.15.79:0/703529572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f7806df50 0x7f4f78159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.245+0000 7f4f7e58b640 1 -- 172.21.15.79:0/703529572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f78159e40 con 0x7f4f78143bc0 2024-04-25T02:08:36.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.245+0000 7f4f7e58b640 1 --2- 172.21.15.79:0/703529572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f78143bc0 0x7f4f7815aee0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4f7002a1c0 tx=0x7f4f700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:36.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.246+0000 7f4f6e7fc640 1 -- 172.21.15.79:0/703529572 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70041020 con 0x7f4f78143bc0 2024-04-25T02:08:36.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.246+0000 7f4f6e7fc640 1 -- 172.21.15.79:0/703529572 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f70030990 con 0x7f4f78143bc0 2024-04-25T02:08:36.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.246+0000 7f4f7ffee640 1 -- 172.21.15.79:0/703529572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7815a120 con 0x7f4f78143bc0 2024-04-25T02:08:36.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.246+0000 7f4f6e7fc640 1 -- 172.21.15.79:0/703529572 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70037040 con 0x7f4f78143bc0 2024-04-25T02:08:36.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.246+0000 7f4f7ffee640 1 -- 172.21.15.79:0/703529572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7815a6e0 con 0x7f4f78143bc0 2024-04-25T02:08:36.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.246+0000 7f4f7ffee640 1 -- 172.21.15.79:0/703529572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f780690a0 con 0x7f4f78143bc0 2024-04-25T02:08:36.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.247+0000 7f4f6e7fc640 1 -- 172.21.15.79:0/703529572 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f70044020 con 0x7f4f78143bc0 2024-04-25T02:08:36.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.247+0000 7f4f6e7fc640 1 --2- 172.21.15.79:0/703529572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f5c06be30 0x7f4f5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.247+0000 7f4f6e7fc640 1 -- 172.21.15.79:0/703529572 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4f700ab730 con 0x7f4f78143bc0 2024-04-25T02:08:36.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.247+0000 7f4f7dd8a640 1 --2- 172.21.15.79:0/703529572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f5c06be30 0x7f4f5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.248+0000 7f4f7dd8a640 1 --2- 172.21.15.79:0/703529572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f5c06be30 0x7f4f5c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4f78141c00 tx=0x7f4f74007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:36.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.252+0000 7f4f6e7fc640 1 -- 172.21.15.79:0/703529572 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4f7004b030 con 0x7f4f78143bc0 2024-04-25T02:08:36.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.462+0000 7f4f7ffee640 1 -- 172.21.15.79:0/703529572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f78142dc0 con 0x7f4f78143bc0 2024-04-25T02:08:36.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.463+0000 7f4f6e7fc640 1 -- 172.21.15.79:0/703529572 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7f4f7007a170 con 0x7f4f78143bc0 2024-04-25T02:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/465663373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":465663373},{"type":"v1","addr":"172.21.15.189:6833","nonce":465663373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2093278785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2093278785},{"type":"v1","addr":"172.21.15.79:6836","nonce":2093278785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2415912880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2415912880},{"type":"v1","addr":"172.21.15.189:6835","nonce":2415912880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:07:59.452096+0000","modified":"2024-04-25T02:08:01.458029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2942986974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2942986974},{"type":"v1","addr":"172.21.15.79:6837","nonce":2942986974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-25T02:08:36.471 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2024-04-25T02:08:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.465+0000 7f4f7ffee640 1 -- 172.21.15.79:0/703529572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f5c06be30 msgr2=0x7f4f5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.465+0000 7f4f7ffee640 1 --2- 172.21.15.79:0/703529572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f5c06be30 0x7f4f5c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4f78141c00 tx=0x7f4f74007d30 comp rx=0 tx=0).stop 2024-04-25T02:08:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.465+0000 7f4f7ffee640 1 -- 172.21.15.79:0/703529572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f78143bc0 msgr2=0x7f4f7815aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.465+0000 7f4f7ffee640 1 --2- 172.21.15.79:0/703529572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f78143bc0 0x7f4f7815aee0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4f7002a1c0 tx=0x7f4f700046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.465+0000 7f4f7ffee640 1 -- 172.21.15.79:0/703529572 shutdown_connections 2024-04-25T02:08:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.465+0000 7f4f7ffee640 1 --2- 172.21.15.79:0/703529572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f5c06be30 0x7f4f5c06e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.465+0000 7f4f7ffee640 1 --2- 172.21.15.79:0/703529572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f78143bc0 0x7f4f7815aee0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.465+0000 7f4f7ffee640 1 --2- 172.21.15.79:0/703529572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f780b2d30 0x7f4f7813f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.465+0000 7f4f7ffee640 1 --2- 172.21.15.79:0/703529572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f7806df50 0x7f4f78159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.465+0000 7f4f7ffee640 1 -- 172.21.15.79:0/703529572 >> 172.21.15.79:0/703529572 conn(0x7f4f780cfc80 msgr2=0x7f4f780d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.465+0000 7f4f7ffee640 1 -- 172.21.15.79:0/703529572 shutdown_connections 2024-04-25T02:08:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.465+0000 7f4f7ffee640 1 -- 172.21.15.79:0/703529572 wait complete. 2024-04-25T02:08:36.483 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:36.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.572+0000 7fc4eacbd640 1 Processor -- start 2024-04-25T02:08:36.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.572+0000 7fc4eacbd640 1 -- start start 2024-04-25T02:08:36.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.573+0000 7fc4eacbd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc4e406df50 0x7fc4e406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.573+0000 7fc4eacbd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4e4071e00 con 0x7fc4e40b2d30 2024-04-25T02:08:36.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.573+0000 7fc4eacbd640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4e40720a0 con 0x7fc4e4143bc0 2024-04-25T02:08:36.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.573+0000 7fc4eacbd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc4e406e8f0 con 0x7fc4e406df50 2024-04-25T02:08:36.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.573+0000 7fc4e3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc4e406df50 0x7fc4e406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.573+0000 7fc4e925a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc4e40b2d30 0x7fc4e40b31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48550/0 (socket says 172.21.15.79:48550) 2024-04-25T02:08:36.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.573+0000 7fc4e925a640 1 -- 172.21.15.79:0/285196352 learned_addr learned my addr 172.21.15.79:0/285196352 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:36.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.573+0000 7fc4e3fff640 1 -- 172.21.15.79:0/285196352 >> v1:172.21.15.189:6789/0 conn(0x7fc4e4143bc0 legacy=0x7fc4e415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:36.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.573+0000 7fc4e3fff640 1 -- 172.21.15.79:0/285196352 >> v1:172.21.15.79:6789/0 conn(0x7fc4e40b2d30 legacy=0x7fc4e40b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.573+0000 7fc4e3fff640 1 -- 172.21.15.79:0/285196352 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e4072380 con 0x7fc4e406df50 2024-04-25T02:08:36.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.574+0000 7fc4e3fff640 1 --2- 172.21.15.79:0/285196352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4e406df50 0x7fc4e406e3b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00097a0 tx=0x7fc4d002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50b7648d2daa510 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:36.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.574+0000 7fc4e37fe640 1 -- 172.21.15.79:0/285196352 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0037070 con 0x7fc4e406df50 2024-04-25T02:08:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.574+0000 7fc4e37fe640 1 -- 172.21.15.79:0/285196352 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d002ae50 con 0x7fc4e406df50 2024-04-25T02:08:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.574+0000 7fc4e37fe640 1 -- 172.21.15.79:0/285196352 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0032660 con 0x7fc4e406df50 2024-04-25T02:08:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.574+0000 7fc4eacbd640 1 -- 172.21.15.79:0/285196352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4e406df50 msgr2=0x7fc4e406e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.574+0000 7fc4eacbd640 1 --2- 172.21.15.79:0/285196352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4e406df50 0x7fc4e406e3b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00097a0 tx=0x7fc4d002a140 comp rx=0 tx=0).stop 2024-04-25T02:08:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.574+0000 7fc4eacbd640 1 -- 172.21.15.79:0/285196352 shutdown_connections 2024-04-25T02:08:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.574+0000 7fc4eacbd640 1 --2- 172.21.15.79:0/285196352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4e406df50 0x7fc4e406e3b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.574+0000 7fc4eacbd640 1 -- 172.21.15.79:0/285196352 >> 172.21.15.79:0/285196352 conn(0x7fc4e40cfc80 msgr2=0x7fc4e40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.574+0000 7fc4eacbd640 1 -- 172.21.15.79:0/285196352 shutdown_connections 2024-04-25T02:08:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.574+0000 7fc4eacbd640 1 -- 172.21.15.79:0/285196352 wait complete. 2024-04-25T02:08:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.575+0000 7fc4eacbd640 1 Processor -- start 2024-04-25T02:08:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.576+0000 7fc4eacbd640 1 -- start start 2024-04-25T02:08:36.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.576+0000 7fc4eacbd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4e406df50 0x7fc4e413f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.576+0000 7fc4eacbd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4e40b2d30 0x7fc4e41f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.576+0000 7fc4eacbd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4e4143bc0 0x7fc4e41f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.576+0000 7fc4eacbd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e4072940 con 0x7fc4e406df50 2024-04-25T02:08:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.576+0000 7fc4eacbd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e4072cb0 con 0x7fc4e4143bc0 2024-04-25T02:08:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.576+0000 7fc4eacbd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc4e4143fa0 con 0x7fc4e40b2d30 2024-04-25T02:08:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.576+0000 7fc4e8a59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4e406df50 0x7fc4e413f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.577+0000 7fc4e8a59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4e406df50 0x7fc4e413f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47362/0 (socket says 172.21.15.79:47362) 2024-04-25T02:08:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.577+0000 7fc4e8a59640 1 -- 172.21.15.79:0/1425459918 learned_addr learned my addr 172.21.15.79:0/1425459918 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.577+0000 7fc4e3fff640 1 --2- 172.21.15.79:0/1425459918 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4e40b2d30 0x7fc4e41f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.577+0000 7fc4e8a59640 1 -- 172.21.15.79:0/1425459918 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4e40b2d30 msgr2=0x7fc4e41f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.577+0000 7fc4e925a640 1 --2- 172.21.15.79:0/1425459918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4e4143bc0 0x7fc4e41f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.577+0000 7fc4e8a59640 1 --2- 172.21.15.79:0/1425459918 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4e40b2d30 0x7fc4e41f4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.577+0000 7fc4e8a59640 1 -- 172.21.15.79:0/1425459918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4e4143bc0 msgr2=0x7fc4e41f3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.577+0000 7fc4e8a59640 1 --2- 172.21.15.79:0/1425459918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4e4143bc0 0x7fc4e41f3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.577+0000 7fc4e8a59640 1 -- 172.21.15.79:0/1425459918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e41f3dc0 con 0x7fc4e406df50 2024-04-25T02:08:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.577+0000 7fc4e8a59640 1 --2- 172.21.15.79:0/1425459918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4e406df50 0x7fc4e413f3e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800c410 tx=0x7fc4d800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.577+0000 7fc4e17fa640 1 -- 172.21.15.79:0/1425459918 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8017070 con 0x7fc4e406df50 2024-04-25T02:08:36.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.577+0000 7fc4e17fa640 1 -- 172.21.15.79:0/1425459918 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d80035f0 con 0x7fc4e406df50 2024-04-25T02:08:36.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.577+0000 7fc4e17fa640 1 -- 172.21.15.79:0/1425459918 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8003a20 con 0x7fc4e406df50 2024-04-25T02:08:36.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.577+0000 7fc4eacbd640 1 -- 172.21.15.79:0/1425459918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e41f40a0 con 0x7fc4e406df50 2024-04-25T02:08:36.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.577+0000 7fc4eacbd640 1 -- 172.21.15.79:0/1425459918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e41f4660 con 0x7fc4e406df50 2024-04-25T02:08:36.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.578+0000 7fc4eacbd640 1 -- 172.21.15.79:0/1425459918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e40707d0 con 0x7fc4e406df50 2024-04-25T02:08:36.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.579+0000 7fc4e17fa640 1 -- 172.21.15.79:0/1425459918 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4d801a070 con 0x7fc4e406df50 2024-04-25T02:08:36.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.579+0000 7fc4e17fa640 1 --2- 172.21.15.79:0/1425459918 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc4c806be30 0x7fc4c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.579+0000 7fc4e17fa640 1 -- 172.21.15.79:0/1425459918 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc4d808a320 con 0x7fc4e406df50 2024-04-25T02:08:36.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.579+0000 7fc4e3fff640 1 --2- 172.21.15.79:0/1425459918 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc4c806be30 0x7fc4c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.579+0000 7fc4e3fff640 1 --2- 172.21.15.79:0/1425459918 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc4c806be30 0x7fc4c806e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0034000 tx=0x7fc4d002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:36.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.583+0000 7fc4e17fa640 1 -- 172.21.15.79:0/1425459918 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc4e40707d0 con 0x7fc4e406df50 2024-04-25T02:08:36.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.757+0000 7fc4eacbd640 1 -- 172.21.15.79:0/1425459918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4e4144af0 con 0x7fc4e406df50 2024-04-25T02:08:36.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.758+0000 7fc4e17fa640 1 -- 172.21.15.79:0/1425459918 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7fc4d8087100 con 0x7fc4e406df50 2024-04-25T02:08:36.765 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:36.765 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.760+0000 7fc4eacbd640 1 -- 172.21.15.79:0/1425459918 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc4c806be30 msgr2=0x7fc4c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.760+0000 7fc4eacbd640 1 --2- 172.21.15.79:0/1425459918 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc4c806be30 0x7fc4c806e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0034000 tx=0x7fc4d002e000 comp rx=0 tx=0).stop 2024-04-25T02:08:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.760+0000 7fc4eacbd640 1 -- 172.21.15.79:0/1425459918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4e406df50 msgr2=0x7fc4e413f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.760+0000 7fc4eacbd640 1 --2- 172.21.15.79:0/1425459918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4e406df50 0x7fc4e413f3e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800c410 tx=0x7fc4d800c8d0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.760+0000 7fc4eacbd640 1 -- 172.21.15.79:0/1425459918 shutdown_connections 2024-04-25T02:08:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.760+0000 7fc4eacbd640 1 --2- 172.21.15.79:0/1425459918 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc4c806be30 0x7fc4c806e2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.760+0000 7fc4eacbd640 1 --2- 172.21.15.79:0/1425459918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4e4143bc0 0x7fc4e41f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.760+0000 7fc4eacbd640 1 --2- 172.21.15.79:0/1425459918 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4e40b2d30 0x7fc4e41f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.760+0000 7fc4eacbd640 1 --2- 172.21.15.79:0/1425459918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4e406df50 0x7fc4e413f3e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.760+0000 7fc4eacbd640 1 -- 172.21.15.79:0/1425459918 >> 172.21.15.79:0/1425459918 conn(0x7fc4e40cfc80 msgr2=0x7fc4e40ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.760+0000 7fc4eacbd640 1 -- 172.21.15.79:0/1425459918 shutdown_connections 2024-04-25T02:08:36.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.760+0000 7fc4eacbd640 1 -- 172.21.15.79:0/1425459918 wait complete. 2024-04-25T02:08:36.779 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:08:36.779 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:08:36.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.868+0000 7f4587a64640 1 Processor -- start 2024-04-25T02:08:36.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.868+0000 7f4587a64640 1 -- start start 2024-04-25T02:08:36.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.869+0000 7f4587a64640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f458006df50 0x7f458006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.869+0000 7f4587a64640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4580071e00 con 0x7f4580143bc0 2024-04-25T02:08:36.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.869+0000 7f4587a64640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45800720a0 con 0x7f45800b2d30 2024-04-25T02:08:36.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.869+0000 7f4587a64640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f458006e8f0 con 0x7f458006df50 2024-04-25T02:08:36.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.869+0000 7f4584fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f458006df50 0x7f458006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.869+0000 7f4585800640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4580143bc0 0x7f458015f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48564/0 (socket says 172.21.15.79:48564) 2024-04-25T02:08:36.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.869+0000 7f4585800640 1 -- 172.21.15.79:0/2058384752 learned_addr learned my addr 172.21.15.79:0/2058384752 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:36.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.869+0000 7f4584fff640 1 -- 172.21.15.79:0/2058384752 >> v1:172.21.15.189:6789/0 conn(0x7f45800b2d30 legacy=0x7f45800b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.869+0000 7f4584fff640 1 -- 172.21.15.79:0/2058384752 >> v1:172.21.15.79:6789/0 conn(0x7f4580143bc0 legacy=0x7f458015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.869+0000 7f4584fff640 1 -- 172.21.15.79:0/2058384752 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4580072380 con 0x7f458006df50 2024-04-25T02:08:36.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.869+0000 7f4577fff640 1 -- 172.21.15.79:0/2058384752 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 180961751 0 0) 0x7f4580071e00 con 0x7f4580143bc0 2024-04-25T02:08:36.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.870+0000 7f4584fff640 1 --2- 172.21.15.79:0/2058384752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458006df50 0x7f458006e3b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f45700097a0 tx=0x7f457002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3213dc5aa707a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:36.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.870+0000 7f4577fff640 1 -- 172.21.15.79:0/2058384752 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570037070 con 0x7f458006df50 2024-04-25T02:08:36.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.870+0000 7f4577fff640 1 -- 172.21.15.79:0/2058384752 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4570032440 con 0x7f458006df50 2024-04-25T02:08:36.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.870+0000 7f4577fff640 1 -- 172.21.15.79:0/2058384752 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570032810 con 0x7f458006df50 2024-04-25T02:08:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.871+0000 7f4587a64640 1 -- 172.21.15.79:0/2058384752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458006df50 msgr2=0x7f458006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.871+0000 7f4587a64640 1 --2- 172.21.15.79:0/2058384752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458006df50 0x7f458006e3b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f45700097a0 tx=0x7f457002a1a0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.871+0000 7f4587a64640 1 -- 172.21.15.79:0/2058384752 shutdown_connections 2024-04-25T02:08:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.871+0000 7f4587a64640 1 --2- 172.21.15.79:0/2058384752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458006df50 0x7f458006e3b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.871+0000 7f4587a64640 1 -- 172.21.15.79:0/2058384752 >> 172.21.15.79:0/2058384752 conn(0x7f45800cfc80 msgr2=0x7f45800d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.871+0000 7f4587a64640 1 -- 172.21.15.79:0/2058384752 shutdown_connections 2024-04-25T02:08:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.871+0000 7f4587a64640 1 -- 172.21.15.79:0/2058384752 wait complete. 2024-04-25T02:08:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.872+0000 7f4587a64640 1 Processor -- start 2024-04-25T02:08:36.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.872+0000 7f4587a64640 1 -- start start 2024-04-25T02:08:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4587a64640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f458006df50 0x7f45800aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4587a64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45800b2d30 0x7f4580141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4587a64640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4580143bc0 0x7f45801ef990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4587a64640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4580072940 con 0x7f45800b2d30 2024-04-25T02:08:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4587a64640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4580072cb0 con 0x7f4580143bc0 2024-04-25T02:08:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4587a64640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4580143fa0 con 0x7f458006df50 2024-04-25T02:08:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4584fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45800b2d30 0x7f4580141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4584fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45800b2d30 0x7f4580141090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47384/0 (socket says 172.21.15.79:47384) 2024-04-25T02:08:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4584fff640 1 -- 172.21.15.79:0/483383373 learned_addr learned my addr 172.21.15.79:0/483383373 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4585800640 1 --2- 172.21.15.79:0/483383373 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f458006df50 0x7f45800aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4586001640 1 --2- 172.21.15.79:0/483383373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4580143bc0 0x7f45801ef990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4584fff640 1 -- 172.21.15.79:0/483383373 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f458006df50 msgr2=0x7f45800aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4584fff640 1 --2- 172.21.15.79:0/483383373 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f458006df50 0x7f45800aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4584fff640 1 -- 172.21.15.79:0/483383373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4580143bc0 msgr2=0x7f45801ef990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4584fff640 1 --2- 172.21.15.79:0/483383373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4580143bc0 0x7f45801ef990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4584fff640 1 -- 172.21.15.79:0/483383373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4580159180 con 0x7f45800b2d30 2024-04-25T02:08:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.873+0000 7f4584fff640 1 --2- 172.21.15.79:0/483383373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45800b2d30 0x7f4580141090 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4570000c00 tx=0x7f45700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.874+0000 7f4575ffb640 1 -- 172.21.15.79:0/483383373 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570037040 con 0x7f45800b2d30 2024-04-25T02:08:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.874+0000 7f4575ffb640 1 -- 172.21.15.79:0/483383373 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4570042070 con 0x7f45800b2d30 2024-04-25T02:08:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.874+0000 7f4587a64640 1 -- 172.21.15.79:0/483383373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4580159440 con 0x7f45800b2d30 2024-04-25T02:08:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.874+0000 7f4575ffb640 1 -- 172.21.15.79:0/483383373 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570030a70 con 0x7f45800b2d30 2024-04-25T02:08:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.874+0000 7f4587a64640 1 -- 172.21.15.79:0/483383373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4580159a00 con 0x7f45800b2d30 2024-04-25T02:08:36.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.875+0000 7f4587a64640 1 -- 172.21.15.79:0/483383373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45800690a0 con 0x7f45800b2d30 2024-04-25T02:08:36.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.875+0000 7f4575ffb640 1 -- 172.21.15.79:0/483383373 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4570030c10 con 0x7f45800b2d30 2024-04-25T02:08:36.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.875+0000 7f4575ffb640 1 --2- 172.21.15.79:0/483383373 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f456406be30 0x7f456406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.876+0000 7f4575ffb640 1 -- 172.21.15.79:0/483383373 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f45700ab930 con 0x7f45800b2d30 2024-04-25T02:08:36.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.876+0000 7f4585800640 1 --2- 172.21.15.79:0/483383373 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f456406be30 0x7f456406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.876+0000 7f4585800640 1 --2- 172.21.15.79:0/483383373 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f456406be30 0x7f456406e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f457c000f60 tx=0x7f457c007b90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:36.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:36.880+0000 7f4575ffb640 1 -- 172.21.15.79:0/483383373 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4570045360 con 0x7f45800b2d30 2024-04-25T02:08:37.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.087+0000 7f4587a64640 1 -- 172.21.15.79:0/483383373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45800cf690 con 0x7f45800b2d30 2024-04-25T02:08:37.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.087+0000 7f4575ffb640 1 -- 172.21.15.79:0/483383373 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7f457007a2e0 con 0x7f45800b2d30 2024-04-25T02:08:37.095 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:37.095 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/465663373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":465663373},{"type":"v1","addr":"172.21.15.189:6833","nonce":465663373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2093278785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2093278785},{"type":"v1","addr":"172.21.15.79:6836","nonce":2093278785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2415912880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2415912880},{"type":"v1","addr":"172.21.15.189:6835","nonce":2415912880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:07:59.452096+0000","modified":"2024-04-25T02:08:01.458029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2942986974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2942986974},{"type":"v1","addr":"172.21.15.79:6837","nonce":2942986974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-25T02:08:37.095 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2024-04-25T02:08:37.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.089+0000 7f4587a64640 1 -- 172.21.15.79:0/483383373 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f456406be30 msgr2=0x7f456406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.089+0000 7f4587a64640 1 --2- 172.21.15.79:0/483383373 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f456406be30 0x7f456406e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f457c000f60 tx=0x7f457c007b90 comp rx=0 tx=0).stop 2024-04-25T02:08:37.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.089+0000 7f4587a64640 1 -- 172.21.15.79:0/483383373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45800b2d30 msgr2=0x7f4580141090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.089+0000 7f4587a64640 1 --2- 172.21.15.79:0/483383373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45800b2d30 0x7f4580141090 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4570000c00 tx=0x7f45700046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.089+0000 7f4587a64640 1 -- 172.21.15.79:0/483383373 shutdown_connections 2024-04-25T02:08:37.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.090+0000 7f4587a64640 1 --2- 172.21.15.79:0/483383373 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f456406be30 0x7f456406e2f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.090+0000 7f4587a64640 1 --2- 172.21.15.79:0/483383373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4580143bc0 0x7f45801ef990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.090+0000 7f4587a64640 1 --2- 172.21.15.79:0/483383373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45800b2d30 0x7f4580141090 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.090+0000 7f4587a64640 1 --2- 172.21.15.79:0/483383373 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f458006df50 0x7f45800aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.090+0000 7f4587a64640 1 -- 172.21.15.79:0/483383373 >> 172.21.15.79:0/483383373 conn(0x7f45800cfc80 msgr2=0x7f45800afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:37.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.090+0000 7f4587a64640 1 -- 172.21.15.79:0/483383373 shutdown_connections 2024-04-25T02:08:37.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.090+0000 7f4587a64640 1 -- 172.21.15.79:0/483383373 wait complete. 2024-04-25T02:08:37.108 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:08:37.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.198+0000 7fec3037e640 1 Processor -- start 2024-04-25T02:08:37.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.198+0000 7fec3037e640 1 -- start start 2024-04-25T02:08:37.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.199+0000 7fec3037e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fec28144cb0 0x7fec280b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.199+0000 7fec3037e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fec280b5580 0x7fec2806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.199+0000 7fec3037e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec28070d90 con 0x7fec2806e490 2024-04-25T02:08:37.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.199+0000 7fec3037e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fec2806e900 con 0x7fec280b5580 2024-04-25T02:08:37.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.199+0000 7fec3037e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fec280cf130 con 0x7fec28144cb0 2024-04-25T02:08:37.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.199+0000 7fec2d919640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fec280b5580 0x7fec2806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.199+0000 7fec2e91b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fec2806e490 0x7fec2815fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48568/0 (socket says 172.21.15.79:48568) 2024-04-25T02:08:37.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.199+0000 7fec2e91b640 1 -- 172.21.15.79:0/1480932312 learned_addr learned my addr 172.21.15.79:0/1480932312 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:37.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.199+0000 7fec2d919640 1 -- 172.21.15.79:0/1480932312 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fec28144cb0 msgr2=0x7fec280b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:37.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.199+0000 7fec2e11a640 1 --2- 172.21.15.79:0/1480932312 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fec28144cb0 0x7fec280b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.200+0000 7fec2d919640 1 --2- 172.21.15.79:0/1480932312 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fec28144cb0 0x7fec280b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.200+0000 7fec2d919640 1 -- 172.21.15.79:0/1480932312 >> v1:172.21.15.79:6789/0 conn(0x7fec2806e490 legacy=0x7fec2815fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.200+0000 7fec2d919640 1 -- 172.21.15.79:0/1480932312 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec280cf410 con 0x7fec280b5580 2024-04-25T02:08:37.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.200+0000 7fec2d118640 1 -- 172.21.15.79:0/1480932312 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3868581135 0 0) 0x7fec28070d90 con 0x7fec2806e490 2024-04-25T02:08:37.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.200+0000 7fec2d919640 1 --2- 172.21.15.79:0/1480932312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec280b5580 0x7fec2806df50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fec180097a0 tx=0x7fec1802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1870a9c2376ff472 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:37.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.200+0000 7fec2d118640 1 -- 172.21.15.79:0/1480932312 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18037070 con 0x7fec280b5580 2024-04-25T02:08:37.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.200+0000 7fec2d118640 1 -- 172.21.15.79:0/1480932312 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec1802adb0 con 0x7fec280b5580 2024-04-25T02:08:37.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.200+0000 7fec2d118640 1 -- 172.21.15.79:0/1480932312 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18032660 con 0x7fec280b5580 2024-04-25T02:08:37.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.201+0000 7fec3037e640 1 -- 172.21.15.79:0/1480932312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec280b5580 msgr2=0x7fec2806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.201+0000 7fec3037e640 1 --2- 172.21.15.79:0/1480932312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec280b5580 0x7fec2806df50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fec180097a0 tx=0x7fec1802a060 comp rx=0 tx=0).stop 2024-04-25T02:08:37.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.201+0000 7fec3037e640 1 -- 172.21.15.79:0/1480932312 shutdown_connections 2024-04-25T02:08:37.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.201+0000 7fec3037e640 1 --2- 172.21.15.79:0/1480932312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec280b5580 0x7fec2806df50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.201+0000 7fec3037e640 1 --2- 172.21.15.79:0/1480932312 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fec28144cb0 0x7fec280b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.201+0000 7fec3037e640 1 -- 172.21.15.79:0/1480932312 >> 172.21.15.79:0/1480932312 conn(0x7fec280cfc80 msgr2=0x7fec280d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:37.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.201+0000 7fec3037e640 1 -- 172.21.15.79:0/1480932312 shutdown_connections 2024-04-25T02:08:37.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.201+0000 7fec3037e640 1 -- 172.21.15.79:0/1480932312 wait complete. 2024-04-25T02:08:37.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.202+0000 7fec3037e640 1 Processor -- start 2024-04-25T02:08:37.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.202+0000 7fec3037e640 1 -- start start 2024-04-25T02:08:37.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec3037e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec2806e490 0x7fec2813bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec3037e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec280b5580 0x7fec2813a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec3037e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fec28144cb0 0x7fec280a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec3037e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fec28145090 con 0x7fec280b5580 2024-04-25T02:08:37.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec3037e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fec280cf9d0 con 0x7fec2806e490 2024-04-25T02:08:37.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec3037e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fec28145ab0 con 0x7fec28144cb0 2024-04-25T02:08:37.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec2d919640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec280b5580 0x7fec2813a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec2d919640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec280b5580 0x7fec2813a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47396/0 (socket says 172.21.15.79:47396) 2024-04-25T02:08:37.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec2d919640 1 -- 172.21.15.79:0/529536887 learned_addr learned my addr 172.21.15.79:0/529536887 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:37.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec2e91b640 1 --2- 172.21.15.79:0/529536887 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fec28144cb0 0x7fec280a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec2e11a640 1 --2- 172.21.15.79:0/529536887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec2806e490 0x7fec2813bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec2d919640 1 -- 172.21.15.79:0/529536887 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fec28144cb0 msgr2=0x7fec280a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec2d919640 1 --2- 172.21.15.79:0/529536887 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fec28144cb0 0x7fec280a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec2d919640 1 -- 172.21.15.79:0/529536887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec2806e490 msgr2=0x7fec2813bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec2d919640 1 --2- 172.21.15.79:0/529536887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec2806e490 0x7fec2813bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec2d919640 1 -- 172.21.15.79:0/529536887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2814d440 con 0x7fec280b5580 2024-04-25T02:08:37.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec2d919640 1 --2- 172.21.15.79:0/529536887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec280b5580 0x7fec2813a6e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fec180098c0 tx=0x7fec180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:37.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.203+0000 7fec1effd640 1 -- 172.21.15.79:0/529536887 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18041070 con 0x7fec280b5580 2024-04-25T02:08:37.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.204+0000 7fec1effd640 1 -- 172.21.15.79:0/529536887 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec1803c670 con 0x7fec280b5580 2024-04-25T02:08:37.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.204+0000 7fec1effd640 1 -- 172.21.15.79:0/529536887 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18037040 con 0x7fec280b5580 2024-04-25T02:08:37.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.204+0000 7fec3037e640 1 -- 172.21.15.79:0/529536887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2814d720 con 0x7fec280b5580 2024-04-25T02:08:37.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.204+0000 7fec3037e640 1 -- 172.21.15.79:0/529536887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec2814dce0 con 0x7fec280b5580 2024-04-25T02:08:37.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.205+0000 7fec3037e640 1 -- 172.21.15.79:0/529536887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec280690a0 con 0x7fec280b5580 2024-04-25T02:08:37.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.205+0000 7fec1effd640 1 -- 172.21.15.79:0/529536887 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec18044070 con 0x7fec280b5580 2024-04-25T02:08:37.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.205+0000 7fec1effd640 1 --2- 172.21.15.79:0/529536887 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fec0c06be60 0x7fec0c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.205+0000 7fec1effd640 1 -- 172.21.15.79:0/529536887 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fec180ab630 con 0x7fec280b5580 2024-04-25T02:08:37.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.205+0000 7fec2e11a640 1 --2- 172.21.15.79:0/529536887 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fec0c06be60 0x7fec0c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.206+0000 7fec2e11a640 1 --2- 172.21.15.79:0/529536887 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fec0c06be60 0x7fec0c06e320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fec2400a970 tx=0x7fec24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:37.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.210+0000 7fec1effd640 1 -- 172.21.15.79:0/529536887 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fec1807a070 con 0x7fec280b5580 2024-04-25T02:08:37.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.418+0000 7fec3037e640 1 -- 172.21.15.79:0/529536887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec280d0b90 con 0x7fec280b5580 2024-04-25T02:08:37.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.419+0000 7fec1effd640 1 -- 172.21.15.79:0/529536887 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7fec18079970 con 0x7fec280b5580 2024-04-25T02:08:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:37.426 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/465663373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":465663373},{"type":"v1","addr":"172.21.15.189:6833","nonce":465663373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2093278785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2093278785},{"type":"v1","addr":"172.21.15.79:6836","nonce":2093278785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2415912880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2415912880},{"type":"v1","addr":"172.21.15.189:6835","nonce":2415912880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:07:59.452096+0000","modified":"2024-04-25T02:08:01.458029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2942986974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2942986974},{"type":"v1","addr":"172.21.15.79:6837","nonce":2942986974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-25T02:08:37.427 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2024-04-25T02:08:37.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.421+0000 7fec3037e640 1 -- 172.21.15.79:0/529536887 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fec0c06be60 msgr2=0x7fec0c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.421+0000 7fec3037e640 1 --2- 172.21.15.79:0/529536887 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fec0c06be60 0x7fec0c06e320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fec2400a970 tx=0x7fec24008040 comp rx=0 tx=0).stop 2024-04-25T02:08:37.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.421+0000 7fec3037e640 1 -- 172.21.15.79:0/529536887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec280b5580 msgr2=0x7fec2813a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.421+0000 7fec3037e640 1 --2- 172.21.15.79:0/529536887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec280b5580 0x7fec2813a6e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fec180098c0 tx=0x7fec180046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.421+0000 7fec3037e640 1 -- 172.21.15.79:0/529536887 shutdown_connections 2024-04-25T02:08:37.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.421+0000 7fec3037e640 1 --2- 172.21.15.79:0/529536887 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fec0c06be60 0x7fec0c06e320 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.421+0000 7fec3037e640 1 --2- 172.21.15.79:0/529536887 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fec28144cb0 0x7fec280a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.421+0000 7fec3037e640 1 --2- 172.21.15.79:0/529536887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec280b5580 0x7fec2813a6e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.421+0000 7fec3037e640 1 --2- 172.21.15.79:0/529536887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec2806e490 0x7fec2813bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.421+0000 7fec3037e640 1 -- 172.21.15.79:0/529536887 >> 172.21.15.79:0/529536887 conn(0x7fec280cfc80 msgr2=0x7fec28072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:37.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.421+0000 7fec3037e640 1 -- 172.21.15.79:0/529536887 shutdown_connections 2024-04-25T02:08:37.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.421+0000 7fec3037e640 1 -- 172.21.15.79:0/529536887 wait complete. 2024-04-25T02:08:37.439 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:37.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.528+0000 7f75b1a38640 1 Processor -- start 2024-04-25T02:08:37.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.528+0000 7f75b1a38640 1 -- start start 2024-04-25T02:08:37.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.529+0000 7f75b1a38640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75ac15a720 0x7f75ac15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.529+0000 7f75b1a38640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f75ac0d07a0 0x7f75ac0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.529+0000 7f75b1a38640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75ac15f1c0 con 0x7f75ac0b47e0 2024-04-25T02:08:37.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.529+0000 7f75b1a38640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f75ac0b4c30 con 0x7f75ac15a720 2024-04-25T02:08:37.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.529+0000 7f75b1a38640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f75ac0b2e60 con 0x7f75ac0d07a0 2024-04-25T02:08:37.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.529+0000 7f75aaffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75ac15a720 0x7f75ac15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.529+0000 7f75ab7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f75ac0b47e0 0x7f75ac15ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48584/0 (socket says 172.21.15.79:48584) 2024-04-25T02:08:37.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.529+0000 7f75ab7fe640 1 -- 172.21.15.79:0/2025845955 learned_addr learned my addr 172.21.15.79:0/2025845955 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:37.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.529+0000 7f75aaffd640 1 --2- 172.21.15.79:0/2025845955 >> v2:172.21.15.79:3300/0 conn(0x7f75ac15a720 0x7f75ac15ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47406/0 (socket says 172.21.15.79:47406) 2024-04-25T02:08:37.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.529+0000 7f75aaffd640 1 -- 172.21.15.79:0/2025845955 >> v2:172.21.15.189:3300/0 conn(0x7f75ac0d07a0 msgr2=0x7f75ac0b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:37.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.529+0000 7f75aaffd640 1 --2- 172.21.15.79:0/2025845955 >> v2:172.21.15.189:3300/0 conn(0x7f75ac0d07a0 0x7f75ac0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.529+0000 7f75aaffd640 1 -- 172.21.15.79:0/2025845955 >> v1:172.21.15.79:6789/0 conn(0x7f75ac0b47e0 legacy=0x7f75ac15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.529+0000 7f75aaffd640 1 -- 172.21.15.79:0/2025845955 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac0b3140 con 0x7f75ac15a720 2024-04-25T02:08:37.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.529+0000 7f75a9ffb640 1 -- 172.21.15.79:0/2025845955 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 761710792 0 0) 0x7f75a4001110 con 0x7f75ac0b47e0 2024-04-25T02:08:37.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.530+0000 7f75aaffd640 1 --2- 172.21.15.79:0/2025845955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75ac15a720 0x7f75ac15ec80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0b5ea0 tx=0x7f759c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3bf862837396fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:37.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.530+0000 7f75a9ffb640 1 -- 172.21.15.79:0/2025845955 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c007740 con 0x7f75ac15a720 2024-04-25T02:08:37.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.530+0000 7f75a9ffb640 1 -- 172.21.15.79:0/2025845955 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f759c0078e0 con 0x7f75ac15a720 2024-04-25T02:08:37.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.530+0000 7f75a9ffb640 1 -- 172.21.15.79:0/2025845955 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c007cb0 con 0x7f75ac15a720 2024-04-25T02:08:37.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.531+0000 7f75b1a38640 1 -- 172.21.15.79:0/2025845955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75ac15a720 msgr2=0x7f75ac15ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.531+0000 7f75b1a38640 1 --2- 172.21.15.79:0/2025845955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75ac15a720 0x7f75ac15ec80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0b5ea0 tx=0x7f759c02a5f0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.531+0000 7f75b1a38640 1 -- 172.21.15.79:0/2025845955 shutdown_connections 2024-04-25T02:08:37.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.531+0000 7f75b1a38640 1 --2- 172.21.15.79:0/2025845955 >> v2:172.21.15.189:3300/0 conn(0x7f75ac0d07a0 0x7f75ac0b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.531+0000 7f75b1a38640 1 --2- 172.21.15.79:0/2025845955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75ac15a720 0x7f75ac15ec80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.531+0000 7f75b1a38640 1 -- 172.21.15.79:0/2025845955 >> 172.21.15.79:0/2025845955 conn(0x7f75ac0cfc80 msgr2=0x7f75ac0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:37.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.531+0000 7f75b1a38640 1 -- 172.21.15.79:0/2025845955 shutdown_connections 2024-04-25T02:08:37.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.531+0000 7f75b1a38640 1 -- 172.21.15.79:0/2025845955 wait complete. 2024-04-25T02:08:37.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.532+0000 7f75b1a38640 1 Processor -- start 2024-04-25T02:08:37.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.532+0000 7f75b1a38640 1 -- start start 2024-04-25T02:08:37.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75b1a38640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75ac0b47e0 0x7f75ac0ce310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75b1a38640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75ac0d07a0 0x7f75ac146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75b1a38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75ac15a720 0x7f75ac14af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75b1a38640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac0b39e0 con 0x7f75ac15a720 2024-04-25T02:08:37.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75b1a38640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac0b3700 con 0x7f75ac0d07a0 2024-04-25T02:08:37.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75b1a38640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f75ac071d00 con 0x7f75ac0b47e0 2024-04-25T02:08:37.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75ab7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75ac15a720 0x7f75ac14af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75ab7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75ac15a720 0x7f75ac14af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47410/0 (socket says 172.21.15.79:47410) 2024-04-25T02:08:37.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75ab7fe640 1 -- 172.21.15.79:0/4223682165 learned_addr learned my addr 172.21.15.79:0/4223682165 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:37.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75aaffd640 1 --2- 172.21.15.79:0/4223682165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75ac0b47e0 0x7f75ac0ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75aa7fc640 1 --2- 172.21.15.79:0/4223682165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75ac0d07a0 0x7f75ac146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75ab7fe640 1 -- 172.21.15.79:0/4223682165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75ac0b47e0 msgr2=0x7f75ac0ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75ab7fe640 1 --2- 172.21.15.79:0/4223682165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75ac0b47e0 0x7f75ac0ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75ab7fe640 1 -- 172.21.15.79:0/4223682165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75ac0d07a0 msgr2=0x7f75ac146540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75ab7fe640 1 --2- 172.21.15.79:0/4223682165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75ac0d07a0 0x7f75ac146540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75ab7fe640 1 -- 172.21.15.79:0/4223682165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac147d60 con 0x7f75ac15a720 2024-04-25T02:08:37.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75aa7fc640 1 --2- 172.21.15.79:0/4223682165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75ac0d07a0 0x7f75ac146540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:37.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75ab7fe640 1 --2- 172.21.15.79:0/4223682165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75ac15a720 0x7f75ac14af70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f75a400c780 tx=0x7f75a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:37.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75a3fff640 1 -- 172.21.15.79:0/4223682165 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4018070 con 0x7f75ac15a720 2024-04-25T02:08:37.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75a3fff640 1 -- 172.21.15.79:0/4223682165 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a40070d0 con 0x7f75ac15a720 2024-04-25T02:08:37.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75b1a38640 1 -- 172.21.15.79:0/4223682165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ac148040 con 0x7f75ac15a720 2024-04-25T02:08:37.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75a3fff640 1 -- 172.21.15.79:0/4223682165 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4007500 con 0x7f75ac15a720 2024-04-25T02:08:37.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.533+0000 7f75b1a38640 1 -- 172.21.15.79:0/4223682165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ac148600 con 0x7f75ac15a720 2024-04-25T02:08:37.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.534+0000 7f75b1a38640 1 -- 172.21.15.79:0/4223682165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ac0690a0 con 0x7f75ac15a720 2024-04-25T02:08:37.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.535+0000 7f75a3fff640 1 -- 172.21.15.79:0/4223682165 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f75a401b070 con 0x7f75ac15a720 2024-04-25T02:08:37.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.535+0000 7f75a3fff640 1 --2- 172.21.15.79:0/4223682165 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f758c06be30 0x7f758c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.535+0000 7f75a3fff640 1 -- 172.21.15.79:0/4223682165 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f75a408a130 con 0x7f75ac15a720 2024-04-25T02:08:37.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.535+0000 7f75aaffd640 1 --2- 172.21.15.79:0/4223682165 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f758c06be30 0x7f758c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.536+0000 7f75aaffd640 1 --2- 172.21.15.79:0/4223682165 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f758c06be30 0x7f758c06e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f759c034000 tx=0x7f759c02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:37.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.539+0000 7f75a3fff640 1 -- 172.21.15.79:0/4223682165 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f75ac15f1c0 con 0x7f75ac15a720 2024-04-25T02:08:37.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.713+0000 7f75b1a38640 1 -- 172.21.15.79:0/4223682165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75ac150a70 con 0x7f75ac15a720 2024-04-25T02:08:37.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.714+0000 7f75a3fff640 1 -- 172.21.15.79:0/4223682165 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f75a4058ae0 con 0x7f75ac15a720 2024-04-25T02:08:37.722 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:37.722 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:01.110123+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:57.115253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:58.421392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.716+0000 7f75b1a38640 1 -- 172.21.15.79:0/4223682165 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f758c06be30 msgr2=0x7f758c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.716+0000 7f75b1a38640 1 --2- 172.21.15.79:0/4223682165 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f758c06be30 0x7f758c06e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f759c034000 tx=0x7f759c02f000 comp rx=0 tx=0).stop 2024-04-25T02:08:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.716+0000 7f75b1a38640 1 -- 172.21.15.79:0/4223682165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75ac15a720 msgr2=0x7f75ac14af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.716+0000 7f75b1a38640 1 --2- 172.21.15.79:0/4223682165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75ac15a720 0x7f75ac14af70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f75a400c780 tx=0x7f75a400cc40 comp rx=0 tx=0).stop 2024-04-25T02:08:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.716+0000 7f75b1a38640 1 -- 172.21.15.79:0/4223682165 shutdown_connections 2024-04-25T02:08:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.716+0000 7f75b1a38640 1 --2- 172.21.15.79:0/4223682165 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f758c06be30 0x7f758c06e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.716+0000 7f75b1a38640 1 --2- 172.21.15.79:0/4223682165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75ac15a720 0x7f75ac14af70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.716+0000 7f75b1a38640 1 --2- 172.21.15.79:0/4223682165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75ac0d07a0 0x7f75ac146540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.716+0000 7f75b1a38640 1 --2- 172.21.15.79:0/4223682165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75ac0b47e0 0x7f75ac0ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.716+0000 7f75b1a38640 1 -- 172.21.15.79:0/4223682165 >> 172.21.15.79:0/4223682165 conn(0x7f75ac0cfc80 msgr2=0x7f75ac15e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.716+0000 7f75b1a38640 1 -- 172.21.15.79:0/4223682165 shutdown_connections 2024-04-25T02:08:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.716+0000 7f75b1a38640 1 -- 172.21.15.79:0/4223682165 wait complete. 2024-04-25T02:08:37.735 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:08:37.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.825+0000 7f9aa8ebd640 1 Processor -- start 2024-04-25T02:08:37.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.825+0000 7f9aa8ebd640 1 -- start start 2024-04-25T02:08:37.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.826+0000 7f9aa8ebd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9aa40b3570 0x7f9aa40d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.826+0000 7f9aa8ebd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9aa40b3020 0x7f9aa40d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.826+0000 7f9aa8ebd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa406c380 con 0x7f9aa415e4d0 2024-04-25T02:08:37.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.826+0000 7f9aa8ebd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9aa40d1660 con 0x7f9aa40b3020 2024-04-25T02:08:37.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.826+0000 7f9aa8ebd640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f9aa40d1380 con 0x7f9aa40b3570 2024-04-25T02:08:37.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.826+0000 7f9aa2d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9aa40b3020 0x7f9aa40d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.826+0000 7f9aa259c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9aa415e4d0 0x7f9aa406bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48588/0 (socket says 172.21.15.79:48588) 2024-04-25T02:08:37.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.827+0000 7f9aa259c640 1 -- 172.21.15.79:0/1372158684 learned_addr learned my addr 172.21.15.79:0/1372158684 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:37.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.827+0000 7f9aa1d9b640 1 --2- 172.21.15.79:0/1372158684 >> v2:172.21.15.189:3300/0 conn(0x7f9aa40b3570 0x7f9aa40d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.827+0000 7f9aa2d9d640 1 -- 172.21.15.79:0/1372158684 >> v2:172.21.15.189:3300/0 conn(0x7f9aa40b3570 msgr2=0x7f9aa40d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:37.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.827+0000 7f9aa2d9d640 1 --2- 172.21.15.79:0/1372158684 >> v2:172.21.15.189:3300/0 conn(0x7f9aa40b3570 0x7f9aa40d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.827+0000 7f9aa2d9d640 1 -- 172.21.15.79:0/1372158684 >> v1:172.21.15.79:6789/0 conn(0x7f9aa415e4d0 legacy=0x7f9aa406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.827+0000 7f9aa159a640 1 -- 172.21.15.79:0/1372158684 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3633160174 0 0) 0x7f9aa406c380 con 0x7f9aa415e4d0 2024-04-25T02:08:37.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.827+0000 7f9aa2d9d640 1 -- 172.21.15.79:0/1372158684 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa40cede0 con 0x7f9aa40b3020 2024-04-25T02:08:37.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.827+0000 7f9aa1d9b640 1 --2- 172.21.15.79:0/1372158684 >> v2:172.21.15.189:3300/0 conn(0x7f9aa40b3570 0x7f9aa40d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:37.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.827+0000 7f9aa2d9d640 1 --2- 172.21.15.79:0/1372158684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aa40b3020 0x7f9aa40d2c50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0097a0 tx=0x7f9a9c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6907171afd1f001 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:37.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.828+0000 7f9aa159a640 1 -- 172.21.15.79:0/1372158684 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c037070 con 0x7f9aa40b3020 2024-04-25T02:08:37.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.828+0000 7f9aa159a640 1 -- 172.21.15.79:0/1372158684 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9c032440 con 0x7f9aa40b3020 2024-04-25T02:08:37.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.828+0000 7f9aa159a640 1 -- 172.21.15.79:0/1372158684 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c032810 con 0x7f9aa40b3020 2024-04-25T02:08:37.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.828+0000 7f9aa8ebd640 1 -- 172.21.15.79:0/1372158684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aa40b3020 msgr2=0x7f9aa40d2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.828+0000 7f9aa8ebd640 1 --2- 172.21.15.79:0/1372158684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aa40b3020 0x7f9aa40d2c50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0097a0 tx=0x7f9a9c02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.828+0000 7f9aa8ebd640 1 -- 172.21.15.79:0/1372158684 shutdown_connections 2024-04-25T02:08:37.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.828+0000 7f9aa8ebd640 1 --2- 172.21.15.79:0/1372158684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aa40b3020 0x7f9aa40d2c50 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.828+0000 7f9aa8ebd640 1 --2- 172.21.15.79:0/1372158684 >> v2:172.21.15.189:3300/0 conn(0x7f9aa40b3570 0x7f9aa40d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.828+0000 7f9aa8ebd640 1 -- 172.21.15.79:0/1372158684 >> 172.21.15.79:0/1372158684 conn(0x7f9aa409d460 msgr2=0x7f9aa40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:37.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.828+0000 7f9aa8ebd640 1 -- 172.21.15.79:0/1372158684 shutdown_connections 2024-04-25T02:08:37.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.828+0000 7f9aa8ebd640 1 -- 172.21.15.79:0/1372158684 wait complete. 2024-04-25T02:08:37.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.830+0000 7f9aa8ebd640 1 Processor -- start 2024-04-25T02:08:37.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.830+0000 7f9aa8ebd640 1 -- start start 2024-04-25T02:08:37.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.830+0000 7f9aa8ebd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aa40b3020 0x7f9aa41f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.830+0000 7f9aa8ebd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa40b3570 0x7f9aa40c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.830+0000 7f9aa8ebd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa415e4d0 0x7f9aa40ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.830+0000 7f9aa8ebd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa40d20d0 con 0x7f9aa40b3020 2024-04-25T02:08:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.830+0000 7f9aa8ebd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa415e8b0 con 0x7f9aa415e4d0 2024-04-25T02:08:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.830+0000 7f9aa8ebd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa40d2250 con 0x7f9aa40b3570 2024-04-25T02:08:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.830+0000 7f9aa259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aa40b3020 0x7f9aa41f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.830+0000 7f9aa259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aa40b3020 0x7f9aa41f33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47432/0 (socket says 172.21.15.79:47432) 2024-04-25T02:08:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.830+0000 7f9aa259c640 1 -- 172.21.15.79:0/4183423293 learned_addr learned my addr 172.21.15.79:0/4183423293 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.831+0000 7f9aa2d9d640 1 --2- 172.21.15.79:0/4183423293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa415e4d0 0x7f9aa40ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.831+0000 7f9aa1d9b640 1 --2- 172.21.15.79:0/4183423293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa40b3570 0x7f9aa40c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.831+0000 7f9aa259c640 1 -- 172.21.15.79:0/4183423293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa40b3570 msgr2=0x7f9aa40c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.831+0000 7f9aa259c640 1 --2- 172.21.15.79:0/4183423293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa40b3570 0x7f9aa40c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.831+0000 7f9aa259c640 1 -- 172.21.15.79:0/4183423293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa415e4d0 msgr2=0x7f9aa40ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.831+0000 7f9aa259c640 1 --2- 172.21.15.79:0/4183423293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa415e4d0 0x7f9aa40ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.831+0000 7f9aa259c640 1 -- 172.21.15.79:0/4183423293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa40b3c40 con 0x7f9aa40b3020 2024-04-25T02:08:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.831+0000 7f9aa259c640 1 --2- 172.21.15.79:0/4183423293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aa40b3020 0x7f9aa41f33a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400c7c0 tx=0x7f9a9400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.831+0000 7f9a92ffd640 1 -- 172.21.15.79:0/4183423293 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94018070 con 0x7f9aa40b3020 2024-04-25T02:08:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.831+0000 7f9a92ffd640 1 -- 172.21.15.79:0/4183423293 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9400a640 con 0x7f9aa40b3020 2024-04-25T02:08:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.831+0000 7f9a92ffd640 1 -- 172.21.15.79:0/4183423293 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9400aa30 con 0x7f9aa40b3020 2024-04-25T02:08:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.831+0000 7f9aa8ebd640 1 -- 172.21.15.79:0/4183423293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa40b3f20 con 0x7f9aa40b3020 2024-04-25T02:08:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.831+0000 7f9aa8ebd640 1 -- 172.21.15.79:0/4183423293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa40b44e0 con 0x7f9aa40b3020 2024-04-25T02:08:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.832+0000 7f9aa8ebd640 1 -- 172.21.15.79:0/4183423293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aa40690a0 con 0x7f9aa40b3020 2024-04-25T02:08:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.832+0000 7f9a92ffd640 1 -- 172.21.15.79:0/4183423293 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a9401b070 con 0x7f9aa40b3020 2024-04-25T02:08:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.833+0000 7f9a92ffd640 1 --2- 172.21.15.79:0/4183423293 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9a8406be30 0x7f9a8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.833+0000 7f9a92ffd640 1 -- 172.21.15.79:0/4183423293 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9a9408a580 con 0x7f9aa40b3020 2024-04-25T02:08:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.833+0000 7f9aa1d9b640 1 --2- 172.21.15.79:0/4183423293 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9a8406be30 0x7f9a8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.833+0000 7f9aa1d9b640 1 --2- 172.21.15.79:0/4183423293 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9a8406be30 0x7f9a8406e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40ce560 tx=0x7f9a98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:37.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:37.837+0000 7f9a92ffd640 1 -- 172.21.15.79:0/4183423293 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9a94058ea0 con 0x7f9aa40b3020 2024-04-25T02:08:38.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.043+0000 7f9aa8ebd640 1 -- 172.21.15.79:0/4183423293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9aa4074d50 con 0x7f9aa40b3020 2024-04-25T02:08:38.051 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:08:38.044+0000 7fb0c50c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:08:38.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.045+0000 7f9a92ffd640 1 -- 172.21.15.79:0/4183423293 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7f9a940587a0 con 0x7f9aa40b3020 2024-04-25T02:08:38.052 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:08:38.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.048+0000 7f9aa8ebd640 1 -- 172.21.15.79:0/4183423293 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9a8406be30 msgr2=0x7f9a8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:38.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.048+0000 7f9aa8ebd640 1 --2- 172.21.15.79:0/4183423293 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9a8406be30 0x7f9a8406e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40ce560 tx=0x7f9a98008040 comp rx=0 tx=0).stop 2024-04-25T02:08:38.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.048+0000 7f9aa8ebd640 1 -- 172.21.15.79:0/4183423293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aa40b3020 msgr2=0x7f9aa41f33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:38.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.048+0000 7f9aa8ebd640 1 --2- 172.21.15.79:0/4183423293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aa40b3020 0x7f9aa41f33a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400c7c0 tx=0x7f9a9400cc80 comp rx=0 tx=0).stop 2024-04-25T02:08:38.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.048+0000 7f9aa8ebd640 1 -- 172.21.15.79:0/4183423293 shutdown_connections 2024-04-25T02:08:38.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.048+0000 7f9aa8ebd640 1 --2- 172.21.15.79:0/4183423293 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9a8406be30 0x7f9a8406e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:38.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.048+0000 7f9aa8ebd640 1 --2- 172.21.15.79:0/4183423293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa415e4d0 0x7f9aa40ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:38.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.048+0000 7f9aa8ebd640 1 --2- 172.21.15.79:0/4183423293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa40b3570 0x7f9aa40c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:38.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.048+0000 7f9aa8ebd640 1 --2- 172.21.15.79:0/4183423293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aa40b3020 0x7f9aa41f33a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:38.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.048+0000 7f9aa8ebd640 1 -- 172.21.15.79:0/4183423293 >> 172.21.15.79:0/4183423293 conn(0x7f9aa409d460 msgr2=0x7f9aa415d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:38.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.048+0000 7f9aa8ebd640 1 -- 172.21.15.79:0/4183423293 shutdown_connections 2024-04-25T02:08:38.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.048+0000 7f9aa8ebd640 1 -- 172.21.15.79:0/4183423293 wait complete. 2024-04-25T02:08:38.058 INFO:tasks.ceph.mds.a.smithi079.stderr: -7326> 2024-04-25T02:08:03.717+0000 7f7602f74640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:08:38.067 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T02:08:38.088 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:08:38.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.158+0000 7f39468ca640 1 Processor -- start 2024-04-25T02:08:38.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.158+0000 7f39468ca640 1 -- start start 2024-04-25T02:08:38.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.159+0000 7f39468ca640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f39400cf200 0x7f39400cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:38.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.159+0000 7f39468ca640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3940162a40 0x7f394015ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:38.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.159+0000 7f39468ca640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394015f4c0 con 0x7f394015ef40 2024-04-25T02:08:38.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.159+0000 7f39468ca640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3940162ec0 con 0x7f39400cf200 2024-04-25T02:08:38.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.159+0000 7f39468ca640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3940161ff0 con 0x7f3940162a40 2024-04-25T02:08:38.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.159+0000 7f393ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f39400cf200 0x7f39400cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:38.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.159+0000 7f393ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f39400cf200 0x7f39400cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47474/0 (socket says 172.21.15.79:47474) 2024-04-25T02:08:38.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.159+0000 7f393ffff640 1 -- 172.21.15.79:0/1562618207 learned_addr learned my addr 172.21.15.79:0/1562618207 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:38.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.159+0000 7f393ffff640 1 -- 172.21.15.79:0/1562618207 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3940162a40 msgr2=0x7f394015ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:38.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.159+0000 7f393ffff640 1 --2- 172.21.15.79:0/1562618207 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3940162a40 0x7f394015ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:38.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.159+0000 7f393ffff640 1 -- 172.21.15.79:0/1562618207 >> v1:172.21.15.189:6789/0 conn(0x7f394015ef40 legacy=0x7f394006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:38.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.159+0000 7f393ffff640 1 -- 172.21.15.79:0/1562618207 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394015f7a0 con 0x7f39400cf200 2024-04-25T02:08:38.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.160+0000 7f393ffff640 1 --2- 172.21.15.79:0/1562618207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39400cf200 0x7f39400cf5e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3930009870 tx=0x7f393002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12d247350b76d69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:38.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.160+0000 7f393effd640 1 -- 172.21.15.79:0/1562618207 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3930037070 con 0x7f39400cf200 2024-04-25T02:08:38.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.160+0000 7f393effd640 1 -- 172.21.15.79:0/1562618207 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3930032440 con 0x7f39400cf200 2024-04-25T02:08:38.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.160+0000 7f393effd640 1 -- 172.21.15.79:0/1562618207 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3930032810 con 0x7f39400cf200 2024-04-25T02:08:38.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.161+0000 7f39468ca640 1 -- 172.21.15.79:0/1562618207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39400cf200 msgr2=0x7f39400cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:38.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.161+0000 7f39468ca640 1 --2- 172.21.15.79:0/1562618207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39400cf200 0x7f39400cf5e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3930009870 tx=0x7f393002a210 comp rx=0 tx=0).stop 2024-04-25T02:08:38.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.161+0000 7f39468ca640 1 -- 172.21.15.79:0/1562618207 shutdown_connections 2024-04-25T02:08:38.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.161+0000 7f39468ca640 1 --2- 172.21.15.79:0/1562618207 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3940162a40 0x7f394015ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:38.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.161+0000 7f39468ca640 1 --2- 172.21.15.79:0/1562618207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39400cf200 0x7f39400cf5e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:38.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.161+0000 7f39468ca640 1 -- 172.21.15.79:0/1562618207 >> 172.21.15.79:0/1562618207 conn(0x7f39400b1cd0 msgr2=0x7f39400b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:38.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.161+0000 7f39468ca640 1 -- 172.21.15.79:0/1562618207 shutdown_connections 2024-04-25T02:08:38.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.161+0000 7f39468ca640 1 -- 172.21.15.79:0/1562618207 wait complete. 2024-04-25T02:08:38.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.162+0000 7f39468ca640 1 Processor -- start 2024-04-25T02:08:38.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.162+0000 7f39468ca640 1 -- start start 2024-04-25T02:08:38.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f39468ca640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39400cf200 0x7f39401596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:38.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f39468ca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394015ef40 0x7f394015fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:38.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f39468ca640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3940162a40 0x7f394015da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:38.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f39468ca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f39400cec80 con 0x7f394015ef40 2024-04-25T02:08:38.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f39468ca640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3940162520 con 0x7f3940162a40 2024-04-25T02:08:38.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f39468ca640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f39400cee00 con 0x7f39400cf200 2024-04-25T02:08:38.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f393f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394015ef40 0x7f394015fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:38.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f393f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394015ef40 0x7f394015fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47484/0 (socket says 172.21.15.79:47484) 2024-04-25T02:08:38.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f393f7fe640 1 -- 172.21.15.79:0/2602765021 learned_addr learned my addr 172.21.15.79:0/2602765021 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:38.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f393f7fe640 1 -- 172.21.15.79:0/2602765021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39400cf200 msgr2=0x7f39401596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:38.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f393f7fe640 1 --2- 172.21.15.79:0/2602765021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39400cf200 0x7f39401596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:38.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f393f7fe640 1 -- 172.21.15.79:0/2602765021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3940162a40 msgr2=0x7f394015da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:38.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f393f7fe640 1 --2- 172.21.15.79:0/2602765021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3940162a40 0x7f394015da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:38.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f393f7fe640 1 -- 172.21.15.79:0/2602765021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39401608d0 con 0x7f394015ef40 2024-04-25T02:08:38.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f393f7fe640 1 --2- 172.21.15.79:0/2602765021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394015ef40 0x7f394015fb30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f393400b4a0 tx=0x7f393400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:38.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f393cff9640 1 -- 172.21.15.79:0/2602765021 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934014070 con 0x7f394015ef40 2024-04-25T02:08:38.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f393cff9640 1 -- 172.21.15.79:0/2602765021 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3934010610 con 0x7f394015ef40 2024-04-25T02:08:38.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.163+0000 7f39468ca640 1 -- 172.21.15.79:0/2602765021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39401605f0 con 0x7f394015ef40 2024-04-25T02:08:38.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.164+0000 7f393cff9640 1 -- 172.21.15.79:0/2602765021 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934010a00 con 0x7f394015ef40 2024-04-25T02:08:38.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.164+0000 7f39468ca640 1 -- 172.21.15.79:0/2602765021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3940158ed0 con 0x7f394015ef40 2024-04-25T02:08:38.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.164+0000 7f39468ca640 1 -- 172.21.15.79:0/2602765021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39400b2ac0 con 0x7f394015ef40 2024-04-25T02:08:38.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.165+0000 7f393cff9640 1 -- 172.21.15.79:0/2602765021 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3934017070 con 0x7f394015ef40 2024-04-25T02:08:38.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.165+0000 7f393cff9640 1 --2- 172.21.15.79:0/2602765021 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f392c06be30 0x7f392c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:38.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.165+0000 7f393cff9640 1 -- 172.21.15.79:0/2602765021 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f393408a8c0 con 0x7f394015ef40 2024-04-25T02:08:38.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.165+0000 7f393ffff640 1 --2- 172.21.15.79:0/2602765021 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f392c06be30 0x7f392c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:38.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.166+0000 7f393ffff640 1 --2- 172.21.15.79:0/2602765021 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f392c06be30 0x7f392c06e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3930034000 tx=0x7f393002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:38.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.170+0000 7f393cff9640 1 -- 172.21.15.79:0/2602765021 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f39400b2ac0 con 0x7f394015ef40 2024-04-25T02:08:38.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:38.380+0000 7f39468ca640 1 -- 172.21.15.79:0/2602765021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f39400ce3c0 con 0x7f394015ef40 2024-04-25T02:08:39.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.046+0000 7f393cff9640 1 -- 172.21.15.79:0/2602765021 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f393408a020 con 0x7f394015ef40 2024-04-25T02:08:39.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.049+0000 7f39468ca640 1 -- 172.21.15.79:0/2602765021 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f392c06be30 msgr2=0x7f392c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:39.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.049+0000 7f39468ca640 1 --2- 172.21.15.79:0/2602765021 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f392c06be30 0x7f392c06e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3930034000 tx=0x7f393002c000 comp rx=0 tx=0).stop 2024-04-25T02:08:39.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.049+0000 7f39468ca640 1 -- 172.21.15.79:0/2602765021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394015ef40 msgr2=0x7f394015fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:39.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.049+0000 7f39468ca640 1 --2- 172.21.15.79:0/2602765021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394015ef40 0x7f394015fb30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f393400b4a0 tx=0x7f393400b960 comp rx=0 tx=0).stop 2024-04-25T02:08:39.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.049+0000 7f39468ca640 1 -- 172.21.15.79:0/2602765021 shutdown_connections 2024-04-25T02:08:39.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.049+0000 7f39468ca640 1 --2- 172.21.15.79:0/2602765021 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f392c06be30 0x7f392c06e2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:39.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.049+0000 7f39468ca640 1 --2- 172.21.15.79:0/2602765021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3940162a40 0x7f394015da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:39.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.049+0000 7f39468ca640 1 --2- 172.21.15.79:0/2602765021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394015ef40 0x7f394015fb30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:39.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.049+0000 7f39468ca640 1 --2- 172.21.15.79:0/2602765021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39400cf200 0x7f39401596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:39.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.049+0000 7f39468ca640 1 -- 172.21.15.79:0/2602765021 >> 172.21.15.79:0/2602765021 conn(0x7f39400b1cd0 msgr2=0x7f394006cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:39.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.049+0000 7f39468ca640 1 -- 172.21.15.79:0/2602765021 shutdown_connections 2024-04-25T02:08:39.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.049+0000 7f39468ca640 1 -- 172.21.15.79:0/2602765021 wait complete. 2024-04-25T02:08:39.070 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T02:08:39.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.209+0000 7fd657f29640 1 Processor -- start 2024-04-25T02:08:39.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.210+0000 7fd657f29640 1 -- start start 2024-04-25T02:08:39.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.210+0000 7fd657f29640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd6500d2f20 0x7fd6500d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:39.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.210+0000 7fd657f29640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6500d1e80 con 0x7fd6500d0ed0 2024-04-25T02:08:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.210+0000 7fd657f29640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6500d2160 con 0x7fd65015e440 2024-04-25T02:08:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.210+0000 7fd657f29640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd6500d2440 con 0x7fd6500d2f20 2024-04-25T02:08:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd6564c6640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd6500d0ed0 0x7fd6500b6ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48592/0 (socket says 172.21.15.79:48592) 2024-04-25T02:08:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd6564c6640 1 -- 172.21.15.79:0/3450984455 learned_addr learned my addr 172.21.15.79:0/3450984455 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd6554c4640 1 --2- 172.21.15.79:0/3450984455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd6500d2f20 0x7fd6500d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd654cc3640 1 -- 172.21.15.79:0/3450984455 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2881578440 0 0) 0x7fd6500d1e80 con 0x7fd6500d0ed0 2024-04-25T02:08:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd654cc3640 1 -- 172.21.15.79:0/3450984455 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd63c003520 con 0x7fd6500d0ed0 2024-04-25T02:08:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd654cc3640 1 -- 172.21.15.79:0/3450984455 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4047580001 0 0) 0x7fd63c003520 con 0x7fd6500d0ed0 2024-04-25T02:08:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd654cc3640 1 -- 172.21.15.79:0/3450984455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd6500d2f20 msgr2=0x7fd6500d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd654cc3640 1 --2- 172.21.15.79:0/3450984455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd6500d2f20 0x7fd6500d0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd654cc3640 1 -- 172.21.15.79:0/3450984455 >> v1:172.21.15.189:6789/0 conn(0x7fd65015e440 legacy=0x7fd6500cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd654cc3640 1 -- 172.21.15.79:0/3450984455 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6500d2720 con 0x7fd6500d0ed0 2024-04-25T02:08:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd654cc3640 1 -- 172.21.15.79:0/3450984455 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fd6480019f0 con 0x7fd6500d0ed0 2024-04-25T02:08:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd654cc3640 1 -- 172.21.15.79:0/3450984455 >> v1:172.21.15.79:6789/0 conn(0x7fd6500d0ed0 legacy=0x7fd6500b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd654cc3640 1 --2- 172.21.15.79:0/3450984455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd6500d2f20 0x7fd63c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd654cc3640 1 --2- 172.21.15.79:0/3450984455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd63c003f60 0x7fd63c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd654cc3640 1 --2- 172.21.15.79:0/3450984455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd63c004d40 0x7fd63c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd654cc3640 1 -- 172.21.15.79:0/3450984455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd6500d2440 con 0x7fd63c003f60 2024-04-25T02:08:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd654cc3640 1 -- 172.21.15.79:0/3450984455 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd63c00baa0 con 0x7fd63c004d40 2024-04-25T02:08:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd654cc3640 1 -- 172.21.15.79:0/3450984455 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd63c00bca0 con 0x7fd6500d2f20 2024-04-25T02:08:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd6554c4640 1 --2- 172.21.15.79:0/3450984455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd63c003f60 0x7fd63c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd655cc5640 1 --2- 172.21.15.79:0/3450984455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd6500d2f20 0x7fd63c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.211+0000 7fd6564c6640 1 --2- 172.21.15.79:0/3450984455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd63c004d40 0x7fd63c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.212+0000 7fd6554c4640 1 -- 172.21.15.79:0/3450984455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd6500d2f20 msgr2=0x7fd63c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.212+0000 7fd6554c4640 1 --2- 172.21.15.79:0/3450984455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd6500d2f20 0x7fd63c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.212+0000 7fd6554c4640 1 -- 172.21.15.79:0/3450984455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd63c004d40 msgr2=0x7fd63c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.212+0000 7fd6554c4640 1 --2- 172.21.15.79:0/3450984455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd63c004d40 0x7fd63c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.212+0000 7fd6554c4640 1 -- 172.21.15.79:0/3450984455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63c003520 con 0x7fd63c003f60 2024-04-25T02:08:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.212+0000 7fd6564c6640 1 --2- 172.21.15.79:0/3450984455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd63c004d40 0x7fd63c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.212+0000 7fd6554c4640 1 --2- 172.21.15.79:0/3450984455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd63c003f60 0x7fd63c004800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd640009ac0 tx=0x7fd63c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952ca354767dd87c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.212+0000 7fd654cc3640 1 -- 172.21.15.79:0/3450984455 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd640036070 con 0x7fd63c003f60 2024-04-25T02:08:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.212+0000 7fd654cc3640 1 -- 172.21.15.79:0/3450984455 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd640031400 con 0x7fd63c003f60 2024-04-25T02:08:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.212+0000 7fd654cc3640 1 -- 172.21.15.79:0/3450984455 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd640009690 con 0x7fd63c003f60 2024-04-25T02:08:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.213+0000 7fd657f29640 1 -- 172.21.15.79:0/3450984455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd63c003f60 msgr2=0x7fd63c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.213+0000 7fd657f29640 1 --2- 172.21.15.79:0/3450984455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd63c003f60 0x7fd63c004800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd640009ac0 tx=0x7fd63c005830 comp rx=0 tx=0).stop 2024-04-25T02:08:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.213+0000 7fd6564c6640 1 -- 172.21.15.79:0/3450984455 reap_dead start 2024-04-25T02:08:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.213+0000 7fd657f29640 1 -- 172.21.15.79:0/3450984455 shutdown_connections 2024-04-25T02:08:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.213+0000 7fd657f29640 1 -- 172.21.15.79:0/3450984455 >> 172.21.15.79:0/3450984455 conn(0x7fd65009d450 msgr2=0x7fd6500d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:39.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.213+0000 7fd657f29640 1 -- 172.21.15.79:0/3450984455 shutdown_connections 2024-04-25T02:08:39.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.213+0000 7fd657f29640 1 -- 172.21.15.79:0/3450984455 wait complete. 2024-04-25T02:08:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.214+0000 7fd657f29640 1 Processor -- start 2024-04-25T02:08:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.214+0000 7fd657f29640 1 -- start start 2024-04-25T02:08:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd657f29640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd63c003f60 0x7fd650155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd657f29640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd650153b80 0x7fd650155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd657f29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6500b8720 0x7fd6500b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd657f29640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd6500d0100 con 0x7fd6500b8720 2024-04-25T02:08:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd657f29640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd6500cff80 con 0x7fd63c003f60 2024-04-25T02:08:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd657f29640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd6500d0990 con 0x7fd650153b80 2024-04-25T02:08:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd6564c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6500b8720 0x7fd6500b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd6564c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6500b8720 0x7fd6500b8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47500/0 (socket says 172.21.15.79:47500) 2024-04-25T02:08:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd6564c6640 1 -- 172.21.15.79:0/3647860899 learned_addr learned my addr 172.21.15.79:0/3647860899 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd6554c4640 1 --2- 172.21.15.79:0/3647860899 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd650153b80 0x7fd650155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd655cc5640 1 --2- 172.21.15.79:0/3647860899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd63c003f60 0x7fd650155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd6564c6640 1 -- 172.21.15.79:0/3647860899 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd650153b80 msgr2=0x7fd650155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd6564c6640 1 --2- 172.21.15.79:0/3647860899 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd650153b80 0x7fd650155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd6564c6640 1 -- 172.21.15.79:0/3647860899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd63c003f60 msgr2=0x7fd650155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd6564c6640 1 --2- 172.21.15.79:0/3647860899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd63c003f60 0x7fd650155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd6564c6640 1 -- 172.21.15.79:0/3647860899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6501562f0 con 0x7fd6500b8720 2024-04-25T02:08:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd655cc5640 1 --2- 172.21.15.79:0/3647860899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd63c003f60 0x7fd650155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd6564c6640 1 --2- 172.21.15.79:0/3647860899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6500b8720 0x7fd6500b8ba0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd6500c7a00 tx=0x7fd64800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd6467fc640 1 -- 172.21.15.79:0/3647860899 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64800eda0 con 0x7fd6500b8720 2024-04-25T02:08:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd6467fc640 1 -- 172.21.15.79:0/3647860899 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd648014430 con 0x7fd6500b8720 2024-04-25T02:08:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd657f29640 1 -- 172.21.15.79:0/3647860899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6501565d0 con 0x7fd6500b8720 2024-04-25T02:08:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.215+0000 7fd6467fc640 1 -- 172.21.15.79:0/3647860899 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648014820 con 0x7fd6500b8720 2024-04-25T02:08:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.216+0000 7fd657f29640 1 -- 172.21.15.79:0/3647860899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd650156b90 con 0x7fd6500b8720 2024-04-25T02:08:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.217+0000 7fd657f29640 1 -- 172.21.15.79:0/3647860899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6500690a0 con 0x7fd6500b8720 2024-04-25T02:08:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.217+0000 7fd6467fc640 1 -- 172.21.15.79:0/3647860899 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd6480149c0 con 0x7fd6500b8720 2024-04-25T02:08:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.217+0000 7fd6467fc640 1 --2- 172.21.15.79:0/3647860899 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd63406be60 0x7fd63406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:39.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.217+0000 7fd6467fc640 1 -- 172.21.15.79:0/3647860899 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7fd64808ad70 con 0x7fd6500b8720 2024-04-25T02:08:39.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.217+0000 7fd655cc5640 1 --2- 172.21.15.79:0/3647860899 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd63406be60 0x7fd63406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:39.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.218+0000 7fd655cc5640 1 --2- 172.21.15.79:0/3647860899 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd63406be60 0x7fd63406e320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd64c0035f0 tx=0x7fd64c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:39.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.222+0000 7fd6467fc640 1 -- 172.21.15.79:0/3647860899 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd648059750 con 0x7fd6500b8720 2024-04-25T02:08:39.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:39.398+0000 7fd657f29640 1 -- 172.21.15.79:0/3647860899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd6500b92c0 con 0x7fd6500b8720 2024-04-25T02:08:40.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.052+0000 7fd6467fc640 1 -- 172.21.15.79:0/3647860899 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7fd648059050 con 0x7fd6500b8720 2024-04-25T02:08:40.059 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-04-25T02:08:40.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.056+0000 7fd657f29640 1 -- 172.21.15.79:0/3647860899 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd63406be60 msgr2=0x7fd63406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:40.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.056+0000 7fd657f29640 1 --2- 172.21.15.79:0/3647860899 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd63406be60 0x7fd63406e320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd64c0035f0 tx=0x7fd64c009040 comp rx=0 tx=0).stop 2024-04-25T02:08:40.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.056+0000 7fd657f29640 1 -- 172.21.15.79:0/3647860899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6500b8720 msgr2=0x7fd6500b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:40.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.056+0000 7fd657f29640 1 --2- 172.21.15.79:0/3647860899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6500b8720 0x7fd6500b8ba0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd6500c7a00 tx=0x7fd64800e530 comp rx=0 tx=0).stop 2024-04-25T02:08:40.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.056+0000 7fd657f29640 1 -- 172.21.15.79:0/3647860899 shutdown_connections 2024-04-25T02:08:40.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.056+0000 7fd657f29640 1 --2- 172.21.15.79:0/3647860899 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd63406be60 0x7fd63406e320 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:40.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.056+0000 7fd657f29640 1 --2- 172.21.15.79:0/3647860899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6500b8720 0x7fd6500b8ba0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:40.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.056+0000 7fd657f29640 1 --2- 172.21.15.79:0/3647860899 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd650153b80 0x7fd650155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:40.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.056+0000 7fd657f29640 1 --2- 172.21.15.79:0/3647860899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd63c003f60 0x7fd650155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:40.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.056+0000 7fd657f29640 1 -- 172.21.15.79:0/3647860899 >> 172.21.15.79:0/3647860899 conn(0x7fd65009d450 msgr2=0x7fd6500d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:40.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.056+0000 7fd657f29640 1 -- 172.21.15.79:0/3647860899 shutdown_connections 2024-04-25T02:08:40.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.056+0000 7fd657f29640 1 -- 172.21.15.79:0/3647860899 wait complete. 2024-04-25T02:08:40.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T02:08:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.178+0000 7fd121288640 1 Processor -- start 2024-04-25T02:08:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.178+0000 7fd121288640 1 -- start start 2024-04-25T02:08:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.178+0000 7fd121288640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd11c15e310 0x7fd11c0b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.178+0000 7fd121288640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd11c0b3cd0 0x7fd11c06db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.178+0000 7fd121288640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd11c06f570 con 0x7fd11c06e070 2024-04-25T02:08:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.178+0000 7fd121288640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd11c06c2a0 con 0x7fd11c15e310 2024-04-25T02:08:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.178+0000 7fd121288640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd11c0b4110 con 0x7fd11c0b3cd0 2024-04-25T02:08:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.179+0000 7fd11affd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd11c15e310 0x7fd11c0b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.179+0000 7fd11a7fc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd11c0b3cd0 0x7fd11c06db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.179+0000 7fd11affd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd11c15e310 0x7fd11c0b02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:37300/0 (socket says 172.21.15.79:37300) 2024-04-25T02:08:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.179+0000 7fd11b7fe640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fd11c06e070 0x7fd11c0b5730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:57642/0 (socket says 172.21.15.79:57642) 2024-04-25T02:08:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.179+0000 7fd11affd640 1 -- 172.21.15.79:0/2266324010 learned_addr learned my addr 172.21.15.79:0/2266324010 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.179+0000 7fd119ffb640 1 -- 172.21.15.79:0/2266324010 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 269081083 0 0) 0x7fd11c06f570 con 0x7fd11c06e070 2024-04-25T02:08:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.179+0000 7fd119ffb640 1 -- 172.21.15.79:0/2266324010 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd104003520 con 0x7fd11c06e070 2024-04-25T02:08:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.179+0000 7fd11a7fc640 1 -- 172.21.15.79:0/2266324010 >> v2:172.21.15.189:3300/0 conn(0x7fd11c15e310 msgr2=0x7fd11c0b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.179+0000 7fd11a7fc640 1 --2- 172.21.15.79:0/2266324010 >> v2:172.21.15.189:3300/0 conn(0x7fd11c15e310 0x7fd11c0b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.179+0000 7fd11a7fc640 1 -- 172.21.15.79:0/2266324010 >> v1:172.21.15.189:6789/0 conn(0x7fd11c06e070 legacy=0x7fd11c0b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.179+0000 7fd11a7fc640 1 -- 172.21.15.79:0/2266324010 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11c06f810 con 0x7fd11c0b3cd0 2024-04-25T02:08:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.179+0000 7fd11affd640 1 --2- 172.21.15.79:0/2266324010 >> v2:172.21.15.189:3300/0 conn(0x7fd11c15e310 0x7fd11c0b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.180+0000 7fd11a7fc640 1 --2- 172.21.15.79:0/2266324010 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd11c0b3cd0 0x7fd11c06db30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd1100097a0 tx=0x7fd11002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2058f9dce1c2178 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.180+0000 7fd119ffb640 1 -- 172.21.15.79:0/2266324010 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110037070 con 0x7fd11c0b3cd0 2024-04-25T02:08:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.180+0000 7fd119ffb640 1 -- 172.21.15.79:0/2266324010 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd110032440 con 0x7fd11c0b3cd0 2024-04-25T02:08:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.180+0000 7fd119ffb640 1 -- 172.21.15.79:0/2266324010 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110032810 con 0x7fd11c0b3cd0 2024-04-25T02:08:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.180+0000 7fd121288640 1 -- 172.21.15.79:0/2266324010 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd11c0b3cd0 msgr2=0x7fd11c06db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.181+0000 7fd121288640 1 --2- 172.21.15.79:0/2266324010 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd11c0b3cd0 0x7fd11c06db30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd1100097a0 tx=0x7fd11002a180 comp rx=0 tx=0).stop 2024-04-25T02:08:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.181+0000 7fd121288640 1 -- 172.21.15.79:0/2266324010 shutdown_connections 2024-04-25T02:08:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.181+0000 7fd121288640 1 --2- 172.21.15.79:0/2266324010 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd11c0b3cd0 0x7fd11c06db30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.181+0000 7fd121288640 1 --2- 172.21.15.79:0/2266324010 >> v2:172.21.15.189:3300/0 conn(0x7fd11c15e310 0x7fd11c0b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.181+0000 7fd121288640 1 -- 172.21.15.79:0/2266324010 >> 172.21.15.79:0/2266324010 conn(0x7fd11c0b29d0 msgr2=0x7fd11c0b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.181+0000 7fd121288640 1 -- 172.21.15.79:0/2266324010 shutdown_connections 2024-04-25T02:08:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.181+0000 7fd121288640 1 -- 172.21.15.79:0/2266324010 wait complete. 2024-04-25T02:08:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.182+0000 7fd121288640 1 Processor -- start 2024-04-25T02:08:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.182+0000 7fd121288640 1 -- start start 2024-04-25T02:08:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd121288640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd11c06e070 0x7fd11c1f7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd121288640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd11c0b3cd0 0x7fd11c151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd121288640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd11c15e310 0x7fd11c151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd121288640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c06ba80 con 0x7fd11c15e310 2024-04-25T02:08:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd121288640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c06bd80 con 0x7fd11c0b3cd0 2024-04-25T02:08:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd121288640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd11c0b5e40 con 0x7fd11c06e070 2024-04-25T02:08:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd11b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd11c15e310 0x7fd11c151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd11b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd11c15e310 0x7fd11c151cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47514/0 (socket says 172.21.15.79:47514) 2024-04-25T02:08:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd11b7fe640 1 -- 172.21.15.79:0/1090006313 learned_addr learned my addr 172.21.15.79:0/1090006313 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd11affd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd11c06e070 0x7fd11c1f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd11a7fc640 1 --2- 172.21.15.79:0/1090006313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd11c0b3cd0 0x7fd11c151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd11affd640 1 -- 172.21.15.79:0/1090006313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd11c0b3cd0 msgr2=0x7fd11c151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd11affd640 1 --2- 172.21.15.79:0/1090006313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd11c0b3cd0 0x7fd11c151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd11affd640 1 -- 172.21.15.79:0/1090006313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd11c15e310 msgr2=0x7fd11c151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd11affd640 1 --2- 172.21.15.79:0/1090006313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd11c15e310 0x7fd11c151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd11affd640 1 -- 172.21.15.79:0/1090006313 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11c0b26e0 con 0x7fd11c06e070 2024-04-25T02:08:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd11b7fe640 1 --2- 172.21.15.79:0/1090006313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd11c15e310 0x7fd11c151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd11affd640 1 --2- 172.21.15.79:0/1090006313 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd11c06e070 0x7fd11c1f7690 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd10c00e860 tx=0x7fd10c00ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd1037fe640 1 -- 172.21.15.79:0/1090006313 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c004030 con 0x7fd11c06e070 2024-04-25T02:08:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd1037fe640 1 -- 172.21.15.79:0/1090006313 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd10c0041d0 con 0x7fd11c06e070 2024-04-25T02:08:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.183+0000 7fd121288640 1 -- 172.21.15.79:0/1090006313 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd11c0b10e0 con 0x7fd11c06e070 2024-04-25T02:08:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.184+0000 7fd1037fe640 1 -- 172.21.15.79:0/1090006313 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c00c940 con 0x7fd11c06e070 2024-04-25T02:08:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.184+0000 7fd121288640 1 -- 172.21.15.79:0/1090006313 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd11c0b0600 con 0x7fd11c06e070 2024-04-25T02:08:40.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.184+0000 7fd121288640 1 -- 172.21.15.79:0/1090006313 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd11c0690a0 con 0x7fd11c06e070 2024-04-25T02:08:40.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.185+0000 7fd1037fe640 1 -- 172.21.15.79:0/1090006313 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd10c00cae0 con 0x7fd11c06e070 2024-04-25T02:08:40.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.185+0000 7fd1037fe640 1 --2- 172.21.15.79:0/1090006313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd10806be30 0x7fd10806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:40.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.185+0000 7fd11a7fc640 1 --2- 172.21.15.79:0/1090006313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd10806be30 0x7fd10806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:40.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.185+0000 7fd1037fe640 1 -- 172.21.15.79:0/1090006313 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5473+0+0 (secure 0 0 0) 0x7fd10c08ad50 con 0x7fd11c06e070 2024-04-25T02:08:40.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.186+0000 7fd11a7fc640 1 --2- 172.21.15.79:0/1090006313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd10806be30 0x7fd10806e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd110034000 tx=0x7fd11002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:40.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.190+0000 7fd1037fe640 1 -- 172.21.15.79:0/1090006313 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd10c017020 con 0x7fd11c06e070 2024-04-25T02:08:40.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:40.366+0000 7fd121288640 1 -- 172.21.15.79:0/1090006313 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd11c06c6c0 con 0x7fd11c06e070 2024-04-25T02:08:41.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.058+0000 7fd1037fe640 1 -- 172.21.15.79:0/1090006313 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7fd10c059180 con 0x7fd11c06e070 2024-04-25T02:08:41.066 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-04-25T02:08:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.061+0000 7fd121288640 1 -- 172.21.15.79:0/1090006313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd10806be30 msgr2=0x7fd10806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.061+0000 7fd121288640 1 --2- 172.21.15.79:0/1090006313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd10806be30 0x7fd10806e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd110034000 tx=0x7fd11002e000 comp rx=0 tx=0).stop 2024-04-25T02:08:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.061+0000 7fd121288640 1 -- 172.21.15.79:0/1090006313 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd11c06e070 msgr2=0x7fd11c1f7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.061+0000 7fd121288640 1 --2- 172.21.15.79:0/1090006313 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd11c06e070 0x7fd11c1f7690 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd10c00e860 tx=0x7fd10c00ed20 comp rx=0 tx=0).stop 2024-04-25T02:08:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.061+0000 7fd121288640 1 -- 172.21.15.79:0/1090006313 shutdown_connections 2024-04-25T02:08:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.061+0000 7fd121288640 1 --2- 172.21.15.79:0/1090006313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd10806be30 0x7fd10806e2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.061+0000 7fd121288640 1 --2- 172.21.15.79:0/1090006313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd11c15e310 0x7fd11c151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.061+0000 7fd121288640 1 --2- 172.21.15.79:0/1090006313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd11c0b3cd0 0x7fd11c151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.061+0000 7fd121288640 1 --2- 172.21.15.79:0/1090006313 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd11c06e070 0x7fd11c1f7690 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.061+0000 7fd121288640 1 -- 172.21.15.79:0/1090006313 >> 172.21.15.79:0/1090006313 conn(0x7fd11c0b29d0 msgr2=0x7fd11c0b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.061+0000 7fd121288640 1 -- 172.21.15.79:0/1090006313 shutdown_connections 2024-04-25T02:08:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.061+0000 7fd121288640 1 -- 172.21.15.79:0/1090006313 wait complete. 2024-04-25T02:08:41.081 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T02:08:41.081 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T02:08:41.082 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T02:08:41.082 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:08:41.082 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T02:08:41.082 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T02:08:41.082 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T02:08:41.082 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:08:41.083 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T02:08:41.083 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T02:08:41.083 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T02:08:41.083 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:08:41.083 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T02:08:41.083 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T02:08:41.084 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T02:08:41.084 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:08:41.092 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T02:08:41.092 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T02:08:41.093 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T02:08:41.093 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T02:08:41.096 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T02:08:41.096 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T02:08:41.096 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T02:08:41.097 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T02:08:41.134 INFO:tasks.ceph.mds.a:Started 2024-04-25T02:08:41.135 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:41.135 INFO:tasks.ceph.mds.c:Started 2024-04-25T02:08:41.135 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:41.138 INFO:tasks.ceph.mds.b:Started 2024-04-25T02:08:41.138 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:41.139 INFO:tasks.ceph.mds.d:Started 2024-04-25T02:08:41.139 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:41.139 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T02:08:41.219 INFO:tasks.ceph.mds.d.smithi189.stdout:starting mds.d at 2024-04-25T02:08:41.219 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-04-25T02:08:41.220 INFO:tasks.ceph.mds.b.smithi189.stdout:starting mds.b at 2024-04-25T02:08:41.220 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:08:41.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.244+0000 7f78bbba2640 1 Processor -- start 2024-04-25T02:08:41.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.245+0000 7f78bbba2640 1 -- start start 2024-04-25T02:08:41.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.245+0000 7f78bbba2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b415e4d0 0x7f78b406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:41.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.245+0000 7f78bbba2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78b40d2e20 0x7f78b40cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:41.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.245+0000 7f78bbba2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b40d1660 con 0x7f78b40b3570 2024-04-25T02:08:41.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.245+0000 7f78bbba2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f78b40d1380 con 0x7f78b40d2e20 2024-04-25T02:08:41.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.245+0000 7f78bbba2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f78b40cede0 con 0x7f78b415e4d0 2024-04-25T02:08:41.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.245+0000 7f78ba13f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78b40d2e20 0x7f78b40cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:41.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.246+0000 7f78ba13f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78b40d2e20 0x7f78b40cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47540/0 (socket says 172.21.15.79:47540) 2024-04-25T02:08:41.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.246+0000 7f78ba13f640 1 -- 172.21.15.79:0/2548304830 learned_addr learned my addr 172.21.15.79:0/2548304830 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:41.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.246+0000 7f78b993e640 1 --2- 172.21.15.79:0/2548304830 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b415e4d0 0x7f78b406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:41.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.246+0000 7f78ba13f640 1 -- 172.21.15.79:0/2548304830 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b415e4d0 msgr2=0x7f78b406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:41.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.246+0000 7f78ba13f640 1 --2- 172.21.15.79:0/2548304830 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b415e4d0 0x7f78b406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.246+0000 7f78ba13f640 1 -- 172.21.15.79:0/2548304830 >> v1:172.21.15.189:6789/0 conn(0x7f78b40b3570 legacy=0x7f78b40d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:41.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.246+0000 7f78ba13f640 1 -- 172.21.15.79:0/2548304830 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b40cf0c0 con 0x7f78b40d2e20 2024-04-25T02:08:41.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.247+0000 7f78ba13f640 1 --2- 172.21.15.79:0/2548304830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b40d2e20 0x7f78b40cf5e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009e50 tx=0x7f78ac02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b896513d4708becf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:41.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.247+0000 7f78b893c640 1 -- 172.21.15.79:0/2548304830 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ac036070 con 0x7f78b40d2e20 2024-04-25T02:08:41.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.247+0000 7f78b893c640 1 -- 172.21.15.79:0/2548304830 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78ac031600 con 0x7f78b40d2e20 2024-04-25T02:08:41.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.247+0000 7f78b893c640 1 -- 172.21.15.79:0/2548304830 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0319d0 con 0x7f78b40d2e20 2024-04-25T02:08:41.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.247+0000 7f78bbba2640 1 -- 172.21.15.79:0/2548304830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b40d2e20 msgr2=0x7f78b40cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.247+0000 7f78bbba2640 1 --2- 172.21.15.79:0/2548304830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b40d2e20 0x7f78b40cf5e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009e50 tx=0x7f78ac02a710 comp rx=0 tx=0).stop 2024-04-25T02:08:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.247+0000 7f78bbba2640 1 -- 172.21.15.79:0/2548304830 shutdown_connections 2024-04-25T02:08:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.247+0000 7f78bbba2640 1 --2- 172.21.15.79:0/2548304830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b40d2e20 0x7f78b40cf5e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.247+0000 7f78bbba2640 1 --2- 172.21.15.79:0/2548304830 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b415e4d0 0x7f78b406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.247+0000 7f78bbba2640 1 -- 172.21.15.79:0/2548304830 >> 172.21.15.79:0/2548304830 conn(0x7f78b409d460 msgr2=0x7f78b40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.247+0000 7f78bbba2640 1 -- 172.21.15.79:0/2548304830 shutdown_connections 2024-04-25T02:08:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.247+0000 7f78bbba2640 1 -- 172.21.15.79:0/2548304830 wait complete. 2024-04-25T02:08:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.248+0000 7f78bbba2640 1 Processor -- start 2024-04-25T02:08:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.249+0000 7f78bbba2640 1 -- start start 2024-04-25T02:08:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.249+0000 7f78bbba2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b40b3570 0x7f78b41f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.249+0000 7f78bbba2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b40d2e20 0x7f78b40b91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.249+0000 7f78bbba2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78b415e4d0 0x7f78b40cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.249+0000 7f78bbba2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78b40d2250 con 0x7f78b40b3570 2024-04-25T02:08:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.249+0000 7f78bbba2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f78b40d20d0 con 0x7f78b415e4d0 2024-04-25T02:08:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.249+0000 7f78bbba2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f78b406c1b0 con 0x7f78b40d2e20 2024-04-25T02:08:41.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.249+0000 7f78b993e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b40b3570 0x7f78b41f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:41.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.249+0000 7f78b993e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b40b3570 0x7f78b41f3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47556/0 (socket says 172.21.15.79:47556) 2024-04-25T02:08:41.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.249+0000 7f78b993e640 1 -- 172.21.15.79:0/3890490537 learned_addr learned my addr 172.21.15.79:0/3890490537 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:41.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.249+0000 7f78b913d640 1 --2- 172.21.15.79:0/3890490537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b40d2e20 0x7f78b40b91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:41.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.249+0000 7f78ba13f640 1 --2- 172.21.15.79:0/3890490537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78b415e4d0 0x7f78b40cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:41.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.250+0000 7f78b993e640 1 -- 172.21.15.79:0/3890490537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b40d2e20 msgr2=0x7f78b40b91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:41.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.250+0000 7f78b993e640 1 --2- 172.21.15.79:0/3890490537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b40d2e20 0x7f78b40b91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.250+0000 7f78b993e640 1 -- 172.21.15.79:0/3890490537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78b415e4d0 msgr2=0x7f78b40cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:41.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.250+0000 7f78b993e640 1 --2- 172.21.15.79:0/3890490537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78b415e4d0 0x7f78b40cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.250+0000 7f78b993e640 1 -- 172.21.15.79:0/3890490537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b40cb750 con 0x7f78b40b3570 2024-04-25T02:08:41.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.250+0000 7f78b993e640 1 --2- 172.21.15.79:0/3890490537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b40b3570 0x7f78b41f3860 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f78b000e870 tx=0x7f78b000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:41.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.250+0000 7f78aa7fc640 1 -- 172.21.15.79:0/3890490537 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0017070 con 0x7f78b40b3570 2024-04-25T02:08:41.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.250+0000 7f78aa7fc640 1 -- 172.21.15.79:0/3890490537 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b000c940 con 0x7f78b40b3570 2024-04-25T02:08:41.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.250+0000 7f78bbba2640 1 -- 172.21.15.79:0/3890490537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b40cba30 con 0x7f78b40b3570 2024-04-25T02:08:41.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.250+0000 7f78aa7fc640 1 -- 172.21.15.79:0/3890490537 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b000cd30 con 0x7f78b40b3570 2024-04-25T02:08:41.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.250+0000 7f78bbba2640 1 -- 172.21.15.79:0/3890490537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b40cbff0 con 0x7f78b40b3570 2024-04-25T02:08:41.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.251+0000 7f78bbba2640 1 -- 172.21.15.79:0/3890490537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b40690a0 con 0x7f78b40b3570 2024-04-25T02:08:41.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.251+0000 7f78aa7fc640 1 -- 172.21.15.79:0/3890490537 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78b001a070 con 0x7f78b40b3570 2024-04-25T02:08:41.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.252+0000 7f78aa7fc640 1 --2- 172.21.15.79:0/3890490537 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f789806be30 0x7f789806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:41.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.252+0000 7f78aa7fc640 1 -- 172.21.15.79:0/3890490537 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7f78b008acd0 con 0x7f78b40b3570 2024-04-25T02:08:41.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.252+0000 7f78b913d640 1 --2- 172.21.15.79:0/3890490537 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f789806be30 0x7f789806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:41.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.252+0000 7f78b913d640 1 --2- 172.21.15.79:0/3890490537 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f789806be30 0x7f789806e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f78b41530f0 tx=0x7f78a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:41.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.256+0000 7f78aa7fc640 1 -- 172.21.15.79:0/3890490537 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f78b0059330 con 0x7f78b40b3570 2024-04-25T02:08:41.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:41.444+0000 7f78bbba2640 1 -- 172.21.15.79:0/3890490537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f78b41617f0 con 0x7f78b40b3570 2024-04-25T02:08:42.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.293+0000 7f78aa7fc640 1 -- 172.21.15.79:0/3890490537 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) ==== 97+0+0 (secure 0 0 0) 0x7f78b005d630 con 0x7f78b40b3570 2024-04-25T02:08:42.301 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2024-04-25T02:08:42.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.296+0000 7f78bbba2640 1 -- 172.21.15.79:0/3890490537 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f789806be30 msgr2=0x7f789806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:42.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.296+0000 7f78bbba2640 1 --2- 172.21.15.79:0/3890490537 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f789806be30 0x7f789806e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f78b41530f0 tx=0x7f78a4009040 comp rx=0 tx=0).stop 2024-04-25T02:08:42.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.296+0000 7f78bbba2640 1 -- 172.21.15.79:0/3890490537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b40b3570 msgr2=0x7f78b41f3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:42.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.296+0000 7f78bbba2640 1 --2- 172.21.15.79:0/3890490537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b40b3570 0x7f78b41f3860 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f78b000e870 tx=0x7f78b000ed30 comp rx=0 tx=0).stop 2024-04-25T02:08:42.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.296+0000 7f78bbba2640 1 -- 172.21.15.79:0/3890490537 shutdown_connections 2024-04-25T02:08:42.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.296+0000 7f78bbba2640 1 --2- 172.21.15.79:0/3890490537 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f789806be30 0x7f789806e2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.296+0000 7f78bbba2640 1 --2- 172.21.15.79:0/3890490537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78b415e4d0 0x7f78b40cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.296+0000 7f78bbba2640 1 --2- 172.21.15.79:0/3890490537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b40d2e20 0x7f78b40b91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.296+0000 7f78bbba2640 1 --2- 172.21.15.79:0/3890490537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b40b3570 0x7f78b41f3860 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.296+0000 7f78bbba2640 1 -- 172.21.15.79:0/3890490537 >> 172.21.15.79:0/3890490537 conn(0x7f78b409d460 msgr2=0x7f78b406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:42.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.296+0000 7f78bbba2640 1 -- 172.21.15.79:0/3890490537 shutdown_connections 2024-04-25T02:08:42.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.296+0000 7f78bbba2640 1 -- 172.21.15.79:0/3890490537 wait complete. 2024-04-25T02:08:42.317 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T02:08:42.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.411+0000 7f6bd1534640 1 Processor -- start 2024-04-25T02:08:42.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.411+0000 7f6bd1534640 1 -- start start 2024-04-25T02:08:42.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.412+0000 7f6bd1534640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bcc0d0b10 0x7f6bcc0cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.412+0000 7f6bd1534640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6bcc0d2940 0x7f6bcc0b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.412+0000 7f6bd1534640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bcc0cff30 con 0x7f6bcc15c230 2024-04-25T02:08:42.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.412+0000 7f6bd1534640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6bcc0cf720 con 0x7f6bcc0d2940 2024-04-25T02:08:42.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.412+0000 7f6bd1534640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6bcc0cf440 con 0x7f6bcc0d0b10 2024-04-25T02:08:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.412+0000 7f6bcaffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6bcc15c230 0x7f6bcc0d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48626/0 (socket says 172.21.15.79:48626) 2024-04-25T02:08:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.412+0000 7f6bcaffd640 1 -- 172.21.15.79:0/983210293 learned_addr learned my addr 172.21.15.79:0/983210293 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.412+0000 7f6bc9ffb640 1 -- 172.21.15.79:0/983210293 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 51088211 0 0) 0x7f6bbc001490 con 0x7f6bcc15c230 2024-04-25T02:08:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bc9ffb640 1 -- 172.21.15.79:0/983210293 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bb4003520 con 0x7f6bcc15c230 2024-04-25T02:08:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bca7fc640 1 --2- 172.21.15.79:0/983210293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bcc0d0b10 0x7f6bcc0cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bcb7fe640 1 --2- 172.21.15.79:0/983210293 >> v2:172.21.15.189:3300/0 conn(0x7f6bcc0d2940 0x7f6bcc0b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bc9ffb640 1 -- 172.21.15.79:0/983210293 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2481053638 0 0) 0x7f6bb4003520 con 0x7f6bcc15c230 2024-04-25T02:08:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bc9ffb640 1 -- 172.21.15.79:0/983210293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bcc0d0b10 msgr2=0x7f6bcc0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bc9ffb640 1 --2- 172.21.15.79:0/983210293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bcc0d0b10 0x7f6bcc0cee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bc9ffb640 1 -- 172.21.15.79:0/983210293 >> v2:172.21.15.189:3300/0 conn(0x7f6bcc0d2940 msgr2=0x7f6bcc0b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bc9ffb640 1 --2- 172.21.15.79:0/983210293 >> v2:172.21.15.189:3300/0 conn(0x7f6bcc0d2940 0x7f6bcc0b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bc9ffb640 1 -- 172.21.15.79:0/983210293 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bcc0b1390 con 0x7f6bcc15c230 2024-04-25T02:08:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bc9ffb640 1 -- 172.21.15.79:0/983210293 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f6bbc001bc0 con 0x7f6bcc15c230 2024-04-25T02:08:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bc9ffb640 1 -- 172.21.15.79:0/983210293 >> v1:172.21.15.79:6789/0 conn(0x7f6bcc15c230 legacy=0x7f6bcc0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:42.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bc9ffb640 1 --2- 172.21.15.79:0/983210293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bb40039b0 0x7f6bb4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bc9ffb640 1 --2- 172.21.15.79:0/983210293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bb4004800 0x7f6bb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bc9ffb640 1 --2- 172.21.15.79:0/983210293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb40051c0 0x7f6bb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bc9ffb640 1 -- 172.21.15.79:0/983210293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6bcc0cf720 con 0x7f6bb40051c0 2024-04-25T02:08:42.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bc9ffb640 1 -- 172.21.15.79:0/983210293 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6bcc0cf440 con 0x7f6bb40039b0 2024-04-25T02:08:42.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bc9ffb640 1 -- 172.21.15.79:0/983210293 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6bb400c0e0 con 0x7f6bb4004800 2024-04-25T02:08:42.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bca7fc640 1 --2- 172.21.15.79:0/983210293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bcc0d0b10 0x7f6bcc0cee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:42.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bcb7fe640 1 --2- 172.21.15.79:0/983210293 >> v2:172.21.15.189:3300/0 conn(0x7f6bcc0d2940 0x7f6bcc0b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:42.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bcb7fe640 1 --2- 172.21.15.79:0/983210293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb40051c0 0x7f6bb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:42.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bcaffd640 1 --2- 172.21.15.79:0/983210293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bb40039b0 0x7f6bb4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:42.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bca7fc640 1 --2- 172.21.15.79:0/983210293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bb4004800 0x7f6bb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:42.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bcb7fe640 1 -- 172.21.15.79:0/983210293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bb4004800 msgr2=0x7f6bb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:42.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bcb7fe640 1 --2- 172.21.15.79:0/983210293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bb4004800 0x7f6bb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bcb7fe640 1 -- 172.21.15.79:0/983210293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bb40039b0 msgr2=0x7f6bb4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:42.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bcb7fe640 1 --2- 172.21.15.79:0/983210293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bb40039b0 0x7f6bb4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.413+0000 7f6bcb7fe640 1 -- 172.21.15.79:0/983210293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb4003520 con 0x7f6bb40051c0 2024-04-25T02:08:42.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.414+0000 7f6bcb7fe640 1 --2- 172.21.15.79:0/983210293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb40051c0 0x7f6bb400b9c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40098a0 tx=0x7f6bb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c83d06f91c4a3d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:42.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.414+0000 7f6bc9ffb640 1 -- 172.21.15.79:0/983210293 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4037070 con 0x7f6bb40051c0 2024-04-25T02:08:42.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.414+0000 7f6bc9ffb640 1 -- 172.21.15.79:0/983210293 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc402ad20 con 0x7f6bb40051c0 2024-04-25T02:08:42.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.414+0000 7f6bc9ffb640 1 -- 172.21.15.79:0/983210293 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc400f040 con 0x7f6bb40051c0 2024-04-25T02:08:42.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.415+0000 7f6bd1534640 1 -- 172.21.15.79:0/983210293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb40051c0 msgr2=0x7f6bb400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:42.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.415+0000 7f6bd1534640 1 --2- 172.21.15.79:0/983210293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb40051c0 0x7f6bb400b9c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40098a0 tx=0x7f6bb4005830 comp rx=0 tx=0).stop 2024-04-25T02:08:42.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.415+0000 7f6bcb7fe640 1 -- 172.21.15.79:0/983210293 reap_dead start 2024-04-25T02:08:42.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.415+0000 7f6bd1534640 1 -- 172.21.15.79:0/983210293 shutdown_connections 2024-04-25T02:08:42.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.415+0000 7f6bd1534640 1 -- 172.21.15.79:0/983210293 >> 172.21.15.79:0/983210293 conn(0x7f6bcc0d1e20 msgr2=0x7f6bcc0d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:42.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.415+0000 7f6bd1534640 1 -- 172.21.15.79:0/983210293 shutdown_connections 2024-04-25T02:08:42.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.415+0000 7f6bd1534640 1 -- 172.21.15.79:0/983210293 wait complete. 2024-04-25T02:08:42.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.416+0000 7f6bd1534640 1 Processor -- start 2024-04-25T02:08:42.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.416+0000 7f6bd1534640 1 -- start start 2024-04-25T02:08:42.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bd1534640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bcc157e20 0x7f6bcc15f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bd1534640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bcc158200 0x7f6bcc15d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bd1534640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bcc15d670 0x7f6bcc0b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bd1534640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6bcc0cee60 con 0x7f6bcc158200 2024-04-25T02:08:42.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bd1534640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6bcc15c610 con 0x7f6bcc15d670 2024-04-25T02:08:42.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bd1534640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6bcc0cefe0 con 0x7f6bcc157e20 2024-04-25T02:08:42.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bca7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bcc158200 0x7f6bcc15d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:42.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bca7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bcc158200 0x7f6bcc15d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47562/0 (socket says 172.21.15.79:47562) 2024-04-25T02:08:42.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bca7fc640 1 -- 172.21.15.79:0/2063564415 learned_addr learned my addr 172.21.15.79:0/2063564415 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:42.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bcb7fe640 1 --2- 172.21.15.79:0/2063564415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bcc15d670 0x7f6bcc0b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:42.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bcaffd640 1 --2- 172.21.15.79:0/2063564415 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bcc157e20 0x7f6bcc15f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:42.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bca7fc640 1 -- 172.21.15.79:0/2063564415 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bcc157e20 msgr2=0x7f6bcc15f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:42.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bca7fc640 1 --2- 172.21.15.79:0/2063564415 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bcc157e20 0x7f6bcc15f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bca7fc640 1 -- 172.21.15.79:0/2063564415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bcc15d670 msgr2=0x7f6bcc0b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:42.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bca7fc640 1 --2- 172.21.15.79:0/2063564415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bcc15d670 0x7f6bcc0b6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bca7fc640 1 -- 172.21.15.79:0/2063564415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bcc06d940 con 0x7f6bcc158200 2024-04-25T02:08:42.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.417+0000 7f6bca7fc640 1 --2- 172.21.15.79:0/2063564415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bcc158200 0x7f6bcc15d130 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0011570 tx=0x7f6bc0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:42.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.418+0000 7f6bb37fe640 1 -- 172.21.15.79:0/2063564415 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0019020 con 0x7f6bcc158200 2024-04-25T02:08:42.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.418+0000 7f6bb37fe640 1 -- 172.21.15.79:0/2063564415 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc0004440 con 0x7f6bcc158200 2024-04-25T02:08:42.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.418+0000 7f6bd1534640 1 -- 172.21.15.79:0/2063564415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bcc0b6220 con 0x7f6bcc158200 2024-04-25T02:08:42.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.418+0000 7f6bb37fe640 1 -- 172.21.15.79:0/2063564415 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000c070 con 0x7f6bcc158200 2024-04-25T02:08:42.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.418+0000 7f6bd1534640 1 -- 172.21.15.79:0/2063564415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bcc1f4440 con 0x7f6bcc158200 2024-04-25T02:08:42.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.419+0000 7f6bd1534640 1 -- 172.21.15.79:0/2063564415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bcc15da80 con 0x7f6bcc158200 2024-04-25T02:08:42.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.419+0000 7f6bb37fe640 1 -- 172.21.15.79:0/2063564415 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6bc001c020 con 0x7f6bcc158200 2024-04-25T02:08:42.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.419+0000 7f6bb37fe640 1 --2- 172.21.15.79:0/2063564415 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bb806be60 0x7f6bb806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.419+0000 7f6bb37fe640 1 -- 172.21.15.79:0/2063564415 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f6bc008ad90 con 0x7f6bcc158200 2024-04-25T02:08:42.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.419+0000 7f6bcaffd640 1 --2- 172.21.15.79:0/2063564415 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bb806be60 0x7f6bb806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:42.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.420+0000 7f6bcaffd640 1 --2- 172.21.15.79:0/2063564415 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bb806be60 0x7f6bb806e320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc001670 tx=0x7f6bbc006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.424+0000 7f6bb37fe640 1 -- 172.21.15.79:0/2063564415 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6bcc15da80 con 0x7f6bcc158200 2024-04-25T02:08:42.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.662+0000 7f6bd1534640 1 -- 172.21.15.79:0/2063564415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6bcc0681e0 con 0x7f6bcc158200 2024-04-25T02:08:42.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.662+0000 7f6bb37fe640 1 -- 172.21.15.79:0/2063564415 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7f6bc0023020 con 0x7f6bcc158200 2024-04-25T02:08:42.670 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:42.671 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:08:42.671 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2024-04-25T02:08:42.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.671 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2024-04-25T02:08:42.671 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmkSfsJhAAEP9aqirUawsrrvVUkxkO0w==", 2024-04-25T02:08:42.671 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.671 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:08:42.671 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:08:42.671 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:08:42.671 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:08:42.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2024-04-25T02:08:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilm8wYYMhAA98c3h9c80Y9zYzVv+kY7qQ==", 2024-04-25T02:08:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:08:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:08:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:08:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:08:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2024-04-25T02:08:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmiqSiLRAAmCUWUrHC31tkg0dkXS54cA==", 2024-04-25T02:08:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:08:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:08:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:08:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:08:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2024-04-25T02:08:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmiPbkOBAA+rBwAypY5jrR3xafG9h1sw==", 2024-04-25T02:08:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:08:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:08:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:08:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:08:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.674 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2024-04-25T02:08:42.674 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDJuilmP1AdGBAAS0IkH2E3XQvkxA33GInm5w==", 2024-04-25T02:08:42.674 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.674 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:08:42.674 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:08:42.674 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:08:42.674 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.674 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2024-04-25T02:08:42.674 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDMuilm479HFhAA8iIjBC94pqHikS5kPHipCQ==", 2024-04-25T02:08:42.674 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:08:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:08:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:08:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2024-04-25T02:08:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDPuilmE+k9FBAARX3P/kjt7ybeVHGGyYaWwg==", 2024-04-25T02:08:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:08:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:08:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:08:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDSuilmUF41EhAA1HhTXWnhVwETe+4hxmxjFw==", 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDYuilm2pisGRAAFBmWVAGib2guJobYooLQoA==", 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:08:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:08:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2024-04-25T02:08:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDbuilm28m9FxAA8GOmzxRAlK6o/RTe+FpL7g==", 2024-04-25T02:08:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:08:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:08:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:08:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2024-04-25T02:08:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDeuilmzDRyFRAAKk7JWPVRxxE+B4OCJhaXvg==", 2024-04-25T02:08:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:08:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:08:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:08:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2024-04-25T02:08:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDhuilmQABhExAA40Inq4eg4oohO3tmNdCyPQ==", 2024-04-25T02:08:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:08:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:08:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:08:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2024-04-25T02:08:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g==", 2024-04-25T02:08:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:08:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:08:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:08:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:08:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2024-04-25T02:08:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilm8EWZCRAAjRomNRANd7sC+tpYZ1uE6w==", 2024-04-25T02:08:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:08:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:08:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:08:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:08:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2024-04-25T02:08:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmHUedBhAA84h2PNUgReBGQ3rubcEDsw==", 2024-04-25T02:08:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:08:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:08:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:08:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:08:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2024-04-25T02:08:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmCx4UDxAAZmQdQB8RdTMr2JKr7TMySg==", 2024-04-25T02:08:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:08:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:08:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:08:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:08:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2024-04-25T02:08:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmFgdeDBAAu+VeVhknKsm+Gxzh5+qANg==", 2024-04-25T02:08:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:08:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:08:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:08:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:08:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-mds", 2024-04-25T02:08:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDnuilmHWfwAhAAIt7BC8SdCRDu5vfrTrXv+w==", 2024-04-25T02:08:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-mds" 2024-04-25T02:08:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-mgr", 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDnuilml2/wAhAAhgAyib3vAyNWHuMYQL4Fkw==", 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-osd", 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDnuilmXHbwAhAA8DwXcDkReIpPO2pPUwK6eA==", 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-osd" 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-rbd", 2024-04-25T02:08:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDnuilm6XzwAhAAQpYnvCO/kVxDOn/WnncJYA==", 2024-04-25T02:08:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-25T02:08:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-25T02:08:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDnuilmr4TwAhAAskLfvtTacXQ7LEjarO0JZg==", 2024-04-25T02:08:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-25T02:08:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-rgw", 2024-04-25T02:08:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDnuilmmIvwAhAAMx4NoRekUeXf4ukG8wDL7Q==", 2024-04-25T02:08:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmXrLhIxAAiq13px9HksQtu+qjoRi1qQ==", 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmV8dxIBAA8GX2T/ZqZF+3qDjtddh/ZQ==", 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:08:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:08:42.686 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-04-25T02:08:42.686 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:08:42.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:42.686 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T02:08:42.686 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:08:42.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.664+0000 7f6bd1534640 1 -- 172.21.15.79:0/2063564415 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bb806be60 msgr2=0x7f6bb806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:42.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.664+0000 7f6bd1534640 1 --2- 172.21.15.79:0/2063564415 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bb806be60 0x7f6bb806e320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc001670 tx=0x7f6bbc006040 comp rx=0 tx=0).stop 2024-04-25T02:08:42.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.664+0000 7f6bd1534640 1 -- 172.21.15.79:0/2063564415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bcc158200 msgr2=0x7f6bcc15d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:42.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.664+0000 7f6bd1534640 1 --2- 172.21.15.79:0/2063564415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bcc158200 0x7f6bcc15d130 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0011570 tx=0x7f6bc0011a30 comp rx=0 tx=0).stop 2024-04-25T02:08:42.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.664+0000 7f6bd1534640 1 -- 172.21.15.79:0/2063564415 shutdown_connections 2024-04-25T02:08:42.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.664+0000 7f6bd1534640 1 --2- 172.21.15.79:0/2063564415 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bb806be60 0x7f6bb806e320 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.664+0000 7f6bd1534640 1 --2- 172.21.15.79:0/2063564415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bcc15d670 0x7f6bcc0b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.664+0000 7f6bd1534640 1 --2- 172.21.15.79:0/2063564415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bcc158200 0x7f6bcc15d130 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.664+0000 7f6bd1534640 1 --2- 172.21.15.79:0/2063564415 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bcc157e20 0x7f6bcc15f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.664+0000 7f6bd1534640 1 -- 172.21.15.79:0/2063564415 >> 172.21.15.79:0/2063564415 conn(0x7f6bcc0d1e20 msgr2=0x7f6bcc06fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:42.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.664+0000 7f6bd1534640 1 -- 172.21.15.79:0/2063564415 shutdown_connections 2024-04-25T02:08:42.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.664+0000 7f6bd1534640 1 -- 172.21.15.79:0/2063564415 wait complete. 2024-04-25T02:08:42.689 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-25T02:08:42.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.777+0000 7fe26228c640 1 Processor -- start 2024-04-25T02:08:42.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.777+0000 7fe26228c640 1 -- start start 2024-04-25T02:08:42.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.778+0000 7fe26228c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe25c06e3b0 0x7fe25c0b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.778+0000 7fe26228c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe25c071e00 con 0x7fe25c06df50 2024-04-25T02:08:42.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.778+0000 7fe26228c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe25c0720a0 con 0x7fe25c143bc0 2024-04-25T02:08:42.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.778+0000 7fe26228c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe25c072cb0 con 0x7fe25c06e3b0 2024-04-25T02:08:42.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.778+0000 7fe25b7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe25c06df50 0x7fe25c0b2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48628/0 (socket says 172.21.15.79:48628) 2024-04-25T02:08:42.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.778+0000 7fe25b7fe640 1 -- 172.21.15.79:0/1326541855 learned_addr learned my addr 172.21.15.79:0/1326541855 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:42.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.778+0000 7fe260829640 1 --2- 172.21.15.79:0/1326541855 >> v2:172.21.15.189:3300/0 conn(0x7fe25c06e3b0 0x7fe25c0b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:42.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.778+0000 7fe25affd640 1 -- 172.21.15.79:0/1326541855 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3490243189 0 0) 0x7fe25c071e00 con 0x7fe25c06df50 2024-04-25T02:08:42.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.778+0000 7fe25affd640 1 -- 172.21.15.79:0/1326541855 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe244003520 con 0x7fe25c06df50 2024-04-25T02:08:42.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.778+0000 7fe25affd640 1 -- 172.21.15.79:0/1326541855 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3493249660 0 0) 0x7fe244003520 con 0x7fe25c06df50 2024-04-25T02:08:42.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25affd640 1 -- 172.21.15.79:0/1326541855 >> v2:172.21.15.189:3300/0 conn(0x7fe25c06e3b0 msgr2=0x7fe25c0b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:42.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25affd640 1 --2- 172.21.15.79:0/1326541855 >> v2:172.21.15.189:3300/0 conn(0x7fe25c06e3b0 0x7fe25c0b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25affd640 1 -- 172.21.15.79:0/1326541855 >> v1:172.21.15.189:6789/0 conn(0x7fe25c143bc0 legacy=0x7fe25c15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:42.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25affd640 1 -- 172.21.15.79:0/1326541855 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25c072380 con 0x7fe25c06df50 2024-04-25T02:08:42.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25affd640 1 -- 172.21.15.79:0/1326541855 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fe250001670 con 0x7fe25c06df50 2024-04-25T02:08:42.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25affd640 1 -- 172.21.15.79:0/1326541855 >> v1:172.21.15.79:6789/0 conn(0x7fe25c06df50 legacy=0x7fe25c0b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:42.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25affd640 1 --2- 172.21.15.79:0/1326541855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2440039b0 0x7fe244003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25affd640 1 --2- 172.21.15.79:0/1326541855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2440043b0 0x7fe244004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25affd640 1 --2- 172.21.15.79:0/1326541855 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe244005120 0x7fe24400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25affd640 1 -- 172.21.15.79:0/1326541855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c072cb0 con 0x7fe2440043b0 2024-04-25T02:08:42.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25affd640 1 -- 172.21.15.79:0/1326541855 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe24400c060 con 0x7fe2440039b0 2024-04-25T02:08:42.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25affd640 1 -- 172.21.15.79:0/1326541855 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe24400c260 con 0x7fe244005120 2024-04-25T02:08:42.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25b7fe640 1 --2- 172.21.15.79:0/1326541855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2440043b0 0x7fe244004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:42.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25bfff640 1 --2- 172.21.15.79:0/1326541855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2440039b0 0x7fe244003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:42.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe260829640 1 --2- 172.21.15.79:0/1326541855 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe244005120 0x7fe24400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:42.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25b7fe640 1 -- 172.21.15.79:0/1326541855 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe244005120 msgr2=0x7fe24400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:42.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25b7fe640 1 --2- 172.21.15.79:0/1326541855 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe244005120 0x7fe24400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25b7fe640 1 -- 172.21.15.79:0/1326541855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2440039b0 msgr2=0x7fe244003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:42.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25b7fe640 1 --2- 172.21.15.79:0/1326541855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2440039b0 0x7fe244003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25b7fe640 1 -- 172.21.15.79:0/1326541855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe244003520 con 0x7fe2440043b0 2024-04-25T02:08:42.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe260829640 1 -- 172.21.15.79:0/1326541855 reap_dead start 2024-04-25T02:08:42.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.779+0000 7fe25bfff640 1 --2- 172.21.15.79:0/1326541855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2440039b0 0x7fe244003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:42.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.780+0000 7fe25b7fe640 1 --2- 172.21.15.79:0/1326541855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2440043b0 0x7fe244004880 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe25000c240 tx=0x7fe244005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a362784e1e096554 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:42.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.780+0000 7fe25affd640 1 -- 172.21.15.79:0/1326541855 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe250007d30 con 0x7fe2440043b0 2024-04-25T02:08:42.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.780+0000 7fe25affd640 1 -- 172.21.15.79:0/1326541855 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe250005af0 con 0x7fe2440043b0 2024-04-25T02:08:42.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.780+0000 7fe25affd640 1 -- 172.21.15.79:0/1326541855 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe250007070 con 0x7fe2440043b0 2024-04-25T02:08:42.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.780+0000 7fe26228c640 1 -- 172.21.15.79:0/1326541855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2440043b0 msgr2=0x7fe244004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:42.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.780+0000 7fe26228c640 1 --2- 172.21.15.79:0/1326541855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2440043b0 0x7fe244004880 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe25000c240 tx=0x7fe244005830 comp rx=0 tx=0).stop 2024-04-25T02:08:42.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.780+0000 7fe26228c640 1 -- 172.21.15.79:0/1326541855 shutdown_connections 2024-04-25T02:08:42.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.780+0000 7fe26228c640 1 --2- 172.21.15.79:0/1326541855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2440043b0 0x7fe244004880 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.780+0000 7fe26228c640 1 -- 172.21.15.79:0/1326541855 >> 172.21.15.79:0/1326541855 conn(0x7fe25c0cfc80 msgr2=0x7fe25c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:42.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.780+0000 7fe26228c640 1 -- 172.21.15.79:0/1326541855 shutdown_connections 2024-04-25T02:08:42.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.780+0000 7fe26228c640 1 -- 172.21.15.79:0/1326541855 wait complete. 2024-04-25T02:08:42.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.781+0000 7fe26228c640 1 Processor -- start 2024-04-25T02:08:42.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.782+0000 7fe26228c640 1 -- start start 2024-04-25T02:08:42.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.782+0000 7fe26228c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2440043b0 0x7fe25c0ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.782+0000 7fe26228c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe25c13e360 0x7fe25c15b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.782+0000 7fe26228c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe25c15bef0 0x7fe25c1f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.782+0000 7fe26228c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c06e840 con 0x7fe25c15bef0 2024-04-25T02:08:42.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.782+0000 7fe26228c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c072940 con 0x7fe25c13e360 2024-04-25T02:08:42.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.782+0000 7fe26228c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe25c143fa0 con 0x7fe2440043b0 2024-04-25T02:08:42.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.782+0000 7fe260829640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe25c15bef0 0x7fe25c1f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:42.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.782+0000 7fe260829640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe25c15bef0 0x7fe25c1f5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47580/0 (socket says 172.21.15.79:47580) 2024-04-25T02:08:42.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.782+0000 7fe260829640 1 -- 172.21.15.79:0/2665588570 learned_addr learned my addr 172.21.15.79:0/2665588570 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:42.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.783+0000 7fe260829640 1 -- 172.21.15.79:0/2665588570 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2440043b0 msgr2=0x7fe25c0ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:42.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.783+0000 7fe260829640 1 --2- 172.21.15.79:0/2665588570 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2440043b0 0x7fe25c0ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.783+0000 7fe260829640 1 -- 172.21.15.79:0/2665588570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe25c13e360 msgr2=0x7fe25c15b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:42.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.783+0000 7fe260829640 1 --2- 172.21.15.79:0/2665588570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe25c13e360 0x7fe25c15b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:42.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.783+0000 7fe260829640 1 -- 172.21.15.79:0/2665588570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25c0aa820 con 0x7fe25c15bef0 2024-04-25T02:08:42.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.783+0000 7fe260829640 1 --2- 172.21.15.79:0/2665588570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe25c15bef0 0x7fe25c1f5400 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe25c070ca0 tx=0x7fe2540115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:42.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.783+0000 7fe258ff9640 1 -- 172.21.15.79:0/2665588570 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254011de0 con 0x7fe25c15bef0 2024-04-25T02:08:42.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.783+0000 7fe258ff9640 1 -- 172.21.15.79:0/2665588570 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe25401b070 con 0x7fe25c15bef0 2024-04-25T02:08:42.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.783+0000 7fe26228c640 1 -- 172.21.15.79:0/2665588570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25c0a9f80 con 0x7fe25c15bef0 2024-04-25T02:08:42.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.783+0000 7fe258ff9640 1 -- 172.21.15.79:0/2665588570 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254003990 con 0x7fe25c15bef0 2024-04-25T02:08:42.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.783+0000 7fe26228c640 1 -- 172.21.15.79:0/2665588570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe25c0aa540 con 0x7fe25c15bef0 2024-04-25T02:08:42.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.784+0000 7fe26228c640 1 -- 172.21.15.79:0/2665588570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe25c0cc9d0 con 0x7fe25c15bef0 2024-04-25T02:08:42.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.784+0000 7fe258ff9640 1 -- 172.21.15.79:0/2665588570 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe254005d10 con 0x7fe25c15bef0 2024-04-25T02:08:42.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.785+0000 7fe258ff9640 1 --2- 172.21.15.79:0/2665588570 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe24806be30 0x7fe24806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:42.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.785+0000 7fe258ff9640 1 -- 172.21.15.79:0/2665588570 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fe25408b010 con 0x7fe25c15bef0 2024-04-25T02:08:42.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.785+0000 7fe25bfff640 1 --2- 172.21.15.79:0/2665588570 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe24806be30 0x7fe24806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:42.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.785+0000 7fe25bfff640 1 --2- 172.21.15.79:0/2665588570 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe24806be30 0x7fe24806e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe24c007fd0 tx=0x7fe24c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:42.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:42.789+0000 7fe258ff9640 1 -- 172.21.15.79:0/2665588570 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe25c0cc9d0 con 0x7fe25c15bef0 2024-04-25T02:08:43.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.028+0000 7fe26228c640 1 -- 172.21.15.79:0/2665588570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fe25c144400 con 0x7fe25c15bef0 2024-04-25T02:08:43.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.030+0000 7fe258ff9640 1 -- 172.21.15.79:0/2665588570 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7fe25c144400 con 0x7fe25c15bef0 2024-04-25T02:08:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.032+0000 7fe26228c640 1 -- 172.21.15.79:0/2665588570 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe24806be30 msgr2=0x7fe24806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.032+0000 7fe26228c640 1 --2- 172.21.15.79:0/2665588570 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe24806be30 0x7fe24806e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe24c007fd0 tx=0x7fe24c009040 comp rx=0 tx=0).stop 2024-04-25T02:08:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.032+0000 7fe26228c640 1 -- 172.21.15.79:0/2665588570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe25c15bef0 msgr2=0x7fe25c1f5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.032+0000 7fe26228c640 1 --2- 172.21.15.79:0/2665588570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe25c15bef0 0x7fe25c1f5400 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe25c070ca0 tx=0x7fe2540115a0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.032+0000 7fe26228c640 1 -- 172.21.15.79:0/2665588570 shutdown_connections 2024-04-25T02:08:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.032+0000 7fe26228c640 1 --2- 172.21.15.79:0/2665588570 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe24806be30 0x7fe24806e2f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.032+0000 7fe26228c640 1 --2- 172.21.15.79:0/2665588570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe25c15bef0 0x7fe25c1f5400 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.032+0000 7fe26228c640 1 --2- 172.21.15.79:0/2665588570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe25c13e360 0x7fe25c15b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.032+0000 7fe26228c640 1 --2- 172.21.15.79:0/2665588570 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2440043b0 0x7fe25c0ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.032+0000 7fe26228c640 1 -- 172.21.15.79:0/2665588570 >> 172.21.15.79:0/2665588570 conn(0x7fe25c0cfc80 msgr2=0x7fe25c15cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.032+0000 7fe26228c640 1 -- 172.21.15.79:0/2665588570 shutdown_connections 2024-04-25T02:08:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.032+0000 7fe26228c640 1 -- 172.21.15.79:0/2665588570 wait complete. 2024-04-25T02:08:43.051 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-25T02:08:43.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.141+0000 7f582136a640 1 Processor -- start 2024-04-25T02:08:43.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.141+0000 7f582136a640 1 -- start start 2024-04-25T02:08:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.141+0000 7f582136a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f581c06cbd0 0x7f581c06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.141+0000 7f582136a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f581c06cfb0 0x7f581c161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.141+0000 7f582136a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581c0b1d20 con 0x7f581c0d00d0 2024-04-25T02:08:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.141+0000 7f582136a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f581c162620 con 0x7f581c06cbd0 2024-04-25T02:08:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.141+0000 7f582136a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f581c162900 con 0x7f581c06cfb0 2024-04-25T02:08:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.142+0000 7f581affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f581c06cbd0 0x7f581c06c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.142+0000 7f581b7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f581c0d00d0 0x7f581c0b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48630/0 (socket says 172.21.15.79:48630) 2024-04-25T02:08:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.142+0000 7f581b7fe640 1 -- 172.21.15.79:0/1685528589 learned_addr learned my addr 172.21.15.79:0/1685528589 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.142+0000 7f581affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f581c06cbd0 0x7f581c06c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47582/0 (socket says 172.21.15.79:47582) 2024-04-25T02:08:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.142+0000 7f581a7fc640 1 --2- 172.21.15.79:0/1685528589 >> v2:172.21.15.189:3300/0 conn(0x7f581c06cfb0 0x7f581c161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.142+0000 7f581affd640 1 -- 172.21.15.79:0/1685528589 >> v2:172.21.15.189:3300/0 conn(0x7f581c06cfb0 msgr2=0x7f581c161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.142+0000 7f581affd640 1 --2- 172.21.15.79:0/1685528589 >> v2:172.21.15.189:3300/0 conn(0x7f581c06cfb0 0x7f581c161df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.142+0000 7f581affd640 1 -- 172.21.15.79:0/1685528589 >> v1:172.21.15.79:6789/0 conn(0x7f581c0d00d0 legacy=0x7f581c0b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.142+0000 7f581affd640 1 -- 172.21.15.79:0/1685528589 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581c162be0 con 0x7f581c06cbd0 2024-04-25T02:08:43.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.143+0000 7f581affd640 1 --2- 172.21.15.79:0/1685528589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c06cbd0 0x7f581c06c3d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f581c161d50 tx=0x7f580c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c42fce7b2dc94d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:43.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.143+0000 7f5819ffb640 1 -- 172.21.15.79:0/1685528589 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c037070 con 0x7f581c06cbd0 2024-04-25T02:08:43.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.143+0000 7f5819ffb640 1 -- 172.21.15.79:0/1685528589 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c032440 con 0x7f581c06cbd0 2024-04-25T02:08:43.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.143+0000 7f5819ffb640 1 -- 172.21.15.79:0/1685528589 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c02ae60 con 0x7f581c06cbd0 2024-04-25T02:08:43.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.143+0000 7f582136a640 1 -- 172.21.15.79:0/1685528589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c06cbd0 msgr2=0x7f581c06c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.143+0000 7f582136a640 1 --2- 172.21.15.79:0/1685528589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c06cbd0 0x7f581c06c3d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f581c161d50 tx=0x7f580c02a110 comp rx=0 tx=0).stop 2024-04-25T02:08:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.143+0000 7f582136a640 1 -- 172.21.15.79:0/1685528589 shutdown_connections 2024-04-25T02:08:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.143+0000 7f582136a640 1 --2- 172.21.15.79:0/1685528589 >> v2:172.21.15.189:3300/0 conn(0x7f581c06cfb0 0x7f581c161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.143+0000 7f582136a640 1 --2- 172.21.15.79:0/1685528589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c06cbd0 0x7f581c06c3d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.143+0000 7f582136a640 1 -- 172.21.15.79:0/1685528589 >> 172.21.15.79:0/1685528589 conn(0x7f581c09aa70 msgr2=0x7f581c09ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.143+0000 7f582136a640 1 -- 172.21.15.79:0/1685528589 shutdown_connections 2024-04-25T02:08:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.143+0000 7f582136a640 1 -- 172.21.15.79:0/1685528589 wait complete. 2024-04-25T02:08:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.145+0000 7f582136a640 1 Processor -- start 2024-04-25T02:08:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.145+0000 7f582136a640 1 -- start start 2024-04-25T02:08:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.145+0000 7f582136a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c06cbd0 0x7f581c14fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.145+0000 7f582136a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f581c06cfb0 0x7f581c0b7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.145+0000 7f582136a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f581c0d00d0 0x7f581c14ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.145+0000 7f582136a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f581c15e600 con 0x7f581c06cbd0 2024-04-25T02:08:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.145+0000 7f582136a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f581c162330 con 0x7f581c0d00d0 2024-04-25T02:08:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.145+0000 7f582136a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f581c06d410 con 0x7f581c06cfb0 2024-04-25T02:08:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.145+0000 7f581affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c06cbd0 0x7f581c14fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.145+0000 7f581affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c06cbd0 0x7f581c14fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47596/0 (socket says 172.21.15.79:47596) 2024-04-25T02:08:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.145+0000 7f581affd640 1 -- 172.21.15.79:0/2252869468 learned_addr learned my addr 172.21.15.79:0/2252869468 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.146+0000 7f581a7fc640 1 --2- 172.21.15.79:0/2252869468 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f581c06cfb0 0x7f581c0b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.146+0000 7f581b7fe640 1 --2- 172.21.15.79:0/2252869468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f581c0d00d0 0x7f581c14ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.146+0000 7f581affd640 1 -- 172.21.15.79:0/2252869468 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f581c06cfb0 msgr2=0x7f581c0b7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.146+0000 7f581affd640 1 --2- 172.21.15.79:0/2252869468 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f581c06cfb0 0x7f581c0b7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.146+0000 7f581affd640 1 -- 172.21.15.79:0/2252869468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f581c0d00d0 msgr2=0x7f581c14ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.146+0000 7f581affd640 1 --2- 172.21.15.79:0/2252869468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f581c0d00d0 0x7f581c14ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.146+0000 7f581affd640 1 -- 172.21.15.79:0/2252869468 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581c150310 con 0x7f581c06cbd0 2024-04-25T02:08:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.146+0000 7f581affd640 1 --2- 172.21.15.79:0/2252869468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c06cbd0 0x7f581c14fdd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f580c000c00 tx=0x7f580c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.146+0000 7f58037fe640 1 -- 172.21.15.79:0/2252869468 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c041070 con 0x7f581c06cbd0 2024-04-25T02:08:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.146+0000 7f58037fe640 1 -- 172.21.15.79:0/2252869468 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c03c890 con 0x7f581c06cbd0 2024-04-25T02:08:43.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.146+0000 7f582136a640 1 -- 172.21.15.79:0/2252869468 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f581c0b7ac0 con 0x7f581c06cbd0 2024-04-25T02:08:43.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.146+0000 7f58037fe640 1 -- 172.21.15.79:0/2252869468 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c037040 con 0x7f581c06cbd0 2024-04-25T02:08:43.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.146+0000 7f582136a640 1 -- 172.21.15.79:0/2252869468 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f581c0b67c0 con 0x7f581c06cbd0 2024-04-25T02:08:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.147+0000 7f582136a640 1 -- 172.21.15.79:0/2252869468 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f581c0690a0 con 0x7f581c06cbd0 2024-04-25T02:08:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.148+0000 7f58037fe640 1 -- 172.21.15.79:0/2252869468 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f580c044070 con 0x7f581c06cbd0 2024-04-25T02:08:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.148+0000 7f58037fe640 1 --2- 172.21.15.79:0/2252869468 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f580806be30 0x7f580806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.148+0000 7f58037fe640 1 -- 172.21.15.79:0/2252869468 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f580c0ab890 con 0x7f581c06cbd0 2024-04-25T02:08:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.148+0000 7f581a7fc640 1 --2- 172.21.15.79:0/2252869468 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f580806be30 0x7f580806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.148+0000 7f581a7fc640 1 --2- 172.21.15.79:0/2252869468 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f580806be30 0x7f580806e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5810006fd0 tx=0x7f5810008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.152+0000 7f58037fe640 1 -- 172.21.15.79:0/2252869468 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f581c150310 con 0x7f581c06cbd0 2024-04-25T02:08:43.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.396+0000 7f582136a640 1 -- 172.21.15.79:0/2252869468 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f581c0c89d0 con 0x7f581c06cbd0 2024-04-25T02:08:43.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.400+0000 7f58037fe640 1 -- 172.21.15.79:0/2252869468 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7f580c07a740 con 0x7f581c06cbd0 2024-04-25T02:08:43.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.402+0000 7f582136a640 1 -- 172.21.15.79:0/2252869468 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f580806be30 msgr2=0x7f580806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.402+0000 7f582136a640 1 --2- 172.21.15.79:0/2252869468 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f580806be30 0x7f580806e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5810006fd0 tx=0x7f5810008040 comp rx=0 tx=0).stop 2024-04-25T02:08:43.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.402+0000 7f582136a640 1 -- 172.21.15.79:0/2252869468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c06cbd0 msgr2=0x7f581c14fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.402+0000 7f582136a640 1 --2- 172.21.15.79:0/2252869468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c06cbd0 0x7f581c14fdd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f580c000c00 tx=0x7f580c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.402+0000 7f582136a640 1 -- 172.21.15.79:0/2252869468 shutdown_connections 2024-04-25T02:08:43.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.402+0000 7f582136a640 1 --2- 172.21.15.79:0/2252869468 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f580806be30 0x7f580806e2f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.402+0000 7f582136a640 1 --2- 172.21.15.79:0/2252869468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f581c0d00d0 0x7f581c14ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.402+0000 7f582136a640 1 --2- 172.21.15.79:0/2252869468 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f581c06cfb0 0x7f581c0b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.402+0000 7f582136a640 1 --2- 172.21.15.79:0/2252869468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c06cbd0 0x7f581c14fdd0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.402+0000 7f582136a640 1 -- 172.21.15.79:0/2252869468 >> 172.21.15.79:0/2252869468 conn(0x7f581c09aa70 msgr2=0x7f581c0b2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:43.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.402+0000 7f582136a640 1 -- 172.21.15.79:0/2252869468 shutdown_connections 2024-04-25T02:08:43.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.402+0000 7f582136a640 1 -- 172.21.15.79:0/2252869468 wait complete. 2024-04-25T02:08:43.421 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-25T02:08:43.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.510+0000 7fee9d21b640 1 Processor -- start 2024-04-25T02:08:43.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.510+0000 7fee9d21b640 1 -- start start 2024-04-25T02:08:43.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.511+0000 7fee9d21b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fee9815e4d0 0x7fee9806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.511+0000 7fee9d21b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fee980b3570 0x7fee980d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.511+0000 7fee9d21b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee980d1660 con 0x7fee980b3020 2024-04-25T02:08:43.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.511+0000 7fee9d21b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fee980d1380 con 0x7fee980b3570 2024-04-25T02:08:43.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.511+0000 7fee9d21b640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fee980cede0 con 0x7fee9815e4d0 2024-04-25T02:08:43.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.511+0000 7fee9659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fee980b3570 0x7fee980d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.511+0000 7fee9659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fee980b3570 0x7fee980d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47600/0 (socket says 172.21.15.79:47600) 2024-04-25T02:08:43.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.511+0000 7fee9659c640 1 -- 172.21.15.79:0/1410245167 learned_addr learned my addr 172.21.15.79:0/1410245167 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:43.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.511+0000 7fee96d9d640 1 --2- 172.21.15.79:0/1410245167 >> v2:172.21.15.189:3300/0 conn(0x7fee9815e4d0 0x7fee9806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.512+0000 7fee9659c640 1 -- 172.21.15.79:0/1410245167 >> v2:172.21.15.189:3300/0 conn(0x7fee9815e4d0 msgr2=0x7fee9806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:43.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.512+0000 7fee9659c640 1 --2- 172.21.15.79:0/1410245167 >> v2:172.21.15.189:3300/0 conn(0x7fee9815e4d0 0x7fee9806bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.512+0000 7fee9659c640 1 -- 172.21.15.79:0/1410245167 >> v1:172.21.15.189:6789/0 conn(0x7fee980b3020 legacy=0x7fee980cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:43.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.512+0000 7fee9659c640 1 -- 172.21.15.79:0/1410245167 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee980cf0c0 con 0x7fee980b3570 2024-04-25T02:08:43.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.512+0000 7fee9659c640 1 --2- 172.21.15.79:0/1410245167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee980b3570 0x7fee980d2710 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009870 tx=0x7fee8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5544250604a623cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:43.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.512+0000 7fee95d9b640 1 -- 172.21.15.79:0/1410245167 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c037070 con 0x7fee980b3570 2024-04-25T02:08:43.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.512+0000 7fee95d9b640 1 -- 172.21.15.79:0/1410245167 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee8c032440 con 0x7fee980b3570 2024-04-25T02:08:43.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.512+0000 7fee95d9b640 1 -- 172.21.15.79:0/1410245167 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c032810 con 0x7fee980b3570 2024-04-25T02:08:43.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.513+0000 7fee9d21b640 1 -- 172.21.15.79:0/1410245167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee980b3570 msgr2=0x7fee980d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.513+0000 7fee9d21b640 1 --2- 172.21.15.79:0/1410245167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee980b3570 0x7fee980d2710 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009870 tx=0x7fee8c02a270 comp rx=0 tx=0).stop 2024-04-25T02:08:43.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.513+0000 7fee9d21b640 1 -- 172.21.15.79:0/1410245167 shutdown_connections 2024-04-25T02:08:43.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.513+0000 7fee9d21b640 1 --2- 172.21.15.79:0/1410245167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee980b3570 0x7fee980d2710 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.513+0000 7fee9d21b640 1 --2- 172.21.15.79:0/1410245167 >> v2:172.21.15.189:3300/0 conn(0x7fee9815e4d0 0x7fee9806bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.513+0000 7fee9d21b640 1 -- 172.21.15.79:0/1410245167 >> 172.21.15.79:0/1410245167 conn(0x7fee9809d460 msgr2=0x7fee980d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:43.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.513+0000 7fee9d21b640 1 -- 172.21.15.79:0/1410245167 shutdown_connections 2024-04-25T02:08:43.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.513+0000 7fee9d21b640 1 -- 172.21.15.79:0/1410245167 wait complete. 2024-04-25T02:08:43.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.514+0000 7fee9d21b640 1 Processor -- start 2024-04-25T02:08:43.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.514+0000 7fee9d21b640 1 -- start start 2024-04-25T02:08:43.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.515+0000 7fee9d21b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee980b3020 0x7fee98158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.515+0000 7fee9d21b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee980b3570 0x7fee980cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.515+0000 7fee9d21b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee9815e4d0 0x7fee980cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.515+0000 7fee9d21b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fee980d2250 con 0x7fee980b3020 2024-04-25T02:08:43.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.515+0000 7fee9d21b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fee980d20d0 con 0x7fee9815e4d0 2024-04-25T02:08:43.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.515+0000 7fee9d21b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fee9806c1b0 con 0x7fee980b3570 2024-04-25T02:08:43.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.515+0000 7fee96d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee980b3020 0x7fee98158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.515+0000 7fee96d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee980b3020 0x7fee98158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59896/0 (socket says 172.21.15.79:59896) 2024-04-25T02:08:43.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.515+0000 7fee96d9d640 1 -- 172.21.15.79:0/443560462 learned_addr learned my addr 172.21.15.79:0/443560462 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:43.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.515+0000 7fee9759e640 1 --2- 172.21.15.79:0/443560462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee9815e4d0 0x7fee980cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.515+0000 7fee9659c640 1 --2- 172.21.15.79:0/443560462 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee980b3570 0x7fee980cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.516+0000 7fee96d9d640 1 -- 172.21.15.79:0/443560462 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee980b3570 msgr2=0x7fee980cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.516+0000 7fee96d9d640 1 --2- 172.21.15.79:0/443560462 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee980b3570 0x7fee980cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.516+0000 7fee96d9d640 1 -- 172.21.15.79:0/443560462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee9815e4d0 msgr2=0x7fee980cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.516+0000 7fee96d9d640 1 --2- 172.21.15.79:0/443560462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee9815e4d0 0x7fee980cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.516+0000 7fee96d9d640 1 -- 172.21.15.79:0/443560462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee980cb740 con 0x7fee980b3020 2024-04-25T02:08:43.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.516+0000 7fee9759e640 1 --2- 172.21.15.79:0/443560462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee9815e4d0 0x7fee980cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:43.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.516+0000 7fee96d9d640 1 --2- 172.21.15.79:0/443560462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee980b3020 0x7fee98158fb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fee88007e70 tx=0x7fee8800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:43.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.516+0000 7fee7f7fe640 1 -- 172.21.15.79:0/443560462 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88014620 con 0x7fee980b3020 2024-04-25T02:08:43.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.516+0000 7fee7f7fe640 1 -- 172.21.15.79:0/443560462 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee88019070 con 0x7fee980b3020 2024-04-25T02:08:43.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.516+0000 7fee7f7fe640 1 -- 172.21.15.79:0/443560462 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88014a00 con 0x7fee980b3020 2024-04-25T02:08:43.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.516+0000 7fee9d21b640 1 -- 172.21.15.79:0/443560462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee980cb9e0 con 0x7fee980b3020 2024-04-25T02:08:43.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.516+0000 7fee9d21b640 1 -- 172.21.15.79:0/443560462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee980cbfa0 con 0x7fee980b3020 2024-04-25T02:08:43.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.517+0000 7fee9d21b640 1 -- 172.21.15.79:0/443560462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee980688f0 con 0x7fee980b3020 2024-04-25T02:08:43.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.517+0000 7fee7f7fe640 1 -- 172.21.15.79:0/443560462 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee88014ba0 con 0x7fee980b3020 2024-04-25T02:08:43.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.518+0000 7fee7f7fe640 1 --2- 172.21.15.79:0/443560462 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fee8406be60 0x7fee8406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.518+0000 7fee7f7fe640 1 -- 172.21.15.79:0/443560462 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fee8808b2a0 con 0x7fee980b3020 2024-04-25T02:08:43.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.518+0000 7fee9659c640 1 --2- 172.21.15.79:0/443560462 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fee8406be60 0x7fee8406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.518+0000 7fee9659c640 1 --2- 172.21.15.79:0/443560462 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fee8406be60 0x7fee8406e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fee8c034000 tx=0x7fee8c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:43.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.522+0000 7fee7f7fe640 1 -- 172.21.15.79:0/443560462 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fee980688f0 con 0x7fee980b3020 2024-04-25T02:08:43.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.761+0000 7fee9d21b640 1 -- 172.21.15.79:0/443560462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fee980690a0 con 0x7fee980b3020 2024-04-25T02:08:43.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.765+0000 7fee7f7fe640 1 -- 172.21.15.79:0/443560462 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fee8805a030 con 0x7fee980b3020 2024-04-25T02:08:43.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.768+0000 7fee9d21b640 1 -- 172.21.15.79:0/443560462 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fee8406be60 msgr2=0x7fee8406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.768+0000 7fee9d21b640 1 --2- 172.21.15.79:0/443560462 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fee8406be60 0x7fee8406e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fee8c034000 tx=0x7fee8c02e000 comp rx=0 tx=0).stop 2024-04-25T02:08:43.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.768+0000 7fee9d21b640 1 -- 172.21.15.79:0/443560462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee980b3020 msgr2=0x7fee98158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.768+0000 7fee9d21b640 1 --2- 172.21.15.79:0/443560462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee980b3020 0x7fee98158fb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fee88007e70 tx=0x7fee8800e4b0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.768+0000 7fee9d21b640 1 -- 172.21.15.79:0/443560462 shutdown_connections 2024-04-25T02:08:43.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.768+0000 7fee9d21b640 1 --2- 172.21.15.79:0/443560462 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fee8406be60 0x7fee8406e320 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.768+0000 7fee9d21b640 1 --2- 172.21.15.79:0/443560462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee9815e4d0 0x7fee980cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.768+0000 7fee9d21b640 1 --2- 172.21.15.79:0/443560462 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee980b3570 0x7fee980cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.768+0000 7fee9d21b640 1 --2- 172.21.15.79:0/443560462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee980b3020 0x7fee98158fb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.768+0000 7fee9d21b640 1 -- 172.21.15.79:0/443560462 >> 172.21.15.79:0/443560462 conn(0x7fee9809d460 msgr2=0x7fee980b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:43.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.768+0000 7fee9d21b640 1 -- 172.21.15.79:0/443560462 shutdown_connections 2024-04-25T02:08:43.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.768+0000 7fee9d21b640 1 -- 172.21.15.79:0/443560462 wait complete. 2024-04-25T02:08:43.787 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-25T02:08:43.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.877+0000 7fd51cba5640 1 Processor -- start 2024-04-25T02:08:43.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.877+0000 7fd51cba5640 1 -- start start 2024-04-25T02:08:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.877+0000 7fd51cba5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd51806e3e0 0x7fd518071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.877+0000 7fd51cba5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd518070d90 con 0x7fd51806df50 2024-04-25T02:08:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51cba5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5180cf130 con 0x7fd518144cb0 2024-04-25T02:08:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51cba5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd5180cf410 con 0x7fd51806e3e0 2024-04-25T02:08:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd515d9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd51806df50 0x7fd518071240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35538/0 (socket says 172.21.15.79:35538) 2024-04-25T02:08:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd515d9b640 1 -- 172.21.15.79:0/2376912085 learned_addr learned my addr 172.21.15.79:0/2376912085 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51559a640 1 -- 172.21.15.79:0/2376912085 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3558950159 0 0) 0x7fd518070d90 con 0x7fd51806df50 2024-04-25T02:08:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd516d9d640 1 --2- 172.21.15.79:0/2376912085 >> v2:172.21.15.189:3300/0 conn(0x7fd51806e3e0 0x7fd518071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51559a640 1 -- 172.21.15.79:0/2376912085 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd500003520 con 0x7fd51806df50 2024-04-25T02:08:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51559a640 1 -- 172.21.15.79:0/2376912085 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3774471675 0 0) 0x7fd500003520 con 0x7fd51806df50 2024-04-25T02:08:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51559a640 1 -- 172.21.15.79:0/2376912085 >> v2:172.21.15.189:3300/0 conn(0x7fd51806e3e0 msgr2=0x7fd518071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51559a640 1 --2- 172.21.15.79:0/2376912085 >> v2:172.21.15.189:3300/0 conn(0x7fd51806e3e0 0x7fd518071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51559a640 1 -- 172.21.15.79:0/2376912085 >> v1:172.21.15.189:6789/0 conn(0x7fd518144cb0 legacy=0x7fd5180b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51559a640 1 -- 172.21.15.79:0/2376912085 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5180cf6f0 con 0x7fd51806df50 2024-04-25T02:08:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51559a640 1 -- 172.21.15.79:0/2376912085 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fd508001670 con 0x7fd51806df50 2024-04-25T02:08:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51559a640 1 -- 172.21.15.79:0/2376912085 >> v1:172.21.15.79:6789/0 conn(0x7fd51806df50 legacy=0x7fd518071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51559a640 1 --2- 172.21.15.79:0/2376912085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5000039b0 0x7fd500003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51559a640 1 --2- 172.21.15.79:0/2376912085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd500004800 0x7fd500004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51559a640 1 --2- 172.21.15.79:0/2376912085 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5000052e0 0x7fd50000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51559a640 1 -- 172.21.15.79:0/2376912085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd5180cf410 con 0x7fd5000039b0 2024-04-25T02:08:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51559a640 1 -- 172.21.15.79:0/2376912085 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd50000c1b0 con 0x7fd500004800 2024-04-25T02:08:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51559a640 1 -- 172.21.15.79:0/2376912085 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd50000c3b0 con 0x7fd5000052e0 2024-04-25T02:08:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd51659c640 1 --2- 172.21.15.79:0/2376912085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5000039b0 0x7fd500003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd515d9b640 1 --2- 172.21.15.79:0/2376912085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd500004800 0x7fd500004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.878+0000 7fd516d9d640 1 --2- 172.21.15.79:0/2376912085 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5000052e0 0x7fd50000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.879+0000 7fd51659c640 1 -- 172.21.15.79:0/2376912085 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5000052e0 msgr2=0x7fd50000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.879+0000 7fd51659c640 1 --2- 172.21.15.79:0/2376912085 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5000052e0 0x7fd50000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.879+0000 7fd51659c640 1 -- 172.21.15.79:0/2376912085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd500004800 msgr2=0x7fd500004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.879+0000 7fd51659c640 1 --2- 172.21.15.79:0/2376912085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd500004800 0x7fd500004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.879+0000 7fd51659c640 1 -- 172.21.15.79:0/2376912085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd500003520 con 0x7fd5000039b0 2024-04-25T02:08:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.879+0000 7fd516d9d640 1 -- 172.21.15.79:0/2376912085 reap_dead start 2024-04-25T02:08:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.879+0000 7fd51659c640 1 --2- 172.21.15.79:0/2376912085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5000039b0 0x7fd500003dd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd50c001720 tx=0x7fd500005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fab27147c798e08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.879+0000 7fd51559a640 1 -- 172.21.15.79:0/2376912085 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c001370 con 0x7fd5000039b0 2024-04-25T02:08:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.879+0000 7fd51559a640 1 -- 172.21.15.79:0/2376912085 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c0052d0 con 0x7fd5000039b0 2024-04-25T02:08:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.879+0000 7fd51559a640 1 -- 172.21.15.79:0/2376912085 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c02ab70 con 0x7fd5000039b0 2024-04-25T02:08:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.880+0000 7fd51cba5640 1 -- 172.21.15.79:0/2376912085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5000039b0 msgr2=0x7fd500003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.880+0000 7fd51cba5640 1 --2- 172.21.15.79:0/2376912085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5000039b0 0x7fd500003dd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd50c001720 tx=0x7fd500005830 comp rx=0 tx=0).stop 2024-04-25T02:08:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.880+0000 7fd51cba5640 1 -- 172.21.15.79:0/2376912085 shutdown_connections 2024-04-25T02:08:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.880+0000 7fd51cba5640 1 --2- 172.21.15.79:0/2376912085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5000039b0 0x7fd500003dd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.880+0000 7fd51cba5640 1 -- 172.21.15.79:0/2376912085 >> 172.21.15.79:0/2376912085 conn(0x7fd5180cfc80 msgr2=0x7fd5180d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.880+0000 7fd51cba5640 1 -- 172.21.15.79:0/2376912085 shutdown_connections 2024-04-25T02:08:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.880+0000 7fd51cba5640 1 -- 172.21.15.79:0/2376912085 wait complete. 2024-04-25T02:08:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.881+0000 7fd51cba5640 1 Processor -- start 2024-04-25T02:08:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.881+0000 7fd51cba5640 1 -- start start 2024-04-25T02:08:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd51cba5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5000039b0 0x7fd518131190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd51cba5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5181f5c20 0x7fd5181f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd51cba5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5181f65e0 0x7fd51815a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd51cba5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd518145090 con 0x7fd5181f5c20 2024-04-25T02:08:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd51cba5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd5180cf9d0 con 0x7fd5181f65e0 2024-04-25T02:08:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd51cba5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd518145ab0 con 0x7fd5000039b0 2024-04-25T02:08:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd515d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5181f5c20 0x7fd5181f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd515d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5181f5c20 0x7fd5181f60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59918/0 (socket says 172.21.15.79:59918) 2024-04-25T02:08:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd515d9b640 1 -- 172.21.15.79:0/1082406196 learned_addr learned my addr 172.21.15.79:0/1082406196 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd516d9d640 1 --2- 172.21.15.79:0/1082406196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5181f65e0 0x7fd51815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd51659c640 1 --2- 172.21.15.79:0/1082406196 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5000039b0 0x7fd518131190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd515d9b640 1 -- 172.21.15.79:0/1082406196 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5000039b0 msgr2=0x7fd518131190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd515d9b640 1 --2- 172.21.15.79:0/1082406196 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5000039b0 0x7fd518131190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd515d9b640 1 -- 172.21.15.79:0/1082406196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5181f65e0 msgr2=0x7fd51815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd515d9b640 1 --2- 172.21.15.79:0/1082406196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5181f65e0 0x7fd51815a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.882+0000 7fd515d9b640 1 -- 172.21.15.79:0/1082406196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5181f6a40 con 0x7fd5181f5c20 2024-04-25T02:08:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.883+0000 7fd515d9b640 1 --2- 172.21.15.79:0/1082406196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5181f5c20 0x7fd5181f60a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd508004ef0 tx=0x7fd508007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.883+0000 7fd506ffd640 1 -- 172.21.15.79:0/1082406196 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50801a070 con 0x7fd5181f5c20 2024-04-25T02:08:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.883+0000 7fd506ffd640 1 -- 172.21.15.79:0/1082406196 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50800f7b0 con 0x7fd5181f5c20 2024-04-25T02:08:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.883+0000 7fd51cba5640 1 -- 172.21.15.79:0/1082406196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd518159c00 con 0x7fd5181f5c20 2024-04-25T02:08:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.883+0000 7fd506ffd640 1 -- 172.21.15.79:0/1082406196 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50800fb60 con 0x7fd5181f5c20 2024-04-25T02:08:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.883+0000 7fd51cba5640 1 -- 172.21.15.79:0/1082406196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd51815a460 con 0x7fd5181f5c20 2024-04-25T02:08:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.884+0000 7fd51cba5640 1 -- 172.21.15.79:0/1082406196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5180690a0 con 0x7fd5181f5c20 2024-04-25T02:08:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.884+0000 7fd506ffd640 1 -- 172.21.15.79:0/1082406196 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd50801d070 con 0x7fd5181f5c20 2024-04-25T02:08:43.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.884+0000 7fd506ffd640 1 --2- 172.21.15.79:0/1082406196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd4f806be30 0x7fd4f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.885+0000 7fd506ffd640 1 -- 172.21.15.79:0/1082406196 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fd50808a400 con 0x7fd5181f5c20 2024-04-25T02:08:43.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.885+0000 7fd51659c640 1 --2- 172.21.15.79:0/1082406196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd4f806be30 0x7fd4f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.885+0000 7fd51659c640 1 --2- 172.21.15.79:0/1082406196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd4f806be30 0x7fd4f806e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd50c032000 tx=0x7fd50c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:43.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:43.890+0000 7fd506ffd640 1 -- 172.21.15.79:0/1082406196 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd508058ab0 con 0x7fd5181f5c20 2024-04-25T02:08:44.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.129+0000 7fd51cba5640 1 -- 172.21.15.79:0/1082406196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fd518159dd0 con 0x7fd5181f5c20 2024-04-25T02:08:44.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.133+0000 7fd506ffd640 1 -- 172.21.15.79:0/1082406196 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fd518159dd0 con 0x7fd5181f5c20 2024-04-25T02:08:44.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.134+0000 7fd51cba5640 1 -- 172.21.15.79:0/1082406196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd4f806be30 msgr2=0x7fd4f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.134+0000 7fd51cba5640 1 --2- 172.21.15.79:0/1082406196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd4f806be30 0x7fd4f806e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd50c032000 tx=0x7fd50c02e000 comp rx=0 tx=0).stop 2024-04-25T02:08:44.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.134+0000 7fd51cba5640 1 -- 172.21.15.79:0/1082406196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5181f5c20 msgr2=0x7fd5181f60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.134+0000 7fd51cba5640 1 --2- 172.21.15.79:0/1082406196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5181f5c20 0x7fd5181f60a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd508004ef0 tx=0x7fd508007430 comp rx=0 tx=0).stop 2024-04-25T02:08:44.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.134+0000 7fd51cba5640 1 -- 172.21.15.79:0/1082406196 shutdown_connections 2024-04-25T02:08:44.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.134+0000 7fd51cba5640 1 --2- 172.21.15.79:0/1082406196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd4f806be30 0x7fd4f806e2f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.134+0000 7fd51cba5640 1 --2- 172.21.15.79:0/1082406196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5181f65e0 0x7fd51815a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.134+0000 7fd51cba5640 1 --2- 172.21.15.79:0/1082406196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5181f5c20 0x7fd5181f60a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.134+0000 7fd51cba5640 1 --2- 172.21.15.79:0/1082406196 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5000039b0 0x7fd518131190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.134+0000 7fd51cba5640 1 -- 172.21.15.79:0/1082406196 >> 172.21.15.79:0/1082406196 conn(0x7fd5180cfc80 msgr2=0x7fd518143b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:44.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.135+0000 7fd51cba5640 1 -- 172.21.15.79:0/1082406196 shutdown_connections 2024-04-25T02:08:44.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.135+0000 7fd51cba5640 1 -- 172.21.15.79:0/1082406196 wait complete. 2024-04-25T02:08:44.153 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-25T02:08:44.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.244+0000 7f40eeac3640 1 Processor -- start 2024-04-25T02:08:44.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.244+0000 7f40eeac3640 1 -- start start 2024-04-25T02:08:44.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.244+0000 7f40eeac3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40e8143bc0 0x7f40e815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.244+0000 7f40eeac3640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f40e80b3d40 0x7f40e806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.245+0000 7f40eeac3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40e815fa40 con 0x7f40e806df50 2024-04-25T02:08:44.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.245+0000 7f40eeac3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f40e806e8f0 con 0x7f40e8143bc0 2024-04-25T02:08:44.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.245+0000 7f40eeac3640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f40e8072cb0 con 0x7f40e80b3d40 2024-04-25T02:08:44.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.245+0000 7f40ec85f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40e8143bc0 0x7f40e815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.245+0000 7f40ec85f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40e8143bc0 0x7f40e815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59928/0 (socket says 172.21.15.79:59928) 2024-04-25T02:08:44.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.245+0000 7f40e7fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f40e806df50 0x7f40e80b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35552/0 (socket says 172.21.15.79:35552) 2024-04-25T02:08:44.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.245+0000 7f40ec85f640 1 -- 172.21.15.79:0/453958266 learned_addr learned my addr 172.21.15.79:0/453958266 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:44.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.245+0000 7f40ed060640 1 --2- 172.21.15.79:0/453958266 >> v2:172.21.15.189:3300/0 conn(0x7f40e80b3d40 0x7f40e806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.245+0000 7f40ec85f640 1 -- 172.21.15.79:0/453958266 >> v2:172.21.15.189:3300/0 conn(0x7f40e80b3d40 msgr2=0x7f40e806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:44.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.245+0000 7f40ec85f640 1 --2- 172.21.15.79:0/453958266 >> v2:172.21.15.189:3300/0 conn(0x7f40e80b3d40 0x7f40e806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.245+0000 7f40ec85f640 1 -- 172.21.15.79:0/453958266 >> v1:172.21.15.79:6789/0 conn(0x7f40e806df50 legacy=0x7f40e80b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.245+0000 7f40ec85f640 1 -- 172.21.15.79:0/453958266 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e8071e00 con 0x7f40e8143bc0 2024-04-25T02:08:44.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.246+0000 7f40ec85f640 1 --2- 172.21.15.79:0/453958266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e8143bc0 0x7f40e815f500 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f40e8144cd0 tx=0x7f40dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df532a699cc1f635 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:44.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.246+0000 7f40e77fe640 1 -- 172.21.15.79:0/453958266 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc037070 con 0x7f40e8143bc0 2024-04-25T02:08:44.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.246+0000 7f40e77fe640 1 -- 172.21.15.79:0/453958266 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40dc032440 con 0x7f40e8143bc0 2024-04-25T02:08:44.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.246+0000 7f40e77fe640 1 -- 172.21.15.79:0/453958266 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc032810 con 0x7f40e8143bc0 2024-04-25T02:08:44.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.246+0000 7f40eeac3640 1 -- 172.21.15.79:0/453958266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e8143bc0 msgr2=0x7f40e815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.246+0000 7f40eeac3640 1 --2- 172.21.15.79:0/453958266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e8143bc0 0x7f40e815f500 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f40e8144cd0 tx=0x7f40dc02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.246+0000 7f40eeac3640 1 -- 172.21.15.79:0/453958266 shutdown_connections 2024-04-25T02:08:44.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.246+0000 7f40eeac3640 1 --2- 172.21.15.79:0/453958266 >> v2:172.21.15.189:3300/0 conn(0x7f40e80b3d40 0x7f40e806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.246+0000 7f40eeac3640 1 --2- 172.21.15.79:0/453958266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e8143bc0 0x7f40e815f500 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.246+0000 7f40eeac3640 1 -- 172.21.15.79:0/453958266 >> 172.21.15.79:0/453958266 conn(0x7f40e80cfc80 msgr2=0x7f40e80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:44.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.246+0000 7f40eeac3640 1 -- 172.21.15.79:0/453958266 shutdown_connections 2024-04-25T02:08:44.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.246+0000 7f40eeac3640 1 -- 172.21.15.79:0/453958266 wait complete. 2024-04-25T02:08:44.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.247+0000 7f40eeac3640 1 Processor -- start 2024-04-25T02:08:44.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.248+0000 7f40eeac3640 1 -- start start 2024-04-25T02:08:44.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.248+0000 7f40eeac3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e806df50 0x7f40e80ad870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.248+0000 7f40eeac3640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40e80b3d40 0x7f40e815c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.248+0000 7f40eeac3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e8143bc0 0x7f40e80b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.248+0000 7f40eeac3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f40e8072660 con 0x7f40e8143bc0 2024-04-25T02:08:44.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.248+0000 7f40eeac3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f40e8072380 con 0x7f40e806df50 2024-04-25T02:08:44.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.248+0000 7f40eeac3640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f40e8072940 con 0x7f40e80b3d40 2024-04-25T02:08:44.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.248+0000 7f40ed060640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e8143bc0 0x7f40e80b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40ed060640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e8143bc0 0x7f40e80b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59934/0 (socket says 172.21.15.79:59934) 2024-04-25T02:08:44.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40ed060640 1 -- 172.21.15.79:0/1317271799 learned_addr learned my addr 172.21.15.79:0/1317271799 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:44.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40ec85f640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e806df50 0x7f40e80ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40e7fff640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40e80b3d40 0x7f40e815c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40ed060640 1 -- 172.21.15.79:0/1317271799 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40e80b3d40 msgr2=0x7f40e815c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40ed060640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40e80b3d40 0x7f40e815c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40ed060640 1 -- 172.21.15.79:0/1317271799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e806df50 msgr2=0x7f40e80ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40ed060640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e806df50 0x7f40e80ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40ed060640 1 -- 172.21.15.79:0/1317271799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e80ac7d0 con 0x7f40e8143bc0 2024-04-25T02:08:44.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40ec85f640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e806df50 0x7f40e80ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:44.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40e7fff640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40e80b3d40 0x7f40e815c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:44.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40ed060640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e8143bc0 0x7f40e80b2b00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f40e0009fd0 tx=0x7f40e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:44.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40e57fa640 1 -- 172.21.15.79:0/1317271799 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0014420 con 0x7f40e8143bc0 2024-04-25T02:08:44.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40e57fa640 1 -- 172.21.15.79:0/1317271799 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e0019070 con 0x7f40e8143bc0 2024-04-25T02:08:44.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40e57fa640 1 -- 172.21.15.79:0/1317271799 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0014800 con 0x7f40e8143bc0 2024-04-25T02:08:44.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40eeac3640 1 -- 172.21.15.79:0/1317271799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e80acab0 con 0x7f40e8143bc0 2024-04-25T02:08:44.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.249+0000 7f40eeac3640 1 -- 172.21.15.79:0/1317271799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e80ad070 con 0x7f40e8143bc0 2024-04-25T02:08:44.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.250+0000 7f40eeac3640 1 -- 172.21.15.79:0/1317271799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e80690a0 con 0x7f40e8143bc0 2024-04-25T02:08:44.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.250+0000 7f40e57fa640 1 -- 172.21.15.79:0/1317271799 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40e00149a0 con 0x7f40e8143bc0 2024-04-25T02:08:44.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.251+0000 7f40e57fa640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40cc06be30 0x7f40cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.251+0000 7f40ec85f640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40cc06be30 0x7f40cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.251+0000 7f40e57fa640 1 -- 172.21.15.79:0/1317271799 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f40e008b2d0 con 0x7f40e8143bc0 2024-04-25T02:08:44.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.251+0000 7f40ec85f640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40cc06be30 0x7f40cc06e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f40dc034000 tx=0x7f40dc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:44.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.256+0000 7f40e57fa640 1 -- 172.21.15.79:0/1317271799 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f40e005a060 con 0x7f40e8143bc0 2024-04-25T02:08:44.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.493+0000 7f40eeac3640 1 -- 172.21.15.79:0/1317271799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f40e80d0410 con 0x7f40e8143bc0 2024-04-25T02:08:44.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.495+0000 7f40e57fa640 1 -- 172.21.15.79:0/1317271799 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7f40e0059960 con 0x7f40e8143bc0 2024-04-25T02:08:44.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.498+0000 7f40eeac3640 1 -- 172.21.15.79:0/1317271799 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40cc06be30 msgr2=0x7f40cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.498+0000 7f40eeac3640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40cc06be30 0x7f40cc06e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f40dc034000 tx=0x7f40dc02e000 comp rx=0 tx=0).stop 2024-04-25T02:08:44.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.498+0000 7f40eeac3640 1 -- 172.21.15.79:0/1317271799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e8143bc0 msgr2=0x7f40e80b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.498+0000 7f40eeac3640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e8143bc0 0x7f40e80b2b00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f40e0009fd0 tx=0x7f40e000e4b0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.498+0000 7f40eeac3640 1 -- 172.21.15.79:0/1317271799 shutdown_connections 2024-04-25T02:08:44.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.498+0000 7f40eeac3640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40cc06be30 0x7f40cc06e2f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.498+0000 7f40eeac3640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e8143bc0 0x7f40e80b2b00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.498+0000 7f40eeac3640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40e80b3d40 0x7f40e815c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.498+0000 7f40eeac3640 1 --2- 172.21.15.79:0/1317271799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e806df50 0x7f40e80ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.498+0000 7f40eeac3640 1 -- 172.21.15.79:0/1317271799 >> 172.21.15.79:0/1317271799 conn(0x7f40e80cfc80 msgr2=0x7f40e8143fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:44.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.498+0000 7f40eeac3640 1 -- 172.21.15.79:0/1317271799 shutdown_connections 2024-04-25T02:08:44.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.498+0000 7f40eeac3640 1 -- 172.21.15.79:0/1317271799 wait complete. 2024-04-25T02:08:44.516 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-25T02:08:44.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.606+0000 7fd9d121c640 1 Processor -- start 2024-04-25T02:08:44.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.606+0000 7fd9d121c640 1 -- start start 2024-04-25T02:08:44.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.607+0000 7fd9d121c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd9cc06df50 0x7fd9cc06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.607+0000 7fd9d121c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd9cc0b2d30 0x7fd9cc0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.607+0000 7fd9d121c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9cc071e00 con 0x7fd9cc143bc0 2024-04-25T02:08:44.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.607+0000 7fd9d121c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd9cc06e8f0 con 0x7fd9cc0b2d30 2024-04-25T02:08:44.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.607+0000 7fd9d121c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd9cc072cb0 con 0x7fd9cc06df50 2024-04-25T02:08:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.607+0000 7fd9cb59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd9cc0b2d30 0x7fd9cc0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.607+0000 7fd9cb59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd9cc0b2d30 0x7fd9cc0b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59944/0 (socket says 172.21.15.79:59944) 2024-04-25T02:08:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.607+0000 7fd9cb59e640 1 -- 172.21.15.79:0/4244873387 learned_addr learned my addr 172.21.15.79:0/4244873387 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.607+0000 7fd9cb59e640 1 -- 172.21.15.79:0/4244873387 >> v2:172.21.15.189:3300/0 conn(0x7fd9cc06df50 msgr2=0x7fd9cc06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.607+0000 7fd9cb59e640 1 --2- 172.21.15.79:0/4244873387 >> v2:172.21.15.189:3300/0 conn(0x7fd9cc06df50 0x7fd9cc06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.607+0000 7fd9cb59e640 1 -- 172.21.15.79:0/4244873387 >> v1:172.21.15.189:6789/0 conn(0x7fd9cc143bc0 legacy=0x7fd9cc15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.607+0000 7fd9cb59e640 1 -- 172.21.15.79:0/4244873387 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9cc0720a0 con 0x7fd9cc0b2d30 2024-04-25T02:08:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.608+0000 7fd9cb59e640 1 --2- 172.21.15.79:0/4244873387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9cc0b2d30 0x7fd9cc0b31c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0cf960 tx=0x7fd9c402c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320680494987685c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.608+0000 7fd9ca59c640 1 -- 172.21.15.79:0/4244873387 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4039070 con 0x7fd9cc0b2d30 2024-04-25T02:08:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.608+0000 7fd9ca59c640 1 -- 172.21.15.79:0/4244873387 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c400b2e0 con 0x7fd9cc0b2d30 2024-04-25T02:08:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.608+0000 7fd9ca59c640 1 -- 172.21.15.79:0/4244873387 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4009820 con 0x7fd9cc0b2d30 2024-04-25T02:08:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.608+0000 7fd9d121c640 1 -- 172.21.15.79:0/4244873387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9cc0b2d30 msgr2=0x7fd9cc0b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.608+0000 7fd9d121c640 1 --2- 172.21.15.79:0/4244873387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9cc0b2d30 0x7fd9cc0b31c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0cf960 tx=0x7fd9c402c860 comp rx=0 tx=0).stop 2024-04-25T02:08:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.608+0000 7fd9d121c640 1 -- 172.21.15.79:0/4244873387 shutdown_connections 2024-04-25T02:08:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.608+0000 7fd9d121c640 1 --2- 172.21.15.79:0/4244873387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9cc0b2d30 0x7fd9cc0b31c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.608+0000 7fd9d121c640 1 --2- 172.21.15.79:0/4244873387 >> v2:172.21.15.189:3300/0 conn(0x7fd9cc06df50 0x7fd9cc06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.608+0000 7fd9d121c640 1 -- 172.21.15.79:0/4244873387 >> 172.21.15.79:0/4244873387 conn(0x7fd9cc0cfc80 msgr2=0x7fd9cc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.608+0000 7fd9d121c640 1 -- 172.21.15.79:0/4244873387 shutdown_connections 2024-04-25T02:08:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.608+0000 7fd9d121c640 1 -- 172.21.15.79:0/4244873387 wait complete. 2024-04-25T02:08:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.610+0000 7fd9d121c640 1 Processor -- start 2024-04-25T02:08:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.610+0000 7fd9d121c640 1 -- start start 2024-04-25T02:08:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.610+0000 7fd9d121c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9cc06df50 0x7fd9cc158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.610+0000 7fd9d121c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9cc0b2d30 0x7fd9cc158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.610+0000 7fd9d121c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9cc143bc0 0x7fd9cc131790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9d121c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd9cc072940 con 0x7fd9cc06df50 2024-04-25T02:08:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9d121c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd9cc072660 con 0x7fd9cc0b2d30 2024-04-25T02:08:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9d121c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd9cc143fa0 con 0x7fd9cc143bc0 2024-04-25T02:08:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9cad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9cc06df50 0x7fd9cc158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9cad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9cc06df50 0x7fd9cc158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59954/0 (socket says 172.21.15.79:59954) 2024-04-25T02:08:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9cad9d640 1 -- 172.21.15.79:0/416597027 learned_addr learned my addr 172.21.15.79:0/416597027 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9c3fff640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9cc0b2d30 0x7fd9cc158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9cad9d640 1 -- 172.21.15.79:0/416597027 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9cc143bc0 msgr2=0x7fd9cc131790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9cb59e640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9cc143bc0 0x7fd9cc131790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9cad9d640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9cc143bc0 0x7fd9cc131790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9cad9d640 1 -- 172.21.15.79:0/416597027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9cc0b2d30 msgr2=0x7fd9cc158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9cad9d640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9cc0b2d30 0x7fd9cc158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9cad9d640 1 -- 172.21.15.79:0/416597027 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9cc12f830 con 0x7fd9cc06df50 2024-04-25T02:08:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9c3fff640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9cc0b2d30 0x7fd9cc158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9cb59e640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9cc143bc0 0x7fd9cc131790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9cad9d640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9cc06df50 0x7fd9cc158d30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00c440 tx=0x7fd9bc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9c37fe640 1 -- 172.21.15.79:0/416597027 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc017070 con 0x7fd9cc06df50 2024-04-25T02:08:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9c37fe640 1 -- 172.21.15.79:0/416597027 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9bc0035f0 con 0x7fd9cc06df50 2024-04-25T02:08:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9d121c640 1 -- 172.21.15.79:0/416597027 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9cc12fb10 con 0x7fd9cc06df50 2024-04-25T02:08:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9c37fe640 1 -- 172.21.15.79:0/416597027 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc0039e0 con 0x7fd9cc06df50 2024-04-25T02:08:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.611+0000 7fd9d121c640 1 -- 172.21.15.79:0/416597027 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9cc1300d0 con 0x7fd9cc06df50 2024-04-25T02:08:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.612+0000 7fd9d121c640 1 -- 172.21.15.79:0/416597027 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9cc0690a0 con 0x7fd9cc06df50 2024-04-25T02:08:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.613+0000 7fd9c37fe640 1 -- 172.21.15.79:0/416597027 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9bc01a070 con 0x7fd9cc06df50 2024-04-25T02:08:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.613+0000 7fd9c37fe640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd9ac06be30 0x7fd9ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.613+0000 7fd9c37fe640 1 -- 172.21.15.79:0/416597027 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fd9bc089e10 con 0x7fd9cc06df50 2024-04-25T02:08:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.613+0000 7fd9c3fff640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd9ac06be30 0x7fd9ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.613+0000 7fd9c3fff640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd9ac06be30 0x7fd9ac06e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc13f780 tx=0x7fd9b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:44.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.618+0000 7fd9c37fe640 1 -- 172.21.15.79:0/416597027 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd9bc058ba0 con 0x7fd9cc06df50 2024-04-25T02:08:44.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.858+0000 7fd9d121c640 1 -- 172.21.15.79:0/416597027 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fd9cc15e610 con 0x7fd9cc06df50 2024-04-25T02:08:44.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.860+0000 7fd9c37fe640 1 -- 172.21.15.79:0/416597027 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fd9bc0010c0 con 0x7fd9cc06df50 2024-04-25T02:08:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.862+0000 7fd9d121c640 1 -- 172.21.15.79:0/416597027 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd9ac06be30 msgr2=0x7fd9ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.862+0000 7fd9d121c640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd9ac06be30 0x7fd9ac06e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc13f780 tx=0x7fd9b4008040 comp rx=0 tx=0).stop 2024-04-25T02:08:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.862+0000 7fd9d121c640 1 -- 172.21.15.79:0/416597027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9cc06df50 msgr2=0x7fd9cc158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.862+0000 7fd9d121c640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9cc06df50 0x7fd9cc158d30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00c440 tx=0x7fd9bc00c900 comp rx=0 tx=0).stop 2024-04-25T02:08:44.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.862+0000 7fd9d121c640 1 -- 172.21.15.79:0/416597027 shutdown_connections 2024-04-25T02:08:44.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.862+0000 7fd9d121c640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd9ac06be30 0x7fd9ac06e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.862+0000 7fd9d121c640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9cc143bc0 0x7fd9cc131790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.862+0000 7fd9d121c640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9cc0b2d30 0x7fd9cc158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.862+0000 7fd9d121c640 1 --2- 172.21.15.79:0/416597027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9cc06df50 0x7fd9cc158d30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.862+0000 7fd9d121c640 1 -- 172.21.15.79:0/416597027 >> 172.21.15.79:0/416597027 conn(0x7fd9cc0cfc80 msgr2=0x7fd9cc0b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:44.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.862+0000 7fd9d121c640 1 -- 172.21.15.79:0/416597027 shutdown_connections 2024-04-25T02:08:44.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.862+0000 7fd9d121c640 1 -- 172.21.15.79:0/416597027 wait complete. 2024-04-25T02:08:44.881 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:44.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.968+0000 7f55f6322640 1 Processor -- start 2024-04-25T02:08:44.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.968+0000 7f55f6322640 1 -- start start 2024-04-25T02:08:44.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.969+0000 7f55f6322640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55f015bc10 0x7f55f0162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.969+0000 7f55f6322640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55f006e660 0x7f55f00b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.969+0000 7f55f6322640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55f0162d40 con 0x7f55f015bff0 2024-04-25T02:08:44.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.969+0000 7f55f6322640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f55f015e870 con 0x7f55f006e660 2024-04-25T02:08:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.969+0000 7f55f6322640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f55f015eb10 con 0x7f55f015bc10 2024-04-25T02:08:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.969+0000 7f55f48bf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55f006e660 0x7f55f00b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.969+0000 7f55ef7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f55f015bff0 0x7f55f006df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35564/0 (socket says 172.21.15.79:35564) 2024-04-25T02:08:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.969+0000 7f55ef7fe640 1 -- 172.21.15.79:0/734052094 learned_addr learned my addr 172.21.15.79:0/734052094 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.969+0000 7f55effff640 1 --2- 172.21.15.79:0/734052094 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55f015bc10 0x7f55f0162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.970+0000 7f55f48bf640 1 -- 172.21.15.79:0/734052094 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55f015bc10 msgr2=0x7f55f0162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.970+0000 7f55f48bf640 1 --2- 172.21.15.79:0/734052094 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55f015bc10 0x7f55f0162800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.970+0000 7f55f48bf640 1 -- 172.21.15.79:0/734052094 >> v1:172.21.15.79:6789/0 conn(0x7f55f015bff0 legacy=0x7f55f006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.970+0000 7f55eeffd640 1 -- 172.21.15.79:0/734052094 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3312041621 0 0) 0x7f55e4001110 con 0x7f55f015bff0 2024-04-25T02:08:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.970+0000 7f55f48bf640 1 -- 172.21.15.79:0/734052094 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f015edf0 con 0x7f55f006e660 2024-04-25T02:08:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.970+0000 7f55f48bf640 1 --2- 172.21.15.79:0/734052094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f006e660 0x7f55f00b3f60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009d90 tx=0x7f55e802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abec45a819f3d81a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.970+0000 7f55eeffd640 1 -- 172.21.15.79:0/734052094 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8031600 con 0x7f55f006e660 2024-04-25T02:08:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.970+0000 7f55eeffd640 1 -- 172.21.15.79:0/734052094 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e80317a0 con 0x7f55f006e660 2024-04-25T02:08:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.970+0000 7f55eeffd640 1 -- 172.21.15.79:0/734052094 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8031b70 con 0x7f55f006e660 2024-04-25T02:08:44.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.971+0000 7f55f6322640 1 -- 172.21.15.79:0/734052094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f006e660 msgr2=0x7f55f00b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.971+0000 7f55f6322640 1 --2- 172.21.15.79:0/734052094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f006e660 0x7f55f00b3f60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009d90 tx=0x7f55e802a5d0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.971+0000 7f55f6322640 1 -- 172.21.15.79:0/734052094 shutdown_connections 2024-04-25T02:08:44.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.971+0000 7f55f6322640 1 --2- 172.21.15.79:0/734052094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f006e660 0x7f55f00b3f60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.971+0000 7f55f6322640 1 --2- 172.21.15.79:0/734052094 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55f015bc10 0x7f55f0162800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.971+0000 7f55f6322640 1 -- 172.21.15.79:0/734052094 >> 172.21.15.79:0/734052094 conn(0x7f55f00cfc80 msgr2=0x7f55f00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:44.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.971+0000 7f55f6322640 1 -- 172.21.15.79:0/734052094 shutdown_connections 2024-04-25T02:08:44.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.971+0000 7f55f6322640 1 -- 172.21.15.79:0/734052094 wait complete. 2024-04-25T02:08:44.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.972+0000 7f55f6322640 1 Processor -- start 2024-04-25T02:08:44.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.972+0000 7f55f6322640 1 -- start start 2024-04-25T02:08:44.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.973+0000 7f55f6322640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55f006e660 0x7f55f00cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.973+0000 7f55f6322640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55f015bc10 0x7f55f0149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.973+0000 7f55f6322640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f015bff0 0x7f55f01615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.973+0000 7f55f6322640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f55f015f690 con 0x7f55f015bff0 2024-04-25T02:08:44.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.973+0000 7f55f6322640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f55f015f3b0 con 0x7f55f006e660 2024-04-25T02:08:44.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.973+0000 7f55f6322640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f55f00aef70 con 0x7f55f015bc10 2024-04-25T02:08:44.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.973+0000 7f55f48bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f015bff0 0x7f55f01615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.973+0000 7f55f48bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f015bff0 0x7f55f01615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59962/0 (socket says 172.21.15.79:59962) 2024-04-25T02:08:44.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.973+0000 7f55f48bf640 1 -- 172.21.15.79:0/990369818 learned_addr learned my addr 172.21.15.79:0/990369818 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:44.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.973+0000 7f55f48bf640 1 -- 172.21.15.79:0/990369818 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55f015bc10 msgr2=0x7f55f0149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.973+0000 7f55ef7fe640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55f015bc10 0x7f55f0149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.973+0000 7f55effff640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55f006e660 0x7f55f00cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.973+0000 7f55f48bf640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55f015bc10 0x7f55f0149740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.973+0000 7f55f48bf640 1 -- 172.21.15.79:0/990369818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55f006e660 msgr2=0x7f55f00cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.974+0000 7f55f48bf640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55f006e660 0x7f55f00cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.974+0000 7f55f48bf640 1 -- 172.21.15.79:0/990369818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f0149c80 con 0x7f55f015bff0 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.974+0000 7f55ef7fe640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55f015bc10 0x7f55f0149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.974+0000 7f55effff640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55f006e660 0x7f55f00cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.974+0000 7f55f48bf640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f015bff0 0x7f55f01615f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009eb0 tx=0x7f55e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.974+0000 7f55ecff9640 1 -- 172.21.15.79:0/990369818 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e803f070 con 0x7f55f015bff0 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.974+0000 7f55ecff9640 1 -- 172.21.15.79:0/990369818 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e8030b60 con 0x7f55f015bff0 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.974+0000 7f55f6322640 1 -- 172.21.15.79:0/990369818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f015f970 con 0x7f55f015bff0 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.974+0000 7f55ecff9640 1 -- 172.21.15.79:0/990369818 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8009450 con 0x7f55f015bff0 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.974+0000 7f55f6322640 1 -- 172.21.15.79:0/990369818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f015fc10 con 0x7f55f015bff0 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.975+0000 7f55f6322640 1 -- 172.21.15.79:0/990369818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f00690a0 con 0x7f55f015bff0 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.975+0000 7f55ecff9640 1 -- 172.21.15.79:0/990369818 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55e803b410 con 0x7f55f015bff0 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.976+0000 7f55ecff9640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f55dc06be60 0x7f55dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.976+0000 7f55ecff9640 1 -- 172.21.15.79:0/990369818 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f55e80abe80 con 0x7f55f015bff0 2024-04-25T02:08:44.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.976+0000 7f55effff640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f55dc06be60 0x7f55dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:44.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.976+0000 7f55effff640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f55dc06be60 0x7f55dc06e320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f55e0006fd0 tx=0x7f55e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:44.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:44.981+0000 7f55ecff9640 1 -- 172.21.15.79:0/990369818 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f55f0149c80 con 0x7f55f015bff0 2024-04-25T02:08:45.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.155+0000 7f55f6322640 1 -- 172.21.15.79:0/990369818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55f00aeb50 con 0x7f55f015bff0 2024-04-25T02:08:45.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.156+0000 7f55ecff9640 1 -- 172.21.15.79:0/990369818 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+12903 (secure 0 0 0) 0x7f55e807aa50 con 0x7f55f015bff0 2024-04-25T02:08:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:45.163 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":29,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:42.291490+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:45.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.158+0000 7f55f6322640 1 -- 172.21.15.79:0/990369818 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f55dc06be60 msgr2=0x7f55dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.158+0000 7f55f6322640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f55dc06be60 0x7f55dc06e320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f55e0006fd0 tx=0x7f55e0008040 comp rx=0 tx=0).stop 2024-04-25T02:08:45.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.158+0000 7f55f6322640 1 -- 172.21.15.79:0/990369818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f015bff0 msgr2=0x7f55f01615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.158+0000 7f55f6322640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f015bff0 0x7f55f01615f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009eb0 tx=0x7f55e8004a40 comp rx=0 tx=0).stop 2024-04-25T02:08:45.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.158+0000 7f55f6322640 1 -- 172.21.15.79:0/990369818 shutdown_connections 2024-04-25T02:08:45.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.158+0000 7f55f6322640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f55dc06be60 0x7f55dc06e320 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.158+0000 7f55f6322640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f015bff0 0x7f55f01615f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.158+0000 7f55f6322640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55f015bc10 0x7f55f0149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.158+0000 7f55f6322640 1 --2- 172.21.15.79:0/990369818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55f006e660 0x7f55f00cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.158+0000 7f55f6322640 1 -- 172.21.15.79:0/990369818 >> 172.21.15.79:0/990369818 conn(0x7f55f00cfc80 msgr2=0x7f55f006dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:45.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.158+0000 7f55f6322640 1 -- 172.21.15.79:0/990369818 shutdown_connections 2024-04-25T02:08:45.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.158+0000 7f55f6322640 1 -- 172.21.15.79:0/990369818 wait complete. 2024-04-25T02:08:45.176 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:08:45.176 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:08:45.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.269+0000 7f4fd1cbd640 1 Processor -- start 2024-04-25T02:08:45.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.269+0000 7f4fd1cbd640 1 -- start start 2024-04-25T02:08:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.270+0000 7f4fd1cbd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4fcc0706d0 0x7f4fcc06dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.270+0000 7f4fd1cbd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fcc06b7c0 con 0x7f4fcc06e1d0 2024-04-25T02:08:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.270+0000 7f4fd1cbd640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fcc15c6d0 con 0x7f4fcc159d30 2024-04-25T02:08:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.270+0000 7f4fd1cbd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4fcc15c990 con 0x7f4fcc0706d0 2024-04-25T02:08:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.270+0000 7f4fcaffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4fcc0706d0 0x7f4fcc06dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.270+0000 7f4fcbfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4fcc06e1d0 0x7f4fcc0addb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35570/0 (socket says 172.21.15.79:35570) 2024-04-25T02:08:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.270+0000 7f4fcbfff640 1 -- 172.21.15.79:0/708103838 learned_addr learned my addr 172.21.15.79:0/708103838 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.271+0000 7f4fcaffd640 1 -- 172.21.15.79:0/708103838 >> v1:172.21.15.189:6789/0 conn(0x7f4fcc159d30 legacy=0x7f4fcc06b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.271+0000 7f4fca7fc640 1 -- 172.21.15.79:0/708103838 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3496029939 0 0) 0x7f4fcc06b7c0 con 0x7f4fcc06e1d0 2024-04-25T02:08:45.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.271+0000 7f4fcaffd640 1 -- 172.21.15.79:0/708103838 >> v1:172.21.15.79:6789/0 conn(0x7f4fcc06e1d0 legacy=0x7f4fcc0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.271+0000 7f4fcaffd640 1 -- 172.21.15.79:0/708103838 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fcc15cc70 con 0x7f4fcc0706d0 2024-04-25T02:08:45.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.271+0000 7f4fcaffd640 1 --2- 172.21.15.79:0/708103838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc0706d0 0x7f4fcc06dc90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00097a0 tx=0x7f4fc002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211e109bf53104b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:45.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.271+0000 7f4fca7fc640 1 -- 172.21.15.79:0/708103838 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0037070 con 0x7f4fcc0706d0 2024-04-25T02:08:45.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.271+0000 7f4fca7fc640 1 -- 172.21.15.79:0/708103838 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc0032440 con 0x7f4fcc0706d0 2024-04-25T02:08:45.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.271+0000 7f4fca7fc640 1 -- 172.21.15.79:0/708103838 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0032810 con 0x7f4fcc0706d0 2024-04-25T02:08:45.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.272+0000 7f4fd1cbd640 1 -- 172.21.15.79:0/708103838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc0706d0 msgr2=0x7f4fcc06dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.272+0000 7f4fd1cbd640 1 --2- 172.21.15.79:0/708103838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc0706d0 0x7f4fcc06dc90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00097a0 tx=0x7f4fc002a1e0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.272+0000 7f4fd1cbd640 1 -- 172.21.15.79:0/708103838 shutdown_connections 2024-04-25T02:08:45.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.272+0000 7f4fd1cbd640 1 --2- 172.21.15.79:0/708103838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc0706d0 0x7f4fcc06dc90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.272+0000 7f4fd1cbd640 1 -- 172.21.15.79:0/708103838 >> 172.21.15.79:0/708103838 conn(0x7f4fcc0d0e00 msgr2=0x7f4fcc0d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:45.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.272+0000 7f4fd1cbd640 1 -- 172.21.15.79:0/708103838 shutdown_connections 2024-04-25T02:08:45.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.272+0000 7f4fd1cbd640 1 -- 172.21.15.79:0/708103838 wait complete. 2024-04-25T02:08:45.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.273+0000 7f4fd1cbd640 1 Processor -- start 2024-04-25T02:08:45.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.273+0000 7f4fd1cbd640 1 -- start start 2024-04-25T02:08:45.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.274+0000 7f4fd1cbd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4fcc06e1d0 0x7f4fcc14d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.274+0000 7f4fd1cbd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fcc0706d0 0x7f4fcc14bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.274+0000 7f4fd1cbd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc159d30 0x7f4fcc1588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.274+0000 7f4fd1cbd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc15d470 con 0x7f4fcc159d30 2024-04-25T02:08:45.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.274+0000 7f4fd1cbd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc06ba50 con 0x7f4fcc0706d0 2024-04-25T02:08:45.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.274+0000 7f4fd1cbd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4fcc0ae4c0 con 0x7f4fcc06e1d0 2024-04-25T02:08:45.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.274+0000 7f4fcbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc159d30 0x7f4fcc1588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:45.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.274+0000 7f4fcbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc159d30 0x7f4fcc1588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59996/0 (socket says 172.21.15.79:59996) 2024-04-25T02:08:45.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.274+0000 7f4fcbfff640 1 -- 172.21.15.79:0/174064511 learned_addr learned my addr 172.21.15.79:0/174064511 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:45.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.274+0000 7f4fcbfff640 1 -- 172.21.15.79:0/174064511 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4fcc06e1d0 msgr2=0x7f4fcc14d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.274+0000 7f4fcbfff640 1 --2- 172.21.15.79:0/174064511 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4fcc06e1d0 0x7f4fcc14d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.274+0000 7f4fcbfff640 1 -- 172.21.15.79:0/174064511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fcc0706d0 msgr2=0x7f4fcc14bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.274+0000 7f4fcbfff640 1 --2- 172.21.15.79:0/174064511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fcc0706d0 0x7f4fcc14bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.274+0000 7f4fcbfff640 1 -- 172.21.15.79:0/174064511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fcc1592d0 con 0x7f4fcc159d30 2024-04-25T02:08:45.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.275+0000 7f4fcbfff640 1 --2- 172.21.15.79:0/174064511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc159d30 0x7f4fcc1588f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400c7a0 tx=0x7f4fc400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:45.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.275+0000 7f4fb3fff640 1 -- 172.21.15.79:0/174064511 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4018070 con 0x7f4fcc159d30 2024-04-25T02:08:45.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.275+0000 7f4fb3fff640 1 -- 172.21.15.79:0/174064511 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc400a640 con 0x7f4fcc159d30 2024-04-25T02:08:45.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.275+0000 7f4fd1cbd640 1 -- 172.21.15.79:0/174064511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fcc14caf0 con 0x7f4fcc159d30 2024-04-25T02:08:45.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.275+0000 7f4fb3fff640 1 -- 172.21.15.79:0/174064511 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400aab0 con 0x7f4fcc159d30 2024-04-25T02:08:45.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.275+0000 7f4fd1cbd640 1 -- 172.21.15.79:0/174064511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fcc14d0b0 con 0x7f4fcc159d30 2024-04-25T02:08:45.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.276+0000 7f4fd1cbd640 1 -- 172.21.15.79:0/174064511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fcc0690a0 con 0x7f4fcc159d30 2024-04-25T02:08:45.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.276+0000 7f4fb3fff640 1 -- 172.21.15.79:0/174064511 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fc401b070 con 0x7f4fcc159d30 2024-04-25T02:08:45.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.276+0000 7f4fb3fff640 1 --2- 172.21.15.79:0/174064511 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4fb806be30 0x7f4fb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.277+0000 7f4fcb7fe640 1 --2- 172.21.15.79:0/174064511 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4fb806be30 0x7f4fb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:45.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.277+0000 7f4fb3fff640 1 -- 172.21.15.79:0/174064511 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f4fc408a0c0 con 0x7f4fcc159d30 2024-04-25T02:08:45.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.277+0000 7f4fcb7fe640 1 --2- 172.21.15.79:0/174064511 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4fb806be30 0x7f4fb806e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc006fd0 tx=0x7f4fbc006bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:45.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.281+0000 7f4fb3fff640 1 -- 172.21.15.79:0/174064511 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4fc4058e50 con 0x7f4fcc159d30 2024-04-25T02:08:45.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.452+0000 7f4fd1cbd640 1 -- 172.21.15.79:0/174064511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4fcc0700d0 con 0x7f4fcc159d30 2024-04-25T02:08:45.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.453+0000 7f4fb3fff640 1 -- 172.21.15.79:0/174064511 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f4fc4058750 con 0x7f4fcc159d30 2024-04-25T02:08:45.460 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:08:45.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.455+0000 7f4fd1cbd640 1 -- 172.21.15.79:0/174064511 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4fb806be30 msgr2=0x7f4fb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.455+0000 7f4fd1cbd640 1 --2- 172.21.15.79:0/174064511 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4fb806be30 0x7f4fb806e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc006fd0 tx=0x7f4fbc006bc0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.455+0000 7f4fd1cbd640 1 -- 172.21.15.79:0/174064511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc159d30 msgr2=0x7f4fcc1588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.455+0000 7f4fd1cbd640 1 --2- 172.21.15.79:0/174064511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc159d30 0x7f4fcc1588f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400c7a0 tx=0x7f4fc400cc60 comp rx=0 tx=0).stop 2024-04-25T02:08:45.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.455+0000 7f4fd1cbd640 1 -- 172.21.15.79:0/174064511 shutdown_connections 2024-04-25T02:08:45.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.455+0000 7f4fd1cbd640 1 --2- 172.21.15.79:0/174064511 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4fb806be30 0x7f4fb806e2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.455+0000 7f4fd1cbd640 1 --2- 172.21.15.79:0/174064511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc159d30 0x7f4fcc1588f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.455+0000 7f4fd1cbd640 1 --2- 172.21.15.79:0/174064511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fcc0706d0 0x7f4fcc14bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.455+0000 7f4fd1cbd640 1 --2- 172.21.15.79:0/174064511 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4fcc06e1d0 0x7f4fcc14d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.455+0000 7f4fd1cbd640 1 -- 172.21.15.79:0/174064511 >> 172.21.15.79:0/174064511 conn(0x7f4fcc0d0e00 msgr2=0x7f4fcc0addb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:45.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.455+0000 7f4fd1cbd640 1 -- 172.21.15.79:0/174064511 shutdown_connections 2024-04-25T02:08:45.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.455+0000 7f4fd1cbd640 1 -- 172.21.15.79:0/174064511 wait complete. 2024-04-25T02:08:45.473 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T02:08:45.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.561+0000 7fdd50e4d640 1 Processor -- start 2024-04-25T02:08:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.561+0000 7fdd50e4d640 1 -- start start 2024-04-25T02:08:45.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.562+0000 7fdd50e4d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fdd4c0d07a0 0x7fdd4c0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.562+0000 7fdd50e4d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4c15bb10 con 0x7fdd4c0b47e0 2024-04-25T02:08:45.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.562+0000 7fdd50e4d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4c0b2e60 con 0x7fdd4c15a720 2024-04-25T02:08:45.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.562+0000 7fdd50e4d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fdd4c0b4c30 con 0x7fdd4c0d07a0 2024-04-25T02:08:45.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4ad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdd4c0b47e0 0x7fdd4c070cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35576/0 (socket says 172.21.15.79:35576) 2024-04-25T02:08:45.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4ad9d640 1 -- 172.21.15.79:0/1995211925 learned_addr learned my addr 172.21.15.79:0/1995211925 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:45.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd49d9b640 1 --2- 172.21.15.79:0/1995211925 >> v2:172.21.15.189:3300/0 conn(0x7fdd4c0d07a0 0x7fdd4c0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:45.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4959a640 1 -- 172.21.15.79:0/1995211925 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942873872 0 0) 0x7fdd4c15bb10 con 0x7fdd4c0b47e0 2024-04-25T02:08:45.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4959a640 1 -- 172.21.15.79:0/1995211925 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd34003520 con 0x7fdd4c0b47e0 2024-04-25T02:08:45.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4959a640 1 -- 172.21.15.79:0/1995211925 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1222817925 0 0) 0x7fdd34003520 con 0x7fdd4c0b47e0 2024-04-25T02:08:45.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4959a640 1 -- 172.21.15.79:0/1995211925 >> v2:172.21.15.189:3300/0 conn(0x7fdd4c0d07a0 msgr2=0x7fdd4c0b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:45.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4959a640 1 --2- 172.21.15.79:0/1995211925 >> v2:172.21.15.189:3300/0 conn(0x7fdd4c0d07a0 0x7fdd4c0b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4959a640 1 -- 172.21.15.79:0/1995211925 >> v1:172.21.15.189:6789/0 conn(0x7fdd4c15a720 legacy=0x7fdd4c15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4959a640 1 -- 172.21.15.79:0/1995211925 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c0b3140 con 0x7fdd4c0b47e0 2024-04-25T02:08:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4959a640 1 -- 172.21.15.79:0/1995211925 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fdd3c001670 con 0x7fdd4c0b47e0 2024-04-25T02:08:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4959a640 1 -- 172.21.15.79:0/1995211925 >> v1:172.21.15.79:6789/0 conn(0x7fdd4c0b47e0 legacy=0x7fdd4c070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4959a640 1 --2- 172.21.15.79:0/1995211925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd340039b0 0x7fdd34003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4959a640 1 --2- 172.21.15.79:0/1995211925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdd34004800 0x7fdd34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4959a640 1 --2- 172.21.15.79:0/1995211925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd340051c0 0x7fdd3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4959a640 1 -- 172.21.15.79:0/1995211925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c0b4c30 con 0x7fdd340051c0 2024-04-25T02:08:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4959a640 1 -- 172.21.15.79:0/1995211925 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3400c160 con 0x7fdd340039b0 2024-04-25T02:08:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4959a640 1 -- 172.21.15.79:0/1995211925 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3400c360 con 0x7fdd34004800 2024-04-25T02:08:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4ad9d640 1 --2- 172.21.15.79:0/1995211925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd340051c0 0x7fdd3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd4a59c640 1 --2- 172.21.15.79:0/1995211925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd340039b0 0x7fdd34003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.563+0000 7fdd49d9b640 1 --2- 172.21.15.79:0/1995211925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdd34004800 0x7fdd34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.564+0000 7fdd4ad9d640 1 -- 172.21.15.79:0/1995211925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdd34004800 msgr2=0x7fdd34004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.564+0000 7fdd4ad9d640 1 --2- 172.21.15.79:0/1995211925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdd34004800 0x7fdd34004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.564+0000 7fdd4ad9d640 1 -- 172.21.15.79:0/1995211925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd340039b0 msgr2=0x7fdd34003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.564+0000 7fdd4ad9d640 1 --2- 172.21.15.79:0/1995211925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd340039b0 0x7fdd34003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.564+0000 7fdd4ad9d640 1 -- 172.21.15.79:0/1995211925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd34003520 con 0x7fdd340051c0 2024-04-25T02:08:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.564+0000 7fdd4ad9d640 1 -- 172.21.15.79:0/1995211925 reap_dead start 2024-04-25T02:08:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.564+0000 7fdd4ad9d640 1 --2- 172.21.15.79:0/1995211925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd340051c0 0x7fdd3400b9c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00c210 tx=0x7fdd34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788d2c9896a2b17b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.564+0000 7fdd4959a640 1 -- 172.21.15.79:0/1995211925 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c007d30 con 0x7fdd340051c0 2024-04-25T02:08:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.564+0000 7fdd4959a640 1 -- 172.21.15.79:0/1995211925 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c005ad0 con 0x7fdd340051c0 2024-04-25T02:08:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.564+0000 7fdd4959a640 1 -- 172.21.15.79:0/1995211925 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c007070 con 0x7fdd340051c0 2024-04-25T02:08:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.565+0000 7fdd50e4d640 1 -- 172.21.15.79:0/1995211925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd340051c0 msgr2=0x7fdd3400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.565+0000 7fdd50e4d640 1 --2- 172.21.15.79:0/1995211925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd340051c0 0x7fdd3400b9c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00c210 tx=0x7fdd34005830 comp rx=0 tx=0).stop 2024-04-25T02:08:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.565+0000 7fdd50e4d640 1 -- 172.21.15.79:0/1995211925 shutdown_connections 2024-04-25T02:08:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.565+0000 7fdd50e4d640 1 --2- 172.21.15.79:0/1995211925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd340051c0 0x7fdd3400b9c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.565+0000 7fdd50e4d640 1 -- 172.21.15.79:0/1995211925 >> 172.21.15.79:0/1995211925 conn(0x7fdd4c0cfc80 msgr2=0x7fdd4c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.565+0000 7fdd50e4d640 1 -- 172.21.15.79:0/1995211925 shutdown_connections 2024-04-25T02:08:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.565+0000 7fdd50e4d640 1 -- 172.21.15.79:0/1995211925 wait complete. 2024-04-25T02:08:45.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.566+0000 7fdd50e4d640 1 Processor -- start 2024-04-25T02:08:45.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.566+0000 7fdd50e4d640 1 -- start start 2024-04-25T02:08:45.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.567+0000 7fdd50e4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd340051c0 0x7fdd4c1f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.567+0000 7fdd50e4d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd4c1f0910 0x7fdd4c1522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.567+0000 7fdd50e4d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdd4c1f0440 0x7fdd4c071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.567+0000 7fdd50e4d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c0b39e0 con 0x7fdd340051c0 2024-04-25T02:08:45.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.567+0000 7fdd50e4d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c0b3700 con 0x7fdd4c1f0910 2024-04-25T02:08:45.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.567+0000 7fdd50e4d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c0b42a0 con 0x7fdd4c1f0440 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.567+0000 7fdd4a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd340051c0 0x7fdd4c1f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.567+0000 7fdd4a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd340051c0 0x7fdd4c1f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60018/0 (socket says 172.21.15.79:60018) 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.567+0000 7fdd4a59c640 1 -- 172.21.15.79:0/1891813375 learned_addr learned my addr 172.21.15.79:0/1891813375 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.567+0000 7fdd4a59c640 1 -- 172.21.15.79:0/1891813375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdd4c1f0440 msgr2=0x7fdd4c071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.567+0000 7fdd4a59c640 1 --2- 172.21.15.79:0/1891813375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdd4c1f0440 0x7fdd4c071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.567+0000 7fdd4a59c640 1 -- 172.21.15.79:0/1891813375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd4c1f0910 msgr2=0x7fdd4c1522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.567+0000 7fdd4a59c640 1 --2- 172.21.15.79:0/1891813375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd4c1f0910 0x7fdd4c1522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.567+0000 7fdd4a59c640 1 -- 172.21.15.79:0/1891813375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c152b60 con 0x7fdd340051c0 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.568+0000 7fdd4a59c640 1 --2- 172.21.15.79:0/1891813375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd340051c0 0x7fdd4c1f2760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400f650 tx=0x7fdd4400fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.568+0000 7fdd3affd640 1 -- 172.21.15.79:0/1891813375 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd440050d0 con 0x7fdd340051c0 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.568+0000 7fdd3affd640 1 -- 172.21.15.79:0/1891813375 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd44018070 con 0x7fdd340051c0 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.568+0000 7fdd50e4d640 1 -- 172.21.15.79:0/1891813375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4c152e40 con 0x7fdd340051c0 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.568+0000 7fdd3affd640 1 -- 172.21.15.79:0/1891813375 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd44005490 con 0x7fdd340051c0 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.568+0000 7fdd50e4d640 1 -- 172.21.15.79:0/1891813375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd4c153400 con 0x7fdd340051c0 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.569+0000 7fdd50e4d640 1 -- 172.21.15.79:0/1891813375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd4c0690a0 con 0x7fdd340051c0 2024-04-25T02:08:45.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.569+0000 7fdd3affd640 1 -- 172.21.15.79:0/1891813375 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd4400d730 con 0x7fdd340051c0 2024-04-25T02:08:45.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.570+0000 7fdd3affd640 1 --2- 172.21.15.79:0/1891813375 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdd2c06be30 0x7fdd2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.570+0000 7fdd3affd640 1 -- 172.21.15.79:0/1891813375 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fdd4408a870 con 0x7fdd340051c0 2024-04-25T02:08:45.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.570+0000 7fdd49d9b640 1 --2- 172.21.15.79:0/1891813375 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdd2c06be30 0x7fdd2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:45.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.570+0000 7fdd49d9b640 1 --2- 172.21.15.79:0/1891813375 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdd2c06be30 0x7fdd2c06e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c151ee0 tx=0x7fdd40009750 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:45.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.574+0000 7fdd3affd640 1 -- 172.21.15.79:0/1891813375 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdd44059600 con 0x7fdd340051c0 2024-04-25T02:08:45.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.747+0000 7fdd50e4d640 1 -- 172.21.15.79:0/1891813375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fdd4c159850 con 0x7fdd340051c0 2024-04-25T02:08:45.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.748+0000 7fdd3affd640 1 -- 172.21.15.79:0/1891813375 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7fdd44058f00 con 0x7fdd340051c0 2024-04-25T02:08:45.755 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:45.755 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-04-25T02:08:45.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:08:45.755 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-04-25T02:08:45.755 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-04-25T02:08:45.755 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:08:45.755 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-04-25T02:08:45.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.750+0000 7fdd50e4d640 1 -- 172.21.15.79:0/1891813375 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdd2c06be30 msgr2=0x7fdd2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.750+0000 7fdd50e4d640 1 --2- 172.21.15.79:0/1891813375 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdd2c06be30 0x7fdd2c06e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c151ee0 tx=0x7fdd40009750 comp rx=0 tx=0).stop 2024-04-25T02:08:45.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.750+0000 7fdd50e4d640 1 -- 172.21.15.79:0/1891813375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd340051c0 msgr2=0x7fdd4c1f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.750+0000 7fdd50e4d640 1 --2- 172.21.15.79:0/1891813375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd340051c0 0x7fdd4c1f2760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400f650 tx=0x7fdd4400fb10 comp rx=0 tx=0).stop 2024-04-25T02:08:45.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.750+0000 7fdd50e4d640 1 -- 172.21.15.79:0/1891813375 shutdown_connections 2024-04-25T02:08:45.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.750+0000 7fdd50e4d640 1 --2- 172.21.15.79:0/1891813375 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdd2c06be30 0x7fdd2c06e2f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.750+0000 7fdd50e4d640 1 --2- 172.21.15.79:0/1891813375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdd4c1f0440 0x7fdd4c071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.750+0000 7fdd50e4d640 1 --2- 172.21.15.79:0/1891813375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd4c1f0910 0x7fdd4c1522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.750+0000 7fdd50e4d640 1 --2- 172.21.15.79:0/1891813375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd340051c0 0x7fdd4c1f2760 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.750+0000 7fdd50e4d640 1 -- 172.21.15.79:0/1891813375 >> 172.21.15.79:0/1891813375 conn(0x7fdd4c0cfc80 msgr2=0x7fdd4c0b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:45.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.750+0000 7fdd50e4d640 1 -- 172.21.15.79:0/1891813375 shutdown_connections 2024-04-25T02:08:45.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.750+0000 7fdd50e4d640 1 -- 172.21.15.79:0/1891813375 wait complete. 2024-04-25T02:08:45.767 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T02:08:45.768 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T02:08:45.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.861+0000 7f89f9542640 1 Processor -- start 2024-04-25T02:08:45.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.861+0000 7f89f9542640 1 -- start start 2024-04-25T02:08:45.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.862+0000 7f89f9542640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89f40b23a0 0x7f89f4169070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.862+0000 7f89f9542640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f40b0eb0 con 0x7f89f415e720 2024-04-25T02:08:45.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.862+0000 7f89f9542640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f40cf7a0 con 0x7f89f40d26c0 2024-04-25T02:08:45.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.862+0000 7f89f9542640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f89f40d0040 con 0x7f89f40b23a0 2024-04-25T02:08:45.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.862+0000 7f89f37fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89f40b23a0 0x7f89f4169070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:45.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.862+0000 7f89f37fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89f40b23a0 0x7f89f4169070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60034/0 (socket says 172.21.15.79:60034) 2024-04-25T02:08:45.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.862+0000 7f89f37fe640 1 -- 172.21.15.79:0/1274077141 learned_addr learned my addr 172.21.15.79:0/1274077141 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:45.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.862+0000 7f89f27fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f89f415e720 0x7f89f40d47f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35588/0 (socket says 172.21.15.79:35588) 2024-04-25T02:08:45.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.862+0000 7f89f37fe640 1 -- 172.21.15.79:0/1274077141 >> v1:172.21.15.189:6789/0 conn(0x7f89f40d26c0 legacy=0x7f89f40d2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.862+0000 7f89f37fe640 1 -- 172.21.15.79:0/1274077141 >> v1:172.21.15.79:6789/0 conn(0x7f89f415e720 legacy=0x7f89f40d47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.862+0000 7f89f37fe640 1 -- 172.21.15.79:0/1274077141 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f40cfa80 con 0x7f89f40b23a0 2024-04-25T02:08:45.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.863+0000 7f89f37fe640 1 --2- 172.21.15.79:0/1274077141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40b23a0 0x7f89f4169070 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009e50 tx=0x7f89ec02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18cc1419997c8de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:45.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.864+0000 7f89f1ffb640 1 -- 172.21.15.79:0/1274077141 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec036070 con 0x7f89f40b23a0 2024-04-25T02:08:45.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.864+0000 7f89f1ffb640 1 -- 172.21.15.79:0/1274077141 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89ec031600 con 0x7f89f40b23a0 2024-04-25T02:08:45.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.864+0000 7f89f1ffb640 1 -- 172.21.15.79:0/1274077141 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec0319f0 con 0x7f89f40b23a0 2024-04-25T02:08:45.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.864+0000 7f89f9542640 1 -- 172.21.15.79:0/1274077141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40b23a0 msgr2=0x7f89f4169070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.864+0000 7f89f9542640 1 --2- 172.21.15.79:0/1274077141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40b23a0 0x7f89f4169070 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009e50 tx=0x7f89ec02a7c0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.864+0000 7f89f9542640 1 -- 172.21.15.79:0/1274077141 shutdown_connections 2024-04-25T02:08:45.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.864+0000 7f89f9542640 1 --2- 172.21.15.79:0/1274077141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40b23a0 0x7f89f4169070 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.864+0000 7f89f9542640 1 -- 172.21.15.79:0/1274077141 >> 172.21.15.79:0/1274077141 conn(0x7f89f409d420 msgr2=0x7f89f40d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:45.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.864+0000 7f89f9542640 1 -- 172.21.15.79:0/1274077141 shutdown_connections 2024-04-25T02:08:45.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.864+0000 7f89f9542640 1 -- 172.21.15.79:0/1274077141 wait complete. 2024-04-25T02:08:45.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.866+0000 7f89f9542640 1 Processor -- start 2024-04-25T02:08:45.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.866+0000 7f89f9542640 1 -- start start 2024-04-25T02:08:45.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.866+0000 7f89f9542640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89f40b23a0 0x7f89f4152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.866+0000 7f89f9542640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40d26c0 0x7f89f40c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.866+0000 7f89f9542640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89f415e720 0x7f89f40c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.866+0000 7f89f9542640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f89f40d22e0 con 0x7f89f40d26c0 2024-04-25T02:08:45.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.866+0000 7f89f9542640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f89f40d2160 con 0x7f89f415e720 2024-04-25T02:08:45.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.866+0000 7f89f9542640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f89f40d2460 con 0x7f89f40b23a0 2024-04-25T02:08:45.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.866+0000 7f89f27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40d26c0 0x7f89f40c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:45.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.866+0000 7f89f27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40d26c0 0x7f89f40c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60036/0 (socket says 172.21.15.79:60036) 2024-04-25T02:08:45.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.866+0000 7f89f27fc640 1 -- 172.21.15.79:0/247865004 learned_addr learned my addr 172.21.15.79:0/247865004 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:45.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.867+0000 7f89f37fe640 1 --2- 172.21.15.79:0/247865004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89f415e720 0x7f89f40c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:45.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.867+0000 7f89f2ffd640 1 --2- 172.21.15.79:0/247865004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89f40b23a0 0x7f89f4152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:45.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.867+0000 7f89f27fc640 1 -- 172.21.15.79:0/247865004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89f40b23a0 msgr2=0x7f89f4152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.867+0000 7f89f27fc640 1 --2- 172.21.15.79:0/247865004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89f40b23a0 0x7f89f4152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.867+0000 7f89f27fc640 1 -- 172.21.15.79:0/247865004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89f415e720 msgr2=0x7f89f40c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:45.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.867+0000 7f89f27fc640 1 --2- 172.21.15.79:0/247865004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89f415e720 0x7f89f40c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:45.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.867+0000 7f89f27fc640 1 -- 172.21.15.79:0/247865004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f40c9c50 con 0x7f89f40d26c0 2024-04-25T02:08:45.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.867+0000 7f89f27fc640 1 --2- 172.21.15.79:0/247865004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40d26c0 0x7f89f40c9000 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f89e800c3c0 tx=0x7f89e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:45.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.867+0000 7f89db7fe640 1 -- 172.21.15.79:0/247865004 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e80074e0 con 0x7f89f40d26c0 2024-04-25T02:08:45.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.867+0000 7f89db7fe640 1 -- 172.21.15.79:0/247865004 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e80047e0 con 0x7f89f40d26c0 2024-04-25T02:08:45.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.867+0000 7f89db7fe640 1 -- 172.21.15.79:0/247865004 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8004bd0 con 0x7f89f40d26c0 2024-04-25T02:08:45.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.867+0000 7f89f9542640 1 -- 172.21.15.79:0/247865004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f40cc380 con 0x7f89f40d26c0 2024-04-25T02:08:45.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.867+0000 7f89f9542640 1 -- 172.21.15.79:0/247865004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f40cc940 con 0x7f89f40d26c0 2024-04-25T02:08:45.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.868+0000 7f89f9542640 1 -- 172.21.15.79:0/247865004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f40690a0 con 0x7f89f40d26c0 2024-04-25T02:08:45.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.869+0000 7f89db7fe640 1 -- 172.21.15.79:0/247865004 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89e801a020 con 0x7f89f40d26c0 2024-04-25T02:08:45.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.869+0000 7f89db7fe640 1 --2- 172.21.15.79:0/247865004 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f89e006be30 0x7f89e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:45.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.869+0000 7f89db7fe640 1 -- 172.21.15.79:0/247865004 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f89e808a140 con 0x7f89f40d26c0 2024-04-25T02:08:45.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.869+0000 7f89f2ffd640 1 --2- 172.21.15.79:0/247865004 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f89e006be30 0x7f89e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:45.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.869+0000 7f89f2ffd640 1 --2- 172.21.15.79:0/247865004 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f89e006be30 0x7f89e006e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f89e40016e0 tx=0x7f89e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:45.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:45.873+0000 7f89db7fe640 1 -- 172.21.15.79:0/247865004 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f89e80587f0 con 0x7f89f40d26c0 2024-04-25T02:08:46.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:46.045+0000 7f89f9542640 1 -- 172.21.15.79:0/247865004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f89f40d4ff0 con 0x7f89f40d26c0 2024-04-25T02:08:46.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:46.864+0000 7f89db7fe640 1 -- 172.21.15.79:0/247865004 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7f89e805caf0 con 0x7f89f40d26c0 2024-04-25T02:08:46.871 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-04-25T02:08:46.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:46.867+0000 7f89f9542640 1 -- 172.21.15.79:0/247865004 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f89e006be30 msgr2=0x7f89e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:46.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:46.867+0000 7f89f9542640 1 --2- 172.21.15.79:0/247865004 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f89e006be30 0x7f89e006e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f89e40016e0 tx=0x7f89e4009040 comp rx=0 tx=0).stop 2024-04-25T02:08:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:46.867+0000 7f89f9542640 1 -- 172.21.15.79:0/247865004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40d26c0 msgr2=0x7f89f40c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:46.867+0000 7f89f9542640 1 --2- 172.21.15.79:0/247865004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40d26c0 0x7f89f40c9000 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f89e800c3c0 tx=0x7f89e800c880 comp rx=0 tx=0).stop 2024-04-25T02:08:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:46.867+0000 7f89f9542640 1 -- 172.21.15.79:0/247865004 shutdown_connections 2024-04-25T02:08:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:46.867+0000 7f89f9542640 1 --2- 172.21.15.79:0/247865004 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f89e006be30 0x7f89e006e2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:46.867+0000 7f89f9542640 1 --2- 172.21.15.79:0/247865004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89f415e720 0x7f89f40c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:46.867+0000 7f89f9542640 1 --2- 172.21.15.79:0/247865004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40d26c0 0x7f89f40c9000 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:46.867+0000 7f89f9542640 1 --2- 172.21.15.79:0/247865004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89f40b23a0 0x7f89f4152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:46.867+0000 7f89f9542640 1 -- 172.21.15.79:0/247865004 >> 172.21.15.79:0/247865004 conn(0x7f89f409d420 msgr2=0x7f89f406d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:46.867+0000 7f89f9542640 1 -- 172.21.15.79:0/247865004 shutdown_connections 2024-04-25T02:08:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:46.868+0000 7f89f9542640 1 -- 172.21.15.79:0/247865004 wait complete. 2024-04-25T02:08:46.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T02:08:47.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.047+0000 7f099a438640 1 Processor -- start 2024-04-25T02:08:47.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.047+0000 7f099a438640 1 -- start start 2024-04-25T02:08:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.047+0000 7f099a438640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f09940d2ca0 0x7f09940d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.047+0000 7f099a438640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09940d0ef0 0x7f099406bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.047+0000 7f099a438640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09940d1ee0 con 0x7f099415e4f0 2024-04-25T02:08:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.047+0000 7f099a438640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f09940d3130 con 0x7f09940d2ca0 2024-04-25T02:08:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.047+0000 7f099a438640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f09940d21c0 con 0x7f09940d0ef0 2024-04-25T02:08:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.048+0000 7f09937fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f09940d2ca0 0x7f09940d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.048+0000 7f09989d5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09940d0ef0 0x7f099406bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.048+0000 7f09937fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f09940d2ca0 0x7f09940d09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:35502/0 (socket says 172.21.15.79:35502) 2024-04-25T02:08:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.048+0000 7f09937fe640 1 -- 172.21.15.79:0/3428603581 learned_addr learned my addr 172.21.15.79:0/3428603581 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:47.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.048+0000 7f0993fff640 1 --1- 172.21.15.79:0/3428603581 >> v1:172.21.15.189:6789/0 conn(0x7f099415e4f0 0x7f09940cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:55650/0 (socket says 172.21.15.79:55650) 2024-04-25T02:08:47.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.048+0000 7f09937fe640 1 -- 172.21.15.79:0/3428603581 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09940d0ef0 msgr2=0x7f099406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:47.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.048+0000 7f09937fe640 1 --2- 172.21.15.79:0/3428603581 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09940d0ef0 0x7f099406bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:47.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.048+0000 7f09937fe640 1 -- 172.21.15.79:0/3428603581 >> v1:172.21.15.189:6789/0 conn(0x7f099415e4f0 legacy=0x7f09940cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:47.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.048+0000 7f09937fe640 1 -- 172.21.15.79:0/3428603581 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09940d24a0 con 0x7f09940d2ca0 2024-04-25T02:08:47.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.049+0000 7f09937fe640 1 --2- 172.21.15.79:0/3428603581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09940d2ca0 0x7f09940d09b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f09880098a0 tx=0x7f098802a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f3b7a2fd6ba4057 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:47.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.049+0000 7f0992ffd640 1 -- 172.21.15.79:0/3428603581 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0988037070 con 0x7f09940d2ca0 2024-04-25T02:08:47.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.049+0000 7f0992ffd640 1 -- 172.21.15.79:0/3428603581 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0988032440 con 0x7f09940d2ca0 2024-04-25T02:08:47.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.049+0000 7f0992ffd640 1 -- 172.21.15.79:0/3428603581 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0988032810 con 0x7f09940d2ca0 2024-04-25T02:08:47.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.049+0000 7f099a438640 1 -- 172.21.15.79:0/3428603581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09940d2ca0 msgr2=0x7f09940d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:47.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.049+0000 7f099a438640 1 --2- 172.21.15.79:0/3428603581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09940d2ca0 0x7f09940d09b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f09880098a0 tx=0x7f098802a290 comp rx=0 tx=0).stop 2024-04-25T02:08:47.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.050+0000 7f099a438640 1 -- 172.21.15.79:0/3428603581 shutdown_connections 2024-04-25T02:08:47.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.050+0000 7f099a438640 1 --2- 172.21.15.79:0/3428603581 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09940d0ef0 0x7f099406bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:47.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.050+0000 7f099a438640 1 --2- 172.21.15.79:0/3428603581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09940d2ca0 0x7f09940d09b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:47.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.050+0000 7f099a438640 1 -- 172.21.15.79:0/3428603581 >> 172.21.15.79:0/3428603581 conn(0x7f099409d4a0 msgr2=0x7f09940d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:47.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.050+0000 7f099a438640 1 -- 172.21.15.79:0/3428603581 shutdown_connections 2024-04-25T02:08:47.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.050+0000 7f099a438640 1 -- 172.21.15.79:0/3428603581 wait complete. 2024-04-25T02:08:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.051+0000 7f099a438640 1 Processor -- start 2024-04-25T02:08:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.051+0000 7f099a438640 1 -- start start 2024-04-25T02:08:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f099a438640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09940d0ef0 0x7f09941f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f099a438640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09940d2ca0 0x7f099415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f099a438640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f099415e4f0 0x7f099406bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f099a438640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f09940d4ee0 con 0x7f099415e4f0 2024-04-25T02:08:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f099a438640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f09940cff00 con 0x7f09940d2ca0 2024-04-25T02:08:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f099a438640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f09940d5060 con 0x7f09940d0ef0 2024-04-25T02:08:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f09989d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f099415e4f0 0x7f099406bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f09989d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f099415e4f0 0x7f099406bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60044/0 (socket says 172.21.15.79:60044) 2024-04-25T02:08:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f09989d5640 1 -- 172.21.15.79:0/1026772957 learned_addr learned my addr 172.21.15.79:0/1026772957 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f0993fff640 1 --2- 172.21.15.79:0/1026772957 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09940d0ef0 0x7f09941f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f09937fe640 1 --2- 172.21.15.79:0/1026772957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09940d2ca0 0x7f099415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f09989d5640 1 -- 172.21.15.79:0/1026772957 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09940d0ef0 msgr2=0x7f09941f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f09989d5640 1 --2- 172.21.15.79:0/1026772957 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09940d0ef0 0x7f09941f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f09989d5640 1 -- 172.21.15.79:0/1026772957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09940d2ca0 msgr2=0x7f099415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f09989d5640 1 --2- 172.21.15.79:0/1026772957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09940d2ca0 0x7f099415cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f09989d5640 1 -- 172.21.15.79:0/1026772957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09941f42f0 con 0x7f099415e4f0 2024-04-25T02:08:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f09989d5640 1 --2- 172.21.15.79:0/1026772957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f099415e4f0 0x7f099406bc30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f098c009dd0 tx=0x7f098c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f0990ff9640 1 -- 172.21.15.79:0/1026772957 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c018020 con 0x7f099415e4f0 2024-04-25T02:08:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f0990ff9640 1 -- 172.21.15.79:0/1026772957 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f098c014480 con 0x7f099415e4f0 2024-04-25T02:08:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f099a438640 1 -- 172.21.15.79:0/1026772957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09940c9960 con 0x7f099415e4f0 2024-04-25T02:08:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f0990ff9640 1 -- 172.21.15.79:0/1026772957 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c014870 con 0x7f099415e4f0 2024-04-25T02:08:47.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.052+0000 7f099a438640 1 -- 172.21.15.79:0/1026772957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09940c9f20 con 0x7f099415e4f0 2024-04-25T02:08:47.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.053+0000 7f099a438640 1 -- 172.21.15.79:0/1026772957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09940686c0 con 0x7f099415e4f0 2024-04-25T02:08:47.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.054+0000 7f0990ff9640 1 -- 172.21.15.79:0/1026772957 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f098c005d10 con 0x7f099415e4f0 2024-04-25T02:08:47.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.054+0000 7f0990ff9640 1 --2- 172.21.15.79:0/1026772957 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f098006be60 0x7f098006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:47.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.055+0000 7f0990ff9640 1 -- 172.21.15.79:0/1026772957 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7f098c08bc00 con 0x7f099415e4f0 2024-04-25T02:08:47.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.055+0000 7f0993fff640 1 --2- 172.21.15.79:0/1026772957 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f098006be60 0x7f098006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:47.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.055+0000 7f0993fff640 1 --2- 172.21.15.79:0/1026772957 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f098006be60 0x7f098006e320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0984007fd0 tx=0x7f0984007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:47.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.059+0000 7f0990ff9640 1 -- 172.21.15.79:0/1026772957 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f098c022070 con 0x7f099415e4f0 2024-04-25T02:08:47.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.236+0000 7f099a438640 1 -- 172.21.15.79:0/1026772957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f09940b2da0 con 0x7f099415e4f0 2024-04-25T02:08:47.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.869+0000 7f0990ff9640 1 -- 172.21.15.79:0/1026772957 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7f098c010040 con 0x7f099415e4f0 2024-04-25T02:08:47.876 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-04-25T02:08:47.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.871+0000 7f099a438640 1 -- 172.21.15.79:0/1026772957 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f098006be60 msgr2=0x7f098006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:47.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.871+0000 7f099a438640 1 --2- 172.21.15.79:0/1026772957 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f098006be60 0x7f098006e320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0984007fd0 tx=0x7f0984007e80 comp rx=0 tx=0).stop 2024-04-25T02:08:47.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.871+0000 7f099a438640 1 -- 172.21.15.79:0/1026772957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f099415e4f0 msgr2=0x7f099406bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:47.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.871+0000 7f099a438640 1 --2- 172.21.15.79:0/1026772957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f099415e4f0 0x7f099406bc30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f098c009dd0 tx=0x7f098c00c490 comp rx=0 tx=0).stop 2024-04-25T02:08:47.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.871+0000 7f099a438640 1 -- 172.21.15.79:0/1026772957 shutdown_connections 2024-04-25T02:08:47.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.871+0000 7f099a438640 1 --2- 172.21.15.79:0/1026772957 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f098006be60 0x7f098006e320 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:47.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.871+0000 7f099a438640 1 --2- 172.21.15.79:0/1026772957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f099415e4f0 0x7f099406bc30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:47.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.871+0000 7f099a438640 1 --2- 172.21.15.79:0/1026772957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09940d2ca0 0x7f099415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:47.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.871+0000 7f099a438640 1 --2- 172.21.15.79:0/1026772957 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09940d0ef0 0x7f09941f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:47.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.871+0000 7f099a438640 1 -- 172.21.15.79:0/1026772957 >> 172.21.15.79:0/1026772957 conn(0x7f099409d4a0 msgr2=0x7f099415a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:47.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.871+0000 7f099a438640 1 -- 172.21.15.79:0/1026772957 shutdown_connections 2024-04-25T02:08:47.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.871+0000 7f099a438640 1 -- 172.21.15.79:0/1026772957 wait complete. 2024-04-25T02:08:47.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T02:08:48.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.993+0000 7f08cac2a640 1 Processor -- start 2024-04-25T02:08:48.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.993+0000 7f08cac2a640 1 -- start start 2024-04-25T02:08:48.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.994+0000 7f08cac2a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c415e4f0 0x7f08c40d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:48.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.994+0000 7f08cac2a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08c40d10c0 0x7f08c406bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:48.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.994+0000 7f08cac2a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08c40d1ee0 con 0x7f08c40cf7f0 2024-04-25T02:08:48.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.994+0000 7f08cac2a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f08c40d21c0 con 0x7f08c40d10c0 2024-04-25T02:08:48.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.994+0000 7f08cac2a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f08c40d24a0 con 0x7f08c415e4f0 2024-04-25T02:08:48.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.994+0000 7f08c91c7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08c40d10c0 0x7f08c406bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:48.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.994+0000 7f08c91c7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08c40d10c0 0x7f08c406bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60054/0 (socket says 172.21.15.79:60054) 2024-04-25T02:08:48.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.994+0000 7f08c91c7640 1 -- 172.21.15.79:0/1539382320 learned_addr learned my addr 172.21.15.79:0/1539382320 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:48.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.995+0000 7f08c89c6640 1 --2- 172.21.15.79:0/1539382320 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c415e4f0 0x7f08c40d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:48.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.995+0000 7f08c91c7640 1 -- 172.21.15.79:0/1539382320 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c415e4f0 msgr2=0x7f08c40d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:48.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.995+0000 7f08c91c7640 1 --2- 172.21.15.79:0/1539382320 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c415e4f0 0x7f08c40d2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:48.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.995+0000 7f08c91c7640 1 -- 172.21.15.79:0/1539382320 >> v1:172.21.15.189:6789/0 conn(0x7f08c40cf7f0 legacy=0x7f08c40d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:48.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.995+0000 7f08c91c7640 1 -- 172.21.15.79:0/1539382320 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c40d2780 con 0x7f08c40d10c0 2024-04-25T02:08:48.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.995+0000 7f08c91c7640 1 --2- 172.21.15.79:0/1539382320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c40d10c0 0x7f08c406bc30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009e50 tx=0x7f08bc02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8b61c9675837fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:48.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.996+0000 7f08c37fe640 1 -- 172.21.15.79:0/1539382320 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc036070 con 0x7f08c40d10c0 2024-04-25T02:08:48.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.996+0000 7f08c37fe640 1 -- 172.21.15.79:0/1539382320 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08bc031600 con 0x7f08c40d10c0 2024-04-25T02:08:48.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.996+0000 7f08c37fe640 1 -- 172.21.15.79:0/1539382320 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc0319d0 con 0x7f08c40d10c0 2024-04-25T02:08:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.996+0000 7f08cac2a640 1 -- 172.21.15.79:0/1539382320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c40d10c0 msgr2=0x7f08c406bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.996+0000 7f08cac2a640 1 --2- 172.21.15.79:0/1539382320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c40d10c0 0x7f08c406bc30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009e50 tx=0x7f08bc02a6c0 comp rx=0 tx=0).stop 2024-04-25T02:08:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.996+0000 7f08cac2a640 1 -- 172.21.15.79:0/1539382320 shutdown_connections 2024-04-25T02:08:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.996+0000 7f08cac2a640 1 --2- 172.21.15.79:0/1539382320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c40d10c0 0x7f08c406bc30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.996+0000 7f08cac2a640 1 --2- 172.21.15.79:0/1539382320 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c415e4f0 0x7f08c40d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.996+0000 7f08cac2a640 1 -- 172.21.15.79:0/1539382320 >> 172.21.15.79:0/1539382320 conn(0x7f08c409d4a0 msgr2=0x7f08c40d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.996+0000 7f08cac2a640 1 -- 172.21.15.79:0/1539382320 shutdown_connections 2024-04-25T02:08:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.996+0000 7f08cac2a640 1 -- 172.21.15.79:0/1539382320 wait complete. 2024-04-25T02:08:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.997+0000 7f08cac2a640 1 Processor -- start 2024-04-25T02:08:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.997+0000 7f08cac2a640 1 -- start start 2024-04-25T02:08:48.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.998+0000 7f08cac2a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c40cf7f0 0x7f08c41f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:48.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.998+0000 7f08cac2a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08c40d10c0 0x7f08c4155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:48.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.998+0000 7f08cac2a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c415e4f0 0x7f08c41557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:48.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.998+0000 7f08cac2a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f08c40cfc50 con 0x7f08c415e4f0 2024-04-25T02:08:48.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.998+0000 7f08cac2a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08c40d50f0 con 0x7f08c40d10c0 2024-04-25T02:08:48.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.998+0000 7f08cac2a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f08c40cfdd0 con 0x7f08c40cf7f0 2024-04-25T02:08:48.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.998+0000 7f08c91c7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c415e4f0 0x7f08c41557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:48.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.998+0000 7f08c91c7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c415e4f0 0x7f08c41557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60064/0 (socket says 172.21.15.79:60064) 2024-04-25T02:08:48.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.998+0000 7f08c91c7640 1 -- 172.21.15.79:0/3378591356 learned_addr learned my addr 172.21.15.79:0/3378591356 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:48.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.998+0000 7f08c89c6640 1 --2- 172.21.15.79:0/3378591356 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c40cf7f0 0x7f08c41f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:48.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.998+0000 7f08c3fff640 1 --2- 172.21.15.79:0/3378591356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08c40d10c0 0x7f08c4155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:48.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.999+0000 7f08c91c7640 1 -- 172.21.15.79:0/3378591356 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c40cf7f0 msgr2=0x7f08c41f7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:48.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.999+0000 7f08c91c7640 1 --2- 172.21.15.79:0/3378591356 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c40cf7f0 0x7f08c41f7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:48.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.999+0000 7f08c91c7640 1 -- 172.21.15.79:0/3378591356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08c40d10c0 msgr2=0x7f08c4155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:48.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.999+0000 7f08c91c7640 1 --2- 172.21.15.79:0/3378591356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08c40d10c0 0x7f08c4155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:48.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.999+0000 7f08c91c7640 1 -- 172.21.15.79:0/3378591356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c40c8750 con 0x7f08c415e4f0 2024-04-25T02:08:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.999+0000 7f08c91c7640 1 --2- 172.21.15.79:0/3378591356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c415e4f0 0x7f08c41557c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f08bc034040 tx=0x7f08bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.999+0000 7f08c17fa640 1 -- 172.21.15.79:0/3378591356 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc036050 con 0x7f08c415e4f0 2024-04-25T02:08:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.999+0000 7f08c17fa640 1 -- 172.21.15.79:0/3378591356 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08bc042070 con 0x7f08c415e4f0 2024-04-25T02:08:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.999+0000 7f08cac2a640 1 -- 172.21.15.79:0/3378591356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c40c89f0 con 0x7f08c415e4f0 2024-04-25T02:08:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.999+0000 7f08c17fa640 1 -- 172.21.15.79:0/3378591356 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc009510 con 0x7f08c415e4f0 2024-04-25T02:08:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:47.999+0000 7f08cac2a640 1 -- 172.21.15.79:0/3378591356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c40c8fb0 con 0x7f08c415e4f0 2024-04-25T02:08:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.000+0000 7f08cac2a640 1 -- 172.21.15.79:0/3378591356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c40686c0 con 0x7f08c415e4f0 2024-04-25T02:08:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.000+0000 7f08c17fa640 1 -- 172.21.15.79:0/3378591356 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08bc007bd0 con 0x7f08c415e4f0 2024-04-25T02:08:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.001+0000 7f08c17fa640 1 --2- 172.21.15.79:0/3378591356 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f08b006be30 0x7f08b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.001+0000 7f08c17fa640 1 -- 172.21.15.79:0/3378591356 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7f08bc0abc80 con 0x7f08c415e4f0 2024-04-25T02:08:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.001+0000 7f08c89c6640 1 --2- 172.21.15.79:0/3378591356 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f08b006be30 0x7f08b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.001+0000 7f08c89c6640 1 --2- 172.21.15.79:0/3378591356 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f08b006be30 0x7f08b006e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f08b400aac0 tx=0x7f08b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:48.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.005+0000 7f08c17fa640 1 -- 172.21.15.79:0/3378591356 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f08bc079fb0 con 0x7f08c415e4f0 2024-04-25T02:08:48.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.217+0000 7f08cac2a640 1 -- 172.21.15.79:0/3378591356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f08c40b5590 con 0x7f08c415e4f0 2024-04-25T02:08:48.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.870+0000 7f08c17fa640 1 -- 172.21.15.79:0/3378591356 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v10) ==== 172+0+0 (secure 0 0 0) 0x7f08bc07e2b0 con 0x7f08c415e4f0 2024-04-25T02:08:48.878 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 4 and data pool 5 2024-04-25T02:08:48.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.873+0000 7f08cac2a640 1 -- 172.21.15.79:0/3378591356 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f08b006be30 msgr2=0x7f08b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:48.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.873+0000 7f08cac2a640 1 --2- 172.21.15.79:0/3378591356 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f08b006be30 0x7f08b006e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f08b400aac0 tx=0x7f08b4008040 comp rx=0 tx=0).stop 2024-04-25T02:08:48.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.873+0000 7f08cac2a640 1 -- 172.21.15.79:0/3378591356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c415e4f0 msgr2=0x7f08c41557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:48.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.873+0000 7f08cac2a640 1 --2- 172.21.15.79:0/3378591356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c415e4f0 0x7f08c41557c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f08bc034040 tx=0x7f08bc004a40 comp rx=0 tx=0).stop 2024-04-25T02:08:48.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.873+0000 7f08cac2a640 1 -- 172.21.15.79:0/3378591356 shutdown_connections 2024-04-25T02:08:48.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.873+0000 7f08cac2a640 1 --2- 172.21.15.79:0/3378591356 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f08b006be30 0x7f08b006e2f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:48.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.873+0000 7f08cac2a640 1 --2- 172.21.15.79:0/3378591356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c415e4f0 0x7f08c41557c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:48.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.873+0000 7f08cac2a640 1 --2- 172.21.15.79:0/3378591356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08c40d10c0 0x7f08c4155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:48.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.873+0000 7f08cac2a640 1 --2- 172.21.15.79:0/3378591356 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c40cf7f0 0x7f08c41f7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:48.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.873+0000 7f08cac2a640 1 -- 172.21.15.79:0/3378591356 >> 172.21.15.79:0/3378591356 conn(0x7f08c409d4a0 msgr2=0x7f08c40b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:48.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.873+0000 7f08cac2a640 1 -- 172.21.15.79:0/3378591356 shutdown_connections 2024-04-25T02:08:48.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.873+0000 7f08cac2a640 1 -- 172.21.15.79:0/3378591356 wait complete. 2024-04-25T02:08:48.906 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:49.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.997+0000 7ff9f22ae640 1 Processor -- start 2024-04-25T02:08:49.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.997+0000 7ff9f22ae640 1 -- start start 2024-04-25T02:08:49.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.998+0000 7ff9f22ae640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9ec06df50 0x7ff9ec06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.998+0000 7ff9f22ae640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ec070d90 con 0x7ff9ec144cb0 2024-04-25T02:08:49.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.998+0000 7ff9f22ae640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ec0cf130 con 0x7ff9ec071240 2024-04-25T02:08:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.998+0000 7ff9f22ae640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ec06e8f0 con 0x7ff9ec06df50 2024-04-25T02:08:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.998+0000 7ff9ebfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff9ec144cb0 0x7ff9ec0b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35604/0 (socket says 172.21.15.79:35604) 2024-04-25T02:08:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.998+0000 7ff9ebfff640 1 -- 172.21.15.79:0/2322272260 learned_addr learned my addr 172.21.15.79:0/2322272260 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.998+0000 7ff9eb7fe640 1 --2- 172.21.15.79:0/2322272260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9ec06df50 0x7ff9ec06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.998+0000 7ff9eaffd640 1 -- 172.21.15.79:0/2322272260 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439972405 0 0) 0x7ff9ec070d90 con 0x7ff9ec144cb0 2024-04-25T02:08:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.998+0000 7ff9eaffd640 1 -- 172.21.15.79:0/2322272260 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9d4003520 con 0x7ff9ec144cb0 2024-04-25T02:08:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.998+0000 7ff9eaffd640 1 -- 172.21.15.79:0/2322272260 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1507052053 0 0) 0x7ff9ec0cf130 con 0x7ff9ec071240 2024-04-25T02:08:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.998+0000 7ff9eb7fe640 1 -- 172.21.15.79:0/2322272260 >> v1:172.21.15.189:6789/0 conn(0x7ff9ec071240 legacy=0x7ff9ec0716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.998+0000 7ff9eb7fe640 1 -- 172.21.15.79:0/2322272260 >> v1:172.21.15.79:6789/0 conn(0x7ff9ec144cb0 legacy=0x7ff9ec0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.998+0000 7ff9eb7fe640 1 -- 172.21.15.79:0/2322272260 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec0cf410 con 0x7ff9ec06df50 2024-04-25T02:08:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.999+0000 7ff9eb7fe640 1 --2- 172.21.15.79:0/2322272260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9ec06df50 0x7ff9ec06e3b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00097d0 tx=0x7ff9e002a050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=392dbbdaee5c298 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.999+0000 7ff9eaffd640 1 -- 172.21.15.79:0/2322272260 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0037070 con 0x7ff9ec06df50 2024-04-25T02:08:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.999+0000 7ff9eaffd640 1 -- 172.21.15.79:0/2322272260 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e002aae0 con 0x7ff9ec06df50 2024-04-25T02:08:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:48.999+0000 7ff9eaffd640 1 -- 172.21.15.79:0/2322272260 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc001670 con 0x7ff9ec06df50 2024-04-25T02:08:49.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.000+0000 7ff9f22ae640 1 -- 172.21.15.79:0/2322272260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9ec06df50 msgr2=0x7ff9ec06e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.000+0000 7ff9f22ae640 1 --2- 172.21.15.79:0/2322272260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9ec06df50 0x7ff9ec06e3b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00097d0 tx=0x7ff9e002a050 comp rx=0 tx=0).stop 2024-04-25T02:08:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.000+0000 7ff9f22ae640 1 -- 172.21.15.79:0/2322272260 shutdown_connections 2024-04-25T02:08:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.000+0000 7ff9f22ae640 1 --2- 172.21.15.79:0/2322272260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9ec06df50 0x7ff9ec06e3b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.000+0000 7ff9f22ae640 1 -- 172.21.15.79:0/2322272260 >> 172.21.15.79:0/2322272260 conn(0x7ff9ec0cfc80 msgr2=0x7ff9ec0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.000+0000 7ff9f22ae640 1 -- 172.21.15.79:0/2322272260 shutdown_connections 2024-04-25T02:08:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.000+0000 7ff9f22ae640 1 -- 172.21.15.79:0/2322272260 wait complete. 2024-04-25T02:08:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.001+0000 7ff9f22ae640 1 Processor -- start 2024-04-25T02:08:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.001+0000 7ff9f22ae640 1 -- start start 2024-04-25T02:08:49.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9f22ae640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9ec06df50 0x7ff9ec1598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9f22ae640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9ec071240 0x7ff9ec140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9f22ae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9ec144cb0 0x7ff9ec155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9f22ae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ec0cf9d0 con 0x7ff9ec144cb0 2024-04-25T02:08:49.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9f22ae640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ec0b5750 con 0x7ff9ec06df50 2024-04-25T02:08:49.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9f22ae640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ec145090 con 0x7ff9ec071240 2024-04-25T02:08:49.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9f084b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9ec144cb0 0x7ff9ec155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9f084b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9ec144cb0 0x7ff9ec155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60066/0 (socket says 172.21.15.79:60066) 2024-04-25T02:08:49.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9f084b640 1 -- 172.21.15.79:0/888156925 learned_addr learned my addr 172.21.15.79:0/888156925 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:49.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9eb7fe640 1 --2- 172.21.15.79:0/888156925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9ec071240 0x7ff9ec140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9ebfff640 1 --2- 172.21.15.79:0/888156925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9ec06df50 0x7ff9ec1598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9f084b640 1 -- 172.21.15.79:0/888156925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9ec071240 msgr2=0x7ff9ec140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9f084b640 1 --2- 172.21.15.79:0/888156925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9ec071240 0x7ff9ec140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9f084b640 1 -- 172.21.15.79:0/888156925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9ec06df50 msgr2=0x7ff9ec1598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9f084b640 1 --2- 172.21.15.79:0/888156925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9ec06df50 0x7ff9ec1598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.002+0000 7ff9f084b640 1 -- 172.21.15.79:0/888156925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec1563c0 con 0x7ff9ec144cb0 2024-04-25T02:08:49.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.003+0000 7ff9f084b640 1 --2- 172.21.15.79:0/888156925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9ec144cb0 0x7ff9ec155b70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4001560 tx=0x7ff9e400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:49.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.003+0000 7ff9e8ff9640 1 -- 172.21.15.79:0/888156925 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4017070 con 0x7ff9ec144cb0 2024-04-25T02:08:49.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.003+0000 7ff9e8ff9640 1 -- 172.21.15.79:0/888156925 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e4003dc0 con 0x7ff9ec144cb0 2024-04-25T02:08:49.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.003+0000 7ff9f22ae640 1 -- 172.21.15.79:0/888156925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ec1566a0 con 0x7ff9ec144cb0 2024-04-25T02:08:49.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.003+0000 7ff9e8ff9640 1 -- 172.21.15.79:0/888156925 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e40052b0 con 0x7ff9ec144cb0 2024-04-25T02:08:49.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.003+0000 7ff9f22ae640 1 -- 172.21.15.79:0/888156925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ec156c60 con 0x7ff9ec144cb0 2024-04-25T02:08:49.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.004+0000 7ff9f22ae640 1 -- 172.21.15.79:0/888156925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ec068a10 con 0x7ff9ec144cb0 2024-04-25T02:08:49.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.004+0000 7ff9e8ff9640 1 -- 172.21.15.79:0/888156925 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9e401a070 con 0x7ff9ec144cb0 2024-04-25T02:08:49.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.004+0000 7ff9e8ff9640 1 --2- 172.21.15.79:0/888156925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff9d806be30 0x7ff9d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.005+0000 7ff9e8ff9640 1 -- 172.21.15.79:0/888156925 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff9e408a430 con 0x7ff9ec144cb0 2024-04-25T02:08:49.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.005+0000 7ff9ebfff640 1 --2- 172.21.15.79:0/888156925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff9d806be30 0x7ff9d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.005+0000 7ff9ebfff640 1 --2- 172.21.15.79:0/888156925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff9d806be30 0x7ff9d806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc001600 tx=0x7ff9dc001570 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:49.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.009+0000 7ff9e8ff9640 1 -- 172.21.15.79:0/888156925 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff9ec068a10 con 0x7ff9ec144cb0 2024-04-25T02:08:49.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.181+0000 7ff9f22ae640 1 -- 172.21.15.79:0/888156925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9ec0690a0 con 0x7ff9ec144cb0 2024-04-25T02:08:49.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.182+0000 7ff9e8ff9640 1 -- 172.21.15.79:0/888156925 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16694 (secure 0 0 0) 0x7ff9e4058820 con 0x7ff9ec144cb0 2024-04-25T02:08:49.189 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:49.190 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":32,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:48.219209+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:08:46.063839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T02:08:47.254948+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:49.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.184+0000 7ff9f22ae640 1 -- 172.21.15.79:0/888156925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff9d806be30 msgr2=0x7ff9d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.184+0000 7ff9f22ae640 1 --2- 172.21.15.79:0/888156925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff9d806be30 0x7ff9d806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc001600 tx=0x7ff9dc001570 comp rx=0 tx=0).stop 2024-04-25T02:08:49.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.184+0000 7ff9f22ae640 1 -- 172.21.15.79:0/888156925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9ec144cb0 msgr2=0x7ff9ec155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.184+0000 7ff9f22ae640 1 --2- 172.21.15.79:0/888156925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9ec144cb0 0x7ff9ec155b70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4001560 tx=0x7ff9e400cc70 comp rx=0 tx=0).stop 2024-04-25T02:08:49.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.184+0000 7ff9f22ae640 1 -- 172.21.15.79:0/888156925 shutdown_connections 2024-04-25T02:08:49.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.184+0000 7ff9f22ae640 1 --2- 172.21.15.79:0/888156925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff9d806be30 0x7ff9d806e2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.184+0000 7ff9f22ae640 1 --2- 172.21.15.79:0/888156925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9ec144cb0 0x7ff9ec155b70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.184+0000 7ff9f22ae640 1 --2- 172.21.15.79:0/888156925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9ec071240 0x7ff9ec140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.184+0000 7ff9f22ae640 1 --2- 172.21.15.79:0/888156925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9ec06df50 0x7ff9ec1598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.184+0000 7ff9f22ae640 1 -- 172.21.15.79:0/888156925 >> 172.21.15.79:0/888156925 conn(0x7ff9ec0cfc80 msgr2=0x7ff9ec0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:49.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.184+0000 7ff9f22ae640 1 -- 172.21.15.79:0/888156925 shutdown_connections 2024-04-25T02:08:49.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.185+0000 7ff9f22ae640 1 -- 172.21.15.79:0/888156925 wait complete. 2024-04-25T02:08:49.203 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:49.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.293+0000 7fbb95916640 1 Processor -- start 2024-04-25T02:08:49.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.293+0000 7fbb95916640 1 -- start start 2024-04-25T02:08:49.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.294+0000 7fbb95916640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb9015e440 0x7fbb900d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.294+0000 7fbb95916640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbb900cf7a0 0x7fbb900b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.294+0000 7fbb95916640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb900cfdc0 con 0x7fbb900d4570 2024-04-25T02:08:49.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.294+0000 7fbb95916640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbb900d49b0 con 0x7fbb900cf7a0 2024-04-25T02:08:49.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.294+0000 7fbb95916640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbb900d00a0 con 0x7fbb9015e440 2024-04-25T02:08:49.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.294+0000 7fbb8f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbb900cf7a0 0x7fbb900b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.294+0000 7fbb8f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbb900cf7a0 0x7fbb900b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60078/0 (socket says 172.21.15.79:60078) 2024-04-25T02:08:49.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.294+0000 7fbb8f7fe640 1 -- 172.21.15.79:0/1861309154 learned_addr learned my addr 172.21.15.79:0/1861309154 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:49.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.294+0000 7fbb8f7fe640 1 -- 172.21.15.79:0/1861309154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb9015e440 msgr2=0x7fbb900d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:49.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.294+0000 7fbb8effd640 1 --2- 172.21.15.79:0/1861309154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb9015e440 0x7fbb900d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.294+0000 7fbb8f7fe640 1 --2- 172.21.15.79:0/1861309154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb9015e440 0x7fbb900d4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.294+0000 7fbb8f7fe640 1 -- 172.21.15.79:0/1861309154 >> v1:172.21.15.189:6789/0 conn(0x7fbb900d4570 legacy=0x7fbb900cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:49.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.294+0000 7fbb8f7fe640 1 -- 172.21.15.79:0/1861309154 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb900d0380 con 0x7fbb900cf7a0 2024-04-25T02:08:49.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.295+0000 7fbb8f7fe640 1 --2- 172.21.15.79:0/1861309154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb900cf7a0 0x7fbb900b3940 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009e50 tx=0x7fbb8802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4092c61fc5d0ac70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:49.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.295+0000 7fbb8dffb640 1 -- 172.21.15.79:0/1861309154 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb88036070 con 0x7fbb900cf7a0 2024-04-25T02:08:49.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.295+0000 7fbb8dffb640 1 -- 172.21.15.79:0/1861309154 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb88031600 con 0x7fbb900cf7a0 2024-04-25T02:08:49.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.295+0000 7fbb8dffb640 1 -- 172.21.15.79:0/1861309154 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb880319d0 con 0x7fbb900cf7a0 2024-04-25T02:08:49.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.295+0000 7fbb95916640 1 -- 172.21.15.79:0/1861309154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb900cf7a0 msgr2=0x7fbb900b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.295+0000 7fbb95916640 1 --2- 172.21.15.79:0/1861309154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb900cf7a0 0x7fbb900b3940 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009e50 tx=0x7fbb8802a6c0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.295+0000 7fbb95916640 1 -- 172.21.15.79:0/1861309154 shutdown_connections 2024-04-25T02:08:49.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.295+0000 7fbb95916640 1 --2- 172.21.15.79:0/1861309154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb900cf7a0 0x7fbb900b3940 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.295+0000 7fbb95916640 1 --2- 172.21.15.79:0/1861309154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb9015e440 0x7fbb900d4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.295+0000 7fbb95916640 1 -- 172.21.15.79:0/1861309154 >> 172.21.15.79:0/1861309154 conn(0x7fbb9008db50 msgr2=0x7fbb9009d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:49.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.295+0000 7fbb95916640 1 -- 172.21.15.79:0/1861309154 shutdown_connections 2024-04-25T02:08:49.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.295+0000 7fbb95916640 1 -- 172.21.15.79:0/1861309154 wait complete. 2024-04-25T02:08:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.297+0000 7fbb95916640 1 Processor -- start 2024-04-25T02:08:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.297+0000 7fbb95916640 1 -- start start 2024-04-25T02:08:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.297+0000 7fbb95916640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb900cf7a0 0x7fbb901507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.297+0000 7fbb95916640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb900d4570 0x7fbb900cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.297+0000 7fbb95916640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb9015e440 0x7fbb9015ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.297+0000 7fbb95916640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbb900b3e80 con 0x7fbb900d4570 2024-04-25T02:08:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.297+0000 7fbb95916640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9015e820 con 0x7fbb900cf7a0 2024-04-25T02:08:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.297+0000 7fbb95916640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbb900b4000 con 0x7fbb9015e440 2024-04-25T02:08:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb8e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb900d4570 0x7fbb900cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb8e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb900d4570 0x7fbb900cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60092/0 (socket says 172.21.15.79:60092) 2024-04-25T02:08:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb8e7fc640 1 -- 172.21.15.79:0/3128199709 learned_addr learned my addr 172.21.15.79:0/3128199709 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb8effd640 1 --2- 172.21.15.79:0/3128199709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb900cf7a0 0x7fbb901507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb8f7fe640 1 --2- 172.21.15.79:0/3128199709 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb9015e440 0x7fbb9015ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb8e7fc640 1 -- 172.21.15.79:0/3128199709 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb9015e440 msgr2=0x7fbb9015ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb8e7fc640 1 --2- 172.21.15.79:0/3128199709 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb9015e440 0x7fbb9015ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb8e7fc640 1 -- 172.21.15.79:0/3128199709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb900cf7a0 msgr2=0x7fbb901507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb8e7fc640 1 --2- 172.21.15.79:0/3128199709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb900cf7a0 0x7fbb901507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb8e7fc640 1 -- 172.21.15.79:0/3128199709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb900b8bb0 con 0x7fbb900d4570 2024-04-25T02:08:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb8effd640 1 --2- 172.21.15.79:0/3128199709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb900cf7a0 0x7fbb901507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb8e7fc640 1 --2- 172.21.15.79:0/3128199709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb900d4570 0x7fbb900cb200 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400c460 tx=0x7fbb8400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb77fff640 1 -- 172.21.15.79:0/3128199709 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84016020 con 0x7fbb900d4570 2024-04-25T02:08:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb77fff640 1 -- 172.21.15.79:0/3128199709 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb84012870 con 0x7fbb900d4570 2024-04-25T02:08:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb95916640 1 -- 172.21.15.79:0/3128199709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb900b8e90 con 0x7fbb900d4570 2024-04-25T02:08:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb77fff640 1 -- 172.21.15.79:0/3128199709 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84012c60 con 0x7fbb900d4570 2024-04-25T02:08:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.298+0000 7fbb95916640 1 -- 172.21.15.79:0/3128199709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb900b9450 con 0x7fbb900d4570 2024-04-25T02:08:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.299+0000 7fbb95916640 1 -- 172.21.15.79:0/3128199709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb900690a0 con 0x7fbb900d4570 2024-04-25T02:08:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.300+0000 7fbb77fff640 1 -- 172.21.15.79:0/3128199709 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb84019020 con 0x7fbb900d4570 2024-04-25T02:08:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.300+0000 7fbb77fff640 1 --2- 172.21.15.79:0/3128199709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbb7c06be60 0x7fbb7c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.300+0000 7fbb77fff640 1 -- 172.21.15.79:0/3128199709 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fbb8408ae40 con 0x7fbb900d4570 2024-04-25T02:08:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.300+0000 7fbb8effd640 1 --2- 172.21.15.79:0/3128199709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbb7c06be60 0x7fbb7c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.300+0000 7fbb8effd640 1 --2- 172.21.15.79:0/3128199709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbb7c06be60 0x7fbb7c06e320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbb80006fd0 tx=0x7fbb80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:49.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.304+0000 7fbb77fff640 1 -- 172.21.15.79:0/3128199709 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbb84020020 con 0x7fbb900d4570 2024-04-25T02:08:49.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.481+0000 7fbb95916640 1 -- 172.21.15.79:0/3128199709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb900d2460 con 0x7fbb900d4570 2024-04-25T02:08:49.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.483+0000 7fbb77fff640 1 -- 172.21.15.79:0/3128199709 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16694 (secure 0 0 0) 0x7fbb840182c0 con 0x7fbb900d4570 2024-04-25T02:08:49.490 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:49.490 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":32,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:48.219209+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:08:46.063839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T02:08:47.254948+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:49.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.484+0000 7fbb95916640 1 -- 172.21.15.79:0/3128199709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbb7c06be60 msgr2=0x7fbb7c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.484+0000 7fbb95916640 1 --2- 172.21.15.79:0/3128199709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbb7c06be60 0x7fbb7c06e320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbb80006fd0 tx=0x7fbb80008040 comp rx=0 tx=0).stop 2024-04-25T02:08:49.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.484+0000 7fbb95916640 1 -- 172.21.15.79:0/3128199709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb900d4570 msgr2=0x7fbb900cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.484+0000 7fbb95916640 1 --2- 172.21.15.79:0/3128199709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb900d4570 0x7fbb900cb200 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400c460 tx=0x7fbb8400c920 comp rx=0 tx=0).stop 2024-04-25T02:08:49.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.484+0000 7fbb95916640 1 -- 172.21.15.79:0/3128199709 shutdown_connections 2024-04-25T02:08:49.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.484+0000 7fbb95916640 1 --2- 172.21.15.79:0/3128199709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbb7c06be60 0x7fbb7c06e320 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.484+0000 7fbb95916640 1 --2- 172.21.15.79:0/3128199709 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb9015e440 0x7fbb9015ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.484+0000 7fbb95916640 1 --2- 172.21.15.79:0/3128199709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb900d4570 0x7fbb900cb200 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.484+0000 7fbb95916640 1 --2- 172.21.15.79:0/3128199709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb900cf7a0 0x7fbb901507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.484+0000 7fbb95916640 1 -- 172.21.15.79:0/3128199709 >> 172.21.15.79:0/3128199709 conn(0x7fbb9008db50 msgr2=0x7fbb9006c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:49.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.485+0000 7fbb95916640 1 -- 172.21.15.79:0/3128199709 shutdown_connections 2024-04-25T02:08:49.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.485+0000 7fbb95916640 1 -- 172.21.15.79:0/3128199709 wait complete. 2024-04-25T02:08:49.503 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T02:08:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.595+0000 7f15d0e53640 1 Processor -- start 2024-04-25T02:08:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.595+0000 7f15d0e53640 1 -- start start 2024-04-25T02:08:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.596+0000 7f15d0e53640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15cc0cf7a0 0x7f15cc0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.596+0000 7f15d0e53640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f15cc06e6b0 0x7f15cc15b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.596+0000 7f15d0e53640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15cc15ec20 con 0x7f15cc06b2f0 2024-04-25T02:08:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.596+0000 7f15d0e53640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f15cc15f830 con 0x7f15cc0cf7a0 2024-04-25T02:08:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.596+0000 7f15d0e53640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f15cc15ef00 con 0x7f15cc06e6b0 2024-04-25T02:08:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.596+0000 7f15c3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15cc0cf7a0 0x7f15cc0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.596+0000 7f15c3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15cc0cf7a0 0x7f15cc0b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60100/0 (socket says 172.21.15.79:60100) 2024-04-25T02:08:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.596+0000 7f15c3fff640 1 -- 172.21.15.79:0/1072559945 learned_addr learned my addr 172.21.15.79:0/1072559945 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.596+0000 7f15cad9d640 1 --2- 172.21.15.79:0/1072559945 >> v2:172.21.15.189:3300/0 conn(0x7f15cc06e6b0 0x7f15cc15b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.596+0000 7f15c3fff640 1 -- 172.21.15.79:0/1072559945 >> v2:172.21.15.189:3300/0 conn(0x7f15cc06e6b0 msgr2=0x7f15cc15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.596+0000 7f15c3fff640 1 --2- 172.21.15.79:0/1072559945 >> v2:172.21.15.189:3300/0 conn(0x7f15cc06e6b0 0x7f15cc15b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.596+0000 7f15c3fff640 1 -- 172.21.15.79:0/1072559945 >> v1:172.21.15.189:6789/0 conn(0x7f15cc06b2f0 legacy=0x7f15cc06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.596+0000 7f15c3fff640 1 -- 172.21.15.79:0/1072559945 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc15f1e0 con 0x7f15cc0cf7a0 2024-04-25T02:08:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.596+0000 7f15cad9d640 1 --2- 172.21.15.79:0/1072559945 >> v2:172.21.15.189:3300/0 conn(0x7f15cc06e6b0 0x7f15cc15b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.597+0000 7f15c3fff640 1 --2- 172.21.15.79:0/1072559945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15cc0cf7a0 0x7f15cc0b4b50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f15cc15f9b0 tx=0x7f15b402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2be567e716e156 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.597+0000 7f15c9d9b640 1 -- 172.21.15.79:0/1072559945 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b4037070 con 0x7f15cc0cf7a0 2024-04-25T02:08:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.597+0000 7f15c9d9b640 1 -- 172.21.15.79:0/1072559945 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b4032440 con 0x7f15cc0cf7a0 2024-04-25T02:08:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.597+0000 7f15c9d9b640 1 -- 172.21.15.79:0/1072559945 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b4032810 con 0x7f15cc0cf7a0 2024-04-25T02:08:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.597+0000 7f15d0e53640 1 -- 172.21.15.79:0/1072559945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15cc0cf7a0 msgr2=0x7f15cc0b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.597+0000 7f15d0e53640 1 --2- 172.21.15.79:0/1072559945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15cc0cf7a0 0x7f15cc0b4b50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f15cc15f9b0 tx=0x7f15b402a180 comp rx=0 tx=0).stop 2024-04-25T02:08:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.597+0000 7f15d0e53640 1 -- 172.21.15.79:0/1072559945 shutdown_connections 2024-04-25T02:08:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.597+0000 7f15d0e53640 1 --2- 172.21.15.79:0/1072559945 >> v2:172.21.15.189:3300/0 conn(0x7f15cc06e6b0 0x7f15cc15b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.597+0000 7f15d0e53640 1 --2- 172.21.15.79:0/1072559945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15cc0cf7a0 0x7f15cc0b4b50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.597+0000 7f15d0e53640 1 -- 172.21.15.79:0/1072559945 >> 172.21.15.79:0/1072559945 conn(0x7f15cc0b1cd0 msgr2=0x7f15cc0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:49.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.598+0000 7f15d0e53640 1 -- 172.21.15.79:0/1072559945 shutdown_connections 2024-04-25T02:08:49.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.598+0000 7f15d0e53640 1 -- 172.21.15.79:0/1072559945 wait complete. 2024-04-25T02:08:49.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.599+0000 7f15d0e53640 1 Processor -- start 2024-04-25T02:08:49.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.599+0000 7f15d0e53640 1 -- start start 2024-04-25T02:08:49.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.599+0000 7f15d0e53640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15cc06b2f0 0x7f15cc0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15d0e53640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15cc06e6b0 0x7f15cc09abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15d0e53640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15cc0cf7a0 0x7f15cc0cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15d0e53640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc06d160 con 0x7f15cc06b2f0 2024-04-25T02:08:49.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15d0e53640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc06cfe0 con 0x7f15cc06e6b0 2024-04-25T02:08:49.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15d0e53640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f15cc15b810 con 0x7f15cc0cf7a0 2024-04-25T02:08:49.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15ca59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15cc06b2f0 0x7f15cc0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15ca59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15cc06b2f0 0x7f15cc0ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60112/0 (socket says 172.21.15.79:60112) 2024-04-25T02:08:49.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15ca59c640 1 -- 172.21.15.79:0/652838206 learned_addr learned my addr 172.21.15.79:0/652838206 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:49.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15c3fff640 1 --2- 172.21.15.79:0/652838206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15cc06e6b0 0x7f15cc09abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15cad9d640 1 --2- 172.21.15.79:0/652838206 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15cc0cf7a0 0x7f15cc0cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15ca59c640 1 -- 172.21.15.79:0/652838206 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15cc0cf7a0 msgr2=0x7f15cc0cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15ca59c640 1 --2- 172.21.15.79:0/652838206 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15cc0cf7a0 0x7f15cc0cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15ca59c640 1 -- 172.21.15.79:0/652838206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15cc06e6b0 msgr2=0x7f15cc09abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15ca59c640 1 --2- 172.21.15.79:0/652838206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15cc06e6b0 0x7f15cc09abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15ca59c640 1 -- 172.21.15.79:0/652838206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc072520 con 0x7f15cc06b2f0 2024-04-25T02:08:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15c3fff640 1 --2- 172.21.15.79:0/652838206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15cc06e6b0 0x7f15cc09abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15ca59c640 1 --2- 172.21.15.79:0/652838206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15cc06b2f0 0x7f15cc0ae880 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00c460 tx=0x7f15bc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15c2ffd640 1 -- 172.21.15.79:0/652838206 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc016020 con 0x7f15cc06b2f0 2024-04-25T02:08:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15c2ffd640 1 -- 172.21.15.79:0/652838206 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15bc012870 con 0x7f15cc06b2f0 2024-04-25T02:08:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15d0e53640 1 -- 172.21.15.79:0/652838206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15cc0aef10 con 0x7f15cc06b2f0 2024-04-25T02:08:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15c2ffd640 1 -- 172.21.15.79:0/652838206 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc012c60 con 0x7f15cc06b2f0 2024-04-25T02:08:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.600+0000 7f15d0e53640 1 -- 172.21.15.79:0/652838206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15cc071a40 con 0x7f15cc06b2f0 2024-04-25T02:08:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.601+0000 7f15d0e53640 1 -- 172.21.15.79:0/652838206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15cc0690a0 con 0x7f15cc06b2f0 2024-04-25T02:08:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.602+0000 7f15c2ffd640 1 -- 172.21.15.79:0/652838206 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15bc019020 con 0x7f15cc06b2f0 2024-04-25T02:08:49.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.602+0000 7f15c2ffd640 1 --2- 172.21.15.79:0/652838206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f15ac06be30 0x7f15ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:49.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.602+0000 7f15c3fff640 1 --2- 172.21.15.79:0/652838206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f15ac06be30 0x7f15ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:49.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.602+0000 7f15c2ffd640 1 -- 172.21.15.79:0/652838206 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f15bc08abf0 con 0x7f15cc06b2f0 2024-04-25T02:08:49.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.603+0000 7f15c3fff640 1 --2- 172.21.15.79:0/652838206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f15ac06be30 0x7f15ac06e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f15b4034000 tx=0x7f15b402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.607+0000 7f15c2ffd640 1 -- 172.21.15.79:0/652838206 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f15bc020030 con 0x7f15cc06b2f0 2024-04-25T02:08:49.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.815+0000 7f15d0e53640 1 -- 172.21.15.79:0/652838206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f15cc0cf4f0 con 0x7f15cc06b2f0 2024-04-25T02:08:49.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.888+0000 7f15c2ffd640 1 -- 172.21.15.79:0/652838206 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v11) ==== 118+0+0 (secure 0 0 0) 0x7f15bc059510 con 0x7f15cc06b2f0 2024-04-25T02:08:49.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.890+0000 7f15d0e53640 1 -- 172.21.15.79:0/652838206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f15ac06be30 msgr2=0x7f15ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.890+0000 7f15d0e53640 1 --2- 172.21.15.79:0/652838206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f15ac06be30 0x7f15ac06e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f15b4034000 tx=0x7f15b402e000 comp rx=0 tx=0).stop 2024-04-25T02:08:49.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.890+0000 7f15d0e53640 1 -- 172.21.15.79:0/652838206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15cc06b2f0 msgr2=0x7f15cc0ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:49.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.890+0000 7f15d0e53640 1 --2- 172.21.15.79:0/652838206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15cc06b2f0 0x7f15cc0ae880 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00c460 tx=0x7f15bc00c920 comp rx=0 tx=0).stop 2024-04-25T02:08:49.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.891+0000 7f15d0e53640 1 -- 172.21.15.79:0/652838206 shutdown_connections 2024-04-25T02:08:49.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.891+0000 7f15d0e53640 1 --2- 172.21.15.79:0/652838206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f15ac06be30 0x7f15ac06e2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.891+0000 7f15d0e53640 1 --2- 172.21.15.79:0/652838206 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15cc0cf7a0 0x7f15cc0cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.891+0000 7f15d0e53640 1 --2- 172.21.15.79:0/652838206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15cc06e6b0 0x7f15cc09abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.891+0000 7f15d0e53640 1 --2- 172.21.15.79:0/652838206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15cc06b2f0 0x7f15cc0ae880 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:49.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.891+0000 7f15d0e53640 1 -- 172.21.15.79:0/652838206 >> 172.21.15.79:0/652838206 conn(0x7f15cc0b1cd0 msgr2=0x7f15cc0ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:49.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.891+0000 7f15d0e53640 1 -- 172.21.15.79:0/652838206 shutdown_connections 2024-04-25T02:08:49.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:49.891+0000 7f15d0e53640 1 -- 172.21.15.79:0/652838206 wait complete. 2024-04-25T02:08:49.909 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T02:08:49.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T02:08:50.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.000+0000 7f1024112640 1 Processor -- start 2024-04-25T02:08:50.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.000+0000 7f1024112640 1 -- start start 2024-04-25T02:08:50.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.001+0000 7f1024112640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f101c0d10c0 0x7f101c06bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:50.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.001+0000 7f1024112640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101c0d1ee0 con 0x7f101c15e4f0 2024-04-25T02:08:50.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.001+0000 7f1024112640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101c0d21c0 con 0x7f101c0d2ca0 2024-04-25T02:08:50.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.001+0000 7f1024112640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f101c0d3130 con 0x7f101c0d10c0 2024-04-25T02:08:50.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.001+0000 7f1021eae640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f101c15e4f0 0x7f101c0cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35616/0 (socket says 172.21.15.79:35616) 2024-04-25T02:08:50.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.001+0000 7f1021eae640 1 -- 172.21.15.79:0/4217550831 learned_addr learned my addr 172.21.15.79:0/4217550831 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:50.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1020eac640 1 -- 172.21.15.79:0/4217550831 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1407099423 0 0) 0x7f101c0d1ee0 con 0x7f101c15e4f0 2024-04-25T02:08:50.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1020eac640 1 -- 172.21.15.79:0/4217550831 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1008003520 con 0x7f101c15e4f0 2024-04-25T02:08:50.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f10226af640 1 --2- 172.21.15.79:0/4217550831 >> v2:172.21.15.189:3300/0 conn(0x7f101c0d10c0 0x7f101c06bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:50.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1020eac640 1 -- 172.21.15.79:0/4217550831 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1244230558 0 0) 0x7f1008003520 con 0x7f101c15e4f0 2024-04-25T02:08:50.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1020eac640 1 -- 172.21.15.79:0/4217550831 >> v2:172.21.15.189:3300/0 conn(0x7f101c0d10c0 msgr2=0x7f101c06bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:50.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1020eac640 1 --2- 172.21.15.79:0/4217550831 >> v2:172.21.15.189:3300/0 conn(0x7f101c0d10c0 0x7f101c06bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1020eac640 1 -- 172.21.15.79:0/4217550831 >> v1:172.21.15.189:6789/0 conn(0x7f101c0d2ca0 legacy=0x7f101c0d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1020eac640 1 -- 172.21.15.79:0/4217550831 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c0d24a0 con 0x7f101c15e4f0 2024-04-25T02:08:50.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1020eac640 1 -- 172.21.15.79:0/4217550831 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f10180019f0 con 0x7f101c15e4f0 2024-04-25T02:08:50.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1020eac640 1 -- 172.21.15.79:0/4217550831 >> v1:172.21.15.79:6789/0 conn(0x7f101c15e4f0 legacy=0x7f101c0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1020eac640 1 --2- 172.21.15.79:0/4217550831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10080039b0 0x7f1008003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1020eac640 1 --2- 172.21.15.79:0/4217550831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1008004800 0x7f1008004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1020eac640 1 --2- 172.21.15.79:0/4217550831 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10080051c0 0x7f100800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1020eac640 1 -- 172.21.15.79:0/4217550831 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f100800c030 con 0x7f1008004800 2024-04-25T02:08:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1020eac640 1 -- 172.21.15.79:0/4217550831 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f100800c1e0 con 0x7f10080039b0 2024-04-25T02:08:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1020eac640 1 -- 172.21.15.79:0/4217550831 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f100800c3e0 con 0x7f10080051c0 2024-04-25T02:08:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f10216ad640 1 --2- 172.21.15.79:0/4217550831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1008004800 0x7f1008004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f1021eae640 1 --2- 172.21.15.79:0/4217550831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10080039b0 0x7f1008003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f10226af640 1 --2- 172.21.15.79:0/4217550831 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10080051c0 0x7f100800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f10216ad640 1 -- 172.21.15.79:0/4217550831 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10080051c0 msgr2=0x7f100800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f10216ad640 1 --2- 172.21.15.79:0/4217550831 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10080051c0 0x7f100800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f10216ad640 1 -- 172.21.15.79:0/4217550831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10080039b0 msgr2=0x7f1008003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f10216ad640 1 --2- 172.21.15.79:0/4217550831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10080039b0 0x7f1008003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f10216ad640 1 -- 172.21.15.79:0/4217550831 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1008003520 con 0x7f1008004800 2024-04-25T02:08:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f10226af640 1 --2- 172.21.15.79:0/4217550831 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10080051c0 0x7f100800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.002+0000 7f10226af640 1 -- 172.21.15.79:0/4217550831 reap_dead start 2024-04-25T02:08:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.003+0000 7f10216ad640 1 --2- 172.21.15.79:0/4217550831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1008004800 0x7f1008004c80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f100c001770 tx=0x7f1008005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939b503324f1aab1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.003+0000 7f1020eac640 1 -- 172.21.15.79:0/4217550831 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c001390 con 0x7f1008004800 2024-04-25T02:08:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.003+0000 7f1020eac640 1 -- 172.21.15.79:0/4217550831 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100c0052d0 con 0x7f1008004800 2024-04-25T02:08:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.003+0000 7f1020eac640 1 -- 172.21.15.79:0/4217550831 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c02ab00 con 0x7f1008004800 2024-04-25T02:08:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.004+0000 7f1024112640 1 -- 172.21.15.79:0/4217550831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1008004800 msgr2=0x7f1008004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.004+0000 7f1024112640 1 --2- 172.21.15.79:0/4217550831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1008004800 0x7f1008004c80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f100c001770 tx=0x7f1008005830 comp rx=0 tx=0).stop 2024-04-25T02:08:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.004+0000 7f1024112640 1 -- 172.21.15.79:0/4217550831 shutdown_connections 2024-04-25T02:08:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.004+0000 7f1024112640 1 --2- 172.21.15.79:0/4217550831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1008004800 0x7f1008004c80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.004+0000 7f1024112640 1 -- 172.21.15.79:0/4217550831 >> 172.21.15.79:0/4217550831 conn(0x7f101c09d4a0 msgr2=0x7f101c0d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.004+0000 7f1024112640 1 -- 172.21.15.79:0/4217550831 shutdown_connections 2024-04-25T02:08:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.004+0000 7f1024112640 1 -- 172.21.15.79:0/4217550831 wait complete. 2024-04-25T02:08:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.005+0000 7f1024112640 1 Processor -- start 2024-04-25T02:08:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.005+0000 7f1024112640 1 -- start start 2024-04-25T02:08:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f1024112640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1008004800 0x7f101c0a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f1024112640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f101c1f5150 0x7f101c0c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f1024112640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f101c0ca020 0x7f101c0ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f1024112640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f101c0d5060 con 0x7f101c0ca020 2024-04-25T02:08:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f1024112640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f101c0d4ee0 con 0x7f1008004800 2024-04-25T02:08:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f1024112640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f101c0d09b0 con 0x7f101c1f5150 2024-04-25T02:08:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f10226af640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f101c0ca020 0x7f101c0ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f10226af640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f101c0ca020 0x7f101c0ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60142/0 (socket says 172.21.15.79:60142) 2024-04-25T02:08:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f10226af640 1 -- 172.21.15.79:0/2668136510 learned_addr learned my addr 172.21.15.79:0/2668136510 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f1021eae640 1 --2- 172.21.15.79:0/2668136510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1008004800 0x7f101c0a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f10216ad640 1 --2- 172.21.15.79:0/2668136510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f101c1f5150 0x7f101c0c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f10226af640 1 -- 172.21.15.79:0/2668136510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f101c1f5150 msgr2=0x7f101c0c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f10226af640 1 --2- 172.21.15.79:0/2668136510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f101c1f5150 0x7f101c0c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f10226af640 1 -- 172.21.15.79:0/2668136510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1008004800 msgr2=0x7f101c0a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f10226af640 1 --2- 172.21.15.79:0/2668136510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1008004800 0x7f101c0a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f10226af640 1 -- 172.21.15.79:0/2668136510 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c0c81e0 con 0x7f101c0ca020 2024-04-25T02:08:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f10216ad640 1 --2- 172.21.15.79:0/2668136510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f101c1f5150 0x7f101c0c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f10226af640 1 --2- 172.21.15.79:0/2668136510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f101c0ca020 0x7f101c0ca4a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f101c08e440 tx=0x7f1014011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f10127fc640 1 -- 172.21.15.79:0/2668136510 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1014019020 con 0x7f101c0ca020 2024-04-25T02:08:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f10127fc640 1 -- 172.21.15.79:0/2668136510 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1014004440 con 0x7f101c0ca020 2024-04-25T02:08:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f1024112640 1 -- 172.21.15.79:0/2668136510 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101c0c84b0 con 0x7f101c0ca020 2024-04-25T02:08:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f10127fc640 1 -- 172.21.15.79:0/2668136510 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1014003850 con 0x7f101c0ca020 2024-04-25T02:08:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.006+0000 7f1024112640 1 -- 172.21.15.79:0/2668136510 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f101c0c8a70 con 0x7f101c0ca020 2024-04-25T02:08:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.007+0000 7f1024112640 1 -- 172.21.15.79:0/2668136510 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f101c0686c0 con 0x7f101c0ca020 2024-04-25T02:08:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.008+0000 7f10127fc640 1 -- 172.21.15.79:0/2668136510 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f101401c020 con 0x7f101c0ca020 2024-04-25T02:08:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.008+0000 7f10127fc640 1 --2- 172.21.15.79:0/2668136510 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f100006be60 0x7f100006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.008+0000 7f10127fc640 1 -- 172.21.15.79:0/2668136510 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f101408afe0 con 0x7f101c0ca020 2024-04-25T02:08:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.008+0000 7f1021eae640 1 --2- 172.21.15.79:0/2668136510 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f100006be60 0x7f100006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.009+0000 7f1021eae640 1 --2- 172.21.15.79:0/2668136510 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f100006be60 0x7f100006e320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f101c0b98f0 tx=0x7f1018006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:50.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.013+0000 7f10127fc640 1 -- 172.21.15.79:0/2668136510 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1014023030 con 0x7f101c0ca020 2024-04-25T02:08:50.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.226+0000 7f1024112640 1 -- 172.21.15.79:0/2668136510 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f101c0690a0 con 0x7f101c0ca020 2024-04-25T02:08:50.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.893+0000 7f10127fc640 1 -- 172.21.15.79:0/2668136510 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f1014059a20 con 0x7f101c0ca020 2024-04-25T02:08:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.896+0000 7f1024112640 1 -- 172.21.15.79:0/2668136510 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f100006be60 msgr2=0x7f100006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.896+0000 7f1024112640 1 --2- 172.21.15.79:0/2668136510 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f100006be60 0x7f100006e320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f101c0b98f0 tx=0x7f1018006040 comp rx=0 tx=0).stop 2024-04-25T02:08:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.896+0000 7f1024112640 1 -- 172.21.15.79:0/2668136510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f101c0ca020 msgr2=0x7f101c0ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.896+0000 7f1024112640 1 --2- 172.21.15.79:0/2668136510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f101c0ca020 0x7f101c0ca4a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f101c08e440 tx=0x7f1014011920 comp rx=0 tx=0).stop 2024-04-25T02:08:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.896+0000 7f1024112640 1 -- 172.21.15.79:0/2668136510 shutdown_connections 2024-04-25T02:08:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.896+0000 7f1024112640 1 --2- 172.21.15.79:0/2668136510 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f100006be60 0x7f100006e320 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.896+0000 7f1024112640 1 --2- 172.21.15.79:0/2668136510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f101c0ca020 0x7f101c0ca4a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.896+0000 7f1024112640 1 --2- 172.21.15.79:0/2668136510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f101c1f5150 0x7f101c0c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.896+0000 7f1024112640 1 --2- 172.21.15.79:0/2668136510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1008004800 0x7f101c0a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.896+0000 7f1024112640 1 -- 172.21.15.79:0/2668136510 >> 172.21.15.79:0/2668136510 conn(0x7f101c09d4a0 msgr2=0x7f101c06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.896+0000 7f1024112640 1 -- 172.21.15.79:0/2668136510 shutdown_connections 2024-04-25T02:08:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:50.897+0000 7f1024112640 1 -- 172.21.15.79:0/2668136510 wait complete. 2024-04-25T02:08:50.917 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T02:08:50.917 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:08:51.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.014+0000 7f5337ba9640 1 Processor -- start 2024-04-25T02:08:51.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.014+0000 7f5337ba9640 1 -- start start 2024-04-25T02:08:51.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.015+0000 7f5337ba9640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5330143bc0 0x7f533015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.015+0000 7f5337ba9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53300b3d40 0x7f533006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.015+0000 7f5337ba9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f533015fa40 con 0x7f533006df50 2024-04-25T02:08:51.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.015+0000 7f5337ba9640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f533006e8f0 con 0x7f5330143bc0 2024-04-25T02:08:51.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.015+0000 7f5337ba9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5330072cb0 con 0x7f53300b3d40 2024-04-25T02:08:51.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.015+0000 7f5335945640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5330143bc0 0x7f533015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.015+0000 7f5336146640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53300b3d40 0x7f533006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.015+0000 7f5335945640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5330143bc0 0x7f533015f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:35588/0 (socket says 172.21.15.79:35588) 2024-04-25T02:08:51.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.015+0000 7f5335945640 1 -- 172.21.15.79:0/1023493509 learned_addr learned my addr 172.21.15.79:0/1023493509 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:51.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.015+0000 7f5335144640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f533006df50 0x7f53300b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:55720/0 (socket says 172.21.15.79:55720) 2024-04-25T02:08:51.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.015+0000 7f5335945640 1 -- 172.21.15.79:0/1023493509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53300b3d40 msgr2=0x7f533006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:51.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.015+0000 7f5335945640 1 --2- 172.21.15.79:0/1023493509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53300b3d40 0x7f533006e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.015+0000 7f5335945640 1 -- 172.21.15.79:0/1023493509 >> v1:172.21.15.189:6789/0 conn(0x7f533006df50 legacy=0x7f53300b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.015+0000 7f5335945640 1 -- 172.21.15.79:0/1023493509 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5330071e00 con 0x7f5330143bc0 2024-04-25T02:08:51.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.015+0000 7f5336146640 1 --2- 172.21.15.79:0/1023493509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53300b3d40 0x7f533006e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.016+0000 7f5335945640 1 --2- 172.21.15.79:0/1023493509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5330143bc0 0x7f533015f500 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f532c00bb10 tx=0x7f532c02c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30b1155fb120c159 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.016+0000 7f5334943640 1 -- 172.21.15.79:0/1023493509 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c032790 con 0x7f5330143bc0 2024-04-25T02:08:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.016+0000 7f5334943640 1 -- 172.21.15.79:0/1023493509 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532c038070 con 0x7f5330143bc0 2024-04-25T02:08:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.016+0000 7f5334943640 1 -- 172.21.15.79:0/1023493509 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c032b50 con 0x7f5330143bc0 2024-04-25T02:08:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.017+0000 7f5337ba9640 1 -- 172.21.15.79:0/1023493509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5330143bc0 msgr2=0x7f533015f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.017+0000 7f5337ba9640 1 --2- 172.21.15.79:0/1023493509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5330143bc0 0x7f533015f500 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f532c00bb10 tx=0x7f532c02c890 comp rx=0 tx=0).stop 2024-04-25T02:08:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.017+0000 7f5337ba9640 1 -- 172.21.15.79:0/1023493509 shutdown_connections 2024-04-25T02:08:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.017+0000 7f5337ba9640 1 --2- 172.21.15.79:0/1023493509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53300b3d40 0x7f533006e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.017+0000 7f5337ba9640 1 --2- 172.21.15.79:0/1023493509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5330143bc0 0x7f533015f500 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.017+0000 7f5337ba9640 1 -- 172.21.15.79:0/1023493509 >> 172.21.15.79:0/1023493509 conn(0x7f53300cfc80 msgr2=0x7f53300d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.017+0000 7f5337ba9640 1 -- 172.21.15.79:0/1023493509 shutdown_connections 2024-04-25T02:08:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.017+0000 7f5337ba9640 1 -- 172.21.15.79:0/1023493509 wait complete. 2024-04-25T02:08:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.018+0000 7f5337ba9640 1 Processor -- start 2024-04-25T02:08:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.018+0000 7f5337ba9640 1 -- start start 2024-04-25T02:08:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5337ba9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533006df50 0x7f533013f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5337ba9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53300b3d40 0x7f53300ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5337ba9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5330143bc0 0x7f53300aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5337ba9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5330072660 con 0x7f533006df50 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5337ba9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5330072380 con 0x7f5330143bc0 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5337ba9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5330072940 con 0x7f53300b3d40 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5335945640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533006df50 0x7f533013f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5335945640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533006df50 0x7f533013f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60148/0 (socket says 172.21.15.79:60148) 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5335945640 1 -- 172.21.15.79:0/2932720020 learned_addr learned my addr 172.21.15.79:0/2932720020 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5335144640 1 --2- 172.21.15.79:0/2932720020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53300b3d40 0x7f53300ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5336146640 1 --2- 172.21.15.79:0/2932720020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5330143bc0 0x7f53300aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5335945640 1 -- 172.21.15.79:0/2932720020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53300b3d40 msgr2=0x7f53300ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5335945640 1 --2- 172.21.15.79:0/2932720020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53300b3d40 0x7f53300ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5335945640 1 -- 172.21.15.79:0/2932720020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5330143bc0 msgr2=0x7f53300aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5335945640 1 --2- 172.21.15.79:0/2932720020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5330143bc0 0x7f53300aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5335945640 1 -- 172.21.15.79:0/2932720020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53300a9fe0 con 0x7f533006df50 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.019+0000 7f5335945640 1 --2- 172.21.15.79:0/2932720020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533006df50 0x7f533013f570 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f532c000c00 tx=0x7f532c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.020+0000 7f53267fc640 1 -- 172.21.15.79:0/2932720020 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c033620 con 0x7f533006df50 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.020+0000 7f53267fc640 1 -- 172.21.15.79:0/2932720020 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532c033800 con 0x7f533006df50 2024-04-25T02:08:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.020+0000 7f53267fc640 1 -- 172.21.15.79:0/2932720020 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c033bf0 con 0x7f533006df50 2024-04-25T02:08:51.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.020+0000 7f5337ba9640 1 -- 172.21.15.79:0/2932720020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53300aa2c0 con 0x7f533006df50 2024-04-25T02:08:51.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.020+0000 7f5337ba9640 1 -- 172.21.15.79:0/2932720020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53300aa880 con 0x7f533006df50 2024-04-25T02:08:51.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.020+0000 7f5337ba9640 1 -- 172.21.15.79:0/2932720020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f533015dac0 con 0x7f533006df50 2024-04-25T02:08:51.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.021+0000 7f53267fc640 1 -- 172.21.15.79:0/2932720020 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f532c04d060 con 0x7f533006df50 2024-04-25T02:08:51.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.021+0000 7f53267fc640 1 --2- 172.21.15.79:0/2932720020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f531406be60 0x7f531406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.021+0000 7f5335144640 1 --2- 172.21.15.79:0/2932720020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f531406be60 0x7f531406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.021+0000 7f53267fc640 1 -- 172.21.15.79:0/2932720020 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f532c0ad950 con 0x7f533006df50 2024-04-25T02:08:51.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.022+0000 7f5335144640 1 --2- 172.21.15.79:0/2932720020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f531406be60 0x7f531406e320 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f53301f3130 tx=0x7f5320007ce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.026+0000 7f53267fc640 1 -- 172.21.15.79:0/2932720020 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f533015dac0 con 0x7f533006df50 2024-04-25T02:08:51.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.236+0000 7f5337ba9640 1 -- 172.21.15.79:0/2932720020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5330143fa0 con 0x7f533006df50 2024-04-25T02:08:51.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.236+0000 7f53267fc640 1 -- 172.21.15.79:0/2932720020 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+5181 (secure 0 0 0) 0x7f532c041070 con 0x7f533006df50 2024-04-25T02:08:51.244 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:51.244 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2251520552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2251520552},{"type":"v1","addr":"172.21.15.79:6836","nonce":2251520552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/1462215746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":1462215746},{"type":"v1","addr":"172.21.15.79:6837","nonce":1462215746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/2359417586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2359417586},{"type":"v1","addr":"172.21.15.189:6834","nonce":2359417586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:08:48.219535+0000","modified":"2024-04-25T02:08:50.227642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6835/605900869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":605900869},{"type":"v1","addr":"172.21.15.189:6835","nonce":605900869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5112,"qdb_cluster":[5112]},"id":2}]} 2024-04-25T02:08:51.244 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 12 2024-04-25T02:08:51.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.238+0000 7f5337ba9640 1 -- 172.21.15.79:0/2932720020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f531406be60 msgr2=0x7f531406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.238+0000 7f5337ba9640 1 --2- 172.21.15.79:0/2932720020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f531406be60 0x7f531406e320 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f53301f3130 tx=0x7f5320007ce0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.238+0000 7f5337ba9640 1 -- 172.21.15.79:0/2932720020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533006df50 msgr2=0x7f533013f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.238+0000 7f5337ba9640 1 --2- 172.21.15.79:0/2932720020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533006df50 0x7f533013f570 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f532c000c00 tx=0x7f532c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.238+0000 7f5337ba9640 1 -- 172.21.15.79:0/2932720020 shutdown_connections 2024-04-25T02:08:51.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.238+0000 7f5337ba9640 1 --2- 172.21.15.79:0/2932720020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f531406be60 0x7f531406e320 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.238+0000 7f5337ba9640 1 --2- 172.21.15.79:0/2932720020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5330143bc0 0x7f53300aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.238+0000 7f5337ba9640 1 --2- 172.21.15.79:0/2932720020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53300b3d40 0x7f53300ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.238+0000 7f5337ba9640 1 --2- 172.21.15.79:0/2932720020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533006df50 0x7f533013f570 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.239+0000 7f5337ba9640 1 -- 172.21.15.79:0/2932720020 >> 172.21.15.79:0/2932720020 conn(0x7f53300cfc80 msgr2=0x7f53300b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:51.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.239+0000 7f5337ba9640 1 -- 172.21.15.79:0/2932720020 shutdown_connections 2024-04-25T02:08:51.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.239+0000 7f5337ba9640 1 -- 172.21.15.79:0/2932720020 wait complete. 2024-04-25T02:08:51.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:51.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.346+0000 7f20b5da2640 1 Processor -- start 2024-04-25T02:08:51.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.346+0000 7f20b5da2640 1 -- start start 2024-04-25T02:08:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.347+0000 7f20b5da2640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f20b015e4d0 0x7f20b006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.347+0000 7f20b5da2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b00d1660 con 0x7f20b00b3570 2024-04-25T02:08:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.347+0000 7f20b5da2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b00d1380 con 0x7f20b00d2e20 2024-04-25T02:08:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.347+0000 7f20b5da2640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f20b00cede0 con 0x7f20b015e4d0 2024-04-25T02:08:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.347+0000 7f20aeffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f20b00b3570 0x7f20b00d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35630/0 (socket says 172.21.15.79:35630) 2024-04-25T02:08:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.347+0000 7f20aeffd640 1 -- 172.21.15.79:0/1676008050 learned_addr learned my addr 172.21.15.79:0/1676008050 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20af7fe640 1 --2- 172.21.15.79:0/1676008050 >> v2:172.21.15.189:3300/0 conn(0x7f20b015e4d0 0x7f20b006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1676008050 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403148941 0 0) 0x7f20b00d1660 con 0x7f20b00b3570 2024-04-25T02:08:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1676008050 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f209c003520 con 0x7f20b00b3570 2024-04-25T02:08:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1676008050 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3966622446 0 0) 0x7f209c003520 con 0x7f20b00b3570 2024-04-25T02:08:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1676008050 >> v2:172.21.15.189:3300/0 conn(0x7f20b015e4d0 msgr2=0x7f20b006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20ae7fc640 1 --2- 172.21.15.79:0/1676008050 >> v2:172.21.15.189:3300/0 conn(0x7f20b015e4d0 0x7f20b006bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1676008050 >> v1:172.21.15.189:6789/0 conn(0x7f20b00d2e20 legacy=0x7f20b00cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1676008050 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b00cf0c0 con 0x7f20b00b3570 2024-04-25T02:08:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1676008050 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f2098001670 con 0x7f20b00b3570 2024-04-25T02:08:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1676008050 >> v1:172.21.15.79:6789/0 conn(0x7f20b00b3570 legacy=0x7f20b00d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20ae7fc640 1 --2- 172.21.15.79:0/1676008050 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f209c0039b0 0x7f209c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20ae7fc640 1 --2- 172.21.15.79:0/1676008050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f209c004800 0x7f209c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20ae7fc640 1 --2- 172.21.15.79:0/1676008050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209c0051c0 0x7f209c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1676008050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f20b00cede0 con 0x7f209c0051c0 2024-04-25T02:08:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1676008050 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f209c00c060 con 0x7f209c004800 2024-04-25T02:08:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1676008050 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f209c00c260 con 0x7f209c0039b0 2024-04-25T02:08:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20affff640 1 --2- 172.21.15.79:0/1676008050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209c0051c0 0x7f209c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20aeffd640 1 --2- 172.21.15.79:0/1676008050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f209c004800 0x7f209c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20af7fe640 1 --2- 172.21.15.79:0/1676008050 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f209c0039b0 0x7f209c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20affff640 1 -- 172.21.15.79:0/1676008050 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f209c0039b0 msgr2=0x7f209c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20affff640 1 --2- 172.21.15.79:0/1676008050 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f209c0039b0 0x7f209c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20affff640 1 -- 172.21.15.79:0/1676008050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f209c004800 msgr2=0x7f209c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20affff640 1 --2- 172.21.15.79:0/1676008050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f209c004800 0x7f209c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.348+0000 7f20affff640 1 -- 172.21.15.79:0/1676008050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c003520 con 0x7f209c0051c0 2024-04-25T02:08:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.349+0000 7f20affff640 1 -- 172.21.15.79:0/1676008050 reap_dead start 2024-04-25T02:08:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.349+0000 7f20affff640 1 --2- 172.21.15.79:0/1676008050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209c0051c0 0x7f209c00b9c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f20b00679f0 tx=0x7f209c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a84e9b7ae061aa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.349+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1676008050 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8001370 con 0x7f209c0051c0 2024-04-25T02:08:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.349+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1676008050 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a80052d0 con 0x7f209c0051c0 2024-04-25T02:08:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.349+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1676008050 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a802ab90 con 0x7f209c0051c0 2024-04-25T02:08:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.350+0000 7f20b5da2640 1 -- 172.21.15.79:0/1676008050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209c0051c0 msgr2=0x7f209c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.350+0000 7f20b5da2640 1 --2- 172.21.15.79:0/1676008050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209c0051c0 0x7f209c00b9c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f20b00679f0 tx=0x7f209c005830 comp rx=0 tx=0).stop 2024-04-25T02:08:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.350+0000 7f20b5da2640 1 -- 172.21.15.79:0/1676008050 shutdown_connections 2024-04-25T02:08:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.350+0000 7f20b5da2640 1 --2- 172.21.15.79:0/1676008050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209c0051c0 0x7f209c00b9c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.350+0000 7f20b5da2640 1 -- 172.21.15.79:0/1676008050 >> 172.21.15.79:0/1676008050 conn(0x7f20b009d460 msgr2=0x7f20b00d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.350+0000 7f20b5da2640 1 -- 172.21.15.79:0/1676008050 shutdown_connections 2024-04-25T02:08:51.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.350+0000 7f20b5da2640 1 -- 172.21.15.79:0/1676008050 wait complete. 2024-04-25T02:08:51.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.351+0000 7f20b5da2640 1 Processor -- start 2024-04-25T02:08:51.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.351+0000 7f20b5da2640 1 -- start start 2024-04-25T02:08:51.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20b5da2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f209c0051c0 0x7f20b0152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20b5da2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b01f7eb0 0x7f20b01f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20b5da2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20b01f77e0 0x7f20b01471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20b5da2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f20b00d2250 con 0x7f20b01f7eb0 2024-04-25T02:08:51.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20b5da2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f20b00d20d0 con 0x7f20b01f77e0 2024-04-25T02:08:51.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20b5da2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f20b00b3020 con 0x7f209c0051c0 2024-04-25T02:08:51.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20aeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b01f7eb0 0x7f20b01f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20aeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b01f7eb0 0x7f20b01f72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60170/0 (socket says 172.21.15.79:60170) 2024-04-25T02:08:51.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20aeffd640 1 -- 172.21.15.79:0/2288500610 learned_addr learned my addr 172.21.15.79:0/2288500610 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:51.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20affff640 1 --2- 172.21.15.79:0/2288500610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20b01f77e0 0x7f20b01471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20af7fe640 1 --2- 172.21.15.79:0/2288500610 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f209c0051c0 0x7f20b0152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20aeffd640 1 -- 172.21.15.79:0/2288500610 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f209c0051c0 msgr2=0x7f20b0152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20aeffd640 1 --2- 172.21.15.79:0/2288500610 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f209c0051c0 0x7f20b0152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20aeffd640 1 -- 172.21.15.79:0/2288500610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20b01f77e0 msgr2=0x7f20b01471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20aeffd640 1 --2- 172.21.15.79:0/2288500610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20b01f77e0 0x7f20b01471d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20aeffd640 1 -- 172.21.15.79:0/2288500610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b01557c0 con 0x7f20b01f7eb0 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20affff640 1 --2- 172.21.15.79:0/2288500610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20b01f77e0 0x7f20b01471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20aeffd640 1 --2- 172.21.15.79:0/2288500610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b01f7eb0 0x7f20b01f72a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f20980072c0 tx=0x7f2098007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.352+0000 7f20a7fff640 1 -- 172.21.15.79:0/2288500610 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209800f8e0 con 0x7f20b01f7eb0 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.353+0000 7f20a7fff640 1 -- 172.21.15.79:0/2288500610 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2098018070 con 0x7f20b01f7eb0 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.353+0000 7f20b5da2640 1 -- 172.21.15.79:0/2288500610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b0155aa0 con 0x7f20b01f7eb0 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.353+0000 7f20a7fff640 1 -- 172.21.15.79:0/2288500610 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209800fce0 con 0x7f20b01f7eb0 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.353+0000 7f20b5da2640 1 -- 172.21.15.79:0/2288500610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b01533a0 con 0x7f20b01f7eb0 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.354+0000 7f20b5da2640 1 -- 172.21.15.79:0/2288500610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b0156160 con 0x7f20b01f7eb0 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.354+0000 7f20a7fff640 1 -- 172.21.15.79:0/2288500610 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f209801d460 con 0x7f20b01f7eb0 2024-04-25T02:08:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.354+0000 7f20a7fff640 1 --2- 172.21.15.79:0/2288500610 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f209006be30 0x7f209006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.354+0000 7f20af7fe640 1 --2- 172.21.15.79:0/2288500610 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f209006be30 0x7f209006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.354+0000 7f20a7fff640 1 -- 172.21.15.79:0/2288500610 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f209808ae80 con 0x7f20b01f7eb0 2024-04-25T02:08:51.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.355+0000 7f20af7fe640 1 --2- 172.21.15.79:0/2288500610 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f209006be30 0x7f209006e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009fd0 tx=0x7f20a000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.359+0000 7f20a7fff640 1 -- 172.21.15.79:0/2288500610 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f20b0156160 con 0x7f20b01f7eb0 2024-04-25T02:08:51.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.533+0000 7f20b5da2640 1 -- 172.21.15.79:0/2288500610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20b01f7bf0 con 0x7f20b01f7eb0 2024-04-25T02:08:51.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.534+0000 7f20a7fff640 1 -- 172.21.15.79:0/2288500610 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16681 (secure 0 0 0) 0x7f20b01f7bf0 con 0x7f20b01f7eb0 2024-04-25T02:08:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:51.541 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":33,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:49.884423+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:08:46.063839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T02:08:47.254948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:51.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.536+0000 7f20b5da2640 1 -- 172.21.15.79:0/2288500610 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f209006be30 msgr2=0x7f209006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.536+0000 7f20b5da2640 1 --2- 172.21.15.79:0/2288500610 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f209006be30 0x7f209006e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009fd0 tx=0x7f20a000b040 comp rx=0 tx=0).stop 2024-04-25T02:08:51.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.536+0000 7f20b5da2640 1 -- 172.21.15.79:0/2288500610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b01f7eb0 msgr2=0x7f20b01f72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.536+0000 7f20b5da2640 1 --2- 172.21.15.79:0/2288500610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b01f7eb0 0x7f20b01f72a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f20980072c0 tx=0x7f2098007780 comp rx=0 tx=0).stop 2024-04-25T02:08:51.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.536+0000 7f20b5da2640 1 -- 172.21.15.79:0/2288500610 shutdown_connections 2024-04-25T02:08:51.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.536+0000 7f20b5da2640 1 --2- 172.21.15.79:0/2288500610 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f209006be30 0x7f209006e2f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.536+0000 7f20b5da2640 1 --2- 172.21.15.79:0/2288500610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20b01f77e0 0x7f20b01471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.536+0000 7f20b5da2640 1 --2- 172.21.15.79:0/2288500610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b01f7eb0 0x7f20b01f72a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.536+0000 7f20b5da2640 1 --2- 172.21.15.79:0/2288500610 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f209c0051c0 0x7f20b0152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.536+0000 7f20b5da2640 1 -- 172.21.15.79:0/2288500610 >> 172.21.15.79:0/2288500610 conn(0x7f20b009d460 msgr2=0x7f20b006c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:51.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.536+0000 7f20b5da2640 1 -- 172.21.15.79:0/2288500610 shutdown_connections 2024-04-25T02:08:51.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.536+0000 7f20b5da2640 1 -- 172.21.15.79:0/2288500610 wait complete. 2024-04-25T02:08:51.554 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T02:08:51.554 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:08:51.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.643+0000 7f53c7e2c640 1 Processor -- start 2024-04-25T02:08:51.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.643+0000 7f53c7e2c640 1 -- start start 2024-04-25T02:08:51.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.644+0000 7f53c7e2c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f53c006df50 0x7f53c006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.644+0000 7f53c7e2c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53c00b2d30 0x7f53c00b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.644+0000 7f53c7e2c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c0071e00 con 0x7f53c0143bc0 2024-04-25T02:08:51.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.644+0000 7f53c7e2c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f53c006e8f0 con 0x7f53c006df50 2024-04-25T02:08:51.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.644+0000 7f53c7e2c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f53c0072cb0 con 0x7f53c00b2d30 2024-04-25T02:08:51.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.644+0000 7f53c5bc8640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f53c0143bc0 0x7f53c015f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35636/0 (socket says 172.21.15.79:35636) 2024-04-25T02:08:51.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.644+0000 7f53c5bc8640 1 -- 172.21.15.79:0/2517872896 learned_addr learned my addr 172.21.15.79:0/2517872896 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:51.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.644+0000 7f53c53c7640 1 --2- 172.21.15.79:0/2517872896 >> v2:172.21.15.189:3300/0 conn(0x7f53c006df50 0x7f53c006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c63c9640 1 --2- 172.21.15.79:0/2517872896 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53c00b2d30 0x7f53c00b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 -- 172.21.15.79:0/2517872896 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1965673103 0 0) 0x7f53c0071e00 con 0x7f53c0143bc0 2024-04-25T02:08:51.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 -- 172.21.15.79:0/2517872896 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53ac003520 con 0x7f53c0143bc0 2024-04-25T02:08:51.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 -- 172.21.15.79:0/2517872896 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3288563554 0 0) 0x7f53ac003520 con 0x7f53c0143bc0 2024-04-25T02:08:51.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 -- 172.21.15.79:0/2517872896 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53c00b2d30 msgr2=0x7f53c00b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:51.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 --2- 172.21.15.79:0/2517872896 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53c00b2d30 0x7f53c00b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 -- 172.21.15.79:0/2517872896 >> v2:172.21.15.189:3300/0 conn(0x7f53c006df50 msgr2=0x7f53c006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:51.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 --2- 172.21.15.79:0/2517872896 >> v2:172.21.15.189:3300/0 conn(0x7f53c006df50 0x7f53c006e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 -- 172.21.15.79:0/2517872896 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c00720a0 con 0x7f53c0143bc0 2024-04-25T02:08:51.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 -- 172.21.15.79:0/2517872896 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f53bc001670 con 0x7f53c0143bc0 2024-04-25T02:08:51.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c53c7640 1 --2- 172.21.15.79:0/2517872896 >> v2:172.21.15.189:3300/0 conn(0x7f53c006df50 0x7f53c006e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:51.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 -- 172.21.15.79:0/2517872896 >> v1:172.21.15.79:6789/0 conn(0x7f53c0143bc0 legacy=0x7f53c015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 --2- 172.21.15.79:0/2517872896 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53c00b2d30 0x7f53ac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 --2- 172.21.15.79:0/2517872896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53ac003f30 0x7f53ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 --2- 172.21.15.79:0/2517872896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53ac004d40 0x7f53ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 -- 172.21.15.79:0/2517872896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f53c0072cb0 con 0x7f53ac003f30 2024-04-25T02:08:51.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 -- 172.21.15.79:0/2517872896 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac00b9c0 con 0x7f53ac004d40 2024-04-25T02:08:51.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c4bc6640 1 -- 172.21.15.79:0/2517872896 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f53ac00dda0 con 0x7f53c00b2d30 2024-04-25T02:08:51.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c53c7640 1 --2- 172.21.15.79:0/2517872896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53ac003f30 0x7f53ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c5bc8640 1 --2- 172.21.15.79:0/2517872896 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53c00b2d30 0x7f53ac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c63c9640 1 --2- 172.21.15.79:0/2517872896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53ac004d40 0x7f53ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c53c7640 1 -- 172.21.15.79:0/2517872896 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53c00b2d30 msgr2=0x7f53ac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:51.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c53c7640 1 --2- 172.21.15.79:0/2517872896 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53c00b2d30 0x7f53ac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c53c7640 1 -- 172.21.15.79:0/2517872896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53ac004d40 msgr2=0x7f53ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:51.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c53c7640 1 --2- 172.21.15.79:0/2517872896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53ac004d40 0x7f53ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c53c7640 1 -- 172.21.15.79:0/2517872896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac003520 con 0x7f53ac003f30 2024-04-25T02:08:51.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.645+0000 7f53c63c9640 1 --2- 172.21.15.79:0/2517872896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53ac004d40 0x7f53ac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:51.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.646+0000 7f53c53c7640 1 --2- 172.21.15.79:0/2517872896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53ac003f30 0x7f53ac004800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009cc0 tx=0x7f53ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfdda76a82f2c83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.646+0000 7f53c4bc6640 1 -- 172.21.15.79:0/2517872896 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0036070 con 0x7f53ac003f30 2024-04-25T02:08:51.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.646+0000 7f53c4bc6640 1 -- 172.21.15.79:0/2517872896 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b0031400 con 0x7f53ac003f30 2024-04-25T02:08:51.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.646+0000 7f53c4bc6640 1 -- 172.21.15.79:0/2517872896 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0009860 con 0x7f53ac003f30 2024-04-25T02:08:51.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.647+0000 7f53c7e2c640 1 -- 172.21.15.79:0/2517872896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53ac003f30 msgr2=0x7f53ac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.647+0000 7f53c7e2c640 1 --2- 172.21.15.79:0/2517872896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53ac003f30 0x7f53ac004800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009cc0 tx=0x7f53ac005830 comp rx=0 tx=0).stop 2024-04-25T02:08:51.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.647+0000 7f53c63c9640 1 -- 172.21.15.79:0/2517872896 reap_dead start 2024-04-25T02:08:51.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.647+0000 7f53c7e2c640 1 -- 172.21.15.79:0/2517872896 shutdown_connections 2024-04-25T02:08:51.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.647+0000 7f53c7e2c640 1 -- 172.21.15.79:0/2517872896 >> 172.21.15.79:0/2517872896 conn(0x7f53c00cfc80 msgr2=0x7f53c00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:51.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.647+0000 7f53c7e2c640 1 -- 172.21.15.79:0/2517872896 shutdown_connections 2024-04-25T02:08:51.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.647+0000 7f53c7e2c640 1 -- 172.21.15.79:0/2517872896 wait complete. 2024-04-25T02:08:51.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.648+0000 7f53c7e2c640 1 Processor -- start 2024-04-25T02:08:51.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.648+0000 7f53c7e2c640 1 -- start start 2024-04-25T02:08:51.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c7e2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53ac003f30 0x7f53c0159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c7e2c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53c00aace0 0x7f53c00ab550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c7e2c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53c01429b0 0x7f53c0142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c7e2c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f53c0072940 con 0x7f53ac003f30 2024-04-25T02:08:51.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c7e2c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53c0072660 con 0x7f53c00aace0 2024-04-25T02:08:51.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c7e2c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f53c0143fa0 con 0x7f53c01429b0 2024-04-25T02:08:51.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c5bc8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53ac003f30 0x7f53c0159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c5bc8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53ac003f30 0x7f53c0159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60194/0 (socket says 172.21.15.79:60194) 2024-04-25T02:08:51.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c5bc8640 1 -- 172.21.15.79:0/3208644568 learned_addr learned my addr 172.21.15.79:0/3208644568 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:51.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c63c9640 1 --2- 172.21.15.79:0/3208644568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53c01429b0 0x7f53c0142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c53c7640 1 --2- 172.21.15.79:0/3208644568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53c00aace0 0x7f53c00ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c5bc8640 1 -- 172.21.15.79:0/3208644568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53c01429b0 msgr2=0x7f53c0142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c5bc8640 1 --2- 172.21.15.79:0/3208644568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53c01429b0 0x7f53c0142e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c5bc8640 1 -- 172.21.15.79:0/3208644568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53c00aace0 msgr2=0x7f53c00ab550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c5bc8640 1 --2- 172.21.15.79:0/3208644568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53c00aace0 0x7f53c00ab550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c5bc8640 1 -- 172.21.15.79:0/3208644568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c00aa820 con 0x7f53ac003f30 2024-04-25T02:08:51.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c5bc8640 1 --2- 172.21.15.79:0/3208644568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53ac003f30 0x7f53c0159d70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f53bc007370 tx=0x7f53bc007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53b67fc640 1 -- 172.21.15.79:0/3208644568 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc01a070 con 0x7f53ac003f30 2024-04-25T02:08:51.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53b67fc640 1 -- 172.21.15.79:0/3208644568 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53bc00f9c0 con 0x7f53ac003f30 2024-04-25T02:08:51.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c7e2c640 1 -- 172.21.15.79:0/3208644568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c00a9f80 con 0x7f53ac003f30 2024-04-25T02:08:51.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53b67fc640 1 -- 172.21.15.79:0/3208644568 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00fd90 con 0x7f53ac003f30 2024-04-25T02:08:51.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.649+0000 7f53c7e2c640 1 -- 172.21.15.79:0/3208644568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c00aa540 con 0x7f53ac003f30 2024-04-25T02:08:51.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.650+0000 7f53c7e2c640 1 -- 172.21.15.79:0/3208644568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c0068a10 con 0x7f53ac003f30 2024-04-25T02:08:51.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.651+0000 7f53b67fc640 1 -- 172.21.15.79:0/3208644568 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53bc01d070 con 0x7f53ac003f30 2024-04-25T02:08:51.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.651+0000 7f53b67fc640 1 --2- 172.21.15.79:0/3208644568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53a406be30 0x7f53a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.651+0000 7f53b67fc640 1 -- 172.21.15.79:0/3208644568 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f53bc08a850 con 0x7f53ac003f30 2024-04-25T02:08:51.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.651+0000 7f53c53c7640 1 --2- 172.21.15.79:0/3208644568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53a406be30 0x7f53a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.652+0000 7f53c53c7640 1 --2- 172.21.15.79:0/3208644568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53a406be30 0x7f53a406e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f53b0033000 tx=0x7f53b0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.655+0000 7f53b67fc640 1 -- 172.21.15.79:0/3208644568 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f53c0068a10 con 0x7f53ac003f30 2024-04-25T02:08:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.825+0000 7f53c7e2c640 1 -- 172.21.15.79:0/3208644568 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53c00cccb0 con 0x7f53a406be30 2024-04-25T02:08:51.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.831+0000 7f53b67fc640 1 -- 172.21.15.79:0/3208644568 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237169 (secure 0 0 0) 0x7f53c00cccb0 con 0x7f53a406be30 2024-04-25T02:08:51.840 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:51.841 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:08:51.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.833+0000 7f53c7e2c640 1 -- 172.21.15.79:0/3208644568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53a406be30 msgr2=0x7f53a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.833+0000 7f53c7e2c640 1 --2- 172.21.15.79:0/3208644568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53a406be30 0x7f53a406e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f53b0033000 tx=0x7f53b0008030 comp rx=0 tx=0).stop 2024-04-25T02:08:51.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.834+0000 7f53c7e2c640 1 -- 172.21.15.79:0/3208644568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53ac003f30 msgr2=0x7f53c0159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.834+0000 7f53c7e2c640 1 --2- 172.21.15.79:0/3208644568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53ac003f30 0x7f53c0159d70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f53bc007370 tx=0x7f53bc007770 comp rx=0 tx=0).stop 2024-04-25T02:08:51.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.834+0000 7f53c7e2c640 1 -- 172.21.15.79:0/3208644568 shutdown_connections 2024-04-25T02:08:51.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.834+0000 7f53c7e2c640 1 --2- 172.21.15.79:0/3208644568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53a406be30 0x7f53a406e2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.834+0000 7f53c7e2c640 1 --2- 172.21.15.79:0/3208644568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53c01429b0 0x7f53c0142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.834+0000 7f53c7e2c640 1 --2- 172.21.15.79:0/3208644568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53c00aace0 0x7f53c00ab550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.834+0000 7f53c7e2c640 1 --2- 172.21.15.79:0/3208644568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53ac003f30 0x7f53c0159d70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.834+0000 7f53c7e2c640 1 -- 172.21.15.79:0/3208644568 >> 172.21.15.79:0/3208644568 conn(0x7f53c00cfc80 msgr2=0x7f53c015e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:51.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.834+0000 7f53c7e2c640 1 -- 172.21.15.79:0/3208644568 shutdown_connections 2024-04-25T02:08:51.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.834+0000 7f53c7e2c640 1 -- 172.21.15.79:0/3208644568 wait complete. 2024-04-25T02:08:51.851 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-04-25T02:08:51.183135+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219884,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754836,"statfs":{"total":773094113280,"available":772868952064,"internally_reserved":0,"allocated":3776512,"data_stored":2134888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.317544"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-25T02:08:43.010261+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:08:43.010261+0000","last_peered":"2024-04-25T02:08:43.010261+0000","last_clean":"2024-04-25T02:08:43.010261+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:08:43.010261+0000","last_undegraded":"2024-04-25T02:08:43.010261+0000","last_fullsized":"2024-04-25T02:08:43.010261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":917504,"data_stored":709637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27356,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":709637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:08:51.855 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:08:51.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.981+0000 7f048201b640 1 Processor -- start 2024-04-25T02:08:51.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.981+0000 7f048201b640 1 -- start start 2024-04-25T02:08:51.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.982+0000 7f048201b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f047c144cb0 0x7f047c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.982+0000 7f048201b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f047c0b5580 0x7f047c06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.982+0000 7f048201b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f047c070d90 con 0x7f047c06e490 2024-04-25T02:08:51.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.982+0000 7f048201b640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f047c06e900 con 0x7f047c0b5580 2024-04-25T02:08:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.982+0000 7f048201b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f047c0cf130 con 0x7f047c144cb0 2024-04-25T02:08:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.982+0000 7f047bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f047c06e490 0x7f047c15fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35652/0 (socket says 172.21.15.79:35652) 2024-04-25T02:08:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.982+0000 7f047bfff640 1 -- 172.21.15.79:0/4096574515 learned_addr learned my addr 172.21.15.79:0/4096574515 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.982+0000 7f047a7fc640 1 -- 172.21.15.79:0/4096574515 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1668874051 0 0) 0x7f047c070d90 con 0x7f047c06e490 2024-04-25T02:08:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047a7fc640 1 -- 172.21.15.79:0/4096574515 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0464003520 con 0x7f047c06e490 2024-04-25T02:08:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047b7fe640 1 --2- 172.21.15.79:0/4096574515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f047c144cb0 0x7f047c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047affd640 1 --2- 172.21.15.79:0/4096574515 >> v2:172.21.15.189:3300/0 conn(0x7f047c0b5580 0x7f047c06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047a7fc640 1 -- 172.21.15.79:0/4096574515 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2042182551 0 0) 0x7f0464003520 con 0x7f047c06e490 2024-04-25T02:08:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047a7fc640 1 -- 172.21.15.79:0/4096574515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f047c144cb0 msgr2=0x7f047c0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047a7fc640 1 --2- 172.21.15.79:0/4096574515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f047c144cb0 0x7f047c0b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047a7fc640 1 -- 172.21.15.79:0/4096574515 >> v2:172.21.15.189:3300/0 conn(0x7f047c0b5580 msgr2=0x7f047c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047a7fc640 1 --2- 172.21.15.79:0/4096574515 >> v2:172.21.15.189:3300/0 conn(0x7f047c0b5580 0x7f047c06df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047a7fc640 1 -- 172.21.15.79:0/4096574515 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047c0cf410 con 0x7f047c06e490 2024-04-25T02:08:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047a7fc640 1 -- 172.21.15.79:0/4096574515 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f04740019f0 con 0x7f047c06e490 2024-04-25T02:08:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047affd640 1 --2- 172.21.15.79:0/4096574515 >> v2:172.21.15.189:3300/0 conn(0x7f047c0b5580 0x7f047c06df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047b7fe640 1 --2- 172.21.15.79:0/4096574515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f047c144cb0 0x7f047c0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047a7fc640 1 -- 172.21.15.79:0/4096574515 >> v1:172.21.15.79:6789/0 conn(0x7f047c06e490 legacy=0x7f047c15fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047a7fc640 1 --2- 172.21.15.79:0/4096574515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640039b0 0x7f0464003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047a7fc640 1 --2- 172.21.15.79:0/4096574515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f047c144cb0 0x7f0464004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047a7fc640 1 --2- 172.21.15.79:0/4096574515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0464004d40 0x7f04640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047a7fc640 1 -- 172.21.15.79:0/4096574515 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f047c06e900 con 0x7f04640039b0 2024-04-25T02:08:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047a7fc640 1 -- 172.21.15.79:0/4096574515 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f047c0cf130 con 0x7f0464004d40 2024-04-25T02:08:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047a7fc640 1 -- 172.21.15.79:0/4096574515 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f046400bb70 con 0x7f047c144cb0 2024-04-25T02:08:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047b7fe640 1 --2- 172.21.15.79:0/4096574515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640039b0 0x7f0464003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047affd640 1 --2- 172.21.15.79:0/4096574515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f047c144cb0 0x7f0464004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047bfff640 1 --2- 172.21.15.79:0/4096574515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0464004d40 0x7f04640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047b7fe640 1 -- 172.21.15.79:0/4096574515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f047c144cb0 msgr2=0x7f0464004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047b7fe640 1 --2- 172.21.15.79:0/4096574515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f047c144cb0 0x7f0464004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047b7fe640 1 -- 172.21.15.79:0/4096574515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0464004d40 msgr2=0x7f04640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047b7fe640 1 --2- 172.21.15.79:0/4096574515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0464004d40 0x7f04640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047b7fe640 1 -- 172.21.15.79:0/4096574515 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0464003520 con 0x7f04640039b0 2024-04-25T02:08:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.983+0000 7f047affd640 1 --2- 172.21.15.79:0/4096574515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f047c144cb0 0x7f0464004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.984+0000 7f047b7fe640 1 --2- 172.21.15.79:0/4096574515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640039b0 0x7f0464003dd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f046c0098a0 tx=0x7f0464005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbd0f5de3843b56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.984+0000 7f047a7fc640 1 -- 172.21.15.79:0/4096574515 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c00f040 con 0x7f04640039b0 2024-04-25T02:08:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.984+0000 7f047a7fc640 1 -- 172.21.15.79:0/4096574515 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f046c02ac10 con 0x7f04640039b0 2024-04-25T02:08:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.984+0000 7f047a7fc640 1 -- 172.21.15.79:0/4096574515 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c004030 con 0x7f04640039b0 2024-04-25T02:08:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.984+0000 7f048201b640 1 -- 172.21.15.79:0/4096574515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640039b0 msgr2=0x7f0464003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.984+0000 7f048201b640 1 --2- 172.21.15.79:0/4096574515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640039b0 0x7f0464003dd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f046c0098a0 tx=0x7f0464005830 comp rx=0 tx=0).stop 2024-04-25T02:08:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.984+0000 7f047bfff640 1 -- 172.21.15.79:0/4096574515 reap_dead start 2024-04-25T02:08:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.985+0000 7f048201b640 1 -- 172.21.15.79:0/4096574515 shutdown_connections 2024-04-25T02:08:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.985+0000 7f048201b640 1 -- 172.21.15.79:0/4096574515 >> 172.21.15.79:0/4096574515 conn(0x7f047c0cfc80 msgr2=0x7f047c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.985+0000 7f048201b640 1 -- 172.21.15.79:0/4096574515 shutdown_connections 2024-04-25T02:08:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.985+0000 7f048201b640 1 -- 172.21.15.79:0/4096574515 wait complete. 2024-04-25T02:08:51.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.986+0000 7f048201b640 1 Processor -- start 2024-04-25T02:08:51.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.986+0000 7f048201b640 1 -- start start 2024-04-25T02:08:51.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f048201b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640039b0 0x7f047c141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f048201b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f047c157f50 0x7f047c15ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f048201b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f047c142bf0 0x7f047c143070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f048201b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f047c145090 con 0x7f04640039b0 2024-04-25T02:08:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f048201b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f047c0cf9d0 con 0x7f047c157f50 2024-04-25T02:08:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f048201b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f047c145ab0 con 0x7f047c142bf0 2024-04-25T02:08:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f047b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640039b0 0x7f047c141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f047b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640039b0 0x7f047c141420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60212/0 (socket says 172.21.15.79:60212) 2024-04-25T02:08:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f047b7fe640 1 -- 172.21.15.79:0/505245173 learned_addr learned my addr 172.21.15.79:0/505245173 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f047affd640 1 --2- 172.21.15.79:0/505245173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f047c157f50 0x7f047c15ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f047bfff640 1 --2- 172.21.15.79:0/505245173 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f047c142bf0 0x7f047c143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f047b7fe640 1 -- 172.21.15.79:0/505245173 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f047c142bf0 msgr2=0x7f047c143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f047b7fe640 1 --2- 172.21.15.79:0/505245173 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f047c142bf0 0x7f047c143070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f047b7fe640 1 -- 172.21.15.79:0/505245173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f047c157f50 msgr2=0x7f047c15ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f047b7fe640 1 --2- 172.21.15.79:0/505245173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f047c157f50 0x7f047c15ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f047b7fe640 1 -- 172.21.15.79:0/505245173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047c1438c0 con 0x7f04640039b0 2024-04-25T02:08:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f047b7fe640 1 --2- 172.21.15.79:0/505245173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640039b0 0x7f047c141420 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f046c0098a0 tx=0x7f046c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f0463fff640 1 -- 172.21.15.79:0/505245173 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c041070 con 0x7f04640039b0 2024-04-25T02:08:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f0463fff640 1 -- 172.21.15.79:0/505245173 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f046c02aa10 con 0x7f04640039b0 2024-04-25T02:08:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f048201b640 1 -- 172.21.15.79:0/505245173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f047c143ba0 con 0x7f04640039b0 2024-04-25T02:08:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f0463fff640 1 -- 172.21.15.79:0/505245173 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c03d430 con 0x7f04640039b0 2024-04-25T02:08:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.987+0000 7f048201b640 1 -- 172.21.15.79:0/505245173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047c144160 con 0x7f04640039b0 2024-04-25T02:08:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.988+0000 7f048201b640 1 -- 172.21.15.79:0/505245173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f047c0690a0 con 0x7f04640039b0 2024-04-25T02:08:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.989+0000 7f0463fff640 1 -- 172.21.15.79:0/505245173 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f046c044070 con 0x7f04640039b0 2024-04-25T02:08:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.989+0000 7f0463fff640 1 --2- 172.21.15.79:0/505245173 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f046806be30 0x7f046806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.989+0000 7f0463fff640 1 -- 172.21.15.79:0/505245173 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f046c0ab630 con 0x7f04640039b0 2024-04-25T02:08:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.989+0000 7f047affd640 1 --2- 172.21.15.79:0/505245173 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f046806be30 0x7f046806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.989+0000 7f047affd640 1 --2- 172.21.15.79:0/505245173 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f046806be30 0x7f046806e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f047c1f75d0 tx=0x7f0470008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:52.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:51.993+0000 7f0463fff640 1 -- 172.21.15.79:0/505245173 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f046c07a070 con 0x7f04640039b0 2024-04-25T02:08:52.069 INFO:tasks.ceph.mds.b.smithi189.stderr:2024-04-25T02:08:52.062+0000 7f4ab8643640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:08:52.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.164+0000 7f048201b640 1 -- 172.21.15.79:0/505245173 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f047c0d0b90 con 0x7f046806be30 2024-04-25T02:08:52.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.169+0000 7f0463fff640 1 -- 172.21.15.79:0/505245173 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237169 (secure 0 0 0) 0x7f047c0d0b90 con 0x7f046806be30 2024-04-25T02:08:52.179 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:52.180 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:08:52.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.173+0000 7f048201b640 1 -- 172.21.15.79:0/505245173 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f046806be30 msgr2=0x7f046806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.173+0000 7f048201b640 1 --2- 172.21.15.79:0/505245173 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f046806be30 0x7f046806e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f047c1f75d0 tx=0x7f0470008040 comp rx=0 tx=0).stop 2024-04-25T02:08:52.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.173+0000 7f048201b640 1 -- 172.21.15.79:0/505245173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640039b0 msgr2=0x7f047c141420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.173+0000 7f048201b640 1 --2- 172.21.15.79:0/505245173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640039b0 0x7f047c141420 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f046c0098a0 tx=0x7f046c004730 comp rx=0 tx=0).stop 2024-04-25T02:08:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.173+0000 7f048201b640 1 -- 172.21.15.79:0/505245173 shutdown_connections 2024-04-25T02:08:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.173+0000 7f048201b640 1 --2- 172.21.15.79:0/505245173 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f046806be30 0x7f046806e2f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.173+0000 7f048201b640 1 --2- 172.21.15.79:0/505245173 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f047c142bf0 0x7f047c143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.173+0000 7f048201b640 1 --2- 172.21.15.79:0/505245173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f047c157f50 0x7f047c15ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.173+0000 7f048201b640 1 --2- 172.21.15.79:0/505245173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640039b0 0x7f047c141420 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.173+0000 7f048201b640 1 -- 172.21.15.79:0/505245173 >> 172.21.15.79:0/505245173 conn(0x7f047c0cfc80 msgr2=0x7f047c0b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.173+0000 7f048201b640 1 -- 172.21.15.79:0/505245173 shutdown_connections 2024-04-25T02:08:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.173+0000 7f048201b640 1 -- 172.21.15.79:0/505245173 wait complete. 2024-04-25T02:08:52.191 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-04-25T02:08:51.183135+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219884,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754836,"statfs":{"total":773094113280,"available":772868952064,"internally_reserved":0,"allocated":3776512,"data_stored":2134888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.317544"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-25T02:08:43.010261+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:08:43.010261+0000","last_peered":"2024-04-25T02:08:43.010261+0000","last_clean":"2024-04-25T02:08:43.010261+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:08:43.010261+0000","last_undegraded":"2024-04-25T02:08:43.010261+0000","last_fullsized":"2024-04-25T02:08:43.010261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":917504,"data_stored":709637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27356,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":709637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:08:52.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:08:52.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.320+0000 7fa9df34f640 1 Processor -- start 2024-04-25T02:08:52.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.320+0000 7fa9df34f640 1 -- start start 2024-04-25T02:08:52.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.321+0000 7fa9df34f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa9d8144cb0 0x7fa9d80b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:52.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.321+0000 7fa9df34f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9d8070d90 con 0x7fa9d806e660 2024-04-25T02:08:52.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.321+0000 7fa9df34f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9d80cf130 con 0x7fa9d80b5580 2024-04-25T02:08:52.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.321+0000 7fa9df34f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa9d80cf410 con 0x7fa9d8144cb0 2024-04-25T02:08:52.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.321+0000 7fa9dd0eb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa9d8144cb0 0x7fa9d80b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:52.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.321+0000 7fa9dd0eb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa9d8144cb0 0x7fa9d80b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60220/0 (socket says 172.21.15.79:60220) 2024-04-25T02:08:52.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.321+0000 7fa9dd0eb640 1 -- 172.21.15.79:0/211131880 learned_addr learned my addr 172.21.15.79:0/211131880 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:52.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.321+0000 7fa9dd8ec640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa9d806e660 0x7fa9d8071240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35664/0 (socket says 172.21.15.79:35664) 2024-04-25T02:08:52.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.322+0000 7fa9dd0eb640 1 -- 172.21.15.79:0/211131880 >> v1:172.21.15.189:6789/0 conn(0x7fa9d80b5580 legacy=0x7fa9d806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:52.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.322+0000 7fa9dd0eb640 1 -- 172.21.15.79:0/211131880 >> v1:172.21.15.79:6789/0 conn(0x7fa9d806e660 legacy=0x7fa9d8071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.322+0000 7fa9cffff640 1 -- 172.21.15.79:0/211131880 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080376888 0 0) 0x7fa9d8070d90 con 0x7fa9d806e660 2024-04-25T02:08:52.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.322+0000 7fa9dd0eb640 1 -- 172.21.15.79:0/211131880 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d80cf6f0 con 0x7fa9d8144cb0 2024-04-25T02:08:52.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.322+0000 7fa9dd0eb640 1 --2- 172.21.15.79:0/211131880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d8144cb0 0x7fa9d80b5040 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40098a0 tx=0x7fa9d402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b41352f9f4758f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:52.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.322+0000 7fa9cffff640 1 -- 172.21.15.79:0/211131880 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4037070 con 0x7fa9d8144cb0 2024-04-25T02:08:52.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.322+0000 7fa9cffff640 1 -- 172.21.15.79:0/211131880 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d4032440 con 0x7fa9d8144cb0 2024-04-25T02:08:52.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.322+0000 7fa9cffff640 1 -- 172.21.15.79:0/211131880 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4032810 con 0x7fa9d8144cb0 2024-04-25T02:08:52.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.323+0000 7fa9df34f640 1 -- 172.21.15.79:0/211131880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d8144cb0 msgr2=0x7fa9d80b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.323+0000 7fa9df34f640 1 --2- 172.21.15.79:0/211131880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d8144cb0 0x7fa9d80b5040 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40098a0 tx=0x7fa9d402a1c0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.323+0000 7fa9df34f640 1 -- 172.21.15.79:0/211131880 shutdown_connections 2024-04-25T02:08:52.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.323+0000 7fa9df34f640 1 --2- 172.21.15.79:0/211131880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d8144cb0 0x7fa9d80b5040 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.323+0000 7fa9df34f640 1 -- 172.21.15.79:0/211131880 >> 172.21.15.79:0/211131880 conn(0x7fa9d80cfc80 msgr2=0x7fa9d80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:52.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.323+0000 7fa9df34f640 1 -- 172.21.15.79:0/211131880 shutdown_connections 2024-04-25T02:08:52.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.323+0000 7fa9df34f640 1 -- 172.21.15.79:0/211131880 wait complete. 2024-04-25T02:08:52.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.324+0000 7fa9df34f640 1 Processor -- start 2024-04-25T02:08:52.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.324+0000 7fa9df34f640 1 -- start start 2024-04-25T02:08:52.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9df34f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d806e660 0x7fa9d8158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:52.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9df34f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9d80b5580 0x7fa9d8158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:52.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9df34f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9d8144cb0 0x7fa9d8157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:52.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9df34f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d8145ab0 con 0x7fa9d806e660 2024-04-25T02:08:52.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9df34f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d8145090 con 0x7fa9d80b5580 2024-04-25T02:08:52.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9df34f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa9d8145c30 con 0x7fa9d8144cb0 2024-04-25T02:08:52.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9dd0eb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d806e660 0x7fa9d8158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:52.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9dd0eb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d806e660 0x7fa9d8158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60232/0 (socket says 172.21.15.79:60232) 2024-04-25T02:08:52.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9dd0eb640 1 -- 172.21.15.79:0/2032007288 learned_addr learned my addr 172.21.15.79:0/2032007288 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:52.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9dc8ea640 1 --2- 172.21.15.79:0/2032007288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9d80b5580 0x7fa9d8158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:52.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9dd0eb640 1 -- 172.21.15.79:0/2032007288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9d8144cb0 msgr2=0x7fa9d8157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9dd0eb640 1 --2- 172.21.15.79:0/2032007288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9d8144cb0 0x7fa9d8157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9dd0eb640 1 -- 172.21.15.79:0/2032007288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9d80b5580 msgr2=0x7fa9d8158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9dd0eb640 1 --2- 172.21.15.79:0/2032007288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9d80b5580 0x7fa9d8158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9dd0eb640 1 -- 172.21.15.79:0/2032007288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d8134d80 con 0x7fa9d806e660 2024-04-25T02:08:52.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.325+0000 7fa9dd0eb640 1 --2- 172.21.15.79:0/2032007288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d806e660 0x7fa9d8158650 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4000c00 tx=0x7fa9d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:52.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.326+0000 7fa9cdffb640 1 -- 172.21.15.79:0/2032007288 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4037040 con 0x7fa9d806e660 2024-04-25T02:08:52.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.326+0000 7fa9cdffb640 1 -- 172.21.15.79:0/2032007288 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d4004230 con 0x7fa9d806e660 2024-04-25T02:08:52.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.326+0000 7fa9df34f640 1 -- 172.21.15.79:0/2032007288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d8159650 con 0x7fa9d806e660 2024-04-25T02:08:52.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.326+0000 7fa9cdffb640 1 -- 172.21.15.79:0/2032007288 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d403c670 con 0x7fa9d806e660 2024-04-25T02:08:52.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.326+0000 7fa9df34f640 1 -- 172.21.15.79:0/2032007288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d8132420 con 0x7fa9d806e660 2024-04-25T02:08:52.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.327+0000 7fa9df34f640 1 -- 172.21.15.79:0/2032007288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9d80690a0 con 0x7fa9d806e660 2024-04-25T02:08:52.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.327+0000 7fa9cdffb640 1 -- 172.21.15.79:0/2032007288 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa9d403a070 con 0x7fa9d806e660 2024-04-25T02:08:52.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.328+0000 7fa9cdffb640 1 --2- 172.21.15.79:0/2032007288 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa9bc06be30 0x7fa9bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:52.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.328+0000 7fa9dc8ea640 1 --2- 172.21.15.79:0/2032007288 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa9bc06be30 0x7fa9bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:52.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.328+0000 7fa9cdffb640 1 -- 172.21.15.79:0/2032007288 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa9d40ab6e0 con 0x7fa9d806e660 2024-04-25T02:08:52.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.328+0000 7fa9dc8ea640 1 --2- 172.21.15.79:0/2032007288 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa9bc06be30 0x7fa9bc06e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8158e50 tx=0x7fa9c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:52.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.332+0000 7fa9cdffb640 1 -- 172.21.15.79:0/2032007288 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa9d8134d80 con 0x7fa9d806e660 2024-04-25T02:08:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.503+0000 7fa9df34f640 1 -- 172.21.15.79:0/2032007288 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa9d80d0b90 con 0x7fa9bc06be30 2024-04-25T02:08:52.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.508+0000 7fa9cdffb640 1 -- 172.21.15.79:0/2032007288 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237169 (secure 0 0 0) 0x7fa9d80d0b90 con 0x7fa9bc06be30 2024-04-25T02:08:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:08:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.511+0000 7fa9df34f640 1 -- 172.21.15.79:0/2032007288 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa9bc06be30 msgr2=0x7fa9bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.511+0000 7fa9df34f640 1 --2- 172.21.15.79:0/2032007288 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa9bc06be30 0x7fa9bc06e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8158e50 tx=0x7fa9c8009040 comp rx=0 tx=0).stop 2024-04-25T02:08:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.511+0000 7fa9df34f640 1 -- 172.21.15.79:0/2032007288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d806e660 msgr2=0x7fa9d8158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.511+0000 7fa9df34f640 1 --2- 172.21.15.79:0/2032007288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d806e660 0x7fa9d8158650 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4000c00 tx=0x7fa9d40046c0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.511+0000 7fa9df34f640 1 -- 172.21.15.79:0/2032007288 shutdown_connections 2024-04-25T02:08:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.511+0000 7fa9df34f640 1 --2- 172.21.15.79:0/2032007288 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa9bc06be30 0x7fa9bc06e2f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.511+0000 7fa9df34f640 1 --2- 172.21.15.79:0/2032007288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9d8144cb0 0x7fa9d8157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.511+0000 7fa9df34f640 1 --2- 172.21.15.79:0/2032007288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9d80b5580 0x7fa9d8158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.511+0000 7fa9df34f640 1 --2- 172.21.15.79:0/2032007288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d806e660 0x7fa9d8158650 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.511+0000 7fa9df34f640 1 -- 172.21.15.79:0/2032007288 >> 172.21.15.79:0/2032007288 conn(0x7fa9d80cfc80 msgr2=0x7fa9d80b05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:52.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.511+0000 7fa9df34f640 1 -- 172.21.15.79:0/2032007288 shutdown_connections 2024-04-25T02:08:52.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.511+0000 7fa9df34f640 1 -- 172.21.15.79:0/2032007288 wait complete. 2024-04-25T02:08:52.529 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-04-25T02:08:51.183135+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219884,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754836,"statfs":{"total":773094113280,"available":772868952064,"internally_reserved":0,"allocated":3776512,"data_stored":2134888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.317544"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:47.865276+0000","last_change":"2024-04-25T02:08:47.865276+0000","last_active":"2024-04-25T02:08:47.865276+0000","last_peered":"2024-04-25T02:08:47.865276+0000","last_clean":"2024-04-25T02:08:47.865276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:47.865276+0000","last_undegraded":"2024-04-25T02:08:47.865276+0000","last_fullsized":"2024-04-25T02:08:47.865276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:08:46.863341+0000","last_change":"2024-04-25T02:08:46.863341+0000","last_active":"2024-04-25T02:08:46.863341+0000","last_peered":"2024-04-25T02:08:46.863341+0000","last_clean":"2024-04-25T02:08:46.863341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:08:46.863341+0000","last_undegraded":"2024-04-25T02:08:46.863341+0000","last_fullsized":"2024-04-25T02:08:46.863341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-25T02:08:43.010261+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:08:43.010261+0000","last_peered":"2024-04-25T02:08:43.010261+0000","last_clean":"2024-04-25T02:08:43.010261+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:08:43.010261+0000","last_undegraded":"2024-04-25T02:08:43.010261+0000","last_fullsized":"2024-04-25T02:08:43.010261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":917504,"data_stored":709637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27356,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":119269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":709637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:08:52.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-04-25T02:08:52.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-04-25T02:08:52.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-04-25T02:08:52.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-04-25T02:08:52.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-04-25T02:08:52.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-04-25T02:08:52.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-04-25T02:08:52.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-04-25T02:08:52.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-04-25T02:08:52.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-04-25T02:08:52.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-04-25T02:08:52.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-04-25T02:08:52.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-04-25T02:08:52.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-04-25T02:08:52.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-04-25T02:08:52.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-04-25T02:08:52.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-04-25T02:08:52.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-04-25T02:08:52.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-04-25T02:08:52.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-04-25T02:08:52.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-04-25T02:08:52.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-04-25T02:08:52.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-04-25T02:08:52.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-04-25T02:08:52.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-04-25T02:08:52.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-04-25T02:08:52.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-04-25T02:08:52.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-04-25T02:08:52.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-04-25T02:08:52.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-04-25T02:08:52.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-04-25T02:08:52.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-04-25T02:08:52.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-04-25T02:08:52.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-25T02:08:52.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-04-25T02:08:52.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-25T02:08:52.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-04-25T02:08:52.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-25T02:08:52.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-04-25T02:08:52.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-25T02:08:52.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-04-25T02:08:52.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-25T02:08:52.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-04-25T02:08:52.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-25T02:08:52.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-04-25T02:08:52.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-25T02:08:52.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-04-25T02:08:52.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-25T02:08:52.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-04-25T02:08:52.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-25T02:08:52.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-04-25T02:08:52.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-25T02:08:52.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-04-25T02:08:52.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-25T02:08:52.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-04-25T02:08:52.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-25T02:08:52.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-04-25T02:08:52.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-25T02:08:52.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-04-25T02:08:52.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-25T02:08:52.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-04-25T02:08:52.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-25T02:08:52.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-04-25T02:08:52.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-25T02:08:52.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-04-25T02:08:52.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-25T02:08:52.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-04-25T02:08:52.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-25T02:08:52.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-04-25T02:08:52.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-25T02:08:52.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-04-25T02:08:52.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-25T02:08:52.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-04-25T02:08:52.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-25T02:08:52.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-04-25T02:08:52.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-25T02:08:52.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-04-25T02:08:52.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-25T02:08:52.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-04-25T02:08:52.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-25T02:08:52.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-04-25T02:08:52.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-25T02:08:52.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-04-25T02:08:52.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-25T02:08:52.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-04-25T02:08:52.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-25T02:08:52.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-04-25T02:08:52.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-25T02:08:52.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-04-25T02:08:52.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-25T02:08:52.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-04-25T02:08:52.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-25T02:08:52.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-04-25T02:08:52.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-25T02:08:52.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-04-25T02:08:52.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:47.865276+0000', 'last_change': '2024-04-25T02:08:47.865276+0000', 'last_active': '2024-04-25T02:08:47.865276+0000', 'last_peered': '2024-04-25T02:08:47.865276+0000', 'last_clean': '2024-04-25T02:08:47.865276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:47.865276+0000', 'last_undegraded': '2024-04-25T02:08:47.865276+0000', 'last_fullsized': '2024-04-25T02:08:47.865276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:47.865276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-25T02:08:52.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:08:46.863341+0000', 'last_change': '2024-04-25T02:08:46.863341+0000', 'last_active': '2024-04-25T02:08:46.863341+0000', 'last_peered': '2024-04-25T02:08:46.863341+0000', 'last_clean': '2024-04-25T02:08:46.863341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:08:46.863341+0000', 'last_undegraded': '2024-04-25T02:08:46.863341+0000', 'last_fullsized': '2024-04-25T02:08:46.863341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'last_clean_scrub_stamp': '2024-04-25T02:08:46.863341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:08:52.550 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T02:08:52.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.658+0000 7f05c0ea3640 1 Processor -- start 2024-04-25T02:08:52.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.658+0000 7f05c0ea3640 1 -- start start 2024-04-25T02:08:52.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05c0ea3640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05bc158910 0x7f05bc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:52.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05c0ea3640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f05bc15f2a0 0x7f05bc0b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:52.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05c0ea3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc071a40 con 0x7f05bc06e900 2024-04-25T02:08:52.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05c0ea3640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f05bc072650 con 0x7f05bc15f2a0 2024-04-25T02:08:52.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05c0ea3640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f05bc071d20 con 0x7f05bc158910 2024-04-25T02:08:52.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05b3fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f05bc06e900 0x7f05bc15eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35674/0 (socket says 172.21.15.79:35674) 2024-04-25T02:08:52.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05b3fff640 1 -- 172.21.15.79:0/4026767305 learned_addr learned my addr 172.21.15.79:0/4026767305 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:52.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05ba59c640 1 --2- 172.21.15.79:0/4026767305 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05bc158910 0x7f05bc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:52.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05bad9d640 1 --2- 172.21.15.79:0/4026767305 >> v2:172.21.15.189:3300/0 conn(0x7f05bc15f2a0 0x7f05bc0b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:52.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05b9d9b640 1 -- 172.21.15.79:0/4026767305 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364063923 0 0) 0x7f05bc071a40 con 0x7f05bc06e900 2024-04-25T02:08:52.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05b9d9b640 1 -- 172.21.15.79:0/4026767305 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05a8003520 con 0x7f05bc06e900 2024-04-25T02:08:52.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05ba59c640 1 -- 172.21.15.79:0/4026767305 >> v2:172.21.15.189:3300/0 conn(0x7f05bc15f2a0 msgr2=0x7f05bc0b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:52.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05ba59c640 1 --2- 172.21.15.79:0/4026767305 >> v2:172.21.15.189:3300/0 conn(0x7f05bc15f2a0 0x7f05bc0b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05ba59c640 1 -- 172.21.15.79:0/4026767305 >> v1:172.21.15.79:6789/0 conn(0x7f05bc06e900 legacy=0x7f05bc15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05b9d9b640 1 -- 172.21.15.79:0/4026767305 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1071995695 0 0) 0x7f05a8003520 con 0x7f05bc06e900 2024-04-25T02:08:52.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.659+0000 7f05ba59c640 1 -- 172.21.15.79:0/4026767305 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc072000 con 0x7f05bc158910 2024-04-25T02:08:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.660+0000 7f05ba59c640 1 --2- 172.21.15.79:0/4026767305 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05bc158910 0x7f05bc06e3c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0097a0 tx=0x7f05ac02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cd086d509475e5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.660+0000 7f05b9d9b640 1 -- 172.21.15.79:0/4026767305 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac037070 con 0x7f05bc158910 2024-04-25T02:08:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.660+0000 7f05b9d9b640 1 -- 172.21.15.79:0/4026767305 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ac02aba0 con 0x7f05bc158910 2024-04-25T02:08:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.660+0000 7f05b9d9b640 1 -- 172.21.15.79:0/4026767305 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4001670 con 0x7f05bc158910 2024-04-25T02:08:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.661+0000 7f05c0ea3640 1 -- 172.21.15.79:0/4026767305 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05bc158910 msgr2=0x7f05bc06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.661+0000 7f05c0ea3640 1 --2- 172.21.15.79:0/4026767305 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05bc158910 0x7f05bc06e3c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0097a0 tx=0x7f05ac02a110 comp rx=0 tx=0).stop 2024-04-25T02:08:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.661+0000 7f05c0ea3640 1 -- 172.21.15.79:0/4026767305 shutdown_connections 2024-04-25T02:08:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.661+0000 7f05c0ea3640 1 --2- 172.21.15.79:0/4026767305 >> v2:172.21.15.189:3300/0 conn(0x7f05bc15f2a0 0x7f05bc0b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.661+0000 7f05c0ea3640 1 --2- 172.21.15.79:0/4026767305 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05bc158910 0x7f05bc06e3c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.661+0000 7f05c0ea3640 1 -- 172.21.15.79:0/4026767305 >> 172.21.15.79:0/4026767305 conn(0x7f05bc0cfc80 msgr2=0x7f05bc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.661+0000 7f05c0ea3640 1 -- 172.21.15.79:0/4026767305 shutdown_connections 2024-04-25T02:08:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.661+0000 7f05c0ea3640 1 -- 172.21.15.79:0/4026767305 wait complete. 2024-04-25T02:08:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.662+0000 7f05c0ea3640 1 Processor -- start 2024-04-25T02:08:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.662+0000 7f05c0ea3640 1 -- start start 2024-04-25T02:08:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05c0ea3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05bc06e900 0x7f05bc15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05c0ea3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc158910 0x7f05bc14f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05c0ea3640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05bc15f2a0 0x7f05bc14f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05c0ea3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc158cf0 con 0x7f05bc158910 2024-04-25T02:08:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05c0ea3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc15f930 con 0x7f05bc06e900 2024-04-25T02:08:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05c0ea3640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f05bc158e70 con 0x7f05bc15f2a0 2024-04-25T02:08:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc158910 0x7f05bc14f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc158910 0x7f05bc14f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60240/0 (socket says 172.21.15.79:60240) 2024-04-25T02:08:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05b3fff640 1 -- 172.21.15.79:0/3408683819 learned_addr learned my addr 172.21.15.79:0/3408683819 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05ba59c640 1 --2- 172.21.15.79:0/3408683819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05bc06e900 0x7f05bc15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05bad9d640 1 --2- 172.21.15.79:0/3408683819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05bc15f2a0 0x7f05bc14f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05b3fff640 1 -- 172.21.15.79:0/3408683819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05bc15f2a0 msgr2=0x7f05bc14f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05b3fff640 1 --2- 172.21.15.79:0/3408683819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05bc15f2a0 0x7f05bc14f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05b3fff640 1 -- 172.21.15.79:0/3408683819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05bc06e900 msgr2=0x7f05bc15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05b3fff640 1 --2- 172.21.15.79:0/3408683819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05bc06e900 0x7f05bc15d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05b3fff640 1 -- 172.21.15.79:0/3408683819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc14fd70 con 0x7f05bc158910 2024-04-25T02:08:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.663+0000 7f05bad9d640 1 --2- 172.21.15.79:0/3408683819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05bc15f2a0 0x7f05bc14f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.664+0000 7f05b3fff640 1 --2- 172.21.15.79:0/3408683819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc158910 0x7f05bc14f120 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f05a400c780 tx=0x7f05a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.664+0000 7f05b2ffd640 1 -- 172.21.15.79:0/3408683819 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4017070 con 0x7f05bc158910 2024-04-25T02:08:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.664+0000 7f05b2ffd640 1 -- 172.21.15.79:0/3408683819 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a4005ad0 con 0x7f05bc158910 2024-04-25T02:08:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.664+0000 7f05c0ea3640 1 -- 172.21.15.79:0/3408683819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05bc150050 con 0x7f05bc158910 2024-04-25T02:08:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.664+0000 7f05b2ffd640 1 -- 172.21.15.79:0/3408683819 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4007070 con 0x7f05bc158910 2024-04-25T02:08:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.664+0000 7f05c0ea3640 1 -- 172.21.15.79:0/3408683819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05bc150610 con 0x7f05bc158910 2024-04-25T02:08:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.665+0000 7f05c0ea3640 1 -- 172.21.15.79:0/3408683819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05bc0690a0 con 0x7f05bc158910 2024-04-25T02:08:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.665+0000 7f05b2ffd640 1 -- 172.21.15.79:0/3408683819 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05a401a070 con 0x7f05bc158910 2024-04-25T02:08:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.666+0000 7f05b2ffd640 1 --2- 172.21.15.79:0/3408683819 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f059c06be60 0x7f059c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.666+0000 7f05b2ffd640 1 -- 172.21.15.79:0/3408683819 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f05a408a320 con 0x7f05bc158910 2024-04-25T02:08:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.666+0000 7f05ba59c640 1 --2- 172.21.15.79:0/3408683819 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f059c06be60 0x7f059c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.666+0000 7f05ba59c640 1 --2- 172.21.15.79:0/3408683819 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f059c06be60 0x7f059c06e320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f05ac034000 tx=0x7f05ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:52.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.670+0000 7f05b2ffd640 1 -- 172.21.15.79:0/3408683819 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f05a4058680 con 0x7f05bc158910 2024-04-25T02:08:52.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.907+0000 7f05c0ea3640 1 -- 172.21.15.79:0/3408683819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f05bc06cd30 con 0x7f05bc158910 2024-04-25T02:08:52.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.908+0000 7f05b2ffd640 1 -- 172.21.15.79:0/3408683819 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1570 (secure 0 0 0) 0x7f05a405c980 con 0x7f05bc158910 2024-04-25T02:08:52.915 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:52.915 INFO:teuthology.orchestra.run.smithi079.stdout:{"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":77,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1714010866,"num_in_osds":8,"osd_in_since":1714010857,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225161216,"bytes_avail":772868952064,"bytes_total":773094113280,"unknown_pgs_ratio":0.98969072103500366},"fsmap":{"epoch":12,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5112}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-25T02:08:47.182616+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T02:08:52.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.910+0000 7f05c0ea3640 1 -- 172.21.15.79:0/3408683819 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f059c06be60 msgr2=0x7f059c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.910+0000 7f05c0ea3640 1 --2- 172.21.15.79:0/3408683819 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f059c06be60 0x7f059c06e320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f05ac034000 tx=0x7f05ac02e000 comp rx=0 tx=0).stop 2024-04-25T02:08:52.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.910+0000 7f05c0ea3640 1 -- 172.21.15.79:0/3408683819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc158910 msgr2=0x7f05bc14f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.910+0000 7f05c0ea3640 1 --2- 172.21.15.79:0/3408683819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc158910 0x7f05bc14f120 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f05a400c780 tx=0x7f05a400cc40 comp rx=0 tx=0).stop 2024-04-25T02:08:52.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.910+0000 7f05c0ea3640 1 -- 172.21.15.79:0/3408683819 shutdown_connections 2024-04-25T02:08:52.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.910+0000 7f05c0ea3640 1 --2- 172.21.15.79:0/3408683819 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f059c06be60 0x7f059c06e320 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.910+0000 7f05c0ea3640 1 --2- 172.21.15.79:0/3408683819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05bc15f2a0 0x7f05bc14f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.910+0000 7f05c0ea3640 1 --2- 172.21.15.79:0/3408683819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc158910 0x7f05bc14f120 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.910+0000 7f05c0ea3640 1 --2- 172.21.15.79:0/3408683819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05bc06e900 0x7f05bc15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.910+0000 7f05c0ea3640 1 -- 172.21.15.79:0/3408683819 >> 172.21.15.79:0/3408683819 conn(0x7f05bc0cfc80 msgr2=0x7f05bc070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:52.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.910+0000 7f05c0ea3640 1 -- 172.21.15.79:0/3408683819 shutdown_connections 2024-04-25T02:08:52.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:52.910+0000 7f05c0ea3640 1 -- 172.21.15.79:0/3408683819 wait complete. 2024-04-25T02:08:52.928 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T02:08:52.928 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:08:53.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.017+0000 7f960e8da640 1 Processor -- start 2024-04-25T02:08:53.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.017+0000 7f960e8da640 1 -- start start 2024-04-25T02:08:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.018+0000 7f960e8da640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f960806df50 0x7f960806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.018+0000 7f960e8da640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9608071240 0x7f9608071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.018+0000 7f960e8da640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9608070d90 con 0x7f9608144cb0 2024-04-25T02:08:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.018+0000 7f960e8da640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f96080cf130 con 0x7f960806df50 2024-04-25T02:08:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.018+0000 7f960e8da640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f96080cf410 con 0x7f9608071240 2024-04-25T02:08:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.018+0000 7f96077fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f960806df50 0x7f960806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.018+0000 7f96077fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f960806df50 0x7f960806e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60242/0 (socket says 172.21.15.79:60242) 2024-04-25T02:08:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.018+0000 7f9607fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9608144cb0 0x7f96080b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35682/0 (socket says 172.21.15.79:35682) 2024-04-25T02:08:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.018+0000 7f96077fe640 1 -- 172.21.15.79:0/1831728449 learned_addr learned my addr 172.21.15.79:0/1831728449 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.018+0000 7f960ce77640 1 --2- 172.21.15.79:0/1831728449 >> v2:172.21.15.189:3300/0 conn(0x7f9608071240 0x7f9608071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.018+0000 7f96077fe640 1 -- 172.21.15.79:0/1831728449 >> v2:172.21.15.189:3300/0 conn(0x7f9608071240 msgr2=0x7f9608071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.018+0000 7f96077fe640 1 --2- 172.21.15.79:0/1831728449 >> v2:172.21.15.189:3300/0 conn(0x7f9608071240 0x7f9608071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.018+0000 7f96077fe640 1 -- 172.21.15.79:0/1831728449 >> v1:172.21.15.79:6789/0 conn(0x7f9608144cb0 legacy=0x7f96080b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.018+0000 7f96077fe640 1 -- 172.21.15.79:0/1831728449 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96080cf6f0 con 0x7f960806df50 2024-04-25T02:08:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.019+0000 7f96077fe640 1 --2- 172.21.15.79:0/1831728449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f960806df50 0x7f960806e3e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f96080b5ae0 tx=0x7f95fc02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0976e840956407c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.019+0000 7f9606ffd640 1 -- 172.21.15.79:0/1831728449 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc037070 con 0x7f960806df50 2024-04-25T02:08:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.019+0000 7f9606ffd640 1 -- 172.21.15.79:0/1831728449 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc02acf0 con 0x7f960806df50 2024-04-25T02:08:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.019+0000 7f9606ffd640 1 -- 172.21.15.79:0/1831728449 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc032660 con 0x7f960806df50 2024-04-25T02:08:53.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.020+0000 7f960e8da640 1 -- 172.21.15.79:0/1831728449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f960806df50 msgr2=0x7f960806e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:53.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.020+0000 7f960e8da640 1 --2- 172.21.15.79:0/1831728449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f960806df50 0x7f960806e3e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f96080b5ae0 tx=0x7f95fc02a060 comp rx=0 tx=0).stop 2024-04-25T02:08:53.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.020+0000 7f960e8da640 1 -- 172.21.15.79:0/1831728449 shutdown_connections 2024-04-25T02:08:53.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.020+0000 7f960e8da640 1 --2- 172.21.15.79:0/1831728449 >> v2:172.21.15.189:3300/0 conn(0x7f9608071240 0x7f9608071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.020+0000 7f960e8da640 1 --2- 172.21.15.79:0/1831728449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f960806df50 0x7f960806e3e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.020+0000 7f960e8da640 1 -- 172.21.15.79:0/1831728449 >> 172.21.15.79:0/1831728449 conn(0x7f96080cfc80 msgr2=0x7f96080d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.020+0000 7f960e8da640 1 -- 172.21.15.79:0/1831728449 shutdown_connections 2024-04-25T02:08:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.020+0000 7f960e8da640 1 -- 172.21.15.79:0/1831728449 wait complete. 2024-04-25T02:08:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.021+0000 7f960e8da640 1 Processor -- start 2024-04-25T02:08:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.021+0000 7f960e8da640 1 -- start start 2024-04-25T02:08:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960e8da640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f960806df50 0x7f96081f2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960e8da640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9608071240 0x7f9608142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960e8da640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9608144cb0 0x7f96081592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960e8da640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9608145090 con 0x7f9608144cb0 2024-04-25T02:08:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960e8da640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96080cf9d0 con 0x7f960806df50 2024-04-25T02:08:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960e8da640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9608145ab0 con 0x7f9608071240 2024-04-25T02:08:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960ce77640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9608144cb0 0x7f96081592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960ce77640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9608144cb0 0x7f96081592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60244/0 (socket says 172.21.15.79:60244) 2024-04-25T02:08:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960ce77640 1 -- 172.21.15.79:0/3465260206 learned_addr learned my addr 172.21.15.79:0/3465260206 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f9607fff640 1 --2- 172.21.15.79:0/3465260206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f960806df50 0x7f96081f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f96077fe640 1 --2- 172.21.15.79:0/3465260206 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9608071240 0x7f9608142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960ce77640 1 -- 172.21.15.79:0/3465260206 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9608071240 msgr2=0x7f9608142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960ce77640 1 --2- 172.21.15.79:0/3465260206 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9608071240 0x7f9608142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960ce77640 1 -- 172.21.15.79:0/3465260206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f960806df50 msgr2=0x7f96081f2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960ce77640 1 --2- 172.21.15.79:0/3465260206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f960806df50 0x7f96081f2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960ce77640 1 -- 172.21.15.79:0/3465260206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9608156930 con 0x7f9608144cb0 2024-04-25T02:08:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960ce77640 1 --2- 172.21.15.79:0/3465260206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9608144cb0 0x7f96081592d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9600007e40 tx=0x7f960000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f9604ff9640 1 -- 172.21.15.79:0/3465260206 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9600014620 con 0x7f9608144cb0 2024-04-25T02:08:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f9604ff9640 1 -- 172.21.15.79:0/3465260206 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9600019070 con 0x7f9608144cb0 2024-04-25T02:08:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960e8da640 1 -- 172.21.15.79:0/3465260206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9608156c70 con 0x7f9608144cb0 2024-04-25T02:08:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f9604ff9640 1 -- 172.21.15.79:0/3465260206 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9600014a20 con 0x7f9608144cb0 2024-04-25T02:08:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.022+0000 7f960e8da640 1 -- 172.21.15.79:0/3465260206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96081574b0 con 0x7f9608144cb0 2024-04-25T02:08:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.023+0000 7f960e8da640 1 -- 172.21.15.79:0/3465260206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96080690a0 con 0x7f9608144cb0 2024-04-25T02:08:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.024+0000 7f9604ff9640 1 -- 172.21.15.79:0/3465260206 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9600014bc0 con 0x7f9608144cb0 2024-04-25T02:08:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.024+0000 7f9604ff9640 1 --2- 172.21.15.79:0/3465260206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f95f406be30 0x7f95f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.024+0000 7f9604ff9640 1 -- 172.21.15.79:0/3465260206 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f960008b5d0 con 0x7f9608144cb0 2024-04-25T02:08:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.024+0000 7f9607fff640 1 --2- 172.21.15.79:0/3465260206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f95f406be30 0x7f95f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.025+0000 7f9607fff640 1 --2- 172.21.15.79:0/3465260206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f95f406be30 0x7f95f406e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f95f8000f60 tx=0x7f95f8000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.029+0000 7f9604ff9640 1 -- 172.21.15.79:0/3465260206 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9608156c70 con 0x7f9608144cb0 2024-04-25T02:08:53.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.198+0000 7f960e8da640 1 -- 172.21.15.79:0/3465260206 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f96080d0b90 con 0x7f95f406be30 2024-04-25T02:08:53.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.204+0000 7f9604ff9640 1 -- 172.21.15.79:0/3465260206 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251915 (secure 0 0 0) 0x7f96080d0b90 con 0x7f95f406be30 2024-04-25T02:08:53.214 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:53.215 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:08:53.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.207+0000 7f960e8da640 1 -- 172.21.15.79:0/3465260206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f95f406be30 msgr2=0x7f95f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:53.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.207+0000 7f960e8da640 1 --2- 172.21.15.79:0/3465260206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f95f406be30 0x7f95f406e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f95f8000f60 tx=0x7f95f8000bc0 comp rx=0 tx=0).stop 2024-04-25T02:08:53.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.207+0000 7f960e8da640 1 -- 172.21.15.79:0/3465260206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9608144cb0 msgr2=0x7f96081592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:53.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.207+0000 7f960e8da640 1 --2- 172.21.15.79:0/3465260206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9608144cb0 0x7f96081592d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9600007e40 tx=0x7f960000e4b0 comp rx=0 tx=0).stop 2024-04-25T02:08:53.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.207+0000 7f960e8da640 1 -- 172.21.15.79:0/3465260206 shutdown_connections 2024-04-25T02:08:53.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.207+0000 7f960e8da640 1 --2- 172.21.15.79:0/3465260206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f95f406be30 0x7f95f406e2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:53.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.207+0000 7f960e8da640 1 --2- 172.21.15.79:0/3465260206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9608144cb0 0x7f96081592d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:53.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.207+0000 7f960e8da640 1 --2- 172.21.15.79:0/3465260206 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9608071240 0x7f9608142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:53.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.207+0000 7f960e8da640 1 --2- 172.21.15.79:0/3465260206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f960806df50 0x7f96081f2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:53.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.207+0000 7f960e8da640 1 -- 172.21.15.79:0/3465260206 >> 172.21.15.79:0/3465260206 conn(0x7f96080cfc80 msgr2=0x7f96080b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:53.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.207+0000 7f960e8da640 1 -- 172.21.15.79:0/3465260206 shutdown_connections 2024-04-25T02:08:53.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:53.207+0000 7f960e8da640 1 -- 172.21.15.79:0/3465260206 wait complete. 2024-04-25T02:08:53.225 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-04-25T02:08:53.183455+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220284,"kb_used_data":4088,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754436,"statfs":{"total":773094113280,"available":772868542464,"internally_reserved":0,"allocated":4186112,"data_stored":2315780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000875"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.911770+0000","last_change":"2024-04-25T02:08:48.904115+0000","last_active":"2024-04-25T02:08:48.911770+0000","last_peered":"2024-04-25T02:08:48.911770+0000","last_clean":"2024-04-25T02:08:48.911770+0000","last_became_active":"2024-04-25T02:08:48.903829+0000","last_became_peered":"2024-04-25T02:08:48.903829+0000","last_unstale":"2024-04-25T02:08:48.911770+0000","last_undegraded":"2024-04-25T02:08:48.911770+0000","last_fullsized":"2024-04-25T02:08:48.911770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:35:15.855723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.901050+0000","last_change":"2024-04-25T02:08:48.897577+0000","last_active":"2024-04-25T02:08:48.901050+0000","last_peered":"2024-04-25T02:08:48.901050+0000","last_clean":"2024-04-25T02:08:48.901050+0000","last_became_active":"2024-04-25T02:08:48.897320+0000","last_became_peered":"2024-04-25T02:08:48.897320+0000","last_unstale":"2024-04-25T02:08:48.901050+0000","last_undegraded":"2024-04-25T02:08:48.901050+0000","last_fullsized":"2024-04-25T02:08:48.901050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:58.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893919+0000","last_change":"2024-04-25T02:08:48.894524+0000","last_active":"2024-04-25T02:08:49.893919+0000","last_peered":"2024-04-25T02:08:49.893919+0000","last_clean":"2024-04-25T02:08:49.893919+0000","last_became_active":"2024-04-25T02:08:48.893624+0000","last_became_peered":"2024-04-25T02:08:48.893624+0000","last_unstale":"2024-04-25T02:08:49.893919+0000","last_undegraded":"2024-04-25T02:08:49.893919+0000","last_fullsized":"2024-04-25T02:08:49.893919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:38.716955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891387+0000","last_change":"2024-04-25T02:08:48.889716+0000","last_active":"2024-04-25T02:08:49.891387+0000","last_peered":"2024-04-25T02:08:49.891387+0000","last_clean":"2024-04-25T02:08:49.891387+0000","last_became_active":"2024-04-25T02:08:48.889430+0000","last_became_peered":"2024-04-25T02:08:48.889430+0000","last_unstale":"2024-04-25T02:08:49.891387+0000","last_undegraded":"2024-04-25T02:08:49.891387+0000","last_fullsized":"2024-04-25T02:08:49.891387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:01.122216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.904074+0000","last_change":"2024-04-25T02:08:48.903248+0000","last_active":"2024-04-25T02:08:48.904074+0000","last_peered":"2024-04-25T02:08:48.904074+0000","last_clean":"2024-04-25T02:08:48.904074+0000","last_became_active":"2024-04-25T02:08:48.902966+0000","last_became_peered":"2024-04-25T02:08:48.902966+0000","last_unstale":"2024-04-25T02:08:48.904074+0000","last_undegraded":"2024-04-25T02:08:48.904074+0000","last_fullsized":"2024-04-25T02:08:48.904074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:58.748661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.898739+0000","last_change":"2024-04-25T02:08:48.897387+0000","last_active":"2024-04-25T02:08:48.898739+0000","last_peered":"2024-04-25T02:08:48.898739+0000","last_clean":"2024-04-25T02:08:48.898739+0000","last_became_active":"2024-04-25T02:08:48.896729+0000","last_became_peered":"2024-04-25T02:08:48.896729+0000","last_unstale":"2024-04-25T02:08:48.898739+0000","last_undegraded":"2024-04-25T02:08:48.898739+0000","last_fullsized":"2024-04-25T02:08:48.898739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:55.327825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.898174+0000","last_change":"2024-04-25T02:08:48.895403+0000","last_active":"2024-04-25T02:08:48.898174+0000","last_peered":"2024-04-25T02:08:48.898174+0000","last_clean":"2024-04-25T02:08:48.898174+0000","last_became_active":"2024-04-25T02:08:48.895133+0000","last_became_peered":"2024-04-25T02:08:48.895133+0000","last_unstale":"2024-04-25T02:08:48.898174+0000","last_undegraded":"2024-04-25T02:08:48.898174+0000","last_fullsized":"2024-04-25T02:08:48.898174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:02.665799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.893017+0000","last_change":"2024-04-25T02:08:48.890266+0000","last_active":"2024-04-25T02:08:48.893017+0000","last_peered":"2024-04-25T02:08:48.893017+0000","last_clean":"2024-04-25T02:08:48.893017+0000","last_became_active":"2024-04-25T02:08:48.889994+0000","last_became_peered":"2024-04-25T02:08:48.889994+0000","last_unstale":"2024-04-25T02:08:48.893017+0000","last_undegraded":"2024-04-25T02:08:48.893017+0000","last_fullsized":"2024-04-25T02:08:48.893017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:52:20.093850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.894236+0000","last_change":"2024-04-25T02:08:48.898726+0000","last_active":"2024-04-25T02:08:49.894236+0000","last_peered":"2024-04-25T02:08:49.894236+0000","last_clean":"2024-04-25T02:08:49.894236+0000","last_became_active":"2024-04-25T02:08:48.898459+0000","last_became_peered":"2024-04-25T02:08:48.898459+0000","last_unstale":"2024-04-25T02:08:49.894236+0000","last_undegraded":"2024-04-25T02:08:49.894236+0000","last_fullsized":"2024-04-25T02:08:49.894236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:58.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891480+0000","last_change":"2024-04-25T02:08:48.899680+0000","last_active":"2024-04-25T02:08:49.891480+0000","last_peered":"2024-04-25T02:08:49.891480+0000","last_clean":"2024-04-25T02:08:49.891480+0000","last_became_active":"2024-04-25T02:08:48.899395+0000","last_became_peered":"2024-04-25T02:08:48.899395+0000","last_unstale":"2024-04-25T02:08:49.891480+0000","last_undegraded":"2024-04-25T02:08:49.891480+0000","last_fullsized":"2024-04-25T02:08:49.891480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:00.943838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.901318+0000","last_change":"2024-04-25T02:08:48.897764+0000","last_active":"2024-04-25T02:08:48.901318+0000","last_peered":"2024-04-25T02:08:48.901318+0000","last_clean":"2024-04-25T02:08:48.901318+0000","last_became_active":"2024-04-25T02:08:48.897508+0000","last_became_peered":"2024-04-25T02:08:48.897508+0000","last_unstale":"2024-04-25T02:08:48.901318+0000","last_undegraded":"2024-04-25T02:08:48.901318+0000","last_fullsized":"2024-04-25T02:08:48.901318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:24:03.301612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893945+0000","last_change":"2024-04-25T02:08:48.900135+0000","last_active":"2024-04-25T02:08:49.893945+0000","last_peered":"2024-04-25T02:08:49.893945+0000","last_clean":"2024-04-25T02:08:49.893945+0000","last_became_active":"2024-04-25T02:08:48.899760+0000","last_became_peered":"2024-04-25T02:08:48.899760+0000","last_unstale":"2024-04-25T02:08:49.893945+0000","last_undegraded":"2024-04-25T02:08:49.893945+0000","last_fullsized":"2024-04-25T02:08:49.893945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:50.110378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.890953+0000","last_change":"2024-04-25T02:08:48.889885+0000","last_active":"2024-04-25T02:08:48.890953+0000","last_peered":"2024-04-25T02:08:48.890953+0000","last_clean":"2024-04-25T02:08:48.890953+0000","last_became_active":"2024-04-25T02:08:48.889638+0000","last_became_peered":"2024-04-25T02:08:48.889638+0000","last_unstale":"2024-04-25T02:08:48.890953+0000","last_undegraded":"2024-04-25T02:08:48.890953+0000","last_fullsized":"2024-04-25T02:08:48.890953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:29:30.759531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.890254+0000","last_change":"2024-04-25T02:08:48.883950+0000","last_active":"2024-04-25T02:08:48.890254+0000","last_peered":"2024-04-25T02:08:48.890254+0000","last_clean":"2024-04-25T02:08:48.890254+0000","last_became_active":"2024-04-25T02:08:48.883679+0000","last_became_peered":"2024-04-25T02:08:48.883679+0000","last_unstale":"2024-04-25T02:08:48.890254+0000","last_undegraded":"2024-04-25T02:08:48.890254+0000","last_fullsized":"2024-04-25T02:08:48.890254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:59:17.017591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893624+0000","last_change":"2024-04-25T02:08:48.896372+0000","last_active":"2024-04-25T02:08:49.893624+0000","last_peered":"2024-04-25T02:08:49.893624+0000","last_clean":"2024-04-25T02:08:49.893624+0000","last_became_active":"2024-04-25T02:08:48.896071+0000","last_became_peered":"2024-04-25T02:08:48.896071+0000","last_unstale":"2024-04-25T02:08:49.893624+0000","last_undegraded":"2024-04-25T02:08:49.893624+0000","last_fullsized":"2024-04-25T02:08:49.893624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:58.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.911649+0000","last_change":"2024-04-25T02:08:48.903795+0000","last_active":"2024-04-25T02:08:48.911649+0000","last_peered":"2024-04-25T02:08:48.911649+0000","last_clean":"2024-04-25T02:08:48.911649+0000","last_became_active":"2024-04-25T02:08:48.903456+0000","last_became_peered":"2024-04-25T02:08:48.903456+0000","last_unstale":"2024-04-25T02:08:48.911649+0000","last_undegraded":"2024-04-25T02:08:48.911649+0000","last_fullsized":"2024-04-25T02:08:48.911649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:13.686545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.906296+0000","last_change":"2024-04-25T02:08:48.901161+0000","last_active":"2024-04-25T02:08:48.906296+0000","last_peered":"2024-04-25T02:08:48.906296+0000","last_clean":"2024-04-25T02:08:48.906296+0000","last_became_active":"2024-04-25T02:08:48.900769+0000","last_became_peered":"2024-04-25T02:08:48.900769+0000","last_unstale":"2024-04-25T02:08:48.906296+0000","last_undegraded":"2024-04-25T02:08:48.906296+0000","last_fullsized":"2024-04-25T02:08:48.906296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:43.906271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.898717+0000","last_change":"2024-04-25T02:08:48.897157+0000","last_active":"2024-04-25T02:08:48.898717+0000","last_peered":"2024-04-25T02:08:48.898717+0000","last_clean":"2024-04-25T02:08:48.898717+0000","last_became_active":"2024-04-25T02:08:48.896697+0000","last_became_peered":"2024-04-25T02:08:48.896697+0000","last_unstale":"2024-04-25T02:08:48.898717+0000","last_undegraded":"2024-04-25T02:08:48.898717+0000","last_fullsized":"2024-04-25T02:08:48.898717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:01.122216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.900867+0000","last_change":"2024-04-25T02:08:48.897428+0000","last_active":"2024-04-25T02:08:48.900867+0000","last_peered":"2024-04-25T02:08:48.900867+0000","last_clean":"2024-04-25T02:08:48.900867+0000","last_became_active":"2024-04-25T02:08:48.896565+0000","last_became_peered":"2024-04-25T02:08:48.896565+0000","last_unstale":"2024-04-25T02:08:48.900867+0000","last_undegraded":"2024-04-25T02:08:48.900867+0000","last_fullsized":"2024-04-25T02:08:48.900867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:00.943838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.891440+0000","last_change":"2024-04-25T02:08:48.888800+0000","last_active":"2024-04-25T02:08:48.891440+0000","last_peered":"2024-04-25T02:08:48.891440+0000","last_clean":"2024-04-25T02:08:48.891440+0000","last_became_active":"2024-04-25T02:08:48.888510+0000","last_became_peered":"2024-04-25T02:08:48.888510+0000","last_unstale":"2024-04-25T02:08:48.891440+0000","last_undegraded":"2024-04-25T02:08:48.891440+0000","last_fullsized":"2024-04-25T02:08:48.891440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:56:35.122570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892883+0000","last_change":"2024-04-25T02:08:48.899829+0000","last_active":"2024-04-25T02:08:49.892883+0000","last_peered":"2024-04-25T02:08:49.892883+0000","last_clean":"2024-04-25T02:08:49.892883+0000","last_became_active":"2024-04-25T02:08:48.899476+0000","last_became_peered":"2024-04-25T02:08:48.899476+0000","last_unstale":"2024-04-25T02:08:49.892883+0000","last_undegraded":"2024-04-25T02:08:49.892883+0000","last_fullsized":"2024-04-25T02:08:49.892883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:13.686545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893048+0000","last_change":"2024-04-25T02:08:48.892656+0000","last_active":"2024-04-25T02:08:49.893048+0000","last_peered":"2024-04-25T02:08:49.893048+0000","last_clean":"2024-04-25T02:08:49.893048+0000","last_became_active":"2024-04-25T02:08:48.892351+0000","last_became_peered":"2024-04-25T02:08:48.892351+0000","last_unstale":"2024-04-25T02:08:49.893048+0000","last_undegraded":"2024-04-25T02:08:49.893048+0000","last_fullsized":"2024-04-25T02:08:49.893048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:55.327825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.877913+0000","last_change":"2024-04-25T02:08:48.893405+0000","last_active":"2024-04-25T02:08:50.877913+0000","last_peered":"2024-04-25T02:08:50.877913+0000","last_clean":"2024-04-25T02:08:50.877913+0000","last_became_active":"2024-04-25T02:08:48.893103+0000","last_became_peered":"2024-04-25T02:08:48.893103+0000","last_unstale":"2024-04-25T02:08:50.877913+0000","last_undegraded":"2024-04-25T02:08:50.877913+0000","last_fullsized":"2024-04-25T02:08:50.877913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:24:03.301612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892625+0000","last_change":"2024-04-25T02:08:48.886533+0000","last_active":"2024-04-25T02:08:49.892625+0000","last_peered":"2024-04-25T02:08:49.892625+0000","last_clean":"2024-04-25T02:08:49.892625+0000","last_became_active":"2024-04-25T02:08:48.886238+0000","last_became_peered":"2024-04-25T02:08:48.886238+0000","last_unstale":"2024-04-25T02:08:49.892625+0000","last_undegraded":"2024-04-25T02:08:49.892625+0000","last_fullsized":"2024-04-25T02:08:49.892625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:00.943838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891524+0000","last_change":"2024-04-25T02:08:48.892330+0000","last_active":"2024-04-25T02:08:49.891524+0000","last_peered":"2024-04-25T02:08:49.891524+0000","last_clean":"2024-04-25T02:08:49.891524+0000","last_became_active":"2024-04-25T02:08:48.892055+0000","last_became_peered":"2024-04-25T02:08:48.892055+0000","last_unstale":"2024-04-25T02:08:49.891524+0000","last_undegraded":"2024-04-25T02:08:49.891524+0000","last_fullsized":"2024-04-25T02:08:49.891524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:44.016450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.902445+0000","last_change":"2024-04-25T02:08:48.898506+0000","last_active":"2024-04-25T02:08:48.902445+0000","last_peered":"2024-04-25T02:08:48.902445+0000","last_clean":"2024-04-25T02:08:48.902445+0000","last_became_active":"2024-04-25T02:08:48.898269+0000","last_became_peered":"2024-04-25T02:08:48.898269+0000","last_unstale":"2024-04-25T02:08:48.902445+0000","last_undegraded":"2024-04-25T02:08:48.902445+0000","last_fullsized":"2024-04-25T02:08:48.902445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:50.516195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891727+0000","last_change":"2024-04-25T02:08:48.893721+0000","last_active":"2024-04-25T02:08:49.891727+0000","last_peered":"2024-04-25T02:08:49.891727+0000","last_clean":"2024-04-25T02:08:49.891727+0000","last_became_active":"2024-04-25T02:08:48.893457+0000","last_became_peered":"2024-04-25T02:08:48.893457+0000","last_unstale":"2024-04-25T02:08:49.891727+0000","last_undegraded":"2024-04-25T02:08:49.891727+0000","last_fullsized":"2024-04-25T02:08:49.891727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:58.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893967+0000","last_change":"2024-04-25T02:08:48.896007+0000","last_active":"2024-04-25T02:08:49.893967+0000","last_peered":"2024-04-25T02:08:49.893967+0000","last_clean":"2024-04-25T02:08:49.893967+0000","last_became_active":"2024-04-25T02:08:48.895728+0000","last_became_peered":"2024-04-25T02:08:48.895728+0000","last_unstale":"2024-04-25T02:08:49.893967+0000","last_undegraded":"2024-04-25T02:08:49.893967+0000","last_fullsized":"2024-04-25T02:08:49.893967+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:11.869427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892969+0000","last_change":"2024-04-25T02:08:48.903103+0000","last_active":"2024-04-25T02:08:49.892969+0000","last_peered":"2024-04-25T02:08:49.892969+0000","last_clean":"2024-04-25T02:08:49.892969+0000","last_became_active":"2024-04-25T02:08:48.902835+0000","last_became_peered":"2024-04-25T02:08:48.902835+0000","last_unstale":"2024-04-25T02:08:49.892969+0000","last_undegraded":"2024-04-25T02:08:49.892969+0000","last_fullsized":"2024-04-25T02:08:49.892969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:01.122216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.906358+0000","last_change":"2024-04-25T02:08:48.901850+0000","last_active":"2024-04-25T02:08:48.906358+0000","last_peered":"2024-04-25T02:08:48.906358+0000","last_clean":"2024-04-25T02:08:48.906358+0000","last_became_active":"2024-04-25T02:08:48.901580+0000","last_became_peered":"2024-04-25T02:08:48.901580+0000","last_unstale":"2024-04-25T02:08:48.906358+0000","last_undegraded":"2024-04-25T02:08:48.906358+0000","last_fullsized":"2024-04-25T02:08:48.906358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:59:17.017591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.900615+0000","last_change":"2024-04-25T02:08:48.895473+0000","last_active":"2024-04-25T02:08:48.900615+0000","last_peered":"2024-04-25T02:08:48.900615+0000","last_clean":"2024-04-25T02:08:48.900615+0000","last_became_active":"2024-04-25T02:08:48.895194+0000","last_became_peered":"2024-04-25T02:08:48.895194+0000","last_unstale":"2024-04-25T02:08:48.900615+0000","last_undegraded":"2024-04-25T02:08:48.900615+0000","last_fullsized":"2024-04-25T02:08:48.900615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:14.433776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.903633+0000","last_change":"2024-04-25T02:08:48.898790+0000","last_active":"2024-04-25T02:08:48.903633+0000","last_peered":"2024-04-25T02:08:48.903633+0000","last_clean":"2024-04-25T02:08:48.903633+0000","last_became_active":"2024-04-25T02:08:48.898511+0000","last_became_peered":"2024-04-25T02:08:48.898511+0000","last_unstale":"2024-04-25T02:08:48.903633+0000","last_undegraded":"2024-04-25T02:08:48.903633+0000","last_fullsized":"2024-04-25T02:08:48.903633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:58.048729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.878066+0000","last_change":"2024-04-25T02:08:48.892727+0000","last_active":"2024-04-25T02:08:50.878066+0000","last_peered":"2024-04-25T02:08:50.878066+0000","last_clean":"2024-04-25T02:08:50.878066+0000","last_became_active":"2024-04-25T02:08:48.892477+0000","last_became_peered":"2024-04-25T02:08:48.892477+0000","last_unstale":"2024-04-25T02:08:50.878066+0000","last_undegraded":"2024-04-25T02:08:50.878066+0000","last_fullsized":"2024-04-25T02:08:50.878066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:59:17.017591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.906822+0000","last_change":"2024-04-25T02:08:47.889452+0000","last_active":"2024-04-25T02:08:48.906822+0000","last_peered":"2024-04-25T02:08:48.906822+0000","last_clean":"2024-04-25T02:08:48.906822+0000","last_became_active":"2024-04-25T02:08:47.889183+0000","last_became_peered":"2024-04-25T02:08:47.889183+0000","last_unstale":"2024-04-25T02:08:48.906822+0000","last_undegraded":"2024-04-25T02:08:48.906822+0000","last_fullsized":"2024-04-25T02:08:48.906822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:54.128942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.912100+0000","last_change":"2024-04-25T02:08:48.906844+0000","last_active":"2024-04-25T02:08:48.912100+0000","last_peered":"2024-04-25T02:08:48.912100+0000","last_clean":"2024-04-25T02:08:48.912100+0000","last_became_active":"2024-04-25T02:08:48.906456+0000","last_became_peered":"2024-04-25T02:08:48.906456+0000","last_unstale":"2024-04-25T02:08:48.912100+0000","last_undegraded":"2024-04-25T02:08:48.912100+0000","last_fullsized":"2024-04-25T02:08:48.912100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:52:20.093850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.878032+0000","last_change":"2024-04-25T02:08:47.890551+0000","last_active":"2024-04-25T02:08:50.878032+0000","last_peered":"2024-04-25T02:08:50.878032+0000","last_clean":"2024-04-25T02:08:50.878032+0000","last_became_active":"2024-04-25T02:08:47.890248+0000","last_became_peered":"2024-04-25T02:08:47.890248+0000","last_unstale":"2024-04-25T02:08:50.878032+0000","last_undegraded":"2024-04-25T02:08:50.878032+0000","last_fullsized":"2024-04-25T02:08:50.878032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:23:41.115929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893163+0000","last_change":"2024-04-25T02:08:48.893719+0000","last_active":"2024-04-25T02:08:49.893163+0000","last_peered":"2024-04-25T02:08:49.893163+0000","last_clean":"2024-04-25T02:08:49.893163+0000","last_became_active":"2024-04-25T02:08:48.893392+0000","last_became_peered":"2024-04-25T02:08:48.893392+0000","last_unstale":"2024-04-25T02:08:49.893163+0000","last_undegraded":"2024-04-25T02:08:49.893163+0000","last_fullsized":"2024-04-25T02:08:49.893163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:00.943838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.905105+0000","last_change":"2024-04-25T02:08:47.893357+0000","last_active":"2024-04-25T02:08:48.905105+0000","last_peered":"2024-04-25T02:08:48.905105+0000","last_clean":"2024-04-25T02:08:48.905105+0000","last_became_active":"2024-04-25T02:08:47.892649+0000","last_became_peered":"2024-04-25T02:08:47.892649+0000","last_unstale":"2024-04-25T02:08:48.905105+0000","last_undegraded":"2024-04-25T02:08:48.905105+0000","last_fullsized":"2024-04-25T02:08:48.905105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:01.663864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891768+0000","last_change":"2024-04-25T02:08:48.889935+0000","last_active":"2024-04-25T02:08:49.891768+0000","last_peered":"2024-04-25T02:08:49.891768+0000","last_clean":"2024-04-25T02:08:49.891768+0000","last_became_active":"2024-04-25T02:08:48.889668+0000","last_became_peered":"2024-04-25T02:08:48.889668+0000","last_unstale":"2024-04-25T02:08:49.891768+0000","last_undegraded":"2024-04-25T02:08:49.891768+0000","last_fullsized":"2024-04-25T02:08:49.891768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:50.516195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.907127+0000","last_change":"2024-04-25T02:08:47.897549+0000","last_active":"2024-04-25T02:08:48.907127+0000","last_peered":"2024-04-25T02:08:48.907127+0000","last_clean":"2024-04-25T02:08:48.907127+0000","last_became_active":"2024-04-25T02:08:47.897234+0000","last_became_peered":"2024-04-25T02:08:47.897234+0000","last_unstale":"2024-04-25T02:08:48.907127+0000","last_undegraded":"2024-04-25T02:08:48.907127+0000","last_fullsized":"2024-04-25T02:08:48.907127+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:31:30.967966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.897376+0000","last_change":"2024-04-25T02:08:48.894623+0000","last_active":"2024-04-25T02:08:48.897376+0000","last_peered":"2024-04-25T02:08:48.897376+0000","last_clean":"2024-04-25T02:08:48.897376+0000","last_became_active":"2024-04-25T02:08:48.894358+0000","last_became_peered":"2024-04-25T02:08:48.894358+0000","last_unstale":"2024-04-25T02:08:48.897376+0000","last_undegraded":"2024-04-25T02:08:48.897376+0000","last_fullsized":"2024-04-25T02:08:48.897376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:44.719305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893026+0000","last_change":"2024-04-25T02:08:47.888169+0000","last_active":"2024-04-25T02:08:49.893026+0000","last_peered":"2024-04-25T02:08:49.893026+0000","last_clean":"2024-04-25T02:08:49.893026+0000","last_became_active":"2024-04-25T02:08:47.887852+0000","last_became_peered":"2024-04-25T02:08:47.887852+0000","last_unstale":"2024-04-25T02:08:49.893026+0000","last_undegraded":"2024-04-25T02:08:49.893026+0000","last_fullsized":"2024-04-25T02:08:49.893026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:54.128942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893617+0000","last_change":"2024-04-25T02:08:48.896093+0000","last_active":"2024-04-25T02:08:49.893617+0000","last_peered":"2024-04-25T02:08:49.893617+0000","last_clean":"2024-04-25T02:08:49.893617+0000","last_became_active":"2024-04-25T02:08:48.895794+0000","last_became_peered":"2024-04-25T02:08:48.895794+0000","last_unstale":"2024-04-25T02:08:49.893617+0000","last_undegraded":"2024-04-25T02:08:49.893617+0000","last_fullsized":"2024-04-25T02:08:49.893617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:44.016450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893158+0000","last_change":"2024-04-25T02:08:47.888121+0000","last_active":"2024-04-25T02:08:49.893158+0000","last_peered":"2024-04-25T02:08:49.893158+0000","last_clean":"2024-04-25T02:08:49.893158+0000","last_became_active":"2024-04-25T02:08:47.887833+0000","last_became_peered":"2024-04-25T02:08:47.887833+0000","last_unstale":"2024-04-25T02:08:49.893158+0000","last_undegraded":"2024-04-25T02:08:49.893158+0000","last_fullsized":"2024-04-25T02:08:49.893158+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:38.135074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892554+0000","last_change":"2024-04-25T02:08:48.895078+0000","last_active":"2024-04-25T02:08:49.892554+0000","last_peered":"2024-04-25T02:08:49.892554+0000","last_clean":"2024-04-25T02:08:49.892554+0000","last_became_active":"2024-04-25T02:08:48.894796+0000","last_became_peered":"2024-04-25T02:08:48.894796+0000","last_unstale":"2024-04-25T02:08:49.892554+0000","last_undegraded":"2024-04-25T02:08:49.892554+0000","last_fullsized":"2024-04-25T02:08:49.892554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:59:17.017591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.875647+0000","last_change":"2024-04-25T02:08:47.888369+0000","last_active":"2024-04-25T02:08:48.875647+0000","last_peered":"2024-04-25T02:08:48.875647+0000","last_clean":"2024-04-25T02:08:48.875647+0000","last_became_active":"2024-04-25T02:08:47.888090+0000","last_became_peered":"2024-04-25T02:08:47.888090+0000","last_unstale":"2024-04-25T02:08:48.875647+0000","last_undegraded":"2024-04-25T02:08:48.875647+0000","last_fullsized":"2024-04-25T02:08:48.875647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:43.717370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891169+0000","last_change":"2024-04-25T02:08:48.890425+0000","last_active":"2024-04-25T02:08:49.891169+0000","last_peered":"2024-04-25T02:08:49.891169+0000","last_clean":"2024-04-25T02:08:49.891169+0000","last_became_active":"2024-04-25T02:08:48.889806+0000","last_became_peered":"2024-04-25T02:08:48.889806+0000","last_unstale":"2024-04-25T02:08:49.891169+0000","last_undegraded":"2024-04-25T02:08:49.891169+0000","last_fullsized":"2024-04-25T02:08:49.891169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:18.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892540+0000","last_change":"2024-04-25T02:08:47.887115+0000","last_active":"2024-04-25T02:08:49.892540+0000","last_peered":"2024-04-25T02:08:49.892540+0000","last_clean":"2024-04-25T02:08:49.892540+0000","last_became_active":"2024-04-25T02:08:47.886819+0000","last_became_peered":"2024-04-25T02:08:47.886819+0000","last_unstale":"2024-04-25T02:08:49.892540+0000","last_undegraded":"2024-04-25T02:08:49.892540+0000","last_fullsized":"2024-04-25T02:08:49.892540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:13.431841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893734+0000","last_change":"2024-04-25T02:08:48.899813+0000","last_active":"2024-04-25T02:08:49.893734+0000","last_peered":"2024-04-25T02:08:49.893734+0000","last_clean":"2024-04-25T02:08:49.893734+0000","last_became_active":"2024-04-25T02:08:48.899517+0000","last_became_peered":"2024-04-25T02:08:48.899517+0000","last_unstale":"2024-04-25T02:08:49.893734+0000","last_undegraded":"2024-04-25T02:08:49.893734+0000","last_fullsized":"2024-04-25T02:08:49.893734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:50.516195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.876919+0000","last_change":"2024-04-25T02:08:47.892734+0000","last_active":"2024-04-25T02:08:48.876919+0000","last_peered":"2024-04-25T02:08:48.876919+0000","last_clean":"2024-04-25T02:08:48.876919+0000","last_became_active":"2024-04-25T02:08:47.892176+0000","last_became_peered":"2024-04-25T02:08:47.892176+0000","last_unstale":"2024-04-25T02:08:48.876919+0000","last_undegraded":"2024-04-25T02:08:48.876919+0000","last_fullsized":"2024-04-25T02:08:48.876919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:42.904336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.898891+0000","last_change":"2024-04-25T02:08:48.896647+0000","last_active":"2024-04-25T02:08:48.898891+0000","last_peered":"2024-04-25T02:08:48.898891+0000","last_clean":"2024-04-25T02:08:48.898891+0000","last_became_active":"2024-04-25T02:08:48.896339+0000","last_became_peered":"2024-04-25T02:08:48.896339+0000","last_unstale":"2024-04-25T02:08:48.898891+0000","last_undegraded":"2024-04-25T02:08:48.898891+0000","last_fullsized":"2024-04-25T02:08:48.898891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:13.686545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.878148+0000","last_change":"2024-04-25T02:08:47.888330+0000","last_active":"2024-04-25T02:08:50.878148+0000","last_peered":"2024-04-25T02:08:50.878148+0000","last_clean":"2024-04-25T02:08:50.878148+0000","last_became_active":"2024-04-25T02:08:47.888070+0000","last_became_peered":"2024-04-25T02:08:47.888070+0000","last_unstale":"2024-04-25T02:08:50.878148+0000","last_undegraded":"2024-04-25T02:08:50.878148+0000","last_fullsized":"2024-04-25T02:08:50.878148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:35.980344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.905240+0000","last_change":"2024-04-25T02:08:48.901730+0000","last_active":"2024-04-25T02:08:48.905240+0000","last_peered":"2024-04-25T02:08:48.905240+0000","last_clean":"2024-04-25T02:08:48.905240+0000","last_became_active":"2024-04-25T02:08:48.901311+0000","last_became_peered":"2024-04-25T02:08:48.901311+0000","last_unstale":"2024-04-25T02:08:48.905240+0000","last_undegraded":"2024-04-25T02:08:48.905240+0000","last_fullsized":"2024-04-25T02:08:48.905240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:26.953905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.894019+0000","last_change":"2024-04-25T02:08:47.891207+0000","last_active":"2024-04-25T02:08:49.894019+0000","last_peered":"2024-04-25T02:08:49.894019+0000","last_clean":"2024-04-25T02:08:49.894019+0000","last_became_active":"2024-04-25T02:08:47.890481+0000","last_became_peered":"2024-04-25T02:08:47.890481+0000","last_unstale":"2024-04-25T02:08:49.894019+0000","last_undegraded":"2024-04-25T02:08:49.894019+0000","last_fullsized":"2024-04-25T02:08:49.894019+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:11:49.496068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893870+0000","last_change":"2024-04-25T02:08:48.894773+0000","last_active":"2024-04-25T02:08:49.893870+0000","last_peered":"2024-04-25T02:08:49.893870+0000","last_clean":"2024-04-25T02:08:49.893870+0000","last_became_active":"2024-04-25T02:08:48.894125+0000","last_became_peered":"2024-04-25T02:08:48.894125+0000","last_unstale":"2024-04-25T02:08:49.893870+0000","last_undegraded":"2024-04-25T02:08:49.893870+0000","last_fullsized":"2024-04-25T02:08:49.893870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:26.953905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.908521+0000","last_change":"2024-04-25T02:08:47.893180+0000","last_active":"2024-04-25T02:08:48.908521+0000","last_peered":"2024-04-25T02:08:48.908521+0000","last_clean":"2024-04-25T02:08:48.908521+0000","last_became_active":"2024-04-25T02:08:47.892861+0000","last_became_peered":"2024-04-25T02:08:47.892861+0000","last_unstale":"2024-04-25T02:08:48.908521+0000","last_undegraded":"2024-04-25T02:08:48.908521+0000","last_fullsized":"2024-04-25T02:08:48.908521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:57.046794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891186+0000","last_change":"2024-04-25T02:08:48.895585+0000","last_active":"2024-04-25T02:08:49.891186+0000","last_peered":"2024-04-25T02:08:49.891186+0000","last_clean":"2024-04-25T02:08:49.891186+0000","last_became_active":"2024-04-25T02:08:48.893056+0000","last_became_peered":"2024-04-25T02:08:48.893056+0000","last_unstale":"2024-04-25T02:08:49.891186+0000","last_undegraded":"2024-04-25T02:08:49.891186+0000","last_fullsized":"2024-04-25T02:08:49.891186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:13.686545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893089+0000","last_change":"2024-04-25T02:08:47.887145+0000","last_active":"2024-04-25T02:08:49.893089+0000","last_peered":"2024-04-25T02:08:49.893089+0000","last_clean":"2024-04-25T02:08:49.893089+0000","last_became_active":"2024-04-25T02:08:47.886861+0000","last_became_peered":"2024-04-25T02:08:47.886861+0000","last_unstale":"2024-04-25T02:08:49.893089+0000","last_undegraded":"2024-04-25T02:08:49.893089+0000","last_fullsized":"2024-04-25T02:08:49.893089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:23:41.115929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.900837+0000","last_change":"2024-04-25T02:08:48.897195+0000","last_active":"2024-04-25T02:08:48.900837+0000","last_peered":"2024-04-25T02:08:48.900837+0000","last_clean":"2024-04-25T02:08:48.900837+0000","last_became_active":"2024-04-25T02:08:48.896790+0000","last_became_peered":"2024-04-25T02:08:48.896790+0000","last_unstale":"2024-04-25T02:08:48.900837+0000","last_undegraded":"2024-04-25T02:08:48.900837+0000","last_fullsized":"2024-04-25T02:08:48.900837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:44.016450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891232+0000","last_change":"2024-04-25T02:08:47.889201+0000","last_active":"2024-04-25T02:08:49.891232+0000","last_peered":"2024-04-25T02:08:49.891232+0000","last_clean":"2024-04-25T02:08:49.891232+0000","last_became_active":"2024-04-25T02:08:47.888935+0000","last_became_peered":"2024-04-25T02:08:47.888935+0000","last_unstale":"2024-04-25T02:08:49.891232+0000","last_undegraded":"2024-04-25T02:08:49.891232+0000","last_fullsized":"2024-04-25T02:08:49.891232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:13.431841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.906485+0000","last_change":"2024-04-25T02:08:48.902659+0000","last_active":"2024-04-25T02:08:48.906485+0000","last_peered":"2024-04-25T02:08:48.906485+0000","last_clean":"2024-04-25T02:08:48.906485+0000","last_became_active":"2024-04-25T02:08:48.902383+0000","last_became_peered":"2024-04-25T02:08:48.902383+0000","last_unstale":"2024-04-25T02:08:48.906485+0000","last_undegraded":"2024-04-25T02:08:48.906485+0000","last_fullsized":"2024-04-25T02:08:48.906485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:18.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.876065+0000","last_change":"2024-04-25T02:08:47.892780+0000","last_active":"2024-04-25T02:08:48.876065+0000","last_peered":"2024-04-25T02:08:48.876065+0000","last_clean":"2024-04-25T02:08:48.876065+0000","last_became_active":"2024-04-25T02:08:47.892248+0000","last_became_peered":"2024-04-25T02:08:47.892248+0000","last_unstale":"2024-04-25T02:08:48.876065+0000","last_undegraded":"2024-04-25T02:08:48.876065+0000","last_fullsized":"2024-04-25T02:08:48.876065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:20.086880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.912090+0000","last_change":"2024-04-25T02:08:48.906885+0000","last_active":"2024-04-25T02:08:48.912090+0000","last_peered":"2024-04-25T02:08:48.912090+0000","last_clean":"2024-04-25T02:08:48.912090+0000","last_became_active":"2024-04-25T02:08:48.906604+0000","last_became_peered":"2024-04-25T02:08:48.906604+0000","last_unstale":"2024-04-25T02:08:48.912090+0000","last_undegraded":"2024-04-25T02:08:48.912090+0000","last_fullsized":"2024-04-25T02:08:48.912090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:11:50.498003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.905431+0000","last_change":"2024-04-25T02:08:47.886749+0000","last_active":"2024-04-25T02:08:48.905431+0000","last_peered":"2024-04-25T02:08:48.905431+0000","last_clean":"2024-04-25T02:08:48.905431+0000","last_became_active":"2024-04-25T02:08:47.886466+0000","last_became_peered":"2024-04-25T02:08:47.886466+0000","last_unstale":"2024-04-25T02:08:48.905431+0000","last_undegraded":"2024-04-25T02:08:48.905431+0000","last_fullsized":"2024-04-25T02:08:48.905431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:11:49.496068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.894062+0000","last_change":"2024-04-25T02:08:48.889300+0000","last_active":"2024-04-25T02:08:49.894062+0000","last_peered":"2024-04-25T02:08:49.894062+0000","last_clean":"2024-04-25T02:08:49.894062+0000","last_became_active":"2024-04-25T02:08:48.887189+0000","last_became_peered":"2024-04-25T02:08:48.887189+0000","last_unstale":"2024-04-25T02:08:49.894062+0000","last_undegraded":"2024-04-25T02:08:49.894062+0000","last_fullsized":"2024-04-25T02:08:49.894062+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:44.016450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891549+0000","last_change":"2024-04-25T02:08:47.885666+0000","last_active":"2024-04-25T02:08:49.891549+0000","last_peered":"2024-04-25T02:08:49.891549+0000","last_clean":"2024-04-25T02:08:49.891549+0000","last_became_active":"2024-04-25T02:08:47.883517+0000","last_became_peered":"2024-04-25T02:08:47.883517+0000","last_unstale":"2024-04-25T02:08:49.891549+0000","last_undegraded":"2024-04-25T02:08:49.891549+0000","last_fullsized":"2024-04-25T02:08:49.891549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:35.980344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893946+0000","last_change":"2024-04-25T02:08:48.887995+0000","last_active":"2024-04-25T02:08:49.893946+0000","last_peered":"2024-04-25T02:08:49.893946+0000","last_clean":"2024-04-25T02:08:49.893946+0000","last_became_active":"2024-04-25T02:08:48.887729+0000","last_became_peered":"2024-04-25T02:08:48.887729+0000","last_unstale":"2024-04-25T02:08:49.893946+0000","last_undegraded":"2024-04-25T02:08:49.893946+0000","last_fullsized":"2024-04-25T02:08:49.893946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:01.399560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.894187+0000","last_change":"2024-04-25T02:08:47.886194+0000","last_active":"2024-04-25T02:08:49.894187+0000","last_peered":"2024-04-25T02:08:49.894187+0000","last_clean":"2024-04-25T02:08:49.894187+0000","last_became_active":"2024-04-25T02:08:47.885867+0000","last_became_peered":"2024-04-25T02:08:47.885867+0000","last_unstale":"2024-04-25T02:08:49.894187+0000","last_undegraded":"2024-04-25T02:08:49.894187+0000","last_fullsized":"2024-04-25T02:08:49.894187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:35.980344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891460+0000","last_change":"2024-04-25T02:08:48.889434+0000","last_active":"2024-04-25T02:08:49.891460+0000","last_peered":"2024-04-25T02:08:49.891460+0000","last_clean":"2024-04-25T02:08:49.891460+0000","last_became_active":"2024-04-25T02:08:48.889201+0000","last_became_peered":"2024-04-25T02:08:48.889201+0000","last_unstale":"2024-04-25T02:08:49.891460+0000","last_undegraded":"2024-04-25T02:08:49.891460+0000","last_fullsized":"2024-04-25T02:08:49.891460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:55.327825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.894085+0000","last_change":"2024-04-25T02:08:47.888054+0000","last_active":"2024-04-25T02:08:49.894085+0000","last_peered":"2024-04-25T02:08:49.894085+0000","last_clean":"2024-04-25T02:08:49.894085+0000","last_became_active":"2024-04-25T02:08:47.887644+0000","last_became_peered":"2024-04-25T02:08:47.887644+0000","last_unstale":"2024-04-25T02:08:49.894085+0000","last_undegraded":"2024-04-25T02:08:49.894085+0000","last_fullsized":"2024-04-25T02:08:49.894085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:06.291375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.891281+0000","last_change":"2024-04-25T02:08:48.890130+0000","last_active":"2024-04-25T02:08:48.891281+0000","last_peered":"2024-04-25T02:08:48.891281+0000","last_clean":"2024-04-25T02:08:48.891281+0000","last_became_active":"2024-04-25T02:08:48.889853+0000","last_became_peered":"2024-04-25T02:08:48.889853+0000","last_unstale":"2024-04-25T02:08:48.891281+0000","last_undegraded":"2024-04-25T02:08:48.891281+0000","last_fullsized":"2024-04-25T02:08:48.891281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:50.993255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893258+0000","last_change":"2024-04-25T02:08:47.889037+0000","last_active":"2024-04-25T02:08:49.893258+0000","last_peered":"2024-04-25T02:08:49.893258+0000","last_clean":"2024-04-25T02:08:49.893258+0000","last_became_active":"2024-04-25T02:08:47.888761+0000","last_became_peered":"2024-04-25T02:08:47.888761+0000","last_unstale":"2024-04-25T02:08:49.893258+0000","last_undegraded":"2024-04-25T02:08:49.893258+0000","last_fullsized":"2024-04-25T02:08:49.893258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:39.015308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.895847+0000","last_change":"2024-04-25T02:08:48.894591+0000","last_active":"2024-04-25T02:08:48.895847+0000","last_peered":"2024-04-25T02:08:48.895847+0000","last_clean":"2024-04-25T02:08:48.895847+0000","last_became_active":"2024-04-25T02:08:48.894300+0000","last_became_peered":"2024-04-25T02:08:48.894300+0000","last_unstale":"2024-04-25T02:08:48.895847+0000","last_undegraded":"2024-04-25T02:08:48.895847+0000","last_fullsized":"2024-04-25T02:08:48.895847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:55:28.126408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.878033+0000","last_change":"2024-04-25T02:08:47.897248+0000","last_active":"2024-04-25T02:08:50.878033+0000","last_peered":"2024-04-25T02:08:50.878033+0000","last_clean":"2024-04-25T02:08:50.878033+0000","last_became_active":"2024-04-25T02:08:47.896985+0000","last_became_peered":"2024-04-25T02:08:47.896985+0000","last_unstale":"2024-04-25T02:08:50.878033+0000","last_undegraded":"2024-04-25T02:08:50.878033+0000","last_fullsized":"2024-04-25T02:08:50.878033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:45.633249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.895873+0000","last_change":"2024-04-25T02:08:48.893965+0000","last_active":"2024-04-25T02:08:48.895873+0000","last_peered":"2024-04-25T02:08:48.895873+0000","last_clean":"2024-04-25T02:08:48.895873+0000","last_became_active":"2024-04-25T02:08:48.893652+0000","last_became_peered":"2024-04-25T02:08:48.893652+0000","last_unstale":"2024-04-25T02:08:48.895873+0000","last_undegraded":"2024-04-25T02:08:48.895873+0000","last_fullsized":"2024-04-25T02:08:48.895873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:30.802710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.895243+0000","last_change":"2024-04-25T02:08:47.892633+0000","last_active":"2024-04-25T02:08:48.895243+0000","last_peered":"2024-04-25T02:08:48.895243+0000","last_clean":"2024-04-25T02:08:48.895243+0000","last_became_active":"2024-04-25T02:08:47.892319+0000","last_became_peered":"2024-04-25T02:08:47.892319+0000","last_unstale":"2024-04-25T02:08:48.895243+0000","last_undegraded":"2024-04-25T02:08:48.895243+0000","last_fullsized":"2024-04-25T02:08:48.895243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:23:41.115929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.895796+0000","last_change":"2024-04-25T02:08:48.893959+0000","last_active":"2024-04-25T02:08:48.895796+0000","last_peered":"2024-04-25T02:08:48.895796+0000","last_clean":"2024-04-25T02:08:48.895796+0000","last_became_active":"2024-04-25T02:08:48.893697+0000","last_became_peered":"2024-04-25T02:08:48.893697+0000","last_unstale":"2024-04-25T02:08:48.895796+0000","last_undegraded":"2024-04-25T02:08:48.895796+0000","last_fullsized":"2024-04-25T02:08:48.895796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:36:37.437633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892733+0000","last_change":"2024-04-25T02:08:47.884327+0000","last_active":"2024-04-25T02:08:49.892733+0000","last_peered":"2024-04-25T02:08:49.892733+0000","last_clean":"2024-04-25T02:08:49.892733+0000","last_became_active":"2024-04-25T02:08:47.884042+0000","last_became_peered":"2024-04-25T02:08:47.884042+0000","last_unstale":"2024-04-25T02:08:49.892733+0000","last_undegraded":"2024-04-25T02:08:49.892733+0000","last_fullsized":"2024-04-25T02:08:49.892733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:45.633249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.898194+0000","last_change":"2024-04-25T02:08:48.896069+0000","last_active":"2024-04-25T02:08:48.898194+0000","last_peered":"2024-04-25T02:08:48.898194+0000","last_clean":"2024-04-25T02:08:48.898194+0000","last_became_active":"2024-04-25T02:08:48.895779+0000","last_became_peered":"2024-04-25T02:08:48.895779+0000","last_unstale":"2024-04-25T02:08:48.898194+0000","last_undegraded":"2024-04-25T02:08:48.898194+0000","last_fullsized":"2024-04-25T02:08:48.898194+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:21.088815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893291+0000","last_change":"2024-04-25T02:08:47.890372+0000","last_active":"2024-04-25T02:08:49.893291+0000","last_peered":"2024-04-25T02:08:49.893291+0000","last_clean":"2024-04-25T02:08:49.893291+0000","last_became_active":"2024-04-25T02:08:47.890025+0000","last_became_peered":"2024-04-25T02:08:47.890025+0000","last_unstale":"2024-04-25T02:08:49.893291+0000","last_undegraded":"2024-04-25T02:08:49.893291+0000","last_fullsized":"2024-04-25T02:08:49.893291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:43.717370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.890911+0000","last_change":"2024-04-25T02:08:48.888133+0000","last_active":"2024-04-25T02:08:48.890911+0000","last_peered":"2024-04-25T02:08:48.890911+0000","last_clean":"2024-04-25T02:08:48.890911+0000","last_became_active":"2024-04-25T02:08:48.887865+0000","last_became_peered":"2024-04-25T02:08:48.887865+0000","last_unstale":"2024-04-25T02:08:48.890911+0000","last_undegraded":"2024-04-25T02:08:48.890911+0000","last_fullsized":"2024-04-25T02:08:48.890911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:25.075367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891617+0000","last_change":"2024-04-25T02:08:47.888395+0000","last_active":"2024-04-25T02:08:49.891617+0000","last_peered":"2024-04-25T02:08:49.891617+0000","last_clean":"2024-04-25T02:08:49.891617+0000","last_became_active":"2024-04-25T02:08:47.888109+0000","last_became_peered":"2024-04-25T02:08:47.888109+0000","last_unstale":"2024-04-25T02:08:49.891617+0000","last_undegraded":"2024-04-25T02:08:49.891617+0000","last_fullsized":"2024-04-25T02:08:49.891617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:35:14.853788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.894161+0000","last_change":"2024-04-25T02:08:48.894010+0000","last_active":"2024-04-25T02:08:49.894161+0000","last_peered":"2024-04-25T02:08:49.894161+0000","last_clean":"2024-04-25T02:08:49.894161+0000","last_became_active":"2024-04-25T02:08:48.893710+0000","last_became_peered":"2024-04-25T02:08:48.893710+0000","last_unstale":"2024-04-25T02:08:49.894161+0000","last_undegraded":"2024-04-25T02:08:49.894161+0000","last_fullsized":"2024-04-25T02:08:49.894161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:08:20.827614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.879450+0000","last_change":"2024-04-25T02:08:47.897368+0000","last_active":"2024-04-25T02:08:50.879450+0000","last_peered":"2024-04-25T02:08:50.879450+0000","last_clean":"2024-04-25T02:08:50.879450+0000","last_became_active":"2024-04-25T02:08:47.897088+0000","last_became_peered":"2024-04-25T02:08:47.897088+0000","last_unstale":"2024-04-25T02:08:50.879450+0000","last_undegraded":"2024-04-25T02:08:50.879450+0000","last_fullsized":"2024-04-25T02:08:50.879450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:13.431841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.877996+0000","last_change":"2024-04-25T02:08:48.894231+0000","last_active":"2024-04-25T02:08:50.877996+0000","last_peered":"2024-04-25T02:08:50.877996+0000","last_clean":"2024-04-25T02:08:50.877996+0000","last_became_active":"2024-04-25T02:08:48.893974+0000","last_became_peered":"2024-04-25T02:08:48.893974+0000","last_unstale":"2024-04-25T02:08:50.877996+0000","last_undegraded":"2024-04-25T02:08:50.877996+0000","last_fullsized":"2024-04-25T02:08:50.877996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:58.048729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891473+0000","last_change":"2024-04-25T02:08:47.889358+0000","last_active":"2024-04-25T02:08:49.891473+0000","last_peered":"2024-04-25T02:08:49.891473+0000","last_clean":"2024-04-25T02:08:49.891473+0000","last_became_active":"2024-04-25T02:08:47.889023+0000","last_became_peered":"2024-04-25T02:08:47.889023+0000","last_unstale":"2024-04-25T02:08:49.891473+0000","last_undegraded":"2024-04-25T02:08:49.891473+0000","last_fullsized":"2024-04-25T02:08:49.891473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:52:19.091915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.906039+0000","last_change":"2024-04-25T02:08:48.900526+0000","last_active":"2024-04-25T02:08:48.906039+0000","last_peered":"2024-04-25T02:08:48.906039+0000","last_clean":"2024-04-25T02:08:48.906039+0000","last_became_active":"2024-04-25T02:08:48.900245+0000","last_became_peered":"2024-04-25T02:08:48.900245+0000","last_unstale":"2024-04-25T02:08:48.906039+0000","last_undegraded":"2024-04-25T02:08:48.906039+0000","last_fullsized":"2024-04-25T02:08:48.906039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:46.635184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.878150+0000","last_change":"2024-04-25T02:08:47.890642+0000","last_active":"2024-04-25T02:08:50.878150+0000","last_peered":"2024-04-25T02:08:50.878150+0000","last_clean":"2024-04-25T02:08:50.878150+0000","last_became_active":"2024-04-25T02:08:47.890374+0000","last_became_peered":"2024-04-25T02:08:47.890374+0000","last_unstale":"2024-04-25T02:08:50.878150+0000","last_undegraded":"2024-04-25T02:08:50.878150+0000","last_fullsized":"2024-04-25T02:08:50.878150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:35:14.853788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.878034+0000","last_change":"2024-04-25T02:08:48.896320+0000","last_active":"2024-04-25T02:08:50.878034+0000","last_peered":"2024-04-25T02:08:50.878034+0000","last_clean":"2024-04-25T02:08:50.878034+0000","last_became_active":"2024-04-25T02:08:48.896025+0000","last_became_peered":"2024-04-25T02:08:48.896025+0000","last_unstale":"2024-04-25T02:08:50.878034+0000","last_undegraded":"2024-04-25T02:08:50.878034+0000","last_fullsized":"2024-04-25T02:08:50.878034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:43.906271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891275+0000","last_change":"2024-04-25T02:08:47.884931+0000","last_active":"2024-04-25T02:08:49.891275+0000","last_peered":"2024-04-25T02:08:49.891275+0000","last_clean":"2024-04-25T02:08:49.891275+0000","last_became_active":"2024-04-25T02:08:47.884633+0000","last_became_peered":"2024-04-25T02:08:47.884633+0000","last_unstale":"2024-04-25T02:08:49.891275+0000","last_undegraded":"2024-04-25T02:08:49.891275+0000","last_fullsized":"2024-04-25T02:08:49.891275+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:45.633249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.901299+0000","last_change":"2024-04-25T02:08:48.887501+0000","last_active":"2024-04-25T02:08:48.901299+0000","last_peered":"2024-04-25T02:08:48.901299+0000","last_clean":"2024-04-25T02:08:48.901299+0000","last_became_active":"2024-04-25T02:08:48.887253+0000","last_became_peered":"2024-04-25T02:08:48.887253+0000","last_unstale":"2024-04-25T02:08:48.901299+0000","last_undegraded":"2024-04-25T02:08:48.901299+0000","last_fullsized":"2024-04-25T02:08:48.901299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:18.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892853+0000","last_change":"2024-04-25T02:08:47.883718+0000","last_active":"2024-04-25T02:08:49.892853+0000","last_peered":"2024-04-25T02:08:49.892853+0000","last_clean":"2024-04-25T02:08:49.892853+0000","last_became_active":"2024-04-25T02:08:47.883410+0000","last_became_peered":"2024-04-25T02:08:47.883410+0000","last_unstale":"2024-04-25T02:08:49.892853+0000","last_undegraded":"2024-04-25T02:08:49.892853+0000","last_fullsized":"2024-04-25T02:08:49.892853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:35:14.853788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892740+0000","last_change":"2024-04-25T02:08:48.892932+0000","last_active":"2024-04-25T02:08:49.892740+0000","last_peered":"2024-04-25T02:08:49.892740+0000","last_clean":"2024-04-25T02:08:49.892740+0000","last_became_active":"2024-04-25T02:08:48.892502+0000","last_became_peered":"2024-04-25T02:08:48.892502+0000","last_unstale":"2024-04-25T02:08:49.892740+0000","last_undegraded":"2024-04-25T02:08:49.892740+0000","last_fullsized":"2024-04-25T02:08:49.892740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:18.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.876181+0000","last_change":"2024-04-25T02:08:47.892970+0000","last_active":"2024-04-25T02:08:48.876181+0000","last_peered":"2024-04-25T02:08:48.876181+0000","last_clean":"2024-04-25T02:08:48.876181+0000","last_became_active":"2024-04-25T02:08:47.892376+0000","last_became_peered":"2024-04-25T02:08:47.892376+0000","last_unstale":"2024-04-25T02:08:48.876181+0000","last_undegraded":"2024-04-25T02:08:48.876181+0000","last_fullsized":"2024-04-25T02:08:48.876181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:24:02.299677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.894309+0000","last_change":"2024-04-25T02:08:48.891542+0000","last_active":"2024-04-25T02:08:48.894309+0000","last_peered":"2024-04-25T02:08:48.894309+0000","last_clean":"2024-04-25T02:08:48.894309+0000","last_became_active":"2024-04-25T02:08:48.891288+0000","last_became_peered":"2024-04-25T02:08:48.891288+0000","last_unstale":"2024-04-25T02:08:48.894309+0000","last_undegraded":"2024-04-25T02:08:48.894309+0000","last_fullsized":"2024-04-25T02:08:48.894309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:11:50.498003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.895296+0000","last_change":"2024-04-25T02:08:47.891531+0000","last_active":"2024-04-25T02:08:48.895296+0000","last_peered":"2024-04-25T02:08:48.895296+0000","last_clean":"2024-04-25T02:08:48.895296+0000","last_became_active":"2024-04-25T02:08:47.891187+0000","last_became_peered":"2024-04-25T02:08:47.891187+0000","last_unstale":"2024-04-25T02:08:48.895296+0000","last_undegraded":"2024-04-25T02:08:48.895296+0000","last_fullsized":"2024-04-25T02:08:48.895296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:35.980344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":190,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.884449+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:08:48.884449+0000","last_peered":"2024-04-25T02:08:48.884449+0000","last_clean":"2024-04-25T02:08:48.884449+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:08:48.884449+0000","last_undegraded":"2024-04-25T02:08:48.884449+0000","last_fullsized":"2024-04-25T02:08:48.884449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":728586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":138744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":145100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":144532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":139762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":138198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":146062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":734796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:08:56.230 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:08:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.331+0000 7f8977838640 1 Processor -- start 2024-04-25T02:08:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.331+0000 7f8977838640 1 -- start start 2024-04-25T02:08:56.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.332+0000 7f8977838640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f89700ca780 0x7f897015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.332+0000 7f8977838640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89700cccb0 0x7f89700cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.332+0000 7f8977838640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89700af340 con 0x7f897006d140 2024-04-25T02:08:56.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.332+0000 7f8977838640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f89700af900 con 0x7f89700cccb0 2024-04-25T02:08:56.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.332+0000 7f8977838640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f89700cc820 con 0x7f89700ca780 2024-04-25T02:08:56.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.332+0000 7f8975dd5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89700cccb0 0x7f89700cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.332+0000 7f89755d4640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f897006d140 0x7f897006d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47386/0 (socket says 172.21.15.79:47386) 2024-04-25T02:08:56.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.332+0000 7f8975dd5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89700cccb0 0x7f89700cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36578/0 (socket says 172.21.15.79:36578) 2024-04-25T02:08:56.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.332+0000 7f89755d4640 1 -- 172.21.15.79:0/3767966885 learned_addr learned my addr 172.21.15.79:0/3767966885 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.333+0000 7f8974dd3640 1 --2- 172.21.15.79:0/3767966885 >> v2:172.21.15.189:3300/0 conn(0x7f89700ca780 0x7f897015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.333+0000 7f8975dd5640 1 -- 172.21.15.79:0/3767966885 >> v2:172.21.15.189:3300/0 conn(0x7f89700ca780 msgr2=0x7f897015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.333+0000 7f8975dd5640 1 --2- 172.21.15.79:0/3767966885 >> v2:172.21.15.189:3300/0 conn(0x7f89700ca780 0x7f897015cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.333+0000 7f8967fff640 1 -- 172.21.15.79:0/3767966885 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1340053208 0 0) 0x7f89700af340 con 0x7f897006d140 2024-04-25T02:08:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.333+0000 7f8975dd5640 1 -- 172.21.15.79:0/3767966885 >> v1:172.21.15.79:6789/0 conn(0x7f897006d140 legacy=0x7f897006d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.333+0000 7f8975dd5640 1 -- 172.21.15.79:0/3767966885 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89700af620 con 0x7f89700cccb0 2024-04-25T02:08:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.333+0000 7f8974dd3640 1 --2- 172.21.15.79:0/3767966885 >> v2:172.21.15.189:3300/0 conn(0x7f89700ca780 0x7f897015cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:56.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.333+0000 7f8975dd5640 1 --2- 172.21.15.79:0/3767966885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89700cccb0 0x7f89700cd140 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f897009e2b0 tx=0x7f896802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec1abf01efa43d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.334+0000 7f8967fff640 1 -- 172.21.15.79:0/3767966885 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968007740 con 0x7f89700cccb0 2024-04-25T02:08:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.334+0000 7f8967fff640 1 -- 172.21.15.79:0/3767966885 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89680078e0 con 0x7f89700cccb0 2024-04-25T02:08:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.334+0000 7f8967fff640 1 -- 172.21.15.79:0/3767966885 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968007cb0 con 0x7f89700cccb0 2024-04-25T02:08:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.334+0000 7f8977838640 1 -- 172.21.15.79:0/3767966885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89700cccb0 msgr2=0x7f89700cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.334+0000 7f8977838640 1 --2- 172.21.15.79:0/3767966885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89700cccb0 0x7f89700cd140 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f897009e2b0 tx=0x7f896802a680 comp rx=0 tx=0).stop 2024-04-25T02:08:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.334+0000 7f8977838640 1 -- 172.21.15.79:0/3767966885 shutdown_connections 2024-04-25T02:08:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.334+0000 7f8977838640 1 --2- 172.21.15.79:0/3767966885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89700cccb0 0x7f89700cd140 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.334+0000 7f8977838640 1 --2- 172.21.15.79:0/3767966885 >> v2:172.21.15.189:3300/0 conn(0x7f89700ca780 0x7f897015cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.334+0000 7f8977838640 1 -- 172.21.15.79:0/3767966885 >> 172.21.15.79:0/3767966885 conn(0x7f89700b1c80 msgr2=0x7f89700b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.334+0000 7f8977838640 1 -- 172.21.15.79:0/3767966885 shutdown_connections 2024-04-25T02:08:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.334+0000 7f8977838640 1 -- 172.21.15.79:0/3767966885 wait complete. 2024-04-25T02:08:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.335+0000 7f8977838640 1 Processor -- start 2024-04-25T02:08:56.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.335+0000 7f8977838640 1 -- start start 2024-04-25T02:08:56.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.336+0000 7f8977838640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f897006d140 0x7f8970155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.336+0000 7f8977838640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89700ca780 0x7f89700c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.336+0000 7f8977838640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89700cccb0 0x7f897015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.336+0000 7f8977838640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f897015d2f0 con 0x7f897006d140 2024-04-25T02:08:56.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.336+0000 7f8977838640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f89700cc4b0 con 0x7f89700cccb0 2024-04-25T02:08:56.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.336+0000 7f8977838640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f89700c7b70 con 0x7f89700ca780 2024-04-25T02:08:56.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.336+0000 7f89755d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f897006d140 0x7f8970155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.336+0000 7f89755d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f897006d140 0x7f8970155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36580/0 (socket says 172.21.15.79:36580) 2024-04-25T02:08:56.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.336+0000 7f89755d4640 1 -- 172.21.15.79:0/1827331996 learned_addr learned my addr 172.21.15.79:0/1827331996 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:56.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.337+0000 7f89755d4640 1 -- 172.21.15.79:0/1827331996 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89700ca780 msgr2=0x7f89700c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.337+0000 7f89755d4640 1 --2- 172.21.15.79:0/1827331996 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89700ca780 0x7f89700c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.337+0000 7f89755d4640 1 -- 172.21.15.79:0/1827331996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89700cccb0 msgr2=0x7f897015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.337+0000 7f89755d4640 1 --2- 172.21.15.79:0/1827331996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89700cccb0 0x7f897015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.337+0000 7f89755d4640 1 -- 172.21.15.79:0/1827331996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89700c7e50 con 0x7f897006d140 2024-04-25T02:08:56.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.337+0000 7f89755d4640 1 --2- 172.21.15.79:0/1827331996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f897006d140 0x7f8970155b30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f896c00c4d0 tx=0x7f896c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:56.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.337+0000 7f8965ffb640 1 -- 172.21.15.79:0/1827331996 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c018070 con 0x7f897006d140 2024-04-25T02:08:56.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.337+0000 7f8965ffb640 1 -- 172.21.15.79:0/1827331996 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896c007500 con 0x7f897006d140 2024-04-25T02:08:56.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.337+0000 7f8977838640 1 -- 172.21.15.79:0/1827331996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89700c8130 con 0x7f897006d140 2024-04-25T02:08:56.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.337+0000 7f8965ffb640 1 -- 172.21.15.79:0/1827331996 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c004a20 con 0x7f897006d140 2024-04-25T02:08:56.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.337+0000 7f8977838640 1 -- 172.21.15.79:0/1827331996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89700c86f0 con 0x7f897006d140 2024-04-25T02:08:56.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.338+0000 7f8977838640 1 -- 172.21.15.79:0/1827331996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89700690a0 con 0x7f897006d140 2024-04-25T02:08:56.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.338+0000 7f8965ffb640 1 -- 172.21.15.79:0/1827331996 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f896c01b070 con 0x7f897006d140 2024-04-25T02:08:56.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.339+0000 7f8965ffb640 1 --2- 172.21.15.79:0/1827331996 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f895406be60 0x7f895406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.339+0000 7f8965ffb640 1 -- 172.21.15.79:0/1827331996 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f896c08a120 con 0x7f897006d140 2024-04-25T02:08:56.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.339+0000 7f8974dd3640 1 --2- 172.21.15.79:0/1827331996 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f895406be60 0x7f895406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.339+0000 7f8974dd3640 1 --2- 172.21.15.79:0/1827331996 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f895406be60 0x7f895406e320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8960006fd0 tx=0x7f8960008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:56.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.343+0000 7f8965ffb640 1 -- 172.21.15.79:0/1827331996 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f896c058b60 con 0x7f897006d140 2024-04-25T02:08:56.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.513+0000 7f8977838640 1 -- 172.21.15.79:0/1827331996 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f89700c8930 con 0x7f895406be60 2024-04-25T02:08:56.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.519+0000 7f8965ffb640 1 -- 172.21.15.79:0/1827331996 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251915 (secure 0 0 0) 0x7f89700c8930 con 0x7f895406be60 2024-04-25T02:08:56.529 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:56.530 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:08:56.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.522+0000 7f8977838640 1 -- 172.21.15.79:0/1827331996 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f895406be60 msgr2=0x7f895406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.522+0000 7f8977838640 1 --2- 172.21.15.79:0/1827331996 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f895406be60 0x7f895406e320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8960006fd0 tx=0x7f8960008040 comp rx=0 tx=0).stop 2024-04-25T02:08:56.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.522+0000 7f8977838640 1 -- 172.21.15.79:0/1827331996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f897006d140 msgr2=0x7f8970155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.522+0000 7f8977838640 1 --2- 172.21.15.79:0/1827331996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f897006d140 0x7f8970155b30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f896c00c4d0 tx=0x7f896c00c990 comp rx=0 tx=0).stop 2024-04-25T02:08:56.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.522+0000 7f8977838640 1 -- 172.21.15.79:0/1827331996 shutdown_connections 2024-04-25T02:08:56.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.522+0000 7f8977838640 1 --2- 172.21.15.79:0/1827331996 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f895406be60 0x7f895406e320 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.522+0000 7f8977838640 1 --2- 172.21.15.79:0/1827331996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89700cccb0 0x7f897015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.522+0000 7f8977838640 1 --2- 172.21.15.79:0/1827331996 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89700ca780 0x7f89700c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.522+0000 7f8977838640 1 --2- 172.21.15.79:0/1827331996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f897006d140 0x7f8970155b30 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.522+0000 7f8977838640 1 -- 172.21.15.79:0/1827331996 >> 172.21.15.79:0/1827331996 conn(0x7f89700b1c80 msgr2=0x7f897006d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:56.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.522+0000 7f8977838640 1 -- 172.21.15.79:0/1827331996 shutdown_connections 2024-04-25T02:08:56.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.522+0000 7f8977838640 1 -- 172.21.15.79:0/1827331996 wait complete. 2024-04-25T02:08:56.540 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-25T02:08:55.183881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220284,"kb_used_data":4088,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754436,"statfs":{"total":773094113280,"available":772868542464,"internally_reserved":0,"allocated":4186112,"data_stored":2315780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.310999"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.911770+0000","last_change":"2024-04-25T02:08:48.904115+0000","last_active":"2024-04-25T02:08:48.911770+0000","last_peered":"2024-04-25T02:08:48.911770+0000","last_clean":"2024-04-25T02:08:48.911770+0000","last_became_active":"2024-04-25T02:08:48.903829+0000","last_became_peered":"2024-04-25T02:08:48.903829+0000","last_unstale":"2024-04-25T02:08:48.911770+0000","last_undegraded":"2024-04-25T02:08:48.911770+0000","last_fullsized":"2024-04-25T02:08:48.911770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:35:15.855723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.901050+0000","last_change":"2024-04-25T02:08:48.897577+0000","last_active":"2024-04-25T02:08:48.901050+0000","last_peered":"2024-04-25T02:08:48.901050+0000","last_clean":"2024-04-25T02:08:48.901050+0000","last_became_active":"2024-04-25T02:08:48.897320+0000","last_became_peered":"2024-04-25T02:08:48.897320+0000","last_unstale":"2024-04-25T02:08:48.901050+0000","last_undegraded":"2024-04-25T02:08:48.901050+0000","last_fullsized":"2024-04-25T02:08:48.901050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:58.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893919+0000","last_change":"2024-04-25T02:08:48.894524+0000","last_active":"2024-04-25T02:08:49.893919+0000","last_peered":"2024-04-25T02:08:49.893919+0000","last_clean":"2024-04-25T02:08:49.893919+0000","last_became_active":"2024-04-25T02:08:48.893624+0000","last_became_peered":"2024-04-25T02:08:48.893624+0000","last_unstale":"2024-04-25T02:08:49.893919+0000","last_undegraded":"2024-04-25T02:08:49.893919+0000","last_fullsized":"2024-04-25T02:08:49.893919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:38.716955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891387+0000","last_change":"2024-04-25T02:08:48.889716+0000","last_active":"2024-04-25T02:08:49.891387+0000","last_peered":"2024-04-25T02:08:49.891387+0000","last_clean":"2024-04-25T02:08:49.891387+0000","last_became_active":"2024-04-25T02:08:48.889430+0000","last_became_peered":"2024-04-25T02:08:48.889430+0000","last_unstale":"2024-04-25T02:08:49.891387+0000","last_undegraded":"2024-04-25T02:08:49.891387+0000","last_fullsized":"2024-04-25T02:08:49.891387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:01.122216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.904074+0000","last_change":"2024-04-25T02:08:48.903248+0000","last_active":"2024-04-25T02:08:48.904074+0000","last_peered":"2024-04-25T02:08:48.904074+0000","last_clean":"2024-04-25T02:08:48.904074+0000","last_became_active":"2024-04-25T02:08:48.902966+0000","last_became_peered":"2024-04-25T02:08:48.902966+0000","last_unstale":"2024-04-25T02:08:48.904074+0000","last_undegraded":"2024-04-25T02:08:48.904074+0000","last_fullsized":"2024-04-25T02:08:48.904074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:58.748661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.898739+0000","last_change":"2024-04-25T02:08:48.897387+0000","last_active":"2024-04-25T02:08:48.898739+0000","last_peered":"2024-04-25T02:08:48.898739+0000","last_clean":"2024-04-25T02:08:48.898739+0000","last_became_active":"2024-04-25T02:08:48.896729+0000","last_became_peered":"2024-04-25T02:08:48.896729+0000","last_unstale":"2024-04-25T02:08:48.898739+0000","last_undegraded":"2024-04-25T02:08:48.898739+0000","last_fullsized":"2024-04-25T02:08:48.898739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:55.327825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.898174+0000","last_change":"2024-04-25T02:08:48.895403+0000","last_active":"2024-04-25T02:08:48.898174+0000","last_peered":"2024-04-25T02:08:48.898174+0000","last_clean":"2024-04-25T02:08:48.898174+0000","last_became_active":"2024-04-25T02:08:48.895133+0000","last_became_peered":"2024-04-25T02:08:48.895133+0000","last_unstale":"2024-04-25T02:08:48.898174+0000","last_undegraded":"2024-04-25T02:08:48.898174+0000","last_fullsized":"2024-04-25T02:08:48.898174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:02.665799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.893017+0000","last_change":"2024-04-25T02:08:48.890266+0000","last_active":"2024-04-25T02:08:48.893017+0000","last_peered":"2024-04-25T02:08:48.893017+0000","last_clean":"2024-04-25T02:08:48.893017+0000","last_became_active":"2024-04-25T02:08:48.889994+0000","last_became_peered":"2024-04-25T02:08:48.889994+0000","last_unstale":"2024-04-25T02:08:48.893017+0000","last_undegraded":"2024-04-25T02:08:48.893017+0000","last_fullsized":"2024-04-25T02:08:48.893017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:52:20.093850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.894236+0000","last_change":"2024-04-25T02:08:48.898726+0000","last_active":"2024-04-25T02:08:49.894236+0000","last_peered":"2024-04-25T02:08:49.894236+0000","last_clean":"2024-04-25T02:08:49.894236+0000","last_became_active":"2024-04-25T02:08:48.898459+0000","last_became_peered":"2024-04-25T02:08:48.898459+0000","last_unstale":"2024-04-25T02:08:49.894236+0000","last_undegraded":"2024-04-25T02:08:49.894236+0000","last_fullsized":"2024-04-25T02:08:49.894236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:58.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891480+0000","last_change":"2024-04-25T02:08:48.899680+0000","last_active":"2024-04-25T02:08:49.891480+0000","last_peered":"2024-04-25T02:08:49.891480+0000","last_clean":"2024-04-25T02:08:49.891480+0000","last_became_active":"2024-04-25T02:08:48.899395+0000","last_became_peered":"2024-04-25T02:08:48.899395+0000","last_unstale":"2024-04-25T02:08:49.891480+0000","last_undegraded":"2024-04-25T02:08:49.891480+0000","last_fullsized":"2024-04-25T02:08:49.891480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:00.943838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.901318+0000","last_change":"2024-04-25T02:08:48.897764+0000","last_active":"2024-04-25T02:08:48.901318+0000","last_peered":"2024-04-25T02:08:48.901318+0000","last_clean":"2024-04-25T02:08:48.901318+0000","last_became_active":"2024-04-25T02:08:48.897508+0000","last_became_peered":"2024-04-25T02:08:48.897508+0000","last_unstale":"2024-04-25T02:08:48.901318+0000","last_undegraded":"2024-04-25T02:08:48.901318+0000","last_fullsized":"2024-04-25T02:08:48.901318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:24:03.301612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893945+0000","last_change":"2024-04-25T02:08:48.900135+0000","last_active":"2024-04-25T02:08:49.893945+0000","last_peered":"2024-04-25T02:08:49.893945+0000","last_clean":"2024-04-25T02:08:49.893945+0000","last_became_active":"2024-04-25T02:08:48.899760+0000","last_became_peered":"2024-04-25T02:08:48.899760+0000","last_unstale":"2024-04-25T02:08:49.893945+0000","last_undegraded":"2024-04-25T02:08:49.893945+0000","last_fullsized":"2024-04-25T02:08:49.893945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:50.110378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.890953+0000","last_change":"2024-04-25T02:08:48.889885+0000","last_active":"2024-04-25T02:08:48.890953+0000","last_peered":"2024-04-25T02:08:48.890953+0000","last_clean":"2024-04-25T02:08:48.890953+0000","last_became_active":"2024-04-25T02:08:48.889638+0000","last_became_peered":"2024-04-25T02:08:48.889638+0000","last_unstale":"2024-04-25T02:08:48.890953+0000","last_undegraded":"2024-04-25T02:08:48.890953+0000","last_fullsized":"2024-04-25T02:08:48.890953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:29:30.759531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.890254+0000","last_change":"2024-04-25T02:08:48.883950+0000","last_active":"2024-04-25T02:08:48.890254+0000","last_peered":"2024-04-25T02:08:48.890254+0000","last_clean":"2024-04-25T02:08:48.890254+0000","last_became_active":"2024-04-25T02:08:48.883679+0000","last_became_peered":"2024-04-25T02:08:48.883679+0000","last_unstale":"2024-04-25T02:08:48.890254+0000","last_undegraded":"2024-04-25T02:08:48.890254+0000","last_fullsized":"2024-04-25T02:08:48.890254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:59:17.017591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893624+0000","last_change":"2024-04-25T02:08:48.896372+0000","last_active":"2024-04-25T02:08:49.893624+0000","last_peered":"2024-04-25T02:08:49.893624+0000","last_clean":"2024-04-25T02:08:49.893624+0000","last_became_active":"2024-04-25T02:08:48.896071+0000","last_became_peered":"2024-04-25T02:08:48.896071+0000","last_unstale":"2024-04-25T02:08:49.893624+0000","last_undegraded":"2024-04-25T02:08:49.893624+0000","last_fullsized":"2024-04-25T02:08:49.893624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:58.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.911649+0000","last_change":"2024-04-25T02:08:48.903795+0000","last_active":"2024-04-25T02:08:48.911649+0000","last_peered":"2024-04-25T02:08:48.911649+0000","last_clean":"2024-04-25T02:08:48.911649+0000","last_became_active":"2024-04-25T02:08:48.903456+0000","last_became_peered":"2024-04-25T02:08:48.903456+0000","last_unstale":"2024-04-25T02:08:48.911649+0000","last_undegraded":"2024-04-25T02:08:48.911649+0000","last_fullsized":"2024-04-25T02:08:48.911649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:13.686545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.906296+0000","last_change":"2024-04-25T02:08:48.901161+0000","last_active":"2024-04-25T02:08:48.906296+0000","last_peered":"2024-04-25T02:08:48.906296+0000","last_clean":"2024-04-25T02:08:48.906296+0000","last_became_active":"2024-04-25T02:08:48.900769+0000","last_became_peered":"2024-04-25T02:08:48.900769+0000","last_unstale":"2024-04-25T02:08:48.906296+0000","last_undegraded":"2024-04-25T02:08:48.906296+0000","last_fullsized":"2024-04-25T02:08:48.906296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:43.906271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.898717+0000","last_change":"2024-04-25T02:08:48.897157+0000","last_active":"2024-04-25T02:08:48.898717+0000","last_peered":"2024-04-25T02:08:48.898717+0000","last_clean":"2024-04-25T02:08:48.898717+0000","last_became_active":"2024-04-25T02:08:48.896697+0000","last_became_peered":"2024-04-25T02:08:48.896697+0000","last_unstale":"2024-04-25T02:08:48.898717+0000","last_undegraded":"2024-04-25T02:08:48.898717+0000","last_fullsized":"2024-04-25T02:08:48.898717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:01.122216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.900867+0000","last_change":"2024-04-25T02:08:48.897428+0000","last_active":"2024-04-25T02:08:48.900867+0000","last_peered":"2024-04-25T02:08:48.900867+0000","last_clean":"2024-04-25T02:08:48.900867+0000","last_became_active":"2024-04-25T02:08:48.896565+0000","last_became_peered":"2024-04-25T02:08:48.896565+0000","last_unstale":"2024-04-25T02:08:48.900867+0000","last_undegraded":"2024-04-25T02:08:48.900867+0000","last_fullsized":"2024-04-25T02:08:48.900867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:00.943838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.891440+0000","last_change":"2024-04-25T02:08:48.888800+0000","last_active":"2024-04-25T02:08:48.891440+0000","last_peered":"2024-04-25T02:08:48.891440+0000","last_clean":"2024-04-25T02:08:48.891440+0000","last_became_active":"2024-04-25T02:08:48.888510+0000","last_became_peered":"2024-04-25T02:08:48.888510+0000","last_unstale":"2024-04-25T02:08:48.891440+0000","last_undegraded":"2024-04-25T02:08:48.891440+0000","last_fullsized":"2024-04-25T02:08:48.891440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:56:35.122570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892883+0000","last_change":"2024-04-25T02:08:48.899829+0000","last_active":"2024-04-25T02:08:49.892883+0000","last_peered":"2024-04-25T02:08:49.892883+0000","last_clean":"2024-04-25T02:08:49.892883+0000","last_became_active":"2024-04-25T02:08:48.899476+0000","last_became_peered":"2024-04-25T02:08:48.899476+0000","last_unstale":"2024-04-25T02:08:49.892883+0000","last_undegraded":"2024-04-25T02:08:49.892883+0000","last_fullsized":"2024-04-25T02:08:49.892883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:13.686545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893048+0000","last_change":"2024-04-25T02:08:48.892656+0000","last_active":"2024-04-25T02:08:49.893048+0000","last_peered":"2024-04-25T02:08:49.893048+0000","last_clean":"2024-04-25T02:08:49.893048+0000","last_became_active":"2024-04-25T02:08:48.892351+0000","last_became_peered":"2024-04-25T02:08:48.892351+0000","last_unstale":"2024-04-25T02:08:49.893048+0000","last_undegraded":"2024-04-25T02:08:49.893048+0000","last_fullsized":"2024-04-25T02:08:49.893048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:55.327825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.877913+0000","last_change":"2024-04-25T02:08:48.893405+0000","last_active":"2024-04-25T02:08:50.877913+0000","last_peered":"2024-04-25T02:08:50.877913+0000","last_clean":"2024-04-25T02:08:50.877913+0000","last_became_active":"2024-04-25T02:08:48.893103+0000","last_became_peered":"2024-04-25T02:08:48.893103+0000","last_unstale":"2024-04-25T02:08:50.877913+0000","last_undegraded":"2024-04-25T02:08:50.877913+0000","last_fullsized":"2024-04-25T02:08:50.877913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:24:03.301612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892625+0000","last_change":"2024-04-25T02:08:48.886533+0000","last_active":"2024-04-25T02:08:49.892625+0000","last_peered":"2024-04-25T02:08:49.892625+0000","last_clean":"2024-04-25T02:08:49.892625+0000","last_became_active":"2024-04-25T02:08:48.886238+0000","last_became_peered":"2024-04-25T02:08:48.886238+0000","last_unstale":"2024-04-25T02:08:49.892625+0000","last_undegraded":"2024-04-25T02:08:49.892625+0000","last_fullsized":"2024-04-25T02:08:49.892625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:00.943838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891524+0000","last_change":"2024-04-25T02:08:48.892330+0000","last_active":"2024-04-25T02:08:49.891524+0000","last_peered":"2024-04-25T02:08:49.891524+0000","last_clean":"2024-04-25T02:08:49.891524+0000","last_became_active":"2024-04-25T02:08:48.892055+0000","last_became_peered":"2024-04-25T02:08:48.892055+0000","last_unstale":"2024-04-25T02:08:49.891524+0000","last_undegraded":"2024-04-25T02:08:49.891524+0000","last_fullsized":"2024-04-25T02:08:49.891524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:44.016450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.902445+0000","last_change":"2024-04-25T02:08:48.898506+0000","last_active":"2024-04-25T02:08:48.902445+0000","last_peered":"2024-04-25T02:08:48.902445+0000","last_clean":"2024-04-25T02:08:48.902445+0000","last_became_active":"2024-04-25T02:08:48.898269+0000","last_became_peered":"2024-04-25T02:08:48.898269+0000","last_unstale":"2024-04-25T02:08:48.902445+0000","last_undegraded":"2024-04-25T02:08:48.902445+0000","last_fullsized":"2024-04-25T02:08:48.902445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:50.516195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891727+0000","last_change":"2024-04-25T02:08:48.893721+0000","last_active":"2024-04-25T02:08:49.891727+0000","last_peered":"2024-04-25T02:08:49.891727+0000","last_clean":"2024-04-25T02:08:49.891727+0000","last_became_active":"2024-04-25T02:08:48.893457+0000","last_became_peered":"2024-04-25T02:08:48.893457+0000","last_unstale":"2024-04-25T02:08:49.891727+0000","last_undegraded":"2024-04-25T02:08:49.891727+0000","last_fullsized":"2024-04-25T02:08:49.891727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:58.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893967+0000","last_change":"2024-04-25T02:08:48.896007+0000","last_active":"2024-04-25T02:08:49.893967+0000","last_peered":"2024-04-25T02:08:49.893967+0000","last_clean":"2024-04-25T02:08:49.893967+0000","last_became_active":"2024-04-25T02:08:48.895728+0000","last_became_peered":"2024-04-25T02:08:48.895728+0000","last_unstale":"2024-04-25T02:08:49.893967+0000","last_undegraded":"2024-04-25T02:08:49.893967+0000","last_fullsized":"2024-04-25T02:08:49.893967+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:11.869427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892969+0000","last_change":"2024-04-25T02:08:48.903103+0000","last_active":"2024-04-25T02:08:49.892969+0000","last_peered":"2024-04-25T02:08:49.892969+0000","last_clean":"2024-04-25T02:08:49.892969+0000","last_became_active":"2024-04-25T02:08:48.902835+0000","last_became_peered":"2024-04-25T02:08:48.902835+0000","last_unstale":"2024-04-25T02:08:49.892969+0000","last_undegraded":"2024-04-25T02:08:49.892969+0000","last_fullsized":"2024-04-25T02:08:49.892969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:01.122216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.906358+0000","last_change":"2024-04-25T02:08:48.901850+0000","last_active":"2024-04-25T02:08:48.906358+0000","last_peered":"2024-04-25T02:08:48.906358+0000","last_clean":"2024-04-25T02:08:48.906358+0000","last_became_active":"2024-04-25T02:08:48.901580+0000","last_became_peered":"2024-04-25T02:08:48.901580+0000","last_unstale":"2024-04-25T02:08:48.906358+0000","last_undegraded":"2024-04-25T02:08:48.906358+0000","last_fullsized":"2024-04-25T02:08:48.906358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:59:17.017591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.900615+0000","last_change":"2024-04-25T02:08:48.895473+0000","last_active":"2024-04-25T02:08:48.900615+0000","last_peered":"2024-04-25T02:08:48.900615+0000","last_clean":"2024-04-25T02:08:48.900615+0000","last_became_active":"2024-04-25T02:08:48.895194+0000","last_became_peered":"2024-04-25T02:08:48.895194+0000","last_unstale":"2024-04-25T02:08:48.900615+0000","last_undegraded":"2024-04-25T02:08:48.900615+0000","last_fullsized":"2024-04-25T02:08:48.900615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:14.433776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.903633+0000","last_change":"2024-04-25T02:08:48.898790+0000","last_active":"2024-04-25T02:08:48.903633+0000","last_peered":"2024-04-25T02:08:48.903633+0000","last_clean":"2024-04-25T02:08:48.903633+0000","last_became_active":"2024-04-25T02:08:48.898511+0000","last_became_peered":"2024-04-25T02:08:48.898511+0000","last_unstale":"2024-04-25T02:08:48.903633+0000","last_undegraded":"2024-04-25T02:08:48.903633+0000","last_fullsized":"2024-04-25T02:08:48.903633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:58.048729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.878066+0000","last_change":"2024-04-25T02:08:48.892727+0000","last_active":"2024-04-25T02:08:50.878066+0000","last_peered":"2024-04-25T02:08:50.878066+0000","last_clean":"2024-04-25T02:08:50.878066+0000","last_became_active":"2024-04-25T02:08:48.892477+0000","last_became_peered":"2024-04-25T02:08:48.892477+0000","last_unstale":"2024-04-25T02:08:50.878066+0000","last_undegraded":"2024-04-25T02:08:50.878066+0000","last_fullsized":"2024-04-25T02:08:50.878066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:59:17.017591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.906822+0000","last_change":"2024-04-25T02:08:47.889452+0000","last_active":"2024-04-25T02:08:48.906822+0000","last_peered":"2024-04-25T02:08:48.906822+0000","last_clean":"2024-04-25T02:08:48.906822+0000","last_became_active":"2024-04-25T02:08:47.889183+0000","last_became_peered":"2024-04-25T02:08:47.889183+0000","last_unstale":"2024-04-25T02:08:48.906822+0000","last_undegraded":"2024-04-25T02:08:48.906822+0000","last_fullsized":"2024-04-25T02:08:48.906822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:54.128942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.912100+0000","last_change":"2024-04-25T02:08:48.906844+0000","last_active":"2024-04-25T02:08:48.912100+0000","last_peered":"2024-04-25T02:08:48.912100+0000","last_clean":"2024-04-25T02:08:48.912100+0000","last_became_active":"2024-04-25T02:08:48.906456+0000","last_became_peered":"2024-04-25T02:08:48.906456+0000","last_unstale":"2024-04-25T02:08:48.912100+0000","last_undegraded":"2024-04-25T02:08:48.912100+0000","last_fullsized":"2024-04-25T02:08:48.912100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:52:20.093850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.878032+0000","last_change":"2024-04-25T02:08:47.890551+0000","last_active":"2024-04-25T02:08:50.878032+0000","last_peered":"2024-04-25T02:08:50.878032+0000","last_clean":"2024-04-25T02:08:50.878032+0000","last_became_active":"2024-04-25T02:08:47.890248+0000","last_became_peered":"2024-04-25T02:08:47.890248+0000","last_unstale":"2024-04-25T02:08:50.878032+0000","last_undegraded":"2024-04-25T02:08:50.878032+0000","last_fullsized":"2024-04-25T02:08:50.878032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:23:41.115929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893163+0000","last_change":"2024-04-25T02:08:48.893719+0000","last_active":"2024-04-25T02:08:49.893163+0000","last_peered":"2024-04-25T02:08:49.893163+0000","last_clean":"2024-04-25T02:08:49.893163+0000","last_became_active":"2024-04-25T02:08:48.893392+0000","last_became_peered":"2024-04-25T02:08:48.893392+0000","last_unstale":"2024-04-25T02:08:49.893163+0000","last_undegraded":"2024-04-25T02:08:49.893163+0000","last_fullsized":"2024-04-25T02:08:49.893163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:00.943838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.905105+0000","last_change":"2024-04-25T02:08:47.893357+0000","last_active":"2024-04-25T02:08:48.905105+0000","last_peered":"2024-04-25T02:08:48.905105+0000","last_clean":"2024-04-25T02:08:48.905105+0000","last_became_active":"2024-04-25T02:08:47.892649+0000","last_became_peered":"2024-04-25T02:08:47.892649+0000","last_unstale":"2024-04-25T02:08:48.905105+0000","last_undegraded":"2024-04-25T02:08:48.905105+0000","last_fullsized":"2024-04-25T02:08:48.905105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:01.663864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891768+0000","last_change":"2024-04-25T02:08:48.889935+0000","last_active":"2024-04-25T02:08:49.891768+0000","last_peered":"2024-04-25T02:08:49.891768+0000","last_clean":"2024-04-25T02:08:49.891768+0000","last_became_active":"2024-04-25T02:08:48.889668+0000","last_became_peered":"2024-04-25T02:08:48.889668+0000","last_unstale":"2024-04-25T02:08:49.891768+0000","last_undegraded":"2024-04-25T02:08:49.891768+0000","last_fullsized":"2024-04-25T02:08:49.891768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:50.516195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.907127+0000","last_change":"2024-04-25T02:08:47.897549+0000","last_active":"2024-04-25T02:08:48.907127+0000","last_peered":"2024-04-25T02:08:48.907127+0000","last_clean":"2024-04-25T02:08:48.907127+0000","last_became_active":"2024-04-25T02:08:47.897234+0000","last_became_peered":"2024-04-25T02:08:47.897234+0000","last_unstale":"2024-04-25T02:08:48.907127+0000","last_undegraded":"2024-04-25T02:08:48.907127+0000","last_fullsized":"2024-04-25T02:08:48.907127+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:31:30.967966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.897376+0000","last_change":"2024-04-25T02:08:48.894623+0000","last_active":"2024-04-25T02:08:48.897376+0000","last_peered":"2024-04-25T02:08:48.897376+0000","last_clean":"2024-04-25T02:08:48.897376+0000","last_became_active":"2024-04-25T02:08:48.894358+0000","last_became_peered":"2024-04-25T02:08:48.894358+0000","last_unstale":"2024-04-25T02:08:48.897376+0000","last_undegraded":"2024-04-25T02:08:48.897376+0000","last_fullsized":"2024-04-25T02:08:48.897376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:44.719305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893026+0000","last_change":"2024-04-25T02:08:47.888169+0000","last_active":"2024-04-25T02:08:49.893026+0000","last_peered":"2024-04-25T02:08:49.893026+0000","last_clean":"2024-04-25T02:08:49.893026+0000","last_became_active":"2024-04-25T02:08:47.887852+0000","last_became_peered":"2024-04-25T02:08:47.887852+0000","last_unstale":"2024-04-25T02:08:49.893026+0000","last_undegraded":"2024-04-25T02:08:49.893026+0000","last_fullsized":"2024-04-25T02:08:49.893026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:54.128942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893617+0000","last_change":"2024-04-25T02:08:48.896093+0000","last_active":"2024-04-25T02:08:49.893617+0000","last_peered":"2024-04-25T02:08:49.893617+0000","last_clean":"2024-04-25T02:08:49.893617+0000","last_became_active":"2024-04-25T02:08:48.895794+0000","last_became_peered":"2024-04-25T02:08:48.895794+0000","last_unstale":"2024-04-25T02:08:49.893617+0000","last_undegraded":"2024-04-25T02:08:49.893617+0000","last_fullsized":"2024-04-25T02:08:49.893617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:44.016450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893158+0000","last_change":"2024-04-25T02:08:47.888121+0000","last_active":"2024-04-25T02:08:49.893158+0000","last_peered":"2024-04-25T02:08:49.893158+0000","last_clean":"2024-04-25T02:08:49.893158+0000","last_became_active":"2024-04-25T02:08:47.887833+0000","last_became_peered":"2024-04-25T02:08:47.887833+0000","last_unstale":"2024-04-25T02:08:49.893158+0000","last_undegraded":"2024-04-25T02:08:49.893158+0000","last_fullsized":"2024-04-25T02:08:49.893158+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:38.135074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892554+0000","last_change":"2024-04-25T02:08:48.895078+0000","last_active":"2024-04-25T02:08:49.892554+0000","last_peered":"2024-04-25T02:08:49.892554+0000","last_clean":"2024-04-25T02:08:49.892554+0000","last_became_active":"2024-04-25T02:08:48.894796+0000","last_became_peered":"2024-04-25T02:08:48.894796+0000","last_unstale":"2024-04-25T02:08:49.892554+0000","last_undegraded":"2024-04-25T02:08:49.892554+0000","last_fullsized":"2024-04-25T02:08:49.892554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:59:17.017591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.875647+0000","last_change":"2024-04-25T02:08:47.888369+0000","last_active":"2024-04-25T02:08:48.875647+0000","last_peered":"2024-04-25T02:08:48.875647+0000","last_clean":"2024-04-25T02:08:48.875647+0000","last_became_active":"2024-04-25T02:08:47.888090+0000","last_became_peered":"2024-04-25T02:08:47.888090+0000","last_unstale":"2024-04-25T02:08:48.875647+0000","last_undegraded":"2024-04-25T02:08:48.875647+0000","last_fullsized":"2024-04-25T02:08:48.875647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:43.717370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891169+0000","last_change":"2024-04-25T02:08:48.890425+0000","last_active":"2024-04-25T02:08:49.891169+0000","last_peered":"2024-04-25T02:08:49.891169+0000","last_clean":"2024-04-25T02:08:49.891169+0000","last_became_active":"2024-04-25T02:08:48.889806+0000","last_became_peered":"2024-04-25T02:08:48.889806+0000","last_unstale":"2024-04-25T02:08:49.891169+0000","last_undegraded":"2024-04-25T02:08:49.891169+0000","last_fullsized":"2024-04-25T02:08:49.891169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:18.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892540+0000","last_change":"2024-04-25T02:08:47.887115+0000","last_active":"2024-04-25T02:08:49.892540+0000","last_peered":"2024-04-25T02:08:49.892540+0000","last_clean":"2024-04-25T02:08:49.892540+0000","last_became_active":"2024-04-25T02:08:47.886819+0000","last_became_peered":"2024-04-25T02:08:47.886819+0000","last_unstale":"2024-04-25T02:08:49.892540+0000","last_undegraded":"2024-04-25T02:08:49.892540+0000","last_fullsized":"2024-04-25T02:08:49.892540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:13.431841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893734+0000","last_change":"2024-04-25T02:08:48.899813+0000","last_active":"2024-04-25T02:08:49.893734+0000","last_peered":"2024-04-25T02:08:49.893734+0000","last_clean":"2024-04-25T02:08:49.893734+0000","last_became_active":"2024-04-25T02:08:48.899517+0000","last_became_peered":"2024-04-25T02:08:48.899517+0000","last_unstale":"2024-04-25T02:08:49.893734+0000","last_undegraded":"2024-04-25T02:08:49.893734+0000","last_fullsized":"2024-04-25T02:08:49.893734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:50.516195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.876919+0000","last_change":"2024-04-25T02:08:47.892734+0000","last_active":"2024-04-25T02:08:48.876919+0000","last_peered":"2024-04-25T02:08:48.876919+0000","last_clean":"2024-04-25T02:08:48.876919+0000","last_became_active":"2024-04-25T02:08:47.892176+0000","last_became_peered":"2024-04-25T02:08:47.892176+0000","last_unstale":"2024-04-25T02:08:48.876919+0000","last_undegraded":"2024-04-25T02:08:48.876919+0000","last_fullsized":"2024-04-25T02:08:48.876919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:42.904336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.898891+0000","last_change":"2024-04-25T02:08:48.896647+0000","last_active":"2024-04-25T02:08:48.898891+0000","last_peered":"2024-04-25T02:08:48.898891+0000","last_clean":"2024-04-25T02:08:48.898891+0000","last_became_active":"2024-04-25T02:08:48.896339+0000","last_became_peered":"2024-04-25T02:08:48.896339+0000","last_unstale":"2024-04-25T02:08:48.898891+0000","last_undegraded":"2024-04-25T02:08:48.898891+0000","last_fullsized":"2024-04-25T02:08:48.898891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:13.686545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.878148+0000","last_change":"2024-04-25T02:08:47.888330+0000","last_active":"2024-04-25T02:08:50.878148+0000","last_peered":"2024-04-25T02:08:50.878148+0000","last_clean":"2024-04-25T02:08:50.878148+0000","last_became_active":"2024-04-25T02:08:47.888070+0000","last_became_peered":"2024-04-25T02:08:47.888070+0000","last_unstale":"2024-04-25T02:08:50.878148+0000","last_undegraded":"2024-04-25T02:08:50.878148+0000","last_fullsized":"2024-04-25T02:08:50.878148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:35.980344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.905240+0000","last_change":"2024-04-25T02:08:48.901730+0000","last_active":"2024-04-25T02:08:48.905240+0000","last_peered":"2024-04-25T02:08:48.905240+0000","last_clean":"2024-04-25T02:08:48.905240+0000","last_became_active":"2024-04-25T02:08:48.901311+0000","last_became_peered":"2024-04-25T02:08:48.901311+0000","last_unstale":"2024-04-25T02:08:48.905240+0000","last_undegraded":"2024-04-25T02:08:48.905240+0000","last_fullsized":"2024-04-25T02:08:48.905240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:26.953905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.894019+0000","last_change":"2024-04-25T02:08:47.891207+0000","last_active":"2024-04-25T02:08:49.894019+0000","last_peered":"2024-04-25T02:08:49.894019+0000","last_clean":"2024-04-25T02:08:49.894019+0000","last_became_active":"2024-04-25T02:08:47.890481+0000","last_became_peered":"2024-04-25T02:08:47.890481+0000","last_unstale":"2024-04-25T02:08:49.894019+0000","last_undegraded":"2024-04-25T02:08:49.894019+0000","last_fullsized":"2024-04-25T02:08:49.894019+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:11:49.496068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893870+0000","last_change":"2024-04-25T02:08:48.894773+0000","last_active":"2024-04-25T02:08:49.893870+0000","last_peered":"2024-04-25T02:08:49.893870+0000","last_clean":"2024-04-25T02:08:49.893870+0000","last_became_active":"2024-04-25T02:08:48.894125+0000","last_became_peered":"2024-04-25T02:08:48.894125+0000","last_unstale":"2024-04-25T02:08:49.893870+0000","last_undegraded":"2024-04-25T02:08:49.893870+0000","last_fullsized":"2024-04-25T02:08:49.893870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:26.953905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.908521+0000","last_change":"2024-04-25T02:08:47.893180+0000","last_active":"2024-04-25T02:08:48.908521+0000","last_peered":"2024-04-25T02:08:48.908521+0000","last_clean":"2024-04-25T02:08:48.908521+0000","last_became_active":"2024-04-25T02:08:47.892861+0000","last_became_peered":"2024-04-25T02:08:47.892861+0000","last_unstale":"2024-04-25T02:08:48.908521+0000","last_undegraded":"2024-04-25T02:08:48.908521+0000","last_fullsized":"2024-04-25T02:08:48.908521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:57.046794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891186+0000","last_change":"2024-04-25T02:08:48.895585+0000","last_active":"2024-04-25T02:08:49.891186+0000","last_peered":"2024-04-25T02:08:49.891186+0000","last_clean":"2024-04-25T02:08:49.891186+0000","last_became_active":"2024-04-25T02:08:48.893056+0000","last_became_peered":"2024-04-25T02:08:48.893056+0000","last_unstale":"2024-04-25T02:08:49.891186+0000","last_undegraded":"2024-04-25T02:08:49.891186+0000","last_fullsized":"2024-04-25T02:08:49.891186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:13.686545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893089+0000","last_change":"2024-04-25T02:08:47.887145+0000","last_active":"2024-04-25T02:08:49.893089+0000","last_peered":"2024-04-25T02:08:49.893089+0000","last_clean":"2024-04-25T02:08:49.893089+0000","last_became_active":"2024-04-25T02:08:47.886861+0000","last_became_peered":"2024-04-25T02:08:47.886861+0000","last_unstale":"2024-04-25T02:08:49.893089+0000","last_undegraded":"2024-04-25T02:08:49.893089+0000","last_fullsized":"2024-04-25T02:08:49.893089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:23:41.115929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.900837+0000","last_change":"2024-04-25T02:08:48.897195+0000","last_active":"2024-04-25T02:08:48.900837+0000","last_peered":"2024-04-25T02:08:48.900837+0000","last_clean":"2024-04-25T02:08:48.900837+0000","last_became_active":"2024-04-25T02:08:48.896790+0000","last_became_peered":"2024-04-25T02:08:48.896790+0000","last_unstale":"2024-04-25T02:08:48.900837+0000","last_undegraded":"2024-04-25T02:08:48.900837+0000","last_fullsized":"2024-04-25T02:08:48.900837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:44.016450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891232+0000","last_change":"2024-04-25T02:08:47.889201+0000","last_active":"2024-04-25T02:08:49.891232+0000","last_peered":"2024-04-25T02:08:49.891232+0000","last_clean":"2024-04-25T02:08:49.891232+0000","last_became_active":"2024-04-25T02:08:47.888935+0000","last_became_peered":"2024-04-25T02:08:47.888935+0000","last_unstale":"2024-04-25T02:08:49.891232+0000","last_undegraded":"2024-04-25T02:08:49.891232+0000","last_fullsized":"2024-04-25T02:08:49.891232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:13.431841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.906485+0000","last_change":"2024-04-25T02:08:48.902659+0000","last_active":"2024-04-25T02:08:48.906485+0000","last_peered":"2024-04-25T02:08:48.906485+0000","last_clean":"2024-04-25T02:08:48.906485+0000","last_became_active":"2024-04-25T02:08:48.902383+0000","last_became_peered":"2024-04-25T02:08:48.902383+0000","last_unstale":"2024-04-25T02:08:48.906485+0000","last_undegraded":"2024-04-25T02:08:48.906485+0000","last_fullsized":"2024-04-25T02:08:48.906485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:18.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.876065+0000","last_change":"2024-04-25T02:08:47.892780+0000","last_active":"2024-04-25T02:08:48.876065+0000","last_peered":"2024-04-25T02:08:48.876065+0000","last_clean":"2024-04-25T02:08:48.876065+0000","last_became_active":"2024-04-25T02:08:47.892248+0000","last_became_peered":"2024-04-25T02:08:47.892248+0000","last_unstale":"2024-04-25T02:08:48.876065+0000","last_undegraded":"2024-04-25T02:08:48.876065+0000","last_fullsized":"2024-04-25T02:08:48.876065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:20.086880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.912090+0000","last_change":"2024-04-25T02:08:48.906885+0000","last_active":"2024-04-25T02:08:48.912090+0000","last_peered":"2024-04-25T02:08:48.912090+0000","last_clean":"2024-04-25T02:08:48.912090+0000","last_became_active":"2024-04-25T02:08:48.906604+0000","last_became_peered":"2024-04-25T02:08:48.906604+0000","last_unstale":"2024-04-25T02:08:48.912090+0000","last_undegraded":"2024-04-25T02:08:48.912090+0000","last_fullsized":"2024-04-25T02:08:48.912090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:11:50.498003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.905431+0000","last_change":"2024-04-25T02:08:47.886749+0000","last_active":"2024-04-25T02:08:48.905431+0000","last_peered":"2024-04-25T02:08:48.905431+0000","last_clean":"2024-04-25T02:08:48.905431+0000","last_became_active":"2024-04-25T02:08:47.886466+0000","last_became_peered":"2024-04-25T02:08:47.886466+0000","last_unstale":"2024-04-25T02:08:48.905431+0000","last_undegraded":"2024-04-25T02:08:48.905431+0000","last_fullsized":"2024-04-25T02:08:48.905431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:11:49.496068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.894062+0000","last_change":"2024-04-25T02:08:48.889300+0000","last_active":"2024-04-25T02:08:49.894062+0000","last_peered":"2024-04-25T02:08:49.894062+0000","last_clean":"2024-04-25T02:08:49.894062+0000","last_became_active":"2024-04-25T02:08:48.887189+0000","last_became_peered":"2024-04-25T02:08:48.887189+0000","last_unstale":"2024-04-25T02:08:49.894062+0000","last_undegraded":"2024-04-25T02:08:49.894062+0000","last_fullsized":"2024-04-25T02:08:49.894062+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:44.016450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891549+0000","last_change":"2024-04-25T02:08:47.885666+0000","last_active":"2024-04-25T02:08:49.891549+0000","last_peered":"2024-04-25T02:08:49.891549+0000","last_clean":"2024-04-25T02:08:49.891549+0000","last_became_active":"2024-04-25T02:08:47.883517+0000","last_became_peered":"2024-04-25T02:08:47.883517+0000","last_unstale":"2024-04-25T02:08:49.891549+0000","last_undegraded":"2024-04-25T02:08:49.891549+0000","last_fullsized":"2024-04-25T02:08:49.891549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:35.980344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893946+0000","last_change":"2024-04-25T02:08:48.887995+0000","last_active":"2024-04-25T02:08:49.893946+0000","last_peered":"2024-04-25T02:08:49.893946+0000","last_clean":"2024-04-25T02:08:49.893946+0000","last_became_active":"2024-04-25T02:08:48.887729+0000","last_became_peered":"2024-04-25T02:08:48.887729+0000","last_unstale":"2024-04-25T02:08:49.893946+0000","last_undegraded":"2024-04-25T02:08:49.893946+0000","last_fullsized":"2024-04-25T02:08:49.893946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:01.399560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.894187+0000","last_change":"2024-04-25T02:08:47.886194+0000","last_active":"2024-04-25T02:08:49.894187+0000","last_peered":"2024-04-25T02:08:49.894187+0000","last_clean":"2024-04-25T02:08:49.894187+0000","last_became_active":"2024-04-25T02:08:47.885867+0000","last_became_peered":"2024-04-25T02:08:47.885867+0000","last_unstale":"2024-04-25T02:08:49.894187+0000","last_undegraded":"2024-04-25T02:08:49.894187+0000","last_fullsized":"2024-04-25T02:08:49.894187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:35.980344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891460+0000","last_change":"2024-04-25T02:08:48.889434+0000","last_active":"2024-04-25T02:08:49.891460+0000","last_peered":"2024-04-25T02:08:49.891460+0000","last_clean":"2024-04-25T02:08:49.891460+0000","last_became_active":"2024-04-25T02:08:48.889201+0000","last_became_peered":"2024-04-25T02:08:48.889201+0000","last_unstale":"2024-04-25T02:08:49.891460+0000","last_undegraded":"2024-04-25T02:08:49.891460+0000","last_fullsized":"2024-04-25T02:08:49.891460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:55.327825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.894085+0000","last_change":"2024-04-25T02:08:47.888054+0000","last_active":"2024-04-25T02:08:49.894085+0000","last_peered":"2024-04-25T02:08:49.894085+0000","last_clean":"2024-04-25T02:08:49.894085+0000","last_became_active":"2024-04-25T02:08:47.887644+0000","last_became_peered":"2024-04-25T02:08:47.887644+0000","last_unstale":"2024-04-25T02:08:49.894085+0000","last_undegraded":"2024-04-25T02:08:49.894085+0000","last_fullsized":"2024-04-25T02:08:49.894085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:06.291375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.891281+0000","last_change":"2024-04-25T02:08:48.890130+0000","last_active":"2024-04-25T02:08:48.891281+0000","last_peered":"2024-04-25T02:08:48.891281+0000","last_clean":"2024-04-25T02:08:48.891281+0000","last_became_active":"2024-04-25T02:08:48.889853+0000","last_became_peered":"2024-04-25T02:08:48.889853+0000","last_unstale":"2024-04-25T02:08:48.891281+0000","last_undegraded":"2024-04-25T02:08:48.891281+0000","last_fullsized":"2024-04-25T02:08:48.891281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:50.993255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893258+0000","last_change":"2024-04-25T02:08:47.889037+0000","last_active":"2024-04-25T02:08:49.893258+0000","last_peered":"2024-04-25T02:08:49.893258+0000","last_clean":"2024-04-25T02:08:49.893258+0000","last_became_active":"2024-04-25T02:08:47.888761+0000","last_became_peered":"2024-04-25T02:08:47.888761+0000","last_unstale":"2024-04-25T02:08:49.893258+0000","last_undegraded":"2024-04-25T02:08:49.893258+0000","last_fullsized":"2024-04-25T02:08:49.893258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:39.015308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.895847+0000","last_change":"2024-04-25T02:08:48.894591+0000","last_active":"2024-04-25T02:08:48.895847+0000","last_peered":"2024-04-25T02:08:48.895847+0000","last_clean":"2024-04-25T02:08:48.895847+0000","last_became_active":"2024-04-25T02:08:48.894300+0000","last_became_peered":"2024-04-25T02:08:48.894300+0000","last_unstale":"2024-04-25T02:08:48.895847+0000","last_undegraded":"2024-04-25T02:08:48.895847+0000","last_fullsized":"2024-04-25T02:08:48.895847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:55:28.126408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.878033+0000","last_change":"2024-04-25T02:08:47.897248+0000","last_active":"2024-04-25T02:08:50.878033+0000","last_peered":"2024-04-25T02:08:50.878033+0000","last_clean":"2024-04-25T02:08:50.878033+0000","last_became_active":"2024-04-25T02:08:47.896985+0000","last_became_peered":"2024-04-25T02:08:47.896985+0000","last_unstale":"2024-04-25T02:08:50.878033+0000","last_undegraded":"2024-04-25T02:08:50.878033+0000","last_fullsized":"2024-04-25T02:08:50.878033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:45.633249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.895873+0000","last_change":"2024-04-25T02:08:48.893965+0000","last_active":"2024-04-25T02:08:48.895873+0000","last_peered":"2024-04-25T02:08:48.895873+0000","last_clean":"2024-04-25T02:08:48.895873+0000","last_became_active":"2024-04-25T02:08:48.893652+0000","last_became_peered":"2024-04-25T02:08:48.893652+0000","last_unstale":"2024-04-25T02:08:48.895873+0000","last_undegraded":"2024-04-25T02:08:48.895873+0000","last_fullsized":"2024-04-25T02:08:48.895873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:30.802710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.895243+0000","last_change":"2024-04-25T02:08:47.892633+0000","last_active":"2024-04-25T02:08:48.895243+0000","last_peered":"2024-04-25T02:08:48.895243+0000","last_clean":"2024-04-25T02:08:48.895243+0000","last_became_active":"2024-04-25T02:08:47.892319+0000","last_became_peered":"2024-04-25T02:08:47.892319+0000","last_unstale":"2024-04-25T02:08:48.895243+0000","last_undegraded":"2024-04-25T02:08:48.895243+0000","last_fullsized":"2024-04-25T02:08:48.895243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:23:41.115929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.895796+0000","last_change":"2024-04-25T02:08:48.893959+0000","last_active":"2024-04-25T02:08:48.895796+0000","last_peered":"2024-04-25T02:08:48.895796+0000","last_clean":"2024-04-25T02:08:48.895796+0000","last_became_active":"2024-04-25T02:08:48.893697+0000","last_became_peered":"2024-04-25T02:08:48.893697+0000","last_unstale":"2024-04-25T02:08:48.895796+0000","last_undegraded":"2024-04-25T02:08:48.895796+0000","last_fullsized":"2024-04-25T02:08:48.895796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:36:37.437633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892733+0000","last_change":"2024-04-25T02:08:47.884327+0000","last_active":"2024-04-25T02:08:49.892733+0000","last_peered":"2024-04-25T02:08:49.892733+0000","last_clean":"2024-04-25T02:08:49.892733+0000","last_became_active":"2024-04-25T02:08:47.884042+0000","last_became_peered":"2024-04-25T02:08:47.884042+0000","last_unstale":"2024-04-25T02:08:49.892733+0000","last_undegraded":"2024-04-25T02:08:49.892733+0000","last_fullsized":"2024-04-25T02:08:49.892733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:45.633249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.898194+0000","last_change":"2024-04-25T02:08:48.896069+0000","last_active":"2024-04-25T02:08:48.898194+0000","last_peered":"2024-04-25T02:08:48.898194+0000","last_clean":"2024-04-25T02:08:48.898194+0000","last_became_active":"2024-04-25T02:08:48.895779+0000","last_became_peered":"2024-04-25T02:08:48.895779+0000","last_unstale":"2024-04-25T02:08:48.898194+0000","last_undegraded":"2024-04-25T02:08:48.898194+0000","last_fullsized":"2024-04-25T02:08:48.898194+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:21.088815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.893291+0000","last_change":"2024-04-25T02:08:47.890372+0000","last_active":"2024-04-25T02:08:49.893291+0000","last_peered":"2024-04-25T02:08:49.893291+0000","last_clean":"2024-04-25T02:08:49.893291+0000","last_became_active":"2024-04-25T02:08:47.890025+0000","last_became_peered":"2024-04-25T02:08:47.890025+0000","last_unstale":"2024-04-25T02:08:49.893291+0000","last_undegraded":"2024-04-25T02:08:49.893291+0000","last_fullsized":"2024-04-25T02:08:49.893291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:43.717370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.890911+0000","last_change":"2024-04-25T02:08:48.888133+0000","last_active":"2024-04-25T02:08:48.890911+0000","last_peered":"2024-04-25T02:08:48.890911+0000","last_clean":"2024-04-25T02:08:48.890911+0000","last_became_active":"2024-04-25T02:08:48.887865+0000","last_became_peered":"2024-04-25T02:08:48.887865+0000","last_unstale":"2024-04-25T02:08:48.890911+0000","last_undegraded":"2024-04-25T02:08:48.890911+0000","last_fullsized":"2024-04-25T02:08:48.890911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:25.075367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891617+0000","last_change":"2024-04-25T02:08:47.888395+0000","last_active":"2024-04-25T02:08:49.891617+0000","last_peered":"2024-04-25T02:08:49.891617+0000","last_clean":"2024-04-25T02:08:49.891617+0000","last_became_active":"2024-04-25T02:08:47.888109+0000","last_became_peered":"2024-04-25T02:08:47.888109+0000","last_unstale":"2024-04-25T02:08:49.891617+0000","last_undegraded":"2024-04-25T02:08:49.891617+0000","last_fullsized":"2024-04-25T02:08:49.891617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:35:14.853788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.894161+0000","last_change":"2024-04-25T02:08:48.894010+0000","last_active":"2024-04-25T02:08:49.894161+0000","last_peered":"2024-04-25T02:08:49.894161+0000","last_clean":"2024-04-25T02:08:49.894161+0000","last_became_active":"2024-04-25T02:08:48.893710+0000","last_became_peered":"2024-04-25T02:08:48.893710+0000","last_unstale":"2024-04-25T02:08:49.894161+0000","last_undegraded":"2024-04-25T02:08:49.894161+0000","last_fullsized":"2024-04-25T02:08:49.894161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:08:20.827614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.879450+0000","last_change":"2024-04-25T02:08:47.897368+0000","last_active":"2024-04-25T02:08:50.879450+0000","last_peered":"2024-04-25T02:08:50.879450+0000","last_clean":"2024-04-25T02:08:50.879450+0000","last_became_active":"2024-04-25T02:08:47.897088+0000","last_became_peered":"2024-04-25T02:08:47.897088+0000","last_unstale":"2024-04-25T02:08:50.879450+0000","last_undegraded":"2024-04-25T02:08:50.879450+0000","last_fullsized":"2024-04-25T02:08:50.879450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:13.431841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.877996+0000","last_change":"2024-04-25T02:08:48.894231+0000","last_active":"2024-04-25T02:08:50.877996+0000","last_peered":"2024-04-25T02:08:50.877996+0000","last_clean":"2024-04-25T02:08:50.877996+0000","last_became_active":"2024-04-25T02:08:48.893974+0000","last_became_peered":"2024-04-25T02:08:48.893974+0000","last_unstale":"2024-04-25T02:08:50.877996+0000","last_undegraded":"2024-04-25T02:08:50.877996+0000","last_fullsized":"2024-04-25T02:08:50.877996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:58.048729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891473+0000","last_change":"2024-04-25T02:08:47.889358+0000","last_active":"2024-04-25T02:08:49.891473+0000","last_peered":"2024-04-25T02:08:49.891473+0000","last_clean":"2024-04-25T02:08:49.891473+0000","last_became_active":"2024-04-25T02:08:47.889023+0000","last_became_peered":"2024-04-25T02:08:47.889023+0000","last_unstale":"2024-04-25T02:08:49.891473+0000","last_undegraded":"2024-04-25T02:08:49.891473+0000","last_fullsized":"2024-04-25T02:08:49.891473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:52:19.091915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.906039+0000","last_change":"2024-04-25T02:08:48.900526+0000","last_active":"2024-04-25T02:08:48.906039+0000","last_peered":"2024-04-25T02:08:48.906039+0000","last_clean":"2024-04-25T02:08:48.906039+0000","last_became_active":"2024-04-25T02:08:48.900245+0000","last_became_peered":"2024-04-25T02:08:48.900245+0000","last_unstale":"2024-04-25T02:08:48.906039+0000","last_undegraded":"2024-04-25T02:08:48.906039+0000","last_fullsized":"2024-04-25T02:08:48.906039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:46.635184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.878150+0000","last_change":"2024-04-25T02:08:47.890642+0000","last_active":"2024-04-25T02:08:50.878150+0000","last_peered":"2024-04-25T02:08:50.878150+0000","last_clean":"2024-04-25T02:08:50.878150+0000","last_became_active":"2024-04-25T02:08:47.890374+0000","last_became_peered":"2024-04-25T02:08:47.890374+0000","last_unstale":"2024-04-25T02:08:50.878150+0000","last_undegraded":"2024-04-25T02:08:50.878150+0000","last_fullsized":"2024-04-25T02:08:50.878150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:35:14.853788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:50.878034+0000","last_change":"2024-04-25T02:08:48.896320+0000","last_active":"2024-04-25T02:08:50.878034+0000","last_peered":"2024-04-25T02:08:50.878034+0000","last_clean":"2024-04-25T02:08:50.878034+0000","last_became_active":"2024-04-25T02:08:48.896025+0000","last_became_peered":"2024-04-25T02:08:48.896025+0000","last_unstale":"2024-04-25T02:08:50.878034+0000","last_undegraded":"2024-04-25T02:08:50.878034+0000","last_fullsized":"2024-04-25T02:08:50.878034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:43.906271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.891275+0000","last_change":"2024-04-25T02:08:47.884931+0000","last_active":"2024-04-25T02:08:49.891275+0000","last_peered":"2024-04-25T02:08:49.891275+0000","last_clean":"2024-04-25T02:08:49.891275+0000","last_became_active":"2024-04-25T02:08:47.884633+0000","last_became_peered":"2024-04-25T02:08:47.884633+0000","last_unstale":"2024-04-25T02:08:49.891275+0000","last_undegraded":"2024-04-25T02:08:49.891275+0000","last_fullsized":"2024-04-25T02:08:49.891275+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:45.633249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.901299+0000","last_change":"2024-04-25T02:08:48.887501+0000","last_active":"2024-04-25T02:08:48.901299+0000","last_peered":"2024-04-25T02:08:48.901299+0000","last_clean":"2024-04-25T02:08:48.901299+0000","last_became_active":"2024-04-25T02:08:48.887253+0000","last_became_peered":"2024-04-25T02:08:48.887253+0000","last_unstale":"2024-04-25T02:08:48.901299+0000","last_undegraded":"2024-04-25T02:08:48.901299+0000","last_fullsized":"2024-04-25T02:08:48.901299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:18.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892853+0000","last_change":"2024-04-25T02:08:47.883718+0000","last_active":"2024-04-25T02:08:49.892853+0000","last_peered":"2024-04-25T02:08:49.892853+0000","last_clean":"2024-04-25T02:08:49.892853+0000","last_became_active":"2024-04-25T02:08:47.883410+0000","last_became_peered":"2024-04-25T02:08:47.883410+0000","last_unstale":"2024-04-25T02:08:49.892853+0000","last_undegraded":"2024-04-25T02:08:49.892853+0000","last_fullsized":"2024-04-25T02:08:49.892853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:35:14.853788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:08:49.892740+0000","last_change":"2024-04-25T02:08:48.892932+0000","last_active":"2024-04-25T02:08:49.892740+0000","last_peered":"2024-04-25T02:08:49.892740+0000","last_clean":"2024-04-25T02:08:49.892740+0000","last_became_active":"2024-04-25T02:08:48.892502+0000","last_became_peered":"2024-04-25T02:08:48.892502+0000","last_unstale":"2024-04-25T02:08:49.892740+0000","last_undegraded":"2024-04-25T02:08:49.892740+0000","last_fullsized":"2024-04-25T02:08:49.892740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:18.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.876181+0000","last_change":"2024-04-25T02:08:47.892970+0000","last_active":"2024-04-25T02:08:48.876181+0000","last_peered":"2024-04-25T02:08:48.876181+0000","last_clean":"2024-04-25T02:08:48.876181+0000","last_became_active":"2024-04-25T02:08:47.892376+0000","last_became_peered":"2024-04-25T02:08:47.892376+0000","last_unstale":"2024-04-25T02:08:48.876181+0000","last_undegraded":"2024-04-25T02:08:48.876181+0000","last_fullsized":"2024-04-25T02:08:48.876181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:24:02.299677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.894309+0000","last_change":"2024-04-25T02:08:48.891542+0000","last_active":"2024-04-25T02:08:48.894309+0000","last_peered":"2024-04-25T02:08:48.894309+0000","last_clean":"2024-04-25T02:08:48.894309+0000","last_became_active":"2024-04-25T02:08:48.891288+0000","last_became_peered":"2024-04-25T02:08:48.891288+0000","last_unstale":"2024-04-25T02:08:48.894309+0000","last_undegraded":"2024-04-25T02:08:48.894309+0000","last_fullsized":"2024-04-25T02:08:48.894309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:47.865276+0000","last_clean_scrub_stamp":"2024-04-25T02:08:47.865276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:11:50.498003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.895296+0000","last_change":"2024-04-25T02:08:47.891531+0000","last_active":"2024-04-25T02:08:48.895296+0000","last_peered":"2024-04-25T02:08:48.895296+0000","last_clean":"2024-04-25T02:08:48.895296+0000","last_became_active":"2024-04-25T02:08:47.891187+0000","last_became_peered":"2024-04-25T02:08:47.891187+0000","last_unstale":"2024-04-25T02:08:48.895296+0000","last_undegraded":"2024-04-25T02:08:48.895296+0000","last_fullsized":"2024-04-25T02:08:48.895296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:08:46.863341+0000","last_clean_scrub_stamp":"2024-04-25T02:08:46.863341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:35.980344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":190,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.884449+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:08:48.884449+0000","last_peered":"2024-04-25T02:08:48.884449+0000","last_clean":"2024-04-25T02:08:48.884449+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:08:48.884449+0000","last_undegraded":"2024-04-25T02:08:48.884449+0000","last_fullsized":"2024-04-25T02:08:48.884449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":728586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":138744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":145100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":144532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":139762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":138198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":146062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":734796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:08:56.544 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T02:08:56.544 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T02:08:56.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.677+0000 7f63197c8640 1 Processor -- start 2024-04-25T02:08:56.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.677+0000 7f63197c8640 1 -- start start 2024-04-25T02:08:56.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.678+0000 7f63197c8640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f631415e3b0 0x7f63140721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.678+0000 7f63197c8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f631406c7d0 0x7f63140c9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.678+0000 7f63197c8640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f631415e790 con 0x7f631406fdd0 2024-04-25T02:08:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.678+0000 7f63197c8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6314161e80 con 0x7f631406c7d0 2024-04-25T02:08:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.678+0000 7f63197c8640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f63141620d0 con 0x7f631415e3b0 2024-04-25T02:08:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.678+0000 7f63137fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f631406c7d0 0x7f63140c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.678+0000 7f63137fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f631406c7d0 0x7f63140c9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36592/0 (socket says 172.21.15.79:36592) 2024-04-25T02:08:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.678+0000 7f63137fe640 1 -- 172.21.15.79:0/3910610132 learned_addr learned my addr 172.21.15.79:0/3910610132 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.678+0000 7f6312ffd640 1 --2- 172.21.15.79:0/3910610132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f631415e3b0 0x7f63140721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.679+0000 7f63137fe640 1 -- 172.21.15.79:0/3910610132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f631415e3b0 msgr2=0x7f63140721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.679+0000 7f63137fe640 1 --2- 172.21.15.79:0/3910610132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f631415e3b0 0x7f63140721a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.679+0000 7f63137fe640 1 -- 172.21.15.79:0/3910610132 >> v1:172.21.15.189:6789/0 conn(0x7f631406fdd0 legacy=0x7f631406c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.679+0000 7f63137fe640 1 -- 172.21.15.79:0/3910610132 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63141623b0 con 0x7f631406c7d0 2024-04-25T02:08:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.679+0000 7f63137fe640 1 --2- 172.21.15.79:0/3910610132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f631406c7d0 0x7f63140c9890 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f630c009870 tx=0x7f630c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766b2e2c139d9e6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.679+0000 7f6311ffb640 1 -- 172.21.15.79:0/3910610132 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c037070 con 0x7f631406c7d0 2024-04-25T02:08:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.679+0000 7f6311ffb640 1 -- 172.21.15.79:0/3910610132 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f630c032440 con 0x7f631406c7d0 2024-04-25T02:08:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.679+0000 7f6311ffb640 1 -- 172.21.15.79:0/3910610132 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c032810 con 0x7f631406c7d0 2024-04-25T02:08:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.680+0000 7f63197c8640 1 -- 172.21.15.79:0/3910610132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f631406c7d0 msgr2=0x7f63140c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.680+0000 7f63197c8640 1 --2- 172.21.15.79:0/3910610132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f631406c7d0 0x7f63140c9890 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f630c009870 tx=0x7f630c02a130 comp rx=0 tx=0).stop 2024-04-25T02:08:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.680+0000 7f63197c8640 1 -- 172.21.15.79:0/3910610132 shutdown_connections 2024-04-25T02:08:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.680+0000 7f63197c8640 1 --2- 172.21.15.79:0/3910610132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f631406c7d0 0x7f63140c9890 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.680+0000 7f63197c8640 1 --2- 172.21.15.79:0/3910610132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f631415e3b0 0x7f63140721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.680+0000 7f63197c8640 1 -- 172.21.15.79:0/3910610132 >> 172.21.15.79:0/3910610132 conn(0x7f63140716b0 msgr2=0x7f6314071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.680+0000 7f63197c8640 1 -- 172.21.15.79:0/3910610132 shutdown_connections 2024-04-25T02:08:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.680+0000 7f63197c8640 1 -- 172.21.15.79:0/3910610132 wait complete. 2024-04-25T02:08:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.681+0000 7f63197c8640 1 Processor -- start 2024-04-25T02:08:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.681+0000 7f63197c8640 1 -- start start 2024-04-25T02:08:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f63197c8640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f631406c7d0 0x7f63140b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f63197c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f631406fdd0 0x7f63141f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f63197c8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631415e3b0 0x7f63141f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f63197c8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f63140cf150 con 0x7f631406fdd0 2024-04-25T02:08:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f63197c8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6314162970 con 0x7f631415e3b0 2024-04-25T02:08:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f63197c8640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f63140cf2d0 con 0x7f631406c7d0 2024-04-25T02:08:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f63127fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f631406fdd0 0x7f63141f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f63127fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f631406fdd0 0x7f63141f75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36608/0 (socket says 172.21.15.79:36608) 2024-04-25T02:08:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f63127fc640 1 -- 172.21.15.79:0/2652978732 learned_addr learned my addr 172.21.15.79:0/2652978732 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f63137fe640 1 --2- 172.21.15.79:0/2652978732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631415e3b0 0x7f63141f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f6312ffd640 1 --2- 172.21.15.79:0/2652978732 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f631406c7d0 0x7f63140b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f63127fc640 1 -- 172.21.15.79:0/2652978732 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f631406c7d0 msgr2=0x7f63140b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f63127fc640 1 --2- 172.21.15.79:0/2652978732 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f631406c7d0 0x7f63140b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f63127fc640 1 -- 172.21.15.79:0/2652978732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631415e3b0 msgr2=0x7f63141f7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f63127fc640 1 --2- 172.21.15.79:0/2652978732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631415e3b0 0x7f63141f7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.682+0000 7f63127fc640 1 -- 172.21.15.79:0/2652978732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631415f530 con 0x7f631406fdd0 2024-04-25T02:08:56.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.683+0000 7f63127fc640 1 --2- 172.21.15.79:0/2652978732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f631406fdd0 0x7f63141f75a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f630800c470 tx=0x7f6308001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:56.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.683+0000 7f62fb7fe640 1 -- 172.21.15.79:0/2652978732 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63080052d0 con 0x7f631406fdd0 2024-04-25T02:08:56.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.683+0000 7f62fb7fe640 1 -- 172.21.15.79:0/2652978732 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6308005470 con 0x7f631406fdd0 2024-04-25T02:08:56.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.683+0000 7f62fb7fe640 1 -- 172.21.15.79:0/2652978732 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6308007260 con 0x7f631406fdd0 2024-04-25T02:08:56.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.683+0000 7f63197c8640 1 -- 172.21.15.79:0/2652978732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f631415f810 con 0x7f631406fdd0 2024-04-25T02:08:56.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.683+0000 7f63197c8640 1 -- 172.21.15.79:0/2652978732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63140b6180 con 0x7f631406fdd0 2024-04-25T02:08:56.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.684+0000 7f63197c8640 1 -- 172.21.15.79:0/2652978732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63140690a0 con 0x7f631406fdd0 2024-04-25T02:08:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.684+0000 7f62fb7fe640 1 -- 172.21.15.79:0/2652978732 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6308007400 con 0x7f631406fdd0 2024-04-25T02:08:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.684+0000 7f62fb7fe640 1 --2- 172.21.15.79:0/2652978732 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f630006be30 0x7f630006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.684+0000 7f62fb7fe640 1 -- 172.21.15.79:0/2652978732 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f630808a300 con 0x7f631406fdd0 2024-04-25T02:08:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.685+0000 7f6312ffd640 1 --2- 172.21.15.79:0/2652978732 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f630006be30 0x7f630006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.685+0000 7f6312ffd640 1 --2- 172.21.15.79:0/2652978732 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f630006be30 0x7f630006e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6304009e90 tx=0x7f630400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:56.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.689+0000 7f62fb7fe640 1 -- 172.21.15.79:0/2652978732 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6308058d40 con 0x7f631406fdd0 2024-04-25T02:08:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.934+0000 7f63197c8640 1 -- 172.21.15.79:0/2652978732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f63140b1930 con 0x7f631406fdd0 2024-04-25T02:08:56.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.935+0000 7f62fb7fe640 1 -- 172.21.15.79:0/2652978732 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f6308058640 con 0x7f631406fdd0 2024-04-25T02:08:56.942 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-04-25T02:08:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g== 2024-04-25T02:08:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: caps mds = "allow" 2024-04-25T02:08:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: caps mon = "allow r" 2024-04-25T02:08:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T02:08:56.943 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2024-04-25T02:08:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.937+0000 7f63197c8640 1 -- 172.21.15.79:0/2652978732 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f630006be30 msgr2=0x7f630006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.937+0000 7f63197c8640 1 --2- 172.21.15.79:0/2652978732 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f630006be30 0x7f630006e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6304009e90 tx=0x7f630400b040 comp rx=0 tx=0).stop 2024-04-25T02:08:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.937+0000 7f63197c8640 1 -- 172.21.15.79:0/2652978732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f631406fdd0 msgr2=0x7f63141f75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.937+0000 7f63197c8640 1 --2- 172.21.15.79:0/2652978732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f631406fdd0 0x7f63141f75a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f630800c470 tx=0x7f6308001e70 comp rx=0 tx=0).stop 2024-04-25T02:08:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.938+0000 7f63197c8640 1 -- 172.21.15.79:0/2652978732 shutdown_connections 2024-04-25T02:08:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.938+0000 7f63197c8640 1 --2- 172.21.15.79:0/2652978732 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f630006be30 0x7f630006e2f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.938+0000 7f63197c8640 1 --2- 172.21.15.79:0/2652978732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631415e3b0 0x7f63141f7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.938+0000 7f63197c8640 1 --2- 172.21.15.79:0/2652978732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f631406fdd0 0x7f63141f75a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.938+0000 7f63197c8640 1 --2- 172.21.15.79:0/2652978732 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f631406c7d0 0x7f63140b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.938+0000 7f63197c8640 1 -- 172.21.15.79:0/2652978732 >> 172.21.15.79:0/2652978732 conn(0x7f63140716b0 msgr2=0x7f63140b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.938+0000 7f63197c8640 1 -- 172.21.15.79:0/2652978732 shutdown_connections 2024-04-25T02:08:56.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:56.938+0000 7f63197c8640 1 -- 172.21.15.79:0/2652978732 wait complete. 2024-04-25T02:08:56.956 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:08:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.044+0000 7f249d5ed640 1 Processor -- start 2024-04-25T02:08:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.044+0000 7f249d5ed640 1 -- start start 2024-04-25T02:08:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.045+0000 7f249d5ed640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f249815e440 0x7f24980d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.045+0000 7f249d5ed640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24980cf7a0 0x7f24980b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.045+0000 7f249d5ed640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24980cfdc0 con 0x7f24980d4570 2024-04-25T02:08:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.045+0000 7f249d5ed640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f24980d49e0 con 0x7f249815e440 2024-04-25T02:08:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.045+0000 7f249d5ed640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f24980d00a0 con 0x7f24980cf7a0 2024-04-25T02:08:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.045+0000 7f2496ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f249815e440 0x7f24980d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.045+0000 7f2496ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f249815e440 0x7f24980d4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36624/0 (socket says 172.21.15.79:36624) 2024-04-25T02:08:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.045+0000 7f248ffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f24980d4570 0x7f24980cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47394/0 (socket says 172.21.15.79:47394) 2024-04-25T02:08:57.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.045+0000 7f2496ffd640 1 -- 172.21.15.79:0/936799461 learned_addr learned my addr 172.21.15.79:0/936799461 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:57.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.045+0000 7f24977fe640 1 --2- 172.21.15.79:0/936799461 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24980cf7a0 0x7f24980b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.045+0000 7f2496ffd640 1 -- 172.21.15.79:0/936799461 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24980cf7a0 msgr2=0x7f24980b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:57.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.045+0000 7f24967fc640 1 -- 172.21.15.79:0/936799461 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1758125095 0 0) 0x7f24980cfdc0 con 0x7f24980d4570 2024-04-25T02:08:57.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.045+0000 7f2496ffd640 1 --2- 172.21.15.79:0/936799461 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24980cf7a0 0x7f24980b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.045+0000 7f2496ffd640 1 -- 172.21.15.79:0/936799461 >> v1:172.21.15.79:6789/0 conn(0x7f24980d4570 legacy=0x7f24980cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.045+0000 7f2496ffd640 1 -- 172.21.15.79:0/936799461 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24980d0380 con 0x7f249815e440 2024-04-25T02:08:57.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.046+0000 7f2496ffd640 1 --2- 172.21.15.79:0/936799461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f249815e440 0x7f24980d4030 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2488009870 tx=0x7f248802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd9e9386f57aed4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.046+0000 7f24967fc640 1 -- 172.21.15.79:0/936799461 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488037070 con 0x7f249815e440 2024-04-25T02:08:57.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.046+0000 7f24967fc640 1 -- 172.21.15.79:0/936799461 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2488032440 con 0x7f249815e440 2024-04-25T02:08:57.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.046+0000 7f24967fc640 1 -- 172.21.15.79:0/936799461 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488032810 con 0x7f249815e440 2024-04-25T02:08:57.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.046+0000 7f249d5ed640 1 -- 172.21.15.79:0/936799461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f249815e440 msgr2=0x7f24980d4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.046+0000 7f249d5ed640 1 --2- 172.21.15.79:0/936799461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f249815e440 0x7f24980d4030 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2488009870 tx=0x7f248802a270 comp rx=0 tx=0).stop 2024-04-25T02:08:57.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.046+0000 7f249d5ed640 1 -- 172.21.15.79:0/936799461 shutdown_connections 2024-04-25T02:08:57.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.046+0000 7f249d5ed640 1 --2- 172.21.15.79:0/936799461 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24980cf7a0 0x7f24980b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.046+0000 7f249d5ed640 1 --2- 172.21.15.79:0/936799461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f249815e440 0x7f24980d4030 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.046+0000 7f249d5ed640 1 -- 172.21.15.79:0/936799461 >> 172.21.15.79:0/936799461 conn(0x7f249808db50 msgr2=0x7f249809d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:57.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.047+0000 7f249d5ed640 1 -- 172.21.15.79:0/936799461 shutdown_connections 2024-04-25T02:08:57.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.047+0000 7f249d5ed640 1 -- 172.21.15.79:0/936799461 wait complete. 2024-04-25T02:08:57.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.048+0000 7f249d5ed640 1 Processor -- start 2024-04-25T02:08:57.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.048+0000 7f249d5ed640 1 -- start start 2024-04-25T02:08:57.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.048+0000 7f249d5ed640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24980cf7a0 0x7f249815caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.048+0000 7f249d5ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24980d4570 0x7f24980b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.048+0000 7f249d5ed640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f249815e440 0x7f24980b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.048+0000 7f249d5ed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f24980b3e80 con 0x7f24980d4570 2024-04-25T02:08:57.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.048+0000 7f249d5ed640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f249815e820 con 0x7f24980cf7a0 2024-04-25T02:08:57.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.048+0000 7f249d5ed640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f24980b4000 con 0x7f249815e440 2024-04-25T02:08:57.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.048+0000 7f248ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24980d4570 0x7f24980b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.048+0000 7f248ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24980d4570 0x7f24980b84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36632/0 (socket says 172.21.15.79:36632) 2024-04-25T02:08:57.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.048+0000 7f248ffff640 1 -- 172.21.15.79:0/3877138155 learned_addr learned my addr 172.21.15.79:0/3877138155 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:57.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.049+0000 7f24977fe640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f249815e440 0x7f24980b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.049+0000 7f2496ffd640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24980cf7a0 0x7f249815caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.049+0000 7f248ffff640 1 -- 172.21.15.79:0/3877138155 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f249815e440 msgr2=0x7f24980b8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.049+0000 7f248ffff640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f249815e440 0x7f24980b8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.049+0000 7f248ffff640 1 -- 172.21.15.79:0/3877138155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24980cf7a0 msgr2=0x7f249815caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.049+0000 7f248ffff640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24980cf7a0 0x7f249815caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.049+0000 7f248ffff640 1 -- 172.21.15.79:0/3877138155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24980b9340 con 0x7f24980d4570 2024-04-25T02:08:57.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.049+0000 7f24977fe640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f249815e440 0x7f24980b8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:57.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.049+0000 7f2496ffd640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24980cf7a0 0x7f249815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:57.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.049+0000 7f248ffff640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24980d4570 0x7f24980b84c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f248000c500 tx=0x7f248000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.049+0000 7f248f7fe640 1 -- 172.21.15.79:0/3877138155 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480018070 con 0x7f24980d4570 2024-04-25T02:08:57.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.049+0000 7f248f7fe640 1 -- 172.21.15.79:0/3877138155 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2480007580 con 0x7f24980d4570 2024-04-25T02:08:57.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.049+0000 7f248f7fe640 1 -- 172.21.15.79:0/3877138155 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480004a20 con 0x7f24980d4570 2024-04-25T02:08:57.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.049+0000 7f249d5ed640 1 -- 172.21.15.79:0/3877138155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24980b9620 con 0x7f24980d4570 2024-04-25T02:08:57.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.049+0000 7f249d5ed640 1 -- 172.21.15.79:0/3877138155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24980b9be0 con 0x7f24980d4570 2024-04-25T02:08:57.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.050+0000 7f249d5ed640 1 -- 172.21.15.79:0/3877138155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24980690a0 con 0x7f24980d4570 2024-04-25T02:08:57.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.051+0000 7f248f7fe640 1 -- 172.21.15.79:0/3877138155 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2480004bc0 con 0x7f24980d4570 2024-04-25T02:08:57.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.051+0000 7f248f7fe640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f247806be60 0x7f247806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.051+0000 7f2496ffd640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f247806be60 0x7f247806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.051+0000 7f248f7fe640 1 -- 172.21.15.79:0/3877138155 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f248008a070 con 0x7f24980d4570 2024-04-25T02:08:57.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.052+0000 7f2496ffd640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f247806be60 0x7f247806e320 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2488034000 tx=0x7f248802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.055+0000 7f248f7fe640 1 -- 172.21.15.79:0/3877138155 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2480058ab0 con 0x7f24980d4570 2024-04-25T02:08:57.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.264+0000 7f249d5ed640 1 -- 172.21.15.79:0/3877138155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24980d2460 con 0x7f24980d4570 2024-04-25T02:08:57.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.264+0000 7f248f7fe640 1 -- 172.21.15.79:0/3877138155 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+5181 (secure 0 0 0) 0x7f24800583b0 con 0x7f24980d4570 2024-04-25T02:08:57.272 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:08:57.272 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2251520552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2251520552},{"type":"v1","addr":"172.21.15.79:6836","nonce":2251520552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/1462215746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":1462215746},{"type":"v1","addr":"172.21.15.79:6837","nonce":1462215746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/2359417586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2359417586},{"type":"v1","addr":"172.21.15.189:6834","nonce":2359417586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:08:48.219535+0000","modified":"2024-04-25T02:08:50.227642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6835/605900869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":605900869},{"type":"v1","addr":"172.21.15.189:6835","nonce":605900869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5112,"qdb_cluster":[5112]},"id":2}]} 2024-04-25T02:08:57.272 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 12 2024-04-25T02:08:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.266+0000 7f249d5ed640 1 -- 172.21.15.79:0/3877138155 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f247806be60 msgr2=0x7f247806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.266+0000 7f249d5ed640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f247806be60 0x7f247806e320 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2488034000 tx=0x7f248802e000 comp rx=0 tx=0).stop 2024-04-25T02:08:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.266+0000 7f249d5ed640 1 -- 172.21.15.79:0/3877138155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24980d4570 msgr2=0x7f24980b84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.266+0000 7f249d5ed640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24980d4570 0x7f24980b84c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f248000c500 tx=0x7f248000c9c0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.266+0000 7f249d5ed640 1 -- 172.21.15.79:0/3877138155 shutdown_connections 2024-04-25T02:08:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.266+0000 7f249d5ed640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f247806be60 0x7f247806e320 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.266+0000 7f249d5ed640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f249815e440 0x7f24980b8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.266+0000 7f249d5ed640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24980d4570 0x7f24980b84c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.266+0000 7f249d5ed640 1 --2- 172.21.15.79:0/3877138155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24980cf7a0 0x7f249815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.266+0000 7f249d5ed640 1 -- 172.21.15.79:0/3877138155 >> 172.21.15.79:0/3877138155 conn(0x7f249808db50 msgr2=0x7f24980d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.266+0000 7f249d5ed640 1 -- 172.21.15.79:0/3877138155 shutdown_connections 2024-04-25T02:08:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.266+0000 7f249d5ed640 1 -- 172.21.15.79:0/3877138155 wait complete. 2024-04-25T02:08:57.687 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:08:48.219535+0000', 'modified': '2024-04-25T02:08:50.227642+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5112}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5112': {'gid': 5112, 'name': 'b', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.189:6835/605900869', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6833', 'nonce': 605900869}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 605900869}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5112, 'qdb_cluster': [5112]} 2024-04-25T02:08:57.688 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:08:57.688 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T02:08:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.781+0000 7fb86ae66640 1 Processor -- start 2024-04-25T02:08:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.781+0000 7fb86ae66640 1 -- start start 2024-04-25T02:08:57.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.782+0000 7fb86ae66640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb86415e140 0x7fb864066ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.782+0000 7fb86ae66640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb86406b0b0 0x7fb8640c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.782+0000 7fb86ae66640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8640cea70 con 0x7fb86415e520 2024-04-25T02:08:57.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.782+0000 7fb86ae66640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb864067480 con 0x7fb86415e140 2024-04-25T02:08:57.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.782+0000 7fb86ae66640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb8640cf3a0 con 0x7fb86406b0b0 2024-04-25T02:08:57.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.782+0000 7fb863fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb86415e520 0x7fb8640af8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47410/0 (socket says 172.21.15.79:47410) 2024-04-25T02:08:57.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.782+0000 7fb863fff640 1 -- 172.21.15.79:0/1110666020 learned_addr learned my addr 172.21.15.79:0/1110666020 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:57.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.782+0000 7fb868c02640 1 --2- 172.21.15.79:0/1110666020 >> v2:172.21.15.79:3300/0 conn(0x7fb86415e140 0x7fb864066ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.782+0000 7fb869403640 1 --2- 172.21.15.79:0/1110666020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb86406b0b0 0x7fb8640c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.782+0000 7fb8637fe640 1 -- 172.21.15.79:0/1110666020 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1883677585 0 0) 0x7fb8640cea70 con 0x7fb86415e520 2024-04-25T02:08:57.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.783+0000 7fb8637fe640 1 -- 172.21.15.79:0/1110666020 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb84c003520 con 0x7fb86415e520 2024-04-25T02:08:57.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.783+0000 7fb868c02640 1 -- 172.21.15.79:0/1110666020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb86406b0b0 msgr2=0x7fb8640c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:57.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.783+0000 7fb868c02640 1 --2- 172.21.15.79:0/1110666020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb86406b0b0 0x7fb8640c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.783+0000 7fb868c02640 1 -- 172.21.15.79:0/1110666020 >> v1:172.21.15.79:6789/0 conn(0x7fb86415e520 legacy=0x7fb8640af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.783+0000 7fb868c02640 1 -- 172.21.15.79:0/1110666020 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8640ced50 con 0x7fb86415e140 2024-04-25T02:08:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.783+0000 7fb868c02640 1 --2- 172.21.15.79:0/1110666020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86415e140 0x7fb864066ea0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb8540097a0 tx=0x7fb85402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3436b32b18c8a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.783+0000 7fb8637fe640 1 -- 172.21.15.79:0/1110666020 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854037070 con 0x7fb86415e140 2024-04-25T02:08:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.783+0000 7fb8637fe640 1 -- 172.21.15.79:0/1110666020 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb85402ae50 con 0x7fb86415e140 2024-04-25T02:08:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.783+0000 7fb8637fe640 1 -- 172.21.15.79:0/1110666020 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854032660 con 0x7fb86415e140 2024-04-25T02:08:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.784+0000 7fb86ae66640 1 -- 172.21.15.79:0/1110666020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86415e140 msgr2=0x7fb864066ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.784+0000 7fb86ae66640 1 --2- 172.21.15.79:0/1110666020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86415e140 0x7fb864066ea0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb8540097a0 tx=0x7fb85402a100 comp rx=0 tx=0).stop 2024-04-25T02:08:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.784+0000 7fb86ae66640 1 -- 172.21.15.79:0/1110666020 shutdown_connections 2024-04-25T02:08:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.784+0000 7fb86ae66640 1 --2- 172.21.15.79:0/1110666020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb86406b0b0 0x7fb8640c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.784+0000 7fb86ae66640 1 --2- 172.21.15.79:0/1110666020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86415e140 0x7fb864066ea0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.784+0000 7fb86ae66640 1 -- 172.21.15.79:0/1110666020 >> 172.21.15.79:0/1110666020 conn(0x7fb8640ccee0 msgr2=0x7fb8640cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.784+0000 7fb86ae66640 1 -- 172.21.15.79:0/1110666020 shutdown_connections 2024-04-25T02:08:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.784+0000 7fb86ae66640 1 -- 172.21.15.79:0/1110666020 wait complete. 2024-04-25T02:08:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.785+0000 7fb86ae66640 1 Processor -- start 2024-04-25T02:08:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.785+0000 7fb86ae66640 1 -- start start 2024-04-25T02:08:57.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.786+0000 7fb86ae66640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb86406b0b0 0x7fb864146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.786+0000 7fb86ae66640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb86415e140 0x7fb8640b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.786+0000 7fb86ae66640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86415e520 0x7fb864152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.786+0000 7fb86ae66640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb86406b6c0 con 0x7fb86415e520 2024-04-25T02:08:57.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.786+0000 7fb86ae66640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb86406b540 con 0x7fb86415e140 2024-04-25T02:08:57.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.786+0000 7fb86ae66640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb8640c9cf0 con 0x7fb86406b0b0 2024-04-25T02:08:57.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.786+0000 7fb869403640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86415e520 0x7fb864152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.786+0000 7fb869403640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86415e520 0x7fb864152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36654/0 (socket says 172.21.15.79:36654) 2024-04-25T02:08:57.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.786+0000 7fb869403640 1 -- 172.21.15.79:0/772113339 learned_addr learned my addr 172.21.15.79:0/772113339 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:57.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.786+0000 7fb868c02640 1 --2- 172.21.15.79:0/772113339 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb86406b0b0 0x7fb864146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.786+0000 7fb863fff640 1 --2- 172.21.15.79:0/772113339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb86415e140 0x7fb8640b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.786+0000 7fb869403640 1 -- 172.21.15.79:0/772113339 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb86406b0b0 msgr2=0x7fb864146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.787+0000 7fb869403640 1 --2- 172.21.15.79:0/772113339 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb86406b0b0 0x7fb864146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.787+0000 7fb869403640 1 -- 172.21.15.79:0/772113339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb86415e140 msgr2=0x7fb8640b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.787+0000 7fb869403640 1 --2- 172.21.15.79:0/772113339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb86415e140 0x7fb8640b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.787+0000 7fb869403640 1 -- 172.21.15.79:0/772113339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8640b3ea0 con 0x7fb86415e520 2024-04-25T02:08:57.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.787+0000 7fb869403640 1 --2- 172.21.15.79:0/772113339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86415e520 0x7fb864152fd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb85c007e70 tx=0x7fb85c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.787+0000 7fb8617fa640 1 -- 172.21.15.79:0/772113339 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c014620 con 0x7fb86415e520 2024-04-25T02:08:57.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.787+0000 7fb8617fa640 1 -- 172.21.15.79:0/772113339 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb85c019070 con 0x7fb86415e520 2024-04-25T02:08:57.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.787+0000 7fb8617fa640 1 -- 172.21.15.79:0/772113339 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c014a20 con 0x7fb86415e520 2024-04-25T02:08:57.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.787+0000 7fb86ae66640 1 -- 172.21.15.79:0/772113339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8640b4180 con 0x7fb86415e520 2024-04-25T02:08:57.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.787+0000 7fb86ae66640 1 -- 172.21.15.79:0/772113339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8640b4740 con 0x7fb86415e520 2024-04-25T02:08:57.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.788+0000 7fb8617fa640 1 -- 172.21.15.79:0/772113339 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb85c014bc0 con 0x7fb86415e520 2024-04-25T02:08:57.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.789+0000 7fb8617fa640 1 --2- 172.21.15.79:0/772113339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb85006be30 0x7fb85006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.789+0000 7fb868c02640 1 --2- 172.21.15.79:0/772113339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb85006be30 0x7fb85006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.789+0000 7fb8617fa640 1 -- 172.21.15.79:0/772113339 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb85c08b720 con 0x7fb86415e520 2024-04-25T02:08:57.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.789+0000 7fb868c02640 1 --2- 172.21.15.79:0/772113339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb85006be30 0x7fb85006e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb854034000 tx=0x7fb85402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.790+0000 7fb86db70740 1 Processor -- start 2024-04-25T02:08:57.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.790+0000 7fb86db70740 1 -- start start 2024-04-25T02:08:57.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.790+0000 7fb86db70740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c19266c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.790+0000 7fb86db70740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c19269cc80 0x55c19269c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.790+0000 7fb86db70740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c19269c540 0x55c192671350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.790+0000 7fb86db70740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c1925d4f00 con 0x55c1926b9b60 2024-04-25T02:08:57.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.790+0000 7fb86db70740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c19257d750 con 0x55c19269c540 2024-04-25T02:08:57.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.790+0000 7fb86db70740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55c1925d0ec0 con 0x55c19269cc80 2024-04-25T02:08:57.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.791+0000 7fb868c02640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c19266c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.791+0000 7fb868c02640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c19266c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36666/0 (socket says 172.21.15.79:36666) 2024-04-25T02:08:57.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.791+0000 7fb868c02640 1 -- 172.21.15.79:0/2155289930 learned_addr learned my addr 172.21.15.79:0/2155289930 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:57.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.791+0000 7fb868c02640 1 -- 172.21.15.79:0/2155289930 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c19269cc80 msgr2=0x55c19269c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:57.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.791+0000 7fb868c02640 1 --2- 172.21.15.79:0/2155289930 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c19269cc80 0x55c19269c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.791+0000 7fb868c02640 1 -- 172.21.15.79:0/2155289930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c19269c540 msgr2=0x55c192671350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.791+0000 7fb868c02640 1 --2- 172.21.15.79:0/2155289930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c19269c540 0x55c192671350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.791+0000 7fb868c02640 1 -- 172.21.15.79:0/2155289930 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1922e92d0 con 0x55c1926b9b60 2024-04-25T02:08:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.791+0000 7fb868c02640 1 --2- 172.21.15.79:0/2155289930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c19266c4f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb85402a6f0 tx=0x7fb85402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9afc7eb202be5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.791+0000 7fb84a7fc640 1 -- 172.21.15.79:0/2155289930 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85404c070 con 0x55c1926b9b60 2024-04-25T02:08:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.791+0000 7fb84a7fc640 1 -- 172.21.15.79:0/2155289930 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb854032d10 con 0x55c1926b9b60 2024-04-25T02:08:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.791+0000 7fb84a7fc640 1 -- 172.21.15.79:0/2155289930 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854037040 con 0x55c1926b9b60 2024-04-25T02:08:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.792+0000 7fb86db70740 1 -- 172.21.15.79:0/2155289930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 msgr2=0x55c19266c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.792+0000 7fb86db70740 1 --2- 172.21.15.79:0/2155289930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c19266c4f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb85402a6f0 tx=0x7fb85402c000 comp rx=0 tx=0).stop 2024-04-25T02:08:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.792+0000 7fb86db70740 1 -- 172.21.15.79:0/2155289930 shutdown_connections 2024-04-25T02:08:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.792+0000 7fb86db70740 1 --2- 172.21.15.79:0/2155289930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c19269c540 0x55c192671350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.792+0000 7fb86db70740 1 --2- 172.21.15.79:0/2155289930 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c19269cc80 0x55c19269c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.792+0000 7fb86db70740 1 --2- 172.21.15.79:0/2155289930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c19266c4f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.792+0000 7fb86db70740 1 -- 172.21.15.79:0/2155289930 >> 172.21.15.79:0/2155289930 conn(0x55c19266e760 msgr2=0x55c1926b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.792+0000 7fb86db70740 1 -- 172.21.15.79:0/2155289930 shutdown_connections 2024-04-25T02:08:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.792+0000 7fb86db70740 1 -- 172.21.15.79:0/2155289930 wait complete. 2024-04-25T02:08:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.792+0000 7fb86db70740 1 -- start start 2024-04-25T02:08:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.793+0000 7fb86db70740 1 Processor -- start 2024-04-25T02:08:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.793+0000 7fb86db70740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c19269cc80 0x55c192697dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.793+0000 7fb86db70740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c192671110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.793+0000 7fb86db70740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c1926adcc0 0x55c192671650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.793+0000 7fb86db70740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c192670910 con 0x55c1926b9b60 2024-04-25T02:08:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.793+0000 7fb86db70740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c192590cf0 con 0x55c19269cc80 2024-04-25T02:08:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.793+0000 7fb86db70740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55c19266fd00 con 0x55c1926adcc0 2024-04-25T02:08:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.793+0000 7fb86db70740 10 client.0 _ll_register_callbacks cb 0x55c1925906e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:08:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.793+0000 7fb863fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c192671110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.793+0000 7fb863fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c192671110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36674/0 (socket says 172.21.15.79:36674) 2024-04-25T02:08:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.793+0000 7fb863fff640 1 -- 172.21.15.79:0/1438174242 learned_addr learned my addr 172.21.15.79:0/1438174242 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.793+0000 7fb869403640 1 --2- 172.21.15.79:0/1438174242 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c1926adcc0 0x55c192671650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.793+0000 7fb868c02640 1 --2- 172.21.15.79:0/1438174242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c19269cc80 0x55c192697dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb863fff640 1 -- 172.21.15.79:0/1438174242 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c1926adcc0 msgr2=0x55c192671650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb863fff640 1 --2- 172.21.15.79:0/1438174242 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c1926adcc0 0x55c192671650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb863fff640 1 -- 172.21.15.79:0/1438174242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c19269cc80 msgr2=0x55c192697dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb863fff640 1 --2- 172.21.15.79:0/1438174242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c19269cc80 0x55c192697dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb863fff640 1 -- 172.21.15.79:0/1438174242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1923b36b0 con 0x55c1926b9b60 2024-04-25T02:08:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb868c02640 1 --2- 172.21.15.79:0/1438174242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c19269cc80 0x55c192697dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb869403640 1 --2- 172.21.15.79:0/1438174242 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c1926adcc0 0x55c192671650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb863fff640 1 --2- 172.21.15.79:0/1438174242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c192671110 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb858001d60 tx=0x7fb85800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05992cad006185b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb8437fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:08:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb8437fe640 1 -- 172.21.15.79:0/1438174242 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858019060 con 0x55c1926b9b60 2024-04-25T02:08:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb86db70740 1 -- 172.21.15.79:0/1438174242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb854032d10 con 0x55c1926b9b60 2024-04-25T02:08:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb8437fe640 1 -- 172.21.15.79:0/1438174242 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb858005850 con 0x55c1926b9b60 2024-04-25T02:08:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb8437fe640 1 -- 172.21.15.79:0/1438174242 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7fb85801f050 con 0x55c1926b9b60 2024-04-25T02:08:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb86db70740 10 client.5313 fetch_fsmap learned FSMap version 12 2024-04-25T02:08:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb86db70740 1 -- 172.21.15.79:0/1438174242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x55c19268a600 con 0x55c1926b9b60 2024-04-25T02:08:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb8437fe640 1 -- 172.21.15.79:0/1438174242 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb854032d10 con 0x55c1926b9b60 2024-04-25T02:08:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb8437fe640 1 -- 172.21.15.79:0/1438174242 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 12) ==== 3494+0+0 (secure 0 0 0) 0x7fb858022020 con 0x55c1926b9b60 2024-04-25T02:08:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb86db70740 10 client.5313 fetch_fsmap finished waiting for FSMap version 12 2024-04-25T02:08:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb86db70740 10 client.5313 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T02:08:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb86db70740 20 client.5313 populate_metadata read hostname 'smithi079' 2024-04-25T02:08:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb86db70740 1 --2- 172.21.15.79:0/1438174242 >> [v2:172.21.15.189:6833/605900869,v1:172.21.15.189:6835/605900869] conn(0x55c1926af710 0x55c19269d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb86db70740 4 client.5313 mds_command: new command op to 5112 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:08:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.794+0000 7fb86db70740 1 -- 172.21.15.79:0/1438174242 --> [v2:172.21.15.189:6833/605900869,v1:172.21.15.189:6835/605900869] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1925e2440 con 0x55c1926af710 2024-04-25T02:08:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.795+0000 7fb868c02640 1 --2- 172.21.15.79:0/1438174242 >> [v2:172.21.15.189:6833/605900869,v1:172.21.15.189:6835/605900869] conn(0x55c1926af710 0x55c19269d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.795+0000 7fb8437fe640 10 client.5313 ms_handle_connect on v2:172.21.15.189:6833/605900869 2024-04-25T02:08:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.795+0000 7fb868c02640 1 --2- 172.21.15.79:0/1438174242 >> [v2:172.21.15.189:6833/605900869,v1:172.21.15.189:6835/605900869] conn(0x55c1926af710 0x55c19269d7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb958b53bf890ff server_cookie=37b6ca9ca485a4d5 in_seq=0 out_seq=0 2024-04-25T02:08:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.796+0000 7fb8437fe640 1 -- 172.21.15.79:0/1438174242 <== mds.0 v2:172.21.15.189:6833/605900869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c1925e2440 con 0x55c1926af710 2024-04-25T02:08:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.796+0000 7fb8437fe640 10 client.5313 handle_command_reply: tid=0 2024-04-25T02:08:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.796+0000 7fb86db70740 1 client.5313 shutdown 2024-04-25T02:08:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.796+0000 7fb86db70740 1 -- 172.21.15.79:0/1438174242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 msgr2=0x55c192671110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.796+0000 7fb86db70740 1 --2- 172.21.15.79:0/1438174242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c192671110 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb858001d60 tx=0x7fb85800e530 comp rx=0 tx=0).stop 2024-04-25T02:08:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.796+0000 7fb86db70740 1 -- 172.21.15.79:0/1438174242 shutdown_connections 2024-04-25T02:08:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.796+0000 7fb86db70740 1 --2- 172.21.15.79:0/1438174242 >> [v2:172.21.15.189:6833/605900869,v1:172.21.15.189:6835/605900869] conn(0x55c1926af710 0x55c19269d7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.796+0000 7fb86db70740 1 --2- 172.21.15.79:0/1438174242 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c1926adcc0 0x55c192671650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.796+0000 7fb86db70740 1 --2- 172.21.15.79:0/1438174242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c192671110 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.796+0000 7fb8437fe640 0 client.5313 ms_handle_reset on v2:172.21.15.189:6833/605900869 2024-04-25T02:08:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.796+0000 7fb86db70740 1 --2- 172.21.15.79:0/1438174242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c19269cc80 0x55c192697dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.796+0000 7fb86db70740 1 -- 172.21.15.79:0/1438174242 >> 172.21.15.79:0/1438174242 conn(0x55c19269c540 msgr2=0x55c19266d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:57.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.796+0000 7fb86db70740 1 -- 172.21.15.79:0/1438174242 shutdown_connections 2024-04-25T02:08:57.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.796+0000 7fb86db70740 1 -- 172.21.15.79:0/1438174242 wait complete. 2024-04-25T02:08:57.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.796+0000 7fb86db70740 20 client.5313 trim_cache size 0 max 16384 2024-04-25T02:08:57.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.814+0000 7fb86db70740 1 Processor -- start 2024-04-25T02:08:57.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.814+0000 7fb86db70740 1 -- start start 2024-04-25T02:08:57.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb86db70740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c19269cc80 0x55c1926b8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb86db70740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c1926adcc0 0x55c19269f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb86db70740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1926b9b60 0x55c19266b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb86db70740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb8641ff4e0 con 0x55c19269cc80 2024-04-25T02:08:57.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb86db70740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8641fe870 con 0x55c1926b9b60 2024-04-25T02:08:57.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb86db70740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb8641feec0 con 0x55c1926adcc0 2024-04-25T02:08:57.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb868c02640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c19269cc80 0x55c1926b8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb868c02640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c19269cc80 0x55c1926b8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36688/0 (socket says 172.21.15.79:36688) 2024-04-25T02:08:57.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb868c02640 1 -- 172.21.15.79:0/4220612308 learned_addr learned my addr 172.21.15.79:0/4220612308 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:57.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb868c02640 1 -- 172.21.15.79:0/4220612308 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c1926adcc0 msgr2=0x55c19269f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:57.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb868c02640 1 --2- 172.21.15.79:0/4220612308 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c1926adcc0 0x55c19269f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb868c02640 1 -- 172.21.15.79:0/4220612308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1926b9b60 msgr2=0x55c19266b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:57.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb868c02640 1 --2- 172.21.15.79:0/4220612308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1926b9b60 0x55c19266b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb868c02640 1 -- 172.21.15.79:0/4220612308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c192697500 con 0x55c19269cc80 2024-04-25T02:08:57.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb868c02640 1 --2- 172.21.15.79:0/4220612308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c19269cc80 0x55c1926b8f80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb854035040 tx=0x7fb85403b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2a08e6a4b84d96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb849ffb640 1 -- 172.21.15.79:0/4220612308 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85404c040 con 0x55c19269cc80 2024-04-25T02:08:57.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb849ffb640 1 -- 172.21.15.79:0/4220612308 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb85403e960 con 0x55c19269cc80 2024-04-25T02:08:57.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.815+0000 7fb849ffb640 1 -- 172.21.15.79:0/4220612308 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85403ed10 con 0x55c19269cc80 2024-04-25T02:08:57.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.816+0000 7fb86db70740 1 -- 172.21.15.79:0/4220612308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c19269cc80 msgr2=0x55c1926b8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.816+0000 7fb86db70740 1 --2- 172.21.15.79:0/4220612308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c19269cc80 0x55c1926b8f80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb854035040 tx=0x7fb85403b000 comp rx=0 tx=0).stop 2024-04-25T02:08:57.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.816+0000 7fb86db70740 1 -- 172.21.15.79:0/4220612308 shutdown_connections 2024-04-25T02:08:57.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.816+0000 7fb86db70740 1 --2- 172.21.15.79:0/4220612308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1926b9b60 0x55c19266b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.816+0000 7fb86db70740 1 --2- 172.21.15.79:0/4220612308 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c1926adcc0 0x55c19269f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.816+0000 7fb86db70740 1 --2- 172.21.15.79:0/4220612308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c19269cc80 0x55c1926b8f80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.816+0000 7fb86db70740 1 -- 172.21.15.79:0/4220612308 >> 172.21.15.79:0/4220612308 conn(0x55c19269c540 msgr2=0x55c1926b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:57.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.816+0000 7fb86db70740 1 -- 172.21.15.79:0/4220612308 shutdown_connections 2024-04-25T02:08:57.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.816+0000 7fb86db70740 1 -- 172.21.15.79:0/4220612308 wait complete. 2024-04-25T02:08:57.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.816+0000 7fb86db70740 1 -- start start 2024-04-25T02:08:57.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.817+0000 7fb86db70740 1 Processor -- start 2024-04-25T02:08:57.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.817+0000 7fb86db70740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c19269cc80 0x55c19269f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.817+0000 7fb86db70740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1926adcc0 0x55c19269fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.817+0000 7fb86db70740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c1926b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.817+0000 7fb86db70740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c1926af590 con 0x55c1926b9b60 2024-04-25T02:08:57.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.817+0000 7fb86db70740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c19268a260 con 0x55c1926adcc0 2024-04-25T02:08:57.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.817+0000 7fb86db70740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55c1926afbe0 con 0x55c19269cc80 2024-04-25T02:08:57.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.817+0000 7fb86db70740 10 client.0 _ll_register_callbacks cb 0x7fb858001940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:08:57.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb869403640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c1926b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb869403640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c1926b5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36692/0 (socket says 172.21.15.79:36692) 2024-04-25T02:08:57.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb869403640 1 -- 172.21.15.79:0/1100763577 learned_addr learned my addr 172.21.15.79:0/1100763577 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:57.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb863fff640 1 --2- 172.21.15.79:0/1100763577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1926adcc0 0x55c19269fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb868c02640 1 --2- 172.21.15.79:0/1100763577 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c19269cc80 0x55c19269f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb869403640 1 -- 172.21.15.79:0/1100763577 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c19269cc80 msgr2=0x55c19269f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:57.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb869403640 1 --2- 172.21.15.79:0/1100763577 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c19269cc80 0x55c19269f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb869403640 1 -- 172.21.15.79:0/1100763577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1926adcc0 msgr2=0x55c19269fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:57.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb869403640 1 --2- 172.21.15.79:0/1100763577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1926adcc0 0x55c19269fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb869403640 1 -- 172.21.15.79:0/1100763577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c19266dc00 con 0x55c1926b9b60 2024-04-25T02:08:57.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb869403640 1 --2- 172.21.15.79:0/1100763577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c1926b5b30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb85c059760 tx=0x7fb85c05a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9465ef5f10cbb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb8437fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:08:57.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb8437fe640 1 -- 172.21.15.79:0/1100763577 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c062640 con 0x55c1926b9b60 2024-04-25T02:08:57.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb8437fe640 1 -- 172.21.15.79:0/1100763577 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb85c0621b0 con 0x55c1926b9b60 2024-04-25T02:08:57.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb86db70740 1 -- 172.21.15.79:0/1100763577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb85403e960 con 0x55c1926b9b60 2024-04-25T02:08:57.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb8437fe640 1 -- 172.21.15.79:0/1100763577 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7fb85c0623b0 con 0x55c1926b9b60 2024-04-25T02:08:57.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb86db70740 10 client.5319 fetch_fsmap learned FSMap version 12 2024-04-25T02:08:57.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb86db70740 1 -- 172.21.15.79:0/1100763577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x55c1926dad00 con 0x55c1926b9b60 2024-04-25T02:08:57.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.818+0000 7fb8437fe640 1 -- 172.21.15.79:0/1100763577 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb85403e960 con 0x55c1926b9b60 2024-04-25T02:08:57.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.819+0000 7fb8437fe640 1 -- 172.21.15.79:0/1100763577 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 12) ==== 3494+0+0 (secure 0 0 0) 0x7fb85c0600c0 con 0x55c1926b9b60 2024-04-25T02:08:57.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.819+0000 7fb86db70740 10 client.5319 fetch_fsmap finished waiting for FSMap version 12 2024-04-25T02:08:57.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.819+0000 7fb86db70740 10 client.5319 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T02:08:57.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.819+0000 7fb86db70740 20 client.5319 populate_metadata read hostname 'smithi079' 2024-04-25T02:08:57.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.819+0000 7fb86db70740 1 --2- 172.21.15.79:0/1100763577 >> [v2:172.21.15.189:6833/605900869,v1:172.21.15.189:6835/605900869] conn(0x55c1926ac990 0x55c1926acd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.819+0000 7fb86db70740 4 client.5319 mds_command: new command op to 5112 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:08:57.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.819+0000 7fb86db70740 1 -- 172.21.15.79:0/1100763577 --> [v2:172.21.15.189:6833/605900869,v1:172.21.15.189:6835/605900869] -- command(tid 0: {"prefix": "status"}) -- 0x55c1925dc790 con 0x55c1926ac990 2024-04-25T02:08:57.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.819+0000 7fb868c02640 1 --2- 172.21.15.79:0/1100763577 >> [v2:172.21.15.189:6833/605900869,v1:172.21.15.189:6835/605900869] conn(0x55c1926ac990 0x55c1926acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.819+0000 7fb8437fe640 10 client.5319 ms_handle_connect on v2:172.21.15.189:6833/605900869 2024-04-25T02:08:57.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.819+0000 7fb868c02640 1 --2- 172.21.15.79:0/1100763577 >> [v2:172.21.15.189:6833/605900869,v1:172.21.15.189:6835/605900869] conn(0x55c1926ac990 0x55c1926acd70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e55f110bf35cfdf server_cookie=8b1ef2720d04c533 in_seq=0 out_seq=0 2024-04-25T02:08:57.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.819+0000 7fb8437fe640 1 -- 172.21.15.79:0/1100763577 <== mds.0 v2:172.21.15.189:6833/605900869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55c1925dc790 con 0x55c1926ac990 2024-04-25T02:08:57.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.819+0000 7fb8437fe640 10 client.5319 handle_command_reply: tid=0 2024-04-25T02:08:57.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.819+0000 7fb86db70740 1 client.5319 shutdown 2024-04-25T02:08:57.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86db70740 1 -- 172.21.15.79:0/1100763577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 msgr2=0x55c1926b5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86db70740 1 --2- 172.21.15.79:0/1100763577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c1926b5b30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb85c059760 tx=0x7fb85c05a2a0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86db70740 1 -- 172.21.15.79:0/1100763577 shutdown_connections 2024-04-25T02:08:57.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86db70740 1 --2- 172.21.15.79:0/1100763577 >> [v2:172.21.15.189:6833/605900869,v1:172.21.15.189:6835/605900869] conn(0x55c1926ac990 0x55c1926acd70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86db70740 1 --2- 172.21.15.79:0/1100763577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c1926b9b60 0x55c1926b5b30 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86db70740 1 --2- 172.21.15.79:0/1100763577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1926adcc0 0x55c19269fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb8437fe640 0 client.5319 ms_handle_reset on v2:172.21.15.189:6833/605900869 2024-04-25T02:08:57.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86db70740 1 --2- 172.21.15.79:0/1100763577 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c19269cc80 0x55c19269f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86db70740 1 -- 172.21.15.79:0/1100763577 >> 172.21.15.79:0/1100763577 conn(0x55c19269c540 msgr2=0x55c192672160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:57.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86db70740 1 -- 172.21.15.79:0/1100763577 shutdown_connections 2024-04-25T02:08:57.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86db70740 1 -- 172.21.15.79:0/1100763577 wait complete. 2024-04-25T02:08:57.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86db70740 20 client.5319 trim_cache size 0 max 16384 2024-04-25T02:08:57.833 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:08:57.833 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "696648c4-3e52-400b-a780-2e8863c56c42", 2024-04-25T02:08:57.833 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-04-25T02:08:57.833 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5112, 2024-04-25T02:08:57.833 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-04-25T02:08:57.833 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-04-25T02:08:57.834 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-04-25T02:08:57.834 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 8.9483737449999996, 2024-04-25T02:08:57.834 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 12, 2024-04-25T02:08:57.834 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 33, 2024-04-25T02:08:57.834 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 33, 2024-04-25T02:08:57.834 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 16.605696768000001 2024-04-25T02:08:57.834 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:08:57.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86ae66640 1 -- 172.21.15.79:0/772113339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb85006be30 msgr2=0x7fb85006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86ae66640 1 --2- 172.21.15.79:0/772113339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb85006be30 0x7fb85006e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb854034000 tx=0x7fb85402e000 comp rx=0 tx=0).stop 2024-04-25T02:08:57.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86ae66640 1 -- 172.21.15.79:0/772113339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86415e520 msgr2=0x7fb864152fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86ae66640 1 --2- 172.21.15.79:0/772113339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86415e520 0x7fb864152fd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb85c007e70 tx=0x7fb85c00e4b0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86ae66640 1 -- 172.21.15.79:0/772113339 shutdown_connections 2024-04-25T02:08:57.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86ae66640 1 --2- 172.21.15.79:0/772113339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb85006be30 0x7fb85006e2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86ae66640 1 --2- 172.21.15.79:0/772113339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86415e520 0x7fb864152fd0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86ae66640 1 --2- 172.21.15.79:0/772113339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb86415e140 0x7fb8640b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86ae66640 1 --2- 172.21.15.79:0/772113339 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb86406b0b0 0x7fb864146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86ae66640 1 -- 172.21.15.79:0/772113339 >> 172.21.15.79:0/772113339 conn(0x7fb8640ccee0 msgr2=0x7fb8640caa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:57.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86ae66640 1 -- 172.21.15.79:0/772113339 shutdown_connections 2024-04-25T02:08:57.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.820+0000 7fb86ae66640 1 -- 172.21.15.79:0/772113339 wait complete. 2024-04-25T02:08:57.838 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:08:57.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.928+0000 7f1b4569e640 1 Processor -- start 2024-04-25T02:08:57.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.929+0000 7f1b4569e640 1 -- start start 2024-04-25T02:08:57.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.929+0000 7f1b4569e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1b4015e4d0 0x7f1b4006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.929+0000 7f1b4569e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b400b3570 0x7f1b400d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.929+0000 7f1b4569e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b400d1660 con 0x7f1b400b3020 2024-04-25T02:08:57.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.929+0000 7f1b4569e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1b400d1380 con 0x7f1b400b3570 2024-04-25T02:08:57.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.929+0000 7f1b4569e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f1b400cede0 con 0x7f1b4015e4d0 2024-04-25T02:08:57.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.929+0000 7f1b3e7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b400b3570 0x7f1b400d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.929+0000 7f1b3f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1b400b3020 0x7f1b400cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47424/0 (socket says 172.21.15.79:47424) 2024-04-25T02:08:57.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.930+0000 7f1b3f7fe640 1 -- 172.21.15.79:0/3378751990 learned_addr learned my addr 172.21.15.79:0/3378751990 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:08:57.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.930+0000 7f1b3e7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b400b3570 0x7f1b400d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36694/0 (socket says 172.21.15.79:36694) 2024-04-25T02:08:57.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.930+0000 7f1b3effd640 1 --2- 172.21.15.79:0/3378751990 >> v2:172.21.15.189:3300/0 conn(0x7f1b4015e4d0 0x7f1b4006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.930+0000 7f1b3e7fc640 1 -- 172.21.15.79:0/3378751990 >> v2:172.21.15.189:3300/0 conn(0x7f1b4015e4d0 msgr2=0x7f1b4006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:08:57.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.930+0000 7f1b3e7fc640 1 --2- 172.21.15.79:0/3378751990 >> v2:172.21.15.189:3300/0 conn(0x7f1b4015e4d0 0x7f1b4006bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.930+0000 7f1b3e7fc640 1 -- 172.21.15.79:0/3378751990 >> v1:172.21.15.79:6789/0 conn(0x7f1b400b3020 legacy=0x7f1b400cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.930+0000 7f1b3e7fc640 1 -- 172.21.15.79:0/3378751990 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b400cf0c0 con 0x7f1b400b3570 2024-04-25T02:08:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.930+0000 7f1b3e7fc640 1 --2- 172.21.15.79:0/3378751990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b400b3570 0x7f1b400d2710 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1b340097a0 tx=0x7f1b3402a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640fac75f1c9eafe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.931+0000 7f1b3dffb640 1 -- 172.21.15.79:0/3378751990 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34037070 con 0x7f1b400b3570 2024-04-25T02:08:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.931+0000 7f1b3dffb640 1 -- 172.21.15.79:0/3378751990 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3402ad60 con 0x7f1b400b3570 2024-04-25T02:08:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.931+0000 7f1b3dffb640 1 -- 172.21.15.79:0/3378751990 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34032660 con 0x7f1b400b3570 2024-04-25T02:08:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.931+0000 7f1b4569e640 1 -- 172.21.15.79:0/3378751990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b400b3570 msgr2=0x7f1b400d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.931+0000 7f1b4569e640 1 --2- 172.21.15.79:0/3378751990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b400b3570 0x7f1b400d2710 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1b340097a0 tx=0x7f1b3402a0d0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.931+0000 7f1b4569e640 1 -- 172.21.15.79:0/3378751990 shutdown_connections 2024-04-25T02:08:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.931+0000 7f1b4569e640 1 --2- 172.21.15.79:0/3378751990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b400b3570 0x7f1b400d2710 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.931+0000 7f1b4569e640 1 --2- 172.21.15.79:0/3378751990 >> v2:172.21.15.189:3300/0 conn(0x7f1b4015e4d0 0x7f1b4006bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.931+0000 7f1b4569e640 1 -- 172.21.15.79:0/3378751990 >> 172.21.15.79:0/3378751990 conn(0x7f1b4009d460 msgr2=0x7f1b400d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.931+0000 7f1b4569e640 1 -- 172.21.15.79:0/3378751990 shutdown_connections 2024-04-25T02:08:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.931+0000 7f1b4569e640 1 -- 172.21.15.79:0/3378751990 wait complete. 2024-04-25T02:08:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.932+0000 7f1b4569e640 1 Processor -- start 2024-04-25T02:08:57.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.933+0000 7f1b4569e640 1 -- start start 2024-04-25T02:08:57.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.933+0000 7f1b4569e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b400b3020 0x7f1b400b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.933+0000 7f1b4569e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b400b3570 0x7f1b400cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.933+0000 7f1b4569e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b4015e4d0 0x7f1b4014f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.933+0000 7f1b4569e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b400d2250 con 0x7f1b400b3020 2024-04-25T02:08:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.933+0000 7f1b4569e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b400d20d0 con 0x7f1b400b3570 2024-04-25T02:08:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.933+0000 7f1b4569e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4006c1b0 con 0x7f1b4015e4d0 2024-04-25T02:08:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.933+0000 7f1b3effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b400b3020 0x7f1b400b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.933+0000 7f1b3effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b400b3020 0x7f1b400b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36702/0 (socket says 172.21.15.79:36702) 2024-04-25T02:08:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.933+0000 7f1b3effd640 1 -- 172.21.15.79:0/3242376130 learned_addr learned my addr 172.21.15.79:0/3242376130 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:08:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.934+0000 7f1b3effd640 1 -- 172.21.15.79:0/3242376130 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b4015e4d0 msgr2=0x7f1b4014f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.934+0000 7f1b3effd640 1 --2- 172.21.15.79:0/3242376130 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b4015e4d0 0x7f1b4014f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.934+0000 7f1b3effd640 1 -- 172.21.15.79:0/3242376130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b400b3570 msgr2=0x7f1b400cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.934+0000 7f1b3effd640 1 --2- 172.21.15.79:0/3242376130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b400b3570 0x7f1b400cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.934+0000 7f1b3effd640 1 -- 172.21.15.79:0/3242376130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b40159960 con 0x7f1b400b3020 2024-04-25T02:08:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.934+0000 7f1b3effd640 1 --2- 172.21.15.79:0/3242376130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b400b3020 0x7f1b400b5050 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800d620 tx=0x7f1b3800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.934+0000 7f1b277fe640 1 -- 172.21.15.79:0/3242376130 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3800b620 con 0x7f1b400b3020 2024-04-25T02:08:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.934+0000 7f1b277fe640 1 -- 172.21.15.79:0/3242376130 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b38019070 con 0x7f1b400b3020 2024-04-25T02:08:57.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.934+0000 7f1b4569e640 1 -- 172.21.15.79:0/3242376130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b400b5630 con 0x7f1b400b3020 2024-04-25T02:08:57.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.934+0000 7f1b277fe640 1 -- 172.21.15.79:0/3242376130 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3800ba00 con 0x7f1b400b3020 2024-04-25T02:08:57.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.934+0000 7f1b4569e640 1 -- 172.21.15.79:0/3242376130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b400b5bf0 con 0x7f1b400b3020 2024-04-25T02:08:57.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.935+0000 7f1b4569e640 1 -- 172.21.15.79:0/3242376130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b400690a0 con 0x7f1b400b3020 2024-04-25T02:08:57.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.936+0000 7f1b277fe640 1 -- 172.21.15.79:0/3242376130 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b3800bba0 con 0x7f1b400b3020 2024-04-25T02:08:57.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.936+0000 7f1b277fe640 1 --2- 172.21.15.79:0/3242376130 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b2c06be30 0x7f1b2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.936+0000 7f1b277fe640 1 -- 172.21.15.79:0/3242376130 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1b3808b270 con 0x7f1b400b3020 2024-04-25T02:08:57.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.936+0000 7f1b3e7fc640 1 --2- 172.21.15.79:0/3242376130 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b2c06be30 0x7f1b2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.936+0000 7f1b3e7fc640 1 --2- 172.21.15.79:0/3242376130 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b2c06be30 0x7f1b2c06e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1b34034000 tx=0x7f1b3402c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:57.940+0000 7f1b277fe640 1 -- 172.21.15.79:0/3242376130 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1b40159960 con 0x7f1b400b3020 2024-04-25T02:08:58.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58.151+0000 7f1b4569e640 1 -- 172.21.15.79:0/3242376130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1b400c73a0 con 0x7f1b400b3020 2024-04-25T02:08:58.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58.151+0000 7f1b277fe640 1 -- 172.21.15.79:0/3242376130 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) ==== 53+0+73 (secure 0 0 0) 0x7f1b38059c20 con 0x7f1b400b3020 2024-04-25T02:08:58.159 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:08:58.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58.153+0000 7f1b4569e640 1 -- 172.21.15.79:0/3242376130 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b2c06be30 msgr2=0x7f1b2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58.153+0000 7f1b4569e640 1 --2- 172.21.15.79:0/3242376130 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b2c06be30 0x7f1b2c06e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1b34034000 tx=0x7f1b3402c000 comp rx=0 tx=0).stop 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58.153+0000 7f1b4569e640 1 -- 172.21.15.79:0/3242376130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b400b3020 msgr2=0x7f1b400b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58.153+0000 7f1b4569e640 1 --2- 172.21.15.79:0/3242376130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b400b3020 0x7f1b400b5050 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800d620 tx=0x7f1b3800dae0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58.153+0000 7f1b4569e640 1 -- 172.21.15.79:0/3242376130 shutdown_connections 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58.153+0000 7f1b4569e640 1 --2- 172.21.15.79:0/3242376130 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b2c06be30 0x7f1b2c06e2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58.153+0000 7f1b4569e640 1 --2- 172.21.15.79:0/3242376130 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b4015e4d0 0x7f1b4014f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58.153+0000 7f1b4569e640 1 --2- 172.21.15.79:0/3242376130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b400b3570 0x7f1b400cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58.153+0000 7f1b4569e640 1 --2- 172.21.15.79:0/3242376130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b400b3020 0x7f1b400b5050 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58.153+0000 7f1b4569e640 1 -- 172.21.15.79:0/3242376130 >> 172.21.15.79:0/3242376130 conn(0x7f1b4009d460 msgr2=0x7f1b4015ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58.153+0000 7f1b4569e640 1 -- 172.21.15.79:0/3242376130 shutdown_connections 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58.153+0000 7f1b4569e640 1 -- 172.21.15.79:0/3242376130 wait complete. 2024-04-25T02:08:58.171 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:08:58.171 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:08:58.171 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:08:58.171 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:08:58.171 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:08:58.171 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:08:58.171 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:08:58.171 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:08:58.171 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:08:58.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:58.172 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:08:58.187 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:08:58.187 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:08:58.187 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:08:58.187 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:58.187 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:08:58.187 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:58.187 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:08:58.187 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:58.187 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:08:58.187 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42668sec preferred_lft 42668sec 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:08:58.188 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:58.189 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:08:58.189 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:08:58.189 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link 2024-04-25T02:08:58.189 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:58.189 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:08:58.189 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:08:58.189 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::4c:adff:fe56:7194/64 scope link 2024-04-25T02:08:58.189 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:08:58.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:58.189 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:08:58.248 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:08:58.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:58.250 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:08:58.306 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:08:58.307 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:08:58.307 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:08:58.307 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:08:58.307 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:08:58.307 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:08:58.307 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:08:58.307 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:08:58.307 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:08:58.307 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:08:58.307 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:08:58.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:08:58.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:58.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:58.431 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:08:58.446 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:08:58.446 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:08:58.446 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:08:58.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:58.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:08:58.509 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:08:58.509 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:08:58.563 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:08:58.564 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:08:58.564 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:08:58.618 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:08:58.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:58.618 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:08:58.699 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:08:58.699 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:08:58.699 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:08:58.707 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:08:58.707 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:08:58.707 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:08:58.707 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:08:58.707 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:08:58.712 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:08:58.712 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:08:58.712 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:08:58.712 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:08:58.712 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:08:58.713 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:08:58.713 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:08:58.713 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:08:58.713 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:08:58.713 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:08:58.713 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:08:58.713 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:08:58.713 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:08:58.715 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:08:58.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:58.715 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:08:58.779 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:08:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:08:58.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:58.881 INFO:teuthology.orchestra.run.smithi079.stdout:client5331 2024-04-25T02:08:58.881 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:08:58.881 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:08:58.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:58.897 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2024-04-25T02:08:58.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:58.957 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2024-04-25T02:08:59.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:59.014 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2024-04-25T02:08:59.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:59.071 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2024-04-25T02:08:59.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:59.131 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2024-04-25T02:08:59.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:08:59.187 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T02:08:59.246 INFO:teuthology.orchestra.run.smithi079.stdout:./ 2024-04-25T02:08:59.246 INFO:teuthology.orchestra.run.smithi079.stdout:./rfile 2024-04-25T02:08:59.246 INFO:teuthology.orchestra.run.smithi079.stdout:./parentdir 2024-04-25T02:08:59.246 INFO:teuthology.orchestra.run.smithi079.stdout:./parentdir/pfile 2024-04-25T02:08:59.246 INFO:teuthology.orchestra.run.smithi079.stdout:./parentdir/childdir 2024-04-25T02:08:59.246 INFO:teuthology.orchestra.run.smithi079.stdout:./parentdir/childdir/cfile 2024-04-25T02:08:59.247 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:08:59.247 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:08:59.247 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:08:59.247 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:08:59.247 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T02:08:59.247 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:08:59.350 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:08:59.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:59.359 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:08:59.359 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:08:59.359 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:08:59.359 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:08:59.359 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2024-04-25T02:08:59.359 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:08:59.437 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:08:59.440 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:08:59.464 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627778 2024-04-25T02:08:59.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:59.474 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:08:59.474 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:08:59.474 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:08:59.474 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:08:59.474 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2024-04-25T02:08:59.474 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:08:59.602 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627776 2024-04-25T02:08:59.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:59.610 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:08:59.610 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:08:59.611 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:08:59.611 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:08:59.611 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2024-04-25T02:08:59.611 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:08:59.715 INFO:teuthology.orchestra.run.smithi079.stdout:1099511628279 2024-04-25T02:08:59.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:59.724 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:08:59.724 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:08:59.724 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:08:59.724 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:08:59.724 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2024-04-25T02:08:59.724 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:08:59.828 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627777 2024-04-25T02:08:59.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:59.837 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:08:59.837 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:08:59.838 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:08:59.838 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:08:59.838 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2024-04-25T02:08:59.838 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:08:59.942 INFO:teuthology.orchestra.run.smithi079.stdout:1099511628280 2024-04-25T02:08:59.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:08:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:08:59.952 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:08:59.952 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:09:00.007 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:09:00.007 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:09:00.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:00.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.191+0000 7fe82bb9d640 1 Processor -- start 2024-04-25T02:09:00.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.191+0000 7fe82bb9d640 1 -- start start 2024-04-25T02:09:00.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.192+0000 7fe82bb9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe82406df50 0x7fe82406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.192+0000 7fe82bb9d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe8240b2d30 0x7fe8240b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.192+0000 7fe82bb9d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe824071e00 con 0x7fe824143bc0 2024-04-25T02:09:00.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.192+0000 7fe82bb9d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe82406e8f0 con 0x7fe82406df50 2024-04-25T02:09:00.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.192+0000 7fe82bb9d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe824072cb0 con 0x7fe8240b2d30 2024-04-25T02:09:00.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.192+0000 7fe829138640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe82406df50 0x7fe82406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.192+0000 7fe829138640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe82406df50 0x7fe82406e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36716/0 (socket says 172.21.15.79:36716) 2024-04-25T02:09:00.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.192+0000 7fe829138640 1 -- 172.21.15.79:0/4269751664 learned_addr learned my addr 172.21.15.79:0/4269751664 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:00.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.192+0000 7fe82a13a640 1 --2- 172.21.15.79:0/4269751664 >> v2:172.21.15.189:3300/0 conn(0x7fe8240b2d30 0x7fe8240b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.192+0000 7fe829138640 1 -- 172.21.15.79:0/4269751664 >> v2:172.21.15.189:3300/0 conn(0x7fe8240b2d30 msgr2=0x7fe8240b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:00.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.192+0000 7fe829138640 1 --2- 172.21.15.79:0/4269751664 >> v2:172.21.15.189:3300/0 conn(0x7fe8240b2d30 0x7fe8240b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.192+0000 7fe829138640 1 -- 172.21.15.79:0/4269751664 >> v1:172.21.15.189:6789/0 conn(0x7fe824143bc0 legacy=0x7fe82415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.192+0000 7fe829138640 1 -- 172.21.15.79:0/4269751664 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8240720a0 con 0x7fe82406df50 2024-04-25T02:09:00.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.193+0000 7fe829138640 1 --2- 172.21.15.79:0/4269751664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82406df50 0x7fe82406e3b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe824144d00 tx=0x7fe81402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc228872adf7a02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.193+0000 7fe828937640 1 -- 172.21.15.79:0/4269751664 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814037070 con 0x7fe82406df50 2024-04-25T02:09:00.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.193+0000 7fe828937640 1 -- 172.21.15.79:0/4269751664 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe814032440 con 0x7fe82406df50 2024-04-25T02:09:00.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.193+0000 7fe828937640 1 -- 172.21.15.79:0/4269751664 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814032810 con 0x7fe82406df50 2024-04-25T02:09:00.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.193+0000 7fe82bb9d640 1 -- 172.21.15.79:0/4269751664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82406df50 msgr2=0x7fe82406e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.194+0000 7fe82bb9d640 1 --2- 172.21.15.79:0/4269751664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82406df50 0x7fe82406e3b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe824144d00 tx=0x7fe81402a1e0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.194+0000 7fe82bb9d640 1 -- 172.21.15.79:0/4269751664 shutdown_connections 2024-04-25T02:09:00.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.194+0000 7fe82bb9d640 1 --2- 172.21.15.79:0/4269751664 >> v2:172.21.15.189:3300/0 conn(0x7fe8240b2d30 0x7fe8240b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.194+0000 7fe82bb9d640 1 --2- 172.21.15.79:0/4269751664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82406df50 0x7fe82406e3b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.194+0000 7fe82bb9d640 1 -- 172.21.15.79:0/4269751664 >> 172.21.15.79:0/4269751664 conn(0x7fe8240cfc80 msgr2=0x7fe8240d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.194+0000 7fe82bb9d640 1 -- 172.21.15.79:0/4269751664 shutdown_connections 2024-04-25T02:09:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.194+0000 7fe82bb9d640 1 -- 172.21.15.79:0/4269751664 wait complete. 2024-04-25T02:09:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.195+0000 7fe82bb9d640 1 Processor -- start 2024-04-25T02:09:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.195+0000 7fe82bb9d640 1 -- start start 2024-04-25T02:09:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.195+0000 7fe82bb9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82406df50 0x7fe824141ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.195+0000 7fe82bb9d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8240b2d30 0x7fe8240aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.195+0000 7fe82bb9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe824143bc0 0x7fe8241f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.195+0000 7fe82bb9d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe824072940 con 0x7fe82406df50 2024-04-25T02:09:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.195+0000 7fe82bb9d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe824072660 con 0x7fe824143bc0 2024-04-25T02:09:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.195+0000 7fe82bb9d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe824143fa0 con 0x7fe8240b2d30 2024-04-25T02:09:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe829939640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82406df50 0x7fe824141ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe829939640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82406df50 0x7fe824141ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36724/0 (socket says 172.21.15.79:36724) 2024-04-25T02:09:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe829939640 1 -- 172.21.15.79:0/3130689091 learned_addr learned my addr 172.21.15.79:0/3130689091 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe829138640 1 --2- 172.21.15.79:0/3130689091 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8240b2d30 0x7fe8240aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe82a13a640 1 --2- 172.21.15.79:0/3130689091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe824143bc0 0x7fe8241f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe829939640 1 -- 172.21.15.79:0/3130689091 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8240b2d30 msgr2=0x7fe8240aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe829939640 1 --2- 172.21.15.79:0/3130689091 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8240b2d30 0x7fe8240aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe829939640 1 -- 172.21.15.79:0/3130689091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe824143bc0 msgr2=0x7fe8241f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe829939640 1 --2- 172.21.15.79:0/3130689091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe824143bc0 0x7fe8241f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe829939640 1 -- 172.21.15.79:0/3130689091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8241f52f0 con 0x7fe82406df50 2024-04-25T02:09:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe82a13a640 1 --2- 172.21.15.79:0/3130689091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe824143bc0 0x7fe8241f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe829939640 1 --2- 172.21.15.79:0/3130689091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82406df50 0x7fe824141ca0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe82000c430 tx=0x7fe82000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe81a7fc640 1 -- 172.21.15.79:0/3130689091 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8200052d0 con 0x7fe82406df50 2024-04-25T02:09:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe81a7fc640 1 -- 172.21.15.79:0/3130689091 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe820005490 con 0x7fe82406df50 2024-04-25T02:09:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe82bb9d640 1 -- 172.21.15.79:0/3130689091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe824140100 con 0x7fe82406df50 2024-04-25T02:09:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe81a7fc640 1 -- 172.21.15.79:0/3130689091 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820007260 con 0x7fe82406df50 2024-04-25T02:09:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.196+0000 7fe82bb9d640 1 -- 172.21.15.79:0/3130689091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8241406c0 con 0x7fe82406df50 2024-04-25T02:09:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.197+0000 7fe82bb9d640 1 -- 172.21.15.79:0/3130689091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe824144400 con 0x7fe82406df50 2024-04-25T02:09:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.198+0000 7fe81a7fc640 1 -- 172.21.15.79:0/3130689091 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe820007400 con 0x7fe82406df50 2024-04-25T02:09:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.198+0000 7fe81a7fc640 1 --2- 172.21.15.79:0/3130689091 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe80806be30 0x7fe80806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.198+0000 7fe81a7fc640 1 -- 172.21.15.79:0/3130689091 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe82008a240 con 0x7fe82406df50 2024-04-25T02:09:00.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.198+0000 7fe829138640 1 --2- 172.21.15.79:0/3130689091 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe80806be30 0x7fe80806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.198+0000 7fe829138640 1 --2- 172.21.15.79:0/3130689091 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe80806be30 0x7fe80806e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe814034000 tx=0x7fe81402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.202+0000 7fe81a7fc640 1 -- 172.21.15.79:0/3130689091 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe824144400 con 0x7fe82406df50 2024-04-25T02:09:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.374+0000 7fe82bb9d640 1 -- 172.21.15.79:0/3130689091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8240690a0 con 0x7fe82406df50 2024-04-25T02:09:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.376+0000 7fe81a7fc640 1 -- 172.21.15.79:0/3130689091 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16681 (secure 0 0 0) 0x7fe820058630 con 0x7fe82406df50 2024-04-25T02:09:00.383 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:00.383 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":33,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:49.884423+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:08:46.063839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T02:08:47.254948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.377+0000 7fe82bb9d640 1 -- 172.21.15.79:0/3130689091 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe80806be30 msgr2=0x7fe80806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.377+0000 7fe82bb9d640 1 --2- 172.21.15.79:0/3130689091 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe80806be30 0x7fe80806e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe814034000 tx=0x7fe81402e000 comp rx=0 tx=0).stop 2024-04-25T02:09:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.377+0000 7fe82bb9d640 1 -- 172.21.15.79:0/3130689091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82406df50 msgr2=0x7fe824141ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.377+0000 7fe82bb9d640 1 --2- 172.21.15.79:0/3130689091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82406df50 0x7fe824141ca0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe82000c430 tx=0x7fe82000c8f0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.378+0000 7fe82bb9d640 1 -- 172.21.15.79:0/3130689091 shutdown_connections 2024-04-25T02:09:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.378+0000 7fe82bb9d640 1 --2- 172.21.15.79:0/3130689091 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe80806be30 0x7fe80806e2f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.378+0000 7fe82bb9d640 1 --2- 172.21.15.79:0/3130689091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe824143bc0 0x7fe8241f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.378+0000 7fe82bb9d640 1 --2- 172.21.15.79:0/3130689091 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8240b2d30 0x7fe8240aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.378+0000 7fe82bb9d640 1 --2- 172.21.15.79:0/3130689091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82406df50 0x7fe824141ca0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.378+0000 7fe82bb9d640 1 -- 172.21.15.79:0/3130689091 >> 172.21.15.79:0/3130689091 conn(0x7fe8240cfc80 msgr2=0x7fe8240cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.378+0000 7fe82bb9d640 1 -- 172.21.15.79:0/3130689091 shutdown_connections 2024-04-25T02:09:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.378+0000 7fe82bb9d640 1 -- 172.21.15.79:0/3130689091 wait complete. 2024-04-25T02:09:00.396 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:08:46.063839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:08:47.254948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:09:00.397 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:09:00.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.489+0000 7fc349729640 1 Processor -- start 2024-04-25T02:09:00.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.489+0000 7fc349729640 1 -- start start 2024-04-25T02:09:00.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.490+0000 7fc349729640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc3440ce060 0x7fc344072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.490+0000 7fc349729640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc34415fb20 0x7fc3440cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.490+0000 7fc349729640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc344072610 con 0x7fc344145af0 2024-04-25T02:09:00.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.490+0000 7fc349729640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc344073220 con 0x7fc3440ce060 2024-04-25T02:09:00.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.490+0000 7fc349729640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc3440728f0 con 0x7fc34415fb20 2024-04-25T02:09:00.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.490+0000 7fc3427fc640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc3440ce060 0x7fc344072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.490+0000 7fc3427fc640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc3440ce060 0x7fc344072030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:45770/0 (socket says 172.21.15.79:45770) 2024-04-25T02:09:00.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.490+0000 7fc342ffd640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fc344145af0 0x7fc3440cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:43056/0 (socket says 172.21.15.79:43056) 2024-04-25T02:09:00.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.490+0000 7fc3427fc640 1 -- 172.21.15.79:0/4183030897 learned_addr learned my addr 172.21.15.79:0/4183030897 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:00.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.490+0000 7fc3437fe640 1 --2- 172.21.15.79:0/4183030897 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc34415fb20 0x7fc3440cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.491+0000 7fc3427fc640 1 -- 172.21.15.79:0/4183030897 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc34415fb20 msgr2=0x7fc3440cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:00.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.491+0000 7fc3427fc640 1 --2- 172.21.15.79:0/4183030897 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc34415fb20 0x7fc3440cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.491+0000 7fc3427fc640 1 -- 172.21.15.79:0/4183030897 >> v1:172.21.15.189:6789/0 conn(0x7fc344145af0 legacy=0x7fc3440cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.491+0000 7fc3427fc640 1 -- 172.21.15.79:0/4183030897 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc344072bd0 con 0x7fc3440ce060 2024-04-25T02:09:00.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.491+0000 7fc341ffb640 1 -- 172.21.15.79:0/4183030897 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4210371188 0 0) 0x7fc344072610 con 0x7fc344145af0 2024-04-25T02:09:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.491+0000 7fc3427fc640 1 --2- 172.21.15.79:0/4183030897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3440ce060 0x7fc344072030 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc338009870 tx=0x7fc33802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f911a4dc069a1b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.492+0000 7fc341ffb640 1 -- 172.21.15.79:0/4183030897 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338037070 con 0x7fc3440ce060 2024-04-25T02:09:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.492+0000 7fc341ffb640 1 -- 172.21.15.79:0/4183030897 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc338032440 con 0x7fc3440ce060 2024-04-25T02:09:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.492+0000 7fc341ffb640 1 -- 172.21.15.79:0/4183030897 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338032810 con 0x7fc3440ce060 2024-04-25T02:09:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.492+0000 7fc349729640 1 -- 172.21.15.79:0/4183030897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3440ce060 msgr2=0x7fc344072030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.492+0000 7fc349729640 1 --2- 172.21.15.79:0/4183030897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3440ce060 0x7fc344072030 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc338009870 tx=0x7fc33802a270 comp rx=0 tx=0).stop 2024-04-25T02:09:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.492+0000 7fc349729640 1 -- 172.21.15.79:0/4183030897 shutdown_connections 2024-04-25T02:09:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.492+0000 7fc349729640 1 --2- 172.21.15.79:0/4183030897 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc34415fb20 0x7fc3440cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.492+0000 7fc349729640 1 --2- 172.21.15.79:0/4183030897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3440ce060 0x7fc344072030 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.492+0000 7fc349729640 1 -- 172.21.15.79:0/4183030897 >> 172.21.15.79:0/4183030897 conn(0x7fc3440d0f40 msgr2=0x7fc3440d1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.492+0000 7fc349729640 1 -- 172.21.15.79:0/4183030897 shutdown_connections 2024-04-25T02:09:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.492+0000 7fc349729640 1 -- 172.21.15.79:0/4183030897 wait complete. 2024-04-25T02:09:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.493+0000 7fc349729640 1 Processor -- start 2024-04-25T02:09:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.493+0000 7fc349729640 1 -- start start 2024-04-25T02:09:00.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc349729640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3440ce060 0x7fc3440b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc349729640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc344145af0 0x7fc3441f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc349729640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc34415fb20 0x7fc344155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc349729640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc3440d1e70 con 0x7fc34415fb20 2024-04-25T02:09:00.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc349729640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc3440d1cf0 con 0x7fc3440ce060 2024-04-25T02:09:00.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc349729640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc3440cffe0 con 0x7fc344145af0 2024-04-25T02:09:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc3437fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc34415fb20 0x7fc344155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc3437fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc34415fb20 0x7fc344155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36728/0 (socket says 172.21.15.79:36728) 2024-04-25T02:09:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc3437fe640 1 -- 172.21.15.79:0/1410988159 learned_addr learned my addr 172.21.15.79:0/1410988159 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc3427fc640 1 --2- 172.21.15.79:0/1410988159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc344145af0 0x7fc3441f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc342ffd640 1 --2- 172.21.15.79:0/1410988159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3440ce060 0x7fc3440b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc3437fe640 1 -- 172.21.15.79:0/1410988159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc344145af0 msgr2=0x7fc3441f33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc3437fe640 1 --2- 172.21.15.79:0/1410988159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc344145af0 0x7fc3441f33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc3437fe640 1 -- 172.21.15.79:0/1410988159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3440ce060 msgr2=0x7fc3440b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc3437fe640 1 --2- 172.21.15.79:0/1410988159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3440ce060 0x7fc3440b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.494+0000 7fc3437fe640 1 -- 172.21.15.79:0/1410988159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc344143060 con 0x7fc34415fb20 2024-04-25T02:09:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.495+0000 7fc3437fe640 1 --2- 172.21.15.79:0/1410988159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc34415fb20 0x7fc344155e40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00e7f0 tx=0x7fc33c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.495+0000 7fc32b7fe640 1 -- 172.21.15.79:0/1410988159 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c017070 con 0x7fc34415fb20 2024-04-25T02:09:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.495+0000 7fc32b7fe640 1 -- 172.21.15.79:0/1410988159 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c00ee40 con 0x7fc34415fb20 2024-04-25T02:09:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.495+0000 7fc349729640 1 -- 172.21.15.79:0/1410988159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3441433a0 con 0x7fc34415fb20 2024-04-25T02:09:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.495+0000 7fc32b7fe640 1 -- 172.21.15.79:0/1410988159 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c00cb80 con 0x7fc34415fb20 2024-04-25T02:09:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.495+0000 7fc349729640 1 -- 172.21.15.79:0/1410988159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc344142cc0 con 0x7fc34415fb20 2024-04-25T02:09:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.496+0000 7fc349729640 1 -- 172.21.15.79:0/1410988159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3440688f0 con 0x7fc34415fb20 2024-04-25T02:09:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.496+0000 7fc32b7fe640 1 -- 172.21.15.79:0/1410988159 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc33c01a070 con 0x7fc34415fb20 2024-04-25T02:09:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.496+0000 7fc32b7fe640 1 --2- 172.21.15.79:0/1410988159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc33006be30 0x7fc33006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.497+0000 7fc32b7fe640 1 -- 172.21.15.79:0/1410988159 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc33c08acb0 con 0x7fc34415fb20 2024-04-25T02:09:00.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.497+0000 7fc342ffd640 1 --2- 172.21.15.79:0/1410988159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc33006be30 0x7fc33006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.497+0000 7fc342ffd640 1 --2- 172.21.15.79:0/1410988159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc33006be30 0x7fc33006e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc3340012e0 tx=0x7fc334001700 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.501+0000 7fc32b7fe640 1 -- 172.21.15.79:0/1410988159 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc3440688f0 con 0x7fc34415fb20 2024-04-25T02:09:00.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.673+0000 7fc349729640 1 -- 172.21.15.79:0/1410988159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc3440681e0 con 0x7fc34415fb20 2024-04-25T02:09:00.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.674+0000 7fc32b7fe640 1 -- 172.21.15.79:0/1410988159 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7fc3441433a0 con 0x7fc34415fb20 2024-04-25T02:09:00.681 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:09:00.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.675+0000 7fc349729640 1 -- 172.21.15.79:0/1410988159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc33006be30 msgr2=0x7fc33006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.675+0000 7fc349729640 1 --2- 172.21.15.79:0/1410988159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc33006be30 0x7fc33006e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc3340012e0 tx=0x7fc334001700 comp rx=0 tx=0).stop 2024-04-25T02:09:00.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.675+0000 7fc349729640 1 -- 172.21.15.79:0/1410988159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc34415fb20 msgr2=0x7fc344155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.675+0000 7fc349729640 1 --2- 172.21.15.79:0/1410988159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc34415fb20 0x7fc344155e40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00e7f0 tx=0x7fc33c00ebf0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.675+0000 7fc349729640 1 -- 172.21.15.79:0/1410988159 shutdown_connections 2024-04-25T02:09:00.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.675+0000 7fc349729640 1 --2- 172.21.15.79:0/1410988159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc33006be30 0x7fc33006e2f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.675+0000 7fc349729640 1 --2- 172.21.15.79:0/1410988159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc34415fb20 0x7fc344155e40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.675+0000 7fc349729640 1 --2- 172.21.15.79:0/1410988159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc344145af0 0x7fc3441f33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.675+0000 7fc349729640 1 --2- 172.21.15.79:0/1410988159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3440ce060 0x7fc3440b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.675+0000 7fc349729640 1 -- 172.21.15.79:0/1410988159 >> 172.21.15.79:0/1410988159 conn(0x7fc3440d0f40 msgr2=0x7fc3440b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:00.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.676+0000 7fc349729640 1 -- 172.21.15.79:0/1410988159 shutdown_connections 2024-04-25T02:09:00.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.676+0000 7fc349729640 1 -- 172.21.15.79:0/1410988159 wait complete. 2024-04-25T02:09:00.694 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:09:00.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.785+0000 7f91c5ea7640 1 Processor -- start 2024-04-25T02:09:00.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.785+0000 7f91c5ea7640 1 -- start start 2024-04-25T02:09:00.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.786+0000 7f91c5ea7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91c015a810 0x7f91c00cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.786+0000 7f91c5ea7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c015abf0 con 0x7f91c0071460 2024-04-25T02:09:00.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.786+0000 7f91c5ea7640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c00ce580 con 0x7f91c009dcb0 2024-04-25T02:09:00.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.786+0000 7f91c5ea7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f91c0073050 con 0x7f91c015a810 2024-04-25T02:09:00.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.786+0000 7f91bffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f91c0071460 0x7f91c00b42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47428/0 (socket says 172.21.15.79:47428) 2024-04-25T02:09:00.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.786+0000 7f91bffff640 1 -- 172.21.15.79:0/2148083753 learned_addr learned my addr 172.21.15.79:0/2148083753 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:00.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.786+0000 7f91bf7fe640 1 --2- 172.21.15.79:0/2148083753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91c015a810 0x7f91c00cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.786+0000 7f91be7fc640 1 -- 172.21.15.79:0/2148083753 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 997598161 0 0) 0x7f91c015abf0 con 0x7f91c0071460 2024-04-25T02:09:00.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.786+0000 7f91be7fc640 1 -- 172.21.15.79:0/2148083753 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91a8003520 con 0x7f91c0071460 2024-04-25T02:09:00.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.787+0000 7f91be7fc640 1 -- 172.21.15.79:0/2148083753 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441093323 0 0) 0x7f91c00ce580 con 0x7f91c009dcb0 2024-04-25T02:09:00.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.787+0000 7f91bf7fe640 1 -- 172.21.15.79:0/2148083753 >> v1:172.21.15.189:6789/0 conn(0x7f91c009dcb0 legacy=0x7f91c0070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.787+0000 7f91bf7fe640 1 -- 172.21.15.79:0/2148083753 >> v1:172.21.15.79:6789/0 conn(0x7f91c0071460 legacy=0x7f91c00b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.787+0000 7f91bf7fe640 1 -- 172.21.15.79:0/2148083753 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c00ce860 con 0x7f91c015a810 2024-04-25T02:09:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.787+0000 7f91bf7fe640 1 --2- 172.21.15.79:0/2148083753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91c015a810 0x7f91c00cc820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f91b00097d0 tx=0x7f91b002a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c19a8ed20dc6992 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.788+0000 7f91be7fc640 1 -- 172.21.15.79:0/2148083753 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0037070 con 0x7f91c015a810 2024-04-25T02:09:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.788+0000 7f91be7fc640 1 -- 172.21.15.79:0/2148083753 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b002ab70 con 0x7f91c015a810 2024-04-25T02:09:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.788+0000 7f91be7fc640 1 -- 172.21.15.79:0/2148083753 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b80019f0 con 0x7f91c015a810 2024-04-25T02:09:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.788+0000 7f91c5ea7640 1 -- 172.21.15.79:0/2148083753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91c015a810 msgr2=0x7f91c00cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.788+0000 7f91c5ea7640 1 --2- 172.21.15.79:0/2148083753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91c015a810 0x7f91c00cc820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f91b00097d0 tx=0x7f91b002a0e0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.788+0000 7f91c5ea7640 1 -- 172.21.15.79:0/2148083753 shutdown_connections 2024-04-25T02:09:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.788+0000 7f91c5ea7640 1 --2- 172.21.15.79:0/2148083753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91c015a810 0x7f91c00cc820 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.788+0000 7f91c5ea7640 1 -- 172.21.15.79:0/2148083753 >> 172.21.15.79:0/2148083753 conn(0x7f91c00b1cd0 msgr2=0x7f91c00b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.788+0000 7f91c5ea7640 1 -- 172.21.15.79:0/2148083753 shutdown_connections 2024-04-25T02:09:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.788+0000 7f91c5ea7640 1 -- 172.21.15.79:0/2148083753 wait complete. 2024-04-25T02:09:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.789+0000 7f91c5ea7640 1 Processor -- start 2024-04-25T02:09:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.789+0000 7f91c5ea7640 1 -- start start 2024-04-25T02:09:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.790+0000 7f91c5ea7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91c009dcb0 0x7f91c014da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.790+0000 7f91c5ea7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91c015a810 0x7f91c006e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.790+0000 7f91c5ea7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91c006e7a0 0x7f91c00b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.790+0000 7f91c5ea7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f91c00cc020 con 0x7f91c009dcb0 2024-04-25T02:09:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.790+0000 7f91c5ea7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91c00cbdd0 con 0x7f91c015a810 2024-04-25T02:09:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.790+0000 7f91c5ea7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f91c00cc300 con 0x7f91c006e7a0 2024-04-25T02:09:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.790+0000 7f91bf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91c009dcb0 0x7f91c014da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.790+0000 7f91bf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91c009dcb0 0x7f91c014da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36736/0 (socket says 172.21.15.79:36736) 2024-04-25T02:09:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.790+0000 7f91bf7fe640 1 -- 172.21.15.79:0/1522580226 learned_addr learned my addr 172.21.15.79:0/1522580226 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.791+0000 7f91bf7fe640 1 -- 172.21.15.79:0/1522580226 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91c006e7a0 msgr2=0x7f91c00b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.791+0000 7f91bffff640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91c006e7a0 0x7f91c00b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.791+0000 7f91bf7fe640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91c006e7a0 0x7f91c00b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.791+0000 7f91beffd640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91c015a810 0x7f91c006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.791+0000 7f91bf7fe640 1 -- 172.21.15.79:0/1522580226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91c015a810 msgr2=0x7f91c006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.791+0000 7f91bf7fe640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91c015a810 0x7f91c006e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.791+0000 7f91bf7fe640 1 -- 172.21.15.79:0/1522580226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c01586e0 con 0x7f91c009dcb0 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.791+0000 7f91bffff640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91c006e7a0 0x7f91c00b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.791+0000 7f91beffd640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91c015a810 0x7f91c006e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.791+0000 7f91bf7fe640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91c009dcb0 0x7f91c014da10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f91b002a120 tx=0x7f91b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.791+0000 7f91a7fff640 1 -- 172.21.15.79:0/1522580226 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0042070 con 0x7f91c009dcb0 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.791+0000 7f91a7fff640 1 -- 172.21.15.79:0/1522580226 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b003e460 con 0x7f91c009dcb0 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.791+0000 7f91a7fff640 1 -- 172.21.15.79:0/1522580226 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0037040 con 0x7f91c009dcb0 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.791+0000 7f91c5ea7640 1 -- 172.21.15.79:0/1522580226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c0158980 con 0x7f91c009dcb0 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.791+0000 7f91c5ea7640 1 -- 172.21.15.79:0/1522580226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c0158f40 con 0x7f91c009dcb0 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.792+0000 7f91c5ea7640 1 -- 172.21.15.79:0/1522580226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c00690a0 con 0x7f91c009dcb0 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.792+0000 7f91a7fff640 1 -- 172.21.15.79:0/1522580226 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91b0045070 con 0x7f91c009dcb0 2024-04-25T02:09:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.793+0000 7f91a7fff640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f91ac06be30 0x7f91ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.793+0000 7f91a7fff640 1 -- 172.21.15.79:0/1522580226 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f91b00ab460 con 0x7f91c009dcb0 2024-04-25T02:09:00.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.793+0000 7f91beffd640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f91ac06be30 0x7f91ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.793+0000 7f91beffd640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f91ac06be30 0x7f91ac06e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f91c006c060 tx=0x7f91b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.797+0000 7f91a7fff640 1 -- 172.21.15.79:0/1522580226 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f91b0079d90 con 0x7f91c009dcb0 2024-04-25T02:09:00.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.971+0000 7f91c5ea7640 1 -- 172.21.15.79:0/1522580226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f91c0159320 con 0x7f91c009dcb0 2024-04-25T02:09:00.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.972+0000 7f91a7fff640 1 -- 172.21.15.79:0/1522580226 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7f91b0079690 con 0x7f91c009dcb0 2024-04-25T02:09:00.979 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:09:00.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.974+0000 7f91c5ea7640 1 -- 172.21.15.79:0/1522580226 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f91ac06be30 msgr2=0x7f91ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.974+0000 7f91c5ea7640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f91ac06be30 0x7f91ac06e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f91c006c060 tx=0x7f91b4009040 comp rx=0 tx=0).stop 2024-04-25T02:09:00.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.974+0000 7f91c5ea7640 1 -- 172.21.15.79:0/1522580226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91c009dcb0 msgr2=0x7f91c014da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.974+0000 7f91c5ea7640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91c009dcb0 0x7f91c014da10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f91b002a120 tx=0x7f91b00046c0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.974+0000 7f91c5ea7640 1 -- 172.21.15.79:0/1522580226 shutdown_connections 2024-04-25T02:09:00.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.974+0000 7f91c5ea7640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f91ac06be30 0x7f91ac06e2f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.974+0000 7f91c5ea7640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91c006e7a0 0x7f91c00b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.974+0000 7f91c5ea7640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91c015a810 0x7f91c006e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.974+0000 7f91c5ea7640 1 --2- 172.21.15.79:0/1522580226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91c009dcb0 0x7f91c014da10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.974+0000 7f91c5ea7640 1 -- 172.21.15.79:0/1522580226 >> 172.21.15.79:0/1522580226 conn(0x7f91c00b1cd0 msgr2=0x7f91c00b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.974+0000 7f91c5ea7640 1 -- 172.21.15.79:0/1522580226 shutdown_connections 2024-04-25T02:09:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:00.974+0000 7f91c5ea7640 1 -- 172.21.15.79:0/1522580226 wait complete. 2024-04-25T02:09:00.992 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:09:01.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.084+0000 7f672e389640 1 Processor -- start 2024-04-25T02:09:01.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.084+0000 7f672e389640 1 -- start start 2024-04-25T02:09:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.085+0000 7f672e389640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f672806b2f0 0x7f67280b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.085+0000 7f672e389640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672815ec20 con 0x7f67280cf7a0 2024-04-25T02:09:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.085+0000 7f672e389640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672815ef00 con 0x7f672806e6b0 2024-04-25T02:09:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.085+0000 7f672e389640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f672815f830 con 0x7f672806b2f0 2024-04-25T02:09:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.085+0000 7f6727fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f672806b2f0 0x7f67280b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.085+0000 7f67277fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f67280cf7a0 0x7f672806b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47442/0 (socket says 172.21.15.79:47442) 2024-04-25T02:09:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.085+0000 7f67277fe640 1 -- 172.21.15.79:0/747127547 learned_addr learned my addr 172.21.15.79:0/747127547 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.085+0000 7f6727fff640 1 -- 172.21.15.79:0/747127547 >> v1:172.21.15.189:6789/0 conn(0x7f672806e6b0 legacy=0x7f672815b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.085+0000 7f6727fff640 1 -- 172.21.15.79:0/747127547 >> v1:172.21.15.79:6789/0 conn(0x7f67280cf7a0 legacy=0x7f672806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.085+0000 7f6727fff640 1 -- 172.21.15.79:0/747127547 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672815f1e0 con 0x7f672806b2f0 2024-04-25T02:09:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.085+0000 7f6726ffd640 1 -- 172.21.15.79:0/747127547 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1761778137 0 0) 0x7f672815ec20 con 0x7f67280cf7a0 2024-04-25T02:09:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.086+0000 7f6727fff640 1 --2- 172.21.15.79:0/747127547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f672806b2f0 0x7f67280b4b50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f67180097a0 tx=0x7f671802c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2c099bf9a6edc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.086+0000 7f6726ffd640 1 -- 172.21.15.79:0/747127547 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718039070 con 0x7f672806b2f0 2024-04-25T02:09:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.086+0000 7f6726ffd640 1 -- 172.21.15.79:0/747127547 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6718034640 con 0x7f672806b2f0 2024-04-25T02:09:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.086+0000 7f6726ffd640 1 -- 172.21.15.79:0/747127547 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718034a10 con 0x7f672806b2f0 2024-04-25T02:09:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.087+0000 7f672e389640 1 -- 172.21.15.79:0/747127547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f672806b2f0 msgr2=0x7f67280b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.087+0000 7f672e389640 1 --2- 172.21.15.79:0/747127547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f672806b2f0 0x7f67280b4b50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f67180097a0 tx=0x7f671802c3b0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.087+0000 7f672e389640 1 -- 172.21.15.79:0/747127547 shutdown_connections 2024-04-25T02:09:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.087+0000 7f672e389640 1 --2- 172.21.15.79:0/747127547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f672806b2f0 0x7f67280b4b50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.087+0000 7f672e389640 1 -- 172.21.15.79:0/747127547 >> 172.21.15.79:0/747127547 conn(0x7f67280b1cd0 msgr2=0x7f67280b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.087+0000 7f672e389640 1 -- 172.21.15.79:0/747127547 shutdown_connections 2024-04-25T02:09:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.087+0000 7f672e389640 1 -- 172.21.15.79:0/747127547 wait complete. 2024-04-25T02:09:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.088+0000 7f672e389640 1 Processor -- start 2024-04-25T02:09:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.088+0000 7f672e389640 1 -- start start 2024-04-25T02:09:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672e389640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f672806b2f0 0x7f672815cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672e389640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f672806e6b0 0x7f672815a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672e389640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67280cf7a0 0x7f6728144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672e389640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f672806d160 con 0x7f67280cf7a0 2024-04-25T02:09:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672e389640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f672806cfe0 con 0x7f672806b2f0 2024-04-25T02:09:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672e389640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f672815b9e0 con 0x7f672806e6b0 2024-04-25T02:09:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672c926640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67280cf7a0 0x7f6728144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672c926640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67280cf7a0 0x7f6728144df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36758/0 (socket says 172.21.15.79:36758) 2024-04-25T02:09:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672c926640 1 -- 172.21.15.79:0/2825372531 learned_addr learned my addr 172.21.15.79:0/2825372531 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f6727fff640 1 --2- 172.21.15.79:0/2825372531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f672806b2f0 0x7f672815cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f67277fe640 1 --2- 172.21.15.79:0/2825372531 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f672806e6b0 0x7f672815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672c926640 1 -- 172.21.15.79:0/2825372531 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f672806e6b0 msgr2=0x7f672815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672c926640 1 --2- 172.21.15.79:0/2825372531 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f672806e6b0 0x7f672815a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672c926640 1 -- 172.21.15.79:0/2825372531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f672806b2f0 msgr2=0x7f672815cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672c926640 1 --2- 172.21.15.79:0/2825372531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f672806b2f0 0x7f672815cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672c926640 1 -- 172.21.15.79:0/2825372531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672815d3a0 con 0x7f67280cf7a0 2024-04-25T02:09:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672c926640 1 --2- 172.21.15.79:0/2825372531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67280cf7a0 0x7f6728144df0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f672000c7d0 tx=0x7f672000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f6724ff9640 1 -- 172.21.15.79:0/2825372531 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6720003b70 con 0x7f67280cf7a0 2024-04-25T02:09:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f6724ff9640 1 -- 172.21.15.79:0/2825372531 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6720003d30 con 0x7f67280cf7a0 2024-04-25T02:09:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672e389640 1 -- 172.21.15.79:0/2825372531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f672815d680 con 0x7f67280cf7a0 2024-04-25T02:09:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f6724ff9640 1 -- 172.21.15.79:0/2825372531 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672000aa90 con 0x7f67280cf7a0 2024-04-25T02:09:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.089+0000 7f672e389640 1 -- 172.21.15.79:0/2825372531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f672815dc40 con 0x7f67280cf7a0 2024-04-25T02:09:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.091+0000 7f672e389640 1 -- 172.21.15.79:0/2825372531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67280690a0 con 0x7f67280cf7a0 2024-04-25T02:09:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.091+0000 7f6724ff9640 1 -- 172.21.15.79:0/2825372531 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f672000ac30 con 0x7f67280cf7a0 2024-04-25T02:09:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.091+0000 7f6724ff9640 1 --2- 172.21.15.79:0/2825372531 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f671406be30 0x7f671406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.091+0000 7f6724ff9640 1 -- 172.21.15.79:0/2825372531 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f672008ac70 con 0x7f67280cf7a0 2024-04-25T02:09:01.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.091+0000 7f6727fff640 1 --2- 172.21.15.79:0/2825372531 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f671406be30 0x7f671406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.092+0000 7f6727fff640 1 --2- 172.21.15.79:0/2825372531 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f671406be30 0x7f671406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6718036000 tx=0x7f6718030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.095+0000 7f6724ff9640 1 -- 172.21.15.79:0/2825372531 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6720058fd0 con 0x7f67280cf7a0 2024-04-25T02:09:01.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.272+0000 7f672e389640 1 -- 172.21.15.79:0/2825372531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f67280cc460 con 0x7f67280cf7a0 2024-04-25T02:09:01.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.272+0000 7f6724ff9640 1 -- 172.21.15.79:0/2825372531 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7f672005d2d0 con 0x7f67280cf7a0 2024-04-25T02:09:01.279 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:09:01.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.274+0000 7f672e389640 1 -- 172.21.15.79:0/2825372531 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f671406be30 msgr2=0x7f671406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.274+0000 7f672e389640 1 --2- 172.21.15.79:0/2825372531 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f671406be30 0x7f671406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6718036000 tx=0x7f6718030000 comp rx=0 tx=0).stop 2024-04-25T02:09:01.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.274+0000 7f672e389640 1 -- 172.21.15.79:0/2825372531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67280cf7a0 msgr2=0x7f6728144df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.274+0000 7f672e389640 1 --2- 172.21.15.79:0/2825372531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67280cf7a0 0x7f6728144df0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f672000c7d0 tx=0x7f672000cc90 comp rx=0 tx=0).stop 2024-04-25T02:09:01.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.274+0000 7f672e389640 1 -- 172.21.15.79:0/2825372531 shutdown_connections 2024-04-25T02:09:01.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.274+0000 7f672e389640 1 --2- 172.21.15.79:0/2825372531 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f671406be30 0x7f671406e2f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.274+0000 7f672e389640 1 --2- 172.21.15.79:0/2825372531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67280cf7a0 0x7f6728144df0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.274+0000 7f672e389640 1 --2- 172.21.15.79:0/2825372531 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f672806e6b0 0x7f672815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.274+0000 7f672e389640 1 --2- 172.21.15.79:0/2825372531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f672806b2f0 0x7f672815cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.274+0000 7f672e389640 1 -- 172.21.15.79:0/2825372531 >> 172.21.15.79:0/2825372531 conn(0x7f67280b1cd0 msgr2=0x7f67280b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.275+0000 7f672e389640 1 -- 172.21.15.79:0/2825372531 shutdown_connections 2024-04-25T02:09:01.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.275+0000 7f672e389640 1 -- 172.21.15.79:0/2825372531 wait complete. 2024-04-25T02:09:01.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:09:01.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.383+0000 7f60565dc640 1 Processor -- start 2024-04-25T02:09:01.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.383+0000 7f60565dc640 1 -- start start 2024-04-25T02:09:01.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.384+0000 7f60565dc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60500d2da0 0x7f60500d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.384+0000 7f60565dc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60500d0a60 0x7f60500d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.384+0000 7f60565dc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60500ceed0 con 0x7f6050161b90 2024-04-25T02:09:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.384+0000 7f60565dc640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f60500d1410 con 0x7f60500d2da0 2024-04-25T02:09:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.384+0000 7f60565dc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f60500ceca0 con 0x7f60500d0a60 2024-04-25T02:09:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.384+0000 7f604f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60500d2da0 0x7f60500d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.384+0000 7f604f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60500d2da0 0x7f60500d47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36762/0 (socket says 172.21.15.79:36762) 2024-04-25T02:09:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.384+0000 7f604f7fe640 1 -- 172.21.15.79:0/2412066650 learned_addr learned my addr 172.21.15.79:0/2412066650 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.385+0000 7f6054b79640 1 --2- 172.21.15.79:0/2412066650 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60500d0a60 0x7f60500d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.385+0000 7f604f7fe640 1 -- 172.21.15.79:0/2412066650 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60500d0a60 msgr2=0x7f60500d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.385+0000 7f604f7fe640 1 --2- 172.21.15.79:0/2412066650 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60500d0a60 0x7f60500d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.385+0000 7f604f7fe640 1 -- 172.21.15.79:0/2412066650 >> v1:172.21.15.79:6789/0 conn(0x7f6050161b90 legacy=0x7f60500cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.385+0000 7f604f7fe640 1 -- 172.21.15.79:0/2412066650 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60500cf1b0 con 0x7f60500d2da0 2024-04-25T02:09:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.385+0000 7f604effd640 1 -- 172.21.15.79:0/2412066650 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325743819 0 0) 0x7f60500ceed0 con 0x7f6050161b90 2024-04-25T02:09:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.385+0000 7f604f7fe640 1 --2- 172.21.15.79:0/2412066650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60500d2da0 0x7f60500d47e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6044009870 tx=0x7f604402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71afd48fd6cff3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.385+0000 7f604effd640 1 -- 172.21.15.79:0/2412066650 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044037070 con 0x7f60500d2da0 2024-04-25T02:09:01.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.386+0000 7f604effd640 1 -- 172.21.15.79:0/2412066650 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6044032440 con 0x7f60500d2da0 2024-04-25T02:09:01.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.386+0000 7f604effd640 1 -- 172.21.15.79:0/2412066650 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044032810 con 0x7f60500d2da0 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.386+0000 7f60565dc640 1 -- 172.21.15.79:0/2412066650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60500d2da0 msgr2=0x7f60500d47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.386+0000 7f60565dc640 1 --2- 172.21.15.79:0/2412066650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60500d2da0 0x7f60500d47e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6044009870 tx=0x7f604402a270 comp rx=0 tx=0).stop 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.386+0000 7f60565dc640 1 -- 172.21.15.79:0/2412066650 shutdown_connections 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.386+0000 7f60565dc640 1 --2- 172.21.15.79:0/2412066650 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60500d0a60 0x7f60500d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.386+0000 7f60565dc640 1 --2- 172.21.15.79:0/2412066650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60500d2da0 0x7f60500d47e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.386+0000 7f60565dc640 1 -- 172.21.15.79:0/2412066650 >> 172.21.15.79:0/2412066650 conn(0x7f605009d460 msgr2=0x7f60500d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.386+0000 7f60565dc640 1 -- 172.21.15.79:0/2412066650 shutdown_connections 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.386+0000 7f60565dc640 1 -- 172.21.15.79:0/2412066650 wait complete. 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.387+0000 7f60565dc640 1 Processor -- start 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.387+0000 7f60565dc640 1 -- start start 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.388+0000 7f60565dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60500d0a60 0x7f605015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.388+0000 7f60565dc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60500d2da0 0x7f60500cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.388+0000 7f60565dc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6050161b90 0x7f60500cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.388+0000 7f60565dc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f60500d4d20 con 0x7f60500d0a60 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.388+0000 7f60565dc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f60500d4f80 con 0x7f6050161b90 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.388+0000 7f60565dc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f60500cf770 con 0x7f60500d2da0 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.388+0000 7f604ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60500d0a60 0x7f605015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.388+0000 7f604ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60500d0a60 0x7f605015a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36774/0 (socket says 172.21.15.79:36774) 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.388+0000 7f604ffff640 1 -- 172.21.15.79:0/3641085391 learned_addr learned my addr 172.21.15.79:0/3641085391 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.388+0000 7f6054b79640 1 --2- 172.21.15.79:0/3641085391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6050161b90 0x7f60500cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.388+0000 7f604f7fe640 1 --2- 172.21.15.79:0/3641085391 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60500d2da0 0x7f60500cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.389+0000 7f604ffff640 1 -- 172.21.15.79:0/3641085391 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60500d2da0 msgr2=0x7f60500cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.389+0000 7f604ffff640 1 --2- 172.21.15.79:0/3641085391 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60500d2da0 0x7f60500cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.389+0000 7f604ffff640 1 -- 172.21.15.79:0/3641085391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6050161b90 msgr2=0x7f60500cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.389+0000 7f604ffff640 1 --2- 172.21.15.79:0/3641085391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6050161b90 0x7f60500cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.389+0000 7f604ffff640 1 -- 172.21.15.79:0/3641085391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60500cd650 con 0x7f60500d0a60 2024-04-25T02:09:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.389+0000 7f6054b79640 1 --2- 172.21.15.79:0/3641085391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6050161b90 0x7f60500cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.389+0000 7f604ffff640 1 --2- 172.21.15.79:0/3641085391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60500d0a60 0x7f605015a180 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f604000c410 tx=0x7f604000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.389+0000 7f604cff9640 1 -- 172.21.15.79:0/3641085391 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040017070 con 0x7f60500d0a60 2024-04-25T02:09:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.389+0000 7f604cff9640 1 -- 172.21.15.79:0/3641085391 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60400035f0 con 0x7f60500d0a60 2024-04-25T02:09:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.389+0000 7f60565dc640 1 -- 172.21.15.79:0/3641085391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60500cd930 con 0x7f60500d0a60 2024-04-25T02:09:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.389+0000 7f604cff9640 1 -- 172.21.15.79:0/3641085391 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60400039e0 con 0x7f60500d0a60 2024-04-25T02:09:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.389+0000 7f60565dc640 1 -- 172.21.15.79:0/3641085391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60500cdef0 con 0x7f60500d0a60 2024-04-25T02:09:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.390+0000 7f60565dc640 1 -- 172.21.15.79:0/3641085391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60500690a0 con 0x7f60500d0a60 2024-04-25T02:09:01.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.391+0000 7f604cff9640 1 -- 172.21.15.79:0/3641085391 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f604001a070 con 0x7f60500d0a60 2024-04-25T02:09:01.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.391+0000 7f604cff9640 1 --2- 172.21.15.79:0/3641085391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f603c06be30 0x7f603c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.391+0000 7f604cff9640 1 -- 172.21.15.79:0/3641085391 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f604008a260 con 0x7f60500d0a60 2024-04-25T02:09:01.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.391+0000 7f604f7fe640 1 --2- 172.21.15.79:0/3641085391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f603c06be30 0x7f603c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.391+0000 7f604f7fe640 1 --2- 172.21.15.79:0/3641085391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f603c06be30 0x7f603c06e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6044034000 tx=0x7f604402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.395+0000 7f604cff9640 1 -- 172.21.15.79:0/3641085391 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6040058c10 con 0x7f60500d0a60 2024-04-25T02:09:01.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.579+0000 7f60565dc640 1 -- 172.21.15.79:0/3641085391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f60501611a0 con 0x7f60500d0a60 2024-04-25T02:09:01.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.580+0000 7f604cff9640 1 -- 172.21.15.79:0/3641085391 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7f6040058510 con 0x7f60500d0a60 2024-04-25T02:09:01.587 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-04-25T02:09:01.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.582+0000 7f60565dc640 1 -- 172.21.15.79:0/3641085391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f603c06be30 msgr2=0x7f603c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.582+0000 7f60565dc640 1 --2- 172.21.15.79:0/3641085391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f603c06be30 0x7f603c06e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6044034000 tx=0x7f604402e000 comp rx=0 tx=0).stop 2024-04-25T02:09:01.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.582+0000 7f60565dc640 1 -- 172.21.15.79:0/3641085391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60500d0a60 msgr2=0x7f605015a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.582+0000 7f60565dc640 1 --2- 172.21.15.79:0/3641085391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60500d0a60 0x7f605015a180 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f604000c410 tx=0x7f604000c8d0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.582+0000 7f60565dc640 1 -- 172.21.15.79:0/3641085391 shutdown_connections 2024-04-25T02:09:01.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.582+0000 7f60565dc640 1 --2- 172.21.15.79:0/3641085391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f603c06be30 0x7f603c06e2f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.582+0000 7f60565dc640 1 --2- 172.21.15.79:0/3641085391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6050161b90 0x7f60500cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.582+0000 7f60565dc640 1 --2- 172.21.15.79:0/3641085391 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60500d2da0 0x7f60500cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.582+0000 7f60565dc640 1 --2- 172.21.15.79:0/3641085391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60500d0a60 0x7f605015a180 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.582+0000 7f60565dc640 1 -- 172.21.15.79:0/3641085391 >> 172.21.15.79:0/3641085391 conn(0x7f605009d460 msgr2=0x7f60500b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.582+0000 7f60565dc640 1 -- 172.21.15.79:0/3641085391 shutdown_connections 2024-04-25T02:09:01.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.582+0000 7f60565dc640 1 -- 172.21.15.79:0/3641085391 wait complete. 2024-04-25T02:09:01.600 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:09:01.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:01.600 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:09:01.656 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:09:01.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:01.656 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:09:01.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:01.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.803+0000 7f43b1a29640 1 Processor -- start 2024-04-25T02:09:01.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.803+0000 7f43b1a29640 1 -- start start 2024-04-25T02:09:01.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.804+0000 7f43b1a29640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43ac0ce860 0x7f43ac0d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.804+0000 7f43b1a29640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f43ac0d29a0 0x7f43ac0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.804+0000 7f43b1a29640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43ac0cf180 con 0x7f43ac06f250 2024-04-25T02:09:01.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.804+0000 7f43b1a29640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f43ac0ce340 con 0x7f43ac0d29a0 2024-04-25T02:09:01.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.804+0000 7f43b1a29640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f43ac0d14e0 con 0x7f43ac0ce860 2024-04-25T02:09:01.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.804+0000 7f43aa7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f43ac0d29a0 0x7f43ac0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.804+0000 7f43aa7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f43ac0d29a0 0x7f43ac0cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36780/0 (socket says 172.21.15.79:36780) 2024-04-25T02:09:01.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.804+0000 7f43aa7fc640 1 -- 172.21.15.79:0/1743624682 learned_addr learned my addr 172.21.15.79:0/1743624682 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:01.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.804+0000 7f43aaffd640 1 --2- 172.21.15.79:0/1743624682 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43ac0ce860 0x7f43ac0d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.804+0000 7f43aa7fc640 1 -- 172.21.15.79:0/1743624682 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43ac0ce860 msgr2=0x7f43ac0d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.804+0000 7f43aa7fc640 1 --2- 172.21.15.79:0/1743624682 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43ac0ce860 0x7f43ac0d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.804+0000 7f43aa7fc640 1 -- 172.21.15.79:0/1743624682 >> v1:172.21.15.189:6789/0 conn(0x7f43ac06f250 legacy=0x7f43ac06f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.804+0000 7f43aa7fc640 1 -- 172.21.15.79:0/1743624682 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ac0cc570 con 0x7f43ac0d29a0 2024-04-25T02:09:01.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.805+0000 7f43aa7fc640 1 --2- 172.21.15.79:0/1743624682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac0d29a0 0x7f43ac0cec40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009870 tx=0x7f43a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ac5423aae0cd51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.805+0000 7f43a9ffb640 1 -- 172.21.15.79:0/1743624682 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0037070 con 0x7f43ac0d29a0 2024-04-25T02:09:01.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.805+0000 7f43a9ffb640 1 -- 172.21.15.79:0/1743624682 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a0032440 con 0x7f43ac0d29a0 2024-04-25T02:09:01.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.805+0000 7f43a9ffb640 1 -- 172.21.15.79:0/1743624682 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0032810 con 0x7f43ac0d29a0 2024-04-25T02:09:01.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.806+0000 7f43b1a29640 1 -- 172.21.15.79:0/1743624682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac0d29a0 msgr2=0x7f43ac0cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.806+0000 7f43b1a29640 1 --2- 172.21.15.79:0/1743624682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac0d29a0 0x7f43ac0cec40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009870 tx=0x7f43a002a270 comp rx=0 tx=0).stop 2024-04-25T02:09:01.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.806+0000 7f43b1a29640 1 -- 172.21.15.79:0/1743624682 shutdown_connections 2024-04-25T02:09:01.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.806+0000 7f43b1a29640 1 --2- 172.21.15.79:0/1743624682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac0d29a0 0x7f43ac0cec40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.806+0000 7f43b1a29640 1 --2- 172.21.15.79:0/1743624682 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43ac0ce860 0x7f43ac0d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.806+0000 7f43b1a29640 1 -- 172.21.15.79:0/1743624682 >> 172.21.15.79:0/1743624682 conn(0x7f43ac0d1e80 msgr2=0x7f43ac0d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.806+0000 7f43b1a29640 1 -- 172.21.15.79:0/1743624682 shutdown_connections 2024-04-25T02:09:01.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.806+0000 7f43b1a29640 1 -- 172.21.15.79:0/1743624682 wait complete. 2024-04-25T02:09:01.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.807+0000 7f43b1a29640 1 Processor -- start 2024-04-25T02:09:01.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.807+0000 7f43b1a29640 1 -- start start 2024-04-25T02:09:01.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43b1a29640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43ac06f250 0x7f43ac15e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43b1a29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac0ce860 0x7f43ac0ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43b1a29640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43ac0d29a0 0x7f43ac0c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43b1a29640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac0cce10 con 0x7f43ac0ce860 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43b1a29640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac0ccb30 con 0x7f43ac0d29a0 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43b1a29640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f43ac06c1c0 con 0x7f43ac06f250 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43aa7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac0ce860 0x7f43ac0ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43aa7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac0ce860 0x7f43ac0ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36782/0 (socket says 172.21.15.79:36782) 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43aa7fc640 1 -- 172.21.15.79:0/2830735229 learned_addr learned my addr 172.21.15.79:0/2830735229 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43aaffd640 1 --2- 172.21.15.79:0/2830735229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43ac06f250 0x7f43ac15e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43ab7fe640 1 --2- 172.21.15.79:0/2830735229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43ac0d29a0 0x7f43ac0c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43aa7fc640 1 -- 172.21.15.79:0/2830735229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43ac06f250 msgr2=0x7f43ac15e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43aa7fc640 1 --2- 172.21.15.79:0/2830735229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43ac06f250 0x7f43ac15e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43aa7fc640 1 -- 172.21.15.79:0/2830735229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43ac0d29a0 msgr2=0x7f43ac0c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43aa7fc640 1 --2- 172.21.15.79:0/2830735229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43ac0d29a0 0x7f43ac0c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43aa7fc640 1 -- 172.21.15.79:0/2830735229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ac1f8070 con 0x7f43ac0ce860 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43aa7fc640 1 --2- 172.21.15.79:0/2830735229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac0ce860 0x7f43ac0ca900 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f43a0000c00 tx=0x7f43a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f4393fff640 1 -- 172.21.15.79:0/2830735229 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0041070 con 0x7f43ac0ce860 2024-04-25T02:09:01.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f4393fff640 1 -- 172.21.15.79:0/2830735229 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a003c870 con 0x7f43ac0ce860 2024-04-25T02:09:01.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43b1a29640 1 -- 172.21.15.79:0/2830735229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ac1f72b0 con 0x7f43ac0ce860 2024-04-25T02:09:01.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f4393fff640 1 -- 172.21.15.79:0/2830735229 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0037040 con 0x7f43ac0ce860 2024-04-25T02:09:01.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.808+0000 7f43b1a29640 1 -- 172.21.15.79:0/2830735229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ac1f7870 con 0x7f43ac0ce860 2024-04-25T02:09:01.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.809+0000 7f43b1a29640 1 -- 172.21.15.79:0/2830735229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43ac0690a0 con 0x7f43ac0ce860 2024-04-25T02:09:01.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.810+0000 7f4393fff640 1 -- 172.21.15.79:0/2830735229 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43a0044070 con 0x7f43ac0ce860 2024-04-25T02:09:01.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.810+0000 7f4393fff640 1 --2- 172.21.15.79:0/2830735229 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f439806be30 0x7f439806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.810+0000 7f43aaffd640 1 --2- 172.21.15.79:0/2830735229 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f439806be30 0x7f439806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.810+0000 7f4393fff640 1 -- 172.21.15.79:0/2830735229 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f43a00abb20 con 0x7f43ac0ce860 2024-04-25T02:09:01.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.811+0000 7f43aaffd640 1 --2- 172.21.15.79:0/2830735229 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f439806be30 0x7f439806e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0c80e0 tx=0x7f439c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:01.815+0000 7f4393fff640 1 -- 172.21.15.79:0/2830735229 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f43a007a030 con 0x7f43ac0ce860 2024-04-25T02:09:02.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.023+0000 7f43b1a29640 1 -- 172.21.15.79:0/2830735229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43ac074df0 con 0x7f43ac0ce860 2024-04-25T02:09:02.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.023+0000 7f4393fff640 1 -- 172.21.15.79:0/2830735229 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+5181 (secure 0 0 0) 0x7f43a007e330 con 0x7f43ac0ce860 2024-04-25T02:09:02.031 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:02.031 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2251520552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2251520552},{"type":"v1","addr":"172.21.15.79:6836","nonce":2251520552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/1462215746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":1462215746},{"type":"v1","addr":"172.21.15.79:6837","nonce":1462215746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/2359417586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2359417586},{"type":"v1","addr":"172.21.15.189:6834","nonce":2359417586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:08:48.219535+0000","modified":"2024-04-25T02:08:50.227642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6835/605900869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":605900869},{"type":"v1","addr":"172.21.15.189:6835","nonce":605900869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5112,"qdb_cluster":[5112]},"id":2}]} 2024-04-25T02:09:02.031 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 12 2024-04-25T02:09:02.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.026+0000 7f43b1a29640 1 -- 172.21.15.79:0/2830735229 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f439806be30 msgr2=0x7f439806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:02.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.026+0000 7f43b1a29640 1 --2- 172.21.15.79:0/2830735229 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f439806be30 0x7f439806e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0c80e0 tx=0x7f439c009190 comp rx=0 tx=0).stop 2024-04-25T02:09:02.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.026+0000 7f43b1a29640 1 -- 172.21.15.79:0/2830735229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac0ce860 msgr2=0x7f43ac0ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:02.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.026+0000 7f43b1a29640 1 --2- 172.21.15.79:0/2830735229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac0ce860 0x7f43ac0ca900 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f43a0000c00 tx=0x7f43a00046c0 comp rx=0 tx=0).stop 2024-04-25T02:09:02.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.026+0000 7f43b1a29640 1 -- 172.21.15.79:0/2830735229 shutdown_connections 2024-04-25T02:09:02.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.026+0000 7f43b1a29640 1 --2- 172.21.15.79:0/2830735229 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f439806be30 0x7f439806e2f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:02.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.026+0000 7f43b1a29640 1 --2- 172.21.15.79:0/2830735229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43ac0d29a0 0x7f43ac0c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:02.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.026+0000 7f43b1a29640 1 --2- 172.21.15.79:0/2830735229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac0ce860 0x7f43ac0ca900 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:02.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.026+0000 7f43b1a29640 1 --2- 172.21.15.79:0/2830735229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43ac06f250 0x7f43ac15e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:02.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.026+0000 7f43b1a29640 1 -- 172.21.15.79:0/2830735229 >> 172.21.15.79:0/2830735229 conn(0x7f43ac0d1e80 msgr2=0x7f43ac0d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:02.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.026+0000 7f43b1a29640 1 -- 172.21.15.79:0/2830735229 shutdown_connections 2024-04-25T02:09:02.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.026+0000 7f43b1a29640 1 -- 172.21.15.79:0/2830735229 wait complete. 2024-04-25T02:09:02.044 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-04-25T02:09:02.172 INFO:teuthology.orchestra.run.smithi189.stdout:{"message":"","return_code":0} 2024-04-25T02:09:02.172 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T02:09:02.172 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:02.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.262+0000 7f47fce72640 1 Processor -- start 2024-04-25T02:09:02.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.262+0000 7f47fce72640 1 -- start start 2024-04-25T02:09:02.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.262+0000 7f47fce72640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f47f815e4d0 0x7f47f806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:02.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.262+0000 7f47fce72640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f80d1660 con 0x7f47f80d2e20 2024-04-25T02:09:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.262+0000 7f47fce72640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f80d1380 con 0x7f47f80b3570 2024-04-25T02:09:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.262+0000 7f47fce72640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f47f80cede0 con 0x7f47f815e4d0 2024-04-25T02:09:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f6d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f47f80d2e20 0x7f47f80cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47464/0 (socket says 172.21.15.79:47464) 2024-04-25T02:09:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f6d9d640 1 -- 172.21.15.79:0/774694368 learned_addr learned my addr 172.21.15.79:0/774694368 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f659c640 1 --2- 172.21.15.79:0/774694368 >> v2:172.21.15.189:3300/0 conn(0x7f47f815e4d0 0x7f47f806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f5d9b640 1 -- 172.21.15.79:0/774694368 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409819471 0 0) 0x7f47f80d1660 con 0x7f47f80d2e20 2024-04-25T02:09:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f5d9b640 1 -- 172.21.15.79:0/774694368 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47e4003520 con 0x7f47f80d2e20 2024-04-25T02:09:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f5d9b640 1 -- 172.21.15.79:0/774694368 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1035872130 0 0) 0x7f47e4003520 con 0x7f47f80d2e20 2024-04-25T02:09:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f5d9b640 1 -- 172.21.15.79:0/774694368 >> v2:172.21.15.189:3300/0 conn(0x7f47f815e4d0 msgr2=0x7f47f806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f5d9b640 1 --2- 172.21.15.79:0/774694368 >> v2:172.21.15.189:3300/0 conn(0x7f47f815e4d0 0x7f47f806bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f5d9b640 1 -- 172.21.15.79:0/774694368 >> v1:172.21.15.189:6789/0 conn(0x7f47f80b3570 legacy=0x7f47f80d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f5d9b640 1 -- 172.21.15.79:0/774694368 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f80cf0c0 con 0x7f47f80d2e20 2024-04-25T02:09:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f5d9b640 1 -- 172.21.15.79:0/774694368 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f47f00019f0 con 0x7f47f80d2e20 2024-04-25T02:09:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f659c640 1 --2- 172.21.15.79:0/774694368 >> v2:172.21.15.189:3300/0 conn(0x7f47f815e4d0 0x7f47f806bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f5d9b640 1 -- 172.21.15.79:0/774694368 >> v1:172.21.15.79:6789/0 conn(0x7f47f80d2e20 legacy=0x7f47f80cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f5d9b640 1 --2- 172.21.15.79:0/774694368 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47e40039b0 0x7f47e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f5d9b640 1 --2- 172.21.15.79:0/774694368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47e4004800 0x7f47e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f5d9b640 1 --2- 172.21.15.79:0/774694368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47e40051c0 0x7f47e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f5d9b640 1 -- 172.21.15.79:0/774694368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f47f80cede0 con 0x7f47e4004800 2024-04-25T02:09:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f5d9b640 1 -- 172.21.15.79:0/774694368 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47e400c060 con 0x7f47e40051c0 2024-04-25T02:09:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f5d9b640 1 -- 172.21.15.79:0/774694368 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f47e400c260 con 0x7f47e40039b0 2024-04-25T02:09:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47effff640 1 --2- 172.21.15.79:0/774694368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47e4004800 0x7f47e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f6d9d640 1 --2- 172.21.15.79:0/774694368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47e40051c0 0x7f47e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.263+0000 7f47f659c640 1 --2- 172.21.15.79:0/774694368 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47e40039b0 0x7f47e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.264+0000 7f47effff640 1 -- 172.21.15.79:0/774694368 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47e40039b0 msgr2=0x7f47e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.264+0000 7f47effff640 1 --2- 172.21.15.79:0/774694368 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47e40039b0 0x7f47e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.264+0000 7f47effff640 1 -- 172.21.15.79:0/774694368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47e40051c0 msgr2=0x7f47e400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.264+0000 7f47effff640 1 --2- 172.21.15.79:0/774694368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47e40051c0 0x7f47e400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.264+0000 7f47f6d9d640 1 -- 172.21.15.79:0/774694368 reap_dead start 2024-04-25T02:09:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.264+0000 7f47effff640 1 -- 172.21.15.79:0/774694368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e4003520 con 0x7f47e4004800 2024-04-25T02:09:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.264+0000 7f47effff640 1 --2- 172.21.15.79:0/774694368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47e4004800 0x7f47e4004c80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f47e0001750 tx=0x7f47e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4d40ec348e3c09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.264+0000 7f47f5d9b640 1 -- 172.21.15.79:0/774694368 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0001370 con 0x7f47e4004800 2024-04-25T02:09:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.264+0000 7f47f5d9b640 1 -- 172.21.15.79:0/774694368 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e00052d0 con 0x7f47e4004800 2024-04-25T02:09:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.264+0000 7f47f5d9b640 1 -- 172.21.15.79:0/774694368 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e002abc0 con 0x7f47e4004800 2024-04-25T02:09:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.265+0000 7f47fce72640 1 -- 172.21.15.79:0/774694368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47e4004800 msgr2=0x7f47e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.265+0000 7f47fce72640 1 --2- 172.21.15.79:0/774694368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47e4004800 0x7f47e4004c80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f47e0001750 tx=0x7f47e4005830 comp rx=0 tx=0).stop 2024-04-25T02:09:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.265+0000 7f47fce72640 1 -- 172.21.15.79:0/774694368 shutdown_connections 2024-04-25T02:09:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.265+0000 7f47fce72640 1 --2- 172.21.15.79:0/774694368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47e4004800 0x7f47e4004c80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.265+0000 7f47fce72640 1 -- 172.21.15.79:0/774694368 >> 172.21.15.79:0/774694368 conn(0x7f47f809d460 msgr2=0x7f47f80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.265+0000 7f47fce72640 1 -- 172.21.15.79:0/774694368 shutdown_connections 2024-04-25T02:09:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.265+0000 7f47fce72640 1 -- 172.21.15.79:0/774694368 wait complete. 2024-04-25T02:09:02.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.266+0000 7f47fce72640 1 Processor -- start 2024-04-25T02:09:02.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.266+0000 7f47fce72640 1 -- start start 2024-04-25T02:09:02.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47fce72640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47e4004800 0x7f47f81f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:02.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47fce72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47f81f7fb0 0x7f47f8154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:02.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47fce72640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f81607b0 0x7f47f81521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:02.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47fce72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f47f80d2250 con 0x7f47f81f7fb0 2024-04-25T02:09:02.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47fce72640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47f80d20d0 con 0x7f47e4004800 2024-04-25T02:09:02.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47fce72640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f47f80b3020 con 0x7f47f81607b0 2024-04-25T02:09:02.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47f81f7fb0 0x7f47f8154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:02.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47f659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47e4004800 0x7f47f81f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:02.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47f659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47e4004800 0x7f47f81f5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:45856/0 (socket says 172.21.15.79:45856) 2024-04-25T02:09:02.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47f659c640 1 -- 172.21.15.79:0/4202288629 learned_addr learned my addr 172.21.15.79:0/4202288629 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:02.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47f81f7fb0 0x7f47f8154860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36810/0 (socket says 172.21.15.79:36810) 2024-04-25T02:09:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47f6d9d640 1 --2- 172.21.15.79:0/4202288629 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f81607b0 0x7f47f81521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47effff640 1 -- 172.21.15.79:0/4202288629 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f81607b0 msgr2=0x7f47f81521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47effff640 1 --2- 172.21.15.79:0/4202288629 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f81607b0 0x7f47f81521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47effff640 1 -- 172.21.15.79:0/4202288629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47e4004800 msgr2=0x7f47f81f5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47effff640 1 --2- 172.21.15.79:0/4202288629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47e4004800 0x7f47f81f5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.267+0000 7f47effff640 1 -- 172.21.15.79:0/4202288629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f8154da0 con 0x7f47f81f7fb0 2024-04-25T02:09:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.268+0000 7f47effff640 1 --2- 172.21.15.79:0/4202288629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47f81f7fb0 0x7f47f8154860 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f47e0004000 tx=0x7f47e0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.268+0000 7f47eeffd640 1 -- 172.21.15.79:0/4202288629 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e003f030 con 0x7f47f81f7fb0 2024-04-25T02:09:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.268+0000 7f47eeffd640 1 -- 172.21.15.79:0/4202288629 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e002be50 con 0x7f47f81f7fb0 2024-04-25T02:09:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.268+0000 7f47fce72640 1 -- 172.21.15.79:0/4202288629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f81f84c0 con 0x7f47f81f7fb0 2024-04-25T02:09:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.268+0000 7f47eeffd640 1 -- 172.21.15.79:0/4202288629 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0037040 con 0x7f47f81f7fb0 2024-04-25T02:09:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.268+0000 7f47fce72640 1 -- 172.21.15.79:0/4202288629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f81f8a80 con 0x7f47f81f7fb0 2024-04-25T02:09:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.269+0000 7f47fce72640 1 -- 172.21.15.79:0/4202288629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f80ce820 con 0x7f47f81f7fb0 2024-04-25T02:09:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.269+0000 7f47eeffd640 1 -- 172.21.15.79:0/4202288629 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47e0042070 con 0x7f47f81f7fb0 2024-04-25T02:09:02.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.270+0000 7f47eeffd640 1 --2- 172.21.15.79:0/4202288629 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47d806be30 0x7f47d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:02.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.270+0000 7f47eeffd640 1 -- 172.21.15.79:0/4202288629 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f47e00aa240 con 0x7f47f81f7fb0 2024-04-25T02:09:02.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.270+0000 7f47f659c640 1 --2- 172.21.15.79:0/4202288629 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47d806be30 0x7f47d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:02.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.270+0000 7f47f659c640 1 --2- 172.21.15.79:0/4202288629 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47d806be30 0x7f47d806e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009e60 tx=0x7f47e8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:02.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.274+0000 7f47eeffd640 1 -- 172.21.15.79:0/4202288629 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f47f80ce820 con 0x7f47f81f7fb0 2024-04-25T02:09:02.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.482+0000 7f47fce72640 1 -- 172.21.15.79:0/4202288629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47f80690a0 con 0x7f47f81f7fb0 2024-04-25T02:09:02.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.482+0000 7f47eeffd640 1 -- 172.21.15.79:0/4202288629 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+5181 (secure 0 0 0) 0x7f47e0078510 con 0x7f47f81f7fb0 2024-04-25T02:09:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:02.490 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2251520552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2251520552},{"type":"v1","addr":"172.21.15.79:6836","nonce":2251520552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/1462215746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":1462215746},{"type":"v1","addr":"172.21.15.79:6837","nonce":1462215746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/2359417586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2359417586},{"type":"v1","addr":"172.21.15.189:6834","nonce":2359417586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:08:48.219535+0000","modified":"2024-04-25T02:08:50.227642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6835/605900869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":605900869},{"type":"v1","addr":"172.21.15.189:6835","nonce":605900869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5112,"qdb_cluster":[5112]},"id":2}]} 2024-04-25T02:09:02.490 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 12 2024-04-25T02:09:02.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.484+0000 7f47fce72640 1 -- 172.21.15.79:0/4202288629 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47d806be30 msgr2=0x7f47d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:02.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.484+0000 7f47fce72640 1 --2- 172.21.15.79:0/4202288629 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47d806be30 0x7f47d806e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009e60 tx=0x7f47e8009190 comp rx=0 tx=0).stop 2024-04-25T02:09:02.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.484+0000 7f47fce72640 1 -- 172.21.15.79:0/4202288629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47f81f7fb0 msgr2=0x7f47f8154860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:02.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.484+0000 7f47fce72640 1 --2- 172.21.15.79:0/4202288629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47f81f7fb0 0x7f47f8154860 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f47e0004000 tx=0x7f47e0001120 comp rx=0 tx=0).stop 2024-04-25T02:09:02.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.484+0000 7f47fce72640 1 -- 172.21.15.79:0/4202288629 shutdown_connections 2024-04-25T02:09:02.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.484+0000 7f47fce72640 1 --2- 172.21.15.79:0/4202288629 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47d806be30 0x7f47d806e2f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:02.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.484+0000 7f47fce72640 1 --2- 172.21.15.79:0/4202288629 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f81607b0 0x7f47f81521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:02.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.484+0000 7f47fce72640 1 --2- 172.21.15.79:0/4202288629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47f81f7fb0 0x7f47f8154860 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:02.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.484+0000 7f47fce72640 1 --2- 172.21.15.79:0/4202288629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47e4004800 0x7f47f81f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:02.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.484+0000 7f47fce72640 1 -- 172.21.15.79:0/4202288629 >> 172.21.15.79:0/4202288629 conn(0x7f47f809d460 msgr2=0x7f47f806d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:02.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.484+0000 7f47fce72640 1 -- 172.21.15.79:0/4202288629 shutdown_connections 2024-04-25T02:09:02.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:02.484+0000 7f47fce72640 1 -- 172.21.15.79:0/4202288629 wait complete. 2024-04-25T02:09:02.503 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json tag path /parentdir mytag 2024-04-25T02:09:02.619 INFO:teuthology.orchestra.run.smithi189.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2024-04-25T02:09:02.620 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2024-04-25T02:09:12.621 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2024-04-25T02:09:12.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.663+0000 7f7bfdf1bf40 1 Processor -- start 2024-04-25T02:09:12.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.663+0000 7f7bfdf1bf40 1 -- start start 2024-04-25T02:09:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.664+0000 7f7bfdf1bf40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563336ba3070 0x563336b2ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.664+0000 7f7bfdf1bf40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563336bb7f80 0x563336bc00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.664+0000 7f7bfdf1bf40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563336bbe240 0x563336bc0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.664+0000 7f7bfdf1bf40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563336bbef50 con 0x563336ba3070 2024-04-25T02:09:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.664+0000 7f7bfdf1bf40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563336a8d640 con 0x563336bb7f80 2024-04-25T02:09:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.664+0000 7f7bfdf1bf40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x563336ba39c0 con 0x563336bbe240 2024-04-25T02:09:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.664+0000 7f7bfaf41640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563336ba3070 0x563336b2ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.664+0000 7f7bfaf41640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563336ba3070 0x563336b2ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53396/0 (socket says 172.21.15.79:53396) 2024-04-25T02:09:12.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.664+0000 7f7bfaf41640 1 -- 172.21.15.79:0/3066102147 learned_addr learned my addr 172.21.15.79:0/3066102147 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:12.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfaf41640 1 -- 172.21.15.79:0/3066102147 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563336bbe240 msgr2=0x563336bc0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:12.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfb742640 1 --2- 172.21.15.79:0/3066102147 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563336bbe240 0x563336bc0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfa740640 1 --2- 172.21.15.79:0/3066102147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563336bb7f80 0x563336bc00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfaf41640 1 --2- 172.21.15.79:0/3066102147 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563336bbe240 0x563336bc0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfaf41640 1 -- 172.21.15.79:0/3066102147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563336bb7f80 msgr2=0x563336bc00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:12.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfaf41640 1 --2- 172.21.15.79:0/3066102147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563336bb7f80 0x563336bc00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfaf41640 1 -- 172.21.15.79:0/3066102147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563336bc0d60 con 0x563336ba3070 2024-04-25T02:09:12.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfb742640 1 --2- 172.21.15.79:0/3066102147 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563336bbe240 0x563336bc0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:12.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfa740640 1 --2- 172.21.15.79:0/3066102147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563336bb7f80 0x563336bc00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:12.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfaf41640 1 --2- 172.21.15.79:0/3066102147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563336ba3070 0x563336b2ce60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00b420 tx=0x7f7bec00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8912526a7f7aaa6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bf973e640 1 -- 172.21.15.79:0/3066102147 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec012020 con 0x563336ba3070 2024-04-25T02:09:12.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bf973e640 1 -- 172.21.15.79:0/3066102147 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec00d6b0 con 0x563336ba3070 2024-04-25T02:09:12.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bf973e640 1 -- 172.21.15.79:0/3066102147 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00dae0 con 0x563336ba3070 2024-04-25T02:09:12.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfdf1bf40 1 -- 172.21.15.79:0/3066102147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563336ba3070 msgr2=0x563336b2ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfdf1bf40 1 --2- 172.21.15.79:0/3066102147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563336ba3070 0x563336b2ce60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00b420 tx=0x7f7bec00b8e0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfdf1bf40 1 -- 172.21.15.79:0/3066102147 shutdown_connections 2024-04-25T02:09:12.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfdf1bf40 1 --2- 172.21.15.79:0/3066102147 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563336bbe240 0x563336bc0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfdf1bf40 1 --2- 172.21.15.79:0/3066102147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563336bb7f80 0x563336bc00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfdf1bf40 1 --2- 172.21.15.79:0/3066102147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563336ba3070 0x563336b2ce60 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfdf1bf40 1 -- 172.21.15.79:0/3066102147 >> 172.21.15.79:0/3066102147 conn(0x563336b12920 msgr2=0x563336ba2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:12.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.665+0000 7f7bfdf1bf40 1 -- 172.21.15.79:0/3066102147 shutdown_connections 2024-04-25T02:09:12.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.666+0000 7f7bfdf1bf40 1 -- 172.21.15.79:0/3066102147 wait complete. 2024-04-25T02:09:12.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.666+0000 7f7bfdf1bf40 1 Processor -- start 2024-04-25T02:09:12.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.666+0000 7f7bfdf1bf40 1 -- start start 2024-04-25T02:09:12.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfdf1bf40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563336ba3070 0x563336b2f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfdf1bf40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563336bb7f80 0x563336c57190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfdf1bf40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563336bbe240 0x563336bbbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfdf1bf40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563336b11f90 con 0x563336ba3070 2024-04-25T02:09:12.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfdf1bf40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563336bc1000 con 0x563336bb7f80 2024-04-25T02:09:12.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfdf1bf40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x563336ba1a90 con 0x563336bbe240 2024-04-25T02:09:12.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfaf41640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563336ba3070 0x563336b2f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfaf41640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563336ba3070 0x563336b2f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53404/0 (socket says 172.21.15.79:53404) 2024-04-25T02:09:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfaf41640 1 -- 172.21.15.79:0/858998108 learned_addr learned my addr 172.21.15.79:0/858998108 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfb742640 1 --2- 172.21.15.79:0/858998108 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563336bbe240 0x563336bbbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfa740640 1 --2- 172.21.15.79:0/858998108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563336bb7f80 0x563336c57190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfaf41640 1 -- 172.21.15.79:0/858998108 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563336bbe240 msgr2=0x563336bbbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfaf41640 1 --2- 172.21.15.79:0/858998108 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563336bbe240 0x563336bbbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfaf41640 1 -- 172.21.15.79:0/858998108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563336bb7f80 msgr2=0x563336c57190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfaf41640 1 --2- 172.21.15.79:0/858998108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563336bb7f80 0x563336c57190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfaf41640 1 -- 172.21.15.79:0/858998108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563336ba25c0 con 0x563336ba3070 2024-04-25T02:09:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.667+0000 7f7bfa740640 1 --2- 172.21.15.79:0/858998108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563336bb7f80 0x563336c57190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.668+0000 7f7bfaf41640 1 --2- 172.21.15.79:0/858998108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563336ba3070 0x563336b2f140 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x563336bbd8a0 tx=0x7f7bec000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.668+0000 7f7be3fff640 1 -- 172.21.15.79:0/858998108 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec027070 con 0x563336ba3070 2024-04-25T02:09:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.668+0000 7f7be3fff640 1 -- 172.21.15.79:0/858998108 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec00e680 con 0x563336ba3070 2024-04-25T02:09:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.668+0000 7f7bfdf1bf40 1 -- 172.21.15.79:0/858998108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563336b2f840 con 0x563336ba3070 2024-04-25T02:09:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.668+0000 7f7be3fff640 1 -- 172.21.15.79:0/858998108 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00ea70 con 0x563336ba3070 2024-04-25T02:09:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.668+0000 7f7bfdf1bf40 1 -- 172.21.15.79:0/858998108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563336bb8950 con 0x563336ba3070 2024-04-25T02:09:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.669+0000 7f7be3fff640 1 -- 172.21.15.79:0/858998108 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7bec02a070 con 0x563336ba3070 2024-04-25T02:09:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.670+0000 7f7be3fff640 1 --2- 172.21.15.79:0/858998108 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7be806a840 0x7f7be806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.670+0000 7f7be3fff640 1 -- 172.21.15.79:0/858998108 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f7bec08b380 con 0x563336ba3070 2024-04-25T02:09:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.670+0000 7f7bfa740640 1 --2- 172.21.15.79:0/858998108 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7be806a840 0x7f7be806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.670+0000 7f7bfdf1bf40 1 --2- 172.21.15.79:0/858998108 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x563336c55470 0x563336bb9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.670+0000 7f7bfdf1bf40 1 -- 172.21.15.79:0/858998108 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563336bb9690 con 0x563336c55470 2024-04-25T02:09:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.670+0000 7f7bfb742640 1 --2- 172.21.15.79:0/858998108 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x563336c55470 0x563336bb9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.670+0000 7f7bfa740640 1 --2- 172.21.15.79:0/858998108 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7be806a840 0x7f7be806cd00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x563336bbc6e0 tx=0x7f7bf0005a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.671+0000 7f7bfb742640 1 --2- 172.21.15.79:0/858998108 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x563336c55470 0x563336bb9150 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.671+0000 7f7bfb742640 1 -- 172.21.15.79:0/858998108 <== osd.3 v2:172.21.15.79:6817/3072297369 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f7bf4054830 con 0x563336c55470 2024-04-25T02:09:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.671+0000 7f7bfdf1bf40 1 -- 172.21.15.79:0/858998108 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x563336c55470 msgr2=0x563336bb9150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.671+0000 7f7bfdf1bf40 1 --2- 172.21.15.79:0/858998108 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x563336c55470 0x563336bb9150 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.671+0000 7f7bfdf1bf40 1 -- 172.21.15.79:0/858998108 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7be806a840 msgr2=0x7f7be806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.671+0000 7f7bfdf1bf40 1 --2- 172.21.15.79:0/858998108 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7be806a840 0x7f7be806cd00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x563336bbc6e0 tx=0x7f7bf0005a00 comp rx=0 tx=0).stop 2024-04-25T02:09:12.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.671+0000 7f7bfdf1bf40 1 -- 172.21.15.79:0/858998108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563336ba3070 msgr2=0x563336b2f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.671+0000 7f7bfdf1bf40 1 --2- 172.21.15.79:0/858998108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563336ba3070 0x563336b2f140 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x563336bbd8a0 tx=0x7f7bec000ed0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.671+0000 7f7bfb742640 1 -- 172.21.15.79:0/858998108 reap_dead start 2024-04-25T02:09:12.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.671+0000 7f7bfdf1bf40 1 -- 172.21.15.79:0/858998108 shutdown_connections 2024-04-25T02:09:12.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.671+0000 7f7bfdf1bf40 1 -- 172.21.15.79:0/858998108 >> 172.21.15.79:0/858998108 conn(0x563336b12920 msgr2=0x563336b121d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:12.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.671+0000 7f7bfdf1bf40 1 -- 172.21.15.79:0/858998108 shutdown_connections 2024-04-25T02:09:12.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.671+0000 7f7bfdf1bf40 1 -- 172.21.15.79:0/858998108 wait complete. 2024-04-25T02:09:12.691 INFO:teuthology.orchestra.run.smithi079.stdout:mytag 2024-04-25T02:09:12.691 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2024-04-25T02:09:12.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.729+0000 7f5d4b022f40 1 Processor -- start 2024-04-25T02:09:12.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.729+0000 7f5d4b022f40 1 -- start start 2024-04-25T02:09:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.729+0000 7f5d4b022f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee6aea070 0x560ee6ae55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.729+0000 7f5d4b022f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560ee6afef80 0x560ee6b03260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.729+0000 7f5d4b022f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560ee6b05240 0x560ee6b037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.729+0000 7f5d4b022f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560ee6b05f50 con 0x560ee6afef80 2024-04-25T02:09:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.729+0000 7f5d4b022f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560ee69d4640 con 0x560ee6aea070 2024-04-25T02:09:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.729+0000 7f5d4b022f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x560ee6a5ada0 con 0x560ee6b05240 2024-04-25T02:09:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.729+0000 7f5d48322640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560ee6afef80 0x560ee6b03260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.730+0000 7f5d48322640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560ee6afef80 0x560ee6b03260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53434/0 (socket says 172.21.15.79:53434) 2024-04-25T02:09:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.730+0000 7f5d48322640 1 -- 172.21.15.79:0/2693335214 learned_addr learned my addr 172.21.15.79:0/2693335214 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.730+0000 7f5d49324640 1 --2- 172.21.15.79:0/2693335214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560ee6b05240 0x560ee6b037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.730+0000 7f5d48b23640 1 --2- 172.21.15.79:0/2693335214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee6aea070 0x560ee6ae55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.730+0000 7f5d48322640 1 -- 172.21.15.79:0/2693335214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560ee6b05240 msgr2=0x560ee6b037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:12.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.730+0000 7f5d48322640 1 --2- 172.21.15.79:0/2693335214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560ee6b05240 0x560ee6b037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.730+0000 7f5d48322640 1 -- 172.21.15.79:0/2693335214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee6aea070 msgr2=0x560ee6ae55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:12.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.730+0000 7f5d48322640 1 --2- 172.21.15.79:0/2693335214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee6aea070 0x560ee6ae55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.730+0000 7f5d48322640 1 -- 172.21.15.79:0/2693335214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ee6b064f0 con 0x560ee6afef80 2024-04-25T02:09:12.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.730+0000 7f5d48322640 1 --2- 172.21.15.79:0/2693335214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560ee6afef80 0x560ee6b03260 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00b2c0 tx=0x7f5d3c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95db8d65aad476bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.730+0000 7f5d47320640 1 -- 172.21.15.79:0/2693335214 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c008070 con 0x560ee6afef80 2024-04-25T02:09:12.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.730+0000 7f5d47320640 1 -- 172.21.15.79:0/2693335214 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3c00d500 con 0x560ee6afef80 2024-04-25T02:09:12.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.730+0000 7f5d47320640 1 -- 172.21.15.79:0/2693335214 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c00d930 con 0x560ee6afef80 2024-04-25T02:09:12.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.731+0000 7f5d4b022f40 1 -- 172.21.15.79:0/2693335214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560ee6afef80 msgr2=0x560ee6b03260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.731+0000 7f5d4b022f40 1 --2- 172.21.15.79:0/2693335214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560ee6afef80 0x560ee6b03260 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00b2c0 tx=0x7f5d3c00b780 comp rx=0 tx=0).stop 2024-04-25T02:09:12.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.731+0000 7f5d4b022f40 1 -- 172.21.15.79:0/2693335214 shutdown_connections 2024-04-25T02:09:12.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.731+0000 7f5d4b022f40 1 --2- 172.21.15.79:0/2693335214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560ee6b05240 0x560ee6b037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.731+0000 7f5d4b022f40 1 --2- 172.21.15.79:0/2693335214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560ee6afef80 0x560ee6b03260 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.731+0000 7f5d4b022f40 1 --2- 172.21.15.79:0/2693335214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee6aea070 0x560ee6ae55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.731+0000 7f5d4b022f40 1 -- 172.21.15.79:0/2693335214 >> 172.21.15.79:0/2693335214 conn(0x560ee6a59920 msgr2=0x560ee6b02b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.731+0000 7f5d4b022f40 1 -- 172.21.15.79:0/2693335214 shutdown_connections 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.731+0000 7f5d4b022f40 1 -- 172.21.15.79:0/2693335214 wait complete. 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.731+0000 7f5d4b022f40 1 Processor -- start 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.731+0000 7f5d4b022f40 1 -- start start 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d4b022f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560ee6aea070 0x560ee6afdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d4b022f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee6afef80 0x560ee6b00af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d4b022f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560ee6b05240 0x560ee6b9b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d4b022f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560ee6ae8710 con 0x560ee6b05240 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d4b022f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560ee6ae8fb0 con 0x560ee6afef80 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d4b022f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x560ee6ae89f0 con 0x560ee6aea070 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d49324640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560ee6b05240 0x560ee6b9b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d49324640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560ee6b05240 0x560ee6b9b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53436/0 (socket says 172.21.15.79:53436) 2024-04-25T02:09:12.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d49324640 1 -- 172.21.15.79:0/3561221390 learned_addr learned my addr 172.21.15.79:0/3561221390 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:12.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d48b23640 1 --2- 172.21.15.79:0/3561221390 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560ee6aea070 0x560ee6afdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d48322640 1 --2- 172.21.15.79:0/3561221390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee6afef80 0x560ee6b00af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d49324640 1 -- 172.21.15.79:0/3561221390 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560ee6aea070 msgr2=0x560ee6afdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d49324640 1 --2- 172.21.15.79:0/3561221390 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560ee6aea070 0x560ee6afdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d49324640 1 -- 172.21.15.79:0/3561221390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee6afef80 msgr2=0x560ee6b00af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d49324640 1 --2- 172.21.15.79:0/3561221390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee6afef80 0x560ee6b00af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d49324640 1 -- 172.21.15.79:0/3561221390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ee6afe710 con 0x560ee6b05240 2024-04-25T02:09:12.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.732+0000 7f5d48b23640 1 --2- 172.21.15.79:0/3561221390 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560ee6aea070 0x560ee6afdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:12.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.733+0000 7f5d49324640 1 --2- 172.21.15.79:0/3561221390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560ee6b05240 0x560ee6b9b7c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000c210 tx=0x7f5d4000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.733+0000 7f5d4631e640 1 -- 172.21.15.79:0/3561221390 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40017020 con 0x560ee6b05240 2024-04-25T02:09:12.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.733+0000 7f5d4631e640 1 -- 172.21.15.79:0/3561221390 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d4000ce90 con 0x560ee6b05240 2024-04-25T02:09:12.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.733+0000 7f5d4b022f40 1 -- 172.21.15.79:0/3561221390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ee6a73e70 con 0x560ee6b05240 2024-04-25T02:09:12.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.733+0000 7f5d4631e640 1 -- 172.21.15.79:0/3561221390 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d400138b0 con 0x560ee6b05240 2024-04-25T02:09:12.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.733+0000 7f5d4b022f40 1 -- 172.21.15.79:0/3561221390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ee6aff8f0 con 0x560ee6b05240 2024-04-25T02:09:12.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.734+0000 7f5d4631e640 1 -- 172.21.15.79:0/3561221390 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d4001a020 con 0x560ee6b05240 2024-04-25T02:09:12.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.734+0000 7f5d4631e640 1 --2- 172.21.15.79:0/3561221390 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d3406a810 0x7f5d3406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.735+0000 7f5d4631e640 1 -- 172.21.15.79:0/3561221390 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5d40089f50 con 0x560ee6b05240 2024-04-25T02:09:12.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.735+0000 7f5d48b23640 1 --2- 172.21.15.79:0/3561221390 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d3406a810 0x7f5d3406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.735+0000 7f5d4b022f40 1 --2- 172.21.15.79:0/3561221390 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x560ee6a75e10 0x560ee6ae6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.735+0000 7f5d4b022f40 1 -- 172.21.15.79:0/3561221390 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:1 4.7 4:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ee6b9ee10 con 0x560ee6a75e10 2024-04-25T02:09:12.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.735+0000 7f5d48322640 1 --2- 172.21.15.79:0/3561221390 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x560ee6a75e10 0x560ee6ae6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.735+0000 7f5d48b23640 1 --2- 172.21.15.79:0/3561221390 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d3406a810 0x7f5d3406ccd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5d38056000 tx=0x7f5d38050000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.735+0000 7f5d48322640 1 --2- 172.21.15.79:0/3561221390 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x560ee6a75e10 0x560ee6ae6da0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.735+0000 7f5d48322640 1 -- 172.21.15.79:0/3561221390 <== osd.1 v2:172.21.15.79:6816/2311596149 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f5d3c00d870 con 0x560ee6a75e10 2024-04-25T02:09:12.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.736+0000 7f5d4b022f40 1 -- 172.21.15.79:0/3561221390 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x560ee6a75e10 msgr2=0x560ee6ae6da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.736+0000 7f5d4b022f40 1 --2- 172.21.15.79:0/3561221390 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x560ee6a75e10 0x560ee6ae6da0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.736+0000 7f5d4b022f40 1 -- 172.21.15.79:0/3561221390 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d3406a810 msgr2=0x7f5d3406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.736+0000 7f5d4b022f40 1 --2- 172.21.15.79:0/3561221390 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d3406a810 0x7f5d3406ccd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5d38056000 tx=0x7f5d38050000 comp rx=0 tx=0).stop 2024-04-25T02:09:12.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.736+0000 7f5d4b022f40 1 -- 172.21.15.79:0/3561221390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560ee6b05240 msgr2=0x560ee6b9b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.736+0000 7f5d4b022f40 1 --2- 172.21.15.79:0/3561221390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560ee6b05240 0x560ee6b9b7c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000c210 tx=0x7f5d4000ef90 comp rx=0 tx=0).stop 2024-04-25T02:09:12.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.736+0000 7f5d49324640 1 -- 172.21.15.79:0/3561221390 reap_dead start 2024-04-25T02:09:12.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.736+0000 7f5d4b022f40 1 -- 172.21.15.79:0/3561221390 shutdown_connections 2024-04-25T02:09:12.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.736+0000 7f5d4b022f40 1 -- 172.21.15.79:0/3561221390 >> 172.21.15.79:0/3561221390 conn(0x560ee6a59920 msgr2=0x560ee6b04120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:12.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.736+0000 7f5d4b022f40 1 -- 172.21.15.79:0/3561221390 shutdown_connections 2024-04-25T02:09:12.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.736+0000 7f5d4b022f40 1 -- 172.21.15.79:0/3561221390 wait complete. 2024-04-25T02:09:12.749 INFO:teuthology.orchestra.run.smithi079.stdout:mytag 2024-04-25T02:09:12.749 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-04-25T02:09:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.785+0000 7f039ebe6f40 1 Processor -- start 2024-04-25T02:09:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.785+0000 7f039ebe6f40 1 -- start start 2024-04-25T02:09:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039ebe6f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0384002820 0x562899985fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039ebe6f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562899a5b780 0x562899a57ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039ebe6f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562899984150 0x5628999845d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039ebe6f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562899a412d0 con 0x562899984150 2024-04-25T02:09:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039ebe6f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56289992d640 con 0x562899a5b780 2024-04-25T02:09:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039ebe6f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x562899a41570 con 0x7f0384002820 2024-04-25T02:09:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039cee8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562899984150 0x5628999845d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039cee8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562899984150 0x5628999845d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53462/0 (socket says 172.21.15.79:53462) 2024-04-25T02:09:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039cee8640 1 -- 172.21.15.79:0/962528014 learned_addr learned my addr 172.21.15.79:0/962528014 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039cee8640 1 -- 172.21.15.79:0/962528014 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0384002820 msgr2=0x562899985fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039cee8640 1 --2- 172.21.15.79:0/962528014 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0384002820 0x562899985fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039cee8640 1 -- 172.21.15.79:0/962528014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562899a5b780 msgr2=0x562899a57ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039cee8640 1 --2- 172.21.15.79:0/962528014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562899a5b780 0x562899a57ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039cee8640 1 -- 172.21.15.79:0/962528014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562899985d70 con 0x562899984150 2024-04-25T02:09:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039cee8640 1 --2- 172.21.15.79:0/962528014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562899984150 0x5628999845d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f03940025b0 tx=0x7f0394005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c563b5ff14ffa87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.786+0000 7f039aee4640 1 -- 172.21.15.79:0/962528014 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0394017070 con 0x562899984150 2024-04-25T02:09:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.787+0000 7f039aee4640 1 -- 172.21.15.79:0/962528014 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0394013640 con 0x562899984150 2024-04-25T02:09:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.787+0000 7f039aee4640 1 -- 172.21.15.79:0/962528014 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0394013a10 con 0x562899984150 2024-04-25T02:09:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.787+0000 7f039ebe6f40 1 -- 172.21.15.79:0/962528014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562899984150 msgr2=0x5628999845d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.787+0000 7f039ebe6f40 1 --2- 172.21.15.79:0/962528014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562899984150 0x5628999845d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f03940025b0 tx=0x7f0394005d80 comp rx=0 tx=0).stop 2024-04-25T02:09:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.787+0000 7f039ebe6f40 1 -- 172.21.15.79:0/962528014 shutdown_connections 2024-04-25T02:09:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.787+0000 7f039ebe6f40 1 --2- 172.21.15.79:0/962528014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562899984150 0x5628999845d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.787+0000 7f039ebe6f40 1 --2- 172.21.15.79:0/962528014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562899a5b780 0x562899a57ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.787+0000 7f039ebe6f40 1 --2- 172.21.15.79:0/962528014 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0384002820 0x562899985fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.787+0000 7f039ebe6f40 1 -- 172.21.15.79:0/962528014 >> 172.21.15.79:0/962528014 conn(0x5628999b2920 msgr2=0x562899986860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.787+0000 7f039ebe6f40 1 -- 172.21.15.79:0/962528014 shutdown_connections 2024-04-25T02:09:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.787+0000 7f039ebe6f40 1 -- 172.21.15.79:0/962528014 wait complete. 2024-04-25T02:09:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.788+0000 7f039ebe6f40 1 Processor -- start 2024-04-25T02:09:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.788+0000 7f039ebe6f40 1 -- start start 2024-04-25T02:09:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.788+0000 7f039ebe6f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562899984150 0x562899a441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.788+0000 7f039ebe6f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562899a5b780 0x5628999b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.788+0000 7f039ebe6f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0384002820 0x562899a56e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.788+0000 7f039ebe6f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562899a40b50 con 0x7f0384002820 2024-04-25T02:09:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.788+0000 7f039ebe6f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562899984e30 con 0x562899a5b780 2024-04-25T02:09:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.788+0000 7f039ebe6f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5628999b4dd0 con 0x562899984150 2024-04-25T02:09:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.788+0000 7f039cee8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0384002820 0x562899a56e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.788+0000 7f039cee8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0384002820 0x562899a56e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53468/0 (socket says 172.21.15.79:53468) 2024-04-25T02:09:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.788+0000 7f039cee8640 1 -- 172.21.15.79:0/1302628196 learned_addr learned my addr 172.21.15.79:0/1302628196 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.789+0000 7f039c6e7640 1 --2- 172.21.15.79:0/1302628196 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562899984150 0x562899a441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.789+0000 7f039bee6640 1 --2- 172.21.15.79:0/1302628196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562899a5b780 0x5628999b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.789+0000 7f039cee8640 1 -- 172.21.15.79:0/1302628196 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562899984150 msgr2=0x562899a441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.789+0000 7f039cee8640 1 --2- 172.21.15.79:0/1302628196 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562899984150 0x562899a441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.789+0000 7f039cee8640 1 -- 172.21.15.79:0/1302628196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562899a5b780 msgr2=0x5628999b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.789+0000 7f039cee8640 1 --2- 172.21.15.79:0/1302628196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562899a5b780 0x5628999b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.789+0000 7f039cee8640 1 -- 172.21.15.79:0/1302628196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562899986970 con 0x7f0384002820 2024-04-25T02:09:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.789+0000 7f039bee6640 1 --2- 172.21.15.79:0/1302628196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562899a5b780 0x5628999b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.789+0000 7f039cee8640 1 --2- 172.21.15.79:0/1302628196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0384002820 0x562899a56e00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f03940059b0 tx=0x7f0394003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.789+0000 7f0399ee2640 1 -- 172.21.15.79:0/1302628196 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0394017040 con 0x7f0384002820 2024-04-25T02:09:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.789+0000 7f0399ee2640 1 -- 172.21.15.79:0/1302628196 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f039401c990 con 0x7f0384002820 2024-04-25T02:09:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.789+0000 7f0399ee2640 1 -- 172.21.15.79:0/1302628196 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039401cd60 con 0x7f0384002820 2024-04-25T02:09:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.789+0000 7f039ebe6f40 1 -- 172.21.15.79:0/1302628196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628999b5040 con 0x7f0384002820 2024-04-25T02:09:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.789+0000 7f039ebe6f40 1 -- 172.21.15.79:0/1302628196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562899986c50 con 0x7f0384002820 2024-04-25T02:09:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.790+0000 7f0399ee2640 1 -- 172.21.15.79:0/1302628196 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f039401a070 con 0x7f0384002820 2024-04-25T02:09:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.791+0000 7f0399ee2640 1 --2- 172.21.15.79:0/1302628196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f038806a810 0x7f038806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.791+0000 7f0399ee2640 1 -- 172.21.15.79:0/1302628196 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f039408b7e0 con 0x7f0384002820 2024-04-25T02:09:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.791+0000 7f039c6e7640 1 --2- 172.21.15.79:0/1302628196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f038806a810 0x7f038806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.791+0000 7f039ebe6f40 1 --2- 172.21.15.79:0/1302628196 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x562899a3daa0 0x562899a3fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.791+0000 7f039ebe6f40 1 -- 172.21.15.79:0/1302628196 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:1 5.36 5:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628999b0730 con 0x562899a3daa0 2024-04-25T02:09:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.791+0000 7f039bee6640 1 --2- 172.21.15.79:0/1302628196 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x562899a3daa0 0x562899a3fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.791+0000 7f039c6e7640 1 --2- 172.21.15.79:0/1302628196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f038806a810 0x7f038806ccd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f038c001020 tx=0x7f038c001c70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.791+0000 7f039bee6640 1 --2- 172.21.15.79:0/1302628196 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x562899a3daa0 0x562899a3fb80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.792+0000 7f039bee6640 1 -- 172.21.15.79:0/1302628196 <== osd.1 v2:172.21.15.79:6816/2311596149 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f039004f8a0 con 0x562899a3daa0 2024-04-25T02:09:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.792+0000 7f039ebe6f40 1 -- 172.21.15.79:0/1302628196 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x562899a3daa0 msgr2=0x562899a3fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.792+0000 7f039ebe6f40 1 --2- 172.21.15.79:0/1302628196 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x562899a3daa0 0x562899a3fb80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.792+0000 7f039ebe6f40 1 -- 172.21.15.79:0/1302628196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f038806a810 msgr2=0x7f038806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.792+0000 7f039ebe6f40 1 --2- 172.21.15.79:0/1302628196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f038806a810 0x7f038806ccd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f038c001020 tx=0x7f038c001c70 comp rx=0 tx=0).stop 2024-04-25T02:09:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.792+0000 7f039ebe6f40 1 -- 172.21.15.79:0/1302628196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0384002820 msgr2=0x562899a56e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.792+0000 7f039ebe6f40 1 --2- 172.21.15.79:0/1302628196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0384002820 0x562899a56e00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f03940059b0 tx=0x7f0394003330 comp rx=0 tx=0).stop 2024-04-25T02:09:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.792+0000 7f039cee8640 1 -- 172.21.15.79:0/1302628196 reap_dead start 2024-04-25T02:09:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.792+0000 7f039ebe6f40 1 -- 172.21.15.79:0/1302628196 shutdown_connections 2024-04-25T02:09:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.792+0000 7f039ebe6f40 1 -- 172.21.15.79:0/1302628196 >> 172.21.15.79:0/1302628196 conn(0x5628999b2920 msgr2=0x562899984530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.792+0000 7f039ebe6f40 1 -- 172.21.15.79:0/1302628196 shutdown_connections 2024-04-25T02:09:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.792+0000 7f039ebe6f40 1 -- 172.21.15.79:0/1302628196 wait complete. 2024-04-25T02:09:12.810 INFO:teuthology.orchestra.run.smithi079.stdout:mytag 2024-04-25T02:09:12.810 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-04-25T02:09:12.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.884+0000 7f6cb93e0f40 1 Processor -- start 2024-04-25T02:09:12.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.884+0000 7f6cb93e0f40 1 -- start start 2024-04-25T02:09:12.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.885+0000 7f6cb93e0f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b28de113f0 0x55b28de56f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.885+0000 7f6cb93e0f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b28deeb3a0 0x55b28dee01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.885+0000 7f6cb93e0f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b28deeb780 0x55b28dee2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.885+0000 7f6cb93e0f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b28de11d80 con 0x55b28deeb3a0 2024-04-25T02:09:12.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.885+0000 7f6cb93e0f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b28ddba640 con 0x55b28de113f0 2024-04-25T02:09:12.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.885+0000 7f6cb93e0f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55b28deeef80 con 0x55b28deeb780 2024-04-25T02:09:12.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.885+0000 7f6cb66e0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b28deeb3a0 0x55b28dee01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.885+0000 7f6cb66e0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b28deeb3a0 0x55b28dee01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53484/0 (socket says 172.21.15.79:53484) 2024-04-25T02:09:12.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.885+0000 7f6cb66e0640 1 -- 172.21.15.79:0/1926975007 learned_addr learned my addr 172.21.15.79:0/1926975007 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:12.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.885+0000 7f6cb66e0640 1 -- 172.21.15.79:0/1926975007 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b28deeb780 msgr2=0x55b28dee2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:12.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.885+0000 7f6cb66e0640 1 --2- 172.21.15.79:0/1926975007 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b28deeb780 0x55b28dee2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.885+0000 7f6cb66e0640 1 -- 172.21.15.79:0/1926975007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b28de113f0 msgr2=0x55b28de56f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:12.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.885+0000 7f6cb66e0640 1 --2- 172.21.15.79:0/1926975007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b28de113f0 0x55b28de56f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.885+0000 7f6cb66e0640 1 -- 172.21.15.79:0/1926975007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b28dee4ef0 con 0x55b28deeb3a0 2024-04-25T02:09:12.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.886+0000 7f6cb66e0640 1 --2- 172.21.15.79:0/1926975007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b28deeb3a0 0x55b28dee01f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6cac045e50 tx=0x7f6cac04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97be04be1987502 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.886+0000 7f6cb56de640 1 -- 172.21.15.79:0/1926975007 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac062070 con 0x55b28deeb3a0 2024-04-25T02:09:12.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.886+0000 7f6cb56de640 1 -- 172.21.15.79:0/1926975007 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cac0547f0 con 0x55b28deeb3a0 2024-04-25T02:09:12.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.886+0000 7f6cb56de640 1 -- 172.21.15.79:0/1926975007 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac059040 con 0x55b28deeb3a0 2024-04-25T02:09:12.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.886+0000 7f6cb93e0f40 1 -- 172.21.15.79:0/1926975007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b28deeb3a0 msgr2=0x55b28dee01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.886+0000 7f6cb93e0f40 1 --2- 172.21.15.79:0/1926975007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b28deeb3a0 0x55b28dee01f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6cac045e50 tx=0x7f6cac04e000 comp rx=0 tx=0).stop 2024-04-25T02:09:12.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.886+0000 7f6cb93e0f40 1 -- 172.21.15.79:0/1926975007 shutdown_connections 2024-04-25T02:09:12.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.886+0000 7f6cb93e0f40 1 --2- 172.21.15.79:0/1926975007 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b28deeb780 0x55b28dee2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.886+0000 7f6cb93e0f40 1 --2- 172.21.15.79:0/1926975007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b28deeb3a0 0x55b28dee01f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.886+0000 7f6cb93e0f40 1 --2- 172.21.15.79:0/1926975007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b28de113f0 0x55b28de56f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.886+0000 7f6cb93e0f40 1 -- 172.21.15.79:0/1926975007 >> 172.21.15.79:0/1926975007 conn(0x55b28de3d880 msgr2=0x55b28de42260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.886+0000 7f6cb93e0f40 1 -- 172.21.15.79:0/1926975007 shutdown_connections 2024-04-25T02:09:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.886+0000 7f6cb93e0f40 1 -- 172.21.15.79:0/1926975007 wait complete. 2024-04-25T02:09:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.887+0000 7f6cb93e0f40 1 Processor -- start 2024-04-25T02:09:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.887+0000 7f6cb93e0f40 1 -- start start 2024-04-25T02:09:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb93e0f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b28de113f0 0x55b28dedec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb93e0f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b28deeb3a0 0x55b28dee6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb93e0f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b28deeb780 0x55b28dee2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb93e0f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b28de3cf30 con 0x55b28deeb3a0 2024-04-25T02:09:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb93e0f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b28de5d2b0 con 0x55b28deeb780 2024-04-25T02:09:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb93e0f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55b28dee4a60 con 0x55b28de113f0 2024-04-25T02:09:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb66e0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b28deeb3a0 0x55b28dee6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb66e0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b28deeb3a0 0x55b28dee6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53496/0 (socket says 172.21.15.79:53496) 2024-04-25T02:09:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb66e0640 1 -- 172.21.15.79:0/3777843455 learned_addr learned my addr 172.21.15.79:0/3777843455 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb6ee1640 1 --2- 172.21.15.79:0/3777843455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b28de113f0 0x55b28dedec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb76e2640 1 --2- 172.21.15.79:0/3777843455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b28deeb780 0x55b28dee2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb66e0640 1 -- 172.21.15.79:0/3777843455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b28de113f0 msgr2=0x55b28dedec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb66e0640 1 --2- 172.21.15.79:0/3777843455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b28de113f0 0x55b28dedec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb66e0640 1 -- 172.21.15.79:0/3777843455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b28deeb780 msgr2=0x55b28dee2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb66e0640 1 --2- 172.21.15.79:0/3777843455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b28deeb780 0x55b28dee2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb66e0640 1 -- 172.21.15.79:0/3777843455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b28dee6d90 con 0x55b28deeb3a0 2024-04-25T02:09:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb6ee1640 1 --2- 172.21.15.79:0/3777843455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b28de113f0 0x55b28dedec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb66e0640 1 --2- 172.21.15.79:0/3777843455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b28deeb3a0 0x55b28dee6850 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00a4f0 tx=0x7f6cac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6c9ffff640 1 -- 172.21.15.79:0/3777843455 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac059070 con 0x55b28deeb3a0 2024-04-25T02:09:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6c9ffff640 1 -- 172.21.15.79:0/3777843455 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cac05e740 con 0x55b28deeb3a0 2024-04-25T02:09:12.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb93e0f40 1 -- 172.21.15.79:0/3777843455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b28dee0290 con 0x55b28deeb3a0 2024-04-25T02:09:12.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6c9ffff640 1 -- 172.21.15.79:0/3777843455 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac062040 con 0x55b28deeb3a0 2024-04-25T02:09:12.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.888+0000 7f6cb93e0f40 1 -- 172.21.15.79:0/3777843455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b28dee0850 con 0x55b28deeb3a0 2024-04-25T02:09:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.890+0000 7f6c9ffff640 1 -- 172.21.15.79:0/3777843455 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6cac05c070 con 0x55b28deeb3a0 2024-04-25T02:09:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.890+0000 7f6c9ffff640 1 --2- 172.21.15.79:0/3777843455 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ca406a810 0x7f6ca406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.890+0000 7f6c9ffff640 1 -- 172.21.15.79:0/3777843455 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6cac0cdcd0 con 0x55b28deeb3a0 2024-04-25T02:09:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.890+0000 7f6cb6ee1640 1 --2- 172.21.15.79:0/3777843455 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ca406a810 0x7f6ca406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.890+0000 7f6cb93e0f40 1 --2- 172.21.15.79:0/3777843455 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55b28dee2b80 0x55b28de12500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.891+0000 7f6cb93e0f40 1 -- 172.21.15.79:0/3777843455 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:1 5.19 5:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b28dedf720 con 0x55b28dee2b80 2024-04-25T02:09:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.891+0000 7f6cb76e2640 1 --2- 172.21.15.79:0/3777843455 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55b28dee2b80 0x55b28de12500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.891+0000 7f6cb6ee1640 1 --2- 172.21.15.79:0/3777843455 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ca406a810 0x7f6ca406ccd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8002700 tx=0x7f6ca8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.891+0000 7f6cb76e2640 1 --2- 172.21.15.79:0/3777843455 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55b28dee2b80 0x55b28de12500 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.891+0000 7f6cb76e2640 1 -- 172.21.15.79:0/3777843455 <== osd.1 v2:172.21.15.79:6816/2311596149 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f6cb00095c0 con 0x55b28dee2b80 2024-04-25T02:09:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.891+0000 7f6cb93e0f40 1 -- 172.21.15.79:0/3777843455 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55b28dee2b80 msgr2=0x55b28de12500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.891+0000 7f6cb93e0f40 1 --2- 172.21.15.79:0/3777843455 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55b28dee2b80 0x55b28de12500 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.891+0000 7f6cb93e0f40 1 -- 172.21.15.79:0/3777843455 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ca406a810 msgr2=0x7f6ca406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.891+0000 7f6cb93e0f40 1 --2- 172.21.15.79:0/3777843455 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ca406a810 0x7f6ca406ccd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8002700 tx=0x7f6ca8008040 comp rx=0 tx=0).stop 2024-04-25T02:09:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.891+0000 7f6cb93e0f40 1 -- 172.21.15.79:0/3777843455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b28deeb3a0 msgr2=0x55b28dee6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.891+0000 7f6cb93e0f40 1 --2- 172.21.15.79:0/3777843455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b28deeb3a0 0x55b28dee6850 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00a4f0 tx=0x7f6cac002fb0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.891+0000 7f6cb76e2640 1 -- 172.21.15.79:0/3777843455 reap_dead start 2024-04-25T02:09:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.891+0000 7f6cb93e0f40 1 -- 172.21.15.79:0/3777843455 shutdown_connections 2024-04-25T02:09:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.891+0000 7f6cb93e0f40 1 -- 172.21.15.79:0/3777843455 >> 172.21.15.79:0/3777843455 conn(0x55b28de3d880 msgr2=0x55b28de42260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.891+0000 7f6cb93e0f40 1 -- 172.21.15.79:0/3777843455 shutdown_connections 2024-04-25T02:09:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.892+0000 7f6cb93e0f40 1 -- 172.21.15.79:0/3777843455 wait complete. 2024-04-25T02:09:12.904 INFO:teuthology.orchestra.run.smithi079.stdout:mytag 2024-04-25T02:09:12.904 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-25T02:09:12.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.978+0000 7ff0cda7ef40 1 Processor -- start 2024-04-25T02:09:12.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.978+0000 7ff0cda7ef40 1 -- start start 2024-04-25T02:09:12.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.979+0000 7ff0cda7ef40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55849d5d7690 0x55849d6b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.979+0000 7ff0cda7ef40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55849d5d7a70 0x55849d6afab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.979+0000 7ff0cda7ef40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55849d6b5290 0x55849d5d5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.979+0000 7ff0cda7ef40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55849d57e640 con 0x55849d5d7690 2024-04-25T02:09:12.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.979+0000 7ff0cda7ef40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55849d582680 con 0x55849d5d7a70 2024-04-25T02:09:12.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.979+0000 7ff0cda7ef40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55849d621a30 con 0x55849d6b5290 2024-04-25T02:09:12.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.979+0000 7ff0cb57f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55849d5d7690 0x55849d6b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.979+0000 7ff0cb57f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55849d5d7690 0x55849d6b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53512/0 (socket says 172.21.15.79:53512) 2024-04-25T02:09:12.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.979+0000 7ff0cb57f640 1 -- 172.21.15.79:0/3422911670 learned_addr learned my addr 172.21.15.79:0/3422911670 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:12.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.979+0000 7ff0cb57f640 1 -- 172.21.15.79:0/3422911670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55849d6b5290 msgr2=0x55849d5d5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:12.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.979+0000 7ff0cb57f640 1 --2- 172.21.15.79:0/3422911670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55849d6b5290 0x55849d5d5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.979+0000 7ff0cb57f640 1 -- 172.21.15.79:0/3422911670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55849d5d7a70 msgr2=0x55849d6afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.979+0000 7ff0cb57f640 1 --2- 172.21.15.79:0/3422911670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55849d5d7a70 0x55849d6afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.979+0000 7ff0cb57f640 1 -- 172.21.15.79:0/3422911670 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55849d604060 con 0x55849d5d7690 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.979+0000 7ff0cb57f640 1 --2- 172.21.15.79:0/3422911670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55849d5d7690 0x55849d6b4ce0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00a590 tx=0x7ff0bc00aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3678a11379750b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.980+0000 7ff0c9d7c640 1 -- 172.21.15.79:0/3422911670 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc00b980 con 0x55849d5d7690 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.980+0000 7ff0c9d7c640 1 -- 172.21.15.79:0/3422911670 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0bc00f070 con 0x55849d5d7690 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.980+0000 7ff0c9d7c640 1 -- 172.21.15.79:0/3422911670 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc00bd80 con 0x55849d5d7690 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.980+0000 7ff0cda7ef40 1 -- 172.21.15.79:0/3422911670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55849d5d7690 msgr2=0x55849d6b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.980+0000 7ff0cda7ef40 1 --2- 172.21.15.79:0/3422911670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55849d5d7690 0x55849d6b4ce0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00a590 tx=0x7ff0bc00aa50 comp rx=0 tx=0).stop 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.980+0000 7ff0cda7ef40 1 -- 172.21.15.79:0/3422911670 shutdown_connections 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.980+0000 7ff0cda7ef40 1 --2- 172.21.15.79:0/3422911670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55849d6b5290 0x55849d5d5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.980+0000 7ff0cda7ef40 1 --2- 172.21.15.79:0/3422911670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55849d5d7a70 0x55849d6afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.980+0000 7ff0cda7ef40 1 --2- 172.21.15.79:0/3422911670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55849d5d7690 0x55849d6b4ce0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.980+0000 7ff0cda7ef40 1 -- 172.21.15.79:0/3422911670 >> 172.21.15.79:0/3422911670 conn(0x55849d603920 msgr2=0x55849d6907d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.980+0000 7ff0cda7ef40 1 -- 172.21.15.79:0/3422911670 shutdown_connections 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.980+0000 7ff0cda7ef40 1 -- 172.21.15.79:0/3422911670 wait complete. 2024-04-25T02:09:12.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.981+0000 7ff0cda7ef40 1 Processor -- start 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.981+0000 7ff0cda7ef40 1 -- start start 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.981+0000 7ff0cda7ef40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55849d5d7690 0x55849d73bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.981+0000 7ff0cda7ef40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55849d5d7a70 0x55849d61f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.981+0000 7ff0cda7ef40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55849d6b5290 0x55849d73a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.981+0000 7ff0cda7ef40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55849d6adf30 con 0x55849d5d7a70 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.981+0000 7ff0cda7ef40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55849d6af620 con 0x55849d5d7690 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.981+0000 7ff0cda7ef40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55849d6ae1b0 con 0x55849d6b5290 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0cad7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55849d5d7a70 0x55849d61f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0cad7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55849d5d7a70 0x55849d61f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53518/0 (socket says 172.21.15.79:53518) 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0cad7e640 1 -- 172.21.15.79:0/3601361742 learned_addr learned my addr 172.21.15.79:0/3601361742 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0cb57f640 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55849d5d7690 0x55849d73bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0cbd80640 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55849d6b5290 0x55849d73a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0cad7e640 1 -- 172.21.15.79:0/3601361742 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55849d6b5290 msgr2=0x55849d73a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0cad7e640 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55849d6b5290 0x55849d73a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0cad7e640 1 -- 172.21.15.79:0/3601361742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55849d5d7690 msgr2=0x55849d73bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0cad7e640 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55849d5d7690 0x55849d73bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0cad7e640 1 -- 172.21.15.79:0/3601361742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55849d73b470 con 0x55849d5d7a70 2024-04-25T02:09:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0cb57f640 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55849d5d7690 0x55849d73bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0cbd80640 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55849d6b5290 0x55849d73a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0cad7e640 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55849d5d7a70 0x55849d61f040 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000baa0 tx=0x7ff0c000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0c8d7a640 1 -- 172.21.15.79:0/3601361742 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0009e10 con 0x55849d5d7a70 2024-04-25T02:09:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0c8d7a640 1 -- 172.21.15.79:0/3601361742 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c000e470 con 0x55849d5d7a70 2024-04-25T02:09:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0cda7ef40 1 -- 172.21.15.79:0/3601361742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55849d6ac4a0 con 0x55849d5d7a70 2024-04-25T02:09:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0c8d7a640 1 -- 172.21.15.79:0/3601361742 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c000e8a0 con 0x55849d5d7a70 2024-04-25T02:09:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.982+0000 7ff0cda7ef40 1 -- 172.21.15.79:0/3601361742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55849d73b6f0 con 0x55849d5d7a70 2024-04-25T02:09:12.995 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:09:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.983+0000 7ff0c8d7a640 1 -- 172.21.15.79:0/3601361742 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0c000ea40 con 0x55849d5d7a70 2024-04-25T02:09:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.984+0000 7ff0c8d7a640 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff0b806a810 0x7ff0b806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.984+0000 7ff0c8d7a640 1 -- 172.21.15.79:0/3601361742 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff0c0089e30 con 0x55849d5d7a70 2024-04-25T02:09:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.984+0000 7ff0cb57f640 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff0b806a810 0x7ff0b806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.984+0000 7ff0cda7ef40 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55849d6a5c30 0x55849d73add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.984+0000 7ff0cda7ef40 1 -- 172.21.15.79:0/3601361742 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:1 5.12 5:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55849d61f580 con 0x55849d6a5c30 2024-04-25T02:09:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.984+0000 7ff0cbd80640 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55849d6a5c30 0x55849d73add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.984+0000 7ff0cb57f640 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff0b806a810 0x7ff0b806ccd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00a590 tx=0x7ff0bc002000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.985+0000 7ff0cbd80640 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55849d6a5c30 0x55849d73add0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.985+0000 7ff0cbd80640 1 -- 172.21.15.79:0/3601361742 <== osd.1 v2:172.21.15.79:6816/2311596149 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7ff0c4057030 con 0x55849d6a5c30 2024-04-25T02:09:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2024-04-25T02:09:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.985+0000 7ff0cda7ef40 1 -- 172.21.15.79:0/3601361742 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55849d6a5c30 msgr2=0x55849d73add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.985+0000 7ff0cda7ef40 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55849d6a5c30 0x55849d73add0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:12.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.985+0000 7ff0cda7ef40 1 -- 172.21.15.79:0/3601361742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff0b806a810 msgr2=0x7ff0b806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.985+0000 7ff0cda7ef40 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff0b806a810 0x7ff0b806ccd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00a590 tx=0x7ff0bc002000 comp rx=0 tx=0).stop 2024-04-25T02:09:12.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.985+0000 7ff0cda7ef40 1 -- 172.21.15.79:0/3601361742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55849d5d7a70 msgr2=0x55849d61f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:12.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.985+0000 7ff0cda7ef40 1 --2- 172.21.15.79:0/3601361742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55849d5d7a70 0x55849d61f040 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000baa0 tx=0x7ff0c000bf60 comp rx=0 tx=0).stop 2024-04-25T02:09:12.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.985+0000 7ff0cbd80640 1 -- 172.21.15.79:0/3601361742 reap_dead start 2024-04-25T02:09:12.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.985+0000 7ff0cda7ef40 1 -- 172.21.15.79:0/3601361742 shutdown_connections 2024-04-25T02:09:12.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.985+0000 7ff0cda7ef40 1 -- 172.21.15.79:0/3601361742 >> 172.21.15.79:0/3601361742 conn(0x55849d603920 msgr2=0x55849d6abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:12.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.985+0000 7ff0cda7ef40 1 -- 172.21.15.79:0/3601361742 shutdown_connections 2024-04-25T02:09:12.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:12.985+0000 7ff0cda7ef40 1 -- 172.21.15.79:0/3601361742 wait complete. 2024-04-25T02:09:12.997 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:09:12.997 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:09:13.076 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:09:13.122 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:09:13.122 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:09:13.122 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:09:13.122 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:09:13.138 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:09:13.138 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:09:13.138 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:09:13.138 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:09:13.155 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:09:13.155 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:09:13.155 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:09:13.155 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:09:13.193 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:09:13.193 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:09:13.193 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:09:13.194 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:09:13.213 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:09:13.213 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:13.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.324+0000 7f9dd981c640 1 Processor -- start 2024-04-25T02:09:13.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.324+0000 7f9dd981c640 1 -- start start 2024-04-25T02:09:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.324+0000 7f9dd981c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9dd415e4d0 0x7f9dd406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.324+0000 7f9dd981c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dd40b3570 0x7f9dd40d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.324+0000 7f9dd981c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9dd40b3020 0x7f9dd40d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.324+0000 7f9dd981c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd40d1660 con 0x7f9dd40b3020 2024-04-25T02:09:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.324+0000 7f9dd981c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd40d1380 con 0x7f9dd415e4d0 2024-04-25T02:09:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.324+0000 7f9dd981c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd40cede0 con 0x7f9dd40b3570 2024-04-25T02:09:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.325+0000 7f9dd37fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9dd40b3020 0x7f9dd40d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.325+0000 7f9dd37fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9dd40b3020 0x7f9dd40d2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53530/0 (socket says 172.21.15.79:53530) 2024-04-25T02:09:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.325+0000 7f9dd37fe640 1 -- 172.21.15.79:0/1592372623 learned_addr learned my addr 172.21.15.79:0/1592372623 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.325+0000 7f9dca7fc640 1 --2- 172.21.15.79:0/1592372623 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dd40b3570 0x7f9dd40d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.325+0000 7f9dd2ffd640 1 --2- 172.21.15.79:0/1592372623 >> v2:172.21.15.189:3300/0 conn(0x7f9dd415e4d0 0x7f9dd406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.325+0000 7f9dd37fe640 1 -- 172.21.15.79:0/1592372623 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dd40b3570 msgr2=0x7f9dd40d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.325+0000 7f9dd37fe640 1 --2- 172.21.15.79:0/1592372623 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dd40b3570 0x7f9dd40d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.325+0000 7f9dd37fe640 1 -- 172.21.15.79:0/1592372623 >> v2:172.21.15.189:3300/0 conn(0x7f9dd415e4d0 msgr2=0x7f9dd406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.325+0000 7f9dd37fe640 1 --2- 172.21.15.79:0/1592372623 >> v2:172.21.15.189:3300/0 conn(0x7f9dd415e4d0 0x7f9dd406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.325+0000 7f9dd37fe640 1 -- 172.21.15.79:0/1592372623 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd40cf0c0 con 0x7f9dd40b3020 2024-04-25T02:09:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.326+0000 7f9dd37fe640 1 --2- 172.21.15.79:0/1592372623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd40b3020 0x7f9dd40d2c50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4067a20 tx=0x7f9dcc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdb7b440787c9af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.326+0000 7f9dd27fc640 1 -- 172.21.15.79:0/1592372623 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc036070 con 0x7f9dd40b3020 2024-04-25T02:09:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.326+0000 7f9dd27fc640 1 -- 172.21.15.79:0/1592372623 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dcc031600 con 0x7f9dd40b3020 2024-04-25T02:09:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.326+0000 7f9dd27fc640 1 -- 172.21.15.79:0/1592372623 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0319d0 con 0x7f9dd40b3020 2024-04-25T02:09:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.326+0000 7f9dd981c640 1 -- 172.21.15.79:0/1592372623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd40b3020 msgr2=0x7f9dd40d2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.326+0000 7f9dd981c640 1 --2- 172.21.15.79:0/1592372623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd40b3020 0x7f9dd40d2c50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4067a20 tx=0x7f9dcc02a6a0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.326+0000 7f9dd981c640 1 -- 172.21.15.79:0/1592372623 shutdown_connections 2024-04-25T02:09:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.326+0000 7f9dd981c640 1 --2- 172.21.15.79:0/1592372623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd40b3020 0x7f9dd40d2c50 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.326+0000 7f9dd981c640 1 --2- 172.21.15.79:0/1592372623 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dd40b3570 0x7f9dd40d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.326+0000 7f9dd981c640 1 --2- 172.21.15.79:0/1592372623 >> v2:172.21.15.189:3300/0 conn(0x7f9dd415e4d0 0x7f9dd406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.326+0000 7f9dd981c640 1 -- 172.21.15.79:0/1592372623 >> 172.21.15.79:0/1592372623 conn(0x7f9dd409d460 msgr2=0x7f9dd40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.326+0000 7f9dd981c640 1 -- 172.21.15.79:0/1592372623 shutdown_connections 2024-04-25T02:09:13.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.326+0000 7f9dd981c640 1 -- 172.21.15.79:0/1592372623 wait complete. 2024-04-25T02:09:13.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.327+0000 7f9dd981c640 1 Processor -- start 2024-04-25T02:09:13.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.328+0000 7f9dd981c640 1 -- start start 2024-04-25T02:09:13.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.328+0000 7f9dd981c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dd40b3020 0x7f9dd40b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.328+0000 7f9dd981c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dd40b3570 0x7f9dd415ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.328+0000 7f9dd981c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd415e4d0 0x7f9dd415f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.328+0000 7f9dd981c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd40d2250 con 0x7f9dd415e4d0 2024-04-25T02:09:13.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.328+0000 7f9dd981c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd40d20d0 con 0x7f9dd40b3020 2024-04-25T02:09:13.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.328+0000 7f9dd981c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd406c1b0 con 0x7f9dd40b3570 2024-04-25T02:09:13.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.328+0000 7f9dd37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd415e4d0 0x7f9dd415f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.329+0000 7f9dd37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd415e4d0 0x7f9dd415f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53546/0 (socket says 172.21.15.79:53546) 2024-04-25T02:09:13.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.329+0000 7f9dd37fe640 1 -- 172.21.15.79:0/596980417 learned_addr learned my addr 172.21.15.79:0/596980417 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:13.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.329+0000 7f9dca7fc640 1 --2- 172.21.15.79:0/596980417 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dd40b3570 0x7f9dd415ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.329+0000 7f9dd2ffd640 1 --2- 172.21.15.79:0/596980417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dd40b3020 0x7f9dd40b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.329+0000 7f9dd37fe640 1 -- 172.21.15.79:0/596980417 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dd40b3570 msgr2=0x7f9dd415ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:13.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.329+0000 7f9dd37fe640 1 --2- 172.21.15.79:0/596980417 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dd40b3570 0x7f9dd415ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.329+0000 7f9dd37fe640 1 -- 172.21.15.79:0/596980417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dd40b3020 msgr2=0x7f9dd40b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.329+0000 7f9dd37fe640 1 --2- 172.21.15.79:0/596980417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dd40b3020 0x7f9dd40b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.329+0000 7f9dd37fe640 1 -- 172.21.15.79:0/596980417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd41f43b0 con 0x7f9dd415e4d0 2024-04-25T02:09:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.329+0000 7f9dd37fe640 1 --2- 172.21.15.79:0/596980417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd415e4d0 0x7f9dd415f2a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc034040 tx=0x7f9dcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.329+0000 7f9dd0ff9640 1 -- 172.21.15.79:0/596980417 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc041020 con 0x7f9dd415e4d0 2024-04-25T02:09:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.329+0000 7f9dd0ff9640 1 -- 172.21.15.79:0/596980417 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dcc0077a0 con 0x7f9dd415e4d0 2024-04-25T02:09:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.329+0000 7f9dd0ff9640 1 -- 172.21.15.79:0/596980417 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc036040 con 0x7f9dd415e4d0 2024-04-25T02:09:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.329+0000 7f9dd981c640 1 -- 172.21.15.79:0/596980417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd41f4690 con 0x7f9dd415e4d0 2024-04-25T02:09:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.329+0000 7f9dd981c640 1 -- 172.21.15.79:0/596980417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd41f4c50 con 0x7f9dd415e4d0 2024-04-25T02:09:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.330+0000 7f9dd981c640 1 -- 172.21.15.79:0/596980417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd40690a0 con 0x7f9dd415e4d0 2024-04-25T02:09:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.331+0000 7f9dd0ff9640 1 -- 172.21.15.79:0/596980417 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9dcc044020 con 0x7f9dd415e4d0 2024-04-25T02:09:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.331+0000 7f9dd0ff9640 1 --2- 172.21.15.79:0/596980417 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9db406be30 0x7f9db406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.331+0000 7f9dd0ff9640 1 -- 172.21.15.79:0/596980417 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9dcc0ab850 con 0x7f9dd415e4d0 2024-04-25T02:09:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.331+0000 7f9dd2ffd640 1 --2- 172.21.15.79:0/596980417 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9db406be30 0x7f9db406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.331+0000 7f9dd2ffd640 1 --2- 172.21.15.79:0/596980417 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9db406be30 0x7f9db406e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009b40 tx=0x7f9dc4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:13.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.335+0000 7f9dd0ff9640 1 -- 172.21.15.79:0/596980417 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9dcc04b030 con 0x7f9dd415e4d0 2024-04-25T02:09:13.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.544+0000 7f9dd981c640 1 -- 172.21.15.79:0/596980417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9dd40d1920 con 0x7f9dd415e4d0 2024-04-25T02:09:13.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.545+0000 7f9dd0ff9640 1 -- 172.21.15.79:0/596980417 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+5181 (secure 0 0 0) 0x7f9dcc079c40 con 0x7f9dd415e4d0 2024-04-25T02:09:13.552 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:13.552 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2251520552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2251520552},{"type":"v1","addr":"172.21.15.79:6836","nonce":2251520552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/1462215746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":1462215746},{"type":"v1","addr":"172.21.15.79:6837","nonce":1462215746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/2359417586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2359417586},{"type":"v1","addr":"172.21.15.189:6834","nonce":2359417586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:08:48.219535+0000","modified":"2024-04-25T02:08:50.227642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6835/605900869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":605900869},{"type":"v1","addr":"172.21.15.189:6835","nonce":605900869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5112,"qdb_cluster":[5112]},"id":2}]} 2024-04-25T02:09:13.553 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 12 2024-04-25T02:09:13.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.547+0000 7f9dd981c640 1 -- 172.21.15.79:0/596980417 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9db406be30 msgr2=0x7f9db406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:13.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.547+0000 7f9dd981c640 1 --2- 172.21.15.79:0/596980417 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9db406be30 0x7f9db406e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009b40 tx=0x7f9dc4009190 comp rx=0 tx=0).stop 2024-04-25T02:09:13.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.547+0000 7f9dd981c640 1 -- 172.21.15.79:0/596980417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd415e4d0 msgr2=0x7f9dd415f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:13.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.547+0000 7f9dd981c640 1 --2- 172.21.15.79:0/596980417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd415e4d0 0x7f9dd415f2a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc034040 tx=0x7f9dcc004a40 comp rx=0 tx=0).stop 2024-04-25T02:09:13.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.547+0000 7f9dd981c640 1 -- 172.21.15.79:0/596980417 shutdown_connections 2024-04-25T02:09:13.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.547+0000 7f9dd981c640 1 --2- 172.21.15.79:0/596980417 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9db406be30 0x7f9db406e2f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.547+0000 7f9dd981c640 1 --2- 172.21.15.79:0/596980417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd415e4d0 0x7f9dd415f2a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.547+0000 7f9dd981c640 1 --2- 172.21.15.79:0/596980417 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dd40b3570 0x7f9dd415ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.547+0000 7f9dd981c640 1 --2- 172.21.15.79:0/596980417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dd40b3020 0x7f9dd40b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.547+0000 7f9dd981c640 1 -- 172.21.15.79:0/596980417 >> 172.21.15.79:0/596980417 conn(0x7f9dd409d460 msgr2=0x7f9dd415d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:13.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.547+0000 7f9dd981c640 1 -- 172.21.15.79:0/596980417 shutdown_connections 2024-04-25T02:09:13.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.547+0000 7f9dd981c640 1 -- 172.21.15.79:0/596980417 wait complete. 2024-04-25T02:09:13.565 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:13.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.654+0000 7fdda689e640 1 Processor -- start 2024-04-25T02:09:13.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.654+0000 7fdda689e640 1 -- start start 2024-04-25T02:09:13.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.655+0000 7fdda689e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdda0143bc0 0x7fdda015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.655+0000 7fdda689e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdda00b3d40 0x7fdda006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.655+0000 7fdda689e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda015fa40 con 0x7fdda006df50 2024-04-25T02:09:13.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.655+0000 7fdda689e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fdda006e8f0 con 0x7fdda00b3d40 2024-04-25T02:09:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.655+0000 7fdda689e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdda0072cb0 con 0x7fdda0143bc0 2024-04-25T02:09:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.655+0000 7fdda4e3b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdda00b3d40 0x7fdda006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.655+0000 7fdd9f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdda006df50 0x7fdda00b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38576/0 (socket says 172.21.15.79:38576) 2024-04-25T02:09:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.655+0000 7fdd9f7fe640 1 -- 172.21.15.79:0/2123935686 learned_addr learned my addr 172.21.15.79:0/2123935686 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.655+0000 7fdd9ffff640 1 --2- 172.21.15.79:0/2123935686 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdda0143bc0 0x7fdda015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.655+0000 7fdda4e3b640 1 -- 172.21.15.79:0/2123935686 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdda0143bc0 msgr2=0x7fdda015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.655+0000 7fdda4e3b640 1 --2- 172.21.15.79:0/2123935686 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdda0143bc0 0x7fdda015f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.655+0000 7fdda4e3b640 1 -- 172.21.15.79:0/2123935686 >> v1:172.21.15.79:6789/0 conn(0x7fdda006df50 legacy=0x7fdda00b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.655+0000 7fdd9effd640 1 -- 172.21.15.79:0/2123935686 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1553406859 0 0) 0x7fdd94001110 con 0x7fdda006df50 2024-04-25T02:09:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.656+0000 7fdda4e3b640 1 -- 172.21.15.79:0/2123935686 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda0071e00 con 0x7fdda00b3d40 2024-04-25T02:09:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.656+0000 7fdda4e3b640 1 --2- 172.21.15.79:0/2123935686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda00b3d40 0x7fdda006e3b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009d90 tx=0x7fdd9802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f88cbb17dcb21d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.656+0000 7fdd9effd640 1 -- 172.21.15.79:0/2123935686 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98031600 con 0x7fdda00b3d40 2024-04-25T02:09:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.656+0000 7fdd9effd640 1 -- 172.21.15.79:0/2123935686 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd980317a0 con 0x7fdda00b3d40 2024-04-25T02:09:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.656+0000 7fdd9effd640 1 -- 172.21.15.79:0/2123935686 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98031b70 con 0x7fdda00b3d40 2024-04-25T02:09:13.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.657+0000 7fdda689e640 1 -- 172.21.15.79:0/2123935686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda00b3d40 msgr2=0x7fdda006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.657+0000 7fdda689e640 1 --2- 172.21.15.79:0/2123935686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda00b3d40 0x7fdda006e3b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009d90 tx=0x7fdd9802a5d0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.657+0000 7fdda689e640 1 -- 172.21.15.79:0/2123935686 shutdown_connections 2024-04-25T02:09:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.657+0000 7fdda689e640 1 --2- 172.21.15.79:0/2123935686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda00b3d40 0x7fdda006e3b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.657+0000 7fdda689e640 1 --2- 172.21.15.79:0/2123935686 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdda0143bc0 0x7fdda015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.657+0000 7fdda689e640 1 -- 172.21.15.79:0/2123935686 >> 172.21.15.79:0/2123935686 conn(0x7fdda00cfc80 msgr2=0x7fdda00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.657+0000 7fdda689e640 1 -- 172.21.15.79:0/2123935686 shutdown_connections 2024-04-25T02:09:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.657+0000 7fdda689e640 1 -- 172.21.15.79:0/2123935686 wait complete. 2024-04-25T02:09:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.658+0000 7fdda689e640 1 Processor -- start 2024-04-25T02:09:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.658+0000 7fdda689e640 1 -- start start 2024-04-25T02:09:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdda689e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda006df50 0x7fdda00cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdda689e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdda00b3d40 0x7fdda015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdda689e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdda0143bc0 0x7fdda015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdda689e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdda0072660 con 0x7fdda006df50 2024-04-25T02:09:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdda689e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdda0072380 con 0x7fdda00b3d40 2024-04-25T02:09:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdda689e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdda0072940 con 0x7fdda0143bc0 2024-04-25T02:09:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdd9ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda006df50 0x7fdda00cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdd9ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda006df50 0x7fdda00cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37030/0 (socket says 172.21.15.79:37030) 2024-04-25T02:09:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdd9ffff640 1 -- 172.21.15.79:0/1686860662 learned_addr learned my addr 172.21.15.79:0/1686860662 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdda4e3b640 1 --2- 172.21.15.79:0/1686860662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdda0143bc0 0x7fdda015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdd9f7fe640 1 --2- 172.21.15.79:0/1686860662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdda00b3d40 0x7fdda015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdd9ffff640 1 -- 172.21.15.79:0/1686860662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdda0143bc0 msgr2=0x7fdda015bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdd9ffff640 1 --2- 172.21.15.79:0/1686860662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdda0143bc0 0x7fdda015bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdd9ffff640 1 -- 172.21.15.79:0/1686860662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdda00b3d40 msgr2=0x7fdda015ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdd9ffff640 1 --2- 172.21.15.79:0/1686860662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdda00b3d40 0x7fdda015ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdd9ffff640 1 -- 172.21.15.79:0/1686860662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda00af990 con 0x7fdda006df50 2024-04-25T02:09:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.659+0000 7fdd9ffff640 1 --2- 172.21.15.79:0/1686860662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda006df50 0x7fdda00cd720 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000d600 tx=0x7fdd9000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.660+0000 7fdd9cff9640 1 -- 172.21.15.79:0/1686860662 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd900125f0 con 0x7fdda006df50 2024-04-25T02:09:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.660+0000 7fdd9cff9640 1 -- 172.21.15.79:0/1686860662 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd90019070 con 0x7fdda006df50 2024-04-25T02:09:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.660+0000 7fdd9cff9640 1 -- 172.21.15.79:0/1686860662 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd900129f0 con 0x7fdda006df50 2024-04-25T02:09:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.660+0000 7fdda689e640 1 -- 172.21.15.79:0/1686860662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda00afc70 con 0x7fdda006df50 2024-04-25T02:09:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.660+0000 7fdda689e640 1 -- 172.21.15.79:0/1686860662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda00b0230 con 0x7fdda006df50 2024-04-25T02:09:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.660+0000 7fdda689e640 1 -- 172.21.15.79:0/1686860662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda00690a0 con 0x7fdda006df50 2024-04-25T02:09:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.661+0000 7fdd9cff9640 1 -- 172.21.15.79:0/1686860662 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd90012b90 con 0x7fdda006df50 2024-04-25T02:09:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.661+0000 7fdd9cff9640 1 --2- 172.21.15.79:0/1686860662 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdd8c06be30 0x7fdd8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.661+0000 7fdd9cff9640 1 -- 172.21.15.79:0/1686860662 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fdd9008b2f0 con 0x7fdda006df50 2024-04-25T02:09:13.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.661+0000 7fdd9f7fe640 1 --2- 172.21.15.79:0/1686860662 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdd8c06be30 0x7fdd8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.662+0000 7fdd9f7fe640 1 --2- 172.21.15.79:0/1686860662 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdd8c06be30 0x7fdd8c06e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdda00b1920 tx=0x7fdd94007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:13.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.666+0000 7fdd9cff9640 1 -- 172.21.15.79:0/1686860662 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdd90059ca0 con 0x7fdda006df50 2024-04-25T02:09:13.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.838+0000 7fdda689e640 1 -- 172.21.15.79:0/1686860662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdda006c0c0 con 0x7fdda006df50 2024-04-25T02:09:13.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.839+0000 7fdd9cff9640 1 -- 172.21.15.79:0/1686860662 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16681 (secure 0 0 0) 0x7fdd900595a0 con 0x7fdda006df50 2024-04-25T02:09:13.847 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:13.847 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":33,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:49.884423+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:08:46.063839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T02:08:47.254948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:13.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.841+0000 7fdda689e640 1 -- 172.21.15.79:0/1686860662 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdd8c06be30 msgr2=0x7fdd8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:13.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.841+0000 7fdda689e640 1 --2- 172.21.15.79:0/1686860662 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdd8c06be30 0x7fdd8c06e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdda00b1920 tx=0x7fdd94007c00 comp rx=0 tx=0).stop 2024-04-25T02:09:13.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.841+0000 7fdda689e640 1 -- 172.21.15.79:0/1686860662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda006df50 msgr2=0x7fdda00cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:13.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.841+0000 7fdda689e640 1 --2- 172.21.15.79:0/1686860662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda006df50 0x7fdda00cd720 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000d600 tx=0x7fdd9000dac0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.841+0000 7fdda689e640 1 -- 172.21.15.79:0/1686860662 shutdown_connections 2024-04-25T02:09:13.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.841+0000 7fdda689e640 1 --2- 172.21.15.79:0/1686860662 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdd8c06be30 0x7fdd8c06e2f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.841+0000 7fdda689e640 1 --2- 172.21.15.79:0/1686860662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdda0143bc0 0x7fdda015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.841+0000 7fdda689e640 1 --2- 172.21.15.79:0/1686860662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdda00b3d40 0x7fdda015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.841+0000 7fdda689e640 1 --2- 172.21.15.79:0/1686860662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda006df50 0x7fdda00cd720 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.841+0000 7fdda689e640 1 -- 172.21.15.79:0/1686860662 >> 172.21.15.79:0/1686860662 conn(0x7fdda00cfc80 msgr2=0x7fdda0142000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:13.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.842+0000 7fdda689e640 1 -- 172.21.15.79:0/1686860662 shutdown_connections 2024-04-25T02:09:13.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.842+0000 7fdda689e640 1 -- 172.21.15.79:0/1686860662 wait complete. 2024-04-25T02:09:13.860 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:08:46.063839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:08:47.254948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:09:13.860 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:09:13.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.952+0000 7f279dfd5640 1 Processor -- start 2024-04-25T02:09:13.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.952+0000 7f279dfd5640 1 -- start start 2024-04-25T02:09:13.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.953+0000 7f279dfd5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f279806b2f0 0x7f27980b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.953+0000 7f279dfd5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27980cf7a0 0x7f279806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.953+0000 7f279dfd5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f279806bc10 con 0x7f279806e6b0 2024-04-25T02:09:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.953+0000 7f279dfd5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f279815f830 con 0x7f27980cf7a0 2024-04-25T02:09:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.953+0000 7f279dfd5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f279815ec20 con 0x7f279806b2f0 2024-04-25T02:09:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.953+0000 7f2796ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27980cf7a0 0x7f279806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.953+0000 7f2797fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f279806e6b0 0x7f27980cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38590/0 (socket says 172.21.15.79:38590) 2024-04-25T02:09:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.953+0000 7f2797fff640 1 -- 172.21.15.79:0/2510669812 learned_addr learned my addr 172.21.15.79:0/2510669812 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.953+0000 7f2796ffd640 1 -- 172.21.15.79:0/2510669812 >> v2:172.21.15.189:3300/0 conn(0x7f279806b2f0 msgr2=0x7f27980b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.953+0000 7f2796ffd640 1 --2- 172.21.15.79:0/2510669812 >> v2:172.21.15.189:3300/0 conn(0x7f279806b2f0 0x7f27980b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.953+0000 7f2796ffd640 1 -- 172.21.15.79:0/2510669812 >> v1:172.21.15.79:6789/0 conn(0x7f279806e6b0 legacy=0x7f27980cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.953+0000 7f27967fc640 1 -- 172.21.15.79:0/2510669812 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145060198 0 0) 0x7f279806bc10 con 0x7f279806e6b0 2024-04-25T02:09:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.953+0000 7f2796ffd640 1 -- 172.21.15.79:0/2510669812 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279815ef00 con 0x7f27980cf7a0 2024-04-25T02:09:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.954+0000 7f2796ffd640 1 --2- 172.21.15.79:0/2510669812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27980cf7a0 0x7f279806b6d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f279806efd0 tx=0x7f278c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b083b11069d307b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.954+0000 7f27967fc640 1 -- 172.21.15.79:0/2510669812 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c037070 con 0x7f27980cf7a0 2024-04-25T02:09:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.954+0000 7f27967fc640 1 -- 172.21.15.79:0/2510669812 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f278c032440 con 0x7f27980cf7a0 2024-04-25T02:09:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.954+0000 7f27967fc640 1 -- 172.21.15.79:0/2510669812 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c02ae60 con 0x7f27980cf7a0 2024-04-25T02:09:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.954+0000 7f279dfd5640 1 -- 172.21.15.79:0/2510669812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27980cf7a0 msgr2=0x7f279806b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.954+0000 7f279dfd5640 1 --2- 172.21.15.79:0/2510669812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27980cf7a0 0x7f279806b6d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f279806efd0 tx=0x7f278c02a110 comp rx=0 tx=0).stop 2024-04-25T02:09:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.955+0000 7f279dfd5640 1 -- 172.21.15.79:0/2510669812 shutdown_connections 2024-04-25T02:09:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.955+0000 7f279dfd5640 1 --2- 172.21.15.79:0/2510669812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27980cf7a0 0x7f279806b6d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.955+0000 7f279dfd5640 1 --2- 172.21.15.79:0/2510669812 >> v2:172.21.15.189:3300/0 conn(0x7f279806b2f0 0x7f27980b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.955+0000 7f279dfd5640 1 -- 172.21.15.79:0/2510669812 >> 172.21.15.79:0/2510669812 conn(0x7f27980b1cd0 msgr2=0x7f27980b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.955+0000 7f279dfd5640 1 -- 172.21.15.79:0/2510669812 shutdown_connections 2024-04-25T02:09:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.955+0000 7f279dfd5640 1 -- 172.21.15.79:0/2510669812 wait complete. 2024-04-25T02:09:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.956+0000 7f279dfd5640 1 Processor -- start 2024-04-25T02:09:13.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.956+0000 7f279dfd5640 1 -- start start 2024-04-25T02:09:13.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f279dfd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279806b2f0 0x7f27980ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f279dfd5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f279806e6b0 0x7f279809d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f279dfd5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27980cf7a0 0x7f2798158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f279dfd5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f279806cfe0 con 0x7f279806b2f0 2024-04-25T02:09:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f279dfd5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f279815f4c0 con 0x7f279806e6b0 2024-04-25T02:09:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f279dfd5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f279806d160 con 0x7f27980cf7a0 2024-04-25T02:09:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f27977fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279806b2f0 0x7f27980ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f27977fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279806b2f0 0x7f27980ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37040/0 (socket says 172.21.15.79:37040) 2024-04-25T02:09:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f27977fe640 1 -- 172.21.15.79:0/4149724925 learned_addr learned my addr 172.21.15.79:0/4149724925 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f2797fff640 1 --2- 172.21.15.79:0/4149724925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27980cf7a0 0x7f2798158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f2796ffd640 1 --2- 172.21.15.79:0/4149724925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f279806e6b0 0x7f279809d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f27977fe640 1 -- 172.21.15.79:0/4149724925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27980cf7a0 msgr2=0x7f2798158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f27977fe640 1 --2- 172.21.15.79:0/4149724925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27980cf7a0 0x7f2798158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f27977fe640 1 -- 172.21.15.79:0/4149724925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f279806e6b0 msgr2=0x7f279809d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f27977fe640 1 --2- 172.21.15.79:0/4149724925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f279806e6b0 0x7f279809d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f27977fe640 1 -- 172.21.15.79:0/4149724925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27981f50e0 con 0x7f279806b2f0 2024-04-25T02:09:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f2796ffd640 1 --2- 172.21.15.79:0/4149724925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f279806e6b0 0x7f279809d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f27977fe640 1 --2- 172.21.15.79:0/4149724925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279806b2f0 0x7f27980ca060 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f278800b4d0 tx=0x7f278800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f277ffff640 1 -- 172.21.15.79:0/4149724925 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788014070 con 0x7f279806b2f0 2024-04-25T02:09:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f277ffff640 1 -- 172.21.15.79:0/4149724925 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2788010870 con 0x7f279806b2f0 2024-04-25T02:09:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f279dfd5640 1 -- 172.21.15.79:0/4149724925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27980ca5a0 con 0x7f279806b2f0 2024-04-25T02:09:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f277ffff640 1 -- 172.21.15.79:0/4149724925 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788010c60 con 0x7f279806b2f0 2024-04-25T02:09:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.957+0000 7f279dfd5640 1 -- 172.21.15.79:0/4149724925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27981f4b20 con 0x7f279806b2f0 2024-04-25T02:09:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.958+0000 7f279dfd5640 1 -- 172.21.15.79:0/4149724925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27980690a0 con 0x7f279806b2f0 2024-04-25T02:09:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.959+0000 7f277ffff640 1 -- 172.21.15.79:0/4149724925 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2788017070 con 0x7f279806b2f0 2024-04-25T02:09:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.959+0000 7f277ffff640 1 --2- 172.21.15.79:0/4149724925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f278406be30 0x7f278406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.959+0000 7f2796ffd640 1 --2- 172.21.15.79:0/4149724925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f278406be30 0x7f278406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.959+0000 7f277ffff640 1 -- 172.21.15.79:0/4149724925 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f278808ab10 con 0x7f279806b2f0 2024-04-25T02:09:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.960+0000 7f2796ffd640 1 --2- 172.21.15.79:0/4149724925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f278406be30 0x7f278406e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f278c034000 tx=0x7f278c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:13.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:13.964+0000 7f277ffff640 1 -- 172.21.15.79:0/4149724925 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2788058f00 con 0x7f279806b2f0 2024-04-25T02:09:14.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.138+0000 7f279dfd5640 1 -- 172.21.15.79:0/4149724925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f27980ad700 con 0x7f279806b2f0 2024-04-25T02:09:14.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.138+0000 7f277ffff640 1 -- 172.21.15.79:0/4149724925 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7f278805d200 con 0x7f279806b2f0 2024-04-25T02:09:14.146 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:09:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.140+0000 7f279dfd5640 1 -- 172.21.15.79:0/4149724925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f278406be30 msgr2=0x7f278406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.140+0000 7f279dfd5640 1 --2- 172.21.15.79:0/4149724925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f278406be30 0x7f278406e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f278c034000 tx=0x7f278c02e000 comp rx=0 tx=0).stop 2024-04-25T02:09:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.140+0000 7f279dfd5640 1 -- 172.21.15.79:0/4149724925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279806b2f0 msgr2=0x7f27980ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.140+0000 7f279dfd5640 1 --2- 172.21.15.79:0/4149724925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279806b2f0 0x7f27980ca060 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f278800b4d0 tx=0x7f278800b990 comp rx=0 tx=0).stop 2024-04-25T02:09:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.140+0000 7f279dfd5640 1 -- 172.21.15.79:0/4149724925 shutdown_connections 2024-04-25T02:09:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.140+0000 7f279dfd5640 1 --2- 172.21.15.79:0/4149724925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f278406be30 0x7f278406e2f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.140+0000 7f279dfd5640 1 --2- 172.21.15.79:0/4149724925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27980cf7a0 0x7f2798158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.140+0000 7f279dfd5640 1 --2- 172.21.15.79:0/4149724925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f279806e6b0 0x7f279809d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.140+0000 7f279dfd5640 1 --2- 172.21.15.79:0/4149724925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279806b2f0 0x7f27980ca060 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.140+0000 7f279dfd5640 1 -- 172.21.15.79:0/4149724925 >> 172.21.15.79:0/4149724925 conn(0x7f27980b1cd0 msgr2=0x7f27980af6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.140+0000 7f279dfd5640 1 -- 172.21.15.79:0/4149724925 shutdown_connections 2024-04-25T02:09:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.140+0000 7f279dfd5640 1 -- 172.21.15.79:0/4149724925 wait complete. 2024-04-25T02:09:14.158 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:09:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.250+0000 7f6ec3abd640 1 Processor -- start 2024-04-25T02:09:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.250+0000 7f6ec3abd640 1 -- start start 2024-04-25T02:09:14.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.251+0000 7f6ec3abd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ebc15e6d0 0x7f6ebc0cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.251+0000 7f6ec3abd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6ebc0cf130 0x7f6ebc0d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.251+0000 7f6ec3abd640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ebc0cf5f0 con 0x7f6ebc0b5610 2024-04-25T02:09:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.251+0000 7f6ec3abd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6ebc0cf8d0 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.251+0000 7f6ec3abd640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6ebc0cfbb0 con 0x7f6ebc0cf130 2024-04-25T02:09:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.251+0000 7f6ec1859640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ebc15e6d0 0x7f6ebc0cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.251+0000 7f6ec1859640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ebc15e6d0 0x7f6ebc0cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37052/0 (socket says 172.21.15.79:37052) 2024-04-25T02:09:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.251+0000 7f6ec1859640 1 -- 172.21.15.79:0/2501994575 learned_addr learned my addr 172.21.15.79:0/2501994575 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.251+0000 7f6ec1058640 1 --2- 172.21.15.79:0/2501994575 >> v2:172.21.15.189:3300/0 conn(0x7f6ebc0cf130 0x7f6ebc0d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.251+0000 7f6ec1859640 1 -- 172.21.15.79:0/2501994575 >> v2:172.21.15.189:3300/0 conn(0x7f6ebc0cf130 msgr2=0x7f6ebc0d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.251+0000 7f6ec1859640 1 --2- 172.21.15.79:0/2501994575 >> v2:172.21.15.189:3300/0 conn(0x7f6ebc0cf130 0x7f6ebc0d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.251+0000 7f6ec1859640 1 -- 172.21.15.79:0/2501994575 >> v1:172.21.15.189:6789/0 conn(0x7f6ebc0b5610 legacy=0x7f6ebc0d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.252+0000 7f6ec1859640 1 -- 172.21.15.79:0/2501994575 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc0cfe90 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.252+0000 7f6ec1058640 1 --2- 172.21.15.79:0/2501994575 >> v2:172.21.15.189:3300/0 conn(0x7f6ebc0cf130 0x7f6ebc0d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.252+0000 7f6ec1859640 1 --2- 172.21.15.79:0/2501994575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ebc15e6d0 0x7f6ebc0cebf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc08e5a0 tx=0x7f6eb802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103b46ab864c8260 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.252+0000 7f6ec0857640 1 -- 172.21.15.79:0/2501994575 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8036070 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.252+0000 7f6ec0857640 1 -- 172.21.15.79:0/2501994575 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb8031600 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.252+0000 7f6ec0857640 1 -- 172.21.15.79:0/2501994575 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb80319d0 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.253+0000 7f6ec3abd640 1 -- 172.21.15.79:0/2501994575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ebc15e6d0 msgr2=0x7f6ebc0cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.253+0000 7f6ec3abd640 1 --2- 172.21.15.79:0/2501994575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ebc15e6d0 0x7f6ebc0cebf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc08e5a0 tx=0x7f6eb802a6f0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.253+0000 7f6ec3abd640 1 -- 172.21.15.79:0/2501994575 shutdown_connections 2024-04-25T02:09:14.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.253+0000 7f6ec3abd640 1 --2- 172.21.15.79:0/2501994575 >> v2:172.21.15.189:3300/0 conn(0x7f6ebc0cf130 0x7f6ebc0d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.253+0000 7f6ec3abd640 1 --2- 172.21.15.79:0/2501994575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ebc15e6d0 0x7f6ebc0cebf0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.253+0000 7f6ec3abd640 1 -- 172.21.15.79:0/2501994575 >> 172.21.15.79:0/2501994575 conn(0x7f6ebc09d3e0 msgr2=0x7f6ebc0d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:14.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.253+0000 7f6ec3abd640 1 -- 172.21.15.79:0/2501994575 shutdown_connections 2024-04-25T02:09:14.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.253+0000 7f6ec3abd640 1 -- 172.21.15.79:0/2501994575 wait complete. 2024-04-25T02:09:14.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.254+0000 7f6ec3abd640 1 Processor -- start 2024-04-25T02:09:14.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.254+0000 7f6ec3abd640 1 -- start start 2024-04-25T02:09:14.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec3abd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ebc0b5610 0x7f6ebc1f80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec3abd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ebc0cf130 0x7f6ebc15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec3abd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ebc15e6d0 0x7f6ebc0d42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec3abd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc0b4910 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec3abd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc0b4790 con 0x7f6ebc0cf130 2024-04-25T02:09:14.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec3abd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6ebc0b4a90 con 0x7f6ebc0b5610 2024-04-25T02:09:14.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec205a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ebc15e6d0 0x7f6ebc0d42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec205a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ebc15e6d0 0x7f6ebc0d42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37058/0 (socket says 172.21.15.79:37058) 2024-04-25T02:09:14.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec205a640 1 -- 172.21.15.79:0/895601631 learned_addr learned my addr 172.21.15.79:0/895601631 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:14.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec1859640 1 --2- 172.21.15.79:0/895601631 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ebc0b5610 0x7f6ebc1f80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec1058640 1 --2- 172.21.15.79:0/895601631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ebc0cf130 0x7f6ebc15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec205a640 1 -- 172.21.15.79:0/895601631 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ebc0b5610 msgr2=0x7f6ebc1f80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec205a640 1 --2- 172.21.15.79:0/895601631 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ebc0b5610 0x7f6ebc1f80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec205a640 1 -- 172.21.15.79:0/895601631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ebc0cf130 msgr2=0x7f6ebc15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec205a640 1 --2- 172.21.15.79:0/895601631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ebc0cf130 0x7f6ebc15c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec205a640 1 -- 172.21.15.79:0/895601631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc1f4b10 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec1058640 1 --2- 172.21.15.79:0/895601631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ebc0cf130 0x7f6ebc15c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:14.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6ec205a640 1 --2- 172.21.15.79:0/895601631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ebc15e6d0 0x7f6ebc0d42f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400b410 tx=0x7f6eb400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:14.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.255+0000 7f6eb27fc640 1 -- 172.21.15.79:0/895601631 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4015030 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.256+0000 7f6eb27fc640 1 -- 172.21.15.79:0/895601631 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb4004020 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.256+0000 7f6eb27fc640 1 -- 172.21.15.79:0/895601631 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4004450 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.256+0000 7f6ec3abd640 1 -- 172.21.15.79:0/895601631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ebc1f4df0 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.256+0000 7f6ec3abd640 1 -- 172.21.15.79:0/895601631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ebc1f78c0 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.256+0000 7f6ec3abd640 1 -- 172.21.15.79:0/895601631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ebc0690a0 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.257+0000 7f6eb27fc640 1 -- 172.21.15.79:0/895601631 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6eb4018070 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.257+0000 7f6eb27fc640 1 --2- 172.21.15.79:0/895601631 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ea006be30 0x7f6ea006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.257+0000 7f6eb27fc640 1 -- 172.21.15.79:0/895601631 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6eb408a960 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.257+0000 7f6ec1859640 1 --2- 172.21.15.79:0/895601631 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ea006be30 0x7f6ea006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.258+0000 7f6ec1859640 1 --2- 172.21.15.79:0/895601631 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ea006be30 0x7f6ea006e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8033000 tx=0x7f6eb8009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:14.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.262+0000 7f6eb27fc640 1 -- 172.21.15.79:0/895601631 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6eb4059310 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.433+0000 7f6ec3abd640 1 -- 172.21.15.79:0/895601631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6ebc0d0920 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.434+0000 7f6eb27fc640 1 -- 172.21.15.79:0/895601631 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7f6eb4058c10 con 0x7f6ebc15e6d0 2024-04-25T02:09:14.441 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:09:14.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.436+0000 7f6ec3abd640 1 -- 172.21.15.79:0/895601631 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ea006be30 msgr2=0x7f6ea006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.436+0000 7f6ec3abd640 1 --2- 172.21.15.79:0/895601631 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ea006be30 0x7f6ea006e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8033000 tx=0x7f6eb8009000 comp rx=0 tx=0).stop 2024-04-25T02:09:14.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.436+0000 7f6ec3abd640 1 -- 172.21.15.79:0/895601631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ebc15e6d0 msgr2=0x7f6ebc0d42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.436+0000 7f6ec3abd640 1 --2- 172.21.15.79:0/895601631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ebc15e6d0 0x7f6ebc0d42f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400b410 tx=0x7f6eb400b8d0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.436+0000 7f6ec3abd640 1 -- 172.21.15.79:0/895601631 shutdown_connections 2024-04-25T02:09:14.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.436+0000 7f6ec3abd640 1 --2- 172.21.15.79:0/895601631 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ea006be30 0x7f6ea006e2f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.436+0000 7f6ec3abd640 1 --2- 172.21.15.79:0/895601631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ebc15e6d0 0x7f6ebc0d42f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.436+0000 7f6ec3abd640 1 --2- 172.21.15.79:0/895601631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ebc0cf130 0x7f6ebc15c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.436+0000 7f6ec3abd640 1 --2- 172.21.15.79:0/895601631 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ebc0b5610 0x7f6ebc1f80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.436+0000 7f6ec3abd640 1 -- 172.21.15.79:0/895601631 >> 172.21.15.79:0/895601631 conn(0x7f6ebc09d3e0 msgr2=0x7f6ebc0d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:14.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.436+0000 7f6ec3abd640 1 -- 172.21.15.79:0/895601631 shutdown_connections 2024-04-25T02:09:14.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.436+0000 7f6ec3abd640 1 -- 172.21.15.79:0/895601631 wait complete. 2024-04-25T02:09:14.454 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:09:14.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.545+0000 7fc05f283640 1 Processor -- start 2024-04-25T02:09:14.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.546+0000 7fc05f283640 1 -- start start 2024-04-25T02:09:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.546+0000 7fc05f283640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc05806b2f0 0x7fc0580b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.546+0000 7fc05f283640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0580cf7a0 0x7fc05806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.546+0000 7fc05f283640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc05806bc10 con 0x7fc05806e6b0 2024-04-25T02:09:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.546+0000 7fc05f283640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc05815f830 con 0x7fc05806b2f0 2024-04-25T02:09:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.546+0000 7fc05f283640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc05815ec20 con 0x7fc0580cf7a0 2024-04-25T02:09:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc05d820640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc05806e6b0 0x7fc0580cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38600/0 (socket says 172.21.15.79:38600) 2024-04-25T02:09:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc05d820640 1 -- 172.21.15.79:0/2947487474 learned_addr learned my addr 172.21.15.79:0/2947487474 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 -- 172.21.15.79:0/2947487474 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 50614772 0 0) 0x7fc05806bc10 con 0x7fc05806e6b0 2024-04-25T02:09:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc05d01f640 1 --2- 172.21.15.79:0/2947487474 >> v2:172.21.15.189:3300/0 conn(0x7fc05806b2f0 0x7fc0580b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 -- 172.21.15.79:0/2947487474 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc044003520 con 0x7fc05806e6b0 2024-04-25T02:09:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc05c81e640 1 --2- 172.21.15.79:0/2947487474 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0580cf7a0 0x7fc05806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 -- 172.21.15.79:0/2947487474 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 541352423 0 0) 0x7fc044003520 con 0x7fc05806e6b0 2024-04-25T02:09:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 -- 172.21.15.79:0/2947487474 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0580cf7a0 msgr2=0x7fc05806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 --2- 172.21.15.79:0/2947487474 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0580cf7a0 0x7fc05806b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 -- 172.21.15.79:0/2947487474 >> v2:172.21.15.189:3300/0 conn(0x7fc05806b2f0 msgr2=0x7fc0580b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 --2- 172.21.15.79:0/2947487474 >> v2:172.21.15.189:3300/0 conn(0x7fc05806b2f0 0x7fc0580b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 -- 172.21.15.79:0/2947487474 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05815ef00 con 0x7fc05806e6b0 2024-04-25T02:09:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 -- 172.21.15.79:0/2947487474 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fc0500019f0 con 0x7fc05806e6b0 2024-04-25T02:09:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 -- 172.21.15.79:0/2947487474 >> v1:172.21.15.79:6789/0 conn(0x7fc05806e6b0 legacy=0x7fc0580cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 --2- 172.21.15.79:0/2947487474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0440039b0 0x7fc044003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 --2- 172.21.15.79:0/2947487474 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0580cf7a0 0x7fc044004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 --2- 172.21.15.79:0/2947487474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc044004d40 0x7fc0440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 -- 172.21.15.79:0/2947487474 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc05815f830 con 0x7fc0440039b0 2024-04-25T02:09:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 -- 172.21.15.79:0/2947487474 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc05815ec20 con 0x7fc044004d40 2024-04-25T02:09:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc04ffff640 1 -- 172.21.15.79:0/2947487474 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc04400b9c0 con 0x7fc0580cf7a0 2024-04-25T02:09:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc05d01f640 1 --2- 172.21.15.79:0/2947487474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0440039b0 0x7fc044003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc05c81e640 1 --2- 172.21.15.79:0/2947487474 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0580cf7a0 0x7fc044004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.547+0000 7fc05d820640 1 --2- 172.21.15.79:0/2947487474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc044004d40 0x7fc0440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.548+0000 7fc05d01f640 1 -- 172.21.15.79:0/2947487474 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0580cf7a0 msgr2=0x7fc044004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.548+0000 7fc05d01f640 1 --2- 172.21.15.79:0/2947487474 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0580cf7a0 0x7fc044004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.548+0000 7fc05d01f640 1 -- 172.21.15.79:0/2947487474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc044004d40 msgr2=0x7fc0440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.548+0000 7fc05d01f640 1 --2- 172.21.15.79:0/2947487474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc044004d40 0x7fc0440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.548+0000 7fc05d01f640 1 -- 172.21.15.79:0/2947487474 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc044003520 con 0x7fc0440039b0 2024-04-25T02:09:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.548+0000 7fc05d820640 1 --2- 172.21.15.79:0/2947487474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc044004d40 0x7fc0440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.548+0000 7fc05d01f640 1 --2- 172.21.15.79:0/2947487474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0440039b0 0x7fc044003dd0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc048009ac0 tx=0x7fc044005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7646f5ca843b3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.548+0000 7fc04ffff640 1 -- 172.21.15.79:0/2947487474 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc048036070 con 0x7fc0440039b0 2024-04-25T02:09:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.548+0000 7fc04ffff640 1 -- 172.21.15.79:0/2947487474 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc048031400 con 0x7fc0440039b0 2024-04-25T02:09:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.548+0000 7fc04ffff640 1 -- 172.21.15.79:0/2947487474 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc048009690 con 0x7fc0440039b0 2024-04-25T02:09:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.549+0000 7fc05f283640 1 -- 172.21.15.79:0/2947487474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0440039b0 msgr2=0x7fc044003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.549+0000 7fc05f283640 1 --2- 172.21.15.79:0/2947487474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0440039b0 0x7fc044003dd0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc048009ac0 tx=0x7fc044005830 comp rx=0 tx=0).stop 2024-04-25T02:09:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.549+0000 7fc05d820640 1 -- 172.21.15.79:0/2947487474 reap_dead start 2024-04-25T02:09:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.549+0000 7fc05f283640 1 -- 172.21.15.79:0/2947487474 shutdown_connections 2024-04-25T02:09:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.549+0000 7fc05f283640 1 -- 172.21.15.79:0/2947487474 >> 172.21.15.79:0/2947487474 conn(0x7fc0580b1cd0 msgr2=0x7fc0580b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.549+0000 7fc05f283640 1 -- 172.21.15.79:0/2947487474 shutdown_connections 2024-04-25T02:09:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.549+0000 7fc05f283640 1 -- 172.21.15.79:0/2947487474 wait complete. 2024-04-25T02:09:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.550+0000 7fc05f283640 1 Processor -- start 2024-04-25T02:09:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.550+0000 7fc05f283640 1 -- start start 2024-04-25T02:09:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05f283640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0440039b0 0x7fc05809cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05f283640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc05815b2d0 0x7fc058148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05f283640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc058159a00 0x7fc058159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05f283640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc05806cfe0 con 0x7fc05815b2d0 2024-04-25T02:09:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05f283640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc05815f4c0 con 0x7fc058159a00 2024-04-25T02:09:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05f283640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc05806d160 con 0x7fc0440039b0 2024-04-25T02:09:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05c81e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc05815b2d0 0x7fc058148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05c81e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc05815b2d0 0x7fc058148780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37082/0 (socket says 172.21.15.79:37082) 2024-04-25T02:09:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05c81e640 1 -- 172.21.15.79:0/265246003 learned_addr learned my addr 172.21.15.79:0/265246003 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05c81e640 1 -- 172.21.15.79:0/265246003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0440039b0 msgr2=0x7fc05809cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05c81e640 1 --2- 172.21.15.79:0/265246003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0440039b0 0x7fc05809cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05c81e640 1 -- 172.21.15.79:0/265246003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc058159a00 msgr2=0x7fc058159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05c81e640 1 --2- 172.21.15.79:0/265246003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc058159a00 0x7fc058159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05c81e640 1 -- 172.21.15.79:0/265246003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05815b890 con 0x7fc05815b2d0 2024-04-25T02:09:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05c81e640 1 --2- 172.21.15.79:0/265246003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc05815b2d0 0x7fc058148780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc0540119a0 tx=0x7fc054011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc04dffb640 1 -- 172.21.15.79:0/265246003 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05400fa70 con 0x7fc05815b2d0 2024-04-25T02:09:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc04dffb640 1 -- 172.21.15.79:0/265246003 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05400fc10 con 0x7fc05815b2d0 2024-04-25T02:09:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc04dffb640 1 -- 172.21.15.79:0/265246003 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054014440 con 0x7fc05815b2d0 2024-04-25T02:09:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.551+0000 7fc05f283640 1 -- 172.21.15.79:0/265246003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc05815bb70 con 0x7fc05815b2d0 2024-04-25T02:09:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.552+0000 7fc05f283640 1 -- 172.21.15.79:0/265246003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc05815c130 con 0x7fc05815b2d0 2024-04-25T02:09:14.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.553+0000 7fc05f283640 1 -- 172.21.15.79:0/265246003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0580690a0 con 0x7fc05815b2d0 2024-04-25T02:09:14.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.553+0000 7fc04dffb640 1 -- 172.21.15.79:0/265246003 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc054012040 con 0x7fc05815b2d0 2024-04-25T02:09:14.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.554+0000 7fc04dffb640 1 --2- 172.21.15.79:0/265246003 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc03c06be30 0x7fc03c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.554+0000 7fc04dffb640 1 -- 172.21.15.79:0/265246003 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc05408b4d0 con 0x7fc05815b2d0 2024-04-25T02:09:14.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.554+0000 7fc05d01f640 1 --2- 172.21.15.79:0/265246003 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc03c06be30 0x7fc03c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.554+0000 7fc05d01f640 1 --2- 172.21.15.79:0/265246003 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc03c06be30 0x7fc03c06e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc048033000 tx=0x7fc04802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:14.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.558+0000 7fc04dffb640 1 -- 172.21.15.79:0/265246003 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc054019030 con 0x7fc05815b2d0 2024-04-25T02:09:14.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.729+0000 7fc05f283640 1 -- 172.21.15.79:0/265246003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc0580cf4f0 con 0x7fc05815b2d0 2024-04-25T02:09:14.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.730+0000 7fc04dffb640 1 -- 172.21.15.79:0/265246003 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7fc054089e20 con 0x7fc05815b2d0 2024-04-25T02:09:14.737 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:09:14.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.731+0000 7fc05f283640 1 -- 172.21.15.79:0/265246003 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc03c06be30 msgr2=0x7fc03c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.731+0000 7fc05f283640 1 --2- 172.21.15.79:0/265246003 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc03c06be30 0x7fc03c06e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc048033000 tx=0x7fc04802e000 comp rx=0 tx=0).stop 2024-04-25T02:09:14.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.731+0000 7fc05f283640 1 -- 172.21.15.79:0/265246003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc05815b2d0 msgr2=0x7fc058148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.732+0000 7fc05f283640 1 --2- 172.21.15.79:0/265246003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc05815b2d0 0x7fc058148780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc0540119a0 tx=0x7fc054011e60 comp rx=0 tx=0).stop 2024-04-25T02:09:14.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.732+0000 7fc05f283640 1 -- 172.21.15.79:0/265246003 shutdown_connections 2024-04-25T02:09:14.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.732+0000 7fc05f283640 1 --2- 172.21.15.79:0/265246003 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc03c06be30 0x7fc03c06e2f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.732+0000 7fc05f283640 1 --2- 172.21.15.79:0/265246003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc058159a00 0x7fc058159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.732+0000 7fc05f283640 1 --2- 172.21.15.79:0/265246003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc05815b2d0 0x7fc058148780 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.732+0000 7fc05f283640 1 --2- 172.21.15.79:0/265246003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0440039b0 0x7fc05809cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.732+0000 7fc05f283640 1 -- 172.21.15.79:0/265246003 >> 172.21.15.79:0/265246003 conn(0x7fc0580b1cd0 msgr2=0x7fc0580ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:14.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.732+0000 7fc05f283640 1 -- 172.21.15.79:0/265246003 shutdown_connections 2024-04-25T02:09:14.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.732+0000 7fc05f283640 1 -- 172.21.15.79:0/265246003 wait complete. 2024-04-25T02:09:14.750 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.839+0000 7f10f01c1640 1 Processor -- start 2024-04-25T02:09:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.839+0000 7f10f01c1640 1 -- start start 2024-04-25T02:09:14.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.840+0000 7f10f01c1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10e8143bc0 0x7f10e815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.840+0000 7f10f01c1640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f10e806df50 0x7f10e806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.840+0000 7f10f01c1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10e80b48e0 0x7f10e80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.840+0000 7f10f01c1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f10e806e8f0 con 0x7f10e80b48e0 2024-04-25T02:09:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.840+0000 7f10f01c1640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f10e8072cb0 con 0x7f10e806df50 2024-04-25T02:09:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.840+0000 7f10f01c1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f10e815fa40 con 0x7f10e8143bc0 2024-04-25T02:09:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.840+0000 7f10ee75e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10e80b48e0 0x7f10e80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.840+0000 7f10ee75e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10e80b48e0 0x7f10e80b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37088/0 (socket says 172.21.15.79:37088) 2024-04-25T02:09:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.840+0000 7f10ee75e640 1 -- 172.21.15.79:0/3016093580 learned_addr learned my addr 172.21.15.79:0/3016093580 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.840+0000 7f10ed75c640 1 --2- 172.21.15.79:0/3016093580 >> v2:172.21.15.189:3300/0 conn(0x7f10e806df50 0x7f10e806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.841+0000 7f10ee75e640 1 -- 172.21.15.79:0/3016093580 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10e8143bc0 msgr2=0x7f10e815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.841+0000 7f10edf5d640 1 --2- 172.21.15.79:0/3016093580 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10e8143bc0 0x7f10e815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.841+0000 7f10ee75e640 1 --2- 172.21.15.79:0/3016093580 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10e8143bc0 0x7f10e815f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.841+0000 7f10ee75e640 1 -- 172.21.15.79:0/3016093580 >> v2:172.21.15.189:3300/0 conn(0x7f10e806df50 msgr2=0x7f10e806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.841+0000 7f10ee75e640 1 --2- 172.21.15.79:0/3016093580 >> v2:172.21.15.189:3300/0 conn(0x7f10e806df50 0x7f10e806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.841+0000 7f10ee75e640 1 -- 172.21.15.79:0/3016093580 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e80720a0 con 0x7f10e80b48e0 2024-04-25T02:09:14.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.841+0000 7f10ed75c640 1 --2- 172.21.15.79:0/3016093580 >> v2:172.21.15.189:3300/0 conn(0x7f10e806df50 0x7f10e806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.841+0000 7f10edf5d640 1 --2- 172.21.15.79:0/3016093580 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10e8143bc0 0x7f10e815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.841+0000 7f10ee75e640 1 --2- 172.21.15.79:0/3016093580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e80b48e0 0x7f10e80b4d40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f10e80b2a80 tx=0x7f10e002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f823b60c03cc10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.841+0000 7f10ecf5b640 1 -- 172.21.15.79:0/3016093580 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e0037070 con 0x7f10e80b48e0 2024-04-25T02:09:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.841+0000 7f10ecf5b640 1 -- 172.21.15.79:0/3016093580 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e0032440 con 0x7f10e80b48e0 2024-04-25T02:09:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.841+0000 7f10ecf5b640 1 -- 172.21.15.79:0/3016093580 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e0032810 con 0x7f10e80b48e0 2024-04-25T02:09:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.842+0000 7f10f01c1640 1 -- 172.21.15.79:0/3016093580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e80b48e0 msgr2=0x7f10e80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.842+0000 7f10f01c1640 1 --2- 172.21.15.79:0/3016093580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e80b48e0 0x7f10e80b4d40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f10e80b2a80 tx=0x7f10e002a140 comp rx=0 tx=0).stop 2024-04-25T02:09:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.842+0000 7f10f01c1640 1 -- 172.21.15.79:0/3016093580 shutdown_connections 2024-04-25T02:09:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.842+0000 7f10f01c1640 1 --2- 172.21.15.79:0/3016093580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e80b48e0 0x7f10e80b4d40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.842+0000 7f10f01c1640 1 --2- 172.21.15.79:0/3016093580 >> v2:172.21.15.189:3300/0 conn(0x7f10e806df50 0x7f10e806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.842+0000 7f10f01c1640 1 --2- 172.21.15.79:0/3016093580 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10e8143bc0 0x7f10e815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.842+0000 7f10f01c1640 1 -- 172.21.15.79:0/3016093580 >> 172.21.15.79:0/3016093580 conn(0x7f10e80cfc80 msgr2=0x7f10e80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.842+0000 7f10f01c1640 1 -- 172.21.15.79:0/3016093580 shutdown_connections 2024-04-25T02:09:14.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.842+0000 7f10f01c1640 1 -- 172.21.15.79:0/3016093580 wait complete. 2024-04-25T02:09:14.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.843+0000 7f10f01c1640 1 Processor -- start 2024-04-25T02:09:14.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.843+0000 7f10f01c1640 1 -- start start 2024-04-25T02:09:14.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10f01c1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10e806df50 0x7f10e81642a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10f01c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e80b48e0 0x7f10e8166680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10f01c1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10e8143bc0 0x7f10e8141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10f01c1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f10e8072940 con 0x7f10e80b48e0 2024-04-25T02:09:14.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10f01c1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f10e8072660 con 0x7f10e806df50 2024-04-25T02:09:14.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10f01c1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f10e8143fa0 con 0x7f10e8143bc0 2024-04-25T02:09:14.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10ed75c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e80b48e0 0x7f10e8166680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10ed75c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e80b48e0 0x7f10e8166680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37104/0 (socket says 172.21.15.79:37104) 2024-04-25T02:09:14.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10ed75c640 1 -- 172.21.15.79:0/518464085 learned_addr learned my addr 172.21.15.79:0/518464085 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:14.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10edf5d640 1 --2- 172.21.15.79:0/518464085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10e806df50 0x7f10e81642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10ee75e640 1 --2- 172.21.15.79:0/518464085 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10e8143bc0 0x7f10e8141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10ed75c640 1 -- 172.21.15.79:0/518464085 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10e8143bc0 msgr2=0x7f10e8141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10ed75c640 1 --2- 172.21.15.79:0/518464085 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10e8143bc0 0x7f10e8141ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10ed75c640 1 -- 172.21.15.79:0/518464085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10e806df50 msgr2=0x7f10e81642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10ed75c640 1 --2- 172.21.15.79:0/518464085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10e806df50 0x7f10e81642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10ed75c640 1 -- 172.21.15.79:0/518464085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e8167060 con 0x7f10e80b48e0 2024-04-25T02:09:14.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.844+0000 7f10ed75c640 1 --2- 172.21.15.79:0/518464085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e80b48e0 0x7f10e8166680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c7f0 tx=0x7f10d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:14.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.845+0000 7f10de7fc640 1 -- 172.21.15.79:0/518464085 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8015070 con 0x7f10e80b48e0 2024-04-25T02:09:14.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.845+0000 7f10de7fc640 1 -- 172.21.15.79:0/518464085 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d8007820 con 0x7f10e80b48e0 2024-04-25T02:09:14.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.845+0000 7f10de7fc640 1 -- 172.21.15.79:0/518464085 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8007c10 con 0x7f10e80b48e0 2024-04-25T02:09:14.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.845+0000 7f10f01c1640 1 -- 172.21.15.79:0/518464085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e8167340 con 0x7f10e80b48e0 2024-04-25T02:09:14.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.845+0000 7f10f01c1640 1 -- 172.21.15.79:0/518464085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e8167900 con 0x7f10e80b48e0 2024-04-25T02:09:14.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.846+0000 7f10f01c1640 1 -- 172.21.15.79:0/518464085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e8167510 con 0x7f10e80b48e0 2024-04-25T02:09:14.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.846+0000 7f10de7fc640 1 -- 172.21.15.79:0/518464085 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f10d8018070 con 0x7f10e80b48e0 2024-04-25T02:09:14.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.847+0000 7f10de7fc640 1 --2- 172.21.15.79:0/518464085 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f10cc06be30 0x7f10cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.847+0000 7f10de7fc640 1 -- 172.21.15.79:0/518464085 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f10d808b3f0 con 0x7f10e80b48e0 2024-04-25T02:09:14.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.847+0000 7f10edf5d640 1 --2- 172.21.15.79:0/518464085 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f10cc06be30 0x7f10cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.847+0000 7f10edf5d640 1 --2- 172.21.15.79:0/518464085 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f10cc06be30 0x7f10cc06e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f10e40075b0 tx=0x7f10e4007540 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:14.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:14.851+0000 7f10de7fc640 1 -- 172.21.15.79:0/518464085 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f10d8059da0 con 0x7f10e80b48e0 2024-04-25T02:09:15.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.058+0000 7f10f01c1640 1 -- 172.21.15.79:0/518464085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10e80690a0 con 0x7f10e80b48e0 2024-04-25T02:09:15.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.059+0000 7f10de7fc640 1 -- 172.21.15.79:0/518464085 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+5181 (secure 0 0 0) 0x7f10d80596a0 con 0x7f10e80b48e0 2024-04-25T02:09:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:15.066 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2251520552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2251520552},{"type":"v1","addr":"172.21.15.79:6836","nonce":2251520552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/1462215746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":1462215746},{"type":"v1","addr":"172.21.15.79:6837","nonce":1462215746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/2359417586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2359417586},{"type":"v1","addr":"172.21.15.189:6834","nonce":2359417586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:08:48.219535+0000","modified":"2024-04-25T02:08:50.227642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6835/605900869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":605900869},{"type":"v1","addr":"172.21.15.189:6835","nonce":605900869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5112,"qdb_cluster":[5112]},"id":2}]} 2024-04-25T02:09:15.067 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 12 2024-04-25T02:09:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.061+0000 7f10f01c1640 1 -- 172.21.15.79:0/518464085 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f10cc06be30 msgr2=0x7f10cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.061+0000 7f10f01c1640 1 --2- 172.21.15.79:0/518464085 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f10cc06be30 0x7f10cc06e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f10e40075b0 tx=0x7f10e4007540 comp rx=0 tx=0).stop 2024-04-25T02:09:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.061+0000 7f10f01c1640 1 -- 172.21.15.79:0/518464085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e80b48e0 msgr2=0x7f10e8166680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.061+0000 7f10f01c1640 1 --2- 172.21.15.79:0/518464085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e80b48e0 0x7f10e8166680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c7f0 tx=0x7f10d800ccb0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.061+0000 7f10f01c1640 1 -- 172.21.15.79:0/518464085 shutdown_connections 2024-04-25T02:09:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.061+0000 7f10f01c1640 1 --2- 172.21.15.79:0/518464085 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f10cc06be30 0x7f10cc06e2f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.061+0000 7f10f01c1640 1 --2- 172.21.15.79:0/518464085 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f10e8143bc0 0x7f10e8141ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.061+0000 7f10f01c1640 1 --2- 172.21.15.79:0/518464085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e80b48e0 0x7f10e8166680 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.061+0000 7f10f01c1640 1 --2- 172.21.15.79:0/518464085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10e806df50 0x7f10e81642a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.061+0000 7f10f01c1640 1 -- 172.21.15.79:0/518464085 >> 172.21.15.79:0/518464085 conn(0x7f10e80cfc80 msgr2=0x7f10e8070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.061+0000 7f10f01c1640 1 -- 172.21.15.79:0/518464085 shutdown_connections 2024-04-25T02:09:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.061+0000 7f10f01c1640 1 -- 172.21.15.79:0/518464085 wait complete. 2024-04-25T02:09:15.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:15.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.168+0000 7f40bef61640 1 Processor -- start 2024-04-25T02:09:15.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.168+0000 7f40bef61640 1 -- start start 2024-04-25T02:09:15.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.169+0000 7f40bef61640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40b80b3570 0x7f40b80d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.169+0000 7f40bef61640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40b80b3020 0x7f40b80d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.169+0000 7f40bef61640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40b806c380 con 0x7f40b815e4d0 2024-04-25T02:09:15.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.169+0000 7f40bef61640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f40b80d1660 con 0x7f40b80b3020 2024-04-25T02:09:15.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.169+0000 7f40bef61640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f40b80d1380 con 0x7f40b80b3570 2024-04-25T02:09:15.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.169+0000 7f40bd4fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40b80b3020 0x7f40b80d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.169+0000 7f40bccfd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f40b815e4d0 0x7f40b806bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38606/0 (socket says 172.21.15.79:38606) 2024-04-25T02:09:15.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.169+0000 7f40bccfd640 1 -- 172.21.15.79:0/3185391750 learned_addr learned my addr 172.21.15.79:0/3185391750 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:15.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.169+0000 7f40bd4fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40b80b3020 0x7f40b80d2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37106/0 (socket says 172.21.15.79:37106) 2024-04-25T02:09:15.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.169+0000 7f40b7fff640 1 --2- 172.21.15.79:0/3185391750 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40b80b3570 0x7f40b80d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.170+0000 7f40bd4fe640 1 -- 172.21.15.79:0/3185391750 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40b80b3570 msgr2=0x7f40b80d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:15.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.170+0000 7f40bd4fe640 1 --2- 172.21.15.79:0/3185391750 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40b80b3570 0x7f40b80d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.170+0000 7f40bd4fe640 1 -- 172.21.15.79:0/3185391750 >> v1:172.21.15.79:6789/0 conn(0x7f40b815e4d0 legacy=0x7f40b806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.170+0000 7f40bd4fe640 1 -- 172.21.15.79:0/3185391750 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b80cede0 con 0x7f40b80b3020 2024-04-25T02:09:15.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.170+0000 7f40bd4fe640 1 --2- 172.21.15.79:0/3185391750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b80b3020 0x7f40b80d2c50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009d90 tx=0x7f40b002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2298a7d41e40b50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:15.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.170+0000 7f40b77fe640 1 -- 172.21.15.79:0/3185391750 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0007740 con 0x7f40b80b3020 2024-04-25T02:09:15.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.170+0000 7f40b77fe640 1 -- 172.21.15.79:0/3185391750 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b00078e0 con 0x7f40b80b3020 2024-04-25T02:09:15.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.170+0000 7f40b77fe640 1 -- 172.21.15.79:0/3185391750 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0007cb0 con 0x7f40b80b3020 2024-04-25T02:09:15.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.171+0000 7f40bef61640 1 -- 172.21.15.79:0/3185391750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b80b3020 msgr2=0x7f40b80d2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.171+0000 7f40bef61640 1 --2- 172.21.15.79:0/3185391750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b80b3020 0x7f40b80d2c50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009d90 tx=0x7f40b002a660 comp rx=0 tx=0).stop 2024-04-25T02:09:15.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.171+0000 7f40bef61640 1 -- 172.21.15.79:0/3185391750 shutdown_connections 2024-04-25T02:09:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.171+0000 7f40bef61640 1 --2- 172.21.15.79:0/3185391750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b80b3020 0x7f40b80d2c50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.171+0000 7f40bef61640 1 --2- 172.21.15.79:0/3185391750 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40b80b3570 0x7f40b80d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.171+0000 7f40bef61640 1 -- 172.21.15.79:0/3185391750 >> 172.21.15.79:0/3185391750 conn(0x7f40b809d460 msgr2=0x7f40b80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.171+0000 7f40bef61640 1 -- 172.21.15.79:0/3185391750 shutdown_connections 2024-04-25T02:09:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.171+0000 7f40bef61640 1 -- 172.21.15.79:0/3185391750 wait complete. 2024-04-25T02:09:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.172+0000 7f40bef61640 1 Processor -- start 2024-04-25T02:09:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.172+0000 7f40bef61640 1 -- start start 2024-04-25T02:09:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40bef61640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40b80b3020 0x7f40b815d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40bef61640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40b80b3570 0x7f40b8160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40bef61640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b815e4d0 0x7f40b80cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40bef61640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f40b80d20d0 con 0x7f40b815e4d0 2024-04-25T02:09:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40bef61640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f40b815e8b0 con 0x7f40b80b3570 2024-04-25T02:09:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40bef61640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f40b80d2250 con 0x7f40b80b3020 2024-04-25T02:09:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40bd4fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b815e4d0 0x7f40b80cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40bd4fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b815e4d0 0x7f40b80cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37110/0 (socket says 172.21.15.79:37110) 2024-04-25T02:09:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40bd4fe640 1 -- 172.21.15.79:0/2190642726 learned_addr learned my addr 172.21.15.79:0/2190642726 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40b7fff640 1 --2- 172.21.15.79:0/2190642726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40b80b3570 0x7f40b8160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40bccfd640 1 --2- 172.21.15.79:0/2190642726 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40b80b3020 0x7f40b815d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40bd4fe640 1 -- 172.21.15.79:0/2190642726 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40b80b3020 msgr2=0x7f40b815d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40bd4fe640 1 --2- 172.21.15.79:0/2190642726 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40b80b3020 0x7f40b815d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40bd4fe640 1 -- 172.21.15.79:0/2190642726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40b80b3570 msgr2=0x7f40b8160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40bd4fe640 1 --2- 172.21.15.79:0/2190642726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40b80b3570 0x7f40b8160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.173+0000 7f40bd4fe640 1 -- 172.21.15.79:0/2190642726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b8161350 con 0x7f40b815e4d0 2024-04-25T02:09:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.174+0000 7f40bd4fe640 1 --2- 172.21.15.79:0/2190642726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b815e4d0 0x7f40b80cc9c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f40b002ac50 tx=0x7f40b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.174+0000 7f40b57fa640 1 -- 172.21.15.79:0/2190642726 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0040070 con 0x7f40b815e4d0 2024-04-25T02:09:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.174+0000 7f40b57fa640 1 -- 172.21.15.79:0/2190642726 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b0031c60 con 0x7f40b815e4d0 2024-04-25T02:09:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.174+0000 7f40bef61640 1 -- 172.21.15.79:0/2190642726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b81f76b0 con 0x7f40b815e4d0 2024-04-25T02:09:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.174+0000 7f40b57fa640 1 -- 172.21.15.79:0/2190642726 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b003c660 con 0x7f40b815e4d0 2024-04-25T02:09:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.174+0000 7f40bef61640 1 -- 172.21.15.79:0/2190642726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b81f7c70 con 0x7f40b815e4d0 2024-04-25T02:09:15.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.175+0000 7f40bef61640 1 -- 172.21.15.79:0/2190642726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40b80ce820 con 0x7f40b815e4d0 2024-04-25T02:09:15.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.175+0000 7f40b57fa640 1 -- 172.21.15.79:0/2190642726 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40b0039040 con 0x7f40b815e4d0 2024-04-25T02:09:15.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.175+0000 7f40b57fa640 1 --2- 172.21.15.79:0/2190642726 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40a406be30 0x7f40a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.176+0000 7f40b57fa640 1 -- 172.21.15.79:0/2190642726 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f40b00ac380 con 0x7f40b815e4d0 2024-04-25T02:09:15.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.176+0000 7f40bccfd640 1 --2- 172.21.15.79:0/2190642726 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40a406be30 0x7f40a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.176+0000 7f40bccfd640 1 --2- 172.21.15.79:0/2190642726 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40a406be30 0x7f40a406e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f40a8000f60 tx=0x7f40a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:15.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.180+0000 7f40b57fa640 1 -- 172.21.15.79:0/2190642726 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f40b80ce820 con 0x7f40b815e4d0 2024-04-25T02:09:15.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.355+0000 7f40bef61640 1 -- 172.21.15.79:0/2190642726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40b80690a0 con 0x7f40b815e4d0 2024-04-25T02:09:15.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.356+0000 7f40b57fa640 1 -- 172.21.15.79:0/2190642726 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16681 (secure 0 0 0) 0x7f40b8161350 con 0x7f40b815e4d0 2024-04-25T02:09:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:15.364 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":33,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:49.884423+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:08:46.063839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T02:08:47.254948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:15.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.358+0000 7f40bef61640 1 -- 172.21.15.79:0/2190642726 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40a406be30 msgr2=0x7f40a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.358+0000 7f40bef61640 1 --2- 172.21.15.79:0/2190642726 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40a406be30 0x7f40a406e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f40a8000f60 tx=0x7f40a8009040 comp rx=0 tx=0).stop 2024-04-25T02:09:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.358+0000 7f40bef61640 1 -- 172.21.15.79:0/2190642726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b815e4d0 msgr2=0x7f40b80cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.358+0000 7f40bef61640 1 --2- 172.21.15.79:0/2190642726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b815e4d0 0x7f40b80cc9c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f40b002ac50 tx=0x7f40b0004a40 comp rx=0 tx=0).stop 2024-04-25T02:09:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.358+0000 7f40bef61640 1 -- 172.21.15.79:0/2190642726 shutdown_connections 2024-04-25T02:09:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.358+0000 7f40bef61640 1 --2- 172.21.15.79:0/2190642726 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40a406be30 0x7f40a406e2f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.358+0000 7f40bef61640 1 --2- 172.21.15.79:0/2190642726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b815e4d0 0x7f40b80cc9c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.358+0000 7f40bef61640 1 --2- 172.21.15.79:0/2190642726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40b80b3570 0x7f40b8160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.358+0000 7f40bef61640 1 --2- 172.21.15.79:0/2190642726 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40b80b3020 0x7f40b815d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.358+0000 7f40bef61640 1 -- 172.21.15.79:0/2190642726 >> 172.21.15.79:0/2190642726 conn(0x7f40b809d460 msgr2=0x7f40b80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.358+0000 7f40bef61640 1 -- 172.21.15.79:0/2190642726 shutdown_connections 2024-04-25T02:09:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.358+0000 7f40bef61640 1 -- 172.21.15.79:0/2190642726 wait complete. 2024-04-25T02:09:15.376 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:09:15.376 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:15.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.466+0000 7f7d47fee640 1 Processor -- start 2024-04-25T02:09:15.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.466+0000 7f7d47fee640 1 -- start start 2024-04-25T02:09:15.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.467+0000 7f7d47fee640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7d4015e4d0 0x7f7d4006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.467+0000 7f7d47fee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7d400d2e20 0x7f7d400cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.467+0000 7f7d47fee640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d400d1660 con 0x7f7d400b3570 2024-04-25T02:09:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.467+0000 7f7d47fee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7d400d1380 con 0x7f7d400d2e20 2024-04-25T02:09:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.467+0000 7f7d47fee640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f7d400cede0 con 0x7f7d4015e4d0 2024-04-25T02:09:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.467+0000 7f7d4658b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7d400d2e20 0x7f7d400cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.467+0000 7f7d4658b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7d400d2e20 0x7f7d400cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37114/0 (socket says 172.21.15.79:37114) 2024-04-25T02:09:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.467+0000 7f7d4658b640 1 -- 172.21.15.79:0/388814264 learned_addr learned my addr 172.21.15.79:0/388814264 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.467+0000 7f7d4658b640 1 -- 172.21.15.79:0/388814264 >> v2:172.21.15.189:3300/0 conn(0x7f7d4015e4d0 msgr2=0x7f7d4006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.467+0000 7f7d45d8a640 1 --2- 172.21.15.79:0/388814264 >> v2:172.21.15.189:3300/0 conn(0x7f7d4015e4d0 0x7f7d4006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.467+0000 7f7d4658b640 1 --2- 172.21.15.79:0/388814264 >> v2:172.21.15.189:3300/0 conn(0x7f7d4015e4d0 0x7f7d4006bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.467+0000 7f7d4658b640 1 -- 172.21.15.79:0/388814264 >> v1:172.21.15.189:6789/0 conn(0x7f7d400b3570 legacy=0x7f7d400d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.467+0000 7f7d4658b640 1 -- 172.21.15.79:0/388814264 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d400cf0c0 con 0x7f7d400d2e20 2024-04-25T02:09:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.467+0000 7f7d45d8a640 1 --2- 172.21.15.79:0/388814264 >> v2:172.21.15.189:3300/0 conn(0x7f7d4015e4d0 0x7f7d4006bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.468+0000 7f7d4658b640 1 --2- 172.21.15.79:0/388814264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d400d2e20 0x7f7d400cf5e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009e50 tx=0x7f7d3802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdeff0274f4305a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.468+0000 7f7d44d88640 1 -- 172.21.15.79:0/388814264 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d38036070 con 0x7f7d400d2e20 2024-04-25T02:09:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.468+0000 7f7d44d88640 1 -- 172.21.15.79:0/388814264 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d38031600 con 0x7f7d400d2e20 2024-04-25T02:09:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.468+0000 7f7d44d88640 1 -- 172.21.15.79:0/388814264 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d380319d0 con 0x7f7d400d2e20 2024-04-25T02:09:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.468+0000 7f7d47fee640 1 -- 172.21.15.79:0/388814264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d400d2e20 msgr2=0x7f7d400cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.468+0000 7f7d47fee640 1 --2- 172.21.15.79:0/388814264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d400d2e20 0x7f7d400cf5e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009e50 tx=0x7f7d3802a710 comp rx=0 tx=0).stop 2024-04-25T02:09:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.469+0000 7f7d47fee640 1 -- 172.21.15.79:0/388814264 shutdown_connections 2024-04-25T02:09:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.469+0000 7f7d47fee640 1 --2- 172.21.15.79:0/388814264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d400d2e20 0x7f7d400cf5e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.469+0000 7f7d47fee640 1 --2- 172.21.15.79:0/388814264 >> v2:172.21.15.189:3300/0 conn(0x7f7d4015e4d0 0x7f7d4006bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.469+0000 7f7d47fee640 1 -- 172.21.15.79:0/388814264 >> 172.21.15.79:0/388814264 conn(0x7f7d4009d460 msgr2=0x7f7d400d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.469+0000 7f7d47fee640 1 -- 172.21.15.79:0/388814264 shutdown_connections 2024-04-25T02:09:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.469+0000 7f7d47fee640 1 -- 172.21.15.79:0/388814264 wait complete. 2024-04-25T02:09:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.470+0000 7f7d47fee640 1 Processor -- start 2024-04-25T02:09:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.470+0000 7f7d47fee640 1 -- start start 2024-04-25T02:09:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.470+0000 7f7d47fee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7d400b3570 0x7f7d401581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.470+0000 7f7d47fee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d400d2e20 0x7f7d401f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.470+0000 7f7d47fee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4015e4d0 0x7f7d400b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.470+0000 7f7d47fee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7d400d2250 con 0x7f7d4015e4d0 2024-04-25T02:09:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.470+0000 7f7d47fee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7d400d20d0 con 0x7f7d400d2e20 2024-04-25T02:09:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.470+0000 7f7d47fee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7d4006c1b0 con 0x7f7d400b3570 2024-04-25T02:09:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d4658b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4015e4d0 0x7f7d400b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d4658b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4015e4d0 0x7f7d400b8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37126/0 (socket says 172.21.15.79:37126) 2024-04-25T02:09:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d4658b640 1 -- 172.21.15.79:0/3581340203 learned_addr learned my addr 172.21.15.79:0/3581340203 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d45d8a640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7d400b3570 0x7f7d401581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d45589640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d400d2e20 0x7f7d401f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d4658b640 1 -- 172.21.15.79:0/3581340203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7d400b3570 msgr2=0x7f7d401581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d4658b640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7d400b3570 0x7f7d401581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d4658b640 1 -- 172.21.15.79:0/3581340203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d400d2e20 msgr2=0x7f7d401f8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d4658b640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d400d2e20 0x7f7d401f8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d4658b640 1 -- 172.21.15.79:0/3581340203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d400b8c20 con 0x7f7d4015e4d0 2024-04-25T02:09:15.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d45589640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d400d2e20 0x7f7d401f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:15.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d45d8a640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7d400b3570 0x7f7d401581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:15.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d4658b640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4015e4d0 0x7f7d400b8fa0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009f70 tx=0x7f7d38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:15.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d367fc640 1 -- 172.21.15.79:0/3581340203 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d38036050 con 0x7f7d4015e4d0 2024-04-25T02:09:15.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d367fc640 1 -- 172.21.15.79:0/3581340203 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d38042070 con 0x7f7d4015e4d0 2024-04-25T02:09:15.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d47fee640 1 -- 172.21.15.79:0/3581340203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d401f8950 con 0x7f7d4015e4d0 2024-04-25T02:09:15.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d367fc640 1 -- 172.21.15.79:0/3581340203 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d38009510 con 0x7f7d4015e4d0 2024-04-25T02:09:15.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.471+0000 7f7d47fee640 1 -- 172.21.15.79:0/3581340203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d400b5680 con 0x7f7d4015e4d0 2024-04-25T02:09:15.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.472+0000 7f7d47fee640 1 -- 172.21.15.79:0/3581340203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d400690a0 con 0x7f7d4015e4d0 2024-04-25T02:09:15.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.473+0000 7f7d367fc640 1 -- 172.21.15.79:0/3581340203 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d38007bd0 con 0x7f7d4015e4d0 2024-04-25T02:09:15.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.473+0000 7f7d367fc640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7d2406be30 0x7f7d2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.473+0000 7f7d367fc640 1 -- 172.21.15.79:0/3581340203 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f7d380abd90 con 0x7f7d4015e4d0 2024-04-25T02:09:15.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.473+0000 7f7d45d8a640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7d2406be30 0x7f7d2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.473+0000 7f7d45d8a640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7d2406be30 0x7f7d2406e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c006fd0 tx=0x7f7d3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:15.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.477+0000 7f7d367fc640 1 -- 172.21.15.79:0/3581340203 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7d401f8950 con 0x7f7d4015e4d0 2024-04-25T02:09:15.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.685+0000 7f7d47fee640 1 -- 172.21.15.79:0/3581340203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d400d2b00 con 0x7f7d4015e4d0 2024-04-25T02:09:15.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.685+0000 7f7d367fc640 1 -- 172.21.15.79:0/3581340203 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+5181 (secure 0 0 0) 0x7f7d38045360 con 0x7f7d4015e4d0 2024-04-25T02:09:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:15.693 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2251520552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2251520552},{"type":"v1","addr":"172.21.15.79:6836","nonce":2251520552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/1462215746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":1462215746},{"type":"v1","addr":"172.21.15.79:6837","nonce":1462215746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/2359417586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2359417586},{"type":"v1","addr":"172.21.15.189:6834","nonce":2359417586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:08:48.219535+0000","modified":"2024-04-25T02:08:50.227642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6835/605900869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":605900869},{"type":"v1","addr":"172.21.15.189:6835","nonce":605900869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5112,"qdb_cluster":[5112]},"id":2}]} 2024-04-25T02:09:15.693 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 12 2024-04-25T02:09:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.687+0000 7f7d47fee640 1 -- 172.21.15.79:0/3581340203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7d2406be30 msgr2=0x7f7d2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.687+0000 7f7d47fee640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7d2406be30 0x7f7d2406e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c006fd0 tx=0x7f7d3c008040 comp rx=0 tx=0).stop 2024-04-25T02:09:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.687+0000 7f7d47fee640 1 -- 172.21.15.79:0/3581340203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4015e4d0 msgr2=0x7f7d400b8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.687+0000 7f7d47fee640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4015e4d0 0x7f7d400b8fa0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009f70 tx=0x7f7d38004a40 comp rx=0 tx=0).stop 2024-04-25T02:09:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.687+0000 7f7d47fee640 1 -- 172.21.15.79:0/3581340203 shutdown_connections 2024-04-25T02:09:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.687+0000 7f7d47fee640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7d2406be30 0x7f7d2406e2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.687+0000 7f7d47fee640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4015e4d0 0x7f7d400b8fa0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.687+0000 7f7d47fee640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d400d2e20 0x7f7d401f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.687+0000 7f7d47fee640 1 --2- 172.21.15.79:0/3581340203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7d400b3570 0x7f7d401581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.687+0000 7f7d47fee640 1 -- 172.21.15.79:0/3581340203 >> 172.21.15.79:0/3581340203 conn(0x7f7d4009d460 msgr2=0x7f7d400b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.687+0000 7f7d47fee640 1 -- 172.21.15.79:0/3581340203 shutdown_connections 2024-04-25T02:09:15.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.687+0000 7f7d47fee640 1 -- 172.21.15.79:0/3581340203 wait complete. 2024-04-25T02:09:15.705 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:15.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.794+0000 7f8fccedf640 1 Processor -- start 2024-04-25T02:09:15.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.794+0000 7f8fccedf640 1 -- start start 2024-04-25T02:09:15.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.795+0000 7f8fccedf640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fc815e4d0 0x7f8fc806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.795+0000 7f8fccedf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8fc80d2e20 0x7f8fc80cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.795+0000 7f8fccedf640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fc80d1660 con 0x7f8fc80b3570 2024-04-25T02:09:15.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.795+0000 7f8fccedf640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8fc80d1380 con 0x7f8fc80d2e20 2024-04-25T02:09:15.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.795+0000 7f8fccedf640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8fc80cede0 con 0x7f8fc815e4d0 2024-04-25T02:09:15.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.796+0000 7f8fc6d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8fc80d2e20 0x7f8fc80cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.796+0000 7f8fc6d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8fc80d2e20 0x7f8fc80cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37140/0 (socket says 172.21.15.79:37140) 2024-04-25T02:09:15.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.796+0000 7f8fc6d9d640 1 -- 172.21.15.79:0/3533171115 learned_addr learned my addr 172.21.15.79:0/3533171115 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:15.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.796+0000 7f8fc659c640 1 --2- 172.21.15.79:0/3533171115 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fc815e4d0 0x7f8fc806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.796+0000 7f8fc6d9d640 1 -- 172.21.15.79:0/3533171115 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fc815e4d0 msgr2=0x7f8fc806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:15.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.796+0000 7f8fc6d9d640 1 --2- 172.21.15.79:0/3533171115 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fc815e4d0 0x7f8fc806bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.796+0000 7f8fc6d9d640 1 -- 172.21.15.79:0/3533171115 >> v1:172.21.15.79:6789/0 conn(0x7f8fc80b3570 legacy=0x7f8fc80d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.796+0000 7f8fc6d9d640 1 -- 172.21.15.79:0/3533171115 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc80cf0c0 con 0x7f8fc80d2e20 2024-04-25T02:09:15.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.796+0000 7f8fc559a640 1 -- 172.21.15.79:0/3533171115 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567251385 0 0) 0x7f8fc80d1660 con 0x7f8fc80b3570 2024-04-25T02:09:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.797+0000 7f8fc6d9d640 1 --2- 172.21.15.79:0/3533171115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc80d2e20 0x7f8fc80cf5e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009870 tx=0x7f8fb802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3cc00abfd896a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.797+0000 7f8fc559a640 1 -- 172.21.15.79:0/3533171115 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8037070 con 0x7f8fc80d2e20 2024-04-25T02:09:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.797+0000 7f8fc559a640 1 -- 172.21.15.79:0/3533171115 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb8032440 con 0x7f8fc80d2e20 2024-04-25T02:09:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.797+0000 7f8fc559a640 1 -- 172.21.15.79:0/3533171115 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8032810 con 0x7f8fc80d2e20 2024-04-25T02:09:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.797+0000 7f8fccedf640 1 -- 172.21.15.79:0/3533171115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc80d2e20 msgr2=0x7f8fc80cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.797+0000 7f8fccedf640 1 --2- 172.21.15.79:0/3533171115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc80d2e20 0x7f8fc80cf5e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009870 tx=0x7f8fb802a270 comp rx=0 tx=0).stop 2024-04-25T02:09:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.797+0000 7f8fccedf640 1 -- 172.21.15.79:0/3533171115 shutdown_connections 2024-04-25T02:09:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.797+0000 7f8fccedf640 1 --2- 172.21.15.79:0/3533171115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc80d2e20 0x7f8fc80cf5e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.797+0000 7f8fccedf640 1 --2- 172.21.15.79:0/3533171115 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fc815e4d0 0x7f8fc806bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.797+0000 7f8fccedf640 1 -- 172.21.15.79:0/3533171115 >> 172.21.15.79:0/3533171115 conn(0x7f8fc809d460 msgr2=0x7f8fc80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.797+0000 7f8fccedf640 1 -- 172.21.15.79:0/3533171115 shutdown_connections 2024-04-25T02:09:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.797+0000 7f8fccedf640 1 -- 172.21.15.79:0/3533171115 wait complete. 2024-04-25T02:09:15.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.799+0000 7f8fccedf640 1 Processor -- start 2024-04-25T02:09:15.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.799+0000 7f8fccedf640 1 -- start start 2024-04-25T02:09:15.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.799+0000 7f8fccedf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fc80b3570 0x7f8fc8162030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.799+0000 7f8fccedf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc80d2e20 0x7f8fc815ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.799+0000 7f8fccedf640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fc815e4d0 0x7f8fc815b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.799+0000 7f8fccedf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc80d2250 con 0x7f8fc80d2e20 2024-04-25T02:09:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.799+0000 7f8fccedf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc80d20d0 con 0x7f8fc80b3570 2024-04-25T02:09:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.799+0000 7f8fccedf640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8fc806c1b0 con 0x7f8fc815e4d0 2024-04-25T02:09:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.799+0000 7f8fc5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc80d2e20 0x7f8fc815ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.799+0000 7f8fc5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc80d2e20 0x7f8fc815ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37146/0 (socket says 172.21.15.79:37146) 2024-04-25T02:09:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.799+0000 7f8fc5d9b640 1 -- 172.21.15.79:0/3120173114 learned_addr learned my addr 172.21.15.79:0/3120173114 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.800+0000 7f8fc6d9d640 1 --2- 172.21.15.79:0/3120173114 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fc815e4d0 0x7f8fc815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.800+0000 7f8fc659c640 1 --2- 172.21.15.79:0/3120173114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fc80b3570 0x7f8fc8162030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.800+0000 7f8fc5d9b640 1 -- 172.21.15.79:0/3120173114 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fc815e4d0 msgr2=0x7f8fc815b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.800+0000 7f8fc5d9b640 1 --2- 172.21.15.79:0/3120173114 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fc815e4d0 0x7f8fc815b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.800+0000 7f8fc5d9b640 1 -- 172.21.15.79:0/3120173114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fc80b3570 msgr2=0x7f8fc8162030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.800+0000 7f8fc5d9b640 1 --2- 172.21.15.79:0/3120173114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fc80b3570 0x7f8fc8162030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.800+0000 7f8fc5d9b640 1 -- 172.21.15.79:0/3120173114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc80ca4e0 con 0x7f8fc80d2e20 2024-04-25T02:09:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.800+0000 7f8fc5d9b640 1 --2- 172.21.15.79:0/3120173114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc80d2e20 0x7f8fc815ac10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00c890 tx=0x7f8fbc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.800+0000 7f8fb6ffd640 1 -- 172.21.15.79:0/3120173114 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc017070 con 0x7f8fc80d2e20 2024-04-25T02:09:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.800+0000 7f8fb6ffd640 1 -- 172.21.15.79:0/3120173114 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fbc003dc0 con 0x7f8fc80d2e20 2024-04-25T02:09:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.800+0000 7f8fccedf640 1 -- 172.21.15.79:0/3120173114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc80ca7c0 con 0x7f8fc80d2e20 2024-04-25T02:09:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.800+0000 7f8fb6ffd640 1 -- 172.21.15.79:0/3120173114 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc0052b0 con 0x7f8fc80d2e20 2024-04-25T02:09:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.800+0000 7f8fccedf640 1 -- 172.21.15.79:0/3120173114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc80c7a90 con 0x7f8fc80d2e20 2024-04-25T02:09:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.801+0000 7f8fccedf640 1 -- 172.21.15.79:0/3120173114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc80690a0 con 0x7f8fc80d2e20 2024-04-25T02:09:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.801+0000 7f8fb6ffd640 1 -- 172.21.15.79:0/3120173114 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8fbc01a070 con 0x7f8fc80d2e20 2024-04-25T02:09:15.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.802+0000 7f8fb6ffd640 1 --2- 172.21.15.79:0/3120173114 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8fa806be60 0x7f8fa806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:15.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.802+0000 7f8fc659c640 1 --2- 172.21.15.79:0/3120173114 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8fa806be60 0x7f8fa806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:15.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.802+0000 7f8fb6ffd640 1 -- 172.21.15.79:0/3120173114 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8fbc08a560 con 0x7f8fc80d2e20 2024-04-25T02:09:15.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.802+0000 7f8fc659c640 1 --2- 172.21.15.79:0/3120173114 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8fa806be60 0x7f8fa806e320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0006fd0 tx=0x7f8fc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:15.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:15.806+0000 7f8fb6ffd640 1 -- 172.21.15.79:0/3120173114 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8fbc058f10 con 0x7f8fc80d2e20 2024-04-25T02:09:16.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.019+0000 7f8fccedf640 1 -- 172.21.15.79:0/3120173114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8fc80d1920 con 0x7f8fc80d2e20 2024-04-25T02:09:16.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.019+0000 7f8fb6ffd640 1 -- 172.21.15.79:0/3120173114 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+5181 (secure 0 0 0) 0x7f8fbc058810 con 0x7f8fc80d2e20 2024-04-25T02:09:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:16.027 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2251520552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2251520552},{"type":"v1","addr":"172.21.15.79:6836","nonce":2251520552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/1462215746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":1462215746},{"type":"v1","addr":"172.21.15.79:6837","nonce":1462215746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/2359417586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2359417586},{"type":"v1","addr":"172.21.15.189:6834","nonce":2359417586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:08:48.219535+0000","modified":"2024-04-25T02:08:50.227642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6835/605900869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":605900869},{"type":"v1","addr":"172.21.15.189:6835","nonce":605900869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5112,"qdb_cluster":[5112]},"id":2}]} 2024-04-25T02:09:16.027 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 12 2024-04-25T02:09:16.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.021+0000 7f8fccedf640 1 -- 172.21.15.79:0/3120173114 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8fa806be60 msgr2=0x7f8fa806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.021+0000 7f8fccedf640 1 --2- 172.21.15.79:0/3120173114 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8fa806be60 0x7f8fa806e320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0006fd0 tx=0x7f8fc0008040 comp rx=0 tx=0).stop 2024-04-25T02:09:16.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.021+0000 7f8fccedf640 1 -- 172.21.15.79:0/3120173114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc80d2e20 msgr2=0x7f8fc815ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.021+0000 7f8fccedf640 1 --2- 172.21.15.79:0/3120173114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc80d2e20 0x7f8fc815ac10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00c890 tx=0x7f8fbc00cd50 comp rx=0 tx=0).stop 2024-04-25T02:09:16.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.021+0000 7f8fccedf640 1 -- 172.21.15.79:0/3120173114 shutdown_connections 2024-04-25T02:09:16.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.021+0000 7f8fccedf640 1 --2- 172.21.15.79:0/3120173114 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8fa806be60 0x7f8fa806e320 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.021+0000 7f8fccedf640 1 --2- 172.21.15.79:0/3120173114 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fc815e4d0 0x7f8fc815b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.021+0000 7f8fccedf640 1 --2- 172.21.15.79:0/3120173114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc80d2e20 0x7f8fc815ac10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.021+0000 7f8fccedf640 1 --2- 172.21.15.79:0/3120173114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fc80b3570 0x7f8fc8162030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.021+0000 7f8fccedf640 1 -- 172.21.15.79:0/3120173114 >> 172.21.15.79:0/3120173114 conn(0x7f8fc809d460 msgr2=0x7f8fc80b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:16.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.021+0000 7f8fccedf640 1 -- 172.21.15.79:0/3120173114 shutdown_connections 2024-04-25T02:09:16.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.021+0000 7f8fccedf640 1 -- 172.21.15.79:0/3120173114 wait complete. 2024-04-25T02:09:16.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:16.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.128+0000 7fb07951b640 1 Processor -- start 2024-04-25T02:09:16.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.128+0000 7fb07951b640 1 -- start start 2024-04-25T02:09:16.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.129+0000 7fb07951b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb074161b90 0x7fb0740d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.129+0000 7fb07951b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0740d0a60 0x7fb0740d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.129+0000 7fb07951b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0740ceed0 con 0x7fb0740d47e0 2024-04-25T02:09:16.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.129+0000 7fb07951b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb0740d1410 con 0x7fb074161b90 2024-04-25T02:09:16.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.129+0000 7fb07951b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb0740ceca0 con 0x7fb0740d0a60 2024-04-25T02:09:16.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.129+0000 7fb072ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb074161b90 0x7fb0740d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:16.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.129+0000 7fb072ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb074161b90 0x7fb0740d2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37150/0 (socket says 172.21.15.79:37150) 2024-04-25T02:09:16.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.129+0000 7fb072ffd640 1 -- 172.21.15.79:0/2932022217 learned_addr learned my addr 172.21.15.79:0/2932022217 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:16.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.129+0000 7fb0737fe640 1 --2- 172.21.15.79:0/2932022217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0740d0a60 0x7fb0740d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:16.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.129+0000 7fb072ffd640 1 -- 172.21.15.79:0/2932022217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0740d0a60 msgr2=0x7fb0740d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:16.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.129+0000 7fb072ffd640 1 --2- 172.21.15.79:0/2932022217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0740d0a60 0x7fb0740d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.129+0000 7fb072ffd640 1 -- 172.21.15.79:0/2932022217 >> v1:172.21.15.189:6789/0 conn(0x7fb0740d47e0 legacy=0x7fb0740cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.129+0000 7fb072ffd640 1 -- 172.21.15.79:0/2932022217 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0740cf1b0 con 0x7fb074161b90 2024-04-25T02:09:16.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.130+0000 7fb072ffd640 1 --2- 172.21.15.79:0/2932022217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb074161b90 0x7fb0740d2da0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb064009870 tx=0x7fb06402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5bf3f5f46e2726 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:16.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.130+0000 7fb0727fc640 1 -- 172.21.15.79:0/2932022217 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064037070 con 0x7fb074161b90 2024-04-25T02:09:16.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.130+0000 7fb0727fc640 1 -- 172.21.15.79:0/2932022217 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb064032440 con 0x7fb074161b90 2024-04-25T02:09:16.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.130+0000 7fb0727fc640 1 -- 172.21.15.79:0/2932022217 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064032810 con 0x7fb074161b90 2024-04-25T02:09:16.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.131+0000 7fb07951b640 1 -- 172.21.15.79:0/2932022217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb074161b90 msgr2=0x7fb0740d2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.131+0000 7fb07951b640 1 --2- 172.21.15.79:0/2932022217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb074161b90 0x7fb0740d2da0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb064009870 tx=0x7fb06402a270 comp rx=0 tx=0).stop 2024-04-25T02:09:16.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.131+0000 7fb07951b640 1 -- 172.21.15.79:0/2932022217 shutdown_connections 2024-04-25T02:09:16.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.131+0000 7fb07951b640 1 --2- 172.21.15.79:0/2932022217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0740d0a60 0x7fb0740d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.131+0000 7fb07951b640 1 --2- 172.21.15.79:0/2932022217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb074161b90 0x7fb0740d2da0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.131+0000 7fb07951b640 1 -- 172.21.15.79:0/2932022217 >> 172.21.15.79:0/2932022217 conn(0x7fb07409d460 msgr2=0x7fb0740d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:16.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.131+0000 7fb07951b640 1 -- 172.21.15.79:0/2932022217 shutdown_connections 2024-04-25T02:09:16.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.131+0000 7fb07951b640 1 -- 172.21.15.79:0/2932022217 wait complete. 2024-04-25T02:09:16.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.132+0000 7fb07951b640 1 Processor -- start 2024-04-25T02:09:16.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.132+0000 7fb07951b640 1 -- start start 2024-04-25T02:09:16.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.132+0000 7fb07951b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0740d0a60 0x7fb07415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.132+0000 7fb07951b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0740d47e0 0x7fb0740cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.132+0000 7fb07951b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb074161b90 0x7fb0740cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.132+0000 7fb07951b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb0740cf770 con 0x7fb0740d0a60 2024-04-25T02:09:16.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.132+0000 7fb07951b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb0740d4f80 con 0x7fb074161b90 2024-04-25T02:09:16.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.132+0000 7fb07951b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb0740d4c70 con 0x7fb0740d47e0 2024-04-25T02:09:16.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb072ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0740d0a60 0x7fb07415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:16.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb072ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0740d0a60 0x7fb07415cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37158/0 (socket says 172.21.15.79:37158) 2024-04-25T02:09:16.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb072ffd640 1 -- 172.21.15.79:0/1963740776 learned_addr learned my addr 172.21.15.79:0/1963740776 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:16.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb0737fe640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb074161b90 0x7fb0740cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:16.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb072ffd640 1 -- 172.21.15.79:0/1963740776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0740d47e0 msgr2=0x7fb0740cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb06bfff640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0740d47e0 0x7fb0740cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:16.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb072ffd640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0740d47e0 0x7fb0740cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb072ffd640 1 -- 172.21.15.79:0/1963740776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb074161b90 msgr2=0x7fb0740cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb072ffd640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb074161b90 0x7fb0740cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb072ffd640 1 -- 172.21.15.79:0/1963740776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0740b8020 con 0x7fb0740d0a60 2024-04-25T02:09:16.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb0737fe640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb074161b90 0x7fb0740cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:16.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb06bfff640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0740d47e0 0x7fb0740cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:16.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb072ffd640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0740d0a60 0x7fb07415cad0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb064000c00 tx=0x7fb0640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:16.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb06b7fe640 1 -- 172.21.15.79:0/1963740776 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064037040 con 0x7fb0740d0a60 2024-04-25T02:09:16.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb06b7fe640 1 -- 172.21.15.79:0/1963740776 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb064042070 con 0x7fb0740d0a60 2024-04-25T02:09:16.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb07951b640 1 -- 172.21.15.79:0/1963740776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0740b8300 con 0x7fb0740d0a60 2024-04-25T02:09:16.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb06b7fe640 1 -- 172.21.15.79:0/1963740776 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064030880 con 0x7fb0740d0a60 2024-04-25T02:09:16.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.133+0000 7fb07951b640 1 -- 172.21.15.79:0/1963740776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0740b88c0 con 0x7fb0740d0a60 2024-04-25T02:09:16.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.134+0000 7fb07951b640 1 -- 172.21.15.79:0/1963740776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb07415df70 con 0x7fb0740d0a60 2024-04-25T02:09:16.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.135+0000 7fb06b7fe640 1 -- 172.21.15.79:0/1963740776 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb064030a20 con 0x7fb0740d0a60 2024-04-25T02:09:16.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.135+0000 7fb06b7fe640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb05406be30 0x7fb05406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.135+0000 7fb06b7fe640 1 -- 172.21.15.79:0/1963740776 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb0640ab690 con 0x7fb0740d0a60 2024-04-25T02:09:16.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.135+0000 7fb06bfff640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb05406be30 0x7fb05406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:16.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.135+0000 7fb06bfff640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb05406be30 0x7fb05406e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb0740b9ab0 tx=0x7fb05c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:16.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.139+0000 7fb06b7fe640 1 -- 172.21.15.79:0/1963740776 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb064045360 con 0x7fb0740d0a60 2024-04-25T02:09:16.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.315+0000 7fb07951b640 1 -- 172.21.15.79:0/1963740776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0740690a0 con 0x7fb0740d0a60 2024-04-25T02:09:16.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.316+0000 7fb06b7fe640 1 -- 172.21.15.79:0/1963740776 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16681 (secure 0 0 0) 0x7fb06407a0d0 con 0x7fb0740d0a60 2024-04-25T02:09:16.324 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:16.324 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":33,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:08:49.884423+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:08:46.063839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T02:08:47.254948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:16.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.319+0000 7fb07951b640 1 -- 172.21.15.79:0/1963740776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb05406be30 msgr2=0x7fb05406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.319+0000 7fb07951b640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb05406be30 0x7fb05406e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb0740b9ab0 tx=0x7fb05c009040 comp rx=0 tx=0).stop 2024-04-25T02:09:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.319+0000 7fb07951b640 1 -- 172.21.15.79:0/1963740776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0740d0a60 msgr2=0x7fb07415cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.319+0000 7fb07951b640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0740d0a60 0x7fb07415cad0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb064000c00 tx=0x7fb0640046c0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.319+0000 7fb07951b640 1 -- 172.21.15.79:0/1963740776 shutdown_connections 2024-04-25T02:09:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.319+0000 7fb07951b640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb05406be30 0x7fb05406e2f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.319+0000 7fb07951b640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb074161b90 0x7fb0740cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.319+0000 7fb07951b640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0740d47e0 0x7fb0740cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.319+0000 7fb07951b640 1 --2- 172.21.15.79:0/1963740776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0740d0a60 0x7fb07415cad0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.319+0000 7fb07951b640 1 -- 172.21.15.79:0/1963740776 >> 172.21.15.79:0/1963740776 conn(0x7fb07409d460 msgr2=0x7fb0740b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.319+0000 7fb07951b640 1 -- 172.21.15.79:0/1963740776 shutdown_connections 2024-04-25T02:09:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.319+0000 7fb07951b640 1 -- 172.21.15.79:0/1963740776 wait complete. 2024-04-25T02:09:16.337 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:09:16.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.427+0000 7f569a09e640 1 Processor -- start 2024-04-25T02:09:16.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.427+0000 7f569a09e640 1 -- start start 2024-04-25T02:09:16.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.427+0000 7f569a09e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f569415e4d0 0x7f569406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.427+0000 7f569a09e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56940b3570 0x7f56940d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.427+0000 7f569a09e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56940d1660 con 0x7f56940b3020 2024-04-25T02:09:16.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.428+0000 7f569a09e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f56940d1380 con 0x7f569415e4d0 2024-04-25T02:09:16.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.428+0000 7f569a09e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f56940cede0 con 0x7f56940b3570 2024-04-25T02:09:16.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.428+0000 7f56937fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f569415e4d0 0x7f569406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:16.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.428+0000 7f56937fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f569415e4d0 0x7f569406bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37160/0 (socket says 172.21.15.79:37160) 2024-04-25T02:09:16.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.428+0000 7f56937fe640 1 -- 172.21.15.79:0/3111121197 learned_addr learned my addr 172.21.15.79:0/3111121197 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:16.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.428+0000 7f56937fe640 1 -- 172.21.15.79:0/3111121197 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56940b3570 msgr2=0x7f56940d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:16.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.428+0000 7f56937fe640 1 --2- 172.21.15.79:0/3111121197 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56940b3570 0x7f56940d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.428+0000 7f56937fe640 1 -- 172.21.15.79:0/3111121197 >> v1:172.21.15.189:6789/0 conn(0x7f56940b3020 legacy=0x7f56940cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:16.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.428+0000 7f56937fe640 1 -- 172.21.15.79:0/3111121197 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56940cf0c0 con 0x7f569415e4d0 2024-04-25T02:09:16.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.429+0000 7f56937fe640 1 --2- 172.21.15.79:0/3111121197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f569415e4d0 0x7f569406bc70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5684009870 tx=0x7f568402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3304aeaa24efffd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:16.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.429+0000 7f56927fc640 1 -- 172.21.15.79:0/3111121197 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684037070 con 0x7f569415e4d0 2024-04-25T02:09:16.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.429+0000 7f56927fc640 1 -- 172.21.15.79:0/3111121197 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5684032440 con 0x7f569415e4d0 2024-04-25T02:09:16.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.429+0000 7f56927fc640 1 -- 172.21.15.79:0/3111121197 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684032810 con 0x7f569415e4d0 2024-04-25T02:09:16.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.429+0000 7f569a09e640 1 -- 172.21.15.79:0/3111121197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f569415e4d0 msgr2=0x7f569406bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.429+0000 7f569a09e640 1 --2- 172.21.15.79:0/3111121197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f569415e4d0 0x7f569406bc70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5684009870 tx=0x7f568402a210 comp rx=0 tx=0).stop 2024-04-25T02:09:16.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.429+0000 7f569a09e640 1 -- 172.21.15.79:0/3111121197 shutdown_connections 2024-04-25T02:09:16.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.429+0000 7f569a09e640 1 --2- 172.21.15.79:0/3111121197 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56940b3570 0x7f56940d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.429+0000 7f569a09e640 1 --2- 172.21.15.79:0/3111121197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f569415e4d0 0x7f569406bc70 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.429+0000 7f569a09e640 1 -- 172.21.15.79:0/3111121197 >> 172.21.15.79:0/3111121197 conn(0x7f569409d460 msgr2=0x7f56940d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:16.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.429+0000 7f569a09e640 1 -- 172.21.15.79:0/3111121197 shutdown_connections 2024-04-25T02:09:16.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.429+0000 7f569a09e640 1 -- 172.21.15.79:0/3111121197 wait complete. 2024-04-25T02:09:16.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.430+0000 7f569a09e640 1 Processor -- start 2024-04-25T02:09:16.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.431+0000 7f569a09e640 1 -- start start 2024-04-25T02:09:16.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.431+0000 7f569a09e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56940b3020 0x7f56941573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.431+0000 7f569a09e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56940b3570 0x7f56941f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.431+0000 7f569a09e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f569415e4d0 0x7f56940b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.431+0000 7f569a09e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f56940d2250 con 0x7f569415e4d0 2024-04-25T02:09:16.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.431+0000 7f569a09e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f56940d20d0 con 0x7f56940b3020 2024-04-25T02:09:16.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.431+0000 7f569a09e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f569406c1b0 con 0x7f56940b3570 2024-04-25T02:09:16.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.431+0000 7f5693fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f569415e4d0 0x7f56940b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:16.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.431+0000 7f5693fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f569415e4d0 0x7f56940b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37166/0 (socket says 172.21.15.79:37166) 2024-04-25T02:09:16.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.431+0000 7f5693fff640 1 -- 172.21.15.79:0/2486238869 learned_addr learned my addr 172.21.15.79:0/2486238869 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:16.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.432+0000 7f5693fff640 1 -- 172.21.15.79:0/2486238869 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56940b3570 msgr2=0x7f56941f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.432+0000 7f5693fff640 1 --2- 172.21.15.79:0/2486238869 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56940b3570 0x7f56941f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.432+0000 7f5693fff640 1 -- 172.21.15.79:0/2486238869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56940b3020 msgr2=0x7f56941573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.432+0000 7f5693fff640 1 --2- 172.21.15.79:0/2486238869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56940b3020 0x7f56941573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.432+0000 7f5693fff640 1 -- 172.21.15.79:0/2486238869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56941f5210 con 0x7f569415e4d0 2024-04-25T02:09:16.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.432+0000 7f5693fff640 1 --2- 172.21.15.79:0/2486238869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f569415e4d0 0x7f56940b58f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f568c00b9c0 tx=0x7f568c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:16.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.432+0000 7f567bfff640 1 -- 172.21.15.79:0/2486238869 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c019070 con 0x7f569415e4d0 2024-04-25T02:09:16.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.432+0000 7f567bfff640 1 -- 172.21.15.79:0/2486238869 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f568c00cba0 con 0x7f569415e4d0 2024-04-25T02:09:16.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.432+0000 7f569a09e640 1 -- 172.21.15.79:0/2486238869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56941e8000 con 0x7f569415e4d0 2024-04-25T02:09:16.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.432+0000 7f567bfff640 1 -- 172.21.15.79:0/2486238869 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c014440 con 0x7f569415e4d0 2024-04-25T02:09:16.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.432+0000 7f569a09e640 1 -- 172.21.15.79:0/2486238869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56941e8580 con 0x7f569415e4d0 2024-04-25T02:09:16.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.433+0000 7f569a09e640 1 -- 172.21.15.79:0/2486238869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56940ca4d0 con 0x7f569415e4d0 2024-04-25T02:09:16.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.434+0000 7f567bfff640 1 -- 172.21.15.79:0/2486238869 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f568c01c070 con 0x7f569415e4d0 2024-04-25T02:09:16.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.434+0000 7f567bfff640 1 --2- 172.21.15.79:0/2486238869 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f568006be30 0x7f568006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.434+0000 7f567bfff640 1 -- 172.21.15.79:0/2486238869 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f568c08ab60 con 0x7f569415e4d0 2024-04-25T02:09:16.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.434+0000 7f56937fe640 1 --2- 172.21.15.79:0/2486238869 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f568006be30 0x7f568006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:16.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.434+0000 7f56937fe640 1 --2- 172.21.15.79:0/2486238869 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f568006be30 0x7f568006e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5684034000 tx=0x7f568402c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:16.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.438+0000 7f567bfff640 1 -- 172.21.15.79:0/2486238869 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f56940ca4d0 con 0x7f569415e4d0 2024-04-25T02:09:16.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.648+0000 7f569a09e640 1 -- 172.21.15.79:0/2486238869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f56940690a0 con 0x7f569415e4d0 2024-04-25T02:09:16.656 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:09:16.649+0000 7fb0c50c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:09:16.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.650+0000 7f567bfff640 1 -- 172.21.15.79:0/2486238869 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v13) ==== 161+0+0 (secure 0 0 0) 0x7f568c0595a0 con 0x7f569415e4d0 2024-04-25T02:09:16.657 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:09:16.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.653+0000 7f569a09e640 1 -- 172.21.15.79:0/2486238869 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f568006be30 msgr2=0x7f568006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.653+0000 7f569a09e640 1 --2- 172.21.15.79:0/2486238869 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f568006be30 0x7f568006e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5684034000 tx=0x7f568402c000 comp rx=0 tx=0).stop 2024-04-25T02:09:16.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.653+0000 7f569a09e640 1 -- 172.21.15.79:0/2486238869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f569415e4d0 msgr2=0x7f56940b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.653+0000 7f569a09e640 1 --2- 172.21.15.79:0/2486238869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f569415e4d0 0x7f56940b58f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f568c00b9c0 tx=0x7f568c00be80 comp rx=0 tx=0).stop 2024-04-25T02:09:16.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.653+0000 7f569a09e640 1 -- 172.21.15.79:0/2486238869 shutdown_connections 2024-04-25T02:09:16.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.653+0000 7f569a09e640 1 --2- 172.21.15.79:0/2486238869 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f568006be30 0x7f568006e2f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.653+0000 7f569a09e640 1 --2- 172.21.15.79:0/2486238869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f569415e4d0 0x7f56940b58f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.653+0000 7f569a09e640 1 --2- 172.21.15.79:0/2486238869 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56940b3570 0x7f56941f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.653+0000 7f569a09e640 1 --2- 172.21.15.79:0/2486238869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56940b3020 0x7f56941573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.653+0000 7f569a09e640 1 -- 172.21.15.79:0/2486238869 >> 172.21.15.79:0/2486238869 conn(0x7f569409d460 msgr2=0x7f56940b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:16.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.653+0000 7f569a09e640 1 -- 172.21.15.79:0/2486238869 shutdown_connections 2024-04-25T02:09:16.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.653+0000 7f569a09e640 1 -- 172.21.15.79:0/2486238869 wait complete. 2024-04-25T02:09:16.665 INFO:tasks.ceph.mds.b.smithi189.stderr: -6670> 2024-04-25T02:08:52.062+0000 7f4ab8643640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:09:16.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T02:09:16.699 INFO:tasks.ceph.mds.b.smithi189.stdout:starting mds.b at 2024-04-25T02:09:16.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.764+0000 7f4f4b431640 1 Processor -- start 2024-04-25T02:09:16.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.765+0000 7f4f4b431640 1 -- start start 2024-04-25T02:09:16.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.765+0000 7f4f4b431640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f4406b2f0 0x7f4f440b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.766+0000 7f4f4b431640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4f4406e6b0 0x7f4f4415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.766+0000 7f4f4b431640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4415ec20 con 0x7f4f440cf7a0 2024-04-25T02:09:16.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.766+0000 7f4f4b431640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4f4415f830 con 0x7f4f4406e6b0 2024-04-25T02:09:16.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.766+0000 7f4f4b431640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4f4415ef00 con 0x7f4f4406b2f0 2024-04-25T02:09:16.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.766+0000 7f4f499ce640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4f4406e6b0 0x7f4f4415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:16.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.766+0000 7f4f489cc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4f440cf7a0 0x7f4f4406b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38614/0 (socket says 172.21.15.79:38614) 2024-04-25T02:09:16.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.766+0000 7f4f489cc640 1 -- 172.21.15.79:0/2225149051 learned_addr learned my addr 172.21.15.79:0/2225149051 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:16.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.766+0000 7f4f491cd640 1 --2- 172.21.15.79:0/2225149051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f4406b2f0 0x7f4f440b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:16.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.766+0000 7f4f499ce640 1 -- 172.21.15.79:0/2225149051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f4406b2f0 msgr2=0x7f4f440b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:16.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.766+0000 7f4f499ce640 1 --2- 172.21.15.79:0/2225149051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f4406b2f0 0x7f4f440b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.766+0000 7f4f499ce640 1 -- 172.21.15.79:0/2225149051 >> v1:172.21.15.79:6789/0 conn(0x7f4f440cf7a0 legacy=0x7f4f4406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.766+0000 7f4f37fff640 1 -- 172.21.15.79:0/2225149051 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 23819898 0 0) 0x7f4f4415ec20 con 0x7f4f440cf7a0 2024-04-25T02:09:16.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.766+0000 7f4f499ce640 1 -- 172.21.15.79:0/2225149051 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4415f1e0 con 0x7f4f4406e6b0 2024-04-25T02:09:16.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.766+0000 7f4f491cd640 1 --2- 172.21.15.79:0/2225149051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f4406b2f0 0x7f4f440b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:16.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.767+0000 7f4f499ce640 1 --2- 172.21.15.79:0/2225149051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4406e6b0 0x7f4f4415b2d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009d90 tx=0x7f4f3c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8f88d5fe857d05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:16.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.767+0000 7f4f37fff640 1 -- 172.21.15.79:0/2225149051 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c031600 con 0x7f4f4406e6b0 2024-04-25T02:09:16.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.767+0000 7f4f37fff640 1 -- 172.21.15.79:0/2225149051 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f3c0317a0 con 0x7f4f4406e6b0 2024-04-25T02:09:16.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.767+0000 7f4f37fff640 1 -- 172.21.15.79:0/2225149051 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c031b70 con 0x7f4f4406e6b0 2024-04-25T02:09:16.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.767+0000 7f4f4b431640 1 -- 172.21.15.79:0/2225149051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4406e6b0 msgr2=0x7f4f4415b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.767+0000 7f4f4b431640 1 --2- 172.21.15.79:0/2225149051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4406e6b0 0x7f4f4415b2d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009d90 tx=0x7f4f3c02a5d0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.767+0000 7f4f4b431640 1 -- 172.21.15.79:0/2225149051 shutdown_connections 2024-04-25T02:09:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.767+0000 7f4f4b431640 1 --2- 172.21.15.79:0/2225149051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4406e6b0 0x7f4f4415b2d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.767+0000 7f4f4b431640 1 --2- 172.21.15.79:0/2225149051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f4406b2f0 0x7f4f440b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.767+0000 7f4f4b431640 1 -- 172.21.15.79:0/2225149051 >> 172.21.15.79:0/2225149051 conn(0x7f4f440b1cd0 msgr2=0x7f4f440b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.767+0000 7f4f4b431640 1 -- 172.21.15.79:0/2225149051 shutdown_connections 2024-04-25T02:09:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.767+0000 7f4f4b431640 1 -- 172.21.15.79:0/2225149051 wait complete. 2024-04-25T02:09:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.769+0000 7f4f4b431640 1 Processor -- start 2024-04-25T02:09:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.769+0000 7f4f4b431640 1 -- start start 2024-04-25T02:09:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.769+0000 7f4f4b431640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f4406b2f0 0x7f4f4414b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.769+0000 7f4f4b431640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f4406e6b0 0x7f4f441f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.769+0000 7f4f4b431640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f440cf7a0 0x7f4f4415cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.769+0000 7f4f4b431640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4406d160 con 0x7f4f440cf7a0 2024-04-25T02:09:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.769+0000 7f4f4b431640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4406cfe0 con 0x7f4f4406b2f0 2024-04-25T02:09:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.769+0000 7f4f4b431640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4f4415b810 con 0x7f4f4406e6b0 2024-04-25T02:09:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.769+0000 7f4f499ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f440cf7a0 0x7f4f4415cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.769+0000 7f4f499ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f440cf7a0 0x7f4f4415cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37182/0 (socket says 172.21.15.79:37182) 2024-04-25T02:09:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.769+0000 7f4f499ce640 1 -- 172.21.15.79:0/1430321967 learned_addr learned my addr 172.21.15.79:0/1430321967 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.770+0000 7f4f489cc640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f4406e6b0 0x7f4f441f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.770+0000 7f4f491cd640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f4406b2f0 0x7f4f4414b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.770+0000 7f4f499ce640 1 -- 172.21.15.79:0/1430321967 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f4406e6b0 msgr2=0x7f4f441f5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.770+0000 7f4f499ce640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f4406e6b0 0x7f4f441f5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.770+0000 7f4f499ce640 1 -- 172.21.15.79:0/1430321967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f4406b2f0 msgr2=0x7f4f4414b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.770+0000 7f4f499ce640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f4406b2f0 0x7f4f4414b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.770+0000 7f4f499ce640 1 -- 172.21.15.79:0/1430321967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4409c6e0 con 0x7f4f440cf7a0 2024-04-25T02:09:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.770+0000 7f4f491cd640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f4406b2f0 0x7f4f4414b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.770+0000 7f4f489cc640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f4406e6b0 0x7f4f441f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.770+0000 7f4f499ce640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f440cf7a0 0x7f4f4415cc70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009eb0 tx=0x7f4f3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.770+0000 7f4f35ffb640 1 -- 172.21.15.79:0/1430321967 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c040070 con 0x7f4f440cf7a0 2024-04-25T02:09:16.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.770+0000 7f4f35ffb640 1 -- 172.21.15.79:0/1430321967 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f3c030b60 con 0x7f4f440cf7a0 2024-04-25T02:09:16.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.770+0000 7f4f4b431640 1 -- 172.21.15.79:0/1430321967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f440af1d0 con 0x7f4f440cf7a0 2024-04-25T02:09:16.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.770+0000 7f4f35ffb640 1 -- 172.21.15.79:0/1430321967 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c045460 con 0x7f4f440cf7a0 2024-04-25T02:09:16.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.770+0000 7f4f4b431640 1 -- 172.21.15.79:0/1430321967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f440aee60 con 0x7f4f440cf7a0 2024-04-25T02:09:16.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.771+0000 7f4f4b431640 1 -- 172.21.15.79:0/1430321967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f440690a0 con 0x7f4f440cf7a0 2024-04-25T02:09:16.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.772+0000 7f4f35ffb640 1 -- 172.21.15.79:0/1430321967 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f3c039040 con 0x7f4f440cf7a0 2024-04-25T02:09:16.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.772+0000 7f4f35ffb640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f2806be30 0x7f4f2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:16.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.772+0000 7f4f491cd640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f2806be30 0x7f4f2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:16.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.772+0000 7f4f35ffb640 1 -- 172.21.15.79:0/1430321967 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7f4f3c0ac6b0 con 0x7f4f440cf7a0 2024-04-25T02:09:16.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.773+0000 7f4f491cd640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f2806be30 0x7f4f2806e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4f40006fd0 tx=0x7f4f40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:16.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.777+0000 7f4f35ffb640 1 -- 172.21.15.79:0/1430321967 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4f3c07b0c0 con 0x7f4f440cf7a0 2024-04-25T02:09:16.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:16.983+0000 7f4f4b431640 1 -- 172.21.15.79:0/1430321967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4f440cf4f0 con 0x7f4f440cf7a0 2024-04-25T02:09:17.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.651+0000 7f4f35ffb640 1 -- 172.21.15.79:0/1430321967 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v14) ==== 104+0+0 (secure 0 0 0) 0x7f4f3c07a9c0 con 0x7f4f440cf7a0 2024-04-25T02:09:17.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.654+0000 7f4f4b431640 1 -- 172.21.15.79:0/1430321967 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f2806be30 msgr2=0x7f4f2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:17.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.654+0000 7f4f4b431640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f2806be30 0x7f4f2806e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4f40006fd0 tx=0x7f4f40008040 comp rx=0 tx=0).stop 2024-04-25T02:09:17.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.654+0000 7f4f4b431640 1 -- 172.21.15.79:0/1430321967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f440cf7a0 msgr2=0x7f4f4415cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:17.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.654+0000 7f4f4b431640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f440cf7a0 0x7f4f4415cc70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009eb0 tx=0x7f4f3c004a40 comp rx=0 tx=0).stop 2024-04-25T02:09:17.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.654+0000 7f4f4b431640 1 -- 172.21.15.79:0/1430321967 shutdown_connections 2024-04-25T02:09:17.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.654+0000 7f4f4b431640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f2806be30 0x7f4f2806e2f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:17.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.654+0000 7f4f4b431640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f440cf7a0 0x7f4f4415cc70 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:17.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.654+0000 7f4f4b431640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f4406e6b0 0x7f4f441f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:17.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.654+0000 7f4f4b431640 1 --2- 172.21.15.79:0/1430321967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f4406b2f0 0x7f4f4414b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:17.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.654+0000 7f4f4b431640 1 -- 172.21.15.79:0/1430321967 >> 172.21.15.79:0/1430321967 conn(0x7f4f440b1cd0 msgr2=0x7f4f4406b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:17.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.654+0000 7f4f4b431640 1 -- 172.21.15.79:0/1430321967 shutdown_connections 2024-04-25T02:09:17.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.654+0000 7f4f4b431640 1 -- 172.21.15.79:0/1430321967 wait complete. 2024-04-25T02:09:17.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T02:09:17.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.768+0000 7f66a8c15640 1 Processor -- start 2024-04-25T02:09:17.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.768+0000 7f66a8c15640 1 -- start start 2024-04-25T02:09:17.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.769+0000 7f66a8c15640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66a415e310 0x7f66a40b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:17.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.769+0000 7f66a8c15640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f66a40b3cd0 0x7f66a406db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:17.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.769+0000 7f66a8c15640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f66a406e070 0x7f66a40b5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:17.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.769+0000 7f66a8c15640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f66a406c2a0 con 0x7f66a406e070 2024-04-25T02:09:17.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.769+0000 7f66a8c15640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f66a406f570 con 0x7f66a40b3cd0 2024-04-25T02:09:17.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.769+0000 7f66a8c15640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f66a40b4110 con 0x7f66a415e310 2024-04-25T02:09:17.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.769+0000 7f66a2d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f66a406e070 0x7f66a40b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:17.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.769+0000 7f66a2d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f66a406e070 0x7f66a40b5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37188/0 (socket says 172.21.15.79:37188) 2024-04-25T02:09:17.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.769+0000 7f66a2d9d640 1 -- 172.21.15.79:0/2449545579 learned_addr learned my addr 172.21.15.79:0/2449545579 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:17.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.770+0000 7f66a1d9b640 1 --2- 172.21.15.79:0/2449545579 >> v2:172.21.15.189:3300/0 conn(0x7f66a40b3cd0 0x7f66a406db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:17.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.770+0000 7f66a259c640 1 --2- 172.21.15.79:0/2449545579 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66a415e310 0x7f66a40b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:17.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.770+0000 7f66a2d9d640 1 -- 172.21.15.79:0/2449545579 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66a415e310 msgr2=0x7f66a40b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:17.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.770+0000 7f66a2d9d640 1 --2- 172.21.15.79:0/2449545579 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66a415e310 0x7f66a40b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:17.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.770+0000 7f66a2d9d640 1 -- 172.21.15.79:0/2449545579 >> v2:172.21.15.189:3300/0 conn(0x7f66a40b3cd0 msgr2=0x7f66a406db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:17.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.770+0000 7f66a2d9d640 1 --2- 172.21.15.79:0/2449545579 >> v2:172.21.15.189:3300/0 conn(0x7f66a40b3cd0 0x7f66a406db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:17.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.770+0000 7f66a2d9d640 1 -- 172.21.15.79:0/2449545579 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a406f810 con 0x7f66a406e070 2024-04-25T02:09:17.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.770+0000 7f66a2d9d640 1 --2- 172.21.15.79:0/2449545579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a406e070 0x7f66a40b5730 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f66a40b3a90 tx=0x7f669c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff582d756ec41c85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:17.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.770+0000 7f66a159a640 1 -- 172.21.15.79:0/2449545579 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c037070 con 0x7f66a406e070 2024-04-25T02:09:17.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.770+0000 7f66a159a640 1 -- 172.21.15.79:0/2449545579 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f669c032440 con 0x7f66a406e070 2024-04-25T02:09:17.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.770+0000 7f66a159a640 1 -- 172.21.15.79:0/2449545579 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c032810 con 0x7f66a406e070 2024-04-25T02:09:17.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.771+0000 7f66a8c15640 1 -- 172.21.15.79:0/2449545579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a406e070 msgr2=0x7f66a40b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:17.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.771+0000 7f66a8c15640 1 --2- 172.21.15.79:0/2449545579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a406e070 0x7f66a40b5730 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f66a40b3a90 tx=0x7f669c02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:09:17.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.771+0000 7f66a8c15640 1 -- 172.21.15.79:0/2449545579 shutdown_connections 2024-04-25T02:09:17.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.771+0000 7f66a8c15640 1 --2- 172.21.15.79:0/2449545579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a406e070 0x7f66a40b5730 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:17.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.771+0000 7f66a8c15640 1 --2- 172.21.15.79:0/2449545579 >> v2:172.21.15.189:3300/0 conn(0x7f66a40b3cd0 0x7f66a406db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:17.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.771+0000 7f66a8c15640 1 --2- 172.21.15.79:0/2449545579 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66a415e310 0x7f66a40b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:17.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.771+0000 7f66a8c15640 1 -- 172.21.15.79:0/2449545579 >> 172.21.15.79:0/2449545579 conn(0x7f66a40b29d0 msgr2=0x7f66a40b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:17.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.771+0000 7f66a8c15640 1 -- 172.21.15.79:0/2449545579 shutdown_connections 2024-04-25T02:09:17.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.771+0000 7f66a8c15640 1 -- 172.21.15.79:0/2449545579 wait complete. 2024-04-25T02:09:17.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.772+0000 7f66a8c15640 1 Processor -- start 2024-04-25T02:09:17.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.772+0000 7f66a8c15640 1 -- start start 2024-04-25T02:09:17.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a8c15640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66a406e070 0x7f66a415f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:17.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a8c15640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66a40b3cd0 0x7f66a4160af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:17.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a8c15640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a415e310 0x7f66a4155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:17.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a8c15640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f66a406ba80 con 0x7f66a415e310 2024-04-25T02:09:17.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a8c15640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f66a406bd80 con 0x7f66a40b3cd0 2024-04-25T02:09:17.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a8c15640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f66a40b5c70 con 0x7f66a406e070 2024-04-25T02:09:17.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a415e310 0x7f66a4155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:17.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a415e310 0x7f66a4155b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37192/0 (socket says 172.21.15.79:37192) 2024-04-25T02:09:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a2d9d640 1 -- 172.21.15.79:0/1223758536 learned_addr learned my addr 172.21.15.79:0/1223758536 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a1d9b640 1 --2- 172.21.15.79:0/1223758536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66a40b3cd0 0x7f66a4160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a259c640 1 --2- 172.21.15.79:0/1223758536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66a406e070 0x7f66a415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a2d9d640 1 -- 172.21.15.79:0/1223758536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66a406e070 msgr2=0x7f66a415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a2d9d640 1 --2- 172.21.15.79:0/1223758536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66a406e070 0x7f66a415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a2d9d640 1 -- 172.21.15.79:0/1223758536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66a40b3cd0 msgr2=0x7f66a4160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a2d9d640 1 --2- 172.21.15.79:0/1223758536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66a40b3cd0 0x7f66a4160af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.773+0000 7f66a2d9d640 1 -- 172.21.15.79:0/1223758536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a4161030 con 0x7f66a415e310 2024-04-25T02:09:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.774+0000 7f66a2d9d640 1 --2- 172.21.15.79:0/1223758536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a415e310 0x7f66a4155b50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f669c02a220 tx=0x7f669c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.774+0000 7f6692ffd640 1 -- 172.21.15.79:0/1223758536 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c037040 con 0x7f66a415e310 2024-04-25T02:09:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.774+0000 7f6692ffd640 1 -- 172.21.15.79:0/1223758536 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f669c042070 con 0x7f66a415e310 2024-04-25T02:09:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.774+0000 7f66a8c15640 1 -- 172.21.15.79:0/1223758536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a4153500 con 0x7f66a415e310 2024-04-25T02:09:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.774+0000 7f6692ffd640 1 -- 172.21.15.79:0/1223758536 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c030920 con 0x7f66a415e310 2024-04-25T02:09:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.774+0000 7f66a8c15640 1 -- 172.21.15.79:0/1223758536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a4153ac0 con 0x7f66a415e310 2024-04-25T02:09:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.775+0000 7f66a8c15640 1 -- 172.21.15.79:0/1223758536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a40690a0 con 0x7f66a415e310 2024-04-25T02:09:17.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.775+0000 7f6692ffd640 1 -- 172.21.15.79:0/1223758536 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f669c030ac0 con 0x7f66a415e310 2024-04-25T02:09:17.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.775+0000 7f6692ffd640 1 --2- 172.21.15.79:0/1223758536 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f668406be30 0x7f668406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:17.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.776+0000 7f6692ffd640 1 -- 172.21.15.79:0/1223758536 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7f669c0ab6f0 con 0x7f66a415e310 2024-04-25T02:09:17.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.776+0000 7f66a259c640 1 --2- 172.21.15.79:0/1223758536 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f668406be30 0x7f668406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:17.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.776+0000 7f66a259c640 1 --2- 172.21.15.79:0/1223758536 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f668406be30 0x7f668406e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f66940099c0 tx=0x7f6694003990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:17.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.780+0000 7f6692ffd640 1 -- 172.21.15.79:0/1223758536 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f669c079a80 con 0x7f66a415e310 2024-04-25T02:09:17.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:17.952+0000 7f66a8c15640 1 -- 172.21.15.79:0/1223758536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f66a406c6f0 con 0x7f66a415e310 2024-04-25T02:09:18.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.653+0000 7f6692ffd640 1 -- 172.21.15.79:0/1223758536 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) ==== 181+0+0 (secure 0 0 0) 0x7f669c07dd80 con 0x7f66a415e310 2024-04-25T02:09:18.660 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-04-25T02:09:18.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.656+0000 7f66a8c15640 1 -- 172.21.15.79:0/1223758536 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f668406be30 msgr2=0x7f668406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:18.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.656+0000 7f66a8c15640 1 --2- 172.21.15.79:0/1223758536 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f668406be30 0x7f668406e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f66940099c0 tx=0x7f6694003990 comp rx=0 tx=0).stop 2024-04-25T02:09:18.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.656+0000 7f66a8c15640 1 -- 172.21.15.79:0/1223758536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a415e310 msgr2=0x7f66a4155b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:18.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.656+0000 7f66a8c15640 1 --2- 172.21.15.79:0/1223758536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a415e310 0x7f66a4155b50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f669c02a220 tx=0x7f669c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.656+0000 7f66a8c15640 1 -- 172.21.15.79:0/1223758536 shutdown_connections 2024-04-25T02:09:18.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.656+0000 7f66a8c15640 1 --2- 172.21.15.79:0/1223758536 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f668406be30 0x7f668406e2f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.656+0000 7f66a8c15640 1 --2- 172.21.15.79:0/1223758536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a415e310 0x7f66a4155b50 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.656+0000 7f66a8c15640 1 --2- 172.21.15.79:0/1223758536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66a40b3cd0 0x7f66a4160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.656+0000 7f66a8c15640 1 --2- 172.21.15.79:0/1223758536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66a406e070 0x7f66a415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.657+0000 7f66a8c15640 1 -- 172.21.15.79:0/1223758536 >> 172.21.15.79:0/1223758536 conn(0x7f66a40b29d0 msgr2=0x7f66a4162260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:18.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.657+0000 7f66a8c15640 1 -- 172.21.15.79:0/1223758536 shutdown_connections 2024-04-25T02:09:18.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.657+0000 7f66a8c15640 1 -- 172.21.15.79:0/1223758536 wait complete. 2024-04-25T02:09:18.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T02:09:18.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.772+0000 7f959561c640 1 Processor -- start 2024-04-25T02:09:18.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.772+0000 7f959561c640 1 -- start start 2024-04-25T02:09:18.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.772+0000 7f959561c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f959015e440 0x7f95900cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:18.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.772+0000 7f959561c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f95900d10a0 0x7f95900cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:18.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.772+0000 7f959561c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95900d1e80 con 0x7f95900d2f20 2024-04-25T02:09:18.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.772+0000 7f959561c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f95900d2160 con 0x7f95900d10a0 2024-04-25T02:09:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.772+0000 7f959561c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f95900d2440 con 0x7f959015e440 2024-04-25T02:09:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.773+0000 7f958effd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f959015e440 0x7f95900cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.773+0000 7f958f7fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f95900d10a0 0x7f95900cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.773+0000 7f958effd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f959015e440 0x7f95900cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:42774/0 (socket says 172.21.15.79:42774) 2024-04-25T02:09:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.773+0000 7f958effd640 1 -- 172.21.15.79:0/1855335387 learned_addr learned my addr 172.21.15.79:0/1855335387 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.773+0000 7f958effd640 1 -- 172.21.15.79:0/1855335387 >> v2:172.21.15.189:3300/0 conn(0x7f95900d10a0 msgr2=0x7f95900cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.773+0000 7f958effd640 1 --2- 172.21.15.79:0/1855335387 >> v2:172.21.15.189:3300/0 conn(0x7f95900d10a0 0x7f95900cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.773+0000 7f958effd640 1 -- 172.21.15.79:0/1855335387 >> v1:172.21.15.189:6789/0 conn(0x7f95900d2f20 legacy=0x7f95900d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.773+0000 7f958effd640 1 -- 172.21.15.79:0/1855335387 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95900d2720 con 0x7f959015e440 2024-04-25T02:09:18.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.774+0000 7f958effd640 1 --2- 172.21.15.79:0/1855335387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f959015e440 0x7f95900cf870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9588009870 tx=0x7f958802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f55cbf3b638a8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.774+0000 7f958dffb640 1 -- 172.21.15.79:0/1855335387 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9588037070 con 0x7f959015e440 2024-04-25T02:09:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.774+0000 7f958dffb640 1 -- 172.21.15.79:0/1855335387 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9588032440 con 0x7f959015e440 2024-04-25T02:09:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.774+0000 7f958dffb640 1 -- 172.21.15.79:0/1855335387 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9588032810 con 0x7f959015e440 2024-04-25T02:09:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.775+0000 7f959561c640 1 -- 172.21.15.79:0/1855335387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f959015e440 msgr2=0x7f95900cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.775+0000 7f959561c640 1 --2- 172.21.15.79:0/1855335387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f959015e440 0x7f95900cf870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9588009870 tx=0x7f958802a270 comp rx=0 tx=0).stop 2024-04-25T02:09:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.775+0000 7f959561c640 1 -- 172.21.15.79:0/1855335387 shutdown_connections 2024-04-25T02:09:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.775+0000 7f959561c640 1 --2- 172.21.15.79:0/1855335387 >> v2:172.21.15.189:3300/0 conn(0x7f95900d10a0 0x7f95900cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.775+0000 7f959561c640 1 --2- 172.21.15.79:0/1855335387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f959015e440 0x7f95900cf870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.775+0000 7f959561c640 1 -- 172.21.15.79:0/1855335387 >> 172.21.15.79:0/1855335387 conn(0x7f959009d450 msgr2=0x7f95900d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.775+0000 7f959561c640 1 -- 172.21.15.79:0/1855335387 shutdown_connections 2024-04-25T02:09:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.775+0000 7f959561c640 1 -- 172.21.15.79:0/1855335387 wait complete. 2024-04-25T02:09:18.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.776+0000 7f959561c640 1 Processor -- start 2024-04-25T02:09:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.776+0000 7f959561c640 1 -- start start 2024-04-25T02:09:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f959561c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95900d10a0 0x7f95901580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f959561c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95900d2f20 0x7f9590153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f959561c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f959015e440 0x7f959015a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f959561c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f95900b7070 con 0x7f95900d2f20 2024-04-25T02:09:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f959561c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f95900b6ef0 con 0x7f95900d10a0 2024-04-25T02:09:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f959561c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f95900b71f0 con 0x7f959015e440 2024-04-25T02:09:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f958e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95900d2f20 0x7f9590153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f958e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95900d2f20 0x7f9590153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37208/0 (socket says 172.21.15.79:37208) 2024-04-25T02:09:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f958e7fc640 1 -- 172.21.15.79:0/206061908 learned_addr learned my addr 172.21.15.79:0/206061908 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f958effd640 1 --2- 172.21.15.79:0/206061908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95900d10a0 0x7f95901580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f958f7fe640 1 --2- 172.21.15.79:0/206061908 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f959015e440 0x7f959015a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f958e7fc640 1 -- 172.21.15.79:0/206061908 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f959015e440 msgr2=0x7f959015a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:18.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f958e7fc640 1 --2- 172.21.15.79:0/206061908 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f959015e440 0x7f959015a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f958e7fc640 1 -- 172.21.15.79:0/206061908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95900d10a0 msgr2=0x7f95901580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:18.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f958e7fc640 1 --2- 172.21.15.79:0/206061908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95900d10a0 0x7f95901580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f958e7fc640 1 -- 172.21.15.79:0/206061908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959015fbb0 con 0x7f95900d2f20 2024-04-25T02:09:18.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f958e7fc640 1 --2- 172.21.15.79:0/206061908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95900d2f20 0x7f9590153290 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f958400c790 tx=0x7f958400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:18.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f95777fe640 1 -- 172.21.15.79:0/206061908 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584016020 con 0x7f95900d2f20 2024-04-25T02:09:18.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f95777fe640 1 -- 172.21.15.79:0/206061908 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9584006d50 con 0x7f95900d2f20 2024-04-25T02:09:18.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f959561c640 1 -- 172.21.15.79:0/206061908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959015fe90 con 0x7f95900d2f20 2024-04-25T02:09:18.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.777+0000 7f95777fe640 1 -- 172.21.15.79:0/206061908 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584003bb0 con 0x7f95900d2f20 2024-04-25T02:09:18.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.778+0000 7f959561c640 1 -- 172.21.15.79:0/206061908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9590160450 con 0x7f95900d2f20 2024-04-25T02:09:18.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.778+0000 7f959561c640 1 -- 172.21.15.79:0/206061908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95900690a0 con 0x7f95900d2f20 2024-04-25T02:09:18.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.779+0000 7f95777fe640 1 -- 172.21.15.79:0/206061908 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f958400a850 con 0x7f95900d2f20 2024-04-25T02:09:18.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.779+0000 7f95777fe640 1 --2- 172.21.15.79:0/206061908 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f957c06be30 0x7f957c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:18.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.779+0000 7f95777fe640 1 -- 172.21.15.79:0/206061908 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5357+0+0 (secure 0 0 0) 0x7f958408a990 con 0x7f95900d2f20 2024-04-25T02:09:18.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.779+0000 7f958effd640 1 --2- 172.21.15.79:0/206061908 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f957c06be30 0x7f957c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:18.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.780+0000 7f958effd640 1 --2- 172.21.15.79:0/206061908 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f957c06be30 0x7f957c06e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9588034000 tx=0x7f958802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:18.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.783+0000 7f95777fe640 1 -- 172.21.15.79:0/206061908 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9584020020 con 0x7f95900d2f20 2024-04-25T02:09:18.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:18.957+0000 7f959561c640 1 -- 172.21.15.79:0/206061908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f95900d1720 con 0x7f95900d2f20 2024-04-25T02:09:19.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.654+0000 7f95777fe640 1 -- 172.21.15.79:0/206061908 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) ==== 169+0+0 (secure 0 0 0) 0x7f9584019310 con 0x7f95900d2f20 2024-04-25T02:09:19.662 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-04-25T02:09:19.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.657+0000 7f959561c640 1 -- 172.21.15.79:0/206061908 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f957c06be30 msgr2=0x7f957c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:19.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.657+0000 7f959561c640 1 --2- 172.21.15.79:0/206061908 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f957c06be30 0x7f957c06e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9588034000 tx=0x7f958802e000 comp rx=0 tx=0).stop 2024-04-25T02:09:19.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.657+0000 7f959561c640 1 -- 172.21.15.79:0/206061908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95900d2f20 msgr2=0x7f9590153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:19.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.657+0000 7f959561c640 1 --2- 172.21.15.79:0/206061908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95900d2f20 0x7f9590153290 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f958400c790 tx=0x7f958400cc50 comp rx=0 tx=0).stop 2024-04-25T02:09:19.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.657+0000 7f959561c640 1 -- 172.21.15.79:0/206061908 shutdown_connections 2024-04-25T02:09:19.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.657+0000 7f959561c640 1 --2- 172.21.15.79:0/206061908 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f957c06be30 0x7f957c06e2f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:19.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.657+0000 7f959561c640 1 --2- 172.21.15.79:0/206061908 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f959015e440 0x7f959015a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:19.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.657+0000 7f959561c640 1 --2- 172.21.15.79:0/206061908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95900d2f20 0x7f9590153290 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:19.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.657+0000 7f959561c640 1 --2- 172.21.15.79:0/206061908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95900d10a0 0x7f95901580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:19.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.658+0000 7f959561c640 1 -- 172.21.15.79:0/206061908 >> 172.21.15.79:0/206061908 conn(0x7f959009d450 msgr2=0x7f95900b7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:19.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.658+0000 7f959561c640 1 -- 172.21.15.79:0/206061908 shutdown_connections 2024-04-25T02:09:19.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.658+0000 7f959561c640 1 -- 172.21.15.79:0/206061908 wait complete. 2024-04-25T02:09:19.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T02:09:19.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.770+0000 7f872d1f9640 1 Processor -- start 2024-04-25T02:09:19.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.770+0000 7f872d1f9640 1 -- start start 2024-04-25T02:09:19.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.771+0000 7f872d1f9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8728161c60 0x7f8728162820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:19.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.771+0000 7f872d1f9640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f87280d02a0 0x7f87280b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:19.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.771+0000 7f872d1f9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87280cf020 con 0x7f8728161880 2024-04-25T02:09:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.771+0000 7f872d1f9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f87280d00c0 con 0x7f8728161c60 2024-04-25T02:09:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.771+0000 7f872d1f9640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f87280cf300 con 0x7f87280d02a0 2024-04-25T02:09:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.771+0000 7f872659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8728161c60 0x7f8728162820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.771+0000 7f872659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8728161c60 0x7f8728162820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37212/0 (socket says 172.21.15.79:37212) 2024-04-25T02:09:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.771+0000 7f872659c640 1 -- 172.21.15.79:0/502716629 learned_addr learned my addr 172.21.15.79:0/502716629 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.771+0000 7f872659c640 1 -- 172.21.15.79:0/502716629 >> v2:172.21.15.189:3300/0 conn(0x7f87280d02a0 msgr2=0x7f87280b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.771+0000 7f872659c640 1 --2- 172.21.15.79:0/502716629 >> v2:172.21.15.189:3300/0 conn(0x7f87280d02a0 0x7f87280b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.771+0000 7f872659c640 1 -- 172.21.15.79:0/502716629 >> v1:172.21.15.189:6789/0 conn(0x7f8728161880 legacy=0x7f8728162110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.772+0000 7f872659c640 1 -- 172.21.15.79:0/502716629 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87280cf5e0 con 0x7f8728161c60 2024-04-25T02:09:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.772+0000 7f872659c640 1 --2- 172.21.15.79:0/502716629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8728161c60 0x7f8728162820 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f87280cb370 tx=0x7f871c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2cd1b95248ea87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.772+0000 7f8725d9b640 1 -- 172.21.15.79:0/502716629 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c037070 con 0x7f8728161c60 2024-04-25T02:09:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.772+0000 7f8725d9b640 1 -- 172.21.15.79:0/502716629 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f871c032440 con 0x7f8728161c60 2024-04-25T02:09:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.772+0000 7f8725d9b640 1 -- 172.21.15.79:0/502716629 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c032810 con 0x7f8728161c60 2024-04-25T02:09:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.773+0000 7f872d1f9640 1 -- 172.21.15.79:0/502716629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8728161c60 msgr2=0x7f8728162820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.773+0000 7f872d1f9640 1 --2- 172.21.15.79:0/502716629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8728161c60 0x7f8728162820 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f87280cb370 tx=0x7f871c02a230 comp rx=0 tx=0).stop 2024-04-25T02:09:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.773+0000 7f872d1f9640 1 -- 172.21.15.79:0/502716629 shutdown_connections 2024-04-25T02:09:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.773+0000 7f872d1f9640 1 --2- 172.21.15.79:0/502716629 >> v2:172.21.15.189:3300/0 conn(0x7f87280d02a0 0x7f87280b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.773+0000 7f872d1f9640 1 --2- 172.21.15.79:0/502716629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8728161c60 0x7f8728162820 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.773+0000 7f872d1f9640 1 -- 172.21.15.79:0/502716629 >> 172.21.15.79:0/502716629 conn(0x7f872809d650 msgr2=0x7f87280d4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.773+0000 7f872d1f9640 1 -- 172.21.15.79:0/502716629 shutdown_connections 2024-04-25T02:09:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.773+0000 7f872d1f9640 1 -- 172.21.15.79:0/502716629 wait complete. 2024-04-25T02:09:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.774+0000 7f872d1f9640 1 Processor -- start 2024-04-25T02:09:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.774+0000 7f872d1f9640 1 -- start start 2024-04-25T02:09:19.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.775+0000 7f872d1f9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87280d02a0 0x7f87281557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:19.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.775+0000 7f872d1f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8728161880 0x7f87280ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:19.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.775+0000 7f872d1f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8728161c60 0x7f872815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:19.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.775+0000 7f872d1f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f87280cec40 con 0x7f8728161880 2024-04-25T02:09:19.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.775+0000 7f872d1f9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f87280cfba0 con 0x7f87280d02a0 2024-04-25T02:09:19.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.775+0000 7f872d1f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f87280cedc0 con 0x7f8728161c60 2024-04-25T02:09:19.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.775+0000 7f872659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8728161880 0x7f87280ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:19.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.775+0000 7f872659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8728161880 0x7f87280ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37226/0 (socket says 172.21.15.79:37226) 2024-04-25T02:09:19.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.775+0000 7f872659c640 1 -- 172.21.15.79:0/3447735181 learned_addr learned my addr 172.21.15.79:0/3447735181 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:19.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.776+0000 7f872759e640 1 --2- 172.21.15.79:0/3447735181 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8728161c60 0x7f872815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:19.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.776+0000 7f8726d9d640 1 --2- 172.21.15.79:0/3447735181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87280d02a0 0x7f87281557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:19.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.776+0000 7f872659c640 1 -- 172.21.15.79:0/3447735181 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8728161c60 msgr2=0x7f872815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:19.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.776+0000 7f872659c640 1 --2- 172.21.15.79:0/3447735181 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8728161c60 0x7f872815d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:19.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.776+0000 7f872659c640 1 -- 172.21.15.79:0/3447735181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87280d02a0 msgr2=0x7f87281557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:19.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.776+0000 7f872659c640 1 --2- 172.21.15.79:0/3447735181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87280d02a0 0x7f87281557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:19.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.776+0000 7f872659c640 1 -- 172.21.15.79:0/3447735181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8728155d00 con 0x7f8728161880 2024-04-25T02:09:19.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.776+0000 7f872659c640 1 --2- 172.21.15.79:0/3447735181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8728161880 0x7f87280ca570 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f871c000c00 tx=0x7f871c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:19.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.776+0000 7f870f7fe640 1 -- 172.21.15.79:0/3447735181 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c041070 con 0x7f8728161880 2024-04-25T02:09:19.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.776+0000 7f870f7fe640 1 -- 172.21.15.79:0/3447735181 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f871c03c870 con 0x7f8728161880 2024-04-25T02:09:19.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.776+0000 7f872d1f9640 1 -- 172.21.15.79:0/3447735181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87280c94d0 con 0x7f8728161880 2024-04-25T02:09:19.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.776+0000 7f870f7fe640 1 -- 172.21.15.79:0/3447735181 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c037040 con 0x7f8728161880 2024-04-25T02:09:19.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.776+0000 7f872d1f9640 1 -- 172.21.15.79:0/3447735181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87280c9a90 con 0x7f8728161880 2024-04-25T02:09:19.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.777+0000 7f872d1f9640 1 -- 172.21.15.79:0/3447735181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87280690a0 con 0x7f8728161880 2024-04-25T02:09:19.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.777+0000 7f870f7fe640 1 -- 172.21.15.79:0/3447735181 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f871c044070 con 0x7f8728161880 2024-04-25T02:09:19.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.778+0000 7f870f7fe640 1 --2- 172.21.15.79:0/3447735181 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f871406be30 0x7f871406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:19.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.778+0000 7f870f7fe640 1 -- 172.21.15.79:0/3447735181 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f871c0ab6e0 con 0x7f8728161880 2024-04-25T02:09:19.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.778+0000 7f8726d9d640 1 --2- 172.21.15.79:0/3447735181 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f871406be30 0x7f871406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:19.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.778+0000 7f8726d9d640 1 --2- 172.21.15.79:0/3447735181 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f871406be30 0x7f871406e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8718007fd0 tx=0x7f8718009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:19.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.782+0000 7f870f7fe640 1 -- 172.21.15.79:0/3447735181 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8728155d00 con 0x7f8728161880 2024-04-25T02:09:19.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.955+0000 7f872d1f9640 1 -- 172.21.15.79:0/3447735181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f872809db30 con 0x7f8728161880 2024-04-25T02:09:19.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.958+0000 7f870f7fe640 1 -- 172.21.15.79:0/3447735181 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f871c07a420 con 0x7f8728161880 2024-04-25T02:09:19.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.960+0000 7f872d1f9640 1 -- 172.21.15.79:0/3447735181 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f871406be30 msgr2=0x7f871406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:19.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.960+0000 7f872d1f9640 1 --2- 172.21.15.79:0/3447735181 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f871406be30 0x7f871406e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8718007fd0 tx=0x7f8718009040 comp rx=0 tx=0).stop 2024-04-25T02:09:19.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.960+0000 7f872d1f9640 1 -- 172.21.15.79:0/3447735181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8728161880 msgr2=0x7f87280ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.960+0000 7f872d1f9640 1 --2- 172.21.15.79:0/3447735181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8728161880 0x7f87280ca570 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f871c000c00 tx=0x7f871c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:09:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.960+0000 7f872d1f9640 1 -- 172.21.15.79:0/3447735181 shutdown_connections 2024-04-25T02:09:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.960+0000 7f872d1f9640 1 --2- 172.21.15.79:0/3447735181 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f871406be30 0x7f871406e2f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.960+0000 7f872d1f9640 1 --2- 172.21.15.79:0/3447735181 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8728161c60 0x7f872815d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.960+0000 7f872d1f9640 1 --2- 172.21.15.79:0/3447735181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8728161880 0x7f87280ca570 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.960+0000 7f872d1f9640 1 --2- 172.21.15.79:0/3447735181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87280d02a0 0x7f87281557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.960+0000 7f872d1f9640 1 -- 172.21.15.79:0/3447735181 >> 172.21.15.79:0/3447735181 conn(0x7f872809d650 msgr2=0x7f87280b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.960+0000 7f872d1f9640 1 -- 172.21.15.79:0/3447735181 shutdown_connections 2024-04-25T02:09:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:19.960+0000 7f872d1f9640 1 -- 172.21.15.79:0/3447735181 wait complete. 2024-04-25T02:09:19.978 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-25T02:09:20.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.067+0000 7f0af2012640 1 Processor -- start 2024-04-25T02:09:20.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.067+0000 7f0af2012640 1 -- start start 2024-04-25T02:09:20.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.068+0000 7f0af2012640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0aec143bc0 0x7f0aec15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:20.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.068+0000 7f0af2012640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0aec0b3d40 0x7f0aec06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:20.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.068+0000 7f0af2012640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aec15fa40 con 0x7f0aec06df50 2024-04-25T02:09:20.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.068+0000 7f0af2012640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f0aec06e8f0 con 0x7f0aec143bc0 2024-04-25T02:09:20.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.068+0000 7f0af2012640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0aec072cb0 con 0x7f0aec0b3d40 2024-04-25T02:09:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.068+0000 7f0aeb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0aec143bc0 0x7f0aec15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.068+0000 7f0aeb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0aec143bc0 0x7f0aec15f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37240/0 (socket says 172.21.15.79:37240) 2024-04-25T02:09:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.068+0000 7f0aeb7fe640 1 -- 172.21.15.79:0/3545134892 learned_addr learned my addr 172.21.15.79:0/3545134892 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.068+0000 7f0aebfff640 1 --2- 172.21.15.79:0/3545134892 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0aec0b3d40 0x7f0aec06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.068+0000 7f0aeb7fe640 1 -- 172.21.15.79:0/3545134892 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0aec0b3d40 msgr2=0x7f0aec06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.068+0000 7f0aeb7fe640 1 --2- 172.21.15.79:0/3545134892 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0aec0b3d40 0x7f0aec06e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.068+0000 7f0aeb7fe640 1 -- 172.21.15.79:0/3545134892 >> v1:172.21.15.189:6789/0 conn(0x7f0aec06df50 legacy=0x7f0aec0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.068+0000 7f0aeb7fe640 1 -- 172.21.15.79:0/3545134892 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aec071e00 con 0x7f0aec143bc0 2024-04-25T02:09:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.069+0000 7f0aeb7fe640 1 --2- 172.21.15.79:0/3545134892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec143bc0 0x7f0aec15f500 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009870 tx=0x7f0adc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84cb65d878159c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.069+0000 7f0aea7fc640 1 -- 172.21.15.79:0/3545134892 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc037070 con 0x7f0aec143bc0 2024-04-25T02:09:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.069+0000 7f0aea7fc640 1 -- 172.21.15.79:0/3545134892 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0adc032440 con 0x7f0aec143bc0 2024-04-25T02:09:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.069+0000 7f0aea7fc640 1 -- 172.21.15.79:0/3545134892 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc032810 con 0x7f0aec143bc0 2024-04-25T02:09:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.070+0000 7f0af2012640 1 -- 172.21.15.79:0/3545134892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec143bc0 msgr2=0x7f0aec15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.070+0000 7f0af2012640 1 --2- 172.21.15.79:0/3545134892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec143bc0 0x7f0aec15f500 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009870 tx=0x7f0adc02a1c0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.070+0000 7f0af2012640 1 -- 172.21.15.79:0/3545134892 shutdown_connections 2024-04-25T02:09:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.070+0000 7f0af2012640 1 --2- 172.21.15.79:0/3545134892 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0aec0b3d40 0x7f0aec06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.070+0000 7f0af2012640 1 --2- 172.21.15.79:0/3545134892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec143bc0 0x7f0aec15f500 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.070+0000 7f0af2012640 1 -- 172.21.15.79:0/3545134892 >> 172.21.15.79:0/3545134892 conn(0x7f0aec0cfc80 msgr2=0x7f0aec0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.070+0000 7f0af2012640 1 -- 172.21.15.79:0/3545134892 shutdown_connections 2024-04-25T02:09:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.070+0000 7f0af2012640 1 -- 172.21.15.79:0/3545134892 wait complete. 2024-04-25T02:09:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.071+0000 7f0af2012640 1 Processor -- start 2024-04-25T02:09:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.071+0000 7f0af2012640 1 -- start start 2024-04-25T02:09:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0af2012640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0aec06df50 0x7f0aec15cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0af2012640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec0b3d40 0x7f0aec141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0af2012640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0aec143bc0 0x7f0aec1e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0af2012640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec072660 con 0x7f0aec0b3d40 2024-04-25T02:09:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0af2012640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec072380 con 0x7f0aec143bc0 2024-04-25T02:09:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0af2012640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0aec072940 con 0x7f0aec06df50 2024-04-25T02:09:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0aeaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec0b3d40 0x7f0aec141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0aeaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec0b3d40 0x7f0aec141a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37242/0 (socket says 172.21.15.79:37242) 2024-04-25T02:09:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0aeaffd640 1 -- 172.21.15.79:0/11332425 learned_addr learned my addr 172.21.15.79:0/11332425 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0aeb7fe640 1 --2- 172.21.15.79:0/11332425 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0aec06df50 0x7f0aec15cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0aebfff640 1 --2- 172.21.15.79:0/11332425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0aec143bc0 0x7f0aec1e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0aeaffd640 1 -- 172.21.15.79:0/11332425 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0aec06df50 msgr2=0x7f0aec15cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0aeaffd640 1 --2- 172.21.15.79:0/11332425 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0aec06df50 0x7f0aec15cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0aeaffd640 1 -- 172.21.15.79:0/11332425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0aec143bc0 msgr2=0x7f0aec1e70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0aeaffd640 1 --2- 172.21.15.79:0/11332425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0aec143bc0 0x7f0aec1e70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0aeaffd640 1 -- 172.21.15.79:0/11332425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aec1e5bd0 con 0x7f0aec0b3d40 2024-04-25T02:09:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0aeaffd640 1 --2- 172.21.15.79:0/11332425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec0b3d40 0x7f0aec141a10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000c3c0 tx=0x7f0ae000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0ad3fff640 1 -- 172.21.15.79:0/11332425 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00052d0 con 0x7f0aec0b3d40 2024-04-25T02:09:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0ad3fff640 1 -- 172.21.15.79:0/11332425 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae0005490 con 0x7f0aec0b3d40 2024-04-25T02:09:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0af2012640 1 -- 172.21.15.79:0/11332425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aec1e5eb0 con 0x7f0aec0b3d40 2024-04-25T02:09:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.072+0000 7f0ad3fff640 1 -- 172.21.15.79:0/11332425 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0007260 con 0x7f0aec0b3d40 2024-04-25T02:09:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.073+0000 7f0af2012640 1 -- 172.21.15.79:0/11332425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aec1e6470 con 0x7f0aec0b3d40 2024-04-25T02:09:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.073+0000 7f0af2012640 1 -- 172.21.15.79:0/11332425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aec0690a0 con 0x7f0aec0b3d40 2024-04-25T02:09:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.074+0000 7f0ad3fff640 1 -- 172.21.15.79:0/11332425 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ae0007400 con 0x7f0aec0b3d40 2024-04-25T02:09:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.074+0000 7f0ad3fff640 1 --2- 172.21.15.79:0/11332425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0ad806be30 0x7f0ad806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.074+0000 7f0ad3fff640 1 -- 172.21.15.79:0/11332425 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f0ae008a040 con 0x7f0aec0b3d40 2024-04-25T02:09:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.074+0000 7f0aeb7fe640 1 --2- 172.21.15.79:0/11332425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0ad806be30 0x7f0ad806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.075+0000 7f0aeb7fe640 1 --2- 172.21.15.79:0/11332425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0ad806be30 0x7f0ad806e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0adc034000 tx=0x7f0adc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:20.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.079+0000 7f0ad3fff640 1 -- 172.21.15.79:0/11332425 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0aec15fa40 con 0x7f0aec0b3d40 2024-04-25T02:09:20.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.319+0000 7f0af2012640 1 -- 172.21.15.79:0/11332425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7f0aec0b3760 con 0x7f0aec0b3d40 2024-04-25T02:09:20.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.656+0000 7f0ad3fff640 1 -- 172.21.15.79:0/11332425 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v98) ==== 142+0+0 (secure 0 0 0) 0x7f0ae0058cf0 con 0x7f0aec0b3d40 2024-04-25T02:09:20.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.658+0000 7f0af2012640 1 -- 172.21.15.79:0/11332425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0ad806be30 msgr2=0x7f0ad806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:20.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.658+0000 7f0af2012640 1 --2- 172.21.15.79:0/11332425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0ad806be30 0x7f0ad806e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0adc034000 tx=0x7f0adc02e000 comp rx=0 tx=0).stop 2024-04-25T02:09:20.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.658+0000 7f0af2012640 1 -- 172.21.15.79:0/11332425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec0b3d40 msgr2=0x7f0aec141a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:20.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.658+0000 7f0af2012640 1 --2- 172.21.15.79:0/11332425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec0b3d40 0x7f0aec141a10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000c3c0 tx=0x7f0ae000c880 comp rx=0 tx=0).stop 2024-04-25T02:09:20.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.658+0000 7f0af2012640 1 -- 172.21.15.79:0/11332425 shutdown_connections 2024-04-25T02:09:20.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.658+0000 7f0af2012640 1 --2- 172.21.15.79:0/11332425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0ad806be30 0x7f0ad806e2f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.658+0000 7f0af2012640 1 --2- 172.21.15.79:0/11332425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0aec143bc0 0x7f0aec1e70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.658+0000 7f0af2012640 1 --2- 172.21.15.79:0/11332425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec0b3d40 0x7f0aec141a10 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.658+0000 7f0af2012640 1 --2- 172.21.15.79:0/11332425 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0aec06df50 0x7f0aec15cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.658+0000 7f0af2012640 1 -- 172.21.15.79:0/11332425 >> 172.21.15.79:0/11332425 conn(0x7f0aec0cfc80 msgr2=0x7f0aec0b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:20.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.658+0000 7f0af2012640 1 -- 172.21.15.79:0/11332425 shutdown_connections 2024-04-25T02:09:20.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.658+0000 7f0af2012640 1 -- 172.21.15.79:0/11332425 wait complete. 2024-04-25T02:09:20.676 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T02:09:20.676 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2024-04-25T02:09:20.676 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T02:09:20.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:20.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.765+0000 7f7b00015640 1 Processor -- start 2024-04-25T02:09:20.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.765+0000 7f7b00015640 1 -- start start 2024-04-25T02:09:20.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.766+0000 7f7b00015640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7af806df50 0x7f7af806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:20.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.766+0000 7f7b00015640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7af80b2d30 0x7f7af80b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:20.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.766+0000 7f7b00015640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7af8071e00 con 0x7f7af8143bc0 2024-04-25T02:09:20.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.766+0000 7f7b00015640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7af806e8f0 con 0x7f7af80b2d30 2024-04-25T02:09:20.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.766+0000 7f7b00015640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f7af8072cb0 con 0x7f7af806df50 2024-04-25T02:09:20.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.766+0000 7f7afe5b2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7af80b2d30 0x7f7af80b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:20.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.766+0000 7f7afe5b2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7af80b2d30 0x7f7af80b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37258/0 (socket says 172.21.15.79:37258) 2024-04-25T02:09:20.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.766+0000 7f7afe5b2640 1 -- 172.21.15.79:0/2713757338 learned_addr learned my addr 172.21.15.79:0/2713757338 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:20.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.766+0000 7f7afd5b0640 1 --2- 172.21.15.79:0/2713757338 >> v2:172.21.15.189:3300/0 conn(0x7f7af806df50 0x7f7af806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:20.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.766+0000 7f7afe5b2640 1 -- 172.21.15.79:0/2713757338 >> v2:172.21.15.189:3300/0 conn(0x7f7af806df50 msgr2=0x7f7af806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:20.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.766+0000 7f7afe5b2640 1 --2- 172.21.15.79:0/2713757338 >> v2:172.21.15.189:3300/0 conn(0x7f7af806df50 0x7f7af806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.766+0000 7f7afe5b2640 1 -- 172.21.15.79:0/2713757338 >> v1:172.21.15.189:6789/0 conn(0x7f7af8143bc0 legacy=0x7f7af815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:20.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.766+0000 7f7afe5b2640 1 -- 172.21.15.79:0/2713757338 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af80720a0 con 0x7f7af80b2d30 2024-04-25T02:09:20.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.766+0000 7f7afd5b0640 1 --2- 172.21.15.79:0/2713757338 >> v2:172.21.15.189:3300/0 conn(0x7f7af806df50 0x7f7af806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:20.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.767+0000 7f7afe5b2640 1 --2- 172.21.15.79:0/2713757338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7af80b2d30 0x7f7af80b31c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7af80cf960 tx=0x7f7af002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b388a9d6d486041 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:20.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.767+0000 7f7afcdaf640 1 -- 172.21.15.79:0/2713757338 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af0037070 con 0x7f7af80b2d30 2024-04-25T02:09:20.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.767+0000 7f7afcdaf640 1 -- 172.21.15.79:0/2713757338 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7af0032440 con 0x7f7af80b2d30 2024-04-25T02:09:20.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.767+0000 7f7afcdaf640 1 -- 172.21.15.79:0/2713757338 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af0032810 con 0x7f7af80b2d30 2024-04-25T02:09:20.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.768+0000 7f7b00015640 1 -- 172.21.15.79:0/2713757338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7af80b2d30 msgr2=0x7f7af80b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:20.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.768+0000 7f7b00015640 1 --2- 172.21.15.79:0/2713757338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7af80b2d30 0x7f7af80b31c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7af80cf960 tx=0x7f7af002a1a0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.768+0000 7f7b00015640 1 -- 172.21.15.79:0/2713757338 shutdown_connections 2024-04-25T02:09:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.768+0000 7f7b00015640 1 --2- 172.21.15.79:0/2713757338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7af80b2d30 0x7f7af80b31c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.768+0000 7f7b00015640 1 --2- 172.21.15.79:0/2713757338 >> v2:172.21.15.189:3300/0 conn(0x7f7af806df50 0x7f7af806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.768+0000 7f7b00015640 1 -- 172.21.15.79:0/2713757338 >> 172.21.15.79:0/2713757338 conn(0x7f7af80cfc80 msgr2=0x7f7af80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.768+0000 7f7b00015640 1 -- 172.21.15.79:0/2713757338 shutdown_connections 2024-04-25T02:09:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.768+0000 7f7b00015640 1 -- 172.21.15.79:0/2713757338 wait complete. 2024-04-25T02:09:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.769+0000 7f7b00015640 1 Processor -- start 2024-04-25T02:09:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.769+0000 7f7b00015640 1 -- start start 2024-04-25T02:09:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7b00015640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7af806df50 0x7f7af8159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7b00015640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7af80b2d30 0x7f7af81e5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7b00015640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7af8143bc0 0x7f7af815be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7b00015640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7af8072940 con 0x7f7af80b2d30 2024-04-25T02:09:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7b00015640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7af8072660 con 0x7f7af806df50 2024-04-25T02:09:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7b00015640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7af8143fa0 con 0x7f7af8143bc0 2024-04-25T02:09:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7afd5b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7af80b2d30 0x7f7af81e5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7afd5b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7af80b2d30 0x7f7af81e5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37266/0 (socket says 172.21.15.79:37266) 2024-04-25T02:09:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7afd5b0640 1 -- 172.21.15.79:0/343922043 learned_addr learned my addr 172.21.15.79:0/343922043 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7afddb1640 1 --2- 172.21.15.79:0/343922043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7af806df50 0x7f7af8159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7afd5b0640 1 -- 172.21.15.79:0/343922043 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7af8143bc0 msgr2=0x7f7af815be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7afd5b0640 1 --2- 172.21.15.79:0/343922043 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7af8143bc0 0x7f7af815be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7afd5b0640 1 -- 172.21.15.79:0/343922043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7af806df50 msgr2=0x7f7af8159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7afd5b0640 1 --2- 172.21.15.79:0/343922043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7af806df50 0x7f7af8159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7afd5b0640 1 -- 172.21.15.79:0/343922043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af8159770 con 0x7f7af80b2d30 2024-04-25T02:09:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7afddb1640 1 --2- 172.21.15.79:0/343922043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7af806df50 0x7f7af8159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7afd5b0640 1 --2- 172.21.15.79:0/343922043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7af80b2d30 0x7f7af81e5b60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800c820 tx=0x7f7ae800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7aee7fc640 1 -- 172.21.15.79:0/343922043 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8015070 con 0x7f7af80b2d30 2024-04-25T02:09:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7aee7fc640 1 -- 172.21.15.79:0/343922043 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae8007a30 con 0x7f7af80b2d30 2024-04-25T02:09:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7aee7fc640 1 -- 172.21.15.79:0/343922043 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8007de0 con 0x7f7af80b2d30 2024-04-25T02:09:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.770+0000 7f7b00015640 1 -- 172.21.15.79:0/343922043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af8159a50 con 0x7f7af80b2d30 2024-04-25T02:09:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.771+0000 7f7b00015640 1 -- 172.21.15.79:0/343922043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af815a2f0 con 0x7f7af80b2d30 2024-04-25T02:09:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.771+0000 7f7b00015640 1 -- 172.21.15.79:0/343922043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7af80690a0 con 0x7f7af80b2d30 2024-04-25T02:09:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.772+0000 7f7aee7fc640 1 -- 172.21.15.79:0/343922043 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ae8018070 con 0x7f7af80b2d30 2024-04-25T02:09:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.772+0000 7f7aee7fc640 1 --2- 172.21.15.79:0/343922043 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7adc06be30 0x7f7adc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.772+0000 7f7aee7fc640 1 -- 172.21.15.79:0/343922043 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f7ae808a9f0 con 0x7f7af80b2d30 2024-04-25T02:09:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.772+0000 7f7afddb1640 1 --2- 172.21.15.79:0/343922043 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7adc06be30 0x7f7adc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.773+0000 7f7afddb1640 1 --2- 172.21.15.79:0/343922043 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7adc06be30 0x7f7adc06e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7af81423c0 tx=0x7f7af4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:20.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.777+0000 7f7aee7fc640 1 -- 172.21.15.79:0/343922043 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7ae8059730 con 0x7f7af80b2d30 2024-04-25T02:09:20.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.951+0000 7f7b00015640 1 -- 172.21.15.79:0/343922043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7af8159c20 con 0x7f7af80b2d30 2024-04-25T02:09:20.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.951+0000 7f7aee7fc640 1 -- 172.21.15.79:0/343922043 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+13032 (secure 0 0 0) 0x7f7ae8059030 con 0x7f7af80b2d30 2024-04-25T02:09:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:20.959 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":36,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:09:19.654174+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.189:6835/605900869":"2024-04-26T02:09:16.649730+0000","172.21.15.189:6833/605900869":"2024-04-26T02:09:16.649730+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:20.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.954+0000 7f7b00015640 1 -- 172.21.15.79:0/343922043 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7adc06be30 msgr2=0x7f7adc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:20.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.954+0000 7f7b00015640 1 --2- 172.21.15.79:0/343922043 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7adc06be30 0x7f7adc06e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7af81423c0 tx=0x7f7af4009040 comp rx=0 tx=0).stop 2024-04-25T02:09:20.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.954+0000 7f7b00015640 1 -- 172.21.15.79:0/343922043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7af80b2d30 msgr2=0x7f7af81e5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:20.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.954+0000 7f7b00015640 1 --2- 172.21.15.79:0/343922043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7af80b2d30 0x7f7af81e5b60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800c820 tx=0x7f7ae800cce0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.954+0000 7f7b00015640 1 -- 172.21.15.79:0/343922043 shutdown_connections 2024-04-25T02:09:20.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.954+0000 7f7b00015640 1 --2- 172.21.15.79:0/343922043 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7adc06be30 0x7f7adc06e2f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.954+0000 7f7b00015640 1 --2- 172.21.15.79:0/343922043 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7af8143bc0 0x7f7af815be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.954+0000 7f7b00015640 1 --2- 172.21.15.79:0/343922043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7af80b2d30 0x7f7af81e5b60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.954+0000 7f7b00015640 1 --2- 172.21.15.79:0/343922043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7af806df50 0x7f7af8159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:20.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.954+0000 7f7b00015640 1 -- 172.21.15.79:0/343922043 >> 172.21.15.79:0/343922043 conn(0x7f7af80cfc80 msgr2=0x7f7af80cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:20.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.954+0000 7f7b00015640 1 -- 172.21.15.79:0/343922043 shutdown_connections 2024-04-25T02:09:20.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:20.954+0000 7f7b00015640 1 -- 172.21.15.79:0/343922043 wait complete. 2024-04-25T02:09:20.972 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:09:20.972 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:09:21.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.064+0000 7f991d163640 1 Processor -- start 2024-04-25T02:09:21.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.064+0000 7f991d163640 1 -- start start 2024-04-25T02:09:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.065+0000 7f991d163640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f991815e4f0 0x7f99180d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.065+0000 7f991d163640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99180cf7f0 0x7f99180d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.065+0000 7f991d163640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99180d1ee0 con 0x7f99180cfc50 2024-04-25T02:09:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.065+0000 7f991d163640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f99180d21c0 con 0x7f991815e4f0 2024-04-25T02:09:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.065+0000 7f991d163640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f99180d24a0 con 0x7f99180cf7f0 2024-04-25T02:09:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.065+0000 7f9916d9d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f991815e4f0 0x7f99180d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.065+0000 7f991759e640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f99180cfc50 0x7f991806bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:48576/0 (socket says 172.21.15.79:48576) 2024-04-25T02:09:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.065+0000 7f991659c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99180cf7f0 0x7f99180d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.065+0000 7f991759e640 1 -- 172.21.15.79:0/2430583272 learned_addr learned my addr 172.21.15.79:0/2430583272 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.066+0000 7f991659c640 1 -- 172.21.15.79:0/2430583272 >> v2:172.21.15.189:3300/0 conn(0x7f991815e4f0 msgr2=0x7f99180d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.066+0000 7f991659c640 1 --2- 172.21.15.79:0/2430583272 >> v2:172.21.15.189:3300/0 conn(0x7f991815e4f0 0x7f99180d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.066+0000 7f991659c640 1 -- 172.21.15.79:0/2430583272 >> v1:172.21.15.189:6789/0 conn(0x7f99180cfc50 legacy=0x7f991806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.066+0000 7f991659c640 1 -- 172.21.15.79:0/2430583272 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99180d2780 con 0x7f99180cf7f0 2024-04-25T02:09:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.066+0000 7f9916d9d640 1 --2- 172.21.15.79:0/2430583272 >> v2:172.21.15.189:3300/0 conn(0x7f991815e4f0 0x7f99180d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:21.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.067+0000 7f991659c640 1 --2- 172.21.15.79:0/2430583272 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99180cf7f0 0x7f99180d09b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f990c0097d0 tx=0x7f990c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd9ef1ff25ca820d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:21.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.067+0000 7f9915d9b640 1 -- 172.21.15.79:0/2430583272 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990c037070 con 0x7f99180cf7f0 2024-04-25T02:09:21.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.067+0000 7f9915d9b640 1 -- 172.21.15.79:0/2430583272 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990c032440 con 0x7f99180cf7f0 2024-04-25T02:09:21.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.067+0000 7f9915d9b640 1 -- 172.21.15.79:0/2430583272 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990c032810 con 0x7f99180cf7f0 2024-04-25T02:09:21.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.067+0000 7f991d163640 1 -- 172.21.15.79:0/2430583272 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99180cf7f0 msgr2=0x7f99180d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.067+0000 7f991d163640 1 --2- 172.21.15.79:0/2430583272 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99180cf7f0 0x7f99180d09b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f990c0097d0 tx=0x7f990c02a1c0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.067+0000 7f991d163640 1 -- 172.21.15.79:0/2430583272 shutdown_connections 2024-04-25T02:09:21.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.067+0000 7f991d163640 1 --2- 172.21.15.79:0/2430583272 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99180cf7f0 0x7f99180d09b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.067+0000 7f991d163640 1 --2- 172.21.15.79:0/2430583272 >> v2:172.21.15.189:3300/0 conn(0x7f991815e4f0 0x7f99180d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.067+0000 7f991d163640 1 -- 172.21.15.79:0/2430583272 >> 172.21.15.79:0/2430583272 conn(0x7f991809d4a0 msgr2=0x7f99180d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:21.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.067+0000 7f991d163640 1 -- 172.21.15.79:0/2430583272 shutdown_connections 2024-04-25T02:09:21.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.067+0000 7f991d163640 1 -- 172.21.15.79:0/2430583272 wait complete. 2024-04-25T02:09:21.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.069+0000 7f991d163640 1 Processor -- start 2024-04-25T02:09:21.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.069+0000 7f991d163640 1 -- start start 2024-04-25T02:09:21.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.069+0000 7f991d163640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99180cf7f0 0x7f99180b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.069+0000 7f991d163640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99180cfc50 0x7f9918153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.069+0000 7f991d163640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f991815e4f0 0x7f9918154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.069+0000 7f991d163640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99180d0ef0 con 0x7f99180cf7f0 2024-04-25T02:09:21.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.069+0000 7f991d163640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99180d50f0 con 0x7f991815e4f0 2024-04-25T02:09:21.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.069+0000 7f991d163640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f99180d1070 con 0x7f99180cfc50 2024-04-25T02:09:21.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f9916d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99180cf7f0 0x7f99180b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f9916d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99180cf7f0 0x7f99180b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37270/0 (socket says 172.21.15.79:37270) 2024-04-25T02:09:21.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f9916d9d640 1 -- 172.21.15.79:0/2779175033 learned_addr learned my addr 172.21.15.79:0/2779175033 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:21.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f991759e640 1 --2- 172.21.15.79:0/2779175033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f991815e4f0 0x7f9918154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f991659c640 1 --2- 172.21.15.79:0/2779175033 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99180cfc50 0x7f9918153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f9916d9d640 1 -- 172.21.15.79:0/2779175033 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99180cfc50 msgr2=0x7f9918153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f9916d9d640 1 --2- 172.21.15.79:0/2779175033 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99180cfc50 0x7f9918153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f9916d9d640 1 -- 172.21.15.79:0/2779175033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f991815e4f0 msgr2=0x7f9918154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f9916d9d640 1 --2- 172.21.15.79:0/2779175033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f991815e4f0 0x7f9918154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f9916d9d640 1 -- 172.21.15.79:0/2779175033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99180b6e30 con 0x7f99180cf7f0 2024-04-25T02:09:21.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f9916d9d640 1 --2- 172.21.15.79:0/2779175033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99180cf7f0 0x7f99180b26f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f990800efc0 tx=0x7f990800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:21.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f98ff7fe640 1 -- 172.21.15.79:0/2779175033 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908018020 con 0x7f99180cf7f0 2024-04-25T02:09:21.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f98ff7fe640 1 -- 172.21.15.79:0/2779175033 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9908014680 con 0x7f99180cf7f0 2024-04-25T02:09:21.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f991d163640 1 -- 172.21.15.79:0/2779175033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99181558b0 con 0x7f99180cf7f0 2024-04-25T02:09:21.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f98ff7fe640 1 -- 172.21.15.79:0/2779175033 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908014a50 con 0x7f99180cf7f0 2024-04-25T02:09:21.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.070+0000 7f991d163640 1 -- 172.21.15.79:0/2779175033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9918155b90 con 0x7f99180cf7f0 2024-04-25T02:09:21.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.071+0000 7f991d163640 1 -- 172.21.15.79:0/2779175033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99180686c0 con 0x7f99180cf7f0 2024-04-25T02:09:21.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.072+0000 7f98ff7fe640 1 -- 172.21.15.79:0/2779175033 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9908005d10 con 0x7f99180cf7f0 2024-04-25T02:09:21.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.072+0000 7f98ff7fe640 1 --2- 172.21.15.79:0/2779175033 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f990406be30 0x7f990406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.072+0000 7f98ff7fe640 1 -- 172.21.15.79:0/2779175033 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f990808b730 con 0x7f99180cf7f0 2024-04-25T02:09:21.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.072+0000 7f991659c640 1 --2- 172.21.15.79:0/2779175033 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f990406be30 0x7f990406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.073+0000 7f991659c640 1 --2- 172.21.15.79:0/2779175033 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f990406be30 0x7f990406e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f990c034000 tx=0x7f990c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:21.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.076+0000 7f98ff7fe640 1 -- 172.21.15.79:0/2779175033 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9908022030 con 0x7f99180cf7f0 2024-04-25T02:09:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.251+0000 7f991d163640 1 -- 172.21.15.79:0/2779175033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f99180690a0 con 0x7f99180cf7f0 2024-04-25T02:09:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.252+0000 7f98ff7fe640 1 -- 172.21.15.79:0/2779175033 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7f9908010040 con 0x7f99180cf7f0 2024-04-25T02:09:21.259 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:09:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.253+0000 7f991d163640 1 -- 172.21.15.79:0/2779175033 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f990406be30 msgr2=0x7f990406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.253+0000 7f991d163640 1 --2- 172.21.15.79:0/2779175033 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f990406be30 0x7f990406e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f990c034000 tx=0x7f990c02e000 comp rx=0 tx=0).stop 2024-04-25T02:09:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.253+0000 7f991d163640 1 -- 172.21.15.79:0/2779175033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99180cf7f0 msgr2=0x7f99180b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.253+0000 7f991d163640 1 --2- 172.21.15.79:0/2779175033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99180cf7f0 0x7f99180b26f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f990800efc0 tx=0x7f990800c490 comp rx=0 tx=0).stop 2024-04-25T02:09:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.254+0000 7f991d163640 1 -- 172.21.15.79:0/2779175033 shutdown_connections 2024-04-25T02:09:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.254+0000 7f991d163640 1 --2- 172.21.15.79:0/2779175033 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f990406be30 0x7f990406e2f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.254+0000 7f991d163640 1 --2- 172.21.15.79:0/2779175033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f991815e4f0 0x7f9918154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.254+0000 7f991d163640 1 --2- 172.21.15.79:0/2779175033 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99180cfc50 0x7f9918153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.254+0000 7f991d163640 1 --2- 172.21.15.79:0/2779175033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99180cf7f0 0x7f99180b26f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.254+0000 7f991d163640 1 -- 172.21.15.79:0/2779175033 >> 172.21.15.79:0/2779175033 conn(0x7f991809d4a0 msgr2=0x7f99180d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.254+0000 7f991d163640 1 -- 172.21.15.79:0/2779175033 shutdown_connections 2024-04-25T02:09:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.254+0000 7f991d163640 1 -- 172.21.15.79:0/2779175033 wait complete. 2024-04-25T02:09:21.272 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-25T02:09:21.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.362+0000 7f1e016b3640 1 Processor -- start 2024-04-25T02:09:21.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.362+0000 7f1e016b3640 1 -- start start 2024-04-25T02:09:21.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.362+0000 7f1e016b3640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1dfc15e4d0 0x7f1dfc06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.362+0000 7f1e016b3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1dfc0b3570 0x7f1dfc0d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.362+0000 7f1e016b3640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1dfc0b3020 0x7f1dfc0d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.362+0000 7f1e016b3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1dfc0d1660 con 0x7f1dfc0b3570 2024-04-25T02:09:21.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.362+0000 7f1e016b3640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f1dfc0d1380 con 0x7f1dfc15e4d0 2024-04-25T02:09:21.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.362+0000 7f1e016b3640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1dfc0cede0 con 0x7f1dfc0b3020 2024-04-25T02:09:21.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.363+0000 7f1dfa7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1dfc0b3570 0x7f1dfc0d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.363+0000 7f1dfa7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1dfc0b3570 0x7f1dfc0d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37284/0 (socket says 172.21.15.79:37284) 2024-04-25T02:09:21.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.363+0000 7f1dfa7fc640 1 -- 172.21.15.79:0/2424419104 learned_addr learned my addr 172.21.15.79:0/2424419104 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:21.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.363+0000 7f1dfb7fe640 1 --2- 172.21.15.79:0/2424419104 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1dfc0b3020 0x7f1dfc0d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.363+0000 7f1dfaffd640 1 --2- 172.21.15.79:0/2424419104 >> v2:172.21.15.189:3300/0 conn(0x7f1dfc15e4d0 0x7f1dfc06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.363+0000 7f1dfa7fc640 1 -- 172.21.15.79:0/2424419104 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1dfc0b3020 msgr2=0x7f1dfc0d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:21.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.363+0000 7f1dfa7fc640 1 --2- 172.21.15.79:0/2424419104 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1dfc0b3020 0x7f1dfc0d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.363+0000 7f1dfa7fc640 1 -- 172.21.15.79:0/2424419104 >> v2:172.21.15.189:3300/0 conn(0x7f1dfc15e4d0 msgr2=0x7f1dfc06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:21.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.363+0000 7f1dfa7fc640 1 --2- 172.21.15.79:0/2424419104 >> v2:172.21.15.189:3300/0 conn(0x7f1dfc15e4d0 0x7f1dfc06bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.363+0000 7f1dfa7fc640 1 -- 172.21.15.79:0/2424419104 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc0cf0c0 con 0x7f1dfc0b3570 2024-04-25T02:09:21.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.363+0000 7f1dfaffd640 1 --2- 172.21.15.79:0/2424419104 >> v2:172.21.15.189:3300/0 conn(0x7f1dfc15e4d0 0x7f1dfc06bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:21.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.363+0000 7f1dfb7fe640 1 --2- 172.21.15.79:0/2424419104 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1dfc0b3020 0x7f1dfc0d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:21.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.364+0000 7f1dfa7fc640 1 --2- 172.21.15.79:0/2424419104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0b3570 0x7f1dfc0d2710 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009870 tx=0x7f1de402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ccbb854f2494b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:21.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.364+0000 7f1df9ffb640 1 -- 172.21.15.79:0/2424419104 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de4037070 con 0x7f1dfc0b3570 2024-04-25T02:09:21.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.364+0000 7f1df9ffb640 1 -- 172.21.15.79:0/2424419104 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de4032440 con 0x7f1dfc0b3570 2024-04-25T02:09:21.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.364+0000 7f1df9ffb640 1 -- 172.21.15.79:0/2424419104 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de4032810 con 0x7f1dfc0b3570 2024-04-25T02:09:21.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.364+0000 7f1e016b3640 1 -- 172.21.15.79:0/2424419104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0b3570 msgr2=0x7f1dfc0d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.364+0000 7f1e016b3640 1 --2- 172.21.15.79:0/2424419104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0b3570 0x7f1dfc0d2710 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009870 tx=0x7f1de402a210 comp rx=0 tx=0).stop 2024-04-25T02:09:21.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.364+0000 7f1e016b3640 1 -- 172.21.15.79:0/2424419104 shutdown_connections 2024-04-25T02:09:21.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.364+0000 7f1e016b3640 1 --2- 172.21.15.79:0/2424419104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0b3570 0x7f1dfc0d2710 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.364+0000 7f1e016b3640 1 --2- 172.21.15.79:0/2424419104 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1dfc0b3020 0x7f1dfc0d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.364+0000 7f1e016b3640 1 --2- 172.21.15.79:0/2424419104 >> v2:172.21.15.189:3300/0 conn(0x7f1dfc15e4d0 0x7f1dfc06bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.364+0000 7f1e016b3640 1 -- 172.21.15.79:0/2424419104 >> 172.21.15.79:0/2424419104 conn(0x7f1dfc09d460 msgr2=0x7f1dfc0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:21.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.364+0000 7f1e016b3640 1 -- 172.21.15.79:0/2424419104 shutdown_connections 2024-04-25T02:09:21.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.364+0000 7f1e016b3640 1 -- 172.21.15.79:0/2424419104 wait complete. 2024-04-25T02:09:21.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.366+0000 7f1e016b3640 1 Processor -- start 2024-04-25T02:09:21.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.366+0000 7f1e016b3640 1 -- start start 2024-04-25T02:09:21.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.366+0000 7f1e016b3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0b3020 0x7f1dfc0b9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.366+0000 7f1e016b3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dfc0b3570 0x7f1dfc0cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.366+0000 7f1e016b3640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1dfc15e4d0 0x7f1dfc0b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.366+0000 7f1e016b3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc0d2250 con 0x7f1dfc0b3020 2024-04-25T02:09:21.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.366+0000 7f1e016b3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc0d20d0 con 0x7f1dfc0b3570 2024-04-25T02:09:21.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.366+0000 7f1e016b3640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1dfc06c1b0 con 0x7f1dfc15e4d0 2024-04-25T02:09:21.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.366+0000 7f1dfaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0b3020 0x7f1dfc0b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.366+0000 7f1dfaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0b3020 0x7f1dfc0b9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37296/0 (socket says 172.21.15.79:37296) 2024-04-25T02:09:21.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.366+0000 7f1dfaffd640 1 -- 172.21.15.79:0/2033447559 learned_addr learned my addr 172.21.15.79:0/2033447559 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:21.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.367+0000 7f1dfb7fe640 1 --2- 172.21.15.79:0/2033447559 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1dfc15e4d0 0x7f1dfc0b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.367+0000 7f1dfaffd640 1 -- 172.21.15.79:0/2033447559 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1dfc15e4d0 msgr2=0x7f1dfc0b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.367+0000 7f1dfaffd640 1 --2- 172.21.15.79:0/2033447559 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1dfc15e4d0 0x7f1dfc0b6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.367+0000 7f1dfaffd640 1 -- 172.21.15.79:0/2033447559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dfc0b3570 msgr2=0x7f1dfc0cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.367+0000 7f1dfa7fc640 1 --2- 172.21.15.79:0/2033447559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dfc0b3570 0x7f1dfc0cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.367+0000 7f1dfaffd640 1 --2- 172.21.15.79:0/2033447559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dfc0b3570 0x7f1dfc0cc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.367+0000 7f1dfaffd640 1 -- 172.21.15.79:0/2033447559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc0ccc80 con 0x7f1dfc0b3020 2024-04-25T02:09:21.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.367+0000 7f1dfaffd640 1 --2- 172.21.15.79:0/2033447559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0b3020 0x7f1dfc0b9450 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1df400c7f0 tx=0x7f1df400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:21.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.367+0000 7f1df37fe640 1 -- 172.21.15.79:0/2033447559 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df4015070 con 0x7f1dfc0b3020 2024-04-25T02:09:21.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.367+0000 7f1df37fe640 1 -- 172.21.15.79:0/2033447559 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df4007820 con 0x7f1dfc0b3020 2024-04-25T02:09:21.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.367+0000 7f1e016b3640 1 -- 172.21.15.79:0/2033447559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dfc0ccf60 con 0x7f1dfc0b3020 2024-04-25T02:09:21.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.367+0000 7f1df37fe640 1 -- 172.21.15.79:0/2033447559 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df4007bd0 con 0x7f1dfc0b3020 2024-04-25T02:09:21.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.367+0000 7f1e016b3640 1 -- 172.21.15.79:0/2033447559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dfc0cd520 con 0x7f1dfc0b3020 2024-04-25T02:09:21.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.368+0000 7f1e016b3640 1 -- 172.21.15.79:0/2033447559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dfc0690a0 con 0x7f1dfc0b3020 2024-04-25T02:09:21.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.369+0000 7f1df37fe640 1 -- 172.21.15.79:0/2033447559 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1df4018070 con 0x7f1dfc0b3020 2024-04-25T02:09:21.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.369+0000 7f1df37fe640 1 --2- 172.21.15.79:0/2033447559 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1ddc06be60 0x7f1ddc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.369+0000 7f1dfa7fc640 1 --2- 172.21.15.79:0/2033447559 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1ddc06be60 0x7f1ddc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.369+0000 7f1df37fe640 1 -- 172.21.15.79:0/2033447559 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f1df408ac60 con 0x7f1dfc0b3020 2024-04-25T02:09:21.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.370+0000 7f1dfa7fc640 1 --2- 172.21.15.79:0/2033447559 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1ddc06be60 0x7f1ddc06e320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1de4034000 tx=0x7f1de402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:21.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.373+0000 7f1df37fe640 1 -- 172.21.15.79:0/2033447559 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1df4059910 con 0x7f1dfc0b3020 2024-04-25T02:09:21.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.611+0000 7f1e016b3640 1 -- 172.21.15.79:0/2033447559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7f1dfc0d1920 con 0x7f1dfc0b3020 2024-04-25T02:09:21.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.660+0000 7f1df37fe640 1 -- 172.21.15.79:0/2033447559 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v99) ==== 152+0+0 (secure 0 0 0) 0x7f1df4059210 con 0x7f1dfc0b3020 2024-04-25T02:09:21.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.662+0000 7f1e016b3640 1 -- 172.21.15.79:0/2033447559 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1ddc06be60 msgr2=0x7f1ddc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.662+0000 7f1e016b3640 1 --2- 172.21.15.79:0/2033447559 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1ddc06be60 0x7f1ddc06e320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1de4034000 tx=0x7f1de402e000 comp rx=0 tx=0).stop 2024-04-25T02:09:21.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.662+0000 7f1e016b3640 1 -- 172.21.15.79:0/2033447559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0b3020 msgr2=0x7f1dfc0b9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.662+0000 7f1e016b3640 1 --2- 172.21.15.79:0/2033447559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0b3020 0x7f1dfc0b9450 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1df400c7f0 tx=0x7f1df400ccb0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.662+0000 7f1e016b3640 1 -- 172.21.15.79:0/2033447559 shutdown_connections 2024-04-25T02:09:21.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.662+0000 7f1e016b3640 1 --2- 172.21.15.79:0/2033447559 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1ddc06be60 0x7f1ddc06e320 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.662+0000 7f1e016b3640 1 --2- 172.21.15.79:0/2033447559 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1dfc15e4d0 0x7f1dfc0b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.662+0000 7f1e016b3640 1 --2- 172.21.15.79:0/2033447559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dfc0b3570 0x7f1dfc0cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.662+0000 7f1e016b3640 1 --2- 172.21.15.79:0/2033447559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0b3020 0x7f1dfc0b9450 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.662+0000 7f1e016b3640 1 -- 172.21.15.79:0/2033447559 >> 172.21.15.79:0/2033447559 conn(0x7f1dfc09d460 msgr2=0x7f1dfc0d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:21.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.662+0000 7f1e016b3640 1 -- 172.21.15.79:0/2033447559 shutdown_connections 2024-04-25T02:09:21.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.662+0000 7f1e016b3640 1 -- 172.21.15.79:0/2033447559 wait complete. 2024-04-25T02:09:21.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T02:09:21.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.774+0000 7f6ebf54f640 1 Processor -- start 2024-04-25T02:09:21.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.774+0000 7f6ebf54f640 1 -- start start 2024-04-25T02:09:21.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.775+0000 7f6ebf54f640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6eb80d10c0 0x7f6eb806bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.775+0000 7f6ebf54f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb80d1ee0 con 0x7f6eb80d2ca0 2024-04-25T02:09:21.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.775+0000 7f6ebf54f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb80d21c0 con 0x7f6eb815e4f0 2024-04-25T02:09:21.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.775+0000 7f6ebf54f640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6eb80d3130 con 0x7f6eb80d10c0 2024-04-25T02:09:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.775+0000 7f6ebcaea640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6eb80d2ca0 0x7f6eb80d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38616/0 (socket says 172.21.15.79:38616) 2024-04-25T02:09:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.775+0000 7f6ebcaea640 1 -- 172.21.15.79:0/3943003801 learned_addr learned my addr 172.21.15.79:0/3943003801 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6ebdaec640 1 --2- 172.21.15.79:0/3943003801 >> v2:172.21.15.189:3300/0 conn(0x7f6eb80d10c0 0x7f6eb806bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6eaffff640 1 -- 172.21.15.79:0/3943003801 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2419159852 0 0) 0x7f6eb80d1ee0 con 0x7f6eb80d2ca0 2024-04-25T02:09:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6eaffff640 1 -- 172.21.15.79:0/3943003801 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ea4003520 con 0x7f6eb80d2ca0 2024-04-25T02:09:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6eaffff640 1 -- 172.21.15.79:0/3943003801 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 881507113 0 0) 0x7f6ea4003520 con 0x7f6eb80d2ca0 2024-04-25T02:09:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6eaffff640 1 -- 172.21.15.79:0/3943003801 >> v2:172.21.15.189:3300/0 conn(0x7f6eb80d10c0 msgr2=0x7f6eb806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6eaffff640 1 --2- 172.21.15.79:0/3943003801 >> v2:172.21.15.189:3300/0 conn(0x7f6eb80d10c0 0x7f6eb806bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6eaffff640 1 -- 172.21.15.79:0/3943003801 >> v1:172.21.15.189:6789/0 conn(0x7f6eb815e4f0 legacy=0x7f6eb80cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6eaffff640 1 -- 172.21.15.79:0/3943003801 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb80d24a0 con 0x7f6eb80d2ca0 2024-04-25T02:09:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6eaffff640 1 -- 172.21.15.79:0/3943003801 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f6ea8001670 con 0x7f6eb80d2ca0 2024-04-25T02:09:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6eaffff640 1 -- 172.21.15.79:0/3943003801 >> v1:172.21.15.79:6789/0 conn(0x7f6eb80d2ca0 legacy=0x7f6eb80d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6eaffff640 1 --2- 172.21.15.79:0/3943003801 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ea40039b0 0x7f6ea4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6eaffff640 1 --2- 172.21.15.79:0/3943003801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ea4004800 0x7f6ea4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6eaffff640 1 --2- 172.21.15.79:0/3943003801 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ea40051c0 0x7f6ea400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6eaffff640 1 -- 172.21.15.79:0/3943003801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea400c030 con 0x7f6ea4004800 2024-04-25T02:09:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6eaffff640 1 -- 172.21.15.79:0/3943003801 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea400c1e0 con 0x7f6ea40051c0 2024-04-25T02:09:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6eaffff640 1 -- 172.21.15.79:0/3943003801 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea400c3e0 con 0x7f6ea40039b0 2024-04-25T02:09:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6ebcaea640 1 --2- 172.21.15.79:0/3943003801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ea4004800 0x7f6ea4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6ebdaec640 1 --2- 172.21.15.79:0/3943003801 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ea40051c0 0x7f6ea400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6ebd2eb640 1 --2- 172.21.15.79:0/3943003801 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ea40039b0 0x7f6ea4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6ebcaea640 1 -- 172.21.15.79:0/3943003801 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ea40039b0 msgr2=0x7f6ea4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6ebcaea640 1 --2- 172.21.15.79:0/3943003801 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ea40039b0 0x7f6ea4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6ebcaea640 1 -- 172.21.15.79:0/3943003801 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ea40051c0 msgr2=0x7f6ea400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6ebcaea640 1 --2- 172.21.15.79:0/3943003801 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ea40051c0 0x7f6ea400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6ebdaec640 1 -- 172.21.15.79:0/3943003801 reap_dead start 2024-04-25T02:09:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.776+0000 7f6ebcaea640 1 -- 172.21.15.79:0/3943003801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea4003520 con 0x7f6ea4004800 2024-04-25T02:09:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.777+0000 7f6ebcaea640 1 --2- 172.21.15.79:0/3943003801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ea4004800 0x7f6ea4004c80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800c240 tx=0x7f6ea4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6effc7b8fabfb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:21.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.777+0000 7f6eaffff640 1 -- 172.21.15.79:0/3943003801 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8007d10 con 0x7f6ea4004800 2024-04-25T02:09:21.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.777+0000 7f6eaffff640 1 -- 172.21.15.79:0/3943003801 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea8005ad0 con 0x7f6ea4004800 2024-04-25T02:09:21.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.777+0000 7f6eaffff640 1 -- 172.21.15.79:0/3943003801 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8007070 con 0x7f6ea4004800 2024-04-25T02:09:21.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.778+0000 7f6ebf54f640 1 -- 172.21.15.79:0/3943003801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ea4004800 msgr2=0x7f6ea4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.778+0000 7f6ebf54f640 1 --2- 172.21.15.79:0/3943003801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ea4004800 0x7f6ea4004c80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800c240 tx=0x7f6ea4005830 comp rx=0 tx=0).stop 2024-04-25T02:09:21.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.778+0000 7f6ebf54f640 1 -- 172.21.15.79:0/3943003801 shutdown_connections 2024-04-25T02:09:21.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.778+0000 7f6ebf54f640 1 --2- 172.21.15.79:0/3943003801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ea4004800 0x7f6ea4004c80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.778+0000 7f6ebf54f640 1 -- 172.21.15.79:0/3943003801 >> 172.21.15.79:0/3943003801 conn(0x7f6eb809d4a0 msgr2=0x7f6eb80d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:21.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.778+0000 7f6ebf54f640 1 -- 172.21.15.79:0/3943003801 shutdown_connections 2024-04-25T02:09:21.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.778+0000 7f6ebf54f640 1 -- 172.21.15.79:0/3943003801 wait complete. 2024-04-25T02:09:21.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.779+0000 7f6ebf54f640 1 Processor -- start 2024-04-25T02:09:21.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.779+0000 7f6ebf54f640 1 -- start start 2024-04-25T02:09:21.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebf54f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ea4004800 0x7f6eb80cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebf54f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6eb80cbc50 0x7f6eb815a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebf54f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6eb80c9b60 0x7f6eb80c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebf54f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb80d5060 con 0x7f6eb80cbc50 2024-04-25T02:09:21.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebf54f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb80d4ee0 con 0x7f6eb80c9b60 2024-04-25T02:09:21.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebf54f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6eb80d09b0 con 0x7f6ea4004800 2024-04-25T02:09:21.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebcaea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6eb80cbc50 0x7f6eb815a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebcaea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6eb80cbc50 0x7f6eb815a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37322/0 (socket says 172.21.15.79:37322) 2024-04-25T02:09:21.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebcaea640 1 -- 172.21.15.79:0/866685347 learned_addr learned my addr 172.21.15.79:0/866685347 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:21.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebdaec640 1 --2- 172.21.15.79:0/866685347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6eb80c9b60 0x7f6eb80c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebd2eb640 1 --2- 172.21.15.79:0/866685347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ea4004800 0x7f6eb80cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebcaea640 1 -- 172.21.15.79:0/866685347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ea4004800 msgr2=0x7f6eb80cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebcaea640 1 --2- 172.21.15.79:0/866685347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ea4004800 0x7f6eb80cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebcaea640 1 -- 172.21.15.79:0/866685347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6eb80c9b60 msgr2=0x7f6eb80c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebcaea640 1 --2- 172.21.15.79:0/866685347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6eb80c9b60 0x7f6eb80c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebcaea640 1 -- 172.21.15.79:0/866685347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb80cc0d0 con 0x7f6eb80cbc50 2024-04-25T02:09:21.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebcaea640 1 --2- 172.21.15.79:0/866685347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6eb80cbc50 0x7f6eb815a770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8001970 tx=0x7f6eb80d20b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:21.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6eadffb640 1 -- 172.21.15.79:0/866685347 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea803f020 con 0x7f6eb80cbc50 2024-04-25T02:09:21.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6eadffb640 1 -- 172.21.15.79:0/866685347 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea8001470 con 0x7f6eb80cbc50 2024-04-25T02:09:21.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6ebf54f640 1 -- 172.21.15.79:0/866685347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb80cc380 con 0x7f6eb80cbc50 2024-04-25T02:09:21.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.780+0000 7f6eadffb640 1 -- 172.21.15.79:0/866685347 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea80049e0 con 0x7f6eb80cbc50 2024-04-25T02:09:21.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.781+0000 7f6ebf54f640 1 -- 172.21.15.79:0/866685347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb80cc940 con 0x7f6eb80cbc50 2024-04-25T02:09:21.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.782+0000 7f6ebf54f640 1 -- 172.21.15.79:0/866685347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb80686c0 con 0x7f6eb80cbc50 2024-04-25T02:09:21.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.782+0000 7f6eadffb640 1 -- 172.21.15.79:0/866685347 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ea8042020 con 0x7f6eb80cbc50 2024-04-25T02:09:21.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.782+0000 7f6eadffb640 1 --2- 172.21.15.79:0/866685347 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e9c06be30 0x7f6e9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.782+0000 7f6eadffb640 1 -- 172.21.15.79:0/866685347 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f6ea80aa6d0 con 0x7f6eb80cbc50 2024-04-25T02:09:21.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.782+0000 7f6ebd2eb640 1 --2- 172.21.15.79:0/866685347 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e9c06be30 0x7f6e9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.783+0000 7f6ebd2eb640 1 --2- 172.21.15.79:0/866685347 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e9c06be30 0x7f6e9c06e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4000f80 tx=0x7f6eb4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:21.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.787+0000 7f6eadffb640 1 -- 172.21.15.79:0/866685347 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6ea8004b80 con 0x7f6eb80cbc50 2024-04-25T02:09:21.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.961+0000 7f6ebf54f640 1 -- 172.21.15.79:0/866685347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6eb80690a0 con 0x7f6eb80cbc50 2024-04-25T02:09:21.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.964+0000 7f6eadffb640 1 -- 172.21.15.79:0/866685347 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f6ea8078d30 con 0x7f6eb80cbc50 2024-04-25T02:09:21.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.966+0000 7f6ebf54f640 1 -- 172.21.15.79:0/866685347 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e9c06be30 msgr2=0x7f6e9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.966+0000 7f6ebf54f640 1 --2- 172.21.15.79:0/866685347 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e9c06be30 0x7f6e9c06e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4000f80 tx=0x7f6eb4009040 comp rx=0 tx=0).stop 2024-04-25T02:09:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.966+0000 7f6ebf54f640 1 -- 172.21.15.79:0/866685347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6eb80cbc50 msgr2=0x7f6eb815a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.966+0000 7f6ebf54f640 1 --2- 172.21.15.79:0/866685347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6eb80cbc50 0x7f6eb815a770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8001970 tx=0x7f6eb80d20b0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.966+0000 7f6ebf54f640 1 -- 172.21.15.79:0/866685347 shutdown_connections 2024-04-25T02:09:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.966+0000 7f6ebf54f640 1 --2- 172.21.15.79:0/866685347 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e9c06be30 0x7f6e9c06e2f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.966+0000 7f6ebf54f640 1 --2- 172.21.15.79:0/866685347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6eb80c9b60 0x7f6eb80c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.966+0000 7f6ebf54f640 1 --2- 172.21.15.79:0/866685347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6eb80cbc50 0x7f6eb815a770 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.966+0000 7f6ebf54f640 1 --2- 172.21.15.79:0/866685347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ea4004800 0x7f6eb80cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.966+0000 7f6ebf54f640 1 -- 172.21.15.79:0/866685347 >> 172.21.15.79:0/866685347 conn(0x7f6eb809d4a0 msgr2=0x7f6eb806bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.966+0000 7f6ebf54f640 1 -- 172.21.15.79:0/866685347 shutdown_connections 2024-04-25T02:09:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:21.966+0000 7f6ebf54f640 1 -- 172.21.15.79:0/866685347 wait complete. 2024-04-25T02:09:21.984 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:09:21.984 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:09:22.018 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:09:22.057 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:09:22.058 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:09:22.058 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:09:22.074 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:09:22.074 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:09:22.074 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:09:22.116 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:09:22.116 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:09:22.116 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:09:22.131 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:09:22.131 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:09:22.131 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:09:22.176 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:09:22.176 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T02:09:22.176 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:22.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.265+0000 7f32c3363640 1 Processor -- start 2024-04-25T02:09:22.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.265+0000 7f32c3363640 1 -- start start 2024-04-25T02:09:22.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.266+0000 7f32c3363640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f32bc15a720 0x7f32bc15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:22.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.266+0000 7f32c3363640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f32bc0d07a0 0x7f32bc0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:22.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.266+0000 7f32c3363640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32bc15f1c0 con 0x7f32bc0b47e0 2024-04-25T02:09:22.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.266+0000 7f32c3363640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f32bc0b4c30 con 0x7f32bc0d07a0 2024-04-25T02:09:22.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.266+0000 7f32c3363640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f32bc0b2e60 con 0x7f32bc15a720 2024-04-25T02:09:22.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.266+0000 7f32c08fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f32bc0d07a0 0x7f32bc0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:22.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.266+0000 7f32c1900640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f32bc0b47e0 0x7f32bc15ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38626/0 (socket says 172.21.15.79:38626) 2024-04-25T02:09:22.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.266+0000 7f32c1900640 1 -- 172.21.15.79:0/598013921 learned_addr learned my addr 172.21.15.79:0/598013921 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:22.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.266+0000 7f32c08fe640 1 -- 172.21.15.79:0/598013921 >> v2:172.21.15.189:3300/0 conn(0x7f32bc15a720 msgr2=0x7f32bc15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:22.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.266+0000 7f32c08fe640 1 --2- 172.21.15.79:0/598013921 >> v2:172.21.15.189:3300/0 conn(0x7f32bc15a720 0x7f32bc15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.266+0000 7f32c08fe640 1 -- 172.21.15.79:0/598013921 >> v1:172.21.15.79:6789/0 conn(0x7f32bc0b47e0 legacy=0x7f32bc15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:22.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.266+0000 7f32c08fe640 1 -- 172.21.15.79:0/598013921 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32bc0b3140 con 0x7f32bc0d07a0 2024-04-25T02:09:22.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.266+0000 7f32b3fff640 1 -- 172.21.15.79:0/598013921 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4029783407 0 0) 0x7f32b4001110 con 0x7f32bc0b47e0 2024-04-25T02:09:22.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.267+0000 7f32c08fe640 1 --2- 172.21.15.79:0/598013921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32bc0d07a0 0x7f32bc0b42a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f32bc074d80 tx=0x7f32ac02c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871e37bb05432332 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:22.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.267+0000 7f32b3fff640 1 -- 172.21.15.79:0/598013921 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac03a070 con 0x7f32bc0d07a0 2024-04-25T02:09:22.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.267+0000 7f32b3fff640 1 -- 172.21.15.79:0/598013921 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ac032480 con 0x7f32bc0d07a0 2024-04-25T02:09:22.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.267+0000 7f32b3fff640 1 -- 172.21.15.79:0/598013921 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac032850 con 0x7f32bc0d07a0 2024-04-25T02:09:22.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.268+0000 7f32c3363640 1 -- 172.21.15.79:0/598013921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32bc0d07a0 msgr2=0x7f32bc0b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.268+0000 7f32c3363640 1 --2- 172.21.15.79:0/598013921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32bc0d07a0 0x7f32bc0b42a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f32bc074d80 tx=0x7f32ac02c5c0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.268+0000 7f32c3363640 1 -- 172.21.15.79:0/598013921 shutdown_connections 2024-04-25T02:09:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.268+0000 7f32c3363640 1 --2- 172.21.15.79:0/598013921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32bc0d07a0 0x7f32bc0b42a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.268+0000 7f32c3363640 1 --2- 172.21.15.79:0/598013921 >> v2:172.21.15.189:3300/0 conn(0x7f32bc15a720 0x7f32bc15ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.268+0000 7f32c3363640 1 -- 172.21.15.79:0/598013921 >> 172.21.15.79:0/598013921 conn(0x7f32bc0cfc80 msgr2=0x7f32bc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.268+0000 7f32c3363640 1 -- 172.21.15.79:0/598013921 shutdown_connections 2024-04-25T02:09:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.268+0000 7f32c3363640 1 -- 172.21.15.79:0/598013921 wait complete. 2024-04-25T02:09:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.269+0000 7f32c3363640 1 Processor -- start 2024-04-25T02:09:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.269+0000 7f32c3363640 1 -- start start 2024-04-25T02:09:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c3363640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32bc0b47e0 0x7f32bc0cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c3363640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32bc0d07a0 0x7f32bc159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c3363640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32bc15a720 0x7f32bc159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c3363640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc0b39e0 con 0x7f32bc0b47e0 2024-04-25T02:09:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c3363640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc0b3700 con 0x7f32bc0d07a0 2024-04-25T02:09:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c3363640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f32bc071d00 con 0x7f32bc15a720 2024-04-25T02:09:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c10ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32bc0b47e0 0x7f32bc0cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c10ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32bc0b47e0 0x7f32bc0cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37340/0 (socket says 172.21.15.79:37340) 2024-04-25T02:09:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c10ff640 1 -- 172.21.15.79:0/1356030618 learned_addr learned my addr 172.21.15.79:0/1356030618 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c08fe640 1 --2- 172.21.15.79:0/1356030618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32bc0d07a0 0x7f32bc159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c10ff640 1 -- 172.21.15.79:0/1356030618 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32bc15a720 msgr2=0x7f32bc159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c10ff640 1 --2- 172.21.15.79:0/1356030618 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32bc15a720 0x7f32bc159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c10ff640 1 -- 172.21.15.79:0/1356030618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32bc0d07a0 msgr2=0x7f32bc159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c10ff640 1 --2- 172.21.15.79:0/1356030618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32bc0d07a0 0x7f32bc159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c10ff640 1 -- 172.21.15.79:0/1356030618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32bc1f47d0 con 0x7f32bc0b47e0 2024-04-25T02:09:22.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c10ff640 1 --2- 172.21.15.79:0/1356030618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32bc0b47e0 0x7f32bc0cbb60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f32b800ba50 tx=0x7f32b800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:22.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32b1ffb640 1 -- 172.21.15.79:0/1356030618 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8019070 con 0x7f32bc0b47e0 2024-04-25T02:09:22.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32b1ffb640 1 -- 172.21.15.79:0/1356030618 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b800cc00 con 0x7f32bc0b47e0 2024-04-25T02:09:22.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32c3363640 1 -- 172.21.15.79:0/1356030618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32bc1f4ab0 con 0x7f32bc0b47e0 2024-04-25T02:09:22.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.270+0000 7f32b1ffb640 1 -- 172.21.15.79:0/1356030618 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8014440 con 0x7f32bc0b47e0 2024-04-25T02:09:22.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.271+0000 7f32c3363640 1 -- 172.21.15.79:0/1356030618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32bc0ccd00 con 0x7f32bc0b47e0 2024-04-25T02:09:22.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.271+0000 7f32c3363640 1 -- 172.21.15.79:0/1356030618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32bc1f4fd0 con 0x7f32bc0b47e0 2024-04-25T02:09:22.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.272+0000 7f32b1ffb640 1 -- 172.21.15.79:0/1356030618 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32b801c070 con 0x7f32bc0b47e0 2024-04-25T02:09:22.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.272+0000 7f32b1ffb640 1 --2- 172.21.15.79:0/1356030618 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f32a006be30 0x7f32a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:22.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.272+0000 7f32b1ffb640 1 -- 172.21.15.79:0/1356030618 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f32b808a8f0 con 0x7f32bc0b47e0 2024-04-25T02:09:22.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.272+0000 7f32c08fe640 1 --2- 172.21.15.79:0/1356030618 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f32a006be30 0x7f32a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:22.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.273+0000 7f32c08fe640 1 --2- 172.21.15.79:0/1356030618 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f32a006be30 0x7f32a006e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f32ac037000 tx=0x7f32ac030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:22.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.277+0000 7f32b1ffb640 1 -- 172.21.15.79:0/1356030618 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f32bc1f4fd0 con 0x7f32bc0b47e0 2024-04-25T02:09:22.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.485+0000 7f32c3363640 1 -- 172.21.15.79:0/1356030618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32bc0690a0 con 0x7f32bc0b47e0 2024-04-25T02:09:22.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.485+0000 7f32b1ffb640 1 -- 172.21.15.79:0/1356030618 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+3869 (secure 0 0 0) 0x7f32b80595a0 con 0x7f32bc0b47e0 2024-04-25T02:09:22.493 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:22.493 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":14,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2251520552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2251520552},{"type":"v1","addr":"172.21.15.79:6836","nonce":2251520552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/1462215746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":1462215746},{"type":"v1","addr":"172.21.15.79:6837","nonce":1462215746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/647591120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":647591120},{"type":"v1","addr":"172.21.15.189:6835","nonce":647591120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":5106,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/2359417586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2359417586},{"type":"v1","addr":"172.21.15.189:6834","nonce":2359417586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-25T02:09:22.493 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 14 2024-04-25T02:09:22.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.487+0000 7f32c3363640 1 -- 172.21.15.79:0/1356030618 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f32a006be30 msgr2=0x7f32a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:22.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.487+0000 7f32c3363640 1 --2- 172.21.15.79:0/1356030618 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f32a006be30 0x7f32a006e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f32ac037000 tx=0x7f32ac030000 comp rx=0 tx=0).stop 2024-04-25T02:09:22.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.487+0000 7f32c3363640 1 -- 172.21.15.79:0/1356030618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32bc0b47e0 msgr2=0x7f32bc0cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:22.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.487+0000 7f32c3363640 1 --2- 172.21.15.79:0/1356030618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32bc0b47e0 0x7f32bc0cbb60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f32b800ba50 tx=0x7f32b800bf10 comp rx=0 tx=0).stop 2024-04-25T02:09:22.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.487+0000 7f32c3363640 1 -- 172.21.15.79:0/1356030618 shutdown_connections 2024-04-25T02:09:22.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.487+0000 7f32c3363640 1 --2- 172.21.15.79:0/1356030618 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f32a006be30 0x7f32a006e2f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.487+0000 7f32c3363640 1 --2- 172.21.15.79:0/1356030618 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32bc15a720 0x7f32bc159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.487+0000 7f32c3363640 1 --2- 172.21.15.79:0/1356030618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32bc0d07a0 0x7f32bc159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.487+0000 7f32c3363640 1 --2- 172.21.15.79:0/1356030618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32bc0b47e0 0x7f32bc0cbb60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.487+0000 7f32c3363640 1 -- 172.21.15.79:0/1356030618 >> 172.21.15.79:0/1356030618 conn(0x7f32bc0cfc80 msgr2=0x7f32bc06e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:22.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.487+0000 7f32c3363640 1 -- 172.21.15.79:0/1356030618 shutdown_connections 2024-04-25T02:09:22.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.487+0000 7f32c3363640 1 -- 172.21.15.79:0/1356030618 wait complete. 2024-04-25T02:09:22.506 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T02:09:22.506 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T02:09:22.506 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T02:09:22.506 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:09:22.506 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T02:09:22.507 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T02:09:22.507 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T02:09:22.507 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:09:22.507 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T02:09:22.507 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T02:09:22.507 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T02:09:22.507 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:09:22.508 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T02:09:22.508 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T02:09:22.508 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T02:09:22.508 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:09:22.518 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T02:09:22.518 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T02:09:22.519 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T02:09:22.519 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T02:09:22.520 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T02:09:22.520 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T02:09:22.521 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T02:09:22.521 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T02:09:22.560 INFO:tasks.ceph.mds.a:Started 2024-04-25T02:09:22.561 DEBUG:teuthology.parallel:result is None 2024-04-25T02:09:22.562 INFO:tasks.ceph.mds.c:Started 2024-04-25T02:09:22.562 DEBUG:teuthology.parallel:result is None 2024-04-25T02:09:22.566 INFO:tasks.ceph.mds.b:Started 2024-04-25T02:09:22.567 INFO:tasks.ceph.mds.d:Started 2024-04-25T02:09:22.567 DEBUG:teuthology.parallel:result is None 2024-04-25T02:09:22.567 DEBUG:teuthology.parallel:result is None 2024-04-25T02:09:22.567 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T02:09:22.634 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-04-25T02:09:22.634 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:09:22.645 INFO:tasks.ceph.mds.b.smithi189.stdout:starting mds.b at 2024-04-25T02:09:22.646 INFO:tasks.ceph.mds.d.smithi189.stdout:starting mds.d at 2024-04-25T02:09:22.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.660+0000 7fd25ce1c640 1 Processor -- start 2024-04-25T02:09:22.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.660+0000 7fd25ce1c640 1 -- start start 2024-04-25T02:09:22.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.661+0000 7fd25ce1c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd258143bc0 0x7fd25815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:22.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.661+0000 7fd25ce1c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd25806df50 0x7fd25806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:22.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.661+0000 7fd25ce1c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd25815fa40 con 0x7fd2580b48e0 2024-04-25T02:09:22.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.661+0000 7fd25ce1c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd25806e8f0 con 0x7fd25806df50 2024-04-25T02:09:22.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.661+0000 7fd25ce1c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd258072cb0 con 0x7fd258143bc0 2024-04-25T02:09:22.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.661+0000 7fd25659c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd258143bc0 0x7fd25815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:22.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.661+0000 7fd256d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd2580b48e0 0x7fd2580b4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38638/0 (socket says 172.21.15.79:38638) 2024-04-25T02:09:22.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.661+0000 7fd24ffff640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd25806df50 0x7fd25806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:22.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.661+0000 7fd256d9d640 1 -- 172.21.15.79:0/3753592954 learned_addr learned my addr 172.21.15.79:0/3753592954 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:22.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.662+0000 7fd25659c640 1 -- 172.21.15.79:0/3753592954 >> v2:172.21.15.189:3300/0 conn(0x7fd25806df50 msgr2=0x7fd25806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:22.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.662+0000 7fd25659c640 1 --2- 172.21.15.79:0/3753592954 >> v2:172.21.15.189:3300/0 conn(0x7fd25806df50 0x7fd25806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.662+0000 7fd25659c640 1 -- 172.21.15.79:0/3753592954 >> v1:172.21.15.79:6789/0 conn(0x7fd2580b48e0 legacy=0x7fd2580b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:22.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.662+0000 7fd25659c640 1 -- 172.21.15.79:0/3753592954 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2580720a0 con 0x7fd258143bc0 2024-04-25T02:09:22.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.662+0000 7fd24ffff640 1 --2- 172.21.15.79:0/3753592954 >> v2:172.21.15.189:3300/0 conn(0x7fd25806df50 0x7fd25806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:22.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.663+0000 7fd25659c640 1 --2- 172.21.15.79:0/3753592954 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd258143bc0 0x7fd25815f500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd2480097a0 tx=0x7fd24802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a97563d00e177be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:22.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.665+0000 7fd255d9b640 1 -- 172.21.15.79:0/3753592954 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd248037070 con 0x7fd258143bc0 2024-04-25T02:09:22.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.665+0000 7fd255d9b640 1 -- 172.21.15.79:0/3753592954 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24802ae50 con 0x7fd258143bc0 2024-04-25T02:09:22.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.665+0000 7fd255d9b640 1 -- 172.21.15.79:0/3753592954 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd248032660 con 0x7fd258143bc0 2024-04-25T02:09:22.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.665+0000 7fd25ce1c640 1 -- 172.21.15.79:0/3753592954 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd258143bc0 msgr2=0x7fd25815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:22.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.665+0000 7fd25ce1c640 1 --2- 172.21.15.79:0/3753592954 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd258143bc0 0x7fd25815f500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd2480097a0 tx=0x7fd24802a100 comp rx=0 tx=0).stop 2024-04-25T02:09:22.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.666+0000 7fd25ce1c640 1 -- 172.21.15.79:0/3753592954 shutdown_connections 2024-04-25T02:09:22.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.666+0000 7fd25ce1c640 1 --2- 172.21.15.79:0/3753592954 >> v2:172.21.15.189:3300/0 conn(0x7fd25806df50 0x7fd25806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.666+0000 7fd25ce1c640 1 --2- 172.21.15.79:0/3753592954 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd258143bc0 0x7fd25815f500 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.666+0000 7fd25ce1c640 1 -- 172.21.15.79:0/3753592954 >> 172.21.15.79:0/3753592954 conn(0x7fd2580cfc80 msgr2=0x7fd2580d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:22.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.666+0000 7fd25ce1c640 1 -- 172.21.15.79:0/3753592954 shutdown_connections 2024-04-25T02:09:22.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.666+0000 7fd25ce1c640 1 -- 172.21.15.79:0/3753592954 wait complete. 2024-04-25T02:09:22.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.667+0000 7fd25ce1c640 1 Processor -- start 2024-04-25T02:09:22.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.667+0000 7fd25ce1c640 1 -- start start 2024-04-25T02:09:22.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.668+0000 7fd25ce1c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd25806df50 0x7fd2581f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:22.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.668+0000 7fd25ce1c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2580b48e0 0x7fd25815b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:22.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.668+0000 7fd25ce1c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd258143bc0 0x7fd25815a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:22.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.668+0000 7fd25ce1c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd258072940 con 0x7fd25806df50 2024-04-25T02:09:22.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.668+0000 7fd25ce1c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd258072660 con 0x7fd2580b48e0 2024-04-25T02:09:22.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.668+0000 7fd25ce1c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd258143fa0 con 0x7fd258143bc0 2024-04-25T02:09:22.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.668+0000 7fd25659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd25806df50 0x7fd2581f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:22.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.668+0000 7fd25659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd25806df50 0x7fd2581f81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37388/0 (socket says 172.21.15.79:37388) 2024-04-25T02:09:22.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.668+0000 7fd25659c640 1 -- 172.21.15.79:0/754483932 learned_addr learned my addr 172.21.15.79:0/754483932 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:22.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.668+0000 7fd24ffff640 1 --2- 172.21.15.79:0/754483932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2580b48e0 0x7fd25815b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:22.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.668+0000 7fd256d9d640 1 --2- 172.21.15.79:0/754483932 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd258143bc0 0x7fd25815a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:22.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.669+0000 7fd25659c640 1 -- 172.21.15.79:0/754483932 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd258143bc0 msgr2=0x7fd25815a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:22.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.669+0000 7fd25659c640 1 --2- 172.21.15.79:0/754483932 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd258143bc0 0x7fd25815a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.669+0000 7fd25659c640 1 -- 172.21.15.79:0/754483932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2580b48e0 msgr2=0x7fd25815b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:22.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.669+0000 7fd25659c640 1 --2- 172.21.15.79:0/754483932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2580b48e0 0x7fd25815b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.669+0000 7fd25659c640 1 -- 172.21.15.79:0/754483932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25815c120 con 0x7fd25806df50 2024-04-25T02:09:22.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.669+0000 7fd25659c640 1 --2- 172.21.15.79:0/754483932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd25806df50 0x7fd2581f81d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd248035040 tx=0x7fd2480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:22.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.671+0000 7fd24effd640 1 -- 172.21.15.79:0/754483932 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd248041070 con 0x7fd25806df50 2024-04-25T02:09:22.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.671+0000 7fd25ce1c640 1 -- 172.21.15.79:0/754483932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd25815c400 con 0x7fd25806df50 2024-04-25T02:09:22.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.671+0000 7fd25ce1c640 1 -- 172.21.15.79:0/754483932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd25815be30 con 0x7fd25806df50 2024-04-25T02:09:22.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.671+0000 7fd24effd640 1 -- 172.21.15.79:0/754483932 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24803c460 con 0x7fd25806df50 2024-04-25T02:09:22.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.671+0000 7fd24effd640 1 -- 172.21.15.79:0/754483932 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd248037040 con 0x7fd25806df50 2024-04-25T02:09:22.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.672+0000 7fd25ce1c640 1 -- 172.21.15.79:0/754483932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd23c005290 con 0x7fd25806df50 2024-04-25T02:09:22.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.673+0000 7fd24effd640 1 -- 172.21.15.79:0/754483932 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd24803a070 con 0x7fd25806df50 2024-04-25T02:09:22.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.673+0000 7fd24effd640 1 --2- 172.21.15.79:0/754483932 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd23806be30 0x7fd23806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:22.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.673+0000 7fd24effd640 1 -- 172.21.15.79:0/754483932 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7fd2480aaee0 con 0x7fd25806df50 2024-04-25T02:09:22.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.673+0000 7fd24ffff640 1 --2- 172.21.15.79:0/754483932 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd23806be30 0x7fd23806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:22.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.674+0000 7fd24ffff640 1 --2- 172.21.15.79:0/754483932 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd23806be30 0x7fd23806e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd240009560 tx=0x7fd240009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:22.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.679+0000 7fd24effd640 1 -- 172.21.15.79:0/754483932 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd2480795d0 con 0x7fd25806df50 2024-04-25T02:09:22.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:22.862+0000 7fd25ce1c640 1 -- 172.21.15.79:0/754483932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd23c005850 con 0x7fd25806df50 2024-04-25T02:09:23.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.673+0000 7fd24effd640 1 -- 172.21.15.79:0/754483932 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) ==== 97+0+0 (secure 0 0 0) 0x7fd24807d8d0 con 0x7fd25806df50 2024-04-25T02:09:23.681 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2024-04-25T02:09:23.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.676+0000 7fd25ce1c640 1 -- 172.21.15.79:0/754483932 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd23806be30 msgr2=0x7fd23806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.676+0000 7fd25ce1c640 1 --2- 172.21.15.79:0/754483932 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd23806be30 0x7fd23806e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd240009560 tx=0x7fd240009190 comp rx=0 tx=0).stop 2024-04-25T02:09:23.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.676+0000 7fd25ce1c640 1 -- 172.21.15.79:0/754483932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd25806df50 msgr2=0x7fd2581f81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.676+0000 7fd25ce1c640 1 --2- 172.21.15.79:0/754483932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd25806df50 0x7fd2581f81d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd248035040 tx=0x7fd2480046c0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.676+0000 7fd25ce1c640 1 -- 172.21.15.79:0/754483932 shutdown_connections 2024-04-25T02:09:23.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.676+0000 7fd25ce1c640 1 --2- 172.21.15.79:0/754483932 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd23806be30 0x7fd23806e2f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.676+0000 7fd25ce1c640 1 --2- 172.21.15.79:0/754483932 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd258143bc0 0x7fd25815a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.676+0000 7fd25ce1c640 1 --2- 172.21.15.79:0/754483932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2580b48e0 0x7fd25815b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.676+0000 7fd25ce1c640 1 --2- 172.21.15.79:0/754483932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd25806df50 0x7fd2581f81d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.676+0000 7fd25ce1c640 1 -- 172.21.15.79:0/754483932 >> 172.21.15.79:0/754483932 conn(0x7fd2580cfc80 msgr2=0x7fd2580adb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:23.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.676+0000 7fd25ce1c640 1 -- 172.21.15.79:0/754483932 shutdown_connections 2024-04-25T02:09:23.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.676+0000 7fd25ce1c640 1 -- 172.21.15.79:0/754483932 wait complete. 2024-04-25T02:09:23.696 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T02:09:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.791+0000 7f439d015640 1 Processor -- start 2024-04-25T02:09:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.791+0000 7f439d015640 1 -- start start 2024-04-25T02:09:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.792+0000 7f439d015640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f43980b33e0 0x7f4398166fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.792+0000 7f439d015640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43980d0480 con 0x7f43980b16a0 2024-04-25T02:09:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.792+0000 7f439d015640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43980b10e0 con 0x7f439815f830 2024-04-25T02:09:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.792+0000 7f439d015640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f43980b13c0 con 0x7f43980b33e0 2024-04-25T02:09:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.792+0000 7f439659c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f43980b16a0 0x7f43980b1ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45988/0 (socket says 172.21.15.79:45988) 2024-04-25T02:09:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.792+0000 7f439659c640 1 -- 172.21.15.79:0/688826647 learned_addr learned my addr 172.21.15.79:0/688826647 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.792+0000 7f439759e640 1 --2- 172.21.15.79:0/688826647 >> v2:172.21.15.189:3300/0 conn(0x7f43980b33e0 0x7f4398166fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.792+0000 7f4395d9b640 1 -- 172.21.15.79:0/688826647 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 927757553 0 0) 0x7f43980d0480 con 0x7f43980b16a0 2024-04-25T02:09:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f4395d9b640 1 -- 172.21.15.79:0/688826647 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4380003520 con 0x7f43980b16a0 2024-04-25T02:09:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f4395d9b640 1 -- 172.21.15.79:0/688826647 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2304296923 0 0) 0x7f4380003520 con 0x7f43980b16a0 2024-04-25T02:09:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f4395d9b640 1 -- 172.21.15.79:0/688826647 >> v2:172.21.15.189:3300/0 conn(0x7f43980b33e0 msgr2=0x7f4398166fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f4395d9b640 1 --2- 172.21.15.79:0/688826647 >> v2:172.21.15.189:3300/0 conn(0x7f43980b33e0 0x7f4398166fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f4395d9b640 1 -- 172.21.15.79:0/688826647 >> v1:172.21.15.189:6789/0 conn(0x7f439815f830 legacy=0x7f43980b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f4395d9b640 1 -- 172.21.15.79:0/688826647 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43980d0740 con 0x7f43980b16a0 2024-04-25T02:09:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f4395d9b640 1 -- 172.21.15.79:0/688826647 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f438c001670 con 0x7f43980b16a0 2024-04-25T02:09:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f4395d9b640 1 -- 172.21.15.79:0/688826647 >> v1:172.21.15.79:6789/0 conn(0x7f43980b16a0 legacy=0x7f43980b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f4395d9b640 1 --2- 172.21.15.79:0/688826647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43800039b0 0x7f4380003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f4395d9b640 1 --2- 172.21.15.79:0/688826647 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4380004800 0x7f4380004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f4395d9b640 1 --2- 172.21.15.79:0/688826647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43800051c0 0x7f438000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f4395d9b640 1 -- 172.21.15.79:0/688826647 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43980b13c0 con 0x7f43800051c0 2024-04-25T02:09:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f4395d9b640 1 -- 172.21.15.79:0/688826647 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f438000c060 con 0x7f43800039b0 2024-04-25T02:09:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f4395d9b640 1 -- 172.21.15.79:0/688826647 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f438000c260 con 0x7f4380004800 2024-04-25T02:09:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f439759e640 1 --2- 172.21.15.79:0/688826647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43800051c0 0x7f438000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f4396d9d640 1 --2- 172.21.15.79:0/688826647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43800039b0 0x7f4380003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f439659c640 1 --2- 172.21.15.79:0/688826647 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4380004800 0x7f4380004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f439759e640 1 -- 172.21.15.79:0/688826647 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4380004800 msgr2=0x7f4380004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f439759e640 1 --2- 172.21.15.79:0/688826647 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4380004800 0x7f4380004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f439759e640 1 -- 172.21.15.79:0/688826647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43800039b0 msgr2=0x7f4380003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f439759e640 1 --2- 172.21.15.79:0/688826647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43800039b0 0x7f4380003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.793+0000 7f439759e640 1 -- 172.21.15.79:0/688826647 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4380003520 con 0x7f43800051c0 2024-04-25T02:09:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.794+0000 7f439759e640 1 -- 172.21.15.79:0/688826647 reap_dead start 2024-04-25T02:09:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.794+0000 7f439759e640 1 --2- 172.21.15.79:0/688826647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43800051c0 0x7f438000b9c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4388009fc0 tx=0x7f4380005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f91ccd21bf602eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.794+0000 7f4395d9b640 1 -- 172.21.15.79:0/688826647 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388035020 con 0x7f43800051c0 2024-04-25T02:09:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.794+0000 7f4395d9b640 1 -- 172.21.15.79:0/688826647 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4388003bd0 con 0x7f43800051c0 2024-04-25T02:09:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.794+0000 7f4395d9b640 1 -- 172.21.15.79:0/688826647 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388009c10 con 0x7f43800051c0 2024-04-25T02:09:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.795+0000 7f439d015640 1 -- 172.21.15.79:0/688826647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43800051c0 msgr2=0x7f438000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.795+0000 7f439d015640 1 --2- 172.21.15.79:0/688826647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43800051c0 0x7f438000b9c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4388009fc0 tx=0x7f4380005830 comp rx=0 tx=0).stop 2024-04-25T02:09:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.795+0000 7f439d015640 1 -- 172.21.15.79:0/688826647 shutdown_connections 2024-04-25T02:09:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.795+0000 7f439d015640 1 --2- 172.21.15.79:0/688826647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43800051c0 0x7f438000b9c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.795+0000 7f439d015640 1 -- 172.21.15.79:0/688826647 >> 172.21.15.79:0/688826647 conn(0x7f43980d1ea0 msgr2=0x7f43980d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.795+0000 7f439d015640 1 -- 172.21.15.79:0/688826647 shutdown_connections 2024-04-25T02:09:23.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.795+0000 7f439d015640 1 -- 172.21.15.79:0/688826647 wait complete. 2024-04-25T02:09:23.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.796+0000 7f439d015640 1 Processor -- start 2024-04-25T02:09:23.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.796+0000 7f439d015640 1 -- start start 2024-04-25T02:09:23.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439d015640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800051c0 0x7f43980ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:23.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439d015640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43980c7790 0x7f43980c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:23.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439d015640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4398152380 0x7f43981527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:23.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439d015640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43980d2c00 con 0x7f4398152380 2024-04-25T02:09:23.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439d015640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f43980b0db0 con 0x7f43980c7790 2024-04-25T02:09:23.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439d015640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f439815fc10 con 0x7f43800051c0 2024-04-25T02:09:23.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4398152380 0x7f43981527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:23.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4398152380 0x7f43981527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47386/0 (socket says 172.21.15.79:47386) 2024-04-25T02:09:23.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439759e640 1 -- 172.21.15.79:0/1594531345 learned_addr learned my addr 172.21.15.79:0/1594531345 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:23.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439659c640 1 --2- 172.21.15.79:0/1594531345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43980c7790 0x7f43980c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:23.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f4396d9d640 1 --2- 172.21.15.79:0/1594531345 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800051c0 0x7f43980ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:23.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439759e640 1 -- 172.21.15.79:0/1594531345 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800051c0 msgr2=0x7f43980ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439759e640 1 --2- 172.21.15.79:0/1594531345 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800051c0 0x7f43980ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439759e640 1 -- 172.21.15.79:0/1594531345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43980c7790 msgr2=0x7f43980c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439759e640 1 --2- 172.21.15.79:0/1594531345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43980c7790 0x7f43980c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439759e640 1 -- 172.21.15.79:0/1594531345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43980c8f70 con 0x7f4398152380 2024-04-25T02:09:23.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.797+0000 7f439659c640 1 --2- 172.21.15.79:0/1594531345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43980c7790 0x7f43980c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:23.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.798+0000 7f439759e640 1 --2- 172.21.15.79:0/1594531345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4398152380 0x7f43981527e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f438800e230 tx=0x7f4388009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:23.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.798+0000 7f437f7fe640 1 -- 172.21.15.79:0/1594531345 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388040070 con 0x7f4398152380 2024-04-25T02:09:23.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.798+0000 7f437f7fe640 1 -- 172.21.15.79:0/1594531345 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4388032e80 con 0x7f4398152380 2024-04-25T02:09:23.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.798+0000 7f439d015640 1 -- 172.21.15.79:0/1594531345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43980c9250 con 0x7f4398152380 2024-04-25T02:09:23.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.798+0000 7f437f7fe640 1 -- 172.21.15.79:0/1594531345 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388035030 con 0x7f4398152380 2024-04-25T02:09:23.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.798+0000 7f439d015640 1 -- 172.21.15.79:0/1594531345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43980c9810 con 0x7f4398152380 2024-04-25T02:09:23.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.799+0000 7f439d015640 1 -- 172.21.15.79:0/1594531345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43980681e0 con 0x7f4398152380 2024-04-25T02:09:23.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.799+0000 7f437f7fe640 1 -- 172.21.15.79:0/1594531345 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4388043070 con 0x7f4398152380 2024-04-25T02:09:23.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.800+0000 7f437f7fe640 1 --2- 172.21.15.79:0/1594531345 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f438406be30 0x7f438406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:23.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.800+0000 7f437f7fe640 1 -- 172.21.15.79:0/1594531345 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f43880abbb0 con 0x7f4398152380 2024-04-25T02:09:23.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.800+0000 7f4396d9d640 1 --2- 172.21.15.79:0/1594531345 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f438406be30 0x7f438406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:23.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.800+0000 7f4396d9d640 1 --2- 172.21.15.79:0/1594531345 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f438406be30 0x7f438406e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4390000c00 tx=0x7f4390009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:23.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:23.804+0000 7f437f7fe640 1 -- 172.21.15.79:0/1594531345 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f438807a250 con 0x7f4398152380 2024-04-25T02:09:24.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.041+0000 7f439d015640 1 -- 172.21.15.79:0/1594531345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f43980c5620 con 0x7f4398152380 2024-04-25T02:09:24.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.042+0000 7f437f7fe640 1 -- 172.21.15.79:0/1594531345 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) ==== 80+0+5304 (secure 0 0 0) 0x7f438807e550 con 0x7f4398152380 2024-04-25T02:09:24.049 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:24.049 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:09:24.049 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2024-04-25T02:09:24.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.050 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2024-04-25T02:09:24.050 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmkSfsJhAAEP9aqirUawsrrvVUkxkO0w==", 2024-04-25T02:09:24.050 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.050 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:09:24.050 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:09:24.050 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:09:24.050 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:09:24.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.050 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2024-04-25T02:09:24.050 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilm8wYYMhAA98c3h9c80Y9zYzVv+kY7qQ==", 2024-04-25T02:09:24.050 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.050 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:09:24.050 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:09:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:09:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:09:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2024-04-25T02:09:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmiqSiLRAAmCUWUrHC31tkg0dkXS54cA==", 2024-04-25T02:09:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:09:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:09:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:09:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:09:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmiPbkOBAA+rBwAypY5jrR3xafG9h1sw==", 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDJuilmP1AdGBAAS0IkH2E3XQvkxA33GInm5w==", 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:09:24.052 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:09:24.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.053 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2024-04-25T02:09:24.053 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDMuilm479HFhAA8iIjBC94pqHikS5kPHipCQ==", 2024-04-25T02:09:24.053 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.053 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:09:24.053 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:09:24.053 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:09:24.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.053 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2024-04-25T02:09:24.053 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDPuilmE+k9FBAARX3P/kjt7ybeVHGGyYaWwg==", 2024-04-25T02:09:24.053 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.054 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:09:24.054 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:09:24.054 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:09:24.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.054 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2024-04-25T02:09:24.054 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDSuilmUF41EhAA1HhTXWnhVwETe+4hxmxjFw==", 2024-04-25T02:09:24.054 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.054 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:09:24.054 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:09:24.054 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:09:24.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.055 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2024-04-25T02:09:24.055 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDYuilm2pisGRAAFBmWVAGib2guJobYooLQoA==", 2024-04-25T02:09:24.055 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.055 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:09:24.055 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:09:24.055 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:09:24.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.055 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2024-04-25T02:09:24.055 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDbuilm28m9FxAA8GOmzxRAlK6o/RTe+FpL7g==", 2024-04-25T02:09:24.055 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.055 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:09:24.055 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:09:24.055 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:09:24.056 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.056 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2024-04-25T02:09:24.056 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDeuilmzDRyFRAAKk7JWPVRxxE+B4OCJhaXvg==", 2024-04-25T02:09:24.056 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.056 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:09:24.056 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:09:24.056 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:09:24.056 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.056 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2024-04-25T02:09:24.056 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDhuilmQABhExAA40Inq4eg4oohO3tmNdCyPQ==", 2024-04-25T02:09:24.056 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g==", 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2024-04-25T02:09:24.057 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilm8EWZCRAAjRomNRANd7sC+tpYZ1uE6w==", 2024-04-25T02:09:24.058 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.058 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:09:24.058 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:09:24.058 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:09:24.058 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:09:24.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.058 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2024-04-25T02:09:24.058 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmHUedBhAA84h2PNUgReBGQ3rubcEDsw==", 2024-04-25T02:09:24.058 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.058 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:09:24.058 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:09:24.059 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:09:24.059 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:09:24.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.059 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2024-04-25T02:09:24.059 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmCx4UDxAAZmQdQB8RdTMr2JKr7TMySg==", 2024-04-25T02:09:24.059 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.059 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:09:24.059 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:09:24.059 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:09:24.059 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:09:24.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.060 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2024-04-25T02:09:24.060 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmFgdeDBAAu+VeVhknKsm+Gxzh5+qANg==", 2024-04-25T02:09:24.060 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.060 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:09:24.060 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:09:24.060 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:09:24.060 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:09:24.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.060 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2024-04-25T02:09:24.060 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmXrLhIxAAiq13px9HksQtu+qjoRi1qQ==", 2024-04-25T02:09:24.060 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.060 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:09:24.061 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-04-25T02:09:24.061 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:09:24.061 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:24.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.061 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2024-04-25T02:09:24.061 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmV8dxIBAA8GX2T/ZqZF+3qDjtddh/ZQ==", 2024-04-25T02:09:24.061 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:09:24.061 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:09:24.061 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-04-25T02:09:24.061 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:09:24.061 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.061 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.061 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T02:09:24.062 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:09:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.044+0000 7f439d015640 1 -- 172.21.15.79:0/1594531345 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f438406be30 msgr2=0x7f438406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.044+0000 7f439d015640 1 --2- 172.21.15.79:0/1594531345 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f438406be30 0x7f438406e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4390000c00 tx=0x7f4390009040 comp rx=0 tx=0).stop 2024-04-25T02:09:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.044+0000 7f439d015640 1 -- 172.21.15.79:0/1594531345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4398152380 msgr2=0x7f43981527e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.044+0000 7f439d015640 1 --2- 172.21.15.79:0/1594531345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4398152380 0x7f43981527e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f438800e230 tx=0x7f4388009750 comp rx=0 tx=0).stop 2024-04-25T02:09:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.044+0000 7f439d015640 1 -- 172.21.15.79:0/1594531345 shutdown_connections 2024-04-25T02:09:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.044+0000 7f439d015640 1 --2- 172.21.15.79:0/1594531345 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f438406be30 0x7f438406e2f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.044+0000 7f439d015640 1 --2- 172.21.15.79:0/1594531345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4398152380 0x7f43981527e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.044+0000 7f439d015640 1 --2- 172.21.15.79:0/1594531345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43980c7790 0x7f43980c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.044+0000 7f439d015640 1 --2- 172.21.15.79:0/1594531345 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800051c0 0x7f43980ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.044+0000 7f439d015640 1 -- 172.21.15.79:0/1594531345 >> 172.21.15.79:0/1594531345 conn(0x7f43980d1ea0 msgr2=0x7f439815d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.044+0000 7f439d015640 1 -- 172.21.15.79:0/1594531345 shutdown_connections 2024-04-25T02:09:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.044+0000 7f439d015640 1 -- 172.21.15.79:0/1594531345 wait complete. 2024-04-25T02:09:24.064 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:24.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.153+0000 7fe7fd3b6640 1 Processor -- start 2024-04-25T02:09:24.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.153+0000 7fe7fd3b6640 1 -- start start 2024-04-25T02:09:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.154+0000 7fe7fd3b6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe7f80b3570 0x7fe7f80d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.154+0000 7fe7fd3b6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7f806c380 con 0x7fe7f815e4d0 2024-04-25T02:09:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.154+0000 7fe7fd3b6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7f80d1660 con 0x7fe7f80b3020 2024-04-25T02:09:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.154+0000 7fe7fd3b6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe7f80d1380 con 0x7fe7f80b3570 2024-04-25T02:09:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.154+0000 7fe7f6ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe7f815e4d0 0x7fe7f806bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45996/0 (socket says 172.21.15.79:45996) 2024-04-25T02:09:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.154+0000 7fe7f6ffd640 1 -- 172.21.15.79:0/633674658 learned_addr learned my addr 172.21.15.79:0/633674658 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.154+0000 7fe7f67fc640 1 --2- 172.21.15.79:0/633674658 >> v2:172.21.15.79:3300/0 conn(0x7fe7f80b3570 0x7fe7f80d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.155+0000 7fe7f67fc640 1 -- 172.21.15.79:0/633674658 >> v1:172.21.15.189:6789/0 conn(0x7fe7f80b3020 legacy=0x7fe7f80cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.155+0000 7fe7f67fc640 1 -- 172.21.15.79:0/633674658 >> v1:172.21.15.79:6789/0 conn(0x7fe7f815e4d0 legacy=0x7fe7f806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.155+0000 7fe7f67fc640 1 -- 172.21.15.79:0/633674658 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f80cede0 con 0x7fe7f80b3570 2024-04-25T02:09:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.155+0000 7fe7f5ffb640 1 -- 172.21.15.79:0/633674658 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907052089 0 0) 0x7fe7f806c380 con 0x7fe7f815e4d0 2024-04-25T02:09:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.155+0000 7fe7f67fc640 1 --2- 172.21.15.79:0/633674658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f80b3570 0x7fe7f80d2710 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0097d0 tx=0x7fe7ec02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce1f1a717fd5cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.155+0000 7fe7f5ffb640 1 -- 172.21.15.79:0/633674658 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec037070 con 0x7fe7f80b3570 2024-04-25T02:09:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.156+0000 7fe7f5ffb640 1 -- 172.21.15.79:0/633674658 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ec032440 con 0x7fe7f80b3570 2024-04-25T02:09:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.156+0000 7fe7f5ffb640 1 -- 172.21.15.79:0/633674658 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec032810 con 0x7fe7f80b3570 2024-04-25T02:09:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.156+0000 7fe7fd3b6640 1 -- 172.21.15.79:0/633674658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f80b3570 msgr2=0x7fe7f80d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.156+0000 7fe7fd3b6640 1 --2- 172.21.15.79:0/633674658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f80b3570 0x7fe7f80d2710 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0097d0 tx=0x7fe7ec02a210 comp rx=0 tx=0).stop 2024-04-25T02:09:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.156+0000 7fe7fd3b6640 1 -- 172.21.15.79:0/633674658 shutdown_connections 2024-04-25T02:09:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.156+0000 7fe7fd3b6640 1 --2- 172.21.15.79:0/633674658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f80b3570 0x7fe7f80d2710 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.156+0000 7fe7fd3b6640 1 -- 172.21.15.79:0/633674658 >> 172.21.15.79:0/633674658 conn(0x7fe7f809d460 msgr2=0x7fe7f80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:24.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.156+0000 7fe7fd3b6640 1 -- 172.21.15.79:0/633674658 shutdown_connections 2024-04-25T02:09:24.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.156+0000 7fe7fd3b6640 1 -- 172.21.15.79:0/633674658 wait complete. 2024-04-25T02:09:24.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.157+0000 7fe7fd3b6640 1 Processor -- start 2024-04-25T02:09:24.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.157+0000 7fe7fd3b6640 1 -- start start 2024-04-25T02:09:24.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.158+0000 7fe7fd3b6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f80b3020 0x7fe7f80b9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.158+0000 7fe7fd3b6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7f80b3570 0x7fe7f8145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.158+0000 7fe7fd3b6640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7f815e4d0 0x7fe7f8145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.158+0000 7fe7fd3b6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f80d20d0 con 0x7fe7f80b3020 2024-04-25T02:09:24.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.158+0000 7fe7fd3b6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f815e8b0 con 0x7fe7f80b3570 2024-04-25T02:09:24.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.158+0000 7fe7fd3b6640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f80d2250 con 0x7fe7f815e4d0 2024-04-25T02:09:24.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.158+0000 7fe7f6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f80b3020 0x7fe7f80b9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.158+0000 7fe7f6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f80b3020 0x7fe7f80b9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47408/0 (socket says 172.21.15.79:47408) 2024-04-25T02:09:24.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.158+0000 7fe7f6ffd640 1 -- 172.21.15.79:0/696793139 learned_addr learned my addr 172.21.15.79:0/696793139 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.158+0000 7fe7f67fc640 1 --2- 172.21.15.79:0/696793139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7f80b3570 0x7fe7f8145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.158+0000 7fe7f77fe640 1 --2- 172.21.15.79:0/696793139 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7f815e4d0 0x7fe7f8145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.159+0000 7fe7f6ffd640 1 -- 172.21.15.79:0/696793139 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7f815e4d0 msgr2=0x7fe7f8145b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.159+0000 7fe7f6ffd640 1 --2- 172.21.15.79:0/696793139 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7f815e4d0 0x7fe7f8145b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.159+0000 7fe7f6ffd640 1 -- 172.21.15.79:0/696793139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7f80b3570 msgr2=0x7fe7f8145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.159+0000 7fe7f6ffd640 1 --2- 172.21.15.79:0/696793139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7f80b3570 0x7fe7f8145620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.159+0000 7fe7f6ffd640 1 -- 172.21.15.79:0/696793139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f80cb200 con 0x7fe7f80b3020 2024-04-25T02:09:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.159+0000 7fe7f6ffd640 1 --2- 172.21.15.79:0/696793139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f80b3020 0x7fe7f80b9590 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800c7c0 tx=0x7fe7e800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.159+0000 7fe7df7fe640 1 -- 172.21.15.79:0/696793139 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8018070 con 0x7fe7f80b3020 2024-04-25T02:09:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.159+0000 7fe7df7fe640 1 -- 172.21.15.79:0/696793139 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e800a640 con 0x7fe7f80b3020 2024-04-25T02:09:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.159+0000 7fe7fd3b6640 1 -- 172.21.15.79:0/696793139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f80cb4e0 con 0x7fe7f80b3020 2024-04-25T02:09:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.159+0000 7fe7df7fe640 1 -- 172.21.15.79:0/696793139 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800aa30 con 0x7fe7f80b3020 2024-04-25T02:09:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.159+0000 7fe7fd3b6640 1 -- 172.21.15.79:0/696793139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f80c9970 con 0x7fe7f80b3020 2024-04-25T02:09:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.160+0000 7fe7fd3b6640 1 -- 172.21.15.79:0/696793139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f80690a0 con 0x7fe7f80b3020 2024-04-25T02:09:24.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.160+0000 7fe7df7fe640 1 -- 172.21.15.79:0/696793139 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe7e801b070 con 0x7fe7f80b3020 2024-04-25T02:09:24.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.161+0000 7fe7df7fe640 1 --2- 172.21.15.79:0/696793139 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe7e406be30 0x7fe7e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.161+0000 7fe7df7fe640 1 -- 172.21.15.79:0/696793139 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7fe7e808a150 con 0x7fe7f80b3020 2024-04-25T02:09:24.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.161+0000 7fe7f67fc640 1 --2- 172.21.15.79:0/696793139 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe7e406be30 0x7fe7e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.161+0000 7fe7f67fc640 1 --2- 172.21.15.79:0/696793139 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe7e406be30 0x7fe7e406e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec034000 tx=0x7fe7ec02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:24.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.165+0000 7fe7df7fe640 1 -- 172.21.15.79:0/696793139 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe7e8058e50 con 0x7fe7f80b3020 2024-04-25T02:09:24.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.339+0000 7fe7fd3b6640 1 -- 172.21.15.79:0/696793139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7f80c73a0 con 0x7fe7f80b3020 2024-04-25T02:09:24.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.339+0000 7fe7df7fe640 1 -- 172.21.15.79:0/696793139 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+12903 (secure 0 0 0) 0x7fe7e8058750 con 0x7fe7f80b3020 2024-04-25T02:09:24.347 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:24.347 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":41,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:09:23.673102+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.341+0000 7fe7fd3b6640 1 -- 172.21.15.79:0/696793139 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe7e406be30 msgr2=0x7fe7e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.341+0000 7fe7fd3b6640 1 --2- 172.21.15.79:0/696793139 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe7e406be30 0x7fe7e406e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec034000 tx=0x7fe7ec02e000 comp rx=0 tx=0).stop 2024-04-25T02:09:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.341+0000 7fe7fd3b6640 1 -- 172.21.15.79:0/696793139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f80b3020 msgr2=0x7fe7f80b9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.341+0000 7fe7fd3b6640 1 --2- 172.21.15.79:0/696793139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f80b3020 0x7fe7f80b9590 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800c7c0 tx=0x7fe7e800cc80 comp rx=0 tx=0).stop 2024-04-25T02:09:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.341+0000 7fe7fd3b6640 1 -- 172.21.15.79:0/696793139 shutdown_connections 2024-04-25T02:09:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.341+0000 7fe7fd3b6640 1 --2- 172.21.15.79:0/696793139 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe7e406be30 0x7fe7e406e2f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.341+0000 7fe7fd3b6640 1 --2- 172.21.15.79:0/696793139 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7f815e4d0 0x7fe7f8145b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.341+0000 7fe7fd3b6640 1 --2- 172.21.15.79:0/696793139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7f80b3570 0x7fe7f8145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.341+0000 7fe7fd3b6640 1 --2- 172.21.15.79:0/696793139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f80b3020 0x7fe7f80b9590 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.341+0000 7fe7fd3b6640 1 -- 172.21.15.79:0/696793139 >> 172.21.15.79:0/696793139 conn(0x7fe7f809d460 msgr2=0x7fe7f815c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:24.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.341+0000 7fe7fd3b6640 1 -- 172.21.15.79:0/696793139 shutdown_connections 2024-04-25T02:09:24.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.341+0000 7fe7fd3b6640 1 -- 172.21.15.79:0/696793139 wait complete. 2024-04-25T02:09:24.360 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:09:24.360 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:09:24.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.452+0000 7f42a149a640 1 Processor -- start 2024-04-25T02:09:24.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.452+0000 7f42a149a640 1 -- start start 2024-04-25T02:09:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.453+0000 7f42a149a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f429c15e4f0 0x7f429c0d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.453+0000 7f42a149a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f429c0d10c0 0x7f429c06bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.453+0000 7f42a149a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f429c0d1ee0 con 0x7f429c0cf7f0 2024-04-25T02:09:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.453+0000 7f42a149a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f429c0d21c0 con 0x7f429c15e4f0 2024-04-25T02:09:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.453+0000 7f42a149a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f429c0d24a0 con 0x7f429c0d10c0 2024-04-25T02:09:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.453+0000 7f429affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f429c15e4f0 0x7f429c0d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.453+0000 7f429affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f429c15e4f0 0x7f429c0d2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47416/0 (socket says 172.21.15.79:47416) 2024-04-25T02:09:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.453+0000 7f429affd640 1 -- 172.21.15.79:0/2002787502 learned_addr learned my addr 172.21.15.79:0/2002787502 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.453+0000 7f429a7fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f429c0cf7f0 0x7f429c0d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46008/0 (socket says 172.21.15.79:46008) 2024-04-25T02:09:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.454+0000 7f429b7fe640 1 --2- 172.21.15.79:0/2002787502 >> v2:172.21.15.189:3300/0 conn(0x7f429c0d10c0 0x7f429c06bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.454+0000 7f429affd640 1 -- 172.21.15.79:0/2002787502 >> v2:172.21.15.189:3300/0 conn(0x7f429c0d10c0 msgr2=0x7f429c06bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.454+0000 7f429affd640 1 --2- 172.21.15.79:0/2002787502 >> v2:172.21.15.189:3300/0 conn(0x7f429c0d10c0 0x7f429c06bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.454+0000 7f4299ffb640 1 -- 172.21.15.79:0/2002787502 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 507167976 0 0) 0x7f429c0d1ee0 con 0x7f429c0cf7f0 2024-04-25T02:09:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.454+0000 7f429affd640 1 -- 172.21.15.79:0/2002787502 >> v1:172.21.15.79:6789/0 conn(0x7f429c0cf7f0 legacy=0x7f429c0d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.454+0000 7f429affd640 1 -- 172.21.15.79:0/2002787502 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429c0d2780 con 0x7f429c15e4f0 2024-04-25T02:09:24.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.454+0000 7f429affd640 1 --2- 172.21.15.79:0/2002787502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429c15e4f0 0x7f429c0d2ca0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f428c009e50 tx=0x7f428c02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b660ce60c19a134e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.455+0000 7f4299ffb640 1 -- 172.21.15.79:0/2002787502 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c036070 con 0x7f429c15e4f0 2024-04-25T02:09:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.455+0000 7f4299ffb640 1 -- 172.21.15.79:0/2002787502 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f428c031600 con 0x7f429c15e4f0 2024-04-25T02:09:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.455+0000 7f4299ffb640 1 -- 172.21.15.79:0/2002787502 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c0319d0 con 0x7f429c15e4f0 2024-04-25T02:09:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.455+0000 7f42a149a640 1 -- 172.21.15.79:0/2002787502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429c15e4f0 msgr2=0x7f429c0d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.455+0000 7f42a149a640 1 --2- 172.21.15.79:0/2002787502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429c15e4f0 0x7f429c0d2ca0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f428c009e50 tx=0x7f428c02a760 comp rx=0 tx=0).stop 2024-04-25T02:09:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.455+0000 7f42a149a640 1 -- 172.21.15.79:0/2002787502 shutdown_connections 2024-04-25T02:09:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.455+0000 7f42a149a640 1 --2- 172.21.15.79:0/2002787502 >> v2:172.21.15.189:3300/0 conn(0x7f429c0d10c0 0x7f429c06bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.455+0000 7f42a149a640 1 --2- 172.21.15.79:0/2002787502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429c15e4f0 0x7f429c0d2ca0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.455+0000 7f42a149a640 1 -- 172.21.15.79:0/2002787502 >> 172.21.15.79:0/2002787502 conn(0x7f429c09d4a0 msgr2=0x7f429c0d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.455+0000 7f42a149a640 1 -- 172.21.15.79:0/2002787502 shutdown_connections 2024-04-25T02:09:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.455+0000 7f42a149a640 1 -- 172.21.15.79:0/2002787502 wait complete. 2024-04-25T02:09:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.456+0000 7f42a149a640 1 Processor -- start 2024-04-25T02:09:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.456+0000 7f42a149a640 1 -- start start 2024-04-25T02:09:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.457+0000 7f42a149a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f429c0cf7f0 0x7f429c1554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.457+0000 7f42a149a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f429c0d10c0 0x7f429c0ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.457+0000 7f42a149a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429c15e4f0 0x7f429c15bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.457+0000 7f42a149a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f429c0cfc80 con 0x7f429c15e4f0 2024-04-25T02:09:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.457+0000 7f42a149a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f429c0d50f0 con 0x7f429c0cf7f0 2024-04-25T02:09:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.457+0000 7f42a149a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f429c0cfe00 con 0x7f429c0d10c0 2024-04-25T02:09:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.457+0000 7f429b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429c15e4f0 0x7f429c15bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.457+0000 7f429b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429c15e4f0 0x7f429c15bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47434/0 (socket says 172.21.15.79:47434) 2024-04-25T02:09:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.457+0000 7f429b7fe640 1 -- 172.21.15.79:0/2583989388 learned_addr learned my addr 172.21.15.79:0/2583989388 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.457+0000 7f429affd640 1 --2- 172.21.15.79:0/2583989388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f429c0cf7f0 0x7f429c1554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.458+0000 7f429a7fc640 1 --2- 172.21.15.79:0/2583989388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f429c0d10c0 0x7f429c0ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.458+0000 7f429b7fe640 1 -- 172.21.15.79:0/2583989388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f429c0d10c0 msgr2=0x7f429c0ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.458+0000 7f429b7fe640 1 --2- 172.21.15.79:0/2583989388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f429c0d10c0 0x7f429c0ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.458+0000 7f429b7fe640 1 -- 172.21.15.79:0/2583989388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f429c0cf7f0 msgr2=0x7f429c1554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.458+0000 7f429b7fe640 1 --2- 172.21.15.79:0/2583989388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f429c0cf7f0 0x7f429c1554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.458+0000 7f429b7fe640 1 -- 172.21.15.79:0/2583989388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429c0cb3e0 con 0x7f429c15e4f0 2024-04-25T02:09:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.458+0000 7f429a7fc640 1 --2- 172.21.15.79:0/2583989388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f429c0d10c0 0x7f429c0ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.458+0000 7f429b7fe640 1 --2- 172.21.15.79:0/2583989388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429c15e4f0 0x7f429c15bd40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f429400c550 tx=0x7f429400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.458+0000 7f42837fe640 1 -- 172.21.15.79:0/2583989388 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294015070 con 0x7f429c15e4f0 2024-04-25T02:09:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.458+0000 7f42837fe640 1 -- 172.21.15.79:0/2583989388 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4294004220 con 0x7f429c15e4f0 2024-04-25T02:09:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.458+0000 7f42a149a640 1 -- 172.21.15.79:0/2583989388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429c0cb6c0 con 0x7f429c15e4f0 2024-04-25T02:09:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.458+0000 7f42837fe640 1 -- 172.21.15.79:0/2583989388 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294003610 con 0x7f429c15e4f0 2024-04-25T02:09:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.458+0000 7f42a149a640 1 -- 172.21.15.79:0/2583989388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f429c0cbc80 con 0x7f429c15e4f0 2024-04-25T02:09:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.459+0000 7f42a149a640 1 -- 172.21.15.79:0/2583989388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f429c0686c0 con 0x7f429c15e4f0 2024-04-25T02:09:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.459+0000 7f42837fe640 1 -- 172.21.15.79:0/2583989388 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f42940037b0 con 0x7f429c15e4f0 2024-04-25T02:09:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.460+0000 7f42837fe640 1 --2- 172.21.15.79:0/2583989388 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f428806be60 0x7f428806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.460+0000 7f42837fe640 1 -- 172.21.15.79:0/2583989388 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f429408a810 con 0x7f429c15e4f0 2024-04-25T02:09:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.460+0000 7f429affd640 1 --2- 172.21.15.79:0/2583989388 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f428806be60 0x7f428806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.460+0000 7f429affd640 1 --2- 172.21.15.79:0/2583989388 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f428806be60 0x7f428806e320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f428c033000 tx=0x7f428c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.464+0000 7f42837fe640 1 -- 172.21.15.79:0/2583989388 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f42940595a0 con 0x7f429c15e4f0 2024-04-25T02:09:24.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.635+0000 7f42a149a640 1 -- 172.21.15.79:0/2583989388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f429c0690a0 con 0x7f429c15e4f0 2024-04-25T02:09:24.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.635+0000 7f42837fe640 1 -- 172.21.15.79:0/2583989388 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) ==== 93+0+10 (secure 0 0 0) 0x7f4294058ea0 con 0x7f429c15e4f0 2024-04-25T02:09:24.642 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:09:24.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.637+0000 7f42a149a640 1 -- 172.21.15.79:0/2583989388 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f428806be60 msgr2=0x7f428806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.637+0000 7f42a149a640 1 --2- 172.21.15.79:0/2583989388 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f428806be60 0x7f428806e320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f428c033000 tx=0x7f428c009000 comp rx=0 tx=0).stop 2024-04-25T02:09:24.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.637+0000 7f42a149a640 1 -- 172.21.15.79:0/2583989388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429c15e4f0 msgr2=0x7f429c15bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.637+0000 7f42a149a640 1 --2- 172.21.15.79:0/2583989388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429c15e4f0 0x7f429c15bd40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f429400c550 tx=0x7f429400ca10 comp rx=0 tx=0).stop 2024-04-25T02:09:24.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.637+0000 7f42a149a640 1 -- 172.21.15.79:0/2583989388 shutdown_connections 2024-04-25T02:09:24.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.637+0000 7f42a149a640 1 --2- 172.21.15.79:0/2583989388 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f428806be60 0x7f428806e320 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.637+0000 7f42a149a640 1 --2- 172.21.15.79:0/2583989388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429c15e4f0 0x7f429c15bd40 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.637+0000 7f42a149a640 1 --2- 172.21.15.79:0/2583989388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f429c0d10c0 0x7f429c0ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.637+0000 7f42a149a640 1 --2- 172.21.15.79:0/2583989388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f429c0cf7f0 0x7f429c1554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.637+0000 7f42a149a640 1 -- 172.21.15.79:0/2583989388 >> 172.21.15.79:0/2583989388 conn(0x7f429c09d4a0 msgr2=0x7f429c15ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:24.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.637+0000 7f42a149a640 1 -- 172.21.15.79:0/2583989388 shutdown_connections 2024-04-25T02:09:24.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.637+0000 7f42a149a640 1 -- 172.21.15.79:0/2583989388 wait complete. 2024-04-25T02:09:24.655 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T02:09:24.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.745+0000 7fb3def42640 1 Processor -- start 2024-04-25T02:09:24.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.745+0000 7fb3def42640 1 -- start start 2024-04-25T02:09:24.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.746+0000 7fb3def42640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb3d806e3b0 0x7fb3d80b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.746+0000 7fb3def42640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3d8071e00 con 0x7fb3d8143bc0 2024-04-25T02:09:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.746+0000 7fb3def42640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3d80720a0 con 0x7fb3d806df50 2024-04-25T02:09:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.746+0000 7fb3def42640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb3d8072cb0 con 0x7fb3d806e3b0 2024-04-25T02:09:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.746+0000 7fb3dd4df640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb3d806e3b0 0x7fb3d80b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.746+0000 7fb3dccde640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb3d8143bc0 0x7fb3d815f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46022/0 (socket says 172.21.15.79:46022) 2024-04-25T02:09:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.746+0000 7fb3dccde640 1 -- 172.21.15.79:0/3125199395 learned_addr learned my addr 172.21.15.79:0/3125199395 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.746+0000 7fb3dd4df640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb3d806e3b0 0x7fb3d80b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47444/0 (socket says 172.21.15.79:47444) 2024-04-25T02:09:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.746+0000 7fb3dd4df640 1 -- 172.21.15.79:0/3125199395 >> v1:172.21.15.189:6789/0 conn(0x7fb3d806df50 legacy=0x7fb3d80b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.746+0000 7fb3dd4df640 1 -- 172.21.15.79:0/3125199395 >> v1:172.21.15.79:6789/0 conn(0x7fb3d8143bc0 legacy=0x7fb3d815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.746+0000 7fb3dd4df640 1 -- 172.21.15.79:0/3125199395 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d8072380 con 0x7fb3d806e3b0 2024-04-25T02:09:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.746+0000 7fb3d77fe640 1 -- 172.21.15.79:0/3125199395 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653887037 0 0) 0x7fb3d8071e00 con 0x7fb3d8143bc0 2024-04-25T02:09:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.747+0000 7fb3dd4df640 1 --2- 172.21.15.79:0/3125199395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3d806e3b0 0x7fb3d80b3440 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009d90 tx=0x7fb3d002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ef2baee87e979d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.747+0000 7fb3d77fe640 1 -- 172.21.15.79:0/3125199395 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0007740 con 0x7fb3d806e3b0 2024-04-25T02:09:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.747+0000 7fb3d77fe640 1 -- 172.21.15.79:0/3125199395 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d00078e0 con 0x7fb3d806e3b0 2024-04-25T02:09:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.747+0000 7fb3d77fe640 1 -- 172.21.15.79:0/3125199395 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0007cb0 con 0x7fb3d806e3b0 2024-04-25T02:09:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.748+0000 7fb3def42640 1 -- 172.21.15.79:0/3125199395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3d806e3b0 msgr2=0x7fb3d80b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.748+0000 7fb3def42640 1 --2- 172.21.15.79:0/3125199395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3d806e3b0 0x7fb3d80b3440 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009d90 tx=0x7fb3d002a660 comp rx=0 tx=0).stop 2024-04-25T02:09:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.748+0000 7fb3def42640 1 -- 172.21.15.79:0/3125199395 shutdown_connections 2024-04-25T02:09:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.748+0000 7fb3def42640 1 --2- 172.21.15.79:0/3125199395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3d806e3b0 0x7fb3d80b3440 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.748+0000 7fb3def42640 1 -- 172.21.15.79:0/3125199395 >> 172.21.15.79:0/3125199395 conn(0x7fb3d80cfc80 msgr2=0x7fb3d80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:24.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.748+0000 7fb3def42640 1 -- 172.21.15.79:0/3125199395 shutdown_connections 2024-04-25T02:09:24.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.748+0000 7fb3def42640 1 -- 172.21.15.79:0/3125199395 wait complete. 2024-04-25T02:09:24.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.749+0000 7fb3def42640 1 Processor -- start 2024-04-25T02:09:24.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.749+0000 7fb3def42640 1 -- start start 2024-04-25T02:09:24.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3def42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3d806df50 0x7fb3d81566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3def42640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb3d806e3b0 0x7fb3d8140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3def42640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3d8143bc0 0x7fb3d81f7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3def42640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d806e840 con 0x7fb3d806df50 2024-04-25T02:09:24.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3def42640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d8072940 con 0x7fb3d8143bc0 2024-04-25T02:09:24.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3def42640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d8143fa0 con 0x7fb3d806e3b0 2024-04-25T02:09:24.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3dccde640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3d806df50 0x7fb3d81566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3dccde640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3d806df50 0x7fb3d81566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47452/0 (socket says 172.21.15.79:47452) 2024-04-25T02:09:24.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3dccde640 1 -- 172.21.15.79:0/3683866580 learned_addr learned my addr 172.21.15.79:0/3683866580 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:24.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3d7fff640 1 --2- 172.21.15.79:0/3683866580 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb3d806e3b0 0x7fb3d8140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3dd4df640 1 --2- 172.21.15.79:0/3683866580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3d8143bc0 0x7fb3d81f7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3dccde640 1 -- 172.21.15.79:0/3683866580 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb3d806e3b0 msgr2=0x7fb3d8140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3dccde640 1 --2- 172.21.15.79:0/3683866580 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb3d806e3b0 0x7fb3d8140fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3dccde640 1 -- 172.21.15.79:0/3683866580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3d8143bc0 msgr2=0x7fb3d81f7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3dccde640 1 --2- 172.21.15.79:0/3683866580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3d8143bc0 0x7fb3d81f7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3dccde640 1 -- 172.21.15.79:0/3683866580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d8140200 con 0x7fb3d806df50 2024-04-25T02:09:24.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3dccde640 1 --2- 172.21.15.79:0/3683866580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3d806df50 0x7fb3d81566e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00c4a0 tx=0x7fb3cc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:24.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3d57fa640 1 -- 172.21.15.79:0/3683866580 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc018070 con 0x7fb3d806df50 2024-04-25T02:09:24.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3d57fa640 1 -- 172.21.15.79:0/3683866580 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3cc0074e0 con 0x7fb3d806df50 2024-04-25T02:09:24.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3def42640 1 -- 172.21.15.79:0/3683866580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d81404e0 con 0x7fb3d806df50 2024-04-25T02:09:24.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3d57fa640 1 -- 172.21.15.79:0/3683866580 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc004a20 con 0x7fb3d806df50 2024-04-25T02:09:24.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.750+0000 7fb3def42640 1 -- 172.21.15.79:0/3683866580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d8152490 con 0x7fb3d806df50 2024-04-25T02:09:24.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.751+0000 7fb3def42640 1 -- 172.21.15.79:0/3683866580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3d80690a0 con 0x7fb3d806df50 2024-04-25T02:09:24.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.752+0000 7fb3d57fa640 1 -- 172.21.15.79:0/3683866580 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3cc01b070 con 0x7fb3d806df50 2024-04-25T02:09:24.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.752+0000 7fb3d57fa640 1 --2- 172.21.15.79:0/3683866580 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb3bc06be30 0x7fb3bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.752+0000 7fb3d57fa640 1 -- 172.21.15.79:0/3683866580 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7fb3cc089d90 con 0x7fb3d806df50 2024-04-25T02:09:24.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.752+0000 7fb3d7fff640 1 --2- 172.21.15.79:0/3683866580 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb3bc06be30 0x7fb3bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.753+0000 7fb3d7fff640 1 --2- 172.21.15.79:0/3683866580 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb3bc06be30 0x7fb3bc06e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb3d806efe0 tx=0x7fb3c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:24.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.756+0000 7fb3d57fa640 1 -- 172.21.15.79:0/3683866580 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb3cc058b20 con 0x7fb3d806df50 2024-04-25T02:09:24.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.930+0000 7fb3def42640 1 -- 172.21.15.79:0/3683866580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb3d80b36b0 con 0x7fb3d806df50 2024-04-25T02:09:24.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.930+0000 7fb3d57fa640 1 -- 172.21.15.79:0/3683866580 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) ==== 84+0+65 (secure 0 0 0) 0x7fb3cc058420 con 0x7fb3d806df50 2024-04-25T02:09:24.938 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:24.938 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-04-25T02:09:24.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:24.938 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-04-25T02:09:24.938 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-04-25T02:09:24.938 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:24.938 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-04-25T02:09:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.932+0000 7fb3def42640 1 -- 172.21.15.79:0/3683866580 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb3bc06be30 msgr2=0x7fb3bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.932+0000 7fb3def42640 1 --2- 172.21.15.79:0/3683866580 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb3bc06be30 0x7fb3bc06e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb3d806efe0 tx=0x7fb3c4009040 comp rx=0 tx=0).stop 2024-04-25T02:09:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.932+0000 7fb3def42640 1 -- 172.21.15.79:0/3683866580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3d806df50 msgr2=0x7fb3d81566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.932+0000 7fb3def42640 1 --2- 172.21.15.79:0/3683866580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3d806df50 0x7fb3d81566e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00c4a0 tx=0x7fb3cc00c960 comp rx=0 tx=0).stop 2024-04-25T02:09:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.932+0000 7fb3def42640 1 -- 172.21.15.79:0/3683866580 shutdown_connections 2024-04-25T02:09:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.932+0000 7fb3def42640 1 --2- 172.21.15.79:0/3683866580 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb3bc06be30 0x7fb3bc06e2f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.932+0000 7fb3def42640 1 --2- 172.21.15.79:0/3683866580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3d8143bc0 0x7fb3d81f7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.932+0000 7fb3def42640 1 --2- 172.21.15.79:0/3683866580 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb3d806e3b0 0x7fb3d8140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.932+0000 7fb3def42640 1 --2- 172.21.15.79:0/3683866580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3d806df50 0x7fb3d81566e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.932+0000 7fb3def42640 1 -- 172.21.15.79:0/3683866580 >> 172.21.15.79:0/3683866580 conn(0x7fb3d80cfc80 msgr2=0x7fb3d8070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.932+0000 7fb3def42640 1 -- 172.21.15.79:0/3683866580 shutdown_connections 2024-04-25T02:09:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:24.932+0000 7fb3def42640 1 -- 172.21.15.79:0/3683866580 wait complete. 2024-04-25T02:09:24.950 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T02:09:24.951 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T02:09:25.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.043+0000 7fb1432ca640 1 Processor -- start 2024-04-25T02:09:25.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.043+0000 7fb1432ca640 1 -- start start 2024-04-25T02:09:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.044+0000 7fb1432ca640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb13c06d2f0 0x7fb13c06d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.044+0000 7fb1432ca640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb13c070cb0 con 0x7fb13c0b3db0 2024-04-25T02:09:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.044+0000 7fb1432ca640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb13c070f90 con 0x7fb13c14be70 2024-04-25T02:09:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.044+0000 7fb1432ca640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb13c06dca0 con 0x7fb13c06d2f0 2024-04-25T02:09:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.044+0000 7fb140865640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb13c06d2f0 0x7fb13c06d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.044+0000 7fb141867640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb13c0b3db0 0x7fb13c0b4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46026/0 (socket says 172.21.15.79:46026) 2024-04-25T02:09:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.044+0000 7fb141867640 1 -- 172.21.15.79:0/2982630128 learned_addr learned my addr 172.21.15.79:0/2982630128 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.044+0000 7fb140865640 1 -- 172.21.15.79:0/2982630128 >> v1:172.21.15.189:6789/0 conn(0x7fb13c14be70 legacy=0x7fb13c0cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.044+0000 7fb133fff640 1 -- 172.21.15.79:0/2982630128 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2464368873 0 0) 0x7fb13c070cb0 con 0x7fb13c0b3db0 2024-04-25T02:09:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.044+0000 7fb140865640 1 -- 172.21.15.79:0/2982630128 >> v1:172.21.15.79:6789/0 conn(0x7fb13c0b3db0 legacy=0x7fb13c0b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.044+0000 7fb140865640 1 -- 172.21.15.79:0/2982630128 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13c071270 con 0x7fb13c06d2f0 2024-04-25T02:09:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.045+0000 7fb140865640 1 --2- 172.21.15.79:0/2982630128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13c06d2f0 0x7fb13c06d760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0097a0 tx=0x7fb12c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76320ba6c66f94c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.045+0000 7fb133fff640 1 -- 172.21.15.79:0/2982630128 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c037070 con 0x7fb13c06d2f0 2024-04-25T02:09:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.045+0000 7fb133fff640 1 -- 172.21.15.79:0/2982630128 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12c032440 con 0x7fb13c06d2f0 2024-04-25T02:09:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.045+0000 7fb133fff640 1 -- 172.21.15.79:0/2982630128 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c032810 con 0x7fb13c06d2f0 2024-04-25T02:09:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.046+0000 7fb1432ca640 1 -- 172.21.15.79:0/2982630128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13c06d2f0 msgr2=0x7fb13c06d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.046+0000 7fb1432ca640 1 --2- 172.21.15.79:0/2982630128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13c06d2f0 0x7fb13c06d760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0097a0 tx=0x7fb12c02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.046+0000 7fb1432ca640 1 -- 172.21.15.79:0/2982630128 shutdown_connections 2024-04-25T02:09:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.046+0000 7fb1432ca640 1 --2- 172.21.15.79:0/2982630128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13c06d2f0 0x7fb13c06d760 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.046+0000 7fb1432ca640 1 -- 172.21.15.79:0/2982630128 >> 172.21.15.79:0/2982630128 conn(0x7fb13c06b4a0 msgr2=0x7fb13c06b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.046+0000 7fb1432ca640 1 -- 172.21.15.79:0/2982630128 shutdown_connections 2024-04-25T02:09:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.046+0000 7fb1432ca640 1 -- 172.21.15.79:0/2982630128 wait complete. 2024-04-25T02:09:25.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.047+0000 7fb1432ca640 1 Processor -- start 2024-04-25T02:09:25.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.047+0000 7fb1432ca640 1 -- start start 2024-04-25T02:09:25.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb1432ca640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb13c06d2f0 0x7fb13c15c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb1432ca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13c0b3db0 0x7fb13c1434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb1432ca640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb13c14be70 0x7fb13c0ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb1432ca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c071830 con 0x7fb13c0b3db0 2024-04-25T02:09:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb1432ca640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c0b4910 con 0x7fb13c06d2f0 2024-04-25T02:09:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb1432ca640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb13c14c250 con 0x7fb13c14be70 2024-04-25T02:09:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb140865640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13c0b3db0 0x7fb13c1434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb140865640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13c0b3db0 0x7fb13c1434e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47470/0 (socket says 172.21.15.79:47470) 2024-04-25T02:09:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb140865640 1 -- 172.21.15.79:0/3841395840 learned_addr learned my addr 172.21.15.79:0/3841395840 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb141066640 1 --2- 172.21.15.79:0/3841395840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb13c06d2f0 0x7fb13c15c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb141867640 1 --2- 172.21.15.79:0/3841395840 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb13c14be70 0x7fb13c0ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb140865640 1 -- 172.21.15.79:0/3841395840 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb13c14be70 msgr2=0x7fb13c0ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb140865640 1 --2- 172.21.15.79:0/3841395840 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb13c14be70 0x7fb13c0ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb140865640 1 -- 172.21.15.79:0/3841395840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb13c06d2f0 msgr2=0x7fb13c15c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:25.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb140865640 1 --2- 172.21.15.79:0/3841395840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb13c06d2f0 0x7fb13c15c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb140865640 1 -- 172.21.15.79:0/3841395840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13c0cf5f0 con 0x7fb13c0b3db0 2024-04-25T02:09:25.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb140865640 1 --2- 172.21.15.79:0/3841395840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13c0b3db0 0x7fb13c1434e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0097a0 tx=0x7fb12c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:25.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.048+0000 7fb131ffb640 1 -- 172.21.15.79:0/3841395840 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c037040 con 0x7fb13c0b3db0 2024-04-25T02:09:25.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.049+0000 7fb131ffb640 1 -- 172.21.15.79:0/3841395840 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12c004250 con 0x7fb13c0b3db0 2024-04-25T02:09:25.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.049+0000 7fb131ffb640 1 -- 172.21.15.79:0/3841395840 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c032e20 con 0x7fb13c0b3db0 2024-04-25T02:09:25.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.049+0000 7fb1432ca640 1 -- 172.21.15.79:0/3841395840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb13c0cf310 con 0x7fb13c0b3db0 2024-04-25T02:09:25.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.049+0000 7fb1432ca640 1 -- 172.21.15.79:0/3841395840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb13c142ce0 con 0x7fb13c0b3db0 2024-04-25T02:09:25.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.050+0000 7fb1432ca640 1 -- 172.21.15.79:0/3841395840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb13c165e90 con 0x7fb13c0b3db0 2024-04-25T02:09:25.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.050+0000 7fb131ffb640 1 -- 172.21.15.79:0/3841395840 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb12c030770 con 0x7fb13c0b3db0 2024-04-25T02:09:25.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.050+0000 7fb131ffb640 1 --2- 172.21.15.79:0/3841395840 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb12006be30 0x7fb12006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:25.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.051+0000 7fb131ffb640 1 -- 172.21.15.79:0/3841395840 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7fb12c0abd20 con 0x7fb13c0b3db0 2024-04-25T02:09:25.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.051+0000 7fb141066640 1 --2- 172.21.15.79:0/3841395840 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb12006be30 0x7fb12006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:25.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.051+0000 7fb141066640 1 --2- 172.21.15.79:0/3841395840 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb12006be30 0x7fb12006e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb138009f20 tx=0x7fb1380094d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:25.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.055+0000 7fb131ffb640 1 -- 172.21.15.79:0/3841395840 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb12c07aab0 con 0x7fb13c0b3db0 2024-04-25T02:09:25.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.229+0000 7fb1432ca640 1 -- 172.21.15.79:0/3841395840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb13c0b0d80 con 0x7fb13c0b3db0 2024-04-25T02:09:25.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.679+0000 7fb131ffb640 1 -- 172.21.15.79:0/3841395840 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) ==== 138+0+0 (secure 0 0 0) 0x7fb12c07a3b0 con 0x7fb13c0b3db0 2024-04-25T02:09:25.687 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-04-25T02:09:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.681+0000 7fb1432ca640 1 -- 172.21.15.79:0/3841395840 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb12006be30 msgr2=0x7fb12006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.681+0000 7fb1432ca640 1 --2- 172.21.15.79:0/3841395840 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb12006be30 0x7fb12006e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb138009f20 tx=0x7fb1380094d0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.681+0000 7fb1432ca640 1 -- 172.21.15.79:0/3841395840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13c0b3db0 msgr2=0x7fb13c1434e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.681+0000 7fb1432ca640 1 --2- 172.21.15.79:0/3841395840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13c0b3db0 0x7fb13c1434e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0097a0 tx=0x7fb12c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.681+0000 7fb1432ca640 1 -- 172.21.15.79:0/3841395840 shutdown_connections 2024-04-25T02:09:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.681+0000 7fb1432ca640 1 --2- 172.21.15.79:0/3841395840 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb12006be30 0x7fb12006e2f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.681+0000 7fb1432ca640 1 --2- 172.21.15.79:0/3841395840 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb13c14be70 0x7fb13c0ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.681+0000 7fb1432ca640 1 --2- 172.21.15.79:0/3841395840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13c0b3db0 0x7fb13c1434e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.681+0000 7fb1432ca640 1 --2- 172.21.15.79:0/3841395840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb13c06d2f0 0x7fb13c15c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.681+0000 7fb1432ca640 1 -- 172.21.15.79:0/3841395840 >> 172.21.15.79:0/3841395840 conn(0x7fb13c06b4a0 msgr2=0x7fb13c0b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:25.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.682+0000 7fb1432ca640 1 -- 172.21.15.79:0/3841395840 shutdown_connections 2024-04-25T02:09:25.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.682+0000 7fb1432ca640 1 -- 172.21.15.79:0/3841395840 wait complete. 2024-04-25T02:09:25.703 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T02:09:25.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.798+0000 7f3e5637e640 1 Processor -- start 2024-04-25T02:09:25.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.798+0000 7f3e5637e640 1 -- start start 2024-04-25T02:09:25.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.799+0000 7f3e5637e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e5015e4f0 0x7f3e500d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:25.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.799+0000 7f3e5637e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f3e500cf7f0 0x7f3e500d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:25.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.799+0000 7f3e5637e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e500d1ee0 con 0x7f3e500cfc50 2024-04-25T02:09:25.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.799+0000 7f3e5637e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3e500d21c0 con 0x7f3e500cf7f0 2024-04-25T02:09:25.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.799+0000 7f3e5637e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3e500d24a0 con 0x7f3e5015e4f0 2024-04-25T02:09:25.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.799+0000 7f3e5491b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3e500cfc50 0x7f3e5006bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46032/0 (socket says 172.21.15.79:46032) 2024-04-25T02:09:25.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.799+0000 7f3e5491b640 1 -- 172.21.15.79:0/3793727042 learned_addr learned my addr 172.21.15.79:0/3793727042 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4f7fe640 1 --2- 172.21.15.79:0/3793727042 >> v2:172.21.15.189:3300/0 conn(0x7f3e500cf7f0 0x7f3e500d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4ffff640 1 --2- 172.21.15.79:0/3793727042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e5015e4f0 0x7f3e500d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 -- 172.21.15.79:0/3793727042 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2058344541 0 0) 0x7f3e500d1ee0 con 0x7f3e500cfc50 2024-04-25T02:09:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 -- 172.21.15.79:0/3793727042 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e38003520 con 0x7f3e500cfc50 2024-04-25T02:09:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 -- 172.21.15.79:0/3793727042 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2101544288 0 0) 0x7f3e38003520 con 0x7f3e500cfc50 2024-04-25T02:09:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 -- 172.21.15.79:0/3793727042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e5015e4f0 msgr2=0x7f3e500d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 --2- 172.21.15.79:0/3793727042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e5015e4f0 0x7f3e500d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 -- 172.21.15.79:0/3793727042 >> v2:172.21.15.189:3300/0 conn(0x7f3e500cf7f0 msgr2=0x7f3e500d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 --2- 172.21.15.79:0/3793727042 >> v2:172.21.15.189:3300/0 conn(0x7f3e500cf7f0 0x7f3e500d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 -- 172.21.15.79:0/3793727042 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e500d2780 con 0x7f3e500cfc50 2024-04-25T02:09:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 -- 172.21.15.79:0/3793727042 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f3e480019f0 con 0x7f3e500cfc50 2024-04-25T02:09:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 -- 172.21.15.79:0/3793727042 >> v1:172.21.15.79:6789/0 conn(0x7f3e500cfc50 legacy=0x7f3e5006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 --2- 172.21.15.79:0/3793727042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e380039b0 0x7f3e38003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 --2- 172.21.15.79:0/3793727042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e38004800 0x7f3e38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:25.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 --2- 172.21.15.79:0/3793727042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e5015e4f0 0x7f3e380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:25.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 -- 172.21.15.79:0/3793727042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3e500d21c0 con 0x7f3e380039b0 2024-04-25T02:09:25.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 -- 172.21.15.79:0/3793727042 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e500d24a0 con 0x7f3e38004800 2024-04-25T02:09:25.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4effd640 1 -- 172.21.15.79:0/3793727042 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3e3800b9c0 con 0x7f3e5015e4f0 2024-04-25T02:09:25.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4ffff640 1 --2- 172.21.15.79:0/3793727042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e380039b0 0x7f3e38003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:25.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e5491b640 1 --2- 172.21.15.79:0/3793727042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e5015e4f0 0x7f3e380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:25.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4f7fe640 1 --2- 172.21.15.79:0/3793727042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e38004800 0x7f3e38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:25.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4ffff640 1 -- 172.21.15.79:0/3793727042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e5015e4f0 msgr2=0x7f3e380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:25.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4ffff640 1 --2- 172.21.15.79:0/3793727042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e5015e4f0 0x7f3e380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4ffff640 1 -- 172.21.15.79:0/3793727042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e38004800 msgr2=0x7f3e38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:25.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4ffff640 1 --2- 172.21.15.79:0/3793727042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e38004800 0x7f3e38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4ffff640 1 -- 172.21.15.79:0/3793727042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e38003520 con 0x7f3e380039b0 2024-04-25T02:09:25.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.800+0000 7f3e4f7fe640 1 --2- 172.21.15.79:0/3793727042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e38004800 0x7f3e38004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:25.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.801+0000 7f3e4ffff640 1 --2- 172.21.15.79:0/3793727042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e380039b0 0x7f3e38003dd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009ac0 tx=0x7f3e38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a431ff1f0c06e8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:25.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.801+0000 7f3e4effd640 1 -- 172.21.15.79:0/3793727042 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40036070 con 0x7f3e380039b0 2024-04-25T02:09:25.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.801+0000 7f3e4effd640 1 -- 172.21.15.79:0/3793727042 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e40031400 con 0x7f3e380039b0 2024-04-25T02:09:25.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.801+0000 7f3e4effd640 1 -- 172.21.15.79:0/3793727042 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40009690 con 0x7f3e380039b0 2024-04-25T02:09:25.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.802+0000 7f3e5637e640 1 -- 172.21.15.79:0/3793727042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e380039b0 msgr2=0x7f3e38003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:25.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.802+0000 7f3e5637e640 1 --2- 172.21.15.79:0/3793727042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e380039b0 0x7f3e38003dd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009ac0 tx=0x7f3e38005830 comp rx=0 tx=0).stop 2024-04-25T02:09:25.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.802+0000 7f3e5491b640 1 -- 172.21.15.79:0/3793727042 reap_dead start 2024-04-25T02:09:25.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.802+0000 7f3e5637e640 1 -- 172.21.15.79:0/3793727042 shutdown_connections 2024-04-25T02:09:25.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.802+0000 7f3e5637e640 1 -- 172.21.15.79:0/3793727042 >> 172.21.15.79:0/3793727042 conn(0x7f3e5009d4a0 msgr2=0x7f3e500d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:25.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.802+0000 7f3e5637e640 1 -- 172.21.15.79:0/3793727042 shutdown_connections 2024-04-25T02:09:25.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.802+0000 7f3e5637e640 1 -- 172.21.15.79:0/3793727042 wait complete. 2024-04-25T02:09:25.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.803+0000 7f3e5637e640 1 Processor -- start 2024-04-25T02:09:25.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.803+0000 7f3e5637e640 1 -- start start 2024-04-25T02:09:25.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e5637e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e380039b0 0x7f3e500cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:25.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e5637e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e500b8640 0x7f3e501544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:25.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e5637e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e500ca250 0x7f3e500ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:25.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e5637e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3e500d0ef0 con 0x7f3e380039b0 2024-04-25T02:09:25.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e5637e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e500d50f0 con 0x7f3e500ca250 2024-04-25T02:09:25.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e5637e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3e500d1070 con 0x7f3e500b8640 2024-04-25T02:09:25.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e4ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e380039b0 0x7f3e500cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:25.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e4ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e380039b0 0x7f3e500cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47494/0 (socket says 172.21.15.79:47494) 2024-04-25T02:09:25.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e4ffff640 1 -- 172.21.15.79:0/2817382255 learned_addr learned my addr 172.21.15.79:0/2817382255 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e4f7fe640 1 --2- 172.21.15.79:0/2817382255 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e500b8640 0x7f3e501544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e5491b640 1 --2- 172.21.15.79:0/2817382255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e500ca250 0x7f3e500ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e4ffff640 1 -- 172.21.15.79:0/2817382255 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e500b8640 msgr2=0x7f3e501544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e4ffff640 1 --2- 172.21.15.79:0/2817382255 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e500b8640 0x7f3e501544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e4ffff640 1 -- 172.21.15.79:0/2817382255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e500ca250 msgr2=0x7f3e500ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e4ffff640 1 --2- 172.21.15.79:0/2817382255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e500ca250 0x7f3e500ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e4ffff640 1 -- 172.21.15.79:0/2817382255 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e500cd980 con 0x7f3e380039b0 2024-04-25T02:09:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e4ffff640 1 --2- 172.21.15.79:0/2817382255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e380039b0 0x7f3e500cd2a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009ac0 tx=0x7f3e40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.804+0000 7f3e4cff9640 1 -- 172.21.15.79:0/2817382255 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40040020 con 0x7f3e380039b0 2024-04-25T02:09:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.805+0000 7f3e4cff9640 1 -- 172.21.15.79:0/2817382255 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e40003bc0 con 0x7f3e380039b0 2024-04-25T02:09:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.805+0000 7f3e5637e640 1 -- 172.21.15.79:0/2817382255 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e500cdc60 con 0x7f3e380039b0 2024-04-25T02:09:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.805+0000 7f3e4cff9640 1 -- 172.21.15.79:0/2817382255 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40036040 con 0x7f3e380039b0 2024-04-25T02:09:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.805+0000 7f3e5637e640 1 -- 172.21.15.79:0/2817382255 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e500ce220 con 0x7f3e380039b0 2024-04-25T02:09:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.805+0000 7f3e5637e640 1 -- 172.21.15.79:0/2817382255 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e500686c0 con 0x7f3e380039b0 2024-04-25T02:09:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.806+0000 7f3e4cff9640 1 -- 172.21.15.79:0/2817382255 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e40043020 con 0x7f3e380039b0 2024-04-25T02:09:25.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.806+0000 7f3e4cff9640 1 --2- 172.21.15.79:0/2817382255 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3e3c06be30 0x7f3e3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:25.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.806+0000 7f3e4cff9640 1 -- 172.21.15.79:0/2817382255 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5227+0+0 (secure 0 0 0) 0x7f3e400aac70 con 0x7f3e380039b0 2024-04-25T02:09:25.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.806+0000 7f3e4f7fe640 1 --2- 172.21.15.79:0/2817382255 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3e3c06be30 0x7f3e3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:25.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.807+0000 7f3e4f7fe640 1 --2- 172.21.15.79:0/2817382255 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3e3c06be30 0x7f3e3c06e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3e500b8eb0 tx=0x7f3e44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:25.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.811+0000 7f3e4cff9640 1 -- 172.21.15.79:0/2817382255 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3e4004a070 con 0x7f3e380039b0 2024-04-25T02:09:25.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:25.982+0000 7f3e5637e640 1 -- 172.21.15.79:0/2817382255 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3e500690a0 con 0x7f3e380039b0 2024-04-25T02:09:26.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.680+0000 7f3e4cff9640 1 -- 172.21.15.79:0/2817382255 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) ==== 170+0+0 (secure 0 0 0) 0x7f3e400044e0 con 0x7f3e380039b0 2024-04-25T02:09:26.689 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-04-25T02:09:26.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.683+0000 7f3e5637e640 1 -- 172.21.15.79:0/2817382255 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3e3c06be30 msgr2=0x7f3e3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.683+0000 7f3e5637e640 1 --2- 172.21.15.79:0/2817382255 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3e3c06be30 0x7f3e3c06e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3e500b8eb0 tx=0x7f3e44008040 comp rx=0 tx=0).stop 2024-04-25T02:09:26.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.683+0000 7f3e5637e640 1 -- 172.21.15.79:0/2817382255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e380039b0 msgr2=0x7f3e500cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.683+0000 7f3e5637e640 1 --2- 172.21.15.79:0/2817382255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e380039b0 0x7f3e500cd2a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009ac0 tx=0x7f3e40004730 comp rx=0 tx=0).stop 2024-04-25T02:09:26.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.683+0000 7f3e5637e640 1 -- 172.21.15.79:0/2817382255 shutdown_connections 2024-04-25T02:09:26.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.683+0000 7f3e5637e640 1 --2- 172.21.15.79:0/2817382255 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3e3c06be30 0x7f3e3c06e2f0 secure :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3e500b8eb0 tx=0x7f3e44008040 comp rx=0 tx=0).stop 2024-04-25T02:09:26.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.683+0000 7f3e5637e640 1 --2- 172.21.15.79:0/2817382255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e500ca250 0x7f3e500ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.683+0000 7f3e5637e640 1 --2- 172.21.15.79:0/2817382255 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e500b8640 0x7f3e501544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.683+0000 7f3e5637e640 1 --2- 172.21.15.79:0/2817382255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e380039b0 0x7f3e500cd2a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.683+0000 7f3e5637e640 1 -- 172.21.15.79:0/2817382255 >> 172.21.15.79:0/2817382255 conn(0x7f3e5009d4a0 msgr2=0x7f3e500d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:26.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.683+0000 7f3e5637e640 1 -- 172.21.15.79:0/2817382255 shutdown_connections 2024-04-25T02:09:26.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.684+0000 7f3e5637e640 1 -- 172.21.15.79:0/2817382255 wait complete. 2024-04-25T02:09:26.716 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T02:09:26.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.807+0000 7f3027415640 1 Processor -- start 2024-04-25T02:09:26.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.808+0000 7f3027415640 1 -- start start 2024-04-25T02:09:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.808+0000 7f3027415640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f302006e6b0 0x7f30200b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.808+0000 7f3027415640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f302015ec20 con 0x7f30200cf7a0 2024-04-25T02:09:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.808+0000 7f3027415640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f302015ef00 con 0x7f302006b2f0 2024-04-25T02:09:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.808+0000 7f3027415640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f302015f830 con 0x7f302006e6b0 2024-04-25T02:09:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.809+0000 7f30259b2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f302006e6b0 0x7f30200b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.809+0000 7f30259b2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f302006e6b0 0x7f30200b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47510/0 (socket says 172.21.15.79:47510) 2024-04-25T02:09:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.809+0000 7f30259b2640 1 -- 172.21.15.79:0/2720277203 learned_addr learned my addr 172.21.15.79:0/2720277203 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.809+0000 7f30259b2640 1 -- 172.21.15.79:0/2720277203 >> v1:172.21.15.189:6789/0 conn(0x7f302006b2f0 legacy=0x7f302006b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.809+0000 7f30259b2640 1 -- 172.21.15.79:0/2720277203 >> v1:172.21.15.79:6789/0 conn(0x7f30200cf7a0 legacy=0x7f302015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.809+0000 7f30259b2640 1 -- 172.21.15.79:0/2720277203 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302015f1e0 con 0x7f302006e6b0 2024-04-25T02:09:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.809+0000 7f3013fff640 1 -- 172.21.15.79:0/2720277203 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 232931137 0 0) 0x7f302015ec20 con 0x7f30200cf7a0 2024-04-25T02:09:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.809+0000 7f30259b2640 1 --2- 172.21.15.79:0/2720277203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f302006e6b0 0x7f30200b4b50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f301800d150 tx=0x7f301802c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac07bc0f2f7ac6fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.810+0000 7f3013fff640 1 -- 172.21.15.79:0/2720277203 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018009600 con 0x7f302006e6b0 2024-04-25T02:09:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.810+0000 7f3013fff640 1 -- 172.21.15.79:0/2720277203 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3018037070 con 0x7f302006e6b0 2024-04-25T02:09:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.810+0000 7f3013fff640 1 -- 172.21.15.79:0/2720277203 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30180099c0 con 0x7f302006e6b0 2024-04-25T02:09:26.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.810+0000 7f3027415640 1 -- 172.21.15.79:0/2720277203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f302006e6b0 msgr2=0x7f30200b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.810+0000 7f3027415640 1 --2- 172.21.15.79:0/2720277203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f302006e6b0 0x7f30200b4b50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f301800d150 tx=0x7f301802c930 comp rx=0 tx=0).stop 2024-04-25T02:09:26.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.810+0000 7f3027415640 1 -- 172.21.15.79:0/2720277203 shutdown_connections 2024-04-25T02:09:26.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.810+0000 7f3027415640 1 --2- 172.21.15.79:0/2720277203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f302006e6b0 0x7f30200b4b50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.810+0000 7f3027415640 1 -- 172.21.15.79:0/2720277203 >> 172.21.15.79:0/2720277203 conn(0x7f30200b1cd0 msgr2=0x7f30200b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:26.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.810+0000 7f3027415640 1 -- 172.21.15.79:0/2720277203 shutdown_connections 2024-04-25T02:09:26.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.810+0000 7f3027415640 1 -- 172.21.15.79:0/2720277203 wait complete. 2024-04-25T02:09:26.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.811+0000 7f3027415640 1 Processor -- start 2024-04-25T02:09:26.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.811+0000 7f3027415640 1 -- start start 2024-04-25T02:09:26.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.812+0000 7f3027415640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f302006b2f0 0x7f3020146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.812+0000 7f3027415640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f302006e6b0 0x7f30200aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.812+0000 7f3027415640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30200cf7a0 0x7f302015c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.812+0000 7f3027415640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f302006d160 con 0x7f30200cf7a0 2024-04-25T02:09:26.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.812+0000 7f3027415640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f302006cfe0 con 0x7f302006e6b0 2024-04-25T02:09:26.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.812+0000 7f3027415640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f302015b9e0 con 0x7f302006b2f0 2024-04-25T02:09:26.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.812+0000 7f30259b2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30200cf7a0 0x7f302015c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:26.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.812+0000 7f30259b2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30200cf7a0 0x7f302015c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47524/0 (socket says 172.21.15.79:47524) 2024-04-25T02:09:26.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.812+0000 7f30259b2640 1 -- 172.21.15.79:0/2455393192 learned_addr learned my addr 172.21.15.79:0/2455393192 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:26.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.812+0000 7f30259b2640 1 -- 172.21.15.79:0/2455393192 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f302006b2f0 msgr2=0x7f3020146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.812+0000 7f30259b2640 1 --2- 172.21.15.79:0/2455393192 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f302006b2f0 0x7f3020146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.812+0000 7f30259b2640 1 -- 172.21.15.79:0/2455393192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f302006e6b0 msgr2=0x7f30200aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.812+0000 7f30259b2640 1 --2- 172.21.15.79:0/2455393192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f302006e6b0 0x7f30200aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.812+0000 7f30259b2640 1 -- 172.21.15.79:0/2455393192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30200adc90 con 0x7f30200cf7a0 2024-04-25T02:09:26.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.813+0000 7f30259b2640 1 --2- 172.21.15.79:0/2455393192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30200cf7a0 0x7f302015c6e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f301800d150 tx=0x7f3018004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:26.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.813+0000 7f3011ffb640 1 -- 172.21.15.79:0/2455393192 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018047480 con 0x7f30200cf7a0 2024-04-25T02:09:26.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.813+0000 7f3011ffb640 1 -- 172.21.15.79:0/2455393192 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3018047620 con 0x7f30200cf7a0 2024-04-25T02:09:26.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.813+0000 7f3011ffb640 1 -- 172.21.15.79:0/2455393192 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018047a10 con 0x7f30200cf7a0 2024-04-25T02:09:26.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.813+0000 7f3027415640 1 -- 172.21.15.79:0/2455393192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30200adf30 con 0x7f30200cf7a0 2024-04-25T02:09:26.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.813+0000 7f3027415640 1 -- 172.21.15.79:0/2455393192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30200ae4f0 con 0x7f30200cf7a0 2024-04-25T02:09:26.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.814+0000 7f3027415640 1 -- 172.21.15.79:0/2455393192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30200690a0 con 0x7f30200cf7a0 2024-04-25T02:09:26.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.814+0000 7f3011ffb640 1 -- 172.21.15.79:0/2455393192 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3018047bb0 con 0x7f30200cf7a0 2024-04-25T02:09:26.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.815+0000 7f3011ffb640 1 --2- 172.21.15.79:0/2455393192 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f300406be30 0x7f300406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.815+0000 7f3011ffb640 1 -- 172.21.15.79:0/2455393192 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5609+0+0 (secure 0 0 0) 0x7f30180ae1e0 con 0x7f30200cf7a0 2024-04-25T02:09:26.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.815+0000 7f30251b1640 1 --2- 172.21.15.79:0/2455393192 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f300406be30 0x7f300406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:26.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.815+0000 7f30251b1640 1 --2- 172.21.15.79:0/2455393192 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f300406be30 0x7f300406e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3014000f60 tx=0x7f30140079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:26.820+0000 7f3011ffb640 1 -- 172.21.15.79:0/2455393192 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f301807cbf0 con 0x7f30200cf7a0 2024-04-25T02:09:27.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.029+0000 7f3027415640 1 -- 172.21.15.79:0/2455393192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f30200cf4f0 con 0x7f30200cf7a0 2024-04-25T02:09:27.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.699+0000 7f3011ffb640 1 -- 172.21.15.79:0/2455393192 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v16) ==== 172+0+0 (secure 0 0 0) 0x7f301807c4f0 con 0x7f30200cf7a0 2024-04-25T02:09:27.710 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 6 and data pool 7 2024-04-25T02:09:27.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.715+0000 7f3027415640 1 -- 172.21.15.79:0/2455393192 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f300406be30 msgr2=0x7f300406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.715+0000 7f3027415640 1 --2- 172.21.15.79:0/2455393192 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f300406be30 0x7f300406e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3014000f60 tx=0x7f30140079b0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.715+0000 7f3027415640 1 -- 172.21.15.79:0/2455393192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30200cf7a0 msgr2=0x7f302015c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.715+0000 7f3027415640 1 --2- 172.21.15.79:0/2455393192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30200cf7a0 0x7f302015c6e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f301800d150 tx=0x7f3018004a40 comp rx=0 tx=0).stop 2024-04-25T02:09:27.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.715+0000 7f3027415640 1 -- 172.21.15.79:0/2455393192 shutdown_connections 2024-04-25T02:09:27.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.715+0000 7f3027415640 1 --2- 172.21.15.79:0/2455393192 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f300406be30 0x7f300406e2f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.715+0000 7f3027415640 1 --2- 172.21.15.79:0/2455393192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30200cf7a0 0x7f302015c6e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.715+0000 7f3027415640 1 --2- 172.21.15.79:0/2455393192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f302006e6b0 0x7f30200aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.715+0000 7f3027415640 1 --2- 172.21.15.79:0/2455393192 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f302006b2f0 0x7f3020146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.715+0000 7f3027415640 1 -- 172.21.15.79:0/2455393192 >> 172.21.15.79:0/2455393192 conn(0x7f30200b1cd0 msgr2=0x7f30200b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:27.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.715+0000 7f3027415640 1 -- 172.21.15.79:0/2455393192 shutdown_connections 2024-04-25T02:09:27.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.715+0000 7f3027415640 1 -- 172.21.15.79:0/2455393192 wait complete. 2024-04-25T02:09:27.740 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:27.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.830+0000 7f2eef5a9640 1 Processor -- start 2024-04-25T02:09:27.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.830+0000 7f2eef5a9640 1 -- start start 2024-04-25T02:09:27.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.831+0000 7f2eef5a9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2ee8143bc0 0x7f2ee815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:27.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.831+0000 7f2eef5a9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee806df50 0x7f2ee806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:27.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.831+0000 7f2eef5a9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee815fa40 con 0x7f2ee80b48e0 2024-04-25T02:09:27.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.831+0000 7f2eef5a9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee806e8f0 con 0x7f2ee8143bc0 2024-04-25T02:09:27.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.831+0000 7f2eef5a9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee8072cb0 con 0x7f2ee806df50 2024-04-25T02:09:27.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.831+0000 7f2eed345640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2ee8143bc0 0x7f2ee815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:27.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.831+0000 7f2eed345640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2ee8143bc0 0x7f2ee815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47530/0 (socket says 172.21.15.79:47530) 2024-04-25T02:09:27.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.831+0000 7f2eed345640 1 -- 172.21.15.79:0/2893906685 learned_addr learned my addr 172.21.15.79:0/2893906685 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:27.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.831+0000 7f2eecb44640 1 --2- 172.21.15.79:0/2893906685 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee806df50 0x7f2ee806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:27.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.831+0000 7f2eed345640 1 -- 172.21.15.79:0/2893906685 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee806df50 msgr2=0x7f2ee806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:27.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.831+0000 7f2eed345640 1 --2- 172.21.15.79:0/2893906685 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee806df50 0x7f2ee806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.831+0000 7f2eed345640 1 -- 172.21.15.79:0/2893906685 >> v1:172.21.15.189:6789/0 conn(0x7f2ee80b48e0 legacy=0x7f2ee80b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.831+0000 7f2eed345640 1 -- 172.21.15.79:0/2893906685 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee8071e00 con 0x7f2ee8143bc0 2024-04-25T02:09:27.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.832+0000 7f2eed345640 1 --2- 172.21.15.79:0/2893906685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee8143bc0 0x7f2ee815f500 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009870 tx=0x7f2ee402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d50905f13471ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:27.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.832+0000 7f2edffff640 1 -- 172.21.15.79:0/2893906685 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4037070 con 0x7f2ee8143bc0 2024-04-25T02:09:27.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.832+0000 7f2edffff640 1 -- 172.21.15.79:0/2893906685 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee4032440 con 0x7f2ee8143bc0 2024-04-25T02:09:27.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.832+0000 7f2edffff640 1 -- 172.21.15.79:0/2893906685 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4032810 con 0x7f2ee8143bc0 2024-04-25T02:09:27.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.833+0000 7f2eef5a9640 1 -- 172.21.15.79:0/2893906685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee8143bc0 msgr2=0x7f2ee815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.833+0000 7f2eef5a9640 1 --2- 172.21.15.79:0/2893906685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee8143bc0 0x7f2ee815f500 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009870 tx=0x7f2ee402a1c0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.833+0000 7f2eef5a9640 1 -- 172.21.15.79:0/2893906685 shutdown_connections 2024-04-25T02:09:27.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.833+0000 7f2eef5a9640 1 --2- 172.21.15.79:0/2893906685 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee806df50 0x7f2ee806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.833+0000 7f2eef5a9640 1 --2- 172.21.15.79:0/2893906685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee8143bc0 0x7f2ee815f500 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.833+0000 7f2eef5a9640 1 -- 172.21.15.79:0/2893906685 >> 172.21.15.79:0/2893906685 conn(0x7f2ee80cfc80 msgr2=0x7f2ee80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.833+0000 7f2eef5a9640 1 -- 172.21.15.79:0/2893906685 shutdown_connections 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.833+0000 7f2eef5a9640 1 -- 172.21.15.79:0/2893906685 wait complete. 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.834+0000 7f2eef5a9640 1 Processor -- start 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.834+0000 7f2eef5a9640 1 -- start start 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eef5a9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ee806df50 0x7f2ee813f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eef5a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee80b48e0 0x7f2ee815b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eef5a9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee8143bc0 0x7f2ee815c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eef5a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee8072660 con 0x7f2ee80b48e0 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eef5a9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee8072380 con 0x7f2ee806df50 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eef5a9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee8072940 con 0x7f2ee8143bc0 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eecb44640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee80b48e0 0x7f2ee815b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eecb44640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee80b48e0 0x7f2ee815b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47542/0 (socket says 172.21.15.79:47542) 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eecb44640 1 -- 172.21.15.79:0/1691585118 learned_addr learned my addr 172.21.15.79:0/1691585118 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eedb46640 1 --2- 172.21.15.79:0/1691585118 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee8143bc0 0x7f2ee815c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eed345640 1 --2- 172.21.15.79:0/1691585118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ee806df50 0x7f2ee813f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:27.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eecb44640 1 -- 172.21.15.79:0/1691585118 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee8143bc0 msgr2=0x7f2ee815c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eecb44640 1 --2- 172.21.15.79:0/1691585118 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee8143bc0 0x7f2ee815c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eecb44640 1 -- 172.21.15.79:0/1691585118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ee806df50 msgr2=0x7f2ee813f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eecb44640 1 --2- 172.21.15.79:0/1691585118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ee806df50 0x7f2ee813f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eecb44640 1 -- 172.21.15.79:0/1691585118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee815aba0 con 0x7f2ee80b48e0 2024-04-25T02:09:27.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eedb46640 1 --2- 172.21.15.79:0/1691585118 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee8143bc0 0x7f2ee815c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:27.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eecb44640 1 --2- 172.21.15.79:0/1691585118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee80b48e0 0x7f2ee815b760 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800d5d0 tx=0x7f2ed800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:27.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eddffb640 1 -- 172.21.15.79:0/1691585118 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80125f0 con 0x7f2ee80b48e0 2024-04-25T02:09:27.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eddffb640 1 -- 172.21.15.79:0/1691585118 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed8019070 con 0x7f2ee80b48e0 2024-04-25T02:09:27.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eef5a9640 1 -- 172.21.15.79:0/1691585118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee8159de0 con 0x7f2ee80b48e0 2024-04-25T02:09:27.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.835+0000 7f2eddffb640 1 -- 172.21.15.79:0/1691585118 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80129f0 con 0x7f2ee80b48e0 2024-04-25T02:09:27.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.836+0000 7f2eef5a9640 1 -- 172.21.15.79:0/1691585118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee815a3a0 con 0x7f2ee80b48e0 2024-04-25T02:09:27.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.837+0000 7f2eef5a9640 1 -- 172.21.15.79:0/1691585118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee80cf790 con 0x7f2ee80b48e0 2024-04-25T02:09:27.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.837+0000 7f2eddffb640 1 -- 172.21.15.79:0/1691585118 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ed8012b90 con 0x7f2ee80b48e0 2024-04-25T02:09:27.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.837+0000 7f2eddffb640 1 --2- 172.21.15.79:0/1691585118 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ecc06be30 0x7f2ecc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:27.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.837+0000 7f2eed345640 1 --2- 172.21.15.79:0/1691585118 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ecc06be30 0x7f2ecc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:27.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.837+0000 7f2eddffb640 1 -- 172.21.15.79:0/1691585118 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f2ed808b260 con 0x7f2ee80b48e0 2024-04-25T02:09:27.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.838+0000 7f2eed345640 1 --2- 172.21.15.79:0/1691585118 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ecc06be30 0x7f2ecc06e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4034000 tx=0x7f2ee402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:27.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:27.842+0000 7f2eddffb640 1 -- 172.21.15.79:0/1691585118 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2ee80cf790 con 0x7f2ee80b48e0 2024-04-25T02:09:28.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.015+0000 7f2eef5a9640 1 -- 172.21.15.79:0/1691585118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ee80690a0 con 0x7f2ee80b48e0 2024-04-25T02:09:28.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.017+0000 7f2eddffb640 1 -- 172.21.15.79:0/1691585118 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16638 (secure 0 0 0) 0x7f2ed8059c10 con 0x7f2ee80b48e0 2024-04-25T02:09:28.025 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:28.025 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":44,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:09:27.031768+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:09:25.247996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T02:09:26.001469+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:28.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.019+0000 7f2eef5a9640 1 -- 172.21.15.79:0/1691585118 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ecc06be30 msgr2=0x7f2ecc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.019+0000 7f2eef5a9640 1 --2- 172.21.15.79:0/1691585118 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ecc06be30 0x7f2ecc06e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4034000 tx=0x7f2ee402e000 comp rx=0 tx=0).stop 2024-04-25T02:09:28.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.019+0000 7f2eef5a9640 1 -- 172.21.15.79:0/1691585118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee80b48e0 msgr2=0x7f2ee815b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.019+0000 7f2eef5a9640 1 --2- 172.21.15.79:0/1691585118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee80b48e0 0x7f2ee815b760 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800d5d0 tx=0x7f2ed800da90 comp rx=0 tx=0).stop 2024-04-25T02:09:28.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.019+0000 7f2eef5a9640 1 -- 172.21.15.79:0/1691585118 shutdown_connections 2024-04-25T02:09:28.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.019+0000 7f2eef5a9640 1 --2- 172.21.15.79:0/1691585118 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ecc06be30 0x7f2ecc06e2f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.019+0000 7f2eef5a9640 1 --2- 172.21.15.79:0/1691585118 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee8143bc0 0x7f2ee815c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.019+0000 7f2eef5a9640 1 --2- 172.21.15.79:0/1691585118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee80b48e0 0x7f2ee815b760 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.019+0000 7f2eef5a9640 1 --2- 172.21.15.79:0/1691585118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ee806df50 0x7f2ee813f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.019+0000 7f2eef5a9640 1 -- 172.21.15.79:0/1691585118 >> 172.21.15.79:0/1691585118 conn(0x7f2ee80cfc80 msgr2=0x7f2ee806d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:28.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.019+0000 7f2eef5a9640 1 -- 172.21.15.79:0/1691585118 shutdown_connections 2024-04-25T02:09:28.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.019+0000 7f2eef5a9640 1 -- 172.21.15.79:0/1691585118 wait complete. 2024-04-25T02:09:28.038 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:28.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.126+0000 7fd002a37640 1 Processor -- start 2024-04-25T02:09:28.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.127+0000 7fd002a37640 1 -- start start 2024-04-25T02:09:28.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.127+0000 7fd002a37640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcffc144cb0 0x7fcffc0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.127+0000 7fd002a37640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcffc06e660 0x7fcffc071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.127+0000 7fd002a37640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcffc070d90 con 0x7fcffc0b5580 2024-04-25T02:09:28.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.127+0000 7fd002a37640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fcffc0cf130 con 0x7fcffc144cb0 2024-04-25T02:09:28.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.127+0000 7fd002a37640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fcffc0cf410 con 0x7fcffc06e660 2024-04-25T02:09:28.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.128+0000 7fcffbfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcffc144cb0 0x7fcffc0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.128+0000 7fcffbfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcffc144cb0 0x7fcffc0b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47558/0 (socket says 172.21.15.79:47558) 2024-04-25T02:09:28.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.128+0000 7fcffb7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcffc0b5580 0x7fcffc06df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46040/0 (socket says 172.21.15.79:46040) 2024-04-25T02:09:28.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.128+0000 7fcffbfff640 1 -- 172.21.15.79:0/625271866 learned_addr learned my addr 172.21.15.79:0/625271866 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:28.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.128+0000 7fcffbfff640 1 -- 172.21.15.79:0/625271866 >> v2:172.21.15.189:3300/0 conn(0x7fcffc06e660 msgr2=0x7fcffc071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:28.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.128+0000 7fd000fd4640 1 --2- 172.21.15.79:0/625271866 >> v2:172.21.15.189:3300/0 conn(0x7fcffc06e660 0x7fcffc071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.128+0000 7fcffaffd640 1 -- 172.21.15.79:0/625271866 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4076756128 0 0) 0x7fcffc070d90 con 0x7fcffc0b5580 2024-04-25T02:09:28.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.128+0000 7fcffbfff640 1 --2- 172.21.15.79:0/625271866 >> v2:172.21.15.189:3300/0 conn(0x7fcffc06e660 0x7fcffc071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.128+0000 7fcffbfff640 1 -- 172.21.15.79:0/625271866 >> v1:172.21.15.79:6789/0 conn(0x7fcffc0b5580 legacy=0x7fcffc06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.128+0000 7fcffbfff640 1 -- 172.21.15.79:0/625271866 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc0cf6f0 con 0x7fcffc144cb0 2024-04-25T02:09:28.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.128+0000 7fd000fd4640 1 --2- 172.21.15.79:0/625271866 >> v2:172.21.15.189:3300/0 conn(0x7fcffc06e660 0x7fcffc071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:28.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.128+0000 7fcffbfff640 1 --2- 172.21.15.79:0/625271866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcffc144cb0 0x7fcffc0b5040 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009870 tx=0x7fcfe402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e54e534b5dc729 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:28.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.129+0000 7fcffaffd640 1 -- 172.21.15.79:0/625271866 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4037070 con 0x7fcffc144cb0 2024-04-25T02:09:28.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.129+0000 7fcffaffd640 1 -- 172.21.15.79:0/625271866 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe4032440 con 0x7fcffc144cb0 2024-04-25T02:09:28.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.129+0000 7fcffaffd640 1 -- 172.21.15.79:0/625271866 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4032810 con 0x7fcffc144cb0 2024-04-25T02:09:28.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.129+0000 7fd002a37640 1 -- 172.21.15.79:0/625271866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcffc144cb0 msgr2=0x7fcffc0b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.129+0000 7fd002a37640 1 --2- 172.21.15.79:0/625271866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcffc144cb0 0x7fcffc0b5040 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009870 tx=0x7fcfe402a180 comp rx=0 tx=0).stop 2024-04-25T02:09:28.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.129+0000 7fd002a37640 1 -- 172.21.15.79:0/625271866 shutdown_connections 2024-04-25T02:09:28.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.129+0000 7fd002a37640 1 --2- 172.21.15.79:0/625271866 >> v2:172.21.15.189:3300/0 conn(0x7fcffc06e660 0x7fcffc071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.129+0000 7fd002a37640 1 --2- 172.21.15.79:0/625271866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcffc144cb0 0x7fcffc0b5040 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.129+0000 7fd002a37640 1 -- 172.21.15.79:0/625271866 >> 172.21.15.79:0/625271866 conn(0x7fcffc0cfc80 msgr2=0x7fcffc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.129+0000 7fd002a37640 1 -- 172.21.15.79:0/625271866 shutdown_connections 2024-04-25T02:09:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.129+0000 7fd002a37640 1 -- 172.21.15.79:0/625271866 wait complete. 2024-04-25T02:09:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.130+0000 7fd002a37640 1 Processor -- start 2024-04-25T02:09:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.131+0000 7fd002a37640 1 -- start start 2024-04-25T02:09:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.131+0000 7fd002a37640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcffc06e660 0x7fcffc1f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.131+0000 7fd002a37640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcffc0b5580 0x7fcffc15ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.131+0000 7fd002a37640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcffc144cb0 0x7fcffc0a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.131+0000 7fd002a37640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc145ab0 con 0x7fcffc144cb0 2024-04-25T02:09:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.131+0000 7fd002a37640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc145090 con 0x7fcffc0b5580 2024-04-25T02:09:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.131+0000 7fd002a37640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcffc145c30 con 0x7fcffc06e660 2024-04-25T02:09:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.131+0000 7fd000fd4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcffc144cb0 0x7fcffc0a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.131+0000 7fd000fd4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcffc144cb0 0x7fcffc0a9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47566/0 (socket says 172.21.15.79:47566) 2024-04-25T02:09:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.131+0000 7fd000fd4640 1 -- 172.21.15.79:0/2078703489 learned_addr learned my addr 172.21.15.79:0/2078703489 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.132+0000 7fcffb7fe640 1 --2- 172.21.15.79:0/2078703489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcffc0b5580 0x7fcffc15ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.132+0000 7fcffbfff640 1 --2- 172.21.15.79:0/2078703489 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcffc06e660 0x7fcffc1f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.132+0000 7fd000fd4640 1 -- 172.21.15.79:0/2078703489 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcffc06e660 msgr2=0x7fcffc1f29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.132+0000 7fd000fd4640 1 --2- 172.21.15.79:0/2078703489 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcffc06e660 0x7fcffc1f29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.132+0000 7fd000fd4640 1 -- 172.21.15.79:0/2078703489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcffc0b5580 msgr2=0x7fcffc15ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.132+0000 7fd000fd4640 1 --2- 172.21.15.79:0/2078703489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcffc0b5580 0x7fcffc15ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.132+0000 7fd000fd4640 1 -- 172.21.15.79:0/2078703489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc0aa300 con 0x7fcffc144cb0 2024-04-25T02:09:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.132+0000 7fcffb7fe640 1 --2- 172.21.15.79:0/2078703489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcffc0b5580 0x7fcffc15ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.132+0000 7fd000fd4640 1 --2- 172.21.15.79:0/2078703489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcffc144cb0 0x7fcffc0a9dc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcff400cf20 tx=0x7fcff400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.132+0000 7fcff8ff9640 1 -- 172.21.15.79:0/2078703489 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff401a070 con 0x7fcffc144cb0 2024-04-25T02:09:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.132+0000 7fcff8ff9640 1 -- 172.21.15.79:0/2078703489 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff400d840 con 0x7fcffc144cb0 2024-04-25T02:09:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.132+0000 7fd002a37640 1 -- 172.21.15.79:0/2078703489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcffc1f2f30 con 0x7fcffc144cb0 2024-04-25T02:09:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.132+0000 7fcff8ff9640 1 -- 172.21.15.79:0/2078703489 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff400dc30 con 0x7fcffc144cb0 2024-04-25T02:09:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.132+0000 7fd002a37640 1 -- 172.21.15.79:0/2078703489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcffc1f34f0 con 0x7fcffc144cb0 2024-04-25T02:09:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.133+0000 7fd002a37640 1 -- 172.21.15.79:0/2078703489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcffc0690a0 con 0x7fcffc144cb0 2024-04-25T02:09:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.133+0000 7fcff8ff9640 1 -- 172.21.15.79:0/2078703489 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcff401d070 con 0x7fcffc144cb0 2024-04-25T02:09:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.134+0000 7fcff8ff9640 1 --2- 172.21.15.79:0/2078703489 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcfdc06be30 0x7fcfdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.134+0000 7fcff8ff9640 1 -- 172.21.15.79:0/2078703489 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fcff408b730 con 0x7fcffc144cb0 2024-04-25T02:09:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.134+0000 7fcffbfff640 1 --2- 172.21.15.79:0/2078703489 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcfdc06be30 0x7fcfdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.134+0000 7fcffbfff640 1 --2- 172.21.15.79:0/2078703489 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcfdc06be30 0x7fcfdc06e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4034000 tx=0x7fcfe402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.138+0000 7fcff8ff9640 1 -- 172.21.15.79:0/2078703489 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcff405a0c0 con 0x7fcffc144cb0 2024-04-25T02:09:28.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.311+0000 7fd002a37640 1 -- 172.21.15.79:0/2078703489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcffc0d0b90 con 0x7fcffc144cb0 2024-04-25T02:09:28.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.312+0000 7fcff8ff9640 1 -- 172.21.15.79:0/2078703489 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16638 (secure 0 0 0) 0x7fcff40599c0 con 0x7fcffc144cb0 2024-04-25T02:09:28.321 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:28.321 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":44,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:09:27.031768+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:09:25.247996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T02:09:26.001469+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:28.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.314+0000 7fd002a37640 1 -- 172.21.15.79:0/2078703489 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcfdc06be30 msgr2=0x7fcfdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.314+0000 7fd002a37640 1 --2- 172.21.15.79:0/2078703489 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcfdc06be30 0x7fcfdc06e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4034000 tx=0x7fcfe402e000 comp rx=0 tx=0).stop 2024-04-25T02:09:28.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.314+0000 7fd002a37640 1 -- 172.21.15.79:0/2078703489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcffc144cb0 msgr2=0x7fcffc0a9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.314+0000 7fd002a37640 1 --2- 172.21.15.79:0/2078703489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcffc144cb0 0x7fcffc0a9dc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcff400cf20 tx=0x7fcff400a7d0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.314+0000 7fd002a37640 1 -- 172.21.15.79:0/2078703489 shutdown_connections 2024-04-25T02:09:28.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.315+0000 7fd002a37640 1 --2- 172.21.15.79:0/2078703489 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcfdc06be30 0x7fcfdc06e2f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.315+0000 7fd002a37640 1 --2- 172.21.15.79:0/2078703489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcffc144cb0 0x7fcffc0a9dc0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.315+0000 7fd002a37640 1 --2- 172.21.15.79:0/2078703489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcffc0b5580 0x7fcffc15ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.315+0000 7fd002a37640 1 --2- 172.21.15.79:0/2078703489 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcffc06e660 0x7fcffc1f29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.315+0000 7fd002a37640 1 -- 172.21.15.79:0/2078703489 >> 172.21.15.79:0/2078703489 conn(0x7fcffc0cfc80 msgr2=0x7fcffc0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.315+0000 7fd002a37640 1 -- 172.21.15.79:0/2078703489 shutdown_connections 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.315+0000 7fd002a37640 1 -- 172.21.15.79:0/2078703489 wait complete. 2024-04-25T02:09:28.334 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T02:09:28.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.425+0000 7f6192742640 1 Processor -- start 2024-04-25T02:09:28.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.425+0000 7f6192742640 1 -- start start 2024-04-25T02:09:28.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.426+0000 7f6192742640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f618c15a810 0x7f618c0cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.426+0000 7f6192742640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f618c071460 0x7f618c0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.426+0000 7f6192742640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f618c15abf0 con 0x7f618c09dcb0 2024-04-25T02:09:28.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.426+0000 7f6192742640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f618c073050 con 0x7f618c15a810 2024-04-25T02:09:28.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.426+0000 7f6192742640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f618c0cbdd0 con 0x7f618c071460 2024-04-25T02:09:28.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.426+0000 7f618bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f618c15a810 0x7f618c0cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.426+0000 7f618b7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f618c09dcb0 0x7f618c070d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46046/0 (socket says 172.21.15.79:46046) 2024-04-25T02:09:28.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.426+0000 7f618bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f618c15a810 0x7f618c0cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47574/0 (socket says 172.21.15.79:47574) 2024-04-25T02:09:28.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.426+0000 7f618b7fe640 1 -- 172.21.15.79:0/636838722 learned_addr learned my addr 172.21.15.79:0/636838722 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:28.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.426+0000 7f6190cdf640 1 --2- 172.21.15.79:0/636838722 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f618c071460 0x7f618c0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.426+0000 7f618bfff640 1 -- 172.21.15.79:0/636838722 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f618c071460 msgr2=0x7f618c0b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:28.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.426+0000 7f618bfff640 1 --2- 172.21.15.79:0/636838722 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f618c071460 0x7f618c0b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.426+0000 7f618bfff640 1 -- 172.21.15.79:0/636838722 >> v1:172.21.15.79:6789/0 conn(0x7f618c09dcb0 legacy=0x7f618c070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.426+0000 7f618bfff640 1 -- 172.21.15.79:0/636838722 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c0ce580 con 0x7f618c15a810 2024-04-25T02:09:28.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.426+0000 7f618affd640 1 -- 172.21.15.79:0/636838722 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 386867123 0 0) 0x7f618c15abf0 con 0x7f618c09dcb0 2024-04-25T02:09:28.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.427+0000 7f618bfff640 1 --2- 172.21.15.79:0/636838722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c15a810 0x7f618c0cc820 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f617c0097a0 tx=0x7f617c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a6db625c7fda44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:28.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.427+0000 7f618affd640 1 -- 172.21.15.79:0/636838722 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c037070 con 0x7f618c15a810 2024-04-25T02:09:28.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.427+0000 7f618affd640 1 -- 172.21.15.79:0/636838722 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617c02ae50 con 0x7f618c15a810 2024-04-25T02:09:28.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.427+0000 7f618affd640 1 -- 172.21.15.79:0/636838722 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c032660 con 0x7f618c15a810 2024-04-25T02:09:28.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.428+0000 7f6192742640 1 -- 172.21.15.79:0/636838722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c15a810 msgr2=0x7f618c0cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.428+0000 7f6192742640 1 --2- 172.21.15.79:0/636838722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c15a810 0x7f618c0cc820 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f617c0097a0 tx=0x7f617c02a100 comp rx=0 tx=0).stop 2024-04-25T02:09:28.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.428+0000 7f6192742640 1 -- 172.21.15.79:0/636838722 shutdown_connections 2024-04-25T02:09:28.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.428+0000 7f6192742640 1 --2- 172.21.15.79:0/636838722 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f618c071460 0x7f618c0b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.428+0000 7f6192742640 1 --2- 172.21.15.79:0/636838722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c15a810 0x7f618c0cc820 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.428+0000 7f6192742640 1 -- 172.21.15.79:0/636838722 >> 172.21.15.79:0/636838722 conn(0x7f618c0b1cd0 msgr2=0x7f618c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:28.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.428+0000 7f6192742640 1 -- 172.21.15.79:0/636838722 shutdown_connections 2024-04-25T02:09:28.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.428+0000 7f6192742640 1 -- 172.21.15.79:0/636838722 wait complete. 2024-04-25T02:09:28.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.429+0000 7f6192742640 1 Processor -- start 2024-04-25T02:09:28.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.429+0000 7f6192742640 1 -- start start 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f6192742640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f618c09dcb0 0x7f618c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f6192742640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c15a810 0x7f618c09c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f6192742640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f618c149410 0x7f618c149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f6192742640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f618c0cc020 con 0x7f618c15a810 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f6192742640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f618c0ceb40 con 0x7f618c149410 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f6192742640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f618c0cc300 con 0x7f618c09dcb0 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f618b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c15a810 0x7f618c09c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f618b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c15a810 0x7f618c09c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47578/0 (socket says 172.21.15.79:47578) 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f618b7fe640 1 -- 172.21.15.79:0/883527719 learned_addr learned my addr 172.21.15.79:0/883527719 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f618bfff640 1 --2- 172.21.15.79:0/883527719 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f618c09dcb0 0x7f618c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f618b7fe640 1 -- 172.21.15.79:0/883527719 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f618c09dcb0 msgr2=0x7f618c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f618b7fe640 1 --2- 172.21.15.79:0/883527719 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f618c09dcb0 0x7f618c0cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f6190cdf640 1 --2- 172.21.15.79:0/883527719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f618c149410 0x7f618c149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f618b7fe640 1 -- 172.21.15.79:0/883527719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f618c149410 msgr2=0x7f618c149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f618b7fe640 1 --2- 172.21.15.79:0/883527719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f618c149410 0x7f618c149f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f618b7fe640 1 -- 172.21.15.79:0/883527719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c09cc70 con 0x7f618c15a810 2024-04-25T02:09:28.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f618b7fe640 1 --2- 172.21.15.79:0/883527719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c15a810 0x7f618c09c300 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f618000c4e0 tx=0x7f618000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:28.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f6188ff9640 1 -- 172.21.15.79:0/883527719 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6180018070 con 0x7f618c15a810 2024-04-25T02:09:28.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f6188ff9640 1 -- 172.21.15.79:0/883527719 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6180007500 con 0x7f618c15a810 2024-04-25T02:09:28.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.430+0000 7f6192742640 1 -- 172.21.15.79:0/883527719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618c14b440 con 0x7f618c15a810 2024-04-25T02:09:28.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.431+0000 7f6188ff9640 1 -- 172.21.15.79:0/883527719 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6180004a20 con 0x7f618c15a810 2024-04-25T02:09:28.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.431+0000 7f6192742640 1 -- 172.21.15.79:0/883527719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618c14ba00 con 0x7f618c15a810 2024-04-25T02:09:28.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.431+0000 7f6192742640 1 -- 172.21.15.79:0/883527719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618c0690a0 con 0x7f618c15a810 2024-04-25T02:09:28.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.432+0000 7f6188ff9640 1 -- 172.21.15.79:0/883527719 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f618001b070 con 0x7f618c15a810 2024-04-25T02:09:28.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.432+0000 7f6188ff9640 1 --2- 172.21.15.79:0/883527719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f617806be30 0x7f617806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.432+0000 7f6188ff9640 1 -- 172.21.15.79:0/883527719 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f618008a1c0 con 0x7f618c15a810 2024-04-25T02:09:28.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.432+0000 7f618bfff640 1 --2- 172.21.15.79:0/883527719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f617806be30 0x7f617806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.433+0000 7f618bfff640 1 --2- 172.21.15.79:0/883527719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f617806be30 0x7f617806e2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f617c034000 tx=0x7f617c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:28.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.437+0000 7f6188ff9640 1 -- 172.21.15.79:0/883527719 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6180058c30 con 0x7f618c15a810 2024-04-25T02:09:28.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.652+0000 7f6192742640 1 -- 172.21.15.79:0/883527719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f618c14bbd0 con 0x7f618c15a810 2024-04-25T02:09:28.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.710+0000 7f6188ff9640 1 -- 172.21.15.79:0/883527719 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f6180058530 con 0x7f618c15a810 2024-04-25T02:09:28.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.712+0000 7f6192742640 1 -- 172.21.15.79:0/883527719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f617806be30 msgr2=0x7f617806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.712+0000 7f6192742640 1 --2- 172.21.15.79:0/883527719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f617806be30 0x7f617806e2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f617c034000 tx=0x7f617c02e000 comp rx=0 tx=0).stop 2024-04-25T02:09:28.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.712+0000 7f6192742640 1 -- 172.21.15.79:0/883527719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c15a810 msgr2=0x7f618c09c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.712+0000 7f6192742640 1 --2- 172.21.15.79:0/883527719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c15a810 0x7f618c09c300 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f618000c4e0 tx=0x7f618000c9a0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.712+0000 7f6192742640 1 -- 172.21.15.79:0/883527719 shutdown_connections 2024-04-25T02:09:28.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.712+0000 7f6192742640 1 --2- 172.21.15.79:0/883527719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f617806be30 0x7f617806e2f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.712+0000 7f6192742640 1 --2- 172.21.15.79:0/883527719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f618c149410 0x7f618c149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.712+0000 7f6192742640 1 --2- 172.21.15.79:0/883527719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c15a810 0x7f618c09c300 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.712+0000 7f6192742640 1 --2- 172.21.15.79:0/883527719 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f618c09dcb0 0x7f618c0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.712+0000 7f6192742640 1 -- 172.21.15.79:0/883527719 >> 172.21.15.79:0/883527719 conn(0x7f618c0b1cd0 msgr2=0x7f618c0b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:28.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.712+0000 7f6192742640 1 -- 172.21.15.79:0/883527719 shutdown_connections 2024-04-25T02:09:28.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.712+0000 7f6192742640 1 -- 172.21.15.79:0/883527719 wait complete. 2024-04-25T02:09:28.731 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T02:09:28.732 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T02:09:28.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.823+0000 7fe3661a2640 1 Processor -- start 2024-04-25T02:09:28.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.823+0000 7fe3661a2640 1 -- start start 2024-04-25T02:09:28.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.824+0000 7fe3661a2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe36006b2f0 0x7fe36006b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.824+0000 7fe3661a2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe360155f00 0x7fe360156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.824+0000 7fe3661a2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe360071cd0 con 0x7fe3600b41b0 2024-04-25T02:09:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.824+0000 7fe3661a2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe360071fb0 con 0x7fe36006b2f0 2024-04-25T02:09:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.824+0000 7fe3661a2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe360072290 con 0x7fe360155f00 2024-04-25T02:09:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.824+0000 7fe35effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe36006b2f0 0x7fe36006b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.824+0000 7fe35effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe36006b2f0 0x7fe36006b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47588/0 (socket says 172.21.15.79:47588) 2024-04-25T02:09:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.824+0000 7fe35effd640 1 -- 172.21.15.79:0/1289773714 learned_addr learned my addr 172.21.15.79:0/1289773714 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.824+0000 7fe35effd640 1 -- 172.21.15.79:0/1289773714 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe360155f00 msgr2=0x7fe360156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.824+0000 7fe35effd640 1 --2- 172.21.15.79:0/1289773714 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe360155f00 0x7fe360156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.824+0000 7fe35effd640 1 -- 172.21.15.79:0/1289773714 >> v1:172.21.15.189:6789/0 conn(0x7fe3600b41b0 legacy=0x7fe3601605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.824+0000 7fe35effd640 1 -- 172.21.15.79:0/1289773714 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe360072570 con 0x7fe36006b2f0 2024-04-25T02:09:28.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.825+0000 7fe35effd640 1 --2- 172.21.15.79:0/1289773714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe36006b2f0 0x7fe36006b770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe354009870 tx=0x7fe35402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48074eda8fabf9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:28.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.825+0000 7fe35e7fc640 1 -- 172.21.15.79:0/1289773714 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe354037070 con 0x7fe36006b2f0 2024-04-25T02:09:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.825+0000 7fe35e7fc640 1 -- 172.21.15.79:0/1289773714 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe354032440 con 0x7fe36006b2f0 2024-04-25T02:09:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.825+0000 7fe35e7fc640 1 -- 172.21.15.79:0/1289773714 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe354032810 con 0x7fe36006b2f0 2024-04-25T02:09:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.825+0000 7fe3661a2640 1 -- 172.21.15.79:0/1289773714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe36006b2f0 msgr2=0x7fe36006b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.825+0000 7fe3661a2640 1 --2- 172.21.15.79:0/1289773714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe36006b2f0 0x7fe36006b770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe354009870 tx=0x7fe35402a210 comp rx=0 tx=0).stop 2024-04-25T02:09:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.825+0000 7fe3661a2640 1 -- 172.21.15.79:0/1289773714 shutdown_connections 2024-04-25T02:09:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.825+0000 7fe3661a2640 1 --2- 172.21.15.79:0/1289773714 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe360155f00 0x7fe360156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.825+0000 7fe3661a2640 1 --2- 172.21.15.79:0/1289773714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe36006b2f0 0x7fe36006b770 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.825+0000 7fe3661a2640 1 -- 172.21.15.79:0/1289773714 >> 172.21.15.79:0/1289773714 conn(0x7fe3600b1cd0 msgr2=0x7fe3600b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.825+0000 7fe3661a2640 1 -- 172.21.15.79:0/1289773714 shutdown_connections 2024-04-25T02:09:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.825+0000 7fe3661a2640 1 -- 172.21.15.79:0/1289773714 wait complete. 2024-04-25T02:09:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.826+0000 7fe3661a2640 1 Processor -- start 2024-04-25T02:09:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.827+0000 7fe3661a2640 1 -- start start 2024-04-25T02:09:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.827+0000 7fe3661a2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe36006b2f0 0x7fe36014c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.827+0000 7fe3661a2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3600b41b0 0x7fe36006d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.827+0000 7fe3661a2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe360155f00 0x7fe3600ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.827+0000 7fe3661a2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe3600b4590 con 0x7fe36006b2f0 2024-04-25T02:09:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.827+0000 7fe3661a2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe36015c870 con 0x7fe3600b41b0 2024-04-25T02:09:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.827+0000 7fe3661a2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe3600b4710 con 0x7fe360155f00 2024-04-25T02:09:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.827+0000 7fe35f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe36006b2f0 0x7fe36014c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe35f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe36006b2f0 0x7fe36014c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47592/0 (socket says 172.21.15.79:47592) 2024-04-25T02:09:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe35f7fe640 1 -- 172.21.15.79:0/2988384148 learned_addr learned my addr 172.21.15.79:0/2988384148 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe35effd640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3600b41b0 0x7fe36006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe35ffff640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe360155f00 0x7fe3600ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe35f7fe640 1 -- 172.21.15.79:0/2988384148 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe360155f00 msgr2=0x7fe3600ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe35f7fe640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe360155f00 0x7fe3600ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe35f7fe640 1 -- 172.21.15.79:0/2988384148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3600b41b0 msgr2=0x7fe36006d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe35f7fe640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3600b41b0 0x7fe36006d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe35f7fe640 1 -- 172.21.15.79:0/2988384148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3600cf690 con 0x7fe36006b2f0 2024-04-25T02:09:28.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe35effd640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3600b41b0 0x7fe36006d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:28.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe35ffff640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe360155f00 0x7fe3600ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:28.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe35f7fe640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe36006b2f0 0x7fe36014c830 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe35000c460 tx=0x7fe35000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:28.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe347fff640 1 -- 172.21.15.79:0/2988384148 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe350016020 con 0x7fe36006b2f0 2024-04-25T02:09:28.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe347fff640 1 -- 172.21.15.79:0/2988384148 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe350012870 con 0x7fe36006b2f0 2024-04-25T02:09:28.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe3661a2640 1 -- 172.21.15.79:0/2988384148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe36006dcf0 con 0x7fe36006b2f0 2024-04-25T02:09:28.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe347fff640 1 -- 172.21.15.79:0/2988384148 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe350012c60 con 0x7fe36006b2f0 2024-04-25T02:09:28.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.828+0000 7fe3661a2640 1 -- 172.21.15.79:0/2988384148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe36006d9c0 con 0x7fe36006b2f0 2024-04-25T02:09:28.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.829+0000 7fe3661a2640 1 -- 172.21.15.79:0/2988384148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3600690a0 con 0x7fe36006b2f0 2024-04-25T02:09:28.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.830+0000 7fe347fff640 1 -- 172.21.15.79:0/2988384148 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe350019020 con 0x7fe36006b2f0 2024-04-25T02:09:28.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.830+0000 7fe347fff640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe34c06be30 0x7fe34c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.830+0000 7fe347fff640 1 -- 172.21.15.79:0/2988384148 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fe35008aad0 con 0x7fe36006b2f0 2024-04-25T02:09:28.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.830+0000 7fe35effd640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe34c06be30 0x7fe34c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.831+0000 7fe35effd640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe34c06be30 0x7fe34c06e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe354034000 tx=0x7fe35402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:28.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:28.834+0000 7fe347fff640 1 -- 172.21.15.79:0/2988384148 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe350020030 con 0x7fe36006b2f0 2024-04-25T02:09:29.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.044+0000 7fe3661a2640 1 -- 172.21.15.79:0/2988384148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe36015b150 con 0x7fe36006b2f0 2024-04-25T02:09:29.500 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:09:29.503 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:09:29.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.715+0000 7fe347fff640 1 -- 172.21.15.79:0/2988384148 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fe350059510 con 0x7fe36006b2f0 2024-04-25T02:09:29.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.717+0000 7fe3661a2640 1 -- 172.21.15.79:0/2988384148 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe34c06be30 msgr2=0x7fe34c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:29.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.717+0000 7fe3661a2640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe34c06be30 0x7fe34c06e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe354034000 tx=0x7fe35402e000 comp rx=0 tx=0).stop 2024-04-25T02:09:29.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.717+0000 7fe3661a2640 1 -- 172.21.15.79:0/2988384148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe36006b2f0 msgr2=0x7fe36014c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:29.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.717+0000 7fe3661a2640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe36006b2f0 0x7fe36014c830 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe35000c460 tx=0x7fe35000c920 comp rx=0 tx=0).stop 2024-04-25T02:09:29.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.717+0000 7fe3661a2640 1 -- 172.21.15.79:0/2988384148 shutdown_connections 2024-04-25T02:09:29.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.717+0000 7fe3661a2640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe34c06be30 0x7fe34c06e2f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.717+0000 7fe3661a2640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe360155f00 0x7fe3600ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.717+0000 7fe3661a2640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3600b41b0 0x7fe36006d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.717+0000 7fe3661a2640 1 --2- 172.21.15.79:0/2988384148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe36006b2f0 0x7fe36014c830 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.718+0000 7fe3661a2640 1 -- 172.21.15.79:0/2988384148 >> 172.21.15.79:0/2988384148 conn(0x7fe3600b1cd0 msgr2=0x7fe3600b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:29.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.718+0000 7fe3661a2640 1 -- 172.21.15.79:0/2988384148 shutdown_connections 2024-04-25T02:09:29.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.718+0000 7fe3661a2640 1 -- 172.21.15.79:0/2988384148 wait complete. 2024-04-25T02:09:29.737 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T02:09:29.737 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:29.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.826+0000 7f570dbf9640 1 Processor -- start 2024-04-25T02:09:29.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.826+0000 7f570dbf9640 1 -- start start 2024-04-25T02:09:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.826+0000 7f570dbf9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5708144cb0 0x7f57080b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.826+0000 7f570dbf9640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f570806e660 0x7f5708071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.826+0000 7f570dbf9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5708070d90 con 0x7f57080b5580 2024-04-25T02:09:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.826+0000 7f570dbf9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f57080cf130 con 0x7f5708144cb0 2024-04-25T02:09:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.826+0000 7f570dbf9640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f57080cf410 con 0x7f570806e660 2024-04-25T02:09:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.827+0000 7f57077fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5708144cb0 0x7f57080b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.827+0000 7f57077fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5708144cb0 0x7f57080b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47608/0 (socket says 172.21.15.79:47608) 2024-04-25T02:09:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.827+0000 7f57077fe640 1 -- 172.21.15.79:0/1382915676 learned_addr learned my addr 172.21.15.79:0/1382915676 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.827+0000 7f5707fff640 1 --2- 172.21.15.79:0/1382915676 >> v2:172.21.15.189:3300/0 conn(0x7f570806e660 0x7f5708071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.827+0000 7f57077fe640 1 -- 172.21.15.79:0/1382915676 >> v2:172.21.15.189:3300/0 conn(0x7f570806e660 msgr2=0x7f5708071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.827+0000 7f57077fe640 1 --2- 172.21.15.79:0/1382915676 >> v2:172.21.15.189:3300/0 conn(0x7f570806e660 0x7f5708071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.827+0000 7f57077fe640 1 -- 172.21.15.79:0/1382915676 >> v1:172.21.15.189:6789/0 conn(0x7f57080b5580 legacy=0x7f570806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.827+0000 7f57077fe640 1 -- 172.21.15.79:0/1382915676 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57080cf6f0 con 0x7f5708144cb0 2024-04-25T02:09:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.828+0000 7f57077fe640 1 --2- 172.21.15.79:0/1382915676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5708144cb0 0x7f57080b5040 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f56f8009870 tx=0x7f56f802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db643147303146b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.828+0000 7f5706ffd640 1 -- 172.21.15.79:0/1382915676 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f8037070 con 0x7f5708144cb0 2024-04-25T02:09:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.828+0000 7f5706ffd640 1 -- 172.21.15.79:0/1382915676 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f802ae40 con 0x7f5708144cb0 2024-04-25T02:09:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.828+0000 7f5706ffd640 1 -- 172.21.15.79:0/1382915676 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f8032660 con 0x7f5708144cb0 2024-04-25T02:09:29.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.828+0000 7f570dbf9640 1 -- 172.21.15.79:0/1382915676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5708144cb0 msgr2=0x7f57080b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:29.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.828+0000 7f570dbf9640 1 --2- 172.21.15.79:0/1382915676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5708144cb0 0x7f57080b5040 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f56f8009870 tx=0x7f56f802a130 comp rx=0 tx=0).stop 2024-04-25T02:09:29.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.828+0000 7f570dbf9640 1 -- 172.21.15.79:0/1382915676 shutdown_connections 2024-04-25T02:09:29.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.828+0000 7f570dbf9640 1 --2- 172.21.15.79:0/1382915676 >> v2:172.21.15.189:3300/0 conn(0x7f570806e660 0x7f5708071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.828+0000 7f570dbf9640 1 --2- 172.21.15.79:0/1382915676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5708144cb0 0x7f57080b5040 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.828+0000 7f570dbf9640 1 -- 172.21.15.79:0/1382915676 >> 172.21.15.79:0/1382915676 conn(0x7f57080cfc80 msgr2=0x7f57080d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.828+0000 7f570dbf9640 1 -- 172.21.15.79:0/1382915676 shutdown_connections 2024-04-25T02:09:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.828+0000 7f570dbf9640 1 -- 172.21.15.79:0/1382915676 wait complete. 2024-04-25T02:09:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.829+0000 7f570dbf9640 1 Processor -- start 2024-04-25T02:09:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.830+0000 7f570dbf9640 1 -- start start 2024-04-25T02:09:29.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.830+0000 7f570dbf9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f570806e660 0x7f5708140470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:29.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.830+0000 7f570dbf9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f57080b5580 0x7f57081e5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:29.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.830+0000 7f570dbf9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5708144cb0 0x7f5708131570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.830+0000 7f570dbf9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5708145ab0 con 0x7f570806e660 2024-04-25T02:09:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.830+0000 7f570dbf9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5708145090 con 0x7f5708144cb0 2024-04-25T02:09:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.830+0000 7f570dbf9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5708145c30 con 0x7f57080b5580 2024-04-25T02:09:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.830+0000 7f57077fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f570806e660 0x7f5708140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.830+0000 7f57077fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f570806e660 0x7f5708140470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47622/0 (socket says 172.21.15.79:47622) 2024-04-25T02:09:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.830+0000 7f57077fe640 1 -- 172.21.15.79:0/1381486811 learned_addr learned my addr 172.21.15.79:0/1381486811 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.831+0000 7f5707fff640 1 --2- 172.21.15.79:0/1381486811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5708144cb0 0x7f5708131570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.831+0000 7f57077fe640 1 -- 172.21.15.79:0/1381486811 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f57080b5580 msgr2=0x7f57081e5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.831+0000 7f57077fe640 1 --2- 172.21.15.79:0/1381486811 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f57080b5580 0x7f57081e5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.831+0000 7f57077fe640 1 -- 172.21.15.79:0/1381486811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5708144cb0 msgr2=0x7f5708131570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.831+0000 7f57077fe640 1 --2- 172.21.15.79:0/1381486811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5708144cb0 0x7f5708131570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.831+0000 7f57077fe640 1 -- 172.21.15.79:0/1381486811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57080aeeb0 con 0x7f570806e660 2024-04-25T02:09:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.831+0000 7f5707fff640 1 --2- 172.21.15.79:0/1381486811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5708144cb0 0x7f5708131570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:29.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.831+0000 7f57077fe640 1 --2- 172.21.15.79:0/1381486811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f570806e660 0x7f5708140470 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f56f8000c00 tx=0x7f56f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:29.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.831+0000 7f5704ff9640 1 -- 172.21.15.79:0/1381486811 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f8037040 con 0x7f570806e660 2024-04-25T02:09:29.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.831+0000 7f5704ff9640 1 -- 172.21.15.79:0/1381486811 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f8004030 con 0x7f570806e660 2024-04-25T02:09:29.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.831+0000 7f570dbf9640 1 -- 172.21.15.79:0/1381486811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57080af190 con 0x7f570806e660 2024-04-25T02:09:29.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.831+0000 7f5704ff9640 1 -- 172.21.15.79:0/1381486811 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f8004420 con 0x7f570806e660 2024-04-25T02:09:29.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.831+0000 7f570dbf9640 1 -- 172.21.15.79:0/1381486811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f570812f860 con 0x7f570806e660 2024-04-25T02:09:29.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.832+0000 7f570dbf9640 1 -- 172.21.15.79:0/1381486811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57080690a0 con 0x7f570806e660 2024-04-25T02:09:29.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.832+0000 7f5704ff9640 1 -- 172.21.15.79:0/1381486811 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56f803a070 con 0x7f570806e660 2024-04-25T02:09:29.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.833+0000 7f5704ff9640 1 --2- 172.21.15.79:0/1381486811 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56e806be30 0x7f56e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:29.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.833+0000 7f5704ff9640 1 -- 172.21.15.79:0/1381486811 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f56f80ab410 con 0x7f570806e660 2024-04-25T02:09:29.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.833+0000 7f56feffd640 1 --2- 172.21.15.79:0/1381486811 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56e806be30 0x7f56e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:29.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.833+0000 7f56feffd640 1 --2- 172.21.15.79:0/1381486811 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56e806be30 0x7f56e806e2f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f57080b59b0 tx=0x7f56f0007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:29.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:29.837+0000 7f5704ff9640 1 -- 172.21.15.79:0/1381486811 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f56f8041020 con 0x7f570806e660 2024-04-25T02:09:30.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.045+0000 7f570dbf9640 1 -- 172.21.15.79:0/1381486811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57080cee70 con 0x7f570806e660 2024-04-25T02:09:30.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.046+0000 7f5704ff9640 1 -- 172.21.15.79:0/1381486811 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7f56f8079ee0 con 0x7f570806e660 2024-04-25T02:09:30.054 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:30.054 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3934472151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3934472151},{"type":"v1","addr":"172.21.15.189:6835","nonce":3934472151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2046740048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2046740048},{"type":"v1","addr":"172.21.15.79:6836","nonce":2046740048}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/207160678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":207160678},{"type":"v1","addr":"172.21.15.79:6837","nonce":207160678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:09:27.032071+0000","modified":"2024-04-25T02:09:29.046598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/1295756642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1295756642},{"type":"v1","addr":"172.21.15.189:6833","nonce":1295756642}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":3}]} 2024-04-25T02:09:30.055 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2024-04-25T02:09:30.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.048+0000 7f570dbf9640 1 -- 172.21.15.79:0/1381486811 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56e806be30 msgr2=0x7f56e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.048+0000 7f570dbf9640 1 --2- 172.21.15.79:0/1381486811 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56e806be30 0x7f56e806e2f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f57080b59b0 tx=0x7f56f0007990 comp rx=0 tx=0).stop 2024-04-25T02:09:30.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.048+0000 7f570dbf9640 1 -- 172.21.15.79:0/1381486811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f570806e660 msgr2=0x7f5708140470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.048+0000 7f570dbf9640 1 --2- 172.21.15.79:0/1381486811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f570806e660 0x7f5708140470 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f56f8000c00 tx=0x7f56f80046c0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.048+0000 7f570dbf9640 1 -- 172.21.15.79:0/1381486811 shutdown_connections 2024-04-25T02:09:30.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.048+0000 7f570dbf9640 1 --2- 172.21.15.79:0/1381486811 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56e806be30 0x7f56e806e2f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.048+0000 7f570dbf9640 1 --2- 172.21.15.79:0/1381486811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5708144cb0 0x7f5708131570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.048+0000 7f570dbf9640 1 --2- 172.21.15.79:0/1381486811 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f57080b5580 0x7f57081e5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.048+0000 7f570dbf9640 1 --2- 172.21.15.79:0/1381486811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f570806e660 0x7f5708140470 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.048+0000 7f570dbf9640 1 -- 172.21.15.79:0/1381486811 >> 172.21.15.79:0/1381486811 conn(0x7f57080cfc80 msgr2=0x7f57080afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:30.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.048+0000 7f570dbf9640 1 -- 172.21.15.79:0/1381486811 shutdown_connections 2024-04-25T02:09:30.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.048+0000 7f570dbf9640 1 -- 172.21.15.79:0/1381486811 wait complete. 2024-04-25T02:09:30.067 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:30.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.156+0000 7fd9aa08c640 1 Processor -- start 2024-04-25T02:09:30.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.156+0000 7fd9aa08c640 1 -- start start 2024-04-25T02:09:30.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.156+0000 7fd9aa08c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd9a415e4d0 0x7fd9a406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.156+0000 7fd9aa08c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9a40d1660 con 0x7fd9a40b3570 2024-04-25T02:09:30.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.156+0000 7fd9aa08c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9a40d1380 con 0x7fd9a40d2e20 2024-04-25T02:09:30.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.156+0000 7fd9aa08c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd9a40cede0 con 0x7fd9a415e4d0 2024-04-25T02:09:30.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.157+0000 7fd9a37fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd9a415e4d0 0x7fd9a406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.157+0000 7fd99bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd9a40b3570 0x7fd9a40d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46060/0 (socket says 172.21.15.79:46060) 2024-04-25T02:09:30.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.157+0000 7fd99bfff640 1 -- 172.21.15.79:0/2347593287 learned_addr learned my addr 172.21.15.79:0/2347593287 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:30.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.157+0000 7fd9a37fe640 1 -- 172.21.15.79:0/2347593287 >> v1:172.21.15.189:6789/0 conn(0x7fd9a40d2e20 legacy=0x7fd9a40cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.157+0000 7fd9a37fe640 1 -- 172.21.15.79:0/2347593287 >> v1:172.21.15.79:6789/0 conn(0x7fd9a40b3570 legacy=0x7fd9a40d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.157+0000 7fd9a37fe640 1 -- 172.21.15.79:0/2347593287 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a40cf0c0 con 0x7fd9a415e4d0 2024-04-25T02:09:30.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.157+0000 7fd9a2ffd640 1 -- 172.21.15.79:0/2347593287 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1867598491 0 0) 0x7fd9a40d1660 con 0x7fd9a40b3570 2024-04-25T02:09:30.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.157+0000 7fd9a37fe640 1 --2- 172.21.15.79:0/2347593287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a415e4d0 0x7fd9a406bc70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd9940097d0 tx=0x7fd99402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a8dcb113c02333 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:30.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.158+0000 7fd9a2ffd640 1 -- 172.21.15.79:0/2347593287 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd994037070 con 0x7fd9a415e4d0 2024-04-25T02:09:30.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.158+0000 7fd9a2ffd640 1 -- 172.21.15.79:0/2347593287 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd994032440 con 0x7fd9a415e4d0 2024-04-25T02:09:30.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.158+0000 7fd9a2ffd640 1 -- 172.21.15.79:0/2347593287 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd994032810 con 0x7fd9a415e4d0 2024-04-25T02:09:30.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.158+0000 7fd9aa08c640 1 -- 172.21.15.79:0/2347593287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a415e4d0 msgr2=0x7fd9a406bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.158+0000 7fd9aa08c640 1 --2- 172.21.15.79:0/2347593287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a415e4d0 0x7fd9a406bc70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd9940097d0 tx=0x7fd99402a270 comp rx=0 tx=0).stop 2024-04-25T02:09:30.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.158+0000 7fd9aa08c640 1 -- 172.21.15.79:0/2347593287 shutdown_connections 2024-04-25T02:09:30.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.158+0000 7fd9aa08c640 1 --2- 172.21.15.79:0/2347593287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a415e4d0 0x7fd9a406bc70 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.158+0000 7fd9aa08c640 1 -- 172.21.15.79:0/2347593287 >> 172.21.15.79:0/2347593287 conn(0x7fd9a409d460 msgr2=0x7fd9a40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:30.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.158+0000 7fd9aa08c640 1 -- 172.21.15.79:0/2347593287 shutdown_connections 2024-04-25T02:09:30.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.158+0000 7fd9aa08c640 1 -- 172.21.15.79:0/2347593287 wait complete. 2024-04-25T02:09:30.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.159+0000 7fd9aa08c640 1 Processor -- start 2024-04-25T02:09:30.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.159+0000 7fd9aa08c640 1 -- start start 2024-04-25T02:09:30.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.160+0000 7fd9aa08c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9a40b3570 0x7fd9a415cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.160+0000 7fd9aa08c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a40d2e20 0x7fd9a40b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.160+0000 7fd9aa08c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9a415e4d0 0x7fd9a40b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.160+0000 7fd9aa08c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a40d2250 con 0x7fd9a40d2e20 2024-04-25T02:09:30.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.160+0000 7fd9aa08c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a40d20d0 con 0x7fd9a415e4d0 2024-04-25T02:09:30.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.160+0000 7fd9aa08c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd9a406c1b0 con 0x7fd9a40b3570 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.160+0000 7fd99bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a40d2e20 0x7fd9a40b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.160+0000 7fd99bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a40d2e20 0x7fd9a40b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47644/0 (socket says 172.21.15.79:47644) 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.160+0000 7fd99bfff640 1 -- 172.21.15.79:0/1492229618 learned_addr learned my addr 172.21.15.79:0/1492229618 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.160+0000 7fd9a3fff640 1 --2- 172.21.15.79:0/1492229618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9a415e4d0 0x7fd9a40b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.160+0000 7fd9a37fe640 1 --2- 172.21.15.79:0/1492229618 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9a40b3570 0x7fd9a415cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.160+0000 7fd99bfff640 1 -- 172.21.15.79:0/1492229618 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9a40b3570 msgr2=0x7fd9a415cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.160+0000 7fd99bfff640 1 --2- 172.21.15.79:0/1492229618 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9a40b3570 0x7fd9a415cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.160+0000 7fd99bfff640 1 -- 172.21.15.79:0/1492229618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9a415e4d0 msgr2=0x7fd9a40b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.160+0000 7fd99bfff640 1 --2- 172.21.15.79:0/1492229618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9a415e4d0 0x7fd9a40b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.161+0000 7fd99bfff640 1 -- 172.21.15.79:0/1492229618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a41f4380 con 0x7fd9a40d2e20 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.161+0000 7fd99bfff640 1 --2- 172.21.15.79:0/1492229618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a40d2e20 0x7fd9a40b5c50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd98c00c4d0 tx=0x7fd98c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.161+0000 7fd9a0ff9640 1 -- 172.21.15.79:0/1492229618 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c018070 con 0x7fd9a40d2e20 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.161+0000 7fd9a0ff9640 1 -- 172.21.15.79:0/1492229618 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd98c0074e0 con 0x7fd9a40d2e20 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.161+0000 7fd9aa08c640 1 -- 172.21.15.79:0/1492229618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9a41f4660 con 0x7fd9a40d2e20 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.161+0000 7fd9a0ff9640 1 -- 172.21.15.79:0/1492229618 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c004a20 con 0x7fd9a40d2e20 2024-04-25T02:09:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.161+0000 7fd9aa08c640 1 -- 172.21.15.79:0/1492229618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9a41f4c20 con 0x7fd9a40d2e20 2024-04-25T02:09:30.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.162+0000 7fd9aa08c640 1 -- 172.21.15.79:0/1492229618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9a40690a0 con 0x7fd9a40d2e20 2024-04-25T02:09:30.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.162+0000 7fd9a0ff9640 1 -- 172.21.15.79:0/1492229618 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd98c01b070 con 0x7fd9a40d2e20 2024-04-25T02:09:30.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.163+0000 7fd9a0ff9640 1 --2- 172.21.15.79:0/1492229618 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd98406be30 0x7fd98406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.163+0000 7fd9a0ff9640 1 -- 172.21.15.79:0/1492229618 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fd98c08a170 con 0x7fd9a40d2e20 2024-04-25T02:09:30.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.163+0000 7fd9a37fe640 1 --2- 172.21.15.79:0/1492229618 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd98406be30 0x7fd98406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.163+0000 7fd9a37fe640 1 --2- 172.21.15.79:0/1492229618 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd98406be30 0x7fd98406e2f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd994034000 tx=0x7fd99402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:30.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.168+0000 7fd9a0ff9640 1 -- 172.21.15.79:0/1492229618 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd98c058bb0 con 0x7fd9a40d2e20 2024-04-25T02:09:30.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.342+0000 7fd9aa08c640 1 -- 172.21.15.79:0/1492229618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9a40d1920 con 0x7fd9a40d2e20 2024-04-25T02:09:30.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.343+0000 7fd9a0ff9640 1 -- 172.21.15.79:0/1492229618 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16625 (secure 0 0 0) 0x7fd98c0584b0 con 0x7fd9a40d2e20 2024-04-25T02:09:30.351 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:30.351 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":45,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:09:28.701396+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:09:25.247996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T02:09:26.001469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:30.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.345+0000 7fd9aa08c640 1 -- 172.21.15.79:0/1492229618 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd98406be30 msgr2=0x7fd98406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.345+0000 7fd9aa08c640 1 --2- 172.21.15.79:0/1492229618 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd98406be30 0x7fd98406e2f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd994034000 tx=0x7fd99402e000 comp rx=0 tx=0).stop 2024-04-25T02:09:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.345+0000 7fd9aa08c640 1 -- 172.21.15.79:0/1492229618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a40d2e20 msgr2=0x7fd9a40b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.345+0000 7fd9aa08c640 1 --2- 172.21.15.79:0/1492229618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a40d2e20 0x7fd9a40b5c50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd98c00c4d0 tx=0x7fd98c00c990 comp rx=0 tx=0).stop 2024-04-25T02:09:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.345+0000 7fd9aa08c640 1 -- 172.21.15.79:0/1492229618 shutdown_connections 2024-04-25T02:09:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.345+0000 7fd9aa08c640 1 --2- 172.21.15.79:0/1492229618 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd98406be30 0x7fd98406e2f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.345+0000 7fd9aa08c640 1 --2- 172.21.15.79:0/1492229618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9a415e4d0 0x7fd9a40b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.345+0000 7fd9aa08c640 1 --2- 172.21.15.79:0/1492229618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a40d2e20 0x7fd9a40b5c50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.345+0000 7fd9aa08c640 1 --2- 172.21.15.79:0/1492229618 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9a40b3570 0x7fd9a415cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.345+0000 7fd9aa08c640 1 -- 172.21.15.79:0/1492229618 >> 172.21.15.79:0/1492229618 conn(0x7fd9a409d460 msgr2=0x7fd9a40d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.345+0000 7fd9aa08c640 1 -- 172.21.15.79:0/1492229618 shutdown_connections 2024-04-25T02:09:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.345+0000 7fd9aa08c640 1 -- 172.21.15.79:0/1492229618 wait complete. 2024-04-25T02:09:30.364 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T02:09:30.365 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:09:30.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.453+0000 7f56febc4640 1 Processor -- start 2024-04-25T02:09:30.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.453+0000 7f56febc4640 1 -- start start 2024-04-25T02:09:30.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.454+0000 7f56febc4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56f8143bc0 0x7f56f815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.454+0000 7f56febc4640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f56f806df50 0x7f56f806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.454+0000 7f56febc4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f56f80b48e0 0x7f56f80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.454+0000 7f56febc4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f56f806e8f0 con 0x7f56f80b48e0 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.454+0000 7f56febc4640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f56f8072cb0 con 0x7f56f806df50 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.454+0000 7f56febc4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f56f815fa40 con 0x7f56f8143bc0 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.454+0000 7f56fd161640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f56f80b48e0 0x7f56f80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.454+0000 7f56fd161640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f56f80b48e0 0x7f56f80b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47648/0 (socket says 172.21.15.79:47648) 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.454+0000 7f56fd161640 1 -- 172.21.15.79:0/2336955617 learned_addr learned my addr 172.21.15.79:0/2336955617 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.455+0000 7f56f7fff640 1 --2- 172.21.15.79:0/2336955617 >> v2:172.21.15.189:3300/0 conn(0x7f56f806df50 0x7f56f806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.455+0000 7f56fc960640 1 --2- 172.21.15.79:0/2336955617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56f8143bc0 0x7f56f815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.455+0000 7f56fd161640 1 -- 172.21.15.79:0/2336955617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56f8143bc0 msgr2=0x7f56f815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.455+0000 7f56fd161640 1 --2- 172.21.15.79:0/2336955617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56f8143bc0 0x7f56f815f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.455+0000 7f56fd161640 1 -- 172.21.15.79:0/2336955617 >> v2:172.21.15.189:3300/0 conn(0x7f56f806df50 msgr2=0x7f56f806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.455+0000 7f56fd161640 1 --2- 172.21.15.79:0/2336955617 >> v2:172.21.15.189:3300/0 conn(0x7f56f806df50 0x7f56f806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.455+0000 7f56fd161640 1 -- 172.21.15.79:0/2336955617 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f8071e00 con 0x7f56f80b48e0 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.455+0000 7f56f7fff640 1 --2- 172.21.15.79:0/2336955617 >> v2:172.21.15.189:3300/0 conn(0x7f56f806df50 0x7f56f806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:30.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.455+0000 7f56fc960640 1 --2- 172.21.15.79:0/2336955617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56f8143bc0 0x7f56f815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:30.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.455+0000 7f56fd161640 1 --2- 172.21.15.79:0/2336955617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f80b48e0 0x7f56f80b4d40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f56f80b2a80 tx=0x7f56f002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316cd9f17cfe4a4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:30.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.455+0000 7f56f77fe640 1 -- 172.21.15.79:0/2336955617 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0036070 con 0x7f56f80b48e0 2024-04-25T02:09:30.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.455+0000 7f56f77fe640 1 -- 172.21.15.79:0/2336955617 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f0031600 con 0x7f56f80b48e0 2024-04-25T02:09:30.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.456+0000 7f56f77fe640 1 -- 172.21.15.79:0/2336955617 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f00319d0 con 0x7f56f80b48e0 2024-04-25T02:09:30.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.456+0000 7f56febc4640 1 -- 172.21.15.79:0/2336955617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f80b48e0 msgr2=0x7f56f80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.456+0000 7f56febc4640 1 --2- 172.21.15.79:0/2336955617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f80b48e0 0x7f56f80b4d40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f56f80b2a80 tx=0x7f56f002a610 comp rx=0 tx=0).stop 2024-04-25T02:09:30.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.456+0000 7f56febc4640 1 -- 172.21.15.79:0/2336955617 shutdown_connections 2024-04-25T02:09:30.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.456+0000 7f56febc4640 1 --2- 172.21.15.79:0/2336955617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f80b48e0 0x7f56f80b4d40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.456+0000 7f56febc4640 1 --2- 172.21.15.79:0/2336955617 >> v2:172.21.15.189:3300/0 conn(0x7f56f806df50 0x7f56f806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.456+0000 7f56febc4640 1 --2- 172.21.15.79:0/2336955617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56f8143bc0 0x7f56f815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.456+0000 7f56febc4640 1 -- 172.21.15.79:0/2336955617 >> 172.21.15.79:0/2336955617 conn(0x7f56f80cfc80 msgr2=0x7f56f80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:30.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.456+0000 7f56febc4640 1 -- 172.21.15.79:0/2336955617 shutdown_connections 2024-04-25T02:09:30.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.456+0000 7f56febc4640 1 -- 172.21.15.79:0/2336955617 wait complete. 2024-04-25T02:09:30.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.457+0000 7f56febc4640 1 Processor -- start 2024-04-25T02:09:30.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.457+0000 7f56febc4640 1 -- start start 2024-04-25T02:09:30.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.458+0000 7f56febc4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f806df50 0x7f56f813e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.458+0000 7f56febc4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56f80b48e0 0x7f56f814a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.458+0000 7f56febc4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f8143bc0 0x7f56f814a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.458+0000 7f56febc4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8072660 con 0x7f56f8143bc0 2024-04-25T02:09:30.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.458+0000 7f56febc4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8072380 con 0x7f56f806df50 2024-04-25T02:09:30.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.458+0000 7f56febc4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f56f8072940 con 0x7f56f80b48e0 2024-04-25T02:09:30.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.458+0000 7f56fd161640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f8143bc0 0x7f56f814a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.458+0000 7f56fd161640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f8143bc0 0x7f56f814a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47664/0 (socket says 172.21.15.79:47664) 2024-04-25T02:09:30.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.458+0000 7f56fd161640 1 -- 172.21.15.79:0/1346728070 learned_addr learned my addr 172.21.15.79:0/1346728070 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:30.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.458+0000 7f56f7fff640 1 --2- 172.21.15.79:0/1346728070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56f80b48e0 0x7f56f814a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.458+0000 7f56fc960640 1 --2- 172.21.15.79:0/1346728070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f806df50 0x7f56f813e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.458+0000 7f56fd161640 1 -- 172.21.15.79:0/1346728070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56f80b48e0 msgr2=0x7f56f814a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.458+0000 7f56fd161640 1 --2- 172.21.15.79:0/1346728070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56f80b48e0 0x7f56f814a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.458+0000 7f56fd161640 1 -- 172.21.15.79:0/1346728070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f806df50 msgr2=0x7f56f813e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.458+0000 7f56fd161640 1 --2- 172.21.15.79:0/1346728070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f806df50 0x7f56f813e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.459+0000 7f56fd161640 1 -- 172.21.15.79:0/1346728070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f814ae90 con 0x7f56f8143bc0 2024-04-25T02:09:30.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.459+0000 7f56fd161640 1 --2- 172.21.15.79:0/1346728070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f8143bc0 0x7f56f814a860 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f56f0034040 tx=0x7f56f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:30.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.459+0000 7f56f57fa640 1 -- 172.21.15.79:0/1346728070 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0036050 con 0x7f56f8143bc0 2024-04-25T02:09:30.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.459+0000 7f56f57fa640 1 -- 172.21.15.79:0/1346728070 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f0042070 con 0x7f56f8143bc0 2024-04-25T02:09:30.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.459+0000 7f56febc4640 1 -- 172.21.15.79:0/1346728070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f814b170 con 0x7f56f8143bc0 2024-04-25T02:09:30.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.459+0000 7f56f57fa640 1 -- 172.21.15.79:0/1346728070 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0009510 con 0x7f56f8143bc0 2024-04-25T02:09:30.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.459+0000 7f56febc4640 1 -- 172.21.15.79:0/1346728070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f814b730 con 0x7f56f8143bc0 2024-04-25T02:09:30.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.460+0000 7f56febc4640 1 -- 172.21.15.79:0/1346728070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f80707d0 con 0x7f56f8143bc0 2024-04-25T02:09:30.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.460+0000 7f56f57fa640 1 -- 172.21.15.79:0/1346728070 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56f0007bd0 con 0x7f56f8143bc0 2024-04-25T02:09:30.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.461+0000 7f56f57fa640 1 --2- 172.21.15.79:0/1346728070 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56e406be30 0x7f56e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.461+0000 7f56f57fa640 1 -- 172.21.15.79:0/1346728070 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f56f00abdd0 con 0x7f56f8143bc0 2024-04-25T02:09:30.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.461+0000 7f56fc960640 1 --2- 172.21.15.79:0/1346728070 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56e406be30 0x7f56e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.461+0000 7f56fc960640 1 --2- 172.21.15.79:0/1346728070 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56e406be30 0x7f56e406e2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f56f80b4170 tx=0x7f56e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:30.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.465+0000 7f56f57fa640 1 -- 172.21.15.79:0/1346728070 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f56f80707d0 con 0x7f56f8143bc0 2024-04-25T02:09:30.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.632+0000 7f56febc4640 1 -- 172.21.15.79:0/1346728070 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56f80690a0 con 0x7f56e406be30 2024-04-25T02:09:30.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.638+0000 7f56f57fa640 1 -- 172.21.15.79:0/1346728070 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239831 (secure 0 0 0) 0x7f56f80690a0 con 0x7f56e406be30 2024-04-25T02:09:30.648 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:30.650 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:09:30.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.641+0000 7f56febc4640 1 -- 172.21.15.79:0/1346728070 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56e406be30 msgr2=0x7f56e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.641+0000 7f56febc4640 1 --2- 172.21.15.79:0/1346728070 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56e406be30 0x7f56e406e2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f56f80b4170 tx=0x7f56e8008040 comp rx=0 tx=0).stop 2024-04-25T02:09:30.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.641+0000 7f56febc4640 1 -- 172.21.15.79:0/1346728070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f8143bc0 msgr2=0x7f56f814a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.641+0000 7f56febc4640 1 --2- 172.21.15.79:0/1346728070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f8143bc0 0x7f56f814a860 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f56f0034040 tx=0x7f56f0004a40 comp rx=0 tx=0).stop 2024-04-25T02:09:30.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.641+0000 7f56febc4640 1 -- 172.21.15.79:0/1346728070 shutdown_connections 2024-04-25T02:09:30.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.641+0000 7f56febc4640 1 --2- 172.21.15.79:0/1346728070 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56e406be30 0x7f56e406e2f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.641+0000 7f56febc4640 1 --2- 172.21.15.79:0/1346728070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f8143bc0 0x7f56f814a860 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.641+0000 7f56febc4640 1 --2- 172.21.15.79:0/1346728070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56f80b48e0 0x7f56f814a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.641+0000 7f56febc4640 1 --2- 172.21.15.79:0/1346728070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f806df50 0x7f56f813e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.641+0000 7f56febc4640 1 -- 172.21.15.79:0/1346728070 >> 172.21.15.79:0/1346728070 conn(0x7f56f80cfc80 msgr2=0x7f56f80cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:30.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.641+0000 7f56febc4640 1 -- 172.21.15.79:0/1346728070 shutdown_connections 2024-04-25T02:09:30.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.641+0000 7f56febc4640 1 -- 172.21.15.79:0/1346728070 wait complete. 2024-04-25T02:09:30.660 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-04-25T02:09:29.190645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":225292,"kb_used_data":4964,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749428,"statfs":{"total":773094113280,"available":772863414272,"internally_reserved":0,"allocated":5083136,"data_stored":2712029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000617"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690553+0000","last_change":"2024-04-25T02:09:25.690553+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690553+0000","last_undegraded":"2024-04-25T02:09:25.690553+0000","last_fullsized":"2024-04-25T02:09:25.690553+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.688663+0000","last_change":"2024-04-25T02:09:25.688663+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.688663+0000","last_undegraded":"2024-04-25T02:09:25.688663+0000","last_fullsized":"2024-04-25T02:09:25.688663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.683909+0000","last_change":"2024-04-25T02:09:25.683909+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.683909+0000","last_undegraded":"2024-04-25T02:09:25.683909+0000","last_fullsized":"2024-04-25T02:09:25.683909+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695504+0000","last_change":"2024-04-25T02:09:25.695504+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695504+0000","last_undegraded":"2024-04-25T02:09:25.695504+0000","last_fullsized":"2024-04-25T02:09:25.695504+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.691357+0000","last_change":"2024-04-25T02:09:25.691357+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.691357+0000","last_undegraded":"2024-04-25T02:09:25.691357+0000","last_fullsized":"2024-04-25T02:09:25.691357+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.688819+0000","last_change":"2024-04-25T02:09:25.688819+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.688819+0000","last_undegraded":"2024-04-25T02:09:25.688819+0000","last_fullsized":"2024-04-25T02:09:25.688819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.686966+0000","last_change":"2024-04-25T02:09:25.686966+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.686966+0000","last_undegraded":"2024-04-25T02:09:25.686966+0000","last_fullsized":"2024-04-25T02:09:25.686966+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.693563+0000","last_change":"2024-04-25T02:09:25.693563+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.693563+0000","last_undegraded":"2024-04-25T02:09:25.693563+0000","last_fullsized":"2024-04-25T02:09:25.693563+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.687941+0000","last_change":"2024-04-25T02:09:25.687941+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.687941+0000","last_undegraded":"2024-04-25T02:09:25.687941+0000","last_fullsized":"2024-04-25T02:09:25.687941+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.692848+0000","last_change":"2024-04-25T02:09:25.692848+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.692848+0000","last_undegraded":"2024-04-25T02:09:25.692848+0000","last_fullsized":"2024-04-25T02:09:25.692848+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.698235+0000","last_change":"2024-04-25T02:09:25.698235+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.698235+0000","last_undegraded":"2024-04-25T02:09:25.698235+0000","last_fullsized":"2024-04-25T02:09:25.698235+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.689952+0000","last_change":"2024-04-25T02:09:25.689952+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.689952+0000","last_undegraded":"2024-04-25T02:09:25.689952+0000","last_fullsized":"2024-04-25T02:09:25.689952+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690975+0000","last_change":"2024-04-25T02:09:25.690975+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690975+0000","last_undegraded":"2024-04-25T02:09:25.690975+0000","last_fullsized":"2024-04-25T02:09:25.690975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695513+0000","last_change":"2024-04-25T02:09:25.695513+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695513+0000","last_undegraded":"2024-04-25T02:09:25.695513+0000","last_fullsized":"2024-04-25T02:09:25.695513+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.689860+0000","last_change":"2024-04-25T02:09:25.689860+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.689860+0000","last_undegraded":"2024-04-25T02:09:25.689860+0000","last_fullsized":"2024-04-25T02:09:25.689860+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.693212+0000","last_change":"2024-04-25T02:09:25.693212+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.693212+0000","last_undegraded":"2024-04-25T02:09:25.693212+0000","last_fullsized":"2024-04-25T02:09:25.693212+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.689980+0000","last_change":"2024-04-25T02:09:25.689980+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.689980+0000","last_undegraded":"2024-04-25T02:09:25.689980+0000","last_fullsized":"2024-04-25T02:09:25.689980+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.687791+0000","last_change":"2024-04-25T02:09:25.687791+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.687791+0000","last_undegraded":"2024-04-25T02:09:25.687791+0000","last_fullsized":"2024-04-25T02:09:25.687791+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690003+0000","last_change":"2024-04-25T02:09:25.690003+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690003+0000","last_undegraded":"2024-04-25T02:09:25.690003+0000","last_fullsized":"2024-04-25T02:09:25.690003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690484+0000","last_change":"2024-04-25T02:09:25.690484+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690484+0000","last_undegraded":"2024-04-25T02:09:25.690484+0000","last_fullsized":"2024-04-25T02:09:25.690484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690475+0000","last_change":"2024-04-25T02:09:25.690475+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690475+0000","last_undegraded":"2024-04-25T02:09:25.690475+0000","last_fullsized":"2024-04-25T02:09:25.690475+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.686944+0000","last_change":"2024-04-25T02:09:25.686944+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.686944+0000","last_undegraded":"2024-04-25T02:09:25.686944+0000","last_fullsized":"2024-04-25T02:09:25.686944+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.692850+0000","last_change":"2024-04-25T02:09:25.692850+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.692850+0000","last_undegraded":"2024-04-25T02:09:25.692850+0000","last_fullsized":"2024-04-25T02:09:25.692850+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695432+0000","last_change":"2024-04-25T02:09:25.695432+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695432+0000","last_undegraded":"2024-04-25T02:09:25.695432+0000","last_fullsized":"2024-04-25T02:09:25.695432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690400+0000","last_change":"2024-04-25T02:09:25.690400+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690400+0000","last_undegraded":"2024-04-25T02:09:25.690400+0000","last_fullsized":"2024-04-25T02:09:25.690400+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695560+0000","last_change":"2024-04-25T02:09:25.695560+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695560+0000","last_undegraded":"2024-04-25T02:09:25.695560+0000","last_fullsized":"2024-04-25T02:09:25.695560+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.683889+0000","last_change":"2024-04-25T02:09:25.683889+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.683889+0000","last_undegraded":"2024-04-25T02:09:25.683889+0000","last_fullsized":"2024-04-25T02:09:25.683889+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695484+0000","last_change":"2024-04-25T02:09:25.695484+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695484+0000","last_undegraded":"2024-04-25T02:09:25.695484+0000","last_fullsized":"2024-04-25T02:09:25.695484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.687841+0000","last_change":"2024-04-25T02:09:25.687841+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.687841+0000","last_undegraded":"2024-04-25T02:09:25.687841+0000","last_fullsized":"2024-04-25T02:09:25.687841+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.683920+0000","last_change":"2024-04-25T02:09:25.683920+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.683920+0000","last_undegraded":"2024-04-25T02:09:25.683920+0000","last_fullsized":"2024-04-25T02:09:25.683920+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.692836+0000","last_change":"2024-04-25T02:09:25.692836+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.692836+0000","last_undegraded":"2024-04-25T02:09:25.692836+0000","last_fullsized":"2024-04-25T02:09:25.692836+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.686950+0000","last_change":"2024-04-25T02:09:25.686950+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.686950+0000","last_undegraded":"2024-04-25T02:09:25.686950+0000","last_fullsized":"2024-04-25T02:09:25.686950+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":207,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:09:25.698595+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:09:25.698595+0000","last_peered":"2024-04-25T02:09:25.698595+0000","last_clean":"2024-04-25T02:09:25.698595+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:09:25.698595+0000","last_undegraded":"2024-04-25T02:09:25.698595+0000","last_fullsized":"2024-04-25T02:09:25.698595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":778144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":187776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":778144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:09:30.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:09:30.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.788+0000 7ff4fbf53640 1 Processor -- start 2024-04-25T02:09:30.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.788+0000 7ff4fbf53640 1 -- start start 2024-04-25T02:09:30.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.789+0000 7ff4fbf53640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4f4144cb0 0x7ff4f40b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.789+0000 7ff4fbf53640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff4f40b5580 0x7ff4f406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.789+0000 7ff4fbf53640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4f4070d90 con 0x7ff4f406e490 2024-04-25T02:09:30.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.789+0000 7ff4fbf53640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff4f406e900 con 0x7ff4f40b5580 2024-04-25T02:09:30.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.789+0000 7ff4fbf53640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f40cf130 con 0x7ff4f4144cb0 2024-04-25T02:09:30.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.790+0000 7ff4f94ee640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff4f40b5580 0x7ff4f406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.790+0000 7ff4f9cef640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4f4144cb0 0x7ff4f40b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.790+0000 7ff4f94ee640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff4f40b5580 0x7ff4f406df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:47254/0 (socket says 172.21.15.79:47254) 2024-04-25T02:09:30.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.790+0000 7ff4f94ee640 1 -- 172.21.15.79:0/3139437635 learned_addr learned my addr 172.21.15.79:0/3139437635 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:30.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.790+0000 7ff4f94ee640 1 -- 172.21.15.79:0/3139437635 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4f4144cb0 msgr2=0x7ff4f40b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.790+0000 7ff4f94ee640 1 --2- 172.21.15.79:0/3139437635 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4f4144cb0 0x7ff4f40b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.790+0000 7ff4f94ee640 1 -- 172.21.15.79:0/3139437635 >> v1:172.21.15.189:6789/0 conn(0x7ff4f406e490 legacy=0x7ff4f415fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.790+0000 7ff4f94ee640 1 -- 172.21.15.79:0/3139437635 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f40cf410 con 0x7ff4f40b5580 2024-04-25T02:09:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.791+0000 7ff4f94ee640 1 --2- 172.21.15.79:0/3139437635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4f40b5580 0x7ff4f406df50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009870 tx=0x7ff4e402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a318475e91a0f39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.791+0000 7ff4f8ced640 1 -- 172.21.15.79:0/3139437635 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4037070 con 0x7ff4f40b5580 2024-04-25T02:09:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.791+0000 7ff4f8ced640 1 -- 172.21.15.79:0/3139437635 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e4032440 con 0x7ff4f40b5580 2024-04-25T02:09:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.791+0000 7ff4f8ced640 1 -- 172.21.15.79:0/3139437635 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4032810 con 0x7ff4f40b5580 2024-04-25T02:09:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.791+0000 7ff4fbf53640 1 -- 172.21.15.79:0/3139437635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4f40b5580 msgr2=0x7ff4f406df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.791+0000 7ff4fbf53640 1 --2- 172.21.15.79:0/3139437635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4f40b5580 0x7ff4f406df50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009870 tx=0x7ff4e402a130 comp rx=0 tx=0).stop 2024-04-25T02:09:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.791+0000 7ff4fbf53640 1 -- 172.21.15.79:0/3139437635 shutdown_connections 2024-04-25T02:09:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.791+0000 7ff4fbf53640 1 --2- 172.21.15.79:0/3139437635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4f40b5580 0x7ff4f406df50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.791+0000 7ff4fbf53640 1 --2- 172.21.15.79:0/3139437635 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4f4144cb0 0x7ff4f40b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.791+0000 7ff4fbf53640 1 -- 172.21.15.79:0/3139437635 >> 172.21.15.79:0/3139437635 conn(0x7ff4f40cfc80 msgr2=0x7ff4f40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.791+0000 7ff4fbf53640 1 -- 172.21.15.79:0/3139437635 shutdown_connections 2024-04-25T02:09:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.791+0000 7ff4fbf53640 1 -- 172.21.15.79:0/3139437635 wait complete. 2024-04-25T02:09:30.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.793+0000 7ff4fbf53640 1 Processor -- start 2024-04-25T02:09:30.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.793+0000 7ff4fbf53640 1 -- start start 2024-04-25T02:09:30.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.793+0000 7ff4fbf53640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4f406e490 0x7ff4f41581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.793+0000 7ff4fbf53640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4f40b5580 0x7ff4f415b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.793+0000 7ff4fbf53640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4f4144cb0 0x7ff4f413f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.793+0000 7ff4fbf53640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f4145090 con 0x7ff4f4144cb0 2024-04-25T02:09:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.793+0000 7ff4fbf53640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f40cf9d0 con 0x7ff4f406e490 2024-04-25T02:09:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.793+0000 7ff4fbf53640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f4145ab0 con 0x7ff4f40b5580 2024-04-25T02:09:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.793+0000 7ff4fa4f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4f4144cb0 0x7ff4f413f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.793+0000 7ff4fa4f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4f4144cb0 0x7ff4f413f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47666/0 (socket says 172.21.15.79:47666) 2024-04-25T02:09:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.793+0000 7ff4fa4f0640 1 -- 172.21.15.79:0/845527847 learned_addr learned my addr 172.21.15.79:0/845527847 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.794+0000 7ff4f94ee640 1 --2- 172.21.15.79:0/845527847 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4f40b5580 0x7ff4f415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.794+0000 7ff4f9cef640 1 --2- 172.21.15.79:0/845527847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4f406e490 0x7ff4f41581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.794+0000 7ff4fa4f0640 1 -- 172.21.15.79:0/845527847 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4f40b5580 msgr2=0x7ff4f415b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.794+0000 7ff4fa4f0640 1 --2- 172.21.15.79:0/845527847 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4f40b5580 0x7ff4f415b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.794+0000 7ff4fa4f0640 1 -- 172.21.15.79:0/845527847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4f406e490 msgr2=0x7ff4f41581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.794+0000 7ff4fa4f0640 1 --2- 172.21.15.79:0/845527847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4f406e490 0x7ff4f41581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.794+0000 7ff4fa4f0640 1 -- 172.21.15.79:0/845527847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f4158f60 con 0x7ff4f4144cb0 2024-04-25T02:09:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.794+0000 7ff4fa4f0640 1 --2- 172.21.15.79:0/845527847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4f4144cb0 0x7ff4f413f8d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00c390 tx=0x7ff4ec00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:30.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.794+0000 7ff4ea7fc640 1 -- 172.21.15.79:0/845527847 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec017070 con 0x7ff4f4144cb0 2024-04-25T02:09:30.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.794+0000 7ff4ea7fc640 1 -- 172.21.15.79:0/845527847 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ec0052d0 con 0x7ff4f4144cb0 2024-04-25T02:09:30.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.794+0000 7ff4ea7fc640 1 -- 172.21.15.79:0/845527847 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec003810 con 0x7ff4f4144cb0 2024-04-25T02:09:30.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.794+0000 7ff4fbf53640 1 -- 172.21.15.79:0/845527847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f41596f0 con 0x7ff4f4144cb0 2024-04-25T02:09:30.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.794+0000 7ff4fbf53640 1 -- 172.21.15.79:0/845527847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f4158c80 con 0x7ff4f4144cb0 2024-04-25T02:09:30.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.795+0000 7ff4fbf53640 1 -- 172.21.15.79:0/845527847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f40690a0 con 0x7ff4f4144cb0 2024-04-25T02:09:30.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.795+0000 7ff4ea7fc640 1 -- 172.21.15.79:0/845527847 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff4ec01a070 con 0x7ff4f4144cb0 2024-04-25T02:09:30.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.796+0000 7ff4ea7fc640 1 --2- 172.21.15.79:0/845527847 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff4d806be30 0x7ff4d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.796+0000 7ff4ea7fc640 1 -- 172.21.15.79:0/845527847 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ff4ec08a170 con 0x7ff4f4144cb0 2024-04-25T02:09:30.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.796+0000 7ff4f9cef640 1 --2- 172.21.15.79:0/845527847 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff4d806be30 0x7ff4d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.796+0000 7ff4f9cef640 1 --2- 172.21.15.79:0/845527847 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff4d806be30 0x7ff4d806e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009fd0 tx=0x7ff4f000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:30.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.801+0000 7ff4ea7fc640 1 -- 172.21.15.79:0/845527847 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff4ec058b20 con 0x7ff4f4144cb0 2024-04-25T02:09:30.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.970+0000 7ff4fbf53640 1 -- 172.21.15.79:0/845527847 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4f40d0b90 con 0x7ff4d806be30 2024-04-25T02:09:30.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.975+0000 7ff4ea7fc640 1 -- 172.21.15.79:0/845527847 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239831 (secure 0 0 0) 0x7ff4f40d0b90 con 0x7ff4d806be30 2024-04-25T02:09:30.986 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:30.987 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:09:30.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.979+0000 7ff4fbf53640 1 -- 172.21.15.79:0/845527847 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff4d806be30 msgr2=0x7ff4d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.979+0000 7ff4fbf53640 1 --2- 172.21.15.79:0/845527847 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff4d806be30 0x7ff4d806e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009fd0 tx=0x7ff4f000b040 comp rx=0 tx=0).stop 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.979+0000 7ff4fbf53640 1 -- 172.21.15.79:0/845527847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4f4144cb0 msgr2=0x7ff4f413f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.979+0000 7ff4fbf53640 1 --2- 172.21.15.79:0/845527847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4f4144cb0 0x7ff4f413f8d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00c390 tx=0x7ff4ec00c850 comp rx=0 tx=0).stop 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.979+0000 7ff4fbf53640 1 -- 172.21.15.79:0/845527847 shutdown_connections 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.979+0000 7ff4fbf53640 1 --2- 172.21.15.79:0/845527847 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff4d806be30 0x7ff4d806e2f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.979+0000 7ff4fbf53640 1 --2- 172.21.15.79:0/845527847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4f4144cb0 0x7ff4f413f8d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.979+0000 7ff4fbf53640 1 --2- 172.21.15.79:0/845527847 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4f40b5580 0x7ff4f415b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.979+0000 7ff4fbf53640 1 --2- 172.21.15.79:0/845527847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4f406e490 0x7ff4f41581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.979+0000 7ff4fbf53640 1 -- 172.21.15.79:0/845527847 >> 172.21.15.79:0/845527847 conn(0x7ff4f40cfc80 msgr2=0x7ff4f4072250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.979+0000 7ff4fbf53640 1 -- 172.21.15.79:0/845527847 shutdown_connections 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:30.979+0000 7ff4fbf53640 1 -- 172.21.15.79:0/845527847 wait complete. 2024-04-25T02:09:30.997 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-04-25T02:09:29.190645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":225292,"kb_used_data":4964,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749428,"statfs":{"total":773094113280,"available":772863414272,"internally_reserved":0,"allocated":5083136,"data_stored":2712029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000617"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690553+0000","last_change":"2024-04-25T02:09:25.690553+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690553+0000","last_undegraded":"2024-04-25T02:09:25.690553+0000","last_fullsized":"2024-04-25T02:09:25.690553+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.688663+0000","last_change":"2024-04-25T02:09:25.688663+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.688663+0000","last_undegraded":"2024-04-25T02:09:25.688663+0000","last_fullsized":"2024-04-25T02:09:25.688663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.683909+0000","last_change":"2024-04-25T02:09:25.683909+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.683909+0000","last_undegraded":"2024-04-25T02:09:25.683909+0000","last_fullsized":"2024-04-25T02:09:25.683909+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695504+0000","last_change":"2024-04-25T02:09:25.695504+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695504+0000","last_undegraded":"2024-04-25T02:09:25.695504+0000","last_fullsized":"2024-04-25T02:09:25.695504+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.691357+0000","last_change":"2024-04-25T02:09:25.691357+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.691357+0000","last_undegraded":"2024-04-25T02:09:25.691357+0000","last_fullsized":"2024-04-25T02:09:25.691357+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.688819+0000","last_change":"2024-04-25T02:09:25.688819+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.688819+0000","last_undegraded":"2024-04-25T02:09:25.688819+0000","last_fullsized":"2024-04-25T02:09:25.688819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.686966+0000","last_change":"2024-04-25T02:09:25.686966+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.686966+0000","last_undegraded":"2024-04-25T02:09:25.686966+0000","last_fullsized":"2024-04-25T02:09:25.686966+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.693563+0000","last_change":"2024-04-25T02:09:25.693563+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.693563+0000","last_undegraded":"2024-04-25T02:09:25.693563+0000","last_fullsized":"2024-04-25T02:09:25.693563+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.687941+0000","last_change":"2024-04-25T02:09:25.687941+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.687941+0000","last_undegraded":"2024-04-25T02:09:25.687941+0000","last_fullsized":"2024-04-25T02:09:25.687941+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.692848+0000","last_change":"2024-04-25T02:09:25.692848+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.692848+0000","last_undegraded":"2024-04-25T02:09:25.692848+0000","last_fullsized":"2024-04-25T02:09:25.692848+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.698235+0000","last_change":"2024-04-25T02:09:25.698235+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.698235+0000","last_undegraded":"2024-04-25T02:09:25.698235+0000","last_fullsized":"2024-04-25T02:09:25.698235+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.689952+0000","last_change":"2024-04-25T02:09:25.689952+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.689952+0000","last_undegraded":"2024-04-25T02:09:25.689952+0000","last_fullsized":"2024-04-25T02:09:25.689952+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690975+0000","last_change":"2024-04-25T02:09:25.690975+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690975+0000","last_undegraded":"2024-04-25T02:09:25.690975+0000","last_fullsized":"2024-04-25T02:09:25.690975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695513+0000","last_change":"2024-04-25T02:09:25.695513+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695513+0000","last_undegraded":"2024-04-25T02:09:25.695513+0000","last_fullsized":"2024-04-25T02:09:25.695513+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.689860+0000","last_change":"2024-04-25T02:09:25.689860+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.689860+0000","last_undegraded":"2024-04-25T02:09:25.689860+0000","last_fullsized":"2024-04-25T02:09:25.689860+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.693212+0000","last_change":"2024-04-25T02:09:25.693212+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.693212+0000","last_undegraded":"2024-04-25T02:09:25.693212+0000","last_fullsized":"2024-04-25T02:09:25.693212+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.689980+0000","last_change":"2024-04-25T02:09:25.689980+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.689980+0000","last_undegraded":"2024-04-25T02:09:25.689980+0000","last_fullsized":"2024-04-25T02:09:25.689980+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.687791+0000","last_change":"2024-04-25T02:09:25.687791+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.687791+0000","last_undegraded":"2024-04-25T02:09:25.687791+0000","last_fullsized":"2024-04-25T02:09:25.687791+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690003+0000","last_change":"2024-04-25T02:09:25.690003+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690003+0000","last_undegraded":"2024-04-25T02:09:25.690003+0000","last_fullsized":"2024-04-25T02:09:25.690003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690484+0000","last_change":"2024-04-25T02:09:25.690484+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690484+0000","last_undegraded":"2024-04-25T02:09:25.690484+0000","last_fullsized":"2024-04-25T02:09:25.690484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690475+0000","last_change":"2024-04-25T02:09:25.690475+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690475+0000","last_undegraded":"2024-04-25T02:09:25.690475+0000","last_fullsized":"2024-04-25T02:09:25.690475+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.686944+0000","last_change":"2024-04-25T02:09:25.686944+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.686944+0000","last_undegraded":"2024-04-25T02:09:25.686944+0000","last_fullsized":"2024-04-25T02:09:25.686944+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.692850+0000","last_change":"2024-04-25T02:09:25.692850+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.692850+0000","last_undegraded":"2024-04-25T02:09:25.692850+0000","last_fullsized":"2024-04-25T02:09:25.692850+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695432+0000","last_change":"2024-04-25T02:09:25.695432+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695432+0000","last_undegraded":"2024-04-25T02:09:25.695432+0000","last_fullsized":"2024-04-25T02:09:25.695432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690400+0000","last_change":"2024-04-25T02:09:25.690400+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690400+0000","last_undegraded":"2024-04-25T02:09:25.690400+0000","last_fullsized":"2024-04-25T02:09:25.690400+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695560+0000","last_change":"2024-04-25T02:09:25.695560+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695560+0000","last_undegraded":"2024-04-25T02:09:25.695560+0000","last_fullsized":"2024-04-25T02:09:25.695560+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.683889+0000","last_change":"2024-04-25T02:09:25.683889+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.683889+0000","last_undegraded":"2024-04-25T02:09:25.683889+0000","last_fullsized":"2024-04-25T02:09:25.683889+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695484+0000","last_change":"2024-04-25T02:09:25.695484+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695484+0000","last_undegraded":"2024-04-25T02:09:25.695484+0000","last_fullsized":"2024-04-25T02:09:25.695484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.687841+0000","last_change":"2024-04-25T02:09:25.687841+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.687841+0000","last_undegraded":"2024-04-25T02:09:25.687841+0000","last_fullsized":"2024-04-25T02:09:25.687841+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.683920+0000","last_change":"2024-04-25T02:09:25.683920+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.683920+0000","last_undegraded":"2024-04-25T02:09:25.683920+0000","last_fullsized":"2024-04-25T02:09:25.683920+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.692836+0000","last_change":"2024-04-25T02:09:25.692836+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.692836+0000","last_undegraded":"2024-04-25T02:09:25.692836+0000","last_fullsized":"2024-04-25T02:09:25.692836+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.686950+0000","last_change":"2024-04-25T02:09:25.686950+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.686950+0000","last_undegraded":"2024-04-25T02:09:25.686950+0000","last_fullsized":"2024-04-25T02:09:25.686950+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":207,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:09:25.698595+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:09:25.698595+0000","last_peered":"2024-04-25T02:09:25.698595+0000","last_clean":"2024-04-25T02:09:25.698595+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:09:25.698595+0000","last_undegraded":"2024-04-25T02:09:25.698595+0000","last_fullsized":"2024-04-25T02:09:25.698595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":778144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":187776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":778144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:09:31.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:09:31.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.126+0000 7f53fce7b640 1 Processor -- start 2024-04-25T02:09:31.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.126+0000 7f53fce7b640 1 -- start start 2024-04-25T02:09:31.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53fce7b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53f806df50 0x7f53f806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53fce7b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f8071e00 con 0x7f53f8143bc0 2024-04-25T02:09:31.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53fce7b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f80720a0 con 0x7f53f80b2d30 2024-04-25T02:09:31.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53fce7b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f53f806e8f0 con 0x7f53f806df50 2024-04-25T02:09:31.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f659c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f53f8143bc0 0x7f53f815f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46062/0 (socket says 172.21.15.79:46062) 2024-04-25T02:09:31.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f659c640 1 -- 172.21.15.79:0/3298358183 learned_addr learned my addr 172.21.15.79:0/3298358183 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:31.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f559a640 1 -- 172.21.15.79:0/3298358183 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3334556794 0 0) 0x7f53f8071e00 con 0x7f53f8143bc0 2024-04-25T02:09:31.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f559a640 1 -- 172.21.15.79:0/3298358183 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53e0003520 con 0x7f53f8143bc0 2024-04-25T02:09:31.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f5d9b640 1 --2- 172.21.15.79:0/3298358183 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53f806df50 0x7f53f806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f559a640 1 -- 172.21.15.79:0/3298358183 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2754977920 0 0) 0x7f53e0003520 con 0x7f53f8143bc0 2024-04-25T02:09:31.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f559a640 1 -- 172.21.15.79:0/3298358183 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53f806df50 msgr2=0x7f53f806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f559a640 1 --2- 172.21.15.79:0/3298358183 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53f806df50 0x7f53f806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f559a640 1 -- 172.21.15.79:0/3298358183 >> v1:172.21.15.189:6789/0 conn(0x7f53f80b2d30 legacy=0x7f53f80b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f559a640 1 -- 172.21.15.79:0/3298358183 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f8072380 con 0x7f53f8143bc0 2024-04-25T02:09:31.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f559a640 1 -- 172.21.15.79:0/3298358183 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f53ec001670 con 0x7f53f8143bc0 2024-04-25T02:09:31.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f559a640 1 -- 172.21.15.79:0/3298358183 >> v1:172.21.15.79:6789/0 conn(0x7f53f8143bc0 legacy=0x7f53f815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f559a640 1 --2- 172.21.15.79:0/3298358183 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53f806df50 0x7f53e00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f559a640 1 --2- 172.21.15.79:0/3298358183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e0003f20 0x7f53e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f559a640 1 --2- 172.21.15.79:0/3298358183 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53e0004d40 0x7f53e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f559a640 1 -- 172.21.15.79:0/3298358183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f53e000bad0 con 0x7f53e0003f20 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f559a640 1 -- 172.21.15.79:0/3298358183 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53e000bc80 con 0x7f53e0004d40 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f559a640 1 -- 172.21.15.79:0/3298358183 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f53e000be80 con 0x7f53f806df50 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.127+0000 7f53f5d9b640 1 --2- 172.21.15.79:0/3298358183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e0003f20 0x7f53e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.128+0000 7f53f659c640 1 --2- 172.21.15.79:0/3298358183 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53f806df50 0x7f53e00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.128+0000 7f53f6d9d640 1 --2- 172.21.15.79:0/3298358183 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53e0004d40 0x7f53e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.128+0000 7f53f5d9b640 1 -- 172.21.15.79:0/3298358183 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53f806df50 msgr2=0x7f53e00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.128+0000 7f53f5d9b640 1 --2- 172.21.15.79:0/3298358183 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53f806df50 0x7f53e00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.128+0000 7f53f5d9b640 1 -- 172.21.15.79:0/3298358183 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53e0004d40 msgr2=0x7f53e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.128+0000 7f53f5d9b640 1 --2- 172.21.15.79:0/3298358183 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53e0004d40 0x7f53e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.128+0000 7f53f5d9b640 1 -- 172.21.15.79:0/3298358183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e0003520 con 0x7f53e0003f20 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.128+0000 7f53f659c640 1 --2- 172.21.15.79:0/3298358183 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53f806df50 0x7f53e00039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.128+0000 7f53f5d9b640 1 --2- 172.21.15.79:0/3298358183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e0003f20 0x7f53e0004800 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009ac0 tx=0x7f53e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e148673eabc68cc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.128+0000 7f53f559a640 1 -- 172.21.15.79:0/3298358183 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8036070 con 0x7f53e0003f20 2024-04-25T02:09:31.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.128+0000 7f53f559a640 1 -- 172.21.15.79:0/3298358183 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e8031400 con 0x7f53e0003f20 2024-04-25T02:09:31.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.128+0000 7f53f559a640 1 -- 172.21.15.79:0/3298358183 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8009690 con 0x7f53e0003f20 2024-04-25T02:09:31.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.129+0000 7f53fce7b640 1 -- 172.21.15.79:0/3298358183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e0003f20 msgr2=0x7f53e0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.129+0000 7f53fce7b640 1 --2- 172.21.15.79:0/3298358183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e0003f20 0x7f53e0004800 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009ac0 tx=0x7f53e0005830 comp rx=0 tx=0).stop 2024-04-25T02:09:31.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.129+0000 7f53f6d9d640 1 -- 172.21.15.79:0/3298358183 reap_dead start 2024-04-25T02:09:31.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.129+0000 7f53fce7b640 1 -- 172.21.15.79:0/3298358183 shutdown_connections 2024-04-25T02:09:31.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.129+0000 7f53fce7b640 1 -- 172.21.15.79:0/3298358183 >> 172.21.15.79:0/3298358183 conn(0x7f53f80cfc80 msgr2=0x7f53f80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.129+0000 7f53fce7b640 1 -- 172.21.15.79:0/3298358183 shutdown_connections 2024-04-25T02:09:31.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.129+0000 7f53fce7b640 1 -- 172.21.15.79:0/3298358183 wait complete. 2024-04-25T02:09:31.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.130+0000 7f53fce7b640 1 Processor -- start 2024-04-25T02:09:31.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.130+0000 7f53fce7b640 1 -- start start 2024-04-25T02:09:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.131+0000 7f53fce7b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53e0003f20 0x7f53f8135440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.131+0000 7f53fce7b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53f8142990 0x7f53f8142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.131+0000 7f53fce7b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53f80cea80 0x7f53f80cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.131+0000 7f53fce7b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f53f8072940 con 0x7f53f8142990 2024-04-25T02:09:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.131+0000 7f53fce7b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53f8072cb0 con 0x7f53f80cea80 2024-04-25T02:09:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.131+0000 7f53fce7b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f53f8143fa0 con 0x7f53e0003f20 2024-04-25T02:09:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.131+0000 7f53f5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53f8142990 0x7f53f8142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.131+0000 7f53f5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53f8142990 0x7f53f8142df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47686/0 (socket says 172.21.15.79:47686) 2024-04-25T02:09:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.131+0000 7f53f5d9b640 1 -- 172.21.15.79:0/2472774932 learned_addr learned my addr 172.21.15.79:0/2472774932 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.131+0000 7f53f5d9b640 1 -- 172.21.15.79:0/2472774932 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53e0003f20 msgr2=0x7f53f8135440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.131+0000 7f53f5d9b640 1 --2- 172.21.15.79:0/2472774932 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53e0003f20 0x7f53f8135440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.131+0000 7f53f5d9b640 1 -- 172.21.15.79:0/2472774932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53f80cea80 msgr2=0x7f53f80cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.131+0000 7f53f5d9b640 1 --2- 172.21.15.79:0/2472774932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53f80cea80 0x7f53f80cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.131+0000 7f53f5d9b640 1 -- 172.21.15.79:0/2472774932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f8140d10 con 0x7f53f8142990 2024-04-25T02:09:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.132+0000 7f53f5d9b640 1 --2- 172.21.15.79:0/2472774932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53f8142990 0x7f53f8142df0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f53e8034040 tx=0x7f53e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.132+0000 7f53e6ffd640 1 -- 172.21.15.79:0/2472774932 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8040020 con 0x7f53f8142990 2024-04-25T02:09:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.132+0000 7f53e6ffd640 1 -- 172.21.15.79:0/2472774932 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e8003be0 con 0x7f53f8142990 2024-04-25T02:09:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.132+0000 7f53fce7b640 1 -- 172.21.15.79:0/2472774932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f8140ff0 con 0x7f53f8142990 2024-04-25T02:09:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.132+0000 7f53e6ffd640 1 -- 172.21.15.79:0/2472774932 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8036040 con 0x7f53f8142990 2024-04-25T02:09:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.132+0000 7f53fce7b640 1 -- 172.21.15.79:0/2472774932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f81415b0 con 0x7f53f8142990 2024-04-25T02:09:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.133+0000 7f53fce7b640 1 -- 172.21.15.79:0/2472774932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f80690a0 con 0x7f53f8142990 2024-04-25T02:09:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.133+0000 7f53e6ffd640 1 -- 172.21.15.79:0/2472774932 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53e8043020 con 0x7f53f8142990 2024-04-25T02:09:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.134+0000 7f53e6ffd640 1 --2- 172.21.15.79:0/2472774932 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53d806be30 0x7f53d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.134+0000 7f53e6ffd640 1 -- 172.21.15.79:0/2472774932 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f53e80aaf50 con 0x7f53f8142990 2024-04-25T02:09:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.134+0000 7f53f659c640 1 --2- 172.21.15.79:0/2472774932 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53d806be30 0x7f53d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.134+0000 7f53f659c640 1 --2- 172.21.15.79:0/2472774932 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53d806be30 0x7f53d806e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f53ec001eb0 tx=0x7f53ec001ab0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.138+0000 7f53e6ffd640 1 -- 172.21.15.79:0/2472774932 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f53e804a070 con 0x7f53f8142990 2024-04-25T02:09:31.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.310+0000 7f53fce7b640 1 -- 172.21.15.79:0/2472774932 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53f80b34d0 con 0x7f53d806be30 2024-04-25T02:09:31.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.315+0000 7f53e6ffd640 1 -- 172.21.15.79:0/2472774932 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239831 (secure 0 0 0) 0x7f53f80b34d0 con 0x7f53d806be30 2024-04-25T02:09:31.325 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:31.326 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:09:31.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.318+0000 7f53fce7b640 1 -- 172.21.15.79:0/2472774932 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53d806be30 msgr2=0x7f53d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.318+0000 7f53fce7b640 1 --2- 172.21.15.79:0/2472774932 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53d806be30 0x7f53d806e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f53ec001eb0 tx=0x7f53ec001ab0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.318+0000 7f53fce7b640 1 -- 172.21.15.79:0/2472774932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53f8142990 msgr2=0x7f53f8142df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.318+0000 7f53fce7b640 1 --2- 172.21.15.79:0/2472774932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53f8142990 0x7f53f8142df0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f53e8034040 tx=0x7f53e8004730 comp rx=0 tx=0).stop 2024-04-25T02:09:31.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.318+0000 7f53fce7b640 1 -- 172.21.15.79:0/2472774932 shutdown_connections 2024-04-25T02:09:31.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.318+0000 7f53fce7b640 1 --2- 172.21.15.79:0/2472774932 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53d806be30 0x7f53d806e2f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.318+0000 7f53fce7b640 1 --2- 172.21.15.79:0/2472774932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53f80cea80 0x7f53f80cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.318+0000 7f53fce7b640 1 --2- 172.21.15.79:0/2472774932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53f8142990 0x7f53f8142df0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.318+0000 7f53fce7b640 1 --2- 172.21.15.79:0/2472774932 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53e0003f20 0x7f53f8135440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.318+0000 7f53fce7b640 1 -- 172.21.15.79:0/2472774932 >> 172.21.15.79:0/2472774932 conn(0x7f53f80cfc80 msgr2=0x7f53f80afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.319+0000 7f53fce7b640 1 -- 172.21.15.79:0/2472774932 shutdown_connections 2024-04-25T02:09:31.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.319+0000 7f53fce7b640 1 -- 172.21.15.79:0/2472774932 wait complete. 2024-04-25T02:09:31.337 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-04-25T02:09:31.191145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":225292,"kb_used_data":4964,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749428,"statfs":{"total":773094113280,"available":772863414272,"internally_reserved":0,"allocated":5083136,"data_stored":2712029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.510062"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690553+0000","last_change":"2024-04-25T02:09:25.690553+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690553+0000","last_undegraded":"2024-04-25T02:09:25.690553+0000","last_fullsized":"2024-04-25T02:09:25.690553+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.688663+0000","last_change":"2024-04-25T02:09:25.688663+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.688663+0000","last_undegraded":"2024-04-25T02:09:25.688663+0000","last_fullsized":"2024-04-25T02:09:25.688663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.683909+0000","last_change":"2024-04-25T02:09:25.683909+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.683909+0000","last_undegraded":"2024-04-25T02:09:25.683909+0000","last_fullsized":"2024-04-25T02:09:25.683909+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695504+0000","last_change":"2024-04-25T02:09:25.695504+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695504+0000","last_undegraded":"2024-04-25T02:09:25.695504+0000","last_fullsized":"2024-04-25T02:09:25.695504+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.691357+0000","last_change":"2024-04-25T02:09:25.691357+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.691357+0000","last_undegraded":"2024-04-25T02:09:25.691357+0000","last_fullsized":"2024-04-25T02:09:25.691357+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.688819+0000","last_change":"2024-04-25T02:09:25.688819+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.688819+0000","last_undegraded":"2024-04-25T02:09:25.688819+0000","last_fullsized":"2024-04-25T02:09:25.688819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.686966+0000","last_change":"2024-04-25T02:09:25.686966+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.686966+0000","last_undegraded":"2024-04-25T02:09:25.686966+0000","last_fullsized":"2024-04-25T02:09:25.686966+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.693563+0000","last_change":"2024-04-25T02:09:25.693563+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.693563+0000","last_undegraded":"2024-04-25T02:09:25.693563+0000","last_fullsized":"2024-04-25T02:09:25.693563+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.687941+0000","last_change":"2024-04-25T02:09:25.687941+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.687941+0000","last_undegraded":"2024-04-25T02:09:25.687941+0000","last_fullsized":"2024-04-25T02:09:25.687941+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.692848+0000","last_change":"2024-04-25T02:09:25.692848+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.692848+0000","last_undegraded":"2024-04-25T02:09:25.692848+0000","last_fullsized":"2024-04-25T02:09:25.692848+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.698235+0000","last_change":"2024-04-25T02:09:25.698235+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.698235+0000","last_undegraded":"2024-04-25T02:09:25.698235+0000","last_fullsized":"2024-04-25T02:09:25.698235+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.689952+0000","last_change":"2024-04-25T02:09:25.689952+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.689952+0000","last_undegraded":"2024-04-25T02:09:25.689952+0000","last_fullsized":"2024-04-25T02:09:25.689952+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690975+0000","last_change":"2024-04-25T02:09:25.690975+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690975+0000","last_undegraded":"2024-04-25T02:09:25.690975+0000","last_fullsized":"2024-04-25T02:09:25.690975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695513+0000","last_change":"2024-04-25T02:09:25.695513+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695513+0000","last_undegraded":"2024-04-25T02:09:25.695513+0000","last_fullsized":"2024-04-25T02:09:25.695513+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.689860+0000","last_change":"2024-04-25T02:09:25.689860+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.689860+0000","last_undegraded":"2024-04-25T02:09:25.689860+0000","last_fullsized":"2024-04-25T02:09:25.689860+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.693212+0000","last_change":"2024-04-25T02:09:25.693212+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.693212+0000","last_undegraded":"2024-04-25T02:09:25.693212+0000","last_fullsized":"2024-04-25T02:09:25.693212+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.689980+0000","last_change":"2024-04-25T02:09:25.689980+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.689980+0000","last_undegraded":"2024-04-25T02:09:25.689980+0000","last_fullsized":"2024-04-25T02:09:25.689980+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.687791+0000","last_change":"2024-04-25T02:09:25.687791+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.687791+0000","last_undegraded":"2024-04-25T02:09:25.687791+0000","last_fullsized":"2024-04-25T02:09:25.687791+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690003+0000","last_change":"2024-04-25T02:09:25.690003+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690003+0000","last_undegraded":"2024-04-25T02:09:25.690003+0000","last_fullsized":"2024-04-25T02:09:25.690003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690484+0000","last_change":"2024-04-25T02:09:25.690484+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690484+0000","last_undegraded":"2024-04-25T02:09:25.690484+0000","last_fullsized":"2024-04-25T02:09:25.690484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690475+0000","last_change":"2024-04-25T02:09:25.690475+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690475+0000","last_undegraded":"2024-04-25T02:09:25.690475+0000","last_fullsized":"2024-04-25T02:09:25.690475+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.686944+0000","last_change":"2024-04-25T02:09:25.686944+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.686944+0000","last_undegraded":"2024-04-25T02:09:25.686944+0000","last_fullsized":"2024-04-25T02:09:25.686944+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.692850+0000","last_change":"2024-04-25T02:09:25.692850+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.692850+0000","last_undegraded":"2024-04-25T02:09:25.692850+0000","last_fullsized":"2024-04-25T02:09:25.692850+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695432+0000","last_change":"2024-04-25T02:09:25.695432+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695432+0000","last_undegraded":"2024-04-25T02:09:25.695432+0000","last_fullsized":"2024-04-25T02:09:25.695432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690400+0000","last_change":"2024-04-25T02:09:25.690400+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690400+0000","last_undegraded":"2024-04-25T02:09:25.690400+0000","last_fullsized":"2024-04-25T02:09:25.690400+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695560+0000","last_change":"2024-04-25T02:09:25.695560+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695560+0000","last_undegraded":"2024-04-25T02:09:25.695560+0000","last_fullsized":"2024-04-25T02:09:25.695560+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.683889+0000","last_change":"2024-04-25T02:09:25.683889+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.683889+0000","last_undegraded":"2024-04-25T02:09:25.683889+0000","last_fullsized":"2024-04-25T02:09:25.683889+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695484+0000","last_change":"2024-04-25T02:09:25.695484+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695484+0000","last_undegraded":"2024-04-25T02:09:25.695484+0000","last_fullsized":"2024-04-25T02:09:25.695484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.687841+0000","last_change":"2024-04-25T02:09:25.687841+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.687841+0000","last_undegraded":"2024-04-25T02:09:25.687841+0000","last_fullsized":"2024-04-25T02:09:25.687841+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.683920+0000","last_change":"2024-04-25T02:09:25.683920+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.683920+0000","last_undegraded":"2024-04-25T02:09:25.683920+0000","last_fullsized":"2024-04-25T02:09:25.683920+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.692836+0000","last_change":"2024-04-25T02:09:25.692836+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.692836+0000","last_undegraded":"2024-04-25T02:09:25.692836+0000","last_fullsized":"2024-04-25T02:09:25.692836+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.686950+0000","last_change":"2024-04-25T02:09:25.686950+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.686950+0000","last_undegraded":"2024-04-25T02:09:25.686950+0000","last_fullsized":"2024-04-25T02:09:25.686950+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":207,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:09:25.698595+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:09:25.698595+0000","last_peered":"2024-04-25T02:09:25.698595+0000","last_clean":"2024-04-25T02:09:25.698595+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:09:25.698595+0000","last_undegraded":"2024-04-25T02:09:25.698595+0000","last_fullsized":"2024-04-25T02:09:25.698595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":778144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":187776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":778144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:09:31.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2024-04-25T02:09:31.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2024-04-25T02:09:31.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2024-04-25T02:09:31.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2024-04-25T02:09:31.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2024-04-25T02:09:31.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2024-04-25T02:09:31.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2024-04-25T02:09:31.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2024-04-25T02:09:31.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2024-04-25T02:09:31.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2024-04-25T02:09:31.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2024-04-25T02:09:31.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2024-04-25T02:09:31.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2024-04-25T02:09:31.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2024-04-25T02:09:31.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2024-04-25T02:09:31.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2024-04-25T02:09:31.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2024-04-25T02:09:31.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2024-04-25T02:09:31.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2024-04-25T02:09:31.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2024-04-25T02:09:31.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2024-04-25T02:09:31.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2024-04-25T02:09:31.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2024-04-25T02:09:31.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2024-04-25T02:09:31.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2024-04-25T02:09:31.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2024-04-25T02:09:31.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2024-04-25T02:09:31.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2024-04-25T02:09:31.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2024-04-25T02:09:31.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2024-04-25T02:09:31.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2024-04-25T02:09:31.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2024-04-25T02:09:31.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-04-25T02:09:31.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-04-25T02:09:31.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.690553+0000', 'last_change': '2024-04-25T02:09:25.690553+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.690553+0000', 'last_undegraded': '2024-04-25T02:09:25.690553+0000', 'last_fullsized': '2024-04-25T02:09:25.690553+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:09:31.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-04-25T02:09:31.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-04-25T02:09:31.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.688663+0000', 'last_change': '2024-04-25T02:09:25.688663+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.688663+0000', 'last_undegraded': '2024-04-25T02:09:25.688663+0000', 'last_fullsized': '2024-04-25T02:09:25.688663+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:09:31.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2024-04-25T02:09:31.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-04-25T02:09:31.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.683909+0000', 'last_change': '2024-04-25T02:09:25.683909+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.683909+0000', 'last_undegraded': '2024-04-25T02:09:25.683909+0000', 'last_fullsized': '2024-04-25T02:09:25.683909+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:09:31.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-04-25T02:09:31.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-04-25T02:09:31.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.695504+0000', 'last_change': '2024-04-25T02:09:25.695504+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.695504+0000', 'last_undegraded': '2024-04-25T02:09:25.695504+0000', 'last_fullsized': '2024-04-25T02:09:25.695504+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:09:31.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2024-04-25T02:09:31.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-04-25T02:09:31.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.691357+0000', 'last_change': '2024-04-25T02:09:25.691357+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.691357+0000', 'last_undegraded': '2024-04-25T02:09:25.691357+0000', 'last_fullsized': '2024-04-25T02:09:25.691357+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:09:31.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2024-04-25T02:09:31.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-04-25T02:09:31.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.688819+0000', 'last_change': '2024-04-25T02:09:25.688819+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.688819+0000', 'last_undegraded': '2024-04-25T02:09:25.688819+0000', 'last_fullsized': '2024-04-25T02:09:25.688819+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:09:31.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2024-04-25T02:09:31.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-04-25T02:09:31.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.686966+0000', 'last_change': '2024-04-25T02:09:25.686966+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.686966+0000', 'last_undegraded': '2024-04-25T02:09:25.686966+0000', 'last_fullsized': '2024-04-25T02:09:25.686966+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:09:31.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-04-25T02:09:31.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-04-25T02:09:31.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.693563+0000', 'last_change': '2024-04-25T02:09:25.693563+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.693563+0000', 'last_undegraded': '2024-04-25T02:09:25.693563+0000', 'last_fullsized': '2024-04-25T02:09:25.693563+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:09:31.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2024-04-25T02:09:31.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-04-25T02:09:31.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.687941+0000', 'last_change': '2024-04-25T02:09:25.687941+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.687941+0000', 'last_undegraded': '2024-04-25T02:09:25.687941+0000', 'last_fullsized': '2024-04-25T02:09:25.687941+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:09:31.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2024-04-25T02:09:31.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-04-25T02:09:31.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.692848+0000', 'last_change': '2024-04-25T02:09:25.692848+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.692848+0000', 'last_undegraded': '2024-04-25T02:09:25.692848+0000', 'last_fullsized': '2024-04-25T02:09:25.692848+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:09:31.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2024-04-25T02:09:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-04-25T02:09:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.698235+0000', 'last_change': '2024-04-25T02:09:25.698235+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.698235+0000', 'last_undegraded': '2024-04-25T02:09:25.698235+0000', 'last_fullsized': '2024-04-25T02:09:25.698235+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:09:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2024-04-25T02:09:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-04-25T02:09:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.689952+0000', 'last_change': '2024-04-25T02:09:25.689952+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.689952+0000', 'last_undegraded': '2024-04-25T02:09:25.689952+0000', 'last_fullsized': '2024-04-25T02:09:25.689952+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:09:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-04-25T02:09:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-04-25T02:09:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.690975+0000', 'last_change': '2024-04-25T02:09:25.690975+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.690975+0000', 'last_undegraded': '2024-04-25T02:09:25.690975+0000', 'last_fullsized': '2024-04-25T02:09:25.690975+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:09:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2024-04-25T02:09:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-04-25T02:09:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.695513+0000', 'last_change': '2024-04-25T02:09:25.695513+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.695513+0000', 'last_undegraded': '2024-04-25T02:09:25.695513+0000', 'last_fullsized': '2024-04-25T02:09:25.695513+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:09:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2024-04-25T02:09:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-04-25T02:09:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.689860+0000', 'last_change': '2024-04-25T02:09:25.689860+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.689860+0000', 'last_undegraded': '2024-04-25T02:09:25.689860+0000', 'last_fullsized': '2024-04-25T02:09:25.689860+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:09:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2024-04-25T02:09:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-04-25T02:09:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.693212+0000', 'last_change': '2024-04-25T02:09:25.693212+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.693212+0000', 'last_undegraded': '2024-04-25T02:09:25.693212+0000', 'last_fullsized': '2024-04-25T02:09:25.693212+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:09:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2024-04-25T02:09:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-04-25T02:09:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.689980+0000', 'last_change': '2024-04-25T02:09:25.689980+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.689980+0000', 'last_undegraded': '2024-04-25T02:09:25.689980+0000', 'last_fullsized': '2024-04-25T02:09:25.689980+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:09:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2024-04-25T02:09:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-04-25T02:09:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.687791+0000', 'last_change': '2024-04-25T02:09:25.687791+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.687791+0000', 'last_undegraded': '2024-04-25T02:09:25.687791+0000', 'last_fullsized': '2024-04-25T02:09:25.687791+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:09:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-04-25T02:09:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-04-25T02:09:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.690003+0000', 'last_change': '2024-04-25T02:09:25.690003+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.690003+0000', 'last_undegraded': '2024-04-25T02:09:25.690003+0000', 'last_fullsized': '2024-04-25T02:09:25.690003+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:09:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-04-25T02:09:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-04-25T02:09:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.690484+0000', 'last_change': '2024-04-25T02:09:25.690484+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.690484+0000', 'last_undegraded': '2024-04-25T02:09:25.690484+0000', 'last_fullsized': '2024-04-25T02:09:25.690484+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:09:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2024-04-25T02:09:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-04-25T02:09:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.690475+0000', 'last_change': '2024-04-25T02:09:25.690475+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.690475+0000', 'last_undegraded': '2024-04-25T02:09:25.690475+0000', 'last_fullsized': '2024-04-25T02:09:25.690475+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:09:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-04-25T02:09:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-04-25T02:09:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.686944+0000', 'last_change': '2024-04-25T02:09:25.686944+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.686944+0000', 'last_undegraded': '2024-04-25T02:09:25.686944+0000', 'last_fullsized': '2024-04-25T02:09:25.686944+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:09:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2024-04-25T02:09:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-04-25T02:09:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.692850+0000', 'last_change': '2024-04-25T02:09:25.692850+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.692850+0000', 'last_undegraded': '2024-04-25T02:09:25.692850+0000', 'last_fullsized': '2024-04-25T02:09:25.692850+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:09:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-04-25T02:09:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-04-25T02:09:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.695432+0000', 'last_change': '2024-04-25T02:09:25.695432+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.695432+0000', 'last_undegraded': '2024-04-25T02:09:25.695432+0000', 'last_fullsized': '2024-04-25T02:09:25.695432+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:09:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-04-25T02:09:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-04-25T02:09:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.690400+0000', 'last_change': '2024-04-25T02:09:25.690400+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.690400+0000', 'last_undegraded': '2024-04-25T02:09:25.690400+0000', 'last_fullsized': '2024-04-25T02:09:25.690400+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:09:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2024-04-25T02:09:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-04-25T02:09:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.695560+0000', 'last_change': '2024-04-25T02:09:25.695560+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.695560+0000', 'last_undegraded': '2024-04-25T02:09:25.695560+0000', 'last_fullsized': '2024-04-25T02:09:25.695560+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:09:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2024-04-25T02:09:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-04-25T02:09:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.683889+0000', 'last_change': '2024-04-25T02:09:25.683889+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.683889+0000', 'last_undegraded': '2024-04-25T02:09:25.683889+0000', 'last_fullsized': '2024-04-25T02:09:25.683889+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:09:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2024-04-25T02:09:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-04-25T02:09:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.695484+0000', 'last_change': '2024-04-25T02:09:25.695484+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.695484+0000', 'last_undegraded': '2024-04-25T02:09:25.695484+0000', 'last_fullsized': '2024-04-25T02:09:25.695484+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:09:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2024-04-25T02:09:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-04-25T02:09:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.687841+0000', 'last_change': '2024-04-25T02:09:25.687841+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.687841+0000', 'last_undegraded': '2024-04-25T02:09:25.687841+0000', 'last_fullsized': '2024-04-25T02:09:25.687841+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:09:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2024-04-25T02:09:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-04-25T02:09:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.683920+0000', 'last_change': '2024-04-25T02:09:25.683920+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.683920+0000', 'last_undegraded': '2024-04-25T02:09:25.683920+0000', 'last_fullsized': '2024-04-25T02:09:25.683920+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:09:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2024-04-25T02:09:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-04-25T02:09:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.692836+0000', 'last_change': '2024-04-25T02:09:25.692836+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.692836+0000', 'last_undegraded': '2024-04-25T02:09:25.692836+0000', 'last_fullsized': '2024-04-25T02:09:25.692836+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:09:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2024-04-25T02:09:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:09:26.680258+0000', 'last_change': '2024-04-25T02:09:26.680258+0000', 'last_active': '2024-04-25T02:09:26.680258+0000', 'last_peered': '2024-04-25T02:09:26.680258+0000', 'last_clean': '2024-04-25T02:09:26.680258+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:26.680258+0000', 'last_undegraded': '2024-04-25T02:09:26.680258+0000', 'last_fullsized': '2024-04-25T02:09:26.680258+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:26.680258+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:09:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-04-25T02:09:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:09:25.686950+0000', 'last_change': '2024-04-25T02:09:25.686950+0000', 'last_active': '2024-04-25T02:09:25.676168+0000', 'last_peered': '2024-04-25T02:09:25.676168+0000', 'last_clean': '2024-04-25T02:09:25.676168+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:09:25.686950+0000', 'last_undegraded': '2024-04-25T02:09:25.686950+0000', 'last_fullsized': '2024-04-25T02:09:25.686950+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'last_clean_scrub_stamp': '2024-04-25T02:09:25.676168+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:09:31.358 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T02:09:31.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.465+0000 7f57171fb640 1 Processor -- start 2024-04-25T02:09:31.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.465+0000 7f57171fb640 1 -- start start 2024-04-25T02:09:31.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f57171fb640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5710158cf0 0x7f571015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f57171fb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f571006ead0 con 0x7f5710158910 2024-04-25T02:09:31.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f57171fb640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5710071a40 con 0x7f571015f0d0 2024-04-25T02:09:31.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f57171fb640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5710072650 con 0x7f5710158cf0 2024-04-25T02:09:31.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f5714f97640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5710158910 0x7f571006e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46072/0 (socket says 172.21.15.79:46072) 2024-04-25T02:09:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f5714f97640 1 -- 172.21.15.79:0/2194042567 learned_addr learned my addr 172.21.15.79:0/2194042567 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570f7fe640 1 -- 172.21.15.79:0/2194042567 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3211495047 0 0) 0x7f571006ead0 con 0x7f5710158910 2024-04-25T02:09:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570ffff640 1 --2- 172.21.15.79:0/2194042567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5710158cf0 0x7f571015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570f7fe640 1 -- 172.21.15.79:0/2194042567 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5700003520 con 0x7f5710158910 2024-04-25T02:09:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570f7fe640 1 -- 172.21.15.79:0/2194042567 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2744778080 0 0) 0x7f5700003520 con 0x7f5710158910 2024-04-25T02:09:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570f7fe640 1 -- 172.21.15.79:0/2194042567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5710158cf0 msgr2=0x7f571015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570f7fe640 1 --2- 172.21.15.79:0/2194042567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5710158cf0 0x7f571015eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570f7fe640 1 -- 172.21.15.79:0/2194042567 >> v1:172.21.15.189:6789/0 conn(0x7f571015f0d0 legacy=0x7f57100b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570f7fe640 1 -- 172.21.15.79:0/2194042567 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5710071d20 con 0x7f5710158910 2024-04-25T02:09:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570f7fe640 1 -- 172.21.15.79:0/2194042567 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f5704001670 con 0x7f5710158910 2024-04-25T02:09:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570f7fe640 1 -- 172.21.15.79:0/2194042567 >> v1:172.21.15.79:6789/0 conn(0x7f5710158910 legacy=0x7f571006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570f7fe640 1 --2- 172.21.15.79:0/2194042567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57000039e0 0x7f5700003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570f7fe640 1 --2- 172.21.15.79:0/2194042567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5700004390 0x7f5700004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570f7fe640 1 --2- 172.21.15.79:0/2194042567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5710158cf0 0x7f57000050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570f7fe640 1 -- 172.21.15.79:0/2194042567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5710072650 con 0x7f5700004390 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570f7fe640 1 -- 172.21.15.79:0/2194042567 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f570000b9c0 con 0x7f57000039e0 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.466+0000 7f570f7fe640 1 -- 172.21.15.79:0/2194042567 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f570000ddd0 con 0x7f5710158cf0 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.467+0000 7f570ffff640 1 --2- 172.21.15.79:0/2194042567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5700004390 0x7f5700004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.467+0000 7f5714f97640 1 --2- 172.21.15.79:0/2194042567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57000039e0 0x7f5700003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.467+0000 7f5715798640 1 --2- 172.21.15.79:0/2194042567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5710158cf0 0x7f57000050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.467+0000 7f570ffff640 1 -- 172.21.15.79:0/2194042567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5710158cf0 msgr2=0x7f57000050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.467+0000 7f570ffff640 1 --2- 172.21.15.79:0/2194042567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5710158cf0 0x7f57000050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.467+0000 7f570ffff640 1 -- 172.21.15.79:0/2194042567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57000039e0 msgr2=0x7f5700003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.467+0000 7f570ffff640 1 --2- 172.21.15.79:0/2194042567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57000039e0 0x7f5700003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.467+0000 7f570ffff640 1 -- 172.21.15.79:0/2194042567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5700003520 con 0x7f5700004390 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.467+0000 7f5715798640 1 --2- 172.21.15.79:0/2194042567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5710158cf0 0x7f57000050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.467+0000 7f570ffff640 1 --2- 172.21.15.79:0/2194042567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5700004390 0x7f5700004860 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009ac0 tx=0x7f5700005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e107b88dffafbc02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.468+0000 7f570f7fe640 1 -- 172.21.15.79:0/2194042567 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56fc036070 con 0x7f5700004390 2024-04-25T02:09:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.468+0000 7f570f7fe640 1 -- 172.21.15.79:0/2194042567 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56fc031400 con 0x7f5700004390 2024-04-25T02:09:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.468+0000 7f570f7fe640 1 -- 172.21.15.79:0/2194042567 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56fc009690 con 0x7f5700004390 2024-04-25T02:09:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.468+0000 7f57171fb640 1 -- 172.21.15.79:0/2194042567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5700004390 msgr2=0x7f5700004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.468+0000 7f57171fb640 1 --2- 172.21.15.79:0/2194042567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5700004390 0x7f5700004860 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009ac0 tx=0x7f5700005830 comp rx=0 tx=0).stop 2024-04-25T02:09:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.468+0000 7f5715798640 1 -- 172.21.15.79:0/2194042567 reap_dead start 2024-04-25T02:09:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.468+0000 7f57171fb640 1 -- 172.21.15.79:0/2194042567 shutdown_connections 2024-04-25T02:09:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.468+0000 7f57171fb640 1 -- 172.21.15.79:0/2194042567 >> 172.21.15.79:0/2194042567 conn(0x7f57100cfc80 msgr2=0x7f57100d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.468+0000 7f57171fb640 1 -- 172.21.15.79:0/2194042567 shutdown_connections 2024-04-25T02:09:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.468+0000 7f57171fb640 1 -- 172.21.15.79:0/2194042567 wait complete. 2024-04-25T02:09:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.469+0000 7f57171fb640 1 Processor -- start 2024-04-25T02:09:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.469+0000 7f57171fb640 1 -- start start 2024-04-25T02:09:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.470+0000 7f57171fb640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5700004390 0x7f57101546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.470+0000 7f57171fb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57100ac220 0x7f57100ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.470+0000 7f57171fb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57100aea10 0x7f57100aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.470+0000 7f57171fb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f571015f930 con 0x7f57100ac220 2024-04-25T02:09:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.470+0000 7f57171fb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f57100722e0 con 0x7f57100aea10 2024-04-25T02:09:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.470+0000 7f57171fb640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f571015eb90 con 0x7f5700004390 2024-04-25T02:09:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.470+0000 7f570ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57100ac220 0x7f57100ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.470+0000 7f570ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57100ac220 0x7f57100ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47706/0 (socket says 172.21.15.79:47706) 2024-04-25T02:09:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.470+0000 7f570ffff640 1 -- 172.21.15.79:0/363307572 learned_addr learned my addr 172.21.15.79:0/363307572 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.470+0000 7f5715798640 1 --2- 172.21.15.79:0/363307572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57100aea10 0x7f57100aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.470+0000 7f5714f97640 1 --2- 172.21.15.79:0/363307572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5700004390 0x7f57101546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.471+0000 7f570ffff640 1 -- 172.21.15.79:0/363307572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5700004390 msgr2=0x7f57101546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.471+0000 7f570ffff640 1 --2- 172.21.15.79:0/363307572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5700004390 0x7f57101546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.471+0000 7f570ffff640 1 -- 172.21.15.79:0/363307572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57100aea10 msgr2=0x7f57100aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.471+0000 7f570ffff640 1 --2- 172.21.15.79:0/363307572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57100aea10 0x7f57100aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.471+0000 7f570ffff640 1 -- 172.21.15.79:0/363307572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5710159680 con 0x7f57100ac220 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.471+0000 7f5715798640 1 --2- 172.21.15.79:0/363307572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57100aea10 0x7f57100aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.471+0000 7f570ffff640 1 --2- 172.21.15.79:0/363307572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57100ac220 0x7f57100ac6a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f56fc034040 tx=0x7f56fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.471+0000 7f570d7fa640 1 -- 172.21.15.79:0/363307572 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56fc040020 con 0x7f57100ac220 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.471+0000 7f570d7fa640 1 -- 172.21.15.79:0/363307572 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56fc003bc0 con 0x7f57100ac220 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.471+0000 7f57171fb640 1 -- 172.21.15.79:0/363307572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5710159920 con 0x7f57100ac220 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.471+0000 7f570d7fa640 1 -- 172.21.15.79:0/363307572 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56fc036040 con 0x7f57100ac220 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.471+0000 7f57171fb640 1 -- 172.21.15.79:0/363307572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5710159ee0 con 0x7f57100ac220 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.472+0000 7f57171fb640 1 -- 172.21.15.79:0/363307572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57100cf640 con 0x7f57100ac220 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.472+0000 7f570d7fa640 1 -- 172.21.15.79:0/363307572 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56fc043020 con 0x7f57100ac220 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.473+0000 7f570d7fa640 1 --2- 172.21.15.79:0/363307572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56f406be60 0x7f56f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.473+0000 7f570d7fa640 1 -- 172.21.15.79:0/363307572 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f56fc0aaf30 con 0x7f57100ac220 2024-04-25T02:09:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.473+0000 7f5714f97640 1 --2- 172.21.15.79:0/363307572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56f406be60 0x7f56f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.473+0000 7f5714f97640 1 --2- 172.21.15.79:0/363307572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56f406be60 0x7f56f406e320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f57100b0c70 tx=0x7f5704009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.477+0000 7f570d7fa640 1 -- 172.21.15.79:0/363307572 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f57100cf640 con 0x7f57100ac220 2024-04-25T02:09:31.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.719+0000 7f57171fb640 1 -- 172.21.15.79:0/363307572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f571006cd30 con 0x7f57100ac220 2024-04-25T02:09:31.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.720+0000 7f570d7fa640 1 -- 172.21.15.79:0/363307572 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1528 (secure 0 0 0) 0x7f56fc04a070 con 0x7f57100ac220 2024-04-25T02:09:31.728 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:31.728 INFO:teuthology.orchestra.run.smithi079.stdout:{"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":116,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":45,"num_osds":8,"num_up_osds":8,"osd_up_since":1714010866,"num_in_osds":8,"osd_in_since":1714010857,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":230699008,"bytes_avail":772863414272,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":18,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":5598}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-25T02:09:17.188657+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T02:09:31.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.722+0000 7f57171fb640 1 -- 172.21.15.79:0/363307572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56f406be60 msgr2=0x7f56f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.722+0000 7f57171fb640 1 --2- 172.21.15.79:0/363307572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56f406be60 0x7f56f406e320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f57100b0c70 tx=0x7f5704009040 comp rx=0 tx=0).stop 2024-04-25T02:09:31.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.722+0000 7f57171fb640 1 -- 172.21.15.79:0/363307572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57100ac220 msgr2=0x7f57100ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.722+0000 7f57171fb640 1 --2- 172.21.15.79:0/363307572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57100ac220 0x7f57100ac6a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f56fc034040 tx=0x7f56fc004730 comp rx=0 tx=0).stop 2024-04-25T02:09:31.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.722+0000 7f57171fb640 1 -- 172.21.15.79:0/363307572 shutdown_connections 2024-04-25T02:09:31.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.722+0000 7f57171fb640 1 --2- 172.21.15.79:0/363307572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f56f406be60 0x7f56f406e320 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.722+0000 7f57171fb640 1 --2- 172.21.15.79:0/363307572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57100aea10 0x7f57100aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.722+0000 7f57171fb640 1 --2- 172.21.15.79:0/363307572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57100ac220 0x7f57100ac6a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.722+0000 7f57171fb640 1 --2- 172.21.15.79:0/363307572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5700004390 0x7f57101546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.722+0000 7f57171fb640 1 -- 172.21.15.79:0/363307572 >> 172.21.15.79:0/363307572 conn(0x7f57100cfc80 msgr2=0x7f57100b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.723+0000 7f57171fb640 1 -- 172.21.15.79:0/363307572 shutdown_connections 2024-04-25T02:09:31.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.723+0000 7f57171fb640 1 -- 172.21.15.79:0/363307572 wait complete. 2024-04-25T02:09:31.741 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T02:09:31.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:09:31.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.830+0000 7f18238ba640 1 Processor -- start 2024-04-25T02:09:31.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.830+0000 7f18238ba640 1 -- start start 2024-04-25T02:09:31.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.831+0000 7f18238ba640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f181c143bc0 0x7f181c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.831+0000 7f18238ba640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181c15fa40 con 0x7f181c0b3d40 2024-04-25T02:09:31.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.831+0000 7f18238ba640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181c0b5700 con 0x7f181c06df50 2024-04-25T02:09:31.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.831+0000 7f18238ba640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f181c072cb0 con 0x7f181c143bc0 2024-04-25T02:09:31.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.831+0000 7f1821656640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f181c143bc0 0x7f181c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.831+0000 7f1821656640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f181c143bc0 0x7f181c15f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47718/0 (socket says 172.21.15.79:47718) 2024-04-25T02:09:31.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.831+0000 7f1821656640 1 -- 172.21.15.79:0/4033982303 learned_addr learned my addr 172.21.15.79:0/4033982303 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:31.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.831+0000 7f1821e57640 1 --1- 172.21.15.79:0/4033982303 >> v1:172.21.15.79:6789/0 conn(0x7f181c0b3d40 0x7f181c0b4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46080/0 (socket says 172.21.15.79:46080) 2024-04-25T02:09:31.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.832+0000 7f1821656640 1 -- 172.21.15.79:0/4033982303 >> v1:172.21.15.189:6789/0 conn(0x7f181c06df50 legacy=0x7f181c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.832+0000 7f1821656640 1 -- 172.21.15.79:0/4033982303 >> v1:172.21.15.79:6789/0 conn(0x7f181c0b3d40 legacy=0x7f181c0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.832+0000 7f1821656640 1 -- 172.21.15.79:0/4033982303 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c071e00 con 0x7f181c143bc0 2024-04-25T02:09:31.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.832+0000 7f1821656640 1 --2- 172.21.15.79:0/4033982303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c143bc0 0x7f181c15f500 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1818009870 tx=0x7f181802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63768e7f6b31dbfa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.832+0000 7f1813fff640 1 -- 172.21.15.79:0/4033982303 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1818037070 con 0x7f181c143bc0 2024-04-25T02:09:31.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.832+0000 7f1813fff640 1 -- 172.21.15.79:0/4033982303 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1818032440 con 0x7f181c143bc0 2024-04-25T02:09:31.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.832+0000 7f1813fff640 1 -- 172.21.15.79:0/4033982303 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1818032810 con 0x7f181c143bc0 2024-04-25T02:09:31.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.833+0000 7f18238ba640 1 -- 172.21.15.79:0/4033982303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c143bc0 msgr2=0x7f181c15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.833+0000 7f18238ba640 1 --2- 172.21.15.79:0/4033982303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c143bc0 0x7f181c15f500 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1818009870 tx=0x7f181802a210 comp rx=0 tx=0).stop 2024-04-25T02:09:31.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.833+0000 7f18238ba640 1 -- 172.21.15.79:0/4033982303 shutdown_connections 2024-04-25T02:09:31.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.833+0000 7f18238ba640 1 --2- 172.21.15.79:0/4033982303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c143bc0 0x7f181c15f500 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.833+0000 7f18238ba640 1 -- 172.21.15.79:0/4033982303 >> 172.21.15.79:0/4033982303 conn(0x7f181c0cfc80 msgr2=0x7f181c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.833+0000 7f18238ba640 1 -- 172.21.15.79:0/4033982303 shutdown_connections 2024-04-25T02:09:31.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.833+0000 7f18238ba640 1 -- 172.21.15.79:0/4033982303 wait complete. 2024-04-25T02:09:31.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.834+0000 7f18238ba640 1 Processor -- start 2024-04-25T02:09:31.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.834+0000 7f18238ba640 1 -- start start 2024-04-25T02:09:31.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f18238ba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c06df50 0x7f181c0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f18238ba640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f181c0b3d40 0x7f181c0ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f18238ba640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f181c143bc0 0x7f181c13edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f18238ba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f181c072660 con 0x7f181c06df50 2024-04-25T02:09:31.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f18238ba640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f181c072380 con 0x7f181c143bc0 2024-04-25T02:09:31.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f18238ba640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f181c072940 con 0x7f181c0b3d40 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f1821656640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c06df50 0x7f181c0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f1821656640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c06df50 0x7f181c0b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47732/0 (socket says 172.21.15.79:47732) 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f1821656640 1 -- 172.21.15.79:0/3645765814 learned_addr learned my addr 172.21.15.79:0/3645765814 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f1821e57640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f181c143bc0 0x7f181c13edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f1821656640 1 -- 172.21.15.79:0/3645765814 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f181c0b3d40 msgr2=0x7f181c0ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f1820e55640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f181c0b3d40 0x7f181c0ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f1821656640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f181c0b3d40 0x7f181c0ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f1821656640 1 -- 172.21.15.79:0/3645765814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f181c143bc0 msgr2=0x7f181c13edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f1821656640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f181c143bc0 0x7f181c13edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f1821656640 1 -- 172.21.15.79:0/3645765814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c1426e0 con 0x7f181c06df50 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f1821e57640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f181c143bc0 0x7f181c13edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f1820e55640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f181c0b3d40 0x7f181c0ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.835+0000 7f1821656640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c06df50 0x7f181c0b14a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1818009870 tx=0x7f18180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.836+0000 7f1811ffb640 1 -- 172.21.15.79:0/3645765814 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1818041070 con 0x7f181c06df50 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.836+0000 7f1811ffb640 1 -- 172.21.15.79:0/3645765814 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f181803c870 con 0x7f181c06df50 2024-04-25T02:09:31.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.836+0000 7f1811ffb640 1 -- 172.21.15.79:0/3645765814 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1818037040 con 0x7f181c06df50 2024-04-25T02:09:31.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.836+0000 7f18238ba640 1 -- 172.21.15.79:0/3645765814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181c142950 con 0x7f181c06df50 2024-04-25T02:09:31.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.836+0000 7f18238ba640 1 -- 172.21.15.79:0/3645765814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f181c13f2f0 con 0x7f181c06df50 2024-04-25T02:09:31.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.837+0000 7f18238ba640 1 -- 172.21.15.79:0/3645765814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f181c0690a0 con 0x7f181c06df50 2024-04-25T02:09:31.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.837+0000 7f1811ffb640 1 -- 172.21.15.79:0/3645765814 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1818044070 con 0x7f181c06df50 2024-04-25T02:09:31.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.837+0000 7f1811ffb640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f180006be30 0x7f180006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.838+0000 7f1811ffb640 1 -- 172.21.15.79:0/3645765814 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f18180ab900 con 0x7f181c06df50 2024-04-25T02:09:31.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.838+0000 7f1820e55640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f180006be30 0x7f180006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.838+0000 7f1820e55640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f180006be30 0x7f180006e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f181c0b3270 tx=0x7f180c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:31.842+0000 7f1811ffb640 1 -- 172.21.15.79:0/3645765814 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f181807a340 con 0x7f181c06df50 2024-04-25T02:09:32.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:32.013+0000 7f18238ba640 1 -- 172.21.15.79:0/3645765814 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f181c0ae830 con 0x7f180006be30 2024-04-25T02:09:32.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:32.018+0000 7f1811ffb640 1 -- 172.21.15.79:0/3645765814 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239831 (secure 0 0 0) 0x7f180c00ad60 con 0x7f180006be30 2024-04-25T02:09:32.028 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:32.029 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:09:32.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:32.021+0000 7f18238ba640 1 -- 172.21.15.79:0/3645765814 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f180006be30 msgr2=0x7f180006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:32.021+0000 7f18238ba640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f180006be30 0x7f180006e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f181c0b3270 tx=0x7f180c008040 comp rx=0 tx=0).stop 2024-04-25T02:09:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:32.021+0000 7f18238ba640 1 -- 172.21.15.79:0/3645765814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c06df50 msgr2=0x7f181c0b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:32.021+0000 7f18238ba640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c06df50 0x7f181c0b14a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1818009870 tx=0x7f18180046c0 comp rx=0 tx=0).stop 2024-04-25T02:09:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:32.021+0000 7f18238ba640 1 -- 172.21.15.79:0/3645765814 shutdown_connections 2024-04-25T02:09:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:32.021+0000 7f18238ba640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f180006be30 0x7f180006e2f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:32.021+0000 7f18238ba640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f181c143bc0 0x7f181c13edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:32.021+0000 7f18238ba640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f181c0b3d40 0x7f181c0ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:32.021+0000 7f18238ba640 1 --2- 172.21.15.79:0/3645765814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c06df50 0x7f181c0b14a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:32.021+0000 7f18238ba640 1 -- 172.21.15.79:0/3645765814 >> 172.21.15.79:0/3645765814 conn(0x7f181c0cfc80 msgr2=0x7f181c143fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:32.021+0000 7f18238ba640 1 -- 172.21.15.79:0/3645765814 shutdown_connections 2024-04-25T02:09:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:32.022+0000 7f18238ba640 1 -- 172.21.15.79:0/3645765814 wait complete. 2024-04-25T02:09:32.039 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-04-25T02:09:31.191145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":225292,"kb_used_data":4964,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749428,"statfs":{"total":773094113280,"available":772863414272,"internally_reserved":0,"allocated":5083136,"data_stored":2712029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.510062"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690553+0000","last_change":"2024-04-25T02:09:25.690553+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690553+0000","last_undegraded":"2024-04-25T02:09:25.690553+0000","last_fullsized":"2024-04-25T02:09:25.690553+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.688663+0000","last_change":"2024-04-25T02:09:25.688663+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.688663+0000","last_undegraded":"2024-04-25T02:09:25.688663+0000","last_fullsized":"2024-04-25T02:09:25.688663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.683909+0000","last_change":"2024-04-25T02:09:25.683909+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.683909+0000","last_undegraded":"2024-04-25T02:09:25.683909+0000","last_fullsized":"2024-04-25T02:09:25.683909+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695504+0000","last_change":"2024-04-25T02:09:25.695504+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695504+0000","last_undegraded":"2024-04-25T02:09:25.695504+0000","last_fullsized":"2024-04-25T02:09:25.695504+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.691357+0000","last_change":"2024-04-25T02:09:25.691357+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.691357+0000","last_undegraded":"2024-04-25T02:09:25.691357+0000","last_fullsized":"2024-04-25T02:09:25.691357+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.688819+0000","last_change":"2024-04-25T02:09:25.688819+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.688819+0000","last_undegraded":"2024-04-25T02:09:25.688819+0000","last_fullsized":"2024-04-25T02:09:25.688819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.686966+0000","last_change":"2024-04-25T02:09:25.686966+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.686966+0000","last_undegraded":"2024-04-25T02:09:25.686966+0000","last_fullsized":"2024-04-25T02:09:25.686966+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.693563+0000","last_change":"2024-04-25T02:09:25.693563+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.693563+0000","last_undegraded":"2024-04-25T02:09:25.693563+0000","last_fullsized":"2024-04-25T02:09:25.693563+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.687941+0000","last_change":"2024-04-25T02:09:25.687941+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.687941+0000","last_undegraded":"2024-04-25T02:09:25.687941+0000","last_fullsized":"2024-04-25T02:09:25.687941+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.692848+0000","last_change":"2024-04-25T02:09:25.692848+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.692848+0000","last_undegraded":"2024-04-25T02:09:25.692848+0000","last_fullsized":"2024-04-25T02:09:25.692848+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.698235+0000","last_change":"2024-04-25T02:09:25.698235+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.698235+0000","last_undegraded":"2024-04-25T02:09:25.698235+0000","last_fullsized":"2024-04-25T02:09:25.698235+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.689952+0000","last_change":"2024-04-25T02:09:25.689952+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.689952+0000","last_undegraded":"2024-04-25T02:09:25.689952+0000","last_fullsized":"2024-04-25T02:09:25.689952+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690975+0000","last_change":"2024-04-25T02:09:25.690975+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690975+0000","last_undegraded":"2024-04-25T02:09:25.690975+0000","last_fullsized":"2024-04-25T02:09:25.690975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695513+0000","last_change":"2024-04-25T02:09:25.695513+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695513+0000","last_undegraded":"2024-04-25T02:09:25.695513+0000","last_fullsized":"2024-04-25T02:09:25.695513+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.689860+0000","last_change":"2024-04-25T02:09:25.689860+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.689860+0000","last_undegraded":"2024-04-25T02:09:25.689860+0000","last_fullsized":"2024-04-25T02:09:25.689860+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.693212+0000","last_change":"2024-04-25T02:09:25.693212+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.693212+0000","last_undegraded":"2024-04-25T02:09:25.693212+0000","last_fullsized":"2024-04-25T02:09:25.693212+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.689980+0000","last_change":"2024-04-25T02:09:25.689980+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.689980+0000","last_undegraded":"2024-04-25T02:09:25.689980+0000","last_fullsized":"2024-04-25T02:09:25.689980+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.687791+0000","last_change":"2024-04-25T02:09:25.687791+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.687791+0000","last_undegraded":"2024-04-25T02:09:25.687791+0000","last_fullsized":"2024-04-25T02:09:25.687791+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690003+0000","last_change":"2024-04-25T02:09:25.690003+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690003+0000","last_undegraded":"2024-04-25T02:09:25.690003+0000","last_fullsized":"2024-04-25T02:09:25.690003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690484+0000","last_change":"2024-04-25T02:09:25.690484+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690484+0000","last_undegraded":"2024-04-25T02:09:25.690484+0000","last_fullsized":"2024-04-25T02:09:25.690484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690475+0000","last_change":"2024-04-25T02:09:25.690475+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690475+0000","last_undegraded":"2024-04-25T02:09:25.690475+0000","last_fullsized":"2024-04-25T02:09:25.690475+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.686944+0000","last_change":"2024-04-25T02:09:25.686944+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.686944+0000","last_undegraded":"2024-04-25T02:09:25.686944+0000","last_fullsized":"2024-04-25T02:09:25.686944+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.692850+0000","last_change":"2024-04-25T02:09:25.692850+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.692850+0000","last_undegraded":"2024-04-25T02:09:25.692850+0000","last_fullsized":"2024-04-25T02:09:25.692850+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695432+0000","last_change":"2024-04-25T02:09:25.695432+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695432+0000","last_undegraded":"2024-04-25T02:09:25.695432+0000","last_fullsized":"2024-04-25T02:09:25.695432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.690400+0000","last_change":"2024-04-25T02:09:25.690400+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.690400+0000","last_undegraded":"2024-04-25T02:09:25.690400+0000","last_fullsized":"2024-04-25T02:09:25.690400+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695560+0000","last_change":"2024-04-25T02:09:25.695560+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695560+0000","last_undegraded":"2024-04-25T02:09:25.695560+0000","last_fullsized":"2024-04-25T02:09:25.695560+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.683889+0000","last_change":"2024-04-25T02:09:25.683889+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.683889+0000","last_undegraded":"2024-04-25T02:09:25.683889+0000","last_fullsized":"2024-04-25T02:09:25.683889+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.695484+0000","last_change":"2024-04-25T02:09:25.695484+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.695484+0000","last_undegraded":"2024-04-25T02:09:25.695484+0000","last_fullsized":"2024-04-25T02:09:25.695484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.687841+0000","last_change":"2024-04-25T02:09:25.687841+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.687841+0000","last_undegraded":"2024-04-25T02:09:25.687841+0000","last_fullsized":"2024-04-25T02:09:25.687841+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.683920+0000","last_change":"2024-04-25T02:09:25.683920+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.683920+0000","last_undegraded":"2024-04-25T02:09:25.683920+0000","last_fullsized":"2024-04-25T02:09:25.683920+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.692836+0000","last_change":"2024-04-25T02:09:25.692836+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.692836+0000","last_undegraded":"2024-04-25T02:09:25.692836+0000","last_fullsized":"2024-04-25T02:09:25.692836+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:09:26.680258+0000","last_change":"2024-04-25T02:09:26.680258+0000","last_active":"2024-04-25T02:09:26.680258+0000","last_peered":"2024-04-25T02:09:26.680258+0000","last_clean":"2024-04-25T02:09:26.680258+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:26.680258+0000","last_undegraded":"2024-04-25T02:09:26.680258+0000","last_fullsized":"2024-04-25T02:09:26.680258+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T02:09:25.686950+0000","last_change":"2024-04-25T02:09:25.686950+0000","last_active":"2024-04-25T02:09:25.676168+0000","last_peered":"2024-04-25T02:09:25.676168+0000","last_clean":"2024-04-25T02:09:25.676168+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:09:25.686950+0000","last_undegraded":"2024-04-25T02:09:25.686950+0000","last_fullsized":"2024-04-25T02:09:25.686950+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":207,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:09:25.698595+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:09:25.698595+0000","last_peered":"2024-04-25T02:09:25.698595+0000","last_clean":"2024-04-25T02:09:25.698595+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:09:25.698595+0000","last_undegraded":"2024-04-25T02:09:25.698595+0000","last_fullsized":"2024-04-25T02:09:25.698595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":778144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":187776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":193593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":778144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:09:32.978 INFO:tasks.ceph.mds.b.smithi189.stderr:2024-04-25T02:09:32.970+0000 7fc98391d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:09:35.043 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:09:35.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.144+0000 7f61bd1c1640 1 Processor -- start 2024-04-25T02:09:35.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.144+0000 7f61bd1c1640 1 -- start start 2024-04-25T02:09:35.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.145+0000 7f61bd1c1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f61b815e4d0 0x7f61b806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.145+0000 7f61bd1c1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61b80b3570 0x7f61b80d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.145+0000 7f61bd1c1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b80d1660 con 0x7f61b80b3020 2024-04-25T02:09:35.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.145+0000 7f61bd1c1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f61b80d1380 con 0x7f61b815e4d0 2024-04-25T02:09:35.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.145+0000 7f61bd1c1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f61b80cede0 con 0x7f61b80b3570 2024-04-25T02:09:35.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.145+0000 7f61b6d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f61b815e4d0 0x7f61b806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.145+0000 7f61b6d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f61b815e4d0 0x7f61b806bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36218/0 (socket says 172.21.15.79:36218) 2024-04-25T02:09:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.145+0000 7f61b6d9d640 1 -- 172.21.15.79:0/4093419335 learned_addr learned my addr 172.21.15.79:0/4093419335 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.146+0000 7f61b659c640 1 --2- 172.21.15.79:0/4093419335 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61b80b3570 0x7f61b80d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.146+0000 7f61b6d9d640 1 -- 172.21.15.79:0/4093419335 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61b80b3570 msgr2=0x7f61b80d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.146+0000 7f61b6d9d640 1 --2- 172.21.15.79:0/4093419335 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61b80b3570 0x7f61b80d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.146+0000 7f61b6d9d640 1 -- 172.21.15.79:0/4093419335 >> v1:172.21.15.189:6789/0 conn(0x7f61b80b3020 legacy=0x7f61b80cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.146+0000 7f61b6d9d640 1 -- 172.21.15.79:0/4093419335 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b80cf0c0 con 0x7f61b815e4d0 2024-04-25T02:09:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.146+0000 7f61b659c640 1 --2- 172.21.15.79:0/4093419335 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61b80b3570 0x7f61b80d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:35.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.146+0000 7f61b6d9d640 1 --2- 172.21.15.79:0/4093419335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b815e4d0 0x7f61b806bc70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009e50 tx=0x7f61a802a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ed061c80a66d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:35.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.146+0000 7f61b5d9b640 1 -- 172.21.15.79:0/4093419335 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8036070 con 0x7f61b815e4d0 2024-04-25T02:09:35.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.147+0000 7f61b5d9b640 1 -- 172.21.15.79:0/4093419335 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a8031600 con 0x7f61b815e4d0 2024-04-25T02:09:35.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.147+0000 7f61b5d9b640 1 -- 172.21.15.79:0/4093419335 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a80319d0 con 0x7f61b815e4d0 2024-04-25T02:09:35.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.147+0000 7f61bd1c1640 1 -- 172.21.15.79:0/4093419335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b815e4d0 msgr2=0x7f61b806bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.147+0000 7f61bd1c1640 1 --2- 172.21.15.79:0/4093419335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b815e4d0 0x7f61b806bc70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009e50 tx=0x7f61a802a6d0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.147+0000 7f61bd1c1640 1 -- 172.21.15.79:0/4093419335 shutdown_connections 2024-04-25T02:09:35.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.147+0000 7f61bd1c1640 1 --2- 172.21.15.79:0/4093419335 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61b80b3570 0x7f61b80d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.147+0000 7f61bd1c1640 1 --2- 172.21.15.79:0/4093419335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b815e4d0 0x7f61b806bc70 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.147+0000 7f61bd1c1640 1 -- 172.21.15.79:0/4093419335 >> 172.21.15.79:0/4093419335 conn(0x7f61b809d460 msgr2=0x7f61b80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:35.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.147+0000 7f61bd1c1640 1 -- 172.21.15.79:0/4093419335 shutdown_connections 2024-04-25T02:09:35.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.147+0000 7f61bd1c1640 1 -- 172.21.15.79:0/4093419335 wait complete. 2024-04-25T02:09:35.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.149+0000 7f61bd1c1640 1 Processor -- start 2024-04-25T02:09:35.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.149+0000 7f61bd1c1640 1 -- start start 2024-04-25T02:09:35.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.149+0000 7f61bd1c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b80b3020 0x7f61b80ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.149+0000 7f61bd1c1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61b80b3570 0x7f61b80b9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.149+0000 7f61bd1c1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61b815e4d0 0x7f61b80cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.149+0000 7f61bd1c1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61b80d2250 con 0x7f61b80b3020 2024-04-25T02:09:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.149+0000 7f61bd1c1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f61b80d20d0 con 0x7f61b815e4d0 2024-04-25T02:09:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.149+0000 7f61bd1c1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f61b806c1b0 con 0x7f61b80b3570 2024-04-25T02:09:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f61b6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b80b3020 0x7f61b80ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f61b6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b80b3020 0x7f61b80ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36220/0 (socket says 172.21.15.79:36220) 2024-04-25T02:09:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f61b6d9d640 1 -- 172.21.15.79:0/505169096 learned_addr learned my addr 172.21.15.79:0/505169096 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f61b659c640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61b80b3570 0x7f61b80b9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f61b759e640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61b815e4d0 0x7f61b80cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f61b6d9d640 1 -- 172.21.15.79:0/505169096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61b80b3570 msgr2=0x7f61b80b9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f61b6d9d640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61b80b3570 0x7f61b80b9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f61b6d9d640 1 -- 172.21.15.79:0/505169096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61b815e4d0 msgr2=0x7f61b80cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f61b6d9d640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61b815e4d0 0x7f61b80cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f61b6d9d640 1 -- 172.21.15.79:0/505169096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b80cb9f0 con 0x7f61b80b3020 2024-04-25T02:09:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f61b759e640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61b815e4d0 0x7f61b80cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f61b659c640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61b80b3570 0x7f61b80b9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f61b6d9d640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b80b3020 0x7f61b80ccd50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f61a8000f80 tx=0x7f61a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f619f7fe640 1 -- 172.21.15.79:0/505169096 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8036050 con 0x7f61b80b3020 2024-04-25T02:09:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f619f7fe640 1 -- 172.21.15.79:0/505169096 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a8042070 con 0x7f61b80b3020 2024-04-25T02:09:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f61bd1c1640 1 -- 172.21.15.79:0/505169096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b80cbcb0 con 0x7f61b80b3020 2024-04-25T02:09:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f619f7fe640 1 -- 172.21.15.79:0/505169096 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8009510 con 0x7f61b80b3020 2024-04-25T02:09:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.150+0000 7f61bd1c1640 1 -- 172.21.15.79:0/505169096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b80cc270 con 0x7f61b80b3020 2024-04-25T02:09:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.151+0000 7f61bd1c1640 1 -- 172.21.15.79:0/505169096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b80690a0 con 0x7f61b80b3020 2024-04-25T02:09:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.152+0000 7f619f7fe640 1 -- 172.21.15.79:0/505169096 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61a8007c70 con 0x7f61b80b3020 2024-04-25T02:09:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.152+0000 7f619f7fe640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f61a406be30 0x7f61a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.152+0000 7f619f7fe640 1 -- 172.21.15.79:0/505169096 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f61a80abd50 con 0x7f61b80b3020 2024-04-25T02:09:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.152+0000 7f61b659c640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f61a406be30 0x7f61a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.152+0000 7f61b659c640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f61a406be30 0x7f61a406e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f61ac006fd0 tx=0x7f61ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:35.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.157+0000 7f619f7fe640 1 -- 172.21.15.79:0/505169096 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f61a80af030 con 0x7f61b80b3020 2024-04-25T02:09:35.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.328+0000 7f61bd1c1640 1 -- 172.21.15.79:0/505169096 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f61b80b9b70 con 0x7f61a406be30 2024-04-25T02:09:35.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.333+0000 7f619f7fe640 1 -- 172.21.15.79:0/505169096 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7f61ac00d810 con 0x7f61a406be30 2024-04-25T02:09:35.343 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:35.345 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:09:35.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.336+0000 7f61bd1c1640 1 -- 172.21.15.79:0/505169096 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f61a406be30 msgr2=0x7f61a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.336+0000 7f61bd1c1640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f61a406be30 0x7f61a406e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f61ac006fd0 tx=0x7f61ac008040 comp rx=0 tx=0).stop 2024-04-25T02:09:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.336+0000 7f61bd1c1640 1 -- 172.21.15.79:0/505169096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b80b3020 msgr2=0x7f61b80ccd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.336+0000 7f61bd1c1640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b80b3020 0x7f61b80ccd50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f61a8000f80 tx=0x7f61a8004a40 comp rx=0 tx=0).stop 2024-04-25T02:09:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.336+0000 7f61bd1c1640 1 -- 172.21.15.79:0/505169096 shutdown_connections 2024-04-25T02:09:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.336+0000 7f61bd1c1640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f61a406be30 0x7f61a406e2f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.336+0000 7f61bd1c1640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61b815e4d0 0x7f61b80cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.336+0000 7f61bd1c1640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61b80b3570 0x7f61b80b9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.336+0000 7f61bd1c1640 1 --2- 172.21.15.79:0/505169096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b80b3020 0x7f61b80ccd50 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.336+0000 7f61bd1c1640 1 -- 172.21.15.79:0/505169096 >> 172.21.15.79:0/505169096 conn(0x7f61b809d460 msgr2=0x7f61b815c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.337+0000 7f61bd1c1640 1 -- 172.21.15.79:0/505169096 shutdown_connections 2024-04-25T02:09:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.337+0000 7f61bd1c1640 1 -- 172.21.15.79:0/505169096 wait complete. 2024-04-25T02:09:35.355 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-04-25T02:09:35.191970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225732,"kb_used_data":5352,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748988,"statfs":{"total":773094113280,"available":772862963712,"internally_reserved":0,"allocated":5480448,"data_stored":2889036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001662"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417319+0000","last_change":"2024-04-25T02:09:27.720422+0000","last_active":"2024-04-25T02:09:29.417319+0000","last_peered":"2024-04-25T02:09:29.417319+0000","last_clean":"2024-04-25T02:09:29.417319+0000","last_became_active":"2024-04-25T02:09:27.719997+0000","last_became_peered":"2024-04-25T02:09:27.719997+0000","last_unstale":"2024-04-25T02:09:29.417319+0000","last_undegraded":"2024-04-25T02:09:29.417319+0000","last_fullsized":"2024-04-25T02:09:29.417319+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:13.164180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.418038+0000","last_change":"2024-04-25T02:09:27.709316+0000","last_active":"2024-04-25T02:09:29.418038+0000","last_peered":"2024-04-25T02:09:29.418038+0000","last_clean":"2024-04-25T02:09:29.418038+0000","last_became_active":"2024-04-25T02:09:27.709043+0000","last_became_peered":"2024-04-25T02:09:27.709043+0000","last_unstale":"2024-04-25T02:09:29.418038+0000","last_undegraded":"2024-04-25T02:09:29.418038+0000","last_fullsized":"2024-04-25T02:09:29.418038+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:50:40.201842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708307+0000","last_change":"2024-04-25T02:09:27.706973+0000","last_active":"2024-04-25T02:09:28.708307+0000","last_peered":"2024-04-25T02:09:28.708307+0000","last_clean":"2024-04-25T02:09:28.708307+0000","last_became_active":"2024-04-25T02:09:27.706531+0000","last_became_peered":"2024-04-25T02:09:27.706531+0000","last_unstale":"2024-04-25T02:09:28.708307+0000","last_undegraded":"2024-04-25T02:09:28.708307+0000","last_fullsized":"2024-04-25T02:09:28.708307+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:50:40.201842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708292+0000","last_change":"2024-04-25T02:09:27.703484+0000","last_active":"2024-04-25T02:09:28.708292+0000","last_peered":"2024-04-25T02:09:28.708292+0000","last_clean":"2024-04-25T02:09:28.708292+0000","last_became_active":"2024-04-25T02:09:27.703157+0000","last_became_peered":"2024-04-25T02:09:27.703157+0000","last_unstale":"2024-04-25T02:09:28.708292+0000","last_undegraded":"2024-04-25T02:09:28.708292+0000","last_fullsized":"2024-04-25T02:09:28.708292+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:12:32.128250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.418104+0000","last_change":"2024-04-25T02:09:27.710022+0000","last_active":"2024-04-25T02:09:29.418104+0000","last_peered":"2024-04-25T02:09:29.418104+0000","last_clean":"2024-04-25T02:09:29.418104+0000","last_became_active":"2024-04-25T02:09:27.709754+0000","last_became_peered":"2024-04-25T02:09:27.709754+0000","last_unstale":"2024-04-25T02:09:29.418104+0000","last_undegraded":"2024-04-25T02:09:29.418104+0000","last_fullsized":"2024-04-25T02:09:29.418104+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:12:32.128250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416032+0000","last_change":"2024-04-25T02:09:27.716754+0000","last_active":"2024-04-25T02:09:29.416032+0000","last_peered":"2024-04-25T02:09:29.416032+0000","last_clean":"2024-04-25T02:09:29.416032+0000","last_became_active":"2024-04-25T02:09:27.716451+0000","last_became_peered":"2024-04-25T02:09:27.716451+0000","last_unstale":"2024-04-25T02:09:29.416032+0000","last_undegraded":"2024-04-25T02:09:29.416032+0000","last_fullsized":"2024-04-25T02:09:29.416032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:33.038921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416963+0000","last_change":"2024-04-25T02:09:27.714476+0000","last_active":"2024-04-25T02:09:29.416963+0000","last_peered":"2024-04-25T02:09:29.416963+0000","last_clean":"2024-04-25T02:09:29.416963+0000","last_became_active":"2024-04-25T02:09:27.714202+0000","last_became_peered":"2024-04-25T02:09:27.714202+0000","last_unstale":"2024-04-25T02:09:29.416963+0000","last_undegraded":"2024-04-25T02:09:29.416963+0000","last_fullsized":"2024-04-25T02:09:29.416963+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:12:32.128250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708092+0000","last_change":"2024-04-25T02:09:27.707403+0000","last_active":"2024-04-25T02:09:28.708092+0000","last_peered":"2024-04-25T02:09:28.708092+0000","last_clean":"2024-04-25T02:09:28.708092+0000","last_became_active":"2024-04-25T02:09:27.706938+0000","last_became_peered":"2024-04-25T02:09:27.706938+0000","last_unstale":"2024-04-25T02:09:28.708092+0000","last_undegraded":"2024-04-25T02:09:28.708092+0000","last_fullsized":"2024-04-25T02:09:28.708092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:56:18.994738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708350+0000","last_change":"2024-04-25T02:09:27.711645+0000","last_active":"2024-04-25T02:09:28.708350+0000","last_peered":"2024-04-25T02:09:28.708350+0000","last_clean":"2024-04-25T02:09:28.708350+0000","last_became_active":"2024-04-25T02:09:27.711123+0000","last_became_peered":"2024-04-25T02:09:27.711123+0000","last_unstale":"2024-04-25T02:09:28.708350+0000","last_undegraded":"2024-04-25T02:09:28.708350+0000","last_fullsized":"2024-04-25T02:09:28.708350+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:13.164180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708511+0000","last_change":"2024-04-25T02:09:27.703661+0000","last_active":"2024-04-25T02:09:28.708511+0000","last_peered":"2024-04-25T02:09:28.708511+0000","last_clean":"2024-04-25T02:09:28.708511+0000","last_became_active":"2024-04-25T02:09:27.703343+0000","last_became_peered":"2024-04-25T02:09:27.703343+0000","last_unstale":"2024-04-25T02:09:28.708511+0000","last_undegraded":"2024-04-25T02:09:28.708511+0000","last_fullsized":"2024-04-25T02:09:28.708511+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:13.414508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708303+0000","last_change":"2024-04-25T02:09:27.710747+0000","last_active":"2024-04-25T02:09:28.708303+0000","last_peered":"2024-04-25T02:09:28.708303+0000","last_clean":"2024-04-25T02:09:28.708303+0000","last_became_active":"2024-04-25T02:09:27.710502+0000","last_became_peered":"2024-04-25T02:09:27.710502+0000","last_unstale":"2024-04-25T02:09:28.708303+0000","last_undegraded":"2024-04-25T02:09:28.708303+0000","last_fullsized":"2024-04-25T02:09:28.708303+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:41:33.850548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417918+0000","last_change":"2024-04-25T02:09:27.707579+0000","last_active":"2024-04-25T02:09:29.417918+0000","last_peered":"2024-04-25T02:09:29.417918+0000","last_clean":"2024-04-25T02:09:29.417918+0000","last_became_active":"2024-04-25T02:09:27.707278+0000","last_became_peered":"2024-04-25T02:09:27.707278+0000","last_unstale":"2024-04-25T02:09:29.417918+0000","last_undegraded":"2024-04-25T02:09:29.417918+0000","last_fullsized":"2024-04-25T02:09:29.417918+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:29.883168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.706982+0000","last_change":"2024-04-25T02:09:27.712020+0000","last_active":"2024-04-25T02:09:28.706982+0000","last_peered":"2024-04-25T02:09:28.706982+0000","last_clean":"2024-04-25T02:09:28.706982+0000","last_became_active":"2024-04-25T02:09:27.711747+0000","last_became_peered":"2024-04-25T02:09:27.711747+0000","last_unstale":"2024-04-25T02:09:28.706982+0000","last_undegraded":"2024-04-25T02:09:28.706982+0000","last_fullsized":"2024-04-25T02:09:28.706982+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:13:20.197093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708180+0000","last_change":"2024-04-25T02:09:27.709409+0000","last_active":"2024-04-25T02:09:28.708180+0000","last_peered":"2024-04-25T02:09:28.708180+0000","last_clean":"2024-04-25T02:09:28.708180+0000","last_became_active":"2024-04-25T02:09:27.709152+0000","last_became_peered":"2024-04-25T02:09:27.709152+0000","last_unstale":"2024-04-25T02:09:28.708180+0000","last_undegraded":"2024-04-25T02:09:28.708180+0000","last_fullsized":"2024-04-25T02:09:28.708180+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:14:09.846417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.415714+0000","last_change":"2024-04-25T02:09:27.713531+0000","last_active":"2024-04-25T02:09:29.415714+0000","last_peered":"2024-04-25T02:09:29.415714+0000","last_clean":"2024-04-25T02:09:29.415714+0000","last_became_active":"2024-04-25T02:09:27.712952+0000","last_became_peered":"2024-04-25T02:09:27.712952+0000","last_unstale":"2024-04-25T02:09:29.415714+0000","last_undegraded":"2024-04-25T02:09:29.415714+0000","last_fullsized":"2024-04-25T02:09:29.415714+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:14:39.213447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416866+0000","last_change":"2024-04-25T02:09:27.709916+0000","last_active":"2024-04-25T02:09:29.416866+0000","last_peered":"2024-04-25T02:09:29.416866+0000","last_clean":"2024-04-25T02:09:29.416866+0000","last_became_active":"2024-04-25T02:09:27.709605+0000","last_became_peered":"2024-04-25T02:09:27.709605+0000","last_unstale":"2024-04-25T02:09:29.416866+0000","last_undegraded":"2024-04-25T02:09:29.416866+0000","last_fullsized":"2024-04-25T02:09:29.416866+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:45.116829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708359+0000","last_change":"2024-04-25T02:09:27.715120+0000","last_active":"2024-04-25T02:09:28.708359+0000","last_peered":"2024-04-25T02:09:28.708359+0000","last_clean":"2024-04-25T02:09:28.708359+0000","last_became_active":"2024-04-25T02:09:27.714803+0000","last_became_peered":"2024-04-25T02:09:27.714803+0000","last_unstale":"2024-04-25T02:09:28.708359+0000","last_undegraded":"2024-04-25T02:09:28.708359+0000","last_fullsized":"2024-04-25T02:09:28.708359+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:12:32.128250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708167+0000","last_change":"2024-04-25T02:09:27.713052+0000","last_active":"2024-04-25T02:09:28.708167+0000","last_peered":"2024-04-25T02:09:28.708167+0000","last_clean":"2024-04-25T02:09:28.708167+0000","last_became_active":"2024-04-25T02:09:27.712549+0000","last_became_peered":"2024-04-25T02:09:27.712549+0000","last_unstale":"2024-04-25T02:09:28.708167+0000","last_undegraded":"2024-04-25T02:09:28.708167+0000","last_fullsized":"2024-04-25T02:09:28.708167+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:14:09.846417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417311+0000","last_change":"2024-04-25T02:09:27.709347+0000","last_active":"2024-04-25T02:09:29.417311+0000","last_peered":"2024-04-25T02:09:29.417311+0000","last_clean":"2024-04-25T02:09:29.417311+0000","last_became_active":"2024-04-25T02:09:27.709081+0000","last_became_peered":"2024-04-25T02:09:27.709081+0000","last_unstale":"2024-04-25T02:09:29.417311+0000","last_undegraded":"2024-04-25T02:09:29.417311+0000","last_fullsized":"2024-04-25T02:09:29.417311+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:10.938078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.707147+0000","last_change":"2024-04-25T02:09:27.703798+0000","last_active":"2024-04-25T02:09:28.707147+0000","last_peered":"2024-04-25T02:09:28.707147+0000","last_clean":"2024-04-25T02:09:28.707147+0000","last_became_active":"2024-04-25T02:09:27.703542+0000","last_became_peered":"2024-04-25T02:09:27.703542+0000","last_unstale":"2024-04-25T02:09:28.707147+0000","last_undegraded":"2024-04-25T02:09:28.707147+0000","last_fullsized":"2024-04-25T02:09:28.707147+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:42.836356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416045+0000","last_change":"2024-04-25T02:09:27.716616+0000","last_active":"2024-04-25T02:09:29.416045+0000","last_peered":"2024-04-25T02:09:29.416045+0000","last_clean":"2024-04-25T02:09:29.416045+0000","last_became_active":"2024-04-25T02:09:27.716213+0000","last_became_peered":"2024-04-25T02:09:27.716213+0000","last_unstale":"2024-04-25T02:09:29.416045+0000","last_undegraded":"2024-04-25T02:09:29.416045+0000","last_fullsized":"2024-04-25T02:09:29.416045+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:11.521414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708341+0000","last_change":"2024-04-25T02:09:27.703394+0000","last_active":"2024-04-25T02:09:28.708341+0000","last_peered":"2024-04-25T02:09:28.708341+0000","last_clean":"2024-04-25T02:09:28.708341+0000","last_became_active":"2024-04-25T02:09:27.703118+0000","last_became_peered":"2024-04-25T02:09:27.703118+0000","last_unstale":"2024-04-25T02:09:28.708341+0000","last_undegraded":"2024-04-25T02:09:28.708341+0000","last_fullsized":"2024-04-25T02:09:28.708341+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:50:40.201842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416810+0000","last_change":"2024-04-25T02:09:27.716647+0000","last_active":"2024-04-25T02:09:29.416810+0000","last_peered":"2024-04-25T02:09:29.416810+0000","last_clean":"2024-04-25T02:09:29.416810+0000","last_became_active":"2024-04-25T02:09:27.716371+0000","last_became_peered":"2024-04-25T02:09:27.716371+0000","last_unstale":"2024-04-25T02:09:29.416810+0000","last_undegraded":"2024-04-25T02:09:29.416810+0000","last_fullsized":"2024-04-25T02:09:29.416810+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:30.689185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416754+0000","last_change":"2024-04-25T02:09:27.717277+0000","last_active":"2024-04-25T02:09:29.416754+0000","last_peered":"2024-04-25T02:09:29.416754+0000","last_clean":"2024-04-25T02:09:29.416754+0000","last_became_active":"2024-04-25T02:09:27.717012+0000","last_became_peered":"2024-04-25T02:09:27.717012+0000","last_unstale":"2024-04-25T02:09:29.416754+0000","last_undegraded":"2024-04-25T02:09:29.416754+0000","last_fullsized":"2024-04-25T02:09:29.416754+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:48:12.234111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417416+0000","last_change":"2024-04-25T02:09:27.708505+0000","last_active":"2024-04-25T02:09:29.417416+0000","last_peered":"2024-04-25T02:09:29.417416+0000","last_clean":"2024-04-25T02:09:29.417416+0000","last_became_active":"2024-04-25T02:09:27.708142+0000","last_became_peered":"2024-04-25T02:09:27.708142+0000","last_unstale":"2024-04-25T02:09:29.417416+0000","last_undegraded":"2024-04-25T02:09:29.417416+0000","last_fullsized":"2024-04-25T02:09:29.417416+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:08.404211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.707174+0000","last_change":"2024-04-25T02:09:27.710612+0000","last_active":"2024-04-25T02:09:28.707174+0000","last_peered":"2024-04-25T02:09:28.707174+0000","last_clean":"2024-04-25T02:09:28.707174+0000","last_became_active":"2024-04-25T02:09:27.710356+0000","last_became_peered":"2024-04-25T02:09:27.710356+0000","last_unstale":"2024-04-25T02:09:28.707174+0000","last_undegraded":"2024-04-25T02:09:28.707174+0000","last_fullsized":"2024-04-25T02:09:28.707174+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:10:06.908176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708166+0000","last_change":"2024-04-25T02:09:27.716445+0000","last_active":"2024-04-25T02:09:28.708166+0000","last_peered":"2024-04-25T02:09:28.708166+0000","last_clean":"2024-04-25T02:09:28.708166+0000","last_became_active":"2024-04-25T02:09:27.716131+0000","last_became_peered":"2024-04-25T02:09:27.716131+0000","last_unstale":"2024-04-25T02:09:28.708166+0000","last_undegraded":"2024-04-25T02:09:28.708166+0000","last_fullsized":"2024-04-25T02:09:28.708166+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:29.883168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417950+0000","last_change":"2024-04-25T02:09:27.706901+0000","last_active":"2024-04-25T02:09:29.417950+0000","last_peered":"2024-04-25T02:09:29.417950+0000","last_clean":"2024-04-25T02:09:29.417950+0000","last_became_active":"2024-04-25T02:09:27.706615+0000","last_became_peered":"2024-04-25T02:09:27.706615+0000","last_unstale":"2024-04-25T02:09:29.417950+0000","last_undegraded":"2024-04-25T02:09:29.417950+0000","last_fullsized":"2024-04-25T02:09:29.417950+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:14:09.846417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417182+0000","last_change":"2024-04-25T02:09:27.707167+0000","last_active":"2024-04-25T02:09:29.417182+0000","last_peered":"2024-04-25T02:09:29.417182+0000","last_clean":"2024-04-25T02:09:29.417182+0000","last_became_active":"2024-04-25T02:09:27.706856+0000","last_became_peered":"2024-04-25T02:09:27.706856+0000","last_unstale":"2024-04-25T02:09:29.417182+0000","last_undegraded":"2024-04-25T02:09:29.417182+0000","last_fullsized":"2024-04-25T02:09:29.417182+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:00.941662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708036+0000","last_change":"2024-04-25T02:09:27.719394+0000","last_active":"2024-04-25T02:09:28.708036+0000","last_peered":"2024-04-25T02:09:28.708036+0000","last_clean":"2024-04-25T02:09:28.708036+0000","last_became_active":"2024-04-25T02:09:27.719107+0000","last_became_peered":"2024-04-25T02:09:27.719107+0000","last_unstale":"2024-04-25T02:09:28.708036+0000","last_undegraded":"2024-04-25T02:09:28.708036+0000","last_fullsized":"2024-04-25T02:09:28.708036+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:26.667539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.415839+0000","last_change":"2024-04-25T02:09:27.715591+0000","last_active":"2024-04-25T02:09:29.415839+0000","last_peered":"2024-04-25T02:09:29.415839+0000","last_clean":"2024-04-25T02:09:29.415839+0000","last_became_active":"2024-04-25T02:09:27.715350+0000","last_became_peered":"2024-04-25T02:09:27.715350+0000","last_unstale":"2024-04-25T02:09:29.415839+0000","last_undegraded":"2024-04-25T02:09:29.415839+0000","last_fullsized":"2024-04-25T02:09:29.415839+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:49.125858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.706931+0000","last_change":"2024-04-25T02:09:27.707119+0000","last_active":"2024-04-25T02:09:28.706931+0000","last_peered":"2024-04-25T02:09:28.706931+0000","last_clean":"2024-04-25T02:09:28.706931+0000","last_became_active":"2024-04-25T02:09:27.706833+0000","last_became_peered":"2024-04-25T02:09:27.706833+0000","last_unstale":"2024-04-25T02:09:28.706931+0000","last_undegraded":"2024-04-25T02:09:28.706931+0000","last_fullsized":"2024-04-25T02:09:28.706931+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:50.684409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416075+0000","last_change":"2024-04-25T02:09:27.710377+0000","last_active":"2024-04-25T02:09:29.416075+0000","last_peered":"2024-04-25T02:09:29.416075+0000","last_clean":"2024-04-25T02:09:29.416075+0000","last_became_active":"2024-04-25T02:09:27.710112+0000","last_became_peered":"2024-04-25T02:09:27.710112+0000","last_unstale":"2024-04-25T02:09:29.416075+0000","last_undegraded":"2024-04-25T02:09:29.416075+0000","last_fullsized":"2024-04-25T02:09:29.416075+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:45.116829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.415861+0000","last_change":"2024-04-25T02:09:26.706875+0000","last_active":"2024-04-25T02:09:29.415861+0000","last_peered":"2024-04-25T02:09:29.415861+0000","last_clean":"2024-04-25T02:09:29.415861+0000","last_became_active":"2024-04-25T02:09:26.706500+0000","last_became_peered":"2024-04-25T02:09:26.706500+0000","last_unstale":"2024-04-25T02:09:29.415861+0000","last_undegraded":"2024-04-25T02:09:29.415861+0000","last_fullsized":"2024-04-25T02:09:29.415861+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:56:17.990647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417486+0000","last_change":"2024-04-25T02:09:27.708259+0000","last_active":"2024-04-25T02:09:29.417486+0000","last_peered":"2024-04-25T02:09:29.417486+0000","last_clean":"2024-04-25T02:09:29.417486+0000","last_became_active":"2024-04-25T02:09:27.707987+0000","last_became_peered":"2024-04-25T02:09:27.707987+0000","last_unstale":"2024-04-25T02:09:29.417486+0000","last_undegraded":"2024-04-25T02:09:29.417486+0000","last_fullsized":"2024-04-25T02:09:29.417486+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:24.016640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708231+0000","last_change":"2024-04-25T02:09:26.706712+0000","last_active":"2024-04-25T02:09:28.708231+0000","last_peered":"2024-04-25T02:09:28.708231+0000","last_clean":"2024-04-25T02:09:28.708231+0000","last_became_active":"2024-04-25T02:09:26.706401+0000","last_became_peered":"2024-04-25T02:09:26.706401+0000","last_unstale":"2024-04-25T02:09:28.708231+0000","last_undegraded":"2024-04-25T02:09:28.708231+0000","last_fullsized":"2024-04-25T02:09:28.708231+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:43:04.701139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.418186+0000","last_change":"2024-04-25T02:09:27.712774+0000","last_active":"2024-04-25T02:09:29.418186+0000","last_peered":"2024-04-25T02:09:29.418186+0000","last_clean":"2024-04-25T02:09:29.418186+0000","last_became_active":"2024-04-25T02:09:27.712501+0000","last_became_peered":"2024-04-25T02:09:27.712501+0000","last_unstale":"2024-04-25T02:09:29.418186+0000","last_undegraded":"2024-04-25T02:09:29.418186+0000","last_fullsized":"2024-04-25T02:09:29.418186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:41:33.850548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416231+0000","last_change":"2024-04-25T02:09:26.702191+0000","last_active":"2024-04-25T02:09:29.416231+0000","last_peered":"2024-04-25T02:09:29.416231+0000","last_clean":"2024-04-25T02:09:29.416231+0000","last_became_active":"2024-04-25T02:09:26.701852+0000","last_became_peered":"2024-04-25T02:09:26.701852+0000","last_unstale":"2024-04-25T02:09:29.416231+0000","last_undegraded":"2024-04-25T02:09:29.416231+0000","last_fullsized":"2024-04-25T02:09:29.416231+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:34:14.848206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416183+0000","last_change":"2024-04-25T02:09:27.706109+0000","last_active":"2024-04-25T02:09:29.416183+0000","last_peered":"2024-04-25T02:09:29.416183+0000","last_clean":"2024-04-25T02:09:29.416183+0000","last_became_active":"2024-04-25T02:09:27.705742+0000","last_became_peered":"2024-04-25T02:09:27.705742+0000","last_unstale":"2024-04-25T02:09:29.416183+0000","last_undegraded":"2024-04-25T02:09:29.416183+0000","last_fullsized":"2024-04-25T02:09:29.416183+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:41.386426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417237+0000","last_change":"2024-04-25T02:09:26.702536+0000","last_active":"2024-04-25T02:09:29.417237+0000","last_peered":"2024-04-25T02:09:29.417237+0000","last_clean":"2024-04-25T02:09:29.417237+0000","last_became_active":"2024-04-25T02:09:26.702271+0000","last_became_peered":"2024-04-25T02:09:26.702271+0000","last_unstale":"2024-04-25T02:09:29.417237+0000","last_undegraded":"2024-04-25T02:09:29.417237+0000","last_fullsized":"2024-04-25T02:09:29.417237+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:40.382335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.707932+0000","last_change":"2024-04-25T02:09:27.707042+0000","last_active":"2024-04-25T02:09:28.707932+0000","last_peered":"2024-04-25T02:09:28.707932+0000","last_clean":"2024-04-25T02:09:28.707932+0000","last_became_active":"2024-04-25T02:09:27.706733+0000","last_became_peered":"2024-04-25T02:09:27.706733+0000","last_unstale":"2024-04-25T02:09:28.707932+0000","last_undegraded":"2024-04-25T02:09:28.707932+0000","last_fullsized":"2024-04-25T02:09:28.707932+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:56:18.994738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416029+0000","last_change":"2024-04-25T02:09:26.703640+0000","last_active":"2024-04-25T02:09:29.416029+0000","last_peered":"2024-04-25T02:09:29.416029+0000","last_clean":"2024-04-25T02:09:29.416029+0000","last_became_active":"2024-04-25T02:09:26.703395+0000","last_became_peered":"2024-04-25T02:09:26.703395+0000","last_unstale":"2024-04-25T02:09:29.416029+0000","last_undegraded":"2024-04-25T02:09:29.416029+0000","last_fullsized":"2024-04-25T02:09:29.416029+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:49.790449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708490+0000","last_change":"2024-04-25T02:09:27.706939+0000","last_active":"2024-04-25T02:09:28.708490+0000","last_peered":"2024-04-25T02:09:28.708490+0000","last_clean":"2024-04-25T02:09:28.708490+0000","last_became_active":"2024-04-25T02:09:27.706578+0000","last_became_peered":"2024-04-25T02:09:27.706578+0000","last_unstale":"2024-04-25T02:09:28.708490+0000","last_undegraded":"2024-04-25T02:09:28.708490+0000","last_fullsized":"2024-04-25T02:09:28.708490+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:50:53.392078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708022+0000","last_change":"2024-04-25T02:09:26.701259+0000","last_active":"2024-04-25T02:09:28.708022+0000","last_peered":"2024-04-25T02:09:28.708022+0000","last_clean":"2024-04-25T02:09:28.708022+0000","last_became_active":"2024-04-25T02:09:26.700957+0000","last_became_peered":"2024-04-25T02:09:26.700957+0000","last_unstale":"2024-04-25T02:09:28.708022+0000","last_undegraded":"2024-04-25T02:09:28.708022+0000","last_fullsized":"2024-04-25T02:09:28.708022+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:34:14.848206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708132+0000","last_change":"2024-04-25T02:09:27.707196+0000","last_active":"2024-04-25T02:09:28.708132+0000","last_peered":"2024-04-25T02:09:28.708132+0000","last_clean":"2024-04-25T02:09:28.708132+0000","last_became_active":"2024-04-25T02:09:27.706605+0000","last_became_peered":"2024-04-25T02:09:27.706605+0000","last_unstale":"2024-04-25T02:09:28.708132+0000","last_undegraded":"2024-04-25T02:09:28.708132+0000","last_fullsized":"2024-04-25T02:09:28.708132+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:26.667539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416416+0000","last_change":"2024-04-25T02:09:26.700375+0000","last_active":"2024-04-25T02:09:29.416416+0000","last_peered":"2024-04-25T02:09:29.416416+0000","last_clean":"2024-04-25T02:09:29.416416+0000","last_became_active":"2024-04-25T02:09:26.700046+0000","last_became_peered":"2024-04-25T02:09:26.700046+0000","last_unstale":"2024-04-25T02:09:29.416416+0000","last_undegraded":"2024-04-25T02:09:29.416416+0000","last_fullsized":"2024-04-25T02:09:29.416416+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:40.382335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416725+0000","last_change":"2024-04-25T02:09:27.716659+0000","last_active":"2024-04-25T02:09:29.416725+0000","last_peered":"2024-04-25T02:09:29.416725+0000","last_clean":"2024-04-25T02:09:29.416725+0000","last_became_active":"2024-04-25T02:09:27.716391+0000","last_became_peered":"2024-04-25T02:09:27.716391+0000","last_unstale":"2024-04-25T02:09:29.416725+0000","last_undegraded":"2024-04-25T02:09:29.416725+0000","last_fullsized":"2024-04-25T02:09:29.416725+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:49.075835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708253+0000","last_change":"2024-04-25T02:09:26.695610+0000","last_active":"2024-04-25T02:09:28.708253+0000","last_peered":"2024-04-25T02:09:28.708253+0000","last_clean":"2024-04-25T02:09:28.708253+0000","last_became_active":"2024-04-25T02:09:26.695353+0000","last_became_peered":"2024-04-25T02:09:26.695353+0000","last_unstale":"2024-04-25T02:09:28.708253+0000","last_undegraded":"2024-04-25T02:09:28.708253+0000","last_fullsized":"2024-04-25T02:09:28.708253+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:43:04.701139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708416+0000","last_change":"2024-04-25T02:09:27.712820+0000","last_active":"2024-04-25T02:09:28.708416+0000","last_peered":"2024-04-25T02:09:28.708416+0000","last_clean":"2024-04-25T02:09:28.708416+0000","last_became_active":"2024-04-25T02:09:27.712234+0000","last_became_peered":"2024-04-25T02:09:27.712234+0000","last_unstale":"2024-04-25T02:09:28.708416+0000","last_undegraded":"2024-04-25T02:09:28.708416+0000","last_fullsized":"2024-04-25T02:09:28.708416+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:41:33.850548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708320+0000","last_change":"2024-04-25T02:09:26.698190+0000","last_active":"2024-04-25T02:09:28.708320+0000","last_peered":"2024-04-25T02:09:28.708320+0000","last_clean":"2024-04-25T02:09:28.708320+0000","last_became_active":"2024-04-25T02:09:26.697837+0000","last_became_peered":"2024-04-25T02:09:26.697837+0000","last_unstale":"2024-04-25T02:09:28.708320+0000","last_undegraded":"2024-04-25T02:09:28.708320+0000","last_fullsized":"2024-04-25T02:09:28.708320+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:48.071744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417451+0000","last_change":"2024-04-25T02:09:27.716138+0000","last_active":"2024-04-25T02:09:29.417451+0000","last_peered":"2024-04-25T02:09:29.417451+0000","last_clean":"2024-04-25T02:09:29.417451+0000","last_became_active":"2024-04-25T02:09:27.715825+0000","last_became_peered":"2024-04-25T02:09:27.715825+0000","last_unstale":"2024-04-25T02:09:29.417451+0000","last_undegraded":"2024-04-25T02:09:29.417451+0000","last_fullsized":"2024-04-25T02:09:29.417451+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:16:25.645085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708539+0000","last_change":"2024-04-25T02:09:26.702889+0000","last_active":"2024-04-25T02:09:28.708539+0000","last_peered":"2024-04-25T02:09:28.708539+0000","last_clean":"2024-04-25T02:09:28.708539+0000","last_became_active":"2024-04-25T02:09:26.702618+0000","last_became_peered":"2024-04-25T02:09:26.702618+0000","last_unstale":"2024-04-25T02:09:28.708539+0000","last_undegraded":"2024-04-25T02:09:28.708539+0000","last_fullsized":"2024-04-25T02:09:28.708539+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:32.472585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416388+0000","last_change":"2024-04-25T02:09:27.717476+0000","last_active":"2024-04-25T02:09:29.416388+0000","last_peered":"2024-04-25T02:09:29.416388+0000","last_clean":"2024-04-25T02:09:29.416388+0000","last_became_active":"2024-04-25T02:09:27.717203+0000","last_became_peered":"2024-04-25T02:09:27.717203+0000","last_unstale":"2024-04-25T02:09:29.416388+0000","last_undegraded":"2024-04-25T02:09:29.416388+0000","last_fullsized":"2024-04-25T02:09:29.416388+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:29.957985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417604+0000","last_change":"2024-04-25T02:09:26.707034+0000","last_active":"2024-04-25T02:09:29.417604+0000","last_peered":"2024-04-25T02:09:29.417604+0000","last_clean":"2024-04-25T02:09:29.417604+0000","last_became_active":"2024-04-25T02:09:26.706706+0000","last_became_peered":"2024-04-25T02:09:26.706706+0000","last_unstale":"2024-04-25T02:09:29.417604+0000","last_undegraded":"2024-04-25T02:09:29.417604+0000","last_fullsized":"2024-04-25T02:09:29.417604+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:53.639255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417595+0000","last_change":"2024-04-25T02:09:27.714853+0000","last_active":"2024-04-25T02:09:29.417595+0000","last_peered":"2024-04-25T02:09:29.417595+0000","last_clean":"2024-04-25T02:09:29.417595+0000","last_became_active":"2024-04-25T02:09:27.714568+0000","last_became_peered":"2024-04-25T02:09:27.714568+0000","last_unstale":"2024-04-25T02:09:29.417595+0000","last_undegraded":"2024-04-25T02:09:29.417595+0000","last_fullsized":"2024-04-25T02:09:29.417595+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:50:53.392078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.707064+0000","last_change":"2024-04-25T02:09:26.695178+0000","last_active":"2024-04-25T02:09:28.707064+0000","last_peered":"2024-04-25T02:09:28.707064+0000","last_clean":"2024-04-25T02:09:28.707064+0000","last_became_active":"2024-04-25T02:09:26.694909+0000","last_became_peered":"2024-04-25T02:09:26.694909+0000","last_unstale":"2024-04-25T02:09:28.707064+0000","last_undegraded":"2024-04-25T02:09:28.707064+0000","last_fullsized":"2024-04-25T02:09:28.707064+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:33.138716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416671+0000","last_change":"2024-04-25T02:09:27.704620+0000","last_active":"2024-04-25T02:09:29.416671+0000","last_peered":"2024-04-25T02:09:29.416671+0000","last_clean":"2024-04-25T02:09:29.416671+0000","last_became_active":"2024-04-25T02:09:27.704357+0000","last_became_peered":"2024-04-25T02:09:27.704357+0000","last_unstale":"2024-04-25T02:09:29.416671+0000","last_undegraded":"2024-04-25T02:09:29.416671+0000","last_fullsized":"2024-04-25T02:09:29.416671+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:20.505752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416093+0000","last_change":"2024-04-25T02:09:26.698938+0000","last_active":"2024-04-25T02:09:29.416093+0000","last_peered":"2024-04-25T02:09:29.416093+0000","last_clean":"2024-04-25T02:09:29.416093+0000","last_became_active":"2024-04-25T02:09:26.698215+0000","last_became_peered":"2024-04-25T02:09:26.698215+0000","last_unstale":"2024-04-25T02:09:29.416093+0000","last_undegraded":"2024-04-25T02:09:29.416093+0000","last_fullsized":"2024-04-25T02:09:29.416093+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:25.663448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708567+0000","last_change":"2024-04-25T02:09:27.716794+0000","last_active":"2024-04-25T02:09:28.708567+0000","last_peered":"2024-04-25T02:09:28.708567+0000","last_clean":"2024-04-25T02:09:28.708567+0000","last_became_active":"2024-04-25T02:09:27.716541+0000","last_became_peered":"2024-04-25T02:09:27.716541+0000","last_unstale":"2024-04-25T02:09:28.708567+0000","last_undegraded":"2024-04-25T02:09:28.708567+0000","last_fullsized":"2024-04-25T02:09:28.708567+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:55.279706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416740+0000","last_change":"2024-04-25T02:09:26.701842+0000","last_active":"2024-04-25T02:09:29.416740+0000","last_peered":"2024-04-25T02:09:29.416740+0000","last_clean":"2024-04-25T02:09:29.416740+0000","last_became_active":"2024-04-25T02:09:26.701559+0000","last_became_peered":"2024-04-25T02:09:26.701559+0000","last_unstale":"2024-04-25T02:09:29.416740+0000","last_undegraded":"2024-04-25T02:09:29.416740+0000","last_fullsized":"2024-04-25T02:09:29.416740+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:09.933987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.415615+0000","last_change":"2024-04-25T02:09:27.708126+0000","last_active":"2024-04-25T02:09:29.415615+0000","last_peered":"2024-04-25T02:09:29.415615+0000","last_clean":"2024-04-25T02:09:29.415615+0000","last_became_active":"2024-04-25T02:09:27.707710+0000","last_became_peered":"2024-04-25T02:09:27.707710+0000","last_unstale":"2024-04-25T02:09:29.415615+0000","last_undegraded":"2024-04-25T02:09:29.415615+0000","last_fullsized":"2024-04-25T02:09:29.415615+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:28.543214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.415758+0000","last_change":"2024-04-25T02:09:26.698408+0000","last_active":"2024-04-25T02:09:29.415758+0000","last_peered":"2024-04-25T02:09:29.415758+0000","last_clean":"2024-04-25T02:09:29.415758+0000","last_became_active":"2024-04-25T02:09:26.698145+0000","last_became_peered":"2024-04-25T02:09:26.698145+0000","last_unstale":"2024-04-25T02:09:29.415758+0000","last_undegraded":"2024-04-25T02:09:29.415758+0000","last_fullsized":"2024-04-25T02:09:29.415758+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:50:39.197752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417131+0000","last_change":"2024-04-25T02:09:27.720005+0000","last_active":"2024-04-25T02:09:29.417131+0000","last_peered":"2024-04-25T02:09:29.417131+0000","last_clean":"2024-04-25T02:09:29.417131+0000","last_became_active":"2024-04-25T02:09:27.719239+0000","last_became_peered":"2024-04-25T02:09:27.719239+0000","last_unstale":"2024-04-25T02:09:29.417131+0000","last_undegraded":"2024-04-25T02:09:29.417131+0000","last_fullsized":"2024-04-25T02:09:29.417131+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:41:33.850548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708364+0000","last_change":"2024-04-25T02:09:26.699499+0000","last_active":"2024-04-25T02:09:28.708364+0000","last_peered":"2024-04-25T02:09:28.708364+0000","last_clean":"2024-04-25T02:09:28.708364+0000","last_became_active":"2024-04-25T02:09:26.699220+0000","last_became_peered":"2024-04-25T02:09:26.699220+0000","last_unstale":"2024-04-25T02:09:28.708364+0000","last_undegraded":"2024-04-25T02:09:28.708364+0000","last_fullsized":"2024-04-25T02:09:28.708364+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:31:12.215479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.707214+0000","last_change":"2024-04-25T02:09:27.704476+0000","last_active":"2024-04-25T02:09:28.707214+0000","last_peered":"2024-04-25T02:09:28.707214+0000","last_clean":"2024-04-25T02:09:28.707214+0000","last_became_active":"2024-04-25T02:09:27.704187+0000","last_became_peered":"2024-04-25T02:09:27.704187+0000","last_unstale":"2024-04-25T02:09:28.707214+0000","last_undegraded":"2024-04-25T02:09:28.707214+0000","last_fullsized":"2024-04-25T02:09:28.707214+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:28:14.449681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.707262+0000","last_change":"2024-04-25T02:09:26.701476+0000","last_active":"2024-04-25T02:09:28.707262+0000","last_peered":"2024-04-25T02:09:28.707262+0000","last_clean":"2024-04-25T02:09:28.707262+0000","last_became_active":"2024-04-25T02:09:26.701188+0000","last_became_peered":"2024-04-25T02:09:26.701188+0000","last_unstale":"2024-04-25T02:09:28.707262+0000","last_undegraded":"2024-04-25T02:09:28.707262+0000","last_fullsized":"2024-04-25T02:09:28.707262+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:38.754730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708399+0000","last_change":"2024-04-25T02:09:27.712228+0000","last_active":"2024-04-25T02:09:28.708399+0000","last_peered":"2024-04-25T02:09:28.708399+0000","last_clean":"2024-04-25T02:09:28.708399+0000","last_became_active":"2024-04-25T02:09:27.711962+0000","last_became_peered":"2024-04-25T02:09:27.711962+0000","last_unstale":"2024-04-25T02:09:28.708399+0000","last_undegraded":"2024-04-25T02:09:28.708399+0000","last_fullsized":"2024-04-25T02:09:28.708399+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:16:25.645085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708343+0000","last_change":"2024-04-25T02:09:26.694249+0000","last_active":"2024-04-25T02:09:28.708343+0000","last_peered":"2024-04-25T02:09:28.708343+0000","last_clean":"2024-04-25T02:09:28.708343+0000","last_became_active":"2024-04-25T02:09:26.693645+0000","last_became_peered":"2024-04-25T02:09:26.693645+0000","last_unstale":"2024-04-25T02:09:28.708343+0000","last_undegraded":"2024-04-25T02:09:28.708343+0000","last_fullsized":"2024-04-25T02:09:28.708343+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:55.793704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417318+0000","last_change":"2024-04-25T02:09:27.710645+0000","last_active":"2024-04-25T02:09:29.417318+0000","last_peered":"2024-04-25T02:09:29.417318+0000","last_clean":"2024-04-25T02:09:29.417318+0000","last_became_active":"2024-04-25T02:09:27.710331+0000","last_became_peered":"2024-04-25T02:09:27.710331+0000","last_unstale":"2024-04-25T02:09:29.417318+0000","last_undegraded":"2024-04-25T02:09:29.417318+0000","last_fullsized":"2024-04-25T02:09:29.417318+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:54.643345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417761+0000","last_change":"2024-04-25T02:09:26.701144+0000","last_active":"2024-04-25T02:09:29.417761+0000","last_peered":"2024-04-25T02:09:29.417761+0000","last_clean":"2024-04-25T02:09:29.417761+0000","last_became_active":"2024-04-25T02:09:26.700839+0000","last_became_peered":"2024-04-25T02:09:26.700839+0000","last_unstale":"2024-04-25T02:09:29.417761+0000","last_undegraded":"2024-04-25T02:09:29.417761+0000","last_fullsized":"2024-04-25T02:09:29.417761+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:29.685094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417181+0000","last_change":"2024-04-25T02:09:27.709135+0000","last_active":"2024-04-25T02:09:29.417181+0000","last_peered":"2024-04-25T02:09:29.417181+0000","last_clean":"2024-04-25T02:09:29.417181+0000","last_became_active":"2024-04-25T02:09:27.708822+0000","last_became_peered":"2024-04-25T02:09:27.708822+0000","last_unstale":"2024-04-25T02:09:29.417181+0000","last_undegraded":"2024-04-25T02:09:29.417181+0000","last_fullsized":"2024-04-25T02:09:29.417181+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:41.386426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416348+0000","last_change":"2024-04-25T02:09:26.707111+0000","last_active":"2024-04-25T02:09:29.416348+0000","last_peered":"2024-04-25T02:09:29.416348+0000","last_clean":"2024-04-25T02:09:29.416348+0000","last_became_active":"2024-04-25T02:09:26.706823+0000","last_became_peered":"2024-04-25T02:09:26.706823+0000","last_unstale":"2024-04-25T02:09:29.416348+0000","last_undegraded":"2024-04-25T02:09:29.416348+0000","last_fullsized":"2024-04-25T02:09:29.416348+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:28.879077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416135+0000","last_change":"2024-04-25T02:09:27.713147+0000","last_active":"2024-04-25T02:09:29.416135+0000","last_peered":"2024-04-25T02:09:29.416135+0000","last_clean":"2024-04-25T02:09:29.416135+0000","last_became_active":"2024-04-25T02:09:27.712883+0000","last_became_peered":"2024-04-25T02:09:27.712883+0000","last_unstale":"2024-04-25T02:09:29.416135+0000","last_undegraded":"2024-04-25T02:09:29.416135+0000","last_fullsized":"2024-04-25T02:09:29.416135+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:44.214603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416185+0000","last_change":"2024-04-25T02:09:26.703147+0000","last_active":"2024-04-25T02:09:29.416185+0000","last_peered":"2024-04-25T02:09:29.416185+0000","last_clean":"2024-04-25T02:09:29.416185+0000","last_became_active":"2024-04-25T02:09:26.702879+0000","last_became_peered":"2024-04-25T02:09:26.702879+0000","last_unstale":"2024-04-25T02:09:29.416185+0000","last_undegraded":"2024-04-25T02:09:29.416185+0000","last_fullsized":"2024-04-25T02:09:29.416185+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:14:08.842326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.415842+0000","last_change":"2024-04-25T02:09:27.705581+0000","last_active":"2024-04-25T02:09:29.415842+0000","last_peered":"2024-04-25T02:09:29.415842+0000","last_clean":"2024-04-25T02:09:29.415842+0000","last_became_active":"2024-04-25T02:09:27.705316+0000","last_became_peered":"2024-04-25T02:09:27.705316+0000","last_unstale":"2024-04-25T02:09:29.415842+0000","last_undegraded":"2024-04-25T02:09:29.415842+0000","last_fullsized":"2024-04-25T02:09:29.415842+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:30.689185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417641+0000","last_change":"2024-04-25T02:09:26.706942+0000","last_active":"2024-04-25T02:09:29.417641+0000","last_peered":"2024-04-25T02:09:29.417641+0000","last_clean":"2024-04-25T02:09:29.417641+0000","last_became_active":"2024-04-25T02:09:26.706520+0000","last_became_peered":"2024-04-25T02:09:26.706520+0000","last_unstale":"2024-04-25T02:09:29.417641+0000","last_undegraded":"2024-04-25T02:09:29.417641+0000","last_fullsized":"2024-04-25T02:09:29.417641+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:44.112739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.706936+0000","last_change":"2024-04-25T02:09:27.718993+0000","last_active":"2024-04-25T02:09:28.706936+0000","last_peered":"2024-04-25T02:09:28.706936+0000","last_clean":"2024-04-25T02:09:28.706936+0000","last_became_active":"2024-04-25T02:09:27.718699+0000","last_became_peered":"2024-04-25T02:09:27.718699+0000","last_unstale":"2024-04-25T02:09:28.706936+0000","last_undegraded":"2024-04-25T02:09:28.706936+0000","last_fullsized":"2024-04-25T02:09:28.706936+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:08:59.642595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708096+0000","last_change":"2024-04-25T02:09:26.701468+0000","last_active":"2024-04-25T02:09:28.708096+0000","last_peered":"2024-04-25T02:09:28.708096+0000","last_clean":"2024-04-25T02:09:28.708096+0000","last_became_active":"2024-04-25T02:09:26.701190+0000","last_became_peered":"2024-04-25T02:09:26.701190+0000","last_unstale":"2024-04-25T02:09:28.708096+0000","last_undegraded":"2024-04-25T02:09:28.708096+0000","last_fullsized":"2024-04-25T02:09:28.708096+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:30.949248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708139+0000","last_change":"2024-04-25T02:09:27.709387+0000","last_active":"2024-04-25T02:09:28.708139+0000","last_peered":"2024-04-25T02:09:28.708139+0000","last_clean":"2024-04-25T02:09:28.708139+0000","last_became_active":"2024-04-25T02:09:27.709098+0000","last_became_peered":"2024-04-25T02:09:27.709098+0000","last_unstale":"2024-04-25T02:09:28.708139+0000","last_undegraded":"2024-04-25T02:09:28.708139+0000","last_fullsized":"2024-04-25T02:09:28.708139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:29.883168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417564+0000","last_change":"2024-04-25T02:09:26.702178+0000","last_active":"2024-04-25T02:09:29.417564+0000","last_peered":"2024-04-25T02:09:29.417564+0000","last_clean":"2024-04-25T02:09:29.417564+0000","last_became_active":"2024-04-25T02:09:26.701885+0000","last_became_peered":"2024-04-25T02:09:26.701885+0000","last_unstale":"2024-04-25T02:09:29.417564+0000","last_undegraded":"2024-04-25T02:09:29.417564+0000","last_fullsized":"2024-04-25T02:09:29.417564+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:59.937572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417576+0000","last_change":"2024-04-25T02:09:27.710439+0000","last_active":"2024-04-25T02:09:29.417576+0000","last_peered":"2024-04-25T02:09:29.417576+0000","last_clean":"2024-04-25T02:09:29.417576+0000","last_became_active":"2024-04-25T02:09:27.709681+0000","last_became_peered":"2024-04-25T02:09:27.709681+0000","last_unstale":"2024-04-25T02:09:29.417576+0000","last_undegraded":"2024-04-25T02:09:29.417576+0000","last_fullsized":"2024-04-25T02:09:29.417576+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:50.794539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.415958+0000","last_change":"2024-04-25T02:09:26.706540+0000","last_active":"2024-04-25T02:09:29.415958+0000","last_peered":"2024-04-25T02:09:29.415958+0000","last_clean":"2024-04-25T02:09:29.415958+0000","last_became_active":"2024-04-25T02:09:26.706254+0000","last_became_peered":"2024-04-25T02:09:26.706254+0000","last_unstale":"2024-04-25T02:09:29.415958+0000","last_undegraded":"2024-04-25T02:09:29.415958+0000","last_fullsized":"2024-04-25T02:09:29.415958+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:12:31.124159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708474+0000","last_change":"2024-04-25T02:09:27.708675+0000","last_active":"2024-04-25T02:09:28.708474+0000","last_peered":"2024-04-25T02:09:28.708474+0000","last_clean":"2024-04-25T02:09:28.708474+0000","last_became_active":"2024-04-25T02:09:27.708397+0000","last_became_peered":"2024-04-25T02:09:27.708397+0000","last_unstale":"2024-04-25T02:09:28.708474+0000","last_undegraded":"2024-04-25T02:09:28.708474+0000","last_fullsized":"2024-04-25T02:09:28.708474+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:08:50.006625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417658+0000","last_change":"2024-04-25T02:09:26.707671+0000","last_active":"2024-04-25T02:09:29.417658+0000","last_peered":"2024-04-25T02:09:29.417658+0000","last_clean":"2024-04-25T02:09:29.417658+0000","last_became_active":"2024-04-25T02:09:26.707421+0000","last_became_peered":"2024-04-25T02:09:26.707421+0000","last_unstale":"2024-04-25T02:09:29.417658+0000","last_undegraded":"2024-04-25T02:09:29.417658+0000","last_fullsized":"2024-04-25T02:09:29.417658+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:07.400120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417533+0000","last_change":"2024-04-25T02:09:27.714929+0000","last_active":"2024-04-25T02:09:29.417533+0000","last_peered":"2024-04-25T02:09:29.417533+0000","last_clean":"2024-04-25T02:09:29.417533+0000","last_became_active":"2024-04-25T02:09:27.714601+0000","last_became_peered":"2024-04-25T02:09:27.714601+0000","last_unstale":"2024-04-25T02:09:29.417533+0000","last_undegraded":"2024-04-25T02:09:29.417533+0000","last_fullsized":"2024-04-25T02:09:29.417533+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:08:50.006625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416154+0000","last_change":"2024-04-25T02:09:26.701369+0000","last_active":"2024-04-25T02:09:29.416154+0000","last_peered":"2024-04-25T02:09:29.416154+0000","last_clean":"2024-04-25T02:09:29.416154+0000","last_became_active":"2024-04-25T02:09:26.701072+0000","last_became_peered":"2024-04-25T02:09:26.701072+0000","last_unstale":"2024-04-25T02:09:29.416154+0000","last_undegraded":"2024-04-25T02:09:29.416154+0000","last_fullsized":"2024-04-25T02:09:29.416154+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:33:58.939695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416186+0000","last_change":"2024-04-25T02:09:27.713096+0000","last_active":"2024-04-25T02:09:29.416186+0000","last_peered":"2024-04-25T02:09:29.416186+0000","last_clean":"2024-04-25T02:09:29.416186+0000","last_became_active":"2024-04-25T02:09:27.712539+0000","last_became_peered":"2024-04-25T02:09:27.712539+0000","last_unstale":"2024-04-25T02:09:29.416186+0000","last_undegraded":"2024-04-25T02:09:29.416186+0000","last_fullsized":"2024-04-25T02:09:29.416186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:37.047827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417364+0000","last_change":"2024-04-25T02:09:26.706836+0000","last_active":"2024-04-25T02:09:29.417364+0000","last_peered":"2024-04-25T02:09:29.417364+0000","last_clean":"2024-04-25T02:09:29.417364+0000","last_became_active":"2024-04-25T02:09:26.706588+0000","last_became_peered":"2024-04-25T02:09:26.706588+0000","last_unstale":"2024-04-25T02:09:29.417364+0000","last_undegraded":"2024-04-25T02:09:29.417364+0000","last_fullsized":"2024-04-25T02:09:29.417364+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:23.012549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.415980+0000","last_change":"2024-04-25T02:09:27.721661+0000","last_active":"2024-04-25T02:09:29.415980+0000","last_peered":"2024-04-25T02:09:29.415980+0000","last_clean":"2024-04-25T02:09:29.415980+0000","last_became_active":"2024-04-25T02:09:27.721299+0000","last_became_peered":"2024-04-25T02:09:27.721299+0000","last_unstale":"2024-04-25T02:09:29.415980+0000","last_undegraded":"2024-04-25T02:09:29.415980+0000","last_fullsized":"2024-04-25T02:09:29.415980+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:58.660750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708111+0000","last_change":"2024-04-25T02:09:26.699678+0000","last_active":"2024-04-25T02:09:28.708111+0000","last_peered":"2024-04-25T02:09:28.708111+0000","last_clean":"2024-04-25T02:09:28.708111+0000","last_became_active":"2024-04-25T02:09:26.699294+0000","last_became_peered":"2024-04-25T02:09:26.699294+0000","last_unstale":"2024-04-25T02:09:28.708111+0000","last_undegraded":"2024-04-25T02:09:28.708111+0000","last_fullsized":"2024-04-25T02:09:28.708111+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:19.501662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.416414+0000","last_change":"2024-04-25T02:09:27.708825+0000","last_active":"2024-04-25T02:09:29.416414+0000","last_peered":"2024-04-25T02:09:29.416414+0000","last_clean":"2024-04-25T02:09:29.416414+0000","last_became_active":"2024-04-25T02:09:27.708558+0000","last_became_peered":"2024-04-25T02:09:27.708558+0000","last_unstale":"2024-04-25T02:09:29.416414+0000","last_undegraded":"2024-04-25T02:09:29.416414+0000","last_fullsized":"2024-04-25T02:09:29.416414+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:26.667539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.415618+0000","last_change":"2024-04-25T02:09:26.706614+0000","last_active":"2024-04-25T02:09:29.415618+0000","last_peered":"2024-04-25T02:09:29.415618+0000","last_clean":"2024-04-25T02:09:29.415618+0000","last_became_active":"2024-04-25T02:09:26.706353+0000","last_became_peered":"2024-04-25T02:09:26.706353+0000","last_unstale":"2024-04-25T02:09:29.415618+0000","last_undegraded":"2024-04-25T02:09:29.415618+0000","last_fullsized":"2024-04-25T02:09:29.415618+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:43:04.701139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.707916+0000","last_change":"2024-04-25T02:09:27.711788+0000","last_active":"2024-04-25T02:09:28.707916+0000","last_peered":"2024-04-25T02:09:28.707916+0000","last_clean":"2024-04-25T02:09:28.707916+0000","last_became_active":"2024-04-25T02:09:27.711454+0000","last_became_peered":"2024-04-25T02:09:27.711454+0000","last_unstale":"2024-04-25T02:09:28.707916+0000","last_undegraded":"2024-04-25T02:09:28.707916+0000","last_fullsized":"2024-04-25T02:09:28.707916+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:50.794539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708428+0000","last_change":"2024-04-25T02:09:26.698265+0000","last_active":"2024-04-25T02:09:28.708428+0000","last_peered":"2024-04-25T02:09:28.708428+0000","last_clean":"2024-04-25T02:09:28.708428+0000","last_became_active":"2024-04-25T02:09:26.698005+0000","last_became_peered":"2024-04-25T02:09:26.698005+0000","last_unstale":"2024-04-25T02:09:28.708428+0000","last_undegraded":"2024-04-25T02:09:28.708428+0000","last_fullsized":"2024-04-25T02:09:28.708428+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:33:58.939695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:28.708578+0000","last_change":"2024-04-25T02:09:27.716207+0000","last_active":"2024-04-25T02:09:28.708578+0000","last_peered":"2024-04-25T02:09:28.708578+0000","last_clean":"2024-04-25T02:09:28.708578+0000","last_became_active":"2024-04-25T02:09:27.715940+0000","last_became_peered":"2024-04-25T02:09:27.715940+0000","last_unstale":"2024-04-25T02:09:28.708578+0000","last_undegraded":"2024-04-25T02:09:28.708578+0000","last_fullsized":"2024-04-25T02:09:28.708578+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:26.680258+0000","last_clean_scrub_stamp":"2024-04-25T02:09:26.680258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:41:00.188476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417991+0000","last_change":"2024-04-25T02:09:26.700831+0000","last_active":"2024-04-25T02:09:29.417991+0000","last_peered":"2024-04-25T02:09:29.417991+0000","last_clean":"2024-04-25T02:09:29.417991+0000","last_became_active":"2024-04-25T02:09:26.700524+0000","last_became_peered":"2024-04-25T02:09:26.700524+0000","last_unstale":"2024-04-25T02:09:29.417991+0000","last_undegraded":"2024-04-25T02:09:29.417991+0000","last_fullsized":"2024-04-25T02:09:29.417991+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:25.676168+0000","last_clean_scrub_stamp":"2024-04-25T02:09:25.676168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:59.937572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":213,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T02:09:29.417672+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:09:29.417672+0000","last_peered":"2024-04-25T02:09:29.417672+0000","last_clean":"2024-04-25T02:09:29.417672+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:09:29.417672+0000","last_undegraded":"2024-04-25T02:09:29.417672+0000","last_fullsized":"2024-04-25T02:09:29.417672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1126400,"data_stored":803393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":213607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":213005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":214547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":540672,"data_stored":213573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":544768,"data_stored":214569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":213005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1126400,"data_stored":803337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:09:35.359 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T02:09:35.359 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T02:09:35.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.491+0000 7fedfff42640 1 Processor -- start 2024-04-25T02:09:35.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.491+0000 7fedfff42640 1 -- start start 2024-04-25T02:09:35.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfff42640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fedf806b2f0 0x7fedf80b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfff42640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fedf806e6b0 0x7fedf815b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfff42640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf815ec20 con 0x7fedf80cf7a0 2024-04-25T02:09:35.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfff42640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fedf815f830 con 0x7fedf806e6b0 2024-04-25T02:09:35.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfff42640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fedf815ef00 con 0x7fedf806b2f0 2024-04-25T02:09:35.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfd4dd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fedf80cf7a0 0x7fedf806b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42454/0 (socket says 172.21.15.79:42454) 2024-04-25T02:09:35.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfd4dd640 1 -- 172.21.15.79:0/4281626715 learned_addr learned my addr 172.21.15.79:0/4281626715 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:35.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfccdc640 1 -- 172.21.15.79:0/4281626715 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188135011 0 0) 0x7fedf815ec20 con 0x7fedf80cf7a0 2024-04-25T02:09:35.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfccdc640 1 -- 172.21.15.79:0/4281626715 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede4003520 con 0x7fedf80cf7a0 2024-04-25T02:09:35.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfe4df640 1 --2- 172.21.15.79:0/4281626715 >> v2:172.21.15.189:3300/0 conn(0x7fedf806e6b0 0x7fedf815b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfdcde640 1 --2- 172.21.15.79:0/4281626715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fedf806b2f0 0x7fedf80b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfccdc640 1 -- 172.21.15.79:0/4281626715 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3297844057 0 0) 0x7fede4003520 con 0x7fedf80cf7a0 2024-04-25T02:09:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfccdc640 1 -- 172.21.15.79:0/4281626715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fedf806b2f0 msgr2=0x7fedf80b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfccdc640 1 --2- 172.21.15.79:0/4281626715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fedf806b2f0 0x7fedf80b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfccdc640 1 -- 172.21.15.79:0/4281626715 >> v2:172.21.15.189:3300/0 conn(0x7fedf806e6b0 msgr2=0x7fedf815b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfccdc640 1 --2- 172.21.15.79:0/4281626715 >> v2:172.21.15.189:3300/0 conn(0x7fedf806e6b0 0x7fedf815b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfccdc640 1 -- 172.21.15.79:0/4281626715 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf815f1e0 con 0x7fedf80cf7a0 2024-04-25T02:09:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfccdc640 1 -- 172.21.15.79:0/4281626715 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fede8001670 con 0x7fedf80cf7a0 2024-04-25T02:09:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfe4df640 1 --2- 172.21.15.79:0/4281626715 >> v2:172.21.15.189:3300/0 conn(0x7fedf806e6b0 0x7fedf815b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfccdc640 1 -- 172.21.15.79:0/4281626715 >> v1:172.21.15.79:6789/0 conn(0x7fedf80cf7a0 legacy=0x7fedf806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfccdc640 1 --2- 172.21.15.79:0/4281626715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fedf806b2f0 0x7fede40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.492+0000 7fedfccdc640 1 --2- 172.21.15.79:0/4281626715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede4003fe0 0x7fede4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.493+0000 7fedfccdc640 1 --2- 172.21.15.79:0/4281626715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fede4004d40 0x7fede40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.493+0000 7fedfccdc640 1 -- 172.21.15.79:0/4281626715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fedf815f830 con 0x7fede4003fe0 2024-04-25T02:09:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.493+0000 7fedfccdc640 1 -- 172.21.15.79:0/4281626715 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fedf815ef00 con 0x7fede4004d40 2024-04-25T02:09:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.493+0000 7fedfccdc640 1 -- 172.21.15.79:0/4281626715 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fede400bb80 con 0x7fedf806b2f0 2024-04-25T02:09:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.493+0000 7fedfd4dd640 1 --2- 172.21.15.79:0/4281626715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede4003fe0 0x7fede4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.493+0000 7fedfdcde640 1 --2- 172.21.15.79:0/4281626715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fedf806b2f0 0x7fede40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.493+0000 7fedfe4df640 1 --2- 172.21.15.79:0/4281626715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fede4004d40 0x7fede40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.493+0000 7fedfd4dd640 1 -- 172.21.15.79:0/4281626715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fedf806b2f0 msgr2=0x7fede40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.493+0000 7fedfd4dd640 1 --2- 172.21.15.79:0/4281626715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fedf806b2f0 0x7fede40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.493+0000 7fedfd4dd640 1 -- 172.21.15.79:0/4281626715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fede4004d40 msgr2=0x7fede40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.493+0000 7fedfd4dd640 1 --2- 172.21.15.79:0/4281626715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fede4004d40 0x7fede40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.493+0000 7fedfd4dd640 1 -- 172.21.15.79:0/4281626715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede4003520 con 0x7fede4003fe0 2024-04-25T02:09:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.493+0000 7fedfe4df640 1 --2- 172.21.15.79:0/4281626715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fede4004d40 0x7fede40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.494+0000 7fedfd4dd640 1 --2- 172.21.15.79:0/4281626715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede4003fe0 0x7fede4004800 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fede8007fd0 tx=0x7fede4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8406bcb79c86c683 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.494+0000 7fedfccdc640 1 -- 172.21.15.79:0/4281626715 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8007d50 con 0x7fede4003fe0 2024-04-25T02:09:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.494+0000 7fedfccdc640 1 -- 172.21.15.79:0/4281626715 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede8005ad0 con 0x7fede4003fe0 2024-04-25T02:09:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.494+0000 7fedfccdc640 1 -- 172.21.15.79:0/4281626715 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8007070 con 0x7fede4003fe0 2024-04-25T02:09:35.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.494+0000 7fedfff42640 1 -- 172.21.15.79:0/4281626715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede4003fe0 msgr2=0x7fede4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.494+0000 7fedfff42640 1 --2- 172.21.15.79:0/4281626715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede4003fe0 0x7fede4004800 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fede8007fd0 tx=0x7fede4005830 comp rx=0 tx=0).stop 2024-04-25T02:09:35.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.494+0000 7fedfe4df640 1 -- 172.21.15.79:0/4281626715 reap_dead start 2024-04-25T02:09:35.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.494+0000 7fedfff42640 1 -- 172.21.15.79:0/4281626715 shutdown_connections 2024-04-25T02:09:35.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.494+0000 7fedfff42640 1 -- 172.21.15.79:0/4281626715 >> 172.21.15.79:0/4281626715 conn(0x7fedf80b1cd0 msgr2=0x7fedf80b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:35.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.494+0000 7fedfff42640 1 -- 172.21.15.79:0/4281626715 shutdown_connections 2024-04-25T02:09:35.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.494+0000 7fedfff42640 1 -- 172.21.15.79:0/4281626715 wait complete. 2024-04-25T02:09:35.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.495+0000 7fedfff42640 1 Processor -- start 2024-04-25T02:09:35.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.495+0000 7fedfff42640 1 -- start start 2024-04-25T02:09:35.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.496+0000 7fedfff42640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fede4003fe0 0x7fedf814c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.496+0000 7fedfff42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedf81f21f0 0x7fedf815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.496+0000 7fedfff42640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fedf81f2670 0x7fedf815c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.496+0000 7fedfff42640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fedf806d160 con 0x7fedf81f21f0 2024-04-25T02:09:35.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.496+0000 7fedfff42640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fedf806cfe0 con 0x7fede4003fe0 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.496+0000 7fedfff42640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fedf80b4b50 con 0x7fedf81f2670 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.496+0000 7fedfd4dd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedf81f21f0 0x7fedf815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.496+0000 7fedfd4dd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedf81f21f0 0x7fedf815bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36230/0 (socket says 172.21.15.79:36230) 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.496+0000 7fedfd4dd640 1 -- 172.21.15.79:0/370133579 learned_addr learned my addr 172.21.15.79:0/370133579 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.496+0000 7fedfdcde640 1 --2- 172.21.15.79:0/370133579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fede4003fe0 0x7fedf814c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.496+0000 7fedfd4dd640 1 -- 172.21.15.79:0/370133579 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fedf81f2670 msgr2=0x7fedf815c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.496+0000 7fedfd4dd640 1 --2- 172.21.15.79:0/370133579 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fedf81f2670 0x7fedf815c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.497+0000 7fedfd4dd640 1 -- 172.21.15.79:0/370133579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fede4003fe0 msgr2=0x7fedf814c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.497+0000 7fedfd4dd640 1 --2- 172.21.15.79:0/370133579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fede4003fe0 0x7fedf814c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.497+0000 7fedfd4dd640 1 -- 172.21.15.79:0/370133579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf8157560 con 0x7fedf81f21f0 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.497+0000 7fedfd4dd640 1 --2- 172.21.15.79:0/370133579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedf81f21f0 0x7fedf815bfc0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fede800c300 tx=0x7fedf80cf030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.497+0000 7fedee7fc640 1 -- 172.21.15.79:0/370133579 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8042020 con 0x7fedf81f21f0 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.497+0000 7fedee7fc640 1 -- 172.21.15.79:0/370133579 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede8004bf0 con 0x7fedf81f21f0 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.497+0000 7fedfff42640 1 -- 172.21.15.79:0/370133579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf8157800 con 0x7fedf81f21f0 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.497+0000 7fedee7fc640 1 -- 172.21.15.79:0/370133579 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8007070 con 0x7fedf81f21f0 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.497+0000 7fedfff42640 1 -- 172.21.15.79:0/370133579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf8157dc0 con 0x7fedf81f21f0 2024-04-25T02:09:35.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.498+0000 7fedfff42640 1 -- 172.21.15.79:0/370133579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf80690a0 con 0x7fedf81f21f0 2024-04-25T02:09:35.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.498+0000 7fedee7fc640 1 -- 172.21.15.79:0/370133579 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fede8045020 con 0x7fedf81f21f0 2024-04-25T02:09:35.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.499+0000 7fedee7fc640 1 --2- 172.21.15.79:0/370133579 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7feddc06be60 0x7feddc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.499+0000 7fedee7fc640 1 -- 172.21.15.79:0/370133579 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fede80ab600 con 0x7fedf81f21f0 2024-04-25T02:09:35.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.499+0000 7fedfdcde640 1 --2- 172.21.15.79:0/370133579 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7feddc06be60 0x7feddc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.499+0000 7fedfdcde640 1 --2- 172.21.15.79:0/370133579 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7feddc06be60 0x7feddc06e320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fedf80ae460 tx=0x7fedf4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:35.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.503+0000 7fedee7fc640 1 -- 172.21.15.79:0/370133579 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fede8079fb0 con 0x7fedf81f21f0 2024-04-25T02:09:35.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.744+0000 7fedfff42640 1 -- 172.21.15.79:0/370133579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fedf80cc460 con 0x7fedf81f21f0 2024-04-25T02:09:35.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.746+0000 7fedee7fc640 1 -- 172.21.15.79:0/370133579 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) ==== 190+0+147 (secure 0 0 0) 0x7fede8046e40 con 0x7fedf81f21f0 2024-04-25T02:09:35.754 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-04-25T02:09:35.754 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g== 2024-04-25T02:09:35.754 INFO:teuthology.orchestra.run.smithi079.stdout: caps mds = "allow" 2024-04-25T02:09:35.754 INFO:teuthology.orchestra.run.smithi079.stdout: caps mon = "allow r" 2024-04-25T02:09:35.754 INFO:teuthology.orchestra.run.smithi079.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T02:09:35.754 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2024-04-25T02:09:35.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.748+0000 7fedfff42640 1 -- 172.21.15.79:0/370133579 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7feddc06be60 msgr2=0x7feddc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.748+0000 7fedfff42640 1 --2- 172.21.15.79:0/370133579 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7feddc06be60 0x7feddc06e320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fedf80ae460 tx=0x7fedf4008040 comp rx=0 tx=0).stop 2024-04-25T02:09:35.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.748+0000 7fedfff42640 1 -- 172.21.15.79:0/370133579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedf81f21f0 msgr2=0x7fedf815bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.748+0000 7fedfff42640 1 --2- 172.21.15.79:0/370133579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedf81f21f0 0x7fedf815bfc0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fede800c300 tx=0x7fedf80cf030 comp rx=0 tx=0).stop 2024-04-25T02:09:35.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.748+0000 7fedfff42640 1 -- 172.21.15.79:0/370133579 shutdown_connections 2024-04-25T02:09:35.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.748+0000 7fedfff42640 1 --2- 172.21.15.79:0/370133579 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7feddc06be60 0x7feddc06e320 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.748+0000 7fedfff42640 1 --2- 172.21.15.79:0/370133579 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fedf81f2670 0x7fedf815c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.748+0000 7fedfff42640 1 --2- 172.21.15.79:0/370133579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedf81f21f0 0x7fedf815bfc0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.748+0000 7fedfff42640 1 --2- 172.21.15.79:0/370133579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fede4003fe0 0x7fedf814c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.748+0000 7fedfff42640 1 -- 172.21.15.79:0/370133579 >> 172.21.15.79:0/370133579 conn(0x7fedf80b1cd0 msgr2=0x7fedf81560b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:35.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.749+0000 7fedfff42640 1 -- 172.21.15.79:0/370133579 shutdown_connections 2024-04-25T02:09:35.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.749+0000 7fedfff42640 1 -- 172.21.15.79:0/370133579 wait complete. 2024-04-25T02:09:35.767 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:35.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.855+0000 7f39403c4640 1 Processor -- start 2024-04-25T02:09:35.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.855+0000 7f39403c4640 1 -- start start 2024-04-25T02:09:35.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.856+0000 7f39403c4640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f3938144cb0 0x7f39380b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.856+0000 7f39403c4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3938070d90 con 0x7f393806e660 2024-04-25T02:09:35.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.856+0000 7f39403c4640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39380cf130 con 0x7f39380b5580 2024-04-25T02:09:35.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.856+0000 7f39403c4640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f39380cf410 con 0x7f3938144cb0 2024-04-25T02:09:35.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.856+0000 7f393e961640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f393806e660 0x7f3938071240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42460/0 (socket says 172.21.15.79:42460) 2024-04-25T02:09:35.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.856+0000 7f393e961640 1 -- 172.21.15.79:0/4182561003 learned_addr learned my addr 172.21.15.79:0/4182561003 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:35.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.856+0000 7f393e160640 1 --2- 172.21.15.79:0/4182561003 >> v2:172.21.15.189:3300/0 conn(0x7f3938144cb0 0x7f39380b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.856+0000 7f393d15e640 1 -- 172.21.15.79:0/4182561003 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3716548934 0 0) 0x7f3938070d90 con 0x7f393806e660 2024-04-25T02:09:35.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.856+0000 7f393d15e640 1 -- 172.21.15.79:0/4182561003 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3924003520 con 0x7f393806e660 2024-04-25T02:09:35.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d15e640 1 -- 172.21.15.79:0/4182561003 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 282556854 0 0) 0x7f3924003520 con 0x7f393806e660 2024-04-25T02:09:35.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d15e640 1 -- 172.21.15.79:0/4182561003 >> v2:172.21.15.189:3300/0 conn(0x7f3938144cb0 msgr2=0x7f39380b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:35.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d15e640 1 --2- 172.21.15.79:0/4182561003 >> v2:172.21.15.189:3300/0 conn(0x7f3938144cb0 0x7f39380b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d15e640 1 -- 172.21.15.79:0/4182561003 >> v1:172.21.15.189:6789/0 conn(0x7f39380b5580 legacy=0x7f393806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d15e640 1 -- 172.21.15.79:0/4182561003 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39380cf6f0 con 0x7f393806e660 2024-04-25T02:09:35.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d15e640 1 -- 172.21.15.79:0/4182561003 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f39300019f0 con 0x7f393806e660 2024-04-25T02:09:35.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d15e640 1 -- 172.21.15.79:0/4182561003 >> v1:172.21.15.79:6789/0 conn(0x7f393806e660 legacy=0x7f3938071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d15e640 1 --2- 172.21.15.79:0/4182561003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39240039b0 0x7f3924003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d15e640 1 --2- 172.21.15.79:0/4182561003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3924004800 0x7f3924004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d15e640 1 --2- 172.21.15.79:0/4182561003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39240052e0 0x7f392400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d15e640 1 -- 172.21.15.79:0/4182561003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f39380cf410 con 0x7f3924004800 2024-04-25T02:09:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d15e640 1 -- 172.21.15.79:0/4182561003 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f392400c1b0 con 0x7f39240052e0 2024-04-25T02:09:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d15e640 1 -- 172.21.15.79:0/4182561003 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f392400c3b0 con 0x7f39240039b0 2024-04-25T02:09:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d95f640 1 --2- 172.21.15.79:0/4182561003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3924004800 0x7f3924004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393e160640 1 --2- 172.21.15.79:0/4182561003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39240039b0 0x7f3924003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393e961640 1 --2- 172.21.15.79:0/4182561003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39240052e0 0x7f392400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d95f640 1 -- 172.21.15.79:0/4182561003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39240039b0 msgr2=0x7f3924003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d95f640 1 --2- 172.21.15.79:0/4182561003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39240039b0 0x7f3924003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d95f640 1 -- 172.21.15.79:0/4182561003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39240052e0 msgr2=0x7f392400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d95f640 1 --2- 172.21.15.79:0/4182561003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39240052e0 0x7f392400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393e961640 1 -- 172.21.15.79:0/4182561003 reap_dead start 2024-04-25T02:09:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.857+0000 7f393d95f640 1 -- 172.21.15.79:0/4182561003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3924003520 con 0x7f3924004800 2024-04-25T02:09:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.858+0000 7f393d95f640 1 --2- 172.21.15.79:0/4182561003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3924004800 0x7f3924004c80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f39380b59b0 tx=0x7f3924005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2387f4f0d85c65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.858+0000 7f393d15e640 1 -- 172.21.15.79:0/4182561003 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928001370 con 0x7f3924004800 2024-04-25T02:09:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.858+0000 7f393d15e640 1 -- 172.21.15.79:0/4182561003 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39280052d0 con 0x7f3924004800 2024-04-25T02:09:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.858+0000 7f393d15e640 1 -- 172.21.15.79:0/4182561003 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392802ab70 con 0x7f3924004800 2024-04-25T02:09:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.858+0000 7f39403c4640 1 -- 172.21.15.79:0/4182561003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3924004800 msgr2=0x7f3924004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.858+0000 7f39403c4640 1 --2- 172.21.15.79:0/4182561003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3924004800 0x7f3924004c80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f39380b59b0 tx=0x7f3924005830 comp rx=0 tx=0).stop 2024-04-25T02:09:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.859+0000 7f39403c4640 1 -- 172.21.15.79:0/4182561003 shutdown_connections 2024-04-25T02:09:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.859+0000 7f39403c4640 1 --2- 172.21.15.79:0/4182561003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3924004800 0x7f3924004c80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.859+0000 7f39403c4640 1 -- 172.21.15.79:0/4182561003 >> 172.21.15.79:0/4182561003 conn(0x7f39380cfc80 msgr2=0x7f39380d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.859+0000 7f39403c4640 1 -- 172.21.15.79:0/4182561003 shutdown_connections 2024-04-25T02:09:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.859+0000 7f39403c4640 1 -- 172.21.15.79:0/4182561003 wait complete. 2024-04-25T02:09:35.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.860+0000 7f39403c4640 1 Processor -- start 2024-04-25T02:09:35.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.860+0000 7f39403c4640 1 -- start start 2024-04-25T02:09:35.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.860+0000 7f39403c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3924004800 0x7f3938140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.860+0000 7f39403c4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39380b4330 0x7f39380b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.860+0000 7f39403c4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39381e4f70 0x7f39381e53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.860+0000 7f39403c4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3938145ab0 con 0x7f3924004800 2024-04-25T02:09:35.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.860+0000 7f39403c4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3938145090 con 0x7f39381e4f70 2024-04-25T02:09:35.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.860+0000 7f39403c4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3938145c30 con 0x7f39380b4330 2024-04-25T02:09:35.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f393e160640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3924004800 0x7f3938140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f393e160640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3924004800 0x7f3938140f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36260/0 (socket says 172.21.15.79:36260) 2024-04-25T02:09:35.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f393e160640 1 -- 172.21.15.79:0/2014589860 learned_addr learned my addr 172.21.15.79:0/2014589860 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:35.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f393d95f640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39380b4330 0x7f39380b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f393e961640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39381e4f70 0x7f39381e53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f393e160640 1 -- 172.21.15.79:0/2014589860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39380b4330 msgr2=0x7f39380b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f393e160640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39380b4330 0x7f39380b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f393e160640 1 -- 172.21.15.79:0/2014589860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39381e4f70 msgr2=0x7f39381e53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:35.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f393e160640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39381e4f70 0x7f39381e53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:35.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f393e160640 1 -- 172.21.15.79:0/2014589860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39381e41b0 con 0x7f3924004800 2024-04-25T02:09:35.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f393d95f640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39380b4330 0x7f39380b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:35.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f393e961640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39381e4f70 0x7f39381e53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:35.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f393e160640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3924004800 0x7f3938140f40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f39340119c0 tx=0x7f3934011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:35.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f392effd640 1 -- 172.21.15.79:0/2014589860 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393400fb50 con 0x7f3924004800 2024-04-25T02:09:35.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f392effd640 1 -- 172.21.15.79:0/2014589860 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393400fcf0 con 0x7f3924004800 2024-04-25T02:09:35.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f392effd640 1 -- 172.21.15.79:0/2014589860 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393400fea0 con 0x7f3924004800 2024-04-25T02:09:35.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f39403c4640 1 -- 172.21.15.79:0/2014589860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39381e4490 con 0x7f3924004800 2024-04-25T02:09:35.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.861+0000 7f39403c4640 1 -- 172.21.15.79:0/2014589860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39381e5930 con 0x7f3924004800 2024-04-25T02:09:35.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.862+0000 7f39403c4640 1 -- 172.21.15.79:0/2014589860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39380690a0 con 0x7f3924004800 2024-04-25T02:09:35.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.863+0000 7f392effd640 1 -- 172.21.15.79:0/2014589860 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3934012040 con 0x7f3924004800 2024-04-25T02:09:35.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.863+0000 7f392effd640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f391c06be30 0x7f391c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:35.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.863+0000 7f393d95f640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f391c06be30 0x7f391c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:35.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.863+0000 7f392effd640 1 -- 172.21.15.79:0/2014589860 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f393408b570 con 0x7f3924004800 2024-04-25T02:09:35.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.864+0000 7f393d95f640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f391c06be30 0x7f391c06e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3928032000 tx=0x7f392802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:35.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:35.867+0000 7f392effd640 1 -- 172.21.15.79:0/2014589860 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3934019030 con 0x7f3924004800 2024-04-25T02:09:36.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.074+0000 7f39403c4640 1 -- 172.21.15.79:0/2014589860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39380d0b90 con 0x7f3924004800 2024-04-25T02:09:36.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.075+0000 7f392effd640 1 -- 172.21.15.79:0/2014589860 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7f3934059fb0 con 0x7f3924004800 2024-04-25T02:09:36.082 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:36.082 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3934472151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3934472151},{"type":"v1","addr":"172.21.15.189:6835","nonce":3934472151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2046740048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2046740048},{"type":"v1","addr":"172.21.15.79:6836","nonce":2046740048}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/207160678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":207160678},{"type":"v1","addr":"172.21.15.79:6837","nonce":207160678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:09:27.032071+0000","modified":"2024-04-25T02:09:29.046598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/1295756642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1295756642},{"type":"v1","addr":"172.21.15.189:6833","nonce":1295756642}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":3}]} 2024-04-25T02:09:36.083 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2024-04-25T02:09:36.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.077+0000 7f39403c4640 1 -- 172.21.15.79:0/2014589860 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f391c06be30 msgr2=0x7f391c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.077+0000 7f39403c4640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f391c06be30 0x7f391c06e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3928032000 tx=0x7f392802e000 comp rx=0 tx=0).stop 2024-04-25T02:09:36.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.077+0000 7f39403c4640 1 -- 172.21.15.79:0/2014589860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3924004800 msgr2=0x7f3938140f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.077+0000 7f39403c4640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3924004800 0x7f3938140f40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f39340119c0 tx=0x7f3934011e80 comp rx=0 tx=0).stop 2024-04-25T02:09:36.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.077+0000 7f39403c4640 1 -- 172.21.15.79:0/2014589860 shutdown_connections 2024-04-25T02:09:36.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.077+0000 7f39403c4640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f391c06be30 0x7f391c06e2f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.077+0000 7f39403c4640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39381e4f70 0x7f39381e53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.077+0000 7f39403c4640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39380b4330 0x7f39380b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.077+0000 7f39403c4640 1 --2- 172.21.15.79:0/2014589860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3924004800 0x7f3938140f40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.077+0000 7f39403c4640 1 -- 172.21.15.79:0/2014589860 >> 172.21.15.79:0/2014589860 conn(0x7f39380cfc80 msgr2=0x7f39381e30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:36.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.077+0000 7f39403c4640 1 -- 172.21.15.79:0/2014589860 shutdown_connections 2024-04-25T02:09:36.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.077+0000 7f39403c4640 1 -- 172.21.15.79:0/2014589860 wait complete. 2024-04-25T02:09:36.497 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:09:27.032071+0000', 'modified': '2024-04-25T02:09:29.046598+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5598}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5598': {'gid': 5598, 'name': 'b', 'rank': 0, 'incarnation': 16, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.189:6833/1295756642', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6832', 'nonce': 1295756642}, {'type': 'v1', 'addr': '172.21.15.189:6833', 'nonce': 1295756642}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5598, 'qdb_cluster': [5598]} 2024-04-25T02:09:36.497 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:09:36.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T02:09:36.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.589+0000 7fce14c64640 1 Processor -- start 2024-04-25T02:09:36.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.589+0000 7fce14c64640 1 -- start start 2024-04-25T02:09:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.590+0000 7fce14c64640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fce10144cb0 0x7fce100b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.590+0000 7fce14c64640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce100b5580 0x7fce1006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.590+0000 7fce14c64640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce10070d90 con 0x7fce1006e490 2024-04-25T02:09:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.590+0000 7fce14c64640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fce1006e900 con 0x7fce10144cb0 2024-04-25T02:09:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.590+0000 7fce14c64640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fce100cf130 con 0x7fce100b5580 2024-04-25T02:09:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.591+0000 7fce0e59c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fce10144cb0 0x7fce100b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.591+0000 7fce0dd9b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce100b5580 0x7fce1006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.591+0000 7fce0ed9d640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fce1006e490 0x7fce1015fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:53024/0 (socket says 172.21.15.79:53024) 2024-04-25T02:09:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.591+0000 7fce0e59c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fce10144cb0 0x7fce100b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:37788/0 (socket says 172.21.15.79:37788) 2024-04-25T02:09:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.591+0000 7fce0dd9b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce100b5580 0x7fce1006df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:41042/0 (socket says 172.21.15.79:41042) 2024-04-25T02:09:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.591+0000 7fce0ed9d640 1 -- 172.21.15.79:0/2121640726 learned_addr learned my addr 172.21.15.79:0/2121640726 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.591+0000 7fce0e59c640 1 -- 172.21.15.79:0/2121640726 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce100b5580 msgr2=0x7fce1006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.591+0000 7fce0e59c640 1 --2- 172.21.15.79:0/2121640726 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce100b5580 0x7fce1006df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.591+0000 7fce0e59c640 1 -- 172.21.15.79:0/2121640726 >> v1:172.21.15.189:6789/0 conn(0x7fce1006e490 legacy=0x7fce1015fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.591+0000 7fce0e59c640 1 -- 172.21.15.79:0/2121640726 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce100cf410 con 0x7fce10144cb0 2024-04-25T02:09:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.591+0000 7fce0dd9b640 1 --2- 172.21.15.79:0/2121640726 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce100b5580 0x7fce1006df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.592+0000 7fce0e59c640 1 --2- 172.21.15.79:0/2121640726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce10144cb0 0x7fce100b5040 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fce00009d90 tx=0x7fce0002a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7b3ff8395cbe651 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.592+0000 7fce0d59a640 1 -- 172.21.15.79:0/2121640726 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce00007740 con 0x7fce10144cb0 2024-04-25T02:09:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.592+0000 7fce0d59a640 1 -- 172.21.15.79:0/2121640726 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce000078e0 con 0x7fce10144cb0 2024-04-25T02:09:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.592+0000 7fce0d59a640 1 -- 172.21.15.79:0/2121640726 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce00007cb0 con 0x7fce10144cb0 2024-04-25T02:09:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.592+0000 7fce14c64640 1 -- 172.21.15.79:0/2121640726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce10144cb0 msgr2=0x7fce100b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.592+0000 7fce14c64640 1 --2- 172.21.15.79:0/2121640726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce10144cb0 0x7fce100b5040 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fce00009d90 tx=0x7fce0002a530 comp rx=0 tx=0).stop 2024-04-25T02:09:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.592+0000 7fce14c64640 1 -- 172.21.15.79:0/2121640726 shutdown_connections 2024-04-25T02:09:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.592+0000 7fce14c64640 1 --2- 172.21.15.79:0/2121640726 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce100b5580 0x7fce1006df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.593+0000 7fce14c64640 1 --2- 172.21.15.79:0/2121640726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce10144cb0 0x7fce100b5040 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.593+0000 7fce14c64640 1 -- 172.21.15.79:0/2121640726 >> 172.21.15.79:0/2121640726 conn(0x7fce100cfc80 msgr2=0x7fce100d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.593+0000 7fce14c64640 1 -- 172.21.15.79:0/2121640726 shutdown_connections 2024-04-25T02:09:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.593+0000 7fce14c64640 1 -- 172.21.15.79:0/2121640726 wait complete. 2024-04-25T02:09:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.594+0000 7fce14c64640 1 Processor -- start 2024-04-25T02:09:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.594+0000 7fce14c64640 1 -- start start 2024-04-25T02:09:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce14c64640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce1006e490 0x7fce10133650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce14c64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce100b5580 0x7fce101f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce14c64640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce10144cb0 0x7fce101e7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce14c64640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce10145090 con 0x7fce100b5580 2024-04-25T02:09:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce14c64640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce100cf9d0 con 0x7fce1006e490 2024-04-25T02:09:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce14c64640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fce10145ab0 con 0x7fce10144cb0 2024-04-25T02:09:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce0dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce100b5580 0x7fce101f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce0dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce100b5580 0x7fce101f2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36274/0 (socket says 172.21.15.79:36274) 2024-04-25T02:09:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce0dd9b640 1 -- 172.21.15.79:0/3855336566 learned_addr learned my addr 172.21.15.79:0/3855336566 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce0e59c640 1 --2- 172.21.15.79:0/3855336566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce1006e490 0x7fce10133650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce0ed9d640 1 --2- 172.21.15.79:0/3855336566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce10144cb0 0x7fce101e7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce0dd9b640 1 -- 172.21.15.79:0/3855336566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce10144cb0 msgr2=0x7fce101e7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce0dd9b640 1 --2- 172.21.15.79:0/3855336566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce10144cb0 0x7fce101e7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce0dd9b640 1 -- 172.21.15.79:0/3855336566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce1006e490 msgr2=0x7fce10133650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce0dd9b640 1 --2- 172.21.15.79:0/3855336566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce1006e490 0x7fce10133650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce0dd9b640 1 -- 172.21.15.79:0/3855336566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce10142700 con 0x7fce100b5580 2024-04-25T02:09:36.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce0dd9b640 1 --2- 172.21.15.79:0/3855336566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce100b5580 0x7fce101f2040 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fce0400ebe0 tx=0x7fce0400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:36.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fcdfeffd640 1 -- 172.21.15.79:0/3855336566 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04017070 con 0x7fce100b5580 2024-04-25T02:09:36.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fcdfeffd640 1 -- 172.21.15.79:0/3855336566 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0400cc30 con 0x7fce100b5580 2024-04-25T02:09:36.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce14c64640 1 -- 172.21.15.79:0/3855336566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce101429e0 con 0x7fce100b5580 2024-04-25T02:09:36.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fcdfeffd640 1 -- 172.21.15.79:0/3855336566 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04013470 con 0x7fce100b5580 2024-04-25T02:09:36.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.595+0000 7fce14c64640 1 -- 172.21.15.79:0/3855336566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce10142fa0 con 0x7fce100b5580 2024-04-25T02:09:36.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.597+0000 7fcdfeffd640 1 -- 172.21.15.79:0/3855336566 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce0401a070 con 0x7fce100b5580 2024-04-25T02:09:36.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.597+0000 7fcdfeffd640 1 --2- 172.21.15.79:0/3855336566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdf006be30 0x7fcdf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.597+0000 7fcdfeffd640 1 -- 172.21.15.79:0/3855336566 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fce0408ada0 con 0x7fce100b5580 2024-04-25T02:09:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.597+0000 7fce0e59c640 1 --2- 172.21.15.79:0/3855336566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdf006be30 0x7fcdf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.598+0000 7fce0e59c640 1 --2- 172.21.15.79:0/3855336566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdf006be30 0x7fcdf006e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fce00034000 tx=0x7fce0002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.598+0000 7fce17974740 1 Processor -- start 2024-04-25T02:09:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.598+0000 7fce17974740 1 -- start start 2024-04-25T02:09:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce17974740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce17974740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe34c80 0x56326fe34000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce17974740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe34540 0x56326fe09350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce17974740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56326fd6cf00 con 0x56326fe34c80 2024-04-25T02:09:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce17974740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56326fd15750 con 0x56326fe51b60 2024-04-25T02:09:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce17974740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56326fd68ec0 con 0x56326fe34540 2024-04-25T02:09:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce0dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe34c80 0x56326fe34000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce0dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe34c80 0x56326fe34000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36276/0 (socket says 172.21.15.79:36276) 2024-04-25T02:09:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce0dd9b640 1 -- 172.21.15.79:0/1054798353 learned_addr learned my addr 172.21.15.79:0/1054798353 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce0e59c640 1 --2- 172.21.15.79:0/1054798353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce0ed9d640 1 --2- 172.21.15.79:0/1054798353 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe34540 0x56326fe09350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce0dd9b640 1 -- 172.21.15.79:0/1054798353 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe34540 msgr2=0x56326fe09350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce0dd9b640 1 --2- 172.21.15.79:0/1054798353 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe34540 0x56326fe09350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce0dd9b640 1 -- 172.21.15.79:0/1054798353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 msgr2=0x56326fe044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce0dd9b640 1 --2- 172.21.15.79:0/1054798353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce0dd9b640 1 -- 172.21.15.79:0/1054798353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56326fa812d0 con 0x56326fe34c80 2024-04-25T02:09:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.599+0000 7fce0e59c640 1 --2- 172.21.15.79:0/1054798353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.600+0000 7fce0dd9b640 1 --2- 172.21.15.79:0/1054798353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe34c80 0x56326fe34000 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fce04089240 tx=0x7fce040589e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a10b36714bd5d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.600+0000 7fcdeffff640 1 -- 172.21.15.79:0/1054798353 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04021070 con 0x56326fe34c80 2024-04-25T02:09:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.600+0000 7fcdeffff640 1 -- 172.21.15.79:0/1054798353 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce04061bb0 con 0x56326fe34c80 2024-04-25T02:09:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.600+0000 7fcdeffff640 1 -- 172.21.15.79:0/1054798353 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04057380 con 0x56326fe34c80 2024-04-25T02:09:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.600+0000 7fce17974740 1 -- 172.21.15.79:0/1054798353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe34c80 msgr2=0x56326fe34000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.600+0000 7fce17974740 1 --2- 172.21.15.79:0/1054798353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe34c80 0x56326fe34000 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fce04089240 tx=0x7fce040589e0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.600+0000 7fce17974740 1 -- 172.21.15.79:0/1054798353 shutdown_connections 2024-04-25T02:09:36.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.600+0000 7fce17974740 1 --2- 172.21.15.79:0/1054798353 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe34540 0x56326fe09350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.600+0000 7fce17974740 1 --2- 172.21.15.79:0/1054798353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe34c80 0x56326fe34000 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.600+0000 7fce17974740 1 --2- 172.21.15.79:0/1054798353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.600+0000 7fce17974740 1 -- 172.21.15.79:0/1054798353 >> 172.21.15.79:0/1054798353 conn(0x56326fe06760 msgr2=0x56326fe4f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:36.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.600+0000 7fce17974740 1 -- 172.21.15.79:0/1054798353 shutdown_connections 2024-04-25T02:09:36.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.601+0000 7fce17974740 1 -- 172.21.15.79:0/1054798353 wait complete. 2024-04-25T02:09:36.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.601+0000 7fce17974740 1 -- start start 2024-04-25T02:09:36.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.601+0000 7fce17974740 1 Processor -- start 2024-04-25T02:09:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce17974740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe34c80 0x56326fe21930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce17974740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe372c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce17974740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe33010 0x56326fe33490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce17974740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56326fe08910 con 0x56326fe33010 2024-04-25T02:09:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce17974740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56326fd28cf0 con 0x56326fe51b60 2024-04-25T02:09:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce17974740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56326fe07d00 con 0x56326fe34c80 2024-04-25T02:09:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce17974740 10 client.0 _ll_register_callbacks cb 0x56326fd286e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce0ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe33010 0x56326fe33490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce0ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe33010 0x56326fe33490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36290/0 (socket says 172.21.15.79:36290) 2024-04-25T02:09:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce0ed9d640 1 -- 172.21.15.79:0/769041074 learned_addr learned my addr 172.21.15.79:0/769041074 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce0dd9b640 1 --2- 172.21.15.79:0/769041074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe372c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce0e59c640 1 --2- 172.21.15.79:0/769041074 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe34c80 0x56326fe21930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce0ed9d640 1 -- 172.21.15.79:0/769041074 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe34c80 msgr2=0x56326fe21930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce0ed9d640 1 --2- 172.21.15.79:0/769041074 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe34c80 0x56326fe21930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce0ed9d640 1 -- 172.21.15.79:0/769041074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 msgr2=0x56326fe372c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce0ed9d640 1 --2- 172.21.15.79:0/769041074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe372c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.602+0000 7fce0ed9d640 1 -- 172.21.15.79:0/769041074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56326fb4b6b0 con 0x56326fe33010 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fce0ed9d640 1 --2- 172.21.15.79:0/769041074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe33010 0x56326fe33490 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fce080073b0 tx=0x7fce08005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ae77863f9ad7ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fcded7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fcded7fa640 1 -- 172.21.15.79:0/769041074 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08001af0 con 0x56326fe33010 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fcded7fa640 1 -- 172.21.15.79:0/769041074 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fce08001c90 con 0x56326fe33010 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fce17974740 1 -- 172.21.15.79:0/769041074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce04061bb0 con 0x56326fe33010 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fcded7fa640 1 -- 172.21.15.79:0/769041074 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fce08021050 con 0x56326fe33010 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fce17974740 10 client.5763 fetch_fsmap learned FSMap version 18 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fce17974740 1 -- 172.21.15.79:0/769041074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56326fe35c30 con 0x56326fe33010 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fcded7fa640 1 -- 172.21.15.79:0/769041074 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce04061bb0 con 0x56326fe33010 2024-04-25T02:09:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fcded7fa640 1 -- 172.21.15.79:0/769041074 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fce08024020 con 0x56326fe33010 2024-04-25T02:09:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fce17974740 10 client.5763 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T02:09:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fce17974740 10 client.5763 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T02:09:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fce17974740 20 client.5763 populate_metadata read hostname 'smithi079' 2024-04-25T02:09:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fce17974740 1 --2- 172.21.15.79:0/769041074 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x56326fe4f390 0x56326fe4f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fce17974740 4 client.5763 mds_command: new command op to 5598 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:09:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fce17974740 1 -- 172.21.15.79:0/769041074 --> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56326fd7a440 con 0x56326fe4f390 2024-04-25T02:09:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.603+0000 7fce0e59c640 1 --2- 172.21.15.79:0/769041074 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x56326fe4f390 0x56326fe4f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.604+0000 7fcded7fa640 10 client.5763 ms_handle_connect on v2:172.21.15.189:6832/1295756642 2024-04-25T02:09:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.604+0000 7fce0e59c640 1 --2- 172.21.15.79:0/769041074 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x56326fe4f390 0x56326fe4f770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edb5eaddcdc94424 server_cookie=69493cf8e960bf38 in_seq=0 out_seq=0 2024-04-25T02:09:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.605+0000 7fcded7fa640 1 -- 172.21.15.79:0/769041074 <== mds.0 v2:172.21.15.189:6832/1295756642 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56326fd7a440 con 0x56326fe4f390 2024-04-25T02:09:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.605+0000 7fcded7fa640 10 client.5763 handle_command_reply: tid=0 2024-04-25T02:09:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.605+0000 7fce17974740 1 client.5763 shutdown 2024-04-25T02:09:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.605+0000 7fce17974740 1 -- 172.21.15.79:0/769041074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe33010 msgr2=0x56326fe33490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.605+0000 7fce17974740 1 --2- 172.21.15.79:0/769041074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe33010 0x56326fe33490 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fce080073b0 tx=0x7fce08005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.605+0000 7fce17974740 1 -- 172.21.15.79:0/769041074 shutdown_connections 2024-04-25T02:09:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.605+0000 7fce17974740 1 --2- 172.21.15.79:0/769041074 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x56326fe4f390 0x56326fe4f770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.605+0000 7fce17974740 1 --2- 172.21.15.79:0/769041074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe33010 0x56326fe33490 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.605+0000 7fce17974740 1 --2- 172.21.15.79:0/769041074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe372c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.605+0000 7fcded7fa640 0 client.5763 ms_handle_reset on v2:172.21.15.189:6832/1295756642 2024-04-25T02:09:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.605+0000 7fce17974740 1 --2- 172.21.15.79:0/769041074 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe34c80 0x56326fe21930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.605+0000 7fce17974740 1 -- 172.21.15.79:0/769041074 >> 172.21.15.79:0/769041074 conn(0x56326fe34540 msgr2=0x56326fe52420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.605+0000 7fce17974740 1 -- 172.21.15.79:0/769041074 shutdown_connections 2024-04-25T02:09:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.605+0000 7fce17974740 1 -- 172.21.15.79:0/769041074 wait complete. 2024-04-25T02:09:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.605+0000 7fce17974740 20 client.5763 trim_cache size 0 max 16384 2024-04-25T02:09:36.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.623+0000 7fce17974740 1 Processor -- start 2024-04-25T02:09:36.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.623+0000 7fce17974740 1 -- start start 2024-04-25T02:09:36.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce17974740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe33010 0x56326fe333f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce17974740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe34c80 0x56326fe52840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce17974740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe2f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce17974740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce101fe570 con 0x56326fe33010 2024-04-25T02:09:36.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce17974740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce10141f40 con 0x56326fe51b60 2024-04-25T02:09:36.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce17974740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fce101412a0 con 0x56326fe34c80 2024-04-25T02:09:36.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce0e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe33010 0x56326fe333f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce0e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe33010 0x56326fe333f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36300/0 (socket says 172.21.15.79:36300) 2024-04-25T02:09:36.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce0e59c640 1 -- 172.21.15.79:0/2554057812 learned_addr learned my addr 172.21.15.79:0/2554057812 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:36.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce0ed9d640 1 --2- 172.21.15.79:0/2554057812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe2f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce0e59c640 1 -- 172.21.15.79:0/2554057812 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe34c80 msgr2=0x56326fe52840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:36.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce0e59c640 1 --2- 172.21.15.79:0/2554057812 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe34c80 0x56326fe52840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce0e59c640 1 -- 172.21.15.79:0/2554057812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 msgr2=0x56326fe2f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:36.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce0e59c640 1 --2- 172.21.15.79:0/2554057812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe2f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce0e59c640 1 -- 172.21.15.79:0/2554057812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56326fe078a0 con 0x56326fe33010 2024-04-25T02:09:36.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce0ed9d640 1 --2- 172.21.15.79:0/2554057812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe2f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:36.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fce0e59c640 1 --2- 172.21.15.79:0/2554057812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe33010 0x56326fe333f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fce00009e80 tx=0x7fce0002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b786c2ed02b668f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:36.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fcdef7fe640 1 -- 172.21.15.79:0/2554057812 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce00047ad0 con 0x56326fe33010 2024-04-25T02:09:36.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fcdef7fe640 1 -- 172.21.15.79:0/2554057812 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce00007e80 con 0x56326fe33010 2024-04-25T02:09:36.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.624+0000 7fcdef7fe640 1 -- 172.21.15.79:0/2554057812 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce00053020 con 0x56326fe33010 2024-04-25T02:09:36.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.625+0000 7fce17974740 1 -- 172.21.15.79:0/2554057812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe33010 msgr2=0x56326fe333f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.625+0000 7fce17974740 1 --2- 172.21.15.79:0/2554057812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe33010 0x56326fe333f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fce00009e80 tx=0x7fce0002e000 comp rx=0 tx=0).stop 2024-04-25T02:09:36.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.625+0000 7fce17974740 1 -- 172.21.15.79:0/2554057812 shutdown_connections 2024-04-25T02:09:36.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.625+0000 7fce17974740 1 --2- 172.21.15.79:0/2554057812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe2f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.625+0000 7fce17974740 1 --2- 172.21.15.79:0/2554057812 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe34c80 0x56326fe52840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.625+0000 7fce17974740 1 --2- 172.21.15.79:0/2554057812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe33010 0x56326fe333f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.625+0000 7fce17974740 1 -- 172.21.15.79:0/2554057812 >> 172.21.15.79:0/2554057812 conn(0x56326fe34540 msgr2=0x56326fdff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:36.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.625+0000 7fce17974740 1 -- 172.21.15.79:0/2554057812 shutdown_connections 2024-04-25T02:09:36.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.625+0000 7fce17974740 1 -- 172.21.15.79:0/2554057812 wait complete. 2024-04-25T02:09:36.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.625+0000 7fce17974740 1 -- start start 2024-04-25T02:09:36.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.626+0000 7fce17974740 1 Processor -- start 2024-04-25T02:09:36.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.626+0000 7fce17974740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe33010 0x56326fe20880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.626+0000 7fce17974740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe34c80 0x56326fec87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.626+0000 7fce17974740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe2f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.626+0000 7fce17974740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56326fe378f0 con 0x56326fe34c80 2024-04-25T02:09:36.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.626+0000 7fce17974740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce101418f0 con 0x56326fe51b60 2024-04-25T02:09:36.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.626+0000 7fce17974740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56326fe22850 con 0x56326fe33010 2024-04-25T02:09:36.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.626+0000 7fce17974740 10 client.0 _ll_register_callbacks cb 0x7fce08007050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:36.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce0dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe34c80 0x56326fec87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce0dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe34c80 0x56326fec87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36308/0 (socket says 172.21.15.79:36308) 2024-04-25T02:09:36.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce0dd9b640 1 -- 172.21.15.79:0/3022303359 learned_addr learned my addr 172.21.15.79:0/3022303359 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:36.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce0ed9d640 1 --2- 172.21.15.79:0/3022303359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe2f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce0e59c640 1 --2- 172.21.15.79:0/3022303359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe33010 0x56326fe20880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce0dd9b640 1 -- 172.21.15.79:0/3022303359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe33010 msgr2=0x56326fe20880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:36.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce0dd9b640 1 --2- 172.21.15.79:0/3022303359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe33010 0x56326fe20880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce0dd9b640 1 -- 172.21.15.79:0/3022303359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 msgr2=0x56326fe2f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:36.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce0dd9b640 1 --2- 172.21.15.79:0/3022303359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe2f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce0dd9b640 1 -- 172.21.15.79:0/3022303359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56326fe4c360 con 0x56326fe34c80 2024-04-25T02:09:36.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce0ed9d640 1 --2- 172.21.15.79:0/3022303359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe2f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:36.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce0dd9b640 1 --2- 172.21.15.79:0/3022303359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe34c80 0x56326fec87e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fce04058b50 tx=0x7fce040891a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb11492b0b738837 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:36.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fcded7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:09:36.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fcded7fa640 1 -- 172.21.15.79:0/3022303359 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04061bb0 con 0x56326fe34c80 2024-04-25T02:09:36.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fcded7fa640 1 -- 172.21.15.79:0/3022303359 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fce040584d0 con 0x56326fe34c80 2024-04-25T02:09:36.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce17974740 1 -- 172.21.15.79:0/3022303359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce00007e80 con 0x56326fe34c80 2024-04-25T02:09:36.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fcded7fa640 1 -- 172.21.15.79:0/3022303359 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fce0407f050 con 0x56326fe34c80 2024-04-25T02:09:36.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce17974740 10 client.5769 fetch_fsmap learned FSMap version 18 2024-04-25T02:09:36.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce17974740 1 -- 172.21.15.79:0/3022303359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56326fe69590 con 0x56326fe34c80 2024-04-25T02:09:36.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fcded7fa640 1 -- 172.21.15.79:0/3022303359 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce00007e80 con 0x56326fe34c80 2024-04-25T02:09:36.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fcded7fa640 1 -- 172.21.15.79:0/3022303359 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fce04024060 con 0x56326fe34c80 2024-04-25T02:09:36.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce17974740 10 client.5769 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T02:09:36.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce17974740 10 client.5769 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T02:09:36.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce17974740 20 client.5769 populate_metadata read hostname 'smithi079' 2024-04-25T02:09:36.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce17974740 1 --2- 172.21.15.79:0/3022303359 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x56326fe68e00 0x56326fe09130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce17974740 4 client.5769 mds_command: new command op to 5598 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:09:36.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.627+0000 7fce17974740 1 -- 172.21.15.79:0/3022303359 --> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] -- command(tid 0: {"prefix": "status"}) -- 0x56326fd74790 con 0x56326fe68e00 2024-04-25T02:09:36.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fce0e59c640 1 --2- 172.21.15.79:0/3022303359 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x56326fe68e00 0x56326fe09130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fce0e59c640 1 --2- 172.21.15.79:0/3022303359 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x56326fe68e00 0x56326fe09130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e12896f6daff7fd8 server_cookie=907c766674930ce1 in_seq=0 out_seq=0 2024-04-25T02:09:36.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fcded7fa640 10 client.5769 ms_handle_connect on v2:172.21.15.189:6832/1295756642 2024-04-25T02:09:36.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fcded7fa640 1 -- 172.21.15.79:0/3022303359 <== mds.0 v2:172.21.15.189:6832/1295756642 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56326fd74790 con 0x56326fe68e00 2024-04-25T02:09:36.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fcded7fa640 10 client.5769 handle_command_reply: tid=0 2024-04-25T02:09:36.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fce17974740 1 client.5769 shutdown 2024-04-25T02:09:36.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fce17974740 1 -- 172.21.15.79:0/3022303359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe34c80 msgr2=0x56326fec87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fce17974740 1 --2- 172.21.15.79:0/3022303359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe34c80 0x56326fec87e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fce04058b50 tx=0x7fce040891a0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fce17974740 1 -- 172.21.15.79:0/3022303359 shutdown_connections 2024-04-25T02:09:36.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fce17974740 1 --2- 172.21.15.79:0/3022303359 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x56326fe68e00 0x56326fe09130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fce17974740 1 --2- 172.21.15.79:0/3022303359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56326fe51b60 0x56326fe2f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fce17974740 1 --2- 172.21.15.79:0/3022303359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326fe34c80 0x56326fec87e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fce17974740 1 --2- 172.21.15.79:0/3022303359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56326fe33010 0x56326fe20880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fcded7fa640 0 client.5769 ms_handle_reset on v2:172.21.15.189:6832/1295756642 2024-04-25T02:09:36.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fce17974740 1 -- 172.21.15.79:0/3022303359 >> 172.21.15.79:0/3022303359 conn(0x56326fe34540 msgr2=0x56326fe4f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:36.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fce17974740 1 -- 172.21.15.79:0/3022303359 shutdown_connections 2024-04-25T02:09:36.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.628+0000 7fce17974740 1 -- 172.21.15.79:0/3022303359 wait complete. 2024-04-25T02:09:36.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.629+0000 7fce17974740 20 client.5769 trim_cache size 0 max 16384 2024-04-25T02:09:36.643 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:09:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "696648c4-3e52-400b-a780-2e8863c56c42", 2024-04-25T02:09:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-04-25T02:09:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5598, 2024-04-25T02:09:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-04-25T02:09:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-04-25T02:09:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-04-25T02:09:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 8.9271768429999998, 2024-04-25T02:09:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 18, 2024-04-25T02:09:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 45, 2024-04-25T02:09:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 45, 2024-04-25T02:09:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 13.988914346 2024-04-25T02:09:36.644 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:09:36.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.629+0000 7fce14c64640 1 -- 172.21.15.79:0/3855336566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdf006be30 msgr2=0x7fcdf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.629+0000 7fce14c64640 1 --2- 172.21.15.79:0/3855336566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdf006be30 0x7fcdf006e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fce00034000 tx=0x7fce0002f000 comp rx=0 tx=0).stop 2024-04-25T02:09:36.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.629+0000 7fce14c64640 1 -- 172.21.15.79:0/3855336566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce100b5580 msgr2=0x7fce101f2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.629+0000 7fce14c64640 1 --2- 172.21.15.79:0/3855336566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce100b5580 0x7fce101f2040 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fce0400ebe0 tx=0x7fce0400c520 comp rx=0 tx=0).stop 2024-04-25T02:09:36.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.629+0000 7fce14c64640 1 -- 172.21.15.79:0/3855336566 shutdown_connections 2024-04-25T02:09:36.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.629+0000 7fce14c64640 1 --2- 172.21.15.79:0/3855336566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdf006be30 0x7fcdf006e2f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.629+0000 7fce14c64640 1 --2- 172.21.15.79:0/3855336566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce10144cb0 0x7fce101e7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.629+0000 7fce14c64640 1 --2- 172.21.15.79:0/3855336566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce100b5580 0x7fce101f2040 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.629+0000 7fce14c64640 1 --2- 172.21.15.79:0/3855336566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce1006e490 0x7fce10133650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.629+0000 7fce14c64640 1 -- 172.21.15.79:0/3855336566 >> 172.21.15.79:0/3855336566 conn(0x7fce100cfc80 msgr2=0x7fce100724f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:36.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.629+0000 7fce14c64640 1 -- 172.21.15.79:0/3855336566 shutdown_connections 2024-04-25T02:09:36.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.629+0000 7fce14c64640 1 -- 172.21.15.79:0/3855336566 wait complete. 2024-04-25T02:09:36.647 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:09:36.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.736+0000 7f6b606f5640 1 Processor -- start 2024-04-25T02:09:36.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.736+0000 7f6b606f5640 1 -- start start 2024-04-25T02:09:36.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.737+0000 7f6b606f5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b580d2e20 0x7f6b580cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.737+0000 7f6b606f5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b5806c380 con 0x7f6b5815e4d0 2024-04-25T02:09:36.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.737+0000 7f6b606f5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b580d1660 con 0x7f6b580b3570 2024-04-25T02:09:36.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.737+0000 7f6b606f5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6b580d1380 con 0x7f6b580d2e20 2024-04-25T02:09:36.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.737+0000 7f6b5e491640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6b5815e4d0 0x7f6b5806bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42464/0 (socket says 172.21.15.79:42464) 2024-04-25T02:09:36.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.737+0000 7f6b5e491640 1 -- 172.21.15.79:0/3460447048 learned_addr learned my addr 172.21.15.79:0/3460447048 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:36.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5ec92640 1 --2- 172.21.15.79:0/3460447048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b580d2e20 0x7f6b580cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5d48f640 1 -- 172.21.15.79:0/3460447048 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803019930 0 0) 0x7f6b5806c380 con 0x7f6b5815e4d0 2024-04-25T02:09:36.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5d48f640 1 -- 172.21.15.79:0/3460447048 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b44003520 con 0x7f6b5815e4d0 2024-04-25T02:09:36.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5d48f640 1 -- 172.21.15.79:0/3460447048 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3438309174 0 0) 0x7f6b44003520 con 0x7f6b5815e4d0 2024-04-25T02:09:36.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5d48f640 1 -- 172.21.15.79:0/3460447048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b580d2e20 msgr2=0x7f6b580cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:36.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5d48f640 1 --2- 172.21.15.79:0/3460447048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b580d2e20 0x7f6b580cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5d48f640 1 -- 172.21.15.79:0/3460447048 >> v1:172.21.15.189:6789/0 conn(0x7f6b580b3570 legacy=0x7f6b580d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5d48f640 1 -- 172.21.15.79:0/3460447048 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b580cede0 con 0x7f6b5815e4d0 2024-04-25T02:09:36.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5d48f640 1 -- 172.21.15.79:0/3460447048 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f6b54001670 con 0x7f6b5815e4d0 2024-04-25T02:09:36.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5d48f640 1 -- 172.21.15.79:0/3460447048 >> v1:172.21.15.79:6789/0 conn(0x7f6b5815e4d0 legacy=0x7f6b5806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5d48f640 1 --2- 172.21.15.79:0/3460447048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b440039e0 0x7f6b44003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5d48f640 1 --2- 172.21.15.79:0/3460447048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b580d2e20 0x7f6b44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5d48f640 1 --2- 172.21.15.79:0/3460447048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b44004d40 0x7f6b440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5d48f640 1 -- 172.21.15.79:0/3460447048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6b580d1380 con 0x7f6b440039e0 2024-04-25T02:09:36.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5d48f640 1 -- 172.21.15.79:0/3460447048 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4400baa0 con 0x7f6b44004d40 2024-04-25T02:09:36.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5d48f640 1 -- 172.21.15.79:0/3460447048 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4400bca0 con 0x7f6b580d2e20 2024-04-25T02:09:36.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5e491640 1 --2- 172.21.15.79:0/3460447048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b440039e0 0x7f6b44003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5dc90640 1 --2- 172.21.15.79:0/3460447048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b580d2e20 0x7f6b44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5ec92640 1 --2- 172.21.15.79:0/3460447048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b44004d40 0x7f6b440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5e491640 1 -- 172.21.15.79:0/3460447048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b580d2e20 msgr2=0x7f6b44004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:36.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5e491640 1 --2- 172.21.15.79:0/3460447048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b580d2e20 0x7f6b44004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5e491640 1 -- 172.21.15.79:0/3460447048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b44004d40 msgr2=0x7f6b440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:36.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5e491640 1 --2- 172.21.15.79:0/3460447048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b44004d40 0x7f6b440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.738+0000 7f6b5e491640 1 -- 172.21.15.79:0/3460447048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b44003520 con 0x7f6b440039e0 2024-04-25T02:09:36.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.739+0000 7f6b5e491640 1 --2- 172.21.15.79:0/3460447048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b440039e0 0x7f6b44003e00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6b54001eb0 tx=0x7f6b44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5582aa0114c50599 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:36.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.739+0000 7f6b5d48f640 1 -- 172.21.15.79:0/3460447048 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b54007d30 con 0x7f6b440039e0 2024-04-25T02:09:36.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.739+0000 7f6b5d48f640 1 -- 172.21.15.79:0/3460447048 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b540058d0 con 0x7f6b440039e0 2024-04-25T02:09:36.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.739+0000 7f6b5d48f640 1 -- 172.21.15.79:0/3460447048 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b54005ce0 con 0x7f6b440039e0 2024-04-25T02:09:36.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.740+0000 7f6b606f5640 1 -- 172.21.15.79:0/3460447048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b440039e0 msgr2=0x7f6b44003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.740+0000 7f6b606f5640 1 --2- 172.21.15.79:0/3460447048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b440039e0 0x7f6b44003e00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6b54001eb0 tx=0x7f6b44005830 comp rx=0 tx=0).stop 2024-04-25T02:09:36.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.740+0000 7f6b5ec92640 1 -- 172.21.15.79:0/3460447048 reap_dead start 2024-04-25T02:09:36.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.740+0000 7f6b606f5640 1 -- 172.21.15.79:0/3460447048 shutdown_connections 2024-04-25T02:09:36.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.740+0000 7f6b606f5640 1 -- 172.21.15.79:0/3460447048 >> 172.21.15.79:0/3460447048 conn(0x7f6b5809d460 msgr2=0x7f6b580d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:36.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.740+0000 7f6b606f5640 1 -- 172.21.15.79:0/3460447048 shutdown_connections 2024-04-25T02:09:36.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.740+0000 7f6b606f5640 1 -- 172.21.15.79:0/3460447048 wait complete. 2024-04-25T02:09:36.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.741+0000 7f6b606f5640 1 Processor -- start 2024-04-25T02:09:36.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.741+0000 7f6b606f5640 1 -- start start 2024-04-25T02:09:36.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b606f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b440039e0 0x7f6b580c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b606f5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b58155b60 0x7f6b581562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b606f5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b581567f0 0x7f6b580d4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b606f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6b580d20d0 con 0x7f6b440039e0 2024-04-25T02:09:36.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b606f5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5815e8b0 con 0x7f6b581567f0 2024-04-25T02:09:36.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b606f5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6b580d2250 con 0x7f6b58155b60 2024-04-25T02:09:36.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b5e491640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b440039e0 0x7f6b580c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b5e491640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b440039e0 0x7f6b580c6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36330/0 (socket says 172.21.15.79:36330) 2024-04-25T02:09:36.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b5e491640 1 -- 172.21.15.79:0/2333967674 learned_addr learned my addr 172.21.15.79:0/2333967674 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:36.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b5dc90640 1 --2- 172.21.15.79:0/2333967674 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b58155b60 0x7f6b581562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b5ec92640 1 --2- 172.21.15.79:0/2333967674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b581567f0 0x7f6b580d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b5e491640 1 -- 172.21.15.79:0/2333967674 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b58155b60 msgr2=0x7f6b581562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b5e491640 1 --2- 172.21.15.79:0/2333967674 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b58155b60 0x7f6b581562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b5e491640 1 -- 172.21.15.79:0/2333967674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b581567f0 msgr2=0x7f6b580d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b5e491640 1 --2- 172.21.15.79:0/2333967674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b581567f0 0x7f6b580d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b5e491640 1 -- 172.21.15.79:0/2333967674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b581580d0 con 0x7f6b440039e0 2024-04-25T02:09:36.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b5e491640 1 --2- 172.21.15.79:0/2333967674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b440039e0 0x7f6b580c6e10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6b540058a0 tx=0x7f6b54001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:36.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b4effd640 1 -- 172.21.15.79:0/2333967674 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b54007480 con 0x7f6b440039e0 2024-04-25T02:09:36.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b4effd640 1 -- 172.21.15.79:0/2333967674 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b54043070 con 0x7f6b440039e0 2024-04-25T02:09:36.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b606f5640 1 -- 172.21.15.79:0/2333967674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b581583b0 con 0x7f6b440039e0 2024-04-25T02:09:36.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b4effd640 1 -- 172.21.15.79:0/2333967674 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b54007d10 con 0x7f6b440039e0 2024-04-25T02:09:36.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.742+0000 7f6b606f5640 1 -- 172.21.15.79:0/2333967674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b58158970 con 0x7f6b440039e0 2024-04-25T02:09:36.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.743+0000 7f6b606f5640 1 -- 172.21.15.79:0/2333967674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b580690a0 con 0x7f6b440039e0 2024-04-25T02:09:36.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.744+0000 7f6b4effd640 1 -- 172.21.15.79:0/2333967674 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b54048460 con 0x7f6b440039e0 2024-04-25T02:09:36.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.744+0000 7f6b4effd640 1 --2- 172.21.15.79:0/2333967674 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b3c06be30 0x7f6b3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.744+0000 7f6b5dc90640 1 --2- 172.21.15.79:0/2333967674 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b3c06be30 0x7f6b3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.744+0000 7f6b4effd640 1 -- 172.21.15.79:0/2333967674 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f6b540ab450 con 0x7f6b440039e0 2024-04-25T02:09:36.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.745+0000 7f6b5dc90640 1 --2- 172.21.15.79:0/2333967674 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b3c06be30 0x7f6b3c06e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6b580cb480 tx=0x7f6b48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:36.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.749+0000 7f6b4effd640 1 -- 172.21.15.79:0/2333967674 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6b54079e00 con 0x7f6b440039e0 2024-04-25T02:09:36.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.957+0000 7f6b606f5640 1 -- 172.21.15.79:0/2333967674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6b580d1920 con 0x7f6b440039e0 2024-04-25T02:09:36.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.958+0000 7f6b4effd640 1 -- 172.21.15.79:0/2333967674 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f6b54079700 con 0x7f6b440039e0 2024-04-25T02:09:36.965 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:09:36.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.960+0000 7f6b606f5640 1 -- 172.21.15.79:0/2333967674 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b3c06be30 msgr2=0x7f6b3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.960+0000 7f6b606f5640 1 --2- 172.21.15.79:0/2333967674 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b3c06be30 0x7f6b3c06e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6b580cb480 tx=0x7f6b48009040 comp rx=0 tx=0).stop 2024-04-25T02:09:36.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.960+0000 7f6b606f5640 1 -- 172.21.15.79:0/2333967674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b440039e0 msgr2=0x7f6b580c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.960+0000 7f6b606f5640 1 --2- 172.21.15.79:0/2333967674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b440039e0 0x7f6b580c6e10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6b540058a0 tx=0x7f6b54001a40 comp rx=0 tx=0).stop 2024-04-25T02:09:36.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.960+0000 7f6b606f5640 1 -- 172.21.15.79:0/2333967674 shutdown_connections 2024-04-25T02:09:36.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.960+0000 7f6b606f5640 1 --2- 172.21.15.79:0/2333967674 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b3c06be30 0x7f6b3c06e2f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.960+0000 7f6b606f5640 1 --2- 172.21.15.79:0/2333967674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b581567f0 0x7f6b580d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.960+0000 7f6b606f5640 1 --2- 172.21.15.79:0/2333967674 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b58155b60 0x7f6b581562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.960+0000 7f6b606f5640 1 --2- 172.21.15.79:0/2333967674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b440039e0 0x7f6b580c6e10 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.960+0000 7f6b606f5640 1 -- 172.21.15.79:0/2333967674 >> 172.21.15.79:0/2333967674 conn(0x7f6b5809d460 msgr2=0x7f6b58162a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:36.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.960+0000 7f6b606f5640 1 -- 172.21.15.79:0/2333967674 shutdown_connections 2024-04-25T02:09:36.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:36.960+0000 7f6b606f5640 1 -- 172.21.15.79:0/2333967674 wait complete. 2024-04-25T02:09:36.978 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:09:36.978 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:09:36.979 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:09:36.979 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:09:36.979 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:09:36.979 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:09:36.979 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:09:36.979 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:09:36.979 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:09:36.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:36.979 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:09:36.994 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:09:36.994 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:09:36.994 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:09:36.995 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:09:36.995 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:09:36.995 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:09:36.995 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:09:36.995 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:09:36.995 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:09:36.995 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:09:36.995 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:09:36.995 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:09:36.995 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:09:36.995 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:09:36.995 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:09:36.995 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:09:36.996 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:09:36.996 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42629sec preferred_lft 42629sec 2024-04-25T02:09:36.996 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:09:36.996 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:09:36.996 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:09:36.996 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:09:36.996 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:09:36.996 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:09:36.996 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:09:36.996 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:09:36.996 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:09:36.996 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:09:36.996 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link 2024-04-25T02:09:36.996 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:09:36.996 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:09:36.997 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:09:36.997 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::4c:adff:fe56:7194/64 scope link 2024-04-25T02:09:36.997 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:09:36.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:36.997 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:09:37.057 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:09:37.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:37.059 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:09:37.115 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:09:37.115 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:09:37.115 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:09:37.115 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:09:37.115 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:09:37.116 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:09:37.116 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:09:37.116 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:09:37.116 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:09:37.116 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:09:37.116 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:09:37.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:09:37.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:09:37.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:37.238 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:09:37.252 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:09:37.253 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:09:37.253 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:09:37.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:37.253 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:09:37.317 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:09:37.317 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:09:37.371 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:09:37.372 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:09:37.372 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:09:37.426 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:09:37.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:37.426 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:09:37.507 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:09:37.507 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:09:37.507 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:09:37.515 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:09:37.515 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:09:37.515 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:09:37.515 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:09:37.515 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:09:37.523 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:09:37.523 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:09:37.523 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:09:37.523 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:09:37.523 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:09:37.523 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:09:37.523 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:09:37.523 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:09:37.524 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:09:37.524 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:09:37.524 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:09:37.524 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:09:37.524 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:09:37.525 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:09:37.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:37.525 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:09:37.589 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:09:37.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:09:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:09:37.688 INFO:teuthology.orchestra.run.smithi079.stdout:client5778 2024-04-25T02:09:37.688 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:09:37.688 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:09:37.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:37.706 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-04-25T02:09:37.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:37.765 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-04-25T02:09:37.822 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:09:37.822 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:09:37.822 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:09:37.822 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:09:37.822 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-04-25T02:09:37.823 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:09:37.925 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627777 2024-04-25T02:09:37.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:09:37.934 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:38.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.063+0000 7f792af7e640 1 Processor -- start 2024-04-25T02:09:38.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.063+0000 7f792af7e640 1 -- start start 2024-04-25T02:09:38.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.064+0000 7f792af7e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7924143bc0 0x7f792415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.064+0000 7f792af7e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f792415fa40 con 0x7f792406df50 2024-04-25T02:09:38.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.064+0000 7f792af7e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79240b5700 con 0x7f79240b3d40 2024-04-25T02:09:38.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.064+0000 7f792af7e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7924072cb0 con 0x7f7924143bc0 2024-04-25T02:09:38.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.064+0000 7f7928d1a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7924143bc0 0x7f792415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.064+0000 7f7923fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f792406df50 0x7f79240b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42468/0 (socket says 172.21.15.79:42468) 2024-04-25T02:09:38.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.064+0000 7f7923fff640 1 -- 172.21.15.79:0/1096422212 learned_addr learned my addr 172.21.15.79:0/1096422212 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:38.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.065+0000 7f7928d1a640 1 -- 172.21.15.79:0/1096422212 >> v1:172.21.15.189:6789/0 conn(0x7f79240b3d40 legacy=0x7f79240b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.065+0000 7f7928d1a640 1 -- 172.21.15.79:0/1096422212 >> v1:172.21.15.79:6789/0 conn(0x7f792406df50 legacy=0x7f79240b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.065+0000 7f79237fe640 1 -- 172.21.15.79:0/1096422212 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 498885188 0 0) 0x7f7918001110 con 0x7f792406df50 2024-04-25T02:09:38.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.065+0000 7f7928d1a640 1 -- 172.21.15.79:0/1096422212 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7924071e00 con 0x7f7924143bc0 2024-04-25T02:09:38.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.065+0000 7f7928d1a640 1 --2- 172.21.15.79:0/1096422212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7924143bc0 0x7f792415f500 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f79140097a0 tx=0x7f791402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca9075827a189db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.066+0000 7f79237fe640 1 -- 172.21.15.79:0/1096422212 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914037070 con 0x7f7924143bc0 2024-04-25T02:09:38.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.066+0000 7f79237fe640 1 -- 172.21.15.79:0/1096422212 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f791402ae50 con 0x7f7924143bc0 2024-04-25T02:09:38.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.066+0000 7f79237fe640 1 -- 172.21.15.79:0/1096422212 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914032660 con 0x7f7924143bc0 2024-04-25T02:09:38.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.066+0000 7f792af7e640 1 -- 172.21.15.79:0/1096422212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7924143bc0 msgr2=0x7f792415f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.066+0000 7f792af7e640 1 --2- 172.21.15.79:0/1096422212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7924143bc0 0x7f792415f500 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f79140097a0 tx=0x7f791402a140 comp rx=0 tx=0).stop 2024-04-25T02:09:38.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.066+0000 7f792af7e640 1 -- 172.21.15.79:0/1096422212 shutdown_connections 2024-04-25T02:09:38.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.066+0000 7f792af7e640 1 --2- 172.21.15.79:0/1096422212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7924143bc0 0x7f792415f500 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.066+0000 7f792af7e640 1 -- 172.21.15.79:0/1096422212 >> 172.21.15.79:0/1096422212 conn(0x7f79240cfc80 msgr2=0x7f79240d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:38.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.066+0000 7f792af7e640 1 -- 172.21.15.79:0/1096422212 shutdown_connections 2024-04-25T02:09:38.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.066+0000 7f792af7e640 1 -- 172.21.15.79:0/1096422212 wait complete. 2024-04-25T02:09:38.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.067+0000 7f792af7e640 1 Processor -- start 2024-04-25T02:09:38.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.067+0000 7f792af7e640 1 -- start start 2024-04-25T02:09:38.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.068+0000 7f792af7e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f792406df50 0x7f7924155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.068+0000 7f792af7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79240b3d40 0x7f792415c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.068+0000 7f792af7e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7924143bc0 0x7f7924157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.068+0000 7f792af7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7924072660 con 0x7f79240b3d40 2024-04-25T02:09:38.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.068+0000 7f792af7e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7924072380 con 0x7f7924143bc0 2024-04-25T02:09:38.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.068+0000 7f792af7e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7924072940 con 0x7f792406df50 2024-04-25T02:09:38.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.068+0000 7f7923fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79240b3d40 0x7f792415c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.068+0000 7f7923fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79240b3d40 0x7f792415c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36354/0 (socket says 172.21.15.79:36354) 2024-04-25T02:09:38.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.068+0000 7f7923fff640 1 -- 172.21.15.79:0/4160066329 learned_addr learned my addr 172.21.15.79:0/4160066329 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:38.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.068+0000 7f7928d1a640 1 --2- 172.21.15.79:0/4160066329 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f792406df50 0x7f7924155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.068+0000 7f792951b640 1 --2- 172.21.15.79:0/4160066329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7924143bc0 0x7f7924157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.069+0000 7f7923fff640 1 -- 172.21.15.79:0/4160066329 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f792406df50 msgr2=0x7f7924155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.069+0000 7f7923fff640 1 --2- 172.21.15.79:0/4160066329 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f792406df50 0x7f7924155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.069+0000 7f7923fff640 1 -- 172.21.15.79:0/4160066329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7924143bc0 msgr2=0x7f7924157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.069+0000 7f7923fff640 1 --2- 172.21.15.79:0/4160066329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7924143bc0 0x7f7924157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.069+0000 7f7923fff640 1 -- 172.21.15.79:0/4160066329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79241563a0 con 0x7f79240b3d40 2024-04-25T02:09:38.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.069+0000 7f7923fff640 1 --2- 172.21.15.79:0/4160066329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79240b3d40 0x7f792415c4a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f791800c3f0 tx=0x7f791800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.069+0000 7f79217fa640 1 -- 172.21.15.79:0/4160066329 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79180074e0 con 0x7f79240b3d40 2024-04-25T02:09:38.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.069+0000 7f79217fa640 1 -- 172.21.15.79:0/4160066329 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79180047e0 con 0x7f79240b3d40 2024-04-25T02:09:38.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.069+0000 7f79217fa640 1 -- 172.21.15.79:0/4160066329 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918004c10 con 0x7f79240b3d40 2024-04-25T02:09:38.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.069+0000 7f792af7e640 1 -- 172.21.15.79:0/4160066329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7924156680 con 0x7f79240b3d40 2024-04-25T02:09:38.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.069+0000 7f792af7e640 1 -- 172.21.15.79:0/4160066329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7924156c40 con 0x7f79240b3d40 2024-04-25T02:09:38.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.070+0000 7f792af7e640 1 -- 172.21.15.79:0/4160066329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79240690a0 con 0x7f79240b3d40 2024-04-25T02:09:38.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.070+0000 7f79217fa640 1 -- 172.21.15.79:0/4160066329 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7918011070 con 0x7f79240b3d40 2024-04-25T02:09:38.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.071+0000 7f79217fa640 1 --2- 172.21.15.79:0/4160066329 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f791006be30 0x7f791006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.071+0000 7f7928d1a640 1 --2- 172.21.15.79:0/4160066329 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f791006be30 0x7f791006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.071+0000 7f79217fa640 1 -- 172.21.15.79:0/4160066329 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f791808aad0 con 0x7f79240b3d40 2024-04-25T02:09:38.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.071+0000 7f7928d1a640 1 --2- 172.21.15.79:0/4160066329 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f791006be30 0x7f791006e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7914034000 tx=0x7f791402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.075+0000 7f79217fa640 1 -- 172.21.15.79:0/4160066329 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f792415fa40 con 0x7f79240b3d40 2024-04-25T02:09:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.284+0000 7f792af7e640 1 -- 172.21.15.79:0/4160066329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79240b37f0 con 0x7f79240b3d40 2024-04-25T02:09:38.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.285+0000 7f79217fa640 1 -- 172.21.15.79:0/4160066329 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7f7918059480 con 0x7f79240b3d40 2024-04-25T02:09:38.292 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:38.292 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3934472151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3934472151},{"type":"v1","addr":"172.21.15.189:6835","nonce":3934472151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2046740048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2046740048},{"type":"v1","addr":"172.21.15.79:6836","nonce":2046740048}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/207160678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":207160678},{"type":"v1","addr":"172.21.15.79:6837","nonce":207160678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:09:27.032071+0000","modified":"2024-04-25T02:09:29.046598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/1295756642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1295756642},{"type":"v1","addr":"172.21.15.189:6833","nonce":1295756642}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":3}]} 2024-04-25T02:09:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2024-04-25T02:09:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.287+0000 7f792af7e640 1 -- 172.21.15.79:0/4160066329 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f791006be30 msgr2=0x7f791006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.287+0000 7f792af7e640 1 --2- 172.21.15.79:0/4160066329 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f791006be30 0x7f791006e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7914034000 tx=0x7f791402e000 comp rx=0 tx=0).stop 2024-04-25T02:09:38.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.287+0000 7f792af7e640 1 -- 172.21.15.79:0/4160066329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79240b3d40 msgr2=0x7f792415c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.287+0000 7f792af7e640 1 --2- 172.21.15.79:0/4160066329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79240b3d40 0x7f792415c4a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f791800c3f0 tx=0x7f791800c8b0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.287+0000 7f792af7e640 1 -- 172.21.15.79:0/4160066329 shutdown_connections 2024-04-25T02:09:38.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.287+0000 7f792af7e640 1 --2- 172.21.15.79:0/4160066329 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f791006be30 0x7f791006e2f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.287+0000 7f792af7e640 1 --2- 172.21.15.79:0/4160066329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7924143bc0 0x7f7924157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.287+0000 7f792af7e640 1 --2- 172.21.15.79:0/4160066329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79240b3d40 0x7f792415c4a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.287+0000 7f792af7e640 1 --2- 172.21.15.79:0/4160066329 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f792406df50 0x7f7924155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.287+0000 7f792af7e640 1 -- 172.21.15.79:0/4160066329 >> 172.21.15.79:0/4160066329 conn(0x7f79240cfc80 msgr2=0x7f79240b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:38.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.287+0000 7f792af7e640 1 -- 172.21.15.79:0/4160066329 shutdown_connections 2024-04-25T02:09:38.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.287+0000 7f792af7e640 1 -- 172.21.15.79:0/4160066329 wait complete. 2024-04-25T02:09:38.305 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-04-25T02:09:38.440 INFO:teuthology.orchestra.run.smithi189.stdout:{"message":"","return_code":0} 2024-04-25T02:09:38.441 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T02:09:38.441 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T02:09:38.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.475+0000 7f60e562af40 1 Processor -- start 2024-04-25T02:09:38.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.475+0000 7f60e562af40 1 -- start start 2024-04-25T02:09:38.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e562af40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a5d56d070 0x560a5d586310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e562af40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a5d581f80 0x560a5d5689a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e562af40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a5d588240 0x560a5d4f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e562af40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a5d588f50 con 0x560a5d581f80 2024-04-25T02:09:38.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e562af40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560a5d457640 con 0x560a5d588240 2024-04-25T02:09:38.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e562af40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x560a5d56d9c0 con 0x560a5d56d070 2024-04-25T02:09:38.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e292a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a5d581f80 0x560a5d5689a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e292a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a5d581f80 0x560a5d5689a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36362/0 (socket says 172.21.15.79:36362) 2024-04-25T02:09:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e292a640 1 -- 172.21.15.79:0/291131296 learned_addr learned my addr 172.21.15.79:0/291131296 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e392c640 1 --2- 172.21.15.79:0/291131296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a5d588240 0x560a5d4f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e312b640 1 --2- 172.21.15.79:0/291131296 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a5d56d070 0x560a5d586310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e292a640 1 -- 172.21.15.79:0/291131296 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a5d56d070 msgr2=0x560a5d586310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e292a640 1 --2- 172.21.15.79:0/291131296 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a5d56d070 0x560a5d586310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e292a640 1 -- 172.21.15.79:0/291131296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a5d588240 msgr2=0x560a5d4f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e292a640 1 --2- 172.21.15.79:0/291131296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a5d588240 0x560a5d4f5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e292a640 1 -- 172.21.15.79:0/291131296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a5d4b2770 con 0x560a5d581f80 2024-04-25T02:09:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e392c640 1 --2- 172.21.15.79:0/291131296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a5d588240 0x560a5d4f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.476+0000 7f60e312b640 1 --2- 172.21.15.79:0/291131296 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a5d56d070 0x560a5d586310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.477+0000 7f60e292a640 1 --2- 172.21.15.79:0/291131296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a5d581f80 0x560a5d5689a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f60d800a770 tx=0x7f60d800a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d12093f41f3a155 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.477+0000 7f60e1928640 1 -- 172.21.15.79:0/291131296 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8019070 con 0x560a5d581f80 2024-04-25T02:09:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.477+0000 7f60e1928640 1 -- 172.21.15.79:0/291131296 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60d8007600 con 0x560a5d581f80 2024-04-25T02:09:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.477+0000 7f60e1928640 1 -- 172.21.15.79:0/291131296 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8007a10 con 0x560a5d581f80 2024-04-25T02:09:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.477+0000 7f60e562af40 1 -- 172.21.15.79:0/291131296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a5d581f80 msgr2=0x560a5d5689a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.477+0000 7f60e562af40 1 --2- 172.21.15.79:0/291131296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a5d581f80 0x560a5d5689a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f60d800a770 tx=0x7f60d800a7a0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.477+0000 7f60e562af40 1 -- 172.21.15.79:0/291131296 shutdown_connections 2024-04-25T02:09:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.477+0000 7f60e562af40 1 --2- 172.21.15.79:0/291131296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a5d588240 0x560a5d4f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.477+0000 7f60e562af40 1 --2- 172.21.15.79:0/291131296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a5d581f80 0x560a5d5689a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.477+0000 7f60e562af40 1 --2- 172.21.15.79:0/291131296 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a5d56d070 0x560a5d586310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.477+0000 7f60e562af40 1 -- 172.21.15.79:0/291131296 >> 172.21.15.79:0/291131296 conn(0x560a5d4dc920 msgr2=0x560a5d4dcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.477+0000 7f60e562af40 1 -- 172.21.15.79:0/291131296 shutdown_connections 2024-04-25T02:09:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.477+0000 7f60e562af40 1 -- 172.21.15.79:0/291131296 wait complete. 2024-04-25T02:09:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.478+0000 7f60e562af40 1 Processor -- start 2024-04-25T02:09:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.478+0000 7f60e562af40 1 -- start start 2024-04-25T02:09:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.478+0000 7f60e562af40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a5d56d070 0x560a5d57cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.478+0000 7f60e562af40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a5d581f80 0x560a5d565360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.478+0000 7f60e562af40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a5d588240 0x560a5d586ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.478+0000 7f60e562af40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a5d585b50 con 0x560a5d56d070 2024-04-25T02:09:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.478+0000 7f60e562af40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560a5d588730 con 0x560a5d588240 2024-04-25T02:09:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.478+0000 7f60e562af40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x560a5d588a10 con 0x560a5d581f80 2024-04-25T02:09:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e312b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a5d56d070 0x560a5d57cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e312b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a5d56d070 0x560a5d57cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36366/0 (socket says 172.21.15.79:36366) 2024-04-25T02:09:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e312b640 1 -- 172.21.15.79:0/4208063509 learned_addr learned my addr 172.21.15.79:0/4208063509 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e292a640 1 --2- 172.21.15.79:0/4208063509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a5d581f80 0x560a5d565360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e392c640 1 --2- 172.21.15.79:0/4208063509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a5d588240 0x560a5d586ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e312b640 1 -- 172.21.15.79:0/4208063509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a5d581f80 msgr2=0x560a5d565360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e312b640 1 --2- 172.21.15.79:0/4208063509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a5d581f80 0x560a5d565360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e312b640 1 -- 172.21.15.79:0/4208063509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a5d588240 msgr2=0x560a5d586ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e312b640 1 --2- 172.21.15.79:0/4208063509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a5d588240 0x560a5d586ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e312b640 1 -- 172.21.15.79:0/4208063509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a5d580af0 con 0x560a5d56d070 2024-04-25T02:09:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e292a640 1 --2- 172.21.15.79:0/4208063509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a5d581f80 0x560a5d565360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e312b640 1 --2- 172.21.15.79:0/4208063509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a5d56d070 0x560a5d57cc60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f60d400a4b0 tx=0x7f60d4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e0926640 1 -- 172.21.15.79:0/4208063509 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d4055040 con 0x560a5d56d070 2024-04-25T02:09:38.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e0926640 1 -- 172.21.15.79:0/4208063509 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60d4066640 con 0x560a5d56d070 2024-04-25T02:09:38.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e562af40 1 -- 172.21.15.79:0/4208063509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a5d580dd0 con 0x560a5d56d070 2024-04-25T02:09:38.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e0926640 1 -- 172.21.15.79:0/4208063509 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d40669f0 con 0x560a5d56d070 2024-04-25T02:09:38.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.479+0000 7f60e562af40 1 -- 172.21.15.79:0/4208063509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a5d4f9610 con 0x560a5d56d070 2024-04-25T02:09:38.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.481+0000 7f60e0926640 1 -- 172.21.15.79:0/4208063509 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f60d4058020 con 0x560a5d56d070 2024-04-25T02:09:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.481+0000 7f60e0926640 1 --2- 172.21.15.79:0/4208063509 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f60d006a810 0x7f60d006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.481+0000 7f60e292a640 1 --2- 172.21.15.79:0/4208063509 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f60d006a810 0x7f60d006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.481+0000 7f60e0926640 1 -- 172.21.15.79:0/4208063509 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f60d40cdc00 con 0x560a5d56d070 2024-04-25T02:09:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.481+0000 7f60e562af40 1 --2- 172.21.15.79:0/4208063509 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x560a5d5658a0 0x560a5d58a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.481+0000 7f60e562af40 1 -- 172.21.15.79:0/4208063509 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) -- 0x560a5d5818b0 con 0x560a5d5658a0 2024-04-25T02:09:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.481+0000 7f60e292a640 1 --2- 172.21.15.79:0/4208063509 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f60d006a810 0x7f60d006ccd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f60d800a770 tx=0x7f60d800c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.482+0000 7f60e392c640 1 --2- 172.21.15.79:0/4208063509 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x560a5d5658a0 0x560a5d58a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.482+0000 7f60e392c640 1 --2- 172.21.15.79:0/4208063509 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x560a5d5658a0 0x560a5d58a5f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.482+0000 7f60e392c640 1 -- 172.21.15.79:0/4208063509 <== osd.6 v2:172.21.15.189:6816/1254358257 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f60dc00f5f0 con 0x560a5d5658a0 2024-04-25T02:09:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.482+0000 7f60e562af40 1 -- 172.21.15.79:0/4208063509 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x560a5d5658a0 msgr2=0x560a5d58a5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.482+0000 7f60e562af40 1 --2- 172.21.15.79:0/4208063509 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x560a5d5658a0 0x560a5d58a5f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.482+0000 7f60e562af40 1 -- 172.21.15.79:0/4208063509 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f60d006a810 msgr2=0x7f60d006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.482+0000 7f60e562af40 1 --2- 172.21.15.79:0/4208063509 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f60d006a810 0x7f60d006ccd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f60d800a770 tx=0x7f60d800c000 comp rx=0 tx=0).stop 2024-04-25T02:09:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.482+0000 7f60e562af40 1 -- 172.21.15.79:0/4208063509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a5d56d070 msgr2=0x560a5d57cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.482+0000 7f60e562af40 1 --2- 172.21.15.79:0/4208063509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a5d56d070 0x560a5d57cc60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f60d400a4b0 tx=0x7f60d4003330 comp rx=0 tx=0).stop 2024-04-25T02:09:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.482+0000 7f60e392c640 1 -- 172.21.15.79:0/4208063509 reap_dead start 2024-04-25T02:09:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.482+0000 7f60e562af40 1 -- 172.21.15.79:0/4208063509 shutdown_connections 2024-04-25T02:09:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.482+0000 7f60e562af40 1 -- 172.21.15.79:0/4208063509 >> 172.21.15.79:0/4208063509 conn(0x560a5d4dc920 msgr2=0x560a5d4dcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.482+0000 7f60e562af40 1 -- 172.21.15.79:0/4208063509 shutdown_connections 2024-04-25T02:09:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.482+0000 7f60e562af40 1 -- 172.21.15.79:0/4208063509 wait complete. 2024-04-25T02:09:38.495 INFO:teuthology.orchestra.run.smithi079.stdout:Yalphaparent_a 2024-04-25T02:09:38.495 DEBUG:teuthology.orchestra.run.smithi079:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T02:09:38.604 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:09:38.604 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627777, 2024-04-25T02:09:38.604 INFO:teuthology.orchestra.run.smithi079.stdout: "ancestors": [ 2024-04-25T02:09:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: "dirino": 1099511627776, 2024-04-25T02:09:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: "dname": "alpha", 2024-04-25T02:09:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 2 2024-04-25T02:09:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:09:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:09:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: "dirino": 1, 2024-04-25T02:09:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: "dname": "parent_a", 2024-04-25T02:09:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 4 2024-04-25T02:09:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-04-25T02:09:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 7, 2024-04-25T02:09:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: "old_pools": [] 2024-04-25T02:09:38.605 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:09:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:38.621 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2024-04-25T02:09:38.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.696+0000 7fe75971af40 1 Processor -- start 2024-04-25T02:09:38.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.696+0000 7fe75971af40 1 -- start start 2024-04-25T02:09:38.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe75971af40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55637f8d7070 0x55637f8d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe75971af40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637f8ebf80 0x55637f8f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe75971af40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55637f8f2240 0x55637f8f4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe75971af40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55637f8f2f50 con 0x55637f8ebf80 2024-04-25T02:09:38.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe75971af40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55637f7c1640 con 0x55637f8d7070 2024-04-25T02:09:38.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe75971af40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55637f8f2d30 con 0x55637f8f2240 2024-04-25T02:09:38.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe755fd8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637f8ebf80 0x55637f8f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe755fd8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637f8ebf80 0x55637f8f0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36390/0 (socket says 172.21.15.79:36390) 2024-04-25T02:09:38.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe755fd8640 1 -- 172.21.15.79:0/1288076724 learned_addr learned my addr 172.21.15.79:0/1288076724 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:38.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe756fda640 1 --2- 172.21.15.79:0/1288076724 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55637f8f2240 0x55637f8f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe755fd8640 1 -- 172.21.15.79:0/1288076724 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55637f8f2240 msgr2=0x55637f8f4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe7567d9640 1 --2- 172.21.15.79:0/1288076724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55637f8d7070 0x55637f8d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe755fd8640 1 --2- 172.21.15.79:0/1288076724 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55637f8f2240 0x55637f8f4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe755fd8640 1 -- 172.21.15.79:0/1288076724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55637f8d7070 msgr2=0x55637f8d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe755fd8640 1 --2- 172.21.15.79:0/1288076724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55637f8d7070 0x55637f8d29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.697+0000 7fe755fd8640 1 -- 172.21.15.79:0/1288076724 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55637f81c9d0 con 0x55637f8ebf80 2024-04-25T02:09:38.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.698+0000 7fe755fd8640 1 --2- 172.21.15.79:0/1288076724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637f8ebf80 0x55637f8f0f20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00a770 tx=0x7fe74c00a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b6e5a14a63f23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.698+0000 7fe754fd6640 1 -- 172.21.15.79:0/1288076724 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c018070 con 0x55637f8ebf80 2024-04-25T02:09:38.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.698+0000 7fe754fd6640 1 -- 172.21.15.79:0/1288076724 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74c007600 con 0x55637f8ebf80 2024-04-25T02:09:38.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.698+0000 7fe754fd6640 1 -- 172.21.15.79:0/1288076724 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0079b0 con 0x55637f8ebf80 2024-04-25T02:09:38.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.698+0000 7fe75971af40 1 -- 172.21.15.79:0/1288076724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637f8ebf80 msgr2=0x55637f8f0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.698+0000 7fe75971af40 1 --2- 172.21.15.79:0/1288076724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637f8ebf80 0x55637f8f0f20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00a770 tx=0x7fe74c00a860 comp rx=0 tx=0).stop 2024-04-25T02:09:38.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.698+0000 7fe75971af40 1 -- 172.21.15.79:0/1288076724 shutdown_connections 2024-04-25T02:09:38.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.698+0000 7fe75971af40 1 --2- 172.21.15.79:0/1288076724 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55637f8f2240 0x55637f8f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.698+0000 7fe75971af40 1 --2- 172.21.15.79:0/1288076724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637f8ebf80 0x55637f8f0f20 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.698+0000 7fe75971af40 1 --2- 172.21.15.79:0/1288076724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55637f8d7070 0x55637f8d29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.698+0000 7fe75971af40 1 -- 172.21.15.79:0/1288076724 >> 172.21.15.79:0/1288076724 conn(0x55637f846920 msgr2=0x55637f85ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:38.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.698+0000 7fe75971af40 1 -- 172.21.15.79:0/1288076724 shutdown_connections 2024-04-25T02:09:38.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.698+0000 7fe75971af40 1 -- 172.21.15.79:0/1288076724 wait complete. 2024-04-25T02:09:38.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.699+0000 7fe75971af40 1 Processor -- start 2024-04-25T02:09:38.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.699+0000 7fe75971af40 1 -- start start 2024-04-25T02:09:38.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.699+0000 7fe75971af40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55637f8d7070 0x55637f8626b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe75971af40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55637f8ebf80 0x55637f8ecb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe75971af40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637f8f2240 0x55637f8ed060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe75971af40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55637f8d4060 con 0x55637f8f2240 2024-04-25T02:09:38.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe75971af40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55637f845c60 con 0x55637f8ebf80 2024-04-25T02:09:38.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe75971af40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55637f845930 con 0x55637f8d7070 2024-04-25T02:09:38.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe756fda640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637f8f2240 0x55637f8ed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe756fda640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637f8f2240 0x55637f8ed060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36398/0 (socket says 172.21.15.79:36398) 2024-04-25T02:09:38.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe756fda640 1 -- 172.21.15.79:0/3256252984 learned_addr learned my addr 172.21.15.79:0/3256252984 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:38.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe7567d9640 1 --2- 172.21.15.79:0/3256252984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55637f8d7070 0x55637f8626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe755fd8640 1 --2- 172.21.15.79:0/3256252984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55637f8ebf80 0x55637f8ecb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe756fda640 1 -- 172.21.15.79:0/3256252984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55637f8d7070 msgr2=0x55637f8626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe756fda640 1 --2- 172.21.15.79:0/3256252984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55637f8d7070 0x55637f8626b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe756fda640 1 -- 172.21.15.79:0/3256252984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55637f8ebf80 msgr2=0x55637f8ecb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe756fda640 1 --2- 172.21.15.79:0/3256252984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55637f8ebf80 0x55637f8ecb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe756fda640 1 -- 172.21.15.79:0/3256252984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55637f8621d0 con 0x55637f8f2240 2024-04-25T02:09:38.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe756fda640 1 --2- 172.21.15.79:0/3256252984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637f8f2240 0x55637f8ed060 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe750002110 tx=0x7fe75000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe7477fe640 1 -- 172.21.15.79:0/3256252984 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7500062d0 con 0x55637f8f2240 2024-04-25T02:09:38.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe7477fe640 1 -- 172.21.15.79:0/3256252984 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe750003450 con 0x55637f8f2240 2024-04-25T02:09:38.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe75971af40 1 -- 172.21.15.79:0/3256252984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55637f8ed5a0 con 0x55637f8f2240 2024-04-25T02:09:38.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe7477fe640 1 -- 172.21.15.79:0/3256252984 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750003860 con 0x55637f8f2240 2024-04-25T02:09:38.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.700+0000 7fe75971af40 1 -- 172.21.15.79:0/3256252984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55637f8f4990 con 0x55637f8f2240 2024-04-25T02:09:38.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.702+0000 7fe7477fe640 1 -- 172.21.15.79:0/3256252984 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe75001a020 con 0x55637f8f2240 2024-04-25T02:09:38.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.702+0000 7fe7477fe640 1 --2- 172.21.15.79:0/3256252984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe73806a810 0x7fe73806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.702+0000 7fe7477fe640 1 -- 172.21.15.79:0/3256252984 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fe7500895b0 con 0x55637f8f2240 2024-04-25T02:09:38.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.702+0000 7fe7567d9640 1 --2- 172.21.15.79:0/3256252984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe73806a810 0x7fe73806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.702+0000 7fe75971af40 1 --2- 172.21.15.79:0/3256252984 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55637f8643d0 0x55637f8d0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.702+0000 7fe75971af40 1 -- 172.21.15.79:0/3256252984 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45) -- 0x55637f8d0ac0 con 0x55637f8643d0 2024-04-25T02:09:38.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.702+0000 7fe755fd8640 1 --2- 172.21.15.79:0/3256252984 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55637f8643d0 0x55637f8d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.702+0000 7fe7567d9640 1 --2- 172.21.15.79:0/3256252984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe73806a810 0x7fe73806ccd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe748056000 tx=0x7fe748050000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.703+0000 7fe755fd8640 1 --2- 172.21.15.79:0/3256252984 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55637f8643d0 0x55637f8d0580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.704+0000 7fe755fd8640 1 -- 172.21.15.79:0/3256252984 <== osd.6 v2:172.21.15.189:6816/1254358257 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v45'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe74c0077b0 con 0x55637f8643d0 2024-04-25T02:09:38.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.704+0000 7fe75971af40 1 -- 172.21.15.79:0/3256252984 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55637f8643d0 msgr2=0x55637f8d0580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.704+0000 7fe75971af40 1 --2- 172.21.15.79:0/3256252984 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55637f8643d0 0x55637f8d0580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.704+0000 7fe75971af40 1 -- 172.21.15.79:0/3256252984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe73806a810 msgr2=0x7fe73806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.704+0000 7fe75971af40 1 --2- 172.21.15.79:0/3256252984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe73806a810 0x7fe73806ccd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe748056000 tx=0x7fe748050000 comp rx=0 tx=0).stop 2024-04-25T02:09:38.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.704+0000 7fe75971af40 1 -- 172.21.15.79:0/3256252984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637f8f2240 msgr2=0x55637f8ed060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.704+0000 7fe75971af40 1 --2- 172.21.15.79:0/3256252984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637f8f2240 0x55637f8ed060 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe750002110 tx=0x7fe75000c520 comp rx=0 tx=0).stop 2024-04-25T02:09:38.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.704+0000 7fe756fda640 1 -- 172.21.15.79:0/3256252984 reap_dead start 2024-04-25T02:09:38.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.704+0000 7fe75971af40 1 -- 172.21.15.79:0/3256252984 shutdown_connections 2024-04-25T02:09:38.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.704+0000 7fe75971af40 1 -- 172.21.15.79:0/3256252984 >> 172.21.15.79:0/3256252984 conn(0x55637f846920 msgr2=0x55637f8eff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:38.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.704+0000 7fe75971af40 1 -- 172.21.15.79:0/3256252984 shutdown_connections 2024-04-25T02:09:38.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.704+0000 7fe75971af40 1 -- 172.21.15.79:0/3256252984 wait complete. 2024-04-25T02:09:38.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T02:09:38.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:38.758 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2024-04-25T02:09:38.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.852+0000 7f2294acd640 1 Processor -- start 2024-04-25T02:09:38.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.852+0000 7f2294acd640 1 -- start start 2024-04-25T02:09:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f2294acd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f229015e440 0x7f22900cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f2294acd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22900d2f20 0x7f22900cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f2294acd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f22900d0990 0x7f22900d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f2294acd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f22900d1e80 con 0x7f229015e440 2024-04-25T02:09:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f2294acd640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f22900d2160 con 0x7f22900d0990 2024-04-25T02:09:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f2294acd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f22900d2440 con 0x7f22900d2f20 2024-04-25T02:09:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f228e59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f229015e440 0x7f22900cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f228e59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f229015e440 0x7f22900cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36408/0 (socket says 172.21.15.79:36408) 2024-04-25T02:09:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f228e59c640 1 -- 172.21.15.79:0/1630050866 learned_addr learned my addr 172.21.15.79:0/1630050866 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f228ed9d640 1 --2- 172.21.15.79:0/1630050866 >> v2:172.21.15.189:3300/0 conn(0x7f22900d0990 0x7f22900d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f2287fff640 1 --2- 172.21.15.79:0/1630050866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22900d2f20 0x7f22900cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f228e59c640 1 -- 172.21.15.79:0/1630050866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22900d2f20 msgr2=0x7f22900cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f228e59c640 1 --2- 172.21.15.79:0/1630050866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22900d2f20 0x7f22900cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f228e59c640 1 -- 172.21.15.79:0/1630050866 >> v2:172.21.15.189:3300/0 conn(0x7f22900d0990 msgr2=0x7f22900d0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f228e59c640 1 --2- 172.21.15.79:0/1630050866 >> v2:172.21.15.189:3300/0 conn(0x7f22900d0990 0x7f22900d0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f228e59c640 1 -- 172.21.15.79:0/1630050866 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22900d2720 con 0x7f229015e440 2024-04-25T02:09:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.853+0000 7f228ed9d640 1 --2- 172.21.15.79:0/1630050866 >> v2:172.21.15.189:3300/0 conn(0x7f22900d0990 0x7f22900d0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.854+0000 7f228e59c640 1 --2- 172.21.15.79:0/1630050866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f229015e440 0x7f22900cf870 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f22900ce650 tx=0x7f228002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ea6bcec8f08fa5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.854+0000 7f228dd9b640 1 -- 172.21.15.79:0/1630050866 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280037070 con 0x7f229015e440 2024-04-25T02:09:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.854+0000 7f228dd9b640 1 -- 172.21.15.79:0/1630050866 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2280032440 con 0x7f229015e440 2024-04-25T02:09:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.854+0000 7f228dd9b640 1 -- 172.21.15.79:0/1630050866 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280032810 con 0x7f229015e440 2024-04-25T02:09:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.855+0000 7f2294acd640 1 -- 172.21.15.79:0/1630050866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f229015e440 msgr2=0x7f22900cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.855+0000 7f2294acd640 1 --2- 172.21.15.79:0/1630050866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f229015e440 0x7f22900cf870 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f22900ce650 tx=0x7f228002a1e0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.855+0000 7f2294acd640 1 -- 172.21.15.79:0/1630050866 shutdown_connections 2024-04-25T02:09:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.855+0000 7f2294acd640 1 --2- 172.21.15.79:0/1630050866 >> v2:172.21.15.189:3300/0 conn(0x7f22900d0990 0x7f22900d0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.855+0000 7f2294acd640 1 --2- 172.21.15.79:0/1630050866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22900d2f20 0x7f22900cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.855+0000 7f2294acd640 1 --2- 172.21.15.79:0/1630050866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f229015e440 0x7f22900cf870 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.855+0000 7f2294acd640 1 -- 172.21.15.79:0/1630050866 >> 172.21.15.79:0/1630050866 conn(0x7f229009d450 msgr2=0x7f22900d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.855+0000 7f2294acd640 1 -- 172.21.15.79:0/1630050866 shutdown_connections 2024-04-25T02:09:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.855+0000 7f2294acd640 1 -- 172.21.15.79:0/1630050866 wait complete. 2024-04-25T02:09:38.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.856+0000 7f2294acd640 1 Processor -- start 2024-04-25T02:09:38.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.856+0000 7f2294acd640 1 -- start start 2024-04-25T02:09:38.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f2294acd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22900d0990 0x7f22901528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f2294acd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22900d2f20 0x7f22900b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f2294acd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f229015e440 0x7f22900b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f2294acd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2290161f90 con 0x7f22900d2f20 2024-04-25T02:09:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f2294acd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2290161e10 con 0x7f229015e440 2024-04-25T02:09:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f2294acd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2290162110 con 0x7f22900d0990 2024-04-25T02:09:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f2287fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22900d2f20 0x7f22900b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f2287fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22900d2f20 0x7f22900b6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36412/0 (socket says 172.21.15.79:36412) 2024-04-25T02:09:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f2287fff640 1 -- 172.21.15.79:0/1044889079 learned_addr learned my addr 172.21.15.79:0/1044889079 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f228ed9d640 1 --2- 172.21.15.79:0/1044889079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f229015e440 0x7f22900b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f228e59c640 1 --2- 172.21.15.79:0/1044889079 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22900d0990 0x7f22901528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f2287fff640 1 -- 172.21.15.79:0/1044889079 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22900d0990 msgr2=0x7f22901528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f2287fff640 1 --2- 172.21.15.79:0/1044889079 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22900d0990 0x7f22901528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f2287fff640 1 -- 172.21.15.79:0/1044889079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f229015e440 msgr2=0x7f22900b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f2287fff640 1 --2- 172.21.15.79:0/1044889079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f229015e440 0x7f22900b8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f2287fff640 1 -- 172.21.15.79:0/1044889079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2290157930 con 0x7f22900d2f20 2024-04-25T02:09:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.857+0000 7f2287fff640 1 --2- 172.21.15.79:0/1044889079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22900d2f20 0x7f22900b6cc0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f227800d800 tx=0x7f227800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.858+0000 7f2286ffd640 1 -- 172.21.15.79:0/1044889079 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227800b6c0 con 0x7f22900d2f20 2024-04-25T02:09:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.858+0000 7f2286ffd640 1 -- 172.21.15.79:0/1044889079 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2278019070 con 0x7f22900d2f20 2024-04-25T02:09:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.858+0000 7f2286ffd640 1 -- 172.21.15.79:0/1044889079 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227800ba80 con 0x7f22900d2f20 2024-04-25T02:09:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.858+0000 7f2294acd640 1 -- 172.21.15.79:0/1044889079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2290157bd0 con 0x7f22900d2f20 2024-04-25T02:09:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.858+0000 7f2294acd640 1 -- 172.21.15.79:0/1044889079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22900b77c0 con 0x7f22900d2f20 2024-04-25T02:09:38.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.859+0000 7f2286ffd640 1 -- 172.21.15.79:0/1044889079 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f227800bc20 con 0x7f22900d2f20 2024-04-25T02:09:38.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.860+0000 7f2286ffd640 1 --2- 172.21.15.79:0/1044889079 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f227006be30 0x7f227006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.860+0000 7f2286ffd640 1 -- 172.21.15.79:0/1044889079 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f227808b150 con 0x7f22900d2f20 2024-04-25T02:09:38.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.860+0000 7f228e59c640 1 --2- 172.21.15.79:0/1044889079 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f227006be30 0x7f227006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.860+0000 7f228e59c640 1 --2- 172.21.15.79:0/1044889079 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f227006be30 0x7f227006e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2280034000 tx=0x7f228002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.861+0000 7f22977dc740 1 Processor -- start 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.861+0000 7f22977dc740 1 -- start start 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.861+0000 7f22977dc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb3a280 0x55ca6eb3c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.861+0000 7f22977dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 0x55ca6eb3a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.861+0000 7f22977dc740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb64d40 0x55ca6eb651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.861+0000 7f22977dc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ca6ea9d2c0 con 0x55ca6eb3a280 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.861+0000 7f22977dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ca6ea45910 con 0x55ca6eb76950 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.861+0000 7f22977dc740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ca6ea99280 con 0x55ca6eb64d40 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.862+0000 7f228e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb3a280 0x55ca6eb3c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.862+0000 7f228e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb3a280 0x55ca6eb3c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36428/0 (socket says 172.21.15.79:36428) 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.862+0000 7f228e59c640 1 -- 172.21.15.79:0/1005450481 learned_addr learned my addr 172.21.15.79:0/1005450481 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.862+0000 7f228ed9d640 1 --2- 172.21.15.79:0/1005450481 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb64d40 0x55ca6eb651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.862+0000 7f2287fff640 1 --2- 172.21.15.79:0/1005450481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 0x55ca6eb3a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.862+0000 7f228e59c640 1 -- 172.21.15.79:0/1005450481 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb64d40 msgr2=0x55ca6eb651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.862+0000 7f228e59c640 1 --2- 172.21.15.79:0/1005450481 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb64d40 0x55ca6eb651c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.862+0000 7f228e59c640 1 -- 172.21.15.79:0/1005450481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 msgr2=0x55ca6eb3a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.862+0000 7f228e59c640 1 --2- 172.21.15.79:0/1005450481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 0x55ca6eb3a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.862+0000 7f228e59c640 1 -- 172.21.15.79:0/1005450481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6ea56fb0 con 0x55ca6eb3a280 2024-04-25T02:09:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.862+0000 7f228ed9d640 1 --2- 172.21.15.79:0/1005450481 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb64d40 0x55ca6eb651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.862+0000 7f228e59c640 1 --2- 172.21.15.79:0/1005450481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb3a280 0x55ca6eb3c3e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f22800090b0 tx=0x7f228002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a938fec114daab8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.862+0000 7f226ffff640 1 -- 172.21.15.79:0/1005450481 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228004e070 con 0x55ca6eb3a280 2024-04-25T02:09:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.862+0000 7f226ffff640 1 -- 172.21.15.79:0/1005450481 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2280032b40 con 0x55ca6eb3a280 2024-04-25T02:09:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.862+0000 7f226ffff640 1 -- 172.21.15.79:0/1005450481 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280037040 con 0x55ca6eb3a280 2024-04-25T02:09:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.863+0000 7f22977dc740 1 -- 172.21.15.79:0/1005450481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb3a280 msgr2=0x55ca6eb3c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.863+0000 7f22977dc740 1 --2- 172.21.15.79:0/1005450481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb3a280 0x55ca6eb3c3e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f22800090b0 tx=0x7f228002c000 comp rx=0 tx=0).stop 2024-04-25T02:09:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.863+0000 7f22977dc740 1 -- 172.21.15.79:0/1005450481 shutdown_connections 2024-04-25T02:09:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.863+0000 7f22977dc740 1 --2- 172.21.15.79:0/1005450481 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb64d40 0x55ca6eb651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.863+0000 7f22977dc740 1 --2- 172.21.15.79:0/1005450481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 0x55ca6eb3a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.863+0000 7f22977dc740 1 --2- 172.21.15.79:0/1005450481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb3a280 0x55ca6eb3c3e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.863+0000 7f22977dc740 1 -- 172.21.15.79:0/1005450481 >> 172.21.15.79:0/1005450481 conn(0x55ca6eb01950 msgr2=0x55ca6eb7fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.863+0000 7f22977dc740 1 -- 172.21.15.79:0/1005450481 shutdown_connections 2024-04-25T02:09:38.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.863+0000 7f22977dc740 1 -- 172.21.15.79:0/1005450481 wait complete. 2024-04-25T02:09:38.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.864+0000 7f22977dc740 1 -- start start 2024-04-25T02:09:38.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.864+0000 7f22977dc740 1 Processor -- start 2024-04-25T02:09:38.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f22977dc740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb3a280 0x55ca6eb50040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f22977dc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb64d40 0x55ca6eb7a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f22977dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 0x55ca6eb52790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f22977dc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ca6ea58e90 con 0x55ca6eb64d40 2024-04-25T02:09:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f22977dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ca6eb62890 con 0x55ca6eb76950 2024-04-25T02:09:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f22977dc740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ca6eb81790 con 0x55ca6eb3a280 2024-04-25T02:09:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f22977dc740 10 client.0 _ll_register_callbacks cb 0x55ca6ea94970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f2287fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb64d40 0x55ca6eb7a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f2287fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb64d40 0x55ca6eb7a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36432/0 (socket says 172.21.15.79:36432) 2024-04-25T02:09:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f228e59c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb3a280 0x55ca6eb50040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f2287fff640 1 -- 172.21.15.79:0/2294976316 learned_addr learned my addr 172.21.15.79:0/2294976316 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f228ed9d640 1 --2- 172.21.15.79:0/2294976316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 0x55ca6eb52790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f228e59c640 1 -- 172.21.15.79:0/2294976316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 msgr2=0x55ca6eb52790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f228e59c640 1 --2- 172.21.15.79:0/2294976316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 0x55ca6eb52790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f228e59c640 1 -- 172.21.15.79:0/2294976316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb64d40 msgr2=0x55ca6eb7a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f228e59c640 1 --2- 172.21.15.79:0/2294976316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb64d40 0x55ca6eb7a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f228e59c640 1 -- 172.21.15.79:0/2294976316 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55ca6e8797e0 con 0x55ca6eb3a280 2024-04-25T02:09:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f228ed9d640 1 --2- 172.21.15.79:0/2294976316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 0x55ca6eb52790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f2287fff640 1 --2- 172.21.15.79:0/2294976316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb64d40 0x55ca6eb7a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f228e59c640 1 --2- 172.21.15.79:0/2294976316 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb3a280 0x55ca6eb50040 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2280049000 tx=0x7f2280004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a734aea7ca9ceb9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f226d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.189:3301/0 2024-04-25T02:09:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f226d7fa640 1 -- 172.21.15.79:0/2294976316 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228004e070 con 0x55ca6eb3a280 2024-04-25T02:09:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f22977dc740 1 -- 172.21.15.79:0/2294976316 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2280032b40 con 0x55ca6eb3a280 2024-04-25T02:09:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.865+0000 7f226d7fa640 1 -- 172.21.15.79:0/2294976316 <== mon.2 v2:172.21.15.189:3301/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f2280053ab0 con 0x55ca6eb3a280 2024-04-25T02:09:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.866+0000 7f226d7fa640 1 -- 172.21.15.79:0/2294976316 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f2280037040 con 0x55ca6eb3a280 2024-04-25T02:09:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.866+0000 7f22977dc740 10 client.5021 fetch_fsmap learned FSMap version 18 2024-04-25T02:09:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.866+0000 7f22977dc740 1 -- 172.21.15.79:0/2294976316 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55ca6e8d9f70 con 0x55ca6eb3a280 2024-04-25T02:09:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.866+0000 7f226d7fa640 1 -- 172.21.15.79:0/2294976316 <== mon.2 v2:172.21.15.189:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2280032b40 con 0x55ca6eb3a280 2024-04-25T02:09:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.866+0000 7f226d7fa640 1 -- 172.21.15.79:0/2294976316 <== mon.2 v2:172.21.15.189:3301/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f2280053cb0 con 0x55ca6eb3a280 2024-04-25T02:09:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.866+0000 7f22977dc740 10 client.5021 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T02:09:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.866+0000 7f22977dc740 10 client.5021 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-04-25T02:09:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.866+0000 7f22977dc740 20 client.5021 populate_metadata read hostname 'smithi079' 2024-04-25T02:09:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.866+0000 7f22977dc740 1 --2- 172.21.15.79:0/2294976316 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55ca6eb53470 0x55ca6eb51710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.866+0000 7f22977dc740 4 client.5021 mds_command: new command op to 5598 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:09:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.866+0000 7f22977dc740 1 -- 172.21.15.79:0/2294976316 --> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca6ea715a0 con 0x55ca6eb53470 2024-04-25T02:09:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.866+0000 7f2287fff640 1 --2- 172.21.15.79:0/2294976316 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55ca6eb53470 0x55ca6eb51710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.867+0000 7f226d7fa640 10 client.5021 ms_handle_connect on v2:172.21.15.189:6832/1295756642 2024-04-25T02:09:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.867+0000 7f2287fff640 1 --2- 172.21.15.79:0/2294976316 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55ca6eb53470 0x55ca6eb51710 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da077b905a681967 server_cookie=2f57208644d4ee3d in_seq=0 out_seq=0 2024-04-25T02:09:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.867+0000 7f226d7fa640 1 -- 172.21.15.79:0/2294976316 <== mds.0 v2:172.21.15.189:6832/1295756642 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ca6ea715a0 con 0x55ca6eb53470 2024-04-25T02:09:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.867+0000 7f226d7fa640 10 client.5021 handle_command_reply: tid=0 2024-04-25T02:09:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.867+0000 7f22977dc740 1 client.5021 shutdown 2024-04-25T02:09:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.867+0000 7f22977dc740 1 -- 172.21.15.79:0/2294976316 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb3a280 msgr2=0x55ca6eb50040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.867+0000 7f22977dc740 1 --2- 172.21.15.79:0/2294976316 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb3a280 0x55ca6eb50040 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2280049000 tx=0x7f2280004730 comp rx=0 tx=0).stop 2024-04-25T02:09:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.868+0000 7f22977dc740 1 -- 172.21.15.79:0/2294976316 shutdown_connections 2024-04-25T02:09:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.868+0000 7f22977dc740 1 --2- 172.21.15.79:0/2294976316 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55ca6eb53470 0x55ca6eb51710 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.868+0000 7f22977dc740 1 --2- 172.21.15.79:0/2294976316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 0x55ca6eb52790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.868+0000 7f226d7fa640 0 client.5021 ms_handle_reset on v2:172.21.15.189:6832/1295756642 2024-04-25T02:09:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.868+0000 7f22977dc740 1 --2- 172.21.15.79:0/2294976316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb64d40 0x55ca6eb7a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.868+0000 7f22977dc740 1 --2- 172.21.15.79:0/2294976316 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb3a280 0x55ca6eb50040 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.868+0000 7f22977dc740 1 -- 172.21.15.79:0/2294976316 >> 172.21.15.79:0/2294976316 conn(0x55ca6eb01950 msgr2=0x55ca6eb61fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.868+0000 7f22977dc740 1 -- 172.21.15.79:0/2294976316 shutdown_connections 2024-04-25T02:09:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.868+0000 7f22977dc740 1 -- 172.21.15.79:0/2294976316 wait complete. 2024-04-25T02:09:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.868+0000 7f22977dc740 20 client.5021 trim_cache size 0 max 16384 2024-04-25T02:09:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.871+0000 7f726021c640 1 Processor -- start 2024-04-25T02:09:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.872+0000 7f726021c640 1 -- start start 2024-04-25T02:09:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.872+0000 7f726021c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7258161870 0x7f725815f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.872+0000 7f726021c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72580d0140 0x7f725806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.872+0000 7f726021c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725815f900 con 0x7f725806ffe0 2024-04-25T02:09:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.872+0000 7f726021c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f72580d11f0 con 0x7f7258161870 2024-04-25T02:09:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.872+0000 7f726021c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7258161c50 con 0x7f72580d0140 2024-04-25T02:09:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.872+0000 7f725dfb8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7258161870 0x7f725815f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.872+0000 7f725dfb8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7258161870 0x7f725815f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36442/0 (socket says 172.21.15.79:36442) 2024-04-25T02:09:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.872+0000 7f725dfb8640 1 -- 172.21.15.79:0/2704481515 learned_addr learned my addr 172.21.15.79:0/2704481515 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.873+0000 7f725d7b7640 1 --2- 172.21.15.79:0/2704481515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72580d0140 0x7f725806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.873+0000 7f725dfb8640 1 -- 172.21.15.79:0/2704481515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72580d0140 msgr2=0x7f725806faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.873+0000 7f725dfb8640 1 --2- 172.21.15.79:0/2704481515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72580d0140 0x7f725806faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.873+0000 7f725dfb8640 1 -- 172.21.15.79:0/2704481515 >> v1:172.21.15.189:6789/0 conn(0x7f725806ffe0 legacy=0x7f725815db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.873+0000 7f725dfb8640 1 -- 172.21.15.79:0/2704481515 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72580d05e0 con 0x7f7258161870 2024-04-25T02:09:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.873+0000 7f725dfb8640 1 --2- 172.21.15.79:0/2704481515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7258161870 0x7f725815f3c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7254009870 tx=0x7f725402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e6b2ef6e43c1fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.873+0000 7f725cfb6640 1 -- 172.21.15.79:0/2704481515 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7254037070 con 0x7f7258161870 2024-04-25T02:09:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.874+0000 7f725cfb6640 1 -- 172.21.15.79:0/2704481515 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7254032440 con 0x7f7258161870 2024-04-25T02:09:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.874+0000 7f725cfb6640 1 -- 172.21.15.79:0/2704481515 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7254032810 con 0x7f7258161870 2024-04-25T02:09:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.874+0000 7f726021c640 1 -- 172.21.15.79:0/2704481515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7258161870 msgr2=0x7f725815f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.874+0000 7f726021c640 1 --2- 172.21.15.79:0/2704481515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7258161870 0x7f725815f3c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7254009870 tx=0x7f725402a2a0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.874+0000 7f726021c640 1 -- 172.21.15.79:0/2704481515 shutdown_connections 2024-04-25T02:09:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.874+0000 7f726021c640 1 --2- 172.21.15.79:0/2704481515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72580d0140 0x7f725806faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.874+0000 7f726021c640 1 --2- 172.21.15.79:0/2704481515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7258161870 0x7f725815f3c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.874+0000 7f726021c640 1 -- 172.21.15.79:0/2704481515 >> 172.21.15.79:0/2704481515 conn(0x7f72580b3a70 msgr2=0x7f72580b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.874+0000 7f726021c640 1 -- 172.21.15.79:0/2704481515 shutdown_connections 2024-04-25T02:09:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.874+0000 7f726021c640 1 -- 172.21.15.79:0/2704481515 wait complete. 2024-04-25T02:09:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.875+0000 7f726021c640 1 Processor -- start 2024-04-25T02:09:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.875+0000 7f726021c640 1 -- start start 2024-04-25T02:09:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.876+0000 7f726021c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f725806ffe0 0x7f72580b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.876+0000 7f726021c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72580d0140 0x7f72580b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.876+0000 7f726021c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7258161870 0x7f7258158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.876+0000 7f726021c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f72580d0ba0 con 0x7f725806ffe0 2024-04-25T02:09:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.876+0000 7f726021c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f72580d08c0 con 0x7f7258161870 2024-04-25T02:09:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.876+0000 7f726021c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f72580d0e80 con 0x7f72580d0140 2024-04-25T02:09:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.876+0000 7f725dfb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f725806ffe0 0x7f72580b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.876+0000 7f725dfb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f725806ffe0 0x7f72580b5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36458/0 (socket says 172.21.15.79:36458) 2024-04-25T02:09:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.876+0000 7f725dfb8640 1 -- 172.21.15.79:0/1003398876 learned_addr learned my addr 172.21.15.79:0/1003398876 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.876+0000 7f725d7b7640 1 --2- 172.21.15.79:0/1003398876 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72580d0140 0x7f72580b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.876+0000 7f725e7b9640 1 --2- 172.21.15.79:0/1003398876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7258161870 0x7f7258158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.877+0000 7f725dfb8640 1 -- 172.21.15.79:0/1003398876 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72580d0140 msgr2=0x7f72580b7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.877+0000 7f725dfb8640 1 --2- 172.21.15.79:0/1003398876 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72580d0140 0x7f72580b7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.877+0000 7f725dfb8640 1 -- 172.21.15.79:0/1003398876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7258161870 msgr2=0x7f7258158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.877+0000 7f725dfb8640 1 --2- 172.21.15.79:0/1003398876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7258161870 0x7f7258158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.877+0000 7f725dfb8640 1 -- 172.21.15.79:0/1003398876 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72580b5ca0 con 0x7f725806ffe0 2024-04-25T02:09:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.877+0000 7f725e7b9640 1 --2- 172.21.15.79:0/1003398876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7258161870 0x7f7258158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.877+0000 7f725dfb8640 1 --2- 172.21.15.79:0/1003398876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f725806ffe0 0x7f72580b5570 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7254009870 tx=0x7f72540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.877+0000 7f724e7fc640 1 -- 172.21.15.79:0/1003398876 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7254041070 con 0x7f725806ffe0 2024-04-25T02:09:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.877+0000 7f724e7fc640 1 -- 172.21.15.79:0/1003398876 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725403c890 con 0x7f725806ffe0 2024-04-25T02:09:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.877+0000 7f726021c640 1 -- 172.21.15.79:0/1003398876 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72580b5f80 con 0x7f725806ffe0 2024-04-25T02:09:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.877+0000 7f724e7fc640 1 -- 172.21.15.79:0/1003398876 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7254037040 con 0x7f725806ffe0 2024-04-25T02:09:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.877+0000 7f726021c640 1 -- 172.21.15.79:0/1003398876 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72581565b0 con 0x7f725806ffe0 2024-04-25T02:09:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.878+0000 7f723bfff640 1 -- 172.21.15.79:0/1003398876 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f7234005270 con 0x7f725806ffe0 2024-04-25T02:09:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.879+0000 7f724e7fc640 1 -- 172.21.15.79:0/1003398876 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7254044070 con 0x7f725806ffe0 2024-04-25T02:09:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.879+0000 7f724e7fc640 1 --2- 172.21.15.79:0/1003398876 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f723c06be30 0x7f723c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.879+0000 7f724e7fc640 1 -- 172.21.15.79:0/1003398876 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f72540abdf0 con 0x7f725806ffe0 2024-04-25T02:09:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.879+0000 7f725d7b7640 1 --2- 172.21.15.79:0/1003398876 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f723c06be30 0x7f723c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.879+0000 7f724e7fc640 1 -- 172.21.15.79:0/1003398876 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+505 (secure 0 0 0) 0x7f72540ac2a0 con 0x7f725806ffe0 2024-04-25T02:09:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.879+0000 7f726021c640 1 -- 172.21.15.79:0/1003398876 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7f7234005550 con 0x7f725806ffe0 2024-04-25T02:09:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.879+0000 7f725d7b7640 1 --2- 172.21.15.79:0/1003398876 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f723c06be30 0x7f723c06e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f72580b0e70 tx=0x7f7248008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.887+0000 7f22977dc740 1 Processor -- start 2024-04-25T02:09:38.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.887+0000 7f22977dc740 1 -- start start 2024-04-25T02:09:38.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.887+0000 7f22977dc740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb3a280 0x55ca6eb66d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.887+0000 7f22977dc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb64d40 0x55ca6eb7ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.887+0000 7f22977dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 0x55ca6eb7b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.887+0000 7f22977dc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ca6eb80cc0 con 0x55ca6eb64d40 2024-04-25T02:09:38.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.887+0000 7f22977dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2290200660 con 0x55ca6eb76950 2024-04-25T02:09:38.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.887+0000 7f22977dc740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2290158d50 con 0x55ca6eb3a280 2024-04-25T02:09:38.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.887+0000 7f2287fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb64d40 0x55ca6eb7ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.888+0000 7f2287fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb64d40 0x55ca6eb7ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36472/0 (socket says 172.21.15.79:36472) 2024-04-25T02:09:38.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.888+0000 7f2287fff640 1 -- 172.21.15.79:0/316793482 learned_addr learned my addr 172.21.15.79:0/316793482 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:38.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.888+0000 7f228ed9d640 1 --2- 172.21.15.79:0/316793482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 0x55ca6eb7b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.888+0000 7f228e59c640 1 --2- 172.21.15.79:0/316793482 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb3a280 0x55ca6eb66d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.888+0000 7f2287fff640 1 -- 172.21.15.79:0/316793482 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb3a280 msgr2=0x55ca6eb66d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.888+0000 7f2287fff640 1 --2- 172.21.15.79:0/316793482 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb3a280 0x55ca6eb66d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.888+0000 7f2287fff640 1 -- 172.21.15.79:0/316793482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 msgr2=0x55ca6eb7b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.888+0000 7f2287fff640 1 --2- 172.21.15.79:0/316793482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 0x55ca6eb7b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.888+0000 7f2287fff640 1 -- 172.21.15.79:0/316793482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6e771170 con 0x55ca6eb64d40 2024-04-25T02:09:38.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.888+0000 7f2287fff640 1 --2- 172.21.15.79:0/316793482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb64d40 0x55ca6eb7ad90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f227800d7d0 tx=0x7f227808b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708389435544f3ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.888+0000 7f226f7fe640 1 -- 172.21.15.79:0/316793482 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2278086020 con 0x55ca6eb64d40 2024-04-25T02:09:38.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.888+0000 7f226f7fe640 1 -- 172.21.15.79:0/316793482 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2278089760 con 0x55ca6eb64d40 2024-04-25T02:09:38.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.888+0000 7f226f7fe640 1 -- 172.21.15.79:0/316793482 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2278055bb0 con 0x55ca6eb64d40 2024-04-25T02:09:38.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.889+0000 7f22977dc740 1 -- 172.21.15.79:0/316793482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb64d40 msgr2=0x55ca6eb7ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.889+0000 7f22977dc740 1 --2- 172.21.15.79:0/316793482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb64d40 0x55ca6eb7ad90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f227800d7d0 tx=0x7f227808b040 comp rx=0 tx=0).stop 2024-04-25T02:09:38.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.889+0000 7f22977dc740 1 -- 172.21.15.79:0/316793482 shutdown_connections 2024-04-25T02:09:38.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.889+0000 7f22977dc740 1 --2- 172.21.15.79:0/316793482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb76950 0x55ca6eb7b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.889+0000 7f22977dc740 1 --2- 172.21.15.79:0/316793482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb64d40 0x55ca6eb7ad90 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.889+0000 7f22977dc740 1 --2- 172.21.15.79:0/316793482 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb3a280 0x55ca6eb66d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.889+0000 7f22977dc740 1 -- 172.21.15.79:0/316793482 >> 172.21.15.79:0/316793482 conn(0x55ca6eb01950 msgr2=0x55ca6eb51e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:38.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.889+0000 7f22977dc740 1 -- 172.21.15.79:0/316793482 shutdown_connections 2024-04-25T02:09:38.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.889+0000 7f22977dc740 1 -- 172.21.15.79:0/316793482 wait complete. 2024-04-25T02:09:38.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.889+0000 7f22977dc740 1 -- start start 2024-04-25T02:09:38.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.889+0000 7f22977dc740 1 Processor -- start 2024-04-25T02:09:38.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.890+0000 7f22977dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb3a280 0x55ca6eb634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.890+0000 7f22977dc740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb64d40 0x55ca6eb62c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.890+0000 7f22977dc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb76950 0x55ca6eb795a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.890+0000 7f22977dc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2290158700 con 0x55ca6eb76950 2024-04-25T02:09:38.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.890+0000 7f22977dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f22901580b0 con 0x55ca6eb3a280 2024-04-25T02:09:38.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.890+0000 7f22977dc740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ca6ea715a0 con 0x55ca6eb64d40 2024-04-25T02:09:38.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.890+0000 7f22977dc740 10 client.0 _ll_register_callbacks cb 0x7f228004c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:38.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.890+0000 7f228ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb76950 0x55ca6eb795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.890+0000 7f228ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb76950 0x55ca6eb795a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36474/0 (socket says 172.21.15.79:36474) 2024-04-25T02:09:38.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.890+0000 7f228ed9d640 1 -- 172.21.15.79:0/1030455507 learned_addr learned my addr 172.21.15.79:0/1030455507 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:38.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f228e59c640 1 --2- 172.21.15.79:0/1030455507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb3a280 0x55ca6eb634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f2287fff640 1 --2- 172.21.15.79:0/1030455507 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb64d40 0x55ca6eb62c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f228ed9d640 1 -- 172.21.15.79:0/1030455507 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb64d40 msgr2=0x55ca6eb62c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f228ed9d640 1 --2- 172.21.15.79:0/1030455507 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb64d40 0x55ca6eb62c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f228ed9d640 1 -- 172.21.15.79:0/1030455507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb3a280 msgr2=0x55ca6eb634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:38.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f228ed9d640 1 --2- 172.21.15.79:0/1030455507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb3a280 0x55ca6eb634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f228ed9d640 1 -- 172.21.15.79:0/1030455507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca6eb63160 con 0x55ca6eb76950 2024-04-25T02:09:38.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f2287fff640 1 --2- 172.21.15.79:0/1030455507 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb64d40 0x55ca6eb62c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:38.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f228e59c640 1 --2- 172.21.15.79:0/1030455507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb3a280 0x55ca6eb634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:38.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f228ed9d640 1 --2- 172.21.15.79:0/1030455507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb76950 0x55ca6eb795a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x55ca6eb80e40 tx=0x7f2288015700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfefdc5fd91e3988 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:38.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f226d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:09:38.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f226d7fa640 1 -- 172.21.15.79:0/1030455507 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288023680 con 0x55ca6eb76950 2024-04-25T02:09:38.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f226d7fa640 1 -- 172.21.15.79:0/1030455507 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f2288023820 con 0x55ca6eb76950 2024-04-25T02:09:38.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f22977dc740 1 -- 172.21.15.79:0/1030455507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2278089760 con 0x55ca6eb76950 2024-04-25T02:09:38.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f226d7fa640 1 -- 172.21.15.79:0/1030455507 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f228802b050 con 0x55ca6eb76950 2024-04-25T02:09:38.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f22977dc740 10 client.5835 fetch_fsmap learned FSMap version 18 2024-04-25T02:09:38.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f22977dc740 1 -- 172.21.15.79:0/1030455507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55ca6eb79ae0 con 0x55ca6eb76950 2024-04-25T02:09:38.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f226d7fa640 1 -- 172.21.15.79:0/1030455507 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2278089760 con 0x55ca6eb76950 2024-04-25T02:09:38.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f226d7fa640 1 -- 172.21.15.79:0/1030455507 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f228802e020 con 0x55ca6eb76950 2024-04-25T02:09:38.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f22977dc740 10 client.5835 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T02:09:38.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f22977dc740 10 client.5835 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-04-25T02:09:38.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f22977dc740 20 client.5835 populate_metadata read hostname 'smithi079' 2024-04-25T02:09:38.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f22977dc740 1 --2- 172.21.15.79:0/1030455507 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55ca6ebf65c0 0x55ca6ebf69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:38.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f22977dc740 4 client.5835 mds_command: new command op to 5598 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T02:09:38.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.891+0000 7f22977dc740 1 -- 172.21.15.79:0/1030455507 --> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x55ca6eaaa800 con 0x55ca6ebf65c0 2024-04-25T02:09:38.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.892+0000 7f228e59c640 1 --2- 172.21.15.79:0/1030455507 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55ca6ebf65c0 0x55ca6ebf69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:38.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.892+0000 7f226d7fa640 10 client.5835 ms_handle_connect on v2:172.21.15.189:6832/1295756642 2024-04-25T02:09:38.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.892+0000 7f228e59c640 1 --2- 172.21.15.79:0/1030455507 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55ca6ebf65c0 0x55ca6ebf69a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbf33b766bc03572 server_cookie=a3a78dcb0c0092bd in_seq=0 out_seq=0 2024-04-25T02:09:38.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.892+0000 7f226d7fa640 1 -- 172.21.15.79:0/1030455507 <== mds.0 v2:172.21.15.189:6832/1295756642 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ca6eaaa800 con 0x55ca6ebf65c0 2024-04-25T02:09:38.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.892+0000 7f226d7fa640 10 client.5835 handle_command_reply: tid=0 2024-04-25T02:09:38.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.893+0000 7f22977dc740 1 client.5835 shutdown 2024-04-25T02:09:38.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.893+0000 7f22977dc740 1 -- 172.21.15.79:0/1030455507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb76950 msgr2=0x55ca6eb795a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.893+0000 7f22977dc740 1 --2- 172.21.15.79:0/1030455507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb76950 0x55ca6eb795a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x55ca6eb80e40 tx=0x7f2288015700 comp rx=0 tx=0).stop 2024-04-25T02:09:38.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.893+0000 7f22977dc740 1 -- 172.21.15.79:0/1030455507 shutdown_connections 2024-04-25T02:09:38.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.893+0000 7f22977dc740 1 --2- 172.21.15.79:0/1030455507 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55ca6ebf65c0 0x55ca6ebf69a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.893+0000 7f22977dc740 1 --2- 172.21.15.79:0/1030455507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca6eb76950 0x55ca6eb795a0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.893+0000 7f22977dc740 1 --2- 172.21.15.79:0/1030455507 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ca6eb64d40 0x55ca6eb62c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.893+0000 7f226d7fa640 0 client.5835 ms_handle_reset on v2:172.21.15.189:6832/1295756642 2024-04-25T02:09:38.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.893+0000 7f22977dc740 1 --2- 172.21.15.79:0/1030455507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca6eb3a280 0x55ca6eb634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.893+0000 7f22977dc740 1 -- 172.21.15.79:0/1030455507 >> 172.21.15.79:0/1030455507 conn(0x55ca6eb01950 msgr2=0x55ca6eb7ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:38.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.893+0000 7f22977dc740 1 -- 172.21.15.79:0/1030455507 shutdown_connections 2024-04-25T02:09:38.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.893+0000 7f22977dc740 1 -- 172.21.15.79:0/1030455507 wait complete. 2024-04-25T02:09:38.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.893+0000 7f22977dc740 20 client.5835 trim_cache size 0 max 16384 2024-04-25T02:09:38.906 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:09:38.906 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-04-25T02:09:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "ef25adcb-4c80-4b15-8ea3-07756035a996", 2024-04-25T02:09:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-04-25T02:09:38.907 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:09:38.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.893+0000 7f2294acd640 1 -- 172.21.15.79:0/1044889079 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f227006be30 msgr2=0x7f227006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.893+0000 7f2294acd640 1 --2- 172.21.15.79:0/1044889079 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f227006be30 0x7f227006e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2280034000 tx=0x7f228002e000 comp rx=0 tx=0).stop 2024-04-25T02:09:38.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.894+0000 7f2294acd640 1 -- 172.21.15.79:0/1044889079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22900d2f20 msgr2=0x7f22900b6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:38.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.894+0000 7f2294acd640 1 --2- 172.21.15.79:0/1044889079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22900d2f20 0x7f22900b6cc0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f227800d800 tx=0x7f227800dcc0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.894+0000 7f2294acd640 1 -- 172.21.15.79:0/1044889079 shutdown_connections 2024-04-25T02:09:38.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.894+0000 7f2294acd640 1 --2- 172.21.15.79:0/1044889079 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f227006be30 0x7f227006e2f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.894+0000 7f2294acd640 1 --2- 172.21.15.79:0/1044889079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f229015e440 0x7f22900b8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.894+0000 7f2294acd640 1 --2- 172.21.15.79:0/1044889079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22900d2f20 0x7f22900b6cc0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.894+0000 7f2294acd640 1 --2- 172.21.15.79:0/1044889079 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22900d0990 0x7f22901528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:38.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.894+0000 7f2294acd640 1 -- 172.21.15.79:0/1044889079 >> 172.21.15.79:0/1044889079 conn(0x7f229009d450 msgr2=0x7f229006bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:38.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.894+0000 7f2294acd640 1 -- 172.21.15.79:0/1044889079 shutdown_connections 2024-04-25T02:09:38.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:38.894+0000 7f2294acd640 1 -- 172.21.15.79:0/1044889079 wait complete. 2024-04-25T02:09:38.909 INFO:tasks.ceph.mds.b.smithi189.stderr:2024-04-25T02:09:38.893+0000 7fc97f915640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5778=0-4194304@1} caps={5778=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5778 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x564f03960680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:09:38.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:38.912 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T02:09:39.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.003+0000 7fda12ae1640 1 Processor -- start 2024-04-25T02:09:39.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.003+0000 7fda12ae1640 1 -- start start 2024-04-25T02:09:39.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.003+0000 7fda12ae1640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fda0c0d10c0 0x7fda0c06bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.003+0000 7fda12ae1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda0c0d1ee0 con 0x7fda0c15e4f0 2024-04-25T02:09:39.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.003+0000 7fda12ae1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda0c0d21c0 con 0x7fda0c0d2ca0 2024-04-25T02:09:39.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.003+0000 7fda12ae1640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fda0c0d3130 con 0x7fda0c0d10c0 2024-04-25T02:09:39.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.004+0000 7fda1087d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fda0c15e4f0 0x7fda0c0cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42496/0 (socket says 172.21.15.79:42496) 2024-04-25T02:09:39.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.004+0000 7fda1087d640 1 -- 172.21.15.79:0/4137986502 learned_addr learned my addr 172.21.15.79:0/4137986502 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:09:39.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.004+0000 7fda1107e640 1 --2- 172.21.15.79:0/4137986502 >> v2:172.21.15.189:3300/0 conn(0x7fda0c0d10c0 0x7fda0c06bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:39.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.004+0000 7fda0b7fe640 1 -- 172.21.15.79:0/4137986502 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3235595074 0 0) 0x7fda0c0d1ee0 con 0x7fda0c15e4f0 2024-04-25T02:09:39.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.004+0000 7fda0b7fe640 1 -- 172.21.15.79:0/4137986502 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9f4003520 con 0x7fda0c15e4f0 2024-04-25T02:09:39.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.004+0000 7fda0b7fe640 1 -- 172.21.15.79:0/4137986502 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4118097369 0 0) 0x7fd9f4003520 con 0x7fda0c15e4f0 2024-04-25T02:09:39.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.004+0000 7fda1107e640 1 -- 172.21.15.79:0/4137986502 >> v1:172.21.15.189:6789/0 conn(0x7fda0c0d2ca0 legacy=0x7fda0c0d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:39.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.004+0000 7fda1107e640 1 -- 172.21.15.79:0/4137986502 >> v1:172.21.15.79:6789/0 conn(0x7fda0c15e4f0 legacy=0x7fda0c0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:39.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.004+0000 7fda1107e640 1 -- 172.21.15.79:0/4137986502 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0c0d24a0 con 0x7fda0c0d10c0 2024-04-25T02:09:39.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.005+0000 7fda1107e640 1 --2- 172.21.15.79:0/4137986502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda0c0d10c0 0x7fda0c06bc30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fda04009dc0 tx=0x7fda0402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23f5e9873b963e35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:39.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.005+0000 7fda0b7fe640 1 -- 172.21.15.79:0/4137986502 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda04035020 con 0x7fda0c0d10c0 2024-04-25T02:09:39.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.005+0000 7fda0b7fe640 1 -- 172.21.15.79:0/4137986502 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda04007540 con 0x7fda0c0d10c0 2024-04-25T02:09:39.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.005+0000 7fda0b7fe640 1 -- 172.21.15.79:0/4137986502 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc001670 con 0x7fda0c0d10c0 2024-04-25T02:09:39.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.005+0000 7fda12ae1640 1 -- 172.21.15.79:0/4137986502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda0c0d10c0 msgr2=0x7fda0c06bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:39.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.006+0000 7fda12ae1640 1 --2- 172.21.15.79:0/4137986502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda0c0d10c0 0x7fda0c06bc30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fda04009dc0 tx=0x7fda0402a5d0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.006+0000 7fda12ae1640 1 -- 172.21.15.79:0/4137986502 shutdown_connections 2024-04-25T02:09:39.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.006+0000 7fda12ae1640 1 --2- 172.21.15.79:0/4137986502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda0c0d10c0 0x7fda0c06bc30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.006+0000 7fda12ae1640 1 -- 172.21.15.79:0/4137986502 >> 172.21.15.79:0/4137986502 conn(0x7fda0c09d4a0 msgr2=0x7fda0c0d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:39.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.006+0000 7fda12ae1640 1 -- 172.21.15.79:0/4137986502 shutdown_connections 2024-04-25T02:09:39.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.006+0000 7fda12ae1640 1 -- 172.21.15.79:0/4137986502 wait complete. 2024-04-25T02:09:39.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.007+0000 7fda12ae1640 1 Processor -- start 2024-04-25T02:09:39.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.007+0000 7fda12ae1640 1 -- start start 2024-04-25T02:09:39.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda12ae1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fda0c0d10c0 0x7fda0c0c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda12ae1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda0c0d2ca0 0x7fda0c1553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda12ae1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda0c15e4f0 0x7fda0c1f4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda12ae1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c0d4ee0 con 0x7fda0c0d2ca0 2024-04-25T02:09:39.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda12ae1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c0cff00 con 0x7fda0c15e4f0 2024-04-25T02:09:39.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda12ae1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fda0c0d5060 con 0x7fda0c0d10c0 2024-04-25T02:09:39.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda0bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda0c0d2ca0 0x7fda0c1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:39.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda0bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda0c0d2ca0 0x7fda0c1553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36490/0 (socket says 172.21.15.79:36490) 2024-04-25T02:09:39.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda0bfff640 1 -- 172.21.15.79:0/128821568 learned_addr learned my addr 172.21.15.79:0/128821568 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:39.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda1087d640 1 --2- 172.21.15.79:0/128821568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fda0c0d10c0 0x7fda0c0c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:39.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda1107e640 1 --2- 172.21.15.79:0/128821568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda0c15e4f0 0x7fda0c1f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:39.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda0bfff640 1 -- 172.21.15.79:0/128821568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fda0c0d10c0 msgr2=0x7fda0c0c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:39.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda0bfff640 1 --2- 172.21.15.79:0/128821568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fda0c0d10c0 0x7fda0c0c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda0bfff640 1 -- 172.21.15.79:0/128821568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda0c15e4f0 msgr2=0x7fda0c1f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:39.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda0bfff640 1 --2- 172.21.15.79:0/128821568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda0c15e4f0 0x7fda0c1f4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda0bfff640 1 -- 172.21.15.79:0/128821568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0c1f5060 con 0x7fda0c0d2ca0 2024-04-25T02:09:39.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda0bfff640 1 --2- 172.21.15.79:0/128821568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda0c0d2ca0 0x7fda0c1553f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c570 tx=0x7fda0000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:39.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda097fa640 1 -- 172.21.15.79:0/128821568 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00005480 con 0x7fda0c0d2ca0 2024-04-25T02:09:39.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda097fa640 1 -- 172.21.15.79:0/128821568 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda000035f0 con 0x7fda0c0d2ca0 2024-04-25T02:09:39.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda12ae1640 1 -- 172.21.15.79:0/128821568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda0c0c9a70 con 0x7fda0c0d2ca0 2024-04-25T02:09:39.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda097fa640 1 -- 172.21.15.79:0/128821568 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda000039c0 con 0x7fda0c0d2ca0 2024-04-25T02:09:39.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.008+0000 7fda12ae1640 1 -- 172.21.15.79:0/128821568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda0c0c80b0 con 0x7fda0c0d2ca0 2024-04-25T02:09:39.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.010+0000 7fda097fa640 1 -- 172.21.15.79:0/128821568 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda00003b60 con 0x7fda0c0d2ca0 2024-04-25T02:09:39.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.010+0000 7fda097fa640 1 --2- 172.21.15.79:0/128821568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd9f806bfd0 0x7fd9f806e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.010+0000 7fda097fa640 1 -- 172.21.15.79:0/128821568 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fda0008a9f0 con 0x7fda0c0d2ca0 2024-04-25T02:09:39.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.010+0000 7fda1087d640 1 --2- 172.21.15.79:0/128821568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd9f806bfd0 0x7fd9f806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:39.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.011+0000 7fda1087d640 1 --2- 172.21.15.79:0/128821568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd9f806bfd0 0x7fd9f806e490 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc001eb0 tx=0x7fd9fc001d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:39.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.011+0000 7fda157f4740 1 Processor -- start 2024-04-25T02:09:39.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.011+0000 7fda157f4740 1 -- start start 2024-04-25T02:09:39.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fda157f4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60aed60 0x5577d60af140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fda157f4740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60cc600 0x5577d60ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fda157f4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d6084a40 0x5577d60cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fda157f4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5577d5fe86b0 con 0x5577d60aed60 2024-04-25T02:09:39.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fda157f4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5577d5f90880 con 0x5577d6084a40 2024-04-25T02:09:39.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fda157f4740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5577d5fe4670 con 0x5577d60cc600 2024-04-25T02:09:39.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fda1087d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60aed60 0x5577d60af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:39.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fda1087d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60aed60 0x5577d60af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36498/0 (socket says 172.21.15.79:36498) 2024-04-25T02:09:39.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fda1087d640 1 -- 172.21.15.79:0/397919536 learned_addr learned my addr 172.21.15.79:0/397919536 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:39.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fda1087d640 1 -- 172.21.15.79:0/397919536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60cc600 msgr2=0x5577d60ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:39.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fda1087d640 1 --2- 172.21.15.79:0/397919536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60cc600 0x5577d60ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fda1087d640 1 -- 172.21.15.79:0/397919536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d6084a40 msgr2=0x5577d60cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:39.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fda1087d640 1 --2- 172.21.15.79:0/397919536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d6084a40 0x5577d60cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fda1087d640 1 -- 172.21.15.79:0/397919536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577d5dc67d0 con 0x5577d60aed60 2024-04-25T02:09:39.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fda1087d640 1 --2- 172.21.15.79:0/397919536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60aed60 0x5577d60af140 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00fba0 tx=0x7fd9fc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461385a9bf0badf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:39.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fd9f27fc640 1 -- 172.21.15.79:0/397919536 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc026070 con 0x5577d60aed60 2024-04-25T02:09:39.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fd9f27fc640 1 -- 172.21.15.79:0/397919536 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9fc013c40 con 0x5577d60aed60 2024-04-25T02:09:39.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.012+0000 7fd9f27fc640 1 -- 172.21.15.79:0/397919536 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc012350 con 0x5577d60aed60 2024-04-25T02:09:39.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.013+0000 7fda157f4740 1 -- 172.21.15.79:0/397919536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60aed60 msgr2=0x5577d60af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:39.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.013+0000 7fda157f4740 1 --2- 172.21.15.79:0/397919536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60aed60 0x5577d60af140 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00fba0 tx=0x7fd9fc012000 comp rx=0 tx=0).stop 2024-04-25T02:09:39.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.013+0000 7fda157f4740 1 -- 172.21.15.79:0/397919536 shutdown_connections 2024-04-25T02:09:39.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.013+0000 7fda157f4740 1 --2- 172.21.15.79:0/397919536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d6084a40 0x5577d60cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.013+0000 7fda157f4740 1 --2- 172.21.15.79:0/397919536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60cc600 0x5577d60ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.013+0000 7fda157f4740 1 --2- 172.21.15.79:0/397919536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60aed60 0x5577d60af140 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.013+0000 7fda157f4740 1 -- 172.21.15.79:0/397919536 >> 172.21.15.79:0/397919536 conn(0x5577d6081600 msgr2=0x5577d60c9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:39.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.013+0000 7fda157f4740 1 -- 172.21.15.79:0/397919536 shutdown_connections 2024-04-25T02:09:39.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.013+0000 7fda157f4740 1 -- 172.21.15.79:0/397919536 wait complete. 2024-04-25T02:09:39.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.014+0000 7fda157f4740 1 -- start start 2024-04-25T02:09:39.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.014+0000 7fda157f4740 1 Processor -- start 2024-04-25T02:09:39.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda157f4740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60aed60 0x5577d60d9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda157f4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60cc600 0x5577d60b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda157f4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d60c40a0 0x5577d60c4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda157f4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5577d60857e0 con 0x5577d60cc600 2024-04-25T02:09:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda157f4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5577d5fa3f50 con 0x5577d60c40a0 2024-04-25T02:09:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda157f4740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5577d607f530 con 0x5577d60aed60 2024-04-25T02:09:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda157f4740 10 client.0 _ll_register_callbacks cb 0x5577d5fdf000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda0bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60cc600 0x5577d60b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda0bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60cc600 0x5577d60b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36510/0 (socket says 172.21.15.79:36510) 2024-04-25T02:09:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda0bfff640 1 -- 172.21.15.79:0/927637454 learned_addr learned my addr 172.21.15.79:0/927637454 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda1087d640 1 --2- 172.21.15.79:0/927637454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60aed60 0x5577d60d9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda1107e640 1 --2- 172.21.15.79:0/927637454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d60c40a0 0x5577d60c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda0bfff640 1 -- 172.21.15.79:0/927637454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60aed60 msgr2=0x5577d60d9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda0bfff640 1 --2- 172.21.15.79:0/927637454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60aed60 0x5577d60d9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda0bfff640 1 -- 172.21.15.79:0/927637454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d60c40a0 msgr2=0x5577d60c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda0bfff640 1 --2- 172.21.15.79:0/927637454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d60c40a0 0x5577d60c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda0bfff640 1 -- 172.21.15.79:0/927637454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577d5cfc3f0 con 0x5577d60cc600 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda0bfff640 1 --2- 172.21.15.79:0/927637454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60cc600 0x5577d60b1a10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fda000613e0 tx=0x7fda0005d1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7cf01a14fe7b41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fd9eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fd9eb7fe640 1 -- 172.21.15.79:0/927637454 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00061480 con 0x5577d60cc600 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda157f4740 1 -- 172.21.15.79:0/927637454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9fc013c40 con 0x5577d60cc600 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fd9eb7fe640 1 -- 172.21.15.79:0/927637454 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fda00061620 con 0x5577d60cc600 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fd9eb7fe640 1 -- 172.21.15.79:0/927637454 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fda00077050 con 0x5577d60cc600 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda157f4740 10 client.5847 fetch_fsmap learned FSMap version 18 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.015+0000 7fda157f4740 1 -- 172.21.15.79:0/927637454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5577d5cbc0f0 con 0x5577d60cc600 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.016+0000 7fd9eb7fe640 1 -- 172.21.15.79:0/927637454 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9fc013c40 con 0x5577d60cc600 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.016+0000 7fd9eb7fe640 1 -- 172.21.15.79:0/927637454 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fda00058230 con 0x5577d60cc600 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.016+0000 7fda157f4740 10 client.5847 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.016+0000 7fda157f4740 10 client.5847 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.016+0000 7fda157f4740 20 client.5847 populate_metadata read hostname 'smithi079' 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.016+0000 7fda157f4740 1 --2- 172.21.15.79:0/927637454 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x5577d60ddcd0 0x5577d60de0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.016+0000 7fda157f4740 4 client.5847 mds_command: new command op to 5598 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:09:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.016+0000 7fda157f4740 1 -- 172.21.15.79:0/927637454 --> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577d5ff5bf0 con 0x5577d60ddcd0 2024-04-25T02:09:39.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.016+0000 7fda1087d640 1 --2- 172.21.15.79:0/927637454 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x5577d60ddcd0 0x5577d60de0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:39.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.016+0000 7fd9eb7fe640 10 client.5847 ms_handle_connect on v2:172.21.15.189:6832/1295756642 2024-04-25T02:09:39.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.016+0000 7fda1087d640 1 --2- 172.21.15.79:0/927637454 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x5577d60ddcd0 0x5577d60de0e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52717ee7e8c0c23a server_cookie=46efc95c355b97f4 in_seq=0 out_seq=0 2024-04-25T02:09:39.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.017+0000 7fd9eb7fe640 1 -- 172.21.15.79:0/927637454 <== mds.0 v2:172.21.15.189:6832/1295756642 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5577d5ff5bf0 con 0x5577d60ddcd0 2024-04-25T02:09:39.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.017+0000 7fd9eb7fe640 10 client.5847 handle_command_reply: tid=0 2024-04-25T02:09:39.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.017+0000 7fda157f4740 1 client.5847 shutdown 2024-04-25T02:09:39.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.017+0000 7fda157f4740 1 -- 172.21.15.79:0/927637454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60cc600 msgr2=0x5577d60b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:39.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.017+0000 7fda157f4740 1 --2- 172.21.15.79:0/927637454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60cc600 0x5577d60b1a10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fda000613e0 tx=0x7fda0005d1a0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.017+0000 7fda157f4740 1 -- 172.21.15.79:0/927637454 shutdown_connections 2024-04-25T02:09:39.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.017+0000 7fda157f4740 1 --2- 172.21.15.79:0/927637454 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x5577d60ddcd0 0x5577d60de0e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.017+0000 7fda157f4740 1 --2- 172.21.15.79:0/927637454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d60c40a0 0x5577d60c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.017+0000 7fda157f4740 1 --2- 172.21.15.79:0/927637454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60cc600 0x5577d60b1a10 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.017+0000 7fda157f4740 1 --2- 172.21.15.79:0/927637454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60aed60 0x5577d60d9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.017+0000 7fd9eb7fe640 0 client.5847 ms_handle_reset on v2:172.21.15.189:6832/1295756642 2024-04-25T02:09:39.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.017+0000 7fda157f4740 1 -- 172.21.15.79:0/927637454 >> 172.21.15.79:0/927637454 conn(0x5577d6084a40 msgr2=0x5577d60cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:39.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.017+0000 7fda157f4740 1 -- 172.21.15.79:0/927637454 shutdown_connections 2024-04-25T02:09:39.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.017+0000 7fda157f4740 1 -- 172.21.15.79:0/927637454 wait complete. 2024-04-25T02:09:39.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.017+0000 7fda157f4740 20 client.5847 trim_cache size 0 max 16384 2024-04-25T02:09:39.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.034+0000 7fda157f4740 1 Processor -- start 2024-04-25T02:09:39.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.034+0000 7fda157f4740 1 -- start start 2024-04-25T02:09:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.035+0000 7fda157f4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60aed60 0x5577d60c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.035+0000 7fda157f4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d60c40a0 0x5577d613e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.035+0000 7fda157f4740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60cc600 0x5577d6083f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.035+0000 7fda157f4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1f82f0 con 0x5577d60aed60 2024-04-25T02:09:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.035+0000 7fda157f4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c0ccf00 con 0x5577d60c40a0 2024-04-25T02:09:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.035+0000 7fda157f4740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fda0c0cc260 con 0x5577d60cc600 2024-04-25T02:09:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.035+0000 7fda1087d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60aed60 0x5577d60c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.035+0000 7fda1087d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60aed60 0x5577d60c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36524/0 (socket says 172.21.15.79:36524) 2024-04-25T02:09:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.035+0000 7fda1087d640 1 -- 172.21.15.79:0/92415572 learned_addr learned my addr 172.21.15.79:0/92415572 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.035+0000 7fda1087d640 1 -- 172.21.15.79:0/92415572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60cc600 msgr2=0x5577d6083f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.035+0000 7fda1087d640 1 --2- 172.21.15.79:0/92415572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60cc600 0x5577d6083f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.035+0000 7fda1087d640 1 -- 172.21.15.79:0/92415572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d60c40a0 msgr2=0x5577d613e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.035+0000 7fda1087d640 1 --2- 172.21.15.79:0/92415572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d60c40a0 0x5577d613e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.035+0000 7fda1087d640 1 -- 172.21.15.79:0/92415572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577d60c4890 con 0x5577d60aed60 2024-04-25T02:09:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.035+0000 7fda1087d640 1 --2- 172.21.15.79:0/92415572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60aed60 0x5577d60c3440 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00fb70 tx=0x7fd9fc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b247a8ca3418ec73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.036+0000 7fd9f1ffb640 1 -- 172.21.15.79:0/92415572 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc035070 con 0x5577d60aed60 2024-04-25T02:09:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.036+0000 7fd9f1ffb640 1 -- 172.21.15.79:0/92415572 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9fc027040 con 0x5577d60aed60 2024-04-25T02:09:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.036+0000 7fd9f1ffb640 1 -- 172.21.15.79:0/92415572 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc026040 con 0x5577d60aed60 2024-04-25T02:09:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.036+0000 7fda157f4740 1 -- 172.21.15.79:0/92415572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60aed60 msgr2=0x5577d60c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.036+0000 7fda157f4740 1 --2- 172.21.15.79:0/92415572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60aed60 0x5577d60c3440 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00fb70 tx=0x7fd9fc013000 comp rx=0 tx=0).stop 2024-04-25T02:09:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.036+0000 7fda157f4740 1 -- 172.21.15.79:0/92415572 shutdown_connections 2024-04-25T02:09:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.036+0000 7fda157f4740 1 --2- 172.21.15.79:0/92415572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60cc600 0x5577d6083f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.036+0000 7fda157f4740 1 --2- 172.21.15.79:0/92415572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d60c40a0 0x5577d613e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.036+0000 7fda157f4740 1 --2- 172.21.15.79:0/92415572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60aed60 0x5577d60c3440 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.036+0000 7fda157f4740 1 -- 172.21.15.79:0/92415572 >> 172.21.15.79:0/92415572 conn(0x5577d6084a40 msgr2=0x5577d60d9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.036+0000 7fda157f4740 1 -- 172.21.15.79:0/92415572 shutdown_connections 2024-04-25T02:09:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.036+0000 7fda157f4740 1 -- 172.21.15.79:0/92415572 wait complete. 2024-04-25T02:09:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.037+0000 7fda157f4740 1 -- start start 2024-04-25T02:09:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.037+0000 7fda157f4740 1 Processor -- start 2024-04-25T02:09:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda157f4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d60aed60 0x5577d613b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda157f4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60c40a0 0x5577d60d87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda157f4740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60cc600 0x5577d60d8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda157f4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5577d60a01a0 con 0x5577d60c40a0 2024-04-25T02:09:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda157f4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c0cc8b0 con 0x5577d60aed60 2024-04-25T02:09:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda157f4740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5577d601cf30 con 0x5577d60cc600 2024-04-25T02:09:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda157f4740 10 client.0 _ll_register_callbacks cb 0x7fda00058bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda0bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60c40a0 0x5577d60d87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda0bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60c40a0 0x5577d60d87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36536/0 (socket says 172.21.15.79:36536) 2024-04-25T02:09:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda0bfff640 1 -- 172.21.15.79:0/1027407251 learned_addr learned my addr 172.21.15.79:0/1027407251 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:09:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda1087d640 1 --2- 172.21.15.79:0/1027407251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d60aed60 0x5577d613b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda1107e640 1 --2- 172.21.15.79:0/1027407251 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60cc600 0x5577d60d8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda0bfff640 1 -- 172.21.15.79:0/1027407251 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60cc600 msgr2=0x5577d60d8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda0bfff640 1 --2- 172.21.15.79:0/1027407251 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60cc600 0x5577d60d8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda0bfff640 1 -- 172.21.15.79:0/1027407251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d60aed60 msgr2=0x5577d613b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda0bfff640 1 --2- 172.21.15.79:0/1027407251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d60aed60 0x5577d613b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda0bfff640 1 -- 172.21.15.79:0/1027407251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577d613b540 con 0x5577d60c40a0 2024-04-25T02:09:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda0bfff640 1 --2- 172.21.15.79:0/1027407251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60c40a0 0x5577d60d87b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fda0000cf30 tx=0x7fda00000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8cdc020d4cd895b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fd9eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:09:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fd9eb7fe640 1 -- 172.21.15.79:0/1027407251 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00055080 con 0x5577d60c40a0 2024-04-25T02:09:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fd9eb7fe640 1 -- 172.21.15.79:0/1027407251 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fda00061480 con 0x5577d60c40a0 2024-04-25T02:09:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda157f4740 1 -- 172.21.15.79:0/1027407251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9fc027040 con 0x5577d60c40a0 2024-04-25T02:09:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fd9eb7fe640 1 -- 172.21.15.79:0/1027407251 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fda00068050 con 0x5577d60c40a0 2024-04-25T02:09:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda157f4740 10 client.5853 fetch_fsmap learned FSMap version 18 2024-04-25T02:09:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fda157f4740 1 -- 172.21.15.79:0/1027407251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5577d613c4c0 con 0x5577d60c40a0 2024-04-25T02:09:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.038+0000 7fd9eb7fe640 1 -- 172.21.15.79:0/1027407251 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9fc027040 con 0x5577d60c40a0 2024-04-25T02:09:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.039+0000 7fd9eb7fe640 1 -- 172.21.15.79:0/1027407251 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fda00061b60 con 0x5577d60c40a0 2024-04-25T02:09:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.039+0000 7fda157f4740 10 client.5853 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T02:09:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.039+0000 7fda157f4740 10 client.5853 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-04-25T02:09:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.039+0000 7fda157f4740 20 client.5853 populate_metadata read hostname 'smithi079' 2024-04-25T02:09:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.039+0000 7fda157f4740 1 --2- 172.21.15.79:0/1027407251 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x5577d60dcb20 0x5577d613b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.039+0000 7fda157f4740 4 client.5853 mds_command: new command op to 5598 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:09:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.039+0000 7fda157f4740 1 -- 172.21.15.79:0/1027407251 --> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5577d5feff40 con 0x5577d60dcb20 2024-04-25T02:09:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.039+0000 7fda1087d640 1 --2- 172.21.15.79:0/1027407251 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x5577d60dcb20 0x5577d613b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.039+0000 7fd9eb7fe640 10 client.5853 ms_handle_connect on v2:172.21.15.189:6832/1295756642 2024-04-25T02:09:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.039+0000 7fda1087d640 1 --2- 172.21.15.79:0/1027407251 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x5577d60dcb20 0x5577d613b790 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f19885ea62a17f3d server_cookie=64587a4e482af3b8 in_seq=0 out_seq=0 2024-04-25T02:09:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.039+0000 7fd9eb7fe640 1 -- 172.21.15.79:0/1027407251 <== mds.0 v2:172.21.15.189:6832/1295756642 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x5577d5feff40 con 0x5577d60dcb20 2024-04-25T02:09:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.039+0000 7fd9eb7fe640 10 client.5853 handle_command_reply: tid=0 2024-04-25T02:09:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.039+0000 7fda157f4740 1 client.5853 shutdown 2024-04-25T02:09:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.039+0000 7fda157f4740 1 -- 172.21.15.79:0/1027407251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60c40a0 msgr2=0x5577d60d87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.039+0000 7fda157f4740 1 --2- 172.21.15.79:0/1027407251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60c40a0 0x5577d60d87b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fda0000cf30 tx=0x7fda00000ed0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda157f4740 1 -- 172.21.15.79:0/1027407251 shutdown_connections 2024-04-25T02:09:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda157f4740 1 --2- 172.21.15.79:0/1027407251 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x5577d60dcb20 0x5577d613b790 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda157f4740 1 --2- 172.21.15.79:0/1027407251 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5577d60cc600 0x5577d60d8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fd9eb7fe640 0 client.5853 ms_handle_reset on v2:172.21.15.189:6832/1295756642 2024-04-25T02:09:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda157f4740 1 --2- 172.21.15.79:0/1027407251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5577d60c40a0 0x5577d60d87b0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda157f4740 1 --2- 172.21.15.79:0/1027407251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5577d60aed60 0x5577d613b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda157f4740 1 -- 172.21.15.79:0/1027407251 >> 172.21.15.79:0/1027407251 conn(0x5577d6084a40 msgr2=0x5577d6084e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda157f4740 1 -- 172.21.15.79:0/1027407251 shutdown_connections 2024-04-25T02:09:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda157f4740 1 -- 172.21.15.79:0/1027407251 wait complete. 2024-04-25T02:09:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda157f4740 20 client.5853 trim_cache size 0 max 16384 2024-04-25T02:09:39.054 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:09:39.054 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T02:09:39.054 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-04-25T02:09:39.054 INFO:teuthology.orchestra.run.smithi079.stdout: "ef25adcb-4c80-4b15-8ea3-07756035a996": { 2024-04-25T02:09:39.054 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-04-25T02:09:39.054 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "ef25adcb-4c80-4b15-8ea3-07756035a996", 2024-04-25T02:09:39.054 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,repair" 2024-04-25T02:09:39.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:39.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:09:39.054 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:09:39.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda12ae1640 1 -- 172.21.15.79:0/128821568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd9f806bfd0 msgr2=0x7fd9f806e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:39.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda12ae1640 1 --2- 172.21.15.79:0/128821568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd9f806bfd0 0x7fd9f806e490 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc001eb0 tx=0x7fd9fc001d80 comp rx=0 tx=0).stop 2024-04-25T02:09:39.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda12ae1640 1 -- 172.21.15.79:0/128821568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda0c0d2ca0 msgr2=0x7fda0c1553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:39.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda12ae1640 1 --2- 172.21.15.79:0/128821568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda0c0d2ca0 0x7fda0c1553f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c570 tx=0x7fda0000ca30 comp rx=0 tx=0).stop 2024-04-25T02:09:39.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda12ae1640 1 -- 172.21.15.79:0/128821568 shutdown_connections 2024-04-25T02:09:39.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda12ae1640 1 --2- 172.21.15.79:0/128821568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd9f806bfd0 0x7fd9f806e490 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda12ae1640 1 --2- 172.21.15.79:0/128821568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda0c15e4f0 0x7fda0c1f4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda12ae1640 1 --2- 172.21.15.79:0/128821568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda0c0d2ca0 0x7fda0c1553f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda12ae1640 1 --2- 172.21.15.79:0/128821568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fda0c0d10c0 0x7fda0c0c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:39.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda12ae1640 1 -- 172.21.15.79:0/128821568 >> 172.21.15.79:0/128821568 conn(0x7fda0c09d4a0 msgr2=0x7fda0c06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:39.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda12ae1640 1 -- 172.21.15.79:0/128821568 shutdown_connections 2024-04-25T02:09:39.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.040+0000 7fda12ae1640 1 -- 172.21.15.79:0/128821568 wait complete. 2024-04-25T02:09:39.058 INFO:tasks.cephfs.filesystem:scrub status for tag:ef25adcb-4c80-4b15-8ea3-07756035a996 - {'path': '/', 'tag': 'ef25adcb-4c80-4b15-8ea3-07756035a996', 'options': 'recursive,repair'} 2024-04-25T02:09:39.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:39.743+0000 7f724e7fc640 1 -- 172.21.15.79:0/1003398876 <== mon.0 v2:172.21.15.79:3300/0 7 ==== log(6 entries from seq 1 at 2024-04-25T02:09:38.893489+0000) ==== 1078+0+0 (secure 0 0 0) 0x7f72540aa430 con 0x7f725806ffe0 2024-04-25T02:09:39.751 INFO:teuthology.orchestra.run.smithi079.stdout: cluster: 2024-04-25T02:09:39.751 INFO:teuthology.orchestra.run.smithi079.stdout: id: 696648c4-3e52-400b-a780-2e8863c56c42 2024-04-25T02:09:39.751 INFO:teuthology.orchestra.run.smithi079.stdout: health: HEALTH_OK 2024-04-25T02:09:39.751 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:39.751 INFO:teuthology.orchestra.run.smithi079.stdout: services: 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: mgr: y(active, since 119s), standbys: x 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: osd: 8 osds: 8 up (since 112s), 8 in (since 2m) 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: data: 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: volumes: 1/1 healthy 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: pools: 3 pools, 97 pgs 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: objects: 24 objects, 579 KiB 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: usage: 220 MiB used, 720 GiB / 720 GiB avail 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: pgs: 97 active+clean 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: io: 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: client: 1.5 KiB/s wr, 0 op/s rd, 4 op/s wr 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:09:39.752 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:09:38.893489+0000 mds.b [INF] scrub queued for path: / 2024-04-25T02:09:39.753 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:09:38.893492+0000 mds.b [INF] scrub summary: idle+waiting paths [/] 2024-04-25T02:09:39.753 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:09:38.893498+0000 mds.b [INF] scrub summary: active paths [/] 2024-04-25T02:09:39.753 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:09:38.894184+0000 mds.b [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2024-04-25T02:09:39.753 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:09:38.894192+0000 mds.b [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2024-04-25T02:09:39.753 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:09:38.894646+0000 mds.b [INF] scrub summary: idle+waiting paths [/] 2024-04-25T02:09:40.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:40.745+0000 7f724e7fc640 1 -- 172.21.15.79:0/1003398876 <== mon.0 v2:172.21.15.79:3300/0 8 ==== log(2 entries from seq 519 at 2024-04-25T02:09:40.061616+0000) ==== 603+0+0 (secure 0 0 0) 0x7f72540781f0 con 0x7f725806ffe0 2024-04-25T02:09:41.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:41.753+0000 7f724e7fc640 1 -- 172.21.15.79:0/1003398876 <== mon.0 v2:172.21.15.79:3300/0 9 ==== log(2 entries from seq 521 at 2024-04-25T02:09:40.749222+0000) ==== 607+0+0 (secure 0 0 0) 0x7f7254078450 con 0x7f725806ffe0 2024-04-25T02:09:42.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:09:42.754+0000 7f724e7fc640 1 -- 172.21.15.79:0/1003398876 <== mon.0 v2:172.21.15.79:3300/0 10 ==== log(1 entries from seq 7 at 2024-04-25T02:09:42.642817+0000) ==== 189+0+0 (secure 0 0 0) 0x7f725407a3b0 con 0x7f725806ffe0 2024-04-25T02:09:42.762 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:09:42.642817+0000 mds.b [INF] scrub summary: idle 2024-04-25T02:09:59.615 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:09:59.618 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:10:00.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:00.780+0000 7f724e7fc640 1 -- 172.21.15.79:0/1003398876 <== mon.0 v2:172.21.15.79:3300/0 11 ==== log(1 entries from seq 525 at 2024-04-25T02:10:00.000152+0000) ==== 187+0+0 (secure 0 0 0) 0x7f72540827f0 con 0x7f725806ffe0 2024-04-25T02:10:00.788 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:10:00.000152+0000 mon.a [INF] overall HEALTH_OK 2024-04-25T02:10:09.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:09.059 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T02:10:09.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.167+0000 7efddde5d640 1 Processor -- start 2024-04-25T02:10:09.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.167+0000 7efddde5d640 1 -- start start 2024-04-25T02:10:09.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.167+0000 7efddde5d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efdd815e4f0 0x7efdd80d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.167+0000 7efddde5d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7efdd80cf7f0 0x7efdd80d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.168+0000 7efddde5d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd80d1ee0 con 0x7efdd80cfc80 2024-04-25T02:10:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.168+0000 7efddde5d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7efdd80d21c0 con 0x7efdd815e4f0 2024-04-25T02:10:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.168+0000 7efddde5d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7efdd80d24a0 con 0x7efdd80cf7f0 2024-04-25T02:10:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.168+0000 7efdd77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efdd815e4f0 0x7efdd80d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.168+0000 7efdd77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efdd815e4f0 0x7efdd80d2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35810/0 (socket says 172.21.15.79:35810) 2024-04-25T02:10:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.168+0000 7efdd77fe640 1 -- 172.21.15.79:0/765710515 learned_addr learned my addr 172.21.15.79:0/765710515 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.168+0000 7efdd6ffd640 1 --2- 172.21.15.79:0/765710515 >> v2:172.21.15.189:3300/0 conn(0x7efdd80cf7f0 0x7efdd80d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.168+0000 7efdd77fe640 1 -- 172.21.15.79:0/765710515 >> v2:172.21.15.189:3300/0 conn(0x7efdd80cf7f0 msgr2=0x7efdd80d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.168+0000 7efdd77fe640 1 --2- 172.21.15.79:0/765710515 >> v2:172.21.15.189:3300/0 conn(0x7efdd80cf7f0 0x7efdd80d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.168+0000 7efdd77fe640 1 -- 172.21.15.79:0/765710515 >> v1:172.21.15.189:6789/0 conn(0x7efdd80cfc80 legacy=0x7efdd806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.168+0000 7efdd77fe640 1 -- 172.21.15.79:0/765710515 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd80d2780 con 0x7efdd815e4f0 2024-04-25T02:10:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.169+0000 7efdd77fe640 1 --2- 172.21.15.79:0/765710515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd815e4f0 0x7efdd80d2ca0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009870 tx=0x7efdc802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b217d51fad25f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.169+0000 7efdd67fc640 1 -- 172.21.15.79:0/765710515 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8037070 con 0x7efdd815e4f0 2024-04-25T02:10:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.169+0000 7efdd67fc640 1 -- 172.21.15.79:0/765710515 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8032440 con 0x7efdd815e4f0 2024-04-25T02:10:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.169+0000 7efdd67fc640 1 -- 172.21.15.79:0/765710515 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8032810 con 0x7efdd815e4f0 2024-04-25T02:10:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.170+0000 7efddde5d640 1 -- 172.21.15.79:0/765710515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd815e4f0 msgr2=0x7efdd80d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.170+0000 7efddde5d640 1 --2- 172.21.15.79:0/765710515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd815e4f0 0x7efdd80d2ca0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009870 tx=0x7efdc802a2a0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.170+0000 7efddde5d640 1 -- 172.21.15.79:0/765710515 shutdown_connections 2024-04-25T02:10:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.170+0000 7efddde5d640 1 --2- 172.21.15.79:0/765710515 >> v2:172.21.15.189:3300/0 conn(0x7efdd80cf7f0 0x7efdd80d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.170+0000 7efddde5d640 1 --2- 172.21.15.79:0/765710515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd815e4f0 0x7efdd80d2ca0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.170+0000 7efddde5d640 1 -- 172.21.15.79:0/765710515 >> 172.21.15.79:0/765710515 conn(0x7efdd809d4a0 msgr2=0x7efdd80d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.170+0000 7efddde5d640 1 -- 172.21.15.79:0/765710515 shutdown_connections 2024-04-25T02:10:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.170+0000 7efddde5d640 1 -- 172.21.15.79:0/765710515 wait complete. 2024-04-25T02:10:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.171+0000 7efddde5d640 1 Processor -- start 2024-04-25T02:10:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.171+0000 7efddde5d640 1 -- start start 2024-04-25T02:10:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efddde5d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdd80cf7f0 0x7efdd81f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efddde5d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdd80cfc80 0x7efdd814e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efddde5d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd815e4f0 0x7efdd80c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efddde5d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efdd80d0ef0 con 0x7efdd815e4f0 2024-04-25T02:10:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efddde5d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efdd80d50f0 con 0x7efdd80cfc80 2024-04-25T02:10:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efddde5d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efdd80d1070 con 0x7efdd80cf7f0 2024-04-25T02:10:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efdd7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd815e4f0 0x7efdd80c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efdd7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd815e4f0 0x7efdd80c7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35818/0 (socket says 172.21.15.79:35818) 2024-04-25T02:10:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efdd7fff640 1 -- 172.21.15.79:0/3948463524 learned_addr learned my addr 172.21.15.79:0/3948463524 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efdd77fe640 1 --2- 172.21.15.79:0/3948463524 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdd80cf7f0 0x7efdd81f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efdd6ffd640 1 --2- 172.21.15.79:0/3948463524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdd80cfc80 0x7efdd814e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efdd7fff640 1 -- 172.21.15.79:0/3948463524 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdd80cf7f0 msgr2=0x7efdd81f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efdd7fff640 1 --2- 172.21.15.79:0/3948463524 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdd80cf7f0 0x7efdd81f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efdd7fff640 1 -- 172.21.15.79:0/3948463524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdd80cfc80 msgr2=0x7efdd814e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efdd7fff640 1 --2- 172.21.15.79:0/3948463524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdd80cfc80 0x7efdd814e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efdd7fff640 1 -- 172.21.15.79:0/3948463524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd81f5c30 con 0x7efdd815e4f0 2024-04-25T02:10:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efdd77fe640 1 --2- 172.21.15.79:0/3948463524 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdd80cf7f0 0x7efdd81f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.172+0000 7efdd7fff640 1 --2- 172.21.15.79:0/3948463524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd815e4f0 0x7efdd80c7ca0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c730 tx=0x7efdd000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.173+0000 7efdbffff640 1 -- 172.21.15.79:0/3948463524 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0003b70 con 0x7efdd815e4f0 2024-04-25T02:10:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.173+0000 7efdbffff640 1 -- 172.21.15.79:0/3948463524 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd0003d10 con 0x7efdd815e4f0 2024-04-25T02:10:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.173+0000 7efdbffff640 1 -- 172.21.15.79:0/3948463524 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd000aa90 con 0x7efdd815e4f0 2024-04-25T02:10:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.173+0000 7efddde5d640 1 -- 172.21.15.79:0/3948463524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd80cc290 con 0x7efdd815e4f0 2024-04-25T02:10:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.173+0000 7efddde5d640 1 -- 172.21.15.79:0/3948463524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd80cc530 con 0x7efdd815e4f0 2024-04-25T02:10:09.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.174+0000 7efdbffff640 1 -- 172.21.15.79:0/3948463524 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efdd000ac30 con 0x7efdd815e4f0 2024-04-25T02:10:09.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.175+0000 7efdbffff640 1 --2- 172.21.15.79:0/3948463524 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efdc406be30 0x7efdc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.175+0000 7efdd77fe640 1 --2- 172.21.15.79:0/3948463524 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efdc406be30 0x7efdc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.175+0000 7efdbffff640 1 -- 172.21.15.79:0/3948463524 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7efdd008ac90 con 0x7efdd815e4f0 2024-04-25T02:10:09.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.176+0000 7efdd77fe640 1 --2- 172.21.15.79:0/3948463524 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efdc406be30 0x7efdc406e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efdc8034000 tx=0x7efdc802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:09.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.176+0000 7efde0b6e740 1 Processor -- start 2024-04-25T02:10:09.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.176+0000 7efde0b6e740 1 -- start start 2024-04-25T02:10:09.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efde0b6e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe3d60 0x55bf9dbe4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efde0b6e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dc01600 0x55bf9dc01b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efde0b6e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dbb9a40 0x55bf9dbffcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efde0b6e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf9db1d6b0 con 0x55bf9dc01600 2024-04-25T02:10:09.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efde0b6e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bf9dac5880 con 0x55bf9dbe3d60 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efde0b6e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55bf9db19670 con 0x55bf9dbb9a40 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efdd6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dc01600 0x55bf9dc01b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efdd6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dc01600 0x55bf9dc01b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35828/0 (socket says 172.21.15.79:35828) 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efdd6ffd640 1 -- 172.21.15.79:0/1090383606 learned_addr learned my addr 172.21.15.79:0/1090383606 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efdd7fff640 1 --2- 172.21.15.79:0/1090383606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dbb9a40 0x55bf9dbffcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efdd77fe640 1 --2- 172.21.15.79:0/1090383606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe3d60 0x55bf9dbe4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efdd6ffd640 1 -- 172.21.15.79:0/1090383606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dbb9a40 msgr2=0x55bf9dbffcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efdd6ffd640 1 --2- 172.21.15.79:0/1090383606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dbb9a40 0x55bf9dbffcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efdd6ffd640 1 -- 172.21.15.79:0/1090383606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe3d60 msgr2=0x55bf9dbe4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efdd6ffd640 1 --2- 172.21.15.79:0/1090383606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe3d60 0x55bf9dbe4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efdd6ffd640 1 -- 172.21.15.79:0/1090383606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf9d8fb7d0 con 0x55bf9dc01600 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efdd6ffd640 1 --2- 172.21.15.79:0/1090383606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dc01600 0x55bf9dc01b50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009b90 tx=0x7efdcc011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba8eb9ecf6998b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.177+0000 7efdbd7fa640 1 -- 172.21.15.79:0/1090383606 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc019070 con 0x55bf9dc01600 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.178+0000 7efdbd7fa640 1 -- 172.21.15.79:0/1090383606 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc004030 con 0x55bf9dc01600 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.178+0000 7efdbd7fa640 1 -- 172.21.15.79:0/1090383606 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc004400 con 0x55bf9dc01600 2024-04-25T02:10:09.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.178+0000 7efde0b6e740 1 -- 172.21.15.79:0/1090383606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dc01600 msgr2=0x55bf9dc01b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.178+0000 7efde0b6e740 1 --2- 172.21.15.79:0/1090383606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dc01600 0x55bf9dc01b50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009b90 tx=0x7efdcc011690 comp rx=0 tx=0).stop 2024-04-25T02:10:09.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.178+0000 7efde0b6e740 1 -- 172.21.15.79:0/1090383606 shutdown_connections 2024-04-25T02:10:09.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.178+0000 7efde0b6e740 1 --2- 172.21.15.79:0/1090383606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dbb9a40 0x55bf9dbffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.178+0000 7efde0b6e740 1 --2- 172.21.15.79:0/1090383606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dc01600 0x55bf9dc01b50 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.178+0000 7efde0b6e740 1 --2- 172.21.15.79:0/1090383606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe3d60 0x55bf9dbe4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.178+0000 7efde0b6e740 1 -- 172.21.15.79:0/1090383606 >> 172.21.15.79:0/1090383606 conn(0x55bf9dbb6600 msgr2=0x55bf9dbfeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:09.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.178+0000 7efde0b6e740 1 -- 172.21.15.79:0/1090383606 shutdown_connections 2024-04-25T02:10:09.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.178+0000 7efde0b6e740 1 -- 172.21.15.79:0/1090383606 wait complete. 2024-04-25T02:10:09.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.179+0000 7efde0b6e740 1 -- start start 2024-04-25T02:10:09.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.179+0000 7efde0b6e740 1 Processor -- start 2024-04-25T02:10:09.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efde0b6e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbe3d60 0x55bf9dbe7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efde0b6e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dc01600 0x55bf9dbb3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efde0b6e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe5cf0 0x55bf9dbe0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efde0b6e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf9dbba7e0 con 0x55bf9dbe3d60 2024-04-25T02:10:09.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efde0b6e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bf9dad8f50 con 0x55bf9dbe5cf0 2024-04-25T02:10:09.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efde0b6e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55bf9dbb4530 con 0x55bf9dc01600 2024-04-25T02:10:09.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efde0b6e740 10 client.0 _ll_register_callbacks cb 0x55bf9db14000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:09.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbe3d60 0x55bf9dbe7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbe3d60 0x55bf9dbe7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35830/0 (socket says 172.21.15.79:35830) 2024-04-25T02:10:09.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efdd77fe640 1 -- 172.21.15.79:0/3042128617 learned_addr learned my addr 172.21.15.79:0/3042128617 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:09.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efdd7fff640 1 --2- 172.21.15.79:0/3042128617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe5cf0 0x55bf9dbe0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efdd6ffd640 1 --2- 172.21.15.79:0/3042128617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dc01600 0x55bf9dbb3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efdd77fe640 1 -- 172.21.15.79:0/3042128617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dc01600 msgr2=0x55bf9dbb3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efdd77fe640 1 --2- 172.21.15.79:0/3042128617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dc01600 0x55bf9dbb3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efdd77fe640 1 -- 172.21.15.79:0/3042128617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe5cf0 msgr2=0x55bf9dbe0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efdd77fe640 1 --2- 172.21.15.79:0/3042128617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe5cf0 0x55bf9dbe0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.180+0000 7efdd77fe640 1 -- 172.21.15.79:0/3042128617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf9d8313f0 con 0x55bf9dbe3d60 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efdd77fe640 1 --2- 172.21.15.79:0/3042128617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbe3d60 0x55bf9dbe7c50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7efdc80090b0 tx=0x7efdc802c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdac581184e63fe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efdb67fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efdb67fc640 1 -- 172.21.15.79:0/3042128617 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8037040 con 0x55bf9dbe3d60 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efdb67fc640 1 -- 172.21.15.79:0/3042128617 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7efdc803ed40 con 0x55bf9dbe3d60 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efde0b6e740 1 -- 172.21.15.79:0/3042128617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdcc004030 con 0x55bf9dbe3d60 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efdb67fc640 1 -- 172.21.15.79:0/3042128617 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7efdc8056050 con 0x55bf9dbe3d60 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efde0b6e740 10 client.5865 fetch_fsmap learned FSMap version 18 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efde0b6e740 1 -- 172.21.15.79:0/3042128617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55bf9d7f10f0 con 0x55bf9dbe3d60 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efdb67fc640 1 -- 172.21.15.79:0/3042128617 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc004030 con 0x55bf9dbe3d60 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efdb67fc640 1 -- 172.21.15.79:0/3042128617 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7efdc8059020 con 0x55bf9dbe3d60 2024-04-25T02:10:09.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efde0b6e740 10 client.5865 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T02:10:09.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efde0b6e740 10 client.5865 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-04-25T02:10:09.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efde0b6e740 20 client.5865 populate_metadata read hostname 'smithi079' 2024-04-25T02:10:09.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efde0b6e740 1 --2- 172.21.15.79:0/3042128617 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55bf9dc12c30 0x55bf9dc13010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efde0b6e740 4 client.5865 mds_command: new command op to 5598 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:09.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efde0b6e740 1 -- 172.21.15.79:0/3042128617 --> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf9db2abf0 con 0x55bf9dc12c30 2024-04-25T02:10:09.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.181+0000 7efdd6ffd640 1 --2- 172.21.15.79:0/3042128617 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55bf9dc12c30 0x55bf9dc13010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.182+0000 7efdd6ffd640 1 --2- 172.21.15.79:0/3042128617 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55bf9dc12c30 0x55bf9dc13010 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=890e2e485fcad296 server_cookie=6c8b9df5d23242b2 in_seq=0 out_seq=0 2024-04-25T02:10:09.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.182+0000 7efdb67fc640 10 client.5865 ms_handle_connect on v2:172.21.15.189:6832/1295756642 2024-04-25T02:10:09.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.182+0000 7efdb67fc640 1 -- 172.21.15.79:0/3042128617 <== mds.0 v2:172.21.15.189:6832/1295756642 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bf9db2abf0 con 0x55bf9dc12c30 2024-04-25T02:10:09.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.183+0000 7efdb67fc640 10 client.5865 handle_command_reply: tid=0 2024-04-25T02:10:09.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.183+0000 7efde0b6e740 1 client.5865 shutdown 2024-04-25T02:10:09.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.183+0000 7efde0b6e740 1 -- 172.21.15.79:0/3042128617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbe3d60 msgr2=0x55bf9dbe7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.183+0000 7efde0b6e740 1 --2- 172.21.15.79:0/3042128617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbe3d60 0x55bf9dbe7c50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7efdc80090b0 tx=0x7efdc802c070 comp rx=0 tx=0).stop 2024-04-25T02:10:09.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.183+0000 7efde0b6e740 1 -- 172.21.15.79:0/3042128617 shutdown_connections 2024-04-25T02:10:09.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.183+0000 7efde0b6e740 1 --2- 172.21.15.79:0/3042128617 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55bf9dc12c30 0x55bf9dc13010 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.183+0000 7efde0b6e740 1 --2- 172.21.15.79:0/3042128617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe5cf0 0x55bf9dbe0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.183+0000 7efde0b6e740 1 --2- 172.21.15.79:0/3042128617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dc01600 0x55bf9dbb3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.183+0000 7efdb67fc640 0 client.5865 ms_handle_reset on v2:172.21.15.189:6832/1295756642 2024-04-25T02:10:09.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.183+0000 7efde0b6e740 1 --2- 172.21.15.79:0/3042128617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbe3d60 0x55bf9dbe7c50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.183+0000 7efde0b6e740 1 -- 172.21.15.79:0/3042128617 >> 172.21.15.79:0/3042128617 conn(0x55bf9dbb9a40 msgr2=0x55bf9dc020f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:09.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.183+0000 7efde0b6e740 1 -- 172.21.15.79:0/3042128617 shutdown_connections 2024-04-25T02:10:09.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.183+0000 7efde0b6e740 1 -- 172.21.15.79:0/3042128617 wait complete. 2024-04-25T02:10:09.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.183+0000 7efde0b6e740 20 client.5865 trim_cache size 0 max 16384 2024-04-25T02:10:09.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.201+0000 7efde0b6e740 1 Processor -- start 2024-04-25T02:10:09.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.201+0000 7efde0b6e740 1 -- start start 2024-04-25T02:10:09.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.202+0000 7efde0b6e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dbb9a40 0x55bf9dc22e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.202+0000 7efde0b6e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe3d60 0x55bf9dbfbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.202+0000 7efde0b6e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbe5cf0 0x55bf9dbe33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.202+0000 7efde0b6e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efdd82007e0 con 0x55bf9dbe5cf0 2024-04-25T02:10:09.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.202+0000 7efde0b6e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efdd81f8520 con 0x55bf9dbe3d60 2024-04-25T02:10:09.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.202+0000 7efde0b6e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efdd80cdb60 con 0x55bf9dbb9a40 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.202+0000 7efdd7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbe5cf0 0x55bf9dbe33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.202+0000 7efdd7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbe5cf0 0x55bf9dbe33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35840/0 (socket says 172.21.15.79:35840) 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.202+0000 7efdd7fff640 1 -- 172.21.15.79:0/1540455911 learned_addr learned my addr 172.21.15.79:0/1540455911 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.202+0000 7efdd6ffd640 1 --2- 172.21.15.79:0/1540455911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe3d60 0x55bf9dbfbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.202+0000 7efdd77fe640 1 --2- 172.21.15.79:0/1540455911 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dbb9a40 0x55bf9dc22e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.203+0000 7efdd7fff640 1 -- 172.21.15.79:0/1540455911 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dbb9a40 msgr2=0x55bf9dc22e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.203+0000 7efdd7fff640 1 --2- 172.21.15.79:0/1540455911 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dbb9a40 0x55bf9dc22e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.203+0000 7efdd7fff640 1 -- 172.21.15.79:0/1540455911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe3d60 msgr2=0x55bf9dbfbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.203+0000 7efdd7fff640 1 --2- 172.21.15.79:0/1540455911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe3d60 0x55bf9dbfbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.203+0000 7efdd7fff640 1 -- 172.21.15.79:0/1540455911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf9dbf99e0 con 0x55bf9dbe5cf0 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.203+0000 7efdd7fff640 1 --2- 172.21.15.79:0/1540455911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbe5cf0 0x55bf9dbe33d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7efdd000afd0 tx=0x7efdd0005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fff0716805a9d30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.203+0000 7efdbcff9640 1 -- 172.21.15.79:0/1540455911 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd005d340 con 0x55bf9dbe5cf0 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.203+0000 7efdbcff9640 1 -- 172.21.15.79:0/1540455911 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd0061b70 con 0x55bf9dbe5cf0 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.203+0000 7efdbcff9640 1 -- 172.21.15.79:0/1540455911 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0055600 con 0x55bf9dbe5cf0 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.204+0000 7efde0b6e740 1 -- 172.21.15.79:0/1540455911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbe5cf0 msgr2=0x55bf9dbe33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.204+0000 7efde0b6e740 1 --2- 172.21.15.79:0/1540455911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbe5cf0 0x55bf9dbe33d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7efdd000afd0 tx=0x7efdd0005040 comp rx=0 tx=0).stop 2024-04-25T02:10:09.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.204+0000 7efde0b6e740 1 -- 172.21.15.79:0/1540455911 shutdown_connections 2024-04-25T02:10:09.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.204+0000 7efde0b6e740 1 --2- 172.21.15.79:0/1540455911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbe5cf0 0x55bf9dbe33d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.204+0000 7efde0b6e740 1 --2- 172.21.15.79:0/1540455911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe3d60 0x55bf9dbfbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.204+0000 7efde0b6e740 1 --2- 172.21.15.79:0/1540455911 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dbb9a40 0x55bf9dc22e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.204+0000 7efde0b6e740 1 -- 172.21.15.79:0/1540455911 >> 172.21.15.79:0/1540455911 conn(0x55bf9dbe7310 msgr2=0x55bf9dbb3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:09.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.204+0000 7efde0b6e740 1 -- 172.21.15.79:0/1540455911 shutdown_connections 2024-04-25T02:10:09.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.204+0000 7efde0b6e740 1 -- 172.21.15.79:0/1540455911 wait complete. 2024-04-25T02:10:09.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.204+0000 7efde0b6e740 1 -- start start 2024-04-25T02:10:09.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.204+0000 7efde0b6e740 1 Processor -- start 2024-04-25T02:10:09.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.205+0000 7efde0b6e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbb9a40 0x55bf9dc02310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.205+0000 7efde0b6e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dbe3d60 0x55bf9dbb8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.205+0000 7efde0b6e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe5cf0 0x55bf9dbb92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.205+0000 7efde0b6e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf9dbb8bc0 con 0x55bf9dbb9a40 2024-04-25T02:10:09.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.205+0000 7efde0b6e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efdd81f7ed0 con 0x55bf9dbe5cf0 2024-04-25T02:10:09.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.205+0000 7efde0b6e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55bf9dbe2de0 con 0x55bf9dbe3d60 2024-04-25T02:10:09.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.205+0000 7efde0b6e740 10 client.0 _ll_register_callbacks cb 0x7efdc8035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:09.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.205+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbb9a40 0x55bf9dc02310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.205+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbb9a40 0x55bf9dc02310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35842/0 (socket says 172.21.15.79:35842) 2024-04-25T02:10:09.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.205+0000 7efdd77fe640 1 -- 172.21.15.79:0/387345546 learned_addr learned my addr 172.21.15.79:0/387345546 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:09.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.205+0000 7efdd6ffd640 1 --2- 172.21.15.79:0/387345546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dbe3d60 0x55bf9dbb8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.205+0000 7efdd7fff640 1 --2- 172.21.15.79:0/387345546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe5cf0 0x55bf9dbb92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efdd77fe640 1 -- 172.21.15.79:0/387345546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dbe3d60 msgr2=0x55bf9dbb8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:09.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efdd77fe640 1 --2- 172.21.15.79:0/387345546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dbe3d60 0x55bf9dbb8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efdd77fe640 1 -- 172.21.15.79:0/387345546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe5cf0 msgr2=0x55bf9dbb92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:09.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efdd77fe640 1 --2- 172.21.15.79:0/387345546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe5cf0 0x55bf9dbb92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efdd77fe640 1 -- 172.21.15.79:0/387345546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf9dbf9c50 con 0x55bf9dbb9a40 2024-04-25T02:10:09.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efdd77fe640 1 --2- 172.21.15.79:0/387345546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbb9a40 0x55bf9dc02310 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7efdc8032490 tx=0x7efdc8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbdb0e5ea5b971d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:09.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efdb67fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:10:09.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efdb67fc640 1 -- 172.21.15.79:0/387345546 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8037070 con 0x55bf9dbb9a40 2024-04-25T02:10:09.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efdb67fc640 1 -- 172.21.15.79:0/387345546 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7efdc803cc00 con 0x55bf9dbb9a40 2024-04-25T02:10:09.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efde0b6e740 1 -- 172.21.15.79:0/387345546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdd0061b70 con 0x55bf9dbb9a40 2024-04-25T02:10:09.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efdb67fc640 1 -- 172.21.15.79:0/387345546 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7efdc8032e50 con 0x55bf9dbb9a40 2024-04-25T02:10:09.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efde0b6e740 10 client.5871 fetch_fsmap learned FSMap version 18 2024-04-25T02:10:09.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efde0b6e740 1 -- 172.21.15.79:0/387345546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55bf9dc21ce0 con 0x55bf9dbb9a40 2024-04-25T02:10:09.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efdb67fc640 1 -- 172.21.15.79:0/387345546 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd0061b70 con 0x55bf9dbb9a40 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efdb67fc640 1 -- 172.21.15.79:0/387345546 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7efdc8059070 con 0x55bf9dbb9a40 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efde0b6e740 10 client.5871 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efde0b6e740 10 client.5871 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efde0b6e740 20 client.5871 populate_metadata read hostname 'smithi079' 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efde0b6e740 1 --2- 172.21.15.79:0/387345546 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55bf9dc01600 0x55bf9dbe4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efde0b6e740 4 client.5871 mds_command: new command op to 5598 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.206+0000 7efde0b6e740 1 -- 172.21.15.79:0/387345546 --> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bf9db24f40 con 0x55bf9dc01600 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efdd6ffd640 1 --2- 172.21.15.79:0/387345546 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55bf9dc01600 0x55bf9dbe4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efdb67fc640 10 client.5871 ms_handle_connect on v2:172.21.15.189:6832/1295756642 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efdd6ffd640 1 --2- 172.21.15.79:0/387345546 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55bf9dc01600 0x55bf9dbe4a20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a4b546a45fa59ea server_cookie=2537b0acc18200d6 in_seq=0 out_seq=0 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efdb67fc640 1 -- 172.21.15.79:0/387345546 <== mds.0 v2:172.21.15.189:6832/1295756642 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55bf9db24f40 con 0x55bf9dc01600 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efdb67fc640 10 client.5871 handle_command_reply: tid=0 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efde0b6e740 1 client.5871 shutdown 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efde0b6e740 1 -- 172.21.15.79:0/387345546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbb9a40 msgr2=0x55bf9dc02310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efde0b6e740 1 --2- 172.21.15.79:0/387345546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbb9a40 0x55bf9dc02310 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7efdc8032490 tx=0x7efdc8004730 comp rx=0 tx=0).stop 2024-04-25T02:10:09.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efde0b6e740 1 -- 172.21.15.79:0/387345546 shutdown_connections 2024-04-25T02:10:09.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efde0b6e740 1 --2- 172.21.15.79:0/387345546 >> [v2:172.21.15.189:6832/1295756642,v1:172.21.15.189:6833/1295756642] conn(0x55bf9dc01600 0x55bf9dbe4a20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efde0b6e740 1 --2- 172.21.15.79:0/387345546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf9dbe5cf0 0x55bf9dbb92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efde0b6e740 1 --2- 172.21.15.79:0/387345546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf9dbe3d60 0x55bf9dbb8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efdb67fc640 0 client.5871 ms_handle_reset on v2:172.21.15.189:6832/1295756642 2024-04-25T02:10:09.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efde0b6e740 1 --2- 172.21.15.79:0/387345546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9dbb9a40 0x55bf9dc02310 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efde0b6e740 1 -- 172.21.15.79:0/387345546 >> 172.21.15.79:0/387345546 conn(0x55bf9dbe7310 msgr2=0x55bf9dbdfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:09.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efde0b6e740 1 -- 172.21.15.79:0/387345546 shutdown_connections 2024-04-25T02:10:09.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efde0b6e740 1 -- 172.21.15.79:0/387345546 wait complete. 2024-04-25T02:10:09.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.207+0000 7efde0b6e740 20 client.5871 trim_cache size 0 max 16384 2024-04-25T02:10:09.220 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:10:09.220 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-04-25T02:10:09.220 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-04-25T02:10:09.221 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:10:09.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.208+0000 7efddde5d640 1 -- 172.21.15.79:0/3948463524 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efdc406be30 msgr2=0x7efdc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.208+0000 7efddde5d640 1 --2- 172.21.15.79:0/3948463524 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efdc406be30 0x7efdc406e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efdc8034000 tx=0x7efdc802e000 comp rx=0 tx=0).stop 2024-04-25T02:10:09.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.208+0000 7efddde5d640 1 -- 172.21.15.79:0/3948463524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd815e4f0 msgr2=0x7efdd80c7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.208+0000 7efddde5d640 1 --2- 172.21.15.79:0/3948463524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd815e4f0 0x7efdd80c7ca0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c730 tx=0x7efdd000cbf0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.208+0000 7efddde5d640 1 -- 172.21.15.79:0/3948463524 shutdown_connections 2024-04-25T02:10:09.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.208+0000 7efddde5d640 1 --2- 172.21.15.79:0/3948463524 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efdc406be30 0x7efdc406e2f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.208+0000 7efddde5d640 1 --2- 172.21.15.79:0/3948463524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd815e4f0 0x7efdd80c7ca0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.208+0000 7efddde5d640 1 --2- 172.21.15.79:0/3948463524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdd80cfc80 0x7efdd814e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.208+0000 7efddde5d640 1 --2- 172.21.15.79:0/3948463524 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdd80cf7f0 0x7efdd81f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.208+0000 7efddde5d640 1 -- 172.21.15.79:0/3948463524 >> 172.21.15.79:0/3948463524 conn(0x7efdd809d4a0 msgr2=0x7efdd80b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:09.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.208+0000 7efddde5d640 1 -- 172.21.15.79:0/3948463524 shutdown_connections 2024-04-25T02:10:09.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.208+0000 7efddde5d640 1 -- 172.21.15.79:0/3948463524 wait complete. 2024-04-25T02:10:09.226 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T02:10:09.327 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:10:09.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.416+0000 7f887015c640 1 Processor -- start 2024-04-25T02:10:09.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.416+0000 7f887015c640 1 -- start start 2024-04-25T02:10:09.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.417+0000 7f887015c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f886806e3b0 0x7f88680b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.417+0000 7f887015c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8868071e00 con 0x7f886806df50 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.417+0000 7f887015c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88680720a0 con 0x7f8868143bc0 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.417+0000 7f887015c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8868072cb0 con 0x7f886806e3b0 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.417+0000 7f886d6f7640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f886806df50 0x7f88680b2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33066/0 (socket says 172.21.15.79:33066) 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.417+0000 7f886d6f7640 1 -- 172.21.15.79:0/2508683510 learned_addr learned my addr 172.21.15.79:0/2508683510 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886e6f9640 1 --2- 172.21.15.79:0/2508683510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f886806e3b0 0x7f88680b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2679682469 0 0) 0x7f8868071e00 con 0x7f886806df50 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8854005730 con 0x7f886806df50 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4099667598 0 0) 0x7f88680720a0 con 0x7f8868143bc0 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8868071e00 con 0x7f8868143bc0 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1321975383 0 0) 0x7f8854005730 con 0x7f886806df50 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f886806e3b0 msgr2=0x7f88680b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 --2- 172.21.15.79:0/2508683510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f886806e3b0 0x7f88680b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 >> v1:172.21.15.189:6789/0 conn(0x7f8868143bc0 legacy=0x7f886815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8868072380 con 0x7f886806df50 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f8858001670 con 0x7f886806df50 2024-04-25T02:10:09.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 >> v1:172.21.15.79:6789/0 conn(0x7f886806df50 legacy=0x7f88680b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 --2- 172.21.15.79:0/2508683510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8854005d80 0x7f8854006180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 --2- 172.21.15.79:0/2508683510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8854006a10 0x7f8854006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 --2- 172.21.15.79:0/2508683510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f886806e3b0 0x7f88540073f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8868072cb0 con 0x7f8854006a10 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f885400dd10 con 0x7f8854005d80 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f885400df10 con 0x7f886806e3b0 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886d6f7640 1 --2- 172.21.15.79:0/2508683510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8854006a10 0x7f8854006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886e6f9640 1 --2- 172.21.15.79:0/2508683510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f886806e3b0 0x7f88540073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886def8640 1 --2- 172.21.15.79:0/2508683510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8854005d80 0x7f8854006180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886d6f7640 1 -- 172.21.15.79:0/2508683510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f886806e3b0 msgr2=0x7f88540073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886d6f7640 1 --2- 172.21.15.79:0/2508683510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f886806e3b0 0x7f88540073f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886d6f7640 1 -- 172.21.15.79:0/2508683510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8854005d80 msgr2=0x7f8854006180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886d6f7640 1 --2- 172.21.15.79:0/2508683510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8854005d80 0x7f8854006180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.418+0000 7f886d6f7640 1 -- 172.21.15.79:0/2508683510 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8854005730 con 0x7f8854006a10 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.419+0000 7f886d6f7640 1 --2- 172.21.15.79:0/2508683510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8854006a10 0x7f8854006e90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f885800c1c0 tx=0x7f8854007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6c6b9e126b5141 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:09.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.419+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858007cc0 con 0x7f8854006a10 2024-04-25T02:10:09.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.419+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8858005ad0 con 0x7f8854006a10 2024-04-25T02:10:09.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.419+0000 7f886cef6640 1 -- 172.21.15.79:0/2508683510 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858007070 con 0x7f8854006a10 2024-04-25T02:10:09.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.420+0000 7f887015c640 1 -- 172.21.15.79:0/2508683510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8854006a10 msgr2=0x7f8854006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.420+0000 7f887015c640 1 --2- 172.21.15.79:0/2508683510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8854006a10 0x7f8854006e90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f885800c1c0 tx=0x7f8854007a40 comp rx=0 tx=0).stop 2024-04-25T02:10:09.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.420+0000 7f886e6f9640 1 -- 172.21.15.79:0/2508683510 reap_dead start 2024-04-25T02:10:09.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.420+0000 7f887015c640 1 -- 172.21.15.79:0/2508683510 shutdown_connections 2024-04-25T02:10:09.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.420+0000 7f887015c640 1 -- 172.21.15.79:0/2508683510 >> 172.21.15.79:0/2508683510 conn(0x7f88680cfc80 msgr2=0x7f88680d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:09.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.420+0000 7f887015c640 1 -- 172.21.15.79:0/2508683510 shutdown_connections 2024-04-25T02:10:09.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.420+0000 7f887015c640 1 -- 172.21.15.79:0/2508683510 wait complete. 2024-04-25T02:10:09.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.421+0000 7f887015c640 1 Processor -- start 2024-04-25T02:10:09.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.421+0000 7f887015c640 1 -- start start 2024-04-25T02:10:09.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f887015c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8854006a10 0x7f886814e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f887015c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88681f3680 0x7f88680b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f887015c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f886814c5b0 0x7f88681efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f887015c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f886806e840 con 0x7f8854006a10 2024-04-25T02:10:09.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f887015c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8868072940 con 0x7f88681f3680 2024-04-25T02:10:09.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f887015c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8868143fa0 con 0x7f886814c5b0 2024-04-25T02:10:09.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f886def8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8854006a10 0x7f886814e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f886def8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8854006a10 0x7f886814e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35868/0 (socket says 172.21.15.79:35868) 2024-04-25T02:10:09.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f886def8640 1 -- 172.21.15.79:0/2077820509 learned_addr learned my addr 172.21.15.79:0/2077820509 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:09.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f886e6f9640 1 --2- 172.21.15.79:0/2077820509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f886814c5b0 0x7f88681efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f886d6f7640 1 --2- 172.21.15.79:0/2077820509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88681f3680 0x7f88680b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f886def8640 1 -- 172.21.15.79:0/2077820509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f886814c5b0 msgr2=0x7f88681efc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f886def8640 1 --2- 172.21.15.79:0/2077820509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f886814c5b0 0x7f88681efc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f886def8640 1 -- 172.21.15.79:0/2077820509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88681f3680 msgr2=0x7f88680b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f886def8640 1 --2- 172.21.15.79:0/2077820509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88681f3680 0x7f88680b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f886def8640 1 -- 172.21.15.79:0/2077820509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88681ef790 con 0x7f8854006a10 2024-04-25T02:10:09.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f886def8640 1 --2- 172.21.15.79:0/2077820509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8854006a10 0x7f886814e640 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f886400fb10 tx=0x7f88640021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:09.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f885e7fc640 1 -- 172.21.15.79:0/2077820509 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8864003b80 con 0x7f8854006a10 2024-04-25T02:10:09.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f885e7fc640 1 -- 172.21.15.79:0/2077820509 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8864018070 con 0x7f8854006a10 2024-04-25T02:10:09.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f887015c640 1 -- 172.21.15.79:0/2077820509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f886814ec20 con 0x7f8854006a10 2024-04-25T02:10:09.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.422+0000 7f885e7fc640 1 -- 172.21.15.79:0/2077820509 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886400d8e0 con 0x7f8854006a10 2024-04-25T02:10:09.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.423+0000 7f887015c640 1 -- 172.21.15.79:0/2077820509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f886814f1e0 con 0x7f8854006a10 2024-04-25T02:10:09.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.423+0000 7f887015c640 1 -- 172.21.15.79:0/2077820509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88680690a0 con 0x7f8854006a10 2024-04-25T02:10:09.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.424+0000 7f885e7fc640 1 -- 172.21.15.79:0/2077820509 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f886400da80 con 0x7f8854006a10 2024-04-25T02:10:09.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.424+0000 7f885e7fc640 1 --2- 172.21.15.79:0/2077820509 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f884c06be60 0x7f884c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.424+0000 7f885e7fc640 1 -- 172.21.15.79:0/2077820509 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f886408b240 con 0x7f8854006a10 2024-04-25T02:10:09.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.424+0000 7f886d6f7640 1 --2- 172.21.15.79:0/2077820509 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f884c06be60 0x7f884c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.425+0000 7f886d6f7640 1 --2- 172.21.15.79:0/2077820509 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f884c06be60 0x7f884c06e320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f885800c190 tx=0x7f8858009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:09.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.429+0000 7f885e7fc640 1 -- 172.21.15.79:0/2077820509 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8864059b20 con 0x7f8854006a10 2024-04-25T02:10:09.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.638+0000 7f887015c640 1 -- 172.21.15.79:0/2077820509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88681f3b60 con 0x7f8854006a10 2024-04-25T02:10:09.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.639+0000 7f885e7fc640 1 -- 172.21.15.79:0/2077820509 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7f8864059420 con 0x7f8854006a10 2024-04-25T02:10:09.646 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:09.646 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3934472151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3934472151},{"type":"v1","addr":"172.21.15.189:6835","nonce":3934472151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2046740048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2046740048},{"type":"v1","addr":"172.21.15.79:6836","nonce":2046740048}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/207160678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":207160678},{"type":"v1","addr":"172.21.15.79:6837","nonce":207160678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:09:27.032071+0000","modified":"2024-04-25T02:09:29.046598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/1295756642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1295756642},{"type":"v1","addr":"172.21.15.189:6833","nonce":1295756642}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":3}]} 2024-04-25T02:10:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2024-04-25T02:10:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.640+0000 7f887015c640 1 -- 172.21.15.79:0/2077820509 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f884c06be60 msgr2=0x7f884c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.640+0000 7f887015c640 1 --2- 172.21.15.79:0/2077820509 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f884c06be60 0x7f884c06e320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f885800c190 tx=0x7f8858009030 comp rx=0 tx=0).stop 2024-04-25T02:10:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.640+0000 7f887015c640 1 -- 172.21.15.79:0/2077820509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8854006a10 msgr2=0x7f886814e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.640+0000 7f887015c640 1 --2- 172.21.15.79:0/2077820509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8854006a10 0x7f886814e640 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f886400fb10 tx=0x7f88640021e0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.641+0000 7f887015c640 1 -- 172.21.15.79:0/2077820509 shutdown_connections 2024-04-25T02:10:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.641+0000 7f887015c640 1 --2- 172.21.15.79:0/2077820509 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f884c06be60 0x7f884c06e320 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.641+0000 7f887015c640 1 --2- 172.21.15.79:0/2077820509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f886814c5b0 0x7f88681efc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.641+0000 7f887015c640 1 --2- 172.21.15.79:0/2077820509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88681f3680 0x7f88680b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.641+0000 7f887015c640 1 --2- 172.21.15.79:0/2077820509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8854006a10 0x7f886814e640 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.641+0000 7f887015c640 1 -- 172.21.15.79:0/2077820509 >> 172.21.15.79:0/2077820509 conn(0x7f88680cfc80 msgr2=0x7f886815e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.641+0000 7f887015c640 1 -- 172.21.15.79:0/2077820509 shutdown_connections 2024-04-25T02:10:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.641+0000 7f887015c640 1 -- 172.21.15.79:0/2077820509 wait complete. 2024-04-25T02:10:09.659 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-04-25T02:10:09.791 INFO:teuthology.orchestra.run.smithi189.stdout:{"message":"","return_code":0} 2024-04-25T02:10:09.791 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T02:10:09.791 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T02:10:09.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.826+0000 7fa19601ef40 1 Processor -- start 2024-04-25T02:10:09.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.826+0000 7fa19601ef40 1 -- start start 2024-04-25T02:10:09.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.826+0000 7fa19601ef40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efd803d9b0 0x55efd80b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.826+0000 7fa19601ef40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55efd80411c0 0x55efd8161380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.826+0000 7fa19601ef40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efd80415a0 0x55efd81618c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.826+0000 7fa19601ef40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55efd80b4000 con 0x55efd803d9b0 2024-04-25T02:10:09.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.826+0000 7fa19601ef40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55efd7f9e640 con 0x55efd80415a0 2024-04-25T02:10:09.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.826+0000 7fa19601ef40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55efd80b4180 con 0x55efd80411c0 2024-04-25T02:10:09.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.826+0000 7fa192ead640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efd803d9b0 0x55efd80b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.826+0000 7fa192ead640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efd803d9b0 0x55efd80b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35884/0 (socket says 172.21.15.79:35884) 2024-04-25T02:10:09.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.826+0000 7fa192ead640 1 -- 172.21.15.79:0/3671301150 learned_addr learned my addr 172.21.15.79:0/3671301150 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:09.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.826+0000 7fa192ead640 1 -- 172.21.15.79:0/3671301150 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55efd80411c0 msgr2=0x55efd8161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:09.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.826+0000 7fa192ead640 1 --2- 172.21.15.79:0/3671301150 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55efd80411c0 0x55efd8161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.826+0000 7fa192ead640 1 -- 172.21.15.79:0/3671301150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efd80415a0 msgr2=0x55efd81618c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:09.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.826+0000 7fa192ead640 1 --2- 172.21.15.79:0/3671301150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efd80415a0 0x55efd81618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.827+0000 7fa192ead640 1 -- 172.21.15.79:0/3671301150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efd80c8dd0 con 0x55efd803d9b0 2024-04-25T02:10:09.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.827+0000 7fa192ead640 1 --2- 172.21.15.79:0/3671301150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efd803d9b0 0x55efd80b1350 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa184002e10 tx=0x7fa18400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e41c5afa762d24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:09.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.827+0000 7fa191eab640 1 -- 172.21.15.79:0/3671301150 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184013020 con 0x55efd803d9b0 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.827+0000 7fa191eab640 1 -- 172.21.15.79:0/3671301150 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa18400f400 con 0x55efd803d9b0 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.827+0000 7fa191eab640 1 -- 172.21.15.79:0/3671301150 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18400f7f0 con 0x55efd803d9b0 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.827+0000 7fa19601ef40 1 -- 172.21.15.79:0/3671301150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efd803d9b0 msgr2=0x55efd80b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.827+0000 7fa19601ef40 1 --2- 172.21.15.79:0/3671301150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efd803d9b0 0x55efd80b1350 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa184002e10 tx=0x7fa18400b5b0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.827+0000 7fa19601ef40 1 -- 172.21.15.79:0/3671301150 shutdown_connections 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.827+0000 7fa19601ef40 1 --2- 172.21.15.79:0/3671301150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efd80415a0 0x55efd81618c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.827+0000 7fa19601ef40 1 --2- 172.21.15.79:0/3671301150 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55efd80411c0 0x55efd8161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.827+0000 7fa19601ef40 1 --2- 172.21.15.79:0/3671301150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efd803d9b0 0x55efd80b1350 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.827+0000 7fa19601ef40 1 -- 172.21.15.79:0/3671301150 >> 172.21.15.79:0/3671301150 conn(0x55efd8023920 msgr2=0x55efd80aee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.827+0000 7fa19601ef40 1 -- 172.21.15.79:0/3671301150 shutdown_connections 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.827+0000 7fa19601ef40 1 -- 172.21.15.79:0/3671301150 wait complete. 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.828+0000 7fa19601ef40 1 Processor -- start 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.828+0000 7fa19601ef40 1 -- start start 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa19601ef40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55efd803d9b0 0x55efd80c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa19601ef40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efd80411c0 0x55efd8165530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa19601ef40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efd80415a0 0x55efd80ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa19601ef40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55efd80cc360 con 0x55efd80415a0 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa19601ef40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55efd80aff50 con 0x55efd80411c0 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa19601ef40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55efd80c8a00 con 0x55efd803d9b0 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa1936ae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efd80415a0 0x55efd80ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa1936ae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efd80415a0 0x55efd80ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35886/0 (socket says 172.21.15.79:35886) 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa1936ae640 1 -- 172.21.15.79:0/1594015923 learned_addr learned my addr 172.21.15.79:0/1594015923 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa18bfff640 1 --2- 172.21.15.79:0/1594015923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efd80411c0 0x55efd8165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa192ead640 1 --2- 172.21.15.79:0/1594015923 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55efd803d9b0 0x55efd80c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa1936ae640 1 -- 172.21.15.79:0/1594015923 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55efd803d9b0 msgr2=0x55efd80c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa1936ae640 1 --2- 172.21.15.79:0/1594015923 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55efd803d9b0 0x55efd80c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa1936ae640 1 -- 172.21.15.79:0/1594015923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efd80411c0 msgr2=0x55efd8165530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa1936ae640 1 --2- 172.21.15.79:0/1594015923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efd80411c0 0x55efd8165530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa1936ae640 1 -- 172.21.15.79:0/1594015923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efd80b2690 con 0x55efd80415a0 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa1936ae640 1 --2- 172.21.15.79:0/1594015923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efd80415a0 0x55efd80ca4e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa18c009180 tx=0x7fa18c009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa190ea9640 1 -- 172.21.15.79:0/1594015923 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c014070 con 0x55efd80415a0 2024-04-25T02:10:09.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa190ea9640 1 -- 172.21.15.79:0/1594015923 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa18c010800 con 0x55efd80415a0 2024-04-25T02:10:09.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa19601ef40 1 -- 172.21.15.79:0/1594015923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efd80c8710 con 0x55efd80415a0 2024-04-25T02:10:09.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa190ea9640 1 -- 172.21.15.79:0/1594015923 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c010bf0 con 0x55efd80415a0 2024-04-25T02:10:09.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.829+0000 7fa19601ef40 1 -- 172.21.15.79:0/1594015923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efd80ae4f0 con 0x55efd80415a0 2024-04-25T02:10:09.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.831+0000 7fa190ea9640 1 -- 172.21.15.79:0/1594015923 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa18c017070 con 0x55efd80415a0 2024-04-25T02:10:09.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.831+0000 7fa190ea9640 1 --2- 172.21.15.79:0/1594015923 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa17406a810 0x7fa17406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.831+0000 7fa190ea9640 1 -- 172.21.15.79:0/1594015923 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fa18c089810 con 0x55efd80415a0 2024-04-25T02:10:09.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.831+0000 7fa192ead640 1 --2- 172.21.15.79:0/1594015923 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa17406a810 0x7fa17406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.831+0000 7fa19601ef40 1 --2- 172.21.15.79:0/1594015923 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55efd8165a70 0x55efd80ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:09.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.831+0000 7fa19601ef40 1 -- 172.21.15.79:0/1594015923 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47) -- 0x55efd8021360 con 0x55efd8165a70 2024-04-25T02:10:09.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.831+0000 7fa192ead640 1 --2- 172.21.15.79:0/1594015923 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa17406a810 0x7fa17406ccd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa184000c00 tx=0x7fa18401b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:09.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.831+0000 7fa18bfff640 1 --2- 172.21.15.79:0/1594015923 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55efd8165a70 0x55efd80ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:09.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.832+0000 7fa18bfff640 1 --2- 172.21.15.79:0/1594015923 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55efd8165a70 0x55efd80ad670 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:09.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.832+0000 7fa18bfff640 1 -- 172.21.15.79:0/1594015923 <== osd.6 v2:172.21.15.189:6816/1254358257 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7fa17c051070 con 0x55efd8165a70 2024-04-25T02:10:09.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.832+0000 7fa19601ef40 1 -- 172.21.15.79:0/1594015923 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55efd8165a70 msgr2=0x55efd80ad670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.832+0000 7fa19601ef40 1 --2- 172.21.15.79:0/1594015923 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55efd8165a70 0x55efd80ad670 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:09.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.832+0000 7fa19601ef40 1 -- 172.21.15.79:0/1594015923 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa17406a810 msgr2=0x7fa17406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.832+0000 7fa19601ef40 1 --2- 172.21.15.79:0/1594015923 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa17406a810 0x7fa17406ccd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa184000c00 tx=0x7fa18401b040 comp rx=0 tx=0).stop 2024-04-25T02:10:09.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.832+0000 7fa19601ef40 1 -- 172.21.15.79:0/1594015923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efd80415a0 msgr2=0x55efd80ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:09.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.832+0000 7fa19601ef40 1 --2- 172.21.15.79:0/1594015923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efd80415a0 0x55efd80ca4e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa18c009180 tx=0x7fa18c009640 comp rx=0 tx=0).stop 2024-04-25T02:10:09.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.832+0000 7fa1936ae640 1 -- 172.21.15.79:0/1594015923 reap_dead start 2024-04-25T02:10:09.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.832+0000 7fa19601ef40 1 -- 172.21.15.79:0/1594015923 shutdown_connections 2024-04-25T02:10:09.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.832+0000 7fa19601ef40 1 -- 172.21.15.79:0/1594015923 >> 172.21.15.79:0/1594015923 conn(0x55efd8023920 msgr2=0x55efd80cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:09.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.832+0000 7fa19601ef40 1 -- 172.21.15.79:0/1594015923 shutdown_connections 2024-04-25T02:10:09.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:09.832+0000 7fa19601ef40 1 -- 172.21.15.79:0/1594015923 wait complete. 2024-04-25T02:10:09.844 INFO:teuthology.orchestra.run.smithi079.stdout:Yalphaparent_a 2024-04-25T02:10:09.845 DEBUG:teuthology.orchestra.run.smithi079:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T02:10:09.930 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:10:09.930 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627777, 2024-04-25T02:10:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ancestors": [ 2024-04-25T02:10:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "dirino": 1099511627776, 2024-04-25T02:10:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "dname": "alpha", 2024-04-25T02:10:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 2 2024-04-25T02:10:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "dirino": 1, 2024-04-25T02:10:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "dname": "parent_a", 2024-04-25T02:10:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 4 2024-04-25T02:10:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-04-25T02:10:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 7, 2024-04-25T02:10:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "old_pools": [] 2024-04-25T02:10:09.932 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:10:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:09.933 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:10:09.933 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:10:10.024 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:10:10.062 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:10:10.062 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:10:10.062 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:10:10.062 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:10:10.077 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:10:10.077 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:10:10.132 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:10.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.261+0000 7fd670b77640 1 Processor -- start 2024-04-25T02:10:10.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.261+0000 7fd670b77640 1 -- start start 2024-04-25T02:10:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.262+0000 7fd670b77640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd66c143bc0 0x7fd66c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.262+0000 7fd670b77640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd66c06df50 0x7fd66c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.262+0000 7fd670b77640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c15fa40 con 0x7fd66c0b48e0 2024-04-25T02:10:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.262+0000 7fd670b77640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd66c06e8f0 con 0x7fd66c143bc0 2024-04-25T02:10:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.262+0000 7fd670b77640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd66c072cb0 con 0x7fd66c06df50 2024-04-25T02:10:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.262+0000 7fd66a59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd66c143bc0 0x7fd66c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.262+0000 7fd66a59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd66c143bc0 0x7fd66c15f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35902/0 (socket says 172.21.15.79:35902) 2024-04-25T02:10:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.262+0000 7fd66a59c640 1 -- 172.21.15.79:0/2565617581 learned_addr learned my addr 172.21.15.79:0/2565617581 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.262+0000 7fd663fff640 1 --2- 172.21.15.79:0/2565617581 >> v2:172.21.15.189:3300/0 conn(0x7fd66c06df50 0x7fd66c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.262+0000 7fd66a59c640 1 -- 172.21.15.79:0/2565617581 >> v2:172.21.15.189:3300/0 conn(0x7fd66c06df50 msgr2=0x7fd66c06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.262+0000 7fd66a59c640 1 --2- 172.21.15.79:0/2565617581 >> v2:172.21.15.189:3300/0 conn(0x7fd66c06df50 0x7fd66c06e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.262+0000 7fd66a59c640 1 -- 172.21.15.79:0/2565617581 >> v1:172.21.15.189:6789/0 conn(0x7fd66c0b48e0 legacy=0x7fd66c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.262+0000 7fd66a59c640 1 -- 172.21.15.79:0/2565617581 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66c071e00 con 0x7fd66c143bc0 2024-04-25T02:10:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.263+0000 7fd66a59c640 1 --2- 172.21.15.79:0/2565617581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd66c143bc0 0x7fd66c15f500 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0cf960 tx=0x7fd65c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ffec1b6fd023ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.263+0000 7fd669d9b640 1 -- 172.21.15.79:0/2565617581 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c037070 con 0x7fd66c143bc0 2024-04-25T02:10:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.263+0000 7fd669d9b640 1 -- 172.21.15.79:0/2565617581 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd65c032440 con 0x7fd66c143bc0 2024-04-25T02:10:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.263+0000 7fd669d9b640 1 -- 172.21.15.79:0/2565617581 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c032810 con 0x7fd66c143bc0 2024-04-25T02:10:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.264+0000 7fd670b77640 1 -- 172.21.15.79:0/2565617581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd66c143bc0 msgr2=0x7fd66c15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.264+0000 7fd670b77640 1 --2- 172.21.15.79:0/2565617581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd66c143bc0 0x7fd66c15f500 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0cf960 tx=0x7fd65c02a1a0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.264+0000 7fd670b77640 1 -- 172.21.15.79:0/2565617581 shutdown_connections 2024-04-25T02:10:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.264+0000 7fd670b77640 1 --2- 172.21.15.79:0/2565617581 >> v2:172.21.15.189:3300/0 conn(0x7fd66c06df50 0x7fd66c06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.264+0000 7fd670b77640 1 --2- 172.21.15.79:0/2565617581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd66c143bc0 0x7fd66c15f500 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.264+0000 7fd670b77640 1 -- 172.21.15.79:0/2565617581 >> 172.21.15.79:0/2565617581 conn(0x7fd66c0cfc80 msgr2=0x7fd66c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.264+0000 7fd670b77640 1 -- 172.21.15.79:0/2565617581 shutdown_connections 2024-04-25T02:10:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.264+0000 7fd670b77640 1 -- 172.21.15.79:0/2565617581 wait complete. 2024-04-25T02:10:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.265+0000 7fd670b77640 1 Processor -- start 2024-04-25T02:10:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.265+0000 7fd670b77640 1 -- start start 2024-04-25T02:10:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd670b77640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd66c06df50 0x7fd66c13f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd670b77640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd66c0b48e0 0x7fd66c1e8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd670b77640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd66c143bc0 0x7fd66c1e8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd670b77640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c072660 con 0x7fd66c0b48e0 2024-04-25T02:10:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd670b77640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c072380 con 0x7fd66c06df50 2024-04-25T02:10:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd670b77640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd66c072940 con 0x7fd66c143bc0 2024-04-25T02:10:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd663fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd66c0b48e0 0x7fd66c1e8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd663fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd66c0b48e0 0x7fd66c1e8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35912/0 (socket says 172.21.15.79:35912) 2024-04-25T02:10:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd663fff640 1 -- 172.21.15.79:0/1356156345 learned_addr learned my addr 172.21.15.79:0/1356156345 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd663fff640 1 -- 172.21.15.79:0/1356156345 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd66c143bc0 msgr2=0x7fd66c1e8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd663fff640 1 --2- 172.21.15.79:0/1356156345 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd66c143bc0 0x7fd66c1e8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd663fff640 1 -- 172.21.15.79:0/1356156345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd66c06df50 msgr2=0x7fd66c13f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd66a59c640 1 --2- 172.21.15.79:0/1356156345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd66c06df50 0x7fd66c13f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd663fff640 1 --2- 172.21.15.79:0/1356156345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd66c06df50 0x7fd66c13f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd663fff640 1 -- 172.21.15.79:0/1356156345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66c142bb0 con 0x7fd66c0b48e0 2024-04-25T02:10:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd66a59c640 1 --2- 172.21.15.79:0/1356156345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd66c06df50 0x7fd66c13f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.266+0000 7fd663fff640 1 --2- 172.21.15.79:0/1356156345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd66c0b48e0 0x7fd66c1e8350 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd65400c7f0 tx=0x7fd65400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.267+0000 7fd662ffd640 1 -- 172.21.15.79:0/1356156345 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654015070 con 0x7fd66c0b48e0 2024-04-25T02:10:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.267+0000 7fd662ffd640 1 -- 172.21.15.79:0/1356156345 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd654004220 con 0x7fd66c0b48e0 2024-04-25T02:10:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.267+0000 7fd670b77640 1 -- 172.21.15.79:0/1356156345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd66c1e5b00 con 0x7fd66c0b48e0 2024-04-25T02:10:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.267+0000 7fd662ffd640 1 -- 172.21.15.79:0/1356156345 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654007620 con 0x7fd66c0b48e0 2024-04-25T02:10:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.267+0000 7fd670b77640 1 -- 172.21.15.79:0/1356156345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd66c1e60c0 con 0x7fd66c0b48e0 2024-04-25T02:10:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.268+0000 7fd670b77640 1 -- 172.21.15.79:0/1356156345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd66c143fa0 con 0x7fd66c0b48e0 2024-04-25T02:10:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.268+0000 7fd662ffd640 1 -- 172.21.15.79:0/1356156345 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd6540079d0 con 0x7fd66c0b48e0 2024-04-25T02:10:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.268+0000 7fd662ffd640 1 --2- 172.21.15.79:0/1356156345 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd64c06be30 0x7fd64c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.269+0000 7fd66a59c640 1 --2- 172.21.15.79:0/1356156345 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd64c06be30 0x7fd64c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.269+0000 7fd662ffd640 1 -- 172.21.15.79:0/1356156345 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fd65408b200 con 0x7fd66c0b48e0 2024-04-25T02:10:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.269+0000 7fd66a59c640 1 --2- 172.21.15.79:0/1356156345 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd64c06be30 0x7fd64c06e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd65c034000 tx=0x7fd65c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.273+0000 7fd662ffd640 1 -- 172.21.15.79:0/1356156345 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd66c143fa0 con 0x7fd66c0b48e0 2024-04-25T02:10:10.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.446+0000 7fd670b77640 1 -- 172.21.15.79:0/1356156345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd66c0b5c60 con 0x7fd66c0b48e0 2024-04-25T02:10:10.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.447+0000 7fd662ffd640 1 -- 172.21.15.79:0/1356156345 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16776 (secure 0 0 0) 0x7fd66c0b5c60 con 0x7fd66c0b48e0 2024-04-25T02:10:10.455 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:10.455 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":47,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:09:41.749749+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:09:25.247996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T02:09:26.001469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:10.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.449+0000 7fd670b77640 1 -- 172.21.15.79:0/1356156345 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd64c06be30 msgr2=0x7fd64c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.449+0000 7fd670b77640 1 --2- 172.21.15.79:0/1356156345 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd64c06be30 0x7fd64c06e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd65c034000 tx=0x7fd65c02e000 comp rx=0 tx=0).stop 2024-04-25T02:10:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.449+0000 7fd670b77640 1 -- 172.21.15.79:0/1356156345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd66c0b48e0 msgr2=0x7fd66c1e8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.449+0000 7fd670b77640 1 --2- 172.21.15.79:0/1356156345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd66c0b48e0 0x7fd66c1e8350 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd65400c7f0 tx=0x7fd65400ccb0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.450+0000 7fd670b77640 1 -- 172.21.15.79:0/1356156345 shutdown_connections 2024-04-25T02:10:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.450+0000 7fd670b77640 1 --2- 172.21.15.79:0/1356156345 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd64c06be30 0x7fd64c06e2f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.450+0000 7fd670b77640 1 --2- 172.21.15.79:0/1356156345 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd66c143bc0 0x7fd66c1e8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.450+0000 7fd670b77640 1 --2- 172.21.15.79:0/1356156345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd66c0b48e0 0x7fd66c1e8350 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.450+0000 7fd670b77640 1 --2- 172.21.15.79:0/1356156345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd66c06df50 0x7fd66c13f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.450+0000 7fd670b77640 1 -- 172.21.15.79:0/1356156345 >> 172.21.15.79:0/1356156345 conn(0x7fd66c0cfc80 msgr2=0x7fd66c070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.450+0000 7fd670b77640 1 -- 172.21.15.79:0/1356156345 shutdown_connections 2024-04-25T02:10:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.450+0000 7fd670b77640 1 -- 172.21.15.79:0/1356156345 wait complete. 2024-04-25T02:10:10.468 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:09:25.247996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:09:26.001469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:10:10.468 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:10:10.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.561+0000 7fd5d6d5a640 1 Processor -- start 2024-04-25T02:10:10.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.561+0000 7fd5d6d5a640 1 -- start start 2024-04-25T02:10:10.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.562+0000 7fd5d6d5a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd5d00cf5e0 0x7fd5d0162a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.562+0000 7fd5d6d5a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd5d006b2f0 0x7fd5d006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.562+0000 7fd5d6d5a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d015f4c0 con 0x7fd5d00cf200 2024-04-25T02:10:10.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.562+0000 7fd5d6d5a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd5d0161ff0 con 0x7fd5d00cf5e0 2024-04-25T02:10:10.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.562+0000 7fd5d6d5a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd5d006bc60 con 0x7fd5d006b2f0 2024-04-25T02:10:10.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.562+0000 7fd5cffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd5d00cf5e0 0x7fd5d0162a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.562+0000 7fd5d4af6640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd5d00cf200 0x7fd5d015ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33070/0 (socket says 172.21.15.79:33070) 2024-04-25T02:10:10.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.562+0000 7fd5d4af6640 1 -- 172.21.15.79:0/3460681245 learned_addr learned my addr 172.21.15.79:0/3460681245 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:10.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.562+0000 7fd5cffff640 1 -- 172.21.15.79:0/3460681245 >> v2:172.21.15.189:3300/0 conn(0x7fd5d006b2f0 msgr2=0x7fd5d006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:10.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.562+0000 7fd5cffff640 1 --2- 172.21.15.79:0/3460681245 >> v2:172.21.15.189:3300/0 conn(0x7fd5d006b2f0 0x7fd5d006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.562+0000 7fd5cffff640 1 -- 172.21.15.79:0/3460681245 >> v1:172.21.15.79:6789/0 conn(0x7fd5d00cf200 legacy=0x7fd5d015ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.562+0000 7fd5cffff640 1 -- 172.21.15.79:0/3460681245 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d015f7a0 con 0x7fd5d00cf5e0 2024-04-25T02:10:10.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.563+0000 7fd5cffff640 1 --2- 172.21.15.79:0/3460681245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d00cf5e0 0x7fd5d0162a40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00b5090 tx=0x7fd5bc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7173c88e0b1a5faa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:10.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.563+0000 7fd5cf7fe640 1 -- 172.21.15.79:0/3460681245 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc037070 con 0x7fd5d00cf5e0 2024-04-25T02:10:10.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.563+0000 7fd5cf7fe640 1 -- 172.21.15.79:0/3460681245 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5bc032440 con 0x7fd5d00cf5e0 2024-04-25T02:10:10.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.563+0000 7fd5cf7fe640 1 -- 172.21.15.79:0/3460681245 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc032810 con 0x7fd5d00cf5e0 2024-04-25T02:10:10.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.563+0000 7fd5d6d5a640 1 -- 172.21.15.79:0/3460681245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d00cf5e0 msgr2=0x7fd5d0162a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.563+0000 7fd5d6d5a640 1 --2- 172.21.15.79:0/3460681245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d00cf5e0 0x7fd5d0162a40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00b5090 tx=0x7fd5bc02a1a0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.563+0000 7fd5d6d5a640 1 -- 172.21.15.79:0/3460681245 shutdown_connections 2024-04-25T02:10:10.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.563+0000 7fd5d6d5a640 1 --2- 172.21.15.79:0/3460681245 >> v2:172.21.15.189:3300/0 conn(0x7fd5d006b2f0 0x7fd5d006b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.563+0000 7fd5d6d5a640 1 --2- 172.21.15.79:0/3460681245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d00cf5e0 0x7fd5d0162a40 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.563+0000 7fd5d6d5a640 1 -- 172.21.15.79:0/3460681245 >> 172.21.15.79:0/3460681245 conn(0x7fd5d00b1cd0 msgr2=0x7fd5d00b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:10.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.563+0000 7fd5d6d5a640 1 -- 172.21.15.79:0/3460681245 shutdown_connections 2024-04-25T02:10:10.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.563+0000 7fd5d6d5a640 1 -- 172.21.15.79:0/3460681245 wait complete. 2024-04-25T02:10:10.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.565+0000 7fd5d6d5a640 1 Processor -- start 2024-04-25T02:10:10.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.565+0000 7fd5d6d5a640 1 -- start start 2024-04-25T02:10:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.565+0000 7fd5d6d5a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5d006b2f0 0x7fd5d01518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.565+0000 7fd5d6d5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d00cf200 0x7fd5d0159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.565+0000 7fd5d6d5a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5d00cf5e0 0x7fd5d00ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.565+0000 7fd5d6d5a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d015f110 con 0x7fd5d00cf200 2024-04-25T02:10:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.565+0000 7fd5d6d5a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d0162520 con 0x7fd5d006b2f0 2024-04-25T02:10:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.565+0000 7fd5d6d5a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d0160690 con 0x7fd5d00cf5e0 2024-04-25T02:10:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5cffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d00cf200 0x7fd5d0159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5cffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d00cf200 0x7fd5d0159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35926/0 (socket says 172.21.15.79:35926) 2024-04-25T02:10:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5cffff640 1 -- 172.21.15.79:0/2260975082 learned_addr learned my addr 172.21.15.79:0/2260975082 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5d4af6640 1 --2- 172.21.15.79:0/2260975082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5d006b2f0 0x7fd5d01518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5cffff640 1 -- 172.21.15.79:0/2260975082 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5d00cf5e0 msgr2=0x7fd5d00ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5cffff640 1 --2- 172.21.15.79:0/2260975082 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5d00cf5e0 0x7fd5d00ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5cffff640 1 -- 172.21.15.79:0/2260975082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5d006b2f0 msgr2=0x7fd5d01518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5cffff640 1 --2- 172.21.15.79:0/2260975082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5d006b2f0 0x7fd5d01518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5cffff640 1 -- 172.21.15.79:0/2260975082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d015a650 con 0x7fd5d00cf200 2024-04-25T02:10:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5d4af6640 1 --2- 172.21.15.79:0/2260975082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5d006b2f0 0x7fd5d01518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5cffff640 1 --2- 172.21.15.79:0/2260975082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d00cf200 0x7fd5d0159b90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009890 tx=0x7fd5bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5cd7fa640 1 -- 172.21.15.79:0/2260975082 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc040020 con 0x7fd5d00cf200 2024-04-25T02:10:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5cd7fa640 1 -- 172.21.15.79:0/2260975082 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5bc038040 con 0x7fd5d00cf200 2024-04-25T02:10:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5d6d5a640 1 -- 172.21.15.79:0/2260975082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d015fd60 con 0x7fd5d00cf200 2024-04-25T02:10:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5cd7fa640 1 -- 172.21.15.79:0/2260975082 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc037070 con 0x7fd5d00cf200 2024-04-25T02:10:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.566+0000 7fd5d6d5a640 1 -- 172.21.15.79:0/2260975082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d0160320 con 0x7fd5d00cf200 2024-04-25T02:10:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.567+0000 7fd5d6d5a640 1 -- 172.21.15.79:0/2260975082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d00690a0 con 0x7fd5d00cf200 2024-04-25T02:10:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.568+0000 7fd5cd7fa640 1 -- 172.21.15.79:0/2260975082 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5bc043020 con 0x7fd5d00cf200 2024-04-25T02:10:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.568+0000 7fd5cd7fa640 1 --2- 172.21.15.79:0/2260975082 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd5b406be60 0x7fd5b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.568+0000 7fd5cd7fa640 1 -- 172.21.15.79:0/2260975082 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fd5bc0ab4c0 con 0x7fd5d00cf200 2024-04-25T02:10:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.568+0000 7fd5d4af6640 1 --2- 172.21.15.79:0/2260975082 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd5b406be60 0x7fd5b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.568+0000 7fd5d4af6640 1 --2- 172.21.15.79:0/2260975082 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd5b406be60 0x7fd5b406e320 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00b3e50 tx=0x7fd5c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:10.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.572+0000 7fd5cd7fa640 1 -- 172.21.15.79:0/2260975082 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd5bc04a030 con 0x7fd5d00cf200 2024-04-25T02:10:10.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.746+0000 7fd5d6d5a640 1 -- 172.21.15.79:0/2260975082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd5d009ac10 con 0x7fd5d00cf200 2024-04-25T02:10:10.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.746+0000 7fd5cd7fa640 1 -- 172.21.15.79:0/2260975082 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) ==== 93+0+10 (secure 0 0 0) 0x7fd5bc079ec0 con 0x7fd5d00cf200 2024-04-25T02:10:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:10:10.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.748+0000 7fd5d6d5a640 1 -- 172.21.15.79:0/2260975082 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd5b406be60 msgr2=0x7fd5b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.748+0000 7fd5d6d5a640 1 --2- 172.21.15.79:0/2260975082 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd5b406be60 0x7fd5b406e320 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00b3e50 tx=0x7fd5c4009040 comp rx=0 tx=0).stop 2024-04-25T02:10:10.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.748+0000 7fd5d6d5a640 1 -- 172.21.15.79:0/2260975082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d00cf200 msgr2=0x7fd5d0159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.748+0000 7fd5d6d5a640 1 --2- 172.21.15.79:0/2260975082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d00cf200 0x7fd5d0159b90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009890 tx=0x7fd5bc0046c0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.748+0000 7fd5d6d5a640 1 -- 172.21.15.79:0/2260975082 shutdown_connections 2024-04-25T02:10:10.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.748+0000 7fd5d6d5a640 1 --2- 172.21.15.79:0/2260975082 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd5b406be60 0x7fd5b406e320 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.748+0000 7fd5d6d5a640 1 --2- 172.21.15.79:0/2260975082 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5d00cf5e0 0x7fd5d00ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.748+0000 7fd5d6d5a640 1 --2- 172.21.15.79:0/2260975082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d00cf200 0x7fd5d0159b90 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.748+0000 7fd5d6d5a640 1 --2- 172.21.15.79:0/2260975082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5d006b2f0 0x7fd5d01518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.748+0000 7fd5d6d5a640 1 -- 172.21.15.79:0/2260975082 >> 172.21.15.79:0/2260975082 conn(0x7fd5d00b1cd0 msgr2=0x7fd5d00715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:10.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.748+0000 7fd5d6d5a640 1 -- 172.21.15.79:0/2260975082 shutdown_connections 2024-04-25T02:10:10.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.748+0000 7fd5d6d5a640 1 -- 172.21.15.79:0/2260975082 wait complete. 2024-04-25T02:10:10.767 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:10:10.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.858+0000 7fb1b8dd5640 1 Processor -- start 2024-04-25T02:10:10.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.858+0000 7fb1b8dd5640 1 -- start start 2024-04-25T02:10:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b8dd5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb1b406e6b0 0x7fb1b40b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b8dd5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1b415ec20 con 0x7fb1b40cf7a0 2024-04-25T02:10:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b8dd5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1b415ef00 con 0x7fb1b406b2f0 2024-04-25T02:10:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b8dd5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb1b415f830 con 0x7fb1b406e6b0 2024-04-25T02:10:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1abfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb1b40cf7a0 0x7fb1b415b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33072/0 (socket says 172.21.15.79:33072) 2024-04-25T02:10:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1abfff640 1 -- 172.21.15.79:0/3763910002 learned_addr learned my addr 172.21.15.79:0/3763910002 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b2d9d640 1 --2- 172.21.15.79:0/3763910002 >> v2:172.21.15.189:3300/0 conn(0x7fb1b406e6b0 0x7fb1b40b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4279497093 0 0) 0x7fb1b415ec20 con 0x7fb1b40cf7a0 2024-04-25T02:10:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1a0003520 con 0x7fb1b40cf7a0 2024-04-25T02:10:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499260467 0 0) 0x7fb1b415ef00 con 0x7fb1b406b2f0 2024-04-25T02:10:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1b415ec20 con 0x7fb1b406b2f0 2024-04-25T02:10:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1994362576 0 0) 0x7fb1a0003520 con 0x7fb1b40cf7a0 2024-04-25T02:10:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 >> v2:172.21.15.189:3300/0 conn(0x7fb1b406e6b0 msgr2=0x7fb1b40b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 --2- 172.21.15.79:0/3763910002 >> v2:172.21.15.189:3300/0 conn(0x7fb1b406e6b0 0x7fb1b40b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 >> v1:172.21.15.189:6789/0 conn(0x7fb1b406b2f0 legacy=0x7fb1b406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b415f1e0 con 0x7fb1b40cf7a0 2024-04-25T02:10:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fb19c001670 con 0x7fb1b40cf7a0 2024-04-25T02:10:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 >> v1:172.21.15.79:6789/0 conn(0x7fb1b40cf7a0 legacy=0x7fb1b415b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 --2- 172.21.15.79:0/3763910002 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1a0003b40 0x7fb1a0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 --2- 172.21.15.79:0/3763910002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a0004800 0x7fb1a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 --2- 172.21.15.79:0/3763910002 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1a00051c0 0x7fb1a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b415f830 con 0x7fb1a0004800 2024-04-25T02:10:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a000c0f0 con 0x7fb1a00051c0 2024-04-25T02:10:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a000c2f0 con 0x7fb1a0003b40 2024-04-25T02:10:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.859+0000 7fb1abfff640 1 --2- 172.21.15.79:0/3763910002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a0004800 0x7fb1a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.860+0000 7fb1b2d9d640 1 --2- 172.21.15.79:0/3763910002 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1a00051c0 0x7fb1a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.860+0000 7fb1b259c640 1 --2- 172.21.15.79:0/3763910002 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1a0003b40 0x7fb1a0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.860+0000 7fb1abfff640 1 -- 172.21.15.79:0/3763910002 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1a0003b40 msgr2=0x7fb1a0003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.860+0000 7fb1abfff640 1 --2- 172.21.15.79:0/3763910002 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1a0003b40 0x7fb1a0003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.860+0000 7fb1abfff640 1 -- 172.21.15.79:0/3763910002 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1a00051c0 msgr2=0x7fb1a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.860+0000 7fb1abfff640 1 --2- 172.21.15.79:0/3763910002 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1a00051c0 0x7fb1a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.860+0000 7fb1abfff640 1 -- 172.21.15.79:0/3763910002 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a0003520 con 0x7fb1a0004800 2024-04-25T02:10:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.860+0000 7fb1b2d9d640 1 -- 172.21.15.79:0/3763910002 reap_dead start 2024-04-25T02:10:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.860+0000 7fb1abfff640 1 --2- 172.21.15.79:0/3763910002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a0004800 0x7fb1a0004c80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c210 tx=0x7fb1a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82c8ca168da04e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.860+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c007ce0 con 0x7fb1a0004800 2024-04-25T02:10:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.860+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c005ad0 con 0x7fb1a0004800 2024-04-25T02:10:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.860+0000 7fb1b1d9b640 1 -- 172.21.15.79:0/3763910002 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c007070 con 0x7fb1a0004800 2024-04-25T02:10:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.861+0000 7fb1b8dd5640 1 -- 172.21.15.79:0/3763910002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a0004800 msgr2=0x7fb1a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.861+0000 7fb1b8dd5640 1 --2- 172.21.15.79:0/3763910002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a0004800 0x7fb1a0004c80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c210 tx=0x7fb1a0005830 comp rx=0 tx=0).stop 2024-04-25T02:10:10.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.861+0000 7fb1b8dd5640 1 -- 172.21.15.79:0/3763910002 shutdown_connections 2024-04-25T02:10:10.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.861+0000 7fb1b8dd5640 1 --2- 172.21.15.79:0/3763910002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a0004800 0x7fb1a0004c80 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.861+0000 7fb1b8dd5640 1 -- 172.21.15.79:0/3763910002 >> 172.21.15.79:0/3763910002 conn(0x7fb1b40b1cd0 msgr2=0x7fb1b40b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:10.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.861+0000 7fb1b8dd5640 1 -- 172.21.15.79:0/3763910002 shutdown_connections 2024-04-25T02:10:10.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.861+0000 7fb1b8dd5640 1 -- 172.21.15.79:0/3763910002 wait complete. 2024-04-25T02:10:10.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.862+0000 7fb1b8dd5640 1 Processor -- start 2024-04-25T02:10:10.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.862+0000 7fb1b8dd5640 1 -- start start 2024-04-25T02:10:10.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1b8dd5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1a0004800 0x7fb1b41efe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1b8dd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b414dae0 0x7fb1b414df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1b8dd5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1b4147030 0x7fb1b41474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1b8dd5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b406d160 con 0x7fb1b414dae0 2024-04-25T02:10:10.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1b8dd5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b406cfe0 con 0x7fb1b4147030 2024-04-25T02:10:10.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1b8dd5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb1b40b4b50 con 0x7fb1a0004800 2024-04-25T02:10:10.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1abfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b414dae0 0x7fb1b414df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1abfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b414dae0 0x7fb1b414df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35956/0 (socket says 172.21.15.79:35956) 2024-04-25T02:10:10.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1abfff640 1 -- 172.21.15.79:0/420571036 learned_addr learned my addr 172.21.15.79:0/420571036 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:10.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1b259c640 1 --2- 172.21.15.79:0/420571036 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1a0004800 0x7fb1b41efe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1b2d9d640 1 --2- 172.21.15.79:0/420571036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1b4147030 0x7fb1b41474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1abfff640 1 -- 172.21.15.79:0/420571036 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1a0004800 msgr2=0x7fb1b41efe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1abfff640 1 --2- 172.21.15.79:0/420571036 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1a0004800 0x7fb1b41efe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1abfff640 1 -- 172.21.15.79:0/420571036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1b4147030 msgr2=0x7fb1b41474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1abfff640 1 --2- 172.21.15.79:0/420571036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1b4147030 0x7fb1b41474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:10.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1abfff640 1 -- 172.21.15.79:0/420571036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b41479f0 con 0x7fb1b414dae0 2024-04-25T02:10:10.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.863+0000 7fb1b2d9d640 1 --2- 172.21.15.79:0/420571036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1b4147030 0x7fb1b41474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:10.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.864+0000 7fb1abfff640 1 --2- 172.21.15.79:0/420571036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b414dae0 0x7fb1b414df60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c210 tx=0x7fb1b415f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:10.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.864+0000 7fb1aaffd640 1 -- 172.21.15.79:0/420571036 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c040030 con 0x7fb1b414dae0 2024-04-25T02:10:10.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.864+0000 7fb1aaffd640 1 -- 172.21.15.79:0/420571036 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c005dc0 con 0x7fb1b414dae0 2024-04-25T02:10:10.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.864+0000 7fb1b8dd5640 1 -- 172.21.15.79:0/420571036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b4145f90 con 0x7fb1b414dae0 2024-04-25T02:10:10.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.864+0000 7fb1aaffd640 1 -- 172.21.15.79:0/420571036 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c037040 con 0x7fb1b414dae0 2024-04-25T02:10:10.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.864+0000 7fb1b8dd5640 1 -- 172.21.15.79:0/420571036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b4146550 con 0x7fb1b414dae0 2024-04-25T02:10:10.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.865+0000 7fb1b8dd5640 1 -- 172.21.15.79:0/420571036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1b40690a0 con 0x7fb1b414dae0 2024-04-25T02:10:10.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.865+0000 7fb1aaffd640 1 -- 172.21.15.79:0/420571036 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb19c043070 con 0x7fb1b414dae0 2024-04-25T02:10:10.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.865+0000 7fb1aaffd640 1 --2- 172.21.15.79:0/420571036 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb19406be30 0x7fb19406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:10.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.866+0000 7fb1aaffd640 1 -- 172.21.15.79:0/420571036 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fb19c0aa2c0 con 0x7fb1b414dae0 2024-04-25T02:10:10.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.866+0000 7fb1b259c640 1 --2- 172.21.15.79:0/420571036 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb19406be30 0x7fb19406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:10.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.866+0000 7fb1b259c640 1 --2- 172.21.15.79:0/420571036 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb19406be30 0x7fb19406e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4007fd0 tx=0x7fb1a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:10.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:10.870+0000 7fb1aaffd640 1 -- 172.21.15.79:0/420571036 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb19c04a020 con 0x7fb1b414dae0 2024-04-25T02:10:11.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.043+0000 7fb1b8dd5640 1 -- 172.21.15.79:0/420571036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb1b40cf4f0 con 0x7fb1b414dae0 2024-04-25T02:10:11.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.043+0000 7fb1aaffd640 1 -- 172.21.15.79:0/420571036 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) ==== 104+0+11 (secure 0 0 0) 0x7fb19c0313d0 con 0x7fb1b414dae0 2024-04-25T02:10:11.051 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:10:11.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.045+0000 7fb1b8dd5640 1 -- 172.21.15.79:0/420571036 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb19406be30 msgr2=0x7fb19406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.045+0000 7fb1b8dd5640 1 --2- 172.21.15.79:0/420571036 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb19406be30 0x7fb19406e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4007fd0 tx=0x7fb1a4009040 comp rx=0 tx=0).stop 2024-04-25T02:10:11.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.045+0000 7fb1b8dd5640 1 -- 172.21.15.79:0/420571036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b414dae0 msgr2=0x7fb1b414df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.045+0000 7fb1b8dd5640 1 --2- 172.21.15.79:0/420571036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b414dae0 0x7fb1b414df60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c210 tx=0x7fb1b415f7a0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.045+0000 7fb1b8dd5640 1 -- 172.21.15.79:0/420571036 shutdown_connections 2024-04-25T02:10:11.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.045+0000 7fb1b8dd5640 1 --2- 172.21.15.79:0/420571036 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb19406be30 0x7fb19406e2f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.045+0000 7fb1b8dd5640 1 --2- 172.21.15.79:0/420571036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1b4147030 0x7fb1b41474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.045+0000 7fb1b8dd5640 1 --2- 172.21.15.79:0/420571036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b414dae0 0x7fb1b414df60 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.045+0000 7fb1b8dd5640 1 --2- 172.21.15.79:0/420571036 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1a0004800 0x7fb1b41efe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.045+0000 7fb1b8dd5640 1 -- 172.21.15.79:0/420571036 >> 172.21.15.79:0/420571036 conn(0x7fb1b40b1cd0 msgr2=0x7fb1b414f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.046+0000 7fb1b8dd5640 1 -- 172.21.15.79:0/420571036 shutdown_connections 2024-04-25T02:10:11.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.046+0000 7fb1b8dd5640 1 -- 172.21.15.79:0/420571036 wait complete. 2024-04-25T02:10:11.064 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:10:11.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.156+0000 7f8ecb329640 1 Processor -- start 2024-04-25T02:10:11.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.156+0000 7f8ecb329640 1 -- start start 2024-04-25T02:10:11.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.157+0000 7f8ecb329640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8ec40b41b0 0x7f8ec41605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.157+0000 7f8ecb329640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ec406b2f0 0x7f8ec406b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.157+0000 7f8ecb329640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec4071cd0 con 0x7f8ec4155f00 2024-04-25T02:10:11.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.157+0000 7f8ecb329640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8ec4071fb0 con 0x7f8ec406b2f0 2024-04-25T02:10:11.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.157+0000 7f8ecb329640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f8ec4072290 con 0x7f8ec40b41b0 2024-04-25T02:10:11.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.157+0000 7f8ec88c4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ec406b2f0 0x7f8ec406b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.157+0000 7f8ec88c4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ec406b2f0 0x7f8ec406b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35970/0 (socket says 172.21.15.79:35970) 2024-04-25T02:10:11.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.157+0000 7f8ec88c4640 1 -- 172.21.15.79:0/542384850 learned_addr learned my addr 172.21.15.79:0/542384850 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:11.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.157+0000 7f8ec90c5640 1 --2- 172.21.15.79:0/542384850 >> v2:172.21.15.189:3300/0 conn(0x7f8ec40b41b0 0x7f8ec41605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.157+0000 7f8ec88c4640 1 -- 172.21.15.79:0/542384850 >> v2:172.21.15.189:3300/0 conn(0x7f8ec40b41b0 msgr2=0x7f8ec41605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.157+0000 7f8ec88c4640 1 --2- 172.21.15.79:0/542384850 >> v2:172.21.15.189:3300/0 conn(0x7f8ec40b41b0 0x7f8ec41605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.157+0000 7f8ec88c4640 1 -- 172.21.15.79:0/542384850 >> v1:172.21.15.189:6789/0 conn(0x7f8ec4155f00 legacy=0x7f8ec4156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.157+0000 7f8ec88c4640 1 -- 172.21.15.79:0/542384850 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec4072570 con 0x7f8ec406b2f0 2024-04-25T02:10:11.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.157+0000 7f8ec90c5640 1 --2- 172.21.15.79:0/542384850 >> v2:172.21.15.189:3300/0 conn(0x7f8ec40b41b0 0x7f8ec41605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:11.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.158+0000 7f8ec88c4640 1 --2- 172.21.15.79:0/542384850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec406b2f0 0x7f8ec406b770 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40cdfb0 tx=0x7f8eb402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0cdf6ed011343f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.158+0000 7f8ebbfff640 1 -- 172.21.15.79:0/542384850 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4037070 con 0x7f8ec406b2f0 2024-04-25T02:10:11.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.158+0000 7f8ebbfff640 1 -- 172.21.15.79:0/542384850 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb4032440 con 0x7f8ec406b2f0 2024-04-25T02:10:11.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.158+0000 7f8ebbfff640 1 -- 172.21.15.79:0/542384850 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4032810 con 0x7f8ec406b2f0 2024-04-25T02:10:11.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.158+0000 7f8ecb329640 1 -- 172.21.15.79:0/542384850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec406b2f0 msgr2=0x7f8ec406b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.158+0000 7f8ecb329640 1 --2- 172.21.15.79:0/542384850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec406b2f0 0x7f8ec406b770 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40cdfb0 tx=0x7f8eb402a230 comp rx=0 tx=0).stop 2024-04-25T02:10:11.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.158+0000 7f8ecb329640 1 -- 172.21.15.79:0/542384850 shutdown_connections 2024-04-25T02:10:11.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.158+0000 7f8ecb329640 1 --2- 172.21.15.79:0/542384850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec406b2f0 0x7f8ec406b770 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.158+0000 7f8ecb329640 1 --2- 172.21.15.79:0/542384850 >> v2:172.21.15.189:3300/0 conn(0x7f8ec40b41b0 0x7f8ec41605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.158+0000 7f8ecb329640 1 -- 172.21.15.79:0/542384850 >> 172.21.15.79:0/542384850 conn(0x7f8ec40b1cd0 msgr2=0x7f8ec40b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.159+0000 7f8ecb329640 1 -- 172.21.15.79:0/542384850 shutdown_connections 2024-04-25T02:10:11.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.159+0000 7f8ecb329640 1 -- 172.21.15.79:0/542384850 wait complete. 2024-04-25T02:10:11.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.160+0000 7f8ecb329640 1 Processor -- start 2024-04-25T02:10:11.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.160+0000 7f8ecb329640 1 -- start start 2024-04-25T02:10:11.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.160+0000 7f8ecb329640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8ec406b2f0 0x7f8ec414f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.160+0000 7f8ecb329640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ec40b41b0 0x7f8ec415e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.160+0000 7f8ecb329640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec4155f00 0x7f8ec415fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.160+0000 7f8ecb329640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec415c870 con 0x7f8ec4155f00 2024-04-25T02:10:11.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.160+0000 7f8ecb329640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec4072d70 con 0x7f8ec40b41b0 2024-04-25T02:10:11.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.160+0000 7f8ecb329640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec4156a20 con 0x7f8ec406b2f0 2024-04-25T02:10:11.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.160+0000 7f8ec98c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec4155f00 0x7f8ec415fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8ec98c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec4155f00 0x7f8ec415fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35972/0 (socket says 172.21.15.79:35972) 2024-04-25T02:10:11.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8ec98c6640 1 -- 172.21.15.79:0/1154287223 learned_addr learned my addr 172.21.15.79:0/1154287223 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:11.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8ec88c4640 1 --2- 172.21.15.79:0/1154287223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ec40b41b0 0x7f8ec415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8ec90c5640 1 --2- 172.21.15.79:0/1154287223 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8ec406b2f0 0x7f8ec414f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8ec98c6640 1 -- 172.21.15.79:0/1154287223 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8ec406b2f0 msgr2=0x7f8ec414f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8ec98c6640 1 --2- 172.21.15.79:0/1154287223 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8ec406b2f0 0x7f8ec414f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8ec98c6640 1 -- 172.21.15.79:0/1154287223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ec40b41b0 msgr2=0x7f8ec415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8ec98c6640 1 --2- 172.21.15.79:0/1154287223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ec40b41b0 0x7f8ec415e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8ec98c6640 1 -- 172.21.15.79:0/1154287223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec415ee40 con 0x7f8ec4155f00 2024-04-25T02:10:11.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8ec88c4640 1 --2- 172.21.15.79:0/1154287223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ec40b41b0 0x7f8ec415e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:11.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8ec98c6640 1 --2- 172.21.15.79:0/1154287223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec4155f00 0x7f8ec415fee0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00b410 tx=0x7f8ebc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8eb9ffb640 1 -- 172.21.15.79:0/1154287223 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc015030 con 0x7f8ec4155f00 2024-04-25T02:10:11.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8eb9ffb640 1 -- 172.21.15.79:0/1154287223 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ebc004020 con 0x7f8ec4155f00 2024-04-25T02:10:11.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8eb9ffb640 1 -- 172.21.15.79:0/1154287223 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc004410 con 0x7f8ec4155f00 2024-04-25T02:10:11.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8ecb329640 1 -- 172.21.15.79:0/1154287223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec415f120 con 0x7f8ec4155f00 2024-04-25T02:10:11.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.161+0000 7f8ecb329640 1 -- 172.21.15.79:0/1154287223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec415f6e0 con 0x7f8ec4155f00 2024-04-25T02:10:11.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.162+0000 7f8ecb329640 1 -- 172.21.15.79:0/1154287223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ec4070e80 con 0x7f8ec4155f00 2024-04-25T02:10:11.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.163+0000 7f8eb9ffb640 1 -- 172.21.15.79:0/1154287223 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ebc018070 con 0x7f8ec4155f00 2024-04-25T02:10:11.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.163+0000 7f8eb9ffb640 1 --2- 172.21.15.79:0/1154287223 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8ea806be30 0x7f8ea806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.163+0000 7f8eb9ffb640 1 -- 172.21.15.79:0/1154287223 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f8ebc08a990 con 0x7f8ec4155f00 2024-04-25T02:10:11.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.163+0000 7f8ec90c5640 1 --2- 172.21.15.79:0/1154287223 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8ea806be30 0x7f8ea806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.163+0000 7f8ec90c5640 1 --2- 172.21.15.79:0/1154287223 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8ea806be30 0x7f8ea806e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00075b0 tx=0x7f8ec0007540 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.167+0000 7f8eb9ffb640 1 -- 172.21.15.79:0/1154287223 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8ec4070e80 con 0x7f8ec4155f00 2024-04-25T02:10:11.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.343+0000 7f8ecb329640 1 -- 172.21.15.79:0/1154287223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8ec415fbc0 con 0x7f8ec4155f00 2024-04-25T02:10:11.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.343+0000 7f8eb9ffb640 1 -- 172.21.15.79:0/1154287223 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) ==== 100+0+11 (secure 0 0 0) 0x7f8ebc059390 con 0x7f8ec4155f00 2024-04-25T02:10:11.351 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:10:11.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.345+0000 7f8ecb329640 1 -- 172.21.15.79:0/1154287223 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8ea806be30 msgr2=0x7f8ea806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.345+0000 7f8ecb329640 1 --2- 172.21.15.79:0/1154287223 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8ea806be30 0x7f8ea806e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00075b0 tx=0x7f8ec0007540 comp rx=0 tx=0).stop 2024-04-25T02:10:11.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.345+0000 7f8ecb329640 1 -- 172.21.15.79:0/1154287223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec4155f00 msgr2=0x7f8ec415fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.345+0000 7f8ecb329640 1 --2- 172.21.15.79:0/1154287223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec4155f00 0x7f8ec415fee0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00b410 tx=0x7f8ebc00b8d0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.345+0000 7f8ecb329640 1 -- 172.21.15.79:0/1154287223 shutdown_connections 2024-04-25T02:10:11.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.345+0000 7f8ecb329640 1 --2- 172.21.15.79:0/1154287223 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8ea806be30 0x7f8ea806e2f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.345+0000 7f8ecb329640 1 --2- 172.21.15.79:0/1154287223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec4155f00 0x7f8ec415fee0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.345+0000 7f8ecb329640 1 --2- 172.21.15.79:0/1154287223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ec40b41b0 0x7f8ec415e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.345+0000 7f8ecb329640 1 --2- 172.21.15.79:0/1154287223 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8ec406b2f0 0x7f8ec414f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.345+0000 7f8ecb329640 1 -- 172.21.15.79:0/1154287223 >> 172.21.15.79:0/1154287223 conn(0x7f8ec40b1cd0 msgr2=0x7f8ec4156310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.345+0000 7f8ecb329640 1 -- 172.21.15.79:0/1154287223 shutdown_connections 2024-04-25T02:10:11.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.345+0000 7f8ecb329640 1 -- 172.21.15.79:0/1154287223 wait complete. 2024-04-25T02:10:11.364 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:10:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.453+0000 7ff062fb7640 1 Processor -- start 2024-04-25T02:10:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.453+0000 7ff062fb7640 1 -- start start 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff062fb7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff05c15bc10 0x7ff05c162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff062fb7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff05c15bff0 0x7ff05c06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff062fb7640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff05c06e490 0x7ff05c0ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff062fb7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff05c162d40 con 0x7ff05c15bff0 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff062fb7640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff05c15e870 con 0x7ff05c06e490 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff062fb7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff05c15eb10 con 0x7ff05c15bc10 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff05bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff05c15bff0 0x7ff05c06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff05bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff05c15bff0 0x7ff05c06df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35980/0 (socket says 172.21.15.79:35980) 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff05bfff640 1 -- 172.21.15.79:0/1530231733 learned_addr learned my addr 172.21.15.79:0/1530231733 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff061554640 1 --2- 172.21.15.79:0/1530231733 >> v2:172.21.15.189:3300/0 conn(0x7ff05c06e490 0x7ff05c0ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff060d53640 1 --2- 172.21.15.79:0/1530231733 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff05c15bc10 0x7ff05c162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff05bfff640 1 -- 172.21.15.79:0/1530231733 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff05c15bc10 msgr2=0x7ff05c162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff05bfff640 1 --2- 172.21.15.79:0/1530231733 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff05c15bc10 0x7ff05c162800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff05bfff640 1 -- 172.21.15.79:0/1530231733 >> v2:172.21.15.189:3300/0 conn(0x7ff05c06e490 msgr2=0x7ff05c0ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff05bfff640 1 --2- 172.21.15.79:0/1530231733 >> v2:172.21.15.189:3300/0 conn(0x7ff05c06e490 0x7ff05c0ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.454+0000 7ff05bfff640 1 -- 172.21.15.79:0/1530231733 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c15edf0 con 0x7ff05c15bff0 2024-04-25T02:10:11.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.455+0000 7ff05bfff640 1 --2- 172.21.15.79:0/1530231733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff05c15bff0 0x7ff05c06df50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff05c06f090 tx=0x7ff05002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208fe53a0be59577 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.455+0000 7ff05b7fe640 1 -- 172.21.15.79:0/1530231733 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050037070 con 0x7ff05c15bff0 2024-04-25T02:10:11.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.455+0000 7ff05b7fe640 1 -- 172.21.15.79:0/1530231733 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff050032440 con 0x7ff05c15bff0 2024-04-25T02:10:11.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.455+0000 7ff05b7fe640 1 -- 172.21.15.79:0/1530231733 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050032810 con 0x7ff05c15bff0 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.456+0000 7ff062fb7640 1 -- 172.21.15.79:0/1530231733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff05c15bff0 msgr2=0x7ff05c06df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.456+0000 7ff062fb7640 1 --2- 172.21.15.79:0/1530231733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff05c15bff0 0x7ff05c06df50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff05c06f090 tx=0x7ff05002a140 comp rx=0 tx=0).stop 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.456+0000 7ff062fb7640 1 -- 172.21.15.79:0/1530231733 shutdown_connections 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.456+0000 7ff062fb7640 1 --2- 172.21.15.79:0/1530231733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff05c15bff0 0x7ff05c06df50 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.456+0000 7ff062fb7640 1 --2- 172.21.15.79:0/1530231733 >> v2:172.21.15.189:3300/0 conn(0x7ff05c06e490 0x7ff05c0ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.456+0000 7ff062fb7640 1 --2- 172.21.15.79:0/1530231733 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff05c15bc10 0x7ff05c162800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.456+0000 7ff062fb7640 1 -- 172.21.15.79:0/1530231733 >> 172.21.15.79:0/1530231733 conn(0x7ff05c0cfc80 msgr2=0x7ff05c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.456+0000 7ff062fb7640 1 -- 172.21.15.79:0/1530231733 shutdown_connections 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.456+0000 7ff062fb7640 1 -- 172.21.15.79:0/1530231733 wait complete. 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.457+0000 7ff062fb7640 1 Processor -- start 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.457+0000 7ff062fb7640 1 -- start start 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff062fb7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff05c06e490 0x7ff05c071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff062fb7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff05c15bc10 0x7ff05c0c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff062fb7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff05c15bff0 0x7ff05c148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff062fb7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c15f690 con 0x7ff05c15bc10 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff062fb7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c15f3b0 con 0x7ff05c15bff0 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff062fb7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff05c0aef70 con 0x7ff05c06e490 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff05bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff05c15bc10 0x7ff05c0c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff05bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff05c15bc10 0x7ff05c0c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35984/0 (socket says 172.21.15.79:35984) 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff05bfff640 1 -- 172.21.15.79:0/2866612604 learned_addr learned my addr 172.21.15.79:0/2866612604 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff061554640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff05c15bff0 0x7ff05c148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff060d53640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff05c06e490 0x7ff05c071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff05bfff640 1 -- 172.21.15.79:0/2866612604 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff05c06e490 msgr2=0x7ff05c071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff05bfff640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff05c06e490 0x7ff05c071eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff05bfff640 1 -- 172.21.15.79:0/2866612604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff05c15bff0 msgr2=0x7ff05c148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff05bfff640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff05c15bff0 0x7ff05c148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff05bfff640 1 -- 172.21.15.79:0/2866612604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c1f7ce0 con 0x7ff05c15bc10 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff061554640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff05c15bff0 0x7ff05c148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff060d53640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff05c06e490 0x7ff05c071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.458+0000 7ff05bfff640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff05c15bc10 0x7ff05c0c4ca0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff05002a180 tx=0x7ff0500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.459+0000 7ff0597fa640 1 -- 172.21.15.79:0/2866612604 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050041020 con 0x7ff05c15bc10 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.459+0000 7ff0597fa640 1 -- 172.21.15.79:0/2866612604 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0500306c0 con 0x7ff05c15bc10 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.459+0000 7ff062fb7640 1 -- 172.21.15.79:0/2866612604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05c1f7fc0 con 0x7ff05c15bc10 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.459+0000 7ff0597fa640 1 -- 172.21.15.79:0/2866612604 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050037040 con 0x7ff05c15bc10 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.459+0000 7ff062fb7640 1 -- 172.21.15.79:0/2866612604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff05c1f8580 con 0x7ff05c15bc10 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.460+0000 7ff062fb7640 1 -- 172.21.15.79:0/2866612604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff05c0690a0 con 0x7ff05c15bc10 2024-04-25T02:10:11.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.460+0000 7ff0597fa640 1 -- 172.21.15.79:0/2866612604 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff050044020 con 0x7ff05c15bc10 2024-04-25T02:10:11.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.460+0000 7ff0597fa640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff04806be30 0x7ff04806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.461+0000 7ff0597fa640 1 -- 172.21.15.79:0/2866612604 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ff0500ab6e0 con 0x7ff05c15bc10 2024-04-25T02:10:11.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.461+0000 7ff060d53640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff04806be30 0x7ff04806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.461+0000 7ff060d53640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff04806be30 0x7ff04806e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff04c006fd0 tx=0x7ff04c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.465+0000 7ff0597fa640 1 -- 172.21.15.79:0/2866612604 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff05004b030 con 0x7ff05c15bc10 2024-04-25T02:10:11.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.650+0000 7ff062fb7640 1 -- 172.21.15.79:0/2866612604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff05c0d08e0 con 0x7ff05c15bc10 2024-04-25T02:10:11.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.651+0000 7ff0597fa640 1 -- 172.21.15.79:0/2866612604 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) ==== 80+0+0 (secure 0 0 0) 0x7ff05007a050 con 0x7ff05c15bc10 2024-04-25T02:10:11.658 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-04-25T02:10:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.653+0000 7ff062fb7640 1 -- 172.21.15.79:0/2866612604 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff04806be30 msgr2=0x7ff04806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.653+0000 7ff062fb7640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff04806be30 0x7ff04806e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff04c006fd0 tx=0x7ff04c008040 comp rx=0 tx=0).stop 2024-04-25T02:10:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.653+0000 7ff062fb7640 1 -- 172.21.15.79:0/2866612604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff05c15bc10 msgr2=0x7ff05c0c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.653+0000 7ff062fb7640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff05c15bc10 0x7ff05c0c4ca0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff05002a180 tx=0x7ff0500046c0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.653+0000 7ff062fb7640 1 -- 172.21.15.79:0/2866612604 shutdown_connections 2024-04-25T02:10:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.653+0000 7ff062fb7640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff04806be30 0x7ff04806e2f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.653+0000 7ff062fb7640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff05c15bff0 0x7ff05c148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.653+0000 7ff062fb7640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff05c15bc10 0x7ff05c0c4ca0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.653+0000 7ff062fb7640 1 --2- 172.21.15.79:0/2866612604 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff05c06e490 0x7ff05c071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.653+0000 7ff062fb7640 1 -- 172.21.15.79:0/2866612604 >> 172.21.15.79:0/2866612604 conn(0x7ff05c0cfc80 msgr2=0x7ff05c0b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.653+0000 7ff062fb7640 1 -- 172.21.15.79:0/2866612604 shutdown_connections 2024-04-25T02:10:11.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.653+0000 7ff062fb7640 1 -- 172.21.15.79:0/2866612604 wait complete. 2024-04-25T02:10:11.671 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:10:11.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:11.672 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:10:11.711 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:10:11.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:11.711 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:10:11.767 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:10:11.767 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:10:11.767 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:10:11.784 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:10:11.784 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:10:11.785 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:10:11.785 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:10:11.822 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:10:11.822 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:10:11.822 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:10:11.822 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:10:11.842 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:10:11.842 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:10:11.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.950+0000 7fcde8238640 1 Processor -- start 2024-04-25T02:10:11.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.950+0000 7fcde8238640 1 -- start start 2024-04-25T02:10:11.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.951+0000 7fcde8238640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcde0143bc0 0x7fcde015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.951+0000 7fcde8238640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde015fa40 con 0x7fcde00b3d40 2024-04-25T02:10:11.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.951+0000 7fcde8238640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde00b5700 con 0x7fcde006df50 2024-04-25T02:10:11.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.951+0000 7fcde8238640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcde0072cb0 con 0x7fcde0143bc0 2024-04-25T02:10:11.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.951+0000 7fcde67d5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcde00b3d40 0x7fcde00b4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33084/0 (socket says 172.21.15.79:33084) 2024-04-25T02:10:11.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.951+0000 7fcde67d5640 1 -- 172.21.15.79:0/2892427662 learned_addr learned my addr 172.21.15.79:0/2892427662 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:11.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.951+0000 7fcde5fd4640 1 --2- 172.21.15.79:0/2892427662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcde0143bc0 0x7fcde015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.951+0000 7fcde4fd2640 1 -- 172.21.15.79:0/2892427662 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2605823825 0 0) 0x7fcdd8001490 con 0x7fcde00b3d40 2024-04-25T02:10:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.951+0000 7fcde4fd2640 1 -- 172.21.15.79:0/2892427662 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdcc003520 con 0x7fcde00b3d40 2024-04-25T02:10:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde4fd2640 1 -- 172.21.15.79:0/2892427662 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2491543761 0 0) 0x7fcdcc003520 con 0x7fcde00b3d40 2024-04-25T02:10:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde4fd2640 1 -- 172.21.15.79:0/2892427662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcde0143bc0 msgr2=0x7fcde015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde4fd2640 1 --2- 172.21.15.79:0/2892427662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcde0143bc0 0x7fcde015f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde4fd2640 1 -- 172.21.15.79:0/2892427662 >> v1:172.21.15.189:6789/0 conn(0x7fcde006df50 legacy=0x7fcde00b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde4fd2640 1 -- 172.21.15.79:0/2892427662 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde0071e00 con 0x7fcde00b3d40 2024-04-25T02:10:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde4fd2640 1 -- 172.21.15.79:0/2892427662 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fcdd8001bc0 con 0x7fcde00b3d40 2024-04-25T02:10:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde4fd2640 1 -- 172.21.15.79:0/2892427662 >> v1:172.21.15.79:6789/0 conn(0x7fcde00b3d40 legacy=0x7fcde00b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde4fd2640 1 --2- 172.21.15.79:0/2892427662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcde0143bc0 0x7fcdcc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde4fd2640 1 --2- 172.21.15.79:0/2892427662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdcc003f20 0x7fcdcc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde4fd2640 1 --2- 172.21.15.79:0/2892427662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdcc004d40 0x7fcdcc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde4fd2640 1 -- 172.21.15.79:0/2892427662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcde0072cb0 con 0x7fcdcc004d40 2024-04-25T02:10:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde4fd2640 1 -- 172.21.15.79:0/2892427662 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc00bad0 con 0x7fcdcc003f20 2024-04-25T02:10:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde4fd2640 1 -- 172.21.15.79:0/2892427662 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcdcc00bcd0 con 0x7fcde0143bc0 2024-04-25T02:10:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde67d5640 1 --2- 172.21.15.79:0/2892427662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdcc004d40 0x7fcdcc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde5fd4640 1 --2- 172.21.15.79:0/2892427662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcde0143bc0 0x7fcdcc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde57d3640 1 --2- 172.21.15.79:0/2892427662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdcc003f20 0x7fcdcc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde67d5640 1 -- 172.21.15.79:0/2892427662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcde0143bc0 msgr2=0x7fcdcc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde67d5640 1 --2- 172.21.15.79:0/2892427662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcde0143bc0 0x7fcdcc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde67d5640 1 -- 172.21.15.79:0/2892427662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdcc003f20 msgr2=0x7fcdcc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde67d5640 1 --2- 172.21.15.79:0/2892427662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdcc003f20 0x7fcdcc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.952+0000 7fcde67d5640 1 -- 172.21.15.79:0/2892427662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc003520 con 0x7fcdcc004d40 2024-04-25T02:10:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.953+0000 7fcde67d5640 1 --2- 172.21.15.79:0/2892427662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdcc004d40 0x7fcdcc0051c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800aa70 tx=0x7fcdcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2640946f9aa0a144 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.953+0000 7fcde4fd2640 1 -- 172.21.15.79:0/2892427662 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd800a690 con 0x7fcdcc004d40 2024-04-25T02:10:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.953+0000 7fcde4fd2640 1 -- 172.21.15.79:0/2892427662 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd802f070 con 0x7fcdcc004d40 2024-04-25T02:10:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.953+0000 7fcde4fd2640 1 -- 172.21.15.79:0/2892427662 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8034470 con 0x7fcdcc004d40 2024-04-25T02:10:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.953+0000 7fcde8238640 1 -- 172.21.15.79:0/2892427662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdcc004d40 msgr2=0x7fcdcc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.953+0000 7fcde8238640 1 --2- 172.21.15.79:0/2892427662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdcc004d40 0x7fcdcc0051c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800aa70 tx=0x7fcdcc005830 comp rx=0 tx=0).stop 2024-04-25T02:10:11.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.954+0000 7fcde67d5640 1 -- 172.21.15.79:0/2892427662 reap_dead start 2024-04-25T02:10:11.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.954+0000 7fcde8238640 1 -- 172.21.15.79:0/2892427662 shutdown_connections 2024-04-25T02:10:11.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.954+0000 7fcde8238640 1 -- 172.21.15.79:0/2892427662 >> 172.21.15.79:0/2892427662 conn(0x7fcde00cfc80 msgr2=0x7fcde00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.954+0000 7fcde8238640 1 -- 172.21.15.79:0/2892427662 shutdown_connections 2024-04-25T02:10:11.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.954+0000 7fcde8238640 1 -- 172.21.15.79:0/2892427662 wait complete. 2024-04-25T02:10:11.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.955+0000 7fcde8238640 1 Processor -- start 2024-04-25T02:10:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.955+0000 7fcde8238640 1 -- start start 2024-04-25T02:10:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.955+0000 7fcde8238640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdcc004d40 0x7fcde01566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.955+0000 7fcde8238640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcde01556d0 0x7fcde01429f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde8238640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde0159c00 0x7fcde015a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde8238640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcde0072660 con 0x7fcde0159c00 2024-04-25T02:10:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde8238640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcde0072380 con 0x7fcdcc004d40 2024-04-25T02:10:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde8238640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcde0072940 con 0x7fcde01556d0 2024-04-25T02:10:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde67d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde0159c00 0x7fcde015a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde67d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde0159c00 0x7fcde015a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35994/0 (socket says 172.21.15.79:35994) 2024-04-25T02:10:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde67d5640 1 -- 172.21.15.79:0/342906159 learned_addr learned my addr 172.21.15.79:0/342906159 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde5fd4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdcc004d40 0x7fcde01566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde57d3640 1 --2- 172.21.15.79:0/342906159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcde01556d0 0x7fcde01429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde67d5640 1 -- 172.21.15.79:0/342906159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcde01556d0 msgr2=0x7fcde01429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde67d5640 1 --2- 172.21.15.79:0/342906159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcde01556d0 0x7fcde01429f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde67d5640 1 -- 172.21.15.79:0/342906159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdcc004d40 msgr2=0x7fcde01566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde67d5640 1 --2- 172.21.15.79:0/342906159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdcc004d40 0x7fcde01566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde67d5640 1 -- 172.21.15.79:0/342906159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde0158350 con 0x7fcde0159c00 2024-04-25T02:10:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde67d5640 1 --2- 172.21.15.79:0/342906159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde0159c00 0x7fcde015a080 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8001ec0 tx=0x7fcdd8001f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcdd67fc640 1 -- 172.21.15.79:0/342906159 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd800a690 con 0x7fcde0159c00 2024-04-25T02:10:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcdd67fc640 1 -- 172.21.15.79:0/342906159 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd8004e10 con 0x7fcde0159c00 2024-04-25T02:10:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcdd67fc640 1 -- 172.21.15.79:0/342906159 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd802bcb0 con 0x7fcde0159c00 2024-04-25T02:10:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde8238640 1 -- 172.21.15.79:0/342906159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde01585f0 con 0x7fcde0159c00 2024-04-25T02:10:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.956+0000 7fcde8238640 1 -- 172.21.15.79:0/342906159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde0158bb0 con 0x7fcde0159c00 2024-04-25T02:10:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.957+0000 7fcde8238640 1 -- 172.21.15.79:0/342906159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde00b56f0 con 0x7fcde0159c00 2024-04-25T02:10:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.958+0000 7fcdd67fc640 1 -- 172.21.15.79:0/342906159 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcdd8034470 con 0x7fcde0159c00 2024-04-25T02:10:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.958+0000 7fcdd67fc640 1 --2- 172.21.15.79:0/342906159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdc406be30 0x7fcdc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.958+0000 7fcdd67fc640 1 -- 172.21.15.79:0/342906159 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fcdd80aa520 con 0x7fcde0159c00 2024-04-25T02:10:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.958+0000 7fcde5fd4640 1 --2- 172.21.15.79:0/342906159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdc406be30 0x7fcdc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.959+0000 7fcde5fd4640 1 --2- 172.21.15.79:0/342906159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdc406be30 0x7fcdc406e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009ba0 tx=0x7fcddc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:11.962+0000 7fcdd67fc640 1 -- 172.21.15.79:0/342906159 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcde00b56f0 con 0x7fcde0159c00 2024-04-25T02:10:12.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.171+0000 7fcde8238640 1 -- 172.21.15.79:0/342906159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcde0155ab0 con 0x7fcde0159c00 2024-04-25T02:10:12.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.171+0000 7fcdd67fc640 1 -- 172.21.15.79:0/342906159 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7fcde015fa40 con 0x7fcde0159c00 2024-04-25T02:10:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:12.179 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3934472151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3934472151},{"type":"v1","addr":"172.21.15.189:6835","nonce":3934472151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2046740048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2046740048},{"type":"v1","addr":"172.21.15.79:6836","nonce":2046740048}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/207160678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":207160678},{"type":"v1","addr":"172.21.15.79:6837","nonce":207160678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:09:27.032071+0000","modified":"2024-04-25T02:09:29.046598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/1295756642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1295756642},{"type":"v1","addr":"172.21.15.189:6833","nonce":1295756642}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":3}]} 2024-04-25T02:10:12.179 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2024-04-25T02:10:12.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.173+0000 7fcde8238640 1 -- 172.21.15.79:0/342906159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdc406be30 msgr2=0x7fcdc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.173+0000 7fcde8238640 1 --2- 172.21.15.79:0/342906159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdc406be30 0x7fcdc406e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009ba0 tx=0x7fcddc009190 comp rx=0 tx=0).stop 2024-04-25T02:10:12.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.173+0000 7fcde8238640 1 -- 172.21.15.79:0/342906159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde0159c00 msgr2=0x7fcde015a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.173+0000 7fcde8238640 1 --2- 172.21.15.79:0/342906159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde0159c00 0x7fcde015a080 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8001ec0 tx=0x7fcdd8001f90 comp rx=0 tx=0).stop 2024-04-25T02:10:12.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.173+0000 7fcde8238640 1 -- 172.21.15.79:0/342906159 shutdown_connections 2024-04-25T02:10:12.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.173+0000 7fcde8238640 1 --2- 172.21.15.79:0/342906159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdc406be30 0x7fcdc406e2f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.173+0000 7fcde8238640 1 --2- 172.21.15.79:0/342906159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde0159c00 0x7fcde015a080 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.173+0000 7fcde8238640 1 --2- 172.21.15.79:0/342906159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcde01556d0 0x7fcde01429f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.173+0000 7fcde8238640 1 --2- 172.21.15.79:0/342906159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdcc004d40 0x7fcde01566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.173+0000 7fcde8238640 1 -- 172.21.15.79:0/342906159 >> 172.21.15.79:0/342906159 conn(0x7fcde00cfc80 msgr2=0x7fcde00cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:12.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.173+0000 7fcde8238640 1 -- 172.21.15.79:0/342906159 shutdown_connections 2024-04-25T02:10:12.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.173+0000 7fcde8238640 1 -- 172.21.15.79:0/342906159 wait complete. 2024-04-25T02:10:12.192 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:12.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.280+0000 7fcb7d3dc640 1 Processor -- start 2024-04-25T02:10:12.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.280+0000 7fcb7d3dc640 1 -- start start 2024-04-25T02:10:12.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.281+0000 7fcb7d3dc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb78161b90 0x7fcb780d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.281+0000 7fcb7d3dc640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcb780d0a60 0x7fcb780d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.281+0000 7fcb7d3dc640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb780ceed0 con 0x7fcb780d47e0 2024-04-25T02:10:12.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.281+0000 7fcb7d3dc640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fcb780ceca0 con 0x7fcb780d0a60 2024-04-25T02:10:12.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.281+0000 7fcb7d3dc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcb780d4f80 con 0x7fcb78161b90 2024-04-25T02:10:12.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.281+0000 7fcb777fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcb780d0a60 0x7fcb780d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.281+0000 7fcb76ffd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb78161b90 0x7fcb780d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.281+0000 7fcb777fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcb780d0a60 0x7fcb780d0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:44626/0 (socket says 172.21.15.79:44626) 2024-04-25T02:10:12.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.281+0000 7fcb777fe640 1 -- 172.21.15.79:0/3663588401 learned_addr learned my addr 172.21.15.79:0/3663588401 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:12.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.281+0000 7fcb76ffd640 1 -- 172.21.15.79:0/3663588401 >> v2:172.21.15.189:3300/0 conn(0x7fcb780d0a60 msgr2=0x7fcb780d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:12.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.281+0000 7fcb76ffd640 1 --2- 172.21.15.79:0/3663588401 >> v2:172.21.15.189:3300/0 conn(0x7fcb780d0a60 0x7fcb780d0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.282+0000 7fcb76ffd640 1 -- 172.21.15.79:0/3663588401 >> v1:172.21.15.189:6789/0 conn(0x7fcb780d47e0 legacy=0x7fcb780cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.282+0000 7fcb76ffd640 1 -- 172.21.15.79:0/3663588401 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb780cf1b0 con 0x7fcb78161b90 2024-04-25T02:10:12.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.282+0000 7fcb777fe640 1 --2- 172.21.15.79:0/3663588401 >> v2:172.21.15.189:3300/0 conn(0x7fcb780d0a60 0x7fcb780d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:12.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.282+0000 7fcb76ffd640 1 --2- 172.21.15.79:0/3663588401 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb78161b90 0x7fcb780d2da0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcb680097a0 tx=0x7fcb6802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aac752795cdc2fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:12.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.282+0000 7fcb75ffb640 1 -- 172.21.15.79:0/3663588401 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68037070 con 0x7fcb78161b90 2024-04-25T02:10:12.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.283+0000 7fcb75ffb640 1 -- 172.21.15.79:0/3663588401 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb68032440 con 0x7fcb78161b90 2024-04-25T02:10:12.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.283+0000 7fcb75ffb640 1 -- 172.21.15.79:0/3663588401 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68032810 con 0x7fcb78161b90 2024-04-25T02:10:12.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.283+0000 7fcb7d3dc640 1 -- 172.21.15.79:0/3663588401 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb78161b90 msgr2=0x7fcb780d2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.283+0000 7fcb7d3dc640 1 --2- 172.21.15.79:0/3663588401 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb78161b90 0x7fcb780d2da0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcb680097a0 tx=0x7fcb6802a180 comp rx=0 tx=0).stop 2024-04-25T02:10:12.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.283+0000 7fcb7d3dc640 1 -- 172.21.15.79:0/3663588401 shutdown_connections 2024-04-25T02:10:12.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.283+0000 7fcb7d3dc640 1 --2- 172.21.15.79:0/3663588401 >> v2:172.21.15.189:3300/0 conn(0x7fcb780d0a60 0x7fcb780d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.283+0000 7fcb7d3dc640 1 --2- 172.21.15.79:0/3663588401 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb78161b90 0x7fcb780d2da0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.283+0000 7fcb7d3dc640 1 -- 172.21.15.79:0/3663588401 >> 172.21.15.79:0/3663588401 conn(0x7fcb7809d460 msgr2=0x7fcb780d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:12.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.283+0000 7fcb7d3dc640 1 -- 172.21.15.79:0/3663588401 shutdown_connections 2024-04-25T02:10:12.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.283+0000 7fcb7d3dc640 1 -- 172.21.15.79:0/3663588401 wait complete. 2024-04-25T02:10:12.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.284+0000 7fcb7d3dc640 1 Processor -- start 2024-04-25T02:10:12.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.284+0000 7fcb7d3dc640 1 -- start start 2024-04-25T02:10:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb7d3dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb780d0a60 0x7fcb781f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb7d3dc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb780d47e0 0x7fcb78156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb7d3dc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb78161b90 0x7fcb780c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb7d3dc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb780d4c40 con 0x7fcb780d0a60 2024-04-25T02:10:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb7d3dc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcb780cf770 con 0x7fcb780d47e0 2024-04-25T02:10:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb7d3dc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcb780b3a30 con 0x7fcb78161b90 2024-04-25T02:10:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb76ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb780d0a60 0x7fcb781f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb76ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb780d0a60 0x7fcb781f76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35998/0 (socket says 172.21.15.79:35998) 2024-04-25T02:10:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb76ffd640 1 -- 172.21.15.79:0/1474603486 learned_addr learned my addr 172.21.15.79:0/1474603486 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb767fc640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb780d47e0 0x7fcb78156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb777fe640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb78161b90 0x7fcb780c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb76ffd640 1 -- 172.21.15.79:0/1474603486 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb78161b90 msgr2=0x7fcb780c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb76ffd640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb78161b90 0x7fcb780c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb76ffd640 1 -- 172.21.15.79:0/1474603486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb780d47e0 msgr2=0x7fcb78156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb76ffd640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb780d47e0 0x7fcb78156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb76ffd640 1 -- 172.21.15.79:0/1474603486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb78158e90 con 0x7fcb780d0a60 2024-04-25T02:10:12.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb777fe640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb78161b90 0x7fcb780c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:12.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.285+0000 7fcb767fc640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb780d47e0 0x7fcb78156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:12.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.286+0000 7fcb76ffd640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb780d0a60 0x7fcb781f76a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcb68000c00 tx=0x7fcb680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:12.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.286+0000 7fcb5f7fe640 1 -- 172.21.15.79:0/1474603486 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68037040 con 0x7fcb780d0a60 2024-04-25T02:10:12.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.286+0000 7fcb5f7fe640 1 -- 172.21.15.79:0/1474603486 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb68042070 con 0x7fcb780d0a60 2024-04-25T02:10:12.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.286+0000 7fcb5f7fe640 1 -- 172.21.15.79:0/1474603486 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68030920 con 0x7fcb780d0a60 2024-04-25T02:10:12.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.286+0000 7fcb7d3dc640 1 -- 172.21.15.79:0/1474603486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb781f7fb0 con 0x7fcb780d0a60 2024-04-25T02:10:12.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.286+0000 7fcb7d3dc640 1 -- 172.21.15.79:0/1474603486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb78159130 con 0x7fcb780d0a60 2024-04-25T02:10:12.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.287+0000 7fcb7d3dc640 1 -- 172.21.15.79:0/1474603486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb780690a0 con 0x7fcb780d0a60 2024-04-25T02:10:12.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.287+0000 7fcb5f7fe640 1 -- 172.21.15.79:0/1474603486 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb68030ac0 con 0x7fcb780d0a60 2024-04-25T02:10:12.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.287+0000 7fcb5f7fe640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcb6406be30 0x7fcb6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.288+0000 7fcb5f7fe640 1 -- 172.21.15.79:0/1474603486 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fcb680ab7f0 con 0x7fcb780d0a60 2024-04-25T02:10:12.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.288+0000 7fcb767fc640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcb6406be30 0x7fcb6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.288+0000 7fcb767fc640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcb6406be30 0x7fcb6406e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcb780c7a00 tx=0x7fcb6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:12.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.292+0000 7fcb5f7fe640 1 -- 172.21.15.79:0/1474603486 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcb68079ba0 con 0x7fcb780d0a60 2024-04-25T02:10:12.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.463+0000 7fcb7d3dc640 1 -- 172.21.15.79:0/1474603486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb7809d910 con 0x7fcb780d0a60 2024-04-25T02:10:12.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.465+0000 7fcb5f7fe640 1 -- 172.21.15.79:0/1474603486 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16776 (secure 0 0 0) 0x7fcb6807dea0 con 0x7fcb780d0a60 2024-04-25T02:10:12.472 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:12.472 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":47,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:09:41.749749+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:09:25.247996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T02:09:26.001469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:12.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.466+0000 7fcb7d3dc640 1 -- 172.21.15.79:0/1474603486 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcb6406be30 msgr2=0x7fcb6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.466+0000 7fcb7d3dc640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcb6406be30 0x7fcb6406e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcb780c7a00 tx=0x7fcb6c009040 comp rx=0 tx=0).stop 2024-04-25T02:10:12.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.466+0000 7fcb7d3dc640 1 -- 172.21.15.79:0/1474603486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb780d0a60 msgr2=0x7fcb781f76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.466+0000 7fcb7d3dc640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb780d0a60 0x7fcb781f76a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcb68000c00 tx=0x7fcb680046c0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.467+0000 7fcb7d3dc640 1 -- 172.21.15.79:0/1474603486 shutdown_connections 2024-04-25T02:10:12.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.467+0000 7fcb7d3dc640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcb6406be30 0x7fcb6406e2f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.467+0000 7fcb7d3dc640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb78161b90 0x7fcb780c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.467+0000 7fcb7d3dc640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb780d47e0 0x7fcb78156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.467+0000 7fcb7d3dc640 1 --2- 172.21.15.79:0/1474603486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb780d0a60 0x7fcb781f76a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.467+0000 7fcb7d3dc640 1 -- 172.21.15.79:0/1474603486 >> 172.21.15.79:0/1474603486 conn(0x7fcb7809d460 msgr2=0x7fcb780d2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:12.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.467+0000 7fcb7d3dc640 1 -- 172.21.15.79:0/1474603486 shutdown_connections 2024-04-25T02:10:12.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.467+0000 7fcb7d3dc640 1 -- 172.21.15.79:0/1474603486 wait complete. 2024-04-25T02:10:12.485 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:09:25.247996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:09:26.001469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:10:12.486 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:10:12.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.578+0000 7f00596b2640 1 Processor -- start 2024-04-25T02:10:12.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.578+0000 7f00596b2640 1 -- start start 2024-04-25T02:10:12.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.578+0000 7f00596b2640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f005415e4f0 0x7f00540d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.578+0000 7f00596b2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f00540cf7f0 0x7f00540d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.578+0000 7f00596b2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00540d1ee0 con 0x7f00540cfc80 2024-04-25T02:10:12.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.578+0000 7f00596b2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f00540d21c0 con 0x7f00540cf7f0 2024-04-25T02:10:12.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.578+0000 7f00596b2640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f00540d24a0 con 0x7f005415e4f0 2024-04-25T02:10:12.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.578+0000 7f00527fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f00540cf7f0 0x7f00540d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.579+0000 7f00527fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f00540cf7f0 0x7f00540d09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36002/0 (socket says 172.21.15.79:36002) 2024-04-25T02:10:12.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.579+0000 7f00527fc640 1 -- 172.21.15.79:0/3940759849 learned_addr learned my addr 172.21.15.79:0/3940759849 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:12.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.579+0000 7f0052ffd640 1 --2- 172.21.15.79:0/3940759849 >> v2:172.21.15.189:3300/0 conn(0x7f005415e4f0 0x7f00540d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.579+0000 7f00527fc640 1 -- 172.21.15.79:0/3940759849 >> v2:172.21.15.189:3300/0 conn(0x7f005415e4f0 msgr2=0x7f00540d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:12.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.579+0000 7f00527fc640 1 --2- 172.21.15.79:0/3940759849 >> v2:172.21.15.189:3300/0 conn(0x7f005415e4f0 0x7f00540d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.579+0000 7f00527fc640 1 -- 172.21.15.79:0/3940759849 >> v1:172.21.15.189:6789/0 conn(0x7f00540cfc80 legacy=0x7f005406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:12.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.579+0000 7f00527fc640 1 -- 172.21.15.79:0/3940759849 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00540d2780 con 0x7f00540cf7f0 2024-04-25T02:10:12.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.579+0000 7f0052ffd640 1 --2- 172.21.15.79:0/3940759849 >> v2:172.21.15.189:3300/0 conn(0x7f005415e4f0 0x7f00540d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:12.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.579+0000 7f00527fc640 1 --2- 172.21.15.79:0/3940759849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00540cf7f0 0x7f00540d09b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0048009870 tx=0x7f004802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd1fbf3e8a3b0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:12.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.580+0000 7f0051ffb640 1 -- 172.21.15.79:0/3940759849 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048037070 con 0x7f00540cf7f0 2024-04-25T02:10:12.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.580+0000 7f0051ffb640 1 -- 172.21.15.79:0/3940759849 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0048032440 con 0x7f00540cf7f0 2024-04-25T02:10:12.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.580+0000 7f0051ffb640 1 -- 172.21.15.79:0/3940759849 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048032810 con 0x7f00540cf7f0 2024-04-25T02:10:12.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.580+0000 7f00596b2640 1 -- 172.21.15.79:0/3940759849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00540cf7f0 msgr2=0x7f00540d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.580+0000 7f00596b2640 1 --2- 172.21.15.79:0/3940759849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00540cf7f0 0x7f00540d09b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0048009870 tx=0x7f004802a270 comp rx=0 tx=0).stop 2024-04-25T02:10:12.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.580+0000 7f00596b2640 1 -- 172.21.15.79:0/3940759849 shutdown_connections 2024-04-25T02:10:12.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.580+0000 7f00596b2640 1 --2- 172.21.15.79:0/3940759849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00540cf7f0 0x7f00540d09b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.580+0000 7f00596b2640 1 --2- 172.21.15.79:0/3940759849 >> v2:172.21.15.189:3300/0 conn(0x7f005415e4f0 0x7f00540d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.580+0000 7f00596b2640 1 -- 172.21.15.79:0/3940759849 >> 172.21.15.79:0/3940759849 conn(0x7f005409d4a0 msgr2=0x7f00540d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:12.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.580+0000 7f00596b2640 1 -- 172.21.15.79:0/3940759849 shutdown_connections 2024-04-25T02:10:12.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.580+0000 7f00596b2640 1 -- 172.21.15.79:0/3940759849 wait complete. 2024-04-25T02:10:12.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.581+0000 7f00596b2640 1 Processor -- start 2024-04-25T02:10:12.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.582+0000 7f00596b2640 1 -- start start 2024-04-25T02:10:12.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.582+0000 7f00596b2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f00540cf7f0 0x7f00540c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.582+0000 7f00596b2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00540cfc80 0x7f005415c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.582+0000 7f00596b2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f005415e4f0 0x7f0054153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.582+0000 7f00596b2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f00540d0ef0 con 0x7f005415e4f0 2024-04-25T02:10:12.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.582+0000 7f00596b2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f00540d50f0 con 0x7f00540cfc80 2024-04-25T02:10:12.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.582+0000 7f00596b2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f00540d1070 con 0x7f00540cf7f0 2024-04-25T02:10:12.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.582+0000 7f00537fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f005415e4f0 0x7f0054153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.582+0000 7f00537fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f005415e4f0 0x7f0054153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36004/0 (socket says 172.21.15.79:36004) 2024-04-25T02:10:12.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.582+0000 7f00537fe640 1 -- 172.21.15.79:0/279343660 learned_addr learned my addr 172.21.15.79:0/279343660 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.583+0000 7f00527fc640 1 --2- 172.21.15.79:0/279343660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00540cfc80 0x7f005415c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.583+0000 7f0052ffd640 1 --2- 172.21.15.79:0/279343660 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f00540cf7f0 0x7f00540c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.583+0000 7f00537fe640 1 -- 172.21.15.79:0/279343660 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f00540cf7f0 msgr2=0x7f00540c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.583+0000 7f00537fe640 1 --2- 172.21.15.79:0/279343660 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f00540cf7f0 0x7f00540c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.583+0000 7f00537fe640 1 -- 172.21.15.79:0/279343660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00540cfc80 msgr2=0x7f005415c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.583+0000 7f00537fe640 1 --2- 172.21.15.79:0/279343660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00540cfc80 0x7f005415c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.583+0000 7f00537fe640 1 -- 172.21.15.79:0/279343660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0054153e50 con 0x7f005415e4f0 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.583+0000 7f00537fe640 1 --2- 172.21.15.79:0/279343660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f005415e4f0 0x7f0054153260 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c3e0 tx=0x7f004c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.583+0000 7f003b7fe640 1 -- 172.21.15.79:0/279343660 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c011790 con 0x7f005415e4f0 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.583+0000 7f003b7fe640 1 -- 172.21.15.79:0/279343660 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f004c017070 con 0x7f005415e4f0 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.583+0000 7f00596b2640 1 -- 172.21.15.79:0/279343660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00540cc780 con 0x7f005415e4f0 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.583+0000 7f003b7fe640 1 -- 172.21.15.79:0/279343660 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c011bb0 con 0x7f005415e4f0 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.583+0000 7f00596b2640 1 -- 172.21.15.79:0/279343660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00540cca60 con 0x7f005415e4f0 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.584+0000 7f00596b2640 1 -- 172.21.15.79:0/279343660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00540686c0 con 0x7f005415e4f0 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.584+0000 7f003b7fe640 1 -- 172.21.15.79:0/279343660 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f004c01c460 con 0x7f005415e4f0 2024-04-25T02:10:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.585+0000 7f003b7fe640 1 --2- 172.21.15.79:0/279343660 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f004006be60 0x7f004006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.585+0000 7f003b7fe640 1 -- 172.21.15.79:0/279343660 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f004c08ad10 con 0x7f005415e4f0 2024-04-25T02:10:12.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.585+0000 7f0052ffd640 1 --2- 172.21.15.79:0/279343660 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f004006be60 0x7f004006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.585+0000 7f0052ffd640 1 --2- 172.21.15.79:0/279343660 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f004006be60 0x7f004006e320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0044003fd0 tx=0x7f00440039f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:12.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.589+0000 7f003b7fe640 1 -- 172.21.15.79:0/279343660 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f004c090020 con 0x7f005415e4f0 2024-04-25T02:10:12.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.761+0000 7f00596b2640 1 -- 172.21.15.79:0/279343660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f00540690a0 con 0x7f005415e4f0 2024-04-25T02:10:12.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.761+0000 7f003b7fe640 1 -- 172.21.15.79:0/279343660 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) ==== 93+0+10 (secure 0 0 0) 0x7f004c0595e0 con 0x7f005415e4f0 2024-04-25T02:10:12.770 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:10:12.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.763+0000 7f00596b2640 1 -- 172.21.15.79:0/279343660 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f004006be60 msgr2=0x7f004006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.763+0000 7f00596b2640 1 --2- 172.21.15.79:0/279343660 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f004006be60 0x7f004006e320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0044003fd0 tx=0x7f00440039f0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.763+0000 7f00596b2640 1 -- 172.21.15.79:0/279343660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f005415e4f0 msgr2=0x7f0054153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.763+0000 7f00596b2640 1 --2- 172.21.15.79:0/279343660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f005415e4f0 0x7f0054153260 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c3e0 tx=0x7f004c00c8a0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.763+0000 7f00596b2640 1 -- 172.21.15.79:0/279343660 shutdown_connections 2024-04-25T02:10:12.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.763+0000 7f00596b2640 1 --2- 172.21.15.79:0/279343660 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f004006be60 0x7f004006e320 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.763+0000 7f00596b2640 1 --2- 172.21.15.79:0/279343660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f005415e4f0 0x7f0054153260 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.763+0000 7f00596b2640 1 --2- 172.21.15.79:0/279343660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00540cfc80 0x7f005415c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.763+0000 7f00596b2640 1 --2- 172.21.15.79:0/279343660 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f00540cf7f0 0x7f00540c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.763+0000 7f00596b2640 1 -- 172.21.15.79:0/279343660 >> 172.21.15.79:0/279343660 conn(0x7f005409d4a0 msgr2=0x7f00541571f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:12.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.763+0000 7f00596b2640 1 -- 172.21.15.79:0/279343660 shutdown_connections 2024-04-25T02:10:12.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.763+0000 7f00596b2640 1 -- 172.21.15.79:0/279343660 wait complete. 2024-04-25T02:10:12.782 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:10:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.872+0000 7efd8ccd4640 1 Processor -- start 2024-04-25T02:10:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.872+0000 7efd8ccd4640 1 -- start start 2024-04-25T02:10:12.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.873+0000 7efd8ccd4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd8806b2f0 0x7efd8806b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.873+0000 7efd8ccd4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd88155f00 0x7efd88156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.873+0000 7efd8ccd4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd88071cd0 con 0x7efd880b41b0 2024-04-25T02:10:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.873+0000 7efd8ccd4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7efd88071fb0 con 0x7efd8806b2f0 2024-04-25T02:10:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.873+0000 7efd8ccd4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efd88072290 con 0x7efd88155f00 2024-04-25T02:10:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.873+0000 7efd7ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd8806b2f0 0x7efd8806b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.873+0000 7efd7ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd8806b2f0 0x7efd8806b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36018/0 (socket says 172.21.15.79:36018) 2024-04-25T02:10:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.873+0000 7efd7ffff640 1 -- 172.21.15.79:0/2206157633 learned_addr learned my addr 172.21.15.79:0/2206157633 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.873+0000 7efd7ffff640 1 -- 172.21.15.79:0/2206157633 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd88155f00 msgr2=0x7efd88156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.873+0000 7efd86d9d640 1 --2- 172.21.15.79:0/2206157633 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd88155f00 0x7efd88156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.873+0000 7efd85d9b640 1 -- 172.21.15.79:0/2206157633 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2947434573 0 0) 0x7efd88071cd0 con 0x7efd880b41b0 2024-04-25T02:10:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.873+0000 7efd7ffff640 1 --2- 172.21.15.79:0/2206157633 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd88155f00 0x7efd88156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.873+0000 7efd7ffff640 1 -- 172.21.15.79:0/2206157633 >> v1:172.21.15.79:6789/0 conn(0x7efd880b41b0 legacy=0x7efd881605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.873+0000 7efd7ffff640 1 -- 172.21.15.79:0/2206157633 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd88072570 con 0x7efd8806b2f0 2024-04-25T02:10:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.874+0000 7efd7ffff640 1 --2- 172.21.15.79:0/2206157633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd8806b2f0 0x7efd8806b770 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7efd70009870 tx=0x7efd7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f2269bc9c3147d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.874+0000 7efd85d9b640 1 -- 172.21.15.79:0/2206157633 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70037070 con 0x7efd8806b2f0 2024-04-25T02:10:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.874+0000 7efd85d9b640 1 -- 172.21.15.79:0/2206157633 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd70032440 con 0x7efd8806b2f0 2024-04-25T02:10:12.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.874+0000 7efd85d9b640 1 -- 172.21.15.79:0/2206157633 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70032810 con 0x7efd8806b2f0 2024-04-25T02:10:12.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.875+0000 7efd8ccd4640 1 -- 172.21.15.79:0/2206157633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd8806b2f0 msgr2=0x7efd8806b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.875+0000 7efd8ccd4640 1 --2- 172.21.15.79:0/2206157633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd8806b2f0 0x7efd8806b770 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7efd70009870 tx=0x7efd7002a270 comp rx=0 tx=0).stop 2024-04-25T02:10:12.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.875+0000 7efd8ccd4640 1 -- 172.21.15.79:0/2206157633 shutdown_connections 2024-04-25T02:10:12.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.875+0000 7efd8ccd4640 1 --2- 172.21.15.79:0/2206157633 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd88155f00 0x7efd88156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.875+0000 7efd8ccd4640 1 --2- 172.21.15.79:0/2206157633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd8806b2f0 0x7efd8806b770 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.875+0000 7efd8ccd4640 1 -- 172.21.15.79:0/2206157633 >> 172.21.15.79:0/2206157633 conn(0x7efd880b1cd0 msgr2=0x7efd880b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:12.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.875+0000 7efd8ccd4640 1 -- 172.21.15.79:0/2206157633 shutdown_connections 2024-04-25T02:10:12.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.875+0000 7efd8ccd4640 1 -- 172.21.15.79:0/2206157633 wait complete. 2024-04-25T02:10:12.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.876+0000 7efd8ccd4640 1 Processor -- start 2024-04-25T02:10:12.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.876+0000 7efd8ccd4640 1 -- start start 2024-04-25T02:10:12.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd8ccd4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd8806b2f0 0x7efd880ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd8ccd4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd880b41b0 0x7efd8809ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd8ccd4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd88155f00 0x7efd8809cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd8ccd4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efd880b4590 con 0x7efd880b41b0 2024-04-25T02:10:12.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd8ccd4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efd8815c870 con 0x7efd88155f00 2024-04-25T02:10:12.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd8ccd4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efd880b4710 con 0x7efd8806b2f0 2024-04-25T02:10:12.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd7ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd880b41b0 0x7efd8809ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd7ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd880b41b0 0x7efd8809ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36024/0 (socket says 172.21.15.79:36024) 2024-04-25T02:10:12.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd7ffff640 1 -- 172.21.15.79:0/3355153153 learned_addr learned my addr 172.21.15.79:0/3355153153 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:12.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd8659c640 1 --2- 172.21.15.79:0/3355153153 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd8806b2f0 0x7efd880ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd86d9d640 1 --2- 172.21.15.79:0/3355153153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd88155f00 0x7efd8809cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd7ffff640 1 -- 172.21.15.79:0/3355153153 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd8806b2f0 msgr2=0x7efd880ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd7ffff640 1 --2- 172.21.15.79:0/3355153153 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd8806b2f0 0x7efd880ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd7ffff640 1 -- 172.21.15.79:0/3355153153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd88155f00 msgr2=0x7efd8809cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd7ffff640 1 --2- 172.21.15.79:0/3355153153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd88155f00 0x7efd8809cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:12.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd7ffff640 1 -- 172.21.15.79:0/3355153153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8809d850 con 0x7efd880b41b0 2024-04-25T02:10:12.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd7ffff640 1 --2- 172.21.15.79:0/3355153153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd880b41b0 0x7efd8809ca20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7efd70000c00 tx=0x7efd700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:12.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd7effd640 1 -- 172.21.15.79:0/3355153153 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70037040 con 0x7efd880b41b0 2024-04-25T02:10:12.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd7effd640 1 -- 172.21.15.79:0/3355153153 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd70042070 con 0x7efd880b41b0 2024-04-25T02:10:12.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd8ccd4640 1 -- 172.21.15.79:0/3355153153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8809d570 con 0x7efd880b41b0 2024-04-25T02:10:12.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd7effd640 1 -- 172.21.15.79:0/3355153153 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70030bd0 con 0x7efd880b41b0 2024-04-25T02:10:12.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.877+0000 7efd8ccd4640 1 -- 172.21.15.79:0/3355153153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd880ce820 con 0x7efd880b41b0 2024-04-25T02:10:12.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.878+0000 7efd8ccd4640 1 -- 172.21.15.79:0/3355153153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd880b4920 con 0x7efd880b41b0 2024-04-25T02:10:12.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.879+0000 7efd7effd640 1 -- 172.21.15.79:0/3355153153 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd70047460 con 0x7efd880b41b0 2024-04-25T02:10:12.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.879+0000 7efd7effd640 1 --2- 172.21.15.79:0/3355153153 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efd6806be60 0x7efd6806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:12.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.879+0000 7efd7effd640 1 -- 172.21.15.79:0/3355153153 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7efd700abac0 con 0x7efd880b41b0 2024-04-25T02:10:12.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.879+0000 7efd8659c640 1 --2- 172.21.15.79:0/3355153153 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efd6806be60 0x7efd6806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:12.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.880+0000 7efd8659c640 1 --2- 172.21.15.79:0/3355153153 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efd6806be60 0x7efd6806e320 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efd78000f60 tx=0x7efd78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:12.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:12.884+0000 7efd7effd640 1 -- 172.21.15.79:0/3355153153 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efd880b4920 con 0x7efd880b41b0 2024-04-25T02:10:13.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.054+0000 7efd8ccd4640 1 -- 172.21.15.79:0/3355153153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efd880690a0 con 0x7efd880b41b0 2024-04-25T02:10:13.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.055+0000 7efd7effd640 1 -- 172.21.15.79:0/3355153153 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) ==== 104+0+11 (secure 0 0 0) 0x7efd70045360 con 0x7efd880b41b0 2024-04-25T02:10:13.063 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.057+0000 7efd8ccd4640 1 -- 172.21.15.79:0/3355153153 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efd6806be60 msgr2=0x7efd6806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.057+0000 7efd8ccd4640 1 --2- 172.21.15.79:0/3355153153 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efd6806be60 0x7efd6806e320 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efd78000f60 tx=0x7efd78009040 comp rx=0 tx=0).stop 2024-04-25T02:10:13.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.057+0000 7efd8ccd4640 1 -- 172.21.15.79:0/3355153153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd880b41b0 msgr2=0x7efd8809ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.057+0000 7efd8ccd4640 1 --2- 172.21.15.79:0/3355153153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd880b41b0 0x7efd8809ca20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7efd70000c00 tx=0x7efd700046c0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.057+0000 7efd8ccd4640 1 -- 172.21.15.79:0/3355153153 shutdown_connections 2024-04-25T02:10:13.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.057+0000 7efd8ccd4640 1 --2- 172.21.15.79:0/3355153153 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efd6806be60 0x7efd6806e320 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.057+0000 7efd8ccd4640 1 --2- 172.21.15.79:0/3355153153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd88155f00 0x7efd8809cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.057+0000 7efd8ccd4640 1 --2- 172.21.15.79:0/3355153153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd880b41b0 0x7efd8809ca20 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.057+0000 7efd8ccd4640 1 --2- 172.21.15.79:0/3355153153 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd8806b2f0 0x7efd880ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.057+0000 7efd8ccd4640 1 -- 172.21.15.79:0/3355153153 >> 172.21.15.79:0/3355153153 conn(0x7efd880b1cd0 msgr2=0x7efd8806b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.057+0000 7efd8ccd4640 1 -- 172.21.15.79:0/3355153153 shutdown_connections 2024-04-25T02:10:13.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.057+0000 7efd8ccd4640 1 -- 172.21.15.79:0/3355153153 wait complete. 2024-04-25T02:10:13.076 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:10:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.167+0000 7f8024f96640 1 Processor -- start 2024-04-25T02:10:13.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.167+0000 7f8024f96640 1 -- start start 2024-04-25T02:10:13.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.168+0000 7f8024f96640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f80200b41b0 0x7f80201605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.168+0000 7f8024f96640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8020071cd0 con 0x7f802006b770 2024-04-25T02:10:13.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.168+0000 7f8024f96640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8020071fb0 con 0x7f802006b2f0 2024-04-25T02:10:13.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.168+0000 7f8024f96640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f8020072290 con 0x7f80200b41b0 2024-04-25T02:10:13.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.168+0000 7f801ed9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f802006b770 0x7f80200ce4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33098/0 (socket says 172.21.15.79:33098) 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.168+0000 7f801ed9d640 1 -- 172.21.15.79:0/2083876848 learned_addr learned my addr 172.21.15.79:0/2083876848 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.168+0000 7f801d59a640 1 -- 172.21.15.79:0/2083876848 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930505763 0 0) 0x7f8020071cd0 con 0x7f802006b770 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.168+0000 7f801e59c640 1 --2- 172.21.15.79:0/2083876848 >> v2:172.21.15.189:3300/0 conn(0x7f80200b41b0 0x7f80201605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.168+0000 7f801d59a640 1 -- 172.21.15.79:0/2083876848 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8008003520 con 0x7f802006b770 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801d59a640 1 -- 172.21.15.79:0/2083876848 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 341842105 0 0) 0x7f8008003520 con 0x7f802006b770 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801d59a640 1 -- 172.21.15.79:0/2083876848 >> v2:172.21.15.189:3300/0 conn(0x7f80200b41b0 msgr2=0x7f80201605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801d59a640 1 --2- 172.21.15.79:0/2083876848 >> v2:172.21.15.189:3300/0 conn(0x7f80200b41b0 0x7f80201605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801d59a640 1 -- 172.21.15.79:0/2083876848 >> v1:172.21.15.189:6789/0 conn(0x7f802006b2f0 legacy=0x7f8020155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801d59a640 1 -- 172.21.15.79:0/2083876848 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8020072570 con 0x7f802006b770 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801d59a640 1 -- 172.21.15.79:0/2083876848 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f8018001670 con 0x7f802006b770 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801d59a640 1 -- 172.21.15.79:0/2083876848 >> v1:172.21.15.79:6789/0 conn(0x7f802006b770 legacy=0x7f80200ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801d59a640 1 --2- 172.21.15.79:0/2083876848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80080039b0 0x7f8008003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801d59a640 1 --2- 172.21.15.79:0/2083876848 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8008004800 0x7f8008004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801d59a640 1 --2- 172.21.15.79:0/2083876848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80080051c0 0x7f800800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801d59a640 1 -- 172.21.15.79:0/2083876848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8020072290 con 0x7f80080051c0 2024-04-25T02:10:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801d59a640 1 -- 172.21.15.79:0/2083876848 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f800800c060 con 0x7f80080039b0 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801d59a640 1 -- 172.21.15.79:0/2083876848 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f800800c260 con 0x7f8008004800 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801ed9d640 1 --2- 172.21.15.79:0/2083876848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80080051c0 0x7f800800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801e59c640 1 --2- 172.21.15.79:0/2083876848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80080039b0 0x7f8008003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801dd9b640 1 --2- 172.21.15.79:0/2083876848 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8008004800 0x7f8008004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801ed9d640 1 -- 172.21.15.79:0/2083876848 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8008004800 msgr2=0x7f8008004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801ed9d640 1 --2- 172.21.15.79:0/2083876848 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8008004800 0x7f8008004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801ed9d640 1 -- 172.21.15.79:0/2083876848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80080039b0 msgr2=0x7f8008003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801ed9d640 1 --2- 172.21.15.79:0/2083876848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80080039b0 0x7f8008003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.169+0000 7f801ed9d640 1 -- 172.21.15.79:0/2083876848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8008003520 con 0x7f80080051c0 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.170+0000 7f801ed9d640 1 -- 172.21.15.79:0/2083876848 reap_dead start 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.170+0000 7f801ed9d640 1 --2- 172.21.15.79:0/2083876848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80080051c0 0x7f800800b9c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f801800c240 tx=0x7f8008005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd39fd7a1f7c6853 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.170+0000 7f801d59a640 1 -- 172.21.15.79:0/2083876848 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018007cf0 con 0x7f80080051c0 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.170+0000 7f801d59a640 1 -- 172.21.15.79:0/2083876848 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80180058d0 con 0x7f80080051c0 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.170+0000 7f801d59a640 1 -- 172.21.15.79:0/2083876848 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018005cc0 con 0x7f80080051c0 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.170+0000 7f8024f96640 1 -- 172.21.15.79:0/2083876848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80080051c0 msgr2=0x7f800800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.170+0000 7f8024f96640 1 --2- 172.21.15.79:0/2083876848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80080051c0 0x7f800800b9c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f801800c240 tx=0x7f8008005830 comp rx=0 tx=0).stop 2024-04-25T02:10:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.171+0000 7f8024f96640 1 -- 172.21.15.79:0/2083876848 shutdown_connections 2024-04-25T02:10:13.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.171+0000 7f8024f96640 1 --2- 172.21.15.79:0/2083876848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80080051c0 0x7f800800b9c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.171+0000 7f8024f96640 1 -- 172.21.15.79:0/2083876848 >> 172.21.15.79:0/2083876848 conn(0x7f80200b1cd0 msgr2=0x7f80200b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.171+0000 7f8024f96640 1 -- 172.21.15.79:0/2083876848 shutdown_connections 2024-04-25T02:10:13.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.171+0000 7f8024f96640 1 -- 172.21.15.79:0/2083876848 wait complete. 2024-04-25T02:10:13.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.172+0000 7f8024f96640 1 Processor -- start 2024-04-25T02:10:13.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.172+0000 7f8024f96640 1 -- start start 2024-04-25T02:10:13.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f8024f96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80080051c0 0x7f8020153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f8024f96640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f802015a0b0 0x7f802015a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f8024f96640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f802009abc0 0x7f802009b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f8024f96640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f802015c870 con 0x7f80080051c0 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f8024f96640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f802006bb80 con 0x7f802009abc0 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f8024f96640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f80200b4590 con 0x7f802015a0b0 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f801e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80080051c0 0x7f8020153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f801e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80080051c0 0x7f8020153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36038/0 (socket says 172.21.15.79:36038) 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f801e59c640 1 -- 172.21.15.79:0/1843771539 learned_addr learned my addr 172.21.15.79:0/1843771539 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f801ed9d640 1 --2- 172.21.15.79:0/1843771539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f802009abc0 0x7f802009b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f801dd9b640 1 --2- 172.21.15.79:0/1843771539 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f802015a0b0 0x7f802015a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f801e59c640 1 -- 172.21.15.79:0/1843771539 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f802015a0b0 msgr2=0x7f802015a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f801e59c640 1 --2- 172.21.15.79:0/1843771539 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f802015a0b0 0x7f802015a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f801e59c640 1 -- 172.21.15.79:0/1843771539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f802009abc0 msgr2=0x7f802009b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f801e59c640 1 --2- 172.21.15.79:0/1843771539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f802009abc0 0x7f802009b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f801e59c640 1 -- 172.21.15.79:0/1843771539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802009b8f0 con 0x7f80080051c0 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f801dd9b640 1 --2- 172.21.15.79:0/1843771539 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f802015a0b0 0x7f802015a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f801e59c640 1 --2- 172.21.15.79:0/1843771539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80080051c0 0x7f8020153c80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8010009fc0 tx=0x7f801000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f800effd640 1 -- 172.21.15.79:0/1843771539 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801000fea0 con 0x7f80080051c0 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f800effd640 1 -- 172.21.15.79:0/1843771539 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8010015630 con 0x7f80080051c0 2024-04-25T02:10:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f8024f96640 1 -- 172.21.15.79:0/1843771539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f802009bbd0 con 0x7f80080051c0 2024-04-25T02:10:13.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f800effd640 1 -- 172.21.15.79:0/1843771539 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8010015a20 con 0x7f80080051c0 2024-04-25T02:10:13.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.173+0000 7f8024f96640 1 -- 172.21.15.79:0/1843771539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f802009c190 con 0x7f80080051c0 2024-04-25T02:10:13.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.174+0000 7f8024f96640 1 -- 172.21.15.79:0/1843771539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80200690a0 con 0x7f80080051c0 2024-04-25T02:10:13.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.175+0000 7f800effd640 1 -- 172.21.15.79:0/1843771539 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8010015bc0 con 0x7f80080051c0 2024-04-25T02:10:13.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.175+0000 7f800effd640 1 --2- 172.21.15.79:0/1843771539 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f800006be60 0x7f800006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.175+0000 7f800effd640 1 -- 172.21.15.79:0/1843771539 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f801008bee0 con 0x7f80080051c0 2024-04-25T02:10:13.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.175+0000 7f801dd9b640 1 --2- 172.21.15.79:0/1843771539 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f800006be60 0x7f800006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.176+0000 7f801dd9b640 1 --2- 172.21.15.79:0/1843771539 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f800006be60 0x7f800006e320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8014000c00 tx=0x7f8014009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.180+0000 7f800effd640 1 -- 172.21.15.79:0/1843771539 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8010019030 con 0x7f80080051c0 2024-04-25T02:10:13.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.355+0000 7f8024f96640 1 -- 172.21.15.79:0/1843771539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f80200ce280 con 0x7f80080051c0 2024-04-25T02:10:13.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.355+0000 7f800effd640 1 -- 172.21.15.79:0/1843771539 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) ==== 100+0+11 (secure 0 0 0) 0x7f8010010040 con 0x7f80080051c0 2024-04-25T02:10:13.363 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:10:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.357+0000 7f8024f96640 1 -- 172.21.15.79:0/1843771539 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f800006be60 msgr2=0x7f800006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.357+0000 7f8024f96640 1 --2- 172.21.15.79:0/1843771539 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f800006be60 0x7f800006e320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8014000c00 tx=0x7f8014009040 comp rx=0 tx=0).stop 2024-04-25T02:10:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.357+0000 7f8024f96640 1 -- 172.21.15.79:0/1843771539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80080051c0 msgr2=0x7f8020153c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.357+0000 7f8024f96640 1 --2- 172.21.15.79:0/1843771539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80080051c0 0x7f8020153c80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8010009fc0 tx=0x7f801000f580 comp rx=0 tx=0).stop 2024-04-25T02:10:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.357+0000 7f8024f96640 1 -- 172.21.15.79:0/1843771539 shutdown_connections 2024-04-25T02:10:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.357+0000 7f8024f96640 1 --2- 172.21.15.79:0/1843771539 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f800006be60 0x7f800006e320 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.357+0000 7f8024f96640 1 --2- 172.21.15.79:0/1843771539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f802009abc0 0x7f802009b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.357+0000 7f8024f96640 1 --2- 172.21.15.79:0/1843771539 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f802015a0b0 0x7f802015a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.357+0000 7f8024f96640 1 --2- 172.21.15.79:0/1843771539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80080051c0 0x7f8020153c80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.357+0000 7f8024f96640 1 -- 172.21.15.79:0/1843771539 >> 172.21.15.79:0/1843771539 conn(0x7f80200b1cd0 msgr2=0x7f8020155900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.357+0000 7f8024f96640 1 -- 172.21.15.79:0/1843771539 shutdown_connections 2024-04-25T02:10:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.357+0000 7f8024f96640 1 -- 172.21.15.79:0/1843771539 wait complete. 2024-04-25T02:10:13.376 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:10:13.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.463+0000 7fc8d8895640 1 Processor -- start 2024-04-25T02:10:13.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.463+0000 7fc8d8895640 1 -- start start 2024-04-25T02:10:13.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.464+0000 7fc8d8895640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc8d40b3570 0x7fc8d40d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.464+0000 7fc8d8895640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc8d40b3020 0x7fc8d40d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.464+0000 7fc8d8895640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8d406c380 con 0x7fc8d415e4d0 2024-04-25T02:10:13.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.464+0000 7fc8d8895640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc8d40d1660 con 0x7fc8d40b3570 2024-04-25T02:10:13.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.464+0000 7fc8d8895640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc8d40d1380 con 0x7fc8d40b3020 2024-04-25T02:10:13.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.464+0000 7fc8d259c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc8d415e4d0 0x7fc8d406bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33108/0 (socket says 172.21.15.79:33108) 2024-04-25T02:10:13.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.464+0000 7fc8d259c640 1 -- 172.21.15.79:0/879011204 learned_addr learned my addr 172.21.15.79:0/879011204 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:13.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.464+0000 7fc8d1d9b640 1 --2- 172.21.15.79:0/879011204 >> v2:172.21.15.79:3300/0 conn(0x7fc8d40b3570 0x7fc8d40d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.465+0000 7fc8d2d9d640 1 --2- 172.21.15.79:0/879011204 >> v2:172.21.15.189:3300/0 conn(0x7fc8d40b3020 0x7fc8d40d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.465+0000 7fc8d1d9b640 1 -- 172.21.15.79:0/879011204 >> v2:172.21.15.189:3300/0 conn(0x7fc8d40b3020 msgr2=0x7fc8d40d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.465+0000 7fc8d1d9b640 1 --2- 172.21.15.79:0/879011204 >> v2:172.21.15.189:3300/0 conn(0x7fc8d40b3020 0x7fc8d40d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.465+0000 7fc8d1d9b640 1 -- 172.21.15.79:0/879011204 >> v1:172.21.15.79:6789/0 conn(0x7fc8d415e4d0 legacy=0x7fc8d406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.465+0000 7fc8d1d9b640 1 -- 172.21.15.79:0/879011204 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d40cede0 con 0x7fc8d40b3570 2024-04-25T02:10:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.465+0000 7fc8d159a640 1 -- 172.21.15.79:0/879011204 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2830219339 0 0) 0x7fc8d406c380 con 0x7fc8d415e4d0 2024-04-25T02:10:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.465+0000 7fc8d1d9b640 1 --2- 172.21.15.79:0/879011204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40b3570 0x7fc8d40d2710 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80097a0 tx=0x7fc8c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc810f55c84e471 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.465+0000 7fc8d159a640 1 -- 172.21.15.79:0/879011204 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8037070 con 0x7fc8d40b3570 2024-04-25T02:10:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.465+0000 7fc8d159a640 1 -- 172.21.15.79:0/879011204 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c8032440 con 0x7fc8d40b3570 2024-04-25T02:10:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.465+0000 7fc8d159a640 1 -- 172.21.15.79:0/879011204 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8032810 con 0x7fc8d40b3570 2024-04-25T02:10:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.466+0000 7fc8d8895640 1 -- 172.21.15.79:0/879011204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40b3570 msgr2=0x7fc8d40d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.466+0000 7fc8d8895640 1 --2- 172.21.15.79:0/879011204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40b3570 0x7fc8d40d2710 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80097a0 tx=0x7fc8c802a1e0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.466+0000 7fc8d8895640 1 -- 172.21.15.79:0/879011204 shutdown_connections 2024-04-25T02:10:13.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.466+0000 7fc8d8895640 1 --2- 172.21.15.79:0/879011204 >> v2:172.21.15.189:3300/0 conn(0x7fc8d40b3020 0x7fc8d40d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.466+0000 7fc8d8895640 1 --2- 172.21.15.79:0/879011204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40b3570 0x7fc8d40d2710 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.466+0000 7fc8d8895640 1 -- 172.21.15.79:0/879011204 >> 172.21.15.79:0/879011204 conn(0x7fc8d409d460 msgr2=0x7fc8d40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.466+0000 7fc8d8895640 1 -- 172.21.15.79:0/879011204 shutdown_connections 2024-04-25T02:10:13.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.466+0000 7fc8d8895640 1 -- 172.21.15.79:0/879011204 wait complete. 2024-04-25T02:10:13.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.467+0000 7fc8d8895640 1 Processor -- start 2024-04-25T02:10:13.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.467+0000 7fc8d8895640 1 -- start start 2024-04-25T02:10:13.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.468+0000 7fc8d8895640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8d40b3020 0x7fc8d40b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.468+0000 7fc8d8895640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40b3570 0x7fc8d40a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.468+0000 7fc8d8895640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc8d415e4d0 0x7fc8d40b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.468+0000 7fc8d8895640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d40d20d0 con 0x7fc8d40b3570 2024-04-25T02:10:13.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.468+0000 7fc8d8895640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d415e8b0 con 0x7fc8d40b3020 2024-04-25T02:10:13.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.468+0000 7fc8d8895640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d40d2250 con 0x7fc8d415e4d0 2024-04-25T02:10:13.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.468+0000 7fc8d1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40b3570 0x7fc8d40a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.468+0000 7fc8d1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40b3570 0x7fc8d40a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36050/0 (socket says 172.21.15.79:36050) 2024-04-25T02:10:13.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.468+0000 7fc8d1d9b640 1 -- 172.21.15.79:0/501303150 learned_addr learned my addr 172.21.15.79:0/501303150 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:13.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.468+0000 7fc8d259c640 1 --2- 172.21.15.79:0/501303150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8d40b3020 0x7fc8d40b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.468+0000 7fc8d2d9d640 1 --2- 172.21.15.79:0/501303150 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc8d415e4d0 0x7fc8d40b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.469+0000 7fc8d1d9b640 1 -- 172.21.15.79:0/501303150 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc8d415e4d0 msgr2=0x7fc8d40b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.469+0000 7fc8d1d9b640 1 --2- 172.21.15.79:0/501303150 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc8d415e4d0 0x7fc8d40b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.469+0000 7fc8d1d9b640 1 -- 172.21.15.79:0/501303150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8d40b3020 msgr2=0x7fc8d40b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.469+0000 7fc8d1d9b640 1 --2- 172.21.15.79:0/501303150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8d40b3020 0x7fc8d40b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.469+0000 7fc8d1d9b640 1 -- 172.21.15.79:0/501303150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d40b5470 con 0x7fc8d40b3570 2024-04-25T02:10:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.469+0000 7fc8d259c640 1 --2- 172.21.15.79:0/501303150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8d40b3020 0x7fc8d40b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.469+0000 7fc8d1d9b640 1 --2- 172.21.15.79:0/501303150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40b3570 0x7fc8d40a1880 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8035040 tx=0x7fc8c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.469+0000 7fc8c2ffd640 1 -- 172.21.15.79:0/501303150 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8037040 con 0x7fc8d40b3570 2024-04-25T02:10:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.469+0000 7fc8c2ffd640 1 -- 172.21.15.79:0/501303150 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c8030770 con 0x7fc8d40b3570 2024-04-25T02:10:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.469+0000 7fc8d8895640 1 -- 172.21.15.79:0/501303150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d40b5750 con 0x7fc8d40b3570 2024-04-25T02:10:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.469+0000 7fc8c2ffd640 1 -- 172.21.15.79:0/501303150 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8030b80 con 0x7fc8d40b3570 2024-04-25T02:10:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.469+0000 7fc8d8895640 1 -- 172.21.15.79:0/501303150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d40b5d10 con 0x7fc8d40b3570 2024-04-25T02:10:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.470+0000 7fc8d8895640 1 -- 172.21.15.79:0/501303150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d40690a0 con 0x7fc8d40b3570 2024-04-25T02:10:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.470+0000 7fc8c2ffd640 1 -- 172.21.15.79:0/501303150 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc8c8044020 con 0x7fc8d40b3570 2024-04-25T02:10:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.471+0000 7fc8c2ffd640 1 --2- 172.21.15.79:0/501303150 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc8b406be30 0x7fc8b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.471+0000 7fc8d259c640 1 --2- 172.21.15.79:0/501303150 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc8b406be30 0x7fc8b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.471+0000 7fc8c2ffd640 1 -- 172.21.15.79:0/501303150 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc8c80ab3b0 con 0x7fc8d40b3570 2024-04-25T02:10:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.471+0000 7fc8d259c640 1 --2- 172.21.15.79:0/501303150 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc8b406be30 0x7fc8b406e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40012e0 tx=0x7fc8c4005bb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.475+0000 7fc8c2ffd640 1 -- 172.21.15.79:0/501303150 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc8c8032e20 con 0x7fc8d40b3570 2024-04-25T02:10:13.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.683+0000 7fc8d8895640 1 -- 172.21.15.79:0/501303150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8d40d1920 con 0x7fc8d40b3570 2024-04-25T02:10:13.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.684+0000 7fc8c2ffd640 1 -- 172.21.15.79:0/501303150 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7fc8c8079d20 con 0x7fc8d40b3570 2024-04-25T02:10:13.692 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:13.692 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3934472151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3934472151},{"type":"v1","addr":"172.21.15.189:6835","nonce":3934472151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2046740048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2046740048},{"type":"v1","addr":"172.21.15.79:6836","nonce":2046740048}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/207160678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":207160678},{"type":"v1","addr":"172.21.15.79:6837","nonce":207160678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:09:27.032071+0000","modified":"2024-04-25T02:09:29.046598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/1295756642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1295756642},{"type":"v1","addr":"172.21.15.189:6833","nonce":1295756642}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":3}]} 2024-04-25T02:10:13.693 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2024-04-25T02:10:13.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.686+0000 7fc8d8895640 1 -- 172.21.15.79:0/501303150 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc8b406be30 msgr2=0x7fc8b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.686+0000 7fc8d8895640 1 --2- 172.21.15.79:0/501303150 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc8b406be30 0x7fc8b406e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40012e0 tx=0x7fc8c4005bb0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.686+0000 7fc8d8895640 1 -- 172.21.15.79:0/501303150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40b3570 msgr2=0x7fc8d40a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.686+0000 7fc8d8895640 1 --2- 172.21.15.79:0/501303150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40b3570 0x7fc8d40a1880 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8035040 tx=0x7fc8c80046c0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.686+0000 7fc8d8895640 1 -- 172.21.15.79:0/501303150 shutdown_connections 2024-04-25T02:10:13.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.686+0000 7fc8d8895640 1 --2- 172.21.15.79:0/501303150 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc8b406be30 0x7fc8b406e2f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.686+0000 7fc8d8895640 1 --2- 172.21.15.79:0/501303150 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc8d415e4d0 0x7fc8d40b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.686+0000 7fc8d8895640 1 --2- 172.21.15.79:0/501303150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40b3570 0x7fc8d40a1880 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.686+0000 7fc8d8895640 1 --2- 172.21.15.79:0/501303150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8d40b3020 0x7fc8d40b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.686+0000 7fc8d8895640 1 -- 172.21.15.79:0/501303150 >> 172.21.15.79:0/501303150 conn(0x7fc8d409d460 msgr2=0x7fc8d415d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.686+0000 7fc8d8895640 1 -- 172.21.15.79:0/501303150 shutdown_connections 2024-04-25T02:10:13.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.686+0000 7fc8d8895640 1 -- 172.21.15.79:0/501303150 wait complete. 2024-04-25T02:10:13.705 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:13.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.792+0000 7fd1c8c7d640 1 Processor -- start 2024-04-25T02:10:13.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.792+0000 7fd1c8c7d640 1 -- start start 2024-04-25T02:10:13.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.793+0000 7fd1c8c7d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd1c415e4d0 0x7fd1c406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.793+0000 7fd1c8c7d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd1c40d2e20 0x7fd1c40cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.793+0000 7fd1c8c7d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1c40d1660 con 0x7fd1c40b3570 2024-04-25T02:10:13.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.793+0000 7fd1c8c7d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd1c40d1380 con 0x7fd1c415e4d0 2024-04-25T02:10:13.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.793+0000 7fd1c8c7d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd1c40cede0 con 0x7fd1c40d2e20 2024-04-25T02:10:13.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.793+0000 7fd1c259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd1c415e4d0 0x7fd1c406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.793+0000 7fd1c259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd1c415e4d0 0x7fd1c406bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45444/0 (socket says 172.21.15.79:45444) 2024-04-25T02:10:13.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.793+0000 7fd1c259c640 1 -- 172.21.15.79:0/2243665611 learned_addr learned my addr 172.21.15.79:0/2243665611 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:13.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.794+0000 7fd1c2d9d640 1 --2- 172.21.15.79:0/2243665611 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd1c40d2e20 0x7fd1c40cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.794+0000 7fd1c259c640 1 -- 172.21.15.79:0/2243665611 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd1c40d2e20 msgr2=0x7fd1c40cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:13.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.794+0000 7fd1c259c640 1 --2- 172.21.15.79:0/2243665611 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd1c40d2e20 0x7fd1c40cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.794+0000 7fd1c259c640 1 -- 172.21.15.79:0/2243665611 >> v1:172.21.15.189:6789/0 conn(0x7fd1c40b3570 legacy=0x7fd1c40d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:13.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.794+0000 7fd1c259c640 1 -- 172.21.15.79:0/2243665611 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c40cf0c0 con 0x7fd1c415e4d0 2024-04-25T02:10:13.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.794+0000 7fd1c259c640 1 --2- 172.21.15.79:0/2243665611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c415e4d0 0x7fd1c406bc70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009e80 tx=0x7fd1b402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e18d92dea58e00 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.794+0000 7fd1c159a640 1 -- 172.21.15.79:0/2243665611 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4036070 con 0x7fd1c415e4d0 2024-04-25T02:10:13.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.795+0000 7fd1c159a640 1 -- 172.21.15.79:0/2243665611 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b4031600 con 0x7fd1c415e4d0 2024-04-25T02:10:13.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.795+0000 7fd1c159a640 1 -- 172.21.15.79:0/2243665611 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40319d0 con 0x7fd1c415e4d0 2024-04-25T02:10:13.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.795+0000 7fd1c8c7d640 1 -- 172.21.15.79:0/2243665611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c415e4d0 msgr2=0x7fd1c406bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.795+0000 7fd1c8c7d640 1 --2- 172.21.15.79:0/2243665611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c415e4d0 0x7fd1c406bc70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009e80 tx=0x7fd1b402a6f0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.795+0000 7fd1c8c7d640 1 -- 172.21.15.79:0/2243665611 shutdown_connections 2024-04-25T02:10:13.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.795+0000 7fd1c8c7d640 1 --2- 172.21.15.79:0/2243665611 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd1c40d2e20 0x7fd1c40cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.795+0000 7fd1c8c7d640 1 --2- 172.21.15.79:0/2243665611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c415e4d0 0x7fd1c406bc70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.795+0000 7fd1c8c7d640 1 -- 172.21.15.79:0/2243665611 >> 172.21.15.79:0/2243665611 conn(0x7fd1c409d460 msgr2=0x7fd1c40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.795+0000 7fd1c8c7d640 1 -- 172.21.15.79:0/2243665611 shutdown_connections 2024-04-25T02:10:13.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.795+0000 7fd1c8c7d640 1 -- 172.21.15.79:0/2243665611 wait complete. 2024-04-25T02:10:13.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.796+0000 7fd1c8c7d640 1 Processor -- start 2024-04-25T02:10:13.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.796+0000 7fd1c8c7d640 1 -- start start 2024-04-25T02:10:13.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.797+0000 7fd1c8c7d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1c40b3570 0x7fd1c41e8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.797+0000 7fd1c8c7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c40d2e20 0x7fd1c40b9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.797+0000 7fd1c8c7d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd1c415e4d0 0x7fd1c414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.797+0000 7fd1c8c7d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c40d2250 con 0x7fd1c40d2e20 2024-04-25T02:10:13.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.797+0000 7fd1c8c7d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c40d20d0 con 0x7fd1c40b3570 2024-04-25T02:10:13.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.797+0000 7fd1c8c7d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd1c406c1b0 con 0x7fd1c415e4d0 2024-04-25T02:10:13.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.797+0000 7fd1c1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c40d2e20 0x7fd1c40b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.797+0000 7fd1c1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c40d2e20 0x7fd1c40b9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45452/0 (socket says 172.21.15.79:45452) 2024-04-25T02:10:13.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.797+0000 7fd1c1d9b640 1 -- 172.21.15.79:0/2541809404 learned_addr learned my addr 172.21.15.79:0/2541809404 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:13.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.797+0000 7fd1c1d9b640 1 -- 172.21.15.79:0/2541809404 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd1c415e4d0 msgr2=0x7fd1c414ff40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T02:10:13.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.797+0000 7fd1c1d9b640 1 --2- 172.21.15.79:0/2541809404 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd1c415e4d0 0x7fd1c414ff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.797+0000 7fd1c1d9b640 1 -- 172.21.15.79:0/2541809404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1c40b3570 msgr2=0x7fd1c41e8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.797+0000 7fd1c1d9b640 1 --2- 172.21.15.79:0/2541809404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1c40b3570 0x7fd1c41e8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.797+0000 7fd1c1d9b640 1 -- 172.21.15.79:0/2541809404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c41e9170 con 0x7fd1c40d2e20 2024-04-25T02:10:13.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.798+0000 7fd1c1d9b640 1 --2- 172.21.15.79:0/2541809404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c40d2e20 0x7fd1c40b9160 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800c430 tx=0x7fd1b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.798+0000 7fd1b2ffd640 1 -- 172.21.15.79:0/2541809404 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8011790 con 0x7fd1c40d2e20 2024-04-25T02:10:13.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.798+0000 7fd1b2ffd640 1 -- 172.21.15.79:0/2541809404 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b8017070 con 0x7fd1c40d2e20 2024-04-25T02:10:13.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.798+0000 7fd1c8c7d640 1 -- 172.21.15.79:0/2541809404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c41e9450 con 0x7fd1c40d2e20 2024-04-25T02:10:13.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.798+0000 7fd1b2ffd640 1 -- 172.21.15.79:0/2541809404 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8011bb0 con 0x7fd1c40d2e20 2024-04-25T02:10:13.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.798+0000 7fd1c8c7d640 1 -- 172.21.15.79:0/2541809404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c41e9a10 con 0x7fd1c40d2e20 2024-04-25T02:10:13.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.799+0000 7fd1c8c7d640 1 -- 172.21.15.79:0/2541809404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1c40690a0 con 0x7fd1c40d2e20 2024-04-25T02:10:13.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.799+0000 7fd1b2ffd640 1 -- 172.21.15.79:0/2541809404 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1b801c460 con 0x7fd1c40d2e20 2024-04-25T02:10:13.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.799+0000 7fd1b2ffd640 1 --2- 172.21.15.79:0/2541809404 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd1a406be30 0x7fd1a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:13.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.800+0000 7fd1b2ffd640 1 -- 172.21.15.79:0/2541809404 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fd1b808ae20 con 0x7fd1c40d2e20 2024-04-25T02:10:13.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.800+0000 7fd1c259c640 1 --2- 172.21.15.79:0/2541809404 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd1a406be30 0x7fd1a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:13.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.800+0000 7fd1c259c640 1 --2- 172.21.15.79:0/2541809404 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd1a406be30 0x7fd1a406e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4033000 tx=0x7fd1b402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.804+0000 7fd1b2ffd640 1 -- 172.21.15.79:0/2541809404 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd1b8059710 con 0x7fd1c40d2e20 2024-04-25T02:10:13.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.978+0000 7fd1c8c7d640 1 -- 172.21.15.79:0/2541809404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd1c40ce560 con 0x7fd1c40d2e20 2024-04-25T02:10:13.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.979+0000 7fd1b2ffd640 1 -- 172.21.15.79:0/2541809404 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16776 (secure 0 0 0) 0x7fd1b8059010 con 0x7fd1c40d2e20 2024-04-25T02:10:13.988 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:13.988 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":47,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:09:41.749749+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:09:25.247996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T02:09:26.001469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:13.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.981+0000 7fd1c8c7d640 1 -- 172.21.15.79:0/2541809404 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd1a406be30 msgr2=0x7fd1a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.981+0000 7fd1c8c7d640 1 --2- 172.21.15.79:0/2541809404 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd1a406be30 0x7fd1a406e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4033000 tx=0x7fd1b402e000 comp rx=0 tx=0).stop 2024-04-25T02:10:13.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.981+0000 7fd1c8c7d640 1 -- 172.21.15.79:0/2541809404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c40d2e20 msgr2=0x7fd1c40b9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.981+0000 7fd1c8c7d640 1 --2- 172.21.15.79:0/2541809404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c40d2e20 0x7fd1c40b9160 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800c430 tx=0x7fd1b800c8f0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.981+0000 7fd1c8c7d640 1 -- 172.21.15.79:0/2541809404 shutdown_connections 2024-04-25T02:10:13.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.981+0000 7fd1c8c7d640 1 --2- 172.21.15.79:0/2541809404 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd1a406be30 0x7fd1a406e2f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.981+0000 7fd1c8c7d640 1 --2- 172.21.15.79:0/2541809404 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd1c415e4d0 0x7fd1c414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.981+0000 7fd1c8c7d640 1 --2- 172.21.15.79:0/2541809404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c40d2e20 0x7fd1c40b9160 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.981+0000 7fd1c8c7d640 1 --2- 172.21.15.79:0/2541809404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1c40b3570 0x7fd1c41e8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:13.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.981+0000 7fd1c8c7d640 1 -- 172.21.15.79:0/2541809404 >> 172.21.15.79:0/2541809404 conn(0x7fd1c409d460 msgr2=0x7fd1c40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.981+0000 7fd1c8c7d640 1 -- 172.21.15.79:0/2541809404 shutdown_connections 2024-04-25T02:10:13.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:13.981+0000 7fd1c8c7d640 1 -- 172.21.15.79:0/2541809404 wait complete. 2024-04-25T02:10:14.001 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:10:14.001 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.088+0000 7fd708ebd640 1 Processor -- start 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.088+0000 7fd708ebd640 1 -- start start 2024-04-25T02:10:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.089+0000 7fd708ebd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd704143bc0 0x7fd70415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.089+0000 7fd708ebd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd70406df50 0x7fd70406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.089+0000 7fd708ebd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd7040b48e0 0x7fd7040b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.089+0000 7fd708ebd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd70406e8f0 con 0x7fd704143bc0 2024-04-25T02:10:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.089+0000 7fd708ebd640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd704072cb0 con 0x7fd7040b48e0 2024-04-25T02:10:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.089+0000 7fd708ebd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd70415fa40 con 0x7fd70406df50 2024-04-25T02:10:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.089+0000 7fd70259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd704143bc0 0x7fd70415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.089+0000 7fd70259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd704143bc0 0x7fd70415f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45464/0 (socket says 172.21.15.79:45464) 2024-04-25T02:10:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.089+0000 7fd70259c640 1 -- 172.21.15.79:0/661020509 learned_addr learned my addr 172.21.15.79:0/661020509 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.090+0000 7fd70259c640 1 -- 172.21.15.79:0/661020509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd70406df50 msgr2=0x7fd70406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.090+0000 7fd701d9b640 1 --2- 172.21.15.79:0/661020509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd70406df50 0x7fd70406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.090+0000 7fd702d9d640 1 --2- 172.21.15.79:0/661020509 >> v2:172.21.15.189:3300/0 conn(0x7fd7040b48e0 0x7fd7040b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.090+0000 7fd70259c640 1 --2- 172.21.15.79:0/661020509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd70406df50 0x7fd70406e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.090+0000 7fd70259c640 1 -- 172.21.15.79:0/661020509 >> v2:172.21.15.189:3300/0 conn(0x7fd7040b48e0 msgr2=0x7fd7040b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.090+0000 7fd70259c640 1 --2- 172.21.15.79:0/661020509 >> v2:172.21.15.189:3300/0 conn(0x7fd7040b48e0 0x7fd7040b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.090+0000 7fd70259c640 1 -- 172.21.15.79:0/661020509 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd704071e00 con 0x7fd704143bc0 2024-04-25T02:10:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.090+0000 7fd702d9d640 1 --2- 172.21.15.79:0/661020509 >> v2:172.21.15.189:3300/0 conn(0x7fd7040b48e0 0x7fd7040b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.090+0000 7fd70259c640 1 --2- 172.21.15.79:0/661020509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd704143bc0 0x7fd70415f500 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd704144de0 tx=0x7fd6f802c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f70b37d227393e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.091+0000 7fd70159a640 1 -- 172.21.15.79:0/661020509 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8032700 con 0x7fd704143bc0 2024-04-25T02:10:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.091+0000 7fd70159a640 1 -- 172.21.15.79:0/661020509 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f80328a0 con 0x7fd704143bc0 2024-04-25T02:10:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.091+0000 7fd70159a640 1 -- 172.21.15.79:0/661020509 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8032c70 con 0x7fd704143bc0 2024-04-25T02:10:14.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.091+0000 7fd708ebd640 1 -- 172.21.15.79:0/661020509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd704143bc0 msgr2=0x7fd70415f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.091+0000 7fd708ebd640 1 --2- 172.21.15.79:0/661020509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd704143bc0 0x7fd70415f500 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd704144de0 tx=0x7fd6f802c800 comp rx=0 tx=0).stop 2024-04-25T02:10:14.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.091+0000 7fd708ebd640 1 -- 172.21.15.79:0/661020509 shutdown_connections 2024-04-25T02:10:14.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.091+0000 7fd708ebd640 1 --2- 172.21.15.79:0/661020509 >> v2:172.21.15.189:3300/0 conn(0x7fd7040b48e0 0x7fd7040b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.091+0000 7fd708ebd640 1 --2- 172.21.15.79:0/661020509 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd70406df50 0x7fd70406e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.091+0000 7fd708ebd640 1 --2- 172.21.15.79:0/661020509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd704143bc0 0x7fd70415f500 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.091+0000 7fd708ebd640 1 -- 172.21.15.79:0/661020509 >> 172.21.15.79:0/661020509 conn(0x7fd7040cfc80 msgr2=0x7fd7040d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:14.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.091+0000 7fd708ebd640 1 -- 172.21.15.79:0/661020509 shutdown_connections 2024-04-25T02:10:14.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.091+0000 7fd708ebd640 1 -- 172.21.15.79:0/661020509 wait complete. 2024-04-25T02:10:14.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.092+0000 7fd708ebd640 1 Processor -- start 2024-04-25T02:10:14.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.093+0000 7fd708ebd640 1 -- start start 2024-04-25T02:10:14.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.093+0000 7fd708ebd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd70406df50 0x7fd704151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.093+0000 7fd708ebd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7040b48e0 0x7fd7041420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.093+0000 7fd708ebd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd704143bc0 0x7fd70413f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.093+0000 7fd708ebd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd704072660 con 0x7fd7040b48e0 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.093+0000 7fd708ebd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd704072380 con 0x7fd704143bc0 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.093+0000 7fd708ebd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd704072940 con 0x7fd70406df50 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.093+0000 7fd701d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7040b48e0 0x7fd7041420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.093+0000 7fd701d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7040b48e0 0x7fd7041420d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45478/0 (socket says 172.21.15.79:45478) 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.093+0000 7fd701d9b640 1 -- 172.21.15.79:0/315332062 learned_addr learned my addr 172.21.15.79:0/315332062 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.094+0000 7fd702d9d640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd704143bc0 0x7fd70413f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.094+0000 7fd70259c640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd70406df50 0x7fd704151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.094+0000 7fd701d9b640 1 -- 172.21.15.79:0/315332062 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd70406df50 msgr2=0x7fd704151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.094+0000 7fd701d9b640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd70406df50 0x7fd704151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.094+0000 7fd701d9b640 1 -- 172.21.15.79:0/315332062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd704143bc0 msgr2=0x7fd70413f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.094+0000 7fd701d9b640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd704143bc0 0x7fd70413f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.094+0000 7fd701d9b640 1 -- 172.21.15.79:0/315332062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7040c62c0 con 0x7fd7040b48e0 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.094+0000 7fd70259c640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd70406df50 0x7fd704151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.094+0000 7fd702d9d640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd704143bc0 0x7fd70413f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.094+0000 7fd701d9b640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7040b48e0 0x7fd7041420d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400c570 tx=0x7fd6f400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:14.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.094+0000 7fd6f2ffd640 1 -- 172.21.15.79:0/315332062 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4015070 con 0x7fd7040b48e0 2024-04-25T02:10:14.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.094+0000 7fd6f2ffd640 1 -- 172.21.15.79:0/315332062 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f4011800 con 0x7fd7040b48e0 2024-04-25T02:10:14.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.094+0000 7fd708ebd640 1 -- 172.21.15.79:0/315332062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd704151eb0 con 0x7fd7040b48e0 2024-04-25T02:10:14.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.094+0000 7fd6f2ffd640 1 -- 172.21.15.79:0/315332062 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4011bf0 con 0x7fd7040b48e0 2024-04-25T02:10:14.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.094+0000 7fd708ebd640 1 -- 172.21.15.79:0/315332062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7040c5500 con 0x7fd7040b48e0 2024-04-25T02:10:14.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.095+0000 7fd708ebd640 1 -- 172.21.15.79:0/315332062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7040690a0 con 0x7fd7040b48e0 2024-04-25T02:10:14.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.095+0000 7fd6f2ffd640 1 -- 172.21.15.79:0/315332062 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd6f4018070 con 0x7fd7040b48e0 2024-04-25T02:10:14.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.096+0000 7fd6f2ffd640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd6e406be30 0x7fd6e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.096+0000 7fd6f2ffd640 1 -- 172.21.15.79:0/315332062 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fd6f408ad20 con 0x7fd7040b48e0 2024-04-25T02:10:14.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.096+0000 7fd70259c640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd6e406be30 0x7fd6e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.096+0000 7fd70259c640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd6e406be30 0x7fd6e406e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8037000 tx=0x7fd6f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:14.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.100+0000 7fd6f2ffd640 1 -- 172.21.15.79:0/315332062 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd704151eb0 con 0x7fd7040b48e0 2024-04-25T02:10:14.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.309+0000 7fd708ebd640 1 -- 172.21.15.79:0/315332062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7040c5f50 con 0x7fd7040b48e0 2024-04-25T02:10:14.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.310+0000 7fd6f2ffd640 1 -- 172.21.15.79:0/315332062 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7fd6f40595f0 con 0x7fd7040b48e0 2024-04-25T02:10:14.319 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:14.319 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3934472151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3934472151},{"type":"v1","addr":"172.21.15.189:6835","nonce":3934472151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2046740048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2046740048},{"type":"v1","addr":"172.21.15.79:6836","nonce":2046740048}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/207160678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":207160678},{"type":"v1","addr":"172.21.15.79:6837","nonce":207160678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:09:27.032071+0000","modified":"2024-04-25T02:09:29.046598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/1295756642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1295756642},{"type":"v1","addr":"172.21.15.189:6833","nonce":1295756642}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":3}]} 2024-04-25T02:10:14.319 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2024-04-25T02:10:14.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.312+0000 7fd708ebd640 1 -- 172.21.15.79:0/315332062 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd6e406be30 msgr2=0x7fd6e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.312+0000 7fd708ebd640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd6e406be30 0x7fd6e406e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8037000 tx=0x7fd6f8008040 comp rx=0 tx=0).stop 2024-04-25T02:10:14.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.312+0000 7fd708ebd640 1 -- 172.21.15.79:0/315332062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7040b48e0 msgr2=0x7fd7041420d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.312+0000 7fd708ebd640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7040b48e0 0x7fd7041420d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400c570 tx=0x7fd6f400ca30 comp rx=0 tx=0).stop 2024-04-25T02:10:14.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.312+0000 7fd708ebd640 1 -- 172.21.15.79:0/315332062 shutdown_connections 2024-04-25T02:10:14.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.312+0000 7fd708ebd640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd6e406be30 0x7fd6e406e2f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.312+0000 7fd708ebd640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd704143bc0 0x7fd70413f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.312+0000 7fd708ebd640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7040b48e0 0x7fd7041420d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.312+0000 7fd708ebd640 1 --2- 172.21.15.79:0/315332062 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd70406df50 0x7fd704151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.312+0000 7fd708ebd640 1 -- 172.21.15.79:0/315332062 >> 172.21.15.79:0/315332062 conn(0x7fd7040cfc80 msgr2=0x7fd7040b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:14.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.312+0000 7fd708ebd640 1 -- 172.21.15.79:0/315332062 shutdown_connections 2024-04-25T02:10:14.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.312+0000 7fd708ebd640 1 -- 172.21.15.79:0/315332062 wait complete. 2024-04-25T02:10:14.331 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:10:14.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.419+0000 7f3c1e4c4640 1 Processor -- start 2024-04-25T02:10:14.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.419+0000 7f3c1e4c4640 1 -- start start 2024-04-25T02:10:14.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.420+0000 7f3c1e4c4640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f3c1815e140 0x7f3c18066ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.420+0000 7f3c1e4c4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c180cea70 con 0x7f3c1806b0b0 2024-04-25T02:10:14.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.420+0000 7f3c1e4c4640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c180ced50 con 0x7f3c1815e520 2024-04-25T02:10:14.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.420+0000 7f3c1e4c4640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3c18067480 con 0x7f3c1815e140 2024-04-25T02:10:14.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.420+0000 7f3c1ca61640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3c1806b0b0 0x7f3c180c97b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55558/0 (socket says 172.21.15.79:55558) 2024-04-25T02:10:14.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.420+0000 7f3c1ca61640 1 -- 172.21.15.79:0/3788692701 learned_addr learned my addr 172.21.15.79:0/3788692701 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.420+0000 7f3c17fff640 1 --2- 172.21.15.79:0/3788692701 >> v2:172.21.15.189:3300/0 conn(0x7f3c1815e140 0x7f3c18066ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c16ffd640 1 -- 172.21.15.79:0/3788692701 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2927193881 0 0) 0x7f3c180cea70 con 0x7f3c1806b0b0 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c16ffd640 1 -- 172.21.15.79:0/3788692701 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c00003520 con 0x7f3c1806b0b0 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c16ffd640 1 -- 172.21.15.79:0/3788692701 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1977637301 0 0) 0x7f3c00003520 con 0x7f3c1806b0b0 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c16ffd640 1 -- 172.21.15.79:0/3788692701 >> v2:172.21.15.189:3300/0 conn(0x7f3c1815e140 msgr2=0x7f3c18066ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c16ffd640 1 --2- 172.21.15.79:0/3788692701 >> v2:172.21.15.189:3300/0 conn(0x7f3c1815e140 0x7f3c18066ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c16ffd640 1 -- 172.21.15.79:0/3788692701 >> v1:172.21.15.189:6789/0 conn(0x7f3c1815e520 legacy=0x7f3c180af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c16ffd640 1 -- 172.21.15.79:0/3788692701 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c180cf030 con 0x7f3c1806b0b0 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c16ffd640 1 -- 172.21.15.79:0/3788692701 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f3c100019f0 con 0x7f3c1806b0b0 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c16ffd640 1 -- 172.21.15.79:0/3788692701 >> v1:172.21.15.79:6789/0 conn(0x7f3c1806b0b0 legacy=0x7f3c180c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c16ffd640 1 --2- 172.21.15.79:0/3788692701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c000039b0 0x7f3c00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c16ffd640 1 --2- 172.21.15.79:0/3788692701 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3c00004800 0x7f3c00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c16ffd640 1 --2- 172.21.15.79:0/3788692701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c000051c0 0x7f3c0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c16ffd640 1 -- 172.21.15.79:0/3788692701 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3c18067480 con 0x7f3c000051c0 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c16ffd640 1 -- 172.21.15.79:0/3788692701 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0000c160 con 0x7f3c000039b0 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c16ffd640 1 -- 172.21.15.79:0/3788692701 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0000c360 con 0x7f3c00004800 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c1ca61640 1 --2- 172.21.15.79:0/3788692701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c000051c0 0x7f3c0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c17fff640 1 --2- 172.21.15.79:0/3788692701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c000039b0 0x7f3c00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c177fe640 1 --2- 172.21.15.79:0/3788692701 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3c00004800 0x7f3c00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c1ca61640 1 -- 172.21.15.79:0/3788692701 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3c00004800 msgr2=0x7f3c00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c1ca61640 1 --2- 172.21.15.79:0/3788692701 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3c00004800 0x7f3c00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c1ca61640 1 -- 172.21.15.79:0/3788692701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c000039b0 msgr2=0x7f3c00003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c1ca61640 1 --2- 172.21.15.79:0/3788692701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c000039b0 0x7f3c00003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.421+0000 7f3c1ca61640 1 -- 172.21.15.79:0/3788692701 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c00003520 con 0x7f3c000051c0 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.422+0000 7f3c1ca61640 1 -- 172.21.15.79:0/3788692701 reap_dead start 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.422+0000 7f3c1ca61640 1 --2- 172.21.15.79:0/3788692701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c000051c0 0x7f3c0000b9c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000a840 tx=0x7f3c00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6441812e800bd206 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.422+0000 7f3c16ffd640 1 -- 172.21.15.79:0/3788692701 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1000a460 con 0x7f3c000051c0 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.422+0000 7f3c16ffd640 1 -- 172.21.15.79:0/3788692701 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1002f070 con 0x7f3c000051c0 2024-04-25T02:10:14.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.422+0000 7f3c16ffd640 1 -- 172.21.15.79:0/3788692701 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1002bcb0 con 0x7f3c000051c0 2024-04-25T02:10:14.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.423+0000 7f3c1e4c4640 1 -- 172.21.15.79:0/3788692701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c000051c0 msgr2=0x7f3c0000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.423+0000 7f3c1e4c4640 1 --2- 172.21.15.79:0/3788692701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c000051c0 0x7f3c0000b9c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000a840 tx=0x7f3c00005830 comp rx=0 tx=0).stop 2024-04-25T02:10:14.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.423+0000 7f3c1e4c4640 1 -- 172.21.15.79:0/3788692701 shutdown_connections 2024-04-25T02:10:14.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.423+0000 7f3c1e4c4640 1 --2- 172.21.15.79:0/3788692701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c000051c0 0x7f3c0000b9c0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.423+0000 7f3c1e4c4640 1 -- 172.21.15.79:0/3788692701 >> 172.21.15.79:0/3788692701 conn(0x7f3c180ccee0 msgr2=0x7f3c180cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:14.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.423+0000 7f3c1e4c4640 1 -- 172.21.15.79:0/3788692701 shutdown_connections 2024-04-25T02:10:14.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.423+0000 7f3c1e4c4640 1 -- 172.21.15.79:0/3788692701 wait complete. 2024-04-25T02:10:14.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.424+0000 7f3c1e4c4640 1 Processor -- start 2024-04-25T02:10:14.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.424+0000 7f3c1e4c4640 1 -- start start 2024-04-25T02:10:14.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1e4c4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3c000051c0 0x7f3c181f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1e4c4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c180b5890 0x7f3c180b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1e4c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c180b34c0 0x7f3c180b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1e4c4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3c180cf3a0 con 0x7f3c180b34c0 2024-04-25T02:10:14.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1e4c4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1806b750 con 0x7f3c180b5890 2024-04-25T02:10:14.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1e4c4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3c18066ea0 con 0x7f3c000051c0 2024-04-25T02:10:14.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1ca61640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c180b34c0 0x7f3c180b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1ca61640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c180b34c0 0x7f3c180b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45506/0 (socket says 172.21.15.79:45506) 2024-04-25T02:10:14.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1ca61640 1 -- 172.21.15.79:0/1554587250 learned_addr learned my addr 172.21.15.79:0/1554587250 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c177fe640 1 --2- 172.21.15.79:0/1554587250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c180b5890 0x7f3c180b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c17fff640 1 --2- 172.21.15.79:0/1554587250 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3c000051c0 0x7f3c181f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1ca61640 1 -- 172.21.15.79:0/1554587250 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3c000051c0 msgr2=0x7f3c181f4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1ca61640 1 --2- 172.21.15.79:0/1554587250 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3c000051c0 0x7f3c181f4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1ca61640 1 -- 172.21.15.79:0/1554587250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c180b5890 msgr2=0x7f3c180b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1ca61640 1 --2- 172.21.15.79:0/1554587250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c180b5890 0x7f3c180b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1ca61640 1 -- 172.21.15.79:0/1554587250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c180b4210 con 0x7f3c180b34c0 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c17fff640 1 --2- 172.21.15.79:0/1554587250 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3c000051c0 0x7f3c181f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1ca61640 1 --2- 172.21.15.79:0/1554587250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c180b34c0 0x7f3c180b3940 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3c100012e0 tx=0x7f3c180cec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c14ff9640 1 -- 172.21.15.79:0/1554587250 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1000a460 con 0x7f3c180b34c0 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c14ff9640 1 -- 172.21.15.79:0/1554587250 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c10034670 con 0x7f3c180b34c0 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1e4c4640 1 -- 172.21.15.79:0/1554587250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c180b44f0 con 0x7f3c180b34c0 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c14ff9640 1 -- 172.21.15.79:0/1554587250 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10001fb0 con 0x7f3c180b34c0 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.425+0000 7f3c1e4c4640 1 -- 172.21.15.79:0/1554587250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c180b4ab0 con 0x7f3c180b34c0 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.427+0000 7f3c1e4c4640 1 -- 172.21.15.79:0/1554587250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c180681e0 con 0x7f3c180b34c0 2024-04-25T02:10:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.427+0000 7f3c14ff9640 1 -- 172.21.15.79:0/1554587250 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c10034a20 con 0x7f3c180b34c0 2024-04-25T02:10:14.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.427+0000 7f3c14ff9640 1 --2- 172.21.15.79:0/1554587250 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3c0406be30 0x7f3c0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.427+0000 7f3c14ff9640 1 -- 172.21.15.79:0/1554587250 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f3c100aaf00 con 0x7f3c180b34c0 2024-04-25T02:10:14.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.427+0000 7f3c17fff640 1 --2- 172.21.15.79:0/1554587250 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3c0406be30 0x7f3c0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.428+0000 7f3c17fff640 1 --2- 172.21.15.79:0/1554587250 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3c0406be30 0x7f3c0406e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009a40 tx=0x7f3c08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:14.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.432+0000 7f3c14ff9640 1 -- 172.21.15.79:0/1554587250 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3c180681e0 con 0x7f3c180b34c0 2024-04-25T02:10:14.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.642+0000 7f3c1e4c4640 1 -- 172.21.15.79:0/1554587250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c180690a0 con 0x7f3c180b34c0 2024-04-25T02:10:14.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.643+0000 7f3c14ff9640 1 -- 172.21.15.79:0/1554587250 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7f3c10046060 con 0x7f3c180b34c0 2024-04-25T02:10:14.651 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:14.651 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3934472151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3934472151},{"type":"v1","addr":"172.21.15.189:6835","nonce":3934472151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2046740048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2046740048},{"type":"v1","addr":"172.21.15.79:6836","nonce":2046740048}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/207160678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":207160678},{"type":"v1","addr":"172.21.15.79:6837","nonce":207160678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:09:27.032071+0000","modified":"2024-04-25T02:09:29.046598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/1295756642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1295756642},{"type":"v1","addr":"172.21.15.189:6833","nonce":1295756642}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":3}]} 2024-04-25T02:10:14.652 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2024-04-25T02:10:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.645+0000 7f3c1e4c4640 1 -- 172.21.15.79:0/1554587250 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3c0406be30 msgr2=0x7f3c0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.645+0000 7f3c1e4c4640 1 --2- 172.21.15.79:0/1554587250 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3c0406be30 0x7f3c0406e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009a40 tx=0x7f3c08008040 comp rx=0 tx=0).stop 2024-04-25T02:10:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.645+0000 7f3c1e4c4640 1 -- 172.21.15.79:0/1554587250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c180b34c0 msgr2=0x7f3c180b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.645+0000 7f3c1e4c4640 1 --2- 172.21.15.79:0/1554587250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c180b34c0 0x7f3c180b3940 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3c100012e0 tx=0x7f3c180cec40 comp rx=0 tx=0).stop 2024-04-25T02:10:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.645+0000 7f3c1e4c4640 1 -- 172.21.15.79:0/1554587250 shutdown_connections 2024-04-25T02:10:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.645+0000 7f3c1e4c4640 1 --2- 172.21.15.79:0/1554587250 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3c0406be30 0x7f3c0406e2f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.645+0000 7f3c1e4c4640 1 --2- 172.21.15.79:0/1554587250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c180b34c0 0x7f3c180b3940 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.645+0000 7f3c1e4c4640 1 --2- 172.21.15.79:0/1554587250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c180b5890 0x7f3c180b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.645+0000 7f3c1e4c4640 1 --2- 172.21.15.79:0/1554587250 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3c000051c0 0x7f3c181f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.645+0000 7f3c1e4c4640 1 -- 172.21.15.79:0/1554587250 >> 172.21.15.79:0/1554587250 conn(0x7f3c180ccee0 msgr2=0x7f3c180b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.645+0000 7f3c1e4c4640 1 -- 172.21.15.79:0/1554587250 shutdown_connections 2024-04-25T02:10:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.645+0000 7f3c1e4c4640 1 -- 172.21.15.79:0/1554587250 wait complete. 2024-04-25T02:10:14.664 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:14.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.752+0000 7f7323b29640 1 Processor -- start 2024-04-25T02:10:14.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.753+0000 7f7323b29640 1 -- start start 2024-04-25T02:10:14.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.753+0000 7f7323b29640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f731c0b3570 0x7f731c0d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.753+0000 7f7323b29640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f731c0b3020 0x7f731c0d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.753+0000 7f7323b29640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f731c06c380 con 0x7f731c15e4d0 2024-04-25T02:10:14.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.753+0000 7f7323b29640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f731c0d1660 con 0x7f731c0b3020 2024-04-25T02:10:14.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.753+0000 7f7323b29640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f731c0d1380 con 0x7f731c0b3570 2024-04-25T02:10:14.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.754+0000 7f73218c5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f731c15e4d0 0x7f731c06bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55564/0 (socket says 172.21.15.79:55564) 2024-04-25T02:10:14.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.754+0000 7f73218c5640 1 -- 172.21.15.79:0/3861908849 learned_addr learned my addr 172.21.15.79:0/3861908849 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:14.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.754+0000 7f73210c4640 1 --2- 172.21.15.79:0/3861908849 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f731c0b3570 0x7f731c0d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.754+0000 7f73220c6640 1 --2- 172.21.15.79:0/3861908849 >> v2:172.21.15.189:3300/0 conn(0x7f731c0b3020 0x7f731c0d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.754+0000 7f73208c3640 1 -- 172.21.15.79:0/3861908849 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3362476475 0 0) 0x7f731c06c380 con 0x7f731c15e4d0 2024-04-25T02:10:14.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.754+0000 7f73208c3640 1 -- 172.21.15.79:0/3861908849 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7308003520 con 0x7f731c15e4d0 2024-04-25T02:10:14.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.754+0000 7f73220c6640 1 -- 172.21.15.79:0/3861908849 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f731c0b3570 msgr2=0x7f731c0d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:14.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.754+0000 7f73220c6640 1 --2- 172.21.15.79:0/3861908849 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f731c0b3570 0x7f731c0d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.754+0000 7f73220c6640 1 -- 172.21.15.79:0/3861908849 >> v1:172.21.15.79:6789/0 conn(0x7f731c15e4d0 legacy=0x7f731c06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.754+0000 7f73208c3640 1 -- 172.21.15.79:0/3861908849 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2388619164 0 0) 0x7f7308003520 con 0x7f731c15e4d0 2024-04-25T02:10:14.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.754+0000 7f73220c6640 1 -- 172.21.15.79:0/3861908849 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f731c0cede0 con 0x7f731c0b3020 2024-04-25T02:10:14.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.755+0000 7f73220c6640 1 --2- 172.21.15.79:0/3861908849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c0b3020 0x7f731c0d2c50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7314009d90 tx=0x7f731402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22b60ade302f6513 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:14.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.755+0000 7f73208c3640 1 -- 172.21.15.79:0/3861908849 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318001670 con 0x7f731c0b3020 2024-04-25T02:10:14.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.755+0000 7f73208c3640 1 -- 172.21.15.79:0/3861908849 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7314007540 con 0x7f731c0b3020 2024-04-25T02:10:14.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.755+0000 7f73208c3640 1 -- 172.21.15.79:0/3861908849 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73140078f0 con 0x7f731c0b3020 2024-04-25T02:10:14.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.756+0000 7f7323b29640 1 -- 172.21.15.79:0/3861908849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c0b3020 msgr2=0x7f731c0d2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.756+0000 7f7323b29640 1 --2- 172.21.15.79:0/3861908849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c0b3020 0x7f731c0d2c50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7314009d90 tx=0x7f731402a5f0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.756+0000 7f7323b29640 1 -- 172.21.15.79:0/3861908849 shutdown_connections 2024-04-25T02:10:14.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.756+0000 7f7323b29640 1 --2- 172.21.15.79:0/3861908849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c0b3020 0x7f731c0d2c50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.756+0000 7f7323b29640 1 --2- 172.21.15.79:0/3861908849 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f731c0b3570 0x7f731c0d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.756+0000 7f7323b29640 1 -- 172.21.15.79:0/3861908849 >> 172.21.15.79:0/3861908849 conn(0x7f731c09d460 msgr2=0x7f731c0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:14.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.756+0000 7f7323b29640 1 -- 172.21.15.79:0/3861908849 shutdown_connections 2024-04-25T02:10:14.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.756+0000 7f7323b29640 1 -- 172.21.15.79:0/3861908849 wait complete. 2024-04-25T02:10:14.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.757+0000 7f7323b29640 1 Processor -- start 2024-04-25T02:10:14.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.757+0000 7f7323b29640 1 -- start start 2024-04-25T02:10:14.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.757+0000 7f7323b29640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c0b3020 0x7f731c1f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.757+0000 7f7323b29640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f731c0b3570 0x7f731c15c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.757+0000 7f7323b29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f731c15e4d0 0x7f731c0b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.757+0000 7f7323b29640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f731c0d20d0 con 0x7f731c15e4d0 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.757+0000 7f7323b29640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f731c15e8b0 con 0x7f731c0b3020 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.757+0000 7f7323b29640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f731c0d2250 con 0x7f731c0b3570 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73220c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f731c15e4d0 0x7f731c0b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73220c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f731c15e4d0 0x7f731c0b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45508/0 (socket says 172.21.15.79:45508) 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73220c6640 1 -- 172.21.15.79:0/2392454921 learned_addr learned my addr 172.21.15.79:0/2392454921 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73210c4640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f731c0b3570 0x7f731c15c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73218c5640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c0b3020 0x7f731c1f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73220c6640 1 -- 172.21.15.79:0/2392454921 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f731c0b3570 msgr2=0x7f731c15c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73220c6640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f731c0b3570 0x7f731c15c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73220c6640 1 -- 172.21.15.79:0/2392454921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c0b3020 msgr2=0x7f731c1f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73220c6640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c0b3020 0x7f731c1f4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73220c6640 1 -- 172.21.15.79:0/2392454921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f731c0b50a0 con 0x7f731c15e4d0 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73218c5640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c0b3020 0x7f731c1f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73210c4640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f731c0b3570 0x7f731c15c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:14.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73220c6640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f731c15e4d0 0x7f731c0b45e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f731402abe0 tx=0x7f7314004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:14.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73127fc640 1 -- 172.21.15.79:0/2392454921 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314040070 con 0x7f731c15e4d0 2024-04-25T02:10:14.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73127fc640 1 -- 172.21.15.79:0/2392454921 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7314031c40 con 0x7f731c15e4d0 2024-04-25T02:10:14.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f7323b29640 1 -- 172.21.15.79:0/2392454921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f731c160030 con 0x7f731c15e4d0 2024-04-25T02:10:14.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f73127fc640 1 -- 172.21.15.79:0/2392454921 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314009450 con 0x7f731c15e4d0 2024-04-25T02:10:14.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.758+0000 7f7323b29640 1 -- 172.21.15.79:0/2392454921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f731c1605f0 con 0x7f731c15e4d0 2024-04-25T02:10:14.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.759+0000 7f7323b29640 1 -- 172.21.15.79:0/2392454921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f731c1607f0 con 0x7f731c15e4d0 2024-04-25T02:10:14.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.759+0000 7f73127fc640 1 -- 172.21.15.79:0/2392454921 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7314039040 con 0x7f731c15e4d0 2024-04-25T02:10:14.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.760+0000 7f73127fc640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f730006be30 0x7f730006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:14.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.760+0000 7f73218c5640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f730006be30 0x7f730006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:14.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.760+0000 7f73127fc640 1 -- 172.21.15.79:0/2392454921 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f73140ac240 con 0x7f731c15e4d0 2024-04-25T02:10:14.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.760+0000 7f73218c5640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f730006be30 0x7f730006e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7318001eb0 tx=0x7f7318009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:14.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.764+0000 7f73127fc640 1 -- 172.21.15.79:0/2392454921 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f731c1607f0 con 0x7f731c15e4d0 2024-04-25T02:10:14.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.941+0000 7f7323b29640 1 -- 172.21.15.79:0/2392454921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f731c0d1920 con 0x7f731c15e4d0 2024-04-25T02:10:14.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.942+0000 7f73127fc640 1 -- 172.21.15.79:0/2392454921 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16776 (secure 0 0 0) 0x7f731407ac40 con 0x7f731c15e4d0 2024-04-25T02:10:14.951 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:14.951 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":47,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:09:41.749749+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:09:25.247996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T02:09:26.001469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.944+0000 7f7323b29640 1 -- 172.21.15.79:0/2392454921 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f730006be30 msgr2=0x7f730006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.944+0000 7f7323b29640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f730006be30 0x7f730006e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7318001eb0 tx=0x7f7318009040 comp rx=0 tx=0).stop 2024-04-25T02:10:14.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.944+0000 7f7323b29640 1 -- 172.21.15.79:0/2392454921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f731c15e4d0 msgr2=0x7f731c0b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.944+0000 7f7323b29640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f731c15e4d0 0x7f731c0b45e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f731402abe0 tx=0x7f7314004a40 comp rx=0 tx=0).stop 2024-04-25T02:10:14.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.944+0000 7f7323b29640 1 -- 172.21.15.79:0/2392454921 shutdown_connections 2024-04-25T02:10:14.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.944+0000 7f7323b29640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f730006be30 0x7f730006e2f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.944+0000 7f7323b29640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f731c15e4d0 0x7f731c0b45e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.944+0000 7f7323b29640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f731c0b3570 0x7f731c15c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.944+0000 7f7323b29640 1 --2- 172.21.15.79:0/2392454921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c0b3020 0x7f731c1f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:14.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.944+0000 7f7323b29640 1 -- 172.21.15.79:0/2392454921 >> 172.21.15.79:0/2392454921 conn(0x7f731c09d460 msgr2=0x7f731c0b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:14.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.945+0000 7f7323b29640 1 -- 172.21.15.79:0/2392454921 shutdown_connections 2024-04-25T02:10:14.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:14.945+0000 7f7323b29640 1 -- 172.21.15.79:0/2392454921 wait complete. 2024-04-25T02:10:14.964 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:10:15.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.052+0000 7f6e9782c640 1 Processor -- start 2024-04-25T02:10:15.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.052+0000 7f6e9782c640 1 -- start start 2024-04-25T02:10:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.053+0000 7f6e9782c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6e9015e4d0 0x7f6e9006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.053+0000 7f6e9782c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e900b3570 0x7f6e900d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.053+0000 7f6e9782c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e900d1660 con 0x7f6e900b3020 2024-04-25T02:10:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.053+0000 7f6e9782c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6e900d1380 con 0x7f6e9015e4d0 2024-04-25T02:10:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.053+0000 7f6e9782c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6e900cede0 con 0x7f6e900b3570 2024-04-25T02:10:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.053+0000 7f6e95dc9640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6e900b3020 0x7f6e900cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55576/0 (socket says 172.21.15.79:55576) 2024-04-25T02:10:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.053+0000 7f6e95dc9640 1 -- 172.21.15.79:0/1176752301 learned_addr learned my addr 172.21.15.79:0/1176752301 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.054+0000 7f6e94dc7640 1 --2- 172.21.15.79:0/1176752301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e900b3570 0x7f6e900d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.054+0000 7f6e955c8640 1 --2- 172.21.15.79:0/1176752301 >> v2:172.21.15.189:3300/0 conn(0x7f6e9015e4d0 0x7f6e9006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.054+0000 7f6e87fff640 1 -- 172.21.15.79:0/1176752301 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 889282462 0 0) 0x7f6e900d1660 con 0x7f6e900b3020 2024-04-25T02:10:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.054+0000 7f6e87fff640 1 -- 172.21.15.79:0/1176752301 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e7c003520 con 0x7f6e900b3020 2024-04-25T02:10:15.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.054+0000 7f6e87fff640 1 -- 172.21.15.79:0/1176752301 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3829649516 0 0) 0x7f6e7c003520 con 0x7f6e900b3020 2024-04-25T02:10:15.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.054+0000 7f6e94dc7640 1 -- 172.21.15.79:0/1176752301 >> v2:172.21.15.189:3300/0 conn(0x7f6e9015e4d0 msgr2=0x7f6e9006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:15.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.054+0000 7f6e94dc7640 1 --2- 172.21.15.79:0/1176752301 >> v2:172.21.15.189:3300/0 conn(0x7f6e9015e4d0 0x7f6e9006bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:15.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.054+0000 7f6e94dc7640 1 -- 172.21.15.79:0/1176752301 >> v1:172.21.15.79:6789/0 conn(0x7f6e900b3020 legacy=0x7f6e900cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.054+0000 7f6e94dc7640 1 -- 172.21.15.79:0/1176752301 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e900cf0c0 con 0x7f6e900b3570 2024-04-25T02:10:15.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.054+0000 7f6e955c8640 1 --2- 172.21.15.79:0/1176752301 >> v2:172.21.15.189:3300/0 conn(0x7f6e9015e4d0 0x7f6e9006bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:15.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.055+0000 7f6e94dc7640 1 --2- 172.21.15.79:0/1176752301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e900b3570 0x7f6e900d2710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6e800097a0 tx=0x7f6e8002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=274cd37eac6f89ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.055+0000 7f6e87fff640 1 -- 172.21.15.79:0/1176752301 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80037070 con 0x7f6e900b3570 2024-04-25T02:10:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.055+0000 7f6e87fff640 1 -- 172.21.15.79:0/1176752301 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e8002aba0 con 0x7f6e900b3570 2024-04-25T02:10:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.055+0000 7f6e87fff640 1 -- 172.21.15.79:0/1176752301 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e88001670 con 0x7f6e900b3570 2024-04-25T02:10:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.055+0000 7f6e9782c640 1 -- 172.21.15.79:0/1176752301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e900b3570 msgr2=0x7f6e900d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.055+0000 7f6e9782c640 1 --2- 172.21.15.79:0/1176752301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e900b3570 0x7f6e900d2710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6e800097a0 tx=0x7f6e8002a110 comp rx=0 tx=0).stop 2024-04-25T02:10:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.055+0000 7f6e9782c640 1 -- 172.21.15.79:0/1176752301 shutdown_connections 2024-04-25T02:10:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.055+0000 7f6e9782c640 1 --2- 172.21.15.79:0/1176752301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e900b3570 0x7f6e900d2710 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.055+0000 7f6e9782c640 1 --2- 172.21.15.79:0/1176752301 >> v2:172.21.15.189:3300/0 conn(0x7f6e9015e4d0 0x7f6e9006bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.055+0000 7f6e9782c640 1 -- 172.21.15.79:0/1176752301 >> 172.21.15.79:0/1176752301 conn(0x7f6e9009d460 msgr2=0x7f6e900d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.056+0000 7f6e9782c640 1 -- 172.21.15.79:0/1176752301 shutdown_connections 2024-04-25T02:10:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.056+0000 7f6e9782c640 1 -- 172.21.15.79:0/1176752301 wait complete. 2024-04-25T02:10:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.057+0000 7f6e9782c640 1 Processor -- start 2024-04-25T02:10:15.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.057+0000 7f6e9782c640 1 -- start start 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.057+0000 7f6e9782c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e900b3020 0x7f6e900c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.057+0000 7f6e9782c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e900b3570 0x7f6e90159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.057+0000 7f6e9782c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9015e4d0 0x7f6e900b8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.057+0000 7f6e9782c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6e900d2250 con 0x7f6e9015e4d0 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.057+0000 7f6e9782c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e900d20d0 con 0x7f6e900b3020 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.057+0000 7f6e9782c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9006c1b0 con 0x7f6e900b3570 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.057+0000 7f6e95dc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9015e4d0 0x7f6e900b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.057+0000 7f6e95dc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9015e4d0 0x7f6e900b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45524/0 (socket says 172.21.15.79:45524) 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.058+0000 7f6e95dc9640 1 -- 172.21.15.79:0/136240865 learned_addr learned my addr 172.21.15.79:0/136240865 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.058+0000 7f6e955c8640 1 --2- 172.21.15.79:0/136240865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e900b3020 0x7f6e900c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.058+0000 7f6e94dc7640 1 --2- 172.21.15.79:0/136240865 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e900b3570 0x7f6e90159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.058+0000 7f6e95dc9640 1 -- 172.21.15.79:0/136240865 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e900b3570 msgr2=0x7f6e90159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.058+0000 7f6e95dc9640 1 --2- 172.21.15.79:0/136240865 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e900b3570 0x7f6e90159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.058+0000 7f6e95dc9640 1 -- 172.21.15.79:0/136240865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e900b3020 msgr2=0x7f6e900c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.058+0000 7f6e95dc9640 1 --2- 172.21.15.79:0/136240865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e900b3020 0x7f6e900c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:15.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.058+0000 7f6e95dc9640 1 -- 172.21.15.79:0/136240865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e900b9b30 con 0x7f6e9015e4d0 2024-04-25T02:10:15.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.058+0000 7f6e94dc7640 1 --2- 172.21.15.79:0/136240865 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e900b3570 0x7f6e90159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:15.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.058+0000 7f6e95dc9640 1 --2- 172.21.15.79:0/136240865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9015e4d0 0x7f6e900b8190 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c520 tx=0x7f6e8800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:15.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.058+0000 7f6e85ffb640 1 -- 172.21.15.79:0/136240865 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e88017070 con 0x7f6e9015e4d0 2024-04-25T02:10:15.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.058+0000 7f6e85ffb640 1 -- 172.21.15.79:0/136240865 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e88005ce0 con 0x7f6e9015e4d0 2024-04-25T02:10:15.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.058+0000 7f6e85ffb640 1 -- 172.21.15.79:0/136240865 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e88007270 con 0x7f6e9015e4d0 2024-04-25T02:10:15.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.058+0000 7f6e9782c640 1 -- 172.21.15.79:0/136240865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e900b8a90 con 0x7f6e9015e4d0 2024-04-25T02:10:15.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.058+0000 7f6e9782c640 1 -- 172.21.15.79:0/136240865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e900b9050 con 0x7f6e9015e4d0 2024-04-25T02:10:15.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.059+0000 7f6e9782c640 1 -- 172.21.15.79:0/136240865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e900690a0 con 0x7f6e9015e4d0 2024-04-25T02:10:15.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.060+0000 7f6e85ffb640 1 -- 172.21.15.79:0/136240865 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e8801a070 con 0x7f6e9015e4d0 2024-04-25T02:10:15.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.060+0000 7f6e85ffb640 1 --2- 172.21.15.79:0/136240865 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e7406be30 0x7f6e7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:15.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.060+0000 7f6e85ffb640 1 -- 172.21.15.79:0/136240865 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f6e8808a1e0 con 0x7f6e9015e4d0 2024-04-25T02:10:15.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.060+0000 7f6e955c8640 1 --2- 172.21.15.79:0/136240865 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e7406be30 0x7f6e7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:15.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.060+0000 7f6e955c8640 1 --2- 172.21.15.79:0/136240865 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e7406be30 0x7f6e7406e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c009bd0 tx=0x7f6e8c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:15.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.064+0000 7f6e85ffb640 1 -- 172.21.15.79:0/136240865 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6e88058480 con 0x7f6e9015e4d0 2024-04-25T02:10:15.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.272+0000 7f6e9782c640 1 -- 172.21.15.79:0/136240865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6e9015bde0 con 0x7f6e9015e4d0 2024-04-25T02:10:15.281 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:10:15.273+0000 7fb0c50c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:10:15.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.274+0000 7f6e85ffb640 1 -- 172.21.15.79:0/136240865 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f6e8805c780 con 0x7f6e9015e4d0 2024-04-25T02:10:15.283 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:10:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.277+0000 7f6e9782c640 1 -- 172.21.15.79:0/136240865 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e7406be30 msgr2=0x7f6e7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.277+0000 7f6e9782c640 1 --2- 172.21.15.79:0/136240865 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e7406be30 0x7f6e7406e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c009bd0 tx=0x7f6e8c00b040 comp rx=0 tx=0).stop 2024-04-25T02:10:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.277+0000 7f6e9782c640 1 -- 172.21.15.79:0/136240865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9015e4d0 msgr2=0x7f6e900b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.277+0000 7f6e9782c640 1 --2- 172.21.15.79:0/136240865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9015e4d0 0x7f6e900b8190 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c520 tx=0x7f6e8800c9e0 comp rx=0 tx=0).stop 2024-04-25T02:10:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.277+0000 7f6e9782c640 1 -- 172.21.15.79:0/136240865 shutdown_connections 2024-04-25T02:10:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.277+0000 7f6e9782c640 1 --2- 172.21.15.79:0/136240865 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e7406be30 0x7f6e7406e2f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.277+0000 7f6e9782c640 1 --2- 172.21.15.79:0/136240865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9015e4d0 0x7f6e900b8190 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.277+0000 7f6e9782c640 1 --2- 172.21.15.79:0/136240865 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e900b3570 0x7f6e90159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.277+0000 7f6e9782c640 1 --2- 172.21.15.79:0/136240865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e900b3020 0x7f6e900c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.277+0000 7f6e9782c640 1 -- 172.21.15.79:0/136240865 >> 172.21.15.79:0/136240865 conn(0x7f6e9009d460 msgr2=0x7f6e900b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.277+0000 7f6e9782c640 1 -- 172.21.15.79:0/136240865 shutdown_connections 2024-04-25T02:10:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.277+0000 7f6e9782c640 1 -- 172.21.15.79:0/136240865 wait complete. 2024-04-25T02:10:15.289 INFO:tasks.ceph.mds.b.smithi189.stderr: -4973> 2024-04-25T02:09:32.970+0000 7fc98391d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:10:15.291 INFO:tasks.ceph.mds.b.smithi189.stderr: -3132> 2024-04-25T02:09:38.893+0000 7fc97f915640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5778=0-4194304@1} caps={5778=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5778 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x564f03960680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:10:15.296 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T02:10:15.321 INFO:tasks.ceph.mds.b.smithi189.stdout:starting mds.b at 2024-04-25T02:10:15.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.386+0000 7f5c5bf8b640 1 Processor -- start 2024-04-25T02:10:15.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.386+0000 7f5c5bf8b640 1 -- start start 2024-04-25T02:10:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.387+0000 7f5c5bf8b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c5406b2f0 0x7f5c540b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.387+0000 7f5c5bf8b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c5406e6b0 0x7f5c5415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.387+0000 7f5c5bf8b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c5415ec20 con 0x7f5c540cf7a0 2024-04-25T02:10:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.387+0000 7f5c5bf8b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5c5415f830 con 0x7f5c5406b2f0 2024-04-25T02:10:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.387+0000 7f5c5bf8b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5c5415ef00 con 0x7f5c5406e6b0 2024-04-25T02:10:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.387+0000 7f5c59d27640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c5406b2f0 0x7f5c540b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.387+0000 7f5c59526640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5c540cf7a0 0x7f5c5406b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55578/0 (socket says 172.21.15.79:55578) 2024-04-25T02:10:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.387+0000 7f5c59526640 1 -- 172.21.15.79:0/3790951444 learned_addr learned my addr 172.21.15.79:0/3790951444 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.387+0000 7f5c5a528640 1 --2- 172.21.15.79:0/3790951444 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c5406e6b0 0x7f5c5415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.387+0000 7f5c59d27640 1 -- 172.21.15.79:0/3790951444 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c5406e6b0 msgr2=0x7f5c5415b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.387+0000 7f5c59d27640 1 --2- 172.21.15.79:0/3790951444 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c5406e6b0 0x7f5c5415b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.387+0000 7f5c59d27640 1 -- 172.21.15.79:0/3790951444 >> v1:172.21.15.79:6789/0 conn(0x7f5c540cf7a0 legacy=0x7f5c5406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.387+0000 7f5c59d27640 1 -- 172.21.15.79:0/3790951444 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5415f1e0 con 0x7f5c5406b2f0 2024-04-25T02:10:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.388+0000 7f5c59d27640 1 --2- 172.21.15.79:0/3790951444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5406b2f0 0x7f5c540b4b50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5c500097a0 tx=0x7f5c5002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4981e336b96011 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.388+0000 7f5c58d25640 1 -- 172.21.15.79:0/3790951444 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c50037070 con 0x7f5c5406b2f0 2024-04-25T02:10:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.388+0000 7f5c58d25640 1 -- 172.21.15.79:0/3790951444 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c5002ae50 con 0x7f5c5406b2f0 2024-04-25T02:10:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.388+0000 7f5c58d25640 1 -- 172.21.15.79:0/3790951444 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c50032660 con 0x7f5c5406b2f0 2024-04-25T02:10:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.388+0000 7f5c5bf8b640 1 -- 172.21.15.79:0/3790951444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5406b2f0 msgr2=0x7f5c540b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.388+0000 7f5c5bf8b640 1 --2- 172.21.15.79:0/3790951444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5406b2f0 0x7f5c540b4b50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5c500097a0 tx=0x7f5c5002a100 comp rx=0 tx=0).stop 2024-04-25T02:10:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.388+0000 7f5c5bf8b640 1 -- 172.21.15.79:0/3790951444 shutdown_connections 2024-04-25T02:10:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.388+0000 7f5c5bf8b640 1 --2- 172.21.15.79:0/3790951444 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c5406e6b0 0x7f5c5415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.388+0000 7f5c5bf8b640 1 --2- 172.21.15.79:0/3790951444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5406b2f0 0x7f5c540b4b50 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.388+0000 7f5c5bf8b640 1 -- 172.21.15.79:0/3790951444 >> 172.21.15.79:0/3790951444 conn(0x7f5c540b1cd0 msgr2=0x7f5c540b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.389+0000 7f5c5bf8b640 1 -- 172.21.15.79:0/3790951444 shutdown_connections 2024-04-25T02:10:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.389+0000 7f5c5bf8b640 1 -- 172.21.15.79:0/3790951444 wait complete. 2024-04-25T02:10:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.390+0000 7f5c5bf8b640 1 Processor -- start 2024-04-25T02:10:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.390+0000 7f5c5bf8b640 1 -- start start 2024-04-25T02:10:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.390+0000 7f5c5bf8b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c5406b2f0 0x7f5c5414f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.390+0000 7f5c5bf8b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5406e6b0 0x7f5c540ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.390+0000 7f5c5bf8b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c540cf7a0 0x7f5c5409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.390+0000 7f5c5bf8b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5406d160 con 0x7f5c5406e6b0 2024-04-25T02:10:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.390+0000 7f5c5bf8b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5406cfe0 con 0x7f5c5406b2f0 2024-04-25T02:10:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.390+0000 7f5c5bf8b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5c5415b810 con 0x7f5c540cf7a0 2024-04-25T02:10:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.390+0000 7f5c59526640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5406e6b0 0x7f5c540ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c59526640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5406e6b0 0x7f5c540ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45552/0 (socket says 172.21.15.79:45552) 2024-04-25T02:10:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c59526640 1 -- 172.21.15.79:0/482118426 learned_addr learned my addr 172.21.15.79:0/482118426 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c59d27640 1 --2- 172.21.15.79:0/482118426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c5406b2f0 0x7f5c5414f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c5a528640 1 --2- 172.21.15.79:0/482118426 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c540cf7a0 0x7f5c5409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c59526640 1 -- 172.21.15.79:0/482118426 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c540cf7a0 msgr2=0x7f5c5409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c59526640 1 --2- 172.21.15.79:0/482118426 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c540cf7a0 0x7f5c5409aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c59526640 1 -- 172.21.15.79:0/482118426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c5406b2f0 msgr2=0x7f5c5414f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c59526640 1 --2- 172.21.15.79:0/482118426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c5406b2f0 0x7f5c5414f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c59526640 1 -- 172.21.15.79:0/482118426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c540ae6e0 con 0x7f5c5406e6b0 2024-04-25T02:10:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c59d27640 1 --2- 172.21.15.79:0/482118426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c5406b2f0 0x7f5c5414f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c59526640 1 --2- 172.21.15.79:0/482118426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5406e6b0 0x7f5c540ad7b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400c3f0 tx=0x7f5c4400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c4a7fc640 1 -- 172.21.15.79:0/482118426 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44017070 con 0x7f5c5406e6b0 2024-04-25T02:10:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c4a7fc640 1 -- 172.21.15.79:0/482118426 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c44005ce0 con 0x7f5c5406e6b0 2024-04-25T02:10:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c5bf8b640 1 -- 172.21.15.79:0/482118426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c540ae180 con 0x7f5c5406e6b0 2024-04-25T02:10:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c4a7fc640 1 -- 172.21.15.79:0/482118426 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c440072f0 con 0x7f5c5406e6b0 2024-04-25T02:10:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.391+0000 7f5c5bf8b640 1 -- 172.21.15.79:0/482118426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c540c98d0 con 0x7f5c5406e6b0 2024-04-25T02:10:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.392+0000 7f5c5bf8b640 1 -- 172.21.15.79:0/482118426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c540690a0 con 0x7f5c5406e6b0 2024-04-25T02:10:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.393+0000 7f5c4a7fc640 1 -- 172.21.15.79:0/482118426 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c4401a070 con 0x7f5c5406e6b0 2024-04-25T02:10:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.393+0000 7f5c4a7fc640 1 --2- 172.21.15.79:0/482118426 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5c3806be30 0x7f5c3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.393+0000 7f5c4a7fc640 1 -- 172.21.15.79:0/482118426 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f5c4408a1e0 con 0x7f5c5406e6b0 2024-04-25T02:10:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.393+0000 7f5c59d27640 1 --2- 172.21.15.79:0/482118426 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5c3806be30 0x7f5c3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.394+0000 7f5c59d27640 1 --2- 172.21.15.79:0/482118426 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5c3806be30 0x7f5c3806e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5c50034000 tx=0x7f5c5002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:15.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.399+0000 7f5c4a7fc640 1 -- 172.21.15.79:0/482118426 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5c540ae180 con 0x7f5c5406e6b0 2024-04-25T02:10:15.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:15.610+0000 7f5c5bf8b640 1 -- 172.21.15.79:0/482118426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5c540cf4f0 con 0x7f5c5406e6b0 2024-04-25T02:10:16.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.276+0000 7f5c4a7fc640 1 -- 172.21.15.79:0/482118426 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f5c44058b00 con 0x7f5c5406e6b0 2024-04-25T02:10:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.278+0000 7f5c5bf8b640 1 -- 172.21.15.79:0/482118426 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5c3806be30 msgr2=0x7f5c3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.278+0000 7f5c5bf8b640 1 --2- 172.21.15.79:0/482118426 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5c3806be30 0x7f5c3806e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5c50034000 tx=0x7f5c5002e000 comp rx=0 tx=0).stop 2024-04-25T02:10:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.278+0000 7f5c5bf8b640 1 -- 172.21.15.79:0/482118426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5406e6b0 msgr2=0x7f5c540ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.278+0000 7f5c5bf8b640 1 --2- 172.21.15.79:0/482118426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5406e6b0 0x7f5c540ad7b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400c3f0 tx=0x7f5c4400c8b0 comp rx=0 tx=0).stop 2024-04-25T02:10:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.278+0000 7f5c5bf8b640 1 -- 172.21.15.79:0/482118426 shutdown_connections 2024-04-25T02:10:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.278+0000 7f5c5bf8b640 1 --2- 172.21.15.79:0/482118426 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5c3806be30 0x7f5c3806e2f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.278+0000 7f5c5bf8b640 1 --2- 172.21.15.79:0/482118426 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c540cf7a0 0x7f5c5409aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.278+0000 7f5c5bf8b640 1 --2- 172.21.15.79:0/482118426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5406e6b0 0x7f5c540ad7b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.278+0000 7f5c5bf8b640 1 --2- 172.21.15.79:0/482118426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c5406b2f0 0x7f5c5414f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:16.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.278+0000 7f5c5bf8b640 1 -- 172.21.15.79:0/482118426 >> 172.21.15.79:0/482118426 conn(0x7f5c540b1cd0 msgr2=0x7f5c540722d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:16.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.278+0000 7f5c5bf8b640 1 -- 172.21.15.79:0/482118426 shutdown_connections 2024-04-25T02:10:16.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.278+0000 7f5c5bf8b640 1 -- 172.21.15.79:0/482118426 wait complete. 2024-04-25T02:10:16.299 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T02:10:16.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.395+0000 7f4d3262a640 1 Processor -- start 2024-04-25T02:10:16.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.395+0000 7f4d3262a640 1 -- start start 2024-04-25T02:10:16.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.396+0000 7f4d3262a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d2c151780 0x7f4d2c15b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:16.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.396+0000 7f4d3262a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d2c0b5280 con 0x7f4d2c06e290 2024-04-25T02:10:16.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.396+0000 7f4d3262a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d2c0b2da0 con 0x7f4d2c0b4e10 2024-04-25T02:10:16.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.396+0000 7f4d3262a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4d2c0b3e40 con 0x7f4d2c151780 2024-04-25T02:10:16.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.396+0000 7f4d2bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d2c151780 0x7f4d2c15b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:16.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.396+0000 7f4d30bc7640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4d2c06e290 0x7f4d2c0cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55592/0 (socket says 172.21.15.79:55592) 2024-04-25T02:10:16.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.396+0000 7f4d2bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d2c151780 0x7f4d2c15b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45556/0 (socket says 172.21.15.79:45556) 2024-04-25T02:10:16.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.396+0000 7f4d30bc7640 1 -- 172.21.15.79:0/4273016579 learned_addr learned my addr 172.21.15.79:0/4273016579 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:16.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.396+0000 7f4d2bfff640 1 -- 172.21.15.79:0/4273016579 >> v1:172.21.15.189:6789/0 conn(0x7f4d2c0b4e10 legacy=0x7f4d2c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:16.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.396+0000 7f4d2bfff640 1 -- 172.21.15.79:0/4273016579 >> v1:172.21.15.79:6789/0 conn(0x7f4d2c06e290 legacy=0x7f4d2c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.396+0000 7f4d2bfff640 1 -- 172.21.15.79:0/4273016579 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2c0b3080 con 0x7f4d2c151780 2024-04-25T02:10:16.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.396+0000 7f4d2affd640 1 -- 172.21.15.79:0/4273016579 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2900043534 0 0) 0x7f4d2c0b5280 con 0x7f4d2c06e290 2024-04-25T02:10:16.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.397+0000 7f4d2bfff640 1 --2- 172.21.15.79:0/4273016579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d2c151780 0x7f4d2c15b720 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0097a0 tx=0x7f4d1c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e2b28248e27681 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:16.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.397+0000 7f4d2affd640 1 -- 172.21.15.79:0/4273016579 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c037070 con 0x7f4d2c151780 2024-04-25T02:10:16.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.397+0000 7f4d2affd640 1 -- 172.21.15.79:0/4273016579 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d1c032440 con 0x7f4d2c151780 2024-04-25T02:10:16.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.397+0000 7f4d2affd640 1 -- 172.21.15.79:0/4273016579 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c032810 con 0x7f4d2c151780 2024-04-25T02:10:16.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.397+0000 7f4d3262a640 1 -- 172.21.15.79:0/4273016579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d2c151780 msgr2=0x7f4d2c15b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.397+0000 7f4d3262a640 1 --2- 172.21.15.79:0/4273016579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d2c151780 0x7f4d2c15b720 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0097a0 tx=0x7f4d1c02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:10:16.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.397+0000 7f4d3262a640 1 -- 172.21.15.79:0/4273016579 shutdown_connections 2024-04-25T02:10:16.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.397+0000 7f4d3262a640 1 --2- 172.21.15.79:0/4273016579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d2c151780 0x7f4d2c15b720 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:16.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.397+0000 7f4d3262a640 1 -- 172.21.15.79:0/4273016579 >> 172.21.15.79:0/4273016579 conn(0x7f4d2c06b4a0 msgr2=0x7f4d2c06b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:16.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.397+0000 7f4d3262a640 1 -- 172.21.15.79:0/4273016579 shutdown_connections 2024-04-25T02:10:16.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.397+0000 7f4d3262a640 1 -- 172.21.15.79:0/4273016579 wait complete. 2024-04-25T02:10:16.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.399+0000 7f4d3262a640 1 Processor -- start 2024-04-25T02:10:16.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.399+0000 7f4d3262a640 1 -- start start 2024-04-25T02:10:16.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.399+0000 7f4d3262a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4d2c06e290 0x7f4d2c140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:16.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.399+0000 7f4d3262a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d2c0b4e10 0x7f4d2c14d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:16.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.399+0000 7f4d3262a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d2c151780 0x7f4d2c14db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:16.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.399+0000 7f4d3262a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c0b3920 con 0x7f4d2c151780 2024-04-25T02:10:16.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.399+0000 7f4d3262a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c0b3640 con 0x7f4d2c0b4e10 2024-04-25T02:10:16.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.399+0000 7f4d3262a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4d2c151b60 con 0x7f4d2c06e290 2024-04-25T02:10:16.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d30bc7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d2c151780 0x7f4d2c14db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:16.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d30bc7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d2c151780 0x7f4d2c14db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45568/0 (socket says 172.21.15.79:45568) 2024-04-25T02:10:16.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d30bc7640 1 -- 172.21.15.79:0/1354581997 learned_addr learned my addr 172.21.15.79:0/1354581997 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:16.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d2b7fe640 1 --2- 172.21.15.79:0/1354581997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d2c0b4e10 0x7f4d2c14d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:16.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d2bfff640 1 --2- 172.21.15.79:0/1354581997 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4d2c06e290 0x7f4d2c140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:16.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d30bc7640 1 -- 172.21.15.79:0/1354581997 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4d2c06e290 msgr2=0x7f4d2c140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d30bc7640 1 --2- 172.21.15.79:0/1354581997 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4d2c06e290 0x7f4d2c140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:16.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d30bc7640 1 -- 172.21.15.79:0/1354581997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d2c0b4e10 msgr2=0x7f4d2c14d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d30bc7640 1 --2- 172.21.15.79:0/1354581997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d2c0b4e10 0x7f4d2c14d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:16.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d30bc7640 1 -- 172.21.15.79:0/1354581997 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2c155400 con 0x7f4d2c151780 2024-04-25T02:10:16.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d2b7fe640 1 --2- 172.21.15.79:0/1354581997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d2c0b4e10 0x7f4d2c14d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:16.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d30bc7640 1 --2- 172.21.15.79:0/1354581997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d2c151780 0x7f4d2c14db90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400c7d0 tx=0x7f4d2400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:16.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d28ff9640 1 -- 172.21.15.79:0/1354581997 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24018070 con 0x7f4d2c151780 2024-04-25T02:10:16.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d28ff9640 1 -- 172.21.15.79:0/1354581997 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d2400a640 con 0x7f4d2c151780 2024-04-25T02:10:16.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d3262a640 1 -- 172.21.15.79:0/1354581997 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d2c1556e0 con 0x7f4d2c151780 2024-04-25T02:10:16.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d28ff9640 1 -- 172.21.15.79:0/1354581997 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2400aa70 con 0x7f4d2c151780 2024-04-25T02:10:16.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.400+0000 7f4d3262a640 1 -- 172.21.15.79:0/1354581997 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d2c157b10 con 0x7f4d2c151780 2024-04-25T02:10:16.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.401+0000 7f4d3262a640 1 -- 172.21.15.79:0/1354581997 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d2c0690a0 con 0x7f4d2c151780 2024-04-25T02:10:16.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.402+0000 7f4d28ff9640 1 -- 172.21.15.79:0/1354581997 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d2401b070 con 0x7f4d2c151780 2024-04-25T02:10:16.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.402+0000 7f4d28ff9640 1 --2- 172.21.15.79:0/1354581997 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d1806be30 0x7f4d1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:16.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.402+0000 7f4d2bfff640 1 --2- 172.21.15.79:0/1354581997 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d1806be30 0x7f4d1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:16.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.402+0000 7f4d28ff9640 1 -- 172.21.15.79:0/1354581997 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f4d2408a530 con 0x7f4d2c151780 2024-04-25T02:10:16.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.402+0000 7f4d2bfff640 1 --2- 172.21.15.79:0/1354581997 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d1806be30 0x7f4d1806e2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c034000 tx=0x7f4d1c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:16.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.406+0000 7f4d28ff9640 1 -- 172.21.15.79:0/1354581997 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4d24058e40 con 0x7f4d2c151780 2024-04-25T02:10:16.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:16.579+0000 7f4d3262a640 1 -- 172.21.15.79:0/1354581997 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4d2c0b46e0 con 0x7f4d2c151780 2024-04-25T02:10:17.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.277+0000 7f4d28ff9640 1 -- 172.21.15.79:0/1354581997 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) ==== 181+0+0 (secure 0 0 0) 0x7f4d24058740 con 0x7f4d2c151780 2024-04-25T02:10:17.286 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-04-25T02:10:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.281+0000 7f4d3262a640 1 -- 172.21.15.79:0/1354581997 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d1806be30 msgr2=0x7f4d1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.281+0000 7f4d3262a640 1 --2- 172.21.15.79:0/1354581997 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d1806be30 0x7f4d1806e2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c034000 tx=0x7f4d1c02e000 comp rx=0 tx=0).stop 2024-04-25T02:10:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.281+0000 7f4d3262a640 1 -- 172.21.15.79:0/1354581997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d2c151780 msgr2=0x7f4d2c14db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.281+0000 7f4d3262a640 1 --2- 172.21.15.79:0/1354581997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d2c151780 0x7f4d2c14db90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400c7d0 tx=0x7f4d2400cc90 comp rx=0 tx=0).stop 2024-04-25T02:10:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.281+0000 7f4d3262a640 1 -- 172.21.15.79:0/1354581997 shutdown_connections 2024-04-25T02:10:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.281+0000 7f4d3262a640 1 --2- 172.21.15.79:0/1354581997 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d1806be30 0x7f4d1806e2f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.281+0000 7f4d3262a640 1 --2- 172.21.15.79:0/1354581997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d2c151780 0x7f4d2c14db90 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.281+0000 7f4d3262a640 1 --2- 172.21.15.79:0/1354581997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d2c0b4e10 0x7f4d2c14d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.281+0000 7f4d3262a640 1 --2- 172.21.15.79:0/1354581997 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4d2c06e290 0x7f4d2c140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.281+0000 7f4d3262a640 1 -- 172.21.15.79:0/1354581997 >> 172.21.15.79:0/1354581997 conn(0x7f4d2c06b4a0 msgr2=0x7f4d2c14e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.281+0000 7f4d3262a640 1 -- 172.21.15.79:0/1354581997 shutdown_connections 2024-04-25T02:10:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.281+0000 7f4d3262a640 1 -- 172.21.15.79:0/1354581997 wait complete. 2024-04-25T02:10:17.302 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T02:10:17.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.397+0000 7fe6bbcee640 1 Processor -- start 2024-04-25T02:10:17.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.397+0000 7fe6bbcee640 1 -- start start 2024-04-25T02:10:17.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.397+0000 7fe6bbcee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe6b406c3d0 0x7fe6b40d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:17.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.397+0000 7fe6bbcee640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6b40cf1a0 con 0x7fe6b40b3160 2024-04-25T02:10:17.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.397+0000 7fe6bbcee640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6b40b20c0 con 0x7fe6b406cbd0 2024-04-25T02:10:17.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.397+0000 7fe6bbcee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe6b40b2cd0 con 0x7fe6b406c3d0 2024-04-25T02:10:17.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.398+0000 7fe6b9289640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe6b406c3d0 0x7fe6b40d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:17.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.398+0000 7fe6ba28b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe6b40b3160 0x7fe6b40aeb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55604/0 (socket says 172.21.15.79:55604) 2024-04-25T02:10:17.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.398+0000 7fe6ba28b640 1 -- 172.21.15.79:0/2651588648 learned_addr learned my addr 172.21.15.79:0/2651588648 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:17.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.398+0000 7fe6b9289640 1 -- 172.21.15.79:0/2651588648 >> v1:172.21.15.189:6789/0 conn(0x7fe6b406cbd0 legacy=0x7fe6b406cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:17.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.398+0000 7fe6b9289640 1 -- 172.21.15.79:0/2651588648 >> v1:172.21.15.79:6789/0 conn(0x7fe6b40b3160 legacy=0x7fe6b40aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.398+0000 7fe6b8a88640 1 -- 172.21.15.79:0/2651588648 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564641817 0 0) 0x7fe6b40cf1a0 con 0x7fe6b40b3160 2024-04-25T02:10:17.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.398+0000 7fe6b9289640 1 -- 172.21.15.79:0/2651588648 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b40b23a0 con 0x7fe6b406c3d0 2024-04-25T02:10:17.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.398+0000 7fe6b9289640 1 --2- 172.21.15.79:0/2651588648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b406c3d0 0x7fe6b40d11c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40097a0 tx=0x7fe6a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a3a74c7feded3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:17.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.399+0000 7fe6b8a88640 1 -- 172.21.15.79:0/2651588648 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4037070 con 0x7fe6b406c3d0 2024-04-25T02:10:17.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.399+0000 7fe6b8a88640 1 -- 172.21.15.79:0/2651588648 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a4032440 con 0x7fe6b406c3d0 2024-04-25T02:10:17.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.399+0000 7fe6b8a88640 1 -- 172.21.15.79:0/2651588648 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4032810 con 0x7fe6b406c3d0 2024-04-25T02:10:17.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.399+0000 7fe6bbcee640 1 -- 172.21.15.79:0/2651588648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b406c3d0 msgr2=0x7fe6b40d11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.399+0000 7fe6bbcee640 1 --2- 172.21.15.79:0/2651588648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b406c3d0 0x7fe6b40d11c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40097a0 tx=0x7fe6a402a270 comp rx=0 tx=0).stop 2024-04-25T02:10:17.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.399+0000 7fe6bbcee640 1 -- 172.21.15.79:0/2651588648 shutdown_connections 2024-04-25T02:10:17.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.399+0000 7fe6bbcee640 1 --2- 172.21.15.79:0/2651588648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b406c3d0 0x7fe6b40d11c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:17.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.399+0000 7fe6bbcee640 1 -- 172.21.15.79:0/2651588648 >> 172.21.15.79:0/2651588648 conn(0x7fe6b40d1e10 msgr2=0x7fe6b40d2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:17.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.399+0000 7fe6bbcee640 1 -- 172.21.15.79:0/2651588648 shutdown_connections 2024-04-25T02:10:17.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.399+0000 7fe6bbcee640 1 -- 172.21.15.79:0/2651588648 wait complete. 2024-04-25T02:10:17.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.400+0000 7fe6bbcee640 1 Processor -- start 2024-04-25T02:10:17.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.400+0000 7fe6bbcee640 1 -- start start 2024-04-25T02:10:17.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.401+0000 7fe6bbcee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b406c3d0 0x7fe6b4157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:17.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.401+0000 7fe6bbcee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe6b406cbd0 0x7fe6b415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:17.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.401+0000 7fe6bbcee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6b40b3160 0x7fe6b415b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:17.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.401+0000 7fe6bbcee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b40b1d70 con 0x7fe6b406c3d0 2024-04-25T02:10:17.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.401+0000 7fe6bbcee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b40b2960 con 0x7fe6b40b3160 2024-04-25T02:10:17.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.401+0000 7fe6bbcee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b40b35f0 con 0x7fe6b406cbd0 2024-04-25T02:10:17.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.401+0000 7fe6b9a8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b406c3d0 0x7fe6b4157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:17.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.401+0000 7fe6b9a8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b406c3d0 0x7fe6b4157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45596/0 (socket says 172.21.15.79:45596) 2024-04-25T02:10:17.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.401+0000 7fe6b9a8a640 1 -- 172.21.15.79:0/931828776 learned_addr learned my addr 172.21.15.79:0/931828776 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:17.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.402+0000 7fe6b9289640 1 --2- 172.21.15.79:0/931828776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe6b406cbd0 0x7fe6b415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:17.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.402+0000 7fe6ba28b640 1 --2- 172.21.15.79:0/931828776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6b40b3160 0x7fe6b415b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:17.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.402+0000 7fe6b9a8a640 1 -- 172.21.15.79:0/931828776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe6b406cbd0 msgr2=0x7fe6b415a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.402+0000 7fe6b9a8a640 1 --2- 172.21.15.79:0/931828776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe6b406cbd0 0x7fe6b415a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:17.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.402+0000 7fe6b9a8a640 1 -- 172.21.15.79:0/931828776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6b40b3160 msgr2=0x7fe6b415b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.402+0000 7fe6b9a8a640 1 --2- 172.21.15.79:0/931828776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6b40b3160 0x7fe6b415b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:17.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.402+0000 7fe6b9a8a640 1 -- 172.21.15.79:0/931828776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b40c69a0 con 0x7fe6b406c3d0 2024-04-25T02:10:17.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.402+0000 7fe6ba28b640 1 --2- 172.21.15.79:0/931828776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6b40b3160 0x7fe6b415b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:17.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.402+0000 7fe6b9a8a640 1 --2- 172.21.15.79:0/931828776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b406c3d0 0x7fe6b4157e70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000c410 tx=0x7fe6b000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:17.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.402+0000 7fe6aa7fc640 1 -- 172.21.15.79:0/931828776 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0017070 con 0x7fe6b406c3d0 2024-04-25T02:10:17.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.402+0000 7fe6aa7fc640 1 -- 172.21.15.79:0/931828776 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b00035f0 con 0x7fe6b406c3d0 2024-04-25T02:10:17.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.402+0000 7fe6bbcee640 1 -- 172.21.15.79:0/931828776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b41597d0 con 0x7fe6b406c3d0 2024-04-25T02:10:17.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.402+0000 7fe6aa7fc640 1 -- 172.21.15.79:0/931828776 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00039e0 con 0x7fe6b406c3d0 2024-04-25T02:10:17.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.402+0000 7fe6bbcee640 1 -- 172.21.15.79:0/931828776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b4159d90 con 0x7fe6b406c3d0 2024-04-25T02:10:17.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.403+0000 7fe6bbcee640 1 -- 172.21.15.79:0/931828776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b40690a0 con 0x7fe6b406c3d0 2024-04-25T02:10:17.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.403+0000 7fe6aa7fc640 1 -- 172.21.15.79:0/931828776 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6b001a070 con 0x7fe6b406c3d0 2024-04-25T02:10:17.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.404+0000 7fe6aa7fc640 1 --2- 172.21.15.79:0/931828776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe69806be30 0x7fe69806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:17.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.404+0000 7fe6b9289640 1 --2- 172.21.15.79:0/931828776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe69806be30 0x7fe69806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:17.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.404+0000 7fe6aa7fc640 1 -- 172.21.15.79:0/931828776 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5415+0+0 (secure 0 0 0) 0x7fe6b008a210 con 0x7fe6b406c3d0 2024-04-25T02:10:17.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.404+0000 7fe6b9289640 1 --2- 172.21.15.79:0/931828776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe69806be30 0x7fe69806e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4034000 tx=0x7fe6a402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:17.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.409+0000 7fe6aa7fc640 1 -- 172.21.15.79:0/931828776 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe6b0058ce0 con 0x7fe6b406c3d0 2024-04-25T02:10:17.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:17.581+0000 7fe6bbcee640 1 -- 172.21.15.79:0/931828776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe6b40cf1a0 con 0x7fe6b406c3d0 2024-04-25T02:10:18.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.280+0000 7fe6aa7fc640 1 -- 172.21.15.79:0/931828776 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) ==== 169+0+0 (secure 0 0 0) 0x7fe6b00585e0 con 0x7fe6b406c3d0 2024-04-25T02:10:18.288 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-04-25T02:10:18.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.283+0000 7fe6bbcee640 1 -- 172.21.15.79:0/931828776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe69806be30 msgr2=0x7fe69806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.283+0000 7fe6bbcee640 1 --2- 172.21.15.79:0/931828776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe69806be30 0x7fe69806e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4034000 tx=0x7fe6a402e000 comp rx=0 tx=0).stop 2024-04-25T02:10:18.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.283+0000 7fe6bbcee640 1 -- 172.21.15.79:0/931828776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b406c3d0 msgr2=0x7fe6b4157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.283+0000 7fe6bbcee640 1 --2- 172.21.15.79:0/931828776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b406c3d0 0x7fe6b4157e70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000c410 tx=0x7fe6b000c8d0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.283+0000 7fe6bbcee640 1 -- 172.21.15.79:0/931828776 shutdown_connections 2024-04-25T02:10:18.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.283+0000 7fe6bbcee640 1 --2- 172.21.15.79:0/931828776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe69806be30 0x7fe69806e2f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.283+0000 7fe6bbcee640 1 --2- 172.21.15.79:0/931828776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6b40b3160 0x7fe6b415b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.283+0000 7fe6bbcee640 1 --2- 172.21.15.79:0/931828776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe6b406cbd0 0x7fe6b415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.283+0000 7fe6bbcee640 1 --2- 172.21.15.79:0/931828776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b406c3d0 0x7fe6b4157e70 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.283+0000 7fe6bbcee640 1 -- 172.21.15.79:0/931828776 >> 172.21.15.79:0/931828776 conn(0x7fe6b40d1e10 msgr2=0x7fe6b40b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:18.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.284+0000 7fe6bbcee640 1 -- 172.21.15.79:0/931828776 shutdown_connections 2024-04-25T02:10:18.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.284+0000 7fe6bbcee640 1 -- 172.21.15.79:0/931828776 wait complete. 2024-04-25T02:10:18.305 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T02:10:18.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.404+0000 7f0fbe809640 1 Processor -- start 2024-04-25T02:10:18.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.404+0000 7f0fbe809640 1 -- start start 2024-04-25T02:10:18.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.405+0000 7f0fbe809640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0fb806b560 0x7f0fb80ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:18.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.405+0000 7f0fbe809640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0fb806b940 0x7f0fb8166350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:18.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.405+0000 7f0fbe809640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fb80cc4e0 con 0x7f0fb8166890 2024-04-25T02:10:18.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.405+0000 7f0fbe809640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f0fb8167320 con 0x7f0fb806b940 2024-04-25T02:10:18.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.405+0000 7f0fbe809640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb8167040 con 0x7f0fb806b560 2024-04-25T02:10:18.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.405+0000 7f0fb77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0fb806b940 0x7f0fb8166350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:18.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.405+0000 7f0fbcda6640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0fb8166890 0x7f0fb8163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55608/0 (socket says 172.21.15.79:55608) 2024-04-25T02:10:18.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.405+0000 7f0fbcda6640 1 -- 172.21.15.79:0/3737786176 learned_addr learned my addr 172.21.15.79:0/3737786176 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:18.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.405+0000 7f0fb7fff640 1 --2- 172.21.15.79:0/3737786176 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0fb806b560 0x7f0fb80ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:18.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.405+0000 7f0fb77fe640 1 -- 172.21.15.79:0/3737786176 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0fb806b560 msgr2=0x7f0fb80ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.405+0000 7f0fb77fe640 1 --2- 172.21.15.79:0/3737786176 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0fb806b560 0x7f0fb80ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.405+0000 7f0fb77fe640 1 -- 172.21.15.79:0/3737786176 >> v1:172.21.15.79:6789/0 conn(0x7f0fb8166890 legacy=0x7f0fb8163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.405+0000 7f0fb77fe640 1 -- 172.21.15.79:0/3737786176 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb80cc780 con 0x7f0fb806b940 2024-04-25T02:10:18.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.406+0000 7f0fb77fe640 1 --2- 172.21.15.79:0/3737786176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb806b940 0x7f0fb8166350 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0097a0 tx=0x7f0fac02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90bab6e4e1926d32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.406+0000 7f0fb6ffd640 1 -- 172.21.15.79:0/3737786176 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac037070 con 0x7f0fb806b940 2024-04-25T02:10:18.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.406+0000 7f0fb6ffd640 1 -- 172.21.15.79:0/3737786176 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fac02ae50 con 0x7f0fb806b940 2024-04-25T02:10:18.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.406+0000 7f0fb6ffd640 1 -- 172.21.15.79:0/3737786176 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac032660 con 0x7f0fb806b940 2024-04-25T02:10:18.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.406+0000 7f0fbe809640 1 -- 172.21.15.79:0/3737786176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb806b940 msgr2=0x7f0fb8166350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.406+0000 7f0fbe809640 1 --2- 172.21.15.79:0/3737786176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb806b940 0x7f0fb8166350 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0097a0 tx=0x7f0fac02a100 comp rx=0 tx=0).stop 2024-04-25T02:10:18.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.406+0000 7f0fbe809640 1 -- 172.21.15.79:0/3737786176 shutdown_connections 2024-04-25T02:10:18.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.406+0000 7f0fbe809640 1 --2- 172.21.15.79:0/3737786176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb806b940 0x7f0fb8166350 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.406+0000 7f0fbe809640 1 --2- 172.21.15.79:0/3737786176 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0fb806b560 0x7f0fb80ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.406+0000 7f0fbe809640 1 -- 172.21.15.79:0/3737786176 >> 172.21.15.79:0/3737786176 conn(0x7f0fb80b1cd0 msgr2=0x7f0fb80b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:18.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.406+0000 7f0fbe809640 1 -- 172.21.15.79:0/3737786176 shutdown_connections 2024-04-25T02:10:18.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.407+0000 7f0fbe809640 1 -- 172.21.15.79:0/3737786176 wait complete. 2024-04-25T02:10:18.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.408+0000 7f0fbe809640 1 Processor -- start 2024-04-25T02:10:18.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.408+0000 7f0fbe809640 1 -- start start 2024-04-25T02:10:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.408+0000 7f0fbe809640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0fb806b560 0x7f0fb81510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.408+0000 7f0fbe809640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fb806b940 0x7f0fb8160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.408+0000 7f0fbe809640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb8166890 0x7f0fb80acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fbe809640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb8166cd0 con 0x7f0fb8166890 2024-04-25T02:10:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fbe809640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb80cd4c0 con 0x7f0fb806b940 2024-04-25T02:10:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fbe809640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb8163930 con 0x7f0fb806b560 2024-04-25T02:10:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fbcda6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb8166890 0x7f0fb80acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fbcda6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb8166890 0x7f0fb80acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45628/0 (socket says 172.21.15.79:45628) 2024-04-25T02:10:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fbcda6640 1 -- 172.21.15.79:0/3175143351 learned_addr learned my addr 172.21.15.79:0/3175143351 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fb7fff640 1 --2- 172.21.15.79:0/3175143351 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0fb806b560 0x7f0fb81510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fbcda6640 1 -- 172.21.15.79:0/3175143351 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0fb806b560 msgr2=0x7f0fb81510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fbcda6640 1 --2- 172.21.15.79:0/3175143351 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0fb806b560 0x7f0fb81510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fb77fe640 1 --2- 172.21.15.79:0/3175143351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fb806b940 0x7f0fb8160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fbcda6640 1 -- 172.21.15.79:0/3175143351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fb806b940 msgr2=0x7f0fb8160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fbcda6640 1 --2- 172.21.15.79:0/3175143351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fb806b940 0x7f0fb8160600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fbcda6640 1 -- 172.21.15.79:0/3175143351 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb80ad2e0 con 0x7f0fb8166890 2024-04-25T02:10:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fbcda6640 1 --2- 172.21.15.79:0/3175143351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb8166890 0x7f0fb80acda0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0002230 tx=0x7f0fb000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fb4ff9640 1 -- 172.21.15.79:0/3175143351 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0017070 con 0x7f0fb8166890 2024-04-25T02:10:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fb4ff9640 1 -- 172.21.15.79:0/3175143351 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb000abd0 con 0x7f0fb8166890 2024-04-25T02:10:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fb4ff9640 1 -- 172.21.15.79:0/3175143351 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0012400 con 0x7f0fb8166890 2024-04-25T02:10:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fbe809640 1 -- 172.21.15.79:0/3175143351 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb80ad560 con 0x7f0fb8166890 2024-04-25T02:10:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.409+0000 7f0fbe809640 1 -- 172.21.15.79:0/3175143351 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb80adb20 con 0x7f0fb8166890 2024-04-25T02:10:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.410+0000 7f0fbe809640 1 -- 172.21.15.79:0/3175143351 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb80690a0 con 0x7f0fb8166890 2024-04-25T02:10:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.411+0000 7f0fb4ff9640 1 -- 172.21.15.79:0/3175143351 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0fb001a070 con 0x7f0fb8166890 2024-04-25T02:10:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.411+0000 7f0fb4ff9640 1 --2- 172.21.15.79:0/3175143351 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0fa406be60 0x7f0fa406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.411+0000 7f0fb4ff9640 1 -- 172.21.15.79:0/3175143351 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f0fb008a770 con 0x7f0fb8166890 2024-04-25T02:10:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.411+0000 7f0fb7fff640 1 --2- 172.21.15.79:0/3175143351 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0fa406be60 0x7f0fa406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:18.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.412+0000 7f0fb7fff640 1 --2- 172.21.15.79:0/3175143351 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0fa406be60 0x7f0fa406e320 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8006fd0 tx=0x7f0fa8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.415+0000 7f0fb4ff9640 1 -- 172.21.15.79:0/3175143351 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0fb80ad2e0 con 0x7f0fb8166890 2024-04-25T02:10:18.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.590+0000 7f0fbe809640 1 -- 172.21.15.79:0/3175143351 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f0fb80af5a0 con 0x7f0fb8166890 2024-04-25T02:10:18.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.593+0000 7f0fb4ff9640 1 -- 172.21.15.79:0/3175143351 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f0fb00594b0 con 0x7f0fb8166890 2024-04-25T02:10:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.595+0000 7f0fbe809640 1 -- 172.21.15.79:0/3175143351 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0fa406be60 msgr2=0x7f0fa406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.595+0000 7f0fbe809640 1 --2- 172.21.15.79:0/3175143351 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0fa406be60 0x7f0fa406e320 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8006fd0 tx=0x7f0fa8008040 comp rx=0 tx=0).stop 2024-04-25T02:10:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.595+0000 7f0fbe809640 1 -- 172.21.15.79:0/3175143351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb8166890 msgr2=0x7f0fb80acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.595+0000 7f0fbe809640 1 --2- 172.21.15.79:0/3175143351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb8166890 0x7f0fb80acda0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0002230 tx=0x7f0fb000cf00 comp rx=0 tx=0).stop 2024-04-25T02:10:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.595+0000 7f0fbe809640 1 -- 172.21.15.79:0/3175143351 shutdown_connections 2024-04-25T02:10:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.595+0000 7f0fbe809640 1 --2- 172.21.15.79:0/3175143351 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0fa406be60 0x7f0fa406e320 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.595+0000 7f0fbe809640 1 --2- 172.21.15.79:0/3175143351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb8166890 0x7f0fb80acda0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.595+0000 7f0fbe809640 1 --2- 172.21.15.79:0/3175143351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fb806b940 0x7f0fb8160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.595+0000 7f0fbe809640 1 --2- 172.21.15.79:0/3175143351 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0fb806b560 0x7f0fb81510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.595+0000 7f0fbe809640 1 -- 172.21.15.79:0/3175143351 >> 172.21.15.79:0/3175143351 conn(0x7f0fb80b1cd0 msgr2=0x7f0fb80b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:18.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.595+0000 7f0fbe809640 1 -- 172.21.15.79:0/3175143351 shutdown_connections 2024-04-25T02:10:18.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.595+0000 7f0fbe809640 1 -- 172.21.15.79:0/3175143351 wait complete. 2024-04-25T02:10:18.613 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-25T02:10:18.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.703+0000 7f40cd638640 1 Processor -- start 2024-04-25T02:10:18.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.703+0000 7f40cd638640 1 -- start start 2024-04-25T02:10:18.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.704+0000 7f40cd638640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40c815c8d0 0x7f40c815dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:18.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.704+0000 7f40cd638640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40c815a040 con 0x7f40c806c010 2024-04-25T02:10:18.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.704+0000 7f40cd638640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40c806b250 con 0x7f40c8066ea0 2024-04-25T02:10:18.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.704+0000 7f40cd638640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f40c8072930 con 0x7f40c815c8d0 2024-04-25T02:10:18.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.704+0000 7f40c77fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f40c806c010 0x7f40c806c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55622/0 (socket says 172.21.15.79:55622) 2024-04-25T02:10:18.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.704+0000 7f40c77fe640 1 -- 172.21.15.79:0/1837677374 learned_addr learned my addr 172.21.15.79:0/1837677374 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:18.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.704+0000 7f40c6ffd640 1 --2- 172.21.15.79:0/1837677374 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40c815c8d0 0x7f40c815dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:18.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.704+0000 7f40c5ffb640 1 -- 172.21.15.79:0/1837677374 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3016397618 0 0) 0x7f40c815a040 con 0x7f40c806c010 2024-04-25T02:10:18.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.704+0000 7f40c5ffb640 1 -- 172.21.15.79:0/1837677374 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40b0003520 con 0x7f40c806c010 2024-04-25T02:10:18.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.704+0000 7f40c5ffb640 1 -- 172.21.15.79:0/1837677374 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3720219979 0 0) 0x7f40b0003520 con 0x7f40c806c010 2024-04-25T02:10:18.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.704+0000 7f40c5ffb640 1 -- 172.21.15.79:0/1837677374 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40c815c8d0 msgr2=0x7f40c815dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.704+0000 7f40c5ffb640 1 --2- 172.21.15.79:0/1837677374 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40c815c8d0 0x7f40c815dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.704+0000 7f40c5ffb640 1 -- 172.21.15.79:0/1837677374 >> v1:172.21.15.189:6789/0 conn(0x7f40c8066ea0 legacy=0x7f40c815ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.704+0000 7f40c5ffb640 1 -- 172.21.15.79:0/1837677374 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c806b530 con 0x7f40c806c010 2024-04-25T02:10:18.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c5ffb640 1 -- 172.21.15.79:0/1837677374 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f40c0001670 con 0x7f40c806c010 2024-04-25T02:10:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c5ffb640 1 -- 172.21.15.79:0/1837677374 >> v1:172.21.15.79:6789/0 conn(0x7f40c806c010 legacy=0x7f40c806c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c5ffb640 1 --2- 172.21.15.79:0/1837677374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40b00039e0 0x7f40b0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c5ffb640 1 --2- 172.21.15.79:0/1837677374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b0004390 0x7f40b0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c5ffb640 1 --2- 172.21.15.79:0/1837677374 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40c815c8d0 0x7f40b00050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c5ffb640 1 -- 172.21.15.79:0/1837677374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f40b000b9c0 con 0x7f40b0004390 2024-04-25T02:10:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c5ffb640 1 -- 172.21.15.79:0/1837677374 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f40b000bb40 con 0x7f40b00039e0 2024-04-25T02:10:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c5ffb640 1 -- 172.21.15.79:0/1837677374 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f40b000bd40 con 0x7f40c815c8d0 2024-04-25T02:10:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c67fc640 1 --2- 172.21.15.79:0/1837677374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b0004390 0x7f40b0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c6ffd640 1 --2- 172.21.15.79:0/1837677374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40b00039e0 0x7f40b0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c77fe640 1 --2- 172.21.15.79:0/1837677374 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40c815c8d0 0x7f40b00050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c67fc640 1 -- 172.21.15.79:0/1837677374 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40c815c8d0 msgr2=0x7f40b00050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c67fc640 1 --2- 172.21.15.79:0/1837677374 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40c815c8d0 0x7f40b00050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c67fc640 1 -- 172.21.15.79:0/1837677374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40b00039e0 msgr2=0x7f40b0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c67fc640 1 --2- 172.21.15.79:0/1837677374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40b00039e0 0x7f40b0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c67fc640 1 -- 172.21.15.79:0/1837677374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b0003520 con 0x7f40b0004390 2024-04-25T02:10:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c77fe640 1 --2- 172.21.15.79:0/1837677374 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40c815c8d0 0x7f40b00050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.705+0000 7f40c6ffd640 1 --2- 172.21.15.79:0/1837677374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40b00039e0 0x7f40b0003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.706+0000 7f40c67fc640 1 --2- 172.21.15.79:0/1837677374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b0004390 0x7f40b0004860 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f40bc001830 tx=0x7f40b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2d35047134fd28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.706+0000 7f40c5ffb640 1 -- 172.21.15.79:0/1837677374 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc037070 con 0x7f40b0004390 2024-04-25T02:10:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.706+0000 7f40c5ffb640 1 -- 172.21.15.79:0/1837677374 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40bc02abe0 con 0x7f40b0004390 2024-04-25T02:10:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.706+0000 7f40c5ffb640 1 -- 172.21.15.79:0/1837677374 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc001430 con 0x7f40b0004390 2024-04-25T02:10:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.706+0000 7f40cd638640 1 -- 172.21.15.79:0/1837677374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b0004390 msgr2=0x7f40b0004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.706+0000 7f40cd638640 1 --2- 172.21.15.79:0/1837677374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b0004390 0x7f40b0004860 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f40bc001830 tx=0x7f40b0005830 comp rx=0 tx=0).stop 2024-04-25T02:10:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.706+0000 7f40c77fe640 1 -- 172.21.15.79:0/1837677374 reap_dead start 2024-04-25T02:10:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.706+0000 7f40cd638640 1 -- 172.21.15.79:0/1837677374 shutdown_connections 2024-04-25T02:10:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.706+0000 7f40cd638640 1 -- 172.21.15.79:0/1837677374 >> 172.21.15.79:0/1837677374 conn(0x7f40c80ccee0 msgr2=0x7f40c80cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.706+0000 7f40cd638640 1 -- 172.21.15.79:0/1837677374 shutdown_connections 2024-04-25T02:10:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.706+0000 7f40cd638640 1 -- 172.21.15.79:0/1837677374 wait complete. 2024-04-25T02:10:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.708+0000 7f40cd638640 1 Processor -- start 2024-04-25T02:10:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.708+0000 7f40cd638640 1 -- start start 2024-04-25T02:10:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.708+0000 7f40cd638640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b0004390 0x7f40c81459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.708+0000 7f40cd638640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40c81f3860 0x7f40c81ecd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.708+0000 7f40cd638640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40c806e060 0x7f40c806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.708+0000 7f40cd638640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f40c815d3c0 con 0x7f40b0004390 2024-04-25T02:10:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.708+0000 7f40cd638640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f40c806baf0 con 0x7f40c81f3860 2024-04-25T02:10:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.708+0000 7f40cd638640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f40c80caab0 con 0x7f40c806e060 2024-04-25T02:10:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.708+0000 7f40c6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b0004390 0x7f40c81459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.708+0000 7f40c6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b0004390 0x7f40c81459b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45642/0 (socket says 172.21.15.79:45642) 2024-04-25T02:10:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.708+0000 7f40c6ffd640 1 -- 172.21.15.79:0/1488889223 learned_addr learned my addr 172.21.15.79:0/1488889223 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.709+0000 7f40c6ffd640 1 -- 172.21.15.79:0/1488889223 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40c806e060 msgr2=0x7f40c806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.709+0000 7f40c6ffd640 1 --2- 172.21.15.79:0/1488889223 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40c806e060 0x7f40c806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.709+0000 7f40c6ffd640 1 -- 172.21.15.79:0/1488889223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40c81f3860 msgr2=0x7f40c81ecd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.709+0000 7f40c67fc640 1 --2- 172.21.15.79:0/1488889223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40c81f3860 0x7f40c81ecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.709+0000 7f40c6ffd640 1 --2- 172.21.15.79:0/1488889223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40c81f3860 0x7f40c81ecd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.709+0000 7f40c6ffd640 1 -- 172.21.15.79:0/1488889223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c81ed270 con 0x7f40b0004390 2024-04-25T02:10:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.709+0000 7f40c6ffd640 1 --2- 172.21.15.79:0/1488889223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b0004390 0x7f40c81459b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f40b8007950 tx=0x7f40b8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.709+0000 7f40af7fe640 1 -- 172.21.15.79:0/1488889223 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b8023020 con 0x7f40b0004390 2024-04-25T02:10:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.709+0000 7f40af7fe640 1 -- 172.21.15.79:0/1488889223 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b8003990 con 0x7f40b0004390 2024-04-25T02:10:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.709+0000 7f40cd638640 1 -- 172.21.15.79:0/1488889223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c8148920 con 0x7f40b0004390 2024-04-25T02:10:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.709+0000 7f40af7fe640 1 -- 172.21.15.79:0/1488889223 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b8003da0 con 0x7f40b0004390 2024-04-25T02:10:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.709+0000 7f40cd638640 1 -- 172.21.15.79:0/1488889223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c8148080 con 0x7f40b0004390 2024-04-25T02:10:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.710+0000 7f40cd638640 1 -- 172.21.15.79:0/1488889223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c80690a0 con 0x7f40b0004390 2024-04-25T02:10:18.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.710+0000 7f40af7fe640 1 -- 172.21.15.79:0/1488889223 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40b800b860 con 0x7f40b0004390 2024-04-25T02:10:18.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.711+0000 7f40af7fe640 1 --2- 172.21.15.79:0/1488889223 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40b406be30 0x7f40b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:18.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.711+0000 7f40af7fe640 1 -- 172.21.15.79:0/1488889223 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f40b8093720 con 0x7f40b0004390 2024-04-25T02:10:18.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.711+0000 7f40c67fc640 1 --2- 172.21.15.79:0/1488889223 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40b406be30 0x7f40b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:18.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.711+0000 7f40c67fc640 1 --2- 172.21.15.79:0/1488889223 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40b406be30 0x7f40b406e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f40bc001830 tx=0x7f40bc009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.715+0000 7f40af7fe640 1 -- 172.21.15.79:0/1488889223 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f40b802d020 con 0x7f40b0004390 2024-04-25T02:10:18.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:18.955+0000 7f40cd638640 1 -- 172.21.15.79:0/1488889223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7f40c815bab0 con 0x7f40b0004390 2024-04-25T02:10:19.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.286+0000 7f40af7fe640 1 -- 172.21.15.79:0/1488889223 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v141) ==== 149+0+0 (secure 0 0 0) 0x7f40b801d2f0 con 0x7f40b0004390 2024-04-25T02:10:19.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.288+0000 7f40cd638640 1 -- 172.21.15.79:0/1488889223 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40b406be30 msgr2=0x7f40b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.288+0000 7f40cd638640 1 --2- 172.21.15.79:0/1488889223 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40b406be30 0x7f40b406e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f40bc001830 tx=0x7f40bc009030 comp rx=0 tx=0).stop 2024-04-25T02:10:19.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.288+0000 7f40cd638640 1 -- 172.21.15.79:0/1488889223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b0004390 msgr2=0x7f40c81459b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.288+0000 7f40cd638640 1 --2- 172.21.15.79:0/1488889223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b0004390 0x7f40c81459b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f40b8007950 tx=0x7f40b8007e10 comp rx=0 tx=0).stop 2024-04-25T02:10:19.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.288+0000 7f40cd638640 1 -- 172.21.15.79:0/1488889223 shutdown_connections 2024-04-25T02:10:19.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.288+0000 7f40cd638640 1 --2- 172.21.15.79:0/1488889223 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f40b406be30 0x7f40b406e2f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.288+0000 7f40cd638640 1 --2- 172.21.15.79:0/1488889223 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40c806e060 0x7f40c806e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.288+0000 7f40cd638640 1 --2- 172.21.15.79:0/1488889223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40c81f3860 0x7f40c81ecd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.288+0000 7f40cd638640 1 --2- 172.21.15.79:0/1488889223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b0004390 0x7f40c81459b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.288+0000 7f40cd638640 1 -- 172.21.15.79:0/1488889223 >> 172.21.15.79:0/1488889223 conn(0x7f40c80ccee0 msgr2=0x7f40c81592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:19.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.288+0000 7f40cd638640 1 -- 172.21.15.79:0/1488889223 shutdown_connections 2024-04-25T02:10:19.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.288+0000 7f40cd638640 1 -- 172.21.15.79:0/1488889223 wait complete. 2024-04-25T02:10:19.307 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2024-04-25T02:10:19.307 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T02:10:19.307 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T02:10:19.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:19.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.397+0000 7f45a7b5a640 1 Processor -- start 2024-04-25T02:10:19.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.397+0000 7f45a7b5a640 1 -- start start 2024-04-25T02:10:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a7b5a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45a0144cb0 0x7f45a00b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a7b5a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f45a00b5580 0x7f45a006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a7b5a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f45a006e490 0x7f45a015fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a7b5a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f45a006e900 con 0x7f45a00b5580 2024-04-25T02:10:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a7b5a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f45a0070d90 con 0x7f45a006e490 2024-04-25T02:10:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a7b5a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f45a00cf130 con 0x7f45a0144cb0 2024-04-25T02:10:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a50f5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f45a00b5580 0x7f45a006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a50f5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f45a00b5580 0x7f45a006df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45652/0 (socket says 172.21.15.79:45652) 2024-04-25T02:10:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a50f5640 1 -- 172.21.15.79:0/1180838965 learned_addr learned my addr 172.21.15.79:0/1180838965 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a50f5640 1 -- 172.21.15.79:0/1180838965 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45a0144cb0 msgr2=0x7f45a00b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a60f7640 1 --2- 172.21.15.79:0/1180838965 >> v2:172.21.15.189:3300/0 conn(0x7f45a006e490 0x7f45a015fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a58f6640 1 --2- 172.21.15.79:0/1180838965 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45a0144cb0 0x7f45a00b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a50f5640 1 --2- 172.21.15.79:0/1180838965 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45a0144cb0 0x7f45a00b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a50f5640 1 -- 172.21.15.79:0/1180838965 >> v2:172.21.15.189:3300/0 conn(0x7f45a006e490 msgr2=0x7f45a015fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a50f5640 1 --2- 172.21.15.79:0/1180838965 >> v2:172.21.15.189:3300/0 conn(0x7f45a006e490 0x7f45a015fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a50f5640 1 -- 172.21.15.79:0/1180838965 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a00cf410 con 0x7f45a00b5580 2024-04-25T02:10:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.398+0000 7f45a58f6640 1 --2- 172.21.15.79:0/1180838965 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45a0144cb0 0x7f45a00b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.399+0000 7f45a50f5640 1 --2- 172.21.15.79:0/1180838965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a00b5580 0x7f45a006df50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f45a0070c80 tx=0x7f459002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6811f6e146883308 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.399+0000 7f45a48f4640 1 -- 172.21.15.79:0/1180838965 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4590037070 con 0x7f45a00b5580 2024-04-25T02:10:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.399+0000 7f45a48f4640 1 -- 172.21.15.79:0/1180838965 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459002ae00 con 0x7f45a00b5580 2024-04-25T02:10:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.399+0000 7f45a48f4640 1 -- 172.21.15.79:0/1180838965 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4590032660 con 0x7f45a00b5580 2024-04-25T02:10:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.399+0000 7f45a7b5a640 1 -- 172.21.15.79:0/1180838965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a00b5580 msgr2=0x7f45a006df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.399+0000 7f45a7b5a640 1 --2- 172.21.15.79:0/1180838965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a00b5580 0x7f45a006df50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f45a0070c80 tx=0x7f459002a0b0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.399+0000 7f45a7b5a640 1 -- 172.21.15.79:0/1180838965 shutdown_connections 2024-04-25T02:10:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.399+0000 7f45a7b5a640 1 --2- 172.21.15.79:0/1180838965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a00b5580 0x7f45a006df50 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.399+0000 7f45a7b5a640 1 --2- 172.21.15.79:0/1180838965 >> v2:172.21.15.189:3300/0 conn(0x7f45a006e490 0x7f45a015fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.399+0000 7f45a7b5a640 1 --2- 172.21.15.79:0/1180838965 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45a0144cb0 0x7f45a00b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.400+0000 7f45a7b5a640 1 -- 172.21.15.79:0/1180838965 >> 172.21.15.79:0/1180838965 conn(0x7f45a00cfc80 msgr2=0x7f45a00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.400+0000 7f45a7b5a640 1 -- 172.21.15.79:0/1180838965 shutdown_connections 2024-04-25T02:10:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.400+0000 7f45a7b5a640 1 -- 172.21.15.79:0/1180838965 wait complete. 2024-04-25T02:10:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.401+0000 7f45a7b5a640 1 Processor -- start 2024-04-25T02:10:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.401+0000 7f45a7b5a640 1 -- start start 2024-04-25T02:10:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.401+0000 7f45a7b5a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45a006e490 0x7f45a01f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.401+0000 7f45a7b5a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a00b5580 0x7f45a013fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.401+0000 7f45a7b5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a0144cb0 0x7f45a015b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.401+0000 7f45a7b5a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f45a0145090 con 0x7f45a0144cb0 2024-04-25T02:10:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.401+0000 7f45a7b5a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f45a00cf9d0 con 0x7f45a00b5580 2024-04-25T02:10:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.401+0000 7f45a7b5a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f45a0145ab0 con 0x7f45a006e490 2024-04-25T02:10:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.401+0000 7f45a60f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a0144cb0 0x7f45a015b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.401+0000 7f45a60f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a0144cb0 0x7f45a015b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45664/0 (socket says 172.21.15.79:45664) 2024-04-25T02:10:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.402+0000 7f45a60f7640 1 -- 172.21.15.79:0/3980724396 learned_addr learned my addr 172.21.15.79:0/3980724396 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.402+0000 7f45a60f7640 1 -- 172.21.15.79:0/3980724396 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45a006e490 msgr2=0x7f45a01f2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.402+0000 7f45a60f7640 1 --2- 172.21.15.79:0/3980724396 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45a006e490 0x7f45a01f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.402+0000 7f45a60f7640 1 -- 172.21.15.79:0/3980724396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a00b5580 msgr2=0x7f45a013fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.402+0000 7f45a60f7640 1 --2- 172.21.15.79:0/3980724396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a00b5580 0x7f45a013fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.402+0000 7f45a60f7640 1 -- 172.21.15.79:0/3980724396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a00a9800 con 0x7f45a0144cb0 2024-04-25T02:10:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.402+0000 7f45a60f7640 1 --2- 172.21.15.79:0/3980724396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a0144cb0 0x7f45a015b330 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f459800ccf0 tx=0x7f459800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.402+0000 7f45967fc640 1 -- 172.21.15.79:0/3980724396 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598003b90 con 0x7f45a0144cb0 2024-04-25T02:10:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.402+0000 7f45967fc640 1 -- 172.21.15.79:0/3980724396 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4598003d30 con 0x7f45a0144cb0 2024-04-25T02:10:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.402+0000 7f45967fc640 1 -- 172.21.15.79:0/3980724396 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598004240 con 0x7f45a0144cb0 2024-04-25T02:10:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.402+0000 7f45a7b5a640 1 -- 172.21.15.79:0/3980724396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a01f2ab0 con 0x7f45a0144cb0 2024-04-25T02:10:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.402+0000 7f45a7b5a640 1 -- 172.21.15.79:0/3980724396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a013f3e0 con 0x7f45a0144cb0 2024-04-25T02:10:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.403+0000 7f45a7b5a640 1 -- 172.21.15.79:0/3980724396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a00af150 con 0x7f45a0144cb0 2024-04-25T02:10:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.403+0000 7f45967fc640 1 -- 172.21.15.79:0/3980724396 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f45980043e0 con 0x7f45a0144cb0 2024-04-25T02:10:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.404+0000 7f45967fc640 1 --2- 172.21.15.79:0/3980724396 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f458406be60 0x7f458406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.404+0000 7f45967fc640 1 -- 172.21.15.79:0/3980724396 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f459808b530 con 0x7f45a0144cb0 2024-04-25T02:10:19.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.404+0000 7f45a58f6640 1 --2- 172.21.15.79:0/3980724396 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f458406be60 0x7f458406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.404+0000 7f45a58f6640 1 --2- 172.21.15.79:0/3980724396 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f458406be60 0x7f458406e320 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f459c006fd0 tx=0x7f459c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:19.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.408+0000 7f45967fc640 1 -- 172.21.15.79:0/3980724396 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f45a00af150 con 0x7f45a0144cb0 2024-04-25T02:10:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.581+0000 7f45a7b5a640 1 -- 172.21.15.79:0/3980724396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45a00d0b90 con 0x7f45a0144cb0 2024-04-25T02:10:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.582+0000 7f45967fc640 1 -- 172.21.15.79:0/3980724396 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+13034 (secure 0 0 0) 0x7f45a01f2ab0 con 0x7f45a0144cb0 2024-04-25T02:10:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:19.590 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":50,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:10:18.279712+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.189:6833/1295756642":"2024-04-26T02:10:15.274852+0000","172.21.15.189:6832/1295756642":"2024-04-26T02:10:15.274852+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.584+0000 7f45a7b5a640 1 -- 172.21.15.79:0/3980724396 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f458406be60 msgr2=0x7f458406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.584+0000 7f45a7b5a640 1 --2- 172.21.15.79:0/3980724396 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f458406be60 0x7f458406e320 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f459c006fd0 tx=0x7f459c008040 comp rx=0 tx=0).stop 2024-04-25T02:10:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.584+0000 7f45a7b5a640 1 -- 172.21.15.79:0/3980724396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a0144cb0 msgr2=0x7f45a015b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.584+0000 7f45a7b5a640 1 --2- 172.21.15.79:0/3980724396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a0144cb0 0x7f45a015b330 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f459800ccf0 tx=0x7f459800a660 comp rx=0 tx=0).stop 2024-04-25T02:10:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.584+0000 7f45a7b5a640 1 -- 172.21.15.79:0/3980724396 shutdown_connections 2024-04-25T02:10:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.584+0000 7f45a7b5a640 1 --2- 172.21.15.79:0/3980724396 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f458406be60 0x7f458406e320 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.584+0000 7f45a7b5a640 1 --2- 172.21.15.79:0/3980724396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a0144cb0 0x7f45a015b330 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.584+0000 7f45a7b5a640 1 --2- 172.21.15.79:0/3980724396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a00b5580 0x7f45a013fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.584+0000 7f45a7b5a640 1 --2- 172.21.15.79:0/3980724396 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45a006e490 0x7f45a01f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.584+0000 7f45a7b5a640 1 -- 172.21.15.79:0/3980724396 >> 172.21.15.79:0/3980724396 conn(0x7f45a00cfc80 msgr2=0x7f45a0141450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.584+0000 7f45a7b5a640 1 -- 172.21.15.79:0/3980724396 shutdown_connections 2024-04-25T02:10:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.584+0000 7f45a7b5a640 1 -- 172.21.15.79:0/3980724396 wait complete. 2024-04-25T02:10:19.602 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:10:19.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:10:19.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.694+0000 7fdc9a24d640 1 Processor -- start 2024-04-25T02:10:19.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.694+0000 7fdc9a24d640 1 -- start start 2024-04-25T02:10:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.695+0000 7fdc9a24d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fdc940b41b0 0x7fdc941605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.695+0000 7fdc9a24d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc9406b2f0 0x7fdc9406b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.695+0000 7fdc9a24d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc94071cd0 con 0x7fdc94155f00 2024-04-25T02:10:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.695+0000 7fdc9a24d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fdc94071fb0 con 0x7fdc9406b2f0 2024-04-25T02:10:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.695+0000 7fdc9a24d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fdc94072290 con 0x7fdc940b41b0 2024-04-25T02:10:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.695+0000 7fdc92ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc9406b2f0 0x7fdc9406b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.695+0000 7fdc93fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdc94155f00 0x7fdc94156310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55628/0 (socket says 172.21.15.79:55628) 2024-04-25T02:10:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.695+0000 7fdc93fff640 1 -- 172.21.15.79:0/2851749803 learned_addr learned my addr 172.21.15.79:0/2851749803 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.695+0000 7fdc937fe640 1 --2- 172.21.15.79:0/2851749803 >> v2:172.21.15.189:3300/0 conn(0x7fdc940b41b0 0x7fdc941605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.695+0000 7fdc92ffd640 1 -- 172.21.15.79:0/2851749803 >> v2:172.21.15.189:3300/0 conn(0x7fdc940b41b0 msgr2=0x7fdc941605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.695+0000 7fdc92ffd640 1 --2- 172.21.15.79:0/2851749803 >> v2:172.21.15.189:3300/0 conn(0x7fdc940b41b0 0x7fdc941605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.695+0000 7fdc92ffd640 1 -- 172.21.15.79:0/2851749803 >> v1:172.21.15.79:6789/0 conn(0x7fdc94155f00 legacy=0x7fdc94156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.695+0000 7fdc92ffd640 1 -- 172.21.15.79:0/2851749803 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc94072570 con 0x7fdc9406b2f0 2024-04-25T02:10:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.696+0000 7fdc92ffd640 1 --2- 172.21.15.79:0/2851749803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc9406b2f0 0x7fdc9406b770 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdc940cdfb0 tx=0x7fdc8802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50fd387d7d1be673 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.696+0000 7fdc927fc640 1 -- 172.21.15.79:0/2851749803 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc88037070 con 0x7fdc9406b2f0 2024-04-25T02:10:19.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.696+0000 7fdc927fc640 1 -- 172.21.15.79:0/2851749803 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc88032440 con 0x7fdc9406b2f0 2024-04-25T02:10:19.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.696+0000 7fdc927fc640 1 -- 172.21.15.79:0/2851749803 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc88032810 con 0x7fdc9406b2f0 2024-04-25T02:10:19.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.697+0000 7fdc9a24d640 1 -- 172.21.15.79:0/2851749803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc9406b2f0 msgr2=0x7fdc9406b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.697+0000 7fdc9a24d640 1 --2- 172.21.15.79:0/2851749803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc9406b2f0 0x7fdc9406b770 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdc940cdfb0 tx=0x7fdc8802a1a0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.697+0000 7fdc9a24d640 1 -- 172.21.15.79:0/2851749803 shutdown_connections 2024-04-25T02:10:19.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.697+0000 7fdc9a24d640 1 --2- 172.21.15.79:0/2851749803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc9406b2f0 0x7fdc9406b770 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.697+0000 7fdc9a24d640 1 --2- 172.21.15.79:0/2851749803 >> v2:172.21.15.189:3300/0 conn(0x7fdc940b41b0 0x7fdc941605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.697+0000 7fdc9a24d640 1 -- 172.21.15.79:0/2851749803 >> 172.21.15.79:0/2851749803 conn(0x7fdc940b1cd0 msgr2=0x7fdc940b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:19.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.697+0000 7fdc9a24d640 1 -- 172.21.15.79:0/2851749803 shutdown_connections 2024-04-25T02:10:19.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.697+0000 7fdc9a24d640 1 -- 172.21.15.79:0/2851749803 wait complete. 2024-04-25T02:10:19.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.698+0000 7fdc9a24d640 1 Processor -- start 2024-04-25T02:10:19.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.698+0000 7fdc9a24d640 1 -- start start 2024-04-25T02:10:19.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc9a24d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc9406b2f0 0x7fdc94156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc9a24d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc940b41b0 0x7fdc9414fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc9a24d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94155f00 0x7fdc9415ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc9a24d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9415c870 con 0x7fdc94155f00 2024-04-25T02:10:19.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc9a24d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdc94072d70 con 0x7fdc940b41b0 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc9a24d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdc94156a20 con 0x7fdc9406b2f0 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc93fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94155f00 0x7fdc9415ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc93fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94155f00 0x7fdc9415ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45678/0 (socket says 172.21.15.79:45678) 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc93fff640 1 -- 172.21.15.79:0/2585439006 learned_addr learned my addr 172.21.15.79:0/2585439006 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc937fe640 1 --2- 172.21.15.79:0/2585439006 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc9406b2f0 0x7fdc94156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc92ffd640 1 --2- 172.21.15.79:0/2585439006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc940b41b0 0x7fdc9414fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc93fff640 1 -- 172.21.15.79:0/2585439006 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc9406b2f0 msgr2=0x7fdc94156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc93fff640 1 --2- 172.21.15.79:0/2585439006 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc9406b2f0 0x7fdc94156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc93fff640 1 -- 172.21.15.79:0/2585439006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc940b41b0 msgr2=0x7fdc9414fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc93fff640 1 --2- 172.21.15.79:0/2585439006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc940b41b0 0x7fdc9414fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc93fff640 1 -- 172.21.15.79:0/2585439006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc941501f0 con 0x7fdc94155f00 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc93fff640 1 --2- 172.21.15.79:0/2585439006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94155f00 0x7fdc9415ff40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00ca20 tx=0x7fdc8c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.699+0000 7fdc7bfff640 1 -- 172.21.15.79:0/2585439006 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c017070 con 0x7fdc94155f00 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.700+0000 7fdc7bfff640 1 -- 172.21.15.79:0/2585439006 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8c00abd0 con 0x7fdc94155f00 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.700+0000 7fdc7bfff640 1 -- 172.21.15.79:0/2585439006 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c012400 con 0x7fdc94155f00 2024-04-25T02:10:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.700+0000 7fdc9a24d640 1 -- 172.21.15.79:0/2585439006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc941f3a80 con 0x7fdc94155f00 2024-04-25T02:10:19.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.700+0000 7fdc9a24d640 1 -- 172.21.15.79:0/2585439006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc941f4040 con 0x7fdc94155f00 2024-04-25T02:10:19.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.700+0000 7fdc9a24d640 1 -- 172.21.15.79:0/2585439006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc940ce010 con 0x7fdc94155f00 2024-04-25T02:10:19.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.701+0000 7fdc7bfff640 1 -- 172.21.15.79:0/2585439006 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc8c01a070 con 0x7fdc94155f00 2024-04-25T02:10:19.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.701+0000 7fdc7bfff640 1 --2- 172.21.15.79:0/2585439006 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc8006be30 0x7fdc8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.701+0000 7fdc7bfff640 1 -- 172.21.15.79:0/2585439006 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fdc8c08a7e0 con 0x7fdc94155f00 2024-04-25T02:10:19.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.702+0000 7fdc937fe640 1 --2- 172.21.15.79:0/2585439006 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc8006be30 0x7fdc8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.702+0000 7fdc937fe640 1 --2- 172.21.15.79:0/2585439006 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc8006be30 0x7fdc8006e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400a970 tx=0x7fdc84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:19.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.706+0000 7fdc7bfff640 1 -- 172.21.15.79:0/2585439006 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdc940ce010 con 0x7fdc94155f00 2024-04-25T02:10:19.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.876+0000 7fdc9a24d640 1 -- 172.21.15.79:0/2585439006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdc940690a0 con 0x7fdc94155f00 2024-04-25T02:10:19.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.876+0000 7fdc7bfff640 1 -- 172.21.15.79:0/2585439006 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) ==== 93+0+10 (secure 0 0 0) 0x7fdc941501f0 con 0x7fdc94155f00 2024-04-25T02:10:19.884 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:10:19.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.878+0000 7fdc9a24d640 1 -- 172.21.15.79:0/2585439006 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc8006be30 msgr2=0x7fdc8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.878+0000 7fdc9a24d640 1 --2- 172.21.15.79:0/2585439006 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc8006be30 0x7fdc8006e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400a970 tx=0x7fdc84008040 comp rx=0 tx=0).stop 2024-04-25T02:10:19.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.878+0000 7fdc9a24d640 1 -- 172.21.15.79:0/2585439006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94155f00 msgr2=0x7fdc9415ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.878+0000 7fdc9a24d640 1 --2- 172.21.15.79:0/2585439006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94155f00 0x7fdc9415ff40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00ca20 tx=0x7fdc8c00cee0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.878+0000 7fdc9a24d640 1 -- 172.21.15.79:0/2585439006 shutdown_connections 2024-04-25T02:10:19.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.878+0000 7fdc9a24d640 1 --2- 172.21.15.79:0/2585439006 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc8006be30 0x7fdc8006e2f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.878+0000 7fdc9a24d640 1 --2- 172.21.15.79:0/2585439006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94155f00 0x7fdc9415ff40 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.878+0000 7fdc9a24d640 1 --2- 172.21.15.79:0/2585439006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc940b41b0 0x7fdc9414fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.878+0000 7fdc9a24d640 1 --2- 172.21.15.79:0/2585439006 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc9406b2f0 0x7fdc94156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.878+0000 7fdc9a24d640 1 -- 172.21.15.79:0/2585439006 >> 172.21.15.79:0/2585439006 conn(0x7fdc940b1cd0 msgr2=0x7fdc940b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:19.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.878+0000 7fdc9a24d640 1 -- 172.21.15.79:0/2585439006 shutdown_connections 2024-04-25T02:10:19.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.878+0000 7fdc9a24d640 1 -- 172.21.15.79:0/2585439006 wait complete. 2024-04-25T02:10:19.897 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-25T02:10:19.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.986+0000 7f6c13f9e640 1 Processor -- start 2024-04-25T02:10:19.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.986+0000 7f6c13f9e640 1 -- start start 2024-04-25T02:10:19.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.987+0000 7f6c13f9e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c0c143bc0 0x7f6c0c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.987+0000 7f6c13f9e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6c0c0b3d40 0x7f6c0c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.987+0000 7f6c13f9e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c0c15fa40 con 0x7f6c0c06df50 2024-04-25T02:10:19.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.987+0000 7f6c13f9e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6c0c06e8f0 con 0x7f6c0c143bc0 2024-04-25T02:10:19.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.987+0000 7f6c13f9e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6c0c072cb0 con 0x7f6c0c0b3d40 2024-04-25T02:10:19.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.987+0000 7f6c11d3a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c0c143bc0 0x7f6c0c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.987+0000 7f6c11539640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6c0c06df50 0x7f6c0c0b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55636/0 (socket says 172.21.15.79:55636) 2024-04-25T02:10:19.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.987+0000 7f6c11539640 1 -- 172.21.15.79:0/1295955739 learned_addr learned my addr 172.21.15.79:0/1295955739 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:19.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.988+0000 7f6c1253b640 1 --2- 172.21.15.79:0/1295955739 >> v2:172.21.15.189:3300/0 conn(0x7f6c0c0b3d40 0x7f6c0c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.988+0000 7f6c11d3a640 1 -- 172.21.15.79:0/1295955739 >> v2:172.21.15.189:3300/0 conn(0x7f6c0c0b3d40 msgr2=0x7f6c0c06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:19.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.988+0000 7f6c11d3a640 1 --2- 172.21.15.79:0/1295955739 >> v2:172.21.15.189:3300/0 conn(0x7f6c0c0b3d40 0x7f6c0c06e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.988+0000 7f6c11d3a640 1 -- 172.21.15.79:0/1295955739 >> v1:172.21.15.79:6789/0 conn(0x7f6c0c06df50 legacy=0x7f6c0c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.988+0000 7f6c10d38640 1 -- 172.21.15.79:0/1295955739 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1047699641 0 0) 0x7f6bfc001110 con 0x7f6c0c06df50 2024-04-25T02:10:19.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.988+0000 7f6c11d3a640 1 -- 172.21.15.79:0/1295955739 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0c071e00 con 0x7f6c0c143bc0 2024-04-25T02:10:19.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.988+0000 7f6c11d3a640 1 --2- 172.21.15.79:0/1295955739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c0c143bc0 0x7f6c0c15f500 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c144cd0 tx=0x7f6c0802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a5db556130eebb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.988+0000 7f6c10d38640 1 -- 172.21.15.79:0/1295955739 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08007740 con 0x7f6c0c143bc0 2024-04-25T02:10:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.988+0000 7f6c10d38640 1 -- 172.21.15.79:0/1295955739 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c080078e0 con 0x7f6c0c143bc0 2024-04-25T02:10:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.988+0000 7f6c10d38640 1 -- 172.21.15.79:0/1295955739 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08007cb0 con 0x7f6c0c143bc0 2024-04-25T02:10:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.989+0000 7f6c13f9e640 1 -- 172.21.15.79:0/1295955739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c0c143bc0 msgr2=0x7f6c0c15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.989+0000 7f6c13f9e640 1 --2- 172.21.15.79:0/1295955739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c0c143bc0 0x7f6c0c15f500 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c144cd0 tx=0x7f6c0802a5f0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.989+0000 7f6c13f9e640 1 -- 172.21.15.79:0/1295955739 shutdown_connections 2024-04-25T02:10:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.989+0000 7f6c13f9e640 1 --2- 172.21.15.79:0/1295955739 >> v2:172.21.15.189:3300/0 conn(0x7f6c0c0b3d40 0x7f6c0c06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.989+0000 7f6c13f9e640 1 --2- 172.21.15.79:0/1295955739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c0c143bc0 0x7f6c0c15f500 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.989+0000 7f6c13f9e640 1 -- 172.21.15.79:0/1295955739 >> 172.21.15.79:0/1295955739 conn(0x7f6c0c0cfc80 msgr2=0x7f6c0c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.989+0000 7f6c13f9e640 1 -- 172.21.15.79:0/1295955739 shutdown_connections 2024-04-25T02:10:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.989+0000 7f6c13f9e640 1 -- 172.21.15.79:0/1295955739 wait complete. 2024-04-25T02:10:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.990+0000 7f6c13f9e640 1 Processor -- start 2024-04-25T02:10:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.990+0000 7f6c13f9e640 1 -- start start 2024-04-25T02:10:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c13f9e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c0c06df50 0x7f6c0c159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c13f9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c0c0b3d40 0x7f6c0c0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c13f9e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c0c143bc0 0x7f6c0c0abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c13f9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c072660 con 0x7f6c0c0b3d40 2024-04-25T02:10:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c13f9e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c072380 con 0x7f6c0c143bc0 2024-04-25T02:10:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c13f9e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6c0c072940 con 0x7f6c0c06df50 2024-04-25T02:10:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c11539640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c0c0b3d40 0x7f6c0c0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c11539640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c0c0b3d40 0x7f6c0c0aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45700/0 (socket says 172.21.15.79:45700) 2024-04-25T02:10:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c11539640 1 -- 172.21.15.79:0/1739336634 learned_addr learned my addr 172.21.15.79:0/1739336634 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c11d3a640 1 --2- 172.21.15.79:0/1739336634 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c0c06df50 0x7f6c0c159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c1253b640 1 --2- 172.21.15.79:0/1739336634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c0c143bc0 0x7f6c0c0abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c11539640 1 -- 172.21.15.79:0/1739336634 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c0c06df50 msgr2=0x7f6c0c159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c11539640 1 --2- 172.21.15.79:0/1739336634 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c0c06df50 0x7f6c0c159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c11539640 1 -- 172.21.15.79:0/1739336634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c0c143bc0 msgr2=0x7f6c0c0abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c11539640 1 --2- 172.21.15.79:0/1739336634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c0c143bc0 0x7f6c0c0abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c11539640 1 -- 172.21.15.79:0/1739336634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0c0aded0 con 0x7f6c0c0b3d40 2024-04-25T02:10:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.991+0000 7f6c11539640 1 --2- 172.21.15.79:0/1739336634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c0c0b3d40 0x7f6c0c0aec90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00c420 tx=0x7f6bfc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.992+0000 7f6c027fc640 1 -- 172.21.15.79:0/1739336634 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc0074e0 con 0x7f6c0c0b3d40 2024-04-25T02:10:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.992+0000 7f6c027fc640 1 -- 172.21.15.79:0/1739336634 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bfc0047e0 con 0x7f6c0c0b3d40 2024-04-25T02:10:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.992+0000 7f6c13f9e640 1 -- 172.21.15.79:0/1739336634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c0c0ae1b0 con 0x7f6c0c0b3d40 2024-04-25T02:10:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.992+0000 7f6c027fc640 1 -- 172.21.15.79:0/1739336634 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc004c10 con 0x7f6c0c0b3d40 2024-04-25T02:10:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.992+0000 7f6c13f9e640 1 -- 172.21.15.79:0/1739336634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c0c0adb80 con 0x7f6c0c0b3d40 2024-04-25T02:10:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.993+0000 7f6c13f9e640 1 -- 172.21.15.79:0/1739336634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c0c0690a0 con 0x7f6c0c0b3d40 2024-04-25T02:10:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.993+0000 7f6c027fc640 1 -- 172.21.15.79:0/1739336634 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6bfc011070 con 0x7f6c0c0b3d40 2024-04-25T02:10:20.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.993+0000 7f6c027fc640 1 --2- 172.21.15.79:0/1739336634 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bf006be30 0x7f6bf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.994+0000 7f6c027fc640 1 -- 172.21.15.79:0/1739336634 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f6bfc08a860 con 0x7f6c0c0b3d40 2024-04-25T02:10:20.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.994+0000 7f6c11d3a640 1 --2- 172.21.15.79:0/1739336634 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bf006be30 0x7f6bf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.994+0000 7f6c11d3a640 1 --2- 172.21.15.79:0/1739336634 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bf006be30 0x7f6bf006e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6c08034000 tx=0x7f6c0802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:20.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:19.998+0000 7f6c027fc640 1 -- 172.21.15.79:0/1739336634 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6c0c15fa40 con 0x7f6c0c0b3d40 2024-04-25T02:10:20.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.239+0000 7f6c13f9e640 1 -- 172.21.15.79:0/1739336634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) -- 0x7f6c0c144120 con 0x7f6c0c0b3d40 2024-04-25T02:10:20.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.288+0000 7f6c027fc640 1 -- 172.21.15.79:0/1739336634 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v142) ==== 172+0+0 (secure 0 0 0) 0x7f6bfc00e280 con 0x7f6c0c0b3d40 2024-04-25T02:10:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.290+0000 7f6c13f9e640 1 -- 172.21.15.79:0/1739336634 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bf006be30 msgr2=0x7f6bf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.290+0000 7f6c13f9e640 1 --2- 172.21.15.79:0/1739336634 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bf006be30 0x7f6bf006e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6c08034000 tx=0x7f6c0802f000 comp rx=0 tx=0).stop 2024-04-25T02:10:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.290+0000 7f6c13f9e640 1 -- 172.21.15.79:0/1739336634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c0c0b3d40 msgr2=0x7f6c0c0aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.290+0000 7f6c13f9e640 1 --2- 172.21.15.79:0/1739336634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c0c0b3d40 0x7f6c0c0aec90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00c420 tx=0x7f6bfc00c8e0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.290+0000 7f6c13f9e640 1 -- 172.21.15.79:0/1739336634 shutdown_connections 2024-04-25T02:10:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.290+0000 7f6c13f9e640 1 --2- 172.21.15.79:0/1739336634 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6bf006be30 0x7f6bf006e2f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.290+0000 7f6c13f9e640 1 --2- 172.21.15.79:0/1739336634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c0c143bc0 0x7f6c0c0abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.290+0000 7f6c13f9e640 1 --2- 172.21.15.79:0/1739336634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c0c0b3d40 0x7f6c0c0aec90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.290+0000 7f6c13f9e640 1 --2- 172.21.15.79:0/1739336634 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c0c06df50 0x7f6c0c159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.290+0000 7f6c13f9e640 1 -- 172.21.15.79:0/1739336634 >> 172.21.15.79:0/1739336634 conn(0x7f6c0c0cfc80 msgr2=0x7f6c0c15f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.290+0000 7f6c13f9e640 1 -- 172.21.15.79:0/1739336634 shutdown_connections 2024-04-25T02:10:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.290+0000 7f6c13f9e640 1 -- 172.21.15.79:0/1739336634 wait complete. 2024-04-25T02:10:20.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T02:10:20.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.398+0000 7f91683c1640 1 Processor -- start 2024-04-25T02:10:20.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.398+0000 7f91683c1640 1 -- start start 2024-04-25T02:10:20.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.399+0000 7f91683c1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91600cf7a0 0x7f91600b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.399+0000 7f91683c1640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f916006e6b0 0x7f916015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.399+0000 7f91683c1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f916015ec20 con 0x7f916006b2f0 2024-04-25T02:10:20.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.399+0000 7f91683c1640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f916015f830 con 0x7f916006e6b0 2024-04-25T02:10:20.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.399+0000 7f91683c1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f916015ef00 con 0x7f91600cf7a0 2024-04-25T02:10:20.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.399+0000 7f916615d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f916006b2f0 0x7f916006b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55646/0 (socket says 172.21.15.79:55646) 2024-04-25T02:10:20.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916615d640 1 -- 172.21.15.79:0/2968212571 learned_addr learned my addr 172.21.15.79:0/2968212571 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:20.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916695e640 1 --2- 172.21.15.79:0/2968212571 >> v2:172.21.15.189:3300/0 conn(0x7f916006e6b0 0x7f916015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916595c640 1 --2- 172.21.15.79:0/2968212571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91600cf7a0 0x7f91600b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 -- 172.21.15.79:0/2968212571 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1407957895 0 0) 0x7f916015ec20 con 0x7f916006b2f0 2024-04-25T02:10:20.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 -- 172.21.15.79:0/2968212571 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9148003520 con 0x7f916006b2f0 2024-04-25T02:10:20.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 -- 172.21.15.79:0/2968212571 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 357216969 0 0) 0x7f9148003520 con 0x7f916006b2f0 2024-04-25T02:10:20.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 -- 172.21.15.79:0/2968212571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91600cf7a0 msgr2=0x7f91600b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:20.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 --2- 172.21.15.79:0/2968212571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91600cf7a0 0x7f91600b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 -- 172.21.15.79:0/2968212571 >> v2:172.21.15.189:3300/0 conn(0x7f916006e6b0 msgr2=0x7f916015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 --2- 172.21.15.79:0/2968212571 >> v2:172.21.15.189:3300/0 conn(0x7f916006e6b0 0x7f916015b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 -- 172.21.15.79:0/2968212571 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916015f1e0 con 0x7f916006b2f0 2024-04-25T02:10:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 -- 172.21.15.79:0/2968212571 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f9158001670 con 0x7f916006b2f0 2024-04-25T02:10:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 -- 172.21.15.79:0/2968212571 >> v1:172.21.15.79:6789/0 conn(0x7f916006b2f0 legacy=0x7f916006b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 --2- 172.21.15.79:0/2968212571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91480039b0 0x7f9148003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 --2- 172.21.15.79:0/2968212571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9148004800 0x7f9148004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 --2- 172.21.15.79:0/2968212571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91600cf7a0 0x7f91480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 -- 172.21.15.79:0/2968212571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f916015f830 con 0x7f9148004800 2024-04-25T02:10:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 -- 172.21.15.79:0/2968212571 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f916015ef00 con 0x7f91480039b0 2024-04-25T02:10:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916515b640 1 -- 172.21.15.79:0/2968212571 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f914800b9c0 con 0x7f91600cf7a0 2024-04-25T02:10:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916595c640 1 --2- 172.21.15.79:0/2968212571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9148004800 0x7f9148004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916615d640 1 --2- 172.21.15.79:0/2968212571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91480039b0 0x7f9148003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.400+0000 7f916695e640 1 --2- 172.21.15.79:0/2968212571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91600cf7a0 0x7f91480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.401+0000 7f916595c640 1 -- 172.21.15.79:0/2968212571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91600cf7a0 msgr2=0x7f91480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:20.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.401+0000 7f916595c640 1 --2- 172.21.15.79:0/2968212571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91600cf7a0 0x7f91480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.401+0000 7f916595c640 1 -- 172.21.15.79:0/2968212571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91480039b0 msgr2=0x7f9148003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:20.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.401+0000 7f916595c640 1 --2- 172.21.15.79:0/2968212571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91480039b0 0x7f9148003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.401+0000 7f916595c640 1 -- 172.21.15.79:0/2968212571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9148003520 con 0x7f9148004800 2024-04-25T02:10:20.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.401+0000 7f916595c640 1 --2- 172.21.15.79:0/2968212571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9148004800 0x7f9148004c80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9154009af0 tx=0x7f9148005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f501d95144c15383 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:20.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.401+0000 7f916515b640 1 -- 172.21.15.79:0/2968212571 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154036070 con 0x7f9148004800 2024-04-25T02:10:20.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.401+0000 7f916515b640 1 -- 172.21.15.79:0/2968212571 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9154031400 con 0x7f9148004800 2024-04-25T02:10:20.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.401+0000 7f916515b640 1 -- 172.21.15.79:0/2968212571 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154009690 con 0x7f9148004800 2024-04-25T02:10:20.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.402+0000 7f91683c1640 1 -- 172.21.15.79:0/2968212571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9148004800 msgr2=0x7f9148004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.402+0000 7f91683c1640 1 --2- 172.21.15.79:0/2968212571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9148004800 0x7f9148004c80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9154009af0 tx=0x7f9148005830 comp rx=0 tx=0).stop 2024-04-25T02:10:20.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.402+0000 7f916695e640 1 -- 172.21.15.79:0/2968212571 reap_dead start 2024-04-25T02:10:20.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.402+0000 7f91683c1640 1 -- 172.21.15.79:0/2968212571 shutdown_connections 2024-04-25T02:10:20.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.402+0000 7f91683c1640 1 -- 172.21.15.79:0/2968212571 >> 172.21.15.79:0/2968212571 conn(0x7f91600b1cd0 msgr2=0x7f91600b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:20.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.402+0000 7f91683c1640 1 -- 172.21.15.79:0/2968212571 shutdown_connections 2024-04-25T02:10:20.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.402+0000 7f91683c1640 1 -- 172.21.15.79:0/2968212571 wait complete. 2024-04-25T02:10:20.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.403+0000 7f91683c1640 1 Processor -- start 2024-04-25T02:10:20.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.403+0000 7f91683c1640 1 -- start start 2024-04-25T02:10:20.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.404+0000 7f91683c1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9148004800 0x7f9160155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.404+0000 7f91683c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9160157de0 0x7f91600addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.404+0000 7f91683c1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91601565d0 0x7f91600ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.404+0000 7f91683c1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f916006d160 con 0x7f9160157de0 2024-04-25T02:10:20.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.404+0000 7f91683c1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f916006cfe0 con 0x7f9148004800 2024-04-25T02:10:20.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.404+0000 7f91683c1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f91600b4b50 con 0x7f91601565d0 2024-04-25T02:10:20.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.404+0000 7f916595c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9160157de0 0x7f91600addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.404+0000 7f916595c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9160157de0 0x7f91600addf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45724/0 (socket says 172.21.15.79:45724) 2024-04-25T02:10:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.404+0000 7f916595c640 1 -- 172.21.15.79:0/3312691729 learned_addr learned my addr 172.21.15.79:0/3312691729 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.404+0000 7f916595c640 1 -- 172.21.15.79:0/3312691729 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91601565d0 msgr2=0x7f91600ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.404+0000 7f916595c640 1 --2- 172.21.15.79:0/3312691729 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91601565d0 0x7f91600ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.404+0000 7f916595c640 1 -- 172.21.15.79:0/3312691729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9148004800 msgr2=0x7f9160155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.404+0000 7f916615d640 1 --2- 172.21.15.79:0/3312691729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9148004800 0x7f9160155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.404+0000 7f916595c640 1 --2- 172.21.15.79:0/3312691729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9148004800 0x7f9160155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.404+0000 7f916595c640 1 -- 172.21.15.79:0/3312691729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9160158350 con 0x7f9160157de0 2024-04-25T02:10:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.405+0000 7f916595c640 1 --2- 172.21.15.79:0/3312691729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9160157de0 0x7f91600addf0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9154034040 tx=0x7f9154004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.405+0000 7f915effd640 1 -- 172.21.15.79:0/3312691729 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154040020 con 0x7f9160157de0 2024-04-25T02:10:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.405+0000 7f915effd640 1 -- 172.21.15.79:0/3312691729 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9154003ac0 con 0x7f9160157de0 2024-04-25T02:10:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.405+0000 7f91683c1640 1 -- 172.21.15.79:0/3312691729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f916009bd60 con 0x7f9160157de0 2024-04-25T02:10:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.405+0000 7f915effd640 1 -- 172.21.15.79:0/3312691729 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154036040 con 0x7f9160157de0 2024-04-25T02:10:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.405+0000 7f91683c1640 1 -- 172.21.15.79:0/3312691729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f916009c320 con 0x7f9160157de0 2024-04-25T02:10:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.406+0000 7f91683c1640 1 -- 172.21.15.79:0/3312691729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91600690a0 con 0x7f9160157de0 2024-04-25T02:10:20.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.406+0000 7f915effd640 1 -- 172.21.15.79:0/3312691729 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9154043020 con 0x7f9160157de0 2024-04-25T02:10:20.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.406+0000 7f915effd640 1 --2- 172.21.15.79:0/3312691729 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f914c06be60 0x7f914c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.406+0000 7f915effd640 1 -- 172.21.15.79:0/3312691729 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f91540aaba0 con 0x7f9160157de0 2024-04-25T02:10:20.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.406+0000 7f916615d640 1 --2- 172.21.15.79:0/3312691729 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f914c06be60 0x7f914c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.407+0000 7f916615d640 1 --2- 172.21.15.79:0/3312691729 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f914c06be60 0x7f914c06e320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9160157280 tx=0x7f9158009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:20.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.411+0000 7f915effd640 1 -- 172.21.15.79:0/3312691729 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f915404a070 con 0x7f9160157de0 2024-04-25T02:10:20.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.582+0000 7f91683c1640 1 -- 172.21.15.79:0/3312691729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f91600cf4f0 con 0x7f9160157de0 2024-04-25T02:10:20.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.585+0000 7f915effd640 1 -- 172.21.15.79:0/3312691729 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f91540044e0 con 0x7f9160157de0 2024-04-25T02:10:20.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.588+0000 7f91683c1640 1 -- 172.21.15.79:0/3312691729 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f914c06be60 msgr2=0x7f914c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.588+0000 7f91683c1640 1 --2- 172.21.15.79:0/3312691729 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f914c06be60 0x7f914c06e320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9160157280 tx=0x7f9158009040 comp rx=0 tx=0).stop 2024-04-25T02:10:20.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.588+0000 7f91683c1640 1 -- 172.21.15.79:0/3312691729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9160157de0 msgr2=0x7f91600addf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.588+0000 7f91683c1640 1 --2- 172.21.15.79:0/3312691729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9160157de0 0x7f91600addf0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9154034040 tx=0x7f9154004730 comp rx=0 tx=0).stop 2024-04-25T02:10:20.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.588+0000 7f91683c1640 1 -- 172.21.15.79:0/3312691729 shutdown_connections 2024-04-25T02:10:20.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.588+0000 7f91683c1640 1 --2- 172.21.15.79:0/3312691729 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f914c06be60 0x7f914c06e320 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.588+0000 7f91683c1640 1 --2- 172.21.15.79:0/3312691729 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91601565d0 0x7f91600ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.588+0000 7f91683c1640 1 --2- 172.21.15.79:0/3312691729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9160157de0 0x7f91600addf0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.588+0000 7f91683c1640 1 --2- 172.21.15.79:0/3312691729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9148004800 0x7f9160155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.588+0000 7f91683c1640 1 -- 172.21.15.79:0/3312691729 >> 172.21.15.79:0/3312691729 conn(0x7f91600b1cd0 msgr2=0x7f91600b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:20.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.588+0000 7f91683c1640 1 -- 172.21.15.79:0/3312691729 shutdown_connections 2024-04-25T02:10:20.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.588+0000 7f91683c1640 1 -- 172.21.15.79:0/3312691729 wait complete. 2024-04-25T02:10:20.606 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:10:20.607 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:10:20.646 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:10:20.695 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:10:20.695 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:10:20.695 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:10:20.710 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:10:20.710 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:10:20.710 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:10:20.728 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:10:20.729 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:10:20.729 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:10:20.765 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:10:20.765 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:10:20.765 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:10:20.785 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:10:20.785 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T02:10:20.785 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:10:20.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.894+0000 7fe3d9521640 1 Processor -- start 2024-04-25T02:10:20.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.894+0000 7fe3d9521640 1 -- start start 2024-04-25T02:10:20.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.895+0000 7fe3d9521640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe3d40ce020 0x7fe3d406cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.895+0000 7fe3d9521640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe3d406c3d0 0x7fe3d406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.895+0000 7fe3d9521640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3d40d0390 con 0x7fe3d40d2940 2024-04-25T02:10:20.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.895+0000 7fe3d9521640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d40d0fa0 con 0x7fe3d406c3d0 2024-04-25T02:10:20.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.895+0000 7fe3d9521640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d40cd480 con 0x7fe3d40ce020 2024-04-25T02:10:20.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.895+0000 7fe3d37fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe3d406c3d0 0x7fe3d406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.895+0000 7fe3d37fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe3d406c3d0 0x7fe3d406d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45730/0 (socket says 172.21.15.79:45730) 2024-04-25T02:10:20.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.895+0000 7fe3d37fe640 1 -- 172.21.15.79:0/3526488227 learned_addr learned my addr 172.21.15.79:0/3526488227 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.895+0000 7fe3d27fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe3d40d2940 0x7fe3d415da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55658/0 (socket says 172.21.15.79:55658) 2024-04-25T02:10:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.896+0000 7fe3d2ffd640 1 --2- 172.21.15.79:0/3526488227 >> v2:172.21.15.189:3300/0 conn(0x7fe3d40ce020 0x7fe3d406cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.896+0000 7fe3d37fe640 1 -- 172.21.15.79:0/3526488227 >> v2:172.21.15.189:3300/0 conn(0x7fe3d40ce020 msgr2=0x7fe3d406cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.896+0000 7fe3d37fe640 1 --2- 172.21.15.79:0/3526488227 >> v2:172.21.15.189:3300/0 conn(0x7fe3d40ce020 0x7fe3d406cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.896+0000 7fe3d37fe640 1 -- 172.21.15.79:0/3526488227 >> v1:172.21.15.79:6789/0 conn(0x7fe3d40d2940 legacy=0x7fe3d415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.896+0000 7fe3d1ffb640 1 -- 172.21.15.79:0/3526488227 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458240703 0 0) 0x7fe3d40d0390 con 0x7fe3d40d2940 2024-04-25T02:10:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.896+0000 7fe3d37fe640 1 -- 172.21.15.79:0/3526488227 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d40d0670 con 0x7fe3d406c3d0 2024-04-25T02:10:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.896+0000 7fe3d37fe640 1 --2- 172.21.15.79:0/3526488227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d406c3d0 0x7fe3d406d110 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40719f0 tx=0x7fe3cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b901c8c4e443a2e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.897+0000 7fe3d1ffb640 1 -- 172.21.15.79:0/3526488227 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc037070 con 0x7fe3d406c3d0 2024-04-25T02:10:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.897+0000 7fe3d1ffb640 1 -- 172.21.15.79:0/3526488227 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3cc032440 con 0x7fe3d406c3d0 2024-04-25T02:10:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.897+0000 7fe3d1ffb640 1 -- 172.21.15.79:0/3526488227 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc032810 con 0x7fe3d406c3d0 2024-04-25T02:10:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.897+0000 7fe3d9521640 1 -- 172.21.15.79:0/3526488227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d406c3d0 msgr2=0x7fe3d406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.897+0000 7fe3d9521640 1 --2- 172.21.15.79:0/3526488227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d406c3d0 0x7fe3d406d110 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40719f0 tx=0x7fe3cc02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.897+0000 7fe3d9521640 1 -- 172.21.15.79:0/3526488227 shutdown_connections 2024-04-25T02:10:20.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.897+0000 7fe3d9521640 1 --2- 172.21.15.79:0/3526488227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d406c3d0 0x7fe3d406d110 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.897+0000 7fe3d9521640 1 --2- 172.21.15.79:0/3526488227 >> v2:172.21.15.189:3300/0 conn(0x7fe3d40ce020 0x7fe3d406cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.897+0000 7fe3d9521640 1 -- 172.21.15.79:0/3526488227 >> 172.21.15.79:0/3526488227 conn(0x7fe3d40d1e20 msgr2=0x7fe3d40d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:20.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.897+0000 7fe3d9521640 1 -- 172.21.15.79:0/3526488227 shutdown_connections 2024-04-25T02:10:20.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.897+0000 7fe3d9521640 1 -- 172.21.15.79:0/3526488227 wait complete. 2024-04-25T02:10:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.898+0000 7fe3d9521640 1 Processor -- start 2024-04-25T02:10:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.898+0000 7fe3d9521640 1 -- start start 2024-04-25T02:10:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.899+0000 7fe3d9521640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3d406c3d0 0x7fe3d41f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.899+0000 7fe3d9521640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d40ce020 0x7fe3d40b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.899+0000 7fe3d9521640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3d40d2940 0x7fe3d40b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.899+0000 7fe3d9521640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d40cf2b0 con 0x7fe3d40ce020 2024-04-25T02:10:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.899+0000 7fe3d9521640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d40d0c30 con 0x7fe3d40d2940 2024-04-25T02:10:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.899+0000 7fe3d9521640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d40d0060 con 0x7fe3d406c3d0 2024-04-25T02:10:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.899+0000 7fe3d27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d40ce020 0x7fe3d40b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.899+0000 7fe3d27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d40ce020 0x7fe3d40b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45738/0 (socket says 172.21.15.79:45738) 2024-04-25T02:10:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.899+0000 7fe3d27fc640 1 -- 172.21.15.79:0/3629438969 learned_addr learned my addr 172.21.15.79:0/3629438969 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.899+0000 7fe3d37fe640 1 --2- 172.21.15.79:0/3629438969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3d40d2940 0x7fe3d40b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.899+0000 7fe3d2ffd640 1 --2- 172.21.15.79:0/3629438969 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3d406c3d0 0x7fe3d41f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.899+0000 7fe3d27fc640 1 -- 172.21.15.79:0/3629438969 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3d406c3d0 msgr2=0x7fe3d41f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.899+0000 7fe3d27fc640 1 --2- 172.21.15.79:0/3629438969 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3d406c3d0 0x7fe3d41f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.899+0000 7fe3d27fc640 1 -- 172.21.15.79:0/3629438969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3d40d2940 msgr2=0x7fe3d40b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.900+0000 7fe3d27fc640 1 --2- 172.21.15.79:0/3629438969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3d40d2940 0x7fe3d40b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.900+0000 7fe3d27fc640 1 -- 172.21.15.79:0/3629438969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d40b40c0 con 0x7fe3d40ce020 2024-04-25T02:10:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.900+0000 7fe3d37fe640 1 --2- 172.21.15.79:0/3629438969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3d40d2940 0x7fe3d40b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.900+0000 7fe3d27fc640 1 --2- 172.21.15.79:0/3629438969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d40ce020 0x7fe3d40b3770 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800c4d0 tx=0x7fe3c800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.900+0000 7fe3bb7fe640 1 -- 172.21.15.79:0/3629438969 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8018070 con 0x7fe3d40ce020 2024-04-25T02:10:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.900+0000 7fe3bb7fe640 1 -- 172.21.15.79:0/3629438969 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c8007500 con 0x7fe3d40ce020 2024-04-25T02:10:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.900+0000 7fe3d9521640 1 -- 172.21.15.79:0/3629438969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d40b43a0 con 0x7fe3d40ce020 2024-04-25T02:10:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.900+0000 7fe3bb7fe640 1 -- 172.21.15.79:0/3629438969 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8004a20 con 0x7fe3d40ce020 2024-04-25T02:10:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.900+0000 7fe3d9521640 1 -- 172.21.15.79:0/3629438969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d40b4960 con 0x7fe3d40ce020 2024-04-25T02:10:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.901+0000 7fe3d9521640 1 -- 172.21.15.79:0/3629438969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d40c6b70 con 0x7fe3d40ce020 2024-04-25T02:10:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.901+0000 7fe3bb7fe640 1 -- 172.21.15.79:0/3629438969 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe3c801b070 con 0x7fe3d40ce020 2024-04-25T02:10:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.902+0000 7fe3bb7fe640 1 --2- 172.21.15.79:0/3629438969 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe3c006be30 0x7fe3c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:20.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.902+0000 7fe3d2ffd640 1 --2- 172.21.15.79:0/3629438969 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe3c006be30 0x7fe3c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:20.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.902+0000 7fe3bb7fe640 1 -- 172.21.15.79:0/3629438969 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fe3c8089e50 con 0x7fe3d40ce020 2024-04-25T02:10:20.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.902+0000 7fe3d2ffd640 1 --2- 172.21.15.79:0/3629438969 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe3c006be30 0x7fe3c006e2f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009a60 tx=0x7fe3c4003990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:20.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:20.906+0000 7fe3bb7fe640 1 -- 172.21.15.79:0/3629438969 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe3c8058b90 con 0x7fe3d40ce020 2024-04-25T02:10:21.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.113+0000 7fe3d9521640 1 -- 172.21.15.79:0/3629438969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3d406c9b0 con 0x7fe3d40ce020 2024-04-25T02:10:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.113+0000 7fe3bb7fe640 1 -- 172.21.15.79:0/3629438969 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3872 (secure 0 0 0) 0x7fe3c8058490 con 0x7fe3d40ce020 2024-04-25T02:10:21.121 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:21.121 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1382943557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1382943557},{"type":"v1","addr":"172.21.15.189:6833","nonce":1382943557}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3934472151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3934472151},{"type":"v1","addr":"172.21.15.189:6835","nonce":3934472151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2046740048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2046740048},{"type":"v1","addr":"172.21.15.79:6836","nonce":2046740048}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/207160678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":207160678},{"type":"v1","addr":"172.21.15.79:6837","nonce":207160678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[]} 2024-04-25T02:10:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 20 2024-04-25T02:10:21.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.115+0000 7fe3d9521640 1 -- 172.21.15.79:0/3629438969 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe3c006be30 msgr2=0x7fe3c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.115+0000 7fe3d9521640 1 --2- 172.21.15.79:0/3629438969 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe3c006be30 0x7fe3c006e2f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009a60 tx=0x7fe3c4003990 comp rx=0 tx=0).stop 2024-04-25T02:10:21.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.115+0000 7fe3d9521640 1 -- 172.21.15.79:0/3629438969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d40ce020 msgr2=0x7fe3d40b3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.115+0000 7fe3d9521640 1 --2- 172.21.15.79:0/3629438969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d40ce020 0x7fe3d40b3770 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800c4d0 tx=0x7fe3c800c990 comp rx=0 tx=0).stop 2024-04-25T02:10:21.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.115+0000 7fe3d9521640 1 -- 172.21.15.79:0/3629438969 shutdown_connections 2024-04-25T02:10:21.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.115+0000 7fe3d9521640 1 --2- 172.21.15.79:0/3629438969 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe3c006be30 0x7fe3c006e2f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.115+0000 7fe3d9521640 1 --2- 172.21.15.79:0/3629438969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3d40d2940 0x7fe3d40b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.115+0000 7fe3d9521640 1 --2- 172.21.15.79:0/3629438969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d40ce020 0x7fe3d40b3770 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.115+0000 7fe3d9521640 1 --2- 172.21.15.79:0/3629438969 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3d406c3d0 0x7fe3d41f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.115+0000 7fe3d9521640 1 -- 172.21.15.79:0/3629438969 >> 172.21.15.79:0/3629438969 conn(0x7fe3d40d1e20 msgr2=0x7fe3d40af310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:21.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.115+0000 7fe3d9521640 1 -- 172.21.15.79:0/3629438969 shutdown_connections 2024-04-25T02:10:21.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.115+0000 7fe3d9521640 1 -- 172.21.15.79:0/3629438969 wait complete. 2024-04-25T02:10:21.134 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T02:10:21.134 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T02:10:21.134 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T02:10:21.135 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:10:21.135 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T02:10:21.135 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T02:10:21.135 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T02:10:21.135 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:10:21.135 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T02:10:21.135 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T02:10:21.136 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T02:10:21.136 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:10:21.136 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T02:10:21.136 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T02:10:21.136 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T02:10:21.136 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:10:21.145 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T02:10:21.145 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T02:10:21.146 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T02:10:21.146 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T02:10:21.148 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T02:10:21.148 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T02:10:21.149 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T02:10:21.149 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T02:10:21.188 INFO:tasks.ceph.mds.c:Started 2024-04-25T02:10:21.188 DEBUG:teuthology.parallel:result is None 2024-04-25T02:10:21.189 INFO:tasks.ceph.mds.a:Started 2024-04-25T02:10:21.189 DEBUG:teuthology.parallel:result is None 2024-04-25T02:10:21.191 INFO:tasks.ceph.mds.b:Started 2024-04-25T02:10:21.191 DEBUG:teuthology.parallel:result is None 2024-04-25T02:10:21.192 INFO:tasks.ceph.mds.d:Started 2024-04-25T02:10:21.192 DEBUG:teuthology.parallel:result is None 2024-04-25T02:10:21.192 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T02:10:21.262 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:10:21.262 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-04-25T02:10:21.273 INFO:tasks.ceph.mds.b.smithi189.stdout:starting mds.b at 2024-04-25T02:10:21.274 INFO:tasks.ceph.mds.d.smithi189.stdout:starting mds.d at 2024-04-25T02:10:21.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.288+0000 7f5ccfb4f640 1 Processor -- start 2024-04-25T02:10:21.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.289+0000 7f5ccfb4f640 1 -- start start 2024-04-25T02:10:21.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.290+0000 7f5ccfb4f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cc815e4d0 0x7f5cc806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.290+0000 7f5ccfb4f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc80d1660 con 0x7f5cc80b3570 2024-04-25T02:10:21.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.290+0000 7f5ccfb4f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc80d1380 con 0x7f5cc80d2e20 2024-04-25T02:10:21.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.290+0000 7f5ccfb4f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5cc80cede0 con 0x7f5cc815e4d0 2024-04-25T02:10:21.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.290+0000 7f5ccd0ea640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5cc80b3570 0x7f5cc80d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55700/0 (socket says 172.21.15.79:55700) 2024-04-25T02:10:21.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.290+0000 7f5ccd0ea640 1 -- 172.21.15.79:0/61200263 learned_addr learned my addr 172.21.15.79:0/61200263 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:21.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.290+0000 7f5ccd8eb640 1 --2- 172.21.15.79:0/61200263 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cc815e4d0 0x7f5cc806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.290+0000 7f5ccd8eb640 1 -- 172.21.15.79:0/61200263 >> v1:172.21.15.189:6789/0 conn(0x7f5cc80d2e20 legacy=0x7f5cc80cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.290+0000 7f5ccd8eb640 1 -- 172.21.15.79:0/61200263 >> v1:172.21.15.79:6789/0 conn(0x7f5cc80b3570 legacy=0x7f5cc80d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.290+0000 7f5ccd8eb640 1 -- 172.21.15.79:0/61200263 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc80cf0c0 con 0x7f5cc815e4d0 2024-04-25T02:10:21.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.291+0000 7f5ccd8eb640 1 --2- 172.21.15.79:0/61200263 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cc815e4d0 0x7f5cc806bc70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40097d0 tx=0x7f5cc402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8348c0f22dc5ee29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:21.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.296+0000 7f5ccc8e9640 1 -- 172.21.15.79:0/61200263 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4037070 con 0x7f5cc815e4d0 2024-04-25T02:10:21.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.296+0000 7f5ccc8e9640 1 -- 172.21.15.79:0/61200263 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc4032440 con 0x7f5cc815e4d0 2024-04-25T02:10:21.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.296+0000 7f5ccc8e9640 1 -- 172.21.15.79:0/61200263 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4032810 con 0x7f5cc815e4d0 2024-04-25T02:10:21.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.296+0000 7f5ccfb4f640 1 -- 172.21.15.79:0/61200263 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cc815e4d0 msgr2=0x7f5cc806bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.296+0000 7f5ccfb4f640 1 --2- 172.21.15.79:0/61200263 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cc815e4d0 0x7f5cc806bc70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40097d0 tx=0x7f5cc402a210 comp rx=0 tx=0).stop 2024-04-25T02:10:21.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.296+0000 7f5ccfb4f640 1 -- 172.21.15.79:0/61200263 shutdown_connections 2024-04-25T02:10:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.296+0000 7f5ccfb4f640 1 --2- 172.21.15.79:0/61200263 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cc815e4d0 0x7f5cc806bc70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.297+0000 7f5ccfb4f640 1 -- 172.21.15.79:0/61200263 >> 172.21.15.79:0/61200263 conn(0x7f5cc809d460 msgr2=0x7f5cc80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.297+0000 7f5ccfb4f640 1 -- 172.21.15.79:0/61200263 shutdown_connections 2024-04-25T02:10:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.297+0000 7f5ccfb4f640 1 -- 172.21.15.79:0/61200263 wait complete. 2024-04-25T02:10:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.298+0000 7f5ccfb4f640 1 Processor -- start 2024-04-25T02:10:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.298+0000 7f5ccfb4f640 1 -- start start 2024-04-25T02:10:21.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.298+0000 7f5ccfb4f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cc80b3570 0x7f5cc80cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.298+0000 7f5ccfb4f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cc80d2e20 0x7f5cc815ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.298+0000 7f5ccfb4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cc815e4d0 0x7f5cc81f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.298+0000 7f5ccfb4f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc80d2250 con 0x7f5cc815e4d0 2024-04-25T02:10:21.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.299+0000 7f5ccfb4f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc80d20d0 con 0x7f5cc80d2e20 2024-04-25T02:10:21.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.299+0000 7f5ccfb4f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5cc806c1b0 con 0x7f5cc80b3570 2024-04-25T02:10:21.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.299+0000 7f5cce0ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cc815e4d0 0x7f5cc81f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.299+0000 7f5cce0ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cc815e4d0 0x7f5cc81f4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45790/0 (socket says 172.21.15.79:45790) 2024-04-25T02:10:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.299+0000 7f5cce0ec640 1 -- 172.21.15.79:0/542246195 learned_addr learned my addr 172.21.15.79:0/542246195 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.299+0000 7f5ccd8eb640 1 --2- 172.21.15.79:0/542246195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cc80b3570 0x7f5cc80cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.299+0000 7f5ccd0ea640 1 --2- 172.21.15.79:0/542246195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cc80d2e20 0x7f5cc815ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.299+0000 7f5cce0ec640 1 -- 172.21.15.79:0/542246195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cc80b3570 msgr2=0x7f5cc80cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.299+0000 7f5cce0ec640 1 --2- 172.21.15.79:0/542246195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cc80b3570 0x7f5cc80cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.299+0000 7f5cce0ec640 1 -- 172.21.15.79:0/542246195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cc80d2e20 msgr2=0x7f5cc815ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.299+0000 7f5cce0ec640 1 --2- 172.21.15.79:0/542246195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cc80d2e20 0x7f5cc815ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.299+0000 7f5cce0ec640 1 -- 172.21.15.79:0/542246195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc81f47e0 con 0x7f5cc815e4d0 2024-04-25T02:10:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.299+0000 7f5cce0ec640 1 --2- 172.21.15.79:0/542246195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cc815e4d0 0x7f5cc81f4fa0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5cc000c730 tx=0x7f5cc000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.302+0000 7f5cbe7fc640 1 -- 172.21.15.79:0/542246195 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0016020 con 0x7f5cc815e4d0 2024-04-25T02:10:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.302+0000 7f5cbe7fc640 1 -- 172.21.15.79:0/542246195 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc0006d50 con 0x7f5cc815e4d0 2024-04-25T02:10:21.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.302+0000 7f5cbe7fc640 1 -- 172.21.15.79:0/542246195 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0003bb0 con 0x7f5cc815e4d0 2024-04-25T02:10:21.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.302+0000 7f5ccfb4f640 1 -- 172.21.15.79:0/542246195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc80cc640 con 0x7f5cc815e4d0 2024-04-25T02:10:21.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.302+0000 7f5ccfb4f640 1 -- 172.21.15.79:0/542246195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc80cc360 con 0x7f5cc815e4d0 2024-04-25T02:10:21.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.303+0000 7f5ccfb4f640 1 -- 172.21.15.79:0/542246195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cc80b9f60 con 0x7f5cc815e4d0 2024-04-25T02:10:21.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.303+0000 7f5cbe7fc640 1 -- 172.21.15.79:0/542246195 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5cc00050d0 con 0x7f5cc815e4d0 2024-04-25T02:10:21.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.304+0000 7f5cbe7fc640 1 --2- 172.21.15.79:0/542246195 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5cac06be30 0x7f5cac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.304+0000 7f5cbe7fc640 1 -- 172.21.15.79:0/542246195 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7f5cc008a770 con 0x7f5cc815e4d0 2024-04-25T02:10:21.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.304+0000 7f5ccd8eb640 1 --2- 172.21.15.79:0/542246195 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5cac06be30 0x7f5cac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.304+0000 7f5ccd8eb640 1 --2- 172.21.15.79:0/542246195 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5cac06be30 0x7f5cac06e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4034000 tx=0x7f5cc402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:21.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.308+0000 7f5cbe7fc640 1 -- 172.21.15.79:0/542246195 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5cc80b9f60 con 0x7f5cc815e4d0 2024-04-25T02:10:21.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:21.496+0000 7f5ccfb4f640 1 -- 172.21.15.79:0/542246195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f5cc80690a0 con 0x7f5cc815e4d0 2024-04-25T02:10:22.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.319+0000 7f5cbe7fc640 1 -- 172.21.15.79:0/542246195 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v55) ==== 97+0+0 (secure 0 0 0) 0x7f5cc0020020 con 0x7f5cc815e4d0 2024-04-25T02:10:22.326 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2024-04-25T02:10:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.321+0000 7f5ccfb4f640 1 -- 172.21.15.79:0/542246195 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5cac06be30 msgr2=0x7f5cac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.321+0000 7f5ccfb4f640 1 --2- 172.21.15.79:0/542246195 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5cac06be30 0x7f5cac06e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4034000 tx=0x7f5cc402e000 comp rx=0 tx=0).stop 2024-04-25T02:10:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.321+0000 7f5ccfb4f640 1 -- 172.21.15.79:0/542246195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cc815e4d0 msgr2=0x7f5cc81f4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.321+0000 7f5ccfb4f640 1 --2- 172.21.15.79:0/542246195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cc815e4d0 0x7f5cc81f4fa0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5cc000c730 tx=0x7f5cc000cbf0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.321+0000 7f5ccfb4f640 1 -- 172.21.15.79:0/542246195 shutdown_connections 2024-04-25T02:10:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.321+0000 7f5ccfb4f640 1 --2- 172.21.15.79:0/542246195 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5cac06be30 0x7f5cac06e2f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.321+0000 7f5ccfb4f640 1 --2- 172.21.15.79:0/542246195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cc815e4d0 0x7f5cc81f4fa0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.321+0000 7f5ccfb4f640 1 --2- 172.21.15.79:0/542246195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cc80d2e20 0x7f5cc815ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.321+0000 7f5ccfb4f640 1 --2- 172.21.15.79:0/542246195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cc80b3570 0x7f5cc80cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.321+0000 7f5ccfb4f640 1 -- 172.21.15.79:0/542246195 >> 172.21.15.79:0/542246195 conn(0x7f5cc809d460 msgr2=0x7f5cc815ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.321+0000 7f5ccfb4f640 1 -- 172.21.15.79:0/542246195 shutdown_connections 2024-04-25T02:10:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.321+0000 7f5ccfb4f640 1 -- 172.21.15.79:0/542246195 wait complete. 2024-04-25T02:10:22.341 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T02:10:22.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.432+0000 7f6a38f70640 1 Processor -- start 2024-04-25T02:10:22.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.432+0000 7f6a38f70640 1 -- start start 2024-04-25T02:10:22.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.433+0000 7f6a38f70640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a3415e4d0 0x7f6a3406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.433+0000 7f6a38f70640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a340d1660 con 0x7f6a340d2e20 2024-04-25T02:10:22.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.433+0000 7f6a38f70640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a340d1380 con 0x7f6a340b3570 2024-04-25T02:10:22.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.433+0000 7f6a38f70640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6a340cede0 con 0x7f6a3415e4d0 2024-04-25T02:10:22.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.433+0000 7f6a3259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a3415e4d0 0x7f6a3406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.433+0000 7f6a32d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6a340d2e20 0x7f6a340cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55716/0 (socket says 172.21.15.79:55716) 2024-04-25T02:10:22.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.433+0000 7f6a32d9d640 1 -- 172.21.15.79:0/1882677 learned_addr learned my addr 172.21.15.79:0/1882677 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:22.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.434+0000 7f6a3259c640 1 -- 172.21.15.79:0/1882677 >> v1:172.21.15.189:6789/0 conn(0x7f6a340b3570 legacy=0x7f6a340d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.434+0000 7f6a3259c640 1 -- 172.21.15.79:0/1882677 >> v1:172.21.15.79:6789/0 conn(0x7f6a340d2e20 legacy=0x7f6a340cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.434+0000 7f6a3259c640 1 -- 172.21.15.79:0/1882677 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a340cf0c0 con 0x7f6a3415e4d0 2024-04-25T02:10:22.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.434+0000 7f6a3159a640 1 -- 172.21.15.79:0/1882677 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209277843 0 0) 0x7f6a340d1660 con 0x7f6a340d2e20 2024-04-25T02:10:22.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.434+0000 7f6a3259c640 1 --2- 172.21.15.79:0/1882677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a3415e4d0 0x7f6a3406bc70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6a24009dc0 tx=0x7f6a2402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75a4ea5b65c7740 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.435+0000 7f6a3159a640 1 -- 172.21.15.79:0/1882677 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24007740 con 0x7f6a3415e4d0 2024-04-25T02:10:22.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.435+0000 7f6a3159a640 1 -- 172.21.15.79:0/1882677 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a240078e0 con 0x7f6a3415e4d0 2024-04-25T02:10:22.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.435+0000 7f6a3159a640 1 -- 172.21.15.79:0/1882677 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24007cb0 con 0x7f6a3415e4d0 2024-04-25T02:10:22.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.435+0000 7f6a38f70640 1 -- 172.21.15.79:0/1882677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a3415e4d0 msgr2=0x7f6a3406bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.435+0000 7f6a38f70640 1 --2- 172.21.15.79:0/1882677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a3415e4d0 0x7f6a3406bc70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6a24009dc0 tx=0x7f6a2402a730 comp rx=0 tx=0).stop 2024-04-25T02:10:22.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.435+0000 7f6a38f70640 1 -- 172.21.15.79:0/1882677 shutdown_connections 2024-04-25T02:10:22.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.435+0000 7f6a38f70640 1 --2- 172.21.15.79:0/1882677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a3415e4d0 0x7f6a3406bc70 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.435+0000 7f6a38f70640 1 -- 172.21.15.79:0/1882677 >> 172.21.15.79:0/1882677 conn(0x7f6a3409d460 msgr2=0x7f6a340d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.435+0000 7f6a38f70640 1 -- 172.21.15.79:0/1882677 shutdown_connections 2024-04-25T02:10:22.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.435+0000 7f6a38f70640 1 -- 172.21.15.79:0/1882677 wait complete. 2024-04-25T02:10:22.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.436+0000 7f6a38f70640 1 Processor -- start 2024-04-25T02:10:22.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.436+0000 7f6a38f70640 1 -- start start 2024-04-25T02:10:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.437+0000 7f6a38f70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a340b3570 0x7f6a34154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.437+0000 7f6a38f70640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a340d2e20 0x7f6a340cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.437+0000 7f6a38f70640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a3415e4d0 0x7f6a340cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.437+0000 7f6a38f70640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6a340d2250 con 0x7f6a340b3570 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.437+0000 7f6a38f70640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6a340d20d0 con 0x7f6a3415e4d0 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.437+0000 7f6a38f70640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3406c1b0 con 0x7f6a340d2e20 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.437+0000 7f6a3259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a340b3570 0x7f6a34154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.437+0000 7f6a3259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a340b3570 0x7f6a34154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45816/0 (socket says 172.21.15.79:45816) 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.437+0000 7f6a3259c640 1 -- 172.21.15.79:0/536792608 learned_addr learned my addr 172.21.15.79:0/536792608 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.437+0000 7f6a32d9d640 1 --2- 172.21.15.79:0/536792608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a3415e4d0 0x7f6a340cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.437+0000 7f6a31d9b640 1 --2- 172.21.15.79:0/536792608 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a340d2e20 0x7f6a340cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.438+0000 7f6a3259c640 1 -- 172.21.15.79:0/536792608 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a340d2e20 msgr2=0x7f6a340cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.438+0000 7f6a3259c640 1 --2- 172.21.15.79:0/536792608 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a340d2e20 0x7f6a340cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.438+0000 7f6a3259c640 1 -- 172.21.15.79:0/536792608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a3415e4d0 msgr2=0x7f6a340cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.438+0000 7f6a3259c640 1 --2- 172.21.15.79:0/536792608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a3415e4d0 0x7f6a340cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.438+0000 7f6a3259c640 1 -- 172.21.15.79:0/536792608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a341554a0 con 0x7f6a340b3570 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.438+0000 7f6a32d9d640 1 --2- 172.21.15.79:0/536792608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a3415e4d0 0x7f6a340cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.438+0000 7f6a3259c640 1 --2- 172.21.15.79:0/536792608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a340b3570 0x7f6a34154f60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f6a24000f80 tx=0x7f6a24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.438+0000 7f6a22ffd640 1 -- 172.21.15.79:0/536792608 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24040070 con 0x7f6a340b3570 2024-04-25T02:10:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.438+0000 7f6a22ffd640 1 -- 172.21.15.79:0/536792608 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a24031bc0 con 0x7f6a340b3570 2024-04-25T02:10:22.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.438+0000 7f6a38f70640 1 -- 172.21.15.79:0/536792608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a340cb380 con 0x7f6a340b3570 2024-04-25T02:10:22.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.438+0000 7f6a22ffd640 1 -- 172.21.15.79:0/536792608 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24045460 con 0x7f6a340b3570 2024-04-25T02:10:22.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.438+0000 7f6a38f70640 1 -- 172.21.15.79:0/536792608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a340ce020 con 0x7f6a340b3570 2024-04-25T02:10:22.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.439+0000 7f6a38f70640 1 -- 172.21.15.79:0/536792608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a340d1ef0 con 0x7f6a340b3570 2024-04-25T02:10:22.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.439+0000 7f6a22ffd640 1 -- 172.21.15.79:0/536792608 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a24039040 con 0x7f6a340b3570 2024-04-25T02:10:22.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.440+0000 7f6a22ffd640 1 --2- 172.21.15.79:0/536792608 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a1406be30 0x7f6a1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.440+0000 7f6a22ffd640 1 -- 172.21.15.79:0/536792608 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4857+0+0 (secure 0 0 0) 0x7f6a240ac480 con 0x7f6a340b3570 2024-04-25T02:10:22.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.440+0000 7f6a31d9b640 1 --2- 172.21.15.79:0/536792608 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a1406be30 0x7f6a1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.440+0000 7f6a31d9b640 1 --2- 172.21.15.79:0/536792608 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a1406be30 0x7f6a1406e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6a34161b20 tx=0x7f6a28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.444+0000 7f6a22ffd640 1 -- 172.21.15.79:0/536792608 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6a340d1ef0 con 0x7f6a340b3570 2024-04-25T02:10:22.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.682+0000 7f6a38f70640 1 -- 172.21.15.79:0/536792608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6a340690a0 con 0x7f6a340b3570 2024-04-25T02:10:22.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.683+0000 7f6a22ffd640 1 -- 172.21.15.79:0/536792608 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) ==== 80+0+5304 (secure 0 0 0) 0x7f6a2407b210 con 0x7f6a340b3570 2024-04-25T02:10:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:22.691 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:10:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2024-04-25T02:10:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2024-04-25T02:10:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmkSfsJhAAEP9aqirUawsrrvVUkxkO0w==", 2024-04-25T02:10:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:10:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:10:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:10:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:10:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2024-04-25T02:10:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilm8wYYMhAA98c3h9c80Y9zYzVv+kY7qQ==", 2024-04-25T02:10:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:10:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:10:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:10:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:10:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2024-04-25T02:10:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmiqSiLRAAmCUWUrHC31tkg0dkXS54cA==", 2024-04-25T02:10:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmiPbkOBAA+rBwAypY5jrR3xafG9h1sw==", 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2024-04-25T02:10:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDJuilmP1AdGBAAS0IkH2E3XQvkxA33GInm5w==", 2024-04-25T02:10:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:10:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:10:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:10:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2024-04-25T02:10:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDMuilm479HFhAA8iIjBC94pqHikS5kPHipCQ==", 2024-04-25T02:10:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDPuilmE+k9FBAARX3P/kjt7ybeVHGGyYaWwg==", 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2024-04-25T02:10:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDSuilmUF41EhAA1HhTXWnhVwETe+4hxmxjFw==", 2024-04-25T02:10:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:10:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:10:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:10:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2024-04-25T02:10:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDYuilm2pisGRAAFBmWVAGib2guJobYooLQoA==", 2024-04-25T02:10:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:10:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:10:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:10:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDbuilm28m9FxAA8GOmzxRAlK6o/RTe+FpL7g==", 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDeuilmzDRyFRAAKk7JWPVRxxE+B4OCJhaXvg==", 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:10:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:10:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2024-04-25T02:10:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDhuilmQABhExAA40Inq4eg4oohO3tmNdCyPQ==", 2024-04-25T02:10:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:10:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:10:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:10:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2024-04-25T02:10:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g==", 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilm8EWZCRAAjRomNRANd7sC+tpYZ1uE6w==", 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmHUedBhAA84h2PNUgReBGQ3rubcEDsw==", 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmCx4UDxAAZmQdQB8RdTMr2JKr7TMySg==", 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:10:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmFgdeDBAAu+VeVhknKsm+Gxzh5+qANg==", 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2024-04-25T02:10:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmXrLhIxAAiq13px9HksQtu+qjoRi1qQ==", 2024-04-25T02:10:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:10:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-04-25T02:10:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:10:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2024-04-25T02:10:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmV8dxIBAA8GX2T/ZqZF+3qDjtddh/ZQ==", 2024-04-25T02:10:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:10:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:10:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-04-25T02:10:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:10:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:22.703 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T02:10:22.703 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:10:22.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.685+0000 7f6a38f70640 1 -- 172.21.15.79:0/536792608 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a1406be30 msgr2=0x7f6a1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.685+0000 7f6a38f70640 1 --2- 172.21.15.79:0/536792608 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a1406be30 0x7f6a1406e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6a34161b20 tx=0x7f6a28009040 comp rx=0 tx=0).stop 2024-04-25T02:10:22.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.685+0000 7f6a38f70640 1 -- 172.21.15.79:0/536792608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a340b3570 msgr2=0x7f6a34154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.685+0000 7f6a38f70640 1 --2- 172.21.15.79:0/536792608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a340b3570 0x7f6a34154f60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f6a24000f80 tx=0x7f6a24004a40 comp rx=0 tx=0).stop 2024-04-25T02:10:22.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.685+0000 7f6a38f70640 1 -- 172.21.15.79:0/536792608 shutdown_connections 2024-04-25T02:10:22.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.685+0000 7f6a38f70640 1 --2- 172.21.15.79:0/536792608 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a1406be30 0x7f6a1406e2f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.685+0000 7f6a38f70640 1 --2- 172.21.15.79:0/536792608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a3415e4d0 0x7f6a340cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.685+0000 7f6a38f70640 1 --2- 172.21.15.79:0/536792608 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a340d2e20 0x7f6a340cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.685+0000 7f6a38f70640 1 --2- 172.21.15.79:0/536792608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a340b3570 0x7f6a34154f60 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.685+0000 7f6a38f70640 1 -- 172.21.15.79:0/536792608 >> 172.21.15.79:0/536792608 conn(0x7f6a3409d460 msgr2=0x7f6a340d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.685+0000 7f6a38f70640 1 -- 172.21.15.79:0/536792608 shutdown_connections 2024-04-25T02:10:22.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.685+0000 7f6a38f70640 1 -- 172.21.15.79:0/536792608 wait complete. 2024-04-25T02:10:22.705 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:22.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.794+0000 7f5dddf28640 1 Processor -- start 2024-04-25T02:10:22.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.794+0000 7f5dddf28640 1 -- start start 2024-04-25T02:10:22.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.795+0000 7f5dddf28640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5dd806df50 0x7f5dd806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.795+0000 7f5dddf28640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd8071e00 con 0x7f5dd8143bc0 2024-04-25T02:10:22.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.795+0000 7f5dddf28640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd80720a0 con 0x7f5dd80b2d30 2024-04-25T02:10:22.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.795+0000 7f5dddf28640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f5dd806e8f0 con 0x7f5dd806df50 2024-04-25T02:10:22.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.795+0000 7f5dd77fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5dd8143bc0 0x7f5dd815f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55730/0 (socket says 172.21.15.79:55730) 2024-04-25T02:10:22.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.795+0000 7f5dd77fe640 1 -- 172.21.15.79:0/3278545028 learned_addr learned my addr 172.21.15.79:0/3278545028 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:22.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.795+0000 7f5dd6ffd640 1 --2- 172.21.15.79:0/3278545028 >> v2:172.21.15.189:3300/0 conn(0x7f5dd806df50 0x7f5dd806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.795+0000 7f5dd67fc640 1 -- 172.21.15.79:0/3278545028 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151090036 0 0) 0x7f5dd8071e00 con 0x7f5dd8143bc0 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.795+0000 7f5dd67fc640 1 -- 172.21.15.79:0/3278545028 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dc0005730 con 0x7f5dd8143bc0 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd67fc640 1 -- 172.21.15.79:0/3278545028 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3629796888 0 0) 0x7f5dc0005730 con 0x7f5dd8143bc0 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd67fc640 1 -- 172.21.15.79:0/3278545028 >> v2:172.21.15.189:3300/0 conn(0x7f5dd806df50 msgr2=0x7f5dd806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd67fc640 1 --2- 172.21.15.79:0/3278545028 >> v2:172.21.15.189:3300/0 conn(0x7f5dd806df50 0x7f5dd806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd67fc640 1 -- 172.21.15.79:0/3278545028 >> v1:172.21.15.189:6789/0 conn(0x7f5dd80b2d30 legacy=0x7f5dd80b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd67fc640 1 -- 172.21.15.79:0/3278545028 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd8072380 con 0x7f5dd8143bc0 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd67fc640 1 -- 172.21.15.79:0/3278545028 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f5dc8001670 con 0x7f5dd8143bc0 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd67fc640 1 -- 172.21.15.79:0/3278545028 >> v1:172.21.15.79:6789/0 conn(0x7f5dd8143bc0 legacy=0x7f5dd815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd67fc640 1 --2- 172.21.15.79:0/3278545028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dc0005bc0 0x7f5dc0005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd67fc640 1 --2- 172.21.15.79:0/3278545028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dc0006a10 0x7f5dc0006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd67fc640 1 --2- 172.21.15.79:0/3278545028 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5dc00073d0 0x7f5dc000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd67fc640 1 -- 172.21.15.79:0/3278545028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc000e340 con 0x7f5dc0005bc0 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd67fc640 1 -- 172.21.15.79:0/3278545028 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc000e4f0 con 0x7f5dc0006a10 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd67fc640 1 -- 172.21.15.79:0/3278545028 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc000e6f0 con 0x7f5dc00073d0 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd77fe640 1 --2- 172.21.15.79:0/3278545028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dc0005bc0 0x7f5dc0005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd6ffd640 1 --2- 172.21.15.79:0/3278545028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dc0006a10 0x7f5dc0006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd7fff640 1 --2- 172.21.15.79:0/3278545028 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5dc00073d0 0x7f5dc000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd77fe640 1 -- 172.21.15.79:0/3278545028 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5dc00073d0 msgr2=0x7f5dc000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd77fe640 1 --2- 172.21.15.79:0/3278545028 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5dc00073d0 0x7f5dc000dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd77fe640 1 -- 172.21.15.79:0/3278545028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dc0006a10 msgr2=0x7f5dc0006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd77fe640 1 --2- 172.21.15.79:0/3278545028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dc0006a10 0x7f5dc0006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd77fe640 1 -- 172.21.15.79:0/3278545028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc0005730 con 0x7f5dc0005bc0 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.796+0000 7f5dd7fff640 1 -- 172.21.15.79:0/3278545028 reap_dead start 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.797+0000 7f5dd77fe640 1 --2- 172.21.15.79:0/3278545028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dc0005bc0 0x7f5dc0005fe0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800c240 tx=0x7f5dc0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42905e4d1e34d4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.797+0000 7f5dd67fc640 1 -- 172.21.15.79:0/3278545028 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8007d10 con 0x7f5dc0005bc0 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.797+0000 7f5dd67fc640 1 -- 172.21.15.79:0/3278545028 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc8005ad0 con 0x7f5dc0005bc0 2024-04-25T02:10:22.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.797+0000 7f5dd67fc640 1 -- 172.21.15.79:0/3278545028 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8007070 con 0x7f5dc0005bc0 2024-04-25T02:10:22.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.797+0000 7f5dddf28640 1 -- 172.21.15.79:0/3278545028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dc0005bc0 msgr2=0x7f5dc0005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.797+0000 7f5dddf28640 1 --2- 172.21.15.79:0/3278545028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dc0005bc0 0x7f5dc0005fe0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800c240 tx=0x7f5dc0007a40 comp rx=0 tx=0).stop 2024-04-25T02:10:22.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.798+0000 7f5dddf28640 1 -- 172.21.15.79:0/3278545028 shutdown_connections 2024-04-25T02:10:22.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.798+0000 7f5dddf28640 1 --2- 172.21.15.79:0/3278545028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dc0005bc0 0x7f5dc0005fe0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.798+0000 7f5dddf28640 1 -- 172.21.15.79:0/3278545028 >> 172.21.15.79:0/3278545028 conn(0x7f5dd80cfc80 msgr2=0x7f5dd80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.798+0000 7f5dddf28640 1 -- 172.21.15.79:0/3278545028 shutdown_connections 2024-04-25T02:10:22.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.798+0000 7f5dddf28640 1 -- 172.21.15.79:0/3278545028 wait complete. 2024-04-25T02:10:22.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.799+0000 7f5dddf28640 1 Processor -- start 2024-04-25T02:10:22.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.799+0000 7f5dddf28640 1 -- start start 2024-04-25T02:10:22.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dddf28640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dc0005bc0 0x7f5dd80b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dddf28640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dd80b1060 0x7f5dd812df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dddf28640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5dd812e480 0x7f5dd812e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dddf28640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd8072940 con 0x7f5dd80b1060 2024-04-25T02:10:22.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dddf28640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd8072cb0 con 0x7f5dc0005bc0 2024-04-25T02:10:22.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dddf28640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd8143fa0 con 0x7f5dd812e480 2024-04-25T02:10:22.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dd6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dd80b1060 0x7f5dd812df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dd6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dd80b1060 0x7f5dd812df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45828/0 (socket says 172.21.15.79:45828) 2024-04-25T02:10:22.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dd6ffd640 1 -- 172.21.15.79:0/1983473834 learned_addr learned my addr 172.21.15.79:0/1983473834 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:22.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dd77fe640 1 --2- 172.21.15.79:0/1983473834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dc0005bc0 0x7f5dd80b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dd7fff640 1 --2- 172.21.15.79:0/1983473834 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5dd812e480 0x7f5dd812e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dd6ffd640 1 -- 172.21.15.79:0/1983473834 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5dd812e480 msgr2=0x7f5dd812e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dd6ffd640 1 --2- 172.21.15.79:0/1983473834 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5dd812e480 0x7f5dd812e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dd6ffd640 1 -- 172.21.15.79:0/1983473834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dc0005bc0 msgr2=0x7f5dd80b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dd6ffd640 1 --2- 172.21.15.79:0/1983473834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dc0005bc0 0x7f5dd80b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dd6ffd640 1 -- 172.21.15.79:0/1983473834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd8140bf0 con 0x7f5dd80b1060 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dd6ffd640 1 --2- 172.21.15.79:0/1983473834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dd80b1060 0x7f5dd812df40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc011700 tx=0x7f5dcc011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dbffff640 1 -- 172.21.15.79:0/1983473834 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00f9c0 con 0x7f5dd80b1060 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dbffff640 1 -- 172.21.15.79:0/1983473834 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dcc00fb60 con 0x7f5dd80b1060 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dddf28640 1 -- 172.21.15.79:0/1983473834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd8140ed0 con 0x7f5dd80b1060 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dbffff640 1 -- 172.21.15.79:0/1983473834 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc015460 con 0x7f5dd80b1060 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.800+0000 7f5dddf28640 1 -- 172.21.15.79:0/1983473834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd8141490 con 0x7f5dd80b1060 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.801+0000 7f5dddf28640 1 -- 172.21.15.79:0/1983473834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd80690a0 con 0x7f5dd80b1060 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.802+0000 7f5dbffff640 1 -- 172.21.15.79:0/1983473834 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5dcc015600 con 0x7f5dd80b1060 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.802+0000 7f5dbffff640 1 --2- 172.21.15.79:0/1983473834 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5dc406be30 0x7f5dc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.802+0000 7f5dbffff640 1 -- 172.21.15.79:0/1983473834 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4857+0+0 (secure 0 0 0) 0x7f5dcc08b290 con 0x7f5dd80b1060 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.802+0000 7f5dd77fe640 1 --2- 172.21.15.79:0/1983473834 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5dc406be30 0x7f5dc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.802+0000 7f5dd77fe640 1 --2- 172.21.15.79:0/1983473834 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5dc406be30 0x7f5dc406e2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8033000 tx=0x7f5dc802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.806+0000 7f5dbffff640 1 -- 172.21.15.79:0/1983473834 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5dcc019030 con 0x7f5dd80b1060 2024-04-25T02:10:22.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.983+0000 7f5dddf28640 1 -- 172.21.15.79:0/1983473834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5dd8071b20 con 0x7f5dd80b1060 2024-04-25T02:10:22.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.984+0000 7f5dbffff640 1 -- 172.21.15.79:0/1983473834 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+12903 (secure 0 0 0) 0x7f5dcc059940 con 0x7f5dd80b1060 2024-04-25T02:10:22.992 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":55,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:10:22.318703+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:22.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.986+0000 7f5dddf28640 1 -- 172.21.15.79:0/1983473834 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5dc406be30 msgr2=0x7f5dc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.986+0000 7f5dddf28640 1 --2- 172.21.15.79:0/1983473834 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5dc406be30 0x7f5dc406e2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8033000 tx=0x7f5dc802e000 comp rx=0 tx=0).stop 2024-04-25T02:10:22.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.986+0000 7f5dddf28640 1 -- 172.21.15.79:0/1983473834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dd80b1060 msgr2=0x7f5dd812df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.986+0000 7f5dddf28640 1 --2- 172.21.15.79:0/1983473834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dd80b1060 0x7f5dd812df40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc011700 tx=0x7f5dcc011bc0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.986+0000 7f5dddf28640 1 -- 172.21.15.79:0/1983473834 shutdown_connections 2024-04-25T02:10:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.986+0000 7f5dddf28640 1 --2- 172.21.15.79:0/1983473834 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5dc406be30 0x7f5dc406e2f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.986+0000 7f5dddf28640 1 --2- 172.21.15.79:0/1983473834 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5dd812e480 0x7f5dd812e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.986+0000 7f5dddf28640 1 --2- 172.21.15.79:0/1983473834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dd80b1060 0x7f5dd812df40 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.986+0000 7f5dddf28640 1 --2- 172.21.15.79:0/1983473834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dc0005bc0 0x7f5dd80b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.986+0000 7f5dddf28640 1 -- 172.21.15.79:0/1983473834 >> 172.21.15.79:0/1983473834 conn(0x7f5dd80cfc80 msgr2=0x7f5dd815e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.986+0000 7f5dddf28640 1 -- 172.21.15.79:0/1983473834 shutdown_connections 2024-04-25T02:10:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:22.987+0000 7f5dddf28640 1 -- 172.21.15.79:0/1983473834 wait complete. 2024-04-25T02:10:23.006 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:10:23.006 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:10:23.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.098+0000 7f908d5b6640 1 Processor -- start 2024-04-25T02:10:23.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.098+0000 7f908d5b6640 1 -- start start 2024-04-25T02:10:23.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.099+0000 7f908d5b6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f908815e4f0 0x7f90880d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.099+0000 7f908d5b6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90880d1ee0 con 0x7f90880cf7f0 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.099+0000 7f908d5b6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90880d21c0 con 0x7f90880d10c0 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.099+0000 7f908d5b6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f90880d24a0 con 0x7f908815e4f0 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.099+0000 7f9086ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f908815e4f0 0x7f90880d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.099+0000 7f90867fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f90880cf7f0 0x7f90880d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55736/0 (socket says 172.21.15.79:55736) 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.099+0000 7f90867fc640 1 -- 172.21.15.79:0/3607435638 learned_addr learned my addr 172.21.15.79:0/3607435638 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.099+0000 7f9086ffd640 1 -- 172.21.15.79:0/3607435638 >> v1:172.21.15.189:6789/0 conn(0x7f90880d10c0 legacy=0x7f908806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.099+0000 7f9086ffd640 1 -- 172.21.15.79:0/3607435638 >> v1:172.21.15.79:6789/0 conn(0x7f90880cf7f0 legacy=0x7f90880d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.099+0000 7f9086ffd640 1 -- 172.21.15.79:0/3607435638 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90880d2780 con 0x7f908815e4f0 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.099+0000 7f9085ffb640 1 -- 172.21.15.79:0/3607435638 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2558790958 0 0) 0x7f90880d1ee0 con 0x7f90880cf7f0 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.100+0000 7f9086ffd640 1 --2- 172.21.15.79:0/3607435638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f908815e4f0 0x7f90880d2ca0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f90780097d0 tx=0x7f907802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152cb32efe9d2ff5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.100+0000 7f9085ffb640 1 -- 172.21.15.79:0/3607435638 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078037070 con 0x7f908815e4f0 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.100+0000 7f9085ffb640 1 -- 172.21.15.79:0/3607435638 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9078032440 con 0x7f908815e4f0 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.100+0000 7f9085ffb640 1 -- 172.21.15.79:0/3607435638 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078032810 con 0x7f908815e4f0 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.101+0000 7f908d5b6640 1 -- 172.21.15.79:0/3607435638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f908815e4f0 msgr2=0x7f90880d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.101+0000 7f908d5b6640 1 --2- 172.21.15.79:0/3607435638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f908815e4f0 0x7f90880d2ca0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f90780097d0 tx=0x7f907802a210 comp rx=0 tx=0).stop 2024-04-25T02:10:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.101+0000 7f908d5b6640 1 -- 172.21.15.79:0/3607435638 shutdown_connections 2024-04-25T02:10:23.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.101+0000 7f908d5b6640 1 --2- 172.21.15.79:0/3607435638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f908815e4f0 0x7f90880d2ca0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.101+0000 7f908d5b6640 1 -- 172.21.15.79:0/3607435638 >> 172.21.15.79:0/3607435638 conn(0x7f908809d4a0 msgr2=0x7f90880d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.101+0000 7f908d5b6640 1 -- 172.21.15.79:0/3607435638 shutdown_connections 2024-04-25T02:10:23.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.101+0000 7f908d5b6640 1 -- 172.21.15.79:0/3607435638 wait complete. 2024-04-25T02:10:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.102+0000 7f908d5b6640 1 Processor -- start 2024-04-25T02:10:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.102+0000 7f908d5b6640 1 -- start start 2024-04-25T02:10:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f908d5b6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90880cf7f0 0x7f908815a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f908d5b6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90880d10c0 0x7f90880cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f908d5b6640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f908815e4f0 0x7f908806be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f908d5b6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f90880cfc80 con 0x7f90880cf7f0 2024-04-25T02:10:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f908d5b6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f90880d50f0 con 0x7f90880d10c0 2024-04-25T02:10:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f908d5b6640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f90880cfe00 con 0x7f908815e4f0 2024-04-25T02:10:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f9086ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90880cf7f0 0x7f908815a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f9086ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90880cf7f0 0x7f908815a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45854/0 (socket says 172.21.15.79:45854) 2024-04-25T02:10:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f9086ffd640 1 -- 172.21.15.79:0/2753115457 learned_addr learned my addr 172.21.15.79:0/2753115457 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f90877fe640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f908815e4f0 0x7f908806be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f90867fc640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90880d10c0 0x7f90880cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f9086ffd640 1 -- 172.21.15.79:0/2753115457 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f908815e4f0 msgr2=0x7f908806be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f9086ffd640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f908815e4f0 0x7f908806be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f9086ffd640 1 -- 172.21.15.79:0/2753115457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90880d10c0 msgr2=0x7f90880cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f9086ffd640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90880d10c0 0x7f90880cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f9086ffd640 1 -- 172.21.15.79:0/2753115457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90880cc7d0 con 0x7f90880cf7f0 2024-04-25T02:10:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f90877fe640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f908815e4f0 0x7f908806be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f90867fc640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90880d10c0 0x7f90880cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.103+0000 7f9086ffd640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90880cf7f0 0x7f908815a0c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9078000c00 tx=0x7f90780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.104+0000 7f906f7fe640 1 -- 172.21.15.79:0/2753115457 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078037040 con 0x7f90880cf7f0 2024-04-25T02:10:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.104+0000 7f906f7fe640 1 -- 172.21.15.79:0/2753115457 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9078004250 con 0x7f90880cf7f0 2024-04-25T02:10:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.104+0000 7f908d5b6640 1 -- 172.21.15.79:0/2753115457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90881f7560 con 0x7f90880cf7f0 2024-04-25T02:10:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.104+0000 7f906f7fe640 1 -- 172.21.15.79:0/2753115457 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907803c730 con 0x7f90880cf7f0 2024-04-25T02:10:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.104+0000 7f908d5b6640 1 -- 172.21.15.79:0/2753115457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90881f7b20 con 0x7f90880cf7f0 2024-04-25T02:10:23.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.105+0000 7f908d5b6640 1 -- 172.21.15.79:0/2753115457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90880686c0 con 0x7f90880cf7f0 2024-04-25T02:10:23.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.105+0000 7f906f7fe640 1 -- 172.21.15.79:0/2753115457 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f907803a070 con 0x7f90880cf7f0 2024-04-25T02:10:23.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.105+0000 7f906f7fe640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f907406be30 0x7f907406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.105+0000 7f90867fc640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f907406be30 0x7f907406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.105+0000 7f906f7fe640 1 -- 172.21.15.79:0/2753115457 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4857+0+0 (secure 0 0 0) 0x7f90780ab3f0 con 0x7f90880cf7f0 2024-04-25T02:10:23.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.106+0000 7f90867fc640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f907406be30 0x7f907406e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f90880b80d0 tx=0x7f907c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.110+0000 7f906f7fe640 1 -- 172.21.15.79:0/2753115457 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9078041020 con 0x7f90880cf7f0 2024-04-25T02:10:23.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.281+0000 7f908d5b6640 1 -- 172.21.15.79:0/2753115457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f90881f3f10 con 0x7f90880cf7f0 2024-04-25T02:10:23.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.282+0000 7f906f7fe640 1 -- 172.21.15.79:0/2753115457 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) ==== 93+0+10 (secure 0 0 0) 0x7f90881f3f10 con 0x7f90880cf7f0 2024-04-25T02:10:23.289 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:10:23.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.283+0000 7f908d5b6640 1 -- 172.21.15.79:0/2753115457 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f907406be30 msgr2=0x7f907406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.283+0000 7f908d5b6640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f907406be30 0x7f907406e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f90880b80d0 tx=0x7f907c009040 comp rx=0 tx=0).stop 2024-04-25T02:10:23.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.284+0000 7f908d5b6640 1 -- 172.21.15.79:0/2753115457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90880cf7f0 msgr2=0x7f908815a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.284+0000 7f908d5b6640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90880cf7f0 0x7f908815a0c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9078000c00 tx=0x7f90780046c0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.284+0000 7f908d5b6640 1 -- 172.21.15.79:0/2753115457 shutdown_connections 2024-04-25T02:10:23.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.284+0000 7f908d5b6640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f907406be30 0x7f907406e2f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.284+0000 7f908d5b6640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f908815e4f0 0x7f908806be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.284+0000 7f908d5b6640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90880d10c0 0x7f90880cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.284+0000 7f908d5b6640 1 --2- 172.21.15.79:0/2753115457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90880cf7f0 0x7f908815a0c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.284+0000 7f908d5b6640 1 -- 172.21.15.79:0/2753115457 >> 172.21.15.79:0/2753115457 conn(0x7f908809d4a0 msgr2=0x7f90880b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.284+0000 7f908d5b6640 1 -- 172.21.15.79:0/2753115457 shutdown_connections 2024-04-25T02:10:23.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.284+0000 7f908d5b6640 1 -- 172.21.15.79:0/2753115457 wait complete. 2024-04-25T02:10:23.302 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T02:10:23.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.393+0000 7fc6192bd640 1 Processor -- start 2024-04-25T02:10:23.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.393+0000 7fc6192bd640 1 -- start start 2024-04-25T02:10:23.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.394+0000 7fc6192bd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6140ce860 0x7fc6140d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.394+0000 7fc6192bd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6140d29a0 0x7fc6140cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.394+0000 7fc6192bd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6140cf180 con 0x7fc61406f250 2024-04-25T02:10:23.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.394+0000 7fc6192bd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc6140ce340 con 0x7fc6140ce860 2024-04-25T02:10:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.394+0000 7fc6192bd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc6140d14e0 con 0x7fc6140d29a0 2024-04-25T02:10:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.394+0000 7fc612ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6140ce860 0x7fc6140d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.394+0000 7fc6137fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc61406f250 0x7fc61406f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55752/0 (socket says 172.21.15.79:55752) 2024-04-25T02:10:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.394+0000 7fc6137fe640 1 -- 172.21.15.79:0/104158357 learned_addr learned my addr 172.21.15.79:0/104158357 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.394+0000 7fc612ffd640 1 -- 172.21.15.79:0/104158357 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6140d29a0 msgr2=0x7fc6140cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.394+0000 7fc612ffd640 1 --2- 172.21.15.79:0/104158357 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6140d29a0 0x7fc6140cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.394+0000 7fc612ffd640 1 -- 172.21.15.79:0/104158357 >> v1:172.21.15.79:6789/0 conn(0x7fc61406f250 legacy=0x7fc61406f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.394+0000 7fc611ffb640 1 -- 172.21.15.79:0/104158357 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3226989365 0 0) 0x7fc6140cf180 con 0x7fc61406f250 2024-04-25T02:10:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.394+0000 7fc612ffd640 1 -- 172.21.15.79:0/104158357 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6140cc570 con 0x7fc6140ce860 2024-04-25T02:10:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.395+0000 7fc612ffd640 1 --2- 172.21.15.79:0/104158357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6140ce860 0x7fc6140d0150 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc6040097a0 tx=0x7fc60402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cd13644c3668a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.395+0000 7fc611ffb640 1 -- 172.21.15.79:0/104158357 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604037070 con 0x7fc6140ce860 2024-04-25T02:10:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.395+0000 7fc611ffb640 1 -- 172.21.15.79:0/104158357 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc604032440 con 0x7fc6140ce860 2024-04-25T02:10:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.395+0000 7fc611ffb640 1 -- 172.21.15.79:0/104158357 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604032810 con 0x7fc6140ce860 2024-04-25T02:10:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.395+0000 7fc6192bd640 1 -- 172.21.15.79:0/104158357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6140ce860 msgr2=0x7fc6140d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.395+0000 7fc6192bd640 1 --2- 172.21.15.79:0/104158357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6140ce860 0x7fc6140d0150 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc6040097a0 tx=0x7fc60402a180 comp rx=0 tx=0).stop 2024-04-25T02:10:23.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.396+0000 7fc6192bd640 1 -- 172.21.15.79:0/104158357 shutdown_connections 2024-04-25T02:10:23.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.396+0000 7fc6192bd640 1 --2- 172.21.15.79:0/104158357 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6140d29a0 0x7fc6140cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.396+0000 7fc6192bd640 1 --2- 172.21.15.79:0/104158357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6140ce860 0x7fc6140d0150 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.396+0000 7fc6192bd640 1 -- 172.21.15.79:0/104158357 >> 172.21.15.79:0/104158357 conn(0x7fc6140d1e80 msgr2=0x7fc6140d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.396+0000 7fc6192bd640 1 -- 172.21.15.79:0/104158357 shutdown_connections 2024-04-25T02:10:23.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.396+0000 7fc6192bd640 1 -- 172.21.15.79:0/104158357 wait complete. 2024-04-25T02:10:23.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.397+0000 7fc6192bd640 1 Processor -- start 2024-04-25T02:10:23.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.397+0000 7fc6192bd640 1 -- start start 2024-04-25T02:10:23.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc6192bd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc61406f250 0x7fc6141498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc6192bd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6140ce860 0x7fc6140c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc6192bd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6140d29a0 0x7fc6140c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc6192bd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140cce10 con 0x7fc61406f250 2024-04-25T02:10:23.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc6192bd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140ccb30 con 0x7fc6140d29a0 2024-04-25T02:10:23.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc6192bd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc61406c1c0 con 0x7fc6140ce860 2024-04-25T02:10:23.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc612ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc61406f250 0x7fc6141498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc612ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc61406f250 0x7fc6141498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45876/0 (socket says 172.21.15.79:45876) 2024-04-25T02:10:23.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc612ffd640 1 -- 172.21.15.79:0/400089931 learned_addr learned my addr 172.21.15.79:0/400089931 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:23.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc612ffd640 1 -- 172.21.15.79:0/400089931 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6140ce860 msgr2=0x7fc6140c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc612ffd640 1 --2- 172.21.15.79:0/400089931 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6140ce860 0x7fc6140c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc612ffd640 1 -- 172.21.15.79:0/400089931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6140d29a0 msgr2=0x7fc6140c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc612ffd640 1 --2- 172.21.15.79:0/400089931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6140d29a0 0x7fc6140c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc612ffd640 1 -- 172.21.15.79:0/400089931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61414c360 con 0x7fc61406f250 2024-04-25T02:10:23.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc612ffd640 1 --2- 172.21.15.79:0/400089931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc61406f250 0x7fc6141498e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc6040096f0 tx=0x7fc6040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc5fb7fe640 1 -- 172.21.15.79:0/400089931 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604037050 con 0x7fc61406f250 2024-04-25T02:10:23.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc5fb7fe640 1 -- 172.21.15.79:0/400089931 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc604038040 con 0x7fc61406f250 2024-04-25T02:10:23.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc6192bd640 1 -- 172.21.15.79:0/400089931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61414c640 con 0x7fc61406f250 2024-04-25T02:10:23.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc5fb7fe640 1 -- 172.21.15.79:0/400089931 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604004430 con 0x7fc61406f250 2024-04-25T02:10:23.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.398+0000 7fc6192bd640 1 -- 172.21.15.79:0/400089931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc61414cc00 con 0x7fc61406f250 2024-04-25T02:10:23.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.399+0000 7fc6192bd640 1 -- 172.21.15.79:0/400089931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6140690a0 con 0x7fc61406f250 2024-04-25T02:10:23.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.400+0000 7fc5fb7fe640 1 -- 172.21.15.79:0/400089931 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc604030980 con 0x7fc61406f250 2024-04-25T02:10:23.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.400+0000 7fc5fb7fe640 1 --2- 172.21.15.79:0/400089931 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc60006be30 0x7fc60006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.400+0000 7fc6127fc640 1 --2- 172.21.15.79:0/400089931 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc60006be30 0x7fc60006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.400+0000 7fc5fb7fe640 1 -- 172.21.15.79:0/400089931 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4857+0+0 (secure 0 0 0) 0x7fc6040ab7a0 con 0x7fc61406f250 2024-04-25T02:10:23.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.401+0000 7fc6127fc640 1 --2- 172.21.15.79:0/400089931 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc60006be30 0x7fc60006e2f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc614159d80 tx=0x7fc608006c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.404+0000 7fc5fb7fe640 1 -- 172.21.15.79:0/400089931 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc60407a650 con 0x7fc61406f250 2024-04-25T02:10:23.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.579+0000 7fc6192bd640 1 -- 172.21.15.79:0/400089931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc614070c60 con 0x7fc61406f250 2024-04-25T02:10:23.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.579+0000 7fc5fb7fe640 1 -- 172.21.15.79:0/400089931 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v55) ==== 84+0+65 (secure 0 0 0) 0x7fc604079f50 con 0x7fc61406f250 2024-04-25T02:10:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:23.587 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-04-25T02:10:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-04-25T02:10:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-04-25T02:10:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:23.588 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-04-25T02:10:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.581+0000 7fc6192bd640 1 -- 172.21.15.79:0/400089931 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc60006be30 msgr2=0x7fc60006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.581+0000 7fc6192bd640 1 --2- 172.21.15.79:0/400089931 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc60006be30 0x7fc60006e2f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc614159d80 tx=0x7fc608006c90 comp rx=0 tx=0).stop 2024-04-25T02:10:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.581+0000 7fc6192bd640 1 -- 172.21.15.79:0/400089931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc61406f250 msgr2=0x7fc6141498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.581+0000 7fc6192bd640 1 --2- 172.21.15.79:0/400089931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc61406f250 0x7fc6141498e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc6040096f0 tx=0x7fc6040046c0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.581+0000 7fc6192bd640 1 -- 172.21.15.79:0/400089931 shutdown_connections 2024-04-25T02:10:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.581+0000 7fc6192bd640 1 --2- 172.21.15.79:0/400089931 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc60006be30 0x7fc60006e2f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.581+0000 7fc6192bd640 1 --2- 172.21.15.79:0/400089931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6140d29a0 0x7fc6140c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.581+0000 7fc6192bd640 1 --2- 172.21.15.79:0/400089931 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6140ce860 0x7fc6140c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.581+0000 7fc6192bd640 1 --2- 172.21.15.79:0/400089931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc61406f250 0x7fc6141498e0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.581+0000 7fc6192bd640 1 -- 172.21.15.79:0/400089931 >> 172.21.15.79:0/400089931 conn(0x7fc6140d1e80 msgr2=0x7fc6141617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.582+0000 7fc6192bd640 1 -- 172.21.15.79:0/400089931 shutdown_connections 2024-04-25T02:10:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.582+0000 7fc6192bd640 1 -- 172.21.15.79:0/400089931 wait complete. 2024-04-25T02:10:23.600 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T02:10:23.600 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T02:10:23.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.693+0000 7fa79fdd5640 1 Processor -- start 2024-04-25T02:10:23.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.693+0000 7fa79fdd5640 1 -- start start 2024-04-25T02:10:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.694+0000 7fa79fdd5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa79815c250 0x7fa79806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.694+0000 7fa79fdd5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa7980cdc20 0x7fa7980b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.694+0000 7fa79fdd5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa7980af740 0x7fa7980b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.694+0000 7fa79fdd5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa7980aff50 con 0x7fa79815c250 2024-04-25T02:10:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.694+0000 7fa79fdd5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fa79806de90 con 0x7fa7980cdc20 2024-04-25T02:10:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.694+0000 7fa79fdd5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa7980cf7e0 con 0x7fa7980af740 2024-04-25T02:10:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.694+0000 7fa79db71640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa79815c250 0x7fa79806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.694+0000 7fa79db71640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa79815c250 0x7fa79806b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35234/0 (socket says 172.21.15.79:35234) 2024-04-25T02:10:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.694+0000 7fa79db71640 1 -- 172.21.15.79:0/718244983 learned_addr learned my addr 172.21.15.79:0/718244983 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.694+0000 7fa79e372640 1 --2- 172.21.15.79:0/718244983 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa7980af740 0x7fa7980b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.695+0000 7fa79d370640 1 --2- 172.21.15.79:0/718244983 >> v2:172.21.15.189:3300/0 conn(0x7fa7980cdc20 0x7fa7980b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.695+0000 7fa79db71640 1 -- 172.21.15.79:0/718244983 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa7980af740 msgr2=0x7fa7980b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.695+0000 7fa79db71640 1 --2- 172.21.15.79:0/718244983 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa7980af740 0x7fa7980b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.695+0000 7fa79db71640 1 -- 172.21.15.79:0/718244983 >> v2:172.21.15.189:3300/0 conn(0x7fa7980cdc20 msgr2=0x7fa7980b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.695+0000 7fa79db71640 1 --2- 172.21.15.79:0/718244983 >> v2:172.21.15.189:3300/0 conn(0x7fa7980cdc20 0x7fa7980b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.695+0000 7fa79db71640 1 -- 172.21.15.79:0/718244983 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7980cf500 con 0x7fa79815c250 2024-04-25T02:10:23.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.695+0000 7fa79d370640 1 --2- 172.21.15.79:0/718244983 >> v2:172.21.15.189:3300/0 conn(0x7fa7980cdc20 0x7fa7980b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:23.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.695+0000 7fa79db71640 1 --2- 172.21.15.79:0/718244983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa79815c250 0x7fa79806b0b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa798070c60 tx=0x7fa79402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83f04b7e1a5458d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.695+0000 7fa79cb6f640 1 -- 172.21.15.79:0/718244983 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa794036070 con 0x7fa79815c250 2024-04-25T02:10:23.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.695+0000 7fa79cb6f640 1 -- 172.21.15.79:0/718244983 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa794031600 con 0x7fa79815c250 2024-04-25T02:10:23.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.695+0000 7fa79cb6f640 1 -- 172.21.15.79:0/718244983 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7940319d0 con 0x7fa79815c250 2024-04-25T02:10:23.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.696+0000 7fa79fdd5640 1 -- 172.21.15.79:0/718244983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa79815c250 msgr2=0x7fa79806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.696+0000 7fa79fdd5640 1 --2- 172.21.15.79:0/718244983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa79815c250 0x7fa79806b0b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa798070c60 tx=0x7fa79402a610 comp rx=0 tx=0).stop 2024-04-25T02:10:23.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.696+0000 7fa79fdd5640 1 -- 172.21.15.79:0/718244983 shutdown_connections 2024-04-25T02:10:23.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.696+0000 7fa79fdd5640 1 --2- 172.21.15.79:0/718244983 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa7980af740 0x7fa7980b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.696+0000 7fa79fdd5640 1 --2- 172.21.15.79:0/718244983 >> v2:172.21.15.189:3300/0 conn(0x7fa7980cdc20 0x7fa7980b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.696+0000 7fa79fdd5640 1 --2- 172.21.15.79:0/718244983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa79815c250 0x7fa79806b0b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.696+0000 7fa79fdd5640 1 -- 172.21.15.79:0/718244983 >> 172.21.15.79:0/718244983 conn(0x7fa7980ccef0 msgr2=0x7fa7980cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.696+0000 7fa79fdd5640 1 -- 172.21.15.79:0/718244983 shutdown_connections 2024-04-25T02:10:23.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.696+0000 7fa79fdd5640 1 -- 172.21.15.79:0/718244983 wait complete. 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.697+0000 7fa79fdd5640 1 Processor -- start 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.697+0000 7fa79fdd5640 1 -- start start 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79fdd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7980af740 0x7fa7980aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79fdd5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7980cdc20 0x7fa798154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79fdd5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa79815c250 0x7fa798154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79fdd5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa79806e150 con 0x7fa7980af740 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79fdd5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa798067500 con 0x7fa7980cdc20 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79fdd5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa798067220 con 0x7fa79815c250 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79db71640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7980af740 0x7fa7980aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79db71640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7980af740 0x7fa7980aba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35236/0 (socket says 172.21.15.79:35236) 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79db71640 1 -- 172.21.15.79:0/2756231960 learned_addr learned my addr 172.21.15.79:0/2756231960 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79db71640 1 -- 172.21.15.79:0/2756231960 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa79815c250 msgr2=0x7fa798154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79e372640 1 --2- 172.21.15.79:0/2756231960 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa79815c250 0x7fa798154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79d370640 1 --2- 172.21.15.79:0/2756231960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7980cdc20 0x7fa798154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79db71640 1 --2- 172.21.15.79:0/2756231960 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa79815c250 0x7fa798154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79db71640 1 -- 172.21.15.79:0/2756231960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7980cdc20 msgr2=0x7fa798154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79db71640 1 --2- 172.21.15.79:0/2756231960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7980cdc20 0x7fa798154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79db71640 1 -- 172.21.15.79:0/2756231960 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa798159560 con 0x7fa7980af740 2024-04-25T02:10:23.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.698+0000 7fa79e372640 1 --2- 172.21.15.79:0/2756231960 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa79815c250 0x7fa798154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:23.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.699+0000 7fa79db71640 1 --2- 172.21.15.79:0/2756231960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7980af740 0x7fa7980aba60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa794000f80 tx=0x7fa794004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.699+0000 7fa78e7fc640 1 -- 172.21.15.79:0/2756231960 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa794036050 con 0x7fa7980af740 2024-04-25T02:10:23.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.699+0000 7fa78e7fc640 1 -- 172.21.15.79:0/2756231960 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa794042070 con 0x7fa7980af740 2024-04-25T02:10:23.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.699+0000 7fa78e7fc640 1 -- 172.21.15.79:0/2756231960 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa794009510 con 0x7fa7980af740 2024-04-25T02:10:23.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.699+0000 7fa79fdd5640 1 -- 172.21.15.79:0/2756231960 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7980aa450 con 0x7fa7980af740 2024-04-25T02:10:23.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.699+0000 7fa79fdd5640 1 -- 172.21.15.79:0/2756231960 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7980aaa10 con 0x7fa7980af740 2024-04-25T02:10:23.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.700+0000 7fa79fdd5640 1 -- 172.21.15.79:0/2756231960 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7980cd2d0 con 0x7fa7980af740 2024-04-25T02:10:23.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.700+0000 7fa78e7fc640 1 -- 172.21.15.79:0/2756231960 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa794007c70 con 0x7fa7980af740 2024-04-25T02:10:23.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.700+0000 7fa78e7fc640 1 --2- 172.21.15.79:0/2756231960 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa77c06be30 0x7fa77c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.701+0000 7fa79d370640 1 --2- 172.21.15.79:0/2756231960 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa77c06be30 0x7fa77c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.701+0000 7fa78e7fc640 1 -- 172.21.15.79:0/2756231960 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4857+0+0 (secure 0 0 0) 0x7fa7940ab9f0 con 0x7fa7980af740 2024-04-25T02:10:23.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.701+0000 7fa79d370640 1 --2- 172.21.15.79:0/2756231960 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa77c06be30 0x7fa77c06e2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa7980b1030 tx=0x7fa788008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.705+0000 7fa78e7fc640 1 -- 172.21.15.79:0/2756231960 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa7980cd2d0 con 0x7fa7980af740 2024-04-25T02:10:23.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:23.882+0000 7fa79fdd5640 1 -- 172.21.15.79:0/2756231960 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa7980aabe0 con 0x7fa7980af740 2024-04-25T02:10:24.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.329+0000 7fa78e7fc640 1 -- 172.21.15.79:0/2756231960 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v56) ==== 138+0+0 (secure 0 0 0) 0x7fa79407a6f0 con 0x7fa7980af740 2024-04-25T02:10:24.337 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-04-25T02:10:24.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.332+0000 7fa79fdd5640 1 -- 172.21.15.79:0/2756231960 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa77c06be30 msgr2=0x7fa77c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.332+0000 7fa79fdd5640 1 --2- 172.21.15.79:0/2756231960 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa77c06be30 0x7fa77c06e2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa7980b1030 tx=0x7fa788008040 comp rx=0 tx=0).stop 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.332+0000 7fa79fdd5640 1 -- 172.21.15.79:0/2756231960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7980af740 msgr2=0x7fa7980aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.332+0000 7fa79fdd5640 1 --2- 172.21.15.79:0/2756231960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7980af740 0x7fa7980aba60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa794000f80 tx=0x7fa794004a40 comp rx=0 tx=0).stop 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.332+0000 7fa79fdd5640 1 -- 172.21.15.79:0/2756231960 shutdown_connections 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.332+0000 7fa79fdd5640 1 --2- 172.21.15.79:0/2756231960 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa77c06be30 0x7fa77c06e2f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.332+0000 7fa79fdd5640 1 --2- 172.21.15.79:0/2756231960 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa79815c250 0x7fa798154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.332+0000 7fa79fdd5640 1 --2- 172.21.15.79:0/2756231960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7980cdc20 0x7fa798154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.332+0000 7fa79fdd5640 1 --2- 172.21.15.79:0/2756231960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7980af740 0x7fa7980aba60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.332+0000 7fa79fdd5640 1 -- 172.21.15.79:0/2756231960 >> 172.21.15.79:0/2756231960 conn(0x7fa7980ccef0 msgr2=0x7fa79815ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.332+0000 7fa79fdd5640 1 -- 172.21.15.79:0/2756231960 shutdown_connections 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.332+0000 7fa79fdd5640 1 -- 172.21.15.79:0/2756231960 wait complete. 2024-04-25T02:10:24.355 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T02:10:24.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.452+0000 7f52b7e72640 1 Processor -- start 2024-04-25T02:10:24.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.452+0000 7f52b7e72640 1 -- start start 2024-04-25T02:10:24.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b7e72640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52b006fdd0 0x7f52b006c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b7e72640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f52b006c600 0x7f52b00c9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b7e72640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52b015e790 con 0x7f52b015e3b0 2024-04-25T02:10:24.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b7e72640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f52b00728b0 con 0x7f52b006c600 2024-04-25T02:10:24.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b7e72640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f52b0161e80 con 0x7f52b006fdd0 2024-04-25T02:10:24.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b5c0e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f52b015e3b0 0x7f52b00721a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53770/0 (socket says 172.21.15.79:53770) 2024-04-25T02:10:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b5c0e640 1 -- 172.21.15.79:0/511600018 learned_addr learned my addr 172.21.15.79:0/511600018 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 -- 172.21.15.79:0/511600018 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 206034740 0 0) 0x7f52b015e790 con 0x7f52b015e3b0 2024-04-25T02:10:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 -- 172.21.15.79:0/511600018 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f529c003520 con 0x7f52b015e3b0 2024-04-25T02:10:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b540d640 1 --2- 172.21.15.79:0/511600018 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52b006fdd0 0x7f52b006c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b640f640 1 --2- 172.21.15.79:0/511600018 >> v2:172.21.15.189:3300/0 conn(0x7f52b006c600 0x7f52b00c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 -- 172.21.15.79:0/511600018 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3790525654 0 0) 0x7f529c003520 con 0x7f52b015e3b0 2024-04-25T02:10:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 -- 172.21.15.79:0/511600018 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52b006fdd0 msgr2=0x7f52b006c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 --2- 172.21.15.79:0/511600018 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52b006fdd0 0x7f52b006c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 -- 172.21.15.79:0/511600018 >> v2:172.21.15.189:3300/0 conn(0x7f52b006c600 msgr2=0x7f52b00c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 --2- 172.21.15.79:0/511600018 >> v2:172.21.15.189:3300/0 conn(0x7f52b006c600 0x7f52b00c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 -- 172.21.15.79:0/511600018 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b01620d0 con 0x7f52b015e3b0 2024-04-25T02:10:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 -- 172.21.15.79:0/511600018 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f52ac001670 con 0x7f52b015e3b0 2024-04-25T02:10:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 -- 172.21.15.79:0/511600018 >> v1:172.21.15.79:6789/0 conn(0x7f52b015e3b0 legacy=0x7f52b00721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 --2- 172.21.15.79:0/511600018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529c0039b0 0x7f529c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 --2- 172.21.15.79:0/511600018 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52b006fdd0 0x7f529c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 --2- 172.21.15.79:0/511600018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f529c004d40 0x7f529c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 -- 172.21.15.79:0/511600018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f52b00728b0 con 0x7f529c0039b0 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 -- 172.21.15.79:0/511600018 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f52b0161e80 con 0x7f529c004d40 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b4c0c640 1 -- 172.21.15.79:0/511600018 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f529c00ba40 con 0x7f52b006fdd0 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b5c0e640 1 --2- 172.21.15.79:0/511600018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529c0039b0 0x7f529c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b540d640 1 --2- 172.21.15.79:0/511600018 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52b006fdd0 0x7f529c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.453+0000 7f52b640f640 1 --2- 172.21.15.79:0/511600018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f529c004d40 0x7f529c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.454+0000 7f52b5c0e640 1 -- 172.21.15.79:0/511600018 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52b006fdd0 msgr2=0x7f529c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.454+0000 7f52b5c0e640 1 --2- 172.21.15.79:0/511600018 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52b006fdd0 0x7f529c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.454+0000 7f52b5c0e640 1 -- 172.21.15.79:0/511600018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f529c004d40 msgr2=0x7f529c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.454+0000 7f52b5c0e640 1 --2- 172.21.15.79:0/511600018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f529c004d40 0x7f529c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.454+0000 7f52b5c0e640 1 -- 172.21.15.79:0/511600018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529c003520 con 0x7f529c0039b0 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.454+0000 7f52b640f640 1 --2- 172.21.15.79:0/511600018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f529c004d40 0x7f529c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.454+0000 7f52b5c0e640 1 --2- 172.21.15.79:0/511600018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529c0039b0 0x7f529c003dd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f52ac007fd0 tx=0x7f529c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410b6221a082cb80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.454+0000 7f52b4c0c640 1 -- 172.21.15.79:0/511600018 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac007d50 con 0x7f529c0039b0 2024-04-25T02:10:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.454+0000 7f52b4c0c640 1 -- 172.21.15.79:0/511600018 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac005ad0 con 0x7f529c0039b0 2024-04-25T02:10:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.454+0000 7f52b4c0c640 1 -- 172.21.15.79:0/511600018 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac007070 con 0x7f529c0039b0 2024-04-25T02:10:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.455+0000 7f52b7e72640 1 -- 172.21.15.79:0/511600018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529c0039b0 msgr2=0x7f529c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.455+0000 7f52b7e72640 1 --2- 172.21.15.79:0/511600018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f529c0039b0 0x7f529c003dd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f52ac007fd0 tx=0x7f529c005830 comp rx=0 tx=0).stop 2024-04-25T02:10:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.455+0000 7f52b640f640 1 -- 172.21.15.79:0/511600018 reap_dead start 2024-04-25T02:10:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.455+0000 7f52b7e72640 1 -- 172.21.15.79:0/511600018 shutdown_connections 2024-04-25T02:10:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.455+0000 7f52b7e72640 1 -- 172.21.15.79:0/511600018 >> 172.21.15.79:0/511600018 conn(0x7f52b00716b0 msgr2=0x7f52b0071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.455+0000 7f52b7e72640 1 -- 172.21.15.79:0/511600018 shutdown_connections 2024-04-25T02:10:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.455+0000 7f52b7e72640 1 -- 172.21.15.79:0/511600018 wait complete. 2024-04-25T02:10:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.456+0000 7f52b7e72640 1 Processor -- start 2024-04-25T02:10:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.456+0000 7f52b7e72640 1 -- start start 2024-04-25T02:10:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b7e72640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f529c0039b0 0x7f52b015f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b7e72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52b00cf150 0x7f52b00cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b7e72640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52b00b3300 0x7f52b00b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b7e72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f52b0162690 con 0x7f52b00cf150 2024-04-25T02:10:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b7e72640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f52b006ca30 con 0x7f52b00b3300 2024-04-25T02:10:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b7e72640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f52b0162970 con 0x7f529c0039b0 2024-04-25T02:10:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b540d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52b00cf150 0x7f52b00cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b540d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52b00cf150 0x7f52b00cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35250/0 (socket says 172.21.15.79:35250) 2024-04-25T02:10:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b540d640 1 -- 172.21.15.79:0/3608351238 learned_addr learned my addr 172.21.15.79:0/3608351238 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b640f640 1 --2- 172.21.15.79:0/3608351238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52b00b3300 0x7f52b00b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b5c0e640 1 --2- 172.21.15.79:0/3608351238 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f529c0039b0 0x7f52b015f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b540d640 1 -- 172.21.15.79:0/3608351238 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f529c0039b0 msgr2=0x7f52b015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b540d640 1 --2- 172.21.15.79:0/3608351238 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f529c0039b0 0x7f52b015f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b540d640 1 -- 172.21.15.79:0/3608351238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52b00b3300 msgr2=0x7f52b00b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b540d640 1 --2- 172.21.15.79:0/3608351238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52b00b3300 0x7f52b00b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b540d640 1 -- 172.21.15.79:0/3608351238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b00b3ee0 con 0x7f52b00cf150 2024-04-25T02:10:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b640f640 1 --2- 172.21.15.79:0/3608351238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52b00b3300 0x7f52b00b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.457+0000 7f52b540d640 1 --2- 172.21.15.79:0/3608351238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52b00cf150 0x7f52b00cf5b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f52a0011560 tx=0x7f52a0011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.458+0000 7f52a67fc640 1 -- 172.21.15.79:0/3608351238 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0004220 con 0x7f52b00cf150 2024-04-25T02:10:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.458+0000 7f52a67fc640 1 -- 172.21.15.79:0/3608351238 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a00043c0 con 0x7f52b00cf150 2024-04-25T02:10:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.458+0000 7f52b7e72640 1 -- 172.21.15.79:0/3608351238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b00b41c0 con 0x7f52b00cf150 2024-04-25T02:10:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.458+0000 7f52a67fc640 1 -- 172.21.15.79:0/3608351238 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0015870 con 0x7f52b00cf150 2024-04-25T02:10:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.458+0000 7f52b7e72640 1 -- 172.21.15.79:0/3608351238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b015eeb0 con 0x7f52b00cf150 2024-04-25T02:10:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.459+0000 7f52b7e72640 1 -- 172.21.15.79:0/3608351238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b00690a0 con 0x7f52b00cf150 2024-04-25T02:10:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.459+0000 7f52a67fc640 1 -- 172.21.15.79:0/3608351238 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52a0015a10 con 0x7f52b00cf150 2024-04-25T02:10:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.459+0000 7f52a67fc640 1 --2- 172.21.15.79:0/3608351238 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f529406be60 0x7f529406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.460+0000 7f52a67fc640 1 -- 172.21.15.79:0/3608351238 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5227+0+0 (secure 0 0 0) 0x7f52a008b2d0 con 0x7f52b00cf150 2024-04-25T02:10:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.460+0000 7f52b5c0e640 1 --2- 172.21.15.79:0/3608351238 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f529406be60 0x7f529406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.460+0000 7f52b5c0e640 1 --2- 172.21.15.79:0/3608351238 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f529406be60 0x7f529406e320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f52ac033000 tx=0x7f52ac009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.464+0000 7f52a67fc640 1 -- 172.21.15.79:0/3608351238 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f52a0019030 con 0x7f52b00cf150 2024-04-25T02:10:24.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:24.639+0000 7f52b7e72640 1 -- 172.21.15.79:0/3608351238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f52b006b430 con 0x7f52b00cf150 2024-04-25T02:10:25.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.333+0000 7f52a67fc640 1 -- 172.21.15.79:0/3608351238 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v57) ==== 170+0+0 (secure 0 0 0) 0x7f52a0059e60 con 0x7f52b00cf150 2024-04-25T02:10:25.342 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-04-25T02:10:25.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.337+0000 7f52b7e72640 1 -- 172.21.15.79:0/3608351238 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f529406be60 msgr2=0x7f529406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.337+0000 7f52b7e72640 1 --2- 172.21.15.79:0/3608351238 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f529406be60 0x7f529406e320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f52ac033000 tx=0x7f52ac009030 comp rx=0 tx=0).stop 2024-04-25T02:10:25.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.337+0000 7f52b7e72640 1 -- 172.21.15.79:0/3608351238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52b00cf150 msgr2=0x7f52b00cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.337+0000 7f52b7e72640 1 --2- 172.21.15.79:0/3608351238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52b00cf150 0x7f52b00cf5b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f52a0011560 tx=0x7f52a0011a20 comp rx=0 tx=0).stop 2024-04-25T02:10:25.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.337+0000 7f52b7e72640 1 -- 172.21.15.79:0/3608351238 shutdown_connections 2024-04-25T02:10:25.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.337+0000 7f52b7e72640 1 --2- 172.21.15.79:0/3608351238 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f529406be60 0x7f529406e320 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:25.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.337+0000 7f52b7e72640 1 --2- 172.21.15.79:0/3608351238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52b00b3300 0x7f52b00b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:25.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.337+0000 7f52b7e72640 1 --2- 172.21.15.79:0/3608351238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52b00cf150 0x7f52b00cf5b0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:25.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.337+0000 7f52b7e72640 1 --2- 172.21.15.79:0/3608351238 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f529c0039b0 0x7f52b015f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:25.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.337+0000 7f52b7e72640 1 -- 172.21.15.79:0/3608351238 >> 172.21.15.79:0/3608351238 conn(0x7f52b00716b0 msgr2=0x7f52b0071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:25.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.337+0000 7f52b7e72640 1 -- 172.21.15.79:0/3608351238 shutdown_connections 2024-04-25T02:10:25.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.337+0000 7f52b7e72640 1 -- 172.21.15.79:0/3608351238 wait complete. 2024-04-25T02:10:25.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T02:10:25.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.461+0000 7fd582c64640 1 Processor -- start 2024-04-25T02:10:25.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.461+0000 7fd582c64640 1 -- start start 2024-04-25T02:10:25.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.462+0000 7fd582c64640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd57c0cf7a0 0x7fd57c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:25.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.462+0000 7fd582c64640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd57c15ec20 con 0x7fd57c06e6b0 2024-04-25T02:10:25.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.462+0000 7fd582c64640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd57c15ef00 con 0x7fd57c06b2f0 2024-04-25T02:10:25.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.462+0000 7fd582c64640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd57c15f830 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.462+0000 7fd581201640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd57c06e6b0 0x7fd57c15b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53780/0 (socket says 172.21.15.79:53780) 2024-04-25T02:10:25.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.462+0000 7fd581201640 1 -- 172.21.15.79:0/2477131211 learned_addr learned my addr 172.21.15.79:0/2477131211 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:25.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.462+0000 7fd57bfff640 1 --2- 172.21.15.79:0/2477131211 >> v2:172.21.15.189:3300/0 conn(0x7fd57c0cf7a0 0x7fd57c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:25.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.463+0000 7fd57b7fe640 1 -- 172.21.15.79:0/2477131211 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3503018477 0 0) 0x7fd57c15ec20 con 0x7fd57c06e6b0 2024-04-25T02:10:25.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.463+0000 7fd57b7fe640 1 -- 172.21.15.79:0/2477131211 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd568003520 con 0x7fd57c06e6b0 2024-04-25T02:10:25.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.463+0000 7fd57bfff640 1 -- 172.21.15.79:0/2477131211 >> v1:172.21.15.189:6789/0 conn(0x7fd57c06b2f0 legacy=0x7fd57c06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.463+0000 7fd57bfff640 1 -- 172.21.15.79:0/2477131211 >> v1:172.21.15.79:6789/0 conn(0x7fd57c06e6b0 legacy=0x7fd57c15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.463+0000 7fd57bfff640 1 -- 172.21.15.79:0/2477131211 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57c15f1e0 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.463+0000 7fd57bfff640 1 --2- 172.21.15.79:0/2477131211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd57c0cf7a0 0x7fd57c0b4b50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd5640097a0 tx=0x7fd56402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aa170efef762467 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:25.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.464+0000 7fd57b7fe640 1 -- 172.21.15.79:0/2477131211 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd564037070 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.464+0000 7fd57b7fe640 1 -- 172.21.15.79:0/2477131211 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd564032440 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.464+0000 7fd57b7fe640 1 -- 172.21.15.79:0/2477131211 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5640327f0 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.464+0000 7fd582c64640 1 -- 172.21.15.79:0/2477131211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd57c0cf7a0 msgr2=0x7fd57c0b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.464+0000 7fd582c64640 1 --2- 172.21.15.79:0/2477131211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd57c0cf7a0 0x7fd57c0b4b50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd5640097a0 tx=0x7fd56402a1a0 comp rx=0 tx=0).stop 2024-04-25T02:10:25.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.464+0000 7fd582c64640 1 -- 172.21.15.79:0/2477131211 shutdown_connections 2024-04-25T02:10:25.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.464+0000 7fd582c64640 1 --2- 172.21.15.79:0/2477131211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd57c0cf7a0 0x7fd57c0b4b50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:25.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.464+0000 7fd582c64640 1 -- 172.21.15.79:0/2477131211 >> 172.21.15.79:0/2477131211 conn(0x7fd57c0b1cd0 msgr2=0x7fd57c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:25.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.464+0000 7fd582c64640 1 -- 172.21.15.79:0/2477131211 shutdown_connections 2024-04-25T02:10:25.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.464+0000 7fd582c64640 1 -- 172.21.15.79:0/2477131211 wait complete. 2024-04-25T02:10:25.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.465+0000 7fd582c64640 1 Processor -- start 2024-04-25T02:10:25.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.465+0000 7fd582c64640 1 -- start start 2024-04-25T02:10:25.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.466+0000 7fd582c64640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd57c06b2f0 0x7fd57c1f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:25.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.466+0000 7fd582c64640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd57c06e6b0 0x7fd57c0ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:25.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.466+0000 7fd582c64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd57c0cf7a0 0x7fd57c0ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:25.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.466+0000 7fd582c64640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c06d160 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.466+0000 7fd582c64640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c06cfe0 con 0x7fd57c06b2f0 2024-04-25T02:10:25.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.466+0000 7fd582c64640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd57c15b9e0 con 0x7fd57c06e6b0 2024-04-25T02:10:25.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.466+0000 7fd581201640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd57c0cf7a0 0x7fd57c0ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:25.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.466+0000 7fd581201640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd57c0cf7a0 0x7fd57c0ade00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35260/0 (socket says 172.21.15.79:35260) 2024-04-25T02:10:25.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.466+0000 7fd581201640 1 -- 172.21.15.79:0/3259430458 learned_addr learned my addr 172.21.15.79:0/3259430458 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:25.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.467+0000 7fd57bfff640 1 --2- 172.21.15.79:0/3259430458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd57c06e6b0 0x7fd57c0ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:25.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.467+0000 7fd580a00640 1 --2- 172.21.15.79:0/3259430458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd57c06b2f0 0x7fd57c1f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:25.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.467+0000 7fd581201640 1 -- 172.21.15.79:0/3259430458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd57c06e6b0 msgr2=0x7fd57c0ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.467+0000 7fd581201640 1 --2- 172.21.15.79:0/3259430458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd57c06e6b0 0x7fd57c0ad8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:25.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.467+0000 7fd581201640 1 -- 172.21.15.79:0/3259430458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd57c06b2f0 msgr2=0x7fd57c1f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.467+0000 7fd581201640 1 --2- 172.21.15.79:0/3259430458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd57c06b2f0 0x7fd57c1f2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:25.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.467+0000 7fd581201640 1 -- 172.21.15.79:0/3259430458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57c09ab10 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.467+0000 7fd581201640 1 --2- 172.21.15.79:0/3259430458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd57c0cf7a0 0x7fd57c0ade00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd57400cb40 tx=0x7fd57400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:25.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.467+0000 7fd5797fa640 1 -- 172.21.15.79:0/3259430458 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd574017070 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.467+0000 7fd582c64640 1 -- 172.21.15.79:0/3259430458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd57c09adf0 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.467+0000 7fd5797fa640 1 -- 172.21.15.79:0/3259430458 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd57400aca0 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.467+0000 7fd5797fa640 1 -- 172.21.15.79:0/3259430458 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd574012620 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.467+0000 7fd582c64640 1 -- 172.21.15.79:0/3259430458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd57c09b3b0 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.468+0000 7fd582c64640 1 -- 172.21.15.79:0/3259430458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd57c0690a0 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.468+0000 7fd5797fa640 1 -- 172.21.15.79:0/3259430458 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd57401a070 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.469+0000 7fd5797fa640 1 --2- 172.21.15.79:0/3259430458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd55c06be30 0x7fd55c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:25.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.469+0000 7fd5797fa640 1 -- 172.21.15.79:0/3259430458 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5609+0+0 (secure 0 0 0) 0x7fd57408acb0 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.469+0000 7fd580a00640 1 --2- 172.21.15.79:0/3259430458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd55c06be30 0x7fd55c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:25.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.469+0000 7fd580a00640 1 --2- 172.21.15.79:0/3259430458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd55c06be30 0x7fd55c06e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd56c007fd0 tx=0x7fd56c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:25.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.473+0000 7fd5797fa640 1 -- 172.21.15.79:0/3259430458 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd574059640 con 0x7fd57c0cf7a0 2024-04-25T02:10:25.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:25.683+0000 7fd582c64640 1 -- 172.21.15.79:0/3259430458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd57c0cf4f0 con 0x7fd57c0cf7a0 2024-04-25T02:10:26.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.335+0000 7fd5797fa640 1 -- 172.21.15.79:0/3259430458 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v22) ==== 172+0+0 (secure 0 0 0) 0x7fd574058f40 con 0x7fd57c0cf7a0 2024-04-25T02:10:26.343 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 8 and data pool 9 2024-04-25T02:10:26.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.339+0000 7fd582c64640 1 -- 172.21.15.79:0/3259430458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd55c06be30 msgr2=0x7fd55c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.339+0000 7fd582c64640 1 --2- 172.21.15.79:0/3259430458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd55c06be30 0x7fd55c06e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd56c007fd0 tx=0x7fd56c009040 comp rx=0 tx=0).stop 2024-04-25T02:10:26.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.339+0000 7fd582c64640 1 -- 172.21.15.79:0/3259430458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd57c0cf7a0 msgr2=0x7fd57c0ade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.339+0000 7fd582c64640 1 --2- 172.21.15.79:0/3259430458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd57c0cf7a0 0x7fd57c0ade00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd57400cb40 tx=0x7fd57400a060 comp rx=0 tx=0).stop 2024-04-25T02:10:26.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.342+0000 7fd582c64640 1 -- 172.21.15.79:0/3259430458 shutdown_connections 2024-04-25T02:10:26.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.342+0000 7fd582c64640 1 --2- 172.21.15.79:0/3259430458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd55c06be30 0x7fd55c06e2f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.342+0000 7fd582c64640 1 --2- 172.21.15.79:0/3259430458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd57c0cf7a0 0x7fd57c0ade00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.342+0000 7fd582c64640 1 --2- 172.21.15.79:0/3259430458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd57c06e6b0 0x7fd57c0ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.342+0000 7fd582c64640 1 --2- 172.21.15.79:0/3259430458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd57c06b2f0 0x7fd57c1f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.342+0000 7fd582c64640 1 -- 172.21.15.79:0/3259430458 >> 172.21.15.79:0/3259430458 conn(0x7fd57c0b1cd0 msgr2=0x7fd57c0b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:26.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.346+0000 7fd582c64640 1 -- 172.21.15.79:0/3259430458 shutdown_connections 2024-04-25T02:10:26.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.347+0000 7fd582c64640 1 -- 172.21.15.79:0/3259430458 wait complete. 2024-04-25T02:10:26.382 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:26.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.472+0000 7f1e846d4640 1 Processor -- start 2024-04-25T02:10:26.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.472+0000 7f1e846d4640 1 -- start start 2024-04-25T02:10:26.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.473+0000 7f1e846d4640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1e7c15e4d0 0x7f1e7c06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.473+0000 7f1e846d4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e7c0d2e20 0x7f1e7c0cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.473+0000 7f1e846d4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e7c0d1660 con 0x7f1e7c0b3570 2024-04-25T02:10:26.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.473+0000 7f1e846d4640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f1e7c0d1380 con 0x7f1e7c15e4d0 2024-04-25T02:10:26.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.473+0000 7f1e846d4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1e7c0cede0 con 0x7f1e7c0d2e20 2024-04-25T02:10:26.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e81c6f640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1e7c0b3570 0x7f1e7c0d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53790/0 (socket says 172.21.15.79:53790) 2024-04-25T02:10:26.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e81c6f640 1 -- 172.21.15.79:0/1617036045 learned_addr learned my addr 172.21.15.79:0/1617036045 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:26.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e82c71640 1 --2- 172.21.15.79:0/1617036045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e7c0d2e20 0x7f1e7c0cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e82470640 1 --2- 172.21.15.79:0/1617036045 >> v2:172.21.15.189:3300/0 conn(0x7f1e7c15e4d0 0x7f1e7c06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 -- 172.21.15.79:0/1617036045 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1235422087 0 0) 0x7f1e7c0d1660 con 0x7f1e7c0b3570 2024-04-25T02:10:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 -- 172.21.15.79:0/1617036045 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e68003520 con 0x7f1e7c0b3570 2024-04-25T02:10:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 -- 172.21.15.79:0/1617036045 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2945297197 0 0) 0x7f1e68003520 con 0x7f1e7c0b3570 2024-04-25T02:10:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 -- 172.21.15.79:0/1617036045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e7c0d2e20 msgr2=0x7f1e7c0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 --2- 172.21.15.79:0/1617036045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e7c0d2e20 0x7f1e7c0cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 -- 172.21.15.79:0/1617036045 >> v2:172.21.15.189:3300/0 conn(0x7f1e7c15e4d0 msgr2=0x7f1e7c06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 --2- 172.21.15.79:0/1617036045 >> v2:172.21.15.189:3300/0 conn(0x7f1e7c15e4d0 0x7f1e7c06bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 -- 172.21.15.79:0/1617036045 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e7c0cf0c0 con 0x7f1e7c0b3570 2024-04-25T02:10:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 -- 172.21.15.79:0/1617036045 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f1e6c001670 con 0x7f1e7c0b3570 2024-04-25T02:10:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 -- 172.21.15.79:0/1617036045 >> v1:172.21.15.79:6789/0 conn(0x7f1e7c0b3570 legacy=0x7f1e7c0d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 --2- 172.21.15.79:0/1617036045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e680039b0 0x7f1e68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 --2- 172.21.15.79:0/1617036045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e7c0d2e20 0x7f1e68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 --2- 172.21.15.79:0/1617036045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e68004d40 0x7f1e680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 -- 172.21.15.79:0/1617036045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7c0d1380 con 0x7f1e68004d40 2024-04-25T02:10:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 -- 172.21.15.79:0/1617036045 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7c0cede0 con 0x7f1e680039b0 2024-04-25T02:10:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e8146e640 1 -- 172.21.15.79:0/1617036045 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1e6800b9c0 con 0x7f1e7c0d2e20 2024-04-25T02:10:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e82c71640 1 --2- 172.21.15.79:0/1617036045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e68004d40 0x7f1e680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e82470640 1 --2- 172.21.15.79:0/1617036045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e680039b0 0x7f1e68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.474+0000 7f1e81c6f640 1 --2- 172.21.15.79:0/1617036045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e7c0d2e20 0x7f1e68004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.475+0000 7f1e82c71640 1 -- 172.21.15.79:0/1617036045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e7c0d2e20 msgr2=0x7f1e68004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.475+0000 7f1e82c71640 1 --2- 172.21.15.79:0/1617036045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e7c0d2e20 0x7f1e68004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.475+0000 7f1e82c71640 1 -- 172.21.15.79:0/1617036045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e680039b0 msgr2=0x7f1e68003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.475+0000 7f1e82c71640 1 --2- 172.21.15.79:0/1617036045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e680039b0 0x7f1e68003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.475+0000 7f1e82c71640 1 -- 172.21.15.79:0/1617036045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e68003520 con 0x7f1e68004d40 2024-04-25T02:10:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.475+0000 7f1e82c71640 1 --2- 172.21.15.79:0/1617036045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e68004d40 0x7f1e680051c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c163140 tx=0x7f1e68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9f66101751c789 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.475+0000 7f1e8146e640 1 -- 172.21.15.79:0/1617036045 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e78036070 con 0x7f1e68004d40 2024-04-25T02:10:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.475+0000 7f1e8146e640 1 -- 172.21.15.79:0/1617036045 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e78031400 con 0x7f1e68004d40 2024-04-25T02:10:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.475+0000 7f1e8146e640 1 -- 172.21.15.79:0/1617036045 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e78009690 con 0x7f1e68004d40 2024-04-25T02:10:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.476+0000 7f1e846d4640 1 -- 172.21.15.79:0/1617036045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e68004d40 msgr2=0x7f1e680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.476+0000 7f1e846d4640 1 --2- 172.21.15.79:0/1617036045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e68004d40 0x7f1e680051c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c163140 tx=0x7f1e68005830 comp rx=0 tx=0).stop 2024-04-25T02:10:26.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.476+0000 7f1e82c71640 1 -- 172.21.15.79:0/1617036045 reap_dead start 2024-04-25T02:10:26.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.476+0000 7f1e846d4640 1 -- 172.21.15.79:0/1617036045 shutdown_connections 2024-04-25T02:10:26.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.476+0000 7f1e846d4640 1 -- 172.21.15.79:0/1617036045 >> 172.21.15.79:0/1617036045 conn(0x7f1e7c09d460 msgr2=0x7f1e7c0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:26.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.476+0000 7f1e846d4640 1 -- 172.21.15.79:0/1617036045 shutdown_connections 2024-04-25T02:10:26.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.476+0000 7f1e846d4640 1 -- 172.21.15.79:0/1617036045 wait complete. 2024-04-25T02:10:26.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.477+0000 7f1e846d4640 1 Processor -- start 2024-04-25T02:10:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.477+0000 7f1e846d4640 1 -- start start 2024-04-25T02:10:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e846d4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e68004d40 0x7f1e7c0ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e846d4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e7c15b7b0 0x7f1e7c15bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e846d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e7c1f4250 0x7f1e7c1f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e846d4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7c0d2250 con 0x7f1e7c1f4250 2024-04-25T02:10:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e846d4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7c0d20d0 con 0x7f1e7c15b7b0 2024-04-25T02:10:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e846d4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1e7c06c1b0 con 0x7f1e68004d40 2024-04-25T02:10:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e82c71640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e7c1f4250 0x7f1e7c1f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e82c71640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e7c1f4250 0x7f1e7c1f46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35274/0 (socket says 172.21.15.79:35274) 2024-04-25T02:10:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e82c71640 1 -- 172.21.15.79:0/2635293219 learned_addr learned my addr 172.21.15.79:0/2635293219 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e82470640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e68004d40 0x7f1e7c0ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e81c6f640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e7c15b7b0 0x7f1e7c15bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e82c71640 1 -- 172.21.15.79:0/2635293219 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e68004d40 msgr2=0x7f1e7c0ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e82c71640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e68004d40 0x7f1e7c0ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e82c71640 1 -- 172.21.15.79:0/2635293219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e7c15b7b0 msgr2=0x7f1e7c15bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e82c71640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e7c15b7b0 0x7f1e7c15bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e82c71640 1 -- 172.21.15.79:0/2635293219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e7c159d70 con 0x7f1e7c1f4250 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e82470640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e68004d40 0x7f1e7c0ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e81c6f640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e7c15b7b0 0x7f1e7c15bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.478+0000 7f1e82c71640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e7c1f4250 0x7f1e7c1f46d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009b80 tx=0x7f1e78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.479+0000 7f1e72ffd640 1 -- 172.21.15.79:0/2635293219 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e78036070 con 0x7f1e7c1f4250 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.479+0000 7f1e72ffd640 1 -- 172.21.15.79:0/2635293219 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e78041070 con 0x7f1e7c1f4250 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.479+0000 7f1e72ffd640 1 -- 172.21.15.79:0/2635293219 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7803b880 con 0x7f1e7c1f4250 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.479+0000 7f1e846d4640 1 -- 172.21.15.79:0/2635293219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e7c158fd0 con 0x7f1e7c1f4250 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.479+0000 7f1e846d4640 1 -- 172.21.15.79:0/2635293219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e7c159570 con 0x7f1e7c1f4250 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.479+0000 7f1e846d4640 1 -- 172.21.15.79:0/2635293219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e7c0690a0 con 0x7f1e7c1f4250 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.480+0000 7f1e72ffd640 1 -- 172.21.15.79:0/2635293219 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e7803ba20 con 0x7f1e7c1f4250 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.480+0000 7f1e72ffd640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1e6006be30 0x7f1e6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.481+0000 7f1e82470640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1e6006be30 0x7f1e6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.481+0000 7f1e72ffd640 1 -- 172.21.15.79:0/2635293219 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f1e780ab1a0 con 0x7f1e7c1f4250 2024-04-25T02:10:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.481+0000 7f1e82470640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1e6006be30 0x7f1e6006e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1e74007520 tx=0x7f1e7400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:26.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.485+0000 7f1e72ffd640 1 -- 172.21.15.79:0/2635293219 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1e78079b50 con 0x7f1e7c1f4250 2024-04-25T02:10:26.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.659+0000 7f1e846d4640 1 -- 172.21.15.79:0/2635293219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e7c0d1920 con 0x7f1e7c1f4250 2024-04-25T02:10:26.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.660+0000 7f1e72ffd640 1 -- 172.21.15.79:0/2635293219 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16690 (secure 0 0 0) 0x7f1e78079450 con 0x7f1e7c1f4250 2024-04-25T02:10:26.668 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:26.668 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":58,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:10:25.684273+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:23.901352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:24.658248+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.662+0000 7f1e846d4640 1 -- 172.21.15.79:0/2635293219 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1e6006be30 msgr2=0x7f1e6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.662+0000 7f1e846d4640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1e6006be30 0x7f1e6006e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1e74007520 tx=0x7f1e7400b040 comp rx=0 tx=0).stop 2024-04-25T02:10:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.662+0000 7f1e846d4640 1 -- 172.21.15.79:0/2635293219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e7c1f4250 msgr2=0x7f1e7c1f46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.662+0000 7f1e846d4640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e7c1f4250 0x7f1e7c1f46d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009b80 tx=0x7f1e78004730 comp rx=0 tx=0).stop 2024-04-25T02:10:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.662+0000 7f1e846d4640 1 -- 172.21.15.79:0/2635293219 shutdown_connections 2024-04-25T02:10:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.662+0000 7f1e846d4640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1e6006be30 0x7f1e6006e2f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.662+0000 7f1e846d4640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e7c1f4250 0x7f1e7c1f46d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.662+0000 7f1e846d4640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e7c15b7b0 0x7f1e7c15bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.662+0000 7f1e846d4640 1 --2- 172.21.15.79:0/2635293219 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1e68004d40 0x7f1e7c0ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.662+0000 7f1e846d4640 1 -- 172.21.15.79:0/2635293219 >> 172.21.15.79:0/2635293219 conn(0x7f1e7c09d460 msgr2=0x7f1e7c15eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.662+0000 7f1e846d4640 1 -- 172.21.15.79:0/2635293219 shutdown_connections 2024-04-25T02:10:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.662+0000 7f1e846d4640 1 -- 172.21.15.79:0/2635293219 wait complete. 2024-04-25T02:10:26.681 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:26.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.769+0000 7fb86e6d2640 1 Processor -- start 2024-04-25T02:10:26.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.769+0000 7fb86e6d2640 1 -- start start 2024-04-25T02:10:26.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.770+0000 7fb86e6d2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb86806df50 0x7fb86806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.770+0000 7fb86e6d2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb8680b2d30 0x7fb8680b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.770+0000 7fb86e6d2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb868071e00 con 0x7fb868143bc0 2024-04-25T02:10:26.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.770+0000 7fb86e6d2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb86806e8f0 con 0x7fb8680b2d30 2024-04-25T02:10:26.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.770+0000 7fb86e6d2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb868072cb0 con 0x7fb86806df50 2024-04-25T02:10:26.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.770+0000 7fb86cc6f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb8680b2d30 0x7fb8680b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.770+0000 7fb86cc6f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb8680b2d30 0x7fb8680b3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35288/0 (socket says 172.21.15.79:35288) 2024-04-25T02:10:26.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.770+0000 7fb86cc6f640 1 -- 172.21.15.79:0/570133717 learned_addr learned my addr 172.21.15.79:0/570133717 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:26.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.770+0000 7fb8677fe640 1 --2- 172.21.15.79:0/570133717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb86806df50 0x7fb86806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.770+0000 7fb86cc6f640 1 -- 172.21.15.79:0/570133717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb86806df50 msgr2=0x7fb86806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:26.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.770+0000 7fb86cc6f640 1 --2- 172.21.15.79:0/570133717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb86806df50 0x7fb86806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.770+0000 7fb86cc6f640 1 -- 172.21.15.79:0/570133717 >> v1:172.21.15.189:6789/0 conn(0x7fb868143bc0 legacy=0x7fb86815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.770+0000 7fb86cc6f640 1 -- 172.21.15.79:0/570133717 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8680720a0 con 0x7fb8680b2d30 2024-04-25T02:10:26.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.771+0000 7fb86cc6f640 1 --2- 172.21.15.79:0/570133717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8680b2d30 0x7fb8680b3190 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb860009e50 tx=0x7fb86002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74cbbabb03736b1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:26.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.771+0000 7fb866ffd640 1 -- 172.21.15.79:0/570133717 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860036070 con 0x7fb8680b2d30 2024-04-25T02:10:26.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.771+0000 7fb866ffd640 1 -- 172.21.15.79:0/570133717 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb860031600 con 0x7fb8680b2d30 2024-04-25T02:10:26.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.771+0000 7fb866ffd640 1 -- 172.21.15.79:0/570133717 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8600319d0 con 0x7fb8680b2d30 2024-04-25T02:10:26.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.771+0000 7fb86e6d2640 1 -- 172.21.15.79:0/570133717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8680b2d30 msgr2=0x7fb8680b3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.771+0000 7fb86e6d2640 1 --2- 172.21.15.79:0/570133717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8680b2d30 0x7fb8680b3190 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb860009e50 tx=0x7fb86002a680 comp rx=0 tx=0).stop 2024-04-25T02:10:26.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.771+0000 7fb86e6d2640 1 -- 172.21.15.79:0/570133717 shutdown_connections 2024-04-25T02:10:26.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.771+0000 7fb86e6d2640 1 --2- 172.21.15.79:0/570133717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8680b2d30 0x7fb8680b3190 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.771+0000 7fb86e6d2640 1 --2- 172.21.15.79:0/570133717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb86806df50 0x7fb86806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.772+0000 7fb86e6d2640 1 -- 172.21.15.79:0/570133717 >> 172.21.15.79:0/570133717 conn(0x7fb8680cfc80 msgr2=0x7fb8680d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:26.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.772+0000 7fb86e6d2640 1 -- 172.21.15.79:0/570133717 shutdown_connections 2024-04-25T02:10:26.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.772+0000 7fb86e6d2640 1 -- 172.21.15.79:0/570133717 wait complete. 2024-04-25T02:10:26.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.773+0000 7fb86e6d2640 1 Processor -- start 2024-04-25T02:10:26.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.773+0000 7fb86e6d2640 1 -- start start 2024-04-25T02:10:26.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.773+0000 7fb86e6d2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86806df50 0x7fb86813b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.773+0000 7fb86e6d2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8680b2d30 0x7fb8680a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.773+0000 7fb86e6d2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb868143bc0 0x7fb86815d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb86e6d2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb868072940 con 0x7fb86806df50 2024-04-25T02:10:26.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb86e6d2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb868072660 con 0x7fb868143bc0 2024-04-25T02:10:26.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb86e6d2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb868143fa0 con 0x7fb8680b2d30 2024-04-25T02:10:26.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb867fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86806df50 0x7fb86813b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb867fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86806df50 0x7fb86813b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35294/0 (socket says 172.21.15.79:35294) 2024-04-25T02:10:26.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb867fff640 1 -- 172.21.15.79:0/370293984 learned_addr learned my addr 172.21.15.79:0/370293984 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:26.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb8677fe640 1 --2- 172.21.15.79:0/370293984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8680b2d30 0x7fb8680a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb86cc6f640 1 --2- 172.21.15.79:0/370293984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb868143bc0 0x7fb86815d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb867fff640 1 -- 172.21.15.79:0/370293984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8680b2d30 msgr2=0x7fb8680a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb867fff640 1 --2- 172.21.15.79:0/370293984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8680b2d30 0x7fb8680a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb867fff640 1 -- 172.21.15.79:0/370293984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb868143bc0 msgr2=0x7fb86815d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb867fff640 1 --2- 172.21.15.79:0/370293984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb868143bc0 0x7fb86815d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb867fff640 1 -- 172.21.15.79:0/370293984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8680a9f90 con 0x7fb86806df50 2024-04-25T02:10:26.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb867fff640 1 --2- 172.21.15.79:0/370293984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86806df50 0x7fb86813b310 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00c400 tx=0x7fb85c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:26.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb864ff9640 1 -- 172.21.15.79:0/370293984 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c0052d0 con 0x7fb86806df50 2024-04-25T02:10:26.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb864ff9640 1 -- 172.21.15.79:0/370293984 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb85c005490 con 0x7fb86806df50 2024-04-25T02:10:26.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb86e6d2640 1 -- 172.21.15.79:0/370293984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8680aa270 con 0x7fb86806df50 2024-04-25T02:10:26.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb864ff9640 1 -- 172.21.15.79:0/370293984 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c007260 con 0x7fb86806df50 2024-04-25T02:10:26.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.774+0000 7fb86e6d2640 1 -- 172.21.15.79:0/370293984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8680aa830 con 0x7fb86806df50 2024-04-25T02:10:26.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.775+0000 7fb86e6d2640 1 -- 172.21.15.79:0/370293984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8680690a0 con 0x7fb86806df50 2024-04-25T02:10:26.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.776+0000 7fb864ff9640 1 -- 172.21.15.79:0/370293984 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb85c007400 con 0x7fb86806df50 2024-04-25T02:10:26.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.776+0000 7fb864ff9640 1 --2- 172.21.15.79:0/370293984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb85406be30 0x7fb85406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.776+0000 7fb8677fe640 1 --2- 172.21.15.79:0/370293984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb85406be30 0x7fb85406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.776+0000 7fb864ff9640 1 -- 172.21.15.79:0/370293984 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fb85c08a340 con 0x7fb86806df50 2024-04-25T02:10:26.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.777+0000 7fb8677fe640 1 --2- 172.21.15.79:0/370293984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb85406be30 0x7fb85406e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb868168e60 tx=0x7fb858009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:26.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.780+0000 7fb864ff9640 1 -- 172.21.15.79:0/370293984 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb85c0586a0 con 0x7fb86806df50 2024-04-25T02:10:26.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.953+0000 7fb86e6d2640 1 -- 172.21.15.79:0/370293984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8680b11a0 con 0x7fb86806df50 2024-04-25T02:10:26.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.954+0000 7fb864ff9640 1 -- 172.21.15.79:0/370293984 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16690 (secure 0 0 0) 0x7fb85c05c9a0 con 0x7fb86806df50 2024-04-25T02:10:26.962 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:26.962 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":58,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:10:25.684273+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:23.901352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:24.658248+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:26.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.956+0000 7fb86e6d2640 1 -- 172.21.15.79:0/370293984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb85406be30 msgr2=0x7fb85406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.956+0000 7fb86e6d2640 1 --2- 172.21.15.79:0/370293984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb85406be30 0x7fb85406e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb868168e60 tx=0x7fb858009190 comp rx=0 tx=0).stop 2024-04-25T02:10:26.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.956+0000 7fb86e6d2640 1 -- 172.21.15.79:0/370293984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86806df50 msgr2=0x7fb86813b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.956+0000 7fb86e6d2640 1 --2- 172.21.15.79:0/370293984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86806df50 0x7fb86813b310 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00c400 tx=0x7fb85c00c8c0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.956+0000 7fb86e6d2640 1 -- 172.21.15.79:0/370293984 shutdown_connections 2024-04-25T02:10:26.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.956+0000 7fb86e6d2640 1 --2- 172.21.15.79:0/370293984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb85406be30 0x7fb85406e2f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.956+0000 7fb86e6d2640 1 --2- 172.21.15.79:0/370293984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb868143bc0 0x7fb86815d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.956+0000 7fb86e6d2640 1 --2- 172.21.15.79:0/370293984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8680b2d30 0x7fb8680a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.956+0000 7fb86e6d2640 1 --2- 172.21.15.79:0/370293984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86806df50 0x7fb86813b310 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.956+0000 7fb86e6d2640 1 -- 172.21.15.79:0/370293984 >> 172.21.15.79:0/370293984 conn(0x7fb8680cfc80 msgr2=0x7fb8680ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:26.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.957+0000 7fb86e6d2640 1 -- 172.21.15.79:0/370293984 shutdown_connections 2024-04-25T02:10:26.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:26.957+0000 7fb86e6d2640 1 -- 172.21.15.79:0/370293984 wait complete. 2024-04-25T02:10:26.975 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T02:10:27.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.067+0000 7fe27b06d640 1 Processor -- start 2024-04-25T02:10:27.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.067+0000 7fe27b06d640 1 -- start start 2024-04-25T02:10:27.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.068+0000 7fe27b06d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2740cf7a0 0x7fe2740b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.068+0000 7fe27b06d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe27406e6b0 0x7fe27415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.068+0000 7fe27b06d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe27415ec20 con 0x7fe27406b2f0 2024-04-25T02:10:27.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.068+0000 7fe27b06d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe27415f830 con 0x7fe27406e6b0 2024-04-25T02:10:27.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.068+0000 7fe27b06d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe27415ef00 con 0x7fe2740cf7a0 2024-04-25T02:10:27.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.068+0000 7fe27960a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe27406e6b0 0x7fe27415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:27.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.068+0000 7fe27960a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe27406e6b0 0x7fe27415b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35300/0 (socket says 172.21.15.79:35300) 2024-04-25T02:10:27.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.068+0000 7fe27960a640 1 -- 172.21.15.79:0/1833023457 learned_addr learned my addr 172.21.15.79:0/1833023457 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:27.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.068+0000 7fe273fff640 1 --2- 172.21.15.79:0/1833023457 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2740cf7a0 0x7fe2740b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:27.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.068+0000 7fe27960a640 1 -- 172.21.15.79:0/1833023457 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2740cf7a0 msgr2=0x7fe2740b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:27.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.068+0000 7fe27960a640 1 --2- 172.21.15.79:0/1833023457 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2740cf7a0 0x7fe2740b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.068+0000 7fe27960a640 1 -- 172.21.15.79:0/1833023457 >> v1:172.21.15.189:6789/0 conn(0x7fe27406b2f0 legacy=0x7fe27406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.068+0000 7fe27960a640 1 -- 172.21.15.79:0/1833023457 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe27415f1e0 con 0x7fe27406e6b0 2024-04-25T02:10:27.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.069+0000 7fe27960a640 1 --2- 172.21.15.79:0/1833023457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe27406e6b0 0x7fe27415b2d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00d150 tx=0x7fe26c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e6a2d44200179 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:27.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.069+0000 7fe2737fe640 1 -- 172.21.15.79:0/1833023457 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26c039070 con 0x7fe27406e6b0 2024-04-25T02:10:27.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.069+0000 7fe2737fe640 1 -- 172.21.15.79:0/1833023457 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe26c009600 con 0x7fe27406e6b0 2024-04-25T02:10:27.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.069+0000 7fe2737fe640 1 -- 172.21.15.79:0/1833023457 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26c0099d0 con 0x7fe27406e6b0 2024-04-25T02:10:27.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.069+0000 7fe27b06d640 1 -- 172.21.15.79:0/1833023457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe27406e6b0 msgr2=0x7fe27415b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.069+0000 7fe27b06d640 1 --2- 172.21.15.79:0/1833023457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe27406e6b0 0x7fe27415b2d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00d150 tx=0x7fe26c02c890 comp rx=0 tx=0).stop 2024-04-25T02:10:27.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.069+0000 7fe27b06d640 1 -- 172.21.15.79:0/1833023457 shutdown_connections 2024-04-25T02:10:27.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.070+0000 7fe27b06d640 1 --2- 172.21.15.79:0/1833023457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe27406e6b0 0x7fe27415b2d0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.070+0000 7fe27b06d640 1 --2- 172.21.15.79:0/1833023457 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2740cf7a0 0x7fe2740b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.070+0000 7fe27b06d640 1 -- 172.21.15.79:0/1833023457 >> 172.21.15.79:0/1833023457 conn(0x7fe2740b1cd0 msgr2=0x7fe2740b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:27.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.070+0000 7fe27b06d640 1 -- 172.21.15.79:0/1833023457 shutdown_connections 2024-04-25T02:10:27.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.070+0000 7fe27b06d640 1 -- 172.21.15.79:0/1833023457 wait complete. 2024-04-25T02:10:27.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.071+0000 7fe27b06d640 1 Processor -- start 2024-04-25T02:10:27.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.071+0000 7fe27b06d640 1 -- start start 2024-04-25T02:10:27.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.071+0000 7fe27b06d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe27406b2f0 0x7fe2741559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.071+0000 7fe27b06d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe27406e6b0 0x7fe274149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe27b06d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2740cf7a0 0x7fe2740ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe27b06d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe27406d160 con 0x7fe27406e6b0 2024-04-25T02:10:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe27b06d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe27406cfe0 con 0x7fe2740cf7a0 2024-04-25T02:10:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe27b06d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe27415b810 con 0x7fe27406b2f0 2024-04-25T02:10:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe273fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe27406e6b0 0x7fe274149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe273fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe27406e6b0 0x7fe274149b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35306/0 (socket says 172.21.15.79:35306) 2024-04-25T02:10:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe273fff640 1 -- 172.21.15.79:0/1038219877 learned_addr learned my addr 172.21.15.79:0/1038219877 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe27960a640 1 --2- 172.21.15.79:0/1038219877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2740cf7a0 0x7fe2740ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe278e09640 1 --2- 172.21.15.79:0/1038219877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe27406b2f0 0x7fe2741559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe273fff640 1 -- 172.21.15.79:0/1038219877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe27406b2f0 msgr2=0x7fe2741559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe273fff640 1 --2- 172.21.15.79:0/1038219877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe27406b2f0 0x7fe2741559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe273fff640 1 -- 172.21.15.79:0/1038219877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2740cf7a0 msgr2=0x7fe2740ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe273fff640 1 --2- 172.21.15.79:0/1038219877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2740cf7a0 0x7fe2740ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe273fff640 1 -- 172.21.15.79:0/1038219877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2740adfc0 con 0x7fe27406e6b0 2024-04-25T02:10:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe273fff640 1 --2- 172.21.15.79:0/1038219877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe27406e6b0 0x7fe274149b90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe26000d620 tx=0x7fe26000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe2717fa640 1 -- 172.21.15.79:0/1038219877 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26000b620 con 0x7fe27406e6b0 2024-04-25T02:10:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe2717fa640 1 -- 172.21.15.79:0/1038219877 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe260019070 con 0x7fe27406e6b0 2024-04-25T02:10:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe2717fa640 1 -- 172.21.15.79:0/1038219877 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26000ba00 con 0x7fe27406e6b0 2024-04-25T02:10:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe27b06d640 1 -- 172.21.15.79:0/1038219877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2740ae2a0 con 0x7fe27406e6b0 2024-04-25T02:10:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.072+0000 7fe27b06d640 1 -- 172.21.15.79:0/1038219877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2740ae860 con 0x7fe27406e6b0 2024-04-25T02:10:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.073+0000 7fe27b06d640 1 -- 172.21.15.79:0/1038219877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2740690a0 con 0x7fe27406e6b0 2024-04-25T02:10:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.074+0000 7fe2717fa640 1 -- 172.21.15.79:0/1038219877 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe26000bba0 con 0x7fe27406e6b0 2024-04-25T02:10:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.074+0000 7fe2717fa640 1 --2- 172.21.15.79:0/1038219877 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe25806be30 0x7fe25806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.074+0000 7fe2717fa640 1 -- 172.21.15.79:0/1038219877 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fe26008b040 con 0x7fe27406e6b0 2024-04-25T02:10:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.074+0000 7fe278e09640 1 --2- 172.21.15.79:0/1038219877 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe25806be30 0x7fe25806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:27.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.075+0000 7fe278e09640 1 --2- 172.21.15.79:0/1038219877 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe25806be30 0x7fe25806e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe268001780 tx=0x7fe268009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:27.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.078+0000 7fe2717fa640 1 -- 172.21.15.79:0/1038219877 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe260059430 con 0x7fe27406e6b0 2024-04-25T02:10:27.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.288+0000 7fe27b06d640 1 -- 172.21.15.79:0/1038219877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe2740af3a0 con 0x7fe27406e6b0 2024-04-25T02:10:27.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.349+0000 7fe2717fa640 1 -- 172.21.15.79:0/1038219877 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) ==== 118+0+0 (secure 0 0 0) 0x7fe26005d730 con 0x7fe27406e6b0 2024-04-25T02:10:27.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.351+0000 7fe27b06d640 1 -- 172.21.15.79:0/1038219877 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe25806be30 msgr2=0x7fe25806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.351+0000 7fe27b06d640 1 --2- 172.21.15.79:0/1038219877 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe25806be30 0x7fe25806e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe268001780 tx=0x7fe268009040 comp rx=0 tx=0).stop 2024-04-25T02:10:27.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.351+0000 7fe27b06d640 1 -- 172.21.15.79:0/1038219877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe27406e6b0 msgr2=0x7fe274149b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.351+0000 7fe27b06d640 1 --2- 172.21.15.79:0/1038219877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe27406e6b0 0x7fe274149b90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe26000d620 tx=0x7fe26000dae0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.352+0000 7fe27b06d640 1 -- 172.21.15.79:0/1038219877 shutdown_connections 2024-04-25T02:10:27.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.352+0000 7fe27b06d640 1 --2- 172.21.15.79:0/1038219877 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe25806be30 0x7fe25806e2f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.352+0000 7fe27b06d640 1 --2- 172.21.15.79:0/1038219877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2740cf7a0 0x7fe2740ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.352+0000 7fe27b06d640 1 --2- 172.21.15.79:0/1038219877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe27406e6b0 0x7fe274149b90 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.352+0000 7fe27b06d640 1 --2- 172.21.15.79:0/1038219877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe27406b2f0 0x7fe2741559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.352+0000 7fe27b06d640 1 -- 172.21.15.79:0/1038219877 >> 172.21.15.79:0/1038219877 conn(0x7fe2740b1cd0 msgr2=0x7fe2741588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:27.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.352+0000 7fe27b06d640 1 -- 172.21.15.79:0/1038219877 shutdown_connections 2024-04-25T02:10:27.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.352+0000 7fe27b06d640 1 -- 172.21.15.79:0/1038219877 wait complete. 2024-04-25T02:10:27.371 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T02:10:27.371 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T02:10:27.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.462+0000 7f1b2c6d2640 1 Processor -- start 2024-04-25T02:10:27.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.462+0000 7f1b2c6d2640 1 -- start start 2024-04-25T02:10:27.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.463+0000 7f1b2c6d2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b2415e4f0 0x7f1b240d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.463+0000 7f1b2c6d2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b240d10c0 0x7f1b2406bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.463+0000 7f1b2c6d2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b240d1ee0 con 0x7f1b240cf7f0 2024-04-25T02:10:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.463+0000 7f1b2c6d2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1b240d21c0 con 0x7f1b2415e4f0 2024-04-25T02:10:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.463+0000 7f1b2c6d2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1b240d24a0 con 0x7f1b240d10c0 2024-04-25T02:10:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.463+0000 7f1b2a46e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b2415e4f0 0x7f1b240d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.463+0000 7f1b29c6d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1b240cf7f0 0x7f1b240d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53800/0 (socket says 172.21.15.79:53800) 2024-04-25T02:10:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.463+0000 7f1b29c6d640 1 -- 172.21.15.79:0/1354824929 learned_addr learned my addr 172.21.15.79:0/1354824929 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.464+0000 7f1b2ac6f640 1 --2- 172.21.15.79:0/1354824929 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b240d10c0 0x7f1b2406bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.464+0000 7f1b2a46e640 1 -- 172.21.15.79:0/1354824929 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b240d10c0 msgr2=0x7f1b2406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.464+0000 7f1b2a46e640 1 --2- 172.21.15.79:0/1354824929 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b240d10c0 0x7f1b2406bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.464+0000 7f1b2a46e640 1 -- 172.21.15.79:0/1354824929 >> v1:172.21.15.79:6789/0 conn(0x7f1b240cf7f0 legacy=0x7f1b240d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.464+0000 7f1b2a46e640 1 -- 172.21.15.79:0/1354824929 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b240d2780 con 0x7f1b2415e4f0 2024-04-25T02:10:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.464+0000 7f1b2946c640 1 -- 172.21.15.79:0/1354824929 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1681269932 0 0) 0x7f1b240d1ee0 con 0x7f1b240cf7f0 2024-04-25T02:10:27.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.464+0000 7f1b2a46e640 1 --2- 172.21.15.79:0/1354824929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2415e4f0 0x7f1b240d2ca0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1b200097d0 tx=0x7f1b2002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913e445d58fdfc0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:27.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.465+0000 7f1b2946c640 1 -- 172.21.15.79:0/1354824929 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20037070 con 0x7f1b2415e4f0 2024-04-25T02:10:27.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.465+0000 7f1b2946c640 1 -- 172.21.15.79:0/1354824929 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b20032440 con 0x7f1b2415e4f0 2024-04-25T02:10:27.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.465+0000 7f1b2946c640 1 -- 172.21.15.79:0/1354824929 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20032810 con 0x7f1b2415e4f0 2024-04-25T02:10:27.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.465+0000 7f1b2c6d2640 1 -- 172.21.15.79:0/1354824929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2415e4f0 msgr2=0x7f1b240d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.465+0000 7f1b2c6d2640 1 --2- 172.21.15.79:0/1354824929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2415e4f0 0x7f1b240d2ca0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1b200097d0 tx=0x7f1b2002a1c0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.465+0000 7f1b2c6d2640 1 -- 172.21.15.79:0/1354824929 shutdown_connections 2024-04-25T02:10:27.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.465+0000 7f1b2c6d2640 1 --2- 172.21.15.79:0/1354824929 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b240d10c0 0x7f1b2406bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.465+0000 7f1b2c6d2640 1 --2- 172.21.15.79:0/1354824929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2415e4f0 0x7f1b240d2ca0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.465+0000 7f1b2c6d2640 1 -- 172.21.15.79:0/1354824929 >> 172.21.15.79:0/1354824929 conn(0x7f1b2409d4a0 msgr2=0x7f1b240d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:27.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.465+0000 7f1b2c6d2640 1 -- 172.21.15.79:0/1354824929 shutdown_connections 2024-04-25T02:10:27.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.465+0000 7f1b2c6d2640 1 -- 172.21.15.79:0/1354824929 wait complete. 2024-04-25T02:10:27.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.466+0000 7f1b2c6d2640 1 Processor -- start 2024-04-25T02:10:27.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.466+0000 7f1b2c6d2640 1 -- start start 2024-04-25T02:10:27.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.467+0000 7f1b2c6d2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b240cf7f0 0x7f1b240b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.467+0000 7f1b2c6d2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b240d10c0 0x7f1b24155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.467+0000 7f1b2c6d2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2415e4f0 0x7f1b241f4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.467+0000 7f1b2c6d2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b240cfe00 con 0x7f1b2415e4f0 2024-04-25T02:10:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.467+0000 7f1b2c6d2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b240cfc80 con 0x7f1b240d10c0 2024-04-25T02:10:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.467+0000 7f1b2c6d2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1b240cff80 con 0x7f1b240cf7f0 2024-04-25T02:10:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.467+0000 7f1b2ac6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2415e4f0 0x7f1b241f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.467+0000 7f1b2ac6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2415e4f0 0x7f1b241f4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35324/0 (socket says 172.21.15.79:35324) 2024-04-25T02:10:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.467+0000 7f1b2ac6f640 1 -- 172.21.15.79:0/3089917156 learned_addr learned my addr 172.21.15.79:0/3089917156 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.467+0000 7f1b2a46e640 1 --2- 172.21.15.79:0/3089917156 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b240cf7f0 0x7f1b240b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.467+0000 7f1b2ac6f640 1 -- 172.21.15.79:0/3089917156 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b240cf7f0 msgr2=0x7f1b240b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.467+0000 7f1b2ac6f640 1 --2- 172.21.15.79:0/3089917156 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b240cf7f0 0x7f1b240b7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.467+0000 7f1b2ac6f640 1 -- 172.21.15.79:0/3089917156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b240d10c0 msgr2=0x7f1b24155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.467+0000 7f1b2ac6f640 1 --2- 172.21.15.79:0/3089917156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b240d10c0 0x7f1b24155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.467+0000 7f1b2ac6f640 1 -- 172.21.15.79:0/3089917156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b241f52e0 con 0x7f1b2415e4f0 2024-04-25T02:10:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.468+0000 7f1b2ac6f640 1 --2- 172.21.15.79:0/3089917156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2415e4f0 0x7f1b241f4180 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c007e40 tx=0x7f1b1c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.468+0000 7f1b1affd640 1 -- 172.21.15.79:0/3089917156 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c014620 con 0x7f1b2415e4f0 2024-04-25T02:10:27.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.468+0000 7f1b1affd640 1 -- 172.21.15.79:0/3089917156 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1c019070 con 0x7f1b2415e4f0 2024-04-25T02:10:27.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.468+0000 7f1b2c6d2640 1 -- 172.21.15.79:0/3089917156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b241f4a40 con 0x7f1b2415e4f0 2024-04-25T02:10:27.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.468+0000 7f1b1affd640 1 -- 172.21.15.79:0/3089917156 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c014a20 con 0x7f1b2415e4f0 2024-04-25T02:10:27.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.468+0000 7f1b2c6d2640 1 -- 172.21.15.79:0/3089917156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b241f5000 con 0x7f1b2415e4f0 2024-04-25T02:10:27.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.469+0000 7f1b2c6d2640 1 -- 172.21.15.79:0/3089917156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b240686c0 con 0x7f1b2415e4f0 2024-04-25T02:10:27.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.469+0000 7f1b1affd640 1 -- 172.21.15.79:0/3089917156 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b1c014bc0 con 0x7f1b2415e4f0 2024-04-25T02:10:27.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.470+0000 7f1b1affd640 1 --2- 172.21.15.79:0/3089917156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b0806be30 0x7f1b0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.470+0000 7f1b2a46e640 1 --2- 172.21.15.79:0/3089917156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b0806be30 0x7f1b0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:27.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.470+0000 7f1b1affd640 1 -- 172.21.15.79:0/3089917156 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f1b1c08b6e0 con 0x7f1b2415e4f0 2024-04-25T02:10:27.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.470+0000 7f1b2a46e640 1 --2- 172.21.15.79:0/3089917156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b0806be30 0x7f1b0806e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1b20034000 tx=0x7f1b2002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:27.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.474+0000 7f1b1affd640 1 -- 172.21.15.79:0/3089917156 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1b1c05a100 con 0x7f1b2415e4f0 2024-04-25T02:10:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:27.687+0000 7f1b2c6d2640 1 -- 172.21.15.79:0/3089917156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1b240690a0 con 0x7f1b2415e4f0 2024-04-25T02:10:28.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.356+0000 7f1b1affd640 1 -- 172.21.15.79:0/3089917156 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f1b1c059a00 con 0x7f1b2415e4f0 2024-04-25T02:10:28.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.358+0000 7f1b2c6d2640 1 -- 172.21.15.79:0/3089917156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b0806be30 msgr2=0x7f1b0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.358+0000 7f1b2c6d2640 1 --2- 172.21.15.79:0/3089917156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b0806be30 0x7f1b0806e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1b20034000 tx=0x7f1b2002e000 comp rx=0 tx=0).stop 2024-04-25T02:10:28.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.358+0000 7f1b2c6d2640 1 -- 172.21.15.79:0/3089917156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2415e4f0 msgr2=0x7f1b241f4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.358+0000 7f1b2c6d2640 1 --2- 172.21.15.79:0/3089917156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2415e4f0 0x7f1b241f4180 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c007e40 tx=0x7f1b1c00e4b0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.358+0000 7f1b2c6d2640 1 -- 172.21.15.79:0/3089917156 shutdown_connections 2024-04-25T02:10:28.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.358+0000 7f1b2c6d2640 1 --2- 172.21.15.79:0/3089917156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b0806be30 0x7f1b0806e2f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.358+0000 7f1b2c6d2640 1 --2- 172.21.15.79:0/3089917156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2415e4f0 0x7f1b241f4180 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.358+0000 7f1b2c6d2640 1 --2- 172.21.15.79:0/3089917156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b240d10c0 0x7f1b24155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.358+0000 7f1b2c6d2640 1 --2- 172.21.15.79:0/3089917156 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b240cf7f0 0x7f1b240b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.358+0000 7f1b2c6d2640 1 -- 172.21.15.79:0/3089917156 >> 172.21.15.79:0/3089917156 conn(0x7f1b2409d4a0 msgr2=0x7f1b2415cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:28.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.358+0000 7f1b2c6d2640 1 -- 172.21.15.79:0/3089917156 shutdown_connections 2024-04-25T02:10:28.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.358+0000 7f1b2c6d2640 1 -- 172.21.15.79:0/3089917156 wait complete. 2024-04-25T02:10:28.377 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T02:10:28.377 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:10:28.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.467+0000 7f3102d5a640 1 Processor -- start 2024-04-25T02:10:28.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.467+0000 7f3102d5a640 1 -- start start 2024-04-25T02:10:28.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.468+0000 7f3102d5a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30fc15e4d0 0x7f30fc06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.468+0000 7f3102d5a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30fc0d1660 con 0x7f30fc0d2e20 2024-04-25T02:10:28.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.468+0000 7f3102d5a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30fc0d1380 con 0x7f30fc0b3570 2024-04-25T02:10:28.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.468+0000 7f3102d5a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f30fc0cede0 con 0x7f30fc15e4d0 2024-04-25T02:10:28.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.468+0000 7f3100af6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30fc15e4d0 0x7f30fc06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.468+0000 7f31012f7640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f30fc0d2e20 0x7f30fc0cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53812/0 (socket says 172.21.15.79:53812) 2024-04-25T02:10:28.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.468+0000 7f31012f7640 1 -- 172.21.15.79:0/3954564878 learned_addr learned my addr 172.21.15.79:0/3954564878 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.469+0000 7f3100af6640 1 -- 172.21.15.79:0/3954564878 >> v1:172.21.15.189:6789/0 conn(0x7f30fc0b3570 legacy=0x7f30fc0d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.469+0000 7f3100af6640 1 -- 172.21.15.79:0/3954564878 >> v1:172.21.15.79:6789/0 conn(0x7f30fc0d2e20 legacy=0x7f30fc0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.469+0000 7f3100af6640 1 -- 172.21.15.79:0/3954564878 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30fc0cf0c0 con 0x7f30fc15e4d0 2024-04-25T02:10:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.469+0000 7f30fb7fe640 1 -- 172.21.15.79:0/3954564878 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1929525069 0 0) 0x7f30fc0d1660 con 0x7f30fc0d2e20 2024-04-25T02:10:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.469+0000 7f3100af6640 1 --2- 172.21.15.79:0/3954564878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30fc15e4d0 0x7f30fc06bc70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0097d0 tx=0x7f30ec02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e42d2c4712ce196 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.469+0000 7f30fb7fe640 1 -- 172.21.15.79:0/3954564878 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec037070 con 0x7f30fc15e4d0 2024-04-25T02:10:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.470+0000 7f30fb7fe640 1 -- 172.21.15.79:0/3954564878 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ec032440 con 0x7f30fc15e4d0 2024-04-25T02:10:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.470+0000 7f30fb7fe640 1 -- 172.21.15.79:0/3954564878 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec032810 con 0x7f30fc15e4d0 2024-04-25T02:10:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.470+0000 7f3102d5a640 1 -- 172.21.15.79:0/3954564878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30fc15e4d0 msgr2=0x7f30fc06bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.470+0000 7f3102d5a640 1 --2- 172.21.15.79:0/3954564878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30fc15e4d0 0x7f30fc06bc70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0097d0 tx=0x7f30ec02a210 comp rx=0 tx=0).stop 2024-04-25T02:10:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.470+0000 7f3102d5a640 1 -- 172.21.15.79:0/3954564878 shutdown_connections 2024-04-25T02:10:28.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.470+0000 7f3102d5a640 1 --2- 172.21.15.79:0/3954564878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30fc15e4d0 0x7f30fc06bc70 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.470+0000 7f3102d5a640 1 -- 172.21.15.79:0/3954564878 >> 172.21.15.79:0/3954564878 conn(0x7f30fc09d460 msgr2=0x7f30fc0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:28.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.470+0000 7f3102d5a640 1 -- 172.21.15.79:0/3954564878 shutdown_connections 2024-04-25T02:10:28.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.470+0000 7f3102d5a640 1 -- 172.21.15.79:0/3954564878 wait complete. 2024-04-25T02:10:28.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.471+0000 7f3102d5a640 1 Processor -- start 2024-04-25T02:10:28.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.471+0000 7f3102d5a640 1 -- start start 2024-04-25T02:10:28.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.472+0000 7f3102d5a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30fc0b3570 0x7f30fc1f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.472+0000 7f3102d5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30fc0d2e20 0x7f30fc15cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.472+0000 7f3102d5a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f30fc15e4d0 0x7f30fc0b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.472+0000 7f3102d5a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc0d2250 con 0x7f30fc0d2e20 2024-04-25T02:10:28.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.472+0000 7f3102d5a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc0d20d0 con 0x7f30fc0b3570 2024-04-25T02:10:28.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.472+0000 7f3102d5a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f30fc06c1b0 con 0x7f30fc15e4d0 2024-04-25T02:10:28.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.472+0000 7f30fbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30fc0d2e20 0x7f30fc15cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.472+0000 7f30fbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30fc0d2e20 0x7f30fc15cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35334/0 (socket says 172.21.15.79:35334) 2024-04-25T02:10:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.472+0000 7f30fbfff640 1 -- 172.21.15.79:0/2636558993 learned_addr learned my addr 172.21.15.79:0/2636558993 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.472+0000 7f3100af6640 1 --2- 172.21.15.79:0/2636558993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30fc0b3570 0x7f30fc1f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.472+0000 7f31012f7640 1 --2- 172.21.15.79:0/2636558993 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f30fc15e4d0 0x7f30fc0b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.472+0000 7f30fbfff640 1 -- 172.21.15.79:0/2636558993 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f30fc15e4d0 msgr2=0x7f30fc0b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.473+0000 7f30fbfff640 1 --2- 172.21.15.79:0/2636558993 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f30fc15e4d0 0x7f30fc0b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.473+0000 7f30fbfff640 1 -- 172.21.15.79:0/2636558993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30fc0b3570 msgr2=0x7f30fc1f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.473+0000 7f30fbfff640 1 --2- 172.21.15.79:0/2636558993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30fc0b3570 0x7f30fc1f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.473+0000 7f30fbfff640 1 -- 172.21.15.79:0/2636558993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30fc0b4f80 con 0x7f30fc0d2e20 2024-04-25T02:10:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.473+0000 7f30fbfff640 1 --2- 172.21.15.79:0/2636558993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30fc0d2e20 0x7f30fc15cd70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f30f000c430 tx=0x7f30f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.473+0000 7f30f97fa640 1 -- 172.21.15.79:0/2636558993 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0011790 con 0x7f30fc0d2e20 2024-04-25T02:10:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.473+0000 7f30f97fa640 1 -- 172.21.15.79:0/2636558993 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f0017070 con 0x7f30fc0d2e20 2024-04-25T02:10:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.473+0000 7f30f97fa640 1 -- 172.21.15.79:0/2636558993 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0011bb0 con 0x7f30fc0d2e20 2024-04-25T02:10:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.473+0000 7f3102d5a640 1 -- 172.21.15.79:0/2636558993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30fc0b5260 con 0x7f30fc0d2e20 2024-04-25T02:10:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.473+0000 7f3102d5a640 1 -- 172.21.15.79:0/2636558993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30fc0b5820 con 0x7f30fc0d2e20 2024-04-25T02:10:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.474+0000 7f3102d5a640 1 -- 172.21.15.79:0/2636558993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30fc0690a0 con 0x7f30fc0d2e20 2024-04-25T02:10:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.474+0000 7f30f97fa640 1 -- 172.21.15.79:0/2636558993 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30f001c460 con 0x7f30fc0d2e20 2024-04-25T02:10:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.475+0000 7f30f97fa640 1 --2- 172.21.15.79:0/2636558993 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30e806be60 0x7f30e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.475+0000 7f3100af6640 1 --2- 172.21.15.79:0/2636558993 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30e806be60 0x7f30e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.475+0000 7f30f97fa640 1 -- 172.21.15.79:0/2636558993 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f30f008aab0 con 0x7f30fc0d2e20 2024-04-25T02:10:28.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.475+0000 7f3100af6640 1 --2- 172.21.15.79:0/2636558993 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30e806be60 0x7f30e806e320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f30ec034000 tx=0x7f30ec02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:28.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.479+0000 7f30f97fa640 1 -- 172.21.15.79:0/2636558993 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f30f0058ea0 con 0x7f30fc0d2e20 2024-04-25T02:10:28.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.687+0000 7f3102d5a640 1 -- 172.21.15.79:0/2636558993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30fc0d5060 con 0x7f30fc0d2e20 2024-04-25T02:10:28.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.687+0000 7f30f97fa640 1 -- 172.21.15.79:0/2636558993 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5184 (secure 0 0 0) 0x7f30f005d1a0 con 0x7f30fc0d2e20 2024-04-25T02:10:28.695 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:28.695 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5431,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3495029157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3495029157},{"type":"v1","addr":"172.21.15.189:6834","nonce":3495029157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2036557544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2036557544},{"type":"v1","addr":"172.21.15.189:6835","nonce":2036557544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/326759836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":326759836},{"type":"v1","addr":"172.21.15.79:6836","nonce":326759836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:25.684570+0000","modified":"2024-04-25T02:10:27.688419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2253487658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2253487658},{"type":"v1","addr":"172.21.15.79:6837","nonce":2253487658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":4}]} 2024-04-25T02:10:28.695 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 24 2024-04-25T02:10:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.689+0000 7f3102d5a640 1 -- 172.21.15.79:0/2636558993 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30e806be60 msgr2=0x7f30e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.689+0000 7f3102d5a640 1 --2- 172.21.15.79:0/2636558993 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30e806be60 0x7f30e806e320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f30ec034000 tx=0x7f30ec02e000 comp rx=0 tx=0).stop 2024-04-25T02:10:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.689+0000 7f3102d5a640 1 -- 172.21.15.79:0/2636558993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30fc0d2e20 msgr2=0x7f30fc15cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.689+0000 7f3102d5a640 1 --2- 172.21.15.79:0/2636558993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30fc0d2e20 0x7f30fc15cd70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f30f000c430 tx=0x7f30f000c8f0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.689+0000 7f3102d5a640 1 -- 172.21.15.79:0/2636558993 shutdown_connections 2024-04-25T02:10:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.689+0000 7f3102d5a640 1 --2- 172.21.15.79:0/2636558993 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30e806be60 0x7f30e806e320 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.689+0000 7f3102d5a640 1 --2- 172.21.15.79:0/2636558993 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f30fc15e4d0 0x7f30fc0b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.689+0000 7f3102d5a640 1 --2- 172.21.15.79:0/2636558993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30fc0d2e20 0x7f30fc15cd70 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.689+0000 7f3102d5a640 1 --2- 172.21.15.79:0/2636558993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30fc0b3570 0x7f30fc1f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.689+0000 7f3102d5a640 1 -- 172.21.15.79:0/2636558993 >> 172.21.15.79:0/2636558993 conn(0x7f30fc09d460 msgr2=0x7f30fc0d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:28.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.689+0000 7f3102d5a640 1 -- 172.21.15.79:0/2636558993 shutdown_connections 2024-04-25T02:10:28.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.689+0000 7f3102d5a640 1 -- 172.21.15.79:0/2636558993 wait complete. 2024-04-25T02:10:28.708 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:28.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.797+0000 7f70c1102640 1 Processor -- start 2024-04-25T02:10:28.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.797+0000 7f70c1102640 1 -- start start 2024-04-25T02:10:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.797+0000 7f70c1102640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f70bc071d00 0x7f70bc1653f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.797+0000 7f70c1102640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70bc15bb10 con 0x7f70bc15a720 2024-04-25T02:10:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.797+0000 7f70c1102640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70bc0b2e60 con 0x7f70bc0d07a0 2024-04-25T02:10:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.797+0000 7f70c1102640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f70bc0b3140 con 0x7f70bc071d00 2024-04-25T02:10:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70bad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f70bc15a720 0x7f70bc15ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53824/0 (socket says 172.21.15.79:53824) 2024-04-25T02:10:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70bad9d640 1 -- 172.21.15.79:0/2406616301 learned_addr learned my addr 172.21.15.79:0/2406616301 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70b9d9b640 1 -- 172.21.15.79:0/2406616301 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1927716690 0 0) 0x7f70bc15bb10 con 0x7f70bc15a720 2024-04-25T02:10:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70b9d9b640 1 -- 172.21.15.79:0/2406616301 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70a4003520 con 0x7f70bc15a720 2024-04-25T02:10:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70bb59e640 1 --2- 172.21.15.79:0/2406616301 >> v2:172.21.15.189:3300/0 conn(0x7f70bc071d00 0x7f70bc1653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70b9d9b640 1 -- 172.21.15.79:0/2406616301 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3406226214 0 0) 0x7f70a4003520 con 0x7f70bc15a720 2024-04-25T02:10:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70b9d9b640 1 -- 172.21.15.79:0/2406616301 >> v2:172.21.15.189:3300/0 conn(0x7f70bc071d00 msgr2=0x7f70bc1653f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70b9d9b640 1 --2- 172.21.15.79:0/2406616301 >> v2:172.21.15.189:3300/0 conn(0x7f70bc071d00 0x7f70bc1653f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70b9d9b640 1 -- 172.21.15.79:0/2406616301 >> v1:172.21.15.189:6789/0 conn(0x7f70bc0d07a0 legacy=0x7f70bc0b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70b9d9b640 1 -- 172.21.15.79:0/2406616301 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70bc0b3420 con 0x7f70bc15a720 2024-04-25T02:10:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70b9d9b640 1 -- 172.21.15.79:0/2406616301 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f70b0001670 con 0x7f70bc15a720 2024-04-25T02:10:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70b9d9b640 1 -- 172.21.15.79:0/2406616301 >> v1:172.21.15.79:6789/0 conn(0x7f70bc15a720 legacy=0x7f70bc15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70b9d9b640 1 --2- 172.21.15.79:0/2406616301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f70a4003a00 0x7f70a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70b9d9b640 1 --2- 172.21.15.79:0/2406616301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70a4004800 0x7f70a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70b9d9b640 1 --2- 172.21.15.79:0/2406616301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70a4005210 0x7f70a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70b9d9b640 1 -- 172.21.15.79:0/2406616301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc0b3140 con 0x7f70a4005210 2024-04-25T02:10:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70b9d9b640 1 -- 172.21.15.79:0/2406616301 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f70a400c140 con 0x7f70a4004800 2024-04-25T02:10:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70b9d9b640 1 -- 172.21.15.79:0/2406616301 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f70a400c340 con 0x7f70a4003a00 2024-04-25T02:10:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70bb59e640 1 --2- 172.21.15.79:0/2406616301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70a4005210 0x7f70a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70ba59c640 1 --2- 172.21.15.79:0/2406616301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70a4004800 0x7f70a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.798+0000 7f70bad9d640 1 --2- 172.21.15.79:0/2406616301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f70a4003a00 0x7f70a4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.799+0000 7f70bb59e640 1 -- 172.21.15.79:0/2406616301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f70a4003a00 msgr2=0x7f70a4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.799+0000 7f70bb59e640 1 --2- 172.21.15.79:0/2406616301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f70a4003a00 0x7f70a4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.799+0000 7f70bb59e640 1 -- 172.21.15.79:0/2406616301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70a4004800 msgr2=0x7f70a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.799+0000 7f70bb59e640 1 --2- 172.21.15.79:0/2406616301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70a4004800 0x7f70a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.799+0000 7f70bb59e640 1 -- 172.21.15.79:0/2406616301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a4003520 con 0x7f70a4005210 2024-04-25T02:10:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.799+0000 7f70bb59e640 1 -- 172.21.15.79:0/2406616301 reap_dead start 2024-04-25T02:10:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.799+0000 7f70bb59e640 1 --2- 172.21.15.79:0/2406616301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70a4005210 0x7f70a400b9c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009f90 tx=0x7f70a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffad8b55b6a5714 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.799+0000 7f70b9d9b640 1 -- 172.21.15.79:0/2406616301 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4035020 con 0x7f70a4005210 2024-04-25T02:10:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.799+0000 7f70b9d9b640 1 -- 172.21.15.79:0/2406616301 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b4003b90 con 0x7f70a4005210 2024-04-25T02:10:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.799+0000 7f70b9d9b640 1 -- 172.21.15.79:0/2406616301 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4009c10 con 0x7f70a4005210 2024-04-25T02:10:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.800+0000 7f70c1102640 1 -- 172.21.15.79:0/2406616301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70a4005210 msgr2=0x7f70a400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.800+0000 7f70c1102640 1 --2- 172.21.15.79:0/2406616301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70a4005210 0x7f70a400b9c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009f90 tx=0x7f70a4005830 comp rx=0 tx=0).stop 2024-04-25T02:10:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.800+0000 7f70c1102640 1 -- 172.21.15.79:0/2406616301 shutdown_connections 2024-04-25T02:10:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.800+0000 7f70c1102640 1 --2- 172.21.15.79:0/2406616301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70a4005210 0x7f70a400b9c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.800+0000 7f70c1102640 1 -- 172.21.15.79:0/2406616301 >> 172.21.15.79:0/2406616301 conn(0x7f70bc0cfc80 msgr2=0x7f70bc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.800+0000 7f70c1102640 1 -- 172.21.15.79:0/2406616301 shutdown_connections 2024-04-25T02:10:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.800+0000 7f70c1102640 1 -- 172.21.15.79:0/2406616301 wait complete. 2024-04-25T02:10:28.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.801+0000 7f70c1102640 1 Processor -- start 2024-04-25T02:10:28.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.801+0000 7f70c1102640 1 -- start start 2024-04-25T02:10:28.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70c1102640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f70a4005210 0x7f70bc15d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70c1102640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70bc14e480 0x7f70bc158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70c1102640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70bc158c80 0x7f70bc15bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70c1102640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc15ec80 con 0x7f70bc14e480 2024-04-25T02:10:28.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70c1102640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc0b39e0 con 0x7f70bc158c80 2024-04-25T02:10:28.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70c1102640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f70bc15ee00 con 0x7f70a4005210 2024-04-25T02:10:28.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70ba59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70bc14e480 0x7f70bc158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70ba59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70bc14e480 0x7f70bc158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35352/0 (socket says 172.21.15.79:35352) 2024-04-25T02:10:28.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70ba59c640 1 -- 172.21.15.79:0/3147121913 learned_addr learned my addr 172.21.15.79:0/3147121913 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:28.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70bad9d640 1 --2- 172.21.15.79:0/3147121913 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f70a4005210 0x7f70bc15d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70bb59e640 1 --2- 172.21.15.79:0/3147121913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70bc158c80 0x7f70bc15bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70ba59c640 1 -- 172.21.15.79:0/3147121913 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f70a4005210 msgr2=0x7f70bc15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70ba59c640 1 --2- 172.21.15.79:0/3147121913 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f70a4005210 0x7f70bc15d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70ba59c640 1 -- 172.21.15.79:0/3147121913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70bc158c80 msgr2=0x7f70bc15bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70ba59c640 1 --2- 172.21.15.79:0/3147121913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70bc158c80 0x7f70bc15bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.802+0000 7f70ba59c640 1 -- 172.21.15.79:0/3147121913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70bc155410 con 0x7f70bc14e480 2024-04-25T02:10:28.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.803+0000 7f70bb59e640 1 --2- 172.21.15.79:0/3147121913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70bc158c80 0x7f70bc15bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:28.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.803+0000 7f70ba59c640 1 --2- 172.21.15.79:0/3147121913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70bc14e480 0x7f70bc158740 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00f5c0 tx=0x7f70ac00fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:28.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.803+0000 7f70a37fe640 1 -- 172.21.15.79:0/3147121913 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac0052e0 con 0x7f70bc14e480 2024-04-25T02:10:28.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.803+0000 7f70a37fe640 1 -- 172.21.15.79:0/3147121913 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70ac018070 con 0x7f70bc14e480 2024-04-25T02:10:28.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.803+0000 7f70a37fe640 1 -- 172.21.15.79:0/3147121913 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac003830 con 0x7f70bc14e480 2024-04-25T02:10:28.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.803+0000 7f70c1102640 1 -- 172.21.15.79:0/3147121913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70bc1556f0 con 0x7f70bc14e480 2024-04-25T02:10:28.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.803+0000 7f70c1102640 1 -- 172.21.15.79:0/3147121913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70bc152870 con 0x7f70bc14e480 2024-04-25T02:10:28.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.804+0000 7f70c1102640 1 -- 172.21.15.79:0/3147121913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70bc159090 con 0x7f70bc14e480 2024-04-25T02:10:28.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.804+0000 7f70a37fe640 1 -- 172.21.15.79:0/3147121913 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70ac0039d0 con 0x7f70bc14e480 2024-04-25T02:10:28.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.805+0000 7f70a37fe640 1 --2- 172.21.15.79:0/3147121913 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f70a806be60 0x7f70a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.805+0000 7f70a37fe640 1 -- 172.21.15.79:0/3147121913 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f70ac08abd0 con 0x7f70bc14e480 2024-04-25T02:10:28.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.805+0000 7f70bad9d640 1 --2- 172.21.15.79:0/3147121913 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f70a806be60 0x7f70a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.805+0000 7f70bad9d640 1 --2- 172.21.15.79:0/3147121913 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f70a806be60 0x7f70a806e320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f70b0000c00 tx=0x7f70b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:28.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.809+0000 7f70a37fe640 1 -- 172.21.15.79:0/3147121913 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f70bc159090 con 0x7f70bc14e480 2024-04-25T02:10:28.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.985+0000 7f70c1102640 1 -- 172.21.15.79:0/3147121913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70bc0690a0 con 0x7f70bc14e480 2024-04-25T02:10:28.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.986+0000 7f70a37fe640 1 -- 172.21.15.79:0/3147121913 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16677 (secure 0 0 0) 0x7f70ac059580 con 0x7f70bc14e480 2024-04-25T02:10:28.994 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:28.994 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":59,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:10:27.345273+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:23.901352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:24.658248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.988+0000 7f70c1102640 1 -- 172.21.15.79:0/3147121913 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f70a806be60 msgr2=0x7f70a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.988+0000 7f70c1102640 1 --2- 172.21.15.79:0/3147121913 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f70a806be60 0x7f70a806e320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f70b0000c00 tx=0x7f70b0009040 comp rx=0 tx=0).stop 2024-04-25T02:10:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.988+0000 7f70c1102640 1 -- 172.21.15.79:0/3147121913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70bc14e480 msgr2=0x7f70bc158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.988+0000 7f70c1102640 1 --2- 172.21.15.79:0/3147121913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70bc14e480 0x7f70bc158740 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00f5c0 tx=0x7f70ac00fa80 comp rx=0 tx=0).stop 2024-04-25T02:10:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.988+0000 7f70c1102640 1 -- 172.21.15.79:0/3147121913 shutdown_connections 2024-04-25T02:10:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.988+0000 7f70c1102640 1 --2- 172.21.15.79:0/3147121913 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f70a806be60 0x7f70a806e320 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.988+0000 7f70c1102640 1 --2- 172.21.15.79:0/3147121913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70bc158c80 0x7f70bc15bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.988+0000 7f70c1102640 1 --2- 172.21.15.79:0/3147121913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70bc14e480 0x7f70bc158740 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.988+0000 7f70c1102640 1 --2- 172.21.15.79:0/3147121913 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f70a4005210 0x7f70bc15d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.988+0000 7f70c1102640 1 -- 172.21.15.79:0/3147121913 >> 172.21.15.79:0/3147121913 conn(0x7f70bc0cfc80 msgr2=0x7f70bc0b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.988+0000 7f70c1102640 1 -- 172.21.15.79:0/3147121913 shutdown_connections 2024-04-25T02:10:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:28.988+0000 7f70c1102640 1 -- 172.21.15.79:0/3147121913 wait complete. 2024-04-25T02:10:29.007 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T02:10:29.007 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:10:29.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.096+0000 7f3821ad4640 1 Processor -- start 2024-04-25T02:10:29.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.096+0000 7f3821ad4640 1 -- start start 2024-04-25T02:10:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.097+0000 7f3821ad4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f381c144cb0 0x7f381c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.097+0000 7f3821ad4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f381c06e660 0x7f381c071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.097+0000 7f3821ad4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f381c070d90 con 0x7f381c0b5580 2024-04-25T02:10:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.097+0000 7f3821ad4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f381c0cf130 con 0x7f381c144cb0 2024-04-25T02:10:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.097+0000 7f3821ad4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f381c0cf410 con 0x7f381c06e660 2024-04-25T02:10:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.097+0000 7f381b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f381c144cb0 0x7f381c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.097+0000 7f381affd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f381c0b5580 0x7f381c06df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53836/0 (socket says 172.21.15.79:53836) 2024-04-25T02:10:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.097+0000 7f381affd640 1 -- 172.21.15.79:0/1641401487 learned_addr learned my addr 172.21.15.79:0/1641401487 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.097+0000 7f381bfff640 1 --2- 172.21.15.79:0/1641401487 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f381c06e660 0x7f381c071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.097+0000 7f381b7fe640 1 -- 172.21.15.79:0/1641401487 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f381c06e660 msgr2=0x7f381c071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.097+0000 7f381b7fe640 1 --2- 172.21.15.79:0/1641401487 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f381c06e660 0x7f381c071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.097+0000 7f381b7fe640 1 -- 172.21.15.79:0/1641401487 >> v1:172.21.15.79:6789/0 conn(0x7f381c0b5580 legacy=0x7f381c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.097+0000 7f381b7fe640 1 -- 172.21.15.79:0/1641401487 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381c0cf6f0 con 0x7f381c144cb0 2024-04-25T02:10:29.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.097+0000 7f381a7fc640 1 -- 172.21.15.79:0/1641401487 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1114469522 0 0) 0x7f381c070d90 con 0x7f381c0b5580 2024-04-25T02:10:29.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.098+0000 7f381b7fe640 1 --2- 172.21.15.79:0/1641401487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c144cb0 0x7f381c0b5040 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f380c0097a0 tx=0x7f380c02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d21136cd880c40a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:29.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.098+0000 7f381a7fc640 1 -- 172.21.15.79:0/1641401487 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c037070 con 0x7f381c144cb0 2024-04-25T02:10:29.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.098+0000 7f381a7fc640 1 -- 172.21.15.79:0/1641401487 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f380c02adb0 con 0x7f381c144cb0 2024-04-25T02:10:29.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.098+0000 7f381a7fc640 1 -- 172.21.15.79:0/1641401487 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c032660 con 0x7f381c144cb0 2024-04-25T02:10:29.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.098+0000 7f3821ad4640 1 -- 172.21.15.79:0/1641401487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c144cb0 msgr2=0x7f381c0b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.098+0000 7f3821ad4640 1 --2- 172.21.15.79:0/1641401487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c144cb0 0x7f381c0b5040 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f380c0097a0 tx=0x7f380c02a060 comp rx=0 tx=0).stop 2024-04-25T02:10:29.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.098+0000 7f3821ad4640 1 -- 172.21.15.79:0/1641401487 shutdown_connections 2024-04-25T02:10:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.098+0000 7f3821ad4640 1 --2- 172.21.15.79:0/1641401487 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f381c06e660 0x7f381c071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.098+0000 7f3821ad4640 1 --2- 172.21.15.79:0/1641401487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c144cb0 0x7f381c0b5040 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.098+0000 7f3821ad4640 1 -- 172.21.15.79:0/1641401487 >> 172.21.15.79:0/1641401487 conn(0x7f381c0cfc80 msgr2=0x7f381c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.098+0000 7f3821ad4640 1 -- 172.21.15.79:0/1641401487 shutdown_connections 2024-04-25T02:10:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.098+0000 7f3821ad4640 1 -- 172.21.15.79:0/1641401487 wait complete. 2024-04-25T02:10:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.100+0000 7f3821ad4640 1 Processor -- start 2024-04-25T02:10:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.100+0000 7f3821ad4640 1 -- start start 2024-04-25T02:10:29.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.100+0000 7f3821ad4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f381c06e660 0x7f381c132460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.100+0000 7f3821ad4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f381c0b5580 0x7f381c1577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.100+0000 7f3821ad4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c144cb0 0x7f381c0ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.100+0000 7f3821ad4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f381c145ab0 con 0x7f381c144cb0 2024-04-25T02:10:29.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.100+0000 7f3821ad4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f381c145090 con 0x7f381c0b5580 2024-04-25T02:10:29.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.100+0000 7f3821ad4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f381c145c30 con 0x7f381c06e660 2024-04-25T02:10:29.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f381bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c144cb0 0x7f381c0ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f381bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c144cb0 0x7f381c0ae820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35364/0 (socket says 172.21.15.79:35364) 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f381bfff640 1 -- 172.21.15.79:0/1889760755 learned_addr learned my addr 172.21.15.79:0/1889760755 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f381affd640 1 --2- 172.21.15.79:0/1889760755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f381c0b5580 0x7f381c1577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f381b7fe640 1 --2- 172.21.15.79:0/1889760755 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f381c06e660 0x7f381c132460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f381bfff640 1 -- 172.21.15.79:0/1889760755 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f381c06e660 msgr2=0x7f381c132460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f381bfff640 1 --2- 172.21.15.79:0/1889760755 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f381c06e660 0x7f381c132460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f381bfff640 1 -- 172.21.15.79:0/1889760755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f381c0b5580 msgr2=0x7f381c1577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f381bfff640 1 --2- 172.21.15.79:0/1889760755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f381c0b5580 0x7f381c1577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f381bfff640 1 -- 172.21.15.79:0/1889760755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381c1329a0 con 0x7f381c144cb0 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f381bfff640 1 --2- 172.21.15.79:0/1889760755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c144cb0 0x7f381c0ae820 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3814007e40 tx=0x7f381400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f3803fff640 1 -- 172.21.15.79:0/1889760755 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814014620 con 0x7f381c144cb0 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f3803fff640 1 -- 172.21.15.79:0/1889760755 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3814019070 con 0x7f381c144cb0 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f3821ad4640 1 -- 172.21.15.79:0/1889760755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f381c15b7a0 con 0x7f381c144cb0 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f3803fff640 1 -- 172.21.15.79:0/1889760755 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814014a20 con 0x7f381c144cb0 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.101+0000 7f3821ad4640 1 -- 172.21.15.79:0/1889760755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f381c142680 con 0x7f381c144cb0 2024-04-25T02:10:29.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.102+0000 7f3821ad4640 1 -- 172.21.15.79:0/1889760755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f381c0b5c70 con 0x7f381c144cb0 2024-04-25T02:10:29.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.103+0000 7f3803fff640 1 -- 172.21.15.79:0/1889760755 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3814014bc0 con 0x7f381c144cb0 2024-04-25T02:10:29.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.103+0000 7f3803fff640 1 --2- 172.21.15.79:0/1889760755 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f380806be30 0x7f380806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.103+0000 7f381b7fe640 1 --2- 172.21.15.79:0/1889760755 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f380806be30 0x7f380806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.103+0000 7f3803fff640 1 -- 172.21.15.79:0/1889760755 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f381408b640 con 0x7f381c144cb0 2024-04-25T02:10:29.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.104+0000 7f381b7fe640 1 --2- 172.21.15.79:0/1889760755 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f380806be30 0x7f380806e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f380c034000 tx=0x7f380c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:29.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.108+0000 7f3803fff640 1 -- 172.21.15.79:0/1889760755 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f381c0b5c70 con 0x7f381c144cb0 2024-04-25T02:10:29.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.277+0000 7f3821ad4640 1 -- 172.21.15.79:0/1889760755 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f381c0d0b90 con 0x7f380806be30 2024-04-25T02:10:29.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.283+0000 7f3803fff640 1 -- 172.21.15.79:0/1889760755 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246636 (secure 0 0 0) 0x7f381c0d0b90 con 0x7f380806be30 2024-04-25T02:10:29.334 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:29.335 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:10:29.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.286+0000 7f3821ad4640 1 -- 172.21.15.79:0/1889760755 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f380806be30 msgr2=0x7f380806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.286+0000 7f3821ad4640 1 --2- 172.21.15.79:0/1889760755 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f380806be30 0x7f380806e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f380c034000 tx=0x7f380c02e000 comp rx=0 tx=0).stop 2024-04-25T02:10:29.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.286+0000 7f3821ad4640 1 -- 172.21.15.79:0/1889760755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c144cb0 msgr2=0x7f381c0ae820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.286+0000 7f3821ad4640 1 --2- 172.21.15.79:0/1889760755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c144cb0 0x7f381c0ae820 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3814007e40 tx=0x7f381400e4b0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.286+0000 7f3821ad4640 1 -- 172.21.15.79:0/1889760755 shutdown_connections 2024-04-25T02:10:29.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.286+0000 7f3821ad4640 1 --2- 172.21.15.79:0/1889760755 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f380806be30 0x7f380806e2f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.286+0000 7f3821ad4640 1 --2- 172.21.15.79:0/1889760755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c144cb0 0x7f381c0ae820 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.286+0000 7f3821ad4640 1 --2- 172.21.15.79:0/1889760755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f381c0b5580 0x7f381c1577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.286+0000 7f3821ad4640 1 --2- 172.21.15.79:0/1889760755 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f381c06e660 0x7f381c132460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.286+0000 7f3821ad4640 1 -- 172.21.15.79:0/1889760755 >> 172.21.15.79:0/1889760755 conn(0x7f381c0cfc80 msgr2=0x7f381c0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:29.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.286+0000 7f3821ad4640 1 -- 172.21.15.79:0/1889760755 shutdown_connections 2024-04-25T02:10:29.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.286+0000 7f3821ad4640 1 -- 172.21.15.79:0/1889760755 wait complete. 2024-04-25T02:10:29.338 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-04-25T02:10:29.203494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226836,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747884,"statfs":{"total":773094113280,"available":772861833216,"internally_reserved":0,"allocated":6647808,"data_stored":3418669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.873032"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347621+0000","last_change":"2024-04-25T02:10:25.347621+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347621+0000","last_undegraded":"2024-04-25T02:10:25.347621+0000","last_fullsized":"2024-04-25T02:10:25.347621+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340544+0000","last_change":"2024-04-25T02:10:25.340544+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340544+0000","last_undegraded":"2024-04-25T02:10:25.340544+0000","last_fullsized":"2024-04-25T02:10:25.340544+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348680+0000","last_change":"2024-04-25T02:10:25.348680+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348680+0000","last_undegraded":"2024-04-25T02:10:25.348680+0000","last_fullsized":"2024-04-25T02:10:25.348680+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345857+0000","last_change":"2024-04-25T02:10:25.345857+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345857+0000","last_undegraded":"2024-04-25T02:10:25.345857+0000","last_fullsized":"2024-04-25T02:10:25.345857+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.349837+0000","last_change":"2024-04-25T02:10:25.349837+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.349837+0000","last_undegraded":"2024-04-25T02:10:25.349837+0000","last_fullsized":"2024-04-25T02:10:25.349837+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344374+0000","last_change":"2024-04-25T02:10:25.344374+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344374+0000","last_undegraded":"2024-04-25T02:10:25.344374+0000","last_fullsized":"2024-04-25T02:10:25.344374+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340105+0000","last_change":"2024-04-25T02:10:25.340105+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340105+0000","last_undegraded":"2024-04-25T02:10:25.340105+0000","last_fullsized":"2024-04-25T02:10:25.340105+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341468+0000","last_change":"2024-04-25T02:10:25.341468+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341468+0000","last_undegraded":"2024-04-25T02:10:25.341468+0000","last_fullsized":"2024-04-25T02:10:25.341468+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339847+0000","last_change":"2024-04-25T02:10:25.339847+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339847+0000","last_undegraded":"2024-04-25T02:10:25.339847+0000","last_fullsized":"2024-04-25T02:10:25.339847+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340046+0000","last_change":"2024-04-25T02:10:25.340046+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340046+0000","last_undegraded":"2024-04-25T02:10:25.340046+0000","last_fullsized":"2024-04-25T02:10:25.340046+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339755+0000","last_change":"2024-04-25T02:10:25.339755+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339755+0000","last_undegraded":"2024-04-25T02:10:25.339755+0000","last_fullsized":"2024-04-25T02:10:25.339755+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344853+0000","last_change":"2024-04-25T02:10:25.344853+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344853+0000","last_undegraded":"2024-04-25T02:10:25.344853+0000","last_fullsized":"2024-04-25T02:10:25.344853+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342550+0000","last_change":"2024-04-25T02:10:25.342550+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342550+0000","last_undegraded":"2024-04-25T02:10:25.342550+0000","last_fullsized":"2024-04-25T02:10:25.342550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339742+0000","last_change":"2024-04-25T02:10:25.339742+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339742+0000","last_undegraded":"2024-04-25T02:10:25.339742+0000","last_fullsized":"2024-04-25T02:10:25.339742+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339195+0000","last_change":"2024-04-25T02:10:25.339195+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339195+0000","last_undegraded":"2024-04-25T02:10:25.339195+0000","last_fullsized":"2024-04-25T02:10:25.339195+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345098+0000","last_change":"2024-04-25T02:10:25.345098+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345098+0000","last_undegraded":"2024-04-25T02:10:25.345098+0000","last_fullsized":"2024-04-25T02:10:25.345098+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342857+0000","last_change":"2024-04-25T02:10:25.342857+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342857+0000","last_undegraded":"2024-04-25T02:10:25.342857+0000","last_fullsized":"2024-04-25T02:10:25.342857+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.349384+0000","last_change":"2024-04-25T02:10:25.349384+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.349384+0000","last_undegraded":"2024-04-25T02:10:25.349384+0000","last_fullsized":"2024-04-25T02:10:25.349384+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347360+0000","last_change":"2024-04-25T02:10:25.347360+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347360+0000","last_undegraded":"2024-04-25T02:10:25.347360+0000","last_fullsized":"2024-04-25T02:10:25.347360+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340489+0000","last_change":"2024-04-25T02:10:25.340489+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340489+0000","last_undegraded":"2024-04-25T02:10:25.340489+0000","last_fullsized":"2024-04-25T02:10:25.340489+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348114+0000","last_change":"2024-04-25T02:10:25.348114+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348114+0000","last_undegraded":"2024-04-25T02:10:25.348114+0000","last_fullsized":"2024-04-25T02:10:25.348114+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342634+0000","last_change":"2024-04-25T02:10:25.342634+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342634+0000","last_undegraded":"2024-04-25T02:10:25.342634+0000","last_fullsized":"2024-04-25T02:10:25.342634+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347881+0000","last_change":"2024-04-25T02:10:25.347881+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347881+0000","last_undegraded":"2024-04-25T02:10:25.347881+0000","last_fullsized":"2024-04-25T02:10:25.347881+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343793+0000","last_change":"2024-04-25T02:10:25.343793+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343793+0000","last_undegraded":"2024-04-25T02:10:25.343793+0000","last_fullsized":"2024-04-25T02:10:25.343793+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347250+0000","last_change":"2024-04-25T02:10:25.347250+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347250+0000","last_undegraded":"2024-04-25T02:10:25.347250+0000","last_fullsized":"2024-04-25T02:10:25.347250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345173+0000","last_change":"2024-04-25T02:10:25.345173+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345173+0000","last_undegraded":"2024-04-25T02:10:25.345173+0000","last_fullsized":"2024-04-25T02:10:25.345173+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344519+0000","last_change":"2024-04-25T02:10:25.344519+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344519+0000","last_undegraded":"2024-04-25T02:10:25.344519+0000","last_fullsized":"2024-04-25T02:10:25.344519+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348626+0000","last_change":"2024-04-25T02:10:25.348626+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348626+0000","last_undegraded":"2024-04-25T02:10:25.348626+0000","last_fullsized":"2024-04-25T02:10:25.348626+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340691+0000","last_change":"2024-04-25T02:10:25.340691+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340691+0000","last_undegraded":"2024-04-25T02:10:25.340691+0000","last_fullsized":"2024-04-25T02:10:25.340691+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347408+0000","last_change":"2024-04-25T02:10:25.347408+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347408+0000","last_undegraded":"2024-04-25T02:10:25.347408+0000","last_fullsized":"2024-04-25T02:10:25.347408+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.346786+0000","last_change":"2024-04-25T02:10:25.346786+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.346786+0000","last_undegraded":"2024-04-25T02:10:25.346786+0000","last_fullsized":"2024-04-25T02:10:25.346786+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344176+0000","last_change":"2024-04-25T02:10:25.344176+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344176+0000","last_undegraded":"2024-04-25T02:10:25.344176+0000","last_fullsized":"2024-04-25T02:10:25.344176+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343764+0000","last_change":"2024-04-25T02:10:25.343764+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343764+0000","last_undegraded":"2024-04-25T02:10:25.343764+0000","last_fullsized":"2024-04-25T02:10:25.343764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352494+0000","last_change":"2024-04-25T02:10:25.351015+0000","last_active":"2024-04-25T02:10:25.352494+0000","last_peered":"2024-04-25T02:10:25.352494+0000","last_clean":"2024-04-25T02:10:25.352494+0000","last_became_active":"2024-04-25T02:10:25.350729+0000","last_became_peered":"2024-04-25T02:10:25.350729+0000","last_unstale":"2024-04-25T02:10:25.352494+0000","last_undegraded":"2024-04-25T02:10:25.352494+0000","last_fullsized":"2024-04-25T02:10:25.352494+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.992991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339701+0000","last_change":"2024-04-25T02:10:25.339701+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339701+0000","last_undegraded":"2024-04-25T02:10:25.339701+0000","last_fullsized":"2024-04-25T02:10:25.339701+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356621+0000","last_change":"2024-04-25T02:10:25.355315+0000","last_active":"2024-04-25T02:10:25.356621+0000","last_peered":"2024-04-25T02:10:25.356621+0000","last_clean":"2024-04-25T02:10:25.356621+0000","last_became_active":"2024-04-25T02:10:25.354844+0000","last_became_peered":"2024-04-25T02:10:25.354844+0000","last_unstale":"2024-04-25T02:10:25.356621+0000","last_undegraded":"2024-04-25T02:10:25.356621+0000","last_fullsized":"2024-04-25T02:10:25.356621+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:09.410317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344146+0000","last_change":"2024-04-25T02:10:25.344146+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344146+0000","last_undegraded":"2024-04-25T02:10:25.344146+0000","last_fullsized":"2024-04-25T02:10:25.344146+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352520+0000","last_change":"2024-04-25T02:10:25.350788+0000","last_active":"2024-04-25T02:10:25.352520+0000","last_peered":"2024-04-25T02:10:25.352520+0000","last_clean":"2024-04-25T02:10:25.352520+0000","last_became_active":"2024-04-25T02:10:25.350527+0000","last_became_peered":"2024-04-25T02:10:25.350527+0000","last_unstale":"2024-04-25T02:10:25.352520+0000","last_undegraded":"2024-04-25T02:10:25.352520+0000","last_fullsized":"2024-04-25T02:10:25.352520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:09.197493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343326+0000","last_change":"2024-04-25T02:10:25.343326+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343326+0000","last_undegraded":"2024-04-25T02:10:25.343326+0000","last_fullsized":"2024-04-25T02:10:25.343326+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.354000+0000","last_change":"2024-04-25T02:10:25.351435+0000","last_active":"2024-04-25T02:10:25.354000+0000","last_peered":"2024-04-25T02:10:25.354000+0000","last_clean":"2024-04-25T02:10:25.354000+0000","last_became_active":"2024-04-25T02:10:25.351119+0000","last_became_peered":"2024-04-25T02:10:25.351119+0000","last_unstale":"2024-04-25T02:10:25.354000+0000","last_undegraded":"2024-04-25T02:10:25.354000+0000","last_fullsized":"2024-04-25T02:10:25.354000+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:11.861132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342223+0000","last_change":"2024-04-25T02:10:25.342223+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342223+0000","last_undegraded":"2024-04-25T02:10:25.342223+0000","last_fullsized":"2024-04-25T02:10:25.342223+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355979+0000","last_change":"2024-04-25T02:10:25.354878+0000","last_active":"2024-04-25T02:10:25.355979+0000","last_peered":"2024-04-25T02:10:25.355979+0000","last_clean":"2024-04-25T02:10:25.355979+0000","last_became_active":"2024-04-25T02:10:25.354616+0000","last_became_peered":"2024-04-25T02:10:25.354616+0000","last_unstale":"2024-04-25T02:10:25.355979+0000","last_undegraded":"2024-04-25T02:10:25.355979+0000","last_fullsized":"2024-04-25T02:10:25.355979+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:08.954558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340276+0000","last_change":"2024-04-25T02:10:25.340276+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340276+0000","last_undegraded":"2024-04-25T02:10:25.340276+0000","last_fullsized":"2024-04-25T02:10:25.340276+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352613+0000","last_change":"2024-04-25T02:10:25.350576+0000","last_active":"2024-04-25T02:10:25.352613+0000","last_peered":"2024-04-25T02:10:25.352613+0000","last_clean":"2024-04-25T02:10:25.352613+0000","last_became_active":"2024-04-25T02:10:25.350283+0000","last_became_peered":"2024-04-25T02:10:25.350283+0000","last_unstale":"2024-04-25T02:10:25.352613+0000","last_undegraded":"2024-04-25T02:10:25.352613+0000","last_fullsized":"2024-04-25T02:10:25.352613+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:50.678511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342834+0000","last_change":"2024-04-25T02:10:25.342834+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342834+0000","last_undegraded":"2024-04-25T02:10:25.342834+0000","last_fullsized":"2024-04-25T02:10:25.342834+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353700+0000","last_change":"2024-04-25T02:10:25.349482+0000","last_active":"2024-04-25T02:10:25.353700+0000","last_peered":"2024-04-25T02:10:25.353700+0000","last_clean":"2024-04-25T02:10:25.353700+0000","last_became_active":"2024-04-25T02:10:25.349132+0000","last_became_peered":"2024-04-25T02:10:25.349132+0000","last_unstale":"2024-04-25T02:10:25.353700+0000","last_undegraded":"2024-04-25T02:10:25.353700+0000","last_fullsized":"2024-04-25T02:10:25.353700+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:56.566118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341977+0000","last_change":"2024-04-25T02:10:25.341977+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341977+0000","last_undegraded":"2024-04-25T02:10:25.341977+0000","last_fullsized":"2024-04-25T02:10:25.341977+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353773+0000","last_change":"2024-04-25T02:10:25.349816+0000","last_active":"2024-04-25T02:10:25.353773+0000","last_peered":"2024-04-25T02:10:25.353773+0000","last_clean":"2024-04-25T02:10:25.353773+0000","last_became_active":"2024-04-25T02:10:25.349428+0000","last_became_peered":"2024-04-25T02:10:25.349428+0000","last_unstale":"2024-04-25T02:10:25.353773+0000","last_undegraded":"2024-04-25T02:10:25.353773+0000","last_fullsized":"2024-04-25T02:10:25.353773+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:27.603312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339987+0000","last_change":"2024-04-25T02:10:25.339987+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339987+0000","last_undegraded":"2024-04-25T02:10:25.339987+0000","last_fullsized":"2024-04-25T02:10:25.339987+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356609+0000","last_change":"2024-04-25T02:10:25.355143+0000","last_active":"2024-04-25T02:10:25.356609+0000","last_peered":"2024-04-25T02:10:25.356609+0000","last_clean":"2024-04-25T02:10:25.356609+0000","last_became_active":"2024-04-25T02:10:25.354873+0000","last_became_peered":"2024-04-25T02:10:25.354873+0000","last_unstale":"2024-04-25T02:10:25.356609+0000","last_undegraded":"2024-04-25T02:10:25.356609+0000","last_fullsized":"2024-04-25T02:10:25.356609+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:24.529205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347170+0000","last_change":"2024-04-25T02:10:25.347170+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347170+0000","last_undegraded":"2024-04-25T02:10:25.347170+0000","last_fullsized":"2024-04-25T02:10:25.347170+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356603+0000","last_change":"2024-04-25T02:10:25.355103+0000","last_active":"2024-04-25T02:10:25.356603+0000","last_peered":"2024-04-25T02:10:25.356603+0000","last_clean":"2024-04-25T02:10:25.356603+0000","last_became_active":"2024-04-25T02:10:25.354520+0000","last_became_peered":"2024-04-25T02:10:25.354520+0000","last_unstale":"2024-04-25T02:10:25.356603+0000","last_undegraded":"2024-04-25T02:10:25.356603+0000","last_fullsized":"2024-04-25T02:10:25.356603+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:25.255214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339665+0000","last_change":"2024-04-25T02:10:25.339665+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339665+0000","last_undegraded":"2024-04-25T02:10:25.339665+0000","last_fullsized":"2024-04-25T02:10:25.339665+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356703+0000","last_change":"2024-04-25T02:10:25.355693+0000","last_active":"2024-04-25T02:10:25.356703+0000","last_peered":"2024-04-25T02:10:25.356703+0000","last_clean":"2024-04-25T02:10:25.356703+0000","last_became_active":"2024-04-25T02:10:25.355422+0000","last_became_peered":"2024-04-25T02:10:25.355422+0000","last_unstale":"2024-04-25T02:10:25.356703+0000","last_undegraded":"2024-04-25T02:10:25.356703+0000","last_fullsized":"2024-04-25T02:10:25.356703+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:09.197493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348307+0000","last_change":"2024-04-25T02:10:25.348307+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348307+0000","last_undegraded":"2024-04-25T02:10:25.348307+0000","last_fullsized":"2024-04-25T02:10:25.348307+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353277+0000","last_change":"2024-04-25T02:10:25.346359+0000","last_active":"2024-04-25T02:10:25.353277+0000","last_peered":"2024-04-25T02:10:25.353277+0000","last_clean":"2024-04-25T02:10:25.353277+0000","last_became_active":"2024-04-25T02:10:25.346084+0000","last_became_peered":"2024-04-25T02:10:25.346084+0000","last_unstale":"2024-04-25T02:10:25.353277+0000","last_undegraded":"2024-04-25T02:10:25.353277+0000","last_fullsized":"2024-04-25T02:10:25.353277+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:54:34.693154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342892+0000","last_change":"2024-04-25T02:10:25.342892+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342892+0000","last_undegraded":"2024-04-25T02:10:25.342892+0000","last_fullsized":"2024-04-25T02:10:25.342892+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.357790+0000","last_change":"2024-04-25T02:10:25.356379+0000","last_active":"2024-04-25T02:10:25.357790+0000","last_peered":"2024-04-25T02:10:25.357790+0000","last_clean":"2024-04-25T02:10:25.357790+0000","last_became_active":"2024-04-25T02:10:25.356070+0000","last_became_peered":"2024-04-25T02:10:25.356070+0000","last_unstale":"2024-04-25T02:10:25.357790+0000","last_undegraded":"2024-04-25T02:10:25.357790+0000","last_fullsized":"2024-04-25T02:10:25.357790+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:17:16.267006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347317+0000","last_change":"2024-04-25T02:10:25.347317+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347317+0000","last_undegraded":"2024-04-25T02:10:25.347317+0000","last_fullsized":"2024-04-25T02:10:25.347317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355867+0000","last_change":"2024-04-25T02:10:25.351370+0000","last_active":"2024-04-25T02:10:25.355867+0000","last_peered":"2024-04-25T02:10:25.355867+0000","last_clean":"2024-04-25T02:10:25.355867+0000","last_became_active":"2024-04-25T02:10:25.351067+0000","last_became_peered":"2024-04-25T02:10:25.351067+0000","last_unstale":"2024-04-25T02:10:25.355867+0000","last_undegraded":"2024-04-25T02:10:25.355867+0000","last_fullsized":"2024-04-25T02:10:25.355867+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:52:30.684248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339104+0000","last_change":"2024-04-25T02:10:25.339104+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339104+0000","last_undegraded":"2024-04-25T02:10:25.339104+0000","last_fullsized":"2024-04-25T02:10:25.339104+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353886+0000","last_change":"2024-04-25T02:10:25.350641+0000","last_active":"2024-04-25T02:10:25.353886+0000","last_peered":"2024-04-25T02:10:25.353886+0000","last_clean":"2024-04-25T02:10:25.353886+0000","last_became_active":"2024-04-25T02:10:25.350337+0000","last_became_peered":"2024-04-25T02:10:25.350337+0000","last_unstale":"2024-04-25T02:10:25.353886+0000","last_undegraded":"2024-04-25T02:10:25.353886+0000","last_fullsized":"2024-04-25T02:10:25.353886+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:08.954558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.346532+0000","last_change":"2024-04-25T02:10:25.346532+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.346532+0000","last_undegraded":"2024-04-25T02:10:25.346532+0000","last_fullsized":"2024-04-25T02:10:25.346532+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356626+0000","last_change":"2024-04-25T02:10:25.355201+0000","last_active":"2024-04-25T02:10:25.356626+0000","last_peered":"2024-04-25T02:10:25.356626+0000","last_clean":"2024-04-25T02:10:25.356626+0000","last_became_active":"2024-04-25T02:10:25.354935+0000","last_became_peered":"2024-04-25T02:10:25.354935+0000","last_unstale":"2024-04-25T02:10:25.356626+0000","last_undegraded":"2024-04-25T02:10:25.356626+0000","last_fullsized":"2024-04-25T02:10:25.356626+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:50.678511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348965+0000","last_change":"2024-04-25T02:10:25.348965+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348965+0000","last_undegraded":"2024-04-25T02:10:25.348965+0000","last_fullsized":"2024-04-25T02:10:25.348965+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356521+0000","last_change":"2024-04-25T02:10:25.354199+0000","last_active":"2024-04-25T02:10:25.356521+0000","last_peered":"2024-04-25T02:10:25.356521+0000","last_clean":"2024-04-25T02:10:25.356521+0000","last_became_active":"2024-04-25T02:10:25.353946+0000","last_became_peered":"2024-04-25T02:10:25.353946+0000","last_unstale":"2024-04-25T02:10:25.356521+0000","last_undegraded":"2024-04-25T02:10:25.356521+0000","last_fullsized":"2024-04-25T02:10:25.356521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:42.993444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343986+0000","last_change":"2024-04-25T02:10:25.343986+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343986+0000","last_undegraded":"2024-04-25T02:10:25.343986+0000","last_fullsized":"2024-04-25T02:10:25.343986+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.354734+0000","last_change":"2024-04-25T02:10:25.352461+0000","last_active":"2024-04-25T02:10:25.354734+0000","last_peered":"2024-04-25T02:10:25.354734+0000","last_clean":"2024-04-25T02:10:25.354734+0000","last_became_active":"2024-04-25T02:10:25.352199+0000","last_became_peered":"2024-04-25T02:10:25.352199+0000","last_unstale":"2024-04-25T02:10:25.354734+0000","last_undegraded":"2024-04-25T02:10:25.354734+0000","last_fullsized":"2024-04-25T02:10:25.354734+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:51.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339879+0000","last_change":"2024-04-25T02:10:25.339879+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339879+0000","last_undegraded":"2024-04-25T02:10:25.339879+0000","last_fullsized":"2024-04-25T02:10:25.339879+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355946+0000","last_change":"2024-04-25T02:10:25.354429+0000","last_active":"2024-04-25T02:10:25.355946+0000","last_peered":"2024-04-25T02:10:25.355946+0000","last_clean":"2024-04-25T02:10:25.355946+0000","last_became_active":"2024-04-25T02:10:25.354011+0000","last_became_peered":"2024-04-25T02:10:25.354011+0000","last_unstale":"2024-04-25T02:10:25.355946+0000","last_undegraded":"2024-04-25T02:10:25.355946+0000","last_fullsized":"2024-04-25T02:10:25.355946+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:50.678511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347891+0000","last_change":"2024-04-25T02:10:25.347891+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347891+0000","last_undegraded":"2024-04-25T02:10:25.347891+0000","last_fullsized":"2024-04-25T02:10:25.347891+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352638+0000","last_change":"2024-04-25T02:10:25.350850+0000","last_active":"2024-04-25T02:10:25.352638+0000","last_peered":"2024-04-25T02:10:25.352638+0000","last_clean":"2024-04-25T02:10:25.352638+0000","last_became_active":"2024-04-25T02:10:25.350567+0000","last_became_peered":"2024-04-25T02:10:25.350567+0000","last_unstale":"2024-04-25T02:10:25.352638+0000","last_undegraded":"2024-04-25T02:10:25.352638+0000","last_fullsized":"2024-04-25T02:10:25.352638+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:48.643486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342223+0000","last_change":"2024-04-25T02:10:25.342223+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342223+0000","last_undegraded":"2024-04-25T02:10:25.342223+0000","last_fullsized":"2024-04-25T02:10:25.342223+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.348885+0000","last_change":"2024-04-25T02:10:25.348082+0000","last_active":"2024-04-25T02:10:25.348885+0000","last_peered":"2024-04-25T02:10:25.348885+0000","last_clean":"2024-04-25T02:10:25.348885+0000","last_became_active":"2024-04-25T02:10:25.347822+0000","last_became_peered":"2024-04-25T02:10:25.347822+0000","last_unstale":"2024-04-25T02:10:25.348885+0000","last_undegraded":"2024-04-25T02:10:25.348885+0000","last_fullsized":"2024-04-25T02:10:25.348885+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:56.655786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343944+0000","last_change":"2024-04-25T02:10:25.343944+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343944+0000","last_undegraded":"2024-04-25T02:10:25.343944+0000","last_fullsized":"2024-04-25T02:10:25.343944+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353410+0000","last_change":"2024-04-25T02:10:25.350688+0000","last_active":"2024-04-25T02:10:25.353410+0000","last_peered":"2024-04-25T02:10:25.353410+0000","last_clean":"2024-04-25T02:10:25.353410+0000","last_became_active":"2024-04-25T02:10:25.350399+0000","last_became_peered":"2024-04-25T02:10:25.350399+0000","last_unstale":"2024-04-25T02:10:25.353410+0000","last_undegraded":"2024-04-25T02:10:25.353410+0000","last_fullsized":"2024-04-25T02:10:25.353410+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:52.925033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344725+0000","last_change":"2024-04-25T02:10:25.344725+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344725+0000","last_undegraded":"2024-04-25T02:10:25.344725+0000","last_fullsized":"2024-04-25T02:10:25.344725+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353728+0000","last_change":"2024-04-25T02:10:25.348436+0000","last_active":"2024-04-25T02:10:25.353728+0000","last_peered":"2024-04-25T02:10:25.353728+0000","last_clean":"2024-04-25T02:10:25.353728+0000","last_became_active":"2024-04-25T02:10:25.348140+0000","last_became_peered":"2024-04-25T02:10:25.348140+0000","last_unstale":"2024-04-25T02:10:25.353728+0000","last_undegraded":"2024-04-25T02:10:25.353728+0000","last_fullsized":"2024-04-25T02:10:25.353728+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:27.603312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344426+0000","last_change":"2024-04-25T02:10:25.344426+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344426+0000","last_undegraded":"2024-04-25T02:10:25.344426+0000","last_fullsized":"2024-04-25T02:10:25.344426+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353441+0000","last_change":"2024-04-25T02:10:25.350051+0000","last_active":"2024-04-25T02:10:25.353441+0000","last_peered":"2024-04-25T02:10:25.353441+0000","last_clean":"2024-04-25T02:10:25.353441+0000","last_became_active":"2024-04-25T02:10:25.348145+0000","last_became_peered":"2024-04-25T02:10:25.348145+0000","last_unstale":"2024-04-25T02:10:25.353441+0000","last_undegraded":"2024-04-25T02:10:25.353441+0000","last_fullsized":"2024-04-25T02:10:25.353441+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:11.059835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342956+0000","last_change":"2024-04-25T02:10:25.342956+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342956+0000","last_undegraded":"2024-04-25T02:10:25.342956+0000","last_fullsized":"2024-04-25T02:10:25.342956+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.354215+0000","last_change":"2024-04-25T02:10:25.352072+0000","last_active":"2024-04-25T02:10:25.354215+0000","last_peered":"2024-04-25T02:10:25.354215+0000","last_clean":"2024-04-25T02:10:25.354215+0000","last_became_active":"2024-04-25T02:10:25.351477+0000","last_became_peered":"2024-04-25T02:10:25.351477+0000","last_unstale":"2024-04-25T02:10:25.354215+0000","last_undegraded":"2024-04-25T02:10:25.354215+0000","last_fullsized":"2024-04-25T02:10:25.354215+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:17:09.184794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339124+0000","last_change":"2024-04-25T02:10:25.339124+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339124+0000","last_undegraded":"2024-04-25T02:10:25.339124+0000","last_fullsized":"2024-04-25T02:10:25.339124+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355327+0000","last_change":"2024-04-25T02:10:25.348725+0000","last_active":"2024-04-25T02:10:25.355327+0000","last_peered":"2024-04-25T02:10:25.355327+0000","last_clean":"2024-04-25T02:10:25.355327+0000","last_became_active":"2024-04-25T02:10:25.348320+0000","last_became_peered":"2024-04-25T02:10:25.348320+0000","last_unstale":"2024-04-25T02:10:25.355327+0000","last_undegraded":"2024-04-25T02:10:25.355327+0000","last_fullsized":"2024-04-25T02:10:25.355327+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:55:56.306078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342810+0000","last_change":"2024-04-25T02:10:25.342810+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342810+0000","last_undegraded":"2024-04-25T02:10:25.342810+0000","last_fullsized":"2024-04-25T02:10:25.342810+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356218+0000","last_change":"2024-04-25T02:10:25.354398+0000","last_active":"2024-04-25T02:10:25.356218+0000","last_peered":"2024-04-25T02:10:25.356218+0000","last_clean":"2024-04-25T02:10:25.356218+0000","last_became_active":"2024-04-25T02:10:25.354135+0000","last_became_peered":"2024-04-25T02:10:25.354135+0000","last_unstale":"2024-04-25T02:10:25.356218+0000","last_undegraded":"2024-04-25T02:10:25.356218+0000","last_fullsized":"2024-04-25T02:10:25.356218+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:24.529205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341817+0000","last_change":"2024-04-25T02:10:25.341817+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341817+0000","last_undegraded":"2024-04-25T02:10:25.341817+0000","last_fullsized":"2024-04-25T02:10:25.341817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.350692+0000","last_change":"2024-04-25T02:10:25.347600+0000","last_active":"2024-04-25T02:10:25.350692+0000","last_peered":"2024-04-25T02:10:25.350692+0000","last_clean":"2024-04-25T02:10:25.350692+0000","last_became_active":"2024-04-25T02:10:25.347353+0000","last_became_peered":"2024-04-25T02:10:25.347353+0000","last_unstale":"2024-04-25T02:10:25.350692+0000","last_undegraded":"2024-04-25T02:10:25.350692+0000","last_fullsized":"2024-04-25T02:10:25.350692+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:51.037405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345800+0000","last_change":"2024-04-25T02:10:25.345800+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345800+0000","last_undegraded":"2024-04-25T02:10:25.345800+0000","last_fullsized":"2024-04-25T02:10:25.345800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355405+0000","last_change":"2024-04-25T02:10:25.351874+0000","last_active":"2024-04-25T02:10:25.355405+0000","last_peered":"2024-04-25T02:10:25.355405+0000","last_clean":"2024-04-25T02:10:25.355405+0000","last_became_active":"2024-04-25T02:10:25.351587+0000","last_became_peered":"2024-04-25T02:10:25.351587+0000","last_unstale":"2024-04-25T02:10:25.355405+0000","last_undegraded":"2024-04-25T02:10:25.355405+0000","last_fullsized":"2024-04-25T02:10:25.355405+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:56.566118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339177+0000","last_change":"2024-04-25T02:10:25.339177+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339177+0000","last_undegraded":"2024-04-25T02:10:25.339177+0000","last_fullsized":"2024-04-25T02:10:25.339177+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.350663+0000","last_change":"2024-04-25T02:10:25.346645+0000","last_active":"2024-04-25T02:10:25.350663+0000","last_peered":"2024-04-25T02:10:25.350663+0000","last_clean":"2024-04-25T02:10:25.350663+0000","last_became_active":"2024-04-25T02:10:25.346395+0000","last_became_peered":"2024-04-25T02:10:25.346395+0000","last_unstale":"2024-04-25T02:10:25.350663+0000","last_undegraded":"2024-04-25T02:10:25.350663+0000","last_fullsized":"2024-04-25T02:10:25.350663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:09:47.651953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341566+0000","last_change":"2024-04-25T02:10:25.341566+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341566+0000","last_undegraded":"2024-04-25T02:10:25.341566+0000","last_fullsized":"2024-04-25T02:10:25.341566+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352509+0000","last_change":"2024-04-25T02:10:25.349386+0000","last_active":"2024-04-25T02:10:25.352509+0000","last_peered":"2024-04-25T02:10:25.352509+0000","last_clean":"2024-04-25T02:10:25.352509+0000","last_became_active":"2024-04-25T02:10:25.348888+0000","last_became_peered":"2024-04-25T02:10:25.348888+0000","last_unstale":"2024-04-25T02:10:25.352509+0000","last_undegraded":"2024-04-25T02:10:25.352509+0000","last_fullsized":"2024-04-25T02:10:25.352509+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:20:35.902100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341065+0000","last_change":"2024-04-25T02:10:25.341065+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341065+0000","last_undegraded":"2024-04-25T02:10:25.341065+0000","last_fullsized":"2024-04-25T02:10:25.341065+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355648+0000","last_change":"2024-04-25T02:10:25.352598+0000","last_active":"2024-04-25T02:10:25.355648+0000","last_peered":"2024-04-25T02:10:25.355648+0000","last_clean":"2024-04-25T02:10:25.355648+0000","last_became_active":"2024-04-25T02:10:25.352292+0000","last_became_peered":"2024-04-25T02:10:25.352292+0000","last_unstale":"2024-04-25T02:10:25.355648+0000","last_undegraded":"2024-04-25T02:10:25.355648+0000","last_fullsized":"2024-04-25T02:10:25.355648+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:09.166741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":234,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.350173+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:10:25.350173+0000","last_peered":"2024-04-25T02:10:25.350173+0000","last_clean":"2024-04-25T02:10:25.350173+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:10:25.350173+0000","last_undegraded":"2024-04-25T02:10:25.350173+0000","last_fullsized":"2024-04-25T02:10:25.350173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1277952,"data_stored":870893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":274258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":1277952,"data_stored":870893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:10:29.342 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:10:29.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.432+0000 7f80028b2640 1 Processor -- start 2024-04-25T02:10:29.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.432+0000 7f80028b2640 1 -- start start 2024-04-25T02:10:29.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.433+0000 7f80028b2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7ffc06df50 0x7f7ffc06e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.433+0000 7f80028b2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ffc071240 0x7f7ffc071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.433+0000 7f80028b2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ffc070d90 con 0x7f7ffc144cb0 2024-04-25T02:10:29.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.433+0000 7f80028b2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7ffc0cf130 con 0x7f7ffc06df50 2024-04-25T02:10:29.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.433+0000 7f80028b2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7ffc0cf410 con 0x7f7ffc071240 2024-04-25T02:10:29.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.433+0000 7f7ffb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7ffc06df50 0x7f7ffc06e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.433+0000 7f7ffb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7ffc06df50 0x7f7ffc06e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35380/0 (socket says 172.21.15.79:35380) 2024-04-25T02:10:29.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.433+0000 7f7ffb7fe640 1 -- 172.21.15.79:0/3121696268 learned_addr learned my addr 172.21.15.79:0/3121696268 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:29.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.433+0000 7f7ffb7fe640 1 -- 172.21.15.79:0/3121696268 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ffc071240 msgr2=0x7f7ffc071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:29.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.433+0000 7f7ffb7fe640 1 --2- 172.21.15.79:0/3121696268 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ffc071240 0x7f7ffc071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.433+0000 7f7ffb7fe640 1 -- 172.21.15.79:0/3121696268 >> v1:172.21.15.189:6789/0 conn(0x7f7ffc144cb0 legacy=0x7f7ffc0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:29.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.433+0000 7f7ffb7fe640 1 -- 172.21.15.79:0/3121696268 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ffc0cf6f0 con 0x7f7ffc06df50 2024-04-25T02:10:29.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.434+0000 7f7ffb7fe640 1 --2- 172.21.15.79:0/3121696268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ffc06df50 0x7f7ffc06e3e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009870 tx=0x7f7ff002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf62890d5ea0eb9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:29.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.434+0000 7f7ffaffd640 1 -- 172.21.15.79:0/3121696268 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0037070 con 0x7f7ffc06df50 2024-04-25T02:10:29.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.434+0000 7f7ffaffd640 1 -- 172.21.15.79:0/3121696268 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff002ae10 con 0x7f7ffc06df50 2024-04-25T02:10:29.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.434+0000 7f7ffaffd640 1 -- 172.21.15.79:0/3121696268 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0032660 con 0x7f7ffc06df50 2024-04-25T02:10:29.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.434+0000 7f80028b2640 1 -- 172.21.15.79:0/3121696268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ffc06df50 msgr2=0x7f7ffc06e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.434+0000 7f80028b2640 1 --2- 172.21.15.79:0/3121696268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ffc06df50 0x7f7ffc06e3e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009870 tx=0x7f7ff002a100 comp rx=0 tx=0).stop 2024-04-25T02:10:29.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.435+0000 7f80028b2640 1 -- 172.21.15.79:0/3121696268 shutdown_connections 2024-04-25T02:10:29.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.435+0000 7f80028b2640 1 --2- 172.21.15.79:0/3121696268 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ffc071240 0x7f7ffc071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.435+0000 7f80028b2640 1 --2- 172.21.15.79:0/3121696268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ffc06df50 0x7f7ffc06e3e0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.435+0000 7f80028b2640 1 -- 172.21.15.79:0/3121696268 >> 172.21.15.79:0/3121696268 conn(0x7f7ffc0cfc80 msgr2=0x7f7ffc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:29.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.435+0000 7f80028b2640 1 -- 172.21.15.79:0/3121696268 shutdown_connections 2024-04-25T02:10:29.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.435+0000 7f80028b2640 1 -- 172.21.15.79:0/3121696268 wait complete. 2024-04-25T02:10:29.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.436+0000 7f80028b2640 1 Processor -- start 2024-04-25T02:10:29.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.436+0000 7f80028b2640 1 -- start start 2024-04-25T02:10:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.436+0000 7f80028b2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ffc06df50 0x7f7ffc156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.436+0000 7f80028b2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ffc071240 0x7f7ffc0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f80028b2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ffc144cb0 0x7f7ffc13f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f80028b2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc145090 con 0x7f7ffc071240 2024-04-25T02:10:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f80028b2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc0cf9d0 con 0x7f7ffc06df50 2024-04-25T02:10:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f80028b2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7ffc145ab0 con 0x7f7ffc144cb0 2024-04-25T02:10:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f7ffb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ffc071240 0x7f7ffc0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f7ffb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ffc071240 0x7f7ffc0b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35394/0 (socket says 172.21.15.79:35394) 2024-04-25T02:10:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f7ffb7fe640 1 -- 172.21.15.79:0/665524367 learned_addr learned my addr 172.21.15.79:0/665524367 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f7ffbfff640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ffc06df50 0x7f7ffc156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f8000e4f640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ffc144cb0 0x7f7ffc13f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f7ffb7fe640 1 -- 172.21.15.79:0/665524367 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ffc144cb0 msgr2=0x7f7ffc13f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f7ffb7fe640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ffc144cb0 0x7f7ffc13f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f7ffb7fe640 1 -- 172.21.15.79:0/665524367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ffc06df50 msgr2=0x7f7ffc156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f7ffb7fe640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ffc06df50 0x7f7ffc156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f7ffb7fe640 1 -- 172.21.15.79:0/665524367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ffc1f8b70 con 0x7f7ffc071240 2024-04-25T02:10:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f7ffbfff640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ffc06df50 0x7f7ffc156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f8000e4f640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ffc144cb0 0x7f7ffc13f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f7ffb7fe640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ffc071240 0x7f7ffc0b4510 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009870 tx=0x7f7ff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f7ff8ff9640 1 -- 172.21.15.79:0/665524367 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0042070 con 0x7f7ffc071240 2024-04-25T02:10:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f7ff8ff9640 1 -- 172.21.15.79:0/665524367 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff003e670 con 0x7f7ffc071240 2024-04-25T02:10:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f80028b2640 1 -- 172.21.15.79:0/665524367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ffc1f8050 con 0x7f7ffc071240 2024-04-25T02:10:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f7ff8ff9640 1 -- 172.21.15.79:0/665524367 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0037040 con 0x7f7ffc071240 2024-04-25T02:10:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.437+0000 7f80028b2640 1 -- 172.21.15.79:0/665524367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ffc1f8890 con 0x7f7ffc071240 2024-04-25T02:10:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.438+0000 7f80028b2640 1 -- 172.21.15.79:0/665524367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ffc0690a0 con 0x7f7ffc071240 2024-04-25T02:10:29.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.439+0000 7f7ff8ff9640 1 -- 172.21.15.79:0/665524367 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ff0045070 con 0x7f7ffc071240 2024-04-25T02:10:29.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.439+0000 7f7ff8ff9640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7fe806be30 0x7f7fe806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.439+0000 7f7ff8ff9640 1 -- 172.21.15.79:0/665524367 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f7ff00ab660 con 0x7f7ffc071240 2024-04-25T02:10:29.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.439+0000 7f7ffbfff640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7fe806be30 0x7f7fe806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.440+0000 7f7ffbfff640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7fe806be30 0x7f7fe806e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00a810 tx=0x7f7fec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:29.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.443+0000 7f7ff8ff9640 1 -- 172.21.15.79:0/665524367 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7ffc1f8050 con 0x7f7ffc071240 2024-04-25T02:10:29.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.614+0000 7f80028b2640 1 -- 172.21.15.79:0/665524367 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7ffc0b2e80 con 0x7f7fe806be30 2024-04-25T02:10:29.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.620+0000 7f7ff8ff9640 1 -- 172.21.15.79:0/665524367 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246636 (secure 0 0 0) 0x7f7fec00ad90 con 0x7f7fe806be30 2024-04-25T02:10:29.630 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:29.631 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:10:29.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.623+0000 7f80028b2640 1 -- 172.21.15.79:0/665524367 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7fe806be30 msgr2=0x7f7fe806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.623+0000 7f80028b2640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7fe806be30 0x7f7fe806e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00a810 tx=0x7f7fec008040 comp rx=0 tx=0).stop 2024-04-25T02:10:29.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.623+0000 7f80028b2640 1 -- 172.21.15.79:0/665524367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ffc071240 msgr2=0x7f7ffc0b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.623+0000 7f80028b2640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ffc071240 0x7f7ffc0b4510 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009870 tx=0x7f7ff00046c0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.623+0000 7f80028b2640 1 -- 172.21.15.79:0/665524367 shutdown_connections 2024-04-25T02:10:29.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.623+0000 7f80028b2640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7fe806be30 0x7f7fe806e2f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.623+0000 7f80028b2640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ffc144cb0 0x7f7ffc13f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.623+0000 7f80028b2640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ffc071240 0x7f7ffc0b4510 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.623+0000 7f80028b2640 1 --2- 172.21.15.79:0/665524367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ffc06df50 0x7f7ffc156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.623+0000 7f80028b2640 1 -- 172.21.15.79:0/665524367 >> 172.21.15.79:0/665524367 conn(0x7f7ffc0cfc80 msgr2=0x7f7ffc071b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:29.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.623+0000 7f80028b2640 1 -- 172.21.15.79:0/665524367 shutdown_connections 2024-04-25T02:10:29.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.623+0000 7f80028b2640 1 -- 172.21.15.79:0/665524367 wait complete. 2024-04-25T02:10:29.642 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-04-25T02:10:29.203494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226836,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747884,"statfs":{"total":773094113280,"available":772861833216,"internally_reserved":0,"allocated":6647808,"data_stored":3418669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.873032"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347621+0000","last_change":"2024-04-25T02:10:25.347621+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347621+0000","last_undegraded":"2024-04-25T02:10:25.347621+0000","last_fullsized":"2024-04-25T02:10:25.347621+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340544+0000","last_change":"2024-04-25T02:10:25.340544+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340544+0000","last_undegraded":"2024-04-25T02:10:25.340544+0000","last_fullsized":"2024-04-25T02:10:25.340544+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348680+0000","last_change":"2024-04-25T02:10:25.348680+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348680+0000","last_undegraded":"2024-04-25T02:10:25.348680+0000","last_fullsized":"2024-04-25T02:10:25.348680+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345857+0000","last_change":"2024-04-25T02:10:25.345857+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345857+0000","last_undegraded":"2024-04-25T02:10:25.345857+0000","last_fullsized":"2024-04-25T02:10:25.345857+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.349837+0000","last_change":"2024-04-25T02:10:25.349837+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.349837+0000","last_undegraded":"2024-04-25T02:10:25.349837+0000","last_fullsized":"2024-04-25T02:10:25.349837+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344374+0000","last_change":"2024-04-25T02:10:25.344374+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344374+0000","last_undegraded":"2024-04-25T02:10:25.344374+0000","last_fullsized":"2024-04-25T02:10:25.344374+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340105+0000","last_change":"2024-04-25T02:10:25.340105+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340105+0000","last_undegraded":"2024-04-25T02:10:25.340105+0000","last_fullsized":"2024-04-25T02:10:25.340105+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341468+0000","last_change":"2024-04-25T02:10:25.341468+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341468+0000","last_undegraded":"2024-04-25T02:10:25.341468+0000","last_fullsized":"2024-04-25T02:10:25.341468+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339847+0000","last_change":"2024-04-25T02:10:25.339847+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339847+0000","last_undegraded":"2024-04-25T02:10:25.339847+0000","last_fullsized":"2024-04-25T02:10:25.339847+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340046+0000","last_change":"2024-04-25T02:10:25.340046+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340046+0000","last_undegraded":"2024-04-25T02:10:25.340046+0000","last_fullsized":"2024-04-25T02:10:25.340046+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339755+0000","last_change":"2024-04-25T02:10:25.339755+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339755+0000","last_undegraded":"2024-04-25T02:10:25.339755+0000","last_fullsized":"2024-04-25T02:10:25.339755+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344853+0000","last_change":"2024-04-25T02:10:25.344853+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344853+0000","last_undegraded":"2024-04-25T02:10:25.344853+0000","last_fullsized":"2024-04-25T02:10:25.344853+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342550+0000","last_change":"2024-04-25T02:10:25.342550+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342550+0000","last_undegraded":"2024-04-25T02:10:25.342550+0000","last_fullsized":"2024-04-25T02:10:25.342550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339742+0000","last_change":"2024-04-25T02:10:25.339742+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339742+0000","last_undegraded":"2024-04-25T02:10:25.339742+0000","last_fullsized":"2024-04-25T02:10:25.339742+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339195+0000","last_change":"2024-04-25T02:10:25.339195+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339195+0000","last_undegraded":"2024-04-25T02:10:25.339195+0000","last_fullsized":"2024-04-25T02:10:25.339195+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345098+0000","last_change":"2024-04-25T02:10:25.345098+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345098+0000","last_undegraded":"2024-04-25T02:10:25.345098+0000","last_fullsized":"2024-04-25T02:10:25.345098+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342857+0000","last_change":"2024-04-25T02:10:25.342857+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342857+0000","last_undegraded":"2024-04-25T02:10:25.342857+0000","last_fullsized":"2024-04-25T02:10:25.342857+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.349384+0000","last_change":"2024-04-25T02:10:25.349384+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.349384+0000","last_undegraded":"2024-04-25T02:10:25.349384+0000","last_fullsized":"2024-04-25T02:10:25.349384+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347360+0000","last_change":"2024-04-25T02:10:25.347360+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347360+0000","last_undegraded":"2024-04-25T02:10:25.347360+0000","last_fullsized":"2024-04-25T02:10:25.347360+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340489+0000","last_change":"2024-04-25T02:10:25.340489+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340489+0000","last_undegraded":"2024-04-25T02:10:25.340489+0000","last_fullsized":"2024-04-25T02:10:25.340489+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348114+0000","last_change":"2024-04-25T02:10:25.348114+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348114+0000","last_undegraded":"2024-04-25T02:10:25.348114+0000","last_fullsized":"2024-04-25T02:10:25.348114+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342634+0000","last_change":"2024-04-25T02:10:25.342634+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342634+0000","last_undegraded":"2024-04-25T02:10:25.342634+0000","last_fullsized":"2024-04-25T02:10:25.342634+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347881+0000","last_change":"2024-04-25T02:10:25.347881+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347881+0000","last_undegraded":"2024-04-25T02:10:25.347881+0000","last_fullsized":"2024-04-25T02:10:25.347881+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343793+0000","last_change":"2024-04-25T02:10:25.343793+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343793+0000","last_undegraded":"2024-04-25T02:10:25.343793+0000","last_fullsized":"2024-04-25T02:10:25.343793+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347250+0000","last_change":"2024-04-25T02:10:25.347250+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347250+0000","last_undegraded":"2024-04-25T02:10:25.347250+0000","last_fullsized":"2024-04-25T02:10:25.347250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345173+0000","last_change":"2024-04-25T02:10:25.345173+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345173+0000","last_undegraded":"2024-04-25T02:10:25.345173+0000","last_fullsized":"2024-04-25T02:10:25.345173+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344519+0000","last_change":"2024-04-25T02:10:25.344519+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344519+0000","last_undegraded":"2024-04-25T02:10:25.344519+0000","last_fullsized":"2024-04-25T02:10:25.344519+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348626+0000","last_change":"2024-04-25T02:10:25.348626+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348626+0000","last_undegraded":"2024-04-25T02:10:25.348626+0000","last_fullsized":"2024-04-25T02:10:25.348626+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340691+0000","last_change":"2024-04-25T02:10:25.340691+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340691+0000","last_undegraded":"2024-04-25T02:10:25.340691+0000","last_fullsized":"2024-04-25T02:10:25.340691+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347408+0000","last_change":"2024-04-25T02:10:25.347408+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347408+0000","last_undegraded":"2024-04-25T02:10:25.347408+0000","last_fullsized":"2024-04-25T02:10:25.347408+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.346786+0000","last_change":"2024-04-25T02:10:25.346786+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.346786+0000","last_undegraded":"2024-04-25T02:10:25.346786+0000","last_fullsized":"2024-04-25T02:10:25.346786+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344176+0000","last_change":"2024-04-25T02:10:25.344176+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344176+0000","last_undegraded":"2024-04-25T02:10:25.344176+0000","last_fullsized":"2024-04-25T02:10:25.344176+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343764+0000","last_change":"2024-04-25T02:10:25.343764+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343764+0000","last_undegraded":"2024-04-25T02:10:25.343764+0000","last_fullsized":"2024-04-25T02:10:25.343764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352494+0000","last_change":"2024-04-25T02:10:25.351015+0000","last_active":"2024-04-25T02:10:25.352494+0000","last_peered":"2024-04-25T02:10:25.352494+0000","last_clean":"2024-04-25T02:10:25.352494+0000","last_became_active":"2024-04-25T02:10:25.350729+0000","last_became_peered":"2024-04-25T02:10:25.350729+0000","last_unstale":"2024-04-25T02:10:25.352494+0000","last_undegraded":"2024-04-25T02:10:25.352494+0000","last_fullsized":"2024-04-25T02:10:25.352494+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.992991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339701+0000","last_change":"2024-04-25T02:10:25.339701+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339701+0000","last_undegraded":"2024-04-25T02:10:25.339701+0000","last_fullsized":"2024-04-25T02:10:25.339701+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356621+0000","last_change":"2024-04-25T02:10:25.355315+0000","last_active":"2024-04-25T02:10:25.356621+0000","last_peered":"2024-04-25T02:10:25.356621+0000","last_clean":"2024-04-25T02:10:25.356621+0000","last_became_active":"2024-04-25T02:10:25.354844+0000","last_became_peered":"2024-04-25T02:10:25.354844+0000","last_unstale":"2024-04-25T02:10:25.356621+0000","last_undegraded":"2024-04-25T02:10:25.356621+0000","last_fullsized":"2024-04-25T02:10:25.356621+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:09.410317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344146+0000","last_change":"2024-04-25T02:10:25.344146+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344146+0000","last_undegraded":"2024-04-25T02:10:25.344146+0000","last_fullsized":"2024-04-25T02:10:25.344146+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352520+0000","last_change":"2024-04-25T02:10:25.350788+0000","last_active":"2024-04-25T02:10:25.352520+0000","last_peered":"2024-04-25T02:10:25.352520+0000","last_clean":"2024-04-25T02:10:25.352520+0000","last_became_active":"2024-04-25T02:10:25.350527+0000","last_became_peered":"2024-04-25T02:10:25.350527+0000","last_unstale":"2024-04-25T02:10:25.352520+0000","last_undegraded":"2024-04-25T02:10:25.352520+0000","last_fullsized":"2024-04-25T02:10:25.352520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:09.197493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343326+0000","last_change":"2024-04-25T02:10:25.343326+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343326+0000","last_undegraded":"2024-04-25T02:10:25.343326+0000","last_fullsized":"2024-04-25T02:10:25.343326+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.354000+0000","last_change":"2024-04-25T02:10:25.351435+0000","last_active":"2024-04-25T02:10:25.354000+0000","last_peered":"2024-04-25T02:10:25.354000+0000","last_clean":"2024-04-25T02:10:25.354000+0000","last_became_active":"2024-04-25T02:10:25.351119+0000","last_became_peered":"2024-04-25T02:10:25.351119+0000","last_unstale":"2024-04-25T02:10:25.354000+0000","last_undegraded":"2024-04-25T02:10:25.354000+0000","last_fullsized":"2024-04-25T02:10:25.354000+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:11.861132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342223+0000","last_change":"2024-04-25T02:10:25.342223+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342223+0000","last_undegraded":"2024-04-25T02:10:25.342223+0000","last_fullsized":"2024-04-25T02:10:25.342223+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355979+0000","last_change":"2024-04-25T02:10:25.354878+0000","last_active":"2024-04-25T02:10:25.355979+0000","last_peered":"2024-04-25T02:10:25.355979+0000","last_clean":"2024-04-25T02:10:25.355979+0000","last_became_active":"2024-04-25T02:10:25.354616+0000","last_became_peered":"2024-04-25T02:10:25.354616+0000","last_unstale":"2024-04-25T02:10:25.355979+0000","last_undegraded":"2024-04-25T02:10:25.355979+0000","last_fullsized":"2024-04-25T02:10:25.355979+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:08.954558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340276+0000","last_change":"2024-04-25T02:10:25.340276+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340276+0000","last_undegraded":"2024-04-25T02:10:25.340276+0000","last_fullsized":"2024-04-25T02:10:25.340276+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352613+0000","last_change":"2024-04-25T02:10:25.350576+0000","last_active":"2024-04-25T02:10:25.352613+0000","last_peered":"2024-04-25T02:10:25.352613+0000","last_clean":"2024-04-25T02:10:25.352613+0000","last_became_active":"2024-04-25T02:10:25.350283+0000","last_became_peered":"2024-04-25T02:10:25.350283+0000","last_unstale":"2024-04-25T02:10:25.352613+0000","last_undegraded":"2024-04-25T02:10:25.352613+0000","last_fullsized":"2024-04-25T02:10:25.352613+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:50.678511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342834+0000","last_change":"2024-04-25T02:10:25.342834+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342834+0000","last_undegraded":"2024-04-25T02:10:25.342834+0000","last_fullsized":"2024-04-25T02:10:25.342834+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353700+0000","last_change":"2024-04-25T02:10:25.349482+0000","last_active":"2024-04-25T02:10:25.353700+0000","last_peered":"2024-04-25T02:10:25.353700+0000","last_clean":"2024-04-25T02:10:25.353700+0000","last_became_active":"2024-04-25T02:10:25.349132+0000","last_became_peered":"2024-04-25T02:10:25.349132+0000","last_unstale":"2024-04-25T02:10:25.353700+0000","last_undegraded":"2024-04-25T02:10:25.353700+0000","last_fullsized":"2024-04-25T02:10:25.353700+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:56.566118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341977+0000","last_change":"2024-04-25T02:10:25.341977+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341977+0000","last_undegraded":"2024-04-25T02:10:25.341977+0000","last_fullsized":"2024-04-25T02:10:25.341977+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353773+0000","last_change":"2024-04-25T02:10:25.349816+0000","last_active":"2024-04-25T02:10:25.353773+0000","last_peered":"2024-04-25T02:10:25.353773+0000","last_clean":"2024-04-25T02:10:25.353773+0000","last_became_active":"2024-04-25T02:10:25.349428+0000","last_became_peered":"2024-04-25T02:10:25.349428+0000","last_unstale":"2024-04-25T02:10:25.353773+0000","last_undegraded":"2024-04-25T02:10:25.353773+0000","last_fullsized":"2024-04-25T02:10:25.353773+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:27.603312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339987+0000","last_change":"2024-04-25T02:10:25.339987+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339987+0000","last_undegraded":"2024-04-25T02:10:25.339987+0000","last_fullsized":"2024-04-25T02:10:25.339987+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356609+0000","last_change":"2024-04-25T02:10:25.355143+0000","last_active":"2024-04-25T02:10:25.356609+0000","last_peered":"2024-04-25T02:10:25.356609+0000","last_clean":"2024-04-25T02:10:25.356609+0000","last_became_active":"2024-04-25T02:10:25.354873+0000","last_became_peered":"2024-04-25T02:10:25.354873+0000","last_unstale":"2024-04-25T02:10:25.356609+0000","last_undegraded":"2024-04-25T02:10:25.356609+0000","last_fullsized":"2024-04-25T02:10:25.356609+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:24.529205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347170+0000","last_change":"2024-04-25T02:10:25.347170+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347170+0000","last_undegraded":"2024-04-25T02:10:25.347170+0000","last_fullsized":"2024-04-25T02:10:25.347170+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356603+0000","last_change":"2024-04-25T02:10:25.355103+0000","last_active":"2024-04-25T02:10:25.356603+0000","last_peered":"2024-04-25T02:10:25.356603+0000","last_clean":"2024-04-25T02:10:25.356603+0000","last_became_active":"2024-04-25T02:10:25.354520+0000","last_became_peered":"2024-04-25T02:10:25.354520+0000","last_unstale":"2024-04-25T02:10:25.356603+0000","last_undegraded":"2024-04-25T02:10:25.356603+0000","last_fullsized":"2024-04-25T02:10:25.356603+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:25.255214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339665+0000","last_change":"2024-04-25T02:10:25.339665+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339665+0000","last_undegraded":"2024-04-25T02:10:25.339665+0000","last_fullsized":"2024-04-25T02:10:25.339665+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356703+0000","last_change":"2024-04-25T02:10:25.355693+0000","last_active":"2024-04-25T02:10:25.356703+0000","last_peered":"2024-04-25T02:10:25.356703+0000","last_clean":"2024-04-25T02:10:25.356703+0000","last_became_active":"2024-04-25T02:10:25.355422+0000","last_became_peered":"2024-04-25T02:10:25.355422+0000","last_unstale":"2024-04-25T02:10:25.356703+0000","last_undegraded":"2024-04-25T02:10:25.356703+0000","last_fullsized":"2024-04-25T02:10:25.356703+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:09.197493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348307+0000","last_change":"2024-04-25T02:10:25.348307+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348307+0000","last_undegraded":"2024-04-25T02:10:25.348307+0000","last_fullsized":"2024-04-25T02:10:25.348307+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353277+0000","last_change":"2024-04-25T02:10:25.346359+0000","last_active":"2024-04-25T02:10:25.353277+0000","last_peered":"2024-04-25T02:10:25.353277+0000","last_clean":"2024-04-25T02:10:25.353277+0000","last_became_active":"2024-04-25T02:10:25.346084+0000","last_became_peered":"2024-04-25T02:10:25.346084+0000","last_unstale":"2024-04-25T02:10:25.353277+0000","last_undegraded":"2024-04-25T02:10:25.353277+0000","last_fullsized":"2024-04-25T02:10:25.353277+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:54:34.693154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342892+0000","last_change":"2024-04-25T02:10:25.342892+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342892+0000","last_undegraded":"2024-04-25T02:10:25.342892+0000","last_fullsized":"2024-04-25T02:10:25.342892+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.357790+0000","last_change":"2024-04-25T02:10:25.356379+0000","last_active":"2024-04-25T02:10:25.357790+0000","last_peered":"2024-04-25T02:10:25.357790+0000","last_clean":"2024-04-25T02:10:25.357790+0000","last_became_active":"2024-04-25T02:10:25.356070+0000","last_became_peered":"2024-04-25T02:10:25.356070+0000","last_unstale":"2024-04-25T02:10:25.357790+0000","last_undegraded":"2024-04-25T02:10:25.357790+0000","last_fullsized":"2024-04-25T02:10:25.357790+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:17:16.267006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347317+0000","last_change":"2024-04-25T02:10:25.347317+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347317+0000","last_undegraded":"2024-04-25T02:10:25.347317+0000","last_fullsized":"2024-04-25T02:10:25.347317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355867+0000","last_change":"2024-04-25T02:10:25.351370+0000","last_active":"2024-04-25T02:10:25.355867+0000","last_peered":"2024-04-25T02:10:25.355867+0000","last_clean":"2024-04-25T02:10:25.355867+0000","last_became_active":"2024-04-25T02:10:25.351067+0000","last_became_peered":"2024-04-25T02:10:25.351067+0000","last_unstale":"2024-04-25T02:10:25.355867+0000","last_undegraded":"2024-04-25T02:10:25.355867+0000","last_fullsized":"2024-04-25T02:10:25.355867+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:52:30.684248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339104+0000","last_change":"2024-04-25T02:10:25.339104+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339104+0000","last_undegraded":"2024-04-25T02:10:25.339104+0000","last_fullsized":"2024-04-25T02:10:25.339104+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353886+0000","last_change":"2024-04-25T02:10:25.350641+0000","last_active":"2024-04-25T02:10:25.353886+0000","last_peered":"2024-04-25T02:10:25.353886+0000","last_clean":"2024-04-25T02:10:25.353886+0000","last_became_active":"2024-04-25T02:10:25.350337+0000","last_became_peered":"2024-04-25T02:10:25.350337+0000","last_unstale":"2024-04-25T02:10:25.353886+0000","last_undegraded":"2024-04-25T02:10:25.353886+0000","last_fullsized":"2024-04-25T02:10:25.353886+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:08.954558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.346532+0000","last_change":"2024-04-25T02:10:25.346532+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.346532+0000","last_undegraded":"2024-04-25T02:10:25.346532+0000","last_fullsized":"2024-04-25T02:10:25.346532+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356626+0000","last_change":"2024-04-25T02:10:25.355201+0000","last_active":"2024-04-25T02:10:25.356626+0000","last_peered":"2024-04-25T02:10:25.356626+0000","last_clean":"2024-04-25T02:10:25.356626+0000","last_became_active":"2024-04-25T02:10:25.354935+0000","last_became_peered":"2024-04-25T02:10:25.354935+0000","last_unstale":"2024-04-25T02:10:25.356626+0000","last_undegraded":"2024-04-25T02:10:25.356626+0000","last_fullsized":"2024-04-25T02:10:25.356626+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:50.678511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348965+0000","last_change":"2024-04-25T02:10:25.348965+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348965+0000","last_undegraded":"2024-04-25T02:10:25.348965+0000","last_fullsized":"2024-04-25T02:10:25.348965+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356521+0000","last_change":"2024-04-25T02:10:25.354199+0000","last_active":"2024-04-25T02:10:25.356521+0000","last_peered":"2024-04-25T02:10:25.356521+0000","last_clean":"2024-04-25T02:10:25.356521+0000","last_became_active":"2024-04-25T02:10:25.353946+0000","last_became_peered":"2024-04-25T02:10:25.353946+0000","last_unstale":"2024-04-25T02:10:25.356521+0000","last_undegraded":"2024-04-25T02:10:25.356521+0000","last_fullsized":"2024-04-25T02:10:25.356521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:42.993444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343986+0000","last_change":"2024-04-25T02:10:25.343986+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343986+0000","last_undegraded":"2024-04-25T02:10:25.343986+0000","last_fullsized":"2024-04-25T02:10:25.343986+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.354734+0000","last_change":"2024-04-25T02:10:25.352461+0000","last_active":"2024-04-25T02:10:25.354734+0000","last_peered":"2024-04-25T02:10:25.354734+0000","last_clean":"2024-04-25T02:10:25.354734+0000","last_became_active":"2024-04-25T02:10:25.352199+0000","last_became_peered":"2024-04-25T02:10:25.352199+0000","last_unstale":"2024-04-25T02:10:25.354734+0000","last_undegraded":"2024-04-25T02:10:25.354734+0000","last_fullsized":"2024-04-25T02:10:25.354734+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:51.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339879+0000","last_change":"2024-04-25T02:10:25.339879+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339879+0000","last_undegraded":"2024-04-25T02:10:25.339879+0000","last_fullsized":"2024-04-25T02:10:25.339879+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355946+0000","last_change":"2024-04-25T02:10:25.354429+0000","last_active":"2024-04-25T02:10:25.355946+0000","last_peered":"2024-04-25T02:10:25.355946+0000","last_clean":"2024-04-25T02:10:25.355946+0000","last_became_active":"2024-04-25T02:10:25.354011+0000","last_became_peered":"2024-04-25T02:10:25.354011+0000","last_unstale":"2024-04-25T02:10:25.355946+0000","last_undegraded":"2024-04-25T02:10:25.355946+0000","last_fullsized":"2024-04-25T02:10:25.355946+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:50.678511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347891+0000","last_change":"2024-04-25T02:10:25.347891+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347891+0000","last_undegraded":"2024-04-25T02:10:25.347891+0000","last_fullsized":"2024-04-25T02:10:25.347891+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352638+0000","last_change":"2024-04-25T02:10:25.350850+0000","last_active":"2024-04-25T02:10:25.352638+0000","last_peered":"2024-04-25T02:10:25.352638+0000","last_clean":"2024-04-25T02:10:25.352638+0000","last_became_active":"2024-04-25T02:10:25.350567+0000","last_became_peered":"2024-04-25T02:10:25.350567+0000","last_unstale":"2024-04-25T02:10:25.352638+0000","last_undegraded":"2024-04-25T02:10:25.352638+0000","last_fullsized":"2024-04-25T02:10:25.352638+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:48.643486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342223+0000","last_change":"2024-04-25T02:10:25.342223+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342223+0000","last_undegraded":"2024-04-25T02:10:25.342223+0000","last_fullsized":"2024-04-25T02:10:25.342223+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.348885+0000","last_change":"2024-04-25T02:10:25.348082+0000","last_active":"2024-04-25T02:10:25.348885+0000","last_peered":"2024-04-25T02:10:25.348885+0000","last_clean":"2024-04-25T02:10:25.348885+0000","last_became_active":"2024-04-25T02:10:25.347822+0000","last_became_peered":"2024-04-25T02:10:25.347822+0000","last_unstale":"2024-04-25T02:10:25.348885+0000","last_undegraded":"2024-04-25T02:10:25.348885+0000","last_fullsized":"2024-04-25T02:10:25.348885+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:56.655786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343944+0000","last_change":"2024-04-25T02:10:25.343944+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343944+0000","last_undegraded":"2024-04-25T02:10:25.343944+0000","last_fullsized":"2024-04-25T02:10:25.343944+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353410+0000","last_change":"2024-04-25T02:10:25.350688+0000","last_active":"2024-04-25T02:10:25.353410+0000","last_peered":"2024-04-25T02:10:25.353410+0000","last_clean":"2024-04-25T02:10:25.353410+0000","last_became_active":"2024-04-25T02:10:25.350399+0000","last_became_peered":"2024-04-25T02:10:25.350399+0000","last_unstale":"2024-04-25T02:10:25.353410+0000","last_undegraded":"2024-04-25T02:10:25.353410+0000","last_fullsized":"2024-04-25T02:10:25.353410+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:52.925033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344725+0000","last_change":"2024-04-25T02:10:25.344725+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344725+0000","last_undegraded":"2024-04-25T02:10:25.344725+0000","last_fullsized":"2024-04-25T02:10:25.344725+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353728+0000","last_change":"2024-04-25T02:10:25.348436+0000","last_active":"2024-04-25T02:10:25.353728+0000","last_peered":"2024-04-25T02:10:25.353728+0000","last_clean":"2024-04-25T02:10:25.353728+0000","last_became_active":"2024-04-25T02:10:25.348140+0000","last_became_peered":"2024-04-25T02:10:25.348140+0000","last_unstale":"2024-04-25T02:10:25.353728+0000","last_undegraded":"2024-04-25T02:10:25.353728+0000","last_fullsized":"2024-04-25T02:10:25.353728+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:27.603312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344426+0000","last_change":"2024-04-25T02:10:25.344426+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344426+0000","last_undegraded":"2024-04-25T02:10:25.344426+0000","last_fullsized":"2024-04-25T02:10:25.344426+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353441+0000","last_change":"2024-04-25T02:10:25.350051+0000","last_active":"2024-04-25T02:10:25.353441+0000","last_peered":"2024-04-25T02:10:25.353441+0000","last_clean":"2024-04-25T02:10:25.353441+0000","last_became_active":"2024-04-25T02:10:25.348145+0000","last_became_peered":"2024-04-25T02:10:25.348145+0000","last_unstale":"2024-04-25T02:10:25.353441+0000","last_undegraded":"2024-04-25T02:10:25.353441+0000","last_fullsized":"2024-04-25T02:10:25.353441+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:11.059835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342956+0000","last_change":"2024-04-25T02:10:25.342956+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342956+0000","last_undegraded":"2024-04-25T02:10:25.342956+0000","last_fullsized":"2024-04-25T02:10:25.342956+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.354215+0000","last_change":"2024-04-25T02:10:25.352072+0000","last_active":"2024-04-25T02:10:25.354215+0000","last_peered":"2024-04-25T02:10:25.354215+0000","last_clean":"2024-04-25T02:10:25.354215+0000","last_became_active":"2024-04-25T02:10:25.351477+0000","last_became_peered":"2024-04-25T02:10:25.351477+0000","last_unstale":"2024-04-25T02:10:25.354215+0000","last_undegraded":"2024-04-25T02:10:25.354215+0000","last_fullsized":"2024-04-25T02:10:25.354215+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:17:09.184794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339124+0000","last_change":"2024-04-25T02:10:25.339124+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339124+0000","last_undegraded":"2024-04-25T02:10:25.339124+0000","last_fullsized":"2024-04-25T02:10:25.339124+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355327+0000","last_change":"2024-04-25T02:10:25.348725+0000","last_active":"2024-04-25T02:10:25.355327+0000","last_peered":"2024-04-25T02:10:25.355327+0000","last_clean":"2024-04-25T02:10:25.355327+0000","last_became_active":"2024-04-25T02:10:25.348320+0000","last_became_peered":"2024-04-25T02:10:25.348320+0000","last_unstale":"2024-04-25T02:10:25.355327+0000","last_undegraded":"2024-04-25T02:10:25.355327+0000","last_fullsized":"2024-04-25T02:10:25.355327+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:55:56.306078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342810+0000","last_change":"2024-04-25T02:10:25.342810+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342810+0000","last_undegraded":"2024-04-25T02:10:25.342810+0000","last_fullsized":"2024-04-25T02:10:25.342810+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356218+0000","last_change":"2024-04-25T02:10:25.354398+0000","last_active":"2024-04-25T02:10:25.356218+0000","last_peered":"2024-04-25T02:10:25.356218+0000","last_clean":"2024-04-25T02:10:25.356218+0000","last_became_active":"2024-04-25T02:10:25.354135+0000","last_became_peered":"2024-04-25T02:10:25.354135+0000","last_unstale":"2024-04-25T02:10:25.356218+0000","last_undegraded":"2024-04-25T02:10:25.356218+0000","last_fullsized":"2024-04-25T02:10:25.356218+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:24.529205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341817+0000","last_change":"2024-04-25T02:10:25.341817+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341817+0000","last_undegraded":"2024-04-25T02:10:25.341817+0000","last_fullsized":"2024-04-25T02:10:25.341817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.350692+0000","last_change":"2024-04-25T02:10:25.347600+0000","last_active":"2024-04-25T02:10:25.350692+0000","last_peered":"2024-04-25T02:10:25.350692+0000","last_clean":"2024-04-25T02:10:25.350692+0000","last_became_active":"2024-04-25T02:10:25.347353+0000","last_became_peered":"2024-04-25T02:10:25.347353+0000","last_unstale":"2024-04-25T02:10:25.350692+0000","last_undegraded":"2024-04-25T02:10:25.350692+0000","last_fullsized":"2024-04-25T02:10:25.350692+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:51.037405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345800+0000","last_change":"2024-04-25T02:10:25.345800+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345800+0000","last_undegraded":"2024-04-25T02:10:25.345800+0000","last_fullsized":"2024-04-25T02:10:25.345800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355405+0000","last_change":"2024-04-25T02:10:25.351874+0000","last_active":"2024-04-25T02:10:25.355405+0000","last_peered":"2024-04-25T02:10:25.355405+0000","last_clean":"2024-04-25T02:10:25.355405+0000","last_became_active":"2024-04-25T02:10:25.351587+0000","last_became_peered":"2024-04-25T02:10:25.351587+0000","last_unstale":"2024-04-25T02:10:25.355405+0000","last_undegraded":"2024-04-25T02:10:25.355405+0000","last_fullsized":"2024-04-25T02:10:25.355405+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:56.566118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339177+0000","last_change":"2024-04-25T02:10:25.339177+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339177+0000","last_undegraded":"2024-04-25T02:10:25.339177+0000","last_fullsized":"2024-04-25T02:10:25.339177+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.350663+0000","last_change":"2024-04-25T02:10:25.346645+0000","last_active":"2024-04-25T02:10:25.350663+0000","last_peered":"2024-04-25T02:10:25.350663+0000","last_clean":"2024-04-25T02:10:25.350663+0000","last_became_active":"2024-04-25T02:10:25.346395+0000","last_became_peered":"2024-04-25T02:10:25.346395+0000","last_unstale":"2024-04-25T02:10:25.350663+0000","last_undegraded":"2024-04-25T02:10:25.350663+0000","last_fullsized":"2024-04-25T02:10:25.350663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:09:47.651953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341566+0000","last_change":"2024-04-25T02:10:25.341566+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341566+0000","last_undegraded":"2024-04-25T02:10:25.341566+0000","last_fullsized":"2024-04-25T02:10:25.341566+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352509+0000","last_change":"2024-04-25T02:10:25.349386+0000","last_active":"2024-04-25T02:10:25.352509+0000","last_peered":"2024-04-25T02:10:25.352509+0000","last_clean":"2024-04-25T02:10:25.352509+0000","last_became_active":"2024-04-25T02:10:25.348888+0000","last_became_peered":"2024-04-25T02:10:25.348888+0000","last_unstale":"2024-04-25T02:10:25.352509+0000","last_undegraded":"2024-04-25T02:10:25.352509+0000","last_fullsized":"2024-04-25T02:10:25.352509+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:20:35.902100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341065+0000","last_change":"2024-04-25T02:10:25.341065+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341065+0000","last_undegraded":"2024-04-25T02:10:25.341065+0000","last_fullsized":"2024-04-25T02:10:25.341065+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355648+0000","last_change":"2024-04-25T02:10:25.352598+0000","last_active":"2024-04-25T02:10:25.355648+0000","last_peered":"2024-04-25T02:10:25.355648+0000","last_clean":"2024-04-25T02:10:25.355648+0000","last_became_active":"2024-04-25T02:10:25.352292+0000","last_became_peered":"2024-04-25T02:10:25.352292+0000","last_unstale":"2024-04-25T02:10:25.355648+0000","last_undegraded":"2024-04-25T02:10:25.355648+0000","last_fullsized":"2024-04-25T02:10:25.355648+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:09.166741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":234,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.350173+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:10:25.350173+0000","last_peered":"2024-04-25T02:10:25.350173+0000","last_clean":"2024-04-25T02:10:25.350173+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:10:25.350173+0000","last_undegraded":"2024-04-25T02:10:25.350173+0000","last_fullsized":"2024-04-25T02:10:25.350173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1277952,"data_stored":870893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":274258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":1277952,"data_stored":870893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:10:29.645 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:10:29.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.771+0000 7f65cbed4640 1 Processor -- start 2024-04-25T02:10:29.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.771+0000 7f65cbed4640 1 -- start start 2024-04-25T02:10:29.779 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:10:29.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.772+0000 7f65cbed4640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f65c406df50 0x7f65c406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.772+0000 7f65cbed4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65c40b2d30 0x7f65c40b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.772+0000 7f65cbed4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65c4071e00 con 0x7f65c4143bc0 2024-04-25T02:10:29.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.772+0000 7f65cbed4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f65c406e8f0 con 0x7f65c40b2d30 2024-04-25T02:10:29.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.772+0000 7f65cbed4640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f65c4072cb0 con 0x7f65c406df50 2024-04-25T02:10:29.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.772+0000 7f65c9c70640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f65c4143bc0 0x7f65c415f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53848/0 (socket says 172.21.15.79:53848) 2024-04-25T02:10:29.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.772+0000 7f65c9c70640 1 -- 172.21.15.79:0/67114898 learned_addr learned my addr 172.21.15.79:0/67114898 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:29.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.772+0000 7f65ca471640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65c40b2d30 0x7f65c40b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.772+0000 7f65c946f640 1 --2- 172.21.15.79:0/67114898 >> v2:172.21.15.189:3300/0 conn(0x7f65c406df50 0x7f65c406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.772+0000 7f65c8c6e640 1 -- 172.21.15.79:0/67114898 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2350379261 0 0) 0x7f65c4071e00 con 0x7f65c4143bc0 2024-04-25T02:10:29.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.772+0000 7f65c8c6e640 1 -- 172.21.15.79:0/67114898 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65b0003520 con 0x7f65c4143bc0 2024-04-25T02:10:29.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.772+0000 7f65ca471640 1 -- 172.21.15.79:0/67114898 >> v2:172.21.15.189:3300/0 conn(0x7f65c406df50 msgr2=0x7f65c406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:29.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.772+0000 7f65ca471640 1 --2- 172.21.15.79:0/67114898 >> v2:172.21.15.189:3300/0 conn(0x7f65c406df50 0x7f65c406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.772+0000 7f65ca471640 1 -- 172.21.15.79:0/67114898 >> v1:172.21.15.79:6789/0 conn(0x7f65c4143bc0 legacy=0x7f65c415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.772+0000 7f65ca471640 1 -- 172.21.15.79:0/67114898 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c40720a0 con 0x7f65c40b2d30 2024-04-25T02:10:29.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.773+0000 7f65ca471640 1 --2- 172.21.15.79:0/67114898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c40b2d30 0x7f65c40b31c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f65c40cf960 tx=0x7f65bc02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39fd8368fd877622 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:29.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.773+0000 7f65c8c6e640 1 -- 172.21.15.79:0/67114898 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc007740 con 0x7f65c40b2d30 2024-04-25T02:10:29.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.773+0000 7f65c8c6e640 1 -- 172.21.15.79:0/67114898 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65bc0078e0 con 0x7f65c40b2d30 2024-04-25T02:10:29.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.773+0000 7f65c8c6e640 1 -- 172.21.15.79:0/67114898 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc007cb0 con 0x7f65c40b2d30 2024-04-25T02:10:29.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.774+0000 7f65cbed4640 1 -- 172.21.15.79:0/67114898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c40b2d30 msgr2=0x7f65c40b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.774+0000 7f65cbed4640 1 --2- 172.21.15.79:0/67114898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c40b2d30 0x7f65c40b31c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f65c40cf960 tx=0x7f65bc02a5f0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.774+0000 7f65cbed4640 1 -- 172.21.15.79:0/67114898 shutdown_connections 2024-04-25T02:10:29.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.774+0000 7f65cbed4640 1 --2- 172.21.15.79:0/67114898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c40b2d30 0x7f65c40b31c0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.774+0000 7f65cbed4640 1 --2- 172.21.15.79:0/67114898 >> v2:172.21.15.189:3300/0 conn(0x7f65c406df50 0x7f65c406e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.774+0000 7f65cbed4640 1 -- 172.21.15.79:0/67114898 >> 172.21.15.79:0/67114898 conn(0x7f65c40cfc80 msgr2=0x7f65c40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:29.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.774+0000 7f65cbed4640 1 -- 172.21.15.79:0/67114898 shutdown_connections 2024-04-25T02:10:29.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.774+0000 7f65cbed4640 1 -- 172.21.15.79:0/67114898 wait complete. 2024-04-25T02:10:29.784 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:10:29.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.775+0000 7f65cbed4640 1 Processor -- start 2024-04-25T02:10:29.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.775+0000 7f65cbed4640 1 -- start start 2024-04-25T02:10:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65cbed4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c406df50 0x7f65c41f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65cbed4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f65c40b2d30 0x7f65c4135a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65cbed4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65c4143bc0 0x7f65c4157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65cbed4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f65c4072940 con 0x7f65c406df50 2024-04-25T02:10:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65cbed4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f65c4072660 con 0x7f65c4143bc0 2024-04-25T02:10:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65cbed4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f65c4143fa0 con 0x7f65c40b2d30 2024-04-25T02:10:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65c9c70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c406df50 0x7f65c41f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65c9c70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c406df50 0x7f65c41f4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35398/0 (socket says 172.21.15.79:35398) 2024-04-25T02:10:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65c9c70640 1 -- 172.21.15.79:0/798373156 learned_addr learned my addr 172.21.15.79:0/798373156 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65c946f640 1 --2- 172.21.15.79:0/798373156 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f65c40b2d30 0x7f65c4135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65ca471640 1 --2- 172.21.15.79:0/798373156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65c4143bc0 0x7f65c4157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65c9c70640 1 -- 172.21.15.79:0/798373156 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f65c40b2d30 msgr2=0x7f65c4135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65c9c70640 1 --2- 172.21.15.79:0/798373156 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f65c40b2d30 0x7f65c4135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65c9c70640 1 -- 172.21.15.79:0/798373156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65c4143bc0 msgr2=0x7f65c4157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65c9c70640 1 --2- 172.21.15.79:0/798373156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65c4143bc0 0x7f65c4157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65c9c70640 1 -- 172.21.15.79:0/798373156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c41400a0 con 0x7f65c406df50 2024-04-25T02:10:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65c9c70640 1 --2- 172.21.15.79:0/798373156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c406df50 0x7f65c41f4810 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f65c000e6e0 tx=0x7f65c000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.776+0000 7f65ba7fc640 1 -- 172.21.15.79:0/798373156 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0015070 con 0x7f65c406df50 2024-04-25T02:10:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.777+0000 7f65ba7fc640 1 -- 172.21.15.79:0/798373156 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c0005ab0 con 0x7f65c406df50 2024-04-25T02:10:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.777+0000 7f65ba7fc640 1 -- 172.21.15.79:0/798373156 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c000c7f0 con 0x7f65c406df50 2024-04-25T02:10:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.777+0000 7f65cbed4640 1 -- 172.21.15.79:0/798373156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c4142b40 con 0x7f65c406df50 2024-04-25T02:10:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.777+0000 7f65cbed4640 1 -- 172.21.15.79:0/798373156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c4157cc0 con 0x7f65c406df50 2024-04-25T02:10:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.778+0000 7f65cbed4640 1 -- 172.21.15.79:0/798373156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65c40690a0 con 0x7f65c406df50 2024-04-25T02:10:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.778+0000 7f65ba7fc640 1 -- 172.21.15.79:0/798373156 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65c0018070 con 0x7f65c406df50 2024-04-25T02:10:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.778+0000 7f65ba7fc640 1 --2- 172.21.15.79:0/798373156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f65a806be30 0x7f65a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.778+0000 7f65ba7fc640 1 -- 172.21.15.79:0/798373156 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f65c008cf80 con 0x7f65c406df50 2024-04-25T02:10:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.779+0000 7f65c946f640 1 --2- 172.21.15.79:0/798373156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f65a806be30 0x7f65a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.779+0000 7f65c946f640 1 --2- 172.21.15.79:0/798373156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f65a806be30 0x7f65a806e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f65c4140850 tx=0x7f65b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:29.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.783+0000 7f65ba7fc640 1 -- 172.21.15.79:0/798373156 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f65c005b9c0 con 0x7f65c406df50 2024-04-25T02:10:29.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.958+0000 7f65cbed4640 1 -- 172.21.15.79:0/798373156 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f65c41428f0 con 0x7f65a806be30 2024-04-25T02:10:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.963+0000 7f65ba7fc640 1 -- 172.21.15.79:0/798373156 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246636 (secure 0 0 0) 0x7f65c41428f0 con 0x7f65a806be30 2024-04-25T02:10:29.973 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:29.975 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:10:29.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.966+0000 7f65cbed4640 1 -- 172.21.15.79:0/798373156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f65a806be30 msgr2=0x7f65a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.966+0000 7f65cbed4640 1 --2- 172.21.15.79:0/798373156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f65a806be30 0x7f65a806e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f65c4140850 tx=0x7f65b4008040 comp rx=0 tx=0).stop 2024-04-25T02:10:29.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.966+0000 7f65cbed4640 1 -- 172.21.15.79:0/798373156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c406df50 msgr2=0x7f65c41f4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.966+0000 7f65cbed4640 1 --2- 172.21.15.79:0/798373156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c406df50 0x7f65c41f4810 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f65c000e6e0 tx=0x7f65c000eba0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.966+0000 7f65cbed4640 1 -- 172.21.15.79:0/798373156 shutdown_connections 2024-04-25T02:10:29.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.966+0000 7f65cbed4640 1 --2- 172.21.15.79:0/798373156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f65a806be30 0x7f65a806e2f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.966+0000 7f65cbed4640 1 --2- 172.21.15.79:0/798373156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65c4143bc0 0x7f65c4157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.966+0000 7f65cbed4640 1 --2- 172.21.15.79:0/798373156 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f65c40b2d30 0x7f65c4135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.966+0000 7f65cbed4640 1 --2- 172.21.15.79:0/798373156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65c406df50 0x7f65c41f4810 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.966+0000 7f65cbed4640 1 -- 172.21.15.79:0/798373156 >> 172.21.15.79:0/798373156 conn(0x7f65c40cfc80 msgr2=0x7f65c40cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:29.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.967+0000 7f65cbed4640 1 -- 172.21.15.79:0/798373156 shutdown_connections 2024-04-25T02:10:29.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:29.967+0000 7f65cbed4640 1 -- 172.21.15.79:0/798373156 wait complete. 2024-04-25T02:10:29.985 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-04-25T02:10:29.203494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226836,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747884,"statfs":{"total":773094113280,"available":772861833216,"internally_reserved":0,"allocated":6647808,"data_stored":3418669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.873032"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347621+0000","last_change":"2024-04-25T02:10:25.347621+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347621+0000","last_undegraded":"2024-04-25T02:10:25.347621+0000","last_fullsized":"2024-04-25T02:10:25.347621+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340544+0000","last_change":"2024-04-25T02:10:25.340544+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340544+0000","last_undegraded":"2024-04-25T02:10:25.340544+0000","last_fullsized":"2024-04-25T02:10:25.340544+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348680+0000","last_change":"2024-04-25T02:10:25.348680+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348680+0000","last_undegraded":"2024-04-25T02:10:25.348680+0000","last_fullsized":"2024-04-25T02:10:25.348680+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345857+0000","last_change":"2024-04-25T02:10:25.345857+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345857+0000","last_undegraded":"2024-04-25T02:10:25.345857+0000","last_fullsized":"2024-04-25T02:10:25.345857+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.349837+0000","last_change":"2024-04-25T02:10:25.349837+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.349837+0000","last_undegraded":"2024-04-25T02:10:25.349837+0000","last_fullsized":"2024-04-25T02:10:25.349837+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344374+0000","last_change":"2024-04-25T02:10:25.344374+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344374+0000","last_undegraded":"2024-04-25T02:10:25.344374+0000","last_fullsized":"2024-04-25T02:10:25.344374+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340105+0000","last_change":"2024-04-25T02:10:25.340105+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340105+0000","last_undegraded":"2024-04-25T02:10:25.340105+0000","last_fullsized":"2024-04-25T02:10:25.340105+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341468+0000","last_change":"2024-04-25T02:10:25.341468+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341468+0000","last_undegraded":"2024-04-25T02:10:25.341468+0000","last_fullsized":"2024-04-25T02:10:25.341468+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339847+0000","last_change":"2024-04-25T02:10:25.339847+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339847+0000","last_undegraded":"2024-04-25T02:10:25.339847+0000","last_fullsized":"2024-04-25T02:10:25.339847+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340046+0000","last_change":"2024-04-25T02:10:25.340046+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340046+0000","last_undegraded":"2024-04-25T02:10:25.340046+0000","last_fullsized":"2024-04-25T02:10:25.340046+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339755+0000","last_change":"2024-04-25T02:10:25.339755+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339755+0000","last_undegraded":"2024-04-25T02:10:25.339755+0000","last_fullsized":"2024-04-25T02:10:25.339755+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344853+0000","last_change":"2024-04-25T02:10:25.344853+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344853+0000","last_undegraded":"2024-04-25T02:10:25.344853+0000","last_fullsized":"2024-04-25T02:10:25.344853+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342550+0000","last_change":"2024-04-25T02:10:25.342550+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342550+0000","last_undegraded":"2024-04-25T02:10:25.342550+0000","last_fullsized":"2024-04-25T02:10:25.342550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339742+0000","last_change":"2024-04-25T02:10:25.339742+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339742+0000","last_undegraded":"2024-04-25T02:10:25.339742+0000","last_fullsized":"2024-04-25T02:10:25.339742+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339195+0000","last_change":"2024-04-25T02:10:25.339195+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339195+0000","last_undegraded":"2024-04-25T02:10:25.339195+0000","last_fullsized":"2024-04-25T02:10:25.339195+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345098+0000","last_change":"2024-04-25T02:10:25.345098+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345098+0000","last_undegraded":"2024-04-25T02:10:25.345098+0000","last_fullsized":"2024-04-25T02:10:25.345098+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342857+0000","last_change":"2024-04-25T02:10:25.342857+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342857+0000","last_undegraded":"2024-04-25T02:10:25.342857+0000","last_fullsized":"2024-04-25T02:10:25.342857+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.349384+0000","last_change":"2024-04-25T02:10:25.349384+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.349384+0000","last_undegraded":"2024-04-25T02:10:25.349384+0000","last_fullsized":"2024-04-25T02:10:25.349384+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347360+0000","last_change":"2024-04-25T02:10:25.347360+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347360+0000","last_undegraded":"2024-04-25T02:10:25.347360+0000","last_fullsized":"2024-04-25T02:10:25.347360+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340489+0000","last_change":"2024-04-25T02:10:25.340489+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340489+0000","last_undegraded":"2024-04-25T02:10:25.340489+0000","last_fullsized":"2024-04-25T02:10:25.340489+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348114+0000","last_change":"2024-04-25T02:10:25.348114+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348114+0000","last_undegraded":"2024-04-25T02:10:25.348114+0000","last_fullsized":"2024-04-25T02:10:25.348114+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342634+0000","last_change":"2024-04-25T02:10:25.342634+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342634+0000","last_undegraded":"2024-04-25T02:10:25.342634+0000","last_fullsized":"2024-04-25T02:10:25.342634+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347881+0000","last_change":"2024-04-25T02:10:25.347881+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347881+0000","last_undegraded":"2024-04-25T02:10:25.347881+0000","last_fullsized":"2024-04-25T02:10:25.347881+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343793+0000","last_change":"2024-04-25T02:10:25.343793+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343793+0000","last_undegraded":"2024-04-25T02:10:25.343793+0000","last_fullsized":"2024-04-25T02:10:25.343793+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347250+0000","last_change":"2024-04-25T02:10:25.347250+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347250+0000","last_undegraded":"2024-04-25T02:10:25.347250+0000","last_fullsized":"2024-04-25T02:10:25.347250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345173+0000","last_change":"2024-04-25T02:10:25.345173+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345173+0000","last_undegraded":"2024-04-25T02:10:25.345173+0000","last_fullsized":"2024-04-25T02:10:25.345173+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344519+0000","last_change":"2024-04-25T02:10:25.344519+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344519+0000","last_undegraded":"2024-04-25T02:10:25.344519+0000","last_fullsized":"2024-04-25T02:10:25.344519+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348626+0000","last_change":"2024-04-25T02:10:25.348626+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348626+0000","last_undegraded":"2024-04-25T02:10:25.348626+0000","last_fullsized":"2024-04-25T02:10:25.348626+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340691+0000","last_change":"2024-04-25T02:10:25.340691+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340691+0000","last_undegraded":"2024-04-25T02:10:25.340691+0000","last_fullsized":"2024-04-25T02:10:25.340691+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347408+0000","last_change":"2024-04-25T02:10:25.347408+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347408+0000","last_undegraded":"2024-04-25T02:10:25.347408+0000","last_fullsized":"2024-04-25T02:10:25.347408+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.346786+0000","last_change":"2024-04-25T02:10:25.346786+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.346786+0000","last_undegraded":"2024-04-25T02:10:25.346786+0000","last_fullsized":"2024-04-25T02:10:25.346786+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344176+0000","last_change":"2024-04-25T02:10:25.344176+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344176+0000","last_undegraded":"2024-04-25T02:10:25.344176+0000","last_fullsized":"2024-04-25T02:10:25.344176+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343764+0000","last_change":"2024-04-25T02:10:25.343764+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343764+0000","last_undegraded":"2024-04-25T02:10:25.343764+0000","last_fullsized":"2024-04-25T02:10:25.343764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352494+0000","last_change":"2024-04-25T02:10:25.351015+0000","last_active":"2024-04-25T02:10:25.352494+0000","last_peered":"2024-04-25T02:10:25.352494+0000","last_clean":"2024-04-25T02:10:25.352494+0000","last_became_active":"2024-04-25T02:10:25.350729+0000","last_became_peered":"2024-04-25T02:10:25.350729+0000","last_unstale":"2024-04-25T02:10:25.352494+0000","last_undegraded":"2024-04-25T02:10:25.352494+0000","last_fullsized":"2024-04-25T02:10:25.352494+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.992991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339701+0000","last_change":"2024-04-25T02:10:25.339701+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339701+0000","last_undegraded":"2024-04-25T02:10:25.339701+0000","last_fullsized":"2024-04-25T02:10:25.339701+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356621+0000","last_change":"2024-04-25T02:10:25.355315+0000","last_active":"2024-04-25T02:10:25.356621+0000","last_peered":"2024-04-25T02:10:25.356621+0000","last_clean":"2024-04-25T02:10:25.356621+0000","last_became_active":"2024-04-25T02:10:25.354844+0000","last_became_peered":"2024-04-25T02:10:25.354844+0000","last_unstale":"2024-04-25T02:10:25.356621+0000","last_undegraded":"2024-04-25T02:10:25.356621+0000","last_fullsized":"2024-04-25T02:10:25.356621+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:09.410317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344146+0000","last_change":"2024-04-25T02:10:25.344146+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344146+0000","last_undegraded":"2024-04-25T02:10:25.344146+0000","last_fullsized":"2024-04-25T02:10:25.344146+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352520+0000","last_change":"2024-04-25T02:10:25.350788+0000","last_active":"2024-04-25T02:10:25.352520+0000","last_peered":"2024-04-25T02:10:25.352520+0000","last_clean":"2024-04-25T02:10:25.352520+0000","last_became_active":"2024-04-25T02:10:25.350527+0000","last_became_peered":"2024-04-25T02:10:25.350527+0000","last_unstale":"2024-04-25T02:10:25.352520+0000","last_undegraded":"2024-04-25T02:10:25.352520+0000","last_fullsized":"2024-04-25T02:10:25.352520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:09.197493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343326+0000","last_change":"2024-04-25T02:10:25.343326+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343326+0000","last_undegraded":"2024-04-25T02:10:25.343326+0000","last_fullsized":"2024-04-25T02:10:25.343326+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.354000+0000","last_change":"2024-04-25T02:10:25.351435+0000","last_active":"2024-04-25T02:10:25.354000+0000","last_peered":"2024-04-25T02:10:25.354000+0000","last_clean":"2024-04-25T02:10:25.354000+0000","last_became_active":"2024-04-25T02:10:25.351119+0000","last_became_peered":"2024-04-25T02:10:25.351119+0000","last_unstale":"2024-04-25T02:10:25.354000+0000","last_undegraded":"2024-04-25T02:10:25.354000+0000","last_fullsized":"2024-04-25T02:10:25.354000+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:11.861132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342223+0000","last_change":"2024-04-25T02:10:25.342223+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342223+0000","last_undegraded":"2024-04-25T02:10:25.342223+0000","last_fullsized":"2024-04-25T02:10:25.342223+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355979+0000","last_change":"2024-04-25T02:10:25.354878+0000","last_active":"2024-04-25T02:10:25.355979+0000","last_peered":"2024-04-25T02:10:25.355979+0000","last_clean":"2024-04-25T02:10:25.355979+0000","last_became_active":"2024-04-25T02:10:25.354616+0000","last_became_peered":"2024-04-25T02:10:25.354616+0000","last_unstale":"2024-04-25T02:10:25.355979+0000","last_undegraded":"2024-04-25T02:10:25.355979+0000","last_fullsized":"2024-04-25T02:10:25.355979+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:08.954558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340276+0000","last_change":"2024-04-25T02:10:25.340276+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340276+0000","last_undegraded":"2024-04-25T02:10:25.340276+0000","last_fullsized":"2024-04-25T02:10:25.340276+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352613+0000","last_change":"2024-04-25T02:10:25.350576+0000","last_active":"2024-04-25T02:10:25.352613+0000","last_peered":"2024-04-25T02:10:25.352613+0000","last_clean":"2024-04-25T02:10:25.352613+0000","last_became_active":"2024-04-25T02:10:25.350283+0000","last_became_peered":"2024-04-25T02:10:25.350283+0000","last_unstale":"2024-04-25T02:10:25.352613+0000","last_undegraded":"2024-04-25T02:10:25.352613+0000","last_fullsized":"2024-04-25T02:10:25.352613+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:50.678511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342834+0000","last_change":"2024-04-25T02:10:25.342834+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342834+0000","last_undegraded":"2024-04-25T02:10:25.342834+0000","last_fullsized":"2024-04-25T02:10:25.342834+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353700+0000","last_change":"2024-04-25T02:10:25.349482+0000","last_active":"2024-04-25T02:10:25.353700+0000","last_peered":"2024-04-25T02:10:25.353700+0000","last_clean":"2024-04-25T02:10:25.353700+0000","last_became_active":"2024-04-25T02:10:25.349132+0000","last_became_peered":"2024-04-25T02:10:25.349132+0000","last_unstale":"2024-04-25T02:10:25.353700+0000","last_undegraded":"2024-04-25T02:10:25.353700+0000","last_fullsized":"2024-04-25T02:10:25.353700+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:56.566118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341977+0000","last_change":"2024-04-25T02:10:25.341977+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341977+0000","last_undegraded":"2024-04-25T02:10:25.341977+0000","last_fullsized":"2024-04-25T02:10:25.341977+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353773+0000","last_change":"2024-04-25T02:10:25.349816+0000","last_active":"2024-04-25T02:10:25.353773+0000","last_peered":"2024-04-25T02:10:25.353773+0000","last_clean":"2024-04-25T02:10:25.353773+0000","last_became_active":"2024-04-25T02:10:25.349428+0000","last_became_peered":"2024-04-25T02:10:25.349428+0000","last_unstale":"2024-04-25T02:10:25.353773+0000","last_undegraded":"2024-04-25T02:10:25.353773+0000","last_fullsized":"2024-04-25T02:10:25.353773+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:27.603312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339987+0000","last_change":"2024-04-25T02:10:25.339987+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339987+0000","last_undegraded":"2024-04-25T02:10:25.339987+0000","last_fullsized":"2024-04-25T02:10:25.339987+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356609+0000","last_change":"2024-04-25T02:10:25.355143+0000","last_active":"2024-04-25T02:10:25.356609+0000","last_peered":"2024-04-25T02:10:25.356609+0000","last_clean":"2024-04-25T02:10:25.356609+0000","last_became_active":"2024-04-25T02:10:25.354873+0000","last_became_peered":"2024-04-25T02:10:25.354873+0000","last_unstale":"2024-04-25T02:10:25.356609+0000","last_undegraded":"2024-04-25T02:10:25.356609+0000","last_fullsized":"2024-04-25T02:10:25.356609+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:24.529205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347170+0000","last_change":"2024-04-25T02:10:25.347170+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347170+0000","last_undegraded":"2024-04-25T02:10:25.347170+0000","last_fullsized":"2024-04-25T02:10:25.347170+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356603+0000","last_change":"2024-04-25T02:10:25.355103+0000","last_active":"2024-04-25T02:10:25.356603+0000","last_peered":"2024-04-25T02:10:25.356603+0000","last_clean":"2024-04-25T02:10:25.356603+0000","last_became_active":"2024-04-25T02:10:25.354520+0000","last_became_peered":"2024-04-25T02:10:25.354520+0000","last_unstale":"2024-04-25T02:10:25.356603+0000","last_undegraded":"2024-04-25T02:10:25.356603+0000","last_fullsized":"2024-04-25T02:10:25.356603+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:25.255214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339665+0000","last_change":"2024-04-25T02:10:25.339665+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339665+0000","last_undegraded":"2024-04-25T02:10:25.339665+0000","last_fullsized":"2024-04-25T02:10:25.339665+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356703+0000","last_change":"2024-04-25T02:10:25.355693+0000","last_active":"2024-04-25T02:10:25.356703+0000","last_peered":"2024-04-25T02:10:25.356703+0000","last_clean":"2024-04-25T02:10:25.356703+0000","last_became_active":"2024-04-25T02:10:25.355422+0000","last_became_peered":"2024-04-25T02:10:25.355422+0000","last_unstale":"2024-04-25T02:10:25.356703+0000","last_undegraded":"2024-04-25T02:10:25.356703+0000","last_fullsized":"2024-04-25T02:10:25.356703+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:09.197493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348307+0000","last_change":"2024-04-25T02:10:25.348307+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348307+0000","last_undegraded":"2024-04-25T02:10:25.348307+0000","last_fullsized":"2024-04-25T02:10:25.348307+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353277+0000","last_change":"2024-04-25T02:10:25.346359+0000","last_active":"2024-04-25T02:10:25.353277+0000","last_peered":"2024-04-25T02:10:25.353277+0000","last_clean":"2024-04-25T02:10:25.353277+0000","last_became_active":"2024-04-25T02:10:25.346084+0000","last_became_peered":"2024-04-25T02:10:25.346084+0000","last_unstale":"2024-04-25T02:10:25.353277+0000","last_undegraded":"2024-04-25T02:10:25.353277+0000","last_fullsized":"2024-04-25T02:10:25.353277+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:54:34.693154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342892+0000","last_change":"2024-04-25T02:10:25.342892+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342892+0000","last_undegraded":"2024-04-25T02:10:25.342892+0000","last_fullsized":"2024-04-25T02:10:25.342892+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.357790+0000","last_change":"2024-04-25T02:10:25.356379+0000","last_active":"2024-04-25T02:10:25.357790+0000","last_peered":"2024-04-25T02:10:25.357790+0000","last_clean":"2024-04-25T02:10:25.357790+0000","last_became_active":"2024-04-25T02:10:25.356070+0000","last_became_peered":"2024-04-25T02:10:25.356070+0000","last_unstale":"2024-04-25T02:10:25.357790+0000","last_undegraded":"2024-04-25T02:10:25.357790+0000","last_fullsized":"2024-04-25T02:10:25.357790+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:17:16.267006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347317+0000","last_change":"2024-04-25T02:10:25.347317+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347317+0000","last_undegraded":"2024-04-25T02:10:25.347317+0000","last_fullsized":"2024-04-25T02:10:25.347317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355867+0000","last_change":"2024-04-25T02:10:25.351370+0000","last_active":"2024-04-25T02:10:25.355867+0000","last_peered":"2024-04-25T02:10:25.355867+0000","last_clean":"2024-04-25T02:10:25.355867+0000","last_became_active":"2024-04-25T02:10:25.351067+0000","last_became_peered":"2024-04-25T02:10:25.351067+0000","last_unstale":"2024-04-25T02:10:25.355867+0000","last_undegraded":"2024-04-25T02:10:25.355867+0000","last_fullsized":"2024-04-25T02:10:25.355867+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:52:30.684248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339104+0000","last_change":"2024-04-25T02:10:25.339104+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339104+0000","last_undegraded":"2024-04-25T02:10:25.339104+0000","last_fullsized":"2024-04-25T02:10:25.339104+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353886+0000","last_change":"2024-04-25T02:10:25.350641+0000","last_active":"2024-04-25T02:10:25.353886+0000","last_peered":"2024-04-25T02:10:25.353886+0000","last_clean":"2024-04-25T02:10:25.353886+0000","last_became_active":"2024-04-25T02:10:25.350337+0000","last_became_peered":"2024-04-25T02:10:25.350337+0000","last_unstale":"2024-04-25T02:10:25.353886+0000","last_undegraded":"2024-04-25T02:10:25.353886+0000","last_fullsized":"2024-04-25T02:10:25.353886+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:08.954558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.346532+0000","last_change":"2024-04-25T02:10:25.346532+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.346532+0000","last_undegraded":"2024-04-25T02:10:25.346532+0000","last_fullsized":"2024-04-25T02:10:25.346532+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356626+0000","last_change":"2024-04-25T02:10:25.355201+0000","last_active":"2024-04-25T02:10:25.356626+0000","last_peered":"2024-04-25T02:10:25.356626+0000","last_clean":"2024-04-25T02:10:25.356626+0000","last_became_active":"2024-04-25T02:10:25.354935+0000","last_became_peered":"2024-04-25T02:10:25.354935+0000","last_unstale":"2024-04-25T02:10:25.356626+0000","last_undegraded":"2024-04-25T02:10:25.356626+0000","last_fullsized":"2024-04-25T02:10:25.356626+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:50.678511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348965+0000","last_change":"2024-04-25T02:10:25.348965+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348965+0000","last_undegraded":"2024-04-25T02:10:25.348965+0000","last_fullsized":"2024-04-25T02:10:25.348965+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356521+0000","last_change":"2024-04-25T02:10:25.354199+0000","last_active":"2024-04-25T02:10:25.356521+0000","last_peered":"2024-04-25T02:10:25.356521+0000","last_clean":"2024-04-25T02:10:25.356521+0000","last_became_active":"2024-04-25T02:10:25.353946+0000","last_became_peered":"2024-04-25T02:10:25.353946+0000","last_unstale":"2024-04-25T02:10:25.356521+0000","last_undegraded":"2024-04-25T02:10:25.356521+0000","last_fullsized":"2024-04-25T02:10:25.356521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:42.993444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343986+0000","last_change":"2024-04-25T02:10:25.343986+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343986+0000","last_undegraded":"2024-04-25T02:10:25.343986+0000","last_fullsized":"2024-04-25T02:10:25.343986+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.354734+0000","last_change":"2024-04-25T02:10:25.352461+0000","last_active":"2024-04-25T02:10:25.354734+0000","last_peered":"2024-04-25T02:10:25.354734+0000","last_clean":"2024-04-25T02:10:25.354734+0000","last_became_active":"2024-04-25T02:10:25.352199+0000","last_became_peered":"2024-04-25T02:10:25.352199+0000","last_unstale":"2024-04-25T02:10:25.354734+0000","last_undegraded":"2024-04-25T02:10:25.354734+0000","last_fullsized":"2024-04-25T02:10:25.354734+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:51.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339879+0000","last_change":"2024-04-25T02:10:25.339879+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339879+0000","last_undegraded":"2024-04-25T02:10:25.339879+0000","last_fullsized":"2024-04-25T02:10:25.339879+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355946+0000","last_change":"2024-04-25T02:10:25.354429+0000","last_active":"2024-04-25T02:10:25.355946+0000","last_peered":"2024-04-25T02:10:25.355946+0000","last_clean":"2024-04-25T02:10:25.355946+0000","last_became_active":"2024-04-25T02:10:25.354011+0000","last_became_peered":"2024-04-25T02:10:25.354011+0000","last_unstale":"2024-04-25T02:10:25.355946+0000","last_undegraded":"2024-04-25T02:10:25.355946+0000","last_fullsized":"2024-04-25T02:10:25.355946+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:50.678511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347891+0000","last_change":"2024-04-25T02:10:25.347891+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347891+0000","last_undegraded":"2024-04-25T02:10:25.347891+0000","last_fullsized":"2024-04-25T02:10:25.347891+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352638+0000","last_change":"2024-04-25T02:10:25.350850+0000","last_active":"2024-04-25T02:10:25.352638+0000","last_peered":"2024-04-25T02:10:25.352638+0000","last_clean":"2024-04-25T02:10:25.352638+0000","last_became_active":"2024-04-25T02:10:25.350567+0000","last_became_peered":"2024-04-25T02:10:25.350567+0000","last_unstale":"2024-04-25T02:10:25.352638+0000","last_undegraded":"2024-04-25T02:10:25.352638+0000","last_fullsized":"2024-04-25T02:10:25.352638+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:48.643486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342223+0000","last_change":"2024-04-25T02:10:25.342223+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342223+0000","last_undegraded":"2024-04-25T02:10:25.342223+0000","last_fullsized":"2024-04-25T02:10:25.342223+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.348885+0000","last_change":"2024-04-25T02:10:25.348082+0000","last_active":"2024-04-25T02:10:25.348885+0000","last_peered":"2024-04-25T02:10:25.348885+0000","last_clean":"2024-04-25T02:10:25.348885+0000","last_became_active":"2024-04-25T02:10:25.347822+0000","last_became_peered":"2024-04-25T02:10:25.347822+0000","last_unstale":"2024-04-25T02:10:25.348885+0000","last_undegraded":"2024-04-25T02:10:25.348885+0000","last_fullsized":"2024-04-25T02:10:25.348885+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:56.655786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343944+0000","last_change":"2024-04-25T02:10:25.343944+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343944+0000","last_undegraded":"2024-04-25T02:10:25.343944+0000","last_fullsized":"2024-04-25T02:10:25.343944+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353410+0000","last_change":"2024-04-25T02:10:25.350688+0000","last_active":"2024-04-25T02:10:25.353410+0000","last_peered":"2024-04-25T02:10:25.353410+0000","last_clean":"2024-04-25T02:10:25.353410+0000","last_became_active":"2024-04-25T02:10:25.350399+0000","last_became_peered":"2024-04-25T02:10:25.350399+0000","last_unstale":"2024-04-25T02:10:25.353410+0000","last_undegraded":"2024-04-25T02:10:25.353410+0000","last_fullsized":"2024-04-25T02:10:25.353410+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:52.925033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344725+0000","last_change":"2024-04-25T02:10:25.344725+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344725+0000","last_undegraded":"2024-04-25T02:10:25.344725+0000","last_fullsized":"2024-04-25T02:10:25.344725+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353728+0000","last_change":"2024-04-25T02:10:25.348436+0000","last_active":"2024-04-25T02:10:25.353728+0000","last_peered":"2024-04-25T02:10:25.353728+0000","last_clean":"2024-04-25T02:10:25.353728+0000","last_became_active":"2024-04-25T02:10:25.348140+0000","last_became_peered":"2024-04-25T02:10:25.348140+0000","last_unstale":"2024-04-25T02:10:25.353728+0000","last_undegraded":"2024-04-25T02:10:25.353728+0000","last_fullsized":"2024-04-25T02:10:25.353728+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:27.603312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344426+0000","last_change":"2024-04-25T02:10:25.344426+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344426+0000","last_undegraded":"2024-04-25T02:10:25.344426+0000","last_fullsized":"2024-04-25T02:10:25.344426+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353441+0000","last_change":"2024-04-25T02:10:25.350051+0000","last_active":"2024-04-25T02:10:25.353441+0000","last_peered":"2024-04-25T02:10:25.353441+0000","last_clean":"2024-04-25T02:10:25.353441+0000","last_became_active":"2024-04-25T02:10:25.348145+0000","last_became_peered":"2024-04-25T02:10:25.348145+0000","last_unstale":"2024-04-25T02:10:25.353441+0000","last_undegraded":"2024-04-25T02:10:25.353441+0000","last_fullsized":"2024-04-25T02:10:25.353441+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:11.059835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342956+0000","last_change":"2024-04-25T02:10:25.342956+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342956+0000","last_undegraded":"2024-04-25T02:10:25.342956+0000","last_fullsized":"2024-04-25T02:10:25.342956+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.354215+0000","last_change":"2024-04-25T02:10:25.352072+0000","last_active":"2024-04-25T02:10:25.354215+0000","last_peered":"2024-04-25T02:10:25.354215+0000","last_clean":"2024-04-25T02:10:25.354215+0000","last_became_active":"2024-04-25T02:10:25.351477+0000","last_became_peered":"2024-04-25T02:10:25.351477+0000","last_unstale":"2024-04-25T02:10:25.354215+0000","last_undegraded":"2024-04-25T02:10:25.354215+0000","last_fullsized":"2024-04-25T02:10:25.354215+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:17:09.184794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339124+0000","last_change":"2024-04-25T02:10:25.339124+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339124+0000","last_undegraded":"2024-04-25T02:10:25.339124+0000","last_fullsized":"2024-04-25T02:10:25.339124+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355327+0000","last_change":"2024-04-25T02:10:25.348725+0000","last_active":"2024-04-25T02:10:25.355327+0000","last_peered":"2024-04-25T02:10:25.355327+0000","last_clean":"2024-04-25T02:10:25.355327+0000","last_became_active":"2024-04-25T02:10:25.348320+0000","last_became_peered":"2024-04-25T02:10:25.348320+0000","last_unstale":"2024-04-25T02:10:25.355327+0000","last_undegraded":"2024-04-25T02:10:25.355327+0000","last_fullsized":"2024-04-25T02:10:25.355327+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:55:56.306078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342810+0000","last_change":"2024-04-25T02:10:25.342810+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342810+0000","last_undegraded":"2024-04-25T02:10:25.342810+0000","last_fullsized":"2024-04-25T02:10:25.342810+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356218+0000","last_change":"2024-04-25T02:10:25.354398+0000","last_active":"2024-04-25T02:10:25.356218+0000","last_peered":"2024-04-25T02:10:25.356218+0000","last_clean":"2024-04-25T02:10:25.356218+0000","last_became_active":"2024-04-25T02:10:25.354135+0000","last_became_peered":"2024-04-25T02:10:25.354135+0000","last_unstale":"2024-04-25T02:10:25.356218+0000","last_undegraded":"2024-04-25T02:10:25.356218+0000","last_fullsized":"2024-04-25T02:10:25.356218+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:24.529205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341817+0000","last_change":"2024-04-25T02:10:25.341817+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341817+0000","last_undegraded":"2024-04-25T02:10:25.341817+0000","last_fullsized":"2024-04-25T02:10:25.341817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.350692+0000","last_change":"2024-04-25T02:10:25.347600+0000","last_active":"2024-04-25T02:10:25.350692+0000","last_peered":"2024-04-25T02:10:25.350692+0000","last_clean":"2024-04-25T02:10:25.350692+0000","last_became_active":"2024-04-25T02:10:25.347353+0000","last_became_peered":"2024-04-25T02:10:25.347353+0000","last_unstale":"2024-04-25T02:10:25.350692+0000","last_undegraded":"2024-04-25T02:10:25.350692+0000","last_fullsized":"2024-04-25T02:10:25.350692+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:51.037405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345800+0000","last_change":"2024-04-25T02:10:25.345800+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345800+0000","last_undegraded":"2024-04-25T02:10:25.345800+0000","last_fullsized":"2024-04-25T02:10:25.345800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355405+0000","last_change":"2024-04-25T02:10:25.351874+0000","last_active":"2024-04-25T02:10:25.355405+0000","last_peered":"2024-04-25T02:10:25.355405+0000","last_clean":"2024-04-25T02:10:25.355405+0000","last_became_active":"2024-04-25T02:10:25.351587+0000","last_became_peered":"2024-04-25T02:10:25.351587+0000","last_unstale":"2024-04-25T02:10:25.355405+0000","last_undegraded":"2024-04-25T02:10:25.355405+0000","last_fullsized":"2024-04-25T02:10:25.355405+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:56.566118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339177+0000","last_change":"2024-04-25T02:10:25.339177+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339177+0000","last_undegraded":"2024-04-25T02:10:25.339177+0000","last_fullsized":"2024-04-25T02:10:25.339177+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.350663+0000","last_change":"2024-04-25T02:10:25.346645+0000","last_active":"2024-04-25T02:10:25.350663+0000","last_peered":"2024-04-25T02:10:25.350663+0000","last_clean":"2024-04-25T02:10:25.350663+0000","last_became_active":"2024-04-25T02:10:25.346395+0000","last_became_peered":"2024-04-25T02:10:25.346395+0000","last_unstale":"2024-04-25T02:10:25.350663+0000","last_undegraded":"2024-04-25T02:10:25.350663+0000","last_fullsized":"2024-04-25T02:10:25.350663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:09:47.651953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341566+0000","last_change":"2024-04-25T02:10:25.341566+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341566+0000","last_undegraded":"2024-04-25T02:10:25.341566+0000","last_fullsized":"2024-04-25T02:10:25.341566+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352509+0000","last_change":"2024-04-25T02:10:25.349386+0000","last_active":"2024-04-25T02:10:25.352509+0000","last_peered":"2024-04-25T02:10:25.352509+0000","last_clean":"2024-04-25T02:10:25.352509+0000","last_became_active":"2024-04-25T02:10:25.348888+0000","last_became_peered":"2024-04-25T02:10:25.348888+0000","last_unstale":"2024-04-25T02:10:25.352509+0000","last_undegraded":"2024-04-25T02:10:25.352509+0000","last_fullsized":"2024-04-25T02:10:25.352509+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:20:35.902100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341065+0000","last_change":"2024-04-25T02:10:25.341065+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341065+0000","last_undegraded":"2024-04-25T02:10:25.341065+0000","last_fullsized":"2024-04-25T02:10:25.341065+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355648+0000","last_change":"2024-04-25T02:10:25.352598+0000","last_active":"2024-04-25T02:10:25.355648+0000","last_peered":"2024-04-25T02:10:25.355648+0000","last_clean":"2024-04-25T02:10:25.355648+0000","last_became_active":"2024-04-25T02:10:25.352292+0000","last_became_peered":"2024-04-25T02:10:25.352292+0000","last_unstale":"2024-04-25T02:10:25.355648+0000","last_undegraded":"2024-04-25T02:10:25.355648+0000","last_fullsized":"2024-04-25T02:10:25.355648+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:09.166741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":234,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.350173+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:10:25.350173+0000","last_peered":"2024-04-25T02:10:25.350173+0000","last_clean":"2024-04-25T02:10:25.350173+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:10:25.350173+0000","last_undegraded":"2024-04-25T02:10:25.350173+0000","last_fullsized":"2024-04-25T02:10:25.350173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1277952,"data_stored":870893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":274258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":1277952,"data_stored":870893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:10:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2024-04-25T02:10:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.347621+0000', 'last_change': '2024-04-25T02:10:25.347621+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.347621+0000', 'last_undegraded': '2024-04-25T02:10:25.347621+0000', 'last_fullsized': '2024-04-25T02:10:25.347621+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:10:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2024-04-25T02:10:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.340544+0000', 'last_change': '2024-04-25T02:10:25.340544+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.340544+0000', 'last_undegraded': '2024-04-25T02:10:25.340544+0000', 'last_fullsized': '2024-04-25T02:10:25.340544+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2024-04-25T02:10:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.348680+0000', 'last_change': '2024-04-25T02:10:25.348680+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.348680+0000', 'last_undegraded': '2024-04-25T02:10:25.348680+0000', 'last_fullsized': '2024-04-25T02:10:25.348680+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:10:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2024-04-25T02:10:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.345857+0000', 'last_change': '2024-04-25T02:10:25.345857+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.345857+0000', 'last_undegraded': '2024-04-25T02:10:25.345857+0000', 'last_fullsized': '2024-04-25T02:10:25.345857+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:10:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2024-04-25T02:10:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.349837+0000', 'last_change': '2024-04-25T02:10:25.349837+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.349837+0000', 'last_undegraded': '2024-04-25T02:10:25.349837+0000', 'last_fullsized': '2024-04-25T02:10:25.349837+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:10:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2024-04-25T02:10:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.344374+0000', 'last_change': '2024-04-25T02:10:25.344374+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.344374+0000', 'last_undegraded': '2024-04-25T02:10:25.344374+0000', 'last_fullsized': '2024-04-25T02:10:25.344374+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2024-04-25T02:10:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.340105+0000', 'last_change': '2024-04-25T02:10:25.340105+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.340105+0000', 'last_undegraded': '2024-04-25T02:10:25.340105+0000', 'last_fullsized': '2024-04-25T02:10:25.340105+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:10:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2024-04-25T02:10:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.341468+0000', 'last_change': '2024-04-25T02:10:25.341468+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.341468+0000', 'last_undegraded': '2024-04-25T02:10:25.341468+0000', 'last_fullsized': '2024-04-25T02:10:25.341468+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2024-04-25T02:10:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.339847+0000', 'last_change': '2024-04-25T02:10:25.339847+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.339847+0000', 'last_undegraded': '2024-04-25T02:10:25.339847+0000', 'last_fullsized': '2024-04-25T02:10:25.339847+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:10:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2024-04-25T02:10:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.340046+0000', 'last_change': '2024-04-25T02:10:25.340046+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.340046+0000', 'last_undegraded': '2024-04-25T02:10:25.340046+0000', 'last_fullsized': '2024-04-25T02:10:25.340046+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:10:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2024-04-25T02:10:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.339755+0000', 'last_change': '2024-04-25T02:10:25.339755+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.339755+0000', 'last_undegraded': '2024-04-25T02:10:25.339755+0000', 'last_fullsized': '2024-04-25T02:10:25.339755+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:10:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2024-04-25T02:10:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.344853+0000', 'last_change': '2024-04-25T02:10:25.344853+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.344853+0000', 'last_undegraded': '2024-04-25T02:10:25.344853+0000', 'last_fullsized': '2024-04-25T02:10:25.344853+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:10:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2024-04-25T02:10:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.342550+0000', 'last_change': '2024-04-25T02:10:25.342550+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.342550+0000', 'last_undegraded': '2024-04-25T02:10:25.342550+0000', 'last_fullsized': '2024-04-25T02:10:25.342550+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T02:10:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2024-04-25T02:10:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.339742+0000', 'last_change': '2024-04-25T02:10:25.339742+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.339742+0000', 'last_undegraded': '2024-04-25T02:10:25.339742+0000', 'last_fullsized': '2024-04-25T02:10:25.339742+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:10:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2024-04-25T02:10:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.339195+0000', 'last_change': '2024-04-25T02:10:25.339195+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.339195+0000', 'last_undegraded': '2024-04-25T02:10:25.339195+0000', 'last_fullsized': '2024-04-25T02:10:25.339195+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:10:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2024-04-25T02:10:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.345098+0000', 'last_change': '2024-04-25T02:10:25.345098+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.345098+0000', 'last_undegraded': '2024-04-25T02:10:25.345098+0000', 'last_fullsized': '2024-04-25T02:10:25.345098+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2024-04-25T02:10:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.342857+0000', 'last_change': '2024-04-25T02:10:25.342857+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.342857+0000', 'last_undegraded': '2024-04-25T02:10:25.342857+0000', 'last_fullsized': '2024-04-25T02:10:25.342857+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2024-04-25T02:10:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.349384+0000', 'last_change': '2024-04-25T02:10:25.349384+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.349384+0000', 'last_undegraded': '2024-04-25T02:10:25.349384+0000', 'last_fullsized': '2024-04-25T02:10:25.349384+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:10:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2024-04-25T02:10:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.347360+0000', 'last_change': '2024-04-25T02:10:25.347360+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.347360+0000', 'last_undegraded': '2024-04-25T02:10:25.347360+0000', 'last_fullsized': '2024-04-25T02:10:25.347360+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:10:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2024-04-25T02:10:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.340489+0000', 'last_change': '2024-04-25T02:10:25.340489+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.340489+0000', 'last_undegraded': '2024-04-25T02:10:25.340489+0000', 'last_fullsized': '2024-04-25T02:10:25.340489+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2024-04-25T02:10:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.348114+0000', 'last_change': '2024-04-25T02:10:25.348114+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.348114+0000', 'last_undegraded': '2024-04-25T02:10:25.348114+0000', 'last_fullsized': '2024-04-25T02:10:25.348114+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:10:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2024-04-25T02:10:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.342634+0000', 'last_change': '2024-04-25T02:10:25.342634+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.342634+0000', 'last_undegraded': '2024-04-25T02:10:25.342634+0000', 'last_fullsized': '2024-04-25T02:10:25.342634+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2024-04-25T02:10:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.347881+0000', 'last_change': '2024-04-25T02:10:25.347881+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.347881+0000', 'last_undegraded': '2024-04-25T02:10:25.347881+0000', 'last_fullsized': '2024-04-25T02:10:25.347881+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:10:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2024-04-25T02:10:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.343793+0000', 'last_change': '2024-04-25T02:10:25.343793+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.343793+0000', 'last_undegraded': '2024-04-25T02:10:25.343793+0000', 'last_fullsized': '2024-04-25T02:10:25.343793+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T02:10:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2024-04-25T02:10:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.347250+0000', 'last_change': '2024-04-25T02:10:25.347250+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.347250+0000', 'last_undegraded': '2024-04-25T02:10:25.347250+0000', 'last_fullsized': '2024-04-25T02:10:25.347250+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:10:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2024-04-25T02:10:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.345173+0000', 'last_change': '2024-04-25T02:10:25.345173+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.345173+0000', 'last_undegraded': '2024-04-25T02:10:25.345173+0000', 'last_fullsized': '2024-04-25T02:10:25.345173+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:10:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2024-04-25T02:10:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.344519+0000', 'last_change': '2024-04-25T02:10:25.344519+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.344519+0000', 'last_undegraded': '2024-04-25T02:10:25.344519+0000', 'last_fullsized': '2024-04-25T02:10:25.344519+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2024-04-25T02:10:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.348626+0000', 'last_change': '2024-04-25T02:10:25.348626+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.348626+0000', 'last_undegraded': '2024-04-25T02:10:25.348626+0000', 'last_fullsized': '2024-04-25T02:10:25.348626+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:10:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2024-04-25T02:10:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.340691+0000', 'last_change': '2024-04-25T02:10:25.340691+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.340691+0000', 'last_undegraded': '2024-04-25T02:10:25.340691+0000', 'last_fullsized': '2024-04-25T02:10:25.340691+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2024-04-25T02:10:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.347408+0000', 'last_change': '2024-04-25T02:10:25.347408+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.347408+0000', 'last_undegraded': '2024-04-25T02:10:25.347408+0000', 'last_fullsized': '2024-04-25T02:10:25.347408+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:10:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2024-04-25T02:10:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.346786+0000', 'last_change': '2024-04-25T02:10:25.346786+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.346786+0000', 'last_undegraded': '2024-04-25T02:10:25.346786+0000', 'last_fullsized': '2024-04-25T02:10:25.346786+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:10:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2024-04-25T02:10:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.344176+0000', 'last_change': '2024-04-25T02:10:25.344176+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.344176+0000', 'last_undegraded': '2024-04-25T02:10:25.344176+0000', 'last_fullsized': '2024-04-25T02:10:25.344176+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2024-04-25T02:10:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.343764+0000', 'last_change': '2024-04-25T02:10:25.343764+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.343764+0000', 'last_undegraded': '2024-04-25T02:10:25.343764+0000', 'last_fullsized': '2024-04-25T02:10:25.343764+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2024-04-25T02:10:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.339701+0000', 'last_change': '2024-04-25T02:10:25.339701+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.339701+0000', 'last_undegraded': '2024-04-25T02:10:25.339701+0000', 'last_fullsized': '2024-04-25T02:10:25.339701+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:10:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2024-04-25T02:10:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.344146+0000', 'last_change': '2024-04-25T02:10:25.344146+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.344146+0000', 'last_undegraded': '2024-04-25T02:10:25.344146+0000', 'last_fullsized': '2024-04-25T02:10:25.344146+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2024-04-25T02:10:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.343326+0000', 'last_change': '2024-04-25T02:10:25.343326+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.343326+0000', 'last_undegraded': '2024-04-25T02:10:25.343326+0000', 'last_fullsized': '2024-04-25T02:10:25.343326+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2024-04-25T02:10:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.342223+0000', 'last_change': '2024-04-25T02:10:25.342223+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.342223+0000', 'last_undegraded': '2024-04-25T02:10:25.342223+0000', 'last_fullsized': '2024-04-25T02:10:25.342223+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2024-04-25T02:10:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.340276+0000', 'last_change': '2024-04-25T02:10:25.340276+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.340276+0000', 'last_undegraded': '2024-04-25T02:10:25.340276+0000', 'last_fullsized': '2024-04-25T02:10:25.340276+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2024-04-25T02:10:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.342834+0000', 'last_change': '2024-04-25T02:10:25.342834+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.342834+0000', 'last_undegraded': '2024-04-25T02:10:25.342834+0000', 'last_fullsized': '2024-04-25T02:10:25.342834+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T02:10:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2024-04-25T02:10:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.341977+0000', 'last_change': '2024-04-25T02:10:25.341977+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.341977+0000', 'last_undegraded': '2024-04-25T02:10:25.341977+0000', 'last_fullsized': '2024-04-25T02:10:25.341977+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2024-04-25T02:10:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.339987+0000', 'last_change': '2024-04-25T02:10:25.339987+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.339987+0000', 'last_undegraded': '2024-04-25T02:10:25.339987+0000', 'last_fullsized': '2024-04-25T02:10:25.339987+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:10:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2024-04-25T02:10:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.347170+0000', 'last_change': '2024-04-25T02:10:25.347170+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.347170+0000', 'last_undegraded': '2024-04-25T02:10:25.347170+0000', 'last_fullsized': '2024-04-25T02:10:25.347170+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:10:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2024-04-25T02:10:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.339665+0000', 'last_change': '2024-04-25T02:10:25.339665+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.339665+0000', 'last_undegraded': '2024-04-25T02:10:25.339665+0000', 'last_fullsized': '2024-04-25T02:10:25.339665+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:10:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2024-04-25T02:10:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.348307+0000', 'last_change': '2024-04-25T02:10:25.348307+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.348307+0000', 'last_undegraded': '2024-04-25T02:10:25.348307+0000', 'last_fullsized': '2024-04-25T02:10:25.348307+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:10:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2024-04-25T02:10:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.342892+0000', 'last_change': '2024-04-25T02:10:25.342892+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.342892+0000', 'last_undegraded': '2024-04-25T02:10:25.342892+0000', 'last_fullsized': '2024-04-25T02:10:25.342892+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:10:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2024-04-25T02:10:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.347317+0000', 'last_change': '2024-04-25T02:10:25.347317+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.347317+0000', 'last_undegraded': '2024-04-25T02:10:25.347317+0000', 'last_fullsized': '2024-04-25T02:10:25.347317+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:10:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2024-04-25T02:10:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.339104+0000', 'last_change': '2024-04-25T02:10:25.339104+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.339104+0000', 'last_undegraded': '2024-04-25T02:10:25.339104+0000', 'last_fullsized': '2024-04-25T02:10:25.339104+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:10:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2024-04-25T02:10:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.346532+0000', 'last_change': '2024-04-25T02:10:25.346532+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.346532+0000', 'last_undegraded': '2024-04-25T02:10:25.346532+0000', 'last_fullsized': '2024-04-25T02:10:25.346532+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:10:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2024-04-25T02:10:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.348965+0000', 'last_change': '2024-04-25T02:10:25.348965+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.348965+0000', 'last_undegraded': '2024-04-25T02:10:25.348965+0000', 'last_fullsized': '2024-04-25T02:10:25.348965+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:10:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2024-04-25T02:10:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.343986+0000', 'last_change': '2024-04-25T02:10:25.343986+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.343986+0000', 'last_undegraded': '2024-04-25T02:10:25.343986+0000', 'last_fullsized': '2024-04-25T02:10:25.343986+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:10:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2024-04-25T02:10:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.339879+0000', 'last_change': '2024-04-25T02:10:25.339879+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.339879+0000', 'last_undegraded': '2024-04-25T02:10:25.339879+0000', 'last_fullsized': '2024-04-25T02:10:25.339879+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2024-04-25T02:10:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.347891+0000', 'last_change': '2024-04-25T02:10:25.347891+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.347891+0000', 'last_undegraded': '2024-04-25T02:10:25.347891+0000', 'last_fullsized': '2024-04-25T02:10:25.347891+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:10:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2024-04-25T02:10:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.342223+0000', 'last_change': '2024-04-25T02:10:25.342223+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.342223+0000', 'last_undegraded': '2024-04-25T02:10:25.342223+0000', 'last_fullsized': '2024-04-25T02:10:25.342223+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:10:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2024-04-25T02:10:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.343944+0000', 'last_change': '2024-04-25T02:10:25.343944+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.343944+0000', 'last_undegraded': '2024-04-25T02:10:25.343944+0000', 'last_fullsized': '2024-04-25T02:10:25.343944+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2024-04-25T02:10:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.344725+0000', 'last_change': '2024-04-25T02:10:25.344725+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.344725+0000', 'last_undegraded': '2024-04-25T02:10:25.344725+0000', 'last_fullsized': '2024-04-25T02:10:25.344725+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2024-04-25T02:10:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.344426+0000', 'last_change': '2024-04-25T02:10:25.344426+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.344426+0000', 'last_undegraded': '2024-04-25T02:10:25.344426+0000', 'last_fullsized': '2024-04-25T02:10:25.344426+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:10:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2024-04-25T02:10:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.342956+0000', 'last_change': '2024-04-25T02:10:25.342956+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.342956+0000', 'last_undegraded': '2024-04-25T02:10:25.342956+0000', 'last_fullsized': '2024-04-25T02:10:25.342956+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:10:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2024-04-25T02:10:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.339124+0000', 'last_change': '2024-04-25T02:10:25.339124+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.339124+0000', 'last_undegraded': '2024-04-25T02:10:25.339124+0000', 'last_fullsized': '2024-04-25T02:10:25.339124+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:10:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2024-04-25T02:10:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.342810+0000', 'last_change': '2024-04-25T02:10:25.342810+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.342810+0000', 'last_undegraded': '2024-04-25T02:10:25.342810+0000', 'last_fullsized': '2024-04-25T02:10:25.342810+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2024-04-25T02:10:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.341817+0000', 'last_change': '2024-04-25T02:10:25.341817+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.341817+0000', 'last_undegraded': '2024-04-25T02:10:25.341817+0000', 'last_fullsized': '2024-04-25T02:10:25.341817+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2024-04-25T02:10:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.345800+0000', 'last_change': '2024-04-25T02:10:25.345800+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.345800+0000', 'last_undegraded': '2024-04-25T02:10:25.345800+0000', 'last_fullsized': '2024-04-25T02:10:25.345800+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:10:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2024-04-25T02:10:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.339177+0000', 'last_change': '2024-04-25T02:10:25.339177+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.339177+0000', 'last_undegraded': '2024-04-25T02:10:25.339177+0000', 'last_fullsized': '2024-04-25T02:10:25.339177+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:10:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2024-04-25T02:10:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.341566+0000', 'last_change': '2024-04-25T02:10:25.341566+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.341566+0000', 'last_undegraded': '2024-04-25T02:10:25.341566+0000', 'last_fullsized': '2024-04-25T02:10:25.341566+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2024-04-25T02:10:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:25.341065+0000', 'last_change': '2024-04-25T02:10:25.341065+0000', 'last_active': '2024-04-25T02:10:25.330336+0000', 'last_peered': '2024-04-25T02:10:25.330336+0000', 'last_clean': '2024-04-25T02:10:25.330336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:25.341065+0000', 'last_undegraded': '2024-04-25T02:10:25.341065+0000', 'last_fullsized': '2024-04-25T02:10:25.341065+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:25.330336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:30.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T02:10:30.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.114+0000 7fe71fea5640 1 Processor -- start 2024-04-25T02:10:30.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.114+0000 7fe71fea5640 1 -- start start 2024-04-25T02:10:30.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.115+0000 7fe71fea5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe718158910 0x7fe71806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.115+0000 7fe71fea5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe718071a40 con 0x7fe71815f2a0 2024-04-25T02:10:30.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.115+0000 7fe71fea5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe718071d20 con 0x7fe71806e900 2024-04-25T02:10:30.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.115+0000 7fe71fea5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe718072650 con 0x7fe718158910 2024-04-25T02:10:30.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.115+0000 7fe71e442640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe71815f2a0 0x7fe7180b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53858/0 (socket says 172.21.15.79:53858) 2024-04-25T02:10:30.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.115+0000 7fe71e442640 1 -- 172.21.15.79:0/2807865780 learned_addr learned my addr 172.21.15.79:0/2807865780 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:30.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.115+0000 7fe71dc41640 1 --2- 172.21.15.79:0/2807865780 >> v2:172.21.15.189:3300/0 conn(0x7fe718158910 0x7fe71806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.115+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706167043 0 0) 0x7fe718071a40 con 0x7fe71815f2a0 2024-04-25T02:10:30.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.115+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe704003520 con 0x7fe71815f2a0 2024-04-25T02:10:30.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2228947943 0 0) 0x7fe718071d20 con 0x7fe71806e900 2024-04-25T02:10:30.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe718071a40 con 0x7fe71806e900 2024-04-25T02:10:30.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1374214490 0 0) 0x7fe704003520 con 0x7fe71815f2a0 2024-04-25T02:10:30.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 >> v2:172.21.15.189:3300/0 conn(0x7fe718158910 msgr2=0x7fe71806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:30.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71cc3f640 1 --2- 172.21.15.79:0/2807865780 >> v2:172.21.15.189:3300/0 conn(0x7fe718158910 0x7fe71806e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 >> v1:172.21.15.189:6789/0 conn(0x7fe71806e900 legacy=0x7fe71815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:30.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe718072000 con 0x7fe71815f2a0 2024-04-25T02:10:30.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fe710001670 con 0x7fe71815f2a0 2024-04-25T02:10:30.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 >> v1:172.21.15.79:6789/0 conn(0x7fe71815f2a0 legacy=0x7fe7180b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:30.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71cc3f640 1 --2- 172.21.15.79:0/2807865780 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe704003b90 0x7fe704003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71cc3f640 1 --2- 172.21.15.79:0/2807865780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe704004800 0x7fe704004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71cc3f640 1 --2- 172.21.15.79:0/2807865780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7040051c0 0x7fe70400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe718072650 con 0x7fe7040051c0 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe70400c090 con 0x7fe704004800 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe70400e4a0 con 0x7fe704003b90 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71e442640 1 --2- 172.21.15.79:0/2807865780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7040051c0 0x7fe70400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71d440640 1 --2- 172.21.15.79:0/2807865780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe704004800 0x7fe704004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71dc41640 1 --2- 172.21.15.79:0/2807865780 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe704003b90 0x7fe704003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71e442640 1 -- 172.21.15.79:0/2807865780 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe704003b90 msgr2=0x7fe704003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71e442640 1 --2- 172.21.15.79:0/2807865780 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe704003b90 0x7fe704003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71e442640 1 -- 172.21.15.79:0/2807865780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe704004800 msgr2=0x7fe704004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71e442640 1 --2- 172.21.15.79:0/2807865780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe704004800 0x7fe704004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.116+0000 7fe71e442640 1 -- 172.21.15.79:0/2807865780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe704003520 con 0x7fe7040051c0 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.117+0000 7fe71e442640 1 -- 172.21.15.79:0/2807865780 reap_dead start 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.117+0000 7fe71e442640 1 --2- 172.21.15.79:0/2807865780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7040051c0 0x7fe70400b9c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe710007f70 tx=0x7fe704005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e48e99bf0dd3da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.117+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710007bc0 con 0x7fe7040051c0 2024-04-25T02:10:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.117+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe710005af0 con 0x7fe7040051c0 2024-04-25T02:10:30.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.117+0000 7fe71cc3f640 1 -- 172.21.15.79:0/2807865780 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710007070 con 0x7fe7040051c0 2024-04-25T02:10:30.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.117+0000 7fe71fea5640 1 -- 172.21.15.79:0/2807865780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7040051c0 msgr2=0x7fe70400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:30.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.117+0000 7fe71fea5640 1 --2- 172.21.15.79:0/2807865780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7040051c0 0x7fe70400b9c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe710007f70 tx=0x7fe704005830 comp rx=0 tx=0).stop 2024-04-25T02:10:30.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.117+0000 7fe71fea5640 1 -- 172.21.15.79:0/2807865780 shutdown_connections 2024-04-25T02:10:30.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.117+0000 7fe71fea5640 1 --2- 172.21.15.79:0/2807865780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7040051c0 0x7fe70400b9c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.117+0000 7fe71fea5640 1 -- 172.21.15.79:0/2807865780 >> 172.21.15.79:0/2807865780 conn(0x7fe7180cfc80 msgr2=0x7fe7180d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:30.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.118+0000 7fe71fea5640 1 -- 172.21.15.79:0/2807865780 shutdown_connections 2024-04-25T02:10:30.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.118+0000 7fe71fea5640 1 -- 172.21.15.79:0/2807865780 wait complete. 2024-04-25T02:10:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.119+0000 7fe71fea5640 1 Processor -- start 2024-04-25T02:10:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.119+0000 7fe71fea5640 1 -- start start 2024-04-25T02:10:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.119+0000 7fe71fea5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7040051c0 0x7fe71814b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.119+0000 7fe71fea5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe71815cd00 0x7fe71815d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71fea5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe718156da0 0x7fe718157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71fea5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe718158cf0 con 0x7fe718156da0 2024-04-25T02:10:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71fea5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe71815f930 con 0x7fe7040051c0 2024-04-25T02:10:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71fea5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe718158e70 con 0x7fe71815cd00 2024-04-25T02:10:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71e442640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe718156da0 0x7fe718157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71e442640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe718156da0 0x7fe718157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35414/0 (socket says 172.21.15.79:35414) 2024-04-25T02:10:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71e442640 1 -- 172.21.15.79:0/737154065 learned_addr learned my addr 172.21.15.79:0/737154065 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71dc41640 1 --2- 172.21.15.79:0/737154065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7040051c0 0x7fe71814b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71d440640 1 --2- 172.21.15.79:0/737154065 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe71815cd00 0x7fe71815d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71e442640 1 -- 172.21.15.79:0/737154065 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe71815cd00 msgr2=0x7fe71815d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71e442640 1 --2- 172.21.15.79:0/737154065 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe71815cd00 0x7fe71815d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71e442640 1 -- 172.21.15.79:0/737154065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7040051c0 msgr2=0x7fe71814b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71e442640 1 --2- 172.21.15.79:0/737154065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7040051c0 0x7fe71814b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71e442640 1 -- 172.21.15.79:0/737154065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71815d830 con 0x7fe718156da0 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71dc41640 1 --2- 172.21.15.79:0/737154065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7040051c0 0x7fe71814b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71e442640 1 --2- 172.21.15.79:0/737154065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe718156da0 0x7fe718157220 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe71000c1d0 tx=0x7fe718071ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe70e7fc640 1 -- 172.21.15.79:0/737154065 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7100047e0 con 0x7fe718156da0 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe70e7fc640 1 -- 172.21.15.79:0/737154065 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe710004980 con 0x7fe718156da0 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71fea5640 1 -- 172.21.15.79:0/737154065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71815db10 con 0x7fe718156da0 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe70e7fc640 1 -- 172.21.15.79:0/737154065 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710004b50 con 0x7fe718156da0 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.120+0000 7fe71fea5640 1 -- 172.21.15.79:0/737154065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe71815e0d0 con 0x7fe718156da0 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.121+0000 7fe71fea5640 1 -- 172.21.15.79:0/737154065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe718157760 con 0x7fe718156da0 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.122+0000 7fe70e7fc640 1 -- 172.21.15.79:0/737154065 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe710042020 con 0x7fe718156da0 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.122+0000 7fe70e7fc640 1 --2- 172.21.15.79:0/737154065 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe6fc06be60 0x7fe6fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.122+0000 7fe71dc41640 1 --2- 172.21.15.79:0/737154065 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe6fc06be60 0x7fe6fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.122+0000 7fe70e7fc640 1 -- 172.21.15.79:0/737154065 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fe7100aa1e0 con 0x7fe718156da0 2024-04-25T02:10:30.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.123+0000 7fe71dc41640 1 --2- 172.21.15.79:0/737154065 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe6fc06be60 0x7fe6fc06e320 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe71815e620 tx=0x7fe71400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:30.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.127+0000 7fe70e7fc640 1 -- 172.21.15.79:0/737154065 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe710049020 con 0x7fe718156da0 2024-04-25T02:10:30.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.367+0000 7fe71fea5640 1 -- 172.21.15.79:0/737154065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe71806ca20 con 0x7fe718156da0 2024-04-25T02:10:30.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.367+0000 7fe70e7fc640 1 -- 172.21.15.79:0/737154065 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1582 (secure 0 0 0) 0x7fe71806ca20 con 0x7fe718156da0 2024-04-25T02:10:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:30.375 INFO:teuthology.orchestra.run.smithi079.stdout:{"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":175,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":59,"num_osds":8,"num_up_osds":8,"osd_up_since":1714010866,"num_in_osds":8,"osd_in_since":1714010857,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":232280064,"bytes_avail":772861833216,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":24,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6093}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-04-25T02:09:49.195015+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T02:10:30.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.369+0000 7fe71fea5640 1 -- 172.21.15.79:0/737154065 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe6fc06be60 msgr2=0x7fe6fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:30.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.369+0000 7fe71fea5640 1 --2- 172.21.15.79:0/737154065 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe6fc06be60 0x7fe6fc06e320 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe71815e620 tx=0x7fe71400b040 comp rx=0 tx=0).stop 2024-04-25T02:10:30.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.369+0000 7fe71fea5640 1 -- 172.21.15.79:0/737154065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe718156da0 msgr2=0x7fe718157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:30.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.369+0000 7fe71fea5640 1 --2- 172.21.15.79:0/737154065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe718156da0 0x7fe718157220 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe71000c1d0 tx=0x7fe718071ef0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.369+0000 7fe71fea5640 1 -- 172.21.15.79:0/737154065 shutdown_connections 2024-04-25T02:10:30.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.369+0000 7fe71fea5640 1 --2- 172.21.15.79:0/737154065 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe6fc06be60 0x7fe6fc06e320 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.369+0000 7fe71fea5640 1 --2- 172.21.15.79:0/737154065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe718156da0 0x7fe718157220 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.369+0000 7fe71fea5640 1 --2- 172.21.15.79:0/737154065 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe71815cd00 0x7fe71815d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.369+0000 7fe71fea5640 1 --2- 172.21.15.79:0/737154065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7040051c0 0x7fe71814b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.369+0000 7fe71fea5640 1 -- 172.21.15.79:0/737154065 >> 172.21.15.79:0/737154065 conn(0x7fe7180cfc80 msgr2=0x7fe7181554b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:30.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.369+0000 7fe71fea5640 1 -- 172.21.15.79:0/737154065 shutdown_connections 2024-04-25T02:10:30.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.369+0000 7fe71fea5640 1 -- 172.21.15.79:0/737154065 wait complete. 2024-04-25T02:10:30.387 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T02:10:30.388 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:10:30.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.476+0000 7f29fb2d6640 1 Processor -- start 2024-04-25T02:10:30.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.476+0000 7f29fb2d6640 1 -- start start 2024-04-25T02:10:30.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.477+0000 7f29fb2d6640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f29f406df50 0x7f29f406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.477+0000 7f29fb2d6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29f4071e00 con 0x7f29f4143bc0 2024-04-25T02:10:30.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.477+0000 7f29fb2d6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29f40720a0 con 0x7f29f40b2d30 2024-04-25T02:10:30.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.477+0000 7f29fb2d6640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f29f406e8f0 con 0x7f29f406df50 2024-04-25T02:10:30.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.477+0000 7f29f9072640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f29f4143bc0 0x7f29f415f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53868/0 (socket says 172.21.15.79:53868) 2024-04-25T02:10:30.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.477+0000 7f29f9072640 1 -- 172.21.15.79:0/68393723 learned_addr learned my addr 172.21.15.79:0/68393723 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:30.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.477+0000 7f29f8871640 1 --2- 172.21.15.79:0/68393723 >> v2:172.21.15.189:3300/0 conn(0x7f29f406df50 0x7f29f406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.477+0000 7f29ebfff640 1 -- 172.21.15.79:0/68393723 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565416451 0 0) 0x7f29f4071e00 con 0x7f29f4143bc0 2024-04-25T02:10:30.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.477+0000 7f29ebfff640 1 -- 172.21.15.79:0/68393723 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29e0005730 con 0x7f29f4143bc0 2024-04-25T02:10:30.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29ebfff640 1 -- 172.21.15.79:0/68393723 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4067196226 0 0) 0x7f29e0005730 con 0x7f29f4143bc0 2024-04-25T02:10:30.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29ebfff640 1 -- 172.21.15.79:0/68393723 >> v2:172.21.15.189:3300/0 conn(0x7f29f406df50 msgr2=0x7f29f406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:30.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29ebfff640 1 --2- 172.21.15.79:0/68393723 >> v2:172.21.15.189:3300/0 conn(0x7f29f406df50 0x7f29f406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29ebfff640 1 -- 172.21.15.79:0/68393723 >> v1:172.21.15.189:6789/0 conn(0x7f29f40b2d30 legacy=0x7f29f40b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:30.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29ebfff640 1 -- 172.21.15.79:0/68393723 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f4072380 con 0x7f29f4143bc0 2024-04-25T02:10:30.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29ebfff640 1 -- 172.21.15.79:0/68393723 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f29e4001670 con 0x7f29f4143bc0 2024-04-25T02:10:30.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29f8871640 1 --2- 172.21.15.79:0/68393723 >> v2:172.21.15.189:3300/0 conn(0x7f29f406df50 0x7f29f406e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:30.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29ebfff640 1 -- 172.21.15.79:0/68393723 >> v1:172.21.15.79:6789/0 conn(0x7f29f4143bc0 legacy=0x7f29f415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:30.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29ebfff640 1 --2- 172.21.15.79:0/68393723 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f29e0005bc0 0x7f29e0005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29ebfff640 1 --2- 172.21.15.79:0/68393723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e0006a10 0x7f29e0006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29ebfff640 1 --2- 172.21.15.79:0/68393723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00073d0 0x7f29e000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29ebfff640 1 -- 172.21.15.79:0/68393723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29e000e340 con 0x7f29e00073d0 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29ebfff640 1 -- 172.21.15.79:0/68393723 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f29e000e4f0 con 0x7f29e0006a10 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29ebfff640 1 -- 172.21.15.79:0/68393723 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f29e000e6f0 con 0x7f29e0005bc0 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29f9873640 1 --2- 172.21.15.79:0/68393723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00073d0 0x7f29e000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29f8871640 1 --2- 172.21.15.79:0/68393723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e0006a10 0x7f29e0006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29f9072640 1 --2- 172.21.15.79:0/68393723 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f29e0005bc0 0x7f29e0005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29f9873640 1 -- 172.21.15.79:0/68393723 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f29e0005bc0 msgr2=0x7f29e0005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29f9873640 1 --2- 172.21.15.79:0/68393723 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f29e0005bc0 0x7f29e0005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29f9873640 1 -- 172.21.15.79:0/68393723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e0006a10 msgr2=0x7f29e0006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29f9873640 1 --2- 172.21.15.79:0/68393723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e0006a10 0x7f29e0006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29f9873640 1 -- 172.21.15.79:0/68393723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e0005730 con 0x7f29e00073d0 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.478+0000 7f29f8871640 1 --2- 172.21.15.79:0/68393723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e0006a10 0x7f29e0006e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.479+0000 7f29f9873640 1 -- 172.21.15.79:0/68393723 reap_dead start 2024-04-25T02:10:30.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.479+0000 7f29f9873640 1 --2- 172.21.15.79:0/68393723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00073d0 0x7f29e000dbd0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f29ec001e50 tx=0x7f29e0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea6ffa8511b8e7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:30.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.479+0000 7f29ebfff640 1 -- 172.21.15.79:0/68393723 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec001a70 con 0x7f29e00073d0 2024-04-25T02:10:30.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.479+0000 7f29ebfff640 1 -- 172.21.15.79:0/68393723 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ec003970 con 0x7f29e00073d0 2024-04-25T02:10:30.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.479+0000 7f29ebfff640 1 -- 172.21.15.79:0/68393723 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec003d60 con 0x7f29e00073d0 2024-04-25T02:10:30.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.479+0000 7f29fb2d6640 1 -- 172.21.15.79:0/68393723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00073d0 msgr2=0x7f29e000dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:30.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.479+0000 7f29fb2d6640 1 --2- 172.21.15.79:0/68393723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00073d0 0x7f29e000dbd0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f29ec001e50 tx=0x7f29e0007a40 comp rx=0 tx=0).stop 2024-04-25T02:10:30.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.480+0000 7f29fb2d6640 1 -- 172.21.15.79:0/68393723 shutdown_connections 2024-04-25T02:10:30.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.480+0000 7f29fb2d6640 1 --2- 172.21.15.79:0/68393723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00073d0 0x7f29e000dbd0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.480+0000 7f29fb2d6640 1 -- 172.21.15.79:0/68393723 >> 172.21.15.79:0/68393723 conn(0x7f29f40cfc80 msgr2=0x7f29f40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:30.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.480+0000 7f29fb2d6640 1 -- 172.21.15.79:0/68393723 shutdown_connections 2024-04-25T02:10:30.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.480+0000 7f29fb2d6640 1 -- 172.21.15.79:0/68393723 wait complete. 2024-04-25T02:10:30.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.481+0000 7f29fb2d6640 1 Processor -- start 2024-04-25T02:10:30.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.481+0000 7f29fb2d6640 1 -- start start 2024-04-25T02:10:30.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.481+0000 7f29fb2d6640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f29e00073d0 0x7f29f40aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.481+0000 7f29fb2d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f41dfd60 0x7f29f4142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.481+0000 7f29fb2d6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29f40ce040 0x7f29f40ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.481+0000 7f29fb2d6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29f4072940 con 0x7f29f41dfd60 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.481+0000 7f29fb2d6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f29f4072cb0 con 0x7f29f40ce040 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.481+0000 7f29fb2d6640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f29f4143fa0 con 0x7f29e00073d0 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29f8871640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f41dfd60 0x7f29f4142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29f8871640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f41dfd60 0x7f29f4142940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35420/0 (socket says 172.21.15.79:35420) 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29f8871640 1 -- 172.21.15.79:0/1223852916 learned_addr learned my addr 172.21.15.79:0/1223852916 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29f9873640 1 --2- 172.21.15.79:0/1223852916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29f40ce040 0x7f29f40ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29f8871640 1 -- 172.21.15.79:0/1223852916 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f29e00073d0 msgr2=0x7f29f40aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29f9072640 1 --2- 172.21.15.79:0/1223852916 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f29e00073d0 0x7f29f40aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29f8871640 1 --2- 172.21.15.79:0/1223852916 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f29e00073d0 0x7f29f40aecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29f8871640 1 -- 172.21.15.79:0/1223852916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29f40ce040 msgr2=0x7f29f40ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29f8871640 1 --2- 172.21.15.79:0/1223852916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29f40ce040 0x7f29f40ce4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29f8871640 1 -- 172.21.15.79:0/1223852916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f4142e80 con 0x7f29f41dfd60 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29f9873640 1 --2- 172.21.15.79:0/1223852916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29f40ce040 0x7f29f40ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:30.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29f8871640 1 --2- 172.21.15.79:0/1223852916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f41dfd60 0x7f29f4142940 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f29f00118d0 tx=0x7f29f0011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:30.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29e9ffb640 1 -- 172.21.15.79:0/1223852916 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f000fbd0 con 0x7f29f41dfd60 2024-04-25T02:10:30.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29e9ffb640 1 -- 172.21.15.79:0/1223852916 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f000fd70 con 0x7f29f41dfd60 2024-04-25T02:10:30.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29fb2d6640 1 -- 172.21.15.79:0/1223852916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f40c4dd0 con 0x7f29f41dfd60 2024-04-25T02:10:30.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29e9ffb640 1 -- 172.21.15.79:0/1223852916 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0015660 con 0x7f29f41dfd60 2024-04-25T02:10:30.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.482+0000 7f29fb2d6640 1 -- 172.21.15.79:0/1223852916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f40c5390 con 0x7f29f41dfd60 2024-04-25T02:10:30.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.484+0000 7f29fb2d6640 1 -- 172.21.15.79:0/1223852916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f40cea00 con 0x7f29f41dfd60 2024-04-25T02:10:30.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.484+0000 7f29e9ffb640 1 -- 172.21.15.79:0/1223852916 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29f0015800 con 0x7f29f41dfd60 2024-04-25T02:10:30.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.484+0000 7f29e9ffb640 1 --2- 172.21.15.79:0/1223852916 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f29d806be60 0x7f29d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:30.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.484+0000 7f29e9ffb640 1 -- 172.21.15.79:0/1223852916 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f29f008b810 con 0x7f29f41dfd60 2024-04-25T02:10:30.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.484+0000 7f29f9072640 1 --2- 172.21.15.79:0/1223852916 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f29d806be60 0x7f29d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:30.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.485+0000 7f29f9072640 1 --2- 172.21.15.79:0/1223852916 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f29d806be60 0x7f29d806e320 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f29e40017b0 tx=0x7f29e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:30.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.489+0000 7f29e9ffb640 1 -- 172.21.15.79:0/1223852916 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f29f0019030 con 0x7f29f41dfd60 2024-04-25T02:10:30.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.658+0000 7f29fb2d6640 1 -- 172.21.15.79:0/1223852916 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29f41e04d0 con 0x7f29d806be60 2024-04-25T02:10:30.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.664+0000 7f29e9ffb640 1 -- 172.21.15.79:0/1223852916 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246636 (secure 0 0 0) 0x7f29f41e04d0 con 0x7f29d806be60 2024-04-25T02:10:30.674 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:30.675 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:10:30.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.667+0000 7f29fb2d6640 1 -- 172.21.15.79:0/1223852916 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f29d806be60 msgr2=0x7f29d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:30.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.667+0000 7f29fb2d6640 1 --2- 172.21.15.79:0/1223852916 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f29d806be60 0x7f29d806e320 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f29e40017b0 tx=0x7f29e4009040 comp rx=0 tx=0).stop 2024-04-25T02:10:30.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.667+0000 7f29fb2d6640 1 -- 172.21.15.79:0/1223852916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f41dfd60 msgr2=0x7f29f4142940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:30.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.667+0000 7f29fb2d6640 1 --2- 172.21.15.79:0/1223852916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f41dfd60 0x7f29f4142940 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f29f00118d0 tx=0x7f29f0011d90 comp rx=0 tx=0).stop 2024-04-25T02:10:30.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.667+0000 7f29fb2d6640 1 -- 172.21.15.79:0/1223852916 shutdown_connections 2024-04-25T02:10:30.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.667+0000 7f29fb2d6640 1 --2- 172.21.15.79:0/1223852916 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f29d806be60 0x7f29d806e320 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.667+0000 7f29fb2d6640 1 --2- 172.21.15.79:0/1223852916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29f40ce040 0x7f29f40ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.667+0000 7f29fb2d6640 1 --2- 172.21.15.79:0/1223852916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f41dfd60 0x7f29f4142940 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.667+0000 7f29fb2d6640 1 --2- 172.21.15.79:0/1223852916 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f29e00073d0 0x7f29f40aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:30.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.667+0000 7f29fb2d6640 1 -- 172.21.15.79:0/1223852916 >> 172.21.15.79:0/1223852916 conn(0x7f29f40cfc80 msgr2=0x7f29f40cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:30.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.667+0000 7f29fb2d6640 1 -- 172.21.15.79:0/1223852916 shutdown_connections 2024-04-25T02:10:30.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:30.667+0000 7f29fb2d6640 1 -- 172.21.15.79:0/1223852916 wait complete. 2024-04-25T02:10:30.685 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-04-25T02:10:29.203494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226836,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747884,"statfs":{"total":773094113280,"available":772861833216,"internally_reserved":0,"allocated":6647808,"data_stored":3418669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.873032"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347621+0000","last_change":"2024-04-25T02:10:25.347621+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347621+0000","last_undegraded":"2024-04-25T02:10:25.347621+0000","last_fullsized":"2024-04-25T02:10:25.347621+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340544+0000","last_change":"2024-04-25T02:10:25.340544+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340544+0000","last_undegraded":"2024-04-25T02:10:25.340544+0000","last_fullsized":"2024-04-25T02:10:25.340544+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348680+0000","last_change":"2024-04-25T02:10:25.348680+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348680+0000","last_undegraded":"2024-04-25T02:10:25.348680+0000","last_fullsized":"2024-04-25T02:10:25.348680+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345857+0000","last_change":"2024-04-25T02:10:25.345857+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345857+0000","last_undegraded":"2024-04-25T02:10:25.345857+0000","last_fullsized":"2024-04-25T02:10:25.345857+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.349837+0000","last_change":"2024-04-25T02:10:25.349837+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.349837+0000","last_undegraded":"2024-04-25T02:10:25.349837+0000","last_fullsized":"2024-04-25T02:10:25.349837+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344374+0000","last_change":"2024-04-25T02:10:25.344374+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344374+0000","last_undegraded":"2024-04-25T02:10:25.344374+0000","last_fullsized":"2024-04-25T02:10:25.344374+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340105+0000","last_change":"2024-04-25T02:10:25.340105+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340105+0000","last_undegraded":"2024-04-25T02:10:25.340105+0000","last_fullsized":"2024-04-25T02:10:25.340105+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341468+0000","last_change":"2024-04-25T02:10:25.341468+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341468+0000","last_undegraded":"2024-04-25T02:10:25.341468+0000","last_fullsized":"2024-04-25T02:10:25.341468+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339847+0000","last_change":"2024-04-25T02:10:25.339847+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339847+0000","last_undegraded":"2024-04-25T02:10:25.339847+0000","last_fullsized":"2024-04-25T02:10:25.339847+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340046+0000","last_change":"2024-04-25T02:10:25.340046+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340046+0000","last_undegraded":"2024-04-25T02:10:25.340046+0000","last_fullsized":"2024-04-25T02:10:25.340046+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339755+0000","last_change":"2024-04-25T02:10:25.339755+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339755+0000","last_undegraded":"2024-04-25T02:10:25.339755+0000","last_fullsized":"2024-04-25T02:10:25.339755+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344853+0000","last_change":"2024-04-25T02:10:25.344853+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344853+0000","last_undegraded":"2024-04-25T02:10:25.344853+0000","last_fullsized":"2024-04-25T02:10:25.344853+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342550+0000","last_change":"2024-04-25T02:10:25.342550+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342550+0000","last_undegraded":"2024-04-25T02:10:25.342550+0000","last_fullsized":"2024-04-25T02:10:25.342550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339742+0000","last_change":"2024-04-25T02:10:25.339742+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339742+0000","last_undegraded":"2024-04-25T02:10:25.339742+0000","last_fullsized":"2024-04-25T02:10:25.339742+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339195+0000","last_change":"2024-04-25T02:10:25.339195+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339195+0000","last_undegraded":"2024-04-25T02:10:25.339195+0000","last_fullsized":"2024-04-25T02:10:25.339195+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345098+0000","last_change":"2024-04-25T02:10:25.345098+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345098+0000","last_undegraded":"2024-04-25T02:10:25.345098+0000","last_fullsized":"2024-04-25T02:10:25.345098+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342857+0000","last_change":"2024-04-25T02:10:25.342857+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342857+0000","last_undegraded":"2024-04-25T02:10:25.342857+0000","last_fullsized":"2024-04-25T02:10:25.342857+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.349384+0000","last_change":"2024-04-25T02:10:25.349384+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.349384+0000","last_undegraded":"2024-04-25T02:10:25.349384+0000","last_fullsized":"2024-04-25T02:10:25.349384+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347360+0000","last_change":"2024-04-25T02:10:25.347360+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347360+0000","last_undegraded":"2024-04-25T02:10:25.347360+0000","last_fullsized":"2024-04-25T02:10:25.347360+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340489+0000","last_change":"2024-04-25T02:10:25.340489+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340489+0000","last_undegraded":"2024-04-25T02:10:25.340489+0000","last_fullsized":"2024-04-25T02:10:25.340489+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348114+0000","last_change":"2024-04-25T02:10:25.348114+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348114+0000","last_undegraded":"2024-04-25T02:10:25.348114+0000","last_fullsized":"2024-04-25T02:10:25.348114+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342634+0000","last_change":"2024-04-25T02:10:25.342634+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342634+0000","last_undegraded":"2024-04-25T02:10:25.342634+0000","last_fullsized":"2024-04-25T02:10:25.342634+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347881+0000","last_change":"2024-04-25T02:10:25.347881+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347881+0000","last_undegraded":"2024-04-25T02:10:25.347881+0000","last_fullsized":"2024-04-25T02:10:25.347881+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343793+0000","last_change":"2024-04-25T02:10:25.343793+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343793+0000","last_undegraded":"2024-04-25T02:10:25.343793+0000","last_fullsized":"2024-04-25T02:10:25.343793+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347250+0000","last_change":"2024-04-25T02:10:25.347250+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347250+0000","last_undegraded":"2024-04-25T02:10:25.347250+0000","last_fullsized":"2024-04-25T02:10:25.347250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345173+0000","last_change":"2024-04-25T02:10:25.345173+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345173+0000","last_undegraded":"2024-04-25T02:10:25.345173+0000","last_fullsized":"2024-04-25T02:10:25.345173+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344519+0000","last_change":"2024-04-25T02:10:25.344519+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344519+0000","last_undegraded":"2024-04-25T02:10:25.344519+0000","last_fullsized":"2024-04-25T02:10:25.344519+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348626+0000","last_change":"2024-04-25T02:10:25.348626+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348626+0000","last_undegraded":"2024-04-25T02:10:25.348626+0000","last_fullsized":"2024-04-25T02:10:25.348626+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340691+0000","last_change":"2024-04-25T02:10:25.340691+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340691+0000","last_undegraded":"2024-04-25T02:10:25.340691+0000","last_fullsized":"2024-04-25T02:10:25.340691+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347408+0000","last_change":"2024-04-25T02:10:25.347408+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347408+0000","last_undegraded":"2024-04-25T02:10:25.347408+0000","last_fullsized":"2024-04-25T02:10:25.347408+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.346786+0000","last_change":"2024-04-25T02:10:25.346786+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.346786+0000","last_undegraded":"2024-04-25T02:10:25.346786+0000","last_fullsized":"2024-04-25T02:10:25.346786+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344176+0000","last_change":"2024-04-25T02:10:25.344176+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344176+0000","last_undegraded":"2024-04-25T02:10:25.344176+0000","last_fullsized":"2024-04-25T02:10:25.344176+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343764+0000","last_change":"2024-04-25T02:10:25.343764+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343764+0000","last_undegraded":"2024-04-25T02:10:25.343764+0000","last_fullsized":"2024-04-25T02:10:25.343764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352494+0000","last_change":"2024-04-25T02:10:25.351015+0000","last_active":"2024-04-25T02:10:25.352494+0000","last_peered":"2024-04-25T02:10:25.352494+0000","last_clean":"2024-04-25T02:10:25.352494+0000","last_became_active":"2024-04-25T02:10:25.350729+0000","last_became_peered":"2024-04-25T02:10:25.350729+0000","last_unstale":"2024-04-25T02:10:25.352494+0000","last_undegraded":"2024-04-25T02:10:25.352494+0000","last_fullsized":"2024-04-25T02:10:25.352494+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.992991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339701+0000","last_change":"2024-04-25T02:10:25.339701+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339701+0000","last_undegraded":"2024-04-25T02:10:25.339701+0000","last_fullsized":"2024-04-25T02:10:25.339701+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356621+0000","last_change":"2024-04-25T02:10:25.355315+0000","last_active":"2024-04-25T02:10:25.356621+0000","last_peered":"2024-04-25T02:10:25.356621+0000","last_clean":"2024-04-25T02:10:25.356621+0000","last_became_active":"2024-04-25T02:10:25.354844+0000","last_became_peered":"2024-04-25T02:10:25.354844+0000","last_unstale":"2024-04-25T02:10:25.356621+0000","last_undegraded":"2024-04-25T02:10:25.356621+0000","last_fullsized":"2024-04-25T02:10:25.356621+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:09.410317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344146+0000","last_change":"2024-04-25T02:10:25.344146+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344146+0000","last_undegraded":"2024-04-25T02:10:25.344146+0000","last_fullsized":"2024-04-25T02:10:25.344146+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352520+0000","last_change":"2024-04-25T02:10:25.350788+0000","last_active":"2024-04-25T02:10:25.352520+0000","last_peered":"2024-04-25T02:10:25.352520+0000","last_clean":"2024-04-25T02:10:25.352520+0000","last_became_active":"2024-04-25T02:10:25.350527+0000","last_became_peered":"2024-04-25T02:10:25.350527+0000","last_unstale":"2024-04-25T02:10:25.352520+0000","last_undegraded":"2024-04-25T02:10:25.352520+0000","last_fullsized":"2024-04-25T02:10:25.352520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:09.197493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343326+0000","last_change":"2024-04-25T02:10:25.343326+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343326+0000","last_undegraded":"2024-04-25T02:10:25.343326+0000","last_fullsized":"2024-04-25T02:10:25.343326+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.354000+0000","last_change":"2024-04-25T02:10:25.351435+0000","last_active":"2024-04-25T02:10:25.354000+0000","last_peered":"2024-04-25T02:10:25.354000+0000","last_clean":"2024-04-25T02:10:25.354000+0000","last_became_active":"2024-04-25T02:10:25.351119+0000","last_became_peered":"2024-04-25T02:10:25.351119+0000","last_unstale":"2024-04-25T02:10:25.354000+0000","last_undegraded":"2024-04-25T02:10:25.354000+0000","last_fullsized":"2024-04-25T02:10:25.354000+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:11.861132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342223+0000","last_change":"2024-04-25T02:10:25.342223+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342223+0000","last_undegraded":"2024-04-25T02:10:25.342223+0000","last_fullsized":"2024-04-25T02:10:25.342223+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355979+0000","last_change":"2024-04-25T02:10:25.354878+0000","last_active":"2024-04-25T02:10:25.355979+0000","last_peered":"2024-04-25T02:10:25.355979+0000","last_clean":"2024-04-25T02:10:25.355979+0000","last_became_active":"2024-04-25T02:10:25.354616+0000","last_became_peered":"2024-04-25T02:10:25.354616+0000","last_unstale":"2024-04-25T02:10:25.355979+0000","last_undegraded":"2024-04-25T02:10:25.355979+0000","last_fullsized":"2024-04-25T02:10:25.355979+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:08.954558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.340276+0000","last_change":"2024-04-25T02:10:25.340276+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.340276+0000","last_undegraded":"2024-04-25T02:10:25.340276+0000","last_fullsized":"2024-04-25T02:10:25.340276+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352613+0000","last_change":"2024-04-25T02:10:25.350576+0000","last_active":"2024-04-25T02:10:25.352613+0000","last_peered":"2024-04-25T02:10:25.352613+0000","last_clean":"2024-04-25T02:10:25.352613+0000","last_became_active":"2024-04-25T02:10:25.350283+0000","last_became_peered":"2024-04-25T02:10:25.350283+0000","last_unstale":"2024-04-25T02:10:25.352613+0000","last_undegraded":"2024-04-25T02:10:25.352613+0000","last_fullsized":"2024-04-25T02:10:25.352613+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:50.678511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342834+0000","last_change":"2024-04-25T02:10:25.342834+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342834+0000","last_undegraded":"2024-04-25T02:10:25.342834+0000","last_fullsized":"2024-04-25T02:10:25.342834+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353700+0000","last_change":"2024-04-25T02:10:25.349482+0000","last_active":"2024-04-25T02:10:25.353700+0000","last_peered":"2024-04-25T02:10:25.353700+0000","last_clean":"2024-04-25T02:10:25.353700+0000","last_became_active":"2024-04-25T02:10:25.349132+0000","last_became_peered":"2024-04-25T02:10:25.349132+0000","last_unstale":"2024-04-25T02:10:25.353700+0000","last_undegraded":"2024-04-25T02:10:25.353700+0000","last_fullsized":"2024-04-25T02:10:25.353700+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:56.566118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341977+0000","last_change":"2024-04-25T02:10:25.341977+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341977+0000","last_undegraded":"2024-04-25T02:10:25.341977+0000","last_fullsized":"2024-04-25T02:10:25.341977+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353773+0000","last_change":"2024-04-25T02:10:25.349816+0000","last_active":"2024-04-25T02:10:25.353773+0000","last_peered":"2024-04-25T02:10:25.353773+0000","last_clean":"2024-04-25T02:10:25.353773+0000","last_became_active":"2024-04-25T02:10:25.349428+0000","last_became_peered":"2024-04-25T02:10:25.349428+0000","last_unstale":"2024-04-25T02:10:25.353773+0000","last_undegraded":"2024-04-25T02:10:25.353773+0000","last_fullsized":"2024-04-25T02:10:25.353773+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:27.603312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339987+0000","last_change":"2024-04-25T02:10:25.339987+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339987+0000","last_undegraded":"2024-04-25T02:10:25.339987+0000","last_fullsized":"2024-04-25T02:10:25.339987+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356609+0000","last_change":"2024-04-25T02:10:25.355143+0000","last_active":"2024-04-25T02:10:25.356609+0000","last_peered":"2024-04-25T02:10:25.356609+0000","last_clean":"2024-04-25T02:10:25.356609+0000","last_became_active":"2024-04-25T02:10:25.354873+0000","last_became_peered":"2024-04-25T02:10:25.354873+0000","last_unstale":"2024-04-25T02:10:25.356609+0000","last_undegraded":"2024-04-25T02:10:25.356609+0000","last_fullsized":"2024-04-25T02:10:25.356609+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:24.529205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347170+0000","last_change":"2024-04-25T02:10:25.347170+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347170+0000","last_undegraded":"2024-04-25T02:10:25.347170+0000","last_fullsized":"2024-04-25T02:10:25.347170+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356603+0000","last_change":"2024-04-25T02:10:25.355103+0000","last_active":"2024-04-25T02:10:25.356603+0000","last_peered":"2024-04-25T02:10:25.356603+0000","last_clean":"2024-04-25T02:10:25.356603+0000","last_became_active":"2024-04-25T02:10:25.354520+0000","last_became_peered":"2024-04-25T02:10:25.354520+0000","last_unstale":"2024-04-25T02:10:25.356603+0000","last_undegraded":"2024-04-25T02:10:25.356603+0000","last_fullsized":"2024-04-25T02:10:25.356603+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:25.255214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339665+0000","last_change":"2024-04-25T02:10:25.339665+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339665+0000","last_undegraded":"2024-04-25T02:10:25.339665+0000","last_fullsized":"2024-04-25T02:10:25.339665+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356703+0000","last_change":"2024-04-25T02:10:25.355693+0000","last_active":"2024-04-25T02:10:25.356703+0000","last_peered":"2024-04-25T02:10:25.356703+0000","last_clean":"2024-04-25T02:10:25.356703+0000","last_became_active":"2024-04-25T02:10:25.355422+0000","last_became_peered":"2024-04-25T02:10:25.355422+0000","last_unstale":"2024-04-25T02:10:25.356703+0000","last_undegraded":"2024-04-25T02:10:25.356703+0000","last_fullsized":"2024-04-25T02:10:25.356703+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:09.197493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348307+0000","last_change":"2024-04-25T02:10:25.348307+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348307+0000","last_undegraded":"2024-04-25T02:10:25.348307+0000","last_fullsized":"2024-04-25T02:10:25.348307+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353277+0000","last_change":"2024-04-25T02:10:25.346359+0000","last_active":"2024-04-25T02:10:25.353277+0000","last_peered":"2024-04-25T02:10:25.353277+0000","last_clean":"2024-04-25T02:10:25.353277+0000","last_became_active":"2024-04-25T02:10:25.346084+0000","last_became_peered":"2024-04-25T02:10:25.346084+0000","last_unstale":"2024-04-25T02:10:25.353277+0000","last_undegraded":"2024-04-25T02:10:25.353277+0000","last_fullsized":"2024-04-25T02:10:25.353277+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:54:34.693154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342892+0000","last_change":"2024-04-25T02:10:25.342892+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342892+0000","last_undegraded":"2024-04-25T02:10:25.342892+0000","last_fullsized":"2024-04-25T02:10:25.342892+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.357790+0000","last_change":"2024-04-25T02:10:25.356379+0000","last_active":"2024-04-25T02:10:25.357790+0000","last_peered":"2024-04-25T02:10:25.357790+0000","last_clean":"2024-04-25T02:10:25.357790+0000","last_became_active":"2024-04-25T02:10:25.356070+0000","last_became_peered":"2024-04-25T02:10:25.356070+0000","last_unstale":"2024-04-25T02:10:25.357790+0000","last_undegraded":"2024-04-25T02:10:25.357790+0000","last_fullsized":"2024-04-25T02:10:25.357790+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:17:16.267006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347317+0000","last_change":"2024-04-25T02:10:25.347317+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347317+0000","last_undegraded":"2024-04-25T02:10:25.347317+0000","last_fullsized":"2024-04-25T02:10:25.347317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355867+0000","last_change":"2024-04-25T02:10:25.351370+0000","last_active":"2024-04-25T02:10:25.355867+0000","last_peered":"2024-04-25T02:10:25.355867+0000","last_clean":"2024-04-25T02:10:25.355867+0000","last_became_active":"2024-04-25T02:10:25.351067+0000","last_became_peered":"2024-04-25T02:10:25.351067+0000","last_unstale":"2024-04-25T02:10:25.355867+0000","last_undegraded":"2024-04-25T02:10:25.355867+0000","last_fullsized":"2024-04-25T02:10:25.355867+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:52:30.684248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339104+0000","last_change":"2024-04-25T02:10:25.339104+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339104+0000","last_undegraded":"2024-04-25T02:10:25.339104+0000","last_fullsized":"2024-04-25T02:10:25.339104+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353886+0000","last_change":"2024-04-25T02:10:25.350641+0000","last_active":"2024-04-25T02:10:25.353886+0000","last_peered":"2024-04-25T02:10:25.353886+0000","last_clean":"2024-04-25T02:10:25.353886+0000","last_became_active":"2024-04-25T02:10:25.350337+0000","last_became_peered":"2024-04-25T02:10:25.350337+0000","last_unstale":"2024-04-25T02:10:25.353886+0000","last_undegraded":"2024-04-25T02:10:25.353886+0000","last_fullsized":"2024-04-25T02:10:25.353886+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:08.954558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.346532+0000","last_change":"2024-04-25T02:10:25.346532+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.346532+0000","last_undegraded":"2024-04-25T02:10:25.346532+0000","last_fullsized":"2024-04-25T02:10:25.346532+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356626+0000","last_change":"2024-04-25T02:10:25.355201+0000","last_active":"2024-04-25T02:10:25.356626+0000","last_peered":"2024-04-25T02:10:25.356626+0000","last_clean":"2024-04-25T02:10:25.356626+0000","last_became_active":"2024-04-25T02:10:25.354935+0000","last_became_peered":"2024-04-25T02:10:25.354935+0000","last_unstale":"2024-04-25T02:10:25.356626+0000","last_undegraded":"2024-04-25T02:10:25.356626+0000","last_fullsized":"2024-04-25T02:10:25.356626+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:50.678511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.348965+0000","last_change":"2024-04-25T02:10:25.348965+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.348965+0000","last_undegraded":"2024-04-25T02:10:25.348965+0000","last_fullsized":"2024-04-25T02:10:25.348965+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356521+0000","last_change":"2024-04-25T02:10:25.354199+0000","last_active":"2024-04-25T02:10:25.356521+0000","last_peered":"2024-04-25T02:10:25.356521+0000","last_clean":"2024-04-25T02:10:25.356521+0000","last_became_active":"2024-04-25T02:10:25.353946+0000","last_became_peered":"2024-04-25T02:10:25.353946+0000","last_unstale":"2024-04-25T02:10:25.356521+0000","last_undegraded":"2024-04-25T02:10:25.356521+0000","last_fullsized":"2024-04-25T02:10:25.356521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:42.993444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343986+0000","last_change":"2024-04-25T02:10:25.343986+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343986+0000","last_undegraded":"2024-04-25T02:10:25.343986+0000","last_fullsized":"2024-04-25T02:10:25.343986+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.354734+0000","last_change":"2024-04-25T02:10:25.352461+0000","last_active":"2024-04-25T02:10:25.354734+0000","last_peered":"2024-04-25T02:10:25.354734+0000","last_clean":"2024-04-25T02:10:25.354734+0000","last_became_active":"2024-04-25T02:10:25.352199+0000","last_became_peered":"2024-04-25T02:10:25.352199+0000","last_unstale":"2024-04-25T02:10:25.354734+0000","last_undegraded":"2024-04-25T02:10:25.354734+0000","last_fullsized":"2024-04-25T02:10:25.354734+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:51.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339879+0000","last_change":"2024-04-25T02:10:25.339879+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339879+0000","last_undegraded":"2024-04-25T02:10:25.339879+0000","last_fullsized":"2024-04-25T02:10:25.339879+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355946+0000","last_change":"2024-04-25T02:10:25.354429+0000","last_active":"2024-04-25T02:10:25.355946+0000","last_peered":"2024-04-25T02:10:25.355946+0000","last_clean":"2024-04-25T02:10:25.355946+0000","last_became_active":"2024-04-25T02:10:25.354011+0000","last_became_peered":"2024-04-25T02:10:25.354011+0000","last_unstale":"2024-04-25T02:10:25.355946+0000","last_undegraded":"2024-04-25T02:10:25.355946+0000","last_fullsized":"2024-04-25T02:10:25.355946+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:50.678511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.347891+0000","last_change":"2024-04-25T02:10:25.347891+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.347891+0000","last_undegraded":"2024-04-25T02:10:25.347891+0000","last_fullsized":"2024-04-25T02:10:25.347891+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352638+0000","last_change":"2024-04-25T02:10:25.350850+0000","last_active":"2024-04-25T02:10:25.352638+0000","last_peered":"2024-04-25T02:10:25.352638+0000","last_clean":"2024-04-25T02:10:25.352638+0000","last_became_active":"2024-04-25T02:10:25.350567+0000","last_became_peered":"2024-04-25T02:10:25.350567+0000","last_unstale":"2024-04-25T02:10:25.352638+0000","last_undegraded":"2024-04-25T02:10:25.352638+0000","last_fullsized":"2024-04-25T02:10:25.352638+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:48.643486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342223+0000","last_change":"2024-04-25T02:10:25.342223+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342223+0000","last_undegraded":"2024-04-25T02:10:25.342223+0000","last_fullsized":"2024-04-25T02:10:25.342223+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.348885+0000","last_change":"2024-04-25T02:10:25.348082+0000","last_active":"2024-04-25T02:10:25.348885+0000","last_peered":"2024-04-25T02:10:25.348885+0000","last_clean":"2024-04-25T02:10:25.348885+0000","last_became_active":"2024-04-25T02:10:25.347822+0000","last_became_peered":"2024-04-25T02:10:25.347822+0000","last_unstale":"2024-04-25T02:10:25.348885+0000","last_undegraded":"2024-04-25T02:10:25.348885+0000","last_fullsized":"2024-04-25T02:10:25.348885+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:56.655786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.343944+0000","last_change":"2024-04-25T02:10:25.343944+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.343944+0000","last_undegraded":"2024-04-25T02:10:25.343944+0000","last_fullsized":"2024-04-25T02:10:25.343944+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353410+0000","last_change":"2024-04-25T02:10:25.350688+0000","last_active":"2024-04-25T02:10:25.353410+0000","last_peered":"2024-04-25T02:10:25.353410+0000","last_clean":"2024-04-25T02:10:25.353410+0000","last_became_active":"2024-04-25T02:10:25.350399+0000","last_became_peered":"2024-04-25T02:10:25.350399+0000","last_unstale":"2024-04-25T02:10:25.353410+0000","last_undegraded":"2024-04-25T02:10:25.353410+0000","last_fullsized":"2024-04-25T02:10:25.353410+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:52.925033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344725+0000","last_change":"2024-04-25T02:10:25.344725+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344725+0000","last_undegraded":"2024-04-25T02:10:25.344725+0000","last_fullsized":"2024-04-25T02:10:25.344725+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353728+0000","last_change":"2024-04-25T02:10:25.348436+0000","last_active":"2024-04-25T02:10:25.353728+0000","last_peered":"2024-04-25T02:10:25.353728+0000","last_clean":"2024-04-25T02:10:25.353728+0000","last_became_active":"2024-04-25T02:10:25.348140+0000","last_became_peered":"2024-04-25T02:10:25.348140+0000","last_unstale":"2024-04-25T02:10:25.353728+0000","last_undegraded":"2024-04-25T02:10:25.353728+0000","last_fullsized":"2024-04-25T02:10:25.353728+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:27.603312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.344426+0000","last_change":"2024-04-25T02:10:25.344426+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.344426+0000","last_undegraded":"2024-04-25T02:10:25.344426+0000","last_fullsized":"2024-04-25T02:10:25.344426+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.353441+0000","last_change":"2024-04-25T02:10:25.350051+0000","last_active":"2024-04-25T02:10:25.353441+0000","last_peered":"2024-04-25T02:10:25.353441+0000","last_clean":"2024-04-25T02:10:25.353441+0000","last_became_active":"2024-04-25T02:10:25.348145+0000","last_became_peered":"2024-04-25T02:10:25.348145+0000","last_unstale":"2024-04-25T02:10:25.353441+0000","last_undegraded":"2024-04-25T02:10:25.353441+0000","last_fullsized":"2024-04-25T02:10:25.353441+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:11.059835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342956+0000","last_change":"2024-04-25T02:10:25.342956+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342956+0000","last_undegraded":"2024-04-25T02:10:25.342956+0000","last_fullsized":"2024-04-25T02:10:25.342956+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.354215+0000","last_change":"2024-04-25T02:10:25.352072+0000","last_active":"2024-04-25T02:10:25.354215+0000","last_peered":"2024-04-25T02:10:25.354215+0000","last_clean":"2024-04-25T02:10:25.354215+0000","last_became_active":"2024-04-25T02:10:25.351477+0000","last_became_peered":"2024-04-25T02:10:25.351477+0000","last_unstale":"2024-04-25T02:10:25.354215+0000","last_undegraded":"2024-04-25T02:10:25.354215+0000","last_fullsized":"2024-04-25T02:10:25.354215+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:17:09.184794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339124+0000","last_change":"2024-04-25T02:10:25.339124+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339124+0000","last_undegraded":"2024-04-25T02:10:25.339124+0000","last_fullsized":"2024-04-25T02:10:25.339124+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355327+0000","last_change":"2024-04-25T02:10:25.348725+0000","last_active":"2024-04-25T02:10:25.355327+0000","last_peered":"2024-04-25T02:10:25.355327+0000","last_clean":"2024-04-25T02:10:25.355327+0000","last_became_active":"2024-04-25T02:10:25.348320+0000","last_became_peered":"2024-04-25T02:10:25.348320+0000","last_unstale":"2024-04-25T02:10:25.355327+0000","last_undegraded":"2024-04-25T02:10:25.355327+0000","last_fullsized":"2024-04-25T02:10:25.355327+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:55:56.306078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.342810+0000","last_change":"2024-04-25T02:10:25.342810+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.342810+0000","last_undegraded":"2024-04-25T02:10:25.342810+0000","last_fullsized":"2024-04-25T02:10:25.342810+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.356218+0000","last_change":"2024-04-25T02:10:25.354398+0000","last_active":"2024-04-25T02:10:25.356218+0000","last_peered":"2024-04-25T02:10:25.356218+0000","last_clean":"2024-04-25T02:10:25.356218+0000","last_became_active":"2024-04-25T02:10:25.354135+0000","last_became_peered":"2024-04-25T02:10:25.354135+0000","last_unstale":"2024-04-25T02:10:25.356218+0000","last_undegraded":"2024-04-25T02:10:25.356218+0000","last_fullsized":"2024-04-25T02:10:25.356218+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:24.529205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341817+0000","last_change":"2024-04-25T02:10:25.341817+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341817+0000","last_undegraded":"2024-04-25T02:10:25.341817+0000","last_fullsized":"2024-04-25T02:10:25.341817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.350692+0000","last_change":"2024-04-25T02:10:25.347600+0000","last_active":"2024-04-25T02:10:25.350692+0000","last_peered":"2024-04-25T02:10:25.350692+0000","last_clean":"2024-04-25T02:10:25.350692+0000","last_became_active":"2024-04-25T02:10:25.347353+0000","last_became_peered":"2024-04-25T02:10:25.347353+0000","last_unstale":"2024-04-25T02:10:25.350692+0000","last_undegraded":"2024-04-25T02:10:25.350692+0000","last_fullsized":"2024-04-25T02:10:25.350692+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:51.037405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.345800+0000","last_change":"2024-04-25T02:10:25.345800+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.345800+0000","last_undegraded":"2024-04-25T02:10:25.345800+0000","last_fullsized":"2024-04-25T02:10:25.345800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355405+0000","last_change":"2024-04-25T02:10:25.351874+0000","last_active":"2024-04-25T02:10:25.355405+0000","last_peered":"2024-04-25T02:10:25.355405+0000","last_clean":"2024-04-25T02:10:25.355405+0000","last_became_active":"2024-04-25T02:10:25.351587+0000","last_became_peered":"2024-04-25T02:10:25.351587+0000","last_unstale":"2024-04-25T02:10:25.355405+0000","last_undegraded":"2024-04-25T02:10:25.355405+0000","last_fullsized":"2024-04-25T02:10:25.355405+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:56.566118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.339177+0000","last_change":"2024-04-25T02:10:25.339177+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.339177+0000","last_undegraded":"2024-04-25T02:10:25.339177+0000","last_fullsized":"2024-04-25T02:10:25.339177+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.350663+0000","last_change":"2024-04-25T02:10:25.346645+0000","last_active":"2024-04-25T02:10:25.350663+0000","last_peered":"2024-04-25T02:10:25.350663+0000","last_clean":"2024-04-25T02:10:25.350663+0000","last_became_active":"2024-04-25T02:10:25.346395+0000","last_became_peered":"2024-04-25T02:10:25.346395+0000","last_unstale":"2024-04-25T02:10:25.350663+0000","last_undegraded":"2024-04-25T02:10:25.350663+0000","last_fullsized":"2024-04-25T02:10:25.350663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:09:47.651953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341566+0000","last_change":"2024-04-25T02:10:25.341566+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341566+0000","last_undegraded":"2024-04-25T02:10:25.341566+0000","last_fullsized":"2024-04-25T02:10:25.341566+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.352509+0000","last_change":"2024-04-25T02:10:25.349386+0000","last_active":"2024-04-25T02:10:25.352509+0000","last_peered":"2024-04-25T02:10:25.352509+0000","last_clean":"2024-04-25T02:10:25.352509+0000","last_became_active":"2024-04-25T02:10:25.348888+0000","last_became_peered":"2024-04-25T02:10:25.348888+0000","last_unstale":"2024-04-25T02:10:25.352509+0000","last_undegraded":"2024-04-25T02:10:25.352509+0000","last_fullsized":"2024-04-25T02:10:25.352509+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:20:35.902100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-25T02:10:25.341065+0000","last_change":"2024-04-25T02:10:25.341065+0000","last_active":"2024-04-25T02:10:25.330336+0000","last_peered":"2024-04-25T02:10:25.330336+0000","last_clean":"2024-04-25T02:10:25.330336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:25.341065+0000","last_undegraded":"2024-04-25T02:10:25.341065+0000","last_fullsized":"2024-04-25T02:10:25.341065+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.355648+0000","last_change":"2024-04-25T02:10:25.352598+0000","last_active":"2024-04-25T02:10:25.355648+0000","last_peered":"2024-04-25T02:10:25.355648+0000","last_clean":"2024-04-25T02:10:25.355648+0000","last_became_active":"2024-04-25T02:10:25.352292+0000","last_became_peered":"2024-04-25T02:10:25.352292+0000","last_unstale":"2024-04-25T02:10:25.355648+0000","last_undegraded":"2024-04-25T02:10:25.355648+0000","last_fullsized":"2024-04-25T02:10:25.355648+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:09.166741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":234,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T02:10:25.350173+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:10:25.350173+0000","last_peered":"2024-04-25T02:10:25.350173+0000","last_clean":"2024-04-25T02:10:25.350173+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:10:25.350173+0000","last_undegraded":"2024-04-25T02:10:25.350173+0000","last_fullsized":"2024-04-25T02:10:25.350173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1277952,"data_stored":870893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":274258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":280525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":1277952,"data_stored":870893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:10:31.605 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-04-25T02:10:31.598+0000 7fb992853640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:10:33.689 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:10:33.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.789+0000 7fb80d641640 1 Processor -- start 2024-04-25T02:10:33.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.789+0000 7fb80d641640 1 -- start start 2024-04-25T02:10:33.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.790+0000 7fb80d641640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb80815e4d0 0x7fb80806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:33.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.790+0000 7fb80d641640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8080d2e20 0x7fb8080cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:33.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.790+0000 7fb80d641640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8080d1660 con 0x7fb8080b3570 2024-04-25T02:10:33.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.790+0000 7fb80d641640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb8080d1380 con 0x7fb80815e4d0 2024-04-25T02:10:33.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.790+0000 7fb80d641640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb8080cede0 con 0x7fb8080d2e20 2024-04-25T02:10:33.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.790+0000 7fb8067fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb8080b3570 0x7fb8080d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38022/0 (socket says 172.21.15.79:38022) 2024-04-25T02:10:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.790+0000 7fb8067fc640 1 -- 172.21.15.79:0/1997729655 learned_addr learned my addr 172.21.15.79:0/1997729655 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.790+0000 7fb8077fe640 1 --2- 172.21.15.79:0/1997729655 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8080d2e20 0x7fb8080cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.790+0000 7fb806ffd640 1 --2- 172.21.15.79:0/1997729655 >> v2:172.21.15.189:3300/0 conn(0x7fb80815e4d0 0x7fb80806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 -- 172.21.15.79:0/1997729655 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1882998746 0 0) 0x7fb8080d1660 con 0x7fb8080b3570 2024-04-25T02:10:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 -- 172.21.15.79:0/1997729655 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7f0003520 con 0x7fb8080b3570 2024-04-25T02:10:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 -- 172.21.15.79:0/1997729655 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3093280495 0 0) 0x7fb7f0003520 con 0x7fb8080b3570 2024-04-25T02:10:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 -- 172.21.15.79:0/1997729655 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8080d2e20 msgr2=0x7fb8080cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 --2- 172.21.15.79:0/1997729655 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8080d2e20 0x7fb8080cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 -- 172.21.15.79:0/1997729655 >> v2:172.21.15.189:3300/0 conn(0x7fb80815e4d0 msgr2=0x7fb80806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 --2- 172.21.15.79:0/1997729655 >> v2:172.21.15.189:3300/0 conn(0x7fb80815e4d0 0x7fb80806bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 -- 172.21.15.79:0/1997729655 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8080cf0c0 con 0x7fb8080b3570 2024-04-25T02:10:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 -- 172.21.15.79:0/1997729655 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fb7fc001670 con 0x7fb8080b3570 2024-04-25T02:10:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb806ffd640 1 --2- 172.21.15.79:0/1997729655 >> v2:172.21.15.189:3300/0 conn(0x7fb80815e4d0 0x7fb80806bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 -- 172.21.15.79:0/1997729655 >> v1:172.21.15.79:6789/0 conn(0x7fb8080b3570 legacy=0x7fb8080d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 --2- 172.21.15.79:0/1997729655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7f00039b0 0x7fb7f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:33.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 --2- 172.21.15.79:0/1997729655 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8080d2e20 0x7fb7f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:33.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 --2- 172.21.15.79:0/1997729655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7f0004d40 0x7fb7f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:33.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 -- 172.21.15.79:0/1997729655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb8080d1380 con 0x7fb7f0004d40 2024-04-25T02:10:33.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 -- 172.21.15.79:0/1997729655 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8080cede0 con 0x7fb7f00039b0 2024-04-25T02:10:33.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb805ffb640 1 -- 172.21.15.79:0/1997729655 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f000b9c0 con 0x7fb8080d2e20 2024-04-25T02:10:33.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb8077fe640 1 --2- 172.21.15.79:0/1997729655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7f0004d40 0x7fb7f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:33.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb806ffd640 1 --2- 172.21.15.79:0/1997729655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7f00039b0 0x7fb7f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:33.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb8067fc640 1 --2- 172.21.15.79:0/1997729655 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8080d2e20 0x7fb7f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:33.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb8077fe640 1 -- 172.21.15.79:0/1997729655 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8080d2e20 msgr2=0x7fb7f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:33.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb8077fe640 1 --2- 172.21.15.79:0/1997729655 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8080d2e20 0x7fb7f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:33.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb8077fe640 1 -- 172.21.15.79:0/1997729655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7f00039b0 msgr2=0x7fb7f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:33.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb8077fe640 1 --2- 172.21.15.79:0/1997729655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7f00039b0 0x7fb7f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:33.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb8077fe640 1 -- 172.21.15.79:0/1997729655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f0003520 con 0x7fb7f0004d40 2024-04-25T02:10:33.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.791+0000 7fb8067fc640 1 --2- 172.21.15.79:0/1997729655 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8080d2e20 0x7fb7f0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:33.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.792+0000 7fb8077fe640 1 --2- 172.21.15.79:0/1997729655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7f0004d40 0x7fb7f00051c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb808163140 tx=0x7fb7f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f448ea79f0d14c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:33.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.792+0000 7fb805ffb640 1 -- 172.21.15.79:0/1997729655 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb800036070 con 0x7fb7f0004d40 2024-04-25T02:10:33.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.792+0000 7fb805ffb640 1 -- 172.21.15.79:0/1997729655 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb800031400 con 0x7fb7f0004d40 2024-04-25T02:10:33.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.792+0000 7fb805ffb640 1 -- 172.21.15.79:0/1997729655 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb800009690 con 0x7fb7f0004d40 2024-04-25T02:10:33.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.793+0000 7fb80d641640 1 -- 172.21.15.79:0/1997729655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7f0004d40 msgr2=0x7fb7f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:33.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.793+0000 7fb80d641640 1 --2- 172.21.15.79:0/1997729655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7f0004d40 0x7fb7f00051c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb808163140 tx=0x7fb7f0005830 comp rx=0 tx=0).stop 2024-04-25T02:10:33.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.793+0000 7fb8077fe640 1 -- 172.21.15.79:0/1997729655 reap_dead start 2024-04-25T02:10:33.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.793+0000 7fb80d641640 1 -- 172.21.15.79:0/1997729655 shutdown_connections 2024-04-25T02:10:33.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.793+0000 7fb80d641640 1 -- 172.21.15.79:0/1997729655 >> 172.21.15.79:0/1997729655 conn(0x7fb80809d460 msgr2=0x7fb8080d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:33.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.793+0000 7fb80d641640 1 -- 172.21.15.79:0/1997729655 shutdown_connections 2024-04-25T02:10:33.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.793+0000 7fb80d641640 1 -- 172.21.15.79:0/1997729655 wait complete. 2024-04-25T02:10:33.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.794+0000 7fb80d641640 1 Processor -- start 2024-04-25T02:10:33.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.794+0000 7fb80d641640 1 -- start start 2024-04-25T02:10:33.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb80d641640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb80814f450 0x7fb8080a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:33.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb80d641640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8080a0bb0 0x7fb808160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb80d641640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8081608b0 0x7fb808159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb80d641640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb8080d2250 con 0x7fb80814f450 2024-04-25T02:10:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb80d641640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8080d20d0 con 0x7fb8080a0bb0 2024-04-25T02:10:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb80d641640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb80806c1b0 con 0x7fb8081608b0 2024-04-25T02:10:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb806ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb80814f450 0x7fb8080a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb806ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb80814f450 0x7fb8080a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40266/0 (socket says 172.21.15.79:40266) 2024-04-25T02:10:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb806ffd640 1 -- 172.21.15.79:0/147734754 learned_addr learned my addr 172.21.15.79:0/147734754 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb806ffd640 1 -- 172.21.15.79:0/147734754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8081608b0 msgr2=0x7fb808159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb8077fe640 1 --2- 172.21.15.79:0/147734754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8081608b0 0x7fb808159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb8067fc640 1 --2- 172.21.15.79:0/147734754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8080a0bb0 0x7fb808160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb806ffd640 1 --2- 172.21.15.79:0/147734754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8081608b0 0x7fb808159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb806ffd640 1 -- 172.21.15.79:0/147734754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8080a0bb0 msgr2=0x7fb808160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb806ffd640 1 --2- 172.21.15.79:0/147734754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8080a0bb0 0x7fb808160370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb806ffd640 1 -- 172.21.15.79:0/147734754 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8080a1130 con 0x7fb80814f450 2024-04-25T02:10:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.795+0000 7fb8067fc640 1 --2- 172.21.15.79:0/147734754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8080a0bb0 0x7fb808160370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.796+0000 7fb806ffd640 1 --2- 172.21.15.79:0/147734754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb80814f450 0x7fb8080a0670 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800f490 tx=0x7fb7f800f950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.796+0000 7fb7ef7fe640 1 -- 172.21.15.79:0/147734754 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8003b90 con 0x7fb80814f450 2024-04-25T02:10:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.796+0000 7fb7ef7fe640 1 -- 172.21.15.79:0/147734754 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f8003d50 con 0x7fb80814f450 2024-04-25T02:10:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.796+0000 7fb80d641640 1 -- 172.21.15.79:0/147734754 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8080a1410 con 0x7fb80814f450 2024-04-25T02:10:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.796+0000 7fb7ef7fe640 1 -- 172.21.15.79:0/147734754 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8004270 con 0x7fb80814f450 2024-04-25T02:10:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.796+0000 7fb80d641640 1 -- 172.21.15.79:0/147734754 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8080a19d0 con 0x7fb80814f450 2024-04-25T02:10:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.797+0000 7fb80d641640 1 -- 172.21.15.79:0/147734754 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8080690a0 con 0x7fb80814f450 2024-04-25T02:10:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.797+0000 7fb7ef7fe640 1 -- 172.21.15.79:0/147734754 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7f8004410 con 0x7fb80814f450 2024-04-25T02:10:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.798+0000 7fb7ef7fe640 1 --2- 172.21.15.79:0/147734754 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7f406be30 0x7fb7f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.798+0000 7fb7ef7fe640 1 -- 172.21.15.79:0/147734754 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fb7f808bf10 con 0x7fb80814f450 2024-04-25T02:10:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.798+0000 7fb8067fc640 1 --2- 172.21.15.79:0/147734754 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7f406be30 0x7fb7f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.798+0000 7fb8067fc640 1 --2- 172.21.15.79:0/147734754 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7f406be30 0x7fb7f406e2f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc001bf0 tx=0x7fb7fc001b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:33.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.802+0000 7fb7ef7fe640 1 -- 172.21.15.79:0/147734754 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb7f8019070 con 0x7fb80814f450 2024-04-25T02:10:33.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.970+0000 7fb80d641640 1 -- 172.21.15.79:0/147734754 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb8080d1920 con 0x7fb7f406be30 2024-04-25T02:10:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.976+0000 7fb7ef7fe640 1 -- 172.21.15.79:0/147734754 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251955 (secure 0 0 0) 0x7fb8080d1920 con 0x7fb7f406be30 2024-04-25T02:10:33.986 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:33.987 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:10:33.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.979+0000 7fb80d641640 1 -- 172.21.15.79:0/147734754 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7f406be30 msgr2=0x7fb7f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:33.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.979+0000 7fb80d641640 1 --2- 172.21.15.79:0/147734754 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7f406be30 0x7fb7f406e2f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc001bf0 tx=0x7fb7fc001b60 comp rx=0 tx=0).stop 2024-04-25T02:10:33.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.979+0000 7fb80d641640 1 -- 172.21.15.79:0/147734754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb80814f450 msgr2=0x7fb8080a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:33.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.979+0000 7fb80d641640 1 --2- 172.21.15.79:0/147734754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb80814f450 0x7fb8080a0670 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800f490 tx=0x7fb7f800f950 comp rx=0 tx=0).stop 2024-04-25T02:10:33.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.979+0000 7fb80d641640 1 -- 172.21.15.79:0/147734754 shutdown_connections 2024-04-25T02:10:33.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.979+0000 7fb80d641640 1 --2- 172.21.15.79:0/147734754 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7f406be30 0x7fb7f406e2f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:33.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.979+0000 7fb80d641640 1 --2- 172.21.15.79:0/147734754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8081608b0 0x7fb808159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:33.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.979+0000 7fb80d641640 1 --2- 172.21.15.79:0/147734754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8080a0bb0 0x7fb808160370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:33.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.979+0000 7fb80d641640 1 --2- 172.21.15.79:0/147734754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb80814f450 0x7fb8080a0670 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:33.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.979+0000 7fb80d641640 1 -- 172.21.15.79:0/147734754 >> 172.21.15.79:0/147734754 conn(0x7fb80809d460 msgr2=0x7fb80815fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:33.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.979+0000 7fb80d641640 1 -- 172.21.15.79:0/147734754 shutdown_connections 2024-04-25T02:10:33.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:33.979+0000 7fb80d641640 1 -- 172.21.15.79:0/147734754 wait complete. 2024-04-25T02:10:33.997 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-04-25T02:10:33.204361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227088,"kb_used_data":6760,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747632,"statfs":{"total":773094113280,"available":772861575168,"internally_reserved":0,"allocated":6922240,"data_stored":3534356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.869059"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835037+0000","last_change":"2024-04-25T02:10:26.347437+0000","last_active":"2024-04-25T02:10:27.835037+0000","last_peered":"2024-04-25T02:10:27.835037+0000","last_clean":"2024-04-25T02:10:27.835037+0000","last_became_active":"2024-04-25T02:10:26.347169+0000","last_became_peered":"2024-04-25T02:10:26.347169+0000","last_unstale":"2024-04-25T02:10:27.835037+0000","last_undegraded":"2024-04-25T02:10:27.835037+0000","last_fullsized":"2024-04-25T02:10:27.835037+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:38.851920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835723+0000","last_change":"2024-04-25T02:10:26.357333+0000","last_active":"2024-04-25T02:10:27.835723+0000","last_peered":"2024-04-25T02:10:27.835723+0000","last_clean":"2024-04-25T02:10:27.835723+0000","last_became_active":"2024-04-25T02:10:26.356659+0000","last_became_peered":"2024-04-25T02:10:26.356659+0000","last_unstale":"2024-04-25T02:10:27.835723+0000","last_undegraded":"2024-04-25T02:10:27.835723+0000","last_fullsized":"2024-04-25T02:10:27.835723+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:05.490812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835731+0000","last_change":"2024-04-25T02:10:26.359068+0000","last_active":"2024-04-25T02:10:27.835731+0000","last_peered":"2024-04-25T02:10:27.835731+0000","last_clean":"2024-04-25T02:10:27.835731+0000","last_became_active":"2024-04-25T02:10:26.358743+0000","last_became_peered":"2024-04-25T02:10:26.358743+0000","last_unstale":"2024-04-25T02:10:27.835731+0000","last_undegraded":"2024-04-25T02:10:27.835731+0000","last_fullsized":"2024-04-25T02:10:27.835731+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:29.306920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.353961+0000","last_change":"2024-04-25T02:10:26.348154+0000","last_active":"2024-04-25T02:10:27.353961+0000","last_peered":"2024-04-25T02:10:27.353961+0000","last_clean":"2024-04-25T02:10:27.353961+0000","last_became_active":"2024-04-25T02:10:26.347880+0000","last_became_peered":"2024-04-25T02:10:26.347880+0000","last_unstale":"2024-04-25T02:10:27.353961+0000","last_undegraded":"2024-04-25T02:10:27.353961+0000","last_fullsized":"2024-04-25T02:10:27.353961+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:28.122901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835350+0000","last_change":"2024-04-25T02:10:26.351212+0000","last_active":"2024-04-25T02:10:27.835350+0000","last_peered":"2024-04-25T02:10:27.835350+0000","last_clean":"2024-04-25T02:10:27.835350+0000","last_became_active":"2024-04-25T02:10:26.350848+0000","last_became_peered":"2024-04-25T02:10:26.350848+0000","last_unstale":"2024-04-25T02:10:27.835350+0000","last_undegraded":"2024-04-25T02:10:27.835350+0000","last_fullsized":"2024-04-25T02:10:27.835350+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:32.500626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835159+0000","last_change":"2024-04-25T02:10:26.359729+0000","last_active":"2024-04-25T02:10:27.835159+0000","last_peered":"2024-04-25T02:10:27.835159+0000","last_clean":"2024-04-25T02:10:27.835159+0000","last_became_active":"2024-04-25T02:10:26.359472+0000","last_became_peered":"2024-04-25T02:10:26.359472+0000","last_unstale":"2024-04-25T02:10:27.835159+0000","last_undegraded":"2024-04-25T02:10:27.835159+0000","last_fullsized":"2024-04-25T02:10:27.835159+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:23:39.674469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.353586+0000","last_change":"2024-04-25T02:10:26.349199+0000","last_active":"2024-04-25T02:10:27.353586+0000","last_peered":"2024-04-25T02:10:27.353586+0000","last_clean":"2024-04-25T02:10:27.353586+0000","last_became_active":"2024-04-25T02:10:26.348946+0000","last_became_peered":"2024-04-25T02:10:26.348946+0000","last_unstale":"2024-04-25T02:10:27.353586+0000","last_undegraded":"2024-04-25T02:10:27.353586+0000","last_fullsized":"2024-04-25T02:10:27.353586+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:34.334169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.834871+0000","last_change":"2024-04-25T02:10:26.353728+0000","last_active":"2024-04-25T02:10:27.834871+0000","last_peered":"2024-04-25T02:10:27.834871+0000","last_clean":"2024-04-25T02:10:27.834871+0000","last_became_active":"2024-04-25T02:10:26.352489+0000","last_became_peered":"2024-04-25T02:10:26.352489+0000","last_unstale":"2024-04-25T02:10:27.834871+0000","last_undegraded":"2024-04-25T02:10:27.834871+0000","last_fullsized":"2024-04-25T02:10:27.834871+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:52:11.157277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354315+0000","last_change":"2024-04-25T02:10:26.359383+0000","last_active":"2024-04-25T02:10:27.354315+0000","last_peered":"2024-04-25T02:10:27.354315+0000","last_clean":"2024-04-25T02:10:27.354315+0000","last_became_active":"2024-04-25T02:10:26.359064+0000","last_became_peered":"2024-04-25T02:10:26.359064+0000","last_unstale":"2024-04-25T02:10:27.354315+0000","last_undegraded":"2024-04-25T02:10:27.354315+0000","last_fullsized":"2024-04-25T02:10:27.354315+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:57.660537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.355088+0000","last_change":"2024-04-25T02:10:26.354324+0000","last_active":"2024-04-25T02:10:27.355088+0000","last_peered":"2024-04-25T02:10:27.355088+0000","last_clean":"2024-04-25T02:10:27.355088+0000","last_became_active":"2024-04-25T02:10:26.354063+0000","last_became_peered":"2024-04-25T02:10:26.354063+0000","last_unstale":"2024-04-25T02:10:27.355088+0000","last_undegraded":"2024-04-25T02:10:27.355088+0000","last_fullsized":"2024-04-25T02:10:27.355088+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:09.959309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.355281+0000","last_change":"2024-04-25T02:10:26.357931+0000","last_active":"2024-04-25T02:10:27.355281+0000","last_peered":"2024-04-25T02:10:27.355281+0000","last_clean":"2024-04-25T02:10:27.355281+0000","last_became_active":"2024-04-25T02:10:26.357681+0000","last_became_peered":"2024-04-25T02:10:26.357681+0000","last_unstale":"2024-04-25T02:10:27.355281+0000","last_undegraded":"2024-04-25T02:10:27.355281+0000","last_fullsized":"2024-04-25T02:10:27.355281+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:51.683262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354114+0000","last_change":"2024-04-25T02:10:26.356190+0000","last_active":"2024-04-25T02:10:27.354114+0000","last_peered":"2024-04-25T02:10:27.354114+0000","last_clean":"2024-04-25T02:10:27.354114+0000","last_became_active":"2024-04-25T02:10:26.355925+0000","last_became_peered":"2024-04-25T02:10:26.355925+0000","last_unstale":"2024-04-25T02:10:27.354114+0000","last_undegraded":"2024-04-25T02:10:27.354114+0000","last_fullsized":"2024-04-25T02:10:27.354114+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:57:22.948257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835379+0000","last_change":"2024-04-25T02:10:26.360137+0000","last_active":"2024-04-25T02:10:27.835379+0000","last_peered":"2024-04-25T02:10:27.835379+0000","last_clean":"2024-04-25T02:10:27.835379+0000","last_became_active":"2024-04-25T02:10:26.359861+0000","last_became_peered":"2024-04-25T02:10:26.359861+0000","last_unstale":"2024-04-25T02:10:27.835379+0000","last_undegraded":"2024-04-25T02:10:27.835379+0000","last_fullsized":"2024-04-25T02:10:27.835379+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:49.648237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354475+0000","last_change":"2024-04-25T02:10:26.356443+0000","last_active":"2024-04-25T02:10:27.354475+0000","last_peered":"2024-04-25T02:10:27.354475+0000","last_clean":"2024-04-25T02:10:27.354475+0000","last_became_active":"2024-04-25T02:10:26.356173+0000","last_became_peered":"2024-04-25T02:10:26.356173+0000","last_unstale":"2024-04-25T02:10:27.354475+0000","last_undegraded":"2024-04-25T02:10:27.354475+0000","last_fullsized":"2024-04-25T02:10:27.354475+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:20:36.906850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.353825+0000","last_change":"2024-04-25T02:10:26.352679+0000","last_active":"2024-04-25T02:10:27.353825+0000","last_peered":"2024-04-25T02:10:27.353825+0000","last_clean":"2024-04-25T02:10:27.353825+0000","last_became_active":"2024-04-25T02:10:26.352046+0000","last_became_peered":"2024-04-25T02:10:26.352046+0000","last_unstale":"2024-04-25T02:10:27.353825+0000","last_undegraded":"2024-04-25T02:10:27.353825+0000","last_fullsized":"2024-04-25T02:10:27.353825+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:10.195031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835508+0000","last_change":"2024-04-25T02:10:26.361059+0000","last_active":"2024-04-25T02:10:27.835508+0000","last_peered":"2024-04-25T02:10:27.835508+0000","last_clean":"2024-04-25T02:10:27.835508+0000","last_became_active":"2024-04-25T02:10:26.359736+0000","last_became_peered":"2024-04-25T02:10:26.359736+0000","last_unstale":"2024-04-25T02:10:27.835508+0000","last_undegraded":"2024-04-25T02:10:27.835508+0000","last_fullsized":"2024-04-25T02:10:27.835508+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:27.836239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835256+0000","last_change":"2024-04-25T02:10:26.354385+0000","last_active":"2024-04-25T02:10:27.835256+0000","last_peered":"2024-04-25T02:10:27.835256+0000","last_clean":"2024-04-25T02:10:27.835256+0000","last_became_active":"2024-04-25T02:10:26.354106+0000","last_became_peered":"2024-04-25T02:10:26.354106+0000","last_unstale":"2024-04-25T02:10:27.835256+0000","last_undegraded":"2024-04-25T02:10:27.835256+0000","last_fullsized":"2024-04-25T02:10:27.835256+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:20.161111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835702+0000","last_change":"2024-04-25T02:10:26.366688+0000","last_active":"2024-04-25T02:10:27.835702+0000","last_peered":"2024-04-25T02:10:27.835702+0000","last_clean":"2024-04-25T02:10:27.835702+0000","last_became_active":"2024-04-25T02:10:26.366374+0000","last_became_peered":"2024-04-25T02:10:26.366374+0000","last_unstale":"2024-04-25T02:10:27.835702+0000","last_undegraded":"2024-04-25T02:10:27.835702+0000","last_fullsized":"2024-04-25T02:10:27.835702+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:29:39.717336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.834877+0000","last_change":"2024-04-25T02:10:26.347405+0000","last_active":"2024-04-25T02:10:27.834877+0000","last_peered":"2024-04-25T02:10:27.834877+0000","last_clean":"2024-04-25T02:10:27.834877+0000","last_became_active":"2024-04-25T02:10:26.347146+0000","last_became_peered":"2024-04-25T02:10:26.347146+0000","last_unstale":"2024-04-25T02:10:27.834877+0000","last_undegraded":"2024-04-25T02:10:27.834877+0000","last_fullsized":"2024-04-25T02:10:27.834877+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:15:08.496495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835269+0000","last_change":"2024-04-25T02:10:26.363968+0000","last_active":"2024-04-25T02:10:27.835269+0000","last_peered":"2024-04-25T02:10:27.835269+0000","last_clean":"2024-04-25T02:10:27.835269+0000","last_became_active":"2024-04-25T02:10:26.363338+0000","last_became_peered":"2024-04-25T02:10:26.363338+0000","last_unstale":"2024-04-25T02:10:27.835269+0000","last_undegraded":"2024-04-25T02:10:27.835269+0000","last_fullsized":"2024-04-25T02:10:27.835269+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:41:28.348390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835694+0000","last_change":"2024-04-25T02:10:26.361149+0000","last_active":"2024-04-25T02:10:27.835694+0000","last_peered":"2024-04-25T02:10:27.835694+0000","last_clean":"2024-04-25T02:10:27.835694+0000","last_became_active":"2024-04-25T02:10:26.360352+0000","last_became_peered":"2024-04-25T02:10:26.360352+0000","last_unstale":"2024-04-25T02:10:27.835694+0000","last_undegraded":"2024-04-25T02:10:27.835694+0000","last_fullsized":"2024-04-25T02:10:27.835694+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:25:00.103393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835161+0000","last_change":"2024-04-25T02:10:26.357003+0000","last_active":"2024-04-25T02:10:27.835161+0000","last_peered":"2024-04-25T02:10:27.835161+0000","last_clean":"2024-04-25T02:10:27.835161+0000","last_became_active":"2024-04-25T02:10:26.356720+0000","last_became_peered":"2024-04-25T02:10:26.356720+0000","last_unstale":"2024-04-25T02:10:27.835161+0000","last_undegraded":"2024-04-25T02:10:27.835161+0000","last_fullsized":"2024-04-25T02:10:27.835161+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:14.889344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835174+0000","last_change":"2024-04-25T02:10:26.364589+0000","last_active":"2024-04-25T02:10:27.835174+0000","last_peered":"2024-04-25T02:10:27.835174+0000","last_clean":"2024-04-25T02:10:27.835174+0000","last_became_active":"2024-04-25T02:10:26.364336+0000","last_became_peered":"2024-04-25T02:10:26.364336+0000","last_unstale":"2024-04-25T02:10:27.835174+0000","last_undegraded":"2024-04-25T02:10:27.835174+0000","last_fullsized":"2024-04-25T02:10:27.835174+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:28.122901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835114+0000","last_change":"2024-04-25T02:10:26.361193+0000","last_active":"2024-04-25T02:10:27.835114+0000","last_peered":"2024-04-25T02:10:27.835114+0000","last_clean":"2024-04-25T02:10:27.835114+0000","last_became_active":"2024-04-25T02:10:26.360875+0000","last_became_peered":"2024-04-25T02:10:26.360875+0000","last_unstale":"2024-04-25T02:10:27.835114+0000","last_undegraded":"2024-04-25T02:10:27.835114+0000","last_fullsized":"2024-04-25T02:10:27.835114+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:51.683262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835186+0000","last_change":"2024-04-25T02:10:26.352443+0000","last_active":"2024-04-25T02:10:27.835186+0000","last_peered":"2024-04-25T02:10:27.835186+0000","last_clean":"2024-04-25T02:10:27.835186+0000","last_became_active":"2024-04-25T02:10:26.352181+0000","last_became_peered":"2024-04-25T02:10:26.352181+0000","last_unstale":"2024-04-25T02:10:27.835186+0000","last_undegraded":"2024-04-25T02:10:27.835186+0000","last_fullsized":"2024-04-25T02:10:27.835186+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:30.778328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354407+0000","last_change":"2024-04-25T02:10:26.356418+0000","last_active":"2024-04-25T02:10:27.354407+0000","last_peered":"2024-04-25T02:10:27.354407+0000","last_clean":"2024-04-25T02:10:27.354407+0000","last_became_active":"2024-04-25T02:10:26.356161+0000","last_became_peered":"2024-04-25T02:10:26.356161+0000","last_unstale":"2024-04-25T02:10:27.354407+0000","last_undegraded":"2024-04-25T02:10:27.354407+0000","last_fullsized":"2024-04-25T02:10:27.354407+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:29:39.717336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835603+0000","last_change":"2024-04-25T02:10:26.358302+0000","last_active":"2024-04-25T02:10:27.835603+0000","last_peered":"2024-04-25T02:10:27.835603+0000","last_clean":"2024-04-25T02:10:27.835603+0000","last_became_active":"2024-04-25T02:10:26.358014+0000","last_became_peered":"2024-04-25T02:10:26.358014+0000","last_unstale":"2024-04-25T02:10:27.835603+0000","last_undegraded":"2024-04-25T02:10:27.835603+0000","last_fullsized":"2024-04-25T02:10:27.835603+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:42:49.878270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.836116+0000","last_change":"2024-04-25T02:10:26.351100+0000","last_active":"2024-04-25T02:10:27.836116+0000","last_peered":"2024-04-25T02:10:27.836116+0000","last_clean":"2024-04-25T02:10:27.836116+0000","last_became_active":"2024-04-25T02:10:26.348385+0000","last_became_peered":"2024-04-25T02:10:26.348385+0000","last_unstale":"2024-04-25T02:10:27.836116+0000","last_undegraded":"2024-04-25T02:10:27.836116+0000","last_fullsized":"2024-04-25T02:10:27.836116+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:11.814258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.836235+0000","last_change":"2024-04-25T02:10:26.362848+0000","last_active":"2024-04-25T02:10:27.836235+0000","last_peered":"2024-04-25T02:10:27.836235+0000","last_clean":"2024-04-25T02:10:27.836235+0000","last_became_active":"2024-04-25T02:10:26.362422+0000","last_became_peered":"2024-04-25T02:10:26.362422+0000","last_unstale":"2024-04-25T02:10:27.836235+0000","last_undegraded":"2024-04-25T02:10:27.836235+0000","last_fullsized":"2024-04-25T02:10:27.836235+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:56.213464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835100+0000","last_change":"2024-04-25T02:10:26.352705+0000","last_active":"2024-04-25T02:10:27.835100+0000","last_peered":"2024-04-25T02:10:27.835100+0000","last_clean":"2024-04-25T02:10:27.835100+0000","last_became_active":"2024-04-25T02:10:26.352436+0000","last_became_peered":"2024-04-25T02:10:26.352436+0000","last_unstale":"2024-04-25T02:10:27.835100+0000","last_undegraded":"2024-04-25T02:10:27.835100+0000","last_fullsized":"2024-04-25T02:10:27.835100+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:17:17.271757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.834762+0000","last_change":"2024-04-25T02:10:26.351807+0000","last_active":"2024-04-25T02:10:27.834762+0000","last_peered":"2024-04-25T02:10:27.834762+0000","last_clean":"2024-04-25T02:10:27.834762+0000","last_became_active":"2024-04-25T02:10:26.351519+0000","last_became_peered":"2024-04-25T02:10:26.351519+0000","last_unstale":"2024-04-25T02:10:27.834762+0000","last_undegraded":"2024-04-25T02:10:27.834762+0000","last_fullsized":"2024-04-25T02:10:27.834762+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:01:28.533246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835612+0000","last_change":"2024-04-25T02:10:26.360047+0000","last_active":"2024-04-25T02:10:27.835612+0000","last_peered":"2024-04-25T02:10:27.835612+0000","last_clean":"2024-04-25T02:10:27.835612+0000","last_became_active":"2024-04-25T02:10:26.359454+0000","last_became_peered":"2024-04-25T02:10:26.359454+0000","last_unstale":"2024-04-25T02:10:27.835612+0000","last_undegraded":"2024-04-25T02:10:27.835612+0000","last_fullsized":"2024-04-25T02:10:27.835612+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:24.303462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835921+0000","last_change":"2024-04-25T02:10:26.366196+0000","last_active":"2024-04-25T02:10:27.835921+0000","last_peered":"2024-04-25T02:10:27.835921+0000","last_clean":"2024-04-25T02:10:27.835921+0000","last_became_active":"2024-04-25T02:10:26.365948+0000","last_became_peered":"2024-04-25T02:10:26.365948+0000","last_unstale":"2024-04-25T02:10:27.835921+0000","last_undegraded":"2024-04-25T02:10:27.835921+0000","last_fullsized":"2024-04-25T02:10:27.835921+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:50.656368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835480+0000","last_change":"2024-04-25T02:10:25.351015+0000","last_active":"2024-04-25T02:10:27.835480+0000","last_peered":"2024-04-25T02:10:27.835480+0000","last_clean":"2024-04-25T02:10:27.835480+0000","last_became_active":"2024-04-25T02:10:25.350729+0000","last_became_peered":"2024-04-25T02:10:25.350729+0000","last_unstale":"2024-04-25T02:10:27.835480+0000","last_undegraded":"2024-04-25T02:10:27.835480+0000","last_fullsized":"2024-04-25T02:10:27.835480+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:58:22.706378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.355172+0000","last_change":"2024-04-25T02:10:26.353108+0000","last_active":"2024-04-25T02:10:27.355172+0000","last_peered":"2024-04-25T02:10:27.355172+0000","last_clean":"2024-04-25T02:10:27.355172+0000","last_became_active":"2024-04-25T02:10:26.352821+0000","last_became_peered":"2024-04-25T02:10:26.352821+0000","last_unstale":"2024-04-25T02:10:27.355172+0000","last_undegraded":"2024-04-25T02:10:27.355172+0000","last_fullsized":"2024-04-25T02:10:27.355172+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:25.533956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835803+0000","last_change":"2024-04-25T02:10:25.355315+0000","last_active":"2024-04-25T02:10:27.835803+0000","last_peered":"2024-04-25T02:10:27.835803+0000","last_clean":"2024-04-25T02:10:27.835803+0000","last_became_active":"2024-04-25T02:10:25.354844+0000","last_became_peered":"2024-04-25T02:10:25.354844+0000","last_unstale":"2024-04-25T02:10:27.835803+0000","last_undegraded":"2024-04-25T02:10:27.835803+0000","last_fullsized":"2024-04-25T02:10:27.835803+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:59.098642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.836134+0000","last_change":"2024-04-25T02:10:26.361314+0000","last_active":"2024-04-25T02:10:27.836134+0000","last_peered":"2024-04-25T02:10:27.836134+0000","last_clean":"2024-04-25T02:10:27.836134+0000","last_became_active":"2024-04-25T02:10:26.361044+0000","last_became_peered":"2024-04-25T02:10:26.361044+0000","last_unstale":"2024-04-25T02:10:27.836134+0000","last_undegraded":"2024-04-25T02:10:27.836134+0000","last_fullsized":"2024-04-25T02:10:27.836134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:18:00.243694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835790+0000","last_change":"2024-04-25T02:10:25.350788+0000","last_active":"2024-04-25T02:10:27.835790+0000","last_peered":"2024-04-25T02:10:27.835790+0000","last_clean":"2024-04-25T02:10:27.835790+0000","last_became_active":"2024-04-25T02:10:25.350527+0000","last_became_peered":"2024-04-25T02:10:25.350527+0000","last_unstale":"2024-04-25T02:10:27.835790+0000","last_undegraded":"2024-04-25T02:10:27.835790+0000","last_fullsized":"2024-04-25T02:10:27.835790+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:33.329419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835679+0000","last_change":"2024-04-25T02:10:26.358270+0000","last_active":"2024-04-25T02:10:27.835679+0000","last_peered":"2024-04-25T02:10:27.835679+0000","last_clean":"2024-04-25T02:10:27.835679+0000","last_became_active":"2024-04-25T02:10:26.357832+0000","last_became_peered":"2024-04-25T02:10:26.357832+0000","last_unstale":"2024-04-25T02:10:27.835679+0000","last_undegraded":"2024-04-25T02:10:27.835679+0000","last_fullsized":"2024-04-25T02:10:27.835679+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:41:15.371766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354204+0000","last_change":"2024-04-25T02:10:25.351435+0000","last_active":"2024-04-25T02:10:27.354204+0000","last_peered":"2024-04-25T02:10:27.354204+0000","last_clean":"2024-04-25T02:10:27.354204+0000","last_became_active":"2024-04-25T02:10:25.351119+0000","last_became_peered":"2024-04-25T02:10:25.351119+0000","last_unstale":"2024-04-25T02:10:27.354204+0000","last_undegraded":"2024-04-25T02:10:27.354204+0000","last_fullsized":"2024-04-25T02:10:27.354204+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:51.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835447+0000","last_change":"2024-04-25T02:10:26.363289+0000","last_active":"2024-04-25T02:10:27.835447+0000","last_peered":"2024-04-25T02:10:27.835447+0000","last_clean":"2024-04-25T02:10:27.835447+0000","last_became_active":"2024-04-25T02:10:26.362488+0000","last_became_peered":"2024-04-25T02:10:26.362488+0000","last_unstale":"2024-04-25T02:10:27.835447+0000","last_undegraded":"2024-04-25T02:10:27.835447+0000","last_fullsized":"2024-04-25T02:10:27.835447+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:52.491291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354018+0000","last_change":"2024-04-25T02:10:25.354878+0000","last_active":"2024-04-25T02:10:27.354018+0000","last_peered":"2024-04-25T02:10:27.354018+0000","last_clean":"2024-04-25T02:10:27.354018+0000","last_became_active":"2024-04-25T02:10:25.354616+0000","last_became_peered":"2024-04-25T02:10:25.354616+0000","last_unstale":"2024-04-25T02:10:27.354018+0000","last_undegraded":"2024-04-25T02:10:27.354018+0000","last_fullsized":"2024-04-25T02:10:27.354018+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:24.529205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.836131+0000","last_change":"2024-04-25T02:10:26.363029+0000","last_active":"2024-04-25T02:10:27.836131+0000","last_peered":"2024-04-25T02:10:27.836131+0000","last_clean":"2024-04-25T02:10:27.836131+0000","last_became_active":"2024-04-25T02:10:26.362654+0000","last_became_peered":"2024-04-25T02:10:26.362654+0000","last_unstale":"2024-04-25T02:10:27.836131+0000","last_undegraded":"2024-04-25T02:10:27.836131+0000","last_fullsized":"2024-04-25T02:10:27.836131+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:57.432233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835244+0000","last_change":"2024-04-25T02:10:25.350576+0000","last_active":"2024-04-25T02:10:27.835244+0000","last_peered":"2024-04-25T02:10:27.835244+0000","last_clean":"2024-04-25T02:10:27.835244+0000","last_became_active":"2024-04-25T02:10:25.350283+0000","last_became_peered":"2024-04-25T02:10:25.350283+0000","last_unstale":"2024-04-25T02:10:27.835244+0000","last_undegraded":"2024-04-25T02:10:27.835244+0000","last_fullsized":"2024-04-25T02:10:27.835244+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:57.294388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835149+0000","last_change":"2024-04-25T02:10:26.347112+0000","last_active":"2024-04-25T02:10:27.835149+0000","last_peered":"2024-04-25T02:10:27.835149+0000","last_clean":"2024-04-25T02:10:27.835149+0000","last_became_active":"2024-04-25T02:10:26.346838+0000","last_became_peered":"2024-04-25T02:10:26.346838+0000","last_unstale":"2024-04-25T02:10:27.835149+0000","last_undegraded":"2024-04-25T02:10:27.835149+0000","last_fullsized":"2024-04-25T02:10:27.835149+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:10.202244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.353892+0000","last_change":"2024-04-25T02:10:25.349482+0000","last_active":"2024-04-25T02:10:27.353892+0000","last_peered":"2024-04-25T02:10:27.353892+0000","last_clean":"2024-04-25T02:10:27.353892+0000","last_became_active":"2024-04-25T02:10:25.349132+0000","last_became_peered":"2024-04-25T02:10:25.349132+0000","last_unstale":"2024-04-25T02:10:27.353892+0000","last_undegraded":"2024-04-25T02:10:27.353892+0000","last_fullsized":"2024-04-25T02:10:27.353892+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:09.197493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835833+0000","last_change":"2024-04-25T02:10:26.357649+0000","last_active":"2024-04-25T02:10:27.835833+0000","last_peered":"2024-04-25T02:10:27.835833+0000","last_clean":"2024-04-25T02:10:27.835833+0000","last_became_active":"2024-04-25T02:10:26.357204+0000","last_became_peered":"2024-04-25T02:10:26.357204+0000","last_unstale":"2024-04-25T02:10:27.835833+0000","last_undegraded":"2024-04-25T02:10:27.835833+0000","last_fullsized":"2024-04-25T02:10:27.835833+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:53.420900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.353974+0000","last_change":"2024-04-25T02:10:25.349816+0000","last_active":"2024-04-25T02:10:27.353974+0000","last_peered":"2024-04-25T02:10:27.353974+0000","last_clean":"2024-04-25T02:10:27.353974+0000","last_became_active":"2024-04-25T02:10:25.349428+0000","last_became_peered":"2024-04-25T02:10:25.349428+0000","last_unstale":"2024-04-25T02:10:27.353974+0000","last_undegraded":"2024-04-25T02:10:27.353974+0000","last_fullsized":"2024-04-25T02:10:27.353974+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:11.861132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354515+0000","last_change":"2024-04-25T02:10:26.351023+0000","last_active":"2024-04-25T02:10:27.354515+0000","last_peered":"2024-04-25T02:10:27.354515+0000","last_clean":"2024-04-25T02:10:27.354515+0000","last_became_active":"2024-04-25T02:10:26.350758+0000","last_became_peered":"2024-04-25T02:10:26.350758+0000","last_unstale":"2024-04-25T02:10:27.354515+0000","last_undegraded":"2024-04-25T02:10:27.354515+0000","last_fullsized":"2024-04-25T02:10:27.354515+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:43.998195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835974+0000","last_change":"2024-04-25T02:10:25.355143+0000","last_active":"2024-04-25T02:10:27.835974+0000","last_peered":"2024-04-25T02:10:27.835974+0000","last_clean":"2024-04-25T02:10:27.835974+0000","last_became_active":"2024-04-25T02:10:25.354873+0000","last_became_peered":"2024-04-25T02:10:25.354873+0000","last_unstale":"2024-04-25T02:10:27.835974+0000","last_undegraded":"2024-04-25T02:10:27.835974+0000","last_fullsized":"2024-04-25T02:10:27.835974+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:17:09.184794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.836001+0000","last_change":"2024-04-25T02:10:26.361521+0000","last_active":"2024-04-25T02:10:27.836001+0000","last_peered":"2024-04-25T02:10:27.836001+0000","last_clean":"2024-04-25T02:10:27.836001+0000","last_became_active":"2024-04-25T02:10:26.361222+0000","last_became_peered":"2024-04-25T02:10:26.361222+0000","last_unstale":"2024-04-25T02:10:27.836001+0000","last_undegraded":"2024-04-25T02:10:27.836001+0000","last_fullsized":"2024-04-25T02:10:27.836001+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:42:49.878270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835902+0000","last_change":"2024-04-25T02:10:25.355103+0000","last_active":"2024-04-25T02:10:27.835902+0000","last_peered":"2024-04-25T02:10:27.835902+0000","last_clean":"2024-04-25T02:10:27.835902+0000","last_became_active":"2024-04-25T02:10:25.354520+0000","last_became_peered":"2024-04-25T02:10:25.354520+0000","last_unstale":"2024-04-25T02:10:27.835902+0000","last_undegraded":"2024-04-25T02:10:27.835902+0000","last_fullsized":"2024-04-25T02:10:27.835902+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:28.302169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.355020+0000","last_change":"2024-04-25T02:10:26.351451+0000","last_active":"2024-04-25T02:10:27.355020+0000","last_peered":"2024-04-25T02:10:27.355020+0000","last_clean":"2024-04-25T02:10:27.355020+0000","last_became_active":"2024-04-25T02:10:26.350693+0000","last_became_peered":"2024-04-25T02:10:26.350693+0000","last_unstale":"2024-04-25T02:10:27.355020+0000","last_undegraded":"2024-04-25T02:10:27.355020+0000","last_fullsized":"2024-04-25T02:10:27.355020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:57.570869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.836036+0000","last_change":"2024-04-25T02:10:25.355693+0000","last_active":"2024-04-25T02:10:27.836036+0000","last_peered":"2024-04-25T02:10:27.836036+0000","last_clean":"2024-04-25T02:10:27.836036+0000","last_became_active":"2024-04-25T02:10:25.355422+0000","last_became_peered":"2024-04-25T02:10:25.355422+0000","last_unstale":"2024-04-25T02:10:27.836036+0000","last_undegraded":"2024-04-25T02:10:27.836036+0000","last_fullsized":"2024-04-25T02:10:27.836036+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.992991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835735+0000","last_change":"2024-04-25T02:10:26.354429+0000","last_active":"2024-04-25T02:10:27.835735+0000","last_peered":"2024-04-25T02:10:27.835735+0000","last_clean":"2024-04-25T02:10:27.835735+0000","last_became_active":"2024-04-25T02:10:26.354131+0000","last_became_peered":"2024-04-25T02:10:26.354131+0000","last_unstale":"2024-04-25T02:10:27.835735+0000","last_undegraded":"2024-04-25T02:10:27.835735+0000","last_fullsized":"2024-04-25T02:10:27.835735+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:24.558512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354320+0000","last_change":"2024-04-25T02:10:25.346359+0000","last_active":"2024-04-25T02:10:27.354320+0000","last_peered":"2024-04-25T02:10:27.354320+0000","last_clean":"2024-04-25T02:10:27.354320+0000","last_became_active":"2024-04-25T02:10:25.346084+0000","last_became_peered":"2024-04-25T02:10:25.346084+0000","last_unstale":"2024-04-25T02:10:27.354320+0000","last_undegraded":"2024-04-25T02:10:27.354320+0000","last_fullsized":"2024-04-25T02:10:27.354320+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:50.678511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.353590+0000","last_change":"2024-04-25T02:10:26.358360+0000","last_active":"2024-04-25T02:10:27.353590+0000","last_peered":"2024-04-25T02:10:27.353590+0000","last_clean":"2024-04-25T02:10:27.353590+0000","last_became_active":"2024-04-25T02:10:26.357390+0000","last_became_peered":"2024-04-25T02:10:26.357390+0000","last_unstale":"2024-04-25T02:10:27.353590+0000","last_undegraded":"2024-04-25T02:10:27.353590+0000","last_fullsized":"2024-04-25T02:10:27.353590+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:10.415068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.836086+0000","last_change":"2024-04-25T02:10:25.356379+0000","last_active":"2024-04-25T02:10:27.836086+0000","last_peered":"2024-04-25T02:10:27.836086+0000","last_clean":"2024-04-25T02:10:27.836086+0000","last_became_active":"2024-04-25T02:10:25.356070+0000","last_became_peered":"2024-04-25T02:10:25.356070+0000","last_unstale":"2024-04-25T02:10:27.836086+0000","last_undegraded":"2024-04-25T02:10:27.836086+0000","last_fullsized":"2024-04-25T02:10:27.836086+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:29:38.712585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835781+0000","last_change":"2024-04-25T02:10:26.353256+0000","last_active":"2024-04-25T02:10:27.835781+0000","last_peered":"2024-04-25T02:10:27.835781+0000","last_clean":"2024-04-25T02:10:27.835781+0000","last_became_active":"2024-04-25T02:10:26.352918+0000","last_became_peered":"2024-04-25T02:10:26.352918+0000","last_unstale":"2024-04-25T02:10:27.835781+0000","last_undegraded":"2024-04-25T02:10:27.835781+0000","last_fullsized":"2024-04-25T02:10:27.835781+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:17.637758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835108+0000","last_change":"2024-04-25T02:10:25.351370+0000","last_active":"2024-04-25T02:10:27.835108+0000","last_peered":"2024-04-25T02:10:27.835108+0000","last_clean":"2024-04-25T02:10:27.835108+0000","last_became_active":"2024-04-25T02:10:25.351067+0000","last_became_peered":"2024-04-25T02:10:25.351067+0000","last_unstale":"2024-04-25T02:10:27.835108+0000","last_undegraded":"2024-04-25T02:10:27.835108+0000","last_fullsized":"2024-04-25T02:10:27.835108+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:54:34.693154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.353842+0000","last_change":"2024-04-25T02:10:26.349975+0000","last_active":"2024-04-25T02:10:27.353842+0000","last_peered":"2024-04-25T02:10:27.353842+0000","last_clean":"2024-04-25T02:10:27.353842+0000","last_became_active":"2024-04-25T02:10:26.349635+0000","last_became_peered":"2024-04-25T02:10:26.349635+0000","last_unstale":"2024-04-25T02:10:27.353842+0000","last_undegraded":"2024-04-25T02:10:27.353842+0000","last_fullsized":"2024-04-25T02:10:27.353842+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:03:57.263945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354009+0000","last_change":"2024-04-25T02:10:25.350641+0000","last_active":"2024-04-25T02:10:27.354009+0000","last_peered":"2024-04-25T02:10:27.354009+0000","last_clean":"2024-04-25T02:10:27.354009+0000","last_became_active":"2024-04-25T02:10:25.350337+0000","last_became_peered":"2024-04-25T02:10:25.350337+0000","last_unstale":"2024-04-25T02:10:27.354009+0000","last_undegraded":"2024-04-25T02:10:27.354009+0000","last_fullsized":"2024-04-25T02:10:27.354009+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.992991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835312+0000","last_change":"2024-04-25T02:10:26.364610+0000","last_active":"2024-04-25T02:10:27.835312+0000","last_peered":"2024-04-25T02:10:27.835312+0000","last_clean":"2024-04-25T02:10:27.835312+0000","last_became_active":"2024-04-25T02:10:26.364359+0000","last_became_peered":"2024-04-25T02:10:26.364359+0000","last_unstale":"2024-04-25T02:10:27.835312+0000","last_undegraded":"2024-04-25T02:10:27.835312+0000","last_fullsized":"2024-04-25T02:10:27.835312+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:57:22.948257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":22,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835045+0000","last_change":"2024-04-25T02:10:25.355201+0000","last_active":"2024-04-25T02:10:27.835045+0000","last_peered":"2024-04-25T02:10:27.835045+0000","last_clean":"2024-04-25T02:10:27.835045+0000","last_became_active":"2024-04-25T02:10:25.354935+0000","last_became_peered":"2024-04-25T02:10:25.354935+0000","last_unstale":"2024-04-25T02:10:27.835045+0000","last_undegraded":"2024-04-25T02:10:27.835045+0000","last_fullsized":"2024-04-25T02:10:27.835045+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:48.643486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835869+0000","last_change":"2024-04-25T02:10:26.359673+0000","last_active":"2024-04-25T02:10:27.835869+0000","last_peered":"2024-04-25T02:10:27.835869+0000","last_clean":"2024-04-25T02:10:27.835869+0000","last_became_active":"2024-04-25T02:10:26.359389+0000","last_became_peered":"2024-04-25T02:10:26.359389+0000","last_unstale":"2024-04-25T02:10:27.835869+0000","last_undegraded":"2024-04-25T02:10:27.835869+0000","last_fullsized":"2024-04-25T02:10:27.835869+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:23:39.674469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835475+0000","last_change":"2024-04-25T02:10:25.354199+0000","last_active":"2024-04-25T02:10:27.835475+0000","last_peered":"2024-04-25T02:10:27.835475+0000","last_clean":"2024-04-25T02:10:27.835475+0000","last_became_active":"2024-04-25T02:10:25.353946+0000","last_became_peered":"2024-04-25T02:10:25.353946+0000","last_unstale":"2024-04-25T02:10:27.835475+0000","last_undegraded":"2024-04-25T02:10:27.835475+0000","last_fullsized":"2024-04-25T02:10:27.835475+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:57:21.943506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354762+0000","last_change":"2024-04-25T02:10:26.354208+0000","last_active":"2024-04-25T02:10:27.354762+0000","last_peered":"2024-04-25T02:10:27.354762+0000","last_clean":"2024-04-25T02:10:27.354762+0000","last_became_active":"2024-04-25T02:10:26.353934+0000","last_became_peered":"2024-04-25T02:10:26.353934+0000","last_unstale":"2024-04-25T02:10:27.354762+0000","last_undegraded":"2024-04-25T02:10:27.354762+0000","last_fullsized":"2024-04-25T02:10:27.354762+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:29.306920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.836001+0000","last_change":"2024-04-25T02:10:25.352461+0000","last_active":"2024-04-25T02:10:27.836001+0000","last_peered":"2024-04-25T02:10:27.836001+0000","last_clean":"2024-04-25T02:10:27.836001+0000","last_became_active":"2024-04-25T02:10:25.352199+0000","last_became_peered":"2024-04-25T02:10:25.352199+0000","last_unstale":"2024-04-25T02:10:27.836001+0000","last_undegraded":"2024-04-25T02:10:27.836001+0000","last_fullsized":"2024-04-25T02:10:27.836001+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:09.190280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835294+0000","last_change":"2024-04-25T02:10:26.354327+0000","last_active":"2024-04-25T02:10:27.835294+0000","last_peered":"2024-04-25T02:10:27.835294+0000","last_clean":"2024-04-25T02:10:27.835294+0000","last_became_active":"2024-04-25T02:10:26.354062+0000","last_became_peered":"2024-04-25T02:10:26.354062+0000","last_unstale":"2024-04-25T02:10:27.835294+0000","last_undegraded":"2024-04-25T02:10:27.835294+0000","last_fullsized":"2024-04-25T02:10:27.835294+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:34:46.822953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354315+0000","last_change":"2024-04-25T02:10:25.354429+0000","last_active":"2024-04-25T02:10:27.354315+0000","last_peered":"2024-04-25T02:10:27.354315+0000","last_clean":"2024-04-25T02:10:27.354315+0000","last_became_active":"2024-04-25T02:10:25.354011+0000","last_became_peered":"2024-04-25T02:10:25.354011+0000","last_unstale":"2024-04-25T02:10:27.354315+0000","last_undegraded":"2024-04-25T02:10:27.354315+0000","last_fullsized":"2024-04-25T02:10:27.354315+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:48.643486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835987+0000","last_change":"2024-04-25T02:10:26.354887+0000","last_active":"2024-04-25T02:10:27.835987+0000","last_peered":"2024-04-25T02:10:27.835987+0000","last_clean":"2024-04-25T02:10:27.835987+0000","last_became_active":"2024-04-25T02:10:26.354617+0000","last_became_peered":"2024-04-25T02:10:26.354617+0000","last_unstale":"2024-04-25T02:10:27.835987+0000","last_undegraded":"2024-04-25T02:10:27.835987+0000","last_fullsized":"2024-04-25T02:10:27.835987+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:24.303462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.836180+0000","last_change":"2024-04-25T02:10:25.350850+0000","last_active":"2024-04-25T02:10:27.836180+0000","last_peered":"2024-04-25T02:10:27.836180+0000","last_clean":"2024-04-25T02:10:27.836180+0000","last_became_active":"2024-04-25T02:10:25.350567+0000","last_became_peered":"2024-04-25T02:10:25.350567+0000","last_unstale":"2024-04-25T02:10:27.836180+0000","last_undegraded":"2024-04-25T02:10:27.836180+0000","last_fullsized":"2024-04-25T02:10:27.836180+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:56.655786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.353825+0000","last_change":"2024-04-25T02:10:26.358100+0000","last_active":"2024-04-25T02:10:27.353825+0000","last_peered":"2024-04-25T02:10:27.353825+0000","last_clean":"2024-04-25T02:10:27.353825+0000","last_became_active":"2024-04-25T02:10:26.357478+0000","last_became_peered":"2024-04-25T02:10:26.357478+0000","last_unstale":"2024-04-25T02:10:27.353825+0000","last_undegraded":"2024-04-25T02:10:27.353825+0000","last_fullsized":"2024-04-25T02:10:27.353825+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:17:17.271757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.836230+0000","last_change":"2024-04-25T02:10:25.348082+0000","last_active":"2024-04-25T02:10:27.836230+0000","last_peered":"2024-04-25T02:10:27.836230+0000","last_clean":"2024-04-25T02:10:27.836230+0000","last_became_active":"2024-04-25T02:10:25.347822+0000","last_became_peered":"2024-04-25T02:10:25.347822+0000","last_unstale":"2024-04-25T02:10:27.836230+0000","last_undegraded":"2024-04-25T02:10:27.836230+0000","last_fullsized":"2024-04-25T02:10:27.836230+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:23.553761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835091+0000","last_change":"2024-04-25T02:10:26.363229+0000","last_active":"2024-04-25T02:10:27.835091+0000","last_peered":"2024-04-25T02:10:27.835091+0000","last_clean":"2024-04-25T02:10:27.835091+0000","last_became_active":"2024-04-25T02:10:26.362966+0000","last_became_peered":"2024-04-25T02:10:26.362966+0000","last_unstale":"2024-04-25T02:10:27.835091+0000","last_undegraded":"2024-04-25T02:10:27.835091+0000","last_fullsized":"2024-04-25T02:10:27.835091+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:17.637758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354941+0000","last_change":"2024-04-25T02:10:25.350688+0000","last_active":"2024-04-25T02:10:27.354941+0000","last_peered":"2024-04-25T02:10:27.354941+0000","last_clean":"2024-04-25T02:10:27.354941+0000","last_became_active":"2024-04-25T02:10:25.350399+0000","last_became_peered":"2024-04-25T02:10:25.350399+0000","last_unstale":"2024-04-25T02:10:27.354941+0000","last_undegraded":"2024-04-25T02:10:27.354941+0000","last_fullsized":"2024-04-25T02:10:27.354941+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:41:57.833803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.834945+0000","last_change":"2024-04-25T02:10:26.363490+0000","last_active":"2024-04-25T02:10:27.834945+0000","last_peered":"2024-04-25T02:10:27.834945+0000","last_clean":"2024-04-25T02:10:27.834945+0000","last_became_active":"2024-04-25T02:10:26.363203+0000","last_became_peered":"2024-04-25T02:10:26.363203+0000","last_unstale":"2024-04-25T02:10:27.834945+0000","last_undegraded":"2024-04-25T02:10:27.834945+0000","last_fullsized":"2024-04-25T02:10:27.834945+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:24.558512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.353622+0000","last_change":"2024-04-25T02:10:25.348436+0000","last_active":"2024-04-25T02:10:27.353622+0000","last_peered":"2024-04-25T02:10:27.353622+0000","last_clean":"2024-04-25T02:10:27.353622+0000","last_became_active":"2024-04-25T02:10:25.348140+0000","last_became_peered":"2024-04-25T02:10:25.348140+0000","last_unstale":"2024-04-25T02:10:27.353622+0000","last_undegraded":"2024-04-25T02:10:27.353622+0000","last_fullsized":"2024-04-25T02:10:27.353622+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:17:09.184794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354549+0000","last_change":"2024-04-25T02:10:26.347493+0000","last_active":"2024-04-25T02:10:27.354549+0000","last_peered":"2024-04-25T02:10:27.354549+0000","last_clean":"2024-04-25T02:10:27.354549+0000","last_became_active":"2024-04-25T02:10:26.347219+0000","last_became_peered":"2024-04-25T02:10:26.347219+0000","last_unstale":"2024-04-25T02:10:27.354549+0000","last_undegraded":"2024-04-25T02:10:27.354549+0000","last_fullsized":"2024-04-25T02:10:27.354549+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:25:00.103393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.355215+0000","last_change":"2024-04-25T02:10:25.350051+0000","last_active":"2024-04-25T02:10:27.355215+0000","last_peered":"2024-04-25T02:10:27.355215+0000","last_clean":"2024-04-25T02:10:27.355215+0000","last_became_active":"2024-04-25T02:10:25.348145+0000","last_became_peered":"2024-04-25T02:10:25.348145+0000","last_unstale":"2024-04-25T02:10:27.355215+0000","last_undegraded":"2024-04-25T02:10:27.355215+0000","last_fullsized":"2024-04-25T02:10:27.355215+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:57:57.599147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354936+0000","last_change":"2024-04-25T02:10:26.356475+0000","last_active":"2024-04-25T02:10:27.354936+0000","last_peered":"2024-04-25T02:10:27.354936+0000","last_clean":"2024-04-25T02:10:27.354936+0000","last_became_active":"2024-04-25T02:10:26.356175+0000","last_became_peered":"2024-04-25T02:10:26.356175+0000","last_unstale":"2024-04-25T02:10:27.354936+0000","last_undegraded":"2024-04-25T02:10:27.354936+0000","last_fullsized":"2024-04-25T02:10:27.354936+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:24.558512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"59'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.836139+0000","last_change":"2024-04-25T02:10:25.352072+0000","last_active":"2024-04-25T02:10:27.836139+0000","last_peered":"2024-04-25T02:10:27.836139+0000","last_clean":"2024-04-25T02:10:27.836139+0000","last_became_active":"2024-04-25T02:10:25.351477+0000","last_became_peered":"2024-04-25T02:10:25.351477+0000","last_unstale":"2024-04-25T02:10:27.836139+0000","last_undegraded":"2024-04-25T02:10:27.836139+0000","last_fullsized":"2024-04-25T02:10:27.836139+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:03:56.259194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.355124+0000","last_change":"2024-04-25T02:10:26.350432+0000","last_active":"2024-04-25T02:10:27.355124+0000","last_peered":"2024-04-25T02:10:27.355124+0000","last_clean":"2024-04-25T02:10:27.355124+0000","last_became_active":"2024-04-25T02:10:26.350146+0000","last_became_peered":"2024-04-25T02:10:26.350146+0000","last_unstale":"2024-04-25T02:10:27.355124+0000","last_undegraded":"2024-04-25T02:10:27.355124+0000","last_fullsized":"2024-04-25T02:10:27.355124+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:12.865883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835475+0000","last_change":"2024-04-25T02:10:25.348725+0000","last_active":"2024-04-25T02:10:27.835475+0000","last_peered":"2024-04-25T02:10:27.835475+0000","last_clean":"2024-04-25T02:10:27.835475+0000","last_became_active":"2024-04-25T02:10:25.348320+0000","last_became_peered":"2024-04-25T02:10:25.348320+0000","last_unstale":"2024-04-25T02:10:27.835475+0000","last_undegraded":"2024-04-25T02:10:27.835475+0000","last_fullsized":"2024-04-25T02:10:27.835475+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:27.603312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835748+0000","last_change":"2024-04-25T02:10:26.358095+0000","last_active":"2024-04-25T02:10:27.835748+0000","last_peered":"2024-04-25T02:10:27.835748+0000","last_clean":"2024-04-25T02:10:27.835748+0000","last_became_active":"2024-04-25T02:10:26.357719+0000","last_became_peered":"2024-04-25T02:10:26.357719+0000","last_unstale":"2024-04-25T02:10:27.835748+0000","last_undegraded":"2024-04-25T02:10:27.835748+0000","last_fullsized":"2024-04-25T02:10:27.835748+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:50.081870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354303+0000","last_change":"2024-04-25T02:10:25.354398+0000","last_active":"2024-04-25T02:10:27.354303+0000","last_peered":"2024-04-25T02:10:27.354303+0000","last_clean":"2024-04-25T02:10:27.354303+0000","last_became_active":"2024-04-25T02:10:25.354135+0000","last_became_peered":"2024-04-25T02:10:25.354135+0000","last_unstale":"2024-04-25T02:10:27.354303+0000","last_undegraded":"2024-04-25T02:10:27.354303+0000","last_fullsized":"2024-04-25T02:10:27.354303+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:48:26.159129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835580+0000","last_change":"2024-04-25T02:10:26.349972+0000","last_active":"2024-04-25T02:10:27.835580+0000","last_peered":"2024-04-25T02:10:27.835580+0000","last_clean":"2024-04-25T02:10:27.835580+0000","last_became_active":"2024-04-25T02:10:26.349702+0000","last_became_peered":"2024-04-25T02:10:26.349702+0000","last_unstale":"2024-04-25T02:10:27.835580+0000","last_undegraded":"2024-04-25T02:10:27.835580+0000","last_fullsized":"2024-04-25T02:10:27.835580+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:39.924905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354840+0000","last_change":"2024-04-25T02:10:25.347600+0000","last_active":"2024-04-25T02:10:27.354840+0000","last_peered":"2024-04-25T02:10:27.354840+0000","last_clean":"2024-04-25T02:10:27.354840+0000","last_became_active":"2024-04-25T02:10:25.347353+0000","last_became_peered":"2024-04-25T02:10:25.347353+0000","last_unstale":"2024-04-25T02:10:27.354840+0000","last_undegraded":"2024-04-25T02:10:27.354840+0000","last_fullsized":"2024-04-25T02:10:27.354840+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:15:36.858774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835962+0000","last_change":"2024-04-25T02:10:26.367696+0000","last_active":"2024-04-25T02:10:27.835962+0000","last_peered":"2024-04-25T02:10:27.835962+0000","last_clean":"2024-04-25T02:10:27.835962+0000","last_became_active":"2024-04-25T02:10:26.367413+0000","last_became_peered":"2024-04-25T02:10:26.367413+0000","last_unstale":"2024-04-25T02:10:27.835962+0000","last_undegraded":"2024-04-25T02:10:27.835962+0000","last_fullsized":"2024-04-25T02:10:27.835962+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:27.836239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354562+0000","last_change":"2024-04-25T02:10:25.351874+0000","last_active":"2024-04-25T02:10:27.354562+0000","last_peered":"2024-04-25T02:10:27.354562+0000","last_clean":"2024-04-25T02:10:27.354562+0000","last_became_active":"2024-04-25T02:10:25.351587+0000","last_became_peered":"2024-04-25T02:10:25.351587+0000","last_unstale":"2024-04-25T02:10:27.354562+0000","last_undegraded":"2024-04-25T02:10:27.354562+0000","last_fullsized":"2024-04-25T02:10:27.354562+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:09.197493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354777+0000","last_change":"2024-04-25T02:10:26.348164+0000","last_active":"2024-04-25T02:10:27.354777+0000","last_peered":"2024-04-25T02:10:27.354777+0000","last_clean":"2024-04-25T02:10:27.354777+0000","last_became_active":"2024-04-25T02:10:26.347873+0000","last_became_peered":"2024-04-25T02:10:26.347873+0000","last_unstale":"2024-04-25T02:10:27.354777+0000","last_undegraded":"2024-04-25T02:10:27.354777+0000","last_fullsized":"2024-04-25T02:10:27.354777+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:28.608063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.354818+0000","last_change":"2024-04-25T02:10:25.346645+0000","last_active":"2024-04-25T02:10:27.354818+0000","last_peered":"2024-04-25T02:10:27.354818+0000","last_clean":"2024-04-25T02:10:27.354818+0000","last_became_active":"2024-04-25T02:10:25.346395+0000","last_became_peered":"2024-04-25T02:10:25.346395+0000","last_unstale":"2024-04-25T02:10:27.354818+0000","last_undegraded":"2024-04-25T02:10:27.354818+0000","last_fullsized":"2024-04-25T02:10:27.354818+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:26.188541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835978+0000","last_change":"2024-04-25T02:10:26.354621+0000","last_active":"2024-04-25T02:10:27.835978+0000","last_peered":"2024-04-25T02:10:27.835978+0000","last_clean":"2024-04-25T02:10:27.835978+0000","last_became_active":"2024-04-25T02:10:26.354342+0000","last_became_peered":"2024-04-25T02:10:26.354342+0000","last_unstale":"2024-04-25T02:10:27.835978+0000","last_undegraded":"2024-04-25T02:10:27.835978+0000","last_fullsized":"2024-04-25T02:10:27.835978+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:25.009616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835108+0000","last_change":"2024-04-25T02:10:25.349386+0000","last_active":"2024-04-25T02:10:27.835108+0000","last_peered":"2024-04-25T02:10:27.835108+0000","last_clean":"2024-04-25T02:10:27.835108+0000","last_became_active":"2024-04-25T02:10:25.348888+0000","last_became_peered":"2024-04-25T02:10:25.348888+0000","last_unstale":"2024-04-25T02:10:27.835108+0000","last_undegraded":"2024-04-25T02:10:27.835108+0000","last_fullsized":"2024-04-25T02:10:27.835108+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:27.118150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835022+0000","last_change":"2024-04-25T02:10:26.363250+0000","last_active":"2024-04-25T02:10:27.835022+0000","last_peered":"2024-04-25T02:10:27.835022+0000","last_clean":"2024-04-25T02:10:27.835022+0000","last_became_active":"2024-04-25T02:10:26.362965+0000","last_became_peered":"2024-04-25T02:10:26.362965+0000","last_unstale":"2024-04-25T02:10:27.835022+0000","last_undegraded":"2024-04-25T02:10:27.835022+0000","last_fullsized":"2024-04-25T02:10:27.835022+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:25.330336+0000","last_clean_scrub_stamp":"2024-04-25T02:10:25.330336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:43.483696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835356+0000","last_change":"2024-04-25T02:10:25.352598+0000","last_active":"2024-04-25T02:10:27.835356+0000","last_peered":"2024-04-25T02:10:27.835356+0000","last_clean":"2024-04-25T02:10:27.835356+0000","last_became_active":"2024-04-25T02:10:25.352292+0000","last_became_peered":"2024-04-25T02:10:25.352292+0000","last_unstale":"2024-04-25T02:10:27.835356+0000","last_undegraded":"2024-04-25T02:10:27.835356+0000","last_fullsized":"2024-04-25T02:10:27.835356+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:24.325585+0000","last_clean_scrub_stamp":"2024-04-25T02:10:24.325585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:34:41.859930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":238,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T02:10:27.835156+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:10:27.835156+0000","last_peered":"2024-04-25T02:10:27.835156+0000","last_clean":"2024-04-25T02:10:27.835156+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:10:27.835156+0000","last_undegraded":"2024-04-25T02:10:27.835156+0000","last_fullsized":"2024-04-25T02:10:27.835156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1310720,"data_stored":884128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":708608,"data_stored":293600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":294252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":720896,"data_stored":295212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":293656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":293656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":712704,"data_stored":293690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28308,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343532,"statfs":{"total":96636764160,"available":96607776768,"internally_reserved":0,"allocated":1318912,"data_stored":886162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:10:34.001 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T02:10:34.002 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T02:10:34.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.133+0000 7f029054f640 1 Processor -- start 2024-04-25T02:10:34.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.133+0000 7f029054f640 1 -- start start 2024-04-25T02:10:34.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.134+0000 7f029054f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f028806e6b0 0x7f02880b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:34.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.134+0000 7f029054f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f028815ec20 con 0x7f028806b2f0 2024-04-25T02:10:34.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.134+0000 7f029054f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f028815ef00 con 0x7f02880cf7a0 2024-04-25T02:10:34.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.134+0000 7f029054f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f028815f830 con 0x7f028806e6b0 2024-04-25T02:10:34.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.134+0000 7f028eaec640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f028806e6b0 0x7f02880b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:34.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.134+0000 7f028e2eb640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f028806b2f0 0x7f028806b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38030/0 (socket says 172.21.15.79:38030) 2024-04-25T02:10:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.134+0000 7f028e2eb640 1 -- 172.21.15.79:0/3449370266 learned_addr learned my addr 172.21.15.79:0/3449370266 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.134+0000 7f028eaec640 1 -- 172.21.15.79:0/3449370266 >> v1:172.21.15.189:6789/0 conn(0x7f02880cf7a0 legacy=0x7f028815b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.134+0000 7f028eaec640 1 -- 172.21.15.79:0/3449370266 >> v1:172.21.15.79:6789/0 conn(0x7f028806b2f0 legacy=0x7f028806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.134+0000 7f028eaec640 1 -- 172.21.15.79:0/3449370266 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028815f1e0 con 0x7f028806e6b0 2024-04-25T02:10:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.134+0000 7f028d2e9640 1 -- 172.21.15.79:0/3449370266 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1451425256 0 0) 0x7f028815ec20 con 0x7f028806b2f0 2024-04-25T02:10:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.135+0000 7f028eaec640 1 --2- 172.21.15.79:0/3449370266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f028806e6b0 0x7f02880b4b50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0280009d90 tx=0x7f028002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1801c39dd7da09f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.135+0000 7f028d2e9640 1 -- 172.21.15.79:0/3449370266 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280031600 con 0x7f028806e6b0 2024-04-25T02:10:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.135+0000 7f028d2e9640 1 -- 172.21.15.79:0/3449370266 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02800317a0 con 0x7f028806e6b0 2024-04-25T02:10:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.135+0000 7f028d2e9640 1 -- 172.21.15.79:0/3449370266 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280031b70 con 0x7f028806e6b0 2024-04-25T02:10:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.136+0000 7f029054f640 1 -- 172.21.15.79:0/3449370266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f028806e6b0 msgr2=0x7f02880b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.136+0000 7f029054f640 1 --2- 172.21.15.79:0/3449370266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f028806e6b0 0x7f02880b4b50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0280009d90 tx=0x7f028002a610 comp rx=0 tx=0).stop 2024-04-25T02:10:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.136+0000 7f029054f640 1 -- 172.21.15.79:0/3449370266 shutdown_connections 2024-04-25T02:10:34.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.136+0000 7f029054f640 1 --2- 172.21.15.79:0/3449370266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f028806e6b0 0x7f02880b4b50 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.136+0000 7f029054f640 1 -- 172.21.15.79:0/3449370266 >> 172.21.15.79:0/3449370266 conn(0x7f02880b1cd0 msgr2=0x7f02880b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:34.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.136+0000 7f029054f640 1 -- 172.21.15.79:0/3449370266 shutdown_connections 2024-04-25T02:10:34.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.136+0000 7f029054f640 1 -- 172.21.15.79:0/3449370266 wait complete. 2024-04-25T02:10:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.137+0000 7f029054f640 1 Processor -- start 2024-04-25T02:10:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.137+0000 7f029054f640 1 -- start start 2024-04-25T02:10:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f029054f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f028806b2f0 0x7f028814b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f029054f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f028806e6b0 0x7f028815bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f029054f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02880cf7a0 0x7f028816a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f029054f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f028806d160 con 0x7f02880cf7a0 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f029054f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f028806cfe0 con 0x7f028806b2f0 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f029054f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f028815b9e0 con 0x7f028806e6b0 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f028eaec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02880cf7a0 0x7f028816a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f028eaec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02880cf7a0 0x7f028816a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40288/0 (socket says 172.21.15.79:40288) 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f028eaec640 1 -- 172.21.15.79:0/216524177 learned_addr learned my addr 172.21.15.79:0/216524177 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f028e2eb640 1 --2- 172.21.15.79:0/216524177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f028806b2f0 0x7f028814b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f028daea640 1 --2- 172.21.15.79:0/216524177 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f028806e6b0 0x7f028815bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f028eaec640 1 -- 172.21.15.79:0/216524177 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f028806e6b0 msgr2=0x7f028815bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f028eaec640 1 --2- 172.21.15.79:0/216524177 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f028806e6b0 0x7f028815bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f028eaec640 1 -- 172.21.15.79:0/216524177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f028806b2f0 msgr2=0x7f028814b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f028eaec640 1 --2- 172.21.15.79:0/216524177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f028806b2f0 0x7f028814b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f028eaec640 1 -- 172.21.15.79:0/216524177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02880acff0 con 0x7f02880cf7a0 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f028eaec640 1 --2- 172.21.15.79:0/216524177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02880cf7a0 0x7f028816a190 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f028002ac00 tx=0x7f0280004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f027effd640 1 -- 172.21.15.79:0/216524177 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280040070 con 0x7f02880cf7a0 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f027effd640 1 -- 172.21.15.79:0/216524177 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0280030b60 con 0x7f02880cf7a0 2024-04-25T02:10:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.138+0000 7f027effd640 1 -- 172.21.15.79:0/216524177 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280045460 con 0x7f02880cf7a0 2024-04-25T02:10:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.139+0000 7f029054f640 1 -- 172.21.15.79:0/216524177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02880ad2d0 con 0x7f02880cf7a0 2024-04-25T02:10:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.139+0000 7f029054f640 1 -- 172.21.15.79:0/216524177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0288169c70 con 0x7f02880cf7a0 2024-04-25T02:10:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.139+0000 7f029054f640 1 -- 172.21.15.79:0/216524177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0288169e70 con 0x7f02880cf7a0 2024-04-25T02:10:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.140+0000 7f027effd640 1 -- 172.21.15.79:0/216524177 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0280039040 con 0x7f02880cf7a0 2024-04-25T02:10:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.140+0000 7f027effd640 1 --2- 172.21.15.79:0/216524177 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f026c06be30 0x7f026c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.140+0000 7f028e2eb640 1 --2- 172.21.15.79:0/216524177 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f026c06be30 0x7f026c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:34.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.140+0000 7f027effd640 1 -- 172.21.15.79:0/216524177 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f02800ac740 con 0x7f02880cf7a0 2024-04-25T02:10:34.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.141+0000 7f028e2eb640 1 --2- 172.21.15.79:0/216524177 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f026c06be30 0x7f026c06e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0284000f60 tx=0x7f0284007b70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:34.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.145+0000 7f027effd640 1 -- 172.21.15.79:0/216524177 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0288169e70 con 0x7f02880cf7a0 2024-04-25T02:10:34.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.390+0000 7f029054f640 1 -- 172.21.15.79:0/216524177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f02880690a0 con 0x7f02880cf7a0 2024-04-25T02:10:34.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.391+0000 7f027effd640 1 -- 172.21.15.79:0/216524177 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f028007b1b0 con 0x7f02880cf7a0 2024-04-25T02:10:34.400 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-04-25T02:10:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g== 2024-04-25T02:10:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: caps mds = "allow" 2024-04-25T02:10:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: caps mon = "allow r" 2024-04-25T02:10:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T02:10:34.400 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2024-04-25T02:10:34.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.394+0000 7f029054f640 1 -- 172.21.15.79:0/216524177 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f026c06be30 msgr2=0x7f026c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:34.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.394+0000 7f029054f640 1 --2- 172.21.15.79:0/216524177 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f026c06be30 0x7f026c06e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0284000f60 tx=0x7f0284007b70 comp rx=0 tx=0).stop 2024-04-25T02:10:34.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.394+0000 7f029054f640 1 -- 172.21.15.79:0/216524177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02880cf7a0 msgr2=0x7f028816a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:34.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.394+0000 7f029054f640 1 --2- 172.21.15.79:0/216524177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02880cf7a0 0x7f028816a190 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f028002ac00 tx=0x7f0280004a40 comp rx=0 tx=0).stop 2024-04-25T02:10:34.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.394+0000 7f029054f640 1 -- 172.21.15.79:0/216524177 shutdown_connections 2024-04-25T02:10:34.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.394+0000 7f029054f640 1 --2- 172.21.15.79:0/216524177 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f026c06be30 0x7f026c06e2f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.394+0000 7f029054f640 1 --2- 172.21.15.79:0/216524177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02880cf7a0 0x7f028816a190 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.394+0000 7f029054f640 1 --2- 172.21.15.79:0/216524177 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f028806e6b0 0x7f028815bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.394+0000 7f029054f640 1 --2- 172.21.15.79:0/216524177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f028806b2f0 0x7f028814b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.394+0000 7f029054f640 1 -- 172.21.15.79:0/216524177 >> 172.21.15.79:0/216524177 conn(0x7f02880b1cd0 msgr2=0x7f02880d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:34.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.394+0000 7f029054f640 1 -- 172.21.15.79:0/216524177 shutdown_connections 2024-04-25T02:10:34.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.394+0000 7f029054f640 1 -- 172.21.15.79:0/216524177 wait complete. 2024-04-25T02:10:34.412 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:10:34.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.501+0000 7fc2f9961640 1 Processor -- start 2024-04-25T02:10:34.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.502+0000 7fc2f9961640 1 -- start start 2024-04-25T02:10:34.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.502+0000 7fc2f9961640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2f415c230 0x7fc2f40cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:34.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.502+0000 7fc2f9961640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc2f40d0b10 0x7fc2f40b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:34.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.502+0000 7fc2f9961640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f40cff30 con 0x7fc2f40d2940 2024-04-25T02:10:34.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.502+0000 7fc2f9961640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f40cf720 con 0x7fc2f415c230 2024-04-25T02:10:34.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.502+0000 7fc2f9961640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f40cf440 con 0x7fc2f40d0b10 2024-04-25T02:10:34.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.502+0000 7fc2f2ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2f415c230 0x7fc2f40cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:34.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.502+0000 7fc2f27fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc2f40d2940 0x7fc2f40d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38040/0 (socket says 172.21.15.79:38040) 2024-04-25T02:10:34.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.502+0000 7fc2f27fc640 1 -- 172.21.15.79:0/4081105997 learned_addr learned my addr 172.21.15.79:0/4081105997 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:34.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.503+0000 7fc2f37fe640 1 --2- 172.21.15.79:0/4081105997 >> v2:172.21.15.189:3300/0 conn(0x7fc2f40d0b10 0x7fc2f40b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:34.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.503+0000 7fc2f2ffd640 1 -- 172.21.15.79:0/4081105997 >> v2:172.21.15.189:3300/0 conn(0x7fc2f40d0b10 msgr2=0x7fc2f40b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:34.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.503+0000 7fc2f2ffd640 1 --2- 172.21.15.79:0/4081105997 >> v2:172.21.15.189:3300/0 conn(0x7fc2f40d0b10 0x7fc2f40b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.503+0000 7fc2f2ffd640 1 -- 172.21.15.79:0/4081105997 >> v1:172.21.15.79:6789/0 conn(0x7fc2f40d2940 legacy=0x7fc2f40d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:34.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.503+0000 7fc2f1ffb640 1 -- 172.21.15.79:0/4081105997 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1821879444 0 0) 0x7fc2e8001110 con 0x7fc2f40d2940 2024-04-25T02:10:34.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.503+0000 7fc2f2ffd640 1 -- 172.21.15.79:0/4081105997 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f40b1390 con 0x7fc2f415c230 2024-04-25T02:10:34.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.503+0000 7fc2f2ffd640 1 --2- 172.21.15.79:0/4081105997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f415c230 0x7fc2f40cee60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4067de0 tx=0x7fc2e402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a429c8e0d5e3739 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:34.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.504+0000 7fc2f1ffb640 1 -- 172.21.15.79:0/4081105997 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4007740 con 0x7fc2f415c230 2024-04-25T02:10:34.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.504+0000 7fc2f1ffb640 1 -- 172.21.15.79:0/4081105997 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e40078e0 con 0x7fc2f415c230 2024-04-25T02:10:34.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.504+0000 7fc2f1ffb640 1 -- 172.21.15.79:0/4081105997 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4007cb0 con 0x7fc2f415c230 2024-04-25T02:10:34.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.504+0000 7fc2f9961640 1 -- 172.21.15.79:0/4081105997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f415c230 msgr2=0x7fc2f40cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:34.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.504+0000 7fc2f9961640 1 --2- 172.21.15.79:0/4081105997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f415c230 0x7fc2f40cee60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4067de0 tx=0x7fc2e402a5f0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.504+0000 7fc2f9961640 1 -- 172.21.15.79:0/4081105997 shutdown_connections 2024-04-25T02:10:34.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.504+0000 7fc2f9961640 1 --2- 172.21.15.79:0/4081105997 >> v2:172.21.15.189:3300/0 conn(0x7fc2f40d0b10 0x7fc2f40b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.504+0000 7fc2f9961640 1 --2- 172.21.15.79:0/4081105997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f415c230 0x7fc2f40cee60 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.504+0000 7fc2f9961640 1 -- 172.21.15.79:0/4081105997 >> 172.21.15.79:0/4081105997 conn(0x7fc2f40d1e20 msgr2=0x7fc2f40d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:34.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.504+0000 7fc2f9961640 1 -- 172.21.15.79:0/4081105997 shutdown_connections 2024-04-25T02:10:34.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.504+0000 7fc2f9961640 1 -- 172.21.15.79:0/4081105997 wait complete. 2024-04-25T02:10:34.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.505+0000 7fc2f9961640 1 Processor -- start 2024-04-25T02:10:34.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.505+0000 7fc2f9961640 1 -- start start 2024-04-25T02:10:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.506+0000 7fc2f9961640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f40d0b10 0x7fc2f41f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.506+0000 7fc2f9961640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2f40d2940 0x7fc2f40b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.506+0000 7fc2f9961640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2f415c230 0x7fc2f40b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.506+0000 7fc2f9961640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f40b23b0 con 0x7fc2f40d0b10 2024-04-25T02:10:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.506+0000 7fc2f9961640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f415c610 con 0x7fc2f40d2940 2024-04-25T02:10:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.506+0000 7fc2f9961640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f40b2530 con 0x7fc2f415c230 2024-04-25T02:10:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.506+0000 7fc2f2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f40d0b10 0x7fc2f41f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.506+0000 7fc2f2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f40d0b10 0x7fc2f41f4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40304/0 (socket says 172.21.15.79:40304) 2024-04-25T02:10:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.506+0000 7fc2f2ffd640 1 -- 172.21.15.79:0/2618242312 learned_addr learned my addr 172.21.15.79:0/2618242312 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.506+0000 7fc2f37fe640 1 --2- 172.21.15.79:0/2618242312 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2f415c230 0x7fc2f40b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.506+0000 7fc2f27fc640 1 --2- 172.21.15.79:0/2618242312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2f40d2940 0x7fc2f40b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.506+0000 7fc2f2ffd640 1 -- 172.21.15.79:0/2618242312 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2f415c230 msgr2=0x7fc2f40b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.507+0000 7fc2f2ffd640 1 --2- 172.21.15.79:0/2618242312 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2f415c230 0x7fc2f40b7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.507+0000 7fc2f2ffd640 1 -- 172.21.15.79:0/2618242312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2f40d2940 msgr2=0x7fc2f40b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:34.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.507+0000 7fc2f2ffd640 1 --2- 172.21.15.79:0/2618242312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2f40d2940 0x7fc2f40b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.507+0000 7fc2f2ffd640 1 -- 172.21.15.79:0/2618242312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f41f5080 con 0x7fc2f40d0b10 2024-04-25T02:10:34.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.507+0000 7fc2f2ffd640 1 --2- 172.21.15.79:0/2618242312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f40d0b10 0x7fc2f41f4b40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009e80 tx=0x7fc2e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:34.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.507+0000 7fc2dbfff640 1 -- 172.21.15.79:0/2618242312 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e403f070 con 0x7fc2f40d0b10 2024-04-25T02:10:34.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.507+0000 7fc2dbfff640 1 -- 172.21.15.79:0/2618242312 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e4031c40 con 0x7fc2f40d0b10 2024-04-25T02:10:34.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.507+0000 7fc2dbfff640 1 -- 172.21.15.79:0/2618242312 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4044460 con 0x7fc2f40d0b10 2024-04-25T02:10:34.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.507+0000 7fc2f9961640 1 -- 172.21.15.79:0/2618242312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f40c9d00 con 0x7fc2f40d0b10 2024-04-25T02:10:34.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.507+0000 7fc2f9961640 1 -- 172.21.15.79:0/2618242312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f414be50 con 0x7fc2f40d0b10 2024-04-25T02:10:34.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.508+0000 7fc2f9961640 1 -- 172.21.15.79:0/2618242312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f40681e0 con 0x7fc2f40d0b10 2024-04-25T02:10:34.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.508+0000 7fc2dbfff640 1 -- 172.21.15.79:0/2618242312 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2e403b410 con 0x7fc2f40d0b10 2024-04-25T02:10:34.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.509+0000 7fc2dbfff640 1 --2- 172.21.15.79:0/2618242312 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2e006be30 0x7fc2e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:34.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.509+0000 7fc2dbfff640 1 -- 172.21.15.79:0/2618242312 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fc2e40ac6f0 con 0x7fc2f40d0b10 2024-04-25T02:10:34.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.509+0000 7fc2f27fc640 1 --2- 172.21.15.79:0/2618242312 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2e006be30 0x7fc2e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:34.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.509+0000 7fc2f27fc640 1 --2- 172.21.15.79:0/2618242312 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2e006be30 0x7fc2e006e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40b78e0 tx=0x7fc2e8007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:34.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.513+0000 7fc2dbfff640 1 -- 172.21.15.79:0/2618242312 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc2e407b130 con 0x7fc2f40d0b10 2024-04-25T02:10:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.726+0000 7fc2f9961640 1 -- 172.21.15.79:0/2618242312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2f406b480 con 0x7fc2f40d0b10 2024-04-25T02:10:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.726+0000 7fc2dbfff640 1 -- 172.21.15.79:0/2618242312 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5184 (secure 0 0 0) 0x7fc2e407aa30 con 0x7fc2f40d0b10 2024-04-25T02:10:34.734 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:34.734 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5431,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3495029157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3495029157},{"type":"v1","addr":"172.21.15.189:6834","nonce":3495029157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2036557544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2036557544},{"type":"v1","addr":"172.21.15.189:6835","nonce":2036557544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/326759836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":326759836},{"type":"v1","addr":"172.21.15.79:6836","nonce":326759836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:25.684570+0000","modified":"2024-04-25T02:10:27.688419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2253487658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2253487658},{"type":"v1","addr":"172.21.15.79:6837","nonce":2253487658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":4}]} 2024-04-25T02:10:34.735 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 24 2024-04-25T02:10:34.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.728+0000 7fc2f9961640 1 -- 172.21.15.79:0/2618242312 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2e006be30 msgr2=0x7fc2e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:34.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.728+0000 7fc2f9961640 1 --2- 172.21.15.79:0/2618242312 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2e006be30 0x7fc2e006e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40b78e0 tx=0x7fc2e8007970 comp rx=0 tx=0).stop 2024-04-25T02:10:34.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.728+0000 7fc2f9961640 1 -- 172.21.15.79:0/2618242312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f40d0b10 msgr2=0x7fc2f41f4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.728+0000 7fc2f9961640 1 --2- 172.21.15.79:0/2618242312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f40d0b10 0x7fc2f41f4b40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009e80 tx=0x7fc2e4004a40 comp rx=0 tx=0).stop 2024-04-25T02:10:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.728+0000 7fc2f9961640 1 -- 172.21.15.79:0/2618242312 shutdown_connections 2024-04-25T02:10:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.728+0000 7fc2f9961640 1 --2- 172.21.15.79:0/2618242312 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2e006be30 0x7fc2e006e2f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.728+0000 7fc2f9961640 1 --2- 172.21.15.79:0/2618242312 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2f415c230 0x7fc2f40b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.728+0000 7fc2f9961640 1 --2- 172.21.15.79:0/2618242312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2f40d2940 0x7fc2f40b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.728+0000 7fc2f9961640 1 --2- 172.21.15.79:0/2618242312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2f40d0b10 0x7fc2f41f4b40 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.728+0000 7fc2f9961640 1 -- 172.21.15.79:0/2618242312 >> 172.21.15.79:0/2618242312 conn(0x7fc2f40d1e20 msgr2=0x7fc2f4070510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.729+0000 7fc2f9961640 1 -- 172.21.15.79:0/2618242312 shutdown_connections 2024-04-25T02:10:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:34.729+0000 7fc2f9961640 1 -- 172.21.15.79:0/2618242312 wait complete. 2024-04-25T02:10:35.149 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:10:25.684570+0000', 'modified': '2024-04-25T02:10:27.688419+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6093}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6093': {'gid': 6093, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6837/2253487658', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 2253487658}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 2253487658}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6093, 'qdb_cluster': [6093]} 2024-04-25T02:10:35.150 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:10:35.150 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T02:10:35.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.243+0000 7f9199d89640 1 Processor -- start 2024-04-25T02:10:35.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.243+0000 7f9199d89640 1 -- start start 2024-04-25T02:10:35.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.243+0000 7f9199d89640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f919415e4d0 0x7f919406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.243+0000 7f9199d89640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91940d1660 con 0x7f91940d2e20 2024-04-25T02:10:35.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.243+0000 7f9199d89640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91940d1380 con 0x7f91940b3570 2024-04-25T02:10:35.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.243+0000 7f9199d89640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f91940cede0 con 0x7f919415e4d0 2024-04-25T02:10:35.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.244+0000 7f91937fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f919415e4d0 0x7f919406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.244+0000 7f91937fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f919415e4d0 0x7f919406bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40312/0 (socket says 172.21.15.79:40312) 2024-04-25T02:10:35.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.244+0000 7f91937fe640 1 -- 172.21.15.79:0/3132340644 learned_addr learned my addr 172.21.15.79:0/3132340644 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:35.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.244+0000 7f9193fff640 1 --1- 172.21.15.79:0/3132340644 >> v1:172.21.15.79:6789/0 conn(0x7f91940d2e20 0x7f91940cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38050/0 (socket says 172.21.15.79:38050) 2024-04-25T02:10:35.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.244+0000 7f91937fe640 1 -- 172.21.15.79:0/3132340644 >> v1:172.21.15.189:6789/0 conn(0x7f91940b3570 legacy=0x7f91940d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:35.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.244+0000 7f91937fe640 1 -- 172.21.15.79:0/3132340644 >> v1:172.21.15.79:6789/0 conn(0x7f91940d2e20 legacy=0x7f91940cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.244+0000 7f9192ffd640 1 -- 172.21.15.79:0/3132340644 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1734049599 0 0) 0x7f91940d1660 con 0x7f91940d2e20 2024-04-25T02:10:35.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.244+0000 7f91937fe640 1 -- 172.21.15.79:0/3132340644 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91940cf0c0 con 0x7f919415e4d0 2024-04-25T02:10:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.244+0000 7f91937fe640 1 --2- 172.21.15.79:0/3132340644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f919415e4d0 0x7f919406bc70 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f91840098a0 tx=0x7f918402a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c877e9374f8d61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.245+0000 7f9192ffd640 1 -- 172.21.15.79:0/3132340644 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184037070 con 0x7f919415e4d0 2024-04-25T02:10:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.245+0000 7f9192ffd640 1 -- 172.21.15.79:0/3132340644 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9184032640 con 0x7f919415e4d0 2024-04-25T02:10:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.245+0000 7f9192ffd640 1 -- 172.21.15.79:0/3132340644 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184032a10 con 0x7f919415e4d0 2024-04-25T02:10:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.245+0000 7f9199d89640 1 -- 172.21.15.79:0/3132340644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f919415e4d0 msgr2=0x7f919406bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.245+0000 7f9199d89640 1 --2- 172.21.15.79:0/3132340644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f919415e4d0 0x7f919406bc70 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f91840098a0 tx=0x7f918402a320 comp rx=0 tx=0).stop 2024-04-25T02:10:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.245+0000 7f9199d89640 1 -- 172.21.15.79:0/3132340644 shutdown_connections 2024-04-25T02:10:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.245+0000 7f9199d89640 1 --2- 172.21.15.79:0/3132340644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f919415e4d0 0x7f919406bc70 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.245+0000 7f9199d89640 1 -- 172.21.15.79:0/3132340644 >> 172.21.15.79:0/3132340644 conn(0x7f919409d460 msgr2=0x7f91940d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.245+0000 7f9199d89640 1 -- 172.21.15.79:0/3132340644 shutdown_connections 2024-04-25T02:10:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.245+0000 7f9199d89640 1 -- 172.21.15.79:0/3132340644 wait complete. 2024-04-25T02:10:35.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.246+0000 7f9199d89640 1 Processor -- start 2024-04-25T02:10:35.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.246+0000 7f9199d89640 1 -- start start 2024-04-25T02:10:35.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.247+0000 7f9199d89640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91940b3570 0x7f919415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.247+0000 7f9199d89640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940d2e20 0x7f91940cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.247+0000 7f9199d89640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f919415e4d0 0x7f91940b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.247+0000 7f9199d89640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f91940d2250 con 0x7f91940b3570 2024-04-25T02:10:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.247+0000 7f9199d89640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91940d20d0 con 0x7f919415e4d0 2024-04-25T02:10:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.247+0000 7f9199d89640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f919406c1b0 con 0x7f91940d2e20 2024-04-25T02:10:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.247+0000 7f91937fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91940b3570 0x7f919415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.247+0000 7f91937fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91940b3570 0x7f919415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40320/0 (socket says 172.21.15.79:40320) 2024-04-25T02:10:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.247+0000 7f91937fe640 1 -- 172.21.15.79:0/49407656 learned_addr learned my addr 172.21.15.79:0/49407656 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.247+0000 7f91937fe640 1 -- 172.21.15.79:0/49407656 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940d2e20 msgr2=0x7f91940cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.247+0000 7f91937fe640 1 --2- 172.21.15.79:0/49407656 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940d2e20 0x7f91940cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.247+0000 7f91937fe640 1 -- 172.21.15.79:0/49407656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f919415e4d0 msgr2=0x7f91940b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.247+0000 7f91937fe640 1 --2- 172.21.15.79:0/49407656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f919415e4d0 0x7f91940b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.247+0000 7f91937fe640 1 -- 172.21.15.79:0/49407656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91940b7070 con 0x7f91940b3570 2024-04-25T02:10:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.248+0000 7f91937fe640 1 --2- 172.21.15.79:0/49407656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91940b3570 0x7f919415d5d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f91840090b0 tx=0x7f91840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.248+0000 7f9190ff9640 1 -- 172.21.15.79:0/49407656 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184041070 con 0x7f91940b3570 2024-04-25T02:10:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.248+0000 7f9190ff9640 1 -- 172.21.15.79:0/49407656 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918403c950 con 0x7f91940b3570 2024-04-25T02:10:35.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.248+0000 7f9190ff9640 1 -- 172.21.15.79:0/49407656 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184037040 con 0x7f91940b3570 2024-04-25T02:10:35.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.248+0000 7f9199d89640 1 -- 172.21.15.79:0/49407656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91940b7350 con 0x7f91940b3570 2024-04-25T02:10:35.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.248+0000 7f9199d89640 1 -- 172.21.15.79:0/49407656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91940b7910 con 0x7f91940b3570 2024-04-25T02:10:35.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.249+0000 7f9190ff9640 1 -- 172.21.15.79:0/49407656 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9184044070 con 0x7f91940b3570 2024-04-25T02:10:35.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.250+0000 7f9190ff9640 1 --2- 172.21.15.79:0/49407656 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f917406be30 0x7f917406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.250+0000 7f9190ff9640 1 -- 172.21.15.79:0/49407656 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f91840abca0 con 0x7f91940b3570 2024-04-25T02:10:35.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.250+0000 7f918bfff640 1 --2- 172.21.15.79:0/49407656 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f917406be30 0x7f917406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.250+0000 7f918bfff640 1 --2- 172.21.15.79:0/49407656 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f917406be30 0x7f917406e2f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f917c000f60 tx=0x7f917c0079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:35.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.251+0000 7f919cb73740 1 Processor -- start 2024-04-25T02:10:35.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.251+0000 7f919cb73740 1 -- start start 2024-04-25T02:10:35.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.251+0000 7f919cb73740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4ab54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.251+0000 7f919cb73740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ae5c80 0x55abe4ae5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.251+0000 7f919cb73740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4ae5540 0x55abe4aba350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.251+0000 7f919cb73740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55abe4a1df00 con 0x55abe4b02b60 2024-04-25T02:10:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.251+0000 7f919cb73740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55abe49c6750 con 0x55abe4ae5540 2024-04-25T02:10:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.251+0000 7f919cb73740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55abe4a19ec0 con 0x55abe4ae5c80 2024-04-25T02:10:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.252+0000 7f91937fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4ab54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.252+0000 7f91937fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4ab54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40322/0 (socket says 172.21.15.79:40322) 2024-04-25T02:10:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.252+0000 7f91937fe640 1 -- 172.21.15.79:0/1647891857 learned_addr learned my addr 172.21.15.79:0/1647891857 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.252+0000 7f91937fe640 1 -- 172.21.15.79:0/1647891857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ae5c80 msgr2=0x55abe4ae5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.252+0000 7f91937fe640 1 --2- 172.21.15.79:0/1647891857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ae5c80 0x55abe4ae5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.252+0000 7f91937fe640 1 -- 172.21.15.79:0/1647891857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4ae5540 msgr2=0x55abe4aba350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.252+0000 7f9193fff640 1 --2- 172.21.15.79:0/1647891857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4ae5540 0x55abe4aba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.252+0000 7f91937fe640 1 --2- 172.21.15.79:0/1647891857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4ae5540 0x55abe4aba350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.252+0000 7f91937fe640 1 -- 172.21.15.79:0/1647891857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abe47322d0 con 0x55abe4b02b60 2024-04-25T02:10:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.252+0000 7f91937fe640 1 --2- 172.21.15.79:0/1647891857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4ab54f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f91840aa140 tx=0x7f91840799d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3695eaf67e92ca0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.252+0000 7f91897fa640 1 -- 172.21.15.79:0/1647891857 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918404b040 con 0x55abe4b02b60 2024-04-25T02:10:35.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.252+0000 7f91897fa640 1 -- 172.21.15.79:0/1647891857 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918407e420 con 0x55abe4b02b60 2024-04-25T02:10:35.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.252+0000 7f91897fa640 1 -- 172.21.15.79:0/1647891857 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184082c50 con 0x55abe4b02b60 2024-04-25T02:10:35.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.253+0000 7f919cb73740 1 -- 172.21.15.79:0/1647891857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 msgr2=0x55abe4ab54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.253+0000 7f919cb73740 1 --2- 172.21.15.79:0/1647891857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4ab54f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f91840aa140 tx=0x7f91840799d0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.253+0000 7f919cb73740 1 -- 172.21.15.79:0/1647891857 shutdown_connections 2024-04-25T02:10:35.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.253+0000 7f919cb73740 1 --2- 172.21.15.79:0/1647891857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4ae5540 0x55abe4aba350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.253+0000 7f919cb73740 1 --2- 172.21.15.79:0/1647891857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ae5c80 0x55abe4ae5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.253+0000 7f919cb73740 1 --2- 172.21.15.79:0/1647891857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4ab54f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.253+0000 7f919cb73740 1 -- 172.21.15.79:0/1647891857 >> 172.21.15.79:0/1647891857 conn(0x55abe4ab7760 msgr2=0x55abe4b00000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:35.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.253+0000 7f919cb73740 1 -- 172.21.15.79:0/1647891857 shutdown_connections 2024-04-25T02:10:35.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.253+0000 7f919cb73740 1 -- 172.21.15.79:0/1647891857 wait complete. 2024-04-25T02:10:35.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.253+0000 7f919cb73740 1 -- start start 2024-04-25T02:10:35.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.254+0000 7f919cb73740 1 Processor -- start 2024-04-25T02:10:35.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.254+0000 7f919cb73740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4ae5c80 0x55abe4ae8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.254+0000 7f919cb73740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4aba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.254+0000 7f919cb73740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ad2aa0 0x55abe4aba560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.254+0000 7f919cb73740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55abe4ab9910 con 0x55abe4b02b60 2024-04-25T02:10:35.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.254+0000 7f919cb73740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55abe49d9cf0 con 0x55abe4ae5c80 2024-04-25T02:10:35.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.254+0000 7f919cb73740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55abe4ab8d00 con 0x55abe4ad2aa0 2024-04-25T02:10:35.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.254+0000 7f919cb73740 10 client.0 _ll_register_callbacks cb 0x55abe49d96e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:35.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.254+0000 7f918bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4aba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.254+0000 7f918bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4aba020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40332/0 (socket says 172.21.15.79:40332) 2024-04-25T02:10:35.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.254+0000 7f918bfff640 1 -- 172.21.15.79:0/305726375 learned_addr learned my addr 172.21.15.79:0/305726375 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:35.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f91937fe640 1 --2- 172.21.15.79:0/305726375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4ae5c80 0x55abe4ae8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f9193fff640 1 --2- 172.21.15.79:0/305726375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ad2aa0 0x55abe4aba560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f918bfff640 1 -- 172.21.15.79:0/305726375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ad2aa0 msgr2=0x55abe4aba560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:35.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f918bfff640 1 --2- 172.21.15.79:0/305726375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ad2aa0 0x55abe4aba560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f918bfff640 1 -- 172.21.15.79:0/305726375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4ae5c80 msgr2=0x55abe4ae8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:35.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f918bfff640 1 --2- 172.21.15.79:0/305726375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4ae5c80 0x55abe4ae8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f918bfff640 1 -- 172.21.15.79:0/305726375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abe47fc6b0 con 0x55abe4b02b60 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f918bfff640 1 --2- 172.21.15.79:0/305726375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4aba020 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f91940cb020 tx=0x7f917c013780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5115ddcda36878 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f91727fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f91727fc640 1 -- 172.21.15.79:0/305726375 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c0160d0 con 0x55abe4b02b60 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f91727fc640 1 -- 172.21.15.79:0/305726375 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f917c016270 con 0x55abe4b02b60 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f919cb73740 1 -- 172.21.15.79:0/305726375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f918407e420 con 0x55abe4b02b60 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f91727fc640 1 -- 172.21.15.79:0/305726375 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f917c005110 con 0x55abe4b02b60 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f919cb73740 10 client.6279 fetch_fsmap learned FSMap version 24 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f919cb73740 1 -- 172.21.15.79:0/305726375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55abe4b10530 con 0x55abe4b02b60 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f91727fc640 1 -- 172.21.15.79:0/305726375 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918407e420 con 0x55abe4b02b60 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f91727fc640 1 -- 172.21.15.79:0/305726375 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 24) ==== 3494+0+0 (secure 0 0 0) 0x7f917c0052b0 con 0x55abe4b02b60 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f919cb73740 10 client.6279 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f919cb73740 10 client.6279 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f919cb73740 20 client.6279 populate_metadata read hostname 'smithi079' 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f919cb73740 1 --2- 172.21.15.79:0/305726375 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55abe4b13730 0x55abe4ae65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f919cb73740 4 client.6279 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:35.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f919cb73740 1 -- 172.21.15.79:0/305726375 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abe4a2b440 con 0x55abe4b13730 2024-04-25T02:10:35.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.255+0000 7f91937fe640 1 --2- 172.21.15.79:0/305726375 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55abe4b13730 0x55abe4ae65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.256+0000 7f91727fc640 10 client.6279 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:10:35.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.256+0000 7f91937fe640 1 --2- 172.21.15.79:0/305726375 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55abe4b13730 0x55abe4ae65a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f1dba0fd4ceac41 server_cookie=4f9dabb532729995 in_seq=0 out_seq=0 2024-04-25T02:10:35.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.256+0000 7f91727fc640 1 -- 172.21.15.79:0/305726375 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55abe4a2b440 con 0x55abe4b13730 2024-04-25T02:10:35.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.256+0000 7f91727fc640 10 client.6279 handle_command_reply: tid=0 2024-04-25T02:10:35.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.256+0000 7f919cb73740 1 client.6279 shutdown 2024-04-25T02:10:35.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.257+0000 7f919cb73740 1 -- 172.21.15.79:0/305726375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 msgr2=0x55abe4aba020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.257+0000 7f919cb73740 1 --2- 172.21.15.79:0/305726375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4aba020 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f91940cb020 tx=0x7f917c013780 comp rx=0 tx=0).stop 2024-04-25T02:10:35.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.257+0000 7f919cb73740 1 -- 172.21.15.79:0/305726375 shutdown_connections 2024-04-25T02:10:35.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.257+0000 7f919cb73740 1 --2- 172.21.15.79:0/305726375 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55abe4b13730 0x55abe4ae65a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.257+0000 7f919cb73740 1 --2- 172.21.15.79:0/305726375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ad2aa0 0x55abe4aba560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.257+0000 7f919cb73740 1 --2- 172.21.15.79:0/305726375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4aba020 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.257+0000 7f919cb73740 1 --2- 172.21.15.79:0/305726375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4ae5c80 0x55abe4ae8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.257+0000 7f91727fc640 0 client.6279 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:10:35.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.257+0000 7f919cb73740 1 -- 172.21.15.79:0/305726375 >> 172.21.15.79:0/305726375 conn(0x55abe4ae5540 msgr2=0x55abe4ab6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:35.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.257+0000 7f919cb73740 1 -- 172.21.15.79:0/305726375 shutdown_connections 2024-04-25T02:10:35.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.257+0000 7f919cb73740 1 -- 172.21.15.79:0/305726375 wait complete. 2024-04-25T02:10:35.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.257+0000 7f919cb73740 20 client.6279 trim_cache size 0 max 16384 2024-04-25T02:10:35.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.275+0000 7f919cb73740 1 Processor -- start 2024-04-25T02:10:35.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.275+0000 7f919cb73740 1 -- start start 2024-04-25T02:10:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.275+0000 7f919cb73740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ad2aa0 0x55abe4ae7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.275+0000 7f919cb73740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4ae5c80 0x55abe4ae69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.275+0000 7f919cb73740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4ab9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.275+0000 7f919cb73740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f91941ff860 con 0x55abe4b02b60 2024-04-25T02:10:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.275+0000 7f919cb73740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91940b1b10 con 0x55abe4ae5c80 2024-04-25T02:10:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.276+0000 7f919cb73740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f91940b2160 con 0x55abe4ad2aa0 2024-04-25T02:10:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.276+0000 7f9193fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4ab9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.276+0000 7f9193fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4ab9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40342/0 (socket says 172.21.15.79:40342) 2024-04-25T02:10:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.276+0000 7f9193fff640 1 -- 172.21.15.79:0/2463705779 learned_addr learned my addr 172.21.15.79:0/2463705779 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.276+0000 7f9193fff640 1 -- 172.21.15.79:0/2463705779 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ad2aa0 msgr2=0x55abe4ae7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.276+0000 7f9193fff640 1 --2- 172.21.15.79:0/2463705779 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ad2aa0 0x55abe4ae7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.276+0000 7f9193fff640 1 -- 172.21.15.79:0/2463705779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4ae5c80 msgr2=0x55abe4ae69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.276+0000 7f9193fff640 1 --2- 172.21.15.79:0/2463705779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4ae5c80 0x55abe4ae69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.276+0000 7f9193fff640 1 -- 172.21.15.79:0/2463705779 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abe4b02990 con 0x55abe4b02b60 2024-04-25T02:10:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.276+0000 7f9193fff640 1 --2- 172.21.15.79:0/2463705779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4ab9f60 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9194163140 tx=0x7f918c007880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f28ad9f529b3038 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.276+0000 7f9188ff9640 1 -- 172.21.15.79:0/2463705779 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c0079b0 con 0x55abe4b02b60 2024-04-25T02:10:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.276+0000 7f9188ff9640 1 -- 172.21.15.79:0/2463705779 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918c018070 con 0x55abe4b02b60 2024-04-25T02:10:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.276+0000 7f9188ff9640 1 -- 172.21.15.79:0/2463705779 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c001ff0 con 0x55abe4b02b60 2024-04-25T02:10:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.277+0000 7f919cb73740 1 -- 172.21.15.79:0/2463705779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 msgr2=0x55abe4ab9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.277+0000 7f919cb73740 1 --2- 172.21.15.79:0/2463705779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4ab9f60 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9194163140 tx=0x7f918c007880 comp rx=0 tx=0).stop 2024-04-25T02:10:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.277+0000 7f919cb73740 1 -- 172.21.15.79:0/2463705779 shutdown_connections 2024-04-25T02:10:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.277+0000 7f919cb73740 1 --2- 172.21.15.79:0/2463705779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4b02b60 0x55abe4ab9f60 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.277+0000 7f919cb73740 1 --2- 172.21.15.79:0/2463705779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4ae5c80 0x55abe4ae69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.277+0000 7f919cb73740 1 --2- 172.21.15.79:0/2463705779 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ad2aa0 0x55abe4ae7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.277+0000 7f919cb73740 1 -- 172.21.15.79:0/2463705779 >> 172.21.15.79:0/2463705779 conn(0x55abe4ae5540 msgr2=0x55abe4ab0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.277+0000 7f919cb73740 1 -- 172.21.15.79:0/2463705779 shutdown_connections 2024-04-25T02:10:35.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.277+0000 7f919cb73740 1 -- 172.21.15.79:0/2463705779 wait complete. 2024-04-25T02:10:35.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.277+0000 7f919cb73740 1 -- start start 2024-04-25T02:10:35.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.277+0000 7f919cb73740 1 Processor -- start 2024-04-25T02:10:35.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f919cb73740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ad2aa0 0x55abe4ab95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f919cb73740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4ae5c80 0x55abe4affbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f919cb73740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4b02b60 0x55abe4b00130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f919cb73740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55abe4b135b0 con 0x55abe4ae5c80 2024-04-25T02:10:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f919cb73740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55abe4b108d0 con 0x55abe4b02b60 2024-04-25T02:10:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f919cb73740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55abe4b13c00 con 0x55abe4ad2aa0 2024-04-25T02:10:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f919cb73740 10 client.0 _ll_register_callbacks cb 0x7f917c0012b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f918bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4ae5c80 0x55abe4affbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f918bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4ae5c80 0x55abe4affbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40358/0 (socket says 172.21.15.79:40358) 2024-04-25T02:10:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f918bfff640 1 -- 172.21.15.79:0/1386894487 learned_addr learned my addr 172.21.15.79:0/1386894487 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f918bfff640 1 -- 172.21.15.79:0/1386894487 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ad2aa0 msgr2=0x55abe4ab95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f918bfff640 1 --2- 172.21.15.79:0/1386894487 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ad2aa0 0x55abe4ab95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f918bfff640 1 -- 172.21.15.79:0/1386894487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4b02b60 msgr2=0x55abe4b00130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f9193fff640 1 --2- 172.21.15.79:0/1386894487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4b02b60 0x55abe4b00130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f918bfff640 1 --2- 172.21.15.79:0/1386894487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4b02b60 0x55abe4b00130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.278+0000 7f918bfff640 1 -- 172.21.15.79:0/1386894487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abe4ab4380 con 0x55abe4ae5c80 2024-04-25T02:10:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f918bfff640 1 --2- 172.21.15.79:0/1386894487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4ae5c80 0x55abe4affbf0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f917c000fb0 tx=0x7f917c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feff16423e244e6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f91727fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f91727fc640 1 -- 172.21.15.79:0/1386894487 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c0162e0 con 0x55abe4ae5c80 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f91727fc640 1 -- 172.21.15.79:0/1386894487 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f917c0036e0 con 0x55abe4ae5c80 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f919cb73740 1 -- 172.21.15.79:0/1386894487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f918c018070 con 0x55abe4ae5c80 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f91727fc640 1 -- 172.21.15.79:0/1386894487 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f917c0039d0 con 0x55abe4ae5c80 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f919cb73740 10 client.6285 fetch_fsmap learned FSMap version 24 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f919cb73740 1 -- 172.21.15.79:0/1386894487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55abe4abb0e0 con 0x55abe4ae5c80 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f91727fc640 1 -- 172.21.15.79:0/1386894487 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918c018070 con 0x55abe4ae5c80 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f91727fc640 1 -- 172.21.15.79:0/1386894487 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 24) ==== 3494+0+0 (secure 0 0 0) 0x7f917c003b70 con 0x55abe4ae5c80 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f919cb73740 10 client.6285 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f919cb73740 10 client.6285 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f919cb73740 20 client.6285 populate_metadata read hostname 'smithi079' 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f919cb73740 1 --2- 172.21.15.79:0/1386894487 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55abe4b82e00 0x55abe4b85ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f919cb73740 4 client.6285 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f919cb73740 1 -- 172.21.15.79:0/1386894487 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "status"}) -- 0x55abe4a25790 con 0x55abe4b82e00 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.279+0000 7f91937fe640 1 --2- 172.21.15.79:0/1386894487 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55abe4b82e00 0x55abe4b85ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f91727fc640 10 client.6285 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:10:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f91937fe640 1 --2- 172.21.15.79:0/1386894487 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55abe4b82e00 0x55abe4b85ed0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a775bb63a6eece39 server_cookie=c7ff01d0cda79567 in_seq=0 out_seq=0 2024-04-25T02:10:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f91727fc640 1 -- 172.21.15.79:0/1386894487 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55abe4a25790 con 0x55abe4b82e00 2024-04-25T02:10:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f91727fc640 10 client.6285 handle_command_reply: tid=0 2024-04-25T02:10:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f919cb73740 1 client.6285 shutdown 2024-04-25T02:10:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f919cb73740 1 -- 172.21.15.79:0/1386894487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4ae5c80 msgr2=0x55abe4affbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f919cb73740 1 --2- 172.21.15.79:0/1386894487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4ae5c80 0x55abe4affbf0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f917c000fb0 tx=0x7f917c011000 comp rx=0 tx=0).stop 2024-04-25T02:10:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f919cb73740 1 -- 172.21.15.79:0/1386894487 shutdown_connections 2024-04-25T02:10:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f919cb73740 1 --2- 172.21.15.79:0/1386894487 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55abe4b82e00 0x55abe4b85ed0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f919cb73740 1 --2- 172.21.15.79:0/1386894487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abe4b02b60 0x55abe4b00130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f91727fc640 0 client.6285 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:10:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f919cb73740 1 --2- 172.21.15.79:0/1386894487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55abe4ae5c80 0x55abe4affbf0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f919cb73740 1 --2- 172.21.15.79:0/1386894487 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55abe4ad2aa0 0x55abe4ab95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f919cb73740 1 -- 172.21.15.79:0/1386894487 >> 172.21.15.79:0/1386894487 conn(0x55abe4ae5540 msgr2=0x55abe4ae69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:35.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f919cb73740 1 -- 172.21.15.79:0/1386894487 shutdown_connections 2024-04-25T02:10:35.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f919cb73740 1 -- 172.21.15.79:0/1386894487 wait complete. 2024-04-25T02:10:35.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f919cb73740 20 client.6285 trim_cache size 0 max 16384 2024-04-25T02:10:35.294 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:10:35.294 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "696648c4-3e52-400b-a780-2e8863c56c42", 2024-04-25T02:10:35.294 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-04-25T02:10:35.294 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6093, 2024-04-25T02:10:35.294 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-04-25T02:10:35.294 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-04-25T02:10:35.294 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-04-25T02:10:35.295 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 8.9442193060000008, 2024-04-25T02:10:35.295 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 24, 2024-04-25T02:10:35.295 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 59, 2024-04-25T02:10:35.295 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 59, 2024-04-25T02:10:35.295 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 14.023577617999999 2024-04-25T02:10:35.295 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:10:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f9199d89640 1 -- 172.21.15.79:0/49407656 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f917406be30 msgr2=0x7f917406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f9199d89640 1 --2- 172.21.15.79:0/49407656 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f917406be30 0x7f917406e2f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f917c000f60 tx=0x7f917c0079b0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f9199d89640 1 -- 172.21.15.79:0/49407656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91940b3570 msgr2=0x7f919415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.280+0000 7f9199d89640 1 --2- 172.21.15.79:0/49407656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91940b3570 0x7f919415d5d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f91840090b0 tx=0x7f91840046c0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.281+0000 7f9199d89640 1 -- 172.21.15.79:0/49407656 shutdown_connections 2024-04-25T02:10:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.281+0000 7f9199d89640 1 --2- 172.21.15.79:0/49407656 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f917406be30 0x7f917406e2f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.281+0000 7f9199d89640 1 --2- 172.21.15.79:0/49407656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f919415e4d0 0x7f91940b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.281+0000 7f9199d89640 1 --2- 172.21.15.79:0/49407656 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940d2e20 0x7f91940cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.281+0000 7f9199d89640 1 --2- 172.21.15.79:0/49407656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91940b3570 0x7f919415d5d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.281+0000 7f9199d89640 1 -- 172.21.15.79:0/49407656 >> 172.21.15.79:0/49407656 conn(0x7f919409d460 msgr2=0x7f91940cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.281+0000 7f9199d89640 1 -- 172.21.15.79:0/49407656 shutdown_connections 2024-04-25T02:10:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.281+0000 7f9199d89640 1 -- 172.21.15.79:0/49407656 wait complete. 2024-04-25T02:10:35.299 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:10:35.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.388+0000 7ff095b09640 1 Processor -- start 2024-04-25T02:10:35.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.388+0000 7ff095b09640 1 -- start start 2024-04-25T02:10:35.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.389+0000 7ff095b09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff09006e3b0 0x7ff0900b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.389+0000 7ff095b09640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff090071e00 con 0x7ff09006df50 2024-04-25T02:10:35.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.389+0000 7ff095b09640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0900720a0 con 0x7ff090143bc0 2024-04-25T02:10:35.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.389+0000 7ff095b09640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff090072cb0 con 0x7ff09006e3b0 2024-04-25T02:10:35.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.389+0000 7ff08ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff09006e3b0 0x7ff0900b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.389+0000 7ff08effd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff09006df50 0x7ff0900b2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38060/0 (socket says 172.21.15.79:38060) 2024-04-25T02:10:35.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.389+0000 7ff08effd640 1 -- 172.21.15.79:0/1843695698 learned_addr learned my addr 172.21.15.79:0/1843695698 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:35.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.389+0000 7ff08e7fc640 1 -- 172.21.15.79:0/1843695698 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 41793372 0 0) 0x7ff090071e00 con 0x7ff09006df50 2024-04-25T02:10:35.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.389+0000 7ff08e7fc640 1 -- 172.21.15.79:0/1843695698 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff078003520 con 0x7ff09006df50 2024-04-25T02:10:35.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.389+0000 7ff08ffff640 1 -- 172.21.15.79:0/1843695698 >> v1:172.21.15.189:6789/0 conn(0x7ff090143bc0 legacy=0x7ff09015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.389+0000 7ff08ffff640 1 -- 172.21.15.79:0/1843695698 >> v1:172.21.15.79:6789/0 conn(0x7ff09006df50 legacy=0x7ff0900b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.389+0000 7ff08ffff640 1 -- 172.21.15.79:0/1843695698 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff090072380 con 0x7ff09006e3b0 2024-04-25T02:10:35.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.390+0000 7ff08ffff640 1 --2- 172.21.15.79:0/1843695698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09006e3b0 0x7ff0900b3440 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff088009d90 tx=0x7ff08802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3d61313e7c3271 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:35.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.390+0000 7ff08e7fc640 1 -- 172.21.15.79:0/1843695698 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff088007740 con 0x7ff09006e3b0 2024-04-25T02:10:35.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.390+0000 7ff08e7fc640 1 -- 172.21.15.79:0/1843695698 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0880078e0 con 0x7ff09006e3b0 2024-04-25T02:10:35.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.390+0000 7ff08e7fc640 1 -- 172.21.15.79:0/1843695698 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff088007cb0 con 0x7ff09006e3b0 2024-04-25T02:10:35.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.391+0000 7ff095b09640 1 -- 172.21.15.79:0/1843695698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09006e3b0 msgr2=0x7ff0900b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.391+0000 7ff095b09640 1 --2- 172.21.15.79:0/1843695698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09006e3b0 0x7ff0900b3440 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff088009d90 tx=0x7ff08802a660 comp rx=0 tx=0).stop 2024-04-25T02:10:35.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.391+0000 7ff095b09640 1 -- 172.21.15.79:0/1843695698 shutdown_connections 2024-04-25T02:10:35.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.391+0000 7ff095b09640 1 --2- 172.21.15.79:0/1843695698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09006e3b0 0x7ff0900b3440 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.391+0000 7ff095b09640 1 -- 172.21.15.79:0/1843695698 >> 172.21.15.79:0/1843695698 conn(0x7ff0900cfc80 msgr2=0x7ff0900d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:35.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.391+0000 7ff095b09640 1 -- 172.21.15.79:0/1843695698 shutdown_connections 2024-04-25T02:10:35.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.391+0000 7ff095b09640 1 -- 172.21.15.79:0/1843695698 wait complete. 2024-04-25T02:10:35.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.392+0000 7ff095b09640 1 Processor -- start 2024-04-25T02:10:35.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.392+0000 7ff095b09640 1 -- start start 2024-04-25T02:10:35.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff095b09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09006df50 0x7ff0900b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff095b09640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff09006e3b0 0x7ff090159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff095b09640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff090143bc0 0x7ff0901e7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff095b09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff09006e840 con 0x7ff09006df50 2024-04-25T02:10:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff095b09640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff090072940 con 0x7ff09006e3b0 2024-04-25T02:10:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff095b09640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff090143fa0 con 0x7ff090143bc0 2024-04-25T02:10:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff08f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09006df50 0x7ff0900b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff08f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09006df50 0x7ff0900b0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40372/0 (socket says 172.21.15.79:40372) 2024-04-25T02:10:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff08f7fe640 1 -- 172.21.15.79:0/1396016236 learned_addr learned my addr 172.21.15.79:0/1396016236 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff08effd640 1 --2- 172.21.15.79:0/1396016236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff09006e3b0 0x7ff090159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff08ffff640 1 --2- 172.21.15.79:0/1396016236 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff090143bc0 0x7ff0901e7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff08f7fe640 1 -- 172.21.15.79:0/1396016236 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff090143bc0 msgr2=0x7ff0901e7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff08f7fe640 1 --2- 172.21.15.79:0/1396016236 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff090143bc0 0x7ff0901e7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff08f7fe640 1 -- 172.21.15.79:0/1396016236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff09006e3b0 msgr2=0x7ff090159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff08f7fe640 1 --2- 172.21.15.79:0/1396016236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff09006e3b0 0x7ff090159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff08f7fe640 1 -- 172.21.15.79:0/1396016236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff090157100 con 0x7ff09006df50 2024-04-25T02:10:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.393+0000 7ff08f7fe640 1 --2- 172.21.15.79:0/1396016236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09006df50 0x7ff0900b0a80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff08000c450 tx=0x7ff08000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.394+0000 7ff077fff640 1 -- 172.21.15.79:0/1396016236 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0800052d0 con 0x7ff09006df50 2024-04-25T02:10:35.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.394+0000 7ff077fff640 1 -- 172.21.15.79:0/1396016236 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff080005470 con 0x7ff09006df50 2024-04-25T02:10:35.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.394+0000 7ff095b09640 1 -- 172.21.15.79:0/1396016236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff090157a30 con 0x7ff09006df50 2024-04-25T02:10:35.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.394+0000 7ff077fff640 1 -- 172.21.15.79:0/1396016236 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080012870 con 0x7ff09006df50 2024-04-25T02:10:35.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.394+0000 7ff095b09640 1 -- 172.21.15.79:0/1396016236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0900b1020 con 0x7ff09006df50 2024-04-25T02:10:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.395+0000 7ff095b09640 1 -- 172.21.15.79:0/1396016236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff090068a10 con 0x7ff09006df50 2024-04-25T02:10:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.396+0000 7ff077fff640 1 -- 172.21.15.79:0/1396016236 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff080012a10 con 0x7ff09006df50 2024-04-25T02:10:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.396+0000 7ff077fff640 1 --2- 172.21.15.79:0/1396016236 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff07c06be30 0x7ff07c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.396+0000 7ff08effd640 1 --2- 172.21.15.79:0/1396016236 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff07c06be30 0x7ff07c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.396+0000 7ff077fff640 1 -- 172.21.15.79:0/1396016236 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7ff08008a910 con 0x7ff09006df50 2024-04-25T02:10:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.397+0000 7ff08effd640 1 --2- 172.21.15.79:0/1396016236 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff07c06be30 0x7ff07c06e2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff09015e780 tx=0x7ff084007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:35.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.401+0000 7ff077fff640 1 -- 172.21.15.79:0/1396016236 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff090068a10 con 0x7ff09006df50 2024-04-25T02:10:35.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.612+0000 7ff095b09640 1 -- 172.21.15.79:0/1396016236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff090157820 con 0x7ff09006df50 2024-04-25T02:10:35.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.613+0000 7ff077fff640 1 -- 172.21.15.79:0/1396016236 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7ff080058c70 con 0x7ff09006df50 2024-04-25T02:10:35.621 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:10:35.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.615+0000 7ff095b09640 1 -- 172.21.15.79:0/1396016236 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff07c06be30 msgr2=0x7ff07c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.615+0000 7ff095b09640 1 --2- 172.21.15.79:0/1396016236 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff07c06be30 0x7ff07c06e2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff09015e780 tx=0x7ff084007d30 comp rx=0 tx=0).stop 2024-04-25T02:10:35.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.615+0000 7ff095b09640 1 -- 172.21.15.79:0/1396016236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09006df50 msgr2=0x7ff0900b0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:35.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.615+0000 7ff095b09640 1 --2- 172.21.15.79:0/1396016236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09006df50 0x7ff0900b0a80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff08000c450 tx=0x7ff08000c910 comp rx=0 tx=0).stop 2024-04-25T02:10:35.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.615+0000 7ff095b09640 1 -- 172.21.15.79:0/1396016236 shutdown_connections 2024-04-25T02:10:35.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.615+0000 7ff095b09640 1 --2- 172.21.15.79:0/1396016236 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff07c06be30 0x7ff07c06e2f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.615+0000 7ff095b09640 1 --2- 172.21.15.79:0/1396016236 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff090143bc0 0x7ff0901e7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.615+0000 7ff095b09640 1 --2- 172.21.15.79:0/1396016236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff09006e3b0 0x7ff090159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.615+0000 7ff095b09640 1 --2- 172.21.15.79:0/1396016236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09006df50 0x7ff0900b0a80 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:35.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.615+0000 7ff095b09640 1 -- 172.21.15.79:0/1396016236 >> 172.21.15.79:0/1396016236 conn(0x7ff0900cfc80 msgr2=0x7ff090070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:35.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.615+0000 7ff095b09640 1 -- 172.21.15.79:0/1396016236 shutdown_connections 2024-04-25T02:10:35.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35.615+0000 7ff095b09640 1 -- 172.21.15.79:0/1396016236 wait complete. 2024-04-25T02:10:35.633 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:10:35.634 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:10:35.634 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:10:35.634 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:10:35.634 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:10:35.634 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:10:35.634 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:10:35.634 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:10:35.634 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:10:35.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:35.634 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:10:35.649 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:10:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:10:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42570sec preferred_lft 42570sec 2024-04-25T02:10:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:10:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:10:35.651 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:10:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:10:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:10:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:10:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:10:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:10:35.651 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:10:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:10:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link 2024-04-25T02:10:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:10:35.651 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:10:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:10:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::4c:adff:fe56:7194/64 scope link 2024-04-25T02:10:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:10:35.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:35.652 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:10:35.711 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:10:35.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:35.713 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:10:35.769 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:10:35.769 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:10:35.769 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:10:35.769 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:10:35.769 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:10:35.769 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:10:35.769 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:10:35.770 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:10:35.770 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:10:35.770 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:10:35.770 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:10:35.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:10:35.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:10:35.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:35.892 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:10:35.907 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:10:35.907 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:10:35.907 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:10:35.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:35.907 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:10:35.973 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:10:35.973 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:10:36.025 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:10:36.025 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:10:36.025 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:10:36.079 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:10:36.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:36.080 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:10:36.160 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:10:36.161 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:10:36.161 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:10:36.169 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:10:36.169 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:10:36.169 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:10:36.169 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:10:36.169 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:10:36.174 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:10:36.174 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:10:36.174 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:10:36.174 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:10:36.174 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:10:36.174 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:10:36.174 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:10:36.174 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:10:36.175 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:10:36.175 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:10:36.175 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:10:36.175 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:10:36.175 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:10:36.176 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:10:36.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:36.176 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:10:36.241 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:10:36.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:10:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:10:36.337 INFO:teuthology.orchestra.run.smithi079.stdout:client6297 2024-04-25T02:10:36.337 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:10:36.337 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:10:36.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:36.352 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2024-04-25T02:10:36.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:36.410 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2024-04-25T02:10:36.466 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:10:36.466 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:10:36.466 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:10:36.466 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:10:36.466 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2024-04-25T02:10:36.466 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:10:36.570 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627777 2024-04-25T02:10:36.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:10:36.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:10:36.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.708+0000 7fc57d85d640 1 Processor -- start 2024-04-25T02:10:36.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.708+0000 7fc57d85d640 1 -- start start 2024-04-25T02:10:36.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.708+0000 7fc57d85d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc578161b90 0x7fc5780d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:36.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.709+0000 7fc57d85d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc5780d0a60 0x7fc5780d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:36.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.709+0000 7fc57d85d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5780ceed0 con 0x7fc5780d47e0 2024-04-25T02:10:36.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.709+0000 7fc57d85d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc5780ceca0 con 0x7fc578161b90 2024-04-25T02:10:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.709+0000 7fc57d85d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc5780d4f80 con 0x7fc5780d0a60 2024-04-25T02:10:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.709+0000 7fc576ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc578161b90 0x7fc5780d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.709+0000 7fc5767fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc5780d47e0 0x7fc5780cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38066/0 (socket says 172.21.15.79:38066) 2024-04-25T02:10:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.709+0000 7fc576ffd640 1 --2- 172.21.15.79:0/1459002349 >> v2:172.21.15.79:3300/0 conn(0x7fc578161b90 0x7fc5780d2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40374/0 (socket says 172.21.15.79:40374) 2024-04-25T02:10:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.709+0000 7fc5767fc640 1 -- 172.21.15.79:0/1459002349 learned_addr learned my addr 172.21.15.79:0/1459002349 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.709+0000 7fc5777fe640 1 --2- 172.21.15.79:0/1459002349 >> v2:172.21.15.189:3300/0 conn(0x7fc5780d0a60 0x7fc5780d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.709+0000 7fc576ffd640 1 -- 172.21.15.79:0/1459002349 >> v2:172.21.15.189:3300/0 conn(0x7fc5780d0a60 msgr2=0x7fc5780d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.709+0000 7fc576ffd640 1 --2- 172.21.15.79:0/1459002349 >> v2:172.21.15.189:3300/0 conn(0x7fc5780d0a60 0x7fc5780d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.709+0000 7fc576ffd640 1 -- 172.21.15.79:0/1459002349 >> v1:172.21.15.79:6789/0 conn(0x7fc5780d47e0 legacy=0x7fc5780cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.709+0000 7fc575ffb640 1 -- 172.21.15.79:0/1459002349 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 472563597 0 0) 0x7fc5780ceed0 con 0x7fc5780d47e0 2024-04-25T02:10:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.709+0000 7fc576ffd640 1 -- 172.21.15.79:0/1459002349 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5780cf1b0 con 0x7fc578161b90 2024-04-25T02:10:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.709+0000 7fc5777fe640 1 --2- 172.21.15.79:0/1459002349 >> v2:172.21.15.189:3300/0 conn(0x7fc5780d0a60 0x7fc5780d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.710+0000 7fc576ffd640 1 --2- 172.21.15.79:0/1459002349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc578161b90 0x7fc5780d2da0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc5780d06a0 tx=0x7fc56802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb94022175ea414 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.710+0000 7fc575ffb640 1 -- 172.21.15.79:0/1459002349 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc568037070 con 0x7fc578161b90 2024-04-25T02:10:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.710+0000 7fc575ffb640 1 -- 172.21.15.79:0/1459002349 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc568032440 con 0x7fc578161b90 2024-04-25T02:10:36.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.710+0000 7fc575ffb640 1 -- 172.21.15.79:0/1459002349 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc568032810 con 0x7fc578161b90 2024-04-25T02:10:36.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.710+0000 7fc57d85d640 1 -- 172.21.15.79:0/1459002349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc578161b90 msgr2=0x7fc5780d2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:36.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.710+0000 7fc57d85d640 1 --2- 172.21.15.79:0/1459002349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc578161b90 0x7fc5780d2da0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc5780d06a0 tx=0x7fc56802a1a0 comp rx=0 tx=0).stop 2024-04-25T02:10:36.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.710+0000 7fc57d85d640 1 -- 172.21.15.79:0/1459002349 shutdown_connections 2024-04-25T02:10:36.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.710+0000 7fc57d85d640 1 --2- 172.21.15.79:0/1459002349 >> v2:172.21.15.189:3300/0 conn(0x7fc5780d0a60 0x7fc5780d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:36.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.710+0000 7fc57d85d640 1 --2- 172.21.15.79:0/1459002349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc578161b90 0x7fc5780d2da0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:36.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.710+0000 7fc57d85d640 1 -- 172.21.15.79:0/1459002349 >> 172.21.15.79:0/1459002349 conn(0x7fc57809d460 msgr2=0x7fc5780d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:36.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.710+0000 7fc57d85d640 1 -- 172.21.15.79:0/1459002349 shutdown_connections 2024-04-25T02:10:36.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.711+0000 7fc57d85d640 1 -- 172.21.15.79:0/1459002349 wait complete. 2024-04-25T02:10:36.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.712+0000 7fc57d85d640 1 Processor -- start 2024-04-25T02:10:36.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.712+0000 7fc57d85d640 1 -- start start 2024-04-25T02:10:36.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.712+0000 7fc57d85d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc5780d0a60 0x7fc578159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:36.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.712+0000 7fc57d85d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5780d47e0 0x7fc5780cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:36.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.712+0000 7fc57d85d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc578161b90 0x7fc5780cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:36.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.712+0000 7fc57d85d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc5780cf770 con 0x7fc5780d47e0 2024-04-25T02:10:36.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.712+0000 7fc57d85d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc5780d13d0 con 0x7fc578161b90 2024-04-25T02:10:36.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.712+0000 7fc57d85d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc5780d4c70 con 0x7fc5780d0a60 2024-04-25T02:10:36.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc5767fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5780d47e0 0x7fc5780cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:36.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc5767fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5780d47e0 0x7fc5780cd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40386/0 (socket says 172.21.15.79:40386) 2024-04-25T02:10:36.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc5767fc640 1 -- 172.21.15.79:0/3624515972 learned_addr learned my addr 172.21.15.79:0/3624515972 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:36.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc576ffd640 1 --2- 172.21.15.79:0/3624515972 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc5780d0a60 0x7fc578159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:36.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc5777fe640 1 --2- 172.21.15.79:0/3624515972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc578161b90 0x7fc5780cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:36.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc5767fc640 1 -- 172.21.15.79:0/3624515972 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc5780d0a60 msgr2=0x7fc578159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:36.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc5767fc640 1 --2- 172.21.15.79:0/3624515972 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc5780d0a60 0x7fc578159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:36.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc5767fc640 1 -- 172.21.15.79:0/3624515972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc578161b90 msgr2=0x7fc5780cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:36.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc5767fc640 1 --2- 172.21.15.79:0/3624515972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc578161b90 0x7fc5780cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:36.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc5767fc640 1 -- 172.21.15.79:0/3624515972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5780cbdd0 con 0x7fc5780d47e0 2024-04-25T02:10:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc576ffd640 1 --2- 172.21.15.79:0/3624515972 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc5780d0a60 0x7fc578159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc5767fc640 1 --2- 172.21.15.79:0/3624515972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5780d47e0 0x7fc5780cd580 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00c4d0 tx=0x7fc56c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc55ffff640 1 -- 172.21.15.79:0/3624515972 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c018070 con 0x7fc5780d47e0 2024-04-25T02:10:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc55ffff640 1 -- 172.21.15.79:0/3624515972 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56c007500 con 0x7fc5780d47e0 2024-04-25T02:10:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc57d85d640 1 -- 172.21.15.79:0/3624515972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5781f7400 con 0x7fc5780d47e0 2024-04-25T02:10:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc55ffff640 1 -- 172.21.15.79:0/3624515972 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c004a20 con 0x7fc5780d47e0 2024-04-25T02:10:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.713+0000 7fc57d85d640 1 -- 172.21.15.79:0/3624515972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5781f79c0 con 0x7fc5780d47e0 2024-04-25T02:10:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.714+0000 7fc57d85d640 1 -- 172.21.15.79:0/3624515972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5781f71f0 con 0x7fc5780d47e0 2024-04-25T02:10:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.715+0000 7fc55ffff640 1 -- 172.21.15.79:0/3624515972 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc56c01b070 con 0x7fc5780d47e0 2024-04-25T02:10:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.715+0000 7fc55ffff640 1 --2- 172.21.15.79:0/3624515972 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc56406be30 0x7fc56406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.715+0000 7fc55ffff640 1 -- 172.21.15.79:0/3624515972 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fc56c08a1a0 con 0x7fc5780d47e0 2024-04-25T02:10:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.715+0000 7fc576ffd640 1 --2- 172.21.15.79:0/3624515972 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc56406be30 0x7fc56406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:36.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.715+0000 7fc576ffd640 1 --2- 172.21.15.79:0/3624515972 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc56406be30 0x7fc56406e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc568034000 tx=0x7fc56802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:36.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.719+0000 7fc55ffff640 1 -- 172.21.15.79:0/3624515972 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc56c058b40 con 0x7fc5780d47e0 2024-04-25T02:10:36.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.928+0000 7fc57d85d640 1 -- 172.21.15.79:0/3624515972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5780690a0 con 0x7fc5780d47e0 2024-04-25T02:10:36.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.928+0000 7fc55ffff640 1 -- 172.21.15.79:0/3624515972 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5184 (secure 0 0 0) 0x7fc56c058440 con 0x7fc5780d47e0 2024-04-25T02:10:36.936 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:36.936 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5431,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3495029157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3495029157},{"type":"v1","addr":"172.21.15.189:6834","nonce":3495029157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2036557544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2036557544},{"type":"v1","addr":"172.21.15.189:6835","nonce":2036557544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/326759836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":326759836},{"type":"v1","addr":"172.21.15.79:6836","nonce":326759836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:25.684570+0000","modified":"2024-04-25T02:10:27.688419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2253487658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2253487658},{"type":"v1","addr":"172.21.15.79:6837","nonce":2253487658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":4}]} 2024-04-25T02:10:36.936 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 24 2024-04-25T02:10:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.930+0000 7fc57d85d640 1 -- 172.21.15.79:0/3624515972 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc56406be30 msgr2=0x7fc56406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.930+0000 7fc57d85d640 1 --2- 172.21.15.79:0/3624515972 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc56406be30 0x7fc56406e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc568034000 tx=0x7fc56802e000 comp rx=0 tx=0).stop 2024-04-25T02:10:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.930+0000 7fc57d85d640 1 -- 172.21.15.79:0/3624515972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5780d47e0 msgr2=0x7fc5780cd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.930+0000 7fc57d85d640 1 --2- 172.21.15.79:0/3624515972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5780d47e0 0x7fc5780cd580 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00c4d0 tx=0x7fc56c00c990 comp rx=0 tx=0).stop 2024-04-25T02:10:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.930+0000 7fc57d85d640 1 -- 172.21.15.79:0/3624515972 shutdown_connections 2024-04-25T02:10:36.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.930+0000 7fc57d85d640 1 --2- 172.21.15.79:0/3624515972 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc56406be30 0x7fc56406e2f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:36.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.930+0000 7fc57d85d640 1 --2- 172.21.15.79:0/3624515972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc578161b90 0x7fc5780cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:36.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.930+0000 7fc57d85d640 1 --2- 172.21.15.79:0/3624515972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5780d47e0 0x7fc5780cd580 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:36.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.930+0000 7fc57d85d640 1 --2- 172.21.15.79:0/3624515972 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc5780d0a60 0x7fc578159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:36.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.930+0000 7fc57d85d640 1 -- 172.21.15.79:0/3624515972 >> 172.21.15.79:0/3624515972 conn(0x7fc57809d460 msgr2=0x7fc5780b3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:36.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.930+0000 7fc57d85d640 1 -- 172.21.15.79:0/3624515972 shutdown_connections 2024-04-25T02:10:36.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:36.930+0000 7fc57d85d640 1 -- 172.21.15.79:0/3624515972 wait complete. 2024-04-25T02:10:36.949 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T02:10:37.070 INFO:teuthology.orchestra.run.smithi079.stdout:{"message":"","return_code":0} 2024-04-25T02:10:37.070 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T02:10:37.070 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T02:10:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.104+0000 7f3c02137f40 1 Processor -- start 2024-04-25T02:10:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.104+0000 7f3c02137f40 1 -- start start 2024-04-25T02:10:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3c02137f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c5e9ed690 0x557c5eac4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3c02137f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c5e9eda70 0x557c5eaba590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3c02137f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5eaa7c10 0x557c5eabaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3c02137f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557c5ea37a30 con 0x557c5eaa7c10 2024-04-25T02:10:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3c02137f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557c5e994640 con 0x557c5e9ed690 2024-04-25T02:10:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3c02137f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x557c5eac2e60 con 0x557c5e9eda70 2024-04-25T02:10:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3c00439640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5eaa7c10 0x557c5eabaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3c00439640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5eaa7c10 0x557c5eabaad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40408/0 (socket says 172.21.15.79:40408) 2024-04-25T02:10:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3c00439640 1 -- 172.21.15.79:0/4123012336 learned_addr learned my addr 172.21.15.79:0/4123012336 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3bffc38640 1 --2- 172.21.15.79:0/4123012336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c5e9ed690 0x557c5eac4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3bff437640 1 --2- 172.21.15.79:0/4123012336 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c5e9eda70 0x557c5eaba590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3c00439640 1 -- 172.21.15.79:0/4123012336 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c5e9eda70 msgr2=0x557c5eaba590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3c00439640 1 --2- 172.21.15.79:0/4123012336 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c5e9eda70 0x557c5eaba590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3c00439640 1 -- 172.21.15.79:0/4123012336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c5e9ed690 msgr2=0x557c5eac4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3c00439640 1 --2- 172.21.15.79:0/4123012336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c5e9ed690 0x557c5eac4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3c00439640 1 -- 172.21.15.79:0/4123012336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c5eaa6910 con 0x557c5eaa7c10 2024-04-25T02:10:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.105+0000 7f3bff437640 1 --2- 172.21.15.79:0/4123012336 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c5e9eda70 0x557c5eaba590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.106+0000 7f3c00439640 1 --2- 172.21.15.79:0/4123012336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5eaa7c10 0x557c5eabaad0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800b590 tx=0x7f3bf800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe827f0ed8c13e89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.106+0000 7f3bfe435640 1 -- 172.21.15.79:0/4123012336 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8014070 con 0x557c5eaa7c10 2024-04-25T02:10:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.106+0000 7f3bfe435640 1 -- 172.21.15.79:0/4123012336 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf8010800 con 0x557c5eaa7c10 2024-04-25T02:10:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.106+0000 7f3bfe435640 1 -- 172.21.15.79:0/4123012336 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8010bf0 con 0x557c5eaa7c10 2024-04-25T02:10:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.106+0000 7f3c02137f40 1 -- 172.21.15.79:0/4123012336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5eaa7c10 msgr2=0x557c5eabaad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.106+0000 7f3c02137f40 1 --2- 172.21.15.79:0/4123012336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5eaa7c10 0x557c5eabaad0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800b590 tx=0x7f3bf800ba50 comp rx=0 tx=0).stop 2024-04-25T02:10:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.106+0000 7f3c02137f40 1 -- 172.21.15.79:0/4123012336 shutdown_connections 2024-04-25T02:10:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.106+0000 7f3c02137f40 1 --2- 172.21.15.79:0/4123012336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5eaa7c10 0x557c5eabaad0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.106+0000 7f3c02137f40 1 --2- 172.21.15.79:0/4123012336 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c5e9eda70 0x557c5eaba590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.106+0000 7f3c02137f40 1 --2- 172.21.15.79:0/4123012336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c5e9ed690 0x557c5eac4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.106+0000 7f3c02137f40 1 -- 172.21.15.79:0/4123012336 >> 172.21.15.79:0/4123012336 conn(0x557c5ea19920 msgr2=0x557c5ea35aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.106+0000 7f3c02137f40 1 -- 172.21.15.79:0/4123012336 shutdown_connections 2024-04-25T02:10:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.106+0000 7f3c02137f40 1 -- 172.21.15.79:0/4123012336 wait complete. 2024-04-25T02:10:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.107+0000 7f3c02137f40 1 Processor -- start 2024-04-25T02:10:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.107+0000 7f3c02137f40 1 -- start start 2024-04-25T02:10:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.107+0000 7f3c02137f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5e9ed690 0x557c5ea35aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.107+0000 7f3c02137f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c5e9eda70 0x557c5eab8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.107+0000 7f3c02137f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c5eaa7c10 0x557c5eb5e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.107+0000 7f3c02137f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557c5eaa6370 con 0x557c5e9ed690 2024-04-25T02:10:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.107+0000 7f3c02137f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557c5ea17b90 con 0x557c5eaa7c10 2024-04-25T02:10:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.107+0000 7f3c02137f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x557c5ea341f0 con 0x557c5e9eda70 2024-04-25T02:10:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3bffc38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5e9ed690 0x557c5ea35aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3bffc38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5e9ed690 0x557c5ea35aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40424/0 (socket says 172.21.15.79:40424) 2024-04-25T02:10:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3bffc38640 1 -- 172.21.15.79:0/3248142080 learned_addr learned my addr 172.21.15.79:0/3248142080 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3bff437640 1 --2- 172.21.15.79:0/3248142080 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c5e9eda70 0x557c5eab8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3c00439640 1 --2- 172.21.15.79:0/3248142080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c5eaa7c10 0x557c5eb5e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3bffc38640 1 -- 172.21.15.79:0/3248142080 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c5e9eda70 msgr2=0x557c5eab8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3bffc38640 1 --2- 172.21.15.79:0/3248142080 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c5e9eda70 0x557c5eab8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3bffc38640 1 -- 172.21.15.79:0/3248142080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c5eaa7c10 msgr2=0x557c5eb5e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3bffc38640 1 --2- 172.21.15.79:0/3248142080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c5eaa7c10 0x557c5eb5e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3bffc38640 1 -- 172.21.15.79:0/3248142080 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c5ea35fe0 con 0x557c5e9ed690 2024-04-25T02:10:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3bffc38640 1 --2- 172.21.15.79:0/3248142080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5e9ed690 0x557c5ea35aa0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0002c80 tx=0x7f3bf000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3bfd433640 1 -- 172.21.15.79:0/3248142080 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0015070 con 0x557c5e9ed690 2024-04-25T02:10:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3bfd433640 1 -- 172.21.15.79:0/3248142080 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf0011640 con 0x557c5e9ed690 2024-04-25T02:10:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3c02137f40 1 -- 172.21.15.79:0/3248142080 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c5eac1cb0 con 0x557c5e9ed690 2024-04-25T02:10:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3bfd433640 1 -- 172.21.15.79:0/3248142080 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0011a30 con 0x557c5e9ed690 2024-04-25T02:10:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.108+0000 7f3c02137f40 1 -- 172.21.15.79:0/3248142080 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c5ea1cbe0 con 0x557c5e9ed690 2024-04-25T02:10:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.110+0000 7f3bfd433640 1 -- 172.21.15.79:0/3248142080 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3bf0018070 con 0x557c5e9ed690 2024-04-25T02:10:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.110+0000 7f3bfd433640 1 --2- 172.21.15.79:0/3248142080 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3bec06a840 0x7f3bec06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.110+0000 7f3bfd433640 1 -- 172.21.15.79:0/3248142080 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f3bf00899f0 con 0x557c5e9ed690 2024-04-25T02:10:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.110+0000 7f3bff437640 1 --2- 172.21.15.79:0/3248142080 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3bec06a840 0x7f3bec06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.110+0000 7f3c02137f40 1 --2- 172.21.15.79:0/3248142080 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x557c5eac1820 0x557c5eb501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.110+0000 7f3c02137f40 1 -- 172.21.15.79:0/3248142080 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59) -- 0x557c5eb506f0 con 0x557c5eac1820 2024-04-25T02:10:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.110+0000 7f3bff437640 1 --2- 172.21.15.79:0/3248142080 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3bec06a840 0x7f3bec06cd00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4057000 tx=0x7f3bf4060040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.111+0000 7f3c00439640 1 --2- 172.21.15.79:0/3248142080 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x557c5eac1820 0x557c5eb501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.111+0000 7f3c00439640 1 --2- 172.21.15.79:0/3248142080 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x557c5eac1820 0x557c5eb501b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.111+0000 7f3c00439640 1 -- 172.21.15.79:0/3248142080 <== osd.5 v2:172.21.15.189:6802/1246927196 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) ==== 164+0+94 (crc 0 0 0) 0x7f3bf8010ad0 con 0x557c5eac1820 2024-04-25T02:10:37.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.111+0000 7f3c02137f40 1 -- 172.21.15.79:0/3248142080 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x557c5eac1820 msgr2=0x557c5eb501b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.111+0000 7f3c02137f40 1 --2- 172.21.15.79:0/3248142080 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x557c5eac1820 0x557c5eb501b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.111+0000 7f3c02137f40 1 -- 172.21.15.79:0/3248142080 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3bec06a840 msgr2=0x7f3bec06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.111+0000 7f3c02137f40 1 --2- 172.21.15.79:0/3248142080 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3bec06a840 0x7f3bec06cd00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4057000 tx=0x7f3bf4060040 comp rx=0 tx=0).stop 2024-04-25T02:10:37.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.111+0000 7f3c02137f40 1 -- 172.21.15.79:0/3248142080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5e9ed690 msgr2=0x557c5ea35aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.111+0000 7f3c02137f40 1 --2- 172.21.15.79:0/3248142080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5e9ed690 0x557c5ea35aa0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0002c80 tx=0x7f3bf000b5b0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.111+0000 7f3c00439640 1 -- 172.21.15.79:0/3248142080 reap_dead start 2024-04-25T02:10:37.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.111+0000 7f3c02137f40 1 -- 172.21.15.79:0/3248142080 shutdown_connections 2024-04-25T02:10:37.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.112+0000 7f3c02137f40 1 -- 172.21.15.79:0/3248142080 >> 172.21.15.79:0/3248142080 conn(0x557c5ea19920 msgr2=0x557c5eac3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.112+0000 7f3c02137f40 1 -- 172.21.15.79:0/3248142080 shutdown_connections 2024-04-25T02:10:37.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.112+0000 7f3c02137f40 1 -- 172.21.15.79:0/3248142080 wait complete. 2024-04-25T02:10:37.126 INFO:teuthology.orchestra.run.smithi079.stdout:Xfiledir_test 2024-04-25T02:10:37.126 DEBUG:teuthology.orchestra.run.smithi079:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T02:10:37.213 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:10:37.213 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627777, 2024-04-25T02:10:37.213 INFO:teuthology.orchestra.run.smithi079.stdout: "ancestors": [ 2024-04-25T02:10:37.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:37.213 INFO:teuthology.orchestra.run.smithi079.stdout: "dirino": 1099511627776, 2024-04-25T02:10:37.213 INFO:teuthology.orchestra.run.smithi079.stdout: "dname": "file", 2024-04-25T02:10:37.214 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 2 2024-04-25T02:10:37.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:10:37.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:10:37.214 INFO:teuthology.orchestra.run.smithi079.stdout: "dirino": 1, 2024-04-25T02:10:37.214 INFO:teuthology.orchestra.run.smithi079.stdout: "dname": "dir_test", 2024-04-25T02:10:37.214 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 4 2024-04-25T02:10:37.214 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:37.214 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-04-25T02:10:37.214 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 9, 2024-04-25T02:10:37.214 INFO:teuthology.orchestra.run.smithi079.stdout: "old_pools": [] 2024-04-25T02:10:37.214 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:10:37.214 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:10:37.216 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2024-04-25T02:10:37.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.290+0000 7f25131b7f40 1 Processor -- start 2024-04-25T02:10:37.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.290+0000 7f25131b7f40 1 -- start start 2024-04-25T02:10:37.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f25131b7f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf01f5af20 0x55bf01f70df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f25131b7f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf01f75510 0x55bf01f72c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f25131b7f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf02000610 0x55bf02001610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f25131b7f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf01f293f0 con 0x55bf02000610 2024-04-25T02:10:37.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f25131b7f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bf01ed2640 con 0x55bf01f5af20 2024-04-25T02:10:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f25131b7f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55bf01f299b0 con 0x55bf01f75510 2024-04-25T02:10:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f25114b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf02000610 0x55bf02001610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f25114b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf02000610 0x55bf02001610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40444/0 (socket says 172.21.15.79:40444) 2024-04-25T02:10:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f25114b9640 1 -- 172.21.15.79:0/1522548916 learned_addr learned my addr 172.21.15.79:0/1522548916 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f25104b7640 1 --2- 172.21.15.79:0/1522548916 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf01f75510 0x55bf01f72c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f2510cb8640 1 --2- 172.21.15.79:0/1522548916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf01f5af20 0x55bf01f70df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f25114b9640 1 -- 172.21.15.79:0/1522548916 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf01f75510 msgr2=0x55bf01f72c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f25114b9640 1 --2- 172.21.15.79:0/1522548916 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf01f75510 0x55bf01f72c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f25114b9640 1 -- 172.21.15.79:0/1522548916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf01f5af20 msgr2=0x55bf01f70df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f25114b9640 1 --2- 172.21.15.79:0/1522548916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf01f5af20 0x55bf01f70df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f25114b9640 1 -- 172.21.15.79:0/1522548916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf02092cd0 con 0x55bf02000610 2024-04-25T02:10:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.291+0000 7f2510cb8640 1 --2- 172.21.15.79:0/1522548916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf01f5af20 0x55bf01f70df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.292+0000 7f25114b9640 1 --2- 172.21.15.79:0/1522548916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf02000610 0x55bf02001610 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2508046060 tx=0x7f2508051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eefbae3ddef75c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.292+0000 7f250f4b5640 1 -- 172.21.15.79:0/1522548916 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508068070 con 0x55bf02000610 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.292+0000 7f250f4b5640 1 -- 172.21.15.79:0/1522548916 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25080517c0 con 0x55bf02000610 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.292+0000 7f250f4b5640 1 -- 172.21.15.79:0/1522548916 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508055040 con 0x55bf02000610 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.292+0000 7f25131b7f40 1 -- 172.21.15.79:0/1522548916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf02000610 msgr2=0x55bf02001610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.292+0000 7f25131b7f40 1 --2- 172.21.15.79:0/1522548916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf02000610 0x55bf02001610 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2508046060 tx=0x7f2508051000 comp rx=0 tx=0).stop 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.292+0000 7f25131b7f40 1 -- 172.21.15.79:0/1522548916 shutdown_connections 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.292+0000 7f25131b7f40 1 --2- 172.21.15.79:0/1522548916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf02000610 0x55bf02001610 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.292+0000 7f25131b7f40 1 --2- 172.21.15.79:0/1522548916 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf01f75510 0x55bf01f72c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.292+0000 7f25131b7f40 1 --2- 172.21.15.79:0/1522548916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf01f5af20 0x55bf01f70df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.292+0000 7f25131b7f40 1 -- 172.21.15.79:0/1522548916 >> 172.21.15.79:0/1522548916 conn(0x55bf01f55880 msgr2=0x55bf02003580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.292+0000 7f25131b7f40 1 -- 172.21.15.79:0/1522548916 shutdown_connections 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.292+0000 7f25131b7f40 1 -- 172.21.15.79:0/1522548916 wait complete. 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.293+0000 7f25131b7f40 1 Processor -- start 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.293+0000 7f25131b7f40 1 -- start start 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25131b7f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf01f5af20 0x55bf01ff0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25131b7f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf01f75510 0x55bf01ff6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25131b7f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf02000610 0x55bf01ff67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25131b7f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf02092fb0 con 0x55bf02000610 2024-04-25T02:10:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25131b7f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bf01f72060 con 0x55bf01f75510 2024-04-25T02:10:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25131b7f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55bf01ff8130 con 0x55bf01f5af20 2024-04-25T02:10:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25114b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf02000610 0x55bf01ff67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25114b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf02000610 0x55bf01ff67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40446/0 (socket says 172.21.15.79:40446) 2024-04-25T02:10:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25114b9640 1 -- 172.21.15.79:0/3550658209 learned_addr learned my addr 172.21.15.79:0/3550658209 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25104b7640 1 --2- 172.21.15.79:0/3550658209 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf01f75510 0x55bf01ff6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f2510cb8640 1 --2- 172.21.15.79:0/3550658209 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf01f5af20 0x55bf01ff0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25114b9640 1 -- 172.21.15.79:0/3550658209 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf01f5af20 msgr2=0x55bf01ff0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25114b9640 1 --2- 172.21.15.79:0/3550658209 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf01f5af20 0x55bf01ff0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25114b9640 1 -- 172.21.15.79:0/3550658209 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf01f75510 msgr2=0x55bf01ff6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25114b9640 1 --2- 172.21.15.79:0/3550658209 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf01f75510 0x55bf01ff6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25114b9640 1 -- 172.21.15.79:0/3550658209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf01ff3560 con 0x55bf02000610 2024-04-25T02:10:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f2510cb8640 1 --2- 172.21.15.79:0/3550658209 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf01f5af20 0x55bf01ff0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25114b9640 1 --2- 172.21.15.79:0/3550658209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf02000610 0x55bf01ff67c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2508066040 tx=0x7f2508003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f250e4b3640 1 -- 172.21.15.79:0/3550658209 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508073070 con 0x55bf02000610 2024-04-25T02:10:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f250e4b3640 1 -- 172.21.15.79:0/3550658209 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f250805a510 con 0x55bf02000610 2024-04-25T02:10:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25131b7f40 1 -- 172.21.15.79:0/3550658209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf01f597c0 con 0x55bf02000610 2024-04-25T02:10:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f250e4b3640 1 -- 172.21.15.79:0/3550658209 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508068040 con 0x55bf02000610 2024-04-25T02:10:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.294+0000 7f25131b7f40 1 -- 172.21.15.79:0/3550658209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf01f71920 con 0x55bf02000610 2024-04-25T02:10:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.296+0000 7f250e4b3640 1 -- 172.21.15.79:0/3550658209 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2508058070 con 0x55bf02000610 2024-04-25T02:10:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.296+0000 7f250e4b3640 1 --2- 172.21.15.79:0/3550658209 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f24fc06a810 0x7f24fc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.296+0000 7f250e4b3640 1 -- 172.21.15.79:0/3550658209 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f25080ce9c0 con 0x55bf02000610 2024-04-25T02:10:37.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.296+0000 7f2510cb8640 1 --2- 172.21.15.79:0/3550658209 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f24fc06a810 0x7f24fc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.296+0000 7f25131b7f40 1 --2- 172.21.15.79:0/3550658209 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55bf01ff6d00 0x55bf020a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.296+0000 7f25131b7f40 1 -- 172.21.15.79:0/3550658209 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59) -- 0x55bf01f74a40 con 0x55bf01ff6d00 2024-04-25T02:10:37.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.296+0000 7f2510cb8640 1 --2- 172.21.15.79:0/3550658209 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f24fc06a810 0x7f24fc06ccd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55bf02003ec0 tx=0x7f25000058e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.296+0000 7f25104b7640 1 --2- 172.21.15.79:0/3550658209 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55bf01ff6d00 0x55bf020a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.297+0000 7f25104b7640 1 --2- 172.21.15.79:0/3550658209 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55bf01ff6d00 0x55bf020a6150 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.298+0000 7f25104b7640 1 -- 172.21.15.79:0/3550658209 <== osd.5 v2:172.21.15.189:6802/1246927196 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v59'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f250400f710 con 0x55bf01ff6d00 2024-04-25T02:10:37.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.298+0000 7f25131b7f40 1 -- 172.21.15.79:0/3550658209 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55bf01ff6d00 msgr2=0x55bf020a6150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.298+0000 7f25131b7f40 1 --2- 172.21.15.79:0/3550658209 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55bf01ff6d00 0x55bf020a6150 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.298+0000 7f25131b7f40 1 -- 172.21.15.79:0/3550658209 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f24fc06a810 msgr2=0x7f24fc06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.298+0000 7f25131b7f40 1 --2- 172.21.15.79:0/3550658209 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f24fc06a810 0x7f24fc06ccd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55bf02003ec0 tx=0x7f25000058e0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.298+0000 7f25131b7f40 1 -- 172.21.15.79:0/3550658209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf02000610 msgr2=0x55bf01ff67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.298+0000 7f25131b7f40 1 --2- 172.21.15.79:0/3550658209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf02000610 0x55bf01ff67c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2508066040 tx=0x7f2508003330 comp rx=0 tx=0).stop 2024-04-25T02:10:37.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.298+0000 7f25114b9640 1 -- 172.21.15.79:0/3550658209 reap_dead start 2024-04-25T02:10:37.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.298+0000 7f25131b7f40 1 -- 172.21.15.79:0/3550658209 shutdown_connections 2024-04-25T02:10:37.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.298+0000 7f25131b7f40 1 -- 172.21.15.79:0/3550658209 >> 172.21.15.79:0/3550658209 conn(0x55bf01f55880 msgr2=0x55bf01f72be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.298+0000 7f25131b7f40 1 -- 172.21.15.79:0/3550658209 shutdown_connections 2024-04-25T02:10:37.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.298+0000 7f25131b7f40 1 -- 172.21.15.79:0/3550658209 wait complete. 2024-04-25T02:10:37.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:37.311 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2024-04-25T02:10:37.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.444+0000 7faafdff9640 1 Processor -- start 2024-04-25T02:10:37.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.444+0000 7faafdff9640 1 -- start start 2024-04-25T02:10:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.445+0000 7faafdff9640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7faaf80cde10 0x7faaf80d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.445+0000 7faafdff9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaf80cee10 0x7faaf815daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.445+0000 7faafdff9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaf806f250 con 0x7faaf80d1080 2024-04-25T02:10:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.445+0000 7faafdff9640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7faaf806f000 con 0x7faaf80cde10 2024-04-25T02:10:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.445+0000 7faafdff9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faaf80cd4e0 con 0x7faaf80cee10 2024-04-25T02:10:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.445+0000 7faaf6ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faaf80d1080 0x7faaf80ce700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38080/0 (socket says 172.21.15.79:38080) 2024-04-25T02:10:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.445+0000 7faaf6ffd640 1 -- 172.21.15.79:0/3907845492 learned_addr learned my addr 172.21.15.79:0/3907845492 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:10:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 -- 172.21.15.79:0/3907845492 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3289147809 0 0) 0x7faaf806f250 con 0x7faaf80d1080 2024-04-25T02:10:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 -- 172.21.15.79:0/3907845492 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faae0003520 con 0x7faaf80d1080 2024-04-25T02:10:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf77fe640 1 --2- 172.21.15.79:0/3907845492 >> v2:172.21.15.189:3300/0 conn(0x7faaf80cde10 0x7faaf80d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf7fff640 1 --2- 172.21.15.79:0/3907845492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaf80cee10 0x7faaf815daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 -- 172.21.15.79:0/3907845492 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4223507583 0 0) 0x7faae0003520 con 0x7faaf80d1080 2024-04-25T02:10:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 -- 172.21.15.79:0/3907845492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaf80cee10 msgr2=0x7faaf815daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 --2- 172.21.15.79:0/3907845492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaf80cee10 0x7faaf815daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 -- 172.21.15.79:0/3907845492 >> v2:172.21.15.189:3300/0 conn(0x7faaf80cde10 msgr2=0x7faaf80d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 --2- 172.21.15.79:0/3907845492 >> v2:172.21.15.189:3300/0 conn(0x7faaf80cde10 0x7faaf80d0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 -- 172.21.15.79:0/3907845492 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf806f530 con 0x7faaf80d1080 2024-04-25T02:10:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 -- 172.21.15.79:0/3907845492 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7faaec001670 con 0x7faaf80d1080 2024-04-25T02:10:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 -- 172.21.15.79:0/3907845492 >> v1:172.21.15.79:6789/0 conn(0x7faaf80d1080 legacy=0x7faaf80ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 --2- 172.21.15.79:0/3907845492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaf80cee10 0x7faae00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 --2- 172.21.15.79:0/3907845492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faae0003f30 0x7faae0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 --2- 172.21.15.79:0/3907845492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faae0004d40 0x7faae00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 -- 172.21.15.79:0/3907845492 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faaf806f000 con 0x7faae0003f30 2024-04-25T02:10:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 -- 172.21.15.79:0/3907845492 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faaf80cd4e0 con 0x7faae0004d40 2024-04-25T02:10:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf67fc640 1 -- 172.21.15.79:0/3907845492 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faae000b9c0 con 0x7faaf80cee10 2024-04-25T02:10:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf6ffd640 1 --2- 172.21.15.79:0/3907845492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faae0003f30 0x7faae0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf77fe640 1 --2- 172.21.15.79:0/3907845492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaf80cee10 0x7faae00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf7fff640 1 --2- 172.21.15.79:0/3907845492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faae0004d40 0x7faae00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf6ffd640 1 -- 172.21.15.79:0/3907845492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaf80cee10 msgr2=0x7faae00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf6ffd640 1 --2- 172.21.15.79:0/3907845492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaf80cee10 0x7faae00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf6ffd640 1 -- 172.21.15.79:0/3907845492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faae0004d40 msgr2=0x7faae00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf6ffd640 1 --2- 172.21.15.79:0/3907845492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faae0004d40 0x7faae00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.446+0000 7faaf6ffd640 1 -- 172.21.15.79:0/3907845492 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae0003520 con 0x7faae0003f30 2024-04-25T02:10:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.447+0000 7faaf6ffd640 1 --2- 172.21.15.79:0/3907845492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faae0003f30 0x7faae0004800 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7faaec001050 tx=0x7faae0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857db434e98f4925 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.447+0000 7faaf67fc640 1 -- 172.21.15.79:0/3907845492 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec007d70 con 0x7faae0003f30 2024-04-25T02:10:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.447+0000 7faaf67fc640 1 -- 172.21.15.79:0/3907845492 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaec005af0 con 0x7faae0003f30 2024-04-25T02:10:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.447+0000 7faaf67fc640 1 -- 172.21.15.79:0/3907845492 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec007070 con 0x7faae0003f30 2024-04-25T02:10:37.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.448+0000 7faafdff9640 1 -- 172.21.15.79:0/3907845492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faae0003f30 msgr2=0x7faae0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.448+0000 7faafdff9640 1 --2- 172.21.15.79:0/3907845492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faae0003f30 0x7faae0004800 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7faaec001050 tx=0x7faae0005830 comp rx=0 tx=0).stop 2024-04-25T02:10:37.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.448+0000 7faaf7fff640 1 -- 172.21.15.79:0/3907845492 reap_dead start 2024-04-25T02:10:37.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.448+0000 7faafdff9640 1 -- 172.21.15.79:0/3907845492 shutdown_connections 2024-04-25T02:10:37.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.448+0000 7faafdff9640 1 -- 172.21.15.79:0/3907845492 >> 172.21.15.79:0/3907845492 conn(0x7faaf80d1e80 msgr2=0x7faaf80d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.448+0000 7faafdff9640 1 -- 172.21.15.79:0/3907845492 shutdown_connections 2024-04-25T02:10:37.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.448+0000 7faafdff9640 1 -- 172.21.15.79:0/3907845492 wait complete. 2024-04-25T02:10:37.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.449+0000 7faafdff9640 1 Processor -- start 2024-04-25T02:10:37.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.449+0000 7faafdff9640 1 -- start start 2024-04-25T02:10:37.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faafdff9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faae0003f30 0x7faaf809eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faafdff9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaf815d030 0x7faaf815d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faafdff9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaf80c6930 0x7faaf80c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faafdff9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faaf806fdd0 con 0x7faaf80c6930 2024-04-25T02:10:37.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faafdff9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faaf806faf0 con 0x7faae0003f30 2024-04-25T02:10:37.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faafdff9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faaf80ce1f0 con 0x7faaf815d030 2024-04-25T02:10:37.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faaf7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaf80c6930 0x7faaf80c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faaf7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaf80c6930 0x7faaf80c6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40460/0 (socket says 172.21.15.79:40460) 2024-04-25T02:10:37.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faaf7fff640 1 -- 172.21.15.79:0/2179547030 learned_addr learned my addr 172.21.15.79:0/2179547030 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:37.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faaf77fe640 1 --2- 172.21.15.79:0/2179547030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faae0003f30 0x7faaf809eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faaf6ffd640 1 --2- 172.21.15.79:0/2179547030 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaf815d030 0x7faaf815d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faaf7fff640 1 -- 172.21.15.79:0/2179547030 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaf815d030 msgr2=0x7faaf815d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faaf7fff640 1 --2- 172.21.15.79:0/2179547030 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaf815d030 0x7faaf815d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faaf7fff640 1 -- 172.21.15.79:0/2179547030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faae0003f30 msgr2=0x7faaf809eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faaf7fff640 1 --2- 172.21.15.79:0/2179547030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faae0003f30 0x7faaf809eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faaf7fff640 1 -- 172.21.15.79:0/2179547030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf80c7660 con 0x7faaf80c6930 2024-04-25T02:10:37.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faaf7fff640 1 --2- 172.21.15.79:0/2179547030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaf80c6930 0x7faaf80c6de0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7faaf8072ef0 tx=0x7faaf000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faadffff640 1 -- 172.21.15.79:0/2179547030 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf000fce0 con 0x7faaf80c6930 2024-04-25T02:10:37.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faadffff640 1 -- 172.21.15.79:0/2179547030 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf001d070 con 0x7faaf80c6930 2024-04-25T02:10:37.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faadffff640 1 -- 172.21.15.79:0/2179547030 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0015670 con 0x7faaf80c6930 2024-04-25T02:10:37.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faafdff9640 1 -- 172.21.15.79:0/2179547030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf80c7940 con 0x7faaf80c6930 2024-04-25T02:10:37.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.450+0000 7faafdff9640 1 -- 172.21.15.79:0/2179547030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf80c7f00 con 0x7faaf80c6930 2024-04-25T02:10:37.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.452+0000 7faadffff640 1 -- 172.21.15.79:0/2179547030 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faaf0015810 con 0x7faaf80c6930 2024-04-25T02:10:37.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.452+0000 7faadffff640 1 --2- 172.21.15.79:0/2179547030 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faae406be60 0x7faae406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.452+0000 7faadffff640 1 -- 172.21.15.79:0/2179547030 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7faaf008b610 con 0x7faaf80c6930 2024-04-25T02:10:37.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.452+0000 7faaf77fe640 1 --2- 172.21.15.79:0/2179547030 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faae406be60 0x7faae406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.453+0000 7faaf77fe640 1 --2- 172.21.15.79:0/2179547030 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faae406be60 0x7faae406e320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faae8009bc0 tx=0x7faae8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.453+0000 7fab00de8740 1 Processor -- start 2024-04-25T02:10:37.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.453+0000 7fab00de8740 1 -- start start 2024-04-25T02:10:37.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.454+0000 7fab00de8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf644590d0 0x55bf644594b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.454+0000 7fab00de8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64453f60 0x55bf64457cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.454+0000 7fab00de8740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64458210 0x55bf64458650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.454+0000 7fab00de8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf643bc2c0 con 0x55bf644590d0 2024-04-25T02:10:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.454+0000 7fab00de8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bf64364950 con 0x55bf64453f60 2024-04-25T02:10:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.454+0000 7fab00de8740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55bf643b8280 con 0x55bf64458210 2024-04-25T02:10:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.454+0000 7faaf77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf644590d0 0x55bf644594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.454+0000 7faaf77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf644590d0 0x55bf644594b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40472/0 (socket says 172.21.15.79:40472) 2024-04-25T02:10:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.454+0000 7faaf77fe640 1 -- 172.21.15.79:0/3465036187 learned_addr learned my addr 172.21.15.79:0/3465036187 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.454+0000 7faaf7fff640 1 --2- 172.21.15.79:0/3465036187 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64458210 0x55bf64458650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.454+0000 7faaf6ffd640 1 --2- 172.21.15.79:0/3465036187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64453f60 0x55bf64457cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.455+0000 7faaf77fe640 1 -- 172.21.15.79:0/3465036187 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64458210 msgr2=0x55bf64458650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.455+0000 7faaf77fe640 1 --2- 172.21.15.79:0/3465036187 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64458210 0x55bf64458650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.455+0000 7faaf77fe640 1 -- 172.21.15.79:0/3465036187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64453f60 msgr2=0x55bf64457cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.455+0000 7faaf77fe640 1 --2- 172.21.15.79:0/3465036187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64453f60 0x55bf64457cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.455+0000 7faaf77fe640 1 -- 172.21.15.79:0/3465036187 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6419c7b0 con 0x55bf644590d0 2024-04-25T02:10:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.455+0000 7faaf6ffd640 1 --2- 172.21.15.79:0/3465036187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64453f60 0x55bf64457cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.455+0000 7faaf77fe640 1 --2- 172.21.15.79:0/3465036187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf644590d0 0x55bf644594b0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7faae8006d40 tx=0x7faae8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa09c258255025d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.455+0000 7faadd7fa640 1 -- 172.21.15.79:0/3465036187 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae801b070 con 0x55bf644590d0 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.455+0000 7faadd7fa640 1 -- 172.21.15.79:0/3465036187 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae8003da0 con 0x55bf644590d0 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.455+0000 7faadd7fa640 1 -- 172.21.15.79:0/3465036187 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8022630 con 0x55bf644590d0 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.455+0000 7fab00de8740 1 -- 172.21.15.79:0/3465036187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf644590d0 msgr2=0x55bf644594b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.455+0000 7fab00de8740 1 --2- 172.21.15.79:0/3465036187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf644590d0 0x55bf644594b0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7faae8006d40 tx=0x7faae8017000 comp rx=0 tx=0).stop 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.456+0000 7fab00de8740 1 -- 172.21.15.79:0/3465036187 shutdown_connections 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.456+0000 7fab00de8740 1 --2- 172.21.15.79:0/3465036187 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64458210 0x55bf64458650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.456+0000 7fab00de8740 1 --2- 172.21.15.79:0/3465036187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64453f60 0x55bf64457cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.456+0000 7fab00de8740 1 --2- 172.21.15.79:0/3465036187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf644590d0 0x55bf644594b0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.456+0000 7fab00de8740 1 -- 172.21.15.79:0/3465036187 >> 172.21.15.79:0/3465036187 conn(0x55bf644561d0 msgr2=0x55bf6449ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.456+0000 7fab00de8740 1 -- 172.21.15.79:0/3465036187 shutdown_connections 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.456+0000 7fab00de8740 1 -- 172.21.15.79:0/3465036187 wait complete. 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.456+0000 7fab00de8740 1 -- start start 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.456+0000 7fab00de8740 1 Processor -- start 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7fab00de8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf64458210 0x55bf644a3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7fab00de8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf644590d0 0x55bf644a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7fab00de8740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64473d10 0x55bf644a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7fab00de8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf64484c60 con 0x55bf64458210 2024-04-25T02:10:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7fab00de8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bf64377ee0 con 0x55bf644590d0 2024-04-25T02:10:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7fab00de8740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55bf644840e0 con 0x55bf64473d10 2024-04-25T02:10:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7faaf77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf64458210 0x55bf644a3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7faaf77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf64458210 0x55bf644a3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40474/0 (socket says 172.21.15.79:40474) 2024-04-25T02:10:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7fab00de8740 10 client.0 _ll_register_callbacks cb 0x55bf6437c120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7faaf77fe640 1 -- 172.21.15.79:0/443127128 learned_addr learned my addr 172.21.15.79:0/443127128 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7faaf7fff640 1 --2- 172.21.15.79:0/443127128 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64473d10 0x55bf644a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7faaf6ffd640 1 --2- 172.21.15.79:0/443127128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf644590d0 0x55bf644a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7faaf77fe640 1 -- 172.21.15.79:0/443127128 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64473d10 msgr2=0x55bf644a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7faaf77fe640 1 --2- 172.21.15.79:0/443127128 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64473d10 0x55bf644a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7faaf77fe640 1 -- 172.21.15.79:0/443127128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf644590d0 msgr2=0x55bf644a4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7faaf77fe640 1 --2- 172.21.15.79:0/443127128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf644590d0 0x55bf644a4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7faaf77fe640 1 -- 172.21.15.79:0/443127128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf641fcf40 con 0x55bf64458210 2024-04-25T02:10:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.457+0000 7faaf6ffd640 1 --2- 172.21.15.79:0/443127128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf644590d0 0x55bf644a4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7faaf77fe640 1 --2- 172.21.15.79:0/443127128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf64458210 0x55bf644a3360 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7faae8022b90 tx=0x7faae80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b70efa0b94f88f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7faad67fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:10:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7faad67fc640 1 -- 172.21.15.79:0/443127128 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8034420 con 0x55bf64458210 2024-04-25T02:10:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7faad67fc640 1 -- 172.21.15.79:0/443127128 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7faae8035c70 con 0x55bf64458210 2024-04-25T02:10:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7fab00de8740 1 -- 172.21.15.79:0/443127128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faae8003da0 con 0x55bf64458210 2024-04-25T02:10:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7faad67fc640 1 -- 172.21.15.79:0/443127128 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faae803c050 con 0x55bf64458210 2024-04-25T02:10:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7fab00de8740 10 client.6339 fetch_fsmap learned FSMap version 24 2024-04-25T02:10:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7fab00de8740 1 -- 172.21.15.79:0/443127128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55bf640900a0 con 0x55bf64458210 2024-04-25T02:10:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7faad67fc640 1 -- 172.21.15.79:0/443127128 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae8003da0 con 0x55bf64458210 2024-04-25T02:10:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7faad67fc640 1 -- 172.21.15.79:0/443127128 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 24) ==== 3494+0+0 (secure 0 0 0) 0x7faae803f020 con 0x55bf64458210 2024-04-25T02:10:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7fab00de8740 10 client.6339 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:10:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7fab00de8740 10 client.6339 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T02:10:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7fab00de8740 20 client.6339 populate_metadata read hostname 'smithi079' 2024-04-25T02:10:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7fab00de8740 1 --2- 172.21.15.79:0/443127128 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55bf64476470 0x55bf644bccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7fab00de8740 4 client.6339 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7fab00de8740 1 -- 172.21.15.79:0/443127128 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf64379d60 con 0x55bf64476470 2024-04-25T02:10:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.458+0000 7faaf6ffd640 1 --2- 172.21.15.79:0/443127128 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55bf64476470 0x55bf644bccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7faad67fc640 10 client.6339 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:10:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7faaf6ffd640 1 --2- 172.21.15.79:0/443127128 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55bf64476470 0x55bf644bccb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95893898f1a30c28 server_cookie=1d399a89ecbba985 in_seq=0 out_seq=0 2024-04-25T02:10:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7faad67fc640 1 -- 172.21.15.79:0/443127128 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bf64379d60 con 0x55bf64476470 2024-04-25T02:10:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7faad67fc640 10 client.6339 handle_command_reply: tid=0 2024-04-25T02:10:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7fab00de8740 1 client.6339 shutdown 2024-04-25T02:10:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7fab00de8740 1 -- 172.21.15.79:0/443127128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf64458210 msgr2=0x55bf644a3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7fab00de8740 1 --2- 172.21.15.79:0/443127128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf64458210 0x55bf644a3360 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7faae8022b90 tx=0x7faae80046c0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7fab00de8740 1 -- 172.21.15.79:0/443127128 shutdown_connections 2024-04-25T02:10:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7fab00de8740 1 --2- 172.21.15.79:0/443127128 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55bf64476470 0x55bf644bccb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7fab00de8740 1 --2- 172.21.15.79:0/443127128 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64473d10 0x55bf644a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7faad67fc640 0 client.6339 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:10:37.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7fab00de8740 1 --2- 172.21.15.79:0/443127128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf644590d0 0x55bf644a4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7fab00de8740 1 --2- 172.21.15.79:0/443127128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf64458210 0x55bf644a3360 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7fab00de8740 1 -- 172.21.15.79:0/443127128 >> 172.21.15.79:0/443127128 conn(0x55bf64453f60 msgr2=0x55bf64453680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7fab00de8740 1 -- 172.21.15.79:0/443127128 shutdown_connections 2024-04-25T02:10:37.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.459+0000 7fab00de8740 1 -- 172.21.15.79:0/443127128 wait complete. 2024-04-25T02:10:37.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.460+0000 7fab00de8740 20 client.6339 trim_cache size 0 max 16384 2024-04-25T02:10:37.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.477+0000 7fab00de8740 1 Processor -- start 2024-04-25T02:10:37.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.477+0000 7fab00de8740 1 -- start start 2024-04-25T02:10:37.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7fab00de8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64453f60 0x55bf64457b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7fab00de8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf64458210 0x55bf644a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7fab00de8740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf644590d0 0x55bf64484330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7fab00de8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faaf8200e40 con 0x55bf64458210 2024-04-25T02:10:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7fab00de8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faaf81ffe70 con 0x55bf64453f60 2024-04-25T02:10:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7fab00de8740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faaf809d820 con 0x55bf644590d0 2024-04-25T02:10:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7faaf6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf64458210 0x55bf644a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7faaf6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf64458210 0x55bf644a3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40476/0 (socket says 172.21.15.79:40476) 2024-04-25T02:10:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7faaf6ffd640 1 -- 172.21.15.79:0/3371966816 learned_addr learned my addr 172.21.15.79:0/3371966816 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7faaf77fe640 1 --2- 172.21.15.79:0/3371966816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64453f60 0x55bf64457b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7faaf7fff640 1 --2- 172.21.15.79:0/3371966816 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf644590d0 0x55bf64484330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7faaf6ffd640 1 -- 172.21.15.79:0/3371966816 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf644590d0 msgr2=0x55bf64484330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7faaf6ffd640 1 --2- 172.21.15.79:0/3371966816 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf644590d0 0x55bf64484330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7faaf6ffd640 1 -- 172.21.15.79:0/3371966816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64453f60 msgr2=0x55bf64457b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7faaf6ffd640 1 --2- 172.21.15.79:0/3371966816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64453f60 0x55bf64457b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7faaf6ffd640 1 -- 172.21.15.79:0/3371966816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf644745f0 con 0x55bf64458210 2024-04-25T02:10:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7faaf7fff640 1 --2- 172.21.15.79:0/3371966816 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf644590d0 0x55bf64484330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7faaf6ffd640 1 --2- 172.21.15.79:0/3371966816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf64458210 0x55bf644a3b20 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7faaec02ae20 tx=0x7faaec007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da5f0f9dc48ec83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7faadcff9640 1 -- 172.21.15.79:0/3371966816 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec001620 con 0x55bf64458210 2024-04-25T02:10:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7faadcff9640 1 -- 172.21.15.79:0/3371966816 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaec046b50 con 0x55bf64458210 2024-04-25T02:10:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.478+0000 7faadcff9640 1 -- 172.21.15.79:0/3371966816 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec0462c0 con 0x55bf64458210 2024-04-25T02:10:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.479+0000 7fab00de8740 1 -- 172.21.15.79:0/3371966816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf64458210 msgr2=0x55bf644a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.479+0000 7fab00de8740 1 --2- 172.21.15.79:0/3371966816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf64458210 0x55bf644a3b20 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7faaec02ae20 tx=0x7faaec007000 comp rx=0 tx=0).stop 2024-04-25T02:10:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.479+0000 7fab00de8740 1 -- 172.21.15.79:0/3371966816 shutdown_connections 2024-04-25T02:10:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.479+0000 7fab00de8740 1 --2- 172.21.15.79:0/3371966816 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf644590d0 0x55bf64484330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.479+0000 7fab00de8740 1 --2- 172.21.15.79:0/3371966816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf64458210 0x55bf644a3b20 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.479+0000 7fab00de8740 1 --2- 172.21.15.79:0/3371966816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64453f60 0x55bf64457b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.479+0000 7fab00de8740 1 -- 172.21.15.79:0/3371966816 >> 172.21.15.79:0/3371966816 conn(0x55bf644570e0 msgr2=0x55bf64459790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.479+0000 7fab00de8740 1 -- 172.21.15.79:0/3371966816 shutdown_connections 2024-04-25T02:10:37.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.479+0000 7fab00de8740 1 -- 172.21.15.79:0/3371966816 wait complete. 2024-04-25T02:10:37.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.480+0000 7fab00de8740 1 -- start start 2024-04-25T02:10:37.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.480+0000 7fab00de8740 1 Processor -- start 2024-04-25T02:10:37.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.480+0000 7fab00de8740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64453f60 0x55bf64472990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.480+0000 7fab00de8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64458210 0x55bf6449fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.480+0000 7fab00de8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf644590d0 0x55bf644a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.480+0000 7fab00de8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf6449f360 con 0x55bf644590d0 2024-04-25T02:10:37.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.480+0000 7fab00de8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faaf81ff820 con 0x55bf64458210 2024-04-25T02:10:37.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.480+0000 7fab00de8740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55bf6449f590 con 0x55bf64453f60 2024-04-25T02:10:37.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.480+0000 7fab00de8740 10 client.0 _ll_register_callbacks cb 0x7faae8014f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:37.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.480+0000 7faaf7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf644590d0 0x55bf644a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.480+0000 7faaf7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf644590d0 0x55bf644a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40480/0 (socket says 172.21.15.79:40480) 2024-04-25T02:10:37.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faaf7fff640 1 -- 172.21.15.79:0/2507883716 learned_addr learned my addr 172.21.15.79:0/2507883716 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:37.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faaf77fe640 1 --2- 172.21.15.79:0/2507883716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64453f60 0x55bf64472990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faaf6ffd640 1 --2- 172.21.15.79:0/2507883716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64458210 0x55bf6449fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faaf7fff640 1 -- 172.21.15.79:0/2507883716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64453f60 msgr2=0x55bf64472990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faaf7fff640 1 --2- 172.21.15.79:0/2507883716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64453f60 0x55bf64472990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faaf7fff640 1 -- 172.21.15.79:0/2507883716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64458210 msgr2=0x55bf6449fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faaf7fff640 1 --2- 172.21.15.79:0/2507883716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64458210 0x55bf6449fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faaf7fff640 1 -- 172.21.15.79:0/2507883716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf6451a6a0 con 0x55bf644590d0 2024-04-25T02:10:37.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faaf77fe640 1 --2- 172.21.15.79:0/2507883716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64453f60 0x55bf64472990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:37.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faaf7fff640 1 --2- 172.21.15.79:0/2507883716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf644590d0 0x55bf644a03d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7faaf0089ab0 tx=0x7faaf005a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a52bd88f3237e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faad67fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:10:37.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faad67fc640 1 -- 172.21.15.79:0/2507883716 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf00624a0 con 0x55bf644590d0 2024-04-25T02:10:37.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faad67fc640 1 -- 172.21.15.79:0/2507883716 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7faaf00600b0 con 0x55bf644590d0 2024-04-25T02:10:37.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7fab00de8740 1 -- 172.21.15.79:0/2507883716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faaec046b50 con 0x55bf644590d0 2024-04-25T02:10:37.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faad67fc640 1 -- 172.21.15.79:0/2507883716 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faaf0058d10 con 0x55bf644590d0 2024-04-25T02:10:37.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7fab00de8740 10 client.6345 fetch_fsmap learned FSMap version 24 2024-04-25T02:10:37.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7fab00de8740 1 -- 172.21.15.79:0/2507883716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55bf644c1050 con 0x55bf644590d0 2024-04-25T02:10:37.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faad67fc640 1 -- 172.21.15.79:0/2507883716 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaec046b50 con 0x55bf644590d0 2024-04-25T02:10:37.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7faad67fc640 1 -- 172.21.15.79:0/2507883716 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 24) ==== 3494+0+0 (secure 0 0 0) 0x7faaf0058eb0 con 0x55bf644590d0 2024-04-25T02:10:37.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7fab00de8740 10 client.6345 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:10:37.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7fab00de8740 10 client.6345 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T02:10:37.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7fab00de8740 20 client.6345 populate_metadata read hostname 'smithi079' 2024-04-25T02:10:37.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7fab00de8740 1 --2- 172.21.15.79:0/2507883716 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55bf64473d10 0x55bf644c1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7fab00de8740 4 client.6345 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-04-25T02:10:37.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.481+0000 7fab00de8740 1 -- 172.21.15.79:0/2507883716 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) -- 0x55bf643c9800 con 0x55bf64473d10 2024-04-25T02:10:37.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.482+0000 7faaf77fe640 1 --2- 172.21.15.79:0/2507883716 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55bf64473d10 0x55bf644c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.482+0000 7faad67fc640 10 client.6345 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:10:37.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.482+0000 7faaf77fe640 1 --2- 172.21.15.79:0/2507883716 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55bf64473d10 0x55bf644c1570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d39f8d81d1917b7 server_cookie=f8bfb118ff0ccd84 in_seq=0 out_seq=0 2024-04-25T02:10:37.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.482+0000 7faad67fc640 1 -- 172.21.15.79:0/2507883716 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bf643c9800 con 0x55bf64473d10 2024-04-25T02:10:37.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.482+0000 7faad67fc640 10 client.6345 handle_command_reply: tid=0 2024-04-25T02:10:37.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.482+0000 7fab00de8740 1 client.6345 shutdown 2024-04-25T02:10:37.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7fab00de8740 1 -- 172.21.15.79:0/2507883716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf644590d0 msgr2=0x55bf644a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7fab00de8740 1 --2- 172.21.15.79:0/2507883716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf644590d0 0x55bf644a03d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7faaf0089ab0 tx=0x7faaf005a0f0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7fab00de8740 1 -- 172.21.15.79:0/2507883716 shutdown_connections 2024-04-25T02:10:37.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7fab00de8740 1 --2- 172.21.15.79:0/2507883716 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55bf64473d10 0x55bf644c1570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7fab00de8740 1 --2- 172.21.15.79:0/2507883716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf644590d0 0x55bf644a03d0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7faad67fc640 0 client.6345 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:10:37.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7fab00de8740 1 --2- 172.21.15.79:0/2507883716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf64458210 0x55bf6449fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7fab00de8740 1 --2- 172.21.15.79:0/2507883716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55bf64453f60 0x55bf64472990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7fab00de8740 1 -- 172.21.15.79:0/2507883716 >> 172.21.15.79:0/2507883716 conn(0x55bf644570e0 msgr2=0x55bf644718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7fab00de8740 1 -- 172.21.15.79:0/2507883716 shutdown_connections 2024-04-25T02:10:37.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7fab00de8740 1 -- 172.21.15.79:0/2507883716 wait complete. 2024-04-25T02:10:37.497 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-04-25T02:10:37.483+0000 7fb98e84b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={6297=0-4194304@1} caps={6297=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6297 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55f5250ea680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:10:37.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7fab00de8740 20 client.6345 trim_cache size 0 max 16384 2024-04-25T02:10:37.498 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:10:37.498 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-04-25T02:10:37.498 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "0935abe4-3550-4e94-b8b9-1e3c763f79de", 2024-04-25T02:10:37.498 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-04-25T02:10:37.498 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:10:37.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7faafdff9640 1 -- 172.21.15.79:0/2179547030 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faae406be60 msgr2=0x7faae406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7faafdff9640 1 --2- 172.21.15.79:0/2179547030 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faae406be60 0x7faae406e320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faae8009bc0 tx=0x7faae8009190 comp rx=0 tx=0).stop 2024-04-25T02:10:37.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7faafdff9640 1 -- 172.21.15.79:0/2179547030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaf80c6930 msgr2=0x7faaf80c6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7faafdff9640 1 --2- 172.21.15.79:0/2179547030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaf80c6930 0x7faaf80c6de0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7faaf8072ef0 tx=0x7faaf000f1b0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7faafdff9640 1 -- 172.21.15.79:0/2179547030 shutdown_connections 2024-04-25T02:10:37.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7faafdff9640 1 --2- 172.21.15.79:0/2179547030 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faae406be60 0x7faae406e320 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7faafdff9640 1 --2- 172.21.15.79:0/2179547030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaf80c6930 0x7faaf80c6de0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7faafdff9640 1 --2- 172.21.15.79:0/2179547030 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faaf815d030 0x7faaf815d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7faafdff9640 1 --2- 172.21.15.79:0/2179547030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faae0003f30 0x7faaf809eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.483+0000 7faafdff9640 1 -- 172.21.15.79:0/2179547030 >> 172.21.15.79:0/2179547030 conn(0x7faaf80d1e80 msgr2=0x7faaf80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.484+0000 7faafdff9640 1 -- 172.21.15.79:0/2179547030 shutdown_connections 2024-04-25T02:10:37.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.484+0000 7faafdff9640 1 -- 172.21.15.79:0/2179547030 wait complete. 2024-04-25T02:10:37.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:37.502 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T02:10:37.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.592+0000 7fadb4638640 1 Processor -- start 2024-04-25T02:10:37.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.592+0000 7fadb4638640 1 -- start start 2024-04-25T02:10:37.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.593+0000 7fadb4638640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadac15e4f0 0x7fadac0d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.593+0000 7fadb4638640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fadac0d10c0 0x7fadac06bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.593+0000 7fadb4638640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadac0d1ee0 con 0x7fadac0cf7f0 2024-04-25T02:10:37.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.593+0000 7fadb4638640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fadac0d21c0 con 0x7fadac0d10c0 2024-04-25T02:10:37.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.593+0000 7fadb4638640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fadac0d24a0 con 0x7fadac15e4f0 2024-04-25T02:10:37.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.593+0000 7fadb2bd5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fadac0d10c0 0x7fadac06bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.593+0000 7fadb2bd5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fadac0d10c0 0x7fadac06bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40488/0 (socket says 172.21.15.79:40488) 2024-04-25T02:10:37.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.593+0000 7fadb2bd5640 1 -- 172.21.15.79:0/4061360355 learned_addr learned my addr 172.21.15.79:0/4061360355 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:37.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.594+0000 7fadb23d4640 1 --2- 172.21.15.79:0/4061360355 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadac15e4f0 0x7fadac0d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.594+0000 7fadb2bd5640 1 -- 172.21.15.79:0/4061360355 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadac15e4f0 msgr2=0x7fadac0d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.594+0000 7fadb2bd5640 1 --2- 172.21.15.79:0/4061360355 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadac15e4f0 0x7fadac0d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.594+0000 7fadb2bd5640 1 -- 172.21.15.79:0/4061360355 >> v1:172.21.15.189:6789/0 conn(0x7fadac0cf7f0 legacy=0x7fadac0d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.594+0000 7fadb2bd5640 1 -- 172.21.15.79:0/4061360355 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadac0d2780 con 0x7fadac0d10c0 2024-04-25T02:10:37.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.594+0000 7fadb23d4640 1 --2- 172.21.15.79:0/4061360355 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadac15e4f0 0x7fadac0d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:37.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.594+0000 7fadb2bd5640 1 --2- 172.21.15.79:0/4061360355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac0d10c0 0x7fadac06bc30 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fada4009870 tx=0x7fada402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3becc931810438 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.595+0000 7fadb13d2640 1 -- 172.21.15.79:0/4061360355 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4037070 con 0x7fadac0d10c0 2024-04-25T02:10:37.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.595+0000 7fadb13d2640 1 -- 172.21.15.79:0/4061360355 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada4032440 con 0x7fadac0d10c0 2024-04-25T02:10:37.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.595+0000 7fadb13d2640 1 -- 172.21.15.79:0/4061360355 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4032810 con 0x7fadac0d10c0 2024-04-25T02:10:37.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.595+0000 7fadb4638640 1 -- 172.21.15.79:0/4061360355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac0d10c0 msgr2=0x7fadac06bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.595+0000 7fadb4638640 1 --2- 172.21.15.79:0/4061360355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac0d10c0 0x7fadac06bc30 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fada4009870 tx=0x7fada402a270 comp rx=0 tx=0).stop 2024-04-25T02:10:37.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.595+0000 7fadb4638640 1 -- 172.21.15.79:0/4061360355 shutdown_connections 2024-04-25T02:10:37.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.595+0000 7fadb4638640 1 --2- 172.21.15.79:0/4061360355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac0d10c0 0x7fadac06bc30 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.595+0000 7fadb4638640 1 --2- 172.21.15.79:0/4061360355 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadac15e4f0 0x7fadac0d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.595+0000 7fadb4638640 1 -- 172.21.15.79:0/4061360355 >> 172.21.15.79:0/4061360355 conn(0x7fadac09d4a0 msgr2=0x7fadac0d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.595+0000 7fadb4638640 1 -- 172.21.15.79:0/4061360355 shutdown_connections 2024-04-25T02:10:37.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.595+0000 7fadb4638640 1 -- 172.21.15.79:0/4061360355 wait complete. 2024-04-25T02:10:37.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.596+0000 7fadb4638640 1 Processor -- start 2024-04-25T02:10:37.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.596+0000 7fadb4638640 1 -- start start 2024-04-25T02:10:37.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.597+0000 7fadb4638640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadac0cf7f0 0x7fadac0b96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.597+0000 7fadb4638640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadac0d10c0 0x7fadac0b8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.597+0000 7fadb4638640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac15e4f0 0x7fadac0c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.597+0000 7fadb4638640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fadac0cfc50 con 0x7fadac15e4f0 2024-04-25T02:10:37.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.597+0000 7fadb4638640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fadac0d50f0 con 0x7fadac0d10c0 2024-04-25T02:10:37.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.597+0000 7fadb4638640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fadac0cfdd0 con 0x7fadac0cf7f0 2024-04-25T02:10:37.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.597+0000 7fadb2bd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac15e4f0 0x7fadac0c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.597+0000 7fadb2bd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac15e4f0 0x7fadac0c9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40504/0 (socket says 172.21.15.79:40504) 2024-04-25T02:10:37.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.597+0000 7fadb2bd5640 1 -- 172.21.15.79:0/443496107 learned_addr learned my addr 172.21.15.79:0/443496107 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:37.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.597+0000 7fadb23d4640 1 --2- 172.21.15.79:0/443496107 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadac0cf7f0 0x7fadac0b96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.597+0000 7fadb1bd3640 1 --2- 172.21.15.79:0/443496107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadac0d10c0 0x7fadac0b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.597+0000 7fadb2bd5640 1 -- 172.21.15.79:0/443496107 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadac0cf7f0 msgr2=0x7fadac0b96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.597+0000 7fadb2bd5640 1 --2- 172.21.15.79:0/443496107 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadac0cf7f0 0x7fadac0b96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.597+0000 7fadb2bd5640 1 -- 172.21.15.79:0/443496107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadac0d10c0 msgr2=0x7fadac0b8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.598+0000 7fadb2bd5640 1 --2- 172.21.15.79:0/443496107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadac0d10c0 0x7fadac0b8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.598+0000 7fadb2bd5640 1 -- 172.21.15.79:0/443496107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadac0b6fe0 con 0x7fadac15e4f0 2024-04-25T02:10:37.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.598+0000 7fadb2bd5640 1 --2- 172.21.15.79:0/443496107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac15e4f0 0x7fadac0c9560 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fada4009870 tx=0x7fada40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.598+0000 7fada2ffd640 1 -- 172.21.15.79:0/443496107 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4037040 con 0x7fadac15e4f0 2024-04-25T02:10:37.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.598+0000 7fada2ffd640 1 -- 172.21.15.79:0/443496107 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada4042070 con 0x7fadac15e4f0 2024-04-25T02:10:37.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.598+0000 7fada2ffd640 1 -- 172.21.15.79:0/443496107 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4030920 con 0x7fadac15e4f0 2024-04-25T02:10:37.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.598+0000 7fadb4638640 1 -- 172.21.15.79:0/443496107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadac0b7280 con 0x7fadac15e4f0 2024-04-25T02:10:37.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.598+0000 7fadb4638640 1 -- 172.21.15.79:0/443496107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadac0b7b20 con 0x7fadac15e4f0 2024-04-25T02:10:37.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.599+0000 7fada2ffd640 1 -- 172.21.15.79:0/443496107 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fada4030ac0 con 0x7fadac15e4f0 2024-04-25T02:10:37.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.600+0000 7fada2ffd640 1 --2- 172.21.15.79:0/443496107 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fad9006be30 0x7fad9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.600+0000 7fada2ffd640 1 -- 172.21.15.79:0/443496107 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fada40ab700 con 0x7fadac15e4f0 2024-04-25T02:10:37.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.600+0000 7fadb23d4640 1 --2- 172.21.15.79:0/443496107 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fad9006be30 0x7fad9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.600+0000 7fadb23d4640 1 --2- 172.21.15.79:0/443496107 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fad9006be30 0x7fad9006e2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fadac0b39f0 tx=0x7fada8003a10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.601+0000 7fadb7423740 1 Processor -- start 2024-04-25T02:10:37.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.601+0000 7fadb7423740 1 -- start start 2024-04-25T02:10:37.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb7423740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4c97d60 0x564ac4c98140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb7423740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4cb5600 0x564ac4cb5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb7423740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4c6da40 0x564ac4cb3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb7423740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564ac4bd16b0 con 0x564ac4c97d60 2024-04-25T02:10:37.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb7423740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564ac4b79880 con 0x564ac4cb5600 2024-04-25T02:10:37.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb7423740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x564ac4bcd670 con 0x564ac4c6da40 2024-04-25T02:10:37.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb23d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4c97d60 0x564ac4c98140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb23d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4c97d60 0x564ac4c98140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40510/0 (socket says 172.21.15.79:40510) 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb23d4640 1 -- 172.21.15.79:0/2213067121 learned_addr learned my addr 172.21.15.79:0/2213067121 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb2bd5640 1 --2- 172.21.15.79:0/2213067121 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4c6da40 0x564ac4cb3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb1bd3640 1 --2- 172.21.15.79:0/2213067121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4cb5600 0x564ac4cb5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb23d4640 1 -- 172.21.15.79:0/2213067121 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4c6da40 msgr2=0x564ac4cb3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb23d4640 1 --2- 172.21.15.79:0/2213067121 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4c6da40 0x564ac4cb3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb23d4640 1 -- 172.21.15.79:0/2213067121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4cb5600 msgr2=0x564ac4cb5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb23d4640 1 --2- 172.21.15.79:0/2213067121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4cb5600 0x564ac4cb5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb23d4640 1 -- 172.21.15.79:0/2213067121 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ac49af7d0 con 0x564ac4c97d60 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.602+0000 7fadb23d4640 1 --2- 172.21.15.79:0/2213067121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4c97d60 0x564ac4c98140 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fada8016470 tx=0x7fada8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d968aff1ea4f2173 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.603+0000 7fad8ffff640 1 -- 172.21.15.79:0/2213067121 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada8026070 con 0x564ac4c97d60 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.603+0000 7fad8ffff640 1 -- 172.21.15.79:0/2213067121 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada80147e0 con 0x564ac4c97d60 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.603+0000 7fad8ffff640 1 -- 172.21.15.79:0/2213067121 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada8014b90 con 0x564ac4c97d60 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.603+0000 7fadb7423740 1 -- 172.21.15.79:0/2213067121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4c97d60 msgr2=0x564ac4c98140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.603+0000 7fadb7423740 1 --2- 172.21.15.79:0/2213067121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4c97d60 0x564ac4c98140 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fada8016470 tx=0x7fada8012000 comp rx=0 tx=0).stop 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.603+0000 7fadb7423740 1 -- 172.21.15.79:0/2213067121 shutdown_connections 2024-04-25T02:10:37.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.603+0000 7fadb7423740 1 --2- 172.21.15.79:0/2213067121 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4c6da40 0x564ac4cb3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.603+0000 7fadb7423740 1 --2- 172.21.15.79:0/2213067121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4cb5600 0x564ac4cb5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.603+0000 7fadb7423740 1 --2- 172.21.15.79:0/2213067121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4c97d60 0x564ac4c98140 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.603+0000 7fadb7423740 1 -- 172.21.15.79:0/2213067121 >> 172.21.15.79:0/2213067121 conn(0x564ac4c6a600 msgr2=0x564ac4cb2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.603+0000 7fadb7423740 1 -- 172.21.15.79:0/2213067121 shutdown_connections 2024-04-25T02:10:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.603+0000 7fadb7423740 1 -- 172.21.15.79:0/2213067121 wait complete. 2024-04-25T02:10:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.604+0000 7fadb7423740 1 -- start start 2024-04-25T02:10:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.604+0000 7fadb7423740 1 Processor -- start 2024-04-25T02:10:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb7423740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4c97d60 0x564ac4c95b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb7423740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4cb5600 0x564ac4caea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb7423740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4caefc0 0x564ac4cafdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb7423740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564ac4c6e7e0 con 0x564ac4c97d60 2024-04-25T02:10:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb7423740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564ac4b8cf50 con 0x564ac4cb5600 2024-04-25T02:10:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb7423740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x564ac4c68530 con 0x564ac4caefc0 2024-04-25T02:10:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb7423740 10 client.0 _ll_register_callbacks cb 0x564ac4bc8000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb23d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4c97d60 0x564ac4c95b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb23d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4c97d60 0x564ac4c95b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40520/0 (socket says 172.21.15.79:40520) 2024-04-25T02:10:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb23d4640 1 -- 172.21.15.79:0/892073436 learned_addr learned my addr 172.21.15.79:0/892073436 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb2bd5640 1 --2- 172.21.15.79:0/892073436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4caefc0 0x564ac4cafdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb1bd3640 1 --2- 172.21.15.79:0/892073436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4cb5600 0x564ac4caea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb23d4640 1 -- 172.21.15.79:0/892073436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4caefc0 msgr2=0x564ac4cafdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb23d4640 1 --2- 172.21.15.79:0/892073436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4caefc0 0x564ac4cafdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb23d4640 1 -- 172.21.15.79:0/892073436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4cb5600 msgr2=0x564ac4caea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb23d4640 1 --2- 172.21.15.79:0/892073436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4cb5600 0x564ac4caea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb23d4640 1 -- 172.21.15.79:0/892073436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ac48e53f0 con 0x564ac4c97d60 2024-04-25T02:10:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb1bd3640 1 --2- 172.21.15.79:0/892073436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4cb5600 0x564ac4caea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fadb23d4640 1 --2- 172.21.15.79:0/892073436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4c97d60 0x564ac4c95b80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fada8024040 tx=0x7fada8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1998a290014f0988 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.605+0000 7fad8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:10:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fad8d7fa640 1 -- 172.21.15.79:0/892073436 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada8030020 con 0x564ac4c97d60 2024-04-25T02:10:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fad8d7fa640 1 -- 172.21.15.79:0/892073436 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fada8014cc0 con 0x564ac4c97d60 2024-04-25T02:10:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fadb7423740 1 -- 172.21.15.79:0/892073436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fada80147e0 con 0x564ac4c97d60 2024-04-25T02:10:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fad8d7fa640 1 -- 172.21.15.79:0/892073436 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fada803a050 con 0x564ac4c97d60 2024-04-25T02:10:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fadb7423740 10 client.6357 fetch_fsmap learned FSMap version 24 2024-04-25T02:10:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fadb7423740 1 -- 172.21.15.79:0/892073436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x564ac48a50f0 con 0x564ac4c97d60 2024-04-25T02:10:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fad8d7fa640 1 -- 172.21.15.79:0/892073436 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada80147e0 con 0x564ac4c97d60 2024-04-25T02:10:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fad8d7fa640 1 -- 172.21.15.79:0/892073436 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 24) ==== 3494+0+0 (secure 0 0 0) 0x7fada803d020 con 0x564ac4c97d60 2024-04-25T02:10:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fadb7423740 10 client.6357 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:10:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fadb7423740 10 client.6357 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T02:10:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fadb7423740 20 client.6357 populate_metadata read hostname 'smithi079' 2024-04-25T02:10:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fadb7423740 1 --2- 172.21.15.79:0/892073436 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x564ac4caded0 0x564ac4cae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fadb7423740 4 client.6357 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fadb7423740 1 -- 172.21.15.79:0/892073436 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ac4bdebf0 con 0x564ac4caded0 2024-04-25T02:10:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fadb1bd3640 1 --2- 172.21.15.79:0/892073436 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x564ac4caded0 0x564ac4cae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fad8d7fa640 10 client.6357 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:10:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.606+0000 7fadb1bd3640 1 --2- 172.21.15.79:0/892073436 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x564ac4caded0 0x564ac4cae2f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b616d4ce5181f729 server_cookie=ee3fd7a209d00159 in_seq=0 out_seq=0 2024-04-25T02:10:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.607+0000 7fad8d7fa640 1 -- 172.21.15.79:0/892073436 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564ac4bdebf0 con 0x564ac4caded0 2024-04-25T02:10:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.607+0000 7fad8d7fa640 10 client.6357 handle_command_reply: tid=0 2024-04-25T02:10:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.607+0000 7fadb7423740 1 client.6357 shutdown 2024-04-25T02:10:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.607+0000 7fadb7423740 1 -- 172.21.15.79:0/892073436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4c97d60 msgr2=0x564ac4c95b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.607+0000 7fadb7423740 1 --2- 172.21.15.79:0/892073436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4c97d60 0x564ac4c95b80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fada8024040 tx=0x7fada8004ab0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.607+0000 7fadb7423740 1 -- 172.21.15.79:0/892073436 shutdown_connections 2024-04-25T02:10:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.607+0000 7fadb7423740 1 --2- 172.21.15.79:0/892073436 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x564ac4caded0 0x564ac4cae2f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.607+0000 7fadb7423740 1 --2- 172.21.15.79:0/892073436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4caefc0 0x564ac4cafdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.607+0000 7fadb7423740 1 --2- 172.21.15.79:0/892073436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4cb5600 0x564ac4caea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.607+0000 7fadb7423740 1 --2- 172.21.15.79:0/892073436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4c97d60 0x564ac4c95b80 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.607+0000 7fad8d7fa640 0 client.6357 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:10:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.607+0000 7fadb7423740 1 -- 172.21.15.79:0/892073436 >> 172.21.15.79:0/892073436 conn(0x564ac4c6da40 msgr2=0x564ac4cb6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.607+0000 7fadb7423740 1 -- 172.21.15.79:0/892073436 shutdown_connections 2024-04-25T02:10:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.607+0000 7fadb7423740 1 -- 172.21.15.79:0/892073436 wait complete. 2024-04-25T02:10:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.607+0000 7fadb7423740 20 client.6357 trim_cache size 0 max 16384 2024-04-25T02:10:37.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.625+0000 7fadb7423740 1 Processor -- start 2024-04-25T02:10:37.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.625+0000 7fadb7423740 1 -- start start 2024-04-25T02:10:37.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.625+0000 7fadb7423740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4c97d60 0x564ac4caa190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.625+0000 7fadb7423740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4caefc0 0x564ac4c6ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.625+0000 7fadb7423740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4cb5600 0x564ac4c6d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.625+0000 7fadb7423740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fadac200890 con 0x564ac4cb5600 2024-04-25T02:10:37.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.625+0000 7fadb7423740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fadac1ff8d0 con 0x564ac4c97d60 2024-04-25T02:10:37.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.625+0000 7fadb7423740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fadac1fece0 con 0x564ac4caefc0 2024-04-25T02:10:37.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.626+0000 7fadb2bd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4cb5600 0x564ac4c6d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.626+0000 7fadb2bd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4cb5600 0x564ac4c6d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40532/0 (socket says 172.21.15.79:40532) 2024-04-25T02:10:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.626+0000 7fadb2bd5640 1 -- 172.21.15.79:0/1066823546 learned_addr learned my addr 172.21.15.79:0/1066823546 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.626+0000 7fadb1bd3640 1 --2- 172.21.15.79:0/1066823546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4caefc0 0x564ac4c6ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.626+0000 7fadb23d4640 1 --2- 172.21.15.79:0/1066823546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4c97d60 0x564ac4caa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.626+0000 7fadb2bd5640 1 -- 172.21.15.79:0/1066823546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4caefc0 msgr2=0x564ac4c6ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.626+0000 7fadb2bd5640 1 --2- 172.21.15.79:0/1066823546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4caefc0 0x564ac4c6ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.626+0000 7fadb2bd5640 1 -- 172.21.15.79:0/1066823546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4c97d60 msgr2=0x564ac4caa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.626+0000 7fadb2bd5640 1 --2- 172.21.15.79:0/1066823546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4c97d60 0x564ac4caa190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.626+0000 7fadb2bd5640 1 -- 172.21.15.79:0/1066823546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ac4c6de20 con 0x564ac4cb5600 2024-04-25T02:10:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.626+0000 7fadb23d4640 1 --2- 172.21.15.79:0/1066823546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4c97d60 0x564ac4caa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.626+0000 7fadb2bd5640 1 --2- 172.21.15.79:0/1066823546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4cb5600 0x564ac4c6d410 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fada402a2b0 tx=0x7fada4079480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560a8fadc694f127 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.626+0000 7fad8f7fe640 1 -- 172.21.15.79:0/1066823546 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4079a60 con 0x564ac4cb5600 2024-04-25T02:10:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.626+0000 7fad8f7fe640 1 -- 172.21.15.79:0/1066823546 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada407dd60 con 0x564ac4cb5600 2024-04-25T02:10:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.626+0000 7fad8f7fe640 1 -- 172.21.15.79:0/1066823546 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4082590 con 0x564ac4cb5600 2024-04-25T02:10:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.627+0000 7fadb7423740 1 -- 172.21.15.79:0/1066823546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4cb5600 msgr2=0x564ac4c6d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.627+0000 7fadb7423740 1 --2- 172.21.15.79:0/1066823546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4cb5600 0x564ac4c6d410 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fada402a2b0 tx=0x7fada4079480 comp rx=0 tx=0).stop 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.627+0000 7fadb7423740 1 -- 172.21.15.79:0/1066823546 shutdown_connections 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.627+0000 7fadb7423740 1 --2- 172.21.15.79:0/1066823546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4cb5600 0x564ac4c6d410 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.627+0000 7fadb7423740 1 --2- 172.21.15.79:0/1066823546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4caefc0 0x564ac4c6ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.627+0000 7fadb7423740 1 --2- 172.21.15.79:0/1066823546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4c97d60 0x564ac4caa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.627+0000 7fadb7423740 1 -- 172.21.15.79:0/1066823546 >> 172.21.15.79:0/1066823546 conn(0x564ac4c6da40 msgr2=0x564ac4c6ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.627+0000 7fadb7423740 1 -- 172.21.15.79:0/1066823546 shutdown_connections 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.627+0000 7fadb7423740 1 -- 172.21.15.79:0/1066823546 wait complete. 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.627+0000 7fadb7423740 1 -- start start 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.627+0000 7fadb7423740 1 Processor -- start 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.628+0000 7fadb7423740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4c97d60 0x564ac4c93ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.628+0000 7fadb7423740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4caefc0 0x564ac4d2f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.628+0000 7fadb7423740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4cb5600 0x564ac4cafc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.628+0000 7fadb7423740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564ac4c6a330 con 0x564ac4caefc0 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.628+0000 7fadb7423740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fadac1ff280 con 0x564ac4c97d60 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.628+0000 7fadb7423740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x564ac4caaa40 con 0x564ac4cb5600 2024-04-25T02:10:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.628+0000 7fadb7423740 10 client.0 _ll_register_callbacks cb 0x7fada8024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:37.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.628+0000 7fadb1bd3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4caefc0 0x564ac4d2f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.628+0000 7fadb1bd3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4caefc0 0x564ac4d2f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40544/0 (socket says 172.21.15.79:40544) 2024-04-25T02:10:37.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.628+0000 7fadb1bd3640 1 -- 172.21.15.79:0/811123190 learned_addr learned my addr 172.21.15.79:0/811123190 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:10:37.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.628+0000 7fadb1bd3640 1 -- 172.21.15.79:0/811123190 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4cb5600 msgr2=0x564ac4cafc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.628+0000 7fadb1bd3640 1 --2- 172.21.15.79:0/811123190 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4cb5600 0x564ac4cafc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.628+0000 7fadb23d4640 1 --2- 172.21.15.79:0/811123190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4c97d60 0x564ac4c93ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.628+0000 7fadb1bd3640 1 -- 172.21.15.79:0/811123190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4c97d60 msgr2=0x564ac4c93ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:37.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.628+0000 7fadb1bd3640 1 --2- 172.21.15.79:0/811123190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4c97d60 0x564ac4c93ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fadb1bd3640 1 -- 172.21.15.79:0/811123190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ac4c94aa0 con 0x564ac4caefc0 2024-04-25T02:10:37.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fadb23d4640 1 --2- 172.21.15.79:0/811123190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4c97d60 0x564ac4c93ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:37.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fadb1bd3640 1 --2- 172.21.15.79:0/811123190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4caefc0 0x564ac4d2f1e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fad9c000fd0 tx=0x7fad9c005530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0c396272e95ebd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:37.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fad8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:10:37.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fad8d7fa640 1 -- 172.21.15.79:0/811123190 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9c010040 con 0x564ac4caefc0 2024-04-25T02:10:37.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fad8d7fa640 1 -- 172.21.15.79:0/811123190 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fad9c023af0 con 0x564ac4caefc0 2024-04-25T02:10:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fadb7423740 1 -- 172.21.15.79:0/811123190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fada407dd60 con 0x564ac4caefc0 2024-04-25T02:10:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fad8d7fa640 1 -- 172.21.15.79:0/811123190 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fad9c023d30 con 0x564ac4caefc0 2024-04-25T02:10:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fadb7423740 10 client.6363 fetch_fsmap learned FSMap version 24 2024-04-25T02:10:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fadb7423740 1 -- 172.21.15.79:0/811123190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x564ac4c93e00 con 0x564ac4caefc0 2024-04-25T02:10:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fad8d7fa640 1 -- 172.21.15.79:0/811123190 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada407dd60 con 0x564ac4caefc0 2024-04-25T02:10:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fad8d7fa640 1 -- 172.21.15.79:0/811123190 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 24) ==== 3494+0+0 (secure 0 0 0) 0x7fad9c020020 con 0x564ac4caefc0 2024-04-25T02:10:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fadb7423740 10 client.6363 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:10:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fadb7423740 10 client.6363 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T02:10:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fadb7423740 20 client.6363 populate_metadata read hostname 'smithi079' 2024-04-25T02:10:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fadb7423740 1 --2- 172.21.15.79:0/811123190 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x564ac4cb4d90 0x564ac4c6ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fadb7423740 4 client.6363 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:10:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fadb7423740 1 -- 172.21.15.79:0/811123190 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564ac4bd8f40 con 0x564ac4cb4d90 2024-04-25T02:10:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.629+0000 7fadb23d4640 1 --2- 172.21.15.79:0/811123190 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x564ac4cb4d90 0x564ac4c6ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fad8d7fa640 10 client.6363 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:10:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fadb23d4640 1 --2- 172.21.15.79:0/811123190 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x564ac4cb4d90 0x564ac4c6ced0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b83d972c462c428a server_cookie=85c499b6457ee55d in_seq=0 out_seq=0 2024-04-25T02:10:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fad8d7fa640 1 -- 172.21.15.79:0/811123190 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+253 (crc 0 0 0) 0x564ac4bd8f40 con 0x564ac4cb4d90 2024-04-25T02:10:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fad8d7fa640 10 client.6363 handle_command_reply: tid=0 2024-04-25T02:10:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fadb7423740 1 client.6363 shutdown 2024-04-25T02:10:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fadb7423740 1 -- 172.21.15.79:0/811123190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4caefc0 msgr2=0x564ac4d2f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fadb7423740 1 --2- 172.21.15.79:0/811123190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4caefc0 0x564ac4d2f1e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fad9c000fd0 tx=0x7fad9c005530 comp rx=0 tx=0).stop 2024-04-25T02:10:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fadb7423740 1 -- 172.21.15.79:0/811123190 shutdown_connections 2024-04-25T02:10:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fadb7423740 1 --2- 172.21.15.79:0/811123190 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x564ac4cb4d90 0x564ac4c6ced0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fadb7423740 1 --2- 172.21.15.79:0/811123190 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x564ac4cb5600 0x564ac4cafc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fad8d7fa640 0 client.6363 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:10:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fadb7423740 1 --2- 172.21.15.79:0/811123190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ac4caefc0 0x564ac4d2f1e0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fadb7423740 1 --2- 172.21.15.79:0/811123190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ac4c97d60 0x564ac4c93ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fadb7423740 1 -- 172.21.15.79:0/811123190 >> 172.21.15.79:0/811123190 conn(0x564ac4c6da40 msgr2=0x564ac4c63980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fadb7423740 1 -- 172.21.15.79:0/811123190 shutdown_connections 2024-04-25T02:10:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fadb7423740 1 -- 172.21.15.79:0/811123190 wait complete. 2024-04-25T02:10:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.630+0000 7fadb7423740 20 client.6363 trim_cache size 0 max 16384 2024-04-25T02:10:37.645 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:10:37.645 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T02:10:37.645 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-04-25T02:10:37.645 INFO:teuthology.orchestra.run.smithi079.stdout: "0935abe4-3550-4e94-b8b9-1e3c763f79de": { 2024-04-25T02:10:37.645 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-04-25T02:10:37.645 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "0935abe4-3550-4e94-b8b9-1e3c763f79de", 2024-04-25T02:10:37.645 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive" 2024-04-25T02:10:37.645 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:37.645 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:10:37.645 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:10:37.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.631+0000 7fadb4638640 1 -- 172.21.15.79:0/443496107 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fad9006be30 msgr2=0x7fad9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.631+0000 7fadb4638640 1 --2- 172.21.15.79:0/443496107 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fad9006be30 0x7fad9006e2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fadac0b39f0 tx=0x7fada8003a10 comp rx=0 tx=0).stop 2024-04-25T02:10:37.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.631+0000 7fadb4638640 1 -- 172.21.15.79:0/443496107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac15e4f0 msgr2=0x7fadac0c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:37.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.631+0000 7fadb4638640 1 --2- 172.21.15.79:0/443496107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac15e4f0 0x7fadac0c9560 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fada4009870 tx=0x7fada40046c0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.631+0000 7fadb4638640 1 -- 172.21.15.79:0/443496107 shutdown_connections 2024-04-25T02:10:37.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.631+0000 7fadb4638640 1 --2- 172.21.15.79:0/443496107 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fad9006be30 0x7fad9006e2f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.631+0000 7fadb4638640 1 --2- 172.21.15.79:0/443496107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac15e4f0 0x7fadac0c9560 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.631+0000 7fadb4638640 1 --2- 172.21.15.79:0/443496107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadac0d10c0 0x7fadac0b8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.631+0000 7fadb4638640 1 --2- 172.21.15.79:0/443496107 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadac0cf7f0 0x7fadac0b96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:37.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.631+0000 7fadb4638640 1 -- 172.21.15.79:0/443496107 >> 172.21.15.79:0/443496107 conn(0x7fadac09d4a0 msgr2=0x7fadac157110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:37.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.631+0000 7fadb4638640 1 -- 172.21.15.79:0/443496107 shutdown_connections 2024-04-25T02:10:37.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:10:37.631+0000 7fadb4638640 1 -- 172.21.15.79:0/443496107 wait complete. 2024-04-25T02:10:37.649 INFO:tasks.cephfs.filesystem:scrub status for tag:0935abe4-3550-4e94-b8b9-1e3c763f79de - {'path': '/', 'tag': '0935abe4-3550-4e94-b8b9-1e3c763f79de', 'options': 'recursive'} 2024-04-25T02:10:42.415 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:10:42.407+0000 7fb0c78c8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T02:10:59.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:10:59.913 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:11:07.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:11:07.650 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T02:11:07.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.753+0000 7f4b3ef1b640 1 Processor -- start 2024-04-25T02:11:07.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.753+0000 7f4b3ef1b640 1 -- start start 2024-04-25T02:11:07.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.754+0000 7f4b3ef1b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4b3806b2f0 0x7f4b380b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.754+0000 7f4b3ef1b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f4b380cf7a0 0x7f4b3806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.754+0000 7f4b3ef1b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b3806bc10 con 0x7f4b3806e6b0 2024-04-25T02:11:07.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.754+0000 7f4b3ef1b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4b3815f830 con 0x7f4b3806b2f0 2024-04-25T02:11:07.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.754+0000 7f4b3ef1b640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f4b3815ec20 con 0x7f4b380cf7a0 2024-04-25T02:11:07.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.754+0000 7f4b3ccb7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4b3806b2f0 0x7f4b380b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.754+0000 7f4b3ccb7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4b3806b2f0 0x7f4b380b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47208/0 (socket says 172.21.15.79:47208) 2024-04-25T02:11:07.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.754+0000 7f4b3ccb7640 1 -- 172.21.15.79:0/294695650 learned_addr learned my addr 172.21.15.79:0/294695650 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:07.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.754+0000 7f4b3ccb7640 1 -- 172.21.15.79:0/294695650 >> v2:172.21.15.189:3300/0 conn(0x7f4b380cf7a0 msgr2=0x7f4b3806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:07.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.754+0000 7f4b3ccb7640 1 --2- 172.21.15.79:0/294695650 >> v2:172.21.15.189:3300/0 conn(0x7f4b380cf7a0 0x7f4b3806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.754+0000 7f4b3ccb7640 1 -- 172.21.15.79:0/294695650 >> v1:172.21.15.189:6789/0 conn(0x7f4b3806e6b0 legacy=0x7f4b380cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:07.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.754+0000 7f4b3ccb7640 1 -- 172.21.15.79:0/294695650 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3815ef00 con 0x7f4b3806b2f0 2024-04-25T02:11:07.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.755+0000 7f4b3ccb7640 1 --2- 172.21.15.79:0/294695650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3806b2f0 0x7f4b380b4b50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4b380af800 tx=0x7f4b2c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5a19e28b4bbaf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:07.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.755+0000 7f4b377fe640 1 -- 172.21.15.79:0/294695650 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c037070 con 0x7f4b3806b2f0 2024-04-25T02:11:07.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.755+0000 7f4b377fe640 1 -- 172.21.15.79:0/294695650 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b2c032440 con 0x7f4b3806b2f0 2024-04-25T02:11:07.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.755+0000 7f4b377fe640 1 -- 172.21.15.79:0/294695650 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c032810 con 0x7f4b3806b2f0 2024-04-25T02:11:07.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.755+0000 7f4b3ef1b640 1 -- 172.21.15.79:0/294695650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3806b2f0 msgr2=0x7f4b380b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:07.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.755+0000 7f4b3ef1b640 1 --2- 172.21.15.79:0/294695650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3806b2f0 0x7f4b380b4b50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4b380af800 tx=0x7f4b2c02a1a0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.756+0000 7f4b3ef1b640 1 -- 172.21.15.79:0/294695650 shutdown_connections 2024-04-25T02:11:07.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.756+0000 7f4b3ef1b640 1 --2- 172.21.15.79:0/294695650 >> v2:172.21.15.189:3300/0 conn(0x7f4b380cf7a0 0x7f4b3806b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.756+0000 7f4b3ef1b640 1 --2- 172.21.15.79:0/294695650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3806b2f0 0x7f4b380b4b50 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.756+0000 7f4b3ef1b640 1 -- 172.21.15.79:0/294695650 >> 172.21.15.79:0/294695650 conn(0x7f4b380b1cd0 msgr2=0x7f4b380b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:07.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.756+0000 7f4b3ef1b640 1 -- 172.21.15.79:0/294695650 shutdown_connections 2024-04-25T02:11:07.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.756+0000 7f4b3ef1b640 1 -- 172.21.15.79:0/294695650 wait complete. 2024-04-25T02:11:07.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.757+0000 7f4b3ef1b640 1 Processor -- start 2024-04-25T02:11:07.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.757+0000 7f4b3ef1b640 1 -- start start 2024-04-25T02:11:07.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3ef1b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4b3806b2f0 0x7f4b3809b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3ef1b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3806e6b0 0x7f4b3809d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3ef1b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b380cf7a0 0x7f4b38159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3ef1b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3806cfe0 con 0x7f4b380cf7a0 2024-04-25T02:11:07.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3ef1b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3815f4c0 con 0x7f4b3806e6b0 2024-04-25T02:11:07.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3ef1b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4b3806d160 con 0x7f4b3806b2f0 2024-04-25T02:11:07.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3d4b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b380cf7a0 0x7f4b38159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3d4b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b380cf7a0 0x7f4b38159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47216/0 (socket says 172.21.15.79:47216) 2024-04-25T02:11:07.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3d4b8640 1 -- 172.21.15.79:0/25064407 learned_addr learned my addr 172.21.15.79:0/25064407 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3ccb7640 1 --2- 172.21.15.79:0/25064407 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4b3806b2f0 0x7f4b3809b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b37fff640 1 --2- 172.21.15.79:0/25064407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3806e6b0 0x7f4b3809d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3d4b8640 1 -- 172.21.15.79:0/25064407 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4b3806b2f0 msgr2=0x7f4b3809b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3d4b8640 1 --2- 172.21.15.79:0/25064407 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4b3806b2f0 0x7f4b3809b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3d4b8640 1 -- 172.21.15.79:0/25064407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3806e6b0 msgr2=0x7f4b3809d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3d4b8640 1 --2- 172.21.15.79:0/25064407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3806e6b0 0x7f4b3809d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3d4b8640 1 -- 172.21.15.79:0/25064407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3809db40 con 0x7f4b380cf7a0 2024-04-25T02:11:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b37fff640 1 --2- 172.21.15.79:0/25064407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3806e6b0 0x7f4b3809d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3d4b8640 1 --2- 172.21.15.79:0/25064407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b380cf7a0 0x7f4b38159840 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000c780 tx=0x7f4b3000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b357fa640 1 -- 172.21.15.79:0/25064407 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30017070 con 0x7f4b380cf7a0 2024-04-25T02:11:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b357fa640 1 -- 172.21.15.79:0/25064407 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b30003da0 con 0x7f4b380cf7a0 2024-04-25T02:11:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3ef1b640 1 -- 172.21.15.79:0/25064407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3809bad0 con 0x7f4b380cf7a0 2024-04-25T02:11:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b357fa640 1 -- 172.21.15.79:0/25064407 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b300052b0 con 0x7f4b380cf7a0 2024-04-25T02:11:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.758+0000 7f4b3ef1b640 1 -- 172.21.15.79:0/25064407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b3809c090 con 0x7f4b380cf7a0 2024-04-25T02:11:07.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.760+0000 7f4b357fa640 1 -- 172.21.15.79:0/25064407 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b3001a070 con 0x7f4b380cf7a0 2024-04-25T02:11:07.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.760+0000 7f4b357fa640 1 --2- 172.21.15.79:0/25064407 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4b1c06be30 0x7f4b1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.760+0000 7f4b357fa640 1 -- 172.21.15.79:0/25064407 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f4b3008a3e0 con 0x7f4b380cf7a0 2024-04-25T02:11:07.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.760+0000 7f4b3ccb7640 1 --2- 172.21.15.79:0/25064407 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4b1c06be30 0x7f4b1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.761+0000 7f4b3ccb7640 1 --2- 172.21.15.79:0/25064407 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4b1c06be30 0x7f4b1c06e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c034000 tx=0x7f4b2c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:07.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.761+0000 7f4b41c2c740 1 Processor -- start 2024-04-25T02:11:07.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.761+0000 7f4b41c2c740 1 -- start start 2024-04-25T02:11:07.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.762+0000 7f4b41c2c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a12d60 0x55a4e5a13140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.762+0000 7f4b41c2c740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a30600 0x55a4e5a30b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.762+0000 7f4b41c2c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e59e8a40 0x55a4e5a2ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.762+0000 7f4b41c2c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a4e594c6b0 con 0x55a4e59e8a40 2024-04-25T02:11:07.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.762+0000 7f4b41c2c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a4e58f4880 con 0x55a4e5a12d60 2024-04-25T02:11:07.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.762+0000 7f4b41c2c740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55a4e5948670 con 0x55a4e5a30600 2024-04-25T02:11:07.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.762+0000 7f4b3d4b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e59e8a40 0x55a4e5a2ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.762+0000 7f4b3d4b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e59e8a40 0x55a4e5a2ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47232/0 (socket says 172.21.15.79:47232) 2024-04-25T02:11:07.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.762+0000 7f4b3d4b8640 1 -- 172.21.15.79:0/2212936564 learned_addr learned my addr 172.21.15.79:0/2212936564 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:07.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b3d4b8640 1 -- 172.21.15.79:0/2212936564 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a30600 msgr2=0x55a4e5a30b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b3d4b8640 1 --2- 172.21.15.79:0/2212936564 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a30600 0x55a4e5a30b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b3d4b8640 1 -- 172.21.15.79:0/2212936564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a12d60 msgr2=0x55a4e5a13140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b3d4b8640 1 --2- 172.21.15.79:0/2212936564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a12d60 0x55a4e5a13140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b3d4b8640 1 -- 172.21.15.79:0/2212936564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4e572a7d0 con 0x55a4e59e8a40 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b3d4b8640 1 --2- 172.21.15.79:0/2212936564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e59e8a40 0x55a4e5a2ecc0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4b30060dd0 tx=0x7f4b300587d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781ced5485d09b60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b227fc640 1 -- 172.21.15.79:0/2212936564 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30061300 con 0x55a4e59e8a40 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b227fc640 1 -- 172.21.15.79:0/2212936564 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b30056ad0 con 0x55a4e59e8a40 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b227fc640 1 -- 172.21.15.79:0/2212936564 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3008a070 con 0x55a4e59e8a40 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b41c2c740 1 -- 172.21.15.79:0/2212936564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e59e8a40 msgr2=0x55a4e5a2ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/2212936564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e59e8a40 0x55a4e5a2ecc0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4b30060dd0 tx=0x7f4b300587d0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b41c2c740 1 -- 172.21.15.79:0/2212936564 shutdown_connections 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/2212936564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e59e8a40 0x55a4e5a2ecc0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/2212936564 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a30600 0x55a4e5a30b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/2212936564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a12d60 0x55a4e5a13140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.763+0000 7f4b41c2c740 1 -- 172.21.15.79:0/2212936564 >> 172.21.15.79:0/2212936564 conn(0x55a4e59e5600 msgr2=0x55a4e5a2db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.764+0000 7f4b41c2c740 1 -- 172.21.15.79:0/2212936564 shutdown_connections 2024-04-25T02:11:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.764+0000 7f4b41c2c740 1 -- 172.21.15.79:0/2212936564 wait complete. 2024-04-25T02:11:07.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.764+0000 7f4b41c2c740 1 -- start start 2024-04-25T02:11:07.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.764+0000 7f4b41c2c740 1 Processor -- start 2024-04-25T02:11:07.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b41c2c740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a12d60 0x55a4e5a27330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b41c2c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a30600 0x55a4e59e2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b41c2c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a169a0 0x55a4e59e27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b41c2c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a4e59e97e0 con 0x55a4e5a169a0 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b41c2c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a4e5907f50 con 0x55a4e5a30600 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b41c2c740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55a4e59e3530 con 0x55a4e5a12d60 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b41c2c740 10 client.0 _ll_register_callbacks cb 0x55a4e5943000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b3d4b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a169a0 0x55a4e59e27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b3d4b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a169a0 0x55a4e59e27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47238/0 (socket says 172.21.15.79:47238) 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b3d4b8640 1 -- 172.21.15.79:0/3820694351 learned_addr learned my addr 172.21.15.79:0/3820694351 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b37fff640 1 --2- 172.21.15.79:0/3820694351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a30600 0x55a4e59e2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b3ccb7640 1 --2- 172.21.15.79:0/3820694351 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a12d60 0x55a4e5a27330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b3d4b8640 1 -- 172.21.15.79:0/3820694351 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a12d60 msgr2=0x55a4e5a27330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b3d4b8640 1 --2- 172.21.15.79:0/3820694351 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a12d60 0x55a4e5a27330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b3d4b8640 1 -- 172.21.15.79:0/3820694351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a30600 msgr2=0x55a4e59e2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b3d4b8640 1 --2- 172.21.15.79:0/3820694351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a30600 0x55a4e59e2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b3d4b8640 1 -- 172.21.15.79:0/3820694351 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4e56603f0 con 0x55a4e5a169a0 2024-04-25T02:11:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.765+0000 7f4b37fff640 1 --2- 172.21.15.79:0/3820694351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a30600 0x55a4e59e2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b3d4b8640 1 --2- 172.21.15.79:0/3820694351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a169a0 0x55a4e59e27a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000a430 tx=0x7f4b30003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b68e7e77affd35e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b177fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:11:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b177fe640 1 -- 172.21.15.79:0/3820694351 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30061070 con 0x55a4e5a169a0 2024-04-25T02:11:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b177fe640 1 -- 172.21.15.79:0/3820694351 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f4b3006cbb0 con 0x55a4e5a169a0 2024-04-25T02:11:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b41c2c740 1 -- 172.21.15.79:0/3820694351 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b30056ad0 con 0x55a4e5a169a0 2024-04-25T02:11:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b177fe640 1 -- 172.21.15.79:0/3820694351 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4b3006cdb0 con 0x55a4e5a169a0 2024-04-25T02:11:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b41c2c740 10 client.6375 fetch_fsmap learned FSMap version 25 2024-04-25T02:11:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b41c2c740 1 -- 172.21.15.79:0/3820694351 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55a4e56200f0 con 0x55a4e5a169a0 2024-04-25T02:11:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b177fe640 1 -- 172.21.15.79:0/3820694351 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b30056ad0 con 0x55a4e5a169a0 2024-04-25T02:11:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b177fe640 1 -- 172.21.15.79:0/3820694351 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f4b30057c20 con 0x55a4e5a169a0 2024-04-25T02:11:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b41c2c740 10 client.6375 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T02:11:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b41c2c740 10 client.6375 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T02:11:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b41c2c740 20 client.6375 populate_metadata read hostname 'smithi079' 2024-04-25T02:11:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/3820694351 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55a4e5a250f0 0x55a4e5a254d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b41c2c740 4 client.6375 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b41c2c740 1 -- 172.21.15.79:0/3820694351 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4e5959bf0 con 0x55a4e5a250f0 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.766+0000 7f4b3ccb7640 1 --2- 172.21.15.79:0/3820694351 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55a4e5a250f0 0x55a4e5a254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.767+0000 7f4b177fe640 10 client.6375 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.767+0000 7f4b3ccb7640 1 --2- 172.21.15.79:0/3820694351 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55a4e5a250f0 0x55a4e5a254d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=232bc507907a720b server_cookie=939cd73b6d7c0ca8 in_seq=0 out_seq=0 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.767+0000 7f4b177fe640 1 -- 172.21.15.79:0/3820694351 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a4e5959bf0 con 0x55a4e5a250f0 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.767+0000 7f4b177fe640 10 client.6375 handle_command_reply: tid=0 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.767+0000 7f4b41c2c740 1 client.6375 shutdown 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.767+0000 7f4b41c2c740 1 -- 172.21.15.79:0/3820694351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a169a0 msgr2=0x55a4e59e27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.767+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/3820694351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a169a0 0x55a4e59e27a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000a430 tx=0x7f4b30003f90 comp rx=0 tx=0).stop 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.767+0000 7f4b41c2c740 1 -- 172.21.15.79:0/3820694351 shutdown_connections 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.767+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/3820694351 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55a4e5a250f0 0x55a4e5a254d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.767+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/3820694351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a169a0 0x55a4e59e27a0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.767+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/3820694351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a30600 0x55a4e59e2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.767+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/3820694351 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a12d60 0x55a4e5a27330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.767+0000 7f4b177fe640 0 client.6375 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:07.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.767+0000 7f4b41c2c740 1 -- 172.21.15.79:0/3820694351 >> 172.21.15.79:0/3820694351 conn(0x55a4e59e8a40 msgr2=0x55a4e5a310f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:07.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.768+0000 7f4b41c2c740 1 -- 172.21.15.79:0/3820694351 shutdown_connections 2024-04-25T02:11:07.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.768+0000 7f4b41c2c740 1 -- 172.21.15.79:0/3820694351 wait complete. 2024-04-25T02:11:07.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.768+0000 7f4b41c2c740 20 client.6375 trim_cache size 0 max 16384 2024-04-25T02:11:07.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.785+0000 7f4b41c2c740 1 Processor -- start 2024-04-25T02:11:07.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.785+0000 7f4b41c2c740 1 -- start start 2024-04-25T02:11:07.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.786+0000 7f4b41c2c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a12d60 0x55a4e59e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.786+0000 7f4b41c2c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a169a0 0x55a4e5a0e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.786+0000 7f4b41c2c740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a30600 0x55a4e5a0edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.786+0000 7f4b41c2c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4b381fe640 con 0x55a4e5a169a0 2024-04-25T02:11:07.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.786+0000 7f4b41c2c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4b381fd640 con 0x55a4e5a12d60 2024-04-25T02:11:07.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.786+0000 7f4b41c2c740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4b381fc9f0 con 0x55a4e5a30600 2024-04-25T02:11:07.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.786+0000 7f4b37fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a169a0 0x55a4e5a0e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.786+0000 7f4b37fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a169a0 0x55a4e5a0e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47242/0 (socket says 172.21.15.79:47242) 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.786+0000 7f4b37fff640 1 -- 172.21.15.79:0/1684571712 learned_addr learned my addr 172.21.15.79:0/1684571712 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.786+0000 7f4b37fff640 1 -- 172.21.15.79:0/1684571712 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a30600 msgr2=0x55a4e5a0edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.786+0000 7f4b37fff640 1 --2- 172.21.15.79:0/1684571712 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a30600 0x55a4e5a0edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.786+0000 7f4b37fff640 1 -- 172.21.15.79:0/1684571712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a12d60 msgr2=0x55a4e59e7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.786+0000 7f4b37fff640 1 --2- 172.21.15.79:0/1684571712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a12d60 0x55a4e59e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.786+0000 7f4b37fff640 1 -- 172.21.15.79:0/1684571712 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4e59d5090 con 0x55a4e5a169a0 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.786+0000 7f4b37fff640 1 --2- 172.21.15.79:0/1684571712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a169a0 0x55a4e5a0e890 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4b240097c0 tx=0x7f4b24009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b4028ee15bab2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.787+0000 7f4b21ffb640 1 -- 172.21.15.79:0/1684571712 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24017020 con 0x55a4e5a169a0 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.787+0000 7f4b21ffb640 1 -- 172.21.15.79:0/1684571712 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b2400e8d0 con 0x55a4e5a169a0 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.787+0000 7f4b21ffb640 1 -- 172.21.15.79:0/1684571712 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2400f040 con 0x55a4e5a169a0 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.787+0000 7f4b41c2c740 1 -- 172.21.15.79:0/1684571712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a169a0 msgr2=0x55a4e5a0e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.787+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/1684571712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a169a0 0x55a4e5a0e890 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4b240097c0 tx=0x7f4b24009c80 comp rx=0 tx=0).stop 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.787+0000 7f4b41c2c740 1 -- 172.21.15.79:0/1684571712 shutdown_connections 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.787+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/1684571712 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a30600 0x55a4e5a0edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.787+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/1684571712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a169a0 0x55a4e5a0e890 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.787+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/1684571712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a12d60 0x55a4e59e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.787+0000 7f4b41c2c740 1 -- 172.21.15.79:0/1684571712 >> 172.21.15.79:0/1684571712 conn(0x55a4e59e8a40 msgr2=0x55a4e5a12120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:07.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.787+0000 7f4b41c2c740 1 -- 172.21.15.79:0/1684571712 shutdown_connections 2024-04-25T02:11:07.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.787+0000 7f4b41c2c740 1 -- 172.21.15.79:0/1684571712 wait complete. 2024-04-25T02:11:07.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.788+0000 7f4b41c2c740 1 -- start start 2024-04-25T02:11:07.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.788+0000 7f4b41c2c740 1 Processor -- start 2024-04-25T02:11:07.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b41c2c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a12d60 0x55a4e5aa7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b41c2c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a169a0 0x55a4e5a27140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b41c2c740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a30600 0x55a4e5a27680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b41c2c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a4e59e2fb0 con 0x55a4e5a12d60 2024-04-25T02:11:07.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b41c2c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4b381fcff0 con 0x55a4e5a169a0 2024-04-25T02:11:07.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b41c2c740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55a4e5a51bf0 con 0x55a4e5a30600 2024-04-25T02:11:07.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b41c2c740 10 client.0 _ll_register_callbacks cb 0x7f4b30058650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:07.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b3ccb7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a12d60 0x55a4e5aa7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b3ccb7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a12d60 0x55a4e5aa7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47252/0 (socket says 172.21.15.79:47252) 2024-04-25T02:11:07.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b3ccb7640 1 -- 172.21.15.79:0/4068923553 learned_addr learned my addr 172.21.15.79:0/4068923553 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:07.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b37fff640 1 --2- 172.21.15.79:0/4068923553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a169a0 0x55a4e5a27140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b3d4b8640 1 --2- 172.21.15.79:0/4068923553 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a30600 0x55a4e5a27680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b3ccb7640 1 -- 172.21.15.79:0/4068923553 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a30600 msgr2=0x55a4e5a27680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:07.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b3ccb7640 1 --2- 172.21.15.79:0/4068923553 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a30600 0x55a4e5a27680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b3ccb7640 1 -- 172.21.15.79:0/4068923553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a169a0 msgr2=0x55a4e5a27140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:07.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b3ccb7640 1 --2- 172.21.15.79:0/4068923553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a169a0 0x55a4e5a27140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b3ccb7640 1 -- 172.21.15.79:0/4068923553 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4e5a0f6d0 con 0x55a4e5a12d60 2024-04-25T02:11:07.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b3ccb7640 1 --2- 172.21.15.79:0/4068923553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a12d60 0x55a4e5aa7600 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c035040 tx=0x7f4b2c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e1a0e1b48f9128 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:07.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b177fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:11:07.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b177fe640 1 -- 172.21.15.79:0/4068923553 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c037040 con 0x55a4e5a12d60 2024-04-25T02:11:07.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b177fe640 1 -- 172.21.15.79:0/4068923553 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f4b2c04db50 con 0x55a4e5a12d60 2024-04-25T02:11:07.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.789+0000 7f4b41c2c740 1 -- 172.21.15.79:0/4068923553 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b2400e8d0 con 0x55a4e5a12d60 2024-04-25T02:11:07.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b177fe640 1 -- 172.21.15.79:0/4068923553 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4b2c05c050 con 0x55a4e5a12d60 2024-04-25T02:11:07.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b41c2c740 10 client.6381 fetch_fsmap learned FSMap version 25 2024-04-25T02:11:07.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b41c2c740 1 -- 172.21.15.79:0/4068923553 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55a4e5a3da50 con 0x55a4e5a12d60 2024-04-25T02:11:07.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b177fe640 1 -- 172.21.15.79:0/4068923553 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b2400e8d0 con 0x55a4e5a12d60 2024-04-25T02:11:07.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b177fe640 1 -- 172.21.15.79:0/4068923553 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f4b2c05f020 con 0x55a4e5a12d60 2024-04-25T02:11:07.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b41c2c740 10 client.6381 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T02:11:07.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b41c2c740 10 client.6381 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T02:11:07.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b41c2c740 20 client.6381 populate_metadata read hostname 'smithi079' 2024-04-25T02:11:07.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/4068923553 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55a4e59e8220 0x55a4e5a23500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b41c2c740 4 client.6381 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:11:07.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b41c2c740 1 -- 172.21.15.79:0/4068923553 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a4e5953f40 con 0x55a4e59e8220 2024-04-25T02:11:07.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b37fff640 1 --2- 172.21.15.79:0/4068923553 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55a4e59e8220 0x55a4e5a23500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b177fe640 10 client.6381 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:07.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b37fff640 1 --2- 172.21.15.79:0/4068923553 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55a4e59e8220 0x55a4e5a23500 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea4e6361d787a2ce server_cookie=ee233b605d9551cd in_seq=0 out_seq=0 2024-04-25T02:11:07.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b177fe640 1 -- 172.21.15.79:0/4068923553 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a4e5953f40 con 0x55a4e59e8220 2024-04-25T02:11:07.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b177fe640 10 client.6381 handle_command_reply: tid=0 2024-04-25T02:11:07.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.790+0000 7f4b41c2c740 1 client.6381 shutdown 2024-04-25T02:11:07.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b41c2c740 1 -- 172.21.15.79:0/4068923553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a12d60 msgr2=0x55a4e5aa7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:07.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/4068923553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a12d60 0x55a4e5aa7600 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c035040 tx=0x7f4b2c004730 comp rx=0 tx=0).stop 2024-04-25T02:11:07.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b41c2c740 1 -- 172.21.15.79:0/4068923553 shutdown_connections 2024-04-25T02:11:07.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/4068923553 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55a4e59e8220 0x55a4e5a23500 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/4068923553 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55a4e5a30600 0x55a4e5a27680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/4068923553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4e5a169a0 0x55a4e5a27140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b41c2c740 1 --2- 172.21.15.79:0/4068923553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4e5a12d60 0x55a4e5aa7600 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b177fe640 0 client.6381 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:07.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b41c2c740 1 -- 172.21.15.79:0/4068923553 >> 172.21.15.79:0/4068923553 conn(0x55a4e59e8a40 msgr2=0x55a4e5a50ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:07.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b41c2c740 1 -- 172.21.15.79:0/4068923553 shutdown_connections 2024-04-25T02:11:07.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b41c2c740 1 -- 172.21.15.79:0/4068923553 wait complete. 2024-04-25T02:11:07.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b41c2c740 20 client.6381 trim_cache size 0 max 16384 2024-04-25T02:11:07.805 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:11:07.805 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-04-25T02:11:07.805 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-04-25T02:11:07.806 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:11:07.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b3ef1b640 1 -- 172.21.15.79:0/25064407 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4b1c06be30 msgr2=0x7f4b1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:07.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b3ef1b640 1 --2- 172.21.15.79:0/25064407 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4b1c06be30 0x7f4b1c06e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c034000 tx=0x7f4b2c02e000 comp rx=0 tx=0).stop 2024-04-25T02:11:07.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b3ef1b640 1 -- 172.21.15.79:0/25064407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b380cf7a0 msgr2=0x7f4b38159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:07.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b3ef1b640 1 --2- 172.21.15.79:0/25064407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b380cf7a0 0x7f4b38159840 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000c780 tx=0x7f4b3000cc40 comp rx=0 tx=0).stop 2024-04-25T02:11:07.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b3ef1b640 1 -- 172.21.15.79:0/25064407 shutdown_connections 2024-04-25T02:11:07.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b3ef1b640 1 --2- 172.21.15.79:0/25064407 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4b1c06be30 0x7f4b1c06e2f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b3ef1b640 1 --2- 172.21.15.79:0/25064407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b380cf7a0 0x7f4b38159840 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b3ef1b640 1 --2- 172.21.15.79:0/25064407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3806e6b0 0x7f4b3809d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b3ef1b640 1 --2- 172.21.15.79:0/25064407 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4b3806b2f0 0x7f4b3809b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b3ef1b640 1 -- 172.21.15.79:0/25064407 >> 172.21.15.79:0/25064407 conn(0x7f4b380b1cd0 msgr2=0x7f4b380721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:07.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b3ef1b640 1 -- 172.21.15.79:0/25064407 shutdown_connections 2024-04-25T02:11:07.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.791+0000 7f4b3ef1b640 1 -- 172.21.15.79:0/25064407 wait complete. 2024-04-25T02:11:07.810 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T02:11:07.810 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:11:07.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.899+0000 7fd294022640 1 Processor -- start 2024-04-25T02:11:07.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.899+0000 7fd294022640 1 -- start start 2024-04-25T02:11:07.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.900+0000 7fd294022640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd28c15e4d0 0x7fd28c06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.900+0000 7fd294022640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd28c0d2e20 0x7fd28c0cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.900+0000 7fd294022640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28c0d1660 con 0x7fd28c0b3570 2024-04-25T02:11:07.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.900+0000 7fd294022640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd28c0d1380 con 0x7fd28c0d2e20 2024-04-25T02:11:07.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.900+0000 7fd294022640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd28c0cede0 con 0x7fd28c15e4d0 2024-04-25T02:11:07.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.900+0000 7fd2925bf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd28c0d2e20 0x7fd28c0cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.900+0000 7fd2925bf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd28c0d2e20 0x7fd28c0cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47268/0 (socket says 172.21.15.79:47268) 2024-04-25T02:11:07.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.900+0000 7fd2925bf640 1 -- 172.21.15.79:0/3662742653 learned_addr learned my addr 172.21.15.79:0/3662742653 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:07.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.901+0000 7fd291dbe640 1 --2- 172.21.15.79:0/3662742653 >> v2:172.21.15.189:3300/0 conn(0x7fd28c15e4d0 0x7fd28c06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.901+0000 7fd2925bf640 1 -- 172.21.15.79:0/3662742653 >> v2:172.21.15.189:3300/0 conn(0x7fd28c15e4d0 msgr2=0x7fd28c06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.901+0000 7fd2925bf640 1 --2- 172.21.15.79:0/3662742653 >> v2:172.21.15.189:3300/0 conn(0x7fd28c15e4d0 0x7fd28c06bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.901+0000 7fd2925bf640 1 -- 172.21.15.79:0/3662742653 >> v1:172.21.15.189:6789/0 conn(0x7fd28c0b3570 legacy=0x7fd28c0d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.901+0000 7fd2925bf640 1 -- 172.21.15.79:0/3662742653 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c0cf0c0 con 0x7fd28c0d2e20 2024-04-25T02:11:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.901+0000 7fd291dbe640 1 --2- 172.21.15.79:0/3662742653 >> v2:172.21.15.189:3300/0 conn(0x7fd28c15e4d0 0x7fd28c06bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.901+0000 7fd2925bf640 1 --2- 172.21.15.79:0/3662742653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28c0d2e20 0x7fd28c0cf5e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd284009870 tx=0x7fd28402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26dfc2233d06b24a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.901+0000 7fd290dbc640 1 -- 172.21.15.79:0/3662742653 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284037070 con 0x7fd28c0d2e20 2024-04-25T02:11:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.902+0000 7fd290dbc640 1 -- 172.21.15.79:0/3662742653 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd284032440 con 0x7fd28c0d2e20 2024-04-25T02:11:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.902+0000 7fd290dbc640 1 -- 172.21.15.79:0/3662742653 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284032810 con 0x7fd28c0d2e20 2024-04-25T02:11:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.902+0000 7fd294022640 1 -- 172.21.15.79:0/3662742653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28c0d2e20 msgr2=0x7fd28c0cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.902+0000 7fd294022640 1 --2- 172.21.15.79:0/3662742653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28c0d2e20 0x7fd28c0cf5e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd284009870 tx=0x7fd28402a270 comp rx=0 tx=0).stop 2024-04-25T02:11:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.902+0000 7fd294022640 1 -- 172.21.15.79:0/3662742653 shutdown_connections 2024-04-25T02:11:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.902+0000 7fd294022640 1 --2- 172.21.15.79:0/3662742653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28c0d2e20 0x7fd28c0cf5e0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.902+0000 7fd294022640 1 --2- 172.21.15.79:0/3662742653 >> v2:172.21.15.189:3300/0 conn(0x7fd28c15e4d0 0x7fd28c06bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.902+0000 7fd294022640 1 -- 172.21.15.79:0/3662742653 >> 172.21.15.79:0/3662742653 conn(0x7fd28c09d460 msgr2=0x7fd28c0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:07.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.902+0000 7fd294022640 1 -- 172.21.15.79:0/3662742653 shutdown_connections 2024-04-25T02:11:07.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.902+0000 7fd294022640 1 -- 172.21.15.79:0/3662742653 wait complete. 2024-04-25T02:11:07.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.903+0000 7fd294022640 1 Processor -- start 2024-04-25T02:11:07.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.903+0000 7fd294022640 1 -- start start 2024-04-25T02:11:07.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.904+0000 7fd294022640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd28c0b3570 0x7fd28c1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.904+0000 7fd294022640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd28c0d2e20 0x7fd28c1f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.904+0000 7fd294022640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28c15e4d0 0x7fd28c0b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.904+0000 7fd294022640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c0d2250 con 0x7fd28c15e4d0 2024-04-25T02:11:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.904+0000 7fd294022640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c0d20d0 con 0x7fd28c0b3570 2024-04-25T02:11:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.904+0000 7fd294022640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd28c06c1b0 con 0x7fd28c0d2e20 2024-04-25T02:11:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.904+0000 7fd2925bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28c15e4d0 0x7fd28c0b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.904+0000 7fd2925bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28c15e4d0 0x7fd28c0b8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47280/0 (socket says 172.21.15.79:47280) 2024-04-25T02:11:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.904+0000 7fd2925bf640 1 -- 172.21.15.79:0/2465995281 learned_addr learned my addr 172.21.15.79:0/2465995281 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.904+0000 7fd2925bf640 1 -- 172.21.15.79:0/2465995281 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd28c0d2e20 msgr2=0x7fd28c1f8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.904+0000 7fd2925bf640 1 --2- 172.21.15.79:0/2465995281 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd28c0d2e20 0x7fd28c1f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.904+0000 7fd2925bf640 1 -- 172.21.15.79:0/2465995281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd28c0b3570 msgr2=0x7fd28c1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.904+0000 7fd2925bf640 1 --2- 172.21.15.79:0/2465995281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd28c0b3570 0x7fd28c1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.904+0000 7fd2925bf640 1 -- 172.21.15.79:0/2465995281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c0b8c20 con 0x7fd28c15e4d0 2024-04-25T02:11:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.904+0000 7fd2925bf640 1 --2- 172.21.15.79:0/2465995281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28c15e4d0 0x7fd28c0b8fa0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd28402a2b0 tx=0x7fd2840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.905+0000 7fd2827fc640 1 -- 172.21.15.79:0/2465995281 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284041020 con 0x7fd28c15e4d0 2024-04-25T02:11:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.905+0000 7fd2827fc640 1 -- 172.21.15.79:0/2465995281 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd284030800 con 0x7fd28c15e4d0 2024-04-25T02:11:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.905+0000 7fd2827fc640 1 -- 172.21.15.79:0/2465995281 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284037040 con 0x7fd28c15e4d0 2024-04-25T02:11:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.905+0000 7fd294022640 1 -- 172.21.15.79:0/2465995281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28c1f8950 con 0x7fd28c15e4d0 2024-04-25T02:11:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.905+0000 7fd294022640 1 -- 172.21.15.79:0/2465995281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28c0b5680 con 0x7fd28c15e4d0 2024-04-25T02:11:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.906+0000 7fd294022640 1 -- 172.21.15.79:0/2465995281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd28c0690a0 con 0x7fd28c15e4d0 2024-04-25T02:11:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.906+0000 7fd2827fc640 1 -- 172.21.15.79:0/2465995281 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd284044020 con 0x7fd28c15e4d0 2024-04-25T02:11:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.906+0000 7fd2827fc640 1 --2- 172.21.15.79:0/2465995281 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd27006be30 0x7fd27006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.907+0000 7fd2827fc640 1 -- 172.21.15.79:0/2465995281 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fd2840ab7e0 con 0x7fd28c15e4d0 2024-04-25T02:11:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.907+0000 7fd291dbe640 1 --2- 172.21.15.79:0/2465995281 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd27006be30 0x7fd27006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.907+0000 7fd291dbe640 1 --2- 172.21.15.79:0/2465995281 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd27006be30 0x7fd27006e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd288008e00 tx=0x7fd288008330 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:07.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:07.911+0000 7fd2827fc640 1 -- 172.21.15.79:0/2465995281 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd28404b030 con 0x7fd28c15e4d0 2024-04-25T02:11:08.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.122+0000 7fd294022640 1 -- 172.21.15.79:0/2465995281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd28c0d2b00 con 0x7fd28c15e4d0 2024-04-25T02:11:08.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.123+0000 7fd2827fc640 1 -- 172.21.15.79:0/2465995281 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5184 (secure 0 0 0) 0x7fd28c1f8950 con 0x7fd28c15e4d0 2024-04-25T02:11:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:08.131 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5431,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3495029157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3495029157},{"type":"v1","addr":"172.21.15.189:6834","nonce":3495029157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2036557544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2036557544},{"type":"v1","addr":"172.21.15.189:6835","nonce":2036557544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/326759836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":326759836},{"type":"v1","addr":"172.21.15.79:6836","nonce":326759836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:25.684570+0000","modified":"2024-04-25T02:10:42.372417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.79:6837/2253487658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2253487658},{"type":"v1","addr":"172.21.15.79:6837","nonce":2253487658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":4}]} 2024-04-25T02:11:08.131 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 25 2024-04-25T02:11:08.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.125+0000 7fd294022640 1 -- 172.21.15.79:0/2465995281 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd27006be30 msgr2=0x7fd27006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.125+0000 7fd294022640 1 --2- 172.21.15.79:0/2465995281 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd27006be30 0x7fd27006e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd288008e00 tx=0x7fd288008330 comp rx=0 tx=0).stop 2024-04-25T02:11:08.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.125+0000 7fd294022640 1 -- 172.21.15.79:0/2465995281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28c15e4d0 msgr2=0x7fd28c0b8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.125+0000 7fd294022640 1 --2- 172.21.15.79:0/2465995281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28c15e4d0 0x7fd28c0b8fa0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd28402a2b0 tx=0x7fd2840046c0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.125+0000 7fd294022640 1 -- 172.21.15.79:0/2465995281 shutdown_connections 2024-04-25T02:11:08.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.125+0000 7fd294022640 1 --2- 172.21.15.79:0/2465995281 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd27006be30 0x7fd27006e2f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.125+0000 7fd294022640 1 --2- 172.21.15.79:0/2465995281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28c15e4d0 0x7fd28c0b8fa0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.125+0000 7fd294022640 1 --2- 172.21.15.79:0/2465995281 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd28c0d2e20 0x7fd28c1f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.125+0000 7fd294022640 1 --2- 172.21.15.79:0/2465995281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd28c0b3570 0x7fd28c1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.125+0000 7fd294022640 1 -- 172.21.15.79:0/2465995281 >> 172.21.15.79:0/2465995281 conn(0x7fd28c09d460 msgr2=0x7fd28c0b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.125+0000 7fd294022640 1 -- 172.21.15.79:0/2465995281 shutdown_connections 2024-04-25T02:11:08.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.125+0000 7fd294022640 1 -- 172.21.15.79:0/2465995281 wait complete. 2024-04-25T02:11:08.143 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T02:11:08.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.234+0000 7fba58d29640 1 Processor -- start 2024-04-25T02:11:08.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.234+0000 7fba58d29640 1 -- start start 2024-04-25T02:11:08.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.235+0000 7fba58d29640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fba5406b2f0 0x7fba540b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.235+0000 7fba58d29640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fba540cf7a0 0x7fba5406b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.235+0000 7fba58d29640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba5406bc10 con 0x7fba5406e6b0 2024-04-25T02:11:08.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.235+0000 7fba58d29640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fba5415f830 con 0x7fba540cf7a0 2024-04-25T02:11:08.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.235+0000 7fba58d29640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fba5415ec20 con 0x7fba5406b2f0 2024-04-25T02:11:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.235+0000 7fba52d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fba5406e6b0 0x7fba540cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36972/0 (socket says 172.21.15.79:36972) 2024-04-25T02:11:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.235+0000 7fba52d9d640 1 -- 172.21.15.79:0/2493651233 learned_addr learned my addr 172.21.15.79:0/2493651233 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.235+0000 7fba51d9b640 1 --2- 172.21.15.79:0/2493651233 >> v2:172.21.15.189:3300/0 conn(0x7fba540cf7a0 0x7fba5406b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.235+0000 7fba5159a640 1 -- 172.21.15.79:0/2493651233 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195823211 0 0) 0x7fba5406bc10 con 0x7fba5406e6b0 2024-04-25T02:11:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.235+0000 7fba5259c640 1 --2- 172.21.15.79:0/2493651233 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fba5406b2f0 0x7fba540b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.235+0000 7fba5159a640 1 -- 172.21.15.79:0/2493651233 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba3c003520 con 0x7fba5406e6b0 2024-04-25T02:11:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba5159a640 1 -- 172.21.15.79:0/2493651233 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3299570397 0 0) 0x7fba3c003520 con 0x7fba5406e6b0 2024-04-25T02:11:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba5159a640 1 -- 172.21.15.79:0/2493651233 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fba5406b2f0 msgr2=0x7fba540b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba5159a640 1 --2- 172.21.15.79:0/2493651233 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fba5406b2f0 0x7fba540b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba5159a640 1 -- 172.21.15.79:0/2493651233 >> v2:172.21.15.189:3300/0 conn(0x7fba540cf7a0 msgr2=0x7fba5406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba5159a640 1 --2- 172.21.15.79:0/2493651233 >> v2:172.21.15.189:3300/0 conn(0x7fba540cf7a0 0x7fba5406b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba5159a640 1 -- 172.21.15.79:0/2493651233 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5415ef00 con 0x7fba5406e6b0 2024-04-25T02:11:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba5159a640 1 -- 172.21.15.79:0/2493651233 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fba4c0019f0 con 0x7fba5406e6b0 2024-04-25T02:11:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba5159a640 1 -- 172.21.15.79:0/2493651233 >> v1:172.21.15.79:6789/0 conn(0x7fba5406e6b0 legacy=0x7fba540cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba5159a640 1 --2- 172.21.15.79:0/2493651233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba3c0039b0 0x7fba3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba5159a640 1 --2- 172.21.15.79:0/2493651233 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fba5406b2f0 0x7fba3c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba5159a640 1 --2- 172.21.15.79:0/2493651233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c004d40 0x7fba3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba5159a640 1 -- 172.21.15.79:0/2493651233 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fba5415f830 con 0x7fba3c004d40 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba5159a640 1 -- 172.21.15.79:0/2493651233 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fba5415ec20 con 0x7fba3c0039b0 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba5159a640 1 -- 172.21.15.79:0/2493651233 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fba3c00dbd0 con 0x7fba5406b2f0 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba52d9d640 1 --2- 172.21.15.79:0/2493651233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c004d40 0x7fba3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba5259c640 1 --2- 172.21.15.79:0/2493651233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba3c0039b0 0x7fba3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba51d9b640 1 --2- 172.21.15.79:0/2493651233 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fba5406b2f0 0x7fba3c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba52d9d640 1 -- 172.21.15.79:0/2493651233 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fba5406b2f0 msgr2=0x7fba3c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba52d9d640 1 --2- 172.21.15.79:0/2493651233 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fba5406b2f0 0x7fba3c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba52d9d640 1 -- 172.21.15.79:0/2493651233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba3c0039b0 msgr2=0x7fba3c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba52d9d640 1 --2- 172.21.15.79:0/2493651233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba3c0039b0 0x7fba3c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.236+0000 7fba52d9d640 1 -- 172.21.15.79:0/2493651233 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c003520 con 0x7fba3c004d40 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.237+0000 7fba52d9d640 1 --2- 172.21.15.79:0/2493651233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c004d40 0x7fba3c0051c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00a8f0 tx=0x7fba3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72fe1178c063b62d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.237+0000 7fba5159a640 1 -- 172.21.15.79:0/2493651233 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c00a4c0 con 0x7fba3c004d40 2024-04-25T02:11:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.237+0000 7fba5159a640 1 -- 172.21.15.79:0/2493651233 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c02f070 con 0x7fba3c004d40 2024-04-25T02:11:08.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.237+0000 7fba5159a640 1 -- 172.21.15.79:0/2493651233 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c02bd00 con 0x7fba3c004d40 2024-04-25T02:11:08.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.237+0000 7fba58d29640 1 -- 172.21.15.79:0/2493651233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c004d40 msgr2=0x7fba3c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.237+0000 7fba58d29640 1 --2- 172.21.15.79:0/2493651233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c004d40 0x7fba3c0051c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00a8f0 tx=0x7fba3c005830 comp rx=0 tx=0).stop 2024-04-25T02:11:08.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.238+0000 7fba52d9d640 1 -- 172.21.15.79:0/2493651233 reap_dead start 2024-04-25T02:11:08.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.238+0000 7fba58d29640 1 -- 172.21.15.79:0/2493651233 shutdown_connections 2024-04-25T02:11:08.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.238+0000 7fba58d29640 1 -- 172.21.15.79:0/2493651233 >> 172.21.15.79:0/2493651233 conn(0x7fba540b1cd0 msgr2=0x7fba540b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.238+0000 7fba58d29640 1 -- 172.21.15.79:0/2493651233 shutdown_connections 2024-04-25T02:11:08.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.238+0000 7fba58d29640 1 -- 172.21.15.79:0/2493651233 wait complete. 2024-04-25T02:11:08.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.239+0000 7fba58d29640 1 Processor -- start 2024-04-25T02:11:08.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.239+0000 7fba58d29640 1 -- start start 2024-04-25T02:11:08.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba58d29640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba3c004d40 0x7fba541485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba58d29640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fba5409b450 0x7fba5409b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba58d29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba5409cd30 0x7fba5409d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba58d29640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fba5406cfe0 con 0x7fba5409cd30 2024-04-25T02:11:08.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba58d29640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fba5415f4c0 con 0x7fba3c004d40 2024-04-25T02:11:08.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba58d29640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fba5406d160 con 0x7fba5409b450 2024-04-25T02:11:08.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba52d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba5409cd30 0x7fba5409d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba52d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba5409cd30 0x7fba5409d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47306/0 (socket says 172.21.15.79:47306) 2024-04-25T02:11:08.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba52d9d640 1 -- 172.21.15.79:0/185093564 learned_addr learned my addr 172.21.15.79:0/185093564 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba5259c640 1 --2- 172.21.15.79:0/185093564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba3c004d40 0x7fba541485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba51d9b640 1 --2- 172.21.15.79:0/185093564 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fba5409b450 0x7fba5409b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba52d9d640 1 -- 172.21.15.79:0/185093564 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fba5409b450 msgr2=0x7fba5409b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba52d9d640 1 --2- 172.21.15.79:0/185093564 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fba5409b450 0x7fba5409b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba52d9d640 1 -- 172.21.15.79:0/185093564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba3c004d40 msgr2=0x7fba541485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba52d9d640 1 --2- 172.21.15.79:0/185093564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba3c004d40 0x7fba541485f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba52d9d640 1 -- 172.21.15.79:0/185093564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5409bff0 con 0x7fba5409cd30 2024-04-25T02:11:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba52d9d640 1 --2- 172.21.15.79:0/185093564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba5409cd30 0x7fba5409d1b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00a9e0 tx=0x7fba540cf030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba42ffd640 1 -- 172.21.15.79:0/185093564 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c044070 con 0x7fba5409cd30 2024-04-25T02:11:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba42ffd640 1 -- 172.21.15.79:0/185093564 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c034470 con 0x7fba5409cd30 2024-04-25T02:11:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba58d29640 1 -- 172.21.15.79:0/185093564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5409c2d0 con 0x7fba5409cd30 2024-04-25T02:11:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba42ffd640 1 -- 172.21.15.79:0/185093564 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c00a4c0 con 0x7fba5409cd30 2024-04-25T02:11:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.240+0000 7fba58d29640 1 -- 172.21.15.79:0/185093564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5409db20 con 0x7fba5409cd30 2024-04-25T02:11:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.242+0000 7fba42ffd640 1 -- 172.21.15.79:0/185093564 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba4c047070 con 0x7fba5409cd30 2024-04-25T02:11:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.242+0000 7fba42ffd640 1 --2- 172.21.15.79:0/185093564 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fba3406be30 0x7fba3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.242+0000 7fba42ffd640 1 -- 172.21.15.79:0/185093564 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fba4c0aadb0 con 0x7fba5409cd30 2024-04-25T02:11:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.242+0000 7fba5259c640 1 --2- 172.21.15.79:0/185093564 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fba3406be30 0x7fba3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.243+0000 7fba5259c640 1 --2- 172.21.15.79:0/185093564 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fba3406be30 0x7fba3406e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fba5406da60 tx=0x7fba44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.243+0000 7fba5ba39740 1 Processor -- start 2024-04-25T02:11:08.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.243+0000 7fba5ba39740 1 -- start start 2024-04-25T02:11:08.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.244+0000 7fba5ba39740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79715330 0x557c79718ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.244+0000 7fba5ba39740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79718ff0 0x557c79734f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.244+0000 7fba5ba39740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79735470 0x557c797358d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.244+0000 7fba5ba39740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557c79651520 con 0x557c79735470 2024-04-25T02:11:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.244+0000 7fba5ba39740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557c795efae0 con 0x557c79715330 2024-04-25T02:11:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.244+0000 7fba5ba39740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x557c7964d4e0 con 0x557c79718ff0 2024-04-25T02:11:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.244+0000 7fba52d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79735470 0x557c797358d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.244+0000 7fba52d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79735470 0x557c797358d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47318/0 (socket says 172.21.15.79:47318) 2024-04-25T02:11:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.244+0000 7fba52d9d640 1 -- 172.21.15.79:0/248086123 learned_addr learned my addr 172.21.15.79:0/248086123 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.244+0000 7fba52d9d640 1 -- 172.21.15.79:0/248086123 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79718ff0 msgr2=0x557c79734f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.244+0000 7fba52d9d640 1 --2- 172.21.15.79:0/248086123 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79718ff0 0x557c79734f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.244+0000 7fba52d9d640 1 -- 172.21.15.79:0/248086123 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79715330 msgr2=0x557c79718ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.244+0000 7fba52d9d640 1 --2- 172.21.15.79:0/248086123 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79715330 0x557c79718ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.244+0000 7fba52d9d640 1 -- 172.21.15.79:0/248086123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c79615240 con 0x557c79735470 2024-04-25T02:11:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.245+0000 7fba52d9d640 1 --2- 172.21.15.79:0/248086123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79735470 0x557c797358d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0a9180 tx=0x7fba4c0020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c97c2466c489adc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.245+0000 7fba33fff640 1 -- 172.21.15.79:0/248086123 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0a7070 con 0x557c79735470 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.245+0000 7fba33fff640 1 -- 172.21.15.79:0/248086123 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c02f040 con 0x557c79735470 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.245+0000 7fba33fff640 1 -- 172.21.15.79:0/248086123 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c081ba0 con 0x557c79735470 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.245+0000 7fba5ba39740 1 -- 172.21.15.79:0/248086123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79735470 msgr2=0x557c797358d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.245+0000 7fba5ba39740 1 --2- 172.21.15.79:0/248086123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79735470 0x557c797358d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0a9180 tx=0x7fba4c0020c0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.245+0000 7fba5ba39740 1 -- 172.21.15.79:0/248086123 shutdown_connections 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.245+0000 7fba5ba39740 1 --2- 172.21.15.79:0/248086123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79735470 0x557c797358d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.245+0000 7fba5ba39740 1 --2- 172.21.15.79:0/248086123 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79718ff0 0x557c79734f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.245+0000 7fba5ba39740 1 --2- 172.21.15.79:0/248086123 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79715330 0x557c79718ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.245+0000 7fba5ba39740 1 -- 172.21.15.79:0/248086123 >> 172.21.15.79:0/248086123 conn(0x557c796eb310 msgr2=0x557c796ec310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.246+0000 7fba5ba39740 1 -- 172.21.15.79:0/248086123 shutdown_connections 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.246+0000 7fba5ba39740 1 -- 172.21.15.79:0/248086123 wait complete. 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.246+0000 7fba5ba39740 1 -- start start 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.246+0000 7fba5ba39740 1 Processor -- start 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5ba39740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79718ff0 0x557c797122d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5ba39740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79735470 0x557c79744880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5ba39740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79711890 0x557c79717fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5ba39740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557c795efae0 con 0x557c79718ff0 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5ba39740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557c795ed470 con 0x557c79735470 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5ba39740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x557c79651520 con 0x557c79711890 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5ba39740 10 client.0 _ll_register_callbacks cb 0x557c79611dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79718ff0 0x557c797122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79718ff0 0x557c797122d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47322/0 (socket says 172.21.15.79:47322) 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5259c640 1 -- 172.21.15.79:0/2460858038 learned_addr learned my addr 172.21.15.79:0/2460858038 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5259c640 1 -- 172.21.15.79:0/2460858038 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79711890 msgr2=0x557c79717fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5259c640 1 --2- 172.21.15.79:0/2460858038 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79711890 0x557c79717fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5259c640 1 -- 172.21.15.79:0/2460858038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79735470 msgr2=0x557c79744880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5259c640 1 --2- 172.21.15.79:0/2460858038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79735470 0x557c79744880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5259c640 1 -- 172.21.15.79:0/2460858038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c79604bf0 con 0x557c79718ff0 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba5259c640 1 --2- 172.21.15.79:0/2460858038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79718ff0 0x557c797122d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fba44016490 tx=0x7fba44009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dab4ae7fada2836 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.247+0000 7fba317fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba317fa640 1 -- 172.21.15.79:0/2460858038 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4401e050 con 0x557c79718ff0 2024-04-25T02:11:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba317fa640 1 -- 172.21.15.79:0/2460858038 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fba4400f040 con 0x557c79718ff0 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba5ba39740 1 -- 172.21.15.79:0/2460858038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba4c02f040 con 0x557c79718ff0 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba317fa640 1 -- 172.21.15.79:0/2460858038 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba4402f050 con 0x557c79718ff0 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba5ba39740 10 client.6399 fetch_fsmap learned FSMap version 25 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba5ba39740 1 -- 172.21.15.79:0/2460858038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x557c794317c0 con 0x557c79718ff0 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba317fa640 1 -- 172.21.15.79:0/2460858038 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c02f040 con 0x557c79718ff0 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba317fa640 1 -- 172.21.15.79:0/2460858038 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7fba44004020 con 0x557c79718ff0 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba5ba39740 10 client.6399 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba5ba39740 10 client.6399 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba5ba39740 20 client.6399 populate_metadata read hostname 'smithi079' 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba5ba39740 1 --2- 172.21.15.79:0/2460858038 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x557c7971b000 0x557c79752740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba5ba39740 4 client.6399 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba5ba39740 1 -- 172.21.15.79:0/2460858038 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c79664d50 con 0x557c7971b000 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba51d9b640 1 --2- 172.21.15.79:0/2460858038 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x557c7971b000 0x557c79752740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba51d9b640 1 --2- 172.21.15.79:0/2460858038 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x557c7971b000 0x557c79752740 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5265b9c65f79a1ff server_cookie=71a005f23b4e8c65 in_seq=0 out_seq=0 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.248+0000 7fba317fa640 10 client.6399 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.249+0000 7fba317fa640 1 -- 172.21.15.79:0/2460858038 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557c79664d50 con 0x557c7971b000 2024-04-25T02:11:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.249+0000 7fba317fa640 10 client.6399 handle_command_reply: tid=0 2024-04-25T02:11:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.249+0000 7fba5ba39740 1 client.6399 shutdown 2024-04-25T02:11:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.249+0000 7fba5ba39740 1 -- 172.21.15.79:0/2460858038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79718ff0 msgr2=0x557c797122d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.249+0000 7fba5ba39740 1 --2- 172.21.15.79:0/2460858038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79718ff0 0x557c797122d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fba44016490 tx=0x7fba44009190 comp rx=0 tx=0).stop 2024-04-25T02:11:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.249+0000 7fba5ba39740 1 -- 172.21.15.79:0/2460858038 shutdown_connections 2024-04-25T02:11:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.249+0000 7fba5ba39740 1 --2- 172.21.15.79:0/2460858038 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x557c7971b000 0x557c79752740 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.249+0000 7fba5ba39740 1 --2- 172.21.15.79:0/2460858038 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79711890 0x557c79717fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.249+0000 7fba317fa640 0 client.6399 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.249+0000 7fba5ba39740 1 --2- 172.21.15.79:0/2460858038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79735470 0x557c79744880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.249+0000 7fba5ba39740 1 --2- 172.21.15.79:0/2460858038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79718ff0 0x557c797122d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.249+0000 7fba5ba39740 1 -- 172.21.15.79:0/2460858038 >> 172.21.15.79:0/2460858038 conn(0x557c79715330 msgr2=0x557c796e9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.249+0000 7fba5ba39740 1 -- 172.21.15.79:0/2460858038 shutdown_connections 2024-04-25T02:11:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.249+0000 7fba5ba39740 1 -- 172.21.15.79:0/2460858038 wait complete. 2024-04-25T02:11:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.249+0000 7fba5ba39740 20 client.6399 trim_cache size 0 max 16384 2024-04-25T02:11:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.262+0000 7fba5ba39740 1 Processor -- start 2024-04-25T02:11:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.262+0000 7fba5ba39740 1 -- start start 2024-04-25T02:11:08.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba5ba39740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79715330 0x557c79711ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba5ba39740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79711890 0x557c79742f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba5ba39740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79718ff0 0x557c797434a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba5ba39740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fba541fb8e0 con 0x557c79711890 2024-04-25T02:11:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba5ba39740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fba541fac40 con 0x557c79715330 2024-04-25T02:11:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba5ba39740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fba541fb290 con 0x557c79718ff0 2024-04-25T02:11:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba51d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79711890 0x557c79742f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba51d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79711890 0x557c79742f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47338/0 (socket says 172.21.15.79:47338) 2024-04-25T02:11:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba51d9b640 1 -- 172.21.15.79:0/3033130288 learned_addr learned my addr 172.21.15.79:0/3033130288 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba5259c640 1 --2- 172.21.15.79:0/3033130288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79715330 0x557c79711ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba52d9d640 1 --2- 172.21.15.79:0/3033130288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79718ff0 0x557c797434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba51d9b640 1 -- 172.21.15.79:0/3033130288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79718ff0 msgr2=0x557c797434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba51d9b640 1 --2- 172.21.15.79:0/3033130288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79718ff0 0x557c797434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba51d9b640 1 -- 172.21.15.79:0/3033130288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79715330 msgr2=0x557c79711ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba51d9b640 1 --2- 172.21.15.79:0/3033130288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79715330 0x557c79711ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.263+0000 7fba51d9b640 1 -- 172.21.15.79:0/3033130288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c79491f50 con 0x557c79711890 2024-04-25T02:11:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.264+0000 7fba51d9b640 1 --2- 172.21.15.79:0/3033130288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79711890 0x557c79742f60 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fba541553e0 tx=0x7fba48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4762b1b023b0349 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.264+0000 7fba337fe640 1 -- 172.21.15.79:0/3033130288 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba48004030 con 0x557c79711890 2024-04-25T02:11:08.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.264+0000 7fba337fe640 1 -- 172.21.15.79:0/3033130288 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba480041d0 con 0x557c79711890 2024-04-25T02:11:08.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.264+0000 7fba337fe640 1 -- 172.21.15.79:0/3033130288 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba480043a0 con 0x557c79711890 2024-04-25T02:11:08.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.264+0000 7fba5ba39740 1 -- 172.21.15.79:0/3033130288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79711890 msgr2=0x557c79742f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.264+0000 7fba5ba39740 1 --2- 172.21.15.79:0/3033130288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79711890 0x557c79742f60 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fba541553e0 tx=0x7fba48008040 comp rx=0 tx=0).stop 2024-04-25T02:11:08.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.264+0000 7fba5ba39740 1 -- 172.21.15.79:0/3033130288 shutdown_connections 2024-04-25T02:11:08.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.264+0000 7fba5ba39740 1 --2- 172.21.15.79:0/3033130288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79718ff0 0x557c797434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.264+0000 7fba5ba39740 1 --2- 172.21.15.79:0/3033130288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79711890 0x557c79742f60 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.264+0000 7fba5ba39740 1 --2- 172.21.15.79:0/3033130288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79715330 0x557c79711ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.264+0000 7fba5ba39740 1 -- 172.21.15.79:0/3033130288 >> 172.21.15.79:0/3033130288 conn(0x557c79718c10 msgr2=0x557c796e42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.264+0000 7fba5ba39740 1 -- 172.21.15.79:0/3033130288 shutdown_connections 2024-04-25T02:11:08.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.264+0000 7fba5ba39740 1 -- 172.21.15.79:0/3033130288 wait complete. 2024-04-25T02:11:08.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.265+0000 7fba5ba39740 1 -- start start 2024-04-25T02:11:08.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.265+0000 7fba5ba39740 1 Processor -- start 2024-04-25T02:11:08.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5ba39740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79711890 0x557c79710e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5ba39740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79715330 0x557c79757da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5ba39740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79718ff0 0x557c7974d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5ba39740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557c79719de0 con 0x557c79711890 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5ba39740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557c79712910 con 0x557c79718ff0 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5ba39740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x557c7971c7c0 con 0x557c79715330 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5ba39740 10 client.0 _ll_register_callbacks cb 0x7fba44009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79711890 0x557c79710e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79711890 0x557c79710e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47340/0 (socket says 172.21.15.79:47340) 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5259c640 1 -- 172.21.15.79:0/2541338008 learned_addr learned my addr 172.21.15.79:0/2541338008 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba51d9b640 1 --2- 172.21.15.79:0/2541338008 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79715330 0x557c79757da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba52d9d640 1 --2- 172.21.15.79:0/2541338008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79718ff0 0x557c7974d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5259c640 1 -- 172.21.15.79:0/2541338008 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79715330 msgr2=0x557c79757da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5259c640 1 --2- 172.21.15.79:0/2541338008 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79715330 0x557c79757da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5259c640 1 -- 172.21.15.79:0/2541338008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79718ff0 msgr2=0x557c7974d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5259c640 1 --2- 172.21.15.79:0/2541338008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79718ff0 0x557c7974d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5259c640 1 -- 172.21.15.79:0/2541338008 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c793250b0 con 0x557c79711890 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba52d9d640 1 --2- 172.21.15.79:0/2541338008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79718ff0 0x557c7974d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba51d9b640 1 --2- 172.21.15.79:0/2541338008 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79715330 0x557c79757da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba5259c640 1 --2- 172.21.15.79:0/2541338008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79711890 0x557c79710e40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fba44016da0 tx=0x7fba44019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee179dcee8b0add server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba317fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.266+0000 7fba317fa640 1 -- 172.21.15.79:0/2541338008 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44037070 con 0x557c79711890 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba317fa640 1 -- 172.21.15.79:0/2541338008 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fba440157e0 con 0x557c79711890 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba5ba39740 1 -- 172.21.15.79:0/2541338008 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba480041d0 con 0x557c79711890 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba317fa640 1 -- 172.21.15.79:0/2541338008 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba44044050 con 0x557c79711890 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba5ba39740 10 client.6405 fetch_fsmap learned FSMap version 25 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba5ba39740 1 -- 172.21.15.79:0/2541338008 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x557c795de780 con 0x557c79711890 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba317fa640 1 -- 172.21.15.79:0/2541338008 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba480041d0 con 0x557c79711890 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba317fa640 1 -- 172.21.15.79:0/2541338008 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7fba440159e0 con 0x557c79711890 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba5ba39740 10 client.6405 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba5ba39740 10 client.6405 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba5ba39740 20 client.6405 populate_metadata read hostname 'smithi079' 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba5ba39740 1 --2- 172.21.15.79:0/2541338008 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x557c79735470 0x557c79730080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba5ba39740 4 client.6405 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba5ba39740 1 -- 172.21.15.79:0/2541338008 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x557c7965ea60 con 0x557c79735470 2024-04-25T02:11:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba51d9b640 1 --2- 172.21.15.79:0/2541338008 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x557c79735470 0x557c79730080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba317fa640 10 client.6405 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba51d9b640 1 --2- 172.21.15.79:0/2541338008 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x557c79735470 0x557c79730080 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e005a581a5629fb server_cookie=4ca3b95aef2e7a84 in_seq=0 out_seq=0 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba317fa640 1 -- 172.21.15.79:0/2541338008 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+139 (crc 0 0 0) 0x557c7965ea60 con 0x557c79735470 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba317fa640 10 client.6405 handle_command_reply: tid=0 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.267+0000 7fba5ba39740 1 client.6405 shutdown 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba5ba39740 1 -- 172.21.15.79:0/2541338008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79711890 msgr2=0x557c79710e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba5ba39740 1 --2- 172.21.15.79:0/2541338008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79711890 0x557c79710e40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fba44016da0 tx=0x7fba44019000 comp rx=0 tx=0).stop 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba5ba39740 1 -- 172.21.15.79:0/2541338008 shutdown_connections 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba5ba39740 1 --2- 172.21.15.79:0/2541338008 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x557c79735470 0x557c79730080 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba5ba39740 1 --2- 172.21.15.79:0/2541338008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c79718ff0 0x557c7974d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba317fa640 0 client.6405 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba5ba39740 1 --2- 172.21.15.79:0/2541338008 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557c79715330 0x557c79757da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba5ba39740 1 --2- 172.21.15.79:0/2541338008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c79711890 0x557c79710e40 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba5ba39740 1 -- 172.21.15.79:0/2541338008 >> 172.21.15.79:0/2541338008 conn(0x557c79718c10 msgr2=0x557c79711ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba5ba39740 1 -- 172.21.15.79:0/2541338008 shutdown_connections 2024-04-25T02:11:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba5ba39740 1 -- 172.21.15.79:0/2541338008 wait complete. 2024-04-25T02:11:08.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba5ba39740 20 client.6405 trim_cache size 0 max 16384 2024-04-25T02:11:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:08.282 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-04-25T02:11:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: "damage_type": "backtrace", 2024-04-25T02:11:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 76142594, 2024-04-25T02:11:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627777, 2024-04-25T02:11:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/dir_test/file" 2024-04-25T02:11:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:08.282 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-04-25T02:11:08.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba58d29640 1 -- 172.21.15.79:0/185093564 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fba3406be30 msgr2=0x7fba3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba58d29640 1 --2- 172.21.15.79:0/185093564 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fba3406be30 0x7fba3406e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fba5406da60 tx=0x7fba44008040 comp rx=0 tx=0).stop 2024-04-25T02:11:08.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba58d29640 1 -- 172.21.15.79:0/185093564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba5409cd30 msgr2=0x7fba5409d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba58d29640 1 --2- 172.21.15.79:0/185093564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba5409cd30 0x7fba5409d1b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00a9e0 tx=0x7fba540cf030 comp rx=0 tx=0).stop 2024-04-25T02:11:08.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba58d29640 1 -- 172.21.15.79:0/185093564 shutdown_connections 2024-04-25T02:11:08.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba58d29640 1 --2- 172.21.15.79:0/185093564 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fba3406be30 0x7fba3406e2f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba58d29640 1 --2- 172.21.15.79:0/185093564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba5409cd30 0x7fba5409d1b0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba58d29640 1 --2- 172.21.15.79:0/185093564 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fba5409b450 0x7fba5409b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba58d29640 1 --2- 172.21.15.79:0/185093564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba3c004d40 0x7fba541485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba58d29640 1 -- 172.21.15.79:0/185093564 >> 172.21.15.79:0/185093564 conn(0x7fba540b1cd0 msgr2=0x7fba54071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba58d29640 1 -- 172.21.15.79:0/185093564 shutdown_connections 2024-04-25T02:11:08.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.268+0000 7fba58d29640 1 -- 172.21.15.79:0/185093564 wait complete. 2024-04-25T02:11:08.287 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T02:11:08.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.374+0000 7f5e8609a640 1 Processor -- start 2024-04-25T02:11:08.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.374+0000 7f5e8609a640 1 -- start start 2024-04-25T02:11:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.375+0000 7f5e8609a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5e80160170 0x7f5e800ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.375+0000 7f5e8609a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e801420a0 0x7f5e8006ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.375+0000 7f5e8609a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e800cea60 con 0x7f5e8013f020 2024-04-25T02:11:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.375+0000 7f5e8609a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f5e800cf670 con 0x7f5e80160170 2024-04-25T02:11:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.375+0000 7f5e8609a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5e800ced40 con 0x7f5e801420a0 2024-04-25T02:11:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.375+0000 7f5e7f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5e8013f020 0x7f5e8015fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36978/0 (socket says 172.21.15.79:36978) 2024-04-25T02:11:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.375+0000 7f5e7f7fe640 1 -- 172.21.15.79:0/1940179066 learned_addr learned my addr 172.21.15.79:0/1940179066 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.375+0000 7f5e7effd640 1 --2- 172.21.15.79:0/1940179066 >> v2:172.21.15.189:3300/0 conn(0x7f5e80160170 0x7f5e800ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.375+0000 7f5e7ffff640 1 --2- 172.21.15.79:0/1940179066 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e801420a0 0x7f5e8006ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.375+0000 7f5e7e7fc640 1 -- 172.21.15.79:0/1940179066 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3086907149 0 0) 0x7f5e800cea60 con 0x7f5e8013f020 2024-04-25T02:11:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.376+0000 7f5e7e7fc640 1 -- 172.21.15.79:0/1940179066 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e6c003520 con 0x7f5e8013f020 2024-04-25T02:11:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.376+0000 7f5e7effd640 1 -- 172.21.15.79:0/1940179066 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e801420a0 msgr2=0x7f5e8006ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.376+0000 7f5e7effd640 1 --2- 172.21.15.79:0/1940179066 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e801420a0 0x7f5e8006ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.376+0000 7f5e7e7fc640 1 -- 172.21.15.79:0/1940179066 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1353549770 0 0) 0x7f5e6c003520 con 0x7f5e8013f020 2024-04-25T02:11:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.376+0000 7f5e7effd640 1 -- 172.21.15.79:0/1940179066 >> v1:172.21.15.79:6789/0 conn(0x7f5e8013f020 legacy=0x7f5e8015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.376+0000 7f5e7effd640 1 -- 172.21.15.79:0/1940179066 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e800cf020 con 0x7f5e80160170 2024-04-25T02:11:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.376+0000 7f5e7ffff640 1 --2- 172.21.15.79:0/1940179066 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e801420a0 0x7f5e8006ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.376+0000 7f5e7effd640 1 --2- 172.21.15.79:0/1940179066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e80160170 0x7f5e800ce3a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5e680097a0 tx=0x7f5e6802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95d57c2e8e44162d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.377+0000 7f5e7e7fc640 1 -- 172.21.15.79:0/1940179066 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e68037070 con 0x7f5e80160170 2024-04-25T02:11:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.377+0000 7f5e7e7fc640 1 -- 172.21.15.79:0/1940179066 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e6802aba0 con 0x7f5e80160170 2024-04-25T02:11:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.377+0000 7f5e7e7fc640 1 -- 172.21.15.79:0/1940179066 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e700019f0 con 0x7f5e80160170 2024-04-25T02:11:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.377+0000 7f5e8609a640 1 -- 172.21.15.79:0/1940179066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e80160170 msgr2=0x7f5e800ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.377+0000 7f5e8609a640 1 --2- 172.21.15.79:0/1940179066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e80160170 0x7f5e800ce3a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5e680097a0 tx=0x7f5e6802a110 comp rx=0 tx=0).stop 2024-04-25T02:11:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.377+0000 7f5e8609a640 1 -- 172.21.15.79:0/1940179066 shutdown_connections 2024-04-25T02:11:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.377+0000 7f5e8609a640 1 --2- 172.21.15.79:0/1940179066 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e801420a0 0x7f5e8006ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.377+0000 7f5e8609a640 1 --2- 172.21.15.79:0/1940179066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e80160170 0x7f5e800ce3a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.377+0000 7f5e8609a640 1 -- 172.21.15.79:0/1940179066 >> 172.21.15.79:0/1940179066 conn(0x7f5e800cfc80 msgr2=0x7f5e800d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.377+0000 7f5e8609a640 1 -- 172.21.15.79:0/1940179066 shutdown_connections 2024-04-25T02:11:08.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.377+0000 7f5e8609a640 1 -- 172.21.15.79:0/1940179066 wait complete. 2024-04-25T02:11:08.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.378+0000 7f5e8609a640 1 Processor -- start 2024-04-25T02:11:08.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.379+0000 7f5e8609a640 1 -- start start 2024-04-25T02:11:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.379+0000 7f5e8609a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e8013f020 0x7f5e80157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.379+0000 7f5e8609a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e801420a0 0x7f5e8015c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.379+0000 7f5e8609a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e80160170 0x7f5e8015ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.379+0000 7f5e8609a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8006cf60 con 0x7f5e801420a0 2024-04-25T02:11:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.379+0000 7f5e8609a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5e80142530 con 0x7f5e80160170 2024-04-25T02:11:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.379+0000 7f5e8609a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5e8006d0e0 con 0x7f5e8013f020 2024-04-25T02:11:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.379+0000 7f5e7effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e801420a0 0x7f5e8015c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.379+0000 7f5e7effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e801420a0 0x7f5e8015c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47350/0 (socket says 172.21.15.79:47350) 2024-04-25T02:11:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.379+0000 7f5e7effd640 1 -- 172.21.15.79:0/3120854057 learned_addr learned my addr 172.21.15.79:0/3120854057 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.380+0000 7f5e7effd640 1 -- 172.21.15.79:0/3120854057 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e8013f020 msgr2=0x7f5e80157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.380+0000 7f5e7effd640 1 --2- 172.21.15.79:0/3120854057 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e8013f020 0x7f5e80157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.380+0000 7f5e7effd640 1 -- 172.21.15.79:0/3120854057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e80160170 msgr2=0x7f5e8015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.380+0000 7f5e7ffff640 1 --2- 172.21.15.79:0/3120854057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e80160170 0x7f5e8015ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.380+0000 7f5e7effd640 1 --2- 172.21.15.79:0/3120854057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e80160170 0x7f5e8015ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.380+0000 7f5e7effd640 1 -- 172.21.15.79:0/3120854057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e801e6a90 con 0x7f5e801420a0 2024-04-25T02:11:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.380+0000 7f5e7effd640 1 --2- 172.21.15.79:0/3120854057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e801420a0 0x7f5e8015c500 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f5e68035040 tx=0x7f5e680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.380+0000 7f5e77fff640 1 -- 172.21.15.79:0/3120854057 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e68037050 con 0x7f5e801420a0 2024-04-25T02:11:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.380+0000 7f5e77fff640 1 -- 172.21.15.79:0/3120854057 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e68043070 con 0x7f5e801420a0 2024-04-25T02:11:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.380+0000 7f5e77fff640 1 -- 172.21.15.79:0/3120854057 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e68006e10 con 0x7f5e801420a0 2024-04-25T02:11:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.380+0000 7f5e8609a640 1 -- 172.21.15.79:0/3120854057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e801e6d70 con 0x7f5e801420a0 2024-04-25T02:11:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.380+0000 7f5e8609a640 1 -- 172.21.15.79:0/3120854057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e801e7330 con 0x7f5e801420a0 2024-04-25T02:11:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.381+0000 7f5e8609a640 1 -- 172.21.15.79:0/3120854057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e800690a0 con 0x7f5e801420a0 2024-04-25T02:11:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.381+0000 7f5e77fff640 1 -- 172.21.15.79:0/3120854057 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e6803ca10 con 0x7f5e801420a0 2024-04-25T02:11:08.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.382+0000 7f5e77fff640 1 --2- 172.21.15.79:0/3120854057 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e6006be30 0x7f5e6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.382+0000 7f5e77fff640 1 -- 172.21.15.79:0/3120854057 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f5e680ab8f0 con 0x7f5e801420a0 2024-04-25T02:11:08.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.382+0000 7f5e7f7fe640 1 --2- 172.21.15.79:0/3120854057 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e6006be30 0x7f5e6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.382+0000 7f5e7f7fe640 1 --2- 172.21.15.79:0/3120854057 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e6006be30 0x7f5e6006e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5e70002180 tx=0x7f5e700013a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.386+0000 7f5e77fff640 1 -- 172.21.15.79:0/3120854057 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5e6807a450 con 0x7f5e801420a0 2024-04-25T02:11:08.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.599+0000 7f5e8609a640 1 -- 172.21.15.79:0/3120854057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5e8006e5f0 con 0x7f5e801420a0 2024-04-25T02:11:08.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.600+0000 7f5e77fff640 1 -- 172.21.15.79:0/3120854057 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7f5e68079d50 con 0x7f5e801420a0 2024-04-25T02:11:08.607 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:08.608 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T02:11:08.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.602+0000 7f5e8609a640 1 -- 172.21.15.79:0/3120854057 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e6006be30 msgr2=0x7f5e6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.602+0000 7f5e8609a640 1 --2- 172.21.15.79:0/3120854057 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e6006be30 0x7f5e6006e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5e70002180 tx=0x7f5e700013a0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.602+0000 7f5e8609a640 1 -- 172.21.15.79:0/3120854057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e801420a0 msgr2=0x7f5e8015c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.602+0000 7f5e8609a640 1 --2- 172.21.15.79:0/3120854057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e801420a0 0x7f5e8015c500 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f5e68035040 tx=0x7f5e680046c0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.602+0000 7f5e8609a640 1 -- 172.21.15.79:0/3120854057 shutdown_connections 2024-04-25T02:11:08.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.602+0000 7f5e8609a640 1 --2- 172.21.15.79:0/3120854057 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e6006be30 0x7f5e6006e2f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.602+0000 7f5e8609a640 1 --2- 172.21.15.79:0/3120854057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e80160170 0x7f5e8015ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.602+0000 7f5e8609a640 1 --2- 172.21.15.79:0/3120854057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e801420a0 0x7f5e8015c500 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.602+0000 7f5e8609a640 1 --2- 172.21.15.79:0/3120854057 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e8013f020 0x7f5e80157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.602+0000 7f5e8609a640 1 -- 172.21.15.79:0/3120854057 >> 172.21.15.79:0/3120854057 conn(0x7f5e800cfc80 msgr2=0x7f5e80070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.602+0000 7f5e8609a640 1 -- 172.21.15.79:0/3120854057 shutdown_connections 2024-04-25T02:11:08.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.602+0000 7f5e8609a640 1 -- 172.21.15.79:0/3120854057 wait complete. 2024-04-25T02:11:08.620 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T02:11:08.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:11:08.620 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive,force 2024-04-25T02:11:08.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.712+0000 7f97c9f48640 1 Processor -- start 2024-04-25T02:11:08.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.712+0000 7f97c9f48640 1 -- start start 2024-04-25T02:11:08.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.713+0000 7f97c9f48640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97c415e440 0x7f97c40cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.713+0000 7f97c9f48640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97c40d1e80 con 0x7f97c40d10a0 2024-04-25T02:11:08.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.713+0000 7f97c9f48640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97c40d2160 con 0x7f97c40d2f20 2024-04-25T02:11:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.713+0000 7f97c9f48640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f97c40d2440 con 0x7f97c415e440 2024-04-25T02:11:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.713+0000 7f97c3fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f97c40d10a0 0x7f97c40b6ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36984/0 (socket says 172.21.15.79:36984) 2024-04-25T02:11:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.713+0000 7f97c3fff640 1 -- 172.21.15.79:0/3866148769 learned_addr learned my addr 172.21.15.79:0/3866148769 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.714+0000 7f97c37fe640 1 --2- 172.21.15.79:0/3866148769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97c415e440 0x7f97c40cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.714+0000 7f97c2ffd640 1 -- 172.21.15.79:0/3866148769 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3198432369 0 0) 0x7f97c40d1e80 con 0x7f97c40d10a0 2024-04-25T02:11:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.714+0000 7f97c2ffd640 1 -- 172.21.15.79:0/3866148769 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97b0003520 con 0x7f97c40d10a0 2024-04-25T02:11:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.714+0000 7f97c2ffd640 1 -- 172.21.15.79:0/3866148769 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1125971787 0 0) 0x7f97b0003520 con 0x7f97c40d10a0 2024-04-25T02:11:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.714+0000 7f97c37fe640 1 -- 172.21.15.79:0/3866148769 >> v1:172.21.15.189:6789/0 conn(0x7f97c40d2f20 legacy=0x7f97c40d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.714+0000 7f97c37fe640 1 -- 172.21.15.79:0/3866148769 >> v1:172.21.15.79:6789/0 conn(0x7f97c40d10a0 legacy=0x7f97c40b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.714+0000 7f97c37fe640 1 -- 172.21.15.79:0/3866148769 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c40d2720 con 0x7f97c415e440 2024-04-25T02:11:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.715+0000 7f97c37fe640 1 --2- 172.21.15.79:0/3866148769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97c415e440 0x7f97c40cf870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f97b40097d0 tx=0x7f97b402a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4c355b2d554776a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.715+0000 7f97c2ffd640 1 -- 172.21.15.79:0/3866148769 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4037070 con 0x7f97c415e440 2024-04-25T02:11:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.715+0000 7f97c2ffd640 1 -- 172.21.15.79:0/3866148769 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b402ab40 con 0x7f97c415e440 2024-04-25T02:11:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.715+0000 7f97c2ffd640 1 -- 172.21.15.79:0/3866148769 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc0019f0 con 0x7f97c415e440 2024-04-25T02:11:08.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.715+0000 7f97c9f48640 1 -- 172.21.15.79:0/3866148769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97c415e440 msgr2=0x7f97c40cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.715+0000 7f97c9f48640 1 --2- 172.21.15.79:0/3866148769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97c415e440 0x7f97c40cf870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f97b40097d0 tx=0x7f97b402a0b0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.715+0000 7f97c9f48640 1 -- 172.21.15.79:0/3866148769 shutdown_connections 2024-04-25T02:11:08.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.715+0000 7f97c9f48640 1 --2- 172.21.15.79:0/3866148769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97c415e440 0x7f97c40cf870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.715+0000 7f97c9f48640 1 -- 172.21.15.79:0/3866148769 >> 172.21.15.79:0/3866148769 conn(0x7f97c409d450 msgr2=0x7f97c40d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.715+0000 7f97c9f48640 1 -- 172.21.15.79:0/3866148769 shutdown_connections 2024-04-25T02:11:08.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.715+0000 7f97c9f48640 1 -- 172.21.15.79:0/3866148769 wait complete. 2024-04-25T02:11:08.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.717+0000 7f97c9f48640 1 Processor -- start 2024-04-25T02:11:08.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.717+0000 7f97c9f48640 1 -- start start 2024-04-25T02:11:08.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.717+0000 7f97c9f48640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97c40d10a0 0x7f97c40c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.717+0000 7f97c9f48640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c40d2f20 0x7f97c40b97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.717+0000 7f97c9f48640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97c415e440 0x7f97c4156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.717+0000 7f97c9f48640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f97c40cff30 con 0x7f97c40d2f20 2024-04-25T02:11:08.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.717+0000 7f97c9f48640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f97c40cfdb0 con 0x7f97c415e440 2024-04-25T02:11:08.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.717+0000 7f97c9f48640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f97c40d00b0 con 0x7f97c40d10a0 2024-04-25T02:11:08.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c40d2f20 0x7f97c40b97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c40d2f20 0x7f97c40b97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47360/0 (socket says 172.21.15.79:47360) 2024-04-25T02:11:08.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97baffd640 1 -- 172.21.15.79:0/2024041030 learned_addr learned my addr 172.21.15.79:0/2024041030 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97c3fff640 1 --2- 172.21.15.79:0/2024041030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97c415e440 0x7f97c4156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97c37fe640 1 --2- 172.21.15.79:0/2024041030 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97c40d10a0 0x7f97c40c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97baffd640 1 -- 172.21.15.79:0/2024041030 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97c40d10a0 msgr2=0x7f97c40c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97baffd640 1 --2- 172.21.15.79:0/2024041030 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97c40d10a0 0x7f97c40c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97baffd640 1 -- 172.21.15.79:0/2024041030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97c415e440 msgr2=0x7f97c4156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97baffd640 1 --2- 172.21.15.79:0/2024041030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97c415e440 0x7f97c4156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97baffd640 1 -- 172.21.15.79:0/2024041030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c40c9f30 con 0x7f97c40d2f20 2024-04-25T02:11:08.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97baffd640 1 --2- 172.21.15.79:0/2024041030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c40d2f20 0x7f97c40b97a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00c540 tx=0x7f97ac00ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97c0ff9640 1 -- 172.21.15.79:0/2024041030 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac017070 con 0x7f97c40d2f20 2024-04-25T02:11:08.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97c0ff9640 1 -- 172.21.15.79:0/2024041030 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97ac005480 con 0x7f97c40d2f20 2024-04-25T02:11:08.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97c9f48640 1 -- 172.21.15.79:0/2024041030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c40ca210 con 0x7f97c40d2f20 2024-04-25T02:11:08.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97c0ff9640 1 -- 172.21.15.79:0/2024041030 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac003830 con 0x7f97c40d2f20 2024-04-25T02:11:08.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.718+0000 7f97c9f48640 1 -- 172.21.15.79:0/2024041030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c40ca7d0 con 0x7f97c40d2f20 2024-04-25T02:11:08.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.720+0000 7f97c0ff9640 1 -- 172.21.15.79:0/2024041030 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97ac01a070 con 0x7f97c40d2f20 2024-04-25T02:11:08.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.720+0000 7f97c0ff9640 1 --2- 172.21.15.79:0/2024041030 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f97a406be30 0x7f97a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.720+0000 7f97c37fe640 1 --2- 172.21.15.79:0/2024041030 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f97a406be30 0x7f97a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.720+0000 7f97c0ff9640 1 -- 172.21.15.79:0/2024041030 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f97ac08a2f0 con 0x7f97c40d2f20 2024-04-25T02:11:08.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.721+0000 7f97c37fe640 1 --2- 172.21.15.79:0/2024041030 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f97a406be30 0x7f97a406e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f97b4034000 tx=0x7f97b402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.721+0000 7f97ccc4b740 1 Processor -- start 2024-04-25T02:11:08.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.721+0000 7f97ccc4b740 1 -- start start 2024-04-25T02:11:08.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.722+0000 7f97ccc4b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109573e9b0 0x56109573ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.722+0000 7f97ccc4b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610957207a0 0x56109571ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.722+0000 7f97ccc4b740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56109571f210 0x5610957468d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.722+0000 7f97ccc4b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56109567d120 con 0x5610957207a0 2024-04-25T02:11:08.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.722+0000 7f97ccc4b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561095682370 con 0x56109573e9b0 2024-04-25T02:11:08.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.722+0000 7f97ccc4b740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56109562aa00 con 0x56109571f210 2024-04-25T02:11:08.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.722+0000 7f97baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610957207a0 0x56109571ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.722+0000 7f97baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610957207a0 0x56109571ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47370/0 (socket says 172.21.15.79:47370) 2024-04-25T02:11:08.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.722+0000 7f97baffd640 1 -- 172.21.15.79:0/3715519263 learned_addr learned my addr 172.21.15.79:0/3715519263 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.722+0000 7f97c37fe640 1 --2- 172.21.15.79:0/3715519263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109573e9b0 0x56109573ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.722+0000 7f97c3fff640 1 --2- 172.21.15.79:0/3715519263 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56109571f210 0x5610957468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.723+0000 7f97baffd640 1 -- 172.21.15.79:0/3715519263 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56109571f210 msgr2=0x5610957468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.723+0000 7f97baffd640 1 --2- 172.21.15.79:0/3715519263 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56109571f210 0x5610957468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.723+0000 7f97baffd640 1 -- 172.21.15.79:0/3715519263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109573e9b0 msgr2=0x56109573ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.723+0000 7f97baffd640 1 --2- 172.21.15.79:0/3715519263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109573e9b0 0x56109573ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.723+0000 7f97baffd640 1 -- 172.21.15.79:0/3715519263 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109560a8d0 con 0x5610957207a0 2024-04-25T02:11:08.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.723+0000 7f97baffd640 1 --2- 172.21.15.79:0/3715519263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610957207a0 0x56109571ecd0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f97ac060b70 tx=0x7f97ac058630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b1d7fb70ef7050 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.723+0000 7f97b97fa640 1 -- 172.21.15.79:0/3715519263 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac08a070 con 0x5610957207a0 2024-04-25T02:11:08.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.723+0000 7f97b97fa640 1 -- 172.21.15.79:0/3715519263 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97ac056870 con 0x5610957207a0 2024-04-25T02:11:08.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.723+0000 7f97b97fa640 1 -- 172.21.15.79:0/3715519263 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac088be0 con 0x5610957207a0 2024-04-25T02:11:08.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.723+0000 7f97ccc4b740 1 -- 172.21.15.79:0/3715519263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610957207a0 msgr2=0x56109571ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.723+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/3715519263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610957207a0 0x56109571ecd0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f97ac060b70 tx=0x7f97ac058630 comp rx=0 tx=0).stop 2024-04-25T02:11:08.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.724+0000 7f97ccc4b740 1 -- 172.21.15.79:0/3715519263 shutdown_connections 2024-04-25T02:11:08.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.724+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/3715519263 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56109571f210 0x5610957468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.724+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/3715519263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610957207a0 0x56109571ecd0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.724+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/3715519263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109573e9b0 0x56109573ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.724+0000 7f97ccc4b740 1 -- 172.21.15.79:0/3715519263 >> 172.21.15.79:0/3715519263 conn(0x5610956e6400 msgr2=0x561095764a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.724+0000 7f97ccc4b740 1 -- 172.21.15.79:0/3715519263 shutdown_connections 2024-04-25T02:11:08.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.724+0000 7f97ccc4b740 1 -- 172.21.15.79:0/3715519263 wait complete. 2024-04-25T02:11:08.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.724+0000 7f97ccc4b740 1 -- start start 2024-04-25T02:11:08.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.724+0000 7f97ccc4b740 1 Processor -- start 2024-04-25T02:11:08.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97ccc4b740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56109571f210 0x56109574d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97ccc4b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610957207a0 0x561095775270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97ccc4b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109573e9b0 0x561095775cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97ccc4b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56109563dfa0 con 0x5610957207a0 2024-04-25T02:11:08.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97ccc4b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56109567e330 con 0x56109573e9b0 2024-04-25T02:11:08.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97ccc4b740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56109574aa30 con 0x56109571f210 2024-04-25T02:11:08.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97ccc4b740 10 client.0 _ll_register_callbacks cb 0x56109563d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:08.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610957207a0 0x561095775270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610957207a0 0x561095775270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47374/0 (socket says 172.21.15.79:47374) 2024-04-25T02:11:08.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97baffd640 1 -- 172.21.15.79:0/659997899 learned_addr learned my addr 172.21.15.79:0/659997899 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97c37fe640 1 --2- 172.21.15.79:0/659997899 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56109571f210 0x56109574d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97c3fff640 1 --2- 172.21.15.79:0/659997899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109573e9b0 0x561095775cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97baffd640 1 -- 172.21.15.79:0/659997899 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56109571f210 msgr2=0x56109574d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97baffd640 1 --2- 172.21.15.79:0/659997899 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56109571f210 0x56109574d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97baffd640 1 -- 172.21.15.79:0/659997899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109573e9b0 msgr2=0x561095775cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97baffd640 1 --2- 172.21.15.79:0/659997899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109573e9b0 0x561095775cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97baffd640 1 -- 172.21.15.79:0/659997899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561095462940 con 0x5610957207a0 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97c3fff640 1 --2- 172.21.15.79:0/659997899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109573e9b0 0x561095775cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97baffd640 1 --2- 172.21.15.79:0/659997899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610957207a0 0x561095775270 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f97ac007fd0 tx=0x7f97ac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864a4d72d71e4fe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.725+0000 7f97a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97a27fc640 1 -- 172.21.15.79:0/659997899 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac08a130 con 0x5610957207a0 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97a27fc640 1 -- 172.21.15.79:0/659997899 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f97ac060c10 con 0x5610957207a0 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97ccc4b740 1 -- 172.21.15.79:0/659997899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97ac056870 con 0x5610957207a0 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97a27fc640 1 -- 172.21.15.79:0/659997899 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f97ac060e10 con 0x5610957207a0 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97ccc4b740 10 client.6423 fetch_fsmap learned FSMap version 25 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97ccc4b740 1 -- 172.21.15.79:0/659997899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x5610954c30d0 con 0x5610957207a0 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97a27fc640 1 -- 172.21.15.79:0/659997899 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97ac056870 con 0x5610957207a0 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97a27fc640 1 -- 172.21.15.79:0/659997899 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f97ac0579c0 con 0x5610957207a0 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97ccc4b740 10 client.6423 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97ccc4b740 10 client.6423 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97ccc4b740 20 client.6423 populate_metadata read hostname 'smithi079' 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/659997899 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x56109573bfc0 0x56109573ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97ccc4b740 4 client.6423 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97ccc4b740 1 -- 172.21.15.79:0/659997899 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56109568f8b0 con 0x56109573bfc0 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97c37fe640 1 --2- 172.21.15.79:0/659997899 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x56109573bfc0 0x56109573ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97c37fe640 1 --2- 172.21.15.79:0/659997899 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x56109573bfc0 0x56109573ed90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59041cc355e9bceb server_cookie=12b6606b3c0f366c in_seq=0 out_seq=0 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.726+0000 7f97a27fc640 10 client.6423 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.727+0000 7f97a27fc640 1 -- 172.21.15.79:0/659997899 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56109568f8b0 con 0x56109573bfc0 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.727+0000 7f97a27fc640 10 client.6423 handle_command_reply: tid=0 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.727+0000 7f97ccc4b740 1 client.6423 shutdown 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.727+0000 7f97ccc4b740 1 -- 172.21.15.79:0/659997899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610957207a0 msgr2=0x561095775270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.727+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/659997899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610957207a0 0x561095775270 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f97ac007fd0 tx=0x7f97ac000ed0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.727+0000 7f97ccc4b740 1 -- 172.21.15.79:0/659997899 shutdown_connections 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.727+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/659997899 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x56109573bfc0 0x56109573ed90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.727+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/659997899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109573e9b0 0x561095775cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.727+0000 7f97a27fc640 0 client.6423 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.727+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/659997899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610957207a0 0x561095775270 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.727+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/659997899 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56109571f210 0x56109574d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.727+0000 7f97ccc4b740 1 -- 172.21.15.79:0/659997899 >> 172.21.15.79:0/659997899 conn(0x5610956e6400 msgr2=0x56109573e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.727+0000 7f97ccc4b740 1 -- 172.21.15.79:0/659997899 shutdown_connections 2024-04-25T02:11:08.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.727+0000 7f97ccc4b740 1 -- 172.21.15.79:0/659997899 wait complete. 2024-04-25T02:11:08.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.727+0000 7f97ccc4b740 20 client.6423 trim_cache size 0 max 16384 2024-04-25T02:11:08.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.745+0000 7f97ccc4b740 1 Processor -- start 2024-04-25T02:11:08.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.745+0000 7f97ccc4b740 1 -- start start 2024-04-25T02:11:08.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.745+0000 7f97ccc4b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56109571f210 0x56109574d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.745+0000 7f97ccc4b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610957207a0 0x561095775110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.745+0000 7f97ccc4b740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56109573e9b0 0x561095776880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.745+0000 7f97ccc4b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f97c42008e0 con 0x56109571f210 2024-04-25T02:11:08.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.745+0000 7f97ccc4b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41ff940 con 0x5610957207a0 2024-04-25T02:11:08.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.745+0000 7f97ccc4b740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f97c41feca0 con 0x56109573e9b0 2024-04-25T02:11:08.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.746+0000 7f97c37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56109571f210 0x56109574d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.746+0000 7f97c37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56109571f210 0x56109574d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47376/0 (socket says 172.21.15.79:47376) 2024-04-25T02:11:08.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.746+0000 7f97c37fe640 1 -- 172.21.15.79:0/642249679 learned_addr learned my addr 172.21.15.79:0/642249679 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.746+0000 7f97c37fe640 1 -- 172.21.15.79:0/642249679 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56109573e9b0 msgr2=0x561095776880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.746+0000 7f97c37fe640 1 --2- 172.21.15.79:0/642249679 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56109573e9b0 0x561095776880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.746+0000 7f97c37fe640 1 -- 172.21.15.79:0/642249679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610957207a0 msgr2=0x561095775110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.746+0000 7f97c37fe640 1 --2- 172.21.15.79:0/642249679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610957207a0 0x561095775110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.746+0000 7f97c37fe640 1 -- 172.21.15.79:0/642249679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561095776020 con 0x56109571f210 2024-04-25T02:11:08.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.746+0000 7f97c37fe640 1 --2- 172.21.15.79:0/642249679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56109571f210 0x56109574d0a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009720 tx=0x7f97b402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d553ed999d7542 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.746+0000 7f97b8ff9640 1 -- 172.21.15.79:0/642249679 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4037040 con 0x56109571f210 2024-04-25T02:11:08.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.746+0000 7f97b8ff9640 1 -- 172.21.15.79:0/642249679 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b4052dc0 con 0x56109571f210 2024-04-25T02:11:08.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.746+0000 7f97b8ff9640 1 -- 172.21.15.79:0/642249679 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b40524c0 con 0x56109571f210 2024-04-25T02:11:08.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.747+0000 7f97ccc4b740 1 -- 172.21.15.79:0/642249679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56109571f210 msgr2=0x56109574d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.747+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/642249679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56109571f210 0x56109574d0a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009720 tx=0x7f97b402c000 comp rx=0 tx=0).stop 2024-04-25T02:11:08.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.747+0000 7f97ccc4b740 1 -- 172.21.15.79:0/642249679 shutdown_connections 2024-04-25T02:11:08.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.747+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/642249679 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56109573e9b0 0x561095776880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.747+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/642249679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610957207a0 0x561095775110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.747+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/642249679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56109571f210 0x56109574d0a0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.747+0000 7f97ccc4b740 1 -- 172.21.15.79:0/642249679 >> 172.21.15.79:0/642249679 conn(0x5610956e6400 msgr2=0x56109573e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.747+0000 7f97ccc4b740 1 -- 172.21.15.79:0/642249679 shutdown_connections 2024-04-25T02:11:08.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.747+0000 7f97ccc4b740 1 -- 172.21.15.79:0/642249679 wait complete. 2024-04-25T02:11:08.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.747+0000 7f97ccc4b740 1 -- start start 2024-04-25T02:11:08.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.747+0000 7f97ccc4b740 1 Processor -- start 2024-04-25T02:11:08.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97ccc4b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109571f210 0x561095773210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97ccc4b740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5610957207a0 0x5610957767e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97ccc4b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56109573e9b0 0x561095776d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97ccc4b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56109571f090 con 0x56109573e9b0 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97ccc4b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41ff2f0 con 0x56109571f210 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97ccc4b740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56109574c670 con 0x5610957207a0 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97ccc4b740 10 client.0 _ll_register_callbacks cb 0x7f97ac056a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97c3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56109573e9b0 0x561095776d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97c3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56109573e9b0 0x561095776d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47378/0 (socket says 172.21.15.79:47378) 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97c3fff640 1 -- 172.21.15.79:0/2355402447 learned_addr learned my addr 172.21.15.79:0/2355402447 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97c37fe640 1 --2- 172.21.15.79:0/2355402447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109571f210 0x561095773210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97baffd640 1 --2- 172.21.15.79:0/2355402447 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5610957207a0 0x5610957767e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97c3fff640 1 -- 172.21.15.79:0/2355402447 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5610957207a0 msgr2=0x5610957767e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97c3fff640 1 --2- 172.21.15.79:0/2355402447 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5610957207a0 0x5610957767e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97c3fff640 1 -- 172.21.15.79:0/2355402447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109571f210 msgr2=0x561095773210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97c3fff640 1 --2- 172.21.15.79:0/2355402447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109571f210 0x561095773210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.748+0000 7f97c3fff640 1 -- 172.21.15.79:0/2355402447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561095356230 con 0x56109573e9b0 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97c3fff640 1 --2- 172.21.15.79:0/2355402447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56109573e9b0 0x561095776d20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f97bc004f60 tx=0x7f97bc004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a30b530bece38bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:11:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97a27fc640 1 -- 172.21.15.79:0/2355402447 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc015680 con 0x56109573e9b0 2024-04-25T02:11:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97a27fc640 1 -- 172.21.15.79:0/2355402447 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f97bc015820 con 0x56109573e9b0 2024-04-25T02:11:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97ccc4b740 1 -- 172.21.15.79:0/2355402447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97b4052dc0 con 0x56109573e9b0 2024-04-25T02:11:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97a27fc640 1 -- 172.21.15.79:0/2355402447 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f97bc015a20 con 0x56109573e9b0 2024-04-25T02:11:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97ccc4b740 10 client.6429 fetch_fsmap learned FSMap version 25 2024-04-25T02:11:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97ccc4b740 1 -- 172.21.15.79:0/2355402447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x5610957df510 con 0x56109573e9b0 2024-04-25T02:11:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97a27fc640 1 -- 172.21.15.79:0/2355402447 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b4052dc0 con 0x56109573e9b0 2024-04-25T02:11:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97a27fc640 1 -- 172.21.15.79:0/2355402447 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f97bc015bc0 con 0x56109573e9b0 2024-04-25T02:11:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97ccc4b740 10 client.6429 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T02:11:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97ccc4b740 10 client.6429 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T02:11:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97ccc4b740 20 client.6429 populate_metadata read hostname 'smithi079' 2024-04-25T02:11:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/2355402447 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x561095773750 0x56109571dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97ccc4b740 4 client.6429 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}] 2024-04-25T02:11:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97ccc4b740 1 -- 172.21.15.79:0/2355402447 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}) -- 0x561095740f00 con 0x561095773750 2024-04-25T02:11:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97c37fe640 1 --2- 172.21.15.79:0/2355402447 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x561095773750 0x56109571dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97a27fc640 10 client.6429 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.749+0000 7f97c37fe640 1 --2- 172.21.15.79:0/2355402447 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x561095773750 0x56109571dba0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=324c2c3104a2900e server_cookie=20b7edde93e442ad in_seq=0 out_seq=0 2024-04-25T02:11:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.750+0000 7f97a27fc640 1 -- 172.21.15.79:0/2355402447 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561095740f00 con 0x561095773750 2024-04-25T02:11:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.750+0000 7f97a27fc640 10 client.6429 handle_command_reply: tid=0 2024-04-25T02:11:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.750+0000 7f97ccc4b740 1 client.6429 shutdown 2024-04-25T02:11:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.750+0000 7f97ccc4b740 1 -- 172.21.15.79:0/2355402447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56109573e9b0 msgr2=0x561095776d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.750+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/2355402447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56109573e9b0 0x561095776d20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f97bc004f60 tx=0x7f97bc004f90 comp rx=0 tx=0).stop 2024-04-25T02:11:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.750+0000 7f97ccc4b740 1 -- 172.21.15.79:0/2355402447 shutdown_connections 2024-04-25T02:11:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.750+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/2355402447 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x561095773750 0x56109571dba0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.750+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/2355402447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56109573e9b0 0x561095776d20 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.750+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/2355402447 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5610957207a0 0x5610957767e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.750+0000 7f97ccc4b740 1 --2- 172.21.15.79:0/2355402447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56109571f210 0x561095773210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.750+0000 7f97ccc4b740 1 -- 172.21.15.79:0/2355402447 >> 172.21.15.79:0/2355402447 conn(0x5610956e6400 msgr2=0x56109573b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.750+0000 7f97a27fc640 0 client.6429 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.750+0000 7f97ccc4b740 1 -- 172.21.15.79:0/2355402447 shutdown_connections 2024-04-25T02:11:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.750+0000 7f97ccc4b740 1 -- 172.21.15.79:0/2355402447 wait complete. 2024-04-25T02:11:08.764 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-04-25T02:11:08.750+0000 7fb98e84b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={6297=0-4194304@1} caps={6297=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6297 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55f5250ea680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:08.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.750+0000 7f97ccc4b740 20 client.6429 trim_cache size 0 max 16384 2024-04-25T02:11:08.764 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:11:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-04-25T02:11:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "18d73fd4-a476-4cf9-80e1-8efdfc00c6ca", 2024-04-25T02:11:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-04-25T02:11:08.765 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:11:08.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.751+0000 7f97c9f48640 1 -- 172.21.15.79:0/2024041030 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f97a406be30 msgr2=0x7f97a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.751+0000 7f97c9f48640 1 --2- 172.21.15.79:0/2024041030 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f97a406be30 0x7f97a406e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f97b4034000 tx=0x7f97b402e000 comp rx=0 tx=0).stop 2024-04-25T02:11:08.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.751+0000 7f97c9f48640 1 -- 172.21.15.79:0/2024041030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c40d2f20 msgr2=0x7f97c40b97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.751+0000 7f97c9f48640 1 --2- 172.21.15.79:0/2024041030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c40d2f20 0x7f97c40b97a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00c540 tx=0x7f97ac00ca00 comp rx=0 tx=0).stop 2024-04-25T02:11:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.751+0000 7f97c9f48640 1 -- 172.21.15.79:0/2024041030 shutdown_connections 2024-04-25T02:11:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.751+0000 7f97c9f48640 1 --2- 172.21.15.79:0/2024041030 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f97a406be30 0x7f97a406e2f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.751+0000 7f97c9f48640 1 --2- 172.21.15.79:0/2024041030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97c415e440 0x7f97c4156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.751+0000 7f97c9f48640 1 --2- 172.21.15.79:0/2024041030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c40d2f20 0x7f97c40b97a0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.751+0000 7f97c9f48640 1 --2- 172.21.15.79:0/2024041030 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97c40d10a0 0x7f97c40c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.751+0000 7f97c9f48640 1 -- 172.21.15.79:0/2024041030 >> 172.21.15.79:0/2024041030 conn(0x7f97c409d450 msgr2=0x7f97c415f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.751+0000 7f97c9f48640 1 -- 172.21.15.79:0/2024041030 shutdown_connections 2024-04-25T02:11:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.751+0000 7f97c9f48640 1 -- 172.21.15.79:0/2024041030 wait complete. 2024-04-25T02:11:08.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:11:08.770 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T02:11:08.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.861+0000 7f9c5da38640 1 Processor -- start 2024-04-25T02:11:08.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.861+0000 7f9c5da38640 1 -- start start 2024-04-25T02:11:08.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.862+0000 7f9c5da38640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9c580d0c80 0x7f9c580cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.862+0000 7f9c5da38640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c580b3100 0x7f9c5815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.862+0000 7f9c5da38640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c580cf7d0 con 0x7f9c580d1060 2024-04-25T02:11:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.862+0000 7f9c5da38640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9c580cfab0 con 0x7f9c580d0c80 2024-04-25T02:11:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.862+0000 7f9c5da38640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9c580cfd90 con 0x7f9c580b3100 2024-04-25T02:11:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.862+0000 7f9c56ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9c580d0c80 0x7f9c580cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.862+0000 7f9c56ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9c580d0c80 0x7f9c580cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47392/0 (socket says 172.21.15.79:47392) 2024-04-25T02:11:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.862+0000 7f9c56ffd640 1 -- 172.21.15.79:0/1193394517 learned_addr learned my addr 172.21.15.79:0/1193394517 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.862+0000 7f9c4ffff640 1 --2- 172.21.15.79:0/1193394517 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c580b3100 0x7f9c5815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.862+0000 7f9c56ffd640 1 -- 172.21.15.79:0/1193394517 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c580b3100 msgr2=0x7f9c5815e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.862+0000 7f9c56ffd640 1 --2- 172.21.15.79:0/1193394517 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c580b3100 0x7f9c5815e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.862+0000 7f9c56ffd640 1 -- 172.21.15.79:0/1193394517 >> v1:172.21.15.189:6789/0 conn(0x7f9c580d1060 legacy=0x7f9c580d1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.862+0000 7f9c56ffd640 1 -- 172.21.15.79:0/1193394517 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c580d0070 con 0x7f9c580d0c80 2024-04-25T02:11:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.862+0000 7f9c4ffff640 1 --2- 172.21.15.79:0/1193394517 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c580b3100 0x7f9c5815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.863+0000 7f9c56ffd640 1 --2- 172.21.15.79:0/1193394517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c580d0c80 0x7f9c580cee80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009870 tx=0x7f9c4802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d2db999f54b896 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.863+0000 7f9c567fc640 1 -- 172.21.15.79:0/1193394517 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48037070 con 0x7f9c580d0c80 2024-04-25T02:11:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.863+0000 7f9c567fc640 1 -- 172.21.15.79:0/1193394517 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c48032440 con 0x7f9c580d0c80 2024-04-25T02:11:08.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.863+0000 7f9c567fc640 1 -- 172.21.15.79:0/1193394517 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48032810 con 0x7f9c580d0c80 2024-04-25T02:11:08.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.863+0000 7f9c5da38640 1 -- 172.21.15.79:0/1193394517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c580d0c80 msgr2=0x7f9c580cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.863+0000 7f9c5da38640 1 --2- 172.21.15.79:0/1193394517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c580d0c80 0x7f9c580cee80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009870 tx=0x7f9c4802a210 comp rx=0 tx=0).stop 2024-04-25T02:11:08.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.863+0000 7f9c5da38640 1 -- 172.21.15.79:0/1193394517 shutdown_connections 2024-04-25T02:11:08.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.863+0000 7f9c5da38640 1 --2- 172.21.15.79:0/1193394517 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c580b3100 0x7f9c5815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.863+0000 7f9c5da38640 1 --2- 172.21.15.79:0/1193394517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c580d0c80 0x7f9c580cee80 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.863+0000 7f9c5da38640 1 -- 172.21.15.79:0/1193394517 >> 172.21.15.79:0/1193394517 conn(0x7f9c5809d3c0 msgr2=0x7f9c580d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.863+0000 7f9c5da38640 1 -- 172.21.15.79:0/1193394517 shutdown_connections 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.863+0000 7f9c5da38640 1 -- 172.21.15.79:0/1193394517 wait complete. 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.865+0000 7f9c5da38640 1 Processor -- start 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.865+0000 7f9c5da38640 1 -- start start 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.865+0000 7f9c5da38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c580b3100 0x7f9c581e55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.865+0000 7f9c5da38640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c580d0c80 0x7f9c58144040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.865+0000 7f9c5da38640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c580d1060 0x7f9c580cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.865+0000 7f9c5da38640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9c580b2270 con 0x7f9c580b3100 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.865+0000 7f9c5da38640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c580b20f0 con 0x7f9c580d1060 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.865+0000 7f9c5da38640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9c580b23f0 con 0x7f9c580d0c80 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.865+0000 7f9c56ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c580b3100 0x7f9c581e55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.865+0000 7f9c56ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c580b3100 0x7f9c581e55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47400/0 (socket says 172.21.15.79:47400) 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.865+0000 7f9c56ffd640 1 -- 172.21.15.79:0/406929308 learned_addr learned my addr 172.21.15.79:0/406929308 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.866+0000 7f9c56ffd640 1 -- 172.21.15.79:0/406929308 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c580d0c80 msgr2=0x7f9c58144040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.866+0000 7f9c56ffd640 1 --2- 172.21.15.79:0/406929308 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c580d0c80 0x7f9c58144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.866+0000 7f9c56ffd640 1 -- 172.21.15.79:0/406929308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c580d1060 msgr2=0x7f9c580cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.866+0000 7f9c56ffd640 1 --2- 172.21.15.79:0/406929308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c580d1060 0x7f9c580cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.866+0000 7f9c56ffd640 1 -- 172.21.15.79:0/406929308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c58144580 con 0x7f9c580b3100 2024-04-25T02:11:08.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.866+0000 7f9c56ffd640 1 --2- 172.21.15.79:0/406929308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c580b3100 0x7f9c581e55a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9c48000c00 tx=0x7f9c480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.866+0000 7f9c54ff9640 1 -- 172.21.15.79:0/406929308 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48037040 con 0x7f9c580b3100 2024-04-25T02:11:08.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.866+0000 7f9c54ff9640 1 -- 172.21.15.79:0/406929308 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c48042070 con 0x7f9c580b3100 2024-04-25T02:11:08.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.866+0000 7f9c5da38640 1 -- 172.21.15.79:0/406929308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c581e7270 con 0x7f9c580b3100 2024-04-25T02:11:08.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.866+0000 7f9c54ff9640 1 -- 172.21.15.79:0/406929308 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48030bd0 con 0x7f9c580b3100 2024-04-25T02:11:08.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.866+0000 7f9c5da38640 1 -- 172.21.15.79:0/406929308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c581e7830 con 0x7f9c580b3100 2024-04-25T02:11:08.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.867+0000 7f9c54ff9640 1 -- 172.21.15.79:0/406929308 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c48047460 con 0x7f9c580b3100 2024-04-25T02:11:08.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.868+0000 7f9c54ff9640 1 --2- 172.21.15.79:0/406929308 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9c3806be30 0x7f9c3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.868+0000 7f9c54ff9640 1 -- 172.21.15.79:0/406929308 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f9c480abaa0 con 0x7f9c580b3100 2024-04-25T02:11:08.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.868+0000 7f9c4ffff640 1 --2- 172.21.15.79:0/406929308 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9c3806be30 0x7f9c3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.868+0000 7f9c4ffff640 1 --2- 172.21.15.79:0/406929308 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9c3806be30 0x7f9c3806e2f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9c40006fd0 tx=0x7f9c40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.869+0000 7f9c60824740 1 Processor -- start 2024-04-25T02:11:08.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.869+0000 7f9c60824740 1 -- start start 2024-04-25T02:11:08.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c60824740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6a7d60 0x56519f6a8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c60824740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6c5600 0x56519f6c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c60824740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f67da40 0x56519f6c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c60824740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56519f5e16b0 con 0x56519f6a7d60 2024-04-25T02:11:08.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c60824740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56519f589880 con 0x56519f6c5600 2024-04-25T02:11:08.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c60824740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56519f5dd670 con 0x56519f67da40 2024-04-25T02:11:08.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c56ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6a7d60 0x56519f6a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c56ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6a7d60 0x56519f6a8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47412/0 (socket says 172.21.15.79:47412) 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c56ffd640 1 -- 172.21.15.79:0/2313369704 learned_addr learned my addr 172.21.15.79:0/2313369704 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c4ffff640 1 --2- 172.21.15.79:0/2313369704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6c5600 0x56519f6c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c577fe640 1 --2- 172.21.15.79:0/2313369704 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f67da40 0x56519f6c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c56ffd640 1 -- 172.21.15.79:0/2313369704 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f67da40 msgr2=0x56519f6c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c56ffd640 1 --2- 172.21.15.79:0/2313369704 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f67da40 0x56519f6c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c56ffd640 1 -- 172.21.15.79:0/2313369704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6c5600 msgr2=0x56519f6c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c56ffd640 1 --2- 172.21.15.79:0/2313369704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6c5600 0x56519f6c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c56ffd640 1 -- 172.21.15.79:0/2313369704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519f3bf7d0 con 0x56519f6a7d60 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c56ffd640 1 --2- 172.21.15.79:0/2313369704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6a7d60 0x56519f6a8140 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9c48082400 tx=0x7f9c48079770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626de3812f30737f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c4d7fa640 1 -- 172.21.15.79:0/2313369704 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48079d50 con 0x56519f6a7d60 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c4d7fa640 1 -- 172.21.15.79:0/2313369704 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4807e100 con 0x56519f6a7d60 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.870+0000 7f9c4d7fa640 1 -- 172.21.15.79:0/2313369704 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48082930 con 0x56519f6a7d60 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.871+0000 7f9c60824740 1 -- 172.21.15.79:0/2313369704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6a7d60 msgr2=0x56519f6a8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.871+0000 7f9c60824740 1 --2- 172.21.15.79:0/2313369704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6a7d60 0x56519f6a8140 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9c48082400 tx=0x7f9c48079770 comp rx=0 tx=0).stop 2024-04-25T02:11:08.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.871+0000 7f9c60824740 1 -- 172.21.15.79:0/2313369704 shutdown_connections 2024-04-25T02:11:08.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.871+0000 7f9c60824740 1 --2- 172.21.15.79:0/2313369704 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f67da40 0x56519f6c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.871+0000 7f9c60824740 1 --2- 172.21.15.79:0/2313369704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6c5600 0x56519f6c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.871+0000 7f9c60824740 1 --2- 172.21.15.79:0/2313369704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6a7d60 0x56519f6a8140 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.871+0000 7f9c60824740 1 -- 172.21.15.79:0/2313369704 >> 172.21.15.79:0/2313369704 conn(0x56519f67a600 msgr2=0x56519f6c2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.871+0000 7f9c60824740 1 -- 172.21.15.79:0/2313369704 shutdown_connections 2024-04-25T02:11:08.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.871+0000 7f9c60824740 1 -- 172.21.15.79:0/2313369704 wait complete. 2024-04-25T02:11:08.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.871+0000 7f9c60824740 1 -- start start 2024-04-25T02:11:08.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.872+0000 7f9c60824740 1 Processor -- start 2024-04-25T02:11:08.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.872+0000 7f9c60824740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6a7d60 0x56519f6aa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.872+0000 7f9c60824740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f6c5600 0x56519f6a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.872+0000 7f9c60824740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c9870 0x56519f6c6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.872+0000 7f9c60824740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56519f5e16b0 con 0x56519f6c9870 2024-04-25T02:11:08.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.872+0000 7f9c60824740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56519f59cf50 con 0x56519f6a7d60 2024-04-25T02:11:08.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.872+0000 7f9c60824740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56519f67e7e0 con 0x56519f6c5600 2024-04-25T02:11:08.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.872+0000 7f9c60824740 10 client.0 _ll_register_callbacks cb 0x56519f5d8000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:08.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.872+0000 7f9c577fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c9870 0x56519f6c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.872+0000 7f9c577fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c9870 0x56519f6c6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47422/0 (socket says 172.21.15.79:47422) 2024-04-25T02:11:08.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.872+0000 7f9c577fe640 1 -- 172.21.15.79:0/2128361229 learned_addr learned my addr 172.21.15.79:0/2128361229 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c56ffd640 1 --2- 172.21.15.79:0/2128361229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6a7d60 0x56519f6aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c4ffff640 1 --2- 172.21.15.79:0/2128361229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f6c5600 0x56519f6a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c577fe640 1 -- 172.21.15.79:0/2128361229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f6c5600 msgr2=0x56519f6a37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c577fe640 1 --2- 172.21.15.79:0/2128361229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f6c5600 0x56519f6a37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c577fe640 1 -- 172.21.15.79:0/2128361229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6a7d60 msgr2=0x56519f6aa840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c577fe640 1 --2- 172.21.15.79:0/2128361229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6a7d60 0x56519f6aa840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c577fe640 1 -- 172.21.15.79:0/2128361229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56519f2f53f0 con 0x56519f6c9870 2024-04-25T02:11:08.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c56ffd640 1 --2- 172.21.15.79:0/2128361229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6a7d60 0x56519f6aa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:08.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c577fe640 1 --2- 172.21.15.79:0/2128361229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c9870 0x56519f6c6400 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000ca50 tx=0x7f9c5000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b7ba1abf58ab52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c367fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:11:08.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c367fc640 1 -- 172.21.15.79:0/2128361229 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5001a060 con 0x56519f6c9870 2024-04-25T02:11:08.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c367fc640 1 -- 172.21.15.79:0/2128361229 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f9c50007b20 con 0x56519f6c9870 2024-04-25T02:11:08.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c60824740 1 -- 172.21.15.79:0/2128361229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c4807e100 con 0x56519f6c9870 2024-04-25T02:11:08.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c367fc640 1 -- 172.21.15.79:0/2128361229 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c50020050 con 0x56519f6c9870 2024-04-25T02:11:08.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c60824740 10 client.6441 fetch_fsmap learned FSMap version 25 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c60824740 1 -- 172.21.15.79:0/2128361229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x56519f2b50f0 con 0x56519f6c9870 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c367fc640 1 -- 172.21.15.79:0/2128361229 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4807e100 con 0x56519f6c9870 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c367fc640 1 -- 172.21.15.79:0/2128361229 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f9c50023020 con 0x56519f6c9870 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c60824740 10 client.6441 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c60824740 10 client.6441 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c60824740 20 client.6441 populate_metadata read hostname 'smithi079' 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c60824740 1 --2- 172.21.15.79:0/2128361229 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x56519f6b9d20 0x56519f6ba170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c60824740 4 client.6441 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.873+0000 7f9c60824740 1 -- 172.21.15.79:0/2128361229 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56519f5eebf0 con 0x56519f6b9d20 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.874+0000 7f9c56ffd640 1 --2- 172.21.15.79:0/2128361229 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x56519f6b9d20 0x56519f6ba170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.874+0000 7f9c367fc640 10 client.6441 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.874+0000 7f9c56ffd640 1 --2- 172.21.15.79:0/2128361229 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x56519f6b9d20 0x56519f6ba170 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1625d203c168e52 server_cookie=433831fdafd47753 in_seq=0 out_seq=0 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.874+0000 7f9c367fc640 1 -- 172.21.15.79:0/2128361229 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56519f5eebf0 con 0x56519f6b9d20 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.874+0000 7f9c367fc640 10 client.6441 handle_command_reply: tid=0 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.874+0000 7f9c60824740 1 client.6441 shutdown 2024-04-25T02:11:08.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.874+0000 7f9c60824740 1 -- 172.21.15.79:0/2128361229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c9870 msgr2=0x56519f6c6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.874+0000 7f9c60824740 1 --2- 172.21.15.79:0/2128361229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c9870 0x56519f6c6400 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000ca50 tx=0x7f9c5000cf10 comp rx=0 tx=0).stop 2024-04-25T02:11:08.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.875+0000 7f9c60824740 1 -- 172.21.15.79:0/2128361229 shutdown_connections 2024-04-25T02:11:08.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.875+0000 7f9c60824740 1 --2- 172.21.15.79:0/2128361229 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x56519f6b9d20 0x56519f6ba170 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.875+0000 7f9c60824740 1 --2- 172.21.15.79:0/2128361229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c9870 0x56519f6c6400 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.875+0000 7f9c367fc640 0 client.6441 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:08.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.875+0000 7f9c60824740 1 --2- 172.21.15.79:0/2128361229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f6c5600 0x56519f6a37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.875+0000 7f9c60824740 1 --2- 172.21.15.79:0/2128361229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6a7d60 0x56519f6aa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.875+0000 7f9c60824740 1 -- 172.21.15.79:0/2128361229 >> 172.21.15.79:0/2128361229 conn(0x56519f67da40 msgr2=0x56519f6c2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.875+0000 7f9c60824740 1 -- 172.21.15.79:0/2128361229 shutdown_connections 2024-04-25T02:11:08.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.875+0000 7f9c60824740 1 -- 172.21.15.79:0/2128361229 wait complete. 2024-04-25T02:11:08.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.875+0000 7f9c60824740 20 client.6441 trim_cache size 0 max 16384 2024-04-25T02:11:08.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.892+0000 7f9c60824740 1 Processor -- start 2024-04-25T02:11:08.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.892+0000 7f9c60824740 1 -- start start 2024-04-25T02:11:08.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.893+0000 7f9c60824740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6a7d60 0x56519f6a8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.893+0000 7f9c60824740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f6c5600 0x56519f67de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.893+0000 7f9c60824740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c9870 0x56519f67e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.893+0000 7f9c60824740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9c58146a10 con 0x56519f6c9870 2024-04-25T02:11:08.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.893+0000 7f9c60824740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c581e88f0 con 0x56519f6a7d60 2024-04-25T02:11:08.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.893+0000 7f9c60824740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9c581f53a0 con 0x56519f6c5600 2024-04-25T02:11:08.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.893+0000 7f9c577fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c9870 0x56519f67e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.893+0000 7f9c577fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c9870 0x56519f67e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47436/0 (socket says 172.21.15.79:47436) 2024-04-25T02:11:08.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.893+0000 7f9c577fe640 1 -- 172.21.15.79:0/1877552160 learned_addr learned my addr 172.21.15.79:0/1877552160 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.893+0000 7f9c577fe640 1 -- 172.21.15.79:0/1877552160 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f6c5600 msgr2=0x56519f67de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.893+0000 7f9c577fe640 1 --2- 172.21.15.79:0/1877552160 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f6c5600 0x56519f67de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.893+0000 7f9c577fe640 1 -- 172.21.15.79:0/1877552160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6a7d60 msgr2=0x56519f6a8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.893+0000 7f9c577fe640 1 --2- 172.21.15.79:0/1877552160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6a7d60 0x56519f6a8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.893+0000 7f9c577fe640 1 -- 172.21.15.79:0/1877552160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519f679ac0 con 0x56519f6c9870 2024-04-25T02:11:08.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.893+0000 7f9c577fe640 1 --2- 172.21.15.79:0/1877552160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c9870 0x56519f67e360 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9c50007180 tx=0x7f9c50011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4664b329e0cb554c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.894+0000 7f9c4cff9640 1 -- 172.21.15.79:0/1877552160 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50009fe0 con 0x56519f6c9870 2024-04-25T02:11:08.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.894+0000 7f9c4cff9640 1 -- 172.21.15.79:0/1877552160 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5000a180 con 0x56519f6c9870 2024-04-25T02:11:08.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.894+0000 7f9c4cff9640 1 -- 172.21.15.79:0/1877552160 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50003970 con 0x56519f6c9870 2024-04-25T02:11:08.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.894+0000 7f9c60824740 1 -- 172.21.15.79:0/1877552160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c9870 msgr2=0x56519f67e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.894+0000 7f9c60824740 1 --2- 172.21.15.79:0/1877552160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c9870 0x56519f67e360 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9c50007180 tx=0x7f9c50011000 comp rx=0 tx=0).stop 2024-04-25T02:11:08.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.894+0000 7f9c60824740 1 -- 172.21.15.79:0/1877552160 shutdown_connections 2024-04-25T02:11:08.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.894+0000 7f9c60824740 1 --2- 172.21.15.79:0/1877552160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c9870 0x56519f67e360 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.894+0000 7f9c60824740 1 --2- 172.21.15.79:0/1877552160 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f6c5600 0x56519f67de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.894+0000 7f9c60824740 1 --2- 172.21.15.79:0/1877552160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6a7d60 0x56519f6a8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.894+0000 7f9c60824740 1 -- 172.21.15.79:0/1877552160 >> 172.21.15.79:0/1877552160 conn(0x56519f67da40 msgr2=0x56519f6c59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.894+0000 7f9c60824740 1 -- 172.21.15.79:0/1877552160 shutdown_connections 2024-04-25T02:11:08.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.894+0000 7f9c60824740 1 -- 172.21.15.79:0/1877552160 wait complete. 2024-04-25T02:11:08.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.895+0000 7f9c60824740 1 -- start start 2024-04-25T02:11:08.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.895+0000 7f9c60824740 1 Processor -- start 2024-04-25T02:11:08.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c60824740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f6a7d60 0x56519f72e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c60824740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c5600 0x56519f67de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c60824740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6c9870 0x56519f67e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c60824740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56519f6c9600 con 0x56519f6c5600 2024-04-25T02:11:08.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c60824740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c581e82a0 con 0x56519f6c9870 2024-04-25T02:11:08.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c60824740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56519f6c60f0 con 0x56519f6a7d60 2024-04-25T02:11:08.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c60824740 10 client.0 _ll_register_callbacks cb 0x7f9c50009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:08.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c4ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c5600 0x56519f67de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c4ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c5600 0x56519f67de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47438/0 (socket says 172.21.15.79:47438) 2024-04-25T02:11:08.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c4ffff640 1 -- 172.21.15.79:0/1085646018 learned_addr learned my addr 172.21.15.79:0/1085646018 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:08.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c577fe640 1 --2- 172.21.15.79:0/1085646018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6c9870 0x56519f67e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c56ffd640 1 --2- 172.21.15.79:0/1085646018 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f6a7d60 0x56519f72e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c4ffff640 1 -- 172.21.15.79:0/1085646018 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f6a7d60 msgr2=0x56519f72e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c4ffff640 1 --2- 172.21.15.79:0/1085646018 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f6a7d60 0x56519f72e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c4ffff640 1 -- 172.21.15.79:0/1085646018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6c9870 msgr2=0x56519f67e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:08.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c4ffff640 1 --2- 172.21.15.79:0/1085646018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6c9870 0x56519f67e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c4ffff640 1 -- 172.21.15.79:0/1085646018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56519f6e7130 con 0x56519f6c5600 2024-04-25T02:11:08.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c577fe640 1 --2- 172.21.15.79:0/1085646018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6c9870 0x56519f67e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:08.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c4ffff640 1 --2- 172.21.15.79:0/1085646018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c5600 0x56519f67de20 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9c581e8fb0 tx=0x7f9c400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd220a25970b302e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:08.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c367fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:11:08.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c367fc640 1 -- 172.21.15.79:0/1085646018 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c40023020 con 0x56519f6c5600 2024-04-25T02:11:08.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c367fc640 1 -- 172.21.15.79:0/1085646018 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f9c4001f480 con 0x56519f6c5600 2024-04-25T02:11:08.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c60824740 1 -- 172.21.15.79:0/1085646018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c5000a180 con 0x56519f6c5600 2024-04-25T02:11:08.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.896+0000 7f9c367fc640 1 -- 172.21.15.79:0/1085646018 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c4002d050 con 0x56519f6c5600 2024-04-25T02:11:08.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 10 client.6447 fetch_fsmap learned FSMap version 25 2024-04-25T02:11:08.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 1 -- 172.21.15.79:0/1085646018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x56519f73d200 con 0x56519f6c5600 2024-04-25T02:11:08.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c367fc640 1 -- 172.21.15.79:0/1085646018 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5000a180 con 0x56519f6c5600 2024-04-25T02:11:08.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c367fc640 1 -- 172.21.15.79:0/1085646018 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f9c40030020 con 0x56519f6c5600 2024-04-25T02:11:08.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 10 client.6447 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T02:11:08.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 10 client.6447 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T02:11:08.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 20 client.6447 populate_metadata read hostname 'smithi079' 2024-04-25T02:11:08.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 1 --2- 172.21.15.79:0/1085646018 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x56519f677a40 0x56519f6dce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:08.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 4 client.6447 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:11:08.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 1 -- 172.21.15.79:0/1085646018 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56519f5e8f40 con 0x56519f677a40 2024-04-25T02:11:08.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c56ffd640 1 --2- 172.21.15.79:0/1085646018 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x56519f677a40 0x56519f6dce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:08.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c367fc640 10 client.6447 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:08.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c56ffd640 1 --2- 172.21.15.79:0/1085646018 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x56519f677a40 0x56519f6dce00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ee19b64bfbcb00f server_cookie=7ca9262c976fd820 in_seq=0 out_seq=0 2024-04-25T02:11:08.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c367fc640 1 -- 172.21.15.79:0/1085646018 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x56519f5e8f40 con 0x56519f677a40 2024-04-25T02:11:08.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c367fc640 10 client.6447 handle_command_reply: tid=0 2024-04-25T02:11:08.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 1 client.6447 shutdown 2024-04-25T02:11:08.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 1 -- 172.21.15.79:0/1085646018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c5600 msgr2=0x56519f67de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 1 --2- 172.21.15.79:0/1085646018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c5600 0x56519f67de20 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9c581e8fb0 tx=0x7f9c400046c0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 1 -- 172.21.15.79:0/1085646018 shutdown_connections 2024-04-25T02:11:08.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 1 --2- 172.21.15.79:0/1085646018 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x56519f677a40 0x56519f6dce00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 1 --2- 172.21.15.79:0/1085646018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56519f6c9870 0x56519f67e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 1 --2- 172.21.15.79:0/1085646018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56519f6c5600 0x56519f67de20 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 1 --2- 172.21.15.79:0/1085646018 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56519f6a7d60 0x56519f72e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c367fc640 0 client.6447 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:08.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.897+0000 7f9c60824740 1 -- 172.21.15.79:0/1085646018 >> 172.21.15.79:0/1085646018 conn(0x56519f67da40 msgr2=0x56519f677260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.898+0000 7f9c60824740 1 -- 172.21.15.79:0/1085646018 shutdown_connections 2024-04-25T02:11:08.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.898+0000 7f9c60824740 1 -- 172.21.15.79:0/1085646018 wait complete. 2024-04-25T02:11:08.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.898+0000 7f9c60824740 20 client.6447 trim_cache size 0 max 16384 2024-04-25T02:11:08.912 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:11:08.912 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T02:11:08.912 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-04-25T02:11:08.912 INFO:teuthology.orchestra.run.smithi079.stdout: "18d73fd4-a476-4cf9-80e1-8efdfc00c6ca": { 2024-04-25T02:11:08.912 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-04-25T02:11:08.912 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "18d73fd4-a476-4cf9-80e1-8efdfc00c6ca", 2024-04-25T02:11:08.912 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,repair,force" 2024-04-25T02:11:08.912 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:08.912 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:08.912 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:11:08.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.898+0000 7f9c5da38640 1 -- 172.21.15.79:0/406929308 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9c3806be30 msgr2=0x7f9c3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.898+0000 7f9c5da38640 1 --2- 172.21.15.79:0/406929308 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9c3806be30 0x7f9c3806e2f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9c40006fd0 tx=0x7f9c40008040 comp rx=0 tx=0).stop 2024-04-25T02:11:08.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.898+0000 7f9c5da38640 1 -- 172.21.15.79:0/406929308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c580b3100 msgr2=0x7f9c581e55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:08.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.898+0000 7f9c5da38640 1 --2- 172.21.15.79:0/406929308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c580b3100 0x7f9c581e55a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9c48000c00 tx=0x7f9c480046c0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.898+0000 7f9c5da38640 1 -- 172.21.15.79:0/406929308 shutdown_connections 2024-04-25T02:11:08.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.898+0000 7f9c5da38640 1 --2- 172.21.15.79:0/406929308 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9c3806be30 0x7f9c3806e2f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.898+0000 7f9c5da38640 1 --2- 172.21.15.79:0/406929308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c580d1060 0x7f9c580cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.898+0000 7f9c5da38640 1 --2- 172.21.15.79:0/406929308 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c580d0c80 0x7f9c58144040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.898+0000 7f9c5da38640 1 --2- 172.21.15.79:0/406929308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c580b3100 0x7f9c581e55a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:08.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.898+0000 7f9c5da38640 1 -- 172.21.15.79:0/406929308 >> 172.21.15.79:0/406929308 conn(0x7f9c5809d3c0 msgr2=0x7f9c580d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:08.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.898+0000 7f9c5da38640 1 -- 172.21.15.79:0/406929308 shutdown_connections 2024-04-25T02:11:08.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:08.898+0000 7f9c5da38640 1 -- 172.21.15.79:0/406929308 wait complete. 2024-04-25T02:11:08.916 INFO:tasks.cephfs.filesystem:scrub status for tag:18d73fd4-a476-4cf9-80e1-8efdfc00c6ca - {'path': '/', 'tag': '18d73fd4-a476-4cf9-80e1-8efdfc00c6ca', 'options': 'recursive,repair,force'} 2024-04-25T02:11:30.024 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:11:30.028 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:11:38.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:11:38.918 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T02:11:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.020+0000 7ff74d134640 1 Processor -- start 2024-04-25T02:11:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.020+0000 7ff74d134640 1 -- start start 2024-04-25T02:11:39.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.021+0000 7ff74d134640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff74815e4f0 0x7ff7480d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.021+0000 7ff74d134640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7480cf7f0 0x7ff7480d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.021+0000 7ff74d134640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7480d1ee0 con 0x7ff7480cfc50 2024-04-25T02:11:39.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.021+0000 7ff74d134640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff7480d21c0 con 0x7ff74815e4f0 2024-04-25T02:11:39.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.021+0000 7ff74d134640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff7480d24a0 con 0x7ff7480cf7f0 2024-04-25T02:11:39.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.021+0000 7ff746d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff74815e4f0 0x7ff7480d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.021+0000 7ff746d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff74815e4f0 0x7ff7480d2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57778/0 (socket says 172.21.15.79:57778) 2024-04-25T02:11:39.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.021+0000 7ff746d9d640 1 -- 172.21.15.79:0/3958030793 learned_addr learned my addr 172.21.15.79:0/3958030793 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:39.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.022+0000 7ff74659c640 1 --2- 172.21.15.79:0/3958030793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7480cf7f0 0x7ff7480d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.022+0000 7ff746d9d640 1 -- 172.21.15.79:0/3958030793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7480cf7f0 msgr2=0x7ff7480d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.022+0000 7ff746d9d640 1 --2- 172.21.15.79:0/3958030793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7480cf7f0 0x7ff7480d09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.022+0000 7ff746d9d640 1 -- 172.21.15.79:0/3958030793 >> v1:172.21.15.189:6789/0 conn(0x7ff7480cfc50 legacy=0x7ff74806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.022+0000 7ff746d9d640 1 -- 172.21.15.79:0/3958030793 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7480d2780 con 0x7ff74815e4f0 2024-04-25T02:11:39.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.022+0000 7ff746d9d640 1 --2- 172.21.15.79:0/3958030793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff74815e4f0 0x7ff7480d2ca0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff738009e80 tx=0x7ff73802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e676fbb5814f831 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.022+0000 7ff745d9b640 1 -- 172.21.15.79:0/3958030793 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738036070 con 0x7ff74815e4f0 2024-04-25T02:11:39.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.023+0000 7ff745d9b640 1 -- 172.21.15.79:0/3958030793 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff738031600 con 0x7ff74815e4f0 2024-04-25T02:11:39.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.023+0000 7ff745d9b640 1 -- 172.21.15.79:0/3958030793 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7380319d0 con 0x7ff74815e4f0 2024-04-25T02:11:39.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.023+0000 7ff74d134640 1 -- 172.21.15.79:0/3958030793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff74815e4f0 msgr2=0x7ff7480d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.023+0000 7ff74d134640 1 --2- 172.21.15.79:0/3958030793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff74815e4f0 0x7ff7480d2ca0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff738009e80 tx=0x7ff73802a6f0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.023+0000 7ff74d134640 1 -- 172.21.15.79:0/3958030793 shutdown_connections 2024-04-25T02:11:39.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.023+0000 7ff74d134640 1 --2- 172.21.15.79:0/3958030793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7480cf7f0 0x7ff7480d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.023+0000 7ff74d134640 1 --2- 172.21.15.79:0/3958030793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff74815e4f0 0x7ff7480d2ca0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.023+0000 7ff74d134640 1 -- 172.21.15.79:0/3958030793 >> 172.21.15.79:0/3958030793 conn(0x7ff74809d4a0 msgr2=0x7ff7480d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.023+0000 7ff74d134640 1 -- 172.21.15.79:0/3958030793 shutdown_connections 2024-04-25T02:11:39.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.023+0000 7ff74d134640 1 -- 172.21.15.79:0/3958030793 wait complete. 2024-04-25T02:11:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.025+0000 7ff74d134640 1 Processor -- start 2024-04-25T02:11:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.025+0000 7ff74d134640 1 -- start start 2024-04-25T02:11:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.025+0000 7ff74d134640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7480cf7f0 0x7ff74814faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.025+0000 7ff74d134640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7480cfc50 0x7ff7480cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.025+0000 7ff74d134640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff74815e4f0 0x7ff748157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff74d134640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff7480d0ef0 con 0x7ff74815e4f0 2024-04-25T02:11:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff74d134640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff7480d50f0 con 0x7ff7480cf7f0 2024-04-25T02:11:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff74d134640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff7480d1070 con 0x7ff7480cfc50 2024-04-25T02:11:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff74759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff74815e4f0 0x7ff748157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff74759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff74815e4f0 0x7ff748157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57788/0 (socket says 172.21.15.79:57788) 2024-04-25T02:11:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff74759e640 1 -- 172.21.15.79:0/721150563 learned_addr learned my addr 172.21.15.79:0/721150563 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff746d9d640 1 --2- 172.21.15.79:0/721150563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7480cf7f0 0x7ff74814faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff74659c640 1 --2- 172.21.15.79:0/721150563 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7480cfc50 0x7ff7480cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff74759e640 1 -- 172.21.15.79:0/721150563 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7480cfc50 msgr2=0x7ff7480cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff74759e640 1 --2- 172.21.15.79:0/721150563 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7480cfc50 0x7ff7480cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff74759e640 1 -- 172.21.15.79:0/721150563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7480cf7f0 msgr2=0x7ff74814faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff74759e640 1 --2- 172.21.15.79:0/721150563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7480cf7f0 0x7ff74814faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff74759e640 1 -- 172.21.15.79:0/721150563 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7480cbbb0 con 0x7ff74815e4f0 2024-04-25T02:11:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff74759e640 1 --2- 172.21.15.79:0/721150563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff74815e4f0 0x7ff748157ea0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff74000c440 tx=0x7ff74000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff72f7fe640 1 -- 172.21.15.79:0/721150563 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740011790 con 0x7ff74815e4f0 2024-04-25T02:11:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff72f7fe640 1 -- 172.21.15.79:0/721150563 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff740017070 con 0x7ff74815e4f0 2024-04-25T02:11:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff74d134640 1 -- 172.21.15.79:0/721150563 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7480cbe90 con 0x7ff74815e4f0 2024-04-25T02:11:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff72f7fe640 1 -- 172.21.15.79:0/721150563 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740011b70 con 0x7ff74815e4f0 2024-04-25T02:11:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.026+0000 7ff74d134640 1 -- 172.21.15.79:0/721150563 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7480c8ce0 con 0x7ff74815e4f0 2024-04-25T02:11:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.028+0000 7ff72f7fe640 1 -- 172.21.15.79:0/721150563 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff740011d10 con 0x7ff74815e4f0 2024-04-25T02:11:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.028+0000 7ff72f7fe640 1 --2- 172.21.15.79:0/721150563 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff73406be30 0x7ff73406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.028+0000 7ff72f7fe640 1 -- 172.21.15.79:0/721150563 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7ff74008aae0 con 0x7ff74815e4f0 2024-04-25T02:11:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.028+0000 7ff746d9d640 1 --2- 172.21.15.79:0/721150563 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff73406be30 0x7ff73406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.029+0000 7ff746d9d640 1 --2- 172.21.15.79:0/721150563 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff73406be30 0x7ff73406e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff738033000 tx=0x7ff738009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.029+0000 7ff74fe40740 1 Processor -- start 2024-04-25T02:11:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.029+0000 7ff74fe40740 1 -- start start 2024-04-25T02:11:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.030+0000 7ff74fe40740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c08d60 0x55ce31c09140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.030+0000 7ff74fe40740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c26600 0x55ce31c26b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.030+0000 7ff74fe40740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31bdea40 0x55ce31c24cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.030+0000 7ff74fe40740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ce31b426b0 con 0x55ce31c08d60 2024-04-25T02:11:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.030+0000 7ff74fe40740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ce31aea880 con 0x55ce31c26600 2024-04-25T02:11:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.030+0000 7ff74fe40740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ce31b3e670 con 0x55ce31bdea40 2024-04-25T02:11:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.030+0000 7ff746d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c08d60 0x55ce31c09140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.030+0000 7ff746d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c08d60 0x55ce31c09140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57798/0 (socket says 172.21.15.79:57798) 2024-04-25T02:11:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.030+0000 7ff746d9d640 1 -- 172.21.15.79:0/2275598778 learned_addr learned my addr 172.21.15.79:0/2275598778 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.030+0000 7ff746d9d640 1 -- 172.21.15.79:0/2275598778 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31bdea40 msgr2=0x55ce31c24cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.030+0000 7ff746d9d640 1 --2- 172.21.15.79:0/2275598778 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31bdea40 0x55ce31c24cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.030+0000 7ff746d9d640 1 -- 172.21.15.79:0/2275598778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c26600 msgr2=0x55ce31c26b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.030+0000 7ff746d9d640 1 --2- 172.21.15.79:0/2275598778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c26600 0x55ce31c26b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.030+0000 7ff746d9d640 1 -- 172.21.15.79:0/2275598778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce319207d0 con 0x55ce31c08d60 2024-04-25T02:11:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.030+0000 7ff746d9d640 1 --2- 172.21.15.79:0/2275598778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c08d60 0x55ce31c09140 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff73802ace0 tx=0x7ff73802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d557c46d94ff9eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.031+0000 7ff72cff9640 1 -- 172.21.15.79:0/2275598778 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738040040 con 0x55ce31c08d60 2024-04-25T02:11:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.031+0000 7ff72cff9640 1 -- 172.21.15.79:0/2275598778 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff738037040 con 0x55ce31c08d60 2024-04-25T02:11:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.031+0000 7ff72cff9640 1 -- 172.21.15.79:0/2275598778 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738036050 con 0x55ce31c08d60 2024-04-25T02:11:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.031+0000 7ff74fe40740 1 -- 172.21.15.79:0/2275598778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c08d60 msgr2=0x55ce31c09140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.031+0000 7ff74fe40740 1 --2- 172.21.15.79:0/2275598778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c08d60 0x55ce31c09140 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff73802ace0 tx=0x7ff73802e000 comp rx=0 tx=0).stop 2024-04-25T02:11:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.031+0000 7ff74fe40740 1 -- 172.21.15.79:0/2275598778 shutdown_connections 2024-04-25T02:11:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.031+0000 7ff74fe40740 1 --2- 172.21.15.79:0/2275598778 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31bdea40 0x55ce31c24cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.031+0000 7ff74fe40740 1 --2- 172.21.15.79:0/2275598778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c26600 0x55ce31c26b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.031+0000 7ff74fe40740 1 --2- 172.21.15.79:0/2275598778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c08d60 0x55ce31c09140 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.031+0000 7ff74fe40740 1 -- 172.21.15.79:0/2275598778 >> 172.21.15.79:0/2275598778 conn(0x55ce31bdb600 msgr2=0x55ce31c23b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.031+0000 7ff74fe40740 1 -- 172.21.15.79:0/2275598778 shutdown_connections 2024-04-25T02:11:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.031+0000 7ff74fe40740 1 -- 172.21.15.79:0/2275598778 wait complete. 2024-04-25T02:11:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.032+0000 7ff74fe40740 1 -- start start 2024-04-25T02:11:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.032+0000 7ff74fe40740 1 Processor -- start 2024-04-25T02:11:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74fe40740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c08d60 0x55ce31c049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74fe40740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c26600 0x55ce31c0bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74fe40740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31bd86a0 0x55ce31bd8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74fe40740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ce31bdf7e0 con 0x55ce31c26600 2024-04-25T02:11:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74fe40740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ce31afdf50 con 0x55ce31c08d60 2024-04-25T02:11:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74fe40740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ce31bd9530 con 0x55ce31bd86a0 2024-04-25T02:11:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74fe40740 10 client.0 _ll_register_callbacks cb 0x55ce31b39000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c26600 0x55ce31c0bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c26600 0x55ce31c0bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57814/0 (socket says 172.21.15.79:57814) 2024-04-25T02:11:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74659c640 1 -- 172.21.15.79:0/555853335 learned_addr learned my addr 172.21.15.79:0/555853335 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff746d9d640 1 --2- 172.21.15.79:0/555853335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c08d60 0x55ce31c049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74759e640 1 --2- 172.21.15.79:0/555853335 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31bd86a0 0x55ce31bd8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74659c640 1 -- 172.21.15.79:0/555853335 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31bd86a0 msgr2=0x55ce31bd8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74659c640 1 --2- 172.21.15.79:0/555853335 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31bd86a0 0x55ce31bd8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74659c640 1 -- 172.21.15.79:0/555853335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c08d60 msgr2=0x55ce31c049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74659c640 1 --2- 172.21.15.79:0/555853335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c08d60 0x55ce31c049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74659c640 1 -- 172.21.15.79:0/555853335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce318563f0 con 0x55ce31c26600 2024-04-25T02:11:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff746d9d640 1 --2- 172.21.15.79:0/555853335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c08d60 0x55ce31c049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff74659c640 1 --2- 172.21.15.79:0/555853335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c26600 0x55ce31c0bef0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00f500 tx=0x7ff73c00f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ab4836b177714b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff725ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:11:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff725ffb640 1 -- 172.21.15.79:0/555853335 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c013850 con 0x55ce31c26600 2024-04-25T02:11:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.033+0000 7ff725ffb640 1 -- 172.21.15.79:0/555853335 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7ff73c0139f0 con 0x55ce31c26600 2024-04-25T02:11:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.034+0000 7ff74fe40740 1 -- 172.21.15.79:0/555853335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff738037040 con 0x55ce31c26600 2024-04-25T02:11:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.034+0000 7ff725ffb640 1 -- 172.21.15.79:0/555853335 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff73c023050 con 0x55ce31c26600 2024-04-25T02:11:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.034+0000 7ff74fe40740 10 client.6459 fetch_fsmap learned FSMap version 26 2024-04-25T02:11:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.034+0000 7ff74fe40740 1 -- 172.21.15.79:0/555853335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55ce318160f0 con 0x55ce31c26600 2024-04-25T02:11:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.034+0000 7ff725ffb640 1 -- 172.21.15.79:0/555853335 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff738037040 con 0x55ce31c26600 2024-04-25T02:11:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.034+0000 7ff725ffb640 1 -- 172.21.15.79:0/555853335 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7ff73c026020 con 0x55ce31c26600 2024-04-25T02:11:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.034+0000 7ff74fe40740 10 client.6459 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:11:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.034+0000 7ff74fe40740 10 client.6459 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T02:11:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.034+0000 7ff74fe40740 20 client.6459 populate_metadata read hostname 'smithi079' 2024-04-25T02:11:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.034+0000 7ff74fe40740 1 --2- 172.21.15.79:0/555853335 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55ce31c078a0 0x55ce31c07ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.034+0000 7ff74fe40740 4 client.6459 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.034+0000 7ff74fe40740 1 -- 172.21.15.79:0/555853335 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce31b4fbf0 con 0x55ce31c078a0 2024-04-25T02:11:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.034+0000 7ff746d9d640 1 --2- 172.21.15.79:0/555853335 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55ce31c078a0 0x55ce31c07ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.034+0000 7ff725ffb640 10 client.6459 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.034+0000 7ff746d9d640 1 --2- 172.21.15.79:0/555853335 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55ce31c078a0 0x55ce31c07ca0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=581f3d5e757079ce server_cookie=8b2f870e8ddbd001 in_seq=0 out_seq=0 2024-04-25T02:11:39.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.035+0000 7ff725ffb640 1 -- 172.21.15.79:0/555853335 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ce31b4fbf0 con 0x55ce31c078a0 2024-04-25T02:11:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.035+0000 7ff725ffb640 10 client.6459 handle_command_reply: tid=0 2024-04-25T02:11:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.035+0000 7ff74fe40740 1 client.6459 shutdown 2024-04-25T02:11:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.035+0000 7ff74fe40740 1 -- 172.21.15.79:0/555853335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c26600 msgr2=0x55ce31c0bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.035+0000 7ff74fe40740 1 --2- 172.21.15.79:0/555853335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c26600 0x55ce31c0bef0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00f500 tx=0x7ff73c00f9c0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.035+0000 7ff74fe40740 1 -- 172.21.15.79:0/555853335 shutdown_connections 2024-04-25T02:11:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.035+0000 7ff74fe40740 1 --2- 172.21.15.79:0/555853335 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55ce31c078a0 0x55ce31c07ca0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.035+0000 7ff74fe40740 1 --2- 172.21.15.79:0/555853335 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31bd86a0 0x55ce31bd8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.035+0000 7ff725ffb640 0 client.6459 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.035+0000 7ff74fe40740 1 --2- 172.21.15.79:0/555853335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c26600 0x55ce31c0bef0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.035+0000 7ff74fe40740 1 --2- 172.21.15.79:0/555853335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c08d60 0x55ce31c049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.035+0000 7ff74fe40740 1 -- 172.21.15.79:0/555853335 >> 172.21.15.79:0/555853335 conn(0x55ce31bdea40 msgr2=0x55ce31c270f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.035+0000 7ff74fe40740 1 -- 172.21.15.79:0/555853335 shutdown_connections 2024-04-25T02:11:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.035+0000 7ff74fe40740 1 -- 172.21.15.79:0/555853335 wait complete. 2024-04-25T02:11:39.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.035+0000 7ff74fe40740 20 client.6459 trim_cache size 0 max 16384 2024-04-25T02:11:39.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.053+0000 7ff74fe40740 1 Processor -- start 2024-04-25T02:11:39.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.053+0000 7ff74fe40740 1 -- start start 2024-04-25T02:11:39.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.053+0000 7ff74fe40740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31bd86a0 0x55ce31c23530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.053+0000 7ff74fe40740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c08d60 0x55ce31c36d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.053+0000 7ff74fe40740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31c26600 0x55ce31c37270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.053+0000 7ff74fe40740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff7482007c0 con 0x55ce31bd86a0 2024-04-25T02:11:39.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.053+0000 7ff74fe40740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff7480ca230 con 0x55ce31c08d60 2024-04-25T02:11:39.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.053+0000 7ff74fe40740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff74815bb50 con 0x55ce31c26600 2024-04-25T02:11:39.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.053+0000 7ff746d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31bd86a0 0x55ce31c23530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.054+0000 7ff746d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31bd86a0 0x55ce31c23530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57818/0 (socket says 172.21.15.79:57818) 2024-04-25T02:11:39.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.054+0000 7ff746d9d640 1 -- 172.21.15.79:0/3811027774 learned_addr learned my addr 172.21.15.79:0/3811027774 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:39.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.054+0000 7ff74759e640 1 --2- 172.21.15.79:0/3811027774 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31c26600 0x55ce31c37270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.054+0000 7ff74659c640 1 --2- 172.21.15.79:0/3811027774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c08d60 0x55ce31c36d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.054+0000 7ff746d9d640 1 -- 172.21.15.79:0/3811027774 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31c26600 msgr2=0x55ce31c37270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.054+0000 7ff746d9d640 1 --2- 172.21.15.79:0/3811027774 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31c26600 0x55ce31c37270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.054+0000 7ff746d9d640 1 -- 172.21.15.79:0/3811027774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c08d60 msgr2=0x55ce31c36d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.054+0000 7ff746d9d640 1 --2- 172.21.15.79:0/3811027774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c08d60 0x55ce31c36d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.054+0000 7ff746d9d640 1 -- 172.21.15.79:0/3811027774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce31c25e30 con 0x55ce31bd86a0 2024-04-25T02:11:39.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.054+0000 7ff74759e640 1 --2- 172.21.15.79:0/3811027774 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31c26600 0x55ce31c37270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:39.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.054+0000 7ff74659c640 1 --2- 172.21.15.79:0/3811027774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c08d60 0x55ce31c36d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:39.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.054+0000 7ff746d9d640 1 --2- 172.21.15.79:0/3811027774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31bd86a0 0x55ce31c23530 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff738009e80 tx=0x7ff738009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843aade2bff37e26 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.054+0000 7ff727fff640 1 -- 172.21.15.79:0/3811027774 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73805d070 con 0x55ce31bd86a0 2024-04-25T02:11:39.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.054+0000 7ff727fff640 1 -- 172.21.15.79:0/3811027774 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff738057dc0 con 0x55ce31bd86a0 2024-04-25T02:11:39.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.054+0000 7ff727fff640 1 -- 172.21.15.79:0/3811027774 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738040040 con 0x55ce31bd86a0 2024-04-25T02:11:39.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.055+0000 7ff74fe40740 1 -- 172.21.15.79:0/3811027774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31bd86a0 msgr2=0x55ce31c23530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.055+0000 7ff74fe40740 1 --2- 172.21.15.79:0/3811027774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31bd86a0 0x55ce31c23530 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff738009e80 tx=0x7ff738009810 comp rx=0 tx=0).stop 2024-04-25T02:11:39.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.055+0000 7ff74fe40740 1 -- 172.21.15.79:0/3811027774 shutdown_connections 2024-04-25T02:11:39.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.055+0000 7ff74fe40740 1 --2- 172.21.15.79:0/3811027774 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31c26600 0x55ce31c37270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.055+0000 7ff74fe40740 1 --2- 172.21.15.79:0/3811027774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31c08d60 0x55ce31c36d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.055+0000 7ff74fe40740 1 --2- 172.21.15.79:0/3811027774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31bd86a0 0x55ce31c23530 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.055+0000 7ff74fe40740 1 -- 172.21.15.79:0/3811027774 >> 172.21.15.79:0/3811027774 conn(0x55ce31bdea40 msgr2=0x55ce31c0b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.055+0000 7ff74fe40740 1 -- 172.21.15.79:0/3811027774 shutdown_connections 2024-04-25T02:11:39.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.055+0000 7ff74fe40740 1 -- 172.21.15.79:0/3811027774 wait complete. 2024-04-25T02:11:39.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.055+0000 7ff74fe40740 1 -- start start 2024-04-25T02:11:39.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.055+0000 7ff74fe40740 1 Processor -- start 2024-04-25T02:11:39.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74fe40740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31bd86a0 0x55ce31c0c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74fe40740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31c08d60 0x55ce31bdc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74fe40740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c26600 0x55ce31c1bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74fe40740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ce31c481a0 con 0x55ce31c26600 2024-04-25T02:11:39.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74fe40740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff7480c9be0 con 0x55ce31bd86a0 2024-04-25T02:11:39.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74fe40740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ce31c04c90 con 0x55ce31c08d60 2024-04-25T02:11:39.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74fe40740 10 client.0 _ll_register_callbacks cb 0x7ff73c00a510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:39.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c26600 0x55ce31c1bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c26600 0x55ce31c1bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57834/0 (socket says 172.21.15.79:57834) 2024-04-25T02:11:39.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74759e640 1 -- 172.21.15.79:0/3245786359 learned_addr learned my addr 172.21.15.79:0/3245786359 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:39.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74659c640 1 --2- 172.21.15.79:0/3245786359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31c08d60 0x55ce31bdc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74759e640 1 -- 172.21.15.79:0/3245786359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31c08d60 msgr2=0x55ce31bdc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74759e640 1 --2- 172.21.15.79:0/3245786359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31c08d60 0x55ce31bdc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74759e640 1 -- 172.21.15.79:0/3245786359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31bd86a0 msgr2=0x55ce31c0c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff746d9d640 1 --2- 172.21.15.79:0/3245786359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31bd86a0 0x55ce31c0c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74759e640 1 --2- 172.21.15.79:0/3245786359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31bd86a0 0x55ce31c0c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74759e640 1 -- 172.21.15.79:0/3245786359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce31bdde70 con 0x55ce31c26600 2024-04-25T02:11:39.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff74759e640 1 --2- 172.21.15.79:0/3245786359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c26600 0x55ce31c1bc80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff74000ce00 tx=0x7ff740061a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36853ec1f1cbb06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.056+0000 7ff725ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:11:39.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff725ffb640 1 -- 172.21.15.79:0/3245786359 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740058320 con 0x55ce31c26600 2024-04-25T02:11:39.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff725ffb640 1 -- 172.21.15.79:0/3245786359 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7ff7400584c0 con 0x55ce31c26600 2024-04-25T02:11:39.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff74fe40740 1 -- 172.21.15.79:0/3245786359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff738057dc0 con 0x55ce31c26600 2024-04-25T02:11:39.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff725ffb640 1 -- 172.21.15.79:0/3245786359 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff740077050 con 0x55ce31c26600 2024-04-25T02:11:39.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff74fe40740 10 client.6465 fetch_fsmap learned FSMap version 26 2024-04-25T02:11:39.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff74fe40740 1 -- 172.21.15.79:0/3245786359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55ce31c1b7c0 con 0x55ce31c26600 2024-04-25T02:11:39.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff725ffb640 1 -- 172.21.15.79:0/3245786359 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff738057dc0 con 0x55ce31c26600 2024-04-25T02:11:39.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff725ffb640 1 -- 172.21.15.79:0/3245786359 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7ff74005f3d0 con 0x55ce31c26600 2024-04-25T02:11:39.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff74fe40740 10 client.6465 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:11:39.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff74fe40740 10 client.6465 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T02:11:39.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff74fe40740 20 client.6465 populate_metadata read hostname 'smithi079' 2024-04-25T02:11:39.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff74fe40740 1 --2- 172.21.15.79:0/3245786359 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55ce31c9cef0 0x55ce31c26d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff74fe40740 4 client.6465 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:11:39.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff74fe40740 1 -- 172.21.15.79:0/3245786359 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ce31b49f40 con 0x55ce31c9cef0 2024-04-25T02:11:39.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff746d9d640 1 --2- 172.21.15.79:0/3245786359 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55ce31c9cef0 0x55ce31c26d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff725ffb640 10 client.6465 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:39.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff746d9d640 1 --2- 172.21.15.79:0/3245786359 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55ce31c9cef0 0x55ce31c26d90 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75e7b0d3a47718d2 server_cookie=e112f5704316fb61 in_seq=0 out_seq=0 2024-04-25T02:11:39.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff725ffb640 1 -- 172.21.15.79:0/3245786359 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ce31b49f40 con 0x55ce31c9cef0 2024-04-25T02:11:39.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff725ffb640 10 client.6465 handle_command_reply: tid=0 2024-04-25T02:11:39.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.057+0000 7ff74fe40740 1 client.6465 shutdown 2024-04-25T02:11:39.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74fe40740 1 -- 172.21.15.79:0/3245786359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c26600 msgr2=0x55ce31c1bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74fe40740 1 --2- 172.21.15.79:0/3245786359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c26600 0x55ce31c1bc80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff74000ce00 tx=0x7ff740061a00 comp rx=0 tx=0).stop 2024-04-25T02:11:39.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74fe40740 1 -- 172.21.15.79:0/3245786359 shutdown_connections 2024-04-25T02:11:39.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74fe40740 1 --2- 172.21.15.79:0/3245786359 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55ce31c9cef0 0x55ce31c26d90 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74fe40740 1 --2- 172.21.15.79:0/3245786359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31c26600 0x55ce31c1bc80 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74fe40740 1 --2- 172.21.15.79:0/3245786359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ce31c08d60 0x55ce31bdc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff725ffb640 0 client.6465 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:39.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74fe40740 1 --2- 172.21.15.79:0/3245786359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ce31bd86a0 0x55ce31c0c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74fe40740 1 -- 172.21.15.79:0/3245786359 >> 172.21.15.79:0/3245786359 conn(0x55ce31bdea40 msgr2=0x55ce31c0b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74fe40740 1 -- 172.21.15.79:0/3245786359 shutdown_connections 2024-04-25T02:11:39.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74fe40740 1 -- 172.21.15.79:0/3245786359 wait complete. 2024-04-25T02:11:39.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74fe40740 20 client.6465 trim_cache size 0 max 16384 2024-04-25T02:11:39.074 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:11:39.075 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-04-25T02:11:39.075 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-04-25T02:11:39.075 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:11:39.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74d134640 1 -- 172.21.15.79:0/721150563 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff73406be30 msgr2=0x7ff73406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74d134640 1 --2- 172.21.15.79:0/721150563 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff73406be30 0x7ff73406e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff738033000 tx=0x7ff738009000 comp rx=0 tx=0).stop 2024-04-25T02:11:39.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74d134640 1 -- 172.21.15.79:0/721150563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff74815e4f0 msgr2=0x7ff748157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74d134640 1 --2- 172.21.15.79:0/721150563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff74815e4f0 0x7ff748157ea0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff74000c440 tx=0x7ff74000c900 comp rx=0 tx=0).stop 2024-04-25T02:11:39.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74d134640 1 -- 172.21.15.79:0/721150563 shutdown_connections 2024-04-25T02:11:39.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74d134640 1 --2- 172.21.15.79:0/721150563 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff73406be30 0x7ff73406e2f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74d134640 1 --2- 172.21.15.79:0/721150563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff74815e4f0 0x7ff748157ea0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74d134640 1 --2- 172.21.15.79:0/721150563 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7480cfc50 0x7ff7480cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74d134640 1 --2- 172.21.15.79:0/721150563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7480cf7f0 0x7ff74814faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74d134640 1 -- 172.21.15.79:0/721150563 >> 172.21.15.79:0/721150563 conn(0x7ff74809d4a0 msgr2=0x7ff74815a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74d134640 1 -- 172.21.15.79:0/721150563 shutdown_connections 2024-04-25T02:11:39.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.058+0000 7ff74d134640 1 -- 172.21.15.79:0/721150563 wait complete. 2024-04-25T02:11:39.077 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T02:11:39.077 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:11:39.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.166+0000 7f181feca640 1 Processor -- start 2024-04-25T02:11:39.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.167+0000 7f181feca640 1 -- start start 2024-04-25T02:11:39.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.167+0000 7f181feca640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18180d2e20 0x7f18180cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.167+0000 7f181feca640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181806c380 con 0x7f181815e4d0 2024-04-25T02:11:39.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.167+0000 7f181feca640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18180d1660 con 0x7f18180b3570 2024-04-25T02:11:39.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.167+0000 7f181feca640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f18180d1380 con 0x7f18180d2e20 2024-04-25T02:11:39.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.167+0000 7f181dc66640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f181815e4d0 0x7f181806bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45136/0 (socket says 172.21.15.79:45136) 2024-04-25T02:11:39.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181dc66640 1 -- 172.21.15.79:0/2753853903 learned_addr learned my addr 172.21.15.79:0/2753853903 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:39.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181e467640 1 --2- 172.21.15.79:0/2753853903 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18180d2e20 0x7f18180cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181cc64640 1 -- 172.21.15.79:0/2753853903 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 726410148 0 0) 0x7f181806c380 con 0x7f181815e4d0 2024-04-25T02:11:39.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181cc64640 1 -- 172.21.15.79:0/2753853903 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1804003520 con 0x7f181815e4d0 2024-04-25T02:11:39.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181cc64640 1 -- 172.21.15.79:0/2753853903 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3324078885 0 0) 0x7f1804003520 con 0x7f181815e4d0 2024-04-25T02:11:39.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181cc64640 1 -- 172.21.15.79:0/2753853903 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18180d2e20 msgr2=0x7f18180cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181cc64640 1 --2- 172.21.15.79:0/2753853903 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18180d2e20 0x7f18180cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181cc64640 1 -- 172.21.15.79:0/2753853903 >> v1:172.21.15.189:6789/0 conn(0x7f18180b3570 legacy=0x7f18180d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181cc64640 1 -- 172.21.15.79:0/2753853903 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18180cede0 con 0x7f181815e4d0 2024-04-25T02:11:39.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181cc64640 1 -- 172.21.15.79:0/2753853903 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f1808001670 con 0x7f181815e4d0 2024-04-25T02:11:39.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181cc64640 1 -- 172.21.15.79:0/2753853903 >> v1:172.21.15.79:6789/0 conn(0x7f181815e4d0 legacy=0x7f181806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181cc64640 1 --2- 172.21.15.79:0/2753853903 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18180d2e20 0x7f18040039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181cc64640 1 --2- 172.21.15.79:0/2753853903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1804003f20 0x7f1804004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181cc64640 1 --2- 172.21.15.79:0/2753853903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1804004d40 0x7f18040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181cc64640 1 -- 172.21.15.79:0/2753853903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f18180d1380 con 0x7f1804004d40 2024-04-25T02:11:39.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181cc64640 1 -- 172.21.15.79:0/2753853903 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f180400ba20 con 0x7f1804003f20 2024-04-25T02:11:39.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181cc64640 1 -- 172.21.15.79:0/2753853903 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f180400bc20 con 0x7f18180d2e20 2024-04-25T02:11:39.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181e467640 1 --2- 172.21.15.79:0/2753853903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1804004d40 0x7f18040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181dc66640 1 --2- 172.21.15.79:0/2753853903 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18180d2e20 0x7f18040039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181d465640 1 --2- 172.21.15.79:0/2753853903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1804003f20 0x7f1804004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181e467640 1 -- 172.21.15.79:0/2753853903 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18180d2e20 msgr2=0x7f18040039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181e467640 1 --2- 172.21.15.79:0/2753853903 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18180d2e20 0x7f18040039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181e467640 1 -- 172.21.15.79:0/2753853903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1804003f20 msgr2=0x7f1804004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181e467640 1 --2- 172.21.15.79:0/2753853903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1804003f20 0x7f1804004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.168+0000 7f181e467640 1 -- 172.21.15.79:0/2753853903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1804003520 con 0x7f1804004d40 2024-04-25T02:11:39.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.169+0000 7f181e467640 1 --2- 172.21.15.79:0/2753853903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1804004d40 0x7f18040051c0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f181808c7d0 tx=0x7f1804005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c20cba829b3dfc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.169+0000 7f181cc64640 1 -- 172.21.15.79:0/2753853903 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1810037070 con 0x7f1804004d40 2024-04-25T02:11:39.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.169+0000 7f181cc64640 1 -- 172.21.15.79:0/2753853903 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1810032600 con 0x7f1804004d40 2024-04-25T02:11:39.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.169+0000 7f181cc64640 1 -- 172.21.15.79:0/2753853903 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1810009c10 con 0x7f1804004d40 2024-04-25T02:11:39.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.170+0000 7f181feca640 1 -- 172.21.15.79:0/2753853903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1804004d40 msgr2=0x7f18040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.170+0000 7f181feca640 1 --2- 172.21.15.79:0/2753853903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1804004d40 0x7f18040051c0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f181808c7d0 tx=0x7f1804005830 comp rx=0 tx=0).stop 2024-04-25T02:11:39.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.170+0000 7f181e467640 1 -- 172.21.15.79:0/2753853903 reap_dead start 2024-04-25T02:11:39.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.170+0000 7f181feca640 1 -- 172.21.15.79:0/2753853903 shutdown_connections 2024-04-25T02:11:39.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.170+0000 7f181feca640 1 -- 172.21.15.79:0/2753853903 >> 172.21.15.79:0/2753853903 conn(0x7f181809d460 msgr2=0x7f18180d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.170+0000 7f181feca640 1 -- 172.21.15.79:0/2753853903 shutdown_connections 2024-04-25T02:11:39.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.170+0000 7f181feca640 1 -- 172.21.15.79:0/2753853903 wait complete. 2024-04-25T02:11:39.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.171+0000 7f181feca640 1 Processor -- start 2024-04-25T02:11:39.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.171+0000 7f181feca640 1 -- start start 2024-04-25T02:11:39.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181feca640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1818159790 0x7f181815fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181feca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181815ffc0 0x7f181809ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181feca640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f181809efd0 0x7f18180cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181feca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f18180d20d0 con 0x7f181815ffc0 2024-04-25T02:11:39.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181feca640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f181815e8b0 con 0x7f1818159790 2024-04-25T02:11:39.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181feca640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f18180d2250 con 0x7f181809efd0 2024-04-25T02:11:39.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181d465640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181815ffc0 0x7f181809ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181d465640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181815ffc0 0x7f181809ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57842/0 (socket says 172.21.15.79:57842) 2024-04-25T02:11:39.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181d465640 1 -- 172.21.15.79:0/784105403 learned_addr learned my addr 172.21.15.79:0/784105403 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:39.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181dc66640 1 --2- 172.21.15.79:0/784105403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1818159790 0x7f181815fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181e467640 1 --2- 172.21.15.79:0/784105403 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f181809efd0 0x7f18180cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181d465640 1 -- 172.21.15.79:0/784105403 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f181809efd0 msgr2=0x7f18180cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181d465640 1 --2- 172.21.15.79:0/784105403 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f181809efd0 0x7f18180cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181d465640 1 -- 172.21.15.79:0/784105403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1818159790 msgr2=0x7f181815fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181d465640 1 --2- 172.21.15.79:0/784105403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1818159790 0x7f181815fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181d465640 1 -- 172.21.15.79:0/784105403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18180cd0e0 con 0x7f181815ffc0 2024-04-25T02:11:39.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181dc66640 1 --2- 172.21.15.79:0/784105403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1818159790 0x7f181815fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:39.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f181d465640 1 --2- 172.21.15.79:0/784105403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181815ffc0 0x7f181809ea90 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f181400f7f0 tx=0x7f181400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f180e7fc640 1 -- 172.21.15.79:0/784105403 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18140052e0 con 0x7f181815ffc0 2024-04-25T02:11:39.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.172+0000 7f180e7fc640 1 -- 172.21.15.79:0/784105403 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1814018070 con 0x7f181815ffc0 2024-04-25T02:11:39.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.173+0000 7f180e7fc640 1 -- 172.21.15.79:0/784105403 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181400d970 con 0x7f181815ffc0 2024-04-25T02:11:39.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.173+0000 7f181feca640 1 -- 172.21.15.79:0/784105403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1818159b70 con 0x7f181815ffc0 2024-04-25T02:11:39.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.173+0000 7f181feca640 1 -- 172.21.15.79:0/784105403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18180cd660 con 0x7f181815ffc0 2024-04-25T02:11:39.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.174+0000 7f181feca640 1 -- 172.21.15.79:0/784105403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18180690a0 con 0x7f181815ffc0 2024-04-25T02:11:39.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.174+0000 7f180e7fc640 1 -- 172.21.15.79:0/784105403 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f181400db10 con 0x7f181815ffc0 2024-04-25T02:11:39.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.174+0000 7f180e7fc640 1 --2- 172.21.15.79:0/784105403 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f17fc06be60 0x7f17fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.174+0000 7f181dc66640 1 --2- 172.21.15.79:0/784105403 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f17fc06be60 0x7f17fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.174+0000 7f180e7fc640 1 -- 172.21.15.79:0/784105403 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f181408ad30 con 0x7f181815ffc0 2024-04-25T02:11:39.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.175+0000 7f181dc66640 1 --2- 172.21.15.79:0/784105403 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f17fc06be60 0x7f17fc06e320 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1808004840 tx=0x7f1808009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.179+0000 7f180e7fc640 1 -- 172.21.15.79:0/784105403 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f181401a310 con 0x7f181815ffc0 2024-04-25T02:11:39.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.392+0000 7f181feca640 1 -- 172.21.15.79:0/784105403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18180d1660 con 0x7f181815ffc0 2024-04-25T02:11:39.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.392+0000 7f180e7fc640 1 -- 172.21.15.79:0/784105403 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5185 (secure 0 0 0) 0x7f1814059770 con 0x7f181815ffc0 2024-04-25T02:11:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:39.400 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5431,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3495029157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3495029157},{"type":"v1","addr":"172.21.15.189:6834","nonce":3495029157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2036557544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2036557544},{"type":"v1","addr":"172.21.15.189:6835","nonce":2036557544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/326759836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":326759836},{"type":"v1","addr":"172.21.15.79:6836","nonce":326759836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:25.684570+0000","modified":"2024-04-25T02:11:14.376645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.79:6837/2253487658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2253487658},{"type":"v1","addr":"172.21.15.79:6837","nonce":2253487658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":4}]} 2024-04-25T02:11:39.401 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 26 2024-04-25T02:11:39.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.394+0000 7f181feca640 1 -- 172.21.15.79:0/784105403 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f17fc06be60 msgr2=0x7f17fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.394+0000 7f181feca640 1 --2- 172.21.15.79:0/784105403 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f17fc06be60 0x7f17fc06e320 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1808004840 tx=0x7f1808009040 comp rx=0 tx=0).stop 2024-04-25T02:11:39.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.394+0000 7f181feca640 1 -- 172.21.15.79:0/784105403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181815ffc0 msgr2=0x7f181809ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.394+0000 7f181feca640 1 --2- 172.21.15.79:0/784105403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181815ffc0 0x7f181809ea90 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f181400f7f0 tx=0x7f181400fcb0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.394+0000 7f181feca640 1 -- 172.21.15.79:0/784105403 shutdown_connections 2024-04-25T02:11:39.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.394+0000 7f181feca640 1 --2- 172.21.15.79:0/784105403 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f17fc06be60 0x7f17fc06e320 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.394+0000 7f181feca640 1 --2- 172.21.15.79:0/784105403 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f181809efd0 0x7f18180cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.394+0000 7f181feca640 1 --2- 172.21.15.79:0/784105403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181815ffc0 0x7f181809ea90 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.394+0000 7f181feca640 1 --2- 172.21.15.79:0/784105403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1818159790 0x7f181815fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.394+0000 7f181feca640 1 -- 172.21.15.79:0/784105403 >> 172.21.15.79:0/784105403 conn(0x7f181809d460 msgr2=0x7f1818161dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.395+0000 7f181feca640 1 -- 172.21.15.79:0/784105403 shutdown_connections 2024-04-25T02:11:39.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.395+0000 7f181feca640 1 -- 172.21.15.79:0/784105403 wait complete. 2024-04-25T02:11:39.413 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T02:11:39.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.503+0000 7f679fa3f640 1 Processor -- start 2024-04-25T02:11:39.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.503+0000 7f679fa3f640 1 -- start start 2024-04-25T02:11:39.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.504+0000 7f679fa3f640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f67980b41b0 0x7f67981605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.504+0000 7f679fa3f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f679806b770 0x7f6798156610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.504+0000 7f679fa3f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6798071cd0 con 0x7f679806b2f0 2024-04-25T02:11:39.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.504+0000 7f679fa3f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6798156b50 con 0x7f679806b770 2024-04-25T02:11:39.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.504+0000 7f679fa3f640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6798071fb0 con 0x7f67980b41b0 2024-04-25T02:11:39.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.504+0000 7f679dfdc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f679806b770 0x7f6798156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.504+0000 7f679cfda640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f679806b2f0 0x7f6798155f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45146/0 (socket says 172.21.15.79:45146) 2024-04-25T02:11:39.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.504+0000 7f679cfda640 1 -- 172.21.15.79:0/2441141290 learned_addr learned my addr 172.21.15.79:0/2441141290 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:39.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.504+0000 7f679d7db640 1 --2- 172.21.15.79:0/2441141290 >> v2:172.21.15.189:3300/0 conn(0x7f67980b41b0 0x7f67981605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.504+0000 7f679dfdc640 1 -- 172.21.15.79:0/2441141290 >> v2:172.21.15.189:3300/0 conn(0x7f67980b41b0 msgr2=0x7f67981605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.504+0000 7f679dfdc640 1 --2- 172.21.15.79:0/2441141290 >> v2:172.21.15.189:3300/0 conn(0x7f67980b41b0 0x7f67981605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.504+0000 7f679dfdc640 1 -- 172.21.15.79:0/2441141290 >> v1:172.21.15.79:6789/0 conn(0x7f679806b2f0 legacy=0x7f6798155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.504+0000 7f678ffff640 1 -- 172.21.15.79:0/2441141290 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 949640797 0 0) 0x7f6798071cd0 con 0x7f679806b2f0 2024-04-25T02:11:39.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.504+0000 7f679dfdc640 1 -- 172.21.15.79:0/2441141290 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6798072290 con 0x7f679806b770 2024-04-25T02:11:39.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.505+0000 7f679dfdc640 1 --2- 172.21.15.79:0/2441141290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806b770 0x7f6798156610 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f67980cdfb0 tx=0x7f679002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f8969b58f08872 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.505+0000 7f678ffff640 1 -- 172.21.15.79:0/2441141290 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790007740 con 0x7f679806b770 2024-04-25T02:11:39.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.505+0000 7f678ffff640 1 -- 172.21.15.79:0/2441141290 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67900078e0 con 0x7f679806b770 2024-04-25T02:11:39.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.505+0000 7f678ffff640 1 -- 172.21.15.79:0/2441141290 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790007cb0 con 0x7f679806b770 2024-04-25T02:11:39.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.506+0000 7f679fa3f640 1 -- 172.21.15.79:0/2441141290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806b770 msgr2=0x7f6798156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.506+0000 7f679fa3f640 1 --2- 172.21.15.79:0/2441141290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806b770 0x7f6798156610 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f67980cdfb0 tx=0x7f679002a680 comp rx=0 tx=0).stop 2024-04-25T02:11:39.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.506+0000 7f679fa3f640 1 -- 172.21.15.79:0/2441141290 shutdown_connections 2024-04-25T02:11:39.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.506+0000 7f679fa3f640 1 --2- 172.21.15.79:0/2441141290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806b770 0x7f6798156610 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.506+0000 7f679fa3f640 1 --2- 172.21.15.79:0/2441141290 >> v2:172.21.15.189:3300/0 conn(0x7f67980b41b0 0x7f67981605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.506+0000 7f679fa3f640 1 -- 172.21.15.79:0/2441141290 >> 172.21.15.79:0/2441141290 conn(0x7f67980b1cd0 msgr2=0x7f67980b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.506+0000 7f679fa3f640 1 -- 172.21.15.79:0/2441141290 shutdown_connections 2024-04-25T02:11:39.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.506+0000 7f679fa3f640 1 -- 172.21.15.79:0/2441141290 wait complete. 2024-04-25T02:11:39.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.507+0000 7f679fa3f640 1 Processor -- start 2024-04-25T02:11:39.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.507+0000 7f679fa3f640 1 -- start start 2024-04-25T02:11:39.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f679fa3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806b2f0 0x7f67981511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f679fa3f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f679806b770 0x7f679815fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f679fa3f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67980b41b0 0x7f679815a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f679fa3f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6798072d70 con 0x7f679806b2f0 2024-04-25T02:11:39.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f679fa3f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6798160b10 con 0x7f679806b770 2024-04-25T02:11:39.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f679fa3f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f679806bb80 con 0x7f67980b41b0 2024-04-25T02:11:39.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f679d7db640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806b2f0 0x7f67981511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f679d7db640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806b2f0 0x7f67981511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57872/0 (socket says 172.21.15.79:57872) 2024-04-25T02:11:39.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f679d7db640 1 -- 172.21.15.79:0/3575156106 learned_addr learned my addr 172.21.15.79:0/3575156106 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:39.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f679d7db640 1 -- 172.21.15.79:0/3575156106 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67980b41b0 msgr2=0x7f679815a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f679d7db640 1 --2- 172.21.15.79:0/3575156106 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67980b41b0 0x7f679815a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f679d7db640 1 -- 172.21.15.79:0/3575156106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f679806b770 msgr2=0x7f679815fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f679d7db640 1 --2- 172.21.15.79:0/3575156106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f679806b770 0x7f679815fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f679d7db640 1 -- 172.21.15.79:0/3575156106 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67981516e0 con 0x7f679806b2f0 2024-04-25T02:11:39.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f679d7db640 1 --2- 172.21.15.79:0/3575156106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806b2f0 0x7f67981511a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f679400d620 tx=0x7f679400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f678dffb640 1 -- 172.21.15.79:0/3575156106 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67940125f0 con 0x7f679806b2f0 2024-04-25T02:11:39.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.508+0000 7f678dffb640 1 -- 172.21.15.79:0/3575156106 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6794019070 con 0x7f679806b2f0 2024-04-25T02:11:39.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.509+0000 7f679fa3f640 1 -- 172.21.15.79:0/3575156106 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6798160500 con 0x7f679806b2f0 2024-04-25T02:11:39.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.509+0000 7f678dffb640 1 -- 172.21.15.79:0/3575156106 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67940129d0 con 0x7f679806b2f0 2024-04-25T02:11:39.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.509+0000 7f679fa3f640 1 -- 172.21.15.79:0/3575156106 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679809c890 con 0x7f679806b2f0 2024-04-25T02:11:39.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.510+0000 7f678dffb640 1 -- 172.21.15.79:0/3575156106 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6794012b70 con 0x7f679806b2f0 2024-04-25T02:11:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.511+0000 7f678dffb640 1 --2- 172.21.15.79:0/3575156106 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f677c06be30 0x7f677c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.511+0000 7f678dffb640 1 -- 172.21.15.79:0/3575156106 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f679408b250 con 0x7f679806b2f0 2024-04-25T02:11:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.511+0000 7f679cfda640 1 --2- 172.21.15.79:0/3575156106 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f677c06be30 0x7f677c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.511+0000 7f679cfda640 1 --2- 172.21.15.79:0/3575156106 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f677c06be30 0x7f677c06e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6788007fd0 tx=0x7f6788007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.512+0000 7f67a282f740 1 Processor -- start 2024-04-25T02:11:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.512+0000 7f67a282f740 1 -- start start 2024-04-25T02:11:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.512+0000 7f67a282f740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2a8330 0x55b16a2abab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.512+0000 7f67a282f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2abff0 0x55b16a2c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.512+0000 7f67a282f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2c8470 0x55b16a2c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.512+0000 7f67a282f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b16a1e4520 con 0x55b16a2c8470 2024-04-25T02:11:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.512+0000 7f67a282f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b16a182ae0 con 0x55b16a2abff0 2024-04-25T02:11:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.512+0000 7f67a282f740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55b16a1e04e0 con 0x55b16a2a8330 2024-04-25T02:11:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.512+0000 7f679dfdc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2c8470 0x55b16a2c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.513+0000 7f679dfdc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2c8470 0x55b16a2c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57880/0 (socket says 172.21.15.79:57880) 2024-04-25T02:11:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.513+0000 7f679dfdc640 1 -- 172.21.15.79:0/1513097328 learned_addr learned my addr 172.21.15.79:0/1513097328 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.513+0000 7f679cfda640 1 --2- 172.21.15.79:0/1513097328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2abff0 0x55b16a2c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.513+0000 7f679d7db640 1 --2- 172.21.15.79:0/1513097328 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2a8330 0x55b16a2abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.513+0000 7f679dfdc640 1 -- 172.21.15.79:0/1513097328 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2a8330 msgr2=0x55b16a2abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.513+0000 7f679dfdc640 1 --2- 172.21.15.79:0/1513097328 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2a8330 0x55b16a2abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.513+0000 7f679dfdc640 1 -- 172.21.15.79:0/1513097328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2abff0 msgr2=0x55b16a2c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.513+0000 7f679dfdc640 1 --2- 172.21.15.79:0/1513097328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2abff0 0x55b16a2c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.513+0000 7f679dfdc640 1 -- 172.21.15.79:0/1513097328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b16a1a8240 con 0x55b16a2c8470 2024-04-25T02:11:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.513+0000 7f679cfda640 1 --2- 172.21.15.79:0/1513097328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2abff0 0x55b16a2c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.513+0000 7f679dfdc640 1 --2- 172.21.15.79:0/1513097328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2c8470 0x55b16a2c88d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6790009e50 tx=0x7f679002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274f3e6c69da3c7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.513+0000 7f6782ffd640 1 -- 172.21.15.79:0/1513097328 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790040070 con 0x55b16a2c8470 2024-04-25T02:11:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.513+0000 7f6782ffd640 1 -- 172.21.15.79:0/1513097328 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6790007740 con 0x55b16a2c8470 2024-04-25T02:11:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.513+0000 7f6782ffd640 1 -- 172.21.15.79:0/1513097328 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790007b30 con 0x55b16a2c8470 2024-04-25T02:11:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.514+0000 7f67a282f740 1 -- 172.21.15.79:0/1513097328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2c8470 msgr2=0x55b16a2c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.514+0000 7f67a282f740 1 --2- 172.21.15.79:0/1513097328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2c8470 0x55b16a2c88d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6790009e50 tx=0x7f679002c000 comp rx=0 tx=0).stop 2024-04-25T02:11:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.514+0000 7f67a282f740 1 -- 172.21.15.79:0/1513097328 shutdown_connections 2024-04-25T02:11:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.514+0000 7f67a282f740 1 --2- 172.21.15.79:0/1513097328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2c8470 0x55b16a2c88d0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.514+0000 7f67a282f740 1 --2- 172.21.15.79:0/1513097328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2abff0 0x55b16a2c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.514+0000 7f67a282f740 1 --2- 172.21.15.79:0/1513097328 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2a8330 0x55b16a2abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.514+0000 7f67a282f740 1 -- 172.21.15.79:0/1513097328 >> 172.21.15.79:0/1513097328 conn(0x55b16a27e310 msgr2=0x55b16a27f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.514+0000 7f67a282f740 1 -- 172.21.15.79:0/1513097328 shutdown_connections 2024-04-25T02:11:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.514+0000 7f67a282f740 1 -- 172.21.15.79:0/1513097328 wait complete. 2024-04-25T02:11:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.514+0000 7f67a282f740 1 -- start start 2024-04-25T02:11:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.514+0000 7f67a282f740 1 Processor -- start 2024-04-25T02:11:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.515+0000 7f67a282f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2abff0 0x55b16a2c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.515+0000 7f67a282f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2c8470 0x55b16a2c1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.515+0000 7f67a282f740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c15b0 0x55b16a2963e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.515+0000 7f67a282f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b16a27c140 con 0x55b16a2abff0 2024-04-25T02:11:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.515+0000 7f67a282f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b16a180470 con 0x55b16a2c8470 2024-04-25T02:11:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.515+0000 7f67a282f740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55b16a27c420 con 0x55b16a2c15b0 2024-04-25T02:11:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.515+0000 7f67a282f740 10 client.0 _ll_register_callbacks cb 0x55b16a1a4dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.516+0000 7f679d7db640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2abff0 0x55b16a2c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.516+0000 7f679d7db640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2abff0 0x55b16a2c30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57894/0 (socket says 172.21.15.79:57894) 2024-04-25T02:11:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.516+0000 7f679d7db640 1 -- 172.21.15.79:0/2529073162 learned_addr learned my addr 172.21.15.79:0/2529073162 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.516+0000 7f679cfda640 1 --2- 172.21.15.79:0/2529073162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2c8470 0x55b16a2c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.516+0000 7f679dfdc640 1 --2- 172.21.15.79:0/2529073162 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c15b0 0x55b16a2963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.516+0000 7f679d7db640 1 -- 172.21.15.79:0/2529073162 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c15b0 msgr2=0x55b16a2963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.516+0000 7f679d7db640 1 --2- 172.21.15.79:0/2529073162 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c15b0 0x55b16a2963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.516+0000 7f679d7db640 1 -- 172.21.15.79:0/2529073162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2c8470 msgr2=0x55b16a2c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.516+0000 7f679d7db640 1 --2- 172.21.15.79:0/2529073162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2c8470 0x55b16a2c1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.516+0000 7f679d7db640 1 -- 172.21.15.79:0/2529073162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b16a197bf0 con 0x55b16a2abff0 2024-04-25T02:11:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.516+0000 7f679cfda640 1 --2- 172.21.15.79:0/2529073162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2c8470 0x55b16a2c1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.516+0000 7f679d7db640 1 --2- 172.21.15.79:0/2529073162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2abff0 0x55b16a2c30f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f67940897a0 tx=0x7f6794059c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2fd132f7dfc4324 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.516+0000 7f6777fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:11:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.517+0000 7f6777fff640 1 -- 172.21.15.79:0/2529073162 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794071020 con 0x55b16a2abff0 2024-04-25T02:11:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.517+0000 7f6777fff640 1 -- 172.21.15.79:0/2529073162 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f6794055b70 con 0x55b16a2abff0 2024-04-25T02:11:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.517+0000 7f67a282f740 1 -- 172.21.15.79:0/2529073162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6790007740 con 0x55b16a2abff0 2024-04-25T02:11:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.517+0000 7f6777fff640 1 -- 172.21.15.79:0/2529073162 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6794076050 con 0x55b16a2abff0 2024-04-25T02:11:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.517+0000 7f67a282f740 10 client.6486 fetch_fsmap learned FSMap version 26 2024-04-25T02:11:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.517+0000 7f67a282f740 1 -- 172.21.15.79:0/2529073162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55b169fc47c0 con 0x55b16a2abff0 2024-04-25T02:11:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.517+0000 7f6777fff640 1 -- 172.21.15.79:0/2529073162 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6790007740 con 0x55b16a2abff0 2024-04-25T02:11:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.517+0000 7f6777fff640 1 -- 172.21.15.79:0/2529073162 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f6794013070 con 0x55b16a2abff0 2024-04-25T02:11:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.517+0000 7f67a282f740 10 client.6486 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:11:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.517+0000 7f67a282f740 10 client.6486 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:11:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.517+0000 7f67a282f740 20 client.6486 populate_metadata read hostname 'smithi079' 2024-04-25T02:11:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.517+0000 7f67a282f740 1 --2- 172.21.15.79:0/2529073162 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55b16a2ae7a0 0x55b16a2e5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.517+0000 7f67a282f740 4 client.6486 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.517+0000 7f67a282f740 1 -- 172.21.15.79:0/2529073162 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b16a1f7d50 con 0x55b16a2ae7a0 2024-04-25T02:11:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.517+0000 7f679cfda640 1 --2- 172.21.15.79:0/2529073162 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55b16a2ae7a0 0x55b16a2e5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.518+0000 7f6777fff640 10 client.6486 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.518+0000 7f679cfda640 1 --2- 172.21.15.79:0/2529073162 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55b16a2ae7a0 0x55b16a2e5610 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db2f2e8e0079905d server_cookie=770cb3b969a5a27b in_seq=0 out_seq=0 2024-04-25T02:11:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.518+0000 7f6777fff640 1 -- 172.21.15.79:0/2529073162 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b16a1f7d50 con 0x55b16a2ae7a0 2024-04-25T02:11:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.518+0000 7f6777fff640 10 client.6486 handle_command_reply: tid=0 2024-04-25T02:11:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.518+0000 7f67a282f740 1 client.6486 shutdown 2024-04-25T02:11:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.519+0000 7f67a282f740 1 -- 172.21.15.79:0/2529073162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2abff0 msgr2=0x55b16a2c30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.519+0000 7f67a282f740 1 --2- 172.21.15.79:0/2529073162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2abff0 0x55b16a2c30f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f67940897a0 tx=0x7f6794059c00 comp rx=0 tx=0).stop 2024-04-25T02:11:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.519+0000 7f67a282f740 1 -- 172.21.15.79:0/2529073162 shutdown_connections 2024-04-25T02:11:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.519+0000 7f67a282f740 1 --2- 172.21.15.79:0/2529073162 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55b16a2ae7a0 0x55b16a2e5610 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.519+0000 7f67a282f740 1 --2- 172.21.15.79:0/2529073162 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c15b0 0x55b16a2963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.519+0000 7f6777fff640 0 client.6486 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.519+0000 7f67a282f740 1 --2- 172.21.15.79:0/2529073162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2c8470 0x55b16a2c1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.519+0000 7f67a282f740 1 --2- 172.21.15.79:0/2529073162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2abff0 0x55b16a2c30f0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.519+0000 7f67a282f740 1 -- 172.21.15.79:0/2529073162 >> 172.21.15.79:0/2529073162 conn(0x55b16a2a8330 msgr2=0x55b16a2c0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.519+0000 7f67a282f740 1 -- 172.21.15.79:0/2529073162 shutdown_connections 2024-04-25T02:11:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.519+0000 7f67a282f740 1 -- 172.21.15.79:0/2529073162 wait complete. 2024-04-25T02:11:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.519+0000 7f67a282f740 20 client.6486 trim_cache size 0 max 16384 2024-04-25T02:11:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.532+0000 7f67a282f740 1 Processor -- start 2024-04-25T02:11:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.532+0000 7f67a282f740 1 -- start start 2024-04-25T02:11:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f67a282f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2abff0 0x55b16a282b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f67a282f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2c15b0 0x55b16a27d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f67a282f740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c8470 0x55b16a27d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f67a282f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f67981fb110 con 0x55b16a2c15b0 2024-04-25T02:11:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f67a282f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67981fa550 con 0x55b16a2abff0 2024-04-25T02:11:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f67a282f740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f67981faaf0 con 0x55b16a2c8470 2024-04-25T02:11:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f679cfda640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2c15b0 0x55b16a27d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f679cfda640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2c15b0 0x55b16a27d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57908/0 (socket says 172.21.15.79:57908) 2024-04-25T02:11:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f679cfda640 1 -- 172.21.15.79:0/201308622 learned_addr learned my addr 172.21.15.79:0/201308622 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f679d7db640 1 --2- 172.21.15.79:0/201308622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2abff0 0x55b16a282b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f679dfdc640 1 --2- 172.21.15.79:0/201308622 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c8470 0x55b16a27d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f679cfda640 1 -- 172.21.15.79:0/201308622 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c8470 msgr2=0x55b16a27d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f679cfda640 1 --2- 172.21.15.79:0/201308622 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c8470 0x55b16a27d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f679cfda640 1 -- 172.21.15.79:0/201308622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2abff0 msgr2=0x55b16a282b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f679cfda640 1 --2- 172.21.15.79:0/201308622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2abff0 0x55b16a282b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f679cfda640 1 -- 172.21.15.79:0/201308622 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b16a2c3460 con 0x55b16a2c15b0 2024-04-25T02:11:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f679dfdc640 1 --2- 172.21.15.79:0/201308622 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c8470 0x55b16a27d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f679cfda640 1 --2- 172.21.15.79:0/201308622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2c15b0 0x55b16a27d040 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6788001400 tx=0x7f678800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f59fdae9d0a1da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f67827fc640 1 -- 172.21.15.79:0/201308622 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788024230 con 0x55b16a2c15b0 2024-04-25T02:11:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f67827fc640 1 -- 172.21.15.79:0/201308622 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67880243d0 con 0x55b16a2c15b0 2024-04-25T02:11:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.533+0000 7f67827fc640 1 -- 172.21.15.79:0/201308622 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67880247a0 con 0x55b16a2c15b0 2024-04-25T02:11:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.534+0000 7f67a282f740 1 -- 172.21.15.79:0/201308622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2c15b0 msgr2=0x55b16a27d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.534+0000 7f67a282f740 1 --2- 172.21.15.79:0/201308622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2c15b0 0x55b16a27d040 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6788001400 tx=0x7f678800f000 comp rx=0 tx=0).stop 2024-04-25T02:11:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.534+0000 7f67a282f740 1 -- 172.21.15.79:0/201308622 shutdown_connections 2024-04-25T02:11:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.534+0000 7f67a282f740 1 --2- 172.21.15.79:0/201308622 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c8470 0x55b16a27d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.534+0000 7f67a282f740 1 --2- 172.21.15.79:0/201308622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2c15b0 0x55b16a27d040 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.534+0000 7f67a282f740 1 --2- 172.21.15.79:0/201308622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2abff0 0x55b16a282b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.534+0000 7f67a282f740 1 -- 172.21.15.79:0/201308622 >> 172.21.15.79:0/201308622 conn(0x55b16a2a8330 msgr2=0x55b16a2772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.534+0000 7f67a282f740 1 -- 172.21.15.79:0/201308622 shutdown_connections 2024-04-25T02:11:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.534+0000 7f67a282f740 1 -- 172.21.15.79:0/201308622 wait complete. 2024-04-25T02:11:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.534+0000 7f67a282f740 1 -- start start 2024-04-25T02:11:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.535+0000 7f67a282f740 1 Processor -- start 2024-04-25T02:11:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.535+0000 7f67a282f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2abff0 0x55b16a2a3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.535+0000 7f67a282f740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c15b0 0x55b16a281610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.535+0000 7f67a282f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2c8470 0x55b16a281b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.535+0000 7f67a282f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b16a2ae620 con 0x55b16a2abff0 2024-04-25T02:11:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.535+0000 7f67a282f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b16a2ae180 con 0x55b16a2c8470 2024-04-25T02:11:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.535+0000 7f67a282f740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55b16a2aebb0 con 0x55b16a2c15b0 2024-04-25T02:11:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.535+0000 7f67a282f740 10 client.0 _ll_register_callbacks cb 0x7f67940557a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f679d7db640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2abff0 0x55b16a2a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f679d7db640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2abff0 0x55b16a2a3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57910/0 (socket says 172.21.15.79:57910) 2024-04-25T02:11:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f679d7db640 1 -- 172.21.15.79:0/4031736044 learned_addr learned my addr 172.21.15.79:0/4031736044 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f679cfda640 1 --2- 172.21.15.79:0/4031736044 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c15b0 0x55b16a281610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f679dfdc640 1 --2- 172.21.15.79:0/4031736044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2c8470 0x55b16a281b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f679d7db640 1 -- 172.21.15.79:0/4031736044 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c15b0 msgr2=0x55b16a281610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f679d7db640 1 --2- 172.21.15.79:0/4031736044 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c15b0 0x55b16a281610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f679d7db640 1 -- 172.21.15.79:0/4031736044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2c8470 msgr2=0x55b16a281b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f679d7db640 1 --2- 172.21.15.79:0/4031736044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2c8470 0x55b16a281b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f679d7db640 1 -- 172.21.15.79:0/4031736044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b16a024f50 con 0x55b16a2abff0 2024-04-25T02:11:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f679d7db640 1 --2- 172.21.15.79:0/4031736044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2abff0 0x55b16a2a3ae0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6794055de0 tx=0x7f6794089650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77f5eafb848384a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f6777fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:11:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f6777fff640 1 -- 172.21.15.79:0/4031736044 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794071050 con 0x55b16a2abff0 2024-04-25T02:11:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f6777fff640 1 -- 172.21.15.79:0/4031736044 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f6794089370 con 0x55b16a2abff0 2024-04-25T02:11:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f67a282f740 1 -- 172.21.15.79:0/4031736044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67880243d0 con 0x55b16a2abff0 2024-04-25T02:11:39.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f6777fff640 1 -- 172.21.15.79:0/4031736044 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6794058e60 con 0x55b16a2abff0 2024-04-25T02:11:39.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f67a282f740 10 client.6492 fetch_fsmap learned FSMap version 26 2024-04-25T02:11:39.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f67a282f740 1 -- 172.21.15.79:0/4031736044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55b169eb80b0 con 0x55b16a2abff0 2024-04-25T02:11:39.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f6777fff640 1 -- 172.21.15.79:0/4031736044 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67880243d0 con 0x55b16a2abff0 2024-04-25T02:11:39.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f6777fff640 1 -- 172.21.15.79:0/4031736044 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f67940782e0 con 0x55b16a2abff0 2024-04-25T02:11:39.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f67a282f740 10 client.6492 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:11:39.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f67a282f740 10 client.6492 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:11:39.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f67a282f740 20 client.6492 populate_metadata read hostname 'smithi079' 2024-04-25T02:11:39.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f67a282f740 1 --2- 172.21.15.79:0/4031736044 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55b16a341520 0x55b16a2a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f67a282f740 4 client.6492 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T02:11:39.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.536+0000 7f67a282f740 1 -- 172.21.15.79:0/4031736044 --> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55b16a1f1a60 con 0x55b16a341520 2024-04-25T02:11:39.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f679cfda640 1 --2- 172.21.15.79:0/4031736044 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55b16a341520 0x55b16a2a6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f6777fff640 10 client.6492 ms_handle_connect on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:39.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f679cfda640 1 --2- 172.21.15.79:0/4031736044 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55b16a341520 0x55b16a2a6da0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33534d43f69ed99a server_cookie=7df0614e694cacc in_seq=0 out_seq=0 2024-04-25T02:11:39.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f6777fff640 1 -- 172.21.15.79:0/4031736044 <== mds.0 v2:172.21.15.79:6835/2253487658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b16a1f1a60 con 0x55b16a341520 2024-04-25T02:11:39.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f6777fff640 10 client.6492 handle_command_reply: tid=0 2024-04-25T02:11:39.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f67a282f740 1 client.6492 shutdown 2024-04-25T02:11:39.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f67a282f740 1 -- 172.21.15.79:0/4031736044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2abff0 msgr2=0x55b16a2a3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f67a282f740 1 --2- 172.21.15.79:0/4031736044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2abff0 0x55b16a2a3ae0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6794055de0 tx=0x7f6794089650 comp rx=0 tx=0).stop 2024-04-25T02:11:39.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f67a282f740 1 -- 172.21.15.79:0/4031736044 shutdown_connections 2024-04-25T02:11:39.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f67a282f740 1 --2- 172.21.15.79:0/4031736044 >> [v2:172.21.15.79:6835/2253487658,v1:172.21.15.79:6837/2253487658] conn(0x55b16a341520 0x55b16a2a6da0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f67a282f740 1 --2- 172.21.15.79:0/4031736044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b16a2c8470 0x55b16a281b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f67a282f740 1 --2- 172.21.15.79:0/4031736044 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b16a2c15b0 0x55b16a281610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f6777fff640 0 client.6492 ms_handle_reset on v2:172.21.15.79:6835/2253487658 2024-04-25T02:11:39.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f67a282f740 1 --2- 172.21.15.79:0/4031736044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b16a2abff0 0x55b16a2a3ae0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f67a282f740 1 -- 172.21.15.79:0/4031736044 >> 172.21.15.79:0/4031736044 conn(0x55b16a2a8330 msgr2=0x55b16a2ac3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f67a282f740 1 -- 172.21.15.79:0/4031736044 shutdown_connections 2024-04-25T02:11:39.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f67a282f740 1 -- 172.21.15.79:0/4031736044 wait complete. 2024-04-25T02:11:39.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.537+0000 7f67a282f740 20 client.6492 trim_cache size 0 max 16384 2024-04-25T02:11:39.552 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:39.552 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-04-25T02:11:39.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.538+0000 7f679fa3f640 1 -- 172.21.15.79:0/3575156106 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f677c06be30 msgr2=0x7f677c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.538+0000 7f679fa3f640 1 --2- 172.21.15.79:0/3575156106 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f677c06be30 0x7f677c06e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6788007fd0 tx=0x7f6788007900 comp rx=0 tx=0).stop 2024-04-25T02:11:39.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.538+0000 7f679fa3f640 1 -- 172.21.15.79:0/3575156106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806b2f0 msgr2=0x7f67981511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.538+0000 7f679fa3f640 1 --2- 172.21.15.79:0/3575156106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806b2f0 0x7f67981511a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f679400d620 tx=0x7f679400dae0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.538+0000 7f679fa3f640 1 -- 172.21.15.79:0/3575156106 shutdown_connections 2024-04-25T02:11:39.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.538+0000 7f679fa3f640 1 --2- 172.21.15.79:0/3575156106 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f677c06be30 0x7f677c06e2f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.538+0000 7f679fa3f640 1 --2- 172.21.15.79:0/3575156106 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67980b41b0 0x7f679815a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.538+0000 7f679fa3f640 1 --2- 172.21.15.79:0/3575156106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f679806b770 0x7f679815fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.538+0000 7f679fa3f640 1 --2- 172.21.15.79:0/3575156106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806b2f0 0x7f67981511a0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.538+0000 7f679fa3f640 1 -- 172.21.15.79:0/3575156106 >> 172.21.15.79:0/3575156106 conn(0x7f67980b1cd0 msgr2=0x7f679806e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.538+0000 7f679fa3f640 1 -- 172.21.15.79:0/3575156106 shutdown_connections 2024-04-25T02:11:39.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.538+0000 7f679fa3f640 1 -- 172.21.15.79:0/3575156106 wait complete. 2024-04-25T02:11:39.556 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T02:11:39.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.644+0000 7ff300abc640 1 Processor -- start 2024-04-25T02:11:39.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.644+0000 7ff300abc640 1 -- start start 2024-04-25T02:11:39.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.645+0000 7ff300abc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2fc15a700 0x7ff2fc06e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.645+0000 7ff300abc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2fc0b2c50 con 0x7ff2fc070ca0 2024-04-25T02:11:39.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.645+0000 7ff300abc640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2fc0b2f10 con 0x7ff2fc071dc0 2024-04-25T02:11:39.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.645+0000 7ff300abc640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff2fc06e850 con 0x7ff2fc15a700 2024-04-25T02:11:39.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.645+0000 7ff2fa59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2fc15a700 0x7ff2fc06e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.645+0000 7ff2f3fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff2fc070ca0 0x7ff2fc0716b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45156/0 (socket says 172.21.15.79:45156) 2024-04-25T02:11:39.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.645+0000 7ff2f3fff640 1 -- 172.21.15.79:0/2523542716 learned_addr learned my addr 172.21.15.79:0/2523542716 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:39.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.645+0000 7ff2fa59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2fc15a700 0x7ff2fc06e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57916/0 (socket says 172.21.15.79:57916) 2024-04-25T02:11:39.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.645+0000 7ff2fa59c640 1 -- 172.21.15.79:0/2523542716 >> v1:172.21.15.189:6789/0 conn(0x7ff2fc071dc0 legacy=0x7ff2fc0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.645+0000 7ff2fa59c640 1 -- 172.21.15.79:0/2523542716 >> v1:172.21.15.79:6789/0 conn(0x7ff2fc070ca0 legacy=0x7ff2fc0716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.645+0000 7ff2fa59c640 1 -- 172.21.15.79:0/2523542716 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2fc0b31f0 con 0x7ff2fc15a700 2024-04-25T02:11:39.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.645+0000 7ff2f9d9b640 1 -- 172.21.15.79:0/2523542716 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 427294399 0 0) 0x7ff2fc0b2c50 con 0x7ff2fc070ca0 2024-04-25T02:11:39.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.646+0000 7ff2fa59c640 1 --2- 172.21.15.79:0/2523542716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2fc15a700 0x7ff2fc06e310 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0097a0 tx=0x7ff2ec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9d920fe74ddb69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.646+0000 7ff2f9d9b640 1 -- 172.21.15.79:0/2523542716 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec037070 con 0x7ff2fc15a700 2024-04-25T02:11:39.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.646+0000 7ff2f9d9b640 1 -- 172.21.15.79:0/2523542716 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2ec032440 con 0x7ff2fc15a700 2024-04-25T02:11:39.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.646+0000 7ff2f9d9b640 1 -- 172.21.15.79:0/2523542716 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec032810 con 0x7ff2fc15a700 2024-04-25T02:11:39.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.647+0000 7ff300abc640 1 -- 172.21.15.79:0/2523542716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2fc15a700 msgr2=0x7ff2fc06e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.647+0000 7ff300abc640 1 --2- 172.21.15.79:0/2523542716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2fc15a700 0x7ff2fc06e310 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0097a0 tx=0x7ff2ec02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.647+0000 7ff300abc640 1 -- 172.21.15.79:0/2523542716 shutdown_connections 2024-04-25T02:11:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.647+0000 7ff300abc640 1 --2- 172.21.15.79:0/2523542716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2fc15a700 0x7ff2fc06e310 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.647+0000 7ff300abc640 1 -- 172.21.15.79:0/2523542716 >> 172.21.15.79:0/2523542716 conn(0x7ff2fc0cfc80 msgr2=0x7ff2fc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.647+0000 7ff300abc640 1 -- 172.21.15.79:0/2523542716 shutdown_connections 2024-04-25T02:11:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.647+0000 7ff300abc640 1 -- 172.21.15.79:0/2523542716 wait complete. 2024-04-25T02:11:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.648+0000 7ff300abc640 1 Processor -- start 2024-04-25T02:11:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.648+0000 7ff300abc640 1 -- start start 2024-04-25T02:11:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.649+0000 7ff300abc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2fc070ca0 0x7ff2fc1f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.649+0000 7ff300abc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2fc071dc0 0x7ff2fc0cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.649+0000 7ff300abc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2fc15a700 0x7ff2fc0b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.649+0000 7ff300abc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc0cca90 con 0x7ff2fc071dc0 2024-04-25T02:11:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.649+0000 7ff300abc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc06ea80 con 0x7ff2fc070ca0 2024-04-25T02:11:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.649+0000 7ff300abc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff2fc0b4100 con 0x7ff2fc15a700 2024-04-25T02:11:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.649+0000 7ff2f3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2fc071dc0 0x7ff2fc0cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.649+0000 7ff2f3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2fc071dc0 0x7ff2fc0cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57930/0 (socket says 172.21.15.79:57930) 2024-04-25T02:11:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.649+0000 7ff2f3fff640 1 -- 172.21.15.79:0/3188795444 learned_addr learned my addr 172.21.15.79:0/3188795444 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.649+0000 7ff2f3fff640 1 -- 172.21.15.79:0/3188795444 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2fc15a700 msgr2=0x7ff2fc0b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.649+0000 7ff2f3fff640 1 --2- 172.21.15.79:0/3188795444 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2fc15a700 0x7ff2fc0b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.649+0000 7ff2f3fff640 1 -- 172.21.15.79:0/3188795444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2fc070ca0 msgr2=0x7ff2fc1f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.649+0000 7ff2f3fff640 1 --2- 172.21.15.79:0/3188795444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2fc070ca0 0x7ff2fc1f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.649+0000 7ff2f3fff640 1 -- 172.21.15.79:0/3188795444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2fc0aad90 con 0x7ff2fc071dc0 2024-04-25T02:11:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.649+0000 7ff2f3fff640 1 --2- 172.21.15.79:0/3188795444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2fc071dc0 0x7ff2fc0cd160 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400c4d0 tx=0x7ff2e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.650+0000 7ff2f2ffd640 1 -- 172.21.15.79:0/3188795444 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4018070 con 0x7ff2fc071dc0 2024-04-25T02:11:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.650+0000 7ff2f2ffd640 1 -- 172.21.15.79:0/3188795444 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e4007500 con 0x7ff2fc071dc0 2024-04-25T02:11:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.650+0000 7ff300abc640 1 -- 172.21.15.79:0/3188795444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2fc0ca4a0 con 0x7ff2fc071dc0 2024-04-25T02:11:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.650+0000 7ff2f2ffd640 1 -- 172.21.15.79:0/3188795444 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4004a20 con 0x7ff2fc071dc0 2024-04-25T02:11:39.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.650+0000 7ff300abc640 1 -- 172.21.15.79:0/3188795444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2fc0caa60 con 0x7ff2fc071dc0 2024-04-25T02:11:39.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.651+0000 7ff300abc640 1 -- 172.21.15.79:0/3188795444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2fc0cac60 con 0x7ff2fc071dc0 2024-04-25T02:11:39.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.651+0000 7ff2f2ffd640 1 -- 172.21.15.79:0/3188795444 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2e401b070 con 0x7ff2fc071dc0 2024-04-25T02:11:39.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.652+0000 7ff2f2ffd640 1 --2- 172.21.15.79:0/3188795444 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2dc06be30 0x7ff2dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.652+0000 7ff2f2ffd640 1 -- 172.21.15.79:0/3188795444 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7ff2e408a1e0 con 0x7ff2fc071dc0 2024-04-25T02:11:39.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.652+0000 7ff2fa59c640 1 --2- 172.21.15.79:0/3188795444 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2dc06be30 0x7ff2dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.652+0000 7ff2fa59c640 1 --2- 172.21.15.79:0/3188795444 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2dc06be30 0x7ff2dc06e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec034000 tx=0x7ff2ec02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.656+0000 7ff2f2ffd640 1 -- 172.21.15.79:0/3188795444 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff2fc0cac60 con 0x7ff2fc071dc0 2024-04-25T02:11:39.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.863+0000 7ff300abc640 1 -- 172.21.15.79:0/3188795444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff2fc06e0f0 con 0x7ff2fc071dc0 2024-04-25T02:11:39.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.863+0000 7ff2f2ffd640 1 -- 172.21.15.79:0/3188795444 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff2e4058b90 con 0x7ff2fc071dc0 2024-04-25T02:11:39.871 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:39.871 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T02:11:39.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.865+0000 7ff300abc640 1 -- 172.21.15.79:0/3188795444 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2dc06be30 msgr2=0x7ff2dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.865+0000 7ff300abc640 1 --2- 172.21.15.79:0/3188795444 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2dc06be30 0x7ff2dc06e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec034000 tx=0x7ff2ec02c000 comp rx=0 tx=0).stop 2024-04-25T02:11:39.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.865+0000 7ff300abc640 1 -- 172.21.15.79:0/3188795444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2fc071dc0 msgr2=0x7ff2fc0cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.865+0000 7ff300abc640 1 --2- 172.21.15.79:0/3188795444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2fc071dc0 0x7ff2fc0cd160 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400c4d0 tx=0x7ff2e400c990 comp rx=0 tx=0).stop 2024-04-25T02:11:39.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.865+0000 7ff300abc640 1 -- 172.21.15.79:0/3188795444 shutdown_connections 2024-04-25T02:11:39.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.865+0000 7ff300abc640 1 --2- 172.21.15.79:0/3188795444 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2dc06be30 0x7ff2dc06e2f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.865+0000 7ff300abc640 1 --2- 172.21.15.79:0/3188795444 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2fc15a700 0x7ff2fc0b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.865+0000 7ff300abc640 1 --2- 172.21.15.79:0/3188795444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2fc071dc0 0x7ff2fc0cd160 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.865+0000 7ff300abc640 1 --2- 172.21.15.79:0/3188795444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2fc070ca0 0x7ff2fc1f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.865+0000 7ff300abc640 1 -- 172.21.15.79:0/3188795444 >> 172.21.15.79:0/3188795444 conn(0x7ff2fc0cfc80 msgr2=0x7ff2fc0ce020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.865+0000 7ff300abc640 1 -- 172.21.15.79:0/3188795444 shutdown_connections 2024-04-25T02:11:39.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:39.865+0000 7ff300abc640 1 -- 172.21.15.79:0/3188795444 wait complete. 2024-04-25T02:11:39.883 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T02:11:39.884 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:11:39.884 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:11:39.927 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:11:39.973 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:11:39.973 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:11:39.973 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:11:39.974 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:11:39.989 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:11:39.989 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:11:40.044 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:11:40.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.174+0000 7f652a07b640 1 Processor -- start 2024-04-25T02:11:40.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.174+0000 7f652a07b640 1 -- start start 2024-04-25T02:11:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.174+0000 7f652a07b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f652415e4d0 0x7f652406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.174+0000 7f652a07b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65240b3570 0x7f65240d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.174+0000 7f652a07b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65240d1660 con 0x7f65240b3020 2024-04-25T02:11:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.174+0000 7f652a07b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f65240d1380 con 0x7f65240b3570 2024-04-25T02:11:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.174+0000 7f652a07b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f65240cede0 con 0x7f652415e4d0 2024-04-25T02:11:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.175+0000 7f6522ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65240b3570 0x7f65240d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.175+0000 7f6522ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65240b3570 0x7f65240d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57940/0 (socket says 172.21.15.79:57940) 2024-04-25T02:11:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.175+0000 7f6522ffd640 1 -- 172.21.15.79:0/3539451765 learned_addr learned my addr 172.21.15.79:0/3539451765 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.175+0000 7f6523fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f65240b3020 0x7f65240cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45170/0 (socket says 172.21.15.79:45170) 2024-04-25T02:11:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.175+0000 7f65237fe640 1 --2- 172.21.15.79:0/3539451765 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f652415e4d0 0x7f652406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.175+0000 7f6522ffd640 1 -- 172.21.15.79:0/3539451765 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f652415e4d0 msgr2=0x7f652406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.175+0000 7f6522ffd640 1 --2- 172.21.15.79:0/3539451765 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f652415e4d0 0x7f652406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.175+0000 7f6522ffd640 1 -- 172.21.15.79:0/3539451765 >> v1:172.21.15.79:6789/0 conn(0x7f65240b3020 legacy=0x7f65240cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.175+0000 7f65227fc640 1 -- 172.21.15.79:0/3539451765 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3633672941 0 0) 0x7f65240d1660 con 0x7f65240b3020 2024-04-25T02:11:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.175+0000 7f6522ffd640 1 -- 172.21.15.79:0/3539451765 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65240cf0c0 con 0x7f65240b3570 2024-04-25T02:11:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.175+0000 7f65237fe640 1 --2- 172.21.15.79:0/3539451765 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f652415e4d0 0x7f652406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.176+0000 7f6522ffd640 1 --2- 172.21.15.79:0/3539451765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65240b3570 0x7f65240d2710 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6518009870 tx=0x7f651802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2dc8be30f585d46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.176+0000 7f65227fc640 1 -- 172.21.15.79:0/3539451765 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518037070 con 0x7f65240b3570 2024-04-25T02:11:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.176+0000 7f65227fc640 1 -- 172.21.15.79:0/3539451765 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6518032440 con 0x7f65240b3570 2024-04-25T02:11:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.176+0000 7f65227fc640 1 -- 172.21.15.79:0/3539451765 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518032810 con 0x7f65240b3570 2024-04-25T02:11:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.176+0000 7f652a07b640 1 -- 172.21.15.79:0/3539451765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65240b3570 msgr2=0x7f65240d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.176+0000 7f652a07b640 1 --2- 172.21.15.79:0/3539451765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65240b3570 0x7f65240d2710 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6518009870 tx=0x7f651802a270 comp rx=0 tx=0).stop 2024-04-25T02:11:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.176+0000 7f652a07b640 1 -- 172.21.15.79:0/3539451765 shutdown_connections 2024-04-25T02:11:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.176+0000 7f652a07b640 1 --2- 172.21.15.79:0/3539451765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65240b3570 0x7f65240d2710 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.176+0000 7f652a07b640 1 --2- 172.21.15.79:0/3539451765 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f652415e4d0 0x7f652406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.176+0000 7f652a07b640 1 -- 172.21.15.79:0/3539451765 >> 172.21.15.79:0/3539451765 conn(0x7f652409d460 msgr2=0x7f65240d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.176+0000 7f652a07b640 1 -- 172.21.15.79:0/3539451765 shutdown_connections 2024-04-25T02:11:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.176+0000 7f652a07b640 1 -- 172.21.15.79:0/3539451765 wait complete. 2024-04-25T02:11:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.177+0000 7f652a07b640 1 Processor -- start 2024-04-25T02:11:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.178+0000 7f652a07b640 1 -- start start 2024-04-25T02:11:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.178+0000 7f652a07b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65240b3020 0x7f65240b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.178+0000 7f652a07b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f65240b3570 0x7f65241594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.178+0000 7f652a07b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f652415e4d0 0x7f652415fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.178+0000 7f652a07b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f65240d2250 con 0x7f65240b3020 2024-04-25T02:11:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.178+0000 7f652a07b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f65240d20d0 con 0x7f652415e4d0 2024-04-25T02:11:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.178+0000 7f652a07b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f652406c1b0 con 0x7f65240b3570 2024-04-25T02:11:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.178+0000 7f65237fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65240b3020 0x7f65240b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.178+0000 7f65237fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65240b3020 0x7f65240b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57942/0 (socket says 172.21.15.79:57942) 2024-04-25T02:11:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.178+0000 7f65237fe640 1 -- 172.21.15.79:0/3716329576 learned_addr learned my addr 172.21.15.79:0/3716329576 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.179+0000 7f65237fe640 1 -- 172.21.15.79:0/3716329576 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f65240b3570 msgr2=0x7f65241594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.179+0000 7f65237fe640 1 --2- 172.21.15.79:0/3716329576 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f65240b3570 0x7f65241594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.179+0000 7f65237fe640 1 -- 172.21.15.79:0/3716329576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f652415e4d0 msgr2=0x7f652415fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.179+0000 7f65237fe640 1 --2- 172.21.15.79:0/3716329576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f652415e4d0 0x7f652415fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.179+0000 7f65237fe640 1 -- 172.21.15.79:0/3716329576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65240b4000 con 0x7f65240b3020 2024-04-25T02:11:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.179+0000 7f65237fe640 1 --2- 172.21.15.79:0/3716329576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65240b3020 0x7f65240b3ac0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f651400cf60 tx=0x7f651400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.179+0000 7f650bfff640 1 -- 172.21.15.79:0/3716329576 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651401a070 con 0x7f65240b3020 2024-04-25T02:11:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.179+0000 7f650bfff640 1 -- 172.21.15.79:0/3716329576 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651400d840 con 0x7f65240b3020 2024-04-25T02:11:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.179+0000 7f652a07b640 1 -- 172.21.15.79:0/3716329576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65240b42d0 con 0x7f65240b3020 2024-04-25T02:11:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.179+0000 7f650bfff640 1 -- 172.21.15.79:0/3716329576 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651400dc10 con 0x7f65240b3020 2024-04-25T02:11:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.179+0000 7f652a07b640 1 -- 172.21.15.79:0/3716329576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65240b6e50 con 0x7f65240b3020 2024-04-25T02:11:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.180+0000 7f652a07b640 1 -- 172.21.15.79:0/3716329576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65240690a0 con 0x7f65240b3020 2024-04-25T02:11:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.181+0000 7f650bfff640 1 -- 172.21.15.79:0/3716329576 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f651401d070 con 0x7f65240b3020 2024-04-25T02:11:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.181+0000 7f650bfff640 1 --2- 172.21.15.79:0/3716329576 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f651006be30 0x7f651006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.181+0000 7f650bfff640 1 -- 172.21.15.79:0/3716329576 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f651408b5b0 con 0x7f65240b3020 2024-04-25T02:11:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.181+0000 7f6522ffd640 1 --2- 172.21.15.79:0/3716329576 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f651006be30 0x7f651006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.182+0000 7f6522ffd640 1 --2- 172.21.15.79:0/3716329576 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f651006be30 0x7f651006e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6518034000 tx=0x7f651802c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.186+0000 7f650bfff640 1 -- 172.21.15.79:0/3716329576 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f65140599a0 con 0x7f65240b3020 2024-04-25T02:11:40.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.358+0000 7f652a07b640 1 -- 172.21.15.79:0/3716329576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6524161280 con 0x7f65240b3020 2024-04-25T02:11:40.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.359+0000 7f650bfff640 1 -- 172.21.15.79:0/3716329576 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16677 (secure 0 0 0) 0x7f651405dca0 con 0x7f65240b3020 2024-04-25T02:11:40.367 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:40.367 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":59,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:10:27.345273+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:23.901352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:24.658248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:11:40.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.361+0000 7f652a07b640 1 -- 172.21.15.79:0/3716329576 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f651006be30 msgr2=0x7f651006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.361+0000 7f652a07b640 1 --2- 172.21.15.79:0/3716329576 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f651006be30 0x7f651006e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6518034000 tx=0x7f651802c000 comp rx=0 tx=0).stop 2024-04-25T02:11:40.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.361+0000 7f652a07b640 1 -- 172.21.15.79:0/3716329576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65240b3020 msgr2=0x7f65240b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.361+0000 7f652a07b640 1 --2- 172.21.15.79:0/3716329576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65240b3020 0x7f65240b3ac0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f651400cf60 tx=0x7f651400cf90 comp rx=0 tx=0).stop 2024-04-25T02:11:40.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.361+0000 7f652a07b640 1 -- 172.21.15.79:0/3716329576 shutdown_connections 2024-04-25T02:11:40.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.361+0000 7f652a07b640 1 --2- 172.21.15.79:0/3716329576 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f651006be30 0x7f651006e2f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.361+0000 7f652a07b640 1 --2- 172.21.15.79:0/3716329576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f652415e4d0 0x7f652415fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.361+0000 7f652a07b640 1 --2- 172.21.15.79:0/3716329576 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f65240b3570 0x7f65241594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.361+0000 7f652a07b640 1 --2- 172.21.15.79:0/3716329576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65240b3020 0x7f65240b3ac0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.361+0000 7f652a07b640 1 -- 172.21.15.79:0/3716329576 >> 172.21.15.79:0/3716329576 conn(0x7f652409d460 msgr2=0x7f652415c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:40.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.361+0000 7f652a07b640 1 -- 172.21.15.79:0/3716329576 shutdown_connections 2024-04-25T02:11:40.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.361+0000 7f652a07b640 1 -- 172.21.15.79:0/3716329576 wait complete. 2024-04-25T02:11:40.379 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:10:23.901352+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:10:24.658248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:11:40.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:11:40.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.472+0000 7f0d1e6f5640 1 Processor -- start 2024-04-25T02:11:40.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.472+0000 7f0d1e6f5640 1 -- start start 2024-04-25T02:11:40.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.473+0000 7f0d1e6f5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f0d1806b770 0x7f0d18156610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.473+0000 7f0d1e6f5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d18071cd0 con 0x7f0d1806b2f0 2024-04-25T02:11:40.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.473+0000 7f0d1e6f5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d18071fb0 con 0x7f0d180b41b0 2024-04-25T02:11:40.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.473+0000 7f0d1e6f5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f0d18156b50 con 0x7f0d1806b770 2024-04-25T02:11:40.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.473+0000 7f0d177fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0d1806b2f0 0x7f0d18155f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45186/0 (socket says 172.21.15.79:45186) 2024-04-25T02:11:40.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.473+0000 7f0d177fe640 1 -- 172.21.15.79:0/3355737158 learned_addr learned my addr 172.21.15.79:0/3355737158 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:40.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.473+0000 7f0d16ffd640 1 -- 172.21.15.79:0/3355737158 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857475362 0 0) 0x7f0d18071cd0 con 0x7f0d1806b2f0 2024-04-25T02:11:40.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.473+0000 7f0d1cc92640 1 --2- 172.21.15.79:0/3355737158 >> v2:172.21.15.189:3300/0 conn(0x7f0d1806b770 0x7f0d18156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.473+0000 7f0d16ffd640 1 -- 172.21.15.79:0/3355737158 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d00003520 con 0x7f0d1806b2f0 2024-04-25T02:11:40.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d16ffd640 1 -- 172.21.15.79:0/3355737158 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3419749562 0 0) 0x7f0d00003520 con 0x7f0d1806b2f0 2024-04-25T02:11:40.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d16ffd640 1 -- 172.21.15.79:0/3355737158 >> v2:172.21.15.189:3300/0 conn(0x7f0d1806b770 msgr2=0x7f0d18156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:40.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d16ffd640 1 --2- 172.21.15.79:0/3355737158 >> v2:172.21.15.189:3300/0 conn(0x7f0d1806b770 0x7f0d18156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d16ffd640 1 -- 172.21.15.79:0/3355737158 >> v1:172.21.15.189:6789/0 conn(0x7f0d180b41b0 legacy=0x7f0d181605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d16ffd640 1 -- 172.21.15.79:0/3355737158 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d18072290 con 0x7f0d1806b2f0 2024-04-25T02:11:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d1cc92640 1 --2- 172.21.15.79:0/3355737158 >> v2:172.21.15.189:3300/0 conn(0x7f0d1806b770 0x7f0d18156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d16ffd640 1 -- 172.21.15.79:0/3355737158 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f0d0c001670 con 0x7f0d1806b2f0 2024-04-25T02:11:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d16ffd640 1 -- 172.21.15.79:0/3355737158 >> v1:172.21.15.79:6789/0 conn(0x7f0d1806b2f0 legacy=0x7f0d18155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d16ffd640 1 --2- 172.21.15.79:0/3355737158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d000039b0 0x7f0d00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d16ffd640 1 --2- 172.21.15.79:0/3355737158 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0d00004800 0x7f0d00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d16ffd640 1 --2- 172.21.15.79:0/3355737158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d000051c0 0x7f0d0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d16ffd640 1 -- 172.21.15.79:0/3355737158 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0000c0e0 con 0x7f0d000051c0 2024-04-25T02:11:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d16ffd640 1 -- 172.21.15.79:0/3355737158 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0000c290 con 0x7f0d000039b0 2024-04-25T02:11:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d16ffd640 1 -- 172.21.15.79:0/3355737158 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0000c490 con 0x7f0d00004800 2024-04-25T02:11:40.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d1cc92640 1 --2- 172.21.15.79:0/3355737158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d000051c0 0x7f0d0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d17fff640 1 --2- 172.21.15.79:0/3355737158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d000039b0 0x7f0d00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d177fe640 1 --2- 172.21.15.79:0/3355737158 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0d00004800 0x7f0d00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d1cc92640 1 -- 172.21.15.79:0/3355737158 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0d00004800 msgr2=0x7f0d00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:40.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d1cc92640 1 --2- 172.21.15.79:0/3355737158 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0d00004800 0x7f0d00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d1cc92640 1 -- 172.21.15.79:0/3355737158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d000039b0 msgr2=0x7f0d00003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:40.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d1cc92640 1 --2- 172.21.15.79:0/3355737158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d000039b0 0x7f0d00003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d1cc92640 1 -- 172.21.15.79:0/3355737158 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d00003520 con 0x7f0d000051c0 2024-04-25T02:11:40.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.474+0000 7f0d177fe640 1 --2- 172.21.15.79:0/3355737158 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0d00004800 0x7f0d00004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:40.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.475+0000 7f0d1cc92640 1 -- 172.21.15.79:0/3355737158 reap_dead start 2024-04-25T02:11:40.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.475+0000 7f0d1cc92640 1 --2- 172.21.15.79:0/3355737158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d000051c0 0x7f0d0000b9c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0d100073e0 tx=0x7f0d00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989d22fb0654f5a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:40.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.475+0000 7f0d16ffd640 1 -- 172.21.15.79:0/3355737158 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d10009c80 con 0x7f0d000051c0 2024-04-25T02:11:40.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.475+0000 7f0d16ffd640 1 -- 172.21.15.79:0/3355737158 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d1002c6c0 con 0x7f0d000051c0 2024-04-25T02:11:40.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.475+0000 7f0d16ffd640 1 -- 172.21.15.79:0/3355737158 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1002cab0 con 0x7f0d000051c0 2024-04-25T02:11:40.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.475+0000 7f0d1e6f5640 1 -- 172.21.15.79:0/3355737158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d000051c0 msgr2=0x7f0d0000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.475+0000 7f0d1e6f5640 1 --2- 172.21.15.79:0/3355737158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d000051c0 0x7f0d0000b9c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0d100073e0 tx=0x7f0d00005830 comp rx=0 tx=0).stop 2024-04-25T02:11:40.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.475+0000 7f0d1e6f5640 1 -- 172.21.15.79:0/3355737158 shutdown_connections 2024-04-25T02:11:40.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.475+0000 7f0d1e6f5640 1 --2- 172.21.15.79:0/3355737158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d000051c0 0x7f0d0000b9c0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.476+0000 7f0d1e6f5640 1 -- 172.21.15.79:0/3355737158 >> 172.21.15.79:0/3355737158 conn(0x7f0d180b1cd0 msgr2=0x7f0d180b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:40.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.476+0000 7f0d1e6f5640 1 -- 172.21.15.79:0/3355737158 shutdown_connections 2024-04-25T02:11:40.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.476+0000 7f0d1e6f5640 1 -- 172.21.15.79:0/3355737158 wait complete. 2024-04-25T02:11:40.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.477+0000 7f0d1e6f5640 1 Processor -- start 2024-04-25T02:11:40.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.477+0000 7f0d1e6f5640 1 -- start start 2024-04-25T02:11:40.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.477+0000 7f0d1e6f5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0d000051c0 0x7f0d1809d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1e6f5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d1814bf30 0x7f0d181f1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1e6f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d180cf580 0x7f0d180cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1e6f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1806bb80 con 0x7f0d180cf580 2024-04-25T02:11:40.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1e6f5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0d18072d70 con 0x7f0d1814bf30 2024-04-25T02:11:40.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1e6f5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0d1815c870 con 0x7f0d000051c0 2024-04-25T02:11:40.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1cc92640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d180cf580 0x7f0d180cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1cc92640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d180cf580 0x7f0d180cfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57954/0 (socket says 172.21.15.79:57954) 2024-04-25T02:11:40.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1cc92640 1 -- 172.21.15.79:0/2589047426 learned_addr learned my addr 172.21.15.79:0/2589047426 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:40.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d17fff640 1 --2- 172.21.15.79:0/2589047426 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0d000051c0 0x7f0d1809d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d177fe640 1 --2- 172.21.15.79:0/2589047426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d1814bf30 0x7f0d181f1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1cc92640 1 -- 172.21.15.79:0/2589047426 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0d000051c0 msgr2=0x7f0d1809d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1cc92640 1 --2- 172.21.15.79:0/2589047426 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0d000051c0 0x7f0d1809d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1cc92640 1 -- 172.21.15.79:0/2589047426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d1814bf30 msgr2=0x7f0d181f1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1cc92640 1 --2- 172.21.15.79:0/2589047426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d1814bf30 0x7f0d181f1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1cc92640 1 -- 172.21.15.79:0/2589047426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d181532a0 con 0x7f0d180cf580 2024-04-25T02:11:40.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d177fe640 1 --2- 172.21.15.79:0/2589047426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d1814bf30 0x7f0d181f1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:40.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1cc92640 1 --2- 172.21.15.79:0/2589047426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d180cf580 0x7f0d180cfa00 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0d1002d690 tx=0x7f0d10004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:40.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d14ff9640 1 -- 172.21.15.79:0/2589047426 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d10009c80 con 0x7f0d180cf580 2024-04-25T02:11:40.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d14ff9640 1 -- 172.21.15.79:0/2589047426 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d1002da80 con 0x7f0d180cf580 2024-04-25T02:11:40.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1e6f5640 1 -- 172.21.15.79:0/2589047426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d1809aba0 con 0x7f0d180cf580 2024-04-25T02:11:40.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d14ff9640 1 -- 172.21.15.79:0/2589047426 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d10041420 con 0x7f0d180cf580 2024-04-25T02:11:40.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.478+0000 7f0d1e6f5640 1 -- 172.21.15.79:0/2589047426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d1809b120 con 0x7f0d180cf580 2024-04-25T02:11:40.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.479+0000 7f0d1e6f5640 1 -- 172.21.15.79:0/2589047426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d180690a0 con 0x7f0d180cf580 2024-04-25T02:11:40.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.480+0000 7f0d14ff9640 1 -- 172.21.15.79:0/2589047426 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d10036400 con 0x7f0d180cf580 2024-04-25T02:11:40.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.480+0000 7f0d14ff9640 1 --2- 172.21.15.79:0/2589047426 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0d0406be30 0x7f0d0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.480+0000 7f0d17fff640 1 --2- 172.21.15.79:0/2589047426 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0d0406be30 0x7f0d0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.480+0000 7f0d14ff9640 1 -- 172.21.15.79:0/2589047426 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f0d100ab3c0 con 0x7f0d180cf580 2024-04-25T02:11:40.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.481+0000 7f0d17fff640 1 --2- 172.21.15.79:0/2589047426 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0d0406be30 0x7f0d0406e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0d08000c00 tx=0x7f0d08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:40.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.485+0000 7f0d14ff9640 1 -- 172.21.15.79:0/2589047426 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0d10032030 con 0x7f0d180cf580 2024-04-25T02:11:40.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.656+0000 7f0d1e6f5640 1 -- 172.21.15.79:0/2589047426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0d1815b740 con 0x7f0d180cf580 2024-04-25T02:11:40.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.656+0000 7f0d14ff9640 1 -- 172.21.15.79:0/2589047426 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) ==== 93+0+10 (secure 0 0 0) 0x7f0d10079e00 con 0x7f0d180cf580 2024-04-25T02:11:40.664 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:11:40.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.658+0000 7f0d1e6f5640 1 -- 172.21.15.79:0/2589047426 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0d0406be30 msgr2=0x7f0d0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.658+0000 7f0d1e6f5640 1 --2- 172.21.15.79:0/2589047426 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0d0406be30 0x7f0d0406e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0d08000c00 tx=0x7f0d08009040 comp rx=0 tx=0).stop 2024-04-25T02:11:40.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.658+0000 7f0d1e6f5640 1 -- 172.21.15.79:0/2589047426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d180cf580 msgr2=0x7f0d180cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.658+0000 7f0d1e6f5640 1 --2- 172.21.15.79:0/2589047426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d180cf580 0x7f0d180cfa00 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0d1002d690 tx=0x7f0d10004ab0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.658+0000 7f0d1e6f5640 1 -- 172.21.15.79:0/2589047426 shutdown_connections 2024-04-25T02:11:40.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.658+0000 7f0d1e6f5640 1 --2- 172.21.15.79:0/2589047426 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0d0406be30 0x7f0d0406e2f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.658+0000 7f0d1e6f5640 1 --2- 172.21.15.79:0/2589047426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d180cf580 0x7f0d180cfa00 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.658+0000 7f0d1e6f5640 1 --2- 172.21.15.79:0/2589047426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d1814bf30 0x7f0d181f1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.658+0000 7f0d1e6f5640 1 --2- 172.21.15.79:0/2589047426 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0d000051c0 0x7f0d1809d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.658+0000 7f0d1e6f5640 1 -- 172.21.15.79:0/2589047426 >> 172.21.15.79:0/2589047426 conn(0x7f0d180b1cd0 msgr2=0x7f0d1815a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:40.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.659+0000 7f0d1e6f5640 1 -- 172.21.15.79:0/2589047426 shutdown_connections 2024-04-25T02:11:40.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.659+0000 7f0d1e6f5640 1 -- 172.21.15.79:0/2589047426 wait complete. 2024-04-25T02:11:40.676 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:11:40.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.768+0000 7f68b12da640 1 Processor -- start 2024-04-25T02:11:40.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.768+0000 7f68b12da640 1 -- start start 2024-04-25T02:11:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.769+0000 7f68b12da640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f68ac0d2ca0 0x7f68ac0d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.769+0000 7f68b12da640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f68ac0d0ef0 0x7f68ac06bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.769+0000 7f68b12da640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68ac0d1ee0 con 0x7f68ac15e4f0 2024-04-25T02:11:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.769+0000 7f68b12da640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f68ac0d3130 con 0x7f68ac0d2ca0 2024-04-25T02:11:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.769+0000 7f68b12da640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f68ac0d21c0 con 0x7f68ac0d0ef0 2024-04-25T02:11:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.769+0000 7f68ab7fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f68ac0d0ef0 0x7f68ac06bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.769+0000 7f68aa7fc640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f68ac0d2ca0 0x7f68ac0d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.769+0000 7f68ab7fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f68ac0d0ef0 0x7f68ac06bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:53454/0 (socket says 172.21.15.79:53454) 2024-04-25T02:11:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.769+0000 7f68ab7fe640 1 -- 172.21.15.79:0/4201459129 learned_addr learned my addr 172.21.15.79:0/4201459129 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.770+0000 7f68ab7fe640 1 -- 172.21.15.79:0/4201459129 >> v2:172.21.15.189:3300/0 conn(0x7f68ac0d2ca0 msgr2=0x7f68ac0d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.770+0000 7f68ab7fe640 1 --2- 172.21.15.79:0/4201459129 >> v2:172.21.15.189:3300/0 conn(0x7f68ac0d2ca0 0x7f68ac0d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.770+0000 7f68ab7fe640 1 -- 172.21.15.79:0/4201459129 >> v1:172.21.15.189:6789/0 conn(0x7f68ac15e4f0 legacy=0x7f68ac0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.770+0000 7f68ab7fe640 1 -- 172.21.15.79:0/4201459129 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68ac0d24a0 con 0x7f68ac0d0ef0 2024-04-25T02:11:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.770+0000 7f68ab7fe640 1 --2- 172.21.15.79:0/4201459129 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f68ac0d0ef0 0x7f68ac06bc30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f68a40098a0 tx=0x7f68a402a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=905f62df0b2d1118 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.770+0000 7f68a9ffb640 1 -- 172.21.15.79:0/4201459129 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4037070 con 0x7f68ac0d0ef0 2024-04-25T02:11:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.771+0000 7f68a9ffb640 1 -- 172.21.15.79:0/4201459129 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a4032440 con 0x7f68ac0d0ef0 2024-04-25T02:11:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.771+0000 7f68a9ffb640 1 -- 172.21.15.79:0/4201459129 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4032810 con 0x7f68ac0d0ef0 2024-04-25T02:11:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.771+0000 7f68b12da640 1 -- 172.21.15.79:0/4201459129 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f68ac0d0ef0 msgr2=0x7f68ac06bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.771+0000 7f68b12da640 1 --2- 172.21.15.79:0/4201459129 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f68ac0d0ef0 0x7f68ac06bc30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f68a40098a0 tx=0x7f68a402a290 comp rx=0 tx=0).stop 2024-04-25T02:11:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.771+0000 7f68b12da640 1 -- 172.21.15.79:0/4201459129 shutdown_connections 2024-04-25T02:11:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.771+0000 7f68b12da640 1 --2- 172.21.15.79:0/4201459129 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f68ac0d0ef0 0x7f68ac06bc30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.771+0000 7f68b12da640 1 --2- 172.21.15.79:0/4201459129 >> v2:172.21.15.189:3300/0 conn(0x7f68ac0d2ca0 0x7f68ac0d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.771+0000 7f68b12da640 1 -- 172.21.15.79:0/4201459129 >> 172.21.15.79:0/4201459129 conn(0x7f68ac09d4a0 msgr2=0x7f68ac0d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:40.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.771+0000 7f68b12da640 1 -- 172.21.15.79:0/4201459129 shutdown_connections 2024-04-25T02:11:40.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.771+0000 7f68b12da640 1 -- 172.21.15.79:0/4201459129 wait complete. 2024-04-25T02:11:40.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.772+0000 7f68b12da640 1 Processor -- start 2024-04-25T02:11:40.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.772+0000 7f68b12da640 1 -- start start 2024-04-25T02:11:40.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.773+0000 7f68b12da640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68ac0d0ef0 0x7f68ac14f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.773+0000 7f68b12da640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f68ac0d2ca0 0x7f68ac0ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.773+0000 7f68b12da640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68ac15e4f0 0x7f68ac0b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.773+0000 7f68b12da640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac0d4ee0 con 0x7f68ac15e4f0 2024-04-25T02:11:40.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.773+0000 7f68b12da640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac0cff00 con 0x7f68ac0d0ef0 2024-04-25T02:11:40.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.773+0000 7f68b12da640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f68ac0d5060 con 0x7f68ac0d2ca0 2024-04-25T02:11:40.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.773+0000 7f68ab7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68ac15e4f0 0x7f68ac0b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.773+0000 7f68ab7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68ac15e4f0 0x7f68ac0b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57962/0 (socket says 172.21.15.79:57962) 2024-04-25T02:11:40.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.773+0000 7f68ab7fe640 1 -- 172.21.15.79:0/1123625387 learned_addr learned my addr 172.21.15.79:0/1123625387 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:40.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.773+0000 7f68aaffd640 1 --2- 172.21.15.79:0/1123625387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68ac0d0ef0 0x7f68ac14f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.774+0000 7f68ab7fe640 1 -- 172.21.15.79:0/1123625387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f68ac0d2ca0 msgr2=0x7f68ac0ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.774+0000 7f68ab7fe640 1 --2- 172.21.15.79:0/1123625387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f68ac0d2ca0 0x7f68ac0ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.774+0000 7f68ab7fe640 1 -- 172.21.15.79:0/1123625387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68ac0d0ef0 msgr2=0x7f68ac14f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.774+0000 7f68ab7fe640 1 --2- 172.21.15.79:0/1123625387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68ac0d0ef0 0x7f68ac14f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.774+0000 7f68ab7fe640 1 -- 172.21.15.79:0/1123625387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68ac1590a0 con 0x7f68ac15e4f0 2024-04-25T02:11:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.774+0000 7f68ab7fe640 1 --2- 172.21.15.79:0/1123625387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68ac15e4f0 0x7f68ac0b16b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f68a40090b0 tx=0x7f68a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.774+0000 7f68937fe640 1 -- 172.21.15.79:0/1123625387 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4037040 con 0x7f68ac15e4f0 2024-04-25T02:11:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.774+0000 7f68937fe640 1 -- 172.21.15.79:0/1123625387 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a4042070 con 0x7f68ac15e4f0 2024-04-25T02:11:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.774+0000 7f68b12da640 1 -- 172.21.15.79:0/1123625387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68ac159380 con 0x7f68ac15e4f0 2024-04-25T02:11:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.774+0000 7f68937fe640 1 -- 172.21.15.79:0/1123625387 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a403b930 con 0x7f68ac15e4f0 2024-04-25T02:11:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.774+0000 7f68b12da640 1 -- 172.21.15.79:0/1123625387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68ac159940 con 0x7f68ac15e4f0 2024-04-25T02:11:40.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.775+0000 7f68b12da640 1 -- 172.21.15.79:0/1123625387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68ac0686c0 con 0x7f68ac15e4f0 2024-04-25T02:11:40.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.775+0000 7f68937fe640 1 -- 172.21.15.79:0/1123625387 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f68a403bad0 con 0x7f68ac15e4f0 2024-04-25T02:11:40.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.776+0000 7f68937fe640 1 --2- 172.21.15.79:0/1123625387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f689806be30 0x7f689806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:40.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.776+0000 7f68937fe640 1 -- 172.21.15.79:0/1123625387 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f68a40ab640 con 0x7f68ac15e4f0 2024-04-25T02:11:40.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.776+0000 7f68aaffd640 1 --2- 172.21.15.79:0/1123625387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f689806be30 0x7f689806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:40.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.776+0000 7f68aaffd640 1 --2- 172.21.15.79:0/1123625387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f689806be30 0x7f689806e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f689c007fd0 tx=0x7f689c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:40.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.780+0000 7f68937fe640 1 -- 172.21.15.79:0/1123625387 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f68a407a080 con 0x7f68ac15e4f0 2024-04-25T02:11:40.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.952+0000 7f68b12da640 1 -- 172.21.15.79:0/1123625387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f68ac0b25e0 con 0x7f68ac15e4f0 2024-04-25T02:11:41.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.952+0000 7f68937fe640 1 -- 172.21.15.79:0/1123625387 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) ==== 104+0+11 (secure 0 0 0) 0x7f68a4079980 con 0x7f68ac15e4f0 2024-04-25T02:11:41.018 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:11:41.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.954+0000 7f68b12da640 1 -- 172.21.15.79:0/1123625387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f689806be30 msgr2=0x7f689806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.954+0000 7f68b12da640 1 --2- 172.21.15.79:0/1123625387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f689806be30 0x7f689806e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f689c007fd0 tx=0x7f689c009040 comp rx=0 tx=0).stop 2024-04-25T02:11:41.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.954+0000 7f68b12da640 1 -- 172.21.15.79:0/1123625387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68ac15e4f0 msgr2=0x7f68ac0b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.954+0000 7f68b12da640 1 --2- 172.21.15.79:0/1123625387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68ac15e4f0 0x7f68ac0b16b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f68a40090b0 tx=0x7f68a40046c0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.954+0000 7f68b12da640 1 -- 172.21.15.79:0/1123625387 shutdown_connections 2024-04-25T02:11:41.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.954+0000 7f68b12da640 1 --2- 172.21.15.79:0/1123625387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f689806be30 0x7f689806e2f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.954+0000 7f68b12da640 1 --2- 172.21.15.79:0/1123625387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68ac15e4f0 0x7f68ac0b16b0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.954+0000 7f68b12da640 1 --2- 172.21.15.79:0/1123625387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f68ac0d2ca0 0x7f68ac0ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.954+0000 7f68b12da640 1 --2- 172.21.15.79:0/1123625387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68ac0d0ef0 0x7f68ac14f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.954+0000 7f68b12da640 1 -- 172.21.15.79:0/1123625387 >> 172.21.15.79:0/1123625387 conn(0x7f68ac09d4a0 msgr2=0x7f68ac06d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:41.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.954+0000 7f68b12da640 1 -- 172.21.15.79:0/1123625387 shutdown_connections 2024-04-25T02:11:41.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:40.954+0000 7f68b12da640 1 -- 172.21.15.79:0/1123625387 wait complete. 2024-04-25T02:11:41.020 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:11:41.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.113+0000 7fe22ab1d640 1 Processor -- start 2024-04-25T02:11:41.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.113+0000 7fe22ab1d640 1 -- start start 2024-04-25T02:11:41.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.114+0000 7fe22ab1d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe22406b770 0x7fe224156610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.114+0000 7fe22ab1d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe224071cd0 con 0x7fe2240b41b0 2024-04-25T02:11:41.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.114+0000 7fe22ab1d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe224071fb0 con 0x7fe22406b2f0 2024-04-25T02:11:41.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.114+0000 7fe22ab1d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe224156b50 con 0x7fe22406b770 2024-04-25T02:11:41.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.114+0000 7fe2290ba640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe22406b770 0x7fe224156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.114+0000 7fe2288b9640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe2240b41b0 0x7fe2241605d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45200/0 (socket says 172.21.15.79:45200) 2024-04-25T02:11:41.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.114+0000 7fe2288b9640 1 -- 172.21.15.79:0/2431185346 learned_addr learned my addr 172.21.15.79:0/2431185346 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:41.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.114+0000 7fe2290ba640 1 -- 172.21.15.79:0/2431185346 >> v1:172.21.15.189:6789/0 conn(0x7fe22406b2f0 legacy=0x7fe224155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:41.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.114+0000 7fe2290ba640 1 -- 172.21.15.79:0/2431185346 >> v1:172.21.15.79:6789/0 conn(0x7fe2240b41b0 legacy=0x7fe2241605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.114+0000 7fe2290ba640 1 -- 172.21.15.79:0/2431185346 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe224072290 con 0x7fe22406b770 2024-04-25T02:11:41.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.115+0000 7fe2290ba640 1 --2- 172.21.15.79:0/2431185346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe22406b770 0x7fe224156610 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009d90 tx=0x7fe21c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87fdaec79fc6f334 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:41.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.115+0000 7fe2237fe640 1 -- 172.21.15.79:0/2431185346 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c007740 con 0x7fe22406b770 2024-04-25T02:11:41.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.115+0000 7fe2237fe640 1 -- 172.21.15.79:0/2431185346 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21c0078e0 con 0x7fe22406b770 2024-04-25T02:11:41.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.115+0000 7fe2237fe640 1 -- 172.21.15.79:0/2431185346 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c007cb0 con 0x7fe22406b770 2024-04-25T02:11:41.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.115+0000 7fe22ab1d640 1 -- 172.21.15.79:0/2431185346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe22406b770 msgr2=0x7fe224156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.115+0000 7fe22ab1d640 1 --2- 172.21.15.79:0/2431185346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe22406b770 0x7fe224156610 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009d90 tx=0x7fe21c02a6a0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.116+0000 7fe22ab1d640 1 -- 172.21.15.79:0/2431185346 shutdown_connections 2024-04-25T02:11:41.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.116+0000 7fe22ab1d640 1 --2- 172.21.15.79:0/2431185346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe22406b770 0x7fe224156610 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.116+0000 7fe22ab1d640 1 -- 172.21.15.79:0/2431185346 >> 172.21.15.79:0/2431185346 conn(0x7fe2240b1cd0 msgr2=0x7fe2240b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:41.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.116+0000 7fe22ab1d640 1 -- 172.21.15.79:0/2431185346 shutdown_connections 2024-04-25T02:11:41.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.116+0000 7fe22ab1d640 1 -- 172.21.15.79:0/2431185346 wait complete. 2024-04-25T02:11:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.117+0000 7fe22ab1d640 1 Processor -- start 2024-04-25T02:11:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.117+0000 7fe22ab1d640 1 -- start start 2024-04-25T02:11:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe22ab1d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe22406b2f0 0x7fe2240c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe22ab1d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe22406b770 0x7fe224159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe22ab1d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2240b41b0 0x7fe2240b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe22ab1d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe2240cf4b0 con 0x7fe22406b2f0 2024-04-25T02:11:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe22ab1d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe224072d70 con 0x7fe22406b770 2024-04-25T02:11:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe22ab1d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe22406bb80 con 0x7fe2240b41b0 2024-04-25T02:11:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe2288b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe22406b2f0 0x7fe2240c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe2288b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe22406b2f0 0x7fe2240c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57972/0 (socket says 172.21.15.79:57972) 2024-04-25T02:11:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe2288b9640 1 -- 172.21.15.79:0/3035161841 learned_addr learned my addr 172.21.15.79:0/3035161841 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe223fff640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe22406b770 0x7fe224159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe2290ba640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2240b41b0 0x7fe2240b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe2288b9640 1 -- 172.21.15.79:0/3035161841 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2240b41b0 msgr2=0x7fe2240b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe2288b9640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2240b41b0 0x7fe2240b29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe2288b9640 1 -- 172.21.15.79:0/3035161841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe22406b770 msgr2=0x7fe224159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe2288b9640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe22406b770 0x7fe224159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe2288b9640 1 -- 172.21.15.79:0/3035161841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe224159cc0 con 0x7fe22406b2f0 2024-04-25T02:11:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe2290ba640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2240b41b0 0x7fe2240b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe223fff640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe22406b770 0x7fe224159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe2288b9640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe22406b2f0 0x7fe2240c8f60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe21800c3f0 tx=0x7fe21800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe2217fa640 1 -- 172.21.15.79:0/3035161841 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe218017070 con 0x7fe22406b2f0 2024-04-25T02:11:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe2217fa640 1 -- 172.21.15.79:0/3035161841 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe218005ce0 con 0x7fe22406b2f0 2024-04-25T02:11:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe22ab1d640 1 -- 172.21.15.79:0/3035161841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2240c9590 con 0x7fe22406b2f0 2024-04-25T02:11:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe2217fa640 1 -- 172.21.15.79:0/3035161841 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2180072f0 con 0x7fe22406b2f0 2024-04-25T02:11:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.118+0000 7fe22ab1d640 1 -- 172.21.15.79:0/3035161841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2241f4970 con 0x7fe22406b2f0 2024-04-25T02:11:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.119+0000 7fe22ab1d640 1 -- 172.21.15.79:0/3035161841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2240690a0 con 0x7fe22406b2f0 2024-04-25T02:11:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.120+0000 7fe2217fa640 1 -- 172.21.15.79:0/3035161841 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe21801a070 con 0x7fe22406b2f0 2024-04-25T02:11:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.120+0000 7fe2217fa640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe20806be30 0x7fe20806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.120+0000 7fe2217fa640 1 -- 172.21.15.79:0/3035161841 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fe21808a0f0 con 0x7fe22406b2f0 2024-04-25T02:11:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.120+0000 7fe223fff640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe20806be30 0x7fe20806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.120+0000 7fe223fff640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe20806be30 0x7fe20806e2f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe22406e6e0 tx=0x7fe210009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.124+0000 7fe2217fa640 1 -- 172.21.15.79:0/3035161841 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe224159cc0 con 0x7fe22406b2f0 2024-04-25T02:11:41.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.297+0000 7fe22ab1d640 1 -- 172.21.15.79:0/3035161841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe2240ce280 con 0x7fe22406b2f0 2024-04-25T02:11:41.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.297+0000 7fe2217fa640 1 -- 172.21.15.79:0/3035161841 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) ==== 100+0+11 (secure 0 0 0) 0x7fe218058b30 con 0x7fe22406b2f0 2024-04-25T02:11:41.305 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:11:41.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.299+0000 7fe22ab1d640 1 -- 172.21.15.79:0/3035161841 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe20806be30 msgr2=0x7fe20806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.299+0000 7fe22ab1d640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe20806be30 0x7fe20806e2f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe22406e6e0 tx=0x7fe210009040 comp rx=0 tx=0).stop 2024-04-25T02:11:41.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.299+0000 7fe22ab1d640 1 -- 172.21.15.79:0/3035161841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe22406b2f0 msgr2=0x7fe2240c8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.299+0000 7fe22ab1d640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe22406b2f0 0x7fe2240c8f60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe21800c3f0 tx=0x7fe21800c8b0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.299+0000 7fe22ab1d640 1 -- 172.21.15.79:0/3035161841 shutdown_connections 2024-04-25T02:11:41.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.299+0000 7fe22ab1d640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe20806be30 0x7fe20806e2f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.299+0000 7fe22ab1d640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2240b41b0 0x7fe2240b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.300+0000 7fe22ab1d640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe22406b770 0x7fe224159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.300+0000 7fe22ab1d640 1 --2- 172.21.15.79:0/3035161841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe22406b2f0 0x7fe2240c8f60 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.300+0000 7fe22ab1d640 1 -- 172.21.15.79:0/3035161841 >> 172.21.15.79:0/3035161841 conn(0x7fe2240b1cd0 msgr2=0x7fe2240aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:41.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.300+0000 7fe22ab1d640 1 -- 172.21.15.79:0/3035161841 shutdown_connections 2024-04-25T02:11:41.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.300+0000 7fe22ab1d640 1 -- 172.21.15.79:0/3035161841 wait complete. 2024-04-25T02:11:41.317 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:11:41.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.408+0000 7f6b1a996640 1 Processor -- start 2024-04-25T02:11:41.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.408+0000 7f6b1a996640 1 -- start start 2024-04-25T02:11:41.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.408+0000 7f6b1a996640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b14143bc0 0x7f6b1415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.409+0000 7f6b1a996640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b1415fa40 con 0x7f6b1406df50 2024-04-25T02:11:41.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.409+0000 7f6b1a996640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b140b5700 con 0x7f6b140b3d40 2024-04-25T02:11:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.409+0000 7f6b1a996640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6b14072cb0 con 0x7f6b14143bc0 2024-04-25T02:11:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.409+0000 7f6b137fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6b1406df50 0x7f6b140b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45204/0 (socket says 172.21.15.79:45204) 2024-04-25T02:11:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.409+0000 7f6b137fe640 1 -- 172.21.15.79:0/364490439 learned_addr learned my addr 172.21.15.79:0/364490439 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.409+0000 7f6b13fff640 1 --2- 172.21.15.79:0/364490439 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b14143bc0 0x7f6b1415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.409+0000 7f6b12ffd640 1 -- 172.21.15.79:0/364490439 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1787935127 0 0) 0x7f6b04001110 con 0x7f6b1406df50 2024-04-25T02:11:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.409+0000 7f6b12ffd640 1 -- 172.21.15.79:0/364490439 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6afc003520 con 0x7f6b1406df50 2024-04-25T02:11:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.409+0000 7f6b12ffd640 1 -- 172.21.15.79:0/364490439 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220594149 0 0) 0x7f6b140b5700 con 0x7f6b140b3d40 2024-04-25T02:11:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.409+0000 7f6b12ffd640 1 -- 172.21.15.79:0/364490439 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b04001110 con 0x7f6b140b3d40 2024-04-25T02:11:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.409+0000 7f6b12ffd640 1 -- 172.21.15.79:0/364490439 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2579780327 0 0) 0x7f6afc003520 con 0x7f6b1406df50 2024-04-25T02:11:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.409+0000 7f6b13fff640 1 -- 172.21.15.79:0/364490439 >> v1:172.21.15.189:6789/0 conn(0x7f6b140b3d40 legacy=0x7f6b140b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.409+0000 7f6b13fff640 1 -- 172.21.15.79:0/364490439 >> v1:172.21.15.79:6789/0 conn(0x7f6b1406df50 legacy=0x7f6b140b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.409+0000 7f6b13fff640 1 -- 172.21.15.79:0/364490439 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b14071e00 con 0x7f6b14143bc0 2024-04-25T02:11:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.410+0000 7f6b13fff640 1 --2- 172.21.15.79:0/364490439 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b14143bc0 0x7f6b1415f500 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6b080097d0 tx=0x7f6b0802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c6ea6c3975341f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.410+0000 7f6b12ffd640 1 -- 172.21.15.79:0/364490439 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08037070 con 0x7f6b14143bc0 2024-04-25T02:11:41.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.410+0000 7f6b12ffd640 1 -- 172.21.15.79:0/364490439 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b0802ab90 con 0x7f6b14143bc0 2024-04-25T02:11:41.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.410+0000 7f6b12ffd640 1 -- 172.21.15.79:0/364490439 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b040017c0 con 0x7f6b14143bc0 2024-04-25T02:11:41.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.411+0000 7f6b1a996640 1 -- 172.21.15.79:0/364490439 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b14143bc0 msgr2=0x7f6b1415f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.411+0000 7f6b1a996640 1 --2- 172.21.15.79:0/364490439 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b14143bc0 0x7f6b1415f500 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6b080097d0 tx=0x7f6b0802a100 comp rx=0 tx=0).stop 2024-04-25T02:11:41.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.411+0000 7f6b1a996640 1 -- 172.21.15.79:0/364490439 shutdown_connections 2024-04-25T02:11:41.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.411+0000 7f6b1a996640 1 --2- 172.21.15.79:0/364490439 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b14143bc0 0x7f6b1415f500 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.411+0000 7f6b1a996640 1 -- 172.21.15.79:0/364490439 >> 172.21.15.79:0/364490439 conn(0x7f6b140cfc80 msgr2=0x7f6b140d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:41.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.411+0000 7f6b1a996640 1 -- 172.21.15.79:0/364490439 shutdown_connections 2024-04-25T02:11:41.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.411+0000 7f6b1a996640 1 -- 172.21.15.79:0/364490439 wait complete. 2024-04-25T02:11:41.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.412+0000 7f6b1a996640 1 Processor -- start 2024-04-25T02:11:41.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.412+0000 7f6b1a996640 1 -- start start 2024-04-25T02:11:41.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b1a996640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b1406df50 0x7f6b141f3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b1a996640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b140b3d40 0x7f6b14159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b1a996640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b14143bc0 0x7f6b14141290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b1a996640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6b14072660 con 0x7f6b14143bc0 2024-04-25T02:11:41.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b1a996640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b14072380 con 0x7f6b1406df50 2024-04-25T02:11:41.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b1a996640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6b14072940 con 0x7f6b140b3d40 2024-04-25T02:11:41.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b18f33640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b14143bc0 0x7f6b14141290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b18f33640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b14143bc0 0x7f6b14141290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57984/0 (socket says 172.21.15.79:57984) 2024-04-25T02:11:41.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b18f33640 1 -- 172.21.15.79:0/3859363571 learned_addr learned my addr 172.21.15.79:0/3859363571 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:41.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b137fe640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b140b3d40 0x7f6b14159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b13fff640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b1406df50 0x7f6b141f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b18f33640 1 -- 172.21.15.79:0/3859363571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b140b3d40 msgr2=0x7f6b14159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b18f33640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b140b3d40 0x7f6b14159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b18f33640 1 -- 172.21.15.79:0/3859363571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b1406df50 msgr2=0x7f6b141f3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b18f33640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b1406df50 0x7f6b141f3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b18f33640 1 -- 172.21.15.79:0/3859363571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b141417d0 con 0x7f6b14143bc0 2024-04-25T02:11:41.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b137fe640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b140b3d40 0x7f6b14159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:41.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b13fff640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b1406df50 0x7f6b141f3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:41.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b18f33640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b14143bc0 0x7f6b14141290 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00c7a0 tx=0x7f6b0c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:41.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b10ff9640 1 -- 172.21.15.79:0/3859363571 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c003b70 con 0x7f6b14143bc0 2024-04-25T02:11:41.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b10ff9640 1 -- 172.21.15.79:0/3859363571 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b0c003d10 con 0x7f6b14143bc0 2024-04-25T02:11:41.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.413+0000 7f6b1a996640 1 -- 172.21.15.79:0/3859363571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b141f3e20 con 0x7f6b14143bc0 2024-04-25T02:11:41.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.414+0000 7f6b10ff9640 1 -- 172.21.15.79:0/3859363571 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c00aa90 con 0x7f6b14143bc0 2024-04-25T02:11:41.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.414+0000 7f6b1a996640 1 -- 172.21.15.79:0/3859363571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b141f43e0 con 0x7f6b14143bc0 2024-04-25T02:11:41.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.415+0000 7f6b1a996640 1 -- 172.21.15.79:0/3859363571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b140690a0 con 0x7f6b14143bc0 2024-04-25T02:11:41.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.415+0000 7f6b10ff9640 1 -- 172.21.15.79:0/3859363571 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b0c00ac30 con 0x7f6b14143bc0 2024-04-25T02:11:41.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.415+0000 7f6b10ff9640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b0006be30 0x7f6b0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.416+0000 7f6b13fff640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b0006be30 0x7f6b0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.416+0000 7f6b10ff9640 1 -- 172.21.15.79:0/3859363571 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f6b0c08ae40 con 0x7f6b14143bc0 2024-04-25T02:11:41.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.416+0000 7f6b13fff640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b0006be30 0x7f6b0006e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6b08034000 tx=0x7f6b0802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:41.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.420+0000 7f6b10ff9640 1 -- 172.21.15.79:0/3859363571 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6b0c059790 con 0x7f6b14143bc0 2024-04-25T02:11:41.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.605+0000 7f6b1a996640 1 -- 172.21.15.79:0/3859363571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6b140cfa10 con 0x7f6b14143bc0 2024-04-25T02:11:41.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.606+0000 7f6b10ff9640 1 -- 172.21.15.79:0/3859363571 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) ==== 80+0+0 (secure 0 0 0) 0x7f6b0c059090 con 0x7f6b14143bc0 2024-04-25T02:11:41.613 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-04-25T02:11:41.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.608+0000 7f6b1a996640 1 -- 172.21.15.79:0/3859363571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b0006be30 msgr2=0x7f6b0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.608+0000 7f6b1a996640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b0006be30 0x7f6b0006e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6b08034000 tx=0x7f6b0802e000 comp rx=0 tx=0).stop 2024-04-25T02:11:41.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.608+0000 7f6b1a996640 1 -- 172.21.15.79:0/3859363571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b14143bc0 msgr2=0x7f6b14141290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.608+0000 7f6b1a996640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b14143bc0 0x7f6b14141290 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00c7a0 tx=0x7f6b0c00cc60 comp rx=0 tx=0).stop 2024-04-25T02:11:41.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.608+0000 7f6b1a996640 1 -- 172.21.15.79:0/3859363571 shutdown_connections 2024-04-25T02:11:41.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.608+0000 7f6b1a996640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b0006be30 0x7f6b0006e2f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.608+0000 7f6b1a996640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b14143bc0 0x7f6b14141290 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.608+0000 7f6b1a996640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b140b3d40 0x7f6b14159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.608+0000 7f6b1a996640 1 --2- 172.21.15.79:0/3859363571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b1406df50 0x7f6b141f3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.608+0000 7f6b1a996640 1 -- 172.21.15.79:0/3859363571 >> 172.21.15.79:0/3859363571 conn(0x7f6b140cfc80 msgr2=0x7f6b140cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:41.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.608+0000 7f6b1a996640 1 -- 172.21.15.79:0/3859363571 shutdown_connections 2024-04-25T02:11:41.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.608+0000 7f6b1a996640 1 -- 172.21.15.79:0/3859363571 wait complete. 2024-04-25T02:11:41.626 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:11:41.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:11:41.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:11:41.666 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:11:41.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:11:41.666 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:11:41.721 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:11:41.721 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:11:41.721 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:11:41.739 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:11:41.739 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:11:41.739 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:11:41.739 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:11:41.776 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:11:41.776 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:11:41.777 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:11:41.777 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:11:41.796 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:11:41.796 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:11:41.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.907+0000 7f2ab6589640 1 Processor -- start 2024-04-25T02:11:41.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.907+0000 7f2ab6589640 1 -- start start 2024-04-25T02:11:41.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.908+0000 7f2ab6589640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2ab006df50 0x7f2ab006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.908+0000 7f2ab6589640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ab0071e00 con 0x7f2ab0143bc0 2024-04-25T02:11:41.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.908+0000 7f2ab6589640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ab00720a0 con 0x7f2ab00b2d30 2024-04-25T02:11:41.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.908+0000 7f2ab6589640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f2ab006e8f0 con 0x7f2ab006df50 2024-04-25T02:11:41.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.908+0000 7f2aaffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2ab0143bc0 0x7f2ab015f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45220/0 (socket says 172.21.15.79:45220) 2024-04-25T02:11:41.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.908+0000 7f2aaffff640 1 -- 172.21.15.79:0/1015974314 learned_addr learned my addr 172.21.15.79:0/1015974314 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:41.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaeffd640 1 -- 172.21.15.79:0/1015974314 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 957965170 0 0) 0x7f2ab0071e00 con 0x7f2ab0143bc0 2024-04-25T02:11:41.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaeffd640 1 -- 172.21.15.79:0/1015974314 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a98003520 con 0x7f2ab0143bc0 2024-04-25T02:11:41.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaf7fe640 1 --2- 172.21.15.79:0/1015974314 >> v2:172.21.15.189:3300/0 conn(0x7f2ab006df50 0x7f2ab006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaeffd640 1 -- 172.21.15.79:0/1015974314 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1289338024 0 0) 0x7f2a98003520 con 0x7f2ab0143bc0 2024-04-25T02:11:41.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaeffd640 1 -- 172.21.15.79:0/1015974314 >> v2:172.21.15.189:3300/0 conn(0x7f2ab006df50 msgr2=0x7f2ab006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:41.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaeffd640 1 --2- 172.21.15.79:0/1015974314 >> v2:172.21.15.189:3300/0 conn(0x7f2ab006df50 0x7f2ab006e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaeffd640 1 -- 172.21.15.79:0/1015974314 >> v1:172.21.15.189:6789/0 conn(0x7f2ab00b2d30 legacy=0x7f2ab00b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaeffd640 1 -- 172.21.15.79:0/1015974314 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab0072380 con 0x7f2ab0143bc0 2024-04-25T02:11:41.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaeffd640 1 -- 172.21.15.79:0/1015974314 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f2aa4001670 con 0x7f2ab0143bc0 2024-04-25T02:11:41.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaeffd640 1 -- 172.21.15.79:0/1015974314 >> v1:172.21.15.79:6789/0 conn(0x7f2ab0143bc0 legacy=0x7f2ab015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaeffd640 1 --2- 172.21.15.79:0/1015974314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a980039b0 0x7f2a98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaeffd640 1 --2- 172.21.15.79:0/1015974314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a98004800 0x7f2a98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaeffd640 1 --2- 172.21.15.79:0/1015974314 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a980051c0 0x7f2a9800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaeffd640 1 -- 172.21.15.79:0/1015974314 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9800c130 con 0x7f2a98004800 2024-04-25T02:11:41.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaeffd640 1 -- 172.21.15.79:0/1015974314 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9800c2e0 con 0x7f2a980039b0 2024-04-25T02:11:41.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaeffd640 1 -- 172.21.15.79:0/1015974314 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2a9800c4e0 con 0x7f2a980051c0 2024-04-25T02:11:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaf7fe640 1 --2- 172.21.15.79:0/1015974314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a98004800 0x7f2a98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaffff640 1 --2- 172.21.15.79:0/1015974314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a980039b0 0x7f2a98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2ab4b26640 1 --2- 172.21.15.79:0/1015974314 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a980051c0 0x7f2a9800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaf7fe640 1 -- 172.21.15.79:0/1015974314 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a980051c0 msgr2=0x7f2a9800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaf7fe640 1 --2- 172.21.15.79:0/1015974314 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a980051c0 0x7f2a9800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaf7fe640 1 -- 172.21.15.79:0/1015974314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a980039b0 msgr2=0x7f2a98003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaf7fe640 1 --2- 172.21.15.79:0/1015974314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a980039b0 0x7f2a98003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2aaf7fe640 1 -- 172.21.15.79:0/1015974314 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a98003520 con 0x7f2a98004800 2024-04-25T02:11:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.909+0000 7f2ab4b26640 1 -- 172.21.15.79:0/1015974314 reap_dead start 2024-04-25T02:11:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.910+0000 7f2aaf7fe640 1 --2- 172.21.15.79:0/1015974314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a98004800 0x7f2a98004c80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009ac0 tx=0x7f2a98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27627667c50ddc1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.910+0000 7f2aaeffd640 1 -- 172.21.15.79:0/1015974314 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0036070 con 0x7f2a98004800 2024-04-25T02:11:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.910+0000 7f2aaeffd640 1 -- 172.21.15.79:0/1015974314 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa0031400 con 0x7f2a98004800 2024-04-25T02:11:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.910+0000 7f2aaeffd640 1 -- 172.21.15.79:0/1015974314 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0009690 con 0x7f2a98004800 2024-04-25T02:11:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.911+0000 7f2ab6589640 1 -- 172.21.15.79:0/1015974314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a98004800 msgr2=0x7f2a98004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.911+0000 7f2ab6589640 1 --2- 172.21.15.79:0/1015974314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a98004800 0x7f2a98004c80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009ac0 tx=0x7f2a98005830 comp rx=0 tx=0).stop 2024-04-25T02:11:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.911+0000 7f2ab6589640 1 -- 172.21.15.79:0/1015974314 shutdown_connections 2024-04-25T02:11:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.911+0000 7f2ab6589640 1 --2- 172.21.15.79:0/1015974314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a98004800 0x7f2a98004c80 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.911+0000 7f2ab6589640 1 -- 172.21.15.79:0/1015974314 >> 172.21.15.79:0/1015974314 conn(0x7f2ab00cfc80 msgr2=0x7f2ab00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.911+0000 7f2ab6589640 1 -- 172.21.15.79:0/1015974314 shutdown_connections 2024-04-25T02:11:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.911+0000 7f2ab6589640 1 -- 172.21.15.79:0/1015974314 wait complete. 2024-04-25T02:11:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.912+0000 7f2ab6589640 1 Processor -- start 2024-04-25T02:11:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.912+0000 7f2ab6589640 1 -- start start 2024-04-25T02:11:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2ab6589640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a98004800 0x7f2ab00aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2ab6589640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ab0132880 0x7f2ab0070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2ab6589640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ab0071230 0x7f2ab0131750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2ab6589640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab0072940 con 0x7f2ab0132880 2024-04-25T02:11:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2ab6589640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab0072cb0 con 0x7f2a98004800 2024-04-25T02:11:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2ab6589640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab0143fa0 con 0x7f2ab0071230 2024-04-25T02:11:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2aaf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ab0132880 0x7f2ab0070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2aaf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ab0132880 0x7f2ab0070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58000/0 (socket says 172.21.15.79:58000) 2024-04-25T02:11:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2aaf7fe640 1 -- 172.21.15.79:0/774462523 learned_addr learned my addr 172.21.15.79:0/774462523 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2aaffff640 1 --2- 172.21.15.79:0/774462523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a98004800 0x7f2ab00aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2ab4b26640 1 --2- 172.21.15.79:0/774462523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ab0071230 0x7f2ab0131750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2aaf7fe640 1 -- 172.21.15.79:0/774462523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ab0071230 msgr2=0x7f2ab0131750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2aaf7fe640 1 --2- 172.21.15.79:0/774462523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ab0071230 0x7f2ab0131750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2aaf7fe640 1 -- 172.21.15.79:0/774462523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a98004800 msgr2=0x7f2ab00aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2aaf7fe640 1 --2- 172.21.15.79:0/774462523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a98004800 0x7f2ab00aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2aaf7fe640 1 -- 172.21.15.79:0/774462523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab00af340 con 0x7f2ab0132880 2024-04-25T02:11:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2ab4b26640 1 --2- 172.21.15.79:0/774462523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ab0071230 0x7f2ab0131750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:41.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2aaf7fe640 1 --2- 172.21.15.79:0/774462523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ab0132880 0x7f2ab0070cf0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009be0 tx=0x7f2aa0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:41.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2aacff9640 1 -- 172.21.15.79:0/774462523 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa003f020 con 0x7f2ab0132880 2024-04-25T02:11:41.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2aacff9640 1 -- 172.21.15.79:0/774462523 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa0037040 con 0x7f2ab0132880 2024-04-25T02:11:41.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2ab6589640 1 -- 172.21.15.79:0/774462523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab012f5e0 con 0x7f2ab0132880 2024-04-25T02:11:41.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2aacff9640 1 -- 172.21.15.79:0/774462523 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0036070 con 0x7f2ab0132880 2024-04-25T02:11:41.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.913+0000 7f2ab6589640 1 -- 172.21.15.79:0/774462523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab012fba0 con 0x7f2ab0132880 2024-04-25T02:11:41.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.915+0000 7f2ab6589640 1 -- 172.21.15.79:0/774462523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab00690a0 con 0x7f2ab0132880 2024-04-25T02:11:41.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.915+0000 7f2aacff9640 1 -- 172.21.15.79:0/774462523 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2aa0042020 con 0x7f2ab0132880 2024-04-25T02:11:41.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.915+0000 7f2aacff9640 1 --2- 172.21.15.79:0/774462523 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a9c06be60 0x7f2a9c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:41.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.915+0000 7f2aaffff640 1 --2- 172.21.15.79:0/774462523 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a9c06be60 0x7f2a9c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:41.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.915+0000 7f2aacff9640 1 -- 172.21.15.79:0/774462523 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f2aa00aa590 con 0x7f2ab0132880 2024-04-25T02:11:41.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.916+0000 7f2aaffff640 1 --2- 172.21.15.79:0/774462523 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a9c06be60 0x7f2a9c06e320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4001050 tx=0x7f2aa4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:41.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:41.920+0000 7f2aacff9640 1 -- 172.21.15.79:0/774462523 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2aa0078fd0 con 0x7f2ab0132880 2024-04-25T02:11:42.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.126+0000 7f2ab6589640 1 -- 172.21.15.79:0/774462523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ab0071610 con 0x7f2ab0132880 2024-04-25T02:11:42.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.126+0000 7f2aacff9640 1 -- 172.21.15.79:0/774462523 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5185 (secure 0 0 0) 0x7f2aa00788d0 con 0x7f2ab0132880 2024-04-25T02:11:42.134 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:42.135 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5431,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3495029157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3495029157},{"type":"v1","addr":"172.21.15.189:6834","nonce":3495029157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2036557544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2036557544},{"type":"v1","addr":"172.21.15.189:6835","nonce":2036557544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/326759836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":326759836},{"type":"v1","addr":"172.21.15.79:6836","nonce":326759836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:25.684570+0000","modified":"2024-04-25T02:11:14.376645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.79:6837/2253487658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2253487658},{"type":"v1","addr":"172.21.15.79:6837","nonce":2253487658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":4}]} 2024-04-25T02:11:42.135 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 26 2024-04-25T02:11:42.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.128+0000 7f2ab6589640 1 -- 172.21.15.79:0/774462523 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a9c06be60 msgr2=0x7f2a9c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.128+0000 7f2ab6589640 1 --2- 172.21.15.79:0/774462523 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a9c06be60 0x7f2a9c06e320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4001050 tx=0x7f2aa4009040 comp rx=0 tx=0).stop 2024-04-25T02:11:42.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.128+0000 7f2ab6589640 1 -- 172.21.15.79:0/774462523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ab0132880 msgr2=0x7f2ab0070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.128+0000 7f2ab6589640 1 --2- 172.21.15.79:0/774462523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ab0132880 0x7f2ab0070cf0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009be0 tx=0x7f2aa0004730 comp rx=0 tx=0).stop 2024-04-25T02:11:42.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.128+0000 7f2ab6589640 1 -- 172.21.15.79:0/774462523 shutdown_connections 2024-04-25T02:11:42.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.128+0000 7f2ab6589640 1 --2- 172.21.15.79:0/774462523 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a9c06be60 0x7f2a9c06e320 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.128+0000 7f2ab6589640 1 --2- 172.21.15.79:0/774462523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ab0071230 0x7f2ab0131750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.128+0000 7f2ab6589640 1 --2- 172.21.15.79:0/774462523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ab0132880 0x7f2ab0070cf0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.128+0000 7f2ab6589640 1 --2- 172.21.15.79:0/774462523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a98004800 0x7f2ab00aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.128+0000 7f2ab6589640 1 -- 172.21.15.79:0/774462523 >> 172.21.15.79:0/774462523 conn(0x7f2ab00cfc80 msgr2=0x7f2ab00cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:42.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.128+0000 7f2ab6589640 1 -- 172.21.15.79:0/774462523 shutdown_connections 2024-04-25T02:11:42.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.128+0000 7f2ab6589640 1 -- 172.21.15.79:0/774462523 wait complete. 2024-04-25T02:11:42.147 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:11:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.236+0000 7fe9cb44c640 1 Processor -- start 2024-04-25T02:11:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.236+0000 7fe9cb44c640 1 -- start start 2024-04-25T02:11:42.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.237+0000 7fe9cb44c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40d07a0 0x7fe9c40b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.237+0000 7fe9cb44c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe9c40b47e0 0x7fe9c4070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.237+0000 7fe9cb44c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c415bb10 con 0x7fe9c415a720 2024-04-25T02:11:42.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.237+0000 7fe9cb44c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe9c40b2e60 con 0x7fe9c40b47e0 2024-04-25T02:11:42.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.237+0000 7fe9cb44c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c40b3140 con 0x7fe9c40d07a0 2024-04-25T02:11:42.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.237+0000 7fe9c89e7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40d07a0 0x7fe9c40b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.237+0000 7fe9c99e9640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe9c40b47e0 0x7fe9c4070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.237+0000 7fe9c91e8640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fe9c415a720 0x7fe9c415ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:59998/0 (socket says 172.21.15.79:59998) 2024-04-25T02:11:42.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.237+0000 7fe9c89e7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40d07a0 0x7fe9c40b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:53508/0 (socket says 172.21.15.79:53508) 2024-04-25T02:11:42.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.237+0000 7fe9c91e8640 1 -- 172.21.15.79:0/4186091676 learned_addr learned my addr 172.21.15.79:0/4186091676 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:42.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.237+0000 7fe9c89e7640 1 -- 172.21.15.79:0/4186091676 >> v2:172.21.15.189:3300/0 conn(0x7fe9c40b47e0 msgr2=0x7fe9c4070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:42.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.237+0000 7fe9c89e7640 1 --2- 172.21.15.79:0/4186091676 >> v2:172.21.15.189:3300/0 conn(0x7fe9c40b47e0 0x7fe9c4070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.237+0000 7fe9c89e7640 1 -- 172.21.15.79:0/4186091676 >> v1:172.21.15.189:6789/0 conn(0x7fe9c415a720 legacy=0x7fe9c415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.237+0000 7fe9c89e7640 1 -- 172.21.15.79:0/4186091676 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c40b3420 con 0x7fe9c40d07a0 2024-04-25T02:11:42.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.237+0000 7fe9c99e9640 1 --2- 172.21.15.79:0/4186091676 >> v2:172.21.15.189:3300/0 conn(0x7fe9c40b47e0 0x7fe9c4070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:42.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.238+0000 7fe9c89e7640 1 --2- 172.21.15.79:0/4186091676 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40d07a0 0x7fe9c40b42a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40097a0 tx=0x7fe9b402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5946d5b90e0ca1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:42.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.238+0000 7fe9bbfff640 1 -- 172.21.15.79:0/4186091676 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4037070 con 0x7fe9c40d07a0 2024-04-25T02:11:42.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.238+0000 7fe9bbfff640 1 -- 172.21.15.79:0/4186091676 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b402ae50 con 0x7fe9c40d07a0 2024-04-25T02:11:42.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.238+0000 7fe9bbfff640 1 -- 172.21.15.79:0/4186091676 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4032660 con 0x7fe9c40d07a0 2024-04-25T02:11:42.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.239+0000 7fe9cb44c640 1 -- 172.21.15.79:0/4186091676 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40d07a0 msgr2=0x7fe9c40b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.239+0000 7fe9cb44c640 1 --2- 172.21.15.79:0/4186091676 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40d07a0 0x7fe9c40b42a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40097a0 tx=0x7fe9b402a100 comp rx=0 tx=0).stop 2024-04-25T02:11:42.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.239+0000 7fe9cb44c640 1 -- 172.21.15.79:0/4186091676 shutdown_connections 2024-04-25T02:11:42.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.239+0000 7fe9cb44c640 1 --2- 172.21.15.79:0/4186091676 >> v2:172.21.15.189:3300/0 conn(0x7fe9c40b47e0 0x7fe9c4070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.239+0000 7fe9cb44c640 1 --2- 172.21.15.79:0/4186091676 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40d07a0 0x7fe9c40b42a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.239+0000 7fe9cb44c640 1 -- 172.21.15.79:0/4186091676 >> 172.21.15.79:0/4186091676 conn(0x7fe9c40cfc80 msgr2=0x7fe9c40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:42.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.239+0000 7fe9cb44c640 1 -- 172.21.15.79:0/4186091676 shutdown_connections 2024-04-25T02:11:42.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.239+0000 7fe9cb44c640 1 -- 172.21.15.79:0/4186091676 wait complete. 2024-04-25T02:11:42.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.240+0000 7fe9cb44c640 1 Processor -- start 2024-04-25T02:11:42.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.240+0000 7fe9cb44c640 1 -- start start 2024-04-25T02:11:42.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9cb44c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40b47e0 0x7fe9c41f3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9cb44c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9c40d07a0 0x7fe9c41558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9cb44c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c415a720 0x7fe9c40ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9cb44c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c406df50 con 0x7fe9c415a720 2024-04-25T02:11:42.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9cb44c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c40b39e0 con 0x7fe9c40d07a0 2024-04-25T02:11:42.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9cb44c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c406e0d0 con 0x7fe9c40b47e0 2024-04-25T02:11:42.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9c99e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c415a720 0x7fe9c40ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9c99e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c415a720 0x7fe9c40ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58016/0 (socket says 172.21.15.79:58016) 2024-04-25T02:11:42.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9c99e9640 1 -- 172.21.15.79:0/3204564203 learned_addr learned my addr 172.21.15.79:0/3204564203 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:42.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9c89e7640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9c40d07a0 0x7fe9c41558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9c91e8640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40b47e0 0x7fe9c41f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9c99e9640 1 -- 172.21.15.79:0/3204564203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40b47e0 msgr2=0x7fe9c41f3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9c99e9640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40b47e0 0x7fe9c41f3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9c99e9640 1 -- 172.21.15.79:0/3204564203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9c40d07a0 msgr2=0x7fe9c41558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9c99e9640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9c40d07a0 0x7fe9c41558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9c99e9640 1 -- 172.21.15.79:0/3204564203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c4142130 con 0x7fe9c415a720 2024-04-25T02:11:42.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9c89e7640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9c40d07a0 0x7fe9c41558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:42.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9c91e8640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40b47e0 0x7fe9c41f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:42.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9c99e9640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c415a720 0x7fe9c40ae1f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc009f00 tx=0x7fe9bc0075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:42.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.241+0000 7fe9b9ffb640 1 -- 172.21.15.79:0/3204564203 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc003990 con 0x7fe9c415a720 2024-04-25T02:11:42.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.242+0000 7fe9b9ffb640 1 -- 172.21.15.79:0/3204564203 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9bc003b30 con 0x7fe9c415a720 2024-04-25T02:11:42.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.242+0000 7fe9cb44c640 1 -- 172.21.15.79:0/3204564203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c4142410 con 0x7fe9c415a720 2024-04-25T02:11:42.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.242+0000 7fe9b9ffb640 1 -- 172.21.15.79:0/3204564203 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc004020 con 0x7fe9c415a720 2024-04-25T02:11:42.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.242+0000 7fe9cb44c640 1 -- 172.21.15.79:0/3204564203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c41429d0 con 0x7fe9c415a720 2024-04-25T02:11:42.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.243+0000 7fe9cb44c640 1 -- 172.21.15.79:0/3204564203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c40690a0 con 0x7fe9c415a720 2024-04-25T02:11:42.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.243+0000 7fe9b9ffb640 1 -- 172.21.15.79:0/3204564203 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9bc005d10 con 0x7fe9c415a720 2024-04-25T02:11:42.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.243+0000 7fe9b9ffb640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe9a806be30 0x7fe9a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.243+0000 7fe9b9ffb640 1 -- 172.21.15.79:0/3204564203 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fe9bc08b0e0 con 0x7fe9c415a720 2024-04-25T02:11:42.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.243+0000 7fe9c91e8640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe9a806be30 0x7fe9a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.244+0000 7fe9c91e8640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe9a806be30 0x7fe9a806e2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0000f60 tx=0x7fe9c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:42.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.247+0000 7fe9b9ffb640 1 -- 172.21.15.79:0/3204564203 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe9bc022020 con 0x7fe9c415a720 2024-04-25T02:11:42.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.421+0000 7fe9cb44c640 1 -- 172.21.15.79:0/3204564203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9c40af9a0 con 0x7fe9c415a720 2024-04-25T02:11:42.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.422+0000 7fe9b9ffb640 1 -- 172.21.15.79:0/3204564203 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16677 (secure 0 0 0) 0x7fe9bc011070 con 0x7fe9c415a720 2024-04-25T02:11:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:42.430 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":59,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:10:27.345273+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:23.901352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:24.658248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:11:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.424+0000 7fe9cb44c640 1 -- 172.21.15.79:0/3204564203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe9a806be30 msgr2=0x7fe9a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.424+0000 7fe9cb44c640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe9a806be30 0x7fe9a806e2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0000f60 tx=0x7fe9c0009040 comp rx=0 tx=0).stop 2024-04-25T02:11:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.424+0000 7fe9cb44c640 1 -- 172.21.15.79:0/3204564203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c415a720 msgr2=0x7fe9c40ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.424+0000 7fe9cb44c640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c415a720 0x7fe9c40ae1f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc009f00 tx=0x7fe9bc0075c0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.424+0000 7fe9cb44c640 1 -- 172.21.15.79:0/3204564203 shutdown_connections 2024-04-25T02:11:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.424+0000 7fe9cb44c640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe9a806be30 0x7fe9a806e2f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.424+0000 7fe9cb44c640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c415a720 0x7fe9c40ae1f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.424+0000 7fe9cb44c640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9c40d07a0 0x7fe9c41558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.424+0000 7fe9cb44c640 1 --2- 172.21.15.79:0/3204564203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40b47e0 0x7fe9c41f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.424+0000 7fe9cb44c640 1 -- 172.21.15.79:0/3204564203 >> 172.21.15.79:0/3204564203 conn(0x7fe9c40cfc80 msgr2=0x7fe9c415be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:42.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.425+0000 7fe9cb44c640 1 -- 172.21.15.79:0/3204564203 shutdown_connections 2024-04-25T02:11:42.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.425+0000 7fe9cb44c640 1 -- 172.21.15.79:0/3204564203 wait complete. 2024-04-25T02:11:42.443 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:10:23.901352+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:10:24.658248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:11:42.443 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:11:42.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.535+0000 7f5d2e563640 1 Processor -- start 2024-04-25T02:11:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.535+0000 7f5d2e563640 1 -- start start 2024-04-25T02:11:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d2e563640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d280d2a60 0x7f5d2806cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d2e563640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5d280ccb50 0x7f5d280ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d2e563640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d280d1460 con 0x7f5d2815e5a0 2024-04-25T02:11:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d2e563640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f5d280cc6c0 con 0x7f5d280ccb50 2024-04-25T02:11:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d2e563640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5d280cf7d0 con 0x7f5d280d2a60 2024-04-25T02:11:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d27fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5d2815e5a0 0x7f5d2806c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45236/0 (socket says 172.21.15.79:45236) 2024-04-25T02:11:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d27fff640 1 -- 172.21.15.79:0/4251372619 learned_addr learned my addr 172.21.15.79:0/4251372619 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 -- 172.21.15.79:0/4251372619 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553642931 0 0) 0x7f5d280d1460 con 0x7f5d2815e5a0 2024-04-25T02:11:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d2cb00640 1 --2- 172.21.15.79:0/4251372619 >> v2:172.21.15.189:3300/0 conn(0x7f5d280ccb50 0x7f5d280ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d277fe640 1 --2- 172.21.15.79:0/4251372619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d280d2a60 0x7f5d2806cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 -- 172.21.15.79:0/4251372619 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d10003520 con 0x7f5d2815e5a0 2024-04-25T02:11:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 -- 172.21.15.79:0/4251372619 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 745118789 0 0) 0x7f5d10003520 con 0x7f5d2815e5a0 2024-04-25T02:11:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 -- 172.21.15.79:0/4251372619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d280d2a60 msgr2=0x7f5d2806cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 --2- 172.21.15.79:0/4251372619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d280d2a60 0x7f5d2806cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 -- 172.21.15.79:0/4251372619 >> v2:172.21.15.189:3300/0 conn(0x7f5d280ccb50 msgr2=0x7f5d280ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 --2- 172.21.15.79:0/4251372619 >> v2:172.21.15.189:3300/0 conn(0x7f5d280ccb50 0x7f5d280ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 -- 172.21.15.79:0/4251372619 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d280d0bc0 con 0x7f5d2815e5a0 2024-04-25T02:11:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 -- 172.21.15.79:0/4251372619 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f5d18001670 con 0x7f5d2815e5a0 2024-04-25T02:11:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 -- 172.21.15.79:0/4251372619 >> v1:172.21.15.79:6789/0 conn(0x7f5d2815e5a0 legacy=0x7f5d2806c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 --2- 172.21.15.79:0/4251372619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d280d2a60 0x7f5d100039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 --2- 172.21.15.79:0/4251372619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d10003f30 0x7f5d10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 --2- 172.21.15.79:0/4251372619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d10004d40 0x7f5d100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 -- 172.21.15.79:0/4251372619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d280cc6c0 con 0x7f5d10004d40 2024-04-25T02:11:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 -- 172.21.15.79:0/4251372619 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5d280cf7d0 con 0x7f5d10003f30 2024-04-25T02:11:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d26ffd640 1 -- 172.21.15.79:0/4251372619 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5d1000b9c0 con 0x7f5d280d2a60 2024-04-25T02:11:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d2cb00640 1 --2- 172.21.15.79:0/4251372619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d10004d40 0x7f5d100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d27fff640 1 --2- 172.21.15.79:0/4251372619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d280d2a60 0x7f5d100039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.536+0000 7f5d277fe640 1 --2- 172.21.15.79:0/4251372619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d10003f30 0x7f5d10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.537+0000 7f5d2cb00640 1 -- 172.21.15.79:0/4251372619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d280d2a60 msgr2=0x7f5d100039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.537+0000 7f5d2cb00640 1 --2- 172.21.15.79:0/4251372619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d280d2a60 0x7f5d100039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.537+0000 7f5d2cb00640 1 -- 172.21.15.79:0/4251372619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d10003f30 msgr2=0x7f5d10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.537+0000 7f5d2cb00640 1 --2- 172.21.15.79:0/4251372619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d10003f30 0x7f5d10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.537+0000 7f5d2cb00640 1 -- 172.21.15.79:0/4251372619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d10003520 con 0x7f5d10004d40 2024-04-25T02:11:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.537+0000 7f5d2cb00640 1 --2- 172.21.15.79:0/4251372619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d10004d40 0x7f5d100051c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009fc0 tx=0x7f5d10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd023508c3fd8bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.537+0000 7f5d26ffd640 1 -- 172.21.15.79:0/4251372619 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20009c10 con 0x7f5d10004d40 2024-04-25T02:11:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.537+0000 7f5d26ffd640 1 -- 172.21.15.79:0/4251372619 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d20036070 con 0x7f5d10004d40 2024-04-25T02:11:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.537+0000 7f5d26ffd640 1 -- 172.21.15.79:0/4251372619 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2002d070 con 0x7f5d10004d40 2024-04-25T02:11:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.538+0000 7f5d2e563640 1 -- 172.21.15.79:0/4251372619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d10004d40 msgr2=0x7f5d100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.538+0000 7f5d2e563640 1 --2- 172.21.15.79:0/4251372619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d10004d40 0x7f5d100051c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009fc0 tx=0x7f5d10005830 comp rx=0 tx=0).stop 2024-04-25T02:11:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.538+0000 7f5d2cb00640 1 -- 172.21.15.79:0/4251372619 reap_dead start 2024-04-25T02:11:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.538+0000 7f5d2e563640 1 -- 172.21.15.79:0/4251372619 shutdown_connections 2024-04-25T02:11:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.538+0000 7f5d2e563640 1 -- 172.21.15.79:0/4251372619 >> 172.21.15.79:0/4251372619 conn(0x7f5d280d1f40 msgr2=0x7f5d280d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:42.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.538+0000 7f5d2e563640 1 -- 172.21.15.79:0/4251372619 shutdown_connections 2024-04-25T02:11:42.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.538+0000 7f5d2e563640 1 -- 172.21.15.79:0/4251372619 wait complete. 2024-04-25T02:11:42.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.539+0000 7f5d2e563640 1 Processor -- start 2024-04-25T02:11:42.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.539+0000 7f5d2e563640 1 -- start start 2024-04-25T02:11:42.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d2e563640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d280cae00 0x7f5d280c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d2e563640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d280cb1e0 0x7f5d280c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d2e563640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d2815cbb0 0x7f5d2815d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d2e563640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2815e980 con 0x7f5d280cae00 2024-04-25T02:11:42.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d2e563640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5d280d1180 con 0x7f5d2815cbb0 2024-04-25T02:11:42.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d2e563640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2815eb00 con 0x7f5d280cb1e0 2024-04-25T02:11:42.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d280cae00 0x7f5d280c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d280cae00 0x7f5d280c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58038/0 (socket says 172.21.15.79:58038) 2024-04-25T02:11:42.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d27fff640 1 -- 172.21.15.79:0/609501545 learned_addr learned my addr 172.21.15.79:0/609501545 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:42.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d277fe640 1 --2- 172.21.15.79:0/609501545 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d280cb1e0 0x7f5d280c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d2cb00640 1 --2- 172.21.15.79:0/609501545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d2815cbb0 0x7f5d2815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d27fff640 1 -- 172.21.15.79:0/609501545 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d280cb1e0 msgr2=0x7f5d280c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d27fff640 1 --2- 172.21.15.79:0/609501545 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d280cb1e0 0x7f5d280c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d27fff640 1 -- 172.21.15.79:0/609501545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d2815cbb0 msgr2=0x7f5d2815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d27fff640 1 --2- 172.21.15.79:0/609501545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d2815cbb0 0x7f5d2815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d27fff640 1 -- 172.21.15.79:0/609501545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d280cb760 con 0x7f5d280cae00 2024-04-25T02:11:42.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.540+0000 7f5d2cb00640 1 --2- 172.21.15.79:0/609501545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d2815cbb0 0x7f5d2815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:42.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.541+0000 7f5d27fff640 1 --2- 172.21.15.79:0/609501545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d280cae00 0x7f5d280c89c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f5d180017e0 tx=0x7f5d18007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:42.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.541+0000 7f5d24ff9640 1 -- 172.21.15.79:0/609501545 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1800fa80 con 0x7f5d280cae00 2024-04-25T02:11:42.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.541+0000 7f5d24ff9640 1 -- 172.21.15.79:0/609501545 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d18018070 con 0x7f5d280cae00 2024-04-25T02:11:42.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.541+0000 7f5d2e563640 1 -- 172.21.15.79:0/609501545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d280cba40 con 0x7f5d280cae00 2024-04-25T02:11:42.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.541+0000 7f5d24ff9640 1 -- 172.21.15.79:0/609501545 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1800fe60 con 0x7f5d280cae00 2024-04-25T02:11:42.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.541+0000 7f5d2e563640 1 -- 172.21.15.79:0/609501545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d280cc000 con 0x7f5d280cae00 2024-04-25T02:11:42.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.542+0000 7f5d2e563640 1 -- 172.21.15.79:0/609501545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d280c9550 con 0x7f5d280cae00 2024-04-25T02:11:42.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.542+0000 7f5d24ff9640 1 -- 172.21.15.79:0/609501545 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d1801d460 con 0x7f5d280cae00 2024-04-25T02:11:42.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.543+0000 7f5d24ff9640 1 --2- 172.21.15.79:0/609501545 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d1406be30 0x7f5d1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.543+0000 7f5d277fe640 1 --2- 172.21.15.79:0/609501545 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d1406be30 0x7f5d1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.543+0000 7f5d24ff9640 1 -- 172.21.15.79:0/609501545 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f5d1808b020 con 0x7f5d280cae00 2024-04-25T02:11:42.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.543+0000 7f5d277fe640 1 --2- 172.21.15.79:0/609501545 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d1406be30 0x7f5d1406e2f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009a40 tx=0x7f5d1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:42.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.547+0000 7f5d24ff9640 1 -- 172.21.15.79:0/609501545 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5d180599d0 con 0x7f5d280cae00 2024-04-25T02:11:42.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.718+0000 7f5d2e563640 1 -- 172.21.15.79:0/609501545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5d280690a0 con 0x7f5d280cae00 2024-04-25T02:11:42.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.718+0000 7f5d24ff9640 1 -- 172.21.15.79:0/609501545 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) ==== 93+0+10 (secure 0 0 0) 0x7f5d180592d0 con 0x7f5d280cae00 2024-04-25T02:11:42.725 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:11:42.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.720+0000 7f5d2e563640 1 -- 172.21.15.79:0/609501545 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d1406be30 msgr2=0x7f5d1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.720+0000 7f5d2e563640 1 --2- 172.21.15.79:0/609501545 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d1406be30 0x7f5d1406e2f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009a40 tx=0x7f5d1c008040 comp rx=0 tx=0).stop 2024-04-25T02:11:42.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.720+0000 7f5d2e563640 1 -- 172.21.15.79:0/609501545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d280cae00 msgr2=0x7f5d280c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.720+0000 7f5d2e563640 1 --2- 172.21.15.79:0/609501545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d280cae00 0x7f5d280c89c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f5d180017e0 tx=0x7f5d18007720 comp rx=0 tx=0).stop 2024-04-25T02:11:42.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.720+0000 7f5d2e563640 1 -- 172.21.15.79:0/609501545 shutdown_connections 2024-04-25T02:11:42.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.720+0000 7f5d2e563640 1 --2- 172.21.15.79:0/609501545 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d1406be30 0x7f5d1406e2f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.720+0000 7f5d2e563640 1 --2- 172.21.15.79:0/609501545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d2815cbb0 0x7f5d2815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.720+0000 7f5d2e563640 1 --2- 172.21.15.79:0/609501545 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d280cb1e0 0x7f5d280c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.720+0000 7f5d2e563640 1 --2- 172.21.15.79:0/609501545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d280cae00 0x7f5d280c89c0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.720+0000 7f5d2e563640 1 -- 172.21.15.79:0/609501545 >> 172.21.15.79:0/609501545 conn(0x7f5d280d1f40 msgr2=0x7f5d2806fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:42.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.720+0000 7f5d2e563640 1 -- 172.21.15.79:0/609501545 shutdown_connections 2024-04-25T02:11:42.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.720+0000 7f5d2e563640 1 -- 172.21.15.79:0/609501545 wait complete. 2024-04-25T02:11:42.738 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:11:42.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.829+0000 7f1170b4c640 1 Processor -- start 2024-04-25T02:11:42.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.829+0000 7f1170b4c640 1 -- start start 2024-04-25T02:11:42.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.830+0000 7f1170b4c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f116c06fe40 0x7f116c06c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.830+0000 7f1170b4c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f116c0cc000 0x7f116c06c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.830+0000 7f1170b4c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f116c0cfc10 0x7f116c0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.830+0000 7f1170b4c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f116c15abe0 con 0x7f116c0cc000 2024-04-25T02:11:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.830+0000 7f1170b4c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f116c0cf9d0 con 0x7f116c06fe40 2024-04-25T02:11:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.830+0000 7f1170b4c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f116c15e370 con 0x7f116c0cfc10 2024-04-25T02:11:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.830+0000 7f1163fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f116c0cc000 0x7f116c06c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.830+0000 7f1163fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f116c0cc000 0x7f116c06c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58044/0 (socket says 172.21.15.79:58044) 2024-04-25T02:11:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.830+0000 7f1163fff640 1 -- 172.21.15.79:0/3707858198 learned_addr learned my addr 172.21.15.79:0/3707858198 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.830+0000 7f116ad9d640 1 --2- 172.21.15.79:0/3707858198 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f116c0cfc10 0x7f116c0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.830+0000 7f116a59c640 1 --2- 172.21.15.79:0/3707858198 >> v2:172.21.15.189:3300/0 conn(0x7f116c06fe40 0x7f116c06c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.831+0000 7f1163fff640 1 -- 172.21.15.79:0/3707858198 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f116c0cfc10 msgr2=0x7f116c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.831+0000 7f1163fff640 1 --2- 172.21.15.79:0/3707858198 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f116c0cfc10 0x7f116c0ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.831+0000 7f1163fff640 1 -- 172.21.15.79:0/3707858198 >> v2:172.21.15.189:3300/0 conn(0x7f116c06fe40 msgr2=0x7f116c06c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:42.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.831+0000 7f1163fff640 1 --2- 172.21.15.79:0/3707858198 >> v2:172.21.15.189:3300/0 conn(0x7f116c06fe40 0x7f116c06c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.831+0000 7f1163fff640 1 -- 172.21.15.79:0/3707858198 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c15e650 con 0x7f116c0cc000 2024-04-25T02:11:42.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.831+0000 7f1163fff640 1 --2- 172.21.15.79:0/3707858198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f116c0cc000 0x7f116c06c600 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f116c06d1f0 tx=0x7f115402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4023bdc2d470aa1c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:42.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.831+0000 7f1169d9b640 1 -- 172.21.15.79:0/3707858198 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154037070 con 0x7f116c0cc000 2024-04-25T02:11:42.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.831+0000 7f1169d9b640 1 -- 172.21.15.79:0/3707858198 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1154032440 con 0x7f116c0cc000 2024-04-25T02:11:42.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.831+0000 7f1169d9b640 1 -- 172.21.15.79:0/3707858198 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154032810 con 0x7f116c0cc000 2024-04-25T02:11:42.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.832+0000 7f1170b4c640 1 -- 172.21.15.79:0/3707858198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f116c0cc000 msgr2=0x7f116c06c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.832+0000 7f1170b4c640 1 --2- 172.21.15.79:0/3707858198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f116c0cc000 0x7f116c06c600 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f116c06d1f0 tx=0x7f115402a180 comp rx=0 tx=0).stop 2024-04-25T02:11:42.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.832+0000 7f1170b4c640 1 -- 172.21.15.79:0/3707858198 shutdown_connections 2024-04-25T02:11:42.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.832+0000 7f1170b4c640 1 --2- 172.21.15.79:0/3707858198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f116c0cc000 0x7f116c06c600 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.832+0000 7f1170b4c640 1 --2- 172.21.15.79:0/3707858198 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f116c0cfc10 0x7f116c0ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.832+0000 7f1170b4c640 1 --2- 172.21.15.79:0/3707858198 >> v2:172.21.15.189:3300/0 conn(0x7f116c06fe40 0x7f116c06c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.832+0000 7f1170b4c640 1 -- 172.21.15.79:0/3707858198 >> 172.21.15.79:0/3707858198 conn(0x7f116c0716b0 msgr2=0x7f116c071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:42.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.832+0000 7f1170b4c640 1 -- 172.21.15.79:0/3707858198 shutdown_connections 2024-04-25T02:11:42.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.832+0000 7f1170b4c640 1 -- 172.21.15.79:0/3707858198 wait complete. 2024-04-25T02:11:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.833+0000 7f1170b4c640 1 Processor -- start 2024-04-25T02:11:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.833+0000 7f1170b4c640 1 -- start start 2024-04-25T02:11:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f1170b4c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f116c06fe40 0x7f116c1f7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f1170b4c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f116c0cc000 0x7f116c15ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f1170b4c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f116c0cfc10 0x7f116c147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f1170b4c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f116c15f130 con 0x7f116c0cfc10 2024-04-25T02:11:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f1170b4c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f116c15ec10 con 0x7f116c0cc000 2024-04-25T02:11:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f1170b4c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f116c06f030 con 0x7f116c06fe40 2024-04-25T02:11:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f116ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f116c0cfc10 0x7f116c147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f116ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f116c0cfc10 0x7f116c147110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58052/0 (socket says 172.21.15.79:58052) 2024-04-25T02:11:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f116ad9d640 1 -- 172.21.15.79:0/2713560676 learned_addr learned my addr 172.21.15.79:0/2713560676 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f1163fff640 1 --2- 172.21.15.79:0/2713560676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f116c0cc000 0x7f116c15ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f116a59c640 1 --2- 172.21.15.79:0/2713560676 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f116c06fe40 0x7f116c1f7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f116ad9d640 1 -- 172.21.15.79:0/2713560676 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f116c06fe40 msgr2=0x7f116c1f7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f116ad9d640 1 --2- 172.21.15.79:0/2713560676 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f116c06fe40 0x7f116c1f7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f116ad9d640 1 -- 172.21.15.79:0/2713560676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f116c0cc000 msgr2=0x7f116c15ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f116ad9d640 1 --2- 172.21.15.79:0/2713560676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f116c0cc000 0x7f116c15ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.834+0000 7f116ad9d640 1 -- 172.21.15.79:0/2713560676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c15d4b0 con 0x7f116c0cfc10 2024-04-25T02:11:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.835+0000 7f116ad9d640 1 --2- 172.21.15.79:0/2713560676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f116c0cfc10 0x7f116c147110 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1164007e70 tx=0x7f116400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.835+0000 7f1162ffd640 1 -- 172.21.15.79:0/2713560676 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1164014620 con 0x7f116c0cfc10 2024-04-25T02:11:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.835+0000 7f1162ffd640 1 -- 172.21.15.79:0/2713560676 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1164019070 con 0x7f116c0cfc10 2024-04-25T02:11:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.835+0000 7f1162ffd640 1 -- 172.21.15.79:0/2713560676 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1164014a20 con 0x7f116c0cfc10 2024-04-25T02:11:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.835+0000 7f1170b4c640 1 -- 172.21.15.79:0/2713560676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116c15d730 con 0x7f116c0cfc10 2024-04-25T02:11:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.835+0000 7f1170b4c640 1 -- 172.21.15.79:0/2713560676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116c15dcf0 con 0x7f116c0cfc10 2024-04-25T02:11:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.836+0000 7f1170b4c640 1 -- 172.21.15.79:0/2713560676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f116c15df30 con 0x7f116c0cfc10 2024-04-25T02:11:42.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.836+0000 7f1162ffd640 1 -- 172.21.15.79:0/2713560676 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1164014bc0 con 0x7f116c0cfc10 2024-04-25T02:11:42.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.836+0000 7f1162ffd640 1 --2- 172.21.15.79:0/2713560676 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f114c06be30 0x7f114c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:42.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.837+0000 7f1162ffd640 1 -- 172.21.15.79:0/2713560676 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f116408b6c0 con 0x7f116c0cfc10 2024-04-25T02:11:42.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.837+0000 7f116a59c640 1 --2- 172.21.15.79:0/2713560676 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f114c06be30 0x7f114c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:42.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.837+0000 7f116a59c640 1 --2- 172.21.15.79:0/2713560676 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f114c06be30 0x7f114c06e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f115c006fd0 tx=0x7f115c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:42.841+0000 7f1162ffd640 1 -- 172.21.15.79:0/2713560676 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f116c15d4b0 con 0x7f116c0cfc10 2024-04-25T02:11:43.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.013+0000 7f1170b4c640 1 -- 172.21.15.79:0/2713560676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f116c0690a0 con 0x7f116c0cfc10 2024-04-25T02:11:43.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.014+0000 7f1162ffd640 1 -- 172.21.15.79:0/2713560676 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) ==== 104+0+11 (secure 0 0 0) 0x7f116405a070 con 0x7f116c0cfc10 2024-04-25T02:11:43.022 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:11:43.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.016+0000 7f1170b4c640 1 -- 172.21.15.79:0/2713560676 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f114c06be30 msgr2=0x7f114c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.016+0000 7f1170b4c640 1 --2- 172.21.15.79:0/2713560676 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f114c06be30 0x7f114c06e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f115c006fd0 tx=0x7f115c008040 comp rx=0 tx=0).stop 2024-04-25T02:11:43.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.016+0000 7f1170b4c640 1 -- 172.21.15.79:0/2713560676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f116c0cfc10 msgr2=0x7f116c147110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.016+0000 7f1170b4c640 1 --2- 172.21.15.79:0/2713560676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f116c0cfc10 0x7f116c147110 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1164007e70 tx=0x7f116400e4b0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.016+0000 7f1170b4c640 1 -- 172.21.15.79:0/2713560676 shutdown_connections 2024-04-25T02:11:43.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.016+0000 7f1170b4c640 1 --2- 172.21.15.79:0/2713560676 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f114c06be30 0x7f114c06e2f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.016+0000 7f1170b4c640 1 --2- 172.21.15.79:0/2713560676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f116c0cfc10 0x7f116c147110 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.016+0000 7f1170b4c640 1 --2- 172.21.15.79:0/2713560676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f116c0cc000 0x7f116c15ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.016+0000 7f1170b4c640 1 --2- 172.21.15.79:0/2713560676 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f116c06fe40 0x7f116c1f7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.016+0000 7f1170b4c640 1 -- 172.21.15.79:0/2713560676 >> 172.21.15.79:0/2713560676 conn(0x7f116c0716b0 msgr2=0x7f116c159fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:43.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.016+0000 7f1170b4c640 1 -- 172.21.15.79:0/2713560676 shutdown_connections 2024-04-25T02:11:43.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.016+0000 7f1170b4c640 1 -- 172.21.15.79:0/2713560676 wait complete. 2024-04-25T02:11:43.034 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:11:43.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.125+0000 7fe51c91d640 1 Processor -- start 2024-04-25T02:11:43.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.125+0000 7fe51c91d640 1 -- start start 2024-04-25T02:11:43.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.126+0000 7fe51c91d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe51815e4f0 0x7fe5180d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.126+0000 7fe51c91d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe5180cf7f0 0x7fe5180d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.126+0000 7fe51c91d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5180d1ee0 con 0x7fe5180cfc80 2024-04-25T02:11:43.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.126+0000 7fe51c91d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe5180d21c0 con 0x7fe51815e4f0 2024-04-25T02:11:43.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.126+0000 7fe51c91d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe5180d24a0 con 0x7fe5180cf7f0 2024-04-25T02:11:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.126+0000 7fe51659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe51815e4f0 0x7fe5180d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.126+0000 7fe516d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe5180cfc80 0x7fe51806bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45252/0 (socket says 172.21.15.79:45252) 2024-04-25T02:11:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.126+0000 7fe516d9d640 1 -- 172.21.15.79:0/1101508727 learned_addr learned my addr 172.21.15.79:0/1101508727 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.127+0000 7fe51659c640 1 -- 172.21.15.79:0/1101508727 >> v2:172.21.15.189:3300/0 conn(0x7fe5180cf7f0 msgr2=0x7fe5180d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.127+0000 7fe515d9b640 1 --2- 172.21.15.79:0/1101508727 >> v2:172.21.15.189:3300/0 conn(0x7fe5180cf7f0 0x7fe5180d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.127+0000 7fe51559a640 1 -- 172.21.15.79:0/1101508727 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1892259729 0 0) 0x7fe5180d1ee0 con 0x7fe5180cfc80 2024-04-25T02:11:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.127+0000 7fe51659c640 1 --2- 172.21.15.79:0/1101508727 >> v2:172.21.15.189:3300/0 conn(0x7fe5180cf7f0 0x7fe5180d09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.127+0000 7fe51659c640 1 -- 172.21.15.79:0/1101508727 >> v1:172.21.15.79:6789/0 conn(0x7fe5180cfc80 legacy=0x7fe51806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.127+0000 7fe51659c640 1 -- 172.21.15.79:0/1101508727 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5180d2780 con 0x7fe51815e4f0 2024-04-25T02:11:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.127+0000 7fe51659c640 1 --2- 172.21.15.79:0/1101508727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe51815e4f0 0x7fe5180d2ca0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe508009d90 tx=0x7fe50802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e546be5379db7bf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.127+0000 7fe51559a640 1 -- 172.21.15.79:0/1101508727 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe508007740 con 0x7fe51815e4f0 2024-04-25T02:11:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.128+0000 7fe51559a640 1 -- 172.21.15.79:0/1101508727 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5080078e0 con 0x7fe51815e4f0 2024-04-25T02:11:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.128+0000 7fe51559a640 1 -- 172.21.15.79:0/1101508727 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe508007cb0 con 0x7fe51815e4f0 2024-04-25T02:11:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.128+0000 7fe51c91d640 1 -- 172.21.15.79:0/1101508727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe51815e4f0 msgr2=0x7fe5180d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.128+0000 7fe51c91d640 1 --2- 172.21.15.79:0/1101508727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe51815e4f0 0x7fe5180d2ca0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe508009d90 tx=0x7fe50802a6a0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.128+0000 7fe51c91d640 1 -- 172.21.15.79:0/1101508727 shutdown_connections 2024-04-25T02:11:43.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.128+0000 7fe51c91d640 1 --2- 172.21.15.79:0/1101508727 >> v2:172.21.15.189:3300/0 conn(0x7fe5180cf7f0 0x7fe5180d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.128+0000 7fe51c91d640 1 --2- 172.21.15.79:0/1101508727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe51815e4f0 0x7fe5180d2ca0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.128+0000 7fe51c91d640 1 -- 172.21.15.79:0/1101508727 >> 172.21.15.79:0/1101508727 conn(0x7fe51809d4a0 msgr2=0x7fe5180d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:43.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.128+0000 7fe51c91d640 1 -- 172.21.15.79:0/1101508727 shutdown_connections 2024-04-25T02:11:43.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.128+0000 7fe51c91d640 1 -- 172.21.15.79:0/1101508727 wait complete. 2024-04-25T02:11:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.129+0000 7fe51c91d640 1 Processor -- start 2024-04-25T02:11:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.129+0000 7fe51c91d640 1 -- start start 2024-04-25T02:11:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.130+0000 7fe51c91d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5180cf7f0 0x7fe518156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.130+0000 7fe51c91d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5180cfc80 0x7fe5181f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.130+0000 7fe51c91d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe51815e4f0 0x7fe518159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.130+0000 7fe51c91d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe5180d0ef0 con 0x7fe5180cf7f0 2024-04-25T02:11:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.130+0000 7fe51c91d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe5180d50f0 con 0x7fe5180cfc80 2024-04-25T02:11:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.130+0000 7fe51c91d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe5180d1070 con 0x7fe51815e4f0 2024-04-25T02:11:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.130+0000 7fe51659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5180cf7f0 0x7fe518156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.130+0000 7fe51659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5180cf7f0 0x7fe518156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58066/0 (socket says 172.21.15.79:58066) 2024-04-25T02:11:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.130+0000 7fe51659c640 1 -- 172.21.15.79:0/2167718692 learned_addr learned my addr 172.21.15.79:0/2167718692 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.130+0000 7fe515d9b640 1 --2- 172.21.15.79:0/2167718692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5180cfc80 0x7fe5181f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.130+0000 7fe516d9d640 1 --2- 172.21.15.79:0/2167718692 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe51815e4f0 0x7fe518159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.130+0000 7fe51659c640 1 -- 172.21.15.79:0/2167718692 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe51815e4f0 msgr2=0x7fe518159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.130+0000 7fe51659c640 1 --2- 172.21.15.79:0/2167718692 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe51815e4f0 0x7fe518159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.131+0000 7fe51659c640 1 -- 172.21.15.79:0/2167718692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5180cfc80 msgr2=0x7fe5181f7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.131+0000 7fe51659c640 1 --2- 172.21.15.79:0/2167718692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5180cfc80 0x7fe5181f7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.131+0000 7fe51659c640 1 -- 172.21.15.79:0/2167718692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5181f7cd0 con 0x7fe5180cf7f0 2024-04-25T02:11:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.131+0000 7fe51659c640 1 --2- 172.21.15.79:0/2167718692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5180cf7f0 0x7fe518156950 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe508009d90 tx=0x7fe508004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.131+0000 7fe506ffd640 1 -- 172.21.15.79:0/2167718692 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50803f070 con 0x7fe5180cf7f0 2024-04-25T02:11:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.131+0000 7fe506ffd640 1 -- 172.21.15.79:0/2167718692 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe508031c40 con 0x7fe5180cf7f0 2024-04-25T02:11:43.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.131+0000 7fe51c91d640 1 -- 172.21.15.79:0/2167718692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5181f7fb0 con 0x7fe5180cf7f0 2024-04-25T02:11:43.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.131+0000 7fe506ffd640 1 -- 172.21.15.79:0/2167718692 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe508043410 con 0x7fe5180cf7f0 2024-04-25T02:11:43.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.131+0000 7fe51c91d640 1 -- 172.21.15.79:0/2167718692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe518157c20 con 0x7fe5180cf7f0 2024-04-25T02:11:43.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.132+0000 7fe51c91d640 1 -- 172.21.15.79:0/2167718692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5180686c0 con 0x7fe5180cf7f0 2024-04-25T02:11:43.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.132+0000 7fe506ffd640 1 -- 172.21.15.79:0/2167718692 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe5080435b0 con 0x7fe5180cf7f0 2024-04-25T02:11:43.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.133+0000 7fe506ffd640 1 --2- 172.21.15.79:0/2167718692 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe4f806be30 0x7fe4f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.133+0000 7fe515d9b640 1 --2- 172.21.15.79:0/2167718692 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe4f806be30 0x7fe4f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.133+0000 7fe506ffd640 1 -- 172.21.15.79:0/2167718692 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fe5080ac3f0 con 0x7fe5180cf7f0 2024-04-25T02:11:43.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.133+0000 7fe515d9b640 1 --2- 172.21.15.79:0/2167718692 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe4f806be30 0x7fe4f806e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe5180b32b0 tx=0x7fe50c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:43.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.137+0000 7fe506ffd640 1 -- 172.21.15.79:0/2167718692 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe50807ada0 con 0x7fe5180cf7f0 2024-04-25T02:11:43.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.310+0000 7fe51c91d640 1 -- 172.21.15.79:0/2167718692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe5181f8180 con 0x7fe5180cf7f0 2024-04-25T02:11:43.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.310+0000 7fe506ffd640 1 -- 172.21.15.79:0/2167718692 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) ==== 100+0+11 (secure 0 0 0) 0x7fe50807a6a0 con 0x7fe5180cf7f0 2024-04-25T02:11:43.317 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:11:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.312+0000 7fe51c91d640 1 -- 172.21.15.79:0/2167718692 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe4f806be30 msgr2=0x7fe4f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.312+0000 7fe51c91d640 1 --2- 172.21.15.79:0/2167718692 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe4f806be30 0x7fe4f806e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe5180b32b0 tx=0x7fe50c008040 comp rx=0 tx=0).stop 2024-04-25T02:11:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.312+0000 7fe51c91d640 1 -- 172.21.15.79:0/2167718692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5180cf7f0 msgr2=0x7fe518156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.312+0000 7fe51c91d640 1 --2- 172.21.15.79:0/2167718692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5180cf7f0 0x7fe518156950 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe508009d90 tx=0x7fe508004a40 comp rx=0 tx=0).stop 2024-04-25T02:11:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.312+0000 7fe51c91d640 1 -- 172.21.15.79:0/2167718692 shutdown_connections 2024-04-25T02:11:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.312+0000 7fe51c91d640 1 --2- 172.21.15.79:0/2167718692 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe4f806be30 0x7fe4f806e2f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.312+0000 7fe51c91d640 1 --2- 172.21.15.79:0/2167718692 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe51815e4f0 0x7fe518159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.312+0000 7fe51c91d640 1 --2- 172.21.15.79:0/2167718692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5180cfc80 0x7fe5181f7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.312+0000 7fe51c91d640 1 --2- 172.21.15.79:0/2167718692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5180cf7f0 0x7fe518156950 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.312+0000 7fe51c91d640 1 -- 172.21.15.79:0/2167718692 >> 172.21.15.79:0/2167718692 conn(0x7fe51809d4a0 msgr2=0x7fe5180d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.312+0000 7fe51c91d640 1 -- 172.21.15.79:0/2167718692 shutdown_connections 2024-04-25T02:11:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.312+0000 7fe51c91d640 1 -- 172.21.15.79:0/2167718692 wait complete. 2024-04-25T02:11:43.330 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:11:43.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.419+0000 7fb67956a640 1 Processor -- start 2024-04-25T02:11:43.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.420+0000 7fb67956a640 1 -- start start 2024-04-25T02:11:43.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.420+0000 7fb67956a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb6740ce020 0x7fb67406cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.420+0000 7fb67956a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6740d2940 0x7fb67406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.420+0000 7fb67956a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6740d0390 con 0x7fb67406c3d0 2024-04-25T02:11:43.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.420+0000 7fb67956a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb6740d0fa0 con 0x7fb6740ce020 2024-04-25T02:11:43.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.420+0000 7fb67956a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb6740cd480 con 0x7fb6740d2940 2024-04-25T02:11:43.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.420+0000 7fb672ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb6740ce020 0x7fb67406cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.420+0000 7fb6737fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb67406c3d0 0x7fb67415da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45258/0 (socket says 172.21.15.79:45258) 2024-04-25T02:11:43.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.421+0000 7fb6737fe640 1 -- 172.21.15.79:0/1060188492 learned_addr learned my addr 172.21.15.79:0/1060188492 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:43.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.421+0000 7fb6727fc640 1 --2- 172.21.15.79:0/1060188492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6740d2940 0x7fb67406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.421+0000 7fb672ffd640 1 -- 172.21.15.79:0/1060188492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6740d2940 msgr2=0x7fb67406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:43.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.421+0000 7fb672ffd640 1 --2- 172.21.15.79:0/1060188492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6740d2940 0x7fb67406d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.421+0000 7fb672ffd640 1 -- 172.21.15.79:0/1060188492 >> v1:172.21.15.79:6789/0 conn(0x7fb67406c3d0 legacy=0x7fb67415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.421+0000 7fb671ffb640 1 -- 172.21.15.79:0/1060188492 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987199450 0 0) 0x7fb6740d0390 con 0x7fb67406c3d0 2024-04-25T02:11:43.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.421+0000 7fb672ffd640 1 -- 172.21.15.79:0/1060188492 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6740d0670 con 0x7fb6740ce020 2024-04-25T02:11:43.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.421+0000 7fb6727fc640 1 --2- 172.21.15.79:0/1060188492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6740d2940 0x7fb67406d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:43.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.421+0000 7fb672ffd640 1 --2- 172.21.15.79:0/1060188492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6740ce020 0x7fb67406cbd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb664009d90 tx=0x7fb66402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232a8653ed083601 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:43.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.422+0000 7fb671ffb640 1 -- 172.21.15.79:0/1060188492 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb664031600 con 0x7fb6740ce020 2024-04-25T02:11:43.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.422+0000 7fb671ffb640 1 -- 172.21.15.79:0/1060188492 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6640317a0 con 0x7fb6740ce020 2024-04-25T02:11:43.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.422+0000 7fb671ffb640 1 -- 172.21.15.79:0/1060188492 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb664031b70 con 0x7fb6740ce020 2024-04-25T02:11:43.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.422+0000 7fb67956a640 1 -- 172.21.15.79:0/1060188492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6740ce020 msgr2=0x7fb67406cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.422+0000 7fb67956a640 1 --2- 172.21.15.79:0/1060188492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6740ce020 0x7fb67406cbd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb664009d90 tx=0x7fb66402a5d0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.422+0000 7fb67956a640 1 -- 172.21.15.79:0/1060188492 shutdown_connections 2024-04-25T02:11:43.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.422+0000 7fb67956a640 1 --2- 172.21.15.79:0/1060188492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6740d2940 0x7fb67406d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.422+0000 7fb67956a640 1 --2- 172.21.15.79:0/1060188492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6740ce020 0x7fb67406cbd0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.422+0000 7fb67956a640 1 -- 172.21.15.79:0/1060188492 >> 172.21.15.79:0/1060188492 conn(0x7fb6740d1e20 msgr2=0x7fb6740d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:43.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.422+0000 7fb67956a640 1 -- 172.21.15.79:0/1060188492 shutdown_connections 2024-04-25T02:11:43.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.422+0000 7fb67956a640 1 -- 172.21.15.79:0/1060188492 wait complete. 2024-04-25T02:11:43.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.423+0000 7fb67956a640 1 Processor -- start 2024-04-25T02:11:43.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.424+0000 7fb67956a640 1 -- start start 2024-04-25T02:11:43.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.424+0000 7fb67956a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb67406c3d0 0x7fb67415f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.424+0000 7fb67956a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6740ce020 0x7fb6740b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.424+0000 7fb67956a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6740d2940 0x7fb6740b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.424+0000 7fb67956a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6740cf2b0 con 0x7fb6740ce020 2024-04-25T02:11:43.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.424+0000 7fb67956a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb6740d0c30 con 0x7fb6740d2940 2024-04-25T02:11:43.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.424+0000 7fb67956a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb6740d0060 con 0x7fb67406c3d0 2024-04-25T02:11:43.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.424+0000 7fb6727fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6740ce020 0x7fb6740b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.424+0000 7fb6727fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6740ce020 0x7fb6740b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58080/0 (socket says 172.21.15.79:58080) 2024-04-25T02:11:43.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.424+0000 7fb6727fc640 1 -- 172.21.15.79:0/1661009598 learned_addr learned my addr 172.21.15.79:0/1661009598 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:43.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.425+0000 7fb6727fc640 1 -- 172.21.15.79:0/1661009598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb67406c3d0 msgr2=0x7fb67415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.425+0000 7fb6727fc640 1 --2- 172.21.15.79:0/1661009598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb67406c3d0 0x7fb67415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.425+0000 7fb6727fc640 1 -- 172.21.15.79:0/1661009598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6740d2940 msgr2=0x7fb6740b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.425+0000 7fb6737fe640 1 --2- 172.21.15.79:0/1661009598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6740d2940 0x7fb6740b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.425+0000 7fb6727fc640 1 --2- 172.21.15.79:0/1661009598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6740d2940 0x7fb6740b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.425+0000 7fb6727fc640 1 -- 172.21.15.79:0/1661009598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6740c9df0 con 0x7fb6740ce020 2024-04-25T02:11:43.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.425+0000 7fb6737fe640 1 --2- 172.21.15.79:0/1661009598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6740d2940 0x7fb6740b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:43.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.425+0000 7fb6727fc640 1 --2- 172.21.15.79:0/1661009598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6740ce020 0x7fb6740b6260 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb66800c7f0 tx=0x7fb66800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:43.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.425+0000 7fb65b7fe640 1 -- 172.21.15.79:0/1661009598 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668015070 con 0x7fb6740ce020 2024-04-25T02:11:43.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.425+0000 7fb65b7fe640 1 -- 172.21.15.79:0/1661009598 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb668007a30 con 0x7fb6740ce020 2024-04-25T02:11:43.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.425+0000 7fb67956a640 1 -- 172.21.15.79:0/1661009598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6740ca0d0 con 0x7fb6740ce020 2024-04-25T02:11:43.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.425+0000 7fb65b7fe640 1 -- 172.21.15.79:0/1661009598 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668007e00 con 0x7fb6740ce020 2024-04-25T02:11:43.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.425+0000 7fb67956a640 1 -- 172.21.15.79:0/1661009598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6740ca690 con 0x7fb6740ce020 2024-04-25T02:11:43.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.426+0000 7fb67956a640 1 -- 172.21.15.79:0/1661009598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6740cdb80 con 0x7fb6740ce020 2024-04-25T02:11:43.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.426+0000 7fb65b7fe640 1 -- 172.21.15.79:0/1661009598 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb668018070 con 0x7fb6740ce020 2024-04-25T02:11:43.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.427+0000 7fb65b7fe640 1 --2- 172.21.15.79:0/1661009598 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb66006be30 0x7fb66006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.427+0000 7fb672ffd640 1 --2- 172.21.15.79:0/1661009598 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb66006be30 0x7fb66006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.427+0000 7fb65b7fe640 1 -- 172.21.15.79:0/1661009598 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fb66808ad80 con 0x7fb6740ce020 2024-04-25T02:11:43.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.427+0000 7fb672ffd640 1 --2- 172.21.15.79:0/1661009598 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb66006be30 0x7fb66006e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb664034000 tx=0x7fb66402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:43.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.431+0000 7fb65b7fe640 1 -- 172.21.15.79:0/1661009598 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb6740cdb80 con 0x7fb6740ce020 2024-04-25T02:11:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.640+0000 7fb67956a640 1 -- 172.21.15.79:0/1661009598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb67406c9b0 con 0x7fb6740ce020 2024-04-25T02:11:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.641+0000 7fb65b7fe640 1 -- 172.21.15.79:0/1661009598 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5185 (secure 0 0 0) 0x7fb6680597c0 con 0x7fb6740ce020 2024-04-25T02:11:43.648 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:43.649 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5431,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3495029157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3495029157},{"type":"v1","addr":"172.21.15.189:6834","nonce":3495029157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2036557544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2036557544},{"type":"v1","addr":"172.21.15.189:6835","nonce":2036557544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/326759836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":326759836},{"type":"v1","addr":"172.21.15.79:6836","nonce":326759836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:25.684570+0000","modified":"2024-04-25T02:11:14.376645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.79:6837/2253487658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2253487658},{"type":"v1","addr":"172.21.15.79:6837","nonce":2253487658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":4}]} 2024-04-25T02:11:43.649 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 26 2024-04-25T02:11:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.643+0000 7fb67956a640 1 -- 172.21.15.79:0/1661009598 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb66006be30 msgr2=0x7fb66006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.643+0000 7fb67956a640 1 --2- 172.21.15.79:0/1661009598 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb66006be30 0x7fb66006e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb664034000 tx=0x7fb66402e000 comp rx=0 tx=0).stop 2024-04-25T02:11:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.643+0000 7fb67956a640 1 -- 172.21.15.79:0/1661009598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6740ce020 msgr2=0x7fb6740b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.643+0000 7fb67956a640 1 --2- 172.21.15.79:0/1661009598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6740ce020 0x7fb6740b6260 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb66800c7f0 tx=0x7fb66800ccb0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.643+0000 7fb67956a640 1 -- 172.21.15.79:0/1661009598 shutdown_connections 2024-04-25T02:11:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.643+0000 7fb67956a640 1 --2- 172.21.15.79:0/1661009598 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb66006be30 0x7fb66006e2f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.643+0000 7fb67956a640 1 --2- 172.21.15.79:0/1661009598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6740d2940 0x7fb6740b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.643+0000 7fb67956a640 1 --2- 172.21.15.79:0/1661009598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6740ce020 0x7fb6740b6260 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.643+0000 7fb67956a640 1 --2- 172.21.15.79:0/1661009598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb67406c3d0 0x7fb67415f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.643+0000 7fb67956a640 1 -- 172.21.15.79:0/1661009598 >> 172.21.15.79:0/1661009598 conn(0x7fb6740d1e20 msgr2=0x7fb6740afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.643+0000 7fb67956a640 1 -- 172.21.15.79:0/1661009598 shutdown_connections 2024-04-25T02:11:43.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.643+0000 7fb67956a640 1 -- 172.21.15.79:0/1661009598 wait complete. 2024-04-25T02:11:43.661 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:11:43.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.750+0000 7efe6921c640 1 Processor -- start 2024-04-25T02:11:43.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.750+0000 7efe6921c640 1 -- start start 2024-04-25T02:11:43.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.751+0000 7efe6921c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe640d07a0 0x7efe640b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.751+0000 7efe6921c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe6415bb10 con 0x7efe640b47e0 2024-04-25T02:11:43.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.751+0000 7efe6921c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe640b2e60 con 0x7efe6415a720 2024-04-25T02:11:43.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.751+0000 7efe6921c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efe640b3140 con 0x7efe640d07a0 2024-04-25T02:11:43.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.751+0000 7efe6359e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efe640b47e0 0x7efe64070cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39302/0 (socket says 172.21.15.79:39302) 2024-04-25T02:11:43.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.751+0000 7efe6359e640 1 -- 172.21.15.79:0/3314011725 learned_addr learned my addr 172.21.15.79:0/3314011725 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:43.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.751+0000 7efe61d9b640 1 -- 172.21.15.79:0/3314011725 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1323217764 0 0) 0x7efe6415bb10 con 0x7efe640b47e0 2024-04-25T02:11:43.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.751+0000 7efe61d9b640 1 -- 172.21.15.79:0/3314011725 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe4c003520 con 0x7efe640b47e0 2024-04-25T02:11:43.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.751+0000 7efe6259c640 1 --2- 172.21.15.79:0/3314011725 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe640d07a0 0x7efe640b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe61d9b640 1 -- 172.21.15.79:0/3314011725 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 602903661 0 0) 0x7efe4c003520 con 0x7efe640b47e0 2024-04-25T02:11:43.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe61d9b640 1 -- 172.21.15.79:0/3314011725 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe640d07a0 msgr2=0x7efe640b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:43.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe61d9b640 1 --2- 172.21.15.79:0/3314011725 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe640d07a0 0x7efe640b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe61d9b640 1 -- 172.21.15.79:0/3314011725 >> v1:172.21.15.189:6789/0 conn(0x7efe6415a720 legacy=0x7efe6415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe61d9b640 1 -- 172.21.15.79:0/3314011725 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe640b3420 con 0x7efe640b47e0 2024-04-25T02:11:43.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe61d9b640 1 -- 172.21.15.79:0/3314011725 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7efe5c001670 con 0x7efe640b47e0 2024-04-25T02:11:43.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe61d9b640 1 -- 172.21.15.79:0/3314011725 >> v1:172.21.15.79:6789/0 conn(0x7efe640b47e0 legacy=0x7efe64070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe61d9b640 1 --2- 172.21.15.79:0/3314011725 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe4c0039e0 0x7efe4c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe61d9b640 1 --2- 172.21.15.79:0/3314011725 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe640d07a0 0x7efe4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe61d9b640 1 --2- 172.21.15.79:0/3314011725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe4c004d40 0x7efe4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe61d9b640 1 -- 172.21.15.79:0/3314011725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efe640b3140 con 0x7efe4c004d40 2024-04-25T02:11:43.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe61d9b640 1 -- 172.21.15.79:0/3314011725 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efe4c00cc00 con 0x7efe4c0039e0 2024-04-25T02:11:43.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe61d9b640 1 -- 172.21.15.79:0/3314011725 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efe4c00ce00 con 0x7efe640d07a0 2024-04-25T02:11:43.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe6359e640 1 --2- 172.21.15.79:0/3314011725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe4c004d40 0x7efe4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe62d9d640 1 --2- 172.21.15.79:0/3314011725 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe4c0039e0 0x7efe4c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe6259c640 1 --2- 172.21.15.79:0/3314011725 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe640d07a0 0x7efe4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe6359e640 1 -- 172.21.15.79:0/3314011725 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe640d07a0 msgr2=0x7efe4c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:43.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe6359e640 1 --2- 172.21.15.79:0/3314011725 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe640d07a0 0x7efe4c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe6359e640 1 -- 172.21.15.79:0/3314011725 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe4c0039e0 msgr2=0x7efe4c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:43.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe6359e640 1 --2- 172.21.15.79:0/3314011725 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe4c0039e0 0x7efe4c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.752+0000 7efe6359e640 1 -- 172.21.15.79:0/3314011725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4c003520 con 0x7efe4c004d40 2024-04-25T02:11:43.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.753+0000 7efe6359e640 1 --2- 172.21.15.79:0/3314011725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe4c004d40 0x7efe4c0051c0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00c210 tx=0x7efe4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f055a3dccb9f3d8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:43.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.753+0000 7efe61d9b640 1 -- 172.21.15.79:0/3314011725 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c007d30 con 0x7efe4c004d40 2024-04-25T02:11:43.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.753+0000 7efe61d9b640 1 -- 172.21.15.79:0/3314011725 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe5c005ad0 con 0x7efe4c004d40 2024-04-25T02:11:43.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.753+0000 7efe61d9b640 1 -- 172.21.15.79:0/3314011725 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c007070 con 0x7efe4c004d40 2024-04-25T02:11:43.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.753+0000 7efe6921c640 1 -- 172.21.15.79:0/3314011725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe4c004d40 msgr2=0x7efe4c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.753+0000 7efe6921c640 1 --2- 172.21.15.79:0/3314011725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe4c004d40 0x7efe4c0051c0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00c210 tx=0x7efe4c005830 comp rx=0 tx=0).stop 2024-04-25T02:11:43.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.753+0000 7efe6359e640 1 -- 172.21.15.79:0/3314011725 reap_dead start 2024-04-25T02:11:43.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.753+0000 7efe6921c640 1 -- 172.21.15.79:0/3314011725 shutdown_connections 2024-04-25T02:11:43.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.753+0000 7efe6921c640 1 -- 172.21.15.79:0/3314011725 >> 172.21.15.79:0/3314011725 conn(0x7efe640cfc80 msgr2=0x7efe640d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:43.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.753+0000 7efe6921c640 1 -- 172.21.15.79:0/3314011725 shutdown_connections 2024-04-25T02:11:43.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.753+0000 7efe6921c640 1 -- 172.21.15.79:0/3314011725 wait complete. 2024-04-25T02:11:43.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.755+0000 7efe6921c640 1 Processor -- start 2024-04-25T02:11:43.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.755+0000 7efe6921c640 1 -- start start 2024-04-25T02:11:43.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6921c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe6413c220 0x7efe64140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6921c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe6413c600 0x7efe6413ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6921c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe640cef10 0x7efe640cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6921c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efe640b42a0 con 0x7efe640cef10 2024-04-25T02:11:43.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6921c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efe640b39e0 con 0x7efe6413c600 2024-04-25T02:11:43.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6921c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efe640b4420 con 0x7efe6413c220 2024-04-25T02:11:43.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe640cef10 0x7efe640cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe640cef10 0x7efe640cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57366/0 (socket says 172.21.15.79:57366) 2024-04-25T02:11:43.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6359e640 1 -- 172.21.15.79:0/2013277947 learned_addr learned my addr 172.21.15.79:0/2013277947 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:43.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6259c640 1 --2- 172.21.15.79:0/2013277947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe6413c600 0x7efe6413ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe62d9d640 1 --2- 172.21.15.79:0/2013277947 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe6413c220 0x7efe64140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6359e640 1 -- 172.21.15.79:0/2013277947 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe6413c220 msgr2=0x7efe64140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6359e640 1 --2- 172.21.15.79:0/2013277947 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe6413c220 0x7efe64140040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6359e640 1 -- 172.21.15.79:0/2013277947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe6413c600 msgr2=0x7efe6413ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6359e640 1 --2- 172.21.15.79:0/2013277947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe6413c600 0x7efe6413ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6359e640 1 -- 172.21.15.79:0/2013277947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe640cccd0 con 0x7efe640cef10 2024-04-25T02:11:43.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6259c640 1 --2- 172.21.15.79:0/2013277947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe6413c600 0x7efe6413ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:43.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6359e640 1 --2- 172.21.15.79:0/2013277947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe640cef10 0x7efe640cf3c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7efe5c034040 tx=0x7efe5c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:43.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe4b7fe640 1 -- 172.21.15.79:0/2013277947 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c043020 con 0x7efe640cef10 2024-04-25T02:11:43.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe4b7fe640 1 -- 172.21.15.79:0/2013277947 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe5c000ed0 con 0x7efe640cef10 2024-04-25T02:11:43.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6921c640 1 -- 172.21.15.79:0/2013277947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe64140720 con 0x7efe640cef10 2024-04-25T02:11:43.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe4b7fe640 1 -- 172.21.15.79:0/2013277947 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c007d30 con 0x7efe640cef10 2024-04-25T02:11:43.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.756+0000 7efe6921c640 1 -- 172.21.15.79:0/2013277947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe640cd250 con 0x7efe640cef10 2024-04-25T02:11:43.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.757+0000 7efe6921c640 1 -- 172.21.15.79:0/2013277947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe640690a0 con 0x7efe640cef10 2024-04-25T02:11:43.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.758+0000 7efe4b7fe640 1 -- 172.21.15.79:0/2013277947 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe5c046070 con 0x7efe640cef10 2024-04-25T02:11:43.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.758+0000 7efe4b7fe640 1 --2- 172.21.15.79:0/2013277947 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efe5006be60 0x7efe5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:43.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.758+0000 7efe4b7fe640 1 -- 172.21.15.79:0/2013277947 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7efe5c0aa7d0 con 0x7efe640cef10 2024-04-25T02:11:43.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.758+0000 7efe62d9d640 1 --2- 172.21.15.79:0/2013277947 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efe5006be60 0x7efe5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:43.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.758+0000 7efe62d9d640 1 --2- 172.21.15.79:0/2013277947 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efe5006be60 0x7efe5006e320 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efe54003fb0 tx=0x7efe54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:43.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.762+0000 7efe4b7fe640 1 -- 172.21.15.79:0/2013277947 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efe5c079210 con 0x7efe640cef10 2024-04-25T02:11:43.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.934+0000 7efe6921c640 1 -- 172.21.15.79:0/2013277947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe6406d470 con 0x7efe640cef10 2024-04-25T02:11:43.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.935+0000 7efe4b7fe640 1 -- 172.21.15.79:0/2013277947 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16677 (secure 0 0 0) 0x7efe5c078b10 con 0x7efe640cef10 2024-04-25T02:11:43.943 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:43.943 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":59,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:10:27.345273+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:23.901352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:24.658248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:11:43.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.937+0000 7efe6921c640 1 -- 172.21.15.79:0/2013277947 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efe5006be60 msgr2=0x7efe5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.937+0000 7efe6921c640 1 --2- 172.21.15.79:0/2013277947 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efe5006be60 0x7efe5006e320 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efe54003fb0 tx=0x7efe54009040 comp rx=0 tx=0).stop 2024-04-25T02:11:43.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.937+0000 7efe6921c640 1 -- 172.21.15.79:0/2013277947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe640cef10 msgr2=0x7efe640cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:43.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.937+0000 7efe6921c640 1 --2- 172.21.15.79:0/2013277947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe640cef10 0x7efe640cf3c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7efe5c034040 tx=0x7efe5c001a40 comp rx=0 tx=0).stop 2024-04-25T02:11:43.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.937+0000 7efe6921c640 1 -- 172.21.15.79:0/2013277947 shutdown_connections 2024-04-25T02:11:43.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.937+0000 7efe6921c640 1 --2- 172.21.15.79:0/2013277947 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efe5006be60 0x7efe5006e320 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.937+0000 7efe6921c640 1 --2- 172.21.15.79:0/2013277947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe640cef10 0x7efe640cf3c0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.937+0000 7efe6921c640 1 --2- 172.21.15.79:0/2013277947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe6413c600 0x7efe6413ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.937+0000 7efe6921c640 1 --2- 172.21.15.79:0/2013277947 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efe6413c220 0x7efe64140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:43.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.937+0000 7efe6921c640 1 -- 172.21.15.79:0/2013277947 >> 172.21.15.79:0/2013277947 conn(0x7efe640cfc80 msgr2=0x7efe6413d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:43.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.937+0000 7efe6921c640 1 -- 172.21.15.79:0/2013277947 shutdown_connections 2024-04-25T02:11:43.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:43.937+0000 7efe6921c640 1 -- 172.21.15.79:0/2013277947 wait complete. 2024-04-25T02:11:43.956 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:11:43.956 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:11:44.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.045+0000 7f48795ee640 1 Processor -- start 2024-04-25T02:11:44.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.045+0000 7f48795ee640 1 -- start start 2024-04-25T02:11:44.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.046+0000 7f48795ee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4874161b90 0x7f48740d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.046+0000 7f48795ee640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f48740d0a60 0x7f48740d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.046+0000 7f48795ee640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48740ceed0 con 0x7f48740d47e0 2024-04-25T02:11:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.046+0000 7f48795ee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f48740ceca0 con 0x7f4874161b90 2024-04-25T02:11:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.046+0000 7f48795ee640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f48740d4f80 con 0x7f48740d0a60 2024-04-25T02:11:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.046+0000 7f4872ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4874161b90 0x7f48740d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.046+0000 7f48727fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f48740d47e0 0x7f48740cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39314/0 (socket says 172.21.15.79:39314) 2024-04-25T02:11:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.046+0000 7f48727fc640 1 -- 172.21.15.79:0/3977495914 learned_addr learned my addr 172.21.15.79:0/3977495914 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.046+0000 7f48737fe640 1 --2- 172.21.15.79:0/3977495914 >> v2:172.21.15.189:3300/0 conn(0x7f48740d0a60 0x7f48740d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.046+0000 7f4872ffd640 1 -- 172.21.15.79:0/3977495914 >> v2:172.21.15.189:3300/0 conn(0x7f48740d0a60 msgr2=0x7f48740d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.046+0000 7f4872ffd640 1 --2- 172.21.15.79:0/3977495914 >> v2:172.21.15.189:3300/0 conn(0x7f48740d0a60 0x7f48740d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.046+0000 7f4872ffd640 1 -- 172.21.15.79:0/3977495914 >> v1:172.21.15.79:6789/0 conn(0x7f48740d47e0 legacy=0x7f48740cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.046+0000 7f4872ffd640 1 -- 172.21.15.79:0/3977495914 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48740cf1b0 con 0x7f4874161b90 2024-04-25T02:11:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.046+0000 7f4871ffb640 1 -- 172.21.15.79:0/3977495914 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 943147647 0 0) 0x7f48740ceed0 con 0x7f48740d47e0 2024-04-25T02:11:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.047+0000 7f4872ffd640 1 --2- 172.21.15.79:0/3977495914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4874161b90 0x7f48740d2da0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f48740d06a0 tx=0x7f486402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba91b4987d8ddc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.047+0000 7f4871ffb640 1 -- 172.21.15.79:0/3977495914 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864007740 con 0x7f4874161b90 2024-04-25T02:11:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.047+0000 7f4871ffb640 1 -- 172.21.15.79:0/3977495914 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48640078e0 con 0x7f4874161b90 2024-04-25T02:11:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.047+0000 7f4871ffb640 1 -- 172.21.15.79:0/3977495914 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864007cb0 con 0x7f4874161b90 2024-04-25T02:11:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.048+0000 7f48795ee640 1 -- 172.21.15.79:0/3977495914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4874161b90 msgr2=0x7f48740d2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.048+0000 7f48795ee640 1 --2- 172.21.15.79:0/3977495914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4874161b90 0x7f48740d2da0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f48740d06a0 tx=0x7f486402a680 comp rx=0 tx=0).stop 2024-04-25T02:11:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.048+0000 7f48795ee640 1 -- 172.21.15.79:0/3977495914 shutdown_connections 2024-04-25T02:11:44.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.048+0000 7f48795ee640 1 --2- 172.21.15.79:0/3977495914 >> v2:172.21.15.189:3300/0 conn(0x7f48740d0a60 0x7f48740d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.048+0000 7f48795ee640 1 --2- 172.21.15.79:0/3977495914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4874161b90 0x7f48740d2da0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.048+0000 7f48795ee640 1 -- 172.21.15.79:0/3977495914 >> 172.21.15.79:0/3977495914 conn(0x7f487409d460 msgr2=0x7f48740d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:44.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.048+0000 7f48795ee640 1 -- 172.21.15.79:0/3977495914 shutdown_connections 2024-04-25T02:11:44.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.048+0000 7f48795ee640 1 -- 172.21.15.79:0/3977495914 wait complete. 2024-04-25T02:11:44.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.049+0000 7f48795ee640 1 Processor -- start 2024-04-25T02:11:44.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.049+0000 7f48795ee640 1 -- start start 2024-04-25T02:11:44.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48795ee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48740d0a60 0x7f48740b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48795ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48740d47e0 0x7f487415c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48795ee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4874161b90 0x7f48740c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48795ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f48740cf770 con 0x7f48740d47e0 2024-04-25T02:11:44.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48795ee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48740d13d0 con 0x7f48740d0a60 2024-04-25T02:11:44.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48795ee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f48740d4c70 con 0x7f4874161b90 2024-04-25T02:11:44.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48727fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48740d47e0 0x7f487415c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48727fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48740d47e0 0x7f487415c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57384/0 (socket says 172.21.15.79:57384) 2024-04-25T02:11:44.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48727fc640 1 -- 172.21.15.79:0/249510821 learned_addr learned my addr 172.21.15.79:0/249510821 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:44.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f4872ffd640 1 --2- 172.21.15.79:0/249510821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48740d0a60 0x7f48740b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48737fe640 1 --2- 172.21.15.79:0/249510821 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4874161b90 0x7f48740c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48727fc640 1 -- 172.21.15.79:0/249510821 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4874161b90 msgr2=0x7f48740c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48727fc640 1 --2- 172.21.15.79:0/249510821 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4874161b90 0x7f48740c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48727fc640 1 -- 172.21.15.79:0/249510821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48740d0a60 msgr2=0x7f48740b8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48727fc640 1 --2- 172.21.15.79:0/249510821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48740d0a60 0x7f48740b8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48727fc640 1 -- 172.21.15.79:0/249510821 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48740b82b0 con 0x7f48740d47e0 2024-04-25T02:11:44.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48727fc640 1 --2- 172.21.15.79:0/249510821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48740d47e0 0x7f487415c330 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f486800c4d0 tx=0x7f486800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:44.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f485b7fe640 1 -- 172.21.15.79:0/249510821 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868018070 con 0x7f48740d47e0 2024-04-25T02:11:44.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f485b7fe640 1 -- 172.21.15.79:0/249510821 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4868007500 con 0x7f48740d47e0 2024-04-25T02:11:44.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48795ee640 1 -- 172.21.15.79:0/249510821 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48740b5ba0 con 0x7f48740d47e0 2024-04-25T02:11:44.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f485b7fe640 1 -- 172.21.15.79:0/249510821 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868004a20 con 0x7f48740d47e0 2024-04-25T02:11:44.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.050+0000 7f48795ee640 1 -- 172.21.15.79:0/249510821 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48740b6160 con 0x7f48740d47e0 2024-04-25T02:11:44.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.051+0000 7f48795ee640 1 -- 172.21.15.79:0/249510821 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48740690a0 con 0x7f48740d47e0 2024-04-25T02:11:44.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.052+0000 7f485b7fe640 1 -- 172.21.15.79:0/249510821 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f486801b070 con 0x7f48740d47e0 2024-04-25T02:11:44.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.052+0000 7f485b7fe640 1 --2- 172.21.15.79:0/249510821 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f486006be30 0x7f486006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.052+0000 7f485b7fe640 1 -- 172.21.15.79:0/249510821 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f486808a070 con 0x7f48740d47e0 2024-04-25T02:11:44.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.052+0000 7f4872ffd640 1 --2- 172.21.15.79:0/249510821 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f486006be30 0x7f486006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.053+0000 7f4872ffd640 1 --2- 172.21.15.79:0/249510821 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f486006be30 0x7f486006e2f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4864034000 tx=0x7f486402f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:44.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.057+0000 7f485b7fe640 1 -- 172.21.15.79:0/249510821 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4868058460 con 0x7f48740d47e0 2024-04-25T02:11:44.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.264+0000 7f48795ee640 1 -- 172.21.15.79:0/249510821 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f487409d910 con 0x7f48740d47e0 2024-04-25T02:11:44.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.265+0000 7f485b7fe640 1 -- 172.21.15.79:0/249510821 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5185 (secure 0 0 0) 0x7f486805c760 con 0x7f48740d47e0 2024-04-25T02:11:44.272 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:44.273 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5431,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3495029157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3495029157},{"type":"v1","addr":"172.21.15.189:6834","nonce":3495029157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2036557544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2036557544},{"type":"v1","addr":"172.21.15.189:6835","nonce":2036557544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/326759836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":326759836},{"type":"v1","addr":"172.21.15.79:6836","nonce":326759836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:25.684570+0000","modified":"2024-04-25T02:11:14.376645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.79:6837/2253487658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2253487658},{"type":"v1","addr":"172.21.15.79:6837","nonce":2253487658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":4}]} 2024-04-25T02:11:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 26 2024-04-25T02:11:44.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.266+0000 7f48795ee640 1 -- 172.21.15.79:0/249510821 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f486006be30 msgr2=0x7f486006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.266+0000 7f48795ee640 1 --2- 172.21.15.79:0/249510821 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f486006be30 0x7f486006e2f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4864034000 tx=0x7f486402f000 comp rx=0 tx=0).stop 2024-04-25T02:11:44.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.266+0000 7f48795ee640 1 -- 172.21.15.79:0/249510821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48740d47e0 msgr2=0x7f487415c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.266+0000 7f48795ee640 1 --2- 172.21.15.79:0/249510821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48740d47e0 0x7f487415c330 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f486800c4d0 tx=0x7f486800c990 comp rx=0 tx=0).stop 2024-04-25T02:11:44.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.266+0000 7f48795ee640 1 -- 172.21.15.79:0/249510821 shutdown_connections 2024-04-25T02:11:44.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.266+0000 7f48795ee640 1 --2- 172.21.15.79:0/249510821 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f486006be30 0x7f486006e2f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.266+0000 7f48795ee640 1 --2- 172.21.15.79:0/249510821 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4874161b90 0x7f48740c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.266+0000 7f48795ee640 1 --2- 172.21.15.79:0/249510821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48740d47e0 0x7f487415c330 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.266+0000 7f48795ee640 1 --2- 172.21.15.79:0/249510821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48740d0a60 0x7f48740b8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.267+0000 7f48795ee640 1 -- 172.21.15.79:0/249510821 >> 172.21.15.79:0/249510821 conn(0x7f487409d460 msgr2=0x7f48740b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:44.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.267+0000 7f48795ee640 1 -- 172.21.15.79:0/249510821 shutdown_connections 2024-04-25T02:11:44.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.267+0000 7f48795ee640 1 -- 172.21.15.79:0/249510821 wait complete. 2024-04-25T02:11:44.285 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:11:44.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.374+0000 7f3aa511d640 1 Processor -- start 2024-04-25T02:11:44.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.374+0000 7f3aa511d640 1 -- start start 2024-04-25T02:11:44.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.374+0000 7f3aa511d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3aa0143bc0 0x7f3aa015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.374+0000 7f3aa511d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3aa006df50 0x7f3aa006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.374+0000 7f3aa511d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f3aa00b48e0 0x7f3aa00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.374+0000 7f3aa511d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3aa006e8f0 con 0x7f3aa006df50 2024-04-25T02:11:44.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.374+0000 7f3aa511d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3aa0072cb0 con 0x7f3aa00b48e0 2024-04-25T02:11:44.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.374+0000 7f3aa511d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa015fa40 con 0x7f3aa0143bc0 2024-04-25T02:11:44.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.375+0000 7f3a9e59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3aa006df50 0x7f3aa006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.375+0000 7f3a9e59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3aa006df50 0x7f3aa006e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57388/0 (socket says 172.21.15.79:57388) 2024-04-25T02:11:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.375+0000 7f3a9e59c640 1 -- 172.21.15.79:0/3359438534 learned_addr learned my addr 172.21.15.79:0/3359438534 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.375+0000 7f3a9f59e640 1 --2- 172.21.15.79:0/3359438534 >> v2:172.21.15.189:3300/0 conn(0x7f3aa00b48e0 0x7f3aa00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.375+0000 7f3a9ed9d640 1 --2- 172.21.15.79:0/3359438534 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3aa0143bc0 0x7f3aa015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.375+0000 7f3a9e59c640 1 -- 172.21.15.79:0/3359438534 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3aa0143bc0 msgr2=0x7f3aa015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.375+0000 7f3a9e59c640 1 --2- 172.21.15.79:0/3359438534 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3aa0143bc0 0x7f3aa015f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.375+0000 7f3a9e59c640 1 -- 172.21.15.79:0/3359438534 >> v2:172.21.15.189:3300/0 conn(0x7f3aa00b48e0 msgr2=0x7f3aa00b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.375+0000 7f3a9e59c640 1 --2- 172.21.15.79:0/3359438534 >> v2:172.21.15.189:3300/0 conn(0x7f3aa00b48e0 0x7f3aa00b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.375+0000 7f3a9e59c640 1 -- 172.21.15.79:0/3359438534 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa0071e00 con 0x7f3aa006df50 2024-04-25T02:11:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.375+0000 7f3a9ed9d640 1 --2- 172.21.15.79:0/3359438534 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3aa0143bc0 0x7f3aa015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.376+0000 7f3a9e59c640 1 --2- 172.21.15.79:0/3359438534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3aa006df50 0x7f3aa006e3b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0144de0 tx=0x7f3a8802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b19f05f1b80b78f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.376+0000 7f3a9dd9b640 1 -- 172.21.15.79:0/3359438534 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88037070 con 0x7f3aa006df50 2024-04-25T02:11:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.376+0000 7f3a9dd9b640 1 -- 172.21.15.79:0/3359438534 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a88032440 con 0x7f3aa006df50 2024-04-25T02:11:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.376+0000 7f3a9dd9b640 1 -- 172.21.15.79:0/3359438534 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88032810 con 0x7f3aa006df50 2024-04-25T02:11:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.376+0000 7f3aa511d640 1 -- 172.21.15.79:0/3359438534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3aa006df50 msgr2=0x7f3aa006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.376+0000 7f3aa511d640 1 --2- 172.21.15.79:0/3359438534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3aa006df50 0x7f3aa006e3b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0144de0 tx=0x7f3a8802a140 comp rx=0 tx=0).stop 2024-04-25T02:11:44.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.376+0000 7f3aa511d640 1 -- 172.21.15.79:0/3359438534 shutdown_connections 2024-04-25T02:11:44.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.376+0000 7f3aa511d640 1 --2- 172.21.15.79:0/3359438534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3aa006df50 0x7f3aa006e3b0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.376+0000 7f3aa511d640 1 --2- 172.21.15.79:0/3359438534 >> v2:172.21.15.189:3300/0 conn(0x7f3aa00b48e0 0x7f3aa00b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.376+0000 7f3aa511d640 1 --2- 172.21.15.79:0/3359438534 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3aa0143bc0 0x7f3aa015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.376+0000 7f3aa511d640 1 -- 172.21.15.79:0/3359438534 >> 172.21.15.79:0/3359438534 conn(0x7f3aa00cfc80 msgr2=0x7f3aa00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:44.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.376+0000 7f3aa511d640 1 -- 172.21.15.79:0/3359438534 shutdown_connections 2024-04-25T02:11:44.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.376+0000 7f3aa511d640 1 -- 172.21.15.79:0/3359438534 wait complete. 2024-04-25T02:11:44.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.378+0000 7f3aa511d640 1 Processor -- start 2024-04-25T02:11:44.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.378+0000 7f3aa511d640 1 -- start start 2024-04-25T02:11:44.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.378+0000 7f3aa511d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3aa006df50 0x7f3aa01f78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.378+0000 7f3aa511d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3aa00b48e0 0x7f3aa0150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.378+0000 7f3aa511d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3aa0143bc0 0x7f3aa0150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.378+0000 7f3aa511d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa0072660 con 0x7f3aa00b48e0 2024-04-25T02:11:44.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.378+0000 7f3aa511d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa0072380 con 0x7f3aa006df50 2024-04-25T02:11:44.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.378+0000 7f3aa511d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa0072940 con 0x7f3aa0143bc0 2024-04-25T02:11:44.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.378+0000 7f3a9e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3aa00b48e0 0x7f3aa0150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3a9e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3aa00b48e0 0x7f3aa0150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57394/0 (socket says 172.21.15.79:57394) 2024-04-25T02:11:44.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3a9e59c640 1 -- 172.21.15.79:0/2198291310 learned_addr learned my addr 172.21.15.79:0/2198291310 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:44.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3a9f59e640 1 --2- 172.21.15.79:0/2198291310 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3aa0143bc0 0x7f3aa0150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3a9ed9d640 1 --2- 172.21.15.79:0/2198291310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3aa006df50 0x7f3aa01f78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3a9e59c640 1 -- 172.21.15.79:0/2198291310 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3aa0143bc0 msgr2=0x7f3aa0150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3a9e59c640 1 --2- 172.21.15.79:0/2198291310 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3aa0143bc0 0x7f3aa0150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3a9e59c640 1 -- 172.21.15.79:0/2198291310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3aa006df50 msgr2=0x7f3aa01f78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3a9e59c640 1 --2- 172.21.15.79:0/2198291310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3aa006df50 0x7f3aa01f78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3a9e59c640 1 -- 172.21.15.79:0/2198291310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa0150f60 con 0x7f3aa00b48e0 2024-04-25T02:11:44.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3a9ed9d640 1 --2- 172.21.15.79:0/2198291310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3aa006df50 0x7f3aa01f78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:44.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3a9e59c640 1 --2- 172.21.15.79:0/2198291310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3aa00b48e0 0x7f3aa0150330 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3a8802a180 tx=0x7f3a880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:44.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3a977fe640 1 -- 172.21.15.79:0/2198291310 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88037040 con 0x7f3aa00b48e0 2024-04-25T02:11:44.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3a977fe640 1 -- 172.21.15.79:0/2198291310 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a88042070 con 0x7f3aa00b48e0 2024-04-25T02:11:44.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3aa511d640 1 -- 172.21.15.79:0/2198291310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa0151240 con 0x7f3aa00b48e0 2024-04-25T02:11:44.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3a977fe640 1 -- 172.21.15.79:0/2198291310 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88030880 con 0x7f3aa00b48e0 2024-04-25T02:11:44.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.379+0000 7f3aa511d640 1 -- 172.21.15.79:0/2198291310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa015cda0 con 0x7f3aa00b48e0 2024-04-25T02:11:44.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.380+0000 7f3aa511d640 1 -- 172.21.15.79:0/2198291310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa00690a0 con 0x7f3aa00b48e0 2024-04-25T02:11:44.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.381+0000 7f3a977fe640 1 -- 172.21.15.79:0/2198291310 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a88030a20 con 0x7f3aa00b48e0 2024-04-25T02:11:44.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.381+0000 7f3a977fe640 1 --2- 172.21.15.79:0/2198291310 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a8006be30 0x7f3a8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.381+0000 7f3a9ed9d640 1 --2- 172.21.15.79:0/2198291310 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a8006be30 0x7f3a8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.381+0000 7f3a977fe640 1 -- 172.21.15.79:0/2198291310 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f3a880ab600 con 0x7f3aa00b48e0 2024-04-25T02:11:44.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.381+0000 7f3a9ed9d640 1 --2- 172.21.15.79:0/2198291310 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a8006be30 0x7f3a8006e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3a98009b40 tx=0x7f3a98003a30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:44.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.385+0000 7f3a977fe640 1 -- 172.21.15.79:0/2198291310 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3a8807a040 con 0x7f3aa00b48e0 2024-04-25T02:11:44.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.596+0000 7f3aa511d640 1 -- 172.21.15.79:0/2198291310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3aa01441b0 con 0x7f3aa00b48e0 2024-04-25T02:11:44.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.596+0000 7f3a977fe640 1 -- 172.21.15.79:0/2198291310 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5185 (secure 0 0 0) 0x7f3a88079940 con 0x7f3aa00b48e0 2024-04-25T02:11:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:44.604 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5431,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3495029157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3495029157},{"type":"v1","addr":"172.21.15.189:6834","nonce":3495029157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2036557544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2036557544},{"type":"v1","addr":"172.21.15.189:6835","nonce":2036557544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/326759836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":326759836},{"type":"v1","addr":"172.21.15.79:6836","nonce":326759836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:25.684570+0000","modified":"2024-04-25T02:11:14.376645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.79:6837/2253487658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2253487658},{"type":"v1","addr":"172.21.15.79:6837","nonce":2253487658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":4}]} 2024-04-25T02:11:44.604 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 26 2024-04-25T02:11:44.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.598+0000 7f3aa511d640 1 -- 172.21.15.79:0/2198291310 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a8006be30 msgr2=0x7f3a8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.598+0000 7f3aa511d640 1 --2- 172.21.15.79:0/2198291310 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a8006be30 0x7f3a8006e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3a98009b40 tx=0x7f3a98003a30 comp rx=0 tx=0).stop 2024-04-25T02:11:44.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.598+0000 7f3aa511d640 1 -- 172.21.15.79:0/2198291310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3aa00b48e0 msgr2=0x7f3aa0150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.598+0000 7f3aa511d640 1 --2- 172.21.15.79:0/2198291310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3aa00b48e0 0x7f3aa0150330 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3a8802a180 tx=0x7f3a880046c0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.598+0000 7f3aa511d640 1 -- 172.21.15.79:0/2198291310 shutdown_connections 2024-04-25T02:11:44.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.598+0000 7f3aa511d640 1 --2- 172.21.15.79:0/2198291310 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a8006be30 0x7f3a8006e2f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.598+0000 7f3aa511d640 1 --2- 172.21.15.79:0/2198291310 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3aa0143bc0 0x7f3aa0150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.598+0000 7f3aa511d640 1 --2- 172.21.15.79:0/2198291310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3aa00b48e0 0x7f3aa0150330 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.598+0000 7f3aa511d640 1 --2- 172.21.15.79:0/2198291310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3aa006df50 0x7f3aa01f78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.598+0000 7f3aa511d640 1 -- 172.21.15.79:0/2198291310 >> 172.21.15.79:0/2198291310 conn(0x7f3aa00cfc80 msgr2=0x7f3aa0141e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:44.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.598+0000 7f3aa511d640 1 -- 172.21.15.79:0/2198291310 shutdown_connections 2024-04-25T02:11:44.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.598+0000 7f3aa511d640 1 -- 172.21.15.79:0/2198291310 wait complete. 2024-04-25T02:11:44.617 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:11:44.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.705+0000 7f416f66d640 1 Processor -- start 2024-04-25T02:11:44.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.706+0000 7f416f66d640 1 -- start start 2024-04-25T02:11:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.706+0000 7f416f66d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f416815a720 0x7f416815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.706+0000 7f416f66d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41680d07a0 0x7f41680b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.706+0000 7f416f66d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41680b47e0 0x7f416815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.706+0000 7f416f66d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f416815f1c0 con 0x7f41680d07a0 2024-04-25T02:11:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.706+0000 7f416f66d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f41680b2e60 con 0x7f416815a720 2024-04-25T02:11:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.706+0000 7f416f66d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f41680b3140 con 0x7f41680b47e0 2024-04-25T02:11:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.707+0000 7f416cc08640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41680d07a0 0x7f41680b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.707+0000 7f416cc08640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41680d07a0 0x7f41680b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57402/0 (socket says 172.21.15.79:57402) 2024-04-25T02:11:44.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.707+0000 7f416cc08640 1 -- 172.21.15.79:0/3376108045 learned_addr learned my addr 172.21.15.79:0/3376108045 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:44.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.707+0000 7f416cc08640 1 -- 172.21.15.79:0/3376108045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41680b47e0 msgr2=0x7f416815ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:44.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.707+0000 7f416cc08640 1 --2- 172.21.15.79:0/3376108045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41680b47e0 0x7f416815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.707+0000 7f416cc08640 1 -- 172.21.15.79:0/3376108045 >> v2:172.21.15.189:3300/0 conn(0x7f416815a720 msgr2=0x7f416815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:44.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.707+0000 7f416cc08640 1 --2- 172.21.15.79:0/3376108045 >> v2:172.21.15.189:3300/0 conn(0x7f416815a720 0x7f416815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.707+0000 7f416cc08640 1 -- 172.21.15.79:0/3376108045 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41680b3420 con 0x7f41680d07a0 2024-04-25T02:11:44.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.708+0000 7f416cc08640 1 --2- 172.21.15.79:0/3376108045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41680d07a0 0x7f41680b42a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f4168074d80 tx=0x7f416402b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178189b494e98570 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:44.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.708+0000 7f415bfff640 1 -- 172.21.15.79:0/3376108045 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416400b040 con 0x7f41680d07a0 2024-04-25T02:11:44.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.708+0000 7f415bfff640 1 -- 172.21.15.79:0/3376108045 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4164030710 con 0x7f41680d07a0 2024-04-25T02:11:44.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.708+0000 7f415bfff640 1 -- 172.21.15.79:0/3376108045 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4164030ae0 con 0x7f41680d07a0 2024-04-25T02:11:44.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.708+0000 7f416f66d640 1 -- 172.21.15.79:0/3376108045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41680d07a0 msgr2=0x7f41680b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.708+0000 7f416f66d640 1 --2- 172.21.15.79:0/3376108045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41680d07a0 0x7f41680b42a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f4168074d80 tx=0x7f416402b510 comp rx=0 tx=0).stop 2024-04-25T02:11:44.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.708+0000 7f416f66d640 1 -- 172.21.15.79:0/3376108045 shutdown_connections 2024-04-25T02:11:44.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.708+0000 7f416f66d640 1 --2- 172.21.15.79:0/3376108045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41680d07a0 0x7f41680b42a0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.708+0000 7f416f66d640 1 --2- 172.21.15.79:0/3376108045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41680b47e0 0x7f416815ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.708+0000 7f416f66d640 1 --2- 172.21.15.79:0/3376108045 >> v2:172.21.15.189:3300/0 conn(0x7f416815a720 0x7f416815ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.708+0000 7f416f66d640 1 -- 172.21.15.79:0/3376108045 >> 172.21.15.79:0/3376108045 conn(0x7f41680cfc80 msgr2=0x7f41680d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:44.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.708+0000 7f416f66d640 1 -- 172.21.15.79:0/3376108045 shutdown_connections 2024-04-25T02:11:44.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.708+0000 7f416f66d640 1 -- 172.21.15.79:0/3376108045 wait complete. 2024-04-25T02:11:44.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.709+0000 7f416f66d640 1 Processor -- start 2024-04-25T02:11:44.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.709+0000 7f416f66d640 1 -- start start 2024-04-25T02:11:44.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.710+0000 7f416f66d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41680b47e0 0x7f416815d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.710+0000 7f416f66d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41680d07a0 0x7f416815e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.710+0000 7f416f66d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416815a720 0x7f416815e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.710+0000 7f416f66d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f416806df50 con 0x7f416815a720 2024-04-25T02:11:44.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.710+0000 7f416f66d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f41680b39e0 con 0x7f41680d07a0 2024-04-25T02:11:44.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.710+0000 7f416f66d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f416806e0d0 con 0x7f41680b47e0 2024-04-25T02:11:44.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.710+0000 7f416dc0a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416815a720 0x7f416815e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.710+0000 7f416dc0a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416815a720 0x7f416815e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57406/0 (socket says 172.21.15.79:57406) 2024-04-25T02:11:44.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.710+0000 7f416dc0a640 1 -- 172.21.15.79:0/134488659 learned_addr learned my addr 172.21.15.79:0/134488659 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:44.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.710+0000 7f416dc0a640 1 -- 172.21.15.79:0/134488659 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41680b47e0 msgr2=0x7f416815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.710+0000 7f416dc0a640 1 --2- 172.21.15.79:0/134488659 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41680b47e0 0x7f416815d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.710+0000 7f416dc0a640 1 -- 172.21.15.79:0/134488659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41680d07a0 msgr2=0x7f416815e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.710+0000 7f416dc0a640 1 --2- 172.21.15.79:0/134488659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41680d07a0 0x7f416815e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.710+0000 7f416dc0a640 1 -- 172.21.15.79:0/134488659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416815d780 con 0x7f416815a720 2024-04-25T02:11:44.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.711+0000 7f416dc0a640 1 --2- 172.21.15.79:0/134488659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416815a720 0x7f416815e5d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f416000b970 tx=0x7f416000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:44.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.711+0000 7f4159ffb640 1 -- 172.21.15.79:0/134488659 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160019070 con 0x7f416815a720 2024-04-25T02:11:44.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.711+0000 7f4159ffb640 1 -- 172.21.15.79:0/134488659 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416000cb60 con 0x7f416815a720 2024-04-25T02:11:44.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.711+0000 7f416f66d640 1 -- 172.21.15.79:0/134488659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41681f4580 con 0x7f416815a720 2024-04-25T02:11:44.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.711+0000 7f4159ffb640 1 -- 172.21.15.79:0/134488659 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160014440 con 0x7f416815a720 2024-04-25T02:11:44.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.711+0000 7f416f66d640 1 -- 172.21.15.79:0/134488659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41681f4b40 con 0x7f416815a720 2024-04-25T02:11:44.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.712+0000 7f416f66d640 1 -- 172.21.15.79:0/134488659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41680690a0 con 0x7f416815a720 2024-04-25T02:11:44.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.712+0000 7f4159ffb640 1 -- 172.21.15.79:0/134488659 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f416001c070 con 0x7f416815a720 2024-04-25T02:11:44.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.712+0000 7f4159ffb640 1 --2- 172.21.15.79:0/134488659 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f414c06be30 0x7f414c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:44.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.713+0000 7f4159ffb640 1 -- 172.21.15.79:0/134488659 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f416008aca0 con 0x7f416815a720 2024-04-25T02:11:44.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.713+0000 7f416d409640 1 --2- 172.21.15.79:0/134488659 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f414c06be30 0x7f414c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:44.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.713+0000 7f416d409640 1 --2- 172.21.15.79:0/134488659 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f414c06be30 0x7f414c06e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f415c009670 tx=0x7f415c006bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:44.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.717+0000 7f4159ffb640 1 -- 172.21.15.79:0/134488659 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f41600595c0 con 0x7f416815a720 2024-04-25T02:11:44.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.889+0000 7f416f66d640 1 -- 172.21.15.79:0/134488659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41680b1810 con 0x7f416815a720 2024-04-25T02:11:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.890+0000 7f4159ffb640 1 -- 172.21.15.79:0/134488659 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16677 (secure 0 0 0) 0x7f4160058ec0 con 0x7f416815a720 2024-04-25T02:11:44.897 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:44.897 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":59,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:10:27.345273+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:23.901352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:24.658248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:11:44.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.892+0000 7f416f66d640 1 -- 172.21.15.79:0/134488659 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f414c06be30 msgr2=0x7f414c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.892+0000 7f416f66d640 1 --2- 172.21.15.79:0/134488659 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f414c06be30 0x7f414c06e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f415c009670 tx=0x7f415c006bf0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.892+0000 7f416f66d640 1 -- 172.21.15.79:0/134488659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416815a720 msgr2=0x7f416815e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.892+0000 7f416f66d640 1 --2- 172.21.15.79:0/134488659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416815a720 0x7f416815e5d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f416000b970 tx=0x7f416000be30 comp rx=0 tx=0).stop 2024-04-25T02:11:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.892+0000 7f416f66d640 1 -- 172.21.15.79:0/134488659 shutdown_connections 2024-04-25T02:11:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.892+0000 7f416f66d640 1 --2- 172.21.15.79:0/134488659 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f414c06be30 0x7f414c06e2f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.892+0000 7f416f66d640 1 --2- 172.21.15.79:0/134488659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416815a720 0x7f416815e5d0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.892+0000 7f416f66d640 1 --2- 172.21.15.79:0/134488659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41680d07a0 0x7f416815e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.892+0000 7f416f66d640 1 --2- 172.21.15.79:0/134488659 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41680b47e0 0x7f416815d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.892+0000 7f416f66d640 1 -- 172.21.15.79:0/134488659 >> 172.21.15.79:0/134488659 conn(0x7f41680cfc80 msgr2=0x7f4168153ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.892+0000 7f416f66d640 1 -- 172.21.15.79:0/134488659 shutdown_connections 2024-04-25T02:11:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:44.892+0000 7f416f66d640 1 -- 172.21.15.79:0/134488659 wait complete. 2024-04-25T02:11:44.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:11:45.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.000+0000 7ff54c28c640 1 Processor -- start 2024-04-25T02:11:45.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.000+0000 7ff54c28c640 1 -- start start 2024-04-25T02:11:45.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.001+0000 7ff54c28c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff544143bc0 0x7ff54415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:45.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.001+0000 7ff54c28c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff5440b3d40 0x7ff54406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:45.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.001+0000 7ff54c28c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54415fa40 con 0x7ff54406df50 2024-04-25T02:11:45.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.001+0000 7ff54c28c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff54406e8f0 con 0x7ff5440b3d40 2024-04-25T02:11:45.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.001+0000 7ff54c28c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff544072cb0 con 0x7ff544143bc0 2024-04-25T02:11:45.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.001+0000 7ff54a829640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff5440b3d40 0x7ff54406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.001+0000 7ff549827640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff54406df50 0x7ff5440b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39328/0 (socket says 172.21.15.79:39328) 2024-04-25T02:11:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.001+0000 7ff549827640 1 -- 172.21.15.79:0/3392087113 learned_addr learned my addr 172.21.15.79:0/3392087113 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.001+0000 7ff54a028640 1 --2- 172.21.15.79:0/3392087113 >> v2:172.21.15.189:3300/0 conn(0x7ff544143bc0 0x7ff54415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.001+0000 7ff54a829640 1 -- 172.21.15.79:0/3392087113 >> v2:172.21.15.189:3300/0 conn(0x7ff544143bc0 msgr2=0x7ff54415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.001+0000 7ff54a829640 1 --2- 172.21.15.79:0/3392087113 >> v2:172.21.15.189:3300/0 conn(0x7ff544143bc0 0x7ff54415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.001+0000 7ff54a829640 1 -- 172.21.15.79:0/3392087113 >> v1:172.21.15.79:6789/0 conn(0x7ff54406df50 legacy=0x7ff5440b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.001+0000 7ff54a829640 1 -- 172.21.15.79:0/3392087113 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff544071e00 con 0x7ff5440b3d40 2024-04-25T02:11:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.001+0000 7ff549026640 1 -- 172.21.15.79:0/3392087113 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3555044520 0 0) 0x7ff534001110 con 0x7ff54406df50 2024-04-25T02:11:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.001+0000 7ff54a028640 1 --2- 172.21.15.79:0/3392087113 >> v2:172.21.15.189:3300/0 conn(0x7ff544143bc0 0x7ff54415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.002+0000 7ff54a829640 1 --2- 172.21.15.79:0/3392087113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5440b3d40 0x7ff54406e3b0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff544067b50 tx=0x7ff53c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e8f6c6739fa794 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.002+0000 7ff549026640 1 -- 172.21.15.79:0/3392087113 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c037070 con 0x7ff5440b3d40 2024-04-25T02:11:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.002+0000 7ff549026640 1 -- 172.21.15.79:0/3392087113 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c032440 con 0x7ff5440b3d40 2024-04-25T02:11:45.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.002+0000 7ff549026640 1 -- 172.21.15.79:0/3392087113 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c02ae60 con 0x7ff5440b3d40 2024-04-25T02:11:45.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.003+0000 7ff54c28c640 1 -- 172.21.15.79:0/3392087113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5440b3d40 msgr2=0x7ff54406e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:45.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.003+0000 7ff54c28c640 1 --2- 172.21.15.79:0/3392087113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5440b3d40 0x7ff54406e3b0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff544067b50 tx=0x7ff53c02a110 comp rx=0 tx=0).stop 2024-04-25T02:11:45.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.003+0000 7ff54c28c640 1 -- 172.21.15.79:0/3392087113 shutdown_connections 2024-04-25T02:11:45.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.003+0000 7ff54c28c640 1 --2- 172.21.15.79:0/3392087113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5440b3d40 0x7ff54406e3b0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.003+0000 7ff54c28c640 1 --2- 172.21.15.79:0/3392087113 >> v2:172.21.15.189:3300/0 conn(0x7ff544143bc0 0x7ff54415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.003+0000 7ff54c28c640 1 -- 172.21.15.79:0/3392087113 >> 172.21.15.79:0/3392087113 conn(0x7ff5440cfc80 msgr2=0x7ff5440d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:45.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.003+0000 7ff54c28c640 1 -- 172.21.15.79:0/3392087113 shutdown_connections 2024-04-25T02:11:45.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.003+0000 7ff54c28c640 1 -- 172.21.15.79:0/3392087113 wait complete. 2024-04-25T02:11:45.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.004+0000 7ff54c28c640 1 Processor -- start 2024-04-25T02:11:45.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.004+0000 7ff54c28c640 1 -- start start 2024-04-25T02:11:45.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54c28c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff54406df50 0x7ff5441f0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:45.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54c28c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff5440b3d40 0x7ff544142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:45.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54c28c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff544143bc0 0x7ff544142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:45.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54c28c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff544072660 con 0x7ff54406df50 2024-04-25T02:11:45.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54c28c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff544072380 con 0x7ff544143bc0 2024-04-25T02:11:45.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54c28c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff544072940 con 0x7ff5440b3d40 2024-04-25T02:11:45.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54a028640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff54406df50 0x7ff5441f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:45.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54a028640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff54406df50 0x7ff5441f0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57434/0 (socket says 172.21.15.79:57434) 2024-04-25T02:11:45.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54a028640 1 -- 172.21.15.79:0/1953273387 learned_addr learned my addr 172.21.15.79:0/1953273387 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:45.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff549827640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff5440b3d40 0x7ff544142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:45.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54a829640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff544143bc0 0x7ff544142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:45.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54a028640 1 -- 172.21.15.79:0/1953273387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff5440b3d40 msgr2=0x7ff544142000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:45.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54a028640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff5440b3d40 0x7ff544142000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54a028640 1 -- 172.21.15.79:0/1953273387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff544143bc0 msgr2=0x7ff544142540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:45.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54a028640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff544143bc0 0x7ff544142540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54a028640 1 -- 172.21.15.79:0/1953273387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5440acc60 con 0x7ff54406df50 2024-04-25T02:11:45.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff549827640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff5440b3d40 0x7ff544142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:45.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54a829640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff544143bc0 0x7ff544142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:45.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54a028640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff54406df50 0x7ff5441f0130 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff54000cf90 tx=0x7ff54000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:45.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff53affd640 1 -- 172.21.15.79:0/1953273387 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54001a070 con 0x7ff54406df50 2024-04-25T02:11:45.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff53affd640 1 -- 172.21.15.79:0/1953273387 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54000d840 con 0x7ff54406df50 2024-04-25T02:11:45.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54c28c640 1 -- 172.21.15.79:0/1953273387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5440acf40 con 0x7ff54406df50 2024-04-25T02:11:45.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff53affd640 1 -- 172.21.15.79:0/1953273387 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54000dc10 con 0x7ff54406df50 2024-04-25T02:11:45.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.005+0000 7ff54c28c640 1 -- 172.21.15.79:0/1953273387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5440ad500 con 0x7ff54406df50 2024-04-25T02:11:45.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.006+0000 7ff54c28c640 1 -- 172.21.15.79:0/1953273387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5440690a0 con 0x7ff54406df50 2024-04-25T02:11:45.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.007+0000 7ff53affd640 1 -- 172.21.15.79:0/1953273387 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff54001d070 con 0x7ff54406df50 2024-04-25T02:11:45.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.007+0000 7ff53affd640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff52806be30 0x7ff52806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:45.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.007+0000 7ff53affd640 1 -- 172.21.15.79:0/1953273387 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7ff54008b630 con 0x7ff54406df50 2024-04-25T02:11:45.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.007+0000 7ff549827640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff52806be30 0x7ff52806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:45.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.008+0000 7ff549827640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff52806be30 0x7ff52806e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff5440cc810 tx=0x7ff534009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:45.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.012+0000 7ff53affd640 1 -- 172.21.15.79:0/1953273387 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff540059990 con 0x7ff54406df50 2024-04-25T02:11:45.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.220+0000 7ff54c28c640 1 -- 172.21.15.79:0/1953273387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff5440ad8d0 con 0x7ff54406df50 2024-04-25T02:11:45.229 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:11:45.221+0000 7fb0c50c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:11:45.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.224+0000 7ff53affd640 1 -- 172.21.15.79:0/1953273387 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7ff54005ee20 con 0x7ff54406df50 2024-04-25T02:11:45.232 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:11:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.226+0000 7ff54c28c640 1 -- 172.21.15.79:0/1953273387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff52806be30 msgr2=0x7ff52806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.226+0000 7ff54c28c640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff52806be30 0x7ff52806e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff5440cc810 tx=0x7ff534009040 comp rx=0 tx=0).stop 2024-04-25T02:11:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.226+0000 7ff54c28c640 1 -- 172.21.15.79:0/1953273387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff54406df50 msgr2=0x7ff5441f0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.226+0000 7ff54c28c640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff54406df50 0x7ff5441f0130 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff54000cf90 tx=0x7ff54000a7d0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.226+0000 7ff54c28c640 1 -- 172.21.15.79:0/1953273387 shutdown_connections 2024-04-25T02:11:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.226+0000 7ff54c28c640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff52806be30 0x7ff52806e2f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.226+0000 7ff54c28c640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff544143bc0 0x7ff544142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.226+0000 7ff54c28c640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff5440b3d40 0x7ff544142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.226+0000 7ff54c28c640 1 --2- 172.21.15.79:0/1953273387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff54406df50 0x7ff5441f0130 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.226+0000 7ff54c28c640 1 -- 172.21.15.79:0/1953273387 >> 172.21.15.79:0/1953273387 conn(0x7ff5440cfc80 msgr2=0x7ff5440cde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.226+0000 7ff54c28c640 1 -- 172.21.15.79:0/1953273387 shutdown_connections 2024-04-25T02:11:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.226+0000 7ff54c28c640 1 -- 172.21.15.79:0/1953273387 wait complete. 2024-04-25T02:11:45.238 INFO:tasks.ceph.mds.a.smithi079.stderr: -6350> 2024-04-25T02:10:31.598+0000 7fb992853640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:11:45.240 INFO:tasks.ceph.mds.a.smithi079.stderr: -4790> 2024-04-25T02:10:37.483+0000 7fb98e84b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={6297=0-4194304@1} caps={6297=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6297 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55f5250ea680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:45.241 INFO:tasks.ceph.mds.a.smithi079.stderr: -3026> 2024-04-25T02:11:08.750+0000 7fb98e84b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={6297=0-4194304@1} caps={6297=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6297 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55f5250ea680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:45.247 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T02:11:45.270 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:11:45.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.338+0000 7f4940e58640 1 Processor -- start 2024-04-25T02:11:45.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.338+0000 7f4940e58640 1 -- start start 2024-04-25T02:11:45.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.339+0000 7f4940e58640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f493c0d2ca0 0x7f493c0d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:45.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.339+0000 7f4940e58640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f493c0d0ef0 0x7f493c06bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:45.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.339+0000 7f4940e58640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f493c0d1ee0 con 0x7f493c15e4f0 2024-04-25T02:11:45.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.339+0000 7f4940e58640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f493c0d3130 con 0x7f493c0d2ca0 2024-04-25T02:11:45.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.339+0000 7f4940e58640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f493c0d21c0 con 0x7f493c0d0ef0 2024-04-25T02:11:45.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.339+0000 7f493a59c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f493c15e4f0 0x7f493c0cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39330/0 (socket says 172.21.15.79:39330) 2024-04-25T02:11:45.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.339+0000 7f493a59c640 1 -- 172.21.15.79:0/2384811369 learned_addr learned my addr 172.21.15.79:0/2384811369 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:45.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 -- 172.21.15.79:0/2384811369 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782029481 0 0) 0x7f493c0d1ee0 con 0x7f493c15e4f0 2024-04-25T02:11:45.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 -- 172.21.15.79:0/2384811369 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4924003520 con 0x7f493c15e4f0 2024-04-25T02:11:45.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f4939d9b640 1 --2- 172.21.15.79:0/2384811369 >> v2:172.21.15.189:3300/0 conn(0x7f493c0d2ca0 0x7f493c0d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:45.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493ad9d640 1 --2- 172.21.15.79:0/2384811369 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f493c0d0ef0 0x7f493c06bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:45.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 -- 172.21.15.79:0/2384811369 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1979938367 0 0) 0x7f4924003520 con 0x7f493c15e4f0 2024-04-25T02:11:45.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 -- 172.21.15.79:0/2384811369 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f493c0d0ef0 msgr2=0x7f493c06bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:45.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 --2- 172.21.15.79:0/2384811369 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f493c0d0ef0 0x7f493c06bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 -- 172.21.15.79:0/2384811369 >> v2:172.21.15.189:3300/0 conn(0x7f493c0d2ca0 msgr2=0x7f493c0d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:45.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 --2- 172.21.15.79:0/2384811369 >> v2:172.21.15.189:3300/0 conn(0x7f493c0d2ca0 0x7f493c0d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 -- 172.21.15.79:0/2384811369 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c0d24a0 con 0x7f493c15e4f0 2024-04-25T02:11:45.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 -- 172.21.15.79:0/2384811369 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f492c0019f0 con 0x7f493c15e4f0 2024-04-25T02:11:45.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493ad9d640 1 --2- 172.21.15.79:0/2384811369 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f493c0d0ef0 0x7f493c06bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:45.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 -- 172.21.15.79:0/2384811369 >> v1:172.21.15.79:6789/0 conn(0x7f493c15e4f0 legacy=0x7f493c0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:45.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 --2- 172.21.15.79:0/2384811369 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f493c0d0ef0 0x7f49240039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:45.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 --2- 172.21.15.79:0/2384811369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4924003ef0 0x7f4924004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:45.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 --2- 172.21.15.79:0/2384811369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4924004d40 0x7f49240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:45.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 -- 172.21.15.79:0/2384811369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f493c0d21c0 con 0x7f4924004d40 2024-04-25T02:11:45.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 -- 172.21.15.79:0/2384811369 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f492400b9c0 con 0x7f4924003ef0 2024-04-25T02:11:45.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493959a640 1 -- 172.21.15.79:0/2384811369 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f492400bb70 con 0x7f493c0d0ef0 2024-04-25T02:11:45.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493ad9d640 1 --2- 172.21.15.79:0/2384811369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4924004d40 0x7f49240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:45.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493a59c640 1 --2- 172.21.15.79:0/2384811369 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f493c0d0ef0 0x7f49240039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:45.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f4939d9b640 1 --2- 172.21.15.79:0/2384811369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4924003ef0 0x7f4924004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:45.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493ad9d640 1 -- 172.21.15.79:0/2384811369 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f493c0d0ef0 msgr2=0x7f49240039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:45.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493ad9d640 1 --2- 172.21.15.79:0/2384811369 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f493c0d0ef0 0x7f49240039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493ad9d640 1 -- 172.21.15.79:0/2384811369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4924003ef0 msgr2=0x7f4924004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:45.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493ad9d640 1 --2- 172.21.15.79:0/2384811369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4924003ef0 0x7f4924004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f493ad9d640 1 -- 172.21.15.79:0/2384811369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4924003520 con 0x7f4924004d40 2024-04-25T02:11:45.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.340+0000 7f4939d9b640 1 --2- 172.21.15.79:0/2384811369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4924003ef0 0x7f4924004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:45.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.341+0000 7f493ad9d640 1 --2- 172.21.15.79:0/2384811369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4924004d40 0x7f49240051c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f49340098a0 tx=0x7f4924005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10d52a21f261f57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:45.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.341+0000 7f493959a640 1 -- 172.21.15.79:0/2384811369 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493400f040 con 0x7f4924004d40 2024-04-25T02:11:45.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.341+0000 7f493959a640 1 -- 172.21.15.79:0/2384811369 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f493402ace0 con 0x7f4924004d40 2024-04-25T02:11:45.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.341+0000 7f493959a640 1 -- 172.21.15.79:0/2384811369 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934004250 con 0x7f4924004d40 2024-04-25T02:11:45.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.342+0000 7f4940e58640 1 -- 172.21.15.79:0/2384811369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4924004d40 msgr2=0x7f49240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:45.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.342+0000 7f4940e58640 1 --2- 172.21.15.79:0/2384811369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4924004d40 0x7f49240051c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f49340098a0 tx=0x7f4924005830 comp rx=0 tx=0).stop 2024-04-25T02:11:45.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.342+0000 7f493ad9d640 1 -- 172.21.15.79:0/2384811369 reap_dead start 2024-04-25T02:11:45.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.342+0000 7f4940e58640 1 -- 172.21.15.79:0/2384811369 shutdown_connections 2024-04-25T02:11:45.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.342+0000 7f4940e58640 1 -- 172.21.15.79:0/2384811369 >> 172.21.15.79:0/2384811369 conn(0x7f493c09d4a0 msgr2=0x7f493c0d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:45.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.342+0000 7f4940e58640 1 -- 172.21.15.79:0/2384811369 shutdown_connections 2024-04-25T02:11:45.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.342+0000 7f4940e58640 1 -- 172.21.15.79:0/2384811369 wait complete. 2024-04-25T02:11:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.343+0000 7f4940e58640 1 Processor -- start 2024-04-25T02:11:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.343+0000 7f4940e58640 1 -- start start 2024-04-25T02:11:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f4940e58640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4924004d40 0x7f493c0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f4940e58640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f493c0b8fb0 0x7f493c1f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f4940e58640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f493c14d220 0x7f493c14d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f4940e58640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f493c0d4ee0 con 0x7f493c14d220 2024-04-25T02:11:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f4940e58640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f493c0cff00 con 0x7f4924004d40 2024-04-25T02:11:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f4940e58640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f493c0d5060 con 0x7f493c0b8fb0 2024-04-25T02:11:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f493ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f493c14d220 0x7f493c14d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f493ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f493c14d220 0x7f493c14d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57476/0 (socket says 172.21.15.79:57476) 2024-04-25T02:11:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f493ad9d640 1 -- 172.21.15.79:0/3298459159 learned_addr learned my addr 172.21.15.79:0/3298459159 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f493a59c640 1 --2- 172.21.15.79:0/3298459159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4924004d40 0x7f493c0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f4939d9b640 1 --2- 172.21.15.79:0/3298459159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f493c0b8fb0 0x7f493c1f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f493ad9d640 1 -- 172.21.15.79:0/3298459159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f493c0b8fb0 msgr2=0x7f493c1f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f493ad9d640 1 --2- 172.21.15.79:0/3298459159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f493c0b8fb0 0x7f493c1f3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f493ad9d640 1 -- 172.21.15.79:0/3298459159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4924004d40 msgr2=0x7f493c0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f493ad9d640 1 --2- 172.21.15.79:0/3298459159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4924004d40 0x7f493c0cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f493ad9d640 1 -- 172.21.15.79:0/3298459159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c0b9dc0 con 0x7f493c14d220 2024-04-25T02:11:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f493ad9d640 1 --2- 172.21.15.79:0/3298459159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f493c14d220 0x7f493c14d6d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f49340099c0 tx=0x7f4934004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f492affd640 1 -- 172.21.15.79:0/3298459159 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493400f000 con 0x7f493c14d220 2024-04-25T02:11:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.344+0000 7f492affd640 1 -- 172.21.15.79:0/3298459159 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4934044070 con 0x7f493c14d220 2024-04-25T02:11:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.345+0000 7f4940e58640 1 -- 172.21.15.79:0/3298459159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493c0c8e20 con 0x7f493c14d220 2024-04-25T02:11:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.345+0000 7f492affd640 1 -- 172.21.15.79:0/3298459159 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934003b30 con 0x7f493c14d220 2024-04-25T02:11:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.345+0000 7f4940e58640 1 -- 172.21.15.79:0/3298459159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f493c0b9800 con 0x7f493c14d220 2024-04-25T02:11:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.346+0000 7f4940e58640 1 -- 172.21.15.79:0/3298459159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f493c0686c0 con 0x7f493c14d220 2024-04-25T02:11:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.346+0000 7f492affd640 1 -- 172.21.15.79:0/3298459159 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f493403b040 con 0x7f493c14d220 2024-04-25T02:11:45.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.346+0000 7f492affd640 1 --2- 172.21.15.79:0/3298459159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f491c06be60 0x7f491c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:45.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.346+0000 7f493a59c640 1 --2- 172.21.15.79:0/3298459159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f491c06be60 0x7f491c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:45.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.346+0000 7f492affd640 1 -- 172.21.15.79:0/3298459159 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5795+0+0 (secure 0 0 0) 0x7f49340aac80 con 0x7f493c14d220 2024-04-25T02:11:45.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.347+0000 7f493a59c640 1 --2- 172.21.15.79:0/3298459159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f491c06be60 0x7f491c06e320 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f493c0cdb50 tx=0x7f492c006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:45.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.351+0000 7f492affd640 1 -- 172.21.15.79:0/3298459159 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f49340795d0 con 0x7f493c14d220 2024-04-25T02:11:45.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:45.565+0000 7f4940e58640 1 -- 172.21.15.79:0/3298459159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f493c0d1360 con 0x7f493c14d220 2024-04-25T02:11:46.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.225+0000 7f492affd640 1 -- 172.21.15.79:0/3298459159 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7f493c0d1360 con 0x7f493c14d220 2024-04-25T02:11:46.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.227+0000 7f4940e58640 1 -- 172.21.15.79:0/3298459159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f491c06be60 msgr2=0x7f491c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:46.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.227+0000 7f4940e58640 1 --2- 172.21.15.79:0/3298459159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f491c06be60 0x7f491c06e320 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f493c0cdb50 tx=0x7f492c006040 comp rx=0 tx=0).stop 2024-04-25T02:11:46.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.227+0000 7f4940e58640 1 -- 172.21.15.79:0/3298459159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f493c14d220 msgr2=0x7f493c14d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:46.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.227+0000 7f4940e58640 1 --2- 172.21.15.79:0/3298459159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f493c14d220 0x7f493c14d6d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f49340099c0 tx=0x7f4934004730 comp rx=0 tx=0).stop 2024-04-25T02:11:46.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.227+0000 7f4940e58640 1 -- 172.21.15.79:0/3298459159 shutdown_connections 2024-04-25T02:11:46.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.227+0000 7f4940e58640 1 --2- 172.21.15.79:0/3298459159 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f491c06be60 0x7f491c06e320 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:46.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.227+0000 7f4940e58640 1 --2- 172.21.15.79:0/3298459159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f493c14d220 0x7f493c14d6d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:46.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.227+0000 7f4940e58640 1 --2- 172.21.15.79:0/3298459159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f493c0b8fb0 0x7f493c1f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:46.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.227+0000 7f4940e58640 1 --2- 172.21.15.79:0/3298459159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4924004d40 0x7f493c0cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:46.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.227+0000 7f4940e58640 1 -- 172.21.15.79:0/3298459159 >> 172.21.15.79:0/3298459159 conn(0x7f493c09d4a0 msgr2=0x7f493c0d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:46.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.228+0000 7f4940e58640 1 -- 172.21.15.79:0/3298459159 shutdown_connections 2024-04-25T02:11:46.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.228+0000 7f4940e58640 1 -- 172.21.15.79:0/3298459159 wait complete. 2024-04-25T02:11:46.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T02:11:46.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.388+0000 7fe5e04f5640 1 Processor -- start 2024-04-25T02:11:46.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.388+0000 7fe5e04f5640 1 -- start start 2024-04-25T02:11:46.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.389+0000 7fe5e04f5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe5d80d2f20 0x7fe5d80d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:46.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.389+0000 7fe5e04f5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5d80d1e80 con 0x7fe5d80d0ed0 2024-04-25T02:11:46.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.389+0000 7fe5e04f5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5d80d2160 con 0x7fe5d815e440 2024-04-25T02:11:46.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.389+0000 7fe5e04f5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe5d80d2440 con 0x7fe5d80d2f20 2024-04-25T02:11:46.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.390+0000 7fe5dda90640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe5d80d2f20 0x7fe5d80d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:46.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.390+0000 7fe5dea92640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe5d80d0ed0 0x7fe5d80b6ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39346/0 (socket says 172.21.15.79:39346) 2024-04-25T02:11:46.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.390+0000 7fe5dea92640 1 -- 172.21.15.79:0/1701097107 learned_addr learned my addr 172.21.15.79:0/1701097107 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:46.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.390+0000 7fe5dda90640 1 -- 172.21.15.79:0/1701097107 >> v1:172.21.15.189:6789/0 conn(0x7fe5d815e440 legacy=0x7fe5d80cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:46.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.390+0000 7fe5dda90640 1 -- 172.21.15.79:0/1701097107 >> v1:172.21.15.79:6789/0 conn(0x7fe5d80d0ed0 legacy=0x7fe5d80b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:46.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.390+0000 7fe5dda90640 1 -- 172.21.15.79:0/1701097107 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d80d2720 con 0x7fe5d80d2f20 2024-04-25T02:11:46.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.390+0000 7fe5dd28f640 1 -- 172.21.15.79:0/1701097107 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2005671191 0 0) 0x7fe5d80d1e80 con 0x7fe5d80d0ed0 2024-04-25T02:11:46.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.390+0000 7fe5dda90640 1 --2- 172.21.15.79:0/1701097107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d80d2f20 0x7fe5d80d0990 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80097a0 tx=0x7fe5c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6070b4df8d245246 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:46.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.391+0000 7fe5dd28f640 1 -- 172.21.15.79:0/1701097107 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8037070 con 0x7fe5d80d2f20 2024-04-25T02:11:46.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.391+0000 7fe5dd28f640 1 -- 172.21.15.79:0/1701097107 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c8032440 con 0x7fe5d80d2f20 2024-04-25T02:11:46.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.391+0000 7fe5dd28f640 1 -- 172.21.15.79:0/1701097107 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8032810 con 0x7fe5d80d2f20 2024-04-25T02:11:46.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.391+0000 7fe5e04f5640 1 -- 172.21.15.79:0/1701097107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d80d2f20 msgr2=0x7fe5d80d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:46.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.391+0000 7fe5e04f5640 1 --2- 172.21.15.79:0/1701097107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d80d2f20 0x7fe5d80d0990 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80097a0 tx=0x7fe5c802a1e0 comp rx=0 tx=0).stop 2024-04-25T02:11:46.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.391+0000 7fe5e04f5640 1 -- 172.21.15.79:0/1701097107 shutdown_connections 2024-04-25T02:11:46.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.391+0000 7fe5e04f5640 1 --2- 172.21.15.79:0/1701097107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d80d2f20 0x7fe5d80d0990 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:46.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.391+0000 7fe5e04f5640 1 -- 172.21.15.79:0/1701097107 >> 172.21.15.79:0/1701097107 conn(0x7fe5d809d450 msgr2=0x7fe5d80d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:46.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.391+0000 7fe5e04f5640 1 -- 172.21.15.79:0/1701097107 shutdown_connections 2024-04-25T02:11:46.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.391+0000 7fe5e04f5640 1 -- 172.21.15.79:0/1701097107 wait complete. 2024-04-25T02:11:46.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.392+0000 7fe5e04f5640 1 Processor -- start 2024-04-25T02:11:46.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.392+0000 7fe5e04f5640 1 -- start start 2024-04-25T02:11:46.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.393+0000 7fe5e04f5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d80d0ed0 0x7fe5d80ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:46.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.393+0000 7fe5e04f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d80d2f20 0x7fe5d80c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:46.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.393+0000 7fe5e04f5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5d815e440 0x7fe5d81f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:46.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.393+0000 7fe5e04f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d80d0100 con 0x7fe5d80d2f20 2024-04-25T02:11:46.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.393+0000 7fe5e04f5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d80cff80 con 0x7fe5d80d0ed0 2024-04-25T02:11:46.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.393+0000 7fe5e04f5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d80b7600 con 0x7fe5d815e440 2024-04-25T02:11:46.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.393+0000 7fe5dda90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d80d2f20 0x7fe5d80c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:46.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.393+0000 7fe5dda90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d80d2f20 0x7fe5d80c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57490/0 (socket says 172.21.15.79:57490) 2024-04-25T02:11:46.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.393+0000 7fe5dda90640 1 -- 172.21.15.79:0/233137853 learned_addr learned my addr 172.21.15.79:0/233137853 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:46.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.394+0000 7fe5dea92640 1 --2- 172.21.15.79:0/233137853 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5d815e440 0x7fe5d81f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.394+0000 7fe5dda90640 1 -- 172.21.15.79:0/233137853 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5d815e440 msgr2=0x7fe5d81f7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.394+0000 7fe5dda90640 1 --2- 172.21.15.79:0/233137853 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5d815e440 0x7fe5d81f7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.394+0000 7fe5de291640 1 --2- 172.21.15.79:0/233137853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d80d0ed0 0x7fe5d80ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.394+0000 7fe5dda90640 1 -- 172.21.15.79:0/233137853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d80d0ed0 msgr2=0x7fe5d80ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.394+0000 7fe5dda90640 1 --2- 172.21.15.79:0/233137853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d80d0ed0 0x7fe5d80ca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.394+0000 7fe5dda90640 1 -- 172.21.15.79:0/233137853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d80ca970 con 0x7fe5d80d2f20 2024-04-25T02:11:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.394+0000 7fe5dda90640 1 --2- 172.21.15.79:0/233137853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d80d2f20 0x7fe5d80c9060 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80097a0 tx=0x7fe5c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.394+0000 7fe5ceffd640 1 -- 172.21.15.79:0/233137853 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8037040 con 0x7fe5d80d2f20 2024-04-25T02:11:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.394+0000 7fe5ceffd640 1 -- 172.21.15.79:0/233137853 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c8004250 con 0x7fe5d80d2f20 2024-04-25T02:11:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.394+0000 7fe5ceffd640 1 -- 172.21.15.79:0/233137853 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8032e20 con 0x7fe5d80d2f20 2024-04-25T02:11:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.394+0000 7fe5e04f5640 1 -- 172.21.15.79:0/233137853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d80ce190 con 0x7fe5d80d2f20 2024-04-25T02:11:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.394+0000 7fe5e04f5640 1 -- 172.21.15.79:0/233137853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d80cdbd0 con 0x7fe5d80d2f20 2024-04-25T02:11:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.395+0000 7fe5e04f5640 1 -- 172.21.15.79:0/233137853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d80ce5f0 con 0x7fe5d80d2f20 2024-04-25T02:11:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.395+0000 7fe5ceffd640 1 -- 172.21.15.79:0/233137853 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe5c8030770 con 0x7fe5d80d2f20 2024-04-25T02:11:46.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.396+0000 7fe5ceffd640 1 --2- 172.21.15.79:0/233137853 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe5bc06be30 0x7fe5bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:46.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.396+0000 7fe5ceffd640 1 -- 172.21.15.79:0/233137853 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5795+0+0 (secure 0 0 0) 0x7fe5c80ac220 con 0x7fe5d80d2f20 2024-04-25T02:11:46.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.396+0000 7fe5de291640 1 --2- 172.21.15.79:0/233137853 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe5bc06be30 0x7fe5bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:46.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.396+0000 7fe5de291640 1 --2- 172.21.15.79:0/233137853 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe5bc06be30 0x7fe5bc06e2f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400a730 tx=0x7fe5d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:46.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.400+0000 7fe5ceffd640 1 -- 172.21.15.79:0/233137853 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe5d80ce5f0 con 0x7fe5d80d2f20 2024-04-25T02:11:46.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:46.575+0000 7fe5e04f5640 1 -- 172.21.15.79:0/233137853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe5d815ac30 con 0x7fe5d80d2f20 2024-04-25T02:11:47.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.548+0000 7fe5ceffd640 1 -- 172.21.15.79:0/233137853 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v61) ==== 181+0+0 (secure 0 0 0) 0x7fe5c8046e50 con 0x7fe5d80d2f20 2024-04-25T02:11:47.556 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-04-25T02:11:47.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.552+0000 7fe5e04f5640 1 -- 172.21.15.79:0/233137853 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe5bc06be30 msgr2=0x7fe5bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:47.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.552+0000 7fe5e04f5640 1 --2- 172.21.15.79:0/233137853 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe5bc06be30 0x7fe5bc06e2f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400a730 tx=0x7fe5d4008040 comp rx=0 tx=0).stop 2024-04-25T02:11:47.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.552+0000 7fe5e04f5640 1 -- 172.21.15.79:0/233137853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d80d2f20 msgr2=0x7fe5d80c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:47.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.552+0000 7fe5e04f5640 1 --2- 172.21.15.79:0/233137853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d80d2f20 0x7fe5d80c9060 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80097a0 tx=0x7fe5c80046c0 comp rx=0 tx=0).stop 2024-04-25T02:11:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.553+0000 7fe5e04f5640 1 -- 172.21.15.79:0/233137853 shutdown_connections 2024-04-25T02:11:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.553+0000 7fe5e04f5640 1 --2- 172.21.15.79:0/233137853 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe5bc06be30 0x7fe5bc06e2f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.553+0000 7fe5e04f5640 1 --2- 172.21.15.79:0/233137853 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5d815e440 0x7fe5d81f7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.553+0000 7fe5e04f5640 1 --2- 172.21.15.79:0/233137853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d80d2f20 0x7fe5d80c9060 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.553+0000 7fe5e04f5640 1 --2- 172.21.15.79:0/233137853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d80d0ed0 0x7fe5d80ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.553+0000 7fe5e04f5640 1 -- 172.21.15.79:0/233137853 >> 172.21.15.79:0/233137853 conn(0x7fe5d809d450 msgr2=0x7fe5d80d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.553+0000 7fe5e04f5640 1 -- 172.21.15.79:0/233137853 shutdown_connections 2024-04-25T02:11:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.553+0000 7fe5e04f5640 1 -- 172.21.15.79:0/233137853 wait complete. 2024-04-25T02:11:47.576 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T02:11:47.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.674+0000 7f5d924ae640 1 Processor -- start 2024-04-25T02:11:47.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.674+0000 7f5d924ae640 1 -- start start 2024-04-25T02:11:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.674+0000 7f5d924ae640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5d8c13de20 0x7f5d8c15e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.674+0000 7f5d924ae640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5d8c0cebe0 0x7f5d8c0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.674+0000 7f5d924ae640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d8c0cf2e0 con 0x7f5d8c15ef10 2024-04-25T02:11:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.674+0000 7f5d924ae640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5d8c0cf5c0 con 0x7f5d8c0cebe0 2024-04-25T02:11:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.674+0000 7f5d924ae640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f5d8c0cf8a0 con 0x7f5d8c13de20 2024-04-25T02:11:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.675+0000 7f5d90a4b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5d8c0cebe0 0x7f5d8c0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.675+0000 7f5d8b7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5d8c15ef10 0x7f5d8c0ce4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39348/0 (socket says 172.21.15.79:39348) 2024-04-25T02:11:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.675+0000 7f5d8b7fe640 1 -- 172.21.15.79:0/2385168792 learned_addr learned my addr 172.21.15.79:0/2385168792 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.675+0000 7f5d8bfff640 1 --2- 172.21.15.79:0/2385168792 >> v2:172.21.15.189:3300/0 conn(0x7f5d8c13de20 0x7f5d8c15e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.675+0000 7f5d90a4b640 1 -- 172.21.15.79:0/2385168792 >> v2:172.21.15.189:3300/0 conn(0x7f5d8c13de20 msgr2=0x7f5d8c15e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.675+0000 7f5d90a4b640 1 --2- 172.21.15.79:0/2385168792 >> v2:172.21.15.189:3300/0 conn(0x7f5d8c13de20 0x7f5d8c15e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.675+0000 7f5d90a4b640 1 -- 172.21.15.79:0/2385168792 >> v1:172.21.15.79:6789/0 conn(0x7f5d8c15ef10 legacy=0x7f5d8c0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.675+0000 7f5d8affd640 1 -- 172.21.15.79:0/2385168792 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3257946482 0 0) 0x7f5d8c0cf2e0 con 0x7f5d8c15ef10 2024-04-25T02:11:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.675+0000 7f5d90a4b640 1 -- 172.21.15.79:0/2385168792 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8c0b2f40 con 0x7f5d8c0cebe0 2024-04-25T02:11:47.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.676+0000 7f5d90a4b640 1 --2- 172.21.15.79:0/2385168792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d8c0cebe0 0x7f5d8c0b3460 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c070370 tx=0x7f5d8402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32d009d325538f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:47.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.676+0000 7f5d8affd640 1 -- 172.21.15.79:0/2385168792 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84007740 con 0x7f5d8c0cebe0 2024-04-25T02:11:47.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.676+0000 7f5d8affd640 1 -- 172.21.15.79:0/2385168792 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d840078e0 con 0x7f5d8c0cebe0 2024-04-25T02:11:47.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.676+0000 7f5d8affd640 1 -- 172.21.15.79:0/2385168792 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84007cb0 con 0x7f5d8c0cebe0 2024-04-25T02:11:47.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.676+0000 7f5d924ae640 1 -- 172.21.15.79:0/2385168792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d8c0cebe0 msgr2=0x7f5d8c0b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:47.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.676+0000 7f5d924ae640 1 --2- 172.21.15.79:0/2385168792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d8c0cebe0 0x7f5d8c0b3460 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c070370 tx=0x7f5d8402a5f0 comp rx=0 tx=0).stop 2024-04-25T02:11:47.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.676+0000 7f5d924ae640 1 -- 172.21.15.79:0/2385168792 shutdown_connections 2024-04-25T02:11:47.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.676+0000 7f5d924ae640 1 --2- 172.21.15.79:0/2385168792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d8c0cebe0 0x7f5d8c0b3460 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:47.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.676+0000 7f5d924ae640 1 --2- 172.21.15.79:0/2385168792 >> v2:172.21.15.189:3300/0 conn(0x7f5d8c13de20 0x7f5d8c15e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:47.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.676+0000 7f5d924ae640 1 -- 172.21.15.79:0/2385168792 >> 172.21.15.79:0/2385168792 conn(0x7f5d8c06b4a0 msgr2=0x7f5d8c06b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:47.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.676+0000 7f5d924ae640 1 -- 172.21.15.79:0/2385168792 shutdown_connections 2024-04-25T02:11:47.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.676+0000 7f5d924ae640 1 -- 172.21.15.79:0/2385168792 wait complete. 2024-04-25T02:11:47.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.677+0000 7f5d924ae640 1 Processor -- start 2024-04-25T02:11:47.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.678+0000 7f5d924ae640 1 -- start start 2024-04-25T02:11:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.678+0000 7f5d924ae640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d8c0cebe0 0x7f5d8c1402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.678+0000 7f5d924ae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d8c13de20 0x7f5d8c137670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.678+0000 7f5d924ae640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d8c15ef10 0x7f5d8c159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.678+0000 7f5d924ae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c0b39a0 con 0x7f5d8c13de20 2024-04-25T02:11:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.678+0000 7f5d924ae640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c13e200 con 0x7f5d8c0cebe0 2024-04-25T02:11:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.678+0000 7f5d924ae640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5d8c0b3b20 con 0x7f5d8c15ef10 2024-04-25T02:11:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.678+0000 7f5d8b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d8c13de20 0x7f5d8c137670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.678+0000 7f5d8b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d8c13de20 0x7f5d8c137670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57510/0 (socket says 172.21.15.79:57510) 2024-04-25T02:11:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.678+0000 7f5d8b7fe640 1 -- 172.21.15.79:0/2222787873 learned_addr learned my addr 172.21.15.79:0/2222787873 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.679+0000 7f5d8bfff640 1 --2- 172.21.15.79:0/2222787873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d8c0cebe0 0x7f5d8c1402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.679+0000 7f5d90a4b640 1 --2- 172.21.15.79:0/2222787873 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d8c15ef10 0x7f5d8c159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.679+0000 7f5d8b7fe640 1 -- 172.21.15.79:0/2222787873 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d8c15ef10 msgr2=0x7f5d8c159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.679+0000 7f5d8b7fe640 1 --2- 172.21.15.79:0/2222787873 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d8c15ef10 0x7f5d8c159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.679+0000 7f5d8b7fe640 1 -- 172.21.15.79:0/2222787873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d8c0cebe0 msgr2=0x7f5d8c1402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.679+0000 7f5d8b7fe640 1 --2- 172.21.15.79:0/2222787873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d8c0cebe0 0x7f5d8c1402b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.679+0000 7f5d8b7fe640 1 -- 172.21.15.79:0/2222787873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8c140b00 con 0x7f5d8c13de20 2024-04-25T02:11:47.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.679+0000 7f5d8b7fe640 1 --2- 172.21.15.79:0/2222787873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d8c13de20 0x7f5d8c137670 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00c3f0 tx=0x7f5d7c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:47.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.679+0000 7f5d88ff9640 1 -- 172.21.15.79:0/2222787873 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0074e0 con 0x7f5d8c13de20 2024-04-25T02:11:47.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.679+0000 7f5d88ff9640 1 -- 172.21.15.79:0/2222787873 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7c0047e0 con 0x7f5d8c13de20 2024-04-25T02:11:47.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.679+0000 7f5d924ae640 1 -- 172.21.15.79:0/2222787873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8c140de0 con 0x7f5d8c13de20 2024-04-25T02:11:47.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.679+0000 7f5d88ff9640 1 -- 172.21.15.79:0/2222787873 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c004bd0 con 0x7f5d8c13de20 2024-04-25T02:11:47.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.679+0000 7f5d924ae640 1 -- 172.21.15.79:0/2222787873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d8c1407f0 con 0x7f5d8c13de20 2024-04-25T02:11:47.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.680+0000 7f5d924ae640 1 -- 172.21.15.79:0/2222787873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d8c0690a0 con 0x7f5d8c13de20 2024-04-25T02:11:47.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.680+0000 7f5d88ff9640 1 -- 172.21.15.79:0/2222787873 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d7c011070 con 0x7f5d8c13de20 2024-04-25T02:11:47.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.681+0000 7f5d88ff9640 1 --2- 172.21.15.79:0/2222787873 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d7806be30 0x7f5d7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:47.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.681+0000 7f5d88ff9640 1 -- 172.21.15.79:0/2222787873 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5357+0+0 (secure 0 0 0) 0x7f5d7c08a8a0 con 0x7f5d8c13de20 2024-04-25T02:11:47.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.681+0000 7f5d8bfff640 1 --2- 172.21.15.79:0/2222787873 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d7806be30 0x7f5d7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:47.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.681+0000 7f5d8bfff640 1 --2- 172.21.15.79:0/2222787873 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d7806be30 0x7f5d7806e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5d80006fd0 tx=0x7f5d80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:47.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.685+0000 7f5d88ff9640 1 -- 172.21.15.79:0/2222787873 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5d7c01a2b0 con 0x7f5d8c13de20 2024-04-25T02:11:47.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:47.860+0000 7f5d924ae640 1 -- 172.21.15.79:0/2222787873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5d8c15f6a0 con 0x7f5d8c13de20 2024-04-25T02:11:48.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.553+0000 7f5d88ff9640 1 -- 172.21.15.79:0/2222787873 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v62) ==== 169+0+0 (secure 0 0 0) 0x7f5d7c059440 con 0x7f5d8c13de20 2024-04-25T02:11:48.562 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-04-25T02:11:48.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.557+0000 7f5d924ae640 1 -- 172.21.15.79:0/2222787873 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d7806be30 msgr2=0x7f5d7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:48.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.557+0000 7f5d924ae640 1 --2- 172.21.15.79:0/2222787873 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d7806be30 0x7f5d7806e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5d80006fd0 tx=0x7f5d80008040 comp rx=0 tx=0).stop 2024-04-25T02:11:48.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.557+0000 7f5d924ae640 1 -- 172.21.15.79:0/2222787873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d8c13de20 msgr2=0x7f5d8c137670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:48.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.557+0000 7f5d924ae640 1 --2- 172.21.15.79:0/2222787873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d8c13de20 0x7f5d8c137670 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00c3f0 tx=0x7f5d7c00c8b0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.558+0000 7f5d924ae640 1 -- 172.21.15.79:0/2222787873 shutdown_connections 2024-04-25T02:11:48.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.558+0000 7f5d924ae640 1 --2- 172.21.15.79:0/2222787873 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d7806be30 0x7f5d7806e2f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.558+0000 7f5d924ae640 1 --2- 172.21.15.79:0/2222787873 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d8c15ef10 0x7f5d8c159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.558+0000 7f5d924ae640 1 --2- 172.21.15.79:0/2222787873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d8c13de20 0x7f5d8c137670 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.558+0000 7f5d924ae640 1 --2- 172.21.15.79:0/2222787873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d8c0cebe0 0x7f5d8c1402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.558+0000 7f5d924ae640 1 -- 172.21.15.79:0/2222787873 >> 172.21.15.79:0/2222787873 conn(0x7f5d8c06b4a0 msgr2=0x7f5d8c155140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:48.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.559+0000 7f5d924ae640 1 -- 172.21.15.79:0/2222787873 shutdown_connections 2024-04-25T02:11:48.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.559+0000 7f5d924ae640 1 -- 172.21.15.79:0/2222787873 wait complete. 2024-04-25T02:11:48.582 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T02:11:48.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.679+0000 7f82ccb21640 1 Processor -- start 2024-04-25T02:11:48.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.679+0000 7f82ccb21640 1 -- start start 2024-04-25T02:11:48.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.680+0000 7f82ccb21640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c80cf7a0 0x7f82c80b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:48.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.680+0000 7f82ccb21640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f82c806e6b0 0x7f82c815b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:48.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.680+0000 7f82ccb21640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c815ec20 con 0x7f82c806b2f0 2024-04-25T02:11:48.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.680+0000 7f82ccb21640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f82c815f830 con 0x7f82c806e6b0 2024-04-25T02:11:48.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.680+0000 7f82ccb21640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f82c815ef00 con 0x7f82c80cf7a0 2024-04-25T02:11:48.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.680+0000 7f82bffff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c80cf7a0 0x7f82c80b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:48.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.680+0000 7f82c6d9d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f82c806e6b0 0x7f82c815b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:48.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.680+0000 7f82c659c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f82c806b2f0 0x7f82c806b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:59224/0 (socket says 172.21.15.79:59224) 2024-04-25T02:11:48.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.680+0000 7f82c659c640 1 -- 172.21.15.79:0/2643096706 learned_addr learned my addr 172.21.15.79:0/2643096706 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:48.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.681+0000 7f82bffff640 1 -- 172.21.15.79:0/2643096706 >> v2:172.21.15.189:3300/0 conn(0x7f82c806e6b0 msgr2=0x7f82c815b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:48.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.681+0000 7f82bffff640 1 --2- 172.21.15.79:0/2643096706 >> v2:172.21.15.189:3300/0 conn(0x7f82c806e6b0 0x7f82c815b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.681+0000 7f82bffff640 1 -- 172.21.15.79:0/2643096706 >> v1:172.21.15.189:6789/0 conn(0x7f82c806b2f0 legacy=0x7f82c806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:48.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.681+0000 7f82bffff640 1 -- 172.21.15.79:0/2643096706 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c815f1e0 con 0x7f82c80cf7a0 2024-04-25T02:11:48.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.681+0000 7f82c6d9d640 1 --2- 172.21.15.79:0/2643096706 >> v2:172.21.15.189:3300/0 conn(0x7f82c806e6b0 0x7f82c815b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:48.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.681+0000 7f82bffff640 1 --2- 172.21.15.79:0/2643096706 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c80cf7a0 0x7f82c80b4b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f82b00097a0 tx=0x7f82b002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f952bb1f67c2018 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:48.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.682+0000 7f82c5d9b640 1 -- 172.21.15.79:0/2643096706 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0037070 con 0x7f82c80cf7a0 2024-04-25T02:11:48.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.682+0000 7f82c5d9b640 1 -- 172.21.15.79:0/2643096706 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b002ae50 con 0x7f82c80cf7a0 2024-04-25T02:11:48.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.682+0000 7f82c5d9b640 1 -- 172.21.15.79:0/2643096706 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0032660 con 0x7f82c80cf7a0 2024-04-25T02:11:48.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.682+0000 7f82ccb21640 1 -- 172.21.15.79:0/2643096706 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c80cf7a0 msgr2=0x7f82c80b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:48.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.682+0000 7f82ccb21640 1 --2- 172.21.15.79:0/2643096706 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c80cf7a0 0x7f82c80b4b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f82b00097a0 tx=0x7f82b002a100 comp rx=0 tx=0).stop 2024-04-25T02:11:48.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.682+0000 7f82ccb21640 1 -- 172.21.15.79:0/2643096706 shutdown_connections 2024-04-25T02:11:48.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.682+0000 7f82ccb21640 1 --2- 172.21.15.79:0/2643096706 >> v2:172.21.15.189:3300/0 conn(0x7f82c806e6b0 0x7f82c815b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.682+0000 7f82ccb21640 1 --2- 172.21.15.79:0/2643096706 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c80cf7a0 0x7f82c80b4b50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.682+0000 7f82ccb21640 1 -- 172.21.15.79:0/2643096706 >> 172.21.15.79:0/2643096706 conn(0x7f82c80b1cd0 msgr2=0x7f82c80b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:48.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.682+0000 7f82ccb21640 1 -- 172.21.15.79:0/2643096706 shutdown_connections 2024-04-25T02:11:48.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.682+0000 7f82ccb21640 1 -- 172.21.15.79:0/2643096706 wait complete. 2024-04-25T02:11:48.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.684+0000 7f82ccb21640 1 Processor -- start 2024-04-25T02:11:48.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.684+0000 7f82ccb21640 1 -- start start 2024-04-25T02:11:48.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.684+0000 7f82ccb21640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c806b2f0 0x7f82c81482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:48.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.684+0000 7f82ccb21640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82c806e6b0 0x7f82c815a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:48.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.684+0000 7f82ccb21640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c80cf7a0 0x7f82c8144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:48.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.684+0000 7f82ccb21640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f82c806d160 con 0x7f82c80cf7a0 2024-04-25T02:11:48.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.684+0000 7f82ccb21640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f82c806cfe0 con 0x7f82c806e6b0 2024-04-25T02:11:48.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.684+0000 7f82ccb21640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f82c815b810 con 0x7f82c806b2f0 2024-04-25T02:11:48.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.684+0000 7f82c6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c80cf7a0 0x7f82c8144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:48.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.684+0000 7f82c6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c80cf7a0 0x7f82c8144eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57518/0 (socket says 172.21.15.79:57518) 2024-04-25T02:11:48.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.684+0000 7f82c6d9d640 1 -- 172.21.15.79:0/3427661112 learned_addr learned my addr 172.21.15.79:0/3427661112 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:48.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.685+0000 7f82c659c640 1 --2- 172.21.15.79:0/3427661112 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c806b2f0 0x7f82c81482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:48.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.685+0000 7f82bffff640 1 --2- 172.21.15.79:0/3427661112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82c806e6b0 0x7f82c815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:48.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.685+0000 7f82c6d9d640 1 -- 172.21.15.79:0/3427661112 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c806b2f0 msgr2=0x7f82c81482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:48.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.685+0000 7f82c6d9d640 1 --2- 172.21.15.79:0/3427661112 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c806b2f0 0x7f82c81482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.685+0000 7f82c6d9d640 1 -- 172.21.15.79:0/3427661112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82c806e6b0 msgr2=0x7f82c815a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:48.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.685+0000 7f82c6d9d640 1 --2- 172.21.15.79:0/3427661112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82c806e6b0 0x7f82c815a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.685+0000 7f82c6d9d640 1 -- 172.21.15.79:0/3427661112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c8158d00 con 0x7f82c80cf7a0 2024-04-25T02:11:48.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.685+0000 7f82bffff640 1 --2- 172.21.15.79:0/3427661112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82c806e6b0 0x7f82c815a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:48.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.685+0000 7f82c6d9d640 1 --2- 172.21.15.79:0/3427661112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c80cf7a0 0x7f82c8144eb0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009f00 tx=0x7f82c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:48.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.685+0000 7f82beffd640 1 -- 172.21.15.79:0/3427661112 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0018030 con 0x7f82c80cf7a0 2024-04-25T02:11:48.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.685+0000 7f82beffd640 1 -- 172.21.15.79:0/3427661112 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c000ce50 con 0x7f82c80cf7a0 2024-04-25T02:11:48.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.685+0000 7f82ccb21640 1 -- 172.21.15.79:0/3427661112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c8148800 con 0x7f82c80cf7a0 2024-04-25T02:11:48.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.685+0000 7f82beffd640 1 -- 172.21.15.79:0/3427661112 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0003bb0 con 0x7f82c80cf7a0 2024-04-25T02:11:48.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.685+0000 7f82ccb21640 1 -- 172.21.15.79:0/3427661112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c8159250 con 0x7f82c80cf7a0 2024-04-25T02:11:48.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.686+0000 7f82ccb21640 1 -- 172.21.15.79:0/3427661112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c80690a0 con 0x7f82c80cf7a0 2024-04-25T02:11:48.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.686+0000 7f82beffd640 1 -- 172.21.15.79:0/3427661112 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f82c0005d10 con 0x7f82c80cf7a0 2024-04-25T02:11:48.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.687+0000 7f82beffd640 1 --2- 172.21.15.79:0/3427661112 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f82a806be30 0x7f82a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:48.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.687+0000 7f82c659c640 1 --2- 172.21.15.79:0/3427661112 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f82a806be30 0x7f82a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:48.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.687+0000 7f82beffd640 1 -- 172.21.15.79:0/3427661112 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7f82c008b5d0 con 0x7f82c80cf7a0 2024-04-25T02:11:48.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.687+0000 7f82c659c640 1 --2- 172.21.15.79:0/3427661112 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f82a806be30 0x7f82a806e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f82c80b09f0 tx=0x7f82b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:48.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.691+0000 7f82beffd640 1 -- 172.21.15.79:0/3427661112 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f82c0022070 con 0x7f82c80cf7a0 2024-04-25T02:11:48.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.864+0000 7f82ccb21640 1 -- 172.21.15.79:0/3427661112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f82c80cc460 con 0x7f82c80cf7a0 2024-04-25T02:11:48.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.868+0000 7f82beffd640 1 -- 172.21.15.79:0/3427661112 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7f82c8148800 con 0x7f82c80cf7a0 2024-04-25T02:11:48.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.870+0000 7f82ccb21640 1 -- 172.21.15.79:0/3427661112 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f82a806be30 msgr2=0x7f82a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:48.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.870+0000 7f82ccb21640 1 --2- 172.21.15.79:0/3427661112 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f82a806be30 0x7f82a806e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f82c80b09f0 tx=0x7f82b8009040 comp rx=0 tx=0).stop 2024-04-25T02:11:48.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.870+0000 7f82ccb21640 1 -- 172.21.15.79:0/3427661112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c80cf7a0 msgr2=0x7f82c8144eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.870+0000 7f82ccb21640 1 --2- 172.21.15.79:0/3427661112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c80cf7a0 0x7f82c8144eb0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009f00 tx=0x7f82c000c490 comp rx=0 tx=0).stop 2024-04-25T02:11:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.870+0000 7f82ccb21640 1 -- 172.21.15.79:0/3427661112 shutdown_connections 2024-04-25T02:11:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.870+0000 7f82ccb21640 1 --2- 172.21.15.79:0/3427661112 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f82a806be30 0x7f82a806e2f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.870+0000 7f82ccb21640 1 --2- 172.21.15.79:0/3427661112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c80cf7a0 0x7f82c8144eb0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.870+0000 7f82ccb21640 1 --2- 172.21.15.79:0/3427661112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82c806e6b0 0x7f82c815a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.870+0000 7f82ccb21640 1 --2- 172.21.15.79:0/3427661112 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c806b2f0 0x7f82c81482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.870+0000 7f82ccb21640 1 -- 172.21.15.79:0/3427661112 >> 172.21.15.79:0/3427661112 conn(0x7f82c80b1cd0 msgr2=0x7f82c80b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.870+0000 7f82ccb21640 1 -- 172.21.15.79:0/3427661112 shutdown_connections 2024-04-25T02:11:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.870+0000 7f82ccb21640 1 -- 172.21.15.79:0/3427661112 wait complete. 2024-04-25T02:11:48.889 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-25T02:11:48.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.977+0000 7fc1cd561640 1 Processor -- start 2024-04-25T02:11:48.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.977+0000 7fc1cd561640 1 -- start start 2024-04-25T02:11:48.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1cd561640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc1c80b00e0 0x7fc1c80cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:48.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1cd561640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc1c80cc100 0x7fc1c806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:48.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1cd561640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1c806b5f0 0x7fc1c8071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:48.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1cd561640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc1c806ba60 con 0x7fc1c80cc100 2024-04-25T02:11:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1cd561640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc1c80b04c0 con 0x7fc1c80b00e0 2024-04-25T02:11:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1cd561640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc1c80d02b0 con 0x7fc1c806b5f0 2024-04-25T02:11:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1c67fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc1c80cc100 0x7fc1c806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1c67fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc1c80cc100 0x7fc1c806b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57522/0 (socket says 172.21.15.79:57522) 2024-04-25T02:11:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1c67fc640 1 -- 172.21.15.79:0/2236738437 learned_addr learned my addr 172.21.15.79:0/2236738437 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1c77fe640 1 --2- 172.21.15.79:0/2236738437 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1c806b5f0 0x7fc1c8071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1c67fc640 1 -- 172.21.15.79:0/2236738437 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1c806b5f0 msgr2=0x7fc1c8071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1c6ffd640 1 --2- 172.21.15.79:0/2236738437 >> v2:172.21.15.189:3300/0 conn(0x7fc1c80b00e0 0x7fc1c80cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1c67fc640 1 --2- 172.21.15.79:0/2236738437 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1c806b5f0 0x7fc1c8071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1c67fc640 1 -- 172.21.15.79:0/2236738437 >> v2:172.21.15.189:3300/0 conn(0x7fc1c80b00e0 msgr2=0x7fc1c80cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1c67fc640 1 --2- 172.21.15.79:0/2236738437 >> v2:172.21.15.189:3300/0 conn(0x7fc1c80b00e0 0x7fc1c80cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1c67fc640 1 -- 172.21.15.79:0/2236738437 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c80d0590 con 0x7fc1c80cc100 2024-04-25T02:11:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1c77fe640 1 --2- 172.21.15.79:0/2236738437 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1c806b5f0 0x7fc1c8071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.978+0000 7fc1c6ffd640 1 --2- 172.21.15.79:0/2236738437 >> v2:172.21.15.189:3300/0 conn(0x7fc1c80b00e0 0x7fc1c80cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.979+0000 7fc1c67fc640 1 --2- 172.21.15.79:0/2236738437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c80cc100 0x7fc1c806b0b0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80b37b0 tx=0x7fc1bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a8572d3148e854 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.979+0000 7fc1c5ffb640 1 -- 172.21.15.79:0/2236738437 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc037070 con 0x7fc1c80cc100 2024-04-25T02:11:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.979+0000 7fc1c5ffb640 1 -- 172.21.15.79:0/2236738437 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1bc032440 con 0x7fc1c80cc100 2024-04-25T02:11:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.979+0000 7fc1c5ffb640 1 -- 172.21.15.79:0/2236738437 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc032810 con 0x7fc1c80cc100 2024-04-25T02:11:48.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.980+0000 7fc1cd561640 1 -- 172.21.15.79:0/2236738437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c80cc100 msgr2=0x7fc1c806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:48.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.980+0000 7fc1cd561640 1 --2- 172.21.15.79:0/2236738437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c80cc100 0x7fc1c806b0b0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80b37b0 tx=0x7fc1bc02a270 comp rx=0 tx=0).stop 2024-04-25T02:11:48.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.980+0000 7fc1cd561640 1 -- 172.21.15.79:0/2236738437 shutdown_connections 2024-04-25T02:11:48.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.980+0000 7fc1cd561640 1 --2- 172.21.15.79:0/2236738437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c80cc100 0x7fc1c806b0b0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.980+0000 7fc1cd561640 1 --2- 172.21.15.79:0/2236738437 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1c806b5f0 0x7fc1c8071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.980+0000 7fc1cd561640 1 --2- 172.21.15.79:0/2236738437 >> v2:172.21.15.189:3300/0 conn(0x7fc1c80b00e0 0x7fc1c80cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.980+0000 7fc1cd561640 1 -- 172.21.15.79:0/2236738437 >> 172.21.15.79:0/2236738437 conn(0x7fc1c80cd770 msgr2=0x7fc1c80cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:48.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.980+0000 7fc1cd561640 1 -- 172.21.15.79:0/2236738437 shutdown_connections 2024-04-25T02:11:48.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.980+0000 7fc1cd561640 1 -- 172.21.15.79:0/2236738437 wait complete. 2024-04-25T02:11:48.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.981+0000 7fc1cd561640 1 Processor -- start 2024-04-25T02:11:48.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.981+0000 7fc1cd561640 1 -- start start 2024-04-25T02:11:48.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1cd561640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1c806b5f0 0x7fc1c81556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1cd561640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c80b00e0 0x7fc1c80c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1cd561640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1c80cc100 0x7fc1c80b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1cd561640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c806dfd0 con 0x7fc1c80b00e0 2024-04-25T02:11:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1cd561640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c806e2e0 con 0x7fc1c80cc100 2024-04-25T02:11:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1cd561640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc1c80cffa0 con 0x7fc1c806b5f0 2024-04-25T02:11:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1c67fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c80b00e0 0x7fc1c80c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1c67fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c80b00e0 0x7fc1c80c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57532/0 (socket says 172.21.15.79:57532) 2024-04-25T02:11:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1c67fc640 1 -- 172.21.15.79:0/2193268436 learned_addr learned my addr 172.21.15.79:0/2193268436 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1c6ffd640 1 --2- 172.21.15.79:0/2193268436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1c806b5f0 0x7fc1c81556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1c77fe640 1 --2- 172.21.15.79:0/2193268436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1c80cc100 0x7fc1c80b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1c67fc640 1 -- 172.21.15.79:0/2193268436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1c806b5f0 msgr2=0x7fc1c81556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1c67fc640 1 --2- 172.21.15.79:0/2193268436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1c806b5f0 0x7fc1c81556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1c67fc640 1 -- 172.21.15.79:0/2193268436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1c80cc100 msgr2=0x7fc1c80b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1c67fc640 1 --2- 172.21.15.79:0/2193268436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1c80cc100 0x7fc1c80b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1c67fc640 1 -- 172.21.15.79:0/2193268436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c8155bf0 con 0x7fc1c80b00e0 2024-04-25T02:11:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1c67fc640 1 --2- 172.21.15.79:0/2193268436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c80b00e0 0x7fc1c80c9530 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc02a2b0 tx=0x7fc1bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1af7fe640 1 -- 172.21.15.79:0/2193268436 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc037040 con 0x7fc1c80b00e0 2024-04-25T02:11:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1af7fe640 1 -- 172.21.15.79:0/2193268436 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1bc042070 con 0x7fc1c80b00e0 2024-04-25T02:11:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1cd561640 1 -- 172.21.15.79:0/2193268436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c80c9ff0 con 0x7fc1c80b00e0 2024-04-25T02:11:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.982+0000 7fc1af7fe640 1 -- 172.21.15.79:0/2193268436 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc030bb0 con 0x7fc1c80b00e0 2024-04-25T02:11:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.983+0000 7fc1cd561640 1 -- 172.21.15.79:0/2193268436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c80c80a0 con 0x7fc1c80b00e0 2024-04-25T02:11:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.984+0000 7fc1cd561640 1 -- 172.21.15.79:0/2193268436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c80690a0 con 0x7fc1c80b00e0 2024-04-25T02:11:48.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.984+0000 7fc1af7fe640 1 -- 172.21.15.79:0/2193268436 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1bc047460 con 0x7fc1c80b00e0 2024-04-25T02:11:48.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.984+0000 7fc1af7fe640 1 --2- 172.21.15.79:0/2193268436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc1b406be60 0x7fc1b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:48.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.984+0000 7fc1c6ffd640 1 --2- 172.21.15.79:0/2193268436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc1b406be60 0x7fc1b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:48.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.984+0000 7fc1af7fe640 1 -- 172.21.15.79:0/2193268436 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7fc1bc0ab710 con 0x7fc1c80b00e0 2024-04-25T02:11:48.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.985+0000 7fc1c6ffd640 1 --2- 172.21.15.79:0/2193268436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc1b406be60 0x7fc1b406e320 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800a990 tx=0x7fc1b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:48.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:48.989+0000 7fc1af7fe640 1 -- 172.21.15.79:0/2193268436 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc1bc045360 con 0x7fc1c80b00e0 2024-04-25T02:11:49.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.238+0000 7fc1cd561640 1 -- 172.21.15.79:0/2193268436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) -- 0x7fc1c80cbce0 con 0x7fc1c80b00e0 2024-04-25T02:11:49.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.554+0000 7fc1af7fe640 1 -- 172.21.15.79:0/2193268436 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v204) ==== 169+0+0 (secure 0 0 0) 0x7fc1bc07a450 con 0x7fc1c80b00e0 2024-04-25T02:11:49.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.557+0000 7fc1cd561640 1 -- 172.21.15.79:0/2193268436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc1b406be60 msgr2=0x7fc1b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:49.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.557+0000 7fc1cd561640 1 --2- 172.21.15.79:0/2193268436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc1b406be60 0x7fc1b406e320 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800a990 tx=0x7fc1b8008040 comp rx=0 tx=0).stop 2024-04-25T02:11:49.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.557+0000 7fc1cd561640 1 -- 172.21.15.79:0/2193268436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c80b00e0 msgr2=0x7fc1c80c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:49.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.557+0000 7fc1cd561640 1 --2- 172.21.15.79:0/2193268436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c80b00e0 0x7fc1c80c9530 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc02a2b0 tx=0x7fc1bc0046c0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.557+0000 7fc1cd561640 1 -- 172.21.15.79:0/2193268436 shutdown_connections 2024-04-25T02:11:49.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.557+0000 7fc1cd561640 1 --2- 172.21.15.79:0/2193268436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc1b406be60 0x7fc1b406e320 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.557+0000 7fc1cd561640 1 --2- 172.21.15.79:0/2193268436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1c80cc100 0x7fc1c80b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.557+0000 7fc1cd561640 1 --2- 172.21.15.79:0/2193268436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c80b00e0 0x7fc1c80c9530 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.557+0000 7fc1cd561640 1 --2- 172.21.15.79:0/2193268436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1c806b5f0 0x7fc1c81556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.557+0000 7fc1cd561640 1 -- 172.21.15.79:0/2193268436 >> 172.21.15.79:0/2193268436 conn(0x7fc1c80cd770 msgr2=0x7fc1c806cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:49.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.557+0000 7fc1cd561640 1 -- 172.21.15.79:0/2193268436 shutdown_connections 2024-04-25T02:11:49.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.557+0000 7fc1cd561640 1 -- 172.21.15.79:0/2193268436 wait complete. 2024-04-25T02:11:49.576 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T02:11:49.576 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T02:11:49.576 INFO:tasks.cephfs_test_runner:test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T02:11:49.577 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:11:49.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.666+0000 7f9209fc1640 1 Processor -- start 2024-04-25T02:11:49.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.666+0000 7f9209fc1640 1 -- start start 2024-04-25T02:11:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.667+0000 7f9209fc1640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f920415a720 0x7f920415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.667+0000 7f9209fc1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f92040d07a0 0x7f92040b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.667+0000 7f9209fc1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920415f1c0 con 0x7f92040b47e0 2024-04-25T02:11:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.667+0000 7f9209fc1640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f92040b2e60 con 0x7f920415a720 2024-04-25T02:11:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.667+0000 7f9209fc1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f92040b3140 con 0x7f92040d07a0 2024-04-25T02:11:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.667+0000 7f92037fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f920415a720 0x7f920415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.667+0000 7f9202ffd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f92040d07a0 0x7f92040b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.667+0000 7f9203fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f92040b47e0 0x7f920415ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:59226/0 (socket says 172.21.15.79:59226) 2024-04-25T02:11:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.667+0000 7f9203fff640 1 -- 172.21.15.79:0/1455764363 learned_addr learned my addr 172.21.15.79:0/1455764363 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.667+0000 7f9202ffd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f92040d07a0 0x7f92040b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:33422/0 (socket says 172.21.15.79:33422) 2024-04-25T02:11:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.667+0000 7f92037fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f920415a720 0x7f920415ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:48808/0 (socket says 172.21.15.79:48808) 2024-04-25T02:11:49.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.667+0000 7f92037fe640 1 -- 172.21.15.79:0/1455764363 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f92040d07a0 msgr2=0x7f92040b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:49.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.667+0000 7f92037fe640 1 --2- 172.21.15.79:0/1455764363 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f92040d07a0 0x7f92040b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.667+0000 7f92037fe640 1 -- 172.21.15.79:0/1455764363 >> v1:172.21.15.189:6789/0 conn(0x7f92040b47e0 legacy=0x7f920415ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:49.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.668+0000 7f92037fe640 1 -- 172.21.15.79:0/1455764363 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92040b3420 con 0x7f920415a720 2024-04-25T02:11:49.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.668+0000 7f9202ffd640 1 --2- 172.21.15.79:0/1455764363 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f92040d07a0 0x7f92040b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:49.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.668+0000 7f92037fe640 1 --2- 172.21.15.79:0/1455764363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f920415a720 0x7f920415ec80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f91f40097a0 tx=0x7f91f402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41c89a91ab166ca2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:49.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.668+0000 7f92027fc640 1 -- 172.21.15.79:0/1455764363 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f4037070 con 0x7f920415a720 2024-04-25T02:11:49.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.668+0000 7f92027fc640 1 -- 172.21.15.79:0/1455764363 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f402ae50 con 0x7f920415a720 2024-04-25T02:11:49.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.668+0000 7f92027fc640 1 -- 172.21.15.79:0/1455764363 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f4032660 con 0x7f920415a720 2024-04-25T02:11:49.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.669+0000 7f9209fc1640 1 -- 172.21.15.79:0/1455764363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f920415a720 msgr2=0x7f920415ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:49.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.669+0000 7f9209fc1640 1 --2- 172.21.15.79:0/1455764363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f920415a720 0x7f920415ec80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f91f40097a0 tx=0x7f91f402a100 comp rx=0 tx=0).stop 2024-04-25T02:11:49.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.669+0000 7f9209fc1640 1 -- 172.21.15.79:0/1455764363 shutdown_connections 2024-04-25T02:11:49.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.669+0000 7f9209fc1640 1 --2- 172.21.15.79:0/1455764363 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f92040d07a0 0x7f92040b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.669+0000 7f9209fc1640 1 --2- 172.21.15.79:0/1455764363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f920415a720 0x7f920415ec80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.669+0000 7f9209fc1640 1 -- 172.21.15.79:0/1455764363 >> 172.21.15.79:0/1455764363 conn(0x7f92040cfc80 msgr2=0x7f92040d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:49.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.669+0000 7f9209fc1640 1 -- 172.21.15.79:0/1455764363 shutdown_connections 2024-04-25T02:11:49.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.669+0000 7f9209fc1640 1 -- 172.21.15.79:0/1455764363 wait complete. 2024-04-25T02:11:49.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.670+0000 7f9209fc1640 1 Processor -- start 2024-04-25T02:11:49.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.670+0000 7f9209fc1640 1 -- start start 2024-04-25T02:11:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.671+0000 7f9209fc1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f92040b47e0 0x7f9204151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.671+0000 7f9209fc1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92040d07a0 0x7f920414cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.671+0000 7f9209fc1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920415a720 0x7f920406df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.671+0000 7f9209fc1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9204071d00 con 0x7f920415a720 2024-04-25T02:11:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.671+0000 7f9209fc1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92040b39e0 con 0x7f92040d07a0 2024-04-25T02:11:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.671+0000 7f9209fc1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9204071e80 con 0x7f92040b47e0 2024-04-25T02:11:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.671+0000 7f9203fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920415a720 0x7f920406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.671+0000 7f9203fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920415a720 0x7f920406df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57534/0 (socket says 172.21.15.79:57534) 2024-04-25T02:11:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.671+0000 7f9203fff640 1 -- 172.21.15.79:0/3697522571 learned_addr learned my addr 172.21.15.79:0/3697522571 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.671+0000 7f92037fe640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f92040b47e0 0x7f9204151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.671+0000 7f9202ffd640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92040d07a0 0x7f920414cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.671+0000 7f9203fff640 1 -- 172.21.15.79:0/3697522571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f92040b47e0 msgr2=0x7f9204151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.671+0000 7f9203fff640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f92040b47e0 0x7f9204151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.671+0000 7f9203fff640 1 -- 172.21.15.79:0/3697522571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92040d07a0 msgr2=0x7f920414cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.671+0000 7f9203fff640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92040d07a0 0x7f920414cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.672+0000 7f9203fff640 1 -- 172.21.15.79:0/3697522571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9204150de0 con 0x7f920415a720 2024-04-25T02:11:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.672+0000 7f92037fe640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f92040b47e0 0x7f9204151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.672+0000 7f9202ffd640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92040d07a0 0x7f920414cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.672+0000 7f9203fff640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920415a720 0x7f920406df50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00ca80 tx=0x7f91fc00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.672+0000 7f91ebfff640 1 -- 172.21.15.79:0/3697522571 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc017070 con 0x7f920415a720 2024-04-25T02:11:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.672+0000 7f91ebfff640 1 -- 172.21.15.79:0/3697522571 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91fc00ac30 con 0x7f920415a720 2024-04-25T02:11:49.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.672+0000 7f91ebfff640 1 -- 172.21.15.79:0/3697522571 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc012600 con 0x7f920415a720 2024-04-25T02:11:49.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.672+0000 7f9209fc1640 1 -- 172.21.15.79:0/3697522571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92041510c0 con 0x7f920415a720 2024-04-25T02:11:49.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.672+0000 7f9209fc1640 1 -- 172.21.15.79:0/3697522571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9204151680 con 0x7f920415a720 2024-04-25T02:11:49.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.673+0000 7f9209fc1640 1 -- 172.21.15.79:0/3697522571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92040690a0 con 0x7f920415a720 2024-04-25T02:11:49.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.673+0000 7f91ebfff640 1 -- 172.21.15.79:0/3697522571 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91fc01a070 con 0x7f920415a720 2024-04-25T02:11:49.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.674+0000 7f91ebfff640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f91f006be60 0x7f91f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:49.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.674+0000 7f91ebfff640 1 -- 172.21.15.79:0/3697522571 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7f91fc08a6f0 con 0x7f920415a720 2024-04-25T02:11:49.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.674+0000 7f92037fe640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f91f006be60 0x7f91f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:49.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.674+0000 7f92037fe640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f91f006be60 0x7f91f006e320 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f91f4034000 tx=0x7f91f402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:49.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.678+0000 7f91ebfff640 1 -- 172.21.15.79:0/3697522571 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f920415f1c0 con 0x7f920415a720 2024-04-25T02:11:49.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.853+0000 7f9209fc1640 1 -- 172.21.15.79:0/3697522571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92040ceb50 con 0x7f920415a720 2024-04-25T02:11:49.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.854+0000 7f91ebfff640 1 -- 172.21.15.79:0/3697522571 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+13032 (secure 0 0 0) 0x7f91fc00ae20 con 0x7f920415a720 2024-04-25T02:11:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:49.863 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":62,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:11:48.550312+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/2253487658":"2024-04-26T02:11:45.222714+0000","172.21.15.79:6835/2253487658":"2024-04-26T02:11:45.222714+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:11:49.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.856+0000 7f9209fc1640 1 -- 172.21.15.79:0/3697522571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f91f006be60 msgr2=0x7f91f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:49.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.856+0000 7f9209fc1640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f91f006be60 0x7f91f006e320 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f91f4034000 tx=0x7f91f402e000 comp rx=0 tx=0).stop 2024-04-25T02:11:49.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.856+0000 7f9209fc1640 1 -- 172.21.15.79:0/3697522571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920415a720 msgr2=0x7f920406df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:49.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.856+0000 7f9209fc1640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920415a720 0x7f920406df50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00ca80 tx=0x7f91fc00cf40 comp rx=0 tx=0).stop 2024-04-25T02:11:49.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.856+0000 7f9209fc1640 1 -- 172.21.15.79:0/3697522571 shutdown_connections 2024-04-25T02:11:49.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.856+0000 7f9209fc1640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f91f006be60 0x7f91f006e320 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.856+0000 7f9209fc1640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920415a720 0x7f920406df50 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.856+0000 7f9209fc1640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92040d07a0 0x7f920414cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.856+0000 7f9209fc1640 1 --2- 172.21.15.79:0/3697522571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f92040b47e0 0x7f9204151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.856+0000 7f9209fc1640 1 -- 172.21.15.79:0/3697522571 >> 172.21.15.79:0/3697522571 conn(0x7f92040cfc80 msgr2=0x7f92040720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:49.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.856+0000 7f9209fc1640 1 -- 172.21.15.79:0/3697522571 shutdown_connections 2024-04-25T02:11:49.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.856+0000 7f9209fc1640 1 -- 172.21.15.79:0/3697522571 wait complete. 2024-04-25T02:11:49.876 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:11:49.876 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:11:49.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.967+0000 7fbc6bb5a640 1 Processor -- start 2024-04-25T02:11:49.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.968+0000 7fbc6bb5a640 1 -- start start 2024-04-25T02:11:49.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.968+0000 7fbc6bb5a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc6415c4c0 0x7fbc640b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:49.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.968+0000 7fbc6bb5a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc640cd670 con 0x7fbc640cfac0 2024-04-25T02:11:49.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.968+0000 7fbc6bb5a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc640cd950 con 0x7fbc640d0890 2024-04-25T02:11:49.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.968+0000 7fbc6bb5a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbc640cffc0 con 0x7fbc6415c4c0 2024-04-25T02:11:49.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.968+0000 7fbc690f5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbc640cfac0 0x7fbc640d0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39356/0 (socket says 172.21.15.79:39356) 2024-04-25T02:11:49.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.968+0000 7fbc690f5640 1 -- 172.21.15.79:0/1202836584 learned_addr learned my addr 172.21.15.79:0/1202836584 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:49.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc698f6640 1 --2- 172.21.15.79:0/1202836584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc6415c4c0 0x7fbc640b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:49.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc688f4640 1 -- 172.21.15.79:0/1202836584 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2577158373 0 0) 0x7fbc640cd670 con 0x7fbc640cfac0 2024-04-25T02:11:49.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc688f4640 1 -- 172.21.15.79:0/1202836584 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc50003520 con 0x7fbc640cfac0 2024-04-25T02:11:49.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc688f4640 1 -- 172.21.15.79:0/1202836584 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1680718002 0 0) 0x7fbc50003520 con 0x7fbc640cfac0 2024-04-25T02:11:49.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc688f4640 1 -- 172.21.15.79:0/1202836584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc6415c4c0 msgr2=0x7fbc640b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:49.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc688f4640 1 --2- 172.21.15.79:0/1202836584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc6415c4c0 0x7fbc640b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc688f4640 1 -- 172.21.15.79:0/1202836584 >> v1:172.21.15.189:6789/0 conn(0x7fbc640d0890 legacy=0x7fbc6406f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:49.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc688f4640 1 -- 172.21.15.79:0/1202836584 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc640cdc30 con 0x7fbc640cfac0 2024-04-25T02:11:49.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc688f4640 1 -- 172.21.15.79:0/1202836584 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fbc54001670 con 0x7fbc640cfac0 2024-04-25T02:11:49.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc688f4640 1 -- 172.21.15.79:0/1202836584 >> v1:172.21.15.79:6789/0 conn(0x7fbc640cfac0 legacy=0x7fbc640d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:49.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc688f4640 1 --2- 172.21.15.79:0/1202836584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc500039e0 0x7fbc50003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:49.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc688f4640 1 --2- 172.21.15.79:0/1202836584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc6415c4c0 0x7fbc50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:49.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc688f4640 1 --2- 172.21.15.79:0/1202836584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc50004d40 0x7fbc500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:49.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc688f4640 1 -- 172.21.15.79:0/1202836584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc640cffc0 con 0x7fbc500039e0 2024-04-25T02:11:49.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc688f4640 1 -- 172.21.15.79:0/1202836584 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5000ba70 con 0x7fbc50004d40 2024-04-25T02:11:49.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc688f4640 1 -- 172.21.15.79:0/1202836584 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5000bc70 con 0x7fbc6415c4c0 2024-04-25T02:11:49.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc698f6640 1 --2- 172.21.15.79:0/1202836584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc500039e0 0x7fbc50003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:49.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc690f5640 1 --2- 172.21.15.79:0/1202836584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc6415c4c0 0x7fbc50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:49.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc6a0f7640 1 --2- 172.21.15.79:0/1202836584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc50004d40 0x7fbc500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:49.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc698f6640 1 -- 172.21.15.79:0/1202836584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc6415c4c0 msgr2=0x7fbc50004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:49.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc698f6640 1 --2- 172.21.15.79:0/1202836584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc6415c4c0 0x7fbc50004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc698f6640 1 -- 172.21.15.79:0/1202836584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc50004d40 msgr2=0x7fbc500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:49.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc698f6640 1 --2- 172.21.15.79:0/1202836584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc50004d40 0x7fbc500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc698f6640 1 -- 172.21.15.79:0/1202836584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc50003520 con 0x7fbc500039e0 2024-04-25T02:11:49.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.969+0000 7fbc6a0f7640 1 --2- 172.21.15.79:0/1202836584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc50004d40 0x7fbc500051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:49.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.970+0000 7fbc698f6640 1 --2- 172.21.15.79:0/1202836584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc500039e0 0x7fbc50003dc0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fbc60009fc0 tx=0x7fbc50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc04fc7b26a7a060 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:49.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.970+0000 7fbc688f4640 1 -- 172.21.15.79:0/1202836584 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60009c10 con 0x7fbc500039e0 2024-04-25T02:11:49.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.970+0000 7fbc688f4640 1 -- 172.21.15.79:0/1202836584 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc60036070 con 0x7fbc500039e0 2024-04-25T02:11:49.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.970+0000 7fbc688f4640 1 -- 172.21.15.79:0/1202836584 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60031880 con 0x7fbc500039e0 2024-04-25T02:11:49.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.971+0000 7fbc6bb5a640 1 -- 172.21.15.79:0/1202836584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc500039e0 msgr2=0x7fbc50003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:49.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.971+0000 7fbc6bb5a640 1 --2- 172.21.15.79:0/1202836584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc500039e0 0x7fbc50003dc0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fbc60009fc0 tx=0x7fbc50005830 comp rx=0 tx=0).stop 2024-04-25T02:11:49.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.971+0000 7fbc6a0f7640 1 -- 172.21.15.79:0/1202836584 reap_dead start 2024-04-25T02:11:49.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.971+0000 7fbc6bb5a640 1 -- 172.21.15.79:0/1202836584 shutdown_connections 2024-04-25T02:11:49.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.971+0000 7fbc6bb5a640 1 -- 172.21.15.79:0/1202836584 >> 172.21.15.79:0/1202836584 conn(0x7fbc640d1ef0 msgr2=0x7fbc640d2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:49.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.971+0000 7fbc6bb5a640 1 -- 172.21.15.79:0/1202836584 shutdown_connections 2024-04-25T02:11:49.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.971+0000 7fbc6bb5a640 1 -- 172.21.15.79:0/1202836584 wait complete. 2024-04-25T02:11:49.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.972+0000 7fbc6bb5a640 1 Processor -- start 2024-04-25T02:11:49.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.972+0000 7fbc6bb5a640 1 -- start start 2024-04-25T02:11:49.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc6bb5a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc500039e0 0x7fbc6406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:49.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc6bb5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc6415d100 0x7fbc64153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc6bb5a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc6415da20 0x7fbc640c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc6bb5a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc640b1340 con 0x7fbc6415d100 2024-04-25T02:11:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc6bb5a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6406ef90 con 0x7fbc500039e0 2024-04-25T02:11:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc6bb5a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbc640b14c0 con 0x7fbc6415da20 2024-04-25T02:11:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc690f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc6415d100 0x7fbc64153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc690f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc6415d100 0x7fbc64153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57546/0 (socket says 172.21.15.79:57546) 2024-04-25T02:11:49.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc690f5640 1 -- 172.21.15.79:0/3129376101 learned_addr learned my addr 172.21.15.79:0/3129376101 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:49.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc690f5640 1 -- 172.21.15.79:0/3129376101 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc6415da20 msgr2=0x7fbc640c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:49.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc690f5640 1 --2- 172.21.15.79:0/3129376101 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc6415da20 0x7fbc640c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc690f5640 1 -- 172.21.15.79:0/3129376101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc500039e0 msgr2=0x7fbc6406f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:49.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc690f5640 1 --2- 172.21.15.79:0/3129376101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc500039e0 0x7fbc6406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:49.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc690f5640 1 -- 172.21.15.79:0/3129376101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6415e320 con 0x7fbc6415d100 2024-04-25T02:11:49.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc690f5640 1 --2- 172.21.15.79:0/3129376101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc6415d100 0x7fbc64153f60 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbc540072c0 tx=0x7fbc54007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:49.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc5a7fc640 1 -- 172.21.15.79:0/3129376101 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc54001630 con 0x7fbc6415d100 2024-04-25T02:11:49.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc5a7fc640 1 -- 172.21.15.79:0/3129376101 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc54018070 con 0x7fbc6415d100 2024-04-25T02:11:49.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc6bb5a640 1 -- 172.21.15.79:0/3129376101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc6415e600 con 0x7fbc6415d100 2024-04-25T02:11:49.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc5a7fc640 1 -- 172.21.15.79:0/3129376101 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5400fc00 con 0x7fbc6415d100 2024-04-25T02:11:49.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.973+0000 7fbc6bb5a640 1 -- 172.21.15.79:0/3129376101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc64157c60 con 0x7fbc6415d100 2024-04-25T02:11:49.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.974+0000 7fbc6bb5a640 1 -- 172.21.15.79:0/3129376101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc640690a0 con 0x7fbc6415d100 2024-04-25T02:11:49.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.975+0000 7fbc5a7fc640 1 -- 172.21.15.79:0/3129376101 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc5401d460 con 0x7fbc6415d100 2024-04-25T02:11:49.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.975+0000 7fbc5a7fc640 1 --2- 172.21.15.79:0/3129376101 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbc4806be60 0x7fbc4806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:49.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.975+0000 7fbc5a7fc640 1 -- 172.21.15.79:0/3129376101 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7fbc5408aaf0 con 0x7fbc6415d100 2024-04-25T02:11:49.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.975+0000 7fbc698f6640 1 --2- 172.21.15.79:0/3129376101 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbc4806be60 0x7fbc4806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:49.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.975+0000 7fbc698f6640 1 --2- 172.21.15.79:0/3129376101 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbc4806be60 0x7fbc4806e320 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbc60035000 tx=0x7fbc6002d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:49.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:49.979+0000 7fbc5a7fc640 1 -- 172.21.15.79:0/3129376101 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbc54059830 con 0x7fbc6415d100 2024-04-25T02:11:50.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.155+0000 7fbc6bb5a640 1 -- 172.21.15.79:0/3129376101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbc6415d800 con 0x7fbc6415d100 2024-04-25T02:11:50.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.156+0000 7fbc5a7fc640 1 -- 172.21.15.79:0/3129376101 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) ==== 93+0+10 (secure 0 0 0) 0x7fbc54059130 con 0x7fbc6415d100 2024-04-25T02:11:50.163 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:11:50.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.158+0000 7fbc6bb5a640 1 -- 172.21.15.79:0/3129376101 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbc4806be60 msgr2=0x7fbc4806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:50.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.158+0000 7fbc6bb5a640 1 --2- 172.21.15.79:0/3129376101 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbc4806be60 0x7fbc4806e320 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbc60035000 tx=0x7fbc6002d000 comp rx=0 tx=0).stop 2024-04-25T02:11:50.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.158+0000 7fbc6bb5a640 1 -- 172.21.15.79:0/3129376101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc6415d100 msgr2=0x7fbc64153f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:50.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.158+0000 7fbc6bb5a640 1 --2- 172.21.15.79:0/3129376101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc6415d100 0x7fbc64153f60 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbc540072c0 tx=0x7fbc54007780 comp rx=0 tx=0).stop 2024-04-25T02:11:50.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.158+0000 7fbc6bb5a640 1 -- 172.21.15.79:0/3129376101 shutdown_connections 2024-04-25T02:11:50.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.158+0000 7fbc6bb5a640 1 --2- 172.21.15.79:0/3129376101 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbc4806be60 0x7fbc4806e320 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.158+0000 7fbc6bb5a640 1 --2- 172.21.15.79:0/3129376101 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc6415da20 0x7fbc640c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.158+0000 7fbc6bb5a640 1 --2- 172.21.15.79:0/3129376101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc6415d100 0x7fbc64153f60 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.158+0000 7fbc6bb5a640 1 --2- 172.21.15.79:0/3129376101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc500039e0 0x7fbc6406f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.158+0000 7fbc6bb5a640 1 -- 172.21.15.79:0/3129376101 >> 172.21.15.79:0/3129376101 conn(0x7fbc640d1ef0 msgr2=0x7fbc640b62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:50.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.158+0000 7fbc6bb5a640 1 -- 172.21.15.79:0/3129376101 shutdown_connections 2024-04-25T02:11:50.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.158+0000 7fbc6bb5a640 1 -- 172.21.15.79:0/3129376101 wait complete. 2024-04-25T02:11:50.176 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-25T02:11:50.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.265+0000 7f6b042bd640 1 Processor -- start 2024-04-25T02:11:50.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.265+0000 7f6b042bd640 1 -- start start 2024-04-25T02:11:50.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.266+0000 7f6b042bd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6afc143bc0 0x7f6afc15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:50.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.266+0000 7f6b042bd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6afc06df50 0x7f6afc06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:50.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.266+0000 7f6b042bd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6afc15fa40 con 0x7f6afc0b48e0 2024-04-25T02:11:50.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.266+0000 7f6b042bd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6afc06e8f0 con 0x7f6afc06df50 2024-04-25T02:11:50.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.266+0000 7f6b042bd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6afc072cb0 con 0x7f6afc143bc0 2024-04-25T02:11:50.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.266+0000 7f6b01858640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6afc06df50 0x7f6afc06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:50.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.266+0000 7f6b0285a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6afc0b48e0 0x7f6afc0b4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39360/0 (socket says 172.21.15.79:39360) 2024-04-25T02:11:50.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.266+0000 7f6b0285a640 1 -- 172.21.15.79:0/1882931850 learned_addr learned my addr 172.21.15.79:0/1882931850 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:50.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.266+0000 7f6b02059640 1 --2- 172.21.15.79:0/1882931850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6afc143bc0 0x7f6afc15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:50.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.266+0000 7f6b01858640 1 -- 172.21.15.79:0/1882931850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6afc143bc0 msgr2=0x7f6afc15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:50.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.266+0000 7f6b01858640 1 --2- 172.21.15.79:0/1882931850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6afc143bc0 0x7f6afc15f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.266+0000 7f6b01858640 1 -- 172.21.15.79:0/1882931850 >> v1:172.21.15.79:6789/0 conn(0x7f6afc0b48e0 legacy=0x7f6afc0b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:50.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.266+0000 7f6b01858640 1 -- 172.21.15.79:0/1882931850 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6afc071e00 con 0x7f6afc06df50 2024-04-25T02:11:50.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.266+0000 7f6b01057640 1 -- 172.21.15.79:0/1882931850 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 22600341 0 0) 0x7f6af4001490 con 0x7f6afc0b48e0 2024-04-25T02:11:50.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.267+0000 7f6b01858640 1 --2- 172.21.15.79:0/1882931850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc06df50 0x7f6afc06e3b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0097a0 tx=0x7f6aec02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a72a292ce5724d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:50.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.267+0000 7f6b01057640 1 -- 172.21.15.79:0/1882931850 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec037070 con 0x7f6afc06df50 2024-04-25T02:11:50.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.267+0000 7f6b01057640 1 -- 172.21.15.79:0/1882931850 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aec02ae50 con 0x7f6afc06df50 2024-04-25T02:11:50.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.267+0000 7f6b01057640 1 -- 172.21.15.79:0/1882931850 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec032660 con 0x7f6afc06df50 2024-04-25T02:11:50.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.267+0000 7f6b042bd640 1 -- 172.21.15.79:0/1882931850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc06df50 msgr2=0x7f6afc06e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:50.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.267+0000 7f6b042bd640 1 --2- 172.21.15.79:0/1882931850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc06df50 0x7f6afc06e3b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0097a0 tx=0x7f6aec02a100 comp rx=0 tx=0).stop 2024-04-25T02:11:50.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.268+0000 7f6b042bd640 1 -- 172.21.15.79:0/1882931850 shutdown_connections 2024-04-25T02:11:50.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.268+0000 7f6b042bd640 1 --2- 172.21.15.79:0/1882931850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc06df50 0x7f6afc06e3b0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.268+0000 7f6b042bd640 1 --2- 172.21.15.79:0/1882931850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6afc143bc0 0x7f6afc15f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.268+0000 7f6b042bd640 1 -- 172.21.15.79:0/1882931850 >> 172.21.15.79:0/1882931850 conn(0x7f6afc0cfc80 msgr2=0x7f6afc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:50.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.268+0000 7f6b042bd640 1 -- 172.21.15.79:0/1882931850 shutdown_connections 2024-04-25T02:11:50.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.268+0000 7f6b042bd640 1 -- 172.21.15.79:0/1882931850 wait complete. 2024-04-25T02:11:50.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.269+0000 7f6b042bd640 1 Processor -- start 2024-04-25T02:11:50.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.269+0000 7f6b042bd640 1 -- start start 2024-04-25T02:11:50.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.269+0000 7f6b042bd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6afc06df50 0x7f6afc0a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:50.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.269+0000 7f6b042bd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6afc0b48e0 0x7f6afc136690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.269+0000 7f6b042bd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc143bc0 0x7f6afc070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.269+0000 7f6b042bd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc072660 con 0x7f6afc143bc0 2024-04-25T02:11:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.269+0000 7f6b042bd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc072380 con 0x7f6afc06df50 2024-04-25T02:11:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.269+0000 7f6b042bd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6afc072940 con 0x7f6afc0b48e0 2024-04-25T02:11:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6b0285a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc143bc0 0x7f6afc070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6b0285a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc143bc0 0x7f6afc070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57566/0 (socket says 172.21.15.79:57566) 2024-04-25T02:11:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6b0285a640 1 -- 172.21.15.79:0/1554330591 learned_addr learned my addr 172.21.15.79:0/1554330591 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6b01858640 1 --2- 172.21.15.79:0/1554330591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6afc0b48e0 0x7f6afc136690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6b02059640 1 --2- 172.21.15.79:0/1554330591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6afc06df50 0x7f6afc0a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6b0285a640 1 -- 172.21.15.79:0/1554330591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6afc0b48e0 msgr2=0x7f6afc136690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6b0285a640 1 --2- 172.21.15.79:0/1554330591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6afc0b48e0 0x7f6afc136690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6b0285a640 1 -- 172.21.15.79:0/1554330591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6afc06df50 msgr2=0x7f6afc0a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6b0285a640 1 --2- 172.21.15.79:0/1554330591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6afc06df50 0x7f6afc0a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6b0285a640 1 -- 172.21.15.79:0/1554330591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6afc136bd0 con 0x7f6afc143bc0 2024-04-25T02:11:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6b01858640 1 --2- 172.21.15.79:0/1554330591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6afc0b48e0 0x7f6afc136690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6b0285a640 1 --2- 172.21.15.79:0/1554330591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc143bc0 0x7f6afc070cf0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f6af400c730 tx=0x7f6af400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6af2ffd640 1 -- 172.21.15.79:0/1554330591 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af4018070 con 0x7f6afc143bc0 2024-04-25T02:11:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6af2ffd640 1 -- 172.21.15.79:0/1554330591 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af400ce40 con 0x7f6afc143bc0 2024-04-25T02:11:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6b042bd640 1 -- 172.21.15.79:0/1554330591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6afc0a9b90 con 0x7f6afc143bc0 2024-04-25T02:11:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6af2ffd640 1 -- 172.21.15.79:0/1554330591 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af400a860 con 0x7f6afc143bc0 2024-04-25T02:11:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.270+0000 7f6b042bd640 1 -- 172.21.15.79:0/1554330591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6afc0aa150 con 0x7f6afc143bc0 2024-04-25T02:11:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.271+0000 7f6b042bd640 1 -- 172.21.15.79:0/1554330591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6afc0690a0 con 0x7f6afc143bc0 2024-04-25T02:11:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.272+0000 7f6af2ffd640 1 -- 172.21.15.79:0/1554330591 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6af401b070 con 0x7f6afc143bc0 2024-04-25T02:11:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.272+0000 7f6af2ffd640 1 --2- 172.21.15.79:0/1554330591 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ae006be30 0x7f6ae006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.272+0000 7f6b02059640 1 --2- 172.21.15.79:0/1554330591 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ae006be30 0x7f6ae006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.272+0000 7f6af2ffd640 1 -- 172.21.15.79:0/1554330591 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7f6af408a0e0 con 0x7f6afc143bc0 2024-04-25T02:11:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.272+0000 7f6b02059640 1 --2- 172.21.15.79:0/1554330591 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ae006be30 0x7f6ae006e2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6af8006fd0 tx=0x7f6af8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:50.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.276+0000 7f6af2ffd640 1 -- 172.21.15.79:0/1554330591 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6afc15fa40 con 0x7f6afc143bc0 2024-04-25T02:11:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.516+0000 7f6b042bd640 1 -- 172.21.15.79:0/1554330591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) -- 0x7f6afc0681e0 con 0x7f6afc143bc0 2024-04-25T02:11:50.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.557+0000 7f6af2ffd640 1 -- 172.21.15.79:0/1554330591 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v205) ==== 169+0+0 (secure 0 0 0) 0x7f6af4058d90 con 0x7f6afc143bc0 2024-04-25T02:11:50.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.559+0000 7f6b042bd640 1 -- 172.21.15.79:0/1554330591 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ae006be30 msgr2=0x7f6ae006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:50.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.559+0000 7f6b042bd640 1 --2- 172.21.15.79:0/1554330591 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ae006be30 0x7f6ae006e2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6af8006fd0 tx=0x7f6af8008040 comp rx=0 tx=0).stop 2024-04-25T02:11:50.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.559+0000 7f6b042bd640 1 -- 172.21.15.79:0/1554330591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc143bc0 msgr2=0x7f6afc070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:50.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.559+0000 7f6b042bd640 1 --2- 172.21.15.79:0/1554330591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc143bc0 0x7f6afc070cf0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f6af400c730 tx=0x7f6af400cbf0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.559+0000 7f6b042bd640 1 -- 172.21.15.79:0/1554330591 shutdown_connections 2024-04-25T02:11:50.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.559+0000 7f6b042bd640 1 --2- 172.21.15.79:0/1554330591 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6ae006be30 0x7f6ae006e2f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.559+0000 7f6b042bd640 1 --2- 172.21.15.79:0/1554330591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc143bc0 0x7f6afc070cf0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.559+0000 7f6b042bd640 1 --2- 172.21.15.79:0/1554330591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6afc0b48e0 0x7f6afc136690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.559+0000 7f6b042bd640 1 --2- 172.21.15.79:0/1554330591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6afc06df50 0x7f6afc0a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.559+0000 7f6b042bd640 1 -- 172.21.15.79:0/1554330591 >> 172.21.15.79:0/1554330591 conn(0x7f6afc0cfc80 msgr2=0x7f6afc144030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:50.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.559+0000 7f6b042bd640 1 -- 172.21.15.79:0/1554330591 shutdown_connections 2024-04-25T02:11:50.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.559+0000 7f6b042bd640 1 -- 172.21.15.79:0/1554330591 wait complete. 2024-04-25T02:11:50.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T02:11:50.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.670+0000 7fc972664640 1 Processor -- start 2024-04-25T02:11:50.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.670+0000 7fc972664640 1 -- start start 2024-04-25T02:11:50.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.671+0000 7fc972664640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc96c06e6b0 0x7fc96c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:50.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.671+0000 7fc972664640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc96c15ec20 con 0x7fc96c06b2f0 2024-04-25T02:11:50.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.671+0000 7fc972664640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc96c15ef00 con 0x7fc96c0cf7a0 2024-04-25T02:11:50.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.671+0000 7fc972664640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc96c15f830 con 0x7fc96c06e6b0 2024-04-25T02:11:50.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.671+0000 7fc96bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc96c06b2f0 0x7fc96c06b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39376/0 (socket says 172.21.15.79:39376) 2024-04-25T02:11:50.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.671+0000 7fc96bfff640 1 -- 172.21.15.79:0/2010752134 learned_addr learned my addr 172.21.15.79:0/2010752134 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:50.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.671+0000 7fc970c01640 1 --2- 172.21.15.79:0/2010752134 >> v2:172.21.15.189:3300/0 conn(0x7fc96c06e6b0 0x7fc96c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:50.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2137756410 0 0) 0x7fc96c15ec20 con 0x7fc96c06b2f0 2024-04-25T02:11:50.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc954005730 con 0x7fc96c06b2f0 2024-04-25T02:11:50.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2673156379 0 0) 0x7fc96c15ef00 con 0x7fc96c0cf7a0 2024-04-25T02:11:50.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc96c15ec20 con 0x7fc96c0cf7a0 2024-04-25T02:11:50.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2388985090 0 0) 0x7fc954005730 con 0x7fc96c06b2f0 2024-04-25T02:11:50.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 >> v2:172.21.15.189:3300/0 conn(0x7fc96c06e6b0 msgr2=0x7fc96c0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:50.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 --2- 172.21.15.79:0/2010752134 >> v2:172.21.15.189:3300/0 conn(0x7fc96c06e6b0 0x7fc96c0b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 >> v1:172.21.15.189:6789/0 conn(0x7fc96c0cf7a0 legacy=0x7fc96c15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:50.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc96c15f1e0 con 0x7fc96c06b2f0 2024-04-25T02:11:50.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fc95c001670 con 0x7fc96c06b2f0 2024-04-25T02:11:50.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 >> v1:172.21.15.79:6789/0 conn(0x7fc96c06b2f0 legacy=0x7fc96c06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:50.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 --2- 172.21.15.79:0/2010752134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc954005d50 0x7fc954006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:50.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 --2- 172.21.15.79:0/2010752134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc954006a10 0x7fc954006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:50.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 --2- 172.21.15.79:0/2010752134 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9540073d0 0x7fc95400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:50.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc96c15f830 con 0x7fc954006a10 2024-04-25T02:11:50.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc95400e300 con 0x7fc954005d50 2024-04-25T02:11:50.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc95400e500 con 0x7fc9540073d0 2024-04-25T02:11:50.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96b7fe640 1 --2- 172.21.15.79:0/2010752134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc954006a10 0x7fc954006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:50.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96bfff640 1 --2- 172.21.15.79:0/2010752134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc954005d50 0x7fc954006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:50.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc970c01640 1 --2- 172.21.15.79:0/2010752134 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9540073d0 0x7fc95400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:50.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96b7fe640 1 -- 172.21.15.79:0/2010752134 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9540073d0 msgr2=0x7fc95400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:50.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96b7fe640 1 --2- 172.21.15.79:0/2010752134 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9540073d0 0x7fc95400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96b7fe640 1 -- 172.21.15.79:0/2010752134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc954005d50 msgr2=0x7fc954006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:50.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96b7fe640 1 --2- 172.21.15.79:0/2010752134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc954005d50 0x7fc954006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96b7fe640 1 -- 172.21.15.79:0/2010752134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc954005730 con 0x7fc954006a10 2024-04-25T02:11:50.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc970c01640 1 -- 172.21.15.79:0/2010752134 reap_dead start 2024-04-25T02:11:50.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.672+0000 7fc96bfff640 1 --2- 172.21.15.79:0/2010752134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc954005d50 0x7fc954006150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:50.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.673+0000 7fc96b7fe640 1 --2- 172.21.15.79:0/2010752134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc954006a10 0x7fc954006e90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc9600018d0 tx=0x7fc954007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58de5f737b225bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:50.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.673+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9600014f0 con 0x7fc954006a10 2024-04-25T02:11:50.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.673+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9600052d0 con 0x7fc954006a10 2024-04-25T02:11:50.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.673+0000 7fc96affd640 1 -- 172.21.15.79:0/2010752134 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96002ac60 con 0x7fc954006a10 2024-04-25T02:11:50.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.674+0000 7fc972664640 1 -- 172.21.15.79:0/2010752134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc954006a10 msgr2=0x7fc954006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:50.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.674+0000 7fc972664640 1 --2- 172.21.15.79:0/2010752134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc954006a10 0x7fc954006e90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc9600018d0 tx=0x7fc954007a40 comp rx=0 tx=0).stop 2024-04-25T02:11:50.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.674+0000 7fc972664640 1 -- 172.21.15.79:0/2010752134 shutdown_connections 2024-04-25T02:11:50.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.674+0000 7fc972664640 1 --2- 172.21.15.79:0/2010752134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc954006a10 0x7fc954006e90 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.674+0000 7fc972664640 1 -- 172.21.15.79:0/2010752134 >> 172.21.15.79:0/2010752134 conn(0x7fc96c0b1cd0 msgr2=0x7fc96c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:50.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.674+0000 7fc972664640 1 -- 172.21.15.79:0/2010752134 shutdown_connections 2024-04-25T02:11:50.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.674+0000 7fc972664640 1 -- 172.21.15.79:0/2010752134 wait complete. 2024-04-25T02:11:50.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.675+0000 7fc972664640 1 Processor -- start 2024-04-25T02:11:50.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.675+0000 7fc972664640 1 -- start start 2024-04-25T02:11:50.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc972664640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc954006a10 0x7fc96c1420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:50.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc972664640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc96c15b2d0 0x7fc96c154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:50.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc972664640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc96c15b750 0x7fc96c154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:50.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc972664640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc96c06d160 con 0x7fc96c15b2d0 2024-04-25T02:11:50.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc972664640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc96c06cfe0 con 0x7fc954006a10 2024-04-25T02:11:50.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc972664640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc96c0b4b50 con 0x7fc96c15b750 2024-04-25T02:11:50.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc96b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc96c15b2d0 0x7fc96c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:50.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc96b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc96c15b2d0 0x7fc96c154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57588/0 (socket says 172.21.15.79:57588) 2024-04-25T02:11:50.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc96b7fe640 1 -- 172.21.15.79:0/1093858171 learned_addr learned my addr 172.21.15.79:0/1093858171 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:50.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc96b7fe640 1 -- 172.21.15.79:0/1093858171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc96c15b750 msgr2=0x7fc96c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:50.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc96bfff640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc954006a10 0x7fc96c1420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:50.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc970c01640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc96c15b750 0x7fc96c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:50.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc96b7fe640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc96c15b750 0x7fc96c154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc96b7fe640 1 -- 172.21.15.79:0/1093858171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc954006a10 msgr2=0x7fc96c1420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:50.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc96b7fe640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc954006a10 0x7fc96c1420b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc96b7fe640 1 -- 172.21.15.79:0/1093858171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc96c09c3a0 con 0x7fc96c15b2d0 2024-04-25T02:11:50.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc96bfff640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc954006a10 0x7fc96c1420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:50.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc970c01640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc96c15b750 0x7fc96c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:50.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc96b7fe640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc96c15b2d0 0x7fc96c154000 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fc960005040 tx=0x7fc9600012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:50.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc968ff9640 1 -- 172.21.15.79:0/1093858171 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc960037040 con 0x7fc96c15b2d0 2024-04-25T02:11:50.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc968ff9640 1 -- 172.21.15.79:0/1093858171 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc960006e50 con 0x7fc96c15b2d0 2024-04-25T02:11:50.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc972664640 1 -- 172.21.15.79:0/1093858171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc96c1425f0 con 0x7fc96c15b2d0 2024-04-25T02:11:50.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.676+0000 7fc968ff9640 1 -- 172.21.15.79:0/1093858171 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9600014f0 con 0x7fc96c15b2d0 2024-04-25T02:11:50.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.677+0000 7fc972664640 1 -- 172.21.15.79:0/1093858171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc96c09c660 con 0x7fc96c15b2d0 2024-04-25T02:11:50.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.678+0000 7fc972664640 1 -- 172.21.15.79:0/1093858171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc96c0690a0 con 0x7fc96c15b2d0 2024-04-25T02:11:50.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.678+0000 7fc968ff9640 1 -- 172.21.15.79:0/1093858171 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc960044020 con 0x7fc96c15b2d0 2024-04-25T02:11:50.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.678+0000 7fc968ff9640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc95806be30 0x7fc95806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:50.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.678+0000 7fc96bfff640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc95806be30 0x7fc95806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:50.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.678+0000 7fc968ff9640 1 -- 172.21.15.79:0/1093858171 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7fc9600aa8f0 con 0x7fc96c15b2d0 2024-04-25T02:11:50.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.679+0000 7fc96bfff640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc95806be30 0x7fc95806e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0b18b0 tx=0x7fc95c000ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:50.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.682+0000 7fc968ff9640 1 -- 172.21.15.79:0/1093858171 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc9600795a0 con 0x7fc96c15b2d0 2024-04-25T02:11:50.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.857+0000 7fc972664640 1 -- 172.21.15.79:0/1093858171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc96c0cf4f0 con 0x7fc96c15b2d0 2024-04-25T02:11:50.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.861+0000 7fc968ff9640 1 -- 172.21.15.79:0/1093858171 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fc960078ea0 con 0x7fc96c15b2d0 2024-04-25T02:11:50.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.863+0000 7fc972664640 1 -- 172.21.15.79:0/1093858171 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc95806be30 msgr2=0x7fc95806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:50.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.863+0000 7fc972664640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc95806be30 0x7fc95806e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0b18b0 tx=0x7fc95c000ef0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.863+0000 7fc972664640 1 -- 172.21.15.79:0/1093858171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc96c15b2d0 msgr2=0x7fc96c154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.863+0000 7fc972664640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc96c15b2d0 0x7fc96c154000 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fc960005040 tx=0x7fc9600012d0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.863+0000 7fc972664640 1 -- 172.21.15.79:0/1093858171 shutdown_connections 2024-04-25T02:11:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.863+0000 7fc972664640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc95806be30 0x7fc95806e2f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.863+0000 7fc972664640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc96c15b750 0x7fc96c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.863+0000 7fc972664640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc96c15b2d0 0x7fc96c154000 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.863+0000 7fc972664640 1 --2- 172.21.15.79:0/1093858171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc954006a10 0x7fc96c1420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.863+0000 7fc972664640 1 -- 172.21.15.79:0/1093858171 >> 172.21.15.79:0/1093858171 conn(0x7fc96c0b1cd0 msgr2=0x7fc96c159960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.863+0000 7fc972664640 1 -- 172.21.15.79:0/1093858171 shutdown_connections 2024-04-25T02:11:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:50.863+0000 7fc972664640 1 -- 172.21.15.79:0/1093858171 wait complete. 2024-04-25T02:11:50.881 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:11:50.881 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:11:50.916 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:11:50.969 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:11:50.969 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:11:50.969 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:11:50.984 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:11:50.984 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:11:50.984 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:11:51.002 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:11:51.002 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:11:51.002 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:11:51.039 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:11:51.039 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:11:51.039 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:11:51.059 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:11:51.059 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T02:11:51.059 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:11:51.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.168+0000 7f6e35015640 1 Processor -- start 2024-04-25T02:11:51.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.168+0000 7f6e35015640 1 -- start start 2024-04-25T02:11:51.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.169+0000 7f6e35015640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6e300d07a0 0x7f6e3015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:51.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.169+0000 7f6e35015640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6e3006df50 0x7f6e300b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:51.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.169+0000 7f6e35015640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3015f1c0 con 0x7f6e3006e3d0 2024-04-25T02:11:51.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.169+0000 7f6e35015640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6e300b2e60 con 0x7f6e3006df50 2024-04-25T02:11:51.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.169+0000 7f6e35015640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6e300b3140 con 0x7f6e300d07a0 2024-04-25T02:11:51.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.169+0000 7f6e2e59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6e3006df50 0x7f6e300b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:51.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.169+0000 7f6e2f59e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6e3006e3d0 0x7f6e3015a720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39378/0 (socket says 172.21.15.79:39378) 2024-04-25T02:11:51.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.169+0000 7f6e2f59e640 1 -- 172.21.15.79:0/1574954054 learned_addr learned my addr 172.21.15.79:0/1574954054 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:51.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.170+0000 7f6e2ed9d640 1 --2- 172.21.15.79:0/1574954054 >> v2:172.21.15.189:3300/0 conn(0x7f6e300d07a0 0x7f6e3015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:51.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.170+0000 7f6e2e59c640 1 -- 172.21.15.79:0/1574954054 >> v2:172.21.15.189:3300/0 conn(0x7f6e300d07a0 msgr2=0x7f6e3015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:51.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.170+0000 7f6e2e59c640 1 --2- 172.21.15.79:0/1574954054 >> v2:172.21.15.189:3300/0 conn(0x7f6e300d07a0 0x7f6e3015ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:51.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.170+0000 7f6e2e59c640 1 -- 172.21.15.79:0/1574954054 >> v1:172.21.15.79:6789/0 conn(0x7f6e3006e3d0 legacy=0x7f6e3015a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:51.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.170+0000 7f6e2e59c640 1 -- 172.21.15.79:0/1574954054 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e300b3420 con 0x7f6e3006df50 2024-04-25T02:11:51.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.170+0000 7f6e2dd9b640 1 -- 172.21.15.79:0/1574954054 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396861720 0 0) 0x7f6e28001110 con 0x7f6e3006e3d0 2024-04-25T02:11:51.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.170+0000 7f6e2e59c640 1 --2- 172.21.15.79:0/1574954054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3006df50 0x7f6e300b42a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6e30074d80 tx=0x7f6e2402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b8fc056e736af1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:51.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.170+0000 7f6e2dd9b640 1 -- 172.21.15.79:0/1574954054 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e24037070 con 0x7f6e3006df50 2024-04-25T02:11:51.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.170+0000 7f6e2dd9b640 1 -- 172.21.15.79:0/1574954054 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e24032440 con 0x7f6e3006df50 2024-04-25T02:11:51.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.170+0000 7f6e2dd9b640 1 -- 172.21.15.79:0/1574954054 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2402ae60 con 0x7f6e3006df50 2024-04-25T02:11:51.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.171+0000 7f6e35015640 1 -- 172.21.15.79:0/1574954054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3006df50 msgr2=0x7f6e300b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:51.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.171+0000 7f6e35015640 1 --2- 172.21.15.79:0/1574954054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3006df50 0x7f6e300b42a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6e30074d80 tx=0x7f6e2402a110 comp rx=0 tx=0).stop 2024-04-25T02:11:51.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.171+0000 7f6e35015640 1 -- 172.21.15.79:0/1574954054 shutdown_connections 2024-04-25T02:11:51.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.171+0000 7f6e35015640 1 --2- 172.21.15.79:0/1574954054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3006df50 0x7f6e300b42a0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:51.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.171+0000 7f6e35015640 1 --2- 172.21.15.79:0/1574954054 >> v2:172.21.15.189:3300/0 conn(0x7f6e300d07a0 0x7f6e3015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:51.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.171+0000 7f6e35015640 1 -- 172.21.15.79:0/1574954054 >> 172.21.15.79:0/1574954054 conn(0x7f6e300cfc80 msgr2=0x7f6e300d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:51.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.171+0000 7f6e35015640 1 -- 172.21.15.79:0/1574954054 shutdown_connections 2024-04-25T02:11:51.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.171+0000 7f6e35015640 1 -- 172.21.15.79:0/1574954054 wait complete. 2024-04-25T02:11:51.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.172+0000 7f6e35015640 1 Processor -- start 2024-04-25T02:11:51.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.172+0000 7f6e35015640 1 -- start start 2024-04-25T02:11:51.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e35015640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e3006df50 0x7f6e30154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:51.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e35015640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3006e3d0 0x7f6e30151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e35015640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e300d07a0 0x7f6e3015d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e35015640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6e300b47e0 con 0x7f6e3006e3d0 2024-04-25T02:11:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e35015640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e300b39e0 con 0x7f6e3006df50 2024-04-25T02:11:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e35015640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6e300b4960 con 0x7f6e300d07a0 2024-04-25T02:11:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e2e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3006e3d0 0x7f6e30151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e2e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3006e3d0 0x7f6e30151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57608/0 (socket says 172.21.15.79:57608) 2024-04-25T02:11:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e2e59c640 1 -- 172.21.15.79:0/222018066 learned_addr learned my addr 172.21.15.79:0/222018066 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e2e59c640 1 -- 172.21.15.79:0/222018066 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e300d07a0 msgr2=0x7f6e3015d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e2f59e640 1 --2- 172.21.15.79:0/222018066 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e300d07a0 0x7f6e3015d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e2ed9d640 1 --2- 172.21.15.79:0/222018066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e3006df50 0x7f6e30154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e2e59c640 1 --2- 172.21.15.79:0/222018066 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e300d07a0 0x7f6e3015d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e2e59c640 1 -- 172.21.15.79:0/222018066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e3006df50 msgr2=0x7f6e30154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e2e59c640 1 --2- 172.21.15.79:0/222018066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e3006df50 0x7f6e30154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.173+0000 7f6e2e59c640 1 -- 172.21.15.79:0/222018066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e30155240 con 0x7f6e3006e3d0 2024-04-25T02:11:51.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.174+0000 7f6e2e59c640 1 --2- 172.21.15.79:0/222018066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3006e3d0 0x7f6e30151fd0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009890 tx=0x7f6e240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:51.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.174+0000 7f6e177fe640 1 -- 172.21.15.79:0/222018066 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e24037040 con 0x7f6e3006e3d0 2024-04-25T02:11:51.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.174+0000 7f6e177fe640 1 -- 172.21.15.79:0/222018066 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e24042070 con 0x7f6e3006e3d0 2024-04-25T02:11:51.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.174+0000 7f6e35015640 1 -- 172.21.15.79:0/222018066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e30155520 con 0x7f6e3006e3d0 2024-04-25T02:11:51.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.174+0000 7f6e177fe640 1 -- 172.21.15.79:0/222018066 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e24030bd0 con 0x7f6e3006e3d0 2024-04-25T02:11:51.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.174+0000 7f6e35015640 1 -- 172.21.15.79:0/222018066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e30155ae0 con 0x7f6e3006e3d0 2024-04-25T02:11:51.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.175+0000 7f6e35015640 1 -- 172.21.15.79:0/222018066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e300690a0 con 0x7f6e3006e3d0 2024-04-25T02:11:51.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.175+0000 7f6e177fe640 1 -- 172.21.15.79:0/222018066 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e24047460 con 0x7f6e3006e3d0 2024-04-25T02:11:51.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.176+0000 7f6e177fe640 1 --2- 172.21.15.79:0/222018066 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e1c06be60 0x7f6e1c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:51.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.176+0000 7f6e177fe640 1 -- 172.21.15.79:0/222018066 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7f6e240ab780 con 0x7f6e3006e3d0 2024-04-25T02:11:51.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.176+0000 7f6e2ed9d640 1 --2- 172.21.15.79:0/222018066 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e1c06be60 0x7f6e1c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:51.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.176+0000 7f6e2ed9d640 1 --2- 172.21.15.79:0/222018066 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e1c06be60 0x7f6e1c06e320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6e20008e50 tx=0x7f6e200083a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:51.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.180+0000 7f6e177fe640 1 -- 172.21.15.79:0/222018066 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6e24032e20 con 0x7f6e3006e3d0 2024-04-25T02:11:51.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.389+0000 7f6e35015640 1 -- 172.21.15.79:0/222018066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e30072930 con 0x7f6e3006e3d0 2024-04-25T02:11:51.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.390+0000 7f6e177fe640 1 -- 172.21.15.79:0/222018066 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+3872 (secure 0 0 0) 0x7f6e2407a4c0 con 0x7f6e3006e3d0 2024-04-25T02:11:51.397 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:51.398 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5431,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3495029157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3495029157},{"type":"v1","addr":"172.21.15.189:6834","nonce":3495029157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2036557544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2036557544},{"type":"v1","addr":"172.21.15.189:6835","nonce":2036557544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/326759836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":326759836},{"type":"v1","addr":"172.21.15.79:6836","nonce":326759836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6615,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2786494394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2786494394},{"type":"v1","addr":"172.21.15.79:6837","nonce":2786494394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[]} 2024-04-25T02:11:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 28 2024-04-25T02:11:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.392+0000 7f6e35015640 1 -- 172.21.15.79:0/222018066 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e1c06be60 msgr2=0x7f6e1c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.392+0000 7f6e35015640 1 --2- 172.21.15.79:0/222018066 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e1c06be60 0x7f6e1c06e320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6e20008e50 tx=0x7f6e200083a0 comp rx=0 tx=0).stop 2024-04-25T02:11:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.392+0000 7f6e35015640 1 -- 172.21.15.79:0/222018066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3006e3d0 msgr2=0x7f6e30151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.392+0000 7f6e35015640 1 --2- 172.21.15.79:0/222018066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3006e3d0 0x7f6e30151fd0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009890 tx=0x7f6e240046c0 comp rx=0 tx=0).stop 2024-04-25T02:11:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.392+0000 7f6e35015640 1 -- 172.21.15.79:0/222018066 shutdown_connections 2024-04-25T02:11:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.392+0000 7f6e35015640 1 --2- 172.21.15.79:0/222018066 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6e1c06be60 0x7f6e1c06e320 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.392+0000 7f6e35015640 1 --2- 172.21.15.79:0/222018066 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e300d07a0 0x7f6e3015d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:51.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.392+0000 7f6e35015640 1 --2- 172.21.15.79:0/222018066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3006e3d0 0x7f6e30151fd0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:51.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.392+0000 7f6e35015640 1 --2- 172.21.15.79:0/222018066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e3006df50 0x7f6e30154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:51.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.392+0000 7f6e35015640 1 -- 172.21.15.79:0/222018066 >> 172.21.15.79:0/222018066 conn(0x7f6e300cfc80 msgr2=0x7f6e300d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:51.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.392+0000 7f6e35015640 1 -- 172.21.15.79:0/222018066 shutdown_connections 2024-04-25T02:11:51.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.392+0000 7f6e35015640 1 -- 172.21.15.79:0/222018066 wait complete. 2024-04-25T02:11:51.410 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T02:11:51.410 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T02:11:51.411 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T02:11:51.411 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:11:51.411 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T02:11:51.411 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T02:11:51.411 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T02:11:51.411 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:11:51.411 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T02:11:51.412 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T02:11:51.412 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T02:11:51.412 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:11:51.412 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T02:11:51.412 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T02:11:51.412 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T02:11:51.412 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:11:51.421 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T02:11:51.421 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T02:11:51.422 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T02:11:51.422 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T02:11:51.424 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T02:11:51.425 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T02:11:51.425 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T02:11:51.426 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T02:11:51.463 INFO:tasks.ceph.mds.a:Started 2024-04-25T02:11:51.464 DEBUG:teuthology.parallel:result is None 2024-04-25T02:11:51.464 INFO:tasks.ceph.mds.c:Started 2024-04-25T02:11:51.464 DEBUG:teuthology.parallel:result is None 2024-04-25T02:11:51.467 INFO:tasks.ceph.mds.b:Started 2024-04-25T02:11:51.468 DEBUG:teuthology.parallel:result is None 2024-04-25T02:11:51.468 INFO:tasks.ceph.mds.d:Started 2024-04-25T02:11:51.468 DEBUG:teuthology.parallel:result is None 2024-04-25T02:11:51.469 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T02:11:51.536 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:11:51.537 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-04-25T02:11:51.546 INFO:tasks.ceph.mds.b.smithi189.stdout:starting mds.b at 2024-04-25T02:11:51.547 INFO:tasks.ceph.mds.d.smithi189.stdout:starting mds.d at 2024-04-25T02:11:51.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.564+0000 7fc1573ed640 1 Processor -- start 2024-04-25T02:11:51.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.565+0000 7fc1573ed640 1 -- start start 2024-04-25T02:11:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.565+0000 7fc1573ed640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc15015e4d0 0x7fc15006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.565+0000 7fc1573ed640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1500d1660 con 0x7fc1500d2e20 2024-04-25T02:11:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.565+0000 7fc1573ed640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1500d1380 con 0x7fc1500b3570 2024-04-25T02:11:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.565+0000 7fc1573ed640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc1500cede0 con 0x7fc15015e4d0 2024-04-25T02:11:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.565+0000 7fc15598a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc1500d2e20 0x7fc1500cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39394/0 (socket says 172.21.15.79:39394) 2024-04-25T02:11:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.566+0000 7fc15598a640 1 -- 172.21.15.79:0/3294793662 learned_addr learned my addr 172.21.15.79:0/3294793662 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.566+0000 7fc155189640 1 --2- 172.21.15.79:0/3294793662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc15015e4d0 0x7fc15006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.566+0000 7fc155189640 1 -- 172.21.15.79:0/3294793662 >> v1:172.21.15.189:6789/0 conn(0x7fc1500b3570 legacy=0x7fc1500d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.566+0000 7fc155189640 1 -- 172.21.15.79:0/3294793662 >> v1:172.21.15.79:6789/0 conn(0x7fc1500d2e20 legacy=0x7fc1500cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.566+0000 7fc155189640 1 -- 172.21.15.79:0/3294793662 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1500cf0c0 con 0x7fc15015e4d0 2024-04-25T02:11:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.567+0000 7fc155189640 1 --2- 172.21.15.79:0/3294793662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc15015e4d0 0x7fc15006bc70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0097d0 tx=0x7fc14c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c22a5593ca3fa5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:51.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.568+0000 7fc147fff640 1 -- 172.21.15.79:0/3294793662 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c037070 con 0x7fc15015e4d0 2024-04-25T02:11:51.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.568+0000 7fc147fff640 1 -- 172.21.15.79:0/3294793662 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc14c032440 con 0x7fc15015e4d0 2024-04-25T02:11:51.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.568+0000 7fc147fff640 1 -- 172.21.15.79:0/3294793662 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c032810 con 0x7fc15015e4d0 2024-04-25T02:11:51.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.569+0000 7fc1573ed640 1 -- 172.21.15.79:0/3294793662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc15015e4d0 msgr2=0x7fc15006bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.569+0000 7fc1573ed640 1 --2- 172.21.15.79:0/3294793662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc15015e4d0 0x7fc15006bc70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0097d0 tx=0x7fc14c02a210 comp rx=0 tx=0).stop 2024-04-25T02:11:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.569+0000 7fc1573ed640 1 -- 172.21.15.79:0/3294793662 shutdown_connections 2024-04-25T02:11:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.569+0000 7fc1573ed640 1 --2- 172.21.15.79:0/3294793662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc15015e4d0 0x7fc15006bc70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.569+0000 7fc1573ed640 1 -- 172.21.15.79:0/3294793662 >> 172.21.15.79:0/3294793662 conn(0x7fc15009d460 msgr2=0x7fc1500d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.569+0000 7fc1573ed640 1 -- 172.21.15.79:0/3294793662 shutdown_connections 2024-04-25T02:11:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.569+0000 7fc1573ed640 1 -- 172.21.15.79:0/3294793662 wait complete. 2024-04-25T02:11:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.570+0000 7fc1573ed640 1 Processor -- start 2024-04-25T02:11:51.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.570+0000 7fc1573ed640 1 -- start start 2024-04-25T02:11:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.571+0000 7fc1573ed640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1500b3570 0x7fc1500cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.571+0000 7fc1573ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1500d2e20 0x7fc1500b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.571+0000 7fc1573ed640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc15015e4d0 0x7fc1500cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.571+0000 7fc1573ed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc1500d2250 con 0x7fc1500d2e20 2024-04-25T02:11:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.571+0000 7fc1573ed640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc1500d20d0 con 0x7fc1500b3570 2024-04-25T02:11:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.571+0000 7fc1573ed640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc15006c1b0 con 0x7fc15015e4d0 2024-04-25T02:11:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.571+0000 7fc154988640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1500d2e20 0x7fc1500b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.571+0000 7fc154988640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1500d2e20 0x7fc1500b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57652/0 (socket says 172.21.15.79:57652) 2024-04-25T02:11:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.571+0000 7fc154988640 1 -- 172.21.15.79:0/2068432410 learned_addr learned my addr 172.21.15.79:0/2068432410 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.571+0000 7fc155189640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1500b3570 0x7fc1500cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.571+0000 7fc15598a640 1 --2- 172.21.15.79:0/2068432410 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc15015e4d0 0x7fc1500cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.572+0000 7fc154988640 1 -- 172.21.15.79:0/2068432410 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc15015e4d0 msgr2=0x7fc1500cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.572+0000 7fc154988640 1 --2- 172.21.15.79:0/2068432410 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc15015e4d0 0x7fc1500cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.572+0000 7fc154988640 1 -- 172.21.15.79:0/2068432410 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1500b3570 msgr2=0x7fc1500cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.572+0000 7fc154988640 1 --2- 172.21.15.79:0/2068432410 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1500b3570 0x7fc1500cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.572+0000 7fc154988640 1 -- 172.21.15.79:0/2068432410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1500b5360 con 0x7fc1500d2e20 2024-04-25T02:11:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.572+0000 7fc154988640 1 --2- 172.21.15.79:0/2068432410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1500d2e20 0x7fc1500b4b10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c450 tx=0x7fc14000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.573+0000 7fc145ffb640 1 -- 172.21.15.79:0/2068432410 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140017070 con 0x7fc1500d2e20 2024-04-25T02:11:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.573+0000 7fc145ffb640 1 -- 172.21.15.79:0/2068432410 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1400052d0 con 0x7fc1500d2e20 2024-04-25T02:11:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.573+0000 7fc145ffb640 1 -- 172.21.15.79:0/2068432410 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140003830 con 0x7fc1500d2e20 2024-04-25T02:11:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.573+0000 7fc1573ed640 1 -- 172.21.15.79:0/2068432410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1500b5640 con 0x7fc1500d2e20 2024-04-25T02:11:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.573+0000 7fc1573ed640 1 -- 172.21.15.79:0/2068432410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1500b5c00 con 0x7fc1500d2e20 2024-04-25T02:11:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.574+0000 7fc1573ed640 1 -- 172.21.15.79:0/2068432410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc150067270 con 0x7fc1500d2e20 2024-04-25T02:11:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.574+0000 7fc145ffb640 1 -- 172.21.15.79:0/2068432410 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc14001a070 con 0x7fc1500d2e20 2024-04-25T02:11:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.574+0000 7fc145ffb640 1 --2- 172.21.15.79:0/2068432410 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc13406be60 0x7fc13406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.575+0000 7fc145ffb640 1 -- 172.21.15.79:0/2068432410 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4943+0+0 (secure 0 0 0) 0x7fc140089d60 con 0x7fc1500d2e20 2024-04-25T02:11:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.575+0000 7fc155189640 1 --2- 172.21.15.79:0/2068432410 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc13406be60 0x7fc13406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:51.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.575+0000 7fc155189640 1 --2- 172.21.15.79:0/2068432410 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc13406be60 0x7fc13406e320 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc14c034000 tx=0x7fc14c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:51.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.579+0000 7fc145ffb640 1 -- 172.21.15.79:0/2068432410 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc150067270 con 0x7fc1500d2e20 2024-04-25T02:11:51.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:51.762+0000 7fc1573ed640 1 -- 172.21.15.79:0/2068432410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc1500690a0 con 0x7fc1500d2e20 2024-04-25T02:11:52.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.581+0000 7fc145ffb640 1 -- 172.21.15.79:0/2068432410 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v67) ==== 97+0+0 (secure 0 0 0) 0x7fc140058450 con 0x7fc1500d2e20 2024-04-25T02:11:52.588 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2024-04-25T02:11:52.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.583+0000 7fc1573ed640 1 -- 172.21.15.79:0/2068432410 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc13406be60 msgr2=0x7fc13406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:52.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.583+0000 7fc1573ed640 1 --2- 172.21.15.79:0/2068432410 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc13406be60 0x7fc13406e320 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc14c034000 tx=0x7fc14c02e000 comp rx=0 tx=0).stop 2024-04-25T02:11:52.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.583+0000 7fc1573ed640 1 -- 172.21.15.79:0/2068432410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1500d2e20 msgr2=0x7fc1500b4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:52.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.583+0000 7fc1573ed640 1 --2- 172.21.15.79:0/2068432410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1500d2e20 0x7fc1500b4b10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c450 tx=0x7fc14000c910 comp rx=0 tx=0).stop 2024-04-25T02:11:52.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.583+0000 7fc1573ed640 1 -- 172.21.15.79:0/2068432410 shutdown_connections 2024-04-25T02:11:52.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.583+0000 7fc1573ed640 1 --2- 172.21.15.79:0/2068432410 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc13406be60 0x7fc13406e320 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:52.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.583+0000 7fc1573ed640 1 --2- 172.21.15.79:0/2068432410 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc15015e4d0 0x7fc1500cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:52.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.583+0000 7fc1573ed640 1 --2- 172.21.15.79:0/2068432410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1500d2e20 0x7fc1500b4b10 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:52.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.583+0000 7fc1573ed640 1 --2- 172.21.15.79:0/2068432410 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1500b3570 0x7fc1500cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:52.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.583+0000 7fc1573ed640 1 -- 172.21.15.79:0/2068432410 >> 172.21.15.79:0/2068432410 conn(0x7fc15009d460 msgr2=0x7fc15015ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:52.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.583+0000 7fc1573ed640 1 -- 172.21.15.79:0/2068432410 shutdown_connections 2024-04-25T02:11:52.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.583+0000 7fc1573ed640 1 -- 172.21.15.79:0/2068432410 wait complete. 2024-04-25T02:11:52.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T02:11:52.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.697+0000 7fa9b1e38640 1 Processor -- start 2024-04-25T02:11:52.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.697+0000 7fa9b1e38640 1 -- start start 2024-04-25T02:11:52.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.698+0000 7fa9b1e38640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9ac143bc0 0x7fa9ac15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:52.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.698+0000 7fa9b1e38640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9ac15fa40 con 0x7fa9ac06df50 2024-04-25T02:11:52.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.698+0000 7fa9b1e38640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9ac0b5700 con 0x7fa9ac0b3d40 2024-04-25T02:11:52.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.698+0000 7fa9b1e38640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa9ac072cb0 con 0x7fa9ac143bc0 2024-04-25T02:11:52.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.698+0000 7fa9aaffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa9ac06df50 0x7fa9ac0b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39396/0 (socket says 172.21.15.79:39396) 2024-04-25T02:11:52.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.698+0000 7fa9aaffd640 1 -- 172.21.15.79:0/651455353 learned_addr learned my addr 172.21.15.79:0/651455353 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:52.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.698+0000 7fa9ab7fe640 1 --2- 172.21.15.79:0/651455353 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9ac143bc0 0x7fa9ac15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:52.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.698+0000 7fa9aa7fc640 1 -- 172.21.15.79:0/651455353 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1216615773 0 0) 0x7fa9a0001110 con 0x7fa9ac06df50 2024-04-25T02:11:52.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.698+0000 7fa9aa7fc640 1 -- 172.21.15.79:0/651455353 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa994005730 con 0x7fa9ac06df50 2024-04-25T02:11:52.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.698+0000 7fa9aa7fc640 1 -- 172.21.15.79:0/651455353 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3227376068 0 0) 0x7fa994005730 con 0x7fa9ac06df50 2024-04-25T02:11:52.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.698+0000 7fa9aa7fc640 1 -- 172.21.15.79:0/651455353 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9ac143bc0 msgr2=0x7fa9ac15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:52.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.698+0000 7fa9aa7fc640 1 --2- 172.21.15.79:0/651455353 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9ac143bc0 0x7fa9ac15f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:52.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9aa7fc640 1 -- 172.21.15.79:0/651455353 >> v1:172.21.15.189:6789/0 conn(0x7fa9ac0b3d40 legacy=0x7fa9ac0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:52.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9aa7fc640 1 -- 172.21.15.79:0/651455353 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ac071e00 con 0x7fa9ac06df50 2024-04-25T02:11:52.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9aa7fc640 1 -- 172.21.15.79:0/651455353 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fa9a0001840 con 0x7fa9ac06df50 2024-04-25T02:11:52.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9aa7fc640 1 -- 172.21.15.79:0/651455353 >> v1:172.21.15.79:6789/0 conn(0x7fa9ac06df50 legacy=0x7fa9ac0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:52.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9aa7fc640 1 --2- 172.21.15.79:0/651455353 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9ac143bc0 0x7fa994005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:52.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9aa7fc640 1 --2- 172.21.15.79:0/651455353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa994006220 0x7fa994006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:52.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9aa7fc640 1 --2- 172.21.15.79:0/651455353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994006f50 0x7fa9940073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:52.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9aa7fc640 1 -- 172.21.15.79:0/651455353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac072cb0 con 0x7fa994006f50 2024-04-25T02:11:52.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9aa7fc640 1 -- 172.21.15.79:0/651455353 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa99400de10 con 0x7fa994006220 2024-04-25T02:11:52.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9aa7fc640 1 -- 172.21.15.79:0/651455353 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa99400e010 con 0x7fa9ac143bc0 2024-04-25T02:11:52.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9abfff640 1 --2- 172.21.15.79:0/651455353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994006f50 0x7fa9940073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:52.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9ab7fe640 1 --2- 172.21.15.79:0/651455353 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9ac143bc0 0x7fa994005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:52.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9aaffd640 1 --2- 172.21.15.79:0/651455353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa994006220 0x7fa994006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:52.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9abfff640 1 -- 172.21.15.79:0/651455353 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9ac143bc0 msgr2=0x7fa994005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:52.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9abfff640 1 --2- 172.21.15.79:0/651455353 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9ac143bc0 0x7fa994005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:52.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9abfff640 1 -- 172.21.15.79:0/651455353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa994006220 msgr2=0x7fa994006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:52.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9abfff640 1 --2- 172.21.15.79:0/651455353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa994006220 0x7fa994006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:52.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9abfff640 1 -- 172.21.15.79:0/651455353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa994005730 con 0x7fa994006f50 2024-04-25T02:11:52.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.699+0000 7fa9aaffd640 1 --2- 172.21.15.79:0/651455353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa994006220 0x7fa994006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:52.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.700+0000 7fa9abfff640 1 --2- 172.21.15.79:0/651455353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994006f50 0x7fa9940073d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4001e50 tx=0x7fa994007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ee72dbfdb52342 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:52.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.700+0000 7fa9aa7fc640 1 -- 172.21.15.79:0/651455353 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4001a70 con 0x7fa994006f50 2024-04-25T02:11:52.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.700+0000 7fa9aa7fc640 1 -- 172.21.15.79:0/651455353 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9a4003970 con 0x7fa994006f50 2024-04-25T02:11:52.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.700+0000 7fa9aa7fc640 1 -- 172.21.15.79:0/651455353 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4003d60 con 0x7fa994006f50 2024-04-25T02:11:52.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.700+0000 7fa9b1e38640 1 -- 172.21.15.79:0/651455353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994006f50 msgr2=0x7fa9940073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:52.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.700+0000 7fa9b1e38640 1 --2- 172.21.15.79:0/651455353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994006f50 0x7fa9940073d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4001e50 tx=0x7fa994007a40 comp rx=0 tx=0).stop 2024-04-25T02:11:52.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.700+0000 7fa9abfff640 1 -- 172.21.15.79:0/651455353 reap_dead start 2024-04-25T02:11:52.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.700+0000 7fa9b1e38640 1 -- 172.21.15.79:0/651455353 shutdown_connections 2024-04-25T02:11:52.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.700+0000 7fa9b1e38640 1 -- 172.21.15.79:0/651455353 >> 172.21.15.79:0/651455353 conn(0x7fa9ac0cfc80 msgr2=0x7fa9ac0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:52.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.700+0000 7fa9b1e38640 1 -- 172.21.15.79:0/651455353 shutdown_connections 2024-04-25T02:11:52.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.701+0000 7fa9b1e38640 1 -- 172.21.15.79:0/651455353 wait complete. 2024-04-25T02:11:52.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.702+0000 7fa9b1e38640 1 Processor -- start 2024-04-25T02:11:52.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.702+0000 7fa9b1e38640 1 -- start start 2024-04-25T02:11:52.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.702+0000 7fa9b1e38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994006f50 0x7fa9ac1effd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:52.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.702+0000 7fa9b1e38640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9ac138760 0x7fa9ac140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:52.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.702+0000 7fa9b1e38640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9ac141130 0x7fa9ac139910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:52.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.702+0000 7fa9b1e38640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac072660 con 0x7fa994006f50 2024-04-25T02:11:52.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.702+0000 7fa9b1e38640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac072380 con 0x7fa9ac141130 2024-04-25T02:11:52.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.702+0000 7fa9b1e38640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa9ac072940 con 0x7fa9ac138760 2024-04-25T02:11:52.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa9ab7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994006f50 0x7fa9ac1effd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:52.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa9ab7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994006f50 0x7fa9ac1effd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57670/0 (socket says 172.21.15.79:57670) 2024-04-25T02:11:52.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa9ab7fe640 1 -- 172.21.15.79:0/785146164 learned_addr learned my addr 172.21.15.79:0/785146164 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:52.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa9aaffd640 1 --2- 172.21.15.79:0/785146164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9ac138760 0x7fa9ac140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:52.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa9abfff640 1 --2- 172.21.15.79:0/785146164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9ac141130 0x7fa9ac139910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:52.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa9ab7fe640 1 -- 172.21.15.79:0/785146164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9ac138760 msgr2=0x7fa9ac140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:52.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa9ab7fe640 1 --2- 172.21.15.79:0/785146164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9ac138760 0x7fa9ac140bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:52.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa9ab7fe640 1 -- 172.21.15.79:0/785146164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9ac141130 msgr2=0x7fa9ac139910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:52.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa9ab7fe640 1 --2- 172.21.15.79:0/785146164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9ac141130 0x7fa9ac139910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:52.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa9ab7fe640 1 -- 172.21.15.79:0/785146164 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ac13dcb0 con 0x7fa994006f50 2024-04-25T02:11:52.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa9abfff640 1 --2- 172.21.15.79:0/785146164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9ac141130 0x7fa9ac139910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:52.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa9ab7fe640 1 --2- 172.21.15.79:0/785146164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994006f50 0x7fa9ac1effd0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00b7f0 tx=0x7fa99c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:52.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa993fff640 1 -- 172.21.15.79:0/785146164 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c018070 con 0x7fa994006f50 2024-04-25T02:11:52.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa993fff640 1 -- 172.21.15.79:0/785146164 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99c010830 con 0x7fa994006f50 2024-04-25T02:11:52.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa9b1e38640 1 -- 172.21.15.79:0/785146164 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9ac13df90 con 0x7fa994006f50 2024-04-25T02:11:52.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa993fff640 1 -- 172.21.15.79:0/785146164 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c010c00 con 0x7fa994006f50 2024-04-25T02:11:52.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.703+0000 7fa9b1e38640 1 -- 172.21.15.79:0/785146164 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9ac13e550 con 0x7fa994006f50 2024-04-25T02:11:52.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.704+0000 7fa9b1e38640 1 -- 172.21.15.79:0/785146164 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9ac141540 con 0x7fa994006f50 2024-04-25T02:11:52.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.705+0000 7fa993fff640 1 -- 172.21.15.79:0/785146164 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa99c01b070 con 0x7fa994006f50 2024-04-25T02:11:52.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.705+0000 7fa993fff640 1 --2- 172.21.15.79:0/785146164 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa99806be30 0x7fa99806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:52.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.705+0000 7fa993fff640 1 -- 172.21.15.79:0/785146164 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 4857+0+0 (secure 0 0 0) 0x7fa99c08af30 con 0x7fa994006f50 2024-04-25T02:11:52.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.705+0000 7fa9aaffd640 1 --2- 172.21.15.79:0/785146164 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa99806be30 0x7fa99806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:52.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.705+0000 7fa9aaffd640 1 --2- 172.21.15.79:0/785146164 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa99806be30 0x7fa99806e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0000ff0 tx=0x7fa9a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:52.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.709+0000 7fa993fff640 1 -- 172.21.15.79:0/785146164 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa9ac141540 con 0x7fa994006f50 2024-04-25T02:11:52.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.949+0000 7fa9b1e38640 1 -- 172.21.15.79:0/785146164 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa9ac0690a0 con 0x7fa994006f50 2024-04-25T02:11:52.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.949+0000 7fa993fff640 1 -- 172.21.15.79:0/785146164 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7fa99c059cc0 con 0x7fa994006f50 2024-04-25T02:11:52.957 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:52.957 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:11:52.957 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2024-04-25T02:11:52.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.957 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2024-04-25T02:11:52.957 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmkSfsJhAAEP9aqirUawsrrvVUkxkO0w==", 2024-04-25T02:11:52.957 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.957 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:11:52.958 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:11:52.958 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:11:52.958 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:11:52.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.958 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2024-04-25T02:11:52.958 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilm8wYYMhAA98c3h9c80Y9zYzVv+kY7qQ==", 2024-04-25T02:11:52.958 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.958 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:11:52.958 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:11:52.958 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:11:52.958 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:11:52.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.959 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2024-04-25T02:11:52.959 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmiqSiLRAAmCUWUrHC31tkg0dkXS54cA==", 2024-04-25T02:11:52.959 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.959 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:11:52.959 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:11:52.959 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:11:52.959 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:11:52.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.960 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2024-04-25T02:11:52.960 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmiPbkOBAA+rBwAypY5jrR3xafG9h1sw==", 2024-04-25T02:11:52.960 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.960 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:11:52.960 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:11:52.960 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:11:52.960 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:11:52.960 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.960 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2024-04-25T02:11:52.960 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDJuilmP1AdGBAAS0IkH2E3XQvkxA33GInm5w==", 2024-04-25T02:11:52.960 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.960 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:11:52.961 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:11:52.961 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:11:52.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.961 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2024-04-25T02:11:52.961 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDMuilm479HFhAA8iIjBC94pqHikS5kPHipCQ==", 2024-04-25T02:11:52.961 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.961 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:11:52.961 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:11:52.961 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:11:52.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.962 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2024-04-25T02:11:52.962 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDPuilmE+k9FBAARX3P/kjt7ybeVHGGyYaWwg==", 2024-04-25T02:11:52.962 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.962 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:11:52.962 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:11:52.962 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:11:52.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.962 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2024-04-25T02:11:52.962 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDSuilmUF41EhAA1HhTXWnhVwETe+4hxmxjFw==", 2024-04-25T02:11:52.962 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:11:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:11:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:11:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2024-04-25T02:11:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDYuilm2pisGRAAFBmWVAGib2guJobYooLQoA==", 2024-04-25T02:11:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:11:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:11:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:11:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.964 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2024-04-25T02:11:52.964 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDbuilm28m9FxAA8GOmzxRAlK6o/RTe+FpL7g==", 2024-04-25T02:11:52.964 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.964 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:11:52.964 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:11:52.964 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:11:52.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.964 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2024-04-25T02:11:52.964 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDeuilmzDRyFRAAKk7JWPVRxxE+B4OCJhaXvg==", 2024-04-25T02:11:52.964 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.964 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:11:52.964 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:11:52.964 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:11:52.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.965 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2024-04-25T02:11:52.965 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDhuilmQABhExAA40Inq4eg4oohO3tmNdCyPQ==", 2024-04-25T02:11:52.965 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.965 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:11:52.965 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:11:52.965 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:11:52.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.965 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2024-04-25T02:11:52.965 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g==", 2024-04-25T02:11:52.965 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.966 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:11:52.966 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2024-04-25T02:11:52.966 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T02:11:52.966 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.966 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2024-04-25T02:11:52.966 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilm8EWZCRAAjRomNRANd7sC+tpYZ1uE6w==", 2024-04-25T02:11:52.966 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.966 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:11:52.966 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:11:52.966 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:11:52.966 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:11:52.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.967 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2024-04-25T02:11:52.967 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmHUedBhAA84h2PNUgReBGQ3rubcEDsw==", 2024-04-25T02:11:52.967 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.967 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:11:52.967 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:11:52.967 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:11:52.967 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:11:52.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.967 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2024-04-25T02:11:52.968 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmCx4UDxAAZmQdQB8RdTMr2JKr7TMySg==", 2024-04-25T02:11:52.968 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.968 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:11:52.968 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:11:52.968 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:11:52.968 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:11:52.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.968 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2024-04-25T02:11:52.968 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmFgdeDBAAu+VeVhknKsm+Gxzh5+qANg==", 2024-04-25T02:11:52.968 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.968 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:11:52.968 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:11:52.968 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:11:52.969 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:11:52.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.969 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2024-04-25T02:11:52.969 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmXrLhIxAAiq13px9HksQtu+qjoRi1qQ==", 2024-04-25T02:11:52.969 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.969 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:11:52.969 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-04-25T02:11:52.969 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:11:52.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:11:52.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:52.969 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2024-04-25T02:11:52.970 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmV8dxIBAA8GX2T/ZqZF+3qDjtddh/ZQ==", 2024-04-25T02:11:52.970 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:11:52.970 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:11:52.970 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-04-25T02:11:52.970 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:11:52.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:52.970 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T02:11:52.970 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:11:52.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.951+0000 7fa9b1e38640 1 -- 172.21.15.79:0/785146164 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa99806be30 msgr2=0x7fa99806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:52.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.951+0000 7fa9b1e38640 1 --2- 172.21.15.79:0/785146164 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa99806be30 0x7fa99806e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0000ff0 tx=0x7fa9a0009040 comp rx=0 tx=0).stop 2024-04-25T02:11:52.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.951+0000 7fa9b1e38640 1 -- 172.21.15.79:0/785146164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994006f50 msgr2=0x7fa9ac1effd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:52.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.951+0000 7fa9b1e38640 1 --2- 172.21.15.79:0/785146164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994006f50 0x7fa9ac1effd0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00b7f0 tx=0x7fa99c00bcb0 comp rx=0 tx=0).stop 2024-04-25T02:11:52.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.951+0000 7fa9b1e38640 1 -- 172.21.15.79:0/785146164 shutdown_connections 2024-04-25T02:11:52.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.951+0000 7fa9b1e38640 1 --2- 172.21.15.79:0/785146164 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa99806be30 0x7fa99806e2f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:52.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.951+0000 7fa9b1e38640 1 --2- 172.21.15.79:0/785146164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9ac141130 0x7fa9ac139910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:52.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.951+0000 7fa9b1e38640 1 --2- 172.21.15.79:0/785146164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa9ac138760 0x7fa9ac140bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:52.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.951+0000 7fa9b1e38640 1 --2- 172.21.15.79:0/785146164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994006f50 0x7fa9ac1effd0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:52.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.951+0000 7fa9b1e38640 1 -- 172.21.15.79:0/785146164 >> 172.21.15.79:0/785146164 conn(0x7fa9ac0cfc80 msgr2=0x7fa9ac15e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:52.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.951+0000 7fa9b1e38640 1 -- 172.21.15.79:0/785146164 shutdown_connections 2024-04-25T02:11:52.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:52.951+0000 7fa9b1e38640 1 -- 172.21.15.79:0/785146164 wait complete. 2024-04-25T02:11:52.973 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:11:53.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.062+0000 7f3d81aa5640 1 Processor -- start 2024-04-25T02:11:53.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.062+0000 7f3d81aa5640 1 -- start start 2024-04-25T02:11:53.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.063+0000 7f3d81aa5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d7c06df50 0x7f3d7c06e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.063+0000 7f3d81aa5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f3d7c071240 0x7f3d7c071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.063+0000 7f3d81aa5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7c070d90 con 0x7f3d7c144cb0 2024-04-25T02:11:53.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.063+0000 7f3d81aa5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3d7c0cf130 con 0x7f3d7c06df50 2024-04-25T02:11:53.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.063+0000 7f3d81aa5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3d7c0cf410 con 0x7f3d7c071240 2024-04-25T02:11:53.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.063+0000 7f3d7affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d7c06df50 0x7f3d7c06e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.063+0000 7f3d7b7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3d7c144cb0 0x7f3d7c0b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39404/0 (socket says 172.21.15.79:39404) 2024-04-25T02:11:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.063+0000 7f3d7b7fe640 1 -- 172.21.15.79:0/2156172464 learned_addr learned my addr 172.21.15.79:0/2156172464 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.063+0000 7f3d7bfff640 1 --2- 172.21.15.79:0/2156172464 >> v2:172.21.15.189:3300/0 conn(0x7f3d7c071240 0x7f3d7c071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.063+0000 7f3d7affd640 1 -- 172.21.15.79:0/2156172464 >> v2:172.21.15.189:3300/0 conn(0x7f3d7c071240 msgr2=0x7f3d7c071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.063+0000 7f3d7affd640 1 --2- 172.21.15.79:0/2156172464 >> v2:172.21.15.189:3300/0 conn(0x7f3d7c071240 0x7f3d7c071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.063+0000 7f3d7affd640 1 -- 172.21.15.79:0/2156172464 >> v1:172.21.15.79:6789/0 conn(0x7f3d7c144cb0 legacy=0x7f3d7c0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.063+0000 7f3d7affd640 1 -- 172.21.15.79:0/2156172464 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c0cf6f0 con 0x7f3d7c06df50 2024-04-25T02:11:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.063+0000 7f3d7a7fc640 1 -- 172.21.15.79:0/2156172464 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2893807709 0 0) 0x7f3d7c070d90 con 0x7f3d7c144cb0 2024-04-25T02:11:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.063+0000 7f3d7bfff640 1 --2- 172.21.15.79:0/2156172464 >> v2:172.21.15.189:3300/0 conn(0x7f3d7c071240 0x7f3d7c071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.064+0000 7f3d7affd640 1 --2- 172.21.15.79:0/2156172464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d7c06df50 0x7f3d7c06e3e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0b5ae0 tx=0x7f3d7002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b709e3e4787c967e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.064+0000 7f3d7a7fc640 1 -- 172.21.15.79:0/2156172464 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70037070 con 0x7f3d7c06df50 2024-04-25T02:11:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.064+0000 7f3d7a7fc640 1 -- 172.21.15.79:0/2156172464 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7002add0 con 0x7f3d7c06df50 2024-04-25T02:11:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.064+0000 7f3d7a7fc640 1 -- 172.21.15.79:0/2156172464 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70032660 con 0x7f3d7c06df50 2024-04-25T02:11:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.065+0000 7f3d81aa5640 1 -- 172.21.15.79:0/2156172464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d7c06df50 msgr2=0x7f3d7c06e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.065+0000 7f3d81aa5640 1 --2- 172.21.15.79:0/2156172464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d7c06df50 0x7f3d7c06e3e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0b5ae0 tx=0x7f3d7002a080 comp rx=0 tx=0).stop 2024-04-25T02:11:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.065+0000 7f3d81aa5640 1 -- 172.21.15.79:0/2156172464 shutdown_connections 2024-04-25T02:11:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.065+0000 7f3d81aa5640 1 --2- 172.21.15.79:0/2156172464 >> v2:172.21.15.189:3300/0 conn(0x7f3d7c071240 0x7f3d7c071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.065+0000 7f3d81aa5640 1 --2- 172.21.15.79:0/2156172464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d7c06df50 0x7f3d7c06e3e0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.065+0000 7f3d81aa5640 1 -- 172.21.15.79:0/2156172464 >> 172.21.15.79:0/2156172464 conn(0x7f3d7c0cfc80 msgr2=0x7f3d7c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.065+0000 7f3d81aa5640 1 -- 172.21.15.79:0/2156172464 shutdown_connections 2024-04-25T02:11:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.065+0000 7f3d81aa5640 1 -- 172.21.15.79:0/2156172464 wait complete. 2024-04-25T02:11:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.066+0000 7f3d81aa5640 1 Processor -- start 2024-04-25T02:11:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.066+0000 7f3d81aa5640 1 -- start start 2024-04-25T02:11:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d81aa5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3d7c06df50 0x7f3d7c15d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d81aa5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d7c071240 0x7f3d7c0c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d81aa5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d7c144cb0 0x7f3d7c1f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d81aa5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c145090 con 0x7f3d7c144cb0 2024-04-25T02:11:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d81aa5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c0cf9d0 con 0x7f3d7c071240 2024-04-25T02:11:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d81aa5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7c145ab0 con 0x7f3d7c06df50 2024-04-25T02:11:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d7bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d7c144cb0 0x7f3d7c1f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d7bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d7c144cb0 0x7f3d7c1f20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57688/0 (socket says 172.21.15.79:57688) 2024-04-25T02:11:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d7bfff640 1 -- 172.21.15.79:0/1841613352 learned_addr learned my addr 172.21.15.79:0/1841613352 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d7affd640 1 --2- 172.21.15.79:0/1841613352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d7c071240 0x7f3d7c0c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d7b7fe640 1 --2- 172.21.15.79:0/1841613352 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3d7c06df50 0x7f3d7c15d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d7bfff640 1 -- 172.21.15.79:0/1841613352 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3d7c06df50 msgr2=0x7f3d7c15d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d7bfff640 1 --2- 172.21.15.79:0/1841613352 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3d7c06df50 0x7f3d7c15d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d7bfff640 1 -- 172.21.15.79:0/1841613352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d7c071240 msgr2=0x7f3d7c0c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d7bfff640 1 --2- 172.21.15.79:0/1841613352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d7c071240 0x7f3d7c0c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d7bfff640 1 -- 172.21.15.79:0/1841613352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c0aaaa0 con 0x7f3d7c144cb0 2024-04-25T02:11:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d7b7fe640 1 --2- 172.21.15.79:0/1841613352 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3d7c06df50 0x7f3d7c15d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d7bfff640 1 --2- 172.21.15.79:0/1841613352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d7c144cb0 0x7f3d7c1f20f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f3d74007f20 tx=0x7f3d7400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d63fff640 1 -- 172.21.15.79:0/1841613352 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7401a070 con 0x7f3d7c144cb0 2024-04-25T02:11:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d63fff640 1 -- 172.21.15.79:0/1841613352 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d74003b90 con 0x7f3d7c144cb0 2024-04-25T02:11:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d81aa5640 1 -- 172.21.15.79:0/1841613352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7c0aad80 con 0x7f3d7c144cb0 2024-04-25T02:11:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d63fff640 1 -- 172.21.15.79:0/1841613352 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d74004030 con 0x7f3d7c144cb0 2024-04-25T02:11:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.067+0000 7f3d81aa5640 1 -- 172.21.15.79:0/1841613352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7c0ab340 con 0x7f3d7c144cb0 2024-04-25T02:11:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.068+0000 7f3d81aa5640 1 -- 172.21.15.79:0/1841613352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d7c1f33a0 con 0x7f3d7c144cb0 2024-04-25T02:11:53.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.069+0000 7f3d63fff640 1 -- 172.21.15.79:0/1841613352 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d7401d070 con 0x7f3d7c144cb0 2024-04-25T02:11:53.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.069+0000 7f3d63fff640 1 --2- 172.21.15.79:0/1841613352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3d6806be30 0x7f3d6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.069+0000 7f3d63fff640 1 -- 172.21.15.79:0/1841613352 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 4857+0+0 (secure 0 0 0) 0x7f3d7408ae40 con 0x7f3d7c144cb0 2024-04-25T02:11:53.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.069+0000 7f3d7b7fe640 1 --2- 172.21.15.79:0/1841613352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3d6806be30 0x7f3d6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.070+0000 7f3d7b7fe640 1 --2- 172.21.15.79:0/1841613352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3d6806be30 0x7f3d6806e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c000f60 tx=0x7f3d6c007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.073+0000 7f3d63fff640 1 -- 172.21.15.79:0/1841613352 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3d74010070 con 0x7f3d7c144cb0 2024-04-25T02:11:53.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.247+0000 7f3d81aa5640 1 -- 172.21.15.79:0/1841613352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d7c13ff30 con 0x7f3d7c144cb0 2024-04-25T02:11:53.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.248+0000 7f3d63fff640 1 -- 172.21.15.79:0/1841613352 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+12903 (secure 0 0 0) 0x7f3d7c13ff30 con 0x7f3d7c144cb0 2024-04-25T02:11:53.255 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:53.255 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":67,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:11:52.580291+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:11:53.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.250+0000 7f3d81aa5640 1 -- 172.21.15.79:0/1841613352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3d6806be30 msgr2=0x7f3d6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.250+0000 7f3d81aa5640 1 --2- 172.21.15.79:0/1841613352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3d6806be30 0x7f3d6806e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c000f60 tx=0x7f3d6c007c10 comp rx=0 tx=0).stop 2024-04-25T02:11:53.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.250+0000 7f3d81aa5640 1 -- 172.21.15.79:0/1841613352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d7c144cb0 msgr2=0x7f3d7c1f20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.250+0000 7f3d81aa5640 1 --2- 172.21.15.79:0/1841613352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d7c144cb0 0x7f3d7c1f20f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f3d74007f20 tx=0x7f3d7400d560 comp rx=0 tx=0).stop 2024-04-25T02:11:53.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.250+0000 7f3d81aa5640 1 -- 172.21.15.79:0/1841613352 shutdown_connections 2024-04-25T02:11:53.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.250+0000 7f3d81aa5640 1 --2- 172.21.15.79:0/1841613352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3d6806be30 0x7f3d6806e2f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.250+0000 7f3d81aa5640 1 --2- 172.21.15.79:0/1841613352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d7c144cb0 0x7f3d7c1f20f0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.250+0000 7f3d81aa5640 1 --2- 172.21.15.79:0/1841613352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d7c071240 0x7f3d7c0c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.250+0000 7f3d81aa5640 1 --2- 172.21.15.79:0/1841613352 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3d7c06df50 0x7f3d7c15d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.250+0000 7f3d81aa5640 1 -- 172.21.15.79:0/1841613352 >> 172.21.15.79:0/1841613352 conn(0x7f3d7c0cfc80 msgr2=0x7f3d7c141100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:53.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.250+0000 7f3d81aa5640 1 -- 172.21.15.79:0/1841613352 shutdown_connections 2024-04-25T02:11:53.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.250+0000 7f3d81aa5640 1 -- 172.21.15.79:0/1841613352 wait complete. 2024-04-25T02:11:53.268 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:11:53.268 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:11:53.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.361+0000 7f8d6c3f9640 1 Processor -- start 2024-04-25T02:11:53.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.361+0000 7f8d6c3f9640 1 -- start start 2024-04-25T02:11:53.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d6c3f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d640cf7a0 0x7f8d640b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d6c3f9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6415ec20 con 0x7f8d6406e6b0 2024-04-25T02:11:53.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d6c3f9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6415ef00 con 0x7f8d6406b2f0 2024-04-25T02:11:53.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d6c3f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6415f830 con 0x7f8d640cf7a0 2024-04-25T02:11:53.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d6a996640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8d6406e6b0 0x7f8d6415b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39416/0 (socket says 172.21.15.79:39416) 2024-04-25T02:11:53.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d6a996640 1 -- 172.21.15.79:0/3108795116 learned_addr learned my addr 172.21.15.79:0/3108795116 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:53.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d69994640 1 --2- 172.21.15.79:0/3108795116 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d640cf7a0 0x7f8d640b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d69193640 1 -- 172.21.15.79:0/3108795116 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536556301 0 0) 0x7f8d6415ec20 con 0x7f8d6406e6b0 2024-04-25T02:11:53.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d69193640 1 -- 172.21.15.79:0/3108795116 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d50003520 con 0x7f8d6406e6b0 2024-04-25T02:11:53.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d69193640 1 -- 172.21.15.79:0/3108795116 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 290616609 0 0) 0x7f8d50003520 con 0x7f8d6406e6b0 2024-04-25T02:11:53.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d69193640 1 -- 172.21.15.79:0/3108795116 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d640cf7a0 msgr2=0x7f8d640b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:53.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d69193640 1 --2- 172.21.15.79:0/3108795116 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d640cf7a0 0x7f8d640b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d69193640 1 -- 172.21.15.79:0/3108795116 >> v1:172.21.15.189:6789/0 conn(0x7f8d6406b2f0 legacy=0x7f8d6406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d69193640 1 -- 172.21.15.79:0/3108795116 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6415f1e0 con 0x7f8d6406e6b0 2024-04-25T02:11:53.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d69193640 1 -- 172.21.15.79:0/3108795116 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f8d5c0019f0 con 0x7f8d6406e6b0 2024-04-25T02:11:53.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.362+0000 7f8d69193640 1 -- 172.21.15.79:0/3108795116 >> v1:172.21.15.79:6789/0 conn(0x7f8d6406e6b0 legacy=0x7f8d6415b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.363+0000 7f8d69193640 1 --2- 172.21.15.79:0/3108795116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500039e0 0x7f8d50003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.363+0000 7f8d69193640 1 --2- 172.21.15.79:0/3108795116 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d50004800 0x7f8d50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.363+0000 7f8d69193640 1 --2- 172.21.15.79:0/3108795116 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d640cf7a0 0x7f8d50005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.363+0000 7f8d69193640 1 -- 172.21.15.79:0/3108795116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6415f830 con 0x7f8d500039e0 2024-04-25T02:11:53.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.363+0000 7f8d69193640 1 -- 172.21.15.79:0/3108795116 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5000baf0 con 0x7f8d50004800 2024-04-25T02:11:53.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.363+0000 7f8d69193640 1 -- 172.21.15.79:0/3108795116 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5000bcf0 con 0x7f8d640cf7a0 2024-04-25T02:11:53.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.363+0000 7f8d6a195640 1 --2- 172.21.15.79:0/3108795116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500039e0 0x7f8d50003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.363+0000 7f8d69994640 1 --2- 172.21.15.79:0/3108795116 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d50004800 0x7f8d50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.363+0000 7f8d6a996640 1 --2- 172.21.15.79:0/3108795116 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d640cf7a0 0x7f8d50005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.363+0000 7f8d6a195640 1 -- 172.21.15.79:0/3108795116 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d640cf7a0 msgr2=0x7f8d50005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:53.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.363+0000 7f8d6a195640 1 --2- 172.21.15.79:0/3108795116 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d640cf7a0 0x7f8d50005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.363+0000 7f8d6a195640 1 -- 172.21.15.79:0/3108795116 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d50004800 msgr2=0x7f8d50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:53.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.363+0000 7f8d6a195640 1 --2- 172.21.15.79:0/3108795116 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d50004800 0x7f8d50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.363+0000 7f8d6a195640 1 -- 172.21.15.79:0/3108795116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d50003520 con 0x7f8d500039e0 2024-04-25T02:11:53.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.364+0000 7f8d6a195640 1 --2- 172.21.15.79:0/3108795116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500039e0 0x7f8d50003e00 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f8d60001750 tx=0x7f8d50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2e7abf6e42ec32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.364+0000 7f8d69193640 1 -- 172.21.15.79:0/3108795116 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60001370 con 0x7f8d500039e0 2024-04-25T02:11:53.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.364+0000 7f8d69193640 1 -- 172.21.15.79:0/3108795116 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d600052d0 con 0x7f8d500039e0 2024-04-25T02:11:53.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.364+0000 7f8d69193640 1 -- 172.21.15.79:0/3108795116 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6002abe0 con 0x7f8d500039e0 2024-04-25T02:11:53.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.364+0000 7f8d6c3f9640 1 -- 172.21.15.79:0/3108795116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500039e0 msgr2=0x7f8d50003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.364+0000 7f8d6c3f9640 1 --2- 172.21.15.79:0/3108795116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500039e0 0x7f8d50003e00 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f8d60001750 tx=0x7f8d50005830 comp rx=0 tx=0).stop 2024-04-25T02:11:53.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.364+0000 7f8d6a996640 1 -- 172.21.15.79:0/3108795116 reap_dead start 2024-04-25T02:11:53.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.364+0000 7f8d6c3f9640 1 -- 172.21.15.79:0/3108795116 shutdown_connections 2024-04-25T02:11:53.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.364+0000 7f8d6c3f9640 1 -- 172.21.15.79:0/3108795116 >> 172.21.15.79:0/3108795116 conn(0x7f8d640b1cd0 msgr2=0x7f8d640b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:53.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.364+0000 7f8d6c3f9640 1 -- 172.21.15.79:0/3108795116 shutdown_connections 2024-04-25T02:11:53.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.364+0000 7f8d6c3f9640 1 -- 172.21.15.79:0/3108795116 wait complete. 2024-04-25T02:11:53.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.365+0000 7f8d6c3f9640 1 Processor -- start 2024-04-25T02:11:53.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.366+0000 7f8d6c3f9640 1 -- start start 2024-04-25T02:11:53.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.366+0000 7f8d6c3f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500039e0 0x7f8d641f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.366+0000 7f8d6c3f9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d641575d0 0x7f8d6409cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.366+0000 7f8d6c3f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d6409d180 0x7f8d64070d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.366+0000 7f8d6c3f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6406d160 con 0x7f8d500039e0 2024-04-25T02:11:53.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.366+0000 7f8d6c3f9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6406cfe0 con 0x7f8d641575d0 2024-04-25T02:11:53.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.366+0000 7f8d6c3f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8d640b4b50 con 0x7f8d6409d180 2024-04-25T02:11:53.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.366+0000 7f8d6a195640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500039e0 0x7f8d641f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.366+0000 7f8d6a195640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500039e0 0x7f8d641f4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57702/0 (socket says 172.21.15.79:57702) 2024-04-25T02:11:53.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.366+0000 7f8d6a195640 1 -- 172.21.15.79:0/3666769218 learned_addr learned my addr 172.21.15.79:0/3666769218 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:53.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.366+0000 7f8d69994640 1 --2- 172.21.15.79:0/3666769218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d641575d0 0x7f8d6409cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.366+0000 7f8d6a996640 1 --2- 172.21.15.79:0/3666769218 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d6409d180 0x7f8d64070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.367+0000 7f8d6a195640 1 -- 172.21.15.79:0/3666769218 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d6409d180 msgr2=0x7f8d64070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.367+0000 7f8d6a195640 1 --2- 172.21.15.79:0/3666769218 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d6409d180 0x7f8d64070d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.367+0000 7f8d6a195640 1 -- 172.21.15.79:0/3666769218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d641575d0 msgr2=0x7f8d6409cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.367+0000 7f8d6a195640 1 --2- 172.21.15.79:0/3666769218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d641575d0 0x7f8d6409cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.367+0000 7f8d6a195640 1 -- 172.21.15.79:0/3666769218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d64159b50 con 0x7f8d500039e0 2024-04-25T02:11:53.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.367+0000 7f8d6a996640 1 --2- 172.21.15.79:0/3666769218 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d6409d180 0x7f8d64070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:53.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.367+0000 7f8d6a195640 1 --2- 172.21.15.79:0/3666769218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500039e0 0x7f8d641f4200 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f8d60005040 tx=0x7f8d60001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.367+0000 7f8d5affd640 1 -- 172.21.15.79:0/3666769218 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60042070 con 0x7f8d500039e0 2024-04-25T02:11:53.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.367+0000 7f8d5affd640 1 -- 172.21.15.79:0/3666769218 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6002be50 con 0x7f8d500039e0 2024-04-25T02:11:53.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.367+0000 7f8d5affd640 1 -- 172.21.15.79:0/3666769218 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60037040 con 0x7f8d500039e0 2024-04-25T02:11:53.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.367+0000 7f8d6c3f9640 1 -- 172.21.15.79:0/3666769218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d64159e30 con 0x7f8d500039e0 2024-04-25T02:11:53.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.367+0000 7f8d6c3f9640 1 -- 172.21.15.79:0/3666769218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d64150270 con 0x7f8d500039e0 2024-04-25T02:11:53.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.368+0000 7f8d6c3f9640 1 -- 172.21.15.79:0/3666769218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d640690a0 con 0x7f8d500039e0 2024-04-25T02:11:53.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.368+0000 7f8d5affd640 1 -- 172.21.15.79:0/3666769218 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d60045070 con 0x7f8d500039e0 2024-04-25T02:11:53.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.369+0000 7f8d5affd640 1 --2- 172.21.15.79:0/3666769218 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8d4806be30 0x7f8d4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.369+0000 7f8d5affd640 1 -- 172.21.15.79:0/3666769218 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 4857+0+0 (secure 0 0 0) 0x7f8d600aa230 con 0x7f8d500039e0 2024-04-25T02:11:53.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.369+0000 7f8d69994640 1 --2- 172.21.15.79:0/3666769218 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8d4806be30 0x7f8d4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.369+0000 7f8d69994640 1 --2- 172.21.15.79:0/3666769218 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8d4806be30 0x7f8d4806e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8d6409d8c0 tx=0x7f8d54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.373+0000 7f8d5affd640 1 -- 172.21.15.79:0/3666769218 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8d60078fc0 con 0x7f8d500039e0 2024-04-25T02:11:53.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.546+0000 7f8d6c3f9640 1 -- 172.21.15.79:0/3666769218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8d64156b40 con 0x7f8d500039e0 2024-04-25T02:11:53.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.547+0000 7f8d5affd640 1 -- 172.21.15.79:0/3666769218 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) ==== 93+0+10 (secure 0 0 0) 0x7f8d600788c0 con 0x7f8d500039e0 2024-04-25T02:11:53.554 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:11:53.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.548+0000 7f8d6c3f9640 1 -- 172.21.15.79:0/3666769218 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8d4806be30 msgr2=0x7f8d4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.548+0000 7f8d6c3f9640 1 --2- 172.21.15.79:0/3666769218 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8d4806be30 0x7f8d4806e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8d6409d8c0 tx=0x7f8d54008040 comp rx=0 tx=0).stop 2024-04-25T02:11:53.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.548+0000 7f8d6c3f9640 1 -- 172.21.15.79:0/3666769218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500039e0 msgr2=0x7f8d641f4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.548+0000 7f8d6c3f9640 1 --2- 172.21.15.79:0/3666769218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500039e0 0x7f8d641f4200 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f8d60005040 tx=0x7f8d60001120 comp rx=0 tx=0).stop 2024-04-25T02:11:53.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.548+0000 7f8d6c3f9640 1 -- 172.21.15.79:0/3666769218 shutdown_connections 2024-04-25T02:11:53.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.548+0000 7f8d6c3f9640 1 --2- 172.21.15.79:0/3666769218 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8d4806be30 0x7f8d4806e2f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.548+0000 7f8d6c3f9640 1 --2- 172.21.15.79:0/3666769218 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d6409d180 0x7f8d64070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.548+0000 7f8d6c3f9640 1 --2- 172.21.15.79:0/3666769218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d641575d0 0x7f8d6409cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.548+0000 7f8d6c3f9640 1 --2- 172.21.15.79:0/3666769218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500039e0 0x7f8d641f4200 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.548+0000 7f8d6c3f9640 1 -- 172.21.15.79:0/3666769218 >> 172.21.15.79:0/3666769218 conn(0x7f8d640b1cd0 msgr2=0x7f8d640aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:53.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.549+0000 7f8d6c3f9640 1 -- 172.21.15.79:0/3666769218 shutdown_connections 2024-04-25T02:11:53.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.549+0000 7f8d6c3f9640 1 -- 172.21.15.79:0/3666769218 wait complete. 2024-04-25T02:11:53.567 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T02:11:53.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.656+0000 7f2837712640 1 Processor -- start 2024-04-25T02:11:53.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.657+0000 7f2837712640 1 -- start start 2024-04-25T02:11:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.657+0000 7f2837712640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f283015a720 0x7f283015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.657+0000 7f2837712640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28300d07a0 0x7f28300b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.657+0000 7f2837712640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f283015f1c0 con 0x7f28300b47e0 2024-04-25T02:11:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.657+0000 7f2837712640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f28300b2e60 con 0x7f283015a720 2024-04-25T02:11:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.657+0000 7f2837712640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f28300b3140 con 0x7f28300d07a0 2024-04-25T02:11:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2835caf640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f28300b47e0 0x7f283015ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:32968/0 (socket says 172.21.15.79:32968) 2024-04-25T02:11:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2835caf640 1 -- 172.21.15.79:0/2502732258 learned_addr learned my addr 172.21.15.79:0/2502732258 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2834cad640 1 --2- 172.21.15.79:0/2502732258 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28300d07a0 0x7f28300b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f28354ae640 1 --2- 172.21.15.79:0/2502732258 >> v2:172.21.15.189:3300/0 conn(0x7f283015a720 0x7f283015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 -- 172.21.15.79:0/2502732258 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 340665278 0 0) 0x7f282c001110 con 0x7f28300b47e0 2024-04-25T02:11:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 -- 172.21.15.79:0/2502732258 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f281c003520 con 0x7f28300b47e0 2024-04-25T02:11:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 -- 172.21.15.79:0/2502732258 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1208789684 0 0) 0x7f281c003520 con 0x7f28300b47e0 2024-04-25T02:11:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 -- 172.21.15.79:0/2502732258 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28300d07a0 msgr2=0x7f28300b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 --2- 172.21.15.79:0/2502732258 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28300d07a0 0x7f28300b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 -- 172.21.15.79:0/2502732258 >> v2:172.21.15.189:3300/0 conn(0x7f283015a720 msgr2=0x7f283015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 --2- 172.21.15.79:0/2502732258 >> v2:172.21.15.189:3300/0 conn(0x7f283015a720 0x7f283015ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 -- 172.21.15.79:0/2502732258 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28300b3420 con 0x7f28300b47e0 2024-04-25T02:11:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 -- 172.21.15.79:0/2502732258 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f282c001840 con 0x7f28300b47e0 2024-04-25T02:11:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 -- 172.21.15.79:0/2502732258 >> v1:172.21.15.79:6789/0 conn(0x7f28300b47e0 legacy=0x7f283015ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 --2- 172.21.15.79:0/2502732258 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28300d07a0 0x7f281c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 --2- 172.21.15.79:0/2502732258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c003f30 0x7f281c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 --2- 172.21.15.79:0/2502732258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f281c004d40 0x7f281c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 -- 172.21.15.79:0/2502732258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f28300b2e60 con 0x7f281c003f30 2024-04-25T02:11:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 -- 172.21.15.79:0/2502732258 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f28300b3140 con 0x7f281c004d40 2024-04-25T02:11:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2827fff640 1 -- 172.21.15.79:0/2502732258 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f281c00ba10 con 0x7f28300d07a0 2024-04-25T02:11:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2834cad640 1 --2- 172.21.15.79:0/2502732258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c003f30 0x7f281c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f2835caf640 1 --2- 172.21.15.79:0/2502732258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f281c004d40 0x7f281c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.658+0000 7f28354ae640 1 --2- 172.21.15.79:0/2502732258 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28300d07a0 0x7f281c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.659+0000 7f2834cad640 1 -- 172.21.15.79:0/2502732258 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28300d07a0 msgr2=0x7f281c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.659+0000 7f2834cad640 1 --2- 172.21.15.79:0/2502732258 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28300d07a0 0x7f281c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.659+0000 7f2834cad640 1 -- 172.21.15.79:0/2502732258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f281c004d40 msgr2=0x7f281c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.659+0000 7f2834cad640 1 --2- 172.21.15.79:0/2502732258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f281c004d40 0x7f281c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.659+0000 7f2834cad640 1 -- 172.21.15.79:0/2502732258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f281c003520 con 0x7f281c003f30 2024-04-25T02:11:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.659+0000 7f2834cad640 1 --2- 172.21.15.79:0/2502732258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c003f30 0x7f281c004800 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f2820009af0 tx=0x7f281c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d707170f48dd0609 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.659+0000 7f2827fff640 1 -- 172.21.15.79:0/2502732258 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820036070 con 0x7f281c003f30 2024-04-25T02:11:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.659+0000 7f2827fff640 1 -- 172.21.15.79:0/2502732258 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2820031400 con 0x7f281c003f30 2024-04-25T02:11:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.659+0000 7f2827fff640 1 -- 172.21.15.79:0/2502732258 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820009690 con 0x7f281c003f30 2024-04-25T02:11:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.660+0000 7f2837712640 1 -- 172.21.15.79:0/2502732258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c003f30 msgr2=0x7f281c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.660+0000 7f2837712640 1 --2- 172.21.15.79:0/2502732258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c003f30 0x7f281c004800 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f2820009af0 tx=0x7f281c005830 comp rx=0 tx=0).stop 2024-04-25T02:11:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.660+0000 7f2835caf640 1 -- 172.21.15.79:0/2502732258 reap_dead start 2024-04-25T02:11:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.660+0000 7f2837712640 1 -- 172.21.15.79:0/2502732258 shutdown_connections 2024-04-25T02:11:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.660+0000 7f2837712640 1 -- 172.21.15.79:0/2502732258 >> 172.21.15.79:0/2502732258 conn(0x7f28300cfc80 msgr2=0x7f28300d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.660+0000 7f2837712640 1 -- 172.21.15.79:0/2502732258 shutdown_connections 2024-04-25T02:11:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.660+0000 7f2837712640 1 -- 172.21.15.79:0/2502732258 wait complete. 2024-04-25T02:11:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.661+0000 7f2837712640 1 Processor -- start 2024-04-25T02:11:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.661+0000 7f2837712640 1 -- start start 2024-04-25T02:11:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2837712640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f281c003f30 0x7f2830156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2837712640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2830149fb0 0x7f283014a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2837712640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f283014ac10 0x7f2830166400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2837712640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2830071d00 con 0x7f2830149fb0 2024-04-25T02:11:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2837712640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f28300b39e0 con 0x7f283014ac10 2024-04-25T02:11:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2837712640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2830071e80 con 0x7f281c003f30 2024-04-25T02:11:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2834cad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2830149fb0 0x7f283014a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2834cad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2830149fb0 0x7f283014a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59736/0 (socket says 172.21.15.79:59736) 2024-04-25T02:11:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2834cad640 1 -- 172.21.15.79:0/4047482206 learned_addr learned my addr 172.21.15.79:0/4047482206 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f28354ae640 1 --2- 172.21.15.79:0/4047482206 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f281c003f30 0x7f2830156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2835caf640 1 --2- 172.21.15.79:0/4047482206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f283014ac10 0x7f2830166400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2834cad640 1 -- 172.21.15.79:0/4047482206 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f281c003f30 msgr2=0x7f2830156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2834cad640 1 --2- 172.21.15.79:0/4047482206 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f281c003f30 0x7f2830156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2834cad640 1 -- 172.21.15.79:0/4047482206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f283014ac10 msgr2=0x7f2830166400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2834cad640 1 --2- 172.21.15.79:0/4047482206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f283014ac10 0x7f2830166400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2834cad640 1 -- 172.21.15.79:0/4047482206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283014c530 con 0x7f2830149fb0 2024-04-25T02:11:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2835caf640 1 --2- 172.21.15.79:0/4047482206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f283014ac10 0x7f2830166400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.662+0000 7f2834cad640 1 --2- 172.21.15.79:0/4047482206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2830149fb0 0x7f283014a6d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2820034040 tx=0x7f2820004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.663+0000 7f2825ffb640 1 -- 172.21.15.79:0/4047482206 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820040020 con 0x7f2830149fb0 2024-04-25T02:11:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.663+0000 7f2825ffb640 1 -- 172.21.15.79:0/4047482206 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2820003c60 con 0x7f2830149fb0 2024-04-25T02:11:53.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.663+0000 7f2837712640 1 -- 172.21.15.79:0/4047482206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283014c810 con 0x7f2830149fb0 2024-04-25T02:11:53.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.663+0000 7f2825ffb640 1 -- 172.21.15.79:0/4047482206 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820036040 con 0x7f2830149fb0 2024-04-25T02:11:53.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.663+0000 7f2837712640 1 -- 172.21.15.79:0/4047482206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f283014cdd0 con 0x7f2830149fb0 2024-04-25T02:11:53.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.664+0000 7f2837712640 1 -- 172.21.15.79:0/4047482206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28300690a0 con 0x7f2830149fb0 2024-04-25T02:11:53.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.664+0000 7f2825ffb640 1 -- 172.21.15.79:0/4047482206 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2820043020 con 0x7f2830149fb0 2024-04-25T02:11:53.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.665+0000 7f2825ffb640 1 --2- 172.21.15.79:0/4047482206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f281406be30 0x7f281406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.665+0000 7f2825ffb640 1 -- 172.21.15.79:0/4047482206 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 4857+0+0 (secure 0 0 0) 0x7f28200aafc0 con 0x7f2830149fb0 2024-04-25T02:11:53.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.665+0000 7f28354ae640 1 --2- 172.21.15.79:0/4047482206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f281406be30 0x7f281406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.665+0000 7f28354ae640 1 --2- 172.21.15.79:0/4047482206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f281406be30 0x7f281406e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2828007520 tx=0x7f282800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.669+0000 7f2825ffb640 1 -- 172.21.15.79:0/4047482206 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f282004a030 con 0x7f2830149fb0 2024-04-25T02:11:53.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.845+0000 7f2837712640 1 -- 172.21.15.79:0/4047482206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f28300681e0 con 0x7f2830149fb0 2024-04-25T02:11:53.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.845+0000 7f2825ffb640 1 -- 172.21.15.79:0/4047482206 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v67) ==== 84+0+65 (secure 0 0 0) 0x7f28200044e0 con 0x7f2830149fb0 2024-04-25T02:11:53.852 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:53.853 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-04-25T02:11:53.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:11:53.853 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-04-25T02:11:53.853 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-04-25T02:11:53.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:11:53.853 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-04-25T02:11:53.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.847+0000 7f2837712640 1 -- 172.21.15.79:0/4047482206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f281406be30 msgr2=0x7f281406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.847+0000 7f2837712640 1 --2- 172.21.15.79:0/4047482206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f281406be30 0x7f281406e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2828007520 tx=0x7f282800b040 comp rx=0 tx=0).stop 2024-04-25T02:11:53.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.847+0000 7f2837712640 1 -- 172.21.15.79:0/4047482206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2830149fb0 msgr2=0x7f283014a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.847+0000 7f2837712640 1 --2- 172.21.15.79:0/4047482206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2830149fb0 0x7f283014a6d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2820034040 tx=0x7f2820004730 comp rx=0 tx=0).stop 2024-04-25T02:11:53.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.847+0000 7f2837712640 1 -- 172.21.15.79:0/4047482206 shutdown_connections 2024-04-25T02:11:53.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.847+0000 7f2837712640 1 --2- 172.21.15.79:0/4047482206 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f281406be30 0x7f281406e2f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.847+0000 7f2837712640 1 --2- 172.21.15.79:0/4047482206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f283014ac10 0x7f2830166400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.847+0000 7f2837712640 1 --2- 172.21.15.79:0/4047482206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2830149fb0 0x7f283014a6d0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.847+0000 7f2837712640 1 --2- 172.21.15.79:0/4047482206 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f281c003f30 0x7f2830156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.847+0000 7f2837712640 1 -- 172.21.15.79:0/4047482206 >> 172.21.15.79:0/4047482206 conn(0x7f28300cfc80 msgr2=0x7f283015c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:53.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.847+0000 7f2837712640 1 -- 172.21.15.79:0/4047482206 shutdown_connections 2024-04-25T02:11:53.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.847+0000 7f2837712640 1 -- 172.21.15.79:0/4047482206 wait complete. 2024-04-25T02:11:53.865 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T02:11:53.865 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T02:11:53.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.958+0000 7f81f2570640 1 Processor -- start 2024-04-25T02:11:53.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.959+0000 7f81f2570640 1 -- start start 2024-04-25T02:11:53.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.959+0000 7f81f2570640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f81ec15e440 0x7f81ec0cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.959+0000 7f81f2570640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81ec0d1e80 con 0x7f81ec0d2f20 2024-04-25T02:11:53.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.959+0000 7f81f2570640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81ec0d2160 con 0x7f81ec0d10a0 2024-04-25T02:11:53.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.959+0000 7f81f2570640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f81ec0d2440 con 0x7f81ec15e440 2024-04-25T02:11:53.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.959+0000 7f81ebfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f81ec15e440 0x7f81ec0cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.959+0000 7f81eb7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f81ec0d2f20 0x7f81ec0d0990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:32980/0 (socket says 172.21.15.79:32980) 2024-04-25T02:11:53.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.960+0000 7f81ebfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f81ec15e440 0x7f81ec0cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59738/0 (socket says 172.21.15.79:59738) 2024-04-25T02:11:53.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.960+0000 7f81eb7fe640 1 -- 172.21.15.79:0/2771027236 learned_addr learned my addr 172.21.15.79:0/2771027236 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:53.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.960+0000 7f81ebfff640 1 -- 172.21.15.79:0/2771027236 >> v1:172.21.15.189:6789/0 conn(0x7f81ec0d10a0 legacy=0x7f81ec0b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:53.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.960+0000 7f81ebfff640 1 -- 172.21.15.79:0/2771027236 >> v1:172.21.15.79:6789/0 conn(0x7f81ec0d2f20 legacy=0x7f81ec0d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.960+0000 7f81ebfff640 1 -- 172.21.15.79:0/2771027236 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ec0d2720 con 0x7f81ec15e440 2024-04-25T02:11:53.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.960+0000 7f81ebfff640 1 --2- 172.21.15.79:0/2771027236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ec15e440 0x7f81ec0cf870 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0097a0 tx=0x7f81dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d6b8daeebcc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.961+0000 7f81eaffd640 1 -- 172.21.15.79:0/2771027236 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc037070 con 0x7f81ec15e440 2024-04-25T02:11:53.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.961+0000 7f81eaffd640 1 -- 172.21.15.79:0/2771027236 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc032440 con 0x7f81ec15e440 2024-04-25T02:11:53.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.961+0000 7f81eaffd640 1 -- 172.21.15.79:0/2771027236 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc032810 con 0x7f81ec15e440 2024-04-25T02:11:53.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.961+0000 7f81f2570640 1 -- 172.21.15.79:0/2771027236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ec15e440 msgr2=0x7f81ec0cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.961+0000 7f81f2570640 1 --2- 172.21.15.79:0/2771027236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ec15e440 0x7f81ec0cf870 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0097a0 tx=0x7f81dc02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.961+0000 7f81f2570640 1 -- 172.21.15.79:0/2771027236 shutdown_connections 2024-04-25T02:11:53.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.961+0000 7f81f2570640 1 --2- 172.21.15.79:0/2771027236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ec15e440 0x7f81ec0cf870 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.961+0000 7f81f2570640 1 -- 172.21.15.79:0/2771027236 >> 172.21.15.79:0/2771027236 conn(0x7f81ec09d450 msgr2=0x7f81ec0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:53.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.961+0000 7f81f2570640 1 -- 172.21.15.79:0/2771027236 shutdown_connections 2024-04-25T02:11:53.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.961+0000 7f81f2570640 1 -- 172.21.15.79:0/2771027236 wait complete. 2024-04-25T02:11:53.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.962+0000 7f81f2570640 1 Processor -- start 2024-04-25T02:11:53.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.962+0000 7f81f2570640 1 -- start start 2024-04-25T02:11:53.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.963+0000 7f81f2570640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ec0d10a0 0x7f81ec0b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.963+0000 7f81f2570640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81ec0d2f20 0x7f81ec0c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.963+0000 7f81f2570640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81ec15e440 0x7f81ec0ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.963+0000 7f81f2570640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec0cff30 con 0x7f81ec0d10a0 2024-04-25T02:11:53.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.963+0000 7f81f2570640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec0cfdb0 con 0x7f81ec15e440 2024-04-25T02:11:53.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.963+0000 7f81f2570640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f81ec0d00b0 con 0x7f81ec0d2f20 2024-04-25T02:11:53.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.963+0000 7f81ebfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ec0d10a0 0x7f81ec0b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.963+0000 7f81ebfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ec0d10a0 0x7f81ec0b4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59752/0 (socket says 172.21.15.79:59752) 2024-04-25T02:11:53.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.963+0000 7f81ebfff640 1 -- 172.21.15.79:0/3106487758 learned_addr learned my addr 172.21.15.79:0/3106487758 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:53.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.963+0000 7f81eb7fe640 1 --2- 172.21.15.79:0/3106487758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81ec0d2f20 0x7f81ec0c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.963+0000 7f81f0b0d640 1 --2- 172.21.15.79:0/3106487758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81ec15e440 0x7f81ec0ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.964+0000 7f81ebfff640 1 -- 172.21.15.79:0/3106487758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81ec0d2f20 msgr2=0x7f81ec0c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.964+0000 7f81ebfff640 1 --2- 172.21.15.79:0/3106487758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81ec0d2f20 0x7f81ec0c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.964+0000 7f81ebfff640 1 -- 172.21.15.79:0/3106487758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81ec15e440 msgr2=0x7f81ec0ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.964+0000 7f81ebfff640 1 --2- 172.21.15.79:0/3106487758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81ec15e440 0x7f81ec0ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:53.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.964+0000 7f81ebfff640 1 -- 172.21.15.79:0/3106487758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ec0cc7d0 con 0x7f81ec0d10a0 2024-04-25T02:11:53.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.964+0000 7f81f0b0d640 1 --2- 172.21.15.79:0/3106487758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81ec15e440 0x7f81ec0ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.964+0000 7f81ebfff640 1 --2- 172.21.15.79:0/3106487758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ec0d10a0 0x7f81ec0b4410 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0098c0 tx=0x7f81dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.964+0000 7f81e8ff9640 1 -- 172.21.15.79:0/3106487758 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc041070 con 0x7f81ec0d10a0 2024-04-25T02:11:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.964+0000 7f81e8ff9640 1 -- 172.21.15.79:0/3106487758 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc03c930 con 0x7f81ec0d10a0 2024-04-25T02:11:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.964+0000 7f81e8ff9640 1 -- 172.21.15.79:0/3106487758 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc037040 con 0x7f81ec0d10a0 2024-04-25T02:11:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.964+0000 7f81f2570640 1 -- 172.21.15.79:0/3106487758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ec0ccab0 con 0x7f81ec0d10a0 2024-04-25T02:11:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.964+0000 7f81f2570640 1 -- 172.21.15.79:0/3106487758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ec0cd070 con 0x7f81ec0d10a0 2024-04-25T02:11:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.965+0000 7f81f2570640 1 -- 172.21.15.79:0/3106487758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81ec0690a0 con 0x7f81ec0d10a0 2024-04-25T02:11:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.965+0000 7f81e8ff9640 1 -- 172.21.15.79:0/3106487758 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81dc044070 con 0x7f81ec0d10a0 2024-04-25T02:11:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.966+0000 7f81e8ff9640 1 --2- 172.21.15.79:0/3106487758 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f81d806be30 0x7f81d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.966+0000 7f81e8ff9640 1 -- 172.21.15.79:0/3106487758 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 4857+0+0 (secure 0 0 0) 0x7f81dc0ab980 con 0x7f81ec0d10a0 2024-04-25T02:11:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.966+0000 7f81eb7fe640 1 --2- 172.21.15.79:0/3106487758 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f81d806be30 0x7f81d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.966+0000 7f81eb7fe640 1 --2- 172.21.15.79:0/3106487758 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f81d806be30 0x7f81d806e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0b87d0 tx=0x7f81e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:53.970+0000 7f81e8ff9640 1 -- 172.21.15.79:0/3106487758 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f81dc07a780 con 0x7f81ec0d10a0 2024-04-25T02:11:54.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.143+0000 7f81f2570640 1 -- 172.21.15.79:0/3106487758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f81ec15dbd0 con 0x7f81ec0d10a0 2024-04-25T02:11:54.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.592+0000 7f81e8ff9640 1 -- 172.21.15.79:0/3106487758 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v68) ==== 138+0+0 (secure 0 0 0) 0x7f81dc07a080 con 0x7f81ec0d10a0 2024-04-25T02:11:54.600 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.595+0000 7f81f2570640 1 -- 172.21.15.79:0/3106487758 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f81d806be30 msgr2=0x7f81d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.595+0000 7f81f2570640 1 --2- 172.21.15.79:0/3106487758 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f81d806be30 0x7f81d806e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0b87d0 tx=0x7f81e0009040 comp rx=0 tx=0).stop 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.595+0000 7f81f2570640 1 -- 172.21.15.79:0/3106487758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ec0d10a0 msgr2=0x7f81ec0b4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.595+0000 7f81f2570640 1 --2- 172.21.15.79:0/3106487758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ec0d10a0 0x7f81ec0b4410 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0098c0 tx=0x7f81dc0046c0 comp rx=0 tx=0).stop 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.595+0000 7f81f2570640 1 -- 172.21.15.79:0/3106487758 shutdown_connections 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.595+0000 7f81f2570640 1 --2- 172.21.15.79:0/3106487758 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f81d806be30 0x7f81d806e2f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.595+0000 7f81f2570640 1 --2- 172.21.15.79:0/3106487758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81ec15e440 0x7f81ec0ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.595+0000 7f81f2570640 1 --2- 172.21.15.79:0/3106487758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81ec0d2f20 0x7f81ec0c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.595+0000 7f81f2570640 1 --2- 172.21.15.79:0/3106487758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ec0d10a0 0x7f81ec0b4410 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.595+0000 7f81f2570640 1 -- 172.21.15.79:0/3106487758 >> 172.21.15.79:0/3106487758 conn(0x7f81ec09d450 msgr2=0x7f81ec15f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.595+0000 7f81f2570640 1 -- 172.21.15.79:0/3106487758 shutdown_connections 2024-04-25T02:11:54.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.595+0000 7f81f2570640 1 -- 172.21.15.79:0/3106487758 wait complete. 2024-04-25T02:11:54.616 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T02:11:54.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.714+0000 7f0bbb6ee640 1 Processor -- start 2024-04-25T02:11:54.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.714+0000 7f0bbb6ee640 1 -- start start 2024-04-25T02:11:54.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.715+0000 7f0bbb6ee640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f0bb40cf7a0 0x7f0bb40b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.715+0000 7f0bbb6ee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0bb406e6b0 0x7f0bb415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.715+0000 7f0bbb6ee640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bb415ec20 con 0x7f0bb406b2f0 2024-04-25T02:11:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.715+0000 7f0bbb6ee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb415f830 con 0x7f0bb406e6b0 2024-04-25T02:11:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.715+0000 7f0bbb6ee640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb415ef00 con 0x7f0bb40cf7a0 2024-04-25T02:11:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.715+0000 7f0bb9c8b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0bb406e6b0 0x7f0bb415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.715+0000 7f0bb9c8b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0bb406e6b0 0x7f0bb415b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59762/0 (socket says 172.21.15.79:59762) 2024-04-25T02:11:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.715+0000 7f0bb9c8b640 1 -- 172.21.15.79:0/2701080844 learned_addr learned my addr 172.21.15.79:0/2701080844 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.715+0000 7f0bb8c89640 1 --2- 172.21.15.79:0/2701080844 >> v2:172.21.15.189:3300/0 conn(0x7f0bb40cf7a0 0x7f0bb40b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.716+0000 7f0bb9c8b640 1 -- 172.21.15.79:0/2701080844 >> v2:172.21.15.189:3300/0 conn(0x7f0bb40cf7a0 msgr2=0x7f0bb40b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.716+0000 7f0bb9c8b640 1 --2- 172.21.15.79:0/2701080844 >> v2:172.21.15.189:3300/0 conn(0x7f0bb40cf7a0 0x7f0bb40b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.716+0000 7f0bb9c8b640 1 -- 172.21.15.79:0/2701080844 >> v1:172.21.15.189:6789/0 conn(0x7f0bb406b2f0 legacy=0x7f0bb406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.716+0000 7f0bb9c8b640 1 -- 172.21.15.79:0/2701080844 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb415f1e0 con 0x7f0bb406e6b0 2024-04-25T02:11:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.716+0000 7f0bb8c89640 1 --2- 172.21.15.79:0/2701080844 >> v2:172.21.15.189:3300/0 conn(0x7f0bb40cf7a0 0x7f0bb40b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.716+0000 7f0bb9c8b640 1 --2- 172.21.15.79:0/2701080844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb406e6b0 0x7f0bb415b2d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0bb415f9b0 tx=0x7f0bac02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8b3c1aec029447 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.716+0000 7f0babfff640 1 -- 172.21.15.79:0/2701080844 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac032790 con 0x7f0bb406e6b0 2024-04-25T02:11:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.716+0000 7f0babfff640 1 -- 172.21.15.79:0/2701080844 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bac038070 con 0x7f0bb406e6b0 2024-04-25T02:11:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.717+0000 7f0babfff640 1 -- 172.21.15.79:0/2701080844 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac032b50 con 0x7f0bb406e6b0 2024-04-25T02:11:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.717+0000 7f0bbb6ee640 1 -- 172.21.15.79:0/2701080844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb406e6b0 msgr2=0x7f0bb415b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.717+0000 7f0bbb6ee640 1 --2- 172.21.15.79:0/2701080844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb406e6b0 0x7f0bb415b2d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0bb415f9b0 tx=0x7f0bac02c890 comp rx=0 tx=0).stop 2024-04-25T02:11:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.717+0000 7f0bbb6ee640 1 -- 172.21.15.79:0/2701080844 shutdown_connections 2024-04-25T02:11:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.717+0000 7f0bbb6ee640 1 --2- 172.21.15.79:0/2701080844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb406e6b0 0x7f0bb415b2d0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.717+0000 7f0bbb6ee640 1 --2- 172.21.15.79:0/2701080844 >> v2:172.21.15.189:3300/0 conn(0x7f0bb40cf7a0 0x7f0bb40b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.717+0000 7f0bbb6ee640 1 -- 172.21.15.79:0/2701080844 >> 172.21.15.79:0/2701080844 conn(0x7f0bb40b1cd0 msgr2=0x7f0bb40b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.717+0000 7f0bbb6ee640 1 -- 172.21.15.79:0/2701080844 shutdown_connections 2024-04-25T02:11:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.717+0000 7f0bbb6ee640 1 -- 172.21.15.79:0/2701080844 wait complete. 2024-04-25T02:11:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.718+0000 7f0bbb6ee640 1 Processor -- start 2024-04-25T02:11:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.718+0000 7f0bbb6ee640 1 -- start start 2024-04-25T02:11:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bbb6ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb406b2f0 0x7f0bb4071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bbb6ee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bb406e6b0 0x7f0bb41f8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bbb6ee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0bb40cf7a0 0x7f0bb41546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bbb6ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb406d160 con 0x7f0bb406b2f0 2024-04-25T02:11:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bbb6ee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb406cfe0 con 0x7f0bb406e6b0 2024-04-25T02:11:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bbb6ee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb415b810 con 0x7f0bb40cf7a0 2024-04-25T02:11:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bb948a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb406b2f0 0x7f0bb4071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bb948a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb406b2f0 0x7f0bb4071470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59778/0 (socket says 172.21.15.79:59778) 2024-04-25T02:11:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bb948a640 1 -- 172.21.15.79:0/1474266220 learned_addr learned my addr 172.21.15.79:0/1474266220 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bb8c89640 1 --2- 172.21.15.79:0/1474266220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bb406e6b0 0x7f0bb41f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bb9c8b640 1 --2- 172.21.15.79:0/1474266220 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0bb40cf7a0 0x7f0bb41546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bb948a640 1 -- 172.21.15.79:0/1474266220 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0bb40cf7a0 msgr2=0x7f0bb41546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bb948a640 1 --2- 172.21.15.79:0/1474266220 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0bb40cf7a0 0x7f0bb41546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bb948a640 1 -- 172.21.15.79:0/1474266220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bb406e6b0 msgr2=0x7f0bb41f8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bb948a640 1 --2- 172.21.15.79:0/1474266220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bb406e6b0 0x7f0bb41f8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bb948a640 1 -- 172.21.15.79:0/1474266220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb4071b00 con 0x7f0bb406b2f0 2024-04-25T02:11:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.719+0000 7f0bb8c89640 1 --2- 172.21.15.79:0/1474266220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bb406e6b0 0x7f0bb41f8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.720+0000 7f0bb948a640 1 --2- 172.21.15.79:0/1474266220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb406b2f0 0x7f0bb4071470 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000c7c0 tx=0x7f0bb000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.720+0000 7f0ba9ffb640 1 -- 172.21.15.79:0/1474266220 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0016020 con 0x7f0bb406b2f0 2024-04-25T02:11:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.720+0000 7f0ba9ffb640 1 -- 172.21.15.79:0/1474266220 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb0006d50 con 0x7f0bb406b2f0 2024-04-25T02:11:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.720+0000 7f0bbb6ee640 1 -- 172.21.15.79:0/1474266220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb4071de0 con 0x7f0bb406b2f0 2024-04-25T02:11:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.720+0000 7f0ba9ffb640 1 -- 172.21.15.79:0/1474266220 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0003bb0 con 0x7f0bb406b2f0 2024-04-25T02:11:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.720+0000 7f0bbb6ee640 1 -- 172.21.15.79:0/1474266220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb40723a0 con 0x7f0bb406b2f0 2024-04-25T02:11:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.721+0000 7f0bbb6ee640 1 -- 172.21.15.79:0/1474266220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb4068950 con 0x7f0bb406b2f0 2024-04-25T02:11:54.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.721+0000 7f0ba9ffb640 1 -- 172.21.15.79:0/1474266220 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0bb000a850 con 0x7f0bb406b2f0 2024-04-25T02:11:54.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.722+0000 7f0ba9ffb640 1 --2- 172.21.15.79:0/1474266220 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0b9806be30 0x7f0b9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:54.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.722+0000 7f0ba9ffb640 1 -- 172.21.15.79:0/1474266220 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5227+0+0 (secure 0 0 0) 0x7f0bb008a960 con 0x7f0bb406b2f0 2024-04-25T02:11:54.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.722+0000 7f0bb8c89640 1 --2- 172.21.15.79:0/1474266220 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0b9806be30 0x7f0b9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:54.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.722+0000 7f0bb8c89640 1 --2- 172.21.15.79:0/1474266220 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0b9806be30 0x7f0b9806e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0bb415eb10 tx=0x7f0ba4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.726+0000 7f0ba9ffb640 1 -- 172.21.15.79:0/1474266220 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0bb4068950 con 0x7f0bb406b2f0 2024-04-25T02:11:54.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:54.898+0000 7f0bbb6ee640 1 -- 172.21.15.79:0/1474266220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0bb40690a0 con 0x7f0bb406b2f0 2024-04-25T02:11:55.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.597+0000 7f0ba9ffb640 1 -- 172.21.15.79:0/1474266220 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v69) ==== 170+0+0 (secure 0 0 0) 0x7f0bb0020020 con 0x7f0bb406b2f0 2024-04-25T02:11:55.604 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-04-25T02:11:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.600+0000 7f0bbb6ee640 1 -- 172.21.15.79:0/1474266220 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0b9806be30 msgr2=0x7f0b9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.600+0000 7f0bbb6ee640 1 --2- 172.21.15.79:0/1474266220 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0b9806be30 0x7f0b9806e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0bb415eb10 tx=0x7f0ba4008040 comp rx=0 tx=0).stop 2024-04-25T02:11:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.600+0000 7f0bbb6ee640 1 -- 172.21.15.79:0/1474266220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb406b2f0 msgr2=0x7f0bb4071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.600+0000 7f0bbb6ee640 1 --2- 172.21.15.79:0/1474266220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb406b2f0 0x7f0bb4071470 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000c7c0 tx=0x7f0bb000cc80 comp rx=0 tx=0).stop 2024-04-25T02:11:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.600+0000 7f0bbb6ee640 1 -- 172.21.15.79:0/1474266220 shutdown_connections 2024-04-25T02:11:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.600+0000 7f0bbb6ee640 1 --2- 172.21.15.79:0/1474266220 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0b9806be30 0x7f0b9806e2f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.600+0000 7f0bbb6ee640 1 --2- 172.21.15.79:0/1474266220 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0bb40cf7a0 0x7f0bb41546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.600+0000 7f0bbb6ee640 1 --2- 172.21.15.79:0/1474266220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bb406e6b0 0x7f0bb41f8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.600+0000 7f0bbb6ee640 1 --2- 172.21.15.79:0/1474266220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb406b2f0 0x7f0bb4071470 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.600+0000 7f0bbb6ee640 1 -- 172.21.15.79:0/1474266220 >> 172.21.15.79:0/1474266220 conn(0x7f0bb40b1cd0 msgr2=0x7f0bb40b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.600+0000 7f0bbb6ee640 1 -- 172.21.15.79:0/1474266220 shutdown_connections 2024-04-25T02:11:55.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.601+0000 7f0bbb6ee640 1 -- 172.21.15.79:0/1474266220 wait complete. 2024-04-25T02:11:55.630 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T02:11:55.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.723+0000 7f8447cba640 1 Processor -- start 2024-04-25T02:11:55.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.723+0000 7f8447cba640 1 -- start start 2024-04-25T02:11:55.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.724+0000 7f8447cba640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f844015a810 0x7f84400cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.724+0000 7f8447cba640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8440071460 0x7f84400b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.724+0000 7f8447cba640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844015abf0 con 0x7f844009dcb0 2024-04-25T02:11:55.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.724+0000 7f8447cba640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8440073050 con 0x7f844015a810 2024-04-25T02:11:55.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.724+0000 7f8447cba640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f84400cbdd0 con 0x7f8440071460 2024-04-25T02:11:55.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.724+0000 7f8445a56640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f844015a810 0x7f84400cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.724+0000 7f8445255640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f844009dcb0 0x7f8440070d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:32990/0 (socket says 172.21.15.79:32990) 2024-04-25T02:11:55.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.724+0000 7f8445255640 1 -- 172.21.15.79:0/3368883399 learned_addr learned my addr 172.21.15.79:0/3368883399 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:55.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.725+0000 7f8446257640 1 --2- 172.21.15.79:0/3368883399 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8440071460 0x7f84400b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.725+0000 7f8445a56640 1 -- 172.21.15.79:0/3368883399 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8440071460 msgr2=0x7f84400b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:55.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.725+0000 7f8445a56640 1 --2- 172.21.15.79:0/3368883399 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8440071460 0x7f84400b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.725+0000 7f8445a56640 1 -- 172.21.15.79:0/3368883399 >> v1:172.21.15.79:6789/0 conn(0x7f844009dcb0 legacy=0x7f8440070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.725+0000 7f8445a56640 1 -- 172.21.15.79:0/3368883399 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84400ce580 con 0x7f844015a810 2024-04-25T02:11:55.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.725+0000 7f8444a54640 1 -- 172.21.15.79:0/3368883399 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1848988513 0 0) 0x7f844015abf0 con 0x7f844009dcb0 2024-04-25T02:11:55.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.725+0000 7f8446257640 1 --2- 172.21.15.79:0/3368883399 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8440071460 0x7f84400b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:55.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.725+0000 7f8445a56640 1 --2- 172.21.15.79:0/3368883399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844015a810 0x7f84400cc820 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f8438009d90 tx=0x7f843802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f1f7295d6fb04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:55.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.725+0000 7f8444a54640 1 -- 172.21.15.79:0/3368883399 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438031600 con 0x7f844015a810 2024-04-25T02:11:55.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.725+0000 7f8444a54640 1 -- 172.21.15.79:0/3368883399 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84380317a0 con 0x7f844015a810 2024-04-25T02:11:55.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.725+0000 7f8444a54640 1 -- 172.21.15.79:0/3368883399 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438031b70 con 0x7f844015a810 2024-04-25T02:11:55.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.726+0000 7f8447cba640 1 -- 172.21.15.79:0/3368883399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844015a810 msgr2=0x7f84400cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.726+0000 7f8447cba640 1 --2- 172.21.15.79:0/3368883399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844015a810 0x7f84400cc820 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f8438009d90 tx=0x7f843802a5d0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.726+0000 7f8447cba640 1 -- 172.21.15.79:0/3368883399 shutdown_connections 2024-04-25T02:11:55.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.726+0000 7f8447cba640 1 --2- 172.21.15.79:0/3368883399 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8440071460 0x7f84400b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.726+0000 7f8447cba640 1 --2- 172.21.15.79:0/3368883399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844015a810 0x7f84400cc820 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.726+0000 7f8447cba640 1 -- 172.21.15.79:0/3368883399 >> 172.21.15.79:0/3368883399 conn(0x7f84400b1cd0 msgr2=0x7f84400b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:55.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.726+0000 7f8447cba640 1 -- 172.21.15.79:0/3368883399 shutdown_connections 2024-04-25T02:11:55.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.726+0000 7f8447cba640 1 -- 172.21.15.79:0/3368883399 wait complete. 2024-04-25T02:11:55.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.727+0000 7f8447cba640 1 Processor -- start 2024-04-25T02:11:55.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.727+0000 7f8447cba640 1 -- start start 2024-04-25T02:11:55.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8447cba640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f844009dcb0 0x7f844006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8447cba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844015a810 0x7f844009d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8447cba640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f844009d5b0 0x7f844015e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8447cba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84400cc020 con 0x7f844015a810 2024-04-25T02:11:55.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8447cba640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f84400ceb40 con 0x7f844009d5b0 2024-04-25T02:11:55.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8447cba640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f84400cc300 con 0x7f844009dcb0 2024-04-25T02:11:55.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8445255640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844015a810 0x7f844009d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8445255640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844015a810 0x7f844009d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59798/0 (socket says 172.21.15.79:59798) 2024-04-25T02:11:55.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8445255640 1 -- 172.21.15.79:0/2397606207 learned_addr learned my addr 172.21.15.79:0/2397606207 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:55.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8446257640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f844009d5b0 0x7f844015e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8445a56640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f844009dcb0 0x7f844006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8445255640 1 -- 172.21.15.79:0/2397606207 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f844009dcb0 msgr2=0x7f844006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8445255640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f844009dcb0 0x7f844006cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8445255640 1 -- 172.21.15.79:0/2397606207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f844009d5b0 msgr2=0x7f844015e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8445255640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f844009d5b0 0x7f844015e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8445255640 1 -- 172.21.15.79:0/2397606207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8440144110 con 0x7f844015a810 2024-04-25T02:11:55.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8446257640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f844009d5b0 0x7f844015e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:55.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8445a56640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f844009dcb0 0x7f844006cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:55.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f8445255640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844015a810 0x7f844009d070 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f843000c4b0 tx=0x7f843000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:55.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.728+0000 7f84367fc640 1 -- 172.21.15.79:0/2397606207 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8430018070 con 0x7f844015a810 2024-04-25T02:11:55.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.729+0000 7f84367fc640 1 -- 172.21.15.79:0/2397606207 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8430007500 con 0x7f844015a810 2024-04-25T02:11:55.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.729+0000 7f8447cba640 1 -- 172.21.15.79:0/2397606207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84400c9a60 con 0x7f844015a810 2024-04-25T02:11:55.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.729+0000 7f84367fc640 1 -- 172.21.15.79:0/2397606207 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8430004a20 con 0x7f844015a810 2024-04-25T02:11:55.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.729+0000 7f8447cba640 1 -- 172.21.15.79:0/2397606207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84400ca020 con 0x7f844015a810 2024-04-25T02:11:55.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.729+0000 7f8447cba640 1 -- 172.21.15.79:0/2397606207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84400690a0 con 0x7f844015a810 2024-04-25T02:11:55.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.730+0000 7f84367fc640 1 -- 172.21.15.79:0/2397606207 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f843001b070 con 0x7f844015a810 2024-04-25T02:11:55.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.730+0000 7f84367fc640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f842406be30 0x7f842406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.731+0000 7f8445a56640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f842406be30 0x7f842406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.731+0000 7f84367fc640 1 -- 172.21.15.79:0/2397606207 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5609+0+0 (secure 0 0 0) 0x7f843008a160 con 0x7f844015a810 2024-04-25T02:11:55.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.731+0000 7f8445a56640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f842406be30 0x7f842406e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8438034000 tx=0x7f843802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:55.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.735+0000 7f84367fc640 1 -- 172.21.15.79:0/2397606207 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8430058c30 con 0x7f844015a810 2024-04-25T02:11:55.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:55.950+0000 7f8447cba640 1 -- 172.21.15.79:0/2397606207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f844006e710 con 0x7f844015a810 2024-04-25T02:11:56.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.609+0000 7f84367fc640 1 -- 172.21.15.79:0/2397606207 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v30) ==== 174+0+0 (secure 0 0 0) 0x7f8430058530 con 0x7f844015a810 2024-04-25T02:11:56.617 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 10 and data pool 11 2024-04-25T02:11:56.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.613+0000 7f8447cba640 1 -- 172.21.15.79:0/2397606207 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f842406be30 msgr2=0x7f842406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.613+0000 7f8447cba640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f842406be30 0x7f842406e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8438034000 tx=0x7f843802f000 comp rx=0 tx=0).stop 2024-04-25T02:11:56.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.613+0000 7f8447cba640 1 -- 172.21.15.79:0/2397606207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844015a810 msgr2=0x7f844009d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.613+0000 7f8447cba640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844015a810 0x7f844009d070 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f843000c4b0 tx=0x7f843000c970 comp rx=0 tx=0).stop 2024-04-25T02:11:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.614+0000 7f8447cba640 1 -- 172.21.15.79:0/2397606207 shutdown_connections 2024-04-25T02:11:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.614+0000 7f8447cba640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f842406be30 0x7f842406e2f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.614+0000 7f8447cba640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f844009d5b0 0x7f844015e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.614+0000 7f8447cba640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844015a810 0x7f844009d070 secure :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f843000c4b0 tx=0x7f843000c970 comp rx=0 tx=0).stop 2024-04-25T02:11:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.614+0000 7f8447cba640 1 --2- 172.21.15.79:0/2397606207 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f844009dcb0 0x7f844006cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.614+0000 7f8447cba640 1 -- 172.21.15.79:0/2397606207 >> 172.21.15.79:0/2397606207 conn(0x7f84400b1cd0 msgr2=0x7f84400ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.614+0000 7f8447cba640 1 -- 172.21.15.79:0/2397606207 shutdown_connections 2024-04-25T02:11:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.614+0000 7f8447cba640 1 -- 172.21.15.79:0/2397606207 wait complete. 2024-04-25T02:11:56.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:11:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.734+0000 7fe3c029a640 1 Processor -- start 2024-04-25T02:11:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.734+0000 7fe3c029a640 1 -- start start 2024-04-25T02:11:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3c029a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3b815a720 0x7fe3b815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3c029a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b815f1c0 con 0x7fe3b80b49b0 2024-04-25T02:11:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3c029a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b815bb10 con 0x7fe3b80d07a0 2024-04-25T02:11:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3c029a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe3b80b2e60 con 0x7fe3b815a720 2024-04-25T02:11:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3be837640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe3b80b49b0 0x7fe3b8070cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33006/0 (socket says 172.21.15.79:33006) 2024-04-25T02:11:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3be837640 1 -- 172.21.15.79:0/2108463746 learned_addr learned my addr 172.21.15.79:0/2108463746 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3be036640 1 --2- 172.21.15.79:0/2108463746 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3b815a720 0x7fe3b815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3bd034640 1 -- 172.21.15.79:0/2108463746 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156360216 0 0) 0x7fe3b0001490 con 0x7fe3b80b49b0 2024-04-25T02:11:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3bd034640 1 -- 172.21.15.79:0/2108463746 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a4003520 con 0x7fe3b80b49b0 2024-04-25T02:11:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3bd034640 1 -- 172.21.15.79:0/2108463746 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3167403193 0 0) 0x7fe3a4003520 con 0x7fe3b80b49b0 2024-04-25T02:11:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3bd034640 1 -- 172.21.15.79:0/2108463746 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3b815a720 msgr2=0x7fe3b815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3bd034640 1 --2- 172.21.15.79:0/2108463746 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3b815a720 0x7fe3b815ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3bd034640 1 -- 172.21.15.79:0/2108463746 >> v1:172.21.15.189:6789/0 conn(0x7fe3b80d07a0 legacy=0x7fe3b80b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3bd034640 1 -- 172.21.15.79:0/2108463746 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b80b3140 con 0x7fe3b80b49b0 2024-04-25T02:11:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3bd034640 1 -- 172.21.15.79:0/2108463746 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fe3b0001bc0 con 0x7fe3b80b49b0 2024-04-25T02:11:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3bd034640 1 -- 172.21.15.79:0/2108463746 >> v1:172.21.15.79:6789/0 conn(0x7fe3b80b49b0 legacy=0x7fe3b8070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3bd034640 1 --2- 172.21.15.79:0/2108463746 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3b815a720 0x7fe3a40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3bd034640 1 --2- 172.21.15.79:0/2108463746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a4003f20 0x7fe3a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3bd034640 1 --2- 172.21.15.79:0/2108463746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a4004d40 0x7fe3a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3bd034640 1 -- 172.21.15.79:0/2108463746 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b80b2e60 con 0x7fe3a4004d40 2024-04-25T02:11:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3bd034640 1 -- 172.21.15.79:0/2108463746 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a400cbe0 con 0x7fe3a4003f20 2024-04-25T02:11:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.735+0000 7fe3bd034640 1 -- 172.21.15.79:0/2108463746 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a4007a20 con 0x7fe3b815a720 2024-04-25T02:11:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.736+0000 7fe3be837640 1 --2- 172.21.15.79:0/2108463746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a4004d40 0x7fe3a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.736+0000 7fe3bd835640 1 --2- 172.21.15.79:0/2108463746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a4003f20 0x7fe3a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.736+0000 7fe3be036640 1 --2- 172.21.15.79:0/2108463746 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3b815a720 0x7fe3a40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.736+0000 7fe3be837640 1 -- 172.21.15.79:0/2108463746 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3b815a720 msgr2=0x7fe3a40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.736+0000 7fe3be837640 1 --2- 172.21.15.79:0/2108463746 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3b815a720 0x7fe3a40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.736+0000 7fe3be837640 1 -- 172.21.15.79:0/2108463746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a4003f20 msgr2=0x7fe3a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.736+0000 7fe3be837640 1 --2- 172.21.15.79:0/2108463746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a4003f20 0x7fe3a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.736+0000 7fe3be837640 1 -- 172.21.15.79:0/2108463746 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a4003520 con 0x7fe3a4004d40 2024-04-25T02:11:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.736+0000 7fe3be837640 1 --2- 172.21.15.79:0/2108463746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a4004d40 0x7fe3a40051c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fe3b000aa20 tx=0x7fe3a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823152f3dfb6e5f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.737+0000 7fe3bd034640 1 -- 172.21.15.79:0/2108463746 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b000a670 con 0x7fe3a4004d40 2024-04-25T02:11:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.737+0000 7fe3bd034640 1 -- 172.21.15.79:0/2108463746 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b002f070 con 0x7fe3a4004d40 2024-04-25T02:11:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.737+0000 7fe3bd034640 1 -- 172.21.15.79:0/2108463746 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0034470 con 0x7fe3a4004d40 2024-04-25T02:11:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.737+0000 7fe3c029a640 1 -- 172.21.15.79:0/2108463746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a4004d40 msgr2=0x7fe3a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.737+0000 7fe3c029a640 1 --2- 172.21.15.79:0/2108463746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a4004d40 0x7fe3a40051c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fe3b000aa20 tx=0x7fe3a4005830 comp rx=0 tx=0).stop 2024-04-25T02:11:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.737+0000 7fe3be837640 1 -- 172.21.15.79:0/2108463746 reap_dead start 2024-04-25T02:11:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.737+0000 7fe3c029a640 1 -- 172.21.15.79:0/2108463746 shutdown_connections 2024-04-25T02:11:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.737+0000 7fe3c029a640 1 -- 172.21.15.79:0/2108463746 >> 172.21.15.79:0/2108463746 conn(0x7fe3b80cfc80 msgr2=0x7fe3b80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.737+0000 7fe3c029a640 1 -- 172.21.15.79:0/2108463746 shutdown_connections 2024-04-25T02:11:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.737+0000 7fe3c029a640 1 -- 172.21.15.79:0/2108463746 wait complete. 2024-04-25T02:11:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.738+0000 7fe3c029a640 1 Processor -- start 2024-04-25T02:11:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.738+0000 7fe3c029a640 1 -- start start 2024-04-25T02:11:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3c029a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a4004d40 0x7fe3b8151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3c029a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3b813d000 0x7fe3b80ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3c029a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3b813f860 0x7fe3b813fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3c029a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b80b39e0 con 0x7fe3a4004d40 2024-04-25T02:11:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3c029a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b80b3700 con 0x7fe3b813d000 2024-04-25T02:11:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3c029a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe3b815ec80 con 0x7fe3b813f860 2024-04-25T02:11:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3be036640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a4004d40 0x7fe3b8151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3be036640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a4004d40 0x7fe3b8151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59816/0 (socket says 172.21.15.79:59816) 2024-04-25T02:11:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3be036640 1 -- 172.21.15.79:0/3862886862 learned_addr learned my addr 172.21.15.79:0/3862886862 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3be837640 1 --2- 172.21.15.79:0/3862886862 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3b813f860 0x7fe3b813fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3be036640 1 -- 172.21.15.79:0/3862886862 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3b813f860 msgr2=0x7fe3b813fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3be036640 1 --2- 172.21.15.79:0/3862886862 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3b813f860 0x7fe3b813fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3be036640 1 -- 172.21.15.79:0/3862886862 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3b813d000 msgr2=0x7fe3b80ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3bd835640 1 --2- 172.21.15.79:0/3862886862 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3b813d000 0x7fe3b80ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3be036640 1 --2- 172.21.15.79:0/3862886862 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3b813d000 0x7fe3b80ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.739+0000 7fe3be036640 1 -- 172.21.15.79:0/3862886862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b80cd3b0 con 0x7fe3a4004d40 2024-04-25T02:11:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.740+0000 7fe3be036640 1 --2- 172.21.15.79:0/3862886862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a4004d40 0x7fe3b8151750 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40119a0 tx=0x7fe3b4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.740+0000 7fe3aeffd640 1 -- 172.21.15.79:0/3862886862 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400faf0 con 0x7fe3a4004d40 2024-04-25T02:11:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.740+0000 7fe3aeffd640 1 -- 172.21.15.79:0/3862886862 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b400fc90 con 0x7fe3a4004d40 2024-04-25T02:11:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.740+0000 7fe3c029a640 1 -- 172.21.15.79:0/3862886862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b80cd690 con 0x7fe3a4004d40 2024-04-25T02:11:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.740+0000 7fe3aeffd640 1 -- 172.21.15.79:0/3862886862 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4014440 con 0x7fe3a4004d40 2024-04-25T02:11:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.740+0000 7fe3c029a640 1 -- 172.21.15.79:0/3862886862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b80cdc50 con 0x7fe3a4004d40 2024-04-25T02:11:56.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.741+0000 7fe3c029a640 1 -- 172.21.15.79:0/3862886862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b80690a0 con 0x7fe3a4004d40 2024-04-25T02:11:56.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.741+0000 7fe3aeffd640 1 -- 172.21.15.79:0/3862886862 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe3b4012040 con 0x7fe3a4004d40 2024-04-25T02:11:56.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.742+0000 7fe3aeffd640 1 --2- 172.21.15.79:0/3862886862 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe39c06be80 0x7fe39c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:56.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.742+0000 7fe3bd835640 1 --2- 172.21.15.79:0/3862886862 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe39c06be80 0x7fe39c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:56.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.742+0000 7fe3aeffd640 1 -- 172.21.15.79:0/3862886862 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7fe3b408b4a0 con 0x7fe3a4004d40 2024-04-25T02:11:56.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.742+0000 7fe3bd835640 1 --2- 172.21.15.79:0/3862886862 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe39c06be80 0x7fe39c06e340 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe3b814e9a0 tx=0x7fe3a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:56.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.746+0000 7fe3aeffd640 1 -- 172.21.15.79:0/3862886862 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe3b4019030 con 0x7fe3a4004d40 2024-04-25T02:11:56.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.921+0000 7fe3c029a640 1 -- 172.21.15.79:0/3862886862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3b80cf850 con 0x7fe3a4004d40 2024-04-25T02:11:56.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.922+0000 7fe3aeffd640 1 -- 172.21.15.79:0/3862886862 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+16693 (secure 0 0 0) 0x7fe3b4059f30 con 0x7fe3a4004d40 2024-04-25T02:11:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:56.930 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":70,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:11:55.951398+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:11:54.161817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T02:11:54.917049+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:11:56.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.924+0000 7fe3c029a640 1 -- 172.21.15.79:0/3862886862 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe39c06be80 msgr2=0x7fe39c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.924+0000 7fe3c029a640 1 --2- 172.21.15.79:0/3862886862 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe39c06be80 0x7fe39c06e340 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe3b814e9a0 tx=0x7fe3a8009040 comp rx=0 tx=0).stop 2024-04-25T02:11:56.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.924+0000 7fe3c029a640 1 -- 172.21.15.79:0/3862886862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a4004d40 msgr2=0x7fe3b8151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.924+0000 7fe3c029a640 1 --2- 172.21.15.79:0/3862886862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a4004d40 0x7fe3b8151750 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40119a0 tx=0x7fe3b4011e60 comp rx=0 tx=0).stop 2024-04-25T02:11:56.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.924+0000 7fe3c029a640 1 -- 172.21.15.79:0/3862886862 shutdown_connections 2024-04-25T02:11:56.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.924+0000 7fe3c029a640 1 --2- 172.21.15.79:0/3862886862 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe39c06be80 0x7fe39c06e340 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.924+0000 7fe3c029a640 1 --2- 172.21.15.79:0/3862886862 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3b813f860 0x7fe3b813fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.924+0000 7fe3c029a640 1 --2- 172.21.15.79:0/3862886862 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3b813d000 0x7fe3b80ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.924+0000 7fe3c029a640 1 --2- 172.21.15.79:0/3862886862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a4004d40 0x7fe3b8151750 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.924+0000 7fe3c029a640 1 -- 172.21.15.79:0/3862886862 >> 172.21.15.79:0/3862886862 conn(0x7fe3b80cfc80 msgr2=0x7fe3b80b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:56.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.924+0000 7fe3c029a640 1 -- 172.21.15.79:0/3862886862 shutdown_connections 2024-04-25T02:11:56.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:56.924+0000 7fe3c029a640 1 -- 172.21.15.79:0/3862886862 wait complete. 2024-04-25T02:11:56.943 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:11:57.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.031+0000 7fb858fc1640 1 Processor -- start 2024-04-25T02:11:57.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.031+0000 7fb858fc1640 1 -- start start 2024-04-25T02:11:57.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.032+0000 7fb858fc1640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb8540d07a0 0x7fb8540b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.032+0000 7fb858fc1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb85415bb10 con 0x7fb8540b47e0 2024-04-25T02:11:57.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.032+0000 7fb858fc1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8540b2e60 con 0x7fb85415a720 2024-04-25T02:11:57.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.032+0000 7fb858fc1640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb8540b4c30 con 0x7fb8540d07a0 2024-04-25T02:11:57.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb852d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb8540b47e0 0x7fb854070cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33014/0 (socket says 172.21.15.79:33014) 2024-04-25T02:11:57.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb852d9d640 1 -- 172.21.15.79:0/1302824458 learned_addr learned my addr 172.21.15.79:0/1302824458 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:57.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85159a640 1 -- 172.21.15.79:0/1302824458 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4161763136 0 0) 0x7fb85415bb10 con 0x7fb8540b47e0 2024-04-25T02:11:57.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85159a640 1 -- 172.21.15.79:0/1302824458 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb83c003520 con 0x7fb8540b47e0 2024-04-25T02:11:57.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb851d9b640 1 --2- 172.21.15.79:0/1302824458 >> v2:172.21.15.189:3300/0 conn(0x7fb8540d07a0 0x7fb8540b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85159a640 1 -- 172.21.15.79:0/1302824458 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1946902710 0 0) 0x7fb83c003520 con 0x7fb8540b47e0 2024-04-25T02:11:57.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85159a640 1 -- 172.21.15.79:0/1302824458 >> v2:172.21.15.189:3300/0 conn(0x7fb8540d07a0 msgr2=0x7fb8540b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:57.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85159a640 1 --2- 172.21.15.79:0/1302824458 >> v2:172.21.15.189:3300/0 conn(0x7fb8540d07a0 0x7fb8540b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85159a640 1 -- 172.21.15.79:0/1302824458 >> v1:172.21.15.189:6789/0 conn(0x7fb85415a720 legacy=0x7fb85415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:57.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85159a640 1 -- 172.21.15.79:0/1302824458 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8540b3140 con 0x7fb8540b47e0 2024-04-25T02:11:57.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85159a640 1 -- 172.21.15.79:0/1302824458 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fb84c0019f0 con 0x7fb8540b47e0 2024-04-25T02:11:57.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85159a640 1 -- 172.21.15.79:0/1302824458 >> v1:172.21.15.79:6789/0 conn(0x7fb8540b47e0 legacy=0x7fb854070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85159a640 1 --2- 172.21.15.79:0/1302824458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb83c0039b0 0x7fb83c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85159a640 1 --2- 172.21.15.79:0/1302824458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb83c004800 0x7fb83c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85159a640 1 --2- 172.21.15.79:0/1302824458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83c0052e0 0x7fb83c00cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85159a640 1 -- 172.21.15.79:0/1302824458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb8540b4c30 con 0x7fb83c0052e0 2024-04-25T02:11:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85159a640 1 -- 172.21.15.79:0/1302824458 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c00d2a0 con 0x7fb83c004800 2024-04-25T02:11:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85159a640 1 -- 172.21.15.79:0/1302824458 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb83c005a10 con 0x7fb83c0039b0 2024-04-25T02:11:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb852d9d640 1 --2- 172.21.15.79:0/1302824458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83c0052e0 0x7fb83c00cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb85259c640 1 --2- 172.21.15.79:0/1302824458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb83c0039b0 0x7fb83c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.033+0000 7fb851d9b640 1 --2- 172.21.15.79:0/1302824458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb83c004800 0x7fb83c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.034+0000 7fb852d9d640 1 -- 172.21.15.79:0/1302824458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb83c0039b0 msgr2=0x7fb83c003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.034+0000 7fb852d9d640 1 --2- 172.21.15.79:0/1302824458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb83c0039b0 0x7fb83c003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.034+0000 7fb852d9d640 1 -- 172.21.15.79:0/1302824458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb83c004800 msgr2=0x7fb83c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.034+0000 7fb852d9d640 1 --2- 172.21.15.79:0/1302824458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb83c004800 0x7fb83c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.034+0000 7fb852d9d640 1 -- 172.21.15.79:0/1302824458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83c003520 con 0x7fb83c0052e0 2024-04-25T02:11:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.034+0000 7fb85259c640 1 --2- 172.21.15.79:0/1302824458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb83c0039b0 0x7fb83c003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.034+0000 7fb852d9d640 1 -- 172.21.15.79:0/1302824458 reap_dead start 2024-04-25T02:11:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.034+0000 7fb852d9d640 1 --2- 172.21.15.79:0/1302824458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83c0052e0 0x7fb83c00cad0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00a8f0 tx=0x7fb83c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba2e71179567636 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.034+0000 7fb85159a640 1 -- 172.21.15.79:0/1302824458 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00a4c0 con 0x7fb83c0052e0 2024-04-25T02:11:57.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.034+0000 7fb85159a640 1 -- 172.21.15.79:0/1302824458 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84c02f070 con 0x7fb83c0052e0 2024-04-25T02:11:57.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.034+0000 7fb85159a640 1 -- 172.21.15.79:0/1302824458 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c02bcb0 con 0x7fb83c0052e0 2024-04-25T02:11:57.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.035+0000 7fb858fc1640 1 -- 172.21.15.79:0/1302824458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83c0052e0 msgr2=0x7fb83c00cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.035+0000 7fb858fc1640 1 --2- 172.21.15.79:0/1302824458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83c0052e0 0x7fb83c00cad0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00a8f0 tx=0x7fb83c005830 comp rx=0 tx=0).stop 2024-04-25T02:11:57.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.035+0000 7fb858fc1640 1 -- 172.21.15.79:0/1302824458 shutdown_connections 2024-04-25T02:11:57.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.035+0000 7fb858fc1640 1 --2- 172.21.15.79:0/1302824458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83c0052e0 0x7fb83c00cad0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.035+0000 7fb858fc1640 1 -- 172.21.15.79:0/1302824458 >> 172.21.15.79:0/1302824458 conn(0x7fb8540cfc80 msgr2=0x7fb8540d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:57.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.035+0000 7fb858fc1640 1 -- 172.21.15.79:0/1302824458 shutdown_connections 2024-04-25T02:11:57.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.035+0000 7fb858fc1640 1 -- 172.21.15.79:0/1302824458 wait complete. 2024-04-25T02:11:57.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.036+0000 7fb858fc1640 1 Processor -- start 2024-04-25T02:11:57.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.036+0000 7fb858fc1640 1 -- start start 2024-04-25T02:11:57.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb858fc1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83c0052e0 0x7fb85414d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb858fc1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8540716e0 0x7fb854071b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb858fc1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8540cdbb0 0x7fb8540ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb858fc1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb8540b39e0 con 0x7fb83c0052e0 2024-04-25T02:11:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb858fc1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8540b3700 con 0x7fb8540cdbb0 2024-04-25T02:11:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb858fc1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb8540b42a0 con 0x7fb8540716e0 2024-04-25T02:11:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb85259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83c0052e0 0x7fb85414d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb85259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83c0052e0 0x7fb85414d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59824/0 (socket says 172.21.15.79:59824) 2024-04-25T02:11:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb85259c640 1 -- 172.21.15.79:0/2697523389 learned_addr learned my addr 172.21.15.79:0/2697523389 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb852d9d640 1 --2- 172.21.15.79:0/2697523389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8540cdbb0 0x7fb8540ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb851d9b640 1 --2- 172.21.15.79:0/2697523389 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8540716e0 0x7fb854071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb85259c640 1 -- 172.21.15.79:0/2697523389 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8540716e0 msgr2=0x7fb854071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb85259c640 1 --2- 172.21.15.79:0/2697523389 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8540716e0 0x7fb854071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb85259c640 1 -- 172.21.15.79:0/2697523389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8540cdbb0 msgr2=0x7fb8540ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb85259c640 1 --2- 172.21.15.79:0/2697523389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8540cdbb0 0x7fb8540ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb85259c640 1 -- 172.21.15.79:0/2697523389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85414dcc0 con 0x7fb83c0052e0 2024-04-25T02:11:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.037+0000 7fb851d9b640 1 --2- 172.21.15.79:0/2697523389 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8540716e0 0x7fb854071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.038+0000 7fb85259c640 1 --2- 172.21.15.79:0/2697523389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83c0052e0 0x7fb85414d780 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb84800e4c0 tx=0x7fb84800e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.038+0000 7fb842ffd640 1 -- 172.21.15.79:0/2697523389 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848007020 con 0x7fb83c0052e0 2024-04-25T02:11:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.038+0000 7fb842ffd640 1 -- 172.21.15.79:0/2697523389 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8480071c0 con 0x7fb83c0052e0 2024-04-25T02:11:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.038+0000 7fb858fc1640 1 -- 172.21.15.79:0/2697523389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb854072160 con 0x7fb83c0052e0 2024-04-25T02:11:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.038+0000 7fb842ffd640 1 -- 172.21.15.79:0/2697523389 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480073b0 con 0x7fb83c0052e0 2024-04-25T02:11:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.038+0000 7fb858fc1640 1 -- 172.21.15.79:0/2697523389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb854072720 con 0x7fb83c0052e0 2024-04-25T02:11:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.039+0000 7fb858fc1640 1 -- 172.21.15.79:0/2697523389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8540ce570 con 0x7fb83c0052e0 2024-04-25T02:11:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.039+0000 7fb842ffd640 1 -- 172.21.15.79:0/2697523389 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb84801c020 con 0x7fb83c0052e0 2024-04-25T02:11:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.040+0000 7fb842ffd640 1 --2- 172.21.15.79:0/2697523389 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb83406be60 0x7fb83406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.040+0000 7fb851d9b640 1 --2- 172.21.15.79:0/2697523389 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb83406be60 0x7fb83406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.040+0000 7fb842ffd640 1 -- 172.21.15.79:0/2697523389 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7fb84808a9f0 con 0x7fb83c0052e0 2024-04-25T02:11:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.040+0000 7fb851d9b640 1 --2- 172.21.15.79:0/2697523389 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb83406be60 0x7fb83406e320 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb8540ca670 tx=0x7fb844008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.044+0000 7fb842ffd640 1 -- 172.21.15.79:0/2697523389 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb8480593a0 con 0x7fb83c0052e0 2024-04-25T02:11:57.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.219+0000 7fb858fc1640 1 -- 172.21.15.79:0/2697523389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb85406d0c0 con 0x7fb83c0052e0 2024-04-25T02:11:57.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.220+0000 7fb842ffd640 1 -- 172.21.15.79:0/2697523389 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+16693 (secure 0 0 0) 0x7fb848058ca0 con 0x7fb83c0052e0 2024-04-25T02:11:57.227 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:57.227 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":70,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:11:55.951398+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:11:54.161817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T02:11:54.917049+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:11:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.222+0000 7fb858fc1640 1 -- 172.21.15.79:0/2697523389 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb83406be60 msgr2=0x7fb83406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.222+0000 7fb858fc1640 1 --2- 172.21.15.79:0/2697523389 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb83406be60 0x7fb83406e320 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb8540ca670 tx=0x7fb844008040 comp rx=0 tx=0).stop 2024-04-25T02:11:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.222+0000 7fb858fc1640 1 -- 172.21.15.79:0/2697523389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83c0052e0 msgr2=0x7fb85414d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.222+0000 7fb858fc1640 1 --2- 172.21.15.79:0/2697523389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83c0052e0 0x7fb85414d780 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb84800e4c0 tx=0x7fb84800e980 comp rx=0 tx=0).stop 2024-04-25T02:11:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.222+0000 7fb858fc1640 1 -- 172.21.15.79:0/2697523389 shutdown_connections 2024-04-25T02:11:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.222+0000 7fb858fc1640 1 --2- 172.21.15.79:0/2697523389 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb83406be60 0x7fb83406e320 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.222+0000 7fb858fc1640 1 --2- 172.21.15.79:0/2697523389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8540cdbb0 0x7fb8540ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.222+0000 7fb858fc1640 1 --2- 172.21.15.79:0/2697523389 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8540716e0 0x7fb854071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.222+0000 7fb858fc1640 1 --2- 172.21.15.79:0/2697523389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83c0052e0 0x7fb85414d780 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.222+0000 7fb858fc1640 1 -- 172.21.15.79:0/2697523389 >> 172.21.15.79:0/2697523389 conn(0x7fb8540cfc80 msgr2=0x7fb8540d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.222+0000 7fb858fc1640 1 -- 172.21.15.79:0/2697523389 shutdown_connections 2024-04-25T02:11:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.222+0000 7fb858fc1640 1 -- 172.21.15.79:0/2697523389 wait complete. 2024-04-25T02:11:57.240 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T02:11:57.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.333+0000 7f5388ccd640 1 Processor -- start 2024-04-25T02:11:57.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.333+0000 7f5388ccd640 1 -- start start 2024-04-25T02:11:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f5388ccd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f538406fe20 0x7f538415e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f5388ccd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53840b0320 0x7f5384070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f5388ccd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f538406dc90 0x7f53840ae370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f5388ccd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5384070740 con 0x7f538406dc90 2024-04-25T02:11:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f5388ccd640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f538415ed80 con 0x7f538406fe20 2024-04-25T02:11:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f5388ccd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f538415f060 con 0x7f53840b0320 2024-04-25T02:11:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f5382d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f538406dc90 0x7f53840ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f5382d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f538406dc90 0x7f53840ae370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59832/0 (socket says 172.21.15.79:59832) 2024-04-25T02:11:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f5382d9d640 1 -- 172.21.15.79:0/3587557 learned_addr learned my addr 172.21.15.79:0/3587557 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f5381d9b640 1 --2- 172.21.15.79:0/3587557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53840b0320 0x7f5384070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f538259c640 1 --2- 172.21.15.79:0/3587557 >> v2:172.21.15.189:3300/0 conn(0x7f538406fe20 0x7f538415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f5382d9d640 1 -- 172.21.15.79:0/3587557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53840b0320 msgr2=0x7f5384070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f5382d9d640 1 --2- 172.21.15.79:0/3587557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53840b0320 0x7f5384070200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f5382d9d640 1 -- 172.21.15.79:0/3587557 >> v2:172.21.15.189:3300/0 conn(0x7f538406fe20 msgr2=0x7f538415e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f5382d9d640 1 --2- 172.21.15.79:0/3587557 >> v2:172.21.15.189:3300/0 conn(0x7f538406fe20 0x7f538415e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f5382d9d640 1 -- 172.21.15.79:0/3587557 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538415f340 con 0x7f538406dc90 2024-04-25T02:11:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.334+0000 7f538259c640 1 --2- 172.21.15.79:0/3587557 >> v2:172.21.15.189:3300/0 conn(0x7f538406fe20 0x7f538415e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.335+0000 7f5382d9d640 1 --2- 172.21.15.79:0/3587557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538406dc90 0x7f53840ae370 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f538409f0c0 tx=0x7f537c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c013a82794c7212 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.335+0000 7f538159a640 1 -- 172.21.15.79:0/3587557 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c036070 con 0x7f538406dc90 2024-04-25T02:11:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.335+0000 7f538159a640 1 -- 172.21.15.79:0/3587557 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f537c031600 con 0x7f538406dc90 2024-04-25T02:11:57.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.335+0000 7f538159a640 1 -- 172.21.15.79:0/3587557 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c0319d0 con 0x7f538406dc90 2024-04-25T02:11:57.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.336+0000 7f5388ccd640 1 -- 172.21.15.79:0/3587557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538406dc90 msgr2=0x7f53840ae370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.336+0000 7f5388ccd640 1 --2- 172.21.15.79:0/3587557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538406dc90 0x7f53840ae370 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f538409f0c0 tx=0x7f537c02a6a0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.336+0000 7f5388ccd640 1 -- 172.21.15.79:0/3587557 shutdown_connections 2024-04-25T02:11:57.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.336+0000 7f5388ccd640 1 --2- 172.21.15.79:0/3587557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538406dc90 0x7f53840ae370 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.336+0000 7f5388ccd640 1 --2- 172.21.15.79:0/3587557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53840b0320 0x7f5384070200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.336+0000 7f5388ccd640 1 --2- 172.21.15.79:0/3587557 >> v2:172.21.15.189:3300/0 conn(0x7f538406fe20 0x7f538415e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.336+0000 7f5388ccd640 1 -- 172.21.15.79:0/3587557 >> 172.21.15.79:0/3587557 conn(0x7f53840d0e00 msgr2=0x7f53840d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:57.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.336+0000 7f5388ccd640 1 -- 172.21.15.79:0/3587557 shutdown_connections 2024-04-25T02:11:57.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.336+0000 7f5388ccd640 1 -- 172.21.15.79:0/3587557 wait complete. 2024-04-25T02:11:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.337+0000 7f5388ccd640 1 Processor -- start 2024-04-25T02:11:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.337+0000 7f5388ccd640 1 -- start start 2024-04-25T02:11:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f5388ccd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538406dc90 0x7f5384154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f5388ccd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f538406fe20 0x7f53841f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f5388ccd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53840b0320 0x7f5384156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f5388ccd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f53840d19d0 con 0x7f538406dc90 2024-04-25T02:11:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f5388ccd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f538415f620 con 0x7f538406fe20 2024-04-25T02:11:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f5388ccd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f53840d1b50 con 0x7f53840b0320 2024-04-25T02:11:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f538259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538406dc90 0x7f5384154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f538259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538406dc90 0x7f5384154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59842/0 (socket says 172.21.15.79:59842) 2024-04-25T02:11:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f538259c640 1 -- 172.21.15.79:0/3230408795 learned_addr learned my addr 172.21.15.79:0/3230408795 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f5381d9b640 1 --2- 172.21.15.79:0/3230408795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f538406fe20 0x7f53841f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f5382d9d640 1 --2- 172.21.15.79:0/3230408795 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53840b0320 0x7f5384156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f538259c640 1 -- 172.21.15.79:0/3230408795 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53840b0320 msgr2=0x7f5384156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f538259c640 1 --2- 172.21.15.79:0/3230408795 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53840b0320 0x7f5384156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f538259c640 1 -- 172.21.15.79:0/3230408795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f538406fe20 msgr2=0x7f53841f7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f538259c640 1 --2- 172.21.15.79:0/3230408795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f538406fe20 0x7f53841f7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.338+0000 7f538259c640 1 -- 172.21.15.79:0/3230408795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5384155ee0 con 0x7f538406dc90 2024-04-25T02:11:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.339+0000 7f538259c640 1 --2- 172.21.15.79:0/3230408795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538406dc90 0x7f5384154380 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f537400c7f0 tx=0x7f537400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.339+0000 7f5372ffd640 1 -- 172.21.15.79:0/3230408795 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374015070 con 0x7f538406dc90 2024-04-25T02:11:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.339+0000 7f5372ffd640 1 -- 172.21.15.79:0/3230408795 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5374007a30 con 0x7f538406dc90 2024-04-25T02:11:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.339+0000 7f5388ccd640 1 -- 172.21.15.79:0/3230408795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5384156180 con 0x7f538406dc90 2024-04-25T02:11:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.339+0000 7f5372ffd640 1 -- 172.21.15.79:0/3230408795 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374007e00 con 0x7f538406dc90 2024-04-25T02:11:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.339+0000 7f5388ccd640 1 -- 172.21.15.79:0/3230408795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5384156740 con 0x7f538406dc90 2024-04-25T02:11:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.340+0000 7f5388ccd640 1 -- 172.21.15.79:0/3230408795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53840690a0 con 0x7f538406dc90 2024-04-25T02:11:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.340+0000 7f5372ffd640 1 -- 172.21.15.79:0/3230408795 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5374018070 con 0x7f538406dc90 2024-04-25T02:11:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.340+0000 7f5372ffd640 1 --2- 172.21.15.79:0/3230408795 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f536406be30 0x7f536406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.341+0000 7f5372ffd640 1 -- 172.21.15.79:0/3230408795 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f537408ad60 con 0x7f538406dc90 2024-04-25T02:11:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.341+0000 7f5381d9b640 1 --2- 172.21.15.79:0/3230408795 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f536406be30 0x7f536406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.341+0000 7f5381d9b640 1 --2- 172.21.15.79:0/3230408795 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f536406be30 0x7f536406e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5378006fd0 tx=0x7f5378008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.345+0000 7f5372ffd640 1 -- 172.21.15.79:0/3230408795 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5374059710 con 0x7f538406dc90 2024-04-25T02:11:57.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.553+0000 7f5388ccd640 1 -- 172.21.15.79:0/3230408795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f538406e560 con 0x7f538406dc90 2024-04-25T02:11:57.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.621+0000 7f5372ffd640 1 -- 172.21.15.79:0/3230408795 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) ==== 118+0+0 (secure 0 0 0) 0x7f5374059010 con 0x7f538406dc90 2024-04-25T02:11:57.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.624+0000 7f5388ccd640 1 -- 172.21.15.79:0/3230408795 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f536406be30 msgr2=0x7f536406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.624+0000 7f5388ccd640 1 --2- 172.21.15.79:0/3230408795 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f536406be30 0x7f536406e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5378006fd0 tx=0x7f5378008040 comp rx=0 tx=0).stop 2024-04-25T02:11:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.624+0000 7f5388ccd640 1 -- 172.21.15.79:0/3230408795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538406dc90 msgr2=0x7f5384154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.624+0000 7f5388ccd640 1 --2- 172.21.15.79:0/3230408795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538406dc90 0x7f5384154380 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f537400c7f0 tx=0x7f537400ccb0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.624+0000 7f5388ccd640 1 -- 172.21.15.79:0/3230408795 shutdown_connections 2024-04-25T02:11:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.624+0000 7f5388ccd640 1 --2- 172.21.15.79:0/3230408795 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f536406be30 0x7f536406e2f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.624+0000 7f5388ccd640 1 --2- 172.21.15.79:0/3230408795 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53840b0320 0x7f5384156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.624+0000 7f5388ccd640 1 --2- 172.21.15.79:0/3230408795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f538406fe20 0x7f53841f7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.624+0000 7f5388ccd640 1 --2- 172.21.15.79:0/3230408795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538406dc90 0x7f5384154380 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.624+0000 7f5388ccd640 1 -- 172.21.15.79:0/3230408795 >> 172.21.15.79:0/3230408795 conn(0x7f53840d0e00 msgr2=0x7f53840b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.624+0000 7f5388ccd640 1 -- 172.21.15.79:0/3230408795 shutdown_connections 2024-04-25T02:11:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.624+0000 7f5388ccd640 1 -- 172.21.15.79:0/3230408795 wait complete. 2024-04-25T02:11:57.642 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T02:11:57.642 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T02:11:57.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.734+0000 7f977d314640 1 Processor -- start 2024-04-25T02:11:57.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.734+0000 7f977d314640 1 -- start start 2024-04-25T02:11:57.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.735+0000 7f977d314640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97780b0320 0x7f97780ae370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.735+0000 7f977d314640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f977815ed80 con 0x7f977815e7a0 2024-04-25T02:11:57.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.735+0000 7f977d314640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f977815f060 con 0x7f977806fe20 2024-04-25T02:11:57.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.735+0000 7f977d314640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f977806e3a0 con 0x7f97780b0320 2024-04-25T02:11:57.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.735+0000 7f97767fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f977815e7a0 0x7f977806dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33024/0 (socket says 172.21.15.79:33024) 2024-04-25T02:11:57.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.735+0000 7f97767fc640 1 -- 172.21.15.79:0/929974386 learned_addr learned my addr 172.21.15.79:0/929974386 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:57.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.735+0000 7f97777fe640 1 --2- 172.21.15.79:0/929974386 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97780b0320 0x7f97780ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.735+0000 7f9775ffb640 1 -- 172.21.15.79:0/929974386 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2854047688 0 0) 0x7f977815ed80 con 0x7f977815e7a0 2024-04-25T02:11:57.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.735+0000 7f9775ffb640 1 -- 172.21.15.79:0/929974386 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9760003520 con 0x7f977815e7a0 2024-04-25T02:11:57.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f9775ffb640 1 -- 172.21.15.79:0/929974386 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2148473145 0 0) 0x7f9760003520 con 0x7f977815e7a0 2024-04-25T02:11:57.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f9775ffb640 1 -- 172.21.15.79:0/929974386 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97780b0320 msgr2=0x7f97780ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:57.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f9775ffb640 1 --2- 172.21.15.79:0/929974386 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97780b0320 0x7f97780ae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f9775ffb640 1 -- 172.21.15.79:0/929974386 >> v1:172.21.15.189:6789/0 conn(0x7f977806fe20 legacy=0x7f9778070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f9775ffb640 1 -- 172.21.15.79:0/929974386 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977815f340 con 0x7f977815e7a0 2024-04-25T02:11:57.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f9775ffb640 1 -- 172.21.15.79:0/929974386 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f976c001670 con 0x7f977815e7a0 2024-04-25T02:11:57.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f9775ffb640 1 -- 172.21.15.79:0/929974386 >> v1:172.21.15.79:6789/0 conn(0x7f977815e7a0 legacy=0x7f977806dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f9775ffb640 1 --2- 172.21.15.79:0/929974386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97600039e0 0x7f9760003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f9775ffb640 1 --2- 172.21.15.79:0/929974386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9760004800 0x7f9760004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f9775ffb640 1 --2- 172.21.15.79:0/929974386 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97780b0320 0x7f97600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f9775ffb640 1 -- 172.21.15.79:0/929974386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f977806e3a0 con 0x7f9760004800 2024-04-25T02:11:57.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f9775ffb640 1 -- 172.21.15.79:0/929974386 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f976000baa0 con 0x7f97600039e0 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f9775ffb640 1 -- 172.21.15.79:0/929974386 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f976000bca0 con 0x7f97780b0320 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f97767fc640 1 --2- 172.21.15.79:0/929974386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9760004800 0x7f9760004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f9776ffd640 1 --2- 172.21.15.79:0/929974386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97600039e0 0x7f9760003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f97777fe640 1 --2- 172.21.15.79:0/929974386 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97780b0320 0x7f97600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f97767fc640 1 -- 172.21.15.79:0/929974386 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97780b0320 msgr2=0x7f97600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f97767fc640 1 --2- 172.21.15.79:0/929974386 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97780b0320 0x7f97600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f97767fc640 1 -- 172.21.15.79:0/929974386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97600039e0 msgr2=0x7f9760003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f97767fc640 1 --2- 172.21.15.79:0/929974386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97600039e0 0x7f9760003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.736+0000 7f97767fc640 1 -- 172.21.15.79:0/929974386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9760003520 con 0x7f9760004800 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.737+0000 7f97767fc640 1 --2- 172.21.15.79:0/929974386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9760004800 0x7f9760004c80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f976c001eb0 tx=0x7f9760005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561ca8298e57376c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.737+0000 7f9775ffb640 1 -- 172.21.15.79:0/929974386 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c007d30 con 0x7f9760004800 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.737+0000 7f9775ffb640 1 -- 172.21.15.79:0/929974386 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f976c005af0 con 0x7f9760004800 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.737+0000 7f9775ffb640 1 -- 172.21.15.79:0/929974386 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c007070 con 0x7f9760004800 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.737+0000 7f977d314640 1 -- 172.21.15.79:0/929974386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9760004800 msgr2=0x7f9760004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.737+0000 7f977d314640 1 --2- 172.21.15.79:0/929974386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9760004800 0x7f9760004c80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f976c001eb0 tx=0x7f9760005830 comp rx=0 tx=0).stop 2024-04-25T02:11:57.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.737+0000 7f97777fe640 1 -- 172.21.15.79:0/929974386 reap_dead start 2024-04-25T02:11:57.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.737+0000 7f977d314640 1 -- 172.21.15.79:0/929974386 shutdown_connections 2024-04-25T02:11:57.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.737+0000 7f977d314640 1 -- 172.21.15.79:0/929974386 >> 172.21.15.79:0/929974386 conn(0x7f97780d0e00 msgr2=0x7f97780d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:57.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.737+0000 7f977d314640 1 -- 172.21.15.79:0/929974386 shutdown_connections 2024-04-25T02:11:57.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.738+0000 7f977d314640 1 -- 172.21.15.79:0/929974386 wait complete. 2024-04-25T02:11:57.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.739+0000 7f977d314640 1 Processor -- start 2024-04-25T02:11:57.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.739+0000 7f977d314640 1 -- start start 2024-04-25T02:11:57.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.739+0000 7f977d314640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9760004800 0x7f97781490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.739+0000 7f977d314640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9778150470 0x7f9778156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.739+0000 7f977d314640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9778145550 0x7f97781459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.739+0000 7f977d314640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f97780d19d0 con 0x7f9760004800 2024-04-25T02:11:57.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.739+0000 7f977d314640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f977815f620 con 0x7f9778145550 2024-04-25T02:11:57.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.739+0000 7f977d314640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f97780d1b50 con 0x7f9778150470 2024-04-25T02:11:57.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f9776ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9760004800 0x7f97781490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f9776ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9760004800 0x7f97781490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59860/0 (socket says 172.21.15.79:59860) 2024-04-25T02:11:57.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f9776ffd640 1 -- 172.21.15.79:0/3225068920 learned_addr learned my addr 172.21.15.79:0/3225068920 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:57.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f9776ffd640 1 -- 172.21.15.79:0/3225068920 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9778150470 msgr2=0x7f9778156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f9776ffd640 1 --2- 172.21.15.79:0/3225068920 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9778150470 0x7f9778156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f9776ffd640 1 -- 172.21.15.79:0/3225068920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9778145550 msgr2=0x7f97781459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f97777fe640 1 --2- 172.21.15.79:0/3225068920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9778145550 0x7f97781459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f9776ffd640 1 --2- 172.21.15.79:0/3225068920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9778145550 0x7f97781459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:57.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f9776ffd640 1 -- 172.21.15.79:0/3225068920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9778150c50 con 0x7f9760004800 2024-04-25T02:11:57.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f97777fe640 1 --2- 172.21.15.79:0/3225068920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9778145550 0x7f97781459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:57.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f9776ffd640 1 --2- 172.21.15.79:0/3225068920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9760004800 0x7f97781490f0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f976800fbc0 tx=0x7f976800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f975f7fe640 1 -- 172.21.15.79:0/3225068920 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976800dc30 con 0x7f9760004800 2024-04-25T02:11:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f975f7fe640 1 -- 172.21.15.79:0/3225068920 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9768018070 con 0x7f9760004800 2024-04-25T02:11:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f977d314640 1 -- 172.21.15.79:0/3225068920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9778152dc0 con 0x7f9760004800 2024-04-25T02:11:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f975f7fe640 1 -- 172.21.15.79:0/3225068920 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9768003970 con 0x7f9760004800 2024-04-25T02:11:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.740+0000 7f977d314640 1 -- 172.21.15.79:0/3225068920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9778153380 con 0x7f9760004800 2024-04-25T02:11:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.741+0000 7f977d314640 1 -- 172.21.15.79:0/3225068920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97780690a0 con 0x7f9760004800 2024-04-25T02:11:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.742+0000 7f975f7fe640 1 -- 172.21.15.79:0/3225068920 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9768003b10 con 0x7f9760004800 2024-04-25T02:11:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.742+0000 7f975f7fe640 1 --2- 172.21.15.79:0/3225068920 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f976406be30 0x7f976406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.742+0000 7f97767fc640 1 --2- 172.21.15.79:0/3225068920 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f976406be30 0x7f976406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.742+0000 7f975f7fe640 1 -- 172.21.15.79:0/3225068920 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f976808b000 con 0x7f9760004800 2024-04-25T02:11:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.742+0000 7f97767fc640 1 --2- 172.21.15.79:0/3225068920 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f976406be30 0x7f976406e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f976c032000 tx=0x7f976c009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.746+0000 7f975f7fe640 1 -- 172.21.15.79:0/3225068920 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9768059a40 con 0x7f9760004800 2024-04-25T02:11:57.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:57.953+0000 7f977d314640 1 -- 172.21.15.79:0/3225068920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9778150230 con 0x7f9760004800 2024-04-25T02:11:58.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.623+0000 7f975f7fe640 1 -- 172.21.15.79:0/3225068920 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f9768059340 con 0x7f9760004800 2024-04-25T02:11:58.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.625+0000 7f977d314640 1 -- 172.21.15.79:0/3225068920 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f976406be30 msgr2=0x7f976406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.625+0000 7f977d314640 1 --2- 172.21.15.79:0/3225068920 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f976406be30 0x7f976406e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f976c032000 tx=0x7f976c009030 comp rx=0 tx=0).stop 2024-04-25T02:11:58.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.626+0000 7f977d314640 1 -- 172.21.15.79:0/3225068920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9760004800 msgr2=0x7f97781490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.626+0000 7f977d314640 1 --2- 172.21.15.79:0/3225068920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9760004800 0x7f97781490f0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f976800fbc0 tx=0x7f976800d520 comp rx=0 tx=0).stop 2024-04-25T02:11:58.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.626+0000 7f977d314640 1 -- 172.21.15.79:0/3225068920 shutdown_connections 2024-04-25T02:11:58.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.626+0000 7f977d314640 1 --2- 172.21.15.79:0/3225068920 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f976406be30 0x7f976406e2f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:58.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.626+0000 7f977d314640 1 --2- 172.21.15.79:0/3225068920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9778145550 0x7f97781459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:58.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.626+0000 7f977d314640 1 --2- 172.21.15.79:0/3225068920 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9778150470 0x7f9778156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:58.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.626+0000 7f977d314640 1 --2- 172.21.15.79:0/3225068920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9760004800 0x7f97781490f0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:58.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.626+0000 7f977d314640 1 -- 172.21.15.79:0/3225068920 >> 172.21.15.79:0/3225068920 conn(0x7f97780d0e00 msgr2=0x7f97780b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:58.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.626+0000 7f977d314640 1 -- 172.21.15.79:0/3225068920 shutdown_connections 2024-04-25T02:11:58.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.626+0000 7f977d314640 1 -- 172.21.15.79:0/3225068920 wait complete. 2024-04-25T02:11:58.647 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T02:11:58.647 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:11:58.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.740+0000 7fcf6955a640 1 Processor -- start 2024-04-25T02:11:58.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.740+0000 7fcf6955a640 1 -- start start 2024-04-25T02:11:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf6955a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf64143bc0 0x7fcf6415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf6955a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcf6406df50 0x7fcf6406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf6955a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf6415fa40 con 0x7fcf640b48e0 2024-04-25T02:11:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf6955a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fcf6406e8f0 con 0x7fcf6406df50 2024-04-25T02:11:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf6955a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcf64072cb0 con 0x7fcf64143bc0 2024-04-25T02:11:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf637fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcf640b48e0 0x7fcf640b4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33030/0 (socket says 172.21.15.79:33030) 2024-04-25T02:11:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf637fe640 1 -- 172.21.15.79:0/4004048042 learned_addr learned my addr 172.21.15.79:0/4004048042 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf5bfff640 1 --2- 172.21.15.79:0/4004048042 >> v2:172.21.15.189:3300/0 conn(0x7fcf6406df50 0x7fcf6406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf62ffd640 1 --2- 172.21.15.79:0/4004048042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf64143bc0 0x7fcf6415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 -- 172.21.15.79:0/4004048042 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654815971 0 0) 0x7fcf5c001490 con 0x7fcf640b48e0 2024-04-25T02:11:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 -- 172.21.15.79:0/4004048042 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf50003520 con 0x7fcf640b48e0 2024-04-25T02:11:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 -- 172.21.15.79:0/4004048042 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2198284777 0 0) 0x7fcf50003520 con 0x7fcf640b48e0 2024-04-25T02:11:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 -- 172.21.15.79:0/4004048042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf64143bc0 msgr2=0x7fcf6415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 --2- 172.21.15.79:0/4004048042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf64143bc0 0x7fcf6415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 -- 172.21.15.79:0/4004048042 >> v2:172.21.15.189:3300/0 conn(0x7fcf6406df50 msgr2=0x7fcf6406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 --2- 172.21.15.79:0/4004048042 >> v2:172.21.15.189:3300/0 conn(0x7fcf6406df50 0x7fcf6406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 -- 172.21.15.79:0/4004048042 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf640720a0 con 0x7fcf640b48e0 2024-04-25T02:11:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 -- 172.21.15.79:0/4004048042 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fcf5c001bc0 con 0x7fcf640b48e0 2024-04-25T02:11:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 -- 172.21.15.79:0/4004048042 >> v1:172.21.15.79:6789/0 conn(0x7fcf640b48e0 legacy=0x7fcf640b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 --2- 172.21.15.79:0/4004048042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf500039b0 0x7fcf50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 --2- 172.21.15.79:0/4004048042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf64143bc0 0x7fcf50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 --2- 172.21.15.79:0/4004048042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf50004d40 0x7fcf500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 -- 172.21.15.79:0/4004048042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcf64072cb0 con 0x7fcf50004d40 2024-04-25T02:11:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 -- 172.21.15.79:0/4004048042 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5000b9c0 con 0x7fcf500039b0 2024-04-25T02:11:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf627fc640 1 -- 172.21.15.79:0/4004048042 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5000bb40 con 0x7fcf64143bc0 2024-04-25T02:11:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.741+0000 7fcf637fe640 1 --2- 172.21.15.79:0/4004048042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf50004d40 0x7fcf500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.742+0000 7fcf62ffd640 1 --2- 172.21.15.79:0/4004048042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf500039b0 0x7fcf50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.742+0000 7fcf5bfff640 1 --2- 172.21.15.79:0/4004048042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf64143bc0 0x7fcf50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.742+0000 7fcf637fe640 1 -- 172.21.15.79:0/4004048042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf64143bc0 msgr2=0x7fcf50004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.742+0000 7fcf637fe640 1 --2- 172.21.15.79:0/4004048042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf64143bc0 0x7fcf50004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.742+0000 7fcf637fe640 1 -- 172.21.15.79:0/4004048042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf500039b0 msgr2=0x7fcf50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.742+0000 7fcf637fe640 1 --2- 172.21.15.79:0/4004048042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf500039b0 0x7fcf50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.742+0000 7fcf637fe640 1 -- 172.21.15.79:0/4004048042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf50003520 con 0x7fcf50004d40 2024-04-25T02:11:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.742+0000 7fcf637fe640 1 --2- 172.21.15.79:0/4004048042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf50004d40 0x7fcf500051c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00aa60 tx=0x7fcf50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca466b300137ebd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.742+0000 7fcf627fc640 1 -- 172.21.15.79:0/4004048042 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c00a6b0 con 0x7fcf50004d40 2024-04-25T02:11:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.742+0000 7fcf627fc640 1 -- 172.21.15.79:0/4004048042 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5c02f070 con 0x7fcf50004d40 2024-04-25T02:11:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.743+0000 7fcf627fc640 1 -- 172.21.15.79:0/4004048042 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c034470 con 0x7fcf50004d40 2024-04-25T02:11:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.743+0000 7fcf6955a640 1 -- 172.21.15.79:0/4004048042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf50004d40 msgr2=0x7fcf500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.743+0000 7fcf6955a640 1 --2- 172.21.15.79:0/4004048042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf50004d40 0x7fcf500051c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00aa60 tx=0x7fcf50005830 comp rx=0 tx=0).stop 2024-04-25T02:11:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.743+0000 7fcf637fe640 1 -- 172.21.15.79:0/4004048042 reap_dead start 2024-04-25T02:11:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.743+0000 7fcf6955a640 1 -- 172.21.15.79:0/4004048042 shutdown_connections 2024-04-25T02:11:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.743+0000 7fcf6955a640 1 -- 172.21.15.79:0/4004048042 >> 172.21.15.79:0/4004048042 conn(0x7fcf640cfc80 msgr2=0x7fcf640d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.743+0000 7fcf6955a640 1 -- 172.21.15.79:0/4004048042 shutdown_connections 2024-04-25T02:11:58.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.743+0000 7fcf6955a640 1 -- 172.21.15.79:0/4004048042 wait complete. 2024-04-25T02:11:58.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.744+0000 7fcf6955a640 1 Processor -- start 2024-04-25T02:11:58.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.744+0000 7fcf6955a640 1 -- start start 2024-04-25T02:11:58.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf6955a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6413a750 0x7fcf6415d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:58.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf6955a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf64141490 0x7fcf64142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:58.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf6955a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf6413e990 0x7fcf6413ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:58.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf6955a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcf64072940 con 0x7fcf6413a750 2024-04-25T02:11:58.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf6955a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcf64072660 con 0x7fcf6413e990 2024-04-25T02:11:58.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf6955a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcf64143fa0 con 0x7fcf64141490 2024-04-25T02:11:58.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf62ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6413a750 0x7fcf6415d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:58.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf62ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6413a750 0x7fcf6415d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59890/0 (socket says 172.21.15.79:59890) 2024-04-25T02:11:58.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf62ffd640 1 -- 172.21.15.79:0/3372761977 learned_addr learned my addr 172.21.15.79:0/3372761977 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:58.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf5bfff640 1 --2- 172.21.15.79:0/3372761977 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf64141490 0x7fcf64142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:58.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf62ffd640 1 -- 172.21.15.79:0/3372761977 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf64141490 msgr2=0x7fcf64142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf637fe640 1 --2- 172.21.15.79:0/3372761977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf6413e990 0x7fcf6413ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:58.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf62ffd640 1 --2- 172.21.15.79:0/3372761977 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf64141490 0x7fcf64142d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:58.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf62ffd640 1 -- 172.21.15.79:0/3372761977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf6413e990 msgr2=0x7fcf6413ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf62ffd640 1 --2- 172.21.15.79:0/3372761977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf6413e990 0x7fcf6413ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf62ffd640 1 -- 172.21.15.79:0/3372761977 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf64141c90 con 0x7fcf6413a750 2024-04-25T02:11:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf637fe640 1 --2- 172.21.15.79:0/3372761977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf6413e990 0x7fcf6413ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.745+0000 7fcf62ffd640 1 --2- 172.21.15.79:0/3372761977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6413a750 0x7fcf6415d8a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fcf54011940 tx=0x7fcf54011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.746+0000 7fcf5b7fe640 1 -- 172.21.15.79:0/3372761977 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5400faf0 con 0x7fcf6413a750 2024-04-25T02:11:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.746+0000 7fcf5b7fe640 1 -- 172.21.15.79:0/3372761977 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5400fc90 con 0x7fcf6413a750 2024-04-25T02:11:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.746+0000 7fcf6955a640 1 -- 172.21.15.79:0/3372761977 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf64141f70 con 0x7fcf6413a750 2024-04-25T02:11:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.746+0000 7fcf5b7fe640 1 -- 172.21.15.79:0/3372761977 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54014440 con 0x7fcf6413a750 2024-04-25T02:11:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.746+0000 7fcf6955a640 1 -- 172.21.15.79:0/3372761977 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf64142530 con 0x7fcf6413a750 2024-04-25T02:11:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.747+0000 7fcf6955a640 1 -- 172.21.15.79:0/3372761977 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf640690a0 con 0x7fcf6413a750 2024-04-25T02:11:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.747+0000 7fcf5b7fe640 1 -- 172.21.15.79:0/3372761977 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf54012040 con 0x7fcf6413a750 2024-04-25T02:11:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.747+0000 7fcf5b7fe640 1 --2- 172.21.15.79:0/3372761977 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcf4406be30 0x7fcf4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.748+0000 7fcf5b7fe640 1 -- 172.21.15.79:0/3372761977 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7fcf5408b4b0 con 0x7fcf6413a750 2024-04-25T02:11:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.748+0000 7fcf5bfff640 1 --2- 172.21.15.79:0/3372761977 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcf4406be30 0x7fcf4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.748+0000 7fcf5bfff640 1 --2- 172.21.15.79:0/3372761977 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcf4406be30 0x7fcf4406e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcf64158aa0 tx=0x7fcf4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:58.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.752+0000 7fcf5b7fe640 1 -- 172.21.15.79:0/3372761977 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcf54019030 con 0x7fcf6413a750 2024-04-25T02:11:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.960+0000 7fcf6955a640 1 -- 172.21.15.79:0/3372761977 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf6415de40 con 0x7fcf6413a750 2024-04-25T02:11:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.960+0000 7fcf5b7fe640 1 -- 172.21.15.79:0/3372761977 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5180 (secure 0 0 0) 0x7fcf54059ef0 con 0x7fcf6413a750 2024-04-25T02:11:58.967 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:58.968 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":32,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/596307304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":596307304},{"type":"v1","addr":"172.21.15.189:6834","nonce":596307304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2550610051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550610051},{"type":"v1","addr":"172.21.15.79:6836","nonce":2550610051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6696,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/782013262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":782013262},{"type":"v1","addr":"172.21.15.79:6837","nonce":782013262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:11:55.951694+0000","modified":"2024-04-25T02:11:57.954401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6708":{"gid":6708,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6835/469348969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":469348969},{"type":"v1","addr":"172.21.15.189:6835","nonce":469348969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6708,"qdb_cluster":[6708]},"id":5}]} 2024-04-25T02:11:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 32 2024-04-25T02:11:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.962+0000 7fcf6955a640 1 -- 172.21.15.79:0/3372761977 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcf4406be30 msgr2=0x7fcf4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.962+0000 7fcf6955a640 1 --2- 172.21.15.79:0/3372761977 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcf4406be30 0x7fcf4406e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcf64158aa0 tx=0x7fcf4c008040 comp rx=0 tx=0).stop 2024-04-25T02:11:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.962+0000 7fcf6955a640 1 -- 172.21.15.79:0/3372761977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6413a750 msgr2=0x7fcf6415d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.962+0000 7fcf6955a640 1 --2- 172.21.15.79:0/3372761977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6413a750 0x7fcf6415d8a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fcf54011940 tx=0x7fcf54011e00 comp rx=0 tx=0).stop 2024-04-25T02:11:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.962+0000 7fcf6955a640 1 -- 172.21.15.79:0/3372761977 shutdown_connections 2024-04-25T02:11:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.962+0000 7fcf6955a640 1 --2- 172.21.15.79:0/3372761977 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcf4406be30 0x7fcf4406e2f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.962+0000 7fcf6955a640 1 --2- 172.21.15.79:0/3372761977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf6413e990 0x7fcf6413ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.962+0000 7fcf6955a640 1 --2- 172.21.15.79:0/3372761977 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf64141490 0x7fcf64142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.962+0000 7fcf6955a640 1 --2- 172.21.15.79:0/3372761977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6413a750 0x7fcf6415d8a0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.962+0000 7fcf6955a640 1 -- 172.21.15.79:0/3372761977 >> 172.21.15.79:0/3372761977 conn(0x7fcf640cfc80 msgr2=0x7fcf640ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.962+0000 7fcf6955a640 1 -- 172.21.15.79:0/3372761977 shutdown_connections 2024-04-25T02:11:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:58.962+0000 7fcf6955a640 1 -- 172.21.15.79:0/3372761977 wait complete. 2024-04-25T02:11:58.980 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:11:59.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.070+0000 7ff35ff7e640 1 Processor -- start 2024-04-25T02:11:59.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.070+0000 7ff35ff7e640 1 -- start start 2024-04-25T02:11:59.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.071+0000 7ff35ff7e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff358143bc0 0x7ff35815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.071+0000 7ff35ff7e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff35806df50 0x7ff35806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.071+0000 7ff35ff7e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff35815fa40 con 0x7ff3580b48e0 2024-04-25T02:11:59.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.071+0000 7ff35ff7e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff35806e8f0 con 0x7ff358143bc0 2024-04-25T02:11:59.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.071+0000 7ff35ff7e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff358072cb0 con 0x7ff35806df50 2024-04-25T02:11:59.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.071+0000 7ff35dd1a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff358143bc0 0x7ff35815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.071+0000 7ff35e51b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff3580b48e0 0x7ff3580b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33044/0 (socket says 172.21.15.79:33044) 2024-04-25T02:11:59.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.071+0000 7ff35e51b640 1 -- 172.21.15.79:0/3162257517 learned_addr learned my addr 172.21.15.79:0/3162257517 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:11:59.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.072+0000 7ff35d519640 1 --2- 172.21.15.79:0/3162257517 >> v2:172.21.15.189:3300/0 conn(0x7ff35806df50 0x7ff35806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.072+0000 7ff35dd1a640 1 -- 172.21.15.79:0/3162257517 >> v2:172.21.15.189:3300/0 conn(0x7ff35806df50 msgr2=0x7ff35806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:59.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.072+0000 7ff35dd1a640 1 --2- 172.21.15.79:0/3162257517 >> v2:172.21.15.189:3300/0 conn(0x7ff35806df50 0x7ff35806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.072+0000 7ff35dd1a640 1 -- 172.21.15.79:0/3162257517 >> v1:172.21.15.79:6789/0 conn(0x7ff3580b48e0 legacy=0x7ff3580b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.072+0000 7ff35dd1a640 1 -- 172.21.15.79:0/3162257517 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff358071e00 con 0x7ff358143bc0 2024-04-25T02:11:59.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.072+0000 7ff35cd18640 1 -- 172.21.15.79:0/3162257517 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4287723722 0 0) 0x7ff350001490 con 0x7ff3580b48e0 2024-04-25T02:11:59.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.072+0000 7ff35dd1a640 1 --2- 172.21.15.79:0/3162257517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff358143bc0 0x7ff35815f500 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff3580cf960 tx=0x7ff35402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb737180c2afcf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:59.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.072+0000 7ff35cd18640 1 -- 172.21.15.79:0/3162257517 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff354037070 con 0x7ff358143bc0 2024-04-25T02:11:59.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.073+0000 7ff35cd18640 1 -- 172.21.15.79:0/3162257517 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff354032440 con 0x7ff358143bc0 2024-04-25T02:11:59.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.073+0000 7ff35cd18640 1 -- 172.21.15.79:0/3162257517 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35402ae60 con 0x7ff358143bc0 2024-04-25T02:11:59.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.073+0000 7ff35ff7e640 1 -- 172.21.15.79:0/3162257517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff358143bc0 msgr2=0x7ff35815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.073+0000 7ff35ff7e640 1 --2- 172.21.15.79:0/3162257517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff358143bc0 0x7ff35815f500 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff3580cf960 tx=0x7ff35402a110 comp rx=0 tx=0).stop 2024-04-25T02:11:59.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.073+0000 7ff35ff7e640 1 -- 172.21.15.79:0/3162257517 shutdown_connections 2024-04-25T02:11:59.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.073+0000 7ff35ff7e640 1 --2- 172.21.15.79:0/3162257517 >> v2:172.21.15.189:3300/0 conn(0x7ff35806df50 0x7ff35806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.073+0000 7ff35ff7e640 1 --2- 172.21.15.79:0/3162257517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff358143bc0 0x7ff35815f500 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.073+0000 7ff35ff7e640 1 -- 172.21.15.79:0/3162257517 >> 172.21.15.79:0/3162257517 conn(0x7ff3580cfc80 msgr2=0x7ff3580d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.073+0000 7ff35ff7e640 1 -- 172.21.15.79:0/3162257517 shutdown_connections 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.073+0000 7ff35ff7e640 1 -- 172.21.15.79:0/3162257517 wait complete. 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.074+0000 7ff35ff7e640 1 Processor -- start 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.074+0000 7ff35ff7e640 1 -- start start 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.075+0000 7ff35ff7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35806df50 0x7ff3580ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.075+0000 7ff35ff7e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff3580b48e0 0x7ff3580abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.075+0000 7ff35ff7e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff358143bc0 0x7ff3581f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.075+0000 7ff35ff7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff358072660 con 0x7ff35806df50 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.075+0000 7ff35ff7e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff358072380 con 0x7ff358143bc0 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.075+0000 7ff35ff7e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff358072940 con 0x7ff3580b48e0 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.075+0000 7ff35dd1a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35806df50 0x7ff3580ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.075+0000 7ff35dd1a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35806df50 0x7ff3580ab630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59912/0 (socket says 172.21.15.79:59912) 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.075+0000 7ff35dd1a640 1 -- 172.21.15.79:0/1422430747 learned_addr learned my addr 172.21.15.79:0/1422430747 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.075+0000 7ff35dd1a640 1 -- 172.21.15.79:0/1422430747 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff3580b48e0 msgr2=0x7ff3580abb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.075+0000 7ff35dd1a640 1 --2- 172.21.15.79:0/1422430747 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff3580b48e0 0x7ff3580abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.075+0000 7ff35dd1a640 1 -- 172.21.15.79:0/1422430747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff358143bc0 msgr2=0x7ff3581f1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.075+0000 7ff35dd1a640 1 --2- 172.21.15.79:0/1422430747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff358143bc0 0x7ff3581f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.075+0000 7ff35dd1a640 1 -- 172.21.15.79:0/1422430747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3580ac3a0 con 0x7ff35806df50 2024-04-25T02:11:59.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.075+0000 7ff35dd1a640 1 --2- 172.21.15.79:0/1422430747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35806df50 0x7ff3580ab630 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff354000c00 tx=0x7ff3540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:59.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.076+0000 7ff34e7fc640 1 -- 172.21.15.79:0/1422430747 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff354037040 con 0x7ff35806df50 2024-04-25T02:11:59.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.076+0000 7ff34e7fc640 1 -- 172.21.15.79:0/1422430747 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff354042070 con 0x7ff35806df50 2024-04-25T02:11:59.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.076+0000 7ff35ff7e640 1 -- 172.21.15.79:0/1422430747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3580ac680 con 0x7ff35806df50 2024-04-25T02:11:59.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.076+0000 7ff34e7fc640 1 -- 172.21.15.79:0/1422430747 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff354030bd0 con 0x7ff35806df50 2024-04-25T02:11:59.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.076+0000 7ff35ff7e640 1 -- 172.21.15.79:0/1422430747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3580acc40 con 0x7ff35806df50 2024-04-25T02:11:59.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.077+0000 7ff35ff7e640 1 -- 172.21.15.79:0/1422430747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3580690a0 con 0x7ff35806df50 2024-04-25T02:11:59.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.077+0000 7ff34e7fc640 1 -- 172.21.15.79:0/1422430747 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff354047460 con 0x7ff35806df50 2024-04-25T02:11:59.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.077+0000 7ff34e7fc640 1 --2- 172.21.15.79:0/1422430747 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff33c06be30 0x7ff33c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.077+0000 7ff34e7fc640 1 -- 172.21.15.79:0/1422430747 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7ff3540aba20 con 0x7ff35806df50 2024-04-25T02:11:59.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.077+0000 7ff35d519640 1 --2- 172.21.15.79:0/1422430747 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff33c06be30 0x7ff33c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.078+0000 7ff35d519640 1 --2- 172.21.15.79:0/1422430747 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff33c06be30 0x7ff33c06e2f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff348006fd0 tx=0x7ff348008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:59.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.082+0000 7ff34e7fc640 1 -- 172.21.15.79:0/1422430747 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff354032e20 con 0x7ff35806df50 2024-04-25T02:11:59.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.255+0000 7ff35ff7e640 1 -- 172.21.15.79:0/1422430747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3580cdc10 con 0x7ff35806df50 2024-04-25T02:11:59.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.256+0000 7ff34e7fc640 1 -- 172.21.15.79:0/1422430747 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16680 (secure 0 0 0) 0x7ff35407a460 con 0x7ff35806df50 2024-04-25T02:11:59.264 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:59.264 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":71,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:11:57.599894+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:11:54.161817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T02:11:54.917049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:11:59.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.258+0000 7ff35ff7e640 1 -- 172.21.15.79:0/1422430747 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff33c06be30 msgr2=0x7ff33c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.258+0000 7ff35ff7e640 1 --2- 172.21.15.79:0/1422430747 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff33c06be30 0x7ff33c06e2f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff348006fd0 tx=0x7ff348008040 comp rx=0 tx=0).stop 2024-04-25T02:11:59.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.258+0000 7ff35ff7e640 1 -- 172.21.15.79:0/1422430747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35806df50 msgr2=0x7ff3580ab630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.258+0000 7ff35ff7e640 1 --2- 172.21.15.79:0/1422430747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35806df50 0x7ff3580ab630 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff354000c00 tx=0x7ff3540046c0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.258+0000 7ff35ff7e640 1 -- 172.21.15.79:0/1422430747 shutdown_connections 2024-04-25T02:11:59.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.258+0000 7ff35ff7e640 1 --2- 172.21.15.79:0/1422430747 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff33c06be30 0x7ff33c06e2f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.258+0000 7ff35ff7e640 1 --2- 172.21.15.79:0/1422430747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff358143bc0 0x7ff3581f1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.258+0000 7ff35ff7e640 1 --2- 172.21.15.79:0/1422430747 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff3580b48e0 0x7ff3580abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.258+0000 7ff35ff7e640 1 --2- 172.21.15.79:0/1422430747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35806df50 0x7ff3580ab630 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.258+0000 7ff35ff7e640 1 -- 172.21.15.79:0/1422430747 >> 172.21.15.79:0/1422430747 conn(0x7ff3580cfc80 msgr2=0x7ff358071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:59.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.258+0000 7ff35ff7e640 1 -- 172.21.15.79:0/1422430747 shutdown_connections 2024-04-25T02:11:59.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.258+0000 7ff35ff7e640 1 -- 172.21.15.79:0/1422430747 wait complete. 2024-04-25T02:11:59.277 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T02:11:59.277 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:11:59.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.366+0000 7f82ad03f640 1 Processor -- start 2024-04-25T02:11:59.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.366+0000 7f82ad03f640 1 -- start start 2024-04-25T02:11:59.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.367+0000 7f82ad03f640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f82a80b3570 0x7f82a80d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.367+0000 7f82ad03f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82a80b3020 0x7f82a80d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.367+0000 7f82ad03f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82a806c380 con 0x7f82a815e4d0 2024-04-25T02:11:59.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.367+0000 7f82ad03f640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f82a80d1660 con 0x7f82a80b3570 2024-04-25T02:11:59.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.367+0000 7f82ad03f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f82a80d1380 con 0x7f82a80b3020 2024-04-25T02:11:59.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.367+0000 7f82a759e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82a80b3020 0x7f82a80d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.367+0000 7f82a759e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82a80b3020 0x7f82a80d2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:48700/0 (socket says 172.21.15.79:48700) 2024-04-25T02:11:59.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.367+0000 7f82a659c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f82a80b3570 0x7f82a80d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.367+0000 7f82a6d9d640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f82a815e4d0 0x7f82a806bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:52766/0 (socket says 172.21.15.79:52766) 2024-04-25T02:11:59.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.367+0000 7f82a759e640 1 -- 172.21.15.79:0/4224340090 learned_addr learned my addr 172.21.15.79:0/4224340090 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:59.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.368+0000 7f82a659c640 1 -- 172.21.15.79:0/4224340090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82a80b3020 msgr2=0x7f82a80d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:59.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.368+0000 7f82a659c640 1 --2- 172.21.15.79:0/4224340090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82a80b3020 0x7f82a80d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.368+0000 7f82a659c640 1 -- 172.21.15.79:0/4224340090 >> v1:172.21.15.189:6789/0 conn(0x7f82a815e4d0 legacy=0x7f82a806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.368+0000 7f82a659c640 1 -- 172.21.15.79:0/4224340090 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a80cede0 con 0x7f82a80b3570 2024-04-25T02:11:59.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.368+0000 7f82a759e640 1 --2- 172.21.15.79:0/4224340090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82a80b3020 0x7f82a80d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:59.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.368+0000 7f82a659c640 1 --2- 172.21.15.79:0/4224340090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82a80b3570 0x7f82a80d2710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f829c0097d0 tx=0x7f829c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=534e17eb0ad186fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:59.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.369+0000 7f82a5d9b640 1 -- 172.21.15.79:0/4224340090 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c037070 con 0x7f82a80b3570 2024-04-25T02:11:59.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.369+0000 7f82a5d9b640 1 -- 172.21.15.79:0/4224340090 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c032440 con 0x7f82a80b3570 2024-04-25T02:11:59.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.369+0000 7f82a5d9b640 1 -- 172.21.15.79:0/4224340090 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c032810 con 0x7f82a80b3570 2024-04-25T02:11:59.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.369+0000 7f82ad03f640 1 -- 172.21.15.79:0/4224340090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82a80b3570 msgr2=0x7f82a80d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.369+0000 7f82ad03f640 1 --2- 172.21.15.79:0/4224340090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82a80b3570 0x7f82a80d2710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f829c0097d0 tx=0x7f829c02a1c0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.369+0000 7f82ad03f640 1 -- 172.21.15.79:0/4224340090 shutdown_connections 2024-04-25T02:11:59.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.369+0000 7f82ad03f640 1 --2- 172.21.15.79:0/4224340090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82a80b3020 0x7f82a80d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.369+0000 7f82ad03f640 1 --2- 172.21.15.79:0/4224340090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82a80b3570 0x7f82a80d2710 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.369+0000 7f82ad03f640 1 -- 172.21.15.79:0/4224340090 >> 172.21.15.79:0/4224340090 conn(0x7f82a809d460 msgr2=0x7f82a80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:59.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.369+0000 7f82ad03f640 1 -- 172.21.15.79:0/4224340090 shutdown_connections 2024-04-25T02:11:59.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.369+0000 7f82ad03f640 1 -- 172.21.15.79:0/4224340090 wait complete. 2024-04-25T02:11:59.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.370+0000 7f82ad03f640 1 Processor -- start 2024-04-25T02:11:59.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.371+0000 7f82ad03f640 1 -- start start 2024-04-25T02:11:59.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.371+0000 7f82ad03f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82a80b3020 0x7f82a80b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.371+0000 7f82ad03f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82a80b3570 0x7f82a8161460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.371+0000 7f82ad03f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82a815e4d0 0x7f82a815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.371+0000 7f82ad03f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f82a80d20d0 con 0x7f82a80b3020 2024-04-25T02:11:59.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.371+0000 7f82ad03f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f82a815e8b0 con 0x7f82a815e4d0 2024-04-25T02:11:59.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.371+0000 7f82ad03f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f82a80d2250 con 0x7f82a80b3570 2024-04-25T02:11:59.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.371+0000 7f82a6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82a80b3020 0x7f82a80b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.371+0000 7f82a6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82a80b3020 0x7f82a80b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59926/0 (socket says 172.21.15.79:59926) 2024-04-25T02:11:59.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.371+0000 7f82a6d9d640 1 -- 172.21.15.79:0/3743975331 learned_addr learned my addr 172.21.15.79:0/3743975331 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:59.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.371+0000 7f82a659c640 1 --2- 172.21.15.79:0/3743975331 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82a80b3570 0x7f82a8161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.372+0000 7f82a759e640 1 --2- 172.21.15.79:0/3743975331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82a815e4d0 0x7f82a815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.372+0000 7f82a6d9d640 1 -- 172.21.15.79:0/3743975331 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82a80b3570 msgr2=0x7f82a8161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.372+0000 7f82a6d9d640 1 --2- 172.21.15.79:0/3743975331 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82a80b3570 0x7f82a8161460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.372+0000 7f82a6d9d640 1 -- 172.21.15.79:0/3743975331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82a815e4d0 msgr2=0x7f82a815afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.372+0000 7f82a6d9d640 1 --2- 172.21.15.79:0/3743975331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82a815e4d0 0x7f82a815afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.372+0000 7f82a6d9d640 1 -- 172.21.15.79:0/3743975331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a81619a0 con 0x7f82a80b3020 2024-04-25T02:11:59.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.372+0000 7f82a759e640 1 --2- 172.21.15.79:0/3743975331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82a815e4d0 0x7f82a815afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:59.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.372+0000 7f82a6d9d640 1 --2- 172.21.15.79:0/3743975331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82a80b3020 0x7f82a80b3ac0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f829800c760 tx=0x7f829800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:59.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.372+0000 7f828f7fe640 1 -- 172.21.15.79:0/3743975331 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8298017070 con 0x7f82a80b3020 2024-04-25T02:11:59.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.372+0000 7f828f7fe640 1 -- 172.21.15.79:0/3743975331 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829800a640 con 0x7f82a80b3020 2024-04-25T02:11:59.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.372+0000 7f828f7fe640 1 -- 172.21.15.79:0/3743975331 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829800aa10 con 0x7f82a80b3020 2024-04-25T02:11:59.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.372+0000 7f82ad03f640 1 -- 172.21.15.79:0/3743975331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a80b40a0 con 0x7f82a80b3020 2024-04-25T02:11:59.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.372+0000 7f82ad03f640 1 -- 172.21.15.79:0/3743975331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a80b4660 con 0x7f82a80b3020 2024-04-25T02:11:59.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.373+0000 7f82ad03f640 1 -- 172.21.15.79:0/3743975331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a80690a0 con 0x7f82a80b3020 2024-04-25T02:11:59.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.374+0000 7f828f7fe640 1 -- 172.21.15.79:0/3743975331 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f829801a070 con 0x7f82a80b3020 2024-04-25T02:11:59.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.374+0000 7f828f7fe640 1 --2- 172.21.15.79:0/3743975331 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f829406be30 0x7f829406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.374+0000 7f82a659c640 1 --2- 172.21.15.79:0/3743975331 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f829406be30 0x7f829406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.374+0000 7f828f7fe640 1 -- 172.21.15.79:0/3743975331 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f829808a390 con 0x7f82a80b3020 2024-04-25T02:11:59.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.374+0000 7f82a659c640 1 --2- 172.21.15.79:0/3743975331 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f829406be30 0x7f829406e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f829c034000 tx=0x7f829c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:59.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.378+0000 7f828f7fe640 1 -- 172.21.15.79:0/3743975331 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8298058700 con 0x7f82a80b3020 2024-04-25T02:11:59.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.547+0000 7f82ad03f640 1 -- 172.21.15.79:0/3743975331 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82a80ce540 con 0x7f829406be30 2024-04-25T02:11:59.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.553+0000 7f828f7fe640 1 -- 172.21.15.79:0/3743975331 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246754 (secure 0 0 0) 0x7f82a80ce540 con 0x7f829406be30 2024-04-25T02:11:59.563 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:59.564 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:11:59.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.556+0000 7f82ad03f640 1 -- 172.21.15.79:0/3743975331 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f829406be30 msgr2=0x7f829406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.556+0000 7f82ad03f640 1 --2- 172.21.15.79:0/3743975331 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f829406be30 0x7f829406e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f829c034000 tx=0x7f829c02e000 comp rx=0 tx=0).stop 2024-04-25T02:11:59.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.556+0000 7f82ad03f640 1 -- 172.21.15.79:0/3743975331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82a80b3020 msgr2=0x7f82a80b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.556+0000 7f82ad03f640 1 --2- 172.21.15.79:0/3743975331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82a80b3020 0x7f82a80b3ac0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f829800c760 tx=0x7f829800cc20 comp rx=0 tx=0).stop 2024-04-25T02:11:59.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.556+0000 7f82ad03f640 1 -- 172.21.15.79:0/3743975331 shutdown_connections 2024-04-25T02:11:59.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.556+0000 7f82ad03f640 1 --2- 172.21.15.79:0/3743975331 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f829406be30 0x7f829406e2f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.556+0000 7f82ad03f640 1 --2- 172.21.15.79:0/3743975331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82a815e4d0 0x7f82a815afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.556+0000 7f82ad03f640 1 --2- 172.21.15.79:0/3743975331 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82a80b3570 0x7f82a8161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.556+0000 7f82ad03f640 1 --2- 172.21.15.79:0/3743975331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82a80b3020 0x7f82a80b3ac0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.556+0000 7f82ad03f640 1 -- 172.21.15.79:0/3743975331 >> 172.21.15.79:0/3743975331 conn(0x7f82a809d460 msgr2=0x7f82a80b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:59.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.556+0000 7f82ad03f640 1 -- 172.21.15.79:0/3743975331 shutdown_connections 2024-04-25T02:11:59.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.556+0000 7f82ad03f640 1 -- 172.21.15.79:0/3743975331 wait complete. 2024-04-25T02:11:59.574 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-04-25T02:11:59.224395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228020,"kb_used_data":7684,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746700,"statfs":{"total":773094113280,"available":772860620800,"internally_reserved":0,"allocated":7868416,"data_stored":3954231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.630354"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.607116+0000","last_change":"2024-04-25T02:11:55.607116+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.607116+0000","last_undegraded":"2024-04-25T02:11:55.607116+0000","last_fullsized":"2024-04-25T02:11:55.607116+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606916+0000","last_change":"2024-04-25T02:11:55.606916+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606916+0000","last_undegraded":"2024-04-25T02:11:55.606916+0000","last_fullsized":"2024-04-25T02:11:55.606916+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604826+0000","last_change":"2024-04-25T02:11:55.604826+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604826+0000","last_undegraded":"2024-04-25T02:11:55.604826+0000","last_fullsized":"2024-04-25T02:11:55.604826+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606076+0000","last_change":"2024-04-25T02:11:55.606076+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606076+0000","last_undegraded":"2024-04-25T02:11:55.606076+0000","last_fullsized":"2024-04-25T02:11:55.606076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604080+0000","last_change":"2024-04-25T02:11:55.604080+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604080+0000","last_undegraded":"2024-04-25T02:11:55.604080+0000","last_fullsized":"2024-04-25T02:11:55.604080+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609278+0000","last_change":"2024-04-25T02:11:55.609278+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609278+0000","last_undegraded":"2024-04-25T02:11:55.609278+0000","last_fullsized":"2024-04-25T02:11:55.609278+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604266+0000","last_change":"2024-04-25T02:11:55.604266+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604266+0000","last_undegraded":"2024-04-25T02:11:55.604266+0000","last_fullsized":"2024-04-25T02:11:55.604266+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606693+0000","last_change":"2024-04-25T02:11:55.606693+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606693+0000","last_undegraded":"2024-04-25T02:11:55.606693+0000","last_fullsized":"2024-04-25T02:11:55.606693+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603626+0000","last_change":"2024-04-25T02:11:55.603626+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603626+0000","last_undegraded":"2024-04-25T02:11:55.603626+0000","last_fullsized":"2024-04-25T02:11:55.603626+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605010+0000","last_change":"2024-04-25T02:11:55.605010+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605010+0000","last_undegraded":"2024-04-25T02:11:55.605010+0000","last_fullsized":"2024-04-25T02:11:55.605010+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608598+0000","last_change":"2024-04-25T02:11:55.608598+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608598+0000","last_undegraded":"2024-04-25T02:11:55.608598+0000","last_fullsized":"2024-04-25T02:11:55.608598+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605667+0000","last_change":"2024-04-25T02:11:55.605667+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605667+0000","last_undegraded":"2024-04-25T02:11:55.605667+0000","last_fullsized":"2024-04-25T02:11:55.605667+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608931+0000","last_change":"2024-04-25T02:11:55.608931+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608931+0000","last_undegraded":"2024-04-25T02:11:55.608931+0000","last_fullsized":"2024-04-25T02:11:55.608931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603722+0000","last_change":"2024-04-25T02:11:55.603722+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603722+0000","last_undegraded":"2024-04-25T02:11:55.603722+0000","last_fullsized":"2024-04-25T02:11:55.603722+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.610212+0000","last_change":"2024-04-25T02:11:55.610212+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.610212+0000","last_undegraded":"2024-04-25T02:11:55.610212+0000","last_fullsized":"2024-04-25T02:11:55.610212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601756+0000","last_change":"2024-04-25T02:11:55.601756+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601756+0000","last_undegraded":"2024-04-25T02:11:55.601756+0000","last_fullsized":"2024-04-25T02:11:55.601756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603211+0000","last_change":"2024-04-25T02:11:55.603211+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603211+0000","last_undegraded":"2024-04-25T02:11:55.603211+0000","last_fullsized":"2024-04-25T02:11:55.603211+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605847+0000","last_change":"2024-04-25T02:11:55.605847+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605847+0000","last_undegraded":"2024-04-25T02:11:55.605847+0000","last_fullsized":"2024-04-25T02:11:55.605847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.612150+0000","last_change":"2024-04-25T02:11:55.612150+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.612150+0000","last_undegraded":"2024-04-25T02:11:55.612150+0000","last_fullsized":"2024-04-25T02:11:55.612150+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608950+0000","last_change":"2024-04-25T02:11:55.608950+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608950+0000","last_undegraded":"2024-04-25T02:11:55.608950+0000","last_fullsized":"2024-04-25T02:11:55.608950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602062+0000","last_change":"2024-04-25T02:11:55.602062+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602062+0000","last_undegraded":"2024-04-25T02:11:55.602062+0000","last_fullsized":"2024-04-25T02:11:55.602062+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601413+0000","last_change":"2024-04-25T02:11:55.601413+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601413+0000","last_undegraded":"2024-04-25T02:11:55.601413+0000","last_fullsized":"2024-04-25T02:11:55.601413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605821+0000","last_change":"2024-04-25T02:11:55.605821+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605821+0000","last_undegraded":"2024-04-25T02:11:55.605821+0000","last_fullsized":"2024-04-25T02:11:55.605821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606765+0000","last_change":"2024-04-25T02:11:55.606765+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606765+0000","last_undegraded":"2024-04-25T02:11:55.606765+0000","last_fullsized":"2024-04-25T02:11:55.606765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603037+0000","last_change":"2024-04-25T02:11:55.603037+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603037+0000","last_undegraded":"2024-04-25T02:11:55.603037+0000","last_fullsized":"2024-04-25T02:11:55.603037+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603022+0000","last_change":"2024-04-25T02:11:55.603022+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603022+0000","last_undegraded":"2024-04-25T02:11:55.603022+0000","last_fullsized":"2024-04-25T02:11:55.603022+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604446+0000","last_change":"2024-04-25T02:11:55.604446+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604446+0000","last_undegraded":"2024-04-25T02:11:55.604446+0000","last_fullsized":"2024-04-25T02:11:55.604446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605200+0000","last_change":"2024-04-25T02:11:55.605200+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605200+0000","last_undegraded":"2024-04-25T02:11:55.605200+0000","last_fullsized":"2024-04-25T02:11:55.605200+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605575+0000","last_change":"2024-04-25T02:11:55.605575+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605575+0000","last_undegraded":"2024-04-25T02:11:55.605575+0000","last_fullsized":"2024-04-25T02:11:55.605575+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602055+0000","last_change":"2024-04-25T02:11:55.602055+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602055+0000","last_undegraded":"2024-04-25T02:11:55.602055+0000","last_fullsized":"2024-04-25T02:11:55.602055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602029+0000","last_change":"2024-04-25T02:11:55.602029+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602029+0000","last_undegraded":"2024-04-25T02:11:55.602029+0000","last_fullsized":"2024-04-25T02:11:55.602029+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606192+0000","last_change":"2024-04-25T02:11:55.606192+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606192+0000","last_undegraded":"2024-04-25T02:11:55.606192+0000","last_fullsized":"2024-04-25T02:11:55.606192+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605418+0000","last_change":"2024-04-25T02:11:55.605418+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605418+0000","last_undegraded":"2024-04-25T02:11:55.605418+0000","last_fullsized":"2024-04-25T02:11:55.605418+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617026+0000","last_change":"2024-04-25T02:11:55.615213+0000","last_active":"2024-04-25T02:11:55.617026+0000","last_peered":"2024-04-25T02:11:55.617026+0000","last_clean":"2024-04-25T02:11:55.617026+0000","last_became_active":"2024-04-25T02:11:55.614877+0000","last_became_peered":"2024-04-25T02:11:55.614877+0000","last_unstale":"2024-04-25T02:11:55.617026+0000","last_undegraded":"2024-04-25T02:11:55.617026+0000","last_fullsized":"2024-04-25T02:11:55.617026+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:12:40.303720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602766+0000","last_change":"2024-04-25T02:11:55.602766+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602766+0000","last_undegraded":"2024-04-25T02:11:55.602766+0000","last_fullsized":"2024-04-25T02:11:55.602766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620001+0000","last_change":"2024-04-25T02:11:55.617352+0000","last_active":"2024-04-25T02:11:55.620001+0000","last_peered":"2024-04-25T02:11:55.620001+0000","last_clean":"2024-04-25T02:11:55.620001+0000","last_became_active":"2024-04-25T02:11:55.617068+0000","last_became_peered":"2024-04-25T02:11:55.617068+0000","last_unstale":"2024-04-25T02:11:55.620001+0000","last_undegraded":"2024-04-25T02:11:55.620001+0000","last_fullsized":"2024-04-25T02:11:55.620001+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:32.851053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609311+0000","last_change":"2024-04-25T02:11:55.609311+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609311+0000","last_undegraded":"2024-04-25T02:11:55.609311+0000","last_fullsized":"2024-04-25T02:11:55.609311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620294+0000","last_change":"2024-04-25T02:11:55.618718+0000","last_active":"2024-04-25T02:11:55.620294+0000","last_peered":"2024-04-25T02:11:55.620294+0000","last_clean":"2024-04-25T02:11:55.620294+0000","last_became_active":"2024-04-25T02:11:55.618396+0000","last_became_peered":"2024-04-25T02:11:55.618396+0000","last_unstale":"2024-04-25T02:11:55.620294+0000","last_undegraded":"2024-04-25T02:11:55.620294+0000","last_fullsized":"2024-04-25T02:11:55.620294+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:34.747144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608194+0000","last_change":"2024-04-25T02:11:55.608194+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608194+0000","last_undegraded":"2024-04-25T02:11:55.608194+0000","last_fullsized":"2024-04-25T02:11:55.608194+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617620+0000","last_change":"2024-04-25T02:11:55.616480+0000","last_active":"2024-04-25T02:11:55.617620+0000","last_peered":"2024-04-25T02:11:55.617620+0000","last_clean":"2024-04-25T02:11:55.617620+0000","last_became_active":"2024-04-25T02:11:55.616118+0000","last_became_peered":"2024-04-25T02:11:55.616118+0000","last_unstale":"2024-04-25T02:11:55.617620+0000","last_undegraded":"2024-04-25T02:11:55.617620+0000","last_fullsized":"2024-04-25T02:11:55.617620+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:14.359235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601516+0000","last_change":"2024-04-25T02:11:55.601516+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601516+0000","last_undegraded":"2024-04-25T02:11:55.601516+0000","last_fullsized":"2024-04-25T02:11:55.601516+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618267+0000","last_change":"2024-04-25T02:11:55.616655+0000","last_active":"2024-04-25T02:11:55.618267+0000","last_peered":"2024-04-25T02:11:55.618267+0000","last_clean":"2024-04-25T02:11:55.618267+0000","last_became_active":"2024-04-25T02:11:55.616366+0000","last_became_peered":"2024-04-25T02:11:55.616366+0000","last_unstale":"2024-04-25T02:11:55.618267+0000","last_undegraded":"2024-04-25T02:11:55.618267+0000","last_fullsized":"2024-04-25T02:11:55.618267+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:31:02.982180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601638+0000","last_change":"2024-04-25T02:11:55.601638+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601638+0000","last_undegraded":"2024-04-25T02:11:55.601638+0000","last_fullsized":"2024-04-25T02:11:55.601638+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.621386+0000","last_change":"2024-04-25T02:11:55.620695+0000","last_active":"2024-04-25T02:11:55.621386+0000","last_peered":"2024-04-25T02:11:55.621386+0000","last_clean":"2024-04-25T02:11:55.621386+0000","last_became_active":"2024-04-25T02:11:55.620416+0000","last_became_peered":"2024-04-25T02:11:55.620416+0000","last_unstale":"2024-04-25T02:11:55.621386+0000","last_undegraded":"2024-04-25T02:11:55.621386+0000","last_fullsized":"2024-04-25T02:11:55.621386+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:57.604722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603002+0000","last_change":"2024-04-25T02:11:55.603002+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603002+0000","last_undegraded":"2024-04-25T02:11:55.603002+0000","last_fullsized":"2024-04-25T02:11:55.603002+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616285+0000","last_change":"2024-04-25T02:11:55.613841+0000","last_active":"2024-04-25T02:11:55.616285+0000","last_peered":"2024-04-25T02:11:55.616285+0000","last_clean":"2024-04-25T02:11:55.616285+0000","last_became_active":"2024-04-25T02:11:55.613576+0000","last_became_peered":"2024-04-25T02:11:55.613576+0000","last_unstale":"2024-04-25T02:11:55.616285+0000","last_undegraded":"2024-04-25T02:11:55.616285+0000","last_fullsized":"2024-04-25T02:11:55.616285+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:44.628098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609226+0000","last_change":"2024-04-25T02:11:55.609226+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609226+0000","last_undegraded":"2024-04-25T02:11:55.609226+0000","last_fullsized":"2024-04-25T02:11:55.609226+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617573+0000","last_change":"2024-04-25T02:11:55.609302+0000","last_active":"2024-04-25T02:11:55.617573+0000","last_peered":"2024-04-25T02:11:55.617573+0000","last_clean":"2024-04-25T02:11:55.617573+0000","last_became_active":"2024-04-25T02:11:55.609033+0000","last_became_peered":"2024-04-25T02:11:55.609033+0000","last_unstale":"2024-04-25T02:11:55.617573+0000","last_undegraded":"2024-04-25T02:11:55.617573+0000","last_fullsized":"2024-04-25T02:11:55.617573+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:13.254074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602583+0000","last_change":"2024-04-25T02:11:55.602583+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602583+0000","last_undegraded":"2024-04-25T02:11:55.602583+0000","last_fullsized":"2024-04-25T02:11:55.602583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.619414+0000","last_change":"2024-04-25T02:11:55.617474+0000","last_active":"2024-04-25T02:11:55.619414+0000","last_peered":"2024-04-25T02:11:55.619414+0000","last_clean":"2024-04-25T02:11:55.619414+0000","last_became_active":"2024-04-25T02:11:55.617093+0000","last_became_peered":"2024-04-25T02:11:55.617093+0000","last_unstale":"2024-04-25T02:11:55.619414+0000","last_undegraded":"2024-04-25T02:11:55.619414+0000","last_fullsized":"2024-04-25T02:11:55.619414+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:09.181237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606693+0000","last_change":"2024-04-25T02:11:55.606693+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606693+0000","last_undegraded":"2024-04-25T02:11:55.606693+0000","last_fullsized":"2024-04-25T02:11:55.606693+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617368+0000","last_change":"2024-04-25T02:11:55.614158+0000","last_active":"2024-04-25T02:11:55.617368+0000","last_peered":"2024-04-25T02:11:55.617368+0000","last_clean":"2024-04-25T02:11:55.617368+0000","last_became_active":"2024-04-25T02:11:55.613879+0000","last_became_peered":"2024-04-25T02:11:55.613879+0000","last_unstale":"2024-04-25T02:11:55.617368+0000","last_undegraded":"2024-04-25T02:11:55.617368+0000","last_fullsized":"2024-04-25T02:11:55.617368+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:38.580085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608839+0000","last_change":"2024-04-25T02:11:55.608839+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608839+0000","last_undegraded":"2024-04-25T02:11:55.608839+0000","last_fullsized":"2024-04-25T02:11:55.608839+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.615572+0000","last_change":"2024-04-25T02:11:55.613806+0000","last_active":"2024-04-25T02:11:55.615572+0000","last_peered":"2024-04-25T02:11:55.615572+0000","last_clean":"2024-04-25T02:11:55.615572+0000","last_became_active":"2024-04-25T02:11:55.613252+0000","last_became_peered":"2024-04-25T02:11:55.613252+0000","last_unstale":"2024-04-25T02:11:55.615572+0000","last_undegraded":"2024-04-25T02:11:55.615572+0000","last_fullsized":"2024-04-25T02:11:55.615572+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:54.406276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603305+0000","last_change":"2024-04-25T02:11:55.603305+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603305+0000","last_undegraded":"2024-04-25T02:11:55.603305+0000","last_fullsized":"2024-04-25T02:11:55.603305+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620176+0000","last_change":"2024-04-25T02:11:55.616655+0000","last_active":"2024-04-25T02:11:55.620176+0000","last_peered":"2024-04-25T02:11:55.620176+0000","last_clean":"2024-04-25T02:11:55.620176+0000","last_became_active":"2024-04-25T02:11:55.616393+0000","last_became_peered":"2024-04-25T02:11:55.616393+0000","last_unstale":"2024-04-25T02:11:55.620176+0000","last_undegraded":"2024-04-25T02:11:55.620176+0000","last_fullsized":"2024-04-25T02:11:55.620176+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:19.912700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606210+0000","last_change":"2024-04-25T02:11:55.606210+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606210+0000","last_undegraded":"2024-04-25T02:11:55.606210+0000","last_fullsized":"2024-04-25T02:11:55.606210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.614348+0000","last_change":"2024-04-25T02:11:55.611138+0000","last_active":"2024-04-25T02:11:55.614348+0000","last_peered":"2024-04-25T02:11:55.614348+0000","last_clean":"2024-04-25T02:11:55.614348+0000","last_became_active":"2024-04-25T02:11:55.610838+0000","last_became_peered":"2024-04-25T02:11:55.610838+0000","last_unstale":"2024-04-25T02:11:55.614348+0000","last_undegraded":"2024-04-25T02:11:55.614348+0000","last_fullsized":"2024-04-25T02:11:55.614348+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:53.559794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604175+0000","last_change":"2024-04-25T02:11:55.604175+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604175+0000","last_undegraded":"2024-04-25T02:11:55.604175+0000","last_fullsized":"2024-04-25T02:11:55.604175+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620834+0000","last_change":"2024-04-25T02:11:55.618236+0000","last_active":"2024-04-25T02:11:55.620834+0000","last_peered":"2024-04-25T02:11:55.620834+0000","last_clean":"2024-04-25T02:11:55.620834+0000","last_became_active":"2024-04-25T02:11:55.617800+0000","last_became_peered":"2024-04-25T02:11:55.617800+0000","last_unstale":"2024-04-25T02:11:55.620834+0000","last_undegraded":"2024-04-25T02:11:55.620834+0000","last_fullsized":"2024-04-25T02:11:55.620834+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:12.740028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608536+0000","last_change":"2024-04-25T02:11:55.608536+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608536+0000","last_undegraded":"2024-04-25T02:11:55.608536+0000","last_fullsized":"2024-04-25T02:11:55.608536+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616039+0000","last_change":"2024-04-25T02:11:55.614787+0000","last_active":"2024-04-25T02:11:55.616039+0000","last_peered":"2024-04-25T02:11:55.616039+0000","last_clean":"2024-04-25T02:11:55.616039+0000","last_became_active":"2024-04-25T02:11:55.614456+0000","last_became_peered":"2024-04-25T02:11:55.614456+0000","last_unstale":"2024-04-25T02:11:55.616039+0000","last_undegraded":"2024-04-25T02:11:55.616039+0000","last_fullsized":"2024-04-25T02:11:55.616039+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:00.242853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602723+0000","last_change":"2024-04-25T02:11:55.602723+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602723+0000","last_undegraded":"2024-04-25T02:11:55.602723+0000","last_fullsized":"2024-04-25T02:11:55.602723+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616780+0000","last_change":"2024-04-25T02:11:55.613116+0000","last_active":"2024-04-25T02:11:55.616780+0000","last_peered":"2024-04-25T02:11:55.616780+0000","last_clean":"2024-04-25T02:11:55.616780+0000","last_became_active":"2024-04-25T02:11:55.612711+0000","last_became_peered":"2024-04-25T02:11:55.612711+0000","last_unstale":"2024-04-25T02:11:55.616780+0000","last_undegraded":"2024-04-25T02:11:55.616780+0000","last_fullsized":"2024-04-25T02:11:55.616780+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:21.747623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604604+0000","last_change":"2024-04-25T02:11:55.604604+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604604+0000","last_undegraded":"2024-04-25T02:11:55.604604+0000","last_fullsized":"2024-04-25T02:11:55.604604+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617335+0000","last_change":"2024-04-25T02:11:55.613889+0000","last_active":"2024-04-25T02:11:55.617335+0000","last_peered":"2024-04-25T02:11:55.617335+0000","last_clean":"2024-04-25T02:11:55.617335+0000","last_became_active":"2024-04-25T02:11:55.613613+0000","last_became_peered":"2024-04-25T02:11:55.613613+0000","last_unstale":"2024-04-25T02:11:55.617335+0000","last_undegraded":"2024-04-25T02:11:55.617335+0000","last_fullsized":"2024-04-25T02:11:55.617335+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:43.656103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605299+0000","last_change":"2024-04-25T02:11:55.605299+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605299+0000","last_undegraded":"2024-04-25T02:11:55.605299+0000","last_fullsized":"2024-04-25T02:11:55.605299+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620314+0000","last_change":"2024-04-25T02:11:55.618770+0000","last_active":"2024-04-25T02:11:55.620314+0000","last_peered":"2024-04-25T02:11:55.620314+0000","last_clean":"2024-04-25T02:11:55.620314+0000","last_became_active":"2024-04-25T02:11:55.618388+0000","last_became_peered":"2024-04-25T02:11:55.618388+0000","last_unstale":"2024-04-25T02:11:55.620314+0000","last_undegraded":"2024-04-25T02:11:55.620314+0000","last_fullsized":"2024-04-25T02:11:55.620314+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:22.677232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605216+0000","last_change":"2024-04-25T02:11:55.605216+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605216+0000","last_undegraded":"2024-04-25T02:11:55.605216+0000","last_fullsized":"2024-04-25T02:11:55.605216+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620981+0000","last_change":"2024-04-25T02:11:55.619965+0000","last_active":"2024-04-25T02:11:55.620981+0000","last_peered":"2024-04-25T02:11:55.620981+0000","last_clean":"2024-04-25T02:11:55.620981+0000","last_became_active":"2024-04-25T02:11:55.619679+0000","last_became_peered":"2024-04-25T02:11:55.619679+0000","last_unstale":"2024-04-25T02:11:55.620981+0000","last_undegraded":"2024-04-25T02:11:55.620981+0000","last_fullsized":"2024-04-25T02:11:55.620981+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:44.145676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602751+0000","last_change":"2024-04-25T02:11:55.602751+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602751+0000","last_undegraded":"2024-04-25T02:11:55.602751+0000","last_fullsized":"2024-04-25T02:11:55.602751+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617781+0000","last_change":"2024-04-25T02:11:55.616188+0000","last_active":"2024-04-25T02:11:55.617781+0000","last_peered":"2024-04-25T02:11:55.617781+0000","last_clean":"2024-04-25T02:11:55.617781+0000","last_became_active":"2024-04-25T02:11:55.615921+0000","last_became_peered":"2024-04-25T02:11:55.615921+0000","last_unstale":"2024-04-25T02:11:55.617781+0000","last_undegraded":"2024-04-25T02:11:55.617781+0000","last_fullsized":"2024-04-25T02:11:55.617781+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:52.550255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605182+0000","last_change":"2024-04-25T02:11:55.605182+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605182+0000","last_undegraded":"2024-04-25T02:11:55.605182+0000","last_fullsized":"2024-04-25T02:11:55.605182+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.621373+0000","last_change":"2024-04-25T02:11:55.620628+0000","last_active":"2024-04-25T02:11:55.621373+0000","last_peered":"2024-04-25T02:11:55.621373+0000","last_clean":"2024-04-25T02:11:55.621373+0000","last_became_active":"2024-04-25T02:11:55.620360+0000","last_became_peered":"2024-04-25T02:11:55.620360+0000","last_unstale":"2024-04-25T02:11:55.621373+0000","last_undegraded":"2024-04-25T02:11:55.621373+0000","last_fullsized":"2024-04-25T02:11:55.621373+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:49.417443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603999+0000","last_change":"2024-04-25T02:11:55.603999+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603999+0000","last_undegraded":"2024-04-25T02:11:55.603999+0000","last_fullsized":"2024-04-25T02:11:55.603999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.613700+0000","last_change":"2024-04-25T02:11:55.611740+0000","last_active":"2024-04-25T02:11:55.613700+0000","last_peered":"2024-04-25T02:11:55.613700+0000","last_clean":"2024-04-25T02:11:55.613700+0000","last_became_active":"2024-04-25T02:11:55.611477+0000","last_became_peered":"2024-04-25T02:11:55.611477+0000","last_unstale":"2024-04-25T02:11:55.613700+0000","last_undegraded":"2024-04-25T02:11:55.613700+0000","last_fullsized":"2024-04-25T02:11:55.613700+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:41.075565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603657+0000","last_change":"2024-04-25T02:11:55.603657+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603657+0000","last_undegraded":"2024-04-25T02:11:55.603657+0000","last_fullsized":"2024-04-25T02:11:55.603657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620266+0000","last_change":"2024-04-25T02:11:55.618924+0000","last_active":"2024-04-25T02:11:55.620266+0000","last_peered":"2024-04-25T02:11:55.620266+0000","last_clean":"2024-04-25T02:11:55.620266+0000","last_became_active":"2024-04-25T02:11:55.618658+0000","last_became_peered":"2024-04-25T02:11:55.618658+0000","last_unstale":"2024-04-25T02:11:55.620266+0000","last_undegraded":"2024-04-25T02:11:55.620266+0000","last_fullsized":"2024-04-25T02:11:55.620266+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:41.849723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.610560+0000","last_change":"2024-04-25T02:11:55.610560+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.610560+0000","last_undegraded":"2024-04-25T02:11:55.610560+0000","last_fullsized":"2024-04-25T02:11:55.610560+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617652+0000","last_change":"2024-04-25T02:11:55.616514+0000","last_active":"2024-04-25T02:11:55.617652+0000","last_peered":"2024-04-25T02:11:55.617652+0000","last_clean":"2024-04-25T02:11:55.617652+0000","last_became_active":"2024-04-25T02:11:55.615526+0000","last_became_peered":"2024-04-25T02:11:55.615526+0000","last_unstale":"2024-04-25T02:11:55.617652+0000","last_undegraded":"2024-04-25T02:11:55.617652+0000","last_fullsized":"2024-04-25T02:11:55.617652+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:11.176893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602299+0000","last_change":"2024-04-25T02:11:55.602299+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602299+0000","last_undegraded":"2024-04-25T02:11:55.602299+0000","last_fullsized":"2024-04-25T02:11:55.602299+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616552+0000","last_change":"2024-04-25T02:11:55.615567+0000","last_active":"2024-04-25T02:11:55.616552+0000","last_peered":"2024-04-25T02:11:55.616552+0000","last_clean":"2024-04-25T02:11:55.616552+0000","last_became_active":"2024-04-25T02:11:55.615288+0000","last_became_peered":"2024-04-25T02:11:55.615288+0000","last_unstale":"2024-04-25T02:11:55.616552+0000","last_undegraded":"2024-04-25T02:11:55.616552+0000","last_fullsized":"2024-04-25T02:11:55.616552+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:55.860433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605971+0000","last_change":"2024-04-25T02:11:55.605971+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605971+0000","last_undegraded":"2024-04-25T02:11:55.605971+0000","last_fullsized":"2024-04-25T02:11:55.605971+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618315+0000","last_change":"2024-04-25T02:11:55.613928+0000","last_active":"2024-04-25T02:11:55.618315+0000","last_peered":"2024-04-25T02:11:55.618315+0000","last_clean":"2024-04-25T02:11:55.618315+0000","last_became_active":"2024-04-25T02:11:55.613174+0000","last_became_peered":"2024-04-25T02:11:55.613174+0000","last_unstale":"2024-04-25T02:11:55.618315+0000","last_undegraded":"2024-04-25T02:11:55.618315+0000","last_fullsized":"2024-04-25T02:11:55.618315+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:22.107459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.607765+0000","last_change":"2024-04-25T02:11:55.607765+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.607765+0000","last_undegraded":"2024-04-25T02:11:55.607765+0000","last_fullsized":"2024-04-25T02:11:55.607765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.619968+0000","last_change":"2024-04-25T02:11:55.614266+0000","last_active":"2024-04-25T02:11:55.619968+0000","last_peered":"2024-04-25T02:11:55.619968+0000","last_clean":"2024-04-25T02:11:55.619968+0000","last_became_active":"2024-04-25T02:11:55.613693+0000","last_became_peered":"2024-04-25T02:11:55.613693+0000","last_unstale":"2024-04-25T02:11:55.619968+0000","last_undegraded":"2024-04-25T02:11:55.619968+0000","last_fullsized":"2024-04-25T02:11:55.619968+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:09.177672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602641+0000","last_change":"2024-04-25T02:11:55.602641+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602641+0000","last_undegraded":"2024-04-25T02:11:55.602641+0000","last_fullsized":"2024-04-25T02:11:55.602641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618273+0000","last_change":"2024-04-25T02:11:55.613675+0000","last_active":"2024-04-25T02:11:55.618273+0000","last_peered":"2024-04-25T02:11:55.618273+0000","last_clean":"2024-04-25T02:11:55.618273+0000","last_became_active":"2024-04-25T02:11:55.613419+0000","last_became_peered":"2024-04-25T02:11:55.613419+0000","last_unstale":"2024-04-25T02:11:55.618273+0000","last_undegraded":"2024-04-25T02:11:55.618273+0000","last_fullsized":"2024-04-25T02:11:55.618273+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:39.445877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609451+0000","last_change":"2024-04-25T02:11:55.609451+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609451+0000","last_undegraded":"2024-04-25T02:11:55.609451+0000","last_fullsized":"2024-04-25T02:11:55.609451+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618578+0000","last_change":"2024-04-25T02:11:55.614522+0000","last_active":"2024-04-25T02:11:55.618578+0000","last_peered":"2024-04-25T02:11:55.618578+0000","last_clean":"2024-04-25T02:11:55.618578+0000","last_became_active":"2024-04-25T02:11:55.614256+0000","last_became_peered":"2024-04-25T02:11:55.614256+0000","last_unstale":"2024-04-25T02:11:55.618578+0000","last_undegraded":"2024-04-25T02:11:55.618578+0000","last_fullsized":"2024-04-25T02:11:55.618578+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:19.338202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605325+0000","last_change":"2024-04-25T02:11:55.605325+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605325+0000","last_undegraded":"2024-04-25T02:11:55.605325+0000","last_fullsized":"2024-04-25T02:11:55.605325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.612985+0000","last_change":"2024-04-25T02:11:55.609657+0000","last_active":"2024-04-25T02:11:55.612985+0000","last_peered":"2024-04-25T02:11:55.612985+0000","last_clean":"2024-04-25T02:11:55.612985+0000","last_became_active":"2024-04-25T02:11:55.609375+0000","last_became_peered":"2024-04-25T02:11:55.609375+0000","last_unstale":"2024-04-25T02:11:55.612985+0000","last_undegraded":"2024-04-25T02:11:55.612985+0000","last_fullsized":"2024-04-25T02:11:55.612985+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:36:16.079285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.607193+0000","last_change":"2024-04-25T02:11:55.607193+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.607193+0000","last_undegraded":"2024-04-25T02:11:55.607193+0000","last_fullsized":"2024-04-25T02:11:55.607193+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.613636+0000","last_change":"2024-04-25T02:11:55.611952+0000","last_active":"2024-04-25T02:11:55.613636+0000","last_peered":"2024-04-25T02:11:55.613636+0000","last_clean":"2024-04-25T02:11:55.613636+0000","last_became_active":"2024-04-25T02:11:55.611645+0000","last_became_peered":"2024-04-25T02:11:55.611645+0000","last_unstale":"2024-04-25T02:11:55.613636+0000","last_undegraded":"2024-04-25T02:11:55.613636+0000","last_fullsized":"2024-04-25T02:11:55.613636+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:29.500026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603696+0000","last_change":"2024-04-25T02:11:55.603696+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603696+0000","last_undegraded":"2024-04-25T02:11:55.603696+0000","last_fullsized":"2024-04-25T02:11:55.603696+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618344+0000","last_change":"2024-04-25T02:11:55.616970+0000","last_active":"2024-04-25T02:11:55.618344+0000","last_peered":"2024-04-25T02:11:55.618344+0000","last_clean":"2024-04-25T02:11:55.618344+0000","last_became_active":"2024-04-25T02:11:55.616677+0000","last_became_peered":"2024-04-25T02:11:55.616677+0000","last_unstale":"2024-04-25T02:11:55.618344+0000","last_undegraded":"2024-04-25T02:11:55.618344+0000","last_fullsized":"2024-04-25T02:11:55.618344+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:53:40.413609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":256,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.607463+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:11:55.607463+0000","last_peered":"2024-04-25T02:11:55.607463+0000","last_clean":"2024-04-25T02:11:55.607463+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:11:55.607463+0000","last_undegraded":"2024-04-25T02:11:55.607463+0000","last_fullsized":"2024-04-25T02:11:55.607463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1433600,"data_stored":939408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":342765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":342765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28408,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343432,"statfs":{"total":96636764160,"available":96607674368,"internally_reserved":0,"allocated":1421312,"data_stored":933133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:11:59.582 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:11:59.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.703+0000 7ffaa484d640 1 Processor -- start 2024-04-25T02:11:59.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.703+0000 7ffaa484d640 1 -- start start 2024-04-25T02:11:59.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.704+0000 7ffaa484d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ffaa0143bc0 0x7ffaa015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.704+0000 7ffaa484d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa00b3d40 0x7ffaa006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.704+0000 7ffaa484d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaa015fa40 con 0x7ffaa006df50 2024-04-25T02:11:59.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.705+0000 7ffaa484d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa006e8f0 con 0x7ffaa0143bc0 2024-04-25T02:11:59.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.705+0000 7ffaa484d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa0072cb0 con 0x7ffaa00b3d40 2024-04-25T02:11:59.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.705+0000 7ffa9e59c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ffaa0143bc0 0x7ffaa015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.705+0000 7ffa9ed9d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa00b3d40 0x7ffaa006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.705+0000 7ffa9e59c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ffaa0143bc0 0x7ffaa015f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:60128/0 (socket says 172.21.15.79:60128) 2024-04-25T02:11:59.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.705+0000 7ffa9ed9d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa00b3d40 0x7ffaa006e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:48726/0 (socket says 172.21.15.79:48726) 2024-04-25T02:11:59.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.705+0000 7ffa9e59c640 1 -- 172.21.15.79:0/2191038994 learned_addr learned my addr 172.21.15.79:0/2191038994 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:59.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.705+0000 7ffa9e59c640 1 -- 172.21.15.79:0/2191038994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa00b3d40 msgr2=0x7ffaa006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:59.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.705+0000 7ffa9e59c640 1 --2- 172.21.15.79:0/2191038994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa00b3d40 0x7ffaa006e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.705+0000 7ffa9e59c640 1 -- 172.21.15.79:0/2191038994 >> v1:172.21.15.189:6789/0 conn(0x7ffaa006df50 legacy=0x7ffaa00b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.705+0000 7ffa9e59c640 1 -- 172.21.15.79:0/2191038994 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa0071e00 con 0x7ffaa0143bc0 2024-04-25T02:11:59.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.705+0000 7ffa9ed9d640 1 --2- 172.21.15.79:0/2191038994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa00b3d40 0x7ffaa006e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:59.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.706+0000 7ffa9e59c640 1 --2- 172.21.15.79:0/2191038994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa0143bc0 0x7ffaa015f500 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffa90009870 tx=0x7ffa9002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e09dbebea638571a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:59.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.706+0000 7ffa9d59a640 1 -- 172.21.15.79:0/2191038994 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90037070 con 0x7ffaa0143bc0 2024-04-25T02:11:59.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.706+0000 7ffa9d59a640 1 -- 172.21.15.79:0/2191038994 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa90032440 con 0x7ffaa0143bc0 2024-04-25T02:11:59.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.706+0000 7ffa9d59a640 1 -- 172.21.15.79:0/2191038994 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90032810 con 0x7ffaa0143bc0 2024-04-25T02:11:59.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.707+0000 7ffaa484d640 1 -- 172.21.15.79:0/2191038994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa0143bc0 msgr2=0x7ffaa015f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.707+0000 7ffaa484d640 1 --2- 172.21.15.79:0/2191038994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa0143bc0 0x7ffaa015f500 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffa90009870 tx=0x7ffa9002a1c0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.707+0000 7ffaa484d640 1 -- 172.21.15.79:0/2191038994 shutdown_connections 2024-04-25T02:11:59.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.707+0000 7ffaa484d640 1 --2- 172.21.15.79:0/2191038994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa00b3d40 0x7ffaa006e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.707+0000 7ffaa484d640 1 --2- 172.21.15.79:0/2191038994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa0143bc0 0x7ffaa015f500 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.707+0000 7ffaa484d640 1 -- 172.21.15.79:0/2191038994 >> 172.21.15.79:0/2191038994 conn(0x7ffaa00cfc80 msgr2=0x7ffaa00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:59.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.707+0000 7ffaa484d640 1 -- 172.21.15.79:0/2191038994 shutdown_connections 2024-04-25T02:11:59.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.707+0000 7ffaa484d640 1 -- 172.21.15.79:0/2191038994 wait complete. 2024-04-25T02:11:59.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.708+0000 7ffaa484d640 1 Processor -- start 2024-04-25T02:11:59.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.708+0000 7ffaa484d640 1 -- start start 2024-04-25T02:11:59.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffaa484d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa006df50 0x7ffaa014d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffaa484d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa00b3d40 0x7ffaa013f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffaa484d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa0143bc0 0x7ffaa00ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffaa484d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa0072660 con 0x7ffaa00b3d40 2024-04-25T02:11:59.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffaa484d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa0072380 con 0x7ffaa006df50 2024-04-25T02:11:59.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffaa484d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa0072940 con 0x7ffaa0143bc0 2024-04-25T02:11:59.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffa9dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa00b3d40 0x7ffaa013f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffa9dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa00b3d40 0x7ffaa013f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59940/0 (socket says 172.21.15.79:59940) 2024-04-25T02:11:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffa9dd9b640 1 -- 172.21.15.79:0/3728966872 learned_addr learned my addr 172.21.15.79:0/3728966872 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:11:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffa9e59c640 1 --2- 172.21.15.79:0/3728966872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa006df50 0x7ffaa014d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffa9ed9d640 1 --2- 172.21.15.79:0/3728966872 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa0143bc0 0x7ffaa00ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffa9dd9b640 1 -- 172.21.15.79:0/3728966872 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa0143bc0 msgr2=0x7ffaa00ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffa9dd9b640 1 --2- 172.21.15.79:0/3728966872 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa0143bc0 0x7ffaa00ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffa9dd9b640 1 -- 172.21.15.79:0/3728966872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa006df50 msgr2=0x7ffaa014d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffa9dd9b640 1 --2- 172.21.15.79:0/3728966872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa006df50 0x7ffaa014d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffa9dd9b640 1 -- 172.21.15.79:0/3728966872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa00aea20 con 0x7ffaa00b3d40 2024-04-25T02:11:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffa9dd9b640 1 --2- 172.21.15.79:0/3728966872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa00b3d40 0x7ffaa013f730 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800c3c0 tx=0x7ffa8800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.709+0000 7ffa96ffd640 1 -- 172.21.15.79:0/3728966872 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa880052d0 con 0x7ffaa00b3d40 2024-04-25T02:11:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.710+0000 7ffa96ffd640 1 -- 172.21.15.79:0/3728966872 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa88005490 con 0x7ffaa00b3d40 2024-04-25T02:11:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.710+0000 7ffaa484d640 1 -- 172.21.15.79:0/3728966872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa00aed00 con 0x7ffaa00b3d40 2024-04-25T02:11:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.710+0000 7ffa96ffd640 1 -- 172.21.15.79:0/3728966872 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88007260 con 0x7ffaa00b3d40 2024-04-25T02:11:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.710+0000 7ffaa484d640 1 -- 172.21.15.79:0/3728966872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa014a8e0 con 0x7ffaa00b3d40 2024-04-25T02:11:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.711+0000 7ffaa484d640 1 -- 172.21.15.79:0/3728966872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa00cccb0 con 0x7ffaa00b3d40 2024-04-25T02:11:59.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.711+0000 7ffa96ffd640 1 -- 172.21.15.79:0/3728966872 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa88007400 con 0x7ffaa00b3d40 2024-04-25T02:11:59.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.711+0000 7ffa96ffd640 1 --2- 172.21.15.79:0/3728966872 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa8006be60 0x7ffa8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:59.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.711+0000 7ffa96ffd640 1 -- 172.21.15.79:0/3728966872 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7ffa8808a2f0 con 0x7ffaa00b3d40 2024-04-25T02:11:59.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.711+0000 7ffa9e59c640 1 --2- 172.21.15.79:0/3728966872 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa8006be60 0x7ffa8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:59.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.712+0000 7ffa9e59c640 1 --2- 172.21.15.79:0/3728966872 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa8006be60 0x7ffa8006e320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ffa90034000 tx=0x7ffa9002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:59.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.716+0000 7ffa96ffd640 1 -- 172.21.15.79:0/3728966872 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffaa00cccb0 con 0x7ffaa00b3d40 2024-04-25T02:11:59.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.885+0000 7ffaa484d640 1 -- 172.21.15.79:0/3728966872 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffaa00690a0 con 0x7ffa8006be60 2024-04-25T02:11:59.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.890+0000 7ffa96ffd640 1 -- 172.21.15.79:0/3728966872 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246754 (secure 0 0 0) 0x7ffaa00690a0 con 0x7ffa8006be60 2024-04-25T02:11:59.900 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:11:59.901 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:11:59.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.893+0000 7ffaa484d640 1 -- 172.21.15.79:0/3728966872 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa8006be60 msgr2=0x7ffa8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.893+0000 7ffaa484d640 1 --2- 172.21.15.79:0/3728966872 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa8006be60 0x7ffa8006e320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ffa90034000 tx=0x7ffa9002e000 comp rx=0 tx=0).stop 2024-04-25T02:11:59.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.893+0000 7ffaa484d640 1 -- 172.21.15.79:0/3728966872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa00b3d40 msgr2=0x7ffaa013f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.893+0000 7ffaa484d640 1 --2- 172.21.15.79:0/3728966872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa00b3d40 0x7ffaa013f730 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800c3c0 tx=0x7ffa8800c880 comp rx=0 tx=0).stop 2024-04-25T02:11:59.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.893+0000 7ffaa484d640 1 -- 172.21.15.79:0/3728966872 shutdown_connections 2024-04-25T02:11:59.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.893+0000 7ffaa484d640 1 --2- 172.21.15.79:0/3728966872 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa8006be60 0x7ffa8006e320 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.893+0000 7ffaa484d640 1 --2- 172.21.15.79:0/3728966872 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa0143bc0 0x7ffaa00ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.893+0000 7ffaa484d640 1 --2- 172.21.15.79:0/3728966872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa00b3d40 0x7ffaa013f730 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.893+0000 7ffaa484d640 1 --2- 172.21.15.79:0/3728966872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa006df50 0x7ffaa014d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:59.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.893+0000 7ffaa484d640 1 -- 172.21.15.79:0/3728966872 >> 172.21.15.79:0/3728966872 conn(0x7ffaa00cfc80 msgr2=0x7ffaa00b4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:59.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.893+0000 7ffaa484d640 1 -- 172.21.15.79:0/3728966872 shutdown_connections 2024-04-25T02:11:59.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:11:59.893+0000 7ffaa484d640 1 -- 172.21.15.79:0/3728966872 wait complete. 2024-04-25T02:11:59.911 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-04-25T02:11:59.224395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228020,"kb_used_data":7684,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746700,"statfs":{"total":773094113280,"available":772860620800,"internally_reserved":0,"allocated":7868416,"data_stored":3954231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.630354"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.607116+0000","last_change":"2024-04-25T02:11:55.607116+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.607116+0000","last_undegraded":"2024-04-25T02:11:55.607116+0000","last_fullsized":"2024-04-25T02:11:55.607116+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606916+0000","last_change":"2024-04-25T02:11:55.606916+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606916+0000","last_undegraded":"2024-04-25T02:11:55.606916+0000","last_fullsized":"2024-04-25T02:11:55.606916+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604826+0000","last_change":"2024-04-25T02:11:55.604826+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604826+0000","last_undegraded":"2024-04-25T02:11:55.604826+0000","last_fullsized":"2024-04-25T02:11:55.604826+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606076+0000","last_change":"2024-04-25T02:11:55.606076+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606076+0000","last_undegraded":"2024-04-25T02:11:55.606076+0000","last_fullsized":"2024-04-25T02:11:55.606076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604080+0000","last_change":"2024-04-25T02:11:55.604080+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604080+0000","last_undegraded":"2024-04-25T02:11:55.604080+0000","last_fullsized":"2024-04-25T02:11:55.604080+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609278+0000","last_change":"2024-04-25T02:11:55.609278+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609278+0000","last_undegraded":"2024-04-25T02:11:55.609278+0000","last_fullsized":"2024-04-25T02:11:55.609278+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604266+0000","last_change":"2024-04-25T02:11:55.604266+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604266+0000","last_undegraded":"2024-04-25T02:11:55.604266+0000","last_fullsized":"2024-04-25T02:11:55.604266+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606693+0000","last_change":"2024-04-25T02:11:55.606693+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606693+0000","last_undegraded":"2024-04-25T02:11:55.606693+0000","last_fullsized":"2024-04-25T02:11:55.606693+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603626+0000","last_change":"2024-04-25T02:11:55.603626+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603626+0000","last_undegraded":"2024-04-25T02:11:55.603626+0000","last_fullsized":"2024-04-25T02:11:55.603626+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605010+0000","last_change":"2024-04-25T02:11:55.605010+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605010+0000","last_undegraded":"2024-04-25T02:11:55.605010+0000","last_fullsized":"2024-04-25T02:11:55.605010+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608598+0000","last_change":"2024-04-25T02:11:55.608598+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608598+0000","last_undegraded":"2024-04-25T02:11:55.608598+0000","last_fullsized":"2024-04-25T02:11:55.608598+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605667+0000","last_change":"2024-04-25T02:11:55.605667+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605667+0000","last_undegraded":"2024-04-25T02:11:55.605667+0000","last_fullsized":"2024-04-25T02:11:55.605667+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608931+0000","last_change":"2024-04-25T02:11:55.608931+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608931+0000","last_undegraded":"2024-04-25T02:11:55.608931+0000","last_fullsized":"2024-04-25T02:11:55.608931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603722+0000","last_change":"2024-04-25T02:11:55.603722+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603722+0000","last_undegraded":"2024-04-25T02:11:55.603722+0000","last_fullsized":"2024-04-25T02:11:55.603722+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.610212+0000","last_change":"2024-04-25T02:11:55.610212+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.610212+0000","last_undegraded":"2024-04-25T02:11:55.610212+0000","last_fullsized":"2024-04-25T02:11:55.610212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601756+0000","last_change":"2024-04-25T02:11:55.601756+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601756+0000","last_undegraded":"2024-04-25T02:11:55.601756+0000","last_fullsized":"2024-04-25T02:11:55.601756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603211+0000","last_change":"2024-04-25T02:11:55.603211+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603211+0000","last_undegraded":"2024-04-25T02:11:55.603211+0000","last_fullsized":"2024-04-25T02:11:55.603211+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605847+0000","last_change":"2024-04-25T02:11:55.605847+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605847+0000","last_undegraded":"2024-04-25T02:11:55.605847+0000","last_fullsized":"2024-04-25T02:11:55.605847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.612150+0000","last_change":"2024-04-25T02:11:55.612150+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.612150+0000","last_undegraded":"2024-04-25T02:11:55.612150+0000","last_fullsized":"2024-04-25T02:11:55.612150+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608950+0000","last_change":"2024-04-25T02:11:55.608950+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608950+0000","last_undegraded":"2024-04-25T02:11:55.608950+0000","last_fullsized":"2024-04-25T02:11:55.608950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602062+0000","last_change":"2024-04-25T02:11:55.602062+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602062+0000","last_undegraded":"2024-04-25T02:11:55.602062+0000","last_fullsized":"2024-04-25T02:11:55.602062+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601413+0000","last_change":"2024-04-25T02:11:55.601413+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601413+0000","last_undegraded":"2024-04-25T02:11:55.601413+0000","last_fullsized":"2024-04-25T02:11:55.601413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605821+0000","last_change":"2024-04-25T02:11:55.605821+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605821+0000","last_undegraded":"2024-04-25T02:11:55.605821+0000","last_fullsized":"2024-04-25T02:11:55.605821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606765+0000","last_change":"2024-04-25T02:11:55.606765+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606765+0000","last_undegraded":"2024-04-25T02:11:55.606765+0000","last_fullsized":"2024-04-25T02:11:55.606765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603037+0000","last_change":"2024-04-25T02:11:55.603037+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603037+0000","last_undegraded":"2024-04-25T02:11:55.603037+0000","last_fullsized":"2024-04-25T02:11:55.603037+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603022+0000","last_change":"2024-04-25T02:11:55.603022+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603022+0000","last_undegraded":"2024-04-25T02:11:55.603022+0000","last_fullsized":"2024-04-25T02:11:55.603022+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604446+0000","last_change":"2024-04-25T02:11:55.604446+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604446+0000","last_undegraded":"2024-04-25T02:11:55.604446+0000","last_fullsized":"2024-04-25T02:11:55.604446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605200+0000","last_change":"2024-04-25T02:11:55.605200+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605200+0000","last_undegraded":"2024-04-25T02:11:55.605200+0000","last_fullsized":"2024-04-25T02:11:55.605200+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605575+0000","last_change":"2024-04-25T02:11:55.605575+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605575+0000","last_undegraded":"2024-04-25T02:11:55.605575+0000","last_fullsized":"2024-04-25T02:11:55.605575+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602055+0000","last_change":"2024-04-25T02:11:55.602055+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602055+0000","last_undegraded":"2024-04-25T02:11:55.602055+0000","last_fullsized":"2024-04-25T02:11:55.602055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602029+0000","last_change":"2024-04-25T02:11:55.602029+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602029+0000","last_undegraded":"2024-04-25T02:11:55.602029+0000","last_fullsized":"2024-04-25T02:11:55.602029+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606192+0000","last_change":"2024-04-25T02:11:55.606192+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606192+0000","last_undegraded":"2024-04-25T02:11:55.606192+0000","last_fullsized":"2024-04-25T02:11:55.606192+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605418+0000","last_change":"2024-04-25T02:11:55.605418+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605418+0000","last_undegraded":"2024-04-25T02:11:55.605418+0000","last_fullsized":"2024-04-25T02:11:55.605418+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617026+0000","last_change":"2024-04-25T02:11:55.615213+0000","last_active":"2024-04-25T02:11:55.617026+0000","last_peered":"2024-04-25T02:11:55.617026+0000","last_clean":"2024-04-25T02:11:55.617026+0000","last_became_active":"2024-04-25T02:11:55.614877+0000","last_became_peered":"2024-04-25T02:11:55.614877+0000","last_unstale":"2024-04-25T02:11:55.617026+0000","last_undegraded":"2024-04-25T02:11:55.617026+0000","last_fullsized":"2024-04-25T02:11:55.617026+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:12:40.303720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602766+0000","last_change":"2024-04-25T02:11:55.602766+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602766+0000","last_undegraded":"2024-04-25T02:11:55.602766+0000","last_fullsized":"2024-04-25T02:11:55.602766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620001+0000","last_change":"2024-04-25T02:11:55.617352+0000","last_active":"2024-04-25T02:11:55.620001+0000","last_peered":"2024-04-25T02:11:55.620001+0000","last_clean":"2024-04-25T02:11:55.620001+0000","last_became_active":"2024-04-25T02:11:55.617068+0000","last_became_peered":"2024-04-25T02:11:55.617068+0000","last_unstale":"2024-04-25T02:11:55.620001+0000","last_undegraded":"2024-04-25T02:11:55.620001+0000","last_fullsized":"2024-04-25T02:11:55.620001+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:32.851053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609311+0000","last_change":"2024-04-25T02:11:55.609311+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609311+0000","last_undegraded":"2024-04-25T02:11:55.609311+0000","last_fullsized":"2024-04-25T02:11:55.609311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620294+0000","last_change":"2024-04-25T02:11:55.618718+0000","last_active":"2024-04-25T02:11:55.620294+0000","last_peered":"2024-04-25T02:11:55.620294+0000","last_clean":"2024-04-25T02:11:55.620294+0000","last_became_active":"2024-04-25T02:11:55.618396+0000","last_became_peered":"2024-04-25T02:11:55.618396+0000","last_unstale":"2024-04-25T02:11:55.620294+0000","last_undegraded":"2024-04-25T02:11:55.620294+0000","last_fullsized":"2024-04-25T02:11:55.620294+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:34.747144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608194+0000","last_change":"2024-04-25T02:11:55.608194+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608194+0000","last_undegraded":"2024-04-25T02:11:55.608194+0000","last_fullsized":"2024-04-25T02:11:55.608194+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617620+0000","last_change":"2024-04-25T02:11:55.616480+0000","last_active":"2024-04-25T02:11:55.617620+0000","last_peered":"2024-04-25T02:11:55.617620+0000","last_clean":"2024-04-25T02:11:55.617620+0000","last_became_active":"2024-04-25T02:11:55.616118+0000","last_became_peered":"2024-04-25T02:11:55.616118+0000","last_unstale":"2024-04-25T02:11:55.617620+0000","last_undegraded":"2024-04-25T02:11:55.617620+0000","last_fullsized":"2024-04-25T02:11:55.617620+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:14.359235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601516+0000","last_change":"2024-04-25T02:11:55.601516+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601516+0000","last_undegraded":"2024-04-25T02:11:55.601516+0000","last_fullsized":"2024-04-25T02:11:55.601516+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618267+0000","last_change":"2024-04-25T02:11:55.616655+0000","last_active":"2024-04-25T02:11:55.618267+0000","last_peered":"2024-04-25T02:11:55.618267+0000","last_clean":"2024-04-25T02:11:55.618267+0000","last_became_active":"2024-04-25T02:11:55.616366+0000","last_became_peered":"2024-04-25T02:11:55.616366+0000","last_unstale":"2024-04-25T02:11:55.618267+0000","last_undegraded":"2024-04-25T02:11:55.618267+0000","last_fullsized":"2024-04-25T02:11:55.618267+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:31:02.982180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601638+0000","last_change":"2024-04-25T02:11:55.601638+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601638+0000","last_undegraded":"2024-04-25T02:11:55.601638+0000","last_fullsized":"2024-04-25T02:11:55.601638+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.621386+0000","last_change":"2024-04-25T02:11:55.620695+0000","last_active":"2024-04-25T02:11:55.621386+0000","last_peered":"2024-04-25T02:11:55.621386+0000","last_clean":"2024-04-25T02:11:55.621386+0000","last_became_active":"2024-04-25T02:11:55.620416+0000","last_became_peered":"2024-04-25T02:11:55.620416+0000","last_unstale":"2024-04-25T02:11:55.621386+0000","last_undegraded":"2024-04-25T02:11:55.621386+0000","last_fullsized":"2024-04-25T02:11:55.621386+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:57.604722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603002+0000","last_change":"2024-04-25T02:11:55.603002+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603002+0000","last_undegraded":"2024-04-25T02:11:55.603002+0000","last_fullsized":"2024-04-25T02:11:55.603002+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616285+0000","last_change":"2024-04-25T02:11:55.613841+0000","last_active":"2024-04-25T02:11:55.616285+0000","last_peered":"2024-04-25T02:11:55.616285+0000","last_clean":"2024-04-25T02:11:55.616285+0000","last_became_active":"2024-04-25T02:11:55.613576+0000","last_became_peered":"2024-04-25T02:11:55.613576+0000","last_unstale":"2024-04-25T02:11:55.616285+0000","last_undegraded":"2024-04-25T02:11:55.616285+0000","last_fullsized":"2024-04-25T02:11:55.616285+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:44.628098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609226+0000","last_change":"2024-04-25T02:11:55.609226+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609226+0000","last_undegraded":"2024-04-25T02:11:55.609226+0000","last_fullsized":"2024-04-25T02:11:55.609226+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617573+0000","last_change":"2024-04-25T02:11:55.609302+0000","last_active":"2024-04-25T02:11:55.617573+0000","last_peered":"2024-04-25T02:11:55.617573+0000","last_clean":"2024-04-25T02:11:55.617573+0000","last_became_active":"2024-04-25T02:11:55.609033+0000","last_became_peered":"2024-04-25T02:11:55.609033+0000","last_unstale":"2024-04-25T02:11:55.617573+0000","last_undegraded":"2024-04-25T02:11:55.617573+0000","last_fullsized":"2024-04-25T02:11:55.617573+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:13.254074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602583+0000","last_change":"2024-04-25T02:11:55.602583+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602583+0000","last_undegraded":"2024-04-25T02:11:55.602583+0000","last_fullsized":"2024-04-25T02:11:55.602583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.619414+0000","last_change":"2024-04-25T02:11:55.617474+0000","last_active":"2024-04-25T02:11:55.619414+0000","last_peered":"2024-04-25T02:11:55.619414+0000","last_clean":"2024-04-25T02:11:55.619414+0000","last_became_active":"2024-04-25T02:11:55.617093+0000","last_became_peered":"2024-04-25T02:11:55.617093+0000","last_unstale":"2024-04-25T02:11:55.619414+0000","last_undegraded":"2024-04-25T02:11:55.619414+0000","last_fullsized":"2024-04-25T02:11:55.619414+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:09.181237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606693+0000","last_change":"2024-04-25T02:11:55.606693+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606693+0000","last_undegraded":"2024-04-25T02:11:55.606693+0000","last_fullsized":"2024-04-25T02:11:55.606693+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617368+0000","last_change":"2024-04-25T02:11:55.614158+0000","last_active":"2024-04-25T02:11:55.617368+0000","last_peered":"2024-04-25T02:11:55.617368+0000","last_clean":"2024-04-25T02:11:55.617368+0000","last_became_active":"2024-04-25T02:11:55.613879+0000","last_became_peered":"2024-04-25T02:11:55.613879+0000","last_unstale":"2024-04-25T02:11:55.617368+0000","last_undegraded":"2024-04-25T02:11:55.617368+0000","last_fullsized":"2024-04-25T02:11:55.617368+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:38.580085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608839+0000","last_change":"2024-04-25T02:11:55.608839+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608839+0000","last_undegraded":"2024-04-25T02:11:55.608839+0000","last_fullsized":"2024-04-25T02:11:55.608839+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.615572+0000","last_change":"2024-04-25T02:11:55.613806+0000","last_active":"2024-04-25T02:11:55.615572+0000","last_peered":"2024-04-25T02:11:55.615572+0000","last_clean":"2024-04-25T02:11:55.615572+0000","last_became_active":"2024-04-25T02:11:55.613252+0000","last_became_peered":"2024-04-25T02:11:55.613252+0000","last_unstale":"2024-04-25T02:11:55.615572+0000","last_undegraded":"2024-04-25T02:11:55.615572+0000","last_fullsized":"2024-04-25T02:11:55.615572+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:54.406276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603305+0000","last_change":"2024-04-25T02:11:55.603305+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603305+0000","last_undegraded":"2024-04-25T02:11:55.603305+0000","last_fullsized":"2024-04-25T02:11:55.603305+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620176+0000","last_change":"2024-04-25T02:11:55.616655+0000","last_active":"2024-04-25T02:11:55.620176+0000","last_peered":"2024-04-25T02:11:55.620176+0000","last_clean":"2024-04-25T02:11:55.620176+0000","last_became_active":"2024-04-25T02:11:55.616393+0000","last_became_peered":"2024-04-25T02:11:55.616393+0000","last_unstale":"2024-04-25T02:11:55.620176+0000","last_undegraded":"2024-04-25T02:11:55.620176+0000","last_fullsized":"2024-04-25T02:11:55.620176+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:19.912700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606210+0000","last_change":"2024-04-25T02:11:55.606210+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606210+0000","last_undegraded":"2024-04-25T02:11:55.606210+0000","last_fullsized":"2024-04-25T02:11:55.606210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.614348+0000","last_change":"2024-04-25T02:11:55.611138+0000","last_active":"2024-04-25T02:11:55.614348+0000","last_peered":"2024-04-25T02:11:55.614348+0000","last_clean":"2024-04-25T02:11:55.614348+0000","last_became_active":"2024-04-25T02:11:55.610838+0000","last_became_peered":"2024-04-25T02:11:55.610838+0000","last_unstale":"2024-04-25T02:11:55.614348+0000","last_undegraded":"2024-04-25T02:11:55.614348+0000","last_fullsized":"2024-04-25T02:11:55.614348+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:53.559794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604175+0000","last_change":"2024-04-25T02:11:55.604175+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604175+0000","last_undegraded":"2024-04-25T02:11:55.604175+0000","last_fullsized":"2024-04-25T02:11:55.604175+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620834+0000","last_change":"2024-04-25T02:11:55.618236+0000","last_active":"2024-04-25T02:11:55.620834+0000","last_peered":"2024-04-25T02:11:55.620834+0000","last_clean":"2024-04-25T02:11:55.620834+0000","last_became_active":"2024-04-25T02:11:55.617800+0000","last_became_peered":"2024-04-25T02:11:55.617800+0000","last_unstale":"2024-04-25T02:11:55.620834+0000","last_undegraded":"2024-04-25T02:11:55.620834+0000","last_fullsized":"2024-04-25T02:11:55.620834+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:12.740028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608536+0000","last_change":"2024-04-25T02:11:55.608536+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608536+0000","last_undegraded":"2024-04-25T02:11:55.608536+0000","last_fullsized":"2024-04-25T02:11:55.608536+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616039+0000","last_change":"2024-04-25T02:11:55.614787+0000","last_active":"2024-04-25T02:11:55.616039+0000","last_peered":"2024-04-25T02:11:55.616039+0000","last_clean":"2024-04-25T02:11:55.616039+0000","last_became_active":"2024-04-25T02:11:55.614456+0000","last_became_peered":"2024-04-25T02:11:55.614456+0000","last_unstale":"2024-04-25T02:11:55.616039+0000","last_undegraded":"2024-04-25T02:11:55.616039+0000","last_fullsized":"2024-04-25T02:11:55.616039+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:00.242853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602723+0000","last_change":"2024-04-25T02:11:55.602723+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602723+0000","last_undegraded":"2024-04-25T02:11:55.602723+0000","last_fullsized":"2024-04-25T02:11:55.602723+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616780+0000","last_change":"2024-04-25T02:11:55.613116+0000","last_active":"2024-04-25T02:11:55.616780+0000","last_peered":"2024-04-25T02:11:55.616780+0000","last_clean":"2024-04-25T02:11:55.616780+0000","last_became_active":"2024-04-25T02:11:55.612711+0000","last_became_peered":"2024-04-25T02:11:55.612711+0000","last_unstale":"2024-04-25T02:11:55.616780+0000","last_undegraded":"2024-04-25T02:11:55.616780+0000","last_fullsized":"2024-04-25T02:11:55.616780+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:21.747623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604604+0000","last_change":"2024-04-25T02:11:55.604604+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604604+0000","last_undegraded":"2024-04-25T02:11:55.604604+0000","last_fullsized":"2024-04-25T02:11:55.604604+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617335+0000","last_change":"2024-04-25T02:11:55.613889+0000","last_active":"2024-04-25T02:11:55.617335+0000","last_peered":"2024-04-25T02:11:55.617335+0000","last_clean":"2024-04-25T02:11:55.617335+0000","last_became_active":"2024-04-25T02:11:55.613613+0000","last_became_peered":"2024-04-25T02:11:55.613613+0000","last_unstale":"2024-04-25T02:11:55.617335+0000","last_undegraded":"2024-04-25T02:11:55.617335+0000","last_fullsized":"2024-04-25T02:11:55.617335+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:43.656103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605299+0000","last_change":"2024-04-25T02:11:55.605299+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605299+0000","last_undegraded":"2024-04-25T02:11:55.605299+0000","last_fullsized":"2024-04-25T02:11:55.605299+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620314+0000","last_change":"2024-04-25T02:11:55.618770+0000","last_active":"2024-04-25T02:11:55.620314+0000","last_peered":"2024-04-25T02:11:55.620314+0000","last_clean":"2024-04-25T02:11:55.620314+0000","last_became_active":"2024-04-25T02:11:55.618388+0000","last_became_peered":"2024-04-25T02:11:55.618388+0000","last_unstale":"2024-04-25T02:11:55.620314+0000","last_undegraded":"2024-04-25T02:11:55.620314+0000","last_fullsized":"2024-04-25T02:11:55.620314+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:22.677232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605216+0000","last_change":"2024-04-25T02:11:55.605216+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605216+0000","last_undegraded":"2024-04-25T02:11:55.605216+0000","last_fullsized":"2024-04-25T02:11:55.605216+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620981+0000","last_change":"2024-04-25T02:11:55.619965+0000","last_active":"2024-04-25T02:11:55.620981+0000","last_peered":"2024-04-25T02:11:55.620981+0000","last_clean":"2024-04-25T02:11:55.620981+0000","last_became_active":"2024-04-25T02:11:55.619679+0000","last_became_peered":"2024-04-25T02:11:55.619679+0000","last_unstale":"2024-04-25T02:11:55.620981+0000","last_undegraded":"2024-04-25T02:11:55.620981+0000","last_fullsized":"2024-04-25T02:11:55.620981+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:44.145676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602751+0000","last_change":"2024-04-25T02:11:55.602751+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602751+0000","last_undegraded":"2024-04-25T02:11:55.602751+0000","last_fullsized":"2024-04-25T02:11:55.602751+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617781+0000","last_change":"2024-04-25T02:11:55.616188+0000","last_active":"2024-04-25T02:11:55.617781+0000","last_peered":"2024-04-25T02:11:55.617781+0000","last_clean":"2024-04-25T02:11:55.617781+0000","last_became_active":"2024-04-25T02:11:55.615921+0000","last_became_peered":"2024-04-25T02:11:55.615921+0000","last_unstale":"2024-04-25T02:11:55.617781+0000","last_undegraded":"2024-04-25T02:11:55.617781+0000","last_fullsized":"2024-04-25T02:11:55.617781+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:52.550255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605182+0000","last_change":"2024-04-25T02:11:55.605182+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605182+0000","last_undegraded":"2024-04-25T02:11:55.605182+0000","last_fullsized":"2024-04-25T02:11:55.605182+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.621373+0000","last_change":"2024-04-25T02:11:55.620628+0000","last_active":"2024-04-25T02:11:55.621373+0000","last_peered":"2024-04-25T02:11:55.621373+0000","last_clean":"2024-04-25T02:11:55.621373+0000","last_became_active":"2024-04-25T02:11:55.620360+0000","last_became_peered":"2024-04-25T02:11:55.620360+0000","last_unstale":"2024-04-25T02:11:55.621373+0000","last_undegraded":"2024-04-25T02:11:55.621373+0000","last_fullsized":"2024-04-25T02:11:55.621373+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:49.417443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603999+0000","last_change":"2024-04-25T02:11:55.603999+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603999+0000","last_undegraded":"2024-04-25T02:11:55.603999+0000","last_fullsized":"2024-04-25T02:11:55.603999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.613700+0000","last_change":"2024-04-25T02:11:55.611740+0000","last_active":"2024-04-25T02:11:55.613700+0000","last_peered":"2024-04-25T02:11:55.613700+0000","last_clean":"2024-04-25T02:11:55.613700+0000","last_became_active":"2024-04-25T02:11:55.611477+0000","last_became_peered":"2024-04-25T02:11:55.611477+0000","last_unstale":"2024-04-25T02:11:55.613700+0000","last_undegraded":"2024-04-25T02:11:55.613700+0000","last_fullsized":"2024-04-25T02:11:55.613700+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:41.075565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603657+0000","last_change":"2024-04-25T02:11:55.603657+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603657+0000","last_undegraded":"2024-04-25T02:11:55.603657+0000","last_fullsized":"2024-04-25T02:11:55.603657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620266+0000","last_change":"2024-04-25T02:11:55.618924+0000","last_active":"2024-04-25T02:11:55.620266+0000","last_peered":"2024-04-25T02:11:55.620266+0000","last_clean":"2024-04-25T02:11:55.620266+0000","last_became_active":"2024-04-25T02:11:55.618658+0000","last_became_peered":"2024-04-25T02:11:55.618658+0000","last_unstale":"2024-04-25T02:11:55.620266+0000","last_undegraded":"2024-04-25T02:11:55.620266+0000","last_fullsized":"2024-04-25T02:11:55.620266+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:41.849723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.610560+0000","last_change":"2024-04-25T02:11:55.610560+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.610560+0000","last_undegraded":"2024-04-25T02:11:55.610560+0000","last_fullsized":"2024-04-25T02:11:55.610560+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617652+0000","last_change":"2024-04-25T02:11:55.616514+0000","last_active":"2024-04-25T02:11:55.617652+0000","last_peered":"2024-04-25T02:11:55.617652+0000","last_clean":"2024-04-25T02:11:55.617652+0000","last_became_active":"2024-04-25T02:11:55.615526+0000","last_became_peered":"2024-04-25T02:11:55.615526+0000","last_unstale":"2024-04-25T02:11:55.617652+0000","last_undegraded":"2024-04-25T02:11:55.617652+0000","last_fullsized":"2024-04-25T02:11:55.617652+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:11.176893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602299+0000","last_change":"2024-04-25T02:11:55.602299+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602299+0000","last_undegraded":"2024-04-25T02:11:55.602299+0000","last_fullsized":"2024-04-25T02:11:55.602299+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616552+0000","last_change":"2024-04-25T02:11:55.615567+0000","last_active":"2024-04-25T02:11:55.616552+0000","last_peered":"2024-04-25T02:11:55.616552+0000","last_clean":"2024-04-25T02:11:55.616552+0000","last_became_active":"2024-04-25T02:11:55.615288+0000","last_became_peered":"2024-04-25T02:11:55.615288+0000","last_unstale":"2024-04-25T02:11:55.616552+0000","last_undegraded":"2024-04-25T02:11:55.616552+0000","last_fullsized":"2024-04-25T02:11:55.616552+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:55.860433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605971+0000","last_change":"2024-04-25T02:11:55.605971+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605971+0000","last_undegraded":"2024-04-25T02:11:55.605971+0000","last_fullsized":"2024-04-25T02:11:55.605971+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618315+0000","last_change":"2024-04-25T02:11:55.613928+0000","last_active":"2024-04-25T02:11:55.618315+0000","last_peered":"2024-04-25T02:11:55.618315+0000","last_clean":"2024-04-25T02:11:55.618315+0000","last_became_active":"2024-04-25T02:11:55.613174+0000","last_became_peered":"2024-04-25T02:11:55.613174+0000","last_unstale":"2024-04-25T02:11:55.618315+0000","last_undegraded":"2024-04-25T02:11:55.618315+0000","last_fullsized":"2024-04-25T02:11:55.618315+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:22.107459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.607765+0000","last_change":"2024-04-25T02:11:55.607765+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.607765+0000","last_undegraded":"2024-04-25T02:11:55.607765+0000","last_fullsized":"2024-04-25T02:11:55.607765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.619968+0000","last_change":"2024-04-25T02:11:55.614266+0000","last_active":"2024-04-25T02:11:55.619968+0000","last_peered":"2024-04-25T02:11:55.619968+0000","last_clean":"2024-04-25T02:11:55.619968+0000","last_became_active":"2024-04-25T02:11:55.613693+0000","last_became_peered":"2024-04-25T02:11:55.613693+0000","last_unstale":"2024-04-25T02:11:55.619968+0000","last_undegraded":"2024-04-25T02:11:55.619968+0000","last_fullsized":"2024-04-25T02:11:55.619968+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:09.177672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602641+0000","last_change":"2024-04-25T02:11:55.602641+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602641+0000","last_undegraded":"2024-04-25T02:11:55.602641+0000","last_fullsized":"2024-04-25T02:11:55.602641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618273+0000","last_change":"2024-04-25T02:11:55.613675+0000","last_active":"2024-04-25T02:11:55.618273+0000","last_peered":"2024-04-25T02:11:55.618273+0000","last_clean":"2024-04-25T02:11:55.618273+0000","last_became_active":"2024-04-25T02:11:55.613419+0000","last_became_peered":"2024-04-25T02:11:55.613419+0000","last_unstale":"2024-04-25T02:11:55.618273+0000","last_undegraded":"2024-04-25T02:11:55.618273+0000","last_fullsized":"2024-04-25T02:11:55.618273+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:39.445877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609451+0000","last_change":"2024-04-25T02:11:55.609451+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609451+0000","last_undegraded":"2024-04-25T02:11:55.609451+0000","last_fullsized":"2024-04-25T02:11:55.609451+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618578+0000","last_change":"2024-04-25T02:11:55.614522+0000","last_active":"2024-04-25T02:11:55.618578+0000","last_peered":"2024-04-25T02:11:55.618578+0000","last_clean":"2024-04-25T02:11:55.618578+0000","last_became_active":"2024-04-25T02:11:55.614256+0000","last_became_peered":"2024-04-25T02:11:55.614256+0000","last_unstale":"2024-04-25T02:11:55.618578+0000","last_undegraded":"2024-04-25T02:11:55.618578+0000","last_fullsized":"2024-04-25T02:11:55.618578+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:19.338202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605325+0000","last_change":"2024-04-25T02:11:55.605325+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605325+0000","last_undegraded":"2024-04-25T02:11:55.605325+0000","last_fullsized":"2024-04-25T02:11:55.605325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.612985+0000","last_change":"2024-04-25T02:11:55.609657+0000","last_active":"2024-04-25T02:11:55.612985+0000","last_peered":"2024-04-25T02:11:55.612985+0000","last_clean":"2024-04-25T02:11:55.612985+0000","last_became_active":"2024-04-25T02:11:55.609375+0000","last_became_peered":"2024-04-25T02:11:55.609375+0000","last_unstale":"2024-04-25T02:11:55.612985+0000","last_undegraded":"2024-04-25T02:11:55.612985+0000","last_fullsized":"2024-04-25T02:11:55.612985+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:36:16.079285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.607193+0000","last_change":"2024-04-25T02:11:55.607193+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.607193+0000","last_undegraded":"2024-04-25T02:11:55.607193+0000","last_fullsized":"2024-04-25T02:11:55.607193+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.613636+0000","last_change":"2024-04-25T02:11:55.611952+0000","last_active":"2024-04-25T02:11:55.613636+0000","last_peered":"2024-04-25T02:11:55.613636+0000","last_clean":"2024-04-25T02:11:55.613636+0000","last_became_active":"2024-04-25T02:11:55.611645+0000","last_became_peered":"2024-04-25T02:11:55.611645+0000","last_unstale":"2024-04-25T02:11:55.613636+0000","last_undegraded":"2024-04-25T02:11:55.613636+0000","last_fullsized":"2024-04-25T02:11:55.613636+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:29.500026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603696+0000","last_change":"2024-04-25T02:11:55.603696+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603696+0000","last_undegraded":"2024-04-25T02:11:55.603696+0000","last_fullsized":"2024-04-25T02:11:55.603696+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618344+0000","last_change":"2024-04-25T02:11:55.616970+0000","last_active":"2024-04-25T02:11:55.618344+0000","last_peered":"2024-04-25T02:11:55.618344+0000","last_clean":"2024-04-25T02:11:55.618344+0000","last_became_active":"2024-04-25T02:11:55.616677+0000","last_became_peered":"2024-04-25T02:11:55.616677+0000","last_unstale":"2024-04-25T02:11:55.618344+0000","last_undegraded":"2024-04-25T02:11:55.618344+0000","last_fullsized":"2024-04-25T02:11:55.618344+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:53:40.413609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":256,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.607463+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:11:55.607463+0000","last_peered":"2024-04-25T02:11:55.607463+0000","last_clean":"2024-04-25T02:11:55.607463+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:11:55.607463+0000","last_undegraded":"2024-04-25T02:11:55.607463+0000","last_fullsized":"2024-04-25T02:11:55.607463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1433600,"data_stored":939408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":342765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":342765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28408,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343432,"statfs":{"total":96636764160,"available":96607674368,"internally_reserved":0,"allocated":1421312,"data_stored":933133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:11:59.915 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:12:00.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.041+0000 7f38f2088640 1 Processor -- start 2024-04-25T02:12:00.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.041+0000 7f38f2088640 1 -- start start 2024-04-25T02:12:00.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38f2088640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38ec06df50 0x7f38ec06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38f2088640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ec071e00 con 0x7f38ec143bc0 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38f2088640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ec0720a0 con 0x7f38ec0b2d30 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38f2088640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec06e8f0 con 0x7f38ec06df50 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38eb7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f38ec143bc0 0x7f38ec15f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33056/0 (socket says 172.21.15.79:33056) 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38eb7fe640 1 -- 172.21.15.79:0/619288433 learned_addr learned my addr 172.21.15.79:0/619288433 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38eaffd640 1 --2- 172.21.15.79:0/619288433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38ec06df50 0x7f38ec06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38ea7fc640 1 -- 172.21.15.79:0/619288433 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132743469 0 0) 0x7f38ec071e00 con 0x7f38ec143bc0 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38ea7fc640 1 -- 172.21.15.79:0/619288433 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38d4003520 con 0x7f38ec143bc0 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38ea7fc640 1 -- 172.21.15.79:0/619288433 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1292554304 0 0) 0x7f38d4003520 con 0x7f38ec143bc0 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38ea7fc640 1 -- 172.21.15.79:0/619288433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38ec06df50 msgr2=0x7f38ec06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38ea7fc640 1 --2- 172.21.15.79:0/619288433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38ec06df50 0x7f38ec06e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38ea7fc640 1 -- 172.21.15.79:0/619288433 >> v1:172.21.15.189:6789/0 conn(0x7f38ec0b2d30 legacy=0x7f38ec0b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38ea7fc640 1 -- 172.21.15.79:0/619288433 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec072380 con 0x7f38ec143bc0 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38ea7fc640 1 -- 172.21.15.79:0/619288433 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f38dc001670 con 0x7f38ec143bc0 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38eaffd640 1 --2- 172.21.15.79:0/619288433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38ec06df50 0x7f38ec06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38ea7fc640 1 -- 172.21.15.79:0/619288433 >> v1:172.21.15.79:6789/0 conn(0x7f38ec143bc0 legacy=0x7f38ec15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38ea7fc640 1 --2- 172.21.15.79:0/619288433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d40039e0 0x7f38d4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38ea7fc640 1 --2- 172.21.15.79:0/619288433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d4004390 0x7f38d4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38ea7fc640 1 --2- 172.21.15.79:0/619288433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38ec06df50 0x7f38d4005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38ea7fc640 1 -- 172.21.15.79:0/619288433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f38d400b9e0 con 0x7f38d4004390 2024-04-25T02:12:00.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38ea7fc640 1 -- 172.21.15.79:0/619288433 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f38d400bb90 con 0x7f38d40039e0 2024-04-25T02:12:00.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38ea7fc640 1 -- 172.21.15.79:0/619288433 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f38d400bd90 con 0x7f38ec06df50 2024-04-25T02:12:00.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.042+0000 7f38eaffd640 1 --2- 172.21.15.79:0/619288433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d4004390 0x7f38d4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.043+0000 7f38eb7fe640 1 --2- 172.21.15.79:0/619288433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d40039e0 0x7f38d4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.043+0000 7f38ebfff640 1 --2- 172.21.15.79:0/619288433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38ec06df50 0x7f38d4005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.043+0000 7f38eaffd640 1 -- 172.21.15.79:0/619288433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38ec06df50 msgr2=0x7f38d4005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:00.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.043+0000 7f38eaffd640 1 --2- 172.21.15.79:0/619288433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38ec06df50 0x7f38d4005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.043+0000 7f38eaffd640 1 -- 172.21.15.79:0/619288433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d40039e0 msgr2=0x7f38d4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:00.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.043+0000 7f38eaffd640 1 --2- 172.21.15.79:0/619288433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d40039e0 0x7f38d4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.043+0000 7f38eaffd640 1 -- 172.21.15.79:0/619288433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d4003520 con 0x7f38d4004390 2024-04-25T02:12:00.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.043+0000 7f38eaffd640 1 --2- 172.21.15.79:0/619288433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d4004390 0x7f38d4004860 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f38e0009c90 tx=0x7f38d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ddec2e2404838c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.043+0000 7f38ea7fc640 1 -- 172.21.15.79:0/619288433 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e0036070 con 0x7f38d4004390 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.043+0000 7f38ea7fc640 1 -- 172.21.15.79:0/619288433 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38e0031400 con 0x7f38d4004390 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.043+0000 7f38ea7fc640 1 -- 172.21.15.79:0/619288433 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e0009860 con 0x7f38d4004390 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.044+0000 7f38f2088640 1 -- 172.21.15.79:0/619288433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d4004390 msgr2=0x7f38d4004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.044+0000 7f38f2088640 1 --2- 172.21.15.79:0/619288433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d4004390 0x7f38d4004860 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f38e0009c90 tx=0x7f38d4005830 comp rx=0 tx=0).stop 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.044+0000 7f38ebfff640 1 -- 172.21.15.79:0/619288433 reap_dead start 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.044+0000 7f38f2088640 1 -- 172.21.15.79:0/619288433 shutdown_connections 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.044+0000 7f38f2088640 1 -- 172.21.15.79:0/619288433 >> 172.21.15.79:0/619288433 conn(0x7f38ec0cfc80 msgr2=0x7f38ec0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.044+0000 7f38f2088640 1 -- 172.21.15.79:0/619288433 shutdown_connections 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.044+0000 7f38f2088640 1 -- 172.21.15.79:0/619288433 wait complete. 2024-04-25T02:12:00.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.045+0000 7f38f2088640 1 Processor -- start 2024-04-25T02:12:00.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.045+0000 7f38f2088640 1 -- start start 2024-04-25T02:12:00.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38f2088640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d4004390 0x7f38ec14b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38f2088640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38ec0ac8e0 0x7f38ec1f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38f2088640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38ec0acd60 0x7f38ec1f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38f2088640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec072940 con 0x7f38ec0ac8e0 2024-04-25T02:12:00.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38f2088640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec072cb0 con 0x7f38d4004390 2024-04-25T02:12:00.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38f2088640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec143fa0 con 0x7f38ec0acd60 2024-04-25T02:12:00.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38eaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38ec0ac8e0 0x7f38ec1f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38eaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38ec0ac8e0 0x7f38ec1f4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59960/0 (socket says 172.21.15.79:59960) 2024-04-25T02:12:00.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38eaffd640 1 -- 172.21.15.79:0/414500696 learned_addr learned my addr 172.21.15.79:0/414500696 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:00.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38ebfff640 1 --2- 172.21.15.79:0/414500696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38ec0acd60 0x7f38ec1f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38eb7fe640 1 --2- 172.21.15.79:0/414500696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d4004390 0x7f38ec14b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38eaffd640 1 -- 172.21.15.79:0/414500696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38ec0acd60 msgr2=0x7f38ec1f5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38eaffd640 1 --2- 172.21.15.79:0/414500696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38ec0acd60 0x7f38ec1f5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38eaffd640 1 -- 172.21.15.79:0/414500696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d4004390 msgr2=0x7f38ec14b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38eaffd640 1 --2- 172.21.15.79:0/414500696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d4004390 0x7f38ec14b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.046+0000 7f38eaffd640 1 -- 172.21.15.79:0/414500696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec1f5880 con 0x7f38ec0ac8e0 2024-04-25T02:12:00.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.047+0000 7f38eaffd640 1 --2- 172.21.15.79:0/414500696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38ec0ac8e0 0x7f38ec1f4e00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f38e0000c00 tx=0x7f38e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:00.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.047+0000 7f38d3fff640 1 -- 172.21.15.79:0/414500696 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e0040070 con 0x7f38ec0ac8e0 2024-04-25T02:12:00.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.047+0000 7f38d3fff640 1 -- 172.21.15.79:0/414500696 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38e00093e0 con 0x7f38ec0ac8e0 2024-04-25T02:12:00.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.047+0000 7f38d3fff640 1 -- 172.21.15.79:0/414500696 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e0036040 con 0x7f38ec0ac8e0 2024-04-25T02:12:00.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.047+0000 7f38f2088640 1 -- 172.21.15.79:0/414500696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ec1f5b30 con 0x7f38ec0ac8e0 2024-04-25T02:12:00.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.047+0000 7f38f2088640 1 -- 172.21.15.79:0/414500696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ec0b3640 con 0x7f38ec0ac8e0 2024-04-25T02:12:00.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.048+0000 7f38f2088640 1 -- 172.21.15.79:0/414500696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38ec0b3150 con 0x7f38ec0ac8e0 2024-04-25T02:12:00.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.048+0000 7f38d3fff640 1 -- 172.21.15.79:0/414500696 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38e0043070 con 0x7f38ec0ac8e0 2024-04-25T02:12:00.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.049+0000 7f38d3fff640 1 --2- 172.21.15.79:0/414500696 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f38d806be30 0x7f38d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.049+0000 7f38d3fff640 1 -- 172.21.15.79:0/414500696 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f38e00ab3c0 con 0x7f38ec0ac8e0 2024-04-25T02:12:00.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.049+0000 7f38eb7fe640 1 --2- 172.21.15.79:0/414500696 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f38d806be30 0x7f38d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.049+0000 7f38eb7fe640 1 --2- 172.21.15.79:0/414500696 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f38d806be30 0x7f38d806e2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0010e0 tx=0x7f38dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:00.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.053+0000 7f38d3fff640 1 -- 172.21.15.79:0/414500696 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f38e0079720 con 0x7f38ec0ac8e0 2024-04-25T02:12:00.170 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:12:00.173 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:12:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.225+0000 7f38f2088640 1 -- 172.21.15.79:0/414500696 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f38ec0cdb10 con 0x7f38d806be30 2024-04-25T02:12:00.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.231+0000 7f38d3fff640 1 -- 172.21.15.79:0/414500696 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246754 (secure 0 0 0) 0x7f38ec0cdb10 con 0x7f38d806be30 2024-04-25T02:12:00.241 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:12:00.242 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:12:00.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.234+0000 7f38f2088640 1 -- 172.21.15.79:0/414500696 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f38d806be30 msgr2=0x7f38d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.234+0000 7f38f2088640 1 --2- 172.21.15.79:0/414500696 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f38d806be30 0x7f38d806e2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0010e0 tx=0x7f38dc009040 comp rx=0 tx=0).stop 2024-04-25T02:12:00.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.234+0000 7f38f2088640 1 -- 172.21.15.79:0/414500696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38ec0ac8e0 msgr2=0x7f38ec1f4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.234+0000 7f38f2088640 1 --2- 172.21.15.79:0/414500696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38ec0ac8e0 0x7f38ec1f4e00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f38e0000c00 tx=0x7f38e0004730 comp rx=0 tx=0).stop 2024-04-25T02:12:00.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.234+0000 7f38f2088640 1 -- 172.21.15.79:0/414500696 shutdown_connections 2024-04-25T02:12:00.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.234+0000 7f38f2088640 1 --2- 172.21.15.79:0/414500696 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f38d806be30 0x7f38d806e2f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.234+0000 7f38f2088640 1 --2- 172.21.15.79:0/414500696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38ec0acd60 0x7f38ec1f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.234+0000 7f38f2088640 1 --2- 172.21.15.79:0/414500696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38ec0ac8e0 0x7f38ec1f4e00 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.234+0000 7f38f2088640 1 --2- 172.21.15.79:0/414500696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d4004390 0x7f38ec14b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.234+0000 7f38f2088640 1 -- 172.21.15.79:0/414500696 >> 172.21.15.79:0/414500696 conn(0x7f38ec0cfc80 msgr2=0x7f38ec15ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:00.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.234+0000 7f38f2088640 1 -- 172.21.15.79:0/414500696 shutdown_connections 2024-04-25T02:12:00.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.234+0000 7f38f2088640 1 -- 172.21.15.79:0/414500696 wait complete. 2024-04-25T02:12:00.252 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-04-25T02:11:59.224395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228020,"kb_used_data":7684,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746700,"statfs":{"total":773094113280,"available":772860620800,"internally_reserved":0,"allocated":7868416,"data_stored":3954231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.630354"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.607116+0000","last_change":"2024-04-25T02:11:55.607116+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.607116+0000","last_undegraded":"2024-04-25T02:11:55.607116+0000","last_fullsized":"2024-04-25T02:11:55.607116+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606916+0000","last_change":"2024-04-25T02:11:55.606916+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606916+0000","last_undegraded":"2024-04-25T02:11:55.606916+0000","last_fullsized":"2024-04-25T02:11:55.606916+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604826+0000","last_change":"2024-04-25T02:11:55.604826+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604826+0000","last_undegraded":"2024-04-25T02:11:55.604826+0000","last_fullsized":"2024-04-25T02:11:55.604826+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606076+0000","last_change":"2024-04-25T02:11:55.606076+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606076+0000","last_undegraded":"2024-04-25T02:11:55.606076+0000","last_fullsized":"2024-04-25T02:11:55.606076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604080+0000","last_change":"2024-04-25T02:11:55.604080+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604080+0000","last_undegraded":"2024-04-25T02:11:55.604080+0000","last_fullsized":"2024-04-25T02:11:55.604080+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609278+0000","last_change":"2024-04-25T02:11:55.609278+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609278+0000","last_undegraded":"2024-04-25T02:11:55.609278+0000","last_fullsized":"2024-04-25T02:11:55.609278+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604266+0000","last_change":"2024-04-25T02:11:55.604266+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604266+0000","last_undegraded":"2024-04-25T02:11:55.604266+0000","last_fullsized":"2024-04-25T02:11:55.604266+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606693+0000","last_change":"2024-04-25T02:11:55.606693+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606693+0000","last_undegraded":"2024-04-25T02:11:55.606693+0000","last_fullsized":"2024-04-25T02:11:55.606693+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603626+0000","last_change":"2024-04-25T02:11:55.603626+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603626+0000","last_undegraded":"2024-04-25T02:11:55.603626+0000","last_fullsized":"2024-04-25T02:11:55.603626+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605010+0000","last_change":"2024-04-25T02:11:55.605010+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605010+0000","last_undegraded":"2024-04-25T02:11:55.605010+0000","last_fullsized":"2024-04-25T02:11:55.605010+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608598+0000","last_change":"2024-04-25T02:11:55.608598+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608598+0000","last_undegraded":"2024-04-25T02:11:55.608598+0000","last_fullsized":"2024-04-25T02:11:55.608598+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605667+0000","last_change":"2024-04-25T02:11:55.605667+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605667+0000","last_undegraded":"2024-04-25T02:11:55.605667+0000","last_fullsized":"2024-04-25T02:11:55.605667+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608931+0000","last_change":"2024-04-25T02:11:55.608931+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608931+0000","last_undegraded":"2024-04-25T02:11:55.608931+0000","last_fullsized":"2024-04-25T02:11:55.608931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603722+0000","last_change":"2024-04-25T02:11:55.603722+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603722+0000","last_undegraded":"2024-04-25T02:11:55.603722+0000","last_fullsized":"2024-04-25T02:11:55.603722+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.610212+0000","last_change":"2024-04-25T02:11:55.610212+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.610212+0000","last_undegraded":"2024-04-25T02:11:55.610212+0000","last_fullsized":"2024-04-25T02:11:55.610212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601756+0000","last_change":"2024-04-25T02:11:55.601756+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601756+0000","last_undegraded":"2024-04-25T02:11:55.601756+0000","last_fullsized":"2024-04-25T02:11:55.601756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603211+0000","last_change":"2024-04-25T02:11:55.603211+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603211+0000","last_undegraded":"2024-04-25T02:11:55.603211+0000","last_fullsized":"2024-04-25T02:11:55.603211+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605847+0000","last_change":"2024-04-25T02:11:55.605847+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605847+0000","last_undegraded":"2024-04-25T02:11:55.605847+0000","last_fullsized":"2024-04-25T02:11:55.605847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.612150+0000","last_change":"2024-04-25T02:11:55.612150+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.612150+0000","last_undegraded":"2024-04-25T02:11:55.612150+0000","last_fullsized":"2024-04-25T02:11:55.612150+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608950+0000","last_change":"2024-04-25T02:11:55.608950+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608950+0000","last_undegraded":"2024-04-25T02:11:55.608950+0000","last_fullsized":"2024-04-25T02:11:55.608950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602062+0000","last_change":"2024-04-25T02:11:55.602062+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602062+0000","last_undegraded":"2024-04-25T02:11:55.602062+0000","last_fullsized":"2024-04-25T02:11:55.602062+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601413+0000","last_change":"2024-04-25T02:11:55.601413+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601413+0000","last_undegraded":"2024-04-25T02:11:55.601413+0000","last_fullsized":"2024-04-25T02:11:55.601413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605821+0000","last_change":"2024-04-25T02:11:55.605821+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605821+0000","last_undegraded":"2024-04-25T02:11:55.605821+0000","last_fullsized":"2024-04-25T02:11:55.605821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606765+0000","last_change":"2024-04-25T02:11:55.606765+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606765+0000","last_undegraded":"2024-04-25T02:11:55.606765+0000","last_fullsized":"2024-04-25T02:11:55.606765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603037+0000","last_change":"2024-04-25T02:11:55.603037+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603037+0000","last_undegraded":"2024-04-25T02:11:55.603037+0000","last_fullsized":"2024-04-25T02:11:55.603037+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603022+0000","last_change":"2024-04-25T02:11:55.603022+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603022+0000","last_undegraded":"2024-04-25T02:11:55.603022+0000","last_fullsized":"2024-04-25T02:11:55.603022+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604446+0000","last_change":"2024-04-25T02:11:55.604446+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604446+0000","last_undegraded":"2024-04-25T02:11:55.604446+0000","last_fullsized":"2024-04-25T02:11:55.604446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605200+0000","last_change":"2024-04-25T02:11:55.605200+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605200+0000","last_undegraded":"2024-04-25T02:11:55.605200+0000","last_fullsized":"2024-04-25T02:11:55.605200+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605575+0000","last_change":"2024-04-25T02:11:55.605575+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605575+0000","last_undegraded":"2024-04-25T02:11:55.605575+0000","last_fullsized":"2024-04-25T02:11:55.605575+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602055+0000","last_change":"2024-04-25T02:11:55.602055+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602055+0000","last_undegraded":"2024-04-25T02:11:55.602055+0000","last_fullsized":"2024-04-25T02:11:55.602055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602029+0000","last_change":"2024-04-25T02:11:55.602029+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602029+0000","last_undegraded":"2024-04-25T02:11:55.602029+0000","last_fullsized":"2024-04-25T02:11:55.602029+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606192+0000","last_change":"2024-04-25T02:11:55.606192+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606192+0000","last_undegraded":"2024-04-25T02:11:55.606192+0000","last_fullsized":"2024-04-25T02:11:55.606192+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605418+0000","last_change":"2024-04-25T02:11:55.605418+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605418+0000","last_undegraded":"2024-04-25T02:11:55.605418+0000","last_fullsized":"2024-04-25T02:11:55.605418+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617026+0000","last_change":"2024-04-25T02:11:55.615213+0000","last_active":"2024-04-25T02:11:55.617026+0000","last_peered":"2024-04-25T02:11:55.617026+0000","last_clean":"2024-04-25T02:11:55.617026+0000","last_became_active":"2024-04-25T02:11:55.614877+0000","last_became_peered":"2024-04-25T02:11:55.614877+0000","last_unstale":"2024-04-25T02:11:55.617026+0000","last_undegraded":"2024-04-25T02:11:55.617026+0000","last_fullsized":"2024-04-25T02:11:55.617026+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:12:40.303720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602766+0000","last_change":"2024-04-25T02:11:55.602766+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602766+0000","last_undegraded":"2024-04-25T02:11:55.602766+0000","last_fullsized":"2024-04-25T02:11:55.602766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620001+0000","last_change":"2024-04-25T02:11:55.617352+0000","last_active":"2024-04-25T02:11:55.620001+0000","last_peered":"2024-04-25T02:11:55.620001+0000","last_clean":"2024-04-25T02:11:55.620001+0000","last_became_active":"2024-04-25T02:11:55.617068+0000","last_became_peered":"2024-04-25T02:11:55.617068+0000","last_unstale":"2024-04-25T02:11:55.620001+0000","last_undegraded":"2024-04-25T02:11:55.620001+0000","last_fullsized":"2024-04-25T02:11:55.620001+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:32.851053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609311+0000","last_change":"2024-04-25T02:11:55.609311+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609311+0000","last_undegraded":"2024-04-25T02:11:55.609311+0000","last_fullsized":"2024-04-25T02:11:55.609311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620294+0000","last_change":"2024-04-25T02:11:55.618718+0000","last_active":"2024-04-25T02:11:55.620294+0000","last_peered":"2024-04-25T02:11:55.620294+0000","last_clean":"2024-04-25T02:11:55.620294+0000","last_became_active":"2024-04-25T02:11:55.618396+0000","last_became_peered":"2024-04-25T02:11:55.618396+0000","last_unstale":"2024-04-25T02:11:55.620294+0000","last_undegraded":"2024-04-25T02:11:55.620294+0000","last_fullsized":"2024-04-25T02:11:55.620294+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:34.747144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608194+0000","last_change":"2024-04-25T02:11:55.608194+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608194+0000","last_undegraded":"2024-04-25T02:11:55.608194+0000","last_fullsized":"2024-04-25T02:11:55.608194+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617620+0000","last_change":"2024-04-25T02:11:55.616480+0000","last_active":"2024-04-25T02:11:55.617620+0000","last_peered":"2024-04-25T02:11:55.617620+0000","last_clean":"2024-04-25T02:11:55.617620+0000","last_became_active":"2024-04-25T02:11:55.616118+0000","last_became_peered":"2024-04-25T02:11:55.616118+0000","last_unstale":"2024-04-25T02:11:55.617620+0000","last_undegraded":"2024-04-25T02:11:55.617620+0000","last_fullsized":"2024-04-25T02:11:55.617620+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:14.359235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601516+0000","last_change":"2024-04-25T02:11:55.601516+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601516+0000","last_undegraded":"2024-04-25T02:11:55.601516+0000","last_fullsized":"2024-04-25T02:11:55.601516+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618267+0000","last_change":"2024-04-25T02:11:55.616655+0000","last_active":"2024-04-25T02:11:55.618267+0000","last_peered":"2024-04-25T02:11:55.618267+0000","last_clean":"2024-04-25T02:11:55.618267+0000","last_became_active":"2024-04-25T02:11:55.616366+0000","last_became_peered":"2024-04-25T02:11:55.616366+0000","last_unstale":"2024-04-25T02:11:55.618267+0000","last_undegraded":"2024-04-25T02:11:55.618267+0000","last_fullsized":"2024-04-25T02:11:55.618267+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:31:02.982180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601638+0000","last_change":"2024-04-25T02:11:55.601638+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601638+0000","last_undegraded":"2024-04-25T02:11:55.601638+0000","last_fullsized":"2024-04-25T02:11:55.601638+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.621386+0000","last_change":"2024-04-25T02:11:55.620695+0000","last_active":"2024-04-25T02:11:55.621386+0000","last_peered":"2024-04-25T02:11:55.621386+0000","last_clean":"2024-04-25T02:11:55.621386+0000","last_became_active":"2024-04-25T02:11:55.620416+0000","last_became_peered":"2024-04-25T02:11:55.620416+0000","last_unstale":"2024-04-25T02:11:55.621386+0000","last_undegraded":"2024-04-25T02:11:55.621386+0000","last_fullsized":"2024-04-25T02:11:55.621386+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:57.604722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603002+0000","last_change":"2024-04-25T02:11:55.603002+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603002+0000","last_undegraded":"2024-04-25T02:11:55.603002+0000","last_fullsized":"2024-04-25T02:11:55.603002+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616285+0000","last_change":"2024-04-25T02:11:55.613841+0000","last_active":"2024-04-25T02:11:55.616285+0000","last_peered":"2024-04-25T02:11:55.616285+0000","last_clean":"2024-04-25T02:11:55.616285+0000","last_became_active":"2024-04-25T02:11:55.613576+0000","last_became_peered":"2024-04-25T02:11:55.613576+0000","last_unstale":"2024-04-25T02:11:55.616285+0000","last_undegraded":"2024-04-25T02:11:55.616285+0000","last_fullsized":"2024-04-25T02:11:55.616285+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:44.628098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609226+0000","last_change":"2024-04-25T02:11:55.609226+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609226+0000","last_undegraded":"2024-04-25T02:11:55.609226+0000","last_fullsized":"2024-04-25T02:11:55.609226+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617573+0000","last_change":"2024-04-25T02:11:55.609302+0000","last_active":"2024-04-25T02:11:55.617573+0000","last_peered":"2024-04-25T02:11:55.617573+0000","last_clean":"2024-04-25T02:11:55.617573+0000","last_became_active":"2024-04-25T02:11:55.609033+0000","last_became_peered":"2024-04-25T02:11:55.609033+0000","last_unstale":"2024-04-25T02:11:55.617573+0000","last_undegraded":"2024-04-25T02:11:55.617573+0000","last_fullsized":"2024-04-25T02:11:55.617573+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:13.254074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602583+0000","last_change":"2024-04-25T02:11:55.602583+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602583+0000","last_undegraded":"2024-04-25T02:11:55.602583+0000","last_fullsized":"2024-04-25T02:11:55.602583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.619414+0000","last_change":"2024-04-25T02:11:55.617474+0000","last_active":"2024-04-25T02:11:55.619414+0000","last_peered":"2024-04-25T02:11:55.619414+0000","last_clean":"2024-04-25T02:11:55.619414+0000","last_became_active":"2024-04-25T02:11:55.617093+0000","last_became_peered":"2024-04-25T02:11:55.617093+0000","last_unstale":"2024-04-25T02:11:55.619414+0000","last_undegraded":"2024-04-25T02:11:55.619414+0000","last_fullsized":"2024-04-25T02:11:55.619414+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:09.181237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606693+0000","last_change":"2024-04-25T02:11:55.606693+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606693+0000","last_undegraded":"2024-04-25T02:11:55.606693+0000","last_fullsized":"2024-04-25T02:11:55.606693+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617368+0000","last_change":"2024-04-25T02:11:55.614158+0000","last_active":"2024-04-25T02:11:55.617368+0000","last_peered":"2024-04-25T02:11:55.617368+0000","last_clean":"2024-04-25T02:11:55.617368+0000","last_became_active":"2024-04-25T02:11:55.613879+0000","last_became_peered":"2024-04-25T02:11:55.613879+0000","last_unstale":"2024-04-25T02:11:55.617368+0000","last_undegraded":"2024-04-25T02:11:55.617368+0000","last_fullsized":"2024-04-25T02:11:55.617368+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:38.580085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608839+0000","last_change":"2024-04-25T02:11:55.608839+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608839+0000","last_undegraded":"2024-04-25T02:11:55.608839+0000","last_fullsized":"2024-04-25T02:11:55.608839+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.615572+0000","last_change":"2024-04-25T02:11:55.613806+0000","last_active":"2024-04-25T02:11:55.615572+0000","last_peered":"2024-04-25T02:11:55.615572+0000","last_clean":"2024-04-25T02:11:55.615572+0000","last_became_active":"2024-04-25T02:11:55.613252+0000","last_became_peered":"2024-04-25T02:11:55.613252+0000","last_unstale":"2024-04-25T02:11:55.615572+0000","last_undegraded":"2024-04-25T02:11:55.615572+0000","last_fullsized":"2024-04-25T02:11:55.615572+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:54.406276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603305+0000","last_change":"2024-04-25T02:11:55.603305+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603305+0000","last_undegraded":"2024-04-25T02:11:55.603305+0000","last_fullsized":"2024-04-25T02:11:55.603305+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620176+0000","last_change":"2024-04-25T02:11:55.616655+0000","last_active":"2024-04-25T02:11:55.620176+0000","last_peered":"2024-04-25T02:11:55.620176+0000","last_clean":"2024-04-25T02:11:55.620176+0000","last_became_active":"2024-04-25T02:11:55.616393+0000","last_became_peered":"2024-04-25T02:11:55.616393+0000","last_unstale":"2024-04-25T02:11:55.620176+0000","last_undegraded":"2024-04-25T02:11:55.620176+0000","last_fullsized":"2024-04-25T02:11:55.620176+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:19.912700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606210+0000","last_change":"2024-04-25T02:11:55.606210+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606210+0000","last_undegraded":"2024-04-25T02:11:55.606210+0000","last_fullsized":"2024-04-25T02:11:55.606210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.614348+0000","last_change":"2024-04-25T02:11:55.611138+0000","last_active":"2024-04-25T02:11:55.614348+0000","last_peered":"2024-04-25T02:11:55.614348+0000","last_clean":"2024-04-25T02:11:55.614348+0000","last_became_active":"2024-04-25T02:11:55.610838+0000","last_became_peered":"2024-04-25T02:11:55.610838+0000","last_unstale":"2024-04-25T02:11:55.614348+0000","last_undegraded":"2024-04-25T02:11:55.614348+0000","last_fullsized":"2024-04-25T02:11:55.614348+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:53.559794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604175+0000","last_change":"2024-04-25T02:11:55.604175+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604175+0000","last_undegraded":"2024-04-25T02:11:55.604175+0000","last_fullsized":"2024-04-25T02:11:55.604175+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620834+0000","last_change":"2024-04-25T02:11:55.618236+0000","last_active":"2024-04-25T02:11:55.620834+0000","last_peered":"2024-04-25T02:11:55.620834+0000","last_clean":"2024-04-25T02:11:55.620834+0000","last_became_active":"2024-04-25T02:11:55.617800+0000","last_became_peered":"2024-04-25T02:11:55.617800+0000","last_unstale":"2024-04-25T02:11:55.620834+0000","last_undegraded":"2024-04-25T02:11:55.620834+0000","last_fullsized":"2024-04-25T02:11:55.620834+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:12.740028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608536+0000","last_change":"2024-04-25T02:11:55.608536+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608536+0000","last_undegraded":"2024-04-25T02:11:55.608536+0000","last_fullsized":"2024-04-25T02:11:55.608536+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616039+0000","last_change":"2024-04-25T02:11:55.614787+0000","last_active":"2024-04-25T02:11:55.616039+0000","last_peered":"2024-04-25T02:11:55.616039+0000","last_clean":"2024-04-25T02:11:55.616039+0000","last_became_active":"2024-04-25T02:11:55.614456+0000","last_became_peered":"2024-04-25T02:11:55.614456+0000","last_unstale":"2024-04-25T02:11:55.616039+0000","last_undegraded":"2024-04-25T02:11:55.616039+0000","last_fullsized":"2024-04-25T02:11:55.616039+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:00.242853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602723+0000","last_change":"2024-04-25T02:11:55.602723+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602723+0000","last_undegraded":"2024-04-25T02:11:55.602723+0000","last_fullsized":"2024-04-25T02:11:55.602723+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616780+0000","last_change":"2024-04-25T02:11:55.613116+0000","last_active":"2024-04-25T02:11:55.616780+0000","last_peered":"2024-04-25T02:11:55.616780+0000","last_clean":"2024-04-25T02:11:55.616780+0000","last_became_active":"2024-04-25T02:11:55.612711+0000","last_became_peered":"2024-04-25T02:11:55.612711+0000","last_unstale":"2024-04-25T02:11:55.616780+0000","last_undegraded":"2024-04-25T02:11:55.616780+0000","last_fullsized":"2024-04-25T02:11:55.616780+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:21.747623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604604+0000","last_change":"2024-04-25T02:11:55.604604+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604604+0000","last_undegraded":"2024-04-25T02:11:55.604604+0000","last_fullsized":"2024-04-25T02:11:55.604604+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617335+0000","last_change":"2024-04-25T02:11:55.613889+0000","last_active":"2024-04-25T02:11:55.617335+0000","last_peered":"2024-04-25T02:11:55.617335+0000","last_clean":"2024-04-25T02:11:55.617335+0000","last_became_active":"2024-04-25T02:11:55.613613+0000","last_became_peered":"2024-04-25T02:11:55.613613+0000","last_unstale":"2024-04-25T02:11:55.617335+0000","last_undegraded":"2024-04-25T02:11:55.617335+0000","last_fullsized":"2024-04-25T02:11:55.617335+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:43.656103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605299+0000","last_change":"2024-04-25T02:11:55.605299+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605299+0000","last_undegraded":"2024-04-25T02:11:55.605299+0000","last_fullsized":"2024-04-25T02:11:55.605299+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620314+0000","last_change":"2024-04-25T02:11:55.618770+0000","last_active":"2024-04-25T02:11:55.620314+0000","last_peered":"2024-04-25T02:11:55.620314+0000","last_clean":"2024-04-25T02:11:55.620314+0000","last_became_active":"2024-04-25T02:11:55.618388+0000","last_became_peered":"2024-04-25T02:11:55.618388+0000","last_unstale":"2024-04-25T02:11:55.620314+0000","last_undegraded":"2024-04-25T02:11:55.620314+0000","last_fullsized":"2024-04-25T02:11:55.620314+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:22.677232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605216+0000","last_change":"2024-04-25T02:11:55.605216+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605216+0000","last_undegraded":"2024-04-25T02:11:55.605216+0000","last_fullsized":"2024-04-25T02:11:55.605216+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620981+0000","last_change":"2024-04-25T02:11:55.619965+0000","last_active":"2024-04-25T02:11:55.620981+0000","last_peered":"2024-04-25T02:11:55.620981+0000","last_clean":"2024-04-25T02:11:55.620981+0000","last_became_active":"2024-04-25T02:11:55.619679+0000","last_became_peered":"2024-04-25T02:11:55.619679+0000","last_unstale":"2024-04-25T02:11:55.620981+0000","last_undegraded":"2024-04-25T02:11:55.620981+0000","last_fullsized":"2024-04-25T02:11:55.620981+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:44.145676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602751+0000","last_change":"2024-04-25T02:11:55.602751+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602751+0000","last_undegraded":"2024-04-25T02:11:55.602751+0000","last_fullsized":"2024-04-25T02:11:55.602751+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617781+0000","last_change":"2024-04-25T02:11:55.616188+0000","last_active":"2024-04-25T02:11:55.617781+0000","last_peered":"2024-04-25T02:11:55.617781+0000","last_clean":"2024-04-25T02:11:55.617781+0000","last_became_active":"2024-04-25T02:11:55.615921+0000","last_became_peered":"2024-04-25T02:11:55.615921+0000","last_unstale":"2024-04-25T02:11:55.617781+0000","last_undegraded":"2024-04-25T02:11:55.617781+0000","last_fullsized":"2024-04-25T02:11:55.617781+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:52.550255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605182+0000","last_change":"2024-04-25T02:11:55.605182+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605182+0000","last_undegraded":"2024-04-25T02:11:55.605182+0000","last_fullsized":"2024-04-25T02:11:55.605182+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.621373+0000","last_change":"2024-04-25T02:11:55.620628+0000","last_active":"2024-04-25T02:11:55.621373+0000","last_peered":"2024-04-25T02:11:55.621373+0000","last_clean":"2024-04-25T02:11:55.621373+0000","last_became_active":"2024-04-25T02:11:55.620360+0000","last_became_peered":"2024-04-25T02:11:55.620360+0000","last_unstale":"2024-04-25T02:11:55.621373+0000","last_undegraded":"2024-04-25T02:11:55.621373+0000","last_fullsized":"2024-04-25T02:11:55.621373+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:49.417443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603999+0000","last_change":"2024-04-25T02:11:55.603999+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603999+0000","last_undegraded":"2024-04-25T02:11:55.603999+0000","last_fullsized":"2024-04-25T02:11:55.603999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.613700+0000","last_change":"2024-04-25T02:11:55.611740+0000","last_active":"2024-04-25T02:11:55.613700+0000","last_peered":"2024-04-25T02:11:55.613700+0000","last_clean":"2024-04-25T02:11:55.613700+0000","last_became_active":"2024-04-25T02:11:55.611477+0000","last_became_peered":"2024-04-25T02:11:55.611477+0000","last_unstale":"2024-04-25T02:11:55.613700+0000","last_undegraded":"2024-04-25T02:11:55.613700+0000","last_fullsized":"2024-04-25T02:11:55.613700+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:41.075565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603657+0000","last_change":"2024-04-25T02:11:55.603657+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603657+0000","last_undegraded":"2024-04-25T02:11:55.603657+0000","last_fullsized":"2024-04-25T02:11:55.603657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620266+0000","last_change":"2024-04-25T02:11:55.618924+0000","last_active":"2024-04-25T02:11:55.620266+0000","last_peered":"2024-04-25T02:11:55.620266+0000","last_clean":"2024-04-25T02:11:55.620266+0000","last_became_active":"2024-04-25T02:11:55.618658+0000","last_became_peered":"2024-04-25T02:11:55.618658+0000","last_unstale":"2024-04-25T02:11:55.620266+0000","last_undegraded":"2024-04-25T02:11:55.620266+0000","last_fullsized":"2024-04-25T02:11:55.620266+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:41.849723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.610560+0000","last_change":"2024-04-25T02:11:55.610560+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.610560+0000","last_undegraded":"2024-04-25T02:11:55.610560+0000","last_fullsized":"2024-04-25T02:11:55.610560+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617652+0000","last_change":"2024-04-25T02:11:55.616514+0000","last_active":"2024-04-25T02:11:55.617652+0000","last_peered":"2024-04-25T02:11:55.617652+0000","last_clean":"2024-04-25T02:11:55.617652+0000","last_became_active":"2024-04-25T02:11:55.615526+0000","last_became_peered":"2024-04-25T02:11:55.615526+0000","last_unstale":"2024-04-25T02:11:55.617652+0000","last_undegraded":"2024-04-25T02:11:55.617652+0000","last_fullsized":"2024-04-25T02:11:55.617652+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:11.176893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602299+0000","last_change":"2024-04-25T02:11:55.602299+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602299+0000","last_undegraded":"2024-04-25T02:11:55.602299+0000","last_fullsized":"2024-04-25T02:11:55.602299+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616552+0000","last_change":"2024-04-25T02:11:55.615567+0000","last_active":"2024-04-25T02:11:55.616552+0000","last_peered":"2024-04-25T02:11:55.616552+0000","last_clean":"2024-04-25T02:11:55.616552+0000","last_became_active":"2024-04-25T02:11:55.615288+0000","last_became_peered":"2024-04-25T02:11:55.615288+0000","last_unstale":"2024-04-25T02:11:55.616552+0000","last_undegraded":"2024-04-25T02:11:55.616552+0000","last_fullsized":"2024-04-25T02:11:55.616552+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:55.860433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605971+0000","last_change":"2024-04-25T02:11:55.605971+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605971+0000","last_undegraded":"2024-04-25T02:11:55.605971+0000","last_fullsized":"2024-04-25T02:11:55.605971+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618315+0000","last_change":"2024-04-25T02:11:55.613928+0000","last_active":"2024-04-25T02:11:55.618315+0000","last_peered":"2024-04-25T02:11:55.618315+0000","last_clean":"2024-04-25T02:11:55.618315+0000","last_became_active":"2024-04-25T02:11:55.613174+0000","last_became_peered":"2024-04-25T02:11:55.613174+0000","last_unstale":"2024-04-25T02:11:55.618315+0000","last_undegraded":"2024-04-25T02:11:55.618315+0000","last_fullsized":"2024-04-25T02:11:55.618315+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:22.107459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.607765+0000","last_change":"2024-04-25T02:11:55.607765+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.607765+0000","last_undegraded":"2024-04-25T02:11:55.607765+0000","last_fullsized":"2024-04-25T02:11:55.607765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.619968+0000","last_change":"2024-04-25T02:11:55.614266+0000","last_active":"2024-04-25T02:11:55.619968+0000","last_peered":"2024-04-25T02:11:55.619968+0000","last_clean":"2024-04-25T02:11:55.619968+0000","last_became_active":"2024-04-25T02:11:55.613693+0000","last_became_peered":"2024-04-25T02:11:55.613693+0000","last_unstale":"2024-04-25T02:11:55.619968+0000","last_undegraded":"2024-04-25T02:11:55.619968+0000","last_fullsized":"2024-04-25T02:11:55.619968+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:09.177672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602641+0000","last_change":"2024-04-25T02:11:55.602641+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602641+0000","last_undegraded":"2024-04-25T02:11:55.602641+0000","last_fullsized":"2024-04-25T02:11:55.602641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618273+0000","last_change":"2024-04-25T02:11:55.613675+0000","last_active":"2024-04-25T02:11:55.618273+0000","last_peered":"2024-04-25T02:11:55.618273+0000","last_clean":"2024-04-25T02:11:55.618273+0000","last_became_active":"2024-04-25T02:11:55.613419+0000","last_became_peered":"2024-04-25T02:11:55.613419+0000","last_unstale":"2024-04-25T02:11:55.618273+0000","last_undegraded":"2024-04-25T02:11:55.618273+0000","last_fullsized":"2024-04-25T02:11:55.618273+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:39.445877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609451+0000","last_change":"2024-04-25T02:11:55.609451+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609451+0000","last_undegraded":"2024-04-25T02:11:55.609451+0000","last_fullsized":"2024-04-25T02:11:55.609451+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618578+0000","last_change":"2024-04-25T02:11:55.614522+0000","last_active":"2024-04-25T02:11:55.618578+0000","last_peered":"2024-04-25T02:11:55.618578+0000","last_clean":"2024-04-25T02:11:55.618578+0000","last_became_active":"2024-04-25T02:11:55.614256+0000","last_became_peered":"2024-04-25T02:11:55.614256+0000","last_unstale":"2024-04-25T02:11:55.618578+0000","last_undegraded":"2024-04-25T02:11:55.618578+0000","last_fullsized":"2024-04-25T02:11:55.618578+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:19.338202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605325+0000","last_change":"2024-04-25T02:11:55.605325+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605325+0000","last_undegraded":"2024-04-25T02:11:55.605325+0000","last_fullsized":"2024-04-25T02:11:55.605325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.612985+0000","last_change":"2024-04-25T02:11:55.609657+0000","last_active":"2024-04-25T02:11:55.612985+0000","last_peered":"2024-04-25T02:11:55.612985+0000","last_clean":"2024-04-25T02:11:55.612985+0000","last_became_active":"2024-04-25T02:11:55.609375+0000","last_became_peered":"2024-04-25T02:11:55.609375+0000","last_unstale":"2024-04-25T02:11:55.612985+0000","last_undegraded":"2024-04-25T02:11:55.612985+0000","last_fullsized":"2024-04-25T02:11:55.612985+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:36:16.079285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.607193+0000","last_change":"2024-04-25T02:11:55.607193+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.607193+0000","last_undegraded":"2024-04-25T02:11:55.607193+0000","last_fullsized":"2024-04-25T02:11:55.607193+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.613636+0000","last_change":"2024-04-25T02:11:55.611952+0000","last_active":"2024-04-25T02:11:55.613636+0000","last_peered":"2024-04-25T02:11:55.613636+0000","last_clean":"2024-04-25T02:11:55.613636+0000","last_became_active":"2024-04-25T02:11:55.611645+0000","last_became_peered":"2024-04-25T02:11:55.611645+0000","last_unstale":"2024-04-25T02:11:55.613636+0000","last_undegraded":"2024-04-25T02:11:55.613636+0000","last_fullsized":"2024-04-25T02:11:55.613636+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:29.500026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603696+0000","last_change":"2024-04-25T02:11:55.603696+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603696+0000","last_undegraded":"2024-04-25T02:11:55.603696+0000","last_fullsized":"2024-04-25T02:11:55.603696+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618344+0000","last_change":"2024-04-25T02:11:55.616970+0000","last_active":"2024-04-25T02:11:55.618344+0000","last_peered":"2024-04-25T02:11:55.618344+0000","last_clean":"2024-04-25T02:11:55.618344+0000","last_became_active":"2024-04-25T02:11:55.616677+0000","last_became_peered":"2024-04-25T02:11:55.616677+0000","last_unstale":"2024-04-25T02:11:55.618344+0000","last_undegraded":"2024-04-25T02:11:55.618344+0000","last_fullsized":"2024-04-25T02:11:55.618344+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:53:40.413609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":256,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.607463+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:11:55.607463+0000","last_peered":"2024-04-25T02:11:55.607463+0000","last_clean":"2024-04-25T02:11:55.607463+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:11:55.607463+0000","last_undegraded":"2024-04-25T02:11:55.607463+0000","last_fullsized":"2024-04-25T02:11:55.607463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1433600,"data_stored":939408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":342765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":342765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28408,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343432,"statfs":{"total":96636764160,"available":96607674368,"internally_reserved":0,"allocated":1421312,"data_stored":933133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:12:00.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2024-04-25T02:12:00.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.607116+0000', 'last_change': '2024-04-25T02:11:55.607116+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.607116+0000', 'last_undegraded': '2024-04-25T02:11:55.607116+0000', 'last_fullsized': '2024-04-25T02:11:55.607116+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:12:00.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2024-04-25T02:12:00.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.606916+0000', 'last_change': '2024-04-25T02:11:55.606916+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.606916+0000', 'last_undegraded': '2024-04-25T02:11:55.606916+0000', 'last_fullsized': '2024-04-25T02:11:55.606916+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T02:12:00.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2024-04-25T02:12:00.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.604826+0000', 'last_change': '2024-04-25T02:11:55.604826+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.604826+0000', 'last_undegraded': '2024-04-25T02:11:55.604826+0000', 'last_fullsized': '2024-04-25T02:11:55.604826+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:12:00.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2024-04-25T02:12:00.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.606076+0000', 'last_change': '2024-04-25T02:11:55.606076+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.606076+0000', 'last_undegraded': '2024-04-25T02:11:55.606076+0000', 'last_fullsized': '2024-04-25T02:11:55.606076+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:12:00.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2024-04-25T02:12:00.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.604080+0000', 'last_change': '2024-04-25T02:11:55.604080+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.604080+0000', 'last_undegraded': '2024-04-25T02:11:55.604080+0000', 'last_fullsized': '2024-04-25T02:11:55.604080+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:12:00.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2024-04-25T02:12:00.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.609278+0000', 'last_change': '2024-04-25T02:11:55.609278+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.609278+0000', 'last_undegraded': '2024-04-25T02:11:55.609278+0000', 'last_fullsized': '2024-04-25T02:11:55.609278+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T02:12:00.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2024-04-25T02:12:00.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.604266+0000', 'last_change': '2024-04-25T02:11:55.604266+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.604266+0000', 'last_undegraded': '2024-04-25T02:11:55.604266+0000', 'last_fullsized': '2024-04-25T02:11:55.604266+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:12:00.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2024-04-25T02:12:00.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.606693+0000', 'last_change': '2024-04-25T02:11:55.606693+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.606693+0000', 'last_undegraded': '2024-04-25T02:11:55.606693+0000', 'last_fullsized': '2024-04-25T02:11:55.606693+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T02:12:00.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2024-04-25T02:12:00.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.603626+0000', 'last_change': '2024-04-25T02:11:55.603626+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.603626+0000', 'last_undegraded': '2024-04-25T02:11:55.603626+0000', 'last_fullsized': '2024-04-25T02:11:55.603626+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:12:00.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2024-04-25T02:12:00.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.605010+0000', 'last_change': '2024-04-25T02:11:55.605010+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.605010+0000', 'last_undegraded': '2024-04-25T02:11:55.605010+0000', 'last_fullsized': '2024-04-25T02:11:55.605010+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:12:00.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2024-04-25T02:12:00.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.608598+0000', 'last_change': '2024-04-25T02:11:55.608598+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.608598+0000', 'last_undegraded': '2024-04-25T02:11:55.608598+0000', 'last_fullsized': '2024-04-25T02:11:55.608598+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:12:00.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2024-04-25T02:12:00.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.605667+0000', 'last_change': '2024-04-25T02:11:55.605667+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.605667+0000', 'last_undegraded': '2024-04-25T02:11:55.605667+0000', 'last_fullsized': '2024-04-25T02:11:55.605667+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:12:00.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2024-04-25T02:12:00.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.608931+0000', 'last_change': '2024-04-25T02:11:55.608931+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.608931+0000', 'last_undegraded': '2024-04-25T02:11:55.608931+0000', 'last_fullsized': '2024-04-25T02:11:55.608931+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:12:00.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2024-04-25T02:12:00.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.603722+0000', 'last_change': '2024-04-25T02:11:55.603722+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.603722+0000', 'last_undegraded': '2024-04-25T02:11:55.603722+0000', 'last_fullsized': '2024-04-25T02:11:55.603722+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:12:00.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2024-04-25T02:12:00.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.610212+0000', 'last_change': '2024-04-25T02:11:55.610212+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.610212+0000', 'last_undegraded': '2024-04-25T02:11:55.610212+0000', 'last_fullsized': '2024-04-25T02:11:55.610212+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:12:00.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2024-04-25T02:12:00.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.601756+0000', 'last_change': '2024-04-25T02:11:55.601756+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.601756+0000', 'last_undegraded': '2024-04-25T02:11:55.601756+0000', 'last_fullsized': '2024-04-25T02:11:55.601756+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:12:00.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2024-04-25T02:12:00.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.603211+0000', 'last_change': '2024-04-25T02:11:55.603211+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.603211+0000', 'last_undegraded': '2024-04-25T02:11:55.603211+0000', 'last_fullsized': '2024-04-25T02:11:55.603211+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:12:00.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2024-04-25T02:12:00.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.605847+0000', 'last_change': '2024-04-25T02:11:55.605847+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.605847+0000', 'last_undegraded': '2024-04-25T02:11:55.605847+0000', 'last_fullsized': '2024-04-25T02:11:55.605847+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:12:00.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2024-04-25T02:12:00.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.612150+0000', 'last_change': '2024-04-25T02:11:55.612150+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.612150+0000', 'last_undegraded': '2024-04-25T02:11:55.612150+0000', 'last_fullsized': '2024-04-25T02:11:55.612150+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T02:12:00.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2024-04-25T02:12:00.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.608950+0000', 'last_change': '2024-04-25T02:11:55.608950+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.608950+0000', 'last_undegraded': '2024-04-25T02:11:55.608950+0000', 'last_fullsized': '2024-04-25T02:11:55.608950+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:12:00.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2024-04-25T02:12:00.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.602062+0000', 'last_change': '2024-04-25T02:11:55.602062+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.602062+0000', 'last_undegraded': '2024-04-25T02:11:55.602062+0000', 'last_fullsized': '2024-04-25T02:11:55.602062+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:12:00.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2024-04-25T02:12:00.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.601413+0000', 'last_change': '2024-04-25T02:11:55.601413+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.601413+0000', 'last_undegraded': '2024-04-25T02:11:55.601413+0000', 'last_fullsized': '2024-04-25T02:11:55.601413+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:12:00.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2024-04-25T02:12:00.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.605821+0000', 'last_change': '2024-04-25T02:11:55.605821+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.605821+0000', 'last_undegraded': '2024-04-25T02:11:55.605821+0000', 'last_fullsized': '2024-04-25T02:11:55.605821+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:12:00.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2024-04-25T02:12:00.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.606765+0000', 'last_change': '2024-04-25T02:11:55.606765+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.606765+0000', 'last_undegraded': '2024-04-25T02:11:55.606765+0000', 'last_fullsized': '2024-04-25T02:11:55.606765+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:12:00.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2024-04-25T02:12:00.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.603037+0000', 'last_change': '2024-04-25T02:11:55.603037+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.603037+0000', 'last_undegraded': '2024-04-25T02:11:55.603037+0000', 'last_fullsized': '2024-04-25T02:11:55.603037+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:12:00.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2024-04-25T02:12:00.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.603022+0000', 'last_change': '2024-04-25T02:11:55.603022+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.603022+0000', 'last_undegraded': '2024-04-25T02:11:55.603022+0000', 'last_fullsized': '2024-04-25T02:11:55.603022+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:12:00.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2024-04-25T02:12:00.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.604446+0000', 'last_change': '2024-04-25T02:11:55.604446+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.604446+0000', 'last_undegraded': '2024-04-25T02:11:55.604446+0000', 'last_fullsized': '2024-04-25T02:11:55.604446+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:12:00.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2024-04-25T02:12:00.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.605200+0000', 'last_change': '2024-04-25T02:11:55.605200+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.605200+0000', 'last_undegraded': '2024-04-25T02:11:55.605200+0000', 'last_fullsized': '2024-04-25T02:11:55.605200+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:12:00.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2024-04-25T02:12:00.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.605575+0000', 'last_change': '2024-04-25T02:11:55.605575+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.605575+0000', 'last_undegraded': '2024-04-25T02:11:55.605575+0000', 'last_fullsized': '2024-04-25T02:11:55.605575+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:12:00.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2024-04-25T02:12:00.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.602055+0000', 'last_change': '2024-04-25T02:11:55.602055+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.602055+0000', 'last_undegraded': '2024-04-25T02:11:55.602055+0000', 'last_fullsized': '2024-04-25T02:11:55.602055+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:12:00.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2024-04-25T02:12:00.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.602029+0000', 'last_change': '2024-04-25T02:11:55.602029+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.602029+0000', 'last_undegraded': '2024-04-25T02:11:55.602029+0000', 'last_fullsized': '2024-04-25T02:11:55.602029+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:12:00.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2024-04-25T02:12:00.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.606192+0000', 'last_change': '2024-04-25T02:11:55.606192+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.606192+0000', 'last_undegraded': '2024-04-25T02:11:55.606192+0000', 'last_fullsized': '2024-04-25T02:11:55.606192+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T02:12:00.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2024-04-25T02:12:00.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.605418+0000', 'last_change': '2024-04-25T02:11:55.605418+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.605418+0000', 'last_undegraded': '2024-04-25T02:11:55.605418+0000', 'last_fullsized': '2024-04-25T02:11:55.605418+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:12:00.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2024-04-25T02:12:00.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.602766+0000', 'last_change': '2024-04-25T02:11:55.602766+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.602766+0000', 'last_undegraded': '2024-04-25T02:11:55.602766+0000', 'last_fullsized': '2024-04-25T02:11:55.602766+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:12:00.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2024-04-25T02:12:00.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.609311+0000', 'last_change': '2024-04-25T02:11:55.609311+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.609311+0000', 'last_undegraded': '2024-04-25T02:11:55.609311+0000', 'last_fullsized': '2024-04-25T02:11:55.609311+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T02:12:00.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2024-04-25T02:12:00.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.608194+0000', 'last_change': '2024-04-25T02:11:55.608194+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.608194+0000', 'last_undegraded': '2024-04-25T02:11:55.608194+0000', 'last_fullsized': '2024-04-25T02:11:55.608194+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:12:00.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2024-04-25T02:12:00.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.601516+0000', 'last_change': '2024-04-25T02:11:55.601516+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.601516+0000', 'last_undegraded': '2024-04-25T02:11:55.601516+0000', 'last_fullsized': '2024-04-25T02:11:55.601516+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:12:00.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2024-04-25T02:12:00.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.601638+0000', 'last_change': '2024-04-25T02:11:55.601638+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.601638+0000', 'last_undegraded': '2024-04-25T02:11:55.601638+0000', 'last_fullsized': '2024-04-25T02:11:55.601638+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:12:00.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2024-04-25T02:12:00.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.603002+0000', 'last_change': '2024-04-25T02:11:55.603002+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.603002+0000', 'last_undegraded': '2024-04-25T02:11:55.603002+0000', 'last_fullsized': '2024-04-25T02:11:55.603002+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:12:00.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2024-04-25T02:12:00.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.609226+0000', 'last_change': '2024-04-25T02:11:55.609226+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.609226+0000', 'last_undegraded': '2024-04-25T02:11:55.609226+0000', 'last_fullsized': '2024-04-25T02:11:55.609226+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:12:00.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2024-04-25T02:12:00.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.602583+0000', 'last_change': '2024-04-25T02:11:55.602583+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.602583+0000', 'last_undegraded': '2024-04-25T02:11:55.602583+0000', 'last_fullsized': '2024-04-25T02:11:55.602583+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:12:00.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2024-04-25T02:12:00.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.606693+0000', 'last_change': '2024-04-25T02:11:55.606693+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.606693+0000', 'last_undegraded': '2024-04-25T02:11:55.606693+0000', 'last_fullsized': '2024-04-25T02:11:55.606693+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:12:00.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2024-04-25T02:12:00.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.608839+0000', 'last_change': '2024-04-25T02:11:55.608839+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.608839+0000', 'last_undegraded': '2024-04-25T02:11:55.608839+0000', 'last_fullsized': '2024-04-25T02:11:55.608839+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T02:12:00.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2024-04-25T02:12:00.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.603305+0000', 'last_change': '2024-04-25T02:11:55.603305+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.603305+0000', 'last_undegraded': '2024-04-25T02:11:55.603305+0000', 'last_fullsized': '2024-04-25T02:11:55.603305+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:12:00.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2024-04-25T02:12:00.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.606210+0000', 'last_change': '2024-04-25T02:11:55.606210+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.606210+0000', 'last_undegraded': '2024-04-25T02:11:55.606210+0000', 'last_fullsized': '2024-04-25T02:11:55.606210+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:12:00.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2024-04-25T02:12:00.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.604175+0000', 'last_change': '2024-04-25T02:11:55.604175+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.604175+0000', 'last_undegraded': '2024-04-25T02:11:55.604175+0000', 'last_fullsized': '2024-04-25T02:11:55.604175+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:12:00.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2024-04-25T02:12:00.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.608536+0000', 'last_change': '2024-04-25T02:11:55.608536+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.608536+0000', 'last_undegraded': '2024-04-25T02:11:55.608536+0000', 'last_fullsized': '2024-04-25T02:11:55.608536+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:12:00.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2024-04-25T02:12:00.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.602723+0000', 'last_change': '2024-04-25T02:11:55.602723+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.602723+0000', 'last_undegraded': '2024-04-25T02:11:55.602723+0000', 'last_fullsized': '2024-04-25T02:11:55.602723+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:12:00.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2024-04-25T02:12:00.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.604604+0000', 'last_change': '2024-04-25T02:11:55.604604+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.604604+0000', 'last_undegraded': '2024-04-25T02:11:55.604604+0000', 'last_fullsized': '2024-04-25T02:11:55.604604+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T02:12:00.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2024-04-25T02:12:00.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.605299+0000', 'last_change': '2024-04-25T02:11:55.605299+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.605299+0000', 'last_undegraded': '2024-04-25T02:11:55.605299+0000', 'last_fullsized': '2024-04-25T02:11:55.605299+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:12:00.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2024-04-25T02:12:00.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.605216+0000', 'last_change': '2024-04-25T02:11:55.605216+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.605216+0000', 'last_undegraded': '2024-04-25T02:11:55.605216+0000', 'last_fullsized': '2024-04-25T02:11:55.605216+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:12:00.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2024-04-25T02:12:00.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.602751+0000', 'last_change': '2024-04-25T02:11:55.602751+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.602751+0000', 'last_undegraded': '2024-04-25T02:11:55.602751+0000', 'last_fullsized': '2024-04-25T02:11:55.602751+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:12:00.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2024-04-25T02:12:00.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.605182+0000', 'last_change': '2024-04-25T02:11:55.605182+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.605182+0000', 'last_undegraded': '2024-04-25T02:11:55.605182+0000', 'last_fullsized': '2024-04-25T02:11:55.605182+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:12:00.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2024-04-25T02:12:00.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.603999+0000', 'last_change': '2024-04-25T02:11:55.603999+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.603999+0000', 'last_undegraded': '2024-04-25T02:11:55.603999+0000', 'last_fullsized': '2024-04-25T02:11:55.603999+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:12:00.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2024-04-25T02:12:00.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.603657+0000', 'last_change': '2024-04-25T02:11:55.603657+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.603657+0000', 'last_undegraded': '2024-04-25T02:11:55.603657+0000', 'last_fullsized': '2024-04-25T02:11:55.603657+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:12:00.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2024-04-25T02:12:00.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.610560+0000', 'last_change': '2024-04-25T02:11:55.610560+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.610560+0000', 'last_undegraded': '2024-04-25T02:11:55.610560+0000', 'last_fullsized': '2024-04-25T02:11:55.610560+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:12:00.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2024-04-25T02:12:00.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.602299+0000', 'last_change': '2024-04-25T02:11:55.602299+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.602299+0000', 'last_undegraded': '2024-04-25T02:11:55.602299+0000', 'last_fullsized': '2024-04-25T02:11:55.602299+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T02:12:00.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2024-04-25T02:12:00.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.605971+0000', 'last_change': '2024-04-25T02:11:55.605971+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.605971+0000', 'last_undegraded': '2024-04-25T02:11:55.605971+0000', 'last_fullsized': '2024-04-25T02:11:55.605971+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:12:00.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2024-04-25T02:12:00.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.607765+0000', 'last_change': '2024-04-25T02:11:55.607765+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.607765+0000', 'last_undegraded': '2024-04-25T02:11:55.607765+0000', 'last_fullsized': '2024-04-25T02:11:55.607765+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T02:12:00.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2024-04-25T02:12:00.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.602641+0000', 'last_change': '2024-04-25T02:11:55.602641+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.602641+0000', 'last_undegraded': '2024-04-25T02:11:55.602641+0000', 'last_fullsized': '2024-04-25T02:11:55.602641+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:12:00.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2024-04-25T02:12:00.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.609451+0000', 'last_change': '2024-04-25T02:11:55.609451+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.609451+0000', 'last_undegraded': '2024-04-25T02:11:55.609451+0000', 'last_fullsized': '2024-04-25T02:11:55.609451+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T02:12:00.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2024-04-25T02:12:00.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.605325+0000', 'last_change': '2024-04-25T02:11:55.605325+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.605325+0000', 'last_undegraded': '2024-04-25T02:11:55.605325+0000', 'last_fullsized': '2024-04-25T02:11:55.605325+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:12:00.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2024-04-25T02:12:00.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.607193+0000', 'last_change': '2024-04-25T02:11:55.607193+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.607193+0000', 'last_undegraded': '2024-04-25T02:11:55.607193+0000', 'last_fullsized': '2024-04-25T02:11:55.607193+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T02:12:00.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2024-04-25T02:12:00.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:11:55.603696+0000', 'last_change': '2024-04-25T02:11:55.603696+0000', 'last_active': '2024-04-25T02:11:55.594161+0000', 'last_peered': '2024-04-25T02:11:55.594161+0000', 'last_clean': '2024-04-25T02:11:55.594161+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:11:55.603696+0000', 'last_undegraded': '2024-04-25T02:11:55.603696+0000', 'last_fullsized': '2024-04-25T02:11:55.603696+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'last_clean_scrub_stamp': '2024-04-25T02:11:55.594161+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:12:00.268 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T02:12:00.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.382+0000 7fdc49ba9640 1 Processor -- start 2024-04-25T02:12:00.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.382+0000 7fdc49ba9640 1 -- start start 2024-04-25T02:12:00.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.382+0000 7fdc49ba9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc44158910 0x7fdc4406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.382+0000 7fdc49ba9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc4406e900 0x7fdc4415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.382+0000 7fdc49ba9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc44071a40 con 0x7fdc44158cf0 2024-04-25T02:12:00.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.382+0000 7fdc49ba9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fdc44072650 con 0x7fdc4406e900 2024-04-25T02:12:00.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.382+0000 7fdc49ba9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdc44071d20 con 0x7fdc44158910 2024-04-25T02:12:00.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.383+0000 7fdc3affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc4406e900 0x7fdc4415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.383+0000 7fdc3affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc4406e900 0x7fdc4415eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59974/0 (socket says 172.21.15.79:59974) 2024-04-25T02:12:00.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.383+0000 7fdc3affd640 1 -- 172.21.15.79:0/2369231427 learned_addr learned my addr 172.21.15.79:0/2369231427 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:00.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.383+0000 7fdc3affd640 1 -- 172.21.15.79:0/2369231427 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc44158910 msgr2=0x7fdc4406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:00.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.383+0000 7fdc3affd640 1 --2- 172.21.15.79:0/2369231427 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc44158910 0x7fdc4406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.383+0000 7fdc3affd640 1 -- 172.21.15.79:0/2369231427 >> v1:172.21.15.189:6789/0 conn(0x7fdc44158cf0 legacy=0x7fdc4415b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:00.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.383+0000 7fdc3affd640 1 -- 172.21.15.79:0/2369231427 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc44072000 con 0x7fdc4406e900 2024-04-25T02:12:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.383+0000 7fdc3affd640 1 --2- 172.21.15.79:0/2369231427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4406e900 0x7fdc4415eb90 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fdc440b2850 tx=0x7fdc2c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ccf4d330890fb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.384+0000 7fdc42ffd640 1 -- 172.21.15.79:0/2369231427 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c037070 con 0x7fdc4406e900 2024-04-25T02:12:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.384+0000 7fdc42ffd640 1 -- 172.21.15.79:0/2369231427 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2c032440 con 0x7fdc4406e900 2024-04-25T02:12:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.384+0000 7fdc42ffd640 1 -- 172.21.15.79:0/2369231427 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c032810 con 0x7fdc4406e900 2024-04-25T02:12:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.384+0000 7fdc49ba9640 1 -- 172.21.15.79:0/2369231427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4406e900 msgr2=0x7fdc4415eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.384+0000 7fdc49ba9640 1 --2- 172.21.15.79:0/2369231427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4406e900 0x7fdc4415eb90 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fdc440b2850 tx=0x7fdc2c02a200 comp rx=0 tx=0).stop 2024-04-25T02:12:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.384+0000 7fdc49ba9640 1 -- 172.21.15.79:0/2369231427 shutdown_connections 2024-04-25T02:12:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.384+0000 7fdc49ba9640 1 --2- 172.21.15.79:0/2369231427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4406e900 0x7fdc4415eb90 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.384+0000 7fdc49ba9640 1 --2- 172.21.15.79:0/2369231427 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc44158910 0x7fdc4406e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.384+0000 7fdc49ba9640 1 -- 172.21.15.79:0/2369231427 >> 172.21.15.79:0/2369231427 conn(0x7fdc440cfc80 msgr2=0x7fdc440d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.384+0000 7fdc49ba9640 1 -- 172.21.15.79:0/2369231427 shutdown_connections 2024-04-25T02:12:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.384+0000 7fdc49ba9640 1 -- 172.21.15.79:0/2369231427 wait complete. 2024-04-25T02:12:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.385+0000 7fdc49ba9640 1 Processor -- start 2024-04-25T02:12:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.386+0000 7fdc49ba9640 1 -- start start 2024-04-25T02:12:00.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.386+0000 7fdc49ba9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc4406e900 0x7fdc4415ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.386+0000 7fdc49ba9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc44158910 0x7fdc441f34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.386+0000 7fdc49ba9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc44158cf0 0x7fdc44150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.386+0000 7fdc49ba9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdc440b3cc0 con 0x7fdc44158910 2024-04-25T02:12:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.386+0000 7fdc49ba9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4415f930 con 0x7fdc4406e900 2024-04-25T02:12:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.386+0000 7fdc49ba9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdc440b3e40 con 0x7fdc44158cf0 2024-04-25T02:12:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.386+0000 7fdc3affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc44158910 0x7fdc441f34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.386+0000 7fdc3affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc44158910 0x7fdc441f34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59984/0 (socket says 172.21.15.79:59984) 2024-04-25T02:12:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.386+0000 7fdc3affd640 1 -- 172.21.15.79:0/2666579209 learned_addr learned my addr 172.21.15.79:0/2666579209 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.387+0000 7fdc3affd640 1 -- 172.21.15.79:0/2666579209 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc44158cf0 msgr2=0x7fdc44150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.387+0000 7fdc43fff640 1 --2- 172.21.15.79:0/2666579209 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc44158cf0 0x7fdc44150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.387+0000 7fdc3affd640 1 --2- 172.21.15.79:0/2666579209 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc44158cf0 0x7fdc44150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.387+0000 7fdc437fe640 1 --2- 172.21.15.79:0/2666579209 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc4406e900 0x7fdc4415ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.387+0000 7fdc3affd640 1 -- 172.21.15.79:0/2666579209 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc4406e900 msgr2=0x7fdc4415ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.387+0000 7fdc3affd640 1 --2- 172.21.15.79:0/2666579209 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc4406e900 0x7fdc4415ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.387+0000 7fdc3affd640 1 -- 172.21.15.79:0/2666579209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc441511b0 con 0x7fdc44158910 2024-04-25T02:12:00.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.387+0000 7fdc3affd640 1 --2- 172.21.15.79:0/2666579209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc44158910 0x7fdc441f34a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c000c00 tx=0x7fdc2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:00.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.387+0000 7fdc40ff9640 1 -- 172.21.15.79:0/2666579209 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c041070 con 0x7fdc44158910 2024-04-25T02:12:00.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.387+0000 7fdc40ff9640 1 -- 172.21.15.79:0/2666579209 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2c03c890 con 0x7fdc44158910 2024-04-25T02:12:00.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.387+0000 7fdc40ff9640 1 -- 172.21.15.79:0/2666579209 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c037040 con 0x7fdc44158910 2024-04-25T02:12:00.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.387+0000 7fdc49ba9640 1 -- 172.21.15.79:0/2666579209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc44151490 con 0x7fdc44158910 2024-04-25T02:12:00.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.387+0000 7fdc49ba9640 1 -- 172.21.15.79:0/2666579209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc4414e970 con 0x7fdc44158910 2024-04-25T02:12:00.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.388+0000 7fdc49ba9640 1 -- 172.21.15.79:0/2666579209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc440690a0 con 0x7fdc44158910 2024-04-25T02:12:00.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.388+0000 7fdc40ff9640 1 -- 172.21.15.79:0/2666579209 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc2c044070 con 0x7fdc44158910 2024-04-25T02:12:00.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.389+0000 7fdc40ff9640 1 --2- 172.21.15.79:0/2666579209 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc2406be30 0x7fdc2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.389+0000 7fdc40ff9640 1 -- 172.21.15.79:0/2666579209 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7fdc2c0aba50 con 0x7fdc44158910 2024-04-25T02:12:00.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.389+0000 7fdc437fe640 1 --2- 172.21.15.79:0/2666579209 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc2406be30 0x7fdc2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.389+0000 7fdc437fe640 1 --2- 172.21.15.79:0/2666579209 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc2406be30 0x7fdc2406e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400a810 tx=0x7fdc34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:00.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.393+0000 7fdc40ff9640 1 -- 172.21.15.79:0/2666579209 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdc2c07a380 con 0x7fdc44158910 2024-04-25T02:12:00.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.632+0000 7fdc49ba9640 1 -- 172.21.15.79:0/2666579209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fdc4406cd30 con 0x7fdc44158910 2024-04-25T02:12:00.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.634+0000 7fdc40ff9640 1 -- 172.21.15.79:0/2666579209 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1196 (secure 0 0 0) 0x7fdc2c079c80 con 0x7fdc44158910 2024-04-25T02:12:00.641 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:12:00.641 INFO:teuthology.orchestra.run.smithi079.stdout:{"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":265,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":71,"num_osds":8,"num_up_osds":8,"osd_up_since":1714010866,"num_in_osds":8,"osd_in_since":1714010857,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":233492480,"bytes_avail":772860620800,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":32,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"d","status":"up:active","gid":6708}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-04-25T02:11:23.216766+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T02:12:00.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.636+0000 7fdc49ba9640 1 -- 172.21.15.79:0/2666579209 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc2406be30 msgr2=0x7fdc2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.636+0000 7fdc49ba9640 1 --2- 172.21.15.79:0/2666579209 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc2406be30 0x7fdc2406e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400a810 tx=0x7fdc34008040 comp rx=0 tx=0).stop 2024-04-25T02:12:00.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.636+0000 7fdc49ba9640 1 -- 172.21.15.79:0/2666579209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc44158910 msgr2=0x7fdc441f34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.636+0000 7fdc49ba9640 1 --2- 172.21.15.79:0/2666579209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc44158910 0x7fdc441f34a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c000c00 tx=0x7fdc2c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.636+0000 7fdc49ba9640 1 -- 172.21.15.79:0/2666579209 shutdown_connections 2024-04-25T02:12:00.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.636+0000 7fdc49ba9640 1 --2- 172.21.15.79:0/2666579209 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc2406be30 0x7fdc2406e2f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.636+0000 7fdc49ba9640 1 --2- 172.21.15.79:0/2666579209 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc44158cf0 0x7fdc44150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.636+0000 7fdc49ba9640 1 --2- 172.21.15.79:0/2666579209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc44158910 0x7fdc441f34a0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.636+0000 7fdc49ba9640 1 --2- 172.21.15.79:0/2666579209 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc4406e900 0x7fdc4415ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.636+0000 7fdc49ba9640 1 -- 172.21.15.79:0/2666579209 >> 172.21.15.79:0/2666579209 conn(0x7fdc440cfc80 msgr2=0x7fdc440ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:00.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.636+0000 7fdc49ba9640 1 -- 172.21.15.79:0/2666579209 shutdown_connections 2024-04-25T02:12:00.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.636+0000 7fdc49ba9640 1 -- 172.21.15.79:0/2666579209 wait complete. 2024-04-25T02:12:00.654 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T02:12:00.654 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:12:00.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.784+0000 7f1fcb0bd640 1 Processor -- start 2024-04-25T02:12:00.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.785+0000 7f1fcb0bd640 1 -- start start 2024-04-25T02:12:00.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.785+0000 7f1fcb0bd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1fc406e3b0 0x7f1fc40b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.785+0000 7f1fcb0bd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc4071e00 con 0x7f1fc4143bc0 2024-04-25T02:12:00.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.785+0000 7f1fcb0bd640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc40720a0 con 0x7f1fc406df50 2024-04-25T02:12:00.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.785+0000 7f1fcb0bd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1fc4072cb0 con 0x7f1fc406e3b0 2024-04-25T02:12:00.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.785+0000 7f1fc8e59640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1fc4143bc0 0x7f1fc415f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33070/0 (socket says 172.21.15.79:33070) 2024-04-25T02:12:00.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.785+0000 7f1fc8e59640 1 -- 172.21.15.79:0/3577227469 learned_addr learned my addr 172.21.15.79:0/3577227469 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:00.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.786+0000 7f1fc965a640 1 --2- 172.21.15.79:0/3577227469 >> v2:172.21.15.79:3300/0 conn(0x7f1fc406e3b0 0x7f1fc40b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.786+0000 7f1fc37fe640 1 -- 172.21.15.79:0/3577227469 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3262401746 0 0) 0x7f1fc4071e00 con 0x7f1fc4143bc0 2024-04-25T02:12:00.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.786+0000 7f1fc37fe640 1 -- 172.21.15.79:0/3577227469 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fb4003520 con 0x7f1fc4143bc0 2024-04-25T02:12:00.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.786+0000 7f1fc965a640 1 -- 172.21.15.79:0/3577227469 >> v1:172.21.15.189:6789/0 conn(0x7f1fc406df50 legacy=0x7f1fc40b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:00.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.786+0000 7f1fc965a640 1 -- 172.21.15.79:0/3577227469 >> v1:172.21.15.79:6789/0 conn(0x7f1fc4143bc0 legacy=0x7f1fc415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.786+0000 7f1fc965a640 1 -- 172.21.15.79:0/3577227469 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc4072380 con 0x7f1fc406e3b0 2024-04-25T02:12:00.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.787+0000 7f1fc965a640 1 --2- 172.21.15.79:0/3577227469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc406e3b0 0x7f1fc40b3440 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009d90 tx=0x7f1fbc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fca7f1e2fcc09b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:00.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.787+0000 7f1fc37fe640 1 -- 172.21.15.79:0/3577227469 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc031600 con 0x7f1fc406e3b0 2024-04-25T02:12:00.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.787+0000 7f1fc37fe640 1 -- 172.21.15.79:0/3577227469 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fbc0317a0 con 0x7f1fc406e3b0 2024-04-25T02:12:00.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.787+0000 7f1fc37fe640 1 -- 172.21.15.79:0/3577227469 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc031b70 con 0x7f1fc406e3b0 2024-04-25T02:12:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.787+0000 7f1fcb0bd640 1 -- 172.21.15.79:0/3577227469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc406e3b0 msgr2=0x7f1fc40b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.787+0000 7f1fcb0bd640 1 --2- 172.21.15.79:0/3577227469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc406e3b0 0x7f1fc40b3440 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009d90 tx=0x7f1fbc02a610 comp rx=0 tx=0).stop 2024-04-25T02:12:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.787+0000 7f1fcb0bd640 1 -- 172.21.15.79:0/3577227469 shutdown_connections 2024-04-25T02:12:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.787+0000 7f1fcb0bd640 1 --2- 172.21.15.79:0/3577227469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc406e3b0 0x7f1fc40b3440 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.787+0000 7f1fcb0bd640 1 -- 172.21.15.79:0/3577227469 >> 172.21.15.79:0/3577227469 conn(0x7f1fc40cfc80 msgr2=0x7f1fc40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.787+0000 7f1fcb0bd640 1 -- 172.21.15.79:0/3577227469 shutdown_connections 2024-04-25T02:12:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.787+0000 7f1fcb0bd640 1 -- 172.21.15.79:0/3577227469 wait complete. 2024-04-25T02:12:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.788+0000 7f1fcb0bd640 1 Processor -- start 2024-04-25T02:12:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.788+0000 7f1fcb0bd640 1 -- start start 2024-04-25T02:12:00.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.789+0000 7f1fcb0bd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc406df50 0x7f1fc415d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.789+0000 7f1fcb0bd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc406e3b0 0x7f1fc41330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.789+0000 7f1fcb0bd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc4143bc0 0x7f1fc41e9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.789+0000 7f1fcb0bd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc406e840 con 0x7f1fc406e3b0 2024-04-25T02:12:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.789+0000 7f1fcb0bd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc4072940 con 0x7f1fc4143bc0 2024-04-25T02:12:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.789+0000 7f1fcb0bd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc4143fa0 con 0x7f1fc406df50 2024-04-25T02:12:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.789+0000 7f1fc3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc406e3b0 0x7f1fc41330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.789+0000 7f1fc3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc406e3b0 0x7f1fc41330b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60010/0 (socket says 172.21.15.79:60010) 2024-04-25T02:12:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.789+0000 7f1fc3fff640 1 -- 172.21.15.79:0/453987441 learned_addr learned my addr 172.21.15.79:0/453987441 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.790+0000 7f1fc8e59640 1 --2- 172.21.15.79:0/453987441 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc406df50 0x7f1fc415d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.790+0000 7f1fc3fff640 1 -- 172.21.15.79:0/453987441 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc406df50 msgr2=0x7f1fc415d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.790+0000 7f1fc965a640 1 --2- 172.21.15.79:0/453987441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc4143bc0 0x7f1fc41e9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.790+0000 7f1fc3fff640 1 --2- 172.21.15.79:0/453987441 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc406df50 0x7f1fc415d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.790+0000 7f1fc3fff640 1 -- 172.21.15.79:0/453987441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc4143bc0 msgr2=0x7f1fc41e9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.790+0000 7f1fc3fff640 1 --2- 172.21.15.79:0/453987441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc4143bc0 0x7f1fc41e9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.790+0000 7f1fc3fff640 1 -- 172.21.15.79:0/453987441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc41e6420 con 0x7f1fc406e3b0 2024-04-25T02:12:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.790+0000 7f1fc3fff640 1 --2- 172.21.15.79:0/453987441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc406e3b0 0x7f1fc41330b0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000b3f0 tx=0x7f1fb000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.790+0000 7f1fc17fa640 1 -- 172.21.15.79:0/453987441 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0015020 con 0x7f1fc406e3b0 2024-04-25T02:12:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.790+0000 7f1fc17fa640 1 -- 172.21.15.79:0/453987441 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb0011830 con 0x7f1fc406e3b0 2024-04-25T02:12:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.790+0000 7f1fc17fa640 1 -- 172.21.15.79:0/453987441 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0011c20 con 0x7f1fc406e3b0 2024-04-25T02:12:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.790+0000 7f1fcb0bd640 1 -- 172.21.15.79:0/453987441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc41e6700 con 0x7f1fc406e3b0 2024-04-25T02:12:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.790+0000 7f1fcb0bd640 1 -- 172.21.15.79:0/453987441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc41e6cc0 con 0x7f1fc406e3b0 2024-04-25T02:12:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.791+0000 7f1fcb0bd640 1 -- 172.21.15.79:0/453987441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc4144430 con 0x7f1fc406e3b0 2024-04-25T02:12:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.791+0000 7f1fc17fa640 1 -- 172.21.15.79:0/453987441 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fb0018020 con 0x7f1fc406e3b0 2024-04-25T02:12:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.792+0000 7f1fc17fa640 1 --2- 172.21.15.79:0/453987441 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa806be30 0x7f1fa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.792+0000 7f1fc17fa640 1 -- 172.21.15.79:0/453987441 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f1fb008aa70 con 0x7f1fc406e3b0 2024-04-25T02:12:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.792+0000 7f1fc8e59640 1 --2- 172.21.15.79:0/453987441 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa806be30 0x7f1fa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.792+0000 7f1fc8e59640 1 --2- 172.21.15.79:0/453987441 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa806be30 0x7f1fa806e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8000f60 tx=0x7f1fb8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:00.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.796+0000 7f1fc17fa640 1 -- 172.21.15.79:0/453987441 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1fc4144430 con 0x7f1fc406e3b0 2024-04-25T02:12:00.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.964+0000 7f1fcb0bd640 1 -- 172.21.15.79:0/453987441 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1fc40690a0 con 0x7f1fa806be30 2024-04-25T02:12:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.970+0000 7f1fc17fa640 1 -- 172.21.15.79:0/453987441 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246754 (secure 0 0 0) 0x7f1fc40690a0 con 0x7f1fa806be30 2024-04-25T02:12:00.979 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:12:00.980 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.973+0000 7f1fcb0bd640 1 -- 172.21.15.79:0/453987441 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa806be30 msgr2=0x7f1fa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.973+0000 7f1fcb0bd640 1 --2- 172.21.15.79:0/453987441 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa806be30 0x7f1fa806e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8000f60 tx=0x7f1fb8009040 comp rx=0 tx=0).stop 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.973+0000 7f1fcb0bd640 1 -- 172.21.15.79:0/453987441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc406e3b0 msgr2=0x7f1fc41330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.973+0000 7f1fcb0bd640 1 --2- 172.21.15.79:0/453987441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc406e3b0 0x7f1fc41330b0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000b3f0 tx=0x7f1fb000b8b0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.973+0000 7f1fcb0bd640 1 -- 172.21.15.79:0/453987441 shutdown_connections 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.973+0000 7f1fcb0bd640 1 --2- 172.21.15.79:0/453987441 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa806be30 0x7f1fa806e2f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.973+0000 7f1fcb0bd640 1 --2- 172.21.15.79:0/453987441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc4143bc0 0x7f1fc41e9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.973+0000 7f1fcb0bd640 1 --2- 172.21.15.79:0/453987441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc406e3b0 0x7f1fc41330b0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.973+0000 7f1fcb0bd640 1 --2- 172.21.15.79:0/453987441 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc406df50 0x7f1fc415d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:00.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.973+0000 7f1fcb0bd640 1 -- 172.21.15.79:0/453987441 >> 172.21.15.79:0/453987441 conn(0x7f1fc40cfc80 msgr2=0x7f1fc4070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:00.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.973+0000 7f1fcb0bd640 1 -- 172.21.15.79:0/453987441 shutdown_connections 2024-04-25T02:12:00.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:00.973+0000 7f1fcb0bd640 1 -- 172.21.15.79:0/453987441 wait complete. 2024-04-25T02:12:00.991 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-04-25T02:11:59.224395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228020,"kb_used_data":7684,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746700,"statfs":{"total":773094113280,"available":772860620800,"internally_reserved":0,"allocated":7868416,"data_stored":3954231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.630354"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.607116+0000","last_change":"2024-04-25T02:11:55.607116+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.607116+0000","last_undegraded":"2024-04-25T02:11:55.607116+0000","last_fullsized":"2024-04-25T02:11:55.607116+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606916+0000","last_change":"2024-04-25T02:11:55.606916+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606916+0000","last_undegraded":"2024-04-25T02:11:55.606916+0000","last_fullsized":"2024-04-25T02:11:55.606916+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604826+0000","last_change":"2024-04-25T02:11:55.604826+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604826+0000","last_undegraded":"2024-04-25T02:11:55.604826+0000","last_fullsized":"2024-04-25T02:11:55.604826+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606076+0000","last_change":"2024-04-25T02:11:55.606076+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606076+0000","last_undegraded":"2024-04-25T02:11:55.606076+0000","last_fullsized":"2024-04-25T02:11:55.606076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604080+0000","last_change":"2024-04-25T02:11:55.604080+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604080+0000","last_undegraded":"2024-04-25T02:11:55.604080+0000","last_fullsized":"2024-04-25T02:11:55.604080+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609278+0000","last_change":"2024-04-25T02:11:55.609278+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609278+0000","last_undegraded":"2024-04-25T02:11:55.609278+0000","last_fullsized":"2024-04-25T02:11:55.609278+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604266+0000","last_change":"2024-04-25T02:11:55.604266+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604266+0000","last_undegraded":"2024-04-25T02:11:55.604266+0000","last_fullsized":"2024-04-25T02:11:55.604266+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606693+0000","last_change":"2024-04-25T02:11:55.606693+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606693+0000","last_undegraded":"2024-04-25T02:11:55.606693+0000","last_fullsized":"2024-04-25T02:11:55.606693+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603626+0000","last_change":"2024-04-25T02:11:55.603626+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603626+0000","last_undegraded":"2024-04-25T02:11:55.603626+0000","last_fullsized":"2024-04-25T02:11:55.603626+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605010+0000","last_change":"2024-04-25T02:11:55.605010+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605010+0000","last_undegraded":"2024-04-25T02:11:55.605010+0000","last_fullsized":"2024-04-25T02:11:55.605010+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608598+0000","last_change":"2024-04-25T02:11:55.608598+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608598+0000","last_undegraded":"2024-04-25T02:11:55.608598+0000","last_fullsized":"2024-04-25T02:11:55.608598+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605667+0000","last_change":"2024-04-25T02:11:55.605667+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605667+0000","last_undegraded":"2024-04-25T02:11:55.605667+0000","last_fullsized":"2024-04-25T02:11:55.605667+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608931+0000","last_change":"2024-04-25T02:11:55.608931+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608931+0000","last_undegraded":"2024-04-25T02:11:55.608931+0000","last_fullsized":"2024-04-25T02:11:55.608931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603722+0000","last_change":"2024-04-25T02:11:55.603722+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603722+0000","last_undegraded":"2024-04-25T02:11:55.603722+0000","last_fullsized":"2024-04-25T02:11:55.603722+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.610212+0000","last_change":"2024-04-25T02:11:55.610212+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.610212+0000","last_undegraded":"2024-04-25T02:11:55.610212+0000","last_fullsized":"2024-04-25T02:11:55.610212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601756+0000","last_change":"2024-04-25T02:11:55.601756+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601756+0000","last_undegraded":"2024-04-25T02:11:55.601756+0000","last_fullsized":"2024-04-25T02:11:55.601756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603211+0000","last_change":"2024-04-25T02:11:55.603211+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603211+0000","last_undegraded":"2024-04-25T02:11:55.603211+0000","last_fullsized":"2024-04-25T02:11:55.603211+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605847+0000","last_change":"2024-04-25T02:11:55.605847+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605847+0000","last_undegraded":"2024-04-25T02:11:55.605847+0000","last_fullsized":"2024-04-25T02:11:55.605847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.612150+0000","last_change":"2024-04-25T02:11:55.612150+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.612150+0000","last_undegraded":"2024-04-25T02:11:55.612150+0000","last_fullsized":"2024-04-25T02:11:55.612150+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608950+0000","last_change":"2024-04-25T02:11:55.608950+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608950+0000","last_undegraded":"2024-04-25T02:11:55.608950+0000","last_fullsized":"2024-04-25T02:11:55.608950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602062+0000","last_change":"2024-04-25T02:11:55.602062+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602062+0000","last_undegraded":"2024-04-25T02:11:55.602062+0000","last_fullsized":"2024-04-25T02:11:55.602062+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601413+0000","last_change":"2024-04-25T02:11:55.601413+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601413+0000","last_undegraded":"2024-04-25T02:11:55.601413+0000","last_fullsized":"2024-04-25T02:11:55.601413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605821+0000","last_change":"2024-04-25T02:11:55.605821+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605821+0000","last_undegraded":"2024-04-25T02:11:55.605821+0000","last_fullsized":"2024-04-25T02:11:55.605821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606765+0000","last_change":"2024-04-25T02:11:55.606765+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606765+0000","last_undegraded":"2024-04-25T02:11:55.606765+0000","last_fullsized":"2024-04-25T02:11:55.606765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603037+0000","last_change":"2024-04-25T02:11:55.603037+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603037+0000","last_undegraded":"2024-04-25T02:11:55.603037+0000","last_fullsized":"2024-04-25T02:11:55.603037+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603022+0000","last_change":"2024-04-25T02:11:55.603022+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603022+0000","last_undegraded":"2024-04-25T02:11:55.603022+0000","last_fullsized":"2024-04-25T02:11:55.603022+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604446+0000","last_change":"2024-04-25T02:11:55.604446+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604446+0000","last_undegraded":"2024-04-25T02:11:55.604446+0000","last_fullsized":"2024-04-25T02:11:55.604446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605200+0000","last_change":"2024-04-25T02:11:55.605200+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605200+0000","last_undegraded":"2024-04-25T02:11:55.605200+0000","last_fullsized":"2024-04-25T02:11:55.605200+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605575+0000","last_change":"2024-04-25T02:11:55.605575+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605575+0000","last_undegraded":"2024-04-25T02:11:55.605575+0000","last_fullsized":"2024-04-25T02:11:55.605575+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602055+0000","last_change":"2024-04-25T02:11:55.602055+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602055+0000","last_undegraded":"2024-04-25T02:11:55.602055+0000","last_fullsized":"2024-04-25T02:11:55.602055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602029+0000","last_change":"2024-04-25T02:11:55.602029+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602029+0000","last_undegraded":"2024-04-25T02:11:55.602029+0000","last_fullsized":"2024-04-25T02:11:55.602029+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606192+0000","last_change":"2024-04-25T02:11:55.606192+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606192+0000","last_undegraded":"2024-04-25T02:11:55.606192+0000","last_fullsized":"2024-04-25T02:11:55.606192+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605418+0000","last_change":"2024-04-25T02:11:55.605418+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605418+0000","last_undegraded":"2024-04-25T02:11:55.605418+0000","last_fullsized":"2024-04-25T02:11:55.605418+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617026+0000","last_change":"2024-04-25T02:11:55.615213+0000","last_active":"2024-04-25T02:11:55.617026+0000","last_peered":"2024-04-25T02:11:55.617026+0000","last_clean":"2024-04-25T02:11:55.617026+0000","last_became_active":"2024-04-25T02:11:55.614877+0000","last_became_peered":"2024-04-25T02:11:55.614877+0000","last_unstale":"2024-04-25T02:11:55.617026+0000","last_undegraded":"2024-04-25T02:11:55.617026+0000","last_fullsized":"2024-04-25T02:11:55.617026+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:12:40.303720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602766+0000","last_change":"2024-04-25T02:11:55.602766+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602766+0000","last_undegraded":"2024-04-25T02:11:55.602766+0000","last_fullsized":"2024-04-25T02:11:55.602766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620001+0000","last_change":"2024-04-25T02:11:55.617352+0000","last_active":"2024-04-25T02:11:55.620001+0000","last_peered":"2024-04-25T02:11:55.620001+0000","last_clean":"2024-04-25T02:11:55.620001+0000","last_became_active":"2024-04-25T02:11:55.617068+0000","last_became_peered":"2024-04-25T02:11:55.617068+0000","last_unstale":"2024-04-25T02:11:55.620001+0000","last_undegraded":"2024-04-25T02:11:55.620001+0000","last_fullsized":"2024-04-25T02:11:55.620001+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:32.851053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609311+0000","last_change":"2024-04-25T02:11:55.609311+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609311+0000","last_undegraded":"2024-04-25T02:11:55.609311+0000","last_fullsized":"2024-04-25T02:11:55.609311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620294+0000","last_change":"2024-04-25T02:11:55.618718+0000","last_active":"2024-04-25T02:11:55.620294+0000","last_peered":"2024-04-25T02:11:55.620294+0000","last_clean":"2024-04-25T02:11:55.620294+0000","last_became_active":"2024-04-25T02:11:55.618396+0000","last_became_peered":"2024-04-25T02:11:55.618396+0000","last_unstale":"2024-04-25T02:11:55.620294+0000","last_undegraded":"2024-04-25T02:11:55.620294+0000","last_fullsized":"2024-04-25T02:11:55.620294+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:34.747144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608194+0000","last_change":"2024-04-25T02:11:55.608194+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608194+0000","last_undegraded":"2024-04-25T02:11:55.608194+0000","last_fullsized":"2024-04-25T02:11:55.608194+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617620+0000","last_change":"2024-04-25T02:11:55.616480+0000","last_active":"2024-04-25T02:11:55.617620+0000","last_peered":"2024-04-25T02:11:55.617620+0000","last_clean":"2024-04-25T02:11:55.617620+0000","last_became_active":"2024-04-25T02:11:55.616118+0000","last_became_peered":"2024-04-25T02:11:55.616118+0000","last_unstale":"2024-04-25T02:11:55.617620+0000","last_undegraded":"2024-04-25T02:11:55.617620+0000","last_fullsized":"2024-04-25T02:11:55.617620+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:14.359235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601516+0000","last_change":"2024-04-25T02:11:55.601516+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601516+0000","last_undegraded":"2024-04-25T02:11:55.601516+0000","last_fullsized":"2024-04-25T02:11:55.601516+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618267+0000","last_change":"2024-04-25T02:11:55.616655+0000","last_active":"2024-04-25T02:11:55.618267+0000","last_peered":"2024-04-25T02:11:55.618267+0000","last_clean":"2024-04-25T02:11:55.618267+0000","last_became_active":"2024-04-25T02:11:55.616366+0000","last_became_peered":"2024-04-25T02:11:55.616366+0000","last_unstale":"2024-04-25T02:11:55.618267+0000","last_undegraded":"2024-04-25T02:11:55.618267+0000","last_fullsized":"2024-04-25T02:11:55.618267+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:31:02.982180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.601638+0000","last_change":"2024-04-25T02:11:55.601638+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.601638+0000","last_undegraded":"2024-04-25T02:11:55.601638+0000","last_fullsized":"2024-04-25T02:11:55.601638+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.621386+0000","last_change":"2024-04-25T02:11:55.620695+0000","last_active":"2024-04-25T02:11:55.621386+0000","last_peered":"2024-04-25T02:11:55.621386+0000","last_clean":"2024-04-25T02:11:55.621386+0000","last_became_active":"2024-04-25T02:11:55.620416+0000","last_became_peered":"2024-04-25T02:11:55.620416+0000","last_unstale":"2024-04-25T02:11:55.621386+0000","last_undegraded":"2024-04-25T02:11:55.621386+0000","last_fullsized":"2024-04-25T02:11:55.621386+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:57.604722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603002+0000","last_change":"2024-04-25T02:11:55.603002+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603002+0000","last_undegraded":"2024-04-25T02:11:55.603002+0000","last_fullsized":"2024-04-25T02:11:55.603002+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616285+0000","last_change":"2024-04-25T02:11:55.613841+0000","last_active":"2024-04-25T02:11:55.616285+0000","last_peered":"2024-04-25T02:11:55.616285+0000","last_clean":"2024-04-25T02:11:55.616285+0000","last_became_active":"2024-04-25T02:11:55.613576+0000","last_became_peered":"2024-04-25T02:11:55.613576+0000","last_unstale":"2024-04-25T02:11:55.616285+0000","last_undegraded":"2024-04-25T02:11:55.616285+0000","last_fullsized":"2024-04-25T02:11:55.616285+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:44.628098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609226+0000","last_change":"2024-04-25T02:11:55.609226+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609226+0000","last_undegraded":"2024-04-25T02:11:55.609226+0000","last_fullsized":"2024-04-25T02:11:55.609226+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617573+0000","last_change":"2024-04-25T02:11:55.609302+0000","last_active":"2024-04-25T02:11:55.617573+0000","last_peered":"2024-04-25T02:11:55.617573+0000","last_clean":"2024-04-25T02:11:55.617573+0000","last_became_active":"2024-04-25T02:11:55.609033+0000","last_became_peered":"2024-04-25T02:11:55.609033+0000","last_unstale":"2024-04-25T02:11:55.617573+0000","last_undegraded":"2024-04-25T02:11:55.617573+0000","last_fullsized":"2024-04-25T02:11:55.617573+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:13.254074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602583+0000","last_change":"2024-04-25T02:11:55.602583+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602583+0000","last_undegraded":"2024-04-25T02:11:55.602583+0000","last_fullsized":"2024-04-25T02:11:55.602583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.619414+0000","last_change":"2024-04-25T02:11:55.617474+0000","last_active":"2024-04-25T02:11:55.619414+0000","last_peered":"2024-04-25T02:11:55.619414+0000","last_clean":"2024-04-25T02:11:55.619414+0000","last_became_active":"2024-04-25T02:11:55.617093+0000","last_became_peered":"2024-04-25T02:11:55.617093+0000","last_unstale":"2024-04-25T02:11:55.619414+0000","last_undegraded":"2024-04-25T02:11:55.619414+0000","last_fullsized":"2024-04-25T02:11:55.619414+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:09.181237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606693+0000","last_change":"2024-04-25T02:11:55.606693+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606693+0000","last_undegraded":"2024-04-25T02:11:55.606693+0000","last_fullsized":"2024-04-25T02:11:55.606693+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617368+0000","last_change":"2024-04-25T02:11:55.614158+0000","last_active":"2024-04-25T02:11:55.617368+0000","last_peered":"2024-04-25T02:11:55.617368+0000","last_clean":"2024-04-25T02:11:55.617368+0000","last_became_active":"2024-04-25T02:11:55.613879+0000","last_became_peered":"2024-04-25T02:11:55.613879+0000","last_unstale":"2024-04-25T02:11:55.617368+0000","last_undegraded":"2024-04-25T02:11:55.617368+0000","last_fullsized":"2024-04-25T02:11:55.617368+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:38.580085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608839+0000","last_change":"2024-04-25T02:11:55.608839+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608839+0000","last_undegraded":"2024-04-25T02:11:55.608839+0000","last_fullsized":"2024-04-25T02:11:55.608839+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.615572+0000","last_change":"2024-04-25T02:11:55.613806+0000","last_active":"2024-04-25T02:11:55.615572+0000","last_peered":"2024-04-25T02:11:55.615572+0000","last_clean":"2024-04-25T02:11:55.615572+0000","last_became_active":"2024-04-25T02:11:55.613252+0000","last_became_peered":"2024-04-25T02:11:55.613252+0000","last_unstale":"2024-04-25T02:11:55.615572+0000","last_undegraded":"2024-04-25T02:11:55.615572+0000","last_fullsized":"2024-04-25T02:11:55.615572+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:54.406276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603305+0000","last_change":"2024-04-25T02:11:55.603305+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603305+0000","last_undegraded":"2024-04-25T02:11:55.603305+0000","last_fullsized":"2024-04-25T02:11:55.603305+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620176+0000","last_change":"2024-04-25T02:11:55.616655+0000","last_active":"2024-04-25T02:11:55.620176+0000","last_peered":"2024-04-25T02:11:55.620176+0000","last_clean":"2024-04-25T02:11:55.620176+0000","last_became_active":"2024-04-25T02:11:55.616393+0000","last_became_peered":"2024-04-25T02:11:55.616393+0000","last_unstale":"2024-04-25T02:11:55.620176+0000","last_undegraded":"2024-04-25T02:11:55.620176+0000","last_fullsized":"2024-04-25T02:11:55.620176+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:19.912700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.606210+0000","last_change":"2024-04-25T02:11:55.606210+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.606210+0000","last_undegraded":"2024-04-25T02:11:55.606210+0000","last_fullsized":"2024-04-25T02:11:55.606210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.614348+0000","last_change":"2024-04-25T02:11:55.611138+0000","last_active":"2024-04-25T02:11:55.614348+0000","last_peered":"2024-04-25T02:11:55.614348+0000","last_clean":"2024-04-25T02:11:55.614348+0000","last_became_active":"2024-04-25T02:11:55.610838+0000","last_became_peered":"2024-04-25T02:11:55.610838+0000","last_unstale":"2024-04-25T02:11:55.614348+0000","last_undegraded":"2024-04-25T02:11:55.614348+0000","last_fullsized":"2024-04-25T02:11:55.614348+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:53.559794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604175+0000","last_change":"2024-04-25T02:11:55.604175+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604175+0000","last_undegraded":"2024-04-25T02:11:55.604175+0000","last_fullsized":"2024-04-25T02:11:55.604175+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620834+0000","last_change":"2024-04-25T02:11:55.618236+0000","last_active":"2024-04-25T02:11:55.620834+0000","last_peered":"2024-04-25T02:11:55.620834+0000","last_clean":"2024-04-25T02:11:55.620834+0000","last_became_active":"2024-04-25T02:11:55.617800+0000","last_became_peered":"2024-04-25T02:11:55.617800+0000","last_unstale":"2024-04-25T02:11:55.620834+0000","last_undegraded":"2024-04-25T02:11:55.620834+0000","last_fullsized":"2024-04-25T02:11:55.620834+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:12.740028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.608536+0000","last_change":"2024-04-25T02:11:55.608536+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.608536+0000","last_undegraded":"2024-04-25T02:11:55.608536+0000","last_fullsized":"2024-04-25T02:11:55.608536+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616039+0000","last_change":"2024-04-25T02:11:55.614787+0000","last_active":"2024-04-25T02:11:55.616039+0000","last_peered":"2024-04-25T02:11:55.616039+0000","last_clean":"2024-04-25T02:11:55.616039+0000","last_became_active":"2024-04-25T02:11:55.614456+0000","last_became_peered":"2024-04-25T02:11:55.614456+0000","last_unstale":"2024-04-25T02:11:55.616039+0000","last_undegraded":"2024-04-25T02:11:55.616039+0000","last_fullsized":"2024-04-25T02:11:55.616039+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:00.242853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602723+0000","last_change":"2024-04-25T02:11:55.602723+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602723+0000","last_undegraded":"2024-04-25T02:11:55.602723+0000","last_fullsized":"2024-04-25T02:11:55.602723+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616780+0000","last_change":"2024-04-25T02:11:55.613116+0000","last_active":"2024-04-25T02:11:55.616780+0000","last_peered":"2024-04-25T02:11:55.616780+0000","last_clean":"2024-04-25T02:11:55.616780+0000","last_became_active":"2024-04-25T02:11:55.612711+0000","last_became_peered":"2024-04-25T02:11:55.612711+0000","last_unstale":"2024-04-25T02:11:55.616780+0000","last_undegraded":"2024-04-25T02:11:55.616780+0000","last_fullsized":"2024-04-25T02:11:55.616780+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:21.747623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.604604+0000","last_change":"2024-04-25T02:11:55.604604+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.604604+0000","last_undegraded":"2024-04-25T02:11:55.604604+0000","last_fullsized":"2024-04-25T02:11:55.604604+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617335+0000","last_change":"2024-04-25T02:11:55.613889+0000","last_active":"2024-04-25T02:11:55.617335+0000","last_peered":"2024-04-25T02:11:55.617335+0000","last_clean":"2024-04-25T02:11:55.617335+0000","last_became_active":"2024-04-25T02:11:55.613613+0000","last_became_peered":"2024-04-25T02:11:55.613613+0000","last_unstale":"2024-04-25T02:11:55.617335+0000","last_undegraded":"2024-04-25T02:11:55.617335+0000","last_fullsized":"2024-04-25T02:11:55.617335+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:43.656103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605299+0000","last_change":"2024-04-25T02:11:55.605299+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605299+0000","last_undegraded":"2024-04-25T02:11:55.605299+0000","last_fullsized":"2024-04-25T02:11:55.605299+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620314+0000","last_change":"2024-04-25T02:11:55.618770+0000","last_active":"2024-04-25T02:11:55.620314+0000","last_peered":"2024-04-25T02:11:55.620314+0000","last_clean":"2024-04-25T02:11:55.620314+0000","last_became_active":"2024-04-25T02:11:55.618388+0000","last_became_peered":"2024-04-25T02:11:55.618388+0000","last_unstale":"2024-04-25T02:11:55.620314+0000","last_undegraded":"2024-04-25T02:11:55.620314+0000","last_fullsized":"2024-04-25T02:11:55.620314+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:22.677232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605216+0000","last_change":"2024-04-25T02:11:55.605216+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605216+0000","last_undegraded":"2024-04-25T02:11:55.605216+0000","last_fullsized":"2024-04-25T02:11:55.605216+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620981+0000","last_change":"2024-04-25T02:11:55.619965+0000","last_active":"2024-04-25T02:11:55.620981+0000","last_peered":"2024-04-25T02:11:55.620981+0000","last_clean":"2024-04-25T02:11:55.620981+0000","last_became_active":"2024-04-25T02:11:55.619679+0000","last_became_peered":"2024-04-25T02:11:55.619679+0000","last_unstale":"2024-04-25T02:11:55.620981+0000","last_undegraded":"2024-04-25T02:11:55.620981+0000","last_fullsized":"2024-04-25T02:11:55.620981+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:44.145676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602751+0000","last_change":"2024-04-25T02:11:55.602751+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602751+0000","last_undegraded":"2024-04-25T02:11:55.602751+0000","last_fullsized":"2024-04-25T02:11:55.602751+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617781+0000","last_change":"2024-04-25T02:11:55.616188+0000","last_active":"2024-04-25T02:11:55.617781+0000","last_peered":"2024-04-25T02:11:55.617781+0000","last_clean":"2024-04-25T02:11:55.617781+0000","last_became_active":"2024-04-25T02:11:55.615921+0000","last_became_peered":"2024-04-25T02:11:55.615921+0000","last_unstale":"2024-04-25T02:11:55.617781+0000","last_undegraded":"2024-04-25T02:11:55.617781+0000","last_fullsized":"2024-04-25T02:11:55.617781+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:52.550255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605182+0000","last_change":"2024-04-25T02:11:55.605182+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605182+0000","last_undegraded":"2024-04-25T02:11:55.605182+0000","last_fullsized":"2024-04-25T02:11:55.605182+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.621373+0000","last_change":"2024-04-25T02:11:55.620628+0000","last_active":"2024-04-25T02:11:55.621373+0000","last_peered":"2024-04-25T02:11:55.621373+0000","last_clean":"2024-04-25T02:11:55.621373+0000","last_became_active":"2024-04-25T02:11:55.620360+0000","last_became_peered":"2024-04-25T02:11:55.620360+0000","last_unstale":"2024-04-25T02:11:55.621373+0000","last_undegraded":"2024-04-25T02:11:55.621373+0000","last_fullsized":"2024-04-25T02:11:55.621373+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:49.417443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603999+0000","last_change":"2024-04-25T02:11:55.603999+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603999+0000","last_undegraded":"2024-04-25T02:11:55.603999+0000","last_fullsized":"2024-04-25T02:11:55.603999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.613700+0000","last_change":"2024-04-25T02:11:55.611740+0000","last_active":"2024-04-25T02:11:55.613700+0000","last_peered":"2024-04-25T02:11:55.613700+0000","last_clean":"2024-04-25T02:11:55.613700+0000","last_became_active":"2024-04-25T02:11:55.611477+0000","last_became_peered":"2024-04-25T02:11:55.611477+0000","last_unstale":"2024-04-25T02:11:55.613700+0000","last_undegraded":"2024-04-25T02:11:55.613700+0000","last_fullsized":"2024-04-25T02:11:55.613700+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:41.075565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603657+0000","last_change":"2024-04-25T02:11:55.603657+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603657+0000","last_undegraded":"2024-04-25T02:11:55.603657+0000","last_fullsized":"2024-04-25T02:11:55.603657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.620266+0000","last_change":"2024-04-25T02:11:55.618924+0000","last_active":"2024-04-25T02:11:55.620266+0000","last_peered":"2024-04-25T02:11:55.620266+0000","last_clean":"2024-04-25T02:11:55.620266+0000","last_became_active":"2024-04-25T02:11:55.618658+0000","last_became_peered":"2024-04-25T02:11:55.618658+0000","last_unstale":"2024-04-25T02:11:55.620266+0000","last_undegraded":"2024-04-25T02:11:55.620266+0000","last_fullsized":"2024-04-25T02:11:55.620266+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:41.849723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.610560+0000","last_change":"2024-04-25T02:11:55.610560+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.610560+0000","last_undegraded":"2024-04-25T02:11:55.610560+0000","last_fullsized":"2024-04-25T02:11:55.610560+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.617652+0000","last_change":"2024-04-25T02:11:55.616514+0000","last_active":"2024-04-25T02:11:55.617652+0000","last_peered":"2024-04-25T02:11:55.617652+0000","last_clean":"2024-04-25T02:11:55.617652+0000","last_became_active":"2024-04-25T02:11:55.615526+0000","last_became_peered":"2024-04-25T02:11:55.615526+0000","last_unstale":"2024-04-25T02:11:55.617652+0000","last_undegraded":"2024-04-25T02:11:55.617652+0000","last_fullsized":"2024-04-25T02:11:55.617652+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:11.176893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602299+0000","last_change":"2024-04-25T02:11:55.602299+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602299+0000","last_undegraded":"2024-04-25T02:11:55.602299+0000","last_fullsized":"2024-04-25T02:11:55.602299+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.616552+0000","last_change":"2024-04-25T02:11:55.615567+0000","last_active":"2024-04-25T02:11:55.616552+0000","last_peered":"2024-04-25T02:11:55.616552+0000","last_clean":"2024-04-25T02:11:55.616552+0000","last_became_active":"2024-04-25T02:11:55.615288+0000","last_became_peered":"2024-04-25T02:11:55.615288+0000","last_unstale":"2024-04-25T02:11:55.616552+0000","last_undegraded":"2024-04-25T02:11:55.616552+0000","last_fullsized":"2024-04-25T02:11:55.616552+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:55.860433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605971+0000","last_change":"2024-04-25T02:11:55.605971+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605971+0000","last_undegraded":"2024-04-25T02:11:55.605971+0000","last_fullsized":"2024-04-25T02:11:55.605971+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618315+0000","last_change":"2024-04-25T02:11:55.613928+0000","last_active":"2024-04-25T02:11:55.618315+0000","last_peered":"2024-04-25T02:11:55.618315+0000","last_clean":"2024-04-25T02:11:55.618315+0000","last_became_active":"2024-04-25T02:11:55.613174+0000","last_became_peered":"2024-04-25T02:11:55.613174+0000","last_unstale":"2024-04-25T02:11:55.618315+0000","last_undegraded":"2024-04-25T02:11:55.618315+0000","last_fullsized":"2024-04-25T02:11:55.618315+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:22.107459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.607765+0000","last_change":"2024-04-25T02:11:55.607765+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.607765+0000","last_undegraded":"2024-04-25T02:11:55.607765+0000","last_fullsized":"2024-04-25T02:11:55.607765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.619968+0000","last_change":"2024-04-25T02:11:55.614266+0000","last_active":"2024-04-25T02:11:55.619968+0000","last_peered":"2024-04-25T02:11:55.619968+0000","last_clean":"2024-04-25T02:11:55.619968+0000","last_became_active":"2024-04-25T02:11:55.613693+0000","last_became_peered":"2024-04-25T02:11:55.613693+0000","last_unstale":"2024-04-25T02:11:55.619968+0000","last_undegraded":"2024-04-25T02:11:55.619968+0000","last_fullsized":"2024-04-25T02:11:55.619968+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:09.177672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.602641+0000","last_change":"2024-04-25T02:11:55.602641+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.602641+0000","last_undegraded":"2024-04-25T02:11:55.602641+0000","last_fullsized":"2024-04-25T02:11:55.602641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618273+0000","last_change":"2024-04-25T02:11:55.613675+0000","last_active":"2024-04-25T02:11:55.618273+0000","last_peered":"2024-04-25T02:11:55.618273+0000","last_clean":"2024-04-25T02:11:55.618273+0000","last_became_active":"2024-04-25T02:11:55.613419+0000","last_became_peered":"2024-04-25T02:11:55.613419+0000","last_unstale":"2024-04-25T02:11:55.618273+0000","last_undegraded":"2024-04-25T02:11:55.618273+0000","last_fullsized":"2024-04-25T02:11:55.618273+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:39.445877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.609451+0000","last_change":"2024-04-25T02:11:55.609451+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.609451+0000","last_undegraded":"2024-04-25T02:11:55.609451+0000","last_fullsized":"2024-04-25T02:11:55.609451+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618578+0000","last_change":"2024-04-25T02:11:55.614522+0000","last_active":"2024-04-25T02:11:55.618578+0000","last_peered":"2024-04-25T02:11:55.618578+0000","last_clean":"2024-04-25T02:11:55.618578+0000","last_became_active":"2024-04-25T02:11:55.614256+0000","last_became_peered":"2024-04-25T02:11:55.614256+0000","last_unstale":"2024-04-25T02:11:55.618578+0000","last_undegraded":"2024-04-25T02:11:55.618578+0000","last_fullsized":"2024-04-25T02:11:55.618578+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:19.338202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.605325+0000","last_change":"2024-04-25T02:11:55.605325+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.605325+0000","last_undegraded":"2024-04-25T02:11:55.605325+0000","last_fullsized":"2024-04-25T02:11:55.605325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.612985+0000","last_change":"2024-04-25T02:11:55.609657+0000","last_active":"2024-04-25T02:11:55.612985+0000","last_peered":"2024-04-25T02:11:55.612985+0000","last_clean":"2024-04-25T02:11:55.612985+0000","last_became_active":"2024-04-25T02:11:55.609375+0000","last_became_peered":"2024-04-25T02:11:55.609375+0000","last_unstale":"2024-04-25T02:11:55.612985+0000","last_undegraded":"2024-04-25T02:11:55.612985+0000","last_fullsized":"2024-04-25T02:11:55.612985+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:36:16.079285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.607193+0000","last_change":"2024-04-25T02:11:55.607193+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.607193+0000","last_undegraded":"2024-04-25T02:11:55.607193+0000","last_fullsized":"2024-04-25T02:11:55.607193+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.613636+0000","last_change":"2024-04-25T02:11:55.611952+0000","last_active":"2024-04-25T02:11:55.613636+0000","last_peered":"2024-04-25T02:11:55.613636+0000","last_clean":"2024-04-25T02:11:55.613636+0000","last_became_active":"2024-04-25T02:11:55.611645+0000","last_became_peered":"2024-04-25T02:11:55.611645+0000","last_unstale":"2024-04-25T02:11:55.613636+0000","last_undegraded":"2024-04-25T02:11:55.613636+0000","last_fullsized":"2024-04-25T02:11:55.613636+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:29.500026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T02:11:55.603696+0000","last_change":"2024-04-25T02:11:55.603696+0000","last_active":"2024-04-25T02:11:55.594161+0000","last_peered":"2024-04-25T02:11:55.594161+0000","last_clean":"2024-04-25T02:11:55.594161+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:11:55.603696+0000","last_undegraded":"2024-04-25T02:11:55.603696+0000","last_fullsized":"2024-04-25T02:11:55.603696+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.618344+0000","last_change":"2024-04-25T02:11:55.616970+0000","last_active":"2024-04-25T02:11:55.618344+0000","last_peered":"2024-04-25T02:11:55.618344+0000","last_clean":"2024-04-25T02:11:55.618344+0000","last_became_active":"2024-04-25T02:11:55.616677+0000","last_became_peered":"2024-04-25T02:11:55.616677+0000","last_unstale":"2024-04-25T02:11:55.618344+0000","last_undegraded":"2024-04-25T02:11:55.618344+0000","last_fullsized":"2024-04-25T02:11:55.618344+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:53:40.413609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":256,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T02:11:55.607463+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:11:55.607463+0000","last_peered":"2024-04-25T02:11:55.607463+0000","last_clean":"2024-04-25T02:11:55.607463+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:11:55.607463+0000","last_undegraded":"2024-04-25T02:11:55.607463+0000","last_fullsized":"2024-04-25T02:11:55.607463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1433600,"data_stored":939408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":342765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":342765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":349040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28408,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343432,"statfs":{"total":96636764160,"available":96607674368,"internally_reserved":0,"allocated":1421312,"data_stored":933133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:12:01.882 INFO:tasks.ceph.mds.d.smithi189.stderr:2024-04-25T02:12:01.875+0000 7f16a3a32640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:12:03.996 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:12:04.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.097+0000 7f430d272640 1 Processor -- start 2024-04-25T02:12:04.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.097+0000 7f430d272640 1 -- start start 2024-04-25T02:12:04.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.098+0000 7f430d272640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f430815e610 0x7f43080d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.098+0000 7f430d272640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43080cf3d0 con 0x7f43080d26b0 2024-04-25T02:12:04.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.098+0000 7f430d272640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f430815f000 con 0x7f43080d2a90 2024-04-25T02:12:04.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.098+0000 7f430d272640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f430815f2e0 con 0x7f430815e610 2024-04-25T02:12:04.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.098+0000 7f4306ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f43080d26b0 0x7f43080d1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41740/0 (socket says 172.21.15.79:41740) 2024-04-25T02:12:04.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.098+0000 7f4306ffd640 1 -- 172.21.15.79:0/2801581572 learned_addr learned my addr 172.21.15.79:0/2801581572 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:04.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f43077fe640 1 --2- 172.21.15.79:0/2801581572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f430815e610 0x7f43080d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4305ffb640 1 -- 172.21.15.79:0/2801581572 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610436715 0 0) 0x7f43080cf3d0 con 0x7f43080d26b0 2024-04-25T02:12:04.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4305ffb640 1 -- 172.21.15.79:0/2801581572 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42f0003520 con 0x7f43080d26b0 2024-04-25T02:12:04.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4305ffb640 1 -- 172.21.15.79:0/2801581572 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 397904940 0 0) 0x7f42f0003520 con 0x7f43080d26b0 2024-04-25T02:12:04.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4305ffb640 1 -- 172.21.15.79:0/2801581572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f430815e610 msgr2=0x7f43080d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:04.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4305ffb640 1 --2- 172.21.15.79:0/2801581572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f430815e610 0x7f43080d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4305ffb640 1 -- 172.21.15.79:0/2801581572 >> v1:172.21.15.189:6789/0 conn(0x7f43080d2a90 legacy=0x7f43080cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4305ffb640 1 -- 172.21.15.79:0/2801581572 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430815f5c0 con 0x7f43080d26b0 2024-04-25T02:12:04.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4305ffb640 1 -- 172.21.15.79:0/2801581572 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f42f80019f0 con 0x7f43080d26b0 2024-04-25T02:12:04.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4305ffb640 1 -- 172.21.15.79:0/2801581572 >> v1:172.21.15.79:6789/0 conn(0x7f43080d26b0 legacy=0x7f43080d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4305ffb640 1 --2- 172.21.15.79:0/2801581572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f430815e610 0x7f42f00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4305ffb640 1 --2- 172.21.15.79:0/2801581572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42f0003f20 0x7f42f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4305ffb640 1 --2- 172.21.15.79:0/2801581572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42f0004d40 0x7f42f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4305ffb640 1 -- 172.21.15.79:0/2801581572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f430815f2e0 con 0x7f42f0004d40 2024-04-25T02:12:04.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4305ffb640 1 -- 172.21.15.79:0/2801581572 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f42f000ba20 con 0x7f42f0003f20 2024-04-25T02:12:04.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4305ffb640 1 -- 172.21.15.79:0/2801581572 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f42f000bc20 con 0x7f430815e610 2024-04-25T02:12:04.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f43077fe640 1 --2- 172.21.15.79:0/2801581572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42f0004d40 0x7f42f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f4306ffd640 1 --2- 172.21.15.79:0/2801581572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f430815e610 0x7f42f00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f43067fc640 1 --2- 172.21.15.79:0/2801581572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42f0003f20 0x7f42f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f43077fe640 1 -- 172.21.15.79:0/2801581572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f430815e610 msgr2=0x7f42f00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:04.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f43077fe640 1 --2- 172.21.15.79:0/2801581572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f430815e610 0x7f42f00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f43077fe640 1 -- 172.21.15.79:0/2801581572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42f0003f20 msgr2=0x7f42f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:04.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f43077fe640 1 --2- 172.21.15.79:0/2801581572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42f0003f20 0x7f42f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f43077fe640 1 -- 172.21.15.79:0/2801581572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f0003520 con 0x7f42f0004d40 2024-04-25T02:12:04.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.099+0000 7f43067fc640 1 --2- 172.21.15.79:0/2801581572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42f0003f20 0x7f42f0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:04.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.100+0000 7f43077fe640 1 --2- 172.21.15.79:0/2801581572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42f0004d40 0x7f42f00051c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f4300009ac0 tx=0x7f42f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912baf68d165cfce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:04.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.100+0000 7f4305ffb640 1 -- 172.21.15.79:0/2801581572 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300036070 con 0x7f42f0004d40 2024-04-25T02:12:04.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.100+0000 7f4305ffb640 1 -- 172.21.15.79:0/2801581572 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4300031400 con 0x7f42f0004d40 2024-04-25T02:12:04.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.100+0000 7f4305ffb640 1 -- 172.21.15.79:0/2801581572 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300009690 con 0x7f42f0004d40 2024-04-25T02:12:04.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.101+0000 7f430d272640 1 -- 172.21.15.79:0/2801581572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42f0004d40 msgr2=0x7f42f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.101+0000 7f430d272640 1 --2- 172.21.15.79:0/2801581572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42f0004d40 0x7f42f00051c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f4300009ac0 tx=0x7f42f0005830 comp rx=0 tx=0).stop 2024-04-25T02:12:04.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.101+0000 7f43077fe640 1 -- 172.21.15.79:0/2801581572 reap_dead start 2024-04-25T02:12:04.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.101+0000 7f430d272640 1 -- 172.21.15.79:0/2801581572 shutdown_connections 2024-04-25T02:12:04.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.101+0000 7f430d272640 1 -- 172.21.15.79:0/2801581572 >> 172.21.15.79:0/2801581572 conn(0x7f43080d40d0 msgr2=0x7f43080d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:04.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.101+0000 7f430d272640 1 -- 172.21.15.79:0/2801581572 shutdown_connections 2024-04-25T02:12:04.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.101+0000 7f430d272640 1 -- 172.21.15.79:0/2801581572 wait complete. 2024-04-25T02:12:04.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.102+0000 7f430d272640 1 Processor -- start 2024-04-25T02:12:04.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.102+0000 7f430d272640 1 -- start start 2024-04-25T02:12:04.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f430d272640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43080c8300 0x7f43080c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f430d272640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f430814fc40 0x7f43081500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f430d272640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43080b0cd0 0x7f43080b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f430d272640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43080d2ed0 con 0x7f43080c8300 2024-04-25T02:12:04.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f430d272640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f430815f8a0 con 0x7f43080b0cd0 2024-04-25T02:12:04.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f430d272640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4308150600 con 0x7f430814fc40 2024-04-25T02:12:04.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f4306ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43080c8300 0x7f43080c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f4306ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43080c8300 0x7f43080c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50056/0 (socket says 172.21.15.79:50056) 2024-04-25T02:12:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f4306ffd640 1 -- 172.21.15.79:0/649997844 learned_addr learned my addr 172.21.15.79:0/649997844 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f43067fc640 1 --2- 172.21.15.79:0/649997844 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f430814fc40 0x7f43081500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f43077fe640 1 --2- 172.21.15.79:0/649997844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43080b0cd0 0x7f43080b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f4306ffd640 1 -- 172.21.15.79:0/649997844 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f430814fc40 msgr2=0x7f43081500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f4306ffd640 1 --2- 172.21.15.79:0/649997844 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f430814fc40 0x7f43081500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f4306ffd640 1 -- 172.21.15.79:0/649997844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43080b0cd0 msgr2=0x7f43080b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f4306ffd640 1 --2- 172.21.15.79:0/649997844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43080b0cd0 0x7f43080b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.103+0000 7f4306ffd640 1 -- 172.21.15.79:0/649997844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43080c8c20 con 0x7f43080c8300 2024-04-25T02:12:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.104+0000 7f4306ffd640 1 --2- 172.21.15.79:0/649997844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43080c8300 0x7f43080c86e0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f42f80079e0 tx=0x7f42f800a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.104+0000 7f42ef7fe640 1 -- 172.21.15.79:0/649997844 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f80133f0 con 0x7f43080c8300 2024-04-25T02:12:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.104+0000 7f42ef7fe640 1 -- 172.21.15.79:0/649997844 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f8018070 con 0x7f43080c8300 2024-04-25T02:12:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.104+0000 7f430d272640 1 -- 172.21.15.79:0/649997844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43081537e0 con 0x7f43080c8300 2024-04-25T02:12:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.104+0000 7f42ef7fe640 1 -- 172.21.15.79:0/649997844 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f80137f0 con 0x7f43080c8300 2024-04-25T02:12:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.104+0000 7f430d272640 1 -- 172.21.15.79:0/649997844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4308150be0 con 0x7f43080c8300 2024-04-25T02:12:04.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.105+0000 7f430d272640 1 -- 172.21.15.79:0/649997844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43080681e0 con 0x7f43080c8300 2024-04-25T02:12:04.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.105+0000 7f42ef7fe640 1 -- 172.21.15.79:0/649997844 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f42f8013990 con 0x7f43080c8300 2024-04-25T02:12:04.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.105+0000 7f42ef7fe640 1 --2- 172.21.15.79:0/649997844 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f42f406be30 0x7f42f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.106+0000 7f42ef7fe640 1 -- 172.21.15.79:0/649997844 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f42f808b8a0 con 0x7f43080c8300 2024-04-25T02:12:04.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.106+0000 7f43067fc640 1 --2- 172.21.15.79:0/649997844 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f42f406be30 0x7f42f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.106+0000 7f43067fc640 1 --2- 172.21.15.79:0/649997844 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f42f406be30 0x7f42f406e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f42fc007b40 tx=0x7f42fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:04.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.110+0000 7f42ef7fe640 1 -- 172.21.15.79:0/649997844 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f42f805a250 con 0x7f43080c8300 2024-04-25T02:12:04.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.278+0000 7f430d272640 1 -- 172.21.15.79:0/649997844 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f430808db70 con 0x7f42f406be30 2024-04-25T02:12:04.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.284+0000 7f42ef7fe640 1 -- 172.21.15.79:0/649997844 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252069 (secure 0 0 0) 0x7f430808db70 con 0x7f42f406be30 2024-04-25T02:12:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:12:04.295 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:12:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.287+0000 7f430d272640 1 -- 172.21.15.79:0/649997844 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f42f406be30 msgr2=0x7f42f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.287+0000 7f430d272640 1 --2- 172.21.15.79:0/649997844 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f42f406be30 0x7f42f406e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f42fc007b40 tx=0x7f42fc009040 comp rx=0 tx=0).stop 2024-04-25T02:12:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.287+0000 7f430d272640 1 -- 172.21.15.79:0/649997844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43080c8300 msgr2=0x7f43080c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.287+0000 7f430d272640 1 --2- 172.21.15.79:0/649997844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43080c8300 0x7f43080c86e0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f42f80079e0 tx=0x7f42f800a6c0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.287+0000 7f430d272640 1 -- 172.21.15.79:0/649997844 shutdown_connections 2024-04-25T02:12:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.287+0000 7f430d272640 1 --2- 172.21.15.79:0/649997844 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f42f406be30 0x7f42f406e2f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.287+0000 7f430d272640 1 --2- 172.21.15.79:0/649997844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43080b0cd0 0x7f43080b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.287+0000 7f430d272640 1 --2- 172.21.15.79:0/649997844 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f430814fc40 0x7f43081500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.287+0000 7f430d272640 1 --2- 172.21.15.79:0/649997844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43080c8300 0x7f43080c86e0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.287+0000 7f430d272640 1 -- 172.21.15.79:0/649997844 >> 172.21.15.79:0/649997844 conn(0x7f43080d40d0 msgr2=0x7f43080b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.287+0000 7f430d272640 1 -- 172.21.15.79:0/649997844 shutdown_connections 2024-04-25T02:12:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.287+0000 7f430d272640 1 -- 172.21.15.79:0/649997844 wait complete. 2024-04-25T02:12:04.305 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-04-25T02:12:03.225222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232464,"kb_used_data":7976,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742256,"statfs":{"total":773094113280,"available":772856070144,"internally_reserved":0,"allocated":8167424,"data_stored":4082476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":229756468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.626398"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.015435+0000","last_change":"2024-04-25T02:11:56.623369+0000","last_active":"2024-04-25T02:11:59.015435+0000","last_peered":"2024-04-25T02:11:59.015435+0000","last_clean":"2024-04-25T02:11:59.015435+0000","last_became_active":"2024-04-25T02:11:56.623115+0000","last_became_peered":"2024-04-25T02:11:56.623115+0000","last_unstale":"2024-04-25T02:11:59.015435+0000","last_undegraded":"2024-04-25T02:11:59.015435+0000","last_fullsized":"2024-04-25T02:11:59.015435+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:55.413769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865872+0000","last_change":"2024-04-25T02:11:56.615110+0000","last_active":"2024-04-25T02:11:58.865872+0000","last_peered":"2024-04-25T02:11:58.865872+0000","last_clean":"2024-04-25T02:11:58.865872+0000","last_became_active":"2024-04-25T02:11:56.614683+0000","last_became_peered":"2024-04-25T02:11:56.614683+0000","last_unstale":"2024-04-25T02:11:58.865872+0000","last_undegraded":"2024-04-25T02:11:58.865872+0000","last_fullsized":"2024-04-25T02:11:58.865872+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:46.697810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.565507+0000","last_change":"2024-04-25T02:11:56.616566+0000","last_active":"2024-04-25T02:11:58.565507+0000","last_peered":"2024-04-25T02:11:58.565507+0000","last_clean":"2024-04-25T02:11:58.565507+0000","last_became_active":"2024-04-25T02:11:56.616290+0000","last_became_peered":"2024-04-25T02:11:56.616290+0000","last_unstale":"2024-04-25T02:11:58.565507+0000","last_undegraded":"2024-04-25T02:11:58.565507+0000","last_fullsized":"2024-04-25T02:11:58.565507+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:12.686557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.606643+0000","last_change":"2024-04-25T02:11:56.627625+0000","last_active":"2024-04-25T02:11:57.606643+0000","last_peered":"2024-04-25T02:11:57.606643+0000","last_clean":"2024-04-25T02:11:57.606643+0000","last_became_active":"2024-04-25T02:11:56.627380+0000","last_became_peered":"2024-04-25T02:11:56.627380+0000","last_unstale":"2024-04-25T02:11:57.606643+0000","last_undegraded":"2024-04-25T02:11:57.606643+0000","last_fullsized":"2024-04-25T02:11:57.606643+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:22.755117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.014579+0000","last_change":"2024-04-25T02:11:56.625433+0000","last_active":"2024-04-25T02:11:59.014579+0000","last_peered":"2024-04-25T02:11:59.014579+0000","last_clean":"2024-04-25T02:11:59.014579+0000","last_became_active":"2024-04-25T02:11:56.624892+0000","last_became_peered":"2024-04-25T02:11:56.624892+0000","last_unstale":"2024-04-25T02:11:59.014579+0000","last_undegraded":"2024-04-25T02:11:59.014579+0000","last_fullsized":"2024-04-25T02:11:59.014579+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:59.570745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865338+0000","last_change":"2024-04-25T02:11:56.631689+0000","last_active":"2024-04-25T02:11:58.865338+0000","last_peered":"2024-04-25T02:11:58.865338+0000","last_clean":"2024-04-25T02:11:58.865338+0000","last_became_active":"2024-04-25T02:11:56.631098+0000","last_became_peered":"2024-04-25T02:11:56.631098+0000","last_unstale":"2024-04-25T02:11:58.865338+0000","last_undegraded":"2024-04-25T02:11:58.865338+0000","last_fullsized":"2024-04-25T02:11:58.865338+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:39:08.771904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.604523+0000","last_change":"2024-04-25T02:11:56.607591+0000","last_active":"2024-04-25T02:11:57.604523+0000","last_peered":"2024-04-25T02:11:57.604523+0000","last_clean":"2024-04-25T02:11:57.604523+0000","last_became_active":"2024-04-25T02:11:56.607281+0000","last_became_peered":"2024-04-25T02:11:56.607281+0000","last_unstale":"2024-04-25T02:11:57.604523+0000","last_undegraded":"2024-04-25T02:11:57.604523+0000","last_fullsized":"2024-04-25T02:11:57.604523+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:19.504574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865359+0000","last_change":"2024-04-25T02:11:56.621120+0000","last_active":"2024-04-25T02:11:58.865359+0000","last_peered":"2024-04-25T02:11:58.865359+0000","last_clean":"2024-04-25T02:11:58.865359+0000","last_became_active":"2024-04-25T02:11:56.619135+0000","last_became_peered":"2024-04-25T02:11:56.619135+0000","last_unstale":"2024-04-25T02:11:58.865359+0000","last_undegraded":"2024-04-25T02:11:58.865359+0000","last_fullsized":"2024-04-25T02:11:58.865359+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:31.926632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.014906+0000","last_change":"2024-04-25T02:11:56.622562+0000","last_active":"2024-04-25T02:11:59.014906+0000","last_peered":"2024-04-25T02:11:59.014906+0000","last_clean":"2024-04-25T02:11:59.014906+0000","last_became_active":"2024-04-25T02:11:56.622076+0000","last_became_peered":"2024-04-25T02:11:56.622076+0000","last_unstale":"2024-04-25T02:11:59.014906+0000","last_undegraded":"2024-04-25T02:11:59.014906+0000","last_fullsized":"2024-04-25T02:11:59.014906+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:54.567288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.605103+0000","last_change":"2024-04-25T02:11:56.623210+0000","last_active":"2024-04-25T02:11:57.605103+0000","last_peered":"2024-04-25T02:11:57.605103+0000","last_clean":"2024-04-25T02:11:57.605103+0000","last_became_active":"2024-04-25T02:11:56.622894+0000","last_became_peered":"2024-04-25T02:11:56.622894+0000","last_unstale":"2024-04-25T02:11:57.605103+0000","last_undegraded":"2024-04-25T02:11:57.605103+0000","last_fullsized":"2024-04-25T02:11:57.605103+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:19.504574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.015222+0000","last_change":"2024-04-25T02:11:56.621596+0000","last_active":"2024-04-25T02:11:59.015222+0000","last_peered":"2024-04-25T02:11:59.015222+0000","last_clean":"2024-04-25T02:11:59.015222+0000","last_became_active":"2024-04-25T02:11:56.621306+0000","last_became_peered":"2024-04-25T02:11:56.621306+0000","last_unstale":"2024-04-25T02:11:59.015222+0000","last_undegraded":"2024-04-25T02:11:59.015222+0000","last_fullsized":"2024-04-25T02:11:59.015222+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:03:59.568481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.606740+0000","last_change":"2024-04-25T02:11:56.619574+0000","last_active":"2024-04-25T02:11:57.606740+0000","last_peered":"2024-04-25T02:11:57.606740+0000","last_clean":"2024-04-25T02:11:57.606740+0000","last_became_active":"2024-04-25T02:11:56.619032+0000","last_became_peered":"2024-04-25T02:11:56.619032+0000","last_unstale":"2024-04-25T02:11:57.606740+0000","last_undegraded":"2024-04-25T02:11:57.606740+0000","last_fullsized":"2024-04-25T02:11:57.606740+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:10.188730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.619368+0000","last_change":"2024-04-25T02:11:56.625720+0000","last_active":"2024-04-25T02:11:58.619368+0000","last_peered":"2024-04-25T02:11:58.619368+0000","last_clean":"2024-04-25T02:11:58.619368+0000","last_became_active":"2024-04-25T02:11:56.625450+0000","last_became_peered":"2024-04-25T02:11:56.625450+0000","last_unstale":"2024-04-25T02:11:58.619368+0000","last_undegraded":"2024-04-25T02:11:58.619368+0000","last_fullsized":"2024-04-25T02:11:58.619368+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:08:04.310393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.014590+0000","last_change":"2024-04-25T02:11:56.628346+0000","last_active":"2024-04-25T02:11:59.014590+0000","last_peered":"2024-04-25T02:11:59.014590+0000","last_clean":"2024-04-25T02:11:59.014590+0000","last_became_active":"2024-04-25T02:11:56.628075+0000","last_became_peered":"2024-04-25T02:11:56.628075+0000","last_unstale":"2024-04-25T02:11:59.014590+0000","last_undegraded":"2024-04-25T02:11:59.014590+0000","last_fullsized":"2024-04-25T02:11:59.014590+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:54.822337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.619195+0000","last_change":"2024-04-25T02:11:56.620624+0000","last_active":"2024-04-25T02:11:58.619195+0000","last_peered":"2024-04-25T02:11:58.619195+0000","last_clean":"2024-04-25T02:11:58.619195+0000","last_became_active":"2024-04-25T02:11:56.620342+0000","last_became_peered":"2024-04-25T02:11:56.620342+0000","last_unstale":"2024-04-25T02:11:58.619195+0000","last_undegraded":"2024-04-25T02:11:58.619195+0000","last_fullsized":"2024-04-25T02:11:58.619195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:00.162270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.605047+0000","last_change":"2024-04-25T02:11:56.627750+0000","last_active":"2024-04-25T02:11:57.605047+0000","last_peered":"2024-04-25T02:11:57.605047+0000","last_clean":"2024-04-25T02:11:57.605047+0000","last_became_active":"2024-04-25T02:11:56.627471+0000","last_became_peered":"2024-04-25T02:11:56.627471+0000","last_unstale":"2024-04-25T02:11:57.605047+0000","last_undegraded":"2024-04-25T02:11:57.605047+0000","last_fullsized":"2024-04-25T02:11:57.605047+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:05.331515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.015005+0000","last_change":"2024-04-25T02:11:56.621611+0000","last_active":"2024-04-25T02:11:59.015005+0000","last_peered":"2024-04-25T02:11:59.015005+0000","last_clean":"2024-04-25T02:11:59.015005+0000","last_became_active":"2024-04-25T02:11:56.621344+0000","last_became_peered":"2024-04-25T02:11:56.621344+0000","last_unstale":"2024-04-25T02:11:59.015005+0000","last_undegraded":"2024-04-25T02:11:59.015005+0000","last_fullsized":"2024-04-25T02:11:59.015005+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:45.635591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.606750+0000","last_change":"2024-04-25T02:11:56.626927+0000","last_active":"2024-04-25T02:11:57.606750+0000","last_peered":"2024-04-25T02:11:57.606750+0000","last_clean":"2024-04-25T02:11:57.606750+0000","last_became_active":"2024-04-25T02:11:56.626661+0000","last_became_peered":"2024-04-25T02:11:56.626661+0000","last_unstale":"2024-04-25T02:11:57.606750+0000","last_undegraded":"2024-04-25T02:11:57.606750+0000","last_fullsized":"2024-04-25T02:11:57.606750+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:35.754637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865665+0000","last_change":"2024-04-25T02:11:56.619941+0000","last_active":"2024-04-25T02:11:58.865665+0000","last_peered":"2024-04-25T02:11:58.865665+0000","last_clean":"2024-04-25T02:11:58.865665+0000","last_became_active":"2024-04-25T02:11:56.618644+0000","last_became_peered":"2024-04-25T02:11:56.618644+0000","last_unstale":"2024-04-25T02:11:58.865665+0000","last_undegraded":"2024-04-25T02:11:58.865665+0000","last_fullsized":"2024-04-25T02:11:58.865665+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:05.331515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.619329+0000","last_change":"2024-04-25T02:11:56.627895+0000","last_active":"2024-04-25T02:11:58.619329+0000","last_peered":"2024-04-25T02:11:58.619329+0000","last_clean":"2024-04-25T02:11:58.619329+0000","last_became_active":"2024-04-25T02:11:56.627609+0000","last_became_peered":"2024-04-25T02:11:56.627609+0000","last_unstale":"2024-04-25T02:11:58.619329+0000","last_undegraded":"2024-04-25T02:11:58.619329+0000","last_fullsized":"2024-04-25T02:11:58.619329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:27.323205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.604921+0000","last_change":"2024-04-25T02:11:56.617223+0000","last_active":"2024-04-25T02:11:57.604921+0000","last_peered":"2024-04-25T02:11:57.604921+0000","last_clean":"2024-04-25T02:11:57.604921+0000","last_became_active":"2024-04-25T02:11:56.616965+0000","last_became_peered":"2024-04-25T02:11:56.616965+0000","last_unstale":"2024-04-25T02:11:57.604921+0000","last_undegraded":"2024-04-25T02:11:57.604921+0000","last_fullsized":"2024-04-25T02:11:57.604921+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:39:08.771904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.604777+0000","last_change":"2024-04-25T02:11:56.623010+0000","last_active":"2024-04-25T02:11:57.604777+0000","last_peered":"2024-04-25T02:11:57.604777+0000","last_clean":"2024-04-25T02:11:57.604777+0000","last_became_active":"2024-04-25T02:11:56.622670+0000","last_became_peered":"2024-04-25T02:11:56.622670+0000","last_unstale":"2024-04-25T02:11:57.604777+0000","last_undegraded":"2024-04-25T02:11:57.604777+0000","last_fullsized":"2024-04-25T02:11:57.604777+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:18:35.511177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.015058+0000","last_change":"2024-04-25T02:11:56.628400+0000","last_active":"2024-04-25T02:11:59.015058+0000","last_peered":"2024-04-25T02:11:59.015058+0000","last_clean":"2024-04-25T02:11:59.015058+0000","last_became_active":"2024-04-25T02:11:56.628122+0000","last_became_peered":"2024-04-25T02:11:56.628122+0000","last_unstale":"2024-04-25T02:11:59.015058+0000","last_undegraded":"2024-04-25T02:11:59.015058+0000","last_fullsized":"2024-04-25T02:11:59.015058+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:26:49.715844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.014973+0000","last_change":"2024-04-25T02:11:56.631816+0000","last_active":"2024-04-25T02:11:59.014973+0000","last_peered":"2024-04-25T02:11:59.014973+0000","last_clean":"2024-04-25T02:11:59.014973+0000","last_became_active":"2024-04-25T02:11:56.631542+0000","last_became_peered":"2024-04-25T02:11:56.631542+0000","last_unstale":"2024-04-25T02:11:59.014973+0000","last_undegraded":"2024-04-25T02:11:59.014973+0000","last_fullsized":"2024-04-25T02:11:59.014973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:39:38.075864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.605219+0000","last_change":"2024-04-25T02:11:56.617384+0000","last_active":"2024-04-25T02:11:57.605219+0000","last_peered":"2024-04-25T02:11:57.605219+0000","last_clean":"2024-04-25T02:11:57.605219+0000","last_became_active":"2024-04-25T02:11:56.617110+0000","last_became_peered":"2024-04-25T02:11:56.617110+0000","last_unstale":"2024-04-25T02:11:57.605219+0000","last_undegraded":"2024-04-25T02:11:57.605219+0000","last_fullsized":"2024-04-25T02:11:57.605219+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:28.544451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.605709+0000","last_change":"2024-04-25T02:11:56.620582+0000","last_active":"2024-04-25T02:11:57.605709+0000","last_peered":"2024-04-25T02:11:57.605709+0000","last_clean":"2024-04-25T02:11:57.605709+0000","last_became_active":"2024-04-25T02:11:56.619875+0000","last_became_peered":"2024-04-25T02:11:56.619875+0000","last_unstale":"2024-04-25T02:11:57.605709+0000","last_undegraded":"2024-04-25T02:11:57.605709+0000","last_fullsized":"2024-04-25T02:11:57.605709+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:00.162270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.565496+0000","last_change":"2024-04-25T02:11:56.618579+0000","last_active":"2024-04-25T02:11:58.565496+0000","last_peered":"2024-04-25T02:11:58.565496+0000","last_clean":"2024-04-25T02:11:58.565496+0000","last_became_active":"2024-04-25T02:11:56.618285+0000","last_became_peered":"2024-04-25T02:11:56.618285+0000","last_unstale":"2024-04-25T02:11:58.565496+0000","last_undegraded":"2024-04-25T02:11:58.565496+0000","last_fullsized":"2024-04-25T02:11:58.565496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:16.023697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.604969+0000","last_change":"2024-04-25T02:11:56.616828+0000","last_active":"2024-04-25T02:11:57.604969+0000","last_peered":"2024-04-25T02:11:57.604969+0000","last_clean":"2024-04-25T02:11:57.604969+0000","last_became_active":"2024-04-25T02:11:56.616562+0000","last_became_peered":"2024-04-25T02:11:56.616562+0000","last_unstale":"2024-04-25T02:11:57.604969+0000","last_undegraded":"2024-04-25T02:11:57.604969+0000","last_fullsized":"2024-04-25T02:11:57.604969+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:31.926632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.565525+0000","last_change":"2024-04-25T02:11:56.629128+0000","last_active":"2024-04-25T02:11:58.565525+0000","last_peered":"2024-04-25T02:11:58.565525+0000","last_clean":"2024-04-25T02:11:58.565525+0000","last_became_active":"2024-04-25T02:11:56.627592+0000","last_became_peered":"2024-04-25T02:11:56.627592+0000","last_unstale":"2024-04-25T02:11:58.565525+0000","last_undegraded":"2024-04-25T02:11:58.565525+0000","last_fullsized":"2024-04-25T02:11:58.565525+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:05:36.596950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.605363+0000","last_change":"2024-04-25T02:11:56.625921+0000","last_active":"2024-04-25T02:11:57.605363+0000","last_peered":"2024-04-25T02:11:57.605363+0000","last_clean":"2024-04-25T02:11:57.605363+0000","last_became_active":"2024-04-25T02:11:56.625632+0000","last_became_peered":"2024-04-25T02:11:56.625632+0000","last_unstale":"2024-04-25T02:11:57.605363+0000","last_undegraded":"2024-04-25T02:11:57.605363+0000","last_fullsized":"2024-04-25T02:11:57.605363+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:46.697810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.604764+0000","last_change":"2024-04-25T02:11:56.619555+0000","last_active":"2024-04-25T02:11:57.604764+0000","last_peered":"2024-04-25T02:11:57.604764+0000","last_clean":"2024-04-25T02:11:57.604764+0000","last_became_active":"2024-04-25T02:11:56.618679+0000","last_became_peered":"2024-04-25T02:11:56.618679+0000","last_unstale":"2024-04-25T02:11:57.604764+0000","last_undegraded":"2024-04-25T02:11:57.604764+0000","last_fullsized":"2024-04-25T02:11:57.604764+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:48.516877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865626+0000","last_change":"2024-04-25T02:11:56.622032+0000","last_active":"2024-04-25T02:11:58.865626+0000","last_peered":"2024-04-25T02:11:58.865626+0000","last_clean":"2024-04-25T02:11:58.865626+0000","last_became_active":"2024-04-25T02:11:56.621767+0000","last_became_peered":"2024-04-25T02:11:56.621767+0000","last_unstale":"2024-04-25T02:11:58.865626+0000","last_undegraded":"2024-04-25T02:11:58.865626+0000","last_fullsized":"2024-04-25T02:11:58.865626+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:28.544451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.015391+0000","last_change":"2024-04-25T02:11:56.631101+0000","last_active":"2024-04-25T02:11:59.015391+0000","last_peered":"2024-04-25T02:11:59.015391+0000","last_clean":"2024-04-25T02:11:59.015391+0000","last_became_active":"2024-04-25T02:11:56.630801+0000","last_became_peered":"2024-04-25T02:11:56.630801+0000","last_unstale":"2024-04-25T02:11:59.015391+0000","last_undegraded":"2024-04-25T02:11:59.015391+0000","last_fullsized":"2024-04-25T02:11:59.015391+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:39.728957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"70'4","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.015541+0000","last_change":"2024-04-25T02:11:55.615213+0000","last_active":"2024-04-25T02:11:59.015541+0000","last_peered":"2024-04-25T02:11:59.015541+0000","last_clean":"2024-04-25T02:11:59.015541+0000","last_became_active":"2024-04-25T02:11:55.614877+0000","last_became_peered":"2024-04-25T02:11:55.614877+0000","last_unstale":"2024-04-25T02:11:59.015541+0000","last_undegraded":"2024-04-25T02:11:59.015541+0000","last_fullsized":"2024-04-25T02:11:59.015541+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:42.809644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.015047+0000","last_change":"2024-04-25T02:11:56.620939+0000","last_active":"2024-04-25T02:11:59.015047+0000","last_peered":"2024-04-25T02:11:59.015047+0000","last_clean":"2024-04-25T02:11:59.015047+0000","last_became_active":"2024-04-25T02:11:56.620666+0000","last_became_peered":"2024-04-25T02:11:56.620666+0000","last_unstale":"2024-04-25T02:11:59.015047+0000","last_undegraded":"2024-04-25T02:11:59.015047+0000","last_fullsized":"2024-04-25T02:11:59.015047+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:20.345695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"70'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.619550+0000","last_change":"2024-04-25T02:11:55.617352+0000","last_active":"2024-04-25T02:11:58.619550+0000","last_peered":"2024-04-25T02:11:58.619550+0000","last_clean":"2024-04-25T02:11:58.619550+0000","last_became_active":"2024-04-25T02:11:55.617068+0000","last_became_peered":"2024-04-25T02:11:55.617068+0000","last_unstale":"2024-04-25T02:11:58.619550+0000","last_undegraded":"2024-04-25T02:11:58.619550+0000","last_fullsized":"2024-04-25T02:11:58.619550+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:39:07.764411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865675+0000","last_change":"2024-04-25T02:11:56.624895+0000","last_active":"2024-04-25T02:11:58.865675+0000","last_peered":"2024-04-25T02:11:58.865675+0000","last_clean":"2024-04-25T02:11:58.865675+0000","last_became_active":"2024-04-25T02:11:56.624630+0000","last_became_peered":"2024-04-25T02:11:56.624630+0000","last_unstale":"2024-04-25T02:11:58.865675+0000","last_undegraded":"2024-04-25T02:11:58.865675+0000","last_fullsized":"2024-04-25T02:11:58.865675+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:48.516877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"70'2","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.605232+0000","last_change":"2024-04-25T02:11:55.618718+0000","last_active":"2024-04-25T02:11:57.605232+0000","last_peered":"2024-04-25T02:11:57.605232+0000","last_clean":"2024-04-25T02:11:57.605232+0000","last_became_active":"2024-04-25T02:11:55.618396+0000","last_became_peered":"2024-04-25T02:11:55.618396+0000","last_unstale":"2024-04-25T02:11:57.605232+0000","last_undegraded":"2024-04-25T02:11:57.605232+0000","last_fullsized":"2024-04-25T02:11:57.605232+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:51.883869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.015354+0000","last_change":"2024-04-25T02:11:56.617747+0000","last_active":"2024-04-25T02:11:59.015354+0000","last_peered":"2024-04-25T02:11:59.015354+0000","last_clean":"2024-04-25T02:11:59.015354+0000","last_became_active":"2024-04-25T02:11:56.617395+0000","last_became_peered":"2024-04-25T02:11:56.617395+0000","last_unstale":"2024-04-25T02:11:59.015354+0000","last_undegraded":"2024-04-25T02:11:59.015354+0000","last_fullsized":"2024-04-25T02:11:59.015354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:08:04.310393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"70'2","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865812+0000","last_change":"2024-04-25T02:11:55.616480+0000","last_active":"2024-04-25T02:11:58.865812+0000","last_peered":"2024-04-25T02:11:58.865812+0000","last_clean":"2024-04-25T02:11:58.865812+0000","last_became_active":"2024-04-25T02:11:55.616118+0000","last_became_peered":"2024-04-25T02:11:55.616118+0000","last_unstale":"2024-04-25T02:11:58.865812+0000","last_undegraded":"2024-04-25T02:11:58.865812+0000","last_fullsized":"2024-04-25T02:11:58.865812+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:09.181237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.605523+0000","last_change":"2024-04-25T02:11:56.621718+0000","last_active":"2024-04-25T02:11:57.605523+0000","last_peered":"2024-04-25T02:11:57.605523+0000","last_clean":"2024-04-25T02:11:57.605523+0000","last_became_active":"2024-04-25T02:11:56.621461+0000","last_became_peered":"2024-04-25T02:11:56.621461+0000","last_unstale":"2024-04-25T02:11:57.605523+0000","last_undegraded":"2024-04-25T02:11:57.605523+0000","last_fullsized":"2024-04-25T02:11:57.605523+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:39:38.075864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"70'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.565603+0000","last_change":"2024-04-25T02:11:55.616655+0000","last_active":"2024-04-25T02:11:58.565603+0000","last_peered":"2024-04-25T02:11:58.565603+0000","last_clean":"2024-04-25T02:11:58.565603+0000","last_became_active":"2024-04-25T02:11:55.616366+0000","last_became_peered":"2024-04-25T02:11:55.616366+0000","last_unstale":"2024-04-25T02:11:58.565603+0000","last_undegraded":"2024-04-25T02:11:58.565603+0000","last_fullsized":"2024-04-25T02:11:58.565603+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:00.279361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.604747+0000","last_change":"2024-04-25T02:11:56.617687+0000","last_active":"2024-04-25T02:11:57.604747+0000","last_peered":"2024-04-25T02:11:57.604747+0000","last_clean":"2024-04-25T02:11:57.604747+0000","last_became_active":"2024-04-25T02:11:56.617282+0000","last_became_peered":"2024-04-25T02:11:56.617282+0000","last_unstale":"2024-04-25T02:11:57.604747+0000","last_undegraded":"2024-04-25T02:11:57.604747+0000","last_fullsized":"2024-04-25T02:11:57.604747+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:42.857217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"70'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865240+0000","last_change":"2024-04-25T02:11:55.620695+0000","last_active":"2024-04-25T02:11:58.865240+0000","last_peered":"2024-04-25T02:11:58.865240+0000","last_clean":"2024-04-25T02:11:58.865240+0000","last_became_active":"2024-04-25T02:11:55.620416+0000","last_became_peered":"2024-04-25T02:11:55.620416+0000","last_unstale":"2024-04-25T02:11:58.865240+0000","last_undegraded":"2024-04-25T02:11:58.865240+0000","last_fullsized":"2024-04-25T02:11:58.865240+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:00.242853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.014482+0000","last_change":"2024-04-25T02:11:56.623884+0000","last_active":"2024-04-25T02:11:59.014482+0000","last_peered":"2024-04-25T02:11:59.014482+0000","last_clean":"2024-04-25T02:11:59.014482+0000","last_became_active":"2024-04-25T02:11:56.623502+0000","last_became_peered":"2024-04-25T02:11:56.623502+0000","last_unstale":"2024-04-25T02:11:59.014482+0000","last_undegraded":"2024-04-25T02:11:59.014482+0000","last_fullsized":"2024-04-25T02:11:59.014482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:26:30.367218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.606537+0000","last_change":"2024-04-25T02:11:55.613841+0000","last_active":"2024-04-25T02:11:57.606537+0000","last_peered":"2024-04-25T02:11:57.606537+0000","last_clean":"2024-04-25T02:11:57.606537+0000","last_became_active":"2024-04-25T02:11:55.613576+0000","last_became_peered":"2024-04-25T02:11:55.613576+0000","last_unstale":"2024-04-25T02:11:57.606537+0000","last_undegraded":"2024-04-25T02:11:57.606537+0000","last_fullsized":"2024-04-25T02:11:57.606537+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:29.500026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.619286+0000","last_change":"2024-04-25T02:11:56.618527+0000","last_active":"2024-04-25T02:11:58.619286+0000","last_peered":"2024-04-25T02:11:58.619286+0000","last_clean":"2024-04-25T02:11:58.619286+0000","last_became_active":"2024-04-25T02:11:56.618269+0000","last_became_peered":"2024-04-25T02:11:56.618269+0000","last_unstale":"2024-04-25T02:11:58.619286+0000","last_undegraded":"2024-04-25T02:11:58.619286+0000","last_fullsized":"2024-04-25T02:11:58.619286+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:03:59.568481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.014444+0000","last_change":"2024-04-25T02:11:55.609302+0000","last_active":"2024-04-25T02:11:59.014444+0000","last_peered":"2024-04-25T02:11:59.014444+0000","last_clean":"2024-04-25T02:11:59.014444+0000","last_became_active":"2024-04-25T02:11:55.609033+0000","last_became_peered":"2024-04-25T02:11:55.609033+0000","last_unstale":"2024-04-25T02:11:59.014444+0000","last_undegraded":"2024-04-25T02:11:59.014444+0000","last_fullsized":"2024-04-25T02:11:59.014444+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:27.555470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.605721+0000","last_change":"2024-04-25T02:11:56.618715+0000","last_active":"2024-04-25T02:11:57.605721+0000","last_peered":"2024-04-25T02:11:57.605721+0000","last_clean":"2024-04-25T02:11:57.605721+0000","last_became_active":"2024-04-25T02:11:56.618441+0000","last_became_peered":"2024-04-25T02:11:56.618441+0000","last_unstale":"2024-04-25T02:11:57.605721+0000","last_undegraded":"2024-04-25T02:11:57.605721+0000","last_fullsized":"2024-04-25T02:11:57.605721+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:26:49.715844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.605088+0000","last_change":"2024-04-25T02:11:55.617474+0000","last_active":"2024-04-25T02:11:57.605088+0000","last_peered":"2024-04-25T02:11:57.605088+0000","last_clean":"2024-04-25T02:11:57.605088+0000","last_became_active":"2024-04-25T02:11:55.617093+0000","last_became_peered":"2024-04-25T02:11:55.617093+0000","last_unstale":"2024-04-25T02:11:57.605088+0000","last_undegraded":"2024-04-25T02:11:57.605088+0000","last_fullsized":"2024-04-25T02:11:57.605088+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:00.242853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.015439+0000","last_change":"2024-04-25T02:11:56.632468+0000","last_active":"2024-04-25T02:11:59.015439+0000","last_peered":"2024-04-25T02:11:59.015439+0000","last_clean":"2024-04-25T02:11:59.015439+0000","last_became_active":"2024-04-25T02:11:56.632206+0000","last_became_peered":"2024-04-25T02:11:56.632206+0000","last_unstale":"2024-04-25T02:11:59.015439+0000","last_undegraded":"2024-04-25T02:11:59.015439+0000","last_fullsized":"2024-04-25T02:11:59.015439+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:31:03.989673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865822+0000","last_change":"2024-04-25T02:11:55.614158+0000","last_active":"2024-04-25T02:11:58.865822+0000","last_peered":"2024-04-25T02:11:58.865822+0000","last_clean":"2024-04-25T02:11:58.865822+0000","last_became_active":"2024-04-25T02:11:55.613879+0000","last_became_peered":"2024-04-25T02:11:55.613879+0000","last_unstale":"2024-04-25T02:11:58.865822+0000","last_undegraded":"2024-04-25T02:11:58.865822+0000","last_fullsized":"2024-04-25T02:11:58.865822+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:22.677232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865918+0000","last_change":"2024-04-25T02:11:56.624319+0000","last_active":"2024-04-25T02:11:58.865918+0000","last_peered":"2024-04-25T02:11:58.865918+0000","last_clean":"2024-04-25T02:11:58.865918+0000","last_became_active":"2024-04-25T02:11:56.624050+0000","last_became_peered":"2024-04-25T02:11:56.624050+0000","last_unstale":"2024-04-25T02:11:58.865918+0000","last_undegraded":"2024-04-25T02:11:58.865918+0000","last_fullsized":"2024-04-25T02:11:58.865918+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:39:38.075864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"70'3","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.565615+0000","last_change":"2024-04-25T02:11:55.613806+0000","last_active":"2024-04-25T02:11:58.565615+0000","last_peered":"2024-04-25T02:11:58.565615+0000","last_clean":"2024-04-25T02:11:58.565615+0000","last_became_active":"2024-04-25T02:11:55.613252+0000","last_became_peered":"2024-04-25T02:11:55.613252+0000","last_unstale":"2024-04-25T02:11:58.565615+0000","last_undegraded":"2024-04-25T02:11:58.565615+0000","last_fullsized":"2024-04-25T02:11:58.565615+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:25.289404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.014811+0000","last_change":"2024-04-25T02:11:56.615949+0000","last_active":"2024-04-25T02:11:59.014811+0000","last_peered":"2024-04-25T02:11:59.014811+0000","last_clean":"2024-04-25T02:11:59.014811+0000","last_became_active":"2024-04-25T02:11:56.615666+0000","last_became_peered":"2024-04-25T02:11:56.615666+0000","last_unstale":"2024-04-25T02:11:59.014811+0000","last_undegraded":"2024-04-25T02:11:59.014811+0000","last_fullsized":"2024-04-25T02:11:59.014811+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:44:20.142096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"70'6","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.606818+0000","last_change":"2024-04-25T02:11:55.616655+0000","last_active":"2024-04-25T02:11:57.606818+0000","last_peered":"2024-04-25T02:11:57.606818+0000","last_clean":"2024-04-25T02:11:57.606818+0000","last_became_active":"2024-04-25T02:11:55.616393+0000","last_became_peered":"2024-04-25T02:11:55.616393+0000","last_unstale":"2024-04-25T02:11:57.606818+0000","last_undegraded":"2024-04-25T02:11:57.606818+0000","last_fullsized":"2024-04-25T02:11:57.606818+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:14.359235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.015043+0000","last_change":"2024-04-25T02:11:56.622405+0000","last_active":"2024-04-25T02:11:59.015043+0000","last_peered":"2024-04-25T02:11:59.015043+0000","last_clean":"2024-04-25T02:11:59.015043+0000","last_became_active":"2024-04-25T02:11:56.618989+0000","last_became_peered":"2024-04-25T02:11:56.618989+0000","last_unstale":"2024-04-25T02:11:59.015043+0000","last_undegraded":"2024-04-25T02:11:59.015043+0000","last_fullsized":"2024-04-25T02:11:59.015043+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:00.162270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"70'2","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.606551+0000","last_change":"2024-04-25T02:11:55.611138+0000","last_active":"2024-04-25T02:11:57.606551+0000","last_peered":"2024-04-25T02:11:57.606551+0000","last_clean":"2024-04-25T02:11:57.606551+0000","last_became_active":"2024-04-25T02:11:55.610838+0000","last_became_peered":"2024-04-25T02:11:55.610838+0000","last_unstale":"2024-04-25T02:11:57.606551+0000","last_undegraded":"2024-04-25T02:11:57.606551+0000","last_fullsized":"2024-04-25T02:11:57.606551+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:38.580085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.604694+0000","last_change":"2024-04-25T02:11:56.608502+0000","last_active":"2024-04-25T02:11:57.604694+0000","last_peered":"2024-04-25T02:11:57.604694+0000","last_clean":"2024-04-25T02:11:57.604694+0000","last_became_active":"2024-04-25T02:11:56.608127+0000","last_became_peered":"2024-04-25T02:11:56.608127+0000","last_unstale":"2024-04-25T02:11:57.604694+0000","last_undegraded":"2024-04-25T02:11:57.604694+0000","last_fullsized":"2024-04-25T02:11:57.604694+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:28.544451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865490+0000","last_change":"2024-04-25T02:11:55.618236+0000","last_active":"2024-04-25T02:11:58.865490+0000","last_peered":"2024-04-25T02:11:58.865490+0000","last_clean":"2024-04-25T02:11:58.865490+0000","last_became_active":"2024-04-25T02:11:55.617800+0000","last_became_peered":"2024-04-25T02:11:55.617800+0000","last_unstale":"2024-04-25T02:11:58.865490+0000","last_undegraded":"2024-04-25T02:11:58.865490+0000","last_fullsized":"2024-04-25T02:11:58.865490+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:55.860433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.619191+0000","last_change":"2024-04-25T02:11:56.626342+0000","last_active":"2024-04-25T02:11:58.619191+0000","last_peered":"2024-04-25T02:11:58.619191+0000","last_clean":"2024-04-25T02:11:58.619191+0000","last_became_active":"2024-04-25T02:11:56.626062+0000","last_became_peered":"2024-04-25T02:11:56.626062+0000","last_unstale":"2024-04-25T02:11:58.619191+0000","last_undegraded":"2024-04-25T02:11:58.619191+0000","last_fullsized":"2024-04-25T02:11:58.619191+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:26:49.715844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.604622+0000","last_change":"2024-04-25T02:11:55.614787+0000","last_active":"2024-04-25T02:11:57.604622+0000","last_peered":"2024-04-25T02:11:57.604622+0000","last_clean":"2024-04-25T02:11:57.604622+0000","last_became_active":"2024-04-25T02:11:55.614456+0000","last_became_peered":"2024-04-25T02:11:55.614456+0000","last_unstale":"2024-04-25T02:11:57.604622+0000","last_undegraded":"2024-04-25T02:11:57.604622+0000","last_fullsized":"2024-04-25T02:11:57.604622+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:12:40.303720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.014610+0000","last_change":"2024-04-25T02:11:56.622532+0000","last_active":"2024-04-25T02:11:59.014610+0000","last_peered":"2024-04-25T02:11:59.014610+0000","last_clean":"2024-04-25T02:11:59.014610+0000","last_became_active":"2024-04-25T02:11:56.622258+0000","last_became_peered":"2024-04-25T02:11:56.622258+0000","last_unstale":"2024-04-25T02:11:59.014610+0000","last_undegraded":"2024-04-25T02:11:59.014610+0000","last_fullsized":"2024-04-25T02:11:59.014610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:47.901583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"70'8","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.605365+0000","last_change":"2024-04-25T02:11:55.613116+0000","last_active":"2024-04-25T02:11:57.605365+0000","last_peered":"2024-04-25T02:11:57.605365+0000","last_clean":"2024-04-25T02:11:57.605365+0000","last_became_active":"2024-04-25T02:11:55.612711+0000","last_became_peered":"2024-04-25T02:11:55.612711+0000","last_unstale":"2024-04-25T02:11:57.605365+0000","last_undegraded":"2024-04-25T02:11:57.605365+0000","last_fullsized":"2024-04-25T02:11:57.605365+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:26.688565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.605255+0000","last_change":"2024-04-25T02:11:56.606372+0000","last_active":"2024-04-25T02:11:57.605255+0000","last_peered":"2024-04-25T02:11:57.605255+0000","last_clean":"2024-04-25T02:11:57.605255+0000","last_became_active":"2024-04-25T02:11:56.606026+0000","last_became_peered":"2024-04-25T02:11:56.606026+0000","last_unstale":"2024-04-25T02:11:57.605255+0000","last_undegraded":"2024-04-25T02:11:57.605255+0000","last_fullsized":"2024-04-25T02:11:57.605255+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:48.516877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"70'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865449+0000","last_change":"2024-04-25T02:11:55.613889+0000","last_active":"2024-04-25T02:11:58.865449+0000","last_peered":"2024-04-25T02:11:58.865449+0000","last_clean":"2024-04-25T02:11:58.865449+0000","last_became_active":"2024-04-25T02:11:55.613613+0000","last_became_peered":"2024-04-25T02:11:55.613613+0000","last_unstale":"2024-04-25T02:11:58.865449+0000","last_undegraded":"2024-04-25T02:11:58.865449+0000","last_fullsized":"2024-04-25T02:11:58.865449+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:34.747144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.015542+0000","last_change":"2024-04-25T02:11:56.619771+0000","last_active":"2024-04-25T02:11:59.015542+0000","last_peered":"2024-04-25T02:11:59.015542+0000","last_clean":"2024-04-25T02:11:59.015542+0000","last_became_active":"2024-04-25T02:11:56.619271+0000","last_became_peered":"2024-04-25T02:11:56.619271+0000","last_unstale":"2024-04-25T02:11:59.015542+0000","last_undegraded":"2024-04-25T02:11:59.015542+0000","last_fullsized":"2024-04-25T02:11:59.015542+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:26.296897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"70'2","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.605330+0000","last_change":"2024-04-25T02:11:55.618770+0000","last_active":"2024-04-25T02:11:57.605330+0000","last_peered":"2024-04-25T02:11:57.605330+0000","last_clean":"2024-04-25T02:11:57.605330+0000","last_became_active":"2024-04-25T02:11:55.618388+0000","last_became_peered":"2024-04-25T02:11:55.618388+0000","last_unstale":"2024-04-25T02:11:57.605330+0000","last_undegraded":"2024-04-25T02:11:57.605330+0000","last_fullsized":"2024-04-25T02:11:57.605330+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:41.075565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.606786+0000","last_change":"2024-04-25T02:11:56.618518+0000","last_active":"2024-04-25T02:11:57.606786+0000","last_peered":"2024-04-25T02:11:57.606786+0000","last_clean":"2024-04-25T02:11:57.606786+0000","last_became_active":"2024-04-25T02:11:56.618236+0000","last_became_peered":"2024-04-25T02:11:56.618236+0000","last_unstale":"2024-04-25T02:11:57.606786+0000","last_undegraded":"2024-04-25T02:11:57.606786+0000","last_fullsized":"2024-04-25T02:11:57.606786+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:23.684725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"70'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865739+0000","last_change":"2024-04-25T02:11:55.619965+0000","last_active":"2024-04-25T02:11:58.865739+0000","last_peered":"2024-04-25T02:11:58.865739+0000","last_clean":"2024-04-25T02:11:58.865739+0000","last_became_active":"2024-04-25T02:11:55.619679+0000","last_became_peered":"2024-04-25T02:11:55.619679+0000","last_unstale":"2024-04-25T02:11:58.865739+0000","last_undegraded":"2024-04-25T02:11:58.865739+0000","last_fullsized":"2024-04-25T02:11:58.865739+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:25.469796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.014790+0000","last_change":"2024-04-25T02:11:56.624765+0000","last_active":"2024-04-25T02:11:59.014790+0000","last_peered":"2024-04-25T02:11:59.014790+0000","last_clean":"2024-04-25T02:11:59.014790+0000","last_became_active":"2024-04-25T02:11:56.624481+0000","last_became_peered":"2024-04-25T02:11:56.624481+0000","last_unstale":"2024-04-25T02:11:59.014790+0000","last_undegraded":"2024-04-25T02:11:59.014790+0000","last_fullsized":"2024-04-25T02:11:59.014790+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:58.100064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.015180+0000","last_change":"2024-04-25T02:11:55.616188+0000","last_active":"2024-04-25T02:11:59.015180+0000","last_peered":"2024-04-25T02:11:59.015180+0000","last_clean":"2024-04-25T02:11:59.015180+0000","last_became_active":"2024-04-25T02:11:55.615921+0000","last_became_peered":"2024-04-25T02:11:55.615921+0000","last_unstale":"2024-04-25T02:11:59.015180+0000","last_undegraded":"2024-04-25T02:11:59.015180+0000","last_fullsized":"2024-04-25T02:11:59.015180+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:10.204566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.565476+0000","last_change":"2024-04-25T02:11:56.616529+0000","last_active":"2024-04-25T02:11:58.565476+0000","last_peered":"2024-04-25T02:11:58.565476+0000","last_clean":"2024-04-25T02:11:58.565476+0000","last_became_active":"2024-04-25T02:11:56.616201+0000","last_became_peered":"2024-04-25T02:11:56.616201+0000","last_unstale":"2024-04-25T02:11:58.565476+0000","last_undegraded":"2024-04-25T02:11:58.565476+0000","last_fullsized":"2024-04-25T02:11:58.565476+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:10.524143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865623+0000","last_change":"2024-04-25T02:11:55.620628+0000","last_active":"2024-04-25T02:11:58.865623+0000","last_peered":"2024-04-25T02:11:58.865623+0000","last_clean":"2024-04-25T02:11:58.865623+0000","last_became_active":"2024-04-25T02:11:55.620360+0000","last_became_peered":"2024-04-25T02:11:55.620360+0000","last_unstale":"2024-04-25T02:11:58.865623+0000","last_undegraded":"2024-04-25T02:11:58.865623+0000","last_fullsized":"2024-04-25T02:11:58.865623+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:12:40.303720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.565456+0000","last_change":"2024-04-25T02:11:56.629936+0000","last_active":"2024-04-25T02:11:58.565456+0000","last_peered":"2024-04-25T02:11:58.565456+0000","last_clean":"2024-04-25T02:11:58.565456+0000","last_became_active":"2024-04-25T02:11:56.629638+0000","last_became_peered":"2024-04-25T02:11:56.629638+0000","last_unstale":"2024-04-25T02:11:58.565456+0000","last_undegraded":"2024-04-25T02:11:58.565456+0000","last_fullsized":"2024-04-25T02:11:58.565456+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:32.769521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.604845+0000","last_change":"2024-04-25T02:11:55.611740+0000","last_active":"2024-04-25T02:11:57.604845+0000","last_peered":"2024-04-25T02:11:57.604845+0000","last_clean":"2024-04-25T02:11:57.604845+0000","last_became_active":"2024-04-25T02:11:55.611477+0000","last_became_peered":"2024-04-25T02:11:55.611477+0000","last_unstale":"2024-04-25T02:11:57.604845+0000","last_undegraded":"2024-04-25T02:11:57.604845+0000","last_fullsized":"2024-04-25T02:11:57.604845+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:52.550255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.565493+0000","last_change":"2024-04-25T02:11:56.630299+0000","last_active":"2024-04-25T02:11:58.565493+0000","last_peered":"2024-04-25T02:11:58.565493+0000","last_clean":"2024-04-25T02:11:58.565493+0000","last_became_active":"2024-04-25T02:11:56.629490+0000","last_became_peered":"2024-04-25T02:11:56.629490+0000","last_unstale":"2024-04-25T02:11:58.565493+0000","last_undegraded":"2024-04-25T02:11:58.565493+0000","last_fullsized":"2024-04-25T02:11:58.565493+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:23.701866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.619101+0000","last_change":"2024-04-25T02:11:55.618924+0000","last_active":"2024-04-25T02:11:58.619101+0000","last_peered":"2024-04-25T02:11:58.619101+0000","last_clean":"2024-04-25T02:11:58.619101+0000","last_became_active":"2024-04-25T02:11:55.618658+0000","last_became_peered":"2024-04-25T02:11:55.618658+0000","last_unstale":"2024-04-25T02:11:58.619101+0000","last_undegraded":"2024-04-25T02:11:58.619101+0000","last_fullsized":"2024-04-25T02:11:58.619101+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:30.919138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.619495+0000","last_change":"2024-04-25T02:11:56.622128+0000","last_active":"2024-04-25T02:11:58.619495+0000","last_peered":"2024-04-25T02:11:58.619495+0000","last_clean":"2024-04-25T02:11:58.619495+0000","last_became_active":"2024-04-25T02:11:56.621833+0000","last_became_peered":"2024-04-25T02:11:56.621833+0000","last_unstale":"2024-04-25T02:11:58.619495+0000","last_undegraded":"2024-04-25T02:11:58.619495+0000","last_fullsized":"2024-04-25T02:11:58.619495+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:39.728957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"70'2","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865541+0000","last_change":"2024-04-25T02:11:55.616514+0000","last_active":"2024-04-25T02:11:58.865541+0000","last_peered":"2024-04-25T02:11:58.865541+0000","last_clean":"2024-04-25T02:11:58.865541+0000","last_became_active":"2024-04-25T02:11:55.615526+0000","last_became_peered":"2024-04-25T02:11:55.615526+0000","last_unstale":"2024-04-25T02:11:58.865541+0000","last_undegraded":"2024-04-25T02:11:58.865541+0000","last_fullsized":"2024-04-25T02:11:58.865541+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:34:54.265948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.605116+0000","last_change":"2024-04-25T02:11:56.607324+0000","last_active":"2024-04-25T02:11:57.605116+0000","last_peered":"2024-04-25T02:11:57.605116+0000","last_clean":"2024-04-25T02:11:57.605116+0000","last_became_active":"2024-04-25T02:11:56.607001+0000","last_became_peered":"2024-04-25T02:11:56.607001+0000","last_unstale":"2024-04-25T02:11:57.605116+0000","last_undegraded":"2024-04-25T02:11:57.605116+0000","last_fullsized":"2024-04-25T02:11:57.605116+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:05.331515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"71'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.605811+0000","last_change":"2024-04-25T02:11:55.615567+0000","last_active":"2024-04-25T02:11:57.605811+0000","last_peered":"2024-04-25T02:11:57.605811+0000","last_clean":"2024-04-25T02:11:57.605811+0000","last_became_active":"2024-04-25T02:11:55.615288+0000","last_became_peered":"2024-04-25T02:11:55.615288+0000","last_unstale":"2024-04-25T02:11:57.605811+0000","last_undegraded":"2024-04-25T02:11:57.605811+0000","last_fullsized":"2024-04-25T02:11:57.605811+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:10.204566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.015276+0000","last_change":"2024-04-25T02:11:56.631447+0000","last_active":"2024-04-25T02:11:59.015276+0000","last_peered":"2024-04-25T02:11:59.015276+0000","last_clean":"2024-04-25T02:11:59.015276+0000","last_became_active":"2024-04-25T02:11:56.631178+0000","last_became_peered":"2024-04-25T02:11:56.631178+0000","last_unstale":"2024-04-25T02:11:59.015276+0000","last_undegraded":"2024-04-25T02:11:59.015276+0000","last_fullsized":"2024-04-25T02:11:59.015276+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:27.323205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.014862+0000","last_change":"2024-04-25T02:11:55.613928+0000","last_active":"2024-04-25T02:11:59.014862+0000","last_peered":"2024-04-25T02:11:59.014862+0000","last_clean":"2024-04-25T02:11:59.014862+0000","last_became_active":"2024-04-25T02:11:55.613174+0000","last_became_peered":"2024-04-25T02:11:55.613174+0000","last_unstale":"2024-04-25T02:11:59.014862+0000","last_undegraded":"2024-04-25T02:11:59.014862+0000","last_fullsized":"2024-04-25T02:11:59.014862+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:49:56.420212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.015522+0000","last_change":"2024-04-25T02:11:56.629549+0000","last_active":"2024-04-25T02:11:59.015522+0000","last_peered":"2024-04-25T02:11:59.015522+0000","last_clean":"2024-04-25T02:11:59.015522+0000","last_became_active":"2024-04-25T02:11:56.629253+0000","last_became_peered":"2024-04-25T02:11:56.629253+0000","last_unstale":"2024-04-25T02:11:59.015522+0000","last_undegraded":"2024-04-25T02:11:59.015522+0000","last_fullsized":"2024-04-25T02:11:59.015522+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:11.830833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.619403+0000","last_change":"2024-04-25T02:11:55.614266+0000","last_active":"2024-04-25T02:11:58.619403+0000","last_peered":"2024-04-25T02:11:58.619403+0000","last_clean":"2024-04-25T02:11:58.619403+0000","last_became_active":"2024-04-25T02:11:55.613693+0000","last_became_peered":"2024-04-25T02:11:55.613693+0000","last_unstale":"2024-04-25T02:11:58.619403+0000","last_undegraded":"2024-04-25T02:11:58.619403+0000","last_fullsized":"2024-04-25T02:11:58.619403+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:18:34.503684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.014729+0000","last_change":"2024-04-25T02:11:56.622433+0000","last_active":"2024-04-25T02:11:59.014729+0000","last_peered":"2024-04-25T02:11:59.014729+0000","last_clean":"2024-04-25T02:11:59.014729+0000","last_became_active":"2024-04-25T02:11:56.622143+0000","last_became_peered":"2024-04-25T02:11:56.622143+0000","last_unstale":"2024-04-25T02:11:59.014729+0000","last_undegraded":"2024-04-25T02:11:59.014729+0000","last_fullsized":"2024-04-25T02:11:59.014729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:09.938294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.014657+0000","last_change":"2024-04-25T02:11:55.613675+0000","last_active":"2024-04-25T02:11:59.014657+0000","last_peered":"2024-04-25T02:11:59.014657+0000","last_clean":"2024-04-25T02:11:59.014657+0000","last_became_active":"2024-04-25T02:11:55.613419+0000","last_became_peered":"2024-04-25T02:11:55.613419+0000","last_unstale":"2024-04-25T02:11:59.014657+0000","last_undegraded":"2024-04-25T02:11:59.014657+0000","last_fullsized":"2024-04-25T02:11:59.014657+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:59:52.967461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865322+0000","last_change":"2024-04-25T02:11:56.624791+0000","last_active":"2024-04-25T02:11:58.865322+0000","last_peered":"2024-04-25T02:11:58.865322+0000","last_clean":"2024-04-25T02:11:58.865322+0000","last_became_active":"2024-04-25T02:11:56.624534+0000","last_became_peered":"2024-04-25T02:11:56.624534+0000","last_unstale":"2024-04-25T02:11:58.865322+0000","last_undegraded":"2024-04-25T02:11:58.865322+0000","last_fullsized":"2024-04-25T02:11:58.865322+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:18:35.511177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.606450+0000","last_change":"2024-04-25T02:11:55.614522+0000","last_active":"2024-04-25T02:11:57.606450+0000","last_peered":"2024-04-25T02:11:57.606450+0000","last_clean":"2024-04-25T02:11:57.606450+0000","last_became_active":"2024-04-25T02:11:55.614256+0000","last_became_peered":"2024-04-25T02:11:55.614256+0000","last_unstale":"2024-04-25T02:11:57.606450+0000","last_undegraded":"2024-04-25T02:11:57.606450+0000","last_fullsized":"2024-04-25T02:11:57.606450+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:43.656103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.606538+0000","last_change":"2024-04-25T02:11:56.620726+0000","last_active":"2024-04-25T02:11:57.606538+0000","last_peered":"2024-04-25T02:11:57.606538+0000","last_clean":"2024-04-25T02:11:57.606538+0000","last_became_active":"2024-04-25T02:11:56.620449+0000","last_became_peered":"2024-04-25T02:11:56.620449+0000","last_unstale":"2024-04-25T02:11:57.606538+0000","last_undegraded":"2024-04-25T02:11:57.606538+0000","last_fullsized":"2024-04-25T02:11:57.606538+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:36:17.086778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:57.604470+0000","last_change":"2024-04-25T02:11:55.609657+0000","last_active":"2024-04-25T02:11:57.604470+0000","last_peered":"2024-04-25T02:11:57.604470+0000","last_clean":"2024-04-25T02:11:57.604470+0000","last_became_active":"2024-04-25T02:11:55.609375+0000","last_became_peered":"2024-04-25T02:11:55.609375+0000","last_unstale":"2024-04-25T02:11:57.604470+0000","last_undegraded":"2024-04-25T02:11:57.604470+0000","last_fullsized":"2024-04-25T02:11:57.604470+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:25.469796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865307+0000","last_change":"2024-04-25T02:11:56.624177+0000","last_active":"2024-04-25T02:11:58.865307+0000","last_peered":"2024-04-25T02:11:58.865307+0000","last_clean":"2024-04-25T02:11:58.865307+0000","last_became_active":"2024-04-25T02:11:56.622462+0000","last_became_peered":"2024-04-25T02:11:56.622462+0000","last_unstale":"2024-04-25T02:11:58.865307+0000","last_undegraded":"2024-04-25T02:11:58.865307+0000","last_fullsized":"2024-04-25T02:11:58.865307+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:19.504574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865501+0000","last_change":"2024-04-25T02:11:55.611952+0000","last_active":"2024-04-25T02:11:58.865501+0000","last_peered":"2024-04-25T02:11:58.865501+0000","last_clean":"2024-04-25T02:11:58.865501+0000","last_became_active":"2024-04-25T02:11:55.611645+0000","last_became_peered":"2024-04-25T02:11:55.611645+0000","last_unstale":"2024-04-25T02:11:58.865501+0000","last_undegraded":"2024-04-25T02:11:58.865501+0000","last_fullsized":"2024-04-25T02:11:58.865501+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:26.688565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.565494+0000","last_change":"2024-04-25T02:11:56.630962+0000","last_active":"2024-04-25T02:11:58.565494+0000","last_peered":"2024-04-25T02:11:58.565494+0000","last_clean":"2024-04-25T02:11:58.565494+0000","last_became_active":"2024-04-25T02:11:56.630456+0000","last_became_peered":"2024-04-25T02:11:56.630456+0000","last_unstale":"2024-04-25T02:11:58.565494+0000","last_undegraded":"2024-04-25T02:11:58.565494+0000","last_fullsized":"2024-04-25T02:11:58.565494+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:55.594161+0000","last_clean_scrub_stamp":"2024-04-25T02:11:55.594161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:39.691206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"70'2","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:58.865408+0000","last_change":"2024-04-25T02:11:55.616970+0000","last_active":"2024-04-25T02:11:58.865408+0000","last_peered":"2024-04-25T02:11:58.865408+0000","last_clean":"2024-04-25T02:11:58.865408+0000","last_became_active":"2024-04-25T02:11:55.616677+0000","last_became_peered":"2024-04-25T02:11:55.616677+0000","last_unstale":"2024-04-25T02:11:58.865408+0000","last_undegraded":"2024-04-25T02:11:58.865408+0000","last_fullsized":"2024-04-25T02:11:58.865408+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:11:54.586668+0000","last_clean_scrub_stamp":"2024-04-25T02:11:54.586668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:21.747623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":260,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T02:11:59.015016+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:11:59.015016+0000","last_peered":"2024-04-25T02:11:59.015016+0000","last_clean":"2024-04-25T02:11:59.015016+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:11:59.015016+0000","last_undegraded":"2024-04-25T02:11:59.015016+0000","last_fullsized":"2024-04-25T02:11:59.015016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1466368,"data_stored":953099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":362207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":362205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":362185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":362227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":363727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":364343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":952483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:12:04.309 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T02:12:04.309 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T02:12:04.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.442+0000 7fc1f1a2c640 1 Processor -- start 2024-04-25T02:12:04.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.442+0000 7fc1f1a2c640 1 -- start start 2024-04-25T02:12:04.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.443+0000 7fc1f1a2c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1ec09dcb0 0x7fc1ec070d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.443+0000 7fc1f1a2c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc1ec0cf380 0x7fc1ec071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.443+0000 7fc1f1a2c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1ec15abf0 con 0x7fc1ec15a810 2024-04-25T02:12:04.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.443+0000 7fc1f1a2c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc1ec073050 con 0x7fc1ec0cf380 2024-04-25T02:12:04.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.443+0000 7fc1f1a2c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc1ec0cbdd0 con 0x7fc1ec09dcb0 2024-04-25T02:12:04.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.443+0000 7fc1eb7fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc1ec0cf380 0x7fc1ec071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.443+0000 7fc1ea7fc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1ec09dcb0 0x7fc1ec070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.443+0000 7fc1ea7fc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1ec09dcb0 0x7fc1ec070d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:41906/0 (socket says 172.21.15.79:41906) 2024-04-25T02:12:04.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.443+0000 7fc1ea7fc640 1 -- 172.21.15.79:0/3693859231 learned_addr learned my addr 172.21.15.79:0/3693859231 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:04.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.444+0000 7fc1ea7fc640 1 -- 172.21.15.79:0/3693859231 >> v2:172.21.15.189:3300/0 conn(0x7fc1ec0cf380 msgr2=0x7fc1ec071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:04.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.444+0000 7fc1ea7fc640 1 --2- 172.21.15.79:0/3693859231 >> v2:172.21.15.189:3300/0 conn(0x7fc1ec0cf380 0x7fc1ec071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.444+0000 7fc1ea7fc640 1 -- 172.21.15.79:0/3693859231 >> v1:172.21.15.189:6789/0 conn(0x7fc1ec15a810 legacy=0x7fc1ec0cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.444+0000 7fc1ea7fc640 1 -- 172.21.15.79:0/3693859231 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec0ce580 con 0x7fc1ec09dcb0 2024-04-25T02:12:04.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.444+0000 7fc1e9ffb640 1 -- 172.21.15.79:0/3693859231 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2290681511 0 0) 0x7fc1ec15abf0 con 0x7fc1ec15a810 2024-04-25T02:12:04.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.444+0000 7fc1ea7fc640 1 --2- 172.21.15.79:0/3693859231 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1ec09dcb0 0x7fc1ec070d50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009870 tx=0x7fc1e002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c830ea35660071cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:04.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.445+0000 7fc1e9ffb640 1 -- 172.21.15.79:0/3693859231 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0037070 con 0x7fc1ec09dcb0 2024-04-25T02:12:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.445+0000 7fc1e9ffb640 1 -- 172.21.15.79:0/3693859231 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e0032440 con 0x7fc1ec09dcb0 2024-04-25T02:12:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.445+0000 7fc1e9ffb640 1 -- 172.21.15.79:0/3693859231 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0032810 con 0x7fc1ec09dcb0 2024-04-25T02:12:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.445+0000 7fc1f1a2c640 1 -- 172.21.15.79:0/3693859231 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1ec09dcb0 msgr2=0x7fc1ec070d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.445+0000 7fc1f1a2c640 1 --2- 172.21.15.79:0/3693859231 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1ec09dcb0 0x7fc1ec070d50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009870 tx=0x7fc1e002a1c0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.445+0000 7fc1f1a2c640 1 -- 172.21.15.79:0/3693859231 shutdown_connections 2024-04-25T02:12:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.445+0000 7fc1f1a2c640 1 --2- 172.21.15.79:0/3693859231 >> v2:172.21.15.189:3300/0 conn(0x7fc1ec0cf380 0x7fc1ec071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.445+0000 7fc1f1a2c640 1 --2- 172.21.15.79:0/3693859231 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1ec09dcb0 0x7fc1ec070d50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.445+0000 7fc1f1a2c640 1 -- 172.21.15.79:0/3693859231 >> 172.21.15.79:0/3693859231 conn(0x7fc1ec0b1cd0 msgr2=0x7fc1ec0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.445+0000 7fc1f1a2c640 1 -- 172.21.15.79:0/3693859231 shutdown_connections 2024-04-25T02:12:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.445+0000 7fc1f1a2c640 1 -- 172.21.15.79:0/3693859231 wait complete. 2024-04-25T02:12:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.446+0000 7fc1f1a2c640 1 Processor -- start 2024-04-25T02:12:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.446+0000 7fc1f1a2c640 1 -- start start 2024-04-25T02:12:04.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.447+0000 7fc1f1a2c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1ec09dcb0 0x7fc1ec1492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.447+0000 7fc1f1a2c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1ec0cf380 0x7fc1ec155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.447+0000 7fc1f1a2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec15a810 0x7fc1ec0afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.447+0000 7fc1f1a2c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec0cc020 con 0x7fc1ec15a810 2024-04-25T02:12:04.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.447+0000 7fc1f1a2c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec0ceb40 con 0x7fc1ec09dcb0 2024-04-25T02:12:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.447+0000 7fc1f1a2c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc1ec0cc300 con 0x7fc1ec0cf380 2024-04-25T02:12:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.447+0000 7fc1eb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec15a810 0x7fc1ec0afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.447+0000 7fc1eb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec15a810 0x7fc1ec0afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50070/0 (socket says 172.21.15.79:50070) 2024-04-25T02:12:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.447+0000 7fc1eb7fe640 1 -- 172.21.15.79:0/201037575 learned_addr learned my addr 172.21.15.79:0/201037575 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.447+0000 7fc1eaffd640 1 --2- 172.21.15.79:0/201037575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1ec09dcb0 0x7fc1ec1492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.447+0000 7fc1ea7fc640 1 --2- 172.21.15.79:0/201037575 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1ec0cf380 0x7fc1ec155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.448+0000 7fc1eb7fe640 1 -- 172.21.15.79:0/201037575 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1ec0cf380 msgr2=0x7fc1ec155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.448+0000 7fc1eb7fe640 1 --2- 172.21.15.79:0/201037575 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1ec0cf380 0x7fc1ec155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.448+0000 7fc1eb7fe640 1 -- 172.21.15.79:0/201037575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1ec09dcb0 msgr2=0x7fc1ec1492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.448+0000 7fc1eb7fe640 1 --2- 172.21.15.79:0/201037575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1ec09dcb0 0x7fc1ec1492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.448+0000 7fc1eb7fe640 1 -- 172.21.15.79:0/201037575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec159fc0 con 0x7fc1ec15a810 2024-04-25T02:12:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.448+0000 7fc1eb7fe640 1 --2- 172.21.15.79:0/201037575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec15a810 0x7fc1ec0afd70 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400efc0 tx=0x7fc1e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.448+0000 7fc1d3fff640 1 -- 172.21.15.79:0/201037575 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4018020 con 0x7fc1ec15a810 2024-04-25T02:12:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.448+0000 7fc1d3fff640 1 -- 172.21.15.79:0/201037575 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e4014480 con 0x7fc1ec15a810 2024-04-25T02:12:04.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.448+0000 7fc1f1a2c640 1 -- 172.21.15.79:0/201037575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1ec159240 con 0x7fc1ec15a810 2024-04-25T02:12:04.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.448+0000 7fc1d3fff640 1 -- 172.21.15.79:0/201037575 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4014870 con 0x7fc1ec15a810 2024-04-25T02:12:04.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.448+0000 7fc1f1a2c640 1 -- 172.21.15.79:0/201037575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1ec1594e0 con 0x7fc1ec15a810 2024-04-25T02:12:04.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.449+0000 7fc1f1a2c640 1 -- 172.21.15.79:0/201037575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1ec0690a0 con 0x7fc1ec15a810 2024-04-25T02:12:04.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.449+0000 7fc1d3fff640 1 -- 172.21.15.79:0/201037575 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1e4005d10 con 0x7fc1ec15a810 2024-04-25T02:12:04.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.450+0000 7fc1d3fff640 1 --2- 172.21.15.79:0/201037575 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc1d806be30 0x7fc1d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.450+0000 7fc1d3fff640 1 -- 172.21.15.79:0/201037575 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7fc1e408b6d0 con 0x7fc1ec15a810 2024-04-25T02:12:04.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.450+0000 7fc1eaffd640 1 --2- 172.21.15.79:0/201037575 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc1d806be30 0x7fc1d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.450+0000 7fc1eaffd640 1 --2- 172.21.15.79:0/201037575 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc1d806be30 0x7fc1d806e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc000f60 tx=0x7fc1dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:04.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.454+0000 7fc1d3fff640 1 -- 172.21.15.79:0/201037575 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc1e4022070 con 0x7fc1ec15a810 2024-04-25T02:12:04.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.700+0000 7fc1f1a2c640 1 -- 172.21.15.79:0/201037575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc1ec0b2250 con 0x7fc1ec15a810 2024-04-25T02:12:04.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.704+0000 7fc1d3fff640 1 -- 172.21.15.79:0/201037575 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7fc1e4010040 con 0x7fc1ec15a810 2024-04-25T02:12:04.711 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-04-25T02:12:04.711 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g== 2024-04-25T02:12:04.711 INFO:teuthology.orchestra.run.smithi079.stdout: caps mds = "allow" 2024-04-25T02:12:04.711 INFO:teuthology.orchestra.run.smithi079.stdout: caps mon = "allow r" 2024-04-25T02:12:04.712 INFO:teuthology.orchestra.run.smithi079.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T02:12:04.712 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2024-04-25T02:12:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.706+0000 7fc1f1a2c640 1 -- 172.21.15.79:0/201037575 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc1d806be30 msgr2=0x7fc1d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.706+0000 7fc1f1a2c640 1 --2- 172.21.15.79:0/201037575 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc1d806be30 0x7fc1d806e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc000f60 tx=0x7fc1dc009040 comp rx=0 tx=0).stop 2024-04-25T02:12:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.706+0000 7fc1f1a2c640 1 -- 172.21.15.79:0/201037575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec15a810 msgr2=0x7fc1ec0afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.706+0000 7fc1f1a2c640 1 --2- 172.21.15.79:0/201037575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec15a810 0x7fc1ec0afd70 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400efc0 tx=0x7fc1e400c490 comp rx=0 tx=0).stop 2024-04-25T02:12:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.706+0000 7fc1f1a2c640 1 -- 172.21.15.79:0/201037575 shutdown_connections 2024-04-25T02:12:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.706+0000 7fc1f1a2c640 1 --2- 172.21.15.79:0/201037575 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc1d806be30 0x7fc1d806e2f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.706+0000 7fc1f1a2c640 1 --2- 172.21.15.79:0/201037575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec15a810 0x7fc1ec0afd70 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.706+0000 7fc1f1a2c640 1 --2- 172.21.15.79:0/201037575 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1ec0cf380 0x7fc1ec155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.706+0000 7fc1f1a2c640 1 --2- 172.21.15.79:0/201037575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1ec09dcb0 0x7fc1ec1492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.706+0000 7fc1f1a2c640 1 -- 172.21.15.79:0/201037575 >> 172.21.15.79:0/201037575 conn(0x7fc1ec0b1cd0 msgr2=0x7fc1ec0b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.706+0000 7fc1f1a2c640 1 -- 172.21.15.79:0/201037575 shutdown_connections 2024-04-25T02:12:04.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.706+0000 7fc1f1a2c640 1 -- 172.21.15.79:0/201037575 wait complete. 2024-04-25T02:12:04.724 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:12:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.813+0000 7fc7b65d5640 1 Processor -- start 2024-04-25T02:12:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.813+0000 7fc7b65d5640 1 -- start start 2024-04-25T02:12:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.814+0000 7fc7b65d5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7b0143bc0 0x7fc7b015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.814+0000 7fc7b65d5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc7b00b3d40 0x7fc7b006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.814+0000 7fc7b65d5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7b015fa40 con 0x7fc7b006df50 2024-04-25T02:12:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.814+0000 7fc7b65d5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc7b006e8f0 con 0x7fc7b0143bc0 2024-04-25T02:12:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.814+0000 7fc7b65d5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b0072cb0 con 0x7fc7b00b3d40 2024-04-25T02:12:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.814+0000 7fc7affff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7b0143bc0 0x7fc7b015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.814+0000 7fc7af7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc7b006df50 0x7fc7b00b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41756/0 (socket says 172.21.15.79:41756) 2024-04-25T02:12:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.814+0000 7fc7af7fe640 1 -- 172.21.15.79:0/2143448451 learned_addr learned my addr 172.21.15.79:0/2143448451 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.814+0000 7fc7affff640 1 -- 172.21.15.79:0/2143448451 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc7b00b3d40 msgr2=0x7fc7b006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.814+0000 7fc7affff640 1 --2- 172.21.15.79:0/2143448451 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc7b00b3d40 0x7fc7b006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.814+0000 7fc7affff640 1 -- 172.21.15.79:0/2143448451 >> v1:172.21.15.79:6789/0 conn(0x7fc7b006df50 legacy=0x7fc7b00b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.814+0000 7fc7aeffd640 1 -- 172.21.15.79:0/2143448451 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998216105 0 0) 0x7fc7a4001110 con 0x7fc7b006df50 2024-04-25T02:12:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.814+0000 7fc7affff640 1 -- 172.21.15.79:0/2143448451 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b0071e00 con 0x7fc7b0143bc0 2024-04-25T02:12:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.815+0000 7fc7affff640 1 --2- 172.21.15.79:0/2143448451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b0143bc0 0x7fc7b015f500 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00097a0 tx=0x7fc7a002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8bdcbb866273be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.815+0000 7fc7aeffd640 1 -- 172.21.15.79:0/2143448451 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0037070 con 0x7fc7b0143bc0 2024-04-25T02:12:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.815+0000 7fc7aeffd640 1 -- 172.21.15.79:0/2143448451 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a002ae50 con 0x7fc7b0143bc0 2024-04-25T02:12:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.815+0000 7fc7aeffd640 1 -- 172.21.15.79:0/2143448451 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0032660 con 0x7fc7b0143bc0 2024-04-25T02:12:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.816+0000 7fc7b65d5640 1 -- 172.21.15.79:0/2143448451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b0143bc0 msgr2=0x7fc7b015f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.816+0000 7fc7b65d5640 1 --2- 172.21.15.79:0/2143448451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b0143bc0 0x7fc7b015f500 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00097a0 tx=0x7fc7a002a100 comp rx=0 tx=0).stop 2024-04-25T02:12:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.816+0000 7fc7b65d5640 1 -- 172.21.15.79:0/2143448451 shutdown_connections 2024-04-25T02:12:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.816+0000 7fc7b65d5640 1 --2- 172.21.15.79:0/2143448451 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc7b00b3d40 0x7fc7b006e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.816+0000 7fc7b65d5640 1 --2- 172.21.15.79:0/2143448451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b0143bc0 0x7fc7b015f500 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.816+0000 7fc7b65d5640 1 -- 172.21.15.79:0/2143448451 >> 172.21.15.79:0/2143448451 conn(0x7fc7b00cfc80 msgr2=0x7fc7b00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.816+0000 7fc7b65d5640 1 -- 172.21.15.79:0/2143448451 shutdown_connections 2024-04-25T02:12:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.816+0000 7fc7b65d5640 1 -- 172.21.15.79:0/2143448451 wait complete. 2024-04-25T02:12:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.817+0000 7fc7b65d5640 1 Processor -- start 2024-04-25T02:12:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.817+0000 7fc7b65d5640 1 -- start start 2024-04-25T02:12:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7b65d5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7b006df50 0x7fc7b015d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7b65d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b00b3d40 0x7fc7b0070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7b65d5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc7b0143bc0 0x7fc7b0153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7b65d5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b0072660 con 0x7fc7b00b3d40 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7b65d5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b0072380 con 0x7fc7b006df50 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7b65d5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b0072940 con 0x7fc7b0143bc0 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7af7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b00b3d40 0x7fc7b0070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7af7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b00b3d40 0x7fc7b0070f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50078/0 (socket says 172.21.15.79:50078) 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7af7fe640 1 -- 172.21.15.79:0/2345524715 learned_addr learned my addr 172.21.15.79:0/2345524715 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7b4b72640 1 --2- 172.21.15.79:0/2345524715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc7b0143bc0 0x7fc7b0153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7affff640 1 --2- 172.21.15.79:0/2345524715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7b006df50 0x7fc7b015d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7af7fe640 1 -- 172.21.15.79:0/2345524715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc7b0143bc0 msgr2=0x7fc7b0153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7af7fe640 1 --2- 172.21.15.79:0/2345524715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc7b0143bc0 0x7fc7b0153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7af7fe640 1 -- 172.21.15.79:0/2345524715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7b006df50 msgr2=0x7fc7b015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7af7fe640 1 --2- 172.21.15.79:0/2345524715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7b006df50 0x7fc7b015d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7af7fe640 1 -- 172.21.15.79:0/2345524715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b0150bd0 con 0x7fc7b00b3d40 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7b4b72640 1 --2- 172.21.15.79:0/2345524715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc7b0143bc0 0x7fc7b0153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.818+0000 7fc7af7fe640 1 --2- 172.21.15.79:0/2345524715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b00b3d40 0x7fc7b0070f60 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400c460 tx=0x7fc7a400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.819+0000 7fc7acff9640 1 -- 172.21.15.79:0/2345524715 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4018070 con 0x7fc7b00b3d40 2024-04-25T02:12:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.819+0000 7fc7acff9640 1 -- 172.21.15.79:0/2345524715 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a4007500 con 0x7fc7b00b3d40 2024-04-25T02:12:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.819+0000 7fc7b65d5640 1 -- 172.21.15.79:0/2345524715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b014dcd0 con 0x7fc7b00b3d40 2024-04-25T02:12:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.819+0000 7fc7acff9640 1 -- 172.21.15.79:0/2345524715 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4004a20 con 0x7fc7b00b3d40 2024-04-25T02:12:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.819+0000 7fc7b65d5640 1 -- 172.21.15.79:0/2345524715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b014e290 con 0x7fc7b00b3d40 2024-04-25T02:12:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.819+0000 7fc7b65d5640 1 -- 172.21.15.79:0/2345524715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7b00690a0 con 0x7fc7b00b3d40 2024-04-25T02:12:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.820+0000 7fc7acff9640 1 -- 172.21.15.79:0/2345524715 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7a401b070 con 0x7fc7b00b3d40 2024-04-25T02:12:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.820+0000 7fc7acff9640 1 --2- 172.21.15.79:0/2345524715 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc79c06be30 0x7fc79c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.821+0000 7fc7affff640 1 --2- 172.21.15.79:0/2345524715 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc79c06be30 0x7fc79c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.821+0000 7fc7acff9640 1 -- 172.21.15.79:0/2345524715 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7fc7a408a0b0 con 0x7fc7b00b3d40 2024-04-25T02:12:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.821+0000 7fc7affff640 1 --2- 172.21.15.79:0/2345524715 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc79c06be30 0x7fc79c06e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0034000 tx=0x7fc7a002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:04.825+0000 7fc7acff9640 1 -- 172.21.15.79:0/2345524715 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc7b015fa40 con 0x7fc7b00b3d40 2024-04-25T02:12:05.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.031+0000 7fc7b65d5640 1 -- 172.21.15.79:0/2345524715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7b00b4200 con 0x7fc7b00b3d40 2024-04-25T02:12:05.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.032+0000 7fc7acff9640 1 -- 172.21.15.79:0/2345524715 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5180 (secure 0 0 0) 0x7fc7a4058a60 con 0x7fc7b00b3d40 2024-04-25T02:12:05.039 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:12:05.039 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":32,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/596307304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":596307304},{"type":"v1","addr":"172.21.15.189:6834","nonce":596307304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2550610051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550610051},{"type":"v1","addr":"172.21.15.79:6836","nonce":2550610051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6696,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/782013262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":782013262},{"type":"v1","addr":"172.21.15.79:6837","nonce":782013262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:11:55.951694+0000","modified":"2024-04-25T02:11:57.954401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6708":{"gid":6708,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6835/469348969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":469348969},{"type":"v1","addr":"172.21.15.189:6835","nonce":469348969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6708,"qdb_cluster":[6708]},"id":5}]} 2024-04-25T02:12:05.039 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 32 2024-04-25T02:12:05.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.034+0000 7fc7b65d5640 1 -- 172.21.15.79:0/2345524715 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc79c06be30 msgr2=0x7fc79c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.034+0000 7fc7b65d5640 1 --2- 172.21.15.79:0/2345524715 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc79c06be30 0x7fc79c06e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0034000 tx=0x7fc7a002e000 comp rx=0 tx=0).stop 2024-04-25T02:12:05.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.034+0000 7fc7b65d5640 1 -- 172.21.15.79:0/2345524715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b00b3d40 msgr2=0x7fc7b0070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.034+0000 7fc7b65d5640 1 --2- 172.21.15.79:0/2345524715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b00b3d40 0x7fc7b0070f60 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400c460 tx=0x7fc7a400c920 comp rx=0 tx=0).stop 2024-04-25T02:12:05.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.034+0000 7fc7b65d5640 1 -- 172.21.15.79:0/2345524715 shutdown_connections 2024-04-25T02:12:05.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.034+0000 7fc7b65d5640 1 --2- 172.21.15.79:0/2345524715 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc79c06be30 0x7fc79c06e2f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.034+0000 7fc7b65d5640 1 --2- 172.21.15.79:0/2345524715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc7b0143bc0 0x7fc7b0153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.034+0000 7fc7b65d5640 1 --2- 172.21.15.79:0/2345524715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b00b3d40 0x7fc7b0070f60 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.034+0000 7fc7b65d5640 1 --2- 172.21.15.79:0/2345524715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7b006df50 0x7fc7b015d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.034+0000 7fc7b65d5640 1 -- 172.21.15.79:0/2345524715 >> 172.21.15.79:0/2345524715 conn(0x7fc7b00cfc80 msgr2=0x7fc7b015f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:05.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.034+0000 7fc7b65d5640 1 -- 172.21.15.79:0/2345524715 shutdown_connections 2024-04-25T02:12:05.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.034+0000 7fc7b65d5640 1 -- 172.21.15.79:0/2345524715 wait complete. 2024-04-25T02:12:05.455 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:11:55.951694+0000', 'modified': '2024-04-25T02:11:57.954401+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6708}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6708': {'gid': 6708, 'name': 'd', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.189:6835/469348969', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6833', 'nonce': 469348969}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 469348969}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6708, 'qdb_cluster': [6708]} 2024-04-25T02:12:05.455 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:12:05.455 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T02:12:05.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.546+0000 7f1f61cd4640 1 Processor -- start 2024-04-25T02:12:05.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.546+0000 7f1f61cd4640 1 -- start start 2024-04-25T02:12:05.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.546+0000 7f1f61cd4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5c15a720 0x7f1f5c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.546+0000 7f1f61cd4640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1f5c0d07a0 0x7f1f5c0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.546+0000 7f1f61cd4640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f5c15f1c0 con 0x7f1f5c0b47e0 2024-04-25T02:12:05.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.546+0000 7f1f61cd4640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f1f5c0b2e60 con 0x7f1f5c0d07a0 2024-04-25T02:12:05.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.546+0000 7f1f61cd4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5c0b3140 con 0x7f1f5c15a720 2024-04-25T02:12:05.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.547+0000 7f1f5affd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1f5c0d07a0 0x7f1f5c0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.547+0000 7f1f5b7fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5c15a720 0x7f1f5c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.547+0000 7f1f5bfff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f1f5c0b47e0 0x7f1f5c15ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:34258/0 (socket says 172.21.15.79:34258) 2024-04-25T02:12:05.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.547+0000 7f1f5affd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1f5c0d07a0 0x7f1f5c0b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:56582/0 (socket says 172.21.15.79:56582) 2024-04-25T02:12:05.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.547+0000 7f1f5bfff640 1 -- 172.21.15.79:0/2732881473 learned_addr learned my addr 172.21.15.79:0/2732881473 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:05.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.547+0000 7f1f5b7fe640 1 -- 172.21.15.79:0/2732881473 >> v2:172.21.15.189:3300/0 conn(0x7f1f5c0d07a0 msgr2=0x7f1f5c0b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:05.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.547+0000 7f1f5b7fe640 1 --2- 172.21.15.79:0/2732881473 >> v2:172.21.15.189:3300/0 conn(0x7f1f5c0d07a0 0x7f1f5c0b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.547+0000 7f1f5b7fe640 1 -- 172.21.15.79:0/2732881473 >> v1:172.21.15.189:6789/0 conn(0x7f1f5c0b47e0 legacy=0x7f1f5c15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.547+0000 7f1f5b7fe640 1 -- 172.21.15.79:0/2732881473 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c0b3420 con 0x7f1f5c15a720 2024-04-25T02:12:05.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.548+0000 7f1f5b7fe640 1 --2- 172.21.15.79:0/2732881473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5c15a720 0x7f1f5c15ec80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1f500097a0 tx=0x7f1f5002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80eb176190edf677 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:05.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.548+0000 7f1f5a7fc640 1 -- 172.21.15.79:0/2732881473 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50037070 con 0x7f1f5c15a720 2024-04-25T02:12:05.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.548+0000 7f1f5a7fc640 1 -- 172.21.15.79:0/2732881473 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5002ae50 con 0x7f1f5c15a720 2024-04-25T02:12:05.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.548+0000 7f1f5a7fc640 1 -- 172.21.15.79:0/2732881473 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50032660 con 0x7f1f5c15a720 2024-04-25T02:12:05.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.549+0000 7f1f61cd4640 1 -- 172.21.15.79:0/2732881473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5c15a720 msgr2=0x7f1f5c15ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.549+0000 7f1f61cd4640 1 --2- 172.21.15.79:0/2732881473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5c15a720 0x7f1f5c15ec80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1f500097a0 tx=0x7f1f5002a100 comp rx=0 tx=0).stop 2024-04-25T02:12:05.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.549+0000 7f1f61cd4640 1 -- 172.21.15.79:0/2732881473 shutdown_connections 2024-04-25T02:12:05.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.549+0000 7f1f61cd4640 1 --2- 172.21.15.79:0/2732881473 >> v2:172.21.15.189:3300/0 conn(0x7f1f5c0d07a0 0x7f1f5c0b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.549+0000 7f1f61cd4640 1 --2- 172.21.15.79:0/2732881473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5c15a720 0x7f1f5c15ec80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.549+0000 7f1f61cd4640 1 -- 172.21.15.79:0/2732881473 >> 172.21.15.79:0/2732881473 conn(0x7f1f5c0cfc80 msgr2=0x7f1f5c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:05.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.549+0000 7f1f61cd4640 1 -- 172.21.15.79:0/2732881473 shutdown_connections 2024-04-25T02:12:05.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.549+0000 7f1f61cd4640 1 -- 172.21.15.79:0/2732881473 wait complete. 2024-04-25T02:12:05.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.550+0000 7f1f61cd4640 1 Processor -- start 2024-04-25T02:12:05.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.550+0000 7f1f61cd4640 1 -- start start 2024-04-25T02:12:05.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f61cd4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f5c0b47e0 0x7f1f5c1547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f61cd4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5c0d07a0 0x7f1f5c1585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f61cd4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5c15a720 0x7f1f5c070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f61cd4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c071d00 con 0x7f1f5c0d07a0 2024-04-25T02:12:05.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f61cd4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c0b39e0 con 0x7f1f5c0b47e0 2024-04-25T02:12:05.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f61cd4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5c071e80 con 0x7f1f5c15a720 2024-04-25T02:12:05.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f5affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5c0d07a0 0x7f1f5c1585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f5affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5c0d07a0 0x7f1f5c1585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50092/0 (socket says 172.21.15.79:50092) 2024-04-25T02:12:05.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f5affd640 1 -- 172.21.15.79:0/2033254741 learned_addr learned my addr 172.21.15.79:0/2033254741 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:05.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f5b7fe640 1 --2- 172.21.15.79:0/2033254741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f5c0b47e0 0x7f1f5c1547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f5bfff640 1 --2- 172.21.15.79:0/2033254741 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5c15a720 0x7f1f5c070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f5affd640 1 -- 172.21.15.79:0/2033254741 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5c15a720 msgr2=0x7f1f5c070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f5affd640 1 --2- 172.21.15.79:0/2033254741 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5c15a720 0x7f1f5c070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f5affd640 1 -- 172.21.15.79:0/2033254741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f5c0b47e0 msgr2=0x7f1f5c1547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f5affd640 1 --2- 172.21.15.79:0/2033254741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f5c0b47e0 0x7f1f5c1547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f5affd640 1 -- 172.21.15.79:0/2033254741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c159330 con 0x7f1f5c0d07a0 2024-04-25T02:12:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f5affd640 1 --2- 172.21.15.79:0/2033254741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5c0d07a0 0x7f1f5c1585c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00e9b0 tx=0x7f1f4c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f43fff640 1 -- 172.21.15.79:0/2033254741 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c017070 con 0x7f1f5c0d07a0 2024-04-25T02:12:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f43fff640 1 -- 172.21.15.79:0/2033254741 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4c00c9a0 con 0x7f1f5c0d07a0 2024-04-25T02:12:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f61cd4640 1 -- 172.21.15.79:0/2033254741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5c159610 con 0x7f1f5c0d07a0 2024-04-25T02:12:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.551+0000 7f1f43fff640 1 -- 172.21.15.79:0/2033254741 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00cd90 con 0x7f1f5c0d07a0 2024-04-25T02:12:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.552+0000 7f1f61cd4640 1 -- 172.21.15.79:0/2033254741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5c159bd0 con 0x7f1f5c0d07a0 2024-04-25T02:12:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.553+0000 7f1f43fff640 1 -- 172.21.15.79:0/2033254741 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f4c01a070 con 0x7f1f5c0d07a0 2024-04-25T02:12:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.553+0000 7f1f43fff640 1 --2- 172.21.15.79:0/2033254741 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1f4806be30 0x7f1f4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.553+0000 7f1f43fff640 1 -- 172.21.15.79:0/2033254741 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f1f4c08b220 con 0x7f1f5c0d07a0 2024-04-25T02:12:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.553+0000 7f1f5b7fe640 1 --2- 172.21.15.79:0/2033254741 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1f4806be30 0x7f1f4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.554+0000 7f1f5b7fe640 1 --2- 172.21.15.79:0/2033254741 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1f4806be30 0x7f1f4806e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1f50034000 tx=0x7f1f5002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.554+0000 7f1f649e3740 1 Processor -- start 2024-04-25T02:12:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.554+0000 7f1f649e3740 1 -- start start 2024-04-25T02:12:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.555+0000 7f1f649e3740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70f9e50 0x55c3b70fdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.555+0000 7f1f649e3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70d1b60 0x55c3b70fa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.555+0000 7f1f649e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70fa770 0x55c3b70fd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.555+0000 7f1f649e3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c3b7035f00 con 0x55c3b70d1b60 2024-04-25T02:12:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.555+0000 7f1f649e3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c3b6fde750 con 0x55c3b70fa770 2024-04-25T02:12:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.555+0000 7f1f649e3740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55c3b7031ec0 con 0x55c3b70f9e50 2024-04-25T02:12:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.555+0000 7f1f5affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70d1b60 0x55c3b70fa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.555+0000 7f1f5affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70d1b60 0x55c3b70fa230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50108/0 (socket says 172.21.15.79:50108) 2024-04-25T02:12:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.555+0000 7f1f5affd640 1 -- 172.21.15.79:0/2175130479 learned_addr learned my addr 172.21.15.79:0/2175130479 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.555+0000 7f1f5affd640 1 -- 172.21.15.79:0/2175130479 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70f9e50 msgr2=0x55c3b70fdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.555+0000 7f1f5affd640 1 --2- 172.21.15.79:0/2175130479 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70f9e50 0x55c3b70fdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.555+0000 7f1f5affd640 1 -- 172.21.15.79:0/2175130479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70fa770 msgr2=0x55c3b70fd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.555+0000 7f1f5affd640 1 --2- 172.21.15.79:0/2175130479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70fa770 0x55c3b70fd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.555+0000 7f1f5affd640 1 -- 172.21.15.79:0/2175130479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b6d4a2d0 con 0x55c3b70d1b60 2024-04-25T02:12:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.555+0000 7f1f5affd640 1 --2- 172.21.15.79:0/2175130479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70d1b60 0x55c3b70fa230 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c061b00 tx=0x7f1f4c058f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ba5f79a4bc794a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.556+0000 7f1f417fa640 1 -- 172.21.15.79:0/2175130479 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c021070 con 0x55c3b70d1b60 2024-04-25T02:12:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.556+0000 7f1f417fa640 1 -- 172.21.15.79:0/2175130479 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4c062030 con 0x55c3b70d1b60 2024-04-25T02:12:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.556+0000 7f1f417fa640 1 -- 172.21.15.79:0/2175130479 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c055b70 con 0x55c3b70d1b60 2024-04-25T02:12:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.556+0000 7f1f649e3740 1 -- 172.21.15.79:0/2175130479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70d1b60 msgr2=0x55c3b70fa230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.556+0000 7f1f649e3740 1 --2- 172.21.15.79:0/2175130479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70d1b60 0x55c3b70fa230 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c061b00 tx=0x7f1f4c058f90 comp rx=0 tx=0).stop 2024-04-25T02:12:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.556+0000 7f1f649e3740 1 -- 172.21.15.79:0/2175130479 shutdown_connections 2024-04-25T02:12:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.556+0000 7f1f649e3740 1 --2- 172.21.15.79:0/2175130479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70fa770 0x55c3b70fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.556+0000 7f1f649e3740 1 --2- 172.21.15.79:0/2175130479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70d1b60 0x55c3b70fa230 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.556+0000 7f1f649e3740 1 --2- 172.21.15.79:0/2175130479 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70f9e50 0x55c3b70fdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.556+0000 7f1f649e3740 1 -- 172.21.15.79:0/2175130479 >> 172.21.15.79:0/2175130479 conn(0x55c3b70cf760 msgr2=0x55c3b7118000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.556+0000 7f1f649e3740 1 -- 172.21.15.79:0/2175130479 shutdown_connections 2024-04-25T02:12:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.556+0000 7f1f649e3740 1 -- 172.21.15.79:0/2175130479 wait complete. 2024-04-25T02:12:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.557+0000 7f1f649e3740 1 -- start start 2024-04-25T02:12:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.557+0000 7f1f649e3740 1 Processor -- start 2024-04-25T02:12:05.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f649e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 0x55c3b70edb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f649e3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70fa770 0x55c3b70f8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f649e3740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70ee760 0x55c3b70f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f649e3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c3b70cdab0 con 0x55c3b70fa770 2024-04-25T02:12:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f649e3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c3b6ff1cf0 con 0x55c3b70f9e50 2024-04-25T02:12:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f649e3740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55c3b70cd4f0 con 0x55c3b70ee760 2024-04-25T02:12:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f649e3740 10 client.0 _ll_register_callbacks cb 0x55c3b6ff16e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f5affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70fa770 0x55c3b70f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f5affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70fa770 0x55c3b70f8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50120/0 (socket says 172.21.15.79:50120) 2024-04-25T02:12:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f5affd640 1 -- 172.21.15.79:0/1862727377 learned_addr learned my addr 172.21.15.79:0/1862727377 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f5b7fe640 1 --2- 172.21.15.79:0/1862727377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 0x55c3b70edb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f5bfff640 1 --2- 172.21.15.79:0/1862727377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70ee760 0x55c3b70f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f5affd640 1 -- 172.21.15.79:0/1862727377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70ee760 msgr2=0x55c3b70f8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f5affd640 1 --2- 172.21.15.79:0/1862727377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70ee760 0x55c3b70f8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f5affd640 1 -- 172.21.15.79:0/1862727377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 msgr2=0x55c3b70edb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f5affd640 1 --2- 172.21.15.79:0/1862727377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 0x55c3b70edb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f5affd640 1 -- 172.21.15.79:0/1862727377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b6e146b0 con 0x55c3b70fa770 2024-04-25T02:12:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f5bfff640 1 --2- 172.21.15.79:0/1862727377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70ee760 0x55c3b70f8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f5affd640 1 --2- 172.21.15.79:0/1862727377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70fa770 0x55c3b70f8650 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0097a0 tx=0x7f1f4c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac0917d661efc86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f3a7fc640 1 -- 172.21.15.79:0/1862727377 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c089060 con 0x55c3b70fa770 2024-04-25T02:12:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f3a7fc640 1 -- 172.21.15.79:0/1862727377 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f1f4c089200 con 0x55c3b70fa770 2024-04-25T02:12:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.558+0000 7f1f649e3740 1 -- 172.21.15.79:0/1862727377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f4c062030 con 0x55c3b70fa770 2024-04-25T02:12:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.559+0000 7f1f3a7fc640 1 -- 172.21.15.79:0/1862727377 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1f4c07e050 con 0x55c3b70fa770 2024-04-25T02:12:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.559+0000 7f1f649e3740 10 client.6855 fetch_fsmap learned FSMap version 32 2024-04-25T02:12:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.559+0000 7f1f649e3740 1 -- 172.21.15.79:0/1862727377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) -- 0x55c3b70f7e50 con 0x55c3b70fa770 2024-04-25T02:12:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.559+0000 7f1f3a7fc640 1 -- 172.21.15.79:0/1862727377 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4c062030 con 0x55c3b70fa770 2024-04-25T02:12:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.559+0000 7f1f3a7fc640 1 -- 172.21.15.79:0/1862727377 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) ==== 3494+0+0 (secure 0 0 0) 0x7f1f4c081020 con 0x55c3b70fa770 2024-04-25T02:12:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.559+0000 7f1f649e3740 10 client.6855 fetch_fsmap finished waiting for FSMap version 32 2024-04-25T02:12:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.559+0000 7f1f649e3740 10 client.6855 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T02:12:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.559+0000 7f1f649e3740 20 client.6855 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.559+0000 7f1f649e3740 1 --2- 172.21.15.79:0/1862727377 >> [v2:172.21.15.189:6833/469348969,v1:172.21.15.189:6835/469348969] conn(0x55c3b7138210 0x55c3b713a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.559+0000 7f1f649e3740 4 client.6855 mds_command: new command op to 6708 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.559+0000 7f1f649e3740 1 -- 172.21.15.79:0/1862727377 --> [v2:172.21.15.189:6833/469348969,v1:172.21.15.189:6835/469348969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3b7043440 con 0x55c3b7138210 2024-04-25T02:12:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.559+0000 7f1f5b7fe640 1 --2- 172.21.15.79:0/1862727377 >> [v2:172.21.15.189:6833/469348969,v1:172.21.15.189:6835/469348969] conn(0x55c3b7138210 0x55c3b713a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.560+0000 7f1f3a7fc640 10 client.6855 ms_handle_connect on v2:172.21.15.189:6833/469348969 2024-04-25T02:12:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.560+0000 7f1f5b7fe640 1 --2- 172.21.15.79:0/1862727377 >> [v2:172.21.15.189:6833/469348969,v1:172.21.15.189:6835/469348969] conn(0x55c3b7138210 0x55c3b713a600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1448c0ab17c8d25 server_cookie=1aaa76ecf0220483 in_seq=0 out_seq=0 2024-04-25T02:12:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.560+0000 7f1f3a7fc640 1 -- 172.21.15.79:0/1862727377 <== mds.0 v2:172.21.15.189:6833/469348969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c3b7043440 con 0x55c3b7138210 2024-04-25T02:12:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.560+0000 7f1f3a7fc640 10 client.6855 handle_command_reply: tid=0 2024-04-25T02:12:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.560+0000 7f1f649e3740 1 client.6855 shutdown 2024-04-25T02:12:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.561+0000 7f1f649e3740 1 -- 172.21.15.79:0/1862727377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70fa770 msgr2=0x55c3b70f8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.561+0000 7f1f649e3740 1 --2- 172.21.15.79:0/1862727377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70fa770 0x55c3b70f8650 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0097a0 tx=0x7f1f4c000bc0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.561+0000 7f1f649e3740 1 -- 172.21.15.79:0/1862727377 shutdown_connections 2024-04-25T02:12:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.561+0000 7f1f649e3740 1 --2- 172.21.15.79:0/1862727377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70ee760 0x55c3b70f8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.561+0000 7f1f649e3740 1 --2- 172.21.15.79:0/1862727377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70fa770 0x55c3b70f8650 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.561+0000 7f1f649e3740 1 --2- 172.21.15.79:0/1862727377 >> [v2:172.21.15.189:6833/469348969,v1:172.21.15.189:6835/469348969] conn(0x55c3b7138210 0x55c3b713a600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.561+0000 7f1f649e3740 1 --2- 172.21.15.79:0/1862727377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 0x55c3b70edb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.561+0000 7f1f649e3740 1 -- 172.21.15.79:0/1862727377 >> 172.21.15.79:0/1862727377 conn(0x55c3b70d1b60 msgr2=0x55c3b71188b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:05.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.561+0000 7f1f3a7fc640 0 client.6855 ms_handle_reset on v2:172.21.15.189:6833/469348969 2024-04-25T02:12:05.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.561+0000 7f1f649e3740 1 -- 172.21.15.79:0/1862727377 shutdown_connections 2024-04-25T02:12:05.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.561+0000 7f1f649e3740 1 -- 172.21.15.79:0/1862727377 wait complete. 2024-04-25T02:12:05.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.561+0000 7f1f649e3740 20 client.6855 trim_cache size 0 max 16384 2024-04-25T02:12:05.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.579+0000 7f1f649e3740 1 Processor -- start 2024-04-25T02:12:05.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.579+0000 7f1f649e3740 1 -- start start 2024-04-25T02:12:05.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f649e3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70ee760 0x55c3b70f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f649e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 0x55c3b70d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f649e3740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70fa770 0x55c3b70d3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f649e3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c157750 con 0x55c3b70ee760 2024-04-25T02:12:05.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f649e3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c0aa630 con 0x55c3b70f9e50 2024-04-25T02:12:05.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f649e3740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5c0aac80 con 0x55c3b70fa770 2024-04-25T02:12:05.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f5b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70ee760 0x55c3b70f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f5b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70ee760 0x55c3b70f77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50124/0 (socket says 172.21.15.79:50124) 2024-04-25T02:12:05.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f5b7fe640 1 -- 172.21.15.79:0/1513541492 learned_addr learned my addr 172.21.15.79:0/1513541492 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:05.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f5bfff640 1 --2- 172.21.15.79:0/1513541492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70fa770 0x55c3b70d3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f5affd640 1 --2- 172.21.15.79:0/1513541492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 0x55c3b70d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f5b7fe640 1 -- 172.21.15.79:0/1513541492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70fa770 msgr2=0x55c3b70d3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:05.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f5b7fe640 1 --2- 172.21.15.79:0/1513541492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70fa770 0x55c3b70d3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f5b7fe640 1 -- 172.21.15.79:0/1513541492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 msgr2=0x55c3b70d2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:05.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f5b7fe640 1 --2- 172.21.15.79:0/1513541492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 0x55c3b70d2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f5b7fe640 1 -- 172.21.15.79:0/1513541492 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b711c450 con 0x55c3b70ee760 2024-04-25T02:12:05.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f5affd640 1 --2- 172.21.15.79:0/1513541492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 0x55c3b70d2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:05.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f5b7fe640 1 --2- 172.21.15.79:0/1513541492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70ee760 0x55c3b70f77d0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1f50035040 tx=0x7f1f50008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7865cdeae845a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:05.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f40ff9640 1 -- 172.21.15.79:0/1513541492 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50037040 con 0x55c3b70ee760 2024-04-25T02:12:05.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f40ff9640 1 -- 172.21.15.79:0/1513541492 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f50057070 con 0x55c3b70ee760 2024-04-25T02:12:05.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.580+0000 7f1f40ff9640 1 -- 172.21.15.79:0/1513541492 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50052350 con 0x55c3b70ee760 2024-04-25T02:12:05.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.581+0000 7f1f649e3740 1 -- 172.21.15.79:0/1513541492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70ee760 msgr2=0x55c3b70f77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.581+0000 7f1f649e3740 1 --2- 172.21.15.79:0/1513541492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70ee760 0x55c3b70f77d0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1f50035040 tx=0x7f1f50008030 comp rx=0 tx=0).stop 2024-04-25T02:12:05.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.581+0000 7f1f649e3740 1 -- 172.21.15.79:0/1513541492 shutdown_connections 2024-04-25T02:12:05.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.581+0000 7f1f649e3740 1 --2- 172.21.15.79:0/1513541492 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70fa770 0x55c3b70d3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.581+0000 7f1f649e3740 1 --2- 172.21.15.79:0/1513541492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 0x55c3b70d2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.581+0000 7f1f649e3740 1 --2- 172.21.15.79:0/1513541492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70ee760 0x55c3b70f77d0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.581+0000 7f1f649e3740 1 -- 172.21.15.79:0/1513541492 >> 172.21.15.79:0/1513541492 conn(0x55c3b70d1b60 msgr2=0x55c3b70fac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:05.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.581+0000 7f1f649e3740 1 -- 172.21.15.79:0/1513541492 shutdown_connections 2024-04-25T02:12:05.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.581+0000 7f1f649e3740 1 -- 172.21.15.79:0/1513541492 wait complete. 2024-04-25T02:12:05.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.582+0000 7f1f649e3740 1 -- start start 2024-04-25T02:12:05.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.582+0000 7f1f649e3740 1 Processor -- start 2024-04-25T02:12:05.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.582+0000 7f1f649e3740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70ee760 0x55c3b70d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.582+0000 7f1f649e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 0x55c3b70d3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.582+0000 7f1f649e3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70fa770 0x55c3b70fac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.582+0000 7f1f649e3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c3b70cdab0 con 0x55c3b70fa770 2024-04-25T02:12:05.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.582+0000 7f1f649e3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c3b70cd4f0 con 0x55c3b70f9e50 2024-04-25T02:12:05.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.582+0000 7f1f649e3740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55c3b6ff1cf0 con 0x55c3b70ee760 2024-04-25T02:12:05.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.582+0000 7f1f649e3740 10 client.0 _ll_register_callbacks cb 0x7f1f4c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:05.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.582+0000 7f1f5bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70fa770 0x55c3b70fac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f5bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70fa770 0x55c3b70fac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50126/0 (socket says 172.21.15.79:50126) 2024-04-25T02:12:05.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f5bfff640 1 -- 172.21.15.79:0/444530541 learned_addr learned my addr 172.21.15.79:0/444530541 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:05.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f5b7fe640 1 --2- 172.21.15.79:0/444530541 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70ee760 0x55c3b70d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f5affd640 1 --2- 172.21.15.79:0/444530541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 0x55c3b70d3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f5bfff640 1 -- 172.21.15.79:0/444530541 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70ee760 msgr2=0x55c3b70d2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:05.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f5bfff640 1 --2- 172.21.15.79:0/444530541 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70ee760 0x55c3b70d2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f5bfff640 1 -- 172.21.15.79:0/444530541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 msgr2=0x55c3b70d3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:05.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f5bfff640 1 --2- 172.21.15.79:0/444530541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 0x55c3b70d3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f5bfff640 1 -- 172.21.15.79:0/444530541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b713a600 con 0x55c3b70fa770 2024-04-25T02:12:05.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f5bfff640 1 --2- 172.21.15.79:0/444530541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70fa770 0x55c3b70fac50 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1f54005c00 tx=0x7f1f540077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c773df0af2a47742 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:05.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:05.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f3a7fc640 1 -- 172.21.15.79:0/444530541 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54004b60 con 0x55c3b70fa770 2024-04-25T02:12:05.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f3a7fc640 1 -- 172.21.15.79:0/444530541 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f1f54004d00 con 0x55c3b70fa770 2024-04-25T02:12:05.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f649e3740 1 -- 172.21.15.79:0/444530541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f50057070 con 0x55c3b70fa770 2024-04-25T02:12:05.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f3a7fc640 1 -- 172.21.15.79:0/444530541 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1f54024050 con 0x55c3b70fa770 2024-04-25T02:12:05.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f649e3740 10 client.6861 fetch_fsmap learned FSMap version 32 2024-04-25T02:12:05.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f649e3740 1 -- 172.21.15.79:0/444530541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) -- 0x55c3b711b830 con 0x55c3b70fa770 2024-04-25T02:12:05.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f3a7fc640 1 -- 172.21.15.79:0/444530541 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f50057070 con 0x55c3b70fa770 2024-04-25T02:12:05.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f3a7fc640 1 -- 172.21.15.79:0/444530541 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) ==== 3494+0+0 (secure 0 0 0) 0x7f1f54027020 con 0x55c3b70fa770 2024-04-25T02:12:05.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f649e3740 10 client.6861 fetch_fsmap finished waiting for FSMap version 32 2024-04-25T02:12:05.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f649e3740 10 client.6861 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T02:12:05.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f649e3740 20 client.6861 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:05.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f649e3740 1 --2- 172.21.15.79:0/444530541 >> [v2:172.21.15.189:6833/469348969,v1:172.21.15.189:6835/469348969] conn(0x55c3b70fb610 0x55c3b70f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f649e3740 4 client.6861 mds_command: new command op to 6708 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:12:05.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.583+0000 7f1f649e3740 1 -- 172.21.15.79:0/444530541 --> [v2:172.21.15.189:6833/469348969,v1:172.21.15.189:6835/469348969] -- command(tid 0: {"prefix": "status"}) -- 0x55c3b70f96d0 con 0x55c3b70fb610 2024-04-25T02:12:05.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f5b7fe640 1 --2- 172.21.15.79:0/444530541 >> [v2:172.21.15.189:6833/469348969,v1:172.21.15.189:6835/469348969] conn(0x55c3b70fb610 0x55c3b70f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f3a7fc640 10 client.6861 ms_handle_connect on v2:172.21.15.189:6833/469348969 2024-04-25T02:12:05.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f5b7fe640 1 --2- 172.21.15.79:0/444530541 >> [v2:172.21.15.189:6833/469348969,v1:172.21.15.189:6835/469348969] conn(0x55c3b70fb610 0x55c3b70f4cb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45fc57345b93261 server_cookie=4d3e95c2dabb6933 in_seq=0 out_seq=0 2024-04-25T02:12:05.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f3a7fc640 1 -- 172.21.15.79:0/444530541 <== mds.0 v2:172.21.15.189:6833/469348969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55c3b70f96d0 con 0x55c3b70fb610 2024-04-25T02:12:05.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f3a7fc640 10 client.6861 handle_command_reply: tid=0 2024-04-25T02:12:05.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f649e3740 1 client.6861 shutdown 2024-04-25T02:12:05.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f649e3740 1 -- 172.21.15.79:0/444530541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70fa770 msgr2=0x55c3b70fac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f649e3740 1 --2- 172.21.15.79:0/444530541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70fa770 0x55c3b70fac50 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1f54005c00 tx=0x7f1f540077f0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f649e3740 1 -- 172.21.15.79:0/444530541 shutdown_connections 2024-04-25T02:12:05.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f649e3740 1 --2- 172.21.15.79:0/444530541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3b70fa770 0x55c3b70fac50 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f649e3740 1 --2- 172.21.15.79:0/444530541 >> [v2:172.21.15.189:6833/469348969,v1:172.21.15.189:6835/469348969] conn(0x55c3b70fb610 0x55c3b70f4cb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f649e3740 1 --2- 172.21.15.79:0/444530541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3b70f9e50 0x55c3b70d3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f649e3740 1 --2- 172.21.15.79:0/444530541 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3b70ee760 0x55c3b70d2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f3a7fc640 0 client.6861 ms_handle_reset on v2:172.21.15.189:6833/469348969 2024-04-25T02:12:05.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f649e3740 1 -- 172.21.15.79:0/444530541 >> 172.21.15.79:0/444530541 conn(0x55c3b70d1b60 msgr2=0x55c3b70f0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:05.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.584+0000 7f1f649e3740 1 -- 172.21.15.79:0/444530541 shutdown_connections 2024-04-25T02:12:05.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.585+0000 7f1f649e3740 1 -- 172.21.15.79:0/444530541 wait complete. 2024-04-25T02:12:05.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.585+0000 7f1f649e3740 20 client.6861 trim_cache size 0 max 16384 2024-04-25T02:12:05.598 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:12:05.598 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "696648c4-3e52-400b-a780-2e8863c56c42", 2024-04-25T02:12:05.598 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-04-25T02:12:05.598 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6708, 2024-04-25T02:12:05.598 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-04-25T02:12:05.598 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-04-25T02:12:05.599 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-04-25T02:12:05.599 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 8.9742459350000008, 2024-04-25T02:12:05.599 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 32, 2024-04-25T02:12:05.599 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 71, 2024-04-25T02:12:05.599 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 71, 2024-04-25T02:12:05.599 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 14.043442056 2024-04-25T02:12:05.599 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:12:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.585+0000 7f1f61cd4640 1 -- 172.21.15.79:0/2033254741 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1f4806be30 msgr2=0x7f1f4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.585+0000 7f1f61cd4640 1 --2- 172.21.15.79:0/2033254741 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1f4806be30 0x7f1f4806e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1f50034000 tx=0x7f1f5002e000 comp rx=0 tx=0).stop 2024-04-25T02:12:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.585+0000 7f1f61cd4640 1 -- 172.21.15.79:0/2033254741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5c0d07a0 msgr2=0x7f1f5c1585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.585+0000 7f1f61cd4640 1 --2- 172.21.15.79:0/2033254741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5c0d07a0 0x7f1f5c1585c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00e9b0 tx=0x7f1f4c00ee70 comp rx=0 tx=0).stop 2024-04-25T02:12:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.585+0000 7f1f61cd4640 1 -- 172.21.15.79:0/2033254741 shutdown_connections 2024-04-25T02:12:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.585+0000 7f1f61cd4640 1 --2- 172.21.15.79:0/2033254741 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1f4806be30 0x7f1f4806e2f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.585+0000 7f1f61cd4640 1 --2- 172.21.15.79:0/2033254741 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5c15a720 0x7f1f5c070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.585+0000 7f1f61cd4640 1 --2- 172.21.15.79:0/2033254741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5c0d07a0 0x7f1f5c1585c0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.585+0000 7f1f61cd4640 1 --2- 172.21.15.79:0/2033254741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f5c0b47e0 0x7f1f5c1547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.585+0000 7f1f61cd4640 1 -- 172.21.15.79:0/2033254741 >> 172.21.15.79:0/2033254741 conn(0x7f1f5c0cfc80 msgr2=0x7f1f5c0ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.585+0000 7f1f61cd4640 1 -- 172.21.15.79:0/2033254741 shutdown_connections 2024-04-25T02:12:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.585+0000 7f1f61cd4640 1 -- 172.21.15.79:0/2033254741 wait complete. 2024-04-25T02:12:05.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:12:05.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.692+0000 7ff2ec9b7640 1 Processor -- start 2024-04-25T02:12:05.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.692+0000 7ff2ec9b7640 1 -- start start 2024-04-25T02:12:05.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2ec9b7640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff2e806e3b0 0x7ff2e80b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2ec9b7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2e8071e00 con 0x7ff2e806df50 2024-04-25T02:12:05.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2ec9b7640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2e80720a0 con 0x7ff2e8143bc0 2024-04-25T02:12:05.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2ec9b7640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff2e8072cb0 con 0x7ff2e806e3b0 2024-04-25T02:12:05.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e5d9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff2e806df50 0x7ff2e80b2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41758/0 (socket says 172.21.15.79:41758) 2024-04-25T02:12:05.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e5d9b640 1 -- 172.21.15.79:0/1112362799 learned_addr learned my addr 172.21.15.79:0/1112362799 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e6d9d640 1 --2- 172.21.15.79:0/1112362799 >> v2:172.21.15.189:3300/0 conn(0x7ff2e806e3b0 0x7ff2e80b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e559a640 1 -- 172.21.15.79:0/1112362799 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1370623548 0 0) 0x7ff2e8071e00 con 0x7ff2e806df50 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e559a640 1 -- 172.21.15.79:0/1112362799 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2d4003520 con 0x7ff2e806df50 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e559a640 1 -- 172.21.15.79:0/1112362799 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 395835394 0 0) 0x7ff2d4003520 con 0x7ff2e806df50 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e559a640 1 -- 172.21.15.79:0/1112362799 >> v2:172.21.15.189:3300/0 conn(0x7ff2e806e3b0 msgr2=0x7ff2e80b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e559a640 1 --2- 172.21.15.79:0/1112362799 >> v2:172.21.15.189:3300/0 conn(0x7ff2e806e3b0 0x7ff2e80b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e559a640 1 -- 172.21.15.79:0/1112362799 >> v1:172.21.15.189:6789/0 conn(0x7ff2e8143bc0 legacy=0x7ff2e815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e559a640 1 -- 172.21.15.79:0/1112362799 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e8072380 con 0x7ff2e806df50 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e559a640 1 -- 172.21.15.79:0/1112362799 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7ff2d0001670 con 0x7ff2e806df50 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e559a640 1 -- 172.21.15.79:0/1112362799 >> v1:172.21.15.79:6789/0 conn(0x7ff2e806df50 legacy=0x7ff2e80b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e559a640 1 --2- 172.21.15.79:0/1112362799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2d40039b0 0x7ff2d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e559a640 1 --2- 172.21.15.79:0/1112362799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2d4004800 0x7ff2d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e559a640 1 --2- 172.21.15.79:0/1112362799 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2d40051c0 0x7ff2d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e559a640 1 -- 172.21.15.79:0/1112362799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e8072cb0 con 0x7ff2d40039b0 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e559a640 1 -- 172.21.15.79:0/1112362799 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d400c160 con 0x7ff2d4004800 2024-04-25T02:12:05.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e559a640 1 -- 172.21.15.79:0/1112362799 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d400c360 con 0x7ff2d40051c0 2024-04-25T02:12:05.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e659c640 1 --2- 172.21.15.79:0/1112362799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2d40039b0 0x7ff2d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.693+0000 7ff2e5d9b640 1 --2- 172.21.15.79:0/1112362799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2d4004800 0x7ff2d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.694+0000 7ff2e6d9d640 1 --2- 172.21.15.79:0/1112362799 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2d40051c0 0x7ff2d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.694+0000 7ff2e659c640 1 -- 172.21.15.79:0/1112362799 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2d40051c0 msgr2=0x7ff2d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:05.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.694+0000 7ff2e659c640 1 --2- 172.21.15.79:0/1112362799 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2d40051c0 0x7ff2d400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.694+0000 7ff2e659c640 1 -- 172.21.15.79:0/1112362799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2d4004800 msgr2=0x7ff2d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:05.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.694+0000 7ff2e659c640 1 --2- 172.21.15.79:0/1112362799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2d4004800 0x7ff2d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.694+0000 7ff2e659c640 1 -- 172.21.15.79:0/1112362799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d4003520 con 0x7ff2d40039b0 2024-04-25T02:12:05.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.694+0000 7ff2e6d9d640 1 -- 172.21.15.79:0/1112362799 reap_dead start 2024-04-25T02:12:05.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.694+0000 7ff2e659c640 1 --2- 172.21.15.79:0/1112362799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2d40039b0 0x7ff2d4003dd0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8001750 tx=0x7ff2d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213165ac5f4f0d10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:05.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.694+0000 7ff2e559a640 1 -- 172.21.15.79:0/1112362799 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8001370 con 0x7ff2d40039b0 2024-04-25T02:12:05.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.694+0000 7ff2e559a640 1 -- 172.21.15.79:0/1112362799 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d80052d0 con 0x7ff2d40039b0 2024-04-25T02:12:05.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.694+0000 7ff2e559a640 1 -- 172.21.15.79:0/1112362799 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d802abe0 con 0x7ff2d40039b0 2024-04-25T02:12:05.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.695+0000 7ff2ec9b7640 1 -- 172.21.15.79:0/1112362799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2d40039b0 msgr2=0x7ff2d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.695+0000 7ff2ec9b7640 1 --2- 172.21.15.79:0/1112362799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2d40039b0 0x7ff2d4003dd0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8001750 tx=0x7ff2d4005830 comp rx=0 tx=0).stop 2024-04-25T02:12:05.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.695+0000 7ff2ec9b7640 1 -- 172.21.15.79:0/1112362799 shutdown_connections 2024-04-25T02:12:05.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.695+0000 7ff2ec9b7640 1 --2- 172.21.15.79:0/1112362799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2d40039b0 0x7ff2d4003dd0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.695+0000 7ff2ec9b7640 1 -- 172.21.15.79:0/1112362799 >> 172.21.15.79:0/1112362799 conn(0x7ff2e80cfc80 msgr2=0x7ff2e80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:05.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.695+0000 7ff2ec9b7640 1 -- 172.21.15.79:0/1112362799 shutdown_connections 2024-04-25T02:12:05.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.695+0000 7ff2ec9b7640 1 -- 172.21.15.79:0/1112362799 wait complete. 2024-04-25T02:12:05.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.696+0000 7ff2ec9b7640 1 Processor -- start 2024-04-25T02:12:05.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.696+0000 7ff2ec9b7640 1 -- start start 2024-04-25T02:12:05.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2ec9b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2d40039b0 0x7ff2e8157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2ec9b7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2e8070cf0 0x7ff2e8071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2ec9b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2e8158320 0x7ff2e81587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2ec9b7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e806e840 con 0x7ff2d40039b0 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2ec9b7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e8072940 con 0x7ff2e8158320 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2ec9b7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff2e8143fa0 con 0x7ff2e8070cf0 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2e659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2d40039b0 0x7ff2e8157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2e659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2d40039b0 0x7ff2e8157ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50148/0 (socket says 172.21.15.79:50148) 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2e659c640 1 -- 172.21.15.79:0/1293927742 learned_addr learned my addr 172.21.15.79:0/1293927742 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2e5d9b640 1 --2- 172.21.15.79:0/1293927742 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2e8070cf0 0x7ff2e8071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2e659c640 1 -- 172.21.15.79:0/1293927742 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2e8070cf0 msgr2=0x7ff2e8071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2e6d9d640 1 --2- 172.21.15.79:0/1293927742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2e8158320 0x7ff2e81587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2e659c640 1 --2- 172.21.15.79:0/1293927742 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2e8070cf0 0x7ff2e8071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2e659c640 1 -- 172.21.15.79:0/1293927742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2e8158320 msgr2=0x7ff2e81587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2e659c640 1 --2- 172.21.15.79:0/1293927742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2e8158320 0x7ff2e81587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2e659c640 1 -- 172.21.15.79:0/1293927742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e815a0b0 con 0x7ff2d40039b0 2024-04-25T02:12:05.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.697+0000 7ff2e659c640 1 --2- 172.21.15.79:0/1293927742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2d40039b0 0x7ff2e8157ad0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8000c00 tx=0x7ff2d8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:05.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.698+0000 7ff2deffd640 1 -- 172.21.15.79:0/1293927742 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d803f020 con 0x7ff2d40039b0 2024-04-25T02:12:05.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.698+0000 7ff2deffd640 1 -- 172.21.15.79:0/1293927742 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d8005480 con 0x7ff2d40039b0 2024-04-25T02:12:05.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.698+0000 7ff2deffd640 1 -- 172.21.15.79:0/1293927742 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8001370 con 0x7ff2d40039b0 2024-04-25T02:12:05.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.698+0000 7ff2ec9b7640 1 -- 172.21.15.79:0/1293927742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e8159010 con 0x7ff2d40039b0 2024-04-25T02:12:05.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.698+0000 7ff2ec9b7640 1 -- 172.21.15.79:0/1293927742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e81595d0 con 0x7ff2d40039b0 2024-04-25T02:12:05.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.699+0000 7ff2ec9b7640 1 -- 172.21.15.79:0/1293927742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2e8071690 con 0x7ff2d40039b0 2024-04-25T02:12:05.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.699+0000 7ff2deffd640 1 -- 172.21.15.79:0/1293927742 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2d8042020 con 0x7ff2d40039b0 2024-04-25T02:12:05.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.699+0000 7ff2deffd640 1 --2- 172.21.15.79:0/1293927742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2c806be60 0x7ff2c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:05.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.700+0000 7ff2deffd640 1 -- 172.21.15.79:0/1293927742 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7ff2d80aa970 con 0x7ff2d40039b0 2024-04-25T02:12:05.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.700+0000 7ff2e5d9b640 1 --2- 172.21.15.79:0/1293927742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2c806be60 0x7ff2c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:05.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.700+0000 7ff2e5d9b640 1 --2- 172.21.15.79:0/1293927742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2c806be60 0x7ff2c806e320 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0001eb0 tx=0x7ff2d0000ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:05.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.704+0000 7ff2deffd640 1 -- 172.21.15.79:0/1293927742 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff2d8049030 con 0x7ff2d40039b0 2024-04-25T02:12:05.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.913+0000 7ff2ec9b7640 1 -- 172.21.15.79:0/1293927742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff2e80b3f90 con 0x7ff2d40039b0 2024-04-25T02:12:05.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.913+0000 7ff2deffd640 1 -- 172.21.15.79:0/1293927742 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) ==== 53+0+73 (secure 0 0 0) 0x7ff2d8079320 con 0x7ff2d40039b0 2024-04-25T02:12:05.923 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:12:05.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.915+0000 7ff2ec9b7640 1 -- 172.21.15.79:0/1293927742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2c806be60 msgr2=0x7ff2c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.915+0000 7ff2ec9b7640 1 --2- 172.21.15.79:0/1293927742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2c806be60 0x7ff2c806e320 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0001eb0 tx=0x7ff2d0000ef0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.915+0000 7ff2ec9b7640 1 -- 172.21.15.79:0/1293927742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2d40039b0 msgr2=0x7ff2e8157ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:05.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.915+0000 7ff2ec9b7640 1 --2- 172.21.15.79:0/1293927742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2d40039b0 0x7ff2e8157ad0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8000c00 tx=0x7ff2d8001120 comp rx=0 tx=0).stop 2024-04-25T02:12:05.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.915+0000 7ff2ec9b7640 1 -- 172.21.15.79:0/1293927742 shutdown_connections 2024-04-25T02:12:05.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.915+0000 7ff2ec9b7640 1 --2- 172.21.15.79:0/1293927742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2c806be60 0x7ff2c806e320 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.915+0000 7ff2ec9b7640 1 --2- 172.21.15.79:0/1293927742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2e8158320 0x7ff2e81587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.915+0000 7ff2ec9b7640 1 --2- 172.21.15.79:0/1293927742 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2e8070cf0 0x7ff2e8071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.915+0000 7ff2ec9b7640 1 --2- 172.21.15.79:0/1293927742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2d40039b0 0x7ff2e8157ad0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:05.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.915+0000 7ff2ec9b7640 1 -- 172.21.15.79:0/1293927742 >> 172.21.15.79:0/1293927742 conn(0x7ff2e80cfc80 msgr2=0x7ff2e80d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:05.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.915+0000 7ff2ec9b7640 1 -- 172.21.15.79:0/1293927742 shutdown_connections 2024-04-25T02:12:05.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:05.915+0000 7ff2ec9b7640 1 -- 172.21.15.79:0/1293927742 wait complete. 2024-04-25T02:12:05.933 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:12:05.933 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:12:05.933 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:12:05.933 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:12:05.933 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:05.933 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:12:05.933 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:12:05.933 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:12:05.933 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:12:05.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:05.934 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:12:05.948 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:12:05.948 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:12:05.948 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:12:05.948 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:05.949 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:12:05.949 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:05.949 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:12:05.949 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:12:05.949 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:12:05.949 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:12:05.949 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:12:05.949 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:12:05.949 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:12:05.949 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:12:05.949 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:12:05.949 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:12:05.949 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:12:05.949 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42480sec preferred_lft 42480sec 2024-04-25T02:12:05.949 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:12:05.950 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:05.950 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:12:05.950 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:12:05.950 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:12:05.950 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:05.950 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:12:05.950 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:05.950 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:12:05.950 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:12:05.950 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link 2024-04-25T02:12:05.950 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:05.950 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:12:05.950 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:12:05.950 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::4c:adff:fe56:7194/64 scope link 2024-04-25T02:12:05.950 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:05.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:05.951 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:12:06.010 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:12:06.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:06.012 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:12:06.067 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:12:06.067 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:12:06.067 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:12:06.067 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:12:06.067 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:12:06.067 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:12:06.068 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:12:06.068 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:12:06.068 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:12:06.068 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:12:06.068 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:12:06.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:12:06.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:12:06.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:06.189 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:12:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:12:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:12:06.204 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:12:06.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:06.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:12:06.267 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:12:06.267 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:06.322 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:12:06.322 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:12:06.322 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:06.376 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:12:06.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:06.377 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:12:06.457 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:12:06.457 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:12:06.457 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:12:06.465 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:12:06.465 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:12:06.465 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:12:06.466 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:12:06.466 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:12:06.473 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:12:06.473 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:12:06.473 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:12:06.473 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:12:06.473 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:12:06.473 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:12:06.473 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:12:06.473 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:12:06.474 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:12:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:12:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:12:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:12:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:12:06.475 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:12:06.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:06.475 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:06.538 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:12:06.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:12:06.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:12:06.635 INFO:teuthology.orchestra.run.smithi079.stdout:client5875 2024-04-25T02:12:06.635 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:12:06.635 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:12:06.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:06.650 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2024-04-25T02:12:06.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:06.708 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2024-04-25T02:12:06.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:06.765 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2024-04-25T02:12:06.820 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:12:06.820 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:12:06.820 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:12:06.821 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:12:06.821 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-04-25T02:12:06.821 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:12:06.924 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627776 2024-04-25T02:12:06.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:12:06.932 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:12:06.932 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:12:06.987 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:12:06.988 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:12:07.043 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:12:07.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.171+0000 7f91459dc640 1 Processor -- start 2024-04-25T02:12:07.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.171+0000 7f91459dc640 1 -- start start 2024-04-25T02:12:07.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.172+0000 7f91459dc640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f914015e4d0 0x7f914006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.172+0000 7f91459dc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91400b3570 0x7f91400d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.172+0000 7f91459dc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91400d1660 con 0x7f91400b3020 2024-04-25T02:12:07.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.172+0000 7f91459dc640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f91400d1380 con 0x7f914015e4d0 2024-04-25T02:12:07.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.172+0000 7f91459dc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f91400cede0 con 0x7f91400b3570 2024-04-25T02:12:07.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.172+0000 7f913f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f91400b3020 0x7f91400cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41772/0 (socket says 172.21.15.79:41772) 2024-04-25T02:12:07.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.172+0000 7f913f7fe640 1 -- 172.21.15.79:0/3824886164 learned_addr learned my addr 172.21.15.79:0/3824886164 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:07.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913e7fc640 1 --2- 172.21.15.79:0/3824886164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91400b3570 0x7f91400d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913effd640 1 --2- 172.21.15.79:0/3824886164 >> v2:172.21.15.189:3300/0 conn(0x7f914015e4d0 0x7f914006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 -- 172.21.15.79:0/3824886164 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891016414 0 0) 0x7f91400d1660 con 0x7f91400b3020 2024-04-25T02:12:07.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 -- 172.21.15.79:0/3824886164 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9128003520 con 0x7f91400b3020 2024-04-25T02:12:07.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 -- 172.21.15.79:0/3824886164 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1147749187 0 0) 0x7f9128003520 con 0x7f91400b3020 2024-04-25T02:12:07.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 -- 172.21.15.79:0/3824886164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91400b3570 msgr2=0x7f91400d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:07.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 --2- 172.21.15.79:0/3824886164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91400b3570 0x7f91400d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 -- 172.21.15.79:0/3824886164 >> v2:172.21.15.189:3300/0 conn(0x7f914015e4d0 msgr2=0x7f914006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:07.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 --2- 172.21.15.79:0/3824886164 >> v2:172.21.15.189:3300/0 conn(0x7f914015e4d0 0x7f914006bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 -- 172.21.15.79:0/3824886164 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91400cf0c0 con 0x7f91400b3020 2024-04-25T02:12:07.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 -- 172.21.15.79:0/3824886164 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f9138001670 con 0x7f91400b3020 2024-04-25T02:12:07.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 -- 172.21.15.79:0/3824886164 >> v1:172.21.15.79:6789/0 conn(0x7f91400b3020 legacy=0x7f91400cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 --2- 172.21.15.79:0/3824886164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280039b0 0x7f9128003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 --2- 172.21.15.79:0/3824886164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91400b3570 0x7f9128004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 --2- 172.21.15.79:0/3824886164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9128004d40 0x7f91280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 -- 172.21.15.79:0/3824886164 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f91400d1380 con 0x7f91280039b0 2024-04-25T02:12:07.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 -- 172.21.15.79:0/3824886164 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91400cede0 con 0x7f9128004d40 2024-04-25T02:12:07.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913dffb640 1 -- 172.21.15.79:0/3824886164 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f912800b9c0 con 0x7f91400b3570 2024-04-25T02:12:07.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913effd640 1 --2- 172.21.15.79:0/3824886164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280039b0 0x7f9128003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913e7fc640 1 --2- 172.21.15.79:0/3824886164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91400b3570 0x7f9128004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913f7fe640 1 --2- 172.21.15.79:0/3824886164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9128004d40 0x7f91280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913effd640 1 -- 172.21.15.79:0/3824886164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91400b3570 msgr2=0x7f9128004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:07.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913effd640 1 --2- 172.21.15.79:0/3824886164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91400b3570 0x7f9128004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913effd640 1 -- 172.21.15.79:0/3824886164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9128004d40 msgr2=0x7f91280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:07.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913effd640 1 --2- 172.21.15.79:0/3824886164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9128004d40 0x7f91280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.173+0000 7f913effd640 1 -- 172.21.15.79:0/3824886164 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9128003520 con 0x7f91280039b0 2024-04-25T02:12:07.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.174+0000 7f913effd640 1 --2- 172.21.15.79:0/3824886164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280039b0 0x7f9128003dd0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f913000e170 tx=0x7f9128005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2907f6daefa019b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:07.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.174+0000 7f913dffb640 1 -- 172.21.15.79:0/3824886164 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130034020 con 0x7f91280039b0 2024-04-25T02:12:07.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.174+0000 7f913dffb640 1 -- 172.21.15.79:0/3824886164 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9130030430 con 0x7f91280039b0 2024-04-25T02:12:07.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.174+0000 7f913dffb640 1 -- 172.21.15.79:0/3824886164 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130009c10 con 0x7f91280039b0 2024-04-25T02:12:07.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.175+0000 7f91459dc640 1 -- 172.21.15.79:0/3824886164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280039b0 msgr2=0x7f9128003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.175+0000 7f91459dc640 1 --2- 172.21.15.79:0/3824886164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280039b0 0x7f9128003dd0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f913000e170 tx=0x7f9128005830 comp rx=0 tx=0).stop 2024-04-25T02:12:07.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.175+0000 7f913f7fe640 1 -- 172.21.15.79:0/3824886164 reap_dead start 2024-04-25T02:12:07.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.175+0000 7f91459dc640 1 -- 172.21.15.79:0/3824886164 shutdown_connections 2024-04-25T02:12:07.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.175+0000 7f91459dc640 1 -- 172.21.15.79:0/3824886164 >> 172.21.15.79:0/3824886164 conn(0x7f914009d460 msgr2=0x7f91400d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:07.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.175+0000 7f91459dc640 1 -- 172.21.15.79:0/3824886164 shutdown_connections 2024-04-25T02:12:07.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.175+0000 7f91459dc640 1 -- 172.21.15.79:0/3824886164 wait complete. 2024-04-25T02:12:07.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.176+0000 7f91459dc640 1 Processor -- start 2024-04-25T02:12:07.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.176+0000 7f91459dc640 1 -- start start 2024-04-25T02:12:07.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f91459dc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91280039b0 0x7f91400b9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f91459dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91400a08d0 0x7f91400a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f91459dc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91400ccc60 0x7f91400cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f91459dc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f91400d2250 con 0x7f91400a08d0 2024-04-25T02:12:07.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f91459dc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91400d20d0 con 0x7f91400ccc60 2024-04-25T02:12:07.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f91459dc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f914006c1b0 con 0x7f91280039b0 2024-04-25T02:12:07.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f913e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91400a08d0 0x7f91400a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f913e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91400a08d0 0x7f91400a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50180/0 (socket says 172.21.15.79:50180) 2024-04-25T02:12:07.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f913e7fc640 1 -- 172.21.15.79:0/1325217246 learned_addr learned my addr 172.21.15.79:0/1325217246 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:07.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f913f7fe640 1 --2- 172.21.15.79:0/1325217246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91400ccc60 0x7f91400cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f913effd640 1 --2- 172.21.15.79:0/1325217246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91280039b0 0x7f91400b9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f913e7fc640 1 -- 172.21.15.79:0/1325217246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91280039b0 msgr2=0x7f91400b9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f913e7fc640 1 --2- 172.21.15.79:0/1325217246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91280039b0 0x7f91400b9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f913e7fc640 1 -- 172.21.15.79:0/1325217246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91400ccc60 msgr2=0x7f91400cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f913e7fc640 1 --2- 172.21.15.79:0/1325217246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91400ccc60 0x7f91400cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f913e7fc640 1 -- 172.21.15.79:0/1325217246 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91400a1290 con 0x7f91400a08d0 2024-04-25T02:12:07.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f913effd640 1 --2- 172.21.15.79:0/1325217246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91280039b0 0x7f91400b9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:07.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f913e7fc640 1 --2- 172.21.15.79:0/1325217246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91400a08d0 0x7f91400a0d50 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f91340119a0 tx=0x7f9134011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:07.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f9127fff640 1 -- 172.21.15.79:0/1325217246 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913400faf0 con 0x7f91400a08d0 2024-04-25T02:12:07.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f9127fff640 1 -- 172.21.15.79:0/1325217246 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913400fc90 con 0x7f91400a08d0 2024-04-25T02:12:07.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f91459dc640 1 -- 172.21.15.79:0/1325217246 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91400cd950 con 0x7f91400a08d0 2024-04-25T02:12:07.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f9127fff640 1 -- 172.21.15.79:0/1325217246 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9134014440 con 0x7f91400a08d0 2024-04-25T02:12:07.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.177+0000 7f91459dc640 1 -- 172.21.15.79:0/1325217246 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f914014b5d0 con 0x7f91400a08d0 2024-04-25T02:12:07.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.178+0000 7f91459dc640 1 -- 172.21.15.79:0/1325217246 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91400690a0 con 0x7f91400a08d0 2024-04-25T02:12:07.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.179+0000 7f9127fff640 1 -- 172.21.15.79:0/1325217246 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9134012040 con 0x7f91400a08d0 2024-04-25T02:12:07.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.179+0000 7f9127fff640 1 --2- 172.21.15.79:0/1325217246 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f912c06be30 0x7f912c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.179+0000 7f9127fff640 1 -- 172.21.15.79:0/1325217246 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f913408b470 con 0x7f91400a08d0 2024-04-25T02:12:07.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.179+0000 7f913effd640 1 --2- 172.21.15.79:0/1325217246 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f912c06be30 0x7f912c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.180+0000 7f913effd640 1 --2- 172.21.15.79:0/1325217246 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f912c06be30 0x7f912c06e2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9130035000 tx=0x7f913002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:07.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.184+0000 7f9127fff640 1 -- 172.21.15.79:0/1325217246 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9134019030 con 0x7f91400a08d0 2024-04-25T02:12:07.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.358+0000 7f91459dc640 1 -- 172.21.15.79:0/1325217246 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91400d1920 con 0x7f91400a08d0 2024-04-25T02:12:07.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.359+0000 7f9127fff640 1 -- 172.21.15.79:0/1325217246 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16680 (secure 0 0 0) 0x7f9134059860 con 0x7f91400a08d0 2024-04-25T02:12:07.367 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:12:07.367 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":71,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:11:57.599894+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:11:54.161817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T02:11:54.917049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:12:07.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.361+0000 7f91459dc640 1 -- 172.21.15.79:0/1325217246 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f912c06be30 msgr2=0x7f912c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.361+0000 7f91459dc640 1 --2- 172.21.15.79:0/1325217246 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f912c06be30 0x7f912c06e2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9130035000 tx=0x7f913002f000 comp rx=0 tx=0).stop 2024-04-25T02:12:07.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.361+0000 7f91459dc640 1 -- 172.21.15.79:0/1325217246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91400a08d0 msgr2=0x7f91400a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.361+0000 7f91459dc640 1 --2- 172.21.15.79:0/1325217246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91400a08d0 0x7f91400a0d50 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f91340119a0 tx=0x7f9134011e60 comp rx=0 tx=0).stop 2024-04-25T02:12:07.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.361+0000 7f91459dc640 1 -- 172.21.15.79:0/1325217246 shutdown_connections 2024-04-25T02:12:07.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.361+0000 7f91459dc640 1 --2- 172.21.15.79:0/1325217246 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f912c06be30 0x7f912c06e2f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.361+0000 7f91459dc640 1 --2- 172.21.15.79:0/1325217246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91400ccc60 0x7f91400cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.361+0000 7f91459dc640 1 --2- 172.21.15.79:0/1325217246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91400a08d0 0x7f91400a0d50 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.361+0000 7f91459dc640 1 --2- 172.21.15.79:0/1325217246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91280039b0 0x7f91400b9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.361+0000 7f91459dc640 1 -- 172.21.15.79:0/1325217246 >> 172.21.15.79:0/1325217246 conn(0x7f914009d460 msgr2=0x7f914015d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:07.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.361+0000 7f91459dc640 1 -- 172.21.15.79:0/1325217246 shutdown_connections 2024-04-25T02:12:07.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.361+0000 7f91459dc640 1 -- 172.21.15.79:0/1325217246 wait complete. 2024-04-25T02:12:07.379 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:11:54.161817+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:11:54.917049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:12:07.379 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:12:07.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.471+0000 7ff6ddaf5640 1 Processor -- start 2024-04-25T02:12:07.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.471+0000 7ff6ddaf5640 1 -- start start 2024-04-25T02:12:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6ddaf5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6d806b2f0 0x7ff6d80b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6ddaf5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff6d80cf7a0 0x7ff6d806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6ddaf5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6d806e6b0 0x7ff6d80cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6ddaf5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff6d815f830 con 0x7ff6d806b2f0 2024-04-25T02:12:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6ddaf5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff6d806bc10 con 0x7ff6d80cf7a0 2024-04-25T02:12:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6ddaf5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d815ec20 con 0x7ff6d806e6b0 2024-04-25T02:12:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6d77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6d806b2f0 0x7ff6d80b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6d77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6d806b2f0 0x7ff6d80b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50182/0 (socket says 172.21.15.79:50182) 2024-04-25T02:12:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6d77fe640 1 -- 172.21.15.79:0/285260074 learned_addr learned my addr 172.21.15.79:0/285260074 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6d77fe640 1 -- 172.21.15.79:0/285260074 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6d806e6b0 msgr2=0x7ff6d80cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6d77fe640 1 --2- 172.21.15.79:0/285260074 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6d806e6b0 0x7ff6d80cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6d77fe640 1 -- 172.21.15.79:0/285260074 >> v2:172.21.15.189:3300/0 conn(0x7ff6d80cf7a0 msgr2=0x7ff6d806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6d6ffd640 1 --2- 172.21.15.79:0/285260074 >> v2:172.21.15.189:3300/0 conn(0x7ff6d80cf7a0 0x7ff6d806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6d77fe640 1 --2- 172.21.15.79:0/285260074 >> v2:172.21.15.189:3300/0 conn(0x7ff6d80cf7a0 0x7ff6d806b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6d77fe640 1 -- 172.21.15.79:0/285260074 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d815ef00 con 0x7ff6d806b2f0 2024-04-25T02:12:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.472+0000 7ff6d6ffd640 1 --2- 172.21.15.79:0/285260074 >> v2:172.21.15.189:3300/0 conn(0x7ff6d80cf7a0 0x7ff6d806b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.473+0000 7ff6d77fe640 1 --2- 172.21.15.79:0/285260074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d806b2f0 0x7ff6d80b4b50 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80af800 tx=0x7ff6c802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2765615c4453aac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.473+0000 7ff6d67fc640 1 -- 172.21.15.79:0/285260074 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8037070 con 0x7ff6d806b2f0 2024-04-25T02:12:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.473+0000 7ff6d67fc640 1 -- 172.21.15.79:0/285260074 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c8032440 con 0x7ff6d806b2f0 2024-04-25T02:12:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.473+0000 7ff6d67fc640 1 -- 172.21.15.79:0/285260074 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8032810 con 0x7ff6d806b2f0 2024-04-25T02:12:07.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.474+0000 7ff6ddaf5640 1 -- 172.21.15.79:0/285260074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d806b2f0 msgr2=0x7ff6d80b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.474+0000 7ff6ddaf5640 1 --2- 172.21.15.79:0/285260074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d806b2f0 0x7ff6d80b4b50 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80af800 tx=0x7ff6c802a140 comp rx=0 tx=0).stop 2024-04-25T02:12:07.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.474+0000 7ff6ddaf5640 1 -- 172.21.15.79:0/285260074 shutdown_connections 2024-04-25T02:12:07.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.474+0000 7ff6ddaf5640 1 --2- 172.21.15.79:0/285260074 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6d806e6b0 0x7ff6d80cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.474+0000 7ff6ddaf5640 1 --2- 172.21.15.79:0/285260074 >> v2:172.21.15.189:3300/0 conn(0x7ff6d80cf7a0 0x7ff6d806b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.474+0000 7ff6ddaf5640 1 --2- 172.21.15.79:0/285260074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d806b2f0 0x7ff6d80b4b50 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.474+0000 7ff6ddaf5640 1 -- 172.21.15.79:0/285260074 >> 172.21.15.79:0/285260074 conn(0x7ff6d80b1cd0 msgr2=0x7ff6d80b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:07.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.474+0000 7ff6ddaf5640 1 -- 172.21.15.79:0/285260074 shutdown_connections 2024-04-25T02:12:07.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.474+0000 7ff6ddaf5640 1 -- 172.21.15.79:0/285260074 wait complete. 2024-04-25T02:12:07.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.475+0000 7ff6ddaf5640 1 Processor -- start 2024-04-25T02:12:07.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.475+0000 7ff6ddaf5640 1 -- start start 2024-04-25T02:12:07.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6ddaf5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6d806b2f0 0x7ff6d8071760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6ddaf5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d806e6b0 0x7ff6d8146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6ddaf5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6d80cf7a0 0x7ff6d80ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6ddaf5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d806cfe0 con 0x7ff6d806e6b0 2024-04-25T02:12:07.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6ddaf5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d815f4c0 con 0x7ff6d806b2f0 2024-04-25T02:12:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6ddaf5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d806d160 con 0x7ff6d80cf7a0 2024-04-25T02:12:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6d6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d806e6b0 0x7ff6d8146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6d6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d806e6b0 0x7ff6d8146660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50192/0 (socket says 172.21.15.79:50192) 2024-04-25T02:12:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6d6ffd640 1 -- 172.21.15.79:0/3415609451 learned_addr learned my addr 172.21.15.79:0/3415609451 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6d6ffd640 1 -- 172.21.15.79:0/3415609451 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6d80cf7a0 msgr2=0x7ff6d80ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6d77fe640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6d806b2f0 0x7ff6d8071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6d7fff640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6d80cf7a0 0x7ff6d80ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6d6ffd640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6d80cf7a0 0x7ff6d80ad380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6d6ffd640 1 -- 172.21.15.79:0/3415609451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6d806b2f0 msgr2=0x7ff6d8071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6d6ffd640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6d806b2f0 0x7ff6d8071760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6d6ffd640 1 -- 172.21.15.79:0/3415609451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d81f5af0 con 0x7ff6d806e6b0 2024-04-25T02:12:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6d77fe640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6d806b2f0 0x7ff6d8071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6d7fff640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6d80cf7a0 0x7ff6d80ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.476+0000 7ff6d6ffd640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d806e6b0 0x7ff6d8146660 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00c820 tx=0x7ff6cc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.477+0000 7ff6bffff640 1 -- 172.21.15.79:0/3415609451 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc015070 con 0x7ff6d806e6b0 2024-04-25T02:12:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.477+0000 7ff6bffff640 1 -- 172.21.15.79:0/3415609451 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6cc007a30 con 0x7ff6d806e6b0 2024-04-25T02:12:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.477+0000 7ff6ddaf5640 1 -- 172.21.15.79:0/3415609451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d81f5dd0 con 0x7ff6d806e6b0 2024-04-25T02:12:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.477+0000 7ff6bffff640 1 -- 172.21.15.79:0/3415609451 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc007e00 con 0x7ff6d806e6b0 2024-04-25T02:12:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.477+0000 7ff6ddaf5640 1 -- 172.21.15.79:0/3415609451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d81f6390 con 0x7ff6d806e6b0 2024-04-25T02:12:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.477+0000 7ff6ddaf5640 1 -- 172.21.15.79:0/3415609451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d80b4b50 con 0x7ff6d806e6b0 2024-04-25T02:12:07.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.478+0000 7ff6bffff640 1 -- 172.21.15.79:0/3415609451 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6cc018070 con 0x7ff6d806e6b0 2024-04-25T02:12:07.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.478+0000 7ff6bffff640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff6c406be30 0x7ff6c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.479+0000 7ff6d77fe640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff6c406be30 0x7ff6c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.479+0000 7ff6bffff640 1 -- 172.21.15.79:0/3415609451 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7ff6cc08ae30 con 0x7ff6d806e6b0 2024-04-25T02:12:07.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.479+0000 7ff6d77fe640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff6c406be30 0x7ff6c406e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8034000 tx=0x7ff6c802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:07.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.483+0000 7ff6bffff640 1 -- 172.21.15.79:0/3415609451 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff6d80b4b50 con 0x7ff6d806e6b0 2024-04-25T02:12:07.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.656+0000 7ff6ddaf5640 1 -- 172.21.15.79:0/3415609451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff6d80690a0 con 0x7ff6d806e6b0 2024-04-25T02:12:07.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.657+0000 7ff6bffff640 1 -- 172.21.15.79:0/3415609451 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) ==== 93+0+10 (secure 0 0 0) 0x7ff6cc0597f0 con 0x7ff6d806e6b0 2024-04-25T02:12:07.664 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:12:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.659+0000 7ff6ddaf5640 1 -- 172.21.15.79:0/3415609451 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff6c406be30 msgr2=0x7ff6c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.659+0000 7ff6ddaf5640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff6c406be30 0x7ff6c406e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8034000 tx=0x7ff6c802e000 comp rx=0 tx=0).stop 2024-04-25T02:12:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.659+0000 7ff6ddaf5640 1 -- 172.21.15.79:0/3415609451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d806e6b0 msgr2=0x7ff6d8146660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.659+0000 7ff6ddaf5640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d806e6b0 0x7ff6d8146660 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00c820 tx=0x7ff6cc00cc20 comp rx=0 tx=0).stop 2024-04-25T02:12:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.659+0000 7ff6ddaf5640 1 -- 172.21.15.79:0/3415609451 shutdown_connections 2024-04-25T02:12:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.659+0000 7ff6ddaf5640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff6c406be30 0x7ff6c406e2f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.659+0000 7ff6ddaf5640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6d80cf7a0 0x7ff6d80ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.659+0000 7ff6ddaf5640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d806e6b0 0x7ff6d8146660 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.659+0000 7ff6ddaf5640 1 --2- 172.21.15.79:0/3415609451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6d806b2f0 0x7ff6d8071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.659+0000 7ff6ddaf5640 1 -- 172.21.15.79:0/3415609451 >> 172.21.15.79:0/3415609451 conn(0x7ff6d80b1cd0 msgr2=0x7ff6d81565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:07.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.659+0000 7ff6ddaf5640 1 -- 172.21.15.79:0/3415609451 shutdown_connections 2024-04-25T02:12:07.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.659+0000 7ff6ddaf5640 1 -- 172.21.15.79:0/3415609451 wait complete. 2024-04-25T02:12:07.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:12:07.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.769+0000 7f05ec561640 1 Processor -- start 2024-04-25T02:12:07.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.769+0000 7f05ec561640 1 -- start start 2024-04-25T02:12:07.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.770+0000 7f05ec561640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f05e40cf7a0 0x7f05e40b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.770+0000 7f05ec561640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05e406e6b0 0x7f05e415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.770+0000 7f05ec561640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e415ec20 con 0x7f05e406b2f0 2024-04-25T02:12:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.770+0000 7f05ec561640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f05e415f830 con 0x7f05e40cf7a0 2024-04-25T02:12:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.770+0000 7f05ec561640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f05e415ef00 con 0x7f05e406e6b0 2024-04-25T02:12:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.770+0000 7f05e9afc640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f05e40cf7a0 0x7f05e40b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.770+0000 7f05eaafe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05e406e6b0 0x7f05e415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.770+0000 7f05ea2fd640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f05e406b2f0 0x7f05e406b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:34282/0 (socket says 172.21.15.79:34282) 2024-04-25T02:12:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.770+0000 7f05ea2fd640 1 -- 172.21.15.79:0/885097141 learned_addr learned my addr 172.21.15.79:0/885097141 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.770+0000 7f05e9afc640 1 -- 172.21.15.79:0/885097141 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05e406e6b0 msgr2=0x7f05e415b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.770+0000 7f05e9afc640 1 --2- 172.21.15.79:0/885097141 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05e406e6b0 0x7f05e415b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.770+0000 7f05e9afc640 1 -- 172.21.15.79:0/885097141 >> v1:172.21.15.189:6789/0 conn(0x7f05e406b2f0 legacy=0x7f05e406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.771+0000 7f05e9afc640 1 -- 172.21.15.79:0/885097141 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e415f1e0 con 0x7f05e40cf7a0 2024-04-25T02:12:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.771+0000 7f05eaafe640 1 --2- 172.21.15.79:0/885097141 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05e406e6b0 0x7f05e415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.771+0000 7f05e9afc640 1 --2- 172.21.15.79:0/885097141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05e40cf7a0 0x7f05e40b4b50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f05e00097a0 tx=0x7f05e002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c82f2f2702c7f41a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.771+0000 7f05e92fb640 1 -- 172.21.15.79:0/885097141 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e0037070 con 0x7f05e40cf7a0 2024-04-25T02:12:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.771+0000 7f05e92fb640 1 -- 172.21.15.79:0/885097141 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e002ae50 con 0x7f05e40cf7a0 2024-04-25T02:12:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.771+0000 7f05e92fb640 1 -- 172.21.15.79:0/885097141 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e0032660 con 0x7f05e40cf7a0 2024-04-25T02:12:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.772+0000 7f05ec561640 1 -- 172.21.15.79:0/885097141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05e40cf7a0 msgr2=0x7f05e40b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.772+0000 7f05ec561640 1 --2- 172.21.15.79:0/885097141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05e40cf7a0 0x7f05e40b4b50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f05e00097a0 tx=0x7f05e002a100 comp rx=0 tx=0).stop 2024-04-25T02:12:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.772+0000 7f05ec561640 1 -- 172.21.15.79:0/885097141 shutdown_connections 2024-04-25T02:12:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.772+0000 7f05ec561640 1 --2- 172.21.15.79:0/885097141 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05e406e6b0 0x7f05e415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.772+0000 7f05ec561640 1 --2- 172.21.15.79:0/885097141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05e40cf7a0 0x7f05e40b4b50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.772+0000 7f05ec561640 1 -- 172.21.15.79:0/885097141 >> 172.21.15.79:0/885097141 conn(0x7f05e40b1cd0 msgr2=0x7f05e40b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.772+0000 7f05ec561640 1 -- 172.21.15.79:0/885097141 shutdown_connections 2024-04-25T02:12:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.772+0000 7f05ec561640 1 -- 172.21.15.79:0/885097141 wait complete. 2024-04-25T02:12:07.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.773+0000 7f05ec561640 1 Processor -- start 2024-04-25T02:12:07.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.773+0000 7f05ec561640 1 -- start start 2024-04-25T02:12:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05ec561640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05e406b2f0 0x7f05e415d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05ec561640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05e406e6b0 0x7f05e409cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05ec561640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05e40cf7a0 0x7f05e41578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05ec561640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05e406d160 con 0x7f05e406b2f0 2024-04-25T02:12:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05ec561640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f05e406cfe0 con 0x7f05e406e6b0 2024-04-25T02:12:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05ec561640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f05e415b810 con 0x7f05e40cf7a0 2024-04-25T02:12:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05ea2fd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05e406b2f0 0x7f05e415d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05ea2fd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05e406b2f0 0x7f05e415d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50198/0 (socket says 172.21.15.79:50198) 2024-04-25T02:12:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05ea2fd640 1 -- 172.21.15.79:0/284309204 learned_addr learned my addr 172.21.15.79:0/284309204 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05e9afc640 1 --2- 172.21.15.79:0/284309204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05e406e6b0 0x7f05e409cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05ea2fd640 1 -- 172.21.15.79:0/284309204 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05e40cf7a0 msgr2=0x7f05e41578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05ea2fd640 1 --2- 172.21.15.79:0/284309204 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05e40cf7a0 0x7f05e41578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05ea2fd640 1 -- 172.21.15.79:0/284309204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05e406e6b0 msgr2=0x7f05e409cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05ea2fd640 1 --2- 172.21.15.79:0/284309204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05e406e6b0 0x7f05e409cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05ea2fd640 1 -- 172.21.15.79:0/284309204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e415d2a0 con 0x7f05e406b2f0 2024-04-25T02:12:07.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.774+0000 7f05ea2fd640 1 --2- 172.21.15.79:0/284309204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05e406b2f0 0x7f05e415d580 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c400 tx=0x7f05d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:07.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.775+0000 7f05d6ffd640 1 -- 172.21.15.79:0/284309204 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8017070 con 0x7f05e406b2f0 2024-04-25T02:12:07.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.775+0000 7f05d6ffd640 1 -- 172.21.15.79:0/284309204 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d8005ce0 con 0x7f05e406b2f0 2024-04-25T02:12:07.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.775+0000 7f05ec561640 1 -- 172.21.15.79:0/284309204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e409aba0 con 0x7f05e406b2f0 2024-04-25T02:12:07.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.775+0000 7f05d6ffd640 1 -- 172.21.15.79:0/284309204 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d80072f0 con 0x7f05e406b2f0 2024-04-25T02:12:07.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.775+0000 7f05ec561640 1 -- 172.21.15.79:0/284309204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e415dac0 con 0x7f05e406b2f0 2024-04-25T02:12:07.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.776+0000 7f05ec561640 1 -- 172.21.15.79:0/284309204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e409ad70 con 0x7f05e406b2f0 2024-04-25T02:12:07.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.776+0000 7f05d6ffd640 1 -- 172.21.15.79:0/284309204 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05d801a070 con 0x7f05e406b2f0 2024-04-25T02:12:07.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.776+0000 7f05d6ffd640 1 --2- 172.21.15.79:0/284309204 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f05c806be30 0x7f05c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:07.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.777+0000 7f05d6ffd640 1 -- 172.21.15.79:0/284309204 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f05d808a1b0 con 0x7f05e406b2f0 2024-04-25T02:12:07.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.777+0000 7f05e9afc640 1 --2- 172.21.15.79:0/284309204 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f05c806be30 0x7f05c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:07.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.777+0000 7f05e9afc640 1 --2- 172.21.15.79:0/284309204 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f05c806be30 0x7f05c806e2f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f05e0034000 tx=0x7f05e002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:07.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.781+0000 7f05d6ffd640 1 -- 172.21.15.79:0/284309204 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f05d8058bf0 con 0x7f05e406b2f0 2024-04-25T02:12:07.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.951+0000 7f05ec561640 1 -- 172.21.15.79:0/284309204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f05e40690a0 con 0x7f05e406b2f0 2024-04-25T02:12:07.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.951+0000 7f05d6ffd640 1 -- 172.21.15.79:0/284309204 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) ==== 104+0+11 (secure 0 0 0) 0x7f05d80584f0 con 0x7f05e406b2f0 2024-04-25T02:12:07.961 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:12:07.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.953+0000 7f05ec561640 1 -- 172.21.15.79:0/284309204 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f05c806be30 msgr2=0x7f05c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.953+0000 7f05ec561640 1 --2- 172.21.15.79:0/284309204 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f05c806be30 0x7f05c806e2f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f05e0034000 tx=0x7f05e002e000 comp rx=0 tx=0).stop 2024-04-25T02:12:07.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.953+0000 7f05ec561640 1 -- 172.21.15.79:0/284309204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05e406b2f0 msgr2=0x7f05e415d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:07.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.953+0000 7f05ec561640 1 --2- 172.21.15.79:0/284309204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05e406b2f0 0x7f05e415d580 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c400 tx=0x7f05d800c8c0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.953+0000 7f05ec561640 1 -- 172.21.15.79:0/284309204 shutdown_connections 2024-04-25T02:12:07.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.953+0000 7f05ec561640 1 --2- 172.21.15.79:0/284309204 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f05c806be30 0x7f05c806e2f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.953+0000 7f05ec561640 1 --2- 172.21.15.79:0/284309204 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05e40cf7a0 0x7f05e41578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.953+0000 7f05ec561640 1 --2- 172.21.15.79:0/284309204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05e406e6b0 0x7f05e409cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.953+0000 7f05ec561640 1 --2- 172.21.15.79:0/284309204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05e406b2f0 0x7f05e415d580 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:07.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.953+0000 7f05ec561640 1 -- 172.21.15.79:0/284309204 >> 172.21.15.79:0/284309204 conn(0x7f05e40b1cd0 msgr2=0x7f05e40b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:07.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.953+0000 7f05ec561640 1 -- 172.21.15.79:0/284309204 shutdown_connections 2024-04-25T02:12:07.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:07.953+0000 7f05ec561640 1 -- 172.21.15.79:0/284309204 wait complete. 2024-04-25T02:12:07.971 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:12:08.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.063+0000 7fa593e4d640 1 Processor -- start 2024-04-25T02:12:08.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.063+0000 7fa593e4d640 1 -- start start 2024-04-25T02:12:08.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.064+0000 7fa593e4d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa58c06b2f0 0x7fa58c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.064+0000 7fa593e4d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa58c06e6b0 0x7fa58c15b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.064+0000 7fa593e4d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa58c15ec20 con 0x7fa58c0cf7a0 2024-04-25T02:12:08.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.064+0000 7fa593e4d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa58c15f830 con 0x7fa58c06e6b0 2024-04-25T02:12:08.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.064+0000 7fa593e4d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fa58c15ef00 con 0x7fa58c06b2f0 2024-04-25T02:12:08.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.064+0000 7fa5923ea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa58c06e6b0 0x7fa58c15b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.064+0000 7fa5923ea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa58c06e6b0 0x7fa58c15b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50210/0 (socket says 172.21.15.79:50210) 2024-04-25T02:12:08.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.064+0000 7fa5923ea640 1 -- 172.21.15.79:0/3316561764 learned_addr learned my addr 172.21.15.79:0/3316561764 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:08.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.064+0000 7fa591be9640 1 --2- 172.21.15.79:0/3316561764 >> v2:172.21.15.189:3300/0 conn(0x7fa58c06b2f0 0x7fa58c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.064+0000 7fa5923ea640 1 -- 172.21.15.79:0/3316561764 >> v2:172.21.15.189:3300/0 conn(0x7fa58c06b2f0 msgr2=0x7fa58c0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:08.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.064+0000 7fa5923ea640 1 --2- 172.21.15.79:0/3316561764 >> v2:172.21.15.189:3300/0 conn(0x7fa58c06b2f0 0x7fa58c0b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.065+0000 7fa5923ea640 1 -- 172.21.15.79:0/3316561764 >> v1:172.21.15.189:6789/0 conn(0x7fa58c0cf7a0 legacy=0x7fa58c06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:08.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.065+0000 7fa5923ea640 1 -- 172.21.15.79:0/3316561764 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c15f1e0 con 0x7fa58c06e6b0 2024-04-25T02:12:08.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.065+0000 7fa5923ea640 1 --2- 172.21.15.79:0/3316561764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa58c06e6b0 0x7fa58c15b2d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fa58c15f9b0 tx=0x7fa58402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a5ec281fd30c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:08.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.065+0000 7fa590be7640 1 -- 172.21.15.79:0/3316561764 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584036070 con 0x7fa58c06e6b0 2024-04-25T02:12:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.065+0000 7fa590be7640 1 -- 172.21.15.79:0/3316561764 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa584031600 con 0x7fa58c06e6b0 2024-04-25T02:12:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.065+0000 7fa590be7640 1 -- 172.21.15.79:0/3316561764 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5840319d0 con 0x7fa58c06e6b0 2024-04-25T02:12:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.066+0000 7fa593e4d640 1 -- 172.21.15.79:0/3316561764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa58c06e6b0 msgr2=0x7fa58c15b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.066+0000 7fa593e4d640 1 --2- 172.21.15.79:0/3316561764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa58c06e6b0 0x7fa58c15b2d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fa58c15f9b0 tx=0x7fa58402a6a0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.066+0000 7fa593e4d640 1 -- 172.21.15.79:0/3316561764 shutdown_connections 2024-04-25T02:12:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.066+0000 7fa593e4d640 1 --2- 172.21.15.79:0/3316561764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa58c06e6b0 0x7fa58c15b2d0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.066+0000 7fa593e4d640 1 --2- 172.21.15.79:0/3316561764 >> v2:172.21.15.189:3300/0 conn(0x7fa58c06b2f0 0x7fa58c0b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.066+0000 7fa593e4d640 1 -- 172.21.15.79:0/3316561764 >> 172.21.15.79:0/3316561764 conn(0x7fa58c0b1cd0 msgr2=0x7fa58c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.066+0000 7fa593e4d640 1 -- 172.21.15.79:0/3316561764 shutdown_connections 2024-04-25T02:12:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.066+0000 7fa593e4d640 1 -- 172.21.15.79:0/3316561764 wait complete. 2024-04-25T02:12:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.067+0000 7fa593e4d640 1 Processor -- start 2024-04-25T02:12:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.067+0000 7fa593e4d640 1 -- start start 2024-04-25T02:12:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa593e4d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa58c06b2f0 0x7fa58c154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa593e4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa58c06e6b0 0x7fa58c0cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa593e4d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa58c0cf7a0 0x7fa58c0d0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa593e4d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c06d160 con 0x7fa58c06e6b0 2024-04-25T02:12:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa593e4d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c06cfe0 con 0x7fa58c06b2f0 2024-04-25T02:12:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa593e4d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa58c15b810 con 0x7fa58c0cf7a0 2024-04-25T02:12:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa5913e8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa58c06e6b0 0x7fa58c0cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa5913e8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa58c06e6b0 0x7fa58c0cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50216/0 (socket says 172.21.15.79:50216) 2024-04-25T02:12:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa5913e8640 1 -- 172.21.15.79:0/2051467967 learned_addr learned my addr 172.21.15.79:0/2051467967 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa591be9640 1 --2- 172.21.15.79:0/2051467967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa58c06b2f0 0x7fa58c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa5923ea640 1 --2- 172.21.15.79:0/2051467967 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa58c0cf7a0 0x7fa58c0d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa5913e8640 1 -- 172.21.15.79:0/2051467967 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa58c0cf7a0 msgr2=0x7fa58c0d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa5913e8640 1 --2- 172.21.15.79:0/2051467967 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa58c0cf7a0 0x7fa58c0d0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa5913e8640 1 -- 172.21.15.79:0/2051467967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa58c06b2f0 msgr2=0x7fa58c154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa5913e8640 1 --2- 172.21.15.79:0/2051467967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa58c06b2f0 0x7fa58c154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.068+0000 7fa5913e8640 1 -- 172.21.15.79:0/2051467967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c09b2f0 con 0x7fa58c06e6b0 2024-04-25T02:12:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.069+0000 7fa5913e8640 1 --2- 172.21.15.79:0/2051467967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa58c06e6b0 0x7fa58c0cfc00 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00c3c0 tx=0x7fa57c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.069+0000 7fa5827fc640 1 -- 172.21.15.79:0/2051467967 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c0052d0 con 0x7fa58c06e6b0 2024-04-25T02:12:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.069+0000 7fa5827fc640 1 -- 172.21.15.79:0/2051467967 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa57c005490 con 0x7fa58c06e6b0 2024-04-25T02:12:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.069+0000 7fa593e4d640 1 -- 172.21.15.79:0/2051467967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58c0ae4d0 con 0x7fa58c06e6b0 2024-04-25T02:12:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.069+0000 7fa5827fc640 1 -- 172.21.15.79:0/2051467967 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c007260 con 0x7fa58c06e6b0 2024-04-25T02:12:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.069+0000 7fa593e4d640 1 -- 172.21.15.79:0/2051467967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa58c0aea90 con 0x7fa58c06e6b0 2024-04-25T02:12:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.070+0000 7fa593e4d640 1 -- 172.21.15.79:0/2051467967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa58c0690a0 con 0x7fa58c06e6b0 2024-04-25T02:12:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.070+0000 7fa5827fc640 1 -- 172.21.15.79:0/2051467967 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa57c007400 con 0x7fa58c06e6b0 2024-04-25T02:12:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.070+0000 7fa5827fc640 1 --2- 172.21.15.79:0/2051467967 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa57006be30 0x7fa57006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.071+0000 7fa5827fc640 1 -- 172.21.15.79:0/2051467967 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7fa57c08a2b0 con 0x7fa58c06e6b0 2024-04-25T02:12:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.071+0000 7fa591be9640 1 --2- 172.21.15.79:0/2051467967 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa57006be30 0x7fa57006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.071+0000 7fa591be9640 1 --2- 172.21.15.79:0/2051467967 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa57006be30 0x7fa57006e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa588006fd0 tx=0x7fa588008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:08.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.075+0000 7fa5827fc640 1 -- 172.21.15.79:0/2051467967 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa57c058cf0 con 0x7fa58c06e6b0 2024-04-25T02:12:08.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.250+0000 7fa593e4d640 1 -- 172.21.15.79:0/2051467967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa58c1574d0 con 0x7fa58c06e6b0 2024-04-25T02:12:08.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.250+0000 7fa5827fc640 1 -- 172.21.15.79:0/2051467967 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) ==== 100+0+11 (secure 0 0 0) 0x7fa57c0585f0 con 0x7fa58c06e6b0 2024-04-25T02:12:08.257 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:12:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.252+0000 7fa593e4d640 1 -- 172.21.15.79:0/2051467967 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa57006be30 msgr2=0x7fa57006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.252+0000 7fa593e4d640 1 --2- 172.21.15.79:0/2051467967 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa57006be30 0x7fa57006e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa588006fd0 tx=0x7fa588008040 comp rx=0 tx=0).stop 2024-04-25T02:12:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.252+0000 7fa593e4d640 1 -- 172.21.15.79:0/2051467967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa58c06e6b0 msgr2=0x7fa58c0cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.252+0000 7fa593e4d640 1 --2- 172.21.15.79:0/2051467967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa58c06e6b0 0x7fa58c0cfc00 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00c3c0 tx=0x7fa57c00c880 comp rx=0 tx=0).stop 2024-04-25T02:12:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.252+0000 7fa593e4d640 1 -- 172.21.15.79:0/2051467967 shutdown_connections 2024-04-25T02:12:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.252+0000 7fa593e4d640 1 --2- 172.21.15.79:0/2051467967 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa57006be30 0x7fa57006e2f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.252+0000 7fa593e4d640 1 --2- 172.21.15.79:0/2051467967 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa58c0cf7a0 0x7fa58c0d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.252+0000 7fa593e4d640 1 --2- 172.21.15.79:0/2051467967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa58c06e6b0 0x7fa58c0cfc00 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.252+0000 7fa593e4d640 1 --2- 172.21.15.79:0/2051467967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa58c06b2f0 0x7fa58c154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.252+0000 7fa593e4d640 1 -- 172.21.15.79:0/2051467967 >> 172.21.15.79:0/2051467967 conn(0x7fa58c0b1cd0 msgr2=0x7fa58c06b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.252+0000 7fa593e4d640 1 -- 172.21.15.79:0/2051467967 shutdown_connections 2024-04-25T02:12:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.252+0000 7fa593e4d640 1 -- 172.21.15.79:0/2051467967 wait complete. 2024-04-25T02:12:08.270 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:12:08.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.360+0000 7f560354f640 1 Processor -- start 2024-04-25T02:12:08.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.360+0000 7f560354f640 1 -- start start 2024-04-25T02:12:08.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.361+0000 7f560354f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55fc143bc0 0x7f55fc15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.361+0000 7f560354f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55fc06df50 0x7f55fc06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.361+0000 7f560354f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55fc15fa40 con 0x7f55fc0b48e0 2024-04-25T02:12:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.361+0000 7f560354f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f55fc06e8f0 con 0x7f55fc06df50 2024-04-25T02:12:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.361+0000 7f560354f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f55fc072cb0 con 0x7f55fc143bc0 2024-04-25T02:12:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.361+0000 7f5600aea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55fc06df50 0x7f55fc06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.361+0000 7f5600aea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55fc06df50 0x7f55fc06e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50228/0 (socket says 172.21.15.79:50228) 2024-04-25T02:12:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.361+0000 7f5600aea640 1 -- 172.21.15.79:0/755561502 learned_addr learned my addr 172.21.15.79:0/755561502 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.361+0000 7f5600aea640 1 -- 172.21.15.79:0/755561502 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55fc143bc0 msgr2=0x7f55fc15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.361+0000 7f5600aea640 1 --2- 172.21.15.79:0/755561502 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55fc143bc0 0x7f55fc15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.361+0000 7f5600aea640 1 -- 172.21.15.79:0/755561502 >> v1:172.21.15.189:6789/0 conn(0x7f55fc0b48e0 legacy=0x7f55fc0b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.361+0000 7f5600aea640 1 -- 172.21.15.79:0/755561502 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55fc0720a0 con 0x7f55fc06df50 2024-04-25T02:12:08.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.362+0000 7f5600aea640 1 --2- 172.21.15.79:0/755561502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc06df50 0x7f55fc06e3b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009870 tx=0x7f55ec02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b349f27caa8ddb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:08.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.362+0000 7f55f3fff640 1 -- 172.21.15.79:0/755561502 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec037070 con 0x7f55fc06df50 2024-04-25T02:12:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.362+0000 7f55f3fff640 1 -- 172.21.15.79:0/755561502 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55ec032440 con 0x7f55fc06df50 2024-04-25T02:12:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.362+0000 7f55f3fff640 1 -- 172.21.15.79:0/755561502 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec032810 con 0x7f55fc06df50 2024-04-25T02:12:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.363+0000 7f560354f640 1 -- 172.21.15.79:0/755561502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc06df50 msgr2=0x7f55fc06e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.363+0000 7f560354f640 1 --2- 172.21.15.79:0/755561502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc06df50 0x7f55fc06e3b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009870 tx=0x7f55ec02a180 comp rx=0 tx=0).stop 2024-04-25T02:12:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.363+0000 7f560354f640 1 -- 172.21.15.79:0/755561502 shutdown_connections 2024-04-25T02:12:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.363+0000 7f560354f640 1 --2- 172.21.15.79:0/755561502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc06df50 0x7f55fc06e3b0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.363+0000 7f560354f640 1 --2- 172.21.15.79:0/755561502 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55fc143bc0 0x7f55fc15f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.363+0000 7f560354f640 1 -- 172.21.15.79:0/755561502 >> 172.21.15.79:0/755561502 conn(0x7f55fc0cfc80 msgr2=0x7f55fc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.363+0000 7f560354f640 1 -- 172.21.15.79:0/755561502 shutdown_connections 2024-04-25T02:12:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.363+0000 7f560354f640 1 -- 172.21.15.79:0/755561502 wait complete. 2024-04-25T02:12:08.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.364+0000 7f560354f640 1 Processor -- start 2024-04-25T02:12:08.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.364+0000 7f560354f640 1 -- start start 2024-04-25T02:12:08.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f560354f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55fc06df50 0x7f55fc13a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f560354f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55fc0b48e0 0x7f55fc15dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f560354f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc143bc0 0x7f55fc142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f560354f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc072940 con 0x7f55fc143bc0 2024-04-25T02:12:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f560354f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc072660 con 0x7f55fc06df50 2024-04-25T02:12:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f560354f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f55fc143fa0 con 0x7f55fc0b48e0 2024-04-25T02:12:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f5601aec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc143bc0 0x7f55fc142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f5601aec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc143bc0 0x7f55fc142130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50242/0 (socket says 172.21.15.79:50242) 2024-04-25T02:12:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f5601aec640 1 -- 172.21.15.79:0/3534033528 learned_addr learned my addr 172.21.15.79:0/3534033528 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f5600aea640 1 --2- 172.21.15.79:0/3534033528 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55fc0b48e0 0x7f55fc15dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f56012eb640 1 --2- 172.21.15.79:0/3534033528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55fc06df50 0x7f55fc13a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f5601aec640 1 -- 172.21.15.79:0/3534033528 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55fc0b48e0 msgr2=0x7f55fc15dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f5601aec640 1 --2- 172.21.15.79:0/3534033528 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55fc0b48e0 0x7f55fc15dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f5601aec640 1 -- 172.21.15.79:0/3534033528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55fc06df50 msgr2=0x7f55fc13a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f5601aec640 1 --2- 172.21.15.79:0/3534033528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55fc06df50 0x7f55fc13a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f5601aec640 1 -- 172.21.15.79:0/3534033528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55fc13ac90 con 0x7f55fc143bc0 2024-04-25T02:12:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f5601aec640 1 --2- 172.21.15.79:0/3534033528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc143bc0 0x7f55fc142130 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f55f400c3c0 tx=0x7f55f400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f55f1ffb640 1 -- 172.21.15.79:0/3534033528 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4017070 con 0x7f55fc143bc0 2024-04-25T02:12:08.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f55f1ffb640 1 -- 172.21.15.79:0/3534033528 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f40035f0 con 0x7f55fc143bc0 2024-04-25T02:12:08.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f55f1ffb640 1 -- 172.21.15.79:0/3534033528 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f40039e0 con 0x7f55fc143bc0 2024-04-25T02:12:08.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.365+0000 7f560354f640 1 -- 172.21.15.79:0/3534033528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55fc13fc00 con 0x7f55fc143bc0 2024-04-25T02:12:08.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.366+0000 7f560354f640 1 -- 172.21.15.79:0/3534033528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55fc1401c0 con 0x7f55fc143bc0 2024-04-25T02:12:08.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.366+0000 7f560354f640 1 -- 172.21.15.79:0/3534033528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55fc0690a0 con 0x7f55fc143bc0 2024-04-25T02:12:08.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.367+0000 7f55f1ffb640 1 -- 172.21.15.79:0/3534033528 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55f401a070 con 0x7f55fc143bc0 2024-04-25T02:12:08.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.367+0000 7f55f1ffb640 1 --2- 172.21.15.79:0/3534033528 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f55e006be30 0x7f55e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.367+0000 7f55f1ffb640 1 -- 172.21.15.79:0/3534033528 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f55f408a170 con 0x7f55fc143bc0 2024-04-25T02:12:08.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.367+0000 7f56012eb640 1 --2- 172.21.15.79:0/3534033528 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f55e006be30 0x7f55e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.368+0000 7f56012eb640 1 --2- 172.21.15.79:0/3534033528 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f55e006be30 0x7f55e006e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f55f8007dc0 tx=0x7f55f80072f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:08.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.371+0000 7f55f1ffb640 1 -- 172.21.15.79:0/3534033528 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f55fc13ac90 con 0x7f55fc143bc0 2024-04-25T02:12:08.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.555+0000 7f560354f640 1 -- 172.21.15.79:0/3534033528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f55fc0b2ca0 con 0x7f55fc143bc0 2024-04-25T02:12:08.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.556+0000 7f55f1ffb640 1 -- 172.21.15.79:0/3534033528 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) ==== 80+0+0 (secure 0 0 0) 0x7f55f4058bb0 con 0x7f55fc143bc0 2024-04-25T02:12:08.563 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-04-25T02:12:08.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.558+0000 7f560354f640 1 -- 172.21.15.79:0/3534033528 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f55e006be30 msgr2=0x7f55e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:08.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.558+0000 7f560354f640 1 --2- 172.21.15.79:0/3534033528 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f55e006be30 0x7f55e006e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f55f8007dc0 tx=0x7f55f80072f0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.558+0000 7f560354f640 1 -- 172.21.15.79:0/3534033528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc143bc0 msgr2=0x7f55fc142130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:08.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.558+0000 7f560354f640 1 --2- 172.21.15.79:0/3534033528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc143bc0 0x7f55fc142130 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f55f400c3c0 tx=0x7f55f400c880 comp rx=0 tx=0).stop 2024-04-25T02:12:08.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.558+0000 7f560354f640 1 -- 172.21.15.79:0/3534033528 shutdown_connections 2024-04-25T02:12:08.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.558+0000 7f560354f640 1 --2- 172.21.15.79:0/3534033528 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f55e006be30 0x7f55e006e2f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.558+0000 7f560354f640 1 --2- 172.21.15.79:0/3534033528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc143bc0 0x7f55fc142130 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.558+0000 7f560354f640 1 --2- 172.21.15.79:0/3534033528 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f55fc0b48e0 0x7f55fc15dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.558+0000 7f560354f640 1 --2- 172.21.15.79:0/3534033528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55fc06df50 0x7f55fc13a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.558+0000 7f560354f640 1 -- 172.21.15.79:0/3534033528 >> 172.21.15.79:0/3534033528 conn(0x7f55fc0cfc80 msgr2=0x7f55fc06cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:08.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.558+0000 7f560354f640 1 -- 172.21.15.79:0/3534033528 shutdown_connections 2024-04-25T02:12:08.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.558+0000 7f560354f640 1 -- 172.21.15.79:0/3534033528 wait complete. 2024-04-25T02:12:08.575 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:12:08.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:08.576 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:08.633 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:12:08.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:08.634 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:12:08.650 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:12:08.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.779+0000 7f29e5cee640 1 Processor -- start 2024-04-25T02:12:08.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.779+0000 7f29e5cee640 1 -- start start 2024-04-25T02:12:08.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.780+0000 7f29e5cee640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f29e015a720 0x7f29e015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.780+0000 7f29e5cee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29e00b49b0 0x7f29e0070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.780+0000 7f29e5cee640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e015f1c0 con 0x7f29e00d07a0 2024-04-25T02:12:08.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.780+0000 7f29e5cee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f29e015bb10 con 0x7f29e00b49b0 2024-04-25T02:12:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.780+0000 7f29e5cee640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f29e00b2e60 con 0x7f29e015a720 2024-04-25T02:12:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.780+0000 7f29dffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29e00b49b0 0x7f29e0070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.780+0000 7f29dffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29e00b49b0 0x7f29e0070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50244/0 (socket says 172.21.15.79:50244) 2024-04-25T02:12:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.780+0000 7f29dffff640 1 -- 172.21.15.79:0/3434482544 learned_addr learned my addr 172.21.15.79:0/3434482544 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.780+0000 7f29df7fe640 1 --2- 172.21.15.79:0/3434482544 >> v2:172.21.15.189:3300/0 conn(0x7f29e015a720 0x7f29e015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.780+0000 7f29dffff640 1 -- 172.21.15.79:0/3434482544 >> v2:172.21.15.189:3300/0 conn(0x7f29e015a720 msgr2=0x7f29e015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.780+0000 7f29dffff640 1 --2- 172.21.15.79:0/3434482544 >> v2:172.21.15.189:3300/0 conn(0x7f29e015a720 0x7f29e015ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.780+0000 7f29dffff640 1 -- 172.21.15.79:0/3434482544 >> v1:172.21.15.189:6789/0 conn(0x7f29e00d07a0 legacy=0x7f29e00b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.781+0000 7f29dffff640 1 -- 172.21.15.79:0/3434482544 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e00b3140 con 0x7f29e00b49b0 2024-04-25T02:12:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.781+0000 7f29dffff640 1 --2- 172.21.15.79:0/3434482544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00b49b0 0x7f29e0070cf0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f29e0074d80 tx=0x7f29d802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f661c6e2410d33d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.781+0000 7f29deffd640 1 -- 172.21.15.79:0/3434482544 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8036070 con 0x7f29e00b49b0 2024-04-25T02:12:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.781+0000 7f29deffd640 1 -- 172.21.15.79:0/3434482544 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d8031600 con 0x7f29e00b49b0 2024-04-25T02:12:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.781+0000 7f29deffd640 1 -- 172.21.15.79:0/3434482544 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d80319d0 con 0x7f29e00b49b0 2024-04-25T02:12:08.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.782+0000 7f29e5cee640 1 -- 172.21.15.79:0/3434482544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00b49b0 msgr2=0x7f29e0070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:08.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.782+0000 7f29e5cee640 1 --2- 172.21.15.79:0/3434482544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00b49b0 0x7f29e0070cf0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f29e0074d80 tx=0x7f29d802a6a0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.782+0000 7f29e5cee640 1 -- 172.21.15.79:0/3434482544 shutdown_connections 2024-04-25T02:12:08.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.782+0000 7f29e5cee640 1 --2- 172.21.15.79:0/3434482544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00b49b0 0x7f29e0070cf0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.782+0000 7f29e5cee640 1 --2- 172.21.15.79:0/3434482544 >> v2:172.21.15.189:3300/0 conn(0x7f29e015a720 0x7f29e015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.782+0000 7f29e5cee640 1 -- 172.21.15.79:0/3434482544 >> 172.21.15.79:0/3434482544 conn(0x7f29e00cfc80 msgr2=0x7f29e00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.782+0000 7f29e5cee640 1 -- 172.21.15.79:0/3434482544 shutdown_connections 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.782+0000 7f29e5cee640 1 -- 172.21.15.79:0/3434482544 wait complete. 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.783+0000 7f29e5cee640 1 Processor -- start 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.783+0000 7f29e5cee640 1 -- start start 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29e5cee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00b49b0 0x7f29e0155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29e5cee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e00d07a0 0x7f29e01f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29e5cee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f29e015a720 0x7f29e01f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29e5cee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29e00b39e0 con 0x7f29e00b49b0 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29e5cee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f29e00b3700 con 0x7f29e00d07a0 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29e5cee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f29e0071230 con 0x7f29e015a720 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29df7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00b49b0 0x7f29e0155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29df7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00b49b0 0x7f29e0155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50256/0 (socket says 172.21.15.79:50256) 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29df7fe640 1 -- 172.21.15.79:0/1452309177 learned_addr learned my addr 172.21.15.79:0/1452309177 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29d7fff640 1 --2- 172.21.15.79:0/1452309177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e00d07a0 0x7f29e01f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29dffff640 1 --2- 172.21.15.79:0/1452309177 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f29e015a720 0x7f29e01f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29df7fe640 1 -- 172.21.15.79:0/1452309177 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f29e015a720 msgr2=0x7f29e01f1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29df7fe640 1 --2- 172.21.15.79:0/1452309177 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f29e015a720 0x7f29e01f1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29df7fe640 1 -- 172.21.15.79:0/1452309177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e00d07a0 msgr2=0x7f29e01f16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29df7fe640 1 --2- 172.21.15.79:0/1452309177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e00d07a0 0x7f29e01f16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29df7fe640 1 -- 172.21.15.79:0/1452309177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e013d450 con 0x7f29e00b49b0 2024-04-25T02:12:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29df7fe640 1 --2- 172.21.15.79:0/1452309177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00b49b0 0x7f29e0155b80 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f29d000d5f0 tx=0x7f29d000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29dcff9640 1 -- 172.21.15.79:0/1452309177 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d00125f0 con 0x7f29e00b49b0 2024-04-25T02:12:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29dcff9640 1 -- 172.21.15.79:0/1452309177 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d0019070 con 0x7f29e00b49b0 2024-04-25T02:12:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29dcff9640 1 -- 172.21.15.79:0/1452309177 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d00129d0 con 0x7f29e00b49b0 2024-04-25T02:12:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.784+0000 7f29e5cee640 1 -- 172.21.15.79:0/1452309177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e013f7c0 con 0x7f29e00b49b0 2024-04-25T02:12:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.785+0000 7f29e5cee640 1 -- 172.21.15.79:0/1452309177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e013fd80 con 0x7f29e00b49b0 2024-04-25T02:12:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.786+0000 7f29e5cee640 1 -- 172.21.15.79:0/1452309177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e01404c0 con 0x7f29e00b49b0 2024-04-25T02:12:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.786+0000 7f29dcff9640 1 -- 172.21.15.79:0/1452309177 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29d0012b70 con 0x7f29e00b49b0 2024-04-25T02:12:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.786+0000 7f29dcff9640 1 --2- 172.21.15.79:0/1452309177 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f29c006be30 0x7f29c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.786+0000 7f29dcff9640 1 -- 172.21.15.79:0/1452309177 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f29d008b270 con 0x7f29e00b49b0 2024-04-25T02:12:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.786+0000 7f29d7fff640 1 --2- 172.21.15.79:0/1452309177 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f29c006be30 0x7f29c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.787+0000 7f29d7fff640 1 --2- 172.21.15.79:0/1452309177 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f29c006be30 0x7f29c006e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f29e014f7d0 tx=0x7f29c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:08.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:08.791+0000 7f29dcff9640 1 -- 172.21.15.79:0/1452309177 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f29e013d450 con 0x7f29e00b49b0 2024-04-25T02:12:09.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.000+0000 7f29e5cee640 1 -- 172.21.15.79:0/1452309177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29e00690a0 con 0x7f29e00b49b0 2024-04-25T02:12:09.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.000+0000 7f29dcff9640 1 -- 172.21.15.79:0/1452309177 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5180 (secure 0 0 0) 0x7f29d0059c20 con 0x7f29e00b49b0 2024-04-25T02:12:09.007 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:12:09.007 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":32,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/596307304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":596307304},{"type":"v1","addr":"172.21.15.189:6834","nonce":596307304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2550610051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550610051},{"type":"v1","addr":"172.21.15.79:6836","nonce":2550610051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6696,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/782013262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":782013262},{"type":"v1","addr":"172.21.15.79:6837","nonce":782013262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:11:55.951694+0000","modified":"2024-04-25T02:11:57.954401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6708":{"gid":6708,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6835/469348969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":469348969},{"type":"v1","addr":"172.21.15.189:6835","nonce":469348969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6708,"qdb_cluster":[6708]},"id":5}]} 2024-04-25T02:12:09.008 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 32 2024-04-25T02:12:09.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.002+0000 7f29e5cee640 1 -- 172.21.15.79:0/1452309177 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f29c006be30 msgr2=0x7f29c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.002+0000 7f29e5cee640 1 --2- 172.21.15.79:0/1452309177 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f29c006be30 0x7f29c006e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f29e014f7d0 tx=0x7f29c8009040 comp rx=0 tx=0).stop 2024-04-25T02:12:09.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.002+0000 7f29e5cee640 1 -- 172.21.15.79:0/1452309177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00b49b0 msgr2=0x7f29e0155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.002+0000 7f29e5cee640 1 --2- 172.21.15.79:0/1452309177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00b49b0 0x7f29e0155b80 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f29d000d5f0 tx=0x7f29d000dab0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.002+0000 7f29e5cee640 1 -- 172.21.15.79:0/1452309177 shutdown_connections 2024-04-25T02:12:09.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.002+0000 7f29e5cee640 1 --2- 172.21.15.79:0/1452309177 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f29c006be30 0x7f29c006e2f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.002+0000 7f29e5cee640 1 --2- 172.21.15.79:0/1452309177 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f29e015a720 0x7f29e01f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.002+0000 7f29e5cee640 1 --2- 172.21.15.79:0/1452309177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e00d07a0 0x7f29e01f16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.002+0000 7f29e5cee640 1 --2- 172.21.15.79:0/1452309177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e00b49b0 0x7f29e0155b80 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.002+0000 7f29e5cee640 1 -- 172.21.15.79:0/1452309177 >> 172.21.15.79:0/1452309177 conn(0x7f29e00cfc80 msgr2=0x7f29e00b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:09.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.002+0000 7f29e5cee640 1 -- 172.21.15.79:0/1452309177 shutdown_connections 2024-04-25T02:12:09.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.002+0000 7f29e5cee640 1 -- 172.21.15.79:0/1452309177 wait complete. 2024-04-25T02:12:09.020 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-04-25T02:12:09.154 INFO:teuthology.orchestra.run.smithi189.stdout:{"message":"","return_code":0} 2024-04-25T02:12:09.155 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T02:12:09.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:12:09.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.246+0000 7f21679e9640 1 Processor -- start 2024-04-25T02:12:09.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.246+0000 7f21679e9640 1 -- start start 2024-04-25T02:12:09.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f21679e9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2160143bc0 0x7f216015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f21679e9640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f216006df50 0x7f216006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f21679e9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21600b48e0 0x7f21600b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f21679e9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f216006e8f0 con 0x7f21600b48e0 2024-04-25T02:12:09.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f21679e9640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f2160072cb0 con 0x7f216006df50 2024-04-25T02:12:09.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f21679e9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f216015fa40 con 0x7f2160143bc0 2024-04-25T02:12:09.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f2165f86640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21600b48e0 0x7f21600b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f2165f86640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21600b48e0 0x7f21600b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50262/0 (socket says 172.21.15.79:50262) 2024-04-25T02:12:09.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f2165f86640 1 -- 172.21.15.79:0/1714548052 learned_addr learned my addr 172.21.15.79:0/1714548052 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:09.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f2164f84640 1 --2- 172.21.15.79:0/1714548052 >> v2:172.21.15.189:3300/0 conn(0x7f216006df50 0x7f216006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f2165f86640 1 -- 172.21.15.79:0/1714548052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2160143bc0 msgr2=0x7f216015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:09.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f2165785640 1 --2- 172.21.15.79:0/1714548052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2160143bc0 0x7f216015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f2165f86640 1 --2- 172.21.15.79:0/1714548052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2160143bc0 0x7f216015f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f2165f86640 1 -- 172.21.15.79:0/1714548052 >> v2:172.21.15.189:3300/0 conn(0x7f216006df50 msgr2=0x7f216006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:09.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f2165f86640 1 --2- 172.21.15.79:0/1714548052 >> v2:172.21.15.189:3300/0 conn(0x7f216006df50 0x7f216006e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.247+0000 7f2165f86640 1 -- 172.21.15.79:0/1714548052 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2160071e00 con 0x7f21600b48e0 2024-04-25T02:12:09.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.248+0000 7f2165f86640 1 --2- 172.21.15.79:0/1714548052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21600b48e0 0x7f21600b4d40 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f21600b2a80 tx=0x7f215802c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58020f2e7e5e8fd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.248+0000 7f2157fff640 1 -- 172.21.15.79:0/1714548052 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2158032700 con 0x7f21600b48e0 2024-04-25T02:12:09.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.248+0000 7f2157fff640 1 -- 172.21.15.79:0/1714548052 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21580328a0 con 0x7f21600b48e0 2024-04-25T02:12:09.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.248+0000 7f2157fff640 1 -- 172.21.15.79:0/1714548052 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2158032c70 con 0x7f21600b48e0 2024-04-25T02:12:09.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.249+0000 7f21679e9640 1 -- 172.21.15.79:0/1714548052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21600b48e0 msgr2=0x7f21600b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.249+0000 7f21679e9640 1 --2- 172.21.15.79:0/1714548052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21600b48e0 0x7f21600b4d40 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f21600b2a80 tx=0x7f215802c800 comp rx=0 tx=0).stop 2024-04-25T02:12:09.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.249+0000 7f21679e9640 1 -- 172.21.15.79:0/1714548052 shutdown_connections 2024-04-25T02:12:09.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.249+0000 7f21679e9640 1 --2- 172.21.15.79:0/1714548052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21600b48e0 0x7f21600b4d40 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.249+0000 7f21679e9640 1 --2- 172.21.15.79:0/1714548052 >> v2:172.21.15.189:3300/0 conn(0x7f216006df50 0x7f216006e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.249+0000 7f21679e9640 1 --2- 172.21.15.79:0/1714548052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2160143bc0 0x7f216015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.249+0000 7f21679e9640 1 -- 172.21.15.79:0/1714548052 >> 172.21.15.79:0/1714548052 conn(0x7f21600cfc80 msgr2=0x7f21600d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:09.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.249+0000 7f21679e9640 1 -- 172.21.15.79:0/1714548052 shutdown_connections 2024-04-25T02:12:09.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.249+0000 7f21679e9640 1 -- 172.21.15.79:0/1714548052 wait complete. 2024-04-25T02:12:09.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.250+0000 7f21679e9640 1 Processor -- start 2024-04-25T02:12:09.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.250+0000 7f21679e9640 1 -- start start 2024-04-25T02:12:09.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f21679e9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f216006df50 0x7f216013fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f21679e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21600b48e0 0x7f21600aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f21679e9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2160143bc0 0x7f21601414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f21679e9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2160072660 con 0x7f21600b48e0 2024-04-25T02:12:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f21679e9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2160072380 con 0x7f2160143bc0 2024-04-25T02:12:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f21679e9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2160072940 con 0x7f216006df50 2024-04-25T02:12:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f2164f84640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21600b48e0 0x7f21600aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f2164f84640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21600b48e0 0x7f21600aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50272/0 (socket says 172.21.15.79:50272) 2024-04-25T02:12:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f2164f84640 1 -- 172.21.15.79:0/3734723052 learned_addr learned my addr 172.21.15.79:0/3734723052 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f2165f86640 1 --2- 172.21.15.79:0/3734723052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2160143bc0 0x7f21601414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f2165785640 1 --2- 172.21.15.79:0/3734723052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f216006df50 0x7f216013fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f2164f84640 1 -- 172.21.15.79:0/3734723052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f216006df50 msgr2=0x7f216013fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f2164f84640 1 --2- 172.21.15.79:0/3734723052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f216006df50 0x7f216013fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f2164f84640 1 -- 172.21.15.79:0/3734723052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2160143bc0 msgr2=0x7f21601414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f2164f84640 1 --2- 172.21.15.79:0/3734723052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2160143bc0 0x7f21601414d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f2164f84640 1 -- 172.21.15.79:0/3734723052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2160140430 con 0x7f21600b48e0 2024-04-25T02:12:09.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f2164f84640 1 --2- 172.21.15.79:0/3734723052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21600b48e0 0x7f21600aee80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f215000c570 tx=0x7f215000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f2155ffb640 1 -- 172.21.15.79:0/3734723052 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150015070 con 0x7f21600b48e0 2024-04-25T02:12:09.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.251+0000 7f2155ffb640 1 -- 172.21.15.79:0/3734723052 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2150011800 con 0x7f21600b48e0 2024-04-25T02:12:09.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.252+0000 7f2155ffb640 1 -- 172.21.15.79:0/3734723052 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150011bf0 con 0x7f21600b48e0 2024-04-25T02:12:09.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.252+0000 7f21679e9640 1 -- 172.21.15.79:0/3734723052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2160140710 con 0x7f21600b48e0 2024-04-25T02:12:09.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.252+0000 7f21679e9640 1 -- 172.21.15.79:0/3734723052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2160140cd0 con 0x7f21600b48e0 2024-04-25T02:12:09.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.253+0000 7f21679e9640 1 -- 172.21.15.79:0/3734723052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21600690a0 con 0x7f21600b48e0 2024-04-25T02:12:09.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.253+0000 7f2155ffb640 1 -- 172.21.15.79:0/3734723052 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2150018070 con 0x7f21600b48e0 2024-04-25T02:12:09.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.253+0000 7f2155ffb640 1 --2- 172.21.15.79:0/3734723052 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f214406be60 0x7f214406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.254+0000 7f2165785640 1 --2- 172.21.15.79:0/3734723052 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f214406be60 0x7f214406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.254+0000 7f2155ffb640 1 -- 172.21.15.79:0/3734723052 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f215008ac30 con 0x7f21600b48e0 2024-04-25T02:12:09.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.254+0000 7f2165785640 1 --2- 172.21.15.79:0/3734723052 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f214406be60 0x7f214406e320 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f215c00f510 tx=0x7f215c0077b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.258+0000 7f2155ffb640 1 -- 172.21.15.79:0/3734723052 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2150058f00 con 0x7f21600b48e0 2024-04-25T02:12:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.470+0000 7f21679e9640 1 -- 172.21.15.79:0/3734723052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f216006dd30 con 0x7f21600b48e0 2024-04-25T02:12:09.477 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:12:09.470+0000 7fb0c50c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:12:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.472+0000 7f2155ffb640 1 -- 172.21.15.79:0/3734723052 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) ==== 161+0+0 (secure 0 0 0) 0x7f215005d200 con 0x7f21600b48e0 2024-04-25T02:12:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:12:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.474+0000 7f21679e9640 1 -- 172.21.15.79:0/3734723052 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f214406be60 msgr2=0x7f214406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.474+0000 7f21679e9640 1 --2- 172.21.15.79:0/3734723052 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f214406be60 0x7f214406e320 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f215c00f510 tx=0x7f215c0077b0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.474+0000 7f21679e9640 1 -- 172.21.15.79:0/3734723052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21600b48e0 msgr2=0x7f21600aee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.474+0000 7f21679e9640 1 --2- 172.21.15.79:0/3734723052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21600b48e0 0x7f21600aee80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f215000c570 tx=0x7f215000ca30 comp rx=0 tx=0).stop 2024-04-25T02:12:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.474+0000 7f21679e9640 1 -- 172.21.15.79:0/3734723052 shutdown_connections 2024-04-25T02:12:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.474+0000 7f21679e9640 1 --2- 172.21.15.79:0/3734723052 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f214406be60 0x7f214406e320 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.474+0000 7f21679e9640 1 --2- 172.21.15.79:0/3734723052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2160143bc0 0x7f21601414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.474+0000 7f21679e9640 1 --2- 172.21.15.79:0/3734723052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21600b48e0 0x7f21600aee80 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.474+0000 7f21679e9640 1 --2- 172.21.15.79:0/3734723052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f216006df50 0x7f216013fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.474+0000 7f21679e9640 1 -- 172.21.15.79:0/3734723052 >> 172.21.15.79:0/3734723052 conn(0x7f21600cfc80 msgr2=0x7f21600b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.474+0000 7f21679e9640 1 -- 172.21.15.79:0/3734723052 shutdown_connections 2024-04-25T02:12:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.474+0000 7f21679e9640 1 -- 172.21.15.79:0/3734723052 wait complete. 2024-04-25T02:12:09.483 INFO:tasks.ceph.mds.d.smithi189.stderr: -3328> 2024-04-25T02:12:01.875+0000 7f16a3a32640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:12:09.492 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-25T02:12:09.512 INFO:tasks.ceph.mds.d.smithi189.stdout:starting mds.d at 2024-04-25T02:12:09.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.527+0000 7f5e00f40f40 1 Processor -- start 2024-04-25T02:12:09.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.528+0000 7f5e00f40f40 1 -- start start 2024-04-25T02:12:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.528+0000 7f5e00f40f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a810fa070 0x563a810f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.528+0000 7f5e00f40f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a8110ef80 0x563a81082f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.528+0000 7f5e00f40f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a81115240 0x563a81083440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.528+0000 7f5e00f40f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563a81115f50 con 0x563a810fa070 2024-04-25T02:12:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.528+0000 7f5e00f40f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563a80fe4640 con 0x563a8110ef80 2024-04-25T02:12:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.528+0000 7f5e00f40f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x563a810fa9c0 con 0x563a81115240 2024-04-25T02:12:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.528+0000 7f5dfea43640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a810fa070 0x563a810f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.528+0000 7f5dfea43640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a810fa070 0x563a810f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50288/0 (socket says 172.21.15.79:50288) 2024-04-25T02:12:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.528+0000 7f5dfea43640 1 -- 172.21.15.79:0/962039014 learned_addr learned my addr 172.21.15.79:0/962039014 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.528+0000 7f5dfea43640 1 -- 172.21.15.79:0/962039014 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a81115240 msgr2=0x563a81083440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.528+0000 7f5dfea43640 1 --2- 172.21.15.79:0/962039014 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a81115240 0x563a81083440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.528+0000 7f5dfea43640 1 -- 172.21.15.79:0/962039014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a8110ef80 msgr2=0x563a81082f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.528+0000 7f5dfea43640 1 --2- 172.21.15.79:0/962039014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a8110ef80 0x563a81082f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.528+0000 7f5dfea43640 1 -- 172.21.15.79:0/962039014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a810f5be0 con 0x563a810fa070 2024-04-25T02:12:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.529+0000 7f5dfea43640 1 --2- 172.21.15.79:0/962039014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a810fa070 0x563a810f56a0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f5df0001e60 tx=0x7f5df000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95779b0b6913969 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.529+0000 7f5dfd240640 1 -- 172.21.15.79:0/962039014 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0012020 con 0x563a810fa070 2024-04-25T02:12:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.529+0000 7f5dfd240640 1 -- 172.21.15.79:0/962039014 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df000e670 con 0x563a810fa070 2024-04-25T02:12:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.529+0000 7f5dfd240640 1 -- 172.21.15.79:0/962039014 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df000eaa0 con 0x563a810fa070 2024-04-25T02:12:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.529+0000 7f5e00f40f40 1 -- 172.21.15.79:0/962039014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a810fa070 msgr2=0x563a810f56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.529+0000 7f5e00f40f40 1 --2- 172.21.15.79:0/962039014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a810fa070 0x563a810f56a0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f5df0001e60 tx=0x7f5df000b780 comp rx=0 tx=0).stop 2024-04-25T02:12:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.529+0000 7f5e00f40f40 1 -- 172.21.15.79:0/962039014 shutdown_connections 2024-04-25T02:12:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.529+0000 7f5e00f40f40 1 --2- 172.21.15.79:0/962039014 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a81115240 0x563a81083440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.529+0000 7f5e00f40f40 1 --2- 172.21.15.79:0/962039014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a8110ef80 0x563a81082f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.529+0000 7f5e00f40f40 1 --2- 172.21.15.79:0/962039014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a810fa070 0x563a810f56a0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.529+0000 7f5e00f40f40 1 -- 172.21.15.79:0/962039014 >> 172.21.15.79:0/962039014 conn(0x563a81069920 msgr2=0x563a8106c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.529+0000 7f5e00f40f40 1 -- 172.21.15.79:0/962039014 shutdown_connections 2024-04-25T02:12:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.529+0000 7f5e00f40f40 1 -- 172.21.15.79:0/962039014 wait complete. 2024-04-25T02:12:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.530+0000 7f5e00f40f40 1 Processor -- start 2024-04-25T02:12:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.530+0000 7f5e00f40f40 1 -- start start 2024-04-25T02:12:09.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5e00f40f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a810fa070 0x563a810f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5e00f40f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a8110ef80 0x563a81111f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5e00f40f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a81115240 0x563a81111250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5e00f40f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563a8103f910 con 0x563a81115240 2024-04-25T02:12:09.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5e00f40f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563a810f7350 con 0x563a8110ef80 2024-04-25T02:12:09.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5e00f40f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x563a8106a030 con 0x563a810fa070 2024-04-25T02:12:09.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5dff244640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a81115240 0x563a81111250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5dff244640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a81115240 0x563a81111250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50302/0 (socket says 172.21.15.79:50302) 2024-04-25T02:12:09.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5dff244640 1 -- 172.21.15.79:0/2823496244 learned_addr learned my addr 172.21.15.79:0/2823496244 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:09.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5dfea43640 1 --2- 172.21.15.79:0/2823496244 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a810fa070 0x563a810f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5dfe242640 1 --2- 172.21.15.79:0/2823496244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a8110ef80 0x563a81111f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5dff244640 1 -- 172.21.15.79:0/2823496244 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a810fa070 msgr2=0x563a810f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5dff244640 1 --2- 172.21.15.79:0/2823496244 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a810fa070 0x563a810f4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5dff244640 1 -- 172.21.15.79:0/2823496244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a8110ef80 msgr2=0x563a81111f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5dff244640 1 --2- 172.21.15.79:0/2823496244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a8110ef80 0x563a81111f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5dff244640 1 -- 172.21.15.79:0/2823496244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a81112440 con 0x563a81115240 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5dff244640 1 --2- 172.21.15.79:0/2823496244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a81115240 0x563a81111250 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f5df800d450 tx=0x7f5df800d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5de7fff640 1 -- 172.21.15.79:0/2823496244 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df8016020 con 0x563a81115240 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5de7fff640 1 -- 172.21.15.79:0/2823496244 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df8012680 con 0x563a81115240 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5de7fff640 1 -- 172.21.15.79:0/2823496244 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df8012a70 con 0x563a81115240 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5e00f40f40 1 -- 172.21.15.79:0/2823496244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a81083c00 con 0x563a81115240 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.531+0000 7f5e00f40f40 1 -- 172.21.15.79:0/2823496244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a81112bc0 con 0x563a81115240 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.533+0000 7f5de7fff640 1 -- 172.21.15.79:0/2823496244 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5df8019020 con 0x563a81115240 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.533+0000 7f5de7fff640 1 --2- 172.21.15.79:0/2823496244 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5dec06a810 0x7f5dec06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.533+0000 7f5de7fff640 1 -- 172.21.15.79:0/2823496244 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7f5df8089a10 con 0x563a81115240 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.533+0000 7f5dfea43640 1 --2- 172.21.15.79:0/2823496244 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5dec06a810 0x7f5dec06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.533+0000 7f5e00f40f40 1 --2- 172.21.15.79:0/2823496244 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x563a81111790 0x563a81068250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.533+0000 7f5e00f40f40 1 -- 172.21.15.79:0/2823496244 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72) -- 0x563a81114670 con 0x563a81111790 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.533+0000 7f5dfea43640 1 --2- 172.21.15.79:0/2823496244 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5dec06a810 0x7f5dec06ccd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x563a81113b60 tx=0x7f5df0009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.534+0000 7f5dfe242640 1 --2- 172.21.15.79:0/2823496244 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x563a81111790 0x563a81068250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.534+0000 7f5dfe242640 1 --2- 172.21.15.79:0/2823496244 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x563a81111790 0x563a81068250 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.535+0000 7f5dfe242640 1 -- 172.21.15.79:0/2823496244 <== osd.4 v2:172.21.15.189:6800/1910571406 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v72'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5df405c040 con 0x563a81111790 2024-04-25T02:12:09.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.535+0000 7f5e00f40f40 1 -- 172.21.15.79:0/2823496244 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x563a81111790 msgr2=0x563a81068250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.535+0000 7f5e00f40f40 1 --2- 172.21.15.79:0/2823496244 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x563a81111790 0x563a81068250 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.535+0000 7f5e00f40f40 1 -- 172.21.15.79:0/2823496244 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5dec06a810 msgr2=0x7f5dec06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.535+0000 7f5e00f40f40 1 --2- 172.21.15.79:0/2823496244 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5dec06a810 0x7f5dec06ccd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x563a81113b60 tx=0x7f5df0009000 comp rx=0 tx=0).stop 2024-04-25T02:12:09.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.535+0000 7f5e00f40f40 1 -- 172.21.15.79:0/2823496244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a81115240 msgr2=0x563a81111250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.535+0000 7f5e00f40f40 1 --2- 172.21.15.79:0/2823496244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a81115240 0x563a81111250 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f5df800d450 tx=0x7f5df800d910 comp rx=0 tx=0).stop 2024-04-25T02:12:09.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.535+0000 7f5dff244640 1 -- 172.21.15.79:0/2823496244 reap_dead start 2024-04-25T02:12:09.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.535+0000 7f5e00f40f40 1 -- 172.21.15.79:0/2823496244 shutdown_connections 2024-04-25T02:12:09.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.535+0000 7f5e00f40f40 1 -- 172.21.15.79:0/2823496244 >> 172.21.15.79:0/2823496244 conn(0x563a81069920 msgr2=0x563a81084c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:09.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.535+0000 7f5e00f40f40 1 -- 172.21.15.79:0/2823496244 shutdown_connections 2024-04-25T02:12:09.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.535+0000 7f5e00f40f40 1 -- 172.21.15.79:0/2823496244 wait complete. 2024-04-25T02:12:09.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T02:12:09.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.679+0000 7f5659f42640 1 Processor -- start 2024-04-25T02:12:09.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.679+0000 7f5659f42640 1 -- start start 2024-04-25T02:12:09.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.679+0000 7f5659f42640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f565415e4f0 0x7f56540d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.679+0000 7f5659f42640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56540d10c0 0x7f565406bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.679+0000 7f5659f42640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56540d1ee0 con 0x7f56540cf7f0 2024-04-25T02:12:09.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.679+0000 7f5659f42640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f56540d21c0 con 0x7f565415e4f0 2024-04-25T02:12:09.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.679+0000 7f5659f42640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f56540d24a0 con 0x7f56540d10c0 2024-04-25T02:12:09.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.680+0000 7f56537fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f565415e4f0 0x7f56540d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.680+0000 7f5653fff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56540d10c0 0x7f565406bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.680+0000 7f5653fff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56540d10c0 0x7f565406bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:42182/0 (socket says 172.21.15.79:42182) 2024-04-25T02:12:09.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.680+0000 7f564bfff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f56540cf7f0 0x7f56540d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:34316/0 (socket says 172.21.15.79:34316) 2024-04-25T02:12:09.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.680+0000 7f56537fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f565415e4f0 0x7f56540d2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:56812/0 (socket says 172.21.15.79:56812) 2024-04-25T02:12:09.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.680+0000 7f5653fff640 1 -- 172.21.15.79:0/3904302020 learned_addr learned my addr 172.21.15.79:0/3904302020 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:09.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.680+0000 7f56537fe640 1 -- 172.21.15.79:0/3904302020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56540d10c0 msgr2=0x7f565406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:09.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.680+0000 7f56537fe640 1 --2- 172.21.15.79:0/3904302020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56540d10c0 0x7f565406bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.680+0000 7f56537fe640 1 -- 172.21.15.79:0/3904302020 >> v1:172.21.15.189:6789/0 conn(0x7f56540cf7f0 legacy=0x7f56540d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.680+0000 7f56537fe640 1 -- 172.21.15.79:0/3904302020 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56540d2780 con 0x7f565415e4f0 2024-04-25T02:12:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.681+0000 7f56537fe640 1 --2- 172.21.15.79:0/3904302020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f565415e4f0 0x7f56540d2ca0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f56440097d0 tx=0x7f564402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a8e7f1018378fc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.681+0000 7f5652ffd640 1 -- 172.21.15.79:0/3904302020 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644037070 con 0x7f565415e4f0 2024-04-25T02:12:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.681+0000 7f5652ffd640 1 -- 172.21.15.79:0/3904302020 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5644032440 con 0x7f565415e4f0 2024-04-25T02:12:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.681+0000 7f5652ffd640 1 -- 172.21.15.79:0/3904302020 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644032810 con 0x7f565415e4f0 2024-04-25T02:12:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.681+0000 7f5659f42640 1 -- 172.21.15.79:0/3904302020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f565415e4f0 msgr2=0x7f56540d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.681+0000 7f5659f42640 1 --2- 172.21.15.79:0/3904302020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f565415e4f0 0x7f56540d2ca0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f56440097d0 tx=0x7f564402a1c0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.681+0000 7f5659f42640 1 -- 172.21.15.79:0/3904302020 shutdown_connections 2024-04-25T02:12:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.681+0000 7f5659f42640 1 --2- 172.21.15.79:0/3904302020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56540d10c0 0x7f565406bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.681+0000 7f5659f42640 1 --2- 172.21.15.79:0/3904302020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f565415e4f0 0x7f56540d2ca0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.681+0000 7f5659f42640 1 -- 172.21.15.79:0/3904302020 >> 172.21.15.79:0/3904302020 conn(0x7f565409d4a0 msgr2=0x7f56540d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:09.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.681+0000 7f5659f42640 1 -- 172.21.15.79:0/3904302020 shutdown_connections 2024-04-25T02:12:09.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.681+0000 7f5659f42640 1 -- 172.21.15.79:0/3904302020 wait complete. 2024-04-25T02:12:09.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.683+0000 7f5659f42640 1 Processor -- start 2024-04-25T02:12:09.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.683+0000 7f5659f42640 1 -- start start 2024-04-25T02:12:09.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.683+0000 7f5659f42640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56540cf7f0 0x7f56540b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.683+0000 7f5659f42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56540d10c0 0x7f56541526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.683+0000 7f5659f42640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f565415e4f0 0x7f56541f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.683+0000 7f5659f42640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f56540cfe00 con 0x7f56540d10c0 2024-04-25T02:12:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.683+0000 7f5659f42640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f56540cfc80 con 0x7f565415e4f0 2024-04-25T02:12:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.683+0000 7f5659f42640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f56540cff80 con 0x7f56540cf7f0 2024-04-25T02:12:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.683+0000 7f564bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56540d10c0 0x7f56541526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.683+0000 7f564bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56540d10c0 0x7f56541526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50316/0 (socket says 172.21.15.79:50316) 2024-04-25T02:12:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.683+0000 7f564bfff640 1 -- 172.21.15.79:0/3129228391 learned_addr learned my addr 172.21.15.79:0/3129228391 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.683+0000 7f56537fe640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56540cf7f0 0x7f56540b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.683+0000 7f5653fff640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f565415e4f0 0x7f56541f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.684+0000 7f564bfff640 1 -- 172.21.15.79:0/3129228391 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56540cf7f0 msgr2=0x7f56540b7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.684+0000 7f564bfff640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56540cf7f0 0x7f56540b7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.684+0000 7f564bfff640 1 -- 172.21.15.79:0/3129228391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f565415e4f0 msgr2=0x7f56541f76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.684+0000 7f564bfff640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f565415e4f0 0x7f56541f76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.684+0000 7f564bfff640 1 -- 172.21.15.79:0/3129228391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5654152c30 con 0x7f56540d10c0 2024-04-25T02:12:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.684+0000 7f56537fe640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56540cf7f0 0x7f56540b7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.684+0000 7f5653fff640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f565415e4f0 0x7f56541f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.684+0000 7f564bfff640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56540d10c0 0x7f56541526f0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f563c00c430 tx=0x7f563c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.684+0000 7f5650ff9640 1 -- 172.21.15.79:0/3129228391 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c0074e0 con 0x7f56540d10c0 2024-04-25T02:12:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.684+0000 7f5650ff9640 1 -- 172.21.15.79:0/3129228391 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563c007680 con 0x7f56540d10c0 2024-04-25T02:12:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.684+0000 7f5659f42640 1 -- 172.21.15.79:0/3129228391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56541f8160 con 0x7f56540d10c0 2024-04-25T02:12:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.684+0000 7f5650ff9640 1 -- 172.21.15.79:0/3129228391 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c004a00 con 0x7f56540d10c0 2024-04-25T02:12:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.684+0000 7f5659f42640 1 -- 172.21.15.79:0/3129228391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56540b6d90 con 0x7f56540d10c0 2024-04-25T02:12:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.685+0000 7f5659f42640 1 -- 172.21.15.79:0/3129228391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56540686c0 con 0x7f56540d10c0 2024-04-25T02:12:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.685+0000 7f5650ff9640 1 -- 172.21.15.79:0/3129228391 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f563c01a020 con 0x7f56540d10c0 2024-04-25T02:12:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.686+0000 7f5650ff9640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f563406be30 0x7f563406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.686+0000 7f5650ff9640 1 -- 172.21.15.79:0/3129228391 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7f563c08a500 con 0x7f56540d10c0 2024-04-25T02:12:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.686+0000 7f56537fe640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f563406be30 0x7f563406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.686+0000 7f56537fe640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f563406be30 0x7f563406e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5644034000 tx=0x7f564402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.690+0000 7f5650ff9640 1 -- 172.21.15.79:0/3129228391 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f563c058890 con 0x7f56540d10c0 2024-04-25T02:12:09.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:09.902+0000 7f5659f42640 1 -- 172.21.15.79:0/3129228391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f56540690a0 con 0x7f56540d10c0 2024-04-25T02:12:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.475+0000 7f5650ff9640 1 -- 172.21.15.79:0/3129228391 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v34) ==== 162+0+0 (secure 0 0 0) 0x7f563c05cb90 con 0x7f56540d10c0 2024-04-25T02:12:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T02:12:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.477+0000 7f5659f42640 1 -- 172.21.15.79:0/3129228391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f563406be30 msgr2=0x7f563406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.477+0000 7f5659f42640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f563406be30 0x7f563406e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5644034000 tx=0x7f564402e000 comp rx=0 tx=0).stop 2024-04-25T02:12:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.477+0000 7f5659f42640 1 -- 172.21.15.79:0/3129228391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56540d10c0 msgr2=0x7f56541526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.477+0000 7f5659f42640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56540d10c0 0x7f56541526f0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f563c00c430 tx=0x7f563c00c8f0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.477+0000 7f5659f42640 1 -- 172.21.15.79:0/3129228391 shutdown_connections 2024-04-25T02:12:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.477+0000 7f5659f42640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f563406be30 0x7f563406e2f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.477+0000 7f5659f42640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f565415e4f0 0x7f56541f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.477+0000 7f5659f42640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56540d10c0 0x7f56541526f0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.477+0000 7f5659f42640 1 --2- 172.21.15.79:0/3129228391 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56540cf7f0 0x7f56540b7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.477+0000 7f5659f42640 1 -- 172.21.15.79:0/3129228391 >> 172.21.15.79:0/3129228391 conn(0x7f565409d4a0 msgr2=0x7f565415a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.477+0000 7f5659f42640 1 -- 172.21.15.79:0/3129228391 shutdown_connections 2024-04-25T02:12:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.478+0000 7f5659f42640 1 -- 172.21.15.79:0/3129228391 wait complete. 2024-04-25T02:12:10.498 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:12:10.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.590+0000 7f2822ad4640 1 Processor -- start 2024-04-25T02:12:10.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.590+0000 7f2822ad4640 1 -- start start 2024-04-25T02:12:10.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.590+0000 7f2822ad4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f281c143bc0 0x7f281c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:10.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.591+0000 7f2822ad4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f281c0b3d40 0x7f281c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:10.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.591+0000 7f2822ad4640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f281c15fa40 con 0x7f281c06df50 2024-04-25T02:12:10.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.591+0000 7f2822ad4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f281c06e8f0 con 0x7f281c0b3d40 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.591+0000 7f2822ad4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f281c072cb0 con 0x7f281c143bc0 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.591+0000 7f2821071640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f281c0b3d40 0x7f281c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.591+0000 7f2821071640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f281c0b3d40 0x7f281c06e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50332/0 (socket says 172.21.15.79:50332) 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.591+0000 7f2821071640 1 -- 172.21.15.79:0/2419214542 learned_addr learned my addr 172.21.15.79:0/2419214542 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.591+0000 7f2820870640 1 --2- 172.21.15.79:0/2419214542 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f281c143bc0 0x7f281c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.591+0000 7f2821071640 1 -- 172.21.15.79:0/2419214542 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f281c143bc0 msgr2=0x7f281c15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.591+0000 7f2821071640 1 --2- 172.21.15.79:0/2419214542 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f281c143bc0 0x7f281c15f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.591+0000 7f2821071640 1 -- 172.21.15.79:0/2419214542 >> v1:172.21.15.189:6789/0 conn(0x7f281c06df50 legacy=0x7f281c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.591+0000 7f2821071640 1 -- 172.21.15.79:0/2419214542 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f281c071e00 con 0x7f281c0b3d40 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.592+0000 7f2821071640 1 --2- 172.21.15.79:0/2419214542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c0b3d40 0x7f281c06e3b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f280c009870 tx=0x7f280c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e4783e3b93292a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.592+0000 7f281b7fe640 1 -- 172.21.15.79:0/2419214542 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c037070 con 0x7f281c0b3d40 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.592+0000 7f281b7fe640 1 -- 172.21.15.79:0/2419214542 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c032440 con 0x7f281c0b3d40 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.592+0000 7f281b7fe640 1 -- 172.21.15.79:0/2419214542 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c032810 con 0x7f281c0b3d40 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.592+0000 7f2822ad4640 1 -- 172.21.15.79:0/2419214542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c0b3d40 msgr2=0x7f281c06e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.592+0000 7f2822ad4640 1 --2- 172.21.15.79:0/2419214542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c0b3d40 0x7f281c06e3b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f280c009870 tx=0x7f280c02a1c0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.592+0000 7f2822ad4640 1 -- 172.21.15.79:0/2419214542 shutdown_connections 2024-04-25T02:12:10.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.592+0000 7f2822ad4640 1 --2- 172.21.15.79:0/2419214542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c0b3d40 0x7f281c06e3b0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.592+0000 7f2822ad4640 1 --2- 172.21.15.79:0/2419214542 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f281c143bc0 0x7f281c15f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.592+0000 7f2822ad4640 1 -- 172.21.15.79:0/2419214542 >> 172.21.15.79:0/2419214542 conn(0x7f281c0cfc80 msgr2=0x7f281c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:10.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.592+0000 7f2822ad4640 1 -- 172.21.15.79:0/2419214542 shutdown_connections 2024-04-25T02:12:10.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.592+0000 7f2822ad4640 1 -- 172.21.15.79:0/2419214542 wait complete. 2024-04-25T02:12:10.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.593+0000 7f2822ad4640 1 Processor -- start 2024-04-25T02:12:10.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.593+0000 7f2822ad4640 1 -- start start 2024-04-25T02:12:10.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.594+0000 7f2822ad4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f281c06df50 0x7f281c140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:10.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.594+0000 7f2822ad4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f281c0b3d40 0x7f281c1412f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:10.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.594+0000 7f2822ad4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c143bc0 0x7f281c1f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:10.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.594+0000 7f2822ad4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f281c072660 con 0x7f281c143bc0 2024-04-25T02:12:10.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.594+0000 7f2822ad4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f281c072380 con 0x7f281c06df50 2024-04-25T02:12:10.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.594+0000 7f2822ad4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f281c072940 con 0x7f281c0b3d40 2024-04-25T02:12:10.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.594+0000 7f2821071640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c143bc0 0x7f281c1f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:10.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.594+0000 7f2821071640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c143bc0 0x7f281c1f3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50348/0 (socket says 172.21.15.79:50348) 2024-04-25T02:12:10.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.594+0000 7f2821071640 1 -- 172.21.15.79:0/429504842 learned_addr learned my addr 172.21.15.79:0/429504842 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:10.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.595+0000 7f2820870640 1 --2- 172.21.15.79:0/429504842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f281c06df50 0x7f281c140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:10.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.595+0000 7f281bfff640 1 --2- 172.21.15.79:0/429504842 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f281c0b3d40 0x7f281c1412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:10.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.595+0000 7f2821071640 1 -- 172.21.15.79:0/429504842 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f281c0b3d40 msgr2=0x7f281c1412f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:10.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.595+0000 7f2821071640 1 --2- 172.21.15.79:0/429504842 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f281c0b3d40 0x7f281c1412f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.595+0000 7f2821071640 1 -- 172.21.15.79:0/429504842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f281c06df50 msgr2=0x7f281c140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:10.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.595+0000 7f2821071640 1 --2- 172.21.15.79:0/429504842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f281c06df50 0x7f281c140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.595+0000 7f2821071640 1 -- 172.21.15.79:0/429504842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f281c1f5130 con 0x7f281c143bc0 2024-04-25T02:12:10.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.595+0000 7f2820870640 1 --2- 172.21.15.79:0/429504842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f281c06df50 0x7f281c140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:10.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.595+0000 7f2821071640 1 --2- 172.21.15.79:0/429504842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c143bc0 0x7f281c1f3ed0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f280c009870 tx=0x7f280c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:10.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.595+0000 7f28197fa640 1 -- 172.21.15.79:0/429504842 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c037040 con 0x7f281c143bc0 2024-04-25T02:12:10.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.595+0000 7f28197fa640 1 -- 172.21.15.79:0/429504842 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c042070 con 0x7f281c143bc0 2024-04-25T02:12:10.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.595+0000 7f2822ad4640 1 -- 172.21.15.79:0/429504842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f281c1f5410 con 0x7f281c143bc0 2024-04-25T02:12:10.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.595+0000 7f28197fa640 1 -- 172.21.15.79:0/429504842 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c030920 con 0x7f281c143bc0 2024-04-25T02:12:10.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.595+0000 7f2822ad4640 1 -- 172.21.15.79:0/429504842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f281c1f59d0 con 0x7f281c143bc0 2024-04-25T02:12:10.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.596+0000 7f2822ad4640 1 -- 172.21.15.79:0/429504842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f281c0690a0 con 0x7f281c143bc0 2024-04-25T02:12:10.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.596+0000 7f28197fa640 1 -- 172.21.15.79:0/429504842 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f280c02ad10 con 0x7f281c143bc0 2024-04-25T02:12:10.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.597+0000 7f28197fa640 1 --2- 172.21.15.79:0/429504842 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f280806be30 0x7f280806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:10.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.597+0000 7f28197fa640 1 -- 172.21.15.79:0/429504842 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7f280c0ab510 con 0x7f281c143bc0 2024-04-25T02:12:10.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.597+0000 7f2820870640 1 --2- 172.21.15.79:0/429504842 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f280806be30 0x7f280806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:10.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.597+0000 7f2820870640 1 --2- 172.21.15.79:0/429504842 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f280806be30 0x7f280806e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2814009fd0 tx=0x7f281400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:10.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.601+0000 7f28197fa640 1 -- 172.21.15.79:0/429504842 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f280c079e60 con 0x7f281c143bc0 2024-04-25T02:12:10.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.811+0000 7f2822ad4640 1 -- 172.21.15.79:0/429504842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f281c0d04e0 con 0x7f281c143bc0 2024-04-25T02:12:10.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.812+0000 7f28197fa640 1 -- 172.21.15.79:0/429504842 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5174 (secure 0 0 0) 0x7f280c079760 con 0x7f281c143bc0 2024-04-25T02:12:10.819 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:12:10.819 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/596307304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":596307304},{"type":"v1","addr":"172.21.15.189:6834","nonce":596307304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/980112490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":980112490},{"type":"v1","addr":"172.21.15.189:6835","nonce":980112490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2550610051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550610051},{"type":"v1","addr":"172.21.15.79:6836","nonce":2550610051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:11:55.951694+0000","modified":"2024-04-25T02:12:10.478637+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":72,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"a","rank":0,"incarnation":35,"state":"up:replay","state_seq":1,"addr":"172.21.15.79:6837/782013262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":782013262},{"type":"v1","addr":"172.21.15.79:6837","nonce":782013262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-04-25T02:12:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 35 2024-04-25T02:12:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.814+0000 7f2822ad4640 1 -- 172.21.15.79:0/429504842 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f280806be30 msgr2=0x7f280806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.814+0000 7f2822ad4640 1 --2- 172.21.15.79:0/429504842 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f280806be30 0x7f280806e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2814009fd0 tx=0x7f281400b040 comp rx=0 tx=0).stop 2024-04-25T02:12:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.814+0000 7f2822ad4640 1 -- 172.21.15.79:0/429504842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c143bc0 msgr2=0x7f281c1f3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.814+0000 7f2822ad4640 1 --2- 172.21.15.79:0/429504842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c143bc0 0x7f281c1f3ed0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f280c009870 tx=0x7f280c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.814+0000 7f2822ad4640 1 -- 172.21.15.79:0/429504842 shutdown_connections 2024-04-25T02:12:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.814+0000 7f2822ad4640 1 --2- 172.21.15.79:0/429504842 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f280806be30 0x7f280806e2f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.814+0000 7f2822ad4640 1 --2- 172.21.15.79:0/429504842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c143bc0 0x7f281c1f3ed0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.814+0000 7f2822ad4640 1 --2- 172.21.15.79:0/429504842 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f281c0b3d40 0x7f281c1412f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.814+0000 7f2822ad4640 1 --2- 172.21.15.79:0/429504842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f281c06df50 0x7f281c140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.814+0000 7f2822ad4640 1 -- 172.21.15.79:0/429504842 >> 172.21.15.79:0/429504842 conn(0x7f281c0cfc80 msgr2=0x7f281c0b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.814+0000 7f2822ad4640 1 -- 172.21.15.79:0/429504842 shutdown_connections 2024-04-25T02:12:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:10.814+0000 7f2822ad4640 1 -- 172.21.15.79:0/429504842 wait complete. 2024-04-25T02:12:11.234 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:11:55.951694+0000', 'modified': '2024-04-25T02:12:10.478637+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 72, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6696}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6696': {'gid': 6696, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.79:6837/782013262', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 782013262}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 782013262}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T02:12:11.234 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6696:up:replay 2024-04-25T02:12:12.235 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:12:12.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.332+0000 7f5a7e25d640 1 Processor -- start 2024-04-25T02:12:12.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.332+0000 7f5a7e25d640 1 -- start start 2024-04-25T02:12:12.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.333+0000 7f5a7e25d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5a78071d00 0x7f5a781653f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:12.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.333+0000 7f5a7e25d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7815bb10 con 0x7f5a780d07a0 2024-04-25T02:12:12.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.333+0000 7f5a7e25d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a780b2e60 con 0x7f5a7815a720 2024-04-25T02:12:12.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.333+0000 7f5a7e25d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5a780b3140 con 0x7f5a78071d00 2024-04-25T02:12:12.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.333+0000 7f5a77fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5a78071d00 0x7f5a781653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:12.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.333+0000 7f5a76ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5a780d07a0 0x7f5a780b42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41794/0 (socket says 172.21.15.79:41794) 2024-04-25T02:12:12.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.333+0000 7f5a76ffd640 1 -- 172.21.15.79:0/1857446400 learned_addr learned my addr 172.21.15.79:0/1857446400 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:12.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.333+0000 7f5a77fff640 1 -- 172.21.15.79:0/1857446400 >> v1:172.21.15.189:6789/0 conn(0x7f5a7815a720 legacy=0x7f5a7815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:12.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.333+0000 7f5a77fff640 1 -- 172.21.15.79:0/1857446400 >> v1:172.21.15.79:6789/0 conn(0x7f5a780d07a0 legacy=0x7f5a780b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:12.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.333+0000 7f5a77fff640 1 -- 172.21.15.79:0/1857446400 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a780b3420 con 0x7f5a78071d00 2024-04-25T02:12:12.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.334+0000 7f5a77fff640 1 --2- 172.21.15.79:0/1857446400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a78071d00 0x7f5a781653f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f5a70009d90 tx=0x7f5a7002b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22912ed448eeac09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:12.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.334+0000 7f5a767fc640 1 -- 172.21.15.79:0/1857446400 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70007740 con 0x7f5a78071d00 2024-04-25T02:12:12.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.334+0000 7f5a767fc640 1 -- 172.21.15.79:0/1857446400 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a700078e0 con 0x7f5a78071d00 2024-04-25T02:12:12.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.334+0000 7f5a767fc640 1 -- 172.21.15.79:0/1857446400 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70007cb0 con 0x7f5a78071d00 2024-04-25T02:12:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.334+0000 7f5a7e25d640 1 -- 172.21.15.79:0/1857446400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a78071d00 msgr2=0x7f5a781653f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.334+0000 7f5a7e25d640 1 --2- 172.21.15.79:0/1857446400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a78071d00 0x7f5a781653f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f5a70009d90 tx=0x7f5a7002b720 comp rx=0 tx=0).stop 2024-04-25T02:12:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.334+0000 7f5a7e25d640 1 -- 172.21.15.79:0/1857446400 shutdown_connections 2024-04-25T02:12:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.334+0000 7f5a7e25d640 1 --2- 172.21.15.79:0/1857446400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a78071d00 0x7f5a781653f0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.334+0000 7f5a7e25d640 1 -- 172.21.15.79:0/1857446400 >> 172.21.15.79:0/1857446400 conn(0x7f5a780cfc80 msgr2=0x7f5a780d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.335+0000 7f5a7e25d640 1 -- 172.21.15.79:0/1857446400 shutdown_connections 2024-04-25T02:12:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.335+0000 7f5a7e25d640 1 -- 172.21.15.79:0/1857446400 wait complete. 2024-04-25T02:12:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.336+0000 7f5a7e25d640 1 Processor -- start 2024-04-25T02:12:12.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.336+0000 7f5a7e25d640 1 -- start start 2024-04-25T02:12:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.336+0000 7f5a7e25d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a78071d00 0x7f5a78150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a7e25d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a780d07a0 0x7f5a78153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a7e25d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7815a720 0x7f5a7815c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a7e25d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5a780b49b0 con 0x7f5a7815a720 2024-04-25T02:12:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a7e25d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5a780b39e0 con 0x7f5a780d07a0 2024-04-25T02:12:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a7e25d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5a780b4b30 con 0x7f5a78071d00 2024-04-25T02:12:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a77fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7815a720 0x7f5a7815c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a77fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7815a720 0x7f5a7815c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50370/0 (socket says 172.21.15.79:50370) 2024-04-25T02:12:12.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a77fff640 1 -- 172.21.15.79:0/425040140 learned_addr learned my addr 172.21.15.79:0/425040140 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a777fe640 1 --2- 172.21.15.79:0/425040140 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a78071d00 0x7f5a78150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a76ffd640 1 --2- 172.21.15.79:0/425040140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a780d07a0 0x7f5a78153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a77fff640 1 -- 172.21.15.79:0/425040140 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a78071d00 msgr2=0x7f5a78150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a77fff640 1 --2- 172.21.15.79:0/425040140 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a78071d00 0x7f5a78150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a77fff640 1 -- 172.21.15.79:0/425040140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a780d07a0 msgr2=0x7f5a78153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a77fff640 1 --2- 172.21.15.79:0/425040140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a780d07a0 0x7f5a78153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a77fff640 1 -- 172.21.15.79:0/425040140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a78150080 con 0x7f5a7815a720 2024-04-25T02:12:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a77fff640 1 --2- 172.21.15.79:0/425040140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7815a720 0x7f5a7815c900 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f5a70009d90 tx=0x7f5a70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a5ffff640 1 -- 172.21.15.79:0/425040140 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70041070 con 0x7f5a7815a720 2024-04-25T02:12:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a5ffff640 1 -- 172.21.15.79:0/425040140 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a70032bc0 con 0x7f5a7815a720 2024-04-25T02:12:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a7e25d640 1 -- 172.21.15.79:0/425040140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a78153bd0 con 0x7f5a7815a720 2024-04-25T02:12:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a5ffff640 1 -- 172.21.15.79:0/425040140 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7003b430 con 0x7f5a7815a720 2024-04-25T02:12:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.337+0000 7f5a7e25d640 1 -- 172.21.15.79:0/425040140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a78150320 con 0x7f5a7815a720 2024-04-25T02:12:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.338+0000 7f5a7e25d640 1 -- 172.21.15.79:0/425040140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a780690a0 con 0x7f5a7815a720 2024-04-25T02:12:12.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.339+0000 7f5a5ffff640 1 -- 172.21.15.79:0/425040140 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a7003b5d0 con 0x7f5a7815a720 2024-04-25T02:12:12.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.339+0000 7f5a5ffff640 1 --2- 172.21.15.79:0/425040140 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5a6406be30 0x7f5a6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:12.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.339+0000 7f5a5ffff640 1 -- 172.21.15.79:0/425040140 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7f5a700ab900 con 0x7f5a7815a720 2024-04-25T02:12:12.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.339+0000 7f5a777fe640 1 --2- 172.21.15.79:0/425040140 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5a6406be30 0x7f5a6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:12.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.340+0000 7f5a777fe640 1 --2- 172.21.15.79:0/425040140 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5a6406be30 0x7f5a6406e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5a780ceeb0 tx=0x7f5a6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:12.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.344+0000 7f5a5ffff640 1 -- 172.21.15.79:0/425040140 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5a7007a2e0 con 0x7f5a7815a720 2024-04-25T02:12:12.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.554+0000 7f5a7e25d640 1 -- 172.21.15.79:0/425040140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a78072bb0 con 0x7f5a7815a720 2024-04-25T02:12:12.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.554+0000 7f5a5ffff640 1 -- 172.21.15.79:0/425040140 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5174 (secure 0 0 0) 0x7f5a70079be0 con 0x7f5a7815a720 2024-04-25T02:12:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:12:12.562 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/596307304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":596307304},{"type":"v1","addr":"172.21.15.189:6834","nonce":596307304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/980112490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":980112490},{"type":"v1","addr":"172.21.15.189:6835","nonce":980112490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2550610051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550610051},{"type":"v1","addr":"172.21.15.79:6836","nonce":2550610051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:11:55.951694+0000","modified":"2024-04-25T02:12:11.485194+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":72,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"a","rank":0,"incarnation":35,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.79:6837/782013262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":782013262},{"type":"v1","addr":"172.21.15.79:6837","nonce":782013262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-04-25T02:12:12.562 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 37 2024-04-25T02:12:12.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.556+0000 7f5a7e25d640 1 -- 172.21.15.79:0/425040140 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5a6406be30 msgr2=0x7f5a6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:12.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.556+0000 7f5a7e25d640 1 --2- 172.21.15.79:0/425040140 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5a6406be30 0x7f5a6406e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5a780ceeb0 tx=0x7f5a6c009040 comp rx=0 tx=0).stop 2024-04-25T02:12:12.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.556+0000 7f5a7e25d640 1 -- 172.21.15.79:0/425040140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7815a720 msgr2=0x7f5a7815c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:12.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.556+0000 7f5a7e25d640 1 --2- 172.21.15.79:0/425040140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7815a720 0x7f5a7815c900 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f5a70009d90 tx=0x7f5a70004a40 comp rx=0 tx=0).stop 2024-04-25T02:12:12.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.556+0000 7f5a7e25d640 1 -- 172.21.15.79:0/425040140 shutdown_connections 2024-04-25T02:12:12.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.556+0000 7f5a7e25d640 1 --2- 172.21.15.79:0/425040140 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5a6406be30 0x7f5a6406e2f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:12.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.556+0000 7f5a7e25d640 1 --2- 172.21.15.79:0/425040140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7815a720 0x7f5a7815c900 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:12.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.556+0000 7f5a7e25d640 1 --2- 172.21.15.79:0/425040140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a780d07a0 0x7f5a78153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:12.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.556+0000 7f5a7e25d640 1 --2- 172.21.15.79:0/425040140 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a78071d00 0x7f5a78150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:12.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.556+0000 7f5a7e25d640 1 -- 172.21.15.79:0/425040140 >> 172.21.15.79:0/425040140 conn(0x7f5a780cfc80 msgr2=0x7f5a7814f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:12.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.556+0000 7f5a7e25d640 1 -- 172.21.15.79:0/425040140 shutdown_connections 2024-04-25T02:12:12.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:12.556+0000 7f5a7e25d640 1 -- 172.21.15.79:0/425040140 wait complete. 2024-04-25T02:12:12.977 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:11:55.951694+0000', 'modified': '2024-04-25T02:12:11.485194+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 72, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6696}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6696': {'gid': 6696, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:rejoin', 'state_seq': 7, 'addr': '172.21.15.79:6837/782013262', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 782013262}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 782013262}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T02:12:12.977 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6696:up:rejoin 2024-04-25T02:12:13.977 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:12:14.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.080+0000 7ff66ed29640 1 Processor -- start 2024-04-25T02:12:14.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.080+0000 7ff66ed29640 1 -- start start 2024-04-25T02:12:14.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.080+0000 7ff66ed29640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff66806df50 0x7ff66806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.080+0000 7ff66ed29640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff668071240 0x7ff668071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.080+0000 7ff66ed29640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff668070d90 con 0x7ff668144cb0 2024-04-25T02:12:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.080+0000 7ff66ed29640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff6680cf130 con 0x7ff668071240 2024-04-25T02:12:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.080+0000 7ff66ed29640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff6680cf410 con 0x7ff66806df50 2024-04-25T02:12:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.081+0000 7ff66d2c6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff668071240 0x7ff668071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.081+0000 7ff66cac5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff668144cb0 0x7ff6680b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55540/0 (socket says 172.21.15.79:55540) 2024-04-25T02:12:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.081+0000 7ff66cac5640 1 -- 172.21.15.79:0/2756164330 learned_addr learned my addr 172.21.15.79:0/2756164330 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.081+0000 7ff667fff640 1 --2- 172.21.15.79:0/2756164330 >> v2:172.21.15.189:3300/0 conn(0x7ff66806df50 0x7ff66806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.081+0000 7ff66d2c6640 1 -- 172.21.15.79:0/2756164330 >> v2:172.21.15.189:3300/0 conn(0x7ff66806df50 msgr2=0x7ff66806e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.081+0000 7ff66d2c6640 1 --2- 172.21.15.79:0/2756164330 >> v2:172.21.15.189:3300/0 conn(0x7ff66806df50 0x7ff66806e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.081+0000 7ff66d2c6640 1 -- 172.21.15.79:0/2756164330 >> v1:172.21.15.79:6789/0 conn(0x7ff668144cb0 legacy=0x7ff6680b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.081+0000 7ff6677fe640 1 -- 172.21.15.79:0/2756164330 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3502171490 0 0) 0x7ff668070d90 con 0x7ff668144cb0 2024-04-25T02:12:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.081+0000 7ff66d2c6640 1 -- 172.21.15.79:0/2756164330 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6680cf6f0 con 0x7ff668071240 2024-04-25T02:12:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.081+0000 7ff667fff640 1 --2- 172.21.15.79:0/2756164330 >> v2:172.21.15.189:3300/0 conn(0x7ff66806df50 0x7ff66806e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.082+0000 7ff66d2c6640 1 --2- 172.21.15.79:0/2756164330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff668071240 0x7ff668071670 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7ff668070910 tx=0x7ff65802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2ff66f2efbd091 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.082+0000 7ff6677fe640 1 -- 172.21.15.79:0/2756164330 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658037070 con 0x7ff668071240 2024-04-25T02:12:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.082+0000 7ff6677fe640 1 -- 172.21.15.79:0/2756164330 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65802add0 con 0x7ff668071240 2024-04-25T02:12:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.082+0000 7ff6677fe640 1 -- 172.21.15.79:0/2756164330 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658032660 con 0x7ff668071240 2024-04-25T02:12:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.082+0000 7ff66ed29640 1 -- 172.21.15.79:0/2756164330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff668071240 msgr2=0x7ff668071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.082+0000 7ff66ed29640 1 --2- 172.21.15.79:0/2756164330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff668071240 0x7ff668071670 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7ff668070910 tx=0x7ff65802a080 comp rx=0 tx=0).stop 2024-04-25T02:12:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.082+0000 7ff66ed29640 1 -- 172.21.15.79:0/2756164330 shutdown_connections 2024-04-25T02:12:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.082+0000 7ff66ed29640 1 --2- 172.21.15.79:0/2756164330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff668071240 0x7ff668071670 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.082+0000 7ff66ed29640 1 --2- 172.21.15.79:0/2756164330 >> v2:172.21.15.189:3300/0 conn(0x7ff66806df50 0x7ff66806e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.082+0000 7ff66ed29640 1 -- 172.21.15.79:0/2756164330 >> 172.21.15.79:0/2756164330 conn(0x7ff6680cfc80 msgr2=0x7ff6680d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.082+0000 7ff66ed29640 1 -- 172.21.15.79:0/2756164330 shutdown_connections 2024-04-25T02:12:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.082+0000 7ff66ed29640 1 -- 172.21.15.79:0/2756164330 wait complete. 2024-04-25T02:12:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.084+0000 7ff66ed29640 1 Processor -- start 2024-04-25T02:12:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.084+0000 7ff66ed29640 1 -- start start 2024-04-25T02:12:14.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.084+0000 7ff66ed29640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff66806df50 0x7ff66813c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66ed29640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff668071240 0x7ff66813ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66ed29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff668144cb0 0x7ff668160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66ed29640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff668145090 con 0x7ff668144cb0 2024-04-25T02:12:14.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66ed29640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff6680cf9d0 con 0x7ff66806df50 2024-04-25T02:12:14.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66ed29640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff668145ab0 con 0x7ff668071240 2024-04-25T02:12:14.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66d2c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff668144cb0 0x7ff668160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66d2c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff668144cb0 0x7ff668160050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58840/0 (socket says 172.21.15.79:58840) 2024-04-25T02:12:14.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66d2c6640 1 -- 172.21.15.79:0/1078944597 learned_addr learned my addr 172.21.15.79:0/1078944597 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66cac5640 1 --2- 172.21.15.79:0/1078944597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff66806df50 0x7ff66813c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff667fff640 1 --2- 172.21.15.79:0/1078944597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff668071240 0x7ff66813ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66d2c6640 1 -- 172.21.15.79:0/1078944597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff668071240 msgr2=0x7ff66813ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66d2c6640 1 --2- 172.21.15.79:0/1078944597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff668071240 0x7ff66813ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66d2c6640 1 -- 172.21.15.79:0/1078944597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff66806df50 msgr2=0x7ff66813c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66d2c6640 1 --2- 172.21.15.79:0/1078944597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff66806df50 0x7ff66813c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66d2c6640 1 -- 172.21.15.79:0/1078944597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66813b6c0 con 0x7ff668144cb0 2024-04-25T02:12:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66cac5640 1 --2- 172.21.15.79:0/1078944597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff66806df50 0x7ff66813c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66d2c6640 1 --2- 172.21.15.79:0/1078944597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff668144cb0 0x7ff668160050 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ff658009890 tx=0x7ff6580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff6657fa640 1 -- 172.21.15.79:0/1078944597 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658037040 con 0x7ff668144cb0 2024-04-25T02:12:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff6657fa640 1 -- 172.21.15.79:0/1078944597 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff658042070 con 0x7ff668144cb0 2024-04-25T02:12:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66ed29640 1 -- 172.21.15.79:0/1078944597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff66813b9a0 con 0x7ff668144cb0 2024-04-25T02:12:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff6657fa640 1 -- 172.21.15.79:0/1078944597 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65803b870 con 0x7ff668144cb0 2024-04-25T02:12:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.085+0000 7ff66ed29640 1 -- 172.21.15.79:0/1078944597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff66813c240 con 0x7ff668144cb0 2024-04-25T02:12:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.086+0000 7ff66ed29640 1 -- 172.21.15.79:0/1078944597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6680690a0 con 0x7ff668144cb0 2024-04-25T02:12:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.087+0000 7ff6657fa640 1 -- 172.21.15.79:0/1078944597 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff65802ac90 con 0x7ff668144cb0 2024-04-25T02:12:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.087+0000 7ff6657fa640 1 --2- 172.21.15.79:0/1078944597 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64806be30 0x7ff64806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.087+0000 7ff6657fa640 1 -- 172.21.15.79:0/1078944597 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7ff6580ab650 con 0x7ff668144cb0 2024-04-25T02:12:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.087+0000 7ff66cac5640 1 --2- 172.21.15.79:0/1078944597 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64806be30 0x7ff64806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.088+0000 7ff66cac5640 1 --2- 172.21.15.79:0/1078944597 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64806be30 0x7ff64806e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff6600012e0 tx=0x7ff660007f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:14.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.092+0000 7ff6657fa640 1 -- 172.21.15.79:0/1078944597 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff658079f10 con 0x7ff668144cb0 2024-04-25T02:12:14.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.300+0000 7ff66ed29640 1 -- 172.21.15.79:0/1078944597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff668141f50 con 0x7ff668144cb0 2024-04-25T02:12:14.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.301+0000 7ff6657fa640 1 -- 172.21.15.79:0/1078944597 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5181 (secure 0 0 0) 0x7ff658079810 con 0x7ff668144cb0 2024-04-25T02:12:14.308 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:12:14.308 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/596307304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":596307304},{"type":"v1","addr":"172.21.15.189:6834","nonce":596307304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/980112490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":980112490},{"type":"v1","addr":"172.21.15.189:6835","nonce":980112490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2550610051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550610051},{"type":"v1","addr":"172.21.15.79:6836","nonce":2550610051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:11:55.951694+0000","modified":"2024-04-25T02:12:13.484553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":72,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":8,"addr":"172.21.15.79:6837/782013262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":782013262},{"type":"v1","addr":"172.21.15.79:6837","nonce":782013262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6696,"qdb_cluster":[6696]},"id":5}]} 2024-04-25T02:12:14.308 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 38 2024-04-25T02:12:14.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.303+0000 7ff66ed29640 1 -- 172.21.15.79:0/1078944597 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64806be30 msgr2=0x7ff64806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.303+0000 7ff66ed29640 1 --2- 172.21.15.79:0/1078944597 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64806be30 0x7ff64806e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff6600012e0 tx=0x7ff660007f90 comp rx=0 tx=0).stop 2024-04-25T02:12:14.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.303+0000 7ff66ed29640 1 -- 172.21.15.79:0/1078944597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff668144cb0 msgr2=0x7ff668160050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.303+0000 7ff66ed29640 1 --2- 172.21.15.79:0/1078944597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff668144cb0 0x7ff668160050 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ff658009890 tx=0x7ff6580046c0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.303+0000 7ff66ed29640 1 -- 172.21.15.79:0/1078944597 shutdown_connections 2024-04-25T02:12:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.303+0000 7ff66ed29640 1 --2- 172.21.15.79:0/1078944597 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64806be30 0x7ff64806e2f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.303+0000 7ff66ed29640 1 --2- 172.21.15.79:0/1078944597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff668144cb0 0x7ff668160050 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.303+0000 7ff66ed29640 1 --2- 172.21.15.79:0/1078944597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff668071240 0x7ff66813ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.303+0000 7ff66ed29640 1 --2- 172.21.15.79:0/1078944597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff66806df50 0x7ff66813c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.303+0000 7ff66ed29640 1 -- 172.21.15.79:0/1078944597 >> 172.21.15.79:0/1078944597 conn(0x7ff6680cfc80 msgr2=0x7ff6680ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.303+0000 7ff66ed29640 1 -- 172.21.15.79:0/1078944597 shutdown_connections 2024-04-25T02:12:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.303+0000 7ff66ed29640 1 -- 172.21.15.79:0/1078944597 wait complete. 2024-04-25T02:12:14.723 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:11:55.951694+0000', 'modified': '2024-04-25T02:12:13.484553+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 72, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6696}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6696': {'gid': 6696, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.79:6837/782013262', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 782013262}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 782013262}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6696, 'qdb_cluster': [6696]} 2024-04-25T02:12:14.723 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:12:14.723 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T02:12:14.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.816+0000 7f27af7b0640 1 Processor -- start 2024-04-25T02:12:14.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.816+0000 7f27af7b0640 1 -- start start 2024-04-25T02:12:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f27af7b0640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27a806df50 0x7f27a806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f27af7b0640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f27a80b2d30 0x7f27a80b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f27af7b0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27a8071e00 con 0x7f27a8143bc0 2024-04-25T02:12:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f27af7b0640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f27a806e8f0 con 0x7f27a80b2d30 2024-04-25T02:12:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f27af7b0640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f27a8072cb0 con 0x7f27a806df50 2024-04-25T02:12:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f27ad54c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f27a8143bc0 0x7f27a815f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55548/0 (socket says 172.21.15.79:55548) 2024-04-25T02:12:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f27ad54c640 1 -- 172.21.15.79:0/3330282699 learned_addr learned my addr 172.21.15.79:0/3330282699 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 -- 172.21.15.79:0/3330282699 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 406303356 0 0) 0x7f27a8071e00 con 0x7f27a8143bc0 2024-04-25T02:12:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f27add4d640 1 --2- 172.21.15.79:0/3330282699 >> v2:172.21.15.189:3300/0 conn(0x7f27a80b2d30 0x7f27a80b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f27acd4b640 1 --2- 172.21.15.79:0/3330282699 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27a806df50 0x7f27a806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 -- 172.21.15.79:0/3330282699 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2794003520 con 0x7f27a8143bc0 2024-04-25T02:12:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 -- 172.21.15.79:0/3330282699 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3221326314 0 0) 0x7f2794003520 con 0x7f27a8143bc0 2024-04-25T02:12:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 -- 172.21.15.79:0/3330282699 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27a806df50 msgr2=0x7f27a806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 --2- 172.21.15.79:0/3330282699 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27a806df50 0x7f27a806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 -- 172.21.15.79:0/3330282699 >> v2:172.21.15.189:3300/0 conn(0x7f27a80b2d30 msgr2=0x7f27a80b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 --2- 172.21.15.79:0/3330282699 >> v2:172.21.15.189:3300/0 conn(0x7f27a80b2d30 0x7f27a80b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 -- 172.21.15.79:0/3330282699 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a80720a0 con 0x7f27a8143bc0 2024-04-25T02:12:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 -- 172.21.15.79:0/3330282699 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f27a4001670 con 0x7f27a8143bc0 2024-04-25T02:12:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 -- 172.21.15.79:0/3330282699 >> v1:172.21.15.79:6789/0 conn(0x7f27a8143bc0 legacy=0x7f27a815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 --2- 172.21.15.79:0/3330282699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27940039b0 0x7f2794003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 --2- 172.21.15.79:0/3330282699 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27a806df50 0x7f2794004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 --2- 172.21.15.79:0/3330282699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2794004d40 0x7f27940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 -- 172.21.15.79:0/3330282699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8072cb0 con 0x7f27940039b0 2024-04-25T02:12:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 -- 172.21.15.79:0/3330282699 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f279400b9c0 con 0x7f2794004d40 2024-04-25T02:12:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.817+0000 7f279ffff640 1 -- 172.21.15.79:0/3330282699 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f279400dd50 con 0x7f27a806df50 2024-04-25T02:12:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.818+0000 7f27ad54c640 1 --2- 172.21.15.79:0/3330282699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27940039b0 0x7f2794003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.818+0000 7f27acd4b640 1 --2- 172.21.15.79:0/3330282699 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27a806df50 0x7f2794004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.818+0000 7f27add4d640 1 --2- 172.21.15.79:0/3330282699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2794004d40 0x7f27940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.818+0000 7f27ad54c640 1 -- 172.21.15.79:0/3330282699 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27a806df50 msgr2=0x7f2794004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.818+0000 7f27ad54c640 1 --2- 172.21.15.79:0/3330282699 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27a806df50 0x7f2794004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.818+0000 7f27ad54c640 1 -- 172.21.15.79:0/3330282699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2794004d40 msgr2=0x7f27940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.818+0000 7f27ad54c640 1 --2- 172.21.15.79:0/3330282699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2794004d40 0x7f27940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.818+0000 7f27ad54c640 1 -- 172.21.15.79:0/3330282699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2794003520 con 0x7f27940039b0 2024-04-25T02:12:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.818+0000 7f27add4d640 1 --2- 172.21.15.79:0/3330282699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2794004d40 0x7f27940051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.819+0000 7f27ad54c640 1 --2- 172.21.15.79:0/3330282699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27940039b0 0x7f2794003dd0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f27a4001050 tx=0x7f2794005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17599d0d9b6da93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.819+0000 7f279ffff640 1 -- 172.21.15.79:0/3330282699 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a402e070 con 0x7f27940039b0 2024-04-25T02:12:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.819+0000 7f279ffff640 1 -- 172.21.15.79:0/3330282699 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a4005af0 con 0x7f27940039b0 2024-04-25T02:12:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.819+0000 7f279ffff640 1 -- 172.21.15.79:0/3330282699 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4007d70 con 0x7f27940039b0 2024-04-25T02:12:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.819+0000 7f27af7b0640 1 -- 172.21.15.79:0/3330282699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27940039b0 msgr2=0x7f2794003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.819+0000 7f27af7b0640 1 --2- 172.21.15.79:0/3330282699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27940039b0 0x7f2794003dd0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f27a4001050 tx=0x7f2794005830 comp rx=0 tx=0).stop 2024-04-25T02:12:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.819+0000 7f27add4d640 1 -- 172.21.15.79:0/3330282699 reap_dead start 2024-04-25T02:12:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.819+0000 7f27af7b0640 1 -- 172.21.15.79:0/3330282699 shutdown_connections 2024-04-25T02:12:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.819+0000 7f27af7b0640 1 -- 172.21.15.79:0/3330282699 >> 172.21.15.79:0/3330282699 conn(0x7f27a80cfc80 msgr2=0x7f27a80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.819+0000 7f27af7b0640 1 -- 172.21.15.79:0/3330282699 shutdown_connections 2024-04-25T02:12:14.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.819+0000 7f27af7b0640 1 -- 172.21.15.79:0/3330282699 wait complete. 2024-04-25T02:12:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.820+0000 7f27af7b0640 1 Processor -- start 2024-04-25T02:12:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.820+0000 7f27af7b0640 1 -- start start 2024-04-25T02:12:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27af7b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27940039b0 0x7f27a81efc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27af7b0640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27a8156500 0x7f27a81f0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27af7b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a81f26f0 0x7f27a81f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27af7b0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8072940 con 0x7f27a81f26f0 2024-04-25T02:12:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27af7b0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8072660 con 0x7f27940039b0 2024-04-25T02:12:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27af7b0640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f27a8143fa0 con 0x7f27a8156500 2024-04-25T02:12:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27add4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a81f26f0 0x7f27a81f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27add4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a81f26f0 0x7f27a81f2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58858/0 (socket says 172.21.15.79:58858) 2024-04-25T02:12:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27add4d640 1 -- 172.21.15.79:0/954255901 learned_addr learned my addr 172.21.15.79:0/954255901 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27ad54c640 1 --2- 172.21.15.79:0/954255901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27940039b0 0x7f27a81efc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27acd4b640 1 --2- 172.21.15.79:0/954255901 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27a8156500 0x7f27a81f0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27add4d640 1 -- 172.21.15.79:0/954255901 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27a8156500 msgr2=0x7f27a81f0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27add4d640 1 --2- 172.21.15.79:0/954255901 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27a8156500 0x7f27a81f0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27add4d640 1 -- 172.21.15.79:0/954255901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27940039b0 msgr2=0x7f27a81efc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27add4d640 1 --2- 172.21.15.79:0/954255901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27940039b0 0x7f27a81efc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.821+0000 7f27add4d640 1 -- 172.21.15.79:0/954255901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a81f1650 con 0x7f27a81f26f0 2024-04-25T02:12:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.822+0000 7f27add4d640 1 --2- 172.21.15.79:0/954255901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a81f26f0 0x7f27a81f2ba0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f27a80b2a00 tx=0x7f27a0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.822+0000 7f279dffb640 1 -- 172.21.15.79:0/954255901 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0010d80 con 0x7f27a81f26f0 2024-04-25T02:12:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.822+0000 7f279dffb640 1 -- 172.21.15.79:0/954255901 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a0003990 con 0x7f27a81f26f0 2024-04-25T02:12:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.822+0000 7f27af7b0640 1 -- 172.21.15.79:0/954255901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a81f1930 con 0x7f27a81f26f0 2024-04-25T02:12:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.822+0000 7f279dffb640 1 -- 172.21.15.79:0/954255901 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0003d80 con 0x7f27a81f26f0 2024-04-25T02:12:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.822+0000 7f27af7b0640 1 -- 172.21.15.79:0/954255901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a81f1ef0 con 0x7f27a81f26f0 2024-04-25T02:12:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.823+0000 7f279dffb640 1 -- 172.21.15.79:0/954255901 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27a001e030 con 0x7f27a81f26f0 2024-04-25T02:12:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.824+0000 7f279dffb640 1 --2- 172.21.15.79:0/954255901 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f278c06be60 0x7f278c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.824+0000 7f279dffb640 1 -- 172.21.15.79:0/954255901 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7f27a008b580 con 0x7f27a81f26f0 2024-04-25T02:12:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.824+0000 7f27ad54c640 1 --2- 172.21.15.79:0/954255901 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f278c06be60 0x7f278c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.824+0000 7f27ad54c640 1 --2- 172.21.15.79:0/954255901 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f278c06be60 0x7f278c06e320 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f27a4033000 tx=0x7f27a4009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.825+0000 7f27b259e740 1 Processor -- start 2024-04-25T02:12:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.825+0000 7f27b259e740 1 -- start start 2024-04-25T02:12:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27b259e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45c18b60 0x55ff45bcb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27b259e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bfbc80 0x55ff45bfb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27b259e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45bfb540 0x55ff45bd0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27b259e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ff45b33f00 con 0x55ff45bfbc80 2024-04-25T02:12:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27b259e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ff45adc750 con 0x55ff45c18b60 2024-04-25T02:12:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27b259e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ff45b2fec0 con 0x55ff45bfb540 2024-04-25T02:12:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27acd4b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bfbc80 0x55ff45bfb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27acd4b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bfbc80 0x55ff45bfb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58868/0 (socket says 172.21.15.79:58868) 2024-04-25T02:12:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27acd4b640 1 -- 172.21.15.79:0/127653532 learned_addr learned my addr 172.21.15.79:0/127653532 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27ad54c640 1 --2- 172.21.15.79:0/127653532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45c18b60 0x55ff45bcb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27add4d640 1 --2- 172.21.15.79:0/127653532 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45bfb540 0x55ff45bd0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27acd4b640 1 -- 172.21.15.79:0/127653532 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45bfb540 msgr2=0x55ff45bd0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27acd4b640 1 --2- 172.21.15.79:0/127653532 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45bfb540 0x55ff45bd0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27acd4b640 1 -- 172.21.15.79:0/127653532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45c18b60 msgr2=0x55ff45bcb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27acd4b640 1 --2- 172.21.15.79:0/127653532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45c18b60 0x55ff45bcb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27acd4b640 1 -- 172.21.15.79:0/127653532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff458482d0 con 0x55ff45bfbc80 2024-04-25T02:12:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27ad54c640 1 --2- 172.21.15.79:0/127653532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45c18b60 0x55ff45bcb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f27acd4b640 1 --2- 172.21.15.79:0/127653532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bfbc80 0x55ff45bfb000 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f2798009c20 tx=0x7f2798009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282526349d4a9527 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f2792ffd640 1 -- 172.21.15.79:0/127653532 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279801f480 con 0x55ff45bfbc80 2024-04-25T02:12:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f2792ffd640 1 -- 172.21.15.79:0/127653532 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f279801f620 con 0x55ff45bfbc80 2024-04-25T02:12:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.826+0000 7f2792ffd640 1 -- 172.21.15.79:0/127653532 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279801f9d0 con 0x55ff45bfbc80 2024-04-25T02:12:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.827+0000 7f27b259e740 1 -- 172.21.15.79:0/127653532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bfbc80 msgr2=0x55ff45bfb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.827+0000 7f27b259e740 1 --2- 172.21.15.79:0/127653532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bfbc80 0x55ff45bfb000 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f2798009c20 tx=0x7f2798009190 comp rx=0 tx=0).stop 2024-04-25T02:12:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.827+0000 7f27b259e740 1 -- 172.21.15.79:0/127653532 shutdown_connections 2024-04-25T02:12:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.827+0000 7f27b259e740 1 --2- 172.21.15.79:0/127653532 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45bfb540 0x55ff45bd0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.827+0000 7f27b259e740 1 --2- 172.21.15.79:0/127653532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bfbc80 0x55ff45bfb000 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.827+0000 7f27b259e740 1 --2- 172.21.15.79:0/127653532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45c18b60 0x55ff45bcb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.827+0000 7f27b259e740 1 -- 172.21.15.79:0/127653532 >> 172.21.15.79:0/127653532 conn(0x55ff45bcd760 msgr2=0x55ff45c16000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:14.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.827+0000 7f27b259e740 1 -- 172.21.15.79:0/127653532 shutdown_connections 2024-04-25T02:12:14.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.827+0000 7f27b259e740 1 -- 172.21.15.79:0/127653532 wait complete. 2024-04-25T02:12:14.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.827+0000 7f27b259e740 1 -- start start 2024-04-25T02:12:14.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.828+0000 7f27b259e740 1 Processor -- start 2024-04-25T02:12:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.828+0000 7f27b259e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bfbc80 0x55ff45bfe830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.828+0000 7f27b259e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45c18b60 0x55ff45bca250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.828+0000 7f27b259e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bca790 0x55ff45c13bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.828+0000 7f27b259e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ff45bcf910 con 0x55ff45bfbc80 2024-04-25T02:12:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.828+0000 7f27b259e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ff45aefcf0 con 0x55ff45bca790 2024-04-25T02:12:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.828+0000 7f27b259e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ff45bced00 con 0x55ff45c18b60 2024-04-25T02:12:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27b259e740 10 client.0 _ll_register_callbacks cb 0x55ff45aef6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27ad54c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bfbc80 0x55ff45bfe830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27ad54c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bfbc80 0x55ff45bfe830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58884/0 (socket says 172.21.15.79:58884) 2024-04-25T02:12:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27ad54c640 1 -- 172.21.15.79:0/3050690923 learned_addr learned my addr 172.21.15.79:0/3050690923 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27acd4b640 1 --2- 172.21.15.79:0/3050690923 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45c18b60 0x55ff45bca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27add4d640 1 --2- 172.21.15.79:0/3050690923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bca790 0x55ff45c13bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27ad54c640 1 -- 172.21.15.79:0/3050690923 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45c18b60 msgr2=0x55ff45bca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27ad54c640 1 --2- 172.21.15.79:0/3050690923 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45c18b60 0x55ff45bca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27ad54c640 1 -- 172.21.15.79:0/3050690923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bca790 msgr2=0x55ff45c13bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27ad54c640 1 --2- 172.21.15.79:0/3050690923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bca790 0x55ff45c13bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27ad54c640 1 -- 172.21.15.79:0/3050690923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff459126b0 con 0x55ff45bfbc80 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27add4d640 1 --2- 172.21.15.79:0/3050690923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bca790 0x55ff45c13bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27ad54c640 1 --2- 172.21.15.79:0/3050690923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bfbc80 0x55ff45bfe830 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f27a400c2d0 tx=0x7f27a4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53482265fc757f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f2787fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f2787fff640 1 -- 172.21.15.79:0/3050690923 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4042070 con 0x55ff45bfbc80 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f2787fff640 1 -- 172.21.15.79:0/3050690923 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7f27a403e830 con 0x55ff45bfbc80 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27b259e740 1 -- 172.21.15.79:0/3050690923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f279801f620 con 0x55ff45bfbc80 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f2787fff640 1 -- 172.21.15.79:0/3050690923 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f27a4059050 con 0x55ff45bfbc80 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27b259e740 10 client.6960 fetch_fsmap learned FSMap version 38 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f27b259e740 1 -- 172.21.15.79:0/3050690923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x55ff45bfcfd0 con 0x55ff45bfbc80 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f2787fff640 1 -- 172.21.15.79:0/3050690923 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f279801f620 con 0x55ff45bfbc80 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.829+0000 7f2787fff640 1 -- 172.21.15.79:0/3050690923 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 3494+0+0 (secure 0 0 0) 0x7f27a403ea30 con 0x55ff45bfbc80 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.830+0000 7f27b259e740 10 client.6960 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.830+0000 7f27b259e740 10 client.6960 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:12:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.830+0000 7f27b259e740 20 client.6960 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.830+0000 7f27b259e740 1 --2- 172.21.15.79:0/3050690923 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55ff45c26b50 0x55ff45c26f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.830+0000 7f27b259e740 4 client.6960 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.830+0000 7f27b259e740 1 -- 172.21.15.79:0/3050690923 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff45b41440 con 0x55ff45c26b50 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.830+0000 7f27acd4b640 1 --2- 172.21.15.79:0/3050690923 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55ff45c26b50 0x55ff45c26f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.830+0000 7f2787fff640 10 client.6960 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.830+0000 7f27acd4b640 1 --2- 172.21.15.79:0/3050690923 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55ff45c26b50 0x55ff45c26f30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=479aaf815a870e55 server_cookie=6ed82e912a5362db in_seq=0 out_seq=0 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.831+0000 7f2787fff640 1 -- 172.21.15.79:0/3050690923 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ff45b41440 con 0x55ff45c26b50 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.831+0000 7f2787fff640 10 client.6960 handle_command_reply: tid=0 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.831+0000 7f27b259e740 1 client.6960 shutdown 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.831+0000 7f27b259e740 1 -- 172.21.15.79:0/3050690923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bfbc80 msgr2=0x55ff45bfe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.831+0000 7f27b259e740 1 --2- 172.21.15.79:0/3050690923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bfbc80 0x55ff45bfe830 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f27a400c2d0 tx=0x7f27a4001a40 comp rx=0 tx=0).stop 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.831+0000 7f27b259e740 1 -- 172.21.15.79:0/3050690923 shutdown_connections 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.831+0000 7f27b259e740 1 --2- 172.21.15.79:0/3050690923 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55ff45c26b50 0x55ff45c26f30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.831+0000 7f27b259e740 1 --2- 172.21.15.79:0/3050690923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bca790 0x55ff45c13bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.831+0000 7f2787fff640 0 client.6960 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.831+0000 7f27b259e740 1 --2- 172.21.15.79:0/3050690923 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45c18b60 0x55ff45bca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.831+0000 7f27b259e740 1 --2- 172.21.15.79:0/3050690923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bfbc80 0x55ff45bfe830 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.831+0000 7f27b259e740 1 -- 172.21.15.79:0/3050690923 >> 172.21.15.79:0/3050690923 conn(0x55ff45bfb540 msgr2=0x55ff45bf8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.831+0000 7f27b259e740 1 -- 172.21.15.79:0/3050690923 shutdown_connections 2024-04-25T02:12:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.831+0000 7f27b259e740 1 -- 172.21.15.79:0/3050690923 wait complete. 2024-04-25T02:12:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.831+0000 7f27b259e740 20 client.6960 trim_cache size 0 max 16384 2024-04-25T02:12:14.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.849+0000 7f27b259e740 1 Processor -- start 2024-04-25T02:12:14.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.849+0000 7f27b259e740 1 -- start start 2024-04-25T02:12:14.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27b259e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bca790 0x55ff45c28ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27b259e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45bfbc80 0x55ff45bfdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27b259e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45c18b60 0x55ff45c25990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27b259e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27a81fba50 con 0x55ff45c18b60 2024-04-25T02:12:14.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27b259e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f27a80b3a70 con 0x55ff45bca790 2024-04-25T02:12:14.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27b259e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f27a81fb480 con 0x55ff45bfbc80 2024-04-25T02:12:14.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27add4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45c18b60 0x55ff45c25990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27add4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45c18b60 0x55ff45c25990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58896/0 (socket says 172.21.15.79:58896) 2024-04-25T02:12:14.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27add4d640 1 -- 172.21.15.79:0/2748065375 learned_addr learned my addr 172.21.15.79:0/2748065375 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:14.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27ad54c640 1 --2- 172.21.15.79:0/2748065375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bca790 0x55ff45c28ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27acd4b640 1 --2- 172.21.15.79:0/2748065375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45bfbc80 0x55ff45bfdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27add4d640 1 -- 172.21.15.79:0/2748065375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45bfbc80 msgr2=0x55ff45bfdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:14.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27add4d640 1 --2- 172.21.15.79:0/2748065375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45bfbc80 0x55ff45bfdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27add4d640 1 -- 172.21.15.79:0/2748065375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bca790 msgr2=0x55ff45c28ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:14.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27add4d640 1 --2- 172.21.15.79:0/2748065375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bca790 0x55ff45c28ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27add4d640 1 -- 172.21.15.79:0/2748065375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff45c0cc30 con 0x55ff45c18b60 2024-04-25T02:12:14.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27ad54c640 1 --2- 172.21.15.79:0/2748065375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bca790 0x55ff45c28ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:14.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27acd4b640 1 --2- 172.21.15.79:0/2748065375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45bfbc80 0x55ff45bfdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:14.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27add4d640 1 --2- 172.21.15.79:0/2748065375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45c18b60 0x55ff45c25990 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f27a0061f10 tx=0x7f27a0059460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be348d445f7db398 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:14.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27927fc640 1 -- 172.21.15.79:0/2748065375 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a005dc10 con 0x55ff45c18b60 2024-04-25T02:12:14.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27927fc640 1 -- 172.21.15.79:0/2748065375 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a0062440 con 0x55ff45c18b60 2024-04-25T02:12:14.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.850+0000 7f27927fc640 1 -- 172.21.15.79:0/2748065375 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0057b60 con 0x55ff45c18b60 2024-04-25T02:12:14.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.851+0000 7f27b259e740 1 -- 172.21.15.79:0/2748065375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45c18b60 msgr2=0x55ff45c25990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.851+0000 7f27b259e740 1 --2- 172.21.15.79:0/2748065375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45c18b60 0x55ff45c25990 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f27a0061f10 tx=0x7f27a0059460 comp rx=0 tx=0).stop 2024-04-25T02:12:14.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.851+0000 7f27b259e740 1 -- 172.21.15.79:0/2748065375 shutdown_connections 2024-04-25T02:12:14.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.851+0000 7f27b259e740 1 --2- 172.21.15.79:0/2748065375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45c18b60 0x55ff45c25990 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.851+0000 7f27b259e740 1 --2- 172.21.15.79:0/2748065375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45bfbc80 0x55ff45bfdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.851+0000 7f27b259e740 1 --2- 172.21.15.79:0/2748065375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bca790 0x55ff45c28ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.851+0000 7f27b259e740 1 -- 172.21.15.79:0/2748065375 >> 172.21.15.79:0/2748065375 conn(0x55ff45bfb540 msgr2=0x55ff45bc6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:14.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.851+0000 7f27b259e740 1 -- 172.21.15.79:0/2748065375 shutdown_connections 2024-04-25T02:12:14.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.851+0000 7f27b259e740 1 -- 172.21.15.79:0/2748065375 wait complete. 2024-04-25T02:12:14.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.851+0000 7f27b259e740 1 -- start start 2024-04-25T02:12:14.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.851+0000 7f27b259e740 1 Processor -- start 2024-04-25T02:12:14.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.852+0000 7f27b259e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bca790 0x55ff45c8afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.852+0000 7f27b259e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bfbc80 0x55ff45c24700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.852+0000 7f27b259e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45c18b60 0x55ff45c25990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.852+0000 7f27b259e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ff45bfc170 con 0x55ff45bca790 2024-04-25T02:12:14.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.852+0000 7f27b259e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ff45c27670 con 0x55ff45bfbc80 2024-04-25T02:12:14.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.852+0000 7f27b259e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ff45c145c0 con 0x55ff45c18b60 2024-04-25T02:12:14.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.852+0000 7f27b259e740 10 client.0 _ll_register_callbacks cb 0x7f2798009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:14.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.852+0000 7f27ad54c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bca790 0x55ff45c8afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.852+0000 7f27ad54c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bca790 0x55ff45c8afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58904/0 (socket says 172.21.15.79:58904) 2024-04-25T02:12:14.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.852+0000 7f27ad54c640 1 -- 172.21.15.79:0/3866871920 learned_addr learned my addr 172.21.15.79:0/3866871920 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:14.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27ad54c640 1 -- 172.21.15.79:0/3866871920 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45c18b60 msgr2=0x55ff45c25990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:14.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27ad54c640 1 --2- 172.21.15.79:0/3866871920 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45c18b60 0x55ff45c25990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27acd4b640 1 --2- 172.21.15.79:0/3866871920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bfbc80 0x55ff45c24700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27ad54c640 1 -- 172.21.15.79:0/3866871920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bfbc80 msgr2=0x55ff45c24700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:14.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27ad54c640 1 --2- 172.21.15.79:0/3866871920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bfbc80 0x55ff45c24700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27ad54c640 1 -- 172.21.15.79:0/3866871920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff45c15bc0 con 0x55ff45bca790 2024-04-25T02:12:14.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27ad54c640 1 --2- 172.21.15.79:0/3866871920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bca790 0x55ff45c8afb0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f27a4008f30 tx=0x7f27a4007970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be53ae5bd67cb49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:14.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f2787fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:14.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f2787fff640 1 -- 172.21.15.79:0/3866871920 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4042070 con 0x55ff45bca790 2024-04-25T02:12:14.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f2787fff640 1 -- 172.21.15.79:0/3866871920 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7f27a4067470 con 0x55ff45bca790 2024-04-25T02:12:14.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27b259e740 1 -- 172.21.15.79:0/3866871920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27a0062440 con 0x55ff45bca790 2024-04-25T02:12:14.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f2787fff640 1 -- 172.21.15.79:0/3866871920 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f27a406f050 con 0x55ff45bca790 2024-04-25T02:12:14.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27b259e740 10 client.6966 fetch_fsmap learned FSMap version 38 2024-04-25T02:12:14.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27b259e740 1 -- 172.21.15.79:0/3866871920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x55ff45c918a0 con 0x55ff45bca790 2024-04-25T02:12:14.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f2787fff640 1 -- 172.21.15.79:0/3866871920 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a0062440 con 0x55ff45bca790 2024-04-25T02:12:14.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f2787fff640 1 -- 172.21.15.79:0/3866871920 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 3494+0+0 (secure 0 0 0) 0x7f27a4072020 con 0x55ff45bca790 2024-04-25T02:12:14.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27b259e740 10 client.6966 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T02:12:14.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27b259e740 10 client.6966 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:12:14.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27b259e740 20 client.6966 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:14.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27b259e740 1 --2- 172.21.15.79:0/3866871920 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55ff45c0bb90 0x55ff45c0bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27b259e740 4 client.6966 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:12:14.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.853+0000 7f27b259e740 1 -- 172.21.15.79:0/3866871920 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "status"}) -- 0x55ff45b3b790 con 0x55ff45c0bb90 2024-04-25T02:12:14.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f27acd4b640 1 --2- 172.21.15.79:0/3866871920 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55ff45c0bb90 0x55ff45c0bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f2787fff640 10 client.6966 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:14.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f27acd4b640 1 --2- 172.21.15.79:0/3866871920 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55ff45c0bb90 0x55ff45c0bf70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acca8d8098f86713 server_cookie=23bc46b6ac9c7c35 in_seq=0 out_seq=0 2024-04-25T02:12:14.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f2787fff640 1 -- 172.21.15.79:0/3866871920 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55ff45b3b790 con 0x55ff45c0bb90 2024-04-25T02:12:14.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f2787fff640 10 client.6966 handle_command_reply: tid=0 2024-04-25T02:12:14.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f27b259e740 1 client.6966 shutdown 2024-04-25T02:12:14.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f27b259e740 1 -- 172.21.15.79:0/3866871920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bca790 msgr2=0x55ff45c8afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f27b259e740 1 --2- 172.21.15.79:0/3866871920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bca790 0x55ff45c8afb0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f27a4008f30 tx=0x7f27a4007970 comp rx=0 tx=0).stop 2024-04-25T02:12:14.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f27b259e740 1 -- 172.21.15.79:0/3866871920 shutdown_connections 2024-04-25T02:12:14.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f27b259e740 1 --2- 172.21.15.79:0/3866871920 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55ff45c0bb90 0x55ff45c0bf70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f27b259e740 1 --2- 172.21.15.79:0/3866871920 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ff45c18b60 0x55ff45c25990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f27b259e740 1 --2- 172.21.15.79:0/3866871920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff45bfbc80 0x55ff45c24700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f27b259e740 1 --2- 172.21.15.79:0/3866871920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff45bca790 0x55ff45c8afb0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f2787fff640 0 client.6966 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:14.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f27b259e740 1 -- 172.21.15.79:0/3866871920 >> 172.21.15.79:0/3866871920 conn(0x55ff45bfb540 msgr2=0x55ff45bfe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:14.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f27b259e740 1 -- 172.21.15.79:0/3866871920 shutdown_connections 2024-04-25T02:12:14.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f27b259e740 1 -- 172.21.15.79:0/3866871920 wait complete. 2024-04-25T02:12:14.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.854+0000 7f27b259e740 20 client.6966 trim_cache size 0 max 16384 2024-04-25T02:12:14.868 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:12:14.868 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "696648c4-3e52-400b-a780-2e8863c56c42", 2024-04-25T02:12:14.868 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-04-25T02:12:14.868 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6696, 2024-04-25T02:12:14.868 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-04-25T02:12:14.868 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-04-25T02:12:14.868 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-04-25T02:12:14.868 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.3730361719999999, 2024-04-25T02:12:14.868 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 38, 2024-04-25T02:12:14.869 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 72, 2024-04-25T02:12:14.869 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 72, 2024-04-25T02:12:14.869 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 23.323320067000001 2024-04-25T02:12:14.869 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:12:14.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.855+0000 7f27af7b0640 1 -- 172.21.15.79:0/954255901 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f278c06be60 msgr2=0x7f278c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.855+0000 7f27af7b0640 1 --2- 172.21.15.79:0/954255901 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f278c06be60 0x7f278c06e320 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f27a4033000 tx=0x7f27a4009030 comp rx=0 tx=0).stop 2024-04-25T02:12:14.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.855+0000 7f27af7b0640 1 -- 172.21.15.79:0/954255901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a81f26f0 msgr2=0x7f27a81f2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.855+0000 7f27af7b0640 1 --2- 172.21.15.79:0/954255901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a81f26f0 0x7f27a81f2ba0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f27a80b2a00 tx=0x7f27a0010590 comp rx=0 tx=0).stop 2024-04-25T02:12:14.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.855+0000 7f27af7b0640 1 -- 172.21.15.79:0/954255901 shutdown_connections 2024-04-25T02:12:14.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.855+0000 7f27af7b0640 1 --2- 172.21.15.79:0/954255901 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f278c06be60 0x7f278c06e320 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.855+0000 7f27af7b0640 1 --2- 172.21.15.79:0/954255901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a81f26f0 0x7f27a81f2ba0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.855+0000 7f27af7b0640 1 --2- 172.21.15.79:0/954255901 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27a8156500 0x7f27a81f0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.855+0000 7f27af7b0640 1 --2- 172.21.15.79:0/954255901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27940039b0 0x7f27a81efc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.855+0000 7f27af7b0640 1 -- 172.21.15.79:0/954255901 >> 172.21.15.79:0/954255901 conn(0x7f27a80cfc80 msgr2=0x7f27a8070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:14.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.855+0000 7f27af7b0640 1 -- 172.21.15.79:0/954255901 shutdown_connections 2024-04-25T02:12:14.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.855+0000 7f27af7b0640 1 -- 172.21.15.79:0/954255901 wait complete. 2024-04-25T02:12:14.872 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:12:14.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.961+0000 7fb7eb3f9640 1 Processor -- start 2024-04-25T02:12:14.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.961+0000 7fb7eb3f9640 1 -- start start 2024-04-25T02:12:14.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.962+0000 7fb7eb3f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7e4143bc0 0x7fb7e415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.962+0000 7fb7eb3f9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb7e40b3d40 0x7fb7e406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.962+0000 7fb7eb3f9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e415fa40 con 0x7fb7e406df50 2024-04-25T02:12:14.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.962+0000 7fb7eb3f9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb7e406e8f0 con 0x7fb7e40b3d40 2024-04-25T02:12:14.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.962+0000 7fb7eb3f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e4072cb0 con 0x7fb7e4143bc0 2024-04-25T02:12:14.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.962+0000 7fb7e9996640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb7e40b3d40 0x7fb7e406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.962+0000 7fb7e9996640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb7e40b3d40 0x7fb7e406e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58920/0 (socket says 172.21.15.79:58920) 2024-04-25T02:12:14.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.962+0000 7fb7e9996640 1 -- 172.21.15.79:0/11827787 learned_addr learned my addr 172.21.15.79:0/11827787 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:14.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.963+0000 7fb7e9996640 1 -- 172.21.15.79:0/11827787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7e4143bc0 msgr2=0x7fb7e415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:14.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.963+0000 7fb7e9996640 1 --2- 172.21.15.79:0/11827787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7e4143bc0 0x7fb7e415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.963+0000 7fb7e9996640 1 -- 172.21.15.79:0/11827787 >> v1:172.21.15.189:6789/0 conn(0x7fb7e406df50 legacy=0x7fb7e40b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:14.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.963+0000 7fb7e9996640 1 -- 172.21.15.79:0/11827787 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e4071e00 con 0x7fb7e40b3d40 2024-04-25T02:12:14.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.963+0000 7fb7e9996640 1 --2- 172.21.15.79:0/11827787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7e40b3d40 0x7fb7e406e3b0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00bb10 tx=0x7fb7dc02c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1572b50de78de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:14.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.963+0000 7fb7dbfff640 1 -- 172.21.15.79:0/11827787 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc03a070 con 0x7fb7e40b3d40 2024-04-25T02:12:14.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.963+0000 7fb7dbfff640 1 -- 172.21.15.79:0/11827787 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7dc0326f0 con 0x7fb7e40b3d40 2024-04-25T02:12:14.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.963+0000 7fb7dbfff640 1 -- 172.21.15.79:0/11827787 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc032ac0 con 0x7fb7e40b3d40 2024-04-25T02:12:14.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.964+0000 7fb7eb3f9640 1 -- 172.21.15.79:0/11827787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7e40b3d40 msgr2=0x7fb7e406e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.964+0000 7fb7eb3f9640 1 --2- 172.21.15.79:0/11827787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7e40b3d40 0x7fb7e406e3b0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00bb10 tx=0x7fb7dc02c830 comp rx=0 tx=0).stop 2024-04-25T02:12:14.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.964+0000 7fb7eb3f9640 1 -- 172.21.15.79:0/11827787 shutdown_connections 2024-04-25T02:12:14.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.964+0000 7fb7eb3f9640 1 --2- 172.21.15.79:0/11827787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7e40b3d40 0x7fb7e406e3b0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.964+0000 7fb7eb3f9640 1 --2- 172.21.15.79:0/11827787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7e4143bc0 0x7fb7e415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.964+0000 7fb7eb3f9640 1 -- 172.21.15.79:0/11827787 >> 172.21.15.79:0/11827787 conn(0x7fb7e40cfc80 msgr2=0x7fb7e40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:14.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.964+0000 7fb7eb3f9640 1 -- 172.21.15.79:0/11827787 shutdown_connections 2024-04-25T02:12:14.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.964+0000 7fb7eb3f9640 1 -- 172.21.15.79:0/11827787 wait complete. 2024-04-25T02:12:14.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.965+0000 7fb7eb3f9640 1 Processor -- start 2024-04-25T02:12:14.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.965+0000 7fb7eb3f9640 1 -- start start 2024-04-25T02:12:14.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7eb3f9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7e406df50 0x7fb7e40ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7eb3f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7e40b3d40 0x7fb7e40c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7eb3f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7e4143bc0 0x7fb7e40c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7eb3f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e4072660 con 0x7fb7e4143bc0 2024-04-25T02:12:14.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7eb3f9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e4072380 con 0x7fb7e406df50 2024-04-25T02:12:14.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7eb3f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e4072940 con 0x7fb7e40b3d40 2024-04-25T02:12:14.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7e9996640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7e4143bc0 0x7fb7e40c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7e9996640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7e4143bc0 0x7fb7e40c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58924/0 (socket says 172.21.15.79:58924) 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7e9996640 1 -- 172.21.15.79:0/2113381689 learned_addr learned my addr 172.21.15.79:0/2113381689 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7e9195640 1 --2- 172.21.15.79:0/2113381689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7e406df50 0x7fb7e40ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7e8994640 1 --2- 172.21.15.79:0/2113381689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7e40b3d40 0x7fb7e40c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7e9996640 1 -- 172.21.15.79:0/2113381689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7e40b3d40 msgr2=0x7fb7e40c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7e9996640 1 --2- 172.21.15.79:0/2113381689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7e40b3d40 0x7fb7e40c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7e9996640 1 -- 172.21.15.79:0/2113381689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7e406df50 msgr2=0x7fb7e40ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7e9996640 1 --2- 172.21.15.79:0/2113381689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7e406df50 0x7fb7e40ae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.966+0000 7fb7e9996640 1 -- 172.21.15.79:0/2113381689 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e40aebc0 con 0x7fb7e4143bc0 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.967+0000 7fb7e9996640 1 --2- 172.21.15.79:0/2113381689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7e4143bc0 0x7fb7e40c67a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00bb10 tx=0x7fb7dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.967+0000 7fb7d9ffb640 1 -- 172.21.15.79:0/2113381689 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc03a040 con 0x7fb7e4143bc0 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.967+0000 7fb7d9ffb640 1 -- 172.21.15.79:0/2113381689 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7dc045070 con 0x7fb7e4143bc0 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.967+0000 7fb7eb3f9640 1 -- 172.21.15.79:0/2113381689 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e40c5080 con 0x7fb7e4143bc0 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.967+0000 7fb7d9ffb640 1 -- 172.21.15.79:0/2113381689 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0358c0 con 0x7fb7e4143bc0 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.967+0000 7fb7eb3f9640 1 -- 172.21.15.79:0/2113381689 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e40c5640 con 0x7fb7e4143bc0 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.968+0000 7fb7eb3f9640 1 -- 172.21.15.79:0/2113381689 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e40690a0 con 0x7fb7e4143bc0 2024-04-25T02:12:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.968+0000 7fb7d9ffb640 1 -- 172.21.15.79:0/2113381689 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7dc032530 con 0x7fb7e4143bc0 2024-04-25T02:12:14.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.969+0000 7fb7d9ffb640 1 --2- 172.21.15.79:0/2113381689 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7c806be30 0x7fb7c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:14.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.969+0000 7fb7d9ffb640 1 -- 172.21.15.79:0/2113381689 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7fb7dc0abb60 con 0x7fb7e4143bc0 2024-04-25T02:12:14.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.969+0000 7fb7e9195640 1 --2- 172.21.15.79:0/2113381689 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7c806be30 0x7fb7c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:14.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.969+0000 7fb7e9195640 1 --2- 172.21.15.79:0/2113381689 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7c806be30 0x7fb7c806e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009f20 tx=0x7fb7e00094f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:14.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:14.973+0000 7fb7d9ffb640 1 -- 172.21.15.79:0/2113381689 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb7e415fa40 con 0x7fb7e4143bc0 2024-04-25T02:12:15.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15.181+0000 7fb7eb3f9640 1 -- 172.21.15.79:0/2113381689 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb7e40d0310 con 0x7fb7e4143bc0 2024-04-25T02:12:15.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15.182+0000 7fb7d9ffb640 1 -- 172.21.15.79:0/2113381689 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) ==== 53+0+73 (secure 0 0 0) 0x7fb7dc07a430 con 0x7fb7e4143bc0 2024-04-25T02:12:15.189 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:12:15.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15.184+0000 7fb7eb3f9640 1 -- 172.21.15.79:0/2113381689 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7c806be30 msgr2=0x7fb7c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:15.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15.184+0000 7fb7eb3f9640 1 --2- 172.21.15.79:0/2113381689 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7c806be30 0x7fb7c806e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009f20 tx=0x7fb7e00094f0 comp rx=0 tx=0).stop 2024-04-25T02:12:15.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15.184+0000 7fb7eb3f9640 1 -- 172.21.15.79:0/2113381689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7e4143bc0 msgr2=0x7fb7e40c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:15.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15.184+0000 7fb7eb3f9640 1 --2- 172.21.15.79:0/2113381689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7e4143bc0 0x7fb7e40c67a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00bb10 tx=0x7fb7dc004730 comp rx=0 tx=0).stop 2024-04-25T02:12:15.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15.184+0000 7fb7eb3f9640 1 -- 172.21.15.79:0/2113381689 shutdown_connections 2024-04-25T02:12:15.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15.184+0000 7fb7eb3f9640 1 --2- 172.21.15.79:0/2113381689 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7c806be30 0x7fb7c806e2f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:15.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15.184+0000 7fb7eb3f9640 1 --2- 172.21.15.79:0/2113381689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7e4143bc0 0x7fb7e40c67a0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:15.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15.184+0000 7fb7eb3f9640 1 --2- 172.21.15.79:0/2113381689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7e40b3d40 0x7fb7e40c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:15.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15.184+0000 7fb7eb3f9640 1 --2- 172.21.15.79:0/2113381689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7e406df50 0x7fb7e40ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:15.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15.184+0000 7fb7eb3f9640 1 -- 172.21.15.79:0/2113381689 >> 172.21.15.79:0/2113381689 conn(0x7fb7e40cfc80 msgr2=0x7fb7e4143fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:15.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15.184+0000 7fb7eb3f9640 1 -- 172.21.15.79:0/2113381689 shutdown_connections 2024-04-25T02:12:15.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15.184+0000 7fb7eb3f9640 1 -- 172.21.15.79:0/2113381689 wait complete. 2024-04-25T02:12:15.201 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:12:15.201 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:12:15.202 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:12:15.202 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:12:15.202 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:15.202 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:12:15.202 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:12:15.202 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:12:15.202 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:12:15.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:15.202 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:12:15.217 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:12:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:12:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:12:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:12:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:15.218 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:12:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:12:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:12:15.218 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:12:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:12:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:12:15.218 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:12:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:12:15.218 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:12:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:12:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:12:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42471sec preferred_lft 42471sec 2024-04-25T02:12:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:12:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:15.219 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:12:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:12:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:12:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:12:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:15.219 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:12:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:12:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link 2024-04-25T02:12:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:15.219 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:12:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:12:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::4c:adff:fe56:7194/64 scope link 2024-04-25T02:12:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:15.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:15.220 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:12:15.280 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:12:15.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:15.281 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:12:15.337 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:12:15.337 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:12:15.337 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:12:15.337 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:12:15.337 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:12:15.338 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:12:15.338 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:12:15.338 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:12:15.338 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:12:15.338 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:12:15.338 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:12:15.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:12:15.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:12:15.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:15.460 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:12:15.475 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:12:15.475 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:12:15.475 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:12:15.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:15.475 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:12:15.538 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:12:15.538 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:15.593 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:12:15.593 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:12:15.593 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:15.647 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:12:15.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:15.648 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:12:15.728 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:12:15.728 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:12:15.728 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:12:15.736 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:12:15.736 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:12:15.736 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:12:15.736 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:12:15.736 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:12:15.741 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:12:15.742 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:12:15.742 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:12:15.742 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:12:15.742 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:12:15.742 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:12:15.742 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:12:15.742 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:12:15.742 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:12:15.743 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:12:15.743 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:12:15.743 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:12:15.743 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:12:15.744 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:12:15.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:15.744 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:15.806 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:12:15.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:12:15.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:12:15.901 INFO:teuthology.orchestra.run.smithi079.stdout:client5947 2024-04-25T02:12:15.901 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:12:15.901 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:12:15.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:15.916 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2024-04-25T02:12:15.973 INFO:teuthology.orchestra.run.smithi079.stdout:file_undamaged 2024-04-25T02:12:15.974 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:12:15.974 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:12:15.974 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:12:15.974 DEBUG:teuthology.orchestra.run.smithi079:> import json 2024-04-25T02:12:15.974 DEBUG:teuthology.orchestra.run.smithi079:> import sys 2024-04-25T02:12:15.974 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:12:15.974 DEBUG:teuthology.orchestra.run.smithi079:> try: 2024-04-25T02:12:15.974 DEBUG:teuthology.orchestra.run.smithi079:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-04-25T02:12:15.974 DEBUG:teuthology.orchestra.run.smithi079:> except OSError as e: 2024-04-25T02:12:15.974 DEBUG:teuthology.orchestra.run.smithi079:> sys.exit(e.errno) 2024-04-25T02:12:15.974 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:12:15.974 DEBUG:teuthology.orchestra.run.smithi079:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-25T02:12:15.974 DEBUG:teuthology.orchestra.run.smithi079:> print(json.dumps( 2024-04-25T02:12:15.975 DEBUG:teuthology.orchestra.run.smithi079:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-25T02:12:15.975 DEBUG:teuthology.orchestra.run.smithi079:> indent=2)) 2024-04-25T02:12:15.975 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:12:16.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-04-25T02:12:16.088 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-25T02:12:16.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:16.089 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-25T02:12:16.144 INFO:teuthology.orchestra.run.smithi079.stdout:2 2024-04-25T02:12:16.144 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:12:16.144 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:12:16.200 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:12:16.200 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:12:16.256 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:12:16.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.384+0000 7f46c1cee640 1 Processor -- start 2024-04-25T02:12:16.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.385+0000 7f46c1cee640 1 -- start start 2024-04-25T02:12:16.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.385+0000 7f46c1cee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46bc0ce860 0x7f46bc0d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.385+0000 7f46c1cee640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46bc0d14e0 con 0x7f46bc0d29a0 2024-04-25T02:12:16.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.385+0000 7f46c1cee640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46bc0cc570 con 0x7f46bc15daf0 2024-04-25T02:12:16.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.385+0000 7f46c1cee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f46bc0ce340 con 0x7f46bc0ce860 2024-04-25T02:12:16.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.385+0000 7f46bb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46bc0ce860 0x7f46bc0d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.385+0000 7f46b3fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f46bc0d29a0 0x7f46bc0cec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55560/0 (socket says 172.21.15.79:55560) 2024-04-25T02:12:16.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.385+0000 7f46b3fff640 1 -- 172.21.15.79:0/4097790084 learned_addr learned my addr 172.21.15.79:0/4097790084 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:16.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.386+0000 7f46bb7fe640 1 -- 172.21.15.79:0/4097790084 >> v1:172.21.15.189:6789/0 conn(0x7f46bc15daf0 legacy=0x7f46bc15df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:16.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.386+0000 7f46bb7fe640 1 -- 172.21.15.79:0/4097790084 >> v1:172.21.15.79:6789/0 conn(0x7f46bc0d29a0 legacy=0x7f46bc0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:16.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.386+0000 7f46bb7fe640 1 -- 172.21.15.79:0/4097790084 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46bc0cc850 con 0x7f46bc0ce860 2024-04-25T02:12:16.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.386+0000 7f46bb7fe640 1 --2- 172.21.15.79:0/4097790084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc0ce860 0x7f46bc0d0150 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0097d0 tx=0x7f46ac02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55a6ec112d4842f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:16.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.387+0000 7f46baffd640 1 -- 172.21.15.79:0/4097790084 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac037070 con 0x7f46bc0ce860 2024-04-25T02:12:16.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.387+0000 7f46baffd640 1 -- 172.21.15.79:0/4097790084 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46ac032440 con 0x7f46bc0ce860 2024-04-25T02:12:16.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.387+0000 7f46baffd640 1 -- 172.21.15.79:0/4097790084 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac032810 con 0x7f46bc0ce860 2024-04-25T02:12:16.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.387+0000 7f46c1cee640 1 -- 172.21.15.79:0/4097790084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc0ce860 msgr2=0x7f46bc0d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:16.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.387+0000 7f46c1cee640 1 --2- 172.21.15.79:0/4097790084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc0ce860 0x7f46bc0d0150 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0097d0 tx=0x7f46ac02a210 comp rx=0 tx=0).stop 2024-04-25T02:12:16.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.387+0000 7f46c1cee640 1 -- 172.21.15.79:0/4097790084 shutdown_connections 2024-04-25T02:12:16.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.387+0000 7f46c1cee640 1 --2- 172.21.15.79:0/4097790084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc0ce860 0x7f46bc0d0150 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.387+0000 7f46c1cee640 1 -- 172.21.15.79:0/4097790084 >> 172.21.15.79:0/4097790084 conn(0x7f46bc0d1e80 msgr2=0x7f46bc0d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:16.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.387+0000 7f46c1cee640 1 -- 172.21.15.79:0/4097790084 shutdown_connections 2024-04-25T02:12:16.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.387+0000 7f46c1cee640 1 -- 172.21.15.79:0/4097790084 wait complete. 2024-04-25T02:12:16.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.388+0000 7f46c1cee640 1 Processor -- start 2024-04-25T02:12:16.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.388+0000 7f46c1cee640 1 -- start start 2024-04-25T02:12:16.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46c1cee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46bc0ce860 0x7f46bc0c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46c1cee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46bc0d29a0 0x7f46bc0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46c1cee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc15daf0 0x7f46bc0ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46c1cee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc06c1c0 con 0x7f46bc15daf0 2024-04-25T02:12:16.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46c1cee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc0cce10 con 0x7f46bc0d29a0 2024-04-25T02:12:16.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46c1cee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f46bc158290 con 0x7f46bc0ce860 2024-04-25T02:12:16.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc15daf0 0x7f46bc0ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc15daf0 0x7f46bc0ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58934/0 (socket says 172.21.15.79:58934) 2024-04-25T02:12:16.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46bbfff640 1 -- 172.21.15.79:0/2951399392 learned_addr learned my addr 172.21.15.79:0/2951399392 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:16.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46bb7fe640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46bc0ce860 0x7f46bc0c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46b3fff640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46bc0d29a0 0x7f46bc0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46bbfff640 1 -- 172.21.15.79:0/2951399392 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46bc0ce860 msgr2=0x7f46bc0c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:16.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46bbfff640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46bc0ce860 0x7f46bc0c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46bbfff640 1 -- 172.21.15.79:0/2951399392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46bc0d29a0 msgr2=0x7f46bc0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:16.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46bbfff640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46bc0d29a0 0x7f46bc0ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46bbfff640 1 -- 172.21.15.79:0/2951399392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46bc1584e0 con 0x7f46bc15daf0 2024-04-25T02:12:16.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46bb7fe640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46bc0ce860 0x7f46bc0c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:16.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.389+0000 7f46b3fff640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46bc0d29a0 0x7f46bc0ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:16.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.390+0000 7f46bbfff640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc15daf0 0x7f46bc0ca870 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f46b400b9a0 tx=0x7f46b400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:16.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.390+0000 7f46b8ff9640 1 -- 172.21.15.79:0/2951399392 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b4019070 con 0x7f46bc15daf0 2024-04-25T02:12:16.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.390+0000 7f46b8ff9640 1 -- 172.21.15.79:0/2951399392 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b400cba0 con 0x7f46bc15daf0 2024-04-25T02:12:16.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.390+0000 7f46c1cee640 1 -- 172.21.15.79:0/2951399392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46bc1587c0 con 0x7f46bc15daf0 2024-04-25T02:12:16.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.390+0000 7f46b8ff9640 1 -- 172.21.15.79:0/2951399392 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b4014440 con 0x7f46bc15daf0 2024-04-25T02:12:16.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.390+0000 7f46c1cee640 1 -- 172.21.15.79:0/2951399392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46bc158d80 con 0x7f46bc15daf0 2024-04-25T02:12:16.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.391+0000 7f46c1cee640 1 -- 172.21.15.79:0/2951399392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46bc0690a0 con 0x7f46bc15daf0 2024-04-25T02:12:16.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.391+0000 7f46b8ff9640 1 -- 172.21.15.79:0/2951399392 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46b401c070 con 0x7f46bc15daf0 2024-04-25T02:12:16.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.391+0000 7f46b8ff9640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f469c06be30 0x7f469c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.391+0000 7f46bb7fe640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f469c06be30 0x7f469c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.391+0000 7f46b8ff9640 1 -- 172.21.15.79:0/2951399392 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7f46b408ab20 con 0x7f46bc15daf0 2024-04-25T02:12:16.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.392+0000 7f46bb7fe640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f469c06be30 0x7f469c06e2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f46ac034000 tx=0x7f46ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:16.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.396+0000 7f46b8ff9640 1 -- 172.21.15.79:0/2951399392 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f46b4059470 con 0x7f46bc15daf0 2024-04-25T02:12:16.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.568+0000 7f46c1cee640 1 -- 172.21.15.79:0/2951399392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46bc15d810 con 0x7f46bc15daf0 2024-04-25T02:12:16.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.570+0000 7f46b8ff9640 1 -- 172.21.15.79:0/2951399392 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16809 (secure 0 0 0) 0x7f46b4058d70 con 0x7f46bc15daf0 2024-04-25T02:12:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:12:16.577 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":72,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:12:09.471273+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:11:54.161817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T02:11:54.917049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.189:6835/469348969":"2024-04-26T02:12:09.471251+0000","172.21.15.189:6833/469348969":"2024-04-26T02:12:09.471251+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:12:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.572+0000 7f46c1cee640 1 -- 172.21.15.79:0/2951399392 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f469c06be30 msgr2=0x7f469c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.572+0000 7f46c1cee640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f469c06be30 0x7f469c06e2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f46ac034000 tx=0x7f46ac02e000 comp rx=0 tx=0).stop 2024-04-25T02:12:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.572+0000 7f46c1cee640 1 -- 172.21.15.79:0/2951399392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc15daf0 msgr2=0x7f46bc0ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.572+0000 7f46c1cee640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc15daf0 0x7f46bc0ca870 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f46b400b9a0 tx=0x7f46b400be60 comp rx=0 tx=0).stop 2024-04-25T02:12:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.572+0000 7f46c1cee640 1 -- 172.21.15.79:0/2951399392 shutdown_connections 2024-04-25T02:12:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.572+0000 7f46c1cee640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f469c06be30 0x7f469c06e2f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.572+0000 7f46c1cee640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc15daf0 0x7f46bc0ca870 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.572+0000 7f46c1cee640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46bc0d29a0 0x7f46bc0ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.572+0000 7f46c1cee640 1 --2- 172.21.15.79:0/2951399392 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f46bc0ce860 0x7f46bc0c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.572+0000 7f46c1cee640 1 -- 172.21.15.79:0/2951399392 >> 172.21.15.79:0/2951399392 conn(0x7f46bc0d1e80 msgr2=0x7f46bc0d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:16.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.572+0000 7f46c1cee640 1 -- 172.21.15.79:0/2951399392 shutdown_connections 2024-04-25T02:12:16.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.572+0000 7f46c1cee640 1 -- 172.21.15.79:0/2951399392 wait complete. 2024-04-25T02:12:16.589 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:11:54.161817+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:11:54.917049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:12:16.590 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:12:16.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.682+0000 7fdddd990640 1 Processor -- start 2024-04-25T02:12:16.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.682+0000 7fdddd990640 1 -- start start 2024-04-25T02:12:16.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.683+0000 7fdddd990640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fddd80b5610 0x7fddd80d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.683+0000 7fdddd990640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fddd80d2970 0x7fddd80b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.683+0000 7fdddd990640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd80cf5f0 con 0x7fddd815e6d0 2024-04-25T02:12:16.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.683+0000 7fdddd990640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fddd80cf8d0 con 0x7fddd80d2970 2024-04-25T02:12:16.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.683+0000 7fdddd990640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fddd80cfbb0 con 0x7fddd80b5610 2024-04-25T02:12:16.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.683+0000 7fddd6ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fddd815e6d0 0x7fddd80cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55570/0 (socket says 172.21.15.79:55570) 2024-04-25T02:12:16.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.683+0000 7fddd6ffd640 1 -- 172.21.15.79:0/313414181 learned_addr learned my addr 172.21.15.79:0/313414181 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:16.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.683+0000 7fddd77fe640 1 --2- 172.21.15.79:0/313414181 >> v2:172.21.15.79:3300/0 conn(0x7fddd80d2970 0x7fddd80b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.683+0000 7fddcffff640 1 --2- 172.21.15.79:0/313414181 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fddd80b5610 0x7fddd80d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.683+0000 7fddd77fe640 1 -- 172.21.15.79:0/313414181 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fddd80b5610 msgr2=0x7fddd80d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.683+0000 7fddd77fe640 1 --2- 172.21.15.79:0/313414181 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fddd80b5610 0x7fddd80d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.683+0000 7fddd77fe640 1 -- 172.21.15.79:0/313414181 >> v1:172.21.15.79:6789/0 conn(0x7fddd815e6d0 legacy=0x7fddd80cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.683+0000 7fddd77fe640 1 -- 172.21.15.79:0/313414181 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd80cfe90 con 0x7fddd80d2970 2024-04-25T02:12:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.683+0000 7fddd67fc640 1 -- 172.21.15.79:0/313414181 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 825801597 0 0) 0x7fddd80cf5f0 con 0x7fddd815e6d0 2024-04-25T02:12:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.683+0000 7fddcffff640 1 --2- 172.21.15.79:0/313414181 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fddd80b5610 0x7fddd80d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.684+0000 7fddd77fe640 1 --2- 172.21.15.79:0/313414181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd80d2970 0x7fddd80b3780 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009d90 tx=0x7fddd002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39724a0616eb35f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.684+0000 7fddd67fc640 1 -- 172.21.15.79:0/313414181 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0007740 con 0x7fddd80d2970 2024-04-25T02:12:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.684+0000 7fddd67fc640 1 -- 172.21.15.79:0/313414181 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd00078e0 con 0x7fddd80d2970 2024-04-25T02:12:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.684+0000 7fddd67fc640 1 -- 172.21.15.79:0/313414181 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0007cb0 con 0x7fddd80d2970 2024-04-25T02:12:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.685+0000 7fdddd990640 1 -- 172.21.15.79:0/313414181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd80d2970 msgr2=0x7fddd80b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.685+0000 7fdddd990640 1 --2- 172.21.15.79:0/313414181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd80d2970 0x7fddd80b3780 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009d90 tx=0x7fddd002a660 comp rx=0 tx=0).stop 2024-04-25T02:12:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.685+0000 7fdddd990640 1 -- 172.21.15.79:0/313414181 shutdown_connections 2024-04-25T02:12:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.685+0000 7fdddd990640 1 --2- 172.21.15.79:0/313414181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd80d2970 0x7fddd80b3780 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.685+0000 7fdddd990640 1 --2- 172.21.15.79:0/313414181 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fddd80b5610 0x7fddd80d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.685+0000 7fdddd990640 1 -- 172.21.15.79:0/313414181 >> 172.21.15.79:0/313414181 conn(0x7fddd809d3e0 msgr2=0x7fddd80d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.685+0000 7fdddd990640 1 -- 172.21.15.79:0/313414181 shutdown_connections 2024-04-25T02:12:16.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.685+0000 7fdddd990640 1 -- 172.21.15.79:0/313414181 wait complete. 2024-04-25T02:12:16.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.686+0000 7fdddd990640 1 Processor -- start 2024-04-25T02:12:16.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.686+0000 7fdddd990640 1 -- start start 2024-04-25T02:12:16.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fdddd990640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd80b5610 0x7fddd80ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fdddd990640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fddd80d2970 0x7fddd81f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fdddd990640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddd815e6d0 0x7fddd8156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fdddd990640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fddd80b3cc0 con 0x7fddd80b5610 2024-04-25T02:12:16.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fdddd990640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fddd815eab0 con 0x7fddd815e6d0 2024-04-25T02:12:16.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fdddd990640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fddd80b3e40 con 0x7fddd80d2970 2024-04-25T02:12:16.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fddd6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd80b5610 0x7fddd80ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fddd6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd80b5610 0x7fddd80ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58950/0 (socket says 172.21.15.79:58950) 2024-04-25T02:12:16.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fddd6ffd640 1 -- 172.21.15.79:0/3562555640 learned_addr learned my addr 172.21.15.79:0/3562555640 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:16.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fddd77fe640 1 --2- 172.21.15.79:0/3562555640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddd815e6d0 0x7fddd8156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fddcffff640 1 --2- 172.21.15.79:0/3562555640 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fddd80d2970 0x7fddd81f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fddd6ffd640 1 -- 172.21.15.79:0/3562555640 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fddd80d2970 msgr2=0x7fddd81f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:16.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fddd6ffd640 1 --2- 172.21.15.79:0/3562555640 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fddd80d2970 0x7fddd81f3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fddd6ffd640 1 -- 172.21.15.79:0/3562555640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddd815e6d0 msgr2=0x7fddd8156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:16.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fddd6ffd640 1 --2- 172.21.15.79:0/3562555640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddd815e6d0 0x7fddd8156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fddd6ffd640 1 -- 172.21.15.79:0/3562555640 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd80c7c60 con 0x7fddd80b5610 2024-04-25T02:12:16.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fddd6ffd640 1 --2- 172.21.15.79:0/3562555640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd80b5610 0x7fddd80ccbc0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fddc800c460 tx=0x7fddc800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:16.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fddd4ff9640 1 -- 172.21.15.79:0/3562555640 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc80074e0 con 0x7fddd80b5610 2024-04-25T02:12:16.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fddd4ff9640 1 -- 172.21.15.79:0/3562555640 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc80047e0 con 0x7fddd80b5610 2024-04-25T02:12:16.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fddd4ff9640 1 -- 172.21.15.79:0/3562555640 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8004bd0 con 0x7fddd80b5610 2024-04-25T02:12:16.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fdddd990640 1 -- 172.21.15.79:0/3562555640 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd80c7f00 con 0x7fddd80b5610 2024-04-25T02:12:16.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.687+0000 7fdddd990640 1 -- 172.21.15.79:0/3562555640 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd80c87a0 con 0x7fddd80b5610 2024-04-25T02:12:16.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.688+0000 7fdddd990640 1 -- 172.21.15.79:0/3562555640 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd80690a0 con 0x7fddd80b5610 2024-04-25T02:12:16.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.689+0000 7fddd4ff9640 1 -- 172.21.15.79:0/3562555640 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fddc8011070 con 0x7fddd80b5610 2024-04-25T02:12:16.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.689+0000 7fddd4ff9640 1 --2- 172.21.15.79:0/3562555640 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fddb806be30 0x7fddb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.689+0000 7fddcffff640 1 --2- 172.21.15.79:0/3562555640 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fddb806be30 0x7fddb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.689+0000 7fddd4ff9640 1 -- 172.21.15.79:0/3562555640 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7fddc808aab0 con 0x7fddd80b5610 2024-04-25T02:12:16.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.690+0000 7fddcffff640 1 --2- 172.21.15.79:0/3562555640 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fddb806be30 0x7fddb806e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fddd80b9c60 tx=0x7fddc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:16.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.694+0000 7fddd4ff9640 1 -- 172.21.15.79:0/3562555640 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fddc8059400 con 0x7fddd80b5610 2024-04-25T02:12:16.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.864+0000 7fdddd990640 1 -- 172.21.15.79:0/3562555640 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fddd80cec50 con 0x7fddd80b5610 2024-04-25T02:12:16.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.865+0000 7fddd4ff9640 1 -- 172.21.15.79:0/3562555640 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7fddc8058d00 con 0x7fddd80b5610 2024-04-25T02:12:16.872 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:12:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.866+0000 7fdddd990640 1 -- 172.21.15.79:0/3562555640 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fddb806be30 msgr2=0x7fddb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.866+0000 7fdddd990640 1 --2- 172.21.15.79:0/3562555640 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fddb806be30 0x7fddb806e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fddd80b9c60 tx=0x7fddc0008040 comp rx=0 tx=0).stop 2024-04-25T02:12:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.866+0000 7fdddd990640 1 -- 172.21.15.79:0/3562555640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd80b5610 msgr2=0x7fddd80ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.866+0000 7fdddd990640 1 --2- 172.21.15.79:0/3562555640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd80b5610 0x7fddd80ccbc0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fddc800c460 tx=0x7fddc800c920 comp rx=0 tx=0).stop 2024-04-25T02:12:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.866+0000 7fdddd990640 1 -- 172.21.15.79:0/3562555640 shutdown_connections 2024-04-25T02:12:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.866+0000 7fdddd990640 1 --2- 172.21.15.79:0/3562555640 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fddb806be30 0x7fddb806e2f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.866+0000 7fdddd990640 1 --2- 172.21.15.79:0/3562555640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddd815e6d0 0x7fddd8156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.866+0000 7fdddd990640 1 --2- 172.21.15.79:0/3562555640 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fddd80d2970 0x7fddd81f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.866+0000 7fdddd990640 1 --2- 172.21.15.79:0/3562555640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd80b5610 0x7fddd80ccbc0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.866+0000 7fdddd990640 1 -- 172.21.15.79:0/3562555640 >> 172.21.15.79:0/3562555640 conn(0x7fddd809d3e0 msgr2=0x7fddd80b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.867+0000 7fdddd990640 1 -- 172.21.15.79:0/3562555640 shutdown_connections 2024-04-25T02:12:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.867+0000 7fdddd990640 1 -- 172.21.15.79:0/3562555640 wait complete. 2024-04-25T02:12:16.881 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-04-25T02:12:16.875+0000 7f7b4a5f2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:12:16.884 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:12:16.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.978+0000 7fa75dd10640 1 Processor -- start 2024-04-25T02:12:16.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.978+0000 7fa75dd10640 1 -- start start 2024-04-25T02:12:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.978+0000 7fa75dd10640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa7580d2ca0 0x7fa7580d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.978+0000 7fa75dd10640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7580d0ef0 0x7fa75806bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.978+0000 7fa75dd10640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7580d1ee0 con 0x7fa75815e4f0 2024-04-25T02:12:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.979+0000 7fa75dd10640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa7580d3130 con 0x7fa7580d0ef0 2024-04-25T02:12:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.979+0000 7fa75dd10640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fa7580d21c0 con 0x7fa7580d2ca0 2024-04-25T02:12:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.979+0000 7fa757fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7580d0ef0 0x7fa75806bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.979+0000 7fa757fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7580d0ef0 0x7fa75806bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58958/0 (socket says 172.21.15.79:58958) 2024-04-25T02:12:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.979+0000 7fa757fff640 1 -- 172.21.15.79:0/967863041 learned_addr learned my addr 172.21.15.79:0/967863041 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:16.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.979+0000 7fa757fff640 1 -- 172.21.15.79:0/967863041 >> v2:172.21.15.189:3300/0 conn(0x7fa7580d2ca0 msgr2=0x7fa7580d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:16.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.979+0000 7fa757fff640 1 --2- 172.21.15.79:0/967863041 >> v2:172.21.15.189:3300/0 conn(0x7fa7580d2ca0 0x7fa7580d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.979+0000 7fa757fff640 1 -- 172.21.15.79:0/967863041 >> v1:172.21.15.189:6789/0 conn(0x7fa75815e4f0 legacy=0x7fa7580cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:16.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.979+0000 7fa757fff640 1 -- 172.21.15.79:0/967863041 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7580d24a0 con 0x7fa7580d0ef0 2024-04-25T02:12:16.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.980+0000 7fa757fff640 1 --2- 172.21.15.79:0/967863041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7580d0ef0 0x7fa75806bc30 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fa750009e50 tx=0x7fa75002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c607a3ed293278 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:16.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.980+0000 7fa7567fc640 1 -- 172.21.15.79:0/967863041 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa750036070 con 0x7fa7580d0ef0 2024-04-25T02:12:16.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.980+0000 7fa7567fc640 1 -- 172.21.15.79:0/967863041 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa750031600 con 0x7fa7580d0ef0 2024-04-25T02:12:16.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.980+0000 7fa7567fc640 1 -- 172.21.15.79:0/967863041 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7500319d0 con 0x7fa7580d0ef0 2024-04-25T02:12:16.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.980+0000 7fa75dd10640 1 -- 172.21.15.79:0/967863041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7580d0ef0 msgr2=0x7fa75806bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:16.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.980+0000 7fa75dd10640 1 --2- 172.21.15.79:0/967863041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7580d0ef0 0x7fa75806bc30 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fa750009e50 tx=0x7fa75002a710 comp rx=0 tx=0).stop 2024-04-25T02:12:16.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.980+0000 7fa75dd10640 1 -- 172.21.15.79:0/967863041 shutdown_connections 2024-04-25T02:12:16.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.980+0000 7fa75dd10640 1 --2- 172.21.15.79:0/967863041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7580d0ef0 0x7fa75806bc30 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.980+0000 7fa75dd10640 1 --2- 172.21.15.79:0/967863041 >> v2:172.21.15.189:3300/0 conn(0x7fa7580d2ca0 0x7fa7580d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.980+0000 7fa75dd10640 1 -- 172.21.15.79:0/967863041 >> 172.21.15.79:0/967863041 conn(0x7fa75809d4a0 msgr2=0x7fa7580d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:16.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.980+0000 7fa75dd10640 1 -- 172.21.15.79:0/967863041 shutdown_connections 2024-04-25T02:12:16.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.980+0000 7fa75dd10640 1 -- 172.21.15.79:0/967863041 wait complete. 2024-04-25T02:12:16.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.981+0000 7fa75dd10640 1 Processor -- start 2024-04-25T02:12:16.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.982+0000 7fa75dd10640 1 -- start start 2024-04-25T02:12:16.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.982+0000 7fa75dd10640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7580d0ef0 0x7fa7580cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.982+0000 7fa75dd10640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7580d2ca0 0x7fa75814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.982+0000 7fa75dd10640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa75815e4f0 0x7fa7581579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.982+0000 7fa75dd10640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa7580d4ee0 con 0x7fa7580d2ca0 2024-04-25T02:12:16.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.982+0000 7fa75dd10640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa7580cff00 con 0x7fa7580d0ef0 2024-04-25T02:12:16.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.982+0000 7fa75dd10640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa7580d5060 con 0x7fa75815e4f0 2024-04-25T02:12:16.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.982+0000 7fa756ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7580d2ca0 0x7fa75814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa756ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7580d2ca0 0x7fa75814dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58974/0 (socket says 172.21.15.79:58974) 2024-04-25T02:12:16.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa756ffd640 1 -- 172.21.15.79:0/862939945 learned_addr learned my addr 172.21.15.79:0/862939945 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:16.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa7577fe640 1 --2- 172.21.15.79:0/862939945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7580d0ef0 0x7fa7580cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa757fff640 1 --2- 172.21.15.79:0/862939945 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa75815e4f0 0x7fa7581579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa756ffd640 1 -- 172.21.15.79:0/862939945 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa75815e4f0 msgr2=0x7fa7581579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa756ffd640 1 --2- 172.21.15.79:0/862939945 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa75815e4f0 0x7fa7581579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa756ffd640 1 -- 172.21.15.79:0/862939945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7580d0ef0 msgr2=0x7fa7580cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa756ffd640 1 --2- 172.21.15.79:0/862939945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7580d0ef0 0x7fa7580cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa756ffd640 1 -- 172.21.15.79:0/862939945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7580c7e20 con 0x7fa7580d2ca0 2024-04-25T02:12:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa7577fe640 1 --2- 172.21.15.79:0/862939945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7580d0ef0 0x7fa7580cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa756ffd640 1 --2- 172.21.15.79:0/862939945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7580d2ca0 0x7fa75814dfd0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00b4a0 tx=0x7fa74c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa73ffff640 1 -- 172.21.15.79:0/862939945 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74c014070 con 0x7fa7580d2ca0 2024-04-25T02:12:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa73ffff640 1 -- 172.21.15.79:0/862939945 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa74c010610 con 0x7fa7580d2ca0 2024-04-25T02:12:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa75dd10640 1 -- 172.21.15.79:0/862939945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7580c8100 con 0x7fa7580d2ca0 2024-04-25T02:12:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa73ffff640 1 -- 172.21.15.79:0/862939945 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74c010a00 con 0x7fa7580d2ca0 2024-04-25T02:12:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.983+0000 7fa75dd10640 1 -- 172.21.15.79:0/862939945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75814e510 con 0x7fa7580d2ca0 2024-04-25T02:12:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.984+0000 7fa75dd10640 1 -- 172.21.15.79:0/862939945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7580686c0 con 0x7fa7580d2ca0 2024-04-25T02:12:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.984+0000 7fa73ffff640 1 -- 172.21.15.79:0/862939945 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa74c017070 con 0x7fa7580d2ca0 2024-04-25T02:12:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.985+0000 7fa73ffff640 1 --2- 172.21.15.79:0/862939945 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa74406be30 0x7fa74406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:16.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.985+0000 7fa73ffff640 1 -- 172.21.15.79:0/862939945 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7fa74c08a9c0 con 0x7fa7580d2ca0 2024-04-25T02:12:16.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.985+0000 7fa7577fe640 1 --2- 172.21.15.79:0/862939945 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa74406be30 0x7fa74406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:16.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.985+0000 7fa7577fe640 1 --2- 172.21.15.79:0/862939945 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa74406be30 0x7fa74406e2f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa748001750 tx=0x7fa748009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:16.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:16.989+0000 7fa73ffff640 1 -- 172.21.15.79:0/862939945 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa74c08ce20 con 0x7fa7580d2ca0 2024-04-25T02:12:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.162+0000 7fa75dd10640 1 -- 172.21.15.79:0/862939945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa7580690a0 con 0x7fa7580d2ca0 2024-04-25T02:12:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.162+0000 7fa73ffff640 1 -- 172.21.15.79:0/862939945 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) ==== 104+0+11 (secure 0 0 0) 0x7fa74c059290 con 0x7fa7580d2ca0 2024-04-25T02:12:17.169 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:12:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.164+0000 7fa75dd10640 1 -- 172.21.15.79:0/862939945 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa74406be30 msgr2=0x7fa74406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.164+0000 7fa75dd10640 1 --2- 172.21.15.79:0/862939945 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa74406be30 0x7fa74406e2f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa748001750 tx=0x7fa748009040 comp rx=0 tx=0).stop 2024-04-25T02:12:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.164+0000 7fa75dd10640 1 -- 172.21.15.79:0/862939945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7580d2ca0 msgr2=0x7fa75814dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.164+0000 7fa75dd10640 1 --2- 172.21.15.79:0/862939945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7580d2ca0 0x7fa75814dfd0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00b4a0 tx=0x7fa74c00b960 comp rx=0 tx=0).stop 2024-04-25T02:12:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.164+0000 7fa75dd10640 1 -- 172.21.15.79:0/862939945 shutdown_connections 2024-04-25T02:12:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.164+0000 7fa75dd10640 1 --2- 172.21.15.79:0/862939945 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa74406be30 0x7fa74406e2f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.164+0000 7fa75dd10640 1 --2- 172.21.15.79:0/862939945 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa75815e4f0 0x7fa7581579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.164+0000 7fa75dd10640 1 --2- 172.21.15.79:0/862939945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7580d2ca0 0x7fa75814dfd0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.164+0000 7fa75dd10640 1 --2- 172.21.15.79:0/862939945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7580d0ef0 0x7fa7580cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.164+0000 7fa75dd10640 1 -- 172.21.15.79:0/862939945 >> 172.21.15.79:0/862939945 conn(0x7fa75809d4a0 msgr2=0x7fa7580d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.164+0000 7fa75dd10640 1 -- 172.21.15.79:0/862939945 shutdown_connections 2024-04-25T02:12:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.164+0000 7fa75dd10640 1 -- 172.21.15.79:0/862939945 wait complete. 2024-04-25T02:12:17.182 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:12:17.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.275+0000 7f3d10cfc640 1 Processor -- start 2024-04-25T02:12:17.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.275+0000 7f3d10cfc640 1 -- start start 2024-04-25T02:12:17.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.276+0000 7f3d10cfc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d0c0d2ad0 0x7f3d0c0d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:17.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.276+0000 7f3d10cfc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d0c0cd6e0 con 0x7f3d0c0c5a90 2024-04-25T02:12:17.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.276+0000 7f3d10cfc640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d0c0cdec0 con 0x7f3d0c15f860 2024-04-25T02:12:17.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.276+0000 7f3d10cfc640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3d0c0b2f00 con 0x7f3d0c0d2ad0 2024-04-25T02:12:17.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.276+0000 7f3d01d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d0c0d2ad0 0x7f3d0c0d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:17.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.276+0000 7f3d0ad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3d0c0c5a90 0x7f3d0c0c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55580/0 (socket says 172.21.15.79:55580) 2024-04-25T02:12:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.276+0000 7f3d0ad9d640 1 -- 172.21.15.79:0/1284908620 learned_addr learned my addr 172.21.15.79:0/1284908620 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.277+0000 7f3d01d9b640 1 -- 172.21.15.79:0/1284908620 >> v1:172.21.15.189:6789/0 conn(0x7f3d0c15f860 legacy=0x7f3d0c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.277+0000 7f3d01d9b640 1 -- 172.21.15.79:0/1284908620 >> v1:172.21.15.79:6789/0 conn(0x7f3d0c0c5a90 legacy=0x7f3d0c0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.277+0000 7f3d09d9b640 1 -- 172.21.15.79:0/1284908620 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3648521356 0 0) 0x7f3d0c0cd6e0 con 0x7f3d0c0c5a90 2024-04-25T02:12:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.277+0000 7f3d01d9b640 1 -- 172.21.15.79:0/1284908620 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c0b3130 con 0x7f3d0c0d2ad0 2024-04-25T02:12:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.277+0000 7f3d01d9b640 1 --2- 172.21.15.79:0/1284908620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c0d2ad0 0x7f3d0c0d0220 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40097a0 tx=0x7f3cf402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8947ecf57d4a799 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.277+0000 7f3d09d9b640 1 -- 172.21.15.79:0/1284908620 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4037070 con 0x7f3d0c0d2ad0 2024-04-25T02:12:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.277+0000 7f3d09d9b640 1 -- 172.21.15.79:0/1284908620 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf4032440 con 0x7f3d0c0d2ad0 2024-04-25T02:12:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.277+0000 7f3d09d9b640 1 -- 172.21.15.79:0/1284908620 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4032810 con 0x7f3d0c0d2ad0 2024-04-25T02:12:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.278+0000 7f3d10cfc640 1 -- 172.21.15.79:0/1284908620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c0d2ad0 msgr2=0x7f3d0c0d0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.278+0000 7f3d10cfc640 1 --2- 172.21.15.79:0/1284908620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c0d2ad0 0x7f3d0c0d0220 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40097a0 tx=0x7f3cf402a230 comp rx=0 tx=0).stop 2024-04-25T02:12:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.278+0000 7f3d10cfc640 1 -- 172.21.15.79:0/1284908620 shutdown_connections 2024-04-25T02:12:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.278+0000 7f3d10cfc640 1 --2- 172.21.15.79:0/1284908620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c0d2ad0 0x7f3d0c0d0220 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.278+0000 7f3d10cfc640 1 -- 172.21.15.79:0/1284908620 >> 172.21.15.79:0/1284908620 conn(0x7f3d0c0d1f40 msgr2=0x7f3d0c0d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.278+0000 7f3d10cfc640 1 -- 172.21.15.79:0/1284908620 shutdown_connections 2024-04-25T02:12:17.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.278+0000 7f3d10cfc640 1 -- 172.21.15.79:0/1284908620 wait complete. 2024-04-25T02:12:17.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.279+0000 7f3d10cfc640 1 Processor -- start 2024-04-25T02:12:17.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.279+0000 7f3d10cfc640 1 -- start start 2024-04-25T02:12:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d10cfc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3d0c0c5a90 0x7f3d0c146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d10cfc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d0c0d2ad0 0x7f3d0c159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d10cfc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c15f860 0x7f3d0c159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d10cfc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c0cd9a0 con 0x7f3d0c15f860 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d10cfc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c15fc40 con 0x7f3d0c0d2ad0 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d10cfc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3d0c0c6b50 con 0x7f3d0c0c5a90 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d0ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c15f860 0x7f3d0c159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d0ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c15f860 0x7f3d0c159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58996/0 (socket says 172.21.15.79:58996) 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d0ad9d640 1 -- 172.21.15.79:0/442770357 learned_addr learned my addr 172.21.15.79:0/442770357 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d01d9b640 1 --2- 172.21.15.79:0/442770357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d0c0d2ad0 0x7f3d0c159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d0a59c640 1 --2- 172.21.15.79:0/442770357 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3d0c0c5a90 0x7f3d0c146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d0ad9d640 1 -- 172.21.15.79:0/442770357 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3d0c0c5a90 msgr2=0x7f3d0c146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d0ad9d640 1 --2- 172.21.15.79:0/442770357 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3d0c0c5a90 0x7f3d0c146740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d0ad9d640 1 -- 172.21.15.79:0/442770357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d0c0d2ad0 msgr2=0x7f3d0c159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d0ad9d640 1 --2- 172.21.15.79:0/442770357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d0c0d2ad0 0x7f3d0c159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.280+0000 7f3d0ad9d640 1 -- 172.21.15.79:0/442770357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c0c6e30 con 0x7f3d0c15f860 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.281+0000 7f3d01d9b640 1 --2- 172.21.15.79:0/442770357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d0c0d2ad0 0x7f3d0c159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.281+0000 7f3d0ad9d640 1 --2- 172.21.15.79:0/442770357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c15f860 0x7f3d0c159760 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400c730 tx=0x7f3d0400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:17.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.281+0000 7f3d037fe640 1 -- 172.21.15.79:0/442770357 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04018070 con 0x7f3d0c15f860 2024-04-25T02:12:17.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.281+0000 7f3d037fe640 1 -- 172.21.15.79:0/442770357 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0400ce40 con 0x7f3d0c15f860 2024-04-25T02:12:17.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.281+0000 7f3d10cfc640 1 -- 172.21.15.79:0/442770357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d0c0c7110 con 0x7f3d0c15f860 2024-04-25T02:12:17.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.281+0000 7f3d037fe640 1 -- 172.21.15.79:0/442770357 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400a860 con 0x7f3d0c15f860 2024-04-25T02:12:17.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.281+0000 7f3d10cfc640 1 -- 172.21.15.79:0/442770357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d0c146c80 con 0x7f3d0c15f860 2024-04-25T02:12:17.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.282+0000 7f3d10cfc640 1 -- 172.21.15.79:0/442770357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d0c0690a0 con 0x7f3d0c15f860 2024-04-25T02:12:17.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.282+0000 7f3d037fe640 1 -- 172.21.15.79:0/442770357 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d0401b070 con 0x7f3d0c15f860 2024-04-25T02:12:17.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.283+0000 7f3d037fe640 1 --2- 172.21.15.79:0/442770357 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3cec06be60 0x7f3cec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:17.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.283+0000 7f3d037fe640 1 -- 172.21.15.79:0/442770357 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7f3d0408a470 con 0x7f3d0c15f860 2024-04-25T02:12:17.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.283+0000 7f3d0a59c640 1 --2- 172.21.15.79:0/442770357 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3cec06be60 0x7f3cec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:17.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.283+0000 7f3d0a59c640 1 --2- 172.21.15.79:0/442770357 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3cec06be60 0x7f3cec06e320 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c14a240 tx=0x7f3cfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:17.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.287+0000 7f3d037fe640 1 -- 172.21.15.79:0/442770357 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3d04058dc0 con 0x7f3d0c15f860 2024-04-25T02:12:17.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.460+0000 7f3d10cfc640 1 -- 172.21.15.79:0/442770357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3d0c0b36f0 con 0x7f3d0c15f860 2024-04-25T02:12:17.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.460+0000 7f3d037fe640 1 -- 172.21.15.79:0/442770357 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) ==== 100+0+11 (secure 0 0 0) 0x7f3d040586c0 con 0x7f3d0c15f860 2024-04-25T02:12:17.467 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:12:17.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.462+0000 7f3d10cfc640 1 -- 172.21.15.79:0/442770357 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3cec06be60 msgr2=0x7f3cec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:17.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.462+0000 7f3d10cfc640 1 --2- 172.21.15.79:0/442770357 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3cec06be60 0x7f3cec06e320 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c14a240 tx=0x7f3cfc009040 comp rx=0 tx=0).stop 2024-04-25T02:12:17.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.462+0000 7f3d10cfc640 1 -- 172.21.15.79:0/442770357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c15f860 msgr2=0x7f3d0c159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:17.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.462+0000 7f3d10cfc640 1 --2- 172.21.15.79:0/442770357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c15f860 0x7f3d0c159760 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400c730 tx=0x7f3d0400cbf0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.462+0000 7f3d10cfc640 1 -- 172.21.15.79:0/442770357 shutdown_connections 2024-04-25T02:12:17.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.462+0000 7f3d10cfc640 1 --2- 172.21.15.79:0/442770357 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3cec06be60 0x7f3cec06e320 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.462+0000 7f3d10cfc640 1 --2- 172.21.15.79:0/442770357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c15f860 0x7f3d0c159760 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.462+0000 7f3d10cfc640 1 --2- 172.21.15.79:0/442770357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d0c0d2ad0 0x7f3d0c159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.462+0000 7f3d10cfc640 1 --2- 172.21.15.79:0/442770357 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3d0c0c5a90 0x7f3d0c146740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.462+0000 7f3d10cfc640 1 -- 172.21.15.79:0/442770357 >> 172.21.15.79:0/442770357 conn(0x7f3d0c0d1f40 msgr2=0x7f3d0c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:17.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.462+0000 7f3d10cfc640 1 -- 172.21.15.79:0/442770357 shutdown_connections 2024-04-25T02:12:17.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.462+0000 7f3d10cfc640 1 -- 172.21.15.79:0/442770357 wait complete. 2024-04-25T02:12:17.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:12:17.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.572+0000 7fcb111d5640 1 Processor -- start 2024-04-25T02:12:17.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.572+0000 7fcb111d5640 1 -- start start 2024-04-25T02:12:17.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.573+0000 7fcb111d5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcb0c144cb0 0x7fcb0c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:17.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.573+0000 7fcb111d5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb0c0b5580 0x7fcb0c06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:17.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.573+0000 7fcb111d5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb0c070d90 con 0x7fcb0c06e490 2024-04-25T02:12:17.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.573+0000 7fcb111d5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fcb0c06e8c0 con 0x7fcb0c0b5580 2024-04-25T02:12:17.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.573+0000 7fcb111d5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fcb0c0cf130 con 0x7fcb0c144cb0 2024-04-25T02:12:17.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.573+0000 7fcb03fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb0c0b5580 0x7fcb0c06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:17.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.573+0000 7fcb0b59e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcb0c06e490 0x7fcb0c15fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55594/0 (socket says 172.21.15.79:55594) 2024-04-25T02:12:17.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.573+0000 7fcb0b59e640 1 -- 172.21.15.79:0/3847702809 learned_addr learned my addr 172.21.15.79:0/3847702809 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:17.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.573+0000 7fcb03fff640 1 -- 172.21.15.79:0/3847702809 >> v2:172.21.15.189:3300/0 conn(0x7fcb0c144cb0 msgr2=0x7fcb0c0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:17.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.573+0000 7fcb0ad9d640 1 --2- 172.21.15.79:0/3847702809 >> v2:172.21.15.189:3300/0 conn(0x7fcb0c144cb0 0x7fcb0c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:17.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.573+0000 7fcb0a59c640 1 -- 172.21.15.79:0/3847702809 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787522523 0 0) 0x7fcb0c070d90 con 0x7fcb0c06e490 2024-04-25T02:12:17.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.573+0000 7fcb03fff640 1 --2- 172.21.15.79:0/3847702809 >> v2:172.21.15.189:3300/0 conn(0x7fcb0c144cb0 0x7fcb0c0b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.573+0000 7fcb03fff640 1 -- 172.21.15.79:0/3847702809 >> v1:172.21.15.79:6789/0 conn(0x7fcb0c06e490 legacy=0x7fcb0c15fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:17.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.573+0000 7fcb03fff640 1 -- 172.21.15.79:0/3847702809 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0c0cf410 con 0x7fcb0c0b5580 2024-04-25T02:12:17.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.573+0000 7fcb0ad9d640 1 --2- 172.21.15.79:0/3847702809 >> v2:172.21.15.189:3300/0 conn(0x7fcb0c144cb0 0x7fcb0c0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:17.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.574+0000 7fcb03fff640 1 --2- 172.21.15.79:0/3847702809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c0b5580 0x7fcb0c06df50 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40097a0 tx=0x7fcaf402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d407be44409d7748 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:17.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.574+0000 7fcb0a59c640 1 -- 172.21.15.79:0/3847702809 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4037070 con 0x7fcb0c0b5580 2024-04-25T02:12:17.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.574+0000 7fcb0a59c640 1 -- 172.21.15.79:0/3847702809 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf402adc0 con 0x7fcb0c0b5580 2024-04-25T02:12:17.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.574+0000 7fcb0a59c640 1 -- 172.21.15.79:0/3847702809 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4032660 con 0x7fcb0c0b5580 2024-04-25T02:12:17.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.575+0000 7fcb111d5640 1 -- 172.21.15.79:0/3847702809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c0b5580 msgr2=0x7fcb0c06df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:17.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.575+0000 7fcb111d5640 1 --2- 172.21.15.79:0/3847702809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c0b5580 0x7fcb0c06df50 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40097a0 tx=0x7fcaf402a0b0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.575+0000 7fcb111d5640 1 -- 172.21.15.79:0/3847702809 shutdown_connections 2024-04-25T02:12:17.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.575+0000 7fcb111d5640 1 --2- 172.21.15.79:0/3847702809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c0b5580 0x7fcb0c06df50 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.575+0000 7fcb111d5640 1 --2- 172.21.15.79:0/3847702809 >> v2:172.21.15.189:3300/0 conn(0x7fcb0c144cb0 0x7fcb0c0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.575+0000 7fcb111d5640 1 -- 172.21.15.79:0/3847702809 >> 172.21.15.79:0/3847702809 conn(0x7fcb0c0cfc80 msgr2=0x7fcb0c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:17.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.575+0000 7fcb111d5640 1 -- 172.21.15.79:0/3847702809 shutdown_connections 2024-04-25T02:12:17.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.575+0000 7fcb111d5640 1 -- 172.21.15.79:0/3847702809 wait complete. 2024-04-25T02:12:17.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.576+0000 7fcb111d5640 1 Processor -- start 2024-04-25T02:12:17.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.576+0000 7fcb111d5640 1 -- start start 2024-04-25T02:12:17.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb111d5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb0c06e490 0x7fcb0c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:17.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb111d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c0b5580 0x7fcb0c1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:17.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb111d5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb0c144cb0 0x7fcb0c1432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:17.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb111d5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c145090 con 0x7fcb0c0b5580 2024-04-25T02:12:17.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb111d5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c0cf9d0 con 0x7fcb0c144cb0 2024-04-25T02:12:17.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb111d5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcb0c145ab0 con 0x7fcb0c06e490 2024-04-25T02:12:17.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb03fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c0b5580 0x7fcb0c1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:17.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb03fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c0b5580 0x7fcb0c1559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59014/0 (socket says 172.21.15.79:59014) 2024-04-25T02:12:17.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb03fff640 1 -- 172.21.15.79:0/2944413893 learned_addr learned my addr 172.21.15.79:0/2944413893 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:17.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb0b59e640 1 --2- 172.21.15.79:0/2944413893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb0c144cb0 0x7fcb0c1432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:17.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb0ad9d640 1 --2- 172.21.15.79:0/2944413893 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb0c06e490 0x7fcb0c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:17.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb03fff640 1 -- 172.21.15.79:0/2944413893 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb0c06e490 msgr2=0x7fcb0c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:17.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb03fff640 1 --2- 172.21.15.79:0/2944413893 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb0c06e490 0x7fcb0c15a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb03fff640 1 -- 172.21.15.79:0/2944413893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb0c144cb0 msgr2=0x7fcb0c1432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:17.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb03fff640 1 --2- 172.21.15.79:0/2944413893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb0c144cb0 0x7fcb0c1432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb03fff640 1 -- 172.21.15.79:0/2944413893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0c15ac60 con 0x7fcb0c0b5580 2024-04-25T02:12:17.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb0ad9d640 1 --2- 172.21.15.79:0/2944413893 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb0c06e490 0x7fcb0c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:17.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb03fff640 1 --2- 172.21.15.79:0/2944413893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c0b5580 0x7fcb0c1559a0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40098c0 tx=0x7fcaf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:17.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb037fe640 1 -- 172.21.15.79:0/2944413893 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4037040 con 0x7fcb0c0b5580 2024-04-25T02:12:17.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb037fe640 1 -- 172.21.15.79:0/2944413893 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf4042070 con 0x7fcb0c0b5580 2024-04-25T02:12:17.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb037fe640 1 -- 172.21.15.79:0/2944413893 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf403b870 con 0x7fcb0c0b5580 2024-04-25T02:12:17.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb111d5640 1 -- 172.21.15.79:0/2944413893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb0c15a980 con 0x7fcb0c0b5580 2024-04-25T02:12:17.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.577+0000 7fcb111d5640 1 -- 172.21.15.79:0/2944413893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb0c157a60 con 0x7fcb0c0b5580 2024-04-25T02:12:17.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.578+0000 7fcb111d5640 1 -- 172.21.15.79:0/2944413893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb0c0690a0 con 0x7fcb0c0b5580 2024-04-25T02:12:17.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.579+0000 7fcb037fe640 1 -- 172.21.15.79:0/2944413893 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcaf403ba10 con 0x7fcb0c0b5580 2024-04-25T02:12:17.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.579+0000 7fcb037fe640 1 --2- 172.21.15.79:0/2944413893 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcaec06be30 0x7fcaec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:17.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.579+0000 7fcb037fe640 1 -- 172.21.15.79:0/2944413893 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7fcaf40ab5b0 con 0x7fcb0c0b5580 2024-04-25T02:12:17.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.579+0000 7fcb0ad9d640 1 --2- 172.21.15.79:0/2944413893 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcaec06be30 0x7fcaec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:17.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.579+0000 7fcb0ad9d640 1 --2- 172.21.15.79:0/2944413893 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcaec06be30 0x7fcaec06e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00a990 tx=0x7fcafc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:17.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.583+0000 7fcb037fe640 1 -- 172.21.15.79:0/2944413893 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcaf4079e70 con 0x7fcb0c0b5580 2024-04-25T02:12:17.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.770+0000 7fcb111d5640 1 -- 172.21.15.79:0/2944413893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcb0c0725f0 con 0x7fcb0c0b5580 2024-04-25T02:12:17.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.770+0000 7fcb037fe640 1 -- 172.21.15.79:0/2944413893 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v72) ==== 80+0+122 (secure 0 0 0) 0x7fcaf4079770 con 0x7fcb0c0b5580 2024-04-25T02:12:17.777 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.189:6835/469348969 2024-04-26T02:12:09.471251+0000 2024-04-25T02:12:17.778 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.189:6833/469348969 2024-04-26T02:12:09.471251+0000 2024-04-25T02:12:17.778 INFO:teuthology.orchestra.run.smithi079.stderr:listed 2 entries 2024-04-25T02:12:17.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.772+0000 7fcb111d5640 1 -- 172.21.15.79:0/2944413893 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcaec06be30 msgr2=0x7fcaec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:17.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.772+0000 7fcb111d5640 1 --2- 172.21.15.79:0/2944413893 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcaec06be30 0x7fcaec06e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00a990 tx=0x7fcafc008040 comp rx=0 tx=0).stop 2024-04-25T02:12:17.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.772+0000 7fcb111d5640 1 -- 172.21.15.79:0/2944413893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c0b5580 msgr2=0x7fcb0c1559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:17.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.772+0000 7fcb111d5640 1 --2- 172.21.15.79:0/2944413893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c0b5580 0x7fcb0c1559a0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40098c0 tx=0x7fcaf40046c0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.772+0000 7fcb111d5640 1 -- 172.21.15.79:0/2944413893 shutdown_connections 2024-04-25T02:12:17.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.772+0000 7fcb111d5640 1 --2- 172.21.15.79:0/2944413893 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcaec06be30 0x7fcaec06e2f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.772+0000 7fcb111d5640 1 --2- 172.21.15.79:0/2944413893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb0c144cb0 0x7fcb0c1432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.772+0000 7fcb111d5640 1 --2- 172.21.15.79:0/2944413893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c0b5580 0x7fcb0c1559a0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.772+0000 7fcb111d5640 1 --2- 172.21.15.79:0/2944413893 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb0c06e490 0x7fcb0c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:17.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.772+0000 7fcb111d5640 1 -- 172.21.15.79:0/2944413893 >> 172.21.15.79:0/2944413893 conn(0x7fcb0c0cfc80 msgr2=0x7fcb0c0af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:17.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.772+0000 7fcb111d5640 1 -- 172.21.15.79:0/2944413893 shutdown_connections 2024-04-25T02:12:17.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:17.772+0000 7fcb111d5640 1 -- 172.21.15.79:0/2944413893 wait complete. 2024-04-25T02:12:17.790 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:12:17.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:17.790 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:17.816 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:12:17.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:17.816 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:12:17.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:17.871 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir recursive 2024-04-25T02:12:18.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.005+0000 7fe86bbf4640 1 Processor -- start 2024-04-25T02:12:18.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.005+0000 7fe86bbf4640 1 -- start start 2024-04-25T02:12:18.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.006+0000 7fe86bbf4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8640cccb0 0x7fe8640ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.006+0000 7fe86bbf4640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe86406da30 0x7fe86415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.006+0000 7fe86bbf4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8640cd090 0x7fe86415e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.006+0000 7fe86bbf4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe8640cabc0 con 0x7fe8640cd090 2024-04-25T02:12:18.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.006+0000 7fe86bbf4640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe86415e740 con 0x7fe86406da30 2024-04-25T02:12:18.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.006+0000 7fe86bbf4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe86406def0 con 0x7fe8640cccb0 2024-04-25T02:12:18.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.006+0000 7fe86a191640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8640cd090 0x7fe86415e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.006+0000 7fe86a191640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8640cd090 0x7fe86415e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59016/0 (socket says 172.21.15.79:59016) 2024-04-25T02:12:18.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.006+0000 7fe86a191640 1 -- 172.21.15.79:0/2277124048 learned_addr learned my addr 172.21.15.79:0/2277124048 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:18.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.006+0000 7fe86a191640 1 -- 172.21.15.79:0/2277124048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8640cccb0 msgr2=0x7fe8640ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.006+0000 7fe86a191640 1 --2- 172.21.15.79:0/2277124048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8640cccb0 0x7fe8640ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.006+0000 7fe86a191640 1 -- 172.21.15.79:0/2277124048 >> v2:172.21.15.189:3300/0 conn(0x7fe86406da30 msgr2=0x7fe86415dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.006+0000 7fe86a191640 1 --2- 172.21.15.79:0/2277124048 >> v2:172.21.15.189:3300/0 conn(0x7fe86406da30 0x7fe86415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.006+0000 7fe86a191640 1 -- 172.21.15.79:0/2277124048 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8640cf7f0 con 0x7fe8640cd090 2024-04-25T02:12:18.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.007+0000 7fe86a191640 1 --2- 172.21.15.79:0/2277124048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640cd090 0x7fe86415e200 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe86406f1f0 tx=0x7fe85c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcdb769ae545bf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:18.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.007+0000 7fe86898e640 1 -- 172.21.15.79:0/2277124048 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c037070 con 0x7fe8640cd090 2024-04-25T02:12:18.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.007+0000 7fe86898e640 1 -- 172.21.15.79:0/2277124048 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85c032440 con 0x7fe8640cd090 2024-04-25T02:12:18.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.007+0000 7fe86898e640 1 -- 172.21.15.79:0/2277124048 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c032810 con 0x7fe8640cd090 2024-04-25T02:12:18.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.007+0000 7fe86bbf4640 1 -- 172.21.15.79:0/2277124048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640cd090 msgr2=0x7fe86415e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.007+0000 7fe86bbf4640 1 --2- 172.21.15.79:0/2277124048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640cd090 0x7fe86415e200 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe86406f1f0 tx=0x7fe85c02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.007+0000 7fe86bbf4640 1 -- 172.21.15.79:0/2277124048 shutdown_connections 2024-04-25T02:12:18.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.007+0000 7fe86bbf4640 1 --2- 172.21.15.79:0/2277124048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640cd090 0x7fe86415e200 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.008+0000 7fe86bbf4640 1 --2- 172.21.15.79:0/2277124048 >> v2:172.21.15.189:3300/0 conn(0x7fe86406da30 0x7fe86415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.008+0000 7fe86bbf4640 1 --2- 172.21.15.79:0/2277124048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8640cccb0 0x7fe8640ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.008+0000 7fe86bbf4640 1 -- 172.21.15.79:0/2277124048 >> 172.21.15.79:0/2277124048 conn(0x7fe8640b1ba0 msgr2=0x7fe8640b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:18.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.008+0000 7fe86bbf4640 1 -- 172.21.15.79:0/2277124048 shutdown_connections 2024-04-25T02:12:18.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.008+0000 7fe86bbf4640 1 -- 172.21.15.79:0/2277124048 wait complete. 2024-04-25T02:12:18.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.009+0000 7fe86bbf4640 1 Processor -- start 2024-04-25T02:12:18.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.009+0000 7fe86bbf4640 1 -- start start 2024-04-25T02:12:18.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.009+0000 7fe86bbf4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe86406da30 0x7fe86415e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.009+0000 7fe86bbf4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8640cccb0 0x7fe8640b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.009+0000 7fe86bbf4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640cd090 0x7fe8640c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.009+0000 7fe86bbf4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe8640cfdb0 con 0x7fe8640cd090 2024-04-25T02:12:18.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.009+0000 7fe86bbf4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8640cf360 con 0x7fe8640cccb0 2024-04-25T02:12:18.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.009+0000 7fe86bbf4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe8640cc660 con 0x7fe86406da30 2024-04-25T02:12:18.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.009+0000 7fe86a191640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640cd090 0x7fe8640c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.009+0000 7fe86a191640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640cd090 0x7fe8640c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59026/0 (socket says 172.21.15.79:59026) 2024-04-25T02:12:18.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.010+0000 7fe86a191640 1 -- 172.21.15.79:0/882712607 learned_addr learned my addr 172.21.15.79:0/882712607 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:18.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.010+0000 7fe86a191640 1 -- 172.21.15.79:0/882712607 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe86406da30 msgr2=0x7fe86415e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.010+0000 7fe869990640 1 --2- 172.21.15.79:0/882712607 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe86406da30 0x7fe86415e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.010+0000 7fe86918f640 1 --2- 172.21.15.79:0/882712607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8640cccb0 0x7fe8640b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.010+0000 7fe86a191640 1 --2- 172.21.15.79:0/882712607 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe86406da30 0x7fe86415e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.010+0000 7fe86a191640 1 -- 172.21.15.79:0/882712607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8640cccb0 msgr2=0x7fe8640b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.010+0000 7fe86a191640 1 --2- 172.21.15.79:0/882712607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8640cccb0 0x7fe8640b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.010+0000 7fe86a191640 1 -- 172.21.15.79:0/882712607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86415ee00 con 0x7fe8640cd090 2024-04-25T02:12:18.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.010+0000 7fe86a191640 1 --2- 172.21.15.79:0/882712607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640cd090 0x7fe8640c7540 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0090b0 tx=0x7fe85c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:18.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.010+0000 7fe85a7fc640 1 -- 172.21.15.79:0/882712607 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c041020 con 0x7fe8640cd090 2024-04-25T02:12:18.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.010+0000 7fe85a7fc640 1 -- 172.21.15.79:0/882712607 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85c032e50 con 0x7fe8640cd090 2024-04-25T02:12:18.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.010+0000 7fe86bbf4640 1 -- 172.21.15.79:0/882712607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe864154af0 con 0x7fe8640cd090 2024-04-25T02:12:18.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.010+0000 7fe85a7fc640 1 -- 172.21.15.79:0/882712607 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c037040 con 0x7fe8640cd090 2024-04-25T02:12:18.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.010+0000 7fe86bbf4640 1 -- 172.21.15.79:0/882712607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe864161690 con 0x7fe8640cd090 2024-04-25T02:12:18.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.012+0000 7fe85a7fc640 1 -- 172.21.15.79:0/882712607 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe85c044020 con 0x7fe8640cd090 2024-04-25T02:12:18.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.012+0000 7fe85a7fc640 1 --2- 172.21.15.79:0/882712607 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe84806be30 0x7fe84806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.012+0000 7fe85a7fc640 1 -- 172.21.15.79:0/882712607 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7fe85c0ab8e0 con 0x7fe8640cd090 2024-04-25T02:12:18.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.012+0000 7fe869990640 1 --2- 172.21.15.79:0/882712607 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe84806be30 0x7fe84806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.012+0000 7fe869990640 1 --2- 172.21.15.79:0/882712607 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe84806be30 0x7fe84806e2f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe860007dc0 tx=0x7fe8600072f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:18.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.013+0000 7fe86e9d7740 1 Processor -- start 2024-04-25T02:12:18.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.013+0000 7fe86e9d7740 1 -- start start 2024-04-25T02:12:18.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe86e9d7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455fe9f0 0x56344561c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe86e9d7740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455faee0 0x5634455d3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe86e9d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455d3640 0x5634455fedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe86e9d7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563445537940 con 0x5634455fe9f0 2024-04-25T02:12:18.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe86e9d7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5634454df920 con 0x5634455d3640 2024-04-25T02:12:18.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe86e9d7740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x563445533900 con 0x5634455faee0 2024-04-25T02:12:18.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe869990640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455fe9f0 0x56344561c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe869990640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455fe9f0 0x56344561c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59038/0 (socket says 172.21.15.79:59038) 2024-04-25T02:12:18.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe869990640 1 -- 172.21.15.79:0/2924104063 learned_addr learned my addr 172.21.15.79:0/2924104063 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:18.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe86918f640 1 --2- 172.21.15.79:0/2924104063 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455faee0 0x5634455d3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe86a191640 1 --2- 172.21.15.79:0/2924104063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455d3640 0x5634455fedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe869990640 1 -- 172.21.15.79:0/2924104063 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455faee0 msgr2=0x5634455d3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe869990640 1 --2- 172.21.15.79:0/2924104063 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455faee0 0x5634455d3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe869990640 1 -- 172.21.15.79:0/2924104063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455d3640 msgr2=0x5634455fedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe869990640 1 --2- 172.21.15.79:0/2924104063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455d3640 0x5634455fedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe869990640 1 -- 172.21.15.79:0/2924104063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563445317a20 con 0x5634455fe9f0 2024-04-25T02:12:18.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe869990640 1 --2- 172.21.15.79:0/2924104063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455fe9f0 0x56344561c7b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe86000cfc0 tx=0x7fe86000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96831a0d983cd655 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:18.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.014+0000 7fe8477fe640 1 -- 172.21.15.79:0/2924104063 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860023070 con 0x5634455fe9f0 2024-04-25T02:12:18.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.015+0000 7fe8477fe640 1 -- 172.21.15.79:0/2924104063 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe860011820 con 0x5634455fe9f0 2024-04-25T02:12:18.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.015+0000 7fe8477fe640 1 -- 172.21.15.79:0/2924104063 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860011bf0 con 0x5634455fe9f0 2024-04-25T02:12:18.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.015+0000 7fe86e9d7740 1 -- 172.21.15.79:0/2924104063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455fe9f0 msgr2=0x56344561c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.015+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/2924104063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455fe9f0 0x56344561c7b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe86000cfc0 tx=0x7fe86000f000 comp rx=0 tx=0).stop 2024-04-25T02:12:18.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.015+0000 7fe86e9d7740 1 -- 172.21.15.79:0/2924104063 shutdown_connections 2024-04-25T02:12:18.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.015+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/2924104063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455d3640 0x5634455fedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.015+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/2924104063 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455faee0 0x5634455d3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.015+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/2924104063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455fe9f0 0x56344561c7b0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.015+0000 7fe86e9d7740 1 -- 172.21.15.79:0/2924104063 >> 172.21.15.79:0/2924104063 conn(0x5634455d1150 msgr2=0x56344561cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:18.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.015+0000 7fe86e9d7740 1 -- 172.21.15.79:0/2924104063 shutdown_connections 2024-04-25T02:12:18.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.015+0000 7fe86e9d7740 1 -- 172.21.15.79:0/2924104063 wait complete. 2024-04-25T02:12:18.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.016+0000 7fe86e9d7740 1 -- start start 2024-04-25T02:12:18.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.016+0000 7fe86e9d7740 1 Processor -- start 2024-04-25T02:12:18.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86e9d7740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455faee0 0x5634455f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86e9d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455fe9f0 0x56344561aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86e9d7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455efd30 0x56344561af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86e9d7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56344561de40 con 0x5634455efd30 2024-04-25T02:12:18.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86e9d7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5634454f3030 con 0x5634455fe9f0 2024-04-25T02:12:18.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86e9d7740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56344561d680 con 0x5634455faee0 2024-04-25T02:12:18.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86e9d7740 10 client.0 _ll_register_callbacks cb 0x5634454ede00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:18.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86a191640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455efd30 0x56344561af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86a191640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455efd30 0x56344561af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59046/0 (socket says 172.21.15.79:59046) 2024-04-25T02:12:18.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86a191640 1 -- 172.21.15.79:0/196426688 learned_addr learned my addr 172.21.15.79:0/196426688 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:18.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe869990640 1 --2- 172.21.15.79:0/196426688 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455faee0 0x5634455f7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86918f640 1 --2- 172.21.15.79:0/196426688 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455fe9f0 0x56344561aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86a191640 1 -- 172.21.15.79:0/196426688 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455faee0 msgr2=0x5634455f7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86a191640 1 --2- 172.21.15.79:0/196426688 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455faee0 0x5634455f7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86a191640 1 -- 172.21.15.79:0/196426688 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455fe9f0 msgr2=0x56344561aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86a191640 1 --2- 172.21.15.79:0/196426688 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455fe9f0 0x56344561aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86a191640 1 -- 172.21.15.79:0/196426688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56344520b310 con 0x5634455efd30 2024-04-25T02:12:18.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86918f640 1 --2- 172.21.15.79:0/196426688 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455fe9f0 0x56344561aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:18.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe86a191640 1 --2- 172.21.15.79:0/196426688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455efd30 0x56344561af80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe85c035040 tx=0x7fe85c07a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f2d7ec92b12979 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:18.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe844ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe844ff9640 1 -- 172.21.15.79:0/196426688 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c091020 con 0x5634455efd30 2024-04-25T02:12:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.017+0000 7fe844ff9640 1 -- 172.21.15.79:0/196426688 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7fe85c0a4e20 con 0x5634455efd30 2024-04-25T02:12:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.018+0000 7fe86e9d7740 1 -- 172.21.15.79:0/196426688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe860011820 con 0x5634455efd30 2024-04-25T02:12:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.018+0000 7fe844ff9640 1 -- 172.21.15.79:0/196426688 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe85c07ae60 con 0x5634455efd30 2024-04-25T02:12:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.018+0000 7fe86e9d7740 10 client.7026 fetch_fsmap learned FSMap version 38 2024-04-25T02:12:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.018+0000 7fe86e9d7740 1 -- 172.21.15.79:0/196426688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x5634453781b0 con 0x5634455efd30 2024-04-25T02:12:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.018+0000 7fe844ff9640 1 -- 172.21.15.79:0/196426688 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe860011820 con 0x5634455efd30 2024-04-25T02:12:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.018+0000 7fe844ff9640 1 -- 172.21.15.79:0/196426688 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 3494+0+0 (secure 0 0 0) 0x7fe85c03a030 con 0x5634455efd30 2024-04-25T02:12:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.018+0000 7fe86e9d7740 10 client.7026 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T02:12:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.018+0000 7fe86e9d7740 10 client.7026 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T02:12:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.018+0000 7fe86e9d7740 20 client.7026 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.018+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/196426688 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x56344561f980 0x56344561fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.018+0000 7fe86e9d7740 4 client.7026 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.018+0000 7fe86e9d7740 1 -- 172.21.15.79:0/196426688 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563445544e80 con 0x56344561f980 2024-04-25T02:12:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.018+0000 7fe869990640 1 --2- 172.21.15.79:0/196426688 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x56344561f980 0x56344561fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.018+0000 7fe869990640 1 --2- 172.21.15.79:0/196426688 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x56344561f980 0x56344561fd90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df60dda7a370802f server_cookie=824837ff9d8a3f89 in_seq=0 out_seq=0 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.018+0000 7fe844ff9640 10 client.7026 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.019+0000 7fe844ff9640 1 -- 172.21.15.79:0/196426688 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563445544e80 con 0x56344561f980 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.019+0000 7fe844ff9640 10 client.7026 handle_command_reply: tid=0 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.019+0000 7fe86e9d7740 1 client.7026 shutdown 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.019+0000 7fe86e9d7740 1 -- 172.21.15.79:0/196426688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455efd30 msgr2=0x56344561af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.019+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/196426688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455efd30 0x56344561af80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe85c035040 tx=0x7fe85c07a2f0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.019+0000 7fe86e9d7740 1 -- 172.21.15.79:0/196426688 shutdown_connections 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.019+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/196426688 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x56344561f980 0x56344561fd90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.019+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/196426688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455efd30 0x56344561af80 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.019+0000 7fe844ff9640 0 client.7026 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.019+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/196426688 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455fe9f0 0x56344561aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.019+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/196426688 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455faee0 0x5634455f7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.019+0000 7fe86e9d7740 1 -- 172.21.15.79:0/196426688 >> 172.21.15.79:0/196426688 conn(0x5634455d3640 msgr2=0x56344561c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.019+0000 7fe86e9d7740 1 -- 172.21.15.79:0/196426688 shutdown_connections 2024-04-25T02:12:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.019+0000 7fe86e9d7740 1 -- 172.21.15.79:0/196426688 wait complete. 2024-04-25T02:12:18.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.019+0000 7fe86e9d7740 20 client.7026 trim_cache size 0 max 16384 2024-04-25T02:12:18.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.037+0000 7fe86e9d7740 1 Processor -- start 2024-04-25T02:12:18.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.037+0000 7fe86e9d7740 1 -- start start 2024-04-25T02:12:18.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.037+0000 7fe86e9d7740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455efd30 0x56344561ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.037+0000 7fe86e9d7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455faee0 0x5634455f9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.037+0000 7fe86e9d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455fe9f0 0x5634455f98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.037+0000 7fe86e9d7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe864200920 con 0x5634455faee0 2024-04-25T02:12:18.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.037+0000 7fe86e9d7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8641ffa60 con 0x5634455fe9f0 2024-04-25T02:12:18.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.037+0000 7fe86e9d7740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe864161190 con 0x5634455efd30 2024-04-25T02:12:18.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.037+0000 7fe86918f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455faee0 0x5634455f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.038+0000 7fe86918f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455faee0 0x5634455f9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59050/0 (socket says 172.21.15.79:59050) 2024-04-25T02:12:18.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.038+0000 7fe86918f640 1 -- 172.21.15.79:0/682663684 learned_addr learned my addr 172.21.15.79:0/682663684 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:18.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.038+0000 7fe869990640 1 --2- 172.21.15.79:0/682663684 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455efd30 0x56344561ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.038+0000 7fe86a191640 1 --2- 172.21.15.79:0/682663684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455fe9f0 0x5634455f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.038+0000 7fe86918f640 1 -- 172.21.15.79:0/682663684 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455efd30 msgr2=0x56344561ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.038+0000 7fe86918f640 1 --2- 172.21.15.79:0/682663684 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455efd30 0x56344561ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.038+0000 7fe86918f640 1 -- 172.21.15.79:0/682663684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455fe9f0 msgr2=0x5634455f98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.038+0000 7fe86918f640 1 --2- 172.21.15.79:0/682663684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455fe9f0 0x5634455f98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.038+0000 7fe86918f640 1 -- 172.21.15.79:0/682663684 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634451e4490 con 0x5634455faee0 2024-04-25T02:12:18.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.038+0000 7fe86918f640 1 --2- 172.21.15.79:0/682663684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455faee0 0x5634455f9370 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fe8640c9320 tx=0x7fe85400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec003dd0d7b795a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:18.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.038+0000 7fe846ffd640 1 -- 172.21.15.79:0/682663684 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85401a020 con 0x5634455faee0 2024-04-25T02:12:18.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.038+0000 7fe846ffd640 1 -- 172.21.15.79:0/682663684 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe854010a40 con 0x5634455faee0 2024-04-25T02:12:18.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.038+0000 7fe846ffd640 1 -- 172.21.15.79:0/682663684 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854010e30 con 0x5634455faee0 2024-04-25T02:12:18.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.039+0000 7fe86e9d7740 1 -- 172.21.15.79:0/682663684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455faee0 msgr2=0x5634455f9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.039+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/682663684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455faee0 0x5634455f9370 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fe8640c9320 tx=0x7fe85400ed80 comp rx=0 tx=0).stop 2024-04-25T02:12:18.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.039+0000 7fe86e9d7740 1 -- 172.21.15.79:0/682663684 shutdown_connections 2024-04-25T02:12:18.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.039+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/682663684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455fe9f0 0x5634455f98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.039+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/682663684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455faee0 0x5634455f9370 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.039+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/682663684 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455efd30 0x56344561ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.039+0000 7fe86e9d7740 1 -- 172.21.15.79:0/682663684 >> 172.21.15.79:0/682663684 conn(0x5634455d3640 msgr2=0x5634455d26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:18.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.039+0000 7fe86e9d7740 1 -- 172.21.15.79:0/682663684 shutdown_connections 2024-04-25T02:12:18.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.039+0000 7fe86e9d7740 1 -- 172.21.15.79:0/682663684 wait complete. 2024-04-25T02:12:18.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.039+0000 7fe86e9d7740 1 -- start start 2024-04-25T02:12:18.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.039+0000 7fe86e9d7740 1 Processor -- start 2024-04-25T02:12:18.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.040+0000 7fe86e9d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455efd30 0x5634455f2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.040+0000 7fe86e9d7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455faee0 0x563445693660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.040+0000 7fe86e9d7740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455fe9f0 0x5634455ee6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.040+0000 7fe86e9d7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe8640b40a0 con 0x5634455faee0 2024-04-25T02:12:18.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.040+0000 7fe86e9d7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5634455d2270 con 0x5634455efd30 2024-04-25T02:12:18.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.040+0000 7fe86e9d7740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56344561dba0 con 0x5634455fe9f0 2024-04-25T02:12:18.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.040+0000 7fe86e9d7740 10 client.0 _ll_register_callbacks cb 0x7fe85c0094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:18.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.040+0000 7fe86918f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455faee0 0x563445693660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.040+0000 7fe86918f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455faee0 0x563445693660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59056/0 (socket says 172.21.15.79:59056) 2024-04-25T02:12:18.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.040+0000 7fe86918f640 1 -- 172.21.15.79:0/2460703707 learned_addr learned my addr 172.21.15.79:0/2460703707 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:18.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.040+0000 7fe869990640 1 --2- 172.21.15.79:0/2460703707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455efd30 0x5634455f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.040+0000 7fe86a191640 1 --2- 172.21.15.79:0/2460703707 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455fe9f0 0x5634455ee6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe86918f640 1 -- 172.21.15.79:0/2460703707 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455fe9f0 msgr2=0x5634455ee6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe86918f640 1 --2- 172.21.15.79:0/2460703707 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455fe9f0 0x5634455ee6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe86918f640 1 -- 172.21.15.79:0/2460703707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455efd30 msgr2=0x5634455f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe86918f640 1 --2- 172.21.15.79:0/2460703707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455efd30 0x5634455f2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe86918f640 1 -- 172.21.15.79:0/2460703707 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634455fa2f0 con 0x5634455faee0 2024-04-25T02:12:18.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe86918f640 1 --2- 172.21.15.79:0/2460703707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455faee0 0x563445693660 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fe854019040 tx=0x7fe8540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718ca97bcd652e90 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:18.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe844ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:18.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe844ff9640 1 -- 172.21.15.79:0/2460703707 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85400e4f0 con 0x5634455faee0 2024-04-25T02:12:18.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe844ff9640 1 -- 172.21.15.79:0/2460703707 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7fe8540169c0 con 0x5634455faee0 2024-04-25T02:12:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe86e9d7740 1 -- 172.21.15.79:0/2460703707 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe854010a40 con 0x5634455faee0 2024-04-25T02:12:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe844ff9640 1 -- 172.21.15.79:0/2460703707 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe854032050 con 0x5634455faee0 2024-04-25T02:12:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe86e9d7740 10 client.7032 fetch_fsmap learned FSMap version 38 2024-04-25T02:12:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe86e9d7740 1 -- 172.21.15.79:0/2460703707 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x5634455f9db0 con 0x5634455faee0 2024-04-25T02:12:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe844ff9640 1 -- 172.21.15.79:0/2460703707 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe854010a40 con 0x5634455faee0 2024-04-25T02:12:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe844ff9640 1 -- 172.21.15.79:0/2460703707 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 3494+0+0 (secure 0 0 0) 0x7fe854035020 con 0x5634455faee0 2024-04-25T02:12:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe86e9d7740 10 client.7032 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T02:12:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe86e9d7740 10 client.7032 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T02:12:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe86e9d7740 20 client.7032 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/2460703707 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5634455f9260 0x5634455f9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe86e9d7740 4 client.7032 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}] 2024-04-25T02:12:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe86e9d7740 1 -- 172.21.15.79:0/2460703707 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}) -- 0x56344553f1d0 con 0x5634455f9260 2024-04-25T02:12:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.041+0000 7fe869990640 1 --2- 172.21.15.79:0/2460703707 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5634455f9260 0x5634455f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe844ff9640 10 client.7032 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe869990640 1 --2- 172.21.15.79:0/2460703707 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5634455f9260 0x5634455f9670 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4aada80073665b1 server_cookie=416f9bb986f439d7 in_seq=0 out_seq=0 2024-04-25T02:12:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe844ff9640 1 -- 172.21.15.79:0/2460703707 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56344553f1d0 con 0x5634455f9260 2024-04-25T02:12:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe844ff9640 10 client.7032 handle_command_reply: tid=0 2024-04-25T02:12:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe86e9d7740 1 client.7032 shutdown 2024-04-25T02:12:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe86e9d7740 1 -- 172.21.15.79:0/2460703707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455faee0 msgr2=0x563445693660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/2460703707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455faee0 0x563445693660 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fe854019040 tx=0x7fe8540046c0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe86e9d7740 1 -- 172.21.15.79:0/2460703707 shutdown_connections 2024-04-25T02:12:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/2460703707 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5634455f9260 0x5634455f9670 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/2460703707 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5634455fe9f0 0x5634455ee6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe844ff9640 0 client.7032 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/2460703707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634455faee0 0x563445693660 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe86e9d7740 1 --2- 172.21.15.79:0/2460703707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634455efd30 0x5634455f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe86e9d7740 1 -- 172.21.15.79:0/2460703707 >> 172.21.15.79:0/2460703707 conn(0x5634455d3640 msgr2=0x5634456133a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:18.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe86e9d7740 1 -- 172.21.15.79:0/2460703707 shutdown_connections 2024-04-25T02:12:18.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.042+0000 7fe86e9d7740 1 -- 172.21.15.79:0/2460703707 wait complete. 2024-04-25T02:12:18.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.043+0000 7fe86e9d7740 20 client.7032 trim_cache size 0 max 16384 2024-04-25T02:12:18.057 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:12:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-04-25T02:12:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "67180eb2-7af0-4aaf-a5bf-c088c0e55bb2", 2024-04-25T02:12:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-04-25T02:12:18.057 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:12:18.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.043+0000 7fe86bbf4640 1 -- 172.21.15.79:0/882712607 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe84806be30 msgr2=0x7fe84806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.043+0000 7fe86bbf4640 1 --2- 172.21.15.79:0/882712607 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe84806be30 0x7fe84806e2f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe860007dc0 tx=0x7fe8600072f0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.043+0000 7fe86bbf4640 1 -- 172.21.15.79:0/882712607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640cd090 msgr2=0x7fe8640c7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.043+0000 7fe86bbf4640 1 --2- 172.21.15.79:0/882712607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640cd090 0x7fe8640c7540 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0090b0 tx=0x7fe85c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.043+0000 7fe86bbf4640 1 -- 172.21.15.79:0/882712607 shutdown_connections 2024-04-25T02:12:18.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.043+0000 7fe86bbf4640 1 --2- 172.21.15.79:0/882712607 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe84806be30 0x7fe84806e2f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.043+0000 7fe86bbf4640 1 --2- 172.21.15.79:0/882712607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8640cd090 0x7fe8640c7540 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.043+0000 7fe86bbf4640 1 --2- 172.21.15.79:0/882712607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8640cccb0 0x7fe8640b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.043+0000 7fe86bbf4640 1 --2- 172.21.15.79:0/882712607 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe86406da30 0x7fe86415e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.043+0000 7fe86bbf4640 1 -- 172.21.15.79:0/882712607 >> 172.21.15.79:0/882712607 conn(0x7fe8640b1ba0 msgr2=0x7fe864071060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:18.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.043+0000 7fe86bbf4640 1 -- 172.21.15.79:0/882712607 shutdown_connections 2024-04-25T02:12:18.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.043+0000 7fe86bbf4640 1 -- 172.21.15.79:0/882712607 wait complete. 2024-04-25T02:12:18.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:18.061 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T02:12:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.152+0000 7f0728da2640 1 Processor -- start 2024-04-25T02:12:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.152+0000 7f0728da2640 1 -- start start 2024-04-25T02:12:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.153+0000 7f0728da2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f072406b2f0 0x7f07240b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.153+0000 7f0728da2640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f07240cf7a0 0x7f072406b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.153+0000 7f0728da2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f072406bc10 con 0x7f072406e6b0 2024-04-25T02:12:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.153+0000 7f0728da2640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f072415f830 con 0x7f07240cf7a0 2024-04-25T02:12:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.153+0000 7f0728da2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f072415ec20 con 0x7f072406b2f0 2024-04-25T02:12:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.153+0000 7f0721d9b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f07240cf7a0 0x7f072406b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.153+0000 7f072259c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f072406b2f0 0x7f07240b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.153+0000 7f0722d9d640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f072406e6b0 0x7f07240cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:54872/0 (socket says 172.21.15.79:54872) 2024-04-25T02:12:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.153+0000 7f0722d9d640 1 -- 172.21.15.79:0/2825225856 learned_addr learned my addr 172.21.15.79:0/2825225856 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.154+0000 7f0721d9b640 1 -- 172.21.15.79:0/2825225856 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f072406b2f0 msgr2=0x7f07240b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.154+0000 7f0721d9b640 1 --2- 172.21.15.79:0/2825225856 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f072406b2f0 0x7f07240b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.154+0000 7f0721d9b640 1 -- 172.21.15.79:0/2825225856 >> v1:172.21.15.189:6789/0 conn(0x7f072406e6b0 legacy=0x7f07240cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.154+0000 7f0721d9b640 1 -- 172.21.15.79:0/2825225856 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072415ef00 con 0x7f07240cf7a0 2024-04-25T02:12:18.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.154+0000 7f072159a640 1 -- 172.21.15.79:0/2825225856 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178730718 0 0) 0x7f072406bc10 con 0x7f072406e6b0 2024-04-25T02:12:18.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.155+0000 7f0721d9b640 1 --2- 172.21.15.79:0/2825225856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07240cf7a0 0x7f072406b6d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f07180097a0 tx=0x7f071802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f818080e0339772 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:18.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.155+0000 7f072159a640 1 -- 172.21.15.79:0/2825225856 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718037070 con 0x7f07240cf7a0 2024-04-25T02:12:18.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.155+0000 7f072159a640 1 -- 172.21.15.79:0/2825225856 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f071802ae50 con 0x7f07240cf7a0 2024-04-25T02:12:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.155+0000 7f072159a640 1 -- 172.21.15.79:0/2825225856 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718032660 con 0x7f07240cf7a0 2024-04-25T02:12:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.155+0000 7f0728da2640 1 -- 172.21.15.79:0/2825225856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07240cf7a0 msgr2=0x7f072406b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.155+0000 7f0728da2640 1 --2- 172.21.15.79:0/2825225856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07240cf7a0 0x7f072406b6d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f07180097a0 tx=0x7f071802a100 comp rx=0 tx=0).stop 2024-04-25T02:12:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.155+0000 7f0728da2640 1 -- 172.21.15.79:0/2825225856 shutdown_connections 2024-04-25T02:12:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.155+0000 7f0728da2640 1 --2- 172.21.15.79:0/2825225856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07240cf7a0 0x7f072406b6d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.155+0000 7f0728da2640 1 --2- 172.21.15.79:0/2825225856 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f072406b2f0 0x7f07240b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.155+0000 7f0728da2640 1 -- 172.21.15.79:0/2825225856 >> 172.21.15.79:0/2825225856 conn(0x7f07240b1cd0 msgr2=0x7f07240b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.155+0000 7f0728da2640 1 -- 172.21.15.79:0/2825225856 shutdown_connections 2024-04-25T02:12:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.155+0000 7f0728da2640 1 -- 172.21.15.79:0/2825225856 wait complete. 2024-04-25T02:12:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.157+0000 7f0728da2640 1 Processor -- start 2024-04-25T02:12:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.157+0000 7f0728da2640 1 -- start start 2024-04-25T02:12:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.157+0000 7f0728da2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f072406b2f0 0x7f07240cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.157+0000 7f0728da2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f072406e6b0 0x7f072415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.157+0000 7f0728da2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07240cf7a0 0x7f07240ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.157+0000 7f0728da2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f072406cfe0 con 0x7f07240cf7a0 2024-04-25T02:12:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.157+0000 7f0728da2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f072415f4c0 con 0x7f072406e6b0 2024-04-25T02:12:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.157+0000 7f0728da2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f072406d160 con 0x7f072406b2f0 2024-04-25T02:12:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.157+0000 7f0722d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07240cf7a0 0x7f07240ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.157+0000 7f0722d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07240cf7a0 0x7f07240ae290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59060/0 (socket says 172.21.15.79:59060) 2024-04-25T02:12:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.157+0000 7f0722d9d640 1 -- 172.21.15.79:0/4237724333 learned_addr learned my addr 172.21.15.79:0/4237724333 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.158+0000 7f0721d9b640 1 --2- 172.21.15.79:0/4237724333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f072406e6b0 0x7f072415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.158+0000 7f072259c640 1 --2- 172.21.15.79:0/4237724333 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f072406b2f0 0x7f07240cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.158+0000 7f0722d9d640 1 -- 172.21.15.79:0/4237724333 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f072406b2f0 msgr2=0x7f07240cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.158+0000 7f0722d9d640 1 --2- 172.21.15.79:0/4237724333 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f072406b2f0 0x7f07240cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.158+0000 7f0722d9d640 1 -- 172.21.15.79:0/4237724333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f072406e6b0 msgr2=0x7f072415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.158+0000 7f0722d9d640 1 --2- 172.21.15.79:0/4237724333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f072406e6b0 0x7f072415a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.158+0000 7f0722d9d640 1 -- 172.21.15.79:0/4237724333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07240ad1f0 con 0x7f07240cf7a0 2024-04-25T02:12:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.158+0000 7f0722d9d640 1 --2- 172.21.15.79:0/4237724333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07240cf7a0 0x7f07240ae290 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f071c00c430 tx=0x7f071c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.158+0000 7f0712ffd640 1 -- 172.21.15.79:0/4237724333 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c0074e0 con 0x7f07240cf7a0 2024-04-25T02:12:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.158+0000 7f0712ffd640 1 -- 172.21.15.79:0/4237724333 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f071c0047e0 con 0x7f07240cf7a0 2024-04-25T02:12:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.158+0000 7f0728da2640 1 -- 172.21.15.79:0/4237724333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07240ad4d0 con 0x7f07240cf7a0 2024-04-25T02:12:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.158+0000 7f0712ffd640 1 -- 172.21.15.79:0/4237724333 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c004bd0 con 0x7f07240cf7a0 2024-04-25T02:12:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.158+0000 7f0728da2640 1 -- 172.21.15.79:0/4237724333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07240ada90 con 0x7f07240cf7a0 2024-04-25T02:12:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.159+0000 7f0712ffd640 1 -- 172.21.15.79:0/4237724333 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f071c011070 con 0x7f07240cf7a0 2024-04-25T02:12:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.160+0000 7f0712ffd640 1 --2- 172.21.15.79:0/4237724333 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f070406be30 0x7f070406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.160+0000 7f0712ffd640 1 -- 172.21.15.79:0/4237724333 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7f071c08ab60 con 0x7f07240cf7a0 2024-04-25T02:12:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.160+0000 7f072259c640 1 --2- 172.21.15.79:0/4237724333 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f070406be30 0x7f070406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.160+0000 7f072259c640 1 --2- 172.21.15.79:0/4237724333 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f070406be30 0x7f070406e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f07140074a0 tx=0x7f071400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:18.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.161+0000 7f072bb93740 1 Processor -- start 2024-04-25T02:12:18.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.161+0000 7f072bb93740 1 -- start start 2024-04-25T02:12:18.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f072bb93740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbab2d60 0x5616bbab3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f072bb93740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbad0600 0x5616bbad0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f072bb93740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bba88a40 0x5616bbacecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f072bb93740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5616bb9ec6b0 con 0x5616bbab2d60 2024-04-25T02:12:18.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f072bb93740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5616bb994880 con 0x5616bbad0600 2024-04-25T02:12:18.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f072bb93740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5616bb9e8670 con 0x5616bba88a40 2024-04-25T02:12:18.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f072259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbab2d60 0x5616bbab3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f072259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbab2d60 0x5616bbab3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59074/0 (socket says 172.21.15.79:59074) 2024-04-25T02:12:18.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f072259c640 1 -- 172.21.15.79:0/515944911 learned_addr learned my addr 172.21.15.79:0/515944911 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f0722d9d640 1 --2- 172.21.15.79:0/515944911 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bba88a40 0x5616bbacecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f0721d9b640 1 --2- 172.21.15.79:0/515944911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbad0600 0x5616bbad0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f072259c640 1 -- 172.21.15.79:0/515944911 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bba88a40 msgr2=0x5616bbacecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f072259c640 1 --2- 172.21.15.79:0/515944911 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bba88a40 0x5616bbacecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f072259c640 1 -- 172.21.15.79:0/515944911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbad0600 msgr2=0x5616bbad0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f072259c640 1 --2- 172.21.15.79:0/515944911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbad0600 0x5616bbad0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f072259c640 1 -- 172.21.15.79:0/515944911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616bb7ca7d0 con 0x5616bbab2d60 2024-04-25T02:12:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f0721d9b640 1 --2- 172.21.15.79:0/515944911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbad0600 0x5616bbad0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f0722d9d640 1 --2- 172.21.15.79:0/515944911 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bba88a40 0x5616bbacecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f072259c640 1 --2- 172.21.15.79:0/515944911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbab2d60 0x5616bbab3140 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f0714016800 tx=0x7f0714014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8658bde23f0c8b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f0703fff640 1 -- 172.21.15.79:0/515944911 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071401d040 con 0x5616bbab2d60 2024-04-25T02:12:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f0703fff640 1 -- 172.21.15.79:0/515944911 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0714026070 con 0x5616bbab2d60 2024-04-25T02:12:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.162+0000 7f0703fff640 1 -- 172.21.15.79:0/515944911 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0714017ba0 con 0x5616bbab2d60 2024-04-25T02:12:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.163+0000 7f072bb93740 1 -- 172.21.15.79:0/515944911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbab2d60 msgr2=0x5616bbab3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.163+0000 7f072bb93740 1 --2- 172.21.15.79:0/515944911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbab2d60 0x5616bbab3140 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f0714016800 tx=0x7f0714014000 comp rx=0 tx=0).stop 2024-04-25T02:12:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.163+0000 7f072bb93740 1 -- 172.21.15.79:0/515944911 shutdown_connections 2024-04-25T02:12:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.163+0000 7f072bb93740 1 --2- 172.21.15.79:0/515944911 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bba88a40 0x5616bbacecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.163+0000 7f072bb93740 1 --2- 172.21.15.79:0/515944911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbad0600 0x5616bbad0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.163+0000 7f072bb93740 1 --2- 172.21.15.79:0/515944911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbab2d60 0x5616bbab3140 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.163+0000 7f072bb93740 1 -- 172.21.15.79:0/515944911 >> 172.21.15.79:0/515944911 conn(0x5616bba85600 msgr2=0x5616bbacdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.163+0000 7f072bb93740 1 -- 172.21.15.79:0/515944911 shutdown_connections 2024-04-25T02:12:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.163+0000 7f072bb93740 1 -- 172.21.15.79:0/515944911 wait complete. 2024-04-25T02:12:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.164+0000 7f072bb93740 1 -- start start 2024-04-25T02:12:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.164+0000 7f072bb93740 1 Processor -- start 2024-04-25T02:12:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.164+0000 7f072bb93740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbab2d60 0x5616bbab1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.164+0000 7f072bb93740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bbad0600 0x5616bbac6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f072bb93740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbac4c20 0x5616bbade7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f072bb93740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5616bba897e0 con 0x5616bbac4c20 2024-04-25T02:12:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f072bb93740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5616bb9a7f50 con 0x5616bbab2d60 2024-04-25T02:12:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f072bb93740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5616bba83530 con 0x5616bbad0600 2024-04-25T02:12:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f072bb93740 10 client.0 _ll_register_callbacks cb 0x5616bb9e3000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f0722d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbac4c20 0x5616bbade7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f0722d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbac4c20 0x5616bbade7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59084/0 (socket says 172.21.15.79:59084) 2024-04-25T02:12:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f0722d9d640 1 -- 172.21.15.79:0/2480321124 learned_addr learned my addr 172.21.15.79:0/2480321124 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f072259c640 1 --2- 172.21.15.79:0/2480321124 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbab2d60 0x5616bbab1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f0721d9b640 1 --2- 172.21.15.79:0/2480321124 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bbad0600 0x5616bbac6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f0722d9d640 1 -- 172.21.15.79:0/2480321124 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bbad0600 msgr2=0x5616bbac6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f0722d9d640 1 --2- 172.21.15.79:0/2480321124 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bbad0600 0x5616bbac6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f0722d9d640 1 -- 172.21.15.79:0/2480321124 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbab2d60 msgr2=0x5616bbab1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f0722d9d640 1 --2- 172.21.15.79:0/2480321124 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbab2d60 0x5616bbab1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f0722d9d640 1 -- 172.21.15.79:0/2480321124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616bb7003f0 con 0x5616bbac4c20 2024-04-25T02:12:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f0722d9d640 1 --2- 172.21.15.79:0/2480321124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbac4c20 0x5616bbade7a0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f071c058b70 tx=0x7f071c00e340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a85aed4331cbaca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f07017fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f07017fa640 1 -- 172.21.15.79:0/2480321124 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c086070 con 0x5616bbac4c20 2024-04-25T02:12:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f07017fa640 1 -- 172.21.15.79:0/2480321124 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7f071c0584c0 con 0x5616bbac4c20 2024-04-25T02:12:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f072bb93740 1 -- 172.21.15.79:0/2480321124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0714026070 con 0x5616bbac4c20 2024-04-25T02:12:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f07017fa640 1 -- 172.21.15.79:0/2480321124 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f071c05d220 con 0x5616bbac4c20 2024-04-25T02:12:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f072bb93740 10 client.7041 fetch_fsmap learned FSMap version 38 2024-04-25T02:12:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f072bb93740 1 -- 172.21.15.79:0/2480321124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x5616bb6c00f0 con 0x5616bbac4c20 2024-04-25T02:12:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.165+0000 7f07017fa640 1 -- 172.21.15.79:0/2480321124 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0714026070 con 0x5616bbac4c20 2024-04-25T02:12:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.166+0000 7f07017fa640 1 -- 172.21.15.79:0/2480321124 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 3494+0+0 (secure 0 0 0) 0x7f071c05f420 con 0x5616bbac4c20 2024-04-25T02:12:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.166+0000 7f072bb93740 10 client.7041 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T02:12:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.166+0000 7f072bb93740 10 client.7041 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T02:12:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.166+0000 7f072bb93740 20 client.7041 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.166+0000 7f072bb93740 1 --2- 172.21.15.79:0/2480321124 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5616bbaa4210 0x5616bbaa4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.166+0000 7f072bb93740 4 client.7041 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.166+0000 7f072bb93740 1 -- 172.21.15.79:0/2480321124 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616bb9f9bf0 con 0x5616bbaa4210 2024-04-25T02:12:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.166+0000 7f072259c640 1 --2- 172.21.15.79:0/2480321124 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5616bbaa4210 0x5616bbaa4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.166+0000 7f07017fa640 10 client.7041 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.166+0000 7f072259c640 1 --2- 172.21.15.79:0/2480321124 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5616bbaa4210 0x5616bbaa4620 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24acad4f769a7066 server_cookie=48b716a7b585941a in_seq=0 out_seq=0 2024-04-25T02:12:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.167+0000 7f07017fa640 1 -- 172.21.15.79:0/2480321124 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5616bb9f9bf0 con 0x5616bbaa4210 2024-04-25T02:12:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.167+0000 7f07017fa640 10 client.7041 handle_command_reply: tid=0 2024-04-25T02:12:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.167+0000 7f072bb93740 1 client.7041 shutdown 2024-04-25T02:12:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.167+0000 7f072bb93740 1 -- 172.21.15.79:0/2480321124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbac4c20 msgr2=0x5616bbade7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.167+0000 7f072bb93740 1 --2- 172.21.15.79:0/2480321124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbac4c20 0x5616bbade7a0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f071c058b70 tx=0x7f071c00e340 comp rx=0 tx=0).stop 2024-04-25T02:12:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.167+0000 7f072bb93740 1 -- 172.21.15.79:0/2480321124 shutdown_connections 2024-04-25T02:12:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.167+0000 7f072bb93740 1 --2- 172.21.15.79:0/2480321124 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5616bbaa4210 0x5616bbaa4620 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.167+0000 7f072bb93740 1 --2- 172.21.15.79:0/2480321124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbac4c20 0x5616bbade7a0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.167+0000 7f07017fa640 0 client.7041 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.167+0000 7f072bb93740 1 --2- 172.21.15.79:0/2480321124 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bbad0600 0x5616bbac6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.167+0000 7f072bb93740 1 --2- 172.21.15.79:0/2480321124 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbab2d60 0x5616bbab1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.167+0000 7f072bb93740 1 -- 172.21.15.79:0/2480321124 >> 172.21.15.79:0/2480321124 conn(0x5616bba88a40 msgr2=0x5616bbad10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.167+0000 7f072bb93740 1 -- 172.21.15.79:0/2480321124 shutdown_connections 2024-04-25T02:12:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.167+0000 7f072bb93740 1 -- 172.21.15.79:0/2480321124 wait complete. 2024-04-25T02:12:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.167+0000 7f072bb93740 20 client.7041 trim_cache size 0 max 16384 2024-04-25T02:12:18.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.184+0000 7f072bb93740 1 Processor -- start 2024-04-25T02:12:18.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.184+0000 7f072bb93740 1 -- start start 2024-04-25T02:12:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.185+0000 7f072bb93740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbab2d60 0x5616bbab5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.185+0000 7f072bb93740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bbac4c20 0x5616bba86910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.185+0000 7f072bb93740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbad0600 0x5616bba86e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.185+0000 7f072bb93740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07242005f0 con 0x5616bbab2d60 2024-04-25T02:12:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.185+0000 7f072bb93740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0724159560 con 0x5616bbad0600 2024-04-25T02:12:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.185+0000 7f072bb93740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f07241588c0 con 0x5616bbac4c20 2024-04-25T02:12:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.185+0000 7f072259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbab2d60 0x5616bbab5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.185+0000 7f072259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbab2d60 0x5616bbab5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59086/0 (socket says 172.21.15.79:59086) 2024-04-25T02:12:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.185+0000 7f072259c640 1 -- 172.21.15.79:0/1531342960 learned_addr learned my addr 172.21.15.79:0/1531342960 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.185+0000 7f072259c640 1 -- 172.21.15.79:0/1531342960 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bbac4c20 msgr2=0x5616bba86910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.185+0000 7f072259c640 1 --2- 172.21.15.79:0/1531342960 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bbac4c20 0x5616bba86910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.185+0000 7f072259c640 1 -- 172.21.15.79:0/1531342960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbad0600 msgr2=0x5616bba86e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.185+0000 7f072259c640 1 --2- 172.21.15.79:0/1531342960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbad0600 0x5616bba86e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.185+0000 7f072259c640 1 -- 172.21.15.79:0/1531342960 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616bbab5f70 con 0x5616bbab2d60 2024-04-25T02:12:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.186+0000 7f072259c640 1 --2- 172.21.15.79:0/1531342960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbab2d60 0x5616bbab5a30 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0714022000 tx=0x7f0714016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d868b08e209f632a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.186+0000 7f07037fe640 1 -- 172.21.15.79:0/1531342960 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0714038070 con 0x5616bbab2d60 2024-04-25T02:12:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.186+0000 7f07037fe640 1 -- 172.21.15.79:0/1531342960 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0714026040 con 0x5616bbab2d60 2024-04-25T02:12:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.186+0000 7f07037fe640 1 -- 172.21.15.79:0/1531342960 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0714033de0 con 0x5616bbab2d60 2024-04-25T02:12:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.186+0000 7f072bb93740 1 -- 172.21.15.79:0/1531342960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbab2d60 msgr2=0x5616bbab5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.186+0000 7f072bb93740 1 --2- 172.21.15.79:0/1531342960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbab2d60 0x5616bbab5a30 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0714022000 tx=0x7f0714016000 comp rx=0 tx=0).stop 2024-04-25T02:12:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.186+0000 7f072bb93740 1 -- 172.21.15.79:0/1531342960 shutdown_connections 2024-04-25T02:12:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.186+0000 7f072bb93740 1 --2- 172.21.15.79:0/1531342960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbad0600 0x5616bba86e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.186+0000 7f072bb93740 1 --2- 172.21.15.79:0/1531342960 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bbac4c20 0x5616bba86910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.186+0000 7f072bb93740 1 --2- 172.21.15.79:0/1531342960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbab2d60 0x5616bbab5a30 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.186+0000 7f072bb93740 1 -- 172.21.15.79:0/1531342960 >> 172.21.15.79:0/1531342960 conn(0x5616bba88a40 msgr2=0x5616bbaae390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.186+0000 7f072bb93740 1 -- 172.21.15.79:0/1531342960 shutdown_connections 2024-04-25T02:12:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.186+0000 7f072bb93740 1 -- 172.21.15.79:0/1531342960 wait complete. 2024-04-25T02:12:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.187+0000 7f072bb93740 1 -- start start 2024-04-25T02:12:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.187+0000 7f072bb93740 1 Processor -- start 2024-04-25T02:12:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f072bb93740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bbab2d60 0x5616bbaf1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f072bb93740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbac4c20 0x5616bba89220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f072bb93740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbad0600 0x5616bbac3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f072bb93740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0724158f10 con 0x5616bbac4c20 2024-04-25T02:12:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f072bb93740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5616bbab31e0 con 0x5616bbad0600 2024-04-25T02:12:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f072bb93740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5616bbacf190 con 0x5616bbab2d60 2024-04-25T02:12:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f072bb93740 10 client.0 _ll_register_callbacks cb 0x7f071c0076a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f0721d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbac4c20 0x5616bba89220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f0721d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbac4c20 0x5616bba89220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59098/0 (socket says 172.21.15.79:59098) 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f0721d9b640 1 -- 172.21.15.79:0/1844745785 learned_addr learned my addr 172.21.15.79:0/1844745785 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f072259c640 1 --2- 172.21.15.79:0/1844745785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bbab2d60 0x5616bbaf1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f0722d9d640 1 --2- 172.21.15.79:0/1844745785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbad0600 0x5616bbac3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f0721d9b640 1 -- 172.21.15.79:0/1844745785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bbab2d60 msgr2=0x5616bbaf1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f0721d9b640 1 --2- 172.21.15.79:0/1844745785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bbab2d60 0x5616bbaf1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f0721d9b640 1 -- 172.21.15.79:0/1844745785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbad0600 msgr2=0x5616bbac3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f0721d9b640 1 --2- 172.21.15.79:0/1844745785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbad0600 0x5616bbac3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f0721d9b640 1 -- 172.21.15.79:0/1844745785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616bbac3960 con 0x5616bbac4c20 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f072259c640 1 --2- 172.21.15.79:0/1844745785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bbab2d60 0x5616bbaf1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f0721d9b640 1 --2- 172.21.15.79:0/1844745785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbac4c20 0x5616bba89220 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f07180097a0 tx=0x7f0718004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e41b6469f45c8af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f07017fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f07017fa640 1 -- 172.21.15.79:0/1844745785 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718043070 con 0x5616bbac4c20 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f07017fa640 1 -- 172.21.15.79:0/1844745785 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7f0718003610 con 0x5616bbac4c20 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.188+0000 7f072bb93740 1 -- 172.21.15.79:0/1844745785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0714026040 con 0x5616bbac4c20 2024-04-25T02:12:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f07017fa640 1 -- 172.21.15.79:0/1844745785 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0718037040 con 0x5616bbac4c20 2024-04-25T02:12:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f072bb93740 10 client.7047 fetch_fsmap learned FSMap version 38 2024-04-25T02:12:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f072bb93740 1 -- 172.21.15.79:0/1844745785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x5616bbad1bf0 con 0x5616bbac4c20 2024-04-25T02:12:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f07017fa640 1 -- 172.21.15.79:0/1844745785 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0714026040 con 0x5616bbac4c20 2024-04-25T02:12:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f07017fa640 1 -- 172.21.15.79:0/1844745785 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 3494+0+0 (secure 0 0 0) 0x7f0718003810 con 0x5616bbac4c20 2024-04-25T02:12:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f072bb93740 10 client.7047 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T02:12:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f072bb93740 10 client.7047 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T02:12:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f072bb93740 20 client.7047 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f072bb93740 1 --2- 172.21.15.79:0/1844745785 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5616bbac6b50 0x5616bbb47350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f072bb93740 4 client.7047 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:12:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f072bb93740 1 -- 172.21.15.79:0/1844745785 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5616bbac7d60 con 0x5616bbac6b50 2024-04-25T02:12:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f072259c640 1 --2- 172.21.15.79:0/1844745785 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5616bbac6b50 0x5616bbb47350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f07017fa640 10 client.7047 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f072259c640 1 --2- 172.21.15.79:0/1844745785 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5616bbac6b50 0x5616bbb47350 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4565559cea48030 server_cookie=2088409fa074f146 in_seq=0 out_seq=0 2024-04-25T02:12:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f07017fa640 1 -- 172.21.15.79:0/1844745785 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5616bbac7d60 con 0x5616bbac6b50 2024-04-25T02:12:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f07017fa640 10 client.7047 handle_command_reply: tid=0 2024-04-25T02:12:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.189+0000 7f072bb93740 1 client.7047 shutdown 2024-04-25T02:12:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f072bb93740 1 -- 172.21.15.79:0/1844745785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbac4c20 msgr2=0x5616bba89220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f072bb93740 1 --2- 172.21.15.79:0/1844745785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbac4c20 0x5616bba89220 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f07180097a0 tx=0x7f0718004730 comp rx=0 tx=0).stop 2024-04-25T02:12:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f072bb93740 1 -- 172.21.15.79:0/1844745785 shutdown_connections 2024-04-25T02:12:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f072bb93740 1 --2- 172.21.15.79:0/1844745785 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5616bbac6b50 0x5616bbb47350 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f072bb93740 1 --2- 172.21.15.79:0/1844745785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616bbad0600 0x5616bbac3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f072bb93740 1 --2- 172.21.15.79:0/1844745785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616bbac4c20 0x5616bba89220 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f072bb93740 1 --2- 172.21.15.79:0/1844745785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5616bbab2d60 0x5616bbaf1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f07017fa640 0 client.7047 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f072bb93740 1 -- 172.21.15.79:0/1844745785 >> 172.21.15.79:0/1844745785 conn(0x5616bba88a40 msgr2=0x5616bba86910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f072bb93740 1 -- 172.21.15.79:0/1844745785 shutdown_connections 2024-04-25T02:12:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f072bb93740 1 -- 172.21.15.79:0/1844745785 wait complete. 2024-04-25T02:12:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f072bb93740 20 client.7047 trim_cache size 0 max 16384 2024-04-25T02:12:18.204 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:12:18.204 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T02:12:18.204 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-04-25T02:12:18.204 INFO:teuthology.orchestra.run.smithi079.stdout: "67180eb2-7af0-4aaf-a5bf-c088c0e55bb2": { 2024-04-25T02:12:18.204 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/subdir", 2024-04-25T02:12:18.204 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "67180eb2-7af0-4aaf-a5bf-c088c0e55bb2", 2024-04-25T02:12:18.204 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive" 2024-04-25T02:12:18.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:12:18.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:12:18.204 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:12:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f0728da2640 1 -- 172.21.15.79:0/4237724333 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f070406be30 msgr2=0x7f070406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f0728da2640 1 --2- 172.21.15.79:0/4237724333 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f070406be30 0x7f070406e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f07140074a0 tx=0x7f071400b040 comp rx=0 tx=0).stop 2024-04-25T02:12:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f0728da2640 1 -- 172.21.15.79:0/4237724333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07240cf7a0 msgr2=0x7f07240ae290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f0728da2640 1 --2- 172.21.15.79:0/4237724333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07240cf7a0 0x7f07240ae290 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f071c00c430 tx=0x7f071c00c8f0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f0728da2640 1 -- 172.21.15.79:0/4237724333 shutdown_connections 2024-04-25T02:12:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f0728da2640 1 --2- 172.21.15.79:0/4237724333 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f070406be30 0x7f070406e2f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f0728da2640 1 --2- 172.21.15.79:0/4237724333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07240cf7a0 0x7f07240ae290 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f0728da2640 1 --2- 172.21.15.79:0/4237724333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f072406e6b0 0x7f072415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f0728da2640 1 --2- 172.21.15.79:0/4237724333 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f072406b2f0 0x7f07240cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f0728da2640 1 -- 172.21.15.79:0/4237724333 >> 172.21.15.79:0/4237724333 conn(0x7f07240b1cd0 msgr2=0x7f072406b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f0728da2640 1 -- 172.21.15.79:0/4237724333 shutdown_connections 2024-04-25T02:12:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:18.190+0000 7f0728da2640 1 -- 172.21.15.79:0/4237724333 wait complete. 2024-04-25T02:12:18.208 INFO:tasks.cephfs.filesystem:scrub status for tag:67180eb2-7af0-4aaf-a5bf-c088c0e55bb2 - {'path': '/subdir', 'tag': '67180eb2-7af0-4aaf-a5bf-c088c0e55bb2', 'options': 'recursive'} 2024-04-25T02:12:20.767 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:12:20.761+0000 7fb0c78c8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T02:12:30.367 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:12:30.370 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:12:48.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:48.209 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T02:12:48.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.315+0000 7f466d3b6640 1 Processor -- start 2024-04-25T02:12:48.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.315+0000 7f466d3b6640 1 -- start start 2024-04-25T02:12:48.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.316+0000 7f466d3b6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46680b3440 0x7f46680d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.316+0000 7f466d3b6640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f466806d2e0 0x7f466815dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.316+0000 7f466d3b6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46680b4f10 con 0x7f46680d10b0 2024-04-25T02:12:48.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.316+0000 7f466d3b6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f46680b4cc0 con 0x7f46680b3440 2024-04-25T02:12:48.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.316+0000 7f466d3b6640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f46680b51f0 con 0x7f466806d2e0 2024-04-25T02:12:48.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.316+0000 7f4666ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46680b3440 0x7f46680d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.316+0000 7f4666ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46680b3440 0x7f46680d0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46544/0 (socket says 172.21.15.79:46544) 2024-04-25T02:12:48.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.316+0000 7f4666ffd640 1 -- 172.21.15.79:0/1103449707 learned_addr learned my addr 172.21.15.79:0/1103449707 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:48.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.316+0000 7f4666ffd640 1 -- 172.21.15.79:0/1103449707 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f466806d2e0 msgr2=0x7f466815dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.316+0000 7f4666ffd640 1 --2- 172.21.15.79:0/1103449707 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f466806d2e0 0x7f466815dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.316+0000 7f4666ffd640 1 -- 172.21.15.79:0/1103449707 >> v1:172.21.15.189:6789/0 conn(0x7f46680d10b0 legacy=0x7f466806cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.316+0000 7f4666ffd640 1 -- 172.21.15.79:0/1103449707 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46680b54d0 con 0x7f46680b3440 2024-04-25T02:12:48.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.317+0000 7f4666ffd640 1 --2- 172.21.15.79:0/1103449707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680b3440 0x7f46680d0b70 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f4658009e50 tx=0x7f465802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d40a69fe9f56017 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.317+0000 7f4665ffb640 1 -- 172.21.15.79:0/1103449707 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4658036070 con 0x7f46680b3440 2024-04-25T02:12:48.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.317+0000 7f4665ffb640 1 -- 172.21.15.79:0/1103449707 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4658031600 con 0x7f46680b3440 2024-04-25T02:12:48.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.317+0000 7f4665ffb640 1 -- 172.21.15.79:0/1103449707 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580319d0 con 0x7f46680b3440 2024-04-25T02:12:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.318+0000 7f466d3b6640 1 -- 172.21.15.79:0/1103449707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680b3440 msgr2=0x7f46680d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.318+0000 7f466d3b6640 1 --2- 172.21.15.79:0/1103449707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680b3440 0x7f46680d0b70 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f4658009e50 tx=0x7f465802a6c0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.318+0000 7f466d3b6640 1 -- 172.21.15.79:0/1103449707 shutdown_connections 2024-04-25T02:12:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.318+0000 7f466d3b6640 1 --2- 172.21.15.79:0/1103449707 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f466806d2e0 0x7f466815dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.318+0000 7f466d3b6640 1 --2- 172.21.15.79:0/1103449707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680b3440 0x7f46680d0b70 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.318+0000 7f466d3b6640 1 -- 172.21.15.79:0/1103449707 >> 172.21.15.79:0/1103449707 conn(0x7f46680d1e70 msgr2=0x7f46680d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.318+0000 7f466d3b6640 1 -- 172.21.15.79:0/1103449707 shutdown_connections 2024-04-25T02:12:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.318+0000 7f466d3b6640 1 -- 172.21.15.79:0/1103449707 wait complete. 2024-04-25T02:12:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.319+0000 7f466d3b6640 1 Processor -- start 2024-04-25T02:12:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.319+0000 7f466d3b6640 1 -- start start 2024-04-25T02:12:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f466d3b6640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f466806d2e0 0x7f46681574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f466d3b6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46680b3440 0x7f466815f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f466d3b6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680d10b0 0x7f466815fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f466d3b6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f466815e020 con 0x7f46680d10b0 2024-04-25T02:12:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f466d3b6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f466806c600 con 0x7f46680b3440 2024-04-25T02:12:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f466d3b6640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f466815e1a0 con 0x7f466806d2e0 2024-04-25T02:12:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f46677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680d10b0 0x7f466815fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f46677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680d10b0 0x7f466815fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46560/0 (socket says 172.21.15.79:46560) 2024-04-25T02:12:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f46677fe640 1 -- 172.21.15.79:0/1777465323 learned_addr learned my addr 172.21.15.79:0/1777465323 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f4666ffd640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f466806d2e0 0x7f46681574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f46667fc640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46680b3440 0x7f466815f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f46677fe640 1 -- 172.21.15.79:0/1777465323 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f466806d2e0 msgr2=0x7f46681574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f46677fe640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f466806d2e0 0x7f46681574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f46677fe640 1 -- 172.21.15.79:0/1777465323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46680b3440 msgr2=0x7f466815f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f46677fe640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46680b3440 0x7f466815f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f46677fe640 1 -- 172.21.15.79:0/1777465323 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46680c92b0 con 0x7f46680d10b0 2024-04-25T02:12:48.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.320+0000 7f4666ffd640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f466806d2e0 0x7f46681574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:48.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.321+0000 7f46667fc640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46680b3440 0x7f466815f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:48.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.321+0000 7f46677fe640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680d10b0 0x7f466815fc50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f466000b3f0 tx=0x7f466000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.321+0000 7f464f7fe640 1 -- 172.21.15.79:0/1777465323 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660015020 con 0x7f46680d10b0 2024-04-25T02:12:48.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.321+0000 7f464f7fe640 1 -- 172.21.15.79:0/1777465323 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4660011850 con 0x7f46680d10b0 2024-04-25T02:12:48.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.321+0000 7f466d3b6640 1 -- 172.21.15.79:0/1777465323 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46680c9590 con 0x7f46680d10b0 2024-04-25T02:12:48.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.321+0000 7f464f7fe640 1 -- 172.21.15.79:0/1777465323 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660011c40 con 0x7f46680d10b0 2024-04-25T02:12:48.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.321+0000 7f466d3b6640 1 -- 172.21.15.79:0/1777465323 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46680c9b50 con 0x7f46680d10b0 2024-04-25T02:12:48.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.322+0000 7f464f7fe640 1 -- 172.21.15.79:0/1777465323 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4660018020 con 0x7f46680d10b0 2024-04-25T02:12:48.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.323+0000 7f464f7fe640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f465406be30 0x7f465406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.323+0000 7f4666ffd640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f465406be30 0x7f465406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.323+0000 7f464f7fe640 1 -- 172.21.15.79:0/1777465323 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f466008afd0 con 0x7f46680d10b0 2024-04-25T02:12:48.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.323+0000 7f4666ffd640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f465406be30 0x7f465406e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4658033000 tx=0x7f4658009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.324+0000 7f467019b740 1 Processor -- start 2024-04-25T02:12:48.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.324+0000 7f467019b740 1 -- start start 2024-04-25T02:12:48.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f467019b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a725d60 0x563b1a726140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f467019b740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a743600 0x563b1a743b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f467019b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a6fba40 0x563b1a741cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f467019b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563b1a65f6b0 con 0x563b1a6fba40 2024-04-25T02:12:48.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f467019b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563b1a607880 con 0x563b1a725d60 2024-04-25T02:12:48.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f467019b740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x563b1a65b670 con 0x563b1a743600 2024-04-25T02:12:48.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f46677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a6fba40 0x563b1a741cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f46677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a6fba40 0x563b1a741cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46574/0 (socket says 172.21.15.79:46574) 2024-04-25T02:12:48.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f46677fe640 1 -- 172.21.15.79:0/3456392834 learned_addr learned my addr 172.21.15.79:0/3456392834 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:48.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f4666ffd640 1 --2- 172.21.15.79:0/3456392834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a725d60 0x563b1a726140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f46677fe640 1 -- 172.21.15.79:0/3456392834 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a743600 msgr2=0x563b1a743b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f46667fc640 1 --2- 172.21.15.79:0/3456392834 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a743600 0x563b1a743b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f46677fe640 1 --2- 172.21.15.79:0/3456392834 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a743600 0x563b1a743b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f46677fe640 1 -- 172.21.15.79:0/3456392834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a725d60 msgr2=0x563b1a726140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f46677fe640 1 --2- 172.21.15.79:0/3456392834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a725d60 0x563b1a726140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f46677fe640 1 -- 172.21.15.79:0/3456392834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b1a43d7d0 con 0x563b1a6fba40 2024-04-25T02:12:48.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f46667fc640 1 --2- 172.21.15.79:0/3456392834 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a743600 0x563b1a743b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:48.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f4666ffd640 1 --2- 172.21.15.79:0/3456392834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a725d60 0x563b1a726140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:48.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.325+0000 7f46677fe640 1 --2- 172.21.15.79:0/3456392834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a6fba40 0x563b1a741cc0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f4660058dd0 tx=0x7f4660059210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5176ce9359bc98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.326+0000 7f464cff9640 1 -- 172.21.15.79:0/3456392834 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660057170 con 0x563b1a6fba40 2024-04-25T02:12:48.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.326+0000 7f464cff9640 1 -- 172.21.15.79:0/3456392834 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46600573d0 con 0x563b1a6fba40 2024-04-25T02:12:48.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.326+0000 7f464cff9640 1 -- 172.21.15.79:0/3456392834 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660055740 con 0x563b1a6fba40 2024-04-25T02:12:48.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.326+0000 7f467019b740 1 -- 172.21.15.79:0/3456392834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a6fba40 msgr2=0x563b1a741cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.326+0000 7f467019b740 1 --2- 172.21.15.79:0/3456392834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a6fba40 0x563b1a741cc0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f4660058dd0 tx=0x7f4660059210 comp rx=0 tx=0).stop 2024-04-25T02:12:48.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.326+0000 7f467019b740 1 -- 172.21.15.79:0/3456392834 shutdown_connections 2024-04-25T02:12:48.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.326+0000 7f467019b740 1 --2- 172.21.15.79:0/3456392834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a6fba40 0x563b1a741cc0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.326+0000 7f467019b740 1 --2- 172.21.15.79:0/3456392834 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a743600 0x563b1a743b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.326+0000 7f467019b740 1 --2- 172.21.15.79:0/3456392834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a725d60 0x563b1a726140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.326+0000 7f467019b740 1 -- 172.21.15.79:0/3456392834 >> 172.21.15.79:0/3456392834 conn(0x563b1a6f8600 msgr2=0x563b1a740b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.326+0000 7f467019b740 1 -- 172.21.15.79:0/3456392834 shutdown_connections 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.326+0000 7f467019b740 1 -- 172.21.15.79:0/3456392834 wait complete. 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.327+0000 7f467019b740 1 -- start start 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.327+0000 7f467019b740 1 Processor -- start 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f467019b740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a725d60 0x563b1a73a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f467019b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a743600 0x563b1a722790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f467019b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a751300 0x563b1a6f5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f467019b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563b1a6fc7e0 con 0x563b1a743600 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f467019b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563b1a61af50 con 0x563b1a751300 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f467019b740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x563b1a6f6530 con 0x563b1a725d60 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f467019b740 10 client.0 _ll_register_callbacks cb 0x563b1a656000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f46667fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a743600 0x563b1a722790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f46667fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a743600 0x563b1a722790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46576/0 (socket says 172.21.15.79:46576) 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f46667fc640 1 -- 172.21.15.79:0/1932542303 learned_addr learned my addr 172.21.15.79:0/1932542303 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:48.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f4666ffd640 1 --2- 172.21.15.79:0/1932542303 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a725d60 0x563b1a73a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f46677fe640 1 --2- 172.21.15.79:0/1932542303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a751300 0x563b1a6f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f46667fc640 1 -- 172.21.15.79:0/1932542303 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a725d60 msgr2=0x563b1a73a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f46667fc640 1 --2- 172.21.15.79:0/1932542303 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a725d60 0x563b1a73a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f46667fc640 1 -- 172.21.15.79:0/1932542303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a751300 msgr2=0x563b1a6f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f46667fc640 1 --2- 172.21.15.79:0/1932542303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a751300 0x563b1a6f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f46667fc640 1 -- 172.21.15.79:0/1932542303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b1a3733f0 con 0x563b1a743600 2024-04-25T02:12:48.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f46667fc640 1 --2- 172.21.15.79:0/1932542303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a743600 0x563b1a722790 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f465c00bfc0 tx=0x7f465c00d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1862f845b49169 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f4645ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:48.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.328+0000 7f4645ffb640 1 -- 172.21.15.79:0/1932542303 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c016070 con 0x563b1a743600 2024-04-25T02:12:48.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f4645ffb640 1 -- 172.21.15.79:0/1932542303 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f465c012870 con 0x563b1a743600 2024-04-25T02:12:48.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f467019b740 1 -- 172.21.15.79:0/1932542303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46600573d0 con 0x563b1a743600 2024-04-25T02:12:48.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f4645ffb640 1 -- 172.21.15.79:0/1932542303 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f465c021050 con 0x563b1a743600 2024-04-25T02:12:48.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f467019b740 10 client.7059 fetch_fsmap learned FSMap version 39 2024-04-25T02:12:48.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f467019b740 1 -- 172.21.15.79:0/1932542303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x563b1a3330f0 con 0x563b1a743600 2024-04-25T02:12:48.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f4645ffb640 1 -- 172.21.15.79:0/1932542303 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46600573d0 con 0x563b1a743600 2024-04-25T02:12:48.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f4645ffb640 1 -- 172.21.15.79:0/1932542303 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f465c024020 con 0x563b1a743600 2024-04-25T02:12:48.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f467019b740 10 client.7059 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T02:12:48.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f467019b740 10 client.7059 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T02:12:48.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f467019b740 20 client.7059 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:48.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f467019b740 1 --2- 172.21.15.79:0/1932542303 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x563b1a738450 0x563b1a738880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f467019b740 4 client.7059 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:48.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f467019b740 1 -- 172.21.15.79:0/1932542303 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b1a66cbf0 con 0x563b1a738450 2024-04-25T02:12:48.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f4666ffd640 1 --2- 172.21.15.79:0/1932542303 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x563b1a738450 0x563b1a738880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f4666ffd640 1 --2- 172.21.15.79:0/1932542303 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x563b1a738450 0x563b1a738880 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43ef6f09a9094187 server_cookie=5a3afd3cc4a4cdc9 in_seq=0 out_seq=0 2024-04-25T02:12:48.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.329+0000 7f4645ffb640 10 client.7059 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:48.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.330+0000 7f4645ffb640 1 -- 172.21.15.79:0/1932542303 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563b1a66cbf0 con 0x563b1a738450 2024-04-25T02:12:48.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.330+0000 7f4645ffb640 10 client.7059 handle_command_reply: tid=0 2024-04-25T02:12:48.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.330+0000 7f467019b740 1 client.7059 shutdown 2024-04-25T02:12:48.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.330+0000 7f467019b740 1 -- 172.21.15.79:0/1932542303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a743600 msgr2=0x563b1a722790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.330+0000 7f467019b740 1 --2- 172.21.15.79:0/1932542303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a743600 0x563b1a722790 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f465c00bfc0 tx=0x7f465c00d650 comp rx=0 tx=0).stop 2024-04-25T02:12:48.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.330+0000 7f467019b740 1 -- 172.21.15.79:0/1932542303 shutdown_connections 2024-04-25T02:12:48.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.330+0000 7f467019b740 1 --2- 172.21.15.79:0/1932542303 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x563b1a738450 0x563b1a738880 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.330+0000 7f467019b740 1 --2- 172.21.15.79:0/1932542303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a751300 0x563b1a6f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.330+0000 7f4645ffb640 0 client.7059 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:48.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.330+0000 7f467019b740 1 --2- 172.21.15.79:0/1932542303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a743600 0x563b1a722790 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.330+0000 7f467019b740 1 --2- 172.21.15.79:0/1932542303 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a725d60 0x563b1a73a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.330+0000 7f467019b740 1 -- 172.21.15.79:0/1932542303 >> 172.21.15.79:0/1932542303 conn(0x563b1a6fba40 msgr2=0x563b1a7440f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.330+0000 7f467019b740 1 -- 172.21.15.79:0/1932542303 shutdown_connections 2024-04-25T02:12:48.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.330+0000 7f467019b740 1 -- 172.21.15.79:0/1932542303 wait complete. 2024-04-25T02:12:48.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.330+0000 7f467019b740 20 client.7059 trim_cache size 0 max 16384 2024-04-25T02:12:48.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.348+0000 7f467019b740 1 Processor -- start 2024-04-25T02:12:48.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.348+0000 7f467019b740 1 -- start start 2024-04-25T02:12:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.348+0000 7f467019b740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a725d60 0x563b1a721a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.348+0000 7f467019b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a743600 0x563b1a739650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.348+0000 7f467019b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a751300 0x563b1a6fce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.348+0000 7f467019b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4668200b30 con 0x563b1a751300 2024-04-25T02:12:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.348+0000 7f467019b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f46681ffb70 con 0x563b1a743600 2024-04-25T02:12:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.348+0000 7f467019b740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f46680cac40 con 0x563b1a725d60 2024-04-25T02:12:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.348+0000 7f46677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a751300 0x563b1a6fce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.348+0000 7f46677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a751300 0x563b1a6fce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46586/0 (socket says 172.21.15.79:46586) 2024-04-25T02:12:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.348+0000 7f46677fe640 1 -- 172.21.15.79:0/3205591677 learned_addr learned my addr 172.21.15.79:0/3205591677 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f46677fe640 1 -- 172.21.15.79:0/3205591677 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a725d60 msgr2=0x563b1a721a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f46677fe640 1 --2- 172.21.15.79:0/3205591677 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a725d60 0x563b1a721a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f46677fe640 1 -- 172.21.15.79:0/3205591677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a743600 msgr2=0x563b1a739650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f46677fe640 1 --2- 172.21.15.79:0/3205591677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a743600 0x563b1a739650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f46677fe640 1 -- 172.21.15.79:0/3205591677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b1a765380 con 0x563b1a751300 2024-04-25T02:12:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f46677fe640 1 --2- 172.21.15.79:0/3205591677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a751300 0x563b1a6fce10 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f4660059930 tx=0x7f466001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bda5e8d4b821ba0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f4647fff640 1 -- 172.21.15.79:0/3205591677 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660087070 con 0x563b1a751300 2024-04-25T02:12:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f4647fff640 1 -- 172.21.15.79:0/3205591677 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4660057170 con 0x563b1a751300 2024-04-25T02:12:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f4647fff640 1 -- 172.21.15.79:0/3205591677 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466005d170 con 0x563b1a751300 2024-04-25T02:12:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f467019b740 1 -- 172.21.15.79:0/3205591677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a751300 msgr2=0x563b1a6fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f467019b740 1 --2- 172.21.15.79:0/3205591677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a751300 0x563b1a6fce10 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f4660059930 tx=0x7f466001c000 comp rx=0 tx=0).stop 2024-04-25T02:12:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f467019b740 1 -- 172.21.15.79:0/3205591677 shutdown_connections 2024-04-25T02:12:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f467019b740 1 --2- 172.21.15.79:0/3205591677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a751300 0x563b1a6fce10 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f467019b740 1 --2- 172.21.15.79:0/3205591677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a743600 0x563b1a739650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f467019b740 1 --2- 172.21.15.79:0/3205591677 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a725d60 0x563b1a721a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.349+0000 7f467019b740 1 -- 172.21.15.79:0/3205591677 >> 172.21.15.79:0/3205591677 conn(0x563b1a6fba40 msgr2=0x563b1a728d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.350+0000 7f467019b740 1 -- 172.21.15.79:0/3205591677 shutdown_connections 2024-04-25T02:12:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.350+0000 7f467019b740 1 -- 172.21.15.79:0/3205591677 wait complete. 2024-04-25T02:12:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.350+0000 7f467019b740 1 -- start start 2024-04-25T02:12:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.350+0000 7f467019b740 1 Processor -- start 2024-04-25T02:12:48.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f467019b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a725d60 0x563b1a73e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f467019b740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a743600 0x563b1a73e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f467019b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a751300 0x563b1a7536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f467019b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563b1a7650b0 con 0x563b1a725d60 2024-04-25T02:12:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f467019b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f46680cb290 con 0x563b1a751300 2024-04-25T02:12:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f467019b740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x563b1a6fd350 con 0x563b1a743600 2024-04-25T02:12:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f467019b740 10 client.0 _ll_register_callbacks cb 0x7f465c006ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f4666ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a725d60 0x563b1a73e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f4666ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a725d60 0x563b1a73e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46588/0 (socket says 172.21.15.79:46588) 2024-04-25T02:12:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f4666ffd640 1 -- 172.21.15.79:0/1360486347 learned_addr learned my addr 172.21.15.79:0/1360486347 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f46677fe640 1 --2- 172.21.15.79:0/1360486347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a751300 0x563b1a7536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f4666ffd640 1 -- 172.21.15.79:0/1360486347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a743600 msgr2=0x563b1a73e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f46667fc640 1 --2- 172.21.15.79:0/1360486347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a743600 0x563b1a73e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f4666ffd640 1 --2- 172.21.15.79:0/1360486347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a743600 0x563b1a73e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f4666ffd640 1 -- 172.21.15.79:0/1360486347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a751300 msgr2=0x563b1a7536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f4666ffd640 1 --2- 172.21.15.79:0/1360486347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a751300 0x563b1a7536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f4666ffd640 1 -- 172.21.15.79:0/1360486347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b1a743d00 con 0x563b1a725d60 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f46677fe640 1 --2- 172.21.15.79:0/1360486347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a751300 0x563b1a7536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f4666ffd640 1 --2- 172.21.15.79:0/1360486347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a725d60 0x563b1a73e200 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f465800c090 tx=0x7f4658004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c38f989f053fba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f4645ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f4645ffb640 1 -- 172.21.15.79:0/1360486347 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4658053060 con 0x563b1a725d60 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f4645ffb640 1 -- 172.21.15.79:0/1360486347 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f465803c890 con 0x563b1a725d60 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.351+0000 7f467019b740 1 -- 172.21.15.79:0/1360486347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4660057170 con 0x563b1a725d60 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f4645ffb640 1 -- 172.21.15.79:0/1360486347 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4658059050 con 0x563b1a725d60 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f467019b740 10 client.7065 fetch_fsmap learned FSMap version 39 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f467019b740 1 -- 172.21.15.79:0/1360486347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x563b1a73eda0 con 0x563b1a725d60 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f4645ffb640 1 -- 172.21.15.79:0/1360486347 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4660057170 con 0x563b1a725d60 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f4645ffb640 1 -- 172.21.15.79:0/1360486347 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f465805c020 con 0x563b1a725d60 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f467019b740 10 client.7065 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f467019b740 10 client.7065 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f467019b740 20 client.7065 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f467019b740 1 --2- 172.21.15.79:0/1360486347 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x563b1a7ba850 0x563b1a753c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f467019b740 4 client.7065 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:12:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f467019b740 1 -- 172.21.15.79:0/1360486347 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563b1a666f40 con 0x563b1a7ba850 2024-04-25T02:12:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f46667fc640 1 --2- 172.21.15.79:0/1360486347 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x563b1a7ba850 0x563b1a753c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f4645ffb640 10 client.7065 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f46667fc640 1 --2- 172.21.15.79:0/1360486347 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x563b1a7ba850 0x563b1a753c30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=604a626de5e0272a server_cookie=621e0575b97a615a in_seq=0 out_seq=0 2024-04-25T02:12:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f4645ffb640 1 -- 172.21.15.79:0/1360486347 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563b1a666f40 con 0x563b1a7ba850 2024-04-25T02:12:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f4645ffb640 10 client.7065 handle_command_reply: tid=0 2024-04-25T02:12:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f467019b740 1 client.7065 shutdown 2024-04-25T02:12:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f467019b740 1 -- 172.21.15.79:0/1360486347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a725d60 msgr2=0x563b1a73e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.352+0000 7f467019b740 1 --2- 172.21.15.79:0/1360486347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a725d60 0x563b1a73e200 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f465800c090 tx=0x7f4658004a40 comp rx=0 tx=0).stop 2024-04-25T02:12:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f467019b740 1 -- 172.21.15.79:0/1360486347 shutdown_connections 2024-04-25T02:12:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f467019b740 1 --2- 172.21.15.79:0/1360486347 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x563b1a7ba850 0x563b1a753c30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f467019b740 1 --2- 172.21.15.79:0/1360486347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b1a751300 0x563b1a7536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f467019b740 1 --2- 172.21.15.79:0/1360486347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563b1a743600 0x563b1a73e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f467019b740 1 --2- 172.21.15.79:0/1360486347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b1a725d60 0x563b1a73e200 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f4645ffb640 0 client.7065 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:48.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f467019b740 1 -- 172.21.15.79:0/1360486347 >> 172.21.15.79:0/1360486347 conn(0x563b1a6fba40 msgr2=0x563b1a7392e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f467019b740 1 -- 172.21.15.79:0/1360486347 shutdown_connections 2024-04-25T02:12:48.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f467019b740 1 -- 172.21.15.79:0/1360486347 wait complete. 2024-04-25T02:12:48.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f467019b740 20 client.7065 trim_cache size 0 max 16384 2024-04-25T02:12:48.366 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:12:48.366 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-04-25T02:12:48.366 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-04-25T02:12:48.366 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:12:48.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f466d3b6640 1 -- 172.21.15.79:0/1777465323 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f465406be30 msgr2=0x7f465406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f466d3b6640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f465406be30 0x7f465406e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4658033000 tx=0x7f4658009000 comp rx=0 tx=0).stop 2024-04-25T02:12:48.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f466d3b6640 1 -- 172.21.15.79:0/1777465323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680d10b0 msgr2=0x7f466815fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f466d3b6640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680d10b0 0x7f466815fc50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f466000b3f0 tx=0x7f466000b8b0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f466d3b6640 1 -- 172.21.15.79:0/1777465323 shutdown_connections 2024-04-25T02:12:48.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f466d3b6640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f465406be30 0x7f465406e2f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f466d3b6640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680d10b0 0x7f466815fc50 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f466d3b6640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46680b3440 0x7f466815f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f466d3b6640 1 --2- 172.21.15.79:0/1777465323 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f466806d2e0 0x7f46681574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f466d3b6640 1 -- 172.21.15.79:0/1777465323 >> 172.21.15.79:0/1777465323 conn(0x7f46680d1e70 msgr2=0x7f466806f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f466d3b6640 1 -- 172.21.15.79:0/1777465323 shutdown_connections 2024-04-25T02:12:48.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.353+0000 7f466d3b6640 1 -- 172.21.15.79:0/1777465323 wait complete. 2024-04-25T02:12:48.371 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T02:12:48.371 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:12:48.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.461+0000 7f78c7ba2640 1 Processor -- start 2024-04-25T02:12:48.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.461+0000 7f78c7ba2640 1 -- start start 2024-04-25T02:12:48.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.462+0000 7f78c7ba2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78c006e3b0 0x7f78c00b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.462+0000 7f78c7ba2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78c0071e00 con 0x7f78c0143bc0 2024-04-25T02:12:48.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.462+0000 7f78c7ba2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78c00720a0 con 0x7f78c006df50 2024-04-25T02:12:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.462+0000 7f78c7ba2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f78c0072cb0 con 0x7f78c006e3b0 2024-04-25T02:12:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.462+0000 7f78c593e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f78c0143bc0 0x7f78c015f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36862/0 (socket says 172.21.15.79:36862) 2024-04-25T02:12:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.462+0000 7f78c593e640 1 -- 172.21.15.79:0/4022021232 learned_addr learned my addr 172.21.15.79:0/4022021232 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.462+0000 7f78c493c640 1 -- 172.21.15.79:0/4022021232 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3429719968 0 0) 0x7f78c0071e00 con 0x7f78c0143bc0 2024-04-25T02:12:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.462+0000 7f78c493c640 1 -- 172.21.15.79:0/4022021232 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78ac003520 con 0x7f78c0143bc0 2024-04-25T02:12:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.462+0000 7f78c613f640 1 --2- 172.21.15.79:0/4022021232 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78c006e3b0 0x7f78c00b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c493c640 1 -- 172.21.15.79:0/4022021232 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 249128702 0 0) 0x7f78ac003520 con 0x7f78c0143bc0 2024-04-25T02:12:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c493c640 1 -- 172.21.15.79:0/4022021232 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78c006e3b0 msgr2=0x7f78c00b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c493c640 1 --2- 172.21.15.79:0/4022021232 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78c006e3b0 0x7f78c00b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c493c640 1 -- 172.21.15.79:0/4022021232 >> v1:172.21.15.189:6789/0 conn(0x7f78c006df50 legacy=0x7f78c00b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c493c640 1 -- 172.21.15.79:0/4022021232 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c0072380 con 0x7f78c0143bc0 2024-04-25T02:12:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c493c640 1 -- 172.21.15.79:0/4022021232 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f78bc0019f0 con 0x7f78c0143bc0 2024-04-25T02:12:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c493c640 1 -- 172.21.15.79:0/4022021232 >> v1:172.21.15.79:6789/0 conn(0x7f78c0143bc0 legacy=0x7f78c015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c493c640 1 --2- 172.21.15.79:0/4022021232 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78c006e3b0 0x7f78ac0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c493c640 1 --2- 172.21.15.79:0/4022021232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78ac003f60 0x7f78ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c493c640 1 --2- 172.21.15.79:0/4022021232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78ac004d40 0x7f78ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c493c640 1 -- 172.21.15.79:0/4022021232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78c0072cb0 con 0x7f78ac004d40 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c493c640 1 -- 172.21.15.79:0/4022021232 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac00bb50 con 0x7f78ac003f60 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c493c640 1 -- 172.21.15.79:0/4022021232 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f78ac00bd50 con 0x7f78c006e3b0 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c613f640 1 --2- 172.21.15.79:0/4022021232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78ac004d40 0x7f78ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c513d640 1 --2- 172.21.15.79:0/4022021232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78ac003f60 0x7f78ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c593e640 1 --2- 172.21.15.79:0/4022021232 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78c006e3b0 0x7f78ac0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c613f640 1 -- 172.21.15.79:0/4022021232 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78c006e3b0 msgr2=0x7f78ac0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c613f640 1 --2- 172.21.15.79:0/4022021232 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78c006e3b0 0x7f78ac0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c613f640 1 -- 172.21.15.79:0/4022021232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78ac003f60 msgr2=0x7f78ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c613f640 1 --2- 172.21.15.79:0/4022021232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78ac003f60 0x7f78ac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.463+0000 7f78c613f640 1 -- 172.21.15.79:0/4022021232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac003520 con 0x7f78ac004d40 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.464+0000 7f78c613f640 1 --2- 172.21.15.79:0/4022021232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78ac004d40 0x7f78ac0051c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009ac0 tx=0x7f78ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfe4a73419b61c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.464+0000 7f78c493c640 1 -- 172.21.15.79:0/4022021232 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8036070 con 0x7f78ac004d40 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.464+0000 7f78c493c640 1 -- 172.21.15.79:0/4022021232 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b8031400 con 0x7f78ac004d40 2024-04-25T02:12:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.464+0000 7f78c493c640 1 -- 172.21.15.79:0/4022021232 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8009690 con 0x7f78ac004d40 2024-04-25T02:12:48.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.464+0000 7f78c7ba2640 1 -- 172.21.15.79:0/4022021232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78ac004d40 msgr2=0x7f78ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.464+0000 7f78c7ba2640 1 --2- 172.21.15.79:0/4022021232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78ac004d40 0x7f78ac0051c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009ac0 tx=0x7f78ac005830 comp rx=0 tx=0).stop 2024-04-25T02:12:48.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.464+0000 7f78c613f640 1 -- 172.21.15.79:0/4022021232 reap_dead start 2024-04-25T02:12:48.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.464+0000 7f78c7ba2640 1 -- 172.21.15.79:0/4022021232 shutdown_connections 2024-04-25T02:12:48.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.464+0000 7f78c7ba2640 1 -- 172.21.15.79:0/4022021232 >> 172.21.15.79:0/4022021232 conn(0x7f78c00cfc80 msgr2=0x7f78c00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.465+0000 7f78c7ba2640 1 -- 172.21.15.79:0/4022021232 shutdown_connections 2024-04-25T02:12:48.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.465+0000 7f78c7ba2640 1 -- 172.21.15.79:0/4022021232 wait complete. 2024-04-25T02:12:48.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.466+0000 7f78c7ba2640 1 Processor -- start 2024-04-25T02:12:48.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.466+0000 7f78c7ba2640 1 -- start start 2024-04-25T02:12:48.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.466+0000 7f78c7ba2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78ac004d40 0x7f78c00aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.466+0000 7f78c7ba2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78c01f7d20 0x7f78c015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.466+0000 7f78c7ba2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c015a820 0x7f78c01592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.466+0000 7f78c7ba2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78c006e840 con 0x7f78c015a820 2024-04-25T02:12:48.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.466+0000 7f78c7ba2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f78c0072940 con 0x7f78ac004d40 2024-04-25T02:12:48.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.466+0000 7f78c7ba2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f78c0143fa0 con 0x7f78c01f7d20 2024-04-25T02:12:48.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78c613f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c015a820 0x7f78c01592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78c613f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c015a820 0x7f78c01592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46606/0 (socket says 172.21.15.79:46606) 2024-04-25T02:12:48.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78c613f640 1 -- 172.21.15.79:0/1173695708 learned_addr learned my addr 172.21.15.79:0/1173695708 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:48.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78c513d640 1 --2- 172.21.15.79:0/1173695708 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78c01f7d20 0x7f78c015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78c593e640 1 --2- 172.21.15.79:0/1173695708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78ac004d40 0x7f78c00aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78c613f640 1 -- 172.21.15.79:0/1173695708 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78c01f7d20 msgr2=0x7f78c015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78c613f640 1 --2- 172.21.15.79:0/1173695708 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78c01f7d20 0x7f78c015a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78c613f640 1 -- 172.21.15.79:0/1173695708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78ac004d40 msgr2=0x7f78c00aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78c613f640 1 --2- 172.21.15.79:0/1173695708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78ac004d40 0x7f78c00aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78c613f640 1 -- 172.21.15.79:0/1173695708 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c0135800 con 0x7f78c015a820 2024-04-25T02:12:48.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78c593e640 1 --2- 172.21.15.79:0/1173695708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78ac004d40 0x7f78c00aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:48.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78c613f640 1 --2- 172.21.15.79:0/1173695708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c015a820 0x7f78c01592a0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009be0 tx=0x7f78b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78b67fc640 1 -- 172.21.15.79:0/1173695708 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8036040 con 0x7f78c015a820 2024-04-25T02:12:48.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78b67fc640 1 -- 172.21.15.79:0/1173695708 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b8041070 con 0x7f78c015a820 2024-04-25T02:12:48.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78c7ba2640 1 -- 172.21.15.79:0/1173695708 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c0135ae0 con 0x7f78c015a820 2024-04-25T02:12:48.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78b67fc640 1 -- 172.21.15.79:0/1173695708 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8009690 con 0x7f78c015a820 2024-04-25T02:12:48.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.467+0000 7f78c7ba2640 1 -- 172.21.15.79:0/1173695708 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c01360a0 con 0x7f78c015a820 2024-04-25T02:12:48.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.468+0000 7f78c7ba2640 1 -- 172.21.15.79:0/1173695708 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c00ceec0 con 0x7f78c015a820 2024-04-25T02:12:48.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.469+0000 7f78b67fc640 1 -- 172.21.15.79:0/1173695708 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78b8039070 con 0x7f78c015a820 2024-04-25T02:12:48.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.469+0000 7f78b67fc640 1 --2- 172.21.15.79:0/1173695708 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f78a406be30 0x7f78a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.469+0000 7f78b67fc640 1 -- 172.21.15.79:0/1173695708 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f78b80aa7b0 con 0x7f78c015a820 2024-04-25T02:12:48.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.469+0000 7f78c593e640 1 --2- 172.21.15.79:0/1173695708 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f78a406be30 0x7f78a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.469+0000 7f78c593e640 1 --2- 172.21.15.79:0/1173695708 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f78a406be30 0x7f78a406e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f78bc001b60 tx=0x7f78bc006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.473+0000 7f78b67fc640 1 -- 172.21.15.79:0/1173695708 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f78c00ceec0 con 0x7f78c015a820 2024-04-25T02:12:48.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.684+0000 7f78c7ba2640 1 -- 172.21.15.79:0/1173695708 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78c00690a0 con 0x7f78c015a820 2024-04-25T02:12:48.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.685+0000 7f78b67fc640 1 -- 172.21.15.79:0/1173695708 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5182 (secure 0 0 0) 0x7f78b804a020 con 0x7f78c015a820 2024-04-25T02:12:48.691 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:12:48.692 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/596307304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":596307304},{"type":"v1","addr":"172.21.15.189:6834","nonce":596307304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/980112490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":980112490},{"type":"v1","addr":"172.21.15.189:6835","nonce":980112490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2550610051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550610051},{"type":"v1","addr":"172.21.15.79:6836","nonce":2550610051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:11:55.951694+0000","modified":"2024-04-25T02:12:20.484828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":72,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":10,"addr":"172.21.15.79:6837/782013262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":782013262},{"type":"v1","addr":"172.21.15.79:6837","nonce":782013262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6696,"qdb_cluster":[6696]},"id":5}]} 2024-04-25T02:12:48.692 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 39 2024-04-25T02:12:48.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.687+0000 7f78c7ba2640 1 -- 172.21.15.79:0/1173695708 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f78a406be30 msgr2=0x7f78a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.687+0000 7f78c7ba2640 1 --2- 172.21.15.79:0/1173695708 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f78a406be30 0x7f78a406e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f78bc001b60 tx=0x7f78bc006040 comp rx=0 tx=0).stop 2024-04-25T02:12:48.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.687+0000 7f78c7ba2640 1 -- 172.21.15.79:0/1173695708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c015a820 msgr2=0x7f78c01592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.687+0000 7f78c7ba2640 1 --2- 172.21.15.79:0/1173695708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c015a820 0x7f78c01592a0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009be0 tx=0x7f78b8004730 comp rx=0 tx=0).stop 2024-04-25T02:12:48.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.687+0000 7f78c7ba2640 1 -- 172.21.15.79:0/1173695708 shutdown_connections 2024-04-25T02:12:48.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.687+0000 7f78c7ba2640 1 --2- 172.21.15.79:0/1173695708 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f78a406be30 0x7f78a406e2f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.687+0000 7f78c7ba2640 1 --2- 172.21.15.79:0/1173695708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c015a820 0x7f78c01592a0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.687+0000 7f78c7ba2640 1 --2- 172.21.15.79:0/1173695708 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78c01f7d20 0x7f78c015a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.687+0000 7f78c7ba2640 1 --2- 172.21.15.79:0/1173695708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78ac004d40 0x7f78c00aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.687+0000 7f78c7ba2640 1 -- 172.21.15.79:0/1173695708 >> 172.21.15.79:0/1173695708 conn(0x7f78c00cfc80 msgr2=0x7f78c0157d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.687+0000 7f78c7ba2640 1 -- 172.21.15.79:0/1173695708 shutdown_connections 2024-04-25T02:12:48.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.687+0000 7f78c7ba2640 1 -- 172.21.15.79:0/1173695708 wait complete. 2024-04-25T02:12:48.704 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T02:12:48.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.795+0000 7f7e10589640 1 Processor -- start 2024-04-25T02:12:48.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.795+0000 7f7e10589640 1 -- start start 2024-04-25T02:12:48.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.796+0000 7f7e10589640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e0815e4f0 0x7f7e080d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.796+0000 7f7e10589640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e080d10c0 0x7f7e0806bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.796+0000 7f7e10589640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e080d1ee0 con 0x7f7e080cf7f0 2024-04-25T02:12:48.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.796+0000 7f7e10589640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7e080d21c0 con 0x7f7e0815e4f0 2024-04-25T02:12:48.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.796+0000 7f7e10589640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7e080d24a0 con 0x7f7e080d10c0 2024-04-25T02:12:48.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.797+0000 7f7e0e325640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e0815e4f0 0x7f7e080d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.797+0000 7f7e0e325640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e0815e4f0 0x7f7e080d2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46618/0 (socket says 172.21.15.79:46618) 2024-04-25T02:12:48.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.797+0000 7f7e0e325640 1 -- 172.21.15.79:0/432507588 learned_addr learned my addr 172.21.15.79:0/432507588 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:48.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.797+0000 7f7e0e325640 1 -- 172.21.15.79:0/432507588 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e080d10c0 msgr2=0x7f7e0806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.797+0000 7f7e0e325640 1 --2- 172.21.15.79:0/432507588 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e080d10c0 0x7f7e0806bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.797+0000 7f7e0e325640 1 -- 172.21.15.79:0/432507588 >> v1:172.21.15.189:6789/0 conn(0x7f7e080cf7f0 legacy=0x7f7e080d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.797+0000 7f7e0e325640 1 -- 172.21.15.79:0/432507588 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e080d2780 con 0x7f7e0815e4f0 2024-04-25T02:12:48.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.797+0000 7f7e0e325640 1 --2- 172.21.15.79:0/432507588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e0815e4f0 0x7f7e080d2ca0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009e80 tx=0x7f7e0002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759006c32f19bfd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.798+0000 7f7e0d323640 1 -- 172.21.15.79:0/432507588 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e00036070 con 0x7f7e0815e4f0 2024-04-25T02:12:48.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.798+0000 7f7e0d323640 1 -- 172.21.15.79:0/432507588 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e00031600 con 0x7f7e0815e4f0 2024-04-25T02:12:48.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.798+0000 7f7e0d323640 1 -- 172.21.15.79:0/432507588 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e000319d0 con 0x7f7e0815e4f0 2024-04-25T02:12:48.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.798+0000 7f7e10589640 1 -- 172.21.15.79:0/432507588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e0815e4f0 msgr2=0x7f7e080d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.798+0000 7f7e10589640 1 --2- 172.21.15.79:0/432507588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e0815e4f0 0x7f7e080d2ca0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009e80 tx=0x7f7e0002a6f0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.798+0000 7f7e10589640 1 -- 172.21.15.79:0/432507588 shutdown_connections 2024-04-25T02:12:48.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.798+0000 7f7e10589640 1 --2- 172.21.15.79:0/432507588 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e080d10c0 0x7f7e0806bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.798+0000 7f7e10589640 1 --2- 172.21.15.79:0/432507588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e0815e4f0 0x7f7e080d2ca0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.798+0000 7f7e10589640 1 -- 172.21.15.79:0/432507588 >> 172.21.15.79:0/432507588 conn(0x7f7e0809d4a0 msgr2=0x7f7e080d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.798+0000 7f7e10589640 1 -- 172.21.15.79:0/432507588 shutdown_connections 2024-04-25T02:12:48.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.798+0000 7f7e10589640 1 -- 172.21.15.79:0/432507588 wait complete. 2024-04-25T02:12:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.799+0000 7f7e10589640 1 Processor -- start 2024-04-25T02:12:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.799+0000 7f7e10589640 1 -- start start 2024-04-25T02:12:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e10589640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e080cf7f0 0x7f7e08158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e10589640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e080d10c0 0x7f7e080cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e10589640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e0815e4f0 0x7f7e080b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e10589640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e080cfe00 con 0x7f7e080d10c0 2024-04-25T02:12:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e10589640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7e080cfc80 con 0x7f7e0815e4f0 2024-04-25T02:12:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e10589640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7e080cff80 con 0x7f7e080cf7f0 2024-04-25T02:12:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e0db24640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e080d10c0 0x7f7e080cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e0db24640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e080d10c0 0x7f7e080cb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46630/0 (socket says 172.21.15.79:46630) 2024-04-25T02:12:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e0db24640 1 -- 172.21.15.79:0/1250026161 learned_addr learned my addr 172.21.15.79:0/1250026161 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e0e325640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e080cf7f0 0x7f7e08158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e0eb26640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e0815e4f0 0x7f7e080b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e0db24640 1 -- 172.21.15.79:0/1250026161 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e080cf7f0 msgr2=0x7f7e08158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e0db24640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e080cf7f0 0x7f7e08158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e0db24640 1 -- 172.21.15.79:0/1250026161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e0815e4f0 msgr2=0x7f7e080b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e0db24640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e0815e4f0 0x7f7e080b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e0db24640 1 -- 172.21.15.79:0/1250026161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e080cba90 con 0x7f7e080d10c0 2024-04-25T02:12:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e0e325640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e080cf7f0 0x7f7e08158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.800+0000 7f7e0eb26640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e0815e4f0 0x7f7e080b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.801+0000 7f7e0db24640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e080d10c0 0x7f7e080cb240 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f7df800c440 tx=0x7f7df800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.801+0000 7f7dfeffd640 1 -- 172.21.15.79:0/1250026161 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8017070 con 0x7f7e080d10c0 2024-04-25T02:12:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.801+0000 7f7dfeffd640 1 -- 172.21.15.79:0/1250026161 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df80035f0 con 0x7f7e080d10c0 2024-04-25T02:12:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.801+0000 7f7e10589640 1 -- 172.21.15.79:0/1250026161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e080cbd70 con 0x7f7e080d10c0 2024-04-25T02:12:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.801+0000 7f7dfeffd640 1 -- 172.21.15.79:0/1250026161 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df80039e0 con 0x7f7e080d10c0 2024-04-25T02:12:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.801+0000 7f7e10589640 1 -- 172.21.15.79:0/1250026161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e080cc330 con 0x7f7e080d10c0 2024-04-25T02:12:48.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.802+0000 7f7dfeffd640 1 -- 172.21.15.79:0/1250026161 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7df801a070 con 0x7f7e080d10c0 2024-04-25T02:12:48.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.802+0000 7f7dfeffd640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7dec06be60 0x7f7dec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.803+0000 7f7dfeffd640 1 -- 172.21.15.79:0/1250026161 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f7df808a150 con 0x7f7e080d10c0 2024-04-25T02:12:48.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.803+0000 7f7e0e325640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7dec06be60 0x7f7dec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.803+0000 7f7e0e325640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7dec06be60 0x7f7dec06e320 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7e00033000 tx=0x7f7e00009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.804+0000 7f7e13373740 1 Processor -- start 2024-04-25T02:12:48.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.804+0000 7f7e13373740 1 -- start start 2024-04-25T02:12:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.804+0000 7f7e13373740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e75ff330 0x55e9e7602ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.804+0000 7f7e13373740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7602ff0 0x55e9e761ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.804+0000 7f7e13373740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 0x55e9e761f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.804+0000 7f7e13373740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e9e753b520 con 0x55e9e75ff330 2024-04-25T02:12:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.804+0000 7f7e13373740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e9e74d9ae0 con 0x55e9e7602ff0 2024-04-25T02:12:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.804+0000 7f7e13373740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55e9e75374e0 con 0x55e9e761f470 2024-04-25T02:12:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.805+0000 7f7e0e325640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e75ff330 0x55e9e7602ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.805+0000 7f7e0e325640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e75ff330 0x55e9e7602ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46642/0 (socket says 172.21.15.79:46642) 2024-04-25T02:12:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.805+0000 7f7e0e325640 1 -- 172.21.15.79:0/2115205829 learned_addr learned my addr 172.21.15.79:0/2115205829 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.805+0000 7f7e0eb26640 1 --2- 172.21.15.79:0/2115205829 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 0x55e9e761f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.805+0000 7f7e0db24640 1 --2- 172.21.15.79:0/2115205829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7602ff0 0x55e9e761ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.805+0000 7f7e0e325640 1 -- 172.21.15.79:0/2115205829 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 msgr2=0x55e9e761f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.805+0000 7f7e0e325640 1 --2- 172.21.15.79:0/2115205829 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 0x55e9e761f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.805+0000 7f7e0e325640 1 -- 172.21.15.79:0/2115205829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7602ff0 msgr2=0x55e9e761ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.805+0000 7f7e0e325640 1 --2- 172.21.15.79:0/2115205829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7602ff0 0x55e9e761ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.805+0000 7f7e0e325640 1 -- 172.21.15.79:0/2115205829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e74ff240 con 0x55e9e75ff330 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.805+0000 7f7e0eb26640 1 --2- 172.21.15.79:0/2115205829 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 0x55e9e761f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.805+0000 7f7e0e325640 1 --2- 172.21.15.79:0/2115205829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e75ff330 0x55e9e7602ab0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f7e0002ace0 tx=0x7f7e0002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28abb3db9eabfcf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.805+0000 7f7debfff640 1 -- 172.21.15.79:0/2115205829 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e00036040 con 0x55e9e75ff330 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.805+0000 7f7debfff640 1 -- 172.21.15.79:0/2115205829 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e0004c070 con 0x55e9e75ff330 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.805+0000 7f7debfff640 1 -- 172.21.15.79:0/2115205829 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0003cb90 con 0x55e9e75ff330 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.806+0000 7f7e13373740 1 -- 172.21.15.79:0/2115205829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e75ff330 msgr2=0x55e9e7602ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.806+0000 7f7e13373740 1 --2- 172.21.15.79:0/2115205829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e75ff330 0x55e9e7602ab0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f7e0002ace0 tx=0x7f7e0002e000 comp rx=0 tx=0).stop 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.806+0000 7f7e13373740 1 -- 172.21.15.79:0/2115205829 shutdown_connections 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.806+0000 7f7e13373740 1 --2- 172.21.15.79:0/2115205829 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 0x55e9e761f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.806+0000 7f7e13373740 1 --2- 172.21.15.79:0/2115205829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7602ff0 0x55e9e761ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.806+0000 7f7e13373740 1 --2- 172.21.15.79:0/2115205829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e75ff330 0x55e9e7602ab0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.806+0000 7f7e13373740 1 -- 172.21.15.79:0/2115205829 >> 172.21.15.79:0/2115205829 conn(0x55e9e75d5310 msgr2=0x55e9e75d6310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.806+0000 7f7e13373740 1 -- 172.21.15.79:0/2115205829 shutdown_connections 2024-04-25T02:12:48.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.806+0000 7f7e13373740 1 -- 172.21.15.79:0/2115205829 wait complete. 2024-04-25T02:12:48.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.806+0000 7f7e13373740 1 -- start start 2024-04-25T02:12:48.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.807+0000 7f7e13373740 1 Processor -- start 2024-04-25T02:12:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.807+0000 7f7e13373740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e7602ff0 0x55e9e7604520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.807+0000 7f7e13373740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e761f470 0x55e9e7618070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.807+0000 7f7e13373740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7606a00 0x55e9e76185b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.807+0000 7f7e13373740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e9e75d3140 con 0x55e9e761f470 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.807+0000 7f7e13373740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e9e74d7470 con 0x55e9e7606a00 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.807+0000 7f7e13373740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55e9e75d3420 con 0x55e9e7602ff0 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.807+0000 7f7e13373740 10 client.0 _ll_register_callbacks cb 0x55e9e74fbdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e0db24640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e761f470 0x55e9e7618070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e0db24640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e761f470 0x55e9e7618070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46656/0 (socket says 172.21.15.79:46656) 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e0db24640 1 -- 172.21.15.79:0/3476129237 learned_addr learned my addr 172.21.15.79:0/3476129237 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e0eb26640 1 --2- 172.21.15.79:0/3476129237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7606a00 0x55e9e76185b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e0db24640 1 -- 172.21.15.79:0/3476129237 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e7602ff0 msgr2=0x55e9e7604520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e0e325640 1 --2- 172.21.15.79:0/3476129237 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e7602ff0 0x55e9e7604520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e0db24640 1 --2- 172.21.15.79:0/3476129237 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e7602ff0 0x55e9e7604520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e0db24640 1 -- 172.21.15.79:0/3476129237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7606a00 msgr2=0x55e9e76185b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e0db24640 1 --2- 172.21.15.79:0/3476129237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7606a00 0x55e9e76185b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e0db24640 1 -- 172.21.15.79:0/3476129237 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9e74eebf0 con 0x55e9e761f470 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e0eb26640 1 --2- 172.21.15.79:0/3476129237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7606a00 0x55e9e76185b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e0e325640 1 --2- 172.21.15.79:0/3476129237 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e7602ff0 0x55e9e7604520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e0db24640 1 --2- 172.21.15.79:0/3476129237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e761f470 0x55e9e7618070 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f7df8058390 tx=0x7f7df80584c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e0d5d0be681c96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7de97fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7de97fa640 1 -- 172.21.15.79:0/3476129237 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8086060 con 0x55e9e761f470 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7de97fa640 1 -- 172.21.15.79:0/3476129237 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f7df8060b50 con 0x55e9e761f470 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e13373740 1 -- 172.21.15.79:0/3476129237 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e0004c070 con 0x55e9e761f470 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7de97fa640 1 -- 172.21.15.79:0/3476129237 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7df8075050 con 0x55e9e761f470 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e13373740 10 client.7083 fetch_fsmap learned FSMap version 39 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7e13373740 1 -- 172.21.15.79:0/3476129237 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55e9e731b7c0 con 0x55e9e761f470 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.808+0000 7f7de97fa640 1 -- 172.21.15.79:0/3476129237 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e0004c070 con 0x55e9e761f470 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.809+0000 7f7de97fa640 1 -- 172.21.15.79:0/3476129237 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f7df80772e0 con 0x55e9e761f470 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.809+0000 7f7e13373740 10 client.7083 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.809+0000 7f7e13373740 10 client.7083 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.809+0000 7f7e13373740 20 client.7083 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.809+0000 7f7e13373740 1 --2- 172.21.15.79:0/3476129237 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55e9e75fdc50 0x55e9e7631c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.809+0000 7f7e13373740 4 client.7083 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.809+0000 7f7e13373740 1 -- 172.21.15.79:0/3476129237 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9e754ed50 con 0x55e9e75fdc50 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.809+0000 7f7e0e325640 1 --2- 172.21.15.79:0/3476129237 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55e9e75fdc50 0x55e9e7631c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.809+0000 7f7de97fa640 10 client.7083 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.809+0000 7f7e0e325640 1 --2- 172.21.15.79:0/3476129237 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55e9e75fdc50 0x55e9e7631c50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77be3f3177565be1 server_cookie=a0a923ccfe386f0 in_seq=0 out_seq=0 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.810+0000 7f7de97fa640 1 -- 172.21.15.79:0/3476129237 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e9e754ed50 con 0x55e9e75fdc50 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.810+0000 7f7de97fa640 10 client.7083 handle_command_reply: tid=0 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.810+0000 7f7e13373740 1 client.7083 shutdown 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.810+0000 7f7e13373740 1 -- 172.21.15.79:0/3476129237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e761f470 msgr2=0x55e9e7618070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.810+0000 7f7e13373740 1 --2- 172.21.15.79:0/3476129237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e761f470 0x55e9e7618070 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f7df8058390 tx=0x7f7df80584c0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.810+0000 7f7e13373740 1 -- 172.21.15.79:0/3476129237 shutdown_connections 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.810+0000 7f7e13373740 1 --2- 172.21.15.79:0/3476129237 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55e9e75fdc50 0x55e9e7631c50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.810+0000 7f7e13373740 1 --2- 172.21.15.79:0/3476129237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7606a00 0x55e9e76185b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.810+0000 7f7e13373740 1 --2- 172.21.15.79:0/3476129237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e761f470 0x55e9e7618070 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.810+0000 7f7de97fa640 0 client.7083 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.810+0000 7f7e13373740 1 --2- 172.21.15.79:0/3476129237 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e7602ff0 0x55e9e7604520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.810+0000 7f7e13373740 1 -- 172.21.15.79:0/3476129237 >> 172.21.15.79:0/3476129237 conn(0x55e9e75ff330 msgr2=0x55e9e75d8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.810+0000 7f7e13373740 1 -- 172.21.15.79:0/3476129237 shutdown_connections 2024-04-25T02:12:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.810+0000 7f7e13373740 1 -- 172.21.15.79:0/3476129237 wait complete. 2024-04-25T02:12:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.810+0000 7f7e13373740 20 client.7083 trim_cache size 0 max 16384 2024-04-25T02:12:48.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.823+0000 7f7e13373740 1 Processor -- start 2024-04-25T02:12:48.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.824+0000 7f7e13373740 1 -- start start 2024-04-25T02:12:48.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e13373740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7602ff0 0x55e9e7618070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e13373740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e7606a00 0x55e9e75fc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e13373740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 0x55e9e762d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e13373740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e081ffa50 con 0x55e9e7606a00 2024-04-25T02:12:48.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e13373740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7e080b71b0 con 0x55e9e7602ff0 2024-04-25T02:12:48.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e13373740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7e080b7800 con 0x55e9e761f470 2024-04-25T02:12:48.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e0db24640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e7606a00 0x55e9e75fc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e0db24640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e7606a00 0x55e9e75fc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46664/0 (socket says 172.21.15.79:46664) 2024-04-25T02:12:48.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e0db24640 1 -- 172.21.15.79:0/3920709790 learned_addr learned my addr 172.21.15.79:0/3920709790 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:48.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e0e325640 1 --2- 172.21.15.79:0/3920709790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7602ff0 0x55e9e7618070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e0eb26640 1 --2- 172.21.15.79:0/3920709790 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 0x55e9e762d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e0db24640 1 -- 172.21.15.79:0/3920709790 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 msgr2=0x55e9e762d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e0db24640 1 --2- 172.21.15.79:0/3920709790 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 0x55e9e762d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e0db24640 1 -- 172.21.15.79:0/3920709790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7602ff0 msgr2=0x55e9e7618070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e0db24640 1 --2- 172.21.15.79:0/3920709790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7602ff0 0x55e9e7618070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e0db24640 1 -- 172.21.15.79:0/3920709790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e737bf50 con 0x55e9e7606a00 2024-04-25T02:12:48.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e0e325640 1 --2- 172.21.15.79:0/3920709790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7602ff0 0x55e9e7618070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:48.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e0eb26640 1 --2- 172.21.15.79:0/3920709790 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 0x55e9e762d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:48.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.825+0000 7f7e0db24640 1 --2- 172.21.15.79:0/3920709790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e7606a00 0x55e9e75fc370 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f7df8077650 tx=0x7f7df801e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce39735302a2331 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.826+0000 7f7deb7fe640 1 -- 172.21.15.79:0/3920709790 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8086020 con 0x55e9e7606a00 2024-04-25T02:12:48.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.826+0000 7f7deb7fe640 1 -- 172.21.15.79:0/3920709790 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df80772e0 con 0x55e9e7606a00 2024-04-25T02:12:48.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.826+0000 7f7deb7fe640 1 -- 172.21.15.79:0/3920709790 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8070070 con 0x55e9e7606a00 2024-04-25T02:12:48.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.826+0000 7f7e13373740 1 -- 172.21.15.79:0/3920709790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e7606a00 msgr2=0x55e9e75fc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.826+0000 7f7e13373740 1 --2- 172.21.15.79:0/3920709790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e7606a00 0x55e9e75fc370 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f7df8077650 tx=0x7f7df801e050 comp rx=0 tx=0).stop 2024-04-25T02:12:48.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.826+0000 7f7e13373740 1 -- 172.21.15.79:0/3920709790 shutdown_connections 2024-04-25T02:12:48.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.826+0000 7f7e13373740 1 --2- 172.21.15.79:0/3920709790 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 0x55e9e762d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.826+0000 7f7e13373740 1 --2- 172.21.15.79:0/3920709790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e7606a00 0x55e9e75fc370 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.826+0000 7f7e13373740 1 --2- 172.21.15.79:0/3920709790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7602ff0 0x55e9e7618070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.826+0000 7f7e13373740 1 -- 172.21.15.79:0/3920709790 >> 172.21.15.79:0/3920709790 conn(0x55e9e75ff330 msgr2=0x55e9e76033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.826+0000 7f7e13373740 1 -- 172.21.15.79:0/3920709790 shutdown_connections 2024-04-25T02:12:48.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.826+0000 7f7e13373740 1 -- 172.21.15.79:0/3920709790 wait complete. 2024-04-25T02:12:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.827+0000 7f7e13373740 1 -- start start 2024-04-25T02:12:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.827+0000 7f7e13373740 1 Processor -- start 2024-04-25T02:12:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e13373740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e7602ff0 0x55e9e76408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e13373740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7606a00 0x55e9e75d4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e13373740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 0x55e9e762d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e13373740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e9e75fdad0 con 0x55e9e7602ff0 2024-04-25T02:12:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e13373740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e9e75fd280 con 0x55e9e7606a00 2024-04-25T02:12:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e13373740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55e9e75fe0f0 con 0x55e9e761f470 2024-04-25T02:12:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e13373740 10 client.0 _ll_register_callbacks cb 0x7f7df80581d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e0e325640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e7602ff0 0x55e9e76408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e0e325640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e7602ff0 0x55e9e76408e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46672/0 (socket says 172.21.15.79:46672) 2024-04-25T02:12:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e0e325640 1 -- 172.21.15.79:0/1120208155 learned_addr learned my addr 172.21.15.79:0/1120208155 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e0db24640 1 --2- 172.21.15.79:0/1120208155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7606a00 0x55e9e75d4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e0eb26640 1 --2- 172.21.15.79:0/1120208155 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 0x55e9e762d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e0e325640 1 -- 172.21.15.79:0/1120208155 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 msgr2=0x55e9e762d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e0e325640 1 --2- 172.21.15.79:0/1120208155 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 0x55e9e762d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e0e325640 1 -- 172.21.15.79:0/1120208155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7606a00 msgr2=0x55e9e75d4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e0e325640 1 --2- 172.21.15.79:0/1120208155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7606a00 0x55e9e75d4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e0e325640 1 -- 172.21.15.79:0/1120208155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9e720f0b0 con 0x55e9e7602ff0 2024-04-25T02:12:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7e0e325640 1 --2- 172.21.15.79:0/1120208155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e7602ff0 0x55e9e76408e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009fa0 tx=0x7f7e0002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1672212d63f83854 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7de97fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.828+0000 7f7de97fa640 1 -- 172.21.15.79:0/1120208155 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e00036040 con 0x55e9e7602ff0 2024-04-25T02:12:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7de97fa640 1 -- 172.21.15.79:0/1120208155 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f7e0003c890 con 0x55e9e7602ff0 2024-04-25T02:12:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7e13373740 1 -- 172.21.15.79:0/1120208155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7df80772e0 con 0x55e9e7602ff0 2024-04-25T02:12:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7de97fa640 1 -- 172.21.15.79:0/1120208155 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7e0003ca90 con 0x55e9e7602ff0 2024-04-25T02:12:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7e13373740 10 client.7089 fetch_fsmap learned FSMap version 39 2024-04-25T02:12:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7e13373740 1 -- 172.21.15.79:0/1120208155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55e9e74c8780 con 0x55e9e7602ff0 2024-04-25T02:12:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7de97fa640 1 -- 172.21.15.79:0/1120208155 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df80772e0 con 0x55e9e7602ff0 2024-04-25T02:12:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7de97fa640 1 -- 172.21.15.79:0/1120208155 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f7e00008040 con 0x55e9e7602ff0 2024-04-25T02:12:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7e13373740 10 client.7089 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T02:12:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7e13373740 10 client.7089 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:12:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7e13373740 20 client.7089 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7e13373740 1 --2- 172.21.15.79:0/1120208155 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55e9e7698120 0x55e9e7698500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7e13373740 4 client.7089 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T02:12:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7e13373740 1 -- 172.21.15.79:0/1120208155 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55e9e7548a60 con 0x55e9e7698120 2024-04-25T02:12:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7e0db24640 1 --2- 172.21.15.79:0/1120208155 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55e9e7698120 0x55e9e7698500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7de97fa640 10 client.7089 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.829+0000 7f7e0db24640 1 --2- 172.21.15.79:0/1120208155 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55e9e7698120 0x55e9e7698500 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8a52a8c04874ec5 server_cookie=ce6848088704902b in_seq=0 out_seq=0 2024-04-25T02:12:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7de97fa640 1 -- 172.21.15.79:0/1120208155 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+237 (crc 0 0 0) 0x55e9e7548a60 con 0x55e9e7698120 2024-04-25T02:12:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7de97fa640 10 client.7089 handle_command_reply: tid=0 2024-04-25T02:12:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e13373740 1 client.7089 shutdown 2024-04-25T02:12:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e13373740 1 -- 172.21.15.79:0/1120208155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e7602ff0 msgr2=0x55e9e76408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e13373740 1 --2- 172.21.15.79:0/1120208155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e7602ff0 0x55e9e76408e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009fa0 tx=0x7f7e0002c000 comp rx=0 tx=0).stop 2024-04-25T02:12:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e13373740 1 -- 172.21.15.79:0/1120208155 shutdown_connections 2024-04-25T02:12:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e13373740 1 --2- 172.21.15.79:0/1120208155 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55e9e7698120 0x55e9e7698500 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e13373740 1 --2- 172.21.15.79:0/1120208155 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e9e761f470 0x55e9e762d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e13373740 1 --2- 172.21.15.79:0/1120208155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e7606a00 0x55e9e75d4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e13373740 1 --2- 172.21.15.79:0/1120208155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e9e7602ff0 0x55e9e76408e0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7de97fa640 0 client.7089 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e13373740 1 -- 172.21.15.79:0/1120208155 >> 172.21.15.79:0/1120208155 conn(0x55e9e75ff330 msgr2=0x55e9e761da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e13373740 1 -- 172.21.15.79:0/1120208155 shutdown_connections 2024-04-25T02:12:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e13373740 1 -- 172.21.15.79:0/1120208155 wait complete. 2024-04-25T02:12:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e13373740 20 client.7089 trim_cache size 0 max 16384 2024-04-25T02:12:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:12:48.843 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-04-25T02:12:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:12:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: "damage_type": "dentry", 2024-04-25T02:12:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 2179080876, 2024-04-25T02:12:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627776, 2024-04-25T02:12:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: "frag": "*", 2024-04-25T02:12:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: "dname": "file_to_be_damaged", 2024-04-25T02:12:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_id": "head", 2024-04-25T02:12:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/subdir/file_to_be_damaged" 2024-04-25T02:12:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:12:48.844 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-04-25T02:12:48.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e10589640 1 -- 172.21.15.79:0/1250026161 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7dec06be60 msgr2=0x7f7dec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e10589640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7dec06be60 0x7f7dec06e320 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7e00033000 tx=0x7f7e00009000 comp rx=0 tx=0).stop 2024-04-25T02:12:48.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e10589640 1 -- 172.21.15.79:0/1250026161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e080d10c0 msgr2=0x7f7e080cb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e10589640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e080d10c0 0x7f7e080cb240 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f7df800c440 tx=0x7f7df800c900 comp rx=0 tx=0).stop 2024-04-25T02:12:48.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e10589640 1 -- 172.21.15.79:0/1250026161 shutdown_connections 2024-04-25T02:12:48.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e10589640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7dec06be60 0x7f7dec06e320 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e10589640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e0815e4f0 0x7f7e080b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e10589640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e080d10c0 0x7f7e080cb240 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e10589640 1 --2- 172.21.15.79:0/1250026161 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e080cf7f0 0x7f7e08158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.830+0000 7f7e10589640 1 -- 172.21.15.79:0/1250026161 >> 172.21.15.79:0/1250026161 conn(0x7f7e0809d4a0 msgr2=0x7f7e0815a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.831+0000 7f7e10589640 1 -- 172.21.15.79:0/1250026161 shutdown_connections 2024-04-25T02:12:48.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.831+0000 7f7e10589640 1 -- 172.21.15.79:0/1250026161 wait complete. 2024-04-25T02:12:48.847 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T02:12:48.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.936+0000 7fdfd0422640 1 Processor -- start 2024-04-25T02:12:48.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.936+0000 7fdfd0422640 1 -- start start 2024-04-25T02:12:48.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.936+0000 7fdfd0422640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdfc8158910 0x7fdfc806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.937+0000 7fdfd0422640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdfc806e900 0x7fdfc815eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.937+0000 7fdfd0422640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc8071a40 con 0x7fdfc8158cf0 2024-04-25T02:12:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.937+0000 7fdfd0422640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fdfc8072650 con 0x7fdfc8158910 2024-04-25T02:12:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.937+0000 7fdfd0422640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc8071d20 con 0x7fdfc806e900 2024-04-25T02:12:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.937+0000 7fdfce1be640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdfc8158910 0x7fdfc806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.937+0000 7fdfce9bf640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdfc8158cf0 0x7fdfc815b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36870/0 (socket says 172.21.15.79:36870) 2024-04-25T02:12:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.937+0000 7fdfce9bf640 1 -- 172.21.15.79:0/3654900807 learned_addr learned my addr 172.21.15.79:0/3654900807 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.937+0000 7fdfcd9bd640 1 --2- 172.21.15.79:0/3654900807 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdfc806e900 0x7fdfc815eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.937+0000 7fdfce1be640 1 -- 172.21.15.79:0/3654900807 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdfc806e900 msgr2=0x7fdfc815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.937+0000 7fdfce1be640 1 --2- 172.21.15.79:0/3654900807 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdfc806e900 0x7fdfc815eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.937+0000 7fdfcd1bc640 1 -- 172.21.15.79:0/3654900807 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3937600002 0 0) 0x7fdfc8071a40 con 0x7fdfc8158cf0 2024-04-25T02:12:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.937+0000 7fdfce1be640 1 -- 172.21.15.79:0/3654900807 >> v1:172.21.15.79:6789/0 conn(0x7fdfc8158cf0 legacy=0x7fdfc815b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.937+0000 7fdfce1be640 1 -- 172.21.15.79:0/3654900807 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc8072000 con 0x7fdfc8158910 2024-04-25T02:12:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.937+0000 7fdfcd9bd640 1 --2- 172.21.15.79:0/3654900807 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdfc806e900 0x7fdfc815eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.938+0000 7fdfce1be640 1 --2- 172.21.15.79:0/3654900807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfc8158910 0x7fdfc806e3c0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80097a0 tx=0x7fdfb802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172bd3e32018c209 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.938+0000 7fdfcd1bc640 1 -- 172.21.15.79:0/3654900807 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8037070 con 0x7fdfc8158910 2024-04-25T02:12:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.938+0000 7fdfcd1bc640 1 -- 172.21.15.79:0/3654900807 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb8032440 con 0x7fdfc8158910 2024-04-25T02:12:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.938+0000 7fdfcd1bc640 1 -- 172.21.15.79:0/3654900807 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8032810 con 0x7fdfc8158910 2024-04-25T02:12:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.938+0000 7fdfd0422640 1 -- 172.21.15.79:0/3654900807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfc8158910 msgr2=0x7fdfc806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.938+0000 7fdfd0422640 1 --2- 172.21.15.79:0/3654900807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfc8158910 0x7fdfc806e3c0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80097a0 tx=0x7fdfb802a180 comp rx=0 tx=0).stop 2024-04-25T02:12:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.938+0000 7fdfd0422640 1 -- 172.21.15.79:0/3654900807 shutdown_connections 2024-04-25T02:12:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.938+0000 7fdfd0422640 1 --2- 172.21.15.79:0/3654900807 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdfc806e900 0x7fdfc815eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.938+0000 7fdfd0422640 1 --2- 172.21.15.79:0/3654900807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfc8158910 0x7fdfc806e3c0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.938+0000 7fdfd0422640 1 -- 172.21.15.79:0/3654900807 >> 172.21.15.79:0/3654900807 conn(0x7fdfc80cfc80 msgr2=0x7fdfc80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.938+0000 7fdfd0422640 1 -- 172.21.15.79:0/3654900807 shutdown_connections 2024-04-25T02:12:48.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.939+0000 7fdfd0422640 1 -- 172.21.15.79:0/3654900807 wait complete. 2024-04-25T02:12:48.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.940+0000 7fdfd0422640 1 Processor -- start 2024-04-25T02:12:48.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.940+0000 7fdfd0422640 1 -- start start 2024-04-25T02:12:48.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.940+0000 7fdfd0422640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfc806e900 0x7fdfc80aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.940+0000 7fdfd0422640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdfc8158910 0x7fdfc81541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.940+0000 7fdfd0422640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfc8158cf0 0x7fdfc8153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.940+0000 7fdfd0422640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc80b3cc0 con 0x7fdfc806e900 2024-04-25T02:12:48.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.940+0000 7fdfd0422640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc815f930 con 0x7fdfc8158cf0 2024-04-25T02:12:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.940+0000 7fdfd0422640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc80b3e40 con 0x7fdfc8158910 2024-04-25T02:12:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.940+0000 7fdfce1be640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfc806e900 0x7fdfc80aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.941+0000 7fdfce1be640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfc806e900 0x7fdfc80aed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46692/0 (socket says 172.21.15.79:46692) 2024-04-25T02:12:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.941+0000 7fdfce1be640 1 -- 172.21.15.79:0/613423219 learned_addr learned my addr 172.21.15.79:0/613423219 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.941+0000 7fdfce1be640 1 -- 172.21.15.79:0/613423219 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdfc8158910 msgr2=0x7fdfc81541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.941+0000 7fdfce1be640 1 --2- 172.21.15.79:0/613423219 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdfc8158910 0x7fdfc81541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.941+0000 7fdfce1be640 1 -- 172.21.15.79:0/613423219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfc8158cf0 msgr2=0x7fdfc8153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.941+0000 7fdfce1be640 1 --2- 172.21.15.79:0/613423219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfc8158cf0 0x7fdfc8153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.941+0000 7fdfce1be640 1 -- 172.21.15.79:0/613423219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc80adca0 con 0x7fdfc806e900 2024-04-25T02:12:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.941+0000 7fdfce1be640 1 --2- 172.21.15.79:0/613423219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfc806e900 0x7fdfc80aed40 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8035040 tx=0x7fdfb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.941+0000 7fdfbeffd640 1 -- 172.21.15.79:0/613423219 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8037040 con 0x7fdfc806e900 2024-04-25T02:12:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.941+0000 7fdfbeffd640 1 -- 172.21.15.79:0/613423219 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb8030770 con 0x7fdfc806e900 2024-04-25T02:12:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.941+0000 7fdfd0422640 1 -- 172.21.15.79:0/613423219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc80adf80 con 0x7fdfc806e900 2024-04-25T02:12:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.941+0000 7fdfbeffd640 1 -- 172.21.15.79:0/613423219 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8030b80 con 0x7fdfc806e900 2024-04-25T02:12:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.941+0000 7fdfd0422640 1 -- 172.21.15.79:0/613423219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc80ae540 con 0x7fdfc806e900 2024-04-25T02:12:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.942+0000 7fdfd0422640 1 -- 172.21.15.79:0/613423219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc80690a0 con 0x7fdfc806e900 2024-04-25T02:12:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.943+0000 7fdfbeffd640 1 -- 172.21.15.79:0/613423219 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdfb8044020 con 0x7fdfc806e900 2024-04-25T02:12:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.943+0000 7fdfbeffd640 1 --2- 172.21.15.79:0/613423219 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdfac06be60 0x7fdfac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:48.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.943+0000 7fdfbeffd640 1 -- 172.21.15.79:0/613423219 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7fdfb80ab5b0 con 0x7fdfc806e900 2024-04-25T02:12:48.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.943+0000 7fdfcd9bd640 1 --2- 172.21.15.79:0/613423219 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdfac06be60 0x7fdfac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:48.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.943+0000 7fdfcd9bd640 1 --2- 172.21.15.79:0/613423219 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdfac06be60 0x7fdfac06e320 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4006fd0 tx=0x7fdfc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:48.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:48.947+0000 7fdfbeffd640 1 -- 172.21.15.79:0/613423219 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdfb8032e20 con 0x7fdfc806e900 2024-04-25T02:12:49.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.156+0000 7fdfd0422640 1 -- 172.21.15.79:0/613423219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdfc80af740 con 0x7fdfc806e900 2024-04-25T02:12:49.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.156+0000 7fdfbeffd640 1 -- 172.21.15.79:0/613423219 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7fdfb80313a0 con 0x7fdfc806e900 2024-04-25T02:12:49.163 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:12:49.163 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T02:12:49.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.158+0000 7fdfd0422640 1 -- 172.21.15.79:0/613423219 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdfac06be60 msgr2=0x7fdfac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.158+0000 7fdfd0422640 1 --2- 172.21.15.79:0/613423219 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdfac06be60 0x7fdfac06e320 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4006fd0 tx=0x7fdfc4008040 comp rx=0 tx=0).stop 2024-04-25T02:12:49.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.158+0000 7fdfd0422640 1 -- 172.21.15.79:0/613423219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfc806e900 msgr2=0x7fdfc80aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.158+0000 7fdfd0422640 1 --2- 172.21.15.79:0/613423219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfc806e900 0x7fdfc80aed40 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8035040 tx=0x7fdfb80046c0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.158+0000 7fdfd0422640 1 -- 172.21.15.79:0/613423219 shutdown_connections 2024-04-25T02:12:49.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.158+0000 7fdfd0422640 1 --2- 172.21.15.79:0/613423219 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdfac06be60 0x7fdfac06e320 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.158+0000 7fdfd0422640 1 --2- 172.21.15.79:0/613423219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfc8158cf0 0x7fdfc8153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.158+0000 7fdfd0422640 1 --2- 172.21.15.79:0/613423219 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdfc8158910 0x7fdfc81541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.158+0000 7fdfd0422640 1 --2- 172.21.15.79:0/613423219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfc806e900 0x7fdfc80aed40 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.158+0000 7fdfd0422640 1 -- 172.21.15.79:0/613423219 >> 172.21.15.79:0/613423219 conn(0x7fdfc80cfc80 msgr2=0x7fdfc8070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:49.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.158+0000 7fdfd0422640 1 -- 172.21.15.79:0/613423219 shutdown_connections 2024-04-25T02:12:49.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.158+0000 7fdfd0422640 1 -- 172.21.15.79:0/613423219 wait complete. 2024-04-25T02:12:49.175 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T02:12:49.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:49.175 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir repair,recursive 2024-04-25T02:12:49.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.270+0000 7fdbdef63640 1 Processor -- start 2024-04-25T02:12:49.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.270+0000 7fdbdef63640 1 -- start start 2024-04-25T02:12:49.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.271+0000 7fdbdef63640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbd806e290 0x7fdbd815b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.271+0000 7fdbdef63640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd80b5280 con 0x7fdbd80b4e10 2024-04-25T02:12:49.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.271+0000 7fdbdef63640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd80b2da0 con 0x7fdbd8151780 2024-04-25T02:12:49.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.271+0000 7fdbdef63640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdbd80b3e40 con 0x7fdbd806e290 2024-04-25T02:12:49.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.271+0000 7fdbdd500640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdbd80b4e10 0x7fdbd80cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36880/0 (socket says 172.21.15.79:36880) 2024-04-25T02:12:49.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.271+0000 7fdbdd500640 1 -- 172.21.15.79:0/1183105728 learned_addr learned my addr 172.21.15.79:0/1183105728 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.271+0000 7fdbd7fff640 1 --2- 172.21.15.79:0/1183105728 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbd806e290 0x7fdbd815b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.271+0000 7fdbd77fe640 1 -- 172.21.15.79:0/1183105728 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1726936685 0 0) 0x7fdbd80b5280 con 0x7fdbd80b4e10 2024-04-25T02:12:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.271+0000 7fdbd77fe640 1 -- 172.21.15.79:0/1183105728 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbc0003520 con 0x7fdbd80b4e10 2024-04-25T02:12:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.272+0000 7fdbd77fe640 1 -- 172.21.15.79:0/1183105728 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4270849754 0 0) 0x7fdbd80b2da0 con 0x7fdbd8151780 2024-04-25T02:12:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.272+0000 7fdbd77fe640 1 -- 172.21.15.79:0/1183105728 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbd80b5280 con 0x7fdbd8151780 2024-04-25T02:12:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.272+0000 7fdbd77fe640 1 -- 172.21.15.79:0/1183105728 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4016322766 0 0) 0x7fdbc0003520 con 0x7fdbd80b4e10 2024-04-25T02:12:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.272+0000 7fdbd7fff640 1 -- 172.21.15.79:0/1183105728 >> v1:172.21.15.189:6789/0 conn(0x7fdbd8151780 legacy=0x7fdbd806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.272+0000 7fdbd7fff640 1 -- 172.21.15.79:0/1183105728 >> v1:172.21.15.79:6789/0 conn(0x7fdbd80b4e10 legacy=0x7fdbd80cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.272+0000 7fdbd7fff640 1 -- 172.21.15.79:0/1183105728 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd80b3080 con 0x7fdbd806e290 2024-04-25T02:12:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.272+0000 7fdbd7fff640 1 --2- 172.21.15.79:0/1183105728 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbd806e290 0x7fdbd815b720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00a970 tx=0x7fdbcc02b550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=766fdecdfb5b9347 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.273+0000 7fdbd77fe640 1 -- 172.21.15.79:0/1183105728 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00019f0 con 0x7fdbd806e290 2024-04-25T02:12:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.273+0000 7fdbd77fe640 1 -- 172.21.15.79:0/1183105728 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbcc030510 con 0x7fdbd806e290 2024-04-25T02:12:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.273+0000 7fdbd77fe640 1 -- 172.21.15.79:0/1183105728 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc00b040 con 0x7fdbd806e290 2024-04-25T02:12:49.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.273+0000 7fdbdef63640 1 -- 172.21.15.79:0/1183105728 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbd806e290 msgr2=0x7fdbd815b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.273+0000 7fdbdef63640 1 --2- 172.21.15.79:0/1183105728 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbd806e290 0x7fdbd815b720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00a970 tx=0x7fdbcc02b550 comp rx=0 tx=0).stop 2024-04-25T02:12:49.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.273+0000 7fdbdef63640 1 -- 172.21.15.79:0/1183105728 shutdown_connections 2024-04-25T02:12:49.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.273+0000 7fdbdef63640 1 --2- 172.21.15.79:0/1183105728 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbd806e290 0x7fdbd815b720 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.273+0000 7fdbdef63640 1 -- 172.21.15.79:0/1183105728 >> 172.21.15.79:0/1183105728 conn(0x7fdbd806b4a0 msgr2=0x7fdbd806b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.273+0000 7fdbdef63640 1 -- 172.21.15.79:0/1183105728 shutdown_connections 2024-04-25T02:12:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.273+0000 7fdbdef63640 1 -- 172.21.15.79:0/1183105728 wait complete. 2024-04-25T02:12:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.274+0000 7fdbdef63640 1 Processor -- start 2024-04-25T02:12:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.274+0000 7fdbdef63640 1 -- start start 2024-04-25T02:12:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.275+0000 7fdbdef63640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbd806e290 0x7fdbd81efb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.275+0000 7fdbdef63640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbd80b4e10 0x7fdbd814b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.275+0000 7fdbdef63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd8151780 0x7fdbd80caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.275+0000 7fdbdef63640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd80b3920 con 0x7fdbd8151780 2024-04-25T02:12:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.275+0000 7fdbdef63640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd80b3640 con 0x7fdbd806e290 2024-04-25T02:12:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.275+0000 7fdbdef63640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdbd8151b60 con 0x7fdbd80b4e10 2024-04-25T02:12:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.275+0000 7fdbdd500640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd8151780 0x7fdbd80caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.275+0000 7fdbdd500640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd8151780 0x7fdbd80caee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46706/0 (socket says 172.21.15.79:46706) 2024-04-25T02:12:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.275+0000 7fdbdd500640 1 -- 172.21.15.79:0/4285908019 learned_addr learned my addr 172.21.15.79:0/4285908019 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.275+0000 7fdbd7fff640 1 --2- 172.21.15.79:0/4285908019 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbd80b4e10 0x7fdbd814b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.275+0000 7fdbdccff640 1 --2- 172.21.15.79:0/4285908019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbd806e290 0x7fdbd81efb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.276+0000 7fdbdd500640 1 -- 172.21.15.79:0/4285908019 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbd80b4e10 msgr2=0x7fdbd814b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.276+0000 7fdbdd500640 1 --2- 172.21.15.79:0/4285908019 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbd80b4e10 0x7fdbd814b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.276+0000 7fdbdd500640 1 -- 172.21.15.79:0/4285908019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbd806e290 msgr2=0x7fdbd81efb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.276+0000 7fdbdd500640 1 --2- 172.21.15.79:0/4285908019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbd806e290 0x7fdbd81efb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.276+0000 7fdbdd500640 1 -- 172.21.15.79:0/4285908019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd81f01b0 con 0x7fdbd8151780 2024-04-25T02:12:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.276+0000 7fdbdd500640 1 --2- 172.21.15.79:0/4285908019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd8151780 0x7fdbd80caee0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000cbe0 tx=0x7fdbd000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.276+0000 7fdbd57fa640 1 -- 172.21.15.79:0/4285908019 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0017070 con 0x7fdbd8151780 2024-04-25T02:12:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.276+0000 7fdbd57fa640 1 -- 172.21.15.79:0/4285908019 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd000ace0 con 0x7fdbd8151780 2024-04-25T02:12:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.276+0000 7fdbd57fa640 1 -- 172.21.15.79:0/4285908019 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0012640 con 0x7fdbd8151780 2024-04-25T02:12:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.276+0000 7fdbdef63640 1 -- 172.21.15.79:0/4285908019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd81f0490 con 0x7fdbd8151780 2024-04-25T02:12:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.276+0000 7fdbdef63640 1 -- 172.21.15.79:0/4285908019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd81f0a50 con 0x7fdbd8151780 2024-04-25T02:12:49.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.277+0000 7fdbd57fa640 1 -- 172.21.15.79:0/4285908019 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdbd001a070 con 0x7fdbd8151780 2024-04-25T02:12:49.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.278+0000 7fdbd57fa640 1 --2- 172.21.15.79:0/4285908019 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdbc406be30 0x7fdbc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.278+0000 7fdbd57fa640 1 -- 172.21.15.79:0/4285908019 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7fdbd008ace0 con 0x7fdbd8151780 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.278+0000 7fdbdccff640 1 --2- 172.21.15.79:0/4285908019 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdbc406be30 0x7fdbc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.278+0000 7fdbdccff640 1 --2- 172.21.15.79:0/4285908019 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdbc406be30 0x7fdbc406e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80011e0 tx=0x7fdbc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.279+0000 7fdbe1c7c740 1 Processor -- start 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.279+0000 7fdbe1c7c740 1 -- start start 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbe1c7c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b39c60 0x5649d9b0b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbe1c7c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b0fda0 0x5649d9b3a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbe1c7c740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b10ee0 0x5649d9b0e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbe1c7c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5649d9a72490 con 0x5649d9b39c60 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbe1c7c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5649d9a1aae0 con 0x5649d9b0fda0 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbe1c7c740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5649d9a6e450 con 0x5649d9b10ee0 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbdccff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b39c60 0x5649d9b0b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbdccff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b39c60 0x5649d9b0b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46722/0 (socket says 172.21.15.79:46722) 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbdccff640 1 -- 172.21.15.79:0/4220581485 learned_addr learned my addr 172.21.15.79:0/4220581485 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbd7fff640 1 --2- 172.21.15.79:0/4220581485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b0fda0 0x5649d9b3a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbdd500640 1 --2- 172.21.15.79:0/4220581485 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b10ee0 0x5649d9b0e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbdccff640 1 -- 172.21.15.79:0/4220581485 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b10ee0 msgr2=0x5649d9b0e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbdccff640 1 --2- 172.21.15.79:0/4220581485 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b10ee0 0x5649d9b0e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbdccff640 1 -- 172.21.15.79:0/4220581485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b0fda0 msgr2=0x5649d9b3a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbdccff640 1 --2- 172.21.15.79:0/4220581485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b0fda0 0x5649d9b3a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbdccff640 1 -- 172.21.15.79:0/4220581485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649d984ea50 con 0x5649d9b39c60 2024-04-25T02:12:49.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbdccff640 1 --2- 172.21.15.79:0/4220581485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b39c60 0x5649d9b0b5b0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80050d0 tx=0x7fdbc8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1af84c62debf52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:49.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbbe7fc640 1 -- 172.21.15.79:0/4220581485 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc80035f0 con 0x5649d9b39c60 2024-04-25T02:12:49.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbbe7fc640 1 -- 172.21.15.79:0/4220581485 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc8003790 con 0x5649d9b39c60 2024-04-25T02:12:49.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.280+0000 7fdbbe7fc640 1 -- 172.21.15.79:0/4220581485 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8003b40 con 0x5649d9b39c60 2024-04-25T02:12:49.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.281+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/4220581485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b39c60 msgr2=0x5649d9b0b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.281+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/4220581485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b39c60 0x5649d9b0b5b0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80050d0 tx=0x7fdbc8011000 comp rx=0 tx=0).stop 2024-04-25T02:12:49.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.281+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/4220581485 shutdown_connections 2024-04-25T02:12:49.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.281+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/4220581485 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b10ee0 0x5649d9b0e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.281+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/4220581485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b0fda0 0x5649d9b3a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.281+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/4220581485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b39c60 0x5649d9b0b5b0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.281+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/4220581485 >> 172.21.15.79:0/4220581485 conn(0x5649d9ad65e0 msgr2=0x5649d9b54a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:49.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.281+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/4220581485 shutdown_connections 2024-04-25T02:12:49.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.281+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/4220581485 wait complete. 2024-04-25T02:12:49.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.281+0000 7fdbe1c7c740 1 -- start start 2024-04-25T02:12:49.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.282+0000 7fdbe1c7c740 1 Processor -- start 2024-04-25T02:12:49.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.282+0000 7fdbe1c7c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b0fda0 0x5649d9b36650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.282+0000 7fdbe1c7c740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b10ee0 0x5649d9b43150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.282+0000 7fdbe1c7c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b39c60 0x5649d9b56d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.282+0000 7fdbe1c7c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5649d9b0e900 con 0x5649d9b0fda0 2024-04-25T02:12:49.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.282+0000 7fdbe1c7c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5649d9a2e060 con 0x5649d9b39c60 2024-04-25T02:12:49.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.282+0000 7fdbe1c7c740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5649d9b10220 con 0x5649d9b10ee0 2024-04-25T02:12:49.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.282+0000 7fdbe1c7c740 10 client.0 _ll_register_callbacks cb 0x5649d9a69970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:49.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.282+0000 7fdbdccff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b0fda0 0x5649d9b36650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.282+0000 7fdbdccff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b0fda0 0x5649d9b36650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46728/0 (socket says 172.21.15.79:46728) 2024-04-25T02:12:49.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.282+0000 7fdbdccff640 1 -- 172.21.15.79:0/2818800264 learned_addr learned my addr 172.21.15.79:0/2818800264 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:49.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbd7fff640 1 --2- 172.21.15.79:0/2818800264 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b10ee0 0x5649d9b43150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbdd500640 1 --2- 172.21.15.79:0/2818800264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b39c60 0x5649d9b56d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbdccff640 1 -- 172.21.15.79:0/2818800264 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b10ee0 msgr2=0x5649d9b43150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbdccff640 1 --2- 172.21.15.79:0/2818800264 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b10ee0 0x5649d9b43150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbdccff640 1 -- 172.21.15.79:0/2818800264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b39c60 msgr2=0x5649d9b56d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbdccff640 1 --2- 172.21.15.79:0/2818800264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b39c60 0x5649d9b56d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbdccff640 1 -- 172.21.15.79:0/2818800264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649d97463e0 con 0x5649d9b0fda0 2024-04-25T02:12:49.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbdccff640 1 --2- 172.21.15.79:0/2818800264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b0fda0 0x5649d9b36650 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80050d0 tx=0x7fdbc8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56f2cd33615a4e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:49.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbb77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:49.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbb77fe640 1 -- 172.21.15.79:0/2818800264 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8021860 con 0x5649d9b0fda0 2024-04-25T02:12:49.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbb77fe640 1 -- 172.21.15.79:0/2818800264 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7fdbc802cb80 con 0x5649d9b0fda0 2024-04-25T02:12:49.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2818800264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbc8003790 con 0x5649d9b0fda0 2024-04-25T02:12:49.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbb77fe640 1 -- 172.21.15.79:0/2818800264 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fdbc802cd80 con 0x5649d9b0fda0 2024-04-25T02:12:49.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbe1c7c740 10 client.7110 fetch_fsmap learned FSMap version 39 2024-04-25T02:12:49.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2818800264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x5649d98af1e0 con 0x5649d9b0fda0 2024-04-25T02:12:49.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbb77fe640 1 -- 172.21.15.79:0/2818800264 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc8003790 con 0x5649d9b0fda0 2024-04-25T02:12:49.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbb77fe640 1 -- 172.21.15.79:0/2818800264 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7fdbc8029070 con 0x5649d9b0fda0 2024-04-25T02:12:49.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbe1c7c740 10 client.7110 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T02:12:49.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.283+0000 7fdbe1c7c740 10 client.7110 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T02:12:49.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.284+0000 7fdbe1c7c740 20 client.7110 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:49.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.284+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/2818800264 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5649d9b6c610 0x5649d9b6ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.284+0000 7fdbe1c7c740 4 client.7110 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:49.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.284+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2818800264 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649d9a7f9d0 con 0x5649d9b6c610 2024-04-25T02:12:49.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.284+0000 7fdbd7fff640 1 --2- 172.21.15.79:0/2818800264 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5649d9b6c610 0x5649d9b6ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.284+0000 7fdbb77fe640 10 client.7110 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:49.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.284+0000 7fdbd7fff640 1 --2- 172.21.15.79:0/2818800264 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5649d9b6c610 0x5649d9b6ca30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df114fb256ccd666 server_cookie=b46b0b486dba22b6 in_seq=0 out_seq=0 2024-04-25T02:12:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.284+0000 7fdbb77fe640 1 -- 172.21.15.79:0/2818800264 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5649d9a7f9d0 con 0x5649d9b6c610 2024-04-25T02:12:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.284+0000 7fdbb77fe640 10 client.7110 handle_command_reply: tid=0 2024-04-25T02:12:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.284+0000 7fdbe1c7c740 1 client.7110 shutdown 2024-04-25T02:12:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.285+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2818800264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b0fda0 msgr2=0x5649d9b36650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.285+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/2818800264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b0fda0 0x5649d9b36650 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80050d0 tx=0x7fdbc8000ed0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.285+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2818800264 shutdown_connections 2024-04-25T02:12:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.285+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/2818800264 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5649d9b6c610 0x5649d9b6ca30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.285+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/2818800264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b39c60 0x5649d9b56d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.285+0000 7fdbb77fe640 0 client.7110 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.285+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/2818800264 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b10ee0 0x5649d9b43150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.285+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/2818800264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b0fda0 0x5649d9b36650 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.285+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2818800264 >> 172.21.15.79:0/2818800264 conn(0x5649d9ad65e0 msgr2=0x5649d9b541d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.285+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2818800264 shutdown_connections 2024-04-25T02:12:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.285+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2818800264 wait complete. 2024-04-25T02:12:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.285+0000 7fdbe1c7c740 20 client.7110 trim_cache size 0 max 16384 2024-04-25T02:12:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.302+0000 7fdbe1c7c740 1 Processor -- start 2024-04-25T02:12:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.302+0000 7fdbe1c7c740 1 -- start start 2024-04-25T02:12:49.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbe1c7c740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b0fda0 0x5649d9b3d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbe1c7c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b10ee0 0x5649d9b43290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbe1c7c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b39c60 0x5649d9bd14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbe1c7c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5649d9b11630 con 0x5649d9b39c60 2024-04-25T02:12:49.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbe1c7c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd81f6290 con 0x5649d9b10ee0 2024-04-25T02:12:49.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbe1c7c740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdbd80c6ce0 con 0x5649d9b0fda0 2024-04-25T02:12:49.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbdd500640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b39c60 0x5649d9bd14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbdd500640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b39c60 0x5649d9bd14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46744/0 (socket says 172.21.15.79:46744) 2024-04-25T02:12:49.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbdd500640 1 -- 172.21.15.79:0/749654101 learned_addr learned my addr 172.21.15.79:0/749654101 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:49.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbdd500640 1 -- 172.21.15.79:0/749654101 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b0fda0 msgr2=0x5649d9b3d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbdd500640 1 --2- 172.21.15.79:0/749654101 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b0fda0 0x5649d9b3d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbdd500640 1 -- 172.21.15.79:0/749654101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b10ee0 msgr2=0x5649d9b43290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbdd500640 1 --2- 172.21.15.79:0/749654101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b10ee0 0x5649d9b43290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbdd500640 1 -- 172.21.15.79:0/749654101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649d971f4a0 con 0x5649d9b39c60 2024-04-25T02:12:49.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbdd500640 1 --2- 172.21.15.79:0/749654101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b39c60 0x5649d9bd14c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0001560 tx=0x7fdbd0001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7379e3bbc0c6c70a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:49.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbbdffb640 1 -- 172.21.15.79:0/749654101 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0061b70 con 0x5649d9b39c60 2024-04-25T02:12:49.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbbdffb640 1 -- 172.21.15.79:0/749654101 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd0057290 con 0x5649d9b39c60 2024-04-25T02:12:49.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.303+0000 7fdbbdffb640 1 -- 172.21.15.79:0/749654101 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00616e0 con 0x5649d9b39c60 2024-04-25T02:12:49.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.304+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/749654101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b39c60 msgr2=0x5649d9bd14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.304+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/749654101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b39c60 0x5649d9bd14c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0001560 tx=0x7fdbd0001b20 comp rx=0 tx=0).stop 2024-04-25T02:12:49.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.304+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/749654101 shutdown_connections 2024-04-25T02:12:49.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.304+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/749654101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b39c60 0x5649d9bd14c0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.304+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/749654101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b10ee0 0x5649d9b43290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.304+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/749654101 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b0fda0 0x5649d9b3d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.304+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/749654101 >> 172.21.15.79:0/749654101 conn(0x5649d9ad65e0 msgr2=0x5649d9b68810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:49.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.304+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/749654101 shutdown_connections 2024-04-25T02:12:49.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.304+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/749654101 wait complete. 2024-04-25T02:12:49.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.304+0000 7fdbe1c7c740 1 -- start start 2024-04-25T02:12:49.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.305+0000 7fdbe1c7c740 1 Processor -- start 2024-04-25T02:12:49.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.305+0000 7fdbe1c7c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b0fda0 0x5649d9b08d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.305+0000 7fdbe1c7c740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b10ee0 0x5649d9b09290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.305+0000 7fdbe1c7c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b39c60 0x5649d9bcc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.305+0000 7fdbe1c7c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd80c6690 con 0x5649d9b0fda0 2024-04-25T02:12:49.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.305+0000 7fdbe1c7c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd80c6040 con 0x5649d9b39c60 2024-04-25T02:12:49.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.305+0000 7fdbe1c7c740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5649d9b36500 con 0x5649d9b10ee0 2024-04-25T02:12:49.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.305+0000 7fdbe1c7c740 10 client.0 _ll_register_callbacks cb 0x7fdbc8001d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:49.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.305+0000 7fdbdccff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b0fda0 0x5649d9b08d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.305+0000 7fdbdccff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b0fda0 0x5649d9b08d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46756/0 (socket says 172.21.15.79:46756) 2024-04-25T02:12:49.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbdccff640 1 -- 172.21.15.79:0/2023914159 learned_addr learned my addr 172.21.15.79:0/2023914159 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:49.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbd7fff640 1 --2- 172.21.15.79:0/2023914159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b10ee0 0x5649d9b09290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbdd500640 1 --2- 172.21.15.79:0/2023914159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b39c60 0x5649d9bcc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbdccff640 1 -- 172.21.15.79:0/2023914159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b10ee0 msgr2=0x5649d9b09290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbdccff640 1 --2- 172.21.15.79:0/2023914159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b10ee0 0x5649d9b09290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbdccff640 1 -- 172.21.15.79:0/2023914159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b39c60 msgr2=0x5649d9bcc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbdccff640 1 --2- 172.21.15.79:0/2023914159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b39c60 0x5649d9bcc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbdccff640 1 -- 172.21.15.79:0/2023914159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649d9bc86e0 con 0x5649d9b0fda0 2024-04-25T02:12:49.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbdccff640 1 --2- 172.21.15.79:0/2023914159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b0fda0 0x5649d9b08d50 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800e530 tx=0x7fdbc8001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204d4bc0641bc9ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:49.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbb77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:49.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbb77fe640 1 -- 172.21.15.79:0/2023914159 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8003790 con 0x5649d9b0fda0 2024-04-25T02:12:49.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbb77fe640 1 -- 172.21.15.79:0/2023914159 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7fdbc8030900 con 0x5649d9b0fda0 2024-04-25T02:12:49.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2023914159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbd0057290 con 0x5649d9b0fda0 2024-04-25T02:12:49.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbb77fe640 1 -- 172.21.15.79:0/2023914159 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fdbc800ebb0 con 0x5649d9b0fda0 2024-04-25T02:12:49.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbe1c7c740 10 client.7116 fetch_fsmap learned FSMap version 39 2024-04-25T02:12:49.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2023914159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x5649d9bcd270 con 0x5649d9b0fda0 2024-04-25T02:12:49.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbb77fe640 1 -- 172.21.15.79:0/2023914159 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd0057290 con 0x5649d9b0fda0 2024-04-25T02:12:49.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbb77fe640 1 -- 172.21.15.79:0/2023914159 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7fdbc8029070 con 0x5649d9b0fda0 2024-04-25T02:12:49.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbe1c7c740 10 client.7116 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T02:12:49.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbe1c7c740 10 client.7116 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T02:12:49.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbe1c7c740 20 client.7116 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:49.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.306+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/2023914159 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5649d9b3d110 0x5649d9bcc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.307+0000 7fdbe1c7c740 4 client.7116 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}] 2024-04-25T02:12:49.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.307+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2023914159 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}) -- 0x5649d9a79d20 con 0x5649d9b3d110 2024-04-25T02:12:49.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.307+0000 7fdbd7fff640 1 --2- 172.21.15.79:0/2023914159 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5649d9b3d110 0x5649d9bcc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.307+0000 7fdbb77fe640 10 client.7116 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:49.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.307+0000 7fdbd7fff640 1 --2- 172.21.15.79:0/2023914159 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5649d9b3d110 0x5649d9bcc780 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abf5704acd6b529c server_cookie=e656a6f76c80a873 in_seq=0 out_seq=0 2024-04-25T02:12:49.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.307+0000 7fdbb77fe640 1 -- 172.21.15.79:0/2023914159 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5649d9a79d20 con 0x5649d9b3d110 2024-04-25T02:12:49.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.307+0000 7fdbb77fe640 10 client.7116 handle_command_reply: tid=0 2024-04-25T02:12:49.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.307+0000 7fdbe1c7c740 1 client.7116 shutdown 2024-04-25T02:12:49.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2023914159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b0fda0 msgr2=0x5649d9b08d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/2023914159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b0fda0 0x5649d9b08d50 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800e530 tx=0x7fdbc8001150 comp rx=0 tx=0).stop 2024-04-25T02:12:49.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2023914159 shutdown_connections 2024-04-25T02:12:49.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/2023914159 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x5649d9b3d110 0x5649d9bcc780 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/2023914159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649d9b39c60 0x5649d9bcc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/2023914159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5649d9b10ee0 0x5649d9b09290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbe1c7c740 1 --2- 172.21.15.79:0/2023914159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d9b0fda0 0x5649d9b08d50 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbb77fe640 0 client.7116 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:49.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2023914159 >> 172.21.15.79:0/2023914159 conn(0x5649d9ad65e0 msgr2=0x5649d9b37970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:49.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2023914159 shutdown_connections 2024-04-25T02:12:49.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbe1c7c740 1 -- 172.21.15.79:0/2023914159 wait complete. 2024-04-25T02:12:49.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbe1c7c740 20 client.7116 trim_cache size 0 max 16384 2024-04-25T02:12:49.321 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:12:49.321 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-04-25T02:12:49.321 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "c366be2a-2819-4767-8b9b-a97aecd4b2e8", 2024-04-25T02:12:49.321 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-04-25T02:12:49.321 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:12:49.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbdef63640 1 -- 172.21.15.79:0/4285908019 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdbc406be30 msgr2=0x7fdbc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbdef63640 1 --2- 172.21.15.79:0/4285908019 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdbc406be30 0x7fdbc406e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80011e0 tx=0x7fdbc8009040 comp rx=0 tx=0).stop 2024-04-25T02:12:49.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbdef63640 1 -- 172.21.15.79:0/4285908019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd8151780 msgr2=0x7fdbd80caee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbdef63640 1 --2- 172.21.15.79:0/4285908019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd8151780 0x7fdbd80caee0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000cbe0 tx=0x7fdbd000a430 comp rx=0 tx=0).stop 2024-04-25T02:12:49.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbdef63640 1 -- 172.21.15.79:0/4285908019 shutdown_connections 2024-04-25T02:12:49.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbdef63640 1 --2- 172.21.15.79:0/4285908019 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdbc406be30 0x7fdbc406e2f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbdef63640 1 --2- 172.21.15.79:0/4285908019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd8151780 0x7fdbd80caee0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbdef63640 1 --2- 172.21.15.79:0/4285908019 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbd80b4e10 0x7fdbd814b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbdef63640 1 --2- 172.21.15.79:0/4285908019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbd806e290 0x7fdbd81efb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.308+0000 7fdbdef63640 1 -- 172.21.15.79:0/4285908019 >> 172.21.15.79:0/4285908019 conn(0x7fdbd806b4a0 msgr2=0x7fdbd815c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:49.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.309+0000 7fdbdef63640 1 -- 172.21.15.79:0/4285908019 shutdown_connections 2024-04-25T02:12:49.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.309+0000 7fdbdef63640 1 -- 172.21.15.79:0/4285908019 wait complete. 2024-04-25T02:12:49.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:49.326 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T02:12:49.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.418+0000 7f5491cbd640 1 Processor -- start 2024-04-25T02:12:49.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.418+0000 7f5491cbd640 1 -- start start 2024-04-25T02:12:49.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.419+0000 7f5491cbd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f548c06b2f0 0x7f548c06b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.419+0000 7f5491cbd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548c071cd0 con 0x7f548c155f00 2024-04-25T02:12:49.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.419+0000 7f5491cbd640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548c071fb0 con 0x7f548c0b41b0 2024-04-25T02:12:49.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.419+0000 7f5491cbd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f548c072290 con 0x7f548c06b2f0 2024-04-25T02:12:49.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.419+0000 7f548bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f548c155f00 0x7f548c156370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36888/0 (socket says 172.21.15.79:36888) 2024-04-25T02:12:49.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.419+0000 7f548bfff640 1 -- 172.21.15.79:0/481198741 learned_addr learned my addr 172.21.15.79:0/481198741 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:12:49.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.419+0000 7f548affd640 1 --2- 172.21.15.79:0/481198741 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f548c06b2f0 0x7f548c06b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.419+0000 7f548a7fc640 1 -- 172.21.15.79:0/481198741 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 660694722 0 0) 0x7f548c071cd0 con 0x7f548c155f00 2024-04-25T02:12:49.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.419+0000 7f548a7fc640 1 -- 172.21.15.79:0/481198741 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5474003520 con 0x7f548c155f00 2024-04-25T02:12:49.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.420+0000 7f548a7fc640 1 -- 172.21.15.79:0/481198741 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 903173005 0 0) 0x7f548c071fb0 con 0x7f548c0b41b0 2024-04-25T02:12:49.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.420+0000 7f548a7fc640 1 -- 172.21.15.79:0/481198741 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f548c071cd0 con 0x7f548c0b41b0 2024-04-25T02:12:49.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.420+0000 7f548a7fc640 1 -- 172.21.15.79:0/481198741 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1295723788 0 0) 0x7f5474003520 con 0x7f548c155f00 2024-04-25T02:12:49.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.420+0000 7f548affd640 1 -- 172.21.15.79:0/481198741 >> v1:172.21.15.189:6789/0 conn(0x7f548c0b41b0 legacy=0x7f548c1605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.420+0000 7f548affd640 1 -- 172.21.15.79:0/481198741 >> v1:172.21.15.79:6789/0 conn(0x7f548c155f00 legacy=0x7f548c156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.420+0000 7f548affd640 1 -- 172.21.15.79:0/481198741 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548c072570 con 0x7f548c06b2f0 2024-04-25T02:12:49.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.420+0000 7f548affd640 1 --2- 172.21.15.79:0/481198741 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f548c06b2f0 0x7f548c06b770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f54800097d0 tx=0x7f548002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1a370b25bec5c71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:49.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.421+0000 7f548a7fc640 1 -- 172.21.15.79:0/481198741 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5480037070 con 0x7f548c06b2f0 2024-04-25T02:12:49.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.421+0000 7f548a7fc640 1 -- 172.21.15.79:0/481198741 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f548002ac30 con 0x7f548c06b2f0 2024-04-25T02:12:49.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.421+0000 7f548a7fc640 1 -- 172.21.15.79:0/481198741 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54840019f0 con 0x7f548c06b2f0 2024-04-25T02:12:49.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.421+0000 7f5491cbd640 1 -- 172.21.15.79:0/481198741 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f548c06b2f0 msgr2=0x7f548c06b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.421+0000 7f5491cbd640 1 --2- 172.21.15.79:0/481198741 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f548c06b2f0 0x7f548c06b770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f54800097d0 tx=0x7f548002a1a0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.421+0000 7f5491cbd640 1 -- 172.21.15.79:0/481198741 shutdown_connections 2024-04-25T02:12:49.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.421+0000 7f5491cbd640 1 --2- 172.21.15.79:0/481198741 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f548c06b2f0 0x7f548c06b770 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.421+0000 7f5491cbd640 1 -- 172.21.15.79:0/481198741 >> 172.21.15.79:0/481198741 conn(0x7f548c0b1cd0 msgr2=0x7f548c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:49.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.421+0000 7f5491cbd640 1 -- 172.21.15.79:0/481198741 shutdown_connections 2024-04-25T02:12:49.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.421+0000 7f5491cbd640 1 -- 172.21.15.79:0/481198741 wait complete. 2024-04-25T02:12:49.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.422+0000 7f5491cbd640 1 Processor -- start 2024-04-25T02:12:49.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.423+0000 7f5491cbd640 1 -- start start 2024-04-25T02:12:49.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.423+0000 7f5491cbd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f548c06b2f0 0x7f548c1f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.423+0000 7f5491cbd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f548c0b41b0 0x7f548c1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.423+0000 7f5491cbd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f548c155f00 0x7f548c09aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.423+0000 7f5491cbd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f548c0cf4b0 con 0x7f548c155f00 2024-04-25T02:12:49.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.423+0000 7f5491cbd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f548c072d70 con 0x7f548c06b2f0 2024-04-25T02:12:49.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.423+0000 7f5491cbd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f548c15c870 con 0x7f548c0b41b0 2024-04-25T02:12:49.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.423+0000 7f548bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f548c155f00 0x7f548c09aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.423+0000 7f548bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f548c155f00 0x7f548c09aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46766/0 (socket says 172.21.15.79:46766) 2024-04-25T02:12:49.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.423+0000 7f548bfff640 1 -- 172.21.15.79:0/2051110456 learned_addr learned my addr 172.21.15.79:0/2051110456 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:49.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.424+0000 7f548affd640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f548c0b41b0 0x7f548c1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.424+0000 7f548b7fe640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f548c06b2f0 0x7f548c1f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.424+0000 7f548bfff640 1 -- 172.21.15.79:0/2051110456 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f548c0b41b0 msgr2=0x7f548c1537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.424+0000 7f548bfff640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f548c0b41b0 0x7f548c1537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.424+0000 7f548bfff640 1 -- 172.21.15.79:0/2051110456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f548c06b2f0 msgr2=0x7f548c1f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.424+0000 7f548bfff640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f548c06b2f0 0x7f548c1f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.424+0000 7f548bfff640 1 -- 172.21.15.79:0/2051110456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548c1f6550 con 0x7f548c155f00 2024-04-25T02:12:49.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.424+0000 7f548affd640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f548c0b41b0 0x7f548c1537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:49.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.424+0000 7f548b7fe640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f548c06b2f0 0x7f548c1f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:49.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.424+0000 7f548bfff640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f548c155f00 0x7f548c09aa70 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f548400cc90 tx=0x7f548400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:49.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.424+0000 7f5473fff640 1 -- 172.21.15.79:0/2051110456 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484012400 con 0x7f548c155f00 2024-04-25T02:12:49.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.424+0000 7f5473fff640 1 -- 172.21.15.79:0/2051110456 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54840125a0 con 0x7f548c155f00 2024-04-25T02:12:49.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.424+0000 7f5491cbd640 1 -- 172.21.15.79:0/2051110456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548c1f6830 con 0x7f548c155f00 2024-04-25T02:12:49.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.424+0000 7f5473fff640 1 -- 172.21.15.79:0/2051110456 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484012990 con 0x7f548c155f00 2024-04-25T02:12:49.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.424+0000 7f5491cbd640 1 -- 172.21.15.79:0/2051110456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f548c09c820 con 0x7f548c155f00 2024-04-25T02:12:49.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.426+0000 7f5473fff640 1 -- 172.21.15.79:0/2051110456 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5484012b30 con 0x7f548c155f00 2024-04-25T02:12:49.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.426+0000 7f5473fff640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f547806be30 0x7f547806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.426+0000 7f5473fff640 1 -- 172.21.15.79:0/2051110456 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f548408b680 con 0x7f548c155f00 2024-04-25T02:12:49.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.426+0000 7f548b7fe640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f547806be30 0x7f547806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.426+0000 7f548b7fe640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f547806be30 0x7f547806e2f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f547c0016b0 tx=0x7f547c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:49.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.427+0000 7f54949d0740 1 Processor -- start 2024-04-25T02:12:49.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.427+0000 7f54949d0740 1 -- start start 2024-04-25T02:12:49.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f54949d0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1bcd60 0x55753a1bd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f54949d0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1dab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f54949d0740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a192a40 0x55753a1d8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f54949d0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55753a0f66b0 con 0x55753a1da600 2024-04-25T02:12:49.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f54949d0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55753a09e880 con 0x55753a1bcd60 2024-04-25T02:12:49.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f54949d0740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55753a0f2670 con 0x55753a192a40 2024-04-25T02:12:49.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f548affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1dab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f548affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1dab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46778/0 (socket says 172.21.15.79:46778) 2024-04-25T02:12:49.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f548affd640 1 -- 172.21.15.79:0/2197375961 learned_addr learned my addr 172.21.15.79:0/2197375961 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:49.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f548affd640 1 -- 172.21.15.79:0/2197375961 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a192a40 msgr2=0x55753a1d8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f548affd640 1 --2- 172.21.15.79:0/2197375961 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a192a40 0x55753a1d8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f548b7fe640 1 --2- 172.21.15.79:0/2197375961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1bcd60 0x55753a1bd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f548affd640 1 -- 172.21.15.79:0/2197375961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1bcd60 msgr2=0x55753a1bd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f548affd640 1 --2- 172.21.15.79:0/2197375961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1bcd60 0x55753a1bd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f548affd640 1 -- 172.21.15.79:0/2197375961 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557539ed47d0 con 0x55753a1da600 2024-04-25T02:12:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f548b7fe640 1 --2- 172.21.15.79:0/2197375961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1bcd60 0x55753a1bd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f548affd640 1 --2- 172.21.15.79:0/2197375961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1dab50 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5480000c00 tx=0x7f548002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55372c0fddbac28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f54717fa640 1 -- 172.21.15.79:0/2197375961 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5480043070 con 0x55753a1da600 2024-04-25T02:12:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f54717fa640 1 -- 172.21.15.79:0/2197375961 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f548002ac30 con 0x55753a1da600 2024-04-25T02:12:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.428+0000 7f54717fa640 1 -- 172.21.15.79:0/2197375961 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5480037040 con 0x55753a1da600 2024-04-25T02:12:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.429+0000 7f54949d0740 1 -- 172.21.15.79:0/2197375961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 msgr2=0x55753a1dab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.429+0000 7f54949d0740 1 --2- 172.21.15.79:0/2197375961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1dab50 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5480000c00 tx=0x7f548002c000 comp rx=0 tx=0).stop 2024-04-25T02:12:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.429+0000 7f54949d0740 1 -- 172.21.15.79:0/2197375961 shutdown_connections 2024-04-25T02:12:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.429+0000 7f54949d0740 1 --2- 172.21.15.79:0/2197375961 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a192a40 0x55753a1d8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.429+0000 7f54949d0740 1 --2- 172.21.15.79:0/2197375961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1dab50 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.429+0000 7f54949d0740 1 --2- 172.21.15.79:0/2197375961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1bcd60 0x55753a1bd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.429+0000 7f54949d0740 1 -- 172.21.15.79:0/2197375961 >> 172.21.15.79:0/2197375961 conn(0x55753a18f600 msgr2=0x55753a1d7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.429+0000 7f54949d0740 1 -- 172.21.15.79:0/2197375961 shutdown_connections 2024-04-25T02:12:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.429+0000 7f54949d0740 1 -- 172.21.15.79:0/2197375961 wait complete. 2024-04-25T02:12:49.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.430+0000 7f54949d0740 1 -- start start 2024-04-25T02:12:49.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.430+0000 7f54949d0740 1 Processor -- start 2024-04-25T02:12:49.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.430+0000 7f54949d0740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a1bcd60 0x55753a1ec460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f54949d0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1b89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f54949d0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1b91b0 0x55753a1d8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f54949d0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55753a1937e0 con 0x55753a1da600 2024-04-25T02:12:49.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f54949d0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55753a0b1f50 con 0x55753a1b91b0 2024-04-25T02:12:49.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f54949d0740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55753a18d530 con 0x55753a1bcd60 2024-04-25T02:12:49.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f54949d0740 10 client.0 _ll_register_callbacks cb 0x55753a0ed000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:49.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f548affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1b89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f548affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1b89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46780/0 (socket says 172.21.15.79:46780) 2024-04-25T02:12:49.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f548affd640 1 -- 172.21.15.79:0/3615003598 learned_addr learned my addr 172.21.15.79:0/3615003598 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:49.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f548bfff640 1 --2- 172.21.15.79:0/3615003598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1b91b0 0x55753a1d8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f548b7fe640 1 --2- 172.21.15.79:0/3615003598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a1bcd60 0x55753a1ec460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f548affd640 1 -- 172.21.15.79:0/3615003598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a1bcd60 msgr2=0x55753a1ec460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f548affd640 1 --2- 172.21.15.79:0/3615003598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a1bcd60 0x55753a1ec460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f548affd640 1 -- 172.21.15.79:0/3615003598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1b91b0 msgr2=0x55753a1d8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f548affd640 1 --2- 172.21.15.79:0/3615003598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1b91b0 0x55753a1d8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f548affd640 1 -- 172.21.15.79:0/3615003598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557539e0a3f0 con 0x55753a1da600 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f548b7fe640 1 --2- 172.21.15.79:0/3615003598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a1bcd60 0x55753a1ec460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f548affd640 1 --2- 172.21.15.79:0/3615003598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1b89f0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5480006ce0 tx=0x7f5480004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cc3d112849add2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f546a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f546a7fc640 1 -- 172.21.15.79:0/3615003598 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5480043030 con 0x55753a1da600 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f546a7fc640 1 -- 172.21.15.79:0/3615003598 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f5480003820 con 0x55753a1da600 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f54949d0740 1 -- 172.21.15.79:0/3615003598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f548002ac30 con 0x55753a1da600 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f546a7fc640 1 -- 172.21.15.79:0/3615003598 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5480053050 con 0x55753a1da600 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f54949d0740 10 client.7128 fetch_fsmap learned FSMap version 39 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f54949d0740 1 -- 172.21.15.79:0/3615003598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x557539dca0f0 con 0x55753a1da600 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.431+0000 7f546a7fc640 1 -- 172.21.15.79:0/3615003598 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f548002ac30 con 0x55753a1da600 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.432+0000 7f546a7fc640 1 -- 172.21.15.79:0/3615003598 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f5480056020 con 0x55753a1da600 2024-04-25T02:12:49.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.432+0000 7f54949d0740 10 client.7128 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T02:12:49.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.432+0000 7f54949d0740 10 client.7128 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T02:12:49.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.432+0000 7f54949d0740 20 client.7128 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:49.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.432+0000 7f54949d0740 1 --2- 172.21.15.79:0/3615003598 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55753a1cfc10 0x55753a1cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.432+0000 7f54949d0740 4 client.7128 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:49.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.432+0000 7f54949d0740 1 -- 172.21.15.79:0/3615003598 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55753a103bf0 con 0x55753a1cfc10 2024-04-25T02:12:49.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.432+0000 7f548b7fe640 1 --2- 172.21.15.79:0/3615003598 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55753a1cfc10 0x55753a1cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.432+0000 7f548b7fe640 1 --2- 172.21.15.79:0/3615003598 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55753a1cfc10 0x55753a1cfff0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fc0ef38e830ba4b server_cookie=ce8427905275c598 in_seq=0 out_seq=0 2024-04-25T02:12:49.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.432+0000 7f546a7fc640 10 client.7128 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:49.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.432+0000 7f546a7fc640 1 -- 172.21.15.79:0/3615003598 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55753a103bf0 con 0x55753a1cfc10 2024-04-25T02:12:49.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.432+0000 7f546a7fc640 10 client.7128 handle_command_reply: tid=0 2024-04-25T02:12:49.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.432+0000 7f54949d0740 1 client.7128 shutdown 2024-04-25T02:12:49.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.433+0000 7f54949d0740 1 -- 172.21.15.79:0/3615003598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 msgr2=0x55753a1b89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.433+0000 7f54949d0740 1 --2- 172.21.15.79:0/3615003598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1b89f0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5480006ce0 tx=0x7f5480004730 comp rx=0 tx=0).stop 2024-04-25T02:12:49.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.433+0000 7f54949d0740 1 -- 172.21.15.79:0/3615003598 shutdown_connections 2024-04-25T02:12:49.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.433+0000 7f54949d0740 1 --2- 172.21.15.79:0/3615003598 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55753a1cfc10 0x55753a1cfff0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.433+0000 7f54949d0740 1 --2- 172.21.15.79:0/3615003598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1b91b0 0x55753a1d8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.433+0000 7f54949d0740 1 --2- 172.21.15.79:0/3615003598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1b89f0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.433+0000 7f546a7fc640 0 client.7128 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:49.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.433+0000 7f54949d0740 1 --2- 172.21.15.79:0/3615003598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a1bcd60 0x55753a1ec460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.433+0000 7f54949d0740 1 -- 172.21.15.79:0/3615003598 >> 172.21.15.79:0/3615003598 conn(0x55753a192a40 msgr2=0x55753a18c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:49.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.433+0000 7f54949d0740 1 -- 172.21.15.79:0/3615003598 shutdown_connections 2024-04-25T02:12:49.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.433+0000 7f54949d0740 1 -- 172.21.15.79:0/3615003598 wait complete. 2024-04-25T02:12:49.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.433+0000 7f54949d0740 20 client.7128 trim_cache size 0 max 16384 2024-04-25T02:12:49.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.450+0000 7f54949d0740 1 Processor -- start 2024-04-25T02:12:49.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.450+0000 7f54949d0740 1 -- start start 2024-04-25T02:12:49.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f54949d0740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a1b91b0 0x55753a1d7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f54949d0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1bcd60 0x55753a1bbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f54949d0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1bc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f54949d0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f548c1fe640 con 0x55753a1da600 2024-04-25T02:12:49.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f54949d0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f548c15a750 con 0x55753a1bcd60 2024-04-25T02:12:49.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f54949d0740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f548c09d4f0 con 0x55753a1b91b0 2024-04-25T02:12:49.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f548bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f548bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1bc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46796/0 (socket says 172.21.15.79:46796) 2024-04-25T02:12:49.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f548bfff640 1 -- 172.21.15.79:0/147992856 learned_addr learned my addr 172.21.15.79:0/147992856 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f548bfff640 1 -- 172.21.15.79:0/147992856 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a1b91b0 msgr2=0x55753a1d7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f548bfff640 1 --2- 172.21.15.79:0/147992856 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a1b91b0 0x55753a1d7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f548bfff640 1 -- 172.21.15.79:0/147992856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1bcd60 msgr2=0x55753a1bbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f548bfff640 1 --2- 172.21.15.79:0/147992856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1bcd60 0x55753a1bbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f548bfff640 1 -- 172.21.15.79:0/147992856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55753a0c3ec0 con 0x55753a1da600 2024-04-25T02:12:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f548bfff640 1 --2- 172.21.15.79:0/147992856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1bc040 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f54840598c0 tx=0x7f5484059350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654211fe144fdd88 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f5470ff9640 1 -- 172.21.15.79:0/147992856 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548405a030 con 0x55753a1da600 2024-04-25T02:12:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f5470ff9640 1 -- 172.21.15.79:0/147992856 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5484059930 con 0x55753a1da600 2024-04-25T02:12:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.451+0000 7f5470ff9640 1 -- 172.21.15.79:0/147992856 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548405dce0 con 0x55753a1da600 2024-04-25T02:12:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.452+0000 7f54949d0740 1 -- 172.21.15.79:0/147992856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 msgr2=0x55753a1bc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.452+0000 7f54949d0740 1 --2- 172.21.15.79:0/147992856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1bc040 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f54840598c0 tx=0x7f5484059350 comp rx=0 tx=0).stop 2024-04-25T02:12:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.452+0000 7f54949d0740 1 -- 172.21.15.79:0/147992856 shutdown_connections 2024-04-25T02:12:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.452+0000 7f54949d0740 1 --2- 172.21.15.79:0/147992856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1da600 0x55753a1bc040 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.452+0000 7f54949d0740 1 --2- 172.21.15.79:0/147992856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1bcd60 0x55753a1bbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.452+0000 7f54949d0740 1 --2- 172.21.15.79:0/147992856 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a1b91b0 0x55753a1d7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.452+0000 7f54949d0740 1 -- 172.21.15.79:0/147992856 >> 172.21.15.79:0/147992856 conn(0x55753a192a40 msgr2=0x55753a18fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.452+0000 7f54949d0740 1 -- 172.21.15.79:0/147992856 shutdown_connections 2024-04-25T02:12:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.452+0000 7f54949d0740 1 -- 172.21.15.79:0/147992856 wait complete. 2024-04-25T02:12:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.453+0000 7f54949d0740 1 -- start start 2024-04-25T02:12:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.453+0000 7f54949d0740 1 Processor -- start 2024-04-25T02:12:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.453+0000 7f54949d0740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a1b91b0 0x55753a24c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.453+0000 7f54949d0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1bcd60 0x55753a18c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.453+0000 7f54949d0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1da600 0x55753a18c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.453+0000 7f54949d0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f548c15a100 con 0x55753a1bcd60 2024-04-25T02:12:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.453+0000 7f54949d0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55753a07c490 con 0x55753a1da600 2024-04-25T02:12:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.453+0000 7f54949d0740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55753a2543c0 con 0x55753a1b91b0 2024-04-25T02:12:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f54949d0740 10 client.0 _ll_register_callbacks cb 0x7f5480041070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f548affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1bcd60 0x55753a18c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f548affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1bcd60 0x55753a18c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46808/0 (socket says 172.21.15.79:46808) 2024-04-25T02:12:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f548affd640 1 -- 172.21.15.79:0/2376859004 learned_addr learned my addr 172.21.15.79:0/2376859004 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:12:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f548b7fe640 1 --2- 172.21.15.79:0/2376859004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a1b91b0 0x55753a24c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f548bfff640 1 --2- 172.21.15.79:0/2376859004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1da600 0x55753a18c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f548affd640 1 -- 172.21.15.79:0/2376859004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a1b91b0 msgr2=0x55753a24c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f548affd640 1 --2- 172.21.15.79:0/2376859004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a1b91b0 0x55753a24c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f548affd640 1 -- 172.21.15.79:0/2376859004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1da600 msgr2=0x55753a18c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f548affd640 1 --2- 172.21.15.79:0/2376859004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1da600 0x55753a18c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f548affd640 1 -- 172.21.15.79:0/2376859004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55753a18ce30 con 0x55753a1bcd60 2024-04-25T02:12:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f548affd640 1 --2- 172.21.15.79:0/2376859004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1bcd60 0x55753a18c260 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f5480009720 tx=0x7f54800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdf3dff134530e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f546a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:12:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f546a7fc640 1 -- 172.21.15.79:0/2376859004 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5480043070 con 0x55753a1bcd60 2024-04-25T02:12:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f546a7fc640 1 -- 172.21.15.79:0/2376859004 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f5480032980 con 0x55753a1bcd60 2024-04-25T02:12:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f54949d0740 1 -- 172.21.15.79:0/2376859004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5484059930 con 0x55753a1bcd60 2024-04-25T02:12:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f546a7fc640 1 -- 172.21.15.79:0/2376859004 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f548005e050 con 0x55753a1bcd60 2024-04-25T02:12:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f54949d0740 10 client.7134 fetch_fsmap learned FSMap version 39 2024-04-25T02:12:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f54949d0740 1 -- 172.21.15.79:0/2376859004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55753a1d0ff0 con 0x55753a1bcd60 2024-04-25T02:12:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f546a7fc640 1 -- 172.21.15.79:0/2376859004 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5484059930 con 0x55753a1bcd60 2024-04-25T02:12:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f546a7fc640 1 -- 172.21.15.79:0/2376859004 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f5480061020 con 0x55753a1bcd60 2024-04-25T02:12:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f54949d0740 10 client.7134 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T02:12:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f54949d0740 10 client.7134 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T02:12:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f54949d0740 20 client.7134 populate_metadata read hostname 'smithi079' 2024-04-25T02:12:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.454+0000 7f54949d0740 1 --2- 172.21.15.79:0/2376859004 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55753a1d0080 0x55753a253190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f54949d0740 4 client.7134 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:12:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f54949d0740 1 -- 172.21.15.79:0/2376859004 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55753a0fdf40 con 0x55753a1d0080 2024-04-25T02:12:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f548b7fe640 1 --2- 172.21.15.79:0/2376859004 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55753a1d0080 0x55753a253190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f546a7fc640 10 client.7134 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f548b7fe640 1 --2- 172.21.15.79:0/2376859004 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55753a1d0080 0x55753a253190 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76cd879003c9a1bb server_cookie=9087f53659ca250d in_seq=0 out_seq=0 2024-04-25T02:12:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f546a7fc640 1 -- 172.21.15.79:0/2376859004 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x55753a0fdf40 con 0x55753a1d0080 2024-04-25T02:12:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f546a7fc640 10 client.7134 handle_command_reply: tid=0 2024-04-25T02:12:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f54949d0740 1 client.7134 shutdown 2024-04-25T02:12:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f54949d0740 1 -- 172.21.15.79:0/2376859004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1bcd60 msgr2=0x55753a18c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f54949d0740 1 --2- 172.21.15.79:0/2376859004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1bcd60 0x55753a18c260 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f5480009720 tx=0x7f54800046c0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f54949d0740 1 -- 172.21.15.79:0/2376859004 shutdown_connections 2024-04-25T02:12:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f54949d0740 1 --2- 172.21.15.79:0/2376859004 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55753a1d0080 0x55753a253190 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f54949d0740 1 --2- 172.21.15.79:0/2376859004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55753a1da600 0x55753a18c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f54949d0740 1 --2- 172.21.15.79:0/2376859004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55753a1bcd60 0x55753a18c260 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f546a7fc640 0 client.7134 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:12:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f54949d0740 1 --2- 172.21.15.79:0/2376859004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55753a1b91b0 0x55753a24c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f54949d0740 1 -- 172.21.15.79:0/2376859004 >> 172.21.15.79:0/2376859004 conn(0x55753a192a40 msgr2=0x55753a1fc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f54949d0740 1 -- 172.21.15.79:0/2376859004 shutdown_connections 2024-04-25T02:12:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f54949d0740 1 -- 172.21.15.79:0/2376859004 wait complete. 2024-04-25T02:12:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.455+0000 7f54949d0740 20 client.7134 trim_cache size 0 max 16384 2024-04-25T02:12:49.468 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:12:49.468 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T02:12:49.468 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-04-25T02:12:49.468 INFO:teuthology.orchestra.run.smithi079.stdout: "c366be2a-2819-4767-8b9b-a97aecd4b2e8": { 2024-04-25T02:12:49.468 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/subdir", 2024-04-25T02:12:49.469 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "c366be2a-2819-4767-8b9b-a97aecd4b2e8", 2024-04-25T02:12:49.469 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,repair" 2024-04-25T02:12:49.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:12:49.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:12:49.469 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:12:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.456+0000 7f5491cbd640 1 -- 172.21.15.79:0/2051110456 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f547806be30 msgr2=0x7f547806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.456+0000 7f5491cbd640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f547806be30 0x7f547806e2f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f547c0016b0 tx=0x7f547c009040 comp rx=0 tx=0).stop 2024-04-25T02:12:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.456+0000 7f5491cbd640 1 -- 172.21.15.79:0/2051110456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f548c155f00 msgr2=0x7f548c09aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.456+0000 7f5491cbd640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f548c155f00 0x7f548c09aa70 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f548400cc90 tx=0x7f548400a430 comp rx=0 tx=0).stop 2024-04-25T02:12:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.456+0000 7f5491cbd640 1 -- 172.21.15.79:0/2051110456 shutdown_connections 2024-04-25T02:12:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.456+0000 7f5491cbd640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f547806be30 0x7f547806e2f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.456+0000 7f5491cbd640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f548c155f00 0x7f548c09aa70 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.456+0000 7f5491cbd640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f548c0b41b0 0x7f548c1537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.456+0000 7f5491cbd640 1 --2- 172.21.15.79:0/2051110456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f548c06b2f0 0x7f548c1f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.456+0000 7f5491cbd640 1 -- 172.21.15.79:0/2051110456 >> 172.21.15.79:0/2051110456 conn(0x7f548c0b1cd0 msgr2=0x7f548c0b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.456+0000 7f5491cbd640 1 -- 172.21.15.79:0/2051110456 shutdown_connections 2024-04-25T02:12:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:12:49.456+0000 7f5491cbd640 1 -- 172.21.15.79:0/2051110456 wait complete. 2024-04-25T02:12:49.473 INFO:tasks.cephfs.filesystem:scrub status for tag:c366be2a-2819-4767-8b9b-a97aecd4b2e8 - {'path': '/subdir', 'tag': 'c366be2a-2819-4767-8b9b-a97aecd4b2e8', 'options': 'recursive,repair'} 2024-04-25T02:13:00.531 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:13:00.534 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:13:19.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:19.475 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T02:13:19.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.578+0000 7f2dbab42640 1 Processor -- start 2024-04-25T02:13:19.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.579+0000 7f2dbab42640 1 -- start start 2024-04-25T02:13:19.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.579+0000 7f2dbab42640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2db415e4f0 0x7f2db40d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.579+0000 7f2dbab42640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2db40cf7f0 0x7f2db40d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.579+0000 7f2dbab42640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2db40d1ee0 con 0x7f2db40cfc50 2024-04-25T02:13:19.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.579+0000 7f2dbab42640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2db40d21c0 con 0x7f2db40cf7f0 2024-04-25T02:13:19.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.579+0000 7f2dbab42640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2db40d24a0 con 0x7f2db415e4f0 2024-04-25T02:13:19.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.580+0000 7f2db3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2db40cf7f0 0x7f2db40d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.580+0000 7f2db90df640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2db40cfc50 0x7f2db406bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60558/0 (socket says 172.21.15.79:60558) 2024-04-25T02:13:19.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.580+0000 7f2db90df640 1 -- 172.21.15.79:0/3128555618 learned_addr learned my addr 172.21.15.79:0/3128555618 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:19.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.580+0000 7f2db88de640 1 --2- 172.21.15.79:0/3128555618 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2db415e4f0 0x7f2db40d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.580+0000 7f2db3fff640 1 -- 172.21.15.79:0/3128555618 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2db415e4f0 msgr2=0x7f2db40d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.580+0000 7f2db3fff640 1 --2- 172.21.15.79:0/3128555618 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2db415e4f0 0x7f2db40d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.580+0000 7f2db3fff640 1 -- 172.21.15.79:0/3128555618 >> v1:172.21.15.79:6789/0 conn(0x7f2db40cfc50 legacy=0x7f2db406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.580+0000 7f2db3fff640 1 -- 172.21.15.79:0/3128555618 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db40d2780 con 0x7f2db40cf7f0 2024-04-25T02:13:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.580+0000 7f2db37fe640 1 -- 172.21.15.79:0/3128555618 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786631317 0 0) 0x7f2db40d1ee0 con 0x7f2db40cfc50 2024-04-25T02:13:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.581+0000 7f2db3fff640 1 --2- 172.21.15.79:0/3128555618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2db40cf7f0 0x7f2db40d09b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f2da80097d0 tx=0x7f2da802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485449c70a1f7950 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.581+0000 7f2db37fe640 1 -- 172.21.15.79:0/3128555618 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8037070 con 0x7f2db40cf7f0 2024-04-25T02:13:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.581+0000 7f2db37fe640 1 -- 172.21.15.79:0/3128555618 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da8032440 con 0x7f2db40cf7f0 2024-04-25T02:13:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.581+0000 7f2db37fe640 1 -- 172.21.15.79:0/3128555618 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8032810 con 0x7f2db40cf7f0 2024-04-25T02:13:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.581+0000 7f2dbab42640 1 -- 172.21.15.79:0/3128555618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2db40cf7f0 msgr2=0x7f2db40d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.581+0000 7f2dbab42640 1 --2- 172.21.15.79:0/3128555618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2db40cf7f0 0x7f2db40d09b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f2da80097d0 tx=0x7f2da802a1c0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.581+0000 7f2dbab42640 1 -- 172.21.15.79:0/3128555618 shutdown_connections 2024-04-25T02:13:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.581+0000 7f2dbab42640 1 --2- 172.21.15.79:0/3128555618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2db40cf7f0 0x7f2db40d09b0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.581+0000 7f2dbab42640 1 --2- 172.21.15.79:0/3128555618 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2db415e4f0 0x7f2db40d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.581+0000 7f2dbab42640 1 -- 172.21.15.79:0/3128555618 >> 172.21.15.79:0/3128555618 conn(0x7f2db409d4a0 msgr2=0x7f2db40d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.581+0000 7f2dbab42640 1 -- 172.21.15.79:0/3128555618 shutdown_connections 2024-04-25T02:13:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.581+0000 7f2dbab42640 1 -- 172.21.15.79:0/3128555618 wait complete. 2024-04-25T02:13:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.583+0000 7f2dbab42640 1 Processor -- start 2024-04-25T02:13:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.583+0000 7f2dbab42640 1 -- start start 2024-04-25T02:13:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.583+0000 7f2dbab42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2db40cf7f0 0x7f2db4155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.583+0000 7f2dbab42640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2db40cfc50 0x7f2db40b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.583+0000 7f2dbab42640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2db415e4f0 0x7f2db40b8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.583+0000 7f2dbab42640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2db40d0ef0 con 0x7f2db40cf7f0 2024-04-25T02:13:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.583+0000 7f2dbab42640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2db40d50f0 con 0x7f2db40cfc50 2024-04-25T02:13:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.583+0000 7f2dbab42640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2db40d1070 con 0x7f2db415e4f0 2024-04-25T02:13:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2db88de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2db40cf7f0 0x7f2db4155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2db88de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2db40cf7f0 0x7f2db4155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41338/0 (socket says 172.21.15.79:41338) 2024-04-25T02:13:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2db88de640 1 -- 172.21.15.79:0/1405068787 learned_addr learned my addr 172.21.15.79:0/1405068787 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2db3fff640 1 --2- 172.21.15.79:0/1405068787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2db40cfc50 0x7f2db40b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2db88de640 1 -- 172.21.15.79:0/1405068787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2db415e4f0 msgr2=0x7f2db40b8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2db90df640 1 --2- 172.21.15.79:0/1405068787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2db415e4f0 0x7f2db40b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2db88de640 1 --2- 172.21.15.79:0/1405068787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2db415e4f0 0x7f2db40b8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2db88de640 1 -- 172.21.15.79:0/1405068787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2db40cfc50 msgr2=0x7f2db40b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2db88de640 1 --2- 172.21.15.79:0/1405068787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2db40cfc50 0x7f2db40b7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2db88de640 1 -- 172.21.15.79:0/1405068787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db40cb3e0 con 0x7f2db40cf7f0 2024-04-25T02:13:19.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2db3fff640 1 --2- 172.21.15.79:0/1405068787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2db40cfc50 0x7f2db40b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:19.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2db88de640 1 --2- 172.21.15.79:0/1405068787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2db40cf7f0 0x7f2db4155360 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f2da400d620 tx=0x7f2da400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:19.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2db17fa640 1 -- 172.21.15.79:0/1405068787 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da400b620 con 0x7f2db40cf7f0 2024-04-25T02:13:19.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2db17fa640 1 -- 172.21.15.79:0/1405068787 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da4019070 con 0x7f2db40cf7f0 2024-04-25T02:13:19.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2dbab42640 1 -- 172.21.15.79:0/1405068787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db40cb6c0 con 0x7f2db40cf7f0 2024-04-25T02:13:19.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2db17fa640 1 -- 172.21.15.79:0/1405068787 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da400ba00 con 0x7f2db40cf7f0 2024-04-25T02:13:19.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.584+0000 7f2dbab42640 1 -- 172.21.15.79:0/1405068787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db40cbc80 con 0x7f2db40cf7f0 2024-04-25T02:13:19.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.586+0000 7f2db17fa640 1 -- 172.21.15.79:0/1405068787 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2da400bba0 con 0x7f2db40cf7f0 2024-04-25T02:13:19.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.586+0000 7f2db17fa640 1 --2- 172.21.15.79:0/1405068787 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2da006be30 0x7f2da006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.587+0000 7f2db17fa640 1 -- 172.21.15.79:0/1405068787 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f2da408b3b0 con 0x7f2db40cf7f0 2024-04-25T02:13:19.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.587+0000 7f2db3fff640 1 --2- 172.21.15.79:0/1405068787 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2da006be30 0x7f2da006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.587+0000 7f2db3fff640 1 --2- 172.21.15.79:0/1405068787 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2da006be30 0x7f2da006e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2da8034000 tx=0x7f2da802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.587+0000 7f2dbd850740 1 Processor -- start 2024-04-25T02:13:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.587+0000 7f2dbd850740 1 -- start start 2024-04-25T02:13:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2dbd850740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598d2d60 0x55cd598d3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2dbd850740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598f0600 0x55cd598f0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2dbd850740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598a8a40 0x55cd598eecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2dbd850740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cd5980c6b0 con 0x55cd598f0600 2024-04-25T02:13:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2dbd850740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cd597b4880 con 0x55cd598d2d60 2024-04-25T02:13:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2dbd850740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55cd59808670 con 0x55cd598a8a40 2024-04-25T02:13:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2db3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598f0600 0x55cd598f0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2db3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598f0600 0x55cd598f0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41352/0 (socket says 172.21.15.79:41352) 2024-04-25T02:13:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2db3fff640 1 -- 172.21.15.79:0/2945149249 learned_addr learned my addr 172.21.15.79:0/2945149249 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2db88de640 1 --2- 172.21.15.79:0/2945149249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598d2d60 0x55cd598d3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2db90df640 1 --2- 172.21.15.79:0/2945149249 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598a8a40 0x55cd598eecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2db3fff640 1 -- 172.21.15.79:0/2945149249 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598a8a40 msgr2=0x55cd598eecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2db3fff640 1 --2- 172.21.15.79:0/2945149249 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598a8a40 0x55cd598eecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2db3fff640 1 -- 172.21.15.79:0/2945149249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598d2d60 msgr2=0x55cd598d3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2db3fff640 1 --2- 172.21.15.79:0/2945149249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598d2d60 0x55cd598d3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2db3fff640 1 -- 172.21.15.79:0/2945149249 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd595ea7d0 con 0x55cd598f0600 2024-04-25T02:13:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.588+0000 7f2db88de640 1 --2- 172.21.15.79:0/2945149249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598d2d60 0x55cd598d3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.589+0000 7f2db3fff640 1 --2- 172.21.15.79:0/2945149249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598f0600 0x55cd598f0b50 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f2da8035040 tx=0x7f2da802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f220546b888f3412 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.589+0000 7f2d9a7fc640 1 -- 172.21.15.79:0/2945149249 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da804d070 con 0x55cd598f0600 2024-04-25T02:13:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.589+0000 7f2d9a7fc640 1 -- 172.21.15.79:0/2945149249 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da8048470 con 0x55cd598f0600 2024-04-25T02:13:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.589+0000 7f2d9a7fc640 1 -- 172.21.15.79:0/2945149249 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8037040 con 0x55cd598f0600 2024-04-25T02:13:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.589+0000 7f2dbd850740 1 -- 172.21.15.79:0/2945149249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598f0600 msgr2=0x55cd598f0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.589+0000 7f2dbd850740 1 --2- 172.21.15.79:0/2945149249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598f0600 0x55cd598f0b50 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f2da8035040 tx=0x7f2da802c000 comp rx=0 tx=0).stop 2024-04-25T02:13:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.589+0000 7f2dbd850740 1 -- 172.21.15.79:0/2945149249 shutdown_connections 2024-04-25T02:13:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.589+0000 7f2dbd850740 1 --2- 172.21.15.79:0/2945149249 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598a8a40 0x55cd598eecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.589+0000 7f2dbd850740 1 --2- 172.21.15.79:0/2945149249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598f0600 0x55cd598f0b50 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.589+0000 7f2dbd850740 1 --2- 172.21.15.79:0/2945149249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598d2d60 0x55cd598d3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.589+0000 7f2dbd850740 1 -- 172.21.15.79:0/2945149249 >> 172.21.15.79:0/2945149249 conn(0x55cd598a5600 msgr2=0x55cd598edb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:19.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.589+0000 7f2dbd850740 1 -- 172.21.15.79:0/2945149249 shutdown_connections 2024-04-25T02:13:19.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.589+0000 7f2dbd850740 1 -- 172.21.15.79:0/2945149249 wait complete. 2024-04-25T02:13:19.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.590+0000 7f2dbd850740 1 -- start start 2024-04-25T02:13:19.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.590+0000 7f2dbd850740 1 Processor -- start 2024-04-25T02:13:19.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2dbd850740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598d2d60 0x55cd598e6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2dbd850740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598f0600 0x55cd598cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2dbd850740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598cf790 0x55cd598d6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2dbd850740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cd598a97e0 con 0x55cd598f0600 2024-04-25T02:13:19.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2dbd850740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cd597c7f50 con 0x55cd598cf790 2024-04-25T02:13:19.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2dbd850740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55cd598a3530 con 0x55cd598d2d60 2024-04-25T02:13:19.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2dbd850740 10 client.0 _ll_register_callbacks cb 0x55cd59803000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:13:19.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2db3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598f0600 0x55cd598cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2db3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598f0600 0x55cd598cead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41358/0 (socket says 172.21.15.79:41358) 2024-04-25T02:13:19.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2db3fff640 1 -- 172.21.15.79:0/3504648408 learned_addr learned my addr 172.21.15.79:0/3504648408 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:19.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2db3fff640 1 -- 172.21.15.79:0/3504648408 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598d2d60 msgr2=0x55cd598e6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:19.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2db3fff640 1 --2- 172.21.15.79:0/3504648408 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598d2d60 0x55cd598e6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2db3fff640 1 -- 172.21.15.79:0/3504648408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598cf790 msgr2=0x55cd598d6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:19.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2db3fff640 1 --2- 172.21.15.79:0/3504648408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598cf790 0x55cd598d6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2db3fff640 1 -- 172.21.15.79:0/3504648408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd595203f0 con 0x55cd598f0600 2024-04-25T02:13:19.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2db3fff640 1 --2- 172.21.15.79:0/3504648408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598f0600 0x55cd598cead0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f2da80098f0 tx=0x7f2da8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427fba9695683dd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:19.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.591+0000 7f2d937fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:13:19.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2d937fe640 1 -- 172.21.15.79:0/3504648408 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da804d030 con 0x55cd598f0600 2024-04-25T02:13:19.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2d937fe640 1 -- 172.21.15.79:0/3504648408 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f2da8048830 con 0x55cd598f0600 2024-04-25T02:13:19.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2dbd850740 1 -- 172.21.15.79:0/3504648408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2da8048470 con 0x55cd598f0600 2024-04-25T02:13:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2d937fe640 1 -- 172.21.15.79:0/3504648408 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f2da8037070 con 0x55cd598f0600 2024-04-25T02:13:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2dbd850740 10 client.7149 fetch_fsmap learned FSMap version 40 2024-04-25T02:13:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2dbd850740 1 -- 172.21.15.79:0/3504648408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x55cd594e00f0 con 0x55cd598f0600 2024-04-25T02:13:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2d937fe640 1 -- 172.21.15.79:0/3504648408 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da8048470 con 0x55cd598f0600 2024-04-25T02:13:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2d937fe640 1 -- 172.21.15.79:0/3504648408 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f2da8048a30 con 0x55cd598f0600 2024-04-25T02:13:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2dbd850740 10 client.7149 fetch_fsmap finished waiting for FSMap version 40 2024-04-25T02:13:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2dbd850740 10 client.7149 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T02:13:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2dbd850740 20 client.7149 populate_metadata read hostname 'smithi079' 2024-04-25T02:13:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2dbd850740 1 --2- 172.21.15.79:0/3504648408 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55cd598d1840 0x55cd598d3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2dbd850740 4 client.7149 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:13:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2dbd850740 1 -- 172.21.15.79:0/3504648408 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd59819bf0 con 0x55cd598d1840 2024-04-25T02:13:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2db88de640 1 --2- 172.21.15.79:0/3504648408 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55cd598d1840 0x55cd598d3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2d937fe640 10 client.7149 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:13:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.592+0000 7f2db88de640 1 --2- 172.21.15.79:0/3504648408 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55cd598d1840 0x55cd598d3d10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43d40aab9cc2243f server_cookie=55ad339fe57d2abb in_seq=0 out_seq=0 2024-04-25T02:13:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.593+0000 7f2d937fe640 1 -- 172.21.15.79:0/3504648408 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cd59819bf0 con 0x55cd598d1840 2024-04-25T02:13:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.593+0000 7f2d937fe640 10 client.7149 handle_command_reply: tid=0 2024-04-25T02:13:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.593+0000 7f2dbd850740 1 client.7149 shutdown 2024-04-25T02:13:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.593+0000 7f2dbd850740 1 -- 172.21.15.79:0/3504648408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598f0600 msgr2=0x55cd598cead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.593+0000 7f2dbd850740 1 --2- 172.21.15.79:0/3504648408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598f0600 0x55cd598cead0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f2da80098f0 tx=0x7f2da8004730 comp rx=0 tx=0).stop 2024-04-25T02:13:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.593+0000 7f2dbd850740 1 -- 172.21.15.79:0/3504648408 shutdown_connections 2024-04-25T02:13:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.593+0000 7f2dbd850740 1 --2- 172.21.15.79:0/3504648408 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55cd598d1840 0x55cd598d3d10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.593+0000 7f2dbd850740 1 --2- 172.21.15.79:0/3504648408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598cf790 0x55cd598d6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.593+0000 7f2dbd850740 1 --2- 172.21.15.79:0/3504648408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598f0600 0x55cd598cead0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.593+0000 7f2d937fe640 0 client.7149 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:13:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.593+0000 7f2dbd850740 1 --2- 172.21.15.79:0/3504648408 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598d2d60 0x55cd598e6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.593+0000 7f2dbd850740 1 -- 172.21.15.79:0/3504648408 >> 172.21.15.79:0/3504648408 conn(0x55cd598a8a40 msgr2=0x55cd598f10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.593+0000 7f2dbd850740 1 -- 172.21.15.79:0/3504648408 shutdown_connections 2024-04-25T02:13:19.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.593+0000 7f2dbd850740 1 -- 172.21.15.79:0/3504648408 wait complete. 2024-04-25T02:13:19.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.593+0000 7f2dbd850740 20 client.7149 trim_cache size 0 max 16384 2024-04-25T02:13:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.611+0000 7f2dbd850740 1 Processor -- start 2024-04-25T02:13:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.611+0000 7f2dbd850740 1 -- start start 2024-04-25T02:13:19.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.611+0000 7f2dbd850740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598cf790 0x55cd598ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.611+0000 7f2dbd850740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598d2d60 0x55cd59908310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.611+0000 7f2dbd850740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598f0600 0x55cd598edb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.611+0000 7f2dbd850740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2db4200780 con 0x55cd598d2d60 2024-04-25T02:13:19.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.611+0000 7f2dbd850740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2db41ff760 con 0x55cd598f0600 2024-04-25T02:13:19.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.611+0000 7f2dbd850740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2db41fead0 con 0x55cd598cf790 2024-04-25T02:13:19.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.611+0000 7f2db3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598d2d60 0x55cd59908310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.611+0000 7f2db3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598d2d60 0x55cd59908310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41374/0 (socket says 172.21.15.79:41374) 2024-04-25T02:13:19.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.611+0000 7f2db3fff640 1 -- 172.21.15.79:0/419815288 learned_addr learned my addr 172.21.15.79:0/419815288 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:19.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.612+0000 7f2db88de640 1 --2- 172.21.15.79:0/419815288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598cf790 0x55cd598ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.612+0000 7f2db90df640 1 --2- 172.21.15.79:0/419815288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598f0600 0x55cd598edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.612+0000 7f2db3fff640 1 -- 172.21.15.79:0/419815288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598cf790 msgr2=0x55cd598ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:19.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.612+0000 7f2db3fff640 1 --2- 172.21.15.79:0/419815288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598cf790 0x55cd598ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.612+0000 7f2db3fff640 1 -- 172.21.15.79:0/419815288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598f0600 msgr2=0x55cd598edb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:19.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.612+0000 7f2db3fff640 1 --2- 172.21.15.79:0/419815288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598f0600 0x55cd598edb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.612+0000 7f2db3fff640 1 -- 172.21.15.79:0/419815288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd598d34b0 con 0x55cd598d2d60 2024-04-25T02:13:19.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.612+0000 7f2db3fff640 1 --2- 172.21.15.79:0/419815288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598d2d60 0x55cd59908310 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f2da8006b60 tx=0x7f2da8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d224950d7a3cdc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:19.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.612+0000 7f2d99ffb640 1 -- 172.21.15.79:0/419815288 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da804d070 con 0x55cd598d2d60 2024-04-25T02:13:19.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.612+0000 7f2d99ffb640 1 -- 172.21.15.79:0/419815288 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da804f070 con 0x55cd598d2d60 2024-04-25T02:13:19.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.612+0000 7f2d99ffb640 1 -- 172.21.15.79:0/419815288 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8032e60 con 0x55cd598d2d60 2024-04-25T02:13:19.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.612+0000 7f2dbd850740 1 -- 172.21.15.79:0/419815288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598d2d60 msgr2=0x55cd59908310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.612+0000 7f2dbd850740 1 --2- 172.21.15.79:0/419815288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598d2d60 0x55cd59908310 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f2da8006b60 tx=0x7f2da8037000 comp rx=0 tx=0).stop 2024-04-25T02:13:19.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.613+0000 7f2dbd850740 1 -- 172.21.15.79:0/419815288 shutdown_connections 2024-04-25T02:13:19.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.613+0000 7f2dbd850740 1 --2- 172.21.15.79:0/419815288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598f0600 0x55cd598edb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.613+0000 7f2dbd850740 1 --2- 172.21.15.79:0/419815288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598d2d60 0x55cd59908310 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.613+0000 7f2dbd850740 1 --2- 172.21.15.79:0/419815288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598cf790 0x55cd598ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.613+0000 7f2dbd850740 1 -- 172.21.15.79:0/419815288 >> 172.21.15.79:0/419815288 conn(0x55cd598a8a40 msgr2=0x55cd598e6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:19.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.613+0000 7f2dbd850740 1 -- 172.21.15.79:0/419815288 shutdown_connections 2024-04-25T02:13:19.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.613+0000 7f2dbd850740 1 -- 172.21.15.79:0/419815288 wait complete. 2024-04-25T02:13:19.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.613+0000 7f2dbd850740 1 -- start start 2024-04-25T02:13:19.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.613+0000 7f2dbd850740 1 Processor -- start 2024-04-25T02:13:19.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2dbd850740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598cf790 0x55cd598d4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2dbd850740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598d2d60 0x55cd598e3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2dbd850740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598f0600 0x55cd598e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2dbd850740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cd598f1ed0 con 0x55cd598d2d60 2024-04-25T02:13:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2dbd850740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2db41ff0f0 con 0x55cd598cf790 2024-04-25T02:13:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2dbd850740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55cd598d25a0 con 0x55cd598f0600 2024-04-25T02:13:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2dbd850740 10 client.0 _ll_register_callbacks cb 0x7f2da804b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:13:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2db3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598d2d60 0x55cd598e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2db3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598d2d60 0x55cd598e3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41380/0 (socket says 172.21.15.79:41380) 2024-04-25T02:13:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2db3fff640 1 -- 172.21.15.79:0/2948851875 learned_addr learned my addr 172.21.15.79:0/2948851875 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2db88de640 1 --2- 172.21.15.79:0/2948851875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598cf790 0x55cd598d4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2db90df640 1 --2- 172.21.15.79:0/2948851875 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598f0600 0x55cd598e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2db3fff640 1 -- 172.21.15.79:0/2948851875 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598f0600 msgr2=0x55cd598e3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2db3fff640 1 --2- 172.21.15.79:0/2948851875 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598f0600 0x55cd598e3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2db3fff640 1 -- 172.21.15.79:0/2948851875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598cf790 msgr2=0x55cd598d4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2db3fff640 1 --2- 172.21.15.79:0/2948851875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598cf790 0x55cd598d4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2db3fff640 1 -- 172.21.15.79:0/2948851875 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd59911090 con 0x55cd598d2d60 2024-04-25T02:13:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.614+0000 7f2db88de640 1 --2- 172.21.15.79:0/2948851875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598cf790 0x55cd598d4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2db90df640 1 --2- 172.21.15.79:0/2948851875 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598f0600 0x55cd598e3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:19.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2db3fff640 1 --2- 172.21.15.79:0/2948851875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598d2d60 0x55cd598e3500 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f2da80485f0 tx=0x7f2da8008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998d19e9970e630b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:19.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2d937fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:13:19.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2d937fe640 1 -- 172.21.15.79:0/2948851875 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da804d040 con 0x55cd598d2d60 2024-04-25T02:13:19.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2d937fe640 1 -- 172.21.15.79:0/2948851875 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f2da8003b50 con 0x55cd598d2d60 2024-04-25T02:13:19.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2dbd850740 1 -- 172.21.15.79:0/2948851875 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2da804f070 con 0x55cd598d2d60 2024-04-25T02:13:19.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2d937fe640 1 -- 172.21.15.79:0/2948851875 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f2da806f050 con 0x55cd598d2d60 2024-04-25T02:13:19.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2dbd850740 10 client.7155 fetch_fsmap learned FSMap version 40 2024-04-25T02:13:19.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2dbd850740 1 -- 172.21.15.79:0/2948851875 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x55cd59911c10 con 0x55cd598d2d60 2024-04-25T02:13:19.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2d937fe640 1 -- 172.21.15.79:0/2948851875 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da804f070 con 0x55cd598d2d60 2024-04-25T02:13:19.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2d937fe640 1 -- 172.21.15.79:0/2948851875 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f2da8072020 con 0x55cd598d2d60 2024-04-25T02:13:19.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2dbd850740 10 client.7155 fetch_fsmap finished waiting for FSMap version 40 2024-04-25T02:13:19.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2dbd850740 10 client.7155 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T02:13:19.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2dbd850740 20 client.7155 populate_metadata read hostname 'smithi079' 2024-04-25T02:13:19.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2dbd850740 1 --2- 172.21.15.79:0/2948851875 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55cd598e49c0 0x55cd598e4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2dbd850740 4 client.7155 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:13:19.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2dbd850740 1 -- 172.21.15.79:0/2948851875 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cd59813f40 con 0x55cd598e49c0 2024-04-25T02:13:19.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.615+0000 7f2db88de640 1 --2- 172.21.15.79:0/2948851875 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55cd598e49c0 0x55cd598e4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2d937fe640 10 client.7155 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:13:19.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2db88de640 1 --2- 172.21.15.79:0/2948851875 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55cd598e49c0 0x55cd598e4da0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db307bcc2b60dff0 server_cookie=298450d3b59c4585 in_seq=0 out_seq=0 2024-04-25T02:13:19.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2d937fe640 1 -- 172.21.15.79:0/2948851875 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cd59813f40 con 0x55cd598e49c0 2024-04-25T02:13:19.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2d937fe640 10 client.7155 handle_command_reply: tid=0 2024-04-25T02:13:19.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2dbd850740 1 client.7155 shutdown 2024-04-25T02:13:19.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2dbd850740 1 -- 172.21.15.79:0/2948851875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598d2d60 msgr2=0x55cd598e3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2dbd850740 1 --2- 172.21.15.79:0/2948851875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598d2d60 0x55cd598e3500 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f2da80485f0 tx=0x7f2da8008030 comp rx=0 tx=0).stop 2024-04-25T02:13:19.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2dbd850740 1 -- 172.21.15.79:0/2948851875 shutdown_connections 2024-04-25T02:13:19.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2dbd850740 1 --2- 172.21.15.79:0/2948851875 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x55cd598e49c0 0x55cd598e4da0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2dbd850740 1 --2- 172.21.15.79:0/2948851875 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cd598f0600 0x55cd598e3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2dbd850740 1 --2- 172.21.15.79:0/2948851875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd598d2d60 0x55cd598e3500 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2d937fe640 0 client.7155 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:13:19.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2dbd850740 1 --2- 172.21.15.79:0/2948851875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd598cf790 0x55cd598d4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2dbd850740 1 -- 172.21.15.79:0/2948851875 >> 172.21.15.79:0/2948851875 conn(0x55cd598a8a40 msgr2=0x55cd598a8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:19.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2dbd850740 1 -- 172.21.15.79:0/2948851875 shutdown_connections 2024-04-25T02:13:19.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2dbd850740 1 -- 172.21.15.79:0/2948851875 wait complete. 2024-04-25T02:13:19.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.616+0000 7f2dbd850740 20 client.7155 trim_cache size 0 max 16384 2024-04-25T02:13:19.630 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:13:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-04-25T02:13:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-04-25T02:13:19.630 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:13:19.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.617+0000 7f2dbab42640 1 -- 172.21.15.79:0/1405068787 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2da006be30 msgr2=0x7f2da006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.617+0000 7f2dbab42640 1 --2- 172.21.15.79:0/1405068787 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2da006be30 0x7f2da006e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2da8034000 tx=0x7f2da802e000 comp rx=0 tx=0).stop 2024-04-25T02:13:19.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.617+0000 7f2dbab42640 1 -- 172.21.15.79:0/1405068787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2db40cf7f0 msgr2=0x7f2db4155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.617+0000 7f2dbab42640 1 --2- 172.21.15.79:0/1405068787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2db40cf7f0 0x7f2db4155360 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f2da400d620 tx=0x7f2da400dae0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.617+0000 7f2dbab42640 1 -- 172.21.15.79:0/1405068787 shutdown_connections 2024-04-25T02:13:19.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.617+0000 7f2dbab42640 1 --2- 172.21.15.79:0/1405068787 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2da006be30 0x7f2da006e2f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.617+0000 7f2dbab42640 1 --2- 172.21.15.79:0/1405068787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2db415e4f0 0x7f2db40b8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.617+0000 7f2dbab42640 1 --2- 172.21.15.79:0/1405068787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2db40cfc50 0x7f2db40b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.617+0000 7f2dbab42640 1 --2- 172.21.15.79:0/1405068787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2db40cf7f0 0x7f2db4155360 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.617+0000 7f2dbab42640 1 -- 172.21.15.79:0/1405068787 >> 172.21.15.79:0/1405068787 conn(0x7f2db409d4a0 msgr2=0x7f2db4157210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:19.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.617+0000 7f2dbab42640 1 -- 172.21.15.79:0/1405068787 shutdown_connections 2024-04-25T02:13:19.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.617+0000 7f2dbab42640 1 -- 172.21.15.79:0/1405068787 wait complete. 2024-04-25T02:13:19.635 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T02:13:19.635 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:13:19.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.724+0000 7f37e3810640 1 Processor -- start 2024-04-25T02:13:19.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.724+0000 7f37e3810640 1 -- start start 2024-04-25T02:13:19.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.725+0000 7f37e3810640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f37dc143bc0 0x7f37dc15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.725+0000 7f37e3810640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37dc06df50 0x7f37dc06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.725+0000 7f37e3810640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37dc15fa40 con 0x7f37dc0b48e0 2024-04-25T02:13:19.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.725+0000 7f37e3810640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f37dc06e8f0 con 0x7f37dc143bc0 2024-04-25T02:13:19.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.725+0000 7f37e3810640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc072cb0 con 0x7f37dc06df50 2024-04-25T02:13:19.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.725+0000 7f37e15ac640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f37dc143bc0 0x7f37dc15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.725+0000 7f37e1dad640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f37dc0b48e0 0x7f37dc0b4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60564/0 (socket says 172.21.15.79:60564) 2024-04-25T02:13:19.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.725+0000 7f37e1dad640 1 -- 172.21.15.79:0/437607238 learned_addr learned my addr 172.21.15.79:0/437607238 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:19.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.725+0000 7f37e0dab640 1 --2- 172.21.15.79:0/437607238 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37dc06df50 0x7f37dc06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.725+0000 7f37e15ac640 1 -- 172.21.15.79:0/437607238 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37dc06df50 msgr2=0x7f37dc06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:19.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.725+0000 7f37e15ac640 1 --2- 172.21.15.79:0/437607238 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37dc06df50 0x7f37dc06e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.725+0000 7f37e15ac640 1 -- 172.21.15.79:0/437607238 >> v1:172.21.15.79:6789/0 conn(0x7f37dc0b48e0 legacy=0x7f37dc0b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.725+0000 7f37e15ac640 1 -- 172.21.15.79:0/437607238 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc071e00 con 0x7f37dc143bc0 2024-04-25T02:13:19.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.725+0000 7f37d3fff640 1 -- 172.21.15.79:0/437607238 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1001860412 0 0) 0x7f37d4001490 con 0x7f37dc0b48e0 2024-04-25T02:13:19.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.726+0000 7f37e15ac640 1 --2- 172.21.15.79:0/437607238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc143bc0 0x7f37dc15f500 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f37d800ba40 tx=0x7f37d802c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a534df1bcf7ba9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:19.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.726+0000 7f37d3fff640 1 -- 172.21.15.79:0/437607238 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8031710 con 0x7f37dc143bc0 2024-04-25T02:13:19.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.726+0000 7f37d3fff640 1 -- 172.21.15.79:0/437607238 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d80318b0 con 0x7f37dc143bc0 2024-04-25T02:13:19.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.726+0000 7f37d3fff640 1 -- 172.21.15.79:0/437607238 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8031c80 con 0x7f37dc143bc0 2024-04-25T02:13:19.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.726+0000 7f37e3810640 1 -- 172.21.15.79:0/437607238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc143bc0 msgr2=0x7f37dc15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.726+0000 7f37e3810640 1 --2- 172.21.15.79:0/437607238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc143bc0 0x7f37dc15f500 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f37d800ba40 tx=0x7f37d802c7b0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.726+0000 7f37e3810640 1 -- 172.21.15.79:0/437607238 shutdown_connections 2024-04-25T02:13:19.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.726+0000 7f37e3810640 1 --2- 172.21.15.79:0/437607238 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37dc06df50 0x7f37dc06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.726+0000 7f37e3810640 1 --2- 172.21.15.79:0/437607238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc143bc0 0x7f37dc15f500 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.726+0000 7f37e3810640 1 -- 172.21.15.79:0/437607238 >> 172.21.15.79:0/437607238 conn(0x7f37dc0cfc80 msgr2=0x7f37dc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:19.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.727+0000 7f37e3810640 1 -- 172.21.15.79:0/437607238 shutdown_connections 2024-04-25T02:13:19.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.727+0000 7f37e3810640 1 -- 172.21.15.79:0/437607238 wait complete. 2024-04-25T02:13:19.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.728+0000 7f37e3810640 1 Processor -- start 2024-04-25T02:13:19.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.728+0000 7f37e3810640 1 -- start start 2024-04-25T02:13:19.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.728+0000 7f37e3810640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37dc06df50 0x7f37dc156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.728+0000 7f37e3810640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37dc0b48e0 0x7f37dc0aa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.728+0000 7f37e3810640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc143bc0 0x7f37dc0af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.728+0000 7f37e3810640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc072660 con 0x7f37dc143bc0 2024-04-25T02:13:19.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.728+0000 7f37e3810640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc072380 con 0x7f37dc06df50 2024-04-25T02:13:19.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.728+0000 7f37e3810640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc072940 con 0x7f37dc0b48e0 2024-04-25T02:13:19.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.728+0000 7f37e1dad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc143bc0 0x7f37dc0af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.728+0000 7f37e1dad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc143bc0 0x7f37dc0af9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41402/0 (socket says 172.21.15.79:41402) 2024-04-25T02:13:19.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.728+0000 7f37e1dad640 1 -- 172.21.15.79:0/3286158198 learned_addr learned my addr 172.21.15.79:0/3286158198 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:19.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.729+0000 7f37e15ac640 1 --2- 172.21.15.79:0/3286158198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37dc06df50 0x7f37dc156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.729+0000 7f37e0dab640 1 --2- 172.21.15.79:0/3286158198 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37dc0b48e0 0x7f37dc0aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.729+0000 7f37e1dad640 1 -- 172.21.15.79:0/3286158198 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37dc0b48e0 msgr2=0x7f37dc0aa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.729+0000 7f37e1dad640 1 --2- 172.21.15.79:0/3286158198 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37dc0b48e0 0x7f37dc0aa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.729+0000 7f37e1dad640 1 -- 172.21.15.79:0/3286158198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37dc06df50 msgr2=0x7f37dc156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.729+0000 7f37e1dad640 1 --2- 172.21.15.79:0/3286158198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37dc06df50 0x7f37dc156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.729+0000 7f37e1dad640 1 -- 172.21.15.79:0/3286158198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc159420 con 0x7f37dc143bc0 2024-04-25T02:13:19.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.729+0000 7f37e15ac640 1 --2- 172.21.15.79:0/3286158198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37dc06df50 0x7f37dc156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:19.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.729+0000 7f37e1dad640 1 --2- 172.21.15.79:0/3286158198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc143bc0 0x7f37dc0af9a0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f37d400c700 tx=0x7f37d400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:19.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.729+0000 7f37d1ffb640 1 -- 172.21.15.79:0/3286158198 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4018070 con 0x7f37dc143bc0 2024-04-25T02:13:19.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.729+0000 7f37d1ffb640 1 -- 172.21.15.79:0/3286158198 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d400ce10 con 0x7f37dc143bc0 2024-04-25T02:13:19.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.729+0000 7f37e3810640 1 -- 172.21.15.79:0/3286158198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37dc159700 con 0x7f37dc143bc0 2024-04-25T02:13:19.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.729+0000 7f37d1ffb640 1 -- 172.21.15.79:0/3286158198 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d400a860 con 0x7f37dc143bc0 2024-04-25T02:13:19.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.729+0000 7f37e3810640 1 -- 172.21.15.79:0/3286158198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37dc159cc0 con 0x7f37dc143bc0 2024-04-25T02:13:19.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.730+0000 7f37e3810640 1 -- 172.21.15.79:0/3286158198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37dc0690a0 con 0x7f37dc143bc0 2024-04-25T02:13:19.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.731+0000 7f37d1ffb640 1 -- 172.21.15.79:0/3286158198 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37d401b070 con 0x7f37dc143bc0 2024-04-25T02:13:19.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.731+0000 7f37d1ffb640 1 --2- 172.21.15.79:0/3286158198 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f37c006be30 0x7f37c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:19.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.731+0000 7f37d1ffb640 1 -- 172.21.15.79:0/3286158198 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f37d408a510 con 0x7f37dc143bc0 2024-04-25T02:13:19.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.731+0000 7f37e15ac640 1 --2- 172.21.15.79:0/3286158198 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f37c006be30 0x7f37c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:19.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.731+0000 7f37e15ac640 1 --2- 172.21.15.79:0/3286158198 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f37c006be30 0x7f37c006e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f37dc144de0 tx=0x7f37d8031000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:19.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.735+0000 7f37d1ffb640 1 -- 172.21.15.79:0/3286158198 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f37dc15fa40 con 0x7f37dc143bc0 2024-04-25T02:13:19.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.944+0000 7f37e3810640 1 -- 172.21.15.79:0/3286158198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37dc15e5b0 con 0x7f37dc143bc0 2024-04-25T02:13:19.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.944+0000 7f37d1ffb640 1 -- 172.21.15.79:0/3286158198 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5182 (secure 0 0 0) 0x7f37d4058e30 con 0x7f37dc143bc0 2024-04-25T02:13:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:19.952 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/596307304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":596307304},{"type":"v1","addr":"172.21.15.189:6834","nonce":596307304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/980112490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":980112490},{"type":"v1","addr":"172.21.15.189:6835","nonce":980112490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2550610051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550610051},{"type":"v1","addr":"172.21.15.79:6836","nonce":2550610051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:11:55.951694+0000","modified":"2024-04-25T02:12:52.486536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":72,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":18,"addr":"172.21.15.79:6837/782013262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":782013262},{"type":"v1","addr":"172.21.15.79:6837","nonce":782013262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6696,"qdb_cluster":[6696]},"id":5}]} 2024-04-25T02:13:19.952 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2024-04-25T02:13:19.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.947+0000 7f37e3810640 1 -- 172.21.15.79:0/3286158198 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f37c006be30 msgr2=0x7f37c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.947+0000 7f37e3810640 1 --2- 172.21.15.79:0/3286158198 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f37c006be30 0x7f37c006e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f37dc144de0 tx=0x7f37d8031000 comp rx=0 tx=0).stop 2024-04-25T02:13:19.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.947+0000 7f37e3810640 1 -- 172.21.15.79:0/3286158198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc143bc0 msgr2=0x7f37dc0af9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:19.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.947+0000 7f37e3810640 1 --2- 172.21.15.79:0/3286158198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc143bc0 0x7f37dc0af9a0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f37d400c700 tx=0x7f37d400cbc0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.947+0000 7f37e3810640 1 -- 172.21.15.79:0/3286158198 shutdown_connections 2024-04-25T02:13:19.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.947+0000 7f37e3810640 1 --2- 172.21.15.79:0/3286158198 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f37c006be30 0x7f37c006e2f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.947+0000 7f37e3810640 1 --2- 172.21.15.79:0/3286158198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc143bc0 0x7f37dc0af9a0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.947+0000 7f37e3810640 1 --2- 172.21.15.79:0/3286158198 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37dc0b48e0 0x7f37dc0aa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.947+0000 7f37e3810640 1 --2- 172.21.15.79:0/3286158198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37dc06df50 0x7f37dc156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:19.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.947+0000 7f37e3810640 1 -- 172.21.15.79:0/3286158198 >> 172.21.15.79:0/3286158198 conn(0x7f37dc0cfc80 msgr2=0x7f37dc143fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:19.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.947+0000 7f37e3810640 1 -- 172.21.15.79:0/3286158198 shutdown_connections 2024-04-25T02:13:19.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:19.947+0000 7f37e3810640 1 -- 172.21.15.79:0/3286158198 wait complete. 2024-04-25T02:13:19.965 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T02:13:20.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.056+0000 7f6802412640 1 Processor -- start 2024-04-25T02:13:20.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.056+0000 7f6802412640 1 -- start start 2024-04-25T02:13:20.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.056+0000 7f6802412640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f67fc15a810 0x7f67fc0cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.056+0000 7f6802412640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f67fc071460 0x7f67fc0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.056+0000 7f6802412640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67fc15abf0 con 0x7f67fc09dcb0 2024-04-25T02:13:20.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.056+0000 7f6802412640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f67fc073050 con 0x7f67fc071460 2024-04-25T02:13:20.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.056+0000 7f6802412640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f67fc0cbdd0 con 0x7f67fc15a810 2024-04-25T02:13:20.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.057+0000 7f68009af640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f67fc071460 0x7f67fc0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.057+0000 7f68009af640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f67fc071460 0x7f67fc0b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41404/0 (socket says 172.21.15.79:41404) 2024-04-25T02:13:20.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.057+0000 7f68009af640 1 -- 172.21.15.79:0/2608129882 learned_addr learned my addr 172.21.15.79:0/2608129882 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:20.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.057+0000 7f67fbfff640 1 --2- 172.21.15.79:0/2608129882 >> v2:172.21.15.189:3300/0 conn(0x7f67fc15a810 0x7f67fc0cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.057+0000 7f68009af640 1 -- 172.21.15.79:0/2608129882 >> v2:172.21.15.189:3300/0 conn(0x7f67fc15a810 msgr2=0x7f67fc0cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.057+0000 7f68009af640 1 --2- 172.21.15.79:0/2608129882 >> v2:172.21.15.189:3300/0 conn(0x7f67fc15a810 0x7f67fc0cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.057+0000 7f68009af640 1 -- 172.21.15.79:0/2608129882 >> v1:172.21.15.189:6789/0 conn(0x7f67fc09dcb0 legacy=0x7f67fc070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.057+0000 7f68009af640 1 -- 172.21.15.79:0/2608129882 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67fc0ce580 con 0x7f67fc071460 2024-04-25T02:13:20.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.058+0000 7f68009af640 1 --2- 172.21.15.79:0/2608129882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67fc071460 0x7f67fc0b42a0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0d0d40 tx=0x7f67f402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ca328ebc522ea6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:20.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.058+0000 7f67faffd640 1 -- 172.21.15.79:0/2608129882 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f4036070 con 0x7f67fc071460 2024-04-25T02:13:20.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.058+0000 7f67faffd640 1 -- 172.21.15.79:0/2608129882 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f4031600 con 0x7f67fc071460 2024-04-25T02:13:20.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.058+0000 7f67faffd640 1 -- 172.21.15.79:0/2608129882 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f40319d0 con 0x7f67fc071460 2024-04-25T02:13:20.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.058+0000 7f6802412640 1 -- 172.21.15.79:0/2608129882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67fc071460 msgr2=0x7f67fc0b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.058+0000 7f6802412640 1 --2- 172.21.15.79:0/2608129882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67fc071460 0x7f67fc0b42a0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0d0d40 tx=0x7f67f402a660 comp rx=0 tx=0).stop 2024-04-25T02:13:20.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.058+0000 7f6802412640 1 -- 172.21.15.79:0/2608129882 shutdown_connections 2024-04-25T02:13:20.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.058+0000 7f6802412640 1 --2- 172.21.15.79:0/2608129882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67fc071460 0x7f67fc0b42a0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.058+0000 7f6802412640 1 --2- 172.21.15.79:0/2608129882 >> v2:172.21.15.189:3300/0 conn(0x7f67fc15a810 0x7f67fc0cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.058+0000 7f6802412640 1 -- 172.21.15.79:0/2608129882 >> 172.21.15.79:0/2608129882 conn(0x7f67fc0b1cd0 msgr2=0x7f67fc0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:20.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.058+0000 7f6802412640 1 -- 172.21.15.79:0/2608129882 shutdown_connections 2024-04-25T02:13:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.058+0000 7f6802412640 1 -- 172.21.15.79:0/2608129882 wait complete. 2024-04-25T02:13:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.059+0000 7f6802412640 1 Processor -- start 2024-04-25T02:13:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.060+0000 7f6802412640 1 -- start start 2024-04-25T02:13:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.060+0000 7f6802412640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67fc09dcb0 0x7f67fc1566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.060+0000 7f6802412640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67fc15a810 0x7f67fc0b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.060+0000 7f6802412640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67fc09d210 0x7f67fc14fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.060+0000 7f6802412640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc0cc020 con 0x7f67fc15a810 2024-04-25T02:13:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.060+0000 7f6802412640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc0ceb40 con 0x7f67fc09dcb0 2024-04-25T02:13:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.060+0000 7f6802412640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f67fc0cc300 con 0x7f67fc09d210 2024-04-25T02:13:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.060+0000 7f67fb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67fc15a810 0x7f67fc0b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f67fb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67fc15a810 0x7f67fc0b01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41414/0 (socket says 172.21.15.79:41414) 2024-04-25T02:13:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f67fb7fe640 1 -- 172.21.15.79:0/3180475166 learned_addr learned my addr 172.21.15.79:0/3180475166 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f67fbfff640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67fc09dcb0 0x7f67fc1566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f68009af640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67fc09d210 0x7f67fc14fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f67fb7fe640 1 -- 172.21.15.79:0/3180475166 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67fc09d210 msgr2=0x7f67fc14fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f67fb7fe640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67fc09d210 0x7f67fc14fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f67fb7fe640 1 -- 172.21.15.79:0/3180475166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67fc09dcb0 msgr2=0x7f67fc1566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f67fb7fe640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67fc09dcb0 0x7f67fc1566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f67fb7fe640 1 -- 172.21.15.79:0/3180475166 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67fc0b0730 con 0x7f67fc15a810 2024-04-25T02:13:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f67fbfff640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67fc09dcb0 0x7f67fc1566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f68009af640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67fc09d210 0x7f67fc14fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f67fb7fe640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67fc15a810 0x7f67fc0b01f0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f67f000e730 tx=0x7f67f000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f67f8ff9640 1 -- 172.21.15.79:0/3180475166 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f00041f0 con 0x7f67fc15a810 2024-04-25T02:13:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f67f8ff9640 1 -- 172.21.15.79:0/3180475166 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f0004390 con 0x7f67fc15a810 2024-04-25T02:13:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f6802412640 1 -- 172.21.15.79:0/3180475166 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67fc0b09c0 con 0x7f67fc15a810 2024-04-25T02:13:20.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f67f8ff9640 1 -- 172.21.15.79:0/3180475166 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f00116b0 con 0x7f67fc15a810 2024-04-25T02:13:20.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.061+0000 7f6802412640 1 -- 172.21.15.79:0/3180475166 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67fc0b0f80 con 0x7f67fc15a810 2024-04-25T02:13:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.063+0000 7f67f8ff9640 1 -- 172.21.15.79:0/3180475166 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67f0011850 con 0x7f67fc15a810 2024-04-25T02:13:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.063+0000 7f67f8ff9640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f67e806be60 0x7f67e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.063+0000 7f67f8ff9640 1 -- 172.21.15.79:0/3180475166 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f67f008d550 con 0x7f67fc15a810 2024-04-25T02:13:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.063+0000 7f67fbfff640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f67e806be60 0x7f67e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.063+0000 7f67fbfff640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f67e806be60 0x7f67e806e320 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f67ec006fd0 tx=0x7f67ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.064+0000 7f68051fa740 1 Processor -- start 2024-04-25T02:13:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.064+0000 7f68051fa740 1 -- start start 2024-04-25T02:13:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f68051fa740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b429d5290 0x555b429d5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f68051fa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b42a22980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f68051fa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429da160 0x555b429da5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f68051fa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555b4293d520 con 0x555b42a02140 2024-04-25T02:13:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f68051fa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555b428dbae0 con 0x555b429da160 2024-04-25T02:13:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f68051fa740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x555b429394e0 con 0x555b429d5290 2024-04-25T02:13:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f67fb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b42a22980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f67fb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b42a22980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41422/0 (socket says 172.21.15.79:41422) 2024-04-25T02:13:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f67fb7fe640 1 -- 172.21.15.79:0/1670983952 learned_addr learned my addr 172.21.15.79:0/1670983952 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f67fbfff640 1 --2- 172.21.15.79:0/1670983952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b429d5290 0x555b429d5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f68009af640 1 --2- 172.21.15.79:0/1670983952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429da160 0x555b429da5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f67fb7fe640 1 -- 172.21.15.79:0/1670983952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b429d5290 msgr2=0x555b429d5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f67fb7fe640 1 --2- 172.21.15.79:0/1670983952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b429d5290 0x555b429d5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f67fb7fe640 1 -- 172.21.15.79:0/1670983952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429da160 msgr2=0x555b429da5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f67fb7fe640 1 --2- 172.21.15.79:0/1670983952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429da160 0x555b429da5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f67fb7fe640 1 -- 172.21.15.79:0/1670983952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b42901240 con 0x555b42a02140 2024-04-25T02:13:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f67fb7fe640 1 --2- 172.21.15.79:0/1670983952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b42a22980 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f67f0063e90 tx=0x7f67f005bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b09f6b5aa281f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.065+0000 7f67e1ffb640 1 -- 172.21.15.79:0/1670983952 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f00620d0 con 0x555b42a02140 2024-04-25T02:13:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.066+0000 7f67e1ffb640 1 -- 172.21.15.79:0/1670983952 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f00643c0 con 0x555b42a02140 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.066+0000 7f67e1ffb640 1 -- 172.21.15.79:0/1670983952 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0059ae0 con 0x555b42a02140 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.066+0000 7f68051fa740 1 -- 172.21.15.79:0/1670983952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 msgr2=0x555b42a22980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.066+0000 7f68051fa740 1 --2- 172.21.15.79:0/1670983952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b42a22980 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f67f0063e90 tx=0x7f67f005bff0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.066+0000 7f68051fa740 1 -- 172.21.15.79:0/1670983952 shutdown_connections 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.066+0000 7f68051fa740 1 --2- 172.21.15.79:0/1670983952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429da160 0x555b429da5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.066+0000 7f68051fa740 1 --2- 172.21.15.79:0/1670983952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b42a22980 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.066+0000 7f68051fa740 1 --2- 172.21.15.79:0/1670983952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b429d5290 0x555b429d5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.066+0000 7f68051fa740 1 -- 172.21.15.79:0/1670983952 >> 172.21.15.79:0/1670983952 conn(0x555b429d7310 msgr2=0x555b429d8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.066+0000 7f68051fa740 1 -- 172.21.15.79:0/1670983952 shutdown_connections 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.066+0000 7f68051fa740 1 -- 172.21.15.79:0/1670983952 wait complete. 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.067+0000 7f68051fa740 1 -- start start 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.067+0000 7f68051fa740 1 Processor -- start 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f68051fa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b429da160 0x555b42a16f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f68051fa740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b42a02140 0x555b42a19330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f68051fa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429ffb80 0x555b42a19870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f68051fa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555b428d9470 con 0x555b429da160 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f68051fa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555b42a01f70 con 0x555b429ffb80 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f68051fa740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x555b42a00a70 con 0x555b42a02140 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f67fbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b429da160 0x555b42a16f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f68051fa740 10 client.0 _ll_register_callbacks cb 0x555b428fddd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f67fbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b429da160 0x555b42a16f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41436/0 (socket says 172.21.15.79:41436) 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f67fbfff640 1 -- 172.21.15.79:0/2505842775 learned_addr learned my addr 172.21.15.79:0/2505842775 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f67fb7fe640 1 --2- 172.21.15.79:0/2505842775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b42a02140 0x555b42a19330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f68009af640 1 --2- 172.21.15.79:0/2505842775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429ffb80 0x555b42a19870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f67fbfff640 1 -- 172.21.15.79:0/2505842775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b42a02140 msgr2=0x555b42a19330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f67fbfff640 1 --2- 172.21.15.79:0/2505842775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b42a02140 0x555b42a19330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f67fbfff640 1 -- 172.21.15.79:0/2505842775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429ffb80 msgr2=0x555b42a19870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f67fbfff640 1 --2- 172.21.15.79:0/2505842775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429ffb80 0x555b42a19870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f67fbfff640 1 -- 172.21.15.79:0/2505842775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b428f0bf0 con 0x555b429da160 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f68009af640 1 --2- 172.21.15.79:0/2505842775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429ffb80 0x555b42a19870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f67fbfff640 1 --2- 172.21.15.79:0/2505842775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b429da160 0x555b42a16f60 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f67ec014710 tx=0x7f67ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3dea253cb6f6282 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f67daffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:13:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f67daffd640 1 -- 172.21.15.79:0/2505842775 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec025020 con 0x555b429da160 2024-04-25T02:13:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f67daffd640 1 -- 172.21.15.79:0/2505842775 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f67ec015960 con 0x555b429da160 2024-04-25T02:13:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f68051fa740 1 -- 172.21.15.79:0/2505842775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67f00643c0 con 0x555b429da160 2024-04-25T02:13:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f67daffd640 1 -- 172.21.15.79:0/2505842775 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f67ec02f050 con 0x555b429da160 2024-04-25T02:13:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f68051fa740 10 client.7176 fetch_fsmap learned FSMap version 40 2024-04-25T02:13:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.068+0000 7f68051fa740 1 -- 172.21.15.79:0/2505842775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x555b4271d7c0 con 0x555b429da160 2024-04-25T02:13:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.069+0000 7f67daffd640 1 -- 172.21.15.79:0/2505842775 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f00643c0 con 0x555b429da160 2024-04-25T02:13:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.069+0000 7f67daffd640 1 -- 172.21.15.79:0/2505842775 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f67ec032020 con 0x555b429da160 2024-04-25T02:13:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.069+0000 7f68051fa740 10 client.7176 fetch_fsmap finished waiting for FSMap version 40 2024-04-25T02:13:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.069+0000 7f68051fa740 10 client.7176 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:13:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.069+0000 7f68051fa740 20 client.7176 populate_metadata read hostname 'smithi079' 2024-04-25T02:13:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.069+0000 7f68051fa740 1 --2- 172.21.15.79:0/2505842775 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x555b42a07890 0x555b42a46ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.069+0000 7f68051fa740 4 client.7176 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:13:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.069+0000 7f68051fa740 1 -- 172.21.15.79:0/2505842775 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b42950d50 con 0x555b42a07890 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.069+0000 7f67fb7fe640 1 --2- 172.21.15.79:0/2505842775 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x555b42a07890 0x555b42a46ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.069+0000 7f67daffd640 10 client.7176 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.069+0000 7f67fb7fe640 1 --2- 172.21.15.79:0/2505842775 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x555b42a07890 0x555b42a46ae0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fef747563cffba2c server_cookie=eebd99f4889a6533 in_seq=0 out_seq=0 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.070+0000 7f67daffd640 1 -- 172.21.15.79:0/2505842775 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555b42950d50 con 0x555b42a07890 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.070+0000 7f67daffd640 10 client.7176 handle_command_reply: tid=0 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.070+0000 7f68051fa740 1 client.7176 shutdown 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.070+0000 7f68051fa740 1 -- 172.21.15.79:0/2505842775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b429da160 msgr2=0x555b42a16f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.070+0000 7f68051fa740 1 --2- 172.21.15.79:0/2505842775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b429da160 0x555b42a16f60 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f67ec014710 tx=0x7f67ec004730 comp rx=0 tx=0).stop 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.070+0000 7f68051fa740 1 -- 172.21.15.79:0/2505842775 shutdown_connections 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.070+0000 7f68051fa740 1 --2- 172.21.15.79:0/2505842775 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x555b42a07890 0x555b42a46ae0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.070+0000 7f68051fa740 1 --2- 172.21.15.79:0/2505842775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429ffb80 0x555b42a19870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.070+0000 7f67daffd640 0 client.7176 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.070+0000 7f68051fa740 1 --2- 172.21.15.79:0/2505842775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b42a02140 0x555b42a19330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.070+0000 7f68051fa740 1 --2- 172.21.15.79:0/2505842775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b429da160 0x555b42a16f60 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.070+0000 7f68051fa740 1 -- 172.21.15.79:0/2505842775 >> 172.21.15.79:0/2505842775 conn(0x555b429d5290 msgr2=0x555b429d8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.070+0000 7f68051fa740 1 -- 172.21.15.79:0/2505842775 shutdown_connections 2024-04-25T02:13:20.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.070+0000 7f68051fa740 1 -- 172.21.15.79:0/2505842775 wait complete. 2024-04-25T02:13:20.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.070+0000 7f68051fa740 20 client.7176 trim_cache size 0 max 16384 2024-04-25T02:13:20.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.083+0000 7f68051fa740 1 Processor -- start 2024-04-25T02:13:20.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.083+0000 7f68051fa740 1 -- start start 2024-04-25T02:13:20.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.084+0000 7f68051fa740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b429da160 0x555b429d5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.084+0000 7f68051fa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429ffb80 0x555b429da540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.084+0000 7f68051fa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b429daa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.084+0000 7f68051fa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc1fb600 con 0x555b42a02140 2024-04-25T02:13:20.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.084+0000 7f68051fa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc159620 con 0x555b429ffb80 2024-04-25T02:13:20.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.084+0000 7f68051fa740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f67fc159c70 con 0x555b429da160 2024-04-25T02:13:20.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.084+0000 7f68009af640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b429daa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.084+0000 7f68009af640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b429daa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41438/0 (socket says 172.21.15.79:41438) 2024-04-25T02:13:20.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.084+0000 7f68009af640 1 -- 172.21.15.79:0/3952098388 learned_addr learned my addr 172.21.15.79:0/3952098388 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:20.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.084+0000 7f68009af640 1 -- 172.21.15.79:0/3952098388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b429da160 msgr2=0x555b429d5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.084+0000 7f68009af640 1 --2- 172.21.15.79:0/3952098388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b429da160 0x555b429d5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.084+0000 7f68009af640 1 -- 172.21.15.79:0/3952098388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429ffb80 msgr2=0x555b429da540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.084+0000 7f68009af640 1 --2- 172.21.15.79:0/3952098388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429ffb80 0x555b429da540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.084+0000 7f68009af640 1 -- 172.21.15.79:0/3952098388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4277df50 con 0x555b42a02140 2024-04-25T02:13:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.084+0000 7f68009af640 1 --2- 172.21.15.79:0/3952098388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b429daa80 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f67f4009f40 tx=0x7f67f402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc8bd6314f27288 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.085+0000 7f67e17fa640 1 -- 172.21.15.79:0/3952098388 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f4036040 con 0x555b42a02140 2024-04-25T02:13:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.085+0000 7f67e17fa640 1 -- 172.21.15.79:0/3952098388 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f403b4d0 con 0x555b42a02140 2024-04-25T02:13:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.085+0000 7f67e17fa640 1 -- 172.21.15.79:0/3952098388 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f403b880 con 0x555b42a02140 2024-04-25T02:13:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.085+0000 7f68051fa740 1 -- 172.21.15.79:0/3952098388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 msgr2=0x555b429daa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.085+0000 7f68051fa740 1 --2- 172.21.15.79:0/3952098388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b429daa80 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f67f4009f40 tx=0x7f67f402e000 comp rx=0 tx=0).stop 2024-04-25T02:13:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.085+0000 7f68051fa740 1 -- 172.21.15.79:0/3952098388 shutdown_connections 2024-04-25T02:13:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.085+0000 7f68051fa740 1 --2- 172.21.15.79:0/3952098388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b429daa80 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.085+0000 7f68051fa740 1 --2- 172.21.15.79:0/3952098388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429ffb80 0x555b429da540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.085+0000 7f68051fa740 1 --2- 172.21.15.79:0/3952098388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b429da160 0x555b429d5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.085+0000 7f68051fa740 1 -- 172.21.15.79:0/3952098388 >> 172.21.15.79:0/3952098388 conn(0x555b429d5290 msgr2=0x555b42a0cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.085+0000 7f68051fa740 1 -- 172.21.15.79:0/3952098388 shutdown_connections 2024-04-25T02:13:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.085+0000 7f68051fa740 1 -- 172.21.15.79:0/3952098388 wait complete. 2024-04-25T02:13:20.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.086+0000 7f68051fa740 1 -- start start 2024-04-25T02:13:20.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.086+0000 7f68051fa740 1 Processor -- start 2024-04-25T02:13:20.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68051fa740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b429da160 0x555b42a9fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68051fa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429ffb80 0x555b42a4c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68051fa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b42a4ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68051fa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555b42a00fa0 con 0x555b42a02140 2024-04-25T02:13:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68051fa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555b42a065d0 con 0x555b429ffb80 2024-04-25T02:13:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68051fa740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x555b42a07e10 con 0x555b429da160 2024-04-25T02:13:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68051fa740 10 client.0 _ll_register_callbacks cb 0x7f67ec00b2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:13:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68009af640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b42a4ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68009af640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b42a4ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41454/0 (socket says 172.21.15.79:41454) 2024-04-25T02:13:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68009af640 1 -- 172.21.15.79:0/3793248247 learned_addr learned my addr 172.21.15.79:0/3793248247 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68009af640 1 -- 172.21.15.79:0/3793248247 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b429da160 msgr2=0x555b42a9fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68009af640 1 --2- 172.21.15.79:0/3793248247 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b429da160 0x555b42a9fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68009af640 1 -- 172.21.15.79:0/3793248247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429ffb80 msgr2=0x555b42a4c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68009af640 1 --2- 172.21.15.79:0/3793248247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429ffb80 0x555b42a4c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68009af640 1 -- 172.21.15.79:0/3793248247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b426110b0 con 0x555b42a02140 2024-04-25T02:13:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68009af640 1 --2- 172.21.15.79:0/3793248247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b42a4ab00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f67f402ac50 tx=0x7f67f4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61767366c94c7b58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f67daffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:13:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f67daffd640 1 -- 172.21.15.79:0/3793248247 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f4036070 con 0x555b42a02140 2024-04-25T02:13:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f67daffd640 1 -- 172.21.15.79:0/3793248247 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f67f403b890 con 0x555b42a02140 2024-04-25T02:13:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68051fa740 1 -- 172.21.15.79:0/3793248247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67f403b4d0 con 0x555b42a02140 2024-04-25T02:13:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f67daffd640 1 -- 172.21.15.79:0/3793248247 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f67f4055050 con 0x555b42a02140 2024-04-25T02:13:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68051fa740 10 client.7182 fetch_fsmap learned FSMap version 40 2024-04-25T02:13:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.087+0000 7f68051fa740 1 -- 172.21.15.79:0/3793248247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x555b428ca780 con 0x555b42a02140 2024-04-25T02:13:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f67daffd640 1 -- 172.21.15.79:0/3793248247 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f403b4d0 con 0x555b42a02140 2024-04-25T02:13:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f67daffd640 1 -- 172.21.15.79:0/3793248247 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f67f4058020 con 0x555b42a02140 2024-04-25T02:13:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f68051fa740 10 client.7182 fetch_fsmap finished waiting for FSMap version 40 2024-04-25T02:13:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f68051fa740 10 client.7182 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:13:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f68051fa740 20 client.7182 populate_metadata read hostname 'smithi079' 2024-04-25T02:13:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f68051fa740 1 --2- 172.21.15.79:0/3793248247 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x555b429d43f0 0x555b42aa5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f68051fa740 4 client.7182 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T02:13:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f68051fa740 1 -- 172.21.15.79:0/3793248247 --> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x555b4294aa60 con 0x555b429d43f0 2024-04-25T02:13:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f67fbfff640 1 --2- 172.21.15.79:0/3793248247 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x555b429d43f0 0x555b42aa5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f67daffd640 10 client.7182 ms_handle_connect on v2:172.21.15.79:6835/782013262 2024-04-25T02:13:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f67fbfff640 1 --2- 172.21.15.79:0/3793248247 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x555b429d43f0 0x555b42aa5be0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96985f3200c48078 server_cookie=c84645d65a100fc7 in_seq=0 out_seq=0 2024-04-25T02:13:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f67daffd640 1 -- 172.21.15.79:0/3793248247 <== mds.0 v2:172.21.15.79:6835/782013262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555b4294aa60 con 0x555b429d43f0 2024-04-25T02:13:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f67daffd640 10 client.7182 handle_command_reply: tid=0 2024-04-25T02:13:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f68051fa740 1 client.7182 shutdown 2024-04-25T02:13:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f68051fa740 1 -- 172.21.15.79:0/3793248247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 msgr2=0x555b42a4ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.088+0000 7f68051fa740 1 --2- 172.21.15.79:0/3793248247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b42a4ab00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f67f402ac50 tx=0x7f67f4004ab0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f68051fa740 1 -- 172.21.15.79:0/3793248247 shutdown_connections 2024-04-25T02:13:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f68051fa740 1 --2- 172.21.15.79:0/3793248247 >> [v2:172.21.15.79:6835/782013262,v1:172.21.15.79:6837/782013262] conn(0x555b429d43f0 0x555b42aa5be0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f68051fa740 1 --2- 172.21.15.79:0/3793248247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b42a02140 0x555b42a4ab00 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f68051fa740 1 --2- 172.21.15.79:0/3793248247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555b429ffb80 0x555b42a4c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f67daffd640 0 client.7182 ms_handle_reset on v2:172.21.15.79:6835/782013262 2024-04-25T02:13:20.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f68051fa740 1 --2- 172.21.15.79:0/3793248247 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555b429da160 0x555b42a9fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f68051fa740 1 -- 172.21.15.79:0/3793248247 >> 172.21.15.79:0/3793248247 conn(0x555b429d5290 msgr2=0x555b42a00040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:20.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f68051fa740 1 -- 172.21.15.79:0/3793248247 shutdown_connections 2024-04-25T02:13:20.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f68051fa740 1 -- 172.21.15.79:0/3793248247 wait complete. 2024-04-25T02:13:20.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f68051fa740 20 client.7182 trim_cache size 0 max 16384 2024-04-25T02:13:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:20.102 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-04-25T02:13:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f6802412640 1 -- 172.21.15.79:0/3180475166 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f67e806be60 msgr2=0x7f67e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f6802412640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f67e806be60 0x7f67e806e320 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f67ec006fd0 tx=0x7f67ec008040 comp rx=0 tx=0).stop 2024-04-25T02:13:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f6802412640 1 -- 172.21.15.79:0/3180475166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67fc15a810 msgr2=0x7f67fc0b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f6802412640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67fc15a810 0x7f67fc0b01f0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f67f000e730 tx=0x7f67f000ebf0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f6802412640 1 -- 172.21.15.79:0/3180475166 shutdown_connections 2024-04-25T02:13:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f6802412640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f67e806be60 0x7f67e806e320 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f6802412640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67fc09d210 0x7f67fc14fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f6802412640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67fc15a810 0x7f67fc0b01f0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f6802412640 1 --2- 172.21.15.79:0/3180475166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67fc09dcb0 0x7f67fc1566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f6802412640 1 -- 172.21.15.79:0/3180475166 >> 172.21.15.79:0/3180475166 conn(0x7f67fc0b1cd0 msgr2=0x7f67fc06b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f6802412640 1 -- 172.21.15.79:0/3180475166 shutdown_connections 2024-04-25T02:13:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.089+0000 7f6802412640 1 -- 172.21.15.79:0/3180475166 wait complete. 2024-04-25T02:13:20.107 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T02:13:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.194+0000 7f4ceb5ed640 1 Processor -- start 2024-04-25T02:13:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.195+0000 7f4ceb5ed640 1 -- start start 2024-04-25T02:13:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.195+0000 7f4ceb5ed640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f4ce40b9a80 0x7f4ce40cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.195+0000 7f4ceb5ed640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4ce40d1e30 0x7f4ce40d2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.195+0000 7f4ceb5ed640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4ce40d2ac0 0x7f4ce40d05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.195+0000 7f4ceb5ed640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4ce4161e50 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.195+0000 7f4ceb5ed640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f4ce40b9e60 con 0x7f4ce40b9a80 2024-04-25T02:13:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.195+0000 7f4ceb5ed640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce40d0030 con 0x7f4ce40d1e30 2024-04-25T02:13:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.196+0000 7f4ce9b8a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4ce40d2ac0 0x7f4ce40d05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.196+0000 7f4ce9b8a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4ce40d2ac0 0x7f4ce40d05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41458/0 (socket says 172.21.15.79:41458) 2024-04-25T02:13:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.196+0000 7f4ce9b8a640 1 -- 172.21.15.79:0/2158683256 learned_addr learned my addr 172.21.15.79:0/2158683256 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.196+0000 7f4ce9389640 1 --2- 172.21.15.79:0/2158683256 >> v2:172.21.15.189:3300/0 conn(0x7f4ce40b9a80 0x7f4ce40cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.196+0000 7f4ce8b88640 1 --2- 172.21.15.79:0/2158683256 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4ce40d1e30 0x7f4ce40d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.196+0000 7f4ce9b8a640 1 -- 172.21.15.79:0/2158683256 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4ce40d1e30 msgr2=0x7f4ce40d2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.196+0000 7f4ce9b8a640 1 --2- 172.21.15.79:0/2158683256 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4ce40d1e30 0x7f4ce40d2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.196+0000 7f4ce9b8a640 1 -- 172.21.15.79:0/2158683256 >> v2:172.21.15.189:3300/0 conn(0x7f4ce40b9a80 msgr2=0x7f4ce40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.196+0000 7f4ce9b8a640 1 --2- 172.21.15.79:0/2158683256 >> v2:172.21.15.189:3300/0 conn(0x7f4ce40b9a80 0x7f4ce40cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.196+0000 7f4ce9b8a640 1 -- 172.21.15.79:0/2158683256 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce40b6e90 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.196+0000 7f4ce9b8a640 1 --2- 172.21.15.79:0/2158683256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce40d2ac0 0x7f4ce40d05d0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40d3f70 tx=0x7f4cdc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7a5e41059b4112 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.197+0000 7f4cdbfff640 1 -- 172.21.15.79:0/2158683256 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc036070 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.197+0000 7f4cdbfff640 1 -- 172.21.15.79:0/2158683256 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cdc031600 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.197+0000 7f4cdbfff640 1 -- 172.21.15.79:0/2158683256 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc0319d0 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.197+0000 7f4ceb5ed640 1 -- 172.21.15.79:0/2158683256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce40d2ac0 msgr2=0x7f4ce40d05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.197+0000 7f4ceb5ed640 1 --2- 172.21.15.79:0/2158683256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce40d2ac0 0x7f4ce40d05d0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40d3f70 tx=0x7f4cdc02a6a0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.197+0000 7f4ceb5ed640 1 -- 172.21.15.79:0/2158683256 shutdown_connections 2024-04-25T02:13:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.197+0000 7f4ceb5ed640 1 --2- 172.21.15.79:0/2158683256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce40d2ac0 0x7f4ce40d05d0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.197+0000 7f4ceb5ed640 1 --2- 172.21.15.79:0/2158683256 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4ce40d1e30 0x7f4ce40d2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.197+0000 7f4ceb5ed640 1 --2- 172.21.15.79:0/2158683256 >> v2:172.21.15.189:3300/0 conn(0x7f4ce40b9a80 0x7f4ce40cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.197+0000 7f4ceb5ed640 1 -- 172.21.15.79:0/2158683256 >> 172.21.15.79:0/2158683256 conn(0x7f4ce40d3fa0 msgr2=0x7f4ce40d43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.197+0000 7f4ceb5ed640 1 -- 172.21.15.79:0/2158683256 shutdown_connections 2024-04-25T02:13:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.197+0000 7f4ceb5ed640 1 -- 172.21.15.79:0/2158683256 wait complete. 2024-04-25T02:13:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.198+0000 7f4ceb5ed640 1 Processor -- start 2024-04-25T02:13:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.198+0000 7f4ceb5ed640 1 -- start start 2024-04-25T02:13:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.199+0000 7f4ceb5ed640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ce40b9a80 0x7f4ce40cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.199+0000 7f4ceb5ed640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4ce40d1e30 0x7f4ce40cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.199+0000 7f4ceb5ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce40d2ac0 0x7f4ce41f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.199+0000 7f4ceb5ed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce40b7730 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.199+0000 7f4ceb5ed640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce40b7450 con 0x7f4ce40b9a80 2024-04-25T02:13:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.199+0000 7f4ceb5ed640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce40cfc00 con 0x7f4ce40d1e30 2024-04-25T02:13:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.199+0000 7f4ce9b8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce40d2ac0 0x7f4ce41f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.199+0000 7f4ce9b8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce40d2ac0 0x7f4ce41f3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41466/0 (socket says 172.21.15.79:41466) 2024-04-25T02:13:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.199+0000 7f4ce9b8a640 1 -- 172.21.15.79:0/1463492923 learned_addr learned my addr 172.21.15.79:0/1463492923 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.199+0000 7f4ce9b8a640 1 -- 172.21.15.79:0/1463492923 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4ce40d1e30 msgr2=0x7f4ce40cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.199+0000 7f4ce9b8a640 1 --2- 172.21.15.79:0/1463492923 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4ce40d1e30 0x7f4ce40cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.199+0000 7f4ce9b8a640 1 -- 172.21.15.79:0/1463492923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ce40b9a80 msgr2=0x7f4ce40cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.199+0000 7f4ce9b8a640 1 --2- 172.21.15.79:0/1463492923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ce40b9a80 0x7f4ce40cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.199+0000 7f4ce9b8a640 1 -- 172.21.15.79:0/1463492923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce40cbf70 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.200+0000 7f4ce9b8a640 1 --2- 172.21.15.79:0/1463492923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce40d2ac0 0x7f4ce41f3f50 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009f40 tx=0x7f4cdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.200+0000 7f4cd9ffb640 1 -- 172.21.15.79:0/1463492923 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc036050 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.200+0000 7f4cd9ffb640 1 -- 172.21.15.79:0/1463492923 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cdc042070 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.200+0000 7f4cd9ffb640 1 -- 172.21.15.79:0/1463492923 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc009510 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.200+0000 7f4ceb5ed640 1 -- 172.21.15.79:0/1463492923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce40cc220 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.200+0000 7f4ceb5ed640 1 -- 172.21.15.79:0/1463492923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce415c370 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.201+0000 7f4ceb5ed640 1 -- 172.21.15.79:0/1463492923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce40690a0 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.201+0000 7f4cd9ffb640 1 -- 172.21.15.79:0/1463492923 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cdc007bd0 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.202+0000 7f4cd9ffb640 1 --2- 172.21.15.79:0/1463492923 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4cc806be30 0x7f4cc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.202+0000 7f4cd9ffb640 1 -- 172.21.15.79:0/1463492923 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f4cdc0abd60 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.202+0000 7f4ce9389640 1 --2- 172.21.15.79:0/1463492923 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4cc806be30 0x7f4cc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.202+0000 7f4ce9389640 1 --2- 172.21.15.79:0/1463492923 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4cc806be30 0x7f4cc806e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400b7f0 tx=0x7f4cd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.206+0000 7f4cd9ffb640 1 -- 172.21.15.79:0/1463492923 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4cdc07a710 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.413+0000 7f4ceb5ed640 1 -- 172.21.15.79:0/1463492923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4ce40caad0 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.413+0000 7f4cd9ffb640 1 -- 172.21.15.79:0/1463492923 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4cdc07a010 con 0x7f4ce40d2ac0 2024-04-25T02:13:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:20.421 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T02:13:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.415+0000 7f4ceb5ed640 1 -- 172.21.15.79:0/1463492923 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4cc806be30 msgr2=0x7f4cc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.415+0000 7f4ceb5ed640 1 --2- 172.21.15.79:0/1463492923 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4cc806be30 0x7f4cc806e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400b7f0 tx=0x7f4cd4008040 comp rx=0 tx=0).stop 2024-04-25T02:13:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.415+0000 7f4ceb5ed640 1 -- 172.21.15.79:0/1463492923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce40d2ac0 msgr2=0x7f4ce41f3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.415+0000 7f4ceb5ed640 1 --2- 172.21.15.79:0/1463492923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce40d2ac0 0x7f4ce41f3f50 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009f40 tx=0x7f4cdc004a40 comp rx=0 tx=0).stop 2024-04-25T02:13:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.415+0000 7f4ceb5ed640 1 -- 172.21.15.79:0/1463492923 shutdown_connections 2024-04-25T02:13:20.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.415+0000 7f4ceb5ed640 1 --2- 172.21.15.79:0/1463492923 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4cc806be30 0x7f4cc806e2f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.415+0000 7f4ceb5ed640 1 --2- 172.21.15.79:0/1463492923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce40d2ac0 0x7f4ce41f3f50 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.415+0000 7f4ceb5ed640 1 --2- 172.21.15.79:0/1463492923 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4ce40d1e30 0x7f4ce40cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.415+0000 7f4ceb5ed640 1 --2- 172.21.15.79:0/1463492923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ce40b9a80 0x7f4ce40cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.415+0000 7f4ceb5ed640 1 -- 172.21.15.79:0/1463492923 >> 172.21.15.79:0/1463492923 conn(0x7f4ce40d3fa0 msgr2=0x7f4ce40d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:20.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.415+0000 7f4ceb5ed640 1 -- 172.21.15.79:0/1463492923 shutdown_connections 2024-04-25T02:13:20.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.415+0000 7f4ceb5ed640 1 -- 172.21.15.79:0/1463492923 wait complete. 2024-04-25T02:13:20.434 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T02:13:20.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:13:20.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.524+0000 7f41d3e9a640 1 Processor -- start 2024-04-25T02:13:20.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.524+0000 7f41d3e9a640 1 -- start start 2024-04-25T02:13:20.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d3e9a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41cc15c8d0 0x7f41cc15dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d3e9a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f41cc06c010 0x7f41cc06c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d3e9a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41cc15a040 con 0x7f41cc066ea0 2024-04-25T02:13:20.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d3e9a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f41cc072930 con 0x7f41cc06c010 2024-04-25T02:13:20.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d3e9a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f41cc06c9e0 con 0x7f41cc15c8d0 2024-04-25T02:13:20.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d1435640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f41cc066ea0 0x7f41cc15ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60580/0 (socket says 172.21.15.79:60580) 2024-04-25T02:13:20.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d1435640 1 -- 172.21.15.79:0/952370557 learned_addr learned my addr 172.21.15.79:0/952370557 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:20.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d1c36640 1 --2- 172.21.15.79:0/952370557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41cc15c8d0 0x7f41cc15dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d2437640 1 --2- 172.21.15.79:0/952370557 >> v2:172.21.15.189:3300/0 conn(0x7f41cc06c010 0x7f41cc06c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 -- 172.21.15.79:0/952370557 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181661840 0 0) 0x7f41cc15a040 con 0x7f41cc066ea0 2024-04-25T02:13:20.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 -- 172.21.15.79:0/952370557 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41b8003520 con 0x7f41cc066ea0 2024-04-25T02:13:20.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 -- 172.21.15.79:0/952370557 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3414753963 0 0) 0x7f41b8003520 con 0x7f41cc066ea0 2024-04-25T02:13:20.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 -- 172.21.15.79:0/952370557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41cc15c8d0 msgr2=0x7f41cc15dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 --2- 172.21.15.79:0/952370557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41cc15c8d0 0x7f41cc15dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 -- 172.21.15.79:0/952370557 >> v2:172.21.15.189:3300/0 conn(0x7f41cc06c010 msgr2=0x7f41cc06c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 --2- 172.21.15.79:0/952370557 >> v2:172.21.15.189:3300/0 conn(0x7f41cc06c010 0x7f41cc06c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 -- 172.21.15.79:0/952370557 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41cc06b250 con 0x7f41cc066ea0 2024-04-25T02:13:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 -- 172.21.15.79:0/952370557 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f41bc001670 con 0x7f41cc066ea0 2024-04-25T02:13:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 -- 172.21.15.79:0/952370557 >> v1:172.21.15.79:6789/0 conn(0x7f41cc066ea0 legacy=0x7f41cc15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 --2- 172.21.15.79:0/952370557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41cc15c8d0 0x7f41b80039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 --2- 172.21.15.79:0/952370557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41b8003f50 0x7f41b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 --2- 172.21.15.79:0/952370557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41b8004d40 0x7f41b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 -- 172.21.15.79:0/952370557 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc06c9e0 con 0x7f41b8004d40 2024-04-25T02:13:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 -- 172.21.15.79:0/952370557 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f41b800b9c0 con 0x7f41b8003f50 2024-04-25T02:13:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.525+0000 7f41d0c34640 1 -- 172.21.15.79:0/952370557 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f41b800bb40 con 0x7f41cc15c8d0 2024-04-25T02:13:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.526+0000 7f41d2437640 1 --2- 172.21.15.79:0/952370557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41b8004d40 0x7f41b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.526+0000 7f41d1c36640 1 --2- 172.21.15.79:0/952370557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41cc15c8d0 0x7f41b80039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.526+0000 7f41d1435640 1 --2- 172.21.15.79:0/952370557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41b8003f50 0x7f41b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.526+0000 7f41d2437640 1 -- 172.21.15.79:0/952370557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41cc15c8d0 msgr2=0x7f41b80039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.526+0000 7f41d2437640 1 --2- 172.21.15.79:0/952370557 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41cc15c8d0 0x7f41b80039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.526+0000 7f41d2437640 1 -- 172.21.15.79:0/952370557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41b8003f50 msgr2=0x7f41b8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.526+0000 7f41d2437640 1 --2- 172.21.15.79:0/952370557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41b8003f50 0x7f41b8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.526+0000 7f41d2437640 1 -- 172.21.15.79:0/952370557 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b8003520 con 0x7f41b8004d40 2024-04-25T02:13:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.526+0000 7f41d2437640 1 --2- 172.21.15.79:0/952370557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41b8004d40 0x7f41b80051c0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f41c400e170 tx=0x7f41b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fcc14c89fa59b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.527+0000 7f41d0c34640 1 -- 172.21.15.79:0/952370557 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c4034020 con 0x7f41b8004d40 2024-04-25T02:13:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.527+0000 7f41d0c34640 1 -- 172.21.15.79:0/952370557 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c4030430 con 0x7f41b8004d40 2024-04-25T02:13:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.527+0000 7f41d0c34640 1 -- 172.21.15.79:0/952370557 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c4009c10 con 0x7f41b8004d40 2024-04-25T02:13:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.527+0000 7f41d3e9a640 1 -- 172.21.15.79:0/952370557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41b8004d40 msgr2=0x7f41b80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.527+0000 7f41d3e9a640 1 --2- 172.21.15.79:0/952370557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41b8004d40 0x7f41b80051c0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f41c400e170 tx=0x7f41b8005830 comp rx=0 tx=0).stop 2024-04-25T02:13:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.527+0000 7f41d2437640 1 -- 172.21.15.79:0/952370557 reap_dead start 2024-04-25T02:13:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.527+0000 7f41d3e9a640 1 -- 172.21.15.79:0/952370557 shutdown_connections 2024-04-25T02:13:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.527+0000 7f41d3e9a640 1 -- 172.21.15.79:0/952370557 >> 172.21.15.79:0/952370557 conn(0x7f41cc0ccee0 msgr2=0x7f41cc0cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.527+0000 7f41d3e9a640 1 -- 172.21.15.79:0/952370557 shutdown_connections 2024-04-25T02:13:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.527+0000 7f41d3e9a640 1 -- 172.21.15.79:0/952370557 wait complete. 2024-04-25T02:13:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.528+0000 7f41d3e9a640 1 Processor -- start 2024-04-25T02:13:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.528+0000 7f41d3e9a640 1 -- start start 2024-04-25T02:13:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d3e9a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41cc14d270 0x7f41cc14da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d3e9a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41cc150530 0x7f41cc14f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d3e9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41cc06e9d0 0x7f41cc06ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d3e9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc06baf0 con 0x7f41cc06e9d0 2024-04-25T02:13:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d3e9a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc06b810 con 0x7f41cc14d270 2024-04-25T02:13:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d3e9a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f41cc15d3c0 con 0x7f41cc150530 2024-04-25T02:13:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d2437640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41cc06e9d0 0x7f41cc06ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d2437640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41cc06e9d0 0x7f41cc06ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41492/0 (socket says 172.21.15.79:41492) 2024-04-25T02:13:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d2437640 1 -- 172.21.15.79:0/2179685242 learned_addr learned my addr 172.21.15.79:0/2179685242 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d1435640 1 --2- 172.21.15.79:0/2179685242 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41cc150530 0x7f41cc14f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d1c36640 1 --2- 172.21.15.79:0/2179685242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41cc14d270 0x7f41cc14da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d2437640 1 -- 172.21.15.79:0/2179685242 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41cc150530 msgr2=0x7f41cc14f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d2437640 1 --2- 172.21.15.79:0/2179685242 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41cc150530 0x7f41cc14f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d2437640 1 -- 172.21.15.79:0/2179685242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41cc14d270 msgr2=0x7f41cc14da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d2437640 1 --2- 172.21.15.79:0/2179685242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41cc14d270 0x7f41cc14da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.529+0000 7f41d2437640 1 -- 172.21.15.79:0/2179685242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41cc14e110 con 0x7f41cc06e9d0 2024-04-25T02:13:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.530+0000 7f41d2437640 1 --2- 172.21.15.79:0/2179685242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41cc06e9d0 0x7f41cc06ee50 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f41c402af70 tx=0x7f41c4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.530+0000 7f41c27fc640 1 -- 172.21.15.79:0/2179685242 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c4034070 con 0x7f41cc06e9d0 2024-04-25T02:13:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.530+0000 7f41c27fc640 1 -- 172.21.15.79:0/2179685242 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c4003b90 con 0x7f41cc06e9d0 2024-04-25T02:13:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.530+0000 7f41d3e9a640 1 -- 172.21.15.79:0/2179685242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41cc14e3f0 con 0x7f41cc06e9d0 2024-04-25T02:13:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.530+0000 7f41c27fc640 1 -- 172.21.15.79:0/2179685242 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c4009c10 con 0x7f41cc06e9d0 2024-04-25T02:13:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.530+0000 7f41d3e9a640 1 -- 172.21.15.79:0/2179685242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41cc14e9b0 con 0x7f41cc06e9d0 2024-04-25T02:13:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.531+0000 7f41d3e9a640 1 -- 172.21.15.79:0/2179685242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41cc06f390 con 0x7f41cc06e9d0 2024-04-25T02:13:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.531+0000 7f41c27fc640 1 -- 172.21.15.79:0/2179685242 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41c4037020 con 0x7f41cc06e9d0 2024-04-25T02:13:20.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.531+0000 7f41c27fc640 1 --2- 172.21.15.79:0/2179685242 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41b006be60 0x7f41b006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:20.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.532+0000 7f41c27fc640 1 -- 172.21.15.79:0/2179685242 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f41c40aba00 con 0x7f41cc06e9d0 2024-04-25T02:13:20.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.532+0000 7f41d1c36640 1 --2- 172.21.15.79:0/2179685242 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41b006be60 0x7f41b006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:20.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.532+0000 7f41d1c36640 1 --2- 172.21.15.79:0/2179685242 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41b006be60 0x7f41b006e320 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009b00 tx=0x7f41c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:20.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.536+0000 7f41c27fc640 1 -- 172.21.15.79:0/2179685242 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f41c4047060 con 0x7f41cc06e9d0 2024-04-25T02:13:20.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.742+0000 7f41d3e9a640 1 -- 172.21.15.79:0/2179685242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f41cc068980 con 0x7f41cc06e9d0 2024-04-25T02:13:20.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.743+0000 7f41c27fc640 1 -- 172.21.15.79:0/2179685242 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) ==== 53+0+73 (secure 0 0 0) 0x7f41cc068980 con 0x7f41cc06e9d0 2024-04-25T02:13:20.750 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:13:20.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.745+0000 7f41d3e9a640 1 -- 172.21.15.79:0/2179685242 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41b006be60 msgr2=0x7f41b006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.745+0000 7f41d3e9a640 1 --2- 172.21.15.79:0/2179685242 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41b006be60 0x7f41b006e320 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009b00 tx=0x7f41c8008040 comp rx=0 tx=0).stop 2024-04-25T02:13:20.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.745+0000 7f41d3e9a640 1 -- 172.21.15.79:0/2179685242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41cc06e9d0 msgr2=0x7f41cc06ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:20.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.745+0000 7f41d3e9a640 1 --2- 172.21.15.79:0/2179685242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41cc06e9d0 0x7f41cc06ee50 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f41c402af70 tx=0x7f41c4009750 comp rx=0 tx=0).stop 2024-04-25T02:13:20.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.745+0000 7f41d3e9a640 1 -- 172.21.15.79:0/2179685242 shutdown_connections 2024-04-25T02:13:20.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.745+0000 7f41d3e9a640 1 --2- 172.21.15.79:0/2179685242 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41b006be60 0x7f41b006e320 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.745+0000 7f41d3e9a640 1 --2- 172.21.15.79:0/2179685242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41cc06e9d0 0x7f41cc06ee50 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.745+0000 7f41d3e9a640 1 --2- 172.21.15.79:0/2179685242 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41cc150530 0x7f41cc14f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.745+0000 7f41d3e9a640 1 --2- 172.21.15.79:0/2179685242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41cc14d270 0x7f41cc14da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:20.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.745+0000 7f41d3e9a640 1 -- 172.21.15.79:0/2179685242 >> 172.21.15.79:0/2179685242 conn(0x7f41cc0ccee0 msgr2=0x7f41cc0c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:20.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.745+0000 7f41d3e9a640 1 -- 172.21.15.79:0/2179685242 shutdown_connections 2024-04-25T02:13:20.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20.745+0000 7f41d3e9a640 1 -- 172.21.15.79:0/2179685242 wait complete. 2024-04-25T02:13:20.763 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:13:20.763 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:13:20.763 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:13:20.763 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:13:20.763 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:13:20.763 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:13:20.763 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:13:20.763 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:13:20.763 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:13:20.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:20.763 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:13:20.778 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:13:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:13:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:13:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:13:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:20.779 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:13:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:13:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:13:20.780 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:13:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:13:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:13:20.780 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:13:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:13:20.780 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:13:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:13:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:13:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42405sec preferred_lft 42405sec 2024-04-25T02:13:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:13:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:20.780 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:13:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:13:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:13:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:13:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:20.781 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:13:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:13:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link 2024-04-25T02:13:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:20.781 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:13:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:13:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::4c:adff:fe56:7194/64 scope link 2024-04-25T02:13:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:20.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:20.782 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:13:20.841 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:13:20.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:20.842 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:13:20.898 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:13:20.898 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:13:20.898 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:13:20.898 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:13:20.898 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:13:20.898 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:13:20.898 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:13:20.898 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:13:20.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:13:20.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:13:20.899 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:13:20.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:13:21.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:13:21.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:21.022 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:13:21.036 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:13:21.036 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:13:21.036 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:13:21.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:21.037 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:13:21.100 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:13:21.100 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:13:21.155 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:13:21.155 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:13:21.155 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:13:21.209 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:13:21.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:21.209 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:13:21.289 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:13:21.289 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:13:21.290 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:13:21.298 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:13:21.298 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:13:21.298 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:13:21.298 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:13:21.298 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:13:21.304 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:13:21.304 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:13:21.304 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:13:21.304 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:13:21.304 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:13:21.304 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:13:21.304 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:13:21.304 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:13:21.304 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:13:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:13:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:13:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:13:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:13:21.306 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:13:21.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:21.306 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:13:21.369 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:13:21.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:13:21.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:13:21.463 INFO:teuthology.orchestra.run.smithi079.stdout:client6061 2024-04-25T02:13:21.464 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:13:21.464 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:13:21.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:21.479 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-25T02:13:21.535 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:13:21.535 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-25T02:13:21.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.610+0000 7fa91d94df40 1 Processor -- start 2024-04-25T02:13:21.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.610+0000 7fa91d94df40 1 -- start start 2024-04-25T02:13:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91d94df40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55eeafa05070 0x55eeafa00950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91d94df40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eeafa19f80 0x55eeafa1db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91d94df40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafa20240 0x55eeafa1e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91d94df40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55eeafa20f50 con 0x55eeafa20240 2024-04-25T02:13:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91d94df40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55eeaf8ef640 con 0x55eeafa19f80 2024-04-25T02:13:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91d94df40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55eeafa059c0 con 0x55eeafa05070 2024-04-25T02:13:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91bc51640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafa20240 0x55eeafa1e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91bc51640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafa20240 0x55eeafa1e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41510/0 (socket says 172.21.15.79:41510) 2024-04-25T02:13:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91bc51640 1 -- 172.21.15.79:0/3605868943 learned_addr learned my addr 172.21.15.79:0/3605868943 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91ac4f640 1 --2- 172.21.15.79:0/3605868943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eeafa19f80 0x55eeafa1db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91b450640 1 --2- 172.21.15.79:0/3605868943 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55eeafa05070 0x55eeafa00950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91bc51640 1 -- 172.21.15.79:0/3605868943 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55eeafa05070 msgr2=0x55eeafa00950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91bc51640 1 --2- 172.21.15.79:0/3605868943 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55eeafa05070 0x55eeafa00950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91bc51640 1 -- 172.21.15.79:0/3605868943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eeafa19f80 msgr2=0x55eeafa1db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91bc51640 1 --2- 172.21.15.79:0/3605868943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eeafa19f80 0x55eeafa1db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91bc51640 1 -- 172.21.15.79:0/3605868943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeafa021b0 con 0x55eeafa20240 2024-04-25T02:13:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.611+0000 7fa91bc51640 1 --2- 172.21.15.79:0/3605868943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafa20240 0x55eeafa1e090 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fa914001e50 tx=0x7fa91400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1212295c84daf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.612+0000 7fa919c4d640 1 -- 172.21.15.79:0/3605868943 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914008070 con 0x55eeafa20240 2024-04-25T02:13:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.612+0000 7fa919c4d640 1 -- 172.21.15.79:0/3605868943 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa91400d500 con 0x55eeafa20240 2024-04-25T02:13:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.612+0000 7fa919c4d640 1 -- 172.21.15.79:0/3605868943 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91400d910 con 0x55eeafa20240 2024-04-25T02:13:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.612+0000 7fa91d94df40 1 -- 172.21.15.79:0/3605868943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafa20240 msgr2=0x55eeafa1e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.612+0000 7fa91d94df40 1 --2- 172.21.15.79:0/3605868943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafa20240 0x55eeafa1e090 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fa914001e50 tx=0x7fa91400b6a0 comp rx=0 tx=0).stop 2024-04-25T02:13:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.612+0000 7fa91d94df40 1 -- 172.21.15.79:0/3605868943 shutdown_connections 2024-04-25T02:13:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.612+0000 7fa91d94df40 1 --2- 172.21.15.79:0/3605868943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafa20240 0x55eeafa1e090 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.612+0000 7fa91d94df40 1 --2- 172.21.15.79:0/3605868943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eeafa19f80 0x55eeafa1db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.612+0000 7fa91d94df40 1 --2- 172.21.15.79:0/3605868943 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55eeafa05070 0x55eeafa00950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.612+0000 7fa91d94df40 1 -- 172.21.15.79:0/3605868943 >> 172.21.15.79:0/3605868943 conn(0x55eeaf974920 msgr2=0x55eeaf98df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.612+0000 7fa91d94df40 1 -- 172.21.15.79:0/3605868943 shutdown_connections 2024-04-25T02:13:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.612+0000 7fa91d94df40 1 -- 172.21.15.79:0/3605868943 wait complete. 2024-04-25T02:13:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.613+0000 7fa91d94df40 1 Processor -- start 2024-04-25T02:13:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.613+0000 7fa91d94df40 1 -- start start 2024-04-25T02:13:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.613+0000 7fa91d94df40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eeafa05070 0x55eeafa01330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.613+0000 7fa91d94df40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafa19f80 0x55eeaf9fddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.613+0000 7fa91d94df40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55eeafa20240 0x55eeaf9fe330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.613+0000 7fa91d94df40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55eeafa230b0 con 0x55eeafa19f80 2024-04-25T02:13:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.613+0000 7fa91d94df40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55eeaf98e7f0 con 0x55eeafa05070 2024-04-25T02:13:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.613+0000 7fa91d94df40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55eeafa209a0 con 0x55eeafa20240 2024-04-25T02:13:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.613+0000 7fa91ac4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafa19f80 0x55eeaf9fddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.613+0000 7fa91ac4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafa19f80 0x55eeaf9fddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41516/0 (socket says 172.21.15.79:41516) 2024-04-25T02:13:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.613+0000 7fa91ac4f640 1 -- 172.21.15.79:0/909966830 learned_addr learned my addr 172.21.15.79:0/909966830 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.614+0000 7fa91b450640 1 --2- 172.21.15.79:0/909966830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eeafa05070 0x55eeafa01330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.614+0000 7fa91bc51640 1 --2- 172.21.15.79:0/909966830 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55eeafa20240 0x55eeaf9fe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.614+0000 7fa91ac4f640 1 -- 172.21.15.79:0/909966830 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55eeafa20240 msgr2=0x55eeaf9fe330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.614+0000 7fa91ac4f640 1 --2- 172.21.15.79:0/909966830 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55eeafa20240 0x55eeaf9fe330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.614+0000 7fa91ac4f640 1 -- 172.21.15.79:0/909966830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eeafa05070 msgr2=0x55eeafa01330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.614+0000 7fa91ac4f640 1 --2- 172.21.15.79:0/909966830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eeafa05070 0x55eeafa01330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.614+0000 7fa91ac4f640 1 -- 172.21.15.79:0/909966830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeafa1eba0 con 0x55eeafa19f80 2024-04-25T02:13:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.614+0000 7fa91ac4f640 1 --2- 172.21.15.79:0/909966830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafa19f80 0x55eeaf9fddf0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa910000c00 tx=0x7fa910002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.614+0000 7fa918c4b640 1 -- 172.21.15.79:0/909966830 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910063030 con 0x55eeafa19f80 2024-04-25T02:13:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.614+0000 7fa918c4b640 1 -- 172.21.15.79:0/909966830 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa910054ba0 con 0x55eeafa19f80 2024-04-25T02:13:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.614+0000 7fa91d94df40 1 -- 172.21.15.79:0/909966830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eeafa21380 con 0x55eeafa19f80 2024-04-25T02:13:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.614+0000 7fa918c4b640 1 -- 172.21.15.79:0/909966830 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910059040 con 0x55eeafa19f80 2024-04-25T02:13:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.614+0000 7fa91d94df40 1 -- 172.21.15.79:0/909966830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeafa1ee80 con 0x55eeafa19f80 2024-04-25T02:13:21.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.615+0000 7fa918c4b640 1 -- 172.21.15.79:0/909966830 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa910066030 con 0x55eeafa19f80 2024-04-25T02:13:21.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.616+0000 7fa918c4b640 1 --2- 172.21.15.79:0/909966830 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa90806a810 0x7fa90806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.616+0000 7fa91b450640 1 --2- 172.21.15.79:0/909966830 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa90806a810 0x7fa90806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.616+0000 7fa918c4b640 1 -- 172.21.15.79:0/909966830 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7fa9100cd510 con 0x55eeafa19f80 2024-04-25T02:13:21.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.616+0000 7fa91d94df40 1 --2- 172.21.15.79:0/909966830 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55eeafa18dc0 0x55eeaf990560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.616+0000 7fa91d94df40 1 -- 172.21.15.79:0/909966830 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) -- 0x55eeafa1a620 con 0x55eeafa18dc0 2024-04-25T02:13:21.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.616+0000 7fa91b450640 1 --2- 172.21.15.79:0/909966830 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa90806a810 0x7fa90806ccd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x55eeafa1ead0 tx=0x7fa90c007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:21.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.616+0000 7fa91bc51640 1 --2- 172.21.15.79:0/909966830 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55eeafa18dc0 0x55eeaf990560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.617+0000 7fa91bc51640 1 --2- 172.21.15.79:0/909966830 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55eeafa18dc0 0x55eeaf990560 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:21.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.618+0000 7fa91bc51640 1 -- 172.21.15.79:0/909966830 <== osd.4 v2:172.21.15.189:6800/1910571406 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v74'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa91400d6b0 con 0x55eeafa18dc0 2024-04-25T02:13:21.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.619+0000 7fa91d94df40 1 -- 172.21.15.79:0/909966830 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55eeafa18dc0 msgr2=0x55eeaf990560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:21.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.619+0000 7fa91d94df40 1 --2- 172.21.15.79:0/909966830 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55eeafa18dc0 0x55eeaf990560 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:21.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.619+0000 7fa91d94df40 1 -- 172.21.15.79:0/909966830 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa90806a810 msgr2=0x7fa90806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:21.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.619+0000 7fa91d94df40 1 --2- 172.21.15.79:0/909966830 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa90806a810 0x7fa90806ccd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x55eeafa1ead0 tx=0x7fa90c007040 comp rx=0 tx=0).stop 2024-04-25T02:13:21.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.619+0000 7fa91d94df40 1 -- 172.21.15.79:0/909966830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafa19f80 msgr2=0x55eeaf9fddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:21.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.619+0000 7fa91d94df40 1 --2- 172.21.15.79:0/909966830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafa19f80 0x55eeaf9fddf0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa910000c00 tx=0x7fa910002fb0 comp rx=0 tx=0).stop 2024-04-25T02:13:21.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.619+0000 7fa91bc51640 1 -- 172.21.15.79:0/909966830 reap_dead start 2024-04-25T02:13:21.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.619+0000 7fa91d94df40 1 -- 172.21.15.79:0/909966830 shutdown_connections 2024-04-25T02:13:21.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.619+0000 7fa91d94df40 1 -- 172.21.15.79:0/909966830 >> 172.21.15.79:0/909966830 conn(0x55eeaf974920 msgr2=0x55eeafa048a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:21.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.619+0000 7fa91d94df40 1 -- 172.21.15.79:0/909966830 shutdown_connections 2024-04-25T02:13:21.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.619+0000 7fa91d94df40 1 -- 172.21.15.79:0/909966830 wait complete. 2024-04-25T02:13:21.630 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:13:21.631 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:13:21.712 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:13:21.749 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:13:21.750 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:13:21.750 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:13:21.750 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:13:21.768 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:13:21.768 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:13:21.823 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:13:21.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.952+0000 7faa77438640 1 Processor -- start 2024-04-25T02:13:21.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.952+0000 7faa77438640 1 -- start start 2024-04-25T02:13:21.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.952+0000 7faa77438640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa700d2e20 0x7faa700cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.952+0000 7faa77438640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa7006c380 con 0x7faa7015e4d0 2024-04-25T02:13:21.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.952+0000 7faa77438640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa700d1660 con 0x7faa700b3570 2024-04-25T02:13:21.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.952+0000 7faa77438640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faa700d1380 con 0x7faa700d2e20 2024-04-25T02:13:21.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa751d4640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faa7015e4d0 0x7faa7006bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60596/0 (socket says 172.21.15.79:60596) 2024-04-25T02:13:21.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa751d4640 1 -- 172.21.15.79:0/172279745 learned_addr learned my addr 172.21.15.79:0/172279745 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:21.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa67fff640 1 -- 172.21.15.79:0/172279745 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1887209125 0 0) 0x7faa7006c380 con 0x7faa7015e4d0 2024-04-25T02:13:21.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa759d5640 1 --2- 172.21.15.79:0/172279745 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa700d2e20 0x7faa700cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa67fff640 1 -- 172.21.15.79:0/172279745 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa5c003520 con 0x7faa7015e4d0 2024-04-25T02:13:21.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa67fff640 1 -- 172.21.15.79:0/172279745 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2638371666 0 0) 0x7faa5c003520 con 0x7faa7015e4d0 2024-04-25T02:13:21.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa67fff640 1 -- 172.21.15.79:0/172279745 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa700d2e20 msgr2=0x7faa700cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:21.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa67fff640 1 --2- 172.21.15.79:0/172279745 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa700d2e20 0x7faa700cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:21.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa67fff640 1 -- 172.21.15.79:0/172279745 >> v1:172.21.15.189:6789/0 conn(0x7faa700b3570 legacy=0x7faa700d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:21.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa67fff640 1 -- 172.21.15.79:0/172279745 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa700cede0 con 0x7faa7015e4d0 2024-04-25T02:13:21.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa67fff640 1 -- 172.21.15.79:0/172279745 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7faa680019f0 con 0x7faa7015e4d0 2024-04-25T02:13:21.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa67fff640 1 -- 172.21.15.79:0/172279745 >> v1:172.21.15.79:6789/0 conn(0x7faa7015e4d0 legacy=0x7faa7006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:21.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa67fff640 1 --2- 172.21.15.79:0/172279745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa5c0039e0 0x7faa5c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa67fff640 1 --2- 172.21.15.79:0/172279745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa5c004800 0x7faa5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa67fff640 1 --2- 172.21.15.79:0/172279745 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa700d2e20 0x7faa5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa67fff640 1 -- 172.21.15.79:0/172279745 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faa700d1380 con 0x7faa5c004800 2024-04-25T02:13:21.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa67fff640 1 -- 172.21.15.79:0/172279745 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c00baa0 con 0x7faa5c0039e0 2024-04-25T02:13:21.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa67fff640 1 -- 172.21.15.79:0/172279745 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faa5c00bca0 con 0x7faa700d2e20 2024-04-25T02:13:21.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa749d3640 1 --2- 172.21.15.79:0/172279745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa5c004800 0x7faa5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa751d4640 1 --2- 172.21.15.79:0/172279745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa5c0039e0 0x7faa5c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.953+0000 7faa759d5640 1 --2- 172.21.15.79:0/172279745 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa700d2e20 0x7faa5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.954+0000 7faa749d3640 1 -- 172.21.15.79:0/172279745 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa700d2e20 msgr2=0x7faa5c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.954+0000 7faa749d3640 1 --2- 172.21.15.79:0/172279745 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa700d2e20 0x7faa5c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.954+0000 7faa749d3640 1 -- 172.21.15.79:0/172279745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa5c0039e0 msgr2=0x7faa5c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.954+0000 7faa749d3640 1 --2- 172.21.15.79:0/172279745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa5c0039e0 0x7faa5c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.954+0000 7faa749d3640 1 -- 172.21.15.79:0/172279745 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5c003520 con 0x7faa5c004800 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.954+0000 7faa749d3640 1 --2- 172.21.15.79:0/172279745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa5c004800 0x7faa5c004c80 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7faa60001330 tx=0x7faa5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31f595271c82056 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.954+0000 7faa67fff640 1 -- 172.21.15.79:0/172279745 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60001370 con 0x7faa5c004800 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.954+0000 7faa67fff640 1 -- 172.21.15.79:0/172279745 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa600052d0 con 0x7faa5c004800 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.954+0000 7faa67fff640 1 -- 172.21.15.79:0/172279745 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60003830 con 0x7faa5c004800 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.955+0000 7faa77438640 1 -- 172.21.15.79:0/172279745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa5c004800 msgr2=0x7faa5c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.955+0000 7faa77438640 1 --2- 172.21.15.79:0/172279745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa5c004800 0x7faa5c004c80 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7faa60001330 tx=0x7faa5c005830 comp rx=0 tx=0).stop 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.955+0000 7faa759d5640 1 -- 172.21.15.79:0/172279745 reap_dead start 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.955+0000 7faa77438640 1 -- 172.21.15.79:0/172279745 shutdown_connections 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.955+0000 7faa77438640 1 -- 172.21.15.79:0/172279745 >> 172.21.15.79:0/172279745 conn(0x7faa7009d460 msgr2=0x7faa700d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:21.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.955+0000 7faa77438640 1 -- 172.21.15.79:0/172279745 shutdown_connections 2024-04-25T02:13:21.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.955+0000 7faa77438640 1 -- 172.21.15.79:0/172279745 wait complete. 2024-04-25T02:13:21.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.956+0000 7faa77438640 1 Processor -- start 2024-04-25T02:13:21.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.956+0000 7faa77438640 1 -- start start 2024-04-25T02:13:21.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa77438640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa5c004800 0x7faa700cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa77438640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa70157eb0 0x7faa700c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa77438640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa70157670 0x7faa700c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa77438640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faa700d20d0 con 0x7faa70157670 2024-04-25T02:13:21.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa77438640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faa7015e8b0 con 0x7faa70157eb0 2024-04-25T02:13:21.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa77438640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faa700d2250 con 0x7faa5c004800 2024-04-25T02:13:21.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa759d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa70157670 0x7faa700c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa759d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa70157670 0x7faa700c9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41542/0 (socket says 172.21.15.79:41542) 2024-04-25T02:13:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa759d5640 1 -- 172.21.15.79:0/3543194818 learned_addr learned my addr 172.21.15.79:0/3543194818 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa751d4640 1 --2- 172.21.15.79:0/3543194818 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa5c004800 0x7faa700cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa749d3640 1 --2- 172.21.15.79:0/3543194818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa70157eb0 0x7faa700c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa759d5640 1 -- 172.21.15.79:0/3543194818 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa5c004800 msgr2=0x7faa700cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa759d5640 1 --2- 172.21.15.79:0/3543194818 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa5c004800 0x7faa700cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa759d5640 1 -- 172.21.15.79:0/3543194818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa70157eb0 msgr2=0x7faa700c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa759d5640 1 --2- 172.21.15.79:0/3543194818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa70157eb0 0x7faa700c9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa759d5640 1 -- 172.21.15.79:0/3543194818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa700d0530 con 0x7faa70157670 2024-04-25T02:13:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.957+0000 7faa759d5640 1 --2- 172.21.15.79:0/3543194818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa70157670 0x7faa700c9030 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7faa6c011860 tx=0x7faa6c011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.958+0000 7faa65ffb640 1 -- 172.21.15.79:0/3543194818 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c004240 con 0x7faa70157670 2024-04-25T02:13:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.958+0000 7faa65ffb640 1 -- 172.21.15.79:0/3543194818 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6c01b070 con 0x7faa70157670 2024-04-25T02:13:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.958+0000 7faa77438640 1 -- 172.21.15.79:0/3543194818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa70160b30 con 0x7faa70157670 2024-04-25T02:13:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.958+0000 7faa65ffb640 1 -- 172.21.15.79:0/3543194818 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00f7a0 con 0x7faa70157670 2024-04-25T02:13:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.958+0000 7faa77438640 1 -- 172.21.15.79:0/3543194818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa700d0810 con 0x7faa70157670 2024-04-25T02:13:21.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.959+0000 7faa77438640 1 -- 172.21.15.79:0/3543194818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa700690a0 con 0x7faa70157670 2024-04-25T02:13:21.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.959+0000 7faa65ffb640 1 -- 172.21.15.79:0/3543194818 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa6c012040 con 0x7faa70157670 2024-04-25T02:13:21.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.960+0000 7faa65ffb640 1 --2- 172.21.15.79:0/3543194818 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa5406be30 0x7faa5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:21.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.960+0000 7faa65ffb640 1 -- 172.21.15.79:0/3543194818 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7faa6c08ad20 con 0x7faa70157670 2024-04-25T02:13:21.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.960+0000 7faa751d4640 1 --2- 172.21.15.79:0/3543194818 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa5406be30 0x7faa5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:21.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.960+0000 7faa751d4640 1 --2- 172.21.15.79:0/3543194818 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa5406be30 0x7faa5406e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faa680013d0 tx=0x7faa68006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:21.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:21.965+0000 7faa65ffb640 1 -- 172.21.15.79:0/3543194818 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faa6c0595b0 con 0x7faa70157670 2024-04-25T02:13:22.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.138+0000 7faa77438640 1 -- 172.21.15.79:0/3543194818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa700d1920 con 0x7faa70157670 2024-04-25T02:13:22.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.139+0000 7faa65ffb640 1 -- 172.21.15.79:0/3543194818 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16907 (secure 0 0 0) 0x7faa6c058eb0 con 0x7faa70157670 2024-04-25T02:13:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:22.147 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:12:41.808973+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:11:54.161817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T02:11:54.917049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.22","mappings":[{"from":6,"to":0}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.189:6835/469348969":"2024-04-26T02:12:09.471251+0000","172.21.15.189:6833/469348969":"2024-04-26T02:12:09.471251+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:13:22.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.141+0000 7faa77438640 1 -- 172.21.15.79:0/3543194818 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa5406be30 msgr2=0x7faa5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.141+0000 7faa77438640 1 --2- 172.21.15.79:0/3543194818 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa5406be30 0x7faa5406e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faa680013d0 tx=0x7faa68006040 comp rx=0 tx=0).stop 2024-04-25T02:13:22.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.141+0000 7faa77438640 1 -- 172.21.15.79:0/3543194818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa70157670 msgr2=0x7faa700c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.141+0000 7faa77438640 1 --2- 172.21.15.79:0/3543194818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa70157670 0x7faa700c9030 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7faa6c011860 tx=0x7faa6c011d20 comp rx=0 tx=0).stop 2024-04-25T02:13:22.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.141+0000 7faa77438640 1 -- 172.21.15.79:0/3543194818 shutdown_connections 2024-04-25T02:13:22.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.141+0000 7faa77438640 1 --2- 172.21.15.79:0/3543194818 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa5406be30 0x7faa5406e2f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.141+0000 7faa77438640 1 --2- 172.21.15.79:0/3543194818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa70157670 0x7faa700c9030 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.141+0000 7faa77438640 1 --2- 172.21.15.79:0/3543194818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa70157eb0 0x7faa700c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.141+0000 7faa77438640 1 --2- 172.21.15.79:0/3543194818 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa5c004800 0x7faa700cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.141+0000 7faa77438640 1 -- 172.21.15.79:0/3543194818 >> 172.21.15.79:0/3543194818 conn(0x7faa7009d460 msgr2=0x7faa700b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:22.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.143+0000 7faa77438640 1 -- 172.21.15.79:0/3543194818 shutdown_connections 2024-04-25T02:13:22.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.143+0000 7faa77438640 1 -- 172.21.15.79:0/3543194818 wait complete. 2024-04-25T02:13:22.162 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:11:54.161817+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:11:54.917049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:13:22.162 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:13:22.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.254+0000 7fb5ec796640 1 Processor -- start 2024-04-25T02:13:22.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.254+0000 7fb5ec796640 1 -- start start 2024-04-25T02:13:22.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.255+0000 7fb5ec796640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5e415e4f0 0x7fb5e40d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.255+0000 7fb5ec796640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e40d1ee0 con 0x7fb5e40cf7f0 2024-04-25T02:13:22.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.255+0000 7fb5ec796640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e40d21c0 con 0x7fb5e40d10c0 2024-04-25T02:13:22.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.255+0000 7fb5ec796640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e40d24a0 con 0x7fb5e415e4f0 2024-04-25T02:13:22.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.256+0000 7fb5e9d31640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb5e40cf7f0 0x7fb5e40d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60602/0 (socket says 172.21.15.79:60602) 2024-04-25T02:13:22.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.256+0000 7fb5ead33640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fb5e40d10c0 0x7fb5e406bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:55408/0 (socket says 172.21.15.79:55408) 2024-04-25T02:13:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.256+0000 7fb5e9d31640 1 -- 172.21.15.79:0/4274969596 learned_addr learned my addr 172.21.15.79:0/4274969596 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.256+0000 7fb5ea532640 1 --2- 172.21.15.79:0/4274969596 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5e415e4f0 0x7fb5e40d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.256+0000 7fb5e9530640 1 -- 172.21.15.79:0/4274969596 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706606856 0 0) 0x7fb5e40d1ee0 con 0x7fb5e40cf7f0 2024-04-25T02:13:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.256+0000 7fb5e9530640 1 -- 172.21.15.79:0/4274969596 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5d0003520 con 0x7fb5e40cf7f0 2024-04-25T02:13:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.256+0000 7fb5e9530640 1 -- 172.21.15.79:0/4274969596 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3890712793 0 0) 0x7fb5e40d21c0 con 0x7fb5e40d10c0 2024-04-25T02:13:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.256+0000 7fb5e9530640 1 -- 172.21.15.79:0/4274969596 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5e40d1ee0 con 0x7fb5e40d10c0 2024-04-25T02:13:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.256+0000 7fb5ea532640 1 -- 172.21.15.79:0/4274969596 >> v1:172.21.15.189:6789/0 conn(0x7fb5e40d10c0 legacy=0x7fb5e406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.256+0000 7fb5ea532640 1 -- 172.21.15.79:0/4274969596 >> v1:172.21.15.79:6789/0 conn(0x7fb5e40cf7f0 legacy=0x7fb5e40d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.256+0000 7fb5ea532640 1 -- 172.21.15.79:0/4274969596 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e40d2780 con 0x7fb5e415e4f0 2024-04-25T02:13:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.257+0000 7fb5ea532640 1 --2- 172.21.15.79:0/4274969596 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5e415e4f0 0x7fb5e40d2ca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009dc0 tx=0x7fb5e002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11804b19b5841579 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.257+0000 7fb5e9530640 1 -- 172.21.15.79:0/4274969596 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0007740 con 0x7fb5e415e4f0 2024-04-25T02:13:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.257+0000 7fb5e9530640 1 -- 172.21.15.79:0/4274969596 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e00078e0 con 0x7fb5e415e4f0 2024-04-25T02:13:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.257+0000 7fb5e9530640 1 -- 172.21.15.79:0/4274969596 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0007c90 con 0x7fb5e415e4f0 2024-04-25T02:13:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.257+0000 7fb5ec796640 1 -- 172.21.15.79:0/4274969596 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5e415e4f0 msgr2=0x7fb5e40d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.257+0000 7fb5ec796640 1 --2- 172.21.15.79:0/4274969596 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5e415e4f0 0x7fb5e40d2ca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009dc0 tx=0x7fb5e002a6d0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.258+0000 7fb5ec796640 1 -- 172.21.15.79:0/4274969596 shutdown_connections 2024-04-25T02:13:22.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.258+0000 7fb5ec796640 1 --2- 172.21.15.79:0/4274969596 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5e415e4f0 0x7fb5e40d2ca0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.258+0000 7fb5ec796640 1 -- 172.21.15.79:0/4274969596 >> 172.21.15.79:0/4274969596 conn(0x7fb5e409d4a0 msgr2=0x7fb5e40d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:22.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.258+0000 7fb5ec796640 1 -- 172.21.15.79:0/4274969596 shutdown_connections 2024-04-25T02:13:22.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.258+0000 7fb5ec796640 1 -- 172.21.15.79:0/4274969596 wait complete. 2024-04-25T02:13:22.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.259+0000 7fb5ec796640 1 Processor -- start 2024-04-25T02:13:22.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.259+0000 7fb5ec796640 1 -- start start 2024-04-25T02:13:22.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.259+0000 7fb5ec796640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5e40cf7f0 0x7fb5e415a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.259+0000 7fb5ec796640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5e40d10c0 0x7fb5e40b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.259+0000 7fb5ec796640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5e415e4f0 0x7fb5e40b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.259+0000 7fb5ec796640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e40cfc50 con 0x7fb5e40d10c0 2024-04-25T02:13:22.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.259+0000 7fb5ec796640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e40d50f0 con 0x7fb5e415e4f0 2024-04-25T02:13:22.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.259+0000 7fb5ec796640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e40cfdd0 con 0x7fb5e40cf7f0 2024-04-25T02:13:22.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5e9d31640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5e40d10c0 0x7fb5e40b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:22.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5e9d31640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5e40d10c0 0x7fb5e40b87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41548/0 (socket says 172.21.15.79:41548) 2024-04-25T02:13:22.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5e9d31640 1 -- 172.21.15.79:0/3586971520 learned_addr learned my addr 172.21.15.79:0/3586971520 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:22.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5ea532640 1 --2- 172.21.15.79:0/3586971520 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5e40cf7f0 0x7fb5e415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:22.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5ead33640 1 --2- 172.21.15.79:0/3586971520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5e415e4f0 0x7fb5e40b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:22.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5e9d31640 1 -- 172.21.15.79:0/3586971520 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5e40cf7f0 msgr2=0x7fb5e415a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5e9d31640 1 --2- 172.21.15.79:0/3586971520 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5e40cf7f0 0x7fb5e415a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5e9d31640 1 -- 172.21.15.79:0/3586971520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5e415e4f0 msgr2=0x7fb5e40b8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5e9d31640 1 --2- 172.21.15.79:0/3586971520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5e415e4f0 0x7fb5e40b8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5e9d31640 1 -- 172.21.15.79:0/3586971520 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e4156fc0 con 0x7fb5e40d10c0 2024-04-25T02:13:22.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5e9d31640 1 --2- 172.21.15.79:0/3586971520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5e40d10c0 0x7fb5e40b87a0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400c440 tx=0x7fb5d400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:22.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5daffd640 1 -- 172.21.15.79:0/3586971520 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4017070 con 0x7fb5e40d10c0 2024-04-25T02:13:22.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5daffd640 1 -- 172.21.15.79:0/3586971520 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d4005ce0 con 0x7fb5e40d10c0 2024-04-25T02:13:22.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5daffd640 1 -- 172.21.15.79:0/3586971520 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4007270 con 0x7fb5e40d10c0 2024-04-25T02:13:22.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5ec796640 1 -- 172.21.15.79:0/3586971520 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e40b9360 con 0x7fb5e40d10c0 2024-04-25T02:13:22.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.260+0000 7fb5ec796640 1 -- 172.21.15.79:0/3586971520 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e40c92a0 con 0x7fb5e40d10c0 2024-04-25T02:13:22.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.261+0000 7fb5ec796640 1 -- 172.21.15.79:0/3586971520 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e40686c0 con 0x7fb5e40d10c0 2024-04-25T02:13:22.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.262+0000 7fb5daffd640 1 -- 172.21.15.79:0/3586971520 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5d401a070 con 0x7fb5e40d10c0 2024-04-25T02:13:22.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.262+0000 7fb5daffd640 1 --2- 172.21.15.79:0/3586971520 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb5c806be30 0x7fb5c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.262+0000 7fb5daffd640 1 -- 172.21.15.79:0/3586971520 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7fb5d408a130 con 0x7fb5e40d10c0 2024-04-25T02:13:22.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.262+0000 7fb5ea532640 1 --2- 172.21.15.79:0/3586971520 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb5c806be30 0x7fb5c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:22.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.263+0000 7fb5ea532640 1 --2- 172.21.15.79:0/3586971520 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb5c806be30 0x7fb5c806e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0034000 tx=0x7fb5e002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:22.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.266+0000 7fb5daffd640 1 -- 172.21.15.79:0/3586971520 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb5d4058410 con 0x7fb5e40d10c0 2024-04-25T02:13:22.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.438+0000 7fb5ec796640 1 -- 172.21.15.79:0/3586971520 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb5e40d1a30 con 0x7fb5e40d10c0 2024-04-25T02:13:22.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.438+0000 7fb5daffd640 1 -- 172.21.15.79:0/3586971520 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7fb5d405c710 con 0x7fb5e40d10c0 2024-04-25T02:13:22.444 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:13:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.440+0000 7fb5ec796640 1 -- 172.21.15.79:0/3586971520 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb5c806be30 msgr2=0x7fb5c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.440+0000 7fb5ec796640 1 --2- 172.21.15.79:0/3586971520 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb5c806be30 0x7fb5c806e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0034000 tx=0x7fb5e002f000 comp rx=0 tx=0).stop 2024-04-25T02:13:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.440+0000 7fb5ec796640 1 -- 172.21.15.79:0/3586971520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5e40d10c0 msgr2=0x7fb5e40b87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.440+0000 7fb5ec796640 1 --2- 172.21.15.79:0/3586971520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5e40d10c0 0x7fb5e40b87a0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400c440 tx=0x7fb5d400c900 comp rx=0 tx=0).stop 2024-04-25T02:13:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.440+0000 7fb5ec796640 1 -- 172.21.15.79:0/3586971520 shutdown_connections 2024-04-25T02:13:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.440+0000 7fb5ec796640 1 --2- 172.21.15.79:0/3586971520 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb5c806be30 0x7fb5c806e2f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.440+0000 7fb5ec796640 1 --2- 172.21.15.79:0/3586971520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5e415e4f0 0x7fb5e40b8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.440+0000 7fb5ec796640 1 --2- 172.21.15.79:0/3586971520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5e40d10c0 0x7fb5e40b87a0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.440+0000 7fb5ec796640 1 --2- 172.21.15.79:0/3586971520 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5e40cf7f0 0x7fb5e415a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.440+0000 7fb5ec796640 1 -- 172.21.15.79:0/3586971520 >> 172.21.15.79:0/3586971520 conn(0x7fb5e409d4a0 msgr2=0x7fb5e415ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.440+0000 7fb5ec796640 1 -- 172.21.15.79:0/3586971520 shutdown_connections 2024-04-25T02:13:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.440+0000 7fb5ec796640 1 -- 172.21.15.79:0/3586971520 wait complete. 2024-04-25T02:13:22.457 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:13:22.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.551+0000 7f89af49a640 1 Processor -- start 2024-04-25T02:13:22.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.552+0000 7f89af49a640 1 -- start start 2024-04-25T02:13:22.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.552+0000 7f89af49a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f89a815e4f0 0x7f89a80d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.552+0000 7f89af49a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89a80d10c0 0x7f89a806bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.552+0000 7f89af49a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a80d1ee0 con 0x7f89a80cf7f0 2024-04-25T02:13:22.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.552+0000 7f89af49a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f89a80d21c0 con 0x7f89a80d10c0 2024-04-25T02:13:22.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.552+0000 7f89af49a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f89a80d24a0 con 0x7f89a815e4f0 2024-04-25T02:13:22.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.553+0000 7f89ada37640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89a80d10c0 0x7f89a806bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:22.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.553+0000 7f89aca35640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f89a80cf7f0 0x7f89a80d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60610/0 (socket says 172.21.15.79:60610) 2024-04-25T02:13:22.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.553+0000 7f89aca35640 1 -- 172.21.15.79:0/2660515554 learned_addr learned my addr 172.21.15.79:0/2660515554 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:22.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.553+0000 7f89ad236640 1 --2- 172.21.15.79:0/2660515554 >> v2:172.21.15.189:3300/0 conn(0x7f89a815e4f0 0x7f89a80d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:22.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.553+0000 7f89ada37640 1 -- 172.21.15.79:0/2660515554 >> v2:172.21.15.189:3300/0 conn(0x7f89a815e4f0 msgr2=0x7f89a80d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:22.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.553+0000 7f89ada37640 1 --2- 172.21.15.79:0/2660515554 >> v2:172.21.15.189:3300/0 conn(0x7f89a815e4f0 0x7f89a80d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.553+0000 7f89ada37640 1 -- 172.21.15.79:0/2660515554 >> v1:172.21.15.79:6789/0 conn(0x7f89a80cf7f0 legacy=0x7f89a80d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.553+0000 7f899ffff640 1 -- 172.21.15.79:0/2660515554 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300226046 0 0) 0x7f89a80d1ee0 con 0x7f89a80cf7f0 2024-04-25T02:13:22.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.553+0000 7f89ada37640 1 -- 172.21.15.79:0/2660515554 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a80d2780 con 0x7f89a80d10c0 2024-04-25T02:13:22.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.553+0000 7f89ad236640 1 --2- 172.21.15.79:0/2660515554 >> v2:172.21.15.189:3300/0 conn(0x7f89a815e4f0 0x7f89a80d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:22.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.554+0000 7f89ada37640 1 --2- 172.21.15.79:0/2660515554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a80d10c0 0x7f89a806bc30 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009d90 tx=0x7f89a002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de7502742e224b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.554+0000 7f899ffff640 1 -- 172.21.15.79:0/2660515554 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0007740 con 0x7f89a80d10c0 2024-04-25T02:13:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.554+0000 7f899ffff640 1 -- 172.21.15.79:0/2660515554 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a00078e0 con 0x7f89a80d10c0 2024-04-25T02:13:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.554+0000 7f899ffff640 1 -- 172.21.15.79:0/2660515554 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0007cb0 con 0x7f89a80d10c0 2024-04-25T02:13:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.554+0000 7f89af49a640 1 -- 172.21.15.79:0/2660515554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a80d10c0 msgr2=0x7f89a806bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.554+0000 7f89af49a640 1 --2- 172.21.15.79:0/2660515554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a80d10c0 0x7f89a806bc30 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009d90 tx=0x7f89a002a6a0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.554+0000 7f89af49a640 1 -- 172.21.15.79:0/2660515554 shutdown_connections 2024-04-25T02:13:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.554+0000 7f89af49a640 1 --2- 172.21.15.79:0/2660515554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a80d10c0 0x7f89a806bc30 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.554+0000 7f89af49a640 1 --2- 172.21.15.79:0/2660515554 >> v2:172.21.15.189:3300/0 conn(0x7f89a815e4f0 0x7f89a80d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.554+0000 7f89af49a640 1 -- 172.21.15.79:0/2660515554 >> 172.21.15.79:0/2660515554 conn(0x7f89a809d4a0 msgr2=0x7f89a80d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.554+0000 7f89af49a640 1 -- 172.21.15.79:0/2660515554 shutdown_connections 2024-04-25T02:13:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.554+0000 7f89af49a640 1 -- 172.21.15.79:0/2660515554 wait complete. 2024-04-25T02:13:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.555+0000 7f89af49a640 1 Processor -- start 2024-04-25T02:13:22.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.555+0000 7f89af49a640 1 -- start start 2024-04-25T02:13:22.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.556+0000 7f89af49a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89a80cf7f0 0x7f89a80b8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.556+0000 7f89af49a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a80d10c0 0x7f89a814c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.556+0000 7f89af49a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89a815e4f0 0x7f89a80b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.556+0000 7f89af49a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f89a80cfc80 con 0x7f89a80d10c0 2024-04-25T02:13:22.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.556+0000 7f89af49a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f89a80d50f0 con 0x7f89a815e4f0 2024-04-25T02:13:22.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.556+0000 7f89af49a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f89a80cfe00 con 0x7f89a80cf7f0 2024-04-25T02:13:22.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.556+0000 7f89aca35640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a80d10c0 0x7f89a814c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:22.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.556+0000 7f89aca35640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a80d10c0 0x7f89a814c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41558/0 (socket says 172.21.15.79:41558) 2024-04-25T02:13:22.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.556+0000 7f89aca35640 1 -- 172.21.15.79:0/109494806 learned_addr learned my addr 172.21.15.79:0/109494806 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:22.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.556+0000 7f89aca35640 1 -- 172.21.15.79:0/109494806 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89a80cf7f0 msgr2=0x7f89a80b8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.556+0000 7f89aca35640 1 --2- 172.21.15.79:0/109494806 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89a80cf7f0 0x7f89a80b8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.556+0000 7f89aca35640 1 -- 172.21.15.79:0/109494806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89a815e4f0 msgr2=0x7f89a80b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.556+0000 7f89aca35640 1 --2- 172.21.15.79:0/109494806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89a815e4f0 0x7f89a80b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.557+0000 7f89aca35640 1 -- 172.21.15.79:0/109494806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a80b7670 con 0x7f89a80d10c0 2024-04-25T02:13:22.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.557+0000 7f89aca35640 1 --2- 172.21.15.79:0/109494806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a80d10c0 0x7f89a814c500 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f899800c430 tx=0x7f899800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:22.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.557+0000 7f899dffb640 1 -- 172.21.15.79:0/109494806 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89980074e0 con 0x7f89a80d10c0 2024-04-25T02:13:22.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.557+0000 7f899dffb640 1 -- 172.21.15.79:0/109494806 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89980047e0 con 0x7f89a80d10c0 2024-04-25T02:13:22.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.557+0000 7f899dffb640 1 -- 172.21.15.79:0/109494806 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998004bd0 con 0x7f89a80d10c0 2024-04-25T02:13:22.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.557+0000 7f89af49a640 1 -- 172.21.15.79:0/109494806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a80b7950 con 0x7f89a80d10c0 2024-04-25T02:13:22.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.557+0000 7f89af49a640 1 -- 172.21.15.79:0/109494806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a80b7f10 con 0x7f89a80d10c0 2024-04-25T02:13:22.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.558+0000 7f89af49a640 1 -- 172.21.15.79:0/109494806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a80686c0 con 0x7f89a80d10c0 2024-04-25T02:13:22.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.558+0000 7f899dffb640 1 -- 172.21.15.79:0/109494806 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8998011070 con 0x7f89a80d10c0 2024-04-25T02:13:22.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.558+0000 7f899dffb640 1 --2- 172.21.15.79:0/109494806 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f898c06be30 0x7f898c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.559+0000 7f899dffb640 1 -- 172.21.15.79:0/109494806 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f899808ab60 con 0x7f89a80d10c0 2024-04-25T02:13:22.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.559+0000 7f89ad236640 1 --2- 172.21.15.79:0/109494806 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f898c06be30 0x7f898c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:22.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.559+0000 7f89ad236640 1 --2- 172.21.15.79:0/109494806 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f898c06be30 0x7f898c06e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f89a4006fd0 tx=0x7f89a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:22.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.563+0000 7f899dffb640 1 -- 172.21.15.79:0/109494806 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8998059480 con 0x7f89a80d10c0 2024-04-25T02:13:22.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.733+0000 7f89af49a640 1 -- 172.21.15.79:0/109494806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f89a80690a0 con 0x7f89a80d10c0 2024-04-25T02:13:22.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.733+0000 7f899dffb640 1 -- 172.21.15.79:0/109494806 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) ==== 104+0+11 (secure 0 0 0) 0x7f8998058d80 con 0x7f89a80d10c0 2024-04-25T02:13:22.740 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:13:22.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.735+0000 7f89af49a640 1 -- 172.21.15.79:0/109494806 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f898c06be30 msgr2=0x7f898c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.735+0000 7f89af49a640 1 --2- 172.21.15.79:0/109494806 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f898c06be30 0x7f898c06e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f89a4006fd0 tx=0x7f89a4008040 comp rx=0 tx=0).stop 2024-04-25T02:13:22.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.735+0000 7f89af49a640 1 -- 172.21.15.79:0/109494806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a80d10c0 msgr2=0x7f89a814c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.735+0000 7f89af49a640 1 --2- 172.21.15.79:0/109494806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a80d10c0 0x7f89a814c500 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f899800c430 tx=0x7f899800c8f0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.735+0000 7f89af49a640 1 -- 172.21.15.79:0/109494806 shutdown_connections 2024-04-25T02:13:22.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.735+0000 7f89af49a640 1 --2- 172.21.15.79:0/109494806 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f898c06be30 0x7f898c06e2f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.735+0000 7f89af49a640 1 --2- 172.21.15.79:0/109494806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89a815e4f0 0x7f89a80b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.735+0000 7f89af49a640 1 --2- 172.21.15.79:0/109494806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a80d10c0 0x7f89a814c500 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.735+0000 7f89af49a640 1 --2- 172.21.15.79:0/109494806 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89a80cf7f0 0x7f89a80b8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.735+0000 7f89af49a640 1 -- 172.21.15.79:0/109494806 >> 172.21.15.79:0/109494806 conn(0x7f89a809d4a0 msgr2=0x7f89a806cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:22.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.736+0000 7f89af49a640 1 -- 172.21.15.79:0/109494806 shutdown_connections 2024-04-25T02:13:22.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.736+0000 7f89af49a640 1 -- 172.21.15.79:0/109494806 wait complete. 2024-04-25T02:13:22.752 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:13:22.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.845+0000 7fde10b14640 1 Processor -- start 2024-04-25T02:13:22.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.845+0000 7fde10b14640 1 -- start start 2024-04-25T02:13:22.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.846+0000 7fde10b14640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fde0c0cf7a0 0x7fde0c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.846+0000 7fde10b14640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fde0c06e6b0 0x7fde0c15b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.846+0000 7fde10b14640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde0c15ec20 con 0x7fde0c06b2f0 2024-04-25T02:13:22.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.846+0000 7fde10b14640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fde0c15f830 con 0x7fde0c0cf7a0 2024-04-25T02:13:22.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.846+0000 7fde10b14640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fde0c15ef00 con 0x7fde0c06e6b0 2024-04-25T02:13:22.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.846+0000 7fde0a59c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fde0c06b2f0 0x7fde0c06b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60624/0 (socket says 172.21.15.79:60624) 2024-04-25T02:13:22.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.846+0000 7fde0a59c640 1 -- 172.21.15.79:0/726187590 learned_addr learned my addr 172.21.15.79:0/726187590 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:22.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.846+0000 7fde09d9b640 1 --2- 172.21.15.79:0/726187590 >> v2:172.21.15.79:3300/0 conn(0x7fde0c0cf7a0 0x7fde0c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:22.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.846+0000 7fde0ad9d640 1 --2- 172.21.15.79:0/726187590 >> v2:172.21.15.189:3300/0 conn(0x7fde0c06e6b0 0x7fde0c15b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:22.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.846+0000 7fde0959a640 1 -- 172.21.15.79:0/726187590 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545149307 0 0) 0x7fde0c15ec20 con 0x7fde0c06b2f0 2024-04-25T02:13:22.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.846+0000 7fde0959a640 1 -- 172.21.15.79:0/726187590 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddf4003520 con 0x7fde0c06b2f0 2024-04-25T02:13:22.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.847+0000 7fde09d9b640 1 -- 172.21.15.79:0/726187590 >> v2:172.21.15.189:3300/0 conn(0x7fde0c06e6b0 msgr2=0x7fde0c15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:22.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.847+0000 7fde09d9b640 1 --2- 172.21.15.79:0/726187590 >> v2:172.21.15.189:3300/0 conn(0x7fde0c06e6b0 0x7fde0c15b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.847+0000 7fde09d9b640 1 -- 172.21.15.79:0/726187590 >> v1:172.21.15.79:6789/0 conn(0x7fde0c06b2f0 legacy=0x7fde0c06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.847+0000 7fde09d9b640 1 -- 172.21.15.79:0/726187590 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c15f1e0 con 0x7fde0c0cf7a0 2024-04-25T02:13:22.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.847+0000 7fde09d9b640 1 --2- 172.21.15.79:0/726187590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c0cf7a0 0x7fde0c0b4b50 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fde0c15f9b0 tx=0x7fde0002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd8e1fd925a22eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:22.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.847+0000 7fde0959a640 1 -- 172.21.15.79:0/726187590 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde00037070 con 0x7fde0c0cf7a0 2024-04-25T02:13:22.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.847+0000 7fde0959a640 1 -- 172.21.15.79:0/726187590 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde00032440 con 0x7fde0c0cf7a0 2024-04-25T02:13:22.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.847+0000 7fde0959a640 1 -- 172.21.15.79:0/726187590 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0002ae60 con 0x7fde0c0cf7a0 2024-04-25T02:13:22.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.848+0000 7fde10b14640 1 -- 172.21.15.79:0/726187590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c0cf7a0 msgr2=0x7fde0c0b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.848+0000 7fde10b14640 1 --2- 172.21.15.79:0/726187590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c0cf7a0 0x7fde0c0b4b50 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fde0c15f9b0 tx=0x7fde0002a110 comp rx=0 tx=0).stop 2024-04-25T02:13:22.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.848+0000 7fde10b14640 1 -- 172.21.15.79:0/726187590 shutdown_connections 2024-04-25T02:13:22.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.848+0000 7fde10b14640 1 --2- 172.21.15.79:0/726187590 >> v2:172.21.15.189:3300/0 conn(0x7fde0c06e6b0 0x7fde0c15b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.848+0000 7fde10b14640 1 --2- 172.21.15.79:0/726187590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c0cf7a0 0x7fde0c0b4b50 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.848+0000 7fde10b14640 1 -- 172.21.15.79:0/726187590 >> 172.21.15.79:0/726187590 conn(0x7fde0c0b1cd0 msgr2=0x7fde0c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:22.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.848+0000 7fde10b14640 1 -- 172.21.15.79:0/726187590 shutdown_connections 2024-04-25T02:13:22.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.848+0000 7fde10b14640 1 -- 172.21.15.79:0/726187590 wait complete. 2024-04-25T02:13:22.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.849+0000 7fde10b14640 1 Processor -- start 2024-04-25T02:13:22.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.849+0000 7fde10b14640 1 -- start start 2024-04-25T02:13:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.850+0000 7fde10b14640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde0c06b2f0 0x7fde0c154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.850+0000 7fde10b14640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde0c06e6b0 0x7fde0c15a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.850+0000 7fde10b14640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c0cf7a0 0x7fde0c15a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.850+0000 7fde10b14640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c06d160 con 0x7fde0c0cf7a0 2024-04-25T02:13:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.850+0000 7fde10b14640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c06cfe0 con 0x7fde0c06b2f0 2024-04-25T02:13:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.850+0000 7fde10b14640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fde0c15b810 con 0x7fde0c06e6b0 2024-04-25T02:13:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.850+0000 7fde0ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c0cf7a0 0x7fde0c15a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.850+0000 7fde0ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c0cf7a0 0x7fde0c15a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41564/0 (socket says 172.21.15.79:41564) 2024-04-25T02:13:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.850+0000 7fde0ad9d640 1 -- 172.21.15.79:0/2347447673 learned_addr learned my addr 172.21.15.79:0/2347447673 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.850+0000 7fde0ad9d640 1 -- 172.21.15.79:0/2347447673 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde0c06e6b0 msgr2=0x7fde0c15a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.850+0000 7fde0ad9d640 1 --2- 172.21.15.79:0/2347447673 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde0c06e6b0 0x7fde0c15a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.850+0000 7fde0ad9d640 1 -- 172.21.15.79:0/2347447673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde0c06b2f0 msgr2=0x7fde0c154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.850+0000 7fde0ad9d640 1 --2- 172.21.15.79:0/2347447673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde0c06b2f0 0x7fde0c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:22.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.850+0000 7fde0ad9d640 1 -- 172.21.15.79:0/2347447673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c1497c0 con 0x7fde0c0cf7a0 2024-04-25T02:13:22.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.851+0000 7fde0ad9d640 1 --2- 172.21.15.79:0/2347447673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c0cf7a0 0x7fde0c15a650 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fde0400e930 tx=0x7fde0400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:22.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.851+0000 7fddfaffd640 1 -- 172.21.15.79:0/2347447673 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04017070 con 0x7fde0c0cf7a0 2024-04-25T02:13:22.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.851+0000 7fddfaffd640 1 -- 172.21.15.79:0/2347447673 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde0400c980 con 0x7fde0c0cf7a0 2024-04-25T02:13:22.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.851+0000 7fde10b14640 1 -- 172.21.15.79:0/2347447673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde0c149aa0 con 0x7fde0c0cf7a0 2024-04-25T02:13:22.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.851+0000 7fddfaffd640 1 -- 172.21.15.79:0/2347447673 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0400cd70 con 0x7fde0c0cf7a0 2024-04-25T02:13:22.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.851+0000 7fde10b14640 1 -- 172.21.15.79:0/2347447673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde0c14a060 con 0x7fde0c0cf7a0 2024-04-25T02:13:22.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.852+0000 7fde10b14640 1 -- 172.21.15.79:0/2347447673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde0c0690a0 con 0x7fde0c0cf7a0 2024-04-25T02:13:22.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.852+0000 7fddfaffd640 1 -- 172.21.15.79:0/2347447673 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde0401a070 con 0x7fde0c0cf7a0 2024-04-25T02:13:22.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.853+0000 7fddfaffd640 1 --2- 172.21.15.79:0/2347447673 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fddec06be30 0x7fddec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:22.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.853+0000 7fddfaffd640 1 -- 172.21.15.79:0/2347447673 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7fde0408b2a0 con 0x7fde0c0cf7a0 2024-04-25T02:13:22.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.853+0000 7fde0a59c640 1 --2- 172.21.15.79:0/2347447673 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fddec06be30 0x7fddec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:22.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.853+0000 7fde0a59c640 1 --2- 172.21.15.79:0/2347447673 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fddec06be30 0x7fddec06e2f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0012e0 tx=0x7fddfc001650 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:22.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:22.857+0000 7fddfaffd640 1 -- 172.21.15.79:0/2347447673 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fde04059c80 con 0x7fde0c0cf7a0 2024-04-25T02:13:23.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.029+0000 7fde10b14640 1 -- 172.21.15.79:0/2347447673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fde0c0cc460 con 0x7fde0c0cf7a0 2024-04-25T02:13:23.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.029+0000 7fddfaffd640 1 -- 172.21.15.79:0/2347447673 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) ==== 100+0+11 (secure 0 0 0) 0x7fde0408b0c0 con 0x7fde0c0cf7a0 2024-04-25T02:13:23.036 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:13:23.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.031+0000 7fde10b14640 1 -- 172.21.15.79:0/2347447673 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fddec06be30 msgr2=0x7fddec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.031+0000 7fde10b14640 1 --2- 172.21.15.79:0/2347447673 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fddec06be30 0x7fddec06e2f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0012e0 tx=0x7fddfc001650 comp rx=0 tx=0).stop 2024-04-25T02:13:23.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.031+0000 7fde10b14640 1 -- 172.21.15.79:0/2347447673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c0cf7a0 msgr2=0x7fde0c15a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.031+0000 7fde10b14640 1 --2- 172.21.15.79:0/2347447673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c0cf7a0 0x7fde0c15a650 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fde0400e930 tx=0x7fde0400edf0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.031+0000 7fde10b14640 1 -- 172.21.15.79:0/2347447673 shutdown_connections 2024-04-25T02:13:23.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.031+0000 7fde10b14640 1 --2- 172.21.15.79:0/2347447673 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fddec06be30 0x7fddec06e2f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.031+0000 7fde10b14640 1 --2- 172.21.15.79:0/2347447673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c0cf7a0 0x7fde0c15a650 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.031+0000 7fde10b14640 1 --2- 172.21.15.79:0/2347447673 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde0c06e6b0 0x7fde0c15a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.031+0000 7fde10b14640 1 --2- 172.21.15.79:0/2347447673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde0c06b2f0 0x7fde0c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.031+0000 7fde10b14640 1 -- 172.21.15.79:0/2347447673 >> 172.21.15.79:0/2347447673 conn(0x7fde0c0b1cd0 msgr2=0x7fde0c0cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:23.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.031+0000 7fde10b14640 1 -- 172.21.15.79:0/2347447673 shutdown_connections 2024-04-25T02:13:23.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.031+0000 7fde10b14640 1 -- 172.21.15.79:0/2347447673 wait complete. 2024-04-25T02:13:23.048 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:13:23.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.140+0000 7f8131f7e640 1 Processor -- start 2024-04-25T02:13:23.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.140+0000 7f8131f7e640 1 -- start start 2024-04-25T02:13:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.140+0000 7f8131f7e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812c0d2e20 0x7f812c0cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.140+0000 7f8131f7e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812c06c380 con 0x7f812c0b3570 2024-04-25T02:13:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.140+0000 7f8131f7e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812c0d1660 con 0x7f812c15e4d0 2024-04-25T02:13:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.140+0000 7f8131f7e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f812c0d1380 con 0x7f812c0d2e20 2024-04-25T02:13:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f8123fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f812c0b3570 0x7f812c0d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60628/0 (socket says 172.21.15.79:60628) 2024-04-25T02:13:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f8123fff640 1 -- 172.21.15.79:0/3315384481 learned_addr learned my addr 172.21.15.79:0/3315384481 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812affd640 1 -- 172.21.15.79:0/3315384481 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4044697273 0 0) 0x7f812c06c380 con 0x7f812c0b3570 2024-04-25T02:13:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812affd640 1 -- 172.21.15.79:0/3315384481 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8118003520 con 0x7f812c0b3570 2024-04-25T02:13:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812bfff640 1 --2- 172.21.15.79:0/3315384481 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812c0d2e20 0x7f812c0cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812affd640 1 -- 172.21.15.79:0/3315384481 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2662692205 0 0) 0x7f8118003520 con 0x7f812c0b3570 2024-04-25T02:13:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812affd640 1 -- 172.21.15.79:0/3315384481 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812c0d2e20 msgr2=0x7f812c0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812affd640 1 --2- 172.21.15.79:0/3315384481 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812c0d2e20 0x7f812c0cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812affd640 1 -- 172.21.15.79:0/3315384481 >> v1:172.21.15.189:6789/0 conn(0x7f812c15e4d0 legacy=0x7f812c06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812affd640 1 -- 172.21.15.79:0/3315384481 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c0cede0 con 0x7f812c0b3570 2024-04-25T02:13:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812affd640 1 -- 172.21.15.79:0/3315384481 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f8114001670 con 0x7f812c0b3570 2024-04-25T02:13:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812bfff640 1 --2- 172.21.15.79:0/3315384481 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812c0d2e20 0x7f812c0cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812affd640 1 -- 172.21.15.79:0/3315384481 >> v1:172.21.15.79:6789/0 conn(0x7f812c0b3570 legacy=0x7f812c0d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812affd640 1 --2- 172.21.15.79:0/3315384481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81180039e0 0x7f8118003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812affd640 1 --2- 172.21.15.79:0/3315384481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8118004800 0x7f8118004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812affd640 1 --2- 172.21.15.79:0/3315384481 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812c0d2e20 0x7f81180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812affd640 1 -- 172.21.15.79:0/3315384481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f812c0d1380 con 0x7f8118004800 2024-04-25T02:13:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812affd640 1 -- 172.21.15.79:0/3315384481 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f811800baf0 con 0x7f81180039e0 2024-04-25T02:13:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812affd640 1 -- 172.21.15.79:0/3315384481 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f811800bcf0 con 0x7f812c0d2e20 2024-04-25T02:13:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f8123fff640 1 --2- 172.21.15.79:0/3315384481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8118004800 0x7f8118004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812b7fe640 1 --2- 172.21.15.79:0/3315384481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81180039e0 0x7f8118003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f812bfff640 1 --2- 172.21.15.79:0/3315384481 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812c0d2e20 0x7f81180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f8123fff640 1 -- 172.21.15.79:0/3315384481 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812c0d2e20 msgr2=0x7f81180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f8123fff640 1 --2- 172.21.15.79:0/3315384481 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812c0d2e20 0x7f81180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f8123fff640 1 -- 172.21.15.79:0/3315384481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81180039e0 msgr2=0x7f8118003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f8123fff640 1 --2- 172.21.15.79:0/3315384481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81180039e0 0x7f8118003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.141+0000 7f8123fff640 1 -- 172.21.15.79:0/3315384481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8118003520 con 0x7f8118004800 2024-04-25T02:13:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.142+0000 7f812b7fe640 1 --2- 172.21.15.79:0/3315384481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81180039e0 0x7f8118003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.142+0000 7f8123fff640 1 --2- 172.21.15.79:0/3315384481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8118004800 0x7f8118004c80 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f811400c210 tx=0x7f8118005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf046cc91af5b1f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.142+0000 7f812affd640 1 -- 172.21.15.79:0/3315384481 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114007d30 con 0x7f8118004800 2024-04-25T02:13:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.142+0000 7f812affd640 1 -- 172.21.15.79:0/3315384481 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8114005ad0 con 0x7f8118004800 2024-04-25T02:13:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.142+0000 7f812affd640 1 -- 172.21.15.79:0/3315384481 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114007070 con 0x7f8118004800 2024-04-25T02:13:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.143+0000 7f8131f7e640 1 -- 172.21.15.79:0/3315384481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8118004800 msgr2=0x7f8118004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.143+0000 7f8131f7e640 1 --2- 172.21.15.79:0/3315384481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8118004800 0x7f8118004c80 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f811400c210 tx=0x7f8118005830 comp rx=0 tx=0).stop 2024-04-25T02:13:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.143+0000 7f812bfff640 1 -- 172.21.15.79:0/3315384481 reap_dead start 2024-04-25T02:13:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.143+0000 7f8131f7e640 1 -- 172.21.15.79:0/3315384481 shutdown_connections 2024-04-25T02:13:23.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.143+0000 7f8131f7e640 1 -- 172.21.15.79:0/3315384481 >> 172.21.15.79:0/3315384481 conn(0x7f812c09d460 msgr2=0x7f812c0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:23.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.143+0000 7f8131f7e640 1 -- 172.21.15.79:0/3315384481 shutdown_connections 2024-04-25T02:13:23.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.143+0000 7f8131f7e640 1 -- 172.21.15.79:0/3315384481 wait complete. 2024-04-25T02:13:23.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.144+0000 7f8131f7e640 1 Processor -- start 2024-04-25T02:13:23.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.144+0000 7f8131f7e640 1 -- start start 2024-04-25T02:13:23.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f8131f7e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8118004800 0x7f812c14de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f8131f7e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812c0cd590 0x7f812c0b9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f8131f7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f812c0a0670 0x7f812c0a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f8131f7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f812c0d20d0 con 0x7f812c0a0670 2024-04-25T02:13:23.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f8131f7e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f812c15e8b0 con 0x7f8118004800 2024-04-25T02:13:23.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f8131f7e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f812c0d2250 con 0x7f812c0cd590 2024-04-25T02:13:23.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f812bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f812c0a0670 0x7f812c0a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f812bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f812c0a0670 0x7f812c0a0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41580/0 (socket says 172.21.15.79:41580) 2024-04-25T02:13:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f812bfff640 1 -- 172.21.15.79:0/833102340 learned_addr learned my addr 172.21.15.79:0/833102340 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f812b7fe640 1 --2- 172.21.15.79:0/833102340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8118004800 0x7f812c14de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f8123fff640 1 --2- 172.21.15.79:0/833102340 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812c0cd590 0x7f812c0b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f812bfff640 1 -- 172.21.15.79:0/833102340 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812c0cd590 msgr2=0x7f812c0b9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f812bfff640 1 --2- 172.21.15.79:0/833102340 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812c0cd590 0x7f812c0b9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f812bfff640 1 -- 172.21.15.79:0/833102340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8118004800 msgr2=0x7f812c14de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f812bfff640 1 --2- 172.21.15.79:0/833102340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8118004800 0x7f812c14de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f812bfff640 1 -- 172.21.15.79:0/833102340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c14e3d0 con 0x7f812c0a0670 2024-04-25T02:13:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f812bfff640 1 --2- 172.21.15.79:0/833102340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f812c0a0670 0x7f812c0a0af0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f812c08c7d0 tx=0x7f8124004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f8128ff9640 1 -- 172.21.15.79:0/833102340 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124007c90 con 0x7f812c0a0670 2024-04-25T02:13:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f8128ff9640 1 -- 172.21.15.79:0/833102340 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8124019070 con 0x7f812c0a0670 2024-04-25T02:13:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f8131f7e640 1 -- 172.21.15.79:0/833102340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812c0cc250 con 0x7f812c0a0670 2024-04-25T02:13:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.145+0000 7f8128ff9640 1 -- 172.21.15.79:0/833102340 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124014650 con 0x7f812c0a0670 2024-04-25T02:13:23.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.146+0000 7f8131f7e640 1 -- 172.21.15.79:0/833102340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f812c0cc4f0 con 0x7f812c0a0670 2024-04-25T02:13:23.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.146+0000 7f8131f7e640 1 -- 172.21.15.79:0/833102340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f812c0690a0 con 0x7f812c0a0670 2024-04-25T02:13:23.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.147+0000 7f8128ff9640 1 -- 172.21.15.79:0/833102340 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81240147f0 con 0x7f812c0a0670 2024-04-25T02:13:23.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.147+0000 7f8128ff9640 1 --2- 172.21.15.79:0/833102340 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f810c06be60 0x7f810c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.147+0000 7f8128ff9640 1 -- 172.21.15.79:0/833102340 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f812408b410 con 0x7f812c0a0670 2024-04-25T02:13:23.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.147+0000 7f812b7fe640 1 --2- 172.21.15.79:0/833102340 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f810c06be60 0x7f810c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.148+0000 7f812b7fe640 1 --2- 172.21.15.79:0/833102340 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f810c06be60 0x7f810c06e320 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f811c007fd0 tx=0x7f811c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:23.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.151+0000 7f8128ff9640 1 -- 172.21.15.79:0/833102340 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f812c14e3d0 con 0x7f812c0a0670 2024-04-25T02:13:23.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.340+0000 7f8131f7e640 1 -- 172.21.15.79:0/833102340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f812c15da60 con 0x7f812c0a0670 2024-04-25T02:13:23.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.340+0000 7f8128ff9640 1 -- 172.21.15.79:0/833102340 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v74) ==== 80+0+122 (secure 0 0 0) 0x7f8124059d30 con 0x7f812c0a0670 2024-04-25T02:13:23.347 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.189:6835/469348969 2024-04-26T02:12:09.471251+0000 2024-04-25T02:13:23.347 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.189:6833/469348969 2024-04-26T02:12:09.471251+0000 2024-04-25T02:13:23.347 INFO:teuthology.orchestra.run.smithi079.stderr:listed 2 entries 2024-04-25T02:13:23.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.342+0000 7f8131f7e640 1 -- 172.21.15.79:0/833102340 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f810c06be60 msgr2=0x7f810c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.342+0000 7f8131f7e640 1 --2- 172.21.15.79:0/833102340 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f810c06be60 0x7f810c06e320 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f811c007fd0 tx=0x7f811c009040 comp rx=0 tx=0).stop 2024-04-25T02:13:23.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.342+0000 7f8131f7e640 1 -- 172.21.15.79:0/833102340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f812c0a0670 msgr2=0x7f812c0a0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.342+0000 7f8131f7e640 1 --2- 172.21.15.79:0/833102340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f812c0a0670 0x7f812c0a0af0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f812c08c7d0 tx=0x7f8124004700 comp rx=0 tx=0).stop 2024-04-25T02:13:23.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.342+0000 7f8131f7e640 1 -- 172.21.15.79:0/833102340 shutdown_connections 2024-04-25T02:13:23.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.342+0000 7f8131f7e640 1 --2- 172.21.15.79:0/833102340 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f810c06be60 0x7f810c06e320 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.342+0000 7f8131f7e640 1 --2- 172.21.15.79:0/833102340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f812c0a0670 0x7f812c0a0af0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.342+0000 7f8131f7e640 1 --2- 172.21.15.79:0/833102340 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812c0cd590 0x7f812c0b9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.342+0000 7f8131f7e640 1 --2- 172.21.15.79:0/833102340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8118004800 0x7f812c14de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.342+0000 7f8131f7e640 1 -- 172.21.15.79:0/833102340 >> 172.21.15.79:0/833102340 conn(0x7f812c09d460 msgr2=0x7f812c0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:23.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.342+0000 7f8131f7e640 1 -- 172.21.15.79:0/833102340 shutdown_connections 2024-04-25T02:13:23.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.342+0000 7f8131f7e640 1 -- 172.21.15.79:0/833102340 wait complete. 2024-04-25T02:13:23.359 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:13:23.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:23.360 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:13:23.385 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:13:23.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:23.385 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:13:23.442 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:13:23.442 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:13:23.442 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:13:23.460 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:13:23.460 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:13:23.461 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:13:23.461 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:13:23.497 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:13:23.497 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:13:23.497 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:13:23.497 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:13:23.518 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:13:23.519 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:13:23.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.629+0000 7f1f98622640 1 Processor -- start 2024-04-25T02:13:23.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.629+0000 7f1f98622640 1 -- start start 2024-04-25T02:13:23.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.630+0000 7f1f98622640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1f9015e4d0 0x7f1f9006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.630+0000 7f1f98622640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1f900d2e20 0x7f1f900cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.630+0000 7f1f98622640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f900d1660 con 0x7f1f900b3570 2024-04-25T02:13:23.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.630+0000 7f1f98622640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1f900d1380 con 0x7f1f9015e4d0 2024-04-25T02:13:23.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.630+0000 7f1f98622640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f1f900cede0 con 0x7f1f900d2e20 2024-04-25T02:13:23.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.630+0000 7f1f963be640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1f9015e4d0 0x7f1f9006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.631+0000 7f1f963be640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1f9015e4d0 0x7f1f9006bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60030/0 (socket says 172.21.15.79:60030) 2024-04-25T02:13:23.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.631+0000 7f1f963be640 1 -- 172.21.15.79:0/3760259928 learned_addr learned my addr 172.21.15.79:0/3760259928 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:23.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.631+0000 7f1f963be640 1 -- 172.21.15.79:0/3760259928 >> v2:172.21.15.189:3300/0 conn(0x7f1f900d2e20 msgr2=0x7f1f900cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:23.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.631+0000 7f1f963be640 1 --2- 172.21.15.79:0/3760259928 >> v2:172.21.15.189:3300/0 conn(0x7f1f900d2e20 0x7f1f900cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.631+0000 7f1f963be640 1 -- 172.21.15.79:0/3760259928 >> v1:172.21.15.189:6789/0 conn(0x7f1f900b3570 legacy=0x7f1f900d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:23.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.631+0000 7f1f963be640 1 -- 172.21.15.79:0/3760259928 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f900cf0c0 con 0x7f1f9015e4d0 2024-04-25T02:13:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.632+0000 7f1f963be640 1 --2- 172.21.15.79:0/3760259928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9015e4d0 0x7f1f9006bc70 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009870 tx=0x7f1f8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3404ba6574c08a7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.632+0000 7f1f953bc640 1 -- 172.21.15.79:0/3760259928 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88037070 con 0x7f1f9015e4d0 2024-04-25T02:13:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.632+0000 7f1f953bc640 1 -- 172.21.15.79:0/3760259928 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f88032440 con 0x7f1f9015e4d0 2024-04-25T02:13:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.632+0000 7f1f953bc640 1 -- 172.21.15.79:0/3760259928 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88032810 con 0x7f1f9015e4d0 2024-04-25T02:13:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.632+0000 7f1f98622640 1 -- 172.21.15.79:0/3760259928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9015e4d0 msgr2=0x7f1f9006bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.632+0000 7f1f98622640 1 --2- 172.21.15.79:0/3760259928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9015e4d0 0x7f1f9006bc70 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009870 tx=0x7f1f8802a270 comp rx=0 tx=0).stop 2024-04-25T02:13:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.632+0000 7f1f98622640 1 -- 172.21.15.79:0/3760259928 shutdown_connections 2024-04-25T02:13:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.632+0000 7f1f98622640 1 --2- 172.21.15.79:0/3760259928 >> v2:172.21.15.189:3300/0 conn(0x7f1f900d2e20 0x7f1f900cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.632+0000 7f1f98622640 1 --2- 172.21.15.79:0/3760259928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9015e4d0 0x7f1f9006bc70 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.632+0000 7f1f98622640 1 -- 172.21.15.79:0/3760259928 >> 172.21.15.79:0/3760259928 conn(0x7f1f9009d460 msgr2=0x7f1f900d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.632+0000 7f1f98622640 1 -- 172.21.15.79:0/3760259928 shutdown_connections 2024-04-25T02:13:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.632+0000 7f1f98622640 1 -- 172.21.15.79:0/3760259928 wait complete. 2024-04-25T02:13:23.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.633+0000 7f1f98622640 1 Processor -- start 2024-04-25T02:13:23.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.634+0000 7f1f98622640 1 -- start start 2024-04-25T02:13:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.634+0000 7f1f98622640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f900b3570 0x7f1f901f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.634+0000 7f1f98622640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f900d2e20 0x7f1f900cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.634+0000 7f1f98622640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f9015e4d0 0x7f1f90157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.634+0000 7f1f98622640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1f900d2250 con 0x7f1f900d2e20 2024-04-25T02:13:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.634+0000 7f1f98622640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1f900d20d0 con 0x7f1f900b3570 2024-04-25T02:13:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.634+0000 7f1f98622640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9006c1b0 con 0x7f1f9015e4d0 2024-04-25T02:13:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.634+0000 7f1f95bbd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f900d2e20 0x7f1f900cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.634+0000 7f1f95bbd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f900d2e20 0x7f1f900cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60046/0 (socket says 172.21.15.79:60046) 2024-04-25T02:13:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.634+0000 7f1f95bbd640 1 -- 172.21.15.79:0/575453770 learned_addr learned my addr 172.21.15.79:0/575453770 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.635+0000 7f1f95bbd640 1 -- 172.21.15.79:0/575453770 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f9015e4d0 msgr2=0x7f1f90157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.635+0000 7f1f95bbd640 1 --2- 172.21.15.79:0/575453770 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f9015e4d0 0x7f1f90157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.635+0000 7f1f95bbd640 1 -- 172.21.15.79:0/575453770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f900b3570 msgr2=0x7f1f901f76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.635+0000 7f1f95bbd640 1 --2- 172.21.15.79:0/575453770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f900b3570 0x7f1f901f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.635+0000 7f1f95bbd640 1 -- 172.21.15.79:0/575453770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f901f7db0 con 0x7f1f900d2e20 2024-04-25T02:13:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.635+0000 7f1f95bbd640 1 --2- 172.21.15.79:0/575453770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f900d2e20 0x7f1f900cb200 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000c440 tx=0x7f1f8000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.635+0000 7f1f86ffd640 1 -- 172.21.15.79:0/575453770 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f80017070 con 0x7f1f900d2e20 2024-04-25T02:13:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.635+0000 7f1f86ffd640 1 -- 172.21.15.79:0/575453770 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f800035f0 con 0x7f1f900d2e20 2024-04-25T02:13:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.635+0000 7f1f86ffd640 1 -- 172.21.15.79:0/575453770 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f800039e0 con 0x7f1f900d2e20 2024-04-25T02:13:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.635+0000 7f1f98622640 1 -- 172.21.15.79:0/575453770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f901f8090 con 0x7f1f900d2e20 2024-04-25T02:13:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.635+0000 7f1f98622640 1 -- 172.21.15.79:0/575453770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f900b7de0 con 0x7f1f900d2e20 2024-04-25T02:13:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.636+0000 7f1f98622640 1 -- 172.21.15.79:0/575453770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f901f85b0 con 0x7f1f900d2e20 2024-04-25T02:13:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.636+0000 7f1f86ffd640 1 -- 172.21.15.79:0/575453770 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f8001a070 con 0x7f1f900d2e20 2024-04-25T02:13:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.637+0000 7f1f86ffd640 1 --2- 172.21.15.79:0/575453770 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1f7406be30 0x7f1f7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.637+0000 7f1f86ffd640 1 -- 172.21.15.79:0/575453770 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f1f8008a230 con 0x7f1f900d2e20 2024-04-25T02:13:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.637+0000 7f1f963be640 1 --2- 172.21.15.79:0/575453770 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1f7406be30 0x7f1f7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.637+0000 7f1f963be640 1 --2- 172.21.15.79:0/575453770 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1f7406be30 0x7f1f7406e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1f88034000 tx=0x7f1f8802c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:23.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.641+0000 7f1f86ffd640 1 -- 172.21.15.79:0/575453770 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1f80058b50 con 0x7f1f900d2e20 2024-04-25T02:13:23.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.850+0000 7f1f98622640 1 -- 172.21.15.79:0/575453770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f900690a0 con 0x7f1f900d2e20 2024-04-25T02:13:23.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.851+0000 7f1f86ffd640 1 -- 172.21.15.79:0/575453770 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5182 (secure 0 0 0) 0x7f1f800010c0 con 0x7f1f900d2e20 2024-04-25T02:13:23.857 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:23.857 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/596307304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":596307304},{"type":"v1","addr":"172.21.15.189:6834","nonce":596307304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/980112490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":980112490},{"type":"v1","addr":"172.21.15.189:6835","nonce":980112490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2550610051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550610051},{"type":"v1","addr":"172.21.15.79:6836","nonce":2550610051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:11:55.951694+0000","modified":"2024-04-25T02:12:52.486536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":72,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":18,"addr":"172.21.15.79:6837/782013262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":782013262},{"type":"v1","addr":"172.21.15.79:6837","nonce":782013262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6696,"qdb_cluster":[6696]},"id":5}]} 2024-04-25T02:13:23.858 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2024-04-25T02:13:23.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.853+0000 7f1f98622640 1 -- 172.21.15.79:0/575453770 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1f7406be30 msgr2=0x7f1f7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.853+0000 7f1f98622640 1 --2- 172.21.15.79:0/575453770 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1f7406be30 0x7f1f7406e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1f88034000 tx=0x7f1f8802c000 comp rx=0 tx=0).stop 2024-04-25T02:13:23.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.853+0000 7f1f98622640 1 -- 172.21.15.79:0/575453770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f900d2e20 msgr2=0x7f1f900cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.853+0000 7f1f98622640 1 --2- 172.21.15.79:0/575453770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f900d2e20 0x7f1f900cb200 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000c440 tx=0x7f1f8000c900 comp rx=0 tx=0).stop 2024-04-25T02:13:23.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.853+0000 7f1f98622640 1 -- 172.21.15.79:0/575453770 shutdown_connections 2024-04-25T02:13:23.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.853+0000 7f1f98622640 1 --2- 172.21.15.79:0/575453770 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1f7406be30 0x7f1f7406e2f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.853+0000 7f1f98622640 1 --2- 172.21.15.79:0/575453770 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f9015e4d0 0x7f1f90157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.853+0000 7f1f98622640 1 --2- 172.21.15.79:0/575453770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f900d2e20 0x7f1f900cb200 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.853+0000 7f1f98622640 1 --2- 172.21.15.79:0/575453770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f900b3570 0x7f1f901f76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.853+0000 7f1f98622640 1 -- 172.21.15.79:0/575453770 >> 172.21.15.79:0/575453770 conn(0x7f1f9009d460 msgr2=0x7f1f900d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:23.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.853+0000 7f1f98622640 1 -- 172.21.15.79:0/575453770 shutdown_connections 2024-04-25T02:13:23.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.853+0000 7f1f98622640 1 -- 172.21.15.79:0/575453770 wait complete. 2024-04-25T02:13:23.870 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:13:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.961+0000 7ff7a77b0640 1 Processor -- start 2024-04-25T02:13:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.961+0000 7ff7a77b0640 1 -- start start 2024-04-25T02:13:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.962+0000 7ff7a77b0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff7a006df50 0x7ff7a006e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.962+0000 7ff7a77b0640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff7a0071240 0x7ff7a0071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.962+0000 7ff7a77b0640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7a0070d90 con 0x7ff7a0144cb0 2024-04-25T02:13:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.962+0000 7ff7a77b0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff7a00cf130 con 0x7ff7a006df50 2024-04-25T02:13:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.962+0000 7ff7a77b0640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff7a00cf410 con 0x7ff7a0071240 2024-04-25T02:13:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.962+0000 7ff7a4d4b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff7a006df50 0x7ff7a006e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.962+0000 7ff7a4d4b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff7a006df50 0x7ff7a006e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60056/0 (socket says 172.21.15.79:60056) 2024-04-25T02:13:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.962+0000 7ff7a4d4b640 1 -- 172.21.15.79:0/2880610176 learned_addr learned my addr 172.21.15.79:0/2880610176 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.962+0000 7ff7a5d4d640 1 --2- 172.21.15.79:0/2880610176 >> v2:172.21.15.189:3300/0 conn(0x7ff7a0071240 0x7ff7a0071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.962+0000 7ff7a4d4b640 1 -- 172.21.15.79:0/2880610176 >> v2:172.21.15.189:3300/0 conn(0x7ff7a0071240 msgr2=0x7ff7a0071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.962+0000 7ff7a4d4b640 1 --2- 172.21.15.79:0/2880610176 >> v2:172.21.15.189:3300/0 conn(0x7ff7a0071240 0x7ff7a0071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.962+0000 7ff7a4d4b640 1 -- 172.21.15.79:0/2880610176 >> v1:172.21.15.189:6789/0 conn(0x7ff7a0144cb0 legacy=0x7ff7a00b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:23.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.962+0000 7ff7a4d4b640 1 -- 172.21.15.79:0/2880610176 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a00cf6f0 con 0x7ff7a006df50 2024-04-25T02:13:23.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.963+0000 7ff7a4d4b640 1 --2- 172.21.15.79:0/2880610176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7a006df50 0x7ff7a006e3e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00b5ae0 tx=0x7ff79002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a1bf153b8ca750 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:23.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.963+0000 7ff797fff640 1 -- 172.21.15.79:0/2880610176 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff790037070 con 0x7ff7a006df50 2024-04-25T02:13:23.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.963+0000 7ff797fff640 1 -- 172.21.15.79:0/2880610176 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79002ae20 con 0x7ff7a006df50 2024-04-25T02:13:23.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.963+0000 7ff797fff640 1 -- 172.21.15.79:0/2880610176 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff790032660 con 0x7ff7a006df50 2024-04-25T02:13:23.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.964+0000 7ff7a77b0640 1 -- 172.21.15.79:0/2880610176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7a006df50 msgr2=0x7ff7a006e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.964+0000 7ff7a77b0640 1 --2- 172.21.15.79:0/2880610176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7a006df50 0x7ff7a006e3e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00b5ae0 tx=0x7ff79002a110 comp rx=0 tx=0).stop 2024-04-25T02:13:23.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.964+0000 7ff7a77b0640 1 -- 172.21.15.79:0/2880610176 shutdown_connections 2024-04-25T02:13:23.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.964+0000 7ff7a77b0640 1 --2- 172.21.15.79:0/2880610176 >> v2:172.21.15.189:3300/0 conn(0x7ff7a0071240 0x7ff7a0071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.964+0000 7ff7a77b0640 1 --2- 172.21.15.79:0/2880610176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7a006df50 0x7ff7a006e3e0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.964+0000 7ff7a77b0640 1 -- 172.21.15.79:0/2880610176 >> 172.21.15.79:0/2880610176 conn(0x7ff7a00cfc80 msgr2=0x7ff7a00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:23.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.964+0000 7ff7a77b0640 1 -- 172.21.15.79:0/2880610176 shutdown_connections 2024-04-25T02:13:23.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.964+0000 7ff7a77b0640 1 -- 172.21.15.79:0/2880610176 wait complete. 2024-04-25T02:13:23.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.965+0000 7ff7a77b0640 1 Processor -- start 2024-04-25T02:13:23.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.965+0000 7ff7a77b0640 1 -- start start 2024-04-25T02:13:23.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a77b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7a006df50 0x7ff7a01f2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a77b0640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7a0071240 0x7ff7a0142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a77b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7a0144cb0 0x7ff7a01592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a77b0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a0145090 con 0x7ff7a006df50 2024-04-25T02:13:23.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a77b0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a00cf9d0 con 0x7ff7a0144cb0 2024-04-25T02:13:23.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a77b0640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a0145ab0 con 0x7ff7a0071240 2024-04-25T02:13:23.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a554c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7a006df50 0x7ff7a01f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a554c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7a006df50 0x7ff7a01f2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60070/0 (socket says 172.21.15.79:60070) 2024-04-25T02:13:23.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a554c640 1 -- 172.21.15.79:0/3529519790 learned_addr learned my addr 172.21.15.79:0/3529519790 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:23.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a5d4d640 1 --2- 172.21.15.79:0/3529519790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7a0144cb0 0x7ff7a01592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a4d4b640 1 --2- 172.21.15.79:0/3529519790 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7a0071240 0x7ff7a0142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a554c640 1 -- 172.21.15.79:0/3529519790 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7a0071240 msgr2=0x7ff7a0142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a554c640 1 --2- 172.21.15.79:0/3529519790 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7a0071240 0x7ff7a0142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a554c640 1 -- 172.21.15.79:0/3529519790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7a0144cb0 msgr2=0x7ff7a01592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:23.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a554c640 1 --2- 172.21.15.79:0/3529519790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7a0144cb0 0x7ff7a01592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:23.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a554c640 1 -- 172.21.15.79:0/3529519790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a0156930 con 0x7ff7a006df50 2024-04-25T02:13:23.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a4d4b640 1 --2- 172.21.15.79:0/3529519790 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7a0071240 0x7ff7a0142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:23.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a554c640 1 --2- 172.21.15.79:0/3529519790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7a006df50 0x7ff7a01f2120 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00c430 tx=0x7ff79c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:23.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff795ffb640 1 -- 172.21.15.79:0/3529519790 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c011790 con 0x7ff7a006df50 2024-04-25T02:13:23.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff795ffb640 1 -- 172.21.15.79:0/3529519790 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79c017070 con 0x7ff7a006df50 2024-04-25T02:13:23.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff7a77b0640 1 -- 172.21.15.79:0/3529519790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a0156c70 con 0x7ff7a006df50 2024-04-25T02:13:23.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.966+0000 7ff795ffb640 1 -- 172.21.15.79:0/3529519790 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c011b70 con 0x7ff7a006df50 2024-04-25T02:13:23.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.967+0000 7ff7a77b0640 1 -- 172.21.15.79:0/3529519790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a01574b0 con 0x7ff7a006df50 2024-04-25T02:13:23.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.968+0000 7ff7a77b0640 1 -- 172.21.15.79:0/3529519790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7a00690a0 con 0x7ff7a006df50 2024-04-25T02:13:23.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.968+0000 7ff795ffb640 1 -- 172.21.15.79:0/3529519790 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff79c011d10 con 0x7ff7a006df50 2024-04-25T02:13:23.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.968+0000 7ff795ffb640 1 --2- 172.21.15.79:0/3529519790 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff78406be30 0x7ff78406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:23.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.968+0000 7ff7a4d4b640 1 --2- 172.21.15.79:0/3529519790 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff78406be30 0x7ff78406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:23.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.968+0000 7ff795ffb640 1 -- 172.21.15.79:0/3529519790 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7ff79c08ad60 con 0x7ff7a006df50 2024-04-25T02:13:23.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.969+0000 7ff7a4d4b640 1 --2- 172.21.15.79:0/3529519790 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff78406be30 0x7ff78406e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff790034000 tx=0x7ff79002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:23.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:23.973+0000 7ff795ffb640 1 -- 172.21.15.79:0/3529519790 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff7a0156c70 con 0x7ff7a006df50 2024-04-25T02:13:24.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.147+0000 7ff7a77b0640 1 -- 172.21.15.79:0/3529519790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7a00d0b90 con 0x7ff7a006df50 2024-04-25T02:13:24.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.148+0000 7ff795ffb640 1 -- 172.21.15.79:0/3529519790 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16907 (secure 0 0 0) 0x7ff79c059680 con 0x7ff7a006df50 2024-04-25T02:13:24.155 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:24.155 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:12:41.808973+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:11:54.161817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T02:11:54.917049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.22","mappings":[{"from":6,"to":0}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.189:6835/469348969":"2024-04-26T02:12:09.471251+0000","172.21.15.189:6833/469348969":"2024-04-26T02:12:09.471251+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:13:24.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.150+0000 7ff7a77b0640 1 -- 172.21.15.79:0/3529519790 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff78406be30 msgr2=0x7ff78406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.150+0000 7ff7a77b0640 1 --2- 172.21.15.79:0/3529519790 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff78406be30 0x7ff78406e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff790034000 tx=0x7ff79002e000 comp rx=0 tx=0).stop 2024-04-25T02:13:24.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.150+0000 7ff7a77b0640 1 -- 172.21.15.79:0/3529519790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7a006df50 msgr2=0x7ff7a01f2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.150+0000 7ff7a77b0640 1 --2- 172.21.15.79:0/3529519790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7a006df50 0x7ff7a01f2120 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00c430 tx=0x7ff79c00c8f0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.150+0000 7ff7a77b0640 1 -- 172.21.15.79:0/3529519790 shutdown_connections 2024-04-25T02:13:24.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.150+0000 7ff7a77b0640 1 --2- 172.21.15.79:0/3529519790 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff78406be30 0x7ff78406e2f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.150+0000 7ff7a77b0640 1 --2- 172.21.15.79:0/3529519790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7a0144cb0 0x7ff7a01592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.150+0000 7ff7a77b0640 1 --2- 172.21.15.79:0/3529519790 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7a0071240 0x7ff7a0142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.150+0000 7ff7a77b0640 1 --2- 172.21.15.79:0/3529519790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7a006df50 0x7ff7a01f2120 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.150+0000 7ff7a77b0640 1 -- 172.21.15.79:0/3529519790 >> 172.21.15.79:0/3529519790 conn(0x7ff7a00cfc80 msgr2=0x7ff7a00b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:24.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.151+0000 7ff7a77b0640 1 -- 172.21.15.79:0/3529519790 shutdown_connections 2024-04-25T02:13:24.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.151+0000 7ff7a77b0640 1 -- 172.21.15.79:0/3529519790 wait complete. 2024-04-25T02:13:24.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:11:54.161817+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:11:54.917049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:13:24.168 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:13:24.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.262+0000 7fc694a5d640 1 Processor -- start 2024-04-25T02:13:24.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.262+0000 7fc694a5d640 1 -- start start 2024-04-25T02:13:24.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.263+0000 7fc694a5d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc69015e4f0 0x7fc6900d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.263+0000 7fc694a5d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6900d10c0 0x7fc69006bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.263+0000 7fc694a5d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6900d1ee0 con 0x7fc6900cf7f0 2024-04-25T02:13:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.263+0000 7fc694a5d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc6900d21c0 con 0x7fc6900d10c0 2024-04-25T02:13:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.263+0000 7fc694a5d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc6900d24a0 con 0x7fc69015e4f0 2024-04-25T02:13:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.263+0000 7fc68ed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6900d10c0 0x7fc69006bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.263+0000 7fc68ed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6900d10c0 0x7fc69006bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60072/0 (socket says 172.21.15.79:60072) 2024-04-25T02:13:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.263+0000 7fc68ed9d640 1 -- 172.21.15.79:0/883172915 learned_addr learned my addr 172.21.15.79:0/883172915 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.264+0000 7fc68e59c640 1 --2- 172.21.15.79:0/883172915 >> v2:172.21.15.189:3300/0 conn(0x7fc69015e4f0 0x7fc6900d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.264+0000 7fc68ed9d640 1 -- 172.21.15.79:0/883172915 >> v2:172.21.15.189:3300/0 conn(0x7fc69015e4f0 msgr2=0x7fc6900d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.264+0000 7fc68ed9d640 1 --2- 172.21.15.79:0/883172915 >> v2:172.21.15.189:3300/0 conn(0x7fc69015e4f0 0x7fc6900d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.264+0000 7fc68ed9d640 1 -- 172.21.15.79:0/883172915 >> v1:172.21.15.189:6789/0 conn(0x7fc6900cf7f0 legacy=0x7fc6900d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.264+0000 7fc68ed9d640 1 -- 172.21.15.79:0/883172915 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6900d2780 con 0x7fc6900d10c0 2024-04-25T02:13:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.264+0000 7fc68e59c640 1 --2- 172.21.15.79:0/883172915 >> v2:172.21.15.189:3300/0 conn(0x7fc69015e4f0 0x7fc6900d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.264+0000 7fc68ed9d640 1 --2- 172.21.15.79:0/883172915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6900d10c0 0x7fc69006bc30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fc688009870 tx=0x7fc68802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86065903fd651c2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:24.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.264+0000 7fc68d59a640 1 -- 172.21.15.79:0/883172915 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688037070 con 0x7fc6900d10c0 2024-04-25T02:13:24.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.264+0000 7fc68d59a640 1 -- 172.21.15.79:0/883172915 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc688032440 con 0x7fc6900d10c0 2024-04-25T02:13:24.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.264+0000 7fc68d59a640 1 -- 172.21.15.79:0/883172915 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688032810 con 0x7fc6900d10c0 2024-04-25T02:13:24.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.265+0000 7fc694a5d640 1 -- 172.21.15.79:0/883172915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6900d10c0 msgr2=0x7fc69006bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.265+0000 7fc694a5d640 1 --2- 172.21.15.79:0/883172915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6900d10c0 0x7fc69006bc30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fc688009870 tx=0x7fc68802a270 comp rx=0 tx=0).stop 2024-04-25T02:13:24.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.265+0000 7fc694a5d640 1 -- 172.21.15.79:0/883172915 shutdown_connections 2024-04-25T02:13:24.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.265+0000 7fc694a5d640 1 --2- 172.21.15.79:0/883172915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6900d10c0 0x7fc69006bc30 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.265+0000 7fc694a5d640 1 --2- 172.21.15.79:0/883172915 >> v2:172.21.15.189:3300/0 conn(0x7fc69015e4f0 0x7fc6900d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.265+0000 7fc694a5d640 1 -- 172.21.15.79:0/883172915 >> 172.21.15.79:0/883172915 conn(0x7fc69009d4a0 msgr2=0x7fc6900d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:24.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.265+0000 7fc694a5d640 1 -- 172.21.15.79:0/883172915 shutdown_connections 2024-04-25T02:13:24.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.265+0000 7fc694a5d640 1 -- 172.21.15.79:0/883172915 wait complete. 2024-04-25T02:13:24.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.266+0000 7fc694a5d640 1 Processor -- start 2024-04-25T02:13:24.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.266+0000 7fc694a5d640 1 -- start start 2024-04-25T02:13:24.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.267+0000 7fc694a5d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6900cf7f0 0x7fc6900c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.267+0000 7fc694a5d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6900d10c0 0x7fc690152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.267+0000 7fc694a5d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc69015e4f0 0x7fc6901528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.267+0000 7fc694a5d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6900cfc80 con 0x7fc6900cf7f0 2024-04-25T02:13:24.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.267+0000 7fc694a5d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc6900d50f0 con 0x7fc6900d10c0 2024-04-25T02:13:24.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.267+0000 7fc694a5d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc6900cfe00 con 0x7fc69015e4f0 2024-04-25T02:13:24.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.267+0000 7fc68e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6900cf7f0 0x7fc6900c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:24.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.267+0000 7fc68e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6900cf7f0 0x7fc6900c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60088/0 (socket says 172.21.15.79:60088) 2024-04-25T02:13:24.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.267+0000 7fc68e59c640 1 -- 172.21.15.79:0/460581747 learned_addr learned my addr 172.21.15.79:0/460581747 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:24.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.267+0000 7fc68e59c640 1 -- 172.21.15.79:0/460581747 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc69015e4f0 msgr2=0x7fc6901528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.267+0000 7fc68e59c640 1 --2- 172.21.15.79:0/460581747 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc69015e4f0 0x7fc6901528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.267+0000 7fc68e59c640 1 -- 172.21.15.79:0/460581747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6900d10c0 msgr2=0x7fc690152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.267+0000 7fc68e59c640 1 --2- 172.21.15.79:0/460581747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6900d10c0 0x7fc690152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.267+0000 7fc68e59c640 1 -- 172.21.15.79:0/460581747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6900cc1e0 con 0x7fc6900cf7f0 2024-04-25T02:13:24.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.268+0000 7fc68e59c640 1 --2- 172.21.15.79:0/460581747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6900cf7f0 0x7fc6900c9a60 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fc68000cf90 tx=0x7fc68000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:24.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.268+0000 7fc67effd640 1 -- 172.21.15.79:0/460581747 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68001a070 con 0x7fc6900cf7f0 2024-04-25T02:13:24.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.268+0000 7fc67effd640 1 -- 172.21.15.79:0/460581747 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc68000d840 con 0x7fc6900cf7f0 2024-04-25T02:13:24.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.268+0000 7fc694a5d640 1 -- 172.21.15.79:0/460581747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6900cc4c0 con 0x7fc6900cf7f0 2024-04-25T02:13:24.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.268+0000 7fc67effd640 1 -- 172.21.15.79:0/460581747 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68000dc10 con 0x7fc6900cf7f0 2024-04-25T02:13:24.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.268+0000 7fc694a5d640 1 -- 172.21.15.79:0/460581747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6900cca80 con 0x7fc6900cf7f0 2024-04-25T02:13:24.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.269+0000 7fc694a5d640 1 -- 172.21.15.79:0/460581747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6900686c0 con 0x7fc6900cf7f0 2024-04-25T02:13:24.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.269+0000 7fc67effd640 1 -- 172.21.15.79:0/460581747 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc68001d070 con 0x7fc6900cf7f0 2024-04-25T02:13:24.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.270+0000 7fc67effd640 1 --2- 172.21.15.79:0/460581747 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc67006be30 0x7fc67006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.270+0000 7fc67effd640 1 -- 172.21.15.79:0/460581747 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7fc68008b710 con 0x7fc6900cf7f0 2024-04-25T02:13:24.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.270+0000 7fc68dd9b640 1 --2- 172.21.15.79:0/460581747 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc67006be30 0x7fc67006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:24.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.270+0000 7fc68dd9b640 1 --2- 172.21.15.79:0/460581747 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc67006be30 0x7fc67006e2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc684006fd0 tx=0x7fc684006bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:24.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.274+0000 7fc67effd640 1 -- 172.21.15.79:0/460581747 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc6800599e0 con 0x7fc6900cf7f0 2024-04-25T02:13:24.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.445+0000 7fc694a5d640 1 -- 172.21.15.79:0/460581747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc6900b59b0 con 0x7fc6900cf7f0 2024-04-25T02:13:24.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.445+0000 7fc67effd640 1 -- 172.21.15.79:0/460581747 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7fc68005dce0 con 0x7fc6900cf7f0 2024-04-25T02:13:24.452 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:13:24.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.447+0000 7fc694a5d640 1 -- 172.21.15.79:0/460581747 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc67006be30 msgr2=0x7fc67006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.447+0000 7fc694a5d640 1 --2- 172.21.15.79:0/460581747 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc67006be30 0x7fc67006e2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc684006fd0 tx=0x7fc684006bc0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.447+0000 7fc694a5d640 1 -- 172.21.15.79:0/460581747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6900cf7f0 msgr2=0x7fc6900c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.447+0000 7fc694a5d640 1 --2- 172.21.15.79:0/460581747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6900cf7f0 0x7fc6900c9a60 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fc68000cf90 tx=0x7fc68000a7d0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.447+0000 7fc694a5d640 1 -- 172.21.15.79:0/460581747 shutdown_connections 2024-04-25T02:13:24.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.447+0000 7fc694a5d640 1 --2- 172.21.15.79:0/460581747 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc67006be30 0x7fc67006e2f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.447+0000 7fc694a5d640 1 --2- 172.21.15.79:0/460581747 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc69015e4f0 0x7fc6901528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.447+0000 7fc694a5d640 1 --2- 172.21.15.79:0/460581747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6900d10c0 0x7fc690152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.447+0000 7fc694a5d640 1 --2- 172.21.15.79:0/460581747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6900cf7f0 0x7fc6900c9a60 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.447+0000 7fc694a5d640 1 -- 172.21.15.79:0/460581747 >> 172.21.15.79:0/460581747 conn(0x7fc69009d4a0 msgr2=0x7fc69015d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:24.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.447+0000 7fc694a5d640 1 -- 172.21.15.79:0/460581747 shutdown_connections 2024-04-25T02:13:24.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.447+0000 7fc694a5d640 1 -- 172.21.15.79:0/460581747 wait complete. 2024-04-25T02:13:24.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:13:24.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.557+0000 7fa37dcd4640 1 Processor -- start 2024-04-25T02:13:24.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.557+0000 7fa37dcd4640 1 -- start start 2024-04-25T02:13:24.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.558+0000 7fa37dcd4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa37809dcb0 0x7fa378070d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.558+0000 7fa37dcd4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3780cf380 0x7fa378071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.558+0000 7fa37dcd4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa37815abf0 con 0x7fa37815a810 2024-04-25T02:13:24.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.558+0000 7fa37dcd4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa378073050 con 0x7fa37809dcb0 2024-04-25T02:13:24.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.558+0000 7fa37dcd4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa3780cbdd0 con 0x7fa3780cf380 2024-04-25T02:13:24.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.558+0000 7fa376ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa37809dcb0 0x7fa378070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:24.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.558+0000 7fa3777fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa37815a810 0x7fa3780cc820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44662/0 (socket says 172.21.15.79:44662) 2024-04-25T02:13:24.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.558+0000 7fa3777fe640 1 -- 172.21.15.79:0/105100744 learned_addr learned my addr 172.21.15.79:0/105100744 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:24.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.558+0000 7fa377fff640 1 --2- 172.21.15.79:0/105100744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3780cf380 0x7fa378071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:24.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.559+0000 7fa376ffd640 1 -- 172.21.15.79:0/105100744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3780cf380 msgr2=0x7fa378071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:24.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.559+0000 7fa376ffd640 1 --2- 172.21.15.79:0/105100744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3780cf380 0x7fa378071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.559+0000 7fa376ffd640 1 -- 172.21.15.79:0/105100744 >> v1:172.21.15.79:6789/0 conn(0x7fa37815a810 legacy=0x7fa3780cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.559+0000 7fa376ffd640 1 -- 172.21.15.79:0/105100744 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3780ce580 con 0x7fa37809dcb0 2024-04-25T02:13:24.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.559+0000 7fa377fff640 1 --2- 172.21.15.79:0/105100744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3780cf380 0x7fa378071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.559+0000 7fa376ffd640 1 --2- 172.21.15.79:0/105100744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa37809dcb0 0x7fa378070d50 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0097a0 tx=0x7fa36c02c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9785d94f4ae6e673 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.559+0000 7fa3767fc640 1 -- 172.21.15.79:0/105100744 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c039070 con 0x7fa37809dcb0 2024-04-25T02:13:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.559+0000 7fa3767fc640 1 -- 172.21.15.79:0/105100744 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36c034440 con 0x7fa37809dcb0 2024-04-25T02:13:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.559+0000 7fa3767fc640 1 -- 172.21.15.79:0/105100744 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c034810 con 0x7fa37809dcb0 2024-04-25T02:13:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.560+0000 7fa37dcd4640 1 -- 172.21.15.79:0/105100744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa37809dcb0 msgr2=0x7fa378070d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.560+0000 7fa37dcd4640 1 --2- 172.21.15.79:0/105100744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa37809dcb0 0x7fa378070d50 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0097a0 tx=0x7fa36c02c270 comp rx=0 tx=0).stop 2024-04-25T02:13:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.560+0000 7fa37dcd4640 1 -- 172.21.15.79:0/105100744 shutdown_connections 2024-04-25T02:13:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.560+0000 7fa37dcd4640 1 --2- 172.21.15.79:0/105100744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3780cf380 0x7fa378071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.560+0000 7fa37dcd4640 1 --2- 172.21.15.79:0/105100744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa37809dcb0 0x7fa378070d50 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.560+0000 7fa37dcd4640 1 -- 172.21.15.79:0/105100744 >> 172.21.15.79:0/105100744 conn(0x7fa3780b1cd0 msgr2=0x7fa3780b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.560+0000 7fa37dcd4640 1 -- 172.21.15.79:0/105100744 shutdown_connections 2024-04-25T02:13:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.560+0000 7fa37dcd4640 1 -- 172.21.15.79:0/105100744 wait complete. 2024-04-25T02:13:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.561+0000 7fa37dcd4640 1 Processor -- start 2024-04-25T02:13:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.561+0000 7fa37dcd4640 1 -- start start 2024-04-25T02:13:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa37dcd4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa37809dcb0 0x7fa37809ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa37dcd4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3780cf380 0x7fa3780cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa37dcd4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa37815a810 0x7fa3781484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa37dcd4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780cc020 con 0x7fa3780cf380 2024-04-25T02:13:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa37dcd4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780ceb40 con 0x7fa37809dcb0 2024-04-25T02:13:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa37dcd4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa3780cc300 con 0x7fa37815a810 2024-04-25T02:13:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa376ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3780cf380 0x7fa3780cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa376ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3780cf380 0x7fa3780cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60112/0 (socket says 172.21.15.79:60112) 2024-04-25T02:13:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa376ffd640 1 -- 172.21.15.79:0/46916220 learned_addr learned my addr 172.21.15.79:0/46916220 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa377fff640 1 --2- 172.21.15.79:0/46916220 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa37815a810 0x7fa3781484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa3777fe640 1 --2- 172.21.15.79:0/46916220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa37809dcb0 0x7fa37809ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:24.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa376ffd640 1 -- 172.21.15.79:0/46916220 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa37815a810 msgr2=0x7fa3781484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa376ffd640 1 --2- 172.21.15.79:0/46916220 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa37815a810 0x7fa3781484e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa376ffd640 1 -- 172.21.15.79:0/46916220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa37809dcb0 msgr2=0x7fa37809ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa376ffd640 1 --2- 172.21.15.79:0/46916220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa37809dcb0 0x7fa37809ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa376ffd640 1 -- 172.21.15.79:0/46916220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3780b0a90 con 0x7fa3780cf380 2024-04-25T02:13:24.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.562+0000 7fa3777fe640 1 --2- 172.21.15.79:0/46916220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa37809dcb0 0x7fa37809ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:24.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.563+0000 7fa376ffd640 1 --2- 172.21.15.79:0/46916220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3780cf380 0x7fa3780cb580 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fa36c037040 tx=0x7fa36c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:24.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.563+0000 7fa35ffff640 1 -- 172.21.15.79:0/46916220 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c039070 con 0x7fa3780cf380 2024-04-25T02:13:24.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.563+0000 7fa35ffff640 1 -- 172.21.15.79:0/46916220 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36c032ba0 con 0x7fa3780cf380 2024-04-25T02:13:24.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.563+0000 7fa35ffff640 1 -- 172.21.15.79:0/46916220 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c006e10 con 0x7fa3780cf380 2024-04-25T02:13:24.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.563+0000 7fa37dcd4640 1 -- 172.21.15.79:0/46916220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3780b0d70 con 0x7fa3780cf380 2024-04-25T02:13:24.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.563+0000 7fa37dcd4640 1 -- 172.21.15.79:0/46916220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa378148a20 con 0x7fa3780cf380 2024-04-25T02:13:24.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.564+0000 7fa37dcd4640 1 -- 172.21.15.79:0/46916220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3780690a0 con 0x7fa3780cf380 2024-04-25T02:13:24.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.564+0000 7fa35ffff640 1 -- 172.21.15.79:0/46916220 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa36c046060 con 0x7fa3780cf380 2024-04-25T02:13:24.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.565+0000 7fa35ffff640 1 --2- 172.21.15.79:0/46916220 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa36406be30 0x7fa36406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.565+0000 7fa35ffff640 1 -- 172.21.15.79:0/46916220 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7fa36c0ab0a0 con 0x7fa3780cf380 2024-04-25T02:13:24.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.565+0000 7fa3777fe640 1 --2- 172.21.15.79:0/46916220 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa36406be30 0x7fa36406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:24.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.565+0000 7fa3777fe640 1 --2- 172.21.15.79:0/46916220 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa36406be30 0x7fa36406e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa378072da0 tx=0x7fa368009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:24.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.569+0000 7fa35ffff640 1 -- 172.21.15.79:0/46916220 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa36c034e20 con 0x7fa3780cf380 2024-04-25T02:13:24.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.747+0000 7fa37dcd4640 1 -- 172.21.15.79:0/46916220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa378072420 con 0x7fa3780cf380 2024-04-25T02:13:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.747+0000 7fa35ffff640 1 -- 172.21.15.79:0/46916220 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) ==== 104+0+11 (secure 0 0 0) 0x7fa36c03b310 con 0x7fa3780cf380 2024-04-25T02:13:24.754 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:13:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.749+0000 7fa37dcd4640 1 -- 172.21.15.79:0/46916220 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa36406be30 msgr2=0x7fa36406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.749+0000 7fa37dcd4640 1 --2- 172.21.15.79:0/46916220 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa36406be30 0x7fa36406e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa378072da0 tx=0x7fa368009040 comp rx=0 tx=0).stop 2024-04-25T02:13:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.749+0000 7fa37dcd4640 1 -- 172.21.15.79:0/46916220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3780cf380 msgr2=0x7fa3780cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.749+0000 7fa37dcd4640 1 --2- 172.21.15.79:0/46916220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3780cf380 0x7fa3780cb580 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fa36c037040 tx=0x7fa36c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.749+0000 7fa37dcd4640 1 -- 172.21.15.79:0/46916220 shutdown_connections 2024-04-25T02:13:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.749+0000 7fa37dcd4640 1 --2- 172.21.15.79:0/46916220 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa36406be30 0x7fa36406e2f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.749+0000 7fa37dcd4640 1 --2- 172.21.15.79:0/46916220 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa37815a810 0x7fa3781484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.749+0000 7fa37dcd4640 1 --2- 172.21.15.79:0/46916220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3780cf380 0x7fa3780cb580 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.749+0000 7fa37dcd4640 1 --2- 172.21.15.79:0/46916220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa37809dcb0 0x7fa37809ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.749+0000 7fa37dcd4640 1 -- 172.21.15.79:0/46916220 >> 172.21.15.79:0/46916220 conn(0x7fa3780b1cd0 msgr2=0x7fa378150a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:24.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.750+0000 7fa37dcd4640 1 -- 172.21.15.79:0/46916220 shutdown_connections 2024-04-25T02:13:24.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.750+0000 7fa37dcd4640 1 -- 172.21.15.79:0/46916220 wait complete. 2024-04-25T02:13:24.766 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:13:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.859+0000 7f491be2a640 1 Processor -- start 2024-04-25T02:13:24.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.859+0000 7f491be2a640 1 -- start start 2024-04-25T02:13:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.860+0000 7f491be2a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49140b41b0 0x7f49141605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.860+0000 7f491be2a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f491406b2f0 0x7f491406b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.860+0000 7f491be2a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4914155f00 0x7f4914156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.860+0000 7f491be2a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4914071cd0 con 0x7f4914155f00 2024-04-25T02:13:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.860+0000 7f491be2a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f4914071fb0 con 0x7f491406b2f0 2024-04-25T02:13:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.860+0000 7f491be2a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4914072290 con 0x7f49140b41b0 2024-04-25T02:13:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.860+0000 7f491a3c7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4914155f00 0x7f4914156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.860+0000 7f491a3c7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4914155f00 0x7f4914156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60124/0 (socket says 172.21.15.79:60124) 2024-04-25T02:13:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.860+0000 7f491a3c7640 1 -- 172.21.15.79:0/3634854878 learned_addr learned my addr 172.21.15.79:0/3634854878 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.861+0000 7f4919bc6640 1 --2- 172.21.15.79:0/3634854878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49140b41b0 0x7f49141605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.861+0000 7f49193c5640 1 --2- 172.21.15.79:0/3634854878 >> v2:172.21.15.189:3300/0 conn(0x7f491406b2f0 0x7f491406b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.861+0000 7f491a3c7640 1 -- 172.21.15.79:0/3634854878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49140b41b0 msgr2=0x7f49141605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.861+0000 7f491a3c7640 1 --2- 172.21.15.79:0/3634854878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49140b41b0 0x7f49141605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.861+0000 7f491a3c7640 1 -- 172.21.15.79:0/3634854878 >> v2:172.21.15.189:3300/0 conn(0x7f491406b2f0 msgr2=0x7f491406b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.861+0000 7f491a3c7640 1 --2- 172.21.15.79:0/3634854878 >> v2:172.21.15.189:3300/0 conn(0x7f491406b2f0 0x7f491406b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.861+0000 7f491a3c7640 1 -- 172.21.15.79:0/3634854878 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4914072570 con 0x7f4914155f00 2024-04-25T02:13:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.861+0000 7f49193c5640 1 --2- 172.21.15.79:0/3634854878 >> v2:172.21.15.189:3300/0 conn(0x7f491406b2f0 0x7f491406b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.861+0000 7f491a3c7640 1 --2- 172.21.15.79:0/3634854878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4914155f00 0x7f4914156370 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f49140cd700 tx=0x7f490c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f7dde32832f95a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.861+0000 7f4918bc4640 1 -- 172.21.15.79:0/3634854878 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c037070 con 0x7f4914155f00 2024-04-25T02:13:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.862+0000 7f4918bc4640 1 -- 172.21.15.79:0/3634854878 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490c032440 con 0x7f4914155f00 2024-04-25T02:13:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.862+0000 7f4918bc4640 1 -- 172.21.15.79:0/3634854878 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c032810 con 0x7f4914155f00 2024-04-25T02:13:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.862+0000 7f491be2a640 1 -- 172.21.15.79:0/3634854878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4914155f00 msgr2=0x7f4914156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.862+0000 7f491be2a640 1 --2- 172.21.15.79:0/3634854878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4914155f00 0x7f4914156370 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f49140cd700 tx=0x7f490c02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.862+0000 7f491be2a640 1 -- 172.21.15.79:0/3634854878 shutdown_connections 2024-04-25T02:13:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.862+0000 7f491be2a640 1 --2- 172.21.15.79:0/3634854878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4914155f00 0x7f4914156370 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.862+0000 7f491be2a640 1 --2- 172.21.15.79:0/3634854878 >> v2:172.21.15.189:3300/0 conn(0x7f491406b2f0 0x7f491406b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.862+0000 7f491be2a640 1 --2- 172.21.15.79:0/3634854878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49140b41b0 0x7f49141605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.862+0000 7f491be2a640 1 -- 172.21.15.79:0/3634854878 >> 172.21.15.79:0/3634854878 conn(0x7f49140b1cd0 msgr2=0x7f49140b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.862+0000 7f491be2a640 1 -- 172.21.15.79:0/3634854878 shutdown_connections 2024-04-25T02:13:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.862+0000 7f491be2a640 1 -- 172.21.15.79:0/3634854878 wait complete. 2024-04-25T02:13:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.863+0000 7f491be2a640 1 Processor -- start 2024-04-25T02:13:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.863+0000 7f491be2a640 1 -- start start 2024-04-25T02:13:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.864+0000 7f491be2a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f491406b2f0 0x7f49140ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.864+0000 7f491be2a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49140b41b0 0x7f491414f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.864+0000 7f491be2a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4914155f00 0x7f49140b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.864+0000 7f491be2a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f491415c870 con 0x7f49140b41b0 2024-04-25T02:13:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.864+0000 7f491be2a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4914072d70 con 0x7f4914155f00 2024-04-25T02:13:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.864+0000 7f491be2a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f49140b4590 con 0x7f491406b2f0 2024-04-25T02:13:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.864+0000 7f49193c5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49140b41b0 0x7f491414f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.864+0000 7f49193c5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49140b41b0 0x7f491414f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60132/0 (socket says 172.21.15.79:60132) 2024-04-25T02:13:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.864+0000 7f49193c5640 1 -- 172.21.15.79:0/4153536042 learned_addr learned my addr 172.21.15.79:0/4153536042 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.864+0000 7f49193c5640 1 -- 172.21.15.79:0/4153536042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f491406b2f0 msgr2=0x7f49140ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.864+0000 7f49193c5640 1 --2- 172.21.15.79:0/4153536042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f491406b2f0 0x7f49140ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.864+0000 7f49193c5640 1 -- 172.21.15.79:0/4153536042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4914155f00 msgr2=0x7f49140b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.864+0000 7f49193c5640 1 --2- 172.21.15.79:0/4153536042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4914155f00 0x7f49140b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.864+0000 7f49193c5640 1 -- 172.21.15.79:0/4153536042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49141f4790 con 0x7f49140b41b0 2024-04-25T02:13:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.865+0000 7f49193c5640 1 --2- 172.21.15.79:0/4153536042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49140b41b0 0x7f491414f810 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f490400e730 tx=0x7f490400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.865+0000 7f490a7fc640 1 -- 172.21.15.79:0/4153536042 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490400f040 con 0x7f49140b41b0 2024-04-25T02:13:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.865+0000 7f490a7fc640 1 -- 172.21.15.79:0/4153536042 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4904004230 con 0x7f49140b41b0 2024-04-25T02:13:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.865+0000 7f491be2a640 1 -- 172.21.15.79:0/4153536042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49141f4a70 con 0x7f49140b41b0 2024-04-25T02:13:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.865+0000 7f490a7fc640 1 -- 172.21.15.79:0/4153536042 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490400ee40 con 0x7f49140b41b0 2024-04-25T02:13:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.865+0000 7f491be2a640 1 -- 172.21.15.79:0/4153536042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49141f5030 con 0x7f49140b41b0 2024-04-25T02:13:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.866+0000 7f491be2a640 1 -- 172.21.15.79:0/4153536042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49140690a0 con 0x7f49140b41b0 2024-04-25T02:13:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.866+0000 7f490a7fc640 1 -- 172.21.15.79:0/4153536042 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f490400c670 con 0x7f49140b41b0 2024-04-25T02:13:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.867+0000 7f490a7fc640 1 --2- 172.21.15.79:0/4153536042 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f48f806be60 0x7f48f806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.867+0000 7f490a7fc640 1 -- 172.21.15.79:0/4153536042 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f490408ab20 con 0x7f49140b41b0 2024-04-25T02:13:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.867+0000 7f4919bc6640 1 --2- 172.21.15.79:0/4153536042 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f48f806be60 0x7f48f806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.867+0000 7f4919bc6640 1 --2- 172.21.15.79:0/4153536042 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f48f806be60 0x7f48f806e320 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4910009540 tx=0x7f4910009450 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:24.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:24.871+0000 7f490a7fc640 1 -- 172.21.15.79:0/4153536042 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4904017020 con 0x7f49140b41b0 2024-04-25T02:13:25.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.045+0000 7f491be2a640 1 -- 172.21.15.79:0/4153536042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f49140ce280 con 0x7f49140b41b0 2024-04-25T02:13:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.045+0000 7f490a7fc640 1 -- 172.21.15.79:0/4153536042 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) ==== 100+0+11 (secure 0 0 0) 0x7f49040594d0 con 0x7f49140b41b0 2024-04-25T02:13:25.052 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:13:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.047+0000 7f491be2a640 1 -- 172.21.15.79:0/4153536042 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f48f806be60 msgr2=0x7f48f806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.047+0000 7f491be2a640 1 --2- 172.21.15.79:0/4153536042 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f48f806be60 0x7f48f806e320 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4910009540 tx=0x7f4910009450 comp rx=0 tx=0).stop 2024-04-25T02:13:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.047+0000 7f491be2a640 1 -- 172.21.15.79:0/4153536042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49140b41b0 msgr2=0x7f491414f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.047+0000 7f491be2a640 1 --2- 172.21.15.79:0/4153536042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49140b41b0 0x7f491414f810 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f490400e730 tx=0x7f490400ebf0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.047+0000 7f491be2a640 1 -- 172.21.15.79:0/4153536042 shutdown_connections 2024-04-25T02:13:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.047+0000 7f491be2a640 1 --2- 172.21.15.79:0/4153536042 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f48f806be60 0x7f48f806e320 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.047+0000 7f491be2a640 1 --2- 172.21.15.79:0/4153536042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4914155f00 0x7f49140b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.047+0000 7f491be2a640 1 --2- 172.21.15.79:0/4153536042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49140b41b0 0x7f491414f810 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.047+0000 7f491be2a640 1 --2- 172.21.15.79:0/4153536042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f491406b2f0 0x7f49140ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.047+0000 7f491be2a640 1 -- 172.21.15.79:0/4153536042 >> 172.21.15.79:0/4153536042 conn(0x7f49140b1cd0 msgr2=0x7f49140b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:25.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.047+0000 7f491be2a640 1 -- 172.21.15.79:0/4153536042 shutdown_connections 2024-04-25T02:13:25.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.047+0000 7f491be2a640 1 -- 172.21.15.79:0/4153536042 wait complete. 2024-04-25T02:13:25.064 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:13:25.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.155+0000 7f3b95729640 1 Processor -- start 2024-04-25T02:13:25.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.155+0000 7f3b95729640 1 -- start start 2024-04-25T02:13:25.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.156+0000 7f3b95729640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f3b90143bc0 0x7f3b9015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.156+0000 7f3b95729640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3b9006df50 0x7f3b9006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.156+0000 7f3b95729640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b9015fa40 con 0x7f3b900b48e0 2024-04-25T02:13:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.156+0000 7f3b95729640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3b9006e8f0 con 0x7f3b9006df50 2024-04-25T02:13:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.156+0000 7f3b95729640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3b90072cb0 con 0x7f3b90143bc0 2024-04-25T02:13:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.156+0000 7f3b87fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3b9006df50 0x7f3b9006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.156+0000 7f3b87fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3b9006df50 0x7f3b9006e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60140/0 (socket says 172.21.15.79:60140) 2024-04-25T02:13:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.156+0000 7f3b87fff640 1 -- 172.21.15.79:0/220757792 learned_addr learned my addr 172.21.15.79:0/220757792 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.156+0000 7f3b8effd640 1 --2- 172.21.15.79:0/220757792 >> v2:172.21.15.189:3300/0 conn(0x7f3b90143bc0 0x7f3b9015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.156+0000 7f3b87fff640 1 -- 172.21.15.79:0/220757792 >> v2:172.21.15.189:3300/0 conn(0x7f3b90143bc0 msgr2=0x7f3b9015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.156+0000 7f3b87fff640 1 --2- 172.21.15.79:0/220757792 >> v2:172.21.15.189:3300/0 conn(0x7f3b90143bc0 0x7f3b9015f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.156+0000 7f3b87fff640 1 -- 172.21.15.79:0/220757792 >> v1:172.21.15.189:6789/0 conn(0x7f3b900b48e0 legacy=0x7f3b900b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.156+0000 7f3b87fff640 1 -- 172.21.15.79:0/220757792 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b900720a0 con 0x7f3b9006df50 2024-04-25T02:13:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.156+0000 7f3b8effd640 1 --2- 172.21.15.79:0/220757792 >> v2:172.21.15.189:3300/0 conn(0x7f3b90143bc0 0x7f3b9015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.157+0000 7f3b87fff640 1 --2- 172.21.15.79:0/220757792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b9006df50 0x7f3b9006e3b0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f3b90067b50 tx=0x7f3b7802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b94844a38a2240b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.157+0000 7f3b8e7fc640 1 -- 172.21.15.79:0/220757792 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b78037070 con 0x7f3b9006df50 2024-04-25T02:13:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.157+0000 7f3b8e7fc640 1 -- 172.21.15.79:0/220757792 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b78032440 con 0x7f3b9006df50 2024-04-25T02:13:25.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.157+0000 7f3b8e7fc640 1 -- 172.21.15.79:0/220757792 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b78032810 con 0x7f3b9006df50 2024-04-25T02:13:25.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.158+0000 7f3b95729640 1 -- 172.21.15.79:0/220757792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b9006df50 msgr2=0x7f3b9006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.158+0000 7f3b95729640 1 --2- 172.21.15.79:0/220757792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b9006df50 0x7f3b9006e3b0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f3b90067b50 tx=0x7f3b7802a1e0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.158+0000 7f3b95729640 1 -- 172.21.15.79:0/220757792 shutdown_connections 2024-04-25T02:13:25.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.158+0000 7f3b95729640 1 --2- 172.21.15.79:0/220757792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b9006df50 0x7f3b9006e3b0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.158+0000 7f3b95729640 1 --2- 172.21.15.79:0/220757792 >> v2:172.21.15.189:3300/0 conn(0x7f3b90143bc0 0x7f3b9015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.158+0000 7f3b95729640 1 -- 172.21.15.79:0/220757792 >> 172.21.15.79:0/220757792 conn(0x7f3b900cfc80 msgr2=0x7f3b900d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.158+0000 7f3b95729640 1 -- 172.21.15.79:0/220757792 shutdown_connections 2024-04-25T02:13:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.158+0000 7f3b95729640 1 -- 172.21.15.79:0/220757792 wait complete. 2024-04-25T02:13:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.159+0000 7f3b95729640 1 Processor -- start 2024-04-25T02:13:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.159+0000 7f3b95729640 1 -- start start 2024-04-25T02:13:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b95729640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b9006df50 0x7f3b900a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b95729640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b900b48e0 0x7f3b900b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b95729640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b90143bc0 0x7f3b9015edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b95729640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3b90072940 con 0x7f3b9006df50 2024-04-25T02:13:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b95729640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b90072660 con 0x7f3b90143bc0 2024-04-25T02:13:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b95729640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3b90143fa0 con 0x7f3b900b48e0 2024-04-25T02:13:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b8effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b9006df50 0x7f3b900a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b8effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b9006df50 0x7f3b900a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60154/0 (socket says 172.21.15.79:60154) 2024-04-25T02:13:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b8effd640 1 -- 172.21.15.79:0/3856062037 learned_addr learned my addr 172.21.15.79:0/3856062037 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b8f7fe640 1 --2- 172.21.15.79:0/3856062037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b90143bc0 0x7f3b9015edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b8effd640 1 -- 172.21.15.79:0/3856062037 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b900b48e0 msgr2=0x7f3b900b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b8effd640 1 --2- 172.21.15.79:0/3856062037 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b900b48e0 0x7f3b900b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b8effd640 1 -- 172.21.15.79:0/3856062037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b90143bc0 msgr2=0x7f3b9015edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b8effd640 1 --2- 172.21.15.79:0/3856062037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b90143bc0 0x7f3b9015edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b8effd640 1 -- 172.21.15.79:0/3856062037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b9015bca0 con 0x7f3b9006df50 2024-04-25T02:13:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b8effd640 1 --2- 172.21.15.79:0/3856062037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b9006df50 0x7f3b900a9eb0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000e810 tx=0x7f3b8000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b877fe640 1 -- 172.21.15.79:0/3856062037 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000f040 con 0x7f3b9006df50 2024-04-25T02:13:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b877fe640 1 -- 172.21.15.79:0/3856062037 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b80004030 con 0x7f3b9006df50 2024-04-25T02:13:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b95729640 1 -- 172.21.15.79:0/3856062037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b9015bf80 con 0x7f3b9006df50 2024-04-25T02:13:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b877fe640 1 -- 172.21.15.79:0/3856062037 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80004400 con 0x7f3b9006df50 2024-04-25T02:13:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.160+0000 7f3b95729640 1 -- 172.21.15.79:0/3856062037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b9015c540 con 0x7f3b9006df50 2024-04-25T02:13:25.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.161+0000 7f3b95729640 1 -- 172.21.15.79:0/3856062037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b900690a0 con 0x7f3b9006df50 2024-04-25T02:13:25.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.162+0000 7f3b877fe640 1 -- 172.21.15.79:0/3856062037 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b8000c6d0 con 0x7f3b9006df50 2024-04-25T02:13:25.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.162+0000 7f3b877fe640 1 --2- 172.21.15.79:0/3856062037 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3b7006be30 0x7f3b7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.162+0000 7f3b877fe640 1 -- 172.21.15.79:0/3856062037 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f3b8008ad10 con 0x7f3b9006df50 2024-04-25T02:13:25.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.162+0000 7f3b87fff640 1 --2- 172.21.15.79:0/3856062037 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3b7006be30 0x7f3b7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.163+0000 7f3b87fff640 1 --2- 172.21.15.79:0/3856062037 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3b7006be30 0x7f3b7006e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3b78034000 tx=0x7f3b7802c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:25.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.167+0000 7f3b877fe640 1 -- 172.21.15.79:0/3856062037 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3b80017020 con 0x7f3b9006df50 2024-04-25T02:13:25.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.379+0000 7f3b95729640 1 -- 172.21.15.79:0/3856062037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b9015d2f0 con 0x7f3b9006df50 2024-04-25T02:13:25.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.379+0000 7f3b877fe640 1 -- 172.21.15.79:0/3856062037 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5182 (secure 0 0 0) 0x7f3b80059630 con 0x7f3b9006df50 2024-04-25T02:13:25.386 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:25.386 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/596307304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":596307304},{"type":"v1","addr":"172.21.15.189:6834","nonce":596307304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/980112490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":980112490},{"type":"v1","addr":"172.21.15.189:6835","nonce":980112490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2550610051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550610051},{"type":"v1","addr":"172.21.15.79:6836","nonce":2550610051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:11:55.951694+0000","modified":"2024-04-25T02:12:52.486536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":72,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":18,"addr":"172.21.15.79:6837/782013262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":782013262},{"type":"v1","addr":"172.21.15.79:6837","nonce":782013262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6696,"qdb_cluster":[6696]},"id":5}]} 2024-04-25T02:13:25.387 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2024-04-25T02:13:25.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.381+0000 7f3b95729640 1 -- 172.21.15.79:0/3856062037 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3b7006be30 msgr2=0x7f3b7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.381+0000 7f3b95729640 1 --2- 172.21.15.79:0/3856062037 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3b7006be30 0x7f3b7006e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3b78034000 tx=0x7f3b7802c000 comp rx=0 tx=0).stop 2024-04-25T02:13:25.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.381+0000 7f3b95729640 1 -- 172.21.15.79:0/3856062037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b9006df50 msgr2=0x7f3b900a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.381+0000 7f3b95729640 1 --2- 172.21.15.79:0/3856062037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b9006df50 0x7f3b900a9eb0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000e810 tx=0x7f3b8000ecd0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.381+0000 7f3b95729640 1 -- 172.21.15.79:0/3856062037 shutdown_connections 2024-04-25T02:13:25.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.381+0000 7f3b95729640 1 --2- 172.21.15.79:0/3856062037 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3b7006be30 0x7f3b7006e2f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.381+0000 7f3b95729640 1 --2- 172.21.15.79:0/3856062037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b90143bc0 0x7f3b9015edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.381+0000 7f3b95729640 1 --2- 172.21.15.79:0/3856062037 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3b900b48e0 0x7f3b900b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.381+0000 7f3b95729640 1 --2- 172.21.15.79:0/3856062037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b9006df50 0x7f3b900a9eb0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.381+0000 7f3b95729640 1 -- 172.21.15.79:0/3856062037 >> 172.21.15.79:0/3856062037 conn(0x7f3b900cfc80 msgr2=0x7f3b900b5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:25.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.381+0000 7f3b95729640 1 -- 172.21.15.79:0/3856062037 shutdown_connections 2024-04-25T02:13:25.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.381+0000 7f3b95729640 1 -- 172.21.15.79:0/3856062037 wait complete. 2024-04-25T02:13:25.399 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:13:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.488+0000 7f3a284cd640 1 Processor -- start 2024-04-25T02:13:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.488+0000 7f3a284cd640 1 -- start start 2024-04-25T02:13:25.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.489+0000 7f3a284cd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a200d2e20 0x7f3a200cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.489+0000 7f3a284cd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a2006c380 con 0x7f3a200b3570 2024-04-25T02:13:25.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.489+0000 7f3a284cd640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a200d1660 con 0x7f3a2015e4d0 2024-04-25T02:13:25.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.489+0000 7f3a284cd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3a200d1380 con 0x7f3a200d2e20 2024-04-25T02:13:25.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.489+0000 7f3a25a68640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3a200b3570 0x7f3a200d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44676/0 (socket says 172.21.15.79:44676) 2024-04-25T02:13:25.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.489+0000 7f3a25a68640 1 -- 172.21.15.79:0/196717306 learned_addr learned my addr 172.21.15.79:0/196717306 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:25.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a26a6a640 1 --2- 172.21.15.79:0/196717306 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a200d2e20 0x7f3a200cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25267640 1 -- 172.21.15.79:0/196717306 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021217026 0 0) 0x7f3a2006c380 con 0x7f3a200b3570 2024-04-25T02:13:25.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25267640 1 -- 172.21.15.79:0/196717306 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a0c003520 con 0x7f3a200b3570 2024-04-25T02:13:25.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25267640 1 -- 172.21.15.79:0/196717306 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3587738544 0 0) 0x7f3a0c003520 con 0x7f3a200b3570 2024-04-25T02:13:25.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25267640 1 -- 172.21.15.79:0/196717306 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a200d2e20 msgr2=0x7f3a200cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:25.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25267640 1 --2- 172.21.15.79:0/196717306 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a200d2e20 0x7f3a200cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25267640 1 -- 172.21.15.79:0/196717306 >> v1:172.21.15.189:6789/0 conn(0x7f3a2015e4d0 legacy=0x7f3a2006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25267640 1 -- 172.21.15.79:0/196717306 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a200cede0 con 0x7f3a200b3570 2024-04-25T02:13:25.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25267640 1 -- 172.21.15.79:0/196717306 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f3a10001670 con 0x7f3a200b3570 2024-04-25T02:13:25.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25267640 1 -- 172.21.15.79:0/196717306 >> v1:172.21.15.79:6789/0 conn(0x7f3a200b3570 legacy=0x7f3a200d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25267640 1 --2- 172.21.15.79:0/196717306 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a200d2e20 0x7f3a0c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25267640 1 --2- 172.21.15.79:0/196717306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a0c003f60 0x7f3a0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25267640 1 --2- 172.21.15.79:0/196717306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a0c004d40 0x7f3a0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25267640 1 -- 172.21.15.79:0/196717306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3a200d1380 con 0x7f3a0c004d40 2024-04-25T02:13:25.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25267640 1 -- 172.21.15.79:0/196717306 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c00baa0 con 0x7f3a0c003f60 2024-04-25T02:13:25.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25267640 1 -- 172.21.15.79:0/196717306 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3a0c00bca0 con 0x7f3a200d2e20 2024-04-25T02:13:25.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a26a6a640 1 --2- 172.21.15.79:0/196717306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a0c004d40 0x7f3a0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a26269640 1 --2- 172.21.15.79:0/196717306 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a200d2e20 0x7f3a0c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a25a68640 1 --2- 172.21.15.79:0/196717306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a0c003f60 0x7f3a0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a26a6a640 1 -- 172.21.15.79:0/196717306 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a200d2e20 msgr2=0x7f3a0c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:25.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a26a6a640 1 --2- 172.21.15.79:0/196717306 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a200d2e20 0x7f3a0c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a26a6a640 1 -- 172.21.15.79:0/196717306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a0c003f60 msgr2=0x7f3a0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:25.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a26a6a640 1 --2- 172.21.15.79:0/196717306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a0c003f60 0x7f3a0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.490+0000 7f3a26a6a640 1 -- 172.21.15.79:0/196717306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0c003520 con 0x7f3a0c004d40 2024-04-25T02:13:25.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.491+0000 7f3a26a6a640 1 --2- 172.21.15.79:0/196717306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a0c004d40 0x7f3a0c0051c0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f3a2008c7d0 tx=0x7f3a0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791a08f0541b6b7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:25.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.491+0000 7f3a25267640 1 -- 172.21.15.79:0/196717306 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18037070 con 0x7f3a0c004d40 2024-04-25T02:13:25.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.491+0000 7f3a25267640 1 -- 172.21.15.79:0/196717306 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a18032600 con 0x7f3a0c004d40 2024-04-25T02:13:25.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.491+0000 7f3a25267640 1 -- 172.21.15.79:0/196717306 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18009c10 con 0x7f3a0c004d40 2024-04-25T02:13:25.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.492+0000 7f3a284cd640 1 -- 172.21.15.79:0/196717306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a0c004d40 msgr2=0x7f3a0c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.492+0000 7f3a284cd640 1 --2- 172.21.15.79:0/196717306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a0c004d40 0x7f3a0c0051c0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f3a2008c7d0 tx=0x7f3a0c005830 comp rx=0 tx=0).stop 2024-04-25T02:13:25.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.492+0000 7f3a26a6a640 1 -- 172.21.15.79:0/196717306 reap_dead start 2024-04-25T02:13:25.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.492+0000 7f3a284cd640 1 -- 172.21.15.79:0/196717306 shutdown_connections 2024-04-25T02:13:25.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.492+0000 7f3a284cd640 1 -- 172.21.15.79:0/196717306 >> 172.21.15.79:0/196717306 conn(0x7f3a2009d460 msgr2=0x7f3a200d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:25.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.492+0000 7f3a284cd640 1 -- 172.21.15.79:0/196717306 shutdown_connections 2024-04-25T02:13:25.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.492+0000 7f3a284cd640 1 -- 172.21.15.79:0/196717306 wait complete. 2024-04-25T02:13:25.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.493+0000 7f3a284cd640 1 Processor -- start 2024-04-25T02:13:25.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.493+0000 7f3a284cd640 1 -- start start 2024-04-25T02:13:25.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a284cd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a0c004d40 0x7f3a2015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a284cd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a2015c3a0 0x7f3a2015c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a284cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a200a0790 0x7f3a200a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a284cd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3a200d20d0 con 0x7f3a200a0790 2024-04-25T02:13:25.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a284cd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2015e8b0 con 0x7f3a0c004d40 2024-04-25T02:13:25.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a284cd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3a200d2250 con 0x7f3a2015c3a0 2024-04-25T02:13:25.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a26a6a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a200a0790 0x7f3a200a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a26a6a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a200a0790 0x7f3a200a0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60176/0 (socket says 172.21.15.79:60176) 2024-04-25T02:13:25.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a26a6a640 1 -- 172.21.15.79:0/1724417425 learned_addr learned my addr 172.21.15.79:0/1724417425 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:25.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a25a68640 1 --2- 172.21.15.79:0/1724417425 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a2015c3a0 0x7f3a2015c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a26269640 1 --2- 172.21.15.79:0/1724417425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a0c004d40 0x7f3a2015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a26a6a640 1 -- 172.21.15.79:0/1724417425 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a2015c3a0 msgr2=0x7f3a2015c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a26a6a640 1 --2- 172.21.15.79:0/1724417425 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a2015c3a0 0x7f3a2015c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a26a6a640 1 -- 172.21.15.79:0/1724417425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a0c004d40 msgr2=0x7f3a2015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a26a6a640 1 --2- 172.21.15.79:0/1724417425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a0c004d40 0x7f3a2015b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a26a6a640 1 -- 172.21.15.79:0/1724417425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2015baf0 con 0x7f3a200a0790 2024-04-25T02:13:25.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a26269640 1 --2- 172.21.15.79:0/1724417425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a0c004d40 0x7f3a2015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:25.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a26a6a640 1 --2- 172.21.15.79:0/1724417425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a200a0790 0x7f3a200a0c10 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800e200 tx=0x7f3a18009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:25.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.494+0000 7f3a16ffd640 1 -- 172.21.15.79:0/1724417425 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18037040 con 0x7f3a200a0790 2024-04-25T02:13:25.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.495+0000 7f3a16ffd640 1 -- 172.21.15.79:0/1724417425 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a18043070 con 0x7f3a200a0790 2024-04-25T02:13:25.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.495+0000 7f3a284cd640 1 -- 172.21.15.79:0/1724417425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2009df70 con 0x7f3a200a0790 2024-04-25T02:13:25.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.495+0000 7f3a16ffd640 1 -- 172.21.15.79:0/1724417425 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18009c10 con 0x7f3a200a0790 2024-04-25T02:13:25.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.495+0000 7f3a284cd640 1 -- 172.21.15.79:0/1724417425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a2009e530 con 0x7f3a200a0790 2024-04-25T02:13:25.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.495+0000 7f3a284cd640 1 -- 172.21.15.79:0/1724417425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a200690a0 con 0x7f3a200a0790 2024-04-25T02:13:25.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.496+0000 7f3a16ffd640 1 -- 172.21.15.79:0/1724417425 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a1803a070 con 0x7f3a200a0790 2024-04-25T02:13:25.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.496+0000 7f3a16ffd640 1 --2- 172.21.15.79:0/1724417425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a0406be30 0x7f3a0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.496+0000 7f3a16ffd640 1 -- 172.21.15.79:0/1724417425 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f3a180ab520 con 0x7f3a200a0790 2024-04-25T02:13:25.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.496+0000 7f3a26269640 1 --2- 172.21.15.79:0/1724417425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a0406be30 0x7f3a0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.497+0000 7f3a26269640 1 --2- 172.21.15.79:0/1724417425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a0406be30 0x7f3a0406e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0035f0 tx=0x7f3a1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:25.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.501+0000 7f3a16ffd640 1 -- 172.21.15.79:0/1724417425 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3a18079ff0 con 0x7f3a200a0790 2024-04-25T02:13:25.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.673+0000 7f3a284cd640 1 -- 172.21.15.79:0/1724417425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a200d1920 con 0x7f3a200a0790 2024-04-25T02:13:25.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.674+0000 7f3a16ffd640 1 -- 172.21.15.79:0/1724417425 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16907 (secure 0 0 0) 0x7f3a180798f0 con 0x7f3a200a0790 2024-04-25T02:13:25.681 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:25.681 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:12:41.808973+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:11:54.161817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T02:11:54.917049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.22","mappings":[{"from":6,"to":0}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.189:6835/469348969":"2024-04-26T02:12:09.471251+0000","172.21.15.189:6833/469348969":"2024-04-26T02:12:09.471251+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:13:25.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.677+0000 7f3a284cd640 1 -- 172.21.15.79:0/1724417425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a0406be30 msgr2=0x7f3a0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.677+0000 7f3a284cd640 1 --2- 172.21.15.79:0/1724417425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a0406be30 0x7f3a0406e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0035f0 tx=0x7f3a1c009040 comp rx=0 tx=0).stop 2024-04-25T02:13:25.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.677+0000 7f3a284cd640 1 -- 172.21.15.79:0/1724417425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a200a0790 msgr2=0x7f3a200a0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.677+0000 7f3a284cd640 1 --2- 172.21.15.79:0/1724417425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a200a0790 0x7f3a200a0c10 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800e200 tx=0x7f3a18009750 comp rx=0 tx=0).stop 2024-04-25T02:13:25.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.677+0000 7f3a284cd640 1 -- 172.21.15.79:0/1724417425 shutdown_connections 2024-04-25T02:13:25.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.677+0000 7f3a284cd640 1 --2- 172.21.15.79:0/1724417425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a0406be30 0x7f3a0406e2f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.677+0000 7f3a284cd640 1 --2- 172.21.15.79:0/1724417425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a200a0790 0x7f3a200a0c10 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.677+0000 7f3a284cd640 1 --2- 172.21.15.79:0/1724417425 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a2015c3a0 0x7f3a2015c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.677+0000 7f3a284cd640 1 --2- 172.21.15.79:0/1724417425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a0c004d40 0x7f3a2015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.677+0000 7f3a284cd640 1 -- 172.21.15.79:0/1724417425 >> 172.21.15.79:0/1724417425 conn(0x7f3a2009d460 msgr2=0x7f3a200d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:25.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.677+0000 7f3a284cd640 1 -- 172.21.15.79:0/1724417425 shutdown_connections 2024-04-25T02:13:25.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.677+0000 7f3a284cd640 1 -- 172.21.15.79:0/1724417425 wait complete. 2024-04-25T02:13:25.694 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:13:25.694 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:13:25.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.784+0000 7f14e1664640 1 Processor -- start 2024-04-25T02:13:25.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.784+0000 7f14e1664640 1 -- start start 2024-04-25T02:13:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.784+0000 7f14e1664640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f14dc161b90 0x7f14dc0d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.784+0000 7f14e1664640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f14dc0d47e0 0x7f14dc0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.784+0000 7f14e1664640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14dc0ceed0 con 0x7f14dc0d0a60 2024-04-25T02:13:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.784+0000 7f14e1664640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f14dc0ceca0 con 0x7f14dc0d47e0 2024-04-25T02:13:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.784+0000 7f14e1664640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f14dc0d4f80 con 0x7f14dc161b90 2024-04-25T02:13:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.785+0000 7f14da7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f14dc0d47e0 0x7f14dc0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.785+0000 7f14db7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f14dc0d0a60 0x7f14dc0b3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44680/0 (socket says 172.21.15.79:44680) 2024-04-25T02:13:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.785+0000 7f14db7fe640 1 -- 172.21.15.79:0/3190813965 learned_addr learned my addr 172.21.15.79:0/3190813965 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.785+0000 7f14da7fc640 1 -- 172.21.15.79:0/3190813965 >> v2:172.21.15.189:3300/0 conn(0x7f14dc161b90 msgr2=0x7f14dc0d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.785+0000 7f14da7fc640 1 --2- 172.21.15.79:0/3190813965 >> v2:172.21.15.189:3300/0 conn(0x7f14dc161b90 0x7f14dc0d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.785+0000 7f14da7fc640 1 -- 172.21.15.79:0/3190813965 >> v1:172.21.15.79:6789/0 conn(0x7f14dc0d0a60 legacy=0x7f14dc0b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.785+0000 7f14da7fc640 1 -- 172.21.15.79:0/3190813965 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14dc0cf1b0 con 0x7f14dc0d47e0 2024-04-25T02:13:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.785+0000 7f14da7fc640 1 --2- 172.21.15.79:0/3190813965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14dc0d47e0 0x7f14dc0cfc90 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f14dc08c790 tx=0x7f14d002a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd6ede911e3177c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.786+0000 7f14d9ffb640 1 -- 172.21.15.79:0/3190813965 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0037070 con 0x7f14dc0d47e0 2024-04-25T02:13:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.786+0000 7f14d9ffb640 1 -- 172.21.15.79:0/3190813965 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d002ad30 con 0x7f14dc0d47e0 2024-04-25T02:13:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.786+0000 7f14d9ffb640 1 -- 172.21.15.79:0/3190813965 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0032660 con 0x7f14dc0d47e0 2024-04-25T02:13:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.786+0000 7f14e1664640 1 -- 172.21.15.79:0/3190813965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14dc0d47e0 msgr2=0x7f14dc0cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.786+0000 7f14e1664640 1 --2- 172.21.15.79:0/3190813965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14dc0d47e0 0x7f14dc0cfc90 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f14dc08c790 tx=0x7f14d002a0a0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.786+0000 7f14e1664640 1 -- 172.21.15.79:0/3190813965 shutdown_connections 2024-04-25T02:13:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.786+0000 7f14e1664640 1 --2- 172.21.15.79:0/3190813965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14dc0d47e0 0x7f14dc0cfc90 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.786+0000 7f14e1664640 1 --2- 172.21.15.79:0/3190813965 >> v2:172.21.15.189:3300/0 conn(0x7f14dc161b90 0x7f14dc0d2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.786+0000 7f14e1664640 1 -- 172.21.15.79:0/3190813965 >> 172.21.15.79:0/3190813965 conn(0x7f14dc09d460 msgr2=0x7f14dc0d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.786+0000 7f14e1664640 1 -- 172.21.15.79:0/3190813965 shutdown_connections 2024-04-25T02:13:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.786+0000 7f14e1664640 1 -- 172.21.15.79:0/3190813965 wait complete. 2024-04-25T02:13:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.788+0000 7f14e1664640 1 Processor -- start 2024-04-25T02:13:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.788+0000 7f14e1664640 1 -- start start 2024-04-25T02:13:25.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.788+0000 7f14e1664640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14dc0d0a60 0x7f14dc14de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.788+0000 7f14e1664640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14dc0d47e0 0x7f14dc0b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.788+0000 7f14e1664640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14dc161b90 0x7f14dc0b8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.788+0000 7f14e1664640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc0d4c70 con 0x7f14dc0d0a60 2024-04-25T02:13:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.788+0000 7f14e1664640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc0cf770 con 0x7f14dc161b90 2024-04-25T02:13:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.788+0000 7f14e1664640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f14dc0d01d0 con 0x7f14dc0d47e0 2024-04-25T02:13:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.788+0000 7f14daffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14dc0d0a60 0x7f14dc14de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.788+0000 7f14daffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14dc0d0a60 0x7f14dc14de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60196/0 (socket says 172.21.15.79:60196) 2024-04-25T02:13:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.788+0000 7f14daffd640 1 -- 172.21.15.79:0/3386637184 learned_addr learned my addr 172.21.15.79:0/3386637184 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.789+0000 7f14db7fe640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14dc161b90 0x7f14dc0b8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.789+0000 7f14da7fc640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14dc0d47e0 0x7f14dc0b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.789+0000 7f14daffd640 1 -- 172.21.15.79:0/3386637184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14dc0d47e0 msgr2=0x7f14dc0b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.789+0000 7f14daffd640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14dc0d47e0 0x7f14dc0b73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.789+0000 7f14daffd640 1 -- 172.21.15.79:0/3386637184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14dc161b90 msgr2=0x7f14dc0b8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.789+0000 7f14daffd640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14dc161b90 0x7f14dc0b8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.789+0000 7f14daffd640 1 -- 172.21.15.79:0/3386637184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14dc0b9d20 con 0x7f14dc0d0a60 2024-04-25T02:13:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.789+0000 7f14da7fc640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14dc0d47e0 0x7f14dc0b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.789+0000 7f14db7fe640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14dc161b90 0x7f14dc0b8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:25.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.789+0000 7f14daffd640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14dc0d0a60 0x7f14dc14de70 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00ba50 tx=0x7f14cc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:25.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.789+0000 7f14c37fe640 1 -- 172.21.15.79:0/3386637184 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc019070 con 0x7f14dc0d0a60 2024-04-25T02:13:25.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.789+0000 7f14c37fe640 1 -- 172.21.15.79:0/3386637184 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14cc00cc00 con 0x7f14dc0d0a60 2024-04-25T02:13:25.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.789+0000 7f14c37fe640 1 -- 172.21.15.79:0/3386637184 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc014440 con 0x7f14dc0d0a60 2024-04-25T02:13:25.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.789+0000 7f14e1664640 1 -- 172.21.15.79:0/3386637184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14dc0b9a40 con 0x7f14dc0d0a60 2024-04-25T02:13:25.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.789+0000 7f14e1664640 1 -- 172.21.15.79:0/3386637184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14dc14d670 con 0x7f14dc0d0a60 2024-04-25T02:13:25.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.790+0000 7f14e1664640 1 -- 172.21.15.79:0/3386637184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14dc0690a0 con 0x7f14dc0d0a60 2024-04-25T02:13:25.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.790+0000 7f14c37fe640 1 -- 172.21.15.79:0/3386637184 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14cc01c070 con 0x7f14dc0d0a60 2024-04-25T02:13:25.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.791+0000 7f14c37fe640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f14c806be30 0x7f14c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:25.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.791+0000 7f14c37fe640 1 -- 172.21.15.79:0/3386637184 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7f14cc08abf0 con 0x7f14dc0d0a60 2024-04-25T02:13:25.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.791+0000 7f14da7fc640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f14c806be30 0x7f14c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:25.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.791+0000 7f14da7fc640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f14c806be30 0x7f14c806e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f14d0034000 tx=0x7f14d002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:25.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:25.795+0000 7f14c37fe640 1 -- 172.21.15.79:0/3386637184 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f14cc0595a0 con 0x7f14dc0d0a60 2024-04-25T02:13:26.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.004+0000 7f14e1664640 1 -- 172.21.15.79:0/3386637184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14dc06d200 con 0x7f14dc0d0a60 2024-04-25T02:13:26.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.004+0000 7f14c37fe640 1 -- 172.21.15.79:0/3386637184 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5182 (secure 0 0 0) 0x7f14cc058ea0 con 0x7f14dc0d0a60 2024-04-25T02:13:26.011 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:26.011 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/596307304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":596307304},{"type":"v1","addr":"172.21.15.189:6834","nonce":596307304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/980112490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":980112490},{"type":"v1","addr":"172.21.15.189:6835","nonce":980112490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2550610051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550610051},{"type":"v1","addr":"172.21.15.79:6836","nonce":2550610051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:11:55.951694+0000","modified":"2024-04-25T02:12:52.486536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":72,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":18,"addr":"172.21.15.79:6837/782013262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":782013262},{"type":"v1","addr":"172.21.15.79:6837","nonce":782013262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6696,"qdb_cluster":[6696]},"id":5}]} 2024-04-25T02:13:26.011 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2024-04-25T02:13:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.006+0000 7f14e1664640 1 -- 172.21.15.79:0/3386637184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f14c806be30 msgr2=0x7f14c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.006+0000 7f14e1664640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f14c806be30 0x7f14c806e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f14d0034000 tx=0x7f14d002e000 comp rx=0 tx=0).stop 2024-04-25T02:13:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.006+0000 7f14e1664640 1 -- 172.21.15.79:0/3386637184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14dc0d0a60 msgr2=0x7f14dc14de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.006+0000 7f14e1664640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14dc0d0a60 0x7f14dc14de70 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00ba50 tx=0x7f14cc00bf10 comp rx=0 tx=0).stop 2024-04-25T02:13:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.006+0000 7f14e1664640 1 -- 172.21.15.79:0/3386637184 shutdown_connections 2024-04-25T02:13:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.006+0000 7f14e1664640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f14c806be30 0x7f14c806e2f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.006+0000 7f14e1664640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14dc161b90 0x7f14dc0b8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.006+0000 7f14e1664640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14dc0d47e0 0x7f14dc0b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.006+0000 7f14e1664640 1 --2- 172.21.15.79:0/3386637184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14dc0d0a60 0x7f14dc14de70 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.006+0000 7f14e1664640 1 -- 172.21.15.79:0/3386637184 >> 172.21.15.79:0/3386637184 conn(0x7f14dc09d460 msgr2=0x7f14dc0b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.006+0000 7f14e1664640 1 -- 172.21.15.79:0/3386637184 shutdown_connections 2024-04-25T02:13:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.006+0000 7f14e1664640 1 -- 172.21.15.79:0/3386637184 wait complete. 2024-04-25T02:13:26.023 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:13:26.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.115+0000 7fe251a9e640 1 Processor -- start 2024-04-25T02:13:26.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.115+0000 7fe251a9e640 1 -- start start 2024-04-25T02:13:26.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe251a9e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe24c15a720 0x7fe24c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe251a9e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe24c0d07a0 0x7fe24c0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe251a9e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe24c0b47e0 0x7fe24c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe251a9e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe24c15f1c0 con 0x7fe24c0b47e0 2024-04-25T02:13:26.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe251a9e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe24c0b2e60 con 0x7fe24c15a720 2024-04-25T02:13:26.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe251a9e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe24c0b3140 con 0x7fe24c0d07a0 2024-04-25T02:13:26.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe24bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe24c0b47e0 0x7fe24c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe24bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe24c0b47e0 0x7fe24c15ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60210/0 (socket says 172.21.15.79:60210) 2024-04-25T02:13:26.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe24bfff640 1 -- 172.21.15.79:0/2376087411 learned_addr learned my addr 172.21.15.79:0/2376087411 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:26.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe24b7fe640 1 --2- 172.21.15.79:0/2376087411 >> v2:172.21.15.189:3300/0 conn(0x7fe24c15a720 0x7fe24c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe24affd640 1 --2- 172.21.15.79:0/2376087411 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe24c0d07a0 0x7fe24c0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe24bfff640 1 -- 172.21.15.79:0/2376087411 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe24c0d07a0 msgr2=0x7fe24c0b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:26.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe24bfff640 1 --2- 172.21.15.79:0/2376087411 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe24c0d07a0 0x7fe24c0b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe24bfff640 1 -- 172.21.15.79:0/2376087411 >> v2:172.21.15.189:3300/0 conn(0x7fe24c15a720 msgr2=0x7fe24c15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:26.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe24bfff640 1 --2- 172.21.15.79:0/2376087411 >> v2:172.21.15.189:3300/0 conn(0x7fe24c15a720 0x7fe24c15ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.116+0000 7fe24bfff640 1 -- 172.21.15.79:0/2376087411 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24c0b3420 con 0x7fe24c0b47e0 2024-04-25T02:13:26.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.117+0000 7fe24bfff640 1 --2- 172.21.15.79:0/2376087411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe24c0b47e0 0x7fe24c15ab00 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fe24c074d80 tx=0x7fe24402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc869179fb7712e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:26.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.117+0000 7fe24a7fc640 1 -- 172.21.15.79:0/2376087411 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244036070 con 0x7fe24c0b47e0 2024-04-25T02:13:26.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.117+0000 7fe24a7fc640 1 -- 172.21.15.79:0/2376087411 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe244031600 con 0x7fe24c0b47e0 2024-04-25T02:13:26.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.117+0000 7fe24a7fc640 1 -- 172.21.15.79:0/2376087411 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2440319d0 con 0x7fe24c0b47e0 2024-04-25T02:13:26.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.117+0000 7fe251a9e640 1 -- 172.21.15.79:0/2376087411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe24c0b47e0 msgr2=0x7fe24c15ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.117+0000 7fe251a9e640 1 --2- 172.21.15.79:0/2376087411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe24c0b47e0 0x7fe24c15ab00 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fe24c074d80 tx=0x7fe24402a610 comp rx=0 tx=0).stop 2024-04-25T02:13:26.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.118+0000 7fe251a9e640 1 -- 172.21.15.79:0/2376087411 shutdown_connections 2024-04-25T02:13:26.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.118+0000 7fe251a9e640 1 --2- 172.21.15.79:0/2376087411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe24c0b47e0 0x7fe24c15ab00 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.118+0000 7fe251a9e640 1 --2- 172.21.15.79:0/2376087411 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe24c0d07a0 0x7fe24c0b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.118+0000 7fe251a9e640 1 --2- 172.21.15.79:0/2376087411 >> v2:172.21.15.189:3300/0 conn(0x7fe24c15a720 0x7fe24c15ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.118+0000 7fe251a9e640 1 -- 172.21.15.79:0/2376087411 >> 172.21.15.79:0/2376087411 conn(0x7fe24c0cfc80 msgr2=0x7fe24c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:26.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.118+0000 7fe251a9e640 1 -- 172.21.15.79:0/2376087411 shutdown_connections 2024-04-25T02:13:26.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.118+0000 7fe251a9e640 1 -- 172.21.15.79:0/2376087411 wait complete. 2024-04-25T02:13:26.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.119+0000 7fe251a9e640 1 Processor -- start 2024-04-25T02:13:26.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.119+0000 7fe251a9e640 1 -- start start 2024-04-25T02:13:26.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe251a9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe24c0b47e0 0x7fe24c1f1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe251a9e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe24c0d07a0 0x7fe24c1f16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe251a9e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe24c15a720 0x7fe24c150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe251a9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c071e00 con 0x7fe24c0b47e0 2024-04-25T02:13:26.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe251a9e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c0b39e0 con 0x7fe24c15a720 2024-04-25T02:13:26.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe251a9e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe24c071f80 con 0x7fe24c0d07a0 2024-04-25T02:13:26.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe24b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe24c0b47e0 0x7fe24c1f1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe24b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe24c0b47e0 0x7fe24c1f1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60214/0 (socket says 172.21.15.79:60214) 2024-04-25T02:13:26.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe24b7fe640 1 -- 172.21.15.79:0/3189875156 learned_addr learned my addr 172.21.15.79:0/3189875156 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:26.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe24affd640 1 --2- 172.21.15.79:0/3189875156 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe24c0d07a0 0x7fe24c1f16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe24bfff640 1 --2- 172.21.15.79:0/3189875156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe24c15a720 0x7fe24c150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe24b7fe640 1 -- 172.21.15.79:0/3189875156 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe24c0d07a0 msgr2=0x7fe24c1f16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe24b7fe640 1 --2- 172.21.15.79:0/3189875156 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe24c0d07a0 0x7fe24c1f16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe24b7fe640 1 -- 172.21.15.79:0/3189875156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe24c15a720 msgr2=0x7fe24c150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe24b7fe640 1 --2- 172.21.15.79:0/3189875156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe24c15a720 0x7fe24c150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe24b7fe640 1 -- 172.21.15.79:0/3189875156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24c14d2b0 con 0x7fe24c0b47e0 2024-04-25T02:13:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe24bfff640 1 --2- 172.21.15.79:0/3189875156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe24c15a720 0x7fe24c150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe24b7fe640 1 --2- 172.21.15.79:0/3189875156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe24c0b47e0 0x7fe24c1f1180 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00d5f0 tx=0x7fe23c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe233fff640 1 -- 172.21.15.79:0/3189875156 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0125f0 con 0x7fe24c0b47e0 2024-04-25T02:13:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe233fff640 1 -- 172.21.15.79:0/3189875156 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23c019070 con 0x7fe24c0b47e0 2024-04-25T02:13:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe251a9e640 1 -- 172.21.15.79:0/3189875156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24c14d590 con 0x7fe24c0b47e0 2024-04-25T02:13:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe233fff640 1 -- 172.21.15.79:0/3189875156 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0129d0 con 0x7fe24c0b47e0 2024-04-25T02:13:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.120+0000 7fe251a9e640 1 -- 172.21.15.79:0/3189875156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24c1547b0 con 0x7fe24c0b47e0 2024-04-25T02:13:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.121+0000 7fe251a9e640 1 -- 172.21.15.79:0/3189875156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe24c0690a0 con 0x7fe24c0b47e0 2024-04-25T02:13:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.122+0000 7fe233fff640 1 -- 172.21.15.79:0/3189875156 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe23c012b70 con 0x7fe24c0b47e0 2024-04-25T02:13:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.122+0000 7fe233fff640 1 --2- 172.21.15.79:0/3189875156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe23806be30 0x7fe23806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.122+0000 7fe233fff640 1 -- 172.21.15.79:0/3189875156 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7fe23c08b340 con 0x7fe24c0b47e0 2024-04-25T02:13:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.122+0000 7fe24affd640 1 --2- 172.21.15.79:0/3189875156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe23806be30 0x7fe23806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.123+0000 7fe24affd640 1 --2- 172.21.15.79:0/3189875156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe23806be30 0x7fe23806e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe24c06e130 tx=0x7fe240008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:26.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.127+0000 7fe233fff640 1 -- 172.21.15.79:0/3189875156 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe23c059bd0 con 0x7fe24c0b47e0 2024-04-25T02:13:26.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.335+0000 7fe251a9e640 1 -- 172.21.15.79:0/3189875156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe24c15c7a0 con 0x7fe24c0b47e0 2024-04-25T02:13:26.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.336+0000 7fe233fff640 1 -- 172.21.15.79:0/3189875156 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5182 (secure 0 0 0) 0x7fe23c0594d0 con 0x7fe24c0b47e0 2024-04-25T02:13:26.342 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:26.342 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/596307304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":596307304},{"type":"v1","addr":"172.21.15.189:6834","nonce":596307304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/980112490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":980112490},{"type":"v1","addr":"172.21.15.189:6835","nonce":980112490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2550610051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550610051},{"type":"v1","addr":"172.21.15.79:6836","nonce":2550610051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:11:55.951694+0000","modified":"2024-04-25T02:12:52.486536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":72,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":18,"addr":"172.21.15.79:6837/782013262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":782013262},{"type":"v1","addr":"172.21.15.79:6837","nonce":782013262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6696,"qdb_cluster":[6696]},"id":5}]} 2024-04-25T02:13:26.342 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2024-04-25T02:13:26.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.338+0000 7fe251a9e640 1 -- 172.21.15.79:0/3189875156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe23806be30 msgr2=0x7fe23806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.338+0000 7fe251a9e640 1 --2- 172.21.15.79:0/3189875156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe23806be30 0x7fe23806e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe24c06e130 tx=0x7fe240008040 comp rx=0 tx=0).stop 2024-04-25T02:13:26.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.338+0000 7fe251a9e640 1 -- 172.21.15.79:0/3189875156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe24c0b47e0 msgr2=0x7fe24c1f1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.338+0000 7fe251a9e640 1 --2- 172.21.15.79:0/3189875156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe24c0b47e0 0x7fe24c1f1180 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00d5f0 tx=0x7fe23c00dab0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.338+0000 7fe251a9e640 1 -- 172.21.15.79:0/3189875156 shutdown_connections 2024-04-25T02:13:26.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.338+0000 7fe251a9e640 1 --2- 172.21.15.79:0/3189875156 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe23806be30 0x7fe23806e2f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.338+0000 7fe251a9e640 1 --2- 172.21.15.79:0/3189875156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe24c15a720 0x7fe24c150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.338+0000 7fe251a9e640 1 --2- 172.21.15.79:0/3189875156 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe24c0d07a0 0x7fe24c1f16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.338+0000 7fe251a9e640 1 --2- 172.21.15.79:0/3189875156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe24c0b47e0 0x7fe24c1f1180 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.338+0000 7fe251a9e640 1 -- 172.21.15.79:0/3189875156 >> 172.21.15.79:0/3189875156 conn(0x7fe24c0cfc80 msgr2=0x7fe24c0d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:26.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.338+0000 7fe251a9e640 1 -- 172.21.15.79:0/3189875156 shutdown_connections 2024-04-25T02:13:26.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.338+0000 7fe251a9e640 1 -- 172.21.15.79:0/3189875156 wait complete. 2024-04-25T02:13:26.355 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:13:26.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.446+0000 7ff1b2c37640 1 Processor -- start 2024-04-25T02:13:26.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.446+0000 7ff1b2c37640 1 -- start start 2024-04-25T02:13:26.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.446+0000 7ff1b2c37640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff1ac0d0b10 0x7ff1ac0cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.446+0000 7ff1b2c37640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1ac0cff30 con 0x7ff1ac15c230 2024-04-25T02:13:26.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.446+0000 7ff1b2c37640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1ac0cf720 con 0x7ff1ac0d2940 2024-04-25T02:13:26.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.446+0000 7ff1b2c37640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff1ac0d2d50 con 0x7ff1ac0d0b10 2024-04-25T02:13:26.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1b09d3640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff1ac15c230 0x7ff1ac0d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44694/0 (socket says 172.21.15.79:44694) 2024-04-25T02:13:26.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1b09d3640 1 -- 172.21.15.79:0/257210816 learned_addr learned my addr 172.21.15.79:0/257210816 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:26.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1abfff640 1 --2- 172.21.15.79:0/257210816 >> v2:172.21.15.189:3300/0 conn(0x7ff1ac0d0b10 0x7ff1ac0cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1ab7fe640 1 -- 172.21.15.79:0/257210816 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1373103426 0 0) 0x7ff1a4001490 con 0x7ff1ac15c230 2024-04-25T02:13:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1ab7fe640 1 -- 172.21.15.79:0/257210816 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff198003520 con 0x7ff1ac15c230 2024-04-25T02:13:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1ab7fe640 1 -- 172.21.15.79:0/257210816 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 581115966 0 0) 0x7ff198003520 con 0x7ff1ac15c230 2024-04-25T02:13:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1ab7fe640 1 -- 172.21.15.79:0/257210816 >> v2:172.21.15.189:3300/0 conn(0x7ff1ac0d0b10 msgr2=0x7ff1ac0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1ab7fe640 1 --2- 172.21.15.79:0/257210816 >> v2:172.21.15.189:3300/0 conn(0x7ff1ac0d0b10 0x7ff1ac0cee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1ab7fe640 1 -- 172.21.15.79:0/257210816 >> v1:172.21.15.189:6789/0 conn(0x7ff1ac0d2940 legacy=0x7ff1ac0b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1ab7fe640 1 -- 172.21.15.79:0/257210816 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ac0cf440 con 0x7ff1ac15c230 2024-04-25T02:13:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1ab7fe640 1 -- 172.21.15.79:0/257210816 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7ff1a4001bc0 con 0x7ff1ac15c230 2024-04-25T02:13:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1ab7fe640 1 -- 172.21.15.79:0/257210816 >> v1:172.21.15.79:6789/0 conn(0x7ff1ac15c230 legacy=0x7ff1ac0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1ab7fe640 1 --2- 172.21.15.79:0/257210816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1980039b0 0x7ff198003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1ab7fe640 1 --2- 172.21.15.79:0/257210816 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff198004800 0x7ff198004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1ab7fe640 1 --2- 172.21.15.79:0/257210816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1980051c0 0x7ff19800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1ab7fe640 1 -- 172.21.15.79:0/257210816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac0d2d50 con 0x7ff1980039b0 2024-04-25T02:13:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1ab7fe640 1 -- 172.21.15.79:0/257210816 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff19800c160 con 0x7ff1980051c0 2024-04-25T02:13:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1ab7fe640 1 -- 172.21.15.79:0/257210816 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff19800c360 con 0x7ff198004800 2024-04-25T02:13:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1b09d3640 1 --2- 172.21.15.79:0/257210816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1980039b0 0x7ff198003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1abfff640 1 --2- 172.21.15.79:0/257210816 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff198004800 0x7ff198004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1b11d4640 1 --2- 172.21.15.79:0/257210816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1980051c0 0x7ff19800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1b09d3640 1 -- 172.21.15.79:0/257210816 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff198004800 msgr2=0x7ff198004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1b09d3640 1 --2- 172.21.15.79:0/257210816 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff198004800 0x7ff198004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1b09d3640 1 -- 172.21.15.79:0/257210816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1980051c0 msgr2=0x7ff19800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1b09d3640 1 --2- 172.21.15.79:0/257210816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1980051c0 0x7ff19800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1b09d3640 1 -- 172.21.15.79:0/257210816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff198003520 con 0x7ff1980039b0 2024-04-25T02:13:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.447+0000 7ff1b11d4640 1 -- 172.21.15.79:0/257210816 reap_dead start 2024-04-25T02:13:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.448+0000 7ff1abfff640 1 --2- 172.21.15.79:0/257210816 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff198004800 0x7ff198004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.448+0000 7ff1b09d3640 1 --2- 172.21.15.79:0/257210816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1980039b0 0x7ff198003dd0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400a630 tx=0x7ff198005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2155431443f94545 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.448+0000 7ff1ab7fe640 1 -- 172.21.15.79:0/257210816 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a400a670 con 0x7ff1980039b0 2024-04-25T02:13:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.448+0000 7ff1ab7fe640 1 -- 172.21.15.79:0/257210816 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a4037650 con 0x7ff1980039b0 2024-04-25T02:13:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.448+0000 7ff1ab7fe640 1 -- 172.21.15.79:0/257210816 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4037a80 con 0x7ff1980039b0 2024-04-25T02:13:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.449+0000 7ff1b2c37640 1 -- 172.21.15.79:0/257210816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1980039b0 msgr2=0x7ff198003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.449+0000 7ff1b2c37640 1 --2- 172.21.15.79:0/257210816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1980039b0 0x7ff198003dd0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400a630 tx=0x7ff198005830 comp rx=0 tx=0).stop 2024-04-25T02:13:26.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.449+0000 7ff1b2c37640 1 -- 172.21.15.79:0/257210816 shutdown_connections 2024-04-25T02:13:26.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.449+0000 7ff1b2c37640 1 --2- 172.21.15.79:0/257210816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1980039b0 0x7ff198003dd0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.449+0000 7ff1b2c37640 1 -- 172.21.15.79:0/257210816 >> 172.21.15.79:0/257210816 conn(0x7ff1ac0d1e20 msgr2=0x7ff1ac0d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:26.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.449+0000 7ff1b2c37640 1 -- 172.21.15.79:0/257210816 shutdown_connections 2024-04-25T02:13:26.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.449+0000 7ff1b2c37640 1 -- 172.21.15.79:0/257210816 wait complete. 2024-04-25T02:13:26.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.450+0000 7ff1b2c37640 1 Processor -- start 2024-04-25T02:13:26.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.450+0000 7ff1b2c37640 1 -- start start 2024-04-25T02:13:26.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b2c37640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1980039b0 0x7ff1ac0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b2c37640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1ac1e6aa0 0x7ff1ac0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b2c37640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1ac0ccba0 0x7ff1ac15c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b2c37640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac15c610 con 0x7ff1980039b0 2024-04-25T02:13:26.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b2c37640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac0b1670 con 0x7ff1ac1e6aa0 2024-04-25T02:13:26.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b2c37640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff1ac0cee60 con 0x7ff1ac0ccba0 2024-04-25T02:13:26.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b09d3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1980039b0 0x7ff1ac0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b09d3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1980039b0 0x7ff1ac0b78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60240/0 (socket says 172.21.15.79:60240) 2024-04-25T02:13:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b09d3640 1 -- 172.21.15.79:0/1589400086 learned_addr learned my addr 172.21.15.79:0/1589400086 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b09d3640 1 -- 172.21.15.79:0/1589400086 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1ac0ccba0 msgr2=0x7ff1ac15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b11d4640 1 --2- 172.21.15.79:0/1589400086 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1ac0ccba0 0x7ff1ac15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1abfff640 1 --2- 172.21.15.79:0/1589400086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1ac1e6aa0 0x7ff1ac0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b09d3640 1 --2- 172.21.15.79:0/1589400086 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1ac0ccba0 0x7ff1ac15c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b09d3640 1 -- 172.21.15.79:0/1589400086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1ac1e6aa0 msgr2=0x7ff1ac0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b09d3640 1 --2- 172.21.15.79:0/1589400086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1ac1e6aa0 0x7ff1ac0b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b09d3640 1 -- 172.21.15.79:0/1589400086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ac0b51b0 con 0x7ff1980039b0 2024-04-25T02:13:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.451+0000 7ff1b09d3640 1 --2- 172.21.15.79:0/1589400086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1980039b0 0x7ff1ac0b78d0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400a0b0 tx=0x7ff1a4001f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.452+0000 7ff1a97fa640 1 -- 172.21.15.79:0/1589400086 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4044020 con 0x7ff1980039b0 2024-04-25T02:13:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.452+0000 7ff1a97fa640 1 -- 172.21.15.79:0/1589400086 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a4001490 con 0x7ff1980039b0 2024-04-25T02:13:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.452+0000 7ff1a97fa640 1 -- 172.21.15.79:0/1589400086 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4001bc0 con 0x7ff1980039b0 2024-04-25T02:13:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.452+0000 7ff1b2c37640 1 -- 172.21.15.79:0/1589400086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1ac1e5ce0 con 0x7ff1980039b0 2024-04-25T02:13:26.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.452+0000 7ff1b2c37640 1 -- 172.21.15.79:0/1589400086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1ac1e62a0 con 0x7ff1980039b0 2024-04-25T02:13:26.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.453+0000 7ff1b2c37640 1 -- 172.21.15.79:0/1589400086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1ac0681e0 con 0x7ff1980039b0 2024-04-25T02:13:26.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.453+0000 7ff1a97fa640 1 -- 172.21.15.79:0/1589400086 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1a4047020 con 0x7ff1980039b0 2024-04-25T02:13:26.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.453+0000 7ff1a97fa640 1 --2- 172.21.15.79:0/1589400086 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff18c06be30 0x7ff18c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.453+0000 7ff1a97fa640 1 -- 172.21.15.79:0/1589400086 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7ff1a40afdc0 con 0x7ff1980039b0 2024-04-25T02:13:26.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.454+0000 7ff1abfff640 1 --2- 172.21.15.79:0/1589400086 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff18c06be30 0x7ff18c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.454+0000 7ff1abfff640 1 --2- 172.21.15.79:0/1589400086 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff18c06be30 0x7ff18c06e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac06d850 tx=0x7ff19c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:26.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.458+0000 7ff1a97fa640 1 -- 172.21.15.79:0/1589400086 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff1a404e030 con 0x7ff1980039b0 2024-04-25T02:13:26.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.632+0000 7ff1b2c37640 1 -- 172.21.15.79:0/1589400086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1ac06e0a0 con 0x7ff1980039b0 2024-04-25T02:13:26.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.633+0000 7ff1a97fa640 1 -- 172.21.15.79:0/1589400086 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16907 (secure 0 0 0) 0x7ff1ac0b51b0 con 0x7ff1980039b0 2024-04-25T02:13:26.640 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:26.640 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:12:41.808973+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:11:54.161817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T02:11:54.917049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.22","mappings":[{"from":6,"to":0}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.189:6835/469348969":"2024-04-26T02:12:09.471251+0000","172.21.15.189:6833/469348969":"2024-04-26T02:12:09.471251+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:13:26.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.635+0000 7ff1b2c37640 1 -- 172.21.15.79:0/1589400086 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff18c06be30 msgr2=0x7ff18c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.635+0000 7ff1b2c37640 1 --2- 172.21.15.79:0/1589400086 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff18c06be30 0x7ff18c06e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac06d850 tx=0x7ff19c008040 comp rx=0 tx=0).stop 2024-04-25T02:13:26.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.635+0000 7ff1b2c37640 1 -- 172.21.15.79:0/1589400086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1980039b0 msgr2=0x7ff1ac0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.635+0000 7ff1b2c37640 1 --2- 172.21.15.79:0/1589400086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1980039b0 0x7ff1ac0b78d0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400a0b0 tx=0x7ff1a4001f90 comp rx=0 tx=0).stop 2024-04-25T02:13:26.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.635+0000 7ff1b2c37640 1 -- 172.21.15.79:0/1589400086 shutdown_connections 2024-04-25T02:13:26.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.635+0000 7ff1b2c37640 1 --2- 172.21.15.79:0/1589400086 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff18c06be30 0x7ff18c06e2f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.635+0000 7ff1b2c37640 1 --2- 172.21.15.79:0/1589400086 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1ac0ccba0 0x7ff1ac15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.635+0000 7ff1b2c37640 1 --2- 172.21.15.79:0/1589400086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1ac1e6aa0 0x7ff1ac0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.635+0000 7ff1b2c37640 1 --2- 172.21.15.79:0/1589400086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1980039b0 0x7ff1ac0b78d0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.635+0000 7ff1b2c37640 1 -- 172.21.15.79:0/1589400086 >> 172.21.15.79:0/1589400086 conn(0x7ff1ac0d1e20 msgr2=0x7ff1ac159f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:26.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.635+0000 7ff1b2c37640 1 -- 172.21.15.79:0/1589400086 shutdown_connections 2024-04-25T02:13:26.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.635+0000 7ff1b2c37640 1 -- 172.21.15.79:0/1589400086 wait complete. 2024-04-25T02:13:26.653 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:13:26.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.744+0000 7ffb17110640 1 Processor -- start 2024-04-25T02:13:26.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.744+0000 7ffb17110640 1 -- start start 2024-04-25T02:13:26.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb17110640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb1006e3e0 0x7ffb10071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb17110640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb10070d90 con 0x7ffb10144cb0 2024-04-25T02:13:26.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb17110640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb100cf130 con 0x7ffb1006df50 2024-04-25T02:13:26.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb17110640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffb100cf410 con 0x7ffb1006e3e0 2024-04-25T02:13:26.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb14eac640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ffb10144cb0 0x7ffb100b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44704/0 (socket says 172.21.15.79:44704) 2024-04-25T02:13:26.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb14eac640 1 -- 172.21.15.79:0/2992850859 learned_addr learned my addr 172.21.15.79:0/2992850859 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb0f7fe640 1 -- 172.21.15.79:0/2992850859 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2608222513 0 0) 0x7ffb10070d90 con 0x7ffb10144cb0 2024-04-25T02:13:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb0f7fe640 1 -- 172.21.15.79:0/2992850859 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb00003520 con 0x7ffb10144cb0 2024-04-25T02:13:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb156ad640 1 --2- 172.21.15.79:0/2992850859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb1006e3e0 0x7ffb10071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb0f7fe640 1 -- 172.21.15.79:0/2992850859 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2438351822 0 0) 0x7ffb00003520 con 0x7ffb10144cb0 2024-04-25T02:13:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb0f7fe640 1 -- 172.21.15.79:0/2992850859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb1006e3e0 msgr2=0x7ffb10071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb0f7fe640 1 --2- 172.21.15.79:0/2992850859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb1006e3e0 0x7ffb10071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb0f7fe640 1 -- 172.21.15.79:0/2992850859 >> v1:172.21.15.189:6789/0 conn(0x7ffb1006df50 legacy=0x7ffb10071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb0f7fe640 1 -- 172.21.15.79:0/2992850859 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb100cf6f0 con 0x7ffb10144cb0 2024-04-25T02:13:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb0f7fe640 1 -- 172.21.15.79:0/2992850859 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7ffb04001670 con 0x7ffb10144cb0 2024-04-25T02:13:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb0f7fe640 1 -- 172.21.15.79:0/2992850859 >> v1:172.21.15.79:6789/0 conn(0x7ffb10144cb0 legacy=0x7ffb100b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.745+0000 7ffb0f7fe640 1 --2- 172.21.15.79:0/2992850859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb000039e0 0x7ffb00003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.746+0000 7ffb0f7fe640 1 --2- 172.21.15.79:0/2992850859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb00004800 0x7ffb00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.746+0000 7ffb0f7fe640 1 --2- 172.21.15.79:0/2992850859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb1006e3e0 0x7ffb00005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.746+0000 7ffb0f7fe640 1 -- 172.21.15.79:0/2992850859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb100cf410 con 0x7ffb00004800 2024-04-25T02:13:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.746+0000 7ffb0f7fe640 1 -- 172.21.15.79:0/2992850859 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0000baf0 con 0x7ffb000039e0 2024-04-25T02:13:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.746+0000 7ffb0f7fe640 1 -- 172.21.15.79:0/2992850859 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0000bcf0 con 0x7ffb1006e3e0 2024-04-25T02:13:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.746+0000 7ffb0ffff640 1 --2- 172.21.15.79:0/2992850859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb00004800 0x7ffb00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.746+0000 7ffb14eac640 1 --2- 172.21.15.79:0/2992850859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb000039e0 0x7ffb00003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.746+0000 7ffb156ad640 1 --2- 172.21.15.79:0/2992850859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb1006e3e0 0x7ffb00005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.746+0000 7ffb0ffff640 1 -- 172.21.15.79:0/2992850859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb1006e3e0 msgr2=0x7ffb00005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.746+0000 7ffb0ffff640 1 --2- 172.21.15.79:0/2992850859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb1006e3e0 0x7ffb00005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.746+0000 7ffb0ffff640 1 -- 172.21.15.79:0/2992850859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb000039e0 msgr2=0x7ffb00003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.746+0000 7ffb0ffff640 1 --2- 172.21.15.79:0/2992850859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb000039e0 0x7ffb00003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.746+0000 7ffb0ffff640 1 -- 172.21.15.79:0/2992850859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb00003520 con 0x7ffb00004800 2024-04-25T02:13:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.746+0000 7ffb14eac640 1 --2- 172.21.15.79:0/2992850859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb000039e0 0x7ffb00003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.747+0000 7ffb0ffff640 1 --2- 172.21.15.79:0/2992850859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb00004800 0x7ffb00004c80 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ffafc001910 tx=0x7ffb00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb26983a193dbee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.747+0000 7ffb0f7fe640 1 -- 172.21.15.79:0/2992850859 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffafc037070 con 0x7ffb00004800 2024-04-25T02:13:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.747+0000 7ffb0f7fe640 1 -- 172.21.15.79:0/2992850859 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffafc02ac40 con 0x7ffb00004800 2024-04-25T02:13:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.747+0000 7ffb0f7fe640 1 -- 172.21.15.79:0/2992850859 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffafc0014e0 con 0x7ffb00004800 2024-04-25T02:13:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.747+0000 7ffb17110640 1 -- 172.21.15.79:0/2992850859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb00004800 msgr2=0x7ffb00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.747+0000 7ffb17110640 1 --2- 172.21.15.79:0/2992850859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb00004800 0x7ffb00004c80 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ffafc001910 tx=0x7ffb00005830 comp rx=0 tx=0).stop 2024-04-25T02:13:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.747+0000 7ffb156ad640 1 -- 172.21.15.79:0/2992850859 reap_dead start 2024-04-25T02:13:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.747+0000 7ffb17110640 1 -- 172.21.15.79:0/2992850859 shutdown_connections 2024-04-25T02:13:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.747+0000 7ffb17110640 1 -- 172.21.15.79:0/2992850859 >> 172.21.15.79:0/2992850859 conn(0x7ffb100cfc80 msgr2=0x7ffb100d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.747+0000 7ffb17110640 1 -- 172.21.15.79:0/2992850859 shutdown_connections 2024-04-25T02:13:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.747+0000 7ffb17110640 1 -- 172.21.15.79:0/2992850859 wait complete. 2024-04-25T02:13:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.748+0000 7ffb17110640 1 Processor -- start 2024-04-25T02:13:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.748+0000 7ffb17110640 1 -- start start 2024-04-25T02:13:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.749+0000 7ffb17110640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb00004800 0x7ffb101407b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.749+0000 7ffb17110640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb10158550 0x7ffb101432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.749+0000 7ffb17110640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb101589d0 0x7ffb10143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.749+0000 7ffb17110640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb100cf9d0 con 0x7ffb101589d0 2024-04-25T02:13:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.749+0000 7ffb17110640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffb100b5750 con 0x7ffb10158550 2024-04-25T02:13:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.749+0000 7ffb17110640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffb10145090 con 0x7ffb00004800 2024-04-25T02:13:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.749+0000 7ffb156ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb101589d0 0x7ffb10143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.749+0000 7ffb156ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb101589d0 0x7ffb10143830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60270/0 (socket says 172.21.15.79:60270) 2024-04-25T02:13:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.749+0000 7ffb156ad640 1 -- 172.21.15.79:0/1595281297 learned_addr learned my addr 172.21.15.79:0/1595281297 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.750+0000 7ffb14eac640 1 --2- 172.21.15.79:0/1595281297 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb00004800 0x7ffb101407b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.750+0000 7ffb0ffff640 1 --2- 172.21.15.79:0/1595281297 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb10158550 0x7ffb101432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.750+0000 7ffb156ad640 1 -- 172.21.15.79:0/1595281297 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb00004800 msgr2=0x7ffb101407b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.750+0000 7ffb156ad640 1 --2- 172.21.15.79:0/1595281297 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb00004800 0x7ffb101407b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.750+0000 7ffb156ad640 1 -- 172.21.15.79:0/1595281297 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb10158550 msgr2=0x7ffb101432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.750+0000 7ffb156ad640 1 --2- 172.21.15.79:0/1595281297 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb10158550 0x7ffb101432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.750+0000 7ffb156ad640 1 -- 172.21.15.79:0/1595281297 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb10158fa0 con 0x7ffb101589d0 2024-04-25T02:13:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.750+0000 7ffb14eac640 1 --2- 172.21.15.79:0/1595281297 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb00004800 0x7ffb101407b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:26.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.750+0000 7ffb156ad640 1 --2- 172.21.15.79:0/1595281297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb101589d0 0x7ffb10143830 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ffb1006f8a0 tx=0x7ffb080115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:26.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.750+0000 7ffb0d7fa640 1 -- 172.21.15.79:0/1595281297 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08003990 con 0x7ffb101589d0 2024-04-25T02:13:26.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.750+0000 7ffb0d7fa640 1 -- 172.21.15.79:0/1595281297 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0801b070 con 0x7ffb101589d0 2024-04-25T02:13:26.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.750+0000 7ffb17110640 1 -- 172.21.15.79:0/1595281297 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb10159280 con 0x7ffb101589d0 2024-04-25T02:13:26.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.750+0000 7ffb0d7fa640 1 -- 172.21.15.79:0/1595281297 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08003b70 con 0x7ffb101589d0 2024-04-25T02:13:26.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.750+0000 7ffb17110640 1 -- 172.21.15.79:0/1595281297 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb10156170 con 0x7ffb101589d0 2024-04-25T02:13:26.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.751+0000 7ffb17110640 1 -- 172.21.15.79:0/1595281297 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb100690a0 con 0x7ffb101589d0 2024-04-25T02:13:26.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.751+0000 7ffb0d7fa640 1 -- 172.21.15.79:0/1595281297 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb08005d10 con 0x7ffb101589d0 2024-04-25T02:13:26.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.752+0000 7ffb0d7fa640 1 --2- 172.21.15.79:0/1595281297 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffaf406be60 0x7ffaf406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:26.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.752+0000 7ffb14eac640 1 --2- 172.21.15.79:0/1595281297 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffaf406be60 0x7ffaf406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:26.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.752+0000 7ffb0d7fa640 1 -- 172.21.15.79:0/1595281297 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5853+0+0 (secure 0 0 0) 0x7ffb0808b4e0 con 0x7ffb101589d0 2024-04-25T02:13:26.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.752+0000 7ffb14eac640 1 --2- 172.21.15.79:0/1595281297 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffaf406be60 0x7ffaf406e320 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ffb04000c00 tx=0x7ffb04001040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:26.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.756+0000 7ffb0d7fa640 1 -- 172.21.15.79:0/1595281297 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffb08025020 con 0x7ffb101589d0 2024-04-25T02:13:26.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.967+0000 7ffb17110640 1 -- 172.21.15.79:0/1595281297 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ffb10072330 con 0x7ffb101589d0 2024-04-25T02:13:26.973 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:13:26.967+0000 7fb0c50c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:13:26.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.968+0000 7ffb0d7fa640 1 -- 172.21.15.79:0/1595281297 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) ==== 161+0+0 (secure 0 0 0) 0x7ffb08014350 con 0x7ffb101589d0 2024-04-25T02:13:26.975 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:13:26.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.971+0000 7ffb17110640 1 -- 172.21.15.79:0/1595281297 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffaf406be60 msgr2=0x7ffaf406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.971+0000 7ffb17110640 1 --2- 172.21.15.79:0/1595281297 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffaf406be60 0x7ffaf406e320 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ffb04000c00 tx=0x7ffb04001040 comp rx=0 tx=0).stop 2024-04-25T02:13:26.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.971+0000 7ffb17110640 1 -- 172.21.15.79:0/1595281297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb101589d0 msgr2=0x7ffb10143830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:26.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.971+0000 7ffb17110640 1 --2- 172.21.15.79:0/1595281297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb101589d0 0x7ffb10143830 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ffb1006f8a0 tx=0x7ffb080115a0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.971+0000 7ffb17110640 1 -- 172.21.15.79:0/1595281297 shutdown_connections 2024-04-25T02:13:26.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.971+0000 7ffb17110640 1 --2- 172.21.15.79:0/1595281297 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffaf406be60 0x7ffaf406e320 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.971+0000 7ffb17110640 1 --2- 172.21.15.79:0/1595281297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb101589d0 0x7ffb10143830 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.971+0000 7ffb17110640 1 --2- 172.21.15.79:0/1595281297 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb10158550 0x7ffb101432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.971+0000 7ffb17110640 1 --2- 172.21.15.79:0/1595281297 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb00004800 0x7ffb101407b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:26.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.971+0000 7ffb17110640 1 -- 172.21.15.79:0/1595281297 >> 172.21.15.79:0/1595281297 conn(0x7ffb100cfc80 msgr2=0x7ffb10072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:26.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.972+0000 7ffb17110640 1 -- 172.21.15.79:0/1595281297 shutdown_connections 2024-04-25T02:13:26.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:26.972+0000 7ffb17110640 1 -- 172.21.15.79:0/1595281297 wait complete. 2024-04-25T02:13:26.981 INFO:tasks.ceph.mds.a.smithi079.stderr: -3526> 2024-04-25T02:12:16.875+0000 7f7b4a5f2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:13:26.989 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T02:13:27.008 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:13:27.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.082+0000 7f8d59cda640 1 Processor -- start 2024-04-25T02:13:27.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.082+0000 7f8d59cda640 1 -- start start 2024-04-25T02:13:27.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.083+0000 7f8d59cda640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d5406b2f0 0x7f8d540b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:27.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.083+0000 7f8d59cda640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8d540cf7a0 0x7f8d5406b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:27.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.083+0000 7f8d59cda640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d5406e6b0 0x7f8d540cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:27.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.083+0000 7f8d59cda640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8d5415f830 con 0x7f8d5406e6b0 2024-04-25T02:13:27.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.083+0000 7f8d59cda640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f8d5406bc10 con 0x7f8d540cf7a0 2024-04-25T02:13:27.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.083+0000 7f8d59cda640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5415ec20 con 0x7f8d5406b2f0 2024-04-25T02:13:27.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.083+0000 7f8d53fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d5406e6b0 0x7f8d540cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:27.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.083+0000 7f8d53fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d5406e6b0 0x7f8d540cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60304/0 (socket says 172.21.15.79:60304) 2024-04-25T02:13:27.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.083+0000 7f8d53fff640 1 -- 172.21.15.79:0/1751526736 learned_addr learned my addr 172.21.15.79:0/1751526736 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:27.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.083+0000 7f8d53fff640 1 -- 172.21.15.79:0/1751526736 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d5406b2f0 msgr2=0x7f8d540b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:27.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.083+0000 7f8d53fff640 1 --2- 172.21.15.79:0/1751526736 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d5406b2f0 0x7f8d540b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:27.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.084+0000 7f8d53fff640 1 -- 172.21.15.79:0/1751526736 >> v2:172.21.15.189:3300/0 conn(0x7f8d540cf7a0 msgr2=0x7f8d5406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:27.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.084+0000 7f8d53fff640 1 --2- 172.21.15.79:0/1751526736 >> v2:172.21.15.189:3300/0 conn(0x7f8d540cf7a0 0x7f8d5406b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:27.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.084+0000 7f8d53fff640 1 -- 172.21.15.79:0/1751526736 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5415ef00 con 0x7f8d5406e6b0 2024-04-25T02:13:27.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.084+0000 7f8d53fff640 1 --2- 172.21.15.79:0/1751526736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d5406e6b0 0x7f8d540cdb70 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f8d540cd910 tx=0x7f8d4c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a19712ff06c464 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:27.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.084+0000 7f8d527fc640 1 -- 172.21.15.79:0/1751526736 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c036070 con 0x7f8d5406e6b0 2024-04-25T02:13:27.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.084+0000 7f8d527fc640 1 -- 172.21.15.79:0/1751526736 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d4c031600 con 0x7f8d5406e6b0 2024-04-25T02:13:27.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.084+0000 7f8d527fc640 1 -- 172.21.15.79:0/1751526736 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c0319d0 con 0x7f8d5406e6b0 2024-04-25T02:13:27.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.085+0000 7f8d59cda640 1 -- 172.21.15.79:0/1751526736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d5406e6b0 msgr2=0x7f8d540cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:27.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.085+0000 7f8d59cda640 1 --2- 172.21.15.79:0/1751526736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d5406e6b0 0x7f8d540cdb70 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f8d540cd910 tx=0x7f8d4c02a610 comp rx=0 tx=0).stop 2024-04-25T02:13:27.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.085+0000 7f8d59cda640 1 -- 172.21.15.79:0/1751526736 shutdown_connections 2024-04-25T02:13:27.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.085+0000 7f8d59cda640 1 --2- 172.21.15.79:0/1751526736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d5406e6b0 0x7f8d540cdb70 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:27.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.085+0000 7f8d59cda640 1 --2- 172.21.15.79:0/1751526736 >> v2:172.21.15.189:3300/0 conn(0x7f8d540cf7a0 0x7f8d5406b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:27.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.085+0000 7f8d59cda640 1 --2- 172.21.15.79:0/1751526736 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d5406b2f0 0x7f8d540b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:27.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.085+0000 7f8d59cda640 1 -- 172.21.15.79:0/1751526736 >> 172.21.15.79:0/1751526736 conn(0x7f8d540b1cd0 msgr2=0x7f8d540b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.085+0000 7f8d59cda640 1 -- 172.21.15.79:0/1751526736 shutdown_connections 2024-04-25T02:13:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.085+0000 7f8d59cda640 1 -- 172.21.15.79:0/1751526736 wait complete. 2024-04-25T02:13:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.086+0000 7f8d59cda640 1 Processor -- start 2024-04-25T02:13:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.086+0000 7f8d59cda640 1 -- start start 2024-04-25T02:13:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d59cda640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d5406b2f0 0x7f8d540afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d59cda640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d5406e6b0 0x7f8d54071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d59cda640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d540cf7a0 0x7f8d540724d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d59cda640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5406cfe0 con 0x7f8d540cf7a0 2024-04-25T02:13:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d59cda640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5415f4c0 con 0x7f8d5406e6b0 2024-04-25T02:13:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d59cda640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5406d160 con 0x7f8d5406b2f0 2024-04-25T02:13:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d53fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d540cf7a0 0x7f8d540724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d53fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d540cf7a0 0x7f8d540724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60306/0 (socket says 172.21.15.79:60306) 2024-04-25T02:13:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d53fff640 1 -- 172.21.15.79:0/3711791613 learned_addr learned my addr 172.21.15.79:0/3711791613 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d53fff640 1 -- 172.21.15.79:0/3711791613 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d5406b2f0 msgr2=0x7f8d540afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d53fff640 1 --2- 172.21.15.79:0/3711791613 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d5406b2f0 0x7f8d540afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d53fff640 1 -- 172.21.15.79:0/3711791613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d5406e6b0 msgr2=0x7f8d54071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d52ffd640 1 --2- 172.21.15.79:0/3711791613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d5406e6b0 0x7f8d54071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d53fff640 1 --2- 172.21.15.79:0/3711791613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d5406e6b0 0x7f8d54071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d53fff640 1 -- 172.21.15.79:0/3711791613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d541f15a0 con 0x7f8d540cf7a0 2024-04-25T02:13:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.087+0000 7f8d52ffd640 1 --2- 172.21.15.79:0/3711791613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d5406e6b0 0x7f8d54071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.088+0000 7f8d53fff640 1 --2- 172.21.15.79:0/3711791613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d540cf7a0 0x7f8d540724d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c009f40 tx=0x7f8d4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.088+0000 7f8d3bfff640 1 -- 172.21.15.79:0/3711791613 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c041020 con 0x7f8d540cf7a0 2024-04-25T02:13:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.088+0000 7f8d3bfff640 1 -- 172.21.15.79:0/3711791613 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d4c007780 con 0x7f8d540cf7a0 2024-04-25T02:13:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.088+0000 7f8d59cda640 1 -- 172.21.15.79:0/3711791613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d541f5920 con 0x7f8d540cf7a0 2024-04-25T02:13:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.088+0000 7f8d3bfff640 1 -- 172.21.15.79:0/3711791613 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c036040 con 0x7f8d540cf7a0 2024-04-25T02:13:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.088+0000 7f8d59cda640 1 -- 172.21.15.79:0/3711791613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d541f1b10 con 0x7f8d540cf7a0 2024-04-25T02:13:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.089+0000 7f8d59cda640 1 -- 172.21.15.79:0/3711791613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d540690a0 con 0x7f8d540cf7a0 2024-04-25T02:13:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.089+0000 7f8d3bfff640 1 -- 172.21.15.79:0/3711791613 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d4c044020 con 0x7f8d540cf7a0 2024-04-25T02:13:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.090+0000 7f8d3bfff640 1 --2- 172.21.15.79:0/3711791613 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8d4006be30 0x7f8d4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.090+0000 7f8d3bfff640 1 -- 172.21.15.79:0/3711791613 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5939+0+0 (secure 0 0 0) 0x7f8d4c0abd20 con 0x7f8d540cf7a0 2024-04-25T02:13:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.090+0000 7f8d537fe640 1 --2- 172.21.15.79:0/3711791613 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8d4006be30 0x7f8d4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.090+0000 7f8d537fe640 1 --2- 172.21.15.79:0/3711791613 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8d4006be30 0x7f8d4006e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009710 tx=0x7f8d44006c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:27.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.094+0000 7f8d3bfff640 1 -- 172.21.15.79:0/3711791613 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8d4c04b030 con 0x7f8d540cf7a0 2024-04-25T02:13:27.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.305+0000 7f8d59cda640 1 -- 172.21.15.79:0/3711791613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8d540cc460 con 0x7f8d540cf7a0 2024-04-25T02:13:27.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.972+0000 7f8d3bfff640 1 -- 172.21.15.79:0/3711791613 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) ==== 104+0+0 (secure 0 0 0) 0x7f8d4c07a730 con 0x7f8d540cf7a0 2024-04-25T02:13:27.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.976+0000 7f8d59cda640 1 -- 172.21.15.79:0/3711791613 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8d4006be30 msgr2=0x7f8d4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:27.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.976+0000 7f8d59cda640 1 --2- 172.21.15.79:0/3711791613 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8d4006be30 0x7f8d4006e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009710 tx=0x7f8d44006c90 comp rx=0 tx=0).stop 2024-04-25T02:13:27.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.976+0000 7f8d59cda640 1 -- 172.21.15.79:0/3711791613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d540cf7a0 msgr2=0x7f8d540724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:27.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.976+0000 7f8d59cda640 1 --2- 172.21.15.79:0/3711791613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d540cf7a0 0x7f8d540724d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c009f40 tx=0x7f8d4c004a40 comp rx=0 tx=0).stop 2024-04-25T02:13:27.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.976+0000 7f8d59cda640 1 -- 172.21.15.79:0/3711791613 shutdown_connections 2024-04-25T02:13:27.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.976+0000 7f8d59cda640 1 --2- 172.21.15.79:0/3711791613 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8d4006be30 0x7f8d4006e2f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:27.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.976+0000 7f8d59cda640 1 --2- 172.21.15.79:0/3711791613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d540cf7a0 0x7f8d540724d0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:27.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.976+0000 7f8d59cda640 1 --2- 172.21.15.79:0/3711791613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d5406e6b0 0x7f8d54071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:27.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.976+0000 7f8d59cda640 1 --2- 172.21.15.79:0/3711791613 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d5406b2f0 0x7f8d540afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:27.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.976+0000 7f8d59cda640 1 -- 172.21.15.79:0/3711791613 >> 172.21.15.79:0/3711791613 conn(0x7f8d540b1cd0 msgr2=0x7f8d54154a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:27.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.976+0000 7f8d59cda640 1 -- 172.21.15.79:0/3711791613 shutdown_connections 2024-04-25T02:13:27.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:27.976+0000 7f8d59cda640 1 -- 172.21.15.79:0/3711791613 wait complete. 2024-04-25T02:13:27.995 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T02:13:28.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.134+0000 7f7285f9e640 1 Processor -- start 2024-04-25T02:13:28.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.134+0000 7f7285f9e640 1 -- start start 2024-04-25T02:13:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.135+0000 7f7285f9e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f728015e310 0x7f72800d4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.135+0000 7f7285f9e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f72800d2bf0 0x7f72800b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.135+0000 7f7285f9e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72800d13d0 con 0x7f72800d0f40 2024-04-25T02:13:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.135+0000 7f7285f9e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f72800b33d0 con 0x7f72800d2bf0 2024-04-25T02:13:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.135+0000 7f7285f9e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f72800b3990 con 0x7f728015e310 2024-04-25T02:13:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.135+0000 7f728579d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f72800d2bf0 0x7f72800b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.135+0000 7f727ffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f72800d0f40 0x7f72800d24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44706/0 (socket says 172.21.15.79:44706) 2024-04-25T02:13:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.135+0000 7f727ffff640 1 -- 172.21.15.79:0/1179045652 learned_addr learned my addr 172.21.15.79:0/1179045652 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.135+0000 7f7284f9c640 1 --2- 172.21.15.79:0/1179045652 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f728015e310 0x7f72800d4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.135+0000 7f728579d640 1 -- 172.21.15.79:0/1179045652 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f728015e310 msgr2=0x7f72800d4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.135+0000 7f728579d640 1 --2- 172.21.15.79:0/1179045652 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f728015e310 0x7f72800d4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.135+0000 7f728579d640 1 -- 172.21.15.79:0/1179045652 >> v1:172.21.15.79:6789/0 conn(0x7f72800d0f40 legacy=0x7f72800d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.135+0000 7f727f7fe640 1 -- 172.21.15.79:0/1179045652 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 340868131 0 0) 0x7f72800d13d0 con 0x7f72800d0f40 2024-04-25T02:13:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.135+0000 7f728579d640 1 -- 172.21.15.79:0/1179045652 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72800d16b0 con 0x7f72800d2bf0 2024-04-25T02:13:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.136+0000 7f728579d640 1 --2- 172.21.15.79:0/1179045652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72800d2bf0 0x7f72800b3e20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f7278009d90 tx=0x7f727802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efcf888904df5ab9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.136+0000 7f727f7fe640 1 -- 172.21.15.79:0/1179045652 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278007740 con 0x7f72800d2bf0 2024-04-25T02:13:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.136+0000 7f727f7fe640 1 -- 172.21.15.79:0/1179045652 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72780078e0 con 0x7f72800d2bf0 2024-04-25T02:13:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.136+0000 7f727f7fe640 1 -- 172.21.15.79:0/1179045652 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278007cb0 con 0x7f72800d2bf0 2024-04-25T02:13:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.137+0000 7f7285f9e640 1 -- 172.21.15.79:0/1179045652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72800d2bf0 msgr2=0x7f72800b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.137+0000 7f7285f9e640 1 --2- 172.21.15.79:0/1179045652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72800d2bf0 0x7f72800b3e20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f7278009d90 tx=0x7f727802a660 comp rx=0 tx=0).stop 2024-04-25T02:13:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.137+0000 7f7285f9e640 1 -- 172.21.15.79:0/1179045652 shutdown_connections 2024-04-25T02:13:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.137+0000 7f7285f9e640 1 --2- 172.21.15.79:0/1179045652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72800d2bf0 0x7f72800b3e20 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.137+0000 7f7285f9e640 1 --2- 172.21.15.79:0/1179045652 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f728015e310 0x7f72800d4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.137+0000 7f7285f9e640 1 -- 172.21.15.79:0/1179045652 >> 172.21.15.79:0/1179045652 conn(0x7f72800d3f00 msgr2=0x7f72800d4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.137+0000 7f7285f9e640 1 -- 172.21.15.79:0/1179045652 shutdown_connections 2024-04-25T02:13:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.137+0000 7f7285f9e640 1 -- 172.21.15.79:0/1179045652 wait complete. 2024-04-25T02:13:28.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.138+0000 7f7285f9e640 1 Processor -- start 2024-04-25T02:13:28.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.138+0000 7f7285f9e640 1 -- start start 2024-04-25T02:13:28.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.139+0000 7f7285f9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72800d2bf0 0x7f72801615b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:28.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.139+0000 7f7285f9e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f728015e310 0x7f7280157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:28.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.139+0000 7f7285f9e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72801f7100 0x7f72800b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:28.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.139+0000 7f7285f9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f72800d1e70 con 0x7f72800d2bf0 2024-04-25T02:13:28.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.139+0000 7f7285f9e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f728015e6f0 con 0x7f72801f7100 2024-04-25T02:13:28.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.139+0000 7f7285f9e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f72800d1ff0 con 0x7f728015e310 2024-04-25T02:13:28.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.139+0000 7f7284f9c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72800d2bf0 0x7f72801615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.139+0000 7f7284f9c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72800d2bf0 0x7f72801615b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60324/0 (socket says 172.21.15.79:60324) 2024-04-25T02:13:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.139+0000 7f7284f9c640 1 -- 172.21.15.79:0/13975190 learned_addr learned my addr 172.21.15.79:0/13975190 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.139+0000 7f7284f9c640 1 -- 172.21.15.79:0/13975190 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f728015e310 msgr2=0x7f7280157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.139+0000 7f7284f9c640 1 --2- 172.21.15.79:0/13975190 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f728015e310 0x7f7280157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.139+0000 7f7284f9c640 1 -- 172.21.15.79:0/13975190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72801f7100 msgr2=0x7f72800b7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.139+0000 7f7284f9c640 1 --2- 172.21.15.79:0/13975190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72801f7100 0x7f72800b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.139+0000 7f7284f9c640 1 -- 172.21.15.79:0/13975190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72800b8380 con 0x7f72800d2bf0 2024-04-25T02:13:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.140+0000 7f7284f9c640 1 --2- 172.21.15.79:0/13975190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72800d2bf0 0x7f72801615b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f727000d5f0 tx=0x7f727000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.140+0000 7f727d7fa640 1 -- 172.21.15.79:0/13975190 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72700125f0 con 0x7f72800d2bf0 2024-04-25T02:13:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.140+0000 7f727d7fa640 1 -- 172.21.15.79:0/13975190 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7270019070 con 0x7f72800d2bf0 2024-04-25T02:13:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.140+0000 7f727d7fa640 1 -- 172.21.15.79:0/13975190 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72700129d0 con 0x7f72800d2bf0 2024-04-25T02:13:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.140+0000 7f7285f9e640 1 -- 172.21.15.79:0/13975190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72801f75e0 con 0x7f72800d2bf0 2024-04-25T02:13:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.140+0000 7f7285f9e640 1 -- 172.21.15.79:0/13975190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72801f7ba0 con 0x7f72800d2bf0 2024-04-25T02:13:28.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.141+0000 7f7285f9e640 1 -- 172.21.15.79:0/13975190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f728004f500 con 0x7f72800d2bf0 2024-04-25T02:13:28.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.141+0000 7f727d7fa640 1 -- 172.21.15.79:0/13975190 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7270012b70 con 0x7f72800d2bf0 2024-04-25T02:13:28.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.141+0000 7f727d7fa640 1 --2- 172.21.15.79:0/13975190 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f726c06be30 0x7f726c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:28.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.142+0000 7f727d7fa640 1 -- 172.21.15.79:0/13975190 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5939+0+0 (secure 0 0 0) 0x7f727008b2d0 con 0x7f72800d2bf0 2024-04-25T02:13:28.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.142+0000 7f727ffff640 1 --2- 172.21.15.79:0/13975190 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f726c06be30 0x7f726c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:28.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.142+0000 7f727ffff640 1 --2- 172.21.15.79:0/13975190 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f726c06be30 0x7f726c06e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7274007fd0 tx=0x7f7274007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:28.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.146+0000 7f727d7fa640 1 -- 172.21.15.79:0/13975190 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7270059c20 con 0x7f72800d2bf0 2024-04-25T02:13:28.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.318+0000 7f7285f9e640 1 -- 172.21.15.79:0/13975190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f72800cf2d0 con 0x7f72800d2bf0 2024-04-25T02:13:28.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.974+0000 7f727d7fa640 1 -- 172.21.15.79:0/13975190 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v76) ==== 181+0+0 (secure 0 0 0) 0x7f7270059520 con 0x7f72800d2bf0 2024-04-25T02:13:28.980 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-04-25T02:13:28.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.977+0000 7f7285f9e640 1 -- 172.21.15.79:0/13975190 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f726c06be30 msgr2=0x7f726c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:28.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.977+0000 7f7285f9e640 1 --2- 172.21.15.79:0/13975190 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f726c06be30 0x7f726c06e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7274007fd0 tx=0x7f7274007900 comp rx=0 tx=0).stop 2024-04-25T02:13:28.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.977+0000 7f7285f9e640 1 -- 172.21.15.79:0/13975190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72800d2bf0 msgr2=0x7f72801615b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:28.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.977+0000 7f7285f9e640 1 --2- 172.21.15.79:0/13975190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72800d2bf0 0x7f72801615b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f727000d5f0 tx=0x7f727000dab0 comp rx=0 tx=0).stop 2024-04-25T02:13:28.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.977+0000 7f7285f9e640 1 -- 172.21.15.79:0/13975190 shutdown_connections 2024-04-25T02:13:28.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.977+0000 7f7285f9e640 1 --2- 172.21.15.79:0/13975190 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f726c06be30 0x7f726c06e2f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:28.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.977+0000 7f7285f9e640 1 --2- 172.21.15.79:0/13975190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72801f7100 0x7f72800b7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:28.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.977+0000 7f7285f9e640 1 --2- 172.21.15.79:0/13975190 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f728015e310 0x7f7280157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:28.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.977+0000 7f7285f9e640 1 --2- 172.21.15.79:0/13975190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72800d2bf0 0x7f72801615b0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:28.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.977+0000 7f7285f9e640 1 -- 172.21.15.79:0/13975190 >> 172.21.15.79:0/13975190 conn(0x7f72800d3f00 msgr2=0x7f72800b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:28.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.978+0000 7f7285f9e640 1 -- 172.21.15.79:0/13975190 shutdown_connections 2024-04-25T02:13:28.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:28.978+0000 7f7285f9e640 1 -- 172.21.15.79:0/13975190 wait complete. 2024-04-25T02:13:28.997 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T02:13:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.099+0000 7f21ba04d640 1 Processor -- start 2024-04-25T02:13:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.099+0000 7f21ba04d640 1 -- start start 2024-04-25T02:13:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21ba04d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f21b4151780 0x7f21b415b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21ba04d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21b40b4e10 0x7f21b406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21ba04d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21b406e0c0 0x7f21b415e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21ba04d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f21b40b3e40 con 0x7f21b40b4e10 2024-04-25T02:13:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21ba04d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f21b406e4f0 con 0x7f21b4151780 2024-04-25T02:13:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21ba04d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f21b40b5280 con 0x7f21b406e0c0 2024-04-25T02:13:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21b2ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21b40b4e10 0x7f21b406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21b2ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21b40b4e10 0x7f21b406db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60336/0 (socket says 172.21.15.79:60336) 2024-04-25T02:13:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21b2ffd640 1 -- 172.21.15.79:0/3004400744 learned_addr learned my addr 172.21.15.79:0/3004400744 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:29.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21b37fe640 1 --2- 172.21.15.79:0/3004400744 >> v2:172.21.15.189:3300/0 conn(0x7f21b4151780 0x7f21b415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:29.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21b3fff640 1 --2- 172.21.15.79:0/3004400744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21b406e0c0 0x7f21b415e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:29.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21b2ffd640 1 -- 172.21.15.79:0/3004400744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21b406e0c0 msgr2=0x7f21b415e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:29.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21b2ffd640 1 --2- 172.21.15.79:0/3004400744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21b406e0c0 0x7f21b415e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:29.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21b2ffd640 1 -- 172.21.15.79:0/3004400744 >> v2:172.21.15.189:3300/0 conn(0x7f21b4151780 msgr2=0x7f21b415b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:29.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21b2ffd640 1 --2- 172.21.15.79:0/3004400744 >> v2:172.21.15.189:3300/0 conn(0x7f21b4151780 0x7f21b415b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:29.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.100+0000 7f21b2ffd640 1 -- 172.21.15.79:0/3004400744 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b40b2da0 con 0x7f21b40b4e10 2024-04-25T02:13:29.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.101+0000 7f21b2ffd640 1 --2- 172.21.15.79:0/3004400744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b40b4e10 0x7f21b406db80 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f21b406f140 tx=0x7f219c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9a909128ab5d39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:29.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.101+0000 7f21b27fc640 1 -- 172.21.15.79:0/3004400744 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c037070 con 0x7f21b40b4e10 2024-04-25T02:13:29.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.101+0000 7f21b27fc640 1 -- 172.21.15.79:0/3004400744 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219c032440 con 0x7f21b40b4e10 2024-04-25T02:13:29.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.101+0000 7f21b27fc640 1 -- 172.21.15.79:0/3004400744 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c032810 con 0x7f21b40b4e10 2024-04-25T02:13:29.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.102+0000 7f21ba04d640 1 -- 172.21.15.79:0/3004400744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b40b4e10 msgr2=0x7f21b406db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:29.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.102+0000 7f21ba04d640 1 --2- 172.21.15.79:0/3004400744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b40b4e10 0x7f21b406db80 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f21b406f140 tx=0x7f219c02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:13:29.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.102+0000 7f21ba04d640 1 -- 172.21.15.79:0/3004400744 shutdown_connections 2024-04-25T02:13:29.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.102+0000 7f21ba04d640 1 --2- 172.21.15.79:0/3004400744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b40b4e10 0x7f21b406db80 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:29.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.102+0000 7f21ba04d640 1 --2- 172.21.15.79:0/3004400744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21b406e0c0 0x7f21b415e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:29.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.102+0000 7f21ba04d640 1 --2- 172.21.15.79:0/3004400744 >> v2:172.21.15.189:3300/0 conn(0x7f21b4151780 0x7f21b415b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:29.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.102+0000 7f21ba04d640 1 -- 172.21.15.79:0/3004400744 >> 172.21.15.79:0/3004400744 conn(0x7f21b406b4a0 msgr2=0x7f21b406b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:29.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.102+0000 7f21ba04d640 1 -- 172.21.15.79:0/3004400744 shutdown_connections 2024-04-25T02:13:29.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.102+0000 7f21ba04d640 1 -- 172.21.15.79:0/3004400744 wait complete. 2024-04-25T02:13:29.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.103+0000 7f21ba04d640 1 Processor -- start 2024-04-25T02:13:29.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.103+0000 7f21ba04d640 1 -- start start 2024-04-25T02:13:29.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21ba04d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b406e0c0 0x7f21b414c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:29.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21ba04d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21b40b4e10 0x7f21b41f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:29.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21ba04d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21b4151780 0x7f21b4159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:29.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21ba04d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f21b40b3640 con 0x7f21b406e0c0 2024-04-25T02:13:29.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21ba04d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f21b40b3360 con 0x7f21b40b4e10 2024-04-25T02:13:29.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21ba04d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f21b40b3920 con 0x7f21b4151780 2024-04-25T02:13:29.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21b37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b406e0c0 0x7f21b414c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:29.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21b37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b406e0c0 0x7f21b414c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60348/0 (socket says 172.21.15.79:60348) 2024-04-25T02:13:29.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21b37fe640 1 -- 172.21.15.79:0/1421434241 learned_addr learned my addr 172.21.15.79:0/1421434241 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:29.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21b2ffd640 1 --2- 172.21.15.79:0/1421434241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21b40b4e10 0x7f21b41f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:29.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21b3fff640 1 --2- 172.21.15.79:0/1421434241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21b4151780 0x7f21b4159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:29.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21b37fe640 1 -- 172.21.15.79:0/1421434241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21b4151780 msgr2=0x7f21b4159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:29.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21b37fe640 1 --2- 172.21.15.79:0/1421434241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21b4151780 0x7f21b4159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:29.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21b37fe640 1 -- 172.21.15.79:0/1421434241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21b40b4e10 msgr2=0x7f21b41f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:29.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21b37fe640 1 --2- 172.21.15.79:0/1421434241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21b40b4e10 0x7f21b41f3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:29.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21b37fe640 1 -- 172.21.15.79:0/1421434241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b40c5390 con 0x7f21b406e0c0 2024-04-25T02:13:29.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21b37fe640 1 --2- 172.21.15.79:0/1421434241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b406e0c0 0x7f21b414c250 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f21a400d800 tx=0x7f21a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:29.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21abfff640 1 -- 172.21.15.79:0/1421434241 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a400b6c0 con 0x7f21b406e0c0 2024-04-25T02:13:29.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21abfff640 1 -- 172.21.15.79:0/1421434241 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a4019070 con 0x7f21b406e0c0 2024-04-25T02:13:29.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21ba04d640 1 -- 172.21.15.79:0/1421434241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b40c5670 con 0x7f21b406e0c0 2024-04-25T02:13:29.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21abfff640 1 -- 172.21.15.79:0/1421434241 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a400ba80 con 0x7f21b406e0c0 2024-04-25T02:13:29.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.104+0000 7f21ba04d640 1 -- 172.21.15.79:0/1421434241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b40c5c30 con 0x7f21b406e0c0 2024-04-25T02:13:29.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.105+0000 7f21ba04d640 1 -- 172.21.15.79:0/1421434241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b414c850 con 0x7f21b406e0c0 2024-04-25T02:13:29.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.106+0000 7f21abfff640 1 -- 172.21.15.79:0/1421434241 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21a400bc20 con 0x7f21b406e0c0 2024-04-25T02:13:29.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.106+0000 7f21abfff640 1 --2- 172.21.15.79:0/1421434241 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f219406be30 0x7f219406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:29.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.106+0000 7f21abfff640 1 -- 172.21.15.79:0/1421434241 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5501+0+0 (secure 0 0 0) 0x7f21a408b190 con 0x7f21b406e0c0 2024-04-25T02:13:29.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.106+0000 7f21b2ffd640 1 --2- 172.21.15.79:0/1421434241 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f219406be30 0x7f219406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:29.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.107+0000 7f21b2ffd640 1 --2- 172.21.15.79:0/1421434241 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f219406be30 0x7f219406e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f219c034000 tx=0x7f219c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:29.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.110+0000 7f21abfff640 1 -- 172.21.15.79:0/1421434241 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f21a4059ca0 con 0x7f21b406e0c0 2024-04-25T02:13:29.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.284+0000 7f21ba04d640 1 -- 172.21.15.79:0/1421434241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f21b40690a0 con 0x7f21b406e0c0 2024-04-25T02:13:29.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.979+0000 7f21abfff640 1 -- 172.21.15.79:0/1421434241 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v77) ==== 169+0+0 (secure 0 0 0) 0x7f21a40595a0 con 0x7f21b406e0c0 2024-04-25T02:13:29.985 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-04-25T02:13:29.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.982+0000 7f21ba04d640 1 -- 172.21.15.79:0/1421434241 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f219406be30 msgr2=0x7f219406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:29.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.982+0000 7f21ba04d640 1 --2- 172.21.15.79:0/1421434241 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f219406be30 0x7f219406e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f219c034000 tx=0x7f219c02e000 comp rx=0 tx=0).stop 2024-04-25T02:13:29.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.982+0000 7f21ba04d640 1 -- 172.21.15.79:0/1421434241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b406e0c0 msgr2=0x7f21b414c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:29.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.982+0000 7f21ba04d640 1 --2- 172.21.15.79:0/1421434241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b406e0c0 0x7f21b414c250 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f21a400d800 tx=0x7f21a400dcc0 comp rx=0 tx=0).stop 2024-04-25T02:13:29.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.982+0000 7f21ba04d640 1 -- 172.21.15.79:0/1421434241 shutdown_connections 2024-04-25T02:13:29.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.982+0000 7f21ba04d640 1 --2- 172.21.15.79:0/1421434241 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f219406be30 0x7f219406e2f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:29.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.982+0000 7f21ba04d640 1 --2- 172.21.15.79:0/1421434241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21b4151780 0x7f21b4159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:29.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.982+0000 7f21ba04d640 1 --2- 172.21.15.79:0/1421434241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21b40b4e10 0x7f21b41f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:29.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.982+0000 7f21ba04d640 1 --2- 172.21.15.79:0/1421434241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b406e0c0 0x7f21b414c250 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:29.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.982+0000 7f21ba04d640 1 -- 172.21.15.79:0/1421434241 >> 172.21.15.79:0/1421434241 conn(0x7f21b406b4a0 msgr2=0x7f21b415bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:29.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.982+0000 7f21ba04d640 1 -- 172.21.15.79:0/1421434241 shutdown_connections 2024-04-25T02:13:29.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:29.982+0000 7f21ba04d640 1 -- 172.21.15.79:0/1421434241 wait complete. 2024-04-25T02:13:30.002 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T02:13:30.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.098+0000 7f454a516640 1 Processor -- start 2024-04-25T02:13:30.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.098+0000 7f454a516640 1 -- start start 2024-04-25T02:13:30.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.099+0000 7f454a516640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f45440cf200 0x7f45440cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:30.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.099+0000 7f454a516640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f4544162a40 0x7f454415ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:30.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.099+0000 7f454a516640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f454415ef40 0x7f454406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:30.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.099+0000 7f454a516640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4544161ff0 con 0x7f45440cf200 2024-04-25T02:13:30.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.099+0000 7f454a516640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f454415f4c0 con 0x7f4544162a40 2024-04-25T02:13:30.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.099+0000 7f454a516640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f454415f7a0 con 0x7f454415ef40 2024-04-25T02:13:30.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.099+0000 7f4543fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f45440cf200 0x7f45440cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:30.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.099+0000 7f4543fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f45440cf200 0x7f45440cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60360/0 (socket says 172.21.15.79:60360) 2024-04-25T02:13:30.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.099+0000 7f4543fff640 1 -- 172.21.15.79:0/830999115 learned_addr learned my addr 172.21.15.79:0/830999115 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:30.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.099+0000 7f4543fff640 1 -- 172.21.15.79:0/830999115 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f454415ef40 msgr2=0x7f454406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:30.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.099+0000 7f4543fff640 1 --2- 172.21.15.79:0/830999115 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f454415ef40 0x7f454406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.099+0000 7f4543fff640 1 -- 172.21.15.79:0/830999115 >> v2:172.21.15.189:3300/0 conn(0x7f4544162a40 msgr2=0x7f454415ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:30.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.099+0000 7f4543fff640 1 --2- 172.21.15.79:0/830999115 >> v2:172.21.15.189:3300/0 conn(0x7f4544162a40 0x7f454415ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.099+0000 7f4543fff640 1 -- 172.21.15.79:0/830999115 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4544162240 con 0x7f45440cf200 2024-04-25T02:13:30.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.100+0000 7f4543fff640 1 --2- 172.21.15.79:0/830999115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45440cf200 0x7f45440cf5e0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f4544070ce0 tx=0x7f453402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7634c9fb2ec7d7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:30.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.100+0000 7f4542ffd640 1 -- 172.21.15.79:0/830999115 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534037070 con 0x7f45440cf200 2024-04-25T02:13:30.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.100+0000 7f4542ffd640 1 -- 172.21.15.79:0/830999115 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4534032440 con 0x7f45440cf200 2024-04-25T02:13:30.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.100+0000 7f4542ffd640 1 -- 172.21.15.79:0/830999115 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534032810 con 0x7f45440cf200 2024-04-25T02:13:30.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.100+0000 7f454a516640 1 -- 172.21.15.79:0/830999115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45440cf200 msgr2=0x7f45440cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:30.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.100+0000 7f454a516640 1 --2- 172.21.15.79:0/830999115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45440cf200 0x7f45440cf5e0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f4544070ce0 tx=0x7f453402a1e0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.101+0000 7f454a516640 1 -- 172.21.15.79:0/830999115 shutdown_connections 2024-04-25T02:13:30.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.101+0000 7f454a516640 1 --2- 172.21.15.79:0/830999115 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f454415ef40 0x7f454406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.101+0000 7f454a516640 1 --2- 172.21.15.79:0/830999115 >> v2:172.21.15.189:3300/0 conn(0x7f4544162a40 0x7f454415ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.101+0000 7f454a516640 1 --2- 172.21.15.79:0/830999115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45440cf200 0x7f45440cf5e0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.101+0000 7f454a516640 1 -- 172.21.15.79:0/830999115 >> 172.21.15.79:0/830999115 conn(0x7f45440b1cd0 msgr2=0x7f45440b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:30.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.101+0000 7f454a516640 1 -- 172.21.15.79:0/830999115 shutdown_connections 2024-04-25T02:13:30.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.101+0000 7f454a516640 1 -- 172.21.15.79:0/830999115 wait complete. 2024-04-25T02:13:30.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.102+0000 7f454a516640 1 Processor -- start 2024-04-25T02:13:30.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.102+0000 7f454a516640 1 -- start start 2024-04-25T02:13:30.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f454a516640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45440cf200 0x7f454409ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:30.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f454a516640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f454415ef40 0x7f45441f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f454a516640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4544162a40 0x7f45441499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f454a516640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f45440cee00 con 0x7f454415ef40 2024-04-25T02:13:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f454a516640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f45440cec80 con 0x7f4544162a40 2024-04-25T02:13:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f454a516640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f454406b830 con 0x7f45440cf200 2024-04-25T02:13:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f45437fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f454415ef40 0x7f45441f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f45437fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f454415ef40 0x7f45441f4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60374/0 (socket says 172.21.15.79:60374) 2024-04-25T02:13:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f45437fe640 1 -- 172.21.15.79:0/3124348106 learned_addr learned my addr 172.21.15.79:0/3124348106 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f4543fff640 1 --2- 172.21.15.79:0/3124348106 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45440cf200 0x7f454409ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f4548ab3640 1 --2- 172.21.15.79:0/3124348106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4544162a40 0x7f45441499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f45437fe640 1 -- 172.21.15.79:0/3124348106 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45440cf200 msgr2=0x7f454409ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f45437fe640 1 --2- 172.21.15.79:0/3124348106 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45440cf200 0x7f454409ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f45437fe640 1 -- 172.21.15.79:0/3124348106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4544162a40 msgr2=0x7f45441499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f45437fe640 1 --2- 172.21.15.79:0/3124348106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4544162a40 0x7f45441499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f45437fe640 1 -- 172.21.15.79:0/3124348106 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45441f4a90 con 0x7f454415ef40 2024-04-25T02:13:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f45437fe640 1 --2- 172.21.15.79:0/3124348106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f454415ef40 0x7f45441f4550 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f453800b4a0 tx=0x7f453800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f4540ff9640 1 -- 172.21.15.79:0/3124348106 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538014070 con 0x7f454415ef40 2024-04-25T02:13:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f4540ff9640 1 -- 172.21.15.79:0/3124348106 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4538010610 con 0x7f454415ef40 2024-04-25T02:13:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f4540ff9640 1 -- 172.21.15.79:0/3124348106 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538010a00 con 0x7f454415ef40 2024-04-25T02:13:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f454a516640 1 -- 172.21.15.79:0/3124348106 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4544149f10 con 0x7f454415ef40 2024-04-25T02:13:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.103+0000 7f454a516640 1 -- 172.21.15.79:0/3124348106 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45441f4ff0 con 0x7f454415ef40 2024-04-25T02:13:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.104+0000 7f454a516640 1 -- 172.21.15.79:0/3124348106 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45440690a0 con 0x7f454415ef40 2024-04-25T02:13:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.105+0000 7f4540ff9640 1 -- 172.21.15.79:0/3124348106 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4538017070 con 0x7f454415ef40 2024-04-25T02:13:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.105+0000 7f4540ff9640 1 --2- 172.21.15.79:0/3124348106 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f453006be30 0x7f453006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.105+0000 7f4540ff9640 1 -- 172.21.15.79:0/3124348106 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5029+0+0 (secure 0 0 0) 0x7f453808a530 con 0x7f454415ef40 2024-04-25T02:13:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.105+0000 7f4543fff640 1 --2- 172.21.15.79:0/3124348106 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f453006be30 0x7f453006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.106+0000 7f4543fff640 1 --2- 172.21.15.79:0/3124348106 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f453006be30 0x7f453006e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4534034000 tx=0x7f453402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.110+0000 7f4540ff9640 1 -- 172.21.15.79:0/3124348106 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f45441f4a90 con 0x7f454415ef40 2024-04-25T02:13:30.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.285+0000 7f454a516640 1 -- 172.21.15.79:0/3124348106 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f45440af530 con 0x7f454415ef40 2024-04-25T02:13:30.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.289+0000 7f4540ff9640 1 -- 172.21.15.79:0/3124348106 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f4538058b30 con 0x7f454415ef40 2024-04-25T02:13:30.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.291+0000 7f454a516640 1 -- 172.21.15.79:0/3124348106 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f453006be30 msgr2=0x7f453006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:30.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.291+0000 7f454a516640 1 --2- 172.21.15.79:0/3124348106 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f453006be30 0x7f453006e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4534034000 tx=0x7f453402e000 comp rx=0 tx=0).stop 2024-04-25T02:13:30.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.291+0000 7f454a516640 1 -- 172.21.15.79:0/3124348106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f454415ef40 msgr2=0x7f45441f4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:30.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.291+0000 7f454a516640 1 --2- 172.21.15.79:0/3124348106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f454415ef40 0x7f45441f4550 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f453800b4a0 tx=0x7f453800b960 comp rx=0 tx=0).stop 2024-04-25T02:13:30.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.291+0000 7f454a516640 1 -- 172.21.15.79:0/3124348106 shutdown_connections 2024-04-25T02:13:30.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.291+0000 7f454a516640 1 --2- 172.21.15.79:0/3124348106 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f453006be30 0x7f453006e2f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.291+0000 7f454a516640 1 --2- 172.21.15.79:0/3124348106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4544162a40 0x7f45441499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.291+0000 7f454a516640 1 --2- 172.21.15.79:0/3124348106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f454415ef40 0x7f45441f4550 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.291+0000 7f454a516640 1 --2- 172.21.15.79:0/3124348106 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45440cf200 0x7f454409ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.291+0000 7f454a516640 1 -- 172.21.15.79:0/3124348106 >> 172.21.15.79:0/3124348106 conn(0x7f45440b1cd0 msgr2=0x7f4544071690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:30.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.291+0000 7f454a516640 1 -- 172.21.15.79:0/3124348106 shutdown_connections 2024-04-25T02:13:30.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.291+0000 7f454a516640 1 -- 172.21.15.79:0/3124348106 wait complete. 2024-04-25T02:13:30.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-25T02:13:30.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.399+0000 7f18587c8640 1 Processor -- start 2024-04-25T02:13:30.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.399+0000 7f18587c8640 1 -- start start 2024-04-25T02:13:30.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.400+0000 7f18587c8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1850143bc0 0x7f185015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:30.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.400+0000 7f18587c8640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18500b3d40 0x7f185006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:30.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.400+0000 7f18587c8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f185015fa40 con 0x7f185006df50 2024-04-25T02:13:30.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.400+0000 7f18587c8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f185006e8f0 con 0x7f1850143bc0 2024-04-25T02:13:30.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.400+0000 7f18587c8640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1850072cb0 con 0x7f18500b3d40 2024-04-25T02:13:30.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.400+0000 7f1856564640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1850143bc0 0x7f185015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:30.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.400+0000 7f1855d63640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f185006df50 0x7f18500b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44720/0 (socket says 172.21.15.79:44720) 2024-04-25T02:13:30.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.400+0000 7f1855d63640 1 -- 172.21.15.79:0/3624860301 learned_addr learned my addr 172.21.15.79:0/3624860301 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:30.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.400+0000 7f1856d65640 1 --2- 172.21.15.79:0/3624860301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18500b3d40 0x7f185006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:30.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.400+0000 7f1856564640 1 -- 172.21.15.79:0/3624860301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18500b3d40 msgr2=0x7f185006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:30.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.400+0000 7f1856564640 1 --2- 172.21.15.79:0/3624860301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18500b3d40 0x7f185006e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.400+0000 7f1856564640 1 -- 172.21.15.79:0/3624860301 >> v1:172.21.15.79:6789/0 conn(0x7f185006df50 legacy=0x7f18500b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.400+0000 7f1855562640 1 -- 172.21.15.79:0/3624860301 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1326847380 0 0) 0x7f1840001110 con 0x7f185006df50 2024-04-25T02:13:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.400+0000 7f1856564640 1 -- 172.21.15.79:0/3624860301 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1850071e00 con 0x7f1850143bc0 2024-04-25T02:13:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.401+0000 7f1856564640 1 --2- 172.21.15.79:0/3624860301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1850143bc0 0x7f185015f500 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f184c0097a0 tx=0x7f184c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ee4a93750d79d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.401+0000 7f1855562640 1 -- 172.21.15.79:0/3624860301 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c037070 con 0x7f1850143bc0 2024-04-25T02:13:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.401+0000 7f1855562640 1 -- 172.21.15.79:0/3624860301 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f184c02ae50 con 0x7f1850143bc0 2024-04-25T02:13:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.401+0000 7f1855562640 1 -- 172.21.15.79:0/3624860301 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c032660 con 0x7f1850143bc0 2024-04-25T02:13:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.401+0000 7f18587c8640 1 -- 172.21.15.79:0/3624860301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1850143bc0 msgr2=0x7f185015f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.401+0000 7f18587c8640 1 --2- 172.21.15.79:0/3624860301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1850143bc0 0x7f185015f500 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f184c0097a0 tx=0x7f184c02a100 comp rx=0 tx=0).stop 2024-04-25T02:13:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.401+0000 7f18587c8640 1 -- 172.21.15.79:0/3624860301 shutdown_connections 2024-04-25T02:13:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.401+0000 7f18587c8640 1 --2- 172.21.15.79:0/3624860301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18500b3d40 0x7f185006e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.401+0000 7f18587c8640 1 --2- 172.21.15.79:0/3624860301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1850143bc0 0x7f185015f500 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.401+0000 7f18587c8640 1 -- 172.21.15.79:0/3624860301 >> 172.21.15.79:0/3624860301 conn(0x7f18500cfc80 msgr2=0x7f18500d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.401+0000 7f18587c8640 1 -- 172.21.15.79:0/3624860301 shutdown_connections 2024-04-25T02:13:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.401+0000 7f18587c8640 1 -- 172.21.15.79:0/3624860301 wait complete. 2024-04-25T02:13:30.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.402+0000 7f18587c8640 1 Processor -- start 2024-04-25T02:13:30.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.403+0000 7f18587c8640 1 -- start start 2024-04-25T02:13:30.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.403+0000 7f18587c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f185006df50 0x7f18501f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:30.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.403+0000 7f18587c8640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18500b3d40 0x7f1850140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:30.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.403+0000 7f18587c8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1850143bc0 0x7f18501386a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:30.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.403+0000 7f18587c8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1850072660 con 0x7f185006df50 2024-04-25T02:13:30.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.403+0000 7f18587c8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1850072380 con 0x7f1850143bc0 2024-04-25T02:13:30.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.403+0000 7f18587c8640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1850072940 con 0x7f18500b3d40 2024-04-25T02:13:30.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.403+0000 7f1856564640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f185006df50 0x7f18501f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:30.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.403+0000 7f1856564640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f185006df50 0x7f18501f4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60404/0 (socket says 172.21.15.79:60404) 2024-04-25T02:13:30.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.403+0000 7f1856564640 1 -- 172.21.15.79:0/772778162 learned_addr learned my addr 172.21.15.79:0/772778162 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:30.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.404+0000 7f1855d63640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18500b3d40 0x7f1850140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:30.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.404+0000 7f1856564640 1 -- 172.21.15.79:0/772778162 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18500b3d40 msgr2=0x7f1850140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:30.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.404+0000 7f1856564640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18500b3d40 0x7f1850140430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.404+0000 7f1856564640 1 -- 172.21.15.79:0/772778162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1850143bc0 msgr2=0x7f18501386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:30.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.404+0000 7f1856d65640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1850143bc0 0x7f18501386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:30.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.404+0000 7f1856564640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1850143bc0 0x7f18501386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.404+0000 7f1856564640 1 -- 172.21.15.79:0/772778162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18501f5c50 con 0x7f185006df50 2024-04-25T02:13:30.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.404+0000 7f1855d63640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18500b3d40 0x7f1850140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:30.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.404+0000 7f1856d65640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1850143bc0 0x7f18501386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:30.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.404+0000 7f1856564640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f185006df50 0x7f18501f4fb0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f184c0097a0 tx=0x7f184c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:30.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.404+0000 7f1846ffd640 1 -- 172.21.15.79:0/772778162 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c037040 con 0x7f185006df50 2024-04-25T02:13:30.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.404+0000 7f1846ffd640 1 -- 172.21.15.79:0/772778162 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f184c004030 con 0x7f185006df50 2024-04-25T02:13:30.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.404+0000 7f18587c8640 1 -- 172.21.15.79:0/772778162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18501f5f30 con 0x7f185006df50 2024-04-25T02:13:30.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.404+0000 7f1846ffd640 1 -- 172.21.15.79:0/772778162 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c004420 con 0x7f185006df50 2024-04-25T02:13:30.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.404+0000 7f18587c8640 1 -- 172.21.15.79:0/772778162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18501f64f0 con 0x7f185006df50 2024-04-25T02:13:30.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.405+0000 7f18587c8640 1 -- 172.21.15.79:0/772778162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18500690a0 con 0x7f185006df50 2024-04-25T02:13:30.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.405+0000 7f1846ffd640 1 -- 172.21.15.79:0/772778162 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f184c003610 con 0x7f185006df50 2024-04-25T02:13:30.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.406+0000 7f1846ffd640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f183406be30 0x7f183406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:30.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.406+0000 7f1846ffd640 1 -- 172.21.15.79:0/772778162 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5029+0+0 (secure 0 0 0) 0x7f184c0aba10 con 0x7f185006df50 2024-04-25T02:13:30.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.406+0000 7f1855d63640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f183406be30 0x7f183406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:30.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.406+0000 7f1855d63640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f183406be30 0x7f183406e2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1840000f60 tx=0x7f1840009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:30.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.410+0000 7f1846ffd640 1 -- 172.21.15.79:0/772778162 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f184c07a660 con 0x7f185006df50 2024-04-25T02:13:30.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.651+0000 7f18587c8640 1 -- 172.21.15.79:0/772778162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) -- 0x7f18500cc670 con 0x7f185006df50 2024-04-25T02:13:30.880 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:13:30.883 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:13:30.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.980+0000 7f1846ffd640 1 -- 172.21.15.79:0/772778162 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v276) ==== 166+0+0 (secure 0 0 0) 0x7f184c079f60 con 0x7f185006df50 2024-04-25T02:13:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.982+0000 7f18587c8640 1 -- 172.21.15.79:0/772778162 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f183406be30 msgr2=0x7f183406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.982+0000 7f18587c8640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f183406be30 0x7f183406e2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1840000f60 tx=0x7f1840009040 comp rx=0 tx=0).stop 2024-04-25T02:13:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.982+0000 7f18587c8640 1 -- 172.21.15.79:0/772778162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f185006df50 msgr2=0x7f18501f4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.982+0000 7f18587c8640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f185006df50 0x7f18501f4fb0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f184c0097a0 tx=0x7f184c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.982+0000 7f18587c8640 1 -- 172.21.15.79:0/772778162 shutdown_connections 2024-04-25T02:13:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.982+0000 7f18587c8640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f183406be30 0x7f183406e2f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.982+0000 7f18587c8640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1850143bc0 0x7f18501386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.982+0000 7f18587c8640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18500b3d40 0x7f1850140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.982+0000 7f18587c8640 1 --2- 172.21.15.79:0/772778162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f185006df50 0x7f18501f4fb0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:30.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.982+0000 7f18587c8640 1 -- 172.21.15.79:0/772778162 >> 172.21.15.79:0/772778162 conn(0x7f18500cfc80 msgr2=0x7f185015f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:30.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.982+0000 7f18587c8640 1 -- 172.21.15.79:0/772778162 shutdown_connections 2024-04-25T02:13:30.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:30.983+0000 7f18587c8640 1 -- 172.21.15.79:0/772778162 wait complete. 2024-04-25T02:13:31.000 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T02:13:31.000 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T02:13:31.000 INFO:tasks.cephfs_test_runner:test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T02:13:31.001 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:13:31.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.098+0000 7f30c435a640 1 Processor -- start 2024-04-25T02:13:31.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.098+0000 7f30c435a640 1 -- start start 2024-04-25T02:13:31.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.099+0000 7f30c435a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30bc15e4d0 0x7f30bc06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.099+0000 7f30c435a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f30bc0b3570 0x7f30bc0d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.099+0000 7f30c435a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30bc0d1660 con 0x7f30bc0b3020 2024-04-25T02:13:31.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.099+0000 7f30c435a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f30bc0d1380 con 0x7f30bc15e4d0 2024-04-25T02:13:31.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.099+0000 7f30c435a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f30bc0cede0 con 0x7f30bc0b3570 2024-04-25T02:13:31.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.099+0000 7f30c20f6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30bc15e4d0 0x7f30bc06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.099+0000 7f30c20f6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30bc15e4d0 0x7f30bc06bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60408/0 (socket says 172.21.15.79:60408) 2024-04-25T02:13:31.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.099+0000 7f30c20f6640 1 -- 172.21.15.79:0/3726863224 learned_addr learned my addr 172.21.15.79:0/3726863224 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:31.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.099+0000 7f30c20f6640 1 -- 172.21.15.79:0/3726863224 >> v2:172.21.15.189:3300/0 conn(0x7f30bc0b3570 msgr2=0x7f30bc0d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:31.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.099+0000 7f30c20f6640 1 --2- 172.21.15.79:0/3726863224 >> v2:172.21.15.189:3300/0 conn(0x7f30bc0b3570 0x7f30bc0d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.099+0000 7f30c20f6640 1 -- 172.21.15.79:0/3726863224 >> v1:172.21.15.189:6789/0 conn(0x7f30bc0b3020 legacy=0x7f30bc0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:31.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.099+0000 7f30c20f6640 1 -- 172.21.15.79:0/3726863224 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc0cf0c0 con 0x7f30bc15e4d0 2024-04-25T02:13:31.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.100+0000 7f30c20f6640 1 --2- 172.21.15.79:0/3726863224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30bc15e4d0 0x7f30bc06bc70 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009870 tx=0x7f30b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d017e2806339c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:31.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.100+0000 7f30c10f4640 1 -- 172.21.15.79:0/3726863224 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8037070 con 0x7f30bc15e4d0 2024-04-25T02:13:31.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.100+0000 7f30c10f4640 1 -- 172.21.15.79:0/3726863224 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b8032440 con 0x7f30bc15e4d0 2024-04-25T02:13:31.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.100+0000 7f30c10f4640 1 -- 172.21.15.79:0/3726863224 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8032810 con 0x7f30bc15e4d0 2024-04-25T02:13:31.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.101+0000 7f30c435a640 1 -- 172.21.15.79:0/3726863224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30bc15e4d0 msgr2=0x7f30bc06bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.101+0000 7f30c435a640 1 --2- 172.21.15.79:0/3726863224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30bc15e4d0 0x7f30bc06bc70 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009870 tx=0x7f30b802a270 comp rx=0 tx=0).stop 2024-04-25T02:13:31.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.101+0000 7f30c435a640 1 -- 172.21.15.79:0/3726863224 shutdown_connections 2024-04-25T02:13:31.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.101+0000 7f30c435a640 1 --2- 172.21.15.79:0/3726863224 >> v2:172.21.15.189:3300/0 conn(0x7f30bc0b3570 0x7f30bc0d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.101+0000 7f30c435a640 1 --2- 172.21.15.79:0/3726863224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30bc15e4d0 0x7f30bc06bc70 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.101+0000 7f30c435a640 1 -- 172.21.15.79:0/3726863224 >> 172.21.15.79:0/3726863224 conn(0x7f30bc09d460 msgr2=0x7f30bc0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:31.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.101+0000 7f30c435a640 1 -- 172.21.15.79:0/3726863224 shutdown_connections 2024-04-25T02:13:31.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.101+0000 7f30c435a640 1 -- 172.21.15.79:0/3726863224 wait complete. 2024-04-25T02:13:31.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.102+0000 7f30c435a640 1 Processor -- start 2024-04-25T02:13:31.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.102+0000 7f30c435a640 1 -- start start 2024-04-25T02:13:31.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c435a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30bc0b3020 0x7f30bc15d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c435a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30bc0b3570 0x7f30bc15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c435a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f30bc15e4d0 0x7f30bc0b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c435a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc0d2250 con 0x7f30bc0b3020 2024-04-25T02:13:31.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c435a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc0d20d0 con 0x7f30bc0b3570 2024-04-25T02:13:31.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c435a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f30bc06c1b0 con 0x7f30bc15e4d0 2024-04-25T02:13:31.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c20f6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30bc0b3020 0x7f30bc15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c20f6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30bc0b3020 0x7f30bc15d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60414/0 (socket says 172.21.15.79:60414) 2024-04-25T02:13:31.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c20f6640 1 -- 172.21.15.79:0/1890911587 learned_addr learned my addr 172.21.15.79:0/1890911587 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:31.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c20f6640 1 -- 172.21.15.79:0/1890911587 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f30bc15e4d0 msgr2=0x7f30bc0b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c18f5640 1 --2- 172.21.15.79:0/1890911587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30bc0b3570 0x7f30bc15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c20f6640 1 --2- 172.21.15.79:0/1890911587 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f30bc15e4d0 0x7f30bc0b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c20f6640 1 -- 172.21.15.79:0/1890911587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30bc0b3570 msgr2=0x7f30bc15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c20f6640 1 --2- 172.21.15.79:0/1890911587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30bc0b3570 0x7f30bc15ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c20f6640 1 -- 172.21.15.79:0/1890911587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc0cc1f0 con 0x7f30bc0b3020 2024-04-25T02:13:31.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.103+0000 7f30c20f6640 1 --2- 172.21.15.79:0/1890911587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30bc0b3020 0x7f30bc15d210 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009870 tx=0x7f30b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:31.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.104+0000 7f30b2ffd640 1 -- 172.21.15.79:0/1890911587 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8037040 con 0x7f30bc0b3020 2024-04-25T02:13:31.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.104+0000 7f30b2ffd640 1 -- 172.21.15.79:0/1890911587 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b8004230 con 0x7f30bc0b3020 2024-04-25T02:13:31.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.104+0000 7f30c435a640 1 -- 172.21.15.79:0/1890911587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30bc0cc4d0 con 0x7f30bc0b3020 2024-04-25T02:13:31.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.104+0000 7f30b2ffd640 1 -- 172.21.15.79:0/1890911587 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b803c670 con 0x7f30bc0b3020 2024-04-25T02:13:31.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.104+0000 7f30c435a640 1 -- 172.21.15.79:0/1890911587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30bc0cca90 con 0x7f30bc0b3020 2024-04-25T02:13:31.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.105+0000 7f30c435a640 1 -- 172.21.15.79:0/1890911587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30bc0690a0 con 0x7f30bc0b3020 2024-04-25T02:13:31.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.105+0000 7f30b2ffd640 1 -- 172.21.15.79:0/1890911587 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30b803a070 con 0x7f30bc0b3020 2024-04-25T02:13:31.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.105+0000 7f30b2ffd640 1 --2- 172.21.15.79:0/1890911587 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30a006be30 0x7f30a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.105+0000 7f30c18f5640 1 --2- 172.21.15.79:0/1890911587 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30a006be30 0x7f30a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.105+0000 7f30b2ffd640 1 -- 172.21.15.79:0/1890911587 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5029+0+0 (secure 0 0 0) 0x7f30b80ab420 con 0x7f30bc0b3020 2024-04-25T02:13:31.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.106+0000 7f30c18f5640 1 --2- 172.21.15.79:0/1890911587 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30a006be30 0x7f30a006e2f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0cb220 tx=0x7f30ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:31.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.110+0000 7f30b2ffd640 1 -- 172.21.15.79:0/1890911587 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f30b8041020 con 0x7f30bc0b3020 2024-04-25T02:13:31.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.284+0000 7f30c435a640 1 -- 172.21.15.79:0/1890911587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30bc067940 con 0x7f30bc0b3020 2024-04-25T02:13:31.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.285+0000 7f30b2ffd640 1 -- 172.21.15.79:0/1890911587 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+13161 (secure 0 0 0) 0x7f30b807a220 con 0x7f30bc0b3020 2024-04-25T02:13:31.291 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:31.292 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":77,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:13:29.975628+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/782013262":"2024-04-26T02:13:26.968185+0000","172.21.15.79:6835/782013262":"2024-04-26T02:13:26.968185+0000","172.21.15.189:6835/469348969":"2024-04-26T02:12:09.471251+0000","172.21.15.189:6833/469348969":"2024-04-26T02:12:09.471251+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:13:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.287+0000 7f30c435a640 1 -- 172.21.15.79:0/1890911587 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30a006be30 msgr2=0x7f30a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.287+0000 7f30c435a640 1 --2- 172.21.15.79:0/1890911587 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30a006be30 0x7f30a006e2f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0cb220 tx=0x7f30ac008040 comp rx=0 tx=0).stop 2024-04-25T02:13:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.287+0000 7f30c435a640 1 -- 172.21.15.79:0/1890911587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30bc0b3020 msgr2=0x7f30bc15d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.287+0000 7f30c435a640 1 --2- 172.21.15.79:0/1890911587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30bc0b3020 0x7f30bc15d210 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009870 tx=0x7f30b80046c0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.287+0000 7f30c435a640 1 -- 172.21.15.79:0/1890911587 shutdown_connections 2024-04-25T02:13:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.287+0000 7f30c435a640 1 --2- 172.21.15.79:0/1890911587 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f30a006be30 0x7f30a006e2f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.287+0000 7f30c435a640 1 --2- 172.21.15.79:0/1890911587 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f30bc15e4d0 0x7f30bc0b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.287+0000 7f30c435a640 1 --2- 172.21.15.79:0/1890911587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30bc0b3570 0x7f30bc15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.287+0000 7f30c435a640 1 --2- 172.21.15.79:0/1890911587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30bc0b3020 0x7f30bc15d210 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.287+0000 7f30c435a640 1 -- 172.21.15.79:0/1890911587 >> 172.21.15.79:0/1890911587 conn(0x7f30bc09d460 msgr2=0x7f30bc0d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.287+0000 7f30c435a640 1 -- 172.21.15.79:0/1890911587 shutdown_connections 2024-04-25T02:13:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.287+0000 7f30c435a640 1 -- 172.21.15.79:0/1890911587 wait complete. 2024-04-25T02:13:31.304 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:13:31.305 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:13:31.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.398+0000 7f98e83a9640 1 Processor -- start 2024-04-25T02:13:31.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.398+0000 7f98e83a9640 1 -- start start 2024-04-25T02:13:31.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.399+0000 7f98e83a9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98e006b2f0 0x7f98e00b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.399+0000 7f98e83a9640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f98e006e6b0 0x7f98e015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.399+0000 7f98e83a9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98e015ec20 con 0x7f98e00cf7a0 2024-04-25T02:13:31.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.399+0000 7f98e83a9640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f98e015f830 con 0x7f98e006e6b0 2024-04-25T02:13:31.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.399+0000 7f98e83a9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f98e015ef00 con 0x7f98e006b2f0 2024-04-25T02:13:31.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.399+0000 7f98e6145640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98e006b2f0 0x7f98e00b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.399+0000 7f98e6946640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f98e006e6b0 0x7f98e015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.399+0000 7f98e5944640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f98e00cf7a0 0x7f98e006b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:46878/0 (socket says 172.21.15.79:46878) 2024-04-25T02:13:31.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.399+0000 7f98e5944640 1 -- 172.21.15.79:0/3211892491 learned_addr learned my addr 172.21.15.79:0/3211892491 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:31.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.399+0000 7f98e6145640 1 -- 172.21.15.79:0/3211892491 >> v2:172.21.15.189:3300/0 conn(0x7f98e006e6b0 msgr2=0x7f98e015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:31.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.399+0000 7f98e6145640 1 --2- 172.21.15.79:0/3211892491 >> v2:172.21.15.189:3300/0 conn(0x7f98e006e6b0 0x7f98e015b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.399+0000 7f98e6145640 1 -- 172.21.15.79:0/3211892491 >> v1:172.21.15.189:6789/0 conn(0x7f98e00cf7a0 legacy=0x7f98e006b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.399+0000 7f98e6145640 1 -- 172.21.15.79:0/3211892491 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e015f1e0 con 0x7f98e006b2f0 2024-04-25T02:13:31.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.399+0000 7f98e6946640 1 --2- 172.21.15.79:0/3211892491 >> v2:172.21.15.189:3300/0 conn(0x7f98e006e6b0 0x7f98e015b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:13:31.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.400+0000 7f98e6145640 1 --2- 172.21.15.79:0/3211892491 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98e006b2f0 0x7f98e00b4b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0097a0 tx=0x7f98dc02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=732903564691f8e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:31.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.400+0000 7f98e5143640 1 -- 172.21.15.79:0/3211892491 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc037070 con 0x7f98e006b2f0 2024-04-25T02:13:31.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.400+0000 7f98e5143640 1 -- 172.21.15.79:0/3211892491 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98dc02ae50 con 0x7f98e006b2f0 2024-04-25T02:13:31.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.400+0000 7f98e5143640 1 -- 172.21.15.79:0/3211892491 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc032660 con 0x7f98e006b2f0 2024-04-25T02:13:31.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.401+0000 7f98e83a9640 1 -- 172.21.15.79:0/3211892491 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98e006b2f0 msgr2=0x7f98e00b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.401+0000 7f98e83a9640 1 --2- 172.21.15.79:0/3211892491 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98e006b2f0 0x7f98e00b4b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0097a0 tx=0x7f98dc02a100 comp rx=0 tx=0).stop 2024-04-25T02:13:31.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.401+0000 7f98e83a9640 1 -- 172.21.15.79:0/3211892491 shutdown_connections 2024-04-25T02:13:31.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.401+0000 7f98e83a9640 1 --2- 172.21.15.79:0/3211892491 >> v2:172.21.15.189:3300/0 conn(0x7f98e006e6b0 0x7f98e015b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.401+0000 7f98e83a9640 1 --2- 172.21.15.79:0/3211892491 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98e006b2f0 0x7f98e00b4b50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.401+0000 7f98e83a9640 1 -- 172.21.15.79:0/3211892491 >> 172.21.15.79:0/3211892491 conn(0x7f98e00b1cd0 msgr2=0x7f98e00b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:31.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.401+0000 7f98e83a9640 1 -- 172.21.15.79:0/3211892491 shutdown_connections 2024-04-25T02:13:31.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.401+0000 7f98e83a9640 1 -- 172.21.15.79:0/3211892491 wait complete. 2024-04-25T02:13:31.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.402+0000 7f98e83a9640 1 Processor -- start 2024-04-25T02:13:31.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.402+0000 7f98e83a9640 1 -- start start 2024-04-25T02:13:31.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e83a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e006b2f0 0x7f98e015d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e83a9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98e006e6b0 0x7f98e01487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e83a9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98e00cf7a0 0x7f98e01573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e83a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f98e006d160 con 0x7f98e006b2f0 2024-04-25T02:13:31.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e83a9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f98e006cfe0 con 0x7f98e006e6b0 2024-04-25T02:13:31.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e83a9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f98e015b810 con 0x7f98e00cf7a0 2024-04-25T02:13:31.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e6145640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e006b2f0 0x7f98e015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e6145640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e006b2f0 0x7f98e015d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60422/0 (socket says 172.21.15.79:60422) 2024-04-25T02:13:31.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e6145640 1 -- 172.21.15.79:0/211220414 learned_addr learned my addr 172.21.15.79:0/211220414 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:31.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e5944640 1 --2- 172.21.15.79:0/211220414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98e006e6b0 0x7f98e01487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e6946640 1 --2- 172.21.15.79:0/211220414 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98e00cf7a0 0x7f98e01573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e6145640 1 -- 172.21.15.79:0/211220414 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98e00cf7a0 msgr2=0x7f98e01573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e6145640 1 --2- 172.21.15.79:0/211220414 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98e00cf7a0 0x7f98e01573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e6145640 1 -- 172.21.15.79:0/211220414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98e006e6b0 msgr2=0x7f98e01487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e6145640 1 --2- 172.21.15.79:0/211220414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98e006e6b0 0x7f98e01487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e6145640 1 -- 172.21.15.79:0/211220414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e0157f00 con 0x7f98e006b2f0 2024-04-25T02:13:31.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e6145640 1 --2- 172.21.15.79:0/211220414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e006b2f0 0x7f98e015d820 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0098c0 tx=0x7f98dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:31.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98d6ffd640 1 -- 172.21.15.79:0/211220414 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc041030 con 0x7f98e006b2f0 2024-04-25T02:13:31.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98d6ffd640 1 -- 172.21.15.79:0/211220414 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98dc02ac50 con 0x7f98e006b2f0 2024-04-25T02:13:31.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.403+0000 7f98e83a9640 1 -- 172.21.15.79:0/211220414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98e0157c20 con 0x7f98e006b2f0 2024-04-25T02:13:31.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.404+0000 7f98d6ffd640 1 -- 172.21.15.79:0/211220414 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc037040 con 0x7f98e006b2f0 2024-04-25T02:13:31.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.404+0000 7f98e83a9640 1 -- 172.21.15.79:0/211220414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98e01598f0 con 0x7f98e006b2f0 2024-04-25T02:13:31.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.404+0000 7f98e83a9640 1 -- 172.21.15.79:0/211220414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98e00690a0 con 0x7f98e006b2f0 2024-04-25T02:13:31.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.405+0000 7f98d6ffd640 1 -- 172.21.15.79:0/211220414 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98dc044070 con 0x7f98e006b2f0 2024-04-25T02:13:31.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.405+0000 7f98d6ffd640 1 --2- 172.21.15.79:0/211220414 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98c406be30 0x7f98c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.406+0000 7f98e5944640 1 --2- 172.21.15.79:0/211220414 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98c406be30 0x7f98c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.406+0000 7f98d6ffd640 1 -- 172.21.15.79:0/211220414 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5029+0+0 (secure 0 0 0) 0x7f98dc0aafe0 con 0x7f98e006b2f0 2024-04-25T02:13:31.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.406+0000 7f98e5944640 1 --2- 172.21.15.79:0/211220414 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98c406be30 0x7f98c406e2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f98e015dd60 tx=0x7f98d0007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:31.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.410+0000 7f98d6ffd640 1 -- 172.21.15.79:0/211220414 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f98dc079c30 con 0x7f98e006b2f0 2024-04-25T02:13:31.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.581+0000 7f98e83a9640 1 -- 172.21.15.79:0/211220414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f98e00cc460 con 0x7f98e006b2f0 2024-04-25T02:13:31.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.581+0000 7f98d6ffd640 1 -- 172.21.15.79:0/211220414 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f98dc02ae20 con 0x7f98e006b2f0 2024-04-25T02:13:31.588 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:13:31.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.583+0000 7f98e83a9640 1 -- 172.21.15.79:0/211220414 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98c406be30 msgr2=0x7f98c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.583+0000 7f98e83a9640 1 --2- 172.21.15.79:0/211220414 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98c406be30 0x7f98c406e2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f98e015dd60 tx=0x7f98d0007e80 comp rx=0 tx=0).stop 2024-04-25T02:13:31.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.583+0000 7f98e83a9640 1 -- 172.21.15.79:0/211220414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e006b2f0 msgr2=0x7f98e015d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.583+0000 7f98e83a9640 1 --2- 172.21.15.79:0/211220414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e006b2f0 0x7f98e015d820 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0098c0 tx=0x7f98dc0046c0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.583+0000 7f98e83a9640 1 -- 172.21.15.79:0/211220414 shutdown_connections 2024-04-25T02:13:31.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.583+0000 7f98e83a9640 1 --2- 172.21.15.79:0/211220414 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98c406be30 0x7f98c406e2f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.583+0000 7f98e83a9640 1 --2- 172.21.15.79:0/211220414 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f98e00cf7a0 0x7f98e01573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.583+0000 7f98e83a9640 1 --2- 172.21.15.79:0/211220414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98e006e6b0 0x7f98e01487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.583+0000 7f98e83a9640 1 --2- 172.21.15.79:0/211220414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e006b2f0 0x7f98e015d820 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.583+0000 7f98e83a9640 1 -- 172.21.15.79:0/211220414 >> 172.21.15.79:0/211220414 conn(0x7f98e00b1cd0 msgr2=0x7f98e006b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:31.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.583+0000 7f98e83a9640 1 -- 172.21.15.79:0/211220414 shutdown_connections 2024-04-25T02:13:31.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.583+0000 7f98e83a9640 1 -- 172.21.15.79:0/211220414 wait complete. 2024-04-25T02:13:31.600 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-25T02:13:31.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.690+0000 7fbdc464d640 1 Processor -- start 2024-04-25T02:13:31.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.690+0000 7fbdc464d640 1 -- start start 2024-04-25T02:13:31.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc464d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbdbc15bc10 0x7fbdbc162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc464d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdbc162d40 con 0x7fbdbc06e660 2024-04-25T02:13:31.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc464d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdbc15e870 con 0x7fbdbc15bff0 2024-04-25T02:13:31.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc464d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fbdbc15eb10 con 0x7fbdbc15bc10 2024-04-25T02:13:31.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc2bea640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbdbc06e660 0x7fbdbc0b3f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44730/0 (socket says 172.21.15.79:44730) 2024-04-25T02:13:31.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc2bea640 1 -- 172.21.15.79:0/2284770689 learned_addr learned my addr 172.21.15.79:0/2284770689 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:31.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc23e9640 1 --2- 172.21.15.79:0/2284770689 >> v2:172.21.15.189:3300/0 conn(0x7fbdbc15bc10 0x7fbdbc162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2953946229 0 0) 0x7fbdb4001490 con 0x7fbdbc06e660 2024-04-25T02:13:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbda8003520 con 0x7fbdbc06e660 2024-04-25T02:13:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2418819109 0 0) 0x7fbdbc15e870 con 0x7fbdbc15bff0 2024-04-25T02:13:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdb4001490 con 0x7fbdbc15bff0 2024-04-25T02:13:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 491129128 0 0) 0x7fbda8003520 con 0x7fbdbc06e660 2024-04-25T02:13:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 >> v2:172.21.15.189:3300/0 conn(0x7fbdbc15bc10 msgr2=0x7fbdbc162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc13e7640 1 --2- 172.21.15.79:0/2284770689 >> v2:172.21.15.189:3300/0 conn(0x7fbdbc15bc10 0x7fbdbc162800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 >> v1:172.21.15.189:6789/0 conn(0x7fbdbc15bff0 legacy=0x7fbdbc06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.691+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdbc15edf0 con 0x7fbdbc06e660 2024-04-25T02:13:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fbdb4001bc0 con 0x7fbdbc06e660 2024-04-25T02:13:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc23e9640 1 --2- 172.21.15.79:0/2284770689 >> v2:172.21.15.189:3300/0 conn(0x7fbdbc15bc10 0x7fbdbc162800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:13:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 >> v1:172.21.15.79:6789/0 conn(0x7fbdbc06e660 legacy=0x7fbdbc0b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc13e7640 1 --2- 172.21.15.79:0/2284770689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbda8003b40 0x7fbda8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc13e7640 1 --2- 172.21.15.79:0/2284770689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbda8004800 0x7fbda8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc13e7640 1 --2- 172.21.15.79:0/2284770689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbda80051c0 0x7fbda800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc15eb10 con 0x7fbda80051c0 2024-04-25T02:13:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbda800c0f0 con 0x7fbda8003b40 2024-04-25T02:13:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbda800c2f0 con 0x7fbda8004800 2024-04-25T02:13:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc2bea640 1 --2- 172.21.15.79:0/2284770689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbda80051c0 0x7fbda800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc23e9640 1 --2- 172.21.15.79:0/2284770689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbda8003b40 0x7fbda8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc1be8640 1 --2- 172.21.15.79:0/2284770689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbda8004800 0x7fbda8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc2bea640 1 -- 172.21.15.79:0/2284770689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbda8004800 msgr2=0x7fbda8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc2bea640 1 --2- 172.21.15.79:0/2284770689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbda8004800 0x7fbda8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc2bea640 1 -- 172.21.15.79:0/2284770689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbda8003b40 msgr2=0x7fbda8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc2bea640 1 --2- 172.21.15.79:0/2284770689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbda8003b40 0x7fbda8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc2bea640 1 -- 172.21.15.79:0/2284770689 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda8003520 con 0x7fbda80051c0 2024-04-25T02:13:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.692+0000 7fbdc1be8640 1 --2- 172.21.15.79:0/2284770689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbda8004800 0x7fbda8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.693+0000 7fbdc2bea640 1 -- 172.21.15.79:0/2284770689 reap_dead start 2024-04-25T02:13:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.693+0000 7fbdc2bea640 1 --2- 172.21.15.79:0/2284770689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbda80051c0 0x7fbda800b9c0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400a9e0 tx=0x7fbda8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f56db1e013d1910 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:31.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.693+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400a600 con 0x7fbda80051c0 2024-04-25T02:13:31.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.693+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb402f070 con 0x7fbda80051c0 2024-04-25T02:13:31.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.693+0000 7fbdc13e7640 1 -- 172.21.15.79:0/2284770689 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb402bdf0 con 0x7fbda80051c0 2024-04-25T02:13:31.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.693+0000 7fbdc464d640 1 -- 172.21.15.79:0/2284770689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbda80051c0 msgr2=0x7fbda800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.693+0000 7fbdc464d640 1 --2- 172.21.15.79:0/2284770689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbda80051c0 0x7fbda800b9c0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400a9e0 tx=0x7fbda8005830 comp rx=0 tx=0).stop 2024-04-25T02:13:31.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.693+0000 7fbdc464d640 1 -- 172.21.15.79:0/2284770689 shutdown_connections 2024-04-25T02:13:31.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.693+0000 7fbdc464d640 1 --2- 172.21.15.79:0/2284770689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbda80051c0 0x7fbda800b9c0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.693+0000 7fbdc464d640 1 -- 172.21.15.79:0/2284770689 >> 172.21.15.79:0/2284770689 conn(0x7fbdbc0cfc80 msgr2=0x7fbdbc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:31.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.693+0000 7fbdc464d640 1 -- 172.21.15.79:0/2284770689 shutdown_connections 2024-04-25T02:13:31.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.693+0000 7fbdc464d640 1 -- 172.21.15.79:0/2284770689 wait complete. 2024-04-25T02:13:31.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.695+0000 7fbdc464d640 1 Processor -- start 2024-04-25T02:13:31.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.695+0000 7fbdc464d640 1 -- start start 2024-04-25T02:13:31.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.695+0000 7fbdc464d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbda80051c0 0x7fbdbc0cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.695+0000 7fbdc464d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdbc1f7220 0x7fbdbc153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.695+0000 7fbdc464d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdbc15cbe0 0x7fbdbc15d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.695+0000 7fbdc464d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc15f690 con 0x7fbdbc15cbe0 2024-04-25T02:13:31.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.695+0000 7fbdc464d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc15f3b0 con 0x7fbda80051c0 2024-04-25T02:13:31.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.695+0000 7fbdc464d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbdbc0aef70 con 0x7fbdbc1f7220 2024-04-25T02:13:31.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.695+0000 7fbdc2bea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdbc15cbe0 0x7fbdbc15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.695+0000 7fbdc2bea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdbc15cbe0 0x7fbdbc15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60442/0 (socket says 172.21.15.79:60442) 2024-04-25T02:13:31.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.695+0000 7fbdc2bea640 1 -- 172.21.15.79:0/2774451196 learned_addr learned my addr 172.21.15.79:0/2774451196 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:31.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.696+0000 7fbdc23e9640 1 --2- 172.21.15.79:0/2774451196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbda80051c0 0x7fbdbc0cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.696+0000 7fbdc1be8640 1 --2- 172.21.15.79:0/2774451196 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdbc1f7220 0x7fbdbc153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.696+0000 7fbdc2bea640 1 -- 172.21.15.79:0/2774451196 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdbc1f7220 msgr2=0x7fbdbc153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.696+0000 7fbdc2bea640 1 --2- 172.21.15.79:0/2774451196 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdbc1f7220 0x7fbdbc153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.696+0000 7fbdc2bea640 1 -- 172.21.15.79:0/2774451196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbda80051c0 msgr2=0x7fbdbc0cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.696+0000 7fbdc2bea640 1 --2- 172.21.15.79:0/2774451196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbda80051c0 0x7fbdbc0cf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.696+0000 7fbdc2bea640 1 -- 172.21.15.79:0/2774451196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdbc1f76a0 con 0x7fbdbc15cbe0 2024-04-25T02:13:31.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.696+0000 7fbdc2bea640 1 --2- 172.21.15.79:0/2774451196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdbc15cbe0 0x7fbdbc15d040 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40012e0 tx=0x7fbdbc15efc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:31.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.696+0000 7fbdb2ffd640 1 -- 172.21.15.79:0/2774451196 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4044070 con 0x7fbdbc15cbe0 2024-04-25T02:13:31.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.696+0000 7fbdb2ffd640 1 -- 172.21.15.79:0/2774451196 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb403f670 con 0x7fbdbc15cbe0 2024-04-25T02:13:31.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.696+0000 7fbdb2ffd640 1 -- 172.21.15.79:0/2774451196 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400a600 con 0x7fbdbc15cbe0 2024-04-25T02:13:31.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.696+0000 7fbdc464d640 1 -- 172.21.15.79:0/2774451196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdbc1f7950 con 0x7fbdbc15cbe0 2024-04-25T02:13:31.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.696+0000 7fbdc464d640 1 -- 172.21.15.79:0/2774451196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdbc1f7f10 con 0x7fbdbc15cbe0 2024-04-25T02:13:31.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.697+0000 7fbdc464d640 1 -- 172.21.15.79:0/2774451196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdbc1f8150 con 0x7fbdbc15cbe0 2024-04-25T02:13:31.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.698+0000 7fbdb2ffd640 1 -- 172.21.15.79:0/2774451196 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbdb4047070 con 0x7fbdbc15cbe0 2024-04-25T02:13:31.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.698+0000 7fbdb2ffd640 1 --2- 172.21.15.79:0/2774451196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbda006be30 0x7fbda006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:31.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.698+0000 7fbdb2ffd640 1 -- 172.21.15.79:0/2774451196 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5029+0+0 (secure 0 0 0) 0x7fbdb40aac10 con 0x7fbdbc15cbe0 2024-04-25T02:13:31.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.698+0000 7fbdc23e9640 1 --2- 172.21.15.79:0/2774451196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbda006be30 0x7fbda006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:31.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.698+0000 7fbdc23e9640 1 --2- 172.21.15.79:0/2774451196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbda006be30 0x7fbda006e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009c10 tx=0x7fbdb8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:31.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.702+0000 7fbdb2ffd640 1 -- 172.21.15.79:0/2774451196 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbdbc1f8150 con 0x7fbdbc15cbe0 2024-04-25T02:13:31.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.942+0000 7fbdc464d640 1 -- 172.21.15.79:0/2774451196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) -- 0x7fbdbc0690a0 con 0x7fbdbc15cbe0 2024-04-25T02:13:31.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.985+0000 7fbdb2ffd640 1 -- 172.21.15.79:0/2774451196 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v277) ==== 170+0+0 (secure 0 0 0) 0x7fbdb40ae070 con 0x7fbdbc15cbe0 2024-04-25T02:13:31.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.987+0000 7fbdc464d640 1 -- 172.21.15.79:0/2774451196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbda006be30 msgr2=0x7fbda006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.987+0000 7fbdc464d640 1 --2- 172.21.15.79:0/2774451196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbda006be30 0x7fbda006e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009c10 tx=0x7fbdb8008040 comp rx=0 tx=0).stop 2024-04-25T02:13:31.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.987+0000 7fbdc464d640 1 -- 172.21.15.79:0/2774451196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdbc15cbe0 msgr2=0x7fbdbc15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:31.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.987+0000 7fbdc464d640 1 --2- 172.21.15.79:0/2774451196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdbc15cbe0 0x7fbdbc15d040 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40012e0 tx=0x7fbdbc15efc0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.987+0000 7fbdc464d640 1 -- 172.21.15.79:0/2774451196 shutdown_connections 2024-04-25T02:13:31.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.987+0000 7fbdc464d640 1 --2- 172.21.15.79:0/2774451196 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbda006be30 0x7fbda006e2f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.987+0000 7fbdc464d640 1 --2- 172.21.15.79:0/2774451196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdbc15cbe0 0x7fbdbc15d040 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.987+0000 7fbdc464d640 1 --2- 172.21.15.79:0/2774451196 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdbc1f7220 0x7fbdbc153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.987+0000 7fbdc464d640 1 --2- 172.21.15.79:0/2774451196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbda80051c0 0x7fbdbc0cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:31.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.987+0000 7fbdc464d640 1 -- 172.21.15.79:0/2774451196 >> 172.21.15.79:0/2774451196 conn(0x7fbdbc0cfc80 msgr2=0x7fbdbc0b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:31.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.987+0000 7fbdc464d640 1 -- 172.21.15.79:0/2774451196 shutdown_connections 2024-04-25T02:13:31.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:31.987+0000 7fbdc464d640 1 -- 172.21.15.79:0/2774451196 wait complete. 2024-04-25T02:13:32.004 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T02:13:32.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.097+0000 7f794a5b7640 1 Processor -- start 2024-04-25T02:13:32.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.097+0000 7f794a5b7640 1 -- start start 2024-04-25T02:13:32.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.098+0000 7f794a5b7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f794406b2f0 0x7f79440b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:32.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.098+0000 7f794a5b7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79440cf7a0 0x7f794406b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:32.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.098+0000 7f794a5b7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f794406bc10 con 0x7f794406e6b0 2024-04-25T02:13:32.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.098+0000 7f794a5b7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f794415f830 con 0x7f794406b2f0 2024-04-25T02:13:32.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.098+0000 7f794a5b7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f794415ec20 con 0x7f79440cf7a0 2024-04-25T02:13:32.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.098+0000 7f7943fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f794406b2f0 0x7f79440b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:32.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.098+0000 7f7948b54640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f794406e6b0 0x7f79440cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44732/0 (socket says 172.21.15.79:44732) 2024-04-25T02:13:32.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.098+0000 7f7948b54640 1 -- 172.21.15.79:0/2796282682 learned_addr learned my addr 172.21.15.79:0/2796282682 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:32.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.099+0000 7f7943fff640 1 -- 172.21.15.79:0/2796282682 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79440cf7a0 msgr2=0x7f794406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:32.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.099+0000 7f7943fff640 1 --2- 172.21.15.79:0/2796282682 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79440cf7a0 0x7f794406b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.099+0000 7f7943fff640 1 -- 172.21.15.79:0/2796282682 >> v1:172.21.15.79:6789/0 conn(0x7f794406e6b0 legacy=0x7f79440cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:32.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.099+0000 7f7943fff640 1 -- 172.21.15.79:0/2796282682 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794415ef00 con 0x7f794406b2f0 2024-04-25T02:13:32.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.099+0000 7f7943fff640 1 --2- 172.21.15.79:0/2796282682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f794406b2f0 0x7f79440b4b50 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f79340097a0 tx=0x7f793402a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3645abff57283153 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:32.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.099+0000 7f7942ffd640 1 -- 172.21.15.79:0/2796282682 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934037070 con 0x7f794406b2f0 2024-04-25T02:13:32.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.099+0000 7f7942ffd640 1 -- 172.21.15.79:0/2796282682 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793402ac90 con 0x7f794406b2f0 2024-04-25T02:13:32.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.099+0000 7f7942ffd640 1 -- 172.21.15.79:0/2796282682 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934032660 con 0x7f794406b2f0 2024-04-25T02:13:32.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.100+0000 7f794a5b7640 1 -- 172.21.15.79:0/2796282682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f794406b2f0 msgr2=0x7f79440b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:32.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.100+0000 7f794a5b7640 1 --2- 172.21.15.79:0/2796282682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f794406b2f0 0x7f79440b4b50 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f79340097a0 tx=0x7f793402a000 comp rx=0 tx=0).stop 2024-04-25T02:13:32.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.100+0000 7f794a5b7640 1 -- 172.21.15.79:0/2796282682 shutdown_connections 2024-04-25T02:13:32.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.100+0000 7f794a5b7640 1 --2- 172.21.15.79:0/2796282682 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79440cf7a0 0x7f794406b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.100+0000 7f794a5b7640 1 --2- 172.21.15.79:0/2796282682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f794406b2f0 0x7f79440b4b50 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.100+0000 7f794a5b7640 1 -- 172.21.15.79:0/2796282682 >> 172.21.15.79:0/2796282682 conn(0x7f79440b1cd0 msgr2=0x7f79440b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:32.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.100+0000 7f794a5b7640 1 -- 172.21.15.79:0/2796282682 shutdown_connections 2024-04-25T02:13:32.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.100+0000 7f794a5b7640 1 -- 172.21.15.79:0/2796282682 wait complete. 2024-04-25T02:13:32.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.101+0000 7f794a5b7640 1 Processor -- start 2024-04-25T02:13:32.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.101+0000 7f794a5b7640 1 -- start start 2024-04-25T02:13:32.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.102+0000 7f794a5b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f794406b2f0 0x7f794414eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:32.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.102+0000 7f794a5b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f794406e6b0 0x7f794409d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:32.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.102+0000 7f794a5b7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79440cf7a0 0x7f794409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:32.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.102+0000 7f794a5b7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f794406cfe0 con 0x7f794406b2f0 2024-04-25T02:13:32.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.102+0000 7f794a5b7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f794415f4c0 con 0x7f794406e6b0 2024-04-25T02:13:32.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.102+0000 7f794a5b7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f794406d160 con 0x7f79440cf7a0 2024-04-25T02:13:32.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.102+0000 7f7943fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f794406b2f0 0x7f794414eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:32.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.102+0000 7f7943fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f794406b2f0 0x7f794414eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60448/0 (socket says 172.21.15.79:60448) 2024-04-25T02:13:32.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.102+0000 7f7943fff640 1 -- 172.21.15.79:0/3991270924 learned_addr learned my addr 172.21.15.79:0/3991270924 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:32.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.102+0000 7f7943fff640 1 -- 172.21.15.79:0/3991270924 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79440cf7a0 msgr2=0x7f794409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:32.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.102+0000 7f7943fff640 1 --2- 172.21.15.79:0/3991270924 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79440cf7a0 0x7f794409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.102+0000 7f7943fff640 1 -- 172.21.15.79:0/3991270924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f794406e6b0 msgr2=0x7f794409d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:32.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.102+0000 7f7943fff640 1 --2- 172.21.15.79:0/3991270924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f794406e6b0 0x7f794409d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.102+0000 7f7943fff640 1 -- 172.21.15.79:0/3991270924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794415c680 con 0x7f794406b2f0 2024-04-25T02:13:32.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.103+0000 7f7943fff640 1 --2- 172.21.15.79:0/3991270924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f794406b2f0 0x7f794414eb10 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f79340098c0 tx=0x7f79340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:32.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.103+0000 7f7940ff9640 1 -- 172.21.15.79:0/3991270924 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934037040 con 0x7f794406b2f0 2024-04-25T02:13:32.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.103+0000 7f7940ff9640 1 -- 172.21.15.79:0/3991270924 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7934004030 con 0x7f794406b2f0 2024-04-25T02:13:32.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.103+0000 7f794a5b7640 1 -- 172.21.15.79:0/3991270924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f794414f1d0 con 0x7f794406b2f0 2024-04-25T02:13:32.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.103+0000 7f7940ff9640 1 -- 172.21.15.79:0/3991270924 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934004400 con 0x7f794406b2f0 2024-04-25T02:13:32.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.103+0000 7f794a5b7640 1 -- 172.21.15.79:0/3991270924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f794415cc00 con 0x7f794406b2f0 2024-04-25T02:13:32.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.104+0000 7f794a5b7640 1 -- 172.21.15.79:0/3991270924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79440690a0 con 0x7f794406b2f0 2024-04-25T02:13:32.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.104+0000 7f7940ff9640 1 -- 172.21.15.79:0/3991270924 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f793403a070 con 0x7f794406b2f0 2024-04-25T02:13:32.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.104+0000 7f7940ff9640 1 --2- 172.21.15.79:0/3991270924 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f793006be30 0x7f793006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:32.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.105+0000 7f7940ff9640 1 -- 172.21.15.79:0/3991270924 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5029+0+0 (secure 0 0 0) 0x7f79340ab140 con 0x7f794406b2f0 2024-04-25T02:13:32.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.105+0000 7f79437fe640 1 --2- 172.21.15.79:0/3991270924 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f793006be30 0x7f793006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:32.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.105+0000 7f79437fe640 1 --2- 172.21.15.79:0/3991270924 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f793006be30 0x7f793006e2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f794415ace0 tx=0x7f7938006bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:32.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.109+0000 7f7940ff9640 1 -- 172.21.15.79:0/3991270924 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7934041020 con 0x7f794406b2f0 2024-04-25T02:13:32.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.281+0000 7f794a5b7640 1 -- 172.21.15.79:0/3991270924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f79440cf4f0 con 0x7f794406b2f0 2024-04-25T02:13:32.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.284+0000 7f7940ff9640 1 -- 172.21.15.79:0/3991270924 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f7934079e20 con 0x7f794406b2f0 2024-04-25T02:13:32.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.286+0000 7f794a5b7640 1 -- 172.21.15.79:0/3991270924 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f793006be30 msgr2=0x7f793006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:32.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.286+0000 7f794a5b7640 1 --2- 172.21.15.79:0/3991270924 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f793006be30 0x7f793006e2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f794415ace0 tx=0x7f7938006bf0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.286+0000 7f794a5b7640 1 -- 172.21.15.79:0/3991270924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f794406b2f0 msgr2=0x7f794414eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:32.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.286+0000 7f794a5b7640 1 --2- 172.21.15.79:0/3991270924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f794406b2f0 0x7f794414eb10 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f79340098c0 tx=0x7f79340046c0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.287+0000 7f794a5b7640 1 -- 172.21.15.79:0/3991270924 shutdown_connections 2024-04-25T02:13:32.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.287+0000 7f794a5b7640 1 --2- 172.21.15.79:0/3991270924 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f793006be30 0x7f793006e2f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.287+0000 7f794a5b7640 1 --2- 172.21.15.79:0/3991270924 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f79440cf7a0 0x7f794409aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.287+0000 7f794a5b7640 1 --2- 172.21.15.79:0/3991270924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f794406e6b0 0x7f794409d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.287+0000 7f794a5b7640 1 --2- 172.21.15.79:0/3991270924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f794406b2f0 0x7f794414eb10 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.287+0000 7f794a5b7640 1 -- 172.21.15.79:0/3991270924 >> 172.21.15.79:0/3991270924 conn(0x7f79440b1cd0 msgr2=0x7f79440aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:32.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.287+0000 7f794a5b7640 1 -- 172.21.15.79:0/3991270924 shutdown_connections 2024-04-25T02:13:32.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.287+0000 7f794a5b7640 1 -- 172.21.15.79:0/3991270924 wait complete. 2024-04-25T02:13:32.304 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:13:32.304 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:13:32.339 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:13:32.382 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:13:32.382 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:13:32.382 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:13:32.397 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:13:32.397 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:13:32.397 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:13:32.440 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:13:32.440 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:13:32.441 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:13:32.455 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:13:32.455 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:13:32.455 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:13:32.499 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:13:32.499 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T02:13:32.499 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:13:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.588+0000 7f8e2debd640 1 Processor -- start 2024-04-25T02:13:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.589+0000 7f8e2debd640 1 -- start start 2024-04-25T02:13:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.589+0000 7f8e2debd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8e2815e4d0 0x7f8e2806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.589+0000 7f8e2debd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e280d2e20 0x7f8e280cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.589+0000 7f8e2debd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e280d1660 con 0x7f8e280b3570 2024-04-25T02:13:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.589+0000 7f8e2debd640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f8e280d1380 con 0x7f8e2815e4d0 2024-04-25T02:13:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.589+0000 7f8e2debd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8e280cede0 con 0x7f8e280d2e20 2024-04-25T02:13:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.589+0000 7f8e26ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8e280b3570 0x7f8e280d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44740/0 (socket says 172.21.15.79:44740) 2024-04-25T02:13:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.589+0000 7f8e26ffd640 1 -- 172.21.15.79:0/2272677246 learned_addr learned my addr 172.21.15.79:0/2272677246 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e277fe640 1 --2- 172.21.15.79:0/2272677246 >> v2:172.21.15.189:3300/0 conn(0x7f8e2815e4d0 0x7f8e2806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e27fff640 1 --2- 172.21.15.79:0/2272677246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e280d2e20 0x7f8e280cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 -- 172.21.15.79:0/2272677246 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1735826150 0 0) 0x7f8e280d1660 con 0x7f8e280b3570 2024-04-25T02:13:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 -- 172.21.15.79:0/2272677246 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e10003520 con 0x7f8e280b3570 2024-04-25T02:13:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 -- 172.21.15.79:0/2272677246 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2197289115 0 0) 0x7f8e10003520 con 0x7f8e280b3570 2024-04-25T02:13:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 -- 172.21.15.79:0/2272677246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e280d2e20 msgr2=0x7f8e280cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 --2- 172.21.15.79:0/2272677246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e280d2e20 0x7f8e280cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 -- 172.21.15.79:0/2272677246 >> v2:172.21.15.189:3300/0 conn(0x7f8e2815e4d0 msgr2=0x7f8e2806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 --2- 172.21.15.79:0/2272677246 >> v2:172.21.15.189:3300/0 conn(0x7f8e2815e4d0 0x7f8e2806bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 -- 172.21.15.79:0/2272677246 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e280cf0c0 con 0x7f8e280b3570 2024-04-25T02:13:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 -- 172.21.15.79:0/2272677246 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f8e1c001670 con 0x7f8e280b3570 2024-04-25T02:13:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 -- 172.21.15.79:0/2272677246 >> v1:172.21.15.79:6789/0 conn(0x7f8e280b3570 legacy=0x7f8e280d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 --2- 172.21.15.79:0/2272677246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e100039b0 0x7f8e10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 --2- 172.21.15.79:0/2272677246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e280d2e20 0x7f8e10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 --2- 172.21.15.79:0/2272677246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e10004d40 0x7f8e100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 -- 172.21.15.79:0/2272677246 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e280d1380 con 0x7f8e100039b0 2024-04-25T02:13:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 -- 172.21.15.79:0/2272677246 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8e280cede0 con 0x7f8e10004d40 2024-04-25T02:13:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e267fc640 1 -- 172.21.15.79:0/2272677246 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8e1000b9c0 con 0x7f8e280d2e20 2024-04-25T02:13:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e277fe640 1 --2- 172.21.15.79:0/2272677246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e100039b0 0x7f8e10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e26ffd640 1 --2- 172.21.15.79:0/2272677246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e280d2e20 0x7f8e10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e27fff640 1 --2- 172.21.15.79:0/2272677246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e10004d40 0x7f8e100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e277fe640 1 -- 172.21.15.79:0/2272677246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e280d2e20 msgr2=0x7f8e10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e277fe640 1 --2- 172.21.15.79:0/2272677246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e280d2e20 0x7f8e10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e277fe640 1 -- 172.21.15.79:0/2272677246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e10004d40 msgr2=0x7f8e100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e277fe640 1 --2- 172.21.15.79:0/2272677246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e10004d40 0x7f8e100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.590+0000 7f8e277fe640 1 -- 172.21.15.79:0/2272677246 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e10003520 con 0x7f8e100039b0 2024-04-25T02:13:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.591+0000 7f8e277fe640 1 --2- 172.21.15.79:0/2272677246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e100039b0 0x7f8e10003dd0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009af0 tx=0x7f8e10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce6b7ae2ab12c4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.591+0000 7f8e267fc640 1 -- 172.21.15.79:0/2272677246 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18036070 con 0x7f8e100039b0 2024-04-25T02:13:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.591+0000 7f8e267fc640 1 -- 172.21.15.79:0/2272677246 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e18031400 con 0x7f8e100039b0 2024-04-25T02:13:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.591+0000 7f8e267fc640 1 -- 172.21.15.79:0/2272677246 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18009690 con 0x7f8e100039b0 2024-04-25T02:13:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.592+0000 7f8e2debd640 1 -- 172.21.15.79:0/2272677246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e100039b0 msgr2=0x7f8e10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.592+0000 7f8e2debd640 1 --2- 172.21.15.79:0/2272677246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e100039b0 0x7f8e10003dd0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009af0 tx=0x7f8e10005830 comp rx=0 tx=0).stop 2024-04-25T02:13:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.592+0000 7f8e27fff640 1 -- 172.21.15.79:0/2272677246 reap_dead start 2024-04-25T02:13:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.592+0000 7f8e2debd640 1 -- 172.21.15.79:0/2272677246 shutdown_connections 2024-04-25T02:13:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.592+0000 7f8e2debd640 1 -- 172.21.15.79:0/2272677246 >> 172.21.15.79:0/2272677246 conn(0x7f8e2809d460 msgr2=0x7f8e280d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.592+0000 7f8e2debd640 1 -- 172.21.15.79:0/2272677246 shutdown_connections 2024-04-25T02:13:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.592+0000 7f8e2debd640 1 -- 172.21.15.79:0/2272677246 wait complete. 2024-04-25T02:13:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.593+0000 7f8e2debd640 1 Processor -- start 2024-04-25T02:13:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.593+0000 7f8e2debd640 1 -- start start 2024-04-25T02:13:32.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e2debd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e100039b0 0x7f8e281f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:32.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e2debd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e280cc250 0x7f8e280cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e2debd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e280c9cd0 0x7f8e280ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e2debd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e280d2250 con 0x7f8e100039b0 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e2debd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8e280d20d0 con 0x7f8e280cc250 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e2debd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8e2806c1b0 con 0x7f8e280c9cd0 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e277fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e100039b0 0x7f8e281f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e277fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e100039b0 0x7f8e281f77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60462/0 (socket says 172.21.15.79:60462) 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e277fe640 1 -- 172.21.15.79:0/4057473546 learned_addr learned my addr 172.21.15.79:0/4057473546 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e27fff640 1 --2- 172.21.15.79:0/4057473546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e280c9cd0 0x7f8e280ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e26ffd640 1 --2- 172.21.15.79:0/4057473546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e280cc250 0x7f8e280cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e277fe640 1 -- 172.21.15.79:0/4057473546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e280c9cd0 msgr2=0x7f8e280ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e277fe640 1 --2- 172.21.15.79:0/4057473546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e280c9cd0 0x7f8e280ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e277fe640 1 -- 172.21.15.79:0/4057473546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e280cc250 msgr2=0x7f8e280cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e277fe640 1 --2- 172.21.15.79:0/4057473546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e280cc250 0x7f8e280cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e277fe640 1 -- 172.21.15.79:0/4057473546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e280ca690 con 0x7f8e100039b0 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e26ffd640 1 --2- 172.21.15.79:0/4057473546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e280cc250 0x7f8e280cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.594+0000 7f8e277fe640 1 --2- 172.21.15.79:0/4057473546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e100039b0 0x7f8e281f77a0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f8e18034040 tx=0x7f8e18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.595+0000 7f8e0ffff640 1 -- 172.21.15.79:0/4057473546 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18040020 con 0x7f8e100039b0 2024-04-25T02:13:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.595+0000 7f8e0ffff640 1 -- 172.21.15.79:0/4057473546 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e18003830 con 0x7f8e100039b0 2024-04-25T02:13:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.595+0000 7f8e2debd640 1 -- 172.21.15.79:0/4057473546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e281f8310 con 0x7f8e100039b0 2024-04-25T02:13:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.595+0000 7f8e0ffff640 1 -- 172.21.15.79:0/4057473546 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18036040 con 0x7f8e100039b0 2024-04-25T02:13:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.595+0000 7f8e2debd640 1 -- 172.21.15.79:0/4057473546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e280cd0a0 con 0x7f8e100039b0 2024-04-25T02:13:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.596+0000 7f8e2debd640 1 -- 172.21.15.79:0/4057473546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e280690a0 con 0x7f8e100039b0 2024-04-25T02:13:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.596+0000 7f8e0ffff640 1 -- 172.21.15.79:0/4057473546 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e18043020 con 0x7f8e100039b0 2024-04-25T02:13:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.596+0000 7f8e0ffff640 1 --2- 172.21.15.79:0/4057473546 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8e1406be30 0x7f8e1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.596+0000 7f8e0ffff640 1 -- 172.21.15.79:0/4057473546 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5029+0+0 (secure 0 0 0) 0x7f8e180aaac0 con 0x7f8e100039b0 2024-04-25T02:13:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.596+0000 7f8e26ffd640 1 --2- 172.21.15.79:0/4057473546 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8e1406be30 0x7f8e1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.597+0000 7f8e26ffd640 1 --2- 172.21.15.79:0/4057473546 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8e1406be30 0x7f8e1406e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c001050 tx=0x7f8e1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:32.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.601+0000 7f8e0ffff640 1 -- 172.21.15.79:0/4057473546 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8e1804a070 con 0x7f8e100039b0 2024-04-25T02:13:32.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.811+0000 7f8e2debd640 1 -- 172.21.15.79:0/4057473546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e280caf70 con 0x7f8e100039b0 2024-04-25T02:13:32.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.812+0000 7f8e0ffff640 1 -- 172.21.15.79:0/4057473546 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+3869 (secure 0 0 0) 0x7f8e280ca690 con 0x7f8e100039b0 2024-04-25T02:13:32.818 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:32.819 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/596307304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":596307304},{"type":"v1","addr":"172.21.15.189:6834","nonce":596307304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/980112490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":980112490},{"type":"v1","addr":"172.21.15.189:6835","nonce":980112490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/2550610051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550610051},{"type":"v1","addr":"172.21.15.79:6836","nonce":2550610051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2942954948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2942954948},{"type":"v1","addr":"172.21.15.79:6837","nonce":2942954948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[]} 2024-04-25T02:13:32.819 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 42 2024-04-25T02:13:32.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.814+0000 7f8e2debd640 1 -- 172.21.15.79:0/4057473546 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8e1406be30 msgr2=0x7f8e1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:32.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.814+0000 7f8e2debd640 1 --2- 172.21.15.79:0/4057473546 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8e1406be30 0x7f8e1406e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c001050 tx=0x7f8e1c009040 comp rx=0 tx=0).stop 2024-04-25T02:13:32.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.814+0000 7f8e2debd640 1 -- 172.21.15.79:0/4057473546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e100039b0 msgr2=0x7f8e281f77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:32.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.814+0000 7f8e2debd640 1 --2- 172.21.15.79:0/4057473546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e100039b0 0x7f8e281f77a0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f8e18034040 tx=0x7f8e18004730 comp rx=0 tx=0).stop 2024-04-25T02:13:32.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.814+0000 7f8e2debd640 1 -- 172.21.15.79:0/4057473546 shutdown_connections 2024-04-25T02:13:32.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.814+0000 7f8e2debd640 1 --2- 172.21.15.79:0/4057473546 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8e1406be30 0x7f8e1406e2f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.814+0000 7f8e2debd640 1 --2- 172.21.15.79:0/4057473546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e280c9cd0 0x7f8e280ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.814+0000 7f8e2debd640 1 --2- 172.21.15.79:0/4057473546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e280cc250 0x7f8e280cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.814+0000 7f8e2debd640 1 --2- 172.21.15.79:0/4057473546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e100039b0 0x7f8e281f77a0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:32.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.814+0000 7f8e2debd640 1 -- 172.21.15.79:0/4057473546 >> 172.21.15.79:0/4057473546 conn(0x7f8e2809d460 msgr2=0x7f8e2815cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:32.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.814+0000 7f8e2debd640 1 -- 172.21.15.79:0/4057473546 shutdown_connections 2024-04-25T02:13:32.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:32.814+0000 7f8e2debd640 1 -- 172.21.15.79:0/4057473546 wait complete. 2024-04-25T02:13:32.831 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T02:13:32.832 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T02:13:32.832 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T02:13:32.832 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:13:32.832 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T02:13:32.832 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T02:13:32.832 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T02:13:32.832 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:13:32.833 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T02:13:32.833 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T02:13:32.833 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T02:13:32.833 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:13:32.833 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T02:13:32.833 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T02:13:32.834 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T02:13:32.834 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:13:32.841 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T02:13:32.842 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T02:13:32.848 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T02:13:32.848 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T02:13:32.849 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T02:13:32.849 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T02:13:32.884 INFO:tasks.ceph.mds.c:Started 2024-04-25T02:13:32.885 DEBUG:teuthology.parallel:result is None 2024-04-25T02:13:32.891 INFO:tasks.ceph.mds.b:Started 2024-04-25T02:13:32.892 DEBUG:teuthology.parallel:result is None 2024-04-25T02:13:32.892 INFO:tasks.ceph.mds.d:Started 2024-04-25T02:13:32.892 DEBUG:teuthology.parallel:result is None 2024-04-25T02:13:32.954 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-04-25T02:13:32.972 INFO:tasks.ceph.mds.b.smithi189.stdout:starting mds.b at 2024-04-25T02:13:32.972 INFO:tasks.ceph.mds.d.smithi189.stdout:starting mds.d at 2024-04-25T02:13:33.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-25T02:13:38.842 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T02:13:38.842 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T02:13:38.845 INFO:tasks.ceph.mds.a:Started 2024-04-25T02:13:38.846 DEBUG:teuthology.parallel:result is None 2024-04-25T02:13:38.846 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T02:13:38.927 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:13:38.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.950+0000 7f60c1f09640 1 Processor -- start 2024-04-25T02:13:38.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.950+0000 7f60c1f09640 1 -- start start 2024-04-25T02:13:38.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.951+0000 7f60c1f09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60bc15e4d0 0x7f60bc06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:38.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.951+0000 7f60c1f09640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f60bc0d2e20 0x7f60bc0cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:38.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.951+0000 7f60c1f09640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60bc0d1660 con 0x7f60bc0b3570 2024-04-25T02:13:38.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.951+0000 7f60c1f09640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f60bc0d1380 con 0x7f60bc15e4d0 2024-04-25T02:13:38.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.951+0000 7f60c1f09640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f60bc0cede0 con 0x7f60bc0d2e20 2024-04-25T02:13:38.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.951+0000 7f60bb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60bc15e4d0 0x7f60bc06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:38.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.951+0000 7f60b3fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f60bc0b3570 0x7f60bc0d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33150/0 (socket says 172.21.15.79:33150) 2024-04-25T02:13:38.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.951+0000 7f60b3fff640 1 -- 172.21.15.79:0/1206606320 learned_addr learned my addr 172.21.15.79:0/1206606320 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:38.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.951+0000 7f60bbfff640 1 --2- 172.21.15.79:0/1206606320 >> v2:172.21.15.189:3300/0 conn(0x7f60bc0d2e20 0x7f60bc0cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:38.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.951+0000 7f60bb7fe640 1 -- 172.21.15.79:0/1206606320 >> v2:172.21.15.189:3300/0 conn(0x7f60bc0d2e20 msgr2=0x7f60bc0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:38.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.951+0000 7f60bb7fe640 1 --2- 172.21.15.79:0/1206606320 >> v2:172.21.15.189:3300/0 conn(0x7f60bc0d2e20 0x7f60bc0cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:38.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.951+0000 7f60bb7fe640 1 -- 172.21.15.79:0/1206606320 >> v1:172.21.15.79:6789/0 conn(0x7f60bc0b3570 legacy=0x7f60bc0d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:38.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.951+0000 7f60bb7fe640 1 -- 172.21.15.79:0/1206606320 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60bc0cf0c0 con 0x7f60bc15e4d0 2024-04-25T02:13:38.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.951+0000 7f60baffd640 1 -- 172.21.15.79:0/1206606320 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2893100046 0 0) 0x7f60bc0d1660 con 0x7f60bc0b3570 2024-04-25T02:13:38.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.952+0000 7f60bb7fe640 1 --2- 172.21.15.79:0/1206606320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60bc15e4d0 0x7f60bc06bc70 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0097a0 tx=0x7f60ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ddb9fc3c43f4400 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:38.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.952+0000 7f60baffd640 1 -- 172.21.15.79:0/1206606320 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac037070 con 0x7f60bc15e4d0 2024-04-25T02:13:38.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.952+0000 7f60baffd640 1 -- 172.21.15.79:0/1206606320 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ac032440 con 0x7f60bc15e4d0 2024-04-25T02:13:38.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.952+0000 7f60baffd640 1 -- 172.21.15.79:0/1206606320 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac032810 con 0x7f60bc15e4d0 2024-04-25T02:13:38.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.952+0000 7f60c1f09640 1 -- 172.21.15.79:0/1206606320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60bc15e4d0 msgr2=0x7f60bc06bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:38.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.952+0000 7f60c1f09640 1 --2- 172.21.15.79:0/1206606320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60bc15e4d0 0x7f60bc06bc70 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0097a0 tx=0x7f60ac02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:13:38.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.952+0000 7f60c1f09640 1 -- 172.21.15.79:0/1206606320 shutdown_connections 2024-04-25T02:13:38.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.953+0000 7f60c1f09640 1 --2- 172.21.15.79:0/1206606320 >> v2:172.21.15.189:3300/0 conn(0x7f60bc0d2e20 0x7f60bc0cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:38.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.953+0000 7f60c1f09640 1 --2- 172.21.15.79:0/1206606320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60bc15e4d0 0x7f60bc06bc70 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:38.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.953+0000 7f60c1f09640 1 -- 172.21.15.79:0/1206606320 >> 172.21.15.79:0/1206606320 conn(0x7f60bc09d460 msgr2=0x7f60bc0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:38.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.953+0000 7f60c1f09640 1 -- 172.21.15.79:0/1206606320 shutdown_connections 2024-04-25T02:13:38.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.953+0000 7f60c1f09640 1 -- 172.21.15.79:0/1206606320 wait complete. 2024-04-25T02:13:38.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.954+0000 7f60c1f09640 1 Processor -- start 2024-04-25T02:13:38.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.954+0000 7f60c1f09640 1 -- start start 2024-04-25T02:13:38.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.954+0000 7f60c1f09640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60bc0b3570 0x7f60bc0b9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:38.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.954+0000 7f60c1f09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60bc0d2e20 0x7f60bc0b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:38.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.954+0000 7f60c1f09640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60bc15e4d0 0x7f60bc0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:38.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.954+0000 7f60c1f09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc0d2250 con 0x7f60bc0d2e20 2024-04-25T02:13:38.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.954+0000 7f60c1f09640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc0d20d0 con 0x7f60bc0b3570 2024-04-25T02:13:38.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.954+0000 7f60c1f09640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f60bc06c1b0 con 0x7f60bc15e4d0 2024-04-25T02:13:38.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60bc0d2e20 0x7f60bc0b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:38.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60bc0d2e20 0x7f60bc0b5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48086/0 (socket says 172.21.15.79:48086) 2024-04-25T02:13:38.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60b3fff640 1 -- 172.21.15.79:0/3500634877 learned_addr learned my addr 172.21.15.79:0/3500634877 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:38.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60bb7fe640 1 --2- 172.21.15.79:0/3500634877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60bc0b3570 0x7f60bc0b9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:38.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60bbfff640 1 --2- 172.21.15.79:0/3500634877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60bc15e4d0 0x7f60bc0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:38.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60b3fff640 1 -- 172.21.15.79:0/3500634877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60bc15e4d0 msgr2=0x7f60bc0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:38.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60b3fff640 1 --2- 172.21.15.79:0/3500634877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60bc15e4d0 0x7f60bc0cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:38.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60b3fff640 1 -- 172.21.15.79:0/3500634877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60bc0b3570 msgr2=0x7f60bc0b9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:38.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60b3fff640 1 --2- 172.21.15.79:0/3500634877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60bc0b3570 0x7f60bc0b9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:38.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60b3fff640 1 -- 172.21.15.79:0/3500634877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60bc0ce330 con 0x7f60bc0d2e20 2024-04-25T02:13:38.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60b3fff640 1 --2- 172.21.15.79:0/3500634877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60bc0d2e20 0x7f60bc0b5fc0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f60a400c4d0 tx=0x7f60a400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:38.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60b8ff9640 1 -- 172.21.15.79:0/3500634877 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a4018070 con 0x7f60bc0d2e20 2024-04-25T02:13:38.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60b8ff9640 1 -- 172.21.15.79:0/3500634877 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a4007500 con 0x7f60bc0d2e20 2024-04-25T02:13:38.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60c1f09640 1 -- 172.21.15.79:0/3500634877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60bc0cd550 con 0x7f60bc0d2e20 2024-04-25T02:13:38.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60b8ff9640 1 -- 172.21.15.79:0/3500634877 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a4004a20 con 0x7f60bc0d2e20 2024-04-25T02:13:38.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.955+0000 7f60c1f09640 1 -- 172.21.15.79:0/3500634877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60bc0cdb10 con 0x7f60bc0d2e20 2024-04-25T02:13:38.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.956+0000 7f60c1f09640 1 -- 172.21.15.79:0/3500634877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60bc0d23d0 con 0x7f60bc0d2e20 2024-04-25T02:13:38.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.957+0000 7f60b8ff9640 1 -- 172.21.15.79:0/3500634877 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f60a401b070 con 0x7f60bc0d2e20 2024-04-25T02:13:38.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.957+0000 7f60b8ff9640 1 --2- 172.21.15.79:0/3500634877 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f609c06be30 0x7f609c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:38.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.957+0000 7f60b8ff9640 1 -- 172.21.15.79:0/3500634877 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5029+0+0 (secure 0 0 0) 0x7f60a4089e60 con 0x7f60bc0d2e20 2024-04-25T02:13:38.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.957+0000 7f60bb7fe640 1 --2- 172.21.15.79:0/3500634877 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f609c06be30 0x7f609c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:38.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.958+0000 7f60bb7fe640 1 --2- 172.21.15.79:0/3500634877 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f609c06be30 0x7f609c06e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f60ac034000 tx=0x7f60ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:38.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:38.961+0000 7f60b8ff9640 1 -- 172.21.15.79:0/3500634877 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f60bc0d23d0 con 0x7f60bc0d2e20 2024-04-25T02:13:39.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:39.151+0000 7f60c1f09640 1 -- 172.21.15.79:0/3500634877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f60bc0690a0 con 0x7f60bc0d2e20 2024-04-25T02:13:40.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.017+0000 7f60b8ff9640 1 -- 172.21.15.79:0/3500634877 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v82) ==== 97+0+0 (secure 0 0 0) 0x7f60a4058460 con 0x7f60bc0d2e20 2024-04-25T02:13:40.023 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2024-04-25T02:13:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.019+0000 7f60c1f09640 1 -- 172.21.15.79:0/3500634877 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f609c06be30 msgr2=0x7f609c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.019+0000 7f60c1f09640 1 --2- 172.21.15.79:0/3500634877 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f609c06be30 0x7f609c06e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f60ac034000 tx=0x7f60ac02e000 comp rx=0 tx=0).stop 2024-04-25T02:13:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.019+0000 7f60c1f09640 1 -- 172.21.15.79:0/3500634877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60bc0d2e20 msgr2=0x7f60bc0b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.019+0000 7f60c1f09640 1 --2- 172.21.15.79:0/3500634877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60bc0d2e20 0x7f60bc0b5fc0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f60a400c4d0 tx=0x7f60a400c990 comp rx=0 tx=0).stop 2024-04-25T02:13:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.019+0000 7f60c1f09640 1 -- 172.21.15.79:0/3500634877 shutdown_connections 2024-04-25T02:13:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.019+0000 7f60c1f09640 1 --2- 172.21.15.79:0/3500634877 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f609c06be30 0x7f609c06e2f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.019+0000 7f60c1f09640 1 --2- 172.21.15.79:0/3500634877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60bc15e4d0 0x7f60bc0cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.019+0000 7f60c1f09640 1 --2- 172.21.15.79:0/3500634877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60bc0d2e20 0x7f60bc0b5fc0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.019+0000 7f60c1f09640 1 --2- 172.21.15.79:0/3500634877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60bc0b3570 0x7f60bc0b9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.019+0000 7f60c1f09640 1 -- 172.21.15.79:0/3500634877 >> 172.21.15.79:0/3500634877 conn(0x7f60bc09d460 msgr2=0x7f60bc15d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.019+0000 7f60c1f09640 1 -- 172.21.15.79:0/3500634877 shutdown_connections 2024-04-25T02:13:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.019+0000 7f60c1f09640 1 -- 172.21.15.79:0/3500634877 wait complete. 2024-04-25T02:13:40.038 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T02:13:40.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.132+0000 7fbf40f70640 1 Processor -- start 2024-04-25T02:13:40.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.132+0000 7fbf40f70640 1 -- start start 2024-04-25T02:13:40.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.133+0000 7fbf40f70640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf3c143bc0 0x7fbf3c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.133+0000 7fbf40f70640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbf3c06df50 0x7fbf3c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.133+0000 7fbf40f70640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf3c0b48e0 0x7fbf3c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.133+0000 7fbf40f70640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbf3c06e8f0 con 0x7fbf3c143bc0 2024-04-25T02:13:40.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.133+0000 7fbf40f70640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fbf3c072cb0 con 0x7fbf3c06df50 2024-04-25T02:13:40.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.133+0000 7fbf40f70640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbf3c15fa40 con 0x7fbf3c0b48e0 2024-04-25T02:13:40.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.133+0000 7fbf3a59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf3c143bc0 0x7fbf3c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.133+0000 7fbf3a59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf3c143bc0 0x7fbf3c15f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48088/0 (socket says 172.21.15.79:48088) 2024-04-25T02:13:40.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.133+0000 7fbf3a59c640 1 -- 172.21.15.79:0/3437057397 learned_addr learned my addr 172.21.15.79:0/3437057397 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:40.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.133+0000 7fbf3a59c640 1 -- 172.21.15.79:0/3437057397 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf3c0b48e0 msgr2=0x7fbf3c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:40.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.133+0000 7fbf3a59c640 1 --2- 172.21.15.79:0/3437057397 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf3c0b48e0 0x7fbf3c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.133+0000 7fbf3a59c640 1 -- 172.21.15.79:0/3437057397 >> v2:172.21.15.189:3300/0 conn(0x7fbf3c06df50 msgr2=0x7fbf3c06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:40.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.133+0000 7fbf3a59c640 1 --2- 172.21.15.79:0/3437057397 >> v2:172.21.15.189:3300/0 conn(0x7fbf3c06df50 0x7fbf3c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.133+0000 7fbf3a59c640 1 -- 172.21.15.79:0/3437057397 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3c071e00 con 0x7fbf3c143bc0 2024-04-25T02:13:40.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.134+0000 7fbf3a59c640 1 --2- 172.21.15.79:0/3437057397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c143bc0 0x7fbf3c15f500 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0cf960 tx=0x7fbf2c02c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a9de3c5bd3eb48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:40.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.134+0000 7fbf39d9b640 1 -- 172.21.15.79:0/3437057397 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c039070 con 0x7fbf3c143bc0 2024-04-25T02:13:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.134+0000 7fbf39d9b640 1 -- 172.21.15.79:0/3437057397 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2c034640 con 0x7fbf3c143bc0 2024-04-25T02:13:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.134+0000 7fbf39d9b640 1 -- 172.21.15.79:0/3437057397 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c034a10 con 0x7fbf3c143bc0 2024-04-25T02:13:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.134+0000 7fbf40f70640 1 -- 172.21.15.79:0/3437057397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c143bc0 msgr2=0x7fbf3c15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.134+0000 7fbf40f70640 1 --2- 172.21.15.79:0/3437057397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c143bc0 0x7fbf3c15f500 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0cf960 tx=0x7fbf2c02c350 comp rx=0 tx=0).stop 2024-04-25T02:13:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.134+0000 7fbf40f70640 1 -- 172.21.15.79:0/3437057397 shutdown_connections 2024-04-25T02:13:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.134+0000 7fbf40f70640 1 --2- 172.21.15.79:0/3437057397 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf3c0b48e0 0x7fbf3c0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.134+0000 7fbf40f70640 1 --2- 172.21.15.79:0/3437057397 >> v2:172.21.15.189:3300/0 conn(0x7fbf3c06df50 0x7fbf3c06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.134+0000 7fbf40f70640 1 --2- 172.21.15.79:0/3437057397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c143bc0 0x7fbf3c15f500 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.134+0000 7fbf40f70640 1 -- 172.21.15.79:0/3437057397 >> 172.21.15.79:0/3437057397 conn(0x7fbf3c0cfc80 msgr2=0x7fbf3c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.135+0000 7fbf40f70640 1 -- 172.21.15.79:0/3437057397 shutdown_connections 2024-04-25T02:13:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.135+0000 7fbf40f70640 1 -- 172.21.15.79:0/3437057397 wait complete. 2024-04-25T02:13:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.136+0000 7fbf40f70640 1 Processor -- start 2024-04-25T02:13:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.136+0000 7fbf40f70640 1 -- start start 2024-04-25T02:13:40.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.136+0000 7fbf40f70640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf3c06df50 0x7fbf3c141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.136+0000 7fbf40f70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c0b48e0 0x7fbf3c0a9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.136+0000 7fbf40f70640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf3c143bc0 0x7fbf3c15b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.136+0000 7fbf40f70640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c072660 con 0x7fbf3c0b48e0 2024-04-25T02:13:40.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.136+0000 7fbf40f70640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c072380 con 0x7fbf3c143bc0 2024-04-25T02:13:40.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.136+0000 7fbf40f70640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbf3c072940 con 0x7fbf3c06df50 2024-04-25T02:13:40.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf33fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c0b48e0 0x7fbf3c0a9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf33fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c0b48e0 0x7fbf3c0a9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48094/0 (socket says 172.21.15.79:48094) 2024-04-25T02:13:40.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf33fff640 1 -- 172.21.15.79:0/3856329511 learned_addr learned my addr 172.21.15.79:0/3856329511 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:40.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf3a59c640 1 --2- 172.21.15.79:0/3856329511 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf3c06df50 0x7fbf3c141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf3ad9d640 1 --2- 172.21.15.79:0/3856329511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf3c143bc0 0x7fbf3c15b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf33fff640 1 -- 172.21.15.79:0/3856329511 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf3c06df50 msgr2=0x7fbf3c141b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf33fff640 1 --2- 172.21.15.79:0/3856329511 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf3c06df50 0x7fbf3c141b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf33fff640 1 -- 172.21.15.79:0/3856329511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf3c143bc0 msgr2=0x7fbf3c15b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf33fff640 1 --2- 172.21.15.79:0/3856329511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf3c143bc0 0x7fbf3c15b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf33fff640 1 -- 172.21.15.79:0/3856329511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3c142a10 con 0x7fbf3c0b48e0 2024-04-25T02:13:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf33fff640 1 --2- 172.21.15.79:0/3856329511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c0b48e0 0x7fbf3c0a9cc0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400b440 tx=0x7fbf2400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf32ffd640 1 -- 172.21.15.79:0/3856329511 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24015020 con 0x7fbf3c0b48e0 2024-04-25T02:13:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf40f70640 1 -- 172.21.15.79:0/3856329511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf3c0aa3c0 con 0x7fbf3c0b48e0 2024-04-25T02:13:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf32ffd640 1 -- 172.21.15.79:0/3856329511 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf24011890 con 0x7fbf3c0b48e0 2024-04-25T02:13:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf32ffd640 1 -- 172.21.15.79:0/3856329511 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24011c80 con 0x7fbf3c0b48e0 2024-04-25T02:13:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.137+0000 7fbf40f70640 1 -- 172.21.15.79:0/3856329511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3c0aa980 con 0x7fbf3c0b48e0 2024-04-25T02:13:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.138+0000 7fbf40f70640 1 -- 172.21.15.79:0/3856329511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf3c0690a0 con 0x7fbf3c0b48e0 2024-04-25T02:13:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.139+0000 7fbf32ffd640 1 -- 172.21.15.79:0/3856329511 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf24018020 con 0x7fbf3c0b48e0 2024-04-25T02:13:40.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.139+0000 7fbf32ffd640 1 --2- 172.21.15.79:0/3856329511 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbf1c06be60 0x7fbf1c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.139+0000 7fbf32ffd640 1 -- 172.21.15.79:0/3856329511 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 4857+0+0 (secure 0 0 0) 0x7fbf2408ab50 con 0x7fbf3c0b48e0 2024-04-25T02:13:40.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.139+0000 7fbf3a59c640 1 --2- 172.21.15.79:0/3856329511 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbf1c06be60 0x7fbf1c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.139+0000 7fbf3a59c640 1 --2- 172.21.15.79:0/3856329511 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbf1c06be60 0x7fbf1c06e320 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c036000 tx=0x7fbf2c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:40.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.143+0000 7fbf32ffd640 1 -- 172.21.15.79:0/3856329511 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbf2401f020 con 0x7fbf3c0b48e0 2024-04-25T02:13:40.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.381+0000 7fbf40f70640 1 -- 172.21.15.79:0/3856329511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fbf3c1441f0 con 0x7fbf3c0b48e0 2024-04-25T02:13:40.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.381+0000 7fbf32ffd640 1 -- 172.21.15.79:0/3856329511 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7fbf2400d040 con 0x7fbf3c0b48e0 2024-04-25T02:13:40.388 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:40.388 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:13:40.388 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2024-04-25T02:13:40.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.388 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2024-04-25T02:13:40.388 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmkSfsJhAAEP9aqirUawsrrvVUkxkO0w==", 2024-04-25T02:13:40.388 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.388 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:13:40.388 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:13:40.388 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:13:40.388 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:13:40.388 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.389 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2024-04-25T02:13:40.389 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilm8wYYMhAA98c3h9c80Y9zYzVv+kY7qQ==", 2024-04-25T02:13:40.389 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.389 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:13:40.389 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:13:40.389 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:13:40.389 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:13:40.389 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.389 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2024-04-25T02:13:40.390 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmiqSiLRAAmCUWUrHC31tkg0dkXS54cA==", 2024-04-25T02:13:40.390 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.390 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:13:40.390 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:13:40.390 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:13:40.390 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:13:40.390 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.390 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2024-04-25T02:13:40.390 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmiPbkOBAA+rBwAypY5jrR3xafG9h1sw==", 2024-04-25T02:13:40.390 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.390 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:13:40.390 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:13:40.391 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:13:40.391 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:13:40.391 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.391 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2024-04-25T02:13:40.391 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDJuilmP1AdGBAAS0IkH2E3XQvkxA33GInm5w==", 2024-04-25T02:13:40.391 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.391 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:13:40.391 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:13:40.391 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:13:40.391 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.391 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDMuilm479HFhAA8iIjBC94pqHikS5kPHipCQ==", 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDPuilmE+k9FBAARX3P/kjt7ybeVHGGyYaWwg==", 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.393 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2024-04-25T02:13:40.393 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDSuilmUF41EhAA1HhTXWnhVwETe+4hxmxjFw==", 2024-04-25T02:13:40.393 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.393 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:13:40.393 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:13:40.393 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:13:40.393 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.393 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2024-04-25T02:13:40.393 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDYuilm2pisGRAAFBmWVAGib2guJobYooLQoA==", 2024-04-25T02:13:40.393 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.393 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:13:40.393 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:13:40.394 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:13:40.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.394 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2024-04-25T02:13:40.394 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDbuilm28m9FxAA8GOmzxRAlK6o/RTe+FpL7g==", 2024-04-25T02:13:40.394 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.394 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:13:40.394 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:13:40.394 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:13:40.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.394 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2024-04-25T02:13:40.394 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDeuilmzDRyFRAAKk7JWPVRxxE+B4OCJhaXvg==", 2024-04-25T02:13:40.395 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.395 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:13:40.395 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:13:40.395 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:13:40.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.395 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2024-04-25T02:13:40.395 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDhuilmQABhExAA40Inq4eg4oohO3tmNdCyPQ==", 2024-04-25T02:13:40.395 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.395 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:13:40.395 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:13:40.395 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:13:40.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g==", 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilm8EWZCRAAjRomNRANd7sC+tpYZ1uE6w==", 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:13:40.396 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:13:40.397 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:13:40.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.397 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2024-04-25T02:13:40.397 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmHUedBhAA84h2PNUgReBGQ3rubcEDsw==", 2024-04-25T02:13:40.397 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.397 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:13:40.397 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:13:40.397 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:13:40.397 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:13:40.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.397 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmCx4UDxAAZmQdQB8RdTMr2JKr7TMySg==", 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmFgdeDBAAu+VeVhknKsm+Gxzh5+qANg==", 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:13:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:13:40.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.399 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2024-04-25T02:13:40.399 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmXrLhIxAAiq13px9HksQtu+qjoRi1qQ==", 2024-04-25T02:13:40.399 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.399 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:13:40.399 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-04-25T02:13:40.399 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:13:40.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:13:40.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:40.399 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2024-04-25T02:13:40.399 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmV8dxIBAA8GX2T/ZqZF+3qDjtddh/ZQ==", 2024-04-25T02:13:40.400 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:13:40.400 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:13:40.400 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-04-25T02:13:40.400 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:13:40.400 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.400 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:40.400 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T02:13:40.400 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:13:40.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.383+0000 7fbf40f70640 1 -- 172.21.15.79:0/3856329511 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbf1c06be60 msgr2=0x7fbf1c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.383+0000 7fbf40f70640 1 --2- 172.21.15.79:0/3856329511 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbf1c06be60 0x7fbf1c06e320 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c036000 tx=0x7fbf2c030000 comp rx=0 tx=0).stop 2024-04-25T02:13:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.383+0000 7fbf40f70640 1 -- 172.21.15.79:0/3856329511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c0b48e0 msgr2=0x7fbf3c0a9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.383+0000 7fbf40f70640 1 --2- 172.21.15.79:0/3856329511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c0b48e0 0x7fbf3c0a9cc0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400b440 tx=0x7fbf2400b900 comp rx=0 tx=0).stop 2024-04-25T02:13:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.383+0000 7fbf40f70640 1 -- 172.21.15.79:0/3856329511 shutdown_connections 2024-04-25T02:13:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.383+0000 7fbf40f70640 1 --2- 172.21.15.79:0/3856329511 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbf1c06be60 0x7fbf1c06e320 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.383+0000 7fbf40f70640 1 --2- 172.21.15.79:0/3856329511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf3c143bc0 0x7fbf3c15b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.383+0000 7fbf40f70640 1 --2- 172.21.15.79:0/3856329511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf3c0b48e0 0x7fbf3c0a9cc0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.383+0000 7fbf40f70640 1 --2- 172.21.15.79:0/3856329511 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf3c06df50 0x7fbf3c141b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.383+0000 7fbf40f70640 1 -- 172.21.15.79:0/3856329511 >> 172.21.15.79:0/3856329511 conn(0x7fbf3c0cfc80 msgr2=0x7fbf3c0cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.383+0000 7fbf40f70640 1 -- 172.21.15.79:0/3856329511 shutdown_connections 2024-04-25T02:13:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.383+0000 7fbf40f70640 1 -- 172.21.15.79:0/3856329511 wait complete. 2024-04-25T02:13:40.403 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:13:40.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.493+0000 7f5d9c51d640 1 Processor -- start 2024-04-25T02:13:40.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.493+0000 7f5d9c51d640 1 -- start start 2024-04-25T02:13:40.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.494+0000 7f5d9c51d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d9415e4d0 0x7f5d9406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.494+0000 7f5d9c51d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5d940d2e20 0x7f5d940cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.494+0000 7f5d9c51d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d940d1660 con 0x7f5d940b3570 2024-04-25T02:13:40.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.494+0000 7f5d9c51d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f5d940d1380 con 0x7f5d940d2e20 2024-04-25T02:13:40.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.494+0000 7f5d9c51d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5d940cede0 con 0x7f5d9415e4d0 2024-04-25T02:13:40.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.494+0000 7f5d99ab8640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5d940b3570 0x7f5d940d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33154/0 (socket says 172.21.15.79:33154) 2024-04-25T02:13:40.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.494+0000 7f5d99ab8640 1 -- 172.21.15.79:0/814179593 learned_addr learned my addr 172.21.15.79:0/814179593 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:40.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d9a2b9640 1 --2- 172.21.15.79:0/814179593 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d9415e4d0 0x7f5d9406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d9aaba640 1 --2- 172.21.15.79:0/814179593 >> v2:172.21.15.189:3300/0 conn(0x7f5d940d2e20 0x7f5d940cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 -- 172.21.15.79:0/814179593 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4197252258 0 0) 0x7f5d940d1660 con 0x7f5d940b3570 2024-04-25T02:13:40.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 -- 172.21.15.79:0/814179593 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d80003520 con 0x7f5d940b3570 2024-04-25T02:13:40.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 -- 172.21.15.79:0/814179593 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3214403021 0 0) 0x7f5d80003520 con 0x7f5d940b3570 2024-04-25T02:13:40.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 -- 172.21.15.79:0/814179593 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d9415e4d0 msgr2=0x7f5d9406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:40.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 --2- 172.21.15.79:0/814179593 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d9415e4d0 0x7f5d9406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 -- 172.21.15.79:0/814179593 >> v2:172.21.15.189:3300/0 conn(0x7f5d940d2e20 msgr2=0x7f5d940cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:40.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 --2- 172.21.15.79:0/814179593 >> v2:172.21.15.189:3300/0 conn(0x7f5d940d2e20 0x7f5d940cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 -- 172.21.15.79:0/814179593 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d940cf0c0 con 0x7f5d940b3570 2024-04-25T02:13:40.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 -- 172.21.15.79:0/814179593 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f5d90001670 con 0x7f5d940b3570 2024-04-25T02:13:40.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 -- 172.21.15.79:0/814179593 >> v1:172.21.15.79:6789/0 conn(0x7f5d940b3570 legacy=0x7f5d940d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 --2- 172.21.15.79:0/814179593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d800039b0 0x7f5d80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 --2- 172.21.15.79:0/814179593 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d9415e4d0 0x7f5d80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 --2- 172.21.15.79:0/814179593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d80004d40 0x7f5d800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 -- 172.21.15.79:0/814179593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d940d1380 con 0x7f5d800039b0 2024-04-25T02:13:40.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 -- 172.21.15.79:0/814179593 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5d940cede0 con 0x7f5d80004d40 2024-04-25T02:13:40.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d992b7640 1 -- 172.21.15.79:0/814179593 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5d8000b9c0 con 0x7f5d9415e4d0 2024-04-25T02:13:40.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d9a2b9640 1 --2- 172.21.15.79:0/814179593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d800039b0 0x7f5d80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d99ab8640 1 --2- 172.21.15.79:0/814179593 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d9415e4d0 0x7f5d80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d9aaba640 1 --2- 172.21.15.79:0/814179593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d80004d40 0x7f5d800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d9a2b9640 1 -- 172.21.15.79:0/814179593 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d9415e4d0 msgr2=0x7f5d80004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:40.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d9a2b9640 1 --2- 172.21.15.79:0/814179593 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d9415e4d0 0x7f5d80004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d9a2b9640 1 -- 172.21.15.79:0/814179593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d80004d40 msgr2=0x7f5d800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:40.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d9a2b9640 1 --2- 172.21.15.79:0/814179593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d80004d40 0x7f5d800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.495+0000 7f5d9a2b9640 1 -- 172.21.15.79:0/814179593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d80003520 con 0x7f5d800039b0 2024-04-25T02:13:40.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.496+0000 7f5d9a2b9640 1 --2- 172.21.15.79:0/814179593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d800039b0 0x7f5d80003dd0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009ac0 tx=0x7f5d80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e16a75a0a643fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:40.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.496+0000 7f5d992b7640 1 -- 172.21.15.79:0/814179593 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84036070 con 0x7f5d800039b0 2024-04-25T02:13:40.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.496+0000 7f5d992b7640 1 -- 172.21.15.79:0/814179593 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d84031400 con 0x7f5d800039b0 2024-04-25T02:13:40.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.496+0000 7f5d992b7640 1 -- 172.21.15.79:0/814179593 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84009690 con 0x7f5d800039b0 2024-04-25T02:13:40.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.497+0000 7f5d9c51d640 1 -- 172.21.15.79:0/814179593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d800039b0 msgr2=0x7f5d80003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.497+0000 7f5d9c51d640 1 --2- 172.21.15.79:0/814179593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d800039b0 0x7f5d80003dd0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009ac0 tx=0x7f5d80005830 comp rx=0 tx=0).stop 2024-04-25T02:13:40.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.497+0000 7f5d9aaba640 1 -- 172.21.15.79:0/814179593 reap_dead start 2024-04-25T02:13:40.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.497+0000 7f5d9c51d640 1 -- 172.21.15.79:0/814179593 shutdown_connections 2024-04-25T02:13:40.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.497+0000 7f5d9c51d640 1 -- 172.21.15.79:0/814179593 >> 172.21.15.79:0/814179593 conn(0x7f5d9409d460 msgr2=0x7f5d940d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:40.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.497+0000 7f5d9c51d640 1 -- 172.21.15.79:0/814179593 shutdown_connections 2024-04-25T02:13:40.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.497+0000 7f5d9c51d640 1 -- 172.21.15.79:0/814179593 wait complete. 2024-04-25T02:13:40.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.498+0000 7f5d9c51d640 1 Processor -- start 2024-04-25T02:13:40.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.498+0000 7f5d9c51d640 1 -- start start 2024-04-25T02:13:40.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.498+0000 7f5d9c51d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d800039b0 0x7f5d940c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9c51d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d94151f40 0x7f5d94152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9c51d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d94152490 0x7f5d941534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9c51d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d940d2250 con 0x7f5d94152490 2024-04-25T02:13:40.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9c51d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5d940d20d0 con 0x7f5d94151f40 2024-04-25T02:13:40.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9c51d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5d940b3020 con 0x7f5d800039b0 2024-04-25T02:13:40.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9aaba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d94152490 0x7f5d941534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9aaba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d94152490 0x7f5d941534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48116/0 (socket says 172.21.15.79:48116) 2024-04-25T02:13:40.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9aaba640 1 -- 172.21.15.79:0/246770592 learned_addr learned my addr 172.21.15.79:0/246770592 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:40.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d99ab8640 1 --2- 172.21.15.79:0/246770592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d94151f40 0x7f5d94152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9a2b9640 1 --2- 172.21.15.79:0/246770592 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d800039b0 0x7f5d940c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9aaba640 1 -- 172.21.15.79:0/246770592 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d800039b0 msgr2=0x7f5d940c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9aaba640 1 --2- 172.21.15.79:0/246770592 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d800039b0 0x7f5d940c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9aaba640 1 -- 172.21.15.79:0/246770592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d94151f40 msgr2=0x7f5d94152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9aaba640 1 --2- 172.21.15.79:0/246770592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d94151f40 0x7f5d94152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9aaba640 1 -- 172.21.15.79:0/246770592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d94160890 con 0x7f5d94152490 2024-04-25T02:13:40.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d99ab8640 1 --2- 172.21.15.79:0/246770592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d94151f40 0x7f5d94152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:40.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9aaba640 1 --2- 172.21.15.79:0/246770592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d94152490 0x7f5d941534a0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f5d9408c7d0 tx=0x7f5d8c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:40.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d8affd640 1 -- 172.21.15.79:0/246770592 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c011de0 con 0x7f5d94152490 2024-04-25T02:13:40.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d8affd640 1 -- 172.21.15.79:0/246770592 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8c01b070 con 0x7f5d94152490 2024-04-25T02:13:40.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d8affd640 1 -- 172.21.15.79:0/246770592 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c003990 con 0x7f5d94152490 2024-04-25T02:13:40.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9c51d640 1 -- 172.21.15.79:0/246770592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d94160b70 con 0x7f5d94152490 2024-04-25T02:13:40.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.499+0000 7f5d9c51d640 1 -- 172.21.15.79:0/246770592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d94161130 con 0x7f5d94152490 2024-04-25T02:13:40.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.500+0000 7f5d9c51d640 1 -- 172.21.15.79:0/246770592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d940688f0 con 0x7f5d94152490 2024-04-25T02:13:40.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.501+0000 7f5d8affd640 1 -- 172.21.15.79:0/246770592 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d8c005d10 con 0x7f5d94152490 2024-04-25T02:13:40.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.501+0000 7f5d8affd640 1 --2- 172.21.15.79:0/246770592 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d7806be30 0x7f5d7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.501+0000 7f5d9a2b9640 1 --2- 172.21.15.79:0/246770592 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d7806be30 0x7f5d7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.501+0000 7f5d8affd640 1 -- 172.21.15.79:0/246770592 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 4857+0+0 (secure 0 0 0) 0x7f5d8c08afe0 con 0x7f5d94152490 2024-04-25T02:13:40.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.501+0000 7f5d9a2b9640 1 --2- 172.21.15.79:0/246770592 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d7806be30 0x7f5d7806e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5d84033000 tx=0x7f5d84008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:40.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.505+0000 7f5d8affd640 1 -- 172.21.15.79:0/246770592 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5d940688f0 con 0x7f5d94152490 2024-04-25T02:13:40.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-25T02:13:40.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.677+0000 7f5d9c51d640 1 -- 172.21.15.79:0/246770592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d940690a0 con 0x7f5d94152490 2024-04-25T02:13:40.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.678+0000 7f5d8affd640 1 -- 172.21.15.79:0/246770592 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+12904 (secure 0 0 0) 0x7f5d8c025020 con 0x7f5d94152490 2024-04-25T02:13:40.684 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:40.684 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":82,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:13:40.011531+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:13:40.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.680+0000 7f5d9c51d640 1 -- 172.21.15.79:0/246770592 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d7806be30 msgr2=0x7f5d7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.680+0000 7f5d9c51d640 1 --2- 172.21.15.79:0/246770592 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d7806be30 0x7f5d7806e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5d84033000 tx=0x7f5d84008030 comp rx=0 tx=0).stop 2024-04-25T02:13:40.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.680+0000 7f5d9c51d640 1 -- 172.21.15.79:0/246770592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d94152490 msgr2=0x7f5d941534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.680+0000 7f5d9c51d640 1 --2- 172.21.15.79:0/246770592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d94152490 0x7f5d941534a0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f5d9408c7d0 tx=0x7f5d8c0115a0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.680+0000 7f5d9c51d640 1 -- 172.21.15.79:0/246770592 shutdown_connections 2024-04-25T02:13:40.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.680+0000 7f5d9c51d640 1 --2- 172.21.15.79:0/246770592 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d7806be30 0x7f5d7806e2f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.680+0000 7f5d9c51d640 1 --2- 172.21.15.79:0/246770592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d94152490 0x7f5d941534a0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.680+0000 7f5d9c51d640 1 --2- 172.21.15.79:0/246770592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d94151f40 0x7f5d94152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.680+0000 7f5d9c51d640 1 --2- 172.21.15.79:0/246770592 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d800039b0 0x7f5d940c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.680+0000 7f5d9c51d640 1 -- 172.21.15.79:0/246770592 >> 172.21.15.79:0/246770592 conn(0x7f5d9409d460 msgr2=0x7f5d9415c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:40.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.680+0000 7f5d9c51d640 1 -- 172.21.15.79:0/246770592 shutdown_connections 2024-04-25T02:13:40.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.680+0000 7f5d9c51d640 1 -- 172.21.15.79:0/246770592 wait complete. 2024-04-25T02:13:40.698 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:13:40.698 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:13:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.792+0000 7eff0e310640 1 Processor -- start 2024-04-25T02:13:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.792+0000 7eff0e310640 1 -- start start 2024-04-25T02:13:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.793+0000 7eff0e310640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff0806b2f0 0x7eff080b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.793+0000 7eff0e310640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7eff080cf7a0 0x7eff0806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.793+0000 7eff0e310640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff0806bc10 con 0x7eff0806e6b0 2024-04-25T02:13:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.793+0000 7eff0e310640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7eff0815f830 con 0x7eff080cf7a0 2024-04-25T02:13:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.793+0000 7eff0e310640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7eff0815ec20 con 0x7eff0806b2f0 2024-04-25T02:13:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.793+0000 7eff077fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7eff080cf7a0 0x7eff0806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.793+0000 7eff077fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7eff080cf7a0 0x7eff0806b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48126/0 (socket says 172.21.15.79:48126) 2024-04-25T02:13:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.793+0000 7eff077fe640 1 -- 172.21.15.79:0/1722508731 learned_addr learned my addr 172.21.15.79:0/1722508731 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.793+0000 7eff07fff640 1 --2- 172.21.15.79:0/1722508731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff0806b2f0 0x7eff080b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.793+0000 7eff077fe640 1 -- 172.21.15.79:0/1722508731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff0806b2f0 msgr2=0x7eff080b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.793+0000 7eff077fe640 1 --2- 172.21.15.79:0/1722508731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff0806b2f0 0x7eff080b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.793+0000 7eff077fe640 1 -- 172.21.15.79:0/1722508731 >> v1:172.21.15.189:6789/0 conn(0x7eff0806e6b0 legacy=0x7eff080cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.793+0000 7eff077fe640 1 -- 172.21.15.79:0/1722508731 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0815ef00 con 0x7eff080cf7a0 2024-04-25T02:13:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.793+0000 7eff07fff640 1 --2- 172.21.15.79:0/1722508731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff0806b2f0 0x7eff080b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.794+0000 7eff077fe640 1 --2- 172.21.15.79:0/1722508731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff080cf7a0 0x7eff0806b6d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7efefc009870 tx=0x7efefc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d517caae459b4d03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.794+0000 7eff06ffd640 1 -- 172.21.15.79:0/1722508731 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc037070 con 0x7eff080cf7a0 2024-04-25T02:13:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.794+0000 7eff06ffd640 1 -- 172.21.15.79:0/1722508731 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efefc032440 con 0x7eff080cf7a0 2024-04-25T02:13:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.794+0000 7eff06ffd640 1 -- 172.21.15.79:0/1722508731 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc032810 con 0x7eff080cf7a0 2024-04-25T02:13:40.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.795+0000 7eff0e310640 1 -- 172.21.15.79:0/1722508731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff080cf7a0 msgr2=0x7eff0806b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.795+0000 7eff0e310640 1 --2- 172.21.15.79:0/1722508731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff080cf7a0 0x7eff0806b6d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7efefc009870 tx=0x7efefc02a180 comp rx=0 tx=0).stop 2024-04-25T02:13:40.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.795+0000 7eff0e310640 1 -- 172.21.15.79:0/1722508731 shutdown_connections 2024-04-25T02:13:40.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.795+0000 7eff0e310640 1 --2- 172.21.15.79:0/1722508731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff080cf7a0 0x7eff0806b6d0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.795+0000 7eff0e310640 1 --2- 172.21.15.79:0/1722508731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff0806b2f0 0x7eff080b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.795+0000 7eff0e310640 1 -- 172.21.15.79:0/1722508731 >> 172.21.15.79:0/1722508731 conn(0x7eff080b1cd0 msgr2=0x7eff080b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:40.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.795+0000 7eff0e310640 1 -- 172.21.15.79:0/1722508731 shutdown_connections 2024-04-25T02:13:40.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.795+0000 7eff0e310640 1 -- 172.21.15.79:0/1722508731 wait complete. 2024-04-25T02:13:40.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.796+0000 7eff0e310640 1 Processor -- start 2024-04-25T02:13:40.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.796+0000 7eff0e310640 1 -- start start 2024-04-25T02:13:40.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0e310640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff0806b2f0 0x7eff081f8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0e310640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff0806e6b0 0x7eff080cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0e310640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff080cf7a0 0x7eff0814de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0e310640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7eff0806cfe0 con 0x7eff080cf7a0 2024-04-25T02:13:40.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0e310640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7eff0815f4c0 con 0x7eff0806b2f0 2024-04-25T02:13:40.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0e310640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7eff0806d160 con 0x7eff0806e6b0 2024-04-25T02:13:40.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0c8ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff080cf7a0 0x7eff0814de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0c8ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff080cf7a0 0x7eff0814de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48130/0 (socket says 172.21.15.79:48130) 2024-04-25T02:13:40.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0c8ad640 1 -- 172.21.15.79:0/819856792 learned_addr learned my addr 172.21.15.79:0/819856792 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:40.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0c8ad640 1 -- 172.21.15.79:0/819856792 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff0806e6b0 msgr2=0x7eff080cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0c8ad640 1 --2- 172.21.15.79:0/819856792 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff0806e6b0 0x7eff080cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff07fff640 1 --2- 172.21.15.79:0/819856792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff0806b2f0 0x7eff081f8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0c8ad640 1 -- 172.21.15.79:0/819856792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff0806b2f0 msgr2=0x7eff081f8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0c8ad640 1 --2- 172.21.15.79:0/819856792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff0806b2f0 0x7eff081f8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0c8ad640 1 -- 172.21.15.79:0/819856792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff080c9010 con 0x7eff080cf7a0 2024-04-25T02:13:40.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0c8ad640 1 --2- 172.21.15.79:0/819856792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff080cf7a0 0x7eff0814de80 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7eff0000c700 tx=0x7eff0000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:40.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff04ff9640 1 -- 172.21.15.79:0/819856792 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00016020 con 0x7eff080cf7a0 2024-04-25T02:13:40.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff04ff9640 1 -- 172.21.15.79:0/819856792 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff0000aa50 con 0x7eff080cf7a0 2024-04-25T02:13:40.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0e310640 1 -- 172.21.15.79:0/819856792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff080adfc0 con 0x7eff080cf7a0 2024-04-25T02:13:40.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff04ff9640 1 -- 172.21.15.79:0/819856792 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0000ce10 con 0x7eff080cf7a0 2024-04-25T02:13:40.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.797+0000 7eff0e310640 1 -- 172.21.15.79:0/819856792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff080ada00 con 0x7eff080cf7a0 2024-04-25T02:13:40.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.798+0000 7eff0e310640 1 -- 172.21.15.79:0/819856792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff080690a0 con 0x7eff080cf7a0 2024-04-25T02:13:40.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.799+0000 7eff04ff9640 1 -- 172.21.15.79:0/819856792 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff00019020 con 0x7eff080cf7a0 2024-04-25T02:13:40.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.799+0000 7eff04ff9640 1 --2- 172.21.15.79:0/819856792 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efef406be30 0x7efef406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.799+0000 7eff04ff9640 1 -- 172.21.15.79:0/819856792 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 4857+0+0 (secure 0 0 0) 0x7eff0008ad50 con 0x7eff080cf7a0 2024-04-25T02:13:40.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.799+0000 7eff07fff640 1 --2- 172.21.15.79:0/819856792 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efef406be30 0x7efef406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.800+0000 7eff07fff640 1 --2- 172.21.15.79:0/819856792 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efef406be30 0x7efef406e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efef8008850 tx=0x7efef8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:40.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.804+0000 7eff04ff9640 1 -- 172.21.15.79:0/819856792 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7eff0008e030 con 0x7eff080cf7a0 2024-04-25T02:13:40.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.976+0000 7eff0e310640 1 -- 172.21.15.79:0/819856792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7eff080cf4f0 con 0x7eff080cf7a0 2024-04-25T02:13:40.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.976+0000 7eff04ff9640 1 -- 172.21.15.79:0/819856792 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7eff00020020 con 0x7eff080cf7a0 2024-04-25T02:13:40.982 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:13:40.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.978+0000 7eff0e310640 1 -- 172.21.15.79:0/819856792 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efef406be30 msgr2=0x7efef406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.978+0000 7eff0e310640 1 --2- 172.21.15.79:0/819856792 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efef406be30 0x7efef406e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efef8008850 tx=0x7efef8008040 comp rx=0 tx=0).stop 2024-04-25T02:13:40.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.978+0000 7eff0e310640 1 -- 172.21.15.79:0/819856792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff080cf7a0 msgr2=0x7eff0814de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.978+0000 7eff0e310640 1 --2- 172.21.15.79:0/819856792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff080cf7a0 0x7eff0814de80 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7eff0000c700 tx=0x7eff0000cbc0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.978+0000 7eff0e310640 1 -- 172.21.15.79:0/819856792 shutdown_connections 2024-04-25T02:13:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.978+0000 7eff0e310640 1 --2- 172.21.15.79:0/819856792 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efef406be30 0x7efef406e2f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.978+0000 7eff0e310640 1 --2- 172.21.15.79:0/819856792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff080cf7a0 0x7eff0814de80 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.978+0000 7eff0e310640 1 --2- 172.21.15.79:0/819856792 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff0806e6b0 0x7eff080cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.978+0000 7eff0e310640 1 --2- 172.21.15.79:0/819856792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff0806b2f0 0x7eff081f8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.978+0000 7eff0e310640 1 -- 172.21.15.79:0/819856792 >> 172.21.15.79:0/819856792 conn(0x7eff080b1cd0 msgr2=0x7eff080b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.978+0000 7eff0e310640 1 -- 172.21.15.79:0/819856792 shutdown_connections 2024-04-25T02:13:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:40.978+0000 7eff0e310640 1 -- 172.21.15.79:0/819856792 wait complete. 2024-04-25T02:13:40.995 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T02:13:41.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.086+0000 7f758d19e640 1 Processor -- start 2024-04-25T02:13:41.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.086+0000 7f758d19e640 1 -- start start 2024-04-25T02:13:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.087+0000 7f758d19e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7588161730 0x7f758806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.087+0000 7f758d19e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75880d0a40 0x7f75880ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.087+0000 7f758d19e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75880cc440 con 0x7f7588161b10 2024-04-25T02:13:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.087+0000 7f758d19e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f75880d0f50 con 0x7f75880d0a40 2024-04-25T02:13:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.087+0000 7f758d19e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f75880d1230 con 0x7f7588161730 2024-04-25T02:13:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.087+0000 7f758c99d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75880d0a40 0x7f75880ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.087+0000 7f758c99d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75880d0a40 0x7f75880ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48144/0 (socket says 172.21.15.79:48144) 2024-04-25T02:13:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.087+0000 7f75877fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7588161b10 0x7f758806f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33164/0 (socket says 172.21.15.79:33164) 2024-04-25T02:13:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.087+0000 7f758c99d640 1 -- 172.21.15.79:0/1818294974 learned_addr learned my addr 172.21.15.79:0/1818294974 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.087+0000 7f7587fff640 1 --2- 172.21.15.79:0/1818294974 >> v2:172.21.15.189:3300/0 conn(0x7f7588161730 0x7f758806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.088+0000 7f758c99d640 1 -- 172.21.15.79:0/1818294974 >> v2:172.21.15.189:3300/0 conn(0x7f7588161730 msgr2=0x7f758806f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.088+0000 7f758c99d640 1 --2- 172.21.15.79:0/1818294974 >> v2:172.21.15.189:3300/0 conn(0x7f7588161730 0x7f758806f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.088+0000 7f758c99d640 1 -- 172.21.15.79:0/1818294974 >> v1:172.21.15.79:6789/0 conn(0x7f7588161b10 legacy=0x7f758806f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.088+0000 7f758c99d640 1 -- 172.21.15.79:0/1818294974 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75880cc6e0 con 0x7f75880d0a40 2024-04-25T02:13:41.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.088+0000 7f7586ffd640 1 -- 172.21.15.79:0/1818294974 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 557953548 0 0) 0x7f75880cc440 con 0x7f7588161b10 2024-04-25T02:13:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.088+0000 7f758c99d640 1 --2- 172.21.15.79:0/1818294974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75880d0a40 0x7f75880ccee0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f7588072290 tx=0x7f758002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1791c0be65c40fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.088+0000 7f7586ffd640 1 -- 172.21.15.79:0/1818294974 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7580036070 con 0x7f75880d0a40 2024-04-25T02:13:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.088+0000 7f7586ffd640 1 -- 172.21.15.79:0/1818294974 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7580031600 con 0x7f75880d0a40 2024-04-25T02:13:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.088+0000 7f7586ffd640 1 -- 172.21.15.79:0/1818294974 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75800319d0 con 0x7f75880d0a40 2024-04-25T02:13:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.089+0000 7f758d19e640 1 -- 172.21.15.79:0/1818294974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75880d0a40 msgr2=0x7f75880ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.089+0000 7f758d19e640 1 --2- 172.21.15.79:0/1818294974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75880d0a40 0x7f75880ccee0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f7588072290 tx=0x7f758002a730 comp rx=0 tx=0).stop 2024-04-25T02:13:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.089+0000 7f758d19e640 1 -- 172.21.15.79:0/1818294974 shutdown_connections 2024-04-25T02:13:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.089+0000 7f758d19e640 1 --2- 172.21.15.79:0/1818294974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75880d0a40 0x7f75880ccee0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.089+0000 7f758d19e640 1 --2- 172.21.15.79:0/1818294974 >> v2:172.21.15.189:3300/0 conn(0x7f7588161730 0x7f758806f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.089+0000 7f758d19e640 1 -- 172.21.15.79:0/1818294974 >> 172.21.15.79:0/1818294974 conn(0x7f75880b3960 msgr2=0x7f75880b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:41.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.089+0000 7f758d19e640 1 -- 172.21.15.79:0/1818294974 shutdown_connections 2024-04-25T02:13:41.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.089+0000 7f758d19e640 1 -- 172.21.15.79:0/1818294974 wait complete. 2024-04-25T02:13:41.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.090+0000 7f758d19e640 1 Processor -- start 2024-04-25T02:13:41.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.090+0000 7f758d19e640 1 -- start start 2024-04-25T02:13:41.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.091+0000 7f758d19e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75880d0a40 0x7f75880b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.091+0000 7f758d19e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7588161730 0x7f75880b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.091+0000 7f758d19e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7588161b10 0x7f75881f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.091+0000 7f758d19e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f758806fdf0 con 0x7f75880d0a40 2024-04-25T02:13:41.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.091+0000 7f758d19e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f75880b46c0 con 0x7f7588161b10 2024-04-25T02:13:41.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.091+0000 7f758d19e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f758806ff70 con 0x7f7588161730 2024-04-25T02:13:41.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.091+0000 7f7587fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75880d0a40 0x7f75880b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.091+0000 7f7587fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75880d0a40 0x7f75880b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48154/0 (socket says 172.21.15.79:48154) 2024-04-25T02:13:41.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.091+0000 7f7587fff640 1 -- 172.21.15.79:0/2975644203 learned_addr learned my addr 172.21.15.79:0/2975644203 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:41.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.092+0000 7f758c99d640 1 --2- 172.21.15.79:0/2975644203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7588161b10 0x7f75881f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.092+0000 7f7587fff640 1 -- 172.21.15.79:0/2975644203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7588161730 msgr2=0x7f75880b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.092+0000 7f75877fe640 1 --2- 172.21.15.79:0/2975644203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7588161730 0x7f75880b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.092+0000 7f7587fff640 1 --2- 172.21.15.79:0/2975644203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7588161730 0x7f75880b0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.092+0000 7f7587fff640 1 -- 172.21.15.79:0/2975644203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7588161b10 msgr2=0x7f75881f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.092+0000 7f7587fff640 1 --2- 172.21.15.79:0/2975644203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7588161b10 0x7f75881f3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.092+0000 7f7587fff640 1 -- 172.21.15.79:0/2975644203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75880c7de0 con 0x7f75880d0a40 2024-04-25T02:13:41.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.092+0000 7f758c99d640 1 --2- 172.21.15.79:0/2975644203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7588161b10 0x7f75881f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:41.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.092+0000 7f7587fff640 1 --2- 172.21.15.79:0/2975644203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75880d0a40 0x7f75880b2b90 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f757800c7f0 tx=0x7f757800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:41.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.092+0000 7f7584ff9640 1 -- 172.21.15.79:0/2975644203 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7578015070 con 0x7f75880d0a40 2024-04-25T02:13:41.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.092+0000 7f7584ff9640 1 -- 172.21.15.79:0/2975644203 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7578004240 con 0x7f75880d0a40 2024-04-25T02:13:41.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.092+0000 7f7584ff9640 1 -- 172.21.15.79:0/2975644203 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7578007620 con 0x7f75880d0a40 2024-04-25T02:13:41.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.092+0000 7f758d19e640 1 -- 172.21.15.79:0/2975644203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75880c6d40 con 0x7f75880d0a40 2024-04-25T02:13:41.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.092+0000 7f758d19e640 1 -- 172.21.15.79:0/2975644203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75880c75e0 con 0x7f75880d0a40 2024-04-25T02:13:41.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.093+0000 7f758d19e640 1 -- 172.21.15.79:0/2975644203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f758809ff50 con 0x7f75880d0a40 2024-04-25T02:13:41.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.093+0000 7f7584ff9640 1 -- 172.21.15.79:0/2975644203 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f75780079d0 con 0x7f75880d0a40 2024-04-25T02:13:41.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.094+0000 7f7584ff9640 1 --2- 172.21.15.79:0/2975644203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f757406be60 0x7f757406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.094+0000 7f7584ff9640 1 -- 172.21.15.79:0/2975644203 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 4857+0+0 (secure 0 0 0) 0x7f757808aad0 con 0x7f75880d0a40 2024-04-25T02:13:41.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.094+0000 7f75877fe640 1 --2- 172.21.15.79:0/2975644203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f757406be60 0x7f757406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.094+0000 7f75877fe640 1 --2- 172.21.15.79:0/2975644203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f757406be60 0x7f757406e320 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f75880c8c30 tx=0x7f757c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:41.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.098+0000 7f7584ff9640 1 -- 172.21.15.79:0/2975644203 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7578059860 con 0x7f75880d0a40 2024-04-25T02:13:41.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.273+0000 7f758d19e640 1 -- 172.21.15.79:0/2975644203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f75880b7a70 con 0x7f75880d0a40 2024-04-25T02:13:41.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.274+0000 7f7584ff9640 1 -- 172.21.15.79:0/2975644203 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) ==== 84+0+65 (secure 0 0 0) 0x7f7578059160 con 0x7f75880d0a40 2024-04-25T02:13:41.280 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:41.280 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-04-25T02:13:41.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:13:41.280 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-04-25T02:13:41.280 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-04-25T02:13:41.280 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:13:41.281 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-04-25T02:13:41.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.276+0000 7f758d19e640 1 -- 172.21.15.79:0/2975644203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f757406be60 msgr2=0x7f757406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.276+0000 7f758d19e640 1 --2- 172.21.15.79:0/2975644203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f757406be60 0x7f757406e320 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f75880c8c30 tx=0x7f757c009040 comp rx=0 tx=0).stop 2024-04-25T02:13:41.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.276+0000 7f758d19e640 1 -- 172.21.15.79:0/2975644203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75880d0a40 msgr2=0x7f75880b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.276+0000 7f758d19e640 1 --2- 172.21.15.79:0/2975644203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75880d0a40 0x7f75880b2b90 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f757800c7f0 tx=0x7f757800ccb0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.276+0000 7f758d19e640 1 -- 172.21.15.79:0/2975644203 shutdown_connections 2024-04-25T02:13:41.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.276+0000 7f758d19e640 1 --2- 172.21.15.79:0/2975644203 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f757406be60 0x7f757406e320 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.276+0000 7f758d19e640 1 --2- 172.21.15.79:0/2975644203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7588161b10 0x7f75881f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.276+0000 7f758d19e640 1 --2- 172.21.15.79:0/2975644203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7588161730 0x7f75880b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.276+0000 7f758d19e640 1 --2- 172.21.15.79:0/2975644203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75880d0a40 0x7f75880b2b90 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.276+0000 7f758d19e640 1 -- 172.21.15.79:0/2975644203 >> 172.21.15.79:0/2975644203 conn(0x7f75880b3960 msgr2=0x7f75880d2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:41.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.276+0000 7f758d19e640 1 -- 172.21.15.79:0/2975644203 shutdown_connections 2024-04-25T02:13:41.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.276+0000 7f758d19e640 1 -- 172.21.15.79:0/2975644203 wait complete. 2024-04-25T02:13:41.293 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T02:13:41.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T02:13:41.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.388+0000 7f7169114640 1 Processor -- start 2024-04-25T02:13:41.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.388+0000 7f7169114640 1 -- start start 2024-04-25T02:13:41.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f7169114640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f716415f0e0 0x7f71640ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f7169114640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71640cf2e0 con 0x7f716413de20 2024-04-25T02:13:41.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f7169114640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71640cf5c0 con 0x7f71640cea10 2024-04-25T02:13:41.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f7169114640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f71640cf8a0 con 0x7f716415f0e0 2024-04-25T02:13:41.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f7162d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f716413de20 0x7f716415e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33176/0 (socket says 172.21.15.79:33176) 2024-04-25T02:13:41.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f7162d9d640 1 -- 172.21.15.79:0/524551645 learned_addr learned my addr 172.21.15.79:0/524551645 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:41.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f716259c640 1 -- 172.21.15.79:0/524551645 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1905245369 0 0) 0x7f71640cf2e0 con 0x7f716413de20 2024-04-25T02:13:41.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f716259c640 1 -- 172.21.15.79:0/524551645 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7150003520 con 0x7f716413de20 2024-04-25T02:13:41.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f715bfff640 1 --2- 172.21.15.79:0/524551645 >> v2:172.21.15.189:3300/0 conn(0x7f716415f0e0 0x7f71640ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f716259c640 1 -- 172.21.15.79:0/524551645 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1965374294 0 0) 0x7f7150003520 con 0x7f716413de20 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f716259c640 1 -- 172.21.15.79:0/524551645 >> v2:172.21.15.189:3300/0 conn(0x7f716415f0e0 msgr2=0x7f71640ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f716259c640 1 --2- 172.21.15.79:0/524551645 >> v2:172.21.15.189:3300/0 conn(0x7f716415f0e0 0x7f71640ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f716259c640 1 -- 172.21.15.79:0/524551645 >> v1:172.21.15.189:6789/0 conn(0x7f71640cea10 legacy=0x7f71640b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f716259c640 1 -- 172.21.15.79:0/524551645 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71640b2f40 con 0x7f716413de20 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f716259c640 1 -- 172.21.15.79:0/524551645 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f7154001670 con 0x7f716413de20 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f716259c640 1 -- 172.21.15.79:0/524551645 >> v1:172.21.15.79:6789/0 conn(0x7f716413de20 legacy=0x7f716415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f716259c640 1 --2- 172.21.15.79:0/524551645 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71500039b0 0x7f7150003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f716259c640 1 --2- 172.21.15.79:0/524551645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7150004800 0x7f7150004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f716259c640 1 --2- 172.21.15.79:0/524551645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71500051c0 0x7f715000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f716259c640 1 -- 172.21.15.79:0/524551645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71640cf8a0 con 0x7f7150004800 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f716259c640 1 -- 172.21.15.79:0/524551645 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f715000e370 con 0x7f71500051c0 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f716259c640 1 -- 172.21.15.79:0/524551645 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f715000e570 con 0x7f71500039b0 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.389+0000 7f715bfff640 1 --2- 172.21.15.79:0/524551645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7150004800 0x7f7150004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.390+0000 7f7162d9d640 1 --2- 172.21.15.79:0/524551645 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71500039b0 0x7f7150003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.390+0000 7f716359e640 1 --2- 172.21.15.79:0/524551645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71500051c0 0x7f715000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.390+0000 7f715bfff640 1 -- 172.21.15.79:0/524551645 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71500039b0 msgr2=0x7f7150003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.390+0000 7f715bfff640 1 --2- 172.21.15.79:0/524551645 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71500039b0 0x7f7150003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.390+0000 7f715bfff640 1 -- 172.21.15.79:0/524551645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71500051c0 msgr2=0x7f715000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.390+0000 7f715bfff640 1 --2- 172.21.15.79:0/524551645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71500051c0 0x7f715000dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.390+0000 7f715bfff640 1 -- 172.21.15.79:0/524551645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7150003520 con 0x7f7150004800 2024-04-25T02:13:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.390+0000 7f716359e640 1 --2- 172.21.15.79:0/524551645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71500051c0 0x7f715000dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.390+0000 7f716359e640 1 -- 172.21.15.79:0/524551645 reap_dead start 2024-04-25T02:13:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.390+0000 7f715bfff640 1 --2- 172.21.15.79:0/524551645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7150004800 0x7f7150004c80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f714c009a90 tx=0x7f7150005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfdbfe6848ed9bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.390+0000 7f716259c640 1 -- 172.21.15.79:0/524551645 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c036070 con 0x7f7150004800 2024-04-25T02:13:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.391+0000 7f716259c640 1 -- 172.21.15.79:0/524551645 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c031400 con 0x7f7150004800 2024-04-25T02:13:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.391+0000 7f716259c640 1 -- 172.21.15.79:0/524551645 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c009690 con 0x7f7150004800 2024-04-25T02:13:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.391+0000 7f7169114640 1 -- 172.21.15.79:0/524551645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7150004800 msgr2=0x7f7150004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.391+0000 7f7169114640 1 --2- 172.21.15.79:0/524551645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7150004800 0x7f7150004c80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f714c009a90 tx=0x7f7150005830 comp rx=0 tx=0).stop 2024-04-25T02:13:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.391+0000 7f7169114640 1 -- 172.21.15.79:0/524551645 shutdown_connections 2024-04-25T02:13:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.391+0000 7f7169114640 1 --2- 172.21.15.79:0/524551645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7150004800 0x7f7150004c80 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.391+0000 7f7169114640 1 -- 172.21.15.79:0/524551645 >> 172.21.15.79:0/524551645 conn(0x7f716406b4a0 msgr2=0x7f716406b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:41.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.391+0000 7f7169114640 1 -- 172.21.15.79:0/524551645 shutdown_connections 2024-04-25T02:13:41.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.391+0000 7f7169114640 1 -- 172.21.15.79:0/524551645 wait complete. 2024-04-25T02:13:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.392+0000 7f7169114640 1 Processor -- start 2024-04-25T02:13:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.392+0000 7f7169114640 1 -- start start 2024-04-25T02:13:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f7169114640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7150004800 0x7f7164072c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f7169114640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7164138ed0 0x7f7164152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f7169114640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71641545e0 0x7f716413f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f7169114640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71640cf000 con 0x7f7164138ed0 2024-04-25T02:13:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f7169114640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f71640cee80 con 0x7f71641545e0 2024-04-25T02:13:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f7169114640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f71640ce4d0 con 0x7f7150004800 2024-04-25T02:13:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f715bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7164138ed0 0x7f7164152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f715bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7164138ed0 0x7f7164152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48168/0 (socket says 172.21.15.79:48168) 2024-04-25T02:13:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f715bfff640 1 -- 172.21.15.79:0/1944096551 learned_addr learned my addr 172.21.15.79:0/1944096551 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f715bfff640 1 -- 172.21.15.79:0/1944096551 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7150004800 msgr2=0x7f7164072c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f715bfff640 1 --2- 172.21.15.79:0/1944096551 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7150004800 0x7f7164072c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f715bfff640 1 -- 172.21.15.79:0/1944096551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71641545e0 msgr2=0x7f716413f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f716359e640 1 --2- 172.21.15.79:0/1944096551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71641545e0 0x7f716413f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f715bfff640 1 --2- 172.21.15.79:0/1944096551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71641545e0 0x7f716413f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f715bfff640 1 -- 172.21.15.79:0/1944096551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7164153b60 con 0x7f7164138ed0 2024-04-25T02:13:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.393+0000 7f716359e640 1 --2- 172.21.15.79:0/1944096551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71641545e0 0x7f716413f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.394+0000 7f715bfff640 1 --2- 172.21.15.79:0/1944096551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7164138ed0 0x7f7164152270 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f714c034040 tx=0x7f714c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.394+0000 7f715b7fe640 1 -- 172.21.15.79:0/1944096551 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c03f020 con 0x7f7164138ed0 2024-04-25T02:13:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.394+0000 7f715b7fe640 1 -- 172.21.15.79:0/1944096551 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c037040 con 0x7f7164138ed0 2024-04-25T02:13:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.394+0000 7f7169114640 1 -- 172.21.15.79:0/1944096551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7164071e70 con 0x7f7164138ed0 2024-04-25T02:13:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.394+0000 7f715b7fe640 1 -- 172.21.15.79:0/1944096551 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c036070 con 0x7f7164138ed0 2024-04-25T02:13:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.394+0000 7f7169114640 1 -- 172.21.15.79:0/1944096551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7164153de0 con 0x7f7164138ed0 2024-04-25T02:13:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.395+0000 7f7169114640 1 -- 172.21.15.79:0/1944096551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71640690a0 con 0x7f7164138ed0 2024-04-25T02:13:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.395+0000 7f715b7fe640 1 -- 172.21.15.79:0/1944096551 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f714c042020 con 0x7f7164138ed0 2024-04-25T02:13:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.396+0000 7f715b7fe640 1 --2- 172.21.15.79:0/1944096551 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f714406be60 0x7f714406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.396+0000 7f7162d9d640 1 --2- 172.21.15.79:0/1944096551 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f714406be60 0x7f714406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.396+0000 7f715b7fe640 1 -- 172.21.15.79:0/1944096551 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 4857+0+0 (secure 0 0 0) 0x7f714c0aa870 con 0x7f7164138ed0 2024-04-25T02:13:41.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.396+0000 7f7162d9d640 1 --2- 172.21.15.79:0/1944096551 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f714406be60 0x7f714406e320 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7154001b60 tx=0x7f7154001af0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:41.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.400+0000 7f715b7fe640 1 -- 172.21.15.79:0/1944096551 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f714c049070 con 0x7f7164138ed0 2024-04-25T02:13:41.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:41.575+0000 7f7169114640 1 -- 172.21.15.79:0/1944096551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f71640b4f60 con 0x7f7164138ed0 2024-04-25T02:13:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.025+0000 7f715b7fe640 1 -- 172.21.15.79:0/1944096551 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) ==== 138+0+0 (secure 0 0 0) 0x7f7164153b60 con 0x7f7164138ed0 2024-04-25T02:13:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-04-25T02:13:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.027+0000 7f7169114640 1 -- 172.21.15.79:0/1944096551 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f714406be60 msgr2=0x7f714406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.027+0000 7f7169114640 1 --2- 172.21.15.79:0/1944096551 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f714406be60 0x7f714406e320 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7154001b60 tx=0x7f7154001af0 comp rx=0 tx=0).stop 2024-04-25T02:13:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.027+0000 7f7169114640 1 -- 172.21.15.79:0/1944096551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7164138ed0 msgr2=0x7f7164152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.027+0000 7f7169114640 1 --2- 172.21.15.79:0/1944096551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7164138ed0 0x7f7164152270 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f714c034040 tx=0x7f714c004730 comp rx=0 tx=0).stop 2024-04-25T02:13:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.027+0000 7f7169114640 1 -- 172.21.15.79:0/1944096551 shutdown_connections 2024-04-25T02:13:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.027+0000 7f7169114640 1 --2- 172.21.15.79:0/1944096551 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f714406be60 0x7f714406e320 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.027+0000 7f7169114640 1 --2- 172.21.15.79:0/1944096551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71641545e0 0x7f716413f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.027+0000 7f7169114640 1 --2- 172.21.15.79:0/1944096551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7164138ed0 0x7f7164152270 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.027+0000 7f7169114640 1 --2- 172.21.15.79:0/1944096551 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7150004800 0x7f7164072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.027+0000 7f7169114640 1 -- 172.21.15.79:0/1944096551 >> 172.21.15.79:0/1944096551 conn(0x7f716406b4a0 msgr2=0x7f716413b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.028+0000 7f7169114640 1 -- 172.21.15.79:0/1944096551 shutdown_connections 2024-04-25T02:13:42.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.028+0000 7f7169114640 1 -- 172.21.15.79:0/1944096551 wait complete. 2024-04-25T02:13:42.048 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T02:13:42.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.146+0000 7f427bb9d640 1 Processor -- start 2024-04-25T02:13:42.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.146+0000 7f427bb9d640 1 -- start start 2024-04-25T02:13:42.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.147+0000 7f427bb9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f42740cf200 0x7f42740cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:42.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.147+0000 7f427bb9d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4274162a40 0x7f427415ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:42.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.147+0000 7f427bb9d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f427415f4c0 con 0x7f427415ef40 2024-04-25T02:13:42.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.147+0000 7f427bb9d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4274162ec0 con 0x7f42740cf200 2024-04-25T02:13:42.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.147+0000 7f427bb9d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4274161ff0 con 0x7f4274162a40 2024-04-25T02:13:42.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.147+0000 7f4279939640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f42740cf200 0x7f42740cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:42.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.147+0000 7f4279939640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f42740cf200 0x7f42740cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48174/0 (socket says 172.21.15.79:48174) 2024-04-25T02:13:42.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.147+0000 7f4279939640 1 -- 172.21.15.79:0/3728112641 learned_addr learned my addr 172.21.15.79:0/3728112641 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:42.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.147+0000 7f4279138640 1 --2- 172.21.15.79:0/3728112641 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4274162a40 0x7f427415ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:42.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.147+0000 7f4279939640 1 -- 172.21.15.79:0/3728112641 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4274162a40 msgr2=0x7f427415ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:42.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.147+0000 7f4279939640 1 --2- 172.21.15.79:0/3728112641 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4274162a40 0x7f427415ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:42.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.147+0000 7f4279939640 1 -- 172.21.15.79:0/3728112641 >> v1:172.21.15.189:6789/0 conn(0x7f427415ef40 legacy=0x7f427406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:42.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.147+0000 7f4279939640 1 -- 172.21.15.79:0/3728112641 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427415f7a0 con 0x7f42740cf200 2024-04-25T02:13:42.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.148+0000 7f4279939640 1 --2- 172.21.15.79:0/3728112641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42740cf200 0x7f42740cf5e0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f4270009870 tx=0x7f427002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38ccabf32760358 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:42.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.148+0000 7f4278937640 1 -- 172.21.15.79:0/3728112641 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4270037070 con 0x7f42740cf200 2024-04-25T02:13:42.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.148+0000 7f4278937640 1 -- 172.21.15.79:0/3728112641 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4270032440 con 0x7f42740cf200 2024-04-25T02:13:42.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.148+0000 7f4278937640 1 -- 172.21.15.79:0/3728112641 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4270032810 con 0x7f42740cf200 2024-04-25T02:13:42.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.148+0000 7f427bb9d640 1 -- 172.21.15.79:0/3728112641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42740cf200 msgr2=0x7f42740cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:42.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.148+0000 7f427bb9d640 1 --2- 172.21.15.79:0/3728112641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42740cf200 0x7f42740cf5e0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f4270009870 tx=0x7f427002a210 comp rx=0 tx=0).stop 2024-04-25T02:13:42.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.148+0000 7f427bb9d640 1 -- 172.21.15.79:0/3728112641 shutdown_connections 2024-04-25T02:13:42.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.148+0000 7f427bb9d640 1 --2- 172.21.15.79:0/3728112641 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4274162a40 0x7f427415ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:42.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.148+0000 7f427bb9d640 1 --2- 172.21.15.79:0/3728112641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42740cf200 0x7f42740cf5e0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:42.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.148+0000 7f427bb9d640 1 -- 172.21.15.79:0/3728112641 >> 172.21.15.79:0/3728112641 conn(0x7f42740b1cd0 msgr2=0x7f42740b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:42.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.149+0000 7f427bb9d640 1 -- 172.21.15.79:0/3728112641 shutdown_connections 2024-04-25T02:13:42.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.149+0000 7f427bb9d640 1 -- 172.21.15.79:0/3728112641 wait complete. 2024-04-25T02:13:42.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.150+0000 7f427bb9d640 1 Processor -- start 2024-04-25T02:13:42.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.150+0000 7f427bb9d640 1 -- start start 2024-04-25T02:13:42.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.150+0000 7f427bb9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42740cf200 0x7f427409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:42.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.150+0000 7f427bb9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f427415ef40 0x7f42740c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:42.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.150+0000 7f427bb9d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4274162a40 0x7f4274159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:42.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.150+0000 7f427bb9d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f42740cec80 con 0x7f42740cf200 2024-04-25T02:13:42.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.150+0000 7f427bb9d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4274162520 con 0x7f427415ef40 2024-04-25T02:13:42.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.150+0000 7f427bb9d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f42740cee00 con 0x7f4274162a40 2024-04-25T02:13:42.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.150+0000 7f4279939640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42740cf200 0x7f427409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:42.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.151+0000 7f4279939640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42740cf200 0x7f427409aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48188/0 (socket says 172.21.15.79:48188) 2024-04-25T02:13:42.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.151+0000 7f4279939640 1 -- 172.21.15.79:0/2180480339 learned_addr learned my addr 172.21.15.79:0/2180480339 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:42.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.151+0000 7f427a13a640 1 --2- 172.21.15.79:0/2180480339 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4274162a40 0x7f4274159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:42.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.151+0000 7f4279138640 1 --2- 172.21.15.79:0/2180480339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f427415ef40 0x7f42740c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:42.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.151+0000 7f4279939640 1 -- 172.21.15.79:0/2180480339 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4274162a40 msgr2=0x7f4274159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:42.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.151+0000 7f4279939640 1 --2- 172.21.15.79:0/2180480339 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4274162a40 0x7f4274159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:42.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.151+0000 7f4279939640 1 -- 172.21.15.79:0/2180480339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f427415ef40 msgr2=0x7f42740c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:42.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.151+0000 7f4279939640 1 --2- 172.21.15.79:0/2180480339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f427415ef40 0x7f42740c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:42.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.151+0000 7f4279939640 1 -- 172.21.15.79:0/2180480339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42740b0530 con 0x7f42740cf200 2024-04-25T02:13:42.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.151+0000 7f4279939640 1 --2- 172.21.15.79:0/2180480339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42740cf200 0x7f427409aa70 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f4270000c00 tx=0x7f42700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:42.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.151+0000 7f426a7fc640 1 -- 172.21.15.79:0/2180480339 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4270041020 con 0x7f42740cf200 2024-04-25T02:13:42.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.151+0000 7f426a7fc640 1 -- 172.21.15.79:0/2180480339 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42700306c0 con 0x7f42740cf200 2024-04-25T02:13:42.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.151+0000 7f427bb9d640 1 -- 172.21.15.79:0/2180480339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427415fd80 con 0x7f42740cf200 2024-04-25T02:13:42.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.151+0000 7f426a7fc640 1 -- 172.21.15.79:0/2180480339 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4270037040 con 0x7f42740cf200 2024-04-25T02:13:42.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.151+0000 7f427bb9d640 1 -- 172.21.15.79:0/2180480339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4274160340 con 0x7f42740cf200 2024-04-25T02:13:42.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.152+0000 7f427bb9d640 1 -- 172.21.15.79:0/2180480339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42740690a0 con 0x7f42740cf200 2024-04-25T02:13:42.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.153+0000 7f426a7fc640 1 -- 172.21.15.79:0/2180480339 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4270044020 con 0x7f42740cf200 2024-04-25T02:13:42.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.153+0000 7f426a7fc640 1 --2- 172.21.15.79:0/2180480339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f425806be30 0x7f425806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:42.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.153+0000 7f426a7fc640 1 -- 172.21.15.79:0/2180480339 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5227+0+0 (secure 0 0 0) 0x7f42700ab830 con 0x7f42740cf200 2024-04-25T02:13:42.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.153+0000 7f4279138640 1 --2- 172.21.15.79:0/2180480339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f425806be30 0x7f425806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:42.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.154+0000 7f4279138640 1 --2- 172.21.15.79:0/2180480339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f425806be30 0x7f425806e2f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f42740cf850 tx=0x7f4264008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:42.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.157+0000 7f426a7fc640 1 -- 172.21.15.79:0/2180480339 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f427004b030 con 0x7f42740cf200 2024-04-25T02:13:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:42.329+0000 7f427bb9d640 1 -- 172.21.15.79:0/2180480339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f42740ce3c0 con 0x7f42740cf200 2024-04-25T02:13:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.033+0000 7f426a7fc640 1 -- 172.21.15.79:0/2180480339 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) ==== 170+0+0 (secure 0 0 0) 0x7f427007a5c0 con 0x7f42740cf200 2024-04-25T02:13:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-04-25T02:13:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.035+0000 7f427bb9d640 1 -- 172.21.15.79:0/2180480339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f425806be30 msgr2=0x7f425806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.035+0000 7f427bb9d640 1 --2- 172.21.15.79:0/2180480339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f425806be30 0x7f425806e2f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f42740cf850 tx=0x7f4264008040 comp rx=0 tx=0).stop 2024-04-25T02:13:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.035+0000 7f427bb9d640 1 -- 172.21.15.79:0/2180480339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42740cf200 msgr2=0x7f427409aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.035+0000 7f427bb9d640 1 --2- 172.21.15.79:0/2180480339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42740cf200 0x7f427409aa70 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f4270000c00 tx=0x7f42700046c0 comp rx=0 tx=0).stop 2024-04-25T02:13:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.036+0000 7f427bb9d640 1 -- 172.21.15.79:0/2180480339 shutdown_connections 2024-04-25T02:13:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.036+0000 7f427bb9d640 1 --2- 172.21.15.79:0/2180480339 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f425806be30 0x7f425806e2f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.036+0000 7f427bb9d640 1 --2- 172.21.15.79:0/2180480339 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4274162a40 0x7f4274159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.036+0000 7f427bb9d640 1 --2- 172.21.15.79:0/2180480339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f427415ef40 0x7f42740c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.036+0000 7f427bb9d640 1 --2- 172.21.15.79:0/2180480339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42740cf200 0x7f427409aa70 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.036+0000 7f427bb9d640 1 -- 172.21.15.79:0/2180480339 >> 172.21.15.79:0/2180480339 conn(0x7f42740b1cd0 msgr2=0x7f42740b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:43.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.036+0000 7f427bb9d640 1 -- 172.21.15.79:0/2180480339 shutdown_connections 2024-04-25T02:13:43.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.036+0000 7f427bb9d640 1 -- 172.21.15.79:0/2180480339 wait complete. 2024-04-25T02:13:43.065 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T02:13:43.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.159+0000 7f0a652fc640 1 Processor -- start 2024-04-25T02:13:43.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.159+0000 7f0a652fc640 1 -- start start 2024-04-25T02:13:43.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a652fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0a6015e6d0 0x7f0a600cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:43.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a652fc640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f0a600cf130 0x7f0a600d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:43.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a652fc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0a600b5610 0x7f0a600d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:43.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a652fc640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f0a600cf5f0 con 0x7f0a6015e6d0 2024-04-25T02:13:43.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a652fc640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f0a600cf8d0 con 0x7f0a600cf130 2024-04-25T02:13:43.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a652fc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0a600cfbb0 con 0x7f0a600b5610 2024-04-25T02:13:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a5effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0a6015e6d0 0x7f0a600cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a5effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0a6015e6d0 0x7f0a600cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48196/0 (socket says 172.21.15.79:48196) 2024-04-25T02:13:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a5effd640 1 -- 172.21.15.79:0/1549679102 learned_addr learned my addr 172.21.15.79:0/1549679102 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a5e7fc640 1 --2- 172.21.15.79:0/1549679102 >> v2:172.21.15.189:3300/0 conn(0x7f0a600cf130 0x7f0a600d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a5f7fe640 1 --2- 172.21.15.79:0/1549679102 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0a600b5610 0x7f0a600d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a5effd640 1 -- 172.21.15.79:0/1549679102 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0a600b5610 msgr2=0x7f0a600d2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a5effd640 1 --2- 172.21.15.79:0/1549679102 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0a600b5610 0x7f0a600d2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a5effd640 1 -- 172.21.15.79:0/1549679102 >> v2:172.21.15.189:3300/0 conn(0x7f0a600cf130 msgr2=0x7f0a600d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a5effd640 1 --2- 172.21.15.79:0/1549679102 >> v2:172.21.15.189:3300/0 conn(0x7f0a600cf130 0x7f0a600d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a5effd640 1 -- 172.21.15.79:0/1549679102 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a600cfe90 con 0x7f0a6015e6d0 2024-04-25T02:13:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a5e7fc640 1 --2- 172.21.15.79:0/1549679102 >> v2:172.21.15.189:3300/0 conn(0x7f0a600cf130 0x7f0a600d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.160+0000 7f0a5f7fe640 1 --2- 172.21.15.79:0/1549679102 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0a600b5610 0x7f0a600d2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.161+0000 7f0a5effd640 1 --2- 172.21.15.79:0/1549679102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a6015e6d0 0x7f0a600cebf0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f0a6008e5a0 tx=0x7f0a5002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac39e96eeb3404f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.161+0000 7f0a5dffb640 1 -- 172.21.15.79:0/1549679102 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a50036070 con 0x7f0a6015e6d0 2024-04-25T02:13:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.161+0000 7f0a5dffb640 1 -- 172.21.15.79:0/1549679102 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a50031600 con 0x7f0a6015e6d0 2024-04-25T02:13:43.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.161+0000 7f0a5dffb640 1 -- 172.21.15.79:0/1549679102 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a500319d0 con 0x7f0a6015e6d0 2024-04-25T02:13:43.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.162+0000 7f0a652fc640 1 -- 172.21.15.79:0/1549679102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a6015e6d0 msgr2=0x7f0a600cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:43.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.162+0000 7f0a652fc640 1 --2- 172.21.15.79:0/1549679102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a6015e6d0 0x7f0a600cebf0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f0a6008e5a0 tx=0x7f0a5002a6a0 comp rx=0 tx=0).stop 2024-04-25T02:13:43.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.162+0000 7f0a652fc640 1 -- 172.21.15.79:0/1549679102 shutdown_connections 2024-04-25T02:13:43.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.162+0000 7f0a652fc640 1 --2- 172.21.15.79:0/1549679102 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0a600b5610 0x7f0a600d2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.162+0000 7f0a652fc640 1 --2- 172.21.15.79:0/1549679102 >> v2:172.21.15.189:3300/0 conn(0x7f0a600cf130 0x7f0a600d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.162+0000 7f0a652fc640 1 --2- 172.21.15.79:0/1549679102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a6015e6d0 0x7f0a600cebf0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.162+0000 7f0a652fc640 1 -- 172.21.15.79:0/1549679102 >> 172.21.15.79:0/1549679102 conn(0x7f0a6009d3e0 msgr2=0x7f0a600d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.162+0000 7f0a652fc640 1 -- 172.21.15.79:0/1549679102 shutdown_connections 2024-04-25T02:13:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.162+0000 7f0a652fc640 1 -- 172.21.15.79:0/1549679102 wait complete. 2024-04-25T02:13:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.163+0000 7f0a652fc640 1 Processor -- start 2024-04-25T02:13:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.163+0000 7f0a652fc640 1 -- start start 2024-04-25T02:13:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a652fc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0a600b5610 0x7f0a600cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a652fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a600cf130 0x7f0a601522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a652fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a6015e6d0 0x7f0a600b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a652fc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0a600d0c00 con 0x7f0a600cf130 2024-04-25T02:13:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a652fc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0a600d0a80 con 0x7f0a6015e6d0 2024-04-25T02:13:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a652fc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0a600d0d80 con 0x7f0a600b5610 2024-04-25T02:13:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a5e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a600cf130 0x7f0a601522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a5e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a600cf130 0x7f0a601522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48206/0 (socket says 172.21.15.79:48206) 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a5e7fc640 1 -- 172.21.15.79:0/1309034175 learned_addr learned my addr 172.21.15.79:0/1309034175 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a5effd640 1 --2- 172.21.15.79:0/1309034175 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0a600b5610 0x7f0a600cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a5f7fe640 1 --2- 172.21.15.79:0/1309034175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a6015e6d0 0x7f0a600b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a5e7fc640 1 -- 172.21.15.79:0/1309034175 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0a600b5610 msgr2=0x7f0a600cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a5e7fc640 1 --2- 172.21.15.79:0/1309034175 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0a600b5610 0x7f0a600cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a5e7fc640 1 -- 172.21.15.79:0/1309034175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a6015e6d0 msgr2=0x7f0a600b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a5e7fc640 1 --2- 172.21.15.79:0/1309034175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a6015e6d0 0x7f0a600b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a5e7fc640 1 -- 172.21.15.79:0/1309034175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a600cba60 con 0x7f0a600cf130 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a5f7fe640 1 --2- 172.21.15.79:0/1309034175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a6015e6d0 0x7f0a600b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.164+0000 7f0a5e7fc640 1 --2- 172.21.15.79:0/1309034175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a600cf130 0x7f0a601522e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400c820 tx=0x7f0a5400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.165+0000 7f0a477fe640 1 -- 172.21.15.79:0/1309034175 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54015070 con 0x7f0a600cf130 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.165+0000 7f0a477fe640 1 -- 172.21.15.79:0/1309034175 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a54007a30 con 0x7f0a600cf130 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.165+0000 7f0a477fe640 1 -- 172.21.15.79:0/1309034175 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54007e00 con 0x7f0a600cf130 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.165+0000 7f0a652fc640 1 -- 172.21.15.79:0/1309034175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a600cbd40 con 0x7f0a600cf130 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.165+0000 7f0a652fc640 1 -- 172.21.15.79:0/1309034175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a600cc870 con 0x7f0a600cf130 2024-04-25T02:13:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.166+0000 7f0a652fc640 1 -- 172.21.15.79:0/1309034175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a600690a0 con 0x7f0a600cf130 2024-04-25T02:13:43.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.166+0000 7f0a477fe640 1 -- 172.21.15.79:0/1309034175 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a54018070 con 0x7f0a600cf130 2024-04-25T02:13:43.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.166+0000 7f0a477fe640 1 --2- 172.21.15.79:0/1309034175 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0a4c06be30 0x7f0a4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:43.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.167+0000 7f0a477fe640 1 -- 172.21.15.79:0/1309034175 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5609+0+0 (secure 0 0 0) 0x7f0a5408ad40 con 0x7f0a600cf130 2024-04-25T02:13:43.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.167+0000 7f0a5effd640 1 --2- 172.21.15.79:0/1309034175 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0a4c06be30 0x7f0a4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:43.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.167+0000 7f0a5effd640 1 --2- 172.21.15.79:0/1309034175 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0a4c06be30 0x7f0a4c06e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0a50033000 tx=0x7f0a50009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:43.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.171+0000 7f0a477fe640 1 -- 172.21.15.79:0/1309034175 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0a54059100 con 0x7f0a600cf130 2024-04-25T02:13:43.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:43.380+0000 7f0a652fc640 1 -- 172.21.15.79:0/1309034175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0a600cca40 con 0x7f0a600cf130 2024-04-25T02:13:44.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.045+0000 7f0a477fe640 1 -- 172.21.15.79:0/1309034175 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v45) ==== 174+0+0 (secure 0 0 0) 0x7f0a5405d400 con 0x7f0a600cf130 2024-04-25T02:13:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 12 and data pool 13 2024-04-25T02:13:44.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.057+0000 7f0a652fc640 1 -- 172.21.15.79:0/1309034175 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0a4c06be30 msgr2=0x7f0a4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.057+0000 7f0a652fc640 1 --2- 172.21.15.79:0/1309034175 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0a4c06be30 0x7f0a4c06e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0a50033000 tx=0x7f0a50009000 comp rx=0 tx=0).stop 2024-04-25T02:13:44.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.057+0000 7f0a652fc640 1 -- 172.21.15.79:0/1309034175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a600cf130 msgr2=0x7f0a601522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.057+0000 7f0a652fc640 1 --2- 172.21.15.79:0/1309034175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a600cf130 0x7f0a601522e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400c820 tx=0x7f0a5400cc20 comp rx=0 tx=0).stop 2024-04-25T02:13:44.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.057+0000 7f0a652fc640 1 -- 172.21.15.79:0/1309034175 shutdown_connections 2024-04-25T02:13:44.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.057+0000 7f0a652fc640 1 --2- 172.21.15.79:0/1309034175 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0a4c06be30 0x7f0a4c06e2f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.057+0000 7f0a652fc640 1 --2- 172.21.15.79:0/1309034175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a6015e6d0 0x7f0a600b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.057+0000 7f0a652fc640 1 --2- 172.21.15.79:0/1309034175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a600cf130 0x7f0a601522e0 secure :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400c820 tx=0x7f0a5400cc20 comp rx=0 tx=0).stop 2024-04-25T02:13:44.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.057+0000 7f0a652fc640 1 --2- 172.21.15.79:0/1309034175 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0a600b5610 0x7f0a600cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.057+0000 7f0a652fc640 1 -- 172.21.15.79:0/1309034175 >> 172.21.15.79:0/1309034175 conn(0x7f0a6009d3e0 msgr2=0x7f0a600b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:44.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.060+0000 7f0a652fc640 1 -- 172.21.15.79:0/1309034175 shutdown_connections 2024-04-25T02:13:44.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.060+0000 7f0a652fc640 1 -- 172.21.15.79:0/1309034175 wait complete. 2024-04-25T02:13:44.084 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:13:44.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.177+0000 7f21442b2640 1 Processor -- start 2024-04-25T02:13:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.177+0000 7f21442b2640 1 -- start start 2024-04-25T02:13:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.178+0000 7f21442b2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f213c15e440 0x7f213c0d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.178+0000 7f21442b2640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f213c0d4570 0x7f213c0cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.178+0000 7f21442b2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f213c0cfdc0 con 0x7f213c0cf5d0 2024-04-25T02:13:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.178+0000 7f21442b2640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f213c0d49b0 con 0x7f213c0d4570 2024-04-25T02:13:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.178+0000 7f21442b2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f213c0d00a0 con 0x7f213c15e440 2024-04-25T02:13:44.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.179+0000 7f214204e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f213c15e440 0x7f213c0d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.179+0000 7f214204e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f213c15e440 0x7f213c0d4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:37384/0 (socket says 172.21.15.79:37384) 2024-04-25T02:13:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.179+0000 7f214184d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f213c0d4570 0x7f213c0cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.179+0000 7f214204e640 1 -- 172.21.15.79:0/2329640024 learned_addr learned my addr 172.21.15.79:0/2329640024 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.179+0000 7f214204e640 1 -- 172.21.15.79:0/2329640024 >> v2:172.21.15.189:3300/0 conn(0x7f213c0d4570 msgr2=0x7f213c0cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.179+0000 7f214204e640 1 --2- 172.21.15.79:0/2329640024 >> v2:172.21.15.189:3300/0 conn(0x7f213c0d4570 0x7f213c0cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.179+0000 7f214204e640 1 -- 172.21.15.79:0/2329640024 >> v1:172.21.15.189:6789/0 conn(0x7f213c0cf5d0 legacy=0x7f213c0d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.179+0000 7f214204e640 1 -- 172.21.15.79:0/2329640024 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f213c0d0380 con 0x7f213c15e440 2024-04-25T02:13:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.179+0000 7f214184d640 1 --2- 172.21.15.79:0/2329640024 >> v2:172.21.15.189:3300/0 conn(0x7f213c0d4570 0x7f213c0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:13:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.180+0000 7f214204e640 1 --2- 172.21.15.79:0/2329640024 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f213c15e440 0x7f213c0d4030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2138009e50 tx=0x7f213802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5432bb52cc86fbf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.180+0000 7f214104c640 1 -- 172.21.15.79:0/2329640024 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138036070 con 0x7f213c15e440 2024-04-25T02:13:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.180+0000 7f214104c640 1 -- 172.21.15.79:0/2329640024 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2138031600 con 0x7f213c15e440 2024-04-25T02:13:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.180+0000 7f214104c640 1 -- 172.21.15.79:0/2329640024 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21380319d0 con 0x7f213c15e440 2024-04-25T02:13:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.180+0000 7f21442b2640 1 -- 172.21.15.79:0/2329640024 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f213c15e440 msgr2=0x7f213c0d4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.180+0000 7f21442b2640 1 --2- 172.21.15.79:0/2329640024 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f213c15e440 0x7f213c0d4030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2138009e50 tx=0x7f213802a710 comp rx=0 tx=0).stop 2024-04-25T02:13:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.180+0000 7f21442b2640 1 -- 172.21.15.79:0/2329640024 shutdown_connections 2024-04-25T02:13:44.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.180+0000 7f21442b2640 1 --2- 172.21.15.79:0/2329640024 >> v2:172.21.15.189:3300/0 conn(0x7f213c0d4570 0x7f213c0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.180+0000 7f21442b2640 1 --2- 172.21.15.79:0/2329640024 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f213c15e440 0x7f213c0d4030 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.180+0000 7f21442b2640 1 -- 172.21.15.79:0/2329640024 >> 172.21.15.79:0/2329640024 conn(0x7f213c08db50 msgr2=0x7f213c09d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:44.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.180+0000 7f21442b2640 1 -- 172.21.15.79:0/2329640024 shutdown_connections 2024-04-25T02:13:44.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.180+0000 7f21442b2640 1 -- 172.21.15.79:0/2329640024 wait complete. 2024-04-25T02:13:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.182+0000 7f21442b2640 1 Processor -- start 2024-04-25T02:13:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.182+0000 7f21442b2640 1 -- start start 2024-04-25T02:13:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.182+0000 7f21442b2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f213c0cf5d0 0x7f213c15cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.182+0000 7f21442b2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f213c0d4570 0x7f213c0b94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.182+0000 7f21442b2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f213c15e440 0x7f213c0cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.182+0000 7f21442b2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f213c0cfa20 con 0x7f213c0d4570 2024-04-25T02:13:44.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.182+0000 7f21442b2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f213c15e820 con 0x7f213c0cf5d0 2024-04-25T02:13:44.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.182+0000 7f21442b2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f213c0cfba0 con 0x7f213c15e440 2024-04-25T02:13:44.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.182+0000 7f214184d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f213c0d4570 0x7f213c0b94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.182+0000 7f214184d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f213c0d4570 0x7f213c0b94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33148/0 (socket says 172.21.15.79:33148) 2024-04-25T02:13:44.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.182+0000 7f214184d640 1 -- 172.21.15.79:0/3529878338 learned_addr learned my addr 172.21.15.79:0/3529878338 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:44.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.182+0000 7f214204e640 1 --2- 172.21.15.79:0/3529878338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f213c0cf5d0 0x7f213c15cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.183+0000 7f214284f640 1 --2- 172.21.15.79:0/3529878338 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f213c15e440 0x7f213c0cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.183+0000 7f214184d640 1 -- 172.21.15.79:0/3529878338 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f213c15e440 msgr2=0x7f213c0cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.183+0000 7f214184d640 1 --2- 172.21.15.79:0/3529878338 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f213c15e440 0x7f213c0cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.183+0000 7f214184d640 1 -- 172.21.15.79:0/3529878338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f213c0cf5d0 msgr2=0x7f213c15cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.183+0000 7f214184d640 1 --2- 172.21.15.79:0/3529878338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f213c0cf5d0 0x7f213c15cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.183+0000 7f214184d640 1 -- 172.21.15.79:0/3529878338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f213c160780 con 0x7f213c0d4570 2024-04-25T02:13:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.183+0000 7f214204e640 1 --2- 172.21.15.79:0/3529878338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f213c0cf5d0 0x7f213c15cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:13:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.183+0000 7f214184d640 1 --2- 172.21.15.79:0/3529878338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f213c0d4570 0x7f213c0b94b0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f212c00ebe0 tx=0x7f212c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.183+0000 7f2132ffd640 1 -- 172.21.15.79:0/3529878338 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c017070 con 0x7f213c0d4570 2024-04-25T02:13:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.183+0000 7f2132ffd640 1 -- 172.21.15.79:0/3529878338 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f212c00cc30 con 0x7f213c0d4570 2024-04-25T02:13:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.183+0000 7f21442b2640 1 -- 172.21.15.79:0/3529878338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f213c160a60 con 0x7f213c0d4570 2024-04-25T02:13:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.183+0000 7f2132ffd640 1 -- 172.21.15.79:0/3529878338 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c013470 con 0x7f213c0d4570 2024-04-25T02:13:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.183+0000 7f21442b2640 1 -- 172.21.15.79:0/3529878338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f213c0cb170 con 0x7f213c0d4570 2024-04-25T02:13:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.184+0000 7f21442b2640 1 -- 172.21.15.79:0/3529878338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f213c0690a0 con 0x7f213c0d4570 2024-04-25T02:13:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.184+0000 7f2132ffd640 1 -- 172.21.15.79:0/3529878338 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f212c01a070 con 0x7f213c0d4570 2024-04-25T02:13:44.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.185+0000 7f2132ffd640 1 --2- 172.21.15.79:0/3529878338 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f212006be30 0x7f212006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.185+0000 7f2132ffd640 1 -- 172.21.15.79:0/3529878338 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5709+0+0 (secure 0 0 0) 0x7f212c08b0a0 con 0x7f213c0d4570 2024-04-25T02:13:44.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.185+0000 7f214204e640 1 --2- 172.21.15.79:0/3529878338 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f212006be30 0x7f212006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.185+0000 7f214204e640 1 --2- 172.21.15.79:0/3529878338 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f212006be30 0x7f212006e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2138033000 tx=0x7f2138009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.189+0000 7f2132ffd640 1 -- 172.21.15.79:0/3529878338 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f212c059400 con 0x7f213c0d4570 2024-04-25T02:13:44.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.365+0000 7f21442b2640 1 -- 172.21.15.79:0/3529878338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f213c0d2460 con 0x7f213c0d4570 2024-04-25T02:13:44.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.366+0000 7f2132ffd640 1 -- 172.21.15.79:0/3529878338 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+16685 (secure 0 0 0) 0x7f212c05d700 con 0x7f213c0d4570 2024-04-25T02:13:44.372 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:44.373 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":85,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:13:43.382124+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:13:41.594939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T02:13:42.348770+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:13:44.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.368+0000 7f21442b2640 1 -- 172.21.15.79:0/3529878338 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f212006be30 msgr2=0x7f212006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.368+0000 7f21442b2640 1 --2- 172.21.15.79:0/3529878338 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f212006be30 0x7f212006e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2138033000 tx=0x7f2138009000 comp rx=0 tx=0).stop 2024-04-25T02:13:44.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.368+0000 7f21442b2640 1 -- 172.21.15.79:0/3529878338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f213c0d4570 msgr2=0x7f213c0b94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.368+0000 7f21442b2640 1 --2- 172.21.15.79:0/3529878338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f213c0d4570 0x7f213c0b94b0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f212c00ebe0 tx=0x7f212c00c520 comp rx=0 tx=0).stop 2024-04-25T02:13:44.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.368+0000 7f21442b2640 1 -- 172.21.15.79:0/3529878338 shutdown_connections 2024-04-25T02:13:44.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.368+0000 7f21442b2640 1 --2- 172.21.15.79:0/3529878338 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f212006be30 0x7f212006e2f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.368+0000 7f21442b2640 1 --2- 172.21.15.79:0/3529878338 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f213c15e440 0x7f213c0cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.368+0000 7f21442b2640 1 --2- 172.21.15.79:0/3529878338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f213c0d4570 0x7f213c0b94b0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.368+0000 7f21442b2640 1 --2- 172.21.15.79:0/3529878338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f213c0cf5d0 0x7f213c15cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.368+0000 7f21442b2640 1 -- 172.21.15.79:0/3529878338 >> 172.21.15.79:0/3529878338 conn(0x7f213c08db50 msgr2=0x7f213c06cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:44.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.368+0000 7f21442b2640 1 -- 172.21.15.79:0/3529878338 shutdown_connections 2024-04-25T02:13:44.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.368+0000 7f21442b2640 1 -- 172.21.15.79:0/3529878338 wait complete. 2024-04-25T02:13:44.385 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:13:44.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.475+0000 7f94f4563640 1 Processor -- start 2024-04-25T02:13:44.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.475+0000 7f94f4563640 1 -- start start 2024-04-25T02:13:44.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.476+0000 7f94f4563640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f94ec15e140 0x7f94ec066ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.476+0000 7f94f4563640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f94ec06b0b0 0x7f94ec0c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.476+0000 7f94f4563640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94ec0cea70 con 0x7f94ec15e520 2024-04-25T02:13:44.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.476+0000 7f94f4563640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f94ec067480 con 0x7f94ec06b0b0 2024-04-25T02:13:44.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.476+0000 7f94f4563640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f94ec0cf3a0 con 0x7f94ec15e140 2024-04-25T02:13:44.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.476+0000 7f94f2b00640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f94ec06b0b0 0x7f94ec0c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.476+0000 7f94f2b00640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f94ec06b0b0 0x7f94ec0c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33154/0 (socket says 172.21.15.79:33154) 2024-04-25T02:13:44.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.476+0000 7f94f2b00640 1 -- 172.21.15.79:0/451285167 learned_addr learned my addr 172.21.15.79:0/451285167 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:44.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.476+0000 7f94f22ff640 1 --2- 172.21.15.79:0/451285167 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f94ec15e140 0x7f94ec066ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.477+0000 7f94f2b00640 1 -- 172.21.15.79:0/451285167 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f94ec15e140 msgr2=0x7f94ec066ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:44.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.477+0000 7f94f2b00640 1 --2- 172.21.15.79:0/451285167 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f94ec15e140 0x7f94ec066ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.477+0000 7f94f2b00640 1 -- 172.21.15.79:0/451285167 >> v1:172.21.15.189:6789/0 conn(0x7f94ec15e520 legacy=0x7f94ec0af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:44.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.477+0000 7f94f2b00640 1 -- 172.21.15.79:0/451285167 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec0ced50 con 0x7f94ec06b0b0 2024-04-25T02:13:44.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.477+0000 7f94f2b00640 1 --2- 172.21.15.79:0/451285167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ec06b0b0 0x7f94ec0c97b0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009870 tx=0x7f94e402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d4557af7200531 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:44.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.477+0000 7f94f12fd640 1 -- 172.21.15.79:0/451285167 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e4037070 con 0x7f94ec06b0b0 2024-04-25T02:13:44.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.477+0000 7f94f12fd640 1 -- 172.21.15.79:0/451285167 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e4032440 con 0x7f94ec06b0b0 2024-04-25T02:13:44.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.477+0000 7f94f12fd640 1 -- 172.21.15.79:0/451285167 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e4032810 con 0x7f94ec06b0b0 2024-04-25T02:13:44.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.478+0000 7f94f4563640 1 -- 172.21.15.79:0/451285167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ec06b0b0 msgr2=0x7f94ec0c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.478+0000 7f94f4563640 1 --2- 172.21.15.79:0/451285167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ec06b0b0 0x7f94ec0c97b0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009870 tx=0x7f94e402a180 comp rx=0 tx=0).stop 2024-04-25T02:13:44.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.478+0000 7f94f4563640 1 -- 172.21.15.79:0/451285167 shutdown_connections 2024-04-25T02:13:44.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.478+0000 7f94f4563640 1 --2- 172.21.15.79:0/451285167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ec06b0b0 0x7f94ec0c97b0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.478+0000 7f94f4563640 1 --2- 172.21.15.79:0/451285167 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f94ec15e140 0x7f94ec066ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.478+0000 7f94f4563640 1 -- 172.21.15.79:0/451285167 >> 172.21.15.79:0/451285167 conn(0x7f94ec0ccee0 msgr2=0x7f94ec0cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:44.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.478+0000 7f94f4563640 1 -- 172.21.15.79:0/451285167 shutdown_connections 2024-04-25T02:13:44.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.478+0000 7f94f4563640 1 -- 172.21.15.79:0/451285167 wait complete. 2024-04-25T02:13:44.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.479+0000 7f94f4563640 1 Processor -- start 2024-04-25T02:13:44.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.479+0000 7f94f4563640 1 -- start start 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f4563640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ec06b0b0 0x7f94ec0b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f4563640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f94ec15e140 0x7f94ec156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f4563640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94ec15e520 0x7f94ec151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f4563640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec06b690 con 0x7f94ec06b0b0 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f4563640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec06b510 con 0x7f94ec15e520 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f4563640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f94ec06b810 con 0x7f94ec15e140 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f22ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ec06b0b0 0x7f94ec0b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f22ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ec06b0b0 0x7f94ec0b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33170/0 (socket says 172.21.15.79:33170) 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f22ff640 1 -- 172.21.15.79:0/504331749 learned_addr learned my addr 172.21.15.79:0/504331749 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f2b00640 1 --2- 172.21.15.79:0/504331749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94ec15e520 0x7f94ec151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f1afe640 1 --2- 172.21.15.79:0/504331749 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f94ec15e140 0x7f94ec156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f22ff640 1 -- 172.21.15.79:0/504331749 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f94ec15e140 msgr2=0x7f94ec156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f22ff640 1 --2- 172.21.15.79:0/504331749 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f94ec15e140 0x7f94ec156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f22ff640 1 -- 172.21.15.79:0/504331749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94ec15e520 msgr2=0x7f94ec151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f22ff640 1 --2- 172.21.15.79:0/504331749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94ec15e520 0x7f94ec151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f22ff640 1 -- 172.21.15.79:0/504331749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec160330 con 0x7f94ec06b0b0 2024-04-25T02:13:44.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.480+0000 7f94f22ff640 1 --2- 172.21.15.79:0/504331749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ec06b0b0 0x7f94ec0b3ae0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f94e8007f20 tx=0x7f94e800e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:44.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.481+0000 7f94e2ffd640 1 -- 172.21.15.79:0/504331749 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8014620 con 0x7f94ec06b0b0 2024-04-25T02:13:44.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.481+0000 7f94e2ffd640 1 -- 172.21.15.79:0/504331749 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e8019070 con 0x7f94ec06b0b0 2024-04-25T02:13:44.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.481+0000 7f94e2ffd640 1 -- 172.21.15.79:0/504331749 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8014a00 con 0x7f94ec06b0b0 2024-04-25T02:13:44.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.481+0000 7f94f4563640 1 -- 172.21.15.79:0/504331749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ec160610 con 0x7f94ec06b0b0 2024-04-25T02:13:44.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.481+0000 7f94f4563640 1 -- 172.21.15.79:0/504331749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ec0b35e0 con 0x7f94ec06b0b0 2024-04-25T02:13:44.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.482+0000 7f94f4563640 1 -- 172.21.15.79:0/504331749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94ec0cda10 con 0x7f94ec06b0b0 2024-04-25T02:13:44.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.482+0000 7f94e2ffd640 1 -- 172.21.15.79:0/504331749 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f94e8014ba0 con 0x7f94ec06b0b0 2024-04-25T02:13:44.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.482+0000 7f94e2ffd640 1 --2- 172.21.15.79:0/504331749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f94d006be30 0x7f94d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.482+0000 7f94f1afe640 1 --2- 172.21.15.79:0/504331749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f94d006be30 0x7f94d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.482+0000 7f94e2ffd640 1 -- 172.21.15.79:0/504331749 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5709+0+0 (secure 0 0 0) 0x7f94e808b740 con 0x7f94ec06b0b0 2024-04-25T02:13:44.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.483+0000 7f94f1afe640 1 --2- 172.21.15.79:0/504331749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f94d006be30 0x7f94d006e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f94dc006fd0 tx=0x7f94dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:44.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.487+0000 7f94e2ffd640 1 -- 172.21.15.79:0/504331749 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f94ec0cda10 con 0x7f94ec06b0b0 2024-04-25T02:13:44.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.658+0000 7f94f4563640 1 -- 172.21.15.79:0/504331749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94ec0690a0 con 0x7f94ec06b0b0 2024-04-25T02:13:44.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.660+0000 7f94e2ffd640 1 -- 172.21.15.79:0/504331749 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+16685 (secure 0 0 0) 0x7f94e805a180 con 0x7f94ec06b0b0 2024-04-25T02:13:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:44.666 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":85,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:13:43.382124+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:13:41.594939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T02:13:42.348770+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:13:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.662+0000 7f94f4563640 1 -- 172.21.15.79:0/504331749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f94d006be30 msgr2=0x7f94d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.662+0000 7f94f4563640 1 --2- 172.21.15.79:0/504331749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f94d006be30 0x7f94d006e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f94dc006fd0 tx=0x7f94dc008040 comp rx=0 tx=0).stop 2024-04-25T02:13:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.662+0000 7f94f4563640 1 -- 172.21.15.79:0/504331749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ec06b0b0 msgr2=0x7f94ec0b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.662+0000 7f94f4563640 1 --2- 172.21.15.79:0/504331749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ec06b0b0 0x7f94ec0b3ae0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f94e8007f20 tx=0x7f94e800e570 comp rx=0 tx=0).stop 2024-04-25T02:13:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.662+0000 7f94f4563640 1 -- 172.21.15.79:0/504331749 shutdown_connections 2024-04-25T02:13:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.662+0000 7f94f4563640 1 --2- 172.21.15.79:0/504331749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f94d006be30 0x7f94d006e2f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.662+0000 7f94f4563640 1 --2- 172.21.15.79:0/504331749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94ec15e520 0x7f94ec151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.662+0000 7f94f4563640 1 --2- 172.21.15.79:0/504331749 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f94ec15e140 0x7f94ec156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.662+0000 7f94f4563640 1 --2- 172.21.15.79:0/504331749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ec06b0b0 0x7f94ec0b3ae0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.662+0000 7f94f4563640 1 -- 172.21.15.79:0/504331749 >> 172.21.15.79:0/504331749 conn(0x7f94ec0ccee0 msgr2=0x7f94ec0cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:44.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.662+0000 7f94f4563640 1 -- 172.21.15.79:0/504331749 shutdown_connections 2024-04-25T02:13:44.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.662+0000 7f94f4563640 1 -- 172.21.15.79:0/504331749 wait complete. 2024-04-25T02:13:44.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T02:13:44.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.772+0000 7feb81e95640 1 Processor -- start 2024-04-25T02:13:44.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.772+0000 7feb81e95640 1 -- start start 2024-04-25T02:13:44.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.773+0000 7feb81e95640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feb7c0b41b0 0x7feb7c1605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.773+0000 7feb81e95640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feb7c06b770 0x7feb7c156610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.773+0000 7feb81e95640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb7c071cd0 con 0x7feb7c06b2f0 2024-04-25T02:13:44.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.773+0000 7feb81e95640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7feb7c156b50 con 0x7feb7c06b770 2024-04-25T02:13:44.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.773+0000 7feb81e95640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7feb7c071fb0 con 0x7feb7c0b41b0 2024-04-25T02:13:44.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.773+0000 7feb7bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feb7c06b770 0x7feb7c156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.773+0000 7feb7bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feb7c06b770 0x7feb7c156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33176/0 (socket says 172.21.15.79:33176) 2024-04-25T02:13:44.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.773+0000 7feb7bfff640 1 -- 172.21.15.79:0/2181224011 learned_addr learned my addr 172.21.15.79:0/2181224011 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:44.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.773+0000 7feb7b7fe640 1 --2- 172.21.15.79:0/2181224011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feb7c0b41b0 0x7feb7c1605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.773+0000 7feb7bfff640 1 -- 172.21.15.79:0/2181224011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feb7c0b41b0 msgr2=0x7feb7c1605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:44.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.773+0000 7feb7bfff640 1 --2- 172.21.15.79:0/2181224011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feb7c0b41b0 0x7feb7c1605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.773+0000 7feb7bfff640 1 -- 172.21.15.79:0/2181224011 >> v1:172.21.15.189:6789/0 conn(0x7feb7c06b2f0 legacy=0x7feb7c155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.773+0000 7feb7bfff640 1 -- 172.21.15.79:0/2181224011 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7c072290 con 0x7feb7c06b770 2024-04-25T02:13:44.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.774+0000 7feb7bfff640 1 --2- 172.21.15.79:0/2181224011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7c06b770 0x7feb7c156610 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7feb74009e50 tx=0x7feb7402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bebd04c1de9aab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:44.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.774+0000 7feb7a7fc640 1 -- 172.21.15.79:0/2181224011 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb74036070 con 0x7feb7c06b770 2024-04-25T02:13:44.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.774+0000 7feb7a7fc640 1 -- 172.21.15.79:0/2181224011 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb74031600 con 0x7feb7c06b770 2024-04-25T02:13:44.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.774+0000 7feb7a7fc640 1 -- 172.21.15.79:0/2181224011 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb740319d0 con 0x7feb7c06b770 2024-04-25T02:13:44.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.775+0000 7feb81e95640 1 -- 172.21.15.79:0/2181224011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7c06b770 msgr2=0x7feb7c156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.775+0000 7feb81e95640 1 --2- 172.21.15.79:0/2181224011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7c06b770 0x7feb7c156610 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7feb74009e50 tx=0x7feb7402a710 comp rx=0 tx=0).stop 2024-04-25T02:13:44.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.775+0000 7feb81e95640 1 -- 172.21.15.79:0/2181224011 shutdown_connections 2024-04-25T02:13:44.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.775+0000 7feb81e95640 1 --2- 172.21.15.79:0/2181224011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7c06b770 0x7feb7c156610 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.775+0000 7feb81e95640 1 --2- 172.21.15.79:0/2181224011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feb7c0b41b0 0x7feb7c1605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.775+0000 7feb81e95640 1 -- 172.21.15.79:0/2181224011 >> 172.21.15.79:0/2181224011 conn(0x7feb7c0b1cd0 msgr2=0x7feb7c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:44.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.775+0000 7feb81e95640 1 -- 172.21.15.79:0/2181224011 shutdown_connections 2024-04-25T02:13:44.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.775+0000 7feb81e95640 1 -- 172.21.15.79:0/2181224011 wait complete. 2024-04-25T02:13:44.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.776+0000 7feb81e95640 1 Processor -- start 2024-04-25T02:13:44.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.776+0000 7feb81e95640 1 -- start start 2024-04-25T02:13:44.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb81e95640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb7c06b2f0 0x7feb7c157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb81e95640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7c06b770 0x7feb7c155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb81e95640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feb7c0b41b0 0x7feb7c155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb81e95640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c160b10 con 0x7feb7c06b770 2024-04-25T02:13:44.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb81e95640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c06bbe0 con 0x7feb7c06b2f0 2024-04-25T02:13:44.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb81e95640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7feb7c072d70 con 0x7feb7c0b41b0 2024-04-25T02:13:44.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb7affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7c06b770 0x7feb7c155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb7affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7c06b770 0x7feb7c155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33188/0 (socket says 172.21.15.79:33188) 2024-04-25T02:13:44.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb7affd640 1 -- 172.21.15.79:0/2887037798 learned_addr learned my addr 172.21.15.79:0/2887037798 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:44.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb7bfff640 1 --2- 172.21.15.79:0/2887037798 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feb7c0b41b0 0x7feb7c155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb7b7fe640 1 --2- 172.21.15.79:0/2887037798 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb7c06b2f0 0x7feb7c157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb7affd640 1 -- 172.21.15.79:0/2887037798 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feb7c0b41b0 msgr2=0x7feb7c155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb7affd640 1 --2- 172.21.15.79:0/2887037798 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feb7c0b41b0 0x7feb7c155760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb7affd640 1 -- 172.21.15.79:0/2887037798 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb7c06b2f0 msgr2=0x7feb7c157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:44.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb7affd640 1 --2- 172.21.15.79:0/2887037798 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb7c06b2f0 0x7feb7c157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:44.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb7affd640 1 -- 172.21.15.79:0/2887037798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7c09aba0 con 0x7feb7c06b770 2024-04-25T02:13:44.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb7affd640 1 --2- 172.21.15.79:0/2887037798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7c06b770 0x7feb7c155220 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7feb7000c400 tx=0x7feb7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:44.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.777+0000 7feb63fff640 1 -- 172.21.15.79:0/2887037798 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb700052d0 con 0x7feb7c06b770 2024-04-25T02:13:44.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.778+0000 7feb63fff640 1 -- 172.21.15.79:0/2887037798 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb70005490 con 0x7feb7c06b770 2024-04-25T02:13:44.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.778+0000 7feb63fff640 1 -- 172.21.15.79:0/2887037798 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb70007260 con 0x7feb7c06b770 2024-04-25T02:13:44.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.778+0000 7feb81e95640 1 -- 172.21.15.79:0/2887037798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb7c09ae80 con 0x7feb7c06b770 2024-04-25T02:13:44.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.778+0000 7feb81e95640 1 -- 172.21.15.79:0/2887037798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb7c09b440 con 0x7feb7c06b770 2024-04-25T02:13:44.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.779+0000 7feb81e95640 1 -- 172.21.15.79:0/2887037798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb7c072fd0 con 0x7feb7c06b770 2024-04-25T02:13:44.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.779+0000 7feb63fff640 1 -- 172.21.15.79:0/2887037798 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb70007400 con 0x7feb7c06b770 2024-04-25T02:13:44.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.779+0000 7feb63fff640 1 --2- 172.21.15.79:0/2887037798 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7feb6806be30 0x7feb6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:44.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.779+0000 7feb63fff640 1 -- 172.21.15.79:0/2887037798 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5709+0+0 (secure 0 0 0) 0x7feb7008a310 con 0x7feb7c06b770 2024-04-25T02:13:44.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.779+0000 7feb7b7fe640 1 --2- 172.21.15.79:0/2887037798 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7feb6806be30 0x7feb6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:44.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.780+0000 7feb7b7fe640 1 --2- 172.21.15.79:0/2887037798 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7feb6806be30 0x7feb6806e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7feb6c006fd0 tx=0x7feb6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:44.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.784+0000 7feb63fff640 1 -- 172.21.15.79:0/2887037798 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7feb7c072fd0 con 0x7feb7c06b770 2024-04-25T02:13:44.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:44.993+0000 7feb81e95640 1 -- 172.21.15.79:0/2887037798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7feb7c0690a0 con 0x7feb7c06b770 2024-04-25T02:13:45.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:45.884+0000 7feb63fff640 1 -- 172.21.15.79:0/2887037798 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) ==== 118+0+0 (secure 0 0 0) 0x7feb70058d50 con 0x7feb7c06b770 2024-04-25T02:13:45.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:45.887+0000 7feb81e95640 1 -- 172.21.15.79:0/2887037798 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7feb6806be30 msgr2=0x7feb6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:45.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:45.887+0000 7feb81e95640 1 --2- 172.21.15.79:0/2887037798 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7feb6806be30 0x7feb6806e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7feb6c006fd0 tx=0x7feb6c008040 comp rx=0 tx=0).stop 2024-04-25T02:13:45.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:45.887+0000 7feb81e95640 1 -- 172.21.15.79:0/2887037798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7c06b770 msgr2=0x7feb7c155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:45.887+0000 7feb81e95640 1 --2- 172.21.15.79:0/2887037798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7c06b770 0x7feb7c155220 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7feb7000c400 tx=0x7feb7000c8c0 comp rx=0 tx=0).stop 2024-04-25T02:13:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:45.887+0000 7feb81e95640 1 -- 172.21.15.79:0/2887037798 shutdown_connections 2024-04-25T02:13:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:45.887+0000 7feb81e95640 1 --2- 172.21.15.79:0/2887037798 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7feb6806be30 0x7feb6806e2f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:45.887+0000 7feb81e95640 1 --2- 172.21.15.79:0/2887037798 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feb7c0b41b0 0x7feb7c155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:45.887+0000 7feb81e95640 1 --2- 172.21.15.79:0/2887037798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7c06b770 0x7feb7c155220 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:45.887+0000 7feb81e95640 1 --2- 172.21.15.79:0/2887037798 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb7c06b2f0 0x7feb7c157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:45.887+0000 7feb81e95640 1 -- 172.21.15.79:0/2887037798 >> 172.21.15.79:0/2887037798 conn(0x7feb7c0b1cd0 msgr2=0x7feb7c15a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:45.887+0000 7feb81e95640 1 -- 172.21.15.79:0/2887037798 shutdown_connections 2024-04-25T02:13:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:45.887+0000 7feb81e95640 1 -- 172.21.15.79:0/2887037798 wait complete. 2024-04-25T02:13:45.906 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T02:13:45.907 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T02:13:46.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.005+0000 7f85f26ee640 1 Processor -- start 2024-04-25T02:13:46.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.005+0000 7f85f26ee640 1 -- start start 2024-04-25T02:13:46.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.006+0000 7f85f26ee640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f85ec06e6b0 0x7f85ec0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:46.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.006+0000 7f85f26ee640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85ec15ec20 con 0x7f85ec06b2f0 2024-04-25T02:13:46.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.006+0000 7f85f26ee640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85ec15ef00 con 0x7f85ec0cf7a0 2024-04-25T02:13:46.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.006+0000 7f85f26ee640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f85ec15f830 con 0x7f85ec06e6b0 2024-04-25T02:13:46.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.006+0000 7f85ebfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f85ec06b2f0 0x7f85ec06b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41816/0 (socket says 172.21.15.79:41816) 2024-04-25T02:13:46.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.006+0000 7f85ebfff640 1 -- 172.21.15.79:0/155374898 learned_addr learned my addr 172.21.15.79:0/155374898 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:46.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.006+0000 7f85f0c8b640 1 --2- 172.21.15.79:0/155374898 >> v2:172.21.15.189:3300/0 conn(0x7f85ec06e6b0 0x7f85ec0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:46.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.006+0000 7f85eaffd640 1 -- 172.21.15.79:0/155374898 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3165149220 0 0) 0x7f85ec15ec20 con 0x7f85ec06b2f0 2024-04-25T02:13:46.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.006+0000 7f85eaffd640 1 -- 172.21.15.79:0/155374898 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85d4003520 con 0x7f85ec06b2f0 2024-04-25T02:13:46.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85eaffd640 1 -- 172.21.15.79:0/155374898 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3658534935 0 0) 0x7f85d4003520 con 0x7f85ec06b2f0 2024-04-25T02:13:46.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85eaffd640 1 -- 172.21.15.79:0/155374898 >> v2:172.21.15.189:3300/0 conn(0x7f85ec06e6b0 msgr2=0x7f85ec0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:46.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85eaffd640 1 --2- 172.21.15.79:0/155374898 >> v2:172.21.15.189:3300/0 conn(0x7f85ec06e6b0 0x7f85ec0b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:46.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85eaffd640 1 -- 172.21.15.79:0/155374898 >> v1:172.21.15.189:6789/0 conn(0x7f85ec0cf7a0 legacy=0x7f85ec15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:46.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85eaffd640 1 -- 172.21.15.79:0/155374898 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ec15f1e0 con 0x7f85ec06b2f0 2024-04-25T02:13:46.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85eaffd640 1 -- 172.21.15.79:0/155374898 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f85dc001670 con 0x7f85ec06b2f0 2024-04-25T02:13:46.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85eaffd640 1 -- 172.21.15.79:0/155374898 >> v1:172.21.15.79:6789/0 conn(0x7f85ec06b2f0 legacy=0x7f85ec06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:46.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85eaffd640 1 --2- 172.21.15.79:0/155374898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85d40039b0 0x7f85d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:46.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85eaffd640 1 --2- 172.21.15.79:0/155374898 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85d4004800 0x7f85d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:46.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85eaffd640 1 --2- 172.21.15.79:0/155374898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d40051c0 0x7f85d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:46.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85eaffd640 1 -- 172.21.15.79:0/155374898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec15f830 con 0x7f85d40051c0 2024-04-25T02:13:46.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85eaffd640 1 -- 172.21.15.79:0/155374898 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f85d400c160 con 0x7f85d40039b0 2024-04-25T02:13:46.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85eaffd640 1 -- 172.21.15.79:0/155374898 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f85d400c360 con 0x7f85d4004800 2024-04-25T02:13:46.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85f0c8b640 1 --2- 172.21.15.79:0/155374898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d40051c0 0x7f85d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:46.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85ebfff640 1 --2- 172.21.15.79:0/155374898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85d40039b0 0x7f85d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:46.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85eb7fe640 1 --2- 172.21.15.79:0/155374898 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85d4004800 0x7f85d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:46.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85f0c8b640 1 -- 172.21.15.79:0/155374898 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85d4004800 msgr2=0x7f85d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:46.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85f0c8b640 1 --2- 172.21.15.79:0/155374898 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85d4004800 0x7f85d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:46.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85f0c8b640 1 -- 172.21.15.79:0/155374898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85d40039b0 msgr2=0x7f85d4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:46.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85f0c8b640 1 --2- 172.21.15.79:0/155374898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85d40039b0 0x7f85d4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:46.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.007+0000 7f85f0c8b640 1 -- 172.21.15.79:0/155374898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d4003520 con 0x7f85d40051c0 2024-04-25T02:13:46.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.008+0000 7f85f0c8b640 1 -- 172.21.15.79:0/155374898 reap_dead start 2024-04-25T02:13:46.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.008+0000 7f85f0c8b640 1 --2- 172.21.15.79:0/155374898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d40051c0 0x7f85d400b9c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009fc0 tx=0x7f85d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3b9b10d398ef9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:46.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.008+0000 7f85eaffd640 1 -- 172.21.15.79:0/155374898 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4035020 con 0x7f85d40051c0 2024-04-25T02:13:46.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.008+0000 7f85eaffd640 1 -- 172.21.15.79:0/155374898 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e4003bd0 con 0x7f85d40051c0 2024-04-25T02:13:46.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.008+0000 7f85eaffd640 1 -- 172.21.15.79:0/155374898 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4009c10 con 0x7f85d40051c0 2024-04-25T02:13:46.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.008+0000 7f85f26ee640 1 -- 172.21.15.79:0/155374898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d40051c0 msgr2=0x7f85d400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:46.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.008+0000 7f85f26ee640 1 --2- 172.21.15.79:0/155374898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d40051c0 0x7f85d400b9c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009fc0 tx=0x7f85d4005830 comp rx=0 tx=0).stop 2024-04-25T02:13:46.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.008+0000 7f85f26ee640 1 -- 172.21.15.79:0/155374898 shutdown_connections 2024-04-25T02:13:46.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.008+0000 7f85f26ee640 1 --2- 172.21.15.79:0/155374898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d40051c0 0x7f85d400b9c0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:46.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.008+0000 7f85f26ee640 1 -- 172.21.15.79:0/155374898 >> 172.21.15.79:0/155374898 conn(0x7f85ec0b1cd0 msgr2=0x7f85ec0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:46.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.008+0000 7f85f26ee640 1 -- 172.21.15.79:0/155374898 shutdown_connections 2024-04-25T02:13:46.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.008+0000 7f85f26ee640 1 -- 172.21.15.79:0/155374898 wait complete. 2024-04-25T02:13:46.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.010+0000 7f85f26ee640 1 Processor -- start 2024-04-25T02:13:46.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.010+0000 7f85f26ee640 1 -- start start 2024-04-25T02:13:46.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85f26ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d40051c0 0x7f85ec0ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:46.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85f26ee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85ec15bce0 0x7f85ec15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:46.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85f26ee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85ec071290 0x7f85ec071710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:46.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85f26ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec06d160 con 0x7f85d40051c0 2024-04-25T02:13:46.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85f26ee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec06cfe0 con 0x7f85ec071290 2024-04-25T02:13:46.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85f26ee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f85ec0b4b50 con 0x7f85ec15bce0 2024-04-25T02:13:46.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85ebfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d40051c0 0x7f85ec0ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:46.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85ebfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d40051c0 0x7f85ec0ae400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33200/0 (socket says 172.21.15.79:33200) 2024-04-25T02:13:46.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85ebfff640 1 -- 172.21.15.79:0/2857610301 learned_addr learned my addr 172.21.15.79:0/2857610301 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:46.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85f0c8b640 1 --2- 172.21.15.79:0/2857610301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85ec071290 0x7f85ec071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:46.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85eb7fe640 1 --2- 172.21.15.79:0/2857610301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85ec15bce0 0x7f85ec15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:46.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85ebfff640 1 -- 172.21.15.79:0/2857610301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85ec15bce0 msgr2=0x7f85ec15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:46.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85ebfff640 1 --2- 172.21.15.79:0/2857610301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85ec15bce0 0x7f85ec15c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:46.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85ebfff640 1 -- 172.21.15.79:0/2857610301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85ec071290 msgr2=0x7f85ec071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:46.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85ebfff640 1 --2- 172.21.15.79:0/2857610301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85ec071290 0x7f85ec071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:46.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85ebfff640 1 -- 172.21.15.79:0/2857610301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ec1f0f00 con 0x7f85d40051c0 2024-04-25T02:13:46.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85ebfff640 1 --2- 172.21.15.79:0/2857610301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d40051c0 0x7f85ec0ae400 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f85dc004a90 tx=0x7f85dc004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:46.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85e8ff9640 1 -- 172.21.15.79:0/2857610301 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc01c070 con 0x7f85d40051c0 2024-04-25T02:13:46.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85e8ff9640 1 -- 172.21.15.79:0/2857610301 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85dc011ca0 con 0x7f85d40051c0 2024-04-25T02:13:46.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85e8ff9640 1 -- 172.21.15.79:0/2857610301 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc010040 con 0x7f85d40051c0 2024-04-25T02:13:46.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85f26ee640 1 -- 172.21.15.79:0/2857610301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ec0afeb0 con 0x7f85d40051c0 2024-04-25T02:13:46.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.011+0000 7f85f26ee640 1 -- 172.21.15.79:0/2857610301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ec0b0430 con 0x7f85d40051c0 2024-04-25T02:13:46.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.012+0000 7f85f26ee640 1 -- 172.21.15.79:0/2857610301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85ec0690a0 con 0x7f85d40051c0 2024-04-25T02:13:46.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.013+0000 7f85e8ff9640 1 -- 172.21.15.79:0/2857610301 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85dc01f070 con 0x7f85d40051c0 2024-04-25T02:13:46.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.013+0000 7f85e8ff9640 1 --2- 172.21.15.79:0/2857610301 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85d806be60 0x7f85d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:46.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.013+0000 7f85e8ff9640 1 -- 172.21.15.79:0/2857610301 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f85dc08cd40 con 0x7f85d40051c0 2024-04-25T02:13:46.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.013+0000 7f85eb7fe640 1 --2- 172.21.15.79:0/2857610301 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85d806be60 0x7f85d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:46.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.014+0000 7f85eb7fe640 1 --2- 172.21.15.79:0/2857610301 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85d806be60 0x7f85d806e320 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f85e0007fd0 tx=0x7f85e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:46.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.018+0000 7f85e8ff9640 1 -- 172.21.15.79:0/2857610301 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f85ec1f0f00 con 0x7f85d40051c0 2024-04-25T02:13:46.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:46.228+0000 7f85f26ee640 1 -- 172.21.15.79:0/2857610301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f85ec0cf4f0 con 0x7f85d40051c0 2024-04-25T02:13:47.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.057+0000 7f85e8ff9640 1 -- 172.21.15.79:0/2857610301 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7f85dc05b0a0 con 0x7f85d40051c0 2024-04-25T02:13:47.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.060+0000 7f85f26ee640 1 -- 172.21.15.79:0/2857610301 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85d806be60 msgr2=0x7f85d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.060+0000 7f85f26ee640 1 --2- 172.21.15.79:0/2857610301 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85d806be60 0x7f85d806e320 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f85e0007fd0 tx=0x7f85e0009040 comp rx=0 tx=0).stop 2024-04-25T02:13:47.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.060+0000 7f85f26ee640 1 -- 172.21.15.79:0/2857610301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d40051c0 msgr2=0x7f85ec0ae400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.060+0000 7f85f26ee640 1 --2- 172.21.15.79:0/2857610301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d40051c0 0x7f85ec0ae400 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f85dc004a90 tx=0x7f85dc004f50 comp rx=0 tx=0).stop 2024-04-25T02:13:47.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.060+0000 7f85f26ee640 1 -- 172.21.15.79:0/2857610301 shutdown_connections 2024-04-25T02:13:47.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.060+0000 7f85f26ee640 1 --2- 172.21.15.79:0/2857610301 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85d806be60 0x7f85d806e320 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.060+0000 7f85f26ee640 1 --2- 172.21.15.79:0/2857610301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85ec071290 0x7f85ec071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.060+0000 7f85f26ee640 1 --2- 172.21.15.79:0/2857610301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85ec15bce0 0x7f85ec15c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.060+0000 7f85f26ee640 1 --2- 172.21.15.79:0/2857610301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d40051c0 0x7f85ec0ae400 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.060+0000 7f85f26ee640 1 -- 172.21.15.79:0/2857610301 >> 172.21.15.79:0/2857610301 conn(0x7f85ec0b1cd0 msgr2=0x7f85ec0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:47.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.061+0000 7f85f26ee640 1 -- 172.21.15.79:0/2857610301 shutdown_connections 2024-04-25T02:13:47.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.061+0000 7f85f26ee640 1 -- 172.21.15.79:0/2857610301 wait complete. 2024-04-25T02:13:47.079 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T02:13:47.080 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:13:47.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.176+0000 7faddfc38640 1 Processor -- start 2024-04-25T02:13:47.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.176+0000 7faddfc38640 1 -- start start 2024-04-25T02:13:47.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.177+0000 7faddfc38640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fadd806e3b0 0x7fadd80b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.177+0000 7faddfc38640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd8071e00 con 0x7fadd8143bc0 2024-04-25T02:13:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.177+0000 7faddfc38640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd80720a0 con 0x7fadd806df50 2024-04-25T02:13:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.177+0000 7faddfc38640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fadd8072cb0 con 0x7fadd806e3b0 2024-04-25T02:13:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.177+0000 7faddd9d4640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fadd8143bc0 0x7fadd815f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41830/0 (socket says 172.21.15.79:41830) 2024-04-25T02:13:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.177+0000 7faddd9d4640 1 -- 172.21.15.79:0/3227598755 learned_addr learned my addr 172.21.15.79:0/3227598755 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.177+0000 7fadde1d5640 1 --2- 172.21.15.79:0/3227598755 >> v2:172.21.15.189:3300/0 conn(0x7fadd806e3b0 0x7fadd80b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.177+0000 7faddc9d2640 1 -- 172.21.15.79:0/3227598755 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3791586415 0 0) 0x7fadd8071e00 con 0x7fadd8143bc0 2024-04-25T02:13:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.177+0000 7faddc9d2640 1 -- 172.21.15.79:0/3227598755 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadc4003520 con 0x7fadd8143bc0 2024-04-25T02:13:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.177+0000 7faddc9d2640 1 -- 172.21.15.79:0/3227598755 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1576443797 0 0) 0x7fadc4003520 con 0x7fadd8143bc0 2024-04-25T02:13:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.177+0000 7fadde1d5640 1 -- 172.21.15.79:0/3227598755 >> v1:172.21.15.189:6789/0 conn(0x7fadd806df50 legacy=0x7fadd80b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.177+0000 7fadde1d5640 1 -- 172.21.15.79:0/3227598755 >> v1:172.21.15.79:6789/0 conn(0x7fadd8143bc0 legacy=0x7fadd815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.177+0000 7fadde1d5640 1 -- 172.21.15.79:0/3227598755 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd8072380 con 0x7fadd806e3b0 2024-04-25T02:13:47.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.178+0000 7fadde1d5640 1 --2- 172.21.15.79:0/3227598755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadd806e3b0 0x7fadd80b3440 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009d90 tx=0x7fadd002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46d02a117db46ccb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:47.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.178+0000 7faddc9d2640 1 -- 172.21.15.79:0/3227598755 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4001670 con 0x7fadd806e3b0 2024-04-25T02:13:47.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.178+0000 7faddc9d2640 1 -- 172.21.15.79:0/3227598755 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd0007540 con 0x7fadd806e3b0 2024-04-25T02:13:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.178+0000 7faddc9d2640 1 -- 172.21.15.79:0/3227598755 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0007910 con 0x7fadd806e3b0 2024-04-25T02:13:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.179+0000 7faddfc38640 1 -- 172.21.15.79:0/3227598755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadd806e3b0 msgr2=0x7fadd80b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.179+0000 7faddfc38640 1 --2- 172.21.15.79:0/3227598755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadd806e3b0 0x7fadd80b3440 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009d90 tx=0x7fadd002a5f0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.179+0000 7faddfc38640 1 -- 172.21.15.79:0/3227598755 shutdown_connections 2024-04-25T02:13:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.179+0000 7faddfc38640 1 --2- 172.21.15.79:0/3227598755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadd806e3b0 0x7fadd80b3440 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.179+0000 7faddfc38640 1 -- 172.21.15.79:0/3227598755 >> 172.21.15.79:0/3227598755 conn(0x7fadd80cfc80 msgr2=0x7fadd80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.179+0000 7faddfc38640 1 -- 172.21.15.79:0/3227598755 shutdown_connections 2024-04-25T02:13:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.179+0000 7faddfc38640 1 -- 172.21.15.79:0/3227598755 wait complete. 2024-04-25T02:13:47.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.180+0000 7faddfc38640 1 Processor -- start 2024-04-25T02:13:47.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.180+0000 7faddfc38640 1 -- start start 2024-04-25T02:13:47.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddfc38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadd806df50 0x7fadd8156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddfc38640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadd806e3b0 0x7fadd80b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddfc38640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadd8143bc0 0x7fadd80b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddfc38640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fadd806e840 con 0x7fadd806df50 2024-04-25T02:13:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddfc38640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fadd8072940 con 0x7fadd8143bc0 2024-04-25T02:13:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddfc38640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fadd8143fa0 con 0x7fadd806e3b0 2024-04-25T02:13:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddd9d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadd806df50 0x7fadd8156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddd9d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadd806df50 0x7fadd8156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33212/0 (socket says 172.21.15.79:33212) 2024-04-25T02:13:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddd9d4640 1 -- 172.21.15.79:0/1833915132 learned_addr learned my addr 172.21.15.79:0/1833915132 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7fadde1d5640 1 --2- 172.21.15.79:0/1833915132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadd8143bc0 0x7fadd80b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddd1d3640 1 --2- 172.21.15.79:0/1833915132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadd806e3b0 0x7fadd80b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddd9d4640 1 -- 172.21.15.79:0/1833915132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadd806e3b0 msgr2=0x7fadd80b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddd9d4640 1 --2- 172.21.15.79:0/1833915132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadd806e3b0 0x7fadd80b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddd9d4640 1 -- 172.21.15.79:0/1833915132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadd8143bc0 msgr2=0x7fadd80b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddd9d4640 1 --2- 172.21.15.79:0/1833915132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadd8143bc0 0x7fadd80b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddd9d4640 1 -- 172.21.15.79:0/1833915132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd813dbf0 con 0x7fadd806df50 2024-04-25T02:13:47.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7fadde1d5640 1 --2- 172.21.15.79:0/1833915132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadd8143bc0 0x7fadd80b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:47.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.181+0000 7faddd9d4640 1 --2- 172.21.15.79:0/1833915132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadd806df50 0x7fadd8156800 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fadd4001eb0 tx=0x7fadd400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:47.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.182+0000 7fadce7fc640 1 -- 172.21.15.79:0/1833915132 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4017070 con 0x7fadd806df50 2024-04-25T02:13:47.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.182+0000 7fadce7fc640 1 -- 172.21.15.79:0/1833915132 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd4005ad0 con 0x7fadd806df50 2024-04-25T02:13:47.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.182+0000 7faddfc38640 1 -- 172.21.15.79:0/1833915132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd80ac350 con 0x7fadd806df50 2024-04-25T02:13:47.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.182+0000 7fadce7fc640 1 -- 172.21.15.79:0/1833915132 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4007070 con 0x7fadd806df50 2024-04-25T02:13:47.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.182+0000 7faddfc38640 1 -- 172.21.15.79:0/1833915132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd80ac910 con 0x7fadd806df50 2024-04-25T02:13:47.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.183+0000 7faddfc38640 1 -- 172.21.15.79:0/1833915132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd80690a0 con 0x7fadd806df50 2024-04-25T02:13:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.183+0000 7fadce7fc640 1 -- 172.21.15.79:0/1833915132 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadd401a070 con 0x7fadd806df50 2024-04-25T02:13:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.183+0000 7fadce7fc640 1 --2- 172.21.15.79:0/1833915132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fadbc06be30 0x7fadbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.183+0000 7fadce7fc640 1 -- 172.21.15.79:0/1833915132 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7fadd408a340 con 0x7fadd806df50 2024-04-25T02:13:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.183+0000 7faddd1d3640 1 --2- 172.21.15.79:0/1833915132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fadbc06be30 0x7fadbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.184+0000 7faddd1d3640 1 --2- 172.21.15.79:0/1833915132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fadbc06be30 0x7fadbc06e2f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fadc8007fd0 tx=0x7fadc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:47.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.188+0000 7fadce7fc640 1 -- 172.21.15.79:0/1833915132 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fadd4058d80 con 0x7fadd806df50 2024-04-25T02:13:47.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.396+0000 7faddfc38640 1 -- 172.21.15.79:0/1833915132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadd8156d70 con 0x7fadd806df50 2024-04-25T02:13:47.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.396+0000 7fadce7fc640 1 -- 172.21.15.79:0/1833915132 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5189 (secure 0 0 0) 0x7fadd4058680 con 0x7fadd806df50 2024-04-25T02:13:47.402 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:47.403 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:13:46.229372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7416},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7416":{"gid":7416,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2290864495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2290864495},{"type":"v1","addr":"172.21.15.79:6837","nonce":2290864495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7416,"qdb_cluster":[7416]},"id":6}]} 2024-04-25T02:13:47.403 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 48 2024-04-25T02:13:47.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.398+0000 7faddfc38640 1 -- 172.21.15.79:0/1833915132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fadbc06be30 msgr2=0x7fadbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.398+0000 7faddfc38640 1 --2- 172.21.15.79:0/1833915132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fadbc06be30 0x7fadbc06e2f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fadc8007fd0 tx=0x7fadc8009040 comp rx=0 tx=0).stop 2024-04-25T02:13:47.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.398+0000 7faddfc38640 1 -- 172.21.15.79:0/1833915132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadd806df50 msgr2=0x7fadd8156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.398+0000 7faddfc38640 1 --2- 172.21.15.79:0/1833915132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadd806df50 0x7fadd8156800 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fadd4001eb0 tx=0x7fadd400cbe0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.398+0000 7faddfc38640 1 -- 172.21.15.79:0/1833915132 shutdown_connections 2024-04-25T02:13:47.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.398+0000 7faddfc38640 1 --2- 172.21.15.79:0/1833915132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fadbc06be30 0x7fadbc06e2f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.398+0000 7faddfc38640 1 --2- 172.21.15.79:0/1833915132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadd8143bc0 0x7fadd80b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.398+0000 7faddfc38640 1 --2- 172.21.15.79:0/1833915132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fadd806e3b0 0x7fadd80b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.398+0000 7faddfc38640 1 --2- 172.21.15.79:0/1833915132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadd806df50 0x7fadd8156800 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.398+0000 7faddfc38640 1 -- 172.21.15.79:0/1833915132 >> 172.21.15.79:0/1833915132 conn(0x7fadd80cfc80 msgr2=0x7fadd80ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:47.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.398+0000 7faddfc38640 1 -- 172.21.15.79:0/1833915132 shutdown_connections 2024-04-25T02:13:47.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.398+0000 7faddfc38640 1 -- 172.21.15.79:0/1833915132 wait complete. 2024-04-25T02:13:47.415 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:13:47.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.506+0000 7f597de4d640 1 Processor -- start 2024-04-25T02:13:47.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.506+0000 7f597de4d640 1 -- start start 2024-04-25T02:13:47.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.507+0000 7f597de4d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5978144cb0 0x7f59780b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.507+0000 7f597de4d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f597806e660 0x7f5978071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.507+0000 7f597de4d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5978070d90 con 0x7f59780b5580 2024-04-25T02:13:47.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.507+0000 7f597de4d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f59780cf130 con 0x7f5978144cb0 2024-04-25T02:13:47.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.507+0000 7f597de4d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f59780cf410 con 0x7f597806e660 2024-04-25T02:13:47.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.507+0000 7f59777fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5978144cb0 0x7f59780b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:47.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.507+0000 7f5977fff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f597806e660 0x7f5978071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:47.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.507+0000 7f596ffff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f59780b5580 0x7f597806df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:34220/0 (socket says 172.21.15.79:34220) 2024-04-25T02:13:47.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.507+0000 7f59777fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5978144cb0 0x7f59780b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:54010/0 (socket says 172.21.15.79:54010) 2024-04-25T02:13:47.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.507+0000 7f596ffff640 1 -- 172.21.15.79:0/3686901045 learned_addr learned my addr 172.21.15.79:0/3686901045 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:47.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.507+0000 7f59777fe640 1 -- 172.21.15.79:0/3686901045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f597806e660 msgr2=0x7f5978071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:47.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.507+0000 7f59777fe640 1 --2- 172.21.15.79:0/3686901045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f597806e660 0x7f5978071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.507+0000 7f59777fe640 1 -- 172.21.15.79:0/3686901045 >> v1:172.21.15.189:6789/0 conn(0x7f59780b5580 legacy=0x7f597806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.507+0000 7f59777fe640 1 -- 172.21.15.79:0/3686901045 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59780cf6f0 con 0x7f5978144cb0 2024-04-25T02:13:47.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.508+0000 7f59777fe640 1 --2- 172.21.15.79:0/3686901045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5978144cb0 0x7f59780b5040 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f59680097a0 tx=0x7f596802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b9d7009ebd8d50d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:47.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.508+0000 7f5976ffd640 1 -- 172.21.15.79:0/3686901045 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968037070 con 0x7f5978144cb0 2024-04-25T02:13:47.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.508+0000 7f5976ffd640 1 -- 172.21.15.79:0/3686901045 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f596802adb0 con 0x7f5978144cb0 2024-04-25T02:13:47.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.508+0000 7f5976ffd640 1 -- 172.21.15.79:0/3686901045 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968032660 con 0x7f5978144cb0 2024-04-25T02:13:47.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.509+0000 7f597de4d640 1 -- 172.21.15.79:0/3686901045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5978144cb0 msgr2=0x7f59780b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.509+0000 7f597de4d640 1 --2- 172.21.15.79:0/3686901045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5978144cb0 0x7f59780b5040 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f59680097a0 tx=0x7f596802a060 comp rx=0 tx=0).stop 2024-04-25T02:13:47.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.509+0000 7f597de4d640 1 -- 172.21.15.79:0/3686901045 shutdown_connections 2024-04-25T02:13:47.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.509+0000 7f597de4d640 1 --2- 172.21.15.79:0/3686901045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f597806e660 0x7f5978071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.509+0000 7f597de4d640 1 --2- 172.21.15.79:0/3686901045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5978144cb0 0x7f59780b5040 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.509+0000 7f597de4d640 1 -- 172.21.15.79:0/3686901045 >> 172.21.15.79:0/3686901045 conn(0x7f59780cfc80 msgr2=0x7f59780d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:47.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.509+0000 7f597de4d640 1 -- 172.21.15.79:0/3686901045 shutdown_connections 2024-04-25T02:13:47.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.509+0000 7f597de4d640 1 -- 172.21.15.79:0/3686901045 wait complete. 2024-04-25T02:13:47.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.510+0000 7f597de4d640 1 Processor -- start 2024-04-25T02:13:47.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.510+0000 7f597de4d640 1 -- start start 2024-04-25T02:13:47.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f597de4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f597806e660 0x7f5978140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f597de4d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59780b5580 0x7f59781e6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f597de4d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5978144cb0 0x7f5978143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f597de4d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5978145ab0 con 0x7f597806e660 2024-04-25T02:13:47.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f597de4d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5978145090 con 0x7f59780b5580 2024-04-25T02:13:47.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f597de4d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5978145c30 con 0x7f5978144cb0 2024-04-25T02:13:47.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f59777fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f597806e660 0x7f5978140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:47.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f59777fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f597806e660 0x7f5978140800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33218/0 (socket says 172.21.15.79:33218) 2024-04-25T02:13:47.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f59777fe640 1 -- 172.21.15.79:0/2021138241 learned_addr learned my addr 172.21.15.79:0/2021138241 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:47.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f596ffff640 1 --2- 172.21.15.79:0/2021138241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59780b5580 0x7f59781e6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:47.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f59777fe640 1 -- 172.21.15.79:0/2021138241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5978144cb0 msgr2=0x7f5978143860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f59777fe640 1 --2- 172.21.15.79:0/2021138241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5978144cb0 0x7f5978143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f59777fe640 1 -- 172.21.15.79:0/2021138241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59780b5580 msgr2=0x7f59781e6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f59777fe640 1 --2- 172.21.15.79:0/2021138241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59780b5580 0x7f59781e6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f59777fe640 1 -- 172.21.15.79:0/2021138241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597814baa0 con 0x7f597806e660 2024-04-25T02:13:47.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.511+0000 7f596ffff640 1 --2- 172.21.15.79:0/2021138241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59780b5580 0x7f59781e6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:47.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.512+0000 7f59777fe640 1 --2- 172.21.15.79:0/2021138241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f597806e660 0x7f5978140800 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f596802a0a0 tx=0x7f59680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:47.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.512+0000 7f5974ff9640 1 -- 172.21.15.79:0/2021138241 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968041070 con 0x7f597806e660 2024-04-25T02:13:47.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.512+0000 7f5974ff9640 1 -- 172.21.15.79:0/2021138241 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f596803c660 con 0x7f597806e660 2024-04-25T02:13:47.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.512+0000 7f597de4d640 1 -- 172.21.15.79:0/2021138241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f597814bd80 con 0x7f597806e660 2024-04-25T02:13:47.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.512+0000 7f5974ff9640 1 -- 172.21.15.79:0/2021138241 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968037040 con 0x7f597806e660 2024-04-25T02:13:47.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.512+0000 7f597de4d640 1 -- 172.21.15.79:0/2021138241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f597814c620 con 0x7f597806e660 2024-04-25T02:13:47.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.513+0000 7f597de4d640 1 -- 172.21.15.79:0/2021138241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f597814c170 con 0x7f597806e660 2024-04-25T02:13:47.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.513+0000 7f5974ff9640 1 -- 172.21.15.79:0/2021138241 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5968044070 con 0x7f597806e660 2024-04-25T02:13:47.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.513+0000 7f5974ff9640 1 --2- 172.21.15.79:0/2021138241 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f595806be30 0x7f595806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.514+0000 7f5974ff9640 1 -- 172.21.15.79:0/2021138241 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f59680ab480 con 0x7f597806e660 2024-04-25T02:13:47.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.514+0000 7f596ffff640 1 --2- 172.21.15.79:0/2021138241 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f595806be30 0x7f595806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:47.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.514+0000 7f596ffff640 1 --2- 172.21.15.79:0/2021138241 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f595806be30 0x7f595806e2f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f59780c4e00 tx=0x7f5960009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:47.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.518+0000 7f5974ff9640 1 -- 172.21.15.79:0/2021138241 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5968079e30 con 0x7f597806e660 2024-04-25T02:13:47.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.690+0000 7f597de4d640 1 -- 172.21.15.79:0/2021138241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59780d0b90 con 0x7f597806e660 2024-04-25T02:13:47.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.691+0000 7f5974ff9640 1 -- 172.21.15.79:0/2021138241 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16672 (secure 0 0 0) 0x7f5968079730 con 0x7f597806e660 2024-04-25T02:13:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:47.698 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":86,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:13:45.043216+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:13:41.594939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T02:13:42.348770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:13:47.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.693+0000 7f597de4d640 1 -- 172.21.15.79:0/2021138241 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f595806be30 msgr2=0x7f595806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.693+0000 7f597de4d640 1 --2- 172.21.15.79:0/2021138241 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f595806be30 0x7f595806e2f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f59780c4e00 tx=0x7f5960009040 comp rx=0 tx=0).stop 2024-04-25T02:13:47.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.693+0000 7f597de4d640 1 -- 172.21.15.79:0/2021138241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f597806e660 msgr2=0x7f5978140800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.693+0000 7f597de4d640 1 --2- 172.21.15.79:0/2021138241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f597806e660 0x7f5978140800 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f596802a0a0 tx=0x7f59680046c0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.693+0000 7f597de4d640 1 -- 172.21.15.79:0/2021138241 shutdown_connections 2024-04-25T02:13:47.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.693+0000 7f597de4d640 1 --2- 172.21.15.79:0/2021138241 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f595806be30 0x7f595806e2f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.693+0000 7f597de4d640 1 --2- 172.21.15.79:0/2021138241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5978144cb0 0x7f5978143860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.693+0000 7f597de4d640 1 --2- 172.21.15.79:0/2021138241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59780b5580 0x7f59781e6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.693+0000 7f597de4d640 1 --2- 172.21.15.79:0/2021138241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f597806e660 0x7f5978140800 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.693+0000 7f597de4d640 1 -- 172.21.15.79:0/2021138241 >> 172.21.15.79:0/2021138241 conn(0x7f59780cfc80 msgr2=0x7f5978071140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:47.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.694+0000 7f597de4d640 1 -- 172.21.15.79:0/2021138241 shutdown_connections 2024-04-25T02:13:47.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.694+0000 7f597de4d640 1 -- 172.21.15.79:0/2021138241 wait complete. 2024-04-25T02:13:47.711 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T02:13:47.711 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:13:47.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.801+0000 7ffb9dfe2640 1 Processor -- start 2024-04-25T02:13:47.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.801+0000 7ffb9dfe2640 1 -- start start 2024-04-25T02:13:47.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.802+0000 7ffb9dfe2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb98143bc0 0x7ffb9815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.802+0000 7ffb9dfe2640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ffb9806df50 0x7ffb9806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.802+0000 7ffb9dfe2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb9815fa40 con 0x7ffb980b48e0 2024-04-25T02:13:47.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.802+0000 7ffb9dfe2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ffb9806e8f0 con 0x7ffb98143bc0 2024-04-25T02:13:47.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.802+0000 7ffb9dfe2640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ffb98072cb0 con 0x7ffb9806df50 2024-04-25T02:13:47.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.802+0000 7ffb977fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb98143bc0 0x7ffb9815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.802+0000 7ffb977fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb98143bc0 0x7ffb9815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33220/0 (socket says 172.21.15.79:33220) 2024-04-25T02:13:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.802+0000 7ffb977fe640 1 -- 172.21.15.79:0/1491399697 learned_addr learned my addr 172.21.15.79:0/1491399697 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.802+0000 7ffb977fe640 1 -- 172.21.15.79:0/1491399697 >> v2:172.21.15.189:3300/0 conn(0x7ffb9806df50 msgr2=0x7ffb9806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.802+0000 7ffb96ffd640 1 --2- 172.21.15.79:0/1491399697 >> v2:172.21.15.189:3300/0 conn(0x7ffb9806df50 0x7ffb9806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.802+0000 7ffb977fe640 1 --2- 172.21.15.79:0/1491399697 >> v2:172.21.15.189:3300/0 conn(0x7ffb9806df50 0x7ffb9806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.802+0000 7ffb977fe640 1 -- 172.21.15.79:0/1491399697 >> v1:172.21.15.189:6789/0 conn(0x7ffb980b48e0 legacy=0x7ffb980b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.802+0000 7ffb977fe640 1 -- 172.21.15.79:0/1491399697 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb98071e00 con 0x7ffb98143bc0 2024-04-25T02:13:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.802+0000 7ffb96ffd640 1 --2- 172.21.15.79:0/1491399697 >> v2:172.21.15.189:3300/0 conn(0x7ffb9806df50 0x7ffb9806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.803+0000 7ffb977fe640 1 --2- 172.21.15.79:0/1491399697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb98143bc0 0x7ffb9815f500 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7ffb980cf960 tx=0x7ffb8802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d8335452c568d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.803+0000 7ffb967fc640 1 -- 172.21.15.79:0/1491399697 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88037070 con 0x7ffb98143bc0 2024-04-25T02:13:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.803+0000 7ffb967fc640 1 -- 172.21.15.79:0/1491399697 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb88032440 con 0x7ffb98143bc0 2024-04-25T02:13:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.803+0000 7ffb967fc640 1 -- 172.21.15.79:0/1491399697 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88032810 con 0x7ffb98143bc0 2024-04-25T02:13:47.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.804+0000 7ffb9dfe2640 1 -- 172.21.15.79:0/1491399697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb98143bc0 msgr2=0x7ffb9815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.804+0000 7ffb9dfe2640 1 --2- 172.21.15.79:0/1491399697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb98143bc0 0x7ffb9815f500 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7ffb980cf960 tx=0x7ffb8802a1a0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.804+0000 7ffb9dfe2640 1 -- 172.21.15.79:0/1491399697 shutdown_connections 2024-04-25T02:13:47.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.804+0000 7ffb9dfe2640 1 --2- 172.21.15.79:0/1491399697 >> v2:172.21.15.189:3300/0 conn(0x7ffb9806df50 0x7ffb9806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.804+0000 7ffb9dfe2640 1 --2- 172.21.15.79:0/1491399697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb98143bc0 0x7ffb9815f500 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.804+0000 7ffb9dfe2640 1 -- 172.21.15.79:0/1491399697 >> 172.21.15.79:0/1491399697 conn(0x7ffb980cfc80 msgr2=0x7ffb980d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:47.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.804+0000 7ffb9dfe2640 1 -- 172.21.15.79:0/1491399697 shutdown_connections 2024-04-25T02:13:47.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.804+0000 7ffb9dfe2640 1 -- 172.21.15.79:0/1491399697 wait complete. 2024-04-25T02:13:47.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.805+0000 7ffb9dfe2640 1 Processor -- start 2024-04-25T02:13:47.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.805+0000 7ffb9dfe2640 1 -- start start 2024-04-25T02:13:47.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb9dfe2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb9806df50 0x7ffb98132cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb9dfe2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb980b48e0 0x7ffb980ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb9dfe2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb98143bc0 0x7ffb9815c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb9dfe2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb98072660 con 0x7ffb98143bc0 2024-04-25T02:13:47.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb9dfe2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffb98072380 con 0x7ffb9806df50 2024-04-25T02:13:47.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb9dfe2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffb98072940 con 0x7ffb980b48e0 2024-04-25T02:13:47.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb97fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb98143bc0 0x7ffb9815c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:47.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb97fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb98143bc0 0x7ffb9815c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33224/0 (socket says 172.21.15.79:33224) 2024-04-25T02:13:47.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb97fff640 1 -- 172.21.15.79:0/85100485 learned_addr learned my addr 172.21.15.79:0/85100485 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:47.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb97fff640 1 -- 172.21.15.79:0/85100485 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb980b48e0 msgr2=0x7ffb980ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb97fff640 1 --2- 172.21.15.79:0/85100485 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb980b48e0 0x7ffb980ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb97fff640 1 -- 172.21.15.79:0/85100485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb9806df50 msgr2=0x7ffb98132cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:47.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb977fe640 1 --2- 172.21.15.79:0/85100485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb9806df50 0x7ffb98132cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:47.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb97fff640 1 --2- 172.21.15.79:0/85100485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb9806df50 0x7ffb98132cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:47.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb97fff640 1 -- 172.21.15.79:0/85100485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb980ae1a0 con 0x7ffb98143bc0 2024-04-25T02:13:47.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb97fff640 1 --2- 172.21.15.79:0/85100485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb98143bc0 0x7ffb9815c040 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000b970 tx=0x7ffb9000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:47.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb7ffff640 1 -- 172.21.15.79:0/85100485 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb90019070 con 0x7ffb98143bc0 2024-04-25T02:13:47.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb7ffff640 1 -- 172.21.15.79:0/85100485 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb9000cb40 con 0x7ffb98143bc0 2024-04-25T02:13:47.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb7ffff640 1 -- 172.21.15.79:0/85100485 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb90014440 con 0x7ffb98143bc0 2024-04-25T02:13:47.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.806+0000 7ffb9dfe2640 1 -- 172.21.15.79:0/85100485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb980ae440 con 0x7ffb98143bc0 2024-04-25T02:13:47.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.807+0000 7ffb9dfe2640 1 -- 172.21.15.79:0/85100485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb980aece0 con 0x7ffb98143bc0 2024-04-25T02:13:47.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.808+0000 7ffb9dfe2640 1 -- 172.21.15.79:0/85100485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb980690a0 con 0x7ffb98143bc0 2024-04-25T02:13:47.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.808+0000 7ffb7ffff640 1 -- 172.21.15.79:0/85100485 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb9001c070 con 0x7ffb98143bc0 2024-04-25T02:13:47.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.808+0000 7ffb7ffff640 1 --2- 172.21.15.79:0/85100485 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffb8406be30 0x7ffb8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:47.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.808+0000 7ffb7ffff640 1 -- 172.21.15.79:0/85100485 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7ffb9008aa80 con 0x7ffb98143bc0 2024-04-25T02:13:47.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.808+0000 7ffb977fe640 1 --2- 172.21.15.79:0/85100485 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffb8406be30 0x7ffb8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:47.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.809+0000 7ffb977fe640 1 --2- 172.21.15.79:0/85100485 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffb8406be30 0x7ffb8406e2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ffb88034000 tx=0x7ffb8802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:47.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.813+0000 7ffb7ffff640 1 -- 172.21.15.79:0/85100485 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffb90059430 con 0x7ffb98143bc0 2024-04-25T02:13:47.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.987+0000 7ffb9dfe2640 1 -- 172.21.15.79:0/85100485 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb980ae610 con 0x7ffb8406be30 2024-04-25T02:13:47.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.993+0000 7ffb7ffff640 1 -- 172.21.15.79:0/85100485 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252084 (secure 0 0 0) 0x7ffb980ae610 con 0x7ffb8406be30 2024-04-25T02:13:48.002 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:48.003 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:13:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.996+0000 7ffb9dfe2640 1 -- 172.21.15.79:0/85100485 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffb8406be30 msgr2=0x7ffb8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.996+0000 7ffb9dfe2640 1 --2- 172.21.15.79:0/85100485 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffb8406be30 0x7ffb8406e2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ffb88034000 tx=0x7ffb8802e000 comp rx=0 tx=0).stop 2024-04-25T02:13:48.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.996+0000 7ffb9dfe2640 1 -- 172.21.15.79:0/85100485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb98143bc0 msgr2=0x7ffb9815c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.996+0000 7ffb9dfe2640 1 --2- 172.21.15.79:0/85100485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb98143bc0 0x7ffb9815c040 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000b970 tx=0x7ffb9000be30 comp rx=0 tx=0).stop 2024-04-25T02:13:48.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.996+0000 7ffb9dfe2640 1 -- 172.21.15.79:0/85100485 shutdown_connections 2024-04-25T02:13:48.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.996+0000 7ffb9dfe2640 1 --2- 172.21.15.79:0/85100485 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffb8406be30 0x7ffb8406e2f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.996+0000 7ffb9dfe2640 1 --2- 172.21.15.79:0/85100485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb98143bc0 0x7ffb9815c040 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.996+0000 7ffb9dfe2640 1 --2- 172.21.15.79:0/85100485 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb980b48e0 0x7ffb980ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.996+0000 7ffb9dfe2640 1 --2- 172.21.15.79:0/85100485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb9806df50 0x7ffb98132cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.996+0000 7ffb9dfe2640 1 -- 172.21.15.79:0/85100485 >> 172.21.15.79:0/85100485 conn(0x7ffb980cfc80 msgr2=0x7ffb981440a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:48.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.996+0000 7ffb9dfe2640 1 -- 172.21.15.79:0/85100485 shutdown_connections 2024-04-25T02:13:48.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:47.996+0000 7ffb9dfe2640 1 -- 172.21.15.79:0/85100485 wait complete. 2024-04-25T02:13:48.013 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2024-04-25T02:13:47.249487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246500,"kb_used_data":9480,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754728220,"statfs":{"total":773094113280,"available":772841697280,"internally_reserved":0,"allocated":9707520,"data_stored":4783260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":242535988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.222300"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051980+0000","last_change":"2024-04-25T02:13:44.050809+0000","last_active":"2024-04-25T02:13:45.051980+0000","last_peered":"2024-04-25T02:13:45.051980+0000","last_clean":"2024-04-25T02:13:45.051980+0000","last_became_active":"2024-04-25T02:13:44.050335+0000","last_became_peered":"2024-04-25T02:13:44.050335+0000","last_unstale":"2024-04-25T02:13:45.051980+0000","last_undegraded":"2024-04-25T02:13:45.051980+0000","last_fullsized":"2024-04-25T02:13:45.051980+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:01.814394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059724+0000","last_change":"2024-04-25T02:13:44.052328+0000","last_active":"2024-04-25T02:13:45.059724+0000","last_peered":"2024-04-25T02:13:45.059724+0000","last_clean":"2024-04-25T02:13:45.059724+0000","last_became_active":"2024-04-25T02:13:44.052034+0000","last_became_peered":"2024-04-25T02:13:44.052034+0000","last_unstale":"2024-04-25T02:13:45.059724+0000","last_undegraded":"2024-04-25T02:13:45.059724+0000","last_fullsized":"2024-04-25T02:13:45.059724+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:38.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059335+0000","last_change":"2024-04-25T02:13:44.055084+0000","last_active":"2024-04-25T02:13:45.059335+0000","last_peered":"2024-04-25T02:13:45.059335+0000","last_clean":"2024-04-25T02:13:45.059335+0000","last_became_active":"2024-04-25T02:13:44.054809+0000","last_became_peered":"2024-04-25T02:13:44.054809+0000","last_unstale":"2024-04-25T02:13:45.059335+0000","last_undegraded":"2024-04-25T02:13:45.059335+0000","last_fullsized":"2024-04-25T02:13:45.059335+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:54.077844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051048+0000","last_change":"2024-04-25T02:13:44.062534+0000","last_active":"2024-04-25T02:13:45.051048+0000","last_peered":"2024-04-25T02:13:45.051048+0000","last_clean":"2024-04-25T02:13:45.051048+0000","last_became_active":"2024-04-25T02:13:44.062245+0000","last_became_peered":"2024-04-25T02:13:44.062245+0000","last_unstale":"2024-04-25T02:13:45.051048+0000","last_undegraded":"2024-04-25T02:13:45.051048+0000","last_fullsized":"2024-04-25T02:13:45.051048+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:42.846321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059490+0000","last_change":"2024-04-25T02:13:44.057243+0000","last_active":"2024-04-25T02:13:45.059490+0000","last_peered":"2024-04-25T02:13:45.059490+0000","last_clean":"2024-04-25T02:13:45.059490+0000","last_became_active":"2024-04-25T02:13:44.056925+0000","last_became_peered":"2024-04-25T02:13:44.056925+0000","last_unstale":"2024-04-25T02:13:45.059490+0000","last_undegraded":"2024-04-25T02:13:45.059490+0000","last_fullsized":"2024-04-25T02:13:45.059490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:58.840648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051238+0000","last_change":"2024-04-25T02:13:44.050824+0000","last_active":"2024-04-25T02:13:45.051238+0000","last_peered":"2024-04-25T02:13:45.051238+0000","last_clean":"2024-04-25T02:13:45.051238+0000","last_became_active":"2024-04-25T02:13:44.050412+0000","last_became_peered":"2024-04-25T02:13:44.050412+0000","last_unstale":"2024-04-25T02:13:45.051238+0000","last_undegraded":"2024-04-25T02:13:45.051238+0000","last_fullsized":"2024-04-25T02:13:45.051238+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:34.374603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.050820+0000","last_change":"2024-04-25T02:13:44.048494+0000","last_active":"2024-04-25T02:13:45.050820+0000","last_peered":"2024-04-25T02:13:45.050820+0000","last_clean":"2024-04-25T02:13:45.050820+0000","last_became_active":"2024-04-25T02:13:44.048199+0000","last_became_peered":"2024-04-25T02:13:44.048199+0000","last_unstale":"2024-04-25T02:13:45.050820+0000","last_undegraded":"2024-04-25T02:13:45.050820+0000","last_fullsized":"2024-04-25T02:13:45.050820+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:59:14.755757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051026+0000","last_change":"2024-04-25T02:13:44.054808+0000","last_active":"2024-04-25T02:13:45.051026+0000","last_peered":"2024-04-25T02:13:45.051026+0000","last_clean":"2024-04-25T02:13:45.051026+0000","last_became_active":"2024-04-25T02:13:44.054551+0000","last_became_peered":"2024-04-25T02:13:44.054551+0000","last_unstale":"2024-04-25T02:13:45.051026+0000","last_undegraded":"2024-04-25T02:13:45.051026+0000","last_fullsized":"2024-04-25T02:13:45.051026+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:16.945232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051605+0000","last_change":"2024-04-25T02:13:44.055615+0000","last_active":"2024-04-25T02:13:45.051605+0000","last_peered":"2024-04-25T02:13:45.051605+0000","last_clean":"2024-04-25T02:13:45.051605+0000","last_became_active":"2024-04-25T02:13:44.055361+0000","last_became_peered":"2024-04-25T02:13:44.055361+0000","last_unstale":"2024-04-25T02:13:45.051605+0000","last_undegraded":"2024-04-25T02:13:45.051605+0000","last_fullsized":"2024-04-25T02:13:45.051605+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:48.101710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052037+0000","last_change":"2024-04-25T02:13:44.057946+0000","last_active":"2024-04-25T02:13:45.052037+0000","last_peered":"2024-04-25T02:13:45.052037+0000","last_clean":"2024-04-25T02:13:45.052037+0000","last_became_active":"2024-04-25T02:13:44.057689+0000","last_became_peered":"2024-04-25T02:13:44.057689+0000","last_unstale":"2024-04-25T02:13:45.052037+0000","last_undegraded":"2024-04-25T02:13:45.052037+0000","last_fullsized":"2024-04-25T02:13:45.052037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:42.984245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059517+0000","last_change":"2024-04-25T02:13:44.051150+0000","last_active":"2024-04-25T02:13:45.059517+0000","last_peered":"2024-04-25T02:13:45.059517+0000","last_clean":"2024-04-25T02:13:45.059517+0000","last_became_active":"2024-04-25T02:13:44.050885+0000","last_became_peered":"2024-04-25T02:13:44.050885+0000","last_unstale":"2024-04-25T02:13:45.059517+0000","last_undegraded":"2024-04-25T02:13:45.059517+0000","last_fullsized":"2024-04-25T02:13:45.059517+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:42.834967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051902+0000","last_change":"2024-04-25T02:13:44.058536+0000","last_active":"2024-04-25T02:13:45.051902+0000","last_peered":"2024-04-25T02:13:45.051902+0000","last_clean":"2024-04-25T02:13:45.051902+0000","last_became_active":"2024-04-25T02:13:44.058293+0000","last_became_peered":"2024-04-25T02:13:44.058293+0000","last_unstale":"2024-04-25T02:13:45.051902+0000","last_undegraded":"2024-04-25T02:13:45.051902+0000","last_fullsized":"2024-04-25T02:13:45.051902+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:47.297520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059896+0000","last_change":"2024-04-25T02:13:44.054094+0000","last_active":"2024-04-25T02:13:45.059896+0000","last_peered":"2024-04-25T02:13:45.059896+0000","last_clean":"2024-04-25T02:13:45.059896+0000","last_became_active":"2024-04-25T02:13:44.053753+0000","last_became_peered":"2024-04-25T02:13:44.053753+0000","last_unstale":"2024-04-25T02:13:45.059896+0000","last_undegraded":"2024-04-25T02:13:45.059896+0000","last_fullsized":"2024-04-25T02:13:45.059896+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:47.675994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051045+0000","last_change":"2024-04-25T02:13:44.065753+0000","last_active":"2024-04-25T02:13:45.051045+0000","last_peered":"2024-04-25T02:13:45.051045+0000","last_clean":"2024-04-25T02:13:45.051045+0000","last_became_active":"2024-04-25T02:13:44.065373+0000","last_became_peered":"2024-04-25T02:13:44.065373+0000","last_unstale":"2024-04-25T02:13:45.051045+0000","last_undegraded":"2024-04-25T02:13:45.051045+0000","last_fullsized":"2024-04-25T02:13:45.051045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:27.161509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059000+0000","last_change":"2024-04-25T02:13:44.057620+0000","last_active":"2024-04-25T02:13:45.059000+0000","last_peered":"2024-04-25T02:13:45.059000+0000","last_clean":"2024-04-25T02:13:45.059000+0000","last_became_active":"2024-04-25T02:13:44.057294+0000","last_became_peered":"2024-04-25T02:13:44.057294+0000","last_unstale":"2024-04-25T02:13:45.059000+0000","last_undegraded":"2024-04-25T02:13:45.059000+0000","last_fullsized":"2024-04-25T02:13:45.059000+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:45.745395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.058975+0000","last_change":"2024-04-25T02:13:44.050812+0000","last_active":"2024-04-25T02:13:45.058975+0000","last_peered":"2024-04-25T02:13:45.058975+0000","last_clean":"2024-04-25T02:13:45.058975+0000","last_became_active":"2024-04-25T02:13:44.050209+0000","last_became_peered":"2024-04-25T02:13:44.050209+0000","last_unstale":"2024-04-25T02:13:45.058975+0000","last_undegraded":"2024-04-25T02:13:45.058975+0000","last_fullsized":"2024-04-25T02:13:45.058975+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:21.665309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059591+0000","last_change":"2024-04-25T02:13:44.052576+0000","last_active":"2024-04-25T02:13:45.059591+0000","last_peered":"2024-04-25T02:13:45.059591+0000","last_clean":"2024-04-25T02:13:45.059591+0000","last_became_active":"2024-04-25T02:13:44.052300+0000","last_became_peered":"2024-04-25T02:13:44.052300+0000","last_unstale":"2024-04-25T02:13:45.059591+0000","last_undegraded":"2024-04-25T02:13:45.059591+0000","last_fullsized":"2024-04-25T02:13:45.059591+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:32.198755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051107+0000","last_change":"2024-04-25T02:13:44.055250+0000","last_active":"2024-04-25T02:13:45.051107+0000","last_peered":"2024-04-25T02:13:45.051107+0000","last_clean":"2024-04-25T02:13:45.051107+0000","last_became_active":"2024-04-25T02:13:44.053882+0000","last_became_peered":"2024-04-25T02:13:44.053882+0000","last_unstale":"2024-04-25T02:13:45.051107+0000","last_undegraded":"2024-04-25T02:13:45.051107+0000","last_fullsized":"2024-04-25T02:13:45.051107+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:13.729450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059686+0000","last_change":"2024-04-25T02:13:44.052997+0000","last_active":"2024-04-25T02:13:45.059686+0000","last_peered":"2024-04-25T02:13:45.059686+0000","last_clean":"2024-04-25T02:13:45.059686+0000","last_became_active":"2024-04-25T02:13:44.052581+0000","last_became_peered":"2024-04-25T02:13:44.052581+0000","last_unstale":"2024-04-25T02:13:45.059686+0000","last_undegraded":"2024-04-25T02:13:45.059686+0000","last_fullsized":"2024-04-25T02:13:45.059686+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:47.297520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051102+0000","last_change":"2024-04-25T02:13:44.062248+0000","last_active":"2024-04-25T02:13:45.051102+0000","last_peered":"2024-04-25T02:13:45.051102+0000","last_clean":"2024-04-25T02:13:45.051102+0000","last_became_active":"2024-04-25T02:13:44.061877+0000","last_became_peered":"2024-04-25T02:13:44.061877+0000","last_unstale":"2024-04-25T02:13:45.051102+0000","last_undegraded":"2024-04-25T02:13:45.051102+0000","last_fullsized":"2024-04-25T02:13:45.051102+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:39:59.263385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051051+0000","last_change":"2024-04-25T02:13:44.063217+0000","last_active":"2024-04-25T02:13:45.051051+0000","last_peered":"2024-04-25T02:13:45.051051+0000","last_clean":"2024-04-25T02:13:45.051051+0000","last_became_active":"2024-04-25T02:13:44.062952+0000","last_became_peered":"2024-04-25T02:13:44.062952+0000","last_unstale":"2024-04-25T02:13:45.051051+0000","last_undegraded":"2024-04-25T02:13:45.051051+0000","last_fullsized":"2024-04-25T02:13:45.051051+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:51.422225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059292+0000","last_change":"2024-04-25T02:13:44.055316+0000","last_active":"2024-04-25T02:13:45.059292+0000","last_peered":"2024-04-25T02:13:45.059292+0000","last_clean":"2024-04-25T02:13:45.059292+0000","last_became_active":"2024-04-25T02:13:44.055040+0000","last_became_peered":"2024-04-25T02:13:44.055040+0000","last_unstale":"2024-04-25T02:13:45.059292+0000","last_undegraded":"2024-04-25T02:13:45.059292+0000","last_fullsized":"2024-04-25T02:13:45.059292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:38.334984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051345+0000","last_change":"2024-04-25T02:13:44.063416+0000","last_active":"2024-04-25T02:13:45.051345+0000","last_peered":"2024-04-25T02:13:45.051345+0000","last_clean":"2024-04-25T02:13:45.051345+0000","last_became_active":"2024-04-25T02:13:44.063138+0000","last_became_peered":"2024-04-25T02:13:44.063138+0000","last_unstale":"2024-04-25T02:13:45.051345+0000","last_undegraded":"2024-04-25T02:13:45.051345+0000","last_fullsized":"2024-04-25T02:13:45.051345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:55.135858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.050812+0000","last_change":"2024-04-25T02:13:44.059480+0000","last_active":"2024-04-25T02:13:45.050812+0000","last_peered":"2024-04-25T02:13:45.050812+0000","last_clean":"2024-04-25T02:13:45.050812+0000","last_became_active":"2024-04-25T02:13:44.059204+0000","last_became_peered":"2024-04-25T02:13:44.059204+0000","last_unstale":"2024-04-25T02:13:45.050812+0000","last_undegraded":"2024-04-25T02:13:45.050812+0000","last_fullsized":"2024-04-25T02:13:45.050812+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:05:47.001033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.060053+0000","last_change":"2024-04-25T02:13:44.053952+0000","last_active":"2024-04-25T02:13:45.060053+0000","last_peered":"2024-04-25T02:13:45.060053+0000","last_clean":"2024-04-25T02:13:45.060053+0000","last_became_active":"2024-04-25T02:13:44.053671+0000","last_became_peered":"2024-04-25T02:13:44.053671+0000","last_unstale":"2024-04-25T02:13:45.060053+0000","last_undegraded":"2024-04-25T02:13:45.060053+0000","last_fullsized":"2024-04-25T02:13:45.060053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:09.883615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059219+0000","last_change":"2024-04-25T02:13:44.063670+0000","last_active":"2024-04-25T02:13:45.059219+0000","last_peered":"2024-04-25T02:13:45.059219+0000","last_clean":"2024-04-25T02:13:45.059219+0000","last_became_active":"2024-04-25T02:13:44.063073+0000","last_became_peered":"2024-04-25T02:13:44.063073+0000","last_unstale":"2024-04-25T02:13:45.059219+0000","last_undegraded":"2024-04-25T02:13:45.059219+0000","last_fullsized":"2024-04-25T02:13:45.059219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:32.198755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059393+0000","last_change":"2024-04-25T02:13:44.052593+0000","last_active":"2024-04-25T02:13:45.059393+0000","last_peered":"2024-04-25T02:13:45.059393+0000","last_clean":"2024-04-25T02:13:45.059393+0000","last_became_active":"2024-04-25T02:13:44.052312+0000","last_became_peered":"2024-04-25T02:13:44.052312+0000","last_unstale":"2024-04-25T02:13:45.059393+0000","last_undegraded":"2024-04-25T02:13:45.059393+0000","last_fullsized":"2024-04-25T02:13:45.059393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:48.101710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051840+0000","last_change":"2024-04-25T02:13:44.054032+0000","last_active":"2024-04-25T02:13:45.051840+0000","last_peered":"2024-04-25T02:13:45.051840+0000","last_clean":"2024-04-25T02:13:45.051840+0000","last_became_active":"2024-04-25T02:13:44.053729+0000","last_became_peered":"2024-04-25T02:13:44.053729+0000","last_unstale":"2024-04-25T02:13:45.051840+0000","last_undegraded":"2024-04-25T02:13:45.051840+0000","last_fullsized":"2024-04-25T02:13:45.051840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:47.675994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.060022+0000","last_change":"2024-04-25T02:13:44.059742+0000","last_active":"2024-04-25T02:13:45.060022+0000","last_peered":"2024-04-25T02:13:45.060022+0000","last_clean":"2024-04-25T02:13:45.060022+0000","last_became_active":"2024-04-25T02:13:44.059438+0000","last_became_peered":"2024-04-25T02:13:44.059438+0000","last_unstale":"2024-04-25T02:13:45.060022+0000","last_undegraded":"2024-04-25T02:13:45.060022+0000","last_fullsized":"2024-04-25T02:13:45.060022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:28:26.969742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059430+0000","last_change":"2024-04-25T02:13:44.058572+0000","last_active":"2024-04-25T02:13:45.059430+0000","last_peered":"2024-04-25T02:13:45.059430+0000","last_clean":"2024-04-25T02:13:45.059430+0000","last_became_active":"2024-04-25T02:13:44.055542+0000","last_became_peered":"2024-04-25T02:13:44.055542+0000","last_unstale":"2024-04-25T02:13:45.059430+0000","last_undegraded":"2024-04-25T02:13:45.059430+0000","last_fullsized":"2024-04-25T02:13:45.059430+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:29.310059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059104+0000","last_change":"2024-04-25T02:13:44.063895+0000","last_active":"2024-04-25T02:13:45.059104+0000","last_peered":"2024-04-25T02:13:45.059104+0000","last_clean":"2024-04-25T02:13:45.059104+0000","last_became_active":"2024-04-25T02:13:44.062169+0000","last_became_peered":"2024-04-25T02:13:44.062169+0000","last_unstale":"2024-04-25T02:13:45.059104+0000","last_undegraded":"2024-04-25T02:13:45.059104+0000","last_fullsized":"2024-04-25T02:13:45.059104+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:11.040179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051271+0000","last_change":"2024-04-25T02:13:44.054839+0000","last_active":"2024-04-25T02:13:45.051271+0000","last_peered":"2024-04-25T02:13:45.051271+0000","last_clean":"2024-04-25T02:13:45.051271+0000","last_became_active":"2024-04-25T02:13:44.054561+0000","last_became_peered":"2024-04-25T02:13:44.054561+0000","last_unstale":"2024-04-25T02:13:45.051271+0000","last_undegraded":"2024-04-25T02:13:45.051271+0000","last_fullsized":"2024-04-25T02:13:45.051271+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:56.935832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059644+0000","last_change":"2024-04-25T02:13:44.052871+0000","last_active":"2024-04-25T02:13:45.059644+0000","last_peered":"2024-04-25T02:13:45.059644+0000","last_clean":"2024-04-25T02:13:45.059644+0000","last_became_active":"2024-04-25T02:13:44.052546+0000","last_became_peered":"2024-04-25T02:13:44.052546+0000","last_unstale":"2024-04-25T02:13:45.059644+0000","last_undegraded":"2024-04-25T02:13:45.059644+0000","last_fullsized":"2024-04-25T02:13:45.059644+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:54.077844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"85'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052155+0000","last_change":"2024-04-25T02:13:43.053264+0000","last_active":"2024-04-25T02:13:45.052155+0000","last_peered":"2024-04-25T02:13:45.052155+0000","last_clean":"2024-04-25T02:13:45.052155+0000","last_became_active":"2024-04-25T02:13:43.052943+0000","last_became_peered":"2024-04-25T02:13:43.052943+0000","last_unstale":"2024-04-25T02:13:45.052155+0000","last_undegraded":"2024-04-25T02:13:45.052155+0000","last_fullsized":"2024-04-25T02:13:45.052155+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:45.414473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052078+0000","last_change":"2024-04-25T02:13:44.063228+0000","last_active":"2024-04-25T02:13:45.052078+0000","last_peered":"2024-04-25T02:13:45.052078+0000","last_clean":"2024-04-25T02:13:45.052078+0000","last_became_active":"2024-04-25T02:13:44.062879+0000","last_became_peered":"2024-04-25T02:13:44.062879+0000","last_unstale":"2024-04-25T02:13:45.052078+0000","last_undegraded":"2024-04-25T02:13:45.052078+0000","last_fullsized":"2024-04-25T02:13:45.052078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:01.622647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059854+0000","last_change":"2024-04-25T02:13:43.054020+0000","last_active":"2024-04-25T02:13:45.059854+0000","last_peered":"2024-04-25T02:13:45.059854+0000","last_clean":"2024-04-25T02:13:45.059854+0000","last_became_active":"2024-04-25T02:13:43.053739+0000","last_became_peered":"2024-04-25T02:13:43.053739+0000","last_unstale":"2024-04-25T02:13:45.059854+0000","last_undegraded":"2024-04-25T02:13:45.059854+0000","last_fullsized":"2024-04-25T02:13:45.059854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:09.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052040+0000","last_change":"2024-04-25T02:13:44.060959+0000","last_active":"2024-04-25T02:13:45.052040+0000","last_peered":"2024-04-25T02:13:45.052040+0000","last_clean":"2024-04-25T02:13:45.052040+0000","last_became_active":"2024-04-25T02:13:44.060636+0000","last_became_peered":"2024-04-25T02:13:44.060636+0000","last_unstale":"2024-04-25T02:13:45.052040+0000","last_undegraded":"2024-04-25T02:13:45.052040+0000","last_fullsized":"2024-04-25T02:13:45.052040+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:33.580845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059778+0000","last_change":"2024-04-25T02:13:43.050515+0000","last_active":"2024-04-25T02:13:45.059778+0000","last_peered":"2024-04-25T02:13:45.059778+0000","last_clean":"2024-04-25T02:13:45.059778+0000","last_became_active":"2024-04-25T02:13:43.050240+0000","last_became_peered":"2024-04-25T02:13:43.050240+0000","last_unstale":"2024-04-25T02:13:45.059778+0000","last_undegraded":"2024-04-25T02:13:45.059778+0000","last_fullsized":"2024-04-25T02:13:45.059778+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:24.962811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059490+0000","last_change":"2024-04-25T02:13:44.055663+0000","last_active":"2024-04-25T02:13:45.059490+0000","last_peered":"2024-04-25T02:13:45.059490+0000","last_clean":"2024-04-25T02:13:45.059490+0000","last_became_active":"2024-04-25T02:13:44.055387+0000","last_became_peered":"2024-04-25T02:13:44.055387+0000","last_unstale":"2024-04-25T02:13:45.059490+0000","last_undegraded":"2024-04-25T02:13:45.059490+0000","last_fullsized":"2024-04-25T02:13:45.059490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:56.935832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059881+0000","last_change":"2024-04-25T02:13:43.049579+0000","last_active":"2024-04-25T02:13:45.059881+0000","last_peered":"2024-04-25T02:13:45.059881+0000","last_clean":"2024-04-25T02:13:45.059881+0000","last_became_active":"2024-04-25T02:13:43.048737+0000","last_became_peered":"2024-04-25T02:13:43.048737+0000","last_unstale":"2024-04-25T02:13:45.059881+0000","last_undegraded":"2024-04-25T02:13:45.059881+0000","last_fullsized":"2024-04-25T02:13:45.059881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:57.833319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059565+0000","last_change":"2024-04-25T02:13:44.058667+0000","last_active":"2024-04-25T02:13:45.059565+0000","last_peered":"2024-04-25T02:13:45.059565+0000","last_clean":"2024-04-25T02:13:45.059565+0000","last_became_active":"2024-04-25T02:13:44.058241+0000","last_became_peered":"2024-04-25T02:13:44.058241+0000","last_unstale":"2024-04-25T02:13:45.059565+0000","last_undegraded":"2024-04-25T02:13:45.059565+0000","last_fullsized":"2024-04-25T02:13:45.059565+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:10.064028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059855+0000","last_change":"2024-04-25T02:13:43.057085+0000","last_active":"2024-04-25T02:13:45.059855+0000","last_peered":"2024-04-25T02:13:45.059855+0000","last_clean":"2024-04-25T02:13:45.059855+0000","last_became_active":"2024-04-25T02:13:43.056456+0000","last_became_peered":"2024-04-25T02:13:43.056456+0000","last_unstale":"2024-04-25T02:13:45.059855+0000","last_undegraded":"2024-04-25T02:13:45.059855+0000","last_fullsized":"2024-04-25T02:13:45.059855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:37.018941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059639+0000","last_change":"2024-04-25T02:13:44.051807+0000","last_active":"2024-04-25T02:13:45.059639+0000","last_peered":"2024-04-25T02:13:45.059639+0000","last_clean":"2024-04-25T02:13:45.059639+0000","last_became_active":"2024-04-25T02:13:44.051527+0000","last_became_peered":"2024-04-25T02:13:44.051527+0000","last_unstale":"2024-04-25T02:13:45.059639+0000","last_undegraded":"2024-04-25T02:13:45.059639+0000","last_fullsized":"2024-04-25T02:13:45.059639+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:19:15.933023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059031+0000","last_change":"2024-04-25T02:13:43.054914+0000","last_active":"2024-04-25T02:13:45.059031+0000","last_peered":"2024-04-25T02:13:45.059031+0000","last_clean":"2024-04-25T02:13:45.059031+0000","last_became_active":"2024-04-25T02:13:43.054626+0000","last_became_peered":"2024-04-25T02:13:43.054626+0000","last_unstale":"2024-04-25T02:13:45.059031+0000","last_undegraded":"2024-04-25T02:13:45.059031+0000","last_fullsized":"2024-04-25T02:13:45.059031+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:37.327655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059723+0000","last_change":"2024-04-25T02:13:44.063766+0000","last_active":"2024-04-25T02:13:45.059723+0000","last_peered":"2024-04-25T02:13:45.059723+0000","last_clean":"2024-04-25T02:13:45.059723+0000","last_became_active":"2024-04-25T02:13:44.063495+0000","last_became_peered":"2024-04-25T02:13:44.063495+0000","last_unstale":"2024-04-25T02:13:45.059723+0000","last_undegraded":"2024-04-25T02:13:45.059723+0000","last_fullsized":"2024-04-25T02:13:45.059723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:55.135858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.058724+0000","last_change":"2024-04-25T02:13:43.054255+0000","last_active":"2024-04-25T02:13:45.058724+0000","last_peered":"2024-04-25T02:13:45.058724+0000","last_clean":"2024-04-25T02:13:45.058724+0000","last_became_active":"2024-04-25T02:13:43.053950+0000","last_became_peered":"2024-04-25T02:13:43.053950+0000","last_unstale":"2024-04-25T02:13:45.058724+0000","last_undegraded":"2024-04-25T02:13:45.058724+0000","last_fullsized":"2024-04-25T02:13:45.058724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:10.032849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059120+0000","last_change":"2024-04-25T02:13:44.055278+0000","last_active":"2024-04-25T02:13:45.059120+0000","last_peered":"2024-04-25T02:13:45.059120+0000","last_clean":"2024-04-25T02:13:45.059120+0000","last_became_active":"2024-04-25T02:13:44.054960+0000","last_became_peered":"2024-04-25T02:13:44.054960+0000","last_unstale":"2024-04-25T02:13:45.059120+0000","last_undegraded":"2024-04-25T02:13:45.059120+0000","last_fullsized":"2024-04-25T02:13:45.059120+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:34.438099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059067+0000","last_change":"2024-04-25T02:13:43.053935+0000","last_active":"2024-04-25T02:13:45.059067+0000","last_peered":"2024-04-25T02:13:45.059067+0000","last_clean":"2024-04-25T02:13:45.059067+0000","last_became_active":"2024-04-25T02:13:43.053607+0000","last_became_peered":"2024-04-25T02:13:43.053607+0000","last_unstale":"2024-04-25T02:13:45.059067+0000","last_undegraded":"2024-04-25T02:13:45.059067+0000","last_fullsized":"2024-04-25T02:13:45.059067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:37:18.378285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059579+0000","last_change":"2024-04-25T02:13:44.057279+0000","last_active":"2024-04-25T02:13:45.059579+0000","last_peered":"2024-04-25T02:13:45.059579+0000","last_clean":"2024-04-25T02:13:45.059579+0000","last_became_active":"2024-04-25T02:13:44.056977+0000","last_became_peered":"2024-04-25T02:13:44.056977+0000","last_unstale":"2024-04-25T02:13:45.059579+0000","last_undegraded":"2024-04-25T02:13:45.059579+0000","last_fullsized":"2024-04-25T02:13:45.059579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:41.063251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052208+0000","last_change":"2024-04-25T02:13:43.053851+0000","last_active":"2024-04-25T02:13:45.052208+0000","last_peered":"2024-04-25T02:13:45.052208+0000","last_clean":"2024-04-25T02:13:45.052208+0000","last_became_active":"2024-04-25T02:13:43.052885+0000","last_became_peered":"2024-04-25T02:13:43.052885+0000","last_unstale":"2024-04-25T02:13:45.052208+0000","last_undegraded":"2024-04-25T02:13:45.052208+0000","last_fullsized":"2024-04-25T02:13:45.052208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:51.107166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051560+0000","last_change":"2024-04-25T02:13:44.050167+0000","last_active":"2024-04-25T02:13:45.051560+0000","last_peered":"2024-04-25T02:13:45.051560+0000","last_clean":"2024-04-25T02:13:45.051560+0000","last_became_active":"2024-04-25T02:13:44.049885+0000","last_became_peered":"2024-04-25T02:13:44.049885+0000","last_unstale":"2024-04-25T02:13:45.051560+0000","last_undegraded":"2024-04-25T02:13:45.051560+0000","last_fullsized":"2024-04-25T02:13:45.051560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:11.040179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051957+0000","last_change":"2024-04-25T02:13:43.056392+0000","last_active":"2024-04-25T02:13:45.051957+0000","last_peered":"2024-04-25T02:13:45.051957+0000","last_clean":"2024-04-25T02:13:45.051957+0000","last_became_active":"2024-04-25T02:13:43.056071+0000","last_became_peered":"2024-04-25T02:13:43.056071+0000","last_unstale":"2024-04-25T02:13:45.051957+0000","last_undegraded":"2024-04-25T02:13:45.051957+0000","last_fullsized":"2024-04-25T02:13:45.051957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:39.579022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059828+0000","last_change":"2024-04-25T02:13:44.055535+0000","last_active":"2024-04-25T02:13:45.059828+0000","last_peered":"2024-04-25T02:13:45.059828+0000","last_clean":"2024-04-25T02:13:45.059828+0000","last_became_active":"2024-04-25T02:13:44.055252+0000","last_became_peered":"2024-04-25T02:13:44.055252+0000","last_unstale":"2024-04-25T02:13:45.059828+0000","last_undegraded":"2024-04-25T02:13:45.059828+0000","last_fullsized":"2024-04-25T02:13:45.059828+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:01.814394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"85'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051718+0000","last_change":"2024-04-25T02:13:43.053463+0000","last_active":"2024-04-25T02:13:45.051718+0000","last_peered":"2024-04-25T02:13:45.051718+0000","last_clean":"2024-04-25T02:13:45.051718+0000","last_became_active":"2024-04-25T02:13:43.052980+0000","last_became_peered":"2024-04-25T02:13:43.052980+0000","last_unstale":"2024-04-25T02:13:45.051718+0000","last_undegraded":"2024-04-25T02:13:45.051718+0000","last_fullsized":"2024-04-25T02:13:45.051718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:15.937903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059559+0000","last_change":"2024-04-25T02:13:44.064218+0000","last_active":"2024-04-25T02:13:45.059559+0000","last_peered":"2024-04-25T02:13:45.059559+0000","last_clean":"2024-04-25T02:13:45.059559+0000","last_became_active":"2024-04-25T02:13:44.063869+0000","last_became_peered":"2024-04-25T02:13:44.063869+0000","last_unstale":"2024-04-25T02:13:45.059559+0000","last_undegraded":"2024-04-25T02:13:45.059559+0000","last_fullsized":"2024-04-25T02:13:45.059559+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:25.970140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"85'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051592+0000","last_change":"2024-04-25T02:13:43.055805+0000","last_active":"2024-04-25T02:13:45.051592+0000","last_peered":"2024-04-25T02:13:45.051592+0000","last_clean":"2024-04-25T02:13:45.051592+0000","last_became_active":"2024-04-25T02:13:43.055454+0000","last_became_peered":"2024-04-25T02:13:43.055454+0000","last_unstale":"2024-04-25T02:13:45.051592+0000","last_undegraded":"2024-04-25T02:13:45.051592+0000","last_fullsized":"2024-04-25T02:13:45.051592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:09.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059542+0000","last_change":"2024-04-25T02:13:44.053452+0000","last_active":"2024-04-25T02:13:45.059542+0000","last_peered":"2024-04-25T02:13:45.059542+0000","last_clean":"2024-04-25T02:13:45.059542+0000","last_became_active":"2024-04-25T02:13:44.053167+0000","last_became_peered":"2024-04-25T02:13:44.053167+0000","last_unstale":"2024-04-25T02:13:45.059542+0000","last_undegraded":"2024-04-25T02:13:45.059542+0000","last_fullsized":"2024-04-25T02:13:45.059542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:47.675994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.060066+0000","last_change":"2024-04-25T02:13:43.049363+0000","last_active":"2024-04-25T02:13:45.060066+0000","last_peered":"2024-04-25T02:13:45.060066+0000","last_clean":"2024-04-25T02:13:45.060066+0000","last_became_active":"2024-04-25T02:13:43.049105+0000","last_became_peered":"2024-04-25T02:13:43.049105+0000","last_unstale":"2024-04-25T02:13:45.060066+0000","last_undegraded":"2024-04-25T02:13:45.060066+0000","last_fullsized":"2024-04-25T02:13:45.060066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:30.462005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059974+0000","last_change":"2024-04-25T02:13:44.067523+0000","last_active":"2024-04-25T02:13:45.059974+0000","last_peered":"2024-04-25T02:13:45.059974+0000","last_clean":"2024-04-25T02:13:45.059974+0000","last_became_active":"2024-04-25T02:13:44.067236+0000","last_became_peered":"2024-04-25T02:13:44.067236+0000","last_unstale":"2024-04-25T02:13:45.059974+0000","last_undegraded":"2024-04-25T02:13:45.059974+0000","last_fullsized":"2024-04-25T02:13:45.059974+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:47.297520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059176+0000","last_change":"2024-04-25T02:13:43.046196+0000","last_active":"2024-04-25T02:13:45.059176+0000","last_peered":"2024-04-25T02:13:45.059176+0000","last_clean":"2024-04-25T02:13:45.059176+0000","last_became_active":"2024-04-25T02:13:43.045929+0000","last_became_peered":"2024-04-25T02:13:43.045929+0000","last_unstale":"2024-04-25T02:13:45.059176+0000","last_undegraded":"2024-04-25T02:13:45.059176+0000","last_fullsized":"2024-04-25T02:13:45.059176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:09.014230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059041+0000","last_change":"2024-04-25T02:13:44.053140+0000","last_active":"2024-04-25T02:13:45.059041+0000","last_peered":"2024-04-25T02:13:45.059041+0000","last_clean":"2024-04-25T02:13:45.059041+0000","last_became_active":"2024-04-25T02:13:44.052839+0000","last_became_peered":"2024-04-25T02:13:44.052839+0000","last_unstale":"2024-04-25T02:13:45.059041+0000","last_undegraded":"2024-04-25T02:13:45.059041+0000","last_fullsized":"2024-04-25T02:13:45.059041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:35.188356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051635+0000","last_change":"2024-04-25T02:13:43.053886+0000","last_active":"2024-04-25T02:13:45.051635+0000","last_peered":"2024-04-25T02:13:45.051635+0000","last_clean":"2024-04-25T02:13:45.051635+0000","last_became_active":"2024-04-25T02:13:43.053630+0000","last_became_peered":"2024-04-25T02:13:43.053630+0000","last_unstale":"2024-04-25T02:13:45.051635+0000","last_undegraded":"2024-04-25T02:13:45.051635+0000","last_fullsized":"2024-04-25T02:13:45.051635+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:37.018941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.058883+0000","last_change":"2024-04-25T02:13:44.050368+0000","last_active":"2024-04-25T02:13:45.058883+0000","last_peered":"2024-04-25T02:13:45.058883+0000","last_clean":"2024-04-25T02:13:45.058883+0000","last_became_active":"2024-04-25T02:13:44.050088+0000","last_became_peered":"2024-04-25T02:13:44.050088+0000","last_unstale":"2024-04-25T02:13:45.058883+0000","last_undegraded":"2024-04-25T02:13:45.058883+0000","last_fullsized":"2024-04-25T02:13:45.058883+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:59:33.766876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"85'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.058614+0000","last_change":"2024-04-25T02:13:43.056043+0000","last_active":"2024-04-25T02:13:45.058614+0000","last_peered":"2024-04-25T02:13:45.058614+0000","last_clean":"2024-04-25T02:13:45.058614+0000","last_became_active":"2024-04-25T02:13:43.055761+0000","last_became_peered":"2024-04-25T02:13:43.055761+0000","last_unstale":"2024-04-25T02:13:45.058614+0000","last_undegraded":"2024-04-25T02:13:45.058614+0000","last_fullsized":"2024-04-25T02:13:45.058614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:50.260391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059371+0000","last_change":"2024-04-25T02:13:44.052403+0000","last_active":"2024-04-25T02:13:45.059371+0000","last_peered":"2024-04-25T02:13:45.059371+0000","last_clean":"2024-04-25T02:13:45.059371+0000","last_became_active":"2024-04-25T02:13:44.051834+0000","last_became_peered":"2024-04-25T02:13:44.051834+0000","last_unstale":"2024-04-25T02:13:45.059371+0000","last_undegraded":"2024-04-25T02:13:45.059371+0000","last_fullsized":"2024-04-25T02:13:45.059371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:42:52.628270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052266+0000","last_change":"2024-04-25T02:13:43.054336+0000","last_active":"2024-04-25T02:13:45.052266+0000","last_peered":"2024-04-25T02:13:45.052266+0000","last_clean":"2024-04-25T02:13:45.052266+0000","last_became_active":"2024-04-25T02:13:43.054072+0000","last_became_peered":"2024-04-25T02:13:43.054072+0000","last_unstale":"2024-04-25T02:13:45.052266+0000","last_undegraded":"2024-04-25T02:13:45.052266+0000","last_fullsized":"2024-04-25T02:13:45.052266+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:42.199104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052140+0000","last_change":"2024-04-25T02:13:44.050597+0000","last_active":"2024-04-25T02:13:45.052140+0000","last_peered":"2024-04-25T02:13:45.052140+0000","last_clean":"2024-04-25T02:13:45.052140+0000","last_became_active":"2024-04-25T02:13:44.049881+0000","last_became_peered":"2024-04-25T02:13:44.049881+0000","last_unstale":"2024-04-25T02:13:45.052140+0000","last_undegraded":"2024-04-25T02:13:45.052140+0000","last_fullsized":"2024-04-25T02:13:45.052140+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:44:28.580382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059000+0000","last_change":"2024-04-25T02:13:43.056583+0000","last_active":"2024-04-25T02:13:45.059000+0000","last_peered":"2024-04-25T02:13:45.059000+0000","last_clean":"2024-04-25T02:13:45.059000+0000","last_became_active":"2024-04-25T02:13:43.056209+0000","last_became_peered":"2024-04-25T02:13:43.056209+0000","last_unstale":"2024-04-25T02:13:45.059000+0000","last_undegraded":"2024-04-25T02:13:45.059000+0000","last_fullsized":"2024-04-25T02:13:45.059000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:20.657979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059724+0000","last_change":"2024-04-25T02:13:44.057204+0000","last_active":"2024-04-25T02:13:45.059724+0000","last_peered":"2024-04-25T02:13:45.059724+0000","last_clean":"2024-04-25T02:13:45.059724+0000","last_became_active":"2024-04-25T02:13:44.056903+0000","last_became_peered":"2024-04-25T02:13:44.056903+0000","last_unstale":"2024-04-25T02:13:45.059724+0000","last_undegraded":"2024-04-25T02:13:45.059724+0000","last_fullsized":"2024-04-25T02:13:45.059724+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:42:52.628270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059913+0000","last_change":"2024-04-25T02:13:43.049819+0000","last_active":"2024-04-25T02:13:45.059913+0000","last_peered":"2024-04-25T02:13:45.059913+0000","last_clean":"2024-04-25T02:13:45.059913+0000","last_became_active":"2024-04-25T02:13:43.048410+0000","last_became_peered":"2024-04-25T02:13:43.048410+0000","last_unstale":"2024-04-25T02:13:45.059913+0000","last_undegraded":"2024-04-25T02:13:45.059913+0000","last_fullsized":"2024-04-25T02:13:45.059913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:31.191426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051176+0000","last_change":"2024-04-25T02:13:44.060629+0000","last_active":"2024-04-25T02:13:45.051176+0000","last_peered":"2024-04-25T02:13:45.051176+0000","last_clean":"2024-04-25T02:13:45.051176+0000","last_became_active":"2024-04-25T02:13:44.060236+0000","last_became_peered":"2024-04-25T02:13:44.060236+0000","last_unstale":"2024-04-25T02:13:45.051176+0000","last_undegraded":"2024-04-25T02:13:45.051176+0000","last_fullsized":"2024-04-25T02:13:45.051176+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:48.719407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059372+0000","last_change":"2024-04-25T02:13:43.045278+0000","last_active":"2024-04-25T02:13:45.059372+0000","last_peered":"2024-04-25T02:13:45.059372+0000","last_clean":"2024-04-25T02:13:45.059372+0000","last_became_active":"2024-04-25T02:13:43.045014+0000","last_became_peered":"2024-04-25T02:13:43.045014+0000","last_unstale":"2024-04-25T02:13:45.059372+0000","last_undegraded":"2024-04-25T02:13:45.059372+0000","last_fullsized":"2024-04-25T02:13:45.059372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:00.615318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051389+0000","last_change":"2024-04-25T02:13:44.057818+0000","last_active":"2024-04-25T02:13:45.051389+0000","last_peered":"2024-04-25T02:13:45.051389+0000","last_clean":"2024-04-25T02:13:45.051389+0000","last_became_active":"2024-04-25T02:13:44.057326+0000","last_became_peered":"2024-04-25T02:13:44.057326+0000","last_unstale":"2024-04-25T02:13:45.051389+0000","last_undegraded":"2024-04-25T02:13:45.051389+0000","last_fullsized":"2024-04-25T02:13:45.051389+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:21.665309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051229+0000","last_change":"2024-04-25T02:13:43.049803+0000","last_active":"2024-04-25T02:13:45.051229+0000","last_peered":"2024-04-25T02:13:45.051229+0000","last_clean":"2024-04-25T02:13:45.051229+0000","last_became_active":"2024-04-25T02:13:43.049523+0000","last_became_peered":"2024-04-25T02:13:43.049523+0000","last_unstale":"2024-04-25T02:13:45.051229+0000","last_undegraded":"2024-04-25T02:13:45.051229+0000","last_fullsized":"2024-04-25T02:13:45.051229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:55.197127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.050844+0000","last_change":"2024-04-25T02:13:44.049027+0000","last_active":"2024-04-25T02:13:45.050844+0000","last_peered":"2024-04-25T02:13:45.050844+0000","last_clean":"2024-04-25T02:13:45.050844+0000","last_became_active":"2024-04-25T02:13:44.048682+0000","last_became_peered":"2024-04-25T02:13:44.048682+0000","last_unstale":"2024-04-25T02:13:45.050844+0000","last_undegraded":"2024-04-25T02:13:45.050844+0000","last_fullsized":"2024-04-25T02:13:45.050844+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:51.742945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.050916+0000","last_change":"2024-04-25T02:13:43.047567+0000","last_active":"2024-04-25T02:13:45.050916+0000","last_peered":"2024-04-25T02:13:45.050916+0000","last_clean":"2024-04-25T02:13:45.050916+0000","last_became_active":"2024-04-25T02:13:43.047325+0000","last_became_peered":"2024-04-25T02:13:43.047325+0000","last_unstale":"2024-04-25T02:13:45.050916+0000","last_undegraded":"2024-04-25T02:13:45.050916+0000","last_fullsized":"2024-04-25T02:13:45.050916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:21.936400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051208+0000","last_change":"2024-04-25T02:13:44.056121+0000","last_active":"2024-04-25T02:13:45.051208+0000","last_peered":"2024-04-25T02:13:45.051208+0000","last_clean":"2024-04-25T02:13:45.051208+0000","last_became_active":"2024-04-25T02:13:44.055776+0000","last_became_peered":"2024-04-25T02:13:44.055776+0000","last_unstale":"2024-04-25T02:13:45.051208+0000","last_undegraded":"2024-04-25T02:13:45.051208+0000","last_fullsized":"2024-04-25T02:13:45.051208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:59.080953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.058860+0000","last_change":"2024-04-25T02:13:43.043103+0000","last_active":"2024-04-25T02:13:45.058860+0000","last_peered":"2024-04-25T02:13:45.058860+0000","last_clean":"2024-04-25T02:13:45.058860+0000","last_became_active":"2024-04-25T02:13:43.042808+0000","last_became_peered":"2024-04-25T02:13:43.042808+0000","last_unstale":"2024-04-25T02:13:45.058860+0000","last_undegraded":"2024-04-25T02:13:45.058860+0000","last_fullsized":"2024-04-25T02:13:45.058860+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:32.573516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059833+0000","last_change":"2024-04-25T02:13:44.043142+0000","last_active":"2024-04-25T02:13:45.059833+0000","last_peered":"2024-04-25T02:13:45.059833+0000","last_clean":"2024-04-25T02:13:45.059833+0000","last_became_active":"2024-04-25T02:13:44.042747+0000","last_became_peered":"2024-04-25T02:13:44.042747+0000","last_unstale":"2024-04-25T02:13:45.059833+0000","last_undegraded":"2024-04-25T02:13:45.059833+0000","last_fullsized":"2024-04-25T02:13:45.059833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:56.935832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.060025+0000","last_change":"2024-04-25T02:13:43.052396+0000","last_active":"2024-04-25T02:13:45.060025+0000","last_peered":"2024-04-25T02:13:45.060025+0000","last_clean":"2024-04-25T02:13:45.060025+0000","last_became_active":"2024-04-25T02:13:43.052107+0000","last_became_peered":"2024-04-25T02:13:43.052107+0000","last_unstale":"2024-04-25T02:13:45.060025+0000","last_undegraded":"2024-04-25T02:13:45.060025+0000","last_fullsized":"2024-04-25T02:13:45.060025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:08:16.341873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059248+0000","last_change":"2024-04-25T02:13:44.055102+0000","last_active":"2024-04-25T02:13:45.059248+0000","last_peered":"2024-04-25T02:13:45.059248+0000","last_clean":"2024-04-25T02:13:45.059248+0000","last_became_active":"2024-04-25T02:13:44.054796+0000","last_became_peered":"2024-04-25T02:13:44.054796+0000","last_unstale":"2024-04-25T02:13:45.059248+0000","last_undegraded":"2024-04-25T02:13:45.059248+0000","last_fullsized":"2024-04-25T02:13:45.059248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:19:15.933023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059671+0000","last_change":"2024-04-25T02:13:43.047689+0000","last_active":"2024-04-25T02:13:45.059671+0000","last_peered":"2024-04-25T02:13:45.059671+0000","last_clean":"2024-04-25T02:13:45.059671+0000","last_became_active":"2024-04-25T02:13:43.047441+0000","last_became_peered":"2024-04-25T02:13:43.047441+0000","last_unstale":"2024-04-25T02:13:45.059671+0000","last_undegraded":"2024-04-25T02:13:45.059671+0000","last_fullsized":"2024-04-25T02:13:45.059671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:48.985842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052112+0000","last_change":"2024-04-25T02:13:44.056976+0000","last_active":"2024-04-25T02:13:45.052112+0000","last_peered":"2024-04-25T02:13:45.052112+0000","last_clean":"2024-04-25T02:13:45.052112+0000","last_became_active":"2024-04-25T02:13:44.056713+0000","last_became_peered":"2024-04-25T02:13:44.056713+0000","last_unstale":"2024-04-25T02:13:45.052112+0000","last_undegraded":"2024-04-25T02:13:45.052112+0000","last_fullsized":"2024-04-25T02:13:45.052112+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:10.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051904+0000","last_change":"2024-04-25T02:13:43.053298+0000","last_active":"2024-04-25T02:13:45.051904+0000","last_peered":"2024-04-25T02:13:45.051904+0000","last_clean":"2024-04-25T02:13:45.051904+0000","last_became_active":"2024-04-25T02:13:43.053009+0000","last_became_peered":"2024-04-25T02:13:43.053009+0000","last_unstale":"2024-04-25T02:13:45.051904+0000","last_undegraded":"2024-04-25T02:13:45.051904+0000","last_fullsized":"2024-04-25T02:13:45.051904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:58.073624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059878+0000","last_change":"2024-04-25T02:13:44.048506+0000","last_active":"2024-04-25T02:13:45.059878+0000","last_peered":"2024-04-25T02:13:45.059878+0000","last_clean":"2024-04-25T02:13:45.059878+0000","last_became_active":"2024-04-25T02:13:44.048208+0000","last_became_peered":"2024-04-25T02:13:44.048208+0000","last_unstale":"2024-04-25T02:13:45.059878+0000","last_undegraded":"2024-04-25T02:13:45.059878+0000","last_fullsized":"2024-04-25T02:13:45.059878+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:55.135858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052158+0000","last_change":"2024-04-25T02:13:43.050467+0000","last_active":"2024-04-25T02:13:45.052158+0000","last_peered":"2024-04-25T02:13:45.052158+0000","last_clean":"2024-04-25T02:13:45.052158+0000","last_became_active":"2024-04-25T02:13:43.050193+0000","last_became_peered":"2024-04-25T02:13:43.050193+0000","last_unstale":"2024-04-25T02:13:45.052158+0000","last_undegraded":"2024-04-25T02:13:45.052158+0000","last_fullsized":"2024-04-25T02:13:45.052158+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:44.924653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051367+0000","last_change":"2024-04-25T02:13:44.052793+0000","last_active":"2024-04-25T02:13:45.051367+0000","last_peered":"2024-04-25T02:13:45.051367+0000","last_clean":"2024-04-25T02:13:45.051367+0000","last_became_active":"2024-04-25T02:13:44.052524+0000","last_became_peered":"2024-04-25T02:13:44.052524+0000","last_unstale":"2024-04-25T02:13:45.051367+0000","last_undegraded":"2024-04-25T02:13:45.051367+0000","last_fullsized":"2024-04-25T02:13:45.051367+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:51.267721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059135+0000","last_change":"2024-04-25T02:13:43.056167+0000","last_active":"2024-04-25T02:13:45.059135+0000","last_peered":"2024-04-25T02:13:45.059135+0000","last_clean":"2024-04-25T02:13:45.059135+0000","last_became_active":"2024-04-25T02:13:43.055901+0000","last_became_peered":"2024-04-25T02:13:43.055901+0000","last_unstale":"2024-04-25T02:13:45.059135+0000","last_undegraded":"2024-04-25T02:13:45.059135+0000","last_fullsized":"2024-04-25T02:13:45.059135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:47.094381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059044+0000","last_change":"2024-04-25T02:13:44.054524+0000","last_active":"2024-04-25T02:13:45.059044+0000","last_peered":"2024-04-25T02:13:45.059044+0000","last_clean":"2024-04-25T02:13:45.059044+0000","last_became_active":"2024-04-25T02:13:44.052126+0000","last_became_peered":"2024-04-25T02:13:44.052126+0000","last_unstale":"2024-04-25T02:13:45.059044+0000","last_undegraded":"2024-04-25T02:13:45.059044+0000","last_fullsized":"2024-04-25T02:13:45.059044+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:05.980481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059117+0000","last_change":"2024-04-25T02:13:43.054235+0000","last_active":"2024-04-25T02:13:45.059117+0000","last_peered":"2024-04-25T02:13:45.059117+0000","last_clean":"2024-04-25T02:13:45.059117+0000","last_became_active":"2024-04-25T02:13:43.053961+0000","last_became_peered":"2024-04-25T02:13:43.053961+0000","last_unstale":"2024-04-25T02:13:45.059117+0000","last_undegraded":"2024-04-25T02:13:45.059117+0000","last_fullsized":"2024-04-25T02:13:45.059117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:41.827637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059843+0000","last_change":"2024-04-25T02:13:44.054359+0000","last_active":"2024-04-25T02:13:45.059843+0000","last_peered":"2024-04-25T02:13:45.059843+0000","last_clean":"2024-04-25T02:13:45.059843+0000","last_became_active":"2024-04-25T02:13:44.054089+0000","last_became_peered":"2024-04-25T02:13:44.054089+0000","last_unstale":"2024-04-25T02:13:45.059843+0000","last_undegraded":"2024-04-25T02:13:45.059843+0000","last_fullsized":"2024-04-25T02:13:45.059843+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:05.980481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051607+0000","last_change":"2024-04-25T02:13:43.052349+0000","last_active":"2024-04-25T02:13:45.051607+0000","last_peered":"2024-04-25T02:13:45.051607+0000","last_clean":"2024-04-25T02:13:45.051607+0000","last_became_active":"2024-04-25T02:13:43.052101+0000","last_became_peered":"2024-04-25T02:13:43.052101+0000","last_unstale":"2024-04-25T02:13:45.051607+0000","last_undegraded":"2024-04-25T02:13:45.051607+0000","last_fullsized":"2024-04-25T02:13:45.051607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:08.876286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051499+0000","last_change":"2024-04-25T02:13:44.056275+0000","last_active":"2024-04-25T02:13:45.051499+0000","last_peered":"2024-04-25T02:13:45.051499+0000","last_clean":"2024-04-25T02:13:45.051499+0000","last_became_active":"2024-04-25T02:13:44.055949+0000","last_became_peered":"2024-04-25T02:13:44.055949+0000","last_unstale":"2024-04-25T02:13:45.051499+0000","last_undegraded":"2024-04-25T02:13:45.051499+0000","last_fullsized":"2024-04-25T02:13:45.051499+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:05.980481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059021+0000","last_change":"2024-04-25T02:13:43.057973+0000","last_active":"2024-04-25T02:13:45.059021+0000","last_peered":"2024-04-25T02:13:45.059021+0000","last_clean":"2024-04-25T02:13:45.059021+0000","last_became_active":"2024-04-25T02:13:43.057693+0000","last_became_peered":"2024-04-25T02:13:43.057693+0000","last_unstale":"2024-04-25T02:13:45.059021+0000","last_undegraded":"2024-04-25T02:13:45.059021+0000","last_fullsized":"2024-04-25T02:13:45.059021+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:28.302730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059282+0000","last_change":"2024-04-25T02:13:44.056037+0000","last_active":"2024-04-25T02:13:45.059282+0000","last_peered":"2024-04-25T02:13:45.059282+0000","last_clean":"2024-04-25T02:13:45.059282+0000","last_became_active":"2024-04-25T02:13:44.055572+0000","last_became_peered":"2024-04-25T02:13:44.055572+0000","last_unstale":"2024-04-25T02:13:45.059282+0000","last_undegraded":"2024-04-25T02:13:45.059282+0000","last_fullsized":"2024-04-25T02:13:45.059282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:38.860627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059676+0000","last_change":"2024-04-25T02:13:43.052388+0000","last_active":"2024-04-25T02:13:45.059676+0000","last_peered":"2024-04-25T02:13:45.059676+0000","last_clean":"2024-04-25T02:13:45.059676+0000","last_became_active":"2024-04-25T02:13:43.052114+0000","last_became_peered":"2024-04-25T02:13:43.052114+0000","last_unstale":"2024-04-25T02:13:45.059676+0000","last_undegraded":"2024-04-25T02:13:45.059676+0000","last_fullsized":"2024-04-25T02:13:45.059676+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:44.924653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":288,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059779+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:13:45.059779+0000","last_peered":"2024-04-25T02:13:45.059779+0000","last_clean":"2024-04-25T02:13:45.059779+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:13:45.059779+0000","last_undegraded":"2024-04-25T02:13:45.059779+0000","last_fullsized":"2024-04-25T02:13:45.059779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1654784,"data_stored":1040151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1069056,"data_stored":450407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1073152,"data_stored":451347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1056768,"data_stored":449713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1069056,"data_stored":451325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":450295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1069056,"data_stored":449907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1654784,"data_stored":1040115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:13:48.018 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:13:48.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.144+0000 7f2fb714f640 1 Processor -- start 2024-04-25T02:13:48.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.145+0000 7f2fb714f640 1 -- start start 2024-04-25T02:13:48.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.145+0000 7f2fb714f640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2fb0143bc0 0x7f2fb015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.145+0000 7f2fb714f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb006df50 0x7f2fb006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.145+0000 7f2fb714f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fb015fa40 con 0x7f2fb00b48e0 2024-04-25T02:13:48.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.145+0000 7f2fb714f640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb006e8f0 con 0x7f2fb0143bc0 2024-04-25T02:13:48.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.145+0000 7f2fb714f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb0072cb0 con 0x7f2fb006df50 2024-04-25T02:13:48.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.146+0000 7f2fb4eeb640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2fb0143bc0 0x7f2fb015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.146+0000 7f2faffff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb006df50 0x7f2fb006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.146+0000 7f2fb4eeb640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2fb0143bc0 0x7f2fb015f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:54030/0 (socket says 172.21.15.79:54030) 2024-04-25T02:13:48.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.146+0000 7f2fb4eeb640 1 -- 172.21.15.79:0/628639725 learned_addr learned my addr 172.21.15.79:0/628639725 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:48.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.146+0000 7f2fb56ec640 1 --1- 172.21.15.79:0/628639725 >> v1:172.21.15.189:6789/0 conn(0x7f2fb00b48e0 0x7f2fb00b4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:34236/0 (socket says 172.21.15.79:34236) 2024-04-25T02:13:48.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.146+0000 7f2faffff640 1 -- 172.21.15.79:0/628639725 >> v2:172.21.15.189:3300/0 conn(0x7f2fb0143bc0 msgr2=0x7f2fb015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:48.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.146+0000 7f2faffff640 1 --2- 172.21.15.79:0/628639725 >> v2:172.21.15.189:3300/0 conn(0x7f2fb0143bc0 0x7f2fb015f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.146+0000 7f2faffff640 1 -- 172.21.15.79:0/628639725 >> v1:172.21.15.189:6789/0 conn(0x7f2fb00b48e0 legacy=0x7f2fb00b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.146+0000 7f2faffff640 1 -- 172.21.15.79:0/628639725 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb00720a0 con 0x7f2fb006df50 2024-04-25T02:13:48.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.146+0000 7f2fb4eeb640 1 --2- 172.21.15.79:0/628639725 >> v2:172.21.15.189:3300/0 conn(0x7f2fb0143bc0 0x7f2fb015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:13:48.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.147+0000 7f2faffff640 1 --2- 172.21.15.79:0/628639725 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb006df50 0x7f2fb006e3b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0097a0 tx=0x7f2f9c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87bc93a83c13fd56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:48.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.147+0000 7f2faf7fe640 1 -- 172.21.15.79:0/628639725 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c037070 con 0x7f2fb006df50 2024-04-25T02:13:48.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.147+0000 7f2faf7fe640 1 -- 172.21.15.79:0/628639725 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9c02ae50 con 0x7f2fb006df50 2024-04-25T02:13:48.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.147+0000 7f2faf7fe640 1 -- 172.21.15.79:0/628639725 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c032660 con 0x7f2fb006df50 2024-04-25T02:13:48.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.148+0000 7f2fb714f640 1 -- 172.21.15.79:0/628639725 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb006df50 msgr2=0x7f2fb006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.148+0000 7f2fb714f640 1 --2- 172.21.15.79:0/628639725 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb006df50 0x7f2fb006e3b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0097a0 tx=0x7f2f9c02a100 comp rx=0 tx=0).stop 2024-04-25T02:13:48.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.148+0000 7f2fb714f640 1 -- 172.21.15.79:0/628639725 shutdown_connections 2024-04-25T02:13:48.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.148+0000 7f2fb714f640 1 --2- 172.21.15.79:0/628639725 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb006df50 0x7f2fb006e3b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.148+0000 7f2fb714f640 1 --2- 172.21.15.79:0/628639725 >> v2:172.21.15.189:3300/0 conn(0x7f2fb0143bc0 0x7f2fb015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.148+0000 7f2fb714f640 1 -- 172.21.15.79:0/628639725 >> 172.21.15.79:0/628639725 conn(0x7f2fb00cfc80 msgr2=0x7f2fb00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:48.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.148+0000 7f2fb714f640 1 -- 172.21.15.79:0/628639725 shutdown_connections 2024-04-25T02:13:48.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.148+0000 7f2fb714f640 1 -- 172.21.15.79:0/628639725 wait complete. 2024-04-25T02:13:48.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.149+0000 7f2fb714f640 1 Processor -- start 2024-04-25T02:13:48.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.149+0000 7f2fb714f640 1 -- start start 2024-04-25T02:13:48.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb714f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fb006df50 0x7f2fb013a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb714f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb00b48e0 0x7f2fb015dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb714f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb0143bc0 0x7f2fb013cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb714f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb0072940 con 0x7f2fb0143bc0 2024-04-25T02:13:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb714f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb0072660 con 0x7f2fb006df50 2024-04-25T02:13:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb714f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb0143fa0 con 0x7f2fb00b48e0 2024-04-25T02:13:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb56ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb0143bc0 0x7f2fb013cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb56ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb0143bc0 0x7f2fb013cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33230/0 (socket says 172.21.15.79:33230) 2024-04-25T02:13:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb56ec640 1 -- 172.21.15.79:0/376229416 learned_addr learned my addr 172.21.15.79:0/376229416 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb4eeb640 1 --2- 172.21.15.79:0/376229416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fb006df50 0x7f2fb013a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2faffff640 1 --2- 172.21.15.79:0/376229416 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb00b48e0 0x7f2fb015dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb56ec640 1 -- 172.21.15.79:0/376229416 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb00b48e0 msgr2=0x7f2fb015dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb56ec640 1 --2- 172.21.15.79:0/376229416 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb00b48e0 0x7f2fb015dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb56ec640 1 -- 172.21.15.79:0/376229416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fb006df50 msgr2=0x7f2fb013a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb56ec640 1 --2- 172.21.15.79:0/376229416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fb006df50 0x7f2fb013a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb56ec640 1 -- 172.21.15.79:0/376229416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb013ac00 con 0x7f2fb0143bc0 2024-04-25T02:13:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fb56ec640 1 --2- 172.21.15.79:0/376229416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb0143bc0 0x7f2fb013cdf0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800c780 tx=0x7f2fa800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.150+0000 7f2fad7fa640 1 -- 172.21.15.79:0/376229416 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8017070 con 0x7f2fb0143bc0 2024-04-25T02:13:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.151+0000 7f2fad7fa640 1 -- 172.21.15.79:0/376229416 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa800a640 con 0x7f2fb0143bc0 2024-04-25T02:13:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.151+0000 7f2fb714f640 1 -- 172.21.15.79:0/376229416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb0141e90 con 0x7f2fb0143bc0 2024-04-25T02:13:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.151+0000 7f2fad7fa640 1 -- 172.21.15.79:0/376229416 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa800aa30 con 0x7f2fb0143bc0 2024-04-25T02:13:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.151+0000 7f2fb714f640 1 -- 172.21.15.79:0/376229416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb0142450 con 0x7f2fb0143bc0 2024-04-25T02:13:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.152+0000 7f2fb714f640 1 -- 172.21.15.79:0/376229416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb00690a0 con 0x7f2fb0143bc0 2024-04-25T02:13:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.152+0000 7f2fad7fa640 1 -- 172.21.15.79:0/376229416 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fa801a070 con 0x7f2fb0143bc0 2024-04-25T02:13:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.152+0000 7f2fad7fa640 1 --2- 172.21.15.79:0/376229416 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2f9406be30 0x7f2f9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.152+0000 7f2fad7fa640 1 -- 172.21.15.79:0/376229416 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f2fa808a370 con 0x7f2fb0143bc0 2024-04-25T02:13:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.152+0000 7f2fb4eeb640 1 --2- 172.21.15.79:0/376229416 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2f9406be30 0x7f2f9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.153+0000 7f2fb4eeb640 1 --2- 172.21.15.79:0/376229416 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2f9406be30 0x7f2f9406e2f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4006ca0 tx=0x7f2fa4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:48.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.157+0000 7f2fad7fa640 1 -- 172.21.15.79:0/376229416 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2fb013ac00 con 0x7f2fb0143bc0 2024-04-25T02:13:48.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.327+0000 7f2fb714f640 1 -- 172.21.15.79:0/376229416 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2fb013fed0 con 0x7f2f9406be30 2024-04-25T02:13:48.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.332+0000 7f2fad7fa640 1 -- 172.21.15.79:0/376229416 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252084 (secure 0 0 0) 0x7f2fb013fed0 con 0x7f2f9406be30 2024-04-25T02:13:48.343 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:48.345 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:13:48.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.335+0000 7f2fb714f640 1 -- 172.21.15.79:0/376229416 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2f9406be30 msgr2=0x7f2f9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.335+0000 7f2fb714f640 1 --2- 172.21.15.79:0/376229416 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2f9406be30 0x7f2f9406e2f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4006ca0 tx=0x7f2fa4009240 comp rx=0 tx=0).stop 2024-04-25T02:13:48.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.335+0000 7f2fb714f640 1 -- 172.21.15.79:0/376229416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb0143bc0 msgr2=0x7f2fb013cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.335+0000 7f2fb714f640 1 --2- 172.21.15.79:0/376229416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb0143bc0 0x7f2fb013cdf0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800c780 tx=0x7f2fa800cc40 comp rx=0 tx=0).stop 2024-04-25T02:13:48.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.335+0000 7f2fb714f640 1 -- 172.21.15.79:0/376229416 shutdown_connections 2024-04-25T02:13:48.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.335+0000 7f2fb714f640 1 --2- 172.21.15.79:0/376229416 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2f9406be30 0x7f2f9406e2f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.335+0000 7f2fb714f640 1 --2- 172.21.15.79:0/376229416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb0143bc0 0x7f2fb013cdf0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.335+0000 7f2fb714f640 1 --2- 172.21.15.79:0/376229416 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb00b48e0 0x7f2fb015dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.335+0000 7f2fb714f640 1 --2- 172.21.15.79:0/376229416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fb006df50 0x7f2fb013a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.335+0000 7f2fb714f640 1 -- 172.21.15.79:0/376229416 >> 172.21.15.79:0/376229416 conn(0x7f2fb00cfc80 msgr2=0x7f2fb00cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:48.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.336+0000 7f2fb714f640 1 -- 172.21.15.79:0/376229416 shutdown_connections 2024-04-25T02:13:48.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.336+0000 7f2fb714f640 1 -- 172.21.15.79:0/376229416 wait complete. 2024-04-25T02:13:48.352 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2024-04-25T02:13:47.249487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246500,"kb_used_data":9480,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754728220,"statfs":{"total":773094113280,"available":772841697280,"internally_reserved":0,"allocated":9707520,"data_stored":4783260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":242535988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.222300"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051980+0000","last_change":"2024-04-25T02:13:44.050809+0000","last_active":"2024-04-25T02:13:45.051980+0000","last_peered":"2024-04-25T02:13:45.051980+0000","last_clean":"2024-04-25T02:13:45.051980+0000","last_became_active":"2024-04-25T02:13:44.050335+0000","last_became_peered":"2024-04-25T02:13:44.050335+0000","last_unstale":"2024-04-25T02:13:45.051980+0000","last_undegraded":"2024-04-25T02:13:45.051980+0000","last_fullsized":"2024-04-25T02:13:45.051980+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:01.814394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059724+0000","last_change":"2024-04-25T02:13:44.052328+0000","last_active":"2024-04-25T02:13:45.059724+0000","last_peered":"2024-04-25T02:13:45.059724+0000","last_clean":"2024-04-25T02:13:45.059724+0000","last_became_active":"2024-04-25T02:13:44.052034+0000","last_became_peered":"2024-04-25T02:13:44.052034+0000","last_unstale":"2024-04-25T02:13:45.059724+0000","last_undegraded":"2024-04-25T02:13:45.059724+0000","last_fullsized":"2024-04-25T02:13:45.059724+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:38.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059335+0000","last_change":"2024-04-25T02:13:44.055084+0000","last_active":"2024-04-25T02:13:45.059335+0000","last_peered":"2024-04-25T02:13:45.059335+0000","last_clean":"2024-04-25T02:13:45.059335+0000","last_became_active":"2024-04-25T02:13:44.054809+0000","last_became_peered":"2024-04-25T02:13:44.054809+0000","last_unstale":"2024-04-25T02:13:45.059335+0000","last_undegraded":"2024-04-25T02:13:45.059335+0000","last_fullsized":"2024-04-25T02:13:45.059335+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:54.077844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051048+0000","last_change":"2024-04-25T02:13:44.062534+0000","last_active":"2024-04-25T02:13:45.051048+0000","last_peered":"2024-04-25T02:13:45.051048+0000","last_clean":"2024-04-25T02:13:45.051048+0000","last_became_active":"2024-04-25T02:13:44.062245+0000","last_became_peered":"2024-04-25T02:13:44.062245+0000","last_unstale":"2024-04-25T02:13:45.051048+0000","last_undegraded":"2024-04-25T02:13:45.051048+0000","last_fullsized":"2024-04-25T02:13:45.051048+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:42.846321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059490+0000","last_change":"2024-04-25T02:13:44.057243+0000","last_active":"2024-04-25T02:13:45.059490+0000","last_peered":"2024-04-25T02:13:45.059490+0000","last_clean":"2024-04-25T02:13:45.059490+0000","last_became_active":"2024-04-25T02:13:44.056925+0000","last_became_peered":"2024-04-25T02:13:44.056925+0000","last_unstale":"2024-04-25T02:13:45.059490+0000","last_undegraded":"2024-04-25T02:13:45.059490+0000","last_fullsized":"2024-04-25T02:13:45.059490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:58.840648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051238+0000","last_change":"2024-04-25T02:13:44.050824+0000","last_active":"2024-04-25T02:13:45.051238+0000","last_peered":"2024-04-25T02:13:45.051238+0000","last_clean":"2024-04-25T02:13:45.051238+0000","last_became_active":"2024-04-25T02:13:44.050412+0000","last_became_peered":"2024-04-25T02:13:44.050412+0000","last_unstale":"2024-04-25T02:13:45.051238+0000","last_undegraded":"2024-04-25T02:13:45.051238+0000","last_fullsized":"2024-04-25T02:13:45.051238+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:34.374603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.050820+0000","last_change":"2024-04-25T02:13:44.048494+0000","last_active":"2024-04-25T02:13:45.050820+0000","last_peered":"2024-04-25T02:13:45.050820+0000","last_clean":"2024-04-25T02:13:45.050820+0000","last_became_active":"2024-04-25T02:13:44.048199+0000","last_became_peered":"2024-04-25T02:13:44.048199+0000","last_unstale":"2024-04-25T02:13:45.050820+0000","last_undegraded":"2024-04-25T02:13:45.050820+0000","last_fullsized":"2024-04-25T02:13:45.050820+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:59:14.755757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051026+0000","last_change":"2024-04-25T02:13:44.054808+0000","last_active":"2024-04-25T02:13:45.051026+0000","last_peered":"2024-04-25T02:13:45.051026+0000","last_clean":"2024-04-25T02:13:45.051026+0000","last_became_active":"2024-04-25T02:13:44.054551+0000","last_became_peered":"2024-04-25T02:13:44.054551+0000","last_unstale":"2024-04-25T02:13:45.051026+0000","last_undegraded":"2024-04-25T02:13:45.051026+0000","last_fullsized":"2024-04-25T02:13:45.051026+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:16.945232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051605+0000","last_change":"2024-04-25T02:13:44.055615+0000","last_active":"2024-04-25T02:13:45.051605+0000","last_peered":"2024-04-25T02:13:45.051605+0000","last_clean":"2024-04-25T02:13:45.051605+0000","last_became_active":"2024-04-25T02:13:44.055361+0000","last_became_peered":"2024-04-25T02:13:44.055361+0000","last_unstale":"2024-04-25T02:13:45.051605+0000","last_undegraded":"2024-04-25T02:13:45.051605+0000","last_fullsized":"2024-04-25T02:13:45.051605+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:48.101710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052037+0000","last_change":"2024-04-25T02:13:44.057946+0000","last_active":"2024-04-25T02:13:45.052037+0000","last_peered":"2024-04-25T02:13:45.052037+0000","last_clean":"2024-04-25T02:13:45.052037+0000","last_became_active":"2024-04-25T02:13:44.057689+0000","last_became_peered":"2024-04-25T02:13:44.057689+0000","last_unstale":"2024-04-25T02:13:45.052037+0000","last_undegraded":"2024-04-25T02:13:45.052037+0000","last_fullsized":"2024-04-25T02:13:45.052037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:42.984245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059517+0000","last_change":"2024-04-25T02:13:44.051150+0000","last_active":"2024-04-25T02:13:45.059517+0000","last_peered":"2024-04-25T02:13:45.059517+0000","last_clean":"2024-04-25T02:13:45.059517+0000","last_became_active":"2024-04-25T02:13:44.050885+0000","last_became_peered":"2024-04-25T02:13:44.050885+0000","last_unstale":"2024-04-25T02:13:45.059517+0000","last_undegraded":"2024-04-25T02:13:45.059517+0000","last_fullsized":"2024-04-25T02:13:45.059517+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:42.834967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051902+0000","last_change":"2024-04-25T02:13:44.058536+0000","last_active":"2024-04-25T02:13:45.051902+0000","last_peered":"2024-04-25T02:13:45.051902+0000","last_clean":"2024-04-25T02:13:45.051902+0000","last_became_active":"2024-04-25T02:13:44.058293+0000","last_became_peered":"2024-04-25T02:13:44.058293+0000","last_unstale":"2024-04-25T02:13:45.051902+0000","last_undegraded":"2024-04-25T02:13:45.051902+0000","last_fullsized":"2024-04-25T02:13:45.051902+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:47.297520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059896+0000","last_change":"2024-04-25T02:13:44.054094+0000","last_active":"2024-04-25T02:13:45.059896+0000","last_peered":"2024-04-25T02:13:45.059896+0000","last_clean":"2024-04-25T02:13:45.059896+0000","last_became_active":"2024-04-25T02:13:44.053753+0000","last_became_peered":"2024-04-25T02:13:44.053753+0000","last_unstale":"2024-04-25T02:13:45.059896+0000","last_undegraded":"2024-04-25T02:13:45.059896+0000","last_fullsized":"2024-04-25T02:13:45.059896+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:47.675994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051045+0000","last_change":"2024-04-25T02:13:44.065753+0000","last_active":"2024-04-25T02:13:45.051045+0000","last_peered":"2024-04-25T02:13:45.051045+0000","last_clean":"2024-04-25T02:13:45.051045+0000","last_became_active":"2024-04-25T02:13:44.065373+0000","last_became_peered":"2024-04-25T02:13:44.065373+0000","last_unstale":"2024-04-25T02:13:45.051045+0000","last_undegraded":"2024-04-25T02:13:45.051045+0000","last_fullsized":"2024-04-25T02:13:45.051045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:27.161509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059000+0000","last_change":"2024-04-25T02:13:44.057620+0000","last_active":"2024-04-25T02:13:45.059000+0000","last_peered":"2024-04-25T02:13:45.059000+0000","last_clean":"2024-04-25T02:13:45.059000+0000","last_became_active":"2024-04-25T02:13:44.057294+0000","last_became_peered":"2024-04-25T02:13:44.057294+0000","last_unstale":"2024-04-25T02:13:45.059000+0000","last_undegraded":"2024-04-25T02:13:45.059000+0000","last_fullsized":"2024-04-25T02:13:45.059000+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:45.745395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.058975+0000","last_change":"2024-04-25T02:13:44.050812+0000","last_active":"2024-04-25T02:13:45.058975+0000","last_peered":"2024-04-25T02:13:45.058975+0000","last_clean":"2024-04-25T02:13:45.058975+0000","last_became_active":"2024-04-25T02:13:44.050209+0000","last_became_peered":"2024-04-25T02:13:44.050209+0000","last_unstale":"2024-04-25T02:13:45.058975+0000","last_undegraded":"2024-04-25T02:13:45.058975+0000","last_fullsized":"2024-04-25T02:13:45.058975+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:21.665309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059591+0000","last_change":"2024-04-25T02:13:44.052576+0000","last_active":"2024-04-25T02:13:45.059591+0000","last_peered":"2024-04-25T02:13:45.059591+0000","last_clean":"2024-04-25T02:13:45.059591+0000","last_became_active":"2024-04-25T02:13:44.052300+0000","last_became_peered":"2024-04-25T02:13:44.052300+0000","last_unstale":"2024-04-25T02:13:45.059591+0000","last_undegraded":"2024-04-25T02:13:45.059591+0000","last_fullsized":"2024-04-25T02:13:45.059591+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:32.198755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051107+0000","last_change":"2024-04-25T02:13:44.055250+0000","last_active":"2024-04-25T02:13:45.051107+0000","last_peered":"2024-04-25T02:13:45.051107+0000","last_clean":"2024-04-25T02:13:45.051107+0000","last_became_active":"2024-04-25T02:13:44.053882+0000","last_became_peered":"2024-04-25T02:13:44.053882+0000","last_unstale":"2024-04-25T02:13:45.051107+0000","last_undegraded":"2024-04-25T02:13:45.051107+0000","last_fullsized":"2024-04-25T02:13:45.051107+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:13.729450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059686+0000","last_change":"2024-04-25T02:13:44.052997+0000","last_active":"2024-04-25T02:13:45.059686+0000","last_peered":"2024-04-25T02:13:45.059686+0000","last_clean":"2024-04-25T02:13:45.059686+0000","last_became_active":"2024-04-25T02:13:44.052581+0000","last_became_peered":"2024-04-25T02:13:44.052581+0000","last_unstale":"2024-04-25T02:13:45.059686+0000","last_undegraded":"2024-04-25T02:13:45.059686+0000","last_fullsized":"2024-04-25T02:13:45.059686+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:47.297520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051102+0000","last_change":"2024-04-25T02:13:44.062248+0000","last_active":"2024-04-25T02:13:45.051102+0000","last_peered":"2024-04-25T02:13:45.051102+0000","last_clean":"2024-04-25T02:13:45.051102+0000","last_became_active":"2024-04-25T02:13:44.061877+0000","last_became_peered":"2024-04-25T02:13:44.061877+0000","last_unstale":"2024-04-25T02:13:45.051102+0000","last_undegraded":"2024-04-25T02:13:45.051102+0000","last_fullsized":"2024-04-25T02:13:45.051102+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:39:59.263385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051051+0000","last_change":"2024-04-25T02:13:44.063217+0000","last_active":"2024-04-25T02:13:45.051051+0000","last_peered":"2024-04-25T02:13:45.051051+0000","last_clean":"2024-04-25T02:13:45.051051+0000","last_became_active":"2024-04-25T02:13:44.062952+0000","last_became_peered":"2024-04-25T02:13:44.062952+0000","last_unstale":"2024-04-25T02:13:45.051051+0000","last_undegraded":"2024-04-25T02:13:45.051051+0000","last_fullsized":"2024-04-25T02:13:45.051051+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:51.422225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059292+0000","last_change":"2024-04-25T02:13:44.055316+0000","last_active":"2024-04-25T02:13:45.059292+0000","last_peered":"2024-04-25T02:13:45.059292+0000","last_clean":"2024-04-25T02:13:45.059292+0000","last_became_active":"2024-04-25T02:13:44.055040+0000","last_became_peered":"2024-04-25T02:13:44.055040+0000","last_unstale":"2024-04-25T02:13:45.059292+0000","last_undegraded":"2024-04-25T02:13:45.059292+0000","last_fullsized":"2024-04-25T02:13:45.059292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:38.334984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051345+0000","last_change":"2024-04-25T02:13:44.063416+0000","last_active":"2024-04-25T02:13:45.051345+0000","last_peered":"2024-04-25T02:13:45.051345+0000","last_clean":"2024-04-25T02:13:45.051345+0000","last_became_active":"2024-04-25T02:13:44.063138+0000","last_became_peered":"2024-04-25T02:13:44.063138+0000","last_unstale":"2024-04-25T02:13:45.051345+0000","last_undegraded":"2024-04-25T02:13:45.051345+0000","last_fullsized":"2024-04-25T02:13:45.051345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:55.135858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.050812+0000","last_change":"2024-04-25T02:13:44.059480+0000","last_active":"2024-04-25T02:13:45.050812+0000","last_peered":"2024-04-25T02:13:45.050812+0000","last_clean":"2024-04-25T02:13:45.050812+0000","last_became_active":"2024-04-25T02:13:44.059204+0000","last_became_peered":"2024-04-25T02:13:44.059204+0000","last_unstale":"2024-04-25T02:13:45.050812+0000","last_undegraded":"2024-04-25T02:13:45.050812+0000","last_fullsized":"2024-04-25T02:13:45.050812+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:05:47.001033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.060053+0000","last_change":"2024-04-25T02:13:44.053952+0000","last_active":"2024-04-25T02:13:45.060053+0000","last_peered":"2024-04-25T02:13:45.060053+0000","last_clean":"2024-04-25T02:13:45.060053+0000","last_became_active":"2024-04-25T02:13:44.053671+0000","last_became_peered":"2024-04-25T02:13:44.053671+0000","last_unstale":"2024-04-25T02:13:45.060053+0000","last_undegraded":"2024-04-25T02:13:45.060053+0000","last_fullsized":"2024-04-25T02:13:45.060053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:09.883615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059219+0000","last_change":"2024-04-25T02:13:44.063670+0000","last_active":"2024-04-25T02:13:45.059219+0000","last_peered":"2024-04-25T02:13:45.059219+0000","last_clean":"2024-04-25T02:13:45.059219+0000","last_became_active":"2024-04-25T02:13:44.063073+0000","last_became_peered":"2024-04-25T02:13:44.063073+0000","last_unstale":"2024-04-25T02:13:45.059219+0000","last_undegraded":"2024-04-25T02:13:45.059219+0000","last_fullsized":"2024-04-25T02:13:45.059219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:32.198755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059393+0000","last_change":"2024-04-25T02:13:44.052593+0000","last_active":"2024-04-25T02:13:45.059393+0000","last_peered":"2024-04-25T02:13:45.059393+0000","last_clean":"2024-04-25T02:13:45.059393+0000","last_became_active":"2024-04-25T02:13:44.052312+0000","last_became_peered":"2024-04-25T02:13:44.052312+0000","last_unstale":"2024-04-25T02:13:45.059393+0000","last_undegraded":"2024-04-25T02:13:45.059393+0000","last_fullsized":"2024-04-25T02:13:45.059393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:48.101710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051840+0000","last_change":"2024-04-25T02:13:44.054032+0000","last_active":"2024-04-25T02:13:45.051840+0000","last_peered":"2024-04-25T02:13:45.051840+0000","last_clean":"2024-04-25T02:13:45.051840+0000","last_became_active":"2024-04-25T02:13:44.053729+0000","last_became_peered":"2024-04-25T02:13:44.053729+0000","last_unstale":"2024-04-25T02:13:45.051840+0000","last_undegraded":"2024-04-25T02:13:45.051840+0000","last_fullsized":"2024-04-25T02:13:45.051840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:47.675994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.060022+0000","last_change":"2024-04-25T02:13:44.059742+0000","last_active":"2024-04-25T02:13:45.060022+0000","last_peered":"2024-04-25T02:13:45.060022+0000","last_clean":"2024-04-25T02:13:45.060022+0000","last_became_active":"2024-04-25T02:13:44.059438+0000","last_became_peered":"2024-04-25T02:13:44.059438+0000","last_unstale":"2024-04-25T02:13:45.060022+0000","last_undegraded":"2024-04-25T02:13:45.060022+0000","last_fullsized":"2024-04-25T02:13:45.060022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:28:26.969742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059430+0000","last_change":"2024-04-25T02:13:44.058572+0000","last_active":"2024-04-25T02:13:45.059430+0000","last_peered":"2024-04-25T02:13:45.059430+0000","last_clean":"2024-04-25T02:13:45.059430+0000","last_became_active":"2024-04-25T02:13:44.055542+0000","last_became_peered":"2024-04-25T02:13:44.055542+0000","last_unstale":"2024-04-25T02:13:45.059430+0000","last_undegraded":"2024-04-25T02:13:45.059430+0000","last_fullsized":"2024-04-25T02:13:45.059430+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:29.310059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059104+0000","last_change":"2024-04-25T02:13:44.063895+0000","last_active":"2024-04-25T02:13:45.059104+0000","last_peered":"2024-04-25T02:13:45.059104+0000","last_clean":"2024-04-25T02:13:45.059104+0000","last_became_active":"2024-04-25T02:13:44.062169+0000","last_became_peered":"2024-04-25T02:13:44.062169+0000","last_unstale":"2024-04-25T02:13:45.059104+0000","last_undegraded":"2024-04-25T02:13:45.059104+0000","last_fullsized":"2024-04-25T02:13:45.059104+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:11.040179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051271+0000","last_change":"2024-04-25T02:13:44.054839+0000","last_active":"2024-04-25T02:13:45.051271+0000","last_peered":"2024-04-25T02:13:45.051271+0000","last_clean":"2024-04-25T02:13:45.051271+0000","last_became_active":"2024-04-25T02:13:44.054561+0000","last_became_peered":"2024-04-25T02:13:44.054561+0000","last_unstale":"2024-04-25T02:13:45.051271+0000","last_undegraded":"2024-04-25T02:13:45.051271+0000","last_fullsized":"2024-04-25T02:13:45.051271+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:56.935832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059644+0000","last_change":"2024-04-25T02:13:44.052871+0000","last_active":"2024-04-25T02:13:45.059644+0000","last_peered":"2024-04-25T02:13:45.059644+0000","last_clean":"2024-04-25T02:13:45.059644+0000","last_became_active":"2024-04-25T02:13:44.052546+0000","last_became_peered":"2024-04-25T02:13:44.052546+0000","last_unstale":"2024-04-25T02:13:45.059644+0000","last_undegraded":"2024-04-25T02:13:45.059644+0000","last_fullsized":"2024-04-25T02:13:45.059644+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:54.077844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"85'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052155+0000","last_change":"2024-04-25T02:13:43.053264+0000","last_active":"2024-04-25T02:13:45.052155+0000","last_peered":"2024-04-25T02:13:45.052155+0000","last_clean":"2024-04-25T02:13:45.052155+0000","last_became_active":"2024-04-25T02:13:43.052943+0000","last_became_peered":"2024-04-25T02:13:43.052943+0000","last_unstale":"2024-04-25T02:13:45.052155+0000","last_undegraded":"2024-04-25T02:13:45.052155+0000","last_fullsized":"2024-04-25T02:13:45.052155+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:45.414473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052078+0000","last_change":"2024-04-25T02:13:44.063228+0000","last_active":"2024-04-25T02:13:45.052078+0000","last_peered":"2024-04-25T02:13:45.052078+0000","last_clean":"2024-04-25T02:13:45.052078+0000","last_became_active":"2024-04-25T02:13:44.062879+0000","last_became_peered":"2024-04-25T02:13:44.062879+0000","last_unstale":"2024-04-25T02:13:45.052078+0000","last_undegraded":"2024-04-25T02:13:45.052078+0000","last_fullsized":"2024-04-25T02:13:45.052078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:01.622647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059854+0000","last_change":"2024-04-25T02:13:43.054020+0000","last_active":"2024-04-25T02:13:45.059854+0000","last_peered":"2024-04-25T02:13:45.059854+0000","last_clean":"2024-04-25T02:13:45.059854+0000","last_became_active":"2024-04-25T02:13:43.053739+0000","last_became_peered":"2024-04-25T02:13:43.053739+0000","last_unstale":"2024-04-25T02:13:45.059854+0000","last_undegraded":"2024-04-25T02:13:45.059854+0000","last_fullsized":"2024-04-25T02:13:45.059854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:09.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052040+0000","last_change":"2024-04-25T02:13:44.060959+0000","last_active":"2024-04-25T02:13:45.052040+0000","last_peered":"2024-04-25T02:13:45.052040+0000","last_clean":"2024-04-25T02:13:45.052040+0000","last_became_active":"2024-04-25T02:13:44.060636+0000","last_became_peered":"2024-04-25T02:13:44.060636+0000","last_unstale":"2024-04-25T02:13:45.052040+0000","last_undegraded":"2024-04-25T02:13:45.052040+0000","last_fullsized":"2024-04-25T02:13:45.052040+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:33.580845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059778+0000","last_change":"2024-04-25T02:13:43.050515+0000","last_active":"2024-04-25T02:13:45.059778+0000","last_peered":"2024-04-25T02:13:45.059778+0000","last_clean":"2024-04-25T02:13:45.059778+0000","last_became_active":"2024-04-25T02:13:43.050240+0000","last_became_peered":"2024-04-25T02:13:43.050240+0000","last_unstale":"2024-04-25T02:13:45.059778+0000","last_undegraded":"2024-04-25T02:13:45.059778+0000","last_fullsized":"2024-04-25T02:13:45.059778+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:24.962811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059490+0000","last_change":"2024-04-25T02:13:44.055663+0000","last_active":"2024-04-25T02:13:45.059490+0000","last_peered":"2024-04-25T02:13:45.059490+0000","last_clean":"2024-04-25T02:13:45.059490+0000","last_became_active":"2024-04-25T02:13:44.055387+0000","last_became_peered":"2024-04-25T02:13:44.055387+0000","last_unstale":"2024-04-25T02:13:45.059490+0000","last_undegraded":"2024-04-25T02:13:45.059490+0000","last_fullsized":"2024-04-25T02:13:45.059490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:56.935832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059881+0000","last_change":"2024-04-25T02:13:43.049579+0000","last_active":"2024-04-25T02:13:45.059881+0000","last_peered":"2024-04-25T02:13:45.059881+0000","last_clean":"2024-04-25T02:13:45.059881+0000","last_became_active":"2024-04-25T02:13:43.048737+0000","last_became_peered":"2024-04-25T02:13:43.048737+0000","last_unstale":"2024-04-25T02:13:45.059881+0000","last_undegraded":"2024-04-25T02:13:45.059881+0000","last_fullsized":"2024-04-25T02:13:45.059881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:57.833319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059565+0000","last_change":"2024-04-25T02:13:44.058667+0000","last_active":"2024-04-25T02:13:45.059565+0000","last_peered":"2024-04-25T02:13:45.059565+0000","last_clean":"2024-04-25T02:13:45.059565+0000","last_became_active":"2024-04-25T02:13:44.058241+0000","last_became_peered":"2024-04-25T02:13:44.058241+0000","last_unstale":"2024-04-25T02:13:45.059565+0000","last_undegraded":"2024-04-25T02:13:45.059565+0000","last_fullsized":"2024-04-25T02:13:45.059565+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:10.064028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059855+0000","last_change":"2024-04-25T02:13:43.057085+0000","last_active":"2024-04-25T02:13:45.059855+0000","last_peered":"2024-04-25T02:13:45.059855+0000","last_clean":"2024-04-25T02:13:45.059855+0000","last_became_active":"2024-04-25T02:13:43.056456+0000","last_became_peered":"2024-04-25T02:13:43.056456+0000","last_unstale":"2024-04-25T02:13:45.059855+0000","last_undegraded":"2024-04-25T02:13:45.059855+0000","last_fullsized":"2024-04-25T02:13:45.059855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:37.018941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059639+0000","last_change":"2024-04-25T02:13:44.051807+0000","last_active":"2024-04-25T02:13:45.059639+0000","last_peered":"2024-04-25T02:13:45.059639+0000","last_clean":"2024-04-25T02:13:45.059639+0000","last_became_active":"2024-04-25T02:13:44.051527+0000","last_became_peered":"2024-04-25T02:13:44.051527+0000","last_unstale":"2024-04-25T02:13:45.059639+0000","last_undegraded":"2024-04-25T02:13:45.059639+0000","last_fullsized":"2024-04-25T02:13:45.059639+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:19:15.933023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059031+0000","last_change":"2024-04-25T02:13:43.054914+0000","last_active":"2024-04-25T02:13:45.059031+0000","last_peered":"2024-04-25T02:13:45.059031+0000","last_clean":"2024-04-25T02:13:45.059031+0000","last_became_active":"2024-04-25T02:13:43.054626+0000","last_became_peered":"2024-04-25T02:13:43.054626+0000","last_unstale":"2024-04-25T02:13:45.059031+0000","last_undegraded":"2024-04-25T02:13:45.059031+0000","last_fullsized":"2024-04-25T02:13:45.059031+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:37.327655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059723+0000","last_change":"2024-04-25T02:13:44.063766+0000","last_active":"2024-04-25T02:13:45.059723+0000","last_peered":"2024-04-25T02:13:45.059723+0000","last_clean":"2024-04-25T02:13:45.059723+0000","last_became_active":"2024-04-25T02:13:44.063495+0000","last_became_peered":"2024-04-25T02:13:44.063495+0000","last_unstale":"2024-04-25T02:13:45.059723+0000","last_undegraded":"2024-04-25T02:13:45.059723+0000","last_fullsized":"2024-04-25T02:13:45.059723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:55.135858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.058724+0000","last_change":"2024-04-25T02:13:43.054255+0000","last_active":"2024-04-25T02:13:45.058724+0000","last_peered":"2024-04-25T02:13:45.058724+0000","last_clean":"2024-04-25T02:13:45.058724+0000","last_became_active":"2024-04-25T02:13:43.053950+0000","last_became_peered":"2024-04-25T02:13:43.053950+0000","last_unstale":"2024-04-25T02:13:45.058724+0000","last_undegraded":"2024-04-25T02:13:45.058724+0000","last_fullsized":"2024-04-25T02:13:45.058724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:10.032849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059120+0000","last_change":"2024-04-25T02:13:44.055278+0000","last_active":"2024-04-25T02:13:45.059120+0000","last_peered":"2024-04-25T02:13:45.059120+0000","last_clean":"2024-04-25T02:13:45.059120+0000","last_became_active":"2024-04-25T02:13:44.054960+0000","last_became_peered":"2024-04-25T02:13:44.054960+0000","last_unstale":"2024-04-25T02:13:45.059120+0000","last_undegraded":"2024-04-25T02:13:45.059120+0000","last_fullsized":"2024-04-25T02:13:45.059120+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:34.438099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059067+0000","last_change":"2024-04-25T02:13:43.053935+0000","last_active":"2024-04-25T02:13:45.059067+0000","last_peered":"2024-04-25T02:13:45.059067+0000","last_clean":"2024-04-25T02:13:45.059067+0000","last_became_active":"2024-04-25T02:13:43.053607+0000","last_became_peered":"2024-04-25T02:13:43.053607+0000","last_unstale":"2024-04-25T02:13:45.059067+0000","last_undegraded":"2024-04-25T02:13:45.059067+0000","last_fullsized":"2024-04-25T02:13:45.059067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:37:18.378285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059579+0000","last_change":"2024-04-25T02:13:44.057279+0000","last_active":"2024-04-25T02:13:45.059579+0000","last_peered":"2024-04-25T02:13:45.059579+0000","last_clean":"2024-04-25T02:13:45.059579+0000","last_became_active":"2024-04-25T02:13:44.056977+0000","last_became_peered":"2024-04-25T02:13:44.056977+0000","last_unstale":"2024-04-25T02:13:45.059579+0000","last_undegraded":"2024-04-25T02:13:45.059579+0000","last_fullsized":"2024-04-25T02:13:45.059579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:41.063251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052208+0000","last_change":"2024-04-25T02:13:43.053851+0000","last_active":"2024-04-25T02:13:45.052208+0000","last_peered":"2024-04-25T02:13:45.052208+0000","last_clean":"2024-04-25T02:13:45.052208+0000","last_became_active":"2024-04-25T02:13:43.052885+0000","last_became_peered":"2024-04-25T02:13:43.052885+0000","last_unstale":"2024-04-25T02:13:45.052208+0000","last_undegraded":"2024-04-25T02:13:45.052208+0000","last_fullsized":"2024-04-25T02:13:45.052208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:51.107166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051560+0000","last_change":"2024-04-25T02:13:44.050167+0000","last_active":"2024-04-25T02:13:45.051560+0000","last_peered":"2024-04-25T02:13:45.051560+0000","last_clean":"2024-04-25T02:13:45.051560+0000","last_became_active":"2024-04-25T02:13:44.049885+0000","last_became_peered":"2024-04-25T02:13:44.049885+0000","last_unstale":"2024-04-25T02:13:45.051560+0000","last_undegraded":"2024-04-25T02:13:45.051560+0000","last_fullsized":"2024-04-25T02:13:45.051560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:11.040179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051957+0000","last_change":"2024-04-25T02:13:43.056392+0000","last_active":"2024-04-25T02:13:45.051957+0000","last_peered":"2024-04-25T02:13:45.051957+0000","last_clean":"2024-04-25T02:13:45.051957+0000","last_became_active":"2024-04-25T02:13:43.056071+0000","last_became_peered":"2024-04-25T02:13:43.056071+0000","last_unstale":"2024-04-25T02:13:45.051957+0000","last_undegraded":"2024-04-25T02:13:45.051957+0000","last_fullsized":"2024-04-25T02:13:45.051957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:39.579022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059828+0000","last_change":"2024-04-25T02:13:44.055535+0000","last_active":"2024-04-25T02:13:45.059828+0000","last_peered":"2024-04-25T02:13:45.059828+0000","last_clean":"2024-04-25T02:13:45.059828+0000","last_became_active":"2024-04-25T02:13:44.055252+0000","last_became_peered":"2024-04-25T02:13:44.055252+0000","last_unstale":"2024-04-25T02:13:45.059828+0000","last_undegraded":"2024-04-25T02:13:45.059828+0000","last_fullsized":"2024-04-25T02:13:45.059828+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:01.814394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"85'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051718+0000","last_change":"2024-04-25T02:13:43.053463+0000","last_active":"2024-04-25T02:13:45.051718+0000","last_peered":"2024-04-25T02:13:45.051718+0000","last_clean":"2024-04-25T02:13:45.051718+0000","last_became_active":"2024-04-25T02:13:43.052980+0000","last_became_peered":"2024-04-25T02:13:43.052980+0000","last_unstale":"2024-04-25T02:13:45.051718+0000","last_undegraded":"2024-04-25T02:13:45.051718+0000","last_fullsized":"2024-04-25T02:13:45.051718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:15.937903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059559+0000","last_change":"2024-04-25T02:13:44.064218+0000","last_active":"2024-04-25T02:13:45.059559+0000","last_peered":"2024-04-25T02:13:45.059559+0000","last_clean":"2024-04-25T02:13:45.059559+0000","last_became_active":"2024-04-25T02:13:44.063869+0000","last_became_peered":"2024-04-25T02:13:44.063869+0000","last_unstale":"2024-04-25T02:13:45.059559+0000","last_undegraded":"2024-04-25T02:13:45.059559+0000","last_fullsized":"2024-04-25T02:13:45.059559+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:25.970140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"85'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051592+0000","last_change":"2024-04-25T02:13:43.055805+0000","last_active":"2024-04-25T02:13:45.051592+0000","last_peered":"2024-04-25T02:13:45.051592+0000","last_clean":"2024-04-25T02:13:45.051592+0000","last_became_active":"2024-04-25T02:13:43.055454+0000","last_became_peered":"2024-04-25T02:13:43.055454+0000","last_unstale":"2024-04-25T02:13:45.051592+0000","last_undegraded":"2024-04-25T02:13:45.051592+0000","last_fullsized":"2024-04-25T02:13:45.051592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:09.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059542+0000","last_change":"2024-04-25T02:13:44.053452+0000","last_active":"2024-04-25T02:13:45.059542+0000","last_peered":"2024-04-25T02:13:45.059542+0000","last_clean":"2024-04-25T02:13:45.059542+0000","last_became_active":"2024-04-25T02:13:44.053167+0000","last_became_peered":"2024-04-25T02:13:44.053167+0000","last_unstale":"2024-04-25T02:13:45.059542+0000","last_undegraded":"2024-04-25T02:13:45.059542+0000","last_fullsized":"2024-04-25T02:13:45.059542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:47.675994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.060066+0000","last_change":"2024-04-25T02:13:43.049363+0000","last_active":"2024-04-25T02:13:45.060066+0000","last_peered":"2024-04-25T02:13:45.060066+0000","last_clean":"2024-04-25T02:13:45.060066+0000","last_became_active":"2024-04-25T02:13:43.049105+0000","last_became_peered":"2024-04-25T02:13:43.049105+0000","last_unstale":"2024-04-25T02:13:45.060066+0000","last_undegraded":"2024-04-25T02:13:45.060066+0000","last_fullsized":"2024-04-25T02:13:45.060066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:30.462005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059974+0000","last_change":"2024-04-25T02:13:44.067523+0000","last_active":"2024-04-25T02:13:45.059974+0000","last_peered":"2024-04-25T02:13:45.059974+0000","last_clean":"2024-04-25T02:13:45.059974+0000","last_became_active":"2024-04-25T02:13:44.067236+0000","last_became_peered":"2024-04-25T02:13:44.067236+0000","last_unstale":"2024-04-25T02:13:45.059974+0000","last_undegraded":"2024-04-25T02:13:45.059974+0000","last_fullsized":"2024-04-25T02:13:45.059974+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:47.297520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059176+0000","last_change":"2024-04-25T02:13:43.046196+0000","last_active":"2024-04-25T02:13:45.059176+0000","last_peered":"2024-04-25T02:13:45.059176+0000","last_clean":"2024-04-25T02:13:45.059176+0000","last_became_active":"2024-04-25T02:13:43.045929+0000","last_became_peered":"2024-04-25T02:13:43.045929+0000","last_unstale":"2024-04-25T02:13:45.059176+0000","last_undegraded":"2024-04-25T02:13:45.059176+0000","last_fullsized":"2024-04-25T02:13:45.059176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:09.014230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059041+0000","last_change":"2024-04-25T02:13:44.053140+0000","last_active":"2024-04-25T02:13:45.059041+0000","last_peered":"2024-04-25T02:13:45.059041+0000","last_clean":"2024-04-25T02:13:45.059041+0000","last_became_active":"2024-04-25T02:13:44.052839+0000","last_became_peered":"2024-04-25T02:13:44.052839+0000","last_unstale":"2024-04-25T02:13:45.059041+0000","last_undegraded":"2024-04-25T02:13:45.059041+0000","last_fullsized":"2024-04-25T02:13:45.059041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:35.188356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051635+0000","last_change":"2024-04-25T02:13:43.053886+0000","last_active":"2024-04-25T02:13:45.051635+0000","last_peered":"2024-04-25T02:13:45.051635+0000","last_clean":"2024-04-25T02:13:45.051635+0000","last_became_active":"2024-04-25T02:13:43.053630+0000","last_became_peered":"2024-04-25T02:13:43.053630+0000","last_unstale":"2024-04-25T02:13:45.051635+0000","last_undegraded":"2024-04-25T02:13:45.051635+0000","last_fullsized":"2024-04-25T02:13:45.051635+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:37.018941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.058883+0000","last_change":"2024-04-25T02:13:44.050368+0000","last_active":"2024-04-25T02:13:45.058883+0000","last_peered":"2024-04-25T02:13:45.058883+0000","last_clean":"2024-04-25T02:13:45.058883+0000","last_became_active":"2024-04-25T02:13:44.050088+0000","last_became_peered":"2024-04-25T02:13:44.050088+0000","last_unstale":"2024-04-25T02:13:45.058883+0000","last_undegraded":"2024-04-25T02:13:45.058883+0000","last_fullsized":"2024-04-25T02:13:45.058883+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:59:33.766876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"85'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.058614+0000","last_change":"2024-04-25T02:13:43.056043+0000","last_active":"2024-04-25T02:13:45.058614+0000","last_peered":"2024-04-25T02:13:45.058614+0000","last_clean":"2024-04-25T02:13:45.058614+0000","last_became_active":"2024-04-25T02:13:43.055761+0000","last_became_peered":"2024-04-25T02:13:43.055761+0000","last_unstale":"2024-04-25T02:13:45.058614+0000","last_undegraded":"2024-04-25T02:13:45.058614+0000","last_fullsized":"2024-04-25T02:13:45.058614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:50.260391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059371+0000","last_change":"2024-04-25T02:13:44.052403+0000","last_active":"2024-04-25T02:13:45.059371+0000","last_peered":"2024-04-25T02:13:45.059371+0000","last_clean":"2024-04-25T02:13:45.059371+0000","last_became_active":"2024-04-25T02:13:44.051834+0000","last_became_peered":"2024-04-25T02:13:44.051834+0000","last_unstale":"2024-04-25T02:13:45.059371+0000","last_undegraded":"2024-04-25T02:13:45.059371+0000","last_fullsized":"2024-04-25T02:13:45.059371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:42:52.628270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052266+0000","last_change":"2024-04-25T02:13:43.054336+0000","last_active":"2024-04-25T02:13:45.052266+0000","last_peered":"2024-04-25T02:13:45.052266+0000","last_clean":"2024-04-25T02:13:45.052266+0000","last_became_active":"2024-04-25T02:13:43.054072+0000","last_became_peered":"2024-04-25T02:13:43.054072+0000","last_unstale":"2024-04-25T02:13:45.052266+0000","last_undegraded":"2024-04-25T02:13:45.052266+0000","last_fullsized":"2024-04-25T02:13:45.052266+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:42.199104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052140+0000","last_change":"2024-04-25T02:13:44.050597+0000","last_active":"2024-04-25T02:13:45.052140+0000","last_peered":"2024-04-25T02:13:45.052140+0000","last_clean":"2024-04-25T02:13:45.052140+0000","last_became_active":"2024-04-25T02:13:44.049881+0000","last_became_peered":"2024-04-25T02:13:44.049881+0000","last_unstale":"2024-04-25T02:13:45.052140+0000","last_undegraded":"2024-04-25T02:13:45.052140+0000","last_fullsized":"2024-04-25T02:13:45.052140+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:44:28.580382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059000+0000","last_change":"2024-04-25T02:13:43.056583+0000","last_active":"2024-04-25T02:13:45.059000+0000","last_peered":"2024-04-25T02:13:45.059000+0000","last_clean":"2024-04-25T02:13:45.059000+0000","last_became_active":"2024-04-25T02:13:43.056209+0000","last_became_peered":"2024-04-25T02:13:43.056209+0000","last_unstale":"2024-04-25T02:13:45.059000+0000","last_undegraded":"2024-04-25T02:13:45.059000+0000","last_fullsized":"2024-04-25T02:13:45.059000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:20.657979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059724+0000","last_change":"2024-04-25T02:13:44.057204+0000","last_active":"2024-04-25T02:13:45.059724+0000","last_peered":"2024-04-25T02:13:45.059724+0000","last_clean":"2024-04-25T02:13:45.059724+0000","last_became_active":"2024-04-25T02:13:44.056903+0000","last_became_peered":"2024-04-25T02:13:44.056903+0000","last_unstale":"2024-04-25T02:13:45.059724+0000","last_undegraded":"2024-04-25T02:13:45.059724+0000","last_fullsized":"2024-04-25T02:13:45.059724+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:42:52.628270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059913+0000","last_change":"2024-04-25T02:13:43.049819+0000","last_active":"2024-04-25T02:13:45.059913+0000","last_peered":"2024-04-25T02:13:45.059913+0000","last_clean":"2024-04-25T02:13:45.059913+0000","last_became_active":"2024-04-25T02:13:43.048410+0000","last_became_peered":"2024-04-25T02:13:43.048410+0000","last_unstale":"2024-04-25T02:13:45.059913+0000","last_undegraded":"2024-04-25T02:13:45.059913+0000","last_fullsized":"2024-04-25T02:13:45.059913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:31.191426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051176+0000","last_change":"2024-04-25T02:13:44.060629+0000","last_active":"2024-04-25T02:13:45.051176+0000","last_peered":"2024-04-25T02:13:45.051176+0000","last_clean":"2024-04-25T02:13:45.051176+0000","last_became_active":"2024-04-25T02:13:44.060236+0000","last_became_peered":"2024-04-25T02:13:44.060236+0000","last_unstale":"2024-04-25T02:13:45.051176+0000","last_undegraded":"2024-04-25T02:13:45.051176+0000","last_fullsized":"2024-04-25T02:13:45.051176+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:48.719407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059372+0000","last_change":"2024-04-25T02:13:43.045278+0000","last_active":"2024-04-25T02:13:45.059372+0000","last_peered":"2024-04-25T02:13:45.059372+0000","last_clean":"2024-04-25T02:13:45.059372+0000","last_became_active":"2024-04-25T02:13:43.045014+0000","last_became_peered":"2024-04-25T02:13:43.045014+0000","last_unstale":"2024-04-25T02:13:45.059372+0000","last_undegraded":"2024-04-25T02:13:45.059372+0000","last_fullsized":"2024-04-25T02:13:45.059372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:00.615318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051389+0000","last_change":"2024-04-25T02:13:44.057818+0000","last_active":"2024-04-25T02:13:45.051389+0000","last_peered":"2024-04-25T02:13:45.051389+0000","last_clean":"2024-04-25T02:13:45.051389+0000","last_became_active":"2024-04-25T02:13:44.057326+0000","last_became_peered":"2024-04-25T02:13:44.057326+0000","last_unstale":"2024-04-25T02:13:45.051389+0000","last_undegraded":"2024-04-25T02:13:45.051389+0000","last_fullsized":"2024-04-25T02:13:45.051389+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:21.665309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051229+0000","last_change":"2024-04-25T02:13:43.049803+0000","last_active":"2024-04-25T02:13:45.051229+0000","last_peered":"2024-04-25T02:13:45.051229+0000","last_clean":"2024-04-25T02:13:45.051229+0000","last_became_active":"2024-04-25T02:13:43.049523+0000","last_became_peered":"2024-04-25T02:13:43.049523+0000","last_unstale":"2024-04-25T02:13:45.051229+0000","last_undegraded":"2024-04-25T02:13:45.051229+0000","last_fullsized":"2024-04-25T02:13:45.051229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:55.197127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.050844+0000","last_change":"2024-04-25T02:13:44.049027+0000","last_active":"2024-04-25T02:13:45.050844+0000","last_peered":"2024-04-25T02:13:45.050844+0000","last_clean":"2024-04-25T02:13:45.050844+0000","last_became_active":"2024-04-25T02:13:44.048682+0000","last_became_peered":"2024-04-25T02:13:44.048682+0000","last_unstale":"2024-04-25T02:13:45.050844+0000","last_undegraded":"2024-04-25T02:13:45.050844+0000","last_fullsized":"2024-04-25T02:13:45.050844+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:51.742945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.050916+0000","last_change":"2024-04-25T02:13:43.047567+0000","last_active":"2024-04-25T02:13:45.050916+0000","last_peered":"2024-04-25T02:13:45.050916+0000","last_clean":"2024-04-25T02:13:45.050916+0000","last_became_active":"2024-04-25T02:13:43.047325+0000","last_became_peered":"2024-04-25T02:13:43.047325+0000","last_unstale":"2024-04-25T02:13:45.050916+0000","last_undegraded":"2024-04-25T02:13:45.050916+0000","last_fullsized":"2024-04-25T02:13:45.050916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:21.936400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051208+0000","last_change":"2024-04-25T02:13:44.056121+0000","last_active":"2024-04-25T02:13:45.051208+0000","last_peered":"2024-04-25T02:13:45.051208+0000","last_clean":"2024-04-25T02:13:45.051208+0000","last_became_active":"2024-04-25T02:13:44.055776+0000","last_became_peered":"2024-04-25T02:13:44.055776+0000","last_unstale":"2024-04-25T02:13:45.051208+0000","last_undegraded":"2024-04-25T02:13:45.051208+0000","last_fullsized":"2024-04-25T02:13:45.051208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:59.080953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.058860+0000","last_change":"2024-04-25T02:13:43.043103+0000","last_active":"2024-04-25T02:13:45.058860+0000","last_peered":"2024-04-25T02:13:45.058860+0000","last_clean":"2024-04-25T02:13:45.058860+0000","last_became_active":"2024-04-25T02:13:43.042808+0000","last_became_peered":"2024-04-25T02:13:43.042808+0000","last_unstale":"2024-04-25T02:13:45.058860+0000","last_undegraded":"2024-04-25T02:13:45.058860+0000","last_fullsized":"2024-04-25T02:13:45.058860+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:32.573516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059833+0000","last_change":"2024-04-25T02:13:44.043142+0000","last_active":"2024-04-25T02:13:45.059833+0000","last_peered":"2024-04-25T02:13:45.059833+0000","last_clean":"2024-04-25T02:13:45.059833+0000","last_became_active":"2024-04-25T02:13:44.042747+0000","last_became_peered":"2024-04-25T02:13:44.042747+0000","last_unstale":"2024-04-25T02:13:45.059833+0000","last_undegraded":"2024-04-25T02:13:45.059833+0000","last_fullsized":"2024-04-25T02:13:45.059833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:56.935832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.060025+0000","last_change":"2024-04-25T02:13:43.052396+0000","last_active":"2024-04-25T02:13:45.060025+0000","last_peered":"2024-04-25T02:13:45.060025+0000","last_clean":"2024-04-25T02:13:45.060025+0000","last_became_active":"2024-04-25T02:13:43.052107+0000","last_became_peered":"2024-04-25T02:13:43.052107+0000","last_unstale":"2024-04-25T02:13:45.060025+0000","last_undegraded":"2024-04-25T02:13:45.060025+0000","last_fullsized":"2024-04-25T02:13:45.060025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:08:16.341873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059248+0000","last_change":"2024-04-25T02:13:44.055102+0000","last_active":"2024-04-25T02:13:45.059248+0000","last_peered":"2024-04-25T02:13:45.059248+0000","last_clean":"2024-04-25T02:13:45.059248+0000","last_became_active":"2024-04-25T02:13:44.054796+0000","last_became_peered":"2024-04-25T02:13:44.054796+0000","last_unstale":"2024-04-25T02:13:45.059248+0000","last_undegraded":"2024-04-25T02:13:45.059248+0000","last_fullsized":"2024-04-25T02:13:45.059248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:19:15.933023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059671+0000","last_change":"2024-04-25T02:13:43.047689+0000","last_active":"2024-04-25T02:13:45.059671+0000","last_peered":"2024-04-25T02:13:45.059671+0000","last_clean":"2024-04-25T02:13:45.059671+0000","last_became_active":"2024-04-25T02:13:43.047441+0000","last_became_peered":"2024-04-25T02:13:43.047441+0000","last_unstale":"2024-04-25T02:13:45.059671+0000","last_undegraded":"2024-04-25T02:13:45.059671+0000","last_fullsized":"2024-04-25T02:13:45.059671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:48.985842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052112+0000","last_change":"2024-04-25T02:13:44.056976+0000","last_active":"2024-04-25T02:13:45.052112+0000","last_peered":"2024-04-25T02:13:45.052112+0000","last_clean":"2024-04-25T02:13:45.052112+0000","last_became_active":"2024-04-25T02:13:44.056713+0000","last_became_peered":"2024-04-25T02:13:44.056713+0000","last_unstale":"2024-04-25T02:13:45.052112+0000","last_undegraded":"2024-04-25T02:13:45.052112+0000","last_fullsized":"2024-04-25T02:13:45.052112+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:10.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051904+0000","last_change":"2024-04-25T02:13:43.053298+0000","last_active":"2024-04-25T02:13:45.051904+0000","last_peered":"2024-04-25T02:13:45.051904+0000","last_clean":"2024-04-25T02:13:45.051904+0000","last_became_active":"2024-04-25T02:13:43.053009+0000","last_became_peered":"2024-04-25T02:13:43.053009+0000","last_unstale":"2024-04-25T02:13:45.051904+0000","last_undegraded":"2024-04-25T02:13:45.051904+0000","last_fullsized":"2024-04-25T02:13:45.051904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:58.073624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059878+0000","last_change":"2024-04-25T02:13:44.048506+0000","last_active":"2024-04-25T02:13:45.059878+0000","last_peered":"2024-04-25T02:13:45.059878+0000","last_clean":"2024-04-25T02:13:45.059878+0000","last_became_active":"2024-04-25T02:13:44.048208+0000","last_became_peered":"2024-04-25T02:13:44.048208+0000","last_unstale":"2024-04-25T02:13:45.059878+0000","last_undegraded":"2024-04-25T02:13:45.059878+0000","last_fullsized":"2024-04-25T02:13:45.059878+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:55.135858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.052158+0000","last_change":"2024-04-25T02:13:43.050467+0000","last_active":"2024-04-25T02:13:45.052158+0000","last_peered":"2024-04-25T02:13:45.052158+0000","last_clean":"2024-04-25T02:13:45.052158+0000","last_became_active":"2024-04-25T02:13:43.050193+0000","last_became_peered":"2024-04-25T02:13:43.050193+0000","last_unstale":"2024-04-25T02:13:45.052158+0000","last_undegraded":"2024-04-25T02:13:45.052158+0000","last_fullsized":"2024-04-25T02:13:45.052158+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:44.924653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051367+0000","last_change":"2024-04-25T02:13:44.052793+0000","last_active":"2024-04-25T02:13:45.051367+0000","last_peered":"2024-04-25T02:13:45.051367+0000","last_clean":"2024-04-25T02:13:45.051367+0000","last_became_active":"2024-04-25T02:13:44.052524+0000","last_became_peered":"2024-04-25T02:13:44.052524+0000","last_unstale":"2024-04-25T02:13:45.051367+0000","last_undegraded":"2024-04-25T02:13:45.051367+0000","last_fullsized":"2024-04-25T02:13:45.051367+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:51.267721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059135+0000","last_change":"2024-04-25T02:13:43.056167+0000","last_active":"2024-04-25T02:13:45.059135+0000","last_peered":"2024-04-25T02:13:45.059135+0000","last_clean":"2024-04-25T02:13:45.059135+0000","last_became_active":"2024-04-25T02:13:43.055901+0000","last_became_peered":"2024-04-25T02:13:43.055901+0000","last_unstale":"2024-04-25T02:13:45.059135+0000","last_undegraded":"2024-04-25T02:13:45.059135+0000","last_fullsized":"2024-04-25T02:13:45.059135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:47.094381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059044+0000","last_change":"2024-04-25T02:13:44.054524+0000","last_active":"2024-04-25T02:13:45.059044+0000","last_peered":"2024-04-25T02:13:45.059044+0000","last_clean":"2024-04-25T02:13:45.059044+0000","last_became_active":"2024-04-25T02:13:44.052126+0000","last_became_peered":"2024-04-25T02:13:44.052126+0000","last_unstale":"2024-04-25T02:13:45.059044+0000","last_undegraded":"2024-04-25T02:13:45.059044+0000","last_fullsized":"2024-04-25T02:13:45.059044+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:05.980481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059117+0000","last_change":"2024-04-25T02:13:43.054235+0000","last_active":"2024-04-25T02:13:45.059117+0000","last_peered":"2024-04-25T02:13:45.059117+0000","last_clean":"2024-04-25T02:13:45.059117+0000","last_became_active":"2024-04-25T02:13:43.053961+0000","last_became_peered":"2024-04-25T02:13:43.053961+0000","last_unstale":"2024-04-25T02:13:45.059117+0000","last_undegraded":"2024-04-25T02:13:45.059117+0000","last_fullsized":"2024-04-25T02:13:45.059117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:41.827637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059843+0000","last_change":"2024-04-25T02:13:44.054359+0000","last_active":"2024-04-25T02:13:45.059843+0000","last_peered":"2024-04-25T02:13:45.059843+0000","last_clean":"2024-04-25T02:13:45.059843+0000","last_became_active":"2024-04-25T02:13:44.054089+0000","last_became_peered":"2024-04-25T02:13:44.054089+0000","last_unstale":"2024-04-25T02:13:45.059843+0000","last_undegraded":"2024-04-25T02:13:45.059843+0000","last_fullsized":"2024-04-25T02:13:45.059843+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:05.980481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051607+0000","last_change":"2024-04-25T02:13:43.052349+0000","last_active":"2024-04-25T02:13:45.051607+0000","last_peered":"2024-04-25T02:13:45.051607+0000","last_clean":"2024-04-25T02:13:45.051607+0000","last_became_active":"2024-04-25T02:13:43.052101+0000","last_became_peered":"2024-04-25T02:13:43.052101+0000","last_unstale":"2024-04-25T02:13:45.051607+0000","last_undegraded":"2024-04-25T02:13:45.051607+0000","last_fullsized":"2024-04-25T02:13:45.051607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:08.876286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.051499+0000","last_change":"2024-04-25T02:13:44.056275+0000","last_active":"2024-04-25T02:13:45.051499+0000","last_peered":"2024-04-25T02:13:45.051499+0000","last_clean":"2024-04-25T02:13:45.051499+0000","last_became_active":"2024-04-25T02:13:44.055949+0000","last_became_peered":"2024-04-25T02:13:44.055949+0000","last_unstale":"2024-04-25T02:13:45.051499+0000","last_undegraded":"2024-04-25T02:13:45.051499+0000","last_fullsized":"2024-04-25T02:13:45.051499+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:05.980481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059021+0000","last_change":"2024-04-25T02:13:43.057973+0000","last_active":"2024-04-25T02:13:45.059021+0000","last_peered":"2024-04-25T02:13:45.059021+0000","last_clean":"2024-04-25T02:13:45.059021+0000","last_became_active":"2024-04-25T02:13:43.057693+0000","last_became_peered":"2024-04-25T02:13:43.057693+0000","last_unstale":"2024-04-25T02:13:45.059021+0000","last_undegraded":"2024-04-25T02:13:45.059021+0000","last_fullsized":"2024-04-25T02:13:45.059021+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:28.302730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059282+0000","last_change":"2024-04-25T02:13:44.056037+0000","last_active":"2024-04-25T02:13:45.059282+0000","last_peered":"2024-04-25T02:13:45.059282+0000","last_clean":"2024-04-25T02:13:45.059282+0000","last_became_active":"2024-04-25T02:13:44.055572+0000","last_became_peered":"2024-04-25T02:13:44.055572+0000","last_unstale":"2024-04-25T02:13:45.059282+0000","last_undegraded":"2024-04-25T02:13:45.059282+0000","last_fullsized":"2024-04-25T02:13:45.059282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:43.026714+0000","last_clean_scrub_stamp":"2024-04-25T02:13:43.026714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:38.860627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059676+0000","last_change":"2024-04-25T02:13:43.052388+0000","last_active":"2024-04-25T02:13:45.059676+0000","last_peered":"2024-04-25T02:13:45.059676+0000","last_clean":"2024-04-25T02:13:45.059676+0000","last_became_active":"2024-04-25T02:13:43.052114+0000","last_became_peered":"2024-04-25T02:13:43.052114+0000","last_unstale":"2024-04-25T02:13:45.059676+0000","last_undegraded":"2024-04-25T02:13:45.059676+0000","last_fullsized":"2024-04-25T02:13:45.059676+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:13:42.019384+0000","last_clean_scrub_stamp":"2024-04-25T02:13:42.019384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:44.924653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":288,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:13:45.059779+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:13:45.059779+0000","last_peered":"2024-04-25T02:13:45.059779+0000","last_clean":"2024-04-25T02:13:45.059779+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:13:45.059779+0000","last_undegraded":"2024-04-25T02:13:45.059779+0000","last_fullsized":"2024-04-25T02:13:45.059779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1654784,"data_stored":1040151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1069056,"data_stored":450407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1073152,"data_stored":451347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1056768,"data_stored":449713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1069056,"data_stored":451325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":450295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1069056,"data_stored":449907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1654784,"data_stored":1040115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:13:48.356 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T02:13:48.357 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T02:13:48.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.490+0000 7f541fb7e640 1 Processor -- start 2024-04-25T02:13:48.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.490+0000 7f541fb7e640 1 -- start start 2024-04-25T02:13:48.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.491+0000 7f541fb7e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f54180b41b0 0x7f54181605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.491+0000 7f541fb7e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f541806b770 0x7f5418156610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.491+0000 7f541fb7e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5418071cd0 con 0x7f541806b2f0 2024-04-25T02:13:48.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.491+0000 7f541fb7e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5418156b50 con 0x7f54180b41b0 2024-04-25T02:13:48.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.491+0000 7f541fb7e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f5418071fb0 con 0x7f541806b770 2024-04-25T02:13:48.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.491+0000 7f541d91a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f54180b41b0 0x7f54181605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.491+0000 7f541d91a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f54180b41b0 0x7f54181605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33246/0 (socket says 172.21.15.79:33246) 2024-04-25T02:13:48.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.491+0000 7f541d91a640 1 -- 172.21.15.79:0/1102284909 learned_addr learned my addr 172.21.15.79:0/1102284909 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:48.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.491+0000 7f541e11b640 1 --2- 172.21.15.79:0/1102284909 >> v2:172.21.15.189:3300/0 conn(0x7f541806b770 0x7f5418156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.492+0000 7f541d91a640 1 -- 172.21.15.79:0/1102284909 >> v2:172.21.15.189:3300/0 conn(0x7f541806b770 msgr2=0x7f5418156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:48.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.492+0000 7f541d91a640 1 --2- 172.21.15.79:0/1102284909 >> v2:172.21.15.189:3300/0 conn(0x7f541806b770 0x7f5418156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.492+0000 7f541d91a640 1 -- 172.21.15.79:0/1102284909 >> v1:172.21.15.189:6789/0 conn(0x7f541806b2f0 legacy=0x7f5418155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:48.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.492+0000 7f541d91a640 1 -- 172.21.15.79:0/1102284909 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5418072290 con 0x7f54180b41b0 2024-04-25T02:13:48.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.492+0000 7f541d91a640 1 --2- 172.21.15.79:0/1102284909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180b41b0 0x7f54181605d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f54180cc410 tx=0x7f541402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7a8e28922d88b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:48.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.492+0000 7f541c918640 1 -- 172.21.15.79:0/1102284909 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414036070 con 0x7f54180b41b0 2024-04-25T02:13:48.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.493+0000 7f541c918640 1 -- 172.21.15.79:0/1102284909 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5414031600 con 0x7f54180b41b0 2024-04-25T02:13:48.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.493+0000 7f541c918640 1 -- 172.21.15.79:0/1102284909 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54140319d0 con 0x7f54180b41b0 2024-04-25T02:13:48.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.493+0000 7f541fb7e640 1 -- 172.21.15.79:0/1102284909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180b41b0 msgr2=0x7f54181605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.493+0000 7f541fb7e640 1 --2- 172.21.15.79:0/1102284909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180b41b0 0x7f54181605d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f54180cc410 tx=0x7f541402a730 comp rx=0 tx=0).stop 2024-04-25T02:13:48.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.493+0000 7f541fb7e640 1 -- 172.21.15.79:0/1102284909 shutdown_connections 2024-04-25T02:13:48.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.493+0000 7f541fb7e640 1 --2- 172.21.15.79:0/1102284909 >> v2:172.21.15.189:3300/0 conn(0x7f541806b770 0x7f5418156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.493+0000 7f541fb7e640 1 --2- 172.21.15.79:0/1102284909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180b41b0 0x7f54181605d0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.493+0000 7f541fb7e640 1 -- 172.21.15.79:0/1102284909 >> 172.21.15.79:0/1102284909 conn(0x7f54180b1cd0 msgr2=0x7f54180b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:48.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.493+0000 7f541fb7e640 1 -- 172.21.15.79:0/1102284909 shutdown_connections 2024-04-25T02:13:48.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.493+0000 7f541fb7e640 1 -- 172.21.15.79:0/1102284909 wait complete. 2024-04-25T02:13:48.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.494+0000 7f541fb7e640 1 Processor -- start 2024-04-25T02:13:48.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.494+0000 7f541fb7e640 1 -- start start 2024-04-25T02:13:48.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.495+0000 7f541fb7e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f541806b2f0 0x7f54180caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.495+0000 7f541fb7e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f541806b770 0x7f5418154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.495+0000 7f541fb7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180b41b0 0x7f54181596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.495+0000 7f541fb7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5418072d70 con 0x7f54180b41b0 2024-04-25T02:13:48.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.495+0000 7f541fb7e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5418160b10 con 0x7f541806b770 2024-04-25T02:13:48.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.495+0000 7f541fb7e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f541806bb80 con 0x7f541806b2f0 2024-04-25T02:13:48.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.495+0000 7f541e11b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180b41b0 0x7f54181596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.495+0000 7f541e11b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180b41b0 0x7f54181596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33258/0 (socket says 172.21.15.79:33258) 2024-04-25T02:13:48.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.495+0000 7f541e11b640 1 -- 172.21.15.79:0/2132018964 learned_addr learned my addr 172.21.15.79:0/2132018964 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:48.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.495+0000 7f541d119640 1 --2- 172.21.15.79:0/2132018964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f541806b770 0x7f5418154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.495+0000 7f541d91a640 1 --2- 172.21.15.79:0/2132018964 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f541806b2f0 0x7f54180caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.495+0000 7f541e11b640 1 -- 172.21.15.79:0/2132018964 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f541806b2f0 msgr2=0x7f54180caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.495+0000 7f541e11b640 1 --2- 172.21.15.79:0/2132018964 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f541806b2f0 0x7f54180caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.495+0000 7f541e11b640 1 -- 172.21.15.79:0/2132018964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f541806b770 msgr2=0x7f5418154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.495+0000 7f541e11b640 1 --2- 172.21.15.79:0/2132018964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f541806b770 0x7f5418154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.496+0000 7f541e11b640 1 -- 172.21.15.79:0/2132018964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54180cb010 con 0x7f54180b41b0 2024-04-25T02:13:48.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.496+0000 7f541d91a640 1 --2- 172.21.15.79:0/2132018964 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f541806b2f0 0x7f54180caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:48.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.496+0000 7f541e11b640 1 --2- 172.21.15.79:0/2132018964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180b41b0 0x7f54181596e0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f541000d800 tx=0x7f541000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:48.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.496+0000 7f540e7fc640 1 -- 172.21.15.79:0/2132018964 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541000b6c0 con 0x7f54180b41b0 2024-04-25T02:13:48.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.496+0000 7f540e7fc640 1 -- 172.21.15.79:0/2132018964 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5410019070 con 0x7f54180b41b0 2024-04-25T02:13:48.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.496+0000 7f540e7fc640 1 -- 172.21.15.79:0/2132018964 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541000bac0 con 0x7f54180b41b0 2024-04-25T02:13:48.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.496+0000 7f541fb7e640 1 -- 172.21.15.79:0/2132018964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54180cb2f0 con 0x7f54180b41b0 2024-04-25T02:13:48.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.496+0000 7f541fb7e640 1 -- 172.21.15.79:0/2132018964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54181f7a10 con 0x7f54180b41b0 2024-04-25T02:13:48.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.497+0000 7f541fb7e640 1 -- 172.21.15.79:0/2132018964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54180690a0 con 0x7f54180b41b0 2024-04-25T02:13:48.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.497+0000 7f540e7fc640 1 -- 172.21.15.79:0/2132018964 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f541000bc60 con 0x7f54180b41b0 2024-04-25T02:13:48.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.498+0000 7f540e7fc640 1 --2- 172.21.15.79:0/2132018964 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53fc06be30 0x7f53fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.498+0000 7f540e7fc640 1 -- 172.21.15.79:0/2132018964 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f541008b170 con 0x7f54180b41b0 2024-04-25T02:13:48.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.498+0000 7f541d91a640 1 --2- 172.21.15.79:0/2132018964 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53fc06be30 0x7f53fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.498+0000 7f541d91a640 1 --2- 172.21.15.79:0/2132018964 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53fc06be30 0x7f53fc06e2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5414033000 tx=0x7f5414009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:48.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.502+0000 7f540e7fc640 1 -- 172.21.15.79:0/2132018964 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5410059bb0 con 0x7f54180b41b0 2024-04-25T02:13:48.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.739+0000 7f541fb7e640 1 -- 172.21.15.79:0/2132018964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f54180ce280 con 0x7f54180b41b0 2024-04-25T02:13:48.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.741+0000 7f540e7fc640 1 -- 172.21.15.79:0/2132018964 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f54100594b0 con 0x7f54180b41b0 2024-04-25T02:13:48.747 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-04-25T02:13:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g== 2024-04-25T02:13:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: caps mds = "allow" 2024-04-25T02:13:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: caps mon = "allow r" 2024-04-25T02:13:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T02:13:48.748 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2024-04-25T02:13:48.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.743+0000 7f541fb7e640 1 -- 172.21.15.79:0/2132018964 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53fc06be30 msgr2=0x7f53fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.743+0000 7f541fb7e640 1 --2- 172.21.15.79:0/2132018964 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53fc06be30 0x7f53fc06e2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5414033000 tx=0x7f5414009000 comp rx=0 tx=0).stop 2024-04-25T02:13:48.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.743+0000 7f541fb7e640 1 -- 172.21.15.79:0/2132018964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180b41b0 msgr2=0x7f54181596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.743+0000 7f541fb7e640 1 --2- 172.21.15.79:0/2132018964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180b41b0 0x7f54181596e0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f541000d800 tx=0x7f541000dcc0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.743+0000 7f541fb7e640 1 -- 172.21.15.79:0/2132018964 shutdown_connections 2024-04-25T02:13:48.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.743+0000 7f541fb7e640 1 --2- 172.21.15.79:0/2132018964 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53fc06be30 0x7f53fc06e2f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.743+0000 7f541fb7e640 1 --2- 172.21.15.79:0/2132018964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180b41b0 0x7f54181596e0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.743+0000 7f541fb7e640 1 --2- 172.21.15.79:0/2132018964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f541806b770 0x7f5418154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.743+0000 7f541fb7e640 1 --2- 172.21.15.79:0/2132018964 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f541806b2f0 0x7f54180caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.743+0000 7f541fb7e640 1 -- 172.21.15.79:0/2132018964 >> 172.21.15.79:0/2132018964 conn(0x7f54180b1cd0 msgr2=0x7f54180d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:48.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.743+0000 7f541fb7e640 1 -- 172.21.15.79:0/2132018964 shutdown_connections 2024-04-25T02:13:48.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.743+0000 7f541fb7e640 1 -- 172.21.15.79:0/2132018964 wait complete. 2024-04-25T02:13:48.760 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:13:48.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.850+0000 7f52e89dc640 1 Processor -- start 2024-04-25T02:13:48.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.850+0000 7f52e89dc640 1 -- start start 2024-04-25T02:13:48.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.851+0000 7f52e89dc640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f52e40b3570 0x7f52e40d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.851+0000 7f52e89dc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e406c380 con 0x7f52e415e4d0 2024-04-25T02:13:48.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.851+0000 7f52e89dc640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e40d1660 con 0x7f52e40b3020 2024-04-25T02:13:48.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.851+0000 7f52e89dc640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f52e40d1380 con 0x7f52e40b3570 2024-04-25T02:13:48.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.851+0000 7f52e259c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f52e415e4d0 0x7f52e406bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41834/0 (socket says 172.21.15.79:41834) 2024-04-25T02:13:48.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.851+0000 7f52e259c640 1 -- 172.21.15.79:0/1361216584 learned_addr learned my addr 172.21.15.79:0/1361216584 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:48.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e159a640 1 -- 172.21.15.79:0/1361216584 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384424772 0 0) 0x7f52e406c380 con 0x7f52e415e4d0 2024-04-25T02:13:48.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e1d9b640 1 --2- 172.21.15.79:0/1361216584 >> v2:172.21.15.189:3300/0 conn(0x7f52e40b3570 0x7f52e40d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e159a640 1 -- 172.21.15.79:0/1361216584 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52cc003520 con 0x7f52e415e4d0 2024-04-25T02:13:48.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e159a640 1 -- 172.21.15.79:0/1361216584 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1420928061 0 0) 0x7f52cc003520 con 0x7f52e415e4d0 2024-04-25T02:13:48.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e159a640 1 -- 172.21.15.79:0/1361216584 >> v2:172.21.15.189:3300/0 conn(0x7f52e40b3570 msgr2=0x7f52e40d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:48.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e159a640 1 --2- 172.21.15.79:0/1361216584 >> v2:172.21.15.189:3300/0 conn(0x7f52e40b3570 0x7f52e40d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e159a640 1 -- 172.21.15.79:0/1361216584 >> v1:172.21.15.189:6789/0 conn(0x7f52e40b3020 legacy=0x7f52e40cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e159a640 1 -- 172.21.15.79:0/1361216584 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e40cede0 con 0x7f52e415e4d0 2024-04-25T02:13:48.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e159a640 1 -- 172.21.15.79:0/1361216584 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f52dc001670 con 0x7f52e415e4d0 2024-04-25T02:13:48.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e159a640 1 -- 172.21.15.79:0/1361216584 >> v1:172.21.15.79:6789/0 conn(0x7f52e415e4d0 legacy=0x7f52e406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e159a640 1 --2- 172.21.15.79:0/1361216584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52cc0039e0 0x7f52cc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e159a640 1 --2- 172.21.15.79:0/1361216584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52cc004800 0x7f52cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e159a640 1 --2- 172.21.15.79:0/1361216584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52cc0051c0 0x7f52cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e159a640 1 -- 172.21.15.79:0/1361216584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f52e40d1380 con 0x7f52cc0051c0 2024-04-25T02:13:48.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e159a640 1 -- 172.21.15.79:0/1361216584 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc00c090 con 0x7f52cc0039e0 2024-04-25T02:13:48.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e159a640 1 -- 172.21.15.79:0/1361216584 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f52cc00c290 con 0x7f52cc004800 2024-04-25T02:13:48.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e2d9d640 1 --2- 172.21.15.79:0/1361216584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52cc0051c0 0x7f52cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e259c640 1 --2- 172.21.15.79:0/1361216584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52cc0039e0 0x7f52cc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e1d9b640 1 --2- 172.21.15.79:0/1361216584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52cc004800 0x7f52cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e2d9d640 1 -- 172.21.15.79:0/1361216584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52cc004800 msgr2=0x7f52cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:48.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e2d9d640 1 --2- 172.21.15.79:0/1361216584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52cc004800 0x7f52cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e2d9d640 1 -- 172.21.15.79:0/1361216584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52cc0039e0 msgr2=0x7f52cc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:48.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e2d9d640 1 --2- 172.21.15.79:0/1361216584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52cc0039e0 0x7f52cc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.852+0000 7f52e2d9d640 1 -- 172.21.15.79:0/1361216584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52cc003520 con 0x7f52cc0051c0 2024-04-25T02:13:48.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.853+0000 7f52e2d9d640 1 -- 172.21.15.79:0/1361216584 reap_dead start 2024-04-25T02:13:48.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.853+0000 7f52e2d9d640 1 --2- 172.21.15.79:0/1361216584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52cc0051c0 0x7f52cc00b9c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f52d4001750 tx=0x7f52cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd78a35ac0a6588 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:48.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.853+0000 7f52e159a640 1 -- 172.21.15.79:0/1361216584 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d4001370 con 0x7f52cc0051c0 2024-04-25T02:13:48.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.853+0000 7f52e159a640 1 -- 172.21.15.79:0/1361216584 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d4005310 con 0x7f52cc0051c0 2024-04-25T02:13:48.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.853+0000 7f52e159a640 1 -- 172.21.15.79:0/1361216584 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d402abe0 con 0x7f52cc0051c0 2024-04-25T02:13:48.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.854+0000 7f52e89dc640 1 -- 172.21.15.79:0/1361216584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52cc0051c0 msgr2=0x7f52cc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.854+0000 7f52e89dc640 1 --2- 172.21.15.79:0/1361216584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52cc0051c0 0x7f52cc00b9c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f52d4001750 tx=0x7f52cc005830 comp rx=0 tx=0).stop 2024-04-25T02:13:48.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.854+0000 7f52e89dc640 1 -- 172.21.15.79:0/1361216584 shutdown_connections 2024-04-25T02:13:48.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.854+0000 7f52e89dc640 1 --2- 172.21.15.79:0/1361216584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52cc0051c0 0x7f52cc00b9c0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.854+0000 7f52e89dc640 1 -- 172.21.15.79:0/1361216584 >> 172.21.15.79:0/1361216584 conn(0x7f52e409d460 msgr2=0x7f52e40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:48.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.854+0000 7f52e89dc640 1 -- 172.21.15.79:0/1361216584 shutdown_connections 2024-04-25T02:13:48.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.854+0000 7f52e89dc640 1 -- 172.21.15.79:0/1361216584 wait complete. 2024-04-25T02:13:48.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.855+0000 7f52e89dc640 1 Processor -- start 2024-04-25T02:13:48.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.855+0000 7f52e89dc640 1 -- start start 2024-04-25T02:13:48.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e89dc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52cc0051c0 0x7f52e41615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e89dc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52e4155040 0x7f52e4157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e89dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e41589b0 0x7f52e4158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e89dc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f52e40d20d0 con 0x7f52e41589b0 2024-04-25T02:13:48.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e89dc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f52e415e8b0 con 0x7f52cc0051c0 2024-04-25T02:13:48.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e89dc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f52e40d2250 con 0x7f52e4155040 2024-04-25T02:13:48.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e41589b0 0x7f52e4158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e41589b0 0x7f52e4158e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33272/0 (socket says 172.21.15.79:33272) 2024-04-25T02:13:48.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e2d9d640 1 -- 172.21.15.79:0/1567866244 learned_addr learned my addr 172.21.15.79:0/1567866244 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:48.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e2d9d640 1 -- 172.21.15.79:0/1567866244 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52e4155040 msgr2=0x7f52e4157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e2d9d640 1 --2- 172.21.15.79:0/1567866244 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52e4155040 0x7f52e4157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e2d9d640 1 -- 172.21.15.79:0/1567866244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52cc0051c0 msgr2=0x7f52e41615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:48.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e259c640 1 --2- 172.21.15.79:0/1567866244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52cc0051c0 0x7f52e41615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e2d9d640 1 --2- 172.21.15.79:0/1567866244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52cc0051c0 0x7f52e41615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:48.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e2d9d640 1 -- 172.21.15.79:0/1567866244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e4157560 con 0x7f52e41589b0 2024-04-25T02:13:48.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e259c640 1 --2- 172.21.15.79:0/1567866244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52cc0051c0 0x7f52e41615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:48.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.856+0000 7f52e2d9d640 1 --2- 172.21.15.79:0/1567866244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e41589b0 0x7f52e4158e30 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f52d4001870 tx=0x7f52d4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:48.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.857+0000 7f52d2ffd640 1 -- 172.21.15.79:0/1567866244 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d4001370 con 0x7f52e41589b0 2024-04-25T02:13:48.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.857+0000 7f52d2ffd640 1 -- 172.21.15.79:0/1567866244 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d4000ed0 con 0x7f52e41589b0 2024-04-25T02:13:48.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.857+0000 7f52d2ffd640 1 -- 172.21.15.79:0/1567866244 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d4007a30 con 0x7f52e41589b0 2024-04-25T02:13:48.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.857+0000 7f52e89dc640 1 -- 172.21.15.79:0/1567866244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e4155fc0 con 0x7f52e41589b0 2024-04-25T02:13:48.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.857+0000 7f52e89dc640 1 -- 172.21.15.79:0/1567866244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e4155a00 con 0x7f52e41589b0 2024-04-25T02:13:48.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.858+0000 7f52e89dc640 1 -- 172.21.15.79:0/1567866244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e4155480 con 0x7f52e41589b0 2024-04-25T02:13:48.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.858+0000 7f52d2ffd640 1 -- 172.21.15.79:0/1567866244 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52d4007030 con 0x7f52e41589b0 2024-04-25T02:13:48.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.858+0000 7f52d2ffd640 1 --2- 172.21.15.79:0/1567866244 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f52c406be30 0x7f52c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:48.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.858+0000 7f52d2ffd640 1 -- 172.21.15.79:0/1567866244 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f52d40aa1c0 con 0x7f52e41589b0 2024-04-25T02:13:48.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.858+0000 7f52e259c640 1 --2- 172.21.15.79:0/1567866244 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f52c406be30 0x7f52c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:48.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.859+0000 7f52e259c640 1 --2- 172.21.15.79:0/1567866244 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f52c406be30 0x7f52c406e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f52dc001eb0 tx=0x7f52dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:48.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:48.863+0000 7f52d2ffd640 1 -- 172.21.15.79:0/1567866244 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f52d4078c00 con 0x7f52e41589b0 2024-04-25T02:13:49.020 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-04-25T02:13:49.015+0000 7f01afbd3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:13:49.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.076+0000 7f52e89dc640 1 -- 172.21.15.79:0/1567866244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52e40690a0 con 0x7f52e41589b0 2024-04-25T02:13:49.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.077+0000 7f52d2ffd640 1 -- 172.21.15.79:0/1567866244 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5189 (secure 0 0 0) 0x7f52d402ae20 con 0x7f52e41589b0 2024-04-25T02:13:49.083 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:49.083 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:13:46.229372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7416},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7416":{"gid":7416,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2290864495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2290864495},{"type":"v1","addr":"172.21.15.79:6837","nonce":2290864495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7416,"qdb_cluster":[7416]},"id":6}]} 2024-04-25T02:13:49.083 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 48 2024-04-25T02:13:49.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.079+0000 7f52e89dc640 1 -- 172.21.15.79:0/1567866244 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f52c406be30 msgr2=0x7f52c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.079+0000 7f52e89dc640 1 --2- 172.21.15.79:0/1567866244 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f52c406be30 0x7f52c406e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f52dc001eb0 tx=0x7f52dc009040 comp rx=0 tx=0).stop 2024-04-25T02:13:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.079+0000 7f52e89dc640 1 -- 172.21.15.79:0/1567866244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e41589b0 msgr2=0x7f52e4158e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.079+0000 7f52e89dc640 1 --2- 172.21.15.79:0/1567866244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e41589b0 0x7f52e4158e30 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f52d4001870 tx=0x7f52d4001120 comp rx=0 tx=0).stop 2024-04-25T02:13:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.079+0000 7f52e89dc640 1 -- 172.21.15.79:0/1567866244 shutdown_connections 2024-04-25T02:13:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.079+0000 7f52e89dc640 1 --2- 172.21.15.79:0/1567866244 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f52c406be30 0x7f52c406e2f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.079+0000 7f52e89dc640 1 --2- 172.21.15.79:0/1567866244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e41589b0 0x7f52e4158e30 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.079+0000 7f52e89dc640 1 --2- 172.21.15.79:0/1567866244 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f52e4155040 0x7f52e4157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.079+0000 7f52e89dc640 1 --2- 172.21.15.79:0/1567866244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52cc0051c0 0x7f52e41615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.079+0000 7f52e89dc640 1 -- 172.21.15.79:0/1567866244 >> 172.21.15.79:0/1567866244 conn(0x7f52e409d460 msgr2=0x7f52e40d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.079+0000 7f52e89dc640 1 -- 172.21.15.79:0/1567866244 shutdown_connections 2024-04-25T02:13:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.079+0000 7f52e89dc640 1 -- 172.21.15.79:0/1567866244 wait complete. 2024-04-25T02:13:49.498 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:13:43.382458+0000', 'modified': '2024-04-25T02:13:46.229372+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7416}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7416': {'gid': 7416, 'name': 'a', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6837/2290864495', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 2290864495}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 2290864495}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7416, 'qdb_cluster': [7416]} 2024-04-25T02:13:49.499 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:13:49.499 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T02:13:49.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.591+0000 7f6f07a93640 1 Processor -- start 2024-04-25T02:13:49.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.591+0000 7f6f07a93640 1 -- start start 2024-04-25T02:13:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.592+0000 7f6f07a93640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6f0006e8c0 0x7f6f0015c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.592+0000 7f6f07a93640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f000cd170 0x7f6f00160470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.592+0000 7f6f07a93640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6f001609b0 0x7f6f000cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.592+0000 7f6f07a93640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6f0015cce0 con 0x7f6f001609b0 2024-04-25T02:13:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.592+0000 7f6f07a93640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6f0006eca0 con 0x7f6f0006e8c0 2024-04-25T02:13:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.592+0000 7f6f07a93640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6f0015cf80 con 0x7f6f000cd170 2024-04-25T02:13:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.592+0000 7f6f06030640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6f001609b0 0x7f6f000cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.592+0000 7f6f06030640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6f001609b0 0x7f6f000cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33282/0 (socket says 172.21.15.79:33282) 2024-04-25T02:13:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.592+0000 7f6f06030640 1 -- 172.21.15.79:0/4109832796 learned_addr learned my addr 172.21.15.79:0/4109832796 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.593+0000 7f6f0582f640 1 --2- 172.21.15.79:0/4109832796 >> v2:172.21.15.189:3300/0 conn(0x7f6f0006e8c0 0x7f6f0015c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.593+0000 7f6f0502e640 1 --2- 172.21.15.79:0/4109832796 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f000cd170 0x7f6f00160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.593+0000 7f6f06030640 1 -- 172.21.15.79:0/4109832796 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f000cd170 msgr2=0x7f6f00160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.593+0000 7f6f06030640 1 --2- 172.21.15.79:0/4109832796 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f000cd170 0x7f6f00160470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.593+0000 7f6f06030640 1 -- 172.21.15.79:0/4109832796 >> v2:172.21.15.189:3300/0 conn(0x7f6f0006e8c0 msgr2=0x7f6f0015c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:49.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.593+0000 7f6f06030640 1 --2- 172.21.15.79:0/4109832796 >> v2:172.21.15.189:3300/0 conn(0x7f6f0006e8c0 0x7f6f0015c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.593+0000 7f6f06030640 1 -- 172.21.15.79:0/4109832796 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0015d260 con 0x7f6f001609b0 2024-04-25T02:13:49.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.593+0000 7f6f0502e640 1 --2- 172.21.15.79:0/4109832796 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f000cd170 0x7f6f00160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:49.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.593+0000 7f6f06030640 1 --2- 172.21.15.79:0/4109832796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f001609b0 0x7f6f000cb340 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f6f000d0c30 tx=0x7f6ef002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d912bc6f58a8bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:49.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.593+0000 7f6f0482d640 1 -- 172.21.15.79:0/4109832796 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0036070 con 0x7f6f001609b0 2024-04-25T02:13:49.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.593+0000 7f6f0482d640 1 -- 172.21.15.79:0/4109832796 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef0031600 con 0x7f6f001609b0 2024-04-25T02:13:49.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.593+0000 7f6f0482d640 1 -- 172.21.15.79:0/4109832796 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef00319d0 con 0x7f6f001609b0 2024-04-25T02:13:49.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.594+0000 7f6f07a93640 1 -- 172.21.15.79:0/4109832796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f001609b0 msgr2=0x7f6f000cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.594+0000 7f6f07a93640 1 --2- 172.21.15.79:0/4109832796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f001609b0 0x7f6f000cb340 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f6f000d0c30 tx=0x7f6ef002a6a0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.594+0000 7f6f07a93640 1 -- 172.21.15.79:0/4109832796 shutdown_connections 2024-04-25T02:13:49.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.594+0000 7f6f07a93640 1 --2- 172.21.15.79:0/4109832796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f001609b0 0x7f6f000cb340 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.594+0000 7f6f07a93640 1 --2- 172.21.15.79:0/4109832796 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f000cd170 0x7f6f00160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.594+0000 7f6f07a93640 1 --2- 172.21.15.79:0/4109832796 >> v2:172.21.15.189:3300/0 conn(0x7f6f0006e8c0 0x7f6f0015c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.594+0000 7f6f07a93640 1 -- 172.21.15.79:0/4109832796 >> 172.21.15.79:0/4109832796 conn(0x7f6f000cd770 msgr2=0x7f6f000cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.594+0000 7f6f07a93640 1 -- 172.21.15.79:0/4109832796 shutdown_connections 2024-04-25T02:13:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.594+0000 7f6f07a93640 1 -- 172.21.15.79:0/4109832796 wait complete. 2024-04-25T02:13:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.595+0000 7f6f07a93640 1 Processor -- start 2024-04-25T02:13:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.595+0000 7f6f07a93640 1 -- start start 2024-04-25T02:13:49.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6f07a93640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f0006e8c0 0x7f6f00148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6f07a93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f000cd170 0x7f6f000c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6f07a93640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f001609b0 0x7f6f000ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6f07a93640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6f000cb880 con 0x7f6f000cd170 2024-04-25T02:13:49.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6f07a93640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0015ff50 con 0x7f6f0006e8c0 2024-04-25T02:13:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6f07a93640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6f000cba00 con 0x7f6f001609b0 2024-04-25T02:13:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6f0502e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f000cd170 0x7f6f000c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6f0502e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f000cd170 0x7f6f000c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33292/0 (socket says 172.21.15.79:33292) 2024-04-25T02:13:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6f0502e640 1 -- 172.21.15.79:0/4079379516 learned_addr learned my addr 172.21.15.79:0/4079379516 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6f0502e640 1 -- 172.21.15.79:0/4079379516 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f001609b0 msgr2=0x7f6f000ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6f0502e640 1 --2- 172.21.15.79:0/4079379516 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f001609b0 0x7f6f000ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6f0502e640 1 -- 172.21.15.79:0/4079379516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f0006e8c0 msgr2=0x7f6f00148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6f0502e640 1 --2- 172.21.15.79:0/4079379516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f0006e8c0 0x7f6f00148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6f0502e640 1 -- 172.21.15.79:0/4079379516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f00148fd0 con 0x7f6f000cd170 2024-04-25T02:13:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6f0502e640 1 --2- 172.21.15.79:0/4079379516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f000cd170 0x7f6f000c6220 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400c7f0 tx=0x7f6ef400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.596+0000 7f6efe7fc640 1 -- 172.21.15.79:0/4079379516 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4015070 con 0x7f6f000cd170 2024-04-25T02:13:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.597+0000 7f6efe7fc640 1 -- 172.21.15.79:0/4079379516 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef4007a30 con 0x7f6f000cd170 2024-04-25T02:13:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.597+0000 7f6f07a93640 1 -- 172.21.15.79:0/4079379516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f000c6ce0 con 0x7f6f000cd170 2024-04-25T02:13:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.597+0000 7f6efe7fc640 1 -- 172.21.15.79:0/4079379516 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4007e00 con 0x7f6f000cd170 2024-04-25T02:13:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.597+0000 7f6f07a93640 1 -- 172.21.15.79:0/4079379516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f000c81e0 con 0x7f6f000cd170 2024-04-25T02:13:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.598+0000 7f6efe7fc640 1 -- 172.21.15.79:0/4079379516 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ef4018070 con 0x7f6f000cd170 2024-04-25T02:13:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.598+0000 7f6efe7fc640 1 --2- 172.21.15.79:0/4079379516 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6eec06be30 0x7f6eec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.598+0000 7f6efe7fc640 1 -- 172.21.15.79:0/4079379516 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f6ef408acf0 con 0x7f6f000cd170 2024-04-25T02:13:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.598+0000 7f6f0582f640 1 --2- 172.21.15.79:0/4079379516 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6eec06be30 0x7f6eec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.599+0000 7f6f0582f640 1 --2- 172.21.15.79:0/4079379516 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6eec06be30 0x7f6eec06e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8006fd0 tx=0x7f6ef8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.599+0000 7f6f0a79e740 1 Processor -- start 2024-04-25T02:13:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.599+0000 7f6f0a79e740 1 -- start start 2024-04-25T02:13:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f0a79e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 0x563a032ef4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f0a79e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a0331f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f0a79e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0331f540 0x563a032f4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f0a79e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563a03257f00 con 0x563a0331fc80 2024-04-25T02:13:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f0a79e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563a03200750 con 0x563a0333cb60 2024-04-25T02:13:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f0a79e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x563a03253ec0 con 0x563a0331f540 2024-04-25T02:13:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f0502e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a0331f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f0502e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a0331f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33304/0 (socket says 172.21.15.79:33304) 2024-04-25T02:13:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f0502e640 1 -- 172.21.15.79:0/2626782936 learned_addr learned my addr 172.21.15.79:0/2626782936 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f0502e640 1 -- 172.21.15.79:0/2626782936 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0331f540 msgr2=0x563a032f4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f06030640 1 --2- 172.21.15.79:0/2626782936 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0331f540 0x563a032f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f0582f640 1 --2- 172.21.15.79:0/2626782936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 0x563a032ef4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f0502e640 1 --2- 172.21.15.79:0/2626782936 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0331f540 0x563a032f4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f0502e640 1 -- 172.21.15.79:0/2626782936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 msgr2=0x563a032ef4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f0502e640 1 --2- 172.21.15.79:0/2626782936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 0x563a032ef4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.600+0000 7f6f0502e640 1 -- 172.21.15.79:0/2626782936 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a02f6c2d0 con 0x563a0331fc80 2024-04-25T02:13:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.601+0000 7f6f0502e640 1 --2- 172.21.15.79:0/2626782936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a0331f000 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4089220 tx=0x7f6ef4059030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d2b91851a16de7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.601+0000 7f6ee77fe640 1 -- 172.21.15.79:0/2626782936 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4071020 con 0x563a0331fc80 2024-04-25T02:13:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.601+0000 7f6ee77fe640 1 -- 172.21.15.79:0/2626782936 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef4061c10 con 0x563a0331fc80 2024-04-25T02:13:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.601+0000 7f6ee77fe640 1 -- 172.21.15.79:0/2626782936 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef401f040 con 0x563a0331fc80 2024-04-25T02:13:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.601+0000 7f6f0a79e740 1 -- 172.21.15.79:0/2626782936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 msgr2=0x563a0331f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.601+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/2626782936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a0331f000 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4089220 tx=0x7f6ef4059030 comp rx=0 tx=0).stop 2024-04-25T02:13:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.601+0000 7f6f0a79e740 1 -- 172.21.15.79:0/2626782936 shutdown_connections 2024-04-25T02:13:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.601+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/2626782936 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0331f540 0x563a032f4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.601+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/2626782936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a0331f000 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.601+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/2626782936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 0x563a032ef4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.601+0000 7f6f0a79e740 1 -- 172.21.15.79:0/2626782936 >> 172.21.15.79:0/2626782936 conn(0x563a032f1760 msgr2=0x563a0333a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.601+0000 7f6f0a79e740 1 -- 172.21.15.79:0/2626782936 shutdown_connections 2024-04-25T02:13:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.601+0000 7f6f0a79e740 1 -- 172.21.15.79:0/2626782936 wait complete. 2024-04-25T02:13:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.602+0000 7f6f0a79e740 1 -- start start 2024-04-25T02:13:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.602+0000 7f6f0a79e740 1 Processor -- start 2024-04-25T02:13:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0a79e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a03322140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0a79e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 0x563a0331ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0a79e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0333c220 0x563a0331a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0a79e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563a032f3910 con 0x563a0331fc80 2024-04-25T02:13:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0a79e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563a03213cf0 con 0x563a0333cb60 2024-04-25T02:13:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0a79e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x563a032f2d00 con 0x563a0333c220 2024-04-25T02:13:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0a79e740 10 client.0 _ll_register_callbacks cb 0x563a032136e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:13:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0582f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a03322140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0582f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a03322140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33306/0 (socket says 172.21.15.79:33306) 2024-04-25T02:13:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0582f640 1 -- 172.21.15.79:0/293436731 learned_addr learned my addr 172.21.15.79:0/293436731 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0502e640 1 --2- 172.21.15.79:0/293436731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 0x563a0331ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f06030640 1 --2- 172.21.15.79:0/293436731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0333c220 0x563a0331a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0582f640 1 -- 172.21.15.79:0/293436731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0333c220 msgr2=0x563a0331a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0582f640 1 --2- 172.21.15.79:0/293436731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0333c220 0x563a0331a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0582f640 1 -- 172.21.15.79:0/293436731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 msgr2=0x563a0331ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0582f640 1 --2- 172.21.15.79:0/293436731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 0x563a0331ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0582f640 1 -- 172.21.15.79:0/293436731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a030366b0 con 0x563a0331fc80 2024-04-25T02:13:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f06030640 1 --2- 172.21.15.79:0/293436731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0333c220 0x563a0331a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0582f640 1 --2- 172.21.15.79:0/293436731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a03322140 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800de10 tx=0x7f6ef80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a2c2e24cc6a227 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6ee4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:13:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6ee4ff9640 1 -- 172.21.15.79:0/293436731 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef801a050 con 0x563a0331fc80 2024-04-25T02:13:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6ee4ff9640 1 -- 172.21.15.79:0/293436731 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f6ef800de40 con 0x563a0331fc80 2024-04-25T02:13:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.603+0000 7f6f0a79e740 1 -- 172.21.15.79:0/293436731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ef4061c10 con 0x563a0331fc80 2024-04-25T02:13:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.604+0000 7f6ee4ff9640 1 -- 172.21.15.79:0/293436731 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f6ef8005990 con 0x563a0331fc80 2024-04-25T02:13:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.604+0000 7f6f0a79e740 10 client.7533 fetch_fsmap learned FSMap version 48 2024-04-25T02:13:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.604+0000 7f6f0a79e740 1 -- 172.21.15.79:0/293436731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) -- 0x563a033207d0 con 0x563a0331fc80 2024-04-25T02:13:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.604+0000 7f6ee4ff9640 1 -- 172.21.15.79:0/293436731 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef4061c10 con 0x563a0331fc80 2024-04-25T02:13:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.604+0000 7f6ee4ff9640 1 -- 172.21.15.79:0/293436731 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 48) ==== 3494+0+0 (secure 0 0 0) 0x7f6ef802f080 con 0x563a0331fc80 2024-04-25T02:13:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.604+0000 7f6f0a79e740 10 client.7533 fetch_fsmap finished waiting for FSMap version 48 2024-04-25T02:13:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.604+0000 7f6f0a79e740 10 client.7533 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:13:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.604+0000 7f6f0a79e740 20 client.7533 populate_metadata read hostname 'smithi079' 2024-04-25T02:13:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.604+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/293436731 >> [v2:172.21.15.79:6836/2290864495,v1:172.21.15.79:6837/2290864495] conn(0x563a0333a3e0 0x563a0333a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.604+0000 7f6f0a79e740 4 client.7533 mds_command: new command op to 7416 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:13:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.604+0000 7f6f0a79e740 1 -- 172.21.15.79:0/293436731 --> [v2:172.21.15.79:6836/2290864495,v1:172.21.15.79:6837/2290864495] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a03265440 con 0x563a0333a3e0 2024-04-25T02:13:49.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.604+0000 7f6f0502e640 1 --2- 172.21.15.79:0/293436731 >> [v2:172.21.15.79:6836/2290864495,v1:172.21.15.79:6837/2290864495] conn(0x563a0333a3e0 0x563a0333a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.604+0000 7f6ee4ff9640 10 client.7533 ms_handle_connect on v2:172.21.15.79:6836/2290864495 2024-04-25T02:13:49.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.604+0000 7f6f0502e640 1 --2- 172.21.15.79:0/293436731 >> [v2:172.21.15.79:6836/2290864495,v1:172.21.15.79:6837/2290864495] conn(0x563a0333a3e0 0x563a0333a7c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0988fbb9da94108 server_cookie=5d80eb947fd27cef in_seq=0 out_seq=0 2024-04-25T02:13:49.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.605+0000 7f6ee4ff9640 1 -- 172.21.15.79:0/293436731 <== mds.0 v2:172.21.15.79:6836/2290864495 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563a03265440 con 0x563a0333a3e0 2024-04-25T02:13:49.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.605+0000 7f6ee4ff9640 10 client.7533 handle_command_reply: tid=0 2024-04-25T02:13:49.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.605+0000 7f6f0a79e740 1 client.7533 shutdown 2024-04-25T02:13:49.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.605+0000 7f6f0a79e740 1 -- 172.21.15.79:0/293436731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 msgr2=0x563a03322140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.605+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/293436731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a03322140 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800de10 tx=0x7f6ef80046c0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.605+0000 7f6f0a79e740 1 -- 172.21.15.79:0/293436731 shutdown_connections 2024-04-25T02:13:49.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.605+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/293436731 >> [v2:172.21.15.79:6836/2290864495,v1:172.21.15.79:6837/2290864495] conn(0x563a0333a3e0 0x563a0333a7c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.605+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/293436731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0333c220 0x563a0331a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.605+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/293436731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 0x563a0331ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.605+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/293436731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a03322140 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.605+0000 7f6f0a79e740 1 -- 172.21.15.79:0/293436731 >> 172.21.15.79:0/293436731 conn(0x563a0331f540 msgr2=0x563a0333d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:49.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.605+0000 7f6ee4ff9640 0 client.7533 ms_handle_reset on v2:172.21.15.79:6836/2290864495 2024-04-25T02:13:49.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.605+0000 7f6f0a79e740 1 -- 172.21.15.79:0/293436731 shutdown_connections 2024-04-25T02:13:49.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.605+0000 7f6f0a79e740 1 -- 172.21.15.79:0/293436731 wait complete. 2024-04-25T02:13:49.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.605+0000 7f6f0a79e740 20 client.7533 trim_cache size 0 max 16384 2024-04-25T02:13:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.623+0000 7f6f0a79e740 1 Processor -- start 2024-04-25T02:13:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.623+0000 7f6f0a79e740 1 -- start start 2024-04-25T02:13:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.624+0000 7f6f0a79e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a033395f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.624+0000 7f6f0a79e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 0x563a0331a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.624+0000 7f6f0a79e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0331a690 0x563a032eeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.624+0000 7f6f0a79e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6f001fd5b0 con 0x563a0331fc80 2024-04-25T02:13:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.624+0000 7f6f0a79e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6f001f6810 con 0x563a0333cb60 2024-04-25T02:13:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.624+0000 7f6f0a79e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6f001fcf90 con 0x563a0331a690 2024-04-25T02:13:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.624+0000 7f6f0582f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a033395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.624+0000 7f6f0582f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a033395f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33318/0 (socket says 172.21.15.79:33318) 2024-04-25T02:13:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.624+0000 7f6f0582f640 1 -- 172.21.15.79:0/2442720486 learned_addr learned my addr 172.21.15.79:0/2442720486 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.624+0000 7f6f0582f640 1 -- 172.21.15.79:0/2442720486 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0331a690 msgr2=0x563a032eeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.624+0000 7f6f0582f640 1 --2- 172.21.15.79:0/2442720486 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0331a690 0x563a032eeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.624+0000 7f6f0582f640 1 -- 172.21.15.79:0/2442720486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 msgr2=0x563a0331a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.624+0000 7f6f0582f640 1 --2- 172.21.15.79:0/2442720486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 0x563a0331a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.624+0000 7f6f0582f640 1 -- 172.21.15.79:0/2442720486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a032f6450 con 0x563a0331fc80 2024-04-25T02:13:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.625+0000 7f6f0582f640 1 --2- 172.21.15.79:0/2442720486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a033395f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8006e80 tx=0x7f6ef801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960504c96ee8e42c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:49.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.625+0000 7f6ee6ffd640 1 -- 172.21.15.79:0/2442720486 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef801a050 con 0x563a0331fc80 2024-04-25T02:13:49.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.625+0000 7f6ee6ffd640 1 -- 172.21.15.79:0/2442720486 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef8024070 con 0x563a0331fc80 2024-04-25T02:13:49.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.625+0000 7f6ee6ffd640 1 -- 172.21.15.79:0/2442720486 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8033070 con 0x563a0331fc80 2024-04-25T02:13:49.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.625+0000 7f6f0a79e740 1 -- 172.21.15.79:0/2442720486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 msgr2=0x563a033395f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.625+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/2442720486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a033395f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8006e80 tx=0x7f6ef801e000 comp rx=0 tx=0).stop 2024-04-25T02:13:49.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.625+0000 7f6f0a79e740 1 -- 172.21.15.79:0/2442720486 shutdown_connections 2024-04-25T02:13:49.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.625+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/2442720486 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0331a690 0x563a032eeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.625+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/2442720486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 0x563a0331a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.625+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/2442720486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a033395f0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.625+0000 7f6f0a79e740 1 -- 172.21.15.79:0/2442720486 >> 172.21.15.79:0/2442720486 conn(0x563a0331f540 msgr2=0x563a0331ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:49.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.625+0000 7f6f0a79e740 1 -- 172.21.15.79:0/2442720486 shutdown_connections 2024-04-25T02:13:49.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.625+0000 7f6f0a79e740 1 -- 172.21.15.79:0/2442720486 wait complete. 2024-04-25T02:13:49.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.626+0000 7f6f0a79e740 1 -- start start 2024-04-25T02:13:49.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.626+0000 7f6f0a79e740 1 Processor -- start 2024-04-25T02:13:49.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0a79e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0331a690 0x563a033b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0a79e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a033b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0a79e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 0x563a0331bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0a79e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563a0334a6e0 con 0x563a0331fc80 2024-04-25T02:13:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0a79e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563a0334aa00 con 0x563a0333cb60 2024-04-25T02:13:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0a79e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x563a03320fc0 con 0x563a0331a690 2024-04-25T02:13:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0a79e740 10 client.0 _ll_register_callbacks cb 0x7f6ef800dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:13:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0502e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a033b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0502e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a033b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33326/0 (socket says 172.21.15.79:33326) 2024-04-25T02:13:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0502e640 1 -- 172.21.15.79:0/3317388955 learned_addr learned my addr 172.21.15.79:0/3317388955 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f06030640 1 --2- 172.21.15.79:0/3317388955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 0x563a0331bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0582f640 1 --2- 172.21.15.79:0/3317388955 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0331a690 0x563a033b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0502e640 1 -- 172.21.15.79:0/3317388955 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0331a690 msgr2=0x563a033b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0502e640 1 --2- 172.21.15.79:0/3317388955 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0331a690 0x563a033b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0502e640 1 -- 172.21.15.79:0/3317388955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 msgr2=0x563a0331bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0502e640 1 --2- 172.21.15.79:0/3317388955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 0x563a0331bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0502e640 1 -- 172.21.15.79:0/3317388955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a0331b800 con 0x563a0331fc80 2024-04-25T02:13:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0502e640 1 --2- 172.21.15.79:0/3317388955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a033b4e40 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40616e0 tx=0x7f6ef4089180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928cae1e59c6522f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6ee4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:13:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6ee4ff9640 1 -- 172.21.15.79:0/3317388955 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef401f040 con 0x563a0331fc80 2024-04-25T02:13:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6ee4ff9640 1 -- 172.21.15.79:0/3317388955 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f6ef4058480 con 0x563a0331fc80 2024-04-25T02:13:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.627+0000 7f6f0a79e740 1 -- 172.21.15.79:0/3317388955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ef8024070 con 0x563a0331fc80 2024-04-25T02:13:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6ee4ff9640 1 -- 172.21.15.79:0/3317388955 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f6ef4061e60 con 0x563a0331fc80 2024-04-25T02:13:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6f0a79e740 10 client.7539 fetch_fsmap learned FSMap version 48 2024-04-25T02:13:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6f0a79e740 1 -- 172.21.15.79:0/3317388955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) -- 0x563a03330900 con 0x563a0331fc80 2024-04-25T02:13:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6ee4ff9640 1 -- 172.21.15.79:0/3317388955 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef8024070 con 0x563a0331fc80 2024-04-25T02:13:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6ee4ff9640 1 -- 172.21.15.79:0/3317388955 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 48) ==== 3494+0+0 (secure 0 0 0) 0x7f6ef4054d80 con 0x563a0331fc80 2024-04-25T02:13:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6f0a79e740 10 client.7539 fetch_fsmap finished waiting for FSMap version 48 2024-04-25T02:13:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6f0a79e740 10 client.7539 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:13:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6f0a79e740 20 client.7539 populate_metadata read hostname 'smithi079' 2024-04-25T02:13:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/3317388955 >> [v2:172.21.15.79:6836/2290864495,v1:172.21.15.79:6837/2290864495] conn(0x563a0333d750 0x563a032eec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6f0a79e740 4 client.7539 mds_command: new command op to 7416 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:13:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6f0a79e740 1 -- 172.21.15.79:0/3317388955 --> [v2:172.21.15.79:6836/2290864495,v1:172.21.15.79:6837/2290864495] -- command(tid 0: {"prefix": "status"}) -- 0x563a0325f790 con 0x563a0333d750 2024-04-25T02:13:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6f0582f640 1 --2- 172.21.15.79:0/3317388955 >> [v2:172.21.15.79:6836/2290864495,v1:172.21.15.79:6837/2290864495] conn(0x563a0333d750 0x563a032eec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6ee4ff9640 10 client.7539 ms_handle_connect on v2:172.21.15.79:6836/2290864495 2024-04-25T02:13:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6f0582f640 1 --2- 172.21.15.79:0/3317388955 >> [v2:172.21.15.79:6836/2290864495,v1:172.21.15.79:6837/2290864495] conn(0x563a0333d750 0x563a032eec10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=960d72144145dcf server_cookie=bfcd2dd2efc509ec in_seq=0 out_seq=0 2024-04-25T02:13:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6ee4ff9640 1 -- 172.21.15.79:0/3317388955 <== mds.0 v2:172.21.15.79:6836/2290864495 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x563a0325f790 con 0x563a0333d750 2024-04-25T02:13:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6ee4ff9640 10 client.7539 handle_command_reply: tid=0 2024-04-25T02:13:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6f0a79e740 1 client.7539 shutdown 2024-04-25T02:13:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6f0a79e740 1 -- 172.21.15.79:0/3317388955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 msgr2=0x563a033b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/3317388955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a033b4e40 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40616e0 tx=0x7f6ef4089180 comp rx=0 tx=0).stop 2024-04-25T02:13:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6f0a79e740 1 -- 172.21.15.79:0/3317388955 shutdown_connections 2024-04-25T02:13:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.628+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/3317388955 >> [v2:172.21.15.79:6836/2290864495,v1:172.21.15.79:6837/2290864495] conn(0x563a0333d750 0x563a032eec10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/3317388955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0333cb60 0x563a0331bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/3317388955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a0331fc80 0x563a033b4e40 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6ee4ff9640 0 client.7539 ms_handle_reset on v2:172.21.15.79:6836/2290864495 2024-04-25T02:13:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f0a79e740 1 --2- 172.21.15.79:0/3317388955 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563a0331a690 0x563a033b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f0a79e740 1 -- 172.21.15.79:0/3317388955 >> 172.21.15.79:0/3317388955 conn(0x563a0331f540 msgr2=0x563a0331e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f0a79e740 1 -- 172.21.15.79:0/3317388955 shutdown_connections 2024-04-25T02:13:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f0a79e740 1 -- 172.21.15.79:0/3317388955 wait complete. 2024-04-25T02:13:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f0a79e740 20 client.7539 trim_cache size 0 max 16384 2024-04-25T02:13:49.641 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:13:49.641 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "696648c4-3e52-400b-a780-2e8863c56c42", 2024-04-25T02:13:49.641 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-04-25T02:13:49.641 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7416, 2024-04-25T02:13:49.641 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-04-25T02:13:49.641 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-04-25T02:13:49.641 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-04-25T02:13:49.641 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 5.5856707310000004, 2024-04-25T02:13:49.641 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 48, 2024-04-25T02:13:49.642 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 86, 2024-04-25T02:13:49.642 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 86, 2024-04-25T02:13:49.642 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 10.705692403 2024-04-25T02:13:49.642 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:13:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f07a93640 1 -- 172.21.15.79:0/4079379516 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6eec06be30 msgr2=0x7f6eec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f07a93640 1 --2- 172.21.15.79:0/4079379516 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6eec06be30 0x7f6eec06e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8006fd0 tx=0x7f6ef8008040 comp rx=0 tx=0).stop 2024-04-25T02:13:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f07a93640 1 -- 172.21.15.79:0/4079379516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f000cd170 msgr2=0x7f6f000c6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f07a93640 1 --2- 172.21.15.79:0/4079379516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f000cd170 0x7f6f000c6220 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400c7f0 tx=0x7f6ef400cbf0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f07a93640 1 -- 172.21.15.79:0/4079379516 shutdown_connections 2024-04-25T02:13:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f07a93640 1 --2- 172.21.15.79:0/4079379516 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6eec06be30 0x7f6eec06e2f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f07a93640 1 --2- 172.21.15.79:0/4079379516 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f001609b0 0x7f6f000ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f07a93640 1 --2- 172.21.15.79:0/4079379516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f000cd170 0x7f6f000c6220 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f07a93640 1 --2- 172.21.15.79:0/4079379516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f0006e8c0 0x7f6f00148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f07a93640 1 -- 172.21.15.79:0/4079379516 >> 172.21.15.79:0/4079379516 conn(0x7f6f000cd770 msgr2=0x7f6f0015e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f07a93640 1 -- 172.21.15.79:0/4079379516 shutdown_connections 2024-04-25T02:13:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.629+0000 7f6f07a93640 1 -- 172.21.15.79:0/4079379516 wait complete. 2024-04-25T02:13:49.646 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:13:49.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.736+0000 7f96392e1640 1 Processor -- start 2024-04-25T02:13:49.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.736+0000 7f96392e1640 1 -- start start 2024-04-25T02:13:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.737+0000 7f96392e1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f963415e140 0x7f9634066ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.737+0000 7f96392e1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96340cea70 con 0x7f963406b0b0 2024-04-25T02:13:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.737+0000 7f96392e1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96340ced50 con 0x7f963415e520 2024-04-25T02:13:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.737+0000 7f96392e1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9634067480 con 0x7f963415e140 2024-04-25T02:13:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.737+0000 7f9632ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f963415e140 0x7f9634066ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.737+0000 7f96337fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f963406b0b0 0x7f96340c97b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41836/0 (socket says 172.21.15.79:41836) 2024-04-25T02:13:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.737+0000 7f96337fe640 1 -- 172.21.15.79:0/1799721612 learned_addr learned my addr 172.21.15.79:0/1799721612 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:49.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.737+0000 7f9632ffd640 1 -- 172.21.15.79:0/1799721612 >> v1:172.21.15.189:6789/0 conn(0x7f963415e520 legacy=0x7f96340af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:49.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.737+0000 7f9632ffd640 1 -- 172.21.15.79:0/1799721612 >> v1:172.21.15.79:6789/0 conn(0x7f963406b0b0 legacy=0x7f96340c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.737+0000 7f9631ffb640 1 -- 172.21.15.79:0/1799721612 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 190362038 0 0) 0x7f96340cea70 con 0x7f963406b0b0 2024-04-25T02:13:49.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.737+0000 7f9632ffd640 1 -- 172.21.15.79:0/1799721612 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96340cf030 con 0x7f963415e140 2024-04-25T02:13:49.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.738+0000 7f9632ffd640 1 --2- 172.21.15.79:0/1799721612 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f963415e140 0x7f9634066ea0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f962c0097a0 tx=0x7f962c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc27ef0412e339c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:49.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.738+0000 7f9631ffb640 1 -- 172.21.15.79:0/1799721612 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c037070 con 0x7f963415e140 2024-04-25T02:13:49.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.738+0000 7f9631ffb640 1 -- 172.21.15.79:0/1799721612 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f962c02ae50 con 0x7f963415e140 2024-04-25T02:13:49.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.738+0000 7f9631ffb640 1 -- 172.21.15.79:0/1799721612 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c032660 con 0x7f963415e140 2024-04-25T02:13:49.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.738+0000 7f96392e1640 1 -- 172.21.15.79:0/1799721612 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f963415e140 msgr2=0x7f9634066ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.738+0000 7f96392e1640 1 --2- 172.21.15.79:0/1799721612 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f963415e140 0x7f9634066ea0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f962c0097a0 tx=0x7f962c02a140 comp rx=0 tx=0).stop 2024-04-25T02:13:49.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.739+0000 7f96392e1640 1 -- 172.21.15.79:0/1799721612 shutdown_connections 2024-04-25T02:13:49.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.739+0000 7f96392e1640 1 --2- 172.21.15.79:0/1799721612 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f963415e140 0x7f9634066ea0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.739+0000 7f96392e1640 1 -- 172.21.15.79:0/1799721612 >> 172.21.15.79:0/1799721612 conn(0x7f96340ccee0 msgr2=0x7f96340cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:49.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.739+0000 7f96392e1640 1 -- 172.21.15.79:0/1799721612 shutdown_connections 2024-04-25T02:13:49.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.739+0000 7f96392e1640 1 -- 172.21.15.79:0/1799721612 wait complete. 2024-04-25T02:13:49.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.740+0000 7f96392e1640 1 Processor -- start 2024-04-25T02:13:49.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.740+0000 7f96392e1640 1 -- start start 2024-04-25T02:13:49.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96392e1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f963406b0b0 0x7f96340ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96392e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f963415e140 0x7f963415d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96392e1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f963415e520 0x7f963406c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96392e1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f96340cf3a0 con 0x7f963415e140 2024-04-25T02:13:49.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96392e1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96340ca110 con 0x7f963415e520 2024-04-25T02:13:49.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96392e1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f963406b540 con 0x7f963406b0b0 2024-04-25T02:13:49.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96327fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f963415e140 0x7f963415d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96327fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f963415e140 0x7f963415d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33344/0 (socket says 172.21.15.79:33344) 2024-04-25T02:13:49.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96327fc640 1 -- 172.21.15.79:0/2496545832 learned_addr learned my addr 172.21.15.79:0/2496545832 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:49.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f9632ffd640 1 --2- 172.21.15.79:0/2496545832 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f963406b0b0 0x7f96340ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96337fe640 1 --2- 172.21.15.79:0/2496545832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f963415e520 0x7f963406c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96327fc640 1 -- 172.21.15.79:0/2496545832 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f963406b0b0 msgr2=0x7f96340ab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96327fc640 1 --2- 172.21.15.79:0/2496545832 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f963406b0b0 0x7f96340ab9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96327fc640 1 -- 172.21.15.79:0/2496545832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f963415e520 msgr2=0x7f963406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96327fc640 1 --2- 172.21.15.79:0/2496545832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f963415e520 0x7f963406c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96327fc640 1 -- 172.21.15.79:0/2496545832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963414cd70 con 0x7f963415e140 2024-04-25T02:13:49.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96337fe640 1 --2- 172.21.15.79:0/2496545832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f963415e520 0x7f963406c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:49.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96327fc640 1 --2- 172.21.15.79:0/2496545832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f963415e140 0x7f963415d160 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f962800b3f0 tx=0x7f962800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:49.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f961b7fe640 1 -- 172.21.15.79:0/2496545832 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628015020 con 0x7f963415e140 2024-04-25T02:13:49.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f961b7fe640 1 -- 172.21.15.79:0/2496545832 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9628011830 con 0x7f963415e140 2024-04-25T02:13:49.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96392e1640 1 -- 172.21.15.79:0/2496545832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f963414d050 con 0x7f963415e140 2024-04-25T02:13:49.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f961b7fe640 1 -- 172.21.15.79:0/2496545832 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628011c20 con 0x7f963415e140 2024-04-25T02:13:49.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.741+0000 7f96392e1640 1 -- 172.21.15.79:0/2496545832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f963414d610 con 0x7f963415e140 2024-04-25T02:13:49.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.742+0000 7f96392e1640 1 -- 172.21.15.79:0/2496545832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96340a9590 con 0x7f963415e140 2024-04-25T02:13:49.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.743+0000 7f961b7fe640 1 -- 172.21.15.79:0/2496545832 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9628018020 con 0x7f963415e140 2024-04-25T02:13:49.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.743+0000 7f961b7fe640 1 --2- 172.21.15.79:0/2496545832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f962006be30 0x7f962006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:49.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.743+0000 7f961b7fe640 1 -- 172.21.15.79:0/2496545832 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f962808a970 con 0x7f963415e140 2024-04-25T02:13:49.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.743+0000 7f9632ffd640 1 --2- 172.21.15.79:0/2496545832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f962006be30 0x7f962006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:49.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.743+0000 7f9632ffd640 1 --2- 172.21.15.79:0/2496545832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f962006be30 0x7f962006e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f962c034000 tx=0x7f962c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:49.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.747+0000 7f961b7fe640 1 -- 172.21.15.79:0/2496545832 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f962801f030 con 0x7f963415e140 2024-04-25T02:13:49.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.955+0000 7f96392e1640 1 -- 172.21.15.79:0/2496545832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f963406daa0 con 0x7f963415e140 2024-04-25T02:13:49.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.956+0000 7f961b7fe640 1 -- 172.21.15.79:0/2496545832 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) ==== 53+0+73 (secure 0 0 0) 0x7f96280593b0 con 0x7f963415e140 2024-04-25T02:13:49.962 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:13:49.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.958+0000 7f96392e1640 1 -- 172.21.15.79:0/2496545832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f962006be30 msgr2=0x7f962006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.958+0000 7f96392e1640 1 --2- 172.21.15.79:0/2496545832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f962006be30 0x7f962006e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f962c034000 tx=0x7f962c02e000 comp rx=0 tx=0).stop 2024-04-25T02:13:49.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.958+0000 7f96392e1640 1 -- 172.21.15.79:0/2496545832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f963415e140 msgr2=0x7f963415d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:49.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.958+0000 7f96392e1640 1 --2- 172.21.15.79:0/2496545832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f963415e140 0x7f963415d160 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f962800b3f0 tx=0x7f962800b8b0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.958+0000 7f96392e1640 1 -- 172.21.15.79:0/2496545832 shutdown_connections 2024-04-25T02:13:49.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.958+0000 7f96392e1640 1 --2- 172.21.15.79:0/2496545832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f962006be30 0x7f962006e2f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.958+0000 7f96392e1640 1 --2- 172.21.15.79:0/2496545832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f963415e520 0x7f963406c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.958+0000 7f96392e1640 1 --2- 172.21.15.79:0/2496545832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f963415e140 0x7f963415d160 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.958+0000 7f96392e1640 1 --2- 172.21.15.79:0/2496545832 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f963406b0b0 0x7f96340ab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:49.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.958+0000 7f96392e1640 1 -- 172.21.15.79:0/2496545832 >> 172.21.15.79:0/2496545832 conn(0x7f96340ccee0 msgr2=0x7f96340cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:49.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.958+0000 7f96392e1640 1 -- 172.21.15.79:0/2496545832 shutdown_connections 2024-04-25T02:13:49.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:49.958+0000 7f96392e1640 1 -- 172.21.15.79:0/2496545832 wait complete. 2024-04-25T02:13:49.975 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:13:49.975 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:13:49.975 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:13:49.975 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:13:49.975 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:13:49.975 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:13:49.975 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:13:49.975 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:13:49.975 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:13:49.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:49.976 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:13:49.990 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:13:49.991 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:13:49.991 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:13:49.991 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:49.991 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:13:49.991 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:49.991 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:13:49.991 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:13:49.991 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:13:49.991 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:13:49.991 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:13:49.991 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:13:49.991 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:13:49.991 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:13:49.992 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:13:49.992 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:13:49.992 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:13:49.992 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42376sec preferred_lft 42376sec 2024-04-25T02:13:49.992 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:13:49.992 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:49.992 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:13:49.992 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:13:49.992 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:13:49.992 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:49.993 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:13:49.993 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:49.993 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:13:49.993 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:13:49.993 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link 2024-04-25T02:13:49.993 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:49.993 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:13:49.993 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:13:49.993 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::4c:adff:fe56:7194/64 scope link 2024-04-25T02:13:49.993 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:49.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:49.994 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:13:50.052 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:13:50.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:50.054 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:13:50.110 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:13:50.110 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:13:50.111 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:13:50.111 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:13:50.111 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:13:50.111 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:13:50.111 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:13:50.111 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:13:50.111 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:13:50.111 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:13:50.111 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:13:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:13:50.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:13:50.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:50.234 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:13:50.248 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:13:50.248 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:13:50.248 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:13:50.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:50.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:13:50.312 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:13:50.312 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:13:50.368 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:13:50.368 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:13:50.368 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:13:50.422 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:13:50.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:50.422 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:13:50.502 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:13:50.502 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:13:50.502 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:13:50.511 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:13:50.511 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:13:50.511 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:13:50.511 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:13:50.511 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:13:50.516 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:13:50.516 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:13:50.516 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:13:50.516 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:13:50.516 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:13:50.516 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:13:50.516 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:13:50.516 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:13:50.517 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:13:50.517 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:13:50.517 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:13:50.517 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:13:50.517 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:13:50.518 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:13:50.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:50.518 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:13:50.581 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:13:50.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:13:50.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:13:50.681 INFO:teuthology.orchestra.run.smithi079.stdout:client6268 2024-04-25T02:13:50.681 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:13:50.681 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:13:50.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:50.696 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir) 2024-04-25T02:13:50.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:50.755 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir/file) 2024-04-25T02:13:50.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:50.811 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-04-25T02:13:50.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:50.867 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir/file testdir/hardlink) 2024-04-25T02:13:50.926 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:13:50.926 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:13:50.926 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:13:50.927 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:13:50.927 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir").st_ino) 2024-04-25T02:13:50.927 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:13:51.031 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627776 2024-04-25T02:13:51.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:13:51.040 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:13:51.040 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:13:51.095 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:13:51.095 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:13:51.150 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:13:51.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.280+0000 7fbcbdb96640 1 Processor -- start 2024-04-25T02:13:51.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.281+0000 7fbcbdb96640 1 -- start start 2024-04-25T02:13:51.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.281+0000 7fbcbdb96640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcb80d2e20 0x7fbcb80cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.281+0000 7fbcbdb96640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb806c380 con 0x7fbcb815e4d0 2024-04-25T02:13:51.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.281+0000 7fbcbdb96640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb80d1660 con 0x7fbcb80b3570 2024-04-25T02:13:51.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.281+0000 7fbcbdb96640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb80d1380 con 0x7fbcb80d2e20 2024-04-25T02:13:51.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.281+0000 7fbcb77fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbcb815e4d0 0x7fbcb806bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41850/0 (socket says 172.21.15.79:41850) 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.281+0000 7fbcb77fe640 1 -- 172.21.15.79:0/3998837662 learned_addr learned my addr 172.21.15.79:0/3998837662 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb7fff640 1 --2- 172.21.15.79:0/3998837662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcb80d2e20 0x7fbcb80cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb67fc640 1 -- 172.21.15.79:0/3998837662 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1328758892 0 0) 0x7fbcb806c380 con 0x7fbcb815e4d0 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb67fc640 1 -- 172.21.15.79:0/3998837662 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbca0003520 con 0x7fbcb815e4d0 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb67fc640 1 -- 172.21.15.79:0/3998837662 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 103176667 0 0) 0x7fbca0003520 con 0x7fbcb815e4d0 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb67fc640 1 -- 172.21.15.79:0/3998837662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcb80d2e20 msgr2=0x7fbcb80cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb67fc640 1 --2- 172.21.15.79:0/3998837662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcb80d2e20 0x7fbcb80cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb67fc640 1 -- 172.21.15.79:0/3998837662 >> v1:172.21.15.189:6789/0 conn(0x7fbcb80b3570 legacy=0x7fbcb80d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb67fc640 1 -- 172.21.15.79:0/3998837662 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb80cede0 con 0x7fbcb815e4d0 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb67fc640 1 -- 172.21.15.79:0/3998837662 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fbca8001670 con 0x7fbcb815e4d0 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb67fc640 1 -- 172.21.15.79:0/3998837662 >> v1:172.21.15.79:6789/0 conn(0x7fbcb815e4d0 legacy=0x7fbcb806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb67fc640 1 --2- 172.21.15.79:0/3998837662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcb80d2e20 0x7fbca00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb67fc640 1 --2- 172.21.15.79:0/3998837662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbca0003f60 0x7fbca0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb67fc640 1 --2- 172.21.15.79:0/3998837662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbca0004d40 0x7fbca00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb67fc640 1 -- 172.21.15.79:0/3998837662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb80d1380 con 0x7fbca0004d40 2024-04-25T02:13:51.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb67fc640 1 -- 172.21.15.79:0/3998837662 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbca000baa0 con 0x7fbca0003f60 2024-04-25T02:13:51.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb67fc640 1 -- 172.21.15.79:0/3998837662 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbca000bca0 con 0x7fbcb80d2e20 2024-04-25T02:13:51.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb7fff640 1 --2- 172.21.15.79:0/3998837662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbca0004d40 0x7fbca00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb77fe640 1 --2- 172.21.15.79:0/3998837662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcb80d2e20 0x7fbca00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb6ffd640 1 --2- 172.21.15.79:0/3998837662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbca0003f60 0x7fbca0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb7fff640 1 -- 172.21.15.79:0/3998837662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcb80d2e20 msgr2=0x7fbca00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:51.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb7fff640 1 --2- 172.21.15.79:0/3998837662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcb80d2e20 0x7fbca00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb7fff640 1 -- 172.21.15.79:0/3998837662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbca0003f60 msgr2=0x7fbca0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:51.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb7fff640 1 --2- 172.21.15.79:0/3998837662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbca0003f60 0x7fbca0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb7fff640 1 -- 172.21.15.79:0/3998837662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca0003520 con 0x7fbca0004d40 2024-04-25T02:13:51.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.282+0000 7fbcb6ffd640 1 --2- 172.21.15.79:0/3998837662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbca0003f60 0x7fbca0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:51.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.283+0000 7fbcb7fff640 1 --2- 172.21.15.79:0/3998837662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbca0004d40 0x7fbca00051c0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fbcb808c7d0 tx=0x7fbca0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f270c5adc9c7480 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:51.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.283+0000 7fbcb67fc640 1 -- 172.21.15.79:0/3998837662 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0037070 con 0x7fbca0004d40 2024-04-25T02:13:51.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.283+0000 7fbcb67fc640 1 -- 172.21.15.79:0/3998837662 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb0032600 con 0x7fbca0004d40 2024-04-25T02:13:51.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.283+0000 7fbcb67fc640 1 -- 172.21.15.79:0/3998837662 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0009c10 con 0x7fbca0004d40 2024-04-25T02:13:51.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.284+0000 7fbcbdb96640 1 -- 172.21.15.79:0/3998837662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbca0004d40 msgr2=0x7fbca00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.284+0000 7fbcbdb96640 1 --2- 172.21.15.79:0/3998837662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbca0004d40 0x7fbca00051c0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fbcb808c7d0 tx=0x7fbca0005830 comp rx=0 tx=0).stop 2024-04-25T02:13:51.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.284+0000 7fbcb7fff640 1 -- 172.21.15.79:0/3998837662 reap_dead start 2024-04-25T02:13:51.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.284+0000 7fbcbdb96640 1 -- 172.21.15.79:0/3998837662 shutdown_connections 2024-04-25T02:13:51.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.284+0000 7fbcbdb96640 1 -- 172.21.15.79:0/3998837662 >> 172.21.15.79:0/3998837662 conn(0x7fbcb809d460 msgr2=0x7fbcb80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:51.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.284+0000 7fbcbdb96640 1 -- 172.21.15.79:0/3998837662 shutdown_connections 2024-04-25T02:13:51.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.284+0000 7fbcbdb96640 1 -- 172.21.15.79:0/3998837662 wait complete. 2024-04-25T02:13:51.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.285+0000 7fbcbdb96640 1 Processor -- start 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.285+0000 7fbcbdb96640 1 -- start start 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcbdb96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80a0600 0x7fbcb80a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcbdb96640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcb80ccc60 0x7fbcb8150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcbdb96640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcb80cd0e0 0x7fbcb8151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcbdb96640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb80d20d0 con 0x7fbcb80a0600 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcbdb96640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb815e8b0 con 0x7fbcb80cd0e0 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcbdb96640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb80d2250 con 0x7fbcb80ccc60 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcb77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80a0600 0x7fbcb80a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcb77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80a0600 0x7fbcb80a09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33356/0 (socket says 172.21.15.79:33356) 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcb77fe640 1 -- 172.21.15.79:0/3628141060 learned_addr learned my addr 172.21.15.79:0/3628141060 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcb7fff640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcb80cd0e0 0x7fbcb8151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcb77fe640 1 -- 172.21.15.79:0/3628141060 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcb80ccc60 msgr2=0x7fbcb8150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcb6ffd640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcb80ccc60 0x7fbcb8150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcb77fe640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcb80ccc60 0x7fbcb8150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcb77fe640 1 -- 172.21.15.79:0/3628141060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcb80cd0e0 msgr2=0x7fbcb8151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcb77fe640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcb80cd0e0 0x7fbcb8151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcb77fe640 1 -- 172.21.15.79:0/3628141060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb80a0f20 con 0x7fbcb80a0600 2024-04-25T02:13:51.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcb7fff640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcb80cd0e0 0x7fbcb8151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:51.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcb6ffd640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcb80ccc60 0x7fbcb8150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:51.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbcb77fe640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80a0600 0x7fbcb80a09e0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fbca8007290 tx=0x7fbca8007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:51.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbc9ffff640 1 -- 172.21.15.79:0/3628141060 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca800f9a0 con 0x7fbcb80a0600 2024-04-25T02:13:51.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.286+0000 7fbc9ffff640 1 -- 172.21.15.79:0/3628141060 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca8018070 con 0x7fbcb80a0600 2024-04-25T02:13:51.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.287+0000 7fbcbdb96640 1 -- 172.21.15.79:0/3628141060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb80cd6b0 con 0x7fbcb80a0600 2024-04-25T02:13:51.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.287+0000 7fbc9ffff640 1 -- 172.21.15.79:0/3628141060 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca800fda0 con 0x7fbcb80a0600 2024-04-25T02:13:51.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.287+0000 7fbcbdb96640 1 -- 172.21.15.79:0/3628141060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb80cdc70 con 0x7fbcb80a0600 2024-04-25T02:13:51.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.288+0000 7fbcbdb96640 1 -- 172.21.15.79:0/3628141060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb80690a0 con 0x7fbcb80a0600 2024-04-25T02:13:51.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.288+0000 7fbc9ffff640 1 -- 172.21.15.79:0/3628141060 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbca801d460 con 0x7fbcb80a0600 2024-04-25T02:13:51.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.288+0000 7fbc9ffff640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbca406be60 0x7fbca406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.288+0000 7fbc9ffff640 1 -- 172.21.15.79:0/3628141060 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7fbca808b070 con 0x7fbcb80a0600 2024-04-25T02:13:51.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.289+0000 7fbcb6ffd640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbca406be60 0x7fbca406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.289+0000 7fbcb6ffd640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbca406be60 0x7fbca406e320 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80ce300 tx=0x7fbcac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:51.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.293+0000 7fbc9ffff640 1 -- 172.21.15.79:0/3628141060 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbca8059a20 con 0x7fbcb80a0600 2024-04-25T02:13:51.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.469+0000 7fbcbdb96640 1 -- 172.21.15.79:0/3628141060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbcb80d1920 con 0x7fbcb80a0600 2024-04-25T02:13:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.470+0000 7fbc9ffff640 1 -- 172.21.15.79:0/3628141060 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16672 (secure 0 0 0) 0x7fbca8059320 con 0x7fbcb80a0600 2024-04-25T02:13:51.476 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:51.476 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":86,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:13:45.043216+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:13:41.594939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T02:13:42.348770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:13:51.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.472+0000 7fbcbdb96640 1 -- 172.21.15.79:0/3628141060 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbca406be60 msgr2=0x7fbca406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.472+0000 7fbcbdb96640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbca406be60 0x7fbca406e320 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80ce300 tx=0x7fbcac009040 comp rx=0 tx=0).stop 2024-04-25T02:13:51.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.472+0000 7fbcbdb96640 1 -- 172.21.15.79:0/3628141060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80a0600 msgr2=0x7fbcb80a09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.472+0000 7fbcbdb96640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80a0600 0x7fbcb80a09e0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fbca8007290 tx=0x7fbca8007750 comp rx=0 tx=0).stop 2024-04-25T02:13:51.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.472+0000 7fbcbdb96640 1 -- 172.21.15.79:0/3628141060 shutdown_connections 2024-04-25T02:13:51.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.472+0000 7fbcbdb96640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbca406be60 0x7fbca406e320 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.472+0000 7fbcbdb96640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcb80cd0e0 0x7fbcb8151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.472+0000 7fbcbdb96640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcb80ccc60 0x7fbcb8150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.472+0000 7fbcbdb96640 1 --2- 172.21.15.79:0/3628141060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80a0600 0x7fbcb80a09e0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.472+0000 7fbcbdb96640 1 -- 172.21.15.79:0/3628141060 >> 172.21.15.79:0/3628141060 conn(0x7fbcb809d460 msgr2=0x7fbcb80b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:51.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.472+0000 7fbcbdb96640 1 -- 172.21.15.79:0/3628141060 shutdown_connections 2024-04-25T02:13:51.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.472+0000 7fbcbdb96640 1 -- 172.21.15.79:0/3628141060 wait complete. 2024-04-25T02:13:51.489 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:13:41.594939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:13:42.348770+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:13:51.490 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:13:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.583+0000 7f63ffb1d640 1 Processor -- start 2024-04-25T02:13:51.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.584+0000 7f63ffb1d640 1 -- start start 2024-04-25T02:13:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.584+0000 7f63ffb1d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f63f815a810 0x7f63f80cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.584+0000 7f63ffb1d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f63f8071460 0x7f63f80b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.584+0000 7f63ffb1d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63f815abf0 con 0x7f63f809dcb0 2024-04-25T02:13:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.584+0000 7f63ffb1d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f63f8073050 con 0x7f63f815a810 2024-04-25T02:13:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.584+0000 7f63ffb1d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f63f80cbdd0 con 0x7f63f8071460 2024-04-25T02:13:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.584+0000 7f63fd8b9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f63f815a810 0x7f63f80cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.584+0000 7f63fd0b8640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f63f809dcb0 0x7f63f8070d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41860/0 (socket says 172.21.15.79:41860) 2024-04-25T02:13:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.584+0000 7f63fd0b8640 1 -- 172.21.15.79:0/1059225732 learned_addr learned my addr 172.21.15.79:0/1059225732 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.585+0000 7f63fe0ba640 1 --2- 172.21.15.79:0/1059225732 >> v2:172.21.15.189:3300/0 conn(0x7f63f8071460 0x7f63f80b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.585+0000 7f63fd8b9640 1 -- 172.21.15.79:0/1059225732 >> v2:172.21.15.189:3300/0 conn(0x7f63f8071460 msgr2=0x7f63f80b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.585+0000 7f63fd8b9640 1 --2- 172.21.15.79:0/1059225732 >> v2:172.21.15.189:3300/0 conn(0x7f63f8071460 0x7f63f80b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.585+0000 7f63fd8b9640 1 -- 172.21.15.79:0/1059225732 >> v1:172.21.15.79:6789/0 conn(0x7f63f809dcb0 legacy=0x7f63f8070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.585+0000 7f63fd8b9640 1 -- 172.21.15.79:0/1059225732 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f80ce580 con 0x7f63f815a810 2024-04-25T02:13:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.585+0000 7f63fd8b9640 1 --2- 172.21.15.79:0/1059225732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f815a810 0x7f63f80cc820 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f63f806eed0 tx=0x7f63f402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392b8dced028a8c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.586+0000 7f63fc8b7640 1 -- 172.21.15.79:0/1059225732 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f4007740 con 0x7f63f815a810 2024-04-25T02:13:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.586+0000 7f63fc8b7640 1 -- 172.21.15.79:0/1059225732 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f40078e0 con 0x7f63f815a810 2024-04-25T02:13:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.586+0000 7f63fc8b7640 1 -- 172.21.15.79:0/1059225732 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f4007cb0 con 0x7f63f815a810 2024-04-25T02:13:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.586+0000 7f63ffb1d640 1 -- 172.21.15.79:0/1059225732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f815a810 msgr2=0x7f63f80cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.586+0000 7f63ffb1d640 1 --2- 172.21.15.79:0/1059225732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f815a810 0x7f63f80cc820 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f63f806eed0 tx=0x7f63f402a5f0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.586+0000 7f63ffb1d640 1 -- 172.21.15.79:0/1059225732 shutdown_connections 2024-04-25T02:13:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.586+0000 7f63ffb1d640 1 --2- 172.21.15.79:0/1059225732 >> v2:172.21.15.189:3300/0 conn(0x7f63f8071460 0x7f63f80b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.586+0000 7f63ffb1d640 1 --2- 172.21.15.79:0/1059225732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f815a810 0x7f63f80cc820 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.586+0000 7f63ffb1d640 1 -- 172.21.15.79:0/1059225732 >> 172.21.15.79:0/1059225732 conn(0x7f63f80b1cd0 msgr2=0x7f63f80b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:51.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.586+0000 7f63ffb1d640 1 -- 172.21.15.79:0/1059225732 shutdown_connections 2024-04-25T02:13:51.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.586+0000 7f63ffb1d640 1 -- 172.21.15.79:0/1059225732 wait complete. 2024-04-25T02:13:51.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.587+0000 7f63ffb1d640 1 Processor -- start 2024-04-25T02:13:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.587+0000 7f63ffb1d640 1 -- start start 2024-04-25T02:13:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.588+0000 7f63ffb1d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f809dcb0 0x7f63f8145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.588+0000 7f63ffb1d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63f815a810 0x7f63f8156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.588+0000 7f63ffb1d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63f8146160 0x7f63f81571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.588+0000 7f63ffb1d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f63f80cc020 con 0x7f63f809dcb0 2024-04-25T02:13:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.588+0000 7f63ffb1d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f63f80ceb40 con 0x7f63f815a810 2024-04-25T02:13:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.588+0000 7f63ffb1d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f63f80cc300 con 0x7f63f8146160 2024-04-25T02:13:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.588+0000 7f63fd8b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f809dcb0 0x7f63f8145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.588+0000 7f63fd8b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f809dcb0 0x7f63f8145c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33384/0 (socket says 172.21.15.79:33384) 2024-04-25T02:13:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.588+0000 7f63fd8b9640 1 -- 172.21.15.79:0/2038126693 learned_addr learned my addr 172.21.15.79:0/2038126693 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.588+0000 7f63fd8b9640 1 -- 172.21.15.79:0/2038126693 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63f8146160 msgr2=0x7f63f81571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.588+0000 7f63fd8b9640 1 --2- 172.21.15.79:0/2038126693 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63f8146160 0x7f63f81571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.588+0000 7f63fd8b9640 1 -- 172.21.15.79:0/2038126693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63f815a810 msgr2=0x7f63f8156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.588+0000 7f63fd8b9640 1 --2- 172.21.15.79:0/2038126693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63f815a810 0x7f63f8156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.588+0000 7f63fd8b9640 1 -- 172.21.15.79:0/2038126693 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f8144bc0 con 0x7f63f809dcb0 2024-04-25T02:13:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.589+0000 7f63fd8b9640 1 --2- 172.21.15.79:0/2038126693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f809dcb0 0x7f63f8145c20 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009e80 tx=0x7f63f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.589+0000 7f63ee7fc640 1 -- 172.21.15.79:0/2038126693 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f403f070 con 0x7f63f809dcb0 2024-04-25T02:13:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.589+0000 7f63ee7fc640 1 -- 172.21.15.79:0/2038126693 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f4031c40 con 0x7f63f809dcb0 2024-04-25T02:13:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.589+0000 7f63ffb1d640 1 -- 172.21.15.79:0/2038126693 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f81426e0 con 0x7f63f809dcb0 2024-04-25T02:13:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.589+0000 7f63ee7fc640 1 -- 172.21.15.79:0/2038126693 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f4043410 con 0x7f63f809dcb0 2024-04-25T02:13:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.589+0000 7f63ffb1d640 1 -- 172.21.15.79:0/2038126693 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f8145420 con 0x7f63f809dcb0 2024-04-25T02:13:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.590+0000 7f63ffb1d640 1 -- 172.21.15.79:0/2038126693 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f80690a0 con 0x7f63f809dcb0 2024-04-25T02:13:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.590+0000 7f63ee7fc640 1 -- 172.21.15.79:0/2038126693 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63f40435b0 con 0x7f63f809dcb0 2024-04-25T02:13:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.590+0000 7f63ee7fc640 1 --2- 172.21.15.79:0/2038126693 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f63dc06be30 0x7f63dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.591+0000 7f63ee7fc640 1 -- 172.21.15.79:0/2038126693 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f63f40ac3c0 con 0x7f63f809dcb0 2024-04-25T02:13:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.591+0000 7f63fd0b8640 1 --2- 172.21.15.79:0/2038126693 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f63dc06be30 0x7f63dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.591+0000 7f63fd0b8640 1 --2- 172.21.15.79:0/2038126693 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f63dc06be30 0x7f63dc06e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f63e8000f60 tx=0x7f63e8007a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:51.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.595+0000 7f63ee7fc640 1 -- 172.21.15.79:0/2038126693 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f63f407ae00 con 0x7f63f809dcb0 2024-04-25T02:13:51.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.765+0000 7f63ffb1d640 1 -- 172.21.15.79:0/2038126693 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f63f81567a0 con 0x7f63f809dcb0 2024-04-25T02:13:51.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.765+0000 7f63ee7fc640 1 -- 172.21.15.79:0/2038126693 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) ==== 93+0+10 (secure 0 0 0) 0x7f63f407a700 con 0x7f63f809dcb0 2024-04-25T02:13:51.771 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:13:51.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.767+0000 7f63ffb1d640 1 -- 172.21.15.79:0/2038126693 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f63dc06be30 msgr2=0x7f63dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.767+0000 7f63ffb1d640 1 --2- 172.21.15.79:0/2038126693 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f63dc06be30 0x7f63dc06e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f63e8000f60 tx=0x7f63e8007a80 comp rx=0 tx=0).stop 2024-04-25T02:13:51.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.767+0000 7f63ffb1d640 1 -- 172.21.15.79:0/2038126693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f809dcb0 msgr2=0x7f63f8145c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.767+0000 7f63ffb1d640 1 --2- 172.21.15.79:0/2038126693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f809dcb0 0x7f63f8145c20 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009e80 tx=0x7f63f4004a40 comp rx=0 tx=0).stop 2024-04-25T02:13:51.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.767+0000 7f63ffb1d640 1 -- 172.21.15.79:0/2038126693 shutdown_connections 2024-04-25T02:13:51.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.767+0000 7f63ffb1d640 1 --2- 172.21.15.79:0/2038126693 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f63dc06be30 0x7f63dc06e2f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.767+0000 7f63ffb1d640 1 --2- 172.21.15.79:0/2038126693 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63f8146160 0x7f63f81571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.767+0000 7f63ffb1d640 1 --2- 172.21.15.79:0/2038126693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63f815a810 0x7f63f8156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.767+0000 7f63ffb1d640 1 --2- 172.21.15.79:0/2038126693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f809dcb0 0x7f63f8145c20 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.767+0000 7f63ffb1d640 1 -- 172.21.15.79:0/2038126693 >> 172.21.15.79:0/2038126693 conn(0x7f63f80b1cd0 msgr2=0x7f63f806d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.767+0000 7f63ffb1d640 1 -- 172.21.15.79:0/2038126693 shutdown_connections 2024-04-25T02:13:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.767+0000 7f63ffb1d640 1 -- 172.21.15.79:0/2038126693 wait complete. 2024-04-25T02:13:51.784 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:13:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.876+0000 7f0507c9a640 1 Processor -- start 2024-04-25T02:13:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.876+0000 7f0507c9a640 1 -- start start 2024-04-25T02:13:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.877+0000 7f0507c9a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f05000b41b0 0x7f05001605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.877+0000 7f0507c9a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f050006b2f0 0x7f050006b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.877+0000 7f0507c9a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0500071cd0 con 0x7f0500155f00 2024-04-25T02:13:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.877+0000 7f0507c9a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f0500071fb0 con 0x7f05000b41b0 2024-04-25T02:13:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.877+0000 7f0507c9a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f0500072290 con 0x7f050006b2f0 2024-04-25T02:13:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.877+0000 7f0505a36640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f05000b41b0 0x7f05001605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.877+0000 7f0505a36640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f05000b41b0 0x7f05001605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33386/0 (socket says 172.21.15.79:33386) 2024-04-25T02:13:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.877+0000 7f0505a36640 1 -- 172.21.15.79:0/1781812458 learned_addr learned my addr 172.21.15.79:0/1781812458 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.877+0000 7f0505a36640 1 -- 172.21.15.79:0/1781812458 >> v2:172.21.15.189:3300/0 conn(0x7f050006b2f0 msgr2=0x7f050006b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.877+0000 7f0505a36640 1 --2- 172.21.15.79:0/1781812458 >> v2:172.21.15.189:3300/0 conn(0x7f050006b2f0 0x7f050006b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.877+0000 7f0505a36640 1 -- 172.21.15.79:0/1781812458 >> v1:172.21.15.189:6789/0 conn(0x7f0500155f00 legacy=0x7f0500156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.877+0000 7f0505a36640 1 -- 172.21.15.79:0/1781812458 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0500072570 con 0x7f05000b41b0 2024-04-25T02:13:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.878+0000 7f0505a36640 1 --2- 172.21.15.79:0/1781812458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05000b41b0 0x7f05001605d0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f05000d0d70 tx=0x7f04fc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238e52889b605cba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.878+0000 7f0504a34640 1 -- 172.21.15.79:0/1781812458 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc037070 con 0x7f05000b41b0 2024-04-25T02:13:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.878+0000 7f0504a34640 1 -- 172.21.15.79:0/1781812458 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04fc032440 con 0x7f05000b41b0 2024-04-25T02:13:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.878+0000 7f0504a34640 1 -- 172.21.15.79:0/1781812458 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc032810 con 0x7f05000b41b0 2024-04-25T02:13:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.879+0000 7f0507c9a640 1 -- 172.21.15.79:0/1781812458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05000b41b0 msgr2=0x7f05001605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.879+0000 7f0507c9a640 1 --2- 172.21.15.79:0/1781812458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05000b41b0 0x7f05001605d0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f05000d0d70 tx=0x7f04fc02a230 comp rx=0 tx=0).stop 2024-04-25T02:13:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.879+0000 7f0507c9a640 1 -- 172.21.15.79:0/1781812458 shutdown_connections 2024-04-25T02:13:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.879+0000 7f0507c9a640 1 --2- 172.21.15.79:0/1781812458 >> v2:172.21.15.189:3300/0 conn(0x7f050006b2f0 0x7f050006b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.879+0000 7f0507c9a640 1 --2- 172.21.15.79:0/1781812458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05000b41b0 0x7f05001605d0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.879+0000 7f0507c9a640 1 -- 172.21.15.79:0/1781812458 >> 172.21.15.79:0/1781812458 conn(0x7f05000b1cd0 msgr2=0x7f05000b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.879+0000 7f0507c9a640 1 -- 172.21.15.79:0/1781812458 shutdown_connections 2024-04-25T02:13:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.879+0000 7f0507c9a640 1 -- 172.21.15.79:0/1781812458 wait complete. 2024-04-25T02:13:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.880+0000 7f0507c9a640 1 Processor -- start 2024-04-25T02:13:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.880+0000 7f0507c9a640 1 -- start start 2024-04-25T02:13:51.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.880+0000 7f0507c9a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f050006b2f0 0x7f050014d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.880+0000 7f0507c9a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05000b41b0 0x7f05000c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.880+0000 7f0507c9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0500155f00 0x7f05000c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.880+0000 7f0507c9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f050015c870 con 0x7f0500155f00 2024-04-25T02:13:51.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.880+0000 7f0507c9a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0500072d70 con 0x7f05000b41b0 2024-04-25T02:13:51.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.880+0000 7f0507c9a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0500156a20 con 0x7f050006b2f0 2024-04-25T02:13:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f0506237640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0500155f00 0x7f05000c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f0506237640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0500155f00 0x7f05000c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33398/0 (socket says 172.21.15.79:33398) 2024-04-25T02:13:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f0506237640 1 -- 172.21.15.79:0/441856720 learned_addr learned my addr 172.21.15.79:0/441856720 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f0505235640 1 --2- 172.21.15.79:0/441856720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05000b41b0 0x7f05000c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f0505a36640 1 --2- 172.21.15.79:0/441856720 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f050006b2f0 0x7f050014d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f0506237640 1 -- 172.21.15.79:0/441856720 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f050006b2f0 msgr2=0x7f050014d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f0506237640 1 --2- 172.21.15.79:0/441856720 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f050006b2f0 0x7f050014d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f0506237640 1 -- 172.21.15.79:0/441856720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05000b41b0 msgr2=0x7f05000c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f0506237640 1 --2- 172.21.15.79:0/441856720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05000b41b0 0x7f05000c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f0506237640 1 -- 172.21.15.79:0/441856720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050006d480 con 0x7f0500155f00 2024-04-25T02:13:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f0506237640 1 --2- 172.21.15.79:0/441856720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0500155f00 0x7f05000c94a0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f04f800b9c0 tx=0x7f04f800bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f04f67fc640 1 -- 172.21.15.79:0/441856720 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f8019070 con 0x7f0500155f00 2024-04-25T02:13:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f04f67fc640 1 -- 172.21.15.79:0/441856720 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f800cac0 con 0x7f0500155f00 2024-04-25T02:13:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f04f67fc640 1 -- 172.21.15.79:0/441856720 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f8014440 con 0x7f0500155f00 2024-04-25T02:13:51.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f0507c9a640 1 -- 172.21.15.79:0/441856720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050006d760 con 0x7f0500155f00 2024-04-25T02:13:51.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.881+0000 7f0507c9a640 1 -- 172.21.15.79:0/441856720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f050006dd20 con 0x7f0500155f00 2024-04-25T02:13:51.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.882+0000 7f0507c9a640 1 -- 172.21.15.79:0/441856720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05000690a0 con 0x7f0500155f00 2024-04-25T02:13:51.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.883+0000 7f04f67fc640 1 -- 172.21.15.79:0/441856720 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04f8007370 con 0x7f0500155f00 2024-04-25T02:13:51.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.883+0000 7f04f67fc640 1 --2- 172.21.15.79:0/441856720 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04e406be60 0x7f04e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:51.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.883+0000 7f04f67fc640 1 -- 172.21.15.79:0/441856720 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f04f808a800 con 0x7f0500155f00 2024-04-25T02:13:51.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.883+0000 7f0505a36640 1 --2- 172.21.15.79:0/441856720 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04e406be60 0x7f04e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:51.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.883+0000 7f0505a36640 1 --2- 172.21.15.79:0/441856720 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04e406be60 0x7f04e406e320 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f04fc034000 tx=0x7f04fc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:51.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:51.887+0000 7f04f67fc640 1 -- 172.21.15.79:0/441856720 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f04f8058bf0 con 0x7f0500155f00 2024-04-25T02:13:52.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.060+0000 7f0507c9a640 1 -- 172.21.15.79:0/441856720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f050015b0e0 con 0x7f0500155f00 2024-04-25T02:13:52.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.061+0000 7f04f67fc640 1 -- 172.21.15.79:0/441856720 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) ==== 104+0+11 (secure 0 0 0) 0x7f04f805cef0 con 0x7f0500155f00 2024-04-25T02:13:52.067 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:13:52.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.063+0000 7f0507c9a640 1 -- 172.21.15.79:0/441856720 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04e406be60 msgr2=0x7f04e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.063+0000 7f0507c9a640 1 --2- 172.21.15.79:0/441856720 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04e406be60 0x7f04e406e320 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f04fc034000 tx=0x7f04fc02e000 comp rx=0 tx=0).stop 2024-04-25T02:13:52.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.063+0000 7f0507c9a640 1 -- 172.21.15.79:0/441856720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0500155f00 msgr2=0x7f05000c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.063+0000 7f0507c9a640 1 --2- 172.21.15.79:0/441856720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0500155f00 0x7f05000c94a0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f04f800b9c0 tx=0x7f04f800bdc0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.063+0000 7f0507c9a640 1 -- 172.21.15.79:0/441856720 shutdown_connections 2024-04-25T02:13:52.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.063+0000 7f0507c9a640 1 --2- 172.21.15.79:0/441856720 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04e406be60 0x7f04e406e320 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.063+0000 7f0507c9a640 1 --2- 172.21.15.79:0/441856720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0500155f00 0x7f05000c94a0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.063+0000 7f0507c9a640 1 --2- 172.21.15.79:0/441856720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05000b41b0 0x7f05000c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.063+0000 7f0507c9a640 1 --2- 172.21.15.79:0/441856720 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f050006b2f0 0x7f050014d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.063+0000 7f0507c9a640 1 -- 172.21.15.79:0/441856720 >> 172.21.15.79:0/441856720 conn(0x7f05000b1cd0 msgr2=0x7f05000b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:52.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.063+0000 7f0507c9a640 1 -- 172.21.15.79:0/441856720 shutdown_connections 2024-04-25T02:13:52.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.063+0000 7f0507c9a640 1 -- 172.21.15.79:0/441856720 wait complete. 2024-04-25T02:13:52.080 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:13:52.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.174+0000 7f7b3714f640 1 Processor -- start 2024-04-25T02:13:52.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.174+0000 7f7b3714f640 1 -- start start 2024-04-25T02:13:52.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.174+0000 7f7b3714f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7b300cf7a0 0x7f7b300b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.175+0000 7f7b3714f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b3015ec20 con 0x7f7b3006e6b0 2024-04-25T02:13:52.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.175+0000 7f7b3714f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b3015ef00 con 0x7f7b3006b2f0 2024-04-25T02:13:52.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.175+0000 7f7b3714f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7b3015f830 con 0x7f7b300cf7a0 2024-04-25T02:13:52.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.175+0000 7f7b2ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7b300cf7a0 0x7f7b300b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.175+0000 7f7b356ec640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7b3006e6b0 0x7f7b3015b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41868/0 (socket says 172.21.15.79:41868) 2024-04-25T02:13:52.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.175+0000 7f7b356ec640 1 -- 172.21.15.79:0/4012673263 learned_addr learned my addr 172.21.15.79:0/4012673263 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:52.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.175+0000 7f7b2ffff640 1 -- 172.21.15.79:0/4012673263 >> v1:172.21.15.189:6789/0 conn(0x7f7b3006b2f0 legacy=0x7f7b3006b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.175+0000 7f7b2ffff640 1 -- 172.21.15.79:0/4012673263 >> v1:172.21.15.79:6789/0 conn(0x7f7b3006e6b0 legacy=0x7f7b3015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.175+0000 7f7b2ffff640 1 -- 172.21.15.79:0/4012673263 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3015f1e0 con 0x7f7b300cf7a0 2024-04-25T02:13:52.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.175+0000 7f7b2f7fe640 1 -- 172.21.15.79:0/4012673263 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237653249 0 0) 0x7f7b3015ec20 con 0x7f7b3006e6b0 2024-04-25T02:13:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.176+0000 7f7b2ffff640 1 --2- 172.21.15.79:0/4012673263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b300cf7a0 0x7f7b300b4b50 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0097a0 tx=0x7f7b1c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f06dd405b365466 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.176+0000 7f7b2f7fe640 1 -- 172.21.15.79:0/4012673263 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c037070 con 0x7f7b300cf7a0 2024-04-25T02:13:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.176+0000 7f7b2f7fe640 1 -- 172.21.15.79:0/4012673263 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c032440 con 0x7f7b300cf7a0 2024-04-25T02:13:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.176+0000 7f7b2f7fe640 1 -- 172.21.15.79:0/4012673263 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c032810 con 0x7f7b300cf7a0 2024-04-25T02:13:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.176+0000 7f7b3714f640 1 -- 172.21.15.79:0/4012673263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b300cf7a0 msgr2=0x7f7b300b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.176+0000 7f7b3714f640 1 --2- 172.21.15.79:0/4012673263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b300cf7a0 0x7f7b300b4b50 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0097a0 tx=0x7f7b1c02a1a0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.176+0000 7f7b3714f640 1 -- 172.21.15.79:0/4012673263 shutdown_connections 2024-04-25T02:13:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.176+0000 7f7b3714f640 1 --2- 172.21.15.79:0/4012673263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b300cf7a0 0x7f7b300b4b50 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.176+0000 7f7b3714f640 1 -- 172.21.15.79:0/4012673263 >> 172.21.15.79:0/4012673263 conn(0x7f7b300b1cd0 msgr2=0x7f7b300b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:52.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.176+0000 7f7b3714f640 1 -- 172.21.15.79:0/4012673263 shutdown_connections 2024-04-25T02:13:52.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.176+0000 7f7b3714f640 1 -- 172.21.15.79:0/4012673263 wait complete. 2024-04-25T02:13:52.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.177+0000 7f7b3714f640 1 Processor -- start 2024-04-25T02:13:52.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.178+0000 7f7b3714f640 1 -- start start 2024-04-25T02:13:52.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.178+0000 7f7b3714f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7b3006b2f0 0x7f7b301542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.178+0000 7f7b3714f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b3006e6b0 0x7f7b300ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.178+0000 7f7b3714f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b300cf7a0 0x7f7b301efd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.178+0000 7f7b3714f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3006d160 con 0x7f7b3006e6b0 2024-04-25T02:13:52.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.178+0000 7f7b3714f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3006cfe0 con 0x7f7b300cf7a0 2024-04-25T02:13:52.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.178+0000 7f7b3714f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3015b9e0 con 0x7f7b3006b2f0 2024-04-25T02:13:52.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.178+0000 7f7b2ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b3006e6b0 0x7f7b300ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.178+0000 7f7b2ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b3006e6b0 0x7f7b300ae7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33414/0 (socket says 172.21.15.79:33414) 2024-04-25T02:13:52.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.178+0000 7f7b2ffff640 1 -- 172.21.15.79:0/1471555525 learned_addr learned my addr 172.21.15.79:0/1471555525 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:52.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.179+0000 7f7b2ffff640 1 -- 172.21.15.79:0/1471555525 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7b3006b2f0 msgr2=0x7f7b301542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.179+0000 7f7b356ec640 1 --2- 172.21.15.79:0/1471555525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b300cf7a0 0x7f7b301efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.179+0000 7f7b2ffff640 1 --2- 172.21.15.79:0/1471555525 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7b3006b2f0 0x7f7b301542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.179+0000 7f7b2ffff640 1 -- 172.21.15.79:0/1471555525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b300cf7a0 msgr2=0x7f7b301efd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.179+0000 7f7b2ffff640 1 --2- 172.21.15.79:0/1471555525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b300cf7a0 0x7f7b301efd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.179+0000 7f7b2ffff640 1 -- 172.21.15.79:0/1471555525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b30156a40 con 0x7f7b3006e6b0 2024-04-25T02:13:52.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.179+0000 7f7b2ffff640 1 --2- 172.21.15.79:0/1471555525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b3006e6b0 0x7f7b300ae7a0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c035040 tx=0x7f7b1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:52.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.179+0000 7f7b2d7fa640 1 -- 172.21.15.79:0/1471555525 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c037050 con 0x7f7b3006e6b0 2024-04-25T02:13:52.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.179+0000 7f7b2d7fa640 1 -- 172.21.15.79:0/1471555525 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c038040 con 0x7f7b3006e6b0 2024-04-25T02:13:52.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.179+0000 7f7b3714f640 1 -- 172.21.15.79:0/1471555525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b30156d20 con 0x7f7b3006e6b0 2024-04-25T02:13:52.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.179+0000 7f7b2d7fa640 1 -- 172.21.15.79:0/1471555525 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c004490 con 0x7f7b3006e6b0 2024-04-25T02:13:52.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.179+0000 7f7b3714f640 1 -- 172.21.15.79:0/1471555525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b301572e0 con 0x7f7b3006e6b0 2024-04-25T02:13:52.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.180+0000 7f7b3714f640 1 -- 172.21.15.79:0/1471555525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b300690a0 con 0x7f7b3006e6b0 2024-04-25T02:13:52.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.180+0000 7f7b2d7fa640 1 -- 172.21.15.79:0/1471555525 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b1c030900 con 0x7f7b3006e6b0 2024-04-25T02:13:52.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.181+0000 7f7b2d7fa640 1 --2- 172.21.15.79:0/1471555525 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7b1406be30 0x7f7b1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.181+0000 7f7b2d7fa640 1 -- 172.21.15.79:0/1471555525 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f7b1c0ab9c0 con 0x7f7b3006e6b0 2024-04-25T02:13:52.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.181+0000 7f7b34eeb640 1 --2- 172.21.15.79:0/1471555525 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7b1406be30 0x7f7b1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.181+0000 7f7b34eeb640 1 --2- 172.21.15.79:0/1471555525 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7b1406be30 0x7f7b1406e2f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7b24000f60 tx=0x7f7b240079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:52.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.185+0000 7f7b2d7fa640 1 -- 172.21.15.79:0/1471555525 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7b1c0ade20 con 0x7f7b3006e6b0 2024-04-25T02:13:52.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.359+0000 7f7b3714f640 1 -- 172.21.15.79:0/1471555525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7b300cf4f0 con 0x7f7b3006e6b0 2024-04-25T02:13:52.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.360+0000 7f7b2d7fa640 1 -- 172.21.15.79:0/1471555525 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) ==== 100+0+11 (secure 0 0 0) 0x7f7b1c07a520 con 0x7f7b3006e6b0 2024-04-25T02:13:52.366 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:13:52.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.361+0000 7f7b3714f640 1 -- 172.21.15.79:0/1471555525 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7b1406be30 msgr2=0x7f7b1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.361+0000 7f7b3714f640 1 --2- 172.21.15.79:0/1471555525 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7b1406be30 0x7f7b1406e2f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7b24000f60 tx=0x7f7b240079b0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.361+0000 7f7b3714f640 1 -- 172.21.15.79:0/1471555525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b3006e6b0 msgr2=0x7f7b300ae7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.361+0000 7f7b3714f640 1 --2- 172.21.15.79:0/1471555525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b3006e6b0 0x7f7b300ae7a0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c035040 tx=0x7f7b1c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.362+0000 7f7b3714f640 1 -- 172.21.15.79:0/1471555525 shutdown_connections 2024-04-25T02:13:52.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.362+0000 7f7b3714f640 1 --2- 172.21.15.79:0/1471555525 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7b1406be30 0x7f7b1406e2f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.362+0000 7f7b3714f640 1 --2- 172.21.15.79:0/1471555525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b300cf7a0 0x7f7b301efd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.362+0000 7f7b3714f640 1 --2- 172.21.15.79:0/1471555525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b3006e6b0 0x7f7b300ae7a0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.362+0000 7f7b3714f640 1 --2- 172.21.15.79:0/1471555525 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7b3006b2f0 0x7f7b301542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.362+0000 7f7b3714f640 1 -- 172.21.15.79:0/1471555525 >> 172.21.15.79:0/1471555525 conn(0x7f7b300b1cd0 msgr2=0x7f7b300b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:52.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.362+0000 7f7b3714f640 1 -- 172.21.15.79:0/1471555525 shutdown_connections 2024-04-25T02:13:52.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.362+0000 7f7b3714f640 1 -- 172.21.15.79:0/1471555525 wait complete. 2024-04-25T02:13:52.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:13:52.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.470+0000 7f3df599e640 1 Processor -- start 2024-04-25T02:13:52.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.470+0000 7f3df599e640 1 -- start start 2024-04-25T02:13:52.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.471+0000 7f3df599e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3df015ada0 0x7f3df00cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.471+0000 7f3df599e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f3df00b4240 0x7f3df00b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.471+0000 7f3df599e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3df00b4be0 0x7f3df015e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.471+0000 7f3df599e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3df0072440 con 0x7f3df00b4be0 2024-04-25T02:13:52.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.471+0000 7f3df599e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3df0072160 con 0x7f3df00b4240 2024-04-25T02:13:52.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.471+0000 7f3df599e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3df00b3760 con 0x7f3df015ada0 2024-04-25T02:13:52.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.471+0000 7f3df519d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3df00b4be0 0x7f3df015e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.471+0000 7f3df519d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3df00b4be0 0x7f3df015e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33420/0 (socket says 172.21.15.79:33420) 2024-04-25T02:13:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.471+0000 7f3df519d640 1 -- 172.21.15.79:0/2317080473 learned_addr learned my addr 172.21.15.79:0/2317080473 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.471+0000 7f3df499c640 1 --2- 172.21.15.79:0/2317080473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3df015ada0 0x7f3df00cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.471+0000 7f3deffff640 1 --2- 172.21.15.79:0/2317080473 >> v2:172.21.15.189:3300/0 conn(0x7f3df00b4240 0x7f3df00b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.472+0000 7f3df519d640 1 -- 172.21.15.79:0/2317080473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3df015ada0 msgr2=0x7f3df00cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.472+0000 7f3df519d640 1 --2- 172.21.15.79:0/2317080473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3df015ada0 0x7f3df00cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.472+0000 7f3df519d640 1 -- 172.21.15.79:0/2317080473 >> v2:172.21.15.189:3300/0 conn(0x7f3df00b4240 msgr2=0x7f3df00b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.472+0000 7f3df519d640 1 --2- 172.21.15.79:0/2317080473 >> v2:172.21.15.189:3300/0 conn(0x7f3df00b4240 0x7f3df00b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.472+0000 7f3df519d640 1 -- 172.21.15.79:0/2317080473 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df00b3a40 con 0x7f3df00b4be0 2024-04-25T02:13:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.472+0000 7f3df499c640 1 --2- 172.21.15.79:0/2317080473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3df015ada0 0x7f3df00cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.472+0000 7f3deffff640 1 --2- 172.21.15.79:0/2317080473 >> v2:172.21.15.189:3300/0 conn(0x7f3df00b4240 0x7f3df00b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.472+0000 7f3df519d640 1 --2- 172.21.15.79:0/2317080473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df00b4be0 0x7f3df015e970 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f3df006c750 tx=0x7f3de802c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee300e0f714c8be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.472+0000 7f3def7fe640 1 -- 172.21.15.79:0/2317080473 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de800b2e0 con 0x7f3df00b4be0 2024-04-25T02:13:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.472+0000 7f3def7fe640 1 -- 172.21.15.79:0/2317080473 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3de8009600 con 0x7f3df00b4be0 2024-04-25T02:13:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.472+0000 7f3def7fe640 1 -- 172.21.15.79:0/2317080473 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de800b480 con 0x7f3df00b4be0 2024-04-25T02:13:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.473+0000 7f3df599e640 1 -- 172.21.15.79:0/2317080473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df00b4be0 msgr2=0x7f3df015e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.473+0000 7f3df599e640 1 --2- 172.21.15.79:0/2317080473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df00b4be0 0x7f3df015e970 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f3df006c750 tx=0x7f3de802c8a0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.473+0000 7f3df599e640 1 -- 172.21.15.79:0/2317080473 shutdown_connections 2024-04-25T02:13:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.473+0000 7f3df599e640 1 --2- 172.21.15.79:0/2317080473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df00b4be0 0x7f3df015e970 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.473+0000 7f3df599e640 1 --2- 172.21.15.79:0/2317080473 >> v2:172.21.15.189:3300/0 conn(0x7f3df00b4240 0x7f3df00b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.473+0000 7f3df599e640 1 --2- 172.21.15.79:0/2317080473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3df015ada0 0x7f3df00cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.473+0000 7f3df599e640 1 -- 172.21.15.79:0/2317080473 >> 172.21.15.79:0/2317080473 conn(0x7f3df00b18b0 msgr2=0x7f3df00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.473+0000 7f3df599e640 1 -- 172.21.15.79:0/2317080473 shutdown_connections 2024-04-25T02:13:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.473+0000 7f3df599e640 1 -- 172.21.15.79:0/2317080473 wait complete. 2024-04-25T02:13:52.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.474+0000 7f3df599e640 1 Processor -- start 2024-04-25T02:13:52.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.474+0000 7f3df599e640 1 -- start start 2024-04-25T02:13:52.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.475+0000 7f3df599e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3df00b4240 0x7f3df01f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.475+0000 7f3df599e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3df00b4be0 0x7f3df014d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.475+0000 7f3df599e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df015ada0 0x7f3df014dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.475+0000 7f3df599e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3df00cd560 con 0x7f3df015ada0 2024-04-25T02:13:52.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.475+0000 7f3df599e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3df015b180 con 0x7f3df00b4240 2024-04-25T02:13:52.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.475+0000 7f3df599e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3df006e980 con 0x7f3df00b4be0 2024-04-25T02:13:52.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.475+0000 7f3df519d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df015ada0 0x7f3df014dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.475+0000 7f3df519d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df015ada0 0x7f3df014dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33424/0 (socket says 172.21.15.79:33424) 2024-04-25T02:13:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.475+0000 7f3df519d640 1 -- 172.21.15.79:0/288235217 learned_addr learned my addr 172.21.15.79:0/288235217 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.475+0000 7f3deffff640 1 --2- 172.21.15.79:0/288235217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3df00b4be0 0x7f3df014d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.475+0000 7f3df499c640 1 --2- 172.21.15.79:0/288235217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3df00b4240 0x7f3df01f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.476+0000 7f3df519d640 1 -- 172.21.15.79:0/288235217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3df00b4be0 msgr2=0x7f3df014d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.476+0000 7f3df519d640 1 --2- 172.21.15.79:0/288235217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3df00b4be0 0x7f3df014d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.476+0000 7f3df519d640 1 -- 172.21.15.79:0/288235217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3df00b4240 msgr2=0x7f3df01f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.476+0000 7f3df519d640 1 --2- 172.21.15.79:0/288235217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3df00b4240 0x7f3df01f2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.476+0000 7f3df519d640 1 -- 172.21.15.79:0/288235217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df014c360 con 0x7f3df015ada0 2024-04-25T02:13:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.476+0000 7f3deffff640 1 --2- 172.21.15.79:0/288235217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3df00b4be0 0x7f3df014d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.476+0000 7f3df519d640 1 --2- 172.21.15.79:0/288235217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df015ada0 0x7f3df014dcb0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f3de802ce90 tx=0x7f3de8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.476+0000 7f3ded7fa640 1 -- 172.21.15.79:0/288235217 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8041070 con 0x7f3df015ada0 2024-04-25T02:13:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.476+0000 7f3ded7fa640 1 -- 172.21.15.79:0/288235217 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3de803d820 con 0x7f3df015ada0 2024-04-25T02:13:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.476+0000 7f3ded7fa640 1 -- 172.21.15.79:0/288235217 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de803dbd0 con 0x7f3df015ada0 2024-04-25T02:13:52.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.476+0000 7f3df599e640 1 -- 172.21.15.79:0/288235217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df014c640 con 0x7f3df015ada0 2024-04-25T02:13:52.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.476+0000 7f3df599e640 1 -- 172.21.15.79:0/288235217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df014cc00 con 0x7f3df015ada0 2024-04-25T02:13:52.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.477+0000 7f3df599e640 1 -- 172.21.15.79:0/288235217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df004f5e0 con 0x7f3df015ada0 2024-04-25T02:13:52.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.477+0000 7f3ded7fa640 1 -- 172.21.15.79:0/288235217 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3de8046460 con 0x7f3df015ada0 2024-04-25T02:13:52.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.478+0000 7f3ded7fa640 1 --2- 172.21.15.79:0/288235217 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3ddc06be30 0x7f3ddc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.478+0000 7f3df499c640 1 --2- 172.21.15.79:0/288235217 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3ddc06be30 0x7f3ddc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.478+0000 7f3ded7fa640 1 -- 172.21.15.79:0/288235217 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f3de8030020 con 0x7f3df015ada0 2024-04-25T02:13:52.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.478+0000 7f3df499c640 1 --2- 172.21.15.79:0/288235217 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3ddc06be30 0x7f3ddc06e2f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3de000aac0 tx=0x7f3de0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:52.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.482+0000 7f3ded7fa640 1 -- 172.21.15.79:0/288235217 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3de807c800 con 0x7f3df015ada0 2024-04-25T02:13:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.670+0000 7f3df599e640 1 -- 172.21.15.79:0/288235217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3df006d480 con 0x7f3df015ada0 2024-04-25T02:13:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.670+0000 7f3ded7fa640 1 -- 172.21.15.79:0/288235217 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v86) ==== 80+0+0 (secure 0 0 0) 0x7f3de8080b00 con 0x7f3df015ada0 2024-04-25T02:13:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-04-25T02:13:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.672+0000 7f3df599e640 1 -- 172.21.15.79:0/288235217 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3ddc06be30 msgr2=0x7f3ddc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.672+0000 7f3df599e640 1 --2- 172.21.15.79:0/288235217 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3ddc06be30 0x7f3ddc06e2f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3de000aac0 tx=0x7f3de0008040 comp rx=0 tx=0).stop 2024-04-25T02:13:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.672+0000 7f3df599e640 1 -- 172.21.15.79:0/288235217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df015ada0 msgr2=0x7f3df014dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.672+0000 7f3df599e640 1 --2- 172.21.15.79:0/288235217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df015ada0 0x7f3df014dcb0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f3de802ce90 tx=0x7f3de8004a40 comp rx=0 tx=0).stop 2024-04-25T02:13:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.672+0000 7f3df599e640 1 -- 172.21.15.79:0/288235217 shutdown_connections 2024-04-25T02:13:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.672+0000 7f3df599e640 1 --2- 172.21.15.79:0/288235217 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3ddc06be30 0x7f3ddc06e2f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.672+0000 7f3df599e640 1 --2- 172.21.15.79:0/288235217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df015ada0 0x7f3df014dcb0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.672+0000 7f3df599e640 1 --2- 172.21.15.79:0/288235217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3df00b4be0 0x7f3df014d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.672+0000 7f3df599e640 1 --2- 172.21.15.79:0/288235217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3df00b4240 0x7f3df01f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.672+0000 7f3df599e640 1 -- 172.21.15.79:0/288235217 >> 172.21.15.79:0/288235217 conn(0x7f3df00b18b0 msgr2=0x7f3df006d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.673+0000 7f3df599e640 1 -- 172.21.15.79:0/288235217 shutdown_connections 2024-04-25T02:13:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.673+0000 7f3df599e640 1 -- 172.21.15.79:0/288235217 wait complete. 2024-04-25T02:13:52.689 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:13:52.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:52.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:13:52.731 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:13:52.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:52.731 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:13:52.786 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:13:52.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.915+0000 7ff4dbefc640 1 Processor -- start 2024-04-25T02:13:52.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.915+0000 7ff4dbefc640 1 -- start start 2024-04-25T02:13:52.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.916+0000 7ff4dbefc640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff4d4143bc0 0x7ff4d415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.916+0000 7ff4dbefc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4d406df50 0x7ff4d406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.916+0000 7ff4dbefc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4d415fa40 con 0x7ff4d40b48e0 2024-04-25T02:13:52.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.916+0000 7ff4dbefc640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff4d406e8f0 con 0x7ff4d4143bc0 2024-04-25T02:13:52.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.916+0000 7ff4dbefc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d4072cb0 con 0x7ff4d406df50 2024-04-25T02:13:52.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.916+0000 7ff4da499640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff4d40b48e0 0x7ff4d40b4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41876/0 (socket says 172.21.15.79:41876) 2024-04-25T02:13:52.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.916+0000 7ff4da499640 1 -- 172.21.15.79:0/2528581076 learned_addr learned my addr 172.21.15.79:0/2528581076 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:52.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.916+0000 7ff4d8c96640 1 -- 172.21.15.79:0/2528581076 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 325216199 0 0) 0x7ff4cc001110 con 0x7ff4d40b48e0 2024-04-25T02:13:52.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.916+0000 7ff4d9c98640 1 --2- 172.21.15.79:0/2528581076 >> v2:172.21.15.189:3300/0 conn(0x7ff4d4143bc0 0x7ff4d415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.916+0000 7ff4d9497640 1 --2- 172.21.15.79:0/2528581076 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4d406df50 0x7ff4d406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.916+0000 7ff4d8c96640 1 -- 172.21.15.79:0/2528581076 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4c0005730 con 0x7ff4d40b48e0 2024-04-25T02:13:52.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d8c96640 1 -- 172.21.15.79:0/2528581076 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3875707456 0 0) 0x7ff4c0005730 con 0x7ff4d40b48e0 2024-04-25T02:13:52.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d8c96640 1 -- 172.21.15.79:0/2528581076 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4d406df50 msgr2=0x7ff4d406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:52.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d8c96640 1 --2- 172.21.15.79:0/2528581076 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4d406df50 0x7ff4d406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d8c96640 1 -- 172.21.15.79:0/2528581076 >> v2:172.21.15.189:3300/0 conn(0x7ff4d4143bc0 msgr2=0x7ff4d415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:52.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d8c96640 1 --2- 172.21.15.79:0/2528581076 >> v2:172.21.15.189:3300/0 conn(0x7ff4d4143bc0 0x7ff4d415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d8c96640 1 -- 172.21.15.79:0/2528581076 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d4071e00 con 0x7ff4d40b48e0 2024-04-25T02:13:52.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d9c98640 1 --2- 172.21.15.79:0/2528581076 >> v2:172.21.15.189:3300/0 conn(0x7ff4d4143bc0 0x7ff4d415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:52.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d8c96640 1 -- 172.21.15.79:0/2528581076 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7ff4cc001840 con 0x7ff4d40b48e0 2024-04-25T02:13:52.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d8c96640 1 -- 172.21.15.79:0/2528581076 >> v1:172.21.15.79:6789/0 conn(0x7ff4d40b48e0 legacy=0x7ff4d40b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d8c96640 1 --2- 172.21.15.79:0/2528581076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4c0005bc0 0x7ff4c0005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d8c96640 1 --2- 172.21.15.79:0/2528581076 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4d406df50 0x7ff4c0006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d8c96640 1 --2- 172.21.15.79:0/2528581076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4c0006f50 0x7ff4c00073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d8c96640 1 -- 172.21.15.79:0/2528581076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d4072cb0 con 0x7ff4c0006f50 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d8c96640 1 -- 172.21.15.79:0/2528581076 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c000dc00 con 0x7ff4c0005bc0 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d8c96640 1 -- 172.21.15.79:0/2528581076 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c000de00 con 0x7ff4d406df50 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4da499640 1 --2- 172.21.15.79:0/2528581076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4c0006f50 0x7ff4c00073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d9c98640 1 --2- 172.21.15.79:0/2528581076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4c0005bc0 0x7ff4c0005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4d9497640 1 --2- 172.21.15.79:0/2528581076 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4d406df50 0x7ff4c0006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4da499640 1 -- 172.21.15.79:0/2528581076 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4d406df50 msgr2=0x7ff4c0006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4da499640 1 --2- 172.21.15.79:0/2528581076 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4d406df50 0x7ff4c0006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4da499640 1 -- 172.21.15.79:0/2528581076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4c0005bc0 msgr2=0x7ff4c0005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4da499640 1 --2- 172.21.15.79:0/2528581076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4c0005bc0 0x7ff4c0005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.917+0000 7ff4da499640 1 -- 172.21.15.79:0/2528581076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c0005730 con 0x7ff4c0006f50 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.918+0000 7ff4da499640 1 --2- 172.21.15.79:0/2528581076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4c0006f50 0x7ff4c00073d0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00c490 tx=0x7ff4c0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fb1b7d43a9a19a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.918+0000 7ff4d8c96640 1 -- 172.21.15.79:0/2528581076 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc032020 con 0x7ff4c0006f50 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.918+0000 7ff4d8c96640 1 -- 172.21.15.79:0/2528581076 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4cc005ad0 con 0x7ff4c0006f50 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.918+0000 7ff4d8c96640 1 -- 172.21.15.79:0/2528581076 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc00c0e0 con 0x7ff4c0006f50 2024-04-25T02:13:52.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.918+0000 7ff4dbefc640 1 -- 172.21.15.79:0/2528581076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4c0006f50 msgr2=0x7ff4c00073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.918+0000 7ff4dbefc640 1 --2- 172.21.15.79:0/2528581076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4c0006f50 0x7ff4c00073d0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00c490 tx=0x7ff4c0007a40 comp rx=0 tx=0).stop 2024-04-25T02:13:52.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.918+0000 7ff4da499640 1 -- 172.21.15.79:0/2528581076 reap_dead start 2024-04-25T02:13:52.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.918+0000 7ff4dbefc640 1 -- 172.21.15.79:0/2528581076 shutdown_connections 2024-04-25T02:13:52.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.918+0000 7ff4dbefc640 1 -- 172.21.15.79:0/2528581076 >> 172.21.15.79:0/2528581076 conn(0x7ff4d40cfc80 msgr2=0x7ff4d40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:52.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.919+0000 7ff4dbefc640 1 -- 172.21.15.79:0/2528581076 shutdown_connections 2024-04-25T02:13:52.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.919+0000 7ff4dbefc640 1 -- 172.21.15.79:0/2528581076 wait complete. 2024-04-25T02:13:52.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.920+0000 7ff4dbefc640 1 Processor -- start 2024-04-25T02:13:52.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.920+0000 7ff4dbefc640 1 -- start start 2024-04-25T02:13:52.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.920+0000 7ff4dbefc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4c0006f50 0x7ff4d41428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.920+0000 7ff4dbefc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4d40b09f0 0x7ff4d40b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.920+0000 7ff4dbefc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4d40ab220 0x7ff4d40ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.920+0000 7ff4dbefc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d4072660 con 0x7ff4d40ab220 2024-04-25T02:13:52.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.920+0000 7ff4dbefc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d4072380 con 0x7ff4c0006f50 2024-04-25T02:13:52.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.920+0000 7ff4dbefc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d4072940 con 0x7ff4d40b09f0 2024-04-25T02:13:52.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4da499640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4d40ab220 0x7ff4d40ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4da499640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4d40ab220 0x7ff4d40ab6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33444/0 (socket says 172.21.15.79:33444) 2024-04-25T02:13:52.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4da499640 1 -- 172.21.15.79:0/152880606 learned_addr learned my addr 172.21.15.79:0/152880606 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:52.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4d9c98640 1 --2- 172.21.15.79:0/152880606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4c0006f50 0x7ff4d41428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4d9497640 1 --2- 172.21.15.79:0/152880606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4d40b09f0 0x7ff4d40b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4da499640 1 -- 172.21.15.79:0/152880606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4d40b09f0 msgr2=0x7ff4d40b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4da499640 1 --2- 172.21.15.79:0/152880606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4d40b09f0 0x7ff4d40b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4da499640 1 -- 172.21.15.79:0/152880606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4c0006f50 msgr2=0x7ff4d41428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:52.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4da499640 1 --2- 172.21.15.79:0/152880606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4c0006f50 0x7ff4d41428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:52.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4da499640 1 -- 172.21.15.79:0/152880606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d4142e30 con 0x7ff4d40ab220 2024-04-25T02:13:52.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4d9c98640 1 --2- 172.21.15.79:0/152880606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4c0006f50 0x7ff4d41428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:52.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4da499640 1 --2- 172.21.15.79:0/152880606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4d40ab220 0x7ff4d40ab6a0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00c4f0 tx=0x7ff4cc000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:52.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4ca7fc640 1 -- 172.21.15.79:0/152880606 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc032030 con 0x7ff4d40ab220 2024-04-25T02:13:52.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4ca7fc640 1 -- 172.21.15.79:0/152880606 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4cc007540 con 0x7ff4d40ab220 2024-04-25T02:13:52.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4dbefc640 1 -- 172.21.15.79:0/152880606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d40abf50 con 0x7ff4d40ab220 2024-04-25T02:13:52.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4ca7fc640 1 -- 172.21.15.79:0/152880606 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc038430 con 0x7ff4d40ab220 2024-04-25T02:13:52.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.921+0000 7ff4dbefc640 1 -- 172.21.15.79:0/152880606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d40ac510 con 0x7ff4d40ab220 2024-04-25T02:13:52.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.922+0000 7ff4dbefc640 1 -- 172.21.15.79:0/152880606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d40690a0 con 0x7ff4d40ab220 2024-04-25T02:13:52.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.923+0000 7ff4ca7fc640 1 -- 172.21.15.79:0/152880606 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff4cc035020 con 0x7ff4d40ab220 2024-04-25T02:13:52.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.923+0000 7ff4ca7fc640 1 --2- 172.21.15.79:0/152880606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff4b806be30 0x7ff4b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:52.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.923+0000 7ff4ca7fc640 1 -- 172.21.15.79:0/152880606 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7ff4cc0ab350 con 0x7ff4d40ab220 2024-04-25T02:13:52.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.923+0000 7ff4d9c98640 1 --2- 172.21.15.79:0/152880606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff4b806be30 0x7ff4b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:52.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.923+0000 7ff4d9c98640 1 --2- 172.21.15.79:0/152880606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff4b806be30 0x7ff4b806e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0007520 tx=0x7ff4d000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:52.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:52.927+0000 7ff4ca7fc640 1 -- 172.21.15.79:0/152880606 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff4d415fa40 con 0x7ff4d40ab220 2024-04-25T02:13:53.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.138+0000 7ff4dbefc640 1 -- 172.21.15.79:0/152880606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4d415e540 con 0x7ff4d40ab220 2024-04-25T02:13:53.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.139+0000 7ff4ca7fc640 1 -- 172.21.15.79:0/152880606 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5189 (secure 0 0 0) 0x7ff4cc005aa0 con 0x7ff4d40ab220 2024-04-25T02:13:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:53.145 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:13:46.229372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7416},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7416":{"gid":7416,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2290864495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2290864495},{"type":"v1","addr":"172.21.15.79:6837","nonce":2290864495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7416,"qdb_cluster":[7416]},"id":6}]} 2024-04-25T02:13:53.145 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 48 2024-04-25T02:13:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.140+0000 7ff4dbefc640 1 -- 172.21.15.79:0/152880606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff4b806be30 msgr2=0x7ff4b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.140+0000 7ff4dbefc640 1 --2- 172.21.15.79:0/152880606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff4b806be30 0x7ff4b806e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0007520 tx=0x7ff4d000b040 comp rx=0 tx=0).stop 2024-04-25T02:13:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.140+0000 7ff4dbefc640 1 -- 172.21.15.79:0/152880606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4d40ab220 msgr2=0x7ff4d40ab6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.140+0000 7ff4dbefc640 1 --2- 172.21.15.79:0/152880606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4d40ab220 0x7ff4d40ab6a0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00c4f0 tx=0x7ff4cc000fe0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.141+0000 7ff4dbefc640 1 -- 172.21.15.79:0/152880606 shutdown_connections 2024-04-25T02:13:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.141+0000 7ff4dbefc640 1 --2- 172.21.15.79:0/152880606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff4b806be30 0x7ff4b806e2f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.141+0000 7ff4dbefc640 1 --2- 172.21.15.79:0/152880606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4d40ab220 0x7ff4d40ab6a0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.141+0000 7ff4dbefc640 1 --2- 172.21.15.79:0/152880606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff4d40b09f0 0x7ff4d40b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.141+0000 7ff4dbefc640 1 --2- 172.21.15.79:0/152880606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff4c0006f50 0x7ff4d41428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.141+0000 7ff4dbefc640 1 -- 172.21.15.79:0/152880606 >> 172.21.15.79:0/152880606 conn(0x7ff4d40cfc80 msgr2=0x7ff4d40b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.141+0000 7ff4dbefc640 1 -- 172.21.15.79:0/152880606 shutdown_connections 2024-04-25T02:13:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.141+0000 7ff4dbefc640 1 -- 172.21.15.79:0/152880606 wait complete. 2024-04-25T02:13:53.157 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T02:13:53.283 INFO:teuthology.orchestra.run.smithi079.stdout:{"message":"","return_code":0} 2024-04-25T02:13:53.284 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T02:13:53.284 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:13:53.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.375+0000 7ff9e7a7d640 1 Processor -- start 2024-04-25T02:13:53.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.376+0000 7ff9e7a7d640 1 -- start start 2024-04-25T02:13:53.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.376+0000 7ff9e7a7d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff9e0071ea0 0x7ff9e006dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.376+0000 7ff9e7a7d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9e0162c10 0x7ff9e0165000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.376+0000 7ff9e7a7d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e00b4d70 con 0x7ff9e0072280 2024-04-25T02:13:53.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.376+0000 7ff9e7a7d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e00cfa30 con 0x7ff9e0071ea0 2024-04-25T02:13:53.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.376+0000 7ff9e7a7d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e00cfd10 con 0x7ff9e0162c10 2024-04-25T02:13:53.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.377+0000 7ff9e5819640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff9e0071ea0 0x7ff9e006dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.377+0000 7ff9e5819640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff9e0071ea0 0x7ff9e006dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33458/0 (socket says 172.21.15.79:33458) 2024-04-25T02:13:53.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.377+0000 7ff9e5819640 1 -- 172.21.15.79:0/4163931265 learned_addr learned my addr 172.21.15.79:0/4163931265 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:53.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.377+0000 7ff9e601a640 1 --2- 172.21.15.79:0/4163931265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9e0162c10 0x7ff9e0165000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.377+0000 7ff9e5819640 1 -- 172.21.15.79:0/4163931265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9e0162c10 msgr2=0x7ff9e0165000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:53.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.377+0000 7ff9e5819640 1 --2- 172.21.15.79:0/4163931265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9e0162c10 0x7ff9e0165000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.377+0000 7ff9e5819640 1 -- 172.21.15.79:0/4163931265 >> v1:172.21.15.189:6789/0 conn(0x7ff9e0072280 legacy=0x7ff9e00726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:53.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.377+0000 7ff9e5819640 1 -- 172.21.15.79:0/4163931265 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e00cfff0 con 0x7ff9e0071ea0 2024-04-25T02:13:53.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.377+0000 7ff9e601a640 1 --2- 172.21.15.79:0/4163931265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9e0162c10 0x7ff9e0165000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:53.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.377+0000 7ff9e5819640 1 --2- 172.21.15.79:0/4163931265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9e0071ea0 0x7ff9e006dc20 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000bb10 tx=0x7ff9d002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c1052fe573773a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.378+0000 7ff9e4817640 1 -- 172.21.15.79:0/4163931265 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0036020 con 0x7ff9e0071ea0 2024-04-25T02:13:53.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.378+0000 7ff9e4817640 1 -- 172.21.15.79:0/4163931265 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d0032820 con 0x7ff9e0071ea0 2024-04-25T02:13:53.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.378+0000 7ff9e4817640 1 -- 172.21.15.79:0/4163931265 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0032bf0 con 0x7ff9e0071ea0 2024-04-25T02:13:53.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.378+0000 7ff9e7a7d640 1 -- 172.21.15.79:0/4163931265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9e0071ea0 msgr2=0x7ff9e006dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.378+0000 7ff9e7a7d640 1 --2- 172.21.15.79:0/4163931265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9e0071ea0 0x7ff9e006dc20 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000bb10 tx=0x7ff9d002c920 comp rx=0 tx=0).stop 2024-04-25T02:13:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.378+0000 7ff9e7a7d640 1 -- 172.21.15.79:0/4163931265 shutdown_connections 2024-04-25T02:13:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.378+0000 7ff9e7a7d640 1 --2- 172.21.15.79:0/4163931265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9e0162c10 0x7ff9e0165000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.378+0000 7ff9e7a7d640 1 --2- 172.21.15.79:0/4163931265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9e0071ea0 0x7ff9e006dc20 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.378+0000 7ff9e7a7d640 1 -- 172.21.15.79:0/4163931265 >> 172.21.15.79:0/4163931265 conn(0x7ff9e00d0db0 msgr2=0x7ff9e00d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.378+0000 7ff9e7a7d640 1 -- 172.21.15.79:0/4163931265 shutdown_connections 2024-04-25T02:13:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.378+0000 7ff9e7a7d640 1 -- 172.21.15.79:0/4163931265 wait complete. 2024-04-25T02:13:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.379+0000 7ff9e7a7d640 1 Processor -- start 2024-04-25T02:13:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.379+0000 7ff9e7a7d640 1 -- start start 2024-04-25T02:13:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.380+0000 7ff9e7a7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9e0071ea0 0x7ff9e015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.380+0000 7ff9e7a7d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9e0072280 0x7ff9e0156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.380+0000 7ff9e7a7d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9e0162c10 0x7ff9e0158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.380+0000 7ff9e7a7d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e00cf6c0 con 0x7ff9e0071ea0 2024-04-25T02:13:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.380+0000 7ff9e7a7d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e00d05b0 con 0x7ff9e0162c10 2024-04-25T02:13:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.380+0000 7ff9e7a7d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e00d0ad0 con 0x7ff9e0072280 2024-04-25T02:13:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.380+0000 7ff9e5819640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9e0071ea0 0x7ff9e015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.380+0000 7ff9e5819640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9e0071ea0 0x7ff9e015b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33464/0 (socket says 172.21.15.79:33464) 2024-04-25T02:13:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.380+0000 7ff9e5819640 1 -- 172.21.15.79:0/141467620 learned_addr learned my addr 172.21.15.79:0/141467620 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.381+0000 7ff9e5819640 1 -- 172.21.15.79:0/141467620 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9e0072280 msgr2=0x7ff9e0156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.381+0000 7ff9e5819640 1 --2- 172.21.15.79:0/141467620 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9e0072280 0x7ff9e0156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.381+0000 7ff9e601a640 1 --2- 172.21.15.79:0/141467620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9e0162c10 0x7ff9e0158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.381+0000 7ff9e5819640 1 -- 172.21.15.79:0/141467620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9e0162c10 msgr2=0x7ff9e0158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.381+0000 7ff9e5819640 1 --2- 172.21.15.79:0/141467620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9e0162c10 0x7ff9e0158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.381+0000 7ff9e5819640 1 -- 172.21.15.79:0/141467620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e015bc00 con 0x7ff9e0071ea0 2024-04-25T02:13:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.381+0000 7ff9e5819640 1 --2- 172.21.15.79:0/141467620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9e0071ea0 0x7ff9e015b6c0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000b2c0 tx=0x7ff9d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.381+0000 7ff9d67fc640 1 -- 172.21.15.79:0/141467620 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0036040 con 0x7ff9e0071ea0 2024-04-25T02:13:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.381+0000 7ff9d67fc640 1 -- 172.21.15.79:0/141467620 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d003cd70 con 0x7ff9e0071ea0 2024-04-25T02:13:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.381+0000 7ff9e7a7d640 1 -- 172.21.15.79:0/141467620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e015bed0 con 0x7ff9e0071ea0 2024-04-25T02:13:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.381+0000 7ff9d67fc640 1 -- 172.21.15.79:0/141467620 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0046630 con 0x7ff9e0071ea0 2024-04-25T02:13:53.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.381+0000 7ff9e7a7d640 1 -- 172.21.15.79:0/141467620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e01587f0 con 0x7ff9e0071ea0 2024-04-25T02:13:53.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.382+0000 7ff9e7a7d640 1 -- 172.21.15.79:0/141467620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e00690a0 con 0x7ff9e0071ea0 2024-04-25T02:13:53.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.382+0000 7ff9d67fc640 1 -- 172.21.15.79:0/141467620 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9d004d060 con 0x7ff9e0071ea0 2024-04-25T02:13:53.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.383+0000 7ff9d67fc640 1 --2- 172.21.15.79:0/141467620 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff9c406be30 0x7ff9c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.383+0000 7ff9d67fc640 1 -- 172.21.15.79:0/141467620 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7ff9d00ae340 con 0x7ff9e0071ea0 2024-04-25T02:13:53.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.383+0000 7ff9e5018640 1 --2- 172.21.15.79:0/141467620 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff9c406be30 0x7ff9c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.383+0000 7ff9e5018640 1 --2- 172.21.15.79:0/141467620 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff9c406be30 0x7ff9c406e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc000f60 tx=0x7ff9dc0079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.387+0000 7ff9d67fc640 1 -- 172.21.15.79:0/141467620 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff9d0041070 con 0x7ff9e0071ea0 2024-04-25T02:13:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.594+0000 7ff9e7a7d640 1 -- 172.21.15.79:0/141467620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff9e013f090 con 0x7ff9e0071ea0 2024-04-25T02:13:53.600 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:13:53.595+0000 7fb0c50c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:13:53.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.596+0000 7ff9d67fc640 1 -- 172.21.15.79:0/141467620 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) ==== 161+0+0 (secure 0 0 0) 0x7ff9d002f070 con 0x7ff9e0071ea0 2024-04-25T02:13:53.602 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:13:53.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.599+0000 7ff9e7a7d640 1 -- 172.21.15.79:0/141467620 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff9c406be30 msgr2=0x7ff9c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.599+0000 7ff9e7a7d640 1 --2- 172.21.15.79:0/141467620 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff9c406be30 0x7ff9c406e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc000f60 tx=0x7ff9dc0079d0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.599+0000 7ff9e7a7d640 1 -- 172.21.15.79:0/141467620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9e0071ea0 msgr2=0x7ff9e015b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.599+0000 7ff9e7a7d640 1 --2- 172.21.15.79:0/141467620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9e0071ea0 0x7ff9e015b6c0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000b2c0 tx=0x7ff9d00046c0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.599+0000 7ff9e7a7d640 1 -- 172.21.15.79:0/141467620 shutdown_connections 2024-04-25T02:13:53.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.599+0000 7ff9e7a7d640 1 --2- 172.21.15.79:0/141467620 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff9c406be30 0x7ff9c406e2f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.599+0000 7ff9e7a7d640 1 --2- 172.21.15.79:0/141467620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9e0162c10 0x7ff9e0158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.599+0000 7ff9e7a7d640 1 --2- 172.21.15.79:0/141467620 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff9e0072280 0x7ff9e0156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.599+0000 7ff9e7a7d640 1 --2- 172.21.15.79:0/141467620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9e0071ea0 0x7ff9e015b6c0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.599+0000 7ff9e7a7d640 1 -- 172.21.15.79:0/141467620 >> 172.21.15.79:0/141467620 conn(0x7ff9e00d0db0 msgr2=0x7ff9e00d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:53.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.599+0000 7ff9e7a7d640 1 -- 172.21.15.79:0/141467620 shutdown_connections 2024-04-25T02:13:53.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.599+0000 7ff9e7a7d640 1 -- 172.21.15.79:0/141467620 wait complete. 2024-04-25T02:13:53.607 INFO:tasks.ceph.mds.a.smithi079.stderr: -4926> 2024-04-25T02:13:49.015+0000 7f01afbd3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:13:53.616 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2024-04-25T02:13:53.636 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:13:53.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.651+0000 7fecf7366f40 1 Processor -- start 2024-04-25T02:13:53.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.651+0000 7fecf7366f40 1 -- start start 2024-04-25T02:13:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7fecf7366f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55816ac2bdb0 0x55816acc8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7fecf7366f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55816acb6320 0x55816acd09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7fecf7366f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55816acd2750 0x55816accb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7fecf7366f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55816acb7cf0 con 0x55816acb6320 2024-04-25T02:13:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7fecf7366f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55816aba3640 con 0x55816ac2bdb0 2024-04-25T02:13:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7fecf7366f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55816ac42d20 con 0x55816acd2750 2024-04-25T02:13:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7feceffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55816acb6320 0x55816acd09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7feceffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55816acb6320 0x55816acd09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35234/0 (socket says 172.21.15.79:35234) 2024-04-25T02:13:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7feceffff640 1 -- 172.21.15.79:0/3046339636 learned_addr learned my addr 172.21.15.79:0/3046339636 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7fecf4e69640 1 --2- 172.21.15.79:0/3046339636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55816ac2bdb0 0x55816acc8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7fecf566a640 1 --2- 172.21.15.79:0/3046339636 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55816acd2750 0x55816accb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7feceffff640 1 -- 172.21.15.79:0/3046339636 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55816acd2750 msgr2=0x55816accb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7feceffff640 1 --2- 172.21.15.79:0/3046339636 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55816acd2750 0x55816accb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7feceffff640 1 -- 172.21.15.79:0/3046339636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55816ac2bdb0 msgr2=0x55816acc8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7feceffff640 1 --2- 172.21.15.79:0/3046339636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55816ac2bdb0 0x55816acc8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7feceffff640 1 -- 172.21.15.79:0/3046339636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55816accb310 con 0x55816acb6320 2024-04-25T02:13:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7feceffff640 1 --2- 172.21.15.79:0/3046339636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55816acb6320 0x55816acd09f0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fece000a460 tx=0x7fece000a920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60afdfc9f2857ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.652+0000 7feceeffd640 1 -- 172.21.15.79:0/3046339636 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece000b920 con 0x55816acb6320 2024-04-25T02:13:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.653+0000 7feceeffd640 1 -- 172.21.15.79:0/3046339636 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece000f070 con 0x55816acb6320 2024-04-25T02:13:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.653+0000 7feceeffd640 1 -- 172.21.15.79:0/3046339636 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece000bd20 con 0x55816acb6320 2024-04-25T02:13:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.653+0000 7fecf7366f40 1 -- 172.21.15.79:0/3046339636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55816acb6320 msgr2=0x55816acd09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.653+0000 7fecf7366f40 1 --2- 172.21.15.79:0/3046339636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55816acb6320 0x55816acd09f0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fece000a460 tx=0x7fece000a920 comp rx=0 tx=0).stop 2024-04-25T02:13:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.653+0000 7fecf7366f40 1 -- 172.21.15.79:0/3046339636 shutdown_connections 2024-04-25T02:13:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.653+0000 7fecf7366f40 1 --2- 172.21.15.79:0/3046339636 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55816acd2750 0x55816accb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.653+0000 7fecf7366f40 1 --2- 172.21.15.79:0/3046339636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55816acb6320 0x55816acd09f0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.653+0000 7fecf7366f40 1 --2- 172.21.15.79:0/3046339636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55816ac2bdb0 0x55816acc8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.653+0000 7fecf7366f40 1 -- 172.21.15.79:0/3046339636 >> 172.21.15.79:0/3046339636 conn(0x55816ac26000 msgr2=0x55816acd3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.653+0000 7fecf7366f40 1 -- 172.21.15.79:0/3046339636 shutdown_connections 2024-04-25T02:13:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.653+0000 7fecf7366f40 1 -- 172.21.15.79:0/3046339636 wait complete. 2024-04-25T02:13:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.654+0000 7fecf7366f40 1 Processor -- start 2024-04-25T02:13:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.654+0000 7fecf7366f40 1 -- start start 2024-04-25T02:13:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.654+0000 7fecf7366f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55816ac2bdb0 0x55816abfca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.654+0000 7fecf7366f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55816acb6320 0x55816acb31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.654+0000 7fecf7366f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55816acd2750 0x55816acca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.654+0000 7fecf7366f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55816acd4980 con 0x55816acb6320 2024-04-25T02:13:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.654+0000 7fecf7366f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55816ac2ba00 con 0x55816acd2750 2024-04-25T02:13:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.654+0000 7fecf7366f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55816acc8810 con 0x55816ac2bdb0 2024-04-25T02:13:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.654+0000 7feceffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55816acb6320 0x55816acb31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.654+0000 7feceffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55816acb6320 0x55816acb31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35240/0 (socket says 172.21.15.79:35240) 2024-04-25T02:13:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.654+0000 7feceffff640 1 -- 172.21.15.79:0/1357578695 learned_addr learned my addr 172.21.15.79:0/1357578695 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.654+0000 7fecf4e69640 1 --2- 172.21.15.79:0/1357578695 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55816ac2bdb0 0x55816abfca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.655+0000 7fecf566a640 1 --2- 172.21.15.79:0/1357578695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55816acd2750 0x55816acca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.655+0000 7feceffff640 1 -- 172.21.15.79:0/1357578695 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55816ac2bdb0 msgr2=0x55816abfca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.655+0000 7feceffff640 1 --2- 172.21.15.79:0/1357578695 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55816ac2bdb0 0x55816abfca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.655+0000 7feceffff640 1 -- 172.21.15.79:0/1357578695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55816acd2750 msgr2=0x55816acca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.655+0000 7feceffff640 1 --2- 172.21.15.79:0/1357578695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55816acd2750 0x55816acca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.655+0000 7feceffff640 1 -- 172.21.15.79:0/1357578695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55816acb3c00 con 0x55816acb6320 2024-04-25T02:13:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.655+0000 7fecf566a640 1 --2- 172.21.15.79:0/1357578695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55816acd2750 0x55816acca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.655+0000 7feceffff640 1 --2- 172.21.15.79:0/1357578695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55816acb6320 0x55816acb31a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fece0010000 tx=0x7fece0002f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.655+0000 7fecedffb640 1 -- 172.21.15.79:0/1357578695 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece0025070 con 0x55816acb6320 2024-04-25T02:13:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.655+0000 7fecedffb640 1 -- 172.21.15.79:0/1357578695 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece0014880 con 0x55816acb6320 2024-04-25T02:13:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.655+0000 7fecf7366f40 1 -- 172.21.15.79:0/1357578695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55816abfbc50 con 0x55816acb6320 2024-04-25T02:13:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.655+0000 7fecedffb640 1 -- 172.21.15.79:0/1357578695 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece000ce60 con 0x55816acb6320 2024-04-25T02:13:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.655+0000 7fecf7366f40 1 -- 172.21.15.79:0/1357578695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55816abfc210 con 0x55816acb6320 2024-04-25T02:13:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.656+0000 7fecedffb640 1 -- 172.21.15.79:0/1357578695 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fece0028070 con 0x55816acb6320 2024-04-25T02:13:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.656+0000 7fecedffb640 1 --2- 172.21.15.79:0/1357578695 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fecd806a840 0x7fecd806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.657+0000 7fecedffb640 1 -- 172.21.15.79:0/1357578695 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fece008b050 con 0x55816acb6320 2024-04-25T02:13:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.657+0000 7fecf4e69640 1 --2- 172.21.15.79:0/1357578695 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fecd806a840 0x7fecd806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.657+0000 7fecf7366f40 1 --2- 172.21.15.79:0/1357578695 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55816abfcf50 0x55816ad5c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.657+0000 7fecf7366f40 1 -- 172.21.15.79:0/1357578695 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:1 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55816acc9e20 con 0x55816abfcf50 2024-04-25T02:13:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.657+0000 7fecf566a640 1 --2- 172.21.15.79:0/1357578695 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55816abfcf50 0x55816ad5c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.657+0000 7fecf4e69640 1 --2- 172.21.15.79:0/1357578695 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fecd806a840 0x7fecd806cd00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x55816acc9b80 tx=0x7fece800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.657+0000 7fecf566a640 1 --2- 172.21.15.79:0/1357578695 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55816abfcf50 0x55816ad5c6f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.660+0000 7fecf566a640 1 -- 172.21.15.79:0/1357578695 <== osd.0 v2:172.21.15.79:6802/1526100659 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v87'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fecf0056030 con 0x55816abfcf50 2024-04-25T02:13:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.660+0000 7fecf7366f40 1 -- 172.21.15.79:0/1357578695 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55816abfcf50 msgr2=0x55816ad5c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.660+0000 7fecf7366f40 1 --2- 172.21.15.79:0/1357578695 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55816abfcf50 0x55816ad5c6f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.660+0000 7fecf7366f40 1 -- 172.21.15.79:0/1357578695 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fecd806a840 msgr2=0x7fecd806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.660+0000 7fecf7366f40 1 --2- 172.21.15.79:0/1357578695 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fecd806a840 0x7fecd806cd00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x55816acc9b80 tx=0x7fece800b040 comp rx=0 tx=0).stop 2024-04-25T02:13:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.660+0000 7fecf7366f40 1 -- 172.21.15.79:0/1357578695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55816acb6320 msgr2=0x55816acb31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.660+0000 7fecf7366f40 1 --2- 172.21.15.79:0/1357578695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55816acb6320 0x55816acb31a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fece0010000 tx=0x7fece0002f70 comp rx=0 tx=0).stop 2024-04-25T02:13:53.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.660+0000 7fecf566a640 1 -- 172.21.15.79:0/1357578695 reap_dead start 2024-04-25T02:13:53.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.660+0000 7fecf7366f40 1 -- 172.21.15.79:0/1357578695 shutdown_connections 2024-04-25T02:13:53.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.660+0000 7fecf7366f40 1 -- 172.21.15.79:0/1357578695 >> 172.21.15.79:0/1357578695 conn(0x55816ac26000 msgr2=0x55816acd5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:53.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.660+0000 7fecf7366f40 1 -- 172.21.15.79:0/1357578695 shutdown_connections 2024-04-25T02:13:53.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.660+0000 7fecf7366f40 1 -- 172.21.15.79:0/1357578695 wait complete. 2024-04-25T02:13:53.672 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-04-25T02:13:53.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.746+0000 7efe71893280 1 -- start start 2024-04-25T02:13:53.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.746+0000 7efe71893280 1 Processor -- start 2024-04-25T02:13:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe71893280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a9889c800 0x560a97b42b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe71893280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a9889dc00 0x560a97b43b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe71893280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a9889d400 0x560a97b43080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe71893280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a988d6000 con 0x560a9889d400 2024-04-25T02:13:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe71893280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560a988d6180 con 0x560a9889dc00 2024-04-25T02:13:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe71893280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x560a988d6300 con 0x560a9889c800 2024-04-25T02:13:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe70842640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a9889d400 0x560a97b43080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe70842640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a9889d400 0x560a97b43080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35250/0 (socket says 172.21.15.79:35250) 2024-04-25T02:13:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe70842640 1 -- 172.21.15.79:0/3954305174 learned_addr learned my addr 172.21.15.79:0/3954305174 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe6f840640 1 --2- 172.21.15.79:0/3954305174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a9889dc00 0x560a97b43b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe70842640 1 -- 172.21.15.79:0/3954305174 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a9889c800 msgr2=0x560a97b42b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe70041640 1 --2- 172.21.15.79:0/3954305174 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a9889c800 0x560a97b42b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe70842640 1 --2- 172.21.15.79:0/3954305174 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a9889c800 0x560a97b42b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe70842640 1 -- 172.21.15.79:0/3954305174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a9889dc00 msgr2=0x560a97b43b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe70842640 1 --2- 172.21.15.79:0/3954305174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a9889dc00 0x560a97b43b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe70842640 1 -- 172.21.15.79:0/3954305174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a97b08780 con 0x560a9889d400 2024-04-25T02:13:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe70842640 1 --2- 172.21.15.79:0/3954305174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a9889d400 0x560a97b43080 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x560a97b05aa0 tx=0x560a988680c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca965b61803caefa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe6d83c640 1 -- 172.21.15.79:0/3954305174 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560a97af8b60 con 0x560a9889d400 2024-04-25T02:13:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe6d83c640 1 -- 172.21.15.79:0/3954305174 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560a97afee00 con 0x560a9889d400 2024-04-25T02:13:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe6d83c640 1 -- 172.21.15.79:0/3954305174 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560a97af8d00 con 0x560a9889d400 2024-04-25T02:13:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe71893280 1 -- 172.21.15.79:0/3954305174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a97b09a40 con 0x560a9889d400 2024-04-25T02:13:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe71893280 1 -- 172.21.15.79:0/3954305174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x560a97b09860 con 0x560a9889d400 2024-04-25T02:13:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe71893280 4 waiting for MDS map... 2024-04-25T02:13:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe6d83c640 1 -- 172.21.15.79:0/3954305174 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x560a988dc400 con 0x560a9889d400 2024-04-25T02:13:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.747+0000 7efe6d83c640 1 -- 172.21.15.79:0/3954305174 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 49) ==== 2885+0+0 (secure 0 0 0) 0x560a97b2d180 con 0x560a9889d400 2024-04-25T02:13:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.748+0000 7efe71893280 4 Got MDS map 49 2024-04-25T02:13:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.748+0000 7efe71893280 10 main: JournalTool::main 2024-04-25T02:13:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.748+0000 7efe71893280 4 main: JournalTool: connecting to RADOS... 2024-04-25T02:13:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.748+0000 7efe71893280 1 Processor -- start 2024-04-25T02:13:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.748+0000 7efe71893280 1 -- start start 2024-04-25T02:13:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe71893280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a989a6400 0x560a97b42580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe71893280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a989a6800 0x560a97b44100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe71893280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a989a6c00 0x560a97b44680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe71893280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a988d6480 con 0x560a989a6800 2024-04-25T02:13:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe71893280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560a988d6600 con 0x560a989a6c00 2024-04-25T02:13:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe71893280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x560a988d6780 con 0x560a989a6400 2024-04-25T02:13:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe70041640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a989a6800 0x560a97b44100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe70041640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a989a6800 0x560a97b44100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35262/0 (socket says 172.21.15.79:35262) 2024-04-25T02:13:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe70041640 1 -- 172.21.15.79:0/2223366359 learned_addr learned my addr 172.21.15.79:0/2223366359 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe6f840640 1 --2- 172.21.15.79:0/2223366359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a989a6c00 0x560a97b44680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe6f840640 1 --2- 172.21.15.79:0/2223366359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a989a6400 0x560a97b42580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe70041640 1 -- 172.21.15.79:0/2223366359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a989a6400 msgr2=0x560a97b42580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe70041640 1 --2- 172.21.15.79:0/2223366359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a989a6400 0x560a97b42580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe70041640 1 -- 172.21.15.79:0/2223366359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a989a6c00 msgr2=0x560a97b44680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe70041640 1 --2- 172.21.15.79:0/2223366359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a989a6c00 0x560a97b44680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe70041640 1 -- 172.21.15.79:0/2223366359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a97b083c0 con 0x560a989a6800 2024-04-25T02:13:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe6f840640 1 --2- 172.21.15.79:0/2223366359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a989a6c00 0x560a97b44680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe70041640 1 --2- 172.21.15.79:0/2223366359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a989a6800 0x560a97b44100 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x560a989a2900 tx=0x560a989a8d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39274f3da316feb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe6b838640 1 -- 172.21.15.79:0/2223366359 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560a97af8b60 con 0x560a989a6800 2024-04-25T02:13:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe6b838640 1 -- 172.21.15.79:0/2223366359 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560a97afe700 con 0x560a989a6800 2024-04-25T02:13:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.749+0000 7efe6b838640 1 -- 172.21.15.79:0/2223366359 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560a97af8d00 con 0x560a989a6800 2024-04-25T02:13:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.750+0000 7efe71893280 1 -- 172.21.15.79:0/2223366359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a989a6800 msgr2=0x560a97b44100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.750+0000 7efe71893280 1 --2- 172.21.15.79:0/2223366359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a989a6800 0x560a97b44100 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x560a989a2900 tx=0x560a989a8d20 comp rx=0 tx=0).stop 2024-04-25T02:13:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.750+0000 7efe71893280 1 -- 172.21.15.79:0/2223366359 shutdown_connections 2024-04-25T02:13:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.750+0000 7efe71893280 1 --2- 172.21.15.79:0/2223366359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a989a6c00 0x560a97b44680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.750+0000 7efe71893280 1 --2- 172.21.15.79:0/2223366359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a989a6800 0x560a97b44100 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.750+0000 7efe71893280 1 --2- 172.21.15.79:0/2223366359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a989a6400 0x560a97b42580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.750+0000 7efe71893280 1 -- 172.21.15.79:0/2223366359 >> 172.21.15.79:0/2223366359 conn(0x560a9889d800 msgr2=0x560a97bbf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.750+0000 7efe71893280 1 -- 172.21.15.79:0/2223366359 shutdown_connections 2024-04-25T02:13:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.750+0000 7efe71893280 1 -- 172.21.15.79:0/2223366359 wait complete. 2024-04-25T02:13:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.750+0000 7efe71893280 1 Processor -- start 2024-04-25T02:13:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.750+0000 7efe71893280 1 -- start start 2024-04-25T02:13:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe71893280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a989a6400 0x560a97b42580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe71893280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a989a6800 0x560a97b44100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe71893280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a989a6c00 0x560a97b44680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe71893280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a988d7e00 con 0x560a989a6400 2024-04-25T02:13:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe71893280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560a988d7c80 con 0x560a989a6c00 2024-04-25T02:13:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe71893280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x560a988d7b00 con 0x560a989a6800 2024-04-25T02:13:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe6f840640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a989a6400 0x560a97b42580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe6f840640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a989a6400 0x560a97b42580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35274/0 (socket says 172.21.15.79:35274) 2024-04-25T02:13:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe6f840640 1 -- 172.21.15.79:0/3255930929 learned_addr learned my addr 172.21.15.79:0/3255930929 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe6f840640 1 --2- 172.21.15.79:0/3255930929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a989a6c00 0x560a97b44680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe70041640 1 --2- 172.21.15.79:0/3255930929 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a989a6800 0x560a97b44100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe6f840640 1 -- 172.21.15.79:0/3255930929 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a989a6800 msgr2=0x560a97b44100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe6f840640 1 --2- 172.21.15.79:0/3255930929 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a989a6800 0x560a97b44100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe6f840640 1 -- 172.21.15.79:0/3255930929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a989a6c00 msgr2=0x560a97b44680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe6f840640 1 --2- 172.21.15.79:0/3255930929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a989a6c00 0x560a97b44680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe6f840640 1 -- 172.21.15.79:0/3255930929 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a97b08780 con 0x560a989a6400 2024-04-25T02:13:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe70041640 1 --2- 172.21.15.79:0/3255930929 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a989a6800 0x560a97b44100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.751+0000 7efe6f840640 1 --2- 172.21.15.79:0/3255930929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a989a6400 0x560a97b42580 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x560a989a3b30 tx=0x560a989a8c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.752+0000 7efe6a035640 1 -- 172.21.15.79:0/3255930929 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560a97af8b60 con 0x560a989a6400 2024-04-25T02:13:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.752+0000 7efe6a035640 1 -- 172.21.15.79:0/3255930929 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560a97afe1c0 con 0x560a989a6400 2024-04-25T02:13:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.752+0000 7efe71893280 1 -- 172.21.15.79:0/3255930929 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a97b08000 con 0x560a989a6400 2024-04-25T02:13:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.752+0000 7efe6a035640 1 -- 172.21.15.79:0/3255930929 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560a97af8d00 con 0x560a989a6400 2024-04-25T02:13:53.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.752+0000 7efe71893280 1 -- 172.21.15.79:0/3255930929 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a97b09680 con 0x560a989a6400 2024-04-25T02:13:53.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.752+0000 7efe71893280 4 main: JournalTool: resolving pool 12 2024-04-25T02:13:53.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.753+0000 7efe6a035640 1 -- 172.21.15.79:0/3255930929 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x560a98a04c00 con 0x560a989a6400 2024-04-25T02:13:53.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.753+0000 7efe6a035640 1 --2- 172.21.15.79:0/3255930929 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x560a98a1cc00 0x560a97b45700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.753+0000 7efe6a035640 1 -- 172.21.15.79:0/3255930929 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x560a98a02e00 con 0x560a989a6400 2024-04-25T02:13:53.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.753+0000 7efe70041640 1 --2- 172.21.15.79:0/3255930929 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x560a98a1cc00 0x560a97b45700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.753+0000 7efe71893280 4 main: JournalTool: creating IoCtx.. 2024-04-25T02:13:53.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.753+0000 7efe71893280 4 main: Executing for rank 0 2024-04-25T02:13:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.753+0000 7efe70041640 1 --2- 172.21.15.79:0/3255930929 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x560a98a1cc00 0x560a97b45700 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x560a989a2900 tx=0x560a988669c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.754+0000 7efe71893280 1 -- start start 2024-04-25T02:13:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.754+0000 7efe71893280 1 Processor -- start 2024-04-25T02:13:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.754+0000 7efe71893280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a989a7400 0x560a97b44c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.754+0000 7efe71893280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a98a1d000 0x560a97b45180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.754+0000 7efe71893280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a98a1d400 0x560a97ea2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.754+0000 7efe71893280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a988d7800 con 0x560a98a1d000 2024-04-25T02:13:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.754+0000 7efe71893280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560a988d7680 con 0x560a989a7400 2024-04-25T02:13:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.754+0000 7efe71893280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x560a988d6480 con 0x560a98a1d400 2024-04-25T02:13:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.754+0000 7efe70041640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a98a1d000 0x560a97b45180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.754+0000 7efe70041640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a98a1d000 0x560a97b45180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35286/0 (socket says 172.21.15.79:35286) 2024-04-25T02:13:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.754+0000 7efe70041640 1 -- 172.21.15.79:0/1207172933 learned_addr learned my addr 172.21.15.79:0/1207172933 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe70041640 1 -- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a98a1d400 msgr2=0x560a97ea2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe70041640 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a98a1d400 0x560a97ea2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe70041640 1 -- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a989a7400 msgr2=0x560a97b44c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe70041640 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a989a7400 0x560a97b44c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe70041640 1 -- 172.21.15.79:0/1207172933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a97b09c20 con 0x560a98a1d000 2024-04-25T02:13:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe70041640 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a98a1d000 0x560a97b45180 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x560a97de7b00 tx=0x560a98866a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7283921a6dcf12d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe6702f640 1 -- 172.21.15.79:0/1207172933 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560a97af84e0 con 0x560a98a1d000 2024-04-25T02:13:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe6702f640 1 -- 172.21.15.79:0/1207172933 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560a97afe540 con 0x560a98a1d000 2024-04-25T02:13:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe6702f640 1 -- 172.21.15.79:0/1207172933 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560a98a524e0 con 0x560a98a1d000 2024-04-25T02:13:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a97b083c0 con 0x560a98a1d000 2024-04-25T02:13:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x560a97b09c20 con 0x560a98a1d000 2024-04-25T02:13:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe71893280 4 waiting for MDS map... 2024-04-25T02:13:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe6702f640 1 -- 172.21.15.79:0/1207172933 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x560a989fe000 con 0x560a98a1d000 2024-04-25T02:13:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe6702f640 1 -- 172.21.15.79:0/1207172933 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 49) ==== 2885+0+0 (secure 0 0 0) 0x560a97b2d500 con 0x560a98a1d000 2024-04-25T02:13:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe71893280 4 Got MDS map 49 2024-04-25T02:13:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe71893280 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x560a98a1d800 0x560a97ea2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.755+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:1 12.f 12:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x560a98a1dc00 con 0x560a98a1d800 2024-04-25T02:13:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.756+0000 7efe70842640 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x560a98a1d800 0x560a97ea2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.756+0000 7efe70842640 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x560a98a1d800 0x560a97ea2580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=de3550f203d8b05f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.759+0000 7efe70842640 1 -- 172.21.15.79:0/1207172933 <== osd.6 v2:172.21.15.189:6816/1254358257 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x560a97bd4000 con 0x560a98a1d800 2024-04-25T02:13:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.760+0000 7efe71893280 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x560a97eb4400 0x560a97ea2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.760+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:2 12.14 12:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x560a97eb4800 con 0x560a97eb4400 2024-04-25T02:13:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.760+0000 7efe6f840640 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x560a97eb4400 0x560a97ea2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.760+0000 7efe6f840640 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x560a97eb4400 0x560a97ea2b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=57a5dab3b4dcb489 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.761+0000 7efe6f840640 1 -- 172.21.15.79:0/1207172933 <== osd.5 v2:172.21.15.189:6802/1246927196 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x560a97bd4500 con 0x560a97eb4400 2024-04-25T02:13:53.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.761+0000 7efe6582c640 1 -- 172.21.15.79:0/1207172933 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:3 12.14 12:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e87) -- 0x560a97ec6000 con 0x560a97eb4400 2024-04-25T02:13:53.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.761+0000 7efe6582c640 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x560a97ec6400 0x560a97ea3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.761+0000 7efe6582c640 1 -- 172.21.15.79:0/1207172933 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:4 12.1b 12:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e87) -- 0x560a97ec6800 con 0x560a97ec6400 2024-04-25T02:13:53.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.761+0000 7efe70842640 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x560a97ec6400 0x560a97ea3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.761+0000 7efe6f840640 1 -- 172.21.15.79:0/1207172933 <== osd.5 v2:172.21.15.189:6802/1246927196 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv17 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x560a97bd4500 con 0x560a97eb4400 2024-04-25T02:13:53.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.761+0000 7efe70842640 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x560a97ec6400 0x560a97ea3b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=160f6e62c5f2e9e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.762+0000 7efe70842640 1 -- 172.21.15.79:0/1207172933 <== osd.4 v2:172.21.15.189:6800/1910571406 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x560a97bd4000 con 0x560a97ec6400 2024-04-25T02:13:53.772 INFO:teuthology.orchestra.run.smithi079.stdout:old journal was 4212724~2605 2024-04-25T02:13:53.773 INFO:teuthology.orchestra.run.smithi079.stdout:new journal start will be 8388608 (4173279 bytes past old end) 2024-04-25T02:13:53.773 INFO:teuthology.orchestra.run.smithi079.stdout:writing journal head 2024-04-25T02:13:53.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.762+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:5 12.14 12:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x560a97eb4c00 con 0x560a97eb4400 2024-04-25T02:13:53.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.763+0000 7efe6f840640 1 -- 172.21.15.79:0/1207172933 <== osd.5 v2:172.21.15.189:6802/1246927196 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v87'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x560a97bd4500 con 0x560a97eb4400 2024-04-25T02:13:53.773 INFO:teuthology.orchestra.run.smithi079.stdout:writing EResetJournal entry 2024-04-25T02:13:53.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.763+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:6 12.1b 12:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x560a97eb5000 con 0x560a97ec6400 2024-04-25T02:13:53.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.763+0000 7efe71893280 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x560a97eb5400 0x560a97ea3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.763+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:7 12.b 12:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x560a97eb5800 con 0x560a97eb5400 2024-04-25T02:13:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.763+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:8 12.1f 12:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x560a97eb5c00 con 0x560a98a1d800 2024-04-25T02:13:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.763+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:9 12.1a 12:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x560a97ec6c00 con 0x560a97ec6400 2024-04-25T02:13:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.763+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:10 12.1e 12:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x560a97ec7000 con 0x560a97ec6400 2024-04-25T02:13:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.763+0000 7efe71893280 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x560a97ec7400 0x560a97ea3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.763+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:11 12.1d 12:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x560a97ec7800 con 0x560a97ec7400 2024-04-25T02:13:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.763+0000 7efe70041640 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x560a97eb5400 0x560a97ea3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.763+0000 7efe6f840640 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x560a97ec7400 0x560a97ea3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.763+0000 7efe70041640 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x560a97eb5400 0x560a97ea3080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=de96773fd687ad4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.763+0000 7efe6f840640 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x560a97ec7400 0x560a97ea3600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=54dcd5c6893bbc86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.764+0000 7efe70842640 1 -- 172.21.15.79:0/1207172933 <== osd.4 v2:172.21.15.189:6800/1910571406 2 ==== osd_op_reply(6 200.00000002 [delete] v87'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x560a97bd4000 con 0x560a97ec6400 2024-04-25T02:13:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.764+0000 7efe70842640 1 -- 172.21.15.79:0/1207172933 <== osd.6 v2:172.21.15.189:6816/1254358257 2 ==== osd_op_reply(8 200.00000004 [delete] v87'7 uv6 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x560a97bd4000 con 0x560a98a1d800 2024-04-25T02:13:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.764+0000 7efe70842640 1 -- 172.21.15.79:0/1207172933 <== osd.4 v2:172.21.15.189:6800/1910571406 3 ==== osd_op_reply(9 200.00000005 [delete] v87'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x560a97bd4000 con 0x560a97ec6400 2024-04-25T02:13:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.765+0000 7efe70842640 1 -- 172.21.15.79:0/1207172933 <== osd.4 v2:172.21.15.189:6800/1910571406 4 ==== osd_op_reply(10 200.00000006 [delete] v87'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x560a97bd4000 con 0x560a97ec6400 2024-04-25T02:13:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.767+0000 7efe70041640 1 -- 172.21.15.79:0/1207172933 <== osd.3 v2:172.21.15.79:6817/3072297369 1 ==== osd_op_reply(7 200.00000003 [delete] v87'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x560a97bd4780 con 0x560a97eb5400 2024-04-25T02:13:53.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.767+0000 7efe6582c640 1 -- 172.21.15.79:0/1207172933 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:12 12.1b 12:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x560a97eb4800 con 0x560a97ec6400 2024-04-25T02:13:53.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.769+0000 7efe6f840640 1 -- 172.21.15.79:0/1207172933 <== osd.0 v2:172.21.15.79:6802/1526100659 1 ==== osd_op_reply(11 200.00000007 [delete] v87'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x560a97bd4500 con 0x560a97ec7400 2024-04-25T02:13:53.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe70842640 1 -- 172.21.15.79:0/1207172933 <== osd.4 v2:172.21.15.189:6800/1910571406 5 ==== osd_op_reply(12 200.00000002 [write 0~48] v87'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x560a97bd4000 con 0x560a97ec6400 2024-04-25T02:13:53.779 INFO:teuthology.orchestra.run.smithi079.stdout:done 2024-04-25T02:13:53.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x560a97ec7400 msgr2=0x560a97ea3600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x560a97ec7400 0x560a97ea3600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x560a97eb5400 msgr2=0x560a97ea3080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x560a97eb5400 0x560a97ea3080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x560a97ec6400 msgr2=0x560a97ea3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x560a97ec6400 0x560a97ea3b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x560a97eb4400 msgr2=0x560a97ea2b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x560a97eb4400 0x560a97ea2b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x560a98a1d800 msgr2=0x560a97ea2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x560a98a1d800 0x560a97ea2580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe6f840640 1 -- 172.21.15.79:0/1207172933 reap_dead start 2024-04-25T02:13:53.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe6f840640 1 -- 172.21.15.79:0/1207172933 reap_dead start 2024-04-25T02:13:53.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a98a1d000 msgr2=0x560a97b45180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 --2- 172.21.15.79:0/1207172933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a98a1d000 0x560a97b45180 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x560a97de7b00 tx=0x560a98866a80 comp rx=0 tx=0).stop 2024-04-25T02:13:53.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe6f840640 1 -- 172.21.15.79:0/1207172933 reap_dead start 2024-04-25T02:13:53.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 shutdown_connections 2024-04-25T02:13:53.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 >> 172.21.15.79:0/1207172933 conn(0x560a989a7000 msgr2=0x560a97bbf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:53.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 shutdown_connections 2024-04-25T02:13:53.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.773+0000 7efe71893280 1 -- 172.21.15.79:0/1207172933 wait complete. 2024-04-25T02:13:53.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 -- 172.21.15.79:0/3255930929 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x560a98a1cc00 msgr2=0x560a97b45700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 --2- 172.21.15.79:0/3255930929 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x560a98a1cc00 0x560a97b45700 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x560a989a2900 tx=0x560a988669c0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 -- 172.21.15.79:0/3255930929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a989a6400 msgr2=0x560a97b42580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 --2- 172.21.15.79:0/3255930929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a989a6400 0x560a97b42580 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x560a989a3b30 tx=0x560a989a8c60 comp rx=0 tx=0).stop 2024-04-25T02:13:53.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 -- 172.21.15.79:0/3255930929 shutdown_connections 2024-04-25T02:13:53.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 --2- 172.21.15.79:0/3255930929 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x560a98a1cc00 0x560a97b45700 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 --2- 172.21.15.79:0/3255930929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a989a6c00 0x560a97b44680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 --2- 172.21.15.79:0/3255930929 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a989a6800 0x560a97b44100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 --2- 172.21.15.79:0/3255930929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a989a6400 0x560a97b42580 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 -- 172.21.15.79:0/3255930929 >> 172.21.15.79:0/3255930929 conn(0x560a9889d800 msgr2=0x560a97bbf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:53.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 -- 172.21.15.79:0/3255930929 shutdown_connections 2024-04-25T02:13:53.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 -- 172.21.15.79:0/3255930929 wait complete. 2024-04-25T02:13:53.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 -- 172.21.15.79:0/3954305174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a9889d400 msgr2=0x560a97b43080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 --2- 172.21.15.79:0/3954305174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a9889d400 0x560a97b43080 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x560a97b05aa0 tx=0x560a988680c0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 -- 172.21.15.79:0/3954305174 shutdown_connections 2024-04-25T02:13:53.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 --2- 172.21.15.79:0/3954305174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a9889d400 0x560a97b43080 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 --2- 172.21.15.79:0/3954305174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a9889dc00 0x560a97b43b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 --2- 172.21.15.79:0/3954305174 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x560a9889c800 0x560a97b42b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 -- 172.21.15.79:0/3954305174 >> 172.21.15.79:0/3954305174 conn(0x560a97ad3000 msgr2=0x560a97bbe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:53.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 -- 172.21.15.79:0/3954305174 shutdown_connections 2024-04-25T02:13:53.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.774+0000 7efe71893280 1 -- 172.21.15.79:0/3954305174 wait complete. 2024-04-25T02:13:53.785 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.112673, result: old journal was 4212724~2605 new journal start will be 8388608 (4173279 bytes past old end) writing journal head writing EResetJournal entry done 2024-04-25T02:13:53.785 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T02:13:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.919+0000 7fdae1076640 1 Processor -- start 2024-04-25T02:13:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.919+0000 7fdae1076640 1 -- start start 2024-04-25T02:13:53.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.919+0000 7fdae1076640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdadc0d2ca0 0x7fdadc0d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.919+0000 7fdae1076640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdadc0d0ef0 0x7fdadc06bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.919+0000 7fdae1076640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdadc0d1ee0 con 0x7fdadc15e4f0 2024-04-25T02:13:53.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.919+0000 7fdae1076640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fdadc0d3130 con 0x7fdadc0d2ca0 2024-04-25T02:13:53.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.919+0000 7fdae1076640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdadc0d21c0 con 0x7fdadc0d0ef0 2024-04-25T02:13:53.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.920+0000 7fdad3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdadc0d2ca0 0x7fdadc0d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.920+0000 7fdadad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdadc15e4f0 0x7fdadc0cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33378/0 (socket says 172.21.15.79:33378) 2024-04-25T02:13:53.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.920+0000 7fdadad9d640 1 -- 172.21.15.79:0/3647672060 learned_addr learned my addr 172.21.15.79:0/3647672060 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:53.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.920+0000 7fdad3fff640 1 -- 172.21.15.79:0/3647672060 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdadc0d0ef0 msgr2=0x7fdadc06bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.920+0000 7fdadb59e640 1 --2- 172.21.15.79:0/3647672060 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdadc0d0ef0 0x7fdadc06bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.920+0000 7fdad3fff640 1 --2- 172.21.15.79:0/3647672060 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdadc0d0ef0 0x7fdadc06bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.920+0000 7fdada59c640 1 -- 172.21.15.79:0/3647672060 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3261371484 0 0) 0x7fdadc0d1ee0 con 0x7fdadc15e4f0 2024-04-25T02:13:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.920+0000 7fdad3fff640 1 -- 172.21.15.79:0/3647672060 >> v1:172.21.15.79:6789/0 conn(0x7fdadc15e4f0 legacy=0x7fdadc0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.920+0000 7fdad3fff640 1 -- 172.21.15.79:0/3647672060 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdadc0d24a0 con 0x7fdadc0d2ca0 2024-04-25T02:13:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.920+0000 7fdadb59e640 1 --2- 172.21.15.79:0/3647672060 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdadc0d0ef0 0x7fdadc06bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.921+0000 7fdad3fff640 1 --2- 172.21.15.79:0/3647672060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdadc0d2ca0 0x7fdadc0d09b0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fdac40097d0 tx=0x7fdac402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ddd02cbda52ebe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.921+0000 7fdada59c640 1 -- 172.21.15.79:0/3647672060 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4037070 con 0x7fdadc0d2ca0 2024-04-25T02:13:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.921+0000 7fdada59c640 1 -- 172.21.15.79:0/3647672060 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdac4032440 con 0x7fdadc0d2ca0 2024-04-25T02:13:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.921+0000 7fdada59c640 1 -- 172.21.15.79:0/3647672060 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4032810 con 0x7fdadc0d2ca0 2024-04-25T02:13:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.921+0000 7fdae1076640 1 -- 172.21.15.79:0/3647672060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdadc0d2ca0 msgr2=0x7fdadc0d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.921+0000 7fdae1076640 1 --2- 172.21.15.79:0/3647672060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdadc0d2ca0 0x7fdadc0d09b0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fdac40097d0 tx=0x7fdac402a1c0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.921+0000 7fdae1076640 1 -- 172.21.15.79:0/3647672060 shutdown_connections 2024-04-25T02:13:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.921+0000 7fdae1076640 1 --2- 172.21.15.79:0/3647672060 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdadc0d0ef0 0x7fdadc06bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.921+0000 7fdae1076640 1 --2- 172.21.15.79:0/3647672060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdadc0d2ca0 0x7fdadc0d09b0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.921+0000 7fdae1076640 1 -- 172.21.15.79:0/3647672060 >> 172.21.15.79:0/3647672060 conn(0x7fdadc09d4a0 msgr2=0x7fdadc0d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.921+0000 7fdae1076640 1 -- 172.21.15.79:0/3647672060 shutdown_connections 2024-04-25T02:13:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.921+0000 7fdae1076640 1 -- 172.21.15.79:0/3647672060 wait complete. 2024-04-25T02:13:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.923+0000 7fdae1076640 1 Processor -- start 2024-04-25T02:13:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.923+0000 7fdae1076640 1 -- start start 2024-04-25T02:13:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.923+0000 7fdae1076640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdadc0d0ef0 0x7fdadc0cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.923+0000 7fdae1076640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdadc0d2ca0 0x7fdadc0cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.923+0000 7fdae1076640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdadc15e4f0 0x7fdadc1f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.923+0000 7fdae1076640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc0d4ee0 con 0x7fdadc0d2ca0 2024-04-25T02:13:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.923+0000 7fdae1076640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc0cff00 con 0x7fdadc0d0ef0 2024-04-25T02:13:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.923+0000 7fdae1076640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdadc0d5060 con 0x7fdadc15e4f0 2024-04-25T02:13:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.923+0000 7fdad3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdadc0d2ca0 0x7fdadc0cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdad3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdadc0d2ca0 0x7fdadc0cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35296/0 (socket says 172.21.15.79:35296) 2024-04-25T02:13:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdad3fff640 1 -- 172.21.15.79:0/3536712152 learned_addr learned my addr 172.21.15.79:0/3536712152 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdadb59e640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdadc15e4f0 0x7fdadc1f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdadad9d640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdadc0d0ef0 0x7fdadc0cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdad3fff640 1 -- 172.21.15.79:0/3536712152 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdadc15e4f0 msgr2=0x7fdadc1f3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdad3fff640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdadc15e4f0 0x7fdadc1f3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdad3fff640 1 -- 172.21.15.79:0/3536712152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdadc0d0ef0 msgr2=0x7fdadc0cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdad3fff640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdadc0d0ef0 0x7fdadc0cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdad3fff640 1 -- 172.21.15.79:0/3536712152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdadc0cc740 con 0x7fdadc0d2ca0 2024-04-25T02:13:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdadb59e640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdadc15e4f0 0x7fdadc1f3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdadad9d640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdadc0d0ef0 0x7fdadc0cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdad3fff640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdadc0d2ca0 0x7fdadc0cbc00 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fdac40098f0 tx=0x7fdac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdad37fe640 1 -- 172.21.15.79:0/3536712152 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4037040 con 0x7fdadc0d2ca0 2024-04-25T02:13:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdad37fe640 1 -- 172.21.15.79:0/3536712152 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdac4042070 con 0x7fdadc0d2ca0 2024-04-25T02:13:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdae1076640 1 -- 172.21.15.79:0/3536712152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdadc0cca20 con 0x7fdadc0d2ca0 2024-04-25T02:13:53.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdad37fe640 1 -- 172.21.15.79:0/3536712152 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4030bd0 con 0x7fdadc0d2ca0 2024-04-25T02:13:53.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.924+0000 7fdae1076640 1 -- 172.21.15.79:0/3536712152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdadc0cc140 con 0x7fdadc0d2ca0 2024-04-25T02:13:53.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.925+0000 7fdae1076640 1 -- 172.21.15.79:0/3536712152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdadc0686c0 con 0x7fdadc0d2ca0 2024-04-25T02:13:53.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.926+0000 7fdad37fe640 1 -- 172.21.15.79:0/3536712152 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdac4047460 con 0x7fdadc0d2ca0 2024-04-25T02:13:53.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.926+0000 7fdad37fe640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdabc06be30 0x7fdabc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:53.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.926+0000 7fdadad9d640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdabc06be30 0x7fdabc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:53.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.926+0000 7fdad37fe640 1 -- 172.21.15.79:0/3536712152 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fdac40abb50 con 0x7fdadc0d2ca0 2024-04-25T02:13:53.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.926+0000 7fdadad9d640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdabc06be30 0x7fdabc06e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdacc000f60 tx=0x7fdacc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:53.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:53.930+0000 7fdad37fe640 1 -- 172.21.15.79:0/3536712152 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdac4032e20 con 0x7fdadc0d2ca0 2024-04-25T02:13:54.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.140+0000 7fdae1076640 1 -- 172.21.15.79:0/3536712152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fdadc0690a0 con 0x7fdadc0d2ca0 2024-04-25T02:13:54.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.598+0000 7fdad37fe640 1 -- 172.21.15.79:0/3536712152 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v50) ==== 162+0+0 (secure 0 0 0) 0x7fdac407a4a0 con 0x7fdadc0d2ca0 2024-04-25T02:13:54.622 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T02:13:54.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.600+0000 7fdae1076640 1 -- 172.21.15.79:0/3536712152 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdabc06be30 msgr2=0x7fdabc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:54.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.600+0000 7fdae1076640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdabc06be30 0x7fdabc06e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdacc000f60 tx=0x7fdacc009040 comp rx=0 tx=0).stop 2024-04-25T02:13:54.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.600+0000 7fdae1076640 1 -- 172.21.15.79:0/3536712152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdadc0d2ca0 msgr2=0x7fdadc0cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:54.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.600+0000 7fdae1076640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdadc0d2ca0 0x7fdadc0cbc00 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fdac40098f0 tx=0x7fdac40046c0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.600+0000 7fdae1076640 1 -- 172.21.15.79:0/3536712152 shutdown_connections 2024-04-25T02:13:54.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.600+0000 7fdae1076640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdabc06be30 0x7fdabc06e2f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.600+0000 7fdae1076640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdadc15e4f0 0x7fdadc1f3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.600+0000 7fdae1076640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdadc0d2ca0 0x7fdadc0cbc00 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.600+0000 7fdae1076640 1 --2- 172.21.15.79:0/3536712152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdadc0d0ef0 0x7fdadc0cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.600+0000 7fdae1076640 1 -- 172.21.15.79:0/3536712152 >> 172.21.15.79:0/3536712152 conn(0x7fdadc09d4a0 msgr2=0x7fdadc0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:54.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.600+0000 7fdae1076640 1 -- 172.21.15.79:0/3536712152 shutdown_connections 2024-04-25T02:13:54.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.600+0000 7fdae1076640 1 -- 172.21.15.79:0/3536712152 wait complete. 2024-04-25T02:13:54.625 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:13:54.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.715+0000 7f93f166d640 1 Processor -- start 2024-04-25T02:13:54.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.715+0000 7f93f166d640 1 -- start start 2024-04-25T02:13:54.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.716+0000 7f93f166d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93ec144cb0 0x7f93ec0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:54.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.716+0000 7f93f166d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f93ec0b5580 0x7f93ec06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.716+0000 7f93f166d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f93ec06e490 0x7f93ec15fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.716+0000 7f93f166d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f93ec06e900 con 0x7f93ec06e490 2024-04-25T02:13:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.716+0000 7f93f166d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f93ec070d90 con 0x7f93ec0b5580 2024-04-25T02:13:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.716+0000 7f93f166d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f93ec0cf130 con 0x7f93ec144cb0 2024-04-25T02:13:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.716+0000 7f93eb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f93ec06e490 0x7f93ec15fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.716+0000 7f93eb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f93ec06e490 0x7f93ec15fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35308/0 (socket says 172.21.15.79:35308) 2024-04-25T02:13:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.716+0000 7f93eb7fe640 1 -- 172.21.15.79:0/3443998321 learned_addr learned my addr 172.21.15.79:0/3443998321 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.717+0000 7f93eb7fe640 1 -- 172.21.15.79:0/3443998321 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93ec144cb0 msgr2=0x7f93ec0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.717+0000 7f93eaffd640 1 --2- 172.21.15.79:0/3443998321 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93ec144cb0 0x7f93ec0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.717+0000 7f93ea7fc640 1 --2- 172.21.15.79:0/3443998321 >> v2:172.21.15.189:3300/0 conn(0x7f93ec0b5580 0x7f93ec06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.717+0000 7f93eb7fe640 1 --2- 172.21.15.79:0/3443998321 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93ec144cb0 0x7f93ec0b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.717+0000 7f93eb7fe640 1 -- 172.21.15.79:0/3443998321 >> v2:172.21.15.189:3300/0 conn(0x7f93ec0b5580 msgr2=0x7f93ec06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.717+0000 7f93eb7fe640 1 --2- 172.21.15.79:0/3443998321 >> v2:172.21.15.189:3300/0 conn(0x7f93ec0b5580 0x7f93ec06df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.717+0000 7f93eb7fe640 1 -- 172.21.15.79:0/3443998321 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec0cf410 con 0x7f93ec06e490 2024-04-25T02:13:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.717+0000 7f93eaffd640 1 --2- 172.21.15.79:0/3443998321 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93ec144cb0 0x7f93ec0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.717+0000 7f93ea7fc640 1 --2- 172.21.15.79:0/3443998321 >> v2:172.21.15.189:3300/0 conn(0x7f93ec0b5580 0x7f93ec06df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.717+0000 7f93eb7fe640 1 --2- 172.21.15.79:0/3443998321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93ec06e490 0x7f93ec15fc10 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0b2a80 tx=0x7f93e402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62365dd435f9924 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.717+0000 7f93e9ffb640 1 -- 172.21.15.79:0/3443998321 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4037070 con 0x7f93ec06e490 2024-04-25T02:13:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.718+0000 7f93e9ffb640 1 -- 172.21.15.79:0/3443998321 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e402ae00 con 0x7f93ec06e490 2024-04-25T02:13:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.718+0000 7f93e9ffb640 1 -- 172.21.15.79:0/3443998321 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4032660 con 0x7f93ec06e490 2024-04-25T02:13:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.718+0000 7f93f166d640 1 -- 172.21.15.79:0/3443998321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93ec06e490 msgr2=0x7f93ec15fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.718+0000 7f93f166d640 1 --2- 172.21.15.79:0/3443998321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93ec06e490 0x7f93ec15fc10 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0b2a80 tx=0x7f93e402a0b0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.718+0000 7f93f166d640 1 -- 172.21.15.79:0/3443998321 shutdown_connections 2024-04-25T02:13:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.718+0000 7f93f166d640 1 --2- 172.21.15.79:0/3443998321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93ec06e490 0x7f93ec15fc10 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.718+0000 7f93f166d640 1 --2- 172.21.15.79:0/3443998321 >> v2:172.21.15.189:3300/0 conn(0x7f93ec0b5580 0x7f93ec06df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.718+0000 7f93f166d640 1 --2- 172.21.15.79:0/3443998321 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93ec144cb0 0x7f93ec0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.718+0000 7f93f166d640 1 -- 172.21.15.79:0/3443998321 >> 172.21.15.79:0/3443998321 conn(0x7f93ec0cfc80 msgr2=0x7f93ec0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.718+0000 7f93f166d640 1 -- 172.21.15.79:0/3443998321 shutdown_connections 2024-04-25T02:13:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.718+0000 7f93f166d640 1 -- 172.21.15.79:0/3443998321 wait complete. 2024-04-25T02:13:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.719+0000 7f93f166d640 1 Processor -- start 2024-04-25T02:13:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.719+0000 7f93f166d640 1 -- start start 2024-04-25T02:13:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.720+0000 7f93f166d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93ec06e490 0x7f93ec1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.720+0000 7f93f166d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93ec0b5580 0x7f93ec156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.720+0000 7f93f166d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93ec144cb0 0x7f93ec1573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.720+0000 7f93f166d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec145090 con 0x7f93ec144cb0 2024-04-25T02:13:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.720+0000 7f93f166d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec0cf9d0 con 0x7f93ec06e490 2024-04-25T02:13:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.720+0000 7f93f166d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f93ec145ab0 con 0x7f93ec0b5580 2024-04-25T02:13:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.720+0000 7f93eb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93ec144cb0 0x7f93ec1573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.720+0000 7f93eb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93ec144cb0 0x7f93ec1573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35312/0 (socket says 172.21.15.79:35312) 2024-04-25T02:13:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.720+0000 7f93eb7fe640 1 -- 172.21.15.79:0/1444349962 learned_addr learned my addr 172.21.15.79:0/1444349962 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.720+0000 7f93eaffd640 1 --2- 172.21.15.79:0/1444349962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93ec06e490 0x7f93ec1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.720+0000 7f93eb7fe640 1 -- 172.21.15.79:0/1444349962 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93ec0b5580 msgr2=0x7f93ec156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.720+0000 7f93eb7fe640 1 --2- 172.21.15.79:0/1444349962 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93ec0b5580 0x7f93ec156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.720+0000 7f93eb7fe640 1 -- 172.21.15.79:0/1444349962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93ec06e490 msgr2=0x7f93ec1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.720+0000 7f93eb7fe640 1 --2- 172.21.15.79:0/1444349962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93ec06e490 0x7f93ec1548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.720+0000 7f93eb7fe640 1 -- 172.21.15.79:0/1444349962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec141720 con 0x7f93ec144cb0 2024-04-25T02:13:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.721+0000 7f93eb7fe640 1 --2- 172.21.15.79:0/1444349962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93ec144cb0 0x7f93ec1573a0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f93e402a0f0 tx=0x7f93e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.721+0000 7f93d37fe640 1 -- 172.21.15.79:0/1444349962 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4041030 con 0x7f93ec144cb0 2024-04-25T02:13:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.721+0000 7f93d37fe640 1 -- 172.21.15.79:0/1444349962 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e403c670 con 0x7f93ec144cb0 2024-04-25T02:13:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.721+0000 7f93f166d640 1 -- 172.21.15.79:0/1444349962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93ec141a00 con 0x7f93ec144cb0 2024-04-25T02:13:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.721+0000 7f93d37fe640 1 -- 172.21.15.79:0/1444349962 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4037040 con 0x7f93ec144cb0 2024-04-25T02:13:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.721+0000 7f93f166d640 1 -- 172.21.15.79:0/1444349962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93ec1553a0 con 0x7f93ec144cb0 2024-04-25T02:13:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.722+0000 7f93f166d640 1 -- 172.21.15.79:0/1444349962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93ec0cde60 con 0x7f93ec144cb0 2024-04-25T02:13:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.722+0000 7f93d37fe640 1 -- 172.21.15.79:0/1444349962 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93e4044070 con 0x7f93ec144cb0 2024-04-25T02:13:54.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.722+0000 7f93d37fe640 1 --2- 172.21.15.79:0/1444349962 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f93d806be30 0x7f93d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:54.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.723+0000 7f93d37fe640 1 -- 172.21.15.79:0/1444349962 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f93e40ab3a0 con 0x7f93ec144cb0 2024-04-25T02:13:54.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.723+0000 7f93eaffd640 1 --2- 172.21.15.79:0/1444349962 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f93d806be30 0x7f93d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:54.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.723+0000 7f93eaffd640 1 --2- 172.21.15.79:0/1444349962 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f93d806be30 0x7f93d806e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f93dc008ee0 tx=0x7f93dc008430 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:54.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.727+0000 7f93d37fe640 1 -- 172.21.15.79:0/1444349962 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f93ec0cde60 con 0x7f93ec144cb0 2024-04-25T02:13:54.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.936+0000 7f93f166d640 1 -- 172.21.15.79:0/1444349962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93ec0690a0 con 0x7f93ec144cb0 2024-04-25T02:13:54.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.937+0000 7f93d37fe640 1 -- 172.21.15.79:0/1444349962 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5180 (secure 0 0 0) 0x7f93e4079d80 con 0x7f93ec144cb0 2024-04-25T02:13:54.943 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:54.943 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:13:54.601006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":51,"state":"up:replay","state_seq":1,"addr":"172.21.15.79:6837/630320044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":630320044},{"type":"v1","addr":"172.21.15.79:6837","nonce":630320044}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-04-25T02:13:54.944 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 51 2024-04-25T02:13:54.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.939+0000 7f93f166d640 1 -- 172.21.15.79:0/1444349962 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f93d806be30 msgr2=0x7f93d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:54.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.939+0000 7f93f166d640 1 --2- 172.21.15.79:0/1444349962 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f93d806be30 0x7f93d806e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f93dc008ee0 tx=0x7f93dc008430 comp rx=0 tx=0).stop 2024-04-25T02:13:54.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.939+0000 7f93f166d640 1 -- 172.21.15.79:0/1444349962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93ec144cb0 msgr2=0x7f93ec1573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:54.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.939+0000 7f93f166d640 1 --2- 172.21.15.79:0/1444349962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93ec144cb0 0x7f93ec1573a0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f93e402a0f0 tx=0x7f93e40046c0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.939+0000 7f93f166d640 1 -- 172.21.15.79:0/1444349962 shutdown_connections 2024-04-25T02:13:54.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.939+0000 7f93f166d640 1 --2- 172.21.15.79:0/1444349962 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f93d806be30 0x7f93d806e2f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.939+0000 7f93f166d640 1 --2- 172.21.15.79:0/1444349962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93ec144cb0 0x7f93ec1573a0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.939+0000 7f93f166d640 1 --2- 172.21.15.79:0/1444349962 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f93ec0b5580 0x7f93ec156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.939+0000 7f93f166d640 1 --2- 172.21.15.79:0/1444349962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93ec06e490 0x7f93ec1548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:54.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.939+0000 7f93f166d640 1 -- 172.21.15.79:0/1444349962 >> 172.21.15.79:0/1444349962 conn(0x7f93ec0cfc80 msgr2=0x7f93ec0b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:54.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.939+0000 7f93f166d640 1 -- 172.21.15.79:0/1444349962 shutdown_connections 2024-04-25T02:13:54.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:54.939+0000 7f93f166d640 1 -- 172.21.15.79:0/1444349962 wait complete. 2024-04-25T02:13:55.358 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:13:43.382458+0000', 'modified': '2024-04-25T02:13:54.601006+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 87, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7602}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7602': {'gid': 7602, 'name': 'a', 'rank': 0, 'incarnation': 51, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.79:6837/630320044', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 630320044}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 630320044}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T02:13:55.359 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7602:up:replay 2024-04-25T02:13:56.359 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:13:56.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.462+0000 7f8fee79e640 1 Processor -- start 2024-04-25T02:13:56.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.462+0000 7f8fee79e640 1 -- start start 2024-04-25T02:13:56.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.463+0000 7f8fee79e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8fe806d810 0x7f8fe815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:56.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.463+0000 7f8fee79e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fe815aac0 con 0x7f8fe815e5f0 2024-04-25T02:13:56.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.463+0000 7f8fee79e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fe815eb70 con 0x7f8fe806d430 2024-04-25T02:13:56.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.463+0000 7f8fee79e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f8fe815ee50 con 0x7f8fe806d810 2024-04-25T02:13:56.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.463+0000 7f8fedf9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8fe815e5f0 0x7f8fe80b2bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33388/0 (socket says 172.21.15.79:33388) 2024-04-25T02:13:56.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.463+0000 7f8fedf9d640 1 -- 172.21.15.79:0/2939222933 learned_addr learned my addr 172.21.15.79:0/2939222933 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:13:56.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fecf9b640 1 --2- 172.21.15.79:0/2939222933 >> v2:172.21.15.189:3300/0 conn(0x7f8fe806d810 0x7f8fe815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:56.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fdffff640 1 -- 172.21.15.79:0/2939222933 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2730407648 0 0) 0x7f8fe0001110 con 0x7f8fe815e5f0 2024-04-25T02:13:56.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fdffff640 1 -- 172.21.15.79:0/2939222933 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fd4003520 con 0x7f8fe815e5f0 2024-04-25T02:13:56.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fdffff640 1 -- 172.21.15.79:0/2939222933 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2316288280 0 0) 0x7f8fd4003520 con 0x7f8fe815e5f0 2024-04-25T02:13:56.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fdffff640 1 -- 172.21.15.79:0/2939222933 >> v2:172.21.15.189:3300/0 conn(0x7f8fe806d810 msgr2=0x7f8fe815e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:56.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fdffff640 1 --2- 172.21.15.79:0/2939222933 >> v2:172.21.15.189:3300/0 conn(0x7f8fe806d810 0x7f8fe815e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fdffff640 1 -- 172.21.15.79:0/2939222933 >> v1:172.21.15.189:6789/0 conn(0x7f8fe806d430 legacy=0x7f8fe815b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fdffff640 1 -- 172.21.15.79:0/2939222933 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe815ad40 con 0x7f8fe815e5f0 2024-04-25T02:13:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fdffff640 1 -- 172.21.15.79:0/2939222933 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f8fe0001840 con 0x7f8fe815e5f0 2024-04-25T02:13:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fecf9b640 1 --2- 172.21.15.79:0/2939222933 >> v2:172.21.15.189:3300/0 conn(0x7f8fe806d810 0x7f8fe815e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:13:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fdffff640 1 -- 172.21.15.79:0/2939222933 >> v1:172.21.15.79:6789/0 conn(0x7f8fe815e5f0 legacy=0x7f8fe80b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fdffff640 1 --2- 172.21.15.79:0/2939222933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd40039b0 0x7f8fd4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fdffff640 1 --2- 172.21.15.79:0/2939222933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fd4004800 0x7f8fd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fdffff640 1 --2- 172.21.15.79:0/2939222933 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fd40051c0 0x7f8fd400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fdffff640 1 -- 172.21.15.79:0/2939222933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe815ee50 con 0x7f8fd40039b0 2024-04-25T02:13:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fdffff640 1 -- 172.21.15.79:0/2939222933 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd400e270 con 0x7f8fd4004800 2024-04-25T02:13:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fdffff640 1 -- 172.21.15.79:0/2939222933 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd400e470 con 0x7f8fd40051c0 2024-04-25T02:13:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fed79c640 1 --2- 172.21.15.79:0/2939222933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd40039b0 0x7f8fd4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fecf9b640 1 --2- 172.21.15.79:0/2939222933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fd4004800 0x7f8fd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fedf9d640 1 --2- 172.21.15.79:0/2939222933 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fd40051c0 0x7f8fd400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fed79c640 1 -- 172.21.15.79:0/2939222933 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fd40051c0 msgr2=0x7f8fd400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:56.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fed79c640 1 --2- 172.21.15.79:0/2939222933 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fd40051c0 0x7f8fd400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:56.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fed79c640 1 -- 172.21.15.79:0/2939222933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fd4004800 msgr2=0x7f8fd4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:56.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fed79c640 1 --2- 172.21.15.79:0/2939222933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fd4004800 0x7f8fd4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:56.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fed79c640 1 -- 172.21.15.79:0/2939222933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd4003520 con 0x7f8fd40039b0 2024-04-25T02:13:56.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.464+0000 7f8fedf9d640 1 -- 172.21.15.79:0/2939222933 reap_dead start 2024-04-25T02:13:56.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.465+0000 7f8fed79c640 1 --2- 172.21.15.79:0/2939222933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd40039b0 0x7f8fd4003dd0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4001e50 tx=0x7f8fd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74688b31a5745075 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:56.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.465+0000 7f8fdffff640 1 -- 172.21.15.79:0/2939222933 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4001a70 con 0x7f8fd40039b0 2024-04-25T02:13:56.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.465+0000 7f8fdffff640 1 -- 172.21.15.79:0/2939222933 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe402ae40 con 0x7f8fd40039b0 2024-04-25T02:13:56.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.465+0000 7f8fdffff640 1 -- 172.21.15.79:0/2939222933 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4003bb0 con 0x7f8fd40039b0 2024-04-25T02:13:56.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.466+0000 7f8fee79e640 1 -- 172.21.15.79:0/2939222933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd40039b0 msgr2=0x7f8fd4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:56.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.466+0000 7f8fee79e640 1 --2- 172.21.15.79:0/2939222933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd40039b0 0x7f8fd4003dd0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4001e50 tx=0x7f8fd4005830 comp rx=0 tx=0).stop 2024-04-25T02:13:56.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.466+0000 7f8fee79e640 1 -- 172.21.15.79:0/2939222933 shutdown_connections 2024-04-25T02:13:56.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.466+0000 7f8fee79e640 1 --2- 172.21.15.79:0/2939222933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd40039b0 0x7f8fd4003dd0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:56.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.466+0000 7f8fee79e640 1 -- 172.21.15.79:0/2939222933 >> 172.21.15.79:0/2939222933 conn(0x7f8fe80b18b0 msgr2=0x7f8fe80b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:56.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.466+0000 7f8fee79e640 1 -- 172.21.15.79:0/2939222933 shutdown_connections 2024-04-25T02:13:56.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.466+0000 7f8fee79e640 1 -- 172.21.15.79:0/2939222933 wait complete. 2024-04-25T02:13:56.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.467+0000 7f8fee79e640 1 Processor -- start 2024-04-25T02:13:56.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.467+0000 7f8fee79e640 1 -- start start 2024-04-25T02:13:56.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fee79e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fd40039b0 0x7f8fe80aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:56.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fee79e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fe80ad8e0 0x7f8fe81f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:56.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fee79e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fe814f8f0 0x7f8fe815be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:56.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fee79e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe80cf440 con 0x7f8fe80ad8e0 2024-04-25T02:13:56.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fee79e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe8158480 con 0x7f8fe814f8f0 2024-04-25T02:13:56.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fee79e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe806dc70 con 0x7f8fd40039b0 2024-04-25T02:13:56.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fecf9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fe80ad8e0 0x7f8fe81f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:56.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fecf9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fe80ad8e0 0x7f8fe81f49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35334/0 (socket says 172.21.15.79:35334) 2024-04-25T02:13:56.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fecf9b640 1 -- 172.21.15.79:0/3680832181 learned_addr learned my addr 172.21.15.79:0/3680832181 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:56.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fedf9d640 1 --2- 172.21.15.79:0/3680832181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fe814f8f0 0x7f8fe815be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:56.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fed79c640 1 --2- 172.21.15.79:0/3680832181 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fd40039b0 0x7f8fe80aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:56.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fecf9b640 1 -- 172.21.15.79:0/3680832181 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fd40039b0 msgr2=0x7f8fe80aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:56.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fecf9b640 1 --2- 172.21.15.79:0/3680832181 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fd40039b0 0x7f8fe80aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:56.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fecf9b640 1 -- 172.21.15.79:0/3680832181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fe814f8f0 msgr2=0x7f8fe815be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:56.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fecf9b640 1 --2- 172.21.15.79:0/3680832181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fe814f8f0 0x7f8fe815be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:56.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fecf9b640 1 -- 172.21.15.79:0/3680832181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe815b820 con 0x7f8fe80ad8e0 2024-04-25T02:13:56.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.468+0000 7f8fed79c640 1 --2- 172.21.15.79:0/3680832181 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fd40039b0 0x7f8fe80aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:56.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.469+0000 7f8fecf9b640 1 --2- 172.21.15.79:0/3680832181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fe80ad8e0 0x7f8fe81f49e0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80109c0 tx=0x7f8fd8010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:56.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.469+0000 7f8fddffb640 1 -- 172.21.15.79:0/3680832181 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8019070 con 0x7f8fe80ad8e0 2024-04-25T02:13:56.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.469+0000 7f8fddffb640 1 -- 172.21.15.79:0/3680832181 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd800ed20 con 0x7f8fe80ad8e0 2024-04-25T02:13:56.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.469+0000 7f8fee79e640 1 -- 172.21.15.79:0/3680832181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe80addc0 con 0x7f8fe80ad8e0 2024-04-25T02:13:56.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.469+0000 7f8fddffb640 1 -- 172.21.15.79:0/3680832181 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd800b040 con 0x7f8fe80ad8e0 2024-04-25T02:13:56.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.469+0000 7f8fee79e640 1 -- 172.21.15.79:0/3680832181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe80ae380 con 0x7f8fe80ad8e0 2024-04-25T02:13:56.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.470+0000 7f8fee79e640 1 -- 172.21.15.79:0/3680832181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fe804f5e0 con 0x7f8fe80ad8e0 2024-04-25T02:13:56.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.470+0000 7f8fddffb640 1 -- 172.21.15.79:0/3680832181 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8fd801c070 con 0x7f8fe80ad8e0 2024-04-25T02:13:56.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.471+0000 7f8fddffb640 1 --2- 172.21.15.79:0/3680832181 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8fcc06be60 0x7f8fcc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:56.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.471+0000 7f8fed79c640 1 --2- 172.21.15.79:0/3680832181 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8fcc06be60 0x7f8fcc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:56.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.471+0000 7f8fddffb640 1 -- 172.21.15.79:0/3680832181 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f8fd808b180 con 0x7f8fe80ad8e0 2024-04-25T02:13:56.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.471+0000 7f8fed79c640 1 --2- 172.21.15.79:0/3680832181 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8fcc06be60 0x7f8fcc06e320 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4032000 tx=0x7f8fe402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:56.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.475+0000 7f8fddffb640 1 -- 172.21.15.79:0/3680832181 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8fd8023030 con 0x7f8fe80ad8e0 2024-04-25T02:13:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.688+0000 7f8fee79e640 1 -- 172.21.15.79:0/3680832181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8fe806e030 con 0x7f8fe80ad8e0 2024-04-25T02:13:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.688+0000 7f8fddffb640 1 -- 172.21.15.79:0/3680832181 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5180 (secure 0 0 0) 0x7f8fd8059b60 con 0x7f8fe80ad8e0 2024-04-25T02:13:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:56.695 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:13:55.606939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":51,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.79:6837/630320044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":630320044},{"type":"v1","addr":"172.21.15.79:6837","nonce":630320044}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-04-25T02:13:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 53 2024-04-25T02:13:56.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.690+0000 7f8fee79e640 1 -- 172.21.15.79:0/3680832181 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8fcc06be60 msgr2=0x7f8fcc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:56.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.690+0000 7f8fee79e640 1 --2- 172.21.15.79:0/3680832181 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8fcc06be60 0x7f8fcc06e320 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4032000 tx=0x7f8fe402e000 comp rx=0 tx=0).stop 2024-04-25T02:13:56.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.690+0000 7f8fee79e640 1 -- 172.21.15.79:0/3680832181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fe80ad8e0 msgr2=0x7f8fe81f49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:56.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.690+0000 7f8fee79e640 1 --2- 172.21.15.79:0/3680832181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fe80ad8e0 0x7f8fe81f49e0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80109c0 tx=0x7f8fd8010dc0 comp rx=0 tx=0).stop 2024-04-25T02:13:56.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.690+0000 7f8fee79e640 1 -- 172.21.15.79:0/3680832181 shutdown_connections 2024-04-25T02:13:56.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.690+0000 7f8fee79e640 1 --2- 172.21.15.79:0/3680832181 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8fcc06be60 0x7f8fcc06e320 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:56.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.690+0000 7f8fee79e640 1 --2- 172.21.15.79:0/3680832181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fe814f8f0 0x7f8fe815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:56.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.690+0000 7f8fee79e640 1 --2- 172.21.15.79:0/3680832181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fe80ad8e0 0x7f8fe81f49e0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:56.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.690+0000 7f8fee79e640 1 --2- 172.21.15.79:0/3680832181 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8fd40039b0 0x7f8fe80aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:56.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.690+0000 7f8fee79e640 1 -- 172.21.15.79:0/3680832181 >> 172.21.15.79:0/3680832181 conn(0x7f8fe80b18b0 msgr2=0x7f8fe80cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:56.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.690+0000 7f8fee79e640 1 -- 172.21.15.79:0/3680832181 shutdown_connections 2024-04-25T02:13:56.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:56.690+0000 7f8fee79e640 1 -- 172.21.15.79:0/3680832181 wait complete. 2024-04-25T02:13:57.109 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:13:43.382458+0000', 'modified': '2024-04-25T02:13:55.606939+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 87, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7602}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7602': {'gid': 7602, 'name': 'a', 'rank': 0, 'incarnation': 51, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.79:6837/630320044', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 630320044}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 630320044}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T02:13:57.109 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7602:up:rejoin 2024-04-25T02:13:58.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:13:58.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.212+0000 7efd643a9640 1 Processor -- start 2024-04-25T02:13:58.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.212+0000 7efd643a9640 1 -- start start 2024-04-25T02:13:58.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.213+0000 7efd643a9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd5c144cb0 0x7efd5c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.213+0000 7efd643a9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd5c06e660 0x7efd5c071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.213+0000 7efd643a9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd5c070d90 con 0x7efd5c0b5580 2024-04-25T02:13:58.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.213+0000 7efd643a9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7efd5c0cf130 con 0x7efd5c06e660 2024-04-25T02:13:58.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.213+0000 7efd643a9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efd5c0cf410 con 0x7efd5c144cb0 2024-04-25T02:13:58.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.213+0000 7efd62946640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd5c06e660 0x7efd5c071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.213+0000 7efd62946640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd5c06e660 0x7efd5c071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35336/0 (socket says 172.21.15.79:35336) 2024-04-25T02:13:58.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.213+0000 7efd62946640 1 -- 172.21.15.79:0/3785267154 learned_addr learned my addr 172.21.15.79:0/3785267154 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:58.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.213+0000 7efd62145640 1 --2- 172.21.15.79:0/3785267154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd5c144cb0 0x7efd5c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.213+0000 7efd62946640 1 -- 172.21.15.79:0/3785267154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd5c144cb0 msgr2=0x7efd5c0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:58.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.213+0000 7efd62946640 1 --2- 172.21.15.79:0/3785267154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd5c144cb0 0x7efd5c0b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.213+0000 7efd62946640 1 -- 172.21.15.79:0/3785267154 >> v1:172.21.15.189:6789/0 conn(0x7efd5c0b5580 legacy=0x7efd5c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:58.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.213+0000 7efd62946640 1 -- 172.21.15.79:0/3785267154 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c0cf6f0 con 0x7efd5c06e660 2024-04-25T02:13:58.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.214+0000 7efd62946640 1 --2- 172.21.15.79:0/3785267154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c06e660 0x7efd5c071240 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7efd54009e50 tx=0x7efd5402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300d22459c562d2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:58.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.214+0000 7efd61143640 1 -- 172.21.15.79:0/3785267154 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54036070 con 0x7efd5c06e660 2024-04-25T02:13:58.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.214+0000 7efd61143640 1 -- 172.21.15.79:0/3785267154 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd54031600 con 0x7efd5c06e660 2024-04-25T02:13:58.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.214+0000 7efd61143640 1 -- 172.21.15.79:0/3785267154 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd540319d0 con 0x7efd5c06e660 2024-04-25T02:13:58.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.214+0000 7efd643a9640 1 -- 172.21.15.79:0/3785267154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c06e660 msgr2=0x7efd5c071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:58.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.214+0000 7efd643a9640 1 --2- 172.21.15.79:0/3785267154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c06e660 0x7efd5c071240 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7efd54009e50 tx=0x7efd5402a5f0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.215+0000 7efd643a9640 1 -- 172.21.15.79:0/3785267154 shutdown_connections 2024-04-25T02:13:58.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.215+0000 7efd643a9640 1 --2- 172.21.15.79:0/3785267154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c06e660 0x7efd5c071240 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.215+0000 7efd643a9640 1 --2- 172.21.15.79:0/3785267154 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd5c144cb0 0x7efd5c0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.215+0000 7efd643a9640 1 -- 172.21.15.79:0/3785267154 >> 172.21.15.79:0/3785267154 conn(0x7efd5c0cfc80 msgr2=0x7efd5c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:58.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.215+0000 7efd643a9640 1 -- 172.21.15.79:0/3785267154 shutdown_connections 2024-04-25T02:13:58.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.215+0000 7efd643a9640 1 -- 172.21.15.79:0/3785267154 wait complete. 2024-04-25T02:13:58.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.216+0000 7efd643a9640 1 Processor -- start 2024-04-25T02:13:58.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.216+0000 7efd643a9640 1 -- start start 2024-04-25T02:13:58.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd643a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c06e660 0x7efd5c1406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd643a9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd5c0b5580 0x7efd5c1f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd643a9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd5c144cb0 0x7efd5c159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd643a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c145ab0 con 0x7efd5c06e660 2024-04-25T02:13:58.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd643a9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c145090 con 0x7efd5c0b5580 2024-04-25T02:13:58.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd643a9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efd5c145c30 con 0x7efd5c144cb0 2024-04-25T02:13:58.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd62145640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c06e660 0x7efd5c1406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd62145640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c06e660 0x7efd5c1406b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35346/0 (socket says 172.21.15.79:35346) 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd62145640 1 -- 172.21.15.79:0/961222020 learned_addr learned my addr 172.21.15.79:0/961222020 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd61944640 1 --2- 172.21.15.79:0/961222020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd5c0b5580 0x7efd5c1f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd62946640 1 --2- 172.21.15.79:0/961222020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd5c144cb0 0x7efd5c159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd62145640 1 -- 172.21.15.79:0/961222020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd5c144cb0 msgr2=0x7efd5c159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd62145640 1 --2- 172.21.15.79:0/961222020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd5c144cb0 0x7efd5c159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd62145640 1 -- 172.21.15.79:0/961222020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd5c0b5580 msgr2=0x7efd5c1f2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd62145640 1 --2- 172.21.15.79:0/961222020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd5c0b5580 0x7efd5c1f2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd62145640 1 -- 172.21.15.79:0/961222020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c15c2d0 con 0x7efd5c06e660 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd61944640 1 --2- 172.21.15.79:0/961222020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd5c0b5580 0x7efd5c1f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd62145640 1 --2- 172.21.15.79:0/961222020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c06e660 0x7efd5c1406b0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7efd5800d620 tx=0x7efd5800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd52ffd640 1 -- 172.21.15.79:0/961222020 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd580125f0 con 0x7efd5c06e660 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd52ffd640 1 -- 172.21.15.79:0/961222020 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd58019070 con 0x7efd5c06e660 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd52ffd640 1 -- 172.21.15.79:0/961222020 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd580129d0 con 0x7efd5c06e660 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd643a9640 1 -- 172.21.15.79:0/961222020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5c15c570 con 0x7efd5c06e660 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.217+0000 7efd643a9640 1 -- 172.21.15.79:0/961222020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5c140bf0 con 0x7efd5c06e660 2024-04-25T02:13:58.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.218+0000 7efd643a9640 1 -- 172.21.15.79:0/961222020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd5c0690a0 con 0x7efd5c06e660 2024-04-25T02:13:58.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.219+0000 7efd52ffd640 1 -- 172.21.15.79:0/961222020 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd58012b70 con 0x7efd5c06e660 2024-04-25T02:13:58.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.219+0000 7efd52ffd640 1 --2- 172.21.15.79:0/961222020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efd4006be30 0x7efd4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.219+0000 7efd52ffd640 1 -- 172.21.15.79:0/961222020 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7efd5808b300 con 0x7efd5c06e660 2024-04-25T02:13:58.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.219+0000 7efd61944640 1 --2- 172.21.15.79:0/961222020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efd4006be30 0x7efd4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.220+0000 7efd61944640 1 --2- 172.21.15.79:0/961222020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efd4006be30 0x7efd4006e2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7efd5c158e60 tx=0x7efd4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:58.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.223+0000 7efd52ffd640 1 -- 172.21.15.79:0/961222020 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efd58059bc0 con 0x7efd5c06e660 2024-04-25T02:13:58.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.435+0000 7efd643a9640 1 -- 172.21.15.79:0/961222020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd5c0d08e0 con 0x7efd5c06e660 2024-04-25T02:13:58.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.436+0000 7efd52ffd640 1 -- 172.21.15.79:0/961222020 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5187 (secure 0 0 0) 0x7efd580594c0 con 0x7efd5c06e660 2024-04-25T02:13:58.442 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:13:58.442 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:13:57.612292+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/630320044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":630320044},{"type":"v1","addr":"172.21.15.79:6837","nonce":630320044}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7602,"qdb_cluster":[7602]},"id":6}]} 2024-04-25T02:13:58.442 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 54 2024-04-25T02:13:58.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.438+0000 7efd643a9640 1 -- 172.21.15.79:0/961222020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efd4006be30 msgr2=0x7efd4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:58.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.438+0000 7efd643a9640 1 --2- 172.21.15.79:0/961222020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efd4006be30 0x7efd4006e2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7efd5c158e60 tx=0x7efd4c009040 comp rx=0 tx=0).stop 2024-04-25T02:13:58.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.438+0000 7efd643a9640 1 -- 172.21.15.79:0/961222020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c06e660 msgr2=0x7efd5c1406b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:58.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.438+0000 7efd643a9640 1 --2- 172.21.15.79:0/961222020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c06e660 0x7efd5c1406b0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7efd5800d620 tx=0x7efd5800dae0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.438+0000 7efd643a9640 1 -- 172.21.15.79:0/961222020 shutdown_connections 2024-04-25T02:13:58.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.438+0000 7efd643a9640 1 --2- 172.21.15.79:0/961222020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efd4006be30 0x7efd4006e2f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.438+0000 7efd643a9640 1 --2- 172.21.15.79:0/961222020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd5c144cb0 0x7efd5c159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.438+0000 7efd643a9640 1 --2- 172.21.15.79:0/961222020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd5c0b5580 0x7efd5c1f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.438+0000 7efd643a9640 1 --2- 172.21.15.79:0/961222020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c06e660 0x7efd5c1406b0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.438+0000 7efd643a9640 1 -- 172.21.15.79:0/961222020 >> 172.21.15.79:0/961222020 conn(0x7efd5c0cfc80 msgr2=0x7efd5c072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:58.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.438+0000 7efd643a9640 1 -- 172.21.15.79:0/961222020 shutdown_connections 2024-04-25T02:13:58.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.438+0000 7efd643a9640 1 -- 172.21.15.79:0/961222020 wait complete. 2024-04-25T02:13:58.857 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:13:43.382458+0000', 'modified': '2024-04-25T02:13:57.612292+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 87, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7602}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7602': {'gid': 7602, 'name': 'a', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.79:6837/630320044', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 630320044}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 630320044}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7602, 'qdb_cluster': [7602]} 2024-04-25T02:13:58.857 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:13:58.857 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T02:13:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.951+0000 7f151edee640 1 Processor -- start 2024-04-25T02:13:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.951+0000 7f151edee640 1 -- start start 2024-04-25T02:13:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151edee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1518144cb0 0x7f15180b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151edee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15180b5580 0x7f151806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151edee640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f151806e490 0x7f151815fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151edee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f151806e900 con 0x7f1518144cb0 2024-04-25T02:13:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151edee640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f1518070d90 con 0x7f151806e490 2024-04-25T02:13:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151edee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f15180cf130 con 0x7f15180b5580 2024-04-25T02:13:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151cb8a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1518144cb0 0x7f15180b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151cb8a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1518144cb0 0x7f15180b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35360/0 (socket says 172.21.15.79:35360) 2024-04-25T02:13:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151cb8a640 1 -- 172.21.15.79:0/2665015012 learned_addr learned my addr 172.21.15.79:0/2665015012 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151d38b640 1 --2- 172.21.15.79:0/2665015012 >> v2:172.21.15.189:3300/0 conn(0x7f151806e490 0x7f151815fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151cb8a640 1 -- 172.21.15.79:0/2665015012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15180b5580 msgr2=0x7f151806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f1517fff640 1 --2- 172.21.15.79:0/2665015012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15180b5580 0x7f151806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151cb8a640 1 --2- 172.21.15.79:0/2665015012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15180b5580 0x7f151806df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151cb8a640 1 -- 172.21.15.79:0/2665015012 >> v2:172.21.15.189:3300/0 conn(0x7f151806e490 msgr2=0x7f151815fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151cb8a640 1 --2- 172.21.15.79:0/2665015012 >> v2:172.21.15.189:3300/0 conn(0x7f151806e490 0x7f151815fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151cb8a640 1 -- 172.21.15.79:0/2665015012 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15180cf410 con 0x7f1518144cb0 2024-04-25T02:13:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f151d38b640 1 --2- 172.21.15.79:0/2665015012 >> v2:172.21.15.189:3300/0 conn(0x7f151806e490 0x7f151815fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.952+0000 7f1517fff640 1 --2- 172.21.15.79:0/2665015012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15180b5580 0x7f151806df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.953+0000 7f151cb8a640 1 --2- 172.21.15.79:0/2665015012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1518144cb0 0x7f15180b5040 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f1518070c80 tx=0x7f150c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ddb24fe656dd51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.953+0000 7f15177fe640 1 -- 172.21.15.79:0/2665015012 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c037070 con 0x7f1518144cb0 2024-04-25T02:13:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.953+0000 7f15177fe640 1 -- 172.21.15.79:0/2665015012 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c02ae00 con 0x7f1518144cb0 2024-04-25T02:13:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.953+0000 7f15177fe640 1 -- 172.21.15.79:0/2665015012 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c032660 con 0x7f1518144cb0 2024-04-25T02:13:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.953+0000 7f151edee640 1 -- 172.21.15.79:0/2665015012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1518144cb0 msgr2=0x7f15180b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.953+0000 7f151edee640 1 --2- 172.21.15.79:0/2665015012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1518144cb0 0x7f15180b5040 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f1518070c80 tx=0x7f150c02a0b0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.954+0000 7f151edee640 1 -- 172.21.15.79:0/2665015012 shutdown_connections 2024-04-25T02:13:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.954+0000 7f151edee640 1 --2- 172.21.15.79:0/2665015012 >> v2:172.21.15.189:3300/0 conn(0x7f151806e490 0x7f151815fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.954+0000 7f151edee640 1 --2- 172.21.15.79:0/2665015012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15180b5580 0x7f151806df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.954+0000 7f151edee640 1 --2- 172.21.15.79:0/2665015012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1518144cb0 0x7f15180b5040 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.954+0000 7f151edee640 1 -- 172.21.15.79:0/2665015012 >> 172.21.15.79:0/2665015012 conn(0x7f15180cfc80 msgr2=0x7f15180d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.954+0000 7f151edee640 1 -- 172.21.15.79:0/2665015012 shutdown_connections 2024-04-25T02:13:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.954+0000 7f151edee640 1 -- 172.21.15.79:0/2665015012 wait complete. 2024-04-25T02:13:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.955+0000 7f151edee640 1 Processor -- start 2024-04-25T02:13:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.955+0000 7f151edee640 1 -- start start 2024-04-25T02:13:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.955+0000 7f151edee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f151806e490 0x7f151813a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151edee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15180b5580 0x7f1518156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151edee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1518144cb0 0x7f1518157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151edee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1518145090 con 0x7f151806e490 2024-04-25T02:13:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151edee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f15180cf9d0 con 0x7f15180b5580 2024-04-25T02:13:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151edee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1518145ab0 con 0x7f1518144cb0 2024-04-25T02:13:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151cb8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f151806e490 0x7f151813a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151cb8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f151806e490 0x7f151813a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35370/0 (socket says 172.21.15.79:35370) 2024-04-25T02:13:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151cb8a640 1 -- 172.21.15.79:0/468980011 learned_addr learned my addr 172.21.15.79:0/468980011 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f1517fff640 1 --2- 172.21.15.79:0/468980011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15180b5580 0x7f1518156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151d38b640 1 --2- 172.21.15.79:0/468980011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1518144cb0 0x7f1518157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151cb8a640 1 -- 172.21.15.79:0/468980011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1518144cb0 msgr2=0x7f1518157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151cb8a640 1 --2- 172.21.15.79:0/468980011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1518144cb0 0x7f1518157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151cb8a640 1 -- 172.21.15.79:0/468980011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15180b5580 msgr2=0x7f1518156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151cb8a640 1 --2- 172.21.15.79:0/468980011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15180b5580 0x7f1518156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151cb8a640 1 -- 172.21.15.79:0/468980011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151813ad00 con 0x7f151806e490 2024-04-25T02:13:58.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151cb8a640 1 --2- 172.21.15.79:0/468980011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f151806e490 0x7f151813a7c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f150c02a0f0 tx=0x7f150c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:58.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f15157fa640 1 -- 172.21.15.79:0/468980011 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c041070 con 0x7f151806e490 2024-04-25T02:13:58.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f15157fa640 1 -- 172.21.15.79:0/468980011 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c03c670 con 0x7f151806e490 2024-04-25T02:13:58.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151edee640 1 -- 172.21.15.79:0/468980011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15181f5580 con 0x7f151806e490 2024-04-25T02:13:58.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f15157fa640 1 -- 172.21.15.79:0/468980011 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c037040 con 0x7f151806e490 2024-04-25T02:13:58.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.956+0000 7f151edee640 1 -- 172.21.15.79:0/468980011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15181f5b40 con 0x7f151806e490 2024-04-25T02:13:58.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.958+0000 7f15157fa640 1 -- 172.21.15.79:0/468980011 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f150c03a070 con 0x7f151806e490 2024-04-25T02:13:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.958+0000 7f15157fa640 1 --2- 172.21.15.79:0/468980011 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f14fc06be30 0x7f14fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.958+0000 7f15157fa640 1 -- 172.21.15.79:0/468980011 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f150c0aaf10 con 0x7f151806e490 2024-04-25T02:13:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.958+0000 7f1517fff640 1 --2- 172.21.15.79:0/468980011 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f14fc06be30 0x7f14fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.959+0000 7f1517fff640 1 --2- 172.21.15.79:0/468980011 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f14fc06be30 0x7f14fc06e2f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1518158740 tx=0x7f1504008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.959+0000 7f1521bd8740 1 Processor -- start 2024-04-25T02:13:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.959+0000 7f1521bd8740 1 -- start start 2024-04-25T02:13:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f1521bd8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620dfb60 0x5647620924f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f1521bd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 0x5647620c2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f1521bd8740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620c2540 0x564762097350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f1521bd8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564761ffaf00 con 0x5647620dfb60 2024-04-25T02:13:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f1521bd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564761fa3750 con 0x5647620c2c80 2024-04-25T02:13:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f1521bd8740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x564761ff6ec0 con 0x5647620c2540 2024-04-25T02:13:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f151cb8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620dfb60 0x5647620924f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f151cb8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620dfb60 0x5647620924f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35380/0 (socket says 172.21.15.79:35380) 2024-04-25T02:13:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f151cb8a640 1 -- 172.21.15.79:0/1398926494 learned_addr learned my addr 172.21.15.79:0/1398926494 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f151cb8a640 1 -- 172.21.15.79:0/1398926494 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620c2540 msgr2=0x564762097350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f151cb8a640 1 --2- 172.21.15.79:0/1398926494 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620c2540 0x564762097350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f151cb8a640 1 -- 172.21.15.79:0/1398926494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 msgr2=0x5647620c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f1517fff640 1 --2- 172.21.15.79:0/1398926494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 0x5647620c2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f151cb8a640 1 --2- 172.21.15.79:0/1398926494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 0x5647620c2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f151cb8a640 1 -- 172.21.15.79:0/1398926494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564761d0f2d0 con 0x5647620dfb60 2024-04-25T02:13:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f1517fff640 1 --2- 172.21.15.79:0/1398926494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 0x5647620c2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f151cb8a640 1 --2- 172.21.15.79:0/1398926494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620dfb60 0x5647620924f0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f150c0a93e0 tx=0x7f150c078df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2746abc6884787 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f15027fc640 1 -- 172.21.15.79:0/1398926494 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c04a070 con 0x5647620dfb60 2024-04-25T02:13:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f15027fc640 1 -- 172.21.15.79:0/1398926494 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c0791f0 con 0x5647620dfb60 2024-04-25T02:13:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.960+0000 7f15027fc640 1 -- 172.21.15.79:0/1398926494 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c07d5a0 con 0x5647620dfb60 2024-04-25T02:13:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.961+0000 7f1521bd8740 1 -- 172.21.15.79:0/1398926494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620dfb60 msgr2=0x5647620924f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.961+0000 7f1521bd8740 1 --2- 172.21.15.79:0/1398926494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620dfb60 0x5647620924f0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f150c0a93e0 tx=0x7f150c078df0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.961+0000 7f1521bd8740 1 -- 172.21.15.79:0/1398926494 shutdown_connections 2024-04-25T02:13:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.961+0000 7f1521bd8740 1 --2- 172.21.15.79:0/1398926494 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620c2540 0x564762097350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.961+0000 7f1521bd8740 1 --2- 172.21.15.79:0/1398926494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 0x5647620c2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.961+0000 7f1521bd8740 1 --2- 172.21.15.79:0/1398926494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620dfb60 0x5647620924f0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.961+0000 7f1521bd8740 1 -- 172.21.15.79:0/1398926494 >> 172.21.15.79:0/1398926494 conn(0x564762094760 msgr2=0x5647620dd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:58.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.961+0000 7f1521bd8740 1 -- 172.21.15.79:0/1398926494 shutdown_connections 2024-04-25T02:13:58.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.961+0000 7f1521bd8740 1 -- 172.21.15.79:0/1398926494 wait complete. 2024-04-25T02:13:58.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.961+0000 7f1521bd8740 1 -- start start 2024-04-25T02:13:58.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.962+0000 7f1521bd8740 1 Processor -- start 2024-04-25T02:13:58.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.962+0000 7f1521bd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 0x5647620b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.962+0000 7f1521bd8740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620dfb60 0x5647620c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.962+0000 7f1521bd8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x5647620de130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.962+0000 7f1521bd8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564761fa3750 con 0x5647620bdb00 2024-04-25T02:13:58.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.962+0000 7f1521bd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564761fb6cf0 con 0x5647620c2c80 2024-04-25T02:13:58.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.962+0000 7f1521bd8740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x564761ffaf00 con 0x5647620dfb60 2024-04-25T02:13:58.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f1521bd8740 10 client.0 _ll_register_callbacks cb 0x564761fb66e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:13:58.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f151d38b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x5647620de130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f151d38b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x5647620de130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35390/0 (socket says 172.21.15.79:35390) 2024-04-25T02:13:58.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f151d38b640 1 -- 172.21.15.79:0/913948248 learned_addr learned my addr 172.21.15.79:0/913948248 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:58.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f151cb8a640 1 --2- 172.21.15.79:0/913948248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 0x5647620b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f1517fff640 1 --2- 172.21.15.79:0/913948248 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620dfb60 0x5647620c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f151d38b640 1 -- 172.21.15.79:0/913948248 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620dfb60 msgr2=0x5647620c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:58.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f151d38b640 1 --2- 172.21.15.79:0/913948248 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620dfb60 0x5647620c4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f151d38b640 1 -- 172.21.15.79:0/913948248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 msgr2=0x5647620b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:58.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f151d38b640 1 --2- 172.21.15.79:0/913948248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 0x5647620b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f151d38b640 1 -- 172.21.15.79:0/913948248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564761dd96b0 con 0x5647620bdb00 2024-04-25T02:13:58.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f151d38b640 1 --2- 172.21.15.79:0/913948248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x5647620de130 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f151000db00 tx=0x7f1510008f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fbc9e46119b3a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:58.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f14f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:13:58.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f14f77fe640 1 -- 172.21.15.79:0/913948248 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151001a060 con 0x5647620bdb00 2024-04-25T02:13:58.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f14f77fe640 1 -- 172.21.15.79:0/913948248 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f151000bd20 con 0x5647620bdb00 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f1521bd8740 1 -- 172.21.15.79:0/913948248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f150c0791f0 con 0x5647620bdb00 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f14f77fe640 1 -- 172.21.15.79:0/913948248 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f1510020050 con 0x5647620bdb00 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f1521bd8740 10 client.7665 fetch_fsmap learned FSMap version 54 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f1521bd8740 1 -- 172.21.15.79:0/913948248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x5647620c5a60 con 0x5647620bdb00 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f14f77fe640 1 -- 172.21.15.79:0/913948248 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c0791f0 con 0x5647620bdb00 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f14f77fe640 1 -- 172.21.15.79:0/913948248 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7f1510023020 con 0x5647620bdb00 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f1521bd8740 10 client.7665 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f1521bd8740 10 client.7665 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.963+0000 7f1521bd8740 20 client.7665 populate_metadata read hostname 'smithi079' 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.964+0000 7f1521bd8740 1 --2- 172.21.15.79:0/913948248 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5647620d6c10 0x5647620c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.964+0000 7f1521bd8740 4 client.7665 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.964+0000 7f1521bd8740 1 -- 172.21.15.79:0/913948248 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564762008440 con 0x5647620d6c10 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.964+0000 7f151cb8a640 1 --2- 172.21.15.79:0/913948248 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5647620d6c10 0x5647620c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.964+0000 7f151cb8a640 1 --2- 172.21.15.79:0/913948248 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5647620d6c10 0x5647620c37d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=427987aae78ec191 server_cookie=751f119640fcd963 in_seq=0 out_seq=0 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.964+0000 7f14f77fe640 10 client.7665 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:13:58.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.964+0000 7f14f77fe640 1 -- 172.21.15.79:0/913948248 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564762008440 con 0x5647620d6c10 2024-04-25T02:13:58.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.964+0000 7f14f77fe640 10 client.7665 handle_command_reply: tid=0 2024-04-25T02:13:58.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.964+0000 7f1521bd8740 1 client.7665 shutdown 2024-04-25T02:13:58.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.965+0000 7f1521bd8740 1 -- 172.21.15.79:0/913948248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 msgr2=0x5647620de130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:58.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.965+0000 7f1521bd8740 1 --2- 172.21.15.79:0/913948248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x5647620de130 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f151000db00 tx=0x7f1510008f20 comp rx=0 tx=0).stop 2024-04-25T02:13:58.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.965+0000 7f1521bd8740 1 -- 172.21.15.79:0/913948248 shutdown_connections 2024-04-25T02:13:58.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.965+0000 7f1521bd8740 1 --2- 172.21.15.79:0/913948248 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5647620d6c10 0x5647620c37d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.965+0000 7f1521bd8740 1 --2- 172.21.15.79:0/913948248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x5647620de130 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.965+0000 7f1521bd8740 1 --2- 172.21.15.79:0/913948248 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620dfb60 0x5647620c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.965+0000 7f14f77fe640 0 client.7665 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:13:58.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.965+0000 7f1521bd8740 1 --2- 172.21.15.79:0/913948248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 0x5647620b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.965+0000 7f1521bd8740 1 -- 172.21.15.79:0/913948248 >> 172.21.15.79:0/913948248 conn(0x5647620c2540 msgr2=0x5647620dd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:58.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.965+0000 7f1521bd8740 1 -- 172.21.15.79:0/913948248 shutdown_connections 2024-04-25T02:13:58.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.965+0000 7f1521bd8740 1 -- 172.21.15.79:0/913948248 wait complete. 2024-04-25T02:13:58.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.965+0000 7f1521bd8740 20 client.7665 trim_cache size 0 max 16384 2024-04-25T02:13:58.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.983+0000 7f1521bd8740 1 Processor -- start 2024-04-25T02:13:58.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.983+0000 7f1521bd8740 1 -- start start 2024-04-25T02:13:58.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.983+0000 7f1521bd8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x564762150a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.983+0000 7f1521bd8740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620c2c80 0x5647620c3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.983+0000 7f1521bd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620dfb60 0x5647620c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.983+0000 7f1521bd8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1518156500 con 0x5647620bdb00 2024-04-25T02:13:58.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.983+0000 7f1521bd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f15181e6700 con 0x5647620dfb60 2024-04-25T02:13:58.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.983+0000 7f1521bd8740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1518155eb0 con 0x5647620c2c80 2024-04-25T02:13:58.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.983+0000 7f151cb8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x564762150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.983+0000 7f151cb8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x564762150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35394/0 (socket says 172.21.15.79:35394) 2024-04-25T02:13:58.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.983+0000 7f151cb8a640 1 -- 172.21.15.79:0/3497125295 learned_addr learned my addr 172.21.15.79:0/3497125295 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:58.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f151cb8a640 1 -- 172.21.15.79:0/3497125295 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620c2c80 msgr2=0x5647620c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:58.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f151cb8a640 1 --2- 172.21.15.79:0/3497125295 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620c2c80 0x5647620c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f151cb8a640 1 -- 172.21.15.79:0/3497125295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620dfb60 msgr2=0x5647620c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:58.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f151cb8a640 1 --2- 172.21.15.79:0/3497125295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620dfb60 0x5647620c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f151cb8a640 1 -- 172.21.15.79:0/3497125295 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647620de4a0 con 0x5647620bdb00 2024-04-25T02:13:58.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f151cb8a640 1 --2- 172.21.15.79:0/3497125295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x564762150a10 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f150c078ef0 tx=0x7f150c008000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471408c0cc4658a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:58.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f1501ffb640 1 -- 172.21.15.79:0/3497125295 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c096070 con 0x5647620bdb00 2024-04-25T02:13:58.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f1501ffb640 1 -- 172.21.15.79:0/3497125295 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c07d5a0 con 0x5647620bdb00 2024-04-25T02:13:58.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f1501ffb640 1 -- 172.21.15.79:0/3497125295 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c0774f0 con 0x5647620bdb00 2024-04-25T02:13:58.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f1521bd8740 1 -- 172.21.15.79:0/3497125295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 msgr2=0x564762150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:58.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f1521bd8740 1 --2- 172.21.15.79:0/3497125295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x564762150a10 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f150c078ef0 tx=0x7f150c008000 comp rx=0 tx=0).stop 2024-04-25T02:13:58.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f1521bd8740 1 -- 172.21.15.79:0/3497125295 shutdown_connections 2024-04-25T02:13:58.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f1521bd8740 1 --2- 172.21.15.79:0/3497125295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620dfb60 0x5647620c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f1521bd8740 1 --2- 172.21.15.79:0/3497125295 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620c2c80 0x5647620c3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f1521bd8740 1 --2- 172.21.15.79:0/3497125295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x564762150a10 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f1521bd8740 1 -- 172.21.15.79:0/3497125295 >> 172.21.15.79:0/3497125295 conn(0x5647620c2540 msgr2=0x56476208d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:58.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f1521bd8740 1 -- 172.21.15.79:0/3497125295 shutdown_connections 2024-04-25T02:13:58.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.984+0000 7f1521bd8740 1 -- 172.21.15.79:0/3497125295 wait complete. 2024-04-25T02:13:58.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.985+0000 7f1521bd8740 1 -- start start 2024-04-25T02:13:58.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.985+0000 7f1521bd8740 1 Processor -- start 2024-04-25T02:13:58.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f1521bd8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x5647620d5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f1521bd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 0x56476213f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f1521bd8740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620dfb60 0x56476213f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f1521bd8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5647620d6a90 con 0x5647620bdb00 2024-04-25T02:13:58.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f1521bd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5647620de7e0 con 0x5647620c2c80 2024-04-25T02:13:58.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f1521bd8740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5647620d70b0 con 0x5647620dfb60 2024-04-25T02:13:58.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f1521bd8740 10 client.0 _ll_register_callbacks cb 0x7f1510008e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:13:58.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f151cb8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x5647620d5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f151cb8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x5647620d5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35406/0 (socket says 172.21.15.79:35406) 2024-04-25T02:13:58.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f151cb8a640 1 -- 172.21.15.79:0/419168347 learned_addr learned my addr 172.21.15.79:0/419168347 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:58.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f151d38b640 1 --2- 172.21.15.79:0/419168347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620dfb60 0x56476213f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f1517fff640 1 --2- 172.21.15.79:0/419168347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 0x56476213f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f151cb8a640 1 -- 172.21.15.79:0/419168347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620dfb60 msgr2=0x56476213f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:58.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f151cb8a640 1 --2- 172.21.15.79:0/419168347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620dfb60 0x56476213f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f151cb8a640 1 -- 172.21.15.79:0/419168347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 msgr2=0x56476213f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:58.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f151cb8a640 1 --2- 172.21.15.79:0/419168347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 0x56476213f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f151cb8a640 1 -- 172.21.15.79:0/419168347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647620d6280 con 0x5647620bdb00 2024-04-25T02:13:58.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f151cb8a640 1 --2- 172.21.15.79:0/419168347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x5647620d5d40 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f150c075650 tx=0x7f150c04a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b360aef8564b42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:58.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.986+0000 7f14f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:13:58.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f14f77fe640 1 -- 172.21.15.79:0/419168347 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c09d060 con 0x5647620bdb00 2024-04-25T02:13:58.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f14f77fe640 1 -- 172.21.15.79:0/419168347 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f150c091170 con 0x5647620bdb00 2024-04-25T02:13:58.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f1521bd8740 1 -- 172.21.15.79:0/419168347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f150c07d5a0 con 0x5647620bdb00 2024-04-25T02:13:58.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f14f77fe640 1 -- 172.21.15.79:0/419168347 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f150c096070 con 0x5647620bdb00 2024-04-25T02:13:58.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f1521bd8740 10 client.7671 fetch_fsmap learned FSMap version 54 2024-04-25T02:13:58.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f1521bd8740 1 -- 172.21.15.79:0/419168347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x5647620df010 con 0x5647620bdb00 2024-04-25T02:13:58.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f14f77fe640 1 -- 172.21.15.79:0/419168347 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c07d5a0 con 0x5647620bdb00 2024-04-25T02:13:58.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f14f77fe640 1 -- 172.21.15.79:0/419168347 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7f150c04d060 con 0x5647620bdb00 2024-04-25T02:13:58.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f1521bd8740 10 client.7671 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T02:13:58.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f1521bd8740 10 client.7671 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f1521bd8740 20 client.7671 populate_metadata read hostname 'smithi079' 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f1521bd8740 1 --2- 172.21.15.79:0/419168347 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5647620be250 0x5647620be630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f1521bd8740 4 client.7671 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f1521bd8740 1 -- 172.21.15.79:0/419168347 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "status"}) -- 0x564762002790 con 0x5647620be250 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f1517fff640 1 --2- 172.21.15.79:0/419168347 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5647620be250 0x5647620be630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f14f77fe640 10 client.7671 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.987+0000 7f1517fff640 1 --2- 172.21.15.79:0/419168347 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5647620be250 0x5647620be630 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42c1fd8c90d37b30 server_cookie=b4071472a9854673 in_seq=0 out_seq=0 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f14f77fe640 1 -- 172.21.15.79:0/419168347 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x564762002790 con 0x5647620be250 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f14f77fe640 10 client.7671 handle_command_reply: tid=0 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f1521bd8740 1 client.7671 shutdown 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f1521bd8740 1 -- 172.21.15.79:0/419168347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 msgr2=0x5647620d5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f1521bd8740 1 --2- 172.21.15.79:0/419168347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x5647620d5d40 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f150c075650 tx=0x7f150c04a000 comp rx=0 tx=0).stop 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f1521bd8740 1 -- 172.21.15.79:0/419168347 shutdown_connections 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f1521bd8740 1 --2- 172.21.15.79:0/419168347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647620dfb60 0x56476213f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f1521bd8740 1 --2- 172.21.15.79:0/419168347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647620c2c80 0x56476213f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:58.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f1521bd8740 1 --2- 172.21.15.79:0/419168347 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5647620be250 0x5647620be630 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f1521bd8740 1 --2- 172.21.15.79:0/419168347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647620bdb00 0x5647620d5d40 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f14f77fe640 0 client.7671 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:13:59.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f1521bd8740 1 -- 172.21.15.79:0/419168347 >> 172.21.15.79:0/419168347 conn(0x5647620c2540 msgr2=0x5647620c3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:59.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f1521bd8740 1 -- 172.21.15.79:0/419168347 shutdown_connections 2024-04-25T02:13:59.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f1521bd8740 1 -- 172.21.15.79:0/419168347 wait complete. 2024-04-25T02:13:59.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f1521bd8740 20 client.7671 trim_cache size 0 max 16384 2024-04-25T02:13:59.000 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:13:59.000 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "696648c4-3e52-400b-a780-2e8863c56c42", 2024-04-25T02:13:59.000 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-04-25T02:13:59.000 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7602, 2024-04-25T02:13:59.000 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-04-25T02:13:59.001 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-04-25T02:13:59.001 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-04-25T02:13:59.001 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.3838720279999999, 2024-04-25T02:13:59.001 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 54, 2024-04-25T02:13:59.001 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 87, 2024-04-25T02:13:59.001 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 87, 2024-04-25T02:13:59.001 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 5.3556094449999998 2024-04-25T02:13:59.001 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:13:59.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f151edee640 1 -- 172.21.15.79:0/468980011 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f14fc06be30 msgr2=0x7f14fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:59.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f151edee640 1 --2- 172.21.15.79:0/468980011 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f14fc06be30 0x7f14fc06e2f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1518158740 tx=0x7f1504008040 comp rx=0 tx=0).stop 2024-04-25T02:13:59.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f151edee640 1 -- 172.21.15.79:0/468980011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f151806e490 msgr2=0x7f151813a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:59.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.988+0000 7f151edee640 1 --2- 172.21.15.79:0/468980011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f151806e490 0x7f151813a7c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f150c02a0f0 tx=0x7f150c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.989+0000 7f151edee640 1 -- 172.21.15.79:0/468980011 shutdown_connections 2024-04-25T02:13:59.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.989+0000 7f151edee640 1 --2- 172.21.15.79:0/468980011 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f14fc06be30 0x7f14fc06e2f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.989+0000 7f151edee640 1 --2- 172.21.15.79:0/468980011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1518144cb0 0x7f1518157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.989+0000 7f151edee640 1 --2- 172.21.15.79:0/468980011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15180b5580 0x7f1518156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.989+0000 7f151edee640 1 --2- 172.21.15.79:0/468980011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f151806e490 0x7f151813a7c0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.989+0000 7f151edee640 1 -- 172.21.15.79:0/468980011 >> 172.21.15.79:0/468980011 conn(0x7f15180cfc80 msgr2=0x7f15180b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:59.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.989+0000 7f151edee640 1 -- 172.21.15.79:0/468980011 shutdown_connections 2024-04-25T02:13:59.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:58.989+0000 7f151edee640 1 -- 172.21.15.79:0/468980011 wait complete. 2024-04-25T02:13:59.005 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:13:59.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.095+0000 7fe20a495640 1 Processor -- start 2024-04-25T02:13:59.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.095+0000 7fe20a495640 1 -- start start 2024-04-25T02:13:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.096+0000 7fe20a495640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe20415e4d0 0x7fe20406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.096+0000 7fe20a495640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe2040b3570 0x7fe2040d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.096+0000 7fe20a495640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2040b3020 0x7fe2040d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.096+0000 7fe20a495640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe2040d1660 con 0x7fe20415e4d0 2024-04-25T02:13:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.096+0000 7fe20a495640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe2040d1380 con 0x7fe2040b3570 2024-04-25T02:13:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.096+0000 7fe20a495640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe2040cede0 con 0x7fe2040b3020 2024-04-25T02:13:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.096+0000 7fe203fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe20415e4d0 0x7fe20406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.096+0000 7fe203fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe20415e4d0 0x7fe20406bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35420/0 (socket says 172.21.15.79:35420) 2024-04-25T02:13:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.096+0000 7fe203fff640 1 -- 172.21.15.79:0/926358859 learned_addr learned my addr 172.21.15.79:0/926358859 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.097+0000 7fe2037fe640 1 --2- 172.21.15.79:0/926358859 >> v2:172.21.15.189:3300/0 conn(0x7fe2040b3570 0x7fe2040d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.097+0000 7fe208a32640 1 --2- 172.21.15.79:0/926358859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2040b3020 0x7fe2040d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.097+0000 7fe203fff640 1 -- 172.21.15.79:0/926358859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2040b3020 msgr2=0x7fe2040d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.097+0000 7fe203fff640 1 --2- 172.21.15.79:0/926358859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2040b3020 0x7fe2040d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.097+0000 7fe203fff640 1 -- 172.21.15.79:0/926358859 >> v2:172.21.15.189:3300/0 conn(0x7fe2040b3570 msgr2=0x7fe2040d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:13:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.097+0000 7fe203fff640 1 --2- 172.21.15.79:0/926358859 >> v2:172.21.15.189:3300/0 conn(0x7fe2040b3570 0x7fe2040d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.097+0000 7fe203fff640 1 -- 172.21.15.79:0/926358859 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2040cf0c0 con 0x7fe20415e4d0 2024-04-25T02:13:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.097+0000 7fe203fff640 1 --2- 172.21.15.79:0/926358859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20415e4d0 0x7fe20406bc70 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009870 tx=0x7fe1f402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87300b96aa155a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.097+0000 7fe202ffd640 1 -- 172.21.15.79:0/926358859 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4037070 con 0x7fe20415e4d0 2024-04-25T02:13:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.097+0000 7fe202ffd640 1 -- 172.21.15.79:0/926358859 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f4032440 con 0x7fe20415e4d0 2024-04-25T02:13:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.097+0000 7fe202ffd640 1 -- 172.21.15.79:0/926358859 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4032810 con 0x7fe20415e4d0 2024-04-25T02:13:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.098+0000 7fe20a495640 1 -- 172.21.15.79:0/926358859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20415e4d0 msgr2=0x7fe20406bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.098+0000 7fe20a495640 1 --2- 172.21.15.79:0/926358859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20415e4d0 0x7fe20406bc70 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009870 tx=0x7fe1f402a210 comp rx=0 tx=0).stop 2024-04-25T02:13:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.098+0000 7fe20a495640 1 -- 172.21.15.79:0/926358859 shutdown_connections 2024-04-25T02:13:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.098+0000 7fe20a495640 1 --2- 172.21.15.79:0/926358859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2040b3020 0x7fe2040d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.098+0000 7fe20a495640 1 --2- 172.21.15.79:0/926358859 >> v2:172.21.15.189:3300/0 conn(0x7fe2040b3570 0x7fe2040d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.098+0000 7fe20a495640 1 --2- 172.21.15.79:0/926358859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20415e4d0 0x7fe20406bc70 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.098+0000 7fe20a495640 1 -- 172.21.15.79:0/926358859 >> 172.21.15.79:0/926358859 conn(0x7fe20409d460 msgr2=0x7fe2040d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.098+0000 7fe20a495640 1 -- 172.21.15.79:0/926358859 shutdown_connections 2024-04-25T02:13:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.098+0000 7fe20a495640 1 -- 172.21.15.79:0/926358859 wait complete. 2024-04-25T02:13:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.099+0000 7fe20a495640 1 Processor -- start 2024-04-25T02:13:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.099+0000 7fe20a495640 1 -- start start 2024-04-25T02:13:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.100+0000 7fe20a495640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2040b3020 0x7fe2041615a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.100+0000 7fe20a495640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2040b3570 0x7fe204153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.100+0000 7fe20a495640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20415e4d0 0x7fe2040b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.100+0000 7fe20a495640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe2040d2250 con 0x7fe20415e4d0 2024-04-25T02:13:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.100+0000 7fe20a495640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe2040d20d0 con 0x7fe2040b3020 2024-04-25T02:13:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.100+0000 7fe20a495640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe20406c1b0 con 0x7fe2040b3570 2024-04-25T02:13:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.100+0000 7fe208a32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20415e4d0 0x7fe2040b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.100+0000 7fe208a32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20415e4d0 0x7fe2040b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35424/0 (socket says 172.21.15.79:35424) 2024-04-25T02:13:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.100+0000 7fe208a32640 1 -- 172.21.15.79:0/206555117 learned_addr learned my addr 172.21.15.79:0/206555117 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:13:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.100+0000 7fe203fff640 1 --2- 172.21.15.79:0/206555117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2040b3020 0x7fe2041615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.100+0000 7fe2037fe640 1 --2- 172.21.15.79:0/206555117 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2040b3570 0x7fe204153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.100+0000 7fe208a32640 1 -- 172.21.15.79:0/206555117 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2040b3570 msgr2=0x7fe204153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:59.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.100+0000 7fe208a32640 1 --2- 172.21.15.79:0/206555117 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2040b3570 0x7fe204153530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.100+0000 7fe208a32640 1 -- 172.21.15.79:0/206555117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2040b3020 msgr2=0x7fe2041615a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:59.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.100+0000 7fe208a32640 1 --2- 172.21.15.79:0/206555117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2040b3020 0x7fe2041615a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.101+0000 7fe208a32640 1 -- 172.21.15.79:0/206555117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2040b4000 con 0x7fe20415e4d0 2024-04-25T02:13:59.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.101+0000 7fe208a32640 1 --2- 172.21.15.79:0/206555117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20415e4d0 0x7fe2040b3ac0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc007e90 tx=0x7fe1fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:59.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.101+0000 7fe200ff9640 1 -- 172.21.15.79:0/206555117 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc014420 con 0x7fe20415e4d0 2024-04-25T02:13:59.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.101+0000 7fe200ff9640 1 -- 172.21.15.79:0/206555117 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1fc019070 con 0x7fe20415e4d0 2024-04-25T02:13:59.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.101+0000 7fe20a495640 1 -- 172.21.15.79:0/206555117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2040b42a0 con 0x7fe20415e4d0 2024-04-25T02:13:59.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.101+0000 7fe200ff9640 1 -- 172.21.15.79:0/206555117 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc014820 con 0x7fe20415e4d0 2024-04-25T02:13:59.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.101+0000 7fe20a495640 1 -- 172.21.15.79:0/206555117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2040b4860 con 0x7fe20415e4d0 2024-04-25T02:13:59.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.102+0000 7fe20a495640 1 -- 172.21.15.79:0/206555117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2040690a0 con 0x7fe20415e4d0 2024-04-25T02:13:59.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.102+0000 7fe200ff9640 1 -- 172.21.15.79:0/206555117 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe1fc0149c0 con 0x7fe20415e4d0 2024-04-25T02:13:59.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.103+0000 7fe200ff9640 1 --2- 172.21.15.79:0/206555117 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe1f006be60 0x7fe1f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:59.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.103+0000 7fe200ff9640 1 -- 172.21.15.79:0/206555117 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fe1fc08b7b0 con 0x7fe20415e4d0 2024-04-25T02:13:59.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.103+0000 7fe203fff640 1 --2- 172.21.15.79:0/206555117 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe1f006be60 0x7fe1f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:59.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.103+0000 7fe203fff640 1 --2- 172.21.15.79:0/206555117 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe1f006be60 0x7fe1f006e320 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4034000 tx=0x7fe1f402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:59.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.107+0000 7fe200ff9640 1 -- 172.21.15.79:0/206555117 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe1fc05a070 con 0x7fe20415e4d0 2024-04-25T02:13:59.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.316+0000 7fe20a495640 1 -- 172.21.15.79:0/206555117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe2040d1920 con 0x7fe20415e4d0 2024-04-25T02:13:59.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.317+0000 7fe200ff9640 1 -- 172.21.15.79:0/206555117 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) ==== 53+0+73 (secure 0 0 0) 0x7fe1fc059970 con 0x7fe20415e4d0 2024-04-25T02:13:59.323 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:13:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.318+0000 7fe20a495640 1 -- 172.21.15.79:0/206555117 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe1f006be60 msgr2=0x7fe1f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.318+0000 7fe20a495640 1 --2- 172.21.15.79:0/206555117 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe1f006be60 0x7fe1f006e320 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4034000 tx=0x7fe1f402e000 comp rx=0 tx=0).stop 2024-04-25T02:13:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.318+0000 7fe20a495640 1 -- 172.21.15.79:0/206555117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20415e4d0 msgr2=0x7fe2040b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.318+0000 7fe20a495640 1 --2- 172.21.15.79:0/206555117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20415e4d0 0x7fe2040b3ac0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc007e90 tx=0x7fe1fc00e4b0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.318+0000 7fe20a495640 1 -- 172.21.15.79:0/206555117 shutdown_connections 2024-04-25T02:13:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.318+0000 7fe20a495640 1 --2- 172.21.15.79:0/206555117 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe1f006be60 0x7fe1f006e320 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.318+0000 7fe20a495640 1 --2- 172.21.15.79:0/206555117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20415e4d0 0x7fe2040b3ac0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.319+0000 7fe20a495640 1 --2- 172.21.15.79:0/206555117 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe2040b3570 0x7fe204153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.319+0000 7fe20a495640 1 --2- 172.21.15.79:0/206555117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2040b3020 0x7fe2041615a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.319+0000 7fe20a495640 1 -- 172.21.15.79:0/206555117 >> 172.21.15.79:0/206555117 conn(0x7fe20409d460 msgr2=0x7fe2040d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.319+0000 7fe20a495640 1 -- 172.21.15.79:0/206555117 shutdown_connections 2024-04-25T02:13:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59.319+0000 7fe20a495640 1 -- 172.21.15.79:0/206555117 wait complete. 2024-04-25T02:13:59.335 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:13:59.335 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:13:59.335 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:13:59.335 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:13:59.335 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:13:59.335 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:13:59.336 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:13:59.336 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:13:59.336 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:13:59.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:59.336 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:13:59.350 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:13:59.351 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42366sec preferred_lft 42366sec 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:13:59.352 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::4c:adff:fe56:7194/64 scope link 2024-04-25T02:13:59.353 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:13:59.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:59.353 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:13:59.412 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:13:59.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:59.414 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:13:59.469 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:13:59.469 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:13:59.469 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:13:59.469 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:13:59.469 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:13:59.470 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:13:59.470 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:13:59.470 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:13:59.470 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:13:59.470 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:13:59.470 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:13:59.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:13:59.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:13:59.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:59.592 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:13:59.606 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:13:59.607 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:13:59.607 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:13:59.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:59.607 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:13:59.610 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-04-25T02:13:59.605+0000 7f8564649640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:13:59.633 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:13:59.633 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:13:59.689 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:13:59.689 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:13:59.689 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:13:59.743 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:13:59.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:59.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:13:59.824 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:13:59.824 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:13:59.824 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:13:59.832 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:13:59.832 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:13:59.832 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:13:59.832 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:13:59.832 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:13:59.837 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:13:59.837 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:13:59.837 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:13:59.837 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:13:59.837 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:13:59.837 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:13:59.837 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:13:59.837 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:13:59.837 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:13:59.838 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:13:59.838 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:13:59.838 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:13:59.838 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:13:59.839 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:13:59.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:13:59.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:13:59.903 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:13:59.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:13:59.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:13:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:13:59.998 INFO:teuthology.orchestra.run.smithi079.stdout:client7680 2024-04-25T02:14:00.001 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:14:00.001 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:14:00.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:14:00.017 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink) 2024-04-25T02:14:00.073 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-04-25T02:14:00.067+0000 7f8560641640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-25T02:14:00.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:14:00.074 INFO:teuthology.orchestra.run.smithi079.stderr:stat: cannot statx 'testdir/hardlink': Input/output error 2024-04-25T02:14:00.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:14:00.075 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive 2024-04-25T02:14:00.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.210+0000 7fb9557b7640 1 Processor -- start 2024-04-25T02:14:00.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.210+0000 7fb9557b7640 1 -- start start 2024-04-25T02:14:00.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.211+0000 7fb9557b7640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb9500d2f20 0x7fb9500d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.211+0000 7fb9557b7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb9500d0ed0 0x7fb9500b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.211+0000 7fb9557b7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9500d1e80 con 0x7fb95015e440 2024-04-25T02:14:00.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.211+0000 7fb9557b7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb9500d2160 con 0x7fb9500d0ed0 2024-04-25T02:14:00.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.211+0000 7fb9557b7640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb9500d2440 con 0x7fb9500d2f20 2024-04-25T02:14:00.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.211+0000 7fb94f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb9500d0ed0 0x7fb9500b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.211+0000 7fb94f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb9500d0ed0 0x7fb9500b6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35428/0 (socket says 172.21.15.79:35428) 2024-04-25T02:14:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.211+0000 7fb94effd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb95015e440 0x7fb9500cf870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33396/0 (socket says 172.21.15.79:33396) 2024-04-25T02:14:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.211+0000 7fb94f7fe640 1 -- 172.21.15.79:0/525115680 learned_addr learned my addr 172.21.15.79:0/525115680 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.211+0000 7fb94e7fc640 1 --2- 172.21.15.79:0/525115680 >> v2:172.21.15.189:3300/0 conn(0x7fb9500d2f20 0x7fb9500d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.211+0000 7fb94f7fe640 1 -- 172.21.15.79:0/525115680 >> v2:172.21.15.189:3300/0 conn(0x7fb9500d2f20 msgr2=0x7fb9500d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.211+0000 7fb94f7fe640 1 --2- 172.21.15.79:0/525115680 >> v2:172.21.15.189:3300/0 conn(0x7fb9500d2f20 0x7fb9500d0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.211+0000 7fb94f7fe640 1 -- 172.21.15.79:0/525115680 >> v1:172.21.15.79:6789/0 conn(0x7fb95015e440 legacy=0x7fb9500cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.211+0000 7fb94f7fe640 1 -- 172.21.15.79:0/525115680 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9500d2720 con 0x7fb9500d0ed0 2024-04-25T02:14:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.211+0000 7fb94dffb640 1 -- 172.21.15.79:0/525115680 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 133126118 0 0) 0x7fb9500d1e80 con 0x7fb95015e440 2024-04-25T02:14:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.212+0000 7fb94f7fe640 1 --2- 172.21.15.79:0/525115680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9500d0ed0 0x7fb9500b6ef0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fb95008d840 tx=0x7fb94802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3e58cc3d791cd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.212+0000 7fb94dffb640 1 -- 172.21.15.79:0/525115680 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948036070 con 0x7fb9500d0ed0 2024-04-25T02:14:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.212+0000 7fb94dffb640 1 -- 172.21.15.79:0/525115680 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb948031600 con 0x7fb9500d0ed0 2024-04-25T02:14:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.212+0000 7fb94dffb640 1 -- 172.21.15.79:0/525115680 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9480319d0 con 0x7fb9500d0ed0 2024-04-25T02:14:00.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.213+0000 7fb9557b7640 1 -- 172.21.15.79:0/525115680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9500d0ed0 msgr2=0x7fb9500b6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.213+0000 7fb9557b7640 1 --2- 172.21.15.79:0/525115680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9500d0ed0 0x7fb9500b6ef0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fb95008d840 tx=0x7fb94802a730 comp rx=0 tx=0).stop 2024-04-25T02:14:00.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.213+0000 7fb9557b7640 1 -- 172.21.15.79:0/525115680 shutdown_connections 2024-04-25T02:14:00.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.213+0000 7fb9557b7640 1 --2- 172.21.15.79:0/525115680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9500d0ed0 0x7fb9500b6ef0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.213+0000 7fb9557b7640 1 --2- 172.21.15.79:0/525115680 >> v2:172.21.15.189:3300/0 conn(0x7fb9500d2f20 0x7fb9500d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.213+0000 7fb9557b7640 1 -- 172.21.15.79:0/525115680 >> 172.21.15.79:0/525115680 conn(0x7fb95009d450 msgr2=0x7fb9500d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.213+0000 7fb9557b7640 1 -- 172.21.15.79:0/525115680 shutdown_connections 2024-04-25T02:14:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.213+0000 7fb9557b7640 1 -- 172.21.15.79:0/525115680 wait complete. 2024-04-25T02:14:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.214+0000 7fb9557b7640 1 Processor -- start 2024-04-25T02:14:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.214+0000 7fb9557b7640 1 -- start start 2024-04-25T02:14:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb9557b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9500d0ed0 0x7fb9500cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb9557b7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb9500d2f20 0x7fb9500c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb9557b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb95015e440 0x7fb9500c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb9557b7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb9500d0100 con 0x7fb95015e440 2024-04-25T02:14:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb9557b7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb9500cff80 con 0x7fb9500d0ed0 2024-04-25T02:14:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb9557b7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb9500b7430 con 0x7fb9500d2f20 2024-04-25T02:14:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb94f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb95015e440 0x7fb9500c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb94f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb95015e440 0x7fb9500c9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35442/0 (socket says 172.21.15.79:35442) 2024-04-25T02:14:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb94f7fe640 1 -- 172.21.15.79:0/3909405182 learned_addr learned my addr 172.21.15.79:0/3909405182 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb94effd640 1 --2- 172.21.15.79:0/3909405182 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9500d0ed0 0x7fb9500cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb94f7fe640 1 -- 172.21.15.79:0/3909405182 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb9500d2f20 msgr2=0x7fb9500c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb94f7fe640 1 --2- 172.21.15.79:0/3909405182 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb9500d2f20 0x7fb9500c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb94f7fe640 1 -- 172.21.15.79:0/3909405182 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9500d0ed0 msgr2=0x7fb9500cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb94f7fe640 1 --2- 172.21.15.79:0/3909405182 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9500d0ed0 0x7fb9500cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb94f7fe640 1 -- 172.21.15.79:0/3909405182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9500cd370 con 0x7fb95015e440 2024-04-25T02:14:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb94effd640 1 --2- 172.21.15.79:0/3909405182 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9500d0ed0 0x7fb9500cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:14:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.215+0000 7fb94f7fe640 1 --2- 172.21.15.79:0/3909405182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb95015e440 0x7fb9500c9ff0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fb948034040 tx=0x7fb948004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.216+0000 7fb9377fe640 1 -- 172.21.15.79:0/3909405182 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948036050 con 0x7fb95015e440 2024-04-25T02:14:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.216+0000 7fb9377fe640 1 -- 172.21.15.79:0/3909405182 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb948042070 con 0x7fb95015e440 2024-04-25T02:14:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.216+0000 7fb9557b7640 1 -- 172.21.15.79:0/3909405182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9500cd650 con 0x7fb95015e440 2024-04-25T02:14:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.216+0000 7fb9377fe640 1 -- 172.21.15.79:0/3909405182 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948009510 con 0x7fb95015e440 2024-04-25T02:14:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.216+0000 7fb9557b7640 1 -- 172.21.15.79:0/3909405182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9500cdc10 con 0x7fb95015e440 2024-04-25T02:14:00.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.217+0000 7fb9377fe640 1 -- 172.21.15.79:0/3909405182 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb948007bf0 con 0x7fb95015e440 2024-04-25T02:14:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.217+0000 7fb9377fe640 1 --2- 172.21.15.79:0/3909405182 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb93c06be30 0x7fb93c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.217+0000 7fb9377fe640 1 -- 172.21.15.79:0/3909405182 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fb9480abdd0 con 0x7fb95015e440 2024-04-25T02:14:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.217+0000 7fb94effd640 1 --2- 172.21.15.79:0/3909405182 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb93c06be30 0x7fb93c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.218+0000 7fb94effd640 1 --2- 172.21.15.79:0/3909405182 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb93c06be30 0x7fb93c06e2f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb940000f60 tx=0x7fb940009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.218+0000 7fb9585a6740 1 Processor -- start 2024-04-25T02:14:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.218+0000 7fb9585a6740 1 -- start start 2024-04-25T02:14:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.219+0000 7fb9585a6740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b45e0d0 0x55b47b45e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.219+0000 7fb9585a6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b458f60 0x55b47b45ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.219+0000 7fb9585a6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45d210 0x55b47b45d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.219+0000 7fb9585a6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b47b3c12c0 con 0x55b47b45d210 2024-04-25T02:14:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.219+0000 7fb9585a6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b47b369950 con 0x55b47b458f60 2024-04-25T02:14:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.219+0000 7fb9585a6740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55b47b3bd280 con 0x55b47b45e0d0 2024-04-25T02:14:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.219+0000 7fb94f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45d210 0x55b47b45d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.219+0000 7fb94f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45d210 0x55b47b45d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35448/0 (socket says 172.21.15.79:35448) 2024-04-25T02:14:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.219+0000 7fb94f7fe640 1 -- 172.21.15.79:0/976956655 learned_addr learned my addr 172.21.15.79:0/976956655 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.219+0000 7fb94effd640 1 --2- 172.21.15.79:0/976956655 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b45e0d0 0x55b47b45e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.219+0000 7fb94f7fe640 1 -- 172.21.15.79:0/976956655 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b45e0d0 msgr2=0x55b47b45e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb94f7fe640 1 --2- 172.21.15.79:0/976956655 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b45e0d0 0x55b47b45e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb94e7fc640 1 --2- 172.21.15.79:0/976956655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b458f60 0x55b47b45ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb94f7fe640 1 -- 172.21.15.79:0/976956655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b458f60 msgr2=0x55b47b45ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb94f7fe640 1 --2- 172.21.15.79:0/976956655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b458f60 0x55b47b45ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb94f7fe640 1 -- 172.21.15.79:0/976956655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b47b1a17b0 con 0x55b47b45d210 2024-04-25T02:14:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb94e7fc640 1 --2- 172.21.15.79:0/976956655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b458f60 0x55b47b45ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:14:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb94f7fe640 1 --2- 172.21.15.79:0/976956655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45d210 0x55b47b45d650 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fb94807a060 tx=0x7fb9480764a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd8c8d74373165c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb934ff9640 1 -- 172.21.15.79:0/976956655 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9480a8070 con 0x55b47b45d210 2024-04-25T02:14:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb934ff9640 1 -- 172.21.15.79:0/976956655 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb948092070 con 0x55b47b45d210 2024-04-25T02:14:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb934ff9640 1 -- 172.21.15.79:0/976956655 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94807a0d0 con 0x55b47b45d210 2024-04-25T02:14:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb9585a6740 1 -- 172.21.15.79:0/976956655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45d210 msgr2=0x55b47b45d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb9585a6740 1 --2- 172.21.15.79:0/976956655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45d210 0x55b47b45d650 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fb94807a060 tx=0x7fb9480764a0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb9585a6740 1 -- 172.21.15.79:0/976956655 shutdown_connections 2024-04-25T02:14:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb9585a6740 1 --2- 172.21.15.79:0/976956655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45d210 0x55b47b45d650 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb9585a6740 1 --2- 172.21.15.79:0/976956655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b458f60 0x55b47b45ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb9585a6740 1 --2- 172.21.15.79:0/976956655 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b45e0d0 0x55b47b45e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.220+0000 7fb9585a6740 1 -- 172.21.15.79:0/976956655 >> 172.21.15.79:0/976956655 conn(0x55b47b45b1d0 msgr2=0x55b47b4a3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.221+0000 7fb9585a6740 1 -- 172.21.15.79:0/976956655 shutdown_connections 2024-04-25T02:14:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.221+0000 7fb9585a6740 1 -- 172.21.15.79:0/976956655 wait complete. 2024-04-25T02:14:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.221+0000 7fb9585a6740 1 -- start start 2024-04-25T02:14:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.221+0000 7fb9585a6740 1 Processor -- start 2024-04-25T02:14:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb9585a6740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b45d210 0x55b47b4a9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb9585a6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45e0d0 0x55b47b47ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb9585a6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b47b140 0x55b47b4ab410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb9585a6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b47b3c12c0 con 0x55b47b47b140 2024-04-25T02:14:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb9585a6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b47b37cee0 con 0x55b47b45e0d0 2024-04-25T02:14:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb9585a6740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55b47b489c60 con 0x55b47b45d210 2024-04-25T02:14:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb9585a6740 10 client.0 _ll_register_callbacks cb 0x55b47b381120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:14:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb94f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b47b140 0x55b47b4ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb94f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b47b140 0x55b47b4ab410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35462/0 (socket says 172.21.15.79:35462) 2024-04-25T02:14:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb94f7fe640 1 -- 172.21.15.79:0/630995783 learned_addr learned my addr 172.21.15.79:0/630995783 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb94e7fc640 1 --2- 172.21.15.79:0/630995783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45e0d0 0x55b47b47ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb94effd640 1 --2- 172.21.15.79:0/630995783 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b45d210 0x55b47b4a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb94f7fe640 1 -- 172.21.15.79:0/630995783 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b45d210 msgr2=0x55b47b4a9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb94f7fe640 1 --2- 172.21.15.79:0/630995783 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b45d210 0x55b47b4a9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb94f7fe640 1 -- 172.21.15.79:0/630995783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45e0d0 msgr2=0x55b47b47ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb94f7fe640 1 --2- 172.21.15.79:0/630995783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45e0d0 0x55b47b47ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb94f7fe640 1 -- 172.21.15.79:0/630995783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b47b201f40 con 0x55b47b47b140 2024-04-25T02:14:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb94e7fc640 1 --2- 172.21.15.79:0/630995783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45e0d0 0x55b47b47ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb94f7fe640 1 --2- 172.21.15.79:0/630995783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b47b140 0x55b47b4ab410 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fb9480aa2f0 tx=0x7fb948009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0dad21078e581a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb92dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:14:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.222+0000 7fb92dffb640 1 -- 172.21.15.79:0/630995783 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9480a8030 con 0x55b47b47b140 2024-04-25T02:14:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb92dffb640 1 -- 172.21.15.79:0/630995783 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fb948079520 con 0x55b47b47b140 2024-04-25T02:14:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb9585a6740 1 -- 172.21.15.79:0/630995783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb948092070 con 0x55b47b47b140 2024-04-25T02:14:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb92dffb640 1 -- 172.21.15.79:0/630995783 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fb9480a0050 con 0x55b47b47b140 2024-04-25T02:14:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb9585a6740 10 client.7695 fetch_fsmap learned FSMap version 54 2024-04-25T02:14:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb9585a6740 1 -- 172.21.15.79:0/630995783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x55b47b0950a0 con 0x55b47b47b140 2024-04-25T02:14:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb92dffb640 1 -- 172.21.15.79:0/630995783 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb948082e50 con 0x55b47b47b140 2024-04-25T02:14:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb92dffb640 1 -- 172.21.15.79:0/630995783 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7fb9480a3020 con 0x55b47b47b140 2024-04-25T02:14:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb9585a6740 10 client.7695 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T02:14:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb9585a6740 10 client.7695 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:14:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb9585a6740 20 client.7695 populate_metadata read hostname 'smithi079' 2024-04-25T02:14:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb9585a6740 1 --2- 172.21.15.79:0/630995783 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55b47b47e280 0x55b47b47e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb9585a6740 4 client.7695 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:14:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb9585a6740 1 -- 172.21.15.79:0/630995783 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b47b37ed60 con 0x55b47b47e280 2024-04-25T02:14:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb94effd640 1 --2- 172.21.15.79:0/630995783 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55b47b47e280 0x55b47b47e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb92dffb640 10 client.7695 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.223+0000 7fb94effd640 1 --2- 172.21.15.79:0/630995783 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55b47b47e280 0x55b47b47e660 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a70010434e59b4db server_cookie=42805850664bc1ef in_seq=0 out_seq=0 2024-04-25T02:14:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.224+0000 7fb92dffb640 1 -- 172.21.15.79:0/630995783 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b47b37ed60 con 0x55b47b47e280 2024-04-25T02:14:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.224+0000 7fb92dffb640 10 client.7695 handle_command_reply: tid=0 2024-04-25T02:14:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.224+0000 7fb9585a6740 1 client.7695 shutdown 2024-04-25T02:14:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.224+0000 7fb9585a6740 1 -- 172.21.15.79:0/630995783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b47b140 msgr2=0x55b47b4ab410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.224+0000 7fb9585a6740 1 --2- 172.21.15.79:0/630995783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b47b140 0x55b47b4ab410 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fb9480aa2f0 tx=0x7fb948009810 comp rx=0 tx=0).stop 2024-04-25T02:14:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.224+0000 7fb9585a6740 1 -- 172.21.15.79:0/630995783 shutdown_connections 2024-04-25T02:14:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.224+0000 7fb9585a6740 1 --2- 172.21.15.79:0/630995783 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55b47b47e280 0x55b47b47e660 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.224+0000 7fb9585a6740 1 --2- 172.21.15.79:0/630995783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b47b140 0x55b47b4ab410 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.224+0000 7fb9585a6740 1 --2- 172.21.15.79:0/630995783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45e0d0 0x55b47b47ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.224+0000 7fb92dffb640 0 client.7695 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.224+0000 7fb9585a6740 1 --2- 172.21.15.79:0/630995783 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b45d210 0x55b47b4a9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.224+0000 7fb9585a6740 1 -- 172.21.15.79:0/630995783 >> 172.21.15.79:0/630995783 conn(0x55b47b458f60 msgr2=0x55b47b458680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.224+0000 7fb9585a6740 1 -- 172.21.15.79:0/630995783 shutdown_connections 2024-04-25T02:14:00.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.224+0000 7fb9585a6740 1 -- 172.21.15.79:0/630995783 wait complete. 2024-04-25T02:14:00.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.224+0000 7fb9585a6740 20 client.7695 trim_cache size 0 max 16384 2024-04-25T02:14:00.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.242+0000 7fb9585a6740 1 Processor -- start 2024-04-25T02:14:00.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.242+0000 7fb9585a6740 1 -- start start 2024-04-25T02:14:00.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb9585a6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45d210 0x55b47b45fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb9585a6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45e0d0 0x55b47b45ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb9585a6740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b47b140 0x55b47b47fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb9585a6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb9502006b0 con 0x55b47b45e0d0 2024-04-25T02:14:00.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb9585a6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb9501ff7a0 con 0x55b47b45d210 2024-04-25T02:14:00.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb9585a6740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb9501472d0 con 0x55b47b47b140 2024-04-25T02:14:00.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb94e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45e0d0 0x55b47b45ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb94e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45e0d0 0x55b47b45ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35474/0 (socket says 172.21.15.79:35474) 2024-04-25T02:14:00.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb94e7fc640 1 -- 172.21.15.79:0/2494982906 learned_addr learned my addr 172.21.15.79:0/2494982906 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:00.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb94effd640 1 --2- 172.21.15.79:0/2494982906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45d210 0x55b47b45fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb94e7fc640 1 -- 172.21.15.79:0/2494982906 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b47b140 msgr2=0x55b47b47fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb94e7fc640 1 --2- 172.21.15.79:0/2494982906 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b47b140 0x55b47b47fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb94e7fc640 1 -- 172.21.15.79:0/2494982906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45d210 msgr2=0x55b47b45fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb94e7fc640 1 --2- 172.21.15.79:0/2494982906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45d210 0x55b47b45fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb94e7fc640 1 -- 172.21.15.79:0/2494982906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b47b457a00 con 0x55b47b45e0d0 2024-04-25T02:14:00.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb94effd640 1 --2- 172.21.15.79:0/2494982906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45d210 0x55b47b45fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:14:00.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb94e7fc640 1 --2- 172.21.15.79:0/2494982906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45e0d0 0x55b47b45ed60 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fb94400dab0 tx=0x7fb94400df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5971c275142ac7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:00.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb92ffff640 1 -- 172.21.15.79:0/2494982906 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944017070 con 0x55b47b45e0d0 2024-04-25T02:14:00.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb92ffff640 1 -- 172.21.15.79:0/2494982906 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94400fe10 con 0x55b47b45e0d0 2024-04-25T02:14:00.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.243+0000 7fb92ffff640 1 -- 172.21.15.79:0/2494982906 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944013660 con 0x55b47b45e0d0 2024-04-25T02:14:00.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.244+0000 7fb9585a6740 1 -- 172.21.15.79:0/2494982906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45e0d0 msgr2=0x55b47b45ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.244+0000 7fb9585a6740 1 --2- 172.21.15.79:0/2494982906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45e0d0 0x55b47b45ed60 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fb94400dab0 tx=0x7fb94400df70 comp rx=0 tx=0).stop 2024-04-25T02:14:00.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.244+0000 7fb9585a6740 1 -- 172.21.15.79:0/2494982906 shutdown_connections 2024-04-25T02:14:00.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.244+0000 7fb9585a6740 1 --2- 172.21.15.79:0/2494982906 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b47b140 0x55b47b47fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.244+0000 7fb9585a6740 1 --2- 172.21.15.79:0/2494982906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45e0d0 0x55b47b45ed60 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.244+0000 7fb9585a6740 1 --2- 172.21.15.79:0/2494982906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45d210 0x55b47b45fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.244+0000 7fb9585a6740 1 -- 172.21.15.79:0/2494982906 >> 172.21.15.79:0/2494982906 conn(0x55b47b458f60 msgr2=0x55b47b47f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:00.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.244+0000 7fb9585a6740 1 -- 172.21.15.79:0/2494982906 shutdown_connections 2024-04-25T02:14:00.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.244+0000 7fb9585a6740 1 -- 172.21.15.79:0/2494982906 wait complete. 2024-04-25T02:14:00.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.244+0000 7fb9585a6740 1 -- start start 2024-04-25T02:14:00.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.244+0000 7fb9585a6740 1 Processor -- start 2024-04-25T02:14:00.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb9585a6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45d210 0x55b47b4b6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb9585a6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45e0d0 0x55b47b4b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb9585a6740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b47b140 0x55b47b521010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb9585a6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb9501453d0 con 0x55b47b45e0d0 2024-04-25T02:14:00.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb9585a6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b47b346930 con 0x55b47b45d210 2024-04-25T02:14:00.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb9585a6740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55b47b477960 con 0x55b47b47b140 2024-04-25T02:14:00.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb9585a6740 10 client.0 _ll_register_callbacks cb 0x7fb9480a6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:14:00.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb94e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45e0d0 0x55b47b4b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb94e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45e0d0 0x55b47b4b6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35478/0 (socket says 172.21.15.79:35478) 2024-04-25T02:14:00.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb94e7fc640 1 -- 172.21.15.79:0/2154306373 learned_addr learned my addr 172.21.15.79:0/2154306373 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:00.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb94effd640 1 --2- 172.21.15.79:0/2154306373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45d210 0x55b47b4b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb94f7fe640 1 --2- 172.21.15.79:0/2154306373 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b47b140 0x55b47b521010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb94e7fc640 1 -- 172.21.15.79:0/2154306373 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b47b140 msgr2=0x55b47b521010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb94e7fc640 1 --2- 172.21.15.79:0/2154306373 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b47b140 0x55b47b521010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb94e7fc640 1 -- 172.21.15.79:0/2154306373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45d210 msgr2=0x55b47b4b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb94e7fc640 1 --2- 172.21.15.79:0/2154306373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45d210 0x55b47b4b6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.245+0000 7fb94e7fc640 1 -- 172.21.15.79:0/2154306373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b47b4a87e0 con 0x55b47b45e0d0 2024-04-25T02:14:00.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb94e7fc640 1 --2- 172.21.15.79:0/2154306373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45e0d0 0x55b47b4b6a60 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fb944016000 tx=0x7fb9440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcfe0da32294e8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:00.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb92dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:14:00.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb92dffb640 1 -- 172.21.15.79:0/2154306373 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94402b060 con 0x55b47b45e0d0 2024-04-25T02:14:00.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb92dffb640 1 -- 172.21.15.79:0/2154306373 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fb94400fc10 con 0x55b47b45e0d0 2024-04-25T02:14:00.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb9585a6740 1 -- 172.21.15.79:0/2154306373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb94400fe10 con 0x55b47b45e0d0 2024-04-25T02:14:00.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb92dffb640 1 -- 172.21.15.79:0/2154306373 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fb944031050 con 0x55b47b45e0d0 2024-04-25T02:14:00.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb9585a6740 10 client.7701 fetch_fsmap learned FSMap version 54 2024-04-25T02:14:00.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb9585a6740 1 -- 172.21.15.79:0/2154306373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x55b47b521ce0 con 0x55b47b45e0d0 2024-04-25T02:14:00.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb92dffb640 1 -- 172.21.15.79:0/2154306373 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94400fe10 con 0x55b47b45e0d0 2024-04-25T02:14:00.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb92dffb640 1 -- 172.21.15.79:0/2154306373 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7fb944034020 con 0x55b47b45e0d0 2024-04-25T02:14:00.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb9585a6740 10 client.7701 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb9585a6740 10 client.7701 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb9585a6740 20 client.7701 populate_metadata read hostname 'smithi079' 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb9585a6740 1 --2- 172.21.15.79:0/2154306373 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55b47b521550 0x55b47b4a4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb9585a6740 4 client.7701 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}] 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb9585a6740 1 -- 172.21.15.79:0/2154306373 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}) -- 0x55b47b45c0e0 con 0x55b47b521550 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.246+0000 7fb94effd640 1 --2- 172.21.15.79:0/2154306373 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55b47b521550 0x55b47b4a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb92dffb640 10 client.7701 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb94effd640 1 --2- 172.21.15.79:0/2154306373 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55b47b521550 0x55b47b4a4630 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d02422732816343b server_cookie=eeffa503e75a8672 in_seq=0 out_seq=0 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb92dffb640 1 -- 172.21.15.79:0/2154306373 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b47b45c0e0 con 0x55b47b521550 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb92dffb640 10 client.7701 handle_command_reply: tid=0 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb9585a6740 1 client.7701 shutdown 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb9585a6740 1 -- 172.21.15.79:0/2154306373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45e0d0 msgr2=0x55b47b4b6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb9585a6740 1 --2- 172.21.15.79:0/2154306373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45e0d0 0x55b47b4b6a60 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fb944016000 tx=0x7fb9440046c0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb9585a6740 1 -- 172.21.15.79:0/2154306373 shutdown_connections 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb9585a6740 1 --2- 172.21.15.79:0/2154306373 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55b47b47b140 0x55b47b521010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb9585a6740 1 --2- 172.21.15.79:0/2154306373 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55b47b521550 0x55b47b4a4630 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb9585a6740 1 --2- 172.21.15.79:0/2154306373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b47b45e0d0 0x55b47b4b6a60 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb9585a6740 1 --2- 172.21.15.79:0/2154306373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b47b45d210 0x55b47b4b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb92dffb640 0 client.7701 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:00.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb9585a6740 1 -- 172.21.15.79:0/2154306373 >> 172.21.15.79:0/2154306373 conn(0x55b47b458f60 msgr2=0x55b47b488810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:00.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb9585a6740 1 -- 172.21.15.79:0/2154306373 shutdown_connections 2024-04-25T02:14:00.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb9585a6740 1 -- 172.21.15.79:0/2154306373 wait complete. 2024-04-25T02:14:00.260 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-04-25T02:14:00.247+0000 7f8560641640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-25T02:13:50.804280+0000 1=1+0) n(v0 rc2024-04-25T02:13:50.919277+0000 2=1+1) | dirfrag=0 authpin=1 scrubqueue=0 0x5603c4bbd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T02:13:50.804280+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T02:13:50.919277+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-25T02:14:00.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.247+0000 7fb9585a6740 20 client.7701 trim_cache size 0 max 16384 2024-04-25T02:14:00.261 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:14:00.261 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-04-25T02:14:00.261 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "e82a7a07-cae1-4307-8f44-dd8c90237f42", 2024-04-25T02:14:00.261 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-04-25T02:14:00.261 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:14:00.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.248+0000 7fb9557b7640 1 -- 172.21.15.79:0/3909405182 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb93c06be30 msgr2=0x7fb93c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.248+0000 7fb9557b7640 1 --2- 172.21.15.79:0/3909405182 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb93c06be30 0x7fb93c06e2f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb940000f60 tx=0x7fb940009040 comp rx=0 tx=0).stop 2024-04-25T02:14:00.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.248+0000 7fb9557b7640 1 -- 172.21.15.79:0/3909405182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb95015e440 msgr2=0x7fb9500c9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.248+0000 7fb9557b7640 1 --2- 172.21.15.79:0/3909405182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb95015e440 0x7fb9500c9ff0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fb948034040 tx=0x7fb948004a40 comp rx=0 tx=0).stop 2024-04-25T02:14:00.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.248+0000 7fb9557b7640 1 -- 172.21.15.79:0/3909405182 shutdown_connections 2024-04-25T02:14:00.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.248+0000 7fb9557b7640 1 --2- 172.21.15.79:0/3909405182 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb93c06be30 0x7fb93c06e2f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.248+0000 7fb9557b7640 1 --2- 172.21.15.79:0/3909405182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb95015e440 0x7fb9500c9ff0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.248+0000 7fb9557b7640 1 --2- 172.21.15.79:0/3909405182 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb9500d2f20 0x7fb9500c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.248+0000 7fb9557b7640 1 --2- 172.21.15.79:0/3909405182 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9500d0ed0 0x7fb9500cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.248+0000 7fb9557b7640 1 -- 172.21.15.79:0/3909405182 >> 172.21.15.79:0/3909405182 conn(0x7fb95009d450 msgr2=0x7fb9500b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:00.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.248+0000 7fb9557b7640 1 -- 172.21.15.79:0/3909405182 shutdown_connections 2024-04-25T02:14:00.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.248+0000 7fb9557b7640 1 -- 172.21.15.79:0/3909405182 wait complete. 2024-04-25T02:14:00.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:14:00.265 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T02:14:00.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.358+0000 7ffa8eaba640 1 Processor -- start 2024-04-25T02:14:00.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.358+0000 7ffa8eaba640 1 -- start start 2024-04-25T02:14:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.358+0000 7ffa8eaba640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffa880d2ca0 0x7ffa880d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.358+0000 7ffa8eaba640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa880d1ee0 con 0x7ffa8815e4f0 2024-04-25T02:14:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.358+0000 7ffa8eaba640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa880d21c0 con 0x7ffa880d0ef0 2024-04-25T02:14:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.358+0000 7ffa8eaba640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffa880d3100 con 0x7ffa880d2ca0 2024-04-25T02:14:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa8c856640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ffa8815e4f0 0x7ffa880cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33404/0 (socket says 172.21.15.79:33404) 2024-04-25T02:14:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa8c856640 1 -- 172.21.15.79:0/34779598 learned_addr learned my addr 172.21.15.79:0/34779598 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:14:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa87fff640 1 --2- 172.21.15.79:0/34779598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffa880d2ca0 0x7ffa880d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776023695 0 0) 0x7ffa880d1ee0 con 0x7ffa8815e4f0 2024-04-25T02:14:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa78003520 con 0x7ffa8815e4f0 2024-04-25T02:14:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2969564835 0 0) 0x7ffa880d21c0 con 0x7ffa880d0ef0 2024-04-25T02:14:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa880d1ee0 con 0x7ffa880d0ef0 2024-04-25T02:14:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3899564506 0 0) 0x7ffa78003520 con 0x7ffa8815e4f0 2024-04-25T02:14:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffa880d2ca0 msgr2=0x7ffa880d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 --2- 172.21.15.79:0/34779598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffa880d2ca0 0x7ffa880d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 >> v1:172.21.15.189:6789/0 conn(0x7ffa880d0ef0 legacy=0x7ffa8806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa880d24a0 con 0x7ffa8815e4f0 2024-04-25T02:14:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7ffa7c001670 con 0x7ffa8815e4f0 2024-04-25T02:14:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 >> v1:172.21.15.79:6789/0 conn(0x7ffa8815e4f0 legacy=0x7ffa880cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 --2- 172.21.15.79:0/34779598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa78003b70 0x7ffa78003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 --2- 172.21.15.79:0/34779598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa78004800 0x7ffa78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 --2- 172.21.15.79:0/34779598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffa880d2ca0 0x7ffa780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffa880d3100 con 0x7ffa78004800 2024-04-25T02:14:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7800baf0 con 0x7ffa78003b70 2024-04-25T02:14:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffa7800bcf0 con 0x7ffa880d2ca0 2024-04-25T02:14:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa87fff640 1 --2- 172.21.15.79:0/34779598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa78004800 0x7ffa78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa8c856640 1 --2- 172.21.15.79:0/34779598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa78003b70 0x7ffa78003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.359+0000 7ffa8d057640 1 --2- 172.21.15.79:0/34779598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffa880d2ca0 0x7ffa780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.360+0000 7ffa87fff640 1 -- 172.21.15.79:0/34779598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffa880d2ca0 msgr2=0x7ffa780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.360+0000 7ffa87fff640 1 --2- 172.21.15.79:0/34779598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffa880d2ca0 0x7ffa780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.360+0000 7ffa87fff640 1 -- 172.21.15.79:0/34779598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa78003b70 msgr2=0x7ffa78003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.360+0000 7ffa87fff640 1 --2- 172.21.15.79:0/34779598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa78003b70 0x7ffa78003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.360+0000 7ffa87fff640 1 -- 172.21.15.79:0/34779598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa78003520 con 0x7ffa78004800 2024-04-25T02:14:00.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.360+0000 7ffa87fff640 1 --2- 172.21.15.79:0/34779598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa78004800 0x7ffa78004c80 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009ac0 tx=0x7ffa78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf77777d7ab0945d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:00.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.360+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74036070 con 0x7ffa78004800 2024-04-25T02:14:00.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.360+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa74031400 con 0x7ffa78004800 2024-04-25T02:14:00.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.360+0000 7ffa877fe640 1 -- 172.21.15.79:0/34779598 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74009690 con 0x7ffa78004800 2024-04-25T02:14:00.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.361+0000 7ffa8eaba640 1 -- 172.21.15.79:0/34779598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa78004800 msgr2=0x7ffa78004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.361+0000 7ffa8eaba640 1 --2- 172.21.15.79:0/34779598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa78004800 0x7ffa78004c80 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009ac0 tx=0x7ffa78005830 comp rx=0 tx=0).stop 2024-04-25T02:14:00.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.361+0000 7ffa8d057640 1 -- 172.21.15.79:0/34779598 reap_dead start 2024-04-25T02:14:00.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.361+0000 7ffa8eaba640 1 -- 172.21.15.79:0/34779598 shutdown_connections 2024-04-25T02:14:00.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.361+0000 7ffa8eaba640 1 -- 172.21.15.79:0/34779598 >> 172.21.15.79:0/34779598 conn(0x7ffa8809d4a0 msgr2=0x7ffa880d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:00.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.361+0000 7ffa8eaba640 1 -- 172.21.15.79:0/34779598 shutdown_connections 2024-04-25T02:14:00.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.361+0000 7ffa8eaba640 1 -- 172.21.15.79:0/34779598 wait complete. 2024-04-25T02:14:00.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.362+0000 7ffa8eaba640 1 Processor -- start 2024-04-25T02:14:00.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.362+0000 7ffa8eaba640 1 -- start start 2024-04-25T02:14:00.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa8eaba640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffa78004800 0x7ffa881503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa8eaba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa880b2a30 0x7ffa880b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa8eaba640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa880ccbd0 0x7ffa880cd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa8eaba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffa880d4ee0 con 0x7ffa880b2a30 2024-04-25T02:14:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa8eaba640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa880cff00 con 0x7ffa880ccbd0 2024-04-25T02:14:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa8eaba640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffa880d5060 con 0x7ffa78004800 2024-04-25T02:14:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa87fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa880b2a30 0x7ffa880b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa87fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa880b2a30 0x7ffa880b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35500/0 (socket says 172.21.15.79:35500) 2024-04-25T02:14:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa87fff640 1 -- 172.21.15.79:0/1185745633 learned_addr learned my addr 172.21.15.79:0/1185745633 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa8d057640 1 --2- 172.21.15.79:0/1185745633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa880ccbd0 0x7ffa880cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa8c856640 1 --2- 172.21.15.79:0/1185745633 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffa78004800 0x7ffa881503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa87fff640 1 -- 172.21.15.79:0/1185745633 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffa78004800 msgr2=0x7ffa881503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa87fff640 1 --2- 172.21.15.79:0/1185745633 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffa78004800 0x7ffa881503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa87fff640 1 -- 172.21.15.79:0/1185745633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa880ccbd0 msgr2=0x7ffa880cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa87fff640 1 --2- 172.21.15.79:0/1185745633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa880ccbd0 0x7ffa880cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa87fff640 1 -- 172.21.15.79:0/1185745633 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa880cb3e0 con 0x7ffa880b2a30 2024-04-25T02:14:00.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa8d057640 1 --2- 172.21.15.79:0/1185745633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa880ccbd0 0x7ffa880cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:00.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.363+0000 7ffa87fff640 1 --2- 172.21.15.79:0/1185745633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa880b2a30 0x7ffa880b2eb0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7ffa74034040 tx=0x7ffa74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:00.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.364+0000 7ffa857fa640 1 -- 172.21.15.79:0/1185745633 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74041020 con 0x7ffa880b2a30 2024-04-25T02:14:00.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.364+0000 7ffa857fa640 1 -- 172.21.15.79:0/1185745633 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7403c470 con 0x7ffa880b2a30 2024-04-25T02:14:00.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.364+0000 7ffa8eaba640 1 -- 172.21.15.79:0/1185745633 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa880cb6c0 con 0x7ffa880b2a30 2024-04-25T02:14:00.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.364+0000 7ffa857fa640 1 -- 172.21.15.79:0/1185745633 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74036040 con 0x7ffa880b2a30 2024-04-25T02:14:00.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.364+0000 7ffa8eaba640 1 -- 172.21.15.79:0/1185745633 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa880cbc80 con 0x7ffa880b2a30 2024-04-25T02:14:00.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.365+0000 7ffa857fa640 1 -- 172.21.15.79:0/1185745633 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa74044020 con 0x7ffa880b2a30 2024-04-25T02:14:00.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.366+0000 7ffa857fa640 1 --2- 172.21.15.79:0/1185745633 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa6c06be30 0x7ffa6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.366+0000 7ffa8c856640 1 --2- 172.21.15.79:0/1185745633 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa6c06be30 0x7ffa6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.366+0000 7ffa857fa640 1 -- 172.21.15.79:0/1185745633 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7ffa740ab3b0 con 0x7ffa880b2a30 2024-04-25T02:14:00.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.366+0000 7ffa8c856640 1 --2- 172.21.15.79:0/1185745633 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa6c06be30 0x7ffa6c06e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c007b80 tx=0x7ffa7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:00.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.367+0000 7ffa917ca740 1 Processor -- start 2024-04-25T02:14:00.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.367+0000 7ffa917ca740 1 -- start start 2024-04-25T02:14:00.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.367+0000 7ffa917ca740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741ca7d60 0x558741ca8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.367+0000 7ffa917ca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741cc5600 0x558741cc5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.367+0000 7ffa917ca740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741c7da40 0x558741cc3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.367+0000 7ffa917ca740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558741be16b0 con 0x558741c7da40 2024-04-25T02:14:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.367+0000 7ffa917ca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558741b89880 con 0x558741cc5600 2024-04-25T02:14:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.367+0000 7ffa917ca740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x558741bdd670 con 0x558741ca7d60 2024-04-25T02:14:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.367+0000 7ffa8d057640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741c7da40 0x558741cc3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.367+0000 7ffa8d057640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741c7da40 0x558741cc3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35504/0 (socket says 172.21.15.79:35504) 2024-04-25T02:14:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.367+0000 7ffa8d057640 1 -- 172.21.15.79:0/2752144510 learned_addr learned my addr 172.21.15.79:0/2752144510 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.368+0000 7ffa8c856640 1 --2- 172.21.15.79:0/2752144510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741ca7d60 0x558741ca8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.368+0000 7ffa87fff640 1 --2- 172.21.15.79:0/2752144510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741cc5600 0x558741cc5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.368+0000 7ffa8d057640 1 -- 172.21.15.79:0/2752144510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741ca7d60 msgr2=0x558741ca8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.368+0000 7ffa8d057640 1 --2- 172.21.15.79:0/2752144510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741ca7d60 0x558741ca8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.368+0000 7ffa8d057640 1 -- 172.21.15.79:0/2752144510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741cc5600 msgr2=0x558741cc5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.368+0000 7ffa8d057640 1 --2- 172.21.15.79:0/2752144510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741cc5600 0x558741cc5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.368+0000 7ffa8d057640 1 -- 172.21.15.79:0/2752144510 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587419bf7d0 con 0x558741c7da40 2024-04-25T02:14:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.368+0000 7ffa87fff640 1 --2- 172.21.15.79:0/2752144510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741cc5600 0x558741cc5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.368+0000 7ffa8d057640 1 --2- 172.21.15.79:0/2752144510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741c7da40 0x558741cc3cc0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ffa8808e440 tx=0x7ffa80005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e898970251656d4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.368+0000 7ffa727fc640 1 -- 172.21.15.79:0/2752144510 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa800019d0 con 0x558741c7da40 2024-04-25T02:14:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.368+0000 7ffa727fc640 1 -- 172.21.15.79:0/2752144510 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa80019070 con 0x558741c7da40 2024-04-25T02:14:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.368+0000 7ffa727fc640 1 -- 172.21.15.79:0/2752144510 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80001d70 con 0x558741c7da40 2024-04-25T02:14:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.369+0000 7ffa917ca740 1 -- 172.21.15.79:0/2752144510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741c7da40 msgr2=0x558741cc3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.369+0000 7ffa917ca740 1 --2- 172.21.15.79:0/2752144510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741c7da40 0x558741cc3cc0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ffa8808e440 tx=0x7ffa80005420 comp rx=0 tx=0).stop 2024-04-25T02:14:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.369+0000 7ffa917ca740 1 -- 172.21.15.79:0/2752144510 shutdown_connections 2024-04-25T02:14:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.369+0000 7ffa917ca740 1 --2- 172.21.15.79:0/2752144510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741c7da40 0x558741cc3cc0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.369+0000 7ffa917ca740 1 --2- 172.21.15.79:0/2752144510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741cc5600 0x558741cc5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.369+0000 7ffa917ca740 1 --2- 172.21.15.79:0/2752144510 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741ca7d60 0x558741ca8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.369+0000 7ffa917ca740 1 -- 172.21.15.79:0/2752144510 >> 172.21.15.79:0/2752144510 conn(0x558741c7a600 msgr2=0x558741cc2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.369+0000 7ffa917ca740 1 -- 172.21.15.79:0/2752144510 shutdown_connections 2024-04-25T02:14:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.369+0000 7ffa917ca740 1 -- 172.21.15.79:0/2752144510 wait complete. 2024-04-25T02:14:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.369+0000 7ffa917ca740 1 -- start start 2024-04-25T02:14:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.369+0000 7ffa917ca740 1 Processor -- start 2024-04-25T02:14:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.370+0000 7ffa917ca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741ca7d60 0x558741ca4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.370+0000 7ffa917ca740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741cc5600 0x558741cba860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.370+0000 7ffa917ca740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741cbada0 0x558741cd66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.370+0000 7ffa917ca740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558741c7e7e0 con 0x558741cbada0 2024-04-25T02:14:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.370+0000 7ffa917ca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558741b9cf50 con 0x558741ca7d60 2024-04-25T02:14:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.370+0000 7ffa917ca740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x558741c78530 con 0x558741cc5600 2024-04-25T02:14:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.370+0000 7ffa917ca740 10 client.0 _ll_register_callbacks cb 0x558741bd8000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:14:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.370+0000 7ffa8d057640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741cbada0 0x558741cd66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.370+0000 7ffa8d057640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741cbada0 0x558741cd66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35512/0 (socket says 172.21.15.79:35512) 2024-04-25T02:14:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.370+0000 7ffa8d057640 1 -- 172.21.15.79:0/3799561751 learned_addr learned my addr 172.21.15.79:0/3799561751 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.370+0000 7ffa87fff640 1 --2- 172.21.15.79:0/3799561751 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741cc5600 0x558741cba860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.370+0000 7ffa8c856640 1 --2- 172.21.15.79:0/3799561751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741ca7d60 0x558741ca4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa8d057640 1 -- 172.21.15.79:0/3799561751 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741cc5600 msgr2=0x558741cba860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa8d057640 1 --2- 172.21.15.79:0/3799561751 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741cc5600 0x558741cba860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa8d057640 1 -- 172.21.15.79:0/3799561751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741ca7d60 msgr2=0x558741ca4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa8d057640 1 --2- 172.21.15.79:0/3799561751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741ca7d60 0x558741ca4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa8d057640 1 -- 172.21.15.79:0/3799561751 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587418f53f0 con 0x558741cbada0 2024-04-25T02:14:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa8c856640 1 --2- 172.21.15.79:0/3799561751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741ca7d60 0x558741ca4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:14:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa8d057640 1 --2- 172.21.15.79:0/3799561751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741cbada0 0x558741cd66d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7ffa80015000 tx=0x7ffa80001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ed3698c383d576 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa677fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:14:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa677fe640 1 -- 172.21.15.79:0/3799561751 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80022070 con 0x558741cbada0 2024-04-25T02:14:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa677fe640 1 -- 172.21.15.79:0/3799561751 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7ffa80006d50 con 0x558741cbada0 2024-04-25T02:14:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa917ca740 1 -- 172.21.15.79:0/3799561751 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa80019070 con 0x558741cbada0 2024-04-25T02:14:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa677fe640 1 -- 172.21.15.79:0/3799561751 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7ffa8002d050 con 0x558741cbada0 2024-04-25T02:14:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa917ca740 10 client.7713 fetch_fsmap learned FSMap version 54 2024-04-25T02:14:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa917ca740 1 -- 172.21.15.79:0/3799561751 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x5587418b50f0 con 0x558741cbada0 2024-04-25T02:14:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa677fe640 1 -- 172.21.15.79:0/3799561751 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa80019070 con 0x558741cbada0 2024-04-25T02:14:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa677fe640 1 -- 172.21.15.79:0/3799561751 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7ffa80030020 con 0x558741cbada0 2024-04-25T02:14:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa917ca740 10 client.7713 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T02:14:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa917ca740 10 client.7713 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:14:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa917ca740 20 client.7713 populate_metadata read hostname 'smithi079' 2024-04-25T02:14:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3799561751 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x558741cbe480 0x558741cab040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa917ca740 4 client.7713 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:14:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa917ca740 1 -- 172.21.15.79:0/3799561751 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558741beebf0 con 0x558741cbe480 2024-04-25T02:14:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.371+0000 7ffa8c856640 1 --2- 172.21.15.79:0/3799561751 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x558741cbe480 0x558741cab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.372+0000 7ffa677fe640 10 client.7713 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.372+0000 7ffa8c856640 1 --2- 172.21.15.79:0/3799561751 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x558741cbe480 0x558741cab040 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93a4d99388ffc220 server_cookie=57f6770e0c2bf4df in_seq=0 out_seq=0 2024-04-25T02:14:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.372+0000 7ffa677fe640 1 -- 172.21.15.79:0/3799561751 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558741beebf0 con 0x558741cbe480 2024-04-25T02:14:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.372+0000 7ffa677fe640 10 client.7713 handle_command_reply: tid=0 2024-04-25T02:14:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.372+0000 7ffa917ca740 1 client.7713 shutdown 2024-04-25T02:14:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.372+0000 7ffa917ca740 1 -- 172.21.15.79:0/3799561751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741cbada0 msgr2=0x558741cd66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.372+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3799561751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741cbada0 0x558741cd66d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7ffa80015000 tx=0x7ffa80001650 comp rx=0 tx=0).stop 2024-04-25T02:14:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.372+0000 7ffa917ca740 1 -- 172.21.15.79:0/3799561751 shutdown_connections 2024-04-25T02:14:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.372+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3799561751 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x558741cbe480 0x558741cab040 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.372+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3799561751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741cbada0 0x558741cd66d0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.372+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3799561751 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741cc5600 0x558741cba860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.372+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3799561751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741ca7d60 0x558741ca4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.372+0000 7ffa677fe640 0 client.7713 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.372+0000 7ffa917ca740 1 -- 172.21.15.79:0/3799561751 >> 172.21.15.79:0/3799561751 conn(0x558741c7da40 msgr2=0x558741cc6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.373+0000 7ffa917ca740 1 -- 172.21.15.79:0/3799561751 shutdown_connections 2024-04-25T02:14:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.373+0000 7ffa917ca740 1 -- 172.21.15.79:0/3799561751 wait complete. 2024-04-25T02:14:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.373+0000 7ffa917ca740 20 client.7713 trim_cache size 0 max 16384 2024-04-25T02:14:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.390+0000 7ffa917ca740 1 Processor -- start 2024-04-25T02:14:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.390+0000 7ffa917ca740 1 -- start start 2024-04-25T02:14:00.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa917ca740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741ca7d60 0x558741ca3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa917ca740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741cbada0 0x558741cc2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa917ca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741cc5600 0x558741cb9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa917ca740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffa88201040 con 0x558741ca7d60 2024-04-25T02:14:00.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa917ca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa88200060 con 0x558741cc5600 2024-04-25T02:14:00.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa917ca740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffa880b8280 con 0x558741cbada0 2024-04-25T02:14:00.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa8c856640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741ca7d60 0x558741ca3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa8c856640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741ca7d60 0x558741ca3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35522/0 (socket says 172.21.15.79:35522) 2024-04-25T02:14:00.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa8c856640 1 -- 172.21.15.79:0/3429047746 learned_addr learned my addr 172.21.15.79:0/3429047746 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:00.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa8c856640 1 -- 172.21.15.79:0/3429047746 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741cbada0 msgr2=0x558741cc2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa8c856640 1 --2- 172.21.15.79:0/3429047746 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741cbada0 0x558741cc2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa8c856640 1 -- 172.21.15.79:0/3429047746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741cc5600 msgr2=0x558741cb9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa8c856640 1 --2- 172.21.15.79:0/3429047746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741cc5600 0x558741cb9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa8c856640 1 -- 172.21.15.79:0/3429047746 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558741cabff0 con 0x558741ca7d60 2024-04-25T02:14:00.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa8c856640 1 --2- 172.21.15.79:0/3429047746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741ca7d60 0x558741ca3ba0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c001050 tx=0x7ffa7c00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b842575735f4886 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:00.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa71ffb640 1 -- 172.21.15.79:0/3429047746 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c02d070 con 0x558741ca7d60 2024-04-25T02:14:00.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa71ffb640 1 -- 172.21.15.79:0/3429047746 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7c016950 con 0x558741ca7d60 2024-04-25T02:14:00.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.391+0000 7ffa71ffb640 1 -- 172.21.15.79:0/3429047746 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c016d00 con 0x558741ca7d60 2024-04-25T02:14:00.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.392+0000 7ffa917ca740 1 -- 172.21.15.79:0/3429047746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741ca7d60 msgr2=0x558741ca3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.392+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3429047746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741ca7d60 0x558741ca3ba0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c001050 tx=0x7ffa7c00c000 comp rx=0 tx=0).stop 2024-04-25T02:14:00.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.392+0000 7ffa917ca740 1 -- 172.21.15.79:0/3429047746 shutdown_connections 2024-04-25T02:14:00.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.392+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3429047746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741cc5600 0x558741cb9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.392+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3429047746 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741cbada0 0x558741cc2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.392+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3429047746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741ca7d60 0x558741ca3ba0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.392+0000 7ffa917ca740 1 -- 172.21.15.79:0/3429047746 >> 172.21.15.79:0/3429047746 conn(0x558741c7da40 msgr2=0x558741c7ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:00.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.392+0000 7ffa917ca740 1 -- 172.21.15.79:0/3429047746 shutdown_connections 2024-04-25T02:14:00.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.392+0000 7ffa917ca740 1 -- 172.21.15.79:0/3429047746 wait complete. 2024-04-25T02:14:00.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.392+0000 7ffa917ca740 1 -- start start 2024-04-25T02:14:00.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.393+0000 7ffa917ca740 1 Processor -- start 2024-04-25T02:14:00.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.393+0000 7ffa917ca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741ca7d60 0x558741d25cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.393+0000 7ffa917ca740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741cbada0 0x558741cd5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.393+0000 7ffa917ca740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741cc5600 0x558741ca0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.393+0000 7ffa917ca740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffa880b88d0 con 0x558741cbada0 2024-04-25T02:14:00.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.393+0000 7ffa917ca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558741cbcc60 con 0x558741ca7d60 2024-04-25T02:14:00.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.393+0000 7ffa917ca740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x558741cc0eb0 con 0x558741cc5600 2024-04-25T02:14:00.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.393+0000 7ffa917ca740 10 client.0 _ll_register_callbacks cb 0x7ffa80003e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:14:00.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.393+0000 7ffa87fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741cbada0 0x558741cd5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.393+0000 7ffa87fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741cbada0 0x558741cd5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35530/0 (socket says 172.21.15.79:35530) 2024-04-25T02:14:00.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.393+0000 7ffa87fff640 1 -- 172.21.15.79:0/3970261981 learned_addr learned my addr 172.21.15.79:0/3970261981 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:00.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.393+0000 7ffa8c856640 1 --2- 172.21.15.79:0/3970261981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741ca7d60 0x558741d25cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa8d057640 1 --2- 172.21.15.79:0/3970261981 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741cc5600 0x558741ca0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa87fff640 1 -- 172.21.15.79:0/3970261981 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741cc5600 msgr2=0x558741ca0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa87fff640 1 --2- 172.21.15.79:0/3970261981 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741cc5600 0x558741ca0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa87fff640 1 -- 172.21.15.79:0/3970261981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741ca7d60 msgr2=0x558741d25cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:00.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa87fff640 1 --2- 172.21.15.79:0/3970261981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741ca7d60 0x558741d25cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa87fff640 1 -- 172.21.15.79:0/3970261981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558741c77d70 con 0x558741cbada0 2024-04-25T02:14:00.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa87fff640 1 --2- 172.21.15.79:0/3970261981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741cbada0 0x558741cd5a60 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ffa740a97e0 tx=0x7ffa74009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e31952bd9ac6c68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:00.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa677fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:14:00.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa677fe640 1 -- 172.21.15.79:0/3970261981 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7407d910 con 0x558741cbada0 2024-04-25T02:14:00.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa677fe640 1 -- 172.21.15.79:0/3970261981 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7ffa74081cb0 con 0x558741cbada0 2024-04-25T02:14:00.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa917ca740 1 -- 172.21.15.79:0/3970261981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa7c016950 con 0x558741cbada0 2024-04-25T02:14:00.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa677fe640 1 -- 172.21.15.79:0/3970261981 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7ffa74082140 con 0x558741cbada0 2024-04-25T02:14:00.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa917ca740 10 client.7719 fetch_fsmap learned FSMap version 54 2024-04-25T02:14:00.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa917ca740 1 -- 172.21.15.79:0/3970261981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x558741cc0bf0 con 0x558741cbada0 2024-04-25T02:14:00.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa677fe640 1 -- 172.21.15.79:0/3970261981 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7c016950 con 0x558741cbada0 2024-04-25T02:14:00.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa677fe640 1 -- 172.21.15.79:0/3970261981 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7ffa740789b0 con 0x558741cbada0 2024-04-25T02:14:00.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa917ca740 10 client.7719 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T02:14:00.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa917ca740 10 client.7719 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:14:00.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa917ca740 20 client.7719 populate_metadata read hostname 'smithi079' 2024-04-25T02:14:00.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3970261981 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x558741ca0b60 0x558741c99de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:00.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa917ca740 4 client.7719 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:14:00.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa917ca740 1 -- 172.21.15.79:0/3970261981 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558741be8f40 con 0x558741ca0b60 2024-04-25T02:14:00.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.394+0000 7ffa8c856640 1 --2- 172.21.15.79:0/3970261981 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x558741ca0b60 0x558741c99de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:00.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa677fe640 10 client.7719 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:00.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa8c856640 1 --2- 172.21.15.79:0/3970261981 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x558741ca0b60 0x558741c99de0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a7afbce7669cec8 server_cookie=d331ffcfa25e899a in_seq=0 out_seq=0 2024-04-25T02:14:00.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa677fe640 1 -- 172.21.15.79:0/3970261981 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+256 (crc 0 0 0) 0x558741be8f40 con 0x558741ca0b60 2024-04-25T02:14:00.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa677fe640 10 client.7719 handle_command_reply: tid=0 2024-04-25T02:14:00.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa917ca740 1 client.7719 shutdown 2024-04-25T02:14:00.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa917ca740 1 -- 172.21.15.79:0/3970261981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741cbada0 msgr2=0x558741cd5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3970261981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741cbada0 0x558741cd5a60 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ffa740a97e0 tx=0x7ffa74009750 comp rx=0 tx=0).stop 2024-04-25T02:14:00.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa917ca740 1 -- 172.21.15.79:0/3970261981 shutdown_connections 2024-04-25T02:14:00.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3970261981 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x558741cc5600 0x558741ca0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3970261981 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x558741ca0b60 0x558741c99de0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3970261981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558741cbada0 0x558741cd5a60 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa917ca740 1 --2- 172.21.15.79:0/3970261981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558741ca7d60 0x558741d25cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa677fe640 0 client.7719 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:00.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa917ca740 1 -- 172.21.15.79:0/3970261981 >> 172.21.15.79:0/3970261981 conn(0x558741c7da40 msgr2=0x558741cab040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:00.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa917ca740 1 -- 172.21.15.79:0/3970261981 shutdown_connections 2024-04-25T02:14:00.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa917ca740 1 -- 172.21.15.79:0/3970261981 wait complete. 2024-04-25T02:14:00.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.395+0000 7ffa917ca740 20 client.7719 trim_cache size 0 max 16384 2024-04-25T02:14:00.408 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:14:00.408 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T02:14:00.408 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-04-25T02:14:00.408 INFO:teuthology.orchestra.run.smithi079.stdout: "e82a7a07-cae1-4307-8f44-dd8c90237f42": { 2024-04-25T02:14:00.408 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/dir", 2024-04-25T02:14:00.408 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "e82a7a07-cae1-4307-8f44-dd8c90237f42", 2024-04-25T02:14:00.408 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive" 2024-04-25T02:14:00.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:14:00.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:14:00.408 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:14:00.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.396+0000 7ffa8eaba640 1 -- 172.21.15.79:0/1185745633 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa6c06be30 msgr2=0x7ffa6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.396+0000 7ffa8eaba640 1 --2- 172.21.15.79:0/1185745633 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa6c06be30 0x7ffa6c06e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c007b80 tx=0x7ffa7c009040 comp rx=0 tx=0).stop 2024-04-25T02:14:00.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.396+0000 7ffa8eaba640 1 -- 172.21.15.79:0/1185745633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa880b2a30 msgr2=0x7ffa880b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:00.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.396+0000 7ffa8eaba640 1 --2- 172.21.15.79:0/1185745633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa880b2a30 0x7ffa880b2eb0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7ffa74034040 tx=0x7ffa74004730 comp rx=0 tx=0).stop 2024-04-25T02:14:00.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.396+0000 7ffa8eaba640 1 -- 172.21.15.79:0/1185745633 shutdown_connections 2024-04-25T02:14:00.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.396+0000 7ffa8eaba640 1 --2- 172.21.15.79:0/1185745633 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa6c06be30 0x7ffa6c06e2f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.396+0000 7ffa8eaba640 1 --2- 172.21.15.79:0/1185745633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa880ccbd0 0x7ffa880cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.396+0000 7ffa8eaba640 1 --2- 172.21.15.79:0/1185745633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa880b2a30 0x7ffa880b2eb0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.396+0000 7ffa8eaba640 1 --2- 172.21.15.79:0/1185745633 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffa78004800 0x7ffa881503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:00.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.396+0000 7ffa8eaba640 1 -- 172.21.15.79:0/1185745633 >> 172.21.15.79:0/1185745633 conn(0x7ffa8809d4a0 msgr2=0x7ffa8806cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:00.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.396+0000 7ffa8eaba640 1 -- 172.21.15.79:0/1185745633 shutdown_connections 2024-04-25T02:14:00.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:00.396+0000 7ffa8eaba640 1 -- 172.21.15.79:0/1185745633 wait complete. 2024-04-25T02:14:00.412 INFO:tasks.cephfs.filesystem:scrub status for tag:e82a7a07-cae1-4307-8f44-dd8c90237f42 - {'path': '/dir', 'tag': 'e82a7a07-cae1-4307-8f44-dd8c90237f42', 'options': 'recursive'} 2024-04-25T02:14:00.992 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:14:00.995 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:14:04.633 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:14:04.626+0000 7fb0c78c8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T02:14:30.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:14:30.413 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T02:14:30.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.517+0000 7f41e5a4d640 1 Processor -- start 2024-04-25T02:14:30.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.517+0000 7f41e5a4d640 1 -- start start 2024-04-25T02:14:30.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.518+0000 7f41e5a4d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41e015e5a0 0x7f41e00d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.518+0000 7f41e5a4d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f41e006c3d0 0x7f41e006c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.518+0000 7f41e5a4d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41e006cd50 0x7f41e00ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.518+0000 7f41e5a4d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f41e00cc6c0 con 0x7f41e015e5a0 2024-04-25T02:14:30.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.518+0000 7f41e5a4d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f41e006d200 con 0x7f41e006c3d0 2024-04-25T02:14:30.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.518+0000 7f41e5a4d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f41e00d1460 con 0x7f41e006cd50 2024-04-25T02:14:30.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.518+0000 7f41deffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41e015e5a0 0x7f41e00d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.518+0000 7f41deffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41e015e5a0 0x7f41e00d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50344/0 (socket says 172.21.15.79:50344) 2024-04-25T02:14:30.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.518+0000 7f41deffd640 1 -- 172.21.15.79:0/3106890819 learned_addr learned my addr 172.21.15.79:0/3106890819 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.518+0000 7f41de7fc640 1 --2- 172.21.15.79:0/3106890819 >> v2:172.21.15.189:3300/0 conn(0x7f41e006c3d0 0x7f41e006c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.518+0000 7f41df7fe640 1 --2- 172.21.15.79:0/3106890819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41e006cd50 0x7f41e00ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.519+0000 7f41deffd640 1 -- 172.21.15.79:0/3106890819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41e006cd50 msgr2=0x7f41e00ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.519+0000 7f41deffd640 1 --2- 172.21.15.79:0/3106890819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41e006cd50 0x7f41e00ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.519+0000 7f41deffd640 1 -- 172.21.15.79:0/3106890819 >> v2:172.21.15.189:3300/0 conn(0x7f41e006c3d0 msgr2=0x7f41e006c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.519+0000 7f41deffd640 1 --2- 172.21.15.79:0/3106890819 >> v2:172.21.15.189:3300/0 conn(0x7f41e006c3d0 0x7f41e006c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.519+0000 7f41deffd640 1 -- 172.21.15.79:0/3106890819 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e00d0bc0 con 0x7f41e015e5a0 2024-04-25T02:14:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.519+0000 7f41deffd640 1 --2- 172.21.15.79:0/3106890819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e015e5a0 0x7f41e00d2a60 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f41e00d3040 tx=0x7f41d002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f1b8c9016eeb38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.519+0000 7f41ddffb640 1 -- 172.21.15.79:0/3106890819 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0036070 con 0x7f41e015e5a0 2024-04-25T02:14:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.520+0000 7f41ddffb640 1 -- 172.21.15.79:0/3106890819 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d0031600 con 0x7f41e015e5a0 2024-04-25T02:14:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.520+0000 7f41ddffb640 1 -- 172.21.15.79:0/3106890819 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d00319d0 con 0x7f41e015e5a0 2024-04-25T02:14:30.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.520+0000 7f41e5a4d640 1 -- 172.21.15.79:0/3106890819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e015e5a0 msgr2=0x7f41e00d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:30.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.520+0000 7f41e5a4d640 1 --2- 172.21.15.79:0/3106890819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e015e5a0 0x7f41e00d2a60 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f41e00d3040 tx=0x7f41d002a6a0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.520+0000 7f41e5a4d640 1 -- 172.21.15.79:0/3106890819 shutdown_connections 2024-04-25T02:14:30.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.520+0000 7f41e5a4d640 1 --2- 172.21.15.79:0/3106890819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41e006cd50 0x7f41e00ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.520+0000 7f41e5a4d640 1 --2- 172.21.15.79:0/3106890819 >> v2:172.21.15.189:3300/0 conn(0x7f41e006c3d0 0x7f41e006c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.520+0000 7f41e5a4d640 1 --2- 172.21.15.79:0/3106890819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e015e5a0 0x7f41e00d2a60 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.520+0000 7f41e5a4d640 1 -- 172.21.15.79:0/3106890819 >> 172.21.15.79:0/3106890819 conn(0x7f41e00d1f40 msgr2=0x7f41e00d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.520+0000 7f41e5a4d640 1 -- 172.21.15.79:0/3106890819 shutdown_connections 2024-04-25T02:14:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.520+0000 7f41e5a4d640 1 -- 172.21.15.79:0/3106890819 wait complete. 2024-04-25T02:14:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.521+0000 7f41e5a4d640 1 Processor -- start 2024-04-25T02:14:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.521+0000 7f41e5a4d640 1 -- start start 2024-04-25T02:14:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.522+0000 7f41e5a4d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41e006c3d0 0x7f41e01534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.522+0000 7f41e5a4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e006cd50 0x7f41e00b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.522+0000 7f41e5a4d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41e015e5a0 0x7f41e00afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.522+0000 7f41e5a4d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f41e015e980 con 0x7f41e006cd50 2024-04-25T02:14:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.522+0000 7f41e5a4d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f41e00d1180 con 0x7f41e015e5a0 2024-04-25T02:14:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.522+0000 7f41e5a4d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f41e015eb00 con 0x7f41e006c3d0 2024-04-25T02:14:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.522+0000 7f41de7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e006cd50 0x7f41e00b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.522+0000 7f41de7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e006cd50 0x7f41e00b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50354/0 (socket says 172.21.15.79:50354) 2024-04-25T02:14:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.522+0000 7f41de7fc640 1 -- 172.21.15.79:0/532622758 learned_addr learned my addr 172.21.15.79:0/532622758 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.523+0000 7f41deffd640 1 --2- 172.21.15.79:0/532622758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41e006c3d0 0x7f41e01534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.523+0000 7f41de7fc640 1 -- 172.21.15.79:0/532622758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41e006c3d0 msgr2=0x7f41e01534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.523+0000 7f41df7fe640 1 --2- 172.21.15.79:0/532622758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41e015e5a0 0x7f41e00afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.523+0000 7f41de7fc640 1 --2- 172.21.15.79:0/532622758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41e006c3d0 0x7f41e01534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.523+0000 7f41de7fc640 1 -- 172.21.15.79:0/532622758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41e015e5a0 msgr2=0x7f41e00afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.523+0000 7f41de7fc640 1 --2- 172.21.15.79:0/532622758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41e015e5a0 0x7f41e00afd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.523+0000 7f41de7fc640 1 -- 172.21.15.79:0/532622758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e0153a30 con 0x7f41e006cd50 2024-04-25T02:14:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.523+0000 7f41de7fc640 1 --2- 172.21.15.79:0/532622758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e006cd50 0x7f41e00b2870 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f41d400d7d0 tx=0x7f41d400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.523+0000 7f41c7fff640 1 -- 172.21.15.79:0/532622758 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4018030 con 0x7f41e006cd50 2024-04-25T02:14:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.523+0000 7f41c7fff640 1 -- 172.21.15.79:0/532622758 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d4004020 con 0x7f41e006cd50 2024-04-25T02:14:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.523+0000 7f41e5a4d640 1 -- 172.21.15.79:0/532622758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e009fb40 con 0x7f41e006cd50 2024-04-25T02:14:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.523+0000 7f41c7fff640 1 -- 172.21.15.79:0/532622758 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4004230 con 0x7f41e006cd50 2024-04-25T02:14:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.523+0000 7f41e5a4d640 1 -- 172.21.15.79:0/532622758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e009ed80 con 0x7f41e006cd50 2024-04-25T02:14:30.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.525+0000 7f41c7fff640 1 -- 172.21.15.79:0/532622758 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41d401b070 con 0x7f41e006cd50 2024-04-25T02:14:30.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.525+0000 7f41c7fff640 1 --2- 172.21.15.79:0/532622758 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41cc06be30 0x7f41cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.525+0000 7f41c7fff640 1 -- 172.21.15.79:0/532622758 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f41d408aff0 con 0x7f41e006cd50 2024-04-25T02:14:30.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.525+0000 7f41deffd640 1 --2- 172.21.15.79:0/532622758 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41cc06be30 0x7f41cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.525+0000 7f41deffd640 1 --2- 172.21.15.79:0/532622758 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41cc06be30 0x7f41cc06e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f41d0033000 tx=0x7f41d0009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:30.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.526+0000 7f41e883a740 1 Processor -- start 2024-04-25T02:14:30.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.526+0000 7f41e883a740 1 -- start start 2024-04-25T02:14:30.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41e883a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8b6d60 0x56348f8b7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41e883a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8d4600 0x56348f8d4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41e883a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f88ca40 0x56348f8d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41e883a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56348f7f06b0 con 0x56348f8b6d60 2024-04-25T02:14:30.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41e883a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56348f798880 con 0x56348f88ca40 2024-04-25T02:14:30.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41e883a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56348f7ec670 con 0x56348f8d4600 2024-04-25T02:14:30.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41deffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8b6d60 0x56348f8b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41deffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8b6d60 0x56348f8b7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50356/0 (socket says 172.21.15.79:50356) 2024-04-25T02:14:30.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41deffd640 1 -- 172.21.15.79:0/2072295228 learned_addr learned my addr 172.21.15.79:0/2072295228 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:30.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41df7fe640 1 --2- 172.21.15.79:0/2072295228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f88ca40 0x56348f8d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41de7fc640 1 --2- 172.21.15.79:0/2072295228 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8d4600 0x56348f8d4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41deffd640 1 -- 172.21.15.79:0/2072295228 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8d4600 msgr2=0x56348f8d4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:30.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41deffd640 1 --2- 172.21.15.79:0/2072295228 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8d4600 0x56348f8d4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41deffd640 1 -- 172.21.15.79:0/2072295228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f88ca40 msgr2=0x56348f8d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:30.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41deffd640 1 --2- 172.21.15.79:0/2072295228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f88ca40 0x56348f8d2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41deffd640 1 -- 172.21.15.79:0/2072295228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348f5ce7d0 con 0x56348f8b6d60 2024-04-25T02:14:30.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41de7fc640 1 --2- 172.21.15.79:0/2072295228 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8d4600 0x56348f8d4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:14:30.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.527+0000 7f41deffd640 1 --2- 172.21.15.79:0/2072295228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8b6d60 0x56348f8b7140 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f41d0034040 tx=0x7f41d002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905f1390e2813a8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:30.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.528+0000 7f41c57fa640 1 -- 172.21.15.79:0/2072295228 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0036040 con 0x56348f8b6d60 2024-04-25T02:14:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.528+0000 7f41c57fa640 1 -- 172.21.15.79:0/2072295228 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d004c070 con 0x56348f8b6d60 2024-04-25T02:14:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.528+0000 7f41c57fa640 1 -- 172.21.15.79:0/2072295228 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d003d8c0 con 0x56348f8b6d60 2024-04-25T02:14:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.528+0000 7f41e883a740 1 -- 172.21.15.79:0/2072295228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8b6d60 msgr2=0x56348f8b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.528+0000 7f41e883a740 1 --2- 172.21.15.79:0/2072295228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8b6d60 0x56348f8b7140 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f41d0034040 tx=0x7f41d002e000 comp rx=0 tx=0).stop 2024-04-25T02:14:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.528+0000 7f41e883a740 1 -- 172.21.15.79:0/2072295228 shutdown_connections 2024-04-25T02:14:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.528+0000 7f41e883a740 1 --2- 172.21.15.79:0/2072295228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f88ca40 0x56348f8d2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.528+0000 7f41e883a740 1 --2- 172.21.15.79:0/2072295228 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8d4600 0x56348f8d4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.528+0000 7f41e883a740 1 --2- 172.21.15.79:0/2072295228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8b6d60 0x56348f8b7140 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.528+0000 7f41e883a740 1 -- 172.21.15.79:0/2072295228 >> 172.21.15.79:0/2072295228 conn(0x56348f889600 msgr2=0x56348f8d1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.528+0000 7f41e883a740 1 -- 172.21.15.79:0/2072295228 shutdown_connections 2024-04-25T02:14:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.528+0000 7f41e883a740 1 -- 172.21.15.79:0/2072295228 wait complete. 2024-04-25T02:14:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.529+0000 7f41e883a740 1 -- start start 2024-04-25T02:14:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.529+0000 7f41e883a740 1 Processor -- start 2024-04-25T02:14:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41e883a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8b6d60 0x56348f8aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41e883a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8d4600 0x56348f8bc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41e883a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8ab570 0x56348f8c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41e883a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56348f88d7e0 con 0x56348f8ab570 2024-04-25T02:14:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41e883a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56348f7abf50 con 0x56348f8d4600 2024-04-25T02:14:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41e883a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56348f887530 con 0x56348f8b6d60 2024-04-25T02:14:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41e883a740 10 client.0 _ll_register_callbacks cb 0x56348f7e7000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:14:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41df7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8ab570 0x56348f8c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41df7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8ab570 0x56348f8c0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50372/0 (socket says 172.21.15.79:50372) 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41df7fe640 1 -- 172.21.15.79:0/315535329 learned_addr learned my addr 172.21.15.79:0/315535329 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41de7fc640 1 --2- 172.21.15.79:0/315535329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8d4600 0x56348f8bc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41df7fe640 1 -- 172.21.15.79:0/315535329 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8b6d60 msgr2=0x56348f8aaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41deffd640 1 --2- 172.21.15.79:0/315535329 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8b6d60 0x56348f8aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41df7fe640 1 --2- 172.21.15.79:0/315535329 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8b6d60 0x56348f8aaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41df7fe640 1 -- 172.21.15.79:0/315535329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8d4600 msgr2=0x56348f8bc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41df7fe640 1 --2- 172.21.15.79:0/315535329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8d4600 0x56348f8bc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41df7fe640 1 -- 172.21.15.79:0/315535329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56348f5043f0 con 0x56348f8ab570 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41de7fc640 1 --2- 172.21.15.79:0/315535329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8d4600 0x56348f8bc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41df7fe640 1 --2- 172.21.15.79:0/315535329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8ab570 0x56348f8c0c90 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f41d8010320 tx=0x7f41d80107e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bb994b75ac558d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41be7fc640 1 -- 172.21.15.79:0/315535329 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d8019030 con 0x56348f8ab570 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41be7fc640 1 -- 172.21.15.79:0/315535329 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f41d8004020 con 0x56348f8ab570 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.530+0000 7f41e883a740 1 -- 172.21.15.79:0/315535329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41d004c070 con 0x56348f8ab570 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.531+0000 7f41be7fc640 1 -- 172.21.15.79:0/315535329 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f41d8022050 con 0x56348f8ab570 2024-04-25T02:14:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.531+0000 7f41e883a740 10 client.7731 fetch_fsmap learned FSMap version 55 2024-04-25T02:14:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.531+0000 7f41e883a740 1 -- 172.21.15.79:0/315535329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x56348f4c40f0 con 0x56348f8ab570 2024-04-25T02:14:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.531+0000 7f41be7fc640 1 -- 172.21.15.79:0/315535329 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d004c070 con 0x56348f8ab570 2024-04-25T02:14:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.531+0000 7f41be7fc640 1 -- 172.21.15.79:0/315535329 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f41d8025020 con 0x56348f8ab570 2024-04-25T02:14:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.531+0000 7f41e883a740 10 client.7731 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T02:14:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.531+0000 7f41e883a740 10 client.7731 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:14:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.531+0000 7f41e883a740 20 client.7731 populate_metadata read hostname 'smithi079' 2024-04-25T02:14:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.531+0000 7f41e883a740 1 --2- 172.21.15.79:0/315535329 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x56348f8e5720 0x56348f8e5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.531+0000 7f41e883a740 4 client.7731 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:14:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.531+0000 7f41e883a740 1 -- 172.21.15.79:0/315535329 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56348f7fdbf0 con 0x56348f8e5720 2024-04-25T02:14:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.531+0000 7f41deffd640 1 --2- 172.21.15.79:0/315535329 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x56348f8e5720 0x56348f8e5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.531+0000 7f41be7fc640 10 client.7731 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.531+0000 7f41deffd640 1 --2- 172.21.15.79:0/315535329 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x56348f8e5720 0x56348f8e5b00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddfd586c4f7e890f server_cookie=8dc0afa99398e071 in_seq=0 out_seq=0 2024-04-25T02:14:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.532+0000 7f41be7fc640 1 -- 172.21.15.79:0/315535329 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56348f7fdbf0 con 0x56348f8e5720 2024-04-25T02:14:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.532+0000 7f41be7fc640 10 client.7731 handle_command_reply: tid=0 2024-04-25T02:14:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.532+0000 7f41e883a740 1 client.7731 shutdown 2024-04-25T02:14:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.532+0000 7f41e883a740 1 -- 172.21.15.79:0/315535329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8ab570 msgr2=0x56348f8c0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.532+0000 7f41e883a740 1 --2- 172.21.15.79:0/315535329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8ab570 0x56348f8c0c90 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f41d8010320 tx=0x7f41d80107e0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.532+0000 7f41e883a740 1 -- 172.21.15.79:0/315535329 shutdown_connections 2024-04-25T02:14:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.532+0000 7f41e883a740 1 --2- 172.21.15.79:0/315535329 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x56348f8e5720 0x56348f8e5b00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.532+0000 7f41e883a740 1 --2- 172.21.15.79:0/315535329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8ab570 0x56348f8c0c90 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.532+0000 7f41e883a740 1 --2- 172.21.15.79:0/315535329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8d4600 0x56348f8bc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.532+0000 7f41e883a740 1 --2- 172.21.15.79:0/315535329 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8b6d60 0x56348f8aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.532+0000 7f41be7fc640 0 client.7731 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.532+0000 7f41e883a740 1 -- 172.21.15.79:0/315535329 >> 172.21.15.79:0/315535329 conn(0x56348f88ca40 msgr2=0x56348f8d5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.532+0000 7f41e883a740 1 -- 172.21.15.79:0/315535329 shutdown_connections 2024-04-25T02:14:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.532+0000 7f41e883a740 1 -- 172.21.15.79:0/315535329 wait complete. 2024-04-25T02:14:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.532+0000 7f41e883a740 20 client.7731 trim_cache size 0 max 16384 2024-04-25T02:14:30.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.550+0000 7f41e883a740 1 Processor -- start 2024-04-25T02:14:30.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.550+0000 7f41e883a740 1 -- start start 2024-04-25T02:14:30.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.550+0000 7f41e883a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8ab570 0x56348f8f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.550+0000 7f41e883a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8b6d60 0x56348f8f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.550+0000 7f41e883a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8d4600 0x56348f88bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.550+0000 7f41e883a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f41e02007f0 con 0x56348f8b6d60 2024-04-25T02:14:30.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.550+0000 7f41e883a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f41e01ff830 con 0x56348f8ab570 2024-04-25T02:14:30.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.550+0000 7f41e883a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f41e009c670 con 0x56348f8d4600 2024-04-25T02:14:30.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.551+0000 7f41de7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8b6d60 0x56348f8f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.551+0000 7f41de7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8b6d60 0x56348f8f5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50382/0 (socket says 172.21.15.79:50382) 2024-04-25T02:14:30.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.551+0000 7f41de7fc640 1 -- 172.21.15.79:0/3160527815 learned_addr learned my addr 172.21.15.79:0/3160527815 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:30.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.551+0000 7f41deffd640 1 --2- 172.21.15.79:0/3160527815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8ab570 0x56348f8f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.551+0000 7f41df7fe640 1 --2- 172.21.15.79:0/3160527815 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8d4600 0x56348f88bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.551+0000 7f41de7fc640 1 -- 172.21.15.79:0/3160527815 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8d4600 msgr2=0x56348f88bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:30.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.551+0000 7f41de7fc640 1 --2- 172.21.15.79:0/3160527815 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8d4600 0x56348f88bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.551+0000 7f41de7fc640 1 -- 172.21.15.79:0/3160527815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8ab570 msgr2=0x56348f8f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:30.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.551+0000 7f41de7fc640 1 --2- 172.21.15.79:0/3160527815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8ab570 0x56348f8f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.551+0000 7f41de7fc640 1 -- 172.21.15.79:0/3160527815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348f8864a0 con 0x56348f8b6d60 2024-04-25T02:14:30.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.551+0000 7f41de7fc640 1 --2- 172.21.15.79:0/3160527815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8b6d60 0x56348f8f5c30 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f41d40556a0 tx=0x7f41d4059300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ddd1b9ea73e68b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:30.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.551+0000 7f41c4ff9640 1 -- 172.21.15.79:0/3160527815 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4057540 con 0x56348f8b6d60 2024-04-25T02:14:30.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.551+0000 7f41c4ff9640 1 -- 172.21.15.79:0/3160527815 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d40043d0 con 0x56348f8b6d60 2024-04-25T02:14:30.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.551+0000 7f41c4ff9640 1 -- 172.21.15.79:0/3160527815 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d40558b0 con 0x56348f8b6d60 2024-04-25T02:14:30.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.552+0000 7f41e883a740 1 -- 172.21.15.79:0/3160527815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8b6d60 msgr2=0x56348f8f5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:30.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.552+0000 7f41e883a740 1 --2- 172.21.15.79:0/3160527815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8b6d60 0x56348f8f5c30 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f41d40556a0 tx=0x7f41d4059300 comp rx=0 tx=0).stop 2024-04-25T02:14:30.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.552+0000 7f41e883a740 1 -- 172.21.15.79:0/3160527815 shutdown_connections 2024-04-25T02:14:30.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.552+0000 7f41e883a740 1 --2- 172.21.15.79:0/3160527815 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8d4600 0x56348f88bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.552+0000 7f41e883a740 1 --2- 172.21.15.79:0/3160527815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8b6d60 0x56348f8f5c30 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.552+0000 7f41e883a740 1 --2- 172.21.15.79:0/3160527815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8ab570 0x56348f8f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.552+0000 7f41e883a740 1 -- 172.21.15.79:0/3160527815 >> 172.21.15.79:0/3160527815 conn(0x56348f88ca40 msgr2=0x56348f8aad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:30.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.552+0000 7f41e883a740 1 -- 172.21.15.79:0/3160527815 shutdown_connections 2024-04-25T02:14:30.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.552+0000 7f41e883a740 1 -- 172.21.15.79:0/3160527815 wait complete. 2024-04-25T02:14:30.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.552+0000 7f41e883a740 1 -- start start 2024-04-25T02:14:30.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.552+0000 7f41e883a740 1 Processor -- start 2024-04-25T02:14:30.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.553+0000 7f41e883a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8ab570 0x56348f9349f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.553+0000 7f41e883a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8b6d60 0x56348f8e0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.553+0000 7f41e883a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8d4600 0x56348f94bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.553+0000 7f41e883a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56348f8bdac0 con 0x56348f8ab570 2024-04-25T02:14:30.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.553+0000 7f41e883a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f41e009ccc0 con 0x56348f8d4600 2024-04-25T02:14:30.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.553+0000 7f41e883a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56348f7ad220 con 0x56348f8b6d60 2024-04-25T02:14:30.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.553+0000 7f41e883a740 10 client.0 _ll_register_callbacks cb 0x7f41d8009240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:14:30.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.553+0000 7f41deffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8ab570 0x56348f9349f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.553+0000 7f41deffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8ab570 0x56348f9349f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50386/0 (socket says 172.21.15.79:50386) 2024-04-25T02:14:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.553+0000 7f41deffd640 1 -- 172.21.15.79:0/914414521 learned_addr learned my addr 172.21.15.79:0/914414521 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.553+0000 7f41df7fe640 1 --2- 172.21.15.79:0/914414521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8d4600 0x56348f94bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.553+0000 7f41de7fc640 1 --2- 172.21.15.79:0/914414521 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8b6d60 0x56348f8e0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.553+0000 7f41deffd640 1 -- 172.21.15.79:0/914414521 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8b6d60 msgr2=0x56348f8e0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.553+0000 7f41deffd640 1 --2- 172.21.15.79:0/914414521 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8b6d60 0x56348f8e0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41deffd640 1 -- 172.21.15.79:0/914414521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8d4600 msgr2=0x56348f94bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41deffd640 1 --2- 172.21.15.79:0/914414521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8d4600 0x56348f94bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41deffd640 1 -- 172.21.15.79:0/914414521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56348f8bf0b0 con 0x56348f8ab570 2024-04-25T02:14:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41df7fe640 1 --2- 172.21.15.79:0/914414521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8d4600 0x56348f94bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41deffd640 1 --2- 172.21.15.79:0/914414521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8ab570 0x56348f9349f0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009f40 tx=0x7f41d002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98820e4ea2ecf7d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:14:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41be7fc640 1 -- 172.21.15.79:0/914414521 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d005e060 con 0x56348f8ab570 2024-04-25T02:14:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41be7fc640 1 -- 172.21.15.79:0/914414521 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f41d0059dc0 con 0x56348f8ab570 2024-04-25T02:14:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41e883a740 1 -- 172.21.15.79:0/914414521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41d40043d0 con 0x56348f8ab570 2024-04-25T02:14:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41be7fc640 1 -- 172.21.15.79:0/914414521 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f41d0064050 con 0x56348f8ab570 2024-04-25T02:14:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41e883a740 10 client.7737 fetch_fsmap learned FSMap version 55 2024-04-25T02:14:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41e883a740 1 -- 172.21.15.79:0/914414521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x56348f8e07d0 con 0x56348f8ab570 2024-04-25T02:14:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41be7fc640 1 -- 172.21.15.79:0/914414521 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d40043d0 con 0x56348f8ab570 2024-04-25T02:14:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41be7fc640 1 -- 172.21.15.79:0/914414521 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f41d0067020 con 0x56348f8ab570 2024-04-25T02:14:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41e883a740 10 client.7737 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T02:14:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41e883a740 10 client.7737 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:14:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41e883a740 20 client.7737 populate_metadata read hostname 'smithi079' 2024-04-25T02:14:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41e883a740 1 --2- 172.21.15.79:0/914414521 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x56348f8c0900 0x56348f88beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41e883a740 4 client.7737 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:14:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41e883a740 1 -- 172.21.15.79:0/914414521 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56348f7f7f40 con 0x56348f8c0900 2024-04-25T02:14:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.554+0000 7f41de7fc640 1 --2- 172.21.15.79:0/914414521 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x56348f8c0900 0x56348f88beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41be7fc640 10 client.7737 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41de7fc640 1 --2- 172.21.15.79:0/914414521 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x56348f8c0900 0x56348f88beb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dce124bd0ee50a56 server_cookie=7e24124a6bcb32ab in_seq=0 out_seq=0 2024-04-25T02:14:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41be7fc640 1 -- 172.21.15.79:0/914414521 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56348f7f7f40 con 0x56348f8c0900 2024-04-25T02:14:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41be7fc640 10 client.7737 handle_command_reply: tid=0 2024-04-25T02:14:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e883a740 1 client.7737 shutdown 2024-04-25T02:14:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e883a740 1 -- 172.21.15.79:0/914414521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8ab570 msgr2=0x56348f9349f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e883a740 1 --2- 172.21.15.79:0/914414521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8ab570 0x56348f9349f0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009f40 tx=0x7f41d002c000 comp rx=0 tx=0).stop 2024-04-25T02:14:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e883a740 1 -- 172.21.15.79:0/914414521 shutdown_connections 2024-04-25T02:14:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e883a740 1 --2- 172.21.15.79:0/914414521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56348f8d4600 0x56348f94bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e883a740 1 --2- 172.21.15.79:0/914414521 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56348f8b6d60 0x56348f8e0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e883a740 1 --2- 172.21.15.79:0/914414521 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x56348f8c0900 0x56348f88beb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e883a740 1 --2- 172.21.15.79:0/914414521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56348f8ab570 0x56348f9349f0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41be7fc640 0 client.7737 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e883a740 1 -- 172.21.15.79:0/914414521 >> 172.21.15.79:0/914414521 conn(0x56348f88ca40 msgr2=0x56348f8bbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e883a740 1 -- 172.21.15.79:0/914414521 shutdown_connections 2024-04-25T02:14:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e883a740 1 -- 172.21.15.79:0/914414521 wait complete. 2024-04-25T02:14:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e883a740 20 client.7737 trim_cache size 0 max 16384 2024-04-25T02:14:30.568 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:14:30.568 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-04-25T02:14:30.568 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-04-25T02:14:30.568 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:14:30.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e5a4d640 1 -- 172.21.15.79:0/532622758 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41cc06be30 msgr2=0x7f41cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:30.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e5a4d640 1 --2- 172.21.15.79:0/532622758 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41cc06be30 0x7f41cc06e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f41d0033000 tx=0x7f41d0009000 comp rx=0 tx=0).stop 2024-04-25T02:14:30.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e5a4d640 1 -- 172.21.15.79:0/532622758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e006cd50 msgr2=0x7f41e00b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:30.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.555+0000 7f41e5a4d640 1 --2- 172.21.15.79:0/532622758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e006cd50 0x7f41e00b2870 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f41d400d7d0 tx=0x7f41d400dc90 comp rx=0 tx=0).stop 2024-04-25T02:14:30.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.556+0000 7f41e5a4d640 1 -- 172.21.15.79:0/532622758 shutdown_connections 2024-04-25T02:14:30.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.556+0000 7f41e5a4d640 1 --2- 172.21.15.79:0/532622758 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41cc06be30 0x7f41cc06e2f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.556+0000 7f41e5a4d640 1 --2- 172.21.15.79:0/532622758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41e015e5a0 0x7f41e00afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.556+0000 7f41e5a4d640 1 --2- 172.21.15.79:0/532622758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e006cd50 0x7f41e00b2870 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.556+0000 7f41e5a4d640 1 --2- 172.21.15.79:0/532622758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41e006c3d0 0x7f41e01534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.556+0000 7f41e5a4d640 1 -- 172.21.15.79:0/532622758 >> 172.21.15.79:0/532622758 conn(0x7f41e00d1f40 msgr2=0x7f41e00ccb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.556+0000 7f41e5a4d640 1 -- 172.21.15.79:0/532622758 shutdown_connections 2024-04-25T02:14:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.556+0000 7f41e5a4d640 1 -- 172.21.15.79:0/532622758 wait complete. 2024-04-25T02:14:30.572 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T02:14:30.572 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:14:30.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.664+0000 7f6494a61640 1 Processor -- start 2024-04-25T02:14:30.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.664+0000 7f6494a61640 1 -- start start 2024-04-25T02:14:30.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f6494a61640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6490144cb0 0x7f64900b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f6494a61640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f64900b5580 0x7f649006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f6494a61640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6490070d90 con 0x7f649006e490 2024-04-25T02:14:30.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f6494a61640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f649006e900 con 0x7f64900b5580 2024-04-25T02:14:30.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f6494a61640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f64900cf130 con 0x7f6490144cb0 2024-04-25T02:14:30.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f648ed9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f649006e490 0x7f649015fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48914/0 (socket says 172.21.15.79:48914) 2024-04-25T02:14:30.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f648ed9d640 1 -- 172.21.15.79:0/3658849455 learned_addr learned my addr 172.21.15.79:0/3658849455 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:14:30.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f6487fff640 1 --2- 172.21.15.79:0/3658849455 >> v2:172.21.15.189:3300/0 conn(0x7f64900b5580 0x7f649006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f648dd9b640 1 -- 172.21.15.79:0/3658849455 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3219651091 0 0) 0x7f6490070d90 con 0x7f649006e490 2024-04-25T02:14:30.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f648e59c640 1 --2- 172.21.15.79:0/3658849455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6490144cb0 0x7f64900b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f648dd9b640 1 -- 172.21.15.79:0/3658849455 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f647c003520 con 0x7f649006e490 2024-04-25T02:14:30.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f648dd9b640 1 -- 172.21.15.79:0/3658849455 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2098283094 0 0) 0x7f647c003520 con 0x7f649006e490 2024-04-25T02:14:30.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f648dd9b640 1 -- 172.21.15.79:0/3658849455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6490144cb0 msgr2=0x7f64900b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:30.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f648dd9b640 1 --2- 172.21.15.79:0/3658849455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6490144cb0 0x7f64900b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f648dd9b640 1 -- 172.21.15.79:0/3658849455 >> v2:172.21.15.189:3300/0 conn(0x7f64900b5580 msgr2=0x7f649006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:30.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f648dd9b640 1 --2- 172.21.15.79:0/3658849455 >> v2:172.21.15.189:3300/0 conn(0x7f64900b5580 0x7f649006df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.665+0000 7f648dd9b640 1 -- 172.21.15.79:0/3658849455 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64900cf410 con 0x7f649006e490 2024-04-25T02:14:30.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648dd9b640 1 -- 172.21.15.79:0/3658849455 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f64880019f0 con 0x7f649006e490 2024-04-25T02:14:30.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648dd9b640 1 -- 172.21.15.79:0/3658849455 >> v1:172.21.15.79:6789/0 conn(0x7f649006e490 legacy=0x7f649015fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:30.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648dd9b640 1 --2- 172.21.15.79:0/3658849455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f647c0039b0 0x7f647c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648dd9b640 1 --2- 172.21.15.79:0/3658849455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f647c004800 0x7f647c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648dd9b640 1 --2- 172.21.15.79:0/3658849455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6490144cb0 0x7f647c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648dd9b640 1 -- 172.21.15.79:0/3658849455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f649006e900 con 0x7f647c0039b0 2024-04-25T02:14:30.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648dd9b640 1 -- 172.21.15.79:0/3658849455 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f64900cf130 con 0x7f647c004800 2024-04-25T02:14:30.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648dd9b640 1 -- 172.21.15.79:0/3658849455 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f647c00ba40 con 0x7f6490144cb0 2024-04-25T02:14:30.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648e59c640 1 --2- 172.21.15.79:0/3658849455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f647c0039b0 0x7f647c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f6487fff640 1 --2- 172.21.15.79:0/3658849455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f647c004800 0x7f647c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648ed9d640 1 --2- 172.21.15.79:0/3658849455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6490144cb0 0x7f647c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648e59c640 1 -- 172.21.15.79:0/3658849455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6490144cb0 msgr2=0x7f647c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:30.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648e59c640 1 --2- 172.21.15.79:0/3658849455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6490144cb0 0x7f647c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648e59c640 1 -- 172.21.15.79:0/3658849455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f647c004800 msgr2=0x7f647c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:30.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648e59c640 1 --2- 172.21.15.79:0/3658849455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f647c004800 0x7f647c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648e59c640 1 -- 172.21.15.79:0/3658849455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c003520 con 0x7f647c0039b0 2024-04-25T02:14:30.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f648ed9d640 1 --2- 172.21.15.79:0/3658849455 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6490144cb0 0x7f647c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:30.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.666+0000 7f6487fff640 1 --2- 172.21.15.79:0/3658849455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f647c004800 0x7f647c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:30.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.667+0000 7f648e59c640 1 --2- 172.21.15.79:0/3658849455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f647c0039b0 0x7f647c003dd0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f6480009ac0 tx=0x7f647c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112e81aec3ce5cdd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:30.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.667+0000 7f648dd9b640 1 -- 172.21.15.79:0/3658849455 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480036070 con 0x7f647c0039b0 2024-04-25T02:14:30.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.667+0000 7f648dd9b640 1 -- 172.21.15.79:0/3658849455 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6480031400 con 0x7f647c0039b0 2024-04-25T02:14:30.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.667+0000 7f648dd9b640 1 -- 172.21.15.79:0/3658849455 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480009690 con 0x7f647c0039b0 2024-04-25T02:14:30.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.667+0000 7f6494a61640 1 -- 172.21.15.79:0/3658849455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f647c0039b0 msgr2=0x7f647c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:30.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.667+0000 7f6494a61640 1 --2- 172.21.15.79:0/3658849455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f647c0039b0 0x7f647c003dd0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f6480009ac0 tx=0x7f647c005830 comp rx=0 tx=0).stop 2024-04-25T02:14:30.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.667+0000 7f648ed9d640 1 -- 172.21.15.79:0/3658849455 reap_dead start 2024-04-25T02:14:30.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.667+0000 7f6494a61640 1 -- 172.21.15.79:0/3658849455 shutdown_connections 2024-04-25T02:14:30.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.667+0000 7f6494a61640 1 -- 172.21.15.79:0/3658849455 >> 172.21.15.79:0/3658849455 conn(0x7f64900cfc80 msgr2=0x7f64900d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:30.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.667+0000 7f6494a61640 1 -- 172.21.15.79:0/3658849455 shutdown_connections 2024-04-25T02:14:30.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.667+0000 7f6494a61640 1 -- 172.21.15.79:0/3658849455 wait complete. 2024-04-25T02:14:30.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.669+0000 7f6494a61640 1 Processor -- start 2024-04-25T02:14:30.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.669+0000 7f6494a61640 1 -- start start 2024-04-25T02:14:30.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.669+0000 7f6494a61640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f647c0039b0 0x7f649015b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.669+0000 7f6494a61640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6490142150 0x7f64901425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.669+0000 7f6494a61640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f649012e040 0x7f649012e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.669+0000 7f6494a61640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6490145090 con 0x7f6490142150 2024-04-25T02:14:30.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.669+0000 7f6494a61640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f64900cf9d0 con 0x7f647c0039b0 2024-04-25T02:14:30.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.669+0000 7f6494a61640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6490145ab0 con 0x7f649012e040 2024-04-25T02:14:30.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.669+0000 7f6487fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6490142150 0x7f64901425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.669+0000 7f6487fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6490142150 0x7f64901425d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50402/0 (socket says 172.21.15.79:50402) 2024-04-25T02:14:30.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.669+0000 7f6487fff640 1 -- 172.21.15.79:0/2236777662 learned_addr learned my addr 172.21.15.79:0/2236777662 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:30.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.670+0000 7f648e59c640 1 --2- 172.21.15.79:0/2236777662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f647c0039b0 0x7f649015b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.670+0000 7f648ed9d640 1 --2- 172.21.15.79:0/2236777662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f649012e040 0x7f649012e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.670+0000 7f6487fff640 1 -- 172.21.15.79:0/2236777662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f649012e040 msgr2=0x7f649012e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:30.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.670+0000 7f6487fff640 1 --2- 172.21.15.79:0/2236777662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f649012e040 0x7f649012e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.670+0000 7f6487fff640 1 -- 172.21.15.79:0/2236777662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f647c0039b0 msgr2=0x7f649015b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:30.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.670+0000 7f6487fff640 1 --2- 172.21.15.79:0/2236777662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f647c0039b0 0x7f649015b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.670+0000 7f6487fff640 1 -- 172.21.15.79:0/2236777662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6490140910 con 0x7f6490142150 2024-04-25T02:14:30.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.670+0000 7f648e59c640 1 --2- 172.21.15.79:0/2236777662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f647c0039b0 0x7f649015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:30.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.670+0000 7f6487fff640 1 --2- 172.21.15.79:0/2236777662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6490142150 0x7f64901425d0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f6478011700 tx=0x7f6478011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:30.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.670+0000 7f6486ffd640 1 -- 172.21.15.79:0/2236777662 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647800f9c0 con 0x7f6490142150 2024-04-25T02:14:30.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.670+0000 7f6486ffd640 1 -- 172.21.15.79:0/2236777662 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f647800fb60 con 0x7f6490142150 2024-04-25T02:14:30.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.670+0000 7f6494a61640 1 -- 172.21.15.79:0/2236777662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6490142cc0 con 0x7f6490142150 2024-04-25T02:14:30.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.670+0000 7f6486ffd640 1 -- 172.21.15.79:0/2236777662 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6478015460 con 0x7f6490142150 2024-04-25T02:14:30.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.670+0000 7f6494a61640 1 -- 172.21.15.79:0/2236777662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6490143280 con 0x7f6490142150 2024-04-25T02:14:30.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.671+0000 7f6494a61640 1 -- 172.21.15.79:0/2236777662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64900690a0 con 0x7f6490142150 2024-04-25T02:14:30.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.672+0000 7f6486ffd640 1 -- 172.21.15.79:0/2236777662 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6478015600 con 0x7f6490142150 2024-04-25T02:14:30.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.672+0000 7f6486ffd640 1 --2- 172.21.15.79:0/2236777662 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f647006be30 0x7f647006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:30.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.672+0000 7f6486ffd640 1 -- 172.21.15.79:0/2236777662 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f647808b880 con 0x7f6490142150 2024-04-25T02:14:30.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.672+0000 7f648e59c640 1 --2- 172.21.15.79:0/2236777662 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f647006be30 0x7f647006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:30.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.673+0000 7f648e59c640 1 --2- 172.21.15.79:0/2236777662 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f647006be30 0x7f647006e2f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6480033000 tx=0x7f6480008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:30.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.677+0000 7f6486ffd640 1 -- 172.21.15.79:0/2236777662 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6478019030 con 0x7f6490142150 2024-04-25T02:14:30.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.883+0000 7f6494a61640 1 -- 172.21.15.79:0/2236777662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64900b5160 con 0x7f6490142150 2024-04-25T02:14:30.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.884+0000 7f6486ffd640 1 -- 172.21.15.79:0/2236777662 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5187 (secure 0 0 0) 0x7f647805a1d0 con 0x7f6490142150 2024-04-25T02:14:30.890 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:14:30.890 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:14:04.613172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":6,"addr":"172.21.15.79:6837/630320044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":630320044},{"type":"v1","addr":"172.21.15.79:6837","nonce":630320044}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7602,"qdb_cluster":[7602]},"id":6}]} 2024-04-25T02:14:30.890 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 55 2024-04-25T02:14:30.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.885+0000 7f6494a61640 1 -- 172.21.15.79:0/2236777662 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f647006be30 msgr2=0x7f647006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:30.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.885+0000 7f6494a61640 1 --2- 172.21.15.79:0/2236777662 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f647006be30 0x7f647006e2f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6480033000 tx=0x7f6480008030 comp rx=0 tx=0).stop 2024-04-25T02:14:30.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.886+0000 7f6494a61640 1 -- 172.21.15.79:0/2236777662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6490142150 msgr2=0x7f64901425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:30.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.886+0000 7f6494a61640 1 --2- 172.21.15.79:0/2236777662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6490142150 0x7f64901425d0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f6478011700 tx=0x7f6478011bc0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.886+0000 7f6494a61640 1 -- 172.21.15.79:0/2236777662 shutdown_connections 2024-04-25T02:14:30.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.886+0000 7f6494a61640 1 --2- 172.21.15.79:0/2236777662 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f647006be30 0x7f647006e2f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.886+0000 7f6494a61640 1 --2- 172.21.15.79:0/2236777662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f649012e040 0x7f649012e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.886+0000 7f6494a61640 1 --2- 172.21.15.79:0/2236777662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6490142150 0x7f64901425d0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.886+0000 7f6494a61640 1 --2- 172.21.15.79:0/2236777662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f647c0039b0 0x7f649015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:30.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.886+0000 7f6494a61640 1 -- 172.21.15.79:0/2236777662 >> 172.21.15.79:0/2236777662 conn(0x7f64900cfc80 msgr2=0x7f64900afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:30.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.886+0000 7f6494a61640 1 -- 172.21.15.79:0/2236777662 shutdown_connections 2024-04-25T02:14:30.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.886+0000 7f6494a61640 1 -- 172.21.15.79:0/2236777662 wait complete. 2024-04-25T02:14:30.902 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T02:14:31.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.995+0000 7f1a98b9e640 1 Processor -- start 2024-04-25T02:14:31.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.995+0000 7f1a98b9e640 1 -- start start 2024-04-25T02:14:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.996+0000 7f1a98b9e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1a9415e4b0 0x7f1a940b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.996+0000 7f1a98b9e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a940ce160 con 0x7f1a9415e0d0 2024-04-25T02:14:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.996+0000 7f1a98b9e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a940d1240 con 0x7f1a940b72f0 2024-04-25T02:14:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.996+0000 7f1a98b9e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f1a940cc390 con 0x7f1a9415e4b0 2024-04-25T02:14:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.996+0000 7f1a937fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1a9415e0d0 0x7f1a940d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48922/0 (socket says 172.21.15.79:48922) 2024-04-25T02:14:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.996+0000 7f1a937fe640 1 -- 172.21.15.79:0/2696801978 learned_addr learned my addr 172.21.15.79:0/2696801978 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:14:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.996+0000 7f1a927fc640 1 -- 172.21.15.79:0/2696801978 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 978425627 0 0) 0x7f1a940ce160 con 0x7f1a9415e0d0 2024-04-25T02:14:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.996+0000 7f1a927fc640 1 -- 172.21.15.79:0/2696801978 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a7c003520 con 0x7f1a9415e0d0 2024-04-25T02:14:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.996+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/2696801978 >> v2:172.21.15.189:3300/0 conn(0x7f1a9415e4b0 0x7f1a940b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.996+0000 7f1a927fc640 1 -- 172.21.15.79:0/2696801978 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1879510732 0 0) 0x7f1a7c003520 con 0x7f1a9415e0d0 2024-04-25T02:14:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.996+0000 7f1a927fc640 1 -- 172.21.15.79:0/2696801978 >> v2:172.21.15.189:3300/0 conn(0x7f1a9415e4b0 msgr2=0x7f1a940b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.996+0000 7f1a927fc640 1 --2- 172.21.15.79:0/2696801978 >> v2:172.21.15.189:3300/0 conn(0x7f1a9415e4b0 0x7f1a940b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.996+0000 7f1a927fc640 1 -- 172.21.15.79:0/2696801978 >> v1:172.21.15.189:6789/0 conn(0x7f1a940b72f0 legacy=0x7f1a9406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.996+0000 7f1a927fc640 1 -- 172.21.15.79:0/2696801978 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a940cc670 con 0x7f1a9415e0d0 2024-04-25T02:14:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.996+0000 7f1a927fc640 1 -- 172.21.15.79:0/2696801978 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f1a84001670 con 0x7f1a9415e0d0 2024-04-25T02:14:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a927fc640 1 -- 172.21.15.79:0/2696801978 >> v1:172.21.15.79:6789/0 conn(0x7f1a9415e0d0 legacy=0x7f1a940d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a927fc640 1 --2- 172.21.15.79:0/2696801978 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a7c0039b0 0x7f1a7c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a927fc640 1 --2- 172.21.15.79:0/2696801978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c004800 0x7f1a7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a927fc640 1 --2- 172.21.15.79:0/2696801978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a7c0051c0 0x7f1a7c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a927fc640 1 -- 172.21.15.79:0/2696801978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1a940cc390 con 0x7f1a7c004800 2024-04-25T02:14:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a927fc640 1 -- 172.21.15.79:0/2696801978 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c00c060 con 0x7f1a7c0051c0 2024-04-25T02:14:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a927fc640 1 -- 172.21.15.79:0/2696801978 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1a7c00c260 con 0x7f1a7c0039b0 2024-04-25T02:14:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/2696801978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c004800 0x7f1a7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a937fe640 1 --2- 172.21.15.79:0/2696801978 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a7c0039b0 0x7f1a7c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a93fff640 1 --2- 172.21.15.79:0/2696801978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a7c0051c0 0x7f1a7c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a92ffd640 1 -- 172.21.15.79:0/2696801978 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a7c0039b0 msgr2=0x7f1a7c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/2696801978 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a7c0039b0 0x7f1a7c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a92ffd640 1 -- 172.21.15.79:0/2696801978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a7c0051c0 msgr2=0x7f1a7c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/2696801978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a7c0051c0 0x7f1a7c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a92ffd640 1 -- 172.21.15.79:0/2696801978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7c003520 con 0x7f1a7c004800 2024-04-25T02:14:31.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a937fe640 1 --2- 172.21.15.79:0/2696801978 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a7c0039b0 0x7f1a7c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:31.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a93fff640 1 --2- 172.21.15.79:0/2696801978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a7c0051c0 0x7f1a7c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:31.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.997+0000 7f1a93fff640 1 -- 172.21.15.79:0/2696801978 reap_dead start 2024-04-25T02:14:31.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.998+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/2696801978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c004800 0x7f1a7c004c80 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009a90 tx=0x7f1a7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d445582eda1631 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.998+0000 7f1a927fc640 1 -- 172.21.15.79:0/2696801978 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88036070 con 0x7f1a7c004800 2024-04-25T02:14:31.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.998+0000 7f1a927fc640 1 -- 172.21.15.79:0/2696801978 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a88031400 con 0x7f1a7c004800 2024-04-25T02:14:31.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.998+0000 7f1a927fc640 1 -- 172.21.15.79:0/2696801978 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88009690 con 0x7f1a7c004800 2024-04-25T02:14:31.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.998+0000 7f1a98b9e640 1 -- 172.21.15.79:0/2696801978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c004800 msgr2=0x7f1a7c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.998+0000 7f1a98b9e640 1 --2- 172.21.15.79:0/2696801978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c004800 0x7f1a7c004c80 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009a90 tx=0x7f1a7c005830 comp rx=0 tx=0).stop 2024-04-25T02:14:31.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.998+0000 7f1a98b9e640 1 -- 172.21.15.79:0/2696801978 shutdown_connections 2024-04-25T02:14:31.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.998+0000 7f1a98b9e640 1 --2- 172.21.15.79:0/2696801978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c004800 0x7f1a7c004c80 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.998+0000 7f1a98b9e640 1 -- 172.21.15.79:0/2696801978 >> 172.21.15.79:0/2696801978 conn(0x7f1a940d1ca0 msgr2=0x7f1a940d20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.998+0000 7f1a98b9e640 1 -- 172.21.15.79:0/2696801978 shutdown_connections 2024-04-25T02:14:31.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:30.998+0000 7f1a98b9e640 1 -- 172.21.15.79:0/2696801978 wait complete. 2024-04-25T02:14:31.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.000+0000 7f1a98b9e640 1 Processor -- start 2024-04-25T02:14:31.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.000+0000 7f1a98b9e640 1 -- start start 2024-04-25T02:14:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.000+0000 7f1a98b9e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a7c004800 0x7f1a941f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.000+0000 7f1a98b9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a940ca550 0x7f1a9415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.000+0000 7f1a98b9e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a9415c1a0 0x7f1a9415e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.000+0000 7f1a98b9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1a940b4af0 con 0x7f1a940ca550 2024-04-25T02:14:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.000+0000 7f1a98b9e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1a940ccc30 con 0x7f1a7c004800 2024-04-25T02:14:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.000+0000 7f1a98b9e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1a940b6db0 con 0x7f1a9415c1a0 2024-04-25T02:14:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a92ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a940ca550 0x7f1a9415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a92ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a940ca550 0x7f1a9415bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50418/0 (socket says 172.21.15.79:50418) 2024-04-25T02:14:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a92ffd640 1 -- 172.21.15.79:0/2563356003 learned_addr learned my addr 172.21.15.79:0/2563356003 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a937fe640 1 --2- 172.21.15.79:0/2563356003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a7c004800 0x7f1a941f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a93fff640 1 --2- 172.21.15.79:0/2563356003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a9415c1a0 0x7f1a9415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a92ffd640 1 -- 172.21.15.79:0/2563356003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a9415c1a0 msgr2=0x7f1a9415e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/2563356003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a9415c1a0 0x7f1a9415e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a92ffd640 1 -- 172.21.15.79:0/2563356003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a7c004800 msgr2=0x7f1a941f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/2563356003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a7c004800 0x7f1a941f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a92ffd640 1 -- 172.21.15.79:0/2563356003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9415f690 con 0x7f1a940ca550 2024-04-25T02:14:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a937fe640 1 --2- 172.21.15.79:0/2563356003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a7c004800 0x7f1a941f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/2563356003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a940ca550 0x7f1a9415bc60 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f1a88034040 tx=0x7f1a88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a7bfff640 1 -- 172.21.15.79:0/2563356003 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8803f020 con 0x7f1a940ca550 2024-04-25T02:14:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a7bfff640 1 -- 172.21.15.79:0/2563356003 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a88037040 con 0x7f1a940ca550 2024-04-25T02:14:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a7bfff640 1 -- 172.21.15.79:0/2563356003 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88036070 con 0x7f1a940ca550 2024-04-25T02:14:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a98b9e640 1 -- 172.21.15.79:0/2563356003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a940c9a70 con 0x7f1a940ca550 2024-04-25T02:14:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.001+0000 7f1a98b9e640 1 -- 172.21.15.79:0/2563356003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a941f4860 con 0x7f1a940ca550 2024-04-25T02:14:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.003+0000 7f1a7bfff640 1 -- 172.21.15.79:0/2563356003 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a88042020 con 0x7f1a940ca550 2024-04-25T02:14:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.003+0000 7f1a7bfff640 1 --2- 172.21.15.79:0/2563356003 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1a8006be60 0x7f1a8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.003+0000 7f1a7bfff640 1 -- 172.21.15.79:0/2563356003 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f1a880aaec0 con 0x7f1a940ca550 2024-04-25T02:14:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.003+0000 7f1a937fe640 1 --2- 172.21.15.79:0/2563356003 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1a8006be60 0x7f1a8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.003+0000 7f1a937fe640 1 --2- 172.21.15.79:0/2563356003 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1a8006be60 0x7f1a8006e320 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1a94068890 tx=0x7f1a84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.004+0000 7f1a9cbeb740 1 Processor -- start 2024-04-25T02:14:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.004+0000 7f1a9cbeb740 1 -- start start 2024-04-25T02:14:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a9cbeb740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d3c530 0x55fbe9d3fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a9cbeb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d401f0 0x55fbe9d5c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a9cbeb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d5c670 0x55fbe9d5cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a9cbeb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fbe9c78520 con 0x55fbe9d401f0 2024-04-25T02:14:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a9cbeb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fbe9c16ae0 con 0x55fbe9d5c670 2024-04-25T02:14:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a9cbeb740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55fbe9c744e0 con 0x55fbe9d3c530 2024-04-25T02:14:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a92ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d401f0 0x55fbe9d5c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a92ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d401f0 0x55fbe9d5c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50432/0 (socket says 172.21.15.79:50432) 2024-04-25T02:14:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a92ffd640 1 -- 172.21.15.79:0/183654692 learned_addr learned my addr 172.21.15.79:0/183654692 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a937fe640 1 --2- 172.21.15.79:0/183654692 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d3c530 0x55fbe9d3fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a93fff640 1 --2- 172.21.15.79:0/183654692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d5c670 0x55fbe9d5cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a92ffd640 1 -- 172.21.15.79:0/183654692 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d3c530 msgr2=0x55fbe9d3fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/183654692 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d3c530 0x55fbe9d3fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a92ffd640 1 -- 172.21.15.79:0/183654692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d5c670 msgr2=0x55fbe9d5cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/183654692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d5c670 0x55fbe9d5cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a92ffd640 1 -- 172.21.15.79:0/183654692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbe9c3c240 con 0x55fbe9d401f0 2024-04-25T02:14:31.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.005+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/183654692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d401f0 0x55fbe9d5c130 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f1a880a93c0 tx=0x7f1a88079320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd394582a1234238 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.006+0000 7f1a797fa640 1 -- 172.21.15.79:0/183654692 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880a6020 con 0x55fbe9d401f0 2024-04-25T02:14:31.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.006+0000 7f1a797fa640 1 -- 172.21.15.79:0/183654692 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a88077560 con 0x55fbe9d401f0 2024-04-25T02:14:31.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.006+0000 7f1a797fa640 1 -- 172.21.15.79:0/183654692 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880819b0 con 0x55fbe9d401f0 2024-04-25T02:14:31.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.006+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/183654692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d401f0 msgr2=0x55fbe9d5c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.006+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/183654692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d401f0 0x55fbe9d5c130 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f1a880a93c0 tx=0x7f1a88079320 comp rx=0 tx=0).stop 2024-04-25T02:14:31.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.006+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/183654692 shutdown_connections 2024-04-25T02:14:31.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.006+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/183654692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d5c670 0x55fbe9d5cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.006+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/183654692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d401f0 0x55fbe9d5c130 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.006+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/183654692 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d3c530 0x55fbe9d3fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.006+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/183654692 >> 172.21.15.79:0/183654692 conn(0x55fbe9d12510 msgr2=0x55fbe9d13510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.006+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/183654692 shutdown_connections 2024-04-25T02:14:31.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.006+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/183654692 wait complete. 2024-04-25T02:14:31.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.007+0000 7f1a9cbeb740 1 -- start start 2024-04-25T02:14:31.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.007+0000 7f1a9cbeb740 1 Processor -- start 2024-04-25T02:14:31.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a9cbeb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 0x55fbe9d6abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a9cbeb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d5c670 0x55fbe9d3af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a9cbeb740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d3b460 0x55fbe9d38f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a9cbeb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fbe9c744e0 con 0x55fbe9d5c670 2024-04-25T02:14:31.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a9cbeb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fbe9c14470 con 0x55fbe9d401f0 2024-04-25T02:14:31.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a9cbeb740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55fbe9c78520 con 0x55fbe9d3b460 2024-04-25T02:14:31.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a9cbeb740 10 client.0 _ll_register_callbacks cb 0x55fbe9c38dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:14:31.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a92ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d5c670 0x55fbe9d3af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a92ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d5c670 0x55fbe9d3af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50446/0 (socket says 172.21.15.79:50446) 2024-04-25T02:14:31.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a92ffd640 1 -- 172.21.15.79:0/4076826773 learned_addr learned my addr 172.21.15.79:0/4076826773 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a93fff640 1 --2- 172.21.15.79:0/4076826773 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d3b460 0x55fbe9d38f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a92ffd640 1 -- 172.21.15.79:0/4076826773 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d3b460 msgr2=0x55fbe9d38f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/4076826773 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d3b460 0x55fbe9d38f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a937fe640 1 --2- 172.21.15.79:0/4076826773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 0x55fbe9d6abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a92ffd640 1 -- 172.21.15.79:0/4076826773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 msgr2=0x55fbe9d6abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/4076826773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 0x55fbe9d6abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a92ffd640 1 -- 172.21.15.79:0/4076826773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbe9c2bbf0 con 0x55fbe9d5c670 2024-04-25T02:14:31.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/4076826773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d5c670 0x55fbe9d3af20 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f1a880a9360 tx=0x7f1a88043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1039821620f19f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a727fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:14:31.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a727fc640 1 -- 172.21.15.79:0/4076826773 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8809d060 con 0x55fbe9d5c670 2024-04-25T02:14:31.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a727fc640 1 -- 172.21.15.79:0/4076826773 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f1a8807d170 con 0x55fbe9d5c670 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/4076826773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a88077560 con 0x55fbe9d5c670 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a727fc640 1 -- 172.21.15.79:0/4076826773 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f1a88098070 con 0x55fbe9d5c670 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.008+0000 7f1a9cbeb740 10 client.7755 fetch_fsmap learned FSMap version 55 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.009+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/4076826773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55fbe9a587c0 con 0x55fbe9d5c670 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.009+0000 7f1a727fc640 1 -- 172.21.15.79:0/4076826773 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a88085080 con 0x55fbe9d5c670 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.009+0000 7f1a727fc640 1 -- 172.21.15.79:0/4076826773 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f1a880786b0 con 0x55fbe9d5c670 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.009+0000 7f1a9cbeb740 10 client.7755 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.009+0000 7f1a9cbeb740 10 client.7755 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.009+0000 7f1a9cbeb740 20 client.7755 populate_metadata read hostname 'smithi079' 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.009+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/4076826773 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55fbe9d56b60 0x55fbe9d56f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.009+0000 7f1a9cbeb740 4 client.7755 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.009+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/4076826773 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbe9c8bd50 con 0x55fbe9d56b60 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.009+0000 7f1a937fe640 1 --2- 172.21.15.79:0/4076826773 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55fbe9d56b60 0x55fbe9d56f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.009+0000 7f1a937fe640 1 --2- 172.21.15.79:0/4076826773 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55fbe9d56b60 0x55fbe9d56f40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fee5ab51351211a8 server_cookie=7d3a4ee4893b843f in_seq=0 out_seq=0 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.009+0000 7f1a727fc640 10 client.7755 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:31.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.010+0000 7f1a727fc640 1 -- 172.21.15.79:0/4076826773 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fbe9c8bd50 con 0x55fbe9d56b60 2024-04-25T02:14:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.010+0000 7f1a727fc640 10 client.7755 handle_command_reply: tid=0 2024-04-25T02:14:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.010+0000 7f1a9cbeb740 1 client.7755 shutdown 2024-04-25T02:14:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.010+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/4076826773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d5c670 msgr2=0x55fbe9d3af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.010+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/4076826773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d5c670 0x55fbe9d3af20 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f1a880a9360 tx=0x7f1a88043000 comp rx=0 tx=0).stop 2024-04-25T02:14:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.010+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/4076826773 shutdown_connections 2024-04-25T02:14:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.010+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/4076826773 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d3b460 0x55fbe9d38f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.010+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/4076826773 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55fbe9d56b60 0x55fbe9d56f40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.010+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/4076826773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d5c670 0x55fbe9d3af20 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.010+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/4076826773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 0x55fbe9d6abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.010+0000 7f1a727fc640 0 client.7755 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.010+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/4076826773 >> 172.21.15.79:0/4076826773 conn(0x55fbe9d3c530 msgr2=0x55fbe9d0f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.010+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/4076826773 shutdown_connections 2024-04-25T02:14:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.010+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/4076826773 wait complete. 2024-04-25T02:14:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.010+0000 7f1a9cbeb740 20 client.7755 trim_cache size 0 max 16384 2024-04-25T02:14:31.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.023+0000 7f1a9cbeb740 1 Processor -- start 2024-04-25T02:14:31.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.023+0000 7f1a9cbeb740 1 -- start start 2024-04-25T02:14:31.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a9cbeb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d3b460 0x55fbe9d11720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a9cbeb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 0x55fbe9d3a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a9cbeb740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d5c670 0x55fbe9d10530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a9cbeb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1a94200020 con 0x55fbe9d3b460 2024-04-25T02:14:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a9cbeb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941ff380 con 0x55fbe9d401f0 2024-04-25T02:14:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a9cbeb740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1a941ff9d0 con 0x55fbe9d5c670 2024-04-25T02:14:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a937fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d3b460 0x55fbe9d11720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a937fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d3b460 0x55fbe9d11720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50458/0 (socket says 172.21.15.79:50458) 2024-04-25T02:14:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a937fe640 1 -- 172.21.15.79:0/2318175880 learned_addr learned my addr 172.21.15.79:0/2318175880 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a937fe640 1 -- 172.21.15.79:0/2318175880 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d5c670 msgr2=0x55fbe9d10530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a937fe640 1 --2- 172.21.15.79:0/2318175880 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d5c670 0x55fbe9d10530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a937fe640 1 -- 172.21.15.79:0/2318175880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 msgr2=0x55fbe9d3a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/2318175880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 0x55fbe9d3a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a937fe640 1 --2- 172.21.15.79:0/2318175880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 0x55fbe9d3a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a937fe640 1 -- 172.21.15.79:0/2318175880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbe9ab8f50 con 0x55fbe9d3b460 2024-04-25T02:14:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/2318175880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 0x55fbe9d3a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:14:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.024+0000 7f1a937fe640 1 --2- 172.21.15.79:0/2318175880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d3b460 0x55fbe9d11720 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f1a84010a30 tx=0x7f1a8400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772fd5e16e47fa2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.025+0000 7f1a78ff9640 1 -- 172.21.15.79:0/2318175880 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8402d070 con 0x55fbe9d3b460 2024-04-25T02:14:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.025+0000 7f1a78ff9640 1 -- 172.21.15.79:0/2318175880 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a84027180 con 0x55fbe9d3b460 2024-04-25T02:14:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.025+0000 7f1a78ff9640 1 -- 172.21.15.79:0/2318175880 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a84027550 con 0x55fbe9d3b460 2024-04-25T02:14:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.025+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/2318175880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d3b460 msgr2=0x55fbe9d11720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.025+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/2318175880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d3b460 0x55fbe9d11720 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f1a84010a30 tx=0x7f1a8400e000 comp rx=0 tx=0).stop 2024-04-25T02:14:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.025+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/2318175880 shutdown_connections 2024-04-25T02:14:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.025+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/2318175880 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d5c670 0x55fbe9d10530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.025+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/2318175880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 0x55fbe9d3a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.025+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/2318175880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d3b460 0x55fbe9d11720 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.025+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/2318175880 >> 172.21.15.79:0/2318175880 conn(0x55fbe9d3c530 msgr2=0x55fbe9d5af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.025+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/2318175880 shutdown_connections 2024-04-25T02:14:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.025+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/2318175880 wait complete. 2024-04-25T02:14:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.026+0000 7f1a9cbeb740 1 -- start start 2024-04-25T02:14:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.026+0000 7f1a9cbeb740 1 Processor -- start 2024-04-25T02:14:31.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.026+0000 7f1a9cbeb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d3b460 0x55fbe9d5e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.026+0000 7f1a9cbeb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 0x55fbe9d5e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.026+0000 7f1a9cbeb740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d5c670 0x55fbe9d37c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a9cbeb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fbe9d3bfe0 con 0x55fbe9d3b460 2024-04-25T02:14:31.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a9cbeb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fbe9c16ae0 con 0x55fbe9d401f0 2024-04-25T02:14:31.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a9cbeb740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55fbe9d56640 con 0x55fbe9d5c670 2024-04-25T02:14:31.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a9cbeb740 10 client.0 _ll_register_callbacks cb 0x7f1a88079960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:14:31.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a937fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d3b460 0x55fbe9d5e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a937fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d3b460 0x55fbe9d5e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50474/0 (socket says 172.21.15.79:50474) 2024-04-25T02:14:31.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a937fe640 1 -- 172.21.15.79:0/908208273 learned_addr learned my addr 172.21.15.79:0/908208273 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/908208273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 0x55fbe9d5e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a93fff640 1 --2- 172.21.15.79:0/908208273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d5c670 0x55fbe9d37c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a937fe640 1 -- 172.21.15.79:0/908208273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d5c670 msgr2=0x55fbe9d37c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a937fe640 1 --2- 172.21.15.79:0/908208273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d5c670 0x55fbe9d37c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a937fe640 1 -- 172.21.15.79:0/908208273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 msgr2=0x55fbe9d5e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a937fe640 1 --2- 172.21.15.79:0/908208273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 0x55fbe9d5e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a937fe640 1 -- 172.21.15.79:0/908208273 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbe994c0b0 con 0x55fbe9d3b460 2024-04-25T02:14:31.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a93fff640 1 --2- 172.21.15.79:0/908208273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d5c670 0x55fbe9d37c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:31.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a937fe640 1 --2- 172.21.15.79:0/908208273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d3b460 0x55fbe9d5e230 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f1a84016040 tx=0x7f1a84001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add8a4cb1cf64331 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a727fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:14:31.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a727fc640 1 -- 172.21.15.79:0/908208273 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a84036060 con 0x55fbe9d3b460 2024-04-25T02:14:31.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a727fc640 1 -- 172.21.15.79:0/908208273 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f1a840275f0 con 0x55fbe9d3b460 2024-04-25T02:14:31.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/908208273 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a84027180 con 0x55fbe9d3b460 2024-04-25T02:14:31.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a727fc640 1 -- 172.21.15.79:0/908208273 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f1a8403c050 con 0x55fbe9d3b460 2024-04-25T02:14:31.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a9cbeb740 10 client.7761 fetch_fsmap learned FSMap version 55 2024-04-25T02:14:31.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/908208273 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55fbe9c05780 con 0x55fbe9d3b460 2024-04-25T02:14:31.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.027+0000 7f1a727fc640 1 -- 172.21.15.79:0/908208273 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a84027180 con 0x55fbe9d3b460 2024-04-25T02:14:31.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a727fc640 1 -- 172.21.15.79:0/908208273 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f1a8403f020 con 0x55fbe9d3b460 2024-04-25T02:14:31.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 10 client.7761 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T02:14:31.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 10 client.7761 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:14:31.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 20 client.7761 populate_metadata read hostname 'smithi079' 2024-04-25T02:14:31.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/908208273 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55fbe9dd4e20 0x55fbe9dd5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 4 client.7761 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T02:14:31.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/908208273 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55fbe9c85a60 con 0x55fbe9dd4e20 2024-04-25T02:14:31.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/908208273 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55fbe9dd4e20 0x55fbe9dd5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a727fc640 10 client.7761 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:31.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a92ffd640 1 --2- 172.21.15.79:0/908208273 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55fbe9dd4e20 0x55fbe9dd5200 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=578a900bb5c527dd server_cookie=79308370db4a9638 in_seq=0 out_seq=0 2024-04-25T02:14:31.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a727fc640 1 -- 172.21.15.79:0/908208273 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+418 (crc 0 0 0) 0x55fbe9c85a60 con 0x55fbe9dd4e20 2024-04-25T02:14:31.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a727fc640 10 client.7761 handle_command_reply: tid=0 2024-04-25T02:14:31.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 1 client.7761 shutdown 2024-04-25T02:14:31.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/908208273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d3b460 msgr2=0x55fbe9d5e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/908208273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d3b460 0x55fbe9d5e230 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f1a84016040 tx=0x7f1a84001a40 comp rx=0 tx=0).stop 2024-04-25T02:14:31.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/908208273 shutdown_connections 2024-04-25T02:14:31.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/908208273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbe9d5c670 0x55fbe9d37c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/908208273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbe9d401f0 0x55fbe9d5e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/908208273 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55fbe9dd4e20 0x55fbe9dd5200 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 1 --2- 172.21.15.79:0/908208273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9d3b460 0x55fbe9d5e230 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a727fc640 0 client.7761 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:31.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/908208273 >> 172.21.15.79:0/908208273 conn(0x55fbe9d3c530 msgr2=0x55fbe9d5b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/908208273 shutdown_connections 2024-04-25T02:14:31.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.028+0000 7f1a9cbeb740 1 -- 172.21.15.79:0/908208273 wait complete. 2024-04-25T02:14:31.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.029+0000 7f1a9cbeb740 20 client.7761 trim_cache size 0 max 16384 2024-04-25T02:14:31.041 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:14:31.041 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-04-25T02:14:31.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:14:31.041 INFO:teuthology.orchestra.run.smithi079.stdout: "damage_type": "backtrace", 2024-04-25T02:14:31.041 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 113979766, 2024-04-25T02:14:31.041 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627777, 2024-04-25T02:14:31.041 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/testdir/hardlink" 2024-04-25T02:14:31.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:14:31.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:14:31.042 INFO:teuthology.orchestra.run.smithi079.stdout: "damage_type": "backtrace", 2024-04-25T02:14:31.042 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 954027020, 2024-04-25T02:14:31.042 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627776, 2024-04-25T02:14:31.042 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/dir" 2024-04-25T02:14:31.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:14:31.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:14:31.042 INFO:teuthology.orchestra.run.smithi079.stdout: "damage_type": "dir_frag", 2024-04-25T02:14:31.042 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4267656783, 2024-04-25T02:14:31.042 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627776, 2024-04-25T02:14:31.042 INFO:teuthology.orchestra.run.smithi079.stdout: "frag": "*", 2024-04-25T02:14:31.042 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/dir" 2024-04-25T02:14:31.042 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:14:31.042 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-04-25T02:14:31.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.029+0000 7f1a98b9e640 1 -- 172.21.15.79:0/2563356003 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1a8006be60 msgr2=0x7f1a8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.029+0000 7f1a98b9e640 1 --2- 172.21.15.79:0/2563356003 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1a8006be60 0x7f1a8006e320 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1a94068890 tx=0x7f1a84009040 comp rx=0 tx=0).stop 2024-04-25T02:14:31.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.029+0000 7f1a98b9e640 1 -- 172.21.15.79:0/2563356003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a940ca550 msgr2=0x7f1a9415bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.029+0000 7f1a98b9e640 1 --2- 172.21.15.79:0/2563356003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a940ca550 0x7f1a9415bc60 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f1a88034040 tx=0x7f1a88004730 comp rx=0 tx=0).stop 2024-04-25T02:14:31.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.029+0000 7f1a98b9e640 1 -- 172.21.15.79:0/2563356003 shutdown_connections 2024-04-25T02:14:31.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.029+0000 7f1a98b9e640 1 --2- 172.21.15.79:0/2563356003 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1a8006be60 0x7f1a8006e320 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.029+0000 7f1a98b9e640 1 --2- 172.21.15.79:0/2563356003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a9415c1a0 0x7f1a9415e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.029+0000 7f1a98b9e640 1 --2- 172.21.15.79:0/2563356003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a940ca550 0x7f1a9415bc60 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.029+0000 7f1a98b9e640 1 --2- 172.21.15.79:0/2563356003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a7c004800 0x7f1a941f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.029+0000 7f1a98b9e640 1 -- 172.21.15.79:0/2563356003 >> 172.21.15.79:0/2563356003 conn(0x7f1a940d1ca0 msgr2=0x7f1a940cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.029+0000 7f1a98b9e640 1 -- 172.21.15.79:0/2563356003 shutdown_connections 2024-04-25T02:14:31.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.029+0000 7f1a98b9e640 1 -- 172.21.15.79:0/2563356003 wait complete. 2024-04-25T02:14:31.045 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T02:14:31.112 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:14:31.115 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:14:31.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.137+0000 7fb0d359e640 1 Processor -- start 2024-04-25T02:14:31.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.137+0000 7fb0d359e640 1 -- start start 2024-04-25T02:14:31.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.138+0000 7fb0d359e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb0cc0b9a80 0x7fb0cc0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.138+0000 7fb0d359e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0cc161e50 con 0x7fb0cc0d2c90 2024-04-25T02:14:31.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.138+0000 7fb0d359e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0cc0b9e60 con 0x7fb0cc0d1e30 2024-04-25T02:14:31.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.138+0000 7fb0d359e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb0cc0d0030 con 0x7fb0cc0b9a80 2024-04-25T02:14:31.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.138+0000 7fb0d1b3b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb0cc0d2c90 0x7fb0cc0b7c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48938/0 (socket says 172.21.15.79:48938) 2024-04-25T02:14:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.138+0000 7fb0d1b3b640 1 -- 172.21.15.79:0/614935606 learned_addr learned my addr 172.21.15.79:0/614935606 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:14:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.138+0000 7fb0d133a640 1 --2- 172.21.15.79:0/614935606 >> v2:172.21.15.189:3300/0 conn(0x7fb0cc0b9a80 0x7fb0cc0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.138+0000 7fb0c3fff640 1 -- 172.21.15.79:0/614935606 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3091140241 0 0) 0x7fb0cc161e50 con 0x7fb0cc0d2c90 2024-04-25T02:14:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.138+0000 7fb0c3fff640 1 -- 172.21.15.79:0/614935606 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0b8003520 con 0x7fb0cc0d2c90 2024-04-25T02:14:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.138+0000 7fb0c3fff640 1 -- 172.21.15.79:0/614935606 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 129996096 0 0) 0x7fb0b8003520 con 0x7fb0cc0d2c90 2024-04-25T02:14:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.138+0000 7fb0c3fff640 1 -- 172.21.15.79:0/614935606 >> v2:172.21.15.189:3300/0 conn(0x7fb0cc0b9a80 msgr2=0x7fb0cc0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.138+0000 7fb0c3fff640 1 --2- 172.21.15.79:0/614935606 >> v2:172.21.15.189:3300/0 conn(0x7fb0cc0b9a80 0x7fb0cc0cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.138+0000 7fb0c3fff640 1 -- 172.21.15.79:0/614935606 >> v1:172.21.15.189:6789/0 conn(0x7fb0cc0d1e30 legacy=0x7fb0cc0d2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.138+0000 7fb0c3fff640 1 -- 172.21.15.79:0/614935606 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0cc0b6e90 con 0x7fb0cc0d2c90 2024-04-25T02:14:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.138+0000 7fb0c3fff640 1 -- 172.21.15.79:0/614935606 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fb0c40019f0 con 0x7fb0cc0d2c90 2024-04-25T02:14:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.139+0000 7fb0c3fff640 1 -- 172.21.15.79:0/614935606 >> v1:172.21.15.79:6789/0 conn(0x7fb0cc0d2c90 legacy=0x7fb0cc0b7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.139+0000 7fb0c3fff640 1 --2- 172.21.15.79:0/614935606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0b80039b0 0x7fb0b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.139+0000 7fb0c3fff640 1 --2- 172.21.15.79:0/614935606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b8004800 0x7fb0b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.139+0000 7fb0c3fff640 1 --2- 172.21.15.79:0/614935606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0b80051c0 0x7fb0b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.139+0000 7fb0c3fff640 1 -- 172.21.15.79:0/614935606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc0d0030 con 0x7fb0b80051c0 2024-04-25T02:14:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.139+0000 7fb0c3fff640 1 -- 172.21.15.79:0/614935606 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b800c060 con 0x7fb0b80039b0 2024-04-25T02:14:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.139+0000 7fb0c3fff640 1 -- 172.21.15.79:0/614935606 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b800c260 con 0x7fb0b8004800 2024-04-25T02:14:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.139+0000 7fb0d1b3b640 1 --2- 172.21.15.79:0/614935606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0b80051c0 0x7fb0b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.139+0000 7fb0d133a640 1 --2- 172.21.15.79:0/614935606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0b80039b0 0x7fb0b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.139+0000 7fb0d0b39640 1 --2- 172.21.15.79:0/614935606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b8004800 0x7fb0b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.139+0000 7fb0d1b3b640 1 -- 172.21.15.79:0/614935606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b8004800 msgr2=0x7fb0b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.139+0000 7fb0d1b3b640 1 --2- 172.21.15.79:0/614935606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b8004800 0x7fb0b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.139+0000 7fb0d1b3b640 1 -- 172.21.15.79:0/614935606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0b80039b0 msgr2=0x7fb0b8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.139+0000 7fb0d1b3b640 1 --2- 172.21.15.79:0/614935606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0b80039b0 0x7fb0b8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.139+0000 7fb0d1b3b640 1 -- 172.21.15.79:0/614935606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b8003520 con 0x7fb0b80051c0 2024-04-25T02:14:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.140+0000 7fb0d1b3b640 1 -- 172.21.15.79:0/614935606 reap_dead start 2024-04-25T02:14:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.140+0000 7fb0d1b3b640 1 --2- 172.21.15.79:0/614935606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0b80051c0 0x7fb0b800b9c0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400a860 tx=0x7fb0b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3d61b490be4f6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.140+0000 7fb0c3fff640 1 -- 172.21.15.79:0/614935606 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c400a480 con 0x7fb0b80051c0 2024-04-25T02:14:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.140+0000 7fb0c3fff640 1 -- 172.21.15.79:0/614935606 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c402f070 con 0x7fb0b80051c0 2024-04-25T02:14:31.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.140+0000 7fb0c3fff640 1 -- 172.21.15.79:0/614935606 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c402bcc0 con 0x7fb0b80051c0 2024-04-25T02:14:31.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.140+0000 7fb0d359e640 1 -- 172.21.15.79:0/614935606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0b80051c0 msgr2=0x7fb0b800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.140+0000 7fb0d359e640 1 --2- 172.21.15.79:0/614935606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0b80051c0 0x7fb0b800b9c0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400a860 tx=0x7fb0b8005830 comp rx=0 tx=0).stop 2024-04-25T02:14:31.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.140+0000 7fb0d359e640 1 -- 172.21.15.79:0/614935606 shutdown_connections 2024-04-25T02:14:31.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.140+0000 7fb0d359e640 1 --2- 172.21.15.79:0/614935606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0b80051c0 0x7fb0b800b9c0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.140+0000 7fb0d359e640 1 -- 172.21.15.79:0/614935606 >> 172.21.15.79:0/614935606 conn(0x7fb0cc0d3fa0 msgr2=0x7fb0cc0d43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.140+0000 7fb0d359e640 1 -- 172.21.15.79:0/614935606 shutdown_connections 2024-04-25T02:14:31.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.140+0000 7fb0d359e640 1 -- 172.21.15.79:0/614935606 wait complete. 2024-04-25T02:14:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.142+0000 7fb0d359e640 1 Processor -- start 2024-04-25T02:14:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.142+0000 7fb0d359e640 1 -- start start 2024-04-25T02:14:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.142+0000 7fb0d359e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b80051c0 0x7fb0cc1e87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.142+0000 7fb0d359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0cc0cd140 0x7fb0cc0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.142+0000 7fb0d359e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0cc0ca400 0x7fb0cc0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.142+0000 7fb0d359e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc0b7730 con 0x7fb0cc0cd140 2024-04-25T02:14:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.142+0000 7fb0d359e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc0b7450 con 0x7fb0cc0ca400 2024-04-25T02:14:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.142+0000 7fb0d359e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb0cc0d2580 con 0x7fb0b80051c0 2024-04-25T02:14:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.142+0000 7fb0d0b39640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0cc0cd140 0x7fb0cc0c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.142+0000 7fb0d0b39640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0cc0cd140 0x7fb0cc0c9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50494/0 (socket says 172.21.15.79:50494) 2024-04-25T02:14:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.142+0000 7fb0d0b39640 1 -- 172.21.15.79:0/2410235784 learned_addr learned my addr 172.21.15.79:0/2410235784 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.143+0000 7fb0d1b3b640 1 --2- 172.21.15.79:0/2410235784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0cc0ca400 0x7fb0cc0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.143+0000 7fb0d133a640 1 --2- 172.21.15.79:0/2410235784 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b80051c0 0x7fb0cc1e87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.143+0000 7fb0d0b39640 1 -- 172.21.15.79:0/2410235784 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b80051c0 msgr2=0x7fb0cc1e87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.143+0000 7fb0d0b39640 1 --2- 172.21.15.79:0/2410235784 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b80051c0 0x7fb0cc1e87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.143+0000 7fb0d0b39640 1 -- 172.21.15.79:0/2410235784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0cc0ca400 msgr2=0x7fb0cc0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.143+0000 7fb0d0b39640 1 --2- 172.21.15.79:0/2410235784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0cc0ca400 0x7fb0cc0cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.143+0000 7fb0d0b39640 1 -- 172.21.15.79:0/2410235784 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0cc1e7450 con 0x7fb0cc0cd140 2024-04-25T02:14:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.143+0000 7fb0d0b39640 1 --2- 172.21.15.79:0/2410235784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0cc0cd140 0x7fb0cc0c9ec0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00f620 tx=0x7fb0bc00fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.143+0000 7fb0c1ffb640 1 -- 172.21.15.79:0/2410235784 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0052e0 con 0x7fb0cc0cd140 2024-04-25T02:14:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.143+0000 7fb0c1ffb640 1 -- 172.21.15.79:0/2410235784 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0bc018070 con 0x7fb0cc0cd140 2024-04-25T02:14:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.143+0000 7fb0d359e640 1 -- 172.21.15.79:0/2410235784 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0cc1e7730 con 0x7fb0cc0cd140 2024-04-25T02:14:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.143+0000 7fb0c1ffb640 1 -- 172.21.15.79:0/2410235784 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc003830 con 0x7fb0cc0cd140 2024-04-25T02:14:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.143+0000 7fb0d359e640 1 -- 172.21.15.79:0/2410235784 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0cc1e7cf0 con 0x7fb0cc0cd140 2024-04-25T02:14:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.144+0000 7fb0d359e640 1 -- 172.21.15.79:0/2410235784 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0cc0690a0 con 0x7fb0cc0cd140 2024-04-25T02:14:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.144+0000 7fb0c1ffb640 1 -- 172.21.15.79:0/2410235784 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0bc0039d0 con 0x7fb0cc0cd140 2024-04-25T02:14:31.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.145+0000 7fb0c1ffb640 1 --2- 172.21.15.79:0/2410235784 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb0b006be60 0x7fb0b006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.145+0000 7fb0d133a640 1 --2- 172.21.15.79:0/2410235784 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb0b006be60 0x7fb0b006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.145+0000 7fb0c1ffb640 1 -- 172.21.15.79:0/2410235784 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fb0bc08aa40 con 0x7fb0cc0cd140 2024-04-25T02:14:31.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.145+0000 7fb0d133a640 1 --2- 172.21.15.79:0/2410235784 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb0b006be60 0x7fb0b006e320 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0cd900 tx=0x7fb0c8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.149+0000 7fb0c1ffb640 1 -- 172.21.15.79:0/2410235784 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb0bc059420 con 0x7fb0cc0cd140 2024-04-25T02:14:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.361+0000 7fb0d359e640 1 -- 172.21.15.79:0/2410235784 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb0cc0ca7e0 con 0x7fb0cc0cd140 2024-04-25T02:14:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.361+0000 7fb0c1ffb640 1 -- 172.21.15.79:0/2410235784 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7fb0bc08ae20 con 0x7fb0cc0cd140 2024-04-25T02:14:31.367 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:14:31.367 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T02:14:31.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.363+0000 7fb0d359e640 1 -- 172.21.15.79:0/2410235784 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb0b006be60 msgr2=0x7fb0b006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.363+0000 7fb0d359e640 1 --2- 172.21.15.79:0/2410235784 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb0b006be60 0x7fb0b006e320 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0cd900 tx=0x7fb0c8009190 comp rx=0 tx=0).stop 2024-04-25T02:14:31.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.363+0000 7fb0d359e640 1 -- 172.21.15.79:0/2410235784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0cc0cd140 msgr2=0x7fb0cc0c9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.363+0000 7fb0d359e640 1 --2- 172.21.15.79:0/2410235784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0cc0cd140 0x7fb0cc0c9ec0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00f620 tx=0x7fb0bc00fa20 comp rx=0 tx=0).stop 2024-04-25T02:14:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.363+0000 7fb0d359e640 1 -- 172.21.15.79:0/2410235784 shutdown_connections 2024-04-25T02:14:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.363+0000 7fb0d359e640 1 --2- 172.21.15.79:0/2410235784 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb0b006be60 0x7fb0b006e320 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.363+0000 7fb0d359e640 1 --2- 172.21.15.79:0/2410235784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0cc0ca400 0x7fb0cc0cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.363+0000 7fb0d359e640 1 --2- 172.21.15.79:0/2410235784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0cc0cd140 0x7fb0cc0c9ec0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.363+0000 7fb0d359e640 1 --2- 172.21.15.79:0/2410235784 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b80051c0 0x7fb0cc1e87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.363+0000 7fb0d359e640 1 -- 172.21.15.79:0/2410235784 >> 172.21.15.79:0/2410235784 conn(0x7fb0cc0d3fa0 msgr2=0x7fb0cc0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.363+0000 7fb0d359e640 1 -- 172.21.15.79:0/2410235784 shutdown_connections 2024-04-25T02:14:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.363+0000 7fb0d359e640 1 -- 172.21.15.79:0/2410235784 wait complete. 2024-04-25T02:14:31.380 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T02:14:31.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:14:31.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-25T02:14:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.474+0000 7f18941e9640 1 Processor -- start 2024-04-25T02:14:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.475+0000 7f18941e9640 1 -- start start 2024-04-25T02:14:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.475+0000 7f18941e9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f188c151780 0x7f188c15b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.475+0000 7f18941e9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f188c0b4e10 0x7f188c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.475+0000 7f18941e9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f188c0b2da0 con 0x7f188c06e0c0 2024-04-25T02:14:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.475+0000 7f18941e9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f188c06e510 con 0x7f188c151780 2024-04-25T02:14:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.476+0000 7f18941e9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f188c0b3e40 con 0x7f188c0b4e10 2024-04-25T02:14:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.476+0000 7f1891f85640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f188c151780 0x7f188c15b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.476+0000 7f1891f85640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f188c151780 0x7f188c15b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50510/0 (socket says 172.21.15.79:50510) 2024-04-25T02:14:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.476+0000 7f1891f85640 1 -- 172.21.15.79:0/2805622587 learned_addr learned my addr 172.21.15.79:0/2805622587 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.476+0000 7f1891784640 1 --2- 172.21.15.79:0/2805622587 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f188c0b4e10 0x7f188c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.476+0000 7f1891f85640 1 -- 172.21.15.79:0/2805622587 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f188c0b4e10 msgr2=0x7f188c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.476+0000 7f1891f85640 1 --2- 172.21.15.79:0/2805622587 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f188c0b4e10 0x7f188c06db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.476+0000 7f1891f85640 1 -- 172.21.15.79:0/2805622587 >> v1:172.21.15.189:6789/0 conn(0x7f188c06e0c0 legacy=0x7f188c15e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.476+0000 7f1891f85640 1 -- 172.21.15.79:0/2805622587 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c0b3080 con 0x7f188c151780 2024-04-25T02:14:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.477+0000 7f1891f85640 1 --2- 172.21.15.79:0/2805622587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f188c151780 0x7f188c15b720 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f1888009870 tx=0x7f188802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579fd1d69c94cbfb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.477+0000 7f1890f83640 1 -- 172.21.15.79:0/2805622587 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888037070 con 0x7f188c151780 2024-04-25T02:14:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.477+0000 7f1890f83640 1 -- 172.21.15.79:0/2805622587 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1888032440 con 0x7f188c151780 2024-04-25T02:14:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.477+0000 7f1890f83640 1 -- 172.21.15.79:0/2805622587 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888032810 con 0x7f188c151780 2024-04-25T02:14:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.477+0000 7f18941e9640 1 -- 172.21.15.79:0/2805622587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f188c151780 msgr2=0x7f188c15b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.477+0000 7f18941e9640 1 --2- 172.21.15.79:0/2805622587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f188c151780 0x7f188c15b720 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f1888009870 tx=0x7f188802a210 comp rx=0 tx=0).stop 2024-04-25T02:14:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.477+0000 7f18941e9640 1 -- 172.21.15.79:0/2805622587 shutdown_connections 2024-04-25T02:14:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.477+0000 7f18941e9640 1 --2- 172.21.15.79:0/2805622587 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f188c0b4e10 0x7f188c06db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.477+0000 7f18941e9640 1 --2- 172.21.15.79:0/2805622587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f188c151780 0x7f188c15b720 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.477+0000 7f18941e9640 1 -- 172.21.15.79:0/2805622587 >> 172.21.15.79:0/2805622587 conn(0x7f188c06b4a0 msgr2=0x7f188c06b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.477+0000 7f18941e9640 1 -- 172.21.15.79:0/2805622587 shutdown_connections 2024-04-25T02:14:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.477+0000 7f18941e9640 1 -- 172.21.15.79:0/2805622587 wait complete. 2024-04-25T02:14:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.478+0000 7f18941e9640 1 Processor -- start 2024-04-25T02:14:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.479+0000 7f18941e9640 1 -- start start 2024-04-25T02:14:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.479+0000 7f18941e9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f188c06e0c0 0x7f188c15d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.479+0000 7f18941e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f188c0b4e10 0x7f188c15d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.479+0000 7f18941e9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f188c151780 0x7f188c145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.479+0000 7f18941e9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f188c0b3920 con 0x7f188c0b4e10 2024-04-25T02:14:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.479+0000 7f18941e9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f188c0b3640 con 0x7f188c151780 2024-04-25T02:14:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.479+0000 7f18941e9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f188c0b5250 con 0x7f188c06e0c0 2024-04-25T02:14:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.479+0000 7f1891784640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f188c0b4e10 0x7f188c15d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.479+0000 7f1891784640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f188c0b4e10 0x7f188c15d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50522/0 (socket says 172.21.15.79:50522) 2024-04-25T02:14:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.479+0000 7f1891784640 1 -- 172.21.15.79:0/360353632 learned_addr learned my addr 172.21.15.79:0/360353632 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.479+0000 7f1891f85640 1 --2- 172.21.15.79:0/360353632 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f188c06e0c0 0x7f188c15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.479+0000 7f1892786640 1 --2- 172.21.15.79:0/360353632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f188c151780 0x7f188c145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.480+0000 7f1891784640 1 -- 172.21.15.79:0/360353632 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f188c06e0c0 msgr2=0x7f188c15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.480+0000 7f1891784640 1 --2- 172.21.15.79:0/360353632 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f188c06e0c0 0x7f188c15d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.480+0000 7f1891784640 1 -- 172.21.15.79:0/360353632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f188c151780 msgr2=0x7f188c145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.480+0000 7f1891784640 1 --2- 172.21.15.79:0/360353632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f188c151780 0x7f188c145d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.480+0000 7f1891784640 1 -- 172.21.15.79:0/360353632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c14cf80 con 0x7f188c0b4e10 2024-04-25T02:14:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.480+0000 7f1892786640 1 --2- 172.21.15.79:0/360353632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f188c151780 0x7f188c145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.480+0000 7f1891784640 1 --2- 172.21.15.79:0/360353632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f188c0b4e10 0x7f188c15d590 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f187c00d620 tx=0x7f187c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.480+0000 7f18827fc640 1 -- 172.21.15.79:0/360353632 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c00b620 con 0x7f188c0b4e10 2024-04-25T02:14:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.480+0000 7f18827fc640 1 -- 172.21.15.79:0/360353632 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c019070 con 0x7f188c0b4e10 2024-04-25T02:14:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.480+0000 7f18941e9640 1 -- 172.21.15.79:0/360353632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188c072930 con 0x7f188c0b4e10 2024-04-25T02:14:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.480+0000 7f18827fc640 1 -- 172.21.15.79:0/360353632 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c00ba00 con 0x7f188c0b4e10 2024-04-25T02:14:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.480+0000 7f18941e9640 1 -- 172.21.15.79:0/360353632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f188c14d4d0 con 0x7f188c0b4e10 2024-04-25T02:14:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.481+0000 7f18827fc640 1 -- 172.21.15.79:0/360353632 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f187c00bba0 con 0x7f188c0b4e10 2024-04-25T02:14:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.482+0000 7f18827fc640 1 --2- 172.21.15.79:0/360353632 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f187006be30 0x7f187006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.482+0000 7f18827fc640 1 -- 172.21.15.79:0/360353632 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f187c08b290 con 0x7f188c0b4e10 2024-04-25T02:14:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.482+0000 7f1891f85640 1 --2- 172.21.15.79:0/360353632 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f187006be30 0x7f187006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.482+0000 7f1891f85640 1 --2- 172.21.15.79:0/360353632 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f187006be30 0x7f187006e2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1888034000 tx=0x7f188802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.483+0000 7f1896fcb740 1 Processor -- start 2024-04-25T02:14:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.483+0000 7f1896fcb740 1 -- start start 2024-04-25T02:14:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1896fcb740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 0x55855b0dd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1896fcb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b117950 0x55855b0db660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1896fcb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b105d40 0x55855b1061c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1896fcb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55855b03e2c0 con 0x55855b117950 2024-04-25T02:14:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1896fcb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55855afe6910 con 0x55855b105d40 2024-04-25T02:14:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1896fcb740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55855b03a280 con 0x55855b0db280 2024-04-25T02:14:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1891784640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b117950 0x55855b0db660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1891784640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b117950 0x55855b0db660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50530/0 (socket says 172.21.15.79:50530) 2024-04-25T02:14:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1891784640 1 -- 172.21.15.79:0/2692774165 learned_addr learned my addr 172.21.15.79:0/2692774165 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1891f85640 1 --2- 172.21.15.79:0/2692774165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 0x55855b0dd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1892786640 1 --2- 172.21.15.79:0/2692774165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b105d40 0x55855b1061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1891784640 1 -- 172.21.15.79:0/2692774165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 msgr2=0x55855b0dd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1891784640 1 --2- 172.21.15.79:0/2692774165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 0x55855b0dd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1891784640 1 -- 172.21.15.79:0/2692774165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b105d40 msgr2=0x55855b1061c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1891784640 1 --2- 172.21.15.79:0/2692774165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b105d40 0x55855b1061c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1891784640 1 -- 172.21.15.79:0/2692774165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55855aff7fb0 con 0x55855b117950 2024-04-25T02:14:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1891f85640 1 --2- 172.21.15.79:0/2692774165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 0x55855b0dd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1892786640 1 --2- 172.21.15.79:0/2692774165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b105d40 0x55855b1061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f1891784640 1 --2- 172.21.15.79:0/2692774165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b117950 0x55855b0db660 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f187c00b0e0 tx=0x7f187c058f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f0ba3290de65c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f186f7fe640 1 -- 172.21.15.79:0/2692774165 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c0620c0 con 0x55855b117950 2024-04-25T02:14:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f186f7fe640 1 -- 172.21.15.79:0/2692774165 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c057580 con 0x55855b117950 2024-04-25T02:14:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.484+0000 7f186f7fe640 1 -- 172.21.15.79:0/2692774165 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c055b50 con 0x55855b117950 2024-04-25T02:14:31.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.485+0000 7f1896fcb740 1 -- 172.21.15.79:0/2692774165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b117950 msgr2=0x55855b0db660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.485+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2692774165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b117950 0x55855b0db660 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f187c00b0e0 tx=0x7f187c058f00 comp rx=0 tx=0).stop 2024-04-25T02:14:31.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.485+0000 7f1896fcb740 1 -- 172.21.15.79:0/2692774165 shutdown_connections 2024-04-25T02:14:31.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.485+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2692774165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b105d40 0x55855b1061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.485+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2692774165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b117950 0x55855b0db660 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.485+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2692774165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 0x55855b0dd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.485+0000 7f1896fcb740 1 -- 172.21.15.79:0/2692774165 >> 172.21.15.79:0/2692774165 conn(0x55855b0a2950 msgr2=0x55855b120d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.485+0000 7f1896fcb740 1 -- 172.21.15.79:0/2692774165 shutdown_connections 2024-04-25T02:14:31.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.485+0000 7f1896fcb740 1 -- 172.21.15.79:0/2692774165 wait complete. 2024-04-25T02:14:31.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.485+0000 7f1896fcb740 1 -- start start 2024-04-25T02:14:31.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.486+0000 7f1896fcb740 1 Processor -- start 2024-04-25T02:14:31.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.486+0000 7f1896fcb740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 0x55855b121570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.486+0000 7f1896fcb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b105d40 0x55855b1029d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.486+0000 7f1896fcb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b117950 0x55855b119950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.486+0000 7f1896fcb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55855aff9e90 con 0x55855b105d40 2024-04-25T02:14:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.486+0000 7f1896fcb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55855b103890 con 0x55855b117950 2024-04-25T02:14:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.486+0000 7f1896fcb740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55855b121c00 con 0x55855b0db280 2024-04-25T02:14:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.486+0000 7f1896fcb740 10 client.0 _ll_register_callbacks cb 0x55855b035970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:14:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1891784640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b105d40 0x55855b1029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1891784640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b105d40 0x55855b1029d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50544/0 (socket says 172.21.15.79:50544) 2024-04-25T02:14:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1891784640 1 -- 172.21.15.79:0/2741199743 learned_addr learned my addr 172.21.15.79:0/2741199743 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1892786640 1 --2- 172.21.15.79:0/2741199743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b117950 0x55855b119950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1891f85640 1 --2- 172.21.15.79:0/2741199743 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 0x55855b121570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1891784640 1 -- 172.21.15.79:0/2741199743 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 msgr2=0x55855b121570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1891784640 1 --2- 172.21.15.79:0/2741199743 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 0x55855b121570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1891784640 1 -- 172.21.15.79:0/2741199743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b117950 msgr2=0x55855b119950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1891784640 1 --2- 172.21.15.79:0/2741199743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b117950 0x55855b119950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1891784640 1 -- 172.21.15.79:0/2741199743 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55855ae1a7e0 con 0x55855b105d40 2024-04-25T02:14:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1892786640 1 --2- 172.21.15.79:0/2741199743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b117950 0x55855b119950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1891784640 1 --2- 172.21.15.79:0/2741199743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b105d40 0x55855b1029d0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f187c00b0e0 tx=0x7f187c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5dded20a281fb3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f186cff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:14:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f186cff9640 1 -- 172.21.15.79:0/2741199743 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c075070 con 0x55855b105d40 2024-04-25T02:14:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f186cff9640 1 -- 172.21.15.79:0/2741199743 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f187c0892e0 con 0x55855b105d40 2024-04-25T02:14:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1896fcb740 1 -- 172.21.15.79:0/2741199743 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f187c057580 con 0x55855b105d40 2024-04-25T02:14:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f186cff9640 1 -- 172.21.15.79:0/2741199743 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f187c0620c0 con 0x55855b105d40 2024-04-25T02:14:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1896fcb740 10 client.7779 fetch_fsmap learned FSMap version 55 2024-04-25T02:14:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1896fcb740 1 -- 172.21.15.79:0/2741199743 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55855ae7af70 con 0x55855b105d40 2024-04-25T02:14:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f186cff9640 1 -- 172.21.15.79:0/2741199743 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c057580 con 0x55855b105d40 2024-04-25T02:14:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f186cff9640 1 -- 172.21.15.79:0/2741199743 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f187c013070 con 0x55855b105d40 2024-04-25T02:14:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1896fcb740 10 client.7779 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T02:14:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.487+0000 7f1896fcb740 10 client.7779 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:14:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.488+0000 7f1896fcb740 20 client.7779 populate_metadata read hostname 'smithi079' 2024-04-25T02:14:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.488+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2741199743 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55855b11b540 0x55855b1061c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.488+0000 7f1896fcb740 4 client.7779 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:14:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.488+0000 7f1896fcb740 1 -- 172.21.15.79:0/2741199743 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55855b0125a0 con 0x55855b11b540 2024-04-25T02:14:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.488+0000 7f1891f85640 1 --2- 172.21.15.79:0/2741199743 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55855b11b540 0x55855b1061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.488+0000 7f186cff9640 10 client.7779 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.488+0000 7f1891f85640 1 --2- 172.21.15.79:0/2741199743 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55855b11b540 0x55855b1061c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db6f70b1f4e51b07 server_cookie=75ce03bd7978ce5c in_seq=0 out_seq=0 2024-04-25T02:14:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.488+0000 7f186cff9640 1 -- 172.21.15.79:0/2741199743 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55855b0125a0 con 0x55855b11b540 2024-04-25T02:14:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.488+0000 7f186cff9640 10 client.7779 handle_command_reply: tid=0 2024-04-25T02:14:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.489+0000 7f1896fcb740 1 client.7779 shutdown 2024-04-25T02:14:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.489+0000 7f1896fcb740 1 -- 172.21.15.79:0/2741199743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b105d40 msgr2=0x55855b1029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.489+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2741199743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b105d40 0x55855b1029d0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f187c00b0e0 tx=0x7f187c000bc0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.489+0000 7f1896fcb740 1 -- 172.21.15.79:0/2741199743 shutdown_connections 2024-04-25T02:14:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.489+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2741199743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b117950 0x55855b119950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.489+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2741199743 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55855b11b540 0x55855b1061c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.489+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2741199743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b105d40 0x55855b1029d0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.489+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2741199743 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 0x55855b121570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.489+0000 7f186cff9640 0 client.7779 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.489+0000 7f1896fcb740 1 -- 172.21.15.79:0/2741199743 >> 172.21.15.79:0/2741199743 conn(0x55855b0a2950 msgr2=0x55855b1240a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.489+0000 7f1896fcb740 1 -- 172.21.15.79:0/2741199743 shutdown_connections 2024-04-25T02:14:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.489+0000 7f1896fcb740 1 -- 172.21.15.79:0/2741199743 wait complete. 2024-04-25T02:14:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.489+0000 7f1896fcb740 20 client.7779 trim_cache size 0 max 16384 2024-04-25T02:14:31.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.506+0000 7f1896fcb740 1 Processor -- start 2024-04-25T02:14:31.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.506+0000 7f1896fcb740 1 -- start start 2024-04-25T02:14:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1896fcb740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 0x55855b11cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1896fcb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b105d40 0x55855b105300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1896fcb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b117950 0x55855b142f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1896fcb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f188c200920 con 0x55855b105d40 2024-04-25T02:14:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1896fcb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f188c071e50 con 0x55855b117950 2024-04-25T02:14:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1896fcb740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f188c0cadf0 con 0x55855b0db280 2024-04-25T02:14:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1891784640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b105d40 0x55855b105300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1891784640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b105d40 0x55855b105300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50556/0 (socket says 172.21.15.79:50556) 2024-04-25T02:14:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1891784640 1 -- 172.21.15.79:0/3171458285 learned_addr learned my addr 172.21.15.79:0/3171458285 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1891f85640 1 --2- 172.21.15.79:0/3171458285 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 0x55855b11cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1892786640 1 --2- 172.21.15.79:0/3171458285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b117950 0x55855b142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1891784640 1 -- 172.21.15.79:0/3171458285 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 msgr2=0x55855b11cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1891784640 1 --2- 172.21.15.79:0/3171458285 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 0x55855b11cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1891784640 1 -- 172.21.15.79:0/3171458285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b117950 msgr2=0x55855b142f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1891784640 1 --2- 172.21.15.79:0/3171458285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b117950 0x55855b142f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1891784640 1 -- 172.21.15.79:0/3171458285 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55855ad12170 con 0x55855b105d40 2024-04-25T02:14:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1892786640 1 --2- 172.21.15.79:0/3171458285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b117950 0x55855b142f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:14:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1891f85640 1 --2- 172.21.15.79:0/3171458285 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 0x55855b11cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:14:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.507+0000 7f1891784640 1 --2- 172.21.15.79:0/3171458285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b105d40 0x55855b105300 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f187c08b5b0 tx=0x7f187c023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1061b6c73cc6fcfa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.508+0000 7f186effd640 1 -- 172.21.15.79:0/3171458285 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c075070 con 0x55855b105d40 2024-04-25T02:14:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.508+0000 7f186effd640 1 -- 172.21.15.79:0/3171458285 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c057580 con 0x55855b105d40 2024-04-25T02:14:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.508+0000 7f186effd640 1 -- 172.21.15.79:0/3171458285 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c055b50 con 0x55855b105d40 2024-04-25T02:14:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.508+0000 7f1896fcb740 1 -- 172.21.15.79:0/3171458285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b105d40 msgr2=0x55855b105300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.508+0000 7f1896fcb740 1 --2- 172.21.15.79:0/3171458285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b105d40 0x55855b105300 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f187c08b5b0 tx=0x7f187c023000 comp rx=0 tx=0).stop 2024-04-25T02:14:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.508+0000 7f1896fcb740 1 -- 172.21.15.79:0/3171458285 shutdown_connections 2024-04-25T02:14:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.508+0000 7f1896fcb740 1 --2- 172.21.15.79:0/3171458285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b117950 0x55855b142f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.508+0000 7f1896fcb740 1 --2- 172.21.15.79:0/3171458285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b105d40 0x55855b105300 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.508+0000 7f1896fcb740 1 --2- 172.21.15.79:0/3171458285 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b0db280 0x55855b11cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.508+0000 7f1896fcb740 1 -- 172.21.15.79:0/3171458285 >> 172.21.15.79:0/3171458285 conn(0x55855b0a2950 msgr2=0x55855b11b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.508+0000 7f1896fcb740 1 -- 172.21.15.79:0/3171458285 shutdown_connections 2024-04-25T02:14:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.508+0000 7f1896fcb740 1 -- 172.21.15.79:0/3171458285 wait complete. 2024-04-25T02:14:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.509+0000 7f1896fcb740 1 -- start start 2024-04-25T02:14:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.509+0000 7f1896fcb740 1 Processor -- start 2024-04-25T02:14:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1896fcb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b0db280 0x55855b0f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1896fcb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b105d40 0x55855b1083e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1896fcb740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b117950 0x55855b188720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1896fcb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f188c071800 con 0x55855b0db280 2024-04-25T02:14:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1896fcb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55855b1894b0 con 0x55855b105d40 2024-04-25T02:14:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1896fcb740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55855b108d00 con 0x55855b117950 2024-04-25T02:14:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1896fcb740 10 client.0 _ll_register_callbacks cb 0x7f187c059020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:14:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1891f85640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b0db280 0x55855b0f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1891f85640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b0db280 0x55855b0f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50566/0 (socket says 172.21.15.79:50566) 2024-04-25T02:14:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1891f85640 1 -- 172.21.15.79:0/2096578117 learned_addr learned my addr 172.21.15.79:0/2096578117 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1892786640 1 --2- 172.21.15.79:0/2096578117 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b117950 0x55855b188720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1891784640 1 --2- 172.21.15.79:0/2096578117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b105d40 0x55855b1083e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1891f85640 1 -- 172.21.15.79:0/2096578117 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b117950 msgr2=0x55855b188720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1891f85640 1 --2- 172.21.15.79:0/2096578117 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b117950 0x55855b188720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1891f85640 1 -- 172.21.15.79:0/2096578117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b105d40 msgr2=0x55855b1083e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1891f85640 1 --2- 172.21.15.79:0/2096578117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b105d40 0x55855b1083e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1891f85640 1 -- 172.21.15.79:0/2096578117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55855b11d000 con 0x55855b0db280 2024-04-25T02:14:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1891f85640 1 --2- 172.21.15.79:0/2096578117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b0db280 0x55855b0f67e0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f1888009870 tx=0x7f1888004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19e8bf83977c531 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f186cff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:14:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f186cff9640 1 -- 172.21.15.79:0/2096578117 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888037040 con 0x55855b0db280 2024-04-25T02:14:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f186cff9640 1 -- 172.21.15.79:0/2096578117 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f188804e310 con 0x55855b0db280 2024-04-25T02:14:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1896fcb740 1 -- 172.21.15.79:0/2096578117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f187c057580 con 0x55855b0db280 2024-04-25T02:14:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f186cff9640 1 -- 172.21.15.79:0/2096578117 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f188805c050 con 0x55855b0db280 2024-04-25T02:14:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1896fcb740 10 client.7785 fetch_fsmap learned FSMap version 55 2024-04-25T02:14:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.510+0000 7f1896fcb740 1 -- 172.21.15.79:0/2096578117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55855b189250 con 0x55855b0db280 2024-04-25T02:14:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.511+0000 7f186cff9640 1 -- 172.21.15.79:0/2096578117 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c057580 con 0x55855b0db280 2024-04-25T02:14:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.511+0000 7f186cff9640 1 -- 172.21.15.79:0/2096578117 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f188805f020 con 0x55855b0db280 2024-04-25T02:14:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.511+0000 7f1896fcb740 10 client.7785 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T02:14:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.511+0000 7f1896fcb740 10 client.7785 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:14:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.511+0000 7f1896fcb740 20 client.7785 populate_metadata read hostname 'smithi079' 2024-04-25T02:14:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.511+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2096578117 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55855b188c60 0x55855b11b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.511+0000 7f1896fcb740 4 client.7785 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-25T02:14:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.511+0000 7f1896fcb740 1 -- 172.21.15.79:0/2096578117 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) -- 0x55855b04b800 con 0x55855b188c60 2024-04-25T02:14:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.511+0000 7f1891784640 1 --2- 172.21.15.79:0/2096578117 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55855b188c60 0x55855b11b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.511+0000 7f186cff9640 10 client.7785 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.511+0000 7f1891784640 1 --2- 172.21.15.79:0/2096578117 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55855b188c60 0x55855b11b920 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e9f440139d78288 server_cookie=d69bc2dfbdc3eb5 in_seq=0 out_seq=0 2024-04-25T02:14:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.511+0000 7f186cff9640 1 -- 172.21.15.79:0/2096578117 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55855b04b800 con 0x55855b188c60 2024-04-25T02:14:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.511+0000 7f186cff9640 10 client.7785 handle_command_reply: tid=0 2024-04-25T02:14:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.511+0000 7f1896fcb740 1 client.7785 shutdown 2024-04-25T02:14:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f1896fcb740 1 -- 172.21.15.79:0/2096578117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b0db280 msgr2=0x55855b0f67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2096578117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b0db280 0x55855b0f67e0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f1888009870 tx=0x7f1888004730 comp rx=0 tx=0).stop 2024-04-25T02:14:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f1896fcb740 1 -- 172.21.15.79:0/2096578117 shutdown_connections 2024-04-25T02:14:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2096578117 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55855b117950 0x55855b188720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2096578117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55855b105d40 0x55855b1083e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2096578117 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55855b188c60 0x55855b11b920 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f1896fcb740 1 --2- 172.21.15.79:0/2096578117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55855b0db280 0x55855b0f67e0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f186cff9640 0 client.7785 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f1896fcb740 1 -- 172.21.15.79:0/2096578117 >> 172.21.15.79:0/2096578117 conn(0x55855b0a2950 msgr2=0x55855b105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f1896fcb740 1 -- 172.21.15.79:0/2096578117 shutdown_connections 2024-04-25T02:14:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f1896fcb740 1 -- 172.21.15.79:0/2096578117 wait complete. 2024-04-25T02:14:31.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f1896fcb740 20 client.7785 trim_cache size 0 max 16384 2024-04-25T02:14:31.527 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:14:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-04-25T02:14:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "a457d1c2-b9a4-4cc4-881d-ae48bd569be7", 2024-04-25T02:14:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-04-25T02:14:31.527 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:14:31.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f18941e9640 1 -- 172.21.15.79:0/360353632 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f187006be30 msgr2=0x7f187006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.528 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f8560641640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-04-25T02:13:50.804280+0000 1=1+0)->f(v1 m2024-04-25T02:13:50.804280+0000) n(v0 rc2024-04-25T02:13:50.919277+0000 2=1+1)->n(v0 rc2024-04-25T02:13:50.919277+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x5603c4bbd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T02:13:50.804280+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T02:13:50.919277+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-25T02:14:31.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f18941e9640 1 --2- 172.21.15.79:0/360353632 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f187006be30 0x7f187006e2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1888034000 tx=0x7f188802e000 comp rx=0 tx=0).stop 2024-04-25T02:14:31.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f18941e9640 1 -- 172.21.15.79:0/360353632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f188c0b4e10 msgr2=0x7f188c15d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f18941e9640 1 --2- 172.21.15.79:0/360353632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f188c0b4e10 0x7f188c15d590 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f187c00d620 tx=0x7f187c00dae0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f18941e9640 1 -- 172.21.15.79:0/360353632 shutdown_connections 2024-04-25T02:14:31.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f18941e9640 1 --2- 172.21.15.79:0/360353632 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f187006be30 0x7f187006e2f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f18941e9640 1 --2- 172.21.15.79:0/360353632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f188c151780 0x7f188c145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f18941e9640 1 --2- 172.21.15.79:0/360353632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f188c0b4e10 0x7f188c15d590 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f18941e9640 1 --2- 172.21.15.79:0/360353632 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f188c06e0c0 0x7f188c15d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.512+0000 7f18941e9640 1 -- 172.21.15.79:0/360353632 >> 172.21.15.79:0/360353632 conn(0x7f188c06b4a0 msgr2=0x7f188c14f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.513+0000 7f18941e9640 1 -- 172.21.15.79:0/360353632 shutdown_connections 2024-04-25T02:14:31.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.513+0000 7f18941e9640 1 -- 172.21.15.79:0/360353632 wait complete. 2024-04-25T02:14:31.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:14:31.531 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T02:14:31.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.624+0000 7fa2eb9f9640 1 Processor -- start 2024-04-25T02:14:31.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.625+0000 7fa2eb9f9640 1 -- start start 2024-04-25T02:14:31.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.625+0000 7fa2eb9f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2e415e4f0 0x7fa2e40d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.625+0000 7fa2eb9f9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2e40d10c0 0x7fa2e406bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.625+0000 7fa2eb9f9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2e40d1ee0 con 0x7fa2e40cf7f0 2024-04-25T02:14:31.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.625+0000 7fa2eb9f9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa2e40d21c0 con 0x7fa2e40d10c0 2024-04-25T02:14:31.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.625+0000 7fa2eb9f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e40d24a0 con 0x7fa2e415e4f0 2024-04-25T02:14:31.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.625+0000 7fa2e9f96640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2e40d10c0 0x7fa2e406bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.625+0000 7fa2e9f96640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2e40d10c0 0x7fa2e406bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50582/0 (socket says 172.21.15.79:50582) 2024-04-25T02:14:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.625+0000 7fa2e9f96640 1 -- 172.21.15.79:0/1448429 learned_addr learned my addr 172.21.15.79:0/1448429 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.626+0000 7fa2e9795640 1 --2- 172.21.15.79:0/1448429 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2e415e4f0 0x7fa2e40d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.626+0000 7fa2e9f96640 1 -- 172.21.15.79:0/1448429 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2e415e4f0 msgr2=0x7fa2e40d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.626+0000 7fa2e9f96640 1 --2- 172.21.15.79:0/1448429 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2e415e4f0 0x7fa2e40d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.626+0000 7fa2e9f96640 1 -- 172.21.15.79:0/1448429 >> v1:172.21.15.189:6789/0 conn(0x7fa2e40cf7f0 legacy=0x7fa2e40d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.626+0000 7fa2e9f96640 1 -- 172.21.15.79:0/1448429 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e40d2780 con 0x7fa2e40d10c0 2024-04-25T02:14:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.626+0000 7fa2e9f96640 1 --2- 172.21.15.79:0/1448429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e40d10c0 0x7fa2e406bc30 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009e50 tx=0x7fa2d402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb8d40857f27ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.626+0000 7fa2e3fff640 1 -- 172.21.15.79:0/1448429 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4036070 con 0x7fa2e40d10c0 2024-04-25T02:14:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.627+0000 7fa2e3fff640 1 -- 172.21.15.79:0/1448429 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d4031600 con 0x7fa2e40d10c0 2024-04-25T02:14:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.627+0000 7fa2e3fff640 1 -- 172.21.15.79:0/1448429 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40319d0 con 0x7fa2e40d10c0 2024-04-25T02:14:31.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.627+0000 7fa2eb9f9640 1 -- 172.21.15.79:0/1448429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e40d10c0 msgr2=0x7fa2e406bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.627+0000 7fa2eb9f9640 1 --2- 172.21.15.79:0/1448429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e40d10c0 0x7fa2e406bc30 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009e50 tx=0x7fa2d402a6c0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.627+0000 7fa2eb9f9640 1 -- 172.21.15.79:0/1448429 shutdown_connections 2024-04-25T02:14:31.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.627+0000 7fa2eb9f9640 1 --2- 172.21.15.79:0/1448429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e40d10c0 0x7fa2e406bc30 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.627+0000 7fa2eb9f9640 1 --2- 172.21.15.79:0/1448429 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2e415e4f0 0x7fa2e40d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.627+0000 7fa2eb9f9640 1 -- 172.21.15.79:0/1448429 >> 172.21.15.79:0/1448429 conn(0x7fa2e409d4a0 msgr2=0x7fa2e40d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.627+0000 7fa2eb9f9640 1 -- 172.21.15.79:0/1448429 shutdown_connections 2024-04-25T02:14:31.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.627+0000 7fa2eb9f9640 1 -- 172.21.15.79:0/1448429 wait complete. 2024-04-25T02:14:31.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.628+0000 7fa2eb9f9640 1 Processor -- start 2024-04-25T02:14:31.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.628+0000 7fa2eb9f9640 1 -- start start 2024-04-25T02:14:31.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2eb9f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2e40cf7f0 0x7fa2e41f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2eb9f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e40d10c0 0x7fa2e4155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2eb9f9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2e415e4f0 0x7fa2e41557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2eb9f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e40cfc50 con 0x7fa2e40d10c0 2024-04-25T02:14:31.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2eb9f9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e40d50f0 con 0x7fa2e415e4f0 2024-04-25T02:14:31.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2eb9f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e40cfdd0 con 0x7fa2e40cf7f0 2024-04-25T02:14:31.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2e8f94640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e40d10c0 0x7fa2e4155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2e8f94640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e40d10c0 0x7fa2e4155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50586/0 (socket says 172.21.15.79:50586) 2024-04-25T02:14:31.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2e8f94640 1 -- 172.21.15.79:0/1848497515 learned_addr learned my addr 172.21.15.79:0/1848497515 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2e9795640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2e40cf7f0 0x7fa2e41f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2e9f96640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2e415e4f0 0x7fa2e41557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2e8f94640 1 -- 172.21.15.79:0/1848497515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2e40cf7f0 msgr2=0x7fa2e41f7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2e8f94640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2e40cf7f0 0x7fa2e41f7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2e8f94640 1 -- 172.21.15.79:0/1848497515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2e415e4f0 msgr2=0x7fa2e41557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2e8f94640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2e415e4f0 0x7fa2e41557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2e8f94640 1 -- 172.21.15.79:0/1848497515 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e40c8750 con 0x7fa2e40d10c0 2024-04-25T02:14:31.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2e9795640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2e40cf7f0 0x7fa2e41f7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:14:31.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.629+0000 7fa2e9f96640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2e415e4f0 0x7fa2e41557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:14:31.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.630+0000 7fa2e8f94640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e40d10c0 0x7fa2e4155280 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800b3f0 tx=0x7fa2d800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.630+0000 7fa2e1ffb640 1 -- 172.21.15.79:0/1848497515 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8015020 con 0x7fa2e40d10c0 2024-04-25T02:14:31.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.630+0000 7fa2e1ffb640 1 -- 172.21.15.79:0/1848497515 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d8011830 con 0x7fa2e40d10c0 2024-04-25T02:14:31.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.630+0000 7fa2eb9f9640 1 -- 172.21.15.79:0/1848497515 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e40c89f0 con 0x7fa2e40d10c0 2024-04-25T02:14:31.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.630+0000 7fa2e1ffb640 1 -- 172.21.15.79:0/1848497515 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8011c20 con 0x7fa2e40d10c0 2024-04-25T02:14:31.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.630+0000 7fa2eb9f9640 1 -- 172.21.15.79:0/1848497515 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e40c8fb0 con 0x7fa2e40d10c0 2024-04-25T02:14:31.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.631+0000 7fa2e1ffb640 1 -- 172.21.15.79:0/1848497515 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2d8018020 con 0x7fa2e40d10c0 2024-04-25T02:14:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.632+0000 7fa2e1ffb640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa2d006be30 0x7fa2d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.632+0000 7fa2e1ffb640 1 -- 172.21.15.79:0/1848497515 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fa2d808abd0 con 0x7fa2e40d10c0 2024-04-25T02:14:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.632+0000 7fa2e9795640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa2d006be30 0x7fa2d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.632+0000 7fa2e9795640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa2d006be30 0x7fa2d006e2f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc006fd0 tx=0x7fa2dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.633+0000 7fa2ee7e7740 1 Processor -- start 2024-04-25T02:14:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.633+0000 7fa2ee7e7740 1 -- start start 2024-04-25T02:14:31.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.633+0000 7fa2ee7e7740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa44fd60 0x5630fa450140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.633+0000 7fa2ee7e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa46d600 0x5630fa46db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.633+0000 7fa2ee7e7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa425a40 0x5630fa46bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.633+0000 7fa2ee7e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5630fa3896b0 con 0x5630fa46d600 2024-04-25T02:14:31.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2ee7e7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5630fa331880 con 0x5630fa425a40 2024-04-25T02:14:31.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2ee7e7740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5630fa385670 con 0x5630fa44fd60 2024-04-25T02:14:31.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2e8f94640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa46d600 0x5630fa46db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2e8f94640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa46d600 0x5630fa46db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50596/0 (socket says 172.21.15.79:50596) 2024-04-25T02:14:31.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2e8f94640 1 -- 172.21.15.79:0/4280551729 learned_addr learned my addr 172.21.15.79:0/4280551729 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2e9795640 1 --2- 172.21.15.79:0/4280551729 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa44fd60 0x5630fa450140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2e9f96640 1 --2- 172.21.15.79:0/4280551729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa425a40 0x5630fa46bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2e8f94640 1 -- 172.21.15.79:0/4280551729 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa44fd60 msgr2=0x5630fa450140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2e8f94640 1 --2- 172.21.15.79:0/4280551729 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa44fd60 0x5630fa450140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2e8f94640 1 -- 172.21.15.79:0/4280551729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa425a40 msgr2=0x5630fa46bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2e8f94640 1 --2- 172.21.15.79:0/4280551729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa425a40 0x5630fa46bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2e8f94640 1 -- 172.21.15.79:0/4280551729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630fa1677d0 con 0x5630fa46d600 2024-04-25T02:14:31.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2e9f96640 1 --2- 172.21.15.79:0/4280551729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa425a40 0x5630fa46bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:31.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2e8f94640 1 --2- 172.21.15.79:0/4280551729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa46d600 0x5630fa46db50 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80614d0 tx=0x7fa2d805d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfed2231130eacfe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2caffd640 1 -- 172.21.15.79:0/4280551729 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8086020 con 0x5630fa46d600 2024-04-25T02:14:31.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2caffd640 1 -- 172.21.15.79:0/4280551729 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d8057090 con 0x5630fa46d600 2024-04-25T02:14:31.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.634+0000 7fa2caffd640 1 -- 172.21.15.79:0/4280551729 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8055400 con 0x5630fa46d600 2024-04-25T02:14:31.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.635+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/4280551729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa46d600 msgr2=0x5630fa46db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.635+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/4280551729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa46d600 0x5630fa46db50 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80614d0 tx=0x7fa2d805d2c0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.635+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/4280551729 shutdown_connections 2024-04-25T02:14:31.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.635+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/4280551729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa425a40 0x5630fa46bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.635+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/4280551729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa46d600 0x5630fa46db50 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.635+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/4280551729 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa44fd60 0x5630fa450140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.635+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/4280551729 >> 172.21.15.79:0/4280551729 conn(0x5630fa422600 msgr2=0x5630fa46ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.635+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/4280551729 shutdown_connections 2024-04-25T02:14:31.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.635+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/4280551729 wait complete. 2024-04-25T02:14:31.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.635+0000 7fa2ee7e7740 1 -- start start 2024-04-25T02:14:31.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.635+0000 7fa2ee7e7740 1 Processor -- start 2024-04-25T02:14:31.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.636+0000 7fa2ee7e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa44fd60 0x5630fa44c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.636+0000 7fa2ee7e7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa46d600 0x5630fa4532b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.636+0000 7fa2ee7e7740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa4537f0 0x5630fa463660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.636+0000 7fa2ee7e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5630fa4267e0 con 0x5630fa44fd60 2024-04-25T02:14:31.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.636+0000 7fa2ee7e7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5630fa344f50 con 0x5630fa46d600 2024-04-25T02:14:31.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.636+0000 7fa2ee7e7740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5630fa420530 con 0x5630fa4537f0 2024-04-25T02:14:31.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.636+0000 7fa2ee7e7740 10 client.0 _ll_register_callbacks cb 0x5630fa380000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:14:31.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.636+0000 7fa2e9795640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa44fd60 0x5630fa44c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.636+0000 7fa2e9795640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa44fd60 0x5630fa44c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50602/0 (socket says 172.21.15.79:50602) 2024-04-25T02:14:31.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.636+0000 7fa2e9795640 1 -- 172.21.15.79:0/2831905974 learned_addr learned my addr 172.21.15.79:0/2831905974 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.636+0000 7fa2e8f94640 1 --2- 172.21.15.79:0/2831905974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa46d600 0x5630fa4532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2e9f96640 1 --2- 172.21.15.79:0/2831905974 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa4537f0 0x5630fa463660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2e9795640 1 -- 172.21.15.79:0/2831905974 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa4537f0 msgr2=0x5630fa463660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2e9795640 1 --2- 172.21.15.79:0/2831905974 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa4537f0 0x5630fa463660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2e9795640 1 -- 172.21.15.79:0/2831905974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa46d600 msgr2=0x5630fa4532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2e9795640 1 --2- 172.21.15.79:0/2831905974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa46d600 0x5630fa4532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2e9795640 1 -- 172.21.15.79:0/2831905974 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630fa09d3f0 con 0x5630fa44fd60 2024-04-25T02:14:31.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2e9795640 1 --2- 172.21.15.79:0/2831905974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa44fd60 0x5630fa44c670 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00eaa0 tx=0x7fa2dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3203adec57110277 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:14:31.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2c3fff640 1 -- 172.21.15.79:0/2831905974 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc028060 con 0x5630fa44fd60 2024-04-25T02:14:31.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2c3fff640 1 -- 172.21.15.79:0/2831905974 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fa2dc023460 con 0x5630fa44fd60 2024-04-25T02:14:31.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/2831905974 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2d8057090 con 0x5630fa44fd60 2024-04-25T02:14:31.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2c3fff640 1 -- 172.21.15.79:0/2831905974 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fa2dc02e050 con 0x5630fa44fd60 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2ee7e7740 10 client.7797 fetch_fsmap learned FSMap version 55 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/2831905974 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x5630fa05d0f0 con 0x5630fa44fd60 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2c3fff640 1 -- 172.21.15.79:0/2831905974 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d8057090 con 0x5630fa44fd60 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2c3fff640 1 -- 172.21.15.79:0/2831905974 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7fa2dc031020 con 0x5630fa44fd60 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2ee7e7740 10 client.7797 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2ee7e7740 10 client.7797 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2ee7e7740 20 client.7797 populate_metadata read hostname 'smithi079' 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/2831905974 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5630fa451df0 0x5630fa4521d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2ee7e7740 4 client.7797 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/2831905974 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630fa396bf0 con 0x5630fa451df0 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.637+0000 7fa2e8f94640 1 --2- 172.21.15.79:0/2831905974 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5630fa451df0 0x5630fa4521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.638+0000 7fa2c3fff640 10 client.7797 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.638+0000 7fa2e8f94640 1 --2- 172.21.15.79:0/2831905974 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5630fa451df0 0x5630fa4521d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1274b3e50e08511 server_cookie=686fcdd1e6a5a813 in_seq=0 out_seq=0 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.638+0000 7fa2c3fff640 1 -- 172.21.15.79:0/2831905974 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5630fa396bf0 con 0x5630fa451df0 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.638+0000 7fa2c3fff640 10 client.7797 handle_command_reply: tid=0 2024-04-25T02:14:31.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.638+0000 7fa2ee7e7740 1 client.7797 shutdown 2024-04-25T02:14:31.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.638+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/2831905974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa44fd60 msgr2=0x5630fa44c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.638+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/2831905974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa44fd60 0x5630fa44c670 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00eaa0 tx=0x7fa2dc004730 comp rx=0 tx=0).stop 2024-04-25T02:14:31.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.638+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/2831905974 shutdown_connections 2024-04-25T02:14:31.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.638+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/2831905974 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa4537f0 0x5630fa463660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.638+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/2831905974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa46d600 0x5630fa4532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.638+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/2831905974 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5630fa451df0 0x5630fa4521d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.638+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/2831905974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa44fd60 0x5630fa44c670 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.638+0000 7fa2c3fff640 0 client.7797 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:31.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.638+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/2831905974 >> 172.21.15.79:0/2831905974 conn(0x5630fa425a40 msgr2=0x5630fa46e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.639+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/2831905974 shutdown_connections 2024-04-25T02:14:31.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.639+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/2831905974 wait complete. 2024-04-25T02:14:31.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.639+0000 7fa2ee7e7740 20 client.7797 trim_cache size 0 max 16384 2024-04-25T02:14:31.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.656+0000 7fa2ee7e7740 1 Processor -- start 2024-04-25T02:14:31.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.656+0000 7fa2ee7e7740 1 -- start start 2024-04-25T02:14:31.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2ee7e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa44fd60 0x5630fa47b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2ee7e7740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa4537f0 0x5630fa423910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2ee7e7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa46d600 0x5630fa423e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2ee7e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e4200970 con 0x5630fa44fd60 2024-04-25T02:14:31.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2ee7e7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e41ff9b0 con 0x5630fa46d600 2024-04-25T02:14:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2ee7e7740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e4158b30 con 0x5630fa4537f0 2024-04-25T02:14:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2e9795640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa44fd60 0x5630fa47b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2e9795640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa44fd60 0x5630fa47b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50612/0 (socket says 172.21.15.79:50612) 2024-04-25T02:14:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2e9795640 1 -- 172.21.15.79:0/2398439495 learned_addr learned my addr 172.21.15.79:0/2398439495 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2e9795640 1 -- 172.21.15.79:0/2398439495 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa4537f0 msgr2=0x5630fa423910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2e9795640 1 --2- 172.21.15.79:0/2398439495 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa4537f0 0x5630fa423910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2e9795640 1 -- 172.21.15.79:0/2398439495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa46d600 msgr2=0x5630fa423e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2e9795640 1 --2- 172.21.15.79:0/2398439495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa46d600 0x5630fa423e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2e9795640 1 -- 172.21.15.79:0/2398439495 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630fa452ac0 con 0x5630fa44fd60 2024-04-25T02:14:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2e9795640 1 --2- 172.21.15.79:0/2398439495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa44fd60 0x5630fa47b680 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009e70 tx=0x7fa2dc020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d809c4037223a00 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2ca7fc640 1 -- 172.21.15.79:0/2398439495 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc036070 con 0x5630fa44fd60 2024-04-25T02:14:31.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2ca7fc640 1 -- 172.21.15.79:0/2398439495 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2dc0044b0 con 0x5630fa44fd60 2024-04-25T02:14:31.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.657+0000 7fa2ca7fc640 1 -- 172.21.15.79:0/2398439495 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc00f040 con 0x5630fa44fd60 2024-04-25T02:14:31.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.658+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/2398439495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa44fd60 msgr2=0x5630fa47b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.658+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/2398439495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa44fd60 0x5630fa47b680 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009e70 tx=0x7fa2dc020000 comp rx=0 tx=0).stop 2024-04-25T02:14:31.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.658+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/2398439495 shutdown_connections 2024-04-25T02:14:31.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.658+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/2398439495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa46d600 0x5630fa423e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.658+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/2398439495 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa4537f0 0x5630fa423910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.658+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/2398439495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa44fd60 0x5630fa47b680 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.658+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/2398439495 >> 172.21.15.79:0/2398439495 conn(0x5630fa425a40 msgr2=0x5630fa44ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.658+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/2398439495 shutdown_connections 2024-04-25T02:14:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.658+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/2398439495 wait complete. 2024-04-25T02:14:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.658+0000 7fa2ee7e7740 1 -- start start 2024-04-25T02:14:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.658+0000 7fa2ee7e7740 1 Processor -- start 2024-04-25T02:14:31.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.659+0000 7fa2ee7e7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa44fd60 0x5630fa4e09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.659+0000 7fa2ee7e7740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa4537f0 0x5630fa423910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.659+0000 7fa2ee7e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa46d600 0x5630fa423e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.659+0000 7fa2ee7e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5630fa421140 con 0x5630fa46d600 2024-04-25T02:14:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.659+0000 7fa2ee7e7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e4159180 con 0x5630fa44fd60 2024-04-25T02:14:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.659+0000 7fa2ee7e7740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5630fa44f540 con 0x5630fa4537f0 2024-04-25T02:14:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.659+0000 7fa2ee7e7740 10 client.0 _ll_register_callbacks cb 0x7fa2dc009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:14:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.659+0000 7fa2e9f96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa46d600 0x5630fa423e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.659+0000 7fa2e9f96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa46d600 0x5630fa423e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50628/0 (socket says 172.21.15.79:50628) 2024-04-25T02:14:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.659+0000 7fa2e9f96640 1 -- 172.21.15.79:0/843202863 learned_addr learned my addr 172.21.15.79:0/843202863 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:14:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2e9795640 1 --2- 172.21.15.79:0/843202863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa44fd60 0x5630fa4e09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2e8f94640 1 --2- 172.21.15.79:0/843202863 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa4537f0 0x5630fa423910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2e9f96640 1 -- 172.21.15.79:0/843202863 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa4537f0 msgr2=0x5630fa423910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2e9f96640 1 --2- 172.21.15.79:0/843202863 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa4537f0 0x5630fa423910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2e9f96640 1 -- 172.21.15.79:0/843202863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa44fd60 msgr2=0x5630fa4e09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:14:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2e9f96640 1 --2- 172.21.15.79:0/843202863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa44fd60 0x5630fa4e09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2e9f96640 1 -- 172.21.15.79:0/843202863 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630fa424750 con 0x5630fa46d600 2024-04-25T02:14:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2e9795640 1 --2- 172.21.15.79:0/843202863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa44fd60 0x5630fa4e09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:14:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2e8f94640 1 --2- 172.21.15.79:0/843202863 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa4537f0 0x5630fa423910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:14:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2e9f96640 1 --2- 172.21.15.79:0/843202863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa46d600 0x5630fa423e50 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40093e0 tx=0x7fa2d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf706b267d5f885 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:14:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2c3fff640 1 -- 172.21.15.79:0/843202863 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4036040 con 0x5630fa46d600 2024-04-25T02:14:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2c3fff640 1 -- 172.21.15.79:0/843202863 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fa2d4031d30 con 0x5630fa46d600 2024-04-25T02:14:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/843202863 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2dc0044b0 con 0x5630fa46d600 2024-04-25T02:14:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2c3fff640 1 -- 172.21.15.79:0/843202863 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fa2d404e050 con 0x5630fa46d600 2024-04-25T02:14:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2ee7e7740 10 client.7803 fetch_fsmap learned FSMap version 55 2024-04-25T02:14:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/843202863 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x5630fa4e5a60 con 0x5630fa46d600 2024-04-25T02:14:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2c3fff640 1 -- 172.21.15.79:0/843202863 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2dc0044b0 con 0x5630fa46d600 2024-04-25T02:14:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2c3fff640 1 -- 172.21.15.79:0/843202863 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7fa2d4051020 con 0x5630fa46d600 2024-04-25T02:14:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2ee7e7740 10 client.7803 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T02:14:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2ee7e7740 10 client.7803 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:14:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2ee7e7740 20 client.7803 populate_metadata read hostname 'smithi079' 2024-04-25T02:14:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/843202863 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5630fa424be0 0x5630fa47c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2ee7e7740 4 client.7803 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:14:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.660+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/843202863 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5630fa390f40 con 0x5630fa424be0 2024-04-25T02:14:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2e9795640 1 --2- 172.21.15.79:0/843202863 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5630fa424be0 0x5630fa47c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2c3fff640 10 client.7803 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2e9795640 1 --2- 172.21.15.79:0/843202863 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5630fa424be0 0x5630fa47c540 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74f1df799349931 server_cookie=6e1765fdcbf5ed0 in_seq=0 out_seq=0 2024-04-25T02:14:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2c3fff640 1 -- 172.21.15.79:0/843202863 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+263 (crc 0 0 0) 0x5630fa390f40 con 0x5630fa424be0 2024-04-25T02:14:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2c3fff640 10 client.7803 handle_command_reply: tid=0 2024-04-25T02:14:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2ee7e7740 1 client.7803 shutdown 2024-04-25T02:14:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/843202863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa46d600 msgr2=0x5630fa423e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/843202863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa46d600 0x5630fa423e50 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40093e0 tx=0x7fa2d4004a40 comp rx=0 tx=0).stop 2024-04-25T02:14:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/843202863 shutdown_connections 2024-04-25T02:14:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/843202863 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5630fa424be0 0x5630fa47c540 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/843202863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fa46d600 0x5630fa423e50 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/843202863 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5630fa4537f0 0x5630fa423910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2ee7e7740 1 --2- 172.21.15.79:0/843202863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630fa44fd60 0x5630fa4e09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2c3fff640 0 client.7803 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:14:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/843202863 >> 172.21.15.79:0/843202863 conn(0x5630fa425a40 msgr2=0x5630fa425050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/843202863 shutdown_connections 2024-04-25T02:14:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2ee7e7740 1 -- 172.21.15.79:0/843202863 wait complete. 2024-04-25T02:14:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.661+0000 7fa2ee7e7740 20 client.7803 trim_cache size 0 max 16384 2024-04-25T02:14:31.675 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:14:31.675 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T02:14:31.675 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-04-25T02:14:31.675 INFO:teuthology.orchestra.run.smithi079.stdout: "a457d1c2-b9a4-4cc4-881d-ae48bd569be7": { 2024-04-25T02:14:31.675 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/dir", 2024-04-25T02:14:31.675 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "a457d1c2-b9a4-4cc4-881d-ae48bd569be7", 2024-04-25T02:14:31.675 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,repair" 2024-04-25T02:14:31.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:14:31.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:14:31.675 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:14:31.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.662+0000 7fa2eb9f9640 1 -- 172.21.15.79:0/1848497515 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa2d006be30 msgr2=0x7fa2d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.662+0000 7fa2eb9f9640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa2d006be30 0x7fa2d006e2f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc006fd0 tx=0x7fa2dc008040 comp rx=0 tx=0).stop 2024-04-25T02:14:31.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.662+0000 7fa2eb9f9640 1 -- 172.21.15.79:0/1848497515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e40d10c0 msgr2=0x7fa2e4155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:31.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.662+0000 7fa2eb9f9640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e40d10c0 0x7fa2e4155280 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800b3f0 tx=0x7fa2d800b8b0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.662+0000 7fa2eb9f9640 1 -- 172.21.15.79:0/1848497515 shutdown_connections 2024-04-25T02:14:31.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.662+0000 7fa2eb9f9640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa2d006be30 0x7fa2d006e2f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.662+0000 7fa2eb9f9640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2e415e4f0 0x7fa2e41557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.662+0000 7fa2eb9f9640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e40d10c0 0x7fa2e4155280 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.662+0000 7fa2eb9f9640 1 --2- 172.21.15.79:0/1848497515 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2e40cf7f0 0x7fa2e41f7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:31.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.662+0000 7fa2eb9f9640 1 -- 172.21.15.79:0/1848497515 >> 172.21.15.79:0/1848497515 conn(0x7fa2e409d4a0 msgr2=0x7fa2e40b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:31.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.662+0000 7fa2eb9f9640 1 -- 172.21.15.79:0/1848497515 shutdown_connections 2024-04-25T02:14:31.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:14:31.662+0000 7fa2eb9f9640 1 -- 172.21.15.79:0/1848497515 wait complete. 2024-04-25T02:14:31.678 INFO:tasks.cephfs.filesystem:scrub status for tag:a457d1c2-b9a4-4cc4-881d-ae48bd569be7 - {'path': '/dir', 'tag': 'a457d1c2-b9a4-4cc4-881d-ae48bd569be7', 'options': 'recursive,repair'} 2024-04-25T02:15:01.167 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:15:01.210 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:15:01.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:15:01.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T02:15:01.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.776+0000 7fe8dc2d6640 1 Processor -- start 2024-04-25T02:15:01.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.776+0000 7fe8dc2d6640 1 -- start start 2024-04-25T02:15:01.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.777+0000 7fe8dc2d6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8d406b2f0 0x7fe8d406b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.777+0000 7fe8dc2d6640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe8d4155f00 0x7fe8d4156310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.777+0000 7fe8dc2d6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8d4071cd0 con 0x7fe8d40b41b0 2024-04-25T02:15:01.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.777+0000 7fe8dc2d6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe8d4071fb0 con 0x7fe8d406b2f0 2024-04-25T02:15:01.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.777+0000 7fe8dc2d6640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe8d4072290 con 0x7fe8d4155f00 2024-04-25T02:15:01.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.777+0000 7fe8d9871640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8d406b2f0 0x7fe8d406b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.777+0000 7fe8d9871640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8d406b2f0 0x7fe8d406b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44322/0 (socket says 172.21.15.79:44322) 2024-04-25T02:15:01.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.777+0000 7fe8d9871640 1 -- 172.21.15.79:0/697202888 learned_addr learned my addr 172.21.15.79:0/697202888 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:01.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.778+0000 7fe8da873640 1 --2- 172.21.15.79:0/697202888 >> v2:172.21.15.189:3300/0 conn(0x7fe8d4155f00 0x7fe8d4156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.778+0000 7fe8d9871640 1 -- 172.21.15.79:0/697202888 >> v2:172.21.15.189:3300/0 conn(0x7fe8d4155f00 msgr2=0x7fe8d4156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:01.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.778+0000 7fe8d9871640 1 --2- 172.21.15.79:0/697202888 >> v2:172.21.15.189:3300/0 conn(0x7fe8d4155f00 0x7fe8d4156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.778+0000 7fe8d9871640 1 -- 172.21.15.79:0/697202888 >> v1:172.21.15.189:6789/0 conn(0x7fe8d40b41b0 legacy=0x7fe8d41605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:01.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.778+0000 7fe8d9871640 1 -- 172.21.15.79:0/697202888 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d4072570 con 0x7fe8d406b2f0 2024-04-25T02:15:01.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.778+0000 7fe8d9871640 1 --2- 172.21.15.79:0/697202888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8d406b2f0 0x7fe8d406b770 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40cc410 tx=0x7fe8c402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3dbfb556f5b8d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:01.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.778+0000 7fe8d9070640 1 -- 172.21.15.79:0/697202888 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4037070 con 0x7fe8d406b2f0 2024-04-25T02:15:01.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.779+0000 7fe8d9070640 1 -- 172.21.15.79:0/697202888 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c4032440 con 0x7fe8d406b2f0 2024-04-25T02:15:01.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.779+0000 7fe8d9070640 1 -- 172.21.15.79:0/697202888 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4032810 con 0x7fe8d406b2f0 2024-04-25T02:15:01.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.779+0000 7fe8dc2d6640 1 -- 172.21.15.79:0/697202888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8d406b2f0 msgr2=0x7fe8d406b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:01.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.779+0000 7fe8dc2d6640 1 --2- 172.21.15.79:0/697202888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8d406b2f0 0x7fe8d406b770 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40cc410 tx=0x7fe8c402a230 comp rx=0 tx=0).stop 2024-04-25T02:15:01.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.779+0000 7fe8dc2d6640 1 -- 172.21.15.79:0/697202888 shutdown_connections 2024-04-25T02:15:01.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.779+0000 7fe8dc2d6640 1 --2- 172.21.15.79:0/697202888 >> v2:172.21.15.189:3300/0 conn(0x7fe8d4155f00 0x7fe8d4156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.779+0000 7fe8dc2d6640 1 --2- 172.21.15.79:0/697202888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8d406b2f0 0x7fe8d406b770 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.779+0000 7fe8dc2d6640 1 -- 172.21.15.79:0/697202888 >> 172.21.15.79:0/697202888 conn(0x7fe8d40b1cd0 msgr2=0x7fe8d40b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:01.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.779+0000 7fe8dc2d6640 1 -- 172.21.15.79:0/697202888 shutdown_connections 2024-04-25T02:15:01.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.779+0000 7fe8dc2d6640 1 -- 172.21.15.79:0/697202888 wait complete. 2024-04-25T02:15:01.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.780+0000 7fe8dc2d6640 1 Processor -- start 2024-04-25T02:15:01.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.780+0000 7fe8dc2d6640 1 -- start start 2024-04-25T02:15:01.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.781+0000 7fe8dc2d6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8d406b2f0 0x7fe8d414a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.781+0000 7fe8dc2d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8d40b41b0 0x7fe8d40c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.781+0000 7fe8dc2d6640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8d4155f00 0x7fe8d414b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.781+0000 7fe8dc2d6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d40b4590 con 0x7fe8d40b41b0 2024-04-25T02:15:01.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.781+0000 7fe8dc2d6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d415c870 con 0x7fe8d406b2f0 2024-04-25T02:15:01.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.781+0000 7fe8dc2d6640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d40b4710 con 0x7fe8d4155f00 2024-04-25T02:15:01.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.781+0000 7fe8d9871640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8d40b41b0 0x7fe8d40c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.781+0000 7fe8d9871640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8d40b41b0 0x7fe8d40c98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44338/0 (socket says 172.21.15.79:44338) 2024-04-25T02:15:01.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.781+0000 7fe8d9871640 1 -- 172.21.15.79:0/1097126047 learned_addr learned my addr 172.21.15.79:0/1097126047 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:01.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.781+0000 7fe8da072640 1 --2- 172.21.15.79:0/1097126047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8d406b2f0 0x7fe8d414a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.781+0000 7fe8da873640 1 --2- 172.21.15.79:0/1097126047 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8d4155f00 0x7fe8d414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.782+0000 7fe8d9871640 1 -- 172.21.15.79:0/1097126047 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8d4155f00 msgr2=0x7fe8d414b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:01.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.782+0000 7fe8d9871640 1 --2- 172.21.15.79:0/1097126047 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8d4155f00 0x7fe8d414b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.782+0000 7fe8d9871640 1 -- 172.21.15.79:0/1097126047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8d406b2f0 msgr2=0x7fe8d414a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:01.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.782+0000 7fe8d9871640 1 --2- 172.21.15.79:0/1097126047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8d406b2f0 0x7fe8d414a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.782+0000 7fe8d9871640 1 -- 172.21.15.79:0/1097126047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d40cb940 con 0x7fe8d40b41b0 2024-04-25T02:15:01.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.782+0000 7fe8da873640 1 --2- 172.21.15.79:0/1097126047 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8d4155f00 0x7fe8d414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:01.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.782+0000 7fe8d9871640 1 --2- 172.21.15.79:0/1097126047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8d40b41b0 0x7fe8d40c98d0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4000c00 tx=0x7fe8c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:01.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.782+0000 7fe8caffd640 1 -- 172.21.15.79:0/1097126047 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4041020 con 0x7fe8d40b41b0 2024-04-25T02:15:01.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.782+0000 7fe8caffd640 1 -- 172.21.15.79:0/1097126047 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c40306c0 con 0x7fe8d40b41b0 2024-04-25T02:15:01.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.782+0000 7fe8dc2d6640 1 -- 172.21.15.79:0/1097126047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d406d610 con 0x7fe8d40b41b0 2024-04-25T02:15:01.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.782+0000 7fe8caffd640 1 -- 172.21.15.79:0/1097126047 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4037040 con 0x7fe8d40b41b0 2024-04-25T02:15:01.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.782+0000 7fe8dc2d6640 1 -- 172.21.15.79:0/1097126047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d406dbd0 con 0x7fe8d40b41b0 2024-04-25T02:15:01.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.783+0000 7fe8caffd640 1 -- 172.21.15.79:0/1097126047 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8c4044020 con 0x7fe8d40b41b0 2024-04-25T02:15:01.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.784+0000 7fe8caffd640 1 --2- 172.21.15.79:0/1097126047 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe8b806be30 0x7fe8b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.784+0000 7fe8da072640 1 --2- 172.21.15.79:0/1097126047 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe8b806be30 0x7fe8b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.784+0000 7fe8caffd640 1 -- 172.21.15.79:0/1097126047 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5824+0+0 (secure 0 0 0) 0x7fe8c40ab6b0 con 0x7fe8d40b41b0 2024-04-25T02:15:01.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.785+0000 7fe8da072640 1 --2- 172.21.15.79:0/1097126047 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe8b806be30 0x7fe8b806e2f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0004ea0 tx=0x7fe8d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:01.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.785+0000 7fe8defe2740 1 Processor -- start 2024-04-25T02:15:01.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.785+0000 7fe8defe2740 1 -- start start 2024-04-25T02:15:01.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8defe2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557114101d60 0x557114102140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8defe2740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55711411f600 0x55711411fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8defe2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5571140d7a40 0x55711411dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8defe2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55711403b6b0 con 0x5571140d7a40 2024-04-25T02:15:01.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8defe2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557113fe3880 con 0x557114101d60 2024-04-25T02:15:01.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8defe2740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x557114037670 con 0x55711411f600 2024-04-25T02:15:01.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8da873640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5571140d7a40 0x55711411dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8da873640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5571140d7a40 0x55711411dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44346/0 (socket says 172.21.15.79:44346) 2024-04-25T02:15:01.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8da873640 1 -- 172.21.15.79:0/2051669117 learned_addr learned my addr 172.21.15.79:0/2051669117 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:01.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8da072640 1 --2- 172.21.15.79:0/2051669117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557114101d60 0x557114102140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8d9871640 1 --2- 172.21.15.79:0/2051669117 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55711411f600 0x55711411fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8da873640 1 -- 172.21.15.79:0/2051669117 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55711411f600 msgr2=0x55711411fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:01.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8da873640 1 --2- 172.21.15.79:0/2051669117 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55711411f600 0x55711411fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8da873640 1 -- 172.21.15.79:0/2051669117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557114101d60 msgr2=0x557114102140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:01.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8da873640 1 --2- 172.21.15.79:0/2051669117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557114101d60 0x557114102140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8da873640 1 -- 172.21.15.79:0/2051669117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557113e197d0 con 0x5571140d7a40 2024-04-25T02:15:01.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.786+0000 7fe8da072640 1 --2- 172.21.15.79:0/2051669117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557114101d60 0x557114102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:01.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.787+0000 7fe8da873640 1 --2- 172.21.15.79:0/2051669117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5571140d7a40 0x55711411dcc0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc007330 tx=0x7fe8cc0077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36235139b8c6e399 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:01.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.787+0000 7fe8b7fff640 1 -- 172.21.15.79:0/2051669117 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc01a070 con 0x5571140d7a40 2024-04-25T02:15:01.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.787+0000 7fe8b7fff640 1 -- 172.21.15.79:0/2051669117 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8cc003da0 con 0x5571140d7a40 2024-04-25T02:15:01.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.787+0000 7fe8b7fff640 1 -- 172.21.15.79:0/2051669117 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc004230 con 0x5571140d7a40 2024-04-25T02:15:01.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.788+0000 7fe8defe2740 1 -- 172.21.15.79:0/2051669117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5571140d7a40 msgr2=0x55711411dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:01.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.788+0000 7fe8defe2740 1 --2- 172.21.15.79:0/2051669117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5571140d7a40 0x55711411dcc0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc007330 tx=0x7fe8cc0077f0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.788+0000 7fe8defe2740 1 -- 172.21.15.79:0/2051669117 shutdown_connections 2024-04-25T02:15:01.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.788+0000 7fe8defe2740 1 --2- 172.21.15.79:0/2051669117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5571140d7a40 0x55711411dcc0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.788+0000 7fe8defe2740 1 --2- 172.21.15.79:0/2051669117 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55711411f600 0x55711411fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.788+0000 7fe8defe2740 1 --2- 172.21.15.79:0/2051669117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557114101d60 0x557114102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.788+0000 7fe8defe2740 1 -- 172.21.15.79:0/2051669117 >> 172.21.15.79:0/2051669117 conn(0x5571140d4600 msgr2=0x55711411cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:01.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.788+0000 7fe8defe2740 1 -- 172.21.15.79:0/2051669117 shutdown_connections 2024-04-25T02:15:01.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.788+0000 7fe8defe2740 1 -- 172.21.15.79:0/2051669117 wait complete. 2024-04-25T02:15:01.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.789+0000 7fe8defe2740 1 -- start start 2024-04-25T02:15:01.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.789+0000 7fe8defe2740 1 Processor -- start 2024-04-25T02:15:01.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.790+0000 7fe8defe2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557114101d60 0x55711412d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.790+0000 7fe8defe2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55711411f600 0x5571140d1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.790+0000 7fe8defe2740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5571140fb260 0x5571140d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.790+0000 7fe8defe2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5571140d87e0 con 0x557114101d60 2024-04-25T02:15:01.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.790+0000 7fe8defe2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557113ff6f50 con 0x55711411f600 2024-04-25T02:15:01.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.790+0000 7fe8defe2740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5571140d2530 con 0x5571140fb260 2024-04-25T02:15:01.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.790+0000 7fe8defe2740 10 client.0 _ll_register_callbacks cb 0x557114032000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:15:01.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.790+0000 7fe8da072640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557114101d60 0x55711412d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.790+0000 7fe8da072640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557114101d60 0x55711412d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44348/0 (socket says 172.21.15.79:44348) 2024-04-25T02:15:01.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.790+0000 7fe8da072640 1 -- 172.21.15.79:0/3505404349 learned_addr learned my addr 172.21.15.79:0/3505404349 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:01.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8d9871640 1 --2- 172.21.15.79:0/3505404349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55711411f600 0x5571140d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8da873640 1 --2- 172.21.15.79:0/3505404349 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5571140fb260 0x5571140d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8da072640 1 -- 172.21.15.79:0/3505404349 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5571140fb260 msgr2=0x5571140d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:01.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8da072640 1 --2- 172.21.15.79:0/3505404349 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5571140fb260 0x5571140d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8da072640 1 -- 172.21.15.79:0/3505404349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55711411f600 msgr2=0x5571140d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:01.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8da072640 1 --2- 172.21.15.79:0/3505404349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55711411f600 0x5571140d1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8da072640 1 -- 172.21.15.79:0/3505404349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557113d4f3f0 con 0x557114101d60 2024-04-25T02:15:01.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8da873640 1 --2- 172.21.15.79:0/3505404349 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5571140fb260 0x5571140d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:01.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8da072640 1 --2- 172.21.15.79:0/3505404349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557114101d60 0x55711412d3b0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000ed10 tx=0x7fe8d00036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9be63bafe14405c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:01.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:15:01.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8b57fa640 1 -- 172.21.15.79:0/3505404349 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0020410 con 0x557114101d60 2024-04-25T02:15:01.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8b57fa640 1 -- 172.21.15.79:0/3505404349 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 5824+0+0 (secure 0 0 0) 0x7fe8d00205b0 con 0x557114101d60 2024-04-25T02:15:01.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8defe2740 1 -- 172.21.15.79:0/3505404349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8cc003da0 con 0x557114101d60 2024-04-25T02:15:01.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8b57fa640 1 -- 172.21.15.79:0/3505404349 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fe8d0003800 con 0x557114101d60 2024-04-25T02:15:01.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8defe2740 10 client.7815 fetch_fsmap learned FSMap version 55 2024-04-25T02:15:01.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8defe2740 1 -- 172.21.15.79:0/3505404349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x557113d0f0f0 con 0x557114101d60 2024-04-25T02:15:01.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8b57fa640 1 -- 172.21.15.79:0/3505404349 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8cc003da0 con 0x557114101d60 2024-04-25T02:15:01.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8b57fa640 1 -- 172.21.15.79:0/3505404349 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7fe8d0030080 con 0x557114101d60 2024-04-25T02:15:01.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8defe2740 10 client.7815 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T02:15:01.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.791+0000 7fe8defe2740 10 client.7815 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:15:01.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.792+0000 7fe8defe2740 20 client.7815 populate_metadata read hostname 'smithi079' 2024-04-25T02:15:01.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.792+0000 7fe8defe2740 1 --2- 172.21.15.79:0/3505404349 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5571141041c0 0x557114104630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.792+0000 7fe8defe2740 4 client.7815 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:15:01.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.792+0000 7fe8defe2740 1 -- 172.21.15.79:0/3505404349 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557114048bf0 con 0x5571141041c0 2024-04-25T02:15:01.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.792+0000 7fe8d9871640 1 --2- 172.21.15.79:0/3505404349 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5571141041c0 0x557114104630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.792+0000 7fe8b57fa640 10 client.7815 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:15:01.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.792+0000 7fe8d9871640 1 --2- 172.21.15.79:0/3505404349 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5571141041c0 0x557114104630 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d27d4dcf770d14e1 server_cookie=3478cfc87d406294 in_seq=0 out_seq=0 2024-04-25T02:15:01.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.793+0000 7fe8b57fa640 1 -- 172.21.15.79:0/3505404349 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557114048bf0 con 0x5571141041c0 2024-04-25T02:15:01.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.793+0000 7fe8b57fa640 10 client.7815 handle_command_reply: tid=0 2024-04-25T02:15:01.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.793+0000 7fe8defe2740 1 client.7815 shutdown 2024-04-25T02:15:01.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.793+0000 7fe8defe2740 1 -- 172.21.15.79:0/3505404349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557114101d60 msgr2=0x55711412d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:01.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.793+0000 7fe8defe2740 1 --2- 172.21.15.79:0/3505404349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557114101d60 0x55711412d3b0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000ed10 tx=0x7fe8d00036f0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.793+0000 7fe8defe2740 1 -- 172.21.15.79:0/3505404349 shutdown_connections 2024-04-25T02:15:01.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.793+0000 7fe8defe2740 1 --2- 172.21.15.79:0/3505404349 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5571140fb260 0x5571140d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.793+0000 7fe8defe2740 1 --2- 172.21.15.79:0/3505404349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55711411f600 0x5571140d1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.793+0000 7fe8defe2740 1 --2- 172.21.15.79:0/3505404349 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x5571141041c0 0x557114104630 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.793+0000 7fe8defe2740 1 --2- 172.21.15.79:0/3505404349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557114101d60 0x55711412d3b0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.793+0000 7fe8b57fa640 0 client.7815 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:15:01.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.793+0000 7fe8defe2740 1 -- 172.21.15.79:0/3505404349 >> 172.21.15.79:0/3505404349 conn(0x5571140d7a40 msgr2=0x55711411c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:01.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.793+0000 7fe8defe2740 1 -- 172.21.15.79:0/3505404349 shutdown_connections 2024-04-25T02:15:01.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.793+0000 7fe8defe2740 1 -- 172.21.15.79:0/3505404349 wait complete. 2024-04-25T02:15:01.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.793+0000 7fe8defe2740 20 client.7815 trim_cache size 0 max 16384 2024-04-25T02:15:01.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.813+0000 7fe8defe2740 1 Processor -- start 2024-04-25T02:15:01.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.813+0000 7fe8defe2740 1 -- start start 2024-04-25T02:15:01.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.813+0000 7fe8defe2740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5571140fb260 0x55711411be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.813+0000 7fe8defe2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557114101d60 0x55711411c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.813+0000 7fe8defe2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55711411f600 0x55711412d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.813+0000 7fe8defe2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d4200a30 con 0x557114101d60 2024-04-25T02:15:01.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.813+0000 7fe8defe2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d40d0710 con 0x55711411f600 2024-04-25T02:15:01.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.813+0000 7fe8defe2740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d415f560 con 0x5571140fb260 2024-04-25T02:15:01.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.813+0000 7fe8d9871640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557114101d60 0x55711411c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.814+0000 7fe8d9871640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557114101d60 0x55711411c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44356/0 (socket says 172.21.15.79:44356) 2024-04-25T02:15:01.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.814+0000 7fe8d9871640 1 -- 172.21.15.79:0/2755650453 learned_addr learned my addr 172.21.15.79:0/2755650453 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:01.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.814+0000 7fe8da873640 1 --2- 172.21.15.79:0/2755650453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55711411f600 0x55711412d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.814+0000 7fe8da072640 1 --2- 172.21.15.79:0/2755650453 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5571140fb260 0x55711411be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.814+0000 7fe8d9871640 1 -- 172.21.15.79:0/2755650453 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5571140fb260 msgr2=0x55711411be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:01.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.814+0000 7fe8d9871640 1 --2- 172.21.15.79:0/2755650453 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5571140fb260 0x55711411be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.814+0000 7fe8d9871640 1 -- 172.21.15.79:0/2755650453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55711411f600 msgr2=0x55711412d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:01.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.814+0000 7fe8d9871640 1 --2- 172.21.15.79:0/2755650453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55711411f600 0x55711412d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.814+0000 7fe8d9871640 1 -- 172.21.15.79:0/2755650453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571141024b0 con 0x557114101d60 2024-04-25T02:15:01.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.814+0000 7fe8da873640 1 --2- 172.21.15.79:0/2755650453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55711411f600 0x55711412d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:01.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.814+0000 7fe8da072640 1 --2- 172.21.15.79:0/2755650453 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5571140fb260 0x55711411be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:01.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.814+0000 7fe8d9871640 1 --2- 172.21.15.79:0/2755650453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557114101d60 0x55711411c3a0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fe8c402a270 tx=0x7fe8c40a9ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed47f0de67114158 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:01.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.814+0000 7fe8b77fe640 1 -- 172.21.15.79:0/2755650453 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4079980 con 0x557114101d60 2024-04-25T02:15:01.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.814+0000 7fe8b77fe640 1 -- 172.21.15.79:0/2755650453 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c407dd30 con 0x557114101d60 2024-04-25T02:15:01.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.814+0000 7fe8b77fe640 1 -- 172.21.15.79:0/2755650453 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4082560 con 0x557114101d60 2024-04-25T02:15:01.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.815+0000 7fe8defe2740 1 -- 172.21.15.79:0/2755650453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557114101d60 msgr2=0x55711411c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:01.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.815+0000 7fe8defe2740 1 --2- 172.21.15.79:0/2755650453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557114101d60 0x55711411c3a0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fe8c402a270 tx=0x7fe8c40a9ad0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.815+0000 7fe8defe2740 1 -- 172.21.15.79:0/2755650453 shutdown_connections 2024-04-25T02:15:01.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.815+0000 7fe8defe2740 1 --2- 172.21.15.79:0/2755650453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55711411f600 0x55711412d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.815+0000 7fe8defe2740 1 --2- 172.21.15.79:0/2755650453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557114101d60 0x55711411c3a0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.815+0000 7fe8defe2740 1 --2- 172.21.15.79:0/2755650453 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5571140fb260 0x55711411be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.815+0000 7fe8defe2740 1 -- 172.21.15.79:0/2755650453 >> 172.21.15.79:0/2755650453 conn(0x5571140d7a40 msgr2=0x557114115310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:01.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.815+0000 7fe8defe2740 1 -- 172.21.15.79:0/2755650453 shutdown_connections 2024-04-25T02:15:01.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.815+0000 7fe8defe2740 1 -- 172.21.15.79:0/2755650453 wait complete. 2024-04-25T02:15:01.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.815+0000 7fe8defe2740 1 -- start start 2024-04-25T02:15:01.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.816+0000 7fe8defe2740 1 Processor -- start 2024-04-25T02:15:01.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.816+0000 7fe8defe2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571140fb260 0x5571140d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.816+0000 7fe8defe2740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557114101d60 0x55711411d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.816+0000 7fe8defe2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55711411f600 0x5571141993a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.816+0000 7fe8defe2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d40d00c0 con 0x55711411f600 2024-04-25T02:15:01.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.816+0000 7fe8defe2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55711419a0c0 con 0x5571140fb260 2024-04-25T02:15:01.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.816+0000 7fe8defe2740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55711412d470 con 0x557114101d60 2024-04-25T02:15:01.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.816+0000 7fe8defe2740 10 client.0 _ll_register_callbacks cb 0x7fe8d0007dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:15:01.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8da873640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55711411f600 0x5571141993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8da873640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55711411f600 0x5571141993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44372/0 (socket says 172.21.15.79:44372) 2024-04-25T02:15:01.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8da873640 1 -- 172.21.15.79:0/2901490261 learned_addr learned my addr 172.21.15.79:0/2901490261 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:01.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8da072640 1 --2- 172.21.15.79:0/2901490261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571140fb260 0x5571140d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8d9871640 1 --2- 172.21.15.79:0/2901490261 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557114101d60 0x55711411d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8da873640 1 -- 172.21.15.79:0/2901490261 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557114101d60 msgr2=0x55711411d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:01.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8da873640 1 --2- 172.21.15.79:0/2901490261 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557114101d60 0x55711411d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8da873640 1 -- 172.21.15.79:0/2901490261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571140fb260 msgr2=0x5571140d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:01.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8da873640 1 --2- 172.21.15.79:0/2901490261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571140fb260 0x5571140d1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8da873640 1 -- 172.21.15.79:0/2901490261 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55711412d6c0 con 0x55711411f600 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8da873640 1 --2- 172.21.15.79:0/2901490261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55711411f600 0x5571141993a0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc018040 tx=0x7fe8cc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4600540b671b3a94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8b57fa640 1 -- 172.21.15.79:0/2901490261 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc025030 con 0x55711411f600 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8b57fa640 1 -- 172.21.15.79:0/2901490261 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 5824+0+0 (secure 0 0 0) 0x7fe8cc015470 con 0x55711411f600 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8defe2740 1 -- 172.21.15.79:0/2901490261 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8c407dd30 con 0x55711411f600 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8b57fa640 1 -- 172.21.15.79:0/2901490261 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fe8cc031050 con 0x55711411f600 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8defe2740 10 client.7821 fetch_fsmap learned FSMap version 55 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8defe2740 1 -- 172.21.15.79:0/2901490261 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x557114199ec0 con 0x55711411f600 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8b57fa640 1 -- 172.21.15.79:0/2901490261 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c407dd30 con 0x55711411f600 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.817+0000 7fe8b57fa640 1 -- 172.21.15.79:0/2901490261 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7fe8cc034020 con 0x55711411f600 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 10 client.7821 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 10 client.7821 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 20 client.7821 populate_metadata read hostname 'smithi079' 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 1 --2- 172.21.15.79:0/2901490261 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55711418ff60 0x5571141045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 4 client.7821 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:15:01.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 1 -- 172.21.15.79:0/2901490261 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557114117af0 con 0x55711418ff60 2024-04-25T02:15:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8da072640 1 --2- 172.21.15.79:0/2901490261 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55711418ff60 0x5571141045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8b57fa640 10 client.7821 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:15:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8da072640 1 --2- 172.21.15.79:0/2901490261 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55711418ff60 0x5571141045a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=337f55648b81d4ac server_cookie=66b3eb3641605133 in_seq=0 out_seq=0 2024-04-25T02:15:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8b57fa640 1 -- 172.21.15.79:0/2901490261 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557114117af0 con 0x55711418ff60 2024-04-25T02:15:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8b57fa640 10 client.7821 handle_command_reply: tid=0 2024-04-25T02:15:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 1 client.7821 shutdown 2024-04-25T02:15:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 1 -- 172.21.15.79:0/2901490261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55711411f600 msgr2=0x5571141993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 1 --2- 172.21.15.79:0/2901490261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55711411f600 0x5571141993a0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc018040 tx=0x7fe8cc004ab0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 1 -- 172.21.15.79:0/2901490261 shutdown_connections 2024-04-25T02:15:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 1 --2- 172.21.15.79:0/2901490261 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x55711418ff60 0x5571141045a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 1 --2- 172.21.15.79:0/2901490261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55711411f600 0x5571141993a0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8b57fa640 0 client.7821 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:15:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 1 --2- 172.21.15.79:0/2901490261 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557114101d60 0x55711411d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 1 --2- 172.21.15.79:0/2901490261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571140fb260 0x5571140d1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 1 -- 172.21.15.79:0/2901490261 >> 172.21.15.79:0/2901490261 conn(0x5571140d7a40 msgr2=0x557114115260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:01.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 1 -- 172.21.15.79:0/2901490261 shutdown_connections 2024-04-25T02:15:01.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.818+0000 7fe8defe2740 1 -- 172.21.15.79:0/2901490261 wait complete. 2024-04-25T02:15:01.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.819+0000 7fe8defe2740 20 client.7821 trim_cache size 0 max 16384 2024-04-25T02:15:01.831 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:15:01.831 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-04-25T02:15:01.831 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-04-25T02:15:01.831 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:15:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.819+0000 7fe8dc2d6640 1 -- 172.21.15.79:0/1097126047 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe8b806be30 msgr2=0x7fe8b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.819+0000 7fe8dc2d6640 1 --2- 172.21.15.79:0/1097126047 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe8b806be30 0x7fe8b806e2f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0004ea0 tx=0x7fe8d0009040 comp rx=0 tx=0).stop 2024-04-25T02:15:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.819+0000 7fe8dc2d6640 1 -- 172.21.15.79:0/1097126047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8d40b41b0 msgr2=0x7fe8d40c98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.819+0000 7fe8dc2d6640 1 --2- 172.21.15.79:0/1097126047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8d40b41b0 0x7fe8d40c98d0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4000c00 tx=0x7fe8c40046c0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.819+0000 7fe8dc2d6640 1 -- 172.21.15.79:0/1097126047 shutdown_connections 2024-04-25T02:15:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.819+0000 7fe8dc2d6640 1 --2- 172.21.15.79:0/1097126047 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe8b806be30 0x7fe8b806e2f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.819+0000 7fe8dc2d6640 1 --2- 172.21.15.79:0/1097126047 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8d4155f00 0x7fe8d414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.819+0000 7fe8dc2d6640 1 --2- 172.21.15.79:0/1097126047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8d40b41b0 0x7fe8d40c98d0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.819+0000 7fe8dc2d6640 1 --2- 172.21.15.79:0/1097126047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8d406b2f0 0x7fe8d414a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.819+0000 7fe8dc2d6640 1 -- 172.21.15.79:0/1097126047 >> 172.21.15.79:0/1097126047 conn(0x7fe8d40b1cd0 msgr2=0x7fe8d415a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:01.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.819+0000 7fe8dc2d6640 1 -- 172.21.15.79:0/1097126047 shutdown_connections 2024-04-25T02:15:01.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.819+0000 7fe8dc2d6640 1 -- 172.21.15.79:0/1097126047 wait complete. 2024-04-25T02:15:01.835 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T02:15:01.836 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:15:01.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.928+0000 7f7c7ab09640 1 Processor -- start 2024-04-25T02:15:01.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.928+0000 7f7c7ab09640 1 -- start start 2024-04-25T02:15:01.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.929+0000 7f7c7ab09640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7c74144cb0 0x7f7c740b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.929+0000 7f7c7ab09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7c7406e660 0x7f7c74071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.929+0000 7f7c7ab09640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c74070d90 con 0x7f7c740b5580 2024-04-25T02:15:01.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.929+0000 7f7c7ab09640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7c740cf130 con 0x7f7c7406e660 2024-04-25T02:15:01.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.929+0000 7f7c7ab09640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f7c740cf410 con 0x7f7c74144cb0 2024-04-25T02:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.929+0000 7f7c790a6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7c7406e660 0x7f7c74071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.929+0000 7f7c790a6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7c7406e660 0x7f7c74071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44382/0 (socket says 172.21.15.79:44382) 2024-04-25T02:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.929+0000 7f7c790a6640 1 -- 172.21.15.79:0/790929000 learned_addr learned my addr 172.21.15.79:0/790929000 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.929+0000 7f7c73fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7c740b5580 0x7f7c7406df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57896/0 (socket says 172.21.15.79:57896) 2024-04-25T02:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.929+0000 7f7c788a5640 1 --2- 172.21.15.79:0/790929000 >> v2:172.21.15.189:3300/0 conn(0x7f7c74144cb0 0x7f7c740b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.929+0000 7f7c790a6640 1 -- 172.21.15.79:0/790929000 >> v2:172.21.15.189:3300/0 conn(0x7f7c74144cb0 msgr2=0x7f7c740b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.929+0000 7f7c790a6640 1 --2- 172.21.15.79:0/790929000 >> v2:172.21.15.189:3300/0 conn(0x7f7c74144cb0 0x7f7c740b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.929+0000 7f7c790a6640 1 -- 172.21.15.79:0/790929000 >> v1:172.21.15.79:6789/0 conn(0x7f7c740b5580 legacy=0x7f7c7406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.929+0000 7f7c790a6640 1 -- 172.21.15.79:0/790929000 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c740cf6f0 con 0x7f7c7406e660 2024-04-25T02:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.929+0000 7f7c788a5640 1 --2- 172.21.15.79:0/790929000 >> v2:172.21.15.189:3300/0 conn(0x7f7c74144cb0 0x7f7c740b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.930+0000 7f7c790a6640 1 --2- 172.21.15.79:0/790929000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c7406e660 0x7f7c74071240 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009e50 tx=0x7f7c6c02a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739ff14b44b7212c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.930+0000 7f7c737fe640 1 -- 172.21.15.79:0/790929000 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c036070 con 0x7f7c7406e660 2024-04-25T02:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.930+0000 7f7c737fe640 1 -- 172.21.15.79:0/790929000 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c6c031600 con 0x7f7c7406e660 2024-04-25T02:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.930+0000 7f7c737fe640 1 -- 172.21.15.79:0/790929000 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0319d0 con 0x7f7c7406e660 2024-04-25T02:15:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.931+0000 7f7c7ab09640 1 -- 172.21.15.79:0/790929000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c7406e660 msgr2=0x7f7c74071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.931+0000 7f7c7ab09640 1 --2- 172.21.15.79:0/790929000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c7406e660 0x7f7c74071240 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009e50 tx=0x7f7c6c02a640 comp rx=0 tx=0).stop 2024-04-25T02:15:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.931+0000 7f7c7ab09640 1 -- 172.21.15.79:0/790929000 shutdown_connections 2024-04-25T02:15:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.931+0000 7f7c7ab09640 1 --2- 172.21.15.79:0/790929000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c7406e660 0x7f7c74071240 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.931+0000 7f7c7ab09640 1 --2- 172.21.15.79:0/790929000 >> v2:172.21.15.189:3300/0 conn(0x7f7c74144cb0 0x7f7c740b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.931+0000 7f7c7ab09640 1 -- 172.21.15.79:0/790929000 >> 172.21.15.79:0/790929000 conn(0x7f7c740cfc80 msgr2=0x7f7c740d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.931+0000 7f7c7ab09640 1 -- 172.21.15.79:0/790929000 shutdown_connections 2024-04-25T02:15:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.931+0000 7f7c7ab09640 1 -- 172.21.15.79:0/790929000 wait complete. 2024-04-25T02:15:01.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.932+0000 7f7c7ab09640 1 Processor -- start 2024-04-25T02:15:01.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.932+0000 7f7c7ab09640 1 -- start start 2024-04-25T02:15:01.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c7ab09640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c7406e660 0x7f7c741e6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c7ab09640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c740b5580 0x7f7c74072040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c7ab09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c74144cb0 0x7f7c74072580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c7ab09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74145ab0 con 0x7f7c74144cb0 2024-04-25T02:15:01.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c7ab09640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74145090 con 0x7f7c740b5580 2024-04-25T02:15:01.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c7ab09640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7c74145c30 con 0x7f7c7406e660 2024-04-25T02:15:01.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c790a6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c74144cb0 0x7f7c74072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c790a6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c74144cb0 0x7f7c74072580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44398/0 (socket says 172.21.15.79:44398) 2024-04-25T02:15:01.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c790a6640 1 -- 172.21.15.79:0/1847755643 learned_addr learned my addr 172.21.15.79:0/1847755643 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:01.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c788a5640 1 --2- 172.21.15.79:0/1847755643 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c7406e660 0x7f7c741e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c73fff640 1 --2- 172.21.15.79:0/1847755643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c740b5580 0x7f7c74072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c790a6640 1 -- 172.21.15.79:0/1847755643 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c7406e660 msgr2=0x7f7c741e6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:01.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c790a6640 1 --2- 172.21.15.79:0/1847755643 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c7406e660 0x7f7c741e6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c790a6640 1 -- 172.21.15.79:0/1847755643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c740b5580 msgr2=0x7f7c74072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:01.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c790a6640 1 --2- 172.21.15.79:0/1847755643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c740b5580 0x7f7c74072040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:01.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c790a6640 1 -- 172.21.15.79:0/1847755643 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c741e65a0 con 0x7f7c74144cb0 2024-04-25T02:15:01.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c73fff640 1 --2- 172.21.15.79:0/1847755643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c740b5580 0x7f7c74072040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:01.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c790a6640 1 --2- 172.21.15.79:0/1847755643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c74144cb0 0x7f7c74072580 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009e50 tx=0x7f7c6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:01.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.933+0000 7f7c717fa640 1 -- 172.21.15.79:0/1847755643 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c036050 con 0x7f7c74144cb0 2024-04-25T02:15:01.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.934+0000 7f7c717fa640 1 -- 172.21.15.79:0/1847755643 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c6c042070 con 0x7f7c74144cb0 2024-04-25T02:15:01.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.934+0000 7f7c7ab09640 1 -- 172.21.15.79:0/1847755643 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c740b4870 con 0x7f7c74144cb0 2024-04-25T02:15:01.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.934+0000 7f7c717fa640 1 -- 172.21.15.79:0/1847755643 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c007bd0 con 0x7f7c74144cb0 2024-04-25T02:15:01.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.934+0000 7f7c7ab09640 1 -- 172.21.15.79:0/1847755643 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c740b3fd0 con 0x7f7c74144cb0 2024-04-25T02:15:01.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.935+0000 7f7c7ab09640 1 -- 172.21.15.79:0/1847755643 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c740690a0 con 0x7f7c74144cb0 2024-04-25T02:15:01.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.935+0000 7f7c717fa640 1 -- 172.21.15.79:0/1847755643 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c6c047460 con 0x7f7c74144cb0 2024-04-25T02:15:01.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.935+0000 7f7c717fa640 1 --2- 172.21.15.79:0/1847755643 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7c5806be30 0x7f7c5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:01.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.935+0000 7f7c717fa640 1 -- 172.21.15.79:0/1847755643 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5824+0+0 (secure 0 0 0) 0x7f7c6c0abe70 con 0x7f7c74144cb0 2024-04-25T02:15:01.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.936+0000 7f7c788a5640 1 --2- 172.21.15.79:0/1847755643 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7c5806be30 0x7f7c5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:01.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.936+0000 7f7c788a5640 1 --2- 172.21.15.79:0/1847755643 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7c5806be30 0x7f7c5806e2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7c680096d0 tx=0x7f7c68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:01.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:01.940+0000 7f7c717fa640 1 -- 172.21.15.79:0/1847755643 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7c741e65a0 con 0x7f7c74144cb0 2024-04-25T02:15:02.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.154+0000 7f7c7ab09640 1 -- 172.21.15.79:0/1847755643 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c740d0b90 con 0x7f7c74144cb0 2024-04-25T02:15:02.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.154+0000 7f7c717fa640 1 -- 172.21.15.79:0/1847755643 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5187 (secure 0 0 0) 0x7f7c6c02ae20 con 0x7f7c74144cb0 2024-04-25T02:15:02.160 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:02.160 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:14:04.613172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":6,"addr":"172.21.15.79:6837/630320044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":630320044},{"type":"v1","addr":"172.21.15.79:6837","nonce":630320044}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7602,"qdb_cluster":[7602]},"id":6}]} 2024-04-25T02:15:02.160 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 55 2024-04-25T02:15:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.156+0000 7f7c7ab09640 1 -- 172.21.15.79:0/1847755643 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7c5806be30 msgr2=0x7f7c5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.156+0000 7f7c7ab09640 1 --2- 172.21.15.79:0/1847755643 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7c5806be30 0x7f7c5806e2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7c680096d0 tx=0x7f7c68008040 comp rx=0 tx=0).stop 2024-04-25T02:15:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.156+0000 7f7c7ab09640 1 -- 172.21.15.79:0/1847755643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c74144cb0 msgr2=0x7f7c74072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.156+0000 7f7c7ab09640 1 --2- 172.21.15.79:0/1847755643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c74144cb0 0x7f7c74072580 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009e50 tx=0x7f7c6c004a40 comp rx=0 tx=0).stop 2024-04-25T02:15:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.157+0000 7f7c7ab09640 1 -- 172.21.15.79:0/1847755643 shutdown_connections 2024-04-25T02:15:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.157+0000 7f7c7ab09640 1 --2- 172.21.15.79:0/1847755643 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7c5806be30 0x7f7c5806e2f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.157+0000 7f7c7ab09640 1 --2- 172.21.15.79:0/1847755643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c74144cb0 0x7f7c74072580 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.157+0000 7f7c7ab09640 1 --2- 172.21.15.79:0/1847755643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c740b5580 0x7f7c74072040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.157+0000 7f7c7ab09640 1 --2- 172.21.15.79:0/1847755643 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c7406e660 0x7f7c741e6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.157+0000 7f7c7ab09640 1 -- 172.21.15.79:0/1847755643 >> 172.21.15.79:0/1847755643 conn(0x7f7c740cfc80 msgr2=0x7f7c74071140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:02.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.157+0000 7f7c7ab09640 1 -- 172.21.15.79:0/1847755643 shutdown_connections 2024-04-25T02:15:02.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.157+0000 7f7c7ab09640 1 -- 172.21.15.79:0/1847755643 wait complete. 2024-04-25T02:15:02.173 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T02:15:02.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.266+0000 7efdf674f640 1 Processor -- start 2024-04-25T02:15:02.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.266+0000 7efdf674f640 1 -- start start 2024-04-25T02:15:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdf674f640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7efdf015e4f0 0x7efdf00d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdf674f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efdf00cf7f0 0x7efdf00d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdf674f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdf00cfc80 0x7efdf00d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdf674f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7efdf00d1ee0 con 0x7efdf00cf7f0 2024-04-25T02:15:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdf674f640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7efdf00d21c0 con 0x7efdf015e4f0 2024-04-25T02:15:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdf674f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efdf00d24a0 con 0x7efdf00cfc80 2024-04-25T02:15:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdef7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efdf00cf7f0 0x7efdf00d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdef7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efdf00cf7f0 0x7efdf00d09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44404/0 (socket says 172.21.15.79:44404) 2024-04-25T02:15:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdef7fe640 1 -- 172.21.15.79:0/2917682027 learned_addr learned my addr 172.21.15.79:0/2917682027 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdeffff640 1 --2- 172.21.15.79:0/2917682027 >> v2:172.21.15.189:3300/0 conn(0x7efdf015e4f0 0x7efdf00d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdf4cec640 1 --2- 172.21.15.79:0/2917682027 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdf00cfc80 0x7efdf00d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdef7fe640 1 -- 172.21.15.79:0/2917682027 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdf00cfc80 msgr2=0x7efdf00d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdef7fe640 1 --2- 172.21.15.79:0/2917682027 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdf00cfc80 0x7efdf00d0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdef7fe640 1 -- 172.21.15.79:0/2917682027 >> v2:172.21.15.189:3300/0 conn(0x7efdf015e4f0 msgr2=0x7efdf00d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdef7fe640 1 --2- 172.21.15.79:0/2917682027 >> v2:172.21.15.189:3300/0 conn(0x7efdf015e4f0 0x7efdf00d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdef7fe640 1 -- 172.21.15.79:0/2917682027 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf00d2780 con 0x7efdf00cf7f0 2024-04-25T02:15:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.267+0000 7efdeffff640 1 --2- 172.21.15.79:0/2917682027 >> v2:172.21.15.189:3300/0 conn(0x7efdf015e4f0 0x7efdf00d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.268+0000 7efdef7fe640 1 --2- 172.21.15.79:0/2917682027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf00cf7f0 0x7efdf00d09b0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7efde0009870 tx=0x7efde002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d6cb8a2e41d15d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:02.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.268+0000 7efdeeffd640 1 -- 172.21.15.79:0/2917682027 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde0037070 con 0x7efdf00cf7f0 2024-04-25T02:15:02.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.268+0000 7efdeeffd640 1 -- 172.21.15.79:0/2917682027 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde0032440 con 0x7efdf00cf7f0 2024-04-25T02:15:02.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.268+0000 7efdeeffd640 1 -- 172.21.15.79:0/2917682027 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde0032810 con 0x7efdf00cf7f0 2024-04-25T02:15:02.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.269+0000 7efdf674f640 1 -- 172.21.15.79:0/2917682027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf00cf7f0 msgr2=0x7efdf00d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.269+0000 7efdf674f640 1 --2- 172.21.15.79:0/2917682027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf00cf7f0 0x7efdf00d09b0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7efde0009870 tx=0x7efde002a210 comp rx=0 tx=0).stop 2024-04-25T02:15:02.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.269+0000 7efdf674f640 1 -- 172.21.15.79:0/2917682027 shutdown_connections 2024-04-25T02:15:02.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.269+0000 7efdf674f640 1 --2- 172.21.15.79:0/2917682027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf00cf7f0 0x7efdf00d09b0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.269+0000 7efdf674f640 1 --2- 172.21.15.79:0/2917682027 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdf00cfc80 0x7efdf00d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.269+0000 7efdf674f640 1 --2- 172.21.15.79:0/2917682027 >> v2:172.21.15.189:3300/0 conn(0x7efdf015e4f0 0x7efdf00d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.269+0000 7efdf674f640 1 -- 172.21.15.79:0/2917682027 >> 172.21.15.79:0/2917682027 conn(0x7efdf009d4a0 msgr2=0x7efdf00d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:02.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.269+0000 7efdf674f640 1 -- 172.21.15.79:0/2917682027 shutdown_connections 2024-04-25T02:15:02.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.269+0000 7efdf674f640 1 -- 172.21.15.79:0/2917682027 wait complete. 2024-04-25T02:15:02.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.270+0000 7efdf674f640 1 Processor -- start 2024-04-25T02:15:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.270+0000 7efdf674f640 1 -- start start 2024-04-25T02:15:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdf674f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdf00cf7f0 0x7efdf01514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdf674f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf00cfc80 0x7efdf00ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdf674f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdf015e4f0 0x7efdf00b9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdf674f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efdf006bc30 con 0x7efdf00cfc80 2024-04-25T02:15:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdf674f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efdf00d50f0 con 0x7efdf00cf7f0 2024-04-25T02:15:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdf674f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efdf006bdb0 con 0x7efdf015e4f0 2024-04-25T02:15:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdef7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf00cfc80 0x7efdf00ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdef7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf00cfc80 0x7efdf00ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44418/0 (socket says 172.21.15.79:44418) 2024-04-25T02:15:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdef7fe640 1 -- 172.21.15.79:0/3880882352 learned_addr learned my addr 172.21.15.79:0/3880882352 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdf4cec640 1 --2- 172.21.15.79:0/3880882352 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdf015e4f0 0x7efdf00b9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdeffff640 1 --2- 172.21.15.79:0/3880882352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdf00cf7f0 0x7efdf01514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdef7fe640 1 -- 172.21.15.79:0/3880882352 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdf015e4f0 msgr2=0x7efdf00b9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdef7fe640 1 --2- 172.21.15.79:0/3880882352 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdf015e4f0 0x7efdf00b9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdef7fe640 1 -- 172.21.15.79:0/3880882352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdf00cf7f0 msgr2=0x7efdf01514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdef7fe640 1 --2- 172.21.15.79:0/3880882352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdf00cf7f0 0x7efdf01514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdef7fe640 1 -- 172.21.15.79:0/3880882352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf00cabe0 con 0x7efdf00cfc80 2024-04-25T02:15:02.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.271+0000 7efdf4cec640 1 --2- 172.21.15.79:0/3880882352 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdf015e4f0 0x7efdf00b9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:02.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.272+0000 7efdef7fe640 1 --2- 172.21.15.79:0/3880882352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf00cfc80 0x7efdf00ca490 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7efde0000c00 tx=0x7efde00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:02.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.272+0000 7efdecff9640 1 -- 172.21.15.79:0/3880882352 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde0041020 con 0x7efdf00cfc80 2024-04-25T02:15:02.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.272+0000 7efdecff9640 1 -- 172.21.15.79:0/3880882352 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde003d620 con 0x7efdf00cfc80 2024-04-25T02:15:02.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.272+0000 7efdf674f640 1 -- 172.21.15.79:0/3880882352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf00c7dd0 con 0x7efdf00cfc80 2024-04-25T02:15:02.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.272+0000 7efdecff9640 1 -- 172.21.15.79:0/3880882352 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde0037040 con 0x7efdf00cfc80 2024-04-25T02:15:02.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.272+0000 7efdf674f640 1 -- 172.21.15.79:0/3880882352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf00c8390 con 0x7efdf00cfc80 2024-04-25T02:15:02.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.273+0000 7efdecff9640 1 -- 172.21.15.79:0/3880882352 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efde0044020 con 0x7efdf00cfc80 2024-04-25T02:15:02.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.274+0000 7efdecff9640 1 --2- 172.21.15.79:0/3880882352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efddc06be30 0x7efddc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.274+0000 7efdecff9640 1 -- 172.21.15.79:0/3880882352 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5824+0+0 (secure 0 0 0) 0x7efde00ab570 con 0x7efdf00cfc80 2024-04-25T02:15:02.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.274+0000 7efdeffff640 1 --2- 172.21.15.79:0/3880882352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efddc06be30 0x7efddc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.274+0000 7efdeffff640 1 --2- 172.21.15.79:0/3880882352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efddc06be30 0x7efddc06e2f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efde4006fd0 tx=0x7efde4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:02.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.275+0000 7efdf945a740 1 Processor -- start 2024-04-25T02:15:02.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.275+0000 7efdf945a740 1 -- start start 2024-04-25T02:15:02.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.275+0000 7efdf945a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91ac3330 0x559f91ac6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.275+0000 7efdf945a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ac6ff0 0x559f91ae2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.275+0000 7efdf945a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91ae3470 0x559f91ae38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.275+0000 7efdf945a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559f919ff520 con 0x559f91ac6ff0 2024-04-25T02:15:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.275+0000 7efdf945a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559f9199dae0 con 0x559f91ae3470 2024-04-25T02:15:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.275+0000 7efdf945a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x559f919fb4e0 con 0x559f91ac3330 2024-04-25T02:15:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.276+0000 7efdef7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ac6ff0 0x559f91ae2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.276+0000 7efdef7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ac6ff0 0x559f91ae2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44432/0 (socket says 172.21.15.79:44432) 2024-04-25T02:15:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.276+0000 7efdef7fe640 1 -- 172.21.15.79:0/3951473489 learned_addr learned my addr 172.21.15.79:0/3951473489 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.276+0000 7efdef7fe640 1 -- 172.21.15.79:0/3951473489 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91ac3330 msgr2=0x559f91ac6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.276+0000 7efdef7fe640 1 --2- 172.21.15.79:0/3951473489 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91ac3330 0x559f91ac6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.276+0000 7efdef7fe640 1 -- 172.21.15.79:0/3951473489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91ae3470 msgr2=0x559f91ae38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.276+0000 7efdef7fe640 1 --2- 172.21.15.79:0/3951473489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91ae3470 0x559f91ae38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.276+0000 7efdef7fe640 1 -- 172.21.15.79:0/3951473489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f919c3240 con 0x559f91ac6ff0 2024-04-25T02:15:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.276+0000 7efdef7fe640 1 --2- 172.21.15.79:0/3951473489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ac6ff0 0x559f91ae2f30 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7efde00a9a30 tx=0x7efde0009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5345f9b8e28b84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.276+0000 7efdd5ffb640 1 -- 172.21.15.79:0/3951473489 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde0079ec0 con 0x559f91ac6ff0 2024-04-25T02:15:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.276+0000 7efdd5ffb640 1 -- 172.21.15.79:0/3951473489 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde00a9e50 con 0x559f91ac6ff0 2024-04-25T02:15:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.276+0000 7efdd5ffb640 1 -- 172.21.15.79:0/3951473489 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde00797c0 con 0x559f91ac6ff0 2024-04-25T02:15:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.277+0000 7efdf945a740 1 -- 172.21.15.79:0/3951473489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ac6ff0 msgr2=0x559f91ae2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.277+0000 7efdf945a740 1 --2- 172.21.15.79:0/3951473489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ac6ff0 0x559f91ae2f30 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7efde00a9a30 tx=0x7efde0009240 comp rx=0 tx=0).stop 2024-04-25T02:15:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.277+0000 7efdf945a740 1 -- 172.21.15.79:0/3951473489 shutdown_connections 2024-04-25T02:15:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.277+0000 7efdf945a740 1 --2- 172.21.15.79:0/3951473489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91ae3470 0x559f91ae38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.277+0000 7efdf945a740 1 --2- 172.21.15.79:0/3951473489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ac6ff0 0x559f91ae2f30 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.277+0000 7efdf945a740 1 --2- 172.21.15.79:0/3951473489 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91ac3330 0x559f91ac6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.277+0000 7efdf945a740 1 -- 172.21.15.79:0/3951473489 >> 172.21.15.79:0/3951473489 conn(0x559f91a99310 msgr2=0x559f91a9a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.277+0000 7efdf945a740 1 -- 172.21.15.79:0/3951473489 shutdown_connections 2024-04-25T02:15:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.277+0000 7efdf945a740 1 -- 172.21.15.79:0/3951473489 wait complete. 2024-04-25T02:15:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.277+0000 7efdf945a740 1 -- start start 2024-04-25T02:15:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.277+0000 7efdf945a740 1 Processor -- start 2024-04-25T02:15:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.278+0000 7efdf945a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91ac6ff0 0x559f91ade6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.278+0000 7efdf945a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ae3470 0x559f91ac25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.278+0000 7efdf945a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91abf650 0x559f91ac2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.278+0000 7efdf945a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559f9199dae0 con 0x559f91ae3470 2024-04-25T02:15:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.278+0000 7efdf945a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559f9199b470 con 0x559f91ac6ff0 2024-04-25T02:15:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.278+0000 7efdf945a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x559f919ff520 con 0x559f91abf650 2024-04-25T02:15:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.278+0000 7efdf945a740 10 client.0 _ll_register_callbacks cb 0x559f919bfdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:15:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.278+0000 7efdef7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ae3470 0x559f91ac25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.278+0000 7efdef7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ae3470 0x559f91ac25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44438/0 (socket says 172.21.15.79:44438) 2024-04-25T02:15:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.278+0000 7efdef7fe640 1 -- 172.21.15.79:0/3723120800 learned_addr learned my addr 172.21.15.79:0/3723120800 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.278+0000 7efdeffff640 1 --2- 172.21.15.79:0/3723120800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91ac6ff0 0x559f91ade6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.278+0000 7efdf4cec640 1 --2- 172.21.15.79:0/3723120800 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91abf650 0x559f91ac2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdef7fe640 1 -- 172.21.15.79:0/3723120800 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91abf650 msgr2=0x559f91ac2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdef7fe640 1 --2- 172.21.15.79:0/3723120800 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91abf650 0x559f91ac2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdef7fe640 1 -- 172.21.15.79:0/3723120800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91ac6ff0 msgr2=0x559f91ade6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdef7fe640 1 --2- 172.21.15.79:0/3723120800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91ac6ff0 0x559f91ade6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdef7fe640 1 -- 172.21.15.79:0/3723120800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f919b2bf0 con 0x559f91ae3470 2024-04-25T02:15:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdeffff640 1 --2- 172.21.15.79:0/3723120800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91ac6ff0 0x559f91ade6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdef7fe640 1 --2- 172.21.15.79:0/3723120800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ae3470 0x559f91ac25e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7efde0079750 tx=0x7efde0098000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c256527359280612 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdceffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:15:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdceffd640 1 -- 172.21.15.79:0/3723120800 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde00a8060 con 0x559f91ae3470 2024-04-25T02:15:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdceffd640 1 -- 172.21.15.79:0/3723120800 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 5824+0+0 (secure 0 0 0) 0x7efde0079c20 con 0x559f91ae3470 2024-04-25T02:15:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdf945a740 1 -- 172.21.15.79:0/3723120800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efde00a9e50 con 0x559f91ae3470 2024-04-25T02:15:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdceffd640 1 -- 172.21.15.79:0/3723120800 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7efde009d050 con 0x559f91ae3470 2024-04-25T02:15:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdf945a740 10 client.7842 fetch_fsmap learned FSMap version 55 2024-04-25T02:15:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdf945a740 1 -- 172.21.15.79:0/3723120800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x559f917df7c0 con 0x559f91ae3470 2024-04-25T02:15:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdceffd640 1 -- 172.21.15.79:0/3723120800 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde00a9e50 con 0x559f91ae3470 2024-04-25T02:15:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdceffd640 1 -- 172.21.15.79:0/3723120800 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7efde00a0020 con 0x559f91ae3470 2024-04-25T02:15:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdf945a740 10 client.7842 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T02:15:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdf945a740 10 client.7842 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:15:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdf945a740 20 client.7842 populate_metadata read hostname 'smithi079' 2024-04-25T02:15:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdf945a740 1 --2- 172.21.15.79:0/3723120800 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x559f91af58b0 0x559f91af5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdf945a740 4 client.7842 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:15:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdf945a740 1 -- 172.21.15.79:0/3723120800 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f91a12d50 con 0x559f91af58b0 2024-04-25T02:15:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.279+0000 7efdeffff640 1 --2- 172.21.15.79:0/3723120800 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x559f91af58b0 0x559f91af5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.280+0000 7efdceffd640 10 client.7842 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:15:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.280+0000 7efdeffff640 1 --2- 172.21.15.79:0/3723120800 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x559f91af58b0 0x559f91af5c90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e358966f8c9a4611 server_cookie=d38a2932d9086b38 in_seq=0 out_seq=0 2024-04-25T02:15:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.280+0000 7efdceffd640 1 -- 172.21.15.79:0/3723120800 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559f91a12d50 con 0x559f91af58b0 2024-04-25T02:15:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.280+0000 7efdceffd640 10 client.7842 handle_command_reply: tid=0 2024-04-25T02:15:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.280+0000 7efdf945a740 1 client.7842 shutdown 2024-04-25T02:15:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.281+0000 7efdf945a740 1 -- 172.21.15.79:0/3723120800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ae3470 msgr2=0x559f91ac25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.281+0000 7efdf945a740 1 --2- 172.21.15.79:0/3723120800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ae3470 0x559f91ac25e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7efde0079750 tx=0x7efde0098000 comp rx=0 tx=0).stop 2024-04-25T02:15:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.281+0000 7efdf945a740 1 -- 172.21.15.79:0/3723120800 shutdown_connections 2024-04-25T02:15:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.281+0000 7efdf945a740 1 --2- 172.21.15.79:0/3723120800 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91abf650 0x559f91ac2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.281+0000 7efdf945a740 1 --2- 172.21.15.79:0/3723120800 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x559f91af58b0 0x559f91af5c90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.281+0000 7efdf945a740 1 --2- 172.21.15.79:0/3723120800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ae3470 0x559f91ac25e0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.281+0000 7efdceffd640 0 client.7842 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:15:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.281+0000 7efdf945a740 1 --2- 172.21.15.79:0/3723120800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91ac6ff0 0x559f91ade6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.281+0000 7efdf945a740 1 -- 172.21.15.79:0/3723120800 >> 172.21.15.79:0/3723120800 conn(0x559f91ac3330 msgr2=0x559f91a95f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.281+0000 7efdf945a740 1 -- 172.21.15.79:0/3723120800 shutdown_connections 2024-04-25T02:15:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.281+0000 7efdf945a740 1 -- 172.21.15.79:0/3723120800 wait complete. 2024-04-25T02:15:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.281+0000 7efdf945a740 20 client.7842 trim_cache size 0 max 16384 2024-04-25T02:15:02.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.294+0000 7efdf945a740 1 Processor -- start 2024-04-25T02:15:02.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.294+0000 7efdf945a740 1 -- start start 2024-04-25T02:15:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdf945a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91abf650 0x559f91a9db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdf945a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91ac6ff0 0x559f91ad7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdf945a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91ae3470 0x559f91ad7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdf945a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efdf01ffb90 con 0x559f91abf650 2024-04-25T02:15:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdf945a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efdf01f8520 con 0x559f91ac6ff0 2024-04-25T02:15:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdf945a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efdf01f3d30 con 0x559f91ae3470 2024-04-25T02:15:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdeffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91abf650 0x559f91a9db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdeffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91abf650 0x559f91a9db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44448/0 (socket says 172.21.15.79:44448) 2024-04-25T02:15:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdeffff640 1 -- 172.21.15.79:0/2836718604 learned_addr learned my addr 172.21.15.79:0/2836718604 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdeffff640 1 -- 172.21.15.79:0/2836718604 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91ae3470 msgr2=0x559f91ad7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdeffff640 1 --2- 172.21.15.79:0/2836718604 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91ae3470 0x559f91ad7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdeffff640 1 -- 172.21.15.79:0/2836718604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91ac6ff0 msgr2=0x559f91ad7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdeffff640 1 --2- 172.21.15.79:0/2836718604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91ac6ff0 0x559f91ad7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdeffff640 1 -- 172.21.15.79:0/2836718604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9183ff50 con 0x559f91abf650 2024-04-25T02:15:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdeffff640 1 --2- 172.21.15.79:0/2836718604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91abf650 0x559f91a9db90 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7efde400b660 tx=0x7efde4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91dabb0a96f2d1b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdd57fa640 1 -- 172.21.15.79:0/2836718604 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde4015ad0 con 0x559f91abf650 2024-04-25T02:15:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdd57fa640 1 -- 172.21.15.79:0/2836718604 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde402c070 con 0x559f91abf650 2024-04-25T02:15:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.295+0000 7efdd57fa640 1 -- 172.21.15.79:0/2836718604 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde4004030 con 0x559f91abf650 2024-04-25T02:15:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.296+0000 7efdf945a740 1 -- 172.21.15.79:0/2836718604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91abf650 msgr2=0x559f91a9db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.296+0000 7efdf945a740 1 --2- 172.21.15.79:0/2836718604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91abf650 0x559f91a9db90 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7efde400b660 tx=0x7efde4012000 comp rx=0 tx=0).stop 2024-04-25T02:15:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.296+0000 7efdf945a740 1 -- 172.21.15.79:0/2836718604 shutdown_connections 2024-04-25T02:15:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.296+0000 7efdf945a740 1 --2- 172.21.15.79:0/2836718604 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91ae3470 0x559f91ad7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.296+0000 7efdf945a740 1 --2- 172.21.15.79:0/2836718604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91ac6ff0 0x559f91ad7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.296+0000 7efdf945a740 1 --2- 172.21.15.79:0/2836718604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91abf650 0x559f91a9db90 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.296+0000 7efdf945a740 1 -- 172.21.15.79:0/2836718604 >> 172.21.15.79:0/2836718604 conn(0x559f91ac3330 msgr2=0x559f91ae4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.296+0000 7efdf945a740 1 -- 172.21.15.79:0/2836718604 shutdown_connections 2024-04-25T02:15:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.296+0000 7efdf945a740 1 -- 172.21.15.79:0/2836718604 wait complete. 2024-04-25T02:15:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.296+0000 7efdf945a740 1 -- start start 2024-04-25T02:15:02.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.297+0000 7efdf945a740 1 Processor -- start 2024-04-25T02:15:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.297+0000 7efdf945a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91abf650 0x559f91a9c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.297+0000 7efdf945a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ac6ff0 0x559f91a9ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.297+0000 7efdf945a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91ae3470 0x559f91ac5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.297+0000 7efdf945a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559f9199dae0 con 0x559f91ac6ff0 2024-04-25T02:15:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.297+0000 7efdf945a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559f91ac8780 con 0x559f91abf650 2024-04-25T02:15:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.297+0000 7efdf945a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x559f9199b470 con 0x559f91ae3470 2024-04-25T02:15:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.297+0000 7efdf945a740 10 client.0 _ll_register_callbacks cb 0x7efde0079620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:15:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.297+0000 7efdef7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ac6ff0 0x559f91a9ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.297+0000 7efdef7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ac6ff0 0x559f91a9ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44464/0 (socket says 172.21.15.79:44464) 2024-04-25T02:15:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.297+0000 7efdef7fe640 1 -- 172.21.15.79:0/1470598968 learned_addr learned my addr 172.21.15.79:0/1470598968 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdeffff640 1 --2- 172.21.15.79:0/1470598968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91abf650 0x559f91a9c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdf4cec640 1 --2- 172.21.15.79:0/1470598968 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91ae3470 0x559f91ac5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdef7fe640 1 -- 172.21.15.79:0/1470598968 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91ae3470 msgr2=0x559f91ac5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdef7fe640 1 --2- 172.21.15.79:0/1470598968 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91ae3470 0x559f91ac5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdef7fe640 1 -- 172.21.15.79:0/1470598968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91abf650 msgr2=0x559f91a9c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdef7fe640 1 --2- 172.21.15.79:0/1470598968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91abf650 0x559f91a9c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdef7fe640 1 -- 172.21.15.79:0/1470598968 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f916d30b0 con 0x559f91ac6ff0 2024-04-25T02:15:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdeffff640 1 --2- 172.21.15.79:0/1470598968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91abf650 0x559f91a9c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdf4cec640 1 --2- 172.21.15.79:0/1470598968 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91ae3470 0x559f91ac5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdef7fe640 1 --2- 172.21.15.79:0/1470598968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ac6ff0 0x559f91a9ce70 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7efde0076140 tx=0x7efde00a9990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d1c8115406889b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdceffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:15:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdceffd640 1 -- 172.21.15.79:0/1470598968 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde007db70 con 0x559f91ac6ff0 2024-04-25T02:15:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdceffd640 1 -- 172.21.15.79:0/1470598968 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 5824+0+0 (secure 0 0 0) 0x7efde00a4b40 con 0x559f91ac6ff0 2024-04-25T02:15:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdf945a740 1 -- 172.21.15.79:0/1470598968 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efde402c070 con 0x559f91ac6ff0 2024-04-25T02:15:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdceffd640 1 -- 172.21.15.79:0/1470598968 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7efde0079ec0 con 0x559f91ac6ff0 2024-04-25T02:15:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdf945a740 10 client.7848 fetch_fsmap learned FSMap version 55 2024-04-25T02:15:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdf945a740 1 -- 172.21.15.79:0/1470598968 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x559f9198c780 con 0x559f91ac6ff0 2024-04-25T02:15:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdceffd640 1 -- 172.21.15.79:0/1470598968 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde402c070 con 0x559f91ac6ff0 2024-04-25T02:15:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdceffd640 1 -- 172.21.15.79:0/1470598968 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7efde00a0030 con 0x559f91ac6ff0 2024-04-25T02:15:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdf945a740 10 client.7848 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T02:15:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdf945a740 10 client.7848 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:15:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdf945a740 20 client.7848 populate_metadata read hostname 'smithi079' 2024-04-25T02:15:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdf945a740 1 --2- 172.21.15.79:0/1470598968 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x559f91ac5c60 0x559f91ac6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdf945a740 4 client.7848 mds_command: new command op to 7602 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T02:15:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.298+0000 7efdf945a740 1 -- 172.21.15.79:0/1470598968 --> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x559f91a0ca60 con 0x559f91ac5c60 2024-04-25T02:15:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdeffff640 1 --2- 172.21.15.79:0/1470598968 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x559f91ac5c60 0x559f91ac6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdceffd640 10 client.7848 ms_handle_connect on v2:172.21.15.79:6836/630320044 2024-04-25T02:15:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdeffff640 1 --2- 172.21.15.79:0/1470598968 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x559f91ac5c60 0x559f91ac6040 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd4d4ece47b04927 server_cookie=3aadbc90ddb77467 in_seq=0 out_seq=0 2024-04-25T02:15:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdceffd640 1 -- 172.21.15.79:0/1470598968 <== mds.0 v2:172.21.15.79:6836/630320044 1 ==== command_reply(tid 0: 0 ) ==== 8+0+143 (crc 0 0 0) 0x559f91a0ca60 con 0x559f91ac5c60 2024-04-25T02:15:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdceffd640 10 client.7848 handle_command_reply: tid=0 2024-04-25T02:15:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdf945a740 1 client.7848 shutdown 2024-04-25T02:15:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdf945a740 1 -- 172.21.15.79:0/1470598968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ac6ff0 msgr2=0x559f91a9ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdf945a740 1 --2- 172.21.15.79:0/1470598968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ac6ff0 0x559f91a9ce70 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7efde0076140 tx=0x7efde00a9990 comp rx=0 tx=0).stop 2024-04-25T02:15:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdf945a740 1 -- 172.21.15.79:0/1470598968 shutdown_connections 2024-04-25T02:15:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdf945a740 1 --2- 172.21.15.79:0/1470598968 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559f91ae3470 0x559f91ac5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdf945a740 1 --2- 172.21.15.79:0/1470598968 >> [v2:172.21.15.79:6836/630320044,v1:172.21.15.79:6837/630320044] conn(0x559f91ac5c60 0x559f91ac6040 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdf945a740 1 --2- 172.21.15.79:0/1470598968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559f91ac6ff0 0x559f91a9ce70 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdf945a740 1 --2- 172.21.15.79:0/1470598968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f91abf650 0x559f91a9c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdceffd640 0 client.7848 ms_handle_reset on v2:172.21.15.79:6836/630320044 2024-04-25T02:15:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdf945a740 1 -- 172.21.15.79:0/1470598968 >> 172.21.15.79:0/1470598968 conn(0x559f91ac3330 msgr2=0x559f91af5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdf945a740 1 -- 172.21.15.79:0/1470598968 shutdown_connections 2024-04-25T02:15:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdf945a740 1 -- 172.21.15.79:0/1470598968 wait complete. 2024-04-25T02:15:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.299+0000 7efdf945a740 20 client.7848 trim_cache size 0 max 16384 2024-04-25T02:15:02.312 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:02.312 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-04-25T02:15:02.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:02.312 INFO:teuthology.orchestra.run.smithi079.stdout: "damage_type": "backtrace", 2024-04-25T02:15:02.312 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 113979766, 2024-04-25T02:15:02.312 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627777, 2024-04-25T02:15:02.312 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/testdir/hardlink" 2024-04-25T02:15:02.312 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:02.312 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-04-25T02:15:02.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.300+0000 7efdf674f640 1 -- 172.21.15.79:0/3880882352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efddc06be30 msgr2=0x7efddc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.300+0000 7efdf674f640 1 --2- 172.21.15.79:0/3880882352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efddc06be30 0x7efddc06e2f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efde4006fd0 tx=0x7efde4008040 comp rx=0 tx=0).stop 2024-04-25T02:15:02.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.300+0000 7efdf674f640 1 -- 172.21.15.79:0/3880882352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf00cfc80 msgr2=0x7efdf00ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.300+0000 7efdf674f640 1 --2- 172.21.15.79:0/3880882352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf00cfc80 0x7efdf00ca490 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7efde0000c00 tx=0x7efde00046c0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.300+0000 7efdf674f640 1 -- 172.21.15.79:0/3880882352 shutdown_connections 2024-04-25T02:15:02.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.300+0000 7efdf674f640 1 --2- 172.21.15.79:0/3880882352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efddc06be30 0x7efddc06e2f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.300+0000 7efdf674f640 1 --2- 172.21.15.79:0/3880882352 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efdf015e4f0 0x7efdf00b9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.300+0000 7efdf674f640 1 --2- 172.21.15.79:0/3880882352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf00cfc80 0x7efdf00ca490 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.300+0000 7efdf674f640 1 --2- 172.21.15.79:0/3880882352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdf00cf7f0 0x7efdf01514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.300+0000 7efdf674f640 1 -- 172.21.15.79:0/3880882352 >> 172.21.15.79:0/3880882352 conn(0x7efdf009d4a0 msgr2=0x7efdf00b4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:02.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.300+0000 7efdf674f640 1 -- 172.21.15.79:0/3880882352 shutdown_connections 2024-04-25T02:15:02.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.300+0000 7efdf674f640 1 -- 172.21.15.79:0/3880882352 wait complete. 2024-04-25T02:15:02.316 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:15:02.316 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:15:02.331 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:15:02.331 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:15:02.386 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:15:02.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.517+0000 7f495a4da640 1 Processor -- start 2024-04-25T02:15:02.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.517+0000 7f495a4da640 1 -- start start 2024-04-25T02:15:02.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.518+0000 7f495a4da640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f495415e4d0 0x7f495406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.518+0000 7f495a4da640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f49540b3570 0x7f49540d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.518+0000 7f495a4da640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49540b3020 0x7f49540d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.518+0000 7f495a4da640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f49540d1660 con 0x7f49540b3020 2024-04-25T02:15:02.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.518+0000 7f495a4da640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f49540d1380 con 0x7f49540b3570 2024-04-25T02:15:02.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.518+0000 7f495a4da640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f49540cede0 con 0x7f495415e4d0 2024-04-25T02:15:02.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.518+0000 7f4958a77640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49540b3020 0x7f49540d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.518+0000 7f4958a77640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49540b3020 0x7f49540d2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44466/0 (socket says 172.21.15.79:44466) 2024-04-25T02:15:02.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.518+0000 7f4958a77640 1 -- 172.21.15.79:0/1847424088 learned_addr learned my addr 172.21.15.79:0/1847424088 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:02.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.519+0000 7f49537fe640 1 --2- 172.21.15.79:0/1847424088 >> v2:172.21.15.189:3300/0 conn(0x7f49540b3570 0x7f49540d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.519+0000 7f4953fff640 1 --2- 172.21.15.79:0/1847424088 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f495415e4d0 0x7f495406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.519+0000 7f4958a77640 1 -- 172.21.15.79:0/1847424088 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f495415e4d0 msgr2=0x7f495406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:02.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.519+0000 7f4958a77640 1 --2- 172.21.15.79:0/1847424088 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f495415e4d0 0x7f495406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.519+0000 7f4958a77640 1 -- 172.21.15.79:0/1847424088 >> v2:172.21.15.189:3300/0 conn(0x7f49540b3570 msgr2=0x7f49540d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:02.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.519+0000 7f4958a77640 1 --2- 172.21.15.79:0/1847424088 >> v2:172.21.15.189:3300/0 conn(0x7f49540b3570 0x7f49540d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.519+0000 7f4958a77640 1 -- 172.21.15.79:0/1847424088 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49540cf0c0 con 0x7f49540b3020 2024-04-25T02:15:02.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.519+0000 7f4953fff640 1 --2- 172.21.15.79:0/1847424088 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f495415e4d0 0x7f495406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:02.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.520+0000 7f4958a77640 1 --2- 172.21.15.79:0/1847424088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49540b3020 0x7f49540d2c50 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f495409db90 tx=0x7f494c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be8c1426c2eac11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:02.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.520+0000 7f4952ffd640 1 -- 172.21.15.79:0/1847424088 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c036070 con 0x7f49540b3020 2024-04-25T02:15:02.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.520+0000 7f4952ffd640 1 -- 172.21.15.79:0/1847424088 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f494c031600 con 0x7f49540b3020 2024-04-25T02:15:02.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.520+0000 7f4952ffd640 1 -- 172.21.15.79:0/1847424088 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c0319d0 con 0x7f49540b3020 2024-04-25T02:15:02.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.520+0000 7f495a4da640 1 -- 172.21.15.79:0/1847424088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49540b3020 msgr2=0x7f49540d2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.520+0000 7f495a4da640 1 --2- 172.21.15.79:0/1847424088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49540b3020 0x7f49540d2c50 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f495409db90 tx=0x7f494c02a6a0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.520+0000 7f495a4da640 1 -- 172.21.15.79:0/1847424088 shutdown_connections 2024-04-25T02:15:02.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.520+0000 7f495a4da640 1 --2- 172.21.15.79:0/1847424088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49540b3020 0x7f49540d2c50 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.520+0000 7f495a4da640 1 --2- 172.21.15.79:0/1847424088 >> v2:172.21.15.189:3300/0 conn(0x7f49540b3570 0x7f49540d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.520+0000 7f495a4da640 1 --2- 172.21.15.79:0/1847424088 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f495415e4d0 0x7f495406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.520+0000 7f495a4da640 1 -- 172.21.15.79:0/1847424088 >> 172.21.15.79:0/1847424088 conn(0x7f495409d460 msgr2=0x7f49540d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:02.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.520+0000 7f495a4da640 1 -- 172.21.15.79:0/1847424088 shutdown_connections 2024-04-25T02:15:02.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.520+0000 7f495a4da640 1 -- 172.21.15.79:0/1847424088 wait complete. 2024-04-25T02:15:02.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.522+0000 7f495a4da640 1 Processor -- start 2024-04-25T02:15:02.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.522+0000 7f495a4da640 1 -- start start 2024-04-25T02:15:02.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.522+0000 7f495a4da640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49540b3020 0x7f49541561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.522+0000 7f495a4da640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49540b3570 0x7f49540b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.522+0000 7f495a4da640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f495415e4d0 0x7f49540b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f495a4da640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f49540d2250 con 0x7f495415e4d0 2024-04-25T02:15:02.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f495a4da640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f49540d20d0 con 0x7f49540b3020 2024-04-25T02:15:02.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f495a4da640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f495406c1b0 con 0x7f49540b3570 2024-04-25T02:15:02.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f4958a77640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f495415e4d0 0x7f49540b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f4958a77640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f495415e4d0 0x7f49540b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44478/0 (socket says 172.21.15.79:44478) 2024-04-25T02:15:02.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f4958a77640 1 -- 172.21.15.79:0/1525730200 learned_addr learned my addr 172.21.15.79:0/1525730200 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:02.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f4953fff640 1 --2- 172.21.15.79:0/1525730200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49540b3020 0x7f49541561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f49537fe640 1 --2- 172.21.15.79:0/1525730200 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49540b3570 0x7f49540b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f4958a77640 1 -- 172.21.15.79:0/1525730200 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49540b3570 msgr2=0x7f49540b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f4958a77640 1 --2- 172.21.15.79:0/1525730200 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49540b3570 0x7f49540b80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f4958a77640 1 -- 172.21.15.79:0/1525730200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49540b3020 msgr2=0x7f49541561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f4958a77640 1 --2- 172.21.15.79:0/1525730200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49540b3020 0x7f49541561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f4958a77640 1 -- 172.21.15.79:0/1525730200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49540b6d20 con 0x7f495415e4d0 2024-04-25T02:15:02.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f4958a77640 1 --2- 172.21.15.79:0/1525730200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f495415e4d0 0x7f49540b3ac0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f494c034040 tx=0x7f494c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:02.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f4950ff9640 1 -- 172.21.15.79:0/1525730200 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c041020 con 0x7f495415e4d0 2024-04-25T02:15:02.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f4950ff9640 1 -- 172.21.15.79:0/1525730200 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f494c0077a0 con 0x7f495415e4d0 2024-04-25T02:15:02.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f4950ff9640 1 -- 172.21.15.79:0/1525730200 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c036040 con 0x7f495415e4d0 2024-04-25T02:15:02.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f495a4da640 1 -- 172.21.15.79:0/1525730200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49540b7000 con 0x7f495415e4d0 2024-04-25T02:15:02.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.523+0000 7f495a4da640 1 -- 172.21.15.79:0/1525730200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49540b75c0 con 0x7f495415e4d0 2024-04-25T02:15:02.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.524+0000 7f495a4da640 1 -- 172.21.15.79:0/1525730200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49540690a0 con 0x7f495415e4d0 2024-04-25T02:15:02.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.525+0000 7f4950ff9640 1 -- 172.21.15.79:0/1525730200 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f494c044020 con 0x7f495415e4d0 2024-04-25T02:15:02.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.525+0000 7f4950ff9640 1 --2- 172.21.15.79:0/1525730200 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f494006be30 0x7f494006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.526+0000 7f4953fff640 1 --2- 172.21.15.79:0/1525730200 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f494006be30 0x7f494006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.526+0000 7f4950ff9640 1 -- 172.21.15.79:0/1525730200 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5824+0+0 (secure 0 0 0) 0x7f494c0ac2d0 con 0x7f495415e4d0 2024-04-25T02:15:02.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.526+0000 7f4953fff640 1 --2- 172.21.15.79:0/1525730200 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f494006be30 0x7f494006e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f494800ab60 tx=0x7f4948008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:02.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.529+0000 7f4950ff9640 1 -- 172.21.15.79:0/1525730200 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f494c04b020 con 0x7f495415e4d0 2024-04-25T02:15:02.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.712+0000 7f495a4da640 1 -- 172.21.15.79:0/1525730200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49540d0f60 con 0x7f495415e4d0 2024-04-25T02:15:02.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.713+0000 7f4950ff9640 1 -- 172.21.15.79:0/1525730200 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+16851 (secure 0 0 0) 0x7f494c07a770 con 0x7f495415e4d0 2024-04-25T02:15:02.718 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:02.719 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":89,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:14:42.706880+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:13:41.594939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T02:13:42.348770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.2a","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/2290864495":"2024-04-26T02:13:53.595807+0000","172.21.15.79:6836/2290864495":"2024-04-26T02:13:53.595807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:15:02.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.715+0000 7f495a4da640 1 -- 172.21.15.79:0/1525730200 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f494006be30 msgr2=0x7f494006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.715+0000 7f495a4da640 1 --2- 172.21.15.79:0/1525730200 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f494006be30 0x7f494006e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f494800ab60 tx=0x7f4948008040 comp rx=0 tx=0).stop 2024-04-25T02:15:02.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.715+0000 7f495a4da640 1 -- 172.21.15.79:0/1525730200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f495415e4d0 msgr2=0x7f49540b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.715+0000 7f495a4da640 1 --2- 172.21.15.79:0/1525730200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f495415e4d0 0x7f49540b3ac0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f494c034040 tx=0x7f494c004a40 comp rx=0 tx=0).stop 2024-04-25T02:15:02.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.715+0000 7f495a4da640 1 -- 172.21.15.79:0/1525730200 shutdown_connections 2024-04-25T02:15:02.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.715+0000 7f495a4da640 1 --2- 172.21.15.79:0/1525730200 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f494006be30 0x7f494006e2f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.715+0000 7f495a4da640 1 --2- 172.21.15.79:0/1525730200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f495415e4d0 0x7f49540b3ac0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.715+0000 7f495a4da640 1 --2- 172.21.15.79:0/1525730200 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49540b3570 0x7f49540b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.715+0000 7f495a4da640 1 --2- 172.21.15.79:0/1525730200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49540b3020 0x7f49541561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.715+0000 7f495a4da640 1 -- 172.21.15.79:0/1525730200 >> 172.21.15.79:0/1525730200 conn(0x7f495409d460 msgr2=0x7f495415d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:02.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.715+0000 7f495a4da640 1 -- 172.21.15.79:0/1525730200 shutdown_connections 2024-04-25T02:15:02.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.715+0000 7f495a4da640 1 -- 172.21.15.79:0/1525730200 wait complete. 2024-04-25T02:15:02.731 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:13:41.594939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:13:42.348770+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:15:02.731 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:15:02.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.826+0000 7f396bb90640 1 Processor -- start 2024-04-25T02:15:02.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.827+0000 7f396bb90640 1 -- start start 2024-04-25T02:15:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.827+0000 7f396bb90640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39640d10c0 0x7f396406bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.827+0000 7f396bb90640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39640d1ee0 con 0x7f39640d2ca0 2024-04-25T02:15:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.827+0000 7f396bb90640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39640d21c0 con 0x7f396415e4f0 2024-04-25T02:15:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.827+0000 7f396bb90640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f39640d3130 con 0x7f39640d10c0 2024-04-25T02:15:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.827+0000 7f396912b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f39640d2ca0 0x7f39640d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57910/0 (socket says 172.21.15.79:57910) 2024-04-25T02:15:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.827+0000 7f396912b640 1 -- 172.21.15.79:0/2677619347 learned_addr learned my addr 172.21.15.79:0/2677619347 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396a12d640 1 --2- 172.21.15.79:0/2677619347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39640d10c0 0x7f396406bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3197887718 0 0) 0x7f39640d1ee0 con 0x7f39640d2ca0 2024-04-25T02:15:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3950003520 con 0x7f39640d2ca0 2024-04-25T02:15:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2772621161 0 0) 0x7f39640d21c0 con 0x7f396415e4f0 2024-04-25T02:15:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39640d1ee0 con 0x7f396415e4f0 2024-04-25T02:15:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3375324800 0 0) 0x7f3950003520 con 0x7f39640d2ca0 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39640d10c0 msgr2=0x7f396406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 --2- 172.21.15.79:0/2677619347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39640d10c0 0x7f396406bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 >> v1:172.21.15.189:6789/0 conn(0x7f396415e4f0 legacy=0x7f39640cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39640d24a0 con 0x7f39640d2ca0 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f3954001670 con 0x7f39640d2ca0 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396a12d640 1 --2- 172.21.15.79:0/2677619347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39640d10c0 0x7f396406bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 >> v1:172.21.15.79:6789/0 conn(0x7f39640d2ca0 legacy=0x7f39640d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 --2- 172.21.15.79:0/2677619347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39640d10c0 0x7f3950003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 --2- 172.21.15.79:0/2677619347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39500040b0 0x7f3950004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 --2- 172.21.15.79:0/2677619347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3950004d40 0x7f39500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f395000ba70 con 0x7f3950004d40 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f395000bbf0 con 0x7f39500040b0 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f395000bdf0 con 0x7f39640d10c0 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396a12d640 1 --2- 172.21.15.79:0/2677619347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3950004d40 0x7f39500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396912b640 1 --2- 172.21.15.79:0/2677619347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39500040b0 0x7f3950004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.828+0000 7f396992c640 1 --2- 172.21.15.79:0/2677619347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39640d10c0 0x7f3950003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.829+0000 7f396a12d640 1 -- 172.21.15.79:0/2677619347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39640d10c0 msgr2=0x7f3950003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.829+0000 7f396a12d640 1 --2- 172.21.15.79:0/2677619347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39640d10c0 0x7f3950003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.829+0000 7f396a12d640 1 -- 172.21.15.79:0/2677619347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39500040b0 msgr2=0x7f3950004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.829+0000 7f396a12d640 1 --2- 172.21.15.79:0/2677619347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39500040b0 0x7f3950004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.829+0000 7f396a12d640 1 -- 172.21.15.79:0/2677619347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3950003520 con 0x7f3950004d40 2024-04-25T02:15:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.829+0000 7f396a12d640 1 --2- 172.21.15.79:0/2677619347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3950004d40 0x7f39500051c0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f395c009c70 tx=0x7f3950005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c610479d9561807 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.829+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c036070 con 0x7f3950004d40 2024-04-25T02:15:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.829+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f395c031400 con 0x7f3950004d40 2024-04-25T02:15:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.829+0000 7f396892a640 1 -- 172.21.15.79:0/2677619347 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c009840 con 0x7f3950004d40 2024-04-25T02:15:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.830+0000 7f396bb90640 1 -- 172.21.15.79:0/2677619347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3950004d40 msgr2=0x7f39500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.830+0000 7f396bb90640 1 --2- 172.21.15.79:0/2677619347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3950004d40 0x7f39500051c0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f395c009c70 tx=0x7f3950005830 comp rx=0 tx=0).stop 2024-04-25T02:15:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.830+0000 7f396a12d640 1 -- 172.21.15.79:0/2677619347 reap_dead start 2024-04-25T02:15:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.830+0000 7f396bb90640 1 -- 172.21.15.79:0/2677619347 shutdown_connections 2024-04-25T02:15:02.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.830+0000 7f396bb90640 1 -- 172.21.15.79:0/2677619347 >> 172.21.15.79:0/2677619347 conn(0x7f396409d4a0 msgr2=0x7f39640d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:02.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.830+0000 7f396bb90640 1 -- 172.21.15.79:0/2677619347 shutdown_connections 2024-04-25T02:15:02.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.830+0000 7f396bb90640 1 -- 172.21.15.79:0/2677619347 wait complete. 2024-04-25T02:15:02.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.831+0000 7f396bb90640 1 Processor -- start 2024-04-25T02:15:02.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.831+0000 7f396bb90640 1 -- start start 2024-04-25T02:15:02.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396bb90640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3950004d40 0x7f396414d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396bb90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39640b94b0 0x7f39640ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396bb90640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39640ca7d0 0x7f39640cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396bb90640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f39640d4ee0 con 0x7f39640b94b0 2024-04-25T02:15:02.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396bb90640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39640cff00 con 0x7f3950004d40 2024-04-25T02:15:02.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396bb90640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f39640d5060 con 0x7f39640ca7d0 2024-04-25T02:15:02.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396912b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39640b94b0 0x7f39640ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396912b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39640b94b0 0x7f39640ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44496/0 (socket says 172.21.15.79:44496) 2024-04-25T02:15:02.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396912b640 1 -- 172.21.15.79:0/1898000157 learned_addr learned my addr 172.21.15.79:0/1898000157 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:02.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396a12d640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39640ca7d0 0x7f39640cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396992c640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3950004d40 0x7f396414d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396912b640 1 -- 172.21.15.79:0/1898000157 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39640ca7d0 msgr2=0x7f39640cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396912b640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39640ca7d0 0x7f39640cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396912b640 1 -- 172.21.15.79:0/1898000157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3950004d40 msgr2=0x7f396414d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396912b640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3950004d40 0x7f396414d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396912b640 1 -- 172.21.15.79:0/1898000157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39640c94d0 con 0x7f39640b94b0 2024-04-25T02:15:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396a12d640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39640ca7d0 0x7f39640cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396992c640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3950004d40 0x7f396414d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396912b640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39640b94b0 0x7f39640ca290 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f3954007310 tx=0x7f39540077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f395a7fc640 1 -- 172.21.15.79:0/1898000157 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395400f930 con 0x7f39640b94b0 2024-04-25T02:15:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f395a7fc640 1 -- 172.21.15.79:0/1898000157 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3954018070 con 0x7f39640b94b0 2024-04-25T02:15:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396bb90640 1 -- 172.21.15.79:0/1898000157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39640c97b0 con 0x7f39640b94b0 2024-04-25T02:15:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f395a7fc640 1 -- 172.21.15.79:0/1898000157 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395400fd50 con 0x7f39640b94b0 2024-04-25T02:15:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.832+0000 7f396bb90640 1 -- 172.21.15.79:0/1898000157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39640b9910 con 0x7f39640b94b0 2024-04-25T02:15:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.833+0000 7f396bb90640 1 -- 172.21.15.79:0/1898000157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39640686c0 con 0x7f39640b94b0 2024-04-25T02:15:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.834+0000 7f395a7fc640 1 -- 172.21.15.79:0/1898000157 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f395401d460 con 0x7f39640b94b0 2024-04-25T02:15:02.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.834+0000 7f395a7fc640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f394806be30 0x7f394806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:02.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.834+0000 7f395a7fc640 1 -- 172.21.15.79:0/1898000157 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5824+0+0 (secure 0 0 0) 0x7f395408afb0 con 0x7f39640b94b0 2024-04-25T02:15:02.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.834+0000 7f396992c640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f394806be30 0x7f394806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:02.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.835+0000 7f396992c640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f394806be30 0x7f394806e2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3960003f40 tx=0x7f3960009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:02.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:02.839+0000 7f395a7fc640 1 -- 172.21.15.79:0/1898000157 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3954059980 con 0x7f39640b94b0 2024-04-25T02:15:03.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.009+0000 7f396bb90640 1 -- 172.21.15.79:0/1898000157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f39640690a0 con 0x7f39640b94b0 2024-04-25T02:15:03.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.009+0000 7f395a7fc640 1 -- 172.21.15.79:0/1898000157 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f3954059280 con 0x7f39640b94b0 2024-04-25T02:15:03.015 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:15:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.011+0000 7f396bb90640 1 -- 172.21.15.79:0/1898000157 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f394806be30 msgr2=0x7f394806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.011+0000 7f396bb90640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f394806be30 0x7f394806e2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3960003f40 tx=0x7f3960009040 comp rx=0 tx=0).stop 2024-04-25T02:15:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.011+0000 7f396bb90640 1 -- 172.21.15.79:0/1898000157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39640b94b0 msgr2=0x7f39640ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.011+0000 7f396bb90640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39640b94b0 0x7f39640ca290 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f3954007310 tx=0x7f39540077d0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.011+0000 7f396bb90640 1 -- 172.21.15.79:0/1898000157 shutdown_connections 2024-04-25T02:15:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.011+0000 7f396bb90640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f394806be30 0x7f394806e2f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.011+0000 7f396bb90640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f39640ca7d0 0x7f39640cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.011+0000 7f396bb90640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39640b94b0 0x7f39640ca290 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.011+0000 7f396bb90640 1 --2- 172.21.15.79:0/1898000157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3950004d40 0x7f396414d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.011+0000 7f396bb90640 1 -- 172.21.15.79:0/1898000157 >> 172.21.15.79:0/1898000157 conn(0x7f396409d4a0 msgr2=0x7f396406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.011+0000 7f396bb90640 1 -- 172.21.15.79:0/1898000157 shutdown_connections 2024-04-25T02:15:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.011+0000 7f396bb90640 1 -- 172.21.15.79:0/1898000157 wait complete. 2024-04-25T02:15:03.027 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:15:03.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.122+0000 7ff2c1fa2640 1 Processor -- start 2024-04-25T02:15:03.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.122+0000 7ff2c1fa2640 1 -- start start 2024-04-25T02:15:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2c1fa2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc09dcb0 0x7ff2bc070d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2c1fa2640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff2bc0cf380 0x7ff2bc071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2c1fa2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc15abf0 con 0x7ff2bc15a810 2024-04-25T02:15:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2c1fa2640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff2bc073050 con 0x7ff2bc0cf380 2024-04-25T02:15:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2c1fa2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff2bc0cbdd0 con 0x7ff2bc09dcb0 2024-04-25T02:15:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2bb7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff2bc15a810 0x7ff2bc0cc820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57914/0 (socket says 172.21.15.79:57914) 2024-04-25T02:15:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2bb7fe640 1 -- 172.21.15.79:0/566529929 learned_addr learned my addr 172.21.15.79:0/566529929 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2baffd640 1 --2- 172.21.15.79:0/566529929 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc09dcb0 0x7ff2bc070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2bbfff640 1 --2- 172.21.15.79:0/566529929 >> v2:172.21.15.189:3300/0 conn(0x7ff2bc0cf380 0x7ff2bc071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2ba7fc640 1 -- 172.21.15.79:0/566529929 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1576457425 0 0) 0x7ff2bc15abf0 con 0x7ff2bc15a810 2024-04-25T02:15:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2ba7fc640 1 -- 172.21.15.79:0/566529929 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2a4003520 con 0x7ff2bc15a810 2024-04-25T02:15:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2baffd640 1 -- 172.21.15.79:0/566529929 >> v2:172.21.15.189:3300/0 conn(0x7ff2bc0cf380 msgr2=0x7ff2bc071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2ba7fc640 1 -- 172.21.15.79:0/566529929 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4219378562 0 0) 0x7ff2a4003520 con 0x7ff2bc15a810 2024-04-25T02:15:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2baffd640 1 --2- 172.21.15.79:0/566529929 >> v2:172.21.15.189:3300/0 conn(0x7ff2bc0cf380 0x7ff2bc071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2baffd640 1 -- 172.21.15.79:0/566529929 >> v1:172.21.15.79:6789/0 conn(0x7ff2bc15a810 legacy=0x7ff2bc0cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2baffd640 1 -- 172.21.15.79:0/566529929 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc0ce580 con 0x7ff2bc09dcb0 2024-04-25T02:15:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.123+0000 7ff2bbfff640 1 --2- 172.21.15.79:0/566529929 >> v2:172.21.15.189:3300/0 conn(0x7ff2bc0cf380 0x7ff2bc071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:15:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.124+0000 7ff2baffd640 1 --2- 172.21.15.79:0/566529929 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc09dcb0 0x7ff2bc070d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00097a0 tx=0x7ff2b002c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c925920a5ec12b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.124+0000 7ff2ba7fc640 1 -- 172.21.15.79:0/566529929 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0039070 con 0x7ff2bc09dcb0 2024-04-25T02:15:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.124+0000 7ff2ba7fc640 1 -- 172.21.15.79:0/566529929 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b002cd20 con 0x7ff2bc09dcb0 2024-04-25T02:15:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.124+0000 7ff2ba7fc640 1 -- 172.21.15.79:0/566529929 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac001670 con 0x7ff2bc09dcb0 2024-04-25T02:15:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.125+0000 7ff2c1fa2640 1 -- 172.21.15.79:0/566529929 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc09dcb0 msgr2=0x7ff2bc070d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.125+0000 7ff2c1fa2640 1 --2- 172.21.15.79:0/566529929 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc09dcb0 0x7ff2bc070d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00097a0 tx=0x7ff2b002c290 comp rx=0 tx=0).stop 2024-04-25T02:15:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.125+0000 7ff2c1fa2640 1 -- 172.21.15.79:0/566529929 shutdown_connections 2024-04-25T02:15:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.125+0000 7ff2c1fa2640 1 --2- 172.21.15.79:0/566529929 >> v2:172.21.15.189:3300/0 conn(0x7ff2bc0cf380 0x7ff2bc071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.125+0000 7ff2c1fa2640 1 --2- 172.21.15.79:0/566529929 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc09dcb0 0x7ff2bc070d50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.125+0000 7ff2c1fa2640 1 -- 172.21.15.79:0/566529929 >> 172.21.15.79:0/566529929 conn(0x7ff2bc0b1cd0 msgr2=0x7ff2bc0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.125+0000 7ff2c1fa2640 1 -- 172.21.15.79:0/566529929 shutdown_connections 2024-04-25T02:15:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.125+0000 7ff2c1fa2640 1 -- 172.21.15.79:0/566529929 wait complete. 2024-04-25T02:15:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.126+0000 7ff2c1fa2640 1 Processor -- start 2024-04-25T02:15:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.126+0000 7ff2c1fa2640 1 -- start start 2024-04-25T02:15:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2c1fa2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2bc09dcb0 0x7ff2bc1590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2c1fa2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc0cf380 0x7ff2bc14e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2c1fa2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc15a810 0x7ff2bc0afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2c1fa2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc0cc020 con 0x7ff2bc15a810 2024-04-25T02:15:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2c1fa2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc0ceb40 con 0x7ff2bc09dcb0 2024-04-25T02:15:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2c1fa2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff2bc0cc300 con 0x7ff2bc0cf380 2024-04-25T02:15:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc15a810 0x7ff2bc0afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc15a810 0x7ff2bc0afc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44506/0 (socket says 172.21.15.79:44506) 2024-04-25T02:15:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2bbfff640 1 -- 172.21.15.79:0/2702969572 learned_addr learned my addr 172.21.15.79:0/2702969572 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2baffd640 1 --2- 172.21.15.79:0/2702969572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc0cf380 0x7ff2bc14e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2bb7fe640 1 --2- 172.21.15.79:0/2702969572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2bc09dcb0 0x7ff2bc1590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2bbfff640 1 -- 172.21.15.79:0/2702969572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc0cf380 msgr2=0x7ff2bc14e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2bbfff640 1 --2- 172.21.15.79:0/2702969572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc0cf380 0x7ff2bc14e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2bbfff640 1 -- 172.21.15.79:0/2702969572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2bc09dcb0 msgr2=0x7ff2bc1590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2bbfff640 1 --2- 172.21.15.79:0/2702969572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2bc09dcb0 0x7ff2bc1590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2bbfff640 1 -- 172.21.15.79:0/2702969572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc14ebb0 con 0x7ff2bc15a810 2024-04-25T02:15:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2bb7fe640 1 --2- 172.21.15.79:0/2702969572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2bc09dcb0 0x7ff2bc1590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2bbfff640 1 --2- 172.21.15.79:0/2702969572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc15a810 0x7ff2bc0afc70 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009e60 tx=0x7ff2b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2a3fff640 1 -- 172.21.15.79:0/2702969572 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4018030 con 0x7ff2bc15a810 2024-04-25T02:15:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2a3fff640 1 -- 172.21.15.79:0/2702969572 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b400cdf0 con 0x7ff2bc15a810 2024-04-25T02:15:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.127+0000 7ff2c1fa2640 1 -- 172.21.15.79:0/2702969572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc14ee90 con 0x7ff2bc15a810 2024-04-25T02:15:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.128+0000 7ff2a3fff640 1 -- 172.21.15.79:0/2702969572 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4003bb0 con 0x7ff2bc15a810 2024-04-25T02:15:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.128+0000 7ff2c1fa2640 1 -- 172.21.15.79:0/2702969572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2bc1549b0 con 0x7ff2bc15a810 2024-04-25T02:15:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.128+0000 7ff2c1fa2640 1 -- 172.21.15.79:0/2702969572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2bc0b38c0 con 0x7ff2bc15a810 2024-04-25T02:15:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.129+0000 7ff2a3fff640 1 -- 172.21.15.79:0/2702969572 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2b401b070 con 0x7ff2bc15a810 2024-04-25T02:15:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.129+0000 7ff2a3fff640 1 --2- 172.21.15.79:0/2702969572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2a806be30 0x7ff2a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.129+0000 7ff2bb7fe640 1 --2- 172.21.15.79:0/2702969572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2a806be30 0x7ff2a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.129+0000 7ff2a3fff640 1 -- 172.21.15.79:0/2702969572 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5824+0+0 (secure 0 0 0) 0x7ff2b408b7d0 con 0x7ff2bc15a810 2024-04-25T02:15:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.130+0000 7ff2bb7fe640 1 --2- 172.21.15.79:0/2702969572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2a806be30 0x7ff2a806e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac0011e0 tx=0x7ff2ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:03.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.134+0000 7ff2a3fff640 1 -- 172.21.15.79:0/2702969572 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff2bc0b38c0 con 0x7ff2bc15a810 2024-04-25T02:15:03.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.307+0000 7ff2c1fa2640 1 -- 172.21.15.79:0/2702969572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff2bc0690a0 con 0x7ff2bc15a810 2024-04-25T02:15:03.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.308+0000 7ff2a3fff640 1 -- 172.21.15.79:0/2702969572 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7ff2b4010040 con 0x7ff2bc15a810 2024-04-25T02:15:03.313 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:15:03.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.310+0000 7ff2c1fa2640 1 -- 172.21.15.79:0/2702969572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2a806be30 msgr2=0x7ff2a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.310+0000 7ff2c1fa2640 1 --2- 172.21.15.79:0/2702969572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2a806be30 0x7ff2a806e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac0011e0 tx=0x7ff2ac009040 comp rx=0 tx=0).stop 2024-04-25T02:15:03.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.310+0000 7ff2c1fa2640 1 -- 172.21.15.79:0/2702969572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc15a810 msgr2=0x7ff2bc0afc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.310+0000 7ff2c1fa2640 1 --2- 172.21.15.79:0/2702969572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc15a810 0x7ff2bc0afc70 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009e60 tx=0x7ff2b400c490 comp rx=0 tx=0).stop 2024-04-25T02:15:03.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.310+0000 7ff2c1fa2640 1 -- 172.21.15.79:0/2702969572 shutdown_connections 2024-04-25T02:15:03.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.310+0000 7ff2c1fa2640 1 --2- 172.21.15.79:0/2702969572 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2a806be30 0x7ff2a806e2f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.310+0000 7ff2c1fa2640 1 --2- 172.21.15.79:0/2702969572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc15a810 0x7ff2bc0afc70 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.310+0000 7ff2c1fa2640 1 --2- 172.21.15.79:0/2702969572 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc0cf380 0x7ff2bc14e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.310+0000 7ff2c1fa2640 1 --2- 172.21.15.79:0/2702969572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2bc09dcb0 0x7ff2bc1590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.310+0000 7ff2c1fa2640 1 -- 172.21.15.79:0/2702969572 >> 172.21.15.79:0/2702969572 conn(0x7ff2bc0b1cd0 msgr2=0x7ff2bc072090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:03.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.310+0000 7ff2c1fa2640 1 -- 172.21.15.79:0/2702969572 shutdown_connections 2024-04-25T02:15:03.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.310+0000 7ff2c1fa2640 1 -- 172.21.15.79:0/2702969572 wait complete. 2024-04-25T02:15:03.326 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:15:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.420+0000 7f4091590640 1 Processor -- start 2024-04-25T02:15:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.420+0000 7f4091590640 1 -- start start 2024-04-25T02:15:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.421+0000 7f4091590640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f408c15c3b0 0x7f408c0cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.421+0000 7f4091590640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f408c0d0b60 0x7f408c0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.421+0000 7f4091590640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f408c15c790 con 0x7f408c0d2a20 2024-04-25T02:15:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.421+0000 7f4091590640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f408c15ca10 con 0x7f408c0d0b60 2024-04-25T02:15:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.421+0000 7f4091590640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f408c15ccf0 con 0x7f408c15c3b0 2024-04-25T02:15:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.421+0000 7f408b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f408c0d0b60 0x7f408c0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.421+0000 7f408b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f408c0d0b60 0x7f408c0cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44510/0 (socket says 172.21.15.79:44510) 2024-04-25T02:15:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.421+0000 7f408b7fe640 1 -- 172.21.15.79:0/56167231 learned_addr learned my addr 172.21.15.79:0/56167231 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.422+0000 7f408b7fe640 1 -- 172.21.15.79:0/56167231 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f408c15c3b0 msgr2=0x7f408c0cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.422+0000 7f408b7fe640 1 --2- 172.21.15.79:0/56167231 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f408c15c3b0 0x7f408c0cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.422+0000 7f408b7fe640 1 -- 172.21.15.79:0/56167231 >> v1:172.21.15.189:6789/0 conn(0x7f408c0d2a20 legacy=0x7f408c0d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.422+0000 7f408b7fe640 1 -- 172.21.15.79:0/56167231 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408c15cfd0 con 0x7f408c0d0b60 2024-04-25T02:15:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.422+0000 7f408b7fe640 1 --2- 172.21.15.79:0/56167231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f408c0d0b60 0x7f408c0cca30 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f4084009870 tx=0x7f408402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6c86faca7237dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.422+0000 7f4089ffb640 1 -- 172.21.15.79:0/56167231 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084037070 con 0x7f408c0d0b60 2024-04-25T02:15:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.422+0000 7f4089ffb640 1 -- 172.21.15.79:0/56167231 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4084032440 con 0x7f408c0d0b60 2024-04-25T02:15:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.422+0000 7f4089ffb640 1 -- 172.21.15.79:0/56167231 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084032810 con 0x7f408c0d0b60 2024-04-25T02:15:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.423+0000 7f4091590640 1 -- 172.21.15.79:0/56167231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f408c0d0b60 msgr2=0x7f408c0cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.423+0000 7f4091590640 1 --2- 172.21.15.79:0/56167231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f408c0d0b60 0x7f408c0cca30 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f4084009870 tx=0x7f408402a210 comp rx=0 tx=0).stop 2024-04-25T02:15:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.423+0000 7f4091590640 1 -- 172.21.15.79:0/56167231 shutdown_connections 2024-04-25T02:15:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.423+0000 7f4091590640 1 --2- 172.21.15.79:0/56167231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f408c0d0b60 0x7f408c0cca30 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.423+0000 7f4091590640 1 --2- 172.21.15.79:0/56167231 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f408c15c3b0 0x7f408c0cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.423+0000 7f4091590640 1 -- 172.21.15.79:0/56167231 >> 172.21.15.79:0/56167231 conn(0x7f408c0d1e90 msgr2=0x7f408c0d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.423+0000 7f4091590640 1 -- 172.21.15.79:0/56167231 shutdown_connections 2024-04-25T02:15:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.423+0000 7f4091590640 1 -- 172.21.15.79:0/56167231 wait complete. 2024-04-25T02:15:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.424+0000 7f4091590640 1 Processor -- start 2024-04-25T02:15:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.424+0000 7f4091590640 1 -- start start 2024-04-25T02:15:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f4091590640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f408c0d0b60 0x7f408c09f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f4091590640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f408c0d2a20 0x7f408c1f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f4091590640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f408c15c3b0 0x7f408c1f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f4091590640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f408c0ccf70 con 0x7f408c15c3b0 2024-04-25T02:15:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f4091590640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f408c0cffa0 con 0x7f408c0d2a20 2024-04-25T02:15:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f4091590640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f408c0cd0f0 con 0x7f408c0d0b60 2024-04-25T02:15:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f408b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f408c15c3b0 0x7f408c1f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f408b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f408c15c3b0 0x7f408c1f6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44516/0 (socket says 172.21.15.79:44516) 2024-04-25T02:15:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f408b7fe640 1 -- 172.21.15.79:0/3980766117 learned_addr learned my addr 172.21.15.79:0/3980766117 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f408b7fe640 1 -- 172.21.15.79:0/3980766117 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f408c0d0b60 msgr2=0x7f408c09f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f408b7fe640 1 --2- 172.21.15.79:0/3980766117 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f408c0d0b60 0x7f408c09f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f408b7fe640 1 -- 172.21.15.79:0/3980766117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f408c0d2a20 msgr2=0x7f408c1f2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f408a7fc640 1 --2- 172.21.15.79:0/3980766117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f408c0d2a20 0x7f408c1f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f408b7fe640 1 --2- 172.21.15.79:0/3980766117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f408c0d2a20 0x7f408c1f2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f408b7fe640 1 -- 172.21.15.79:0/3980766117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408c1f5bd0 con 0x7f408c15c3b0 2024-04-25T02:15:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.425+0000 7f408a7fc640 1 --2- 172.21.15.79:0/3980766117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f408c0d2a20 0x7f408c1f2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.426+0000 7f408b7fe640 1 --2- 172.21.15.79:0/3980766117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f408c15c3b0 0x7f408c1f6390 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f408402a250 tx=0x7f40840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.426+0000 7f40737fe640 1 -- 172.21.15.79:0/3980766117 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084041070 con 0x7f408c15c3b0 2024-04-25T02:15:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.426+0000 7f40737fe640 1 -- 172.21.15.79:0/3980766117 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f408403c950 con 0x7f408c15c3b0 2024-04-25T02:15:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.426+0000 7f4091590640 1 -- 172.21.15.79:0/3980766117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f408c0aff20 con 0x7f408c15c3b0 2024-04-25T02:15:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.426+0000 7f40737fe640 1 -- 172.21.15.79:0/3980766117 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084037040 con 0x7f408c15c3b0 2024-04-25T02:15:03.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.426+0000 7f4091590640 1 -- 172.21.15.79:0/3980766117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f408c0afc40 con 0x7f408c15c3b0 2024-04-25T02:15:03.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.427+0000 7f4091590640 1 -- 172.21.15.79:0/3980766117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f408c0681e0 con 0x7f408c15c3b0 2024-04-25T02:15:03.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.427+0000 7f40737fe640 1 -- 172.21.15.79:0/3980766117 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4084044070 con 0x7f408c15c3b0 2024-04-25T02:15:03.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.427+0000 7f40737fe640 1 --2- 172.21.15.79:0/3980766117 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f407806be30 0x7f407806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.428+0000 7f40737fe640 1 -- 172.21.15.79:0/3980766117 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5824+0+0 (secure 0 0 0) 0x7f40840abb80 con 0x7f408c15c3b0 2024-04-25T02:15:03.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.428+0000 7f408affd640 1 --2- 172.21.15.79:0/3980766117 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f407806be30 0x7f407806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.428+0000 7f408affd640 1 --2- 172.21.15.79:0/3980766117 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f407806be30 0x7f407806e2f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f407c00ab90 tx=0x7f407c009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:03.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.432+0000 7f40737fe640 1 -- 172.21.15.79:0/3980766117 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f408c15c790 con 0x7f408c15c3b0 2024-04-25T02:15:03.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.606+0000 7f4091590640 1 -- 172.21.15.79:0/3980766117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f408c0b2b60 con 0x7f408c15c3b0 2024-04-25T02:15:03.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.607+0000 7f40737fe640 1 -- 172.21.15.79:0/3980766117 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f408407a5e0 con 0x7f408c15c3b0 2024-04-25T02:15:03.612 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:15:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.609+0000 7f4091590640 1 -- 172.21.15.79:0/3980766117 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f407806be30 msgr2=0x7f407806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.609+0000 7f4091590640 1 --2- 172.21.15.79:0/3980766117 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f407806be30 0x7f407806e2f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f407c00ab90 tx=0x7f407c009250 comp rx=0 tx=0).stop 2024-04-25T02:15:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.609+0000 7f4091590640 1 -- 172.21.15.79:0/3980766117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f408c15c3b0 msgr2=0x7f408c1f6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.609+0000 7f4091590640 1 --2- 172.21.15.79:0/3980766117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f408c15c3b0 0x7f408c1f6390 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f408402a250 tx=0x7f40840046c0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.609+0000 7f4091590640 1 -- 172.21.15.79:0/3980766117 shutdown_connections 2024-04-25T02:15:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.609+0000 7f4091590640 1 --2- 172.21.15.79:0/3980766117 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f407806be30 0x7f407806e2f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.609+0000 7f4091590640 1 --2- 172.21.15.79:0/3980766117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f408c15c3b0 0x7f408c1f6390 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.609+0000 7f4091590640 1 --2- 172.21.15.79:0/3980766117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f408c0d2a20 0x7f408c1f2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.609+0000 7f4091590640 1 --2- 172.21.15.79:0/3980766117 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f408c0d0b60 0x7f408c09f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.609+0000 7f4091590640 1 -- 172.21.15.79:0/3980766117 >> 172.21.15.79:0/3980766117 conn(0x7f408c0d1e90 msgr2=0x7f408c15eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.609+0000 7f4091590640 1 -- 172.21.15.79:0/3980766117 shutdown_connections 2024-04-25T02:15:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.609+0000 7f4091590640 1 -- 172.21.15.79:0/3980766117 wait complete. 2024-04-25T02:15:03.625 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:15:03.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.717+0000 7f914d631640 1 Processor -- start 2024-04-25T02:15:03.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.717+0000 7f914d631640 1 -- start start 2024-04-25T02:15:03.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.717+0000 7f914d631640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9148161b90 0x7f91480d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.717+0000 7f914d631640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91480d0a60 0x7f91480d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.717+0000 7f914d631640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91480ceed0 con 0x7f91480d47e0 2024-04-25T02:15:03.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.717+0000 7f914d631640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f91480d1410 con 0x7f9148161b90 2024-04-25T02:15:03.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.717+0000 7f914d631640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f91480ceca0 con 0x7f91480d0a60 2024-04-25T02:15:03.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f91467fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f91480d47e0 0x7f91480cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48088/0 (socket says 172.21.15.79:48088) 2024-04-25T02:15:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f91467fc640 1 -- 172.21.15.79:0/2336700266 learned_addr learned my addr 172.21.15.79:0/2336700266 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 -- 172.21.15.79:0/2336700266 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 217775718 0 0) 0x7f91480ceed0 con 0x7f91480d47e0 2024-04-25T02:15:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9146ffd640 1 --2- 172.21.15.79:0/2336700266 >> v2:172.21.15.189:3300/0 conn(0x7f9148161b90 0x7f91480d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 -- 172.21.15.79:0/2336700266 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9130003520 con 0x7f91480d47e0 2024-04-25T02:15:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f91477fe640 1 --2- 172.21.15.79:0/2336700266 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91480d0a60 0x7f91480d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 -- 172.21.15.79:0/2336700266 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2760274011 0 0) 0x7f9130003520 con 0x7f91480d47e0 2024-04-25T02:15:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 -- 172.21.15.79:0/2336700266 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91480d0a60 msgr2=0x7f91480d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 --2- 172.21.15.79:0/2336700266 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91480d0a60 0x7f91480d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 -- 172.21.15.79:0/2336700266 >> v2:172.21.15.189:3300/0 conn(0x7f9148161b90 msgr2=0x7f91480d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 --2- 172.21.15.79:0/2336700266 >> v2:172.21.15.189:3300/0 conn(0x7f9148161b90 0x7f91480d2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 -- 172.21.15.79:0/2336700266 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91480cf1b0 con 0x7f91480d47e0 2024-04-25T02:15:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 -- 172.21.15.79:0/2336700266 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f913c001670 con 0x7f91480d47e0 2024-04-25T02:15:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f91477fe640 1 --2- 172.21.15.79:0/2336700266 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91480d0a60 0x7f91480d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9146ffd640 1 --2- 172.21.15.79:0/2336700266 >> v2:172.21.15.189:3300/0 conn(0x7f9148161b90 0x7f91480d2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 -- 172.21.15.79:0/2336700266 >> v1:172.21.15.79:6789/0 conn(0x7f91480d47e0 legacy=0x7f91480cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 --2- 172.21.15.79:0/2336700266 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91480d0a60 0x7f91300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 --2- 172.21.15.79:0/2336700266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9130003fa0 0x7f9130004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 --2- 172.21.15.79:0/2336700266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9130004d40 0x7f91300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 -- 172.21.15.79:0/2336700266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f91480d1410 con 0x7f9130003fa0 2024-04-25T02:15:03.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 -- 172.21.15.79:0/2336700266 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f913000ba20 con 0x7f9130004d40 2024-04-25T02:15:03.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9145ffb640 1 -- 172.21.15.79:0/2336700266 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f913000bc20 con 0x7f91480d0a60 2024-04-25T02:15:03.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f91467fc640 1 --2- 172.21.15.79:0/2336700266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9130003fa0 0x7f9130004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f9146ffd640 1 --2- 172.21.15.79:0/2336700266 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91480d0a60 0x7f91300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.718+0000 7f91477fe640 1 --2- 172.21.15.79:0/2336700266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9130004d40 0x7f91300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.719+0000 7f91467fc640 1 -- 172.21.15.79:0/2336700266 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91480d0a60 msgr2=0x7f91300039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:03.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.719+0000 7f91467fc640 1 --2- 172.21.15.79:0/2336700266 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91480d0a60 0x7f91300039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.719+0000 7f91467fc640 1 -- 172.21.15.79:0/2336700266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9130004d40 msgr2=0x7f91300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:03.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.719+0000 7f91467fc640 1 --2- 172.21.15.79:0/2336700266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9130004d40 0x7f91300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.719+0000 7f91467fc640 1 -- 172.21.15.79:0/2336700266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9130003520 con 0x7f9130003fa0 2024-04-25T02:15:03.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.719+0000 7f9146ffd640 1 --2- 172.21.15.79:0/2336700266 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91480d0a60 0x7f91300039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:03.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.719+0000 7f91477fe640 1 --2- 172.21.15.79:0/2336700266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9130004d40 0x7f91300051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:03.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.719+0000 7f91467fc640 1 --2- 172.21.15.79:0/2336700266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9130003fa0 0x7f9130004800 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c210 tx=0x7f9130005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711794094193637f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:03.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.719+0000 7f9145ffb640 1 -- 172.21.15.79:0/2336700266 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c007d50 con 0x7f9130003fa0 2024-04-25T02:15:03.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.719+0000 7f9145ffb640 1 -- 172.21.15.79:0/2336700266 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913c005af0 con 0x7f9130003fa0 2024-04-25T02:15:03.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.719+0000 7f9145ffb640 1 -- 172.21.15.79:0/2336700266 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c007070 con 0x7f9130003fa0 2024-04-25T02:15:03.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.720+0000 7f914d631640 1 -- 172.21.15.79:0/2336700266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9130003fa0 msgr2=0x7f9130004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.720+0000 7f914d631640 1 --2- 172.21.15.79:0/2336700266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9130003fa0 0x7f9130004800 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c210 tx=0x7f9130005830 comp rx=0 tx=0).stop 2024-04-25T02:15:03.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.720+0000 7f91477fe640 1 -- 172.21.15.79:0/2336700266 reap_dead start 2024-04-25T02:15:03.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.720+0000 7f914d631640 1 -- 172.21.15.79:0/2336700266 shutdown_connections 2024-04-25T02:15:03.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.720+0000 7f914d631640 1 -- 172.21.15.79:0/2336700266 >> 172.21.15.79:0/2336700266 conn(0x7f914809d460 msgr2=0x7f91480d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:03.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.720+0000 7f914d631640 1 -- 172.21.15.79:0/2336700266 shutdown_connections 2024-04-25T02:15:03.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.720+0000 7f914d631640 1 -- 172.21.15.79:0/2336700266 wait complete. 2024-04-25T02:15:03.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.721+0000 7f914d631640 1 Processor -- start 2024-04-25T02:15:03.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.721+0000 7f914d631640 1 -- start start 2024-04-25T02:15:03.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.722+0000 7f914d631640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9130003fa0 0x7f914806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.722+0000 7f914d631640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91480b7c50 0x7f91480cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.722+0000 7f914d631640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91480cde80 0x7f91480b9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.722+0000 7f914d631640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f91480cf770 con 0x7f91480b7c50 2024-04-25T02:15:03.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.722+0000 7f914d631640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91480d4f80 con 0x7f9130003fa0 2024-04-25T02:15:03.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.722+0000 7f914d631640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f91480d4c70 con 0x7f91480cde80 2024-04-25T02:15:03.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.722+0000 7f91467fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91480b7c50 0x7f91480cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.722+0000 7f91467fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91480b7c50 0x7f91480cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33026/0 (socket says 172.21.15.79:33026) 2024-04-25T02:15:03.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.722+0000 7f91467fc640 1 -- 172.21.15.79:0/2356506568 learned_addr learned my addr 172.21.15.79:0/2356506568 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:03.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.722+0000 7f91467fc640 1 -- 172.21.15.79:0/2356506568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91480cde80 msgr2=0x7f91480b9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.722+0000 7f91467fc640 1 --2- 172.21.15.79:0/2356506568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91480cde80 0x7f91480b9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.722+0000 7f91467fc640 1 -- 172.21.15.79:0/2356506568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9130003fa0 msgr2=0x7f914806d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.722+0000 7f91467fc640 1 --2- 172.21.15.79:0/2356506568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9130003fa0 0x7f914806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.722+0000 7f91467fc640 1 -- 172.21.15.79:0/2356506568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91481f3ef0 con 0x7f91480b7c50 2024-04-25T02:15:03.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.723+0000 7f91467fc640 1 --2- 172.21.15.79:0/2356506568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91480b7c50 0x7f91480cd940 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f913c034040 tx=0x7f913c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:03.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.723+0000 7f912f7fe640 1 -- 172.21.15.79:0/2356506568 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c042070 con 0x7f91480b7c50 2024-04-25T02:15:03.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.723+0000 7f912f7fe640 1 -- 172.21.15.79:0/2356506568 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913c007480 con 0x7f91480b7c50 2024-04-25T02:15:03.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.723+0000 7f914d631640 1 -- 172.21.15.79:0/2356506568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91481f41d0 con 0x7f91480b7c50 2024-04-25T02:15:03.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.723+0000 7f912f7fe640 1 -- 172.21.15.79:0/2356506568 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c001c90 con 0x7f91480b7c50 2024-04-25T02:15:03.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.723+0000 7f914d631640 1 -- 172.21.15.79:0/2356506568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91481f3ba0 con 0x7f91480b7c50 2024-04-25T02:15:03.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.724+0000 7f914d631640 1 -- 172.21.15.79:0/2356506568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91480690a0 con 0x7f91480b7c50 2024-04-25T02:15:03.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.724+0000 7f912f7fe640 1 -- 172.21.15.79:0/2356506568 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f913c045070 con 0x7f91480b7c50 2024-04-25T02:15:03.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.725+0000 7f912f7fe640 1 --2- 172.21.15.79:0/2356506568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f913406be30 0x7f913406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:03.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.725+0000 7f912f7fe640 1 -- 172.21.15.79:0/2356506568 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5824+0+0 (secure 0 0 0) 0x7f913c0aba30 con 0x7f91480b7c50 2024-04-25T02:15:03.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.725+0000 7f9146ffd640 1 --2- 172.21.15.79:0/2356506568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f913406be30 0x7f913406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:03.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.725+0000 7f9146ffd640 1 --2- 172.21.15.79:0/2356506568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f913406be30 0x7f913406e2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9138006e80 tx=0x7f9138006df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:03.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.729+0000 7f912f7fe640 1 -- 172.21.15.79:0/2356506568 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f913c005ac0 con 0x7f91480b7c50 2024-04-25T02:15:03.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.915+0000 7f914d631640 1 -- 172.21.15.79:0/2356506568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f91481f4560 con 0x7f91480b7c50 2024-04-25T02:15:03.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.915+0000 7f912f7fe640 1 -- 172.21.15.79:0/2356506568 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v89) ==== 80+0+122 (secure 0 0 0) 0x7f913c079db0 con 0x7f91480b7c50 2024-04-25T02:15:03.921 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6837/2290864495 2024-04-26T02:13:53.595807+0000 2024-04-25T02:15:03.921 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6836/2290864495 2024-04-26T02:13:53.595807+0000 2024-04-25T02:15:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:listed 2 entries 2024-04-25T02:15:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.917+0000 7f914d631640 1 -- 172.21.15.79:0/2356506568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f913406be30 msgr2=0x7f913406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.917+0000 7f914d631640 1 --2- 172.21.15.79:0/2356506568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f913406be30 0x7f913406e2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9138006e80 tx=0x7f9138006df0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.917+0000 7f914d631640 1 -- 172.21.15.79:0/2356506568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91480b7c50 msgr2=0x7f91480cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.917+0000 7f914d631640 1 --2- 172.21.15.79:0/2356506568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91480b7c50 0x7f91480cd940 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f913c034040 tx=0x7f913c001a40 comp rx=0 tx=0).stop 2024-04-25T02:15:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.917+0000 7f914d631640 1 -- 172.21.15.79:0/2356506568 shutdown_connections 2024-04-25T02:15:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.917+0000 7f914d631640 1 --2- 172.21.15.79:0/2356506568 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f913406be30 0x7f913406e2f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.917+0000 7f914d631640 1 --2- 172.21.15.79:0/2356506568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91480cde80 0x7f91480b9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.917+0000 7f914d631640 1 --2- 172.21.15.79:0/2356506568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91480b7c50 0x7f91480cd940 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.917+0000 7f914d631640 1 --2- 172.21.15.79:0/2356506568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9130003fa0 0x7f914806d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.917+0000 7f914d631640 1 -- 172.21.15.79:0/2356506568 >> 172.21.15.79:0/2356506568 conn(0x7f914809d460 msgr2=0x7f91480b4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:03.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.917+0000 7f914d631640 1 -- 172.21.15.79:0/2356506568 shutdown_connections 2024-04-25T02:15:03.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:03.917+0000 7f914d631640 1 -- 172.21.15.79:0/2356506568 wait complete. 2024-04-25T02:15:03.933 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:15:03.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:15:03.933 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:15:03.960 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:15:03.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:15:03.960 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:15:04.015 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:15:04.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.147+0000 7f4ea7361640 1 Processor -- start 2024-04-25T02:15:04.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.147+0000 7f4ea7361640 1 -- start start 2024-04-25T02:15:04.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.148+0000 7f4ea7361640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f4ea0144cb0 0x7f4ea00b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.148+0000 7f4ea7361640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ea0070d90 con 0x7f4ea006e660 2024-04-25T02:15:04.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.148+0000 7f4ea7361640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ea00cf130 con 0x7f4ea00b5580 2024-04-25T02:15:04.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.148+0000 7f4ea7361640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f4ea00cf410 con 0x7f4ea0144cb0 2024-04-25T02:15:04.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.148+0000 7f4ea58fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4ea006e660 0x7f4ea0071240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48094/0 (socket says 172.21.15.79:48094) 2024-04-25T02:15:04.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.148+0000 7f4ea58fe640 1 -- 172.21.15.79:0/4267656585 learned_addr learned my addr 172.21.15.79:0/4267656585 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:04.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.148+0000 7f4ea50fd640 1 --2- 172.21.15.79:0/4267656585 >> v2:172.21.15.189:3300/0 conn(0x7f4ea0144cb0 0x7f4ea00b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.148+0000 7f4e97fff640 1 -- 172.21.15.79:0/4267656585 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18711901 0 0) 0x7f4ea0070d90 con 0x7f4ea006e660 2024-04-25T02:15:04.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.148+0000 7f4e97fff640 1 -- 172.21.15.79:0/4267656585 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e8c003520 con 0x7f4ea006e660 2024-04-25T02:15:04.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4e97fff640 1 -- 172.21.15.79:0/4267656585 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3665363848 0 0) 0x7f4e8c003520 con 0x7f4ea006e660 2024-04-25T02:15:04.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4e97fff640 1 -- 172.21.15.79:0/4267656585 >> v2:172.21.15.189:3300/0 conn(0x7f4ea0144cb0 msgr2=0x7f4ea00b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:04.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4e97fff640 1 --2- 172.21.15.79:0/4267656585 >> v2:172.21.15.189:3300/0 conn(0x7f4ea0144cb0 0x7f4ea00b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4e97fff640 1 -- 172.21.15.79:0/4267656585 >> v1:172.21.15.189:6789/0 conn(0x7f4ea00b5580 legacy=0x7f4ea006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4e97fff640 1 -- 172.21.15.79:0/4267656585 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea00cf6f0 con 0x7f4ea006e660 2024-04-25T02:15:04.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4e97fff640 1 -- 172.21.15.79:0/4267656585 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f4e98001670 con 0x7f4ea006e660 2024-04-25T02:15:04.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4e97fff640 1 -- 172.21.15.79:0/4267656585 >> v1:172.21.15.79:6789/0 conn(0x7f4ea006e660 legacy=0x7f4ea0071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4e97fff640 1 --2- 172.21.15.79:0/4267656585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8c0039b0 0x7f4e8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4e97fff640 1 --2- 172.21.15.79:0/4267656585 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4e8c004800 0x7f4e8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4e97fff640 1 --2- 172.21.15.79:0/4267656585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e8c0052e0 0x7f4e8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4e97fff640 1 -- 172.21.15.79:0/4267656585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea00cf410 con 0x7f4e8c0039b0 2024-04-25T02:15:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4e97fff640 1 -- 172.21.15.79:0/4267656585 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c00c1b0 con 0x7f4e8c0052e0 2024-04-25T02:15:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4e97fff640 1 -- 172.21.15.79:0/4267656585 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4e8c00c3b0 con 0x7f4e8c004800 2024-04-25T02:15:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4ea50fd640 1 --2- 172.21.15.79:0/4267656585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8c0039b0 0x7f4e8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4ea58fe640 1 --2- 172.21.15.79:0/4267656585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e8c0052e0 0x7f4e8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4ea48fc640 1 --2- 172.21.15.79:0/4267656585 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4e8c004800 0x7f4e8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4ea50fd640 1 -- 172.21.15.79:0/4267656585 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4e8c004800 msgr2=0x7f4e8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4ea50fd640 1 --2- 172.21.15.79:0/4267656585 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4e8c004800 0x7f4e8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4ea50fd640 1 -- 172.21.15.79:0/4267656585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e8c0052e0 msgr2=0x7f4e8c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4ea50fd640 1 --2- 172.21.15.79:0/4267656585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e8c0052e0 0x7f4e8c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4ea58fe640 1 -- 172.21.15.79:0/4267656585 reap_dead start 2024-04-25T02:15:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.149+0000 7f4ea50fd640 1 -- 172.21.15.79:0/4267656585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8c003520 con 0x7f4e8c0039b0 2024-04-25T02:15:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.150+0000 7f4ea50fd640 1 --2- 172.21.15.79:0/4267656585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8c0039b0 0x7f4e8c003dd0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009f90 tx=0x7f4e8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab427f970885e382 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.150+0000 7f4e97fff640 1 -- 172.21.15.79:0/4267656585 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c009c10 con 0x7f4e8c0039b0 2024-04-25T02:15:04.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.150+0000 7f4e97fff640 1 -- 172.21.15.79:0/4267656585 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e9c036070 con 0x7f4e8c0039b0 2024-04-25T02:15:04.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.150+0000 7f4e97fff640 1 -- 172.21.15.79:0/4267656585 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c031850 con 0x7f4e8c0039b0 2024-04-25T02:15:04.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.150+0000 7f4ea7361640 1 -- 172.21.15.79:0/4267656585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8c0039b0 msgr2=0x7f4e8c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.150+0000 7f4ea7361640 1 --2- 172.21.15.79:0/4267656585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8c0039b0 0x7f4e8c003dd0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009f90 tx=0x7f4e8c005830 comp rx=0 tx=0).stop 2024-04-25T02:15:04.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.150+0000 7f4ea7361640 1 -- 172.21.15.79:0/4267656585 shutdown_connections 2024-04-25T02:15:04.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.150+0000 7f4ea7361640 1 --2- 172.21.15.79:0/4267656585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8c0039b0 0x7f4e8c003dd0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.150+0000 7f4ea7361640 1 -- 172.21.15.79:0/4267656585 >> 172.21.15.79:0/4267656585 conn(0x7f4ea00cfc80 msgr2=0x7f4ea00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:04.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.150+0000 7f4ea7361640 1 -- 172.21.15.79:0/4267656585 shutdown_connections 2024-04-25T02:15:04.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.150+0000 7f4ea7361640 1 -- 172.21.15.79:0/4267656585 wait complete. 2024-04-25T02:15:04.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.152+0000 7f4ea7361640 1 Processor -- start 2024-04-25T02:15:04.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.152+0000 7f4ea7361640 1 -- start start 2024-04-25T02:15:04.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.152+0000 7f4ea7361640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8c0039b0 0x7f4ea01559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.152+0000 7f4ea7361640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4ea0157a70 0x7f4ea01e6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.152+0000 7f4ea7361640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ea01583e0 0x7f4ea0158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.152+0000 7f4ea7361640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea0145ab0 con 0x7f4e8c0039b0 2024-04-25T02:15:04.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.152+0000 7f4ea7361640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea0145090 con 0x7f4ea01583e0 2024-04-25T02:15:04.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.152+0000 7f4ea7361640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea0145c30 con 0x7f4ea0157a70 2024-04-25T02:15:04.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.152+0000 7f4ea50fd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8c0039b0 0x7f4ea01559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.152+0000 7f4ea50fd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8c0039b0 0x7f4ea01559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33042/0 (socket says 172.21.15.79:33042) 2024-04-25T02:15:04.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.152+0000 7f4ea50fd640 1 -- 172.21.15.79:0/3993066186 learned_addr learned my addr 172.21.15.79:0/3993066186 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.153+0000 7f4ea50fd640 1 -- 172.21.15.79:0/3993066186 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4ea0157a70 msgr2=0x7f4ea01e6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.153+0000 7f4ea50fd640 1 --2- 172.21.15.79:0/3993066186 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4ea0157a70 0x7f4ea01e6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.153+0000 7f4ea50fd640 1 -- 172.21.15.79:0/3993066186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ea01583e0 msgr2=0x7f4ea0158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.153+0000 7f4ea50fd640 1 --2- 172.21.15.79:0/3993066186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ea01583e0 0x7f4ea0158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.153+0000 7f4ea50fd640 1 -- 172.21.15.79:0/3993066186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea0155f00 con 0x7f4e8c0039b0 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.153+0000 7f4ea50fd640 1 --2- 172.21.15.79:0/3993066186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8c0039b0 0x7f4ea01559c0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c033040 tx=0x7f4e9c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.153+0000 7f4e95ffb640 1 -- 172.21.15.79:0/3993066186 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c009c10 con 0x7f4e8c0039b0 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.153+0000 7f4e95ffb640 1 -- 172.21.15.79:0/3993066186 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e9c045630 con 0x7f4e8c0039b0 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.153+0000 7f4ea7361640 1 -- 172.21.15.79:0/3993066186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea01e6d60 con 0x7f4e8c0039b0 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.153+0000 7f4e95ffb640 1 -- 172.21.15.79:0/3993066186 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c045a20 con 0x7f4e8c0039b0 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.153+0000 7f4ea7361640 1 -- 172.21.15.79:0/3993066186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea01e7320 con 0x7f4e8c0039b0 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.154+0000 7f4ea7361640 1 -- 172.21.15.79:0/3993066186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ea00690a0 con 0x7f4e8c0039b0 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.154+0000 7f4e95ffb640 1 -- 172.21.15.79:0/3993066186 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e9c005d10 con 0x7f4e8c0039b0 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.155+0000 7f4e95ffb640 1 --2- 172.21.15.79:0/3993066186 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4e8406be60 0x7f4e8406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.155+0000 7f4e95ffb640 1 -- 172.21.15.79:0/3993066186 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5824+0+0 (secure 0 0 0) 0x7f4e9c0ac3a0 con 0x7f4e8c0039b0 2024-04-25T02:15:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.155+0000 7f4ea48fc640 1 --2- 172.21.15.79:0/3993066186 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4e8406be60 0x7f4e8406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.155+0000 7f4ea48fc640 1 --2- 172.21.15.79:0/3993066186 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4e8406be60 0x7f4e8406e320 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4e90007fd0 tx=0x7f4e90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.159+0000 7f4e95ffb640 1 -- 172.21.15.79:0/3993066186 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4ea0155f00 con 0x7f4e8c0039b0 2024-04-25T02:15:04.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.370+0000 7f4ea7361640 1 -- 172.21.15.79:0/3993066186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ea00d0b90 con 0x7f4e8c0039b0 2024-04-25T02:15:04.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.371+0000 7f4e95ffb640 1 -- 172.21.15.79:0/3993066186 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5187 (secure 0 0 0) 0x7f4e9c02e050 con 0x7f4e8c0039b0 2024-04-25T02:15:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:04.377 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:14:04.613172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":6,"addr":"172.21.15.79:6837/630320044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":630320044},{"type":"v1","addr":"172.21.15.79:6837","nonce":630320044}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7602,"qdb_cluster":[7602]},"id":6}]} 2024-04-25T02:15:04.377 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 55 2024-04-25T02:15:04.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.373+0000 7f4ea7361640 1 -- 172.21.15.79:0/3993066186 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4e8406be60 msgr2=0x7f4e8406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.373+0000 7f4ea7361640 1 --2- 172.21.15.79:0/3993066186 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4e8406be60 0x7f4e8406e320 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4e90007fd0 tx=0x7f4e90009040 comp rx=0 tx=0).stop 2024-04-25T02:15:04.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.373+0000 7f4ea7361640 1 -- 172.21.15.79:0/3993066186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8c0039b0 msgr2=0x7f4ea01559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.373+0000 7f4ea7361640 1 --2- 172.21.15.79:0/3993066186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8c0039b0 0x7f4ea01559c0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c033040 tx=0x7f4e9c009750 comp rx=0 tx=0).stop 2024-04-25T02:15:04.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.373+0000 7f4ea7361640 1 -- 172.21.15.79:0/3993066186 shutdown_connections 2024-04-25T02:15:04.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.373+0000 7f4ea7361640 1 --2- 172.21.15.79:0/3993066186 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4e8406be60 0x7f4e8406e320 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.373+0000 7f4ea7361640 1 --2- 172.21.15.79:0/3993066186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ea01583e0 0x7f4ea0158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.373+0000 7f4ea7361640 1 --2- 172.21.15.79:0/3993066186 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4ea0157a70 0x7f4ea01e6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.373+0000 7f4ea7361640 1 --2- 172.21.15.79:0/3993066186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8c0039b0 0x7f4ea01559c0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.373+0000 7f4ea7361640 1 -- 172.21.15.79:0/3993066186 >> 172.21.15.79:0/3993066186 conn(0x7f4ea00cfc80 msgr2=0x7f4ea00b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:04.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.373+0000 7f4ea7361640 1 -- 172.21.15.79:0/3993066186 shutdown_connections 2024-04-25T02:15:04.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.373+0000 7f4ea7361640 1 -- 172.21.15.79:0/3993066186 wait complete. 2024-04-25T02:15:04.389 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T02:15:04.512 INFO:teuthology.orchestra.run.smithi079.stdout:{"message":"","return_code":0} 2024-04-25T02:15:04.512 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T02:15:04.512 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:15:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.604+0000 7fceef6a5640 1 Processor -- start 2024-04-25T02:15:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.604+0000 7fceef6a5640 1 -- start start 2024-04-25T02:15:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.605+0000 7fceef6a5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcee806df50 0x7fcee806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.605+0000 7fceef6a5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcee80b2d30 0x7fcee80b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.605+0000 7fceef6a5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee8071e00 con 0x7fcee8143bc0 2024-04-25T02:15:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.605+0000 7fceef6a5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fcee806e8f0 con 0x7fcee80b2d30 2024-04-25T02:15:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.605+0000 7fceef6a5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fcee8072cb0 con 0x7fcee806df50 2024-04-25T02:15:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.605+0000 7fceedc42640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcee80b2d30 0x7fcee80b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.605+0000 7fceedc42640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcee80b2d30 0x7fcee80b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33052/0 (socket says 172.21.15.79:33052) 2024-04-25T02:15:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.605+0000 7fceedc42640 1 -- 172.21.15.79:0/3241599521 learned_addr learned my addr 172.21.15.79:0/3241599521 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.605+0000 7fceecc40640 1 --2- 172.21.15.79:0/3241599521 >> v2:172.21.15.189:3300/0 conn(0x7fcee806df50 0x7fcee806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.605+0000 7fceedc42640 1 -- 172.21.15.79:0/3241599521 >> v2:172.21.15.189:3300/0 conn(0x7fcee806df50 msgr2=0x7fcee806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.605+0000 7fceedc42640 1 --2- 172.21.15.79:0/3241599521 >> v2:172.21.15.189:3300/0 conn(0x7fcee806df50 0x7fcee806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.605+0000 7fceedc42640 1 -- 172.21.15.79:0/3241599521 >> v1:172.21.15.189:6789/0 conn(0x7fcee8143bc0 legacy=0x7fcee815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.605+0000 7fceedc42640 1 -- 172.21.15.79:0/3241599521 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee80720a0 con 0x7fcee80b2d30 2024-04-25T02:15:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.606+0000 7fceedc42640 1 --2- 172.21.15.79:0/3241599521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee80b2d30 0x7fcee80b31c0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fcee80cf960 tx=0x7fcee002c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4a3700db9d2fda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.606+0000 7fcedffff640 1 -- 172.21.15.79:0/3241599521 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee0039070 con 0x7fcee80b2d30 2024-04-25T02:15:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.606+0000 7fcedffff640 1 -- 172.21.15.79:0/3241599521 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee000b2e0 con 0x7fcee80b2d30 2024-04-25T02:15:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.606+0000 7fcedffff640 1 -- 172.21.15.79:0/3241599521 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee0009820 con 0x7fcee80b2d30 2024-04-25T02:15:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.606+0000 7fceef6a5640 1 -- 172.21.15.79:0/3241599521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee80b2d30 msgr2=0x7fcee80b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.606+0000 7fceef6a5640 1 --2- 172.21.15.79:0/3241599521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee80b2d30 0x7fcee80b31c0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fcee80cf960 tx=0x7fcee002c860 comp rx=0 tx=0).stop 2024-04-25T02:15:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.606+0000 7fceef6a5640 1 -- 172.21.15.79:0/3241599521 shutdown_connections 2024-04-25T02:15:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.606+0000 7fceef6a5640 1 --2- 172.21.15.79:0/3241599521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee80b2d30 0x7fcee80b31c0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.606+0000 7fceef6a5640 1 --2- 172.21.15.79:0/3241599521 >> v2:172.21.15.189:3300/0 conn(0x7fcee806df50 0x7fcee806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.606+0000 7fceef6a5640 1 -- 172.21.15.79:0/3241599521 >> 172.21.15.79:0/3241599521 conn(0x7fcee80cfc80 msgr2=0x7fcee80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.606+0000 7fceef6a5640 1 -- 172.21.15.79:0/3241599521 shutdown_connections 2024-04-25T02:15:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.606+0000 7fceef6a5640 1 -- 172.21.15.79:0/3241599521 wait complete. 2024-04-25T02:15:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.607+0000 7fceef6a5640 1 Processor -- start 2024-04-25T02:15:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.608+0000 7fceef6a5640 1 -- start start 2024-04-25T02:15:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.608+0000 7fceef6a5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcee806df50 0x7fcee8139520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.608+0000 7fceef6a5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcee80b2d30 0x7fcee815ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.608+0000 7fceef6a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee8143bc0 0x7fcee81f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.608+0000 7fceef6a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcee8072940 con 0x7fcee8143bc0 2024-04-25T02:15:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.608+0000 7fceef6a5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcee8072660 con 0x7fcee806df50 2024-04-25T02:15:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.608+0000 7fceef6a5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcee8143fa0 con 0x7fcee80b2d30 2024-04-25T02:15:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.608+0000 7fceedc42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee8143bc0 0x7fcee81f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.608+0000 7fceedc42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee8143bc0 0x7fcee81f3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33054/0 (socket says 172.21.15.79:33054) 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.608+0000 7fceedc42640 1 -- 172.21.15.79:0/388290470 learned_addr learned my addr 172.21.15.79:0/388290470 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.608+0000 7fceed441640 1 --2- 172.21.15.79:0/388290470 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcee806df50 0x7fcee8139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.609+0000 7fceecc40640 1 --2- 172.21.15.79:0/388290470 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcee80b2d30 0x7fcee815ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.609+0000 7fceedc42640 1 -- 172.21.15.79:0/388290470 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcee80b2d30 msgr2=0x7fcee815ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.609+0000 7fceedc42640 1 --2- 172.21.15.79:0/388290470 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcee80b2d30 0x7fcee815ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.609+0000 7fceedc42640 1 -- 172.21.15.79:0/388290470 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcee806df50 msgr2=0x7fcee8139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.609+0000 7fceedc42640 1 --2- 172.21.15.79:0/388290470 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcee806df50 0x7fcee8139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.609+0000 7fceedc42640 1 -- 172.21.15.79:0/388290470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee813fba0 con 0x7fcee8143bc0 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.609+0000 7fceecc40640 1 --2- 172.21.15.79:0/388290470 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcee80b2d30 0x7fcee815ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.609+0000 7fceedc42640 1 --2- 172.21.15.79:0/388290470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee8143bc0 0x7fcee81f3cc0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fcee0037040 tx=0x7fcee0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.609+0000 7fceddffb640 1 -- 172.21.15.79:0/388290470 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee0039040 con 0x7fcee8143bc0 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.609+0000 7fceddffb640 1 -- 172.21.15.79:0/388290470 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee0009370 con 0x7fcee8143bc0 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.609+0000 7fceddffb640 1 -- 172.21.15.79:0/388290470 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee000b720 con 0x7fcee8143bc0 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.609+0000 7fceef6a5640 1 -- 172.21.15.79:0/388290470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee8141430 con 0x7fcee8143bc0 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.609+0000 7fceef6a5640 1 -- 172.21.15.79:0/388290470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee81419f0 con 0x7fcee8143bc0 2024-04-25T02:15:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.610+0000 7fceef6a5640 1 -- 172.21.15.79:0/388290470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcee80690a0 con 0x7fcee8143bc0 2024-04-25T02:15:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.611+0000 7fceddffb640 1 -- 172.21.15.79:0/388290470 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcee000b2e0 con 0x7fcee8143bc0 2024-04-25T02:15:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.611+0000 7fceddffb640 1 --2- 172.21.15.79:0/388290470 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcecc06be30 0x7fcecc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.611+0000 7fceddffb640 1 -- 172.21.15.79:0/388290470 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5824+0+0 (secure 0 0 0) 0x7fcee00abc20 con 0x7fcee8143bc0 2024-04-25T02:15:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.611+0000 7fceed441640 1 --2- 172.21.15.79:0/388290470 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcecc06be30 0x7fcecc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.611+0000 7fceed441640 1 --2- 172.21.15.79:0/388290470 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcecc06be30 0x7fcecc06e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fcee4004ea0 tx=0x7fcee4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.615+0000 7fceddffb640 1 -- 172.21.15.79:0/388290470 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcee0079e00 con 0x7fcee8143bc0 2024-04-25T02:15:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.826+0000 7fceef6a5640 1 -- 172.21.15.79:0/388290470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fcee815b3c0 con 0x7fcee8143bc0 2024-04-25T02:15:04.832 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:15:04.827+0000 7fb0c50c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:15:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.828+0000 7fceddffb640 1 -- 172.21.15.79:0/388290470 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) ==== 161+0+0 (secure 0 0 0) 0x7fcee007e100 con 0x7fcee8143bc0 2024-04-25T02:15:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:15:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.831+0000 7fceef6a5640 1 -- 172.21.15.79:0/388290470 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcecc06be30 msgr2=0x7fcecc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.831+0000 7fceef6a5640 1 --2- 172.21.15.79:0/388290470 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcecc06be30 0x7fcecc06e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fcee4004ea0 tx=0x7fcee4009040 comp rx=0 tx=0).stop 2024-04-25T02:15:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.831+0000 7fceef6a5640 1 -- 172.21.15.79:0/388290470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee8143bc0 msgr2=0x7fcee81f3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.831+0000 7fceef6a5640 1 --2- 172.21.15.79:0/388290470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee8143bc0 0x7fcee81f3cc0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fcee0037040 tx=0x7fcee0004a40 comp rx=0 tx=0).stop 2024-04-25T02:15:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.831+0000 7fceef6a5640 1 -- 172.21.15.79:0/388290470 shutdown_connections 2024-04-25T02:15:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.831+0000 7fceef6a5640 1 --2- 172.21.15.79:0/388290470 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcecc06be30 0x7fcecc06e2f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.831+0000 7fceef6a5640 1 --2- 172.21.15.79:0/388290470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee8143bc0 0x7fcee81f3cc0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.831+0000 7fceef6a5640 1 --2- 172.21.15.79:0/388290470 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcee80b2d30 0x7fcee815ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.831+0000 7fceef6a5640 1 --2- 172.21.15.79:0/388290470 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcee806df50 0x7fcee8139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.831+0000 7fceef6a5640 1 -- 172.21.15.79:0/388290470 >> 172.21.15.79:0/388290470 conn(0x7fcee80cfc80 msgr2=0x7fcee8070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.832+0000 7fceef6a5640 1 -- 172.21.15.79:0/388290470 shutdown_connections 2024-04-25T02:15:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.832+0000 7fceef6a5640 1 -- 172.21.15.79:0/388290470 wait complete. 2024-04-25T02:15:04.839 INFO:tasks.ceph.mds.a.smithi079.stderr: -4621> 2024-04-25T02:13:59.605+0000 7f8564649640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:15:04.840 INFO:tasks.ceph.mds.a.smithi079.stderr: -4218> 2024-04-25T02:14:00.067+0000 7f8560641640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-25T02:15:04.840 INFO:tasks.ceph.mds.a.smithi079.stderr: -4052> 2024-04-25T02:14:00.247+0000 7f8560641640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-25T02:13:50.804280+0000 1=1+0) n(v0 rc2024-04-25T02:13:50.919277+0000 2=1+1) | dirfrag=0 authpin=1 scrubqueue=0 0x5603c4bbd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T02:13:50.804280+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T02:13:50.919277+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-25T02:15:04.842 INFO:tasks.ceph.mds.a.smithi079.stderr: -2243> 2024-04-25T02:14:31.512+0000 7f8560641640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-04-25T02:13:50.804280+0000 1=1+0)->f(v1 m2024-04-25T02:13:50.804280+0000) n(v0 rc2024-04-25T02:13:50.919277+0000 2=1+1)->n(v0 rc2024-04-25T02:13:50.919277+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x5603c4bbd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T02:13:50.804280+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T02:13:50.919277+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-25T02:15:04.848 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-25T02:15:04.868 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:15:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.881+0000 7f6595c19740 1 -- start start 2024-04-25T02:15:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.881+0000 7f6595c19740 1 Processor -- start 2024-04-25T02:15:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.882+0000 7f6595c19740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f23a2c00 0x5622f2416580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.882+0000 7f6595c19740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5622f23a3800 0x5622f2416b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.882+0000 7f6595c19740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622f23a3c00 0x5622f2417080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.882+0000 7f6595c19740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5622f317c180 con 0x5622f23a2c00 2024-04-25T02:15:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.882+0000 7f6595c19740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5622f317c300 con 0x5622f23a3c00 2024-04-25T02:15:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.882+0000 7f6595c19740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5622f317c480 con 0x5622f23a3800 2024-04-25T02:15:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.882+0000 7f659397c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f23a2c00 0x5622f2416580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.882+0000 7f659397c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f23a2c00 0x5622f2416580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33098/0 (socket says 172.21.15.79:33098) 2024-04-25T02:15:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.882+0000 7f659397c640 1 -- 172.21.15.79:0/3245402571 learned_addr learned my addr 172.21.15.79:0/3245402571 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:04.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.882+0000 7f659397c640 1 -- 172.21.15.79:0/3245402571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5622f23a3800 msgr2=0x5622f2416b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:04.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.882+0000 7f659397c640 1 --2- 172.21.15.79:0/3245402571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5622f23a3800 0x5622f2416b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.882+0000 7f659397c640 1 -- 172.21.15.79:0/3245402571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622f23a3c00 msgr2=0x5622f2417080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:04.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.882+0000 7f659417d640 1 --2- 172.21.15.79:0/3245402571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622f23a3c00 0x5622f2417080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.882+0000 7f659397c640 1 --2- 172.21.15.79:0/3245402571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622f23a3c00 0x5622f2417080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.882+0000 7f659397c640 1 -- 172.21.15.79:0/3245402571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622f23cf680 con 0x5622f23a2c00 2024-04-25T02:15:04.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.883+0000 7f659397c640 1 --2- 172.21.15.79:0/3245402571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f23a2c00 0x5622f2416580 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x5622f31bb200 tx=0x5622f313cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3264ebd1b5d9160c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.883+0000 7f6591177640 1 -- 172.21.15.79:0/3245402571 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5622f23c89c0 con 0x5622f23a2c00 2024-04-25T02:15:04.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.883+0000 7f6591177640 1 -- 172.21.15.79:0/3245402571 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5622f23ece00 con 0x5622f23a2c00 2024-04-25T02:15:04.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.883+0000 7f6591177640 1 -- 172.21.15.79:0/3245402571 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5622f23c8680 con 0x5622f23a2c00 2024-04-25T02:15:04.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.883+0000 7f6595c19740 1 -- 172.21.15.79:0/3245402571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622f23cf4a0 con 0x5622f23a2c00 2024-04-25T02:15:04.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.883+0000 7f6595c19740 1 -- 172.21.15.79:0/3245402571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5622f23cfa40 con 0x5622f23a2c00 2024-04-25T02:15:04.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.883+0000 7f6595c19740 4 waiting for MDS map... 2024-04-25T02:15:04.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.883+0000 7f6591177640 1 -- 172.21.15.79:0/3245402571 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x5622f3272200 con 0x5622f23a2c00 2024-04-25T02:15:04.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.883+0000 7f6591177640 1 -- 172.21.15.79:0/3245402571 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) ==== 2885+0+0 (secure 0 0 0) 0x5622f23fb180 con 0x5622f23a2c00 2024-04-25T02:15:04.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.883+0000 7f6595c19740 4 Got MDS map 56 2024-04-25T02:15:04.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.883+0000 7f6595c19740 4 datascan.main: Using metadata pool output 2024-04-25T02:15:04.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.883+0000 7f6595c19740 4 datascan.main: connecting to RADOS... 2024-04-25T02:15:04.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.884+0000 7f6595c19740 1 Processor -- start 2024-04-25T02:15:04.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.884+0000 7f6595c19740 1 -- start start 2024-04-25T02:15:04.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.884+0000 7f6595c19740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622f32d6000 0x5622f2417600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.884+0000 7f6595c19740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5622f32d6400 0x5622f2417b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.884+0000 7f6595c19740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f32d6800 0x5622f2418100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.884+0000 7f6595c19740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5622f317c600 con 0x5622f32d6800 2024-04-25T02:15:04.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.884+0000 7f6595c19740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5622f317c780 con 0x5622f32d6000 2024-04-25T02:15:04.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.884+0000 7f6595c19740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5622f317c900 con 0x5622f32d6400 2024-04-25T02:15:04.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.884+0000 7f659317b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f32d6800 0x5622f2418100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.884+0000 7f659317b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f32d6800 0x5622f2418100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33110/0 (socket says 172.21.15.79:33110) 2024-04-25T02:15:04.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.884+0000 7f659317b640 1 -- 172.21.15.79:0/2255959104 learned_addr learned my addr 172.21.15.79:0/2255959104 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:04.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.884+0000 7f659417d640 1 --2- 172.21.15.79:0/2255959104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622f32d6000 0x5622f2417600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.884+0000 7f659397c640 1 --2- 172.21.15.79:0/2255959104 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5622f32d6400 0x5622f2417b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f659317b640 1 -- 172.21.15.79:0/2255959104 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5622f32d6400 msgr2=0x5622f2417b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:04.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f659317b640 1 --2- 172.21.15.79:0/2255959104 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5622f32d6400 0x5622f2417b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f659317b640 1 -- 172.21.15.79:0/2255959104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622f32d6000 msgr2=0x5622f2417600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:04.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f659317b640 1 --2- 172.21.15.79:0/2255959104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622f32d6000 0x5622f2417600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f659317b640 1 -- 172.21.15.79:0/2255959104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622f23cf860 con 0x5622f32d6800 2024-04-25T02:15:04.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f659317b640 1 --2- 172.21.15.79:0/2255959104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f32d6800 0x5622f2418100 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x5622f3280de0 tx=0x5622f3284cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d53677b28107bef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f658f173640 1 -- 172.21.15.79:0/2255959104 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5622f23c89c0 con 0x5622f32d6800 2024-04-25T02:15:04.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f658f173640 1 -- 172.21.15.79:0/2255959104 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5622f23eca80 con 0x5622f32d6800 2024-04-25T02:15:04.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f658f173640 1 -- 172.21.15.79:0/2255959104 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5622f23c8680 con 0x5622f32d6800 2024-04-25T02:15:04.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f6595c19740 1 -- 172.21.15.79:0/2255959104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f32d6800 msgr2=0x5622f2418100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f6595c19740 1 --2- 172.21.15.79:0/2255959104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f32d6800 0x5622f2418100 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x5622f3280de0 tx=0x5622f3284cc0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f6595c19740 1 -- 172.21.15.79:0/2255959104 shutdown_connections 2024-04-25T02:15:04.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f6595c19740 1 --2- 172.21.15.79:0/2255959104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f32d6800 0x5622f2418100 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f6595c19740 1 --2- 172.21.15.79:0/2255959104 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5622f32d6400 0x5622f2417b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f6595c19740 1 --2- 172.21.15.79:0/2255959104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622f32d6000 0x5622f2417600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f6595c19740 1 -- 172.21.15.79:0/2255959104 >> 172.21.15.79:0/2255959104 conn(0x5622f3189c00 msgr2=0x5622f24ab000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:04.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f6595c19740 1 -- 172.21.15.79:0/2255959104 shutdown_connections 2024-04-25T02:15:04.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.885+0000 7f6595c19740 1 -- 172.21.15.79:0/2255959104 wait complete. 2024-04-25T02:15:04.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.886+0000 7f6595c19740 1 Processor -- start 2024-04-25T02:15:04.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.886+0000 7f6595c19740 1 -- start start 2024-04-25T02:15:04.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.886+0000 7f6595c19740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5622f32d6000 0x5622f2419180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.886+0000 7f6595c19740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622f32d6400 0x5622f2418c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.886+0000 7f6595c19740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f32d6800 0x5622f2418680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.886+0000 7f6595c19740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5622f317dc80 con 0x5622f32d6800 2024-04-25T02:15:04.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.886+0000 7f6595c19740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5622f317db00 con 0x5622f32d6400 2024-04-25T02:15:04.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.886+0000 7f6595c19740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5622f317d980 con 0x5622f32d6000 2024-04-25T02:15:04.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.886+0000 7f659317b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f32d6800 0x5622f2418680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f659317b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f32d6800 0x5622f2418680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33114/0 (socket says 172.21.15.79:33114) 2024-04-25T02:15:04.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 learned_addr learned my addr 172.21.15.79:0/3353089552 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:04.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f659417d640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5622f32d6000 0x5622f2419180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f659397c640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622f32d6400 0x5622f2418c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5622f32d6000 msgr2=0x5622f2419180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f659317b640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5622f32d6000 0x5622f2419180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622f32d6400 msgr2=0x5622f2418c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f659317b640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622f32d6400 0x5622f2418c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622f23cf2c0 con 0x5622f32d6800 2024-04-25T02:15:04.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f659397c640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622f32d6400 0x5622f2418c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:04.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f659317b640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f32d6800 0x5622f2418680 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x5622f3281aa0 tx=0x5622f313c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f658d970640 1 -- 172.21.15.79:0/3353089552 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5622f23c84e0 con 0x5622f32d6800 2024-04-25T02:15:04.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f658d970640 1 -- 172.21.15.79:0/3353089552 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5622f23ed340 con 0x5622f32d6800 2024-04-25T02:15:04.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f658d970640 1 -- 172.21.15.79:0/3353089552 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5622f23c89c0 con 0x5622f32d6800 2024-04-25T02:15:04.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622f23cf0e0 con 0x5622f32d6800 2024-04-25T02:15:04.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622f23ce3c0 con 0x5622f32d6800 2024-04-25T02:15:04.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.887+0000 7f6595c19740 4 datascan.init: resolving metadata pool 12 2024-04-25T02:15:04.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.888+0000 7f658d970640 1 -- 172.21.15.79:0/3353089552 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5622f32e6c00 con 0x5622f32d6800 2024-04-25T02:15:04.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.888+0000 7f658d970640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x5622f2718000 0x5622f2419700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.888+0000 7f658d970640 1 -- 172.21.15.79:0/3353089552 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x5622f32dd400 con 0x5622f32d6800 2024-04-25T02:15:04.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.889+0000 7f659417d640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x5622f2718000 0x5622f2419700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.889+0000 7f6595c19740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T02:15:04.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.889+0000 7f6595c19740 4 datascan.main: data pool 'cephfs_data' has ID 13 2024-04-25T02:15:04.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.889+0000 7f6595c19740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T02:15:04.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.889+0000 7f6595c19740 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x5622f32d6c00 0x5622f2418100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.889+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:1 13.0 13:00000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f32d7000 con 0x5622f32d6c00 2024-04-25T02:15:04.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.889+0000 7f659397c640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x5622f32d6c00 0x5622f2418100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.889+0000 7f659417d640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x5622f2718000 0x5622f2419700 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x5622f313f080 tx=0x5622f3284fc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.889+0000 7f659397c640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x5622f32d6c00 0x5622f2418100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.892+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.7 v2:172.21.15.189:6824/3421948491 1 ==== osd_op_reply(1 [pgnls start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f32d6c00 2024-04-25T02:15:04.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.892+0000 7f658e972640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x5622f2719000 0x5622f2730000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.892+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:2 13.20 13:04000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2719400 con 0x5622f2719000 2024-04-25T02:15:04.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.892+0000 7f659417d640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x5622f2719000 0x5622f2730000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.893+0000 7f659417d640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x5622f2719000 0x5622f2730000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.895+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.6 v2:172.21.15.189:6816/1254358257 1 ==== osd_op_reply(2 [pgnls start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2719000 2024-04-25T02:15:04.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.895+0000 7f658f173640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x5622f2719c00 0x5622f2730580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.895+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:3 13.10 13:08000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2740000 con 0x5622f2719c00 2024-04-25T02:15:04.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.895+0000 7f659397c640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x5622f2719c00 0x5622f2730580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.895+0000 7f659397c640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x5622f2719c00 0x5622f2730580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.897+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.1 v2:172.21.15.79:6816/2311596149 1 ==== osd_op_reply(3 [pgnls start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2719c00 2024-04-25T02:15:04.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.897+0000 7f658e972640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x5622f2719800 0x5622f2730b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.897+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:4 13.30 13:0c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2740800 con 0x5622f2719800 2024-04-25T02:15:04.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.898+0000 7f659317b640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x5622f2719800 0x5622f2730b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.898+0000 7f659317b640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x5622f2719800 0x5622f2730b00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.898+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 <== osd.4 v2:172.21.15.189:6800/1910571406 1 ==== osd_op_reply(4 [pgnls start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116780 con 0x5622f2719800 2024-04-25T02:15:04.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.898+0000 7f658f173640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5622f2740400 0x5622f2731600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.898+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:5 13.8 13:10000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2741400 con 0x5622f2740400 2024-04-25T02:15:04.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.898+0000 7f659417d640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5622f2740400 0x5622f2731600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.899+0000 7f659417d640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5622f2740400 0x5622f2731600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.900+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.2 v2:172.21.15.79:6800/3397511354 1 ==== osd_op_reply(5 [pgnls start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2740400 2024-04-25T02:15:04.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.900+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:6 13.28 13:14000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2740c00 con 0x5622f2740400 2024-04-25T02:15:04.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.900+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.2 v2:172.21.15.79:6800/3397511354 2 ==== osd_op_reply(6 [pgnls start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2740400 2024-04-25T02:15:04.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.901+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:7 13.18 13:18000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2741800 con 0x5622f32d6c00 2024-04-25T02:15:04.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.901+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.7 v2:172.21.15.189:6824/3421948491 2 ==== osd_op_reply(7 [pgnls start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f32d6c00 2024-04-25T02:15:04.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.901+0000 7f658e972640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x5622f2741000 0x5622f2731080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.901+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:8 13.38 13:1c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2741400 con 0x5622f2741000 2024-04-25T02:15:04.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.901+0000 7f659397c640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x5622f2741000 0x5622f2731080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.902+0000 7f659397c640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x5622f2741000 0x5622f2731080 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.902+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.5 v2:172.21.15.189:6802/1246927196 1 ==== osd_op_reply(8 [pgnls start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2741000 2024-04-25T02:15:04.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.902+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:9 13.4 13:20000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2741c00 con 0x5622f2719000 2024-04-25T02:15:04.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.902+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.6 v2:172.21.15.189:6816/1254358257 2 ==== osd_op_reply(9 [pgnls start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2719000 2024-04-25T02:15:04.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.902+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:10 13.24 13:24000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2740c00 con 0x5622f2719000 2024-04-25T02:15:04.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.902+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.6 v2:172.21.15.189:6816/1254358257 3 ==== osd_op_reply(10 [pgnls start_epoch 90 out=49b] v86'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2719000 2024-04-25T02:15:04.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.903+0000 7f658f173640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x5622f274c000 0x5622f2731b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.903+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:11 13.14 13:28000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274c400 con 0x5622f274c000 2024-04-25T02:15:04.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.903+0000 7f659317b640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x5622f274c000 0x5622f2731b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.903+0000 7f659317b640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x5622f274c000 0x5622f2731b80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.905+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 <== osd.0 v2:172.21.15.79:6802/1526100659 1 ==== osd_op_reply(11 [pgnls start_epoch 90 out=49b] v86'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116780 con 0x5622f274c000 2024-04-25T02:15:04.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.905+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:12 13.34 13:2c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2718c00 con 0x5622f2719000 2024-04-25T02:15:04.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.905+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.6 v2:172.21.15.189:6816/1254358257 4 ==== osd_op_reply(12 [pgnls start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2719000 2024-04-25T02:15:04.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.905+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:13 13.c 13:30000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274c800 con 0x5622f2719c00 2024-04-25T02:15:04.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.906+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.1 v2:172.21.15.79:6816/2311596149 2 ==== osd_op_reply(13 [pgnls start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2719c00 2024-04-25T02:15:04.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.906+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:14 13.2c 13:34000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2719400 con 0x5622f2740400 2024-04-25T02:15:04.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.906+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.2 v2:172.21.15.79:6800/3397511354 3 ==== osd_op_reply(14 [pgnls start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2740400 2024-04-25T02:15:04.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.906+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:15 13.1c 13:38000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274cc00 con 0x5622f2719000 2024-04-25T02:15:04.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.906+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.6 v2:172.21.15.189:6816/1254358257 5 ==== osd_op_reply(15 [pgnls start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2719000 2024-04-25T02:15:04.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.906+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:16 13.3c 13:3c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2741c00 con 0x5622f2740400 2024-04-25T02:15:04.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.907+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.2 v2:172.21.15.79:6800/3397511354 4 ==== osd_op_reply(16 [pgnls start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2740400 2024-04-25T02:15:04.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.907+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:17 13.2 13:40000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274cc00 con 0x5622f2741000 2024-04-25T02:15:04.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.907+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.5 v2:172.21.15.189:6802/1246927196 2 ==== osd_op_reply(17 [pgnls start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2741000 2024-04-25T02:15:04.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.907+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:18 13.22 13:44000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2740c00 con 0x5622f2719c00 2024-04-25T02:15:04.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.907+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.1 v2:172.21.15.79:6816/2311596149 3 ==== osd_op_reply(18 [pgnls start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2719c00 2024-04-25T02:15:04.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.907+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:19 13.12 13:48000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274c800 con 0x5622f274c000 2024-04-25T02:15:04.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.908+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 <== osd.0 v2:172.21.15.79:6802/1526100659 2 ==== osd_op_reply(19 [pgnls start_epoch 90 out=49b] v86'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116780 con 0x5622f274c000 2024-04-25T02:15:04.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.908+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:20 13.32 13:4c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f32d7000 con 0x5622f2740400 2024-04-25T02:15:04.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.908+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.2 v2:172.21.15.79:6800/3397511354 5 ==== osd_op_reply(20 [pgnls start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2740400 2024-04-25T02:15:04.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.908+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:21 13.a 13:50000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2740000 con 0x5622f2740400 2024-04-25T02:15:04.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.908+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.2 v2:172.21.15.79:6800/3397511354 6 ==== osd_op_reply(21 [pgnls start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2740400 2024-04-25T02:15:04.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.908+0000 7f658e972640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x5622f2718c00 0x5622f2732100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:04.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.908+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:22 13.2a 13:54000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2719400 con 0x5622f2718c00 2024-04-25T02:15:04.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.908+0000 7f659417d640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x5622f2718c00 0x5622f2732100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:04.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.908+0000 7f659417d640 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x5622f2718c00 0x5622f2732100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.909+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.3 v2:172.21.15.79:6817/3072297369 1 ==== osd_op_reply(22 [pgnls start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2718c00 2024-04-25T02:15:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.909+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:23 13.1a 13:58000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2741800 con 0x5622f2719c00 2024-04-25T02:15:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.909+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.1 v2:172.21.15.79:6816/2311596149 4 ==== osd_op_reply(23 [pgnls start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2719c00 2024-04-25T02:15:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.909+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:24 13.3a 13:5c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274d000 con 0x5622f2741000 2024-04-25T02:15:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.909+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.5 v2:172.21.15.189:6802/1246927196 3 ==== osd_op_reply(24 [pgnls start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2741000 2024-04-25T02:15:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.909+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:25 13.6 13:60000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2741400 con 0x5622f2719800 2024-04-25T02:15:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.910+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 <== osd.4 v2:172.21.15.189:6800/1910571406 2 ==== osd_op_reply(25 [pgnls start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116780 con 0x5622f2719800 2024-04-25T02:15:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.910+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:26 13.26 13:64000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274d400 con 0x5622f32d6c00 2024-04-25T02:15:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.910+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.7 v2:172.21.15.189:6824/3421948491 3 ==== osd_op_reply(26 [pgnls start_epoch 90 out=49b] v86'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f32d6c00 2024-04-25T02:15:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.910+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:27 13.16 13:68000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2740800 con 0x5622f2718c00 2024-04-25T02:15:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.910+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.3 v2:172.21.15.79:6817/3072297369 2 ==== osd_op_reply(27 [pgnls start_epoch 90 out=49b] v86'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2718c00 2024-04-25T02:15:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.910+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:28 13.36 13:6c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274d800 con 0x5622f2719000 2024-04-25T02:15:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.911+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.6 v2:172.21.15.189:6816/1254358257 6 ==== osd_op_reply(28 [pgnls start_epoch 90 out=49b] v86'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2719000 2024-04-25T02:15:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.911+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:29 13.e 13:70000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2741400 con 0x5622f32d6c00 2024-04-25T02:15:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.911+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.7 v2:172.21.15.189:6824/3421948491 4 ==== osd_op_reply(29 [pgnls start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f32d6c00 2024-04-25T02:15:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.911+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:30 13.2e 13:74000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274dc00 con 0x5622f2740400 2024-04-25T02:15:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.911+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.2 v2:172.21.15.79:6800/3397511354 7 ==== osd_op_reply(30 [pgnls start_epoch 90 out=49b] v86'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2740400 2024-04-25T02:15:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.911+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:31 13.1e 13:78000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274c400 con 0x5622f2719800 2024-04-25T02:15:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.911+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 <== osd.4 v2:172.21.15.189:6800/1910571406 3 ==== osd_op_reply(31 [pgnls start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116780 con 0x5622f2719800 2024-04-25T02:15:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.911+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:32 13.3e 13:7c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2740c00 con 0x5622f2719c00 2024-04-25T02:15:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.912+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.1 v2:172.21.15.79:6816/2311596149 5 ==== osd_op_reply(32 [pgnls start_epoch 90 out=49b] v86'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2719c00 2024-04-25T02:15:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.912+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:33 13.1 13:80000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274c800 con 0x5622f2719000 2024-04-25T02:15:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.912+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.6 v2:172.21.15.189:6816/1254358257 7 ==== osd_op_reply(33 [pgnls start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2719000 2024-04-25T02:15:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.912+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:34 13.21 13:84000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2741800 con 0x5622f2719800 2024-04-25T02:15:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.912+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 <== osd.4 v2:172.21.15.189:6800/1910571406 4 ==== osd_op_reply(34 [pgnls start_epoch 90 out=49b] v86'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116780 con 0x5622f2719800 2024-04-25T02:15:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.912+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:35 13.11 13:88000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274cc00 con 0x5622f2719c00 2024-04-25T02:15:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.912+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.1 v2:172.21.15.79:6816/2311596149 6 ==== osd_op_reply(35 [pgnls start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2719c00 2024-04-25T02:15:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.912+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:36 13.31 13:8c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2741400 con 0x5622f2718c00 2024-04-25T02:15:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.913+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.3 v2:172.21.15.79:6817/3072297369 3 ==== osd_op_reply(36 [pgnls start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2718c00 2024-04-25T02:15:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.913+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:37 13.9 13:90000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274d000 con 0x5622f2741000 2024-04-25T02:15:04.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.913+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.5 v2:172.21.15.189:6802/1246927196 4 ==== osd_op_reply(37 [pgnls start_epoch 90 out=49b] v86'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2741000 2024-04-25T02:15:04.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.913+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:38 13.29 13:94000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2741c00 con 0x5622f2719000 2024-04-25T02:15:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.913+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.6 v2:172.21.15.189:6816/1254358257 8 ==== osd_op_reply(38 [pgnls start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2719000 2024-04-25T02:15:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.913+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:39 13.19 13:98000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274d400 con 0x5622f2718c00 2024-04-25T02:15:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.914+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.3 v2:172.21.15.79:6817/3072297369 4 ==== osd_op_reply(39 [pgnls start_epoch 90 out=49b] v86'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2718c00 2024-04-25T02:15:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.914+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:40 13.39 13:9c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2740000 con 0x5622f2740400 2024-04-25T02:15:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.914+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.2 v2:172.21.15.79:6800/3397511354 8 ==== osd_op_reply(40 [pgnls start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2740400 2024-04-25T02:15:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.914+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:41 13.5 13:a0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274d800 con 0x5622f2719800 2024-04-25T02:15:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.914+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 <== osd.4 v2:172.21.15.189:6800/1910571406 5 ==== osd_op_reply(41 [pgnls start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116780 con 0x5622f2719800 2024-04-25T02:15:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.914+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:42 13.25 13:a4000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2719400 con 0x5622f2719800 2024-04-25T02:15:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.914+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 <== osd.4 v2:172.21.15.189:6800/1910571406 6 ==== osd_op_reply(42 [pgnls start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116780 con 0x5622f2719800 2024-04-25T02:15:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.915+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:43 13.15 13:a8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2740800 con 0x5622f2719800 2024-04-25T02:15:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.915+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 <== osd.4 v2:172.21.15.189:6800/1910571406 7 ==== osd_op_reply(43 [pgnls start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116780 con 0x5622f2719800 2024-04-25T02:15:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.915+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:44 13.35 13:ac000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f32d7000 con 0x5622f2719c00 2024-04-25T02:15:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.915+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.1 v2:172.21.15.79:6816/2311596149 7 ==== osd_op_reply(44 [pgnls start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2719c00 2024-04-25T02:15:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.915+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:45 13.d 13:b0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2741800 con 0x5622f2719800 2024-04-25T02:15:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.915+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 <== osd.4 v2:172.21.15.189:6800/1910571406 8 ==== osd_op_reply(45 [pgnls start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116780 con 0x5622f2719800 2024-04-25T02:15:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.915+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:46 13.2d 13:b4000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f275c000 con 0x5622f274c000 2024-04-25T02:15:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.915+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 <== osd.0 v2:172.21.15.79:6802/1526100659 3 ==== osd_op_reply(46 [pgnls start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116780 con 0x5622f274c000 2024-04-25T02:15:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.915+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:47 13.1d 13:b8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2740800 con 0x5622f32d6c00 2024-04-25T02:15:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.916+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.7 v2:172.21.15.189:6824/3421948491 5 ==== osd_op_reply(47 [pgnls start_epoch 90 out=49b] v86'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f32d6c00 2024-04-25T02:15:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.916+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:48 13.3d 13:bc000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f275c400 con 0x5622f32d6c00 2024-04-25T02:15:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.916+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.7 v2:172.21.15.189:6824/3421948491 6 ==== osd_op_reply(48 [pgnls start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f32d6c00 2024-04-25T02:15:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.916+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:49 13.3 13:c0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2719400 con 0x5622f274c000 2024-04-25T02:15:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.916+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 <== osd.0 v2:172.21.15.79:6802/1526100659 4 ==== osd_op_reply(49 [pgnls start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116780 con 0x5622f274c000 2024-04-25T02:15:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.916+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:50 13.23 13:c4000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f275c800 con 0x5622f2719c00 2024-04-25T02:15:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.916+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.1 v2:172.21.15.79:6816/2311596149 8 ==== osd_op_reply(50 [pgnls start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2719c00 2024-04-25T02:15:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.917+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:51 13.13 13:c8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274c400 con 0x5622f32d6c00 2024-04-25T02:15:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.917+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.7 v2:172.21.15.189:6824/3421948491 7 ==== osd_op_reply(51 [pgnls start_epoch 90 out=49b] v86'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f32d6c00 2024-04-25T02:15:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.917+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:52 13.33 13:cc000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f275cc00 con 0x5622f32d6c00 2024-04-25T02:15:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.917+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.7 v2:172.21.15.189:6824/3421948491 8 ==== osd_op_reply(52 [pgnls start_epoch 90 out=49b] v86'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f32d6c00 2024-04-25T02:15:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.917+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:53 13.b 13:d0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274d800 con 0x5622f2741000 2024-04-25T02:15:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.917+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.5 v2:172.21.15.189:6802/1246927196 5 ==== osd_op_reply(53 [pgnls start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2741000 2024-04-25T02:15:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.917+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:54 13.2b 13:d4000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f275d000 con 0x5622f2740400 2024-04-25T02:15:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.918+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.2 v2:172.21.15.79:6800/3397511354 9 ==== osd_op_reply(54 [pgnls start_epoch 90 out=49b] v86'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2740400 2024-04-25T02:15:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.918+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:55 13.1b 13:d8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2741400 con 0x5622f2719800 2024-04-25T02:15:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.918+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 <== osd.4 v2:172.21.15.189:6800/1910571406 9 ==== osd_op_reply(55 [pgnls start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116780 con 0x5622f2719800 2024-04-25T02:15:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.918+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:56 13.3b 13:dc000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f275d400 con 0x5622f2719800 2024-04-25T02:15:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.918+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 <== osd.4 v2:172.21.15.189:6800/1910571406 10 ==== osd_op_reply(56 [pgnls start_epoch 90 out=49b] v86'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116780 con 0x5622f2719800 2024-04-25T02:15:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.918+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:57 13.7 13:e0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2741c00 con 0x5622f32d6c00 2024-04-25T02:15:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.919+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.7 v2:172.21.15.189:6824/3421948491 9 ==== osd_op_reply(57 [pgnls start_epoch 90 out=81b] v86'6 uv6 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5622f3116000 con 0x5622f32d6c00 2024-04-25T02:15:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.919+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:58 13.7 13:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x5622f275d000 con 0x5622f32d6c00 2024-04-25T02:15:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.919+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.7 v2:172.21.15.189:6824/3421948491 10 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5622f3116000 con 0x5622f32d6c00 2024-04-25T02:15:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.919+0000 7f6595c19740 10 datascan.operator(): handling object 1099511627777.0 2024-04-25T02:15:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.919+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:59 13.7 13:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x5622f275c400 con 0x5622f32d6c00 2024-04-25T02:15:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.920+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.7 v2:172.21.15.189:6824/3421948491 11 ==== osd_op_reply(59 10000000001.00000000 [call] v90'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5622f3116000 con 0x5622f32d6c00 2024-04-25T02:15:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.920+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:60 13.27 13:e4000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f275c800 con 0x5622f2719c00 2024-04-25T02:15:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.921+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.1 v2:172.21.15.79:6816/2311596149 9 ==== osd_op_reply(60 [pgnls start_epoch 90 out=49b] v86'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2719c00 2024-04-25T02:15:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.921+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:61 13.17 13:e8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f2740000 con 0x5622f2741000 2024-04-25T02:15:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.921+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.5 v2:172.21.15.189:6802/1246927196 6 ==== osd_op_reply(61 [pgnls start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2741000 2024-04-25T02:15:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.921+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:62 13.37 13:ec000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f275d800 con 0x5622f2741000 2024-04-25T02:15:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.921+0000 7f659397c640 1 -- 172.21.15.79:0/3353089552 <== osd.5 v2:172.21.15.189:6802/1246927196 7 ==== osd_op_reply(62 [pgnls start_epoch 90 out=49b] v86'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116000 con 0x5622f2741000 2024-04-25T02:15:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.921+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:63 13.f 13:f0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f32d7000 con 0x5622f2719000 2024-04-25T02:15:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.922+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.6 v2:172.21.15.189:6816/1254358257 9 ==== osd_op_reply(63 [pgnls start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2719000 2024-04-25T02:15:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.922+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:64 13.2f 13:f4000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f275dc00 con 0x5622f2719800 2024-04-25T02:15:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.922+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 <== osd.4 v2:172.21.15.189:6800/1910571406 11 ==== osd_op_reply(64 [pgnls start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116780 con 0x5622f2719800 2024-04-25T02:15:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.922+0000 7f658f173640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:65 13.1f 13:f8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f274dc00 con 0x5622f2719000 2024-04-25T02:15:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.922+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.6 v2:172.21.15.189:6816/1254358257 10 ==== osd_op_reply(65 [pgnls start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2719000 2024-04-25T02:15:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.922+0000 7f658e972640 1 -- 172.21.15.79:0/3353089552 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:66 13.3f 13:fc000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x5622f275c000 con 0x5622f2719000 2024-04-25T02:15:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f659417d640 1 -- 172.21.15.79:0/3353089552 <== osd.6 v2:172.21.15.189:6816/1254358257 11 ==== osd_op_reply(66 [pgnls start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5622f3116500 con 0x5622f2719000 2024-04-25T02:15:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x5622f274c000 msgr2=0x5622f2731b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x5622f274c000 0x5622f2731b80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x5622f2719c00 msgr2=0x5622f2730580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x5622f2719c00 0x5622f2730580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5622f2740400 msgr2=0x5622f2731600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5622f2740400 0x5622f2731600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x5622f2718c00 msgr2=0x5622f2732100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 reap_dead start 2024-04-25T02:15:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x5622f2718c00 0x5622f2732100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x5622f2719800 msgr2=0x5622f2730b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x5622f2719800 0x5622f2730b00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x5622f2741000 msgr2=0x5622f2731080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x5622f2741000 0x5622f2731080 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x5622f2719000 msgr2=0x5622f2730000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x5622f2719000 0x5622f2730000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x5622f32d6c00 msgr2=0x5622f2418100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x5622f32d6c00 0x5622f2418100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f659317b640 1 -- 172.21.15.79:0/3353089552 reap_dead start 2024-04-25T02:15:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x5622f2718000 msgr2=0x5622f2419700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x5622f2718000 0x5622f2419700 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x5622f313f080 tx=0x5622f3284fc0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f32d6800 msgr2=0x5622f2418680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f32d6800 0x5622f2418680 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x5622f3281aa0 tx=0x5622f313c9c0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 shutdown_connections 2024-04-25T02:15:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x5622f2718000 0x5622f2419700 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 --2- 172.21.15.79:0/3353089552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f32d6800 0x5622f2418680 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 >> 172.21.15.79:0/3353089552 conn(0x5622f3189c00 msgr2=0x5622f24ab000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 shutdown_connections 2024-04-25T02:15:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.923+0000 7f6595c19740 1 -- 172.21.15.79:0/3353089552 wait complete. 2024-04-25T02:15:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.924+0000 7f6595c19740 1 -- 172.21.15.79:0/3245402571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f23a2c00 msgr2=0x5622f2416580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.924+0000 7f6595c19740 1 --2- 172.21.15.79:0/3245402571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f23a2c00 0x5622f2416580 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x5622f31bb200 tx=0x5622f313cb40 comp rx=0 tx=0).stop 2024-04-25T02:15:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.924+0000 7f6595c19740 1 -- 172.21.15.79:0/3245402571 shutdown_connections 2024-04-25T02:15:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.924+0000 7f6595c19740 1 --2- 172.21.15.79:0/3245402571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622f23a3c00 0x5622f2417080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.924+0000 7f6595c19740 1 --2- 172.21.15.79:0/3245402571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5622f23a3800 0x5622f2416b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.924+0000 7f6595c19740 1 --2- 172.21.15.79:0/3245402571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622f23a2c00 0x5622f2416580 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.924+0000 7f6595c19740 1 -- 172.21.15.79:0/3245402571 >> 172.21.15.79:0/3245402571 conn(0x5622f23a3000 msgr2=0x5622f24aa800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.924+0000 7f6595c19740 1 -- 172.21.15.79:0/3245402571 shutdown_connections 2024-04-25T02:15:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:04.924+0000 7f6595c19740 1 -- 172.21.15.79:0/3245402571 wait complete. 2024-04-25T02:15:04.936 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.087139, result: 2024-04-25T02:15:04.936 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes cephfs_data 2024-04-25T02:15:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.006+0000 7f975cc13740 1 -- start start 2024-04-25T02:15:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.006+0000 7f975cc13740 1 Processor -- start 2024-04-25T02:15:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.006+0000 7f975cc13740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d261ea400 0x562d25483600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.006+0000 7f975cc13740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d261eb000 0x562d25482b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.006+0000 7f975cc13740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d261eb400 0x562d25483b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.006+0000 7f975cc13740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562d26214000 con 0x562d261eb000 2024-04-25T02:15:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.006+0000 7f975cc13740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562d26214180 con 0x562d261ea400 2024-04-25T02:15:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.006+0000 7f975cc13740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x562d26214300 con 0x562d261eb400 2024-04-25T02:15:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.006+0000 7f975a0b4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d261eb000 0x562d25482b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f975a0b4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d261eb000 0x562d25482b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33124/0 (socket says 172.21.15.79:33124) 2024-04-25T02:15:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f975a0b4640 1 -- 172.21.15.79:0/689991167 learned_addr learned my addr 172.21.15.79:0/689991167 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f975a8b5640 1 --2- 172.21.15.79:0/689991167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d261ea400 0x562d25483600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f975b0b6640 1 --2- 172.21.15.79:0/689991167 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d261eb400 0x562d25483b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f975a0b4640 1 -- 172.21.15.79:0/689991167 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d261eb400 msgr2=0x562d25483b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f975a0b4640 1 --2- 172.21.15.79:0/689991167 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d261eb400 0x562d25483b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f975a0b4640 1 -- 172.21.15.79:0/689991167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d261ea400 msgr2=0x562d25483600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f975a0b4640 1 --2- 172.21.15.79:0/689991167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d261ea400 0x562d25483600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f975a0b4640 1 -- 172.21.15.79:0/689991167 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d2543b680 con 0x562d261eb000 2024-04-25T02:15:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f975a0b4640 1 --2- 172.21.15.79:0/689991167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d261eb000 0x562d25482b00 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x562d26233110 tx=0x562d261ac1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9477c27c33e729 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f97580b0640 1 -- 172.21.15.79:0/689991167 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562d25434680 con 0x562d261eb000 2024-04-25T02:15:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f97580b0640 1 -- 172.21.15.79:0/689991167 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562d25458c40 con 0x562d261eb000 2024-04-25T02:15:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f97580b0640 1 -- 172.21.15.79:0/689991167 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562d254349c0 con 0x562d261eb000 2024-04-25T02:15:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f975cc13740 1 -- 172.21.15.79:0/689991167 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d2543ab40 con 0x562d261eb000 2024-04-25T02:15:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f975cc13740 1 -- 172.21.15.79:0/689991167 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x562d2543a3c0 con 0x562d261eb000 2024-04-25T02:15:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f975cc13740 4 waiting for MDS map... 2024-04-25T02:15:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f97580b0640 1 -- 172.21.15.79:0/689991167 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x562d262d2400 con 0x562d261eb000 2024-04-25T02:15:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f97580b0640 1 -- 172.21.15.79:0/689991167 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) ==== 2885+0+0 (secure 0 0 0) 0x562d25467180 con 0x562d261eb000 2024-04-25T02:15:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.007+0000 7f975cc13740 4 Got MDS map 56 2024-04-25T02:15:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.008+0000 7f975cc13740 4 datascan.main: Using metadata pool output 2024-04-25T02:15:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.008+0000 7f975cc13740 4 datascan.main: connecting to RADOS... 2024-04-25T02:15:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.008+0000 7f975cc13740 1 Processor -- start 2024-04-25T02:15:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.008+0000 7f975cc13740 1 -- start start 2024-04-25T02:15:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975cc13740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d261ebc00 0x562d25483080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975cc13740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d262e8400 0x562d25484100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975cc13740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d262e8800 0x562d25484680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975cc13740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562d26214480 con 0x562d262e8800 2024-04-25T02:15:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975cc13740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562d26214600 con 0x562d261ebc00 2024-04-25T02:15:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975cc13740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x562d26214780 con 0x562d262e8400 2024-04-25T02:15:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975a0b4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d262e8800 0x562d25484680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975a0b4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d262e8800 0x562d25484680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33138/0 (socket says 172.21.15.79:33138) 2024-04-25T02:15:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975a0b4640 1 -- 172.21.15.79:0/1066673934 learned_addr learned my addr 172.21.15.79:0/1066673934 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975a8b5640 1 --2- 172.21.15.79:0/1066673934 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d262e8400 0x562d25484100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975b0b6640 1 --2- 172.21.15.79:0/1066673934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d261ebc00 0x562d25483080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975a0b4640 1 -- 172.21.15.79:0/1066673934 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d262e8400 msgr2=0x562d25484100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975a0b4640 1 --2- 172.21.15.79:0/1066673934 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d262e8400 0x562d25484100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975a0b4640 1 -- 172.21.15.79:0/1066673934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d261ebc00 msgr2=0x562d25483080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975a0b4640 1 --2- 172.21.15.79:0/1066673934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d261ebc00 0x562d25483080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975a0b4640 1 -- 172.21.15.79:0/1066673934 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d2543b4a0 con 0x562d262e8800 2024-04-25T02:15:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975b0b6640 1 --2- 172.21.15.79:0/1066673934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d261ebc00 0x562d25483080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f975a0b4640 1 --2- 172.21.15.79:0/1066673934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d262e8800 0x562d25484680 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x562d262e0f90 tx=0x562d261a8b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd2c46a4d72183d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f97560ac640 1 -- 172.21.15.79:0/1066673934 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562d25434b60 con 0x562d262e8800 2024-04-25T02:15:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f97560ac640 1 -- 172.21.15.79:0/1066673934 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562d25458a80 con 0x562d262e8800 2024-04-25T02:15:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.009+0000 7f97560ac640 1 -- 172.21.15.79:0/1066673934 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562d25434820 con 0x562d262e8800 2024-04-25T02:15:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.010+0000 7f975cc13740 1 -- 172.21.15.79:0/1066673934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d262e8800 msgr2=0x562d25484680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.010+0000 7f975cc13740 1 --2- 172.21.15.79:0/1066673934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d262e8800 0x562d25484680 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x562d262e0f90 tx=0x562d261a8b40 comp rx=0 tx=0).stop 2024-04-25T02:15:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.010+0000 7f975cc13740 1 -- 172.21.15.79:0/1066673934 shutdown_connections 2024-04-25T02:15:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.010+0000 7f975cc13740 1 --2- 172.21.15.79:0/1066673934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d262e8800 0x562d25484680 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.010+0000 7f975cc13740 1 --2- 172.21.15.79:0/1066673934 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d262e8400 0x562d25484100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.010+0000 7f975cc13740 1 --2- 172.21.15.79:0/1066673934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d261ebc00 0x562d25483080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.010+0000 7f975cc13740 1 -- 172.21.15.79:0/1066673934 >> 172.21.15.79:0/1066673934 conn(0x562d261eb800 msgr2=0x562d25517000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.010+0000 7f975cc13740 1 -- 172.21.15.79:0/1066673934 shutdown_connections 2024-04-25T02:15:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.010+0000 7f975cc13740 1 -- 172.21.15.79:0/1066673934 wait complete. 2024-04-25T02:15:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.010+0000 7f975cc13740 1 Processor -- start 2024-04-25T02:15:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.010+0000 7f975cc13740 1 -- start start 2024-04-25T02:15:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975cc13740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d261eb800 0x562d25485700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975cc13740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d262e9400 0x562d25485180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975cc13740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d262e9000 0x562d25484c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975cc13740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562d26214a80 con 0x562d262e9400 2024-04-25T02:15:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975cc13740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562d26214900 con 0x562d262e9000 2024-04-25T02:15:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975cc13740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x562d26215500 con 0x562d261eb800 2024-04-25T02:15:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975a8b5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d262e9400 0x562d25485180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975a8b5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d262e9400 0x562d25485180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33142/0 (socket says 172.21.15.79:33142) 2024-04-25T02:15:05.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 learned_addr learned my addr 172.21.15.79:0/2813842765 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975a0b4640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d262e9000 0x562d25484c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975b0b6640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d261eb800 0x562d25485700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d261eb800 msgr2=0x562d25485700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975a8b5640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d261eb800 0x562d25485700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d262e9000 msgr2=0x562d25484c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975a8b5640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d262e9000 0x562d25484c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d2543b680 con 0x562d262e9400 2024-04-25T02:15:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975a0b4640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d262e9000 0x562d25484c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975a8b5640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d262e9400 0x562d25485180 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x562d262e1c50 tx=0x562d262e2c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f97548a9640 1 -- 172.21.15.79:0/2813842765 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562d25434b60 con 0x562d262e9400 2024-04-25T02:15:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f97548a9640 1 -- 172.21.15.79:0/2813842765 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562d25459340 con 0x562d262e9400 2024-04-25T02:15:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d2543b2c0 con 0x562d262e9400 2024-04-25T02:15:05.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f97548a9640 1 -- 172.21.15.79:0/2813842765 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562d25434820 con 0x562d262e9400 2024-04-25T02:15:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d2543ba40 con 0x562d262e9400 2024-04-25T02:15:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.011+0000 7f975cc13740 4 datascan.init: resolving metadata pool 12 2024-04-25T02:15:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.013+0000 7f97548a9640 1 -- 172.21.15.79:0/2813842765 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x562d26216c00 con 0x562d262e9400 2024-04-25T02:15:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.013+0000 7f97548a9640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x562d26362c00 0x562d25792000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.013+0000 7f97548a9640 1 -- 172.21.15.79:0/2813842765 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x562d26340e00 con 0x562d262e9400 2024-04-25T02:15:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.013+0000 7f975cc13740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T02:15:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.013+0000 7f975cc13740 4 datascan.main: data pool 'cephfs_data' has ID 13 2024-04-25T02:15:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.013+0000 7f975cc13740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T02:15:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.013+0000 7f975b0b6640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x562d26362c00 0x562d25792000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.013+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x562d262e8c00 0x562d25484680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.013+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:1 12.14 12:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x562d262e8800 con 0x562d262e8c00 2024-04-25T02:15:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.013+0000 7f975a0b4640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x562d262e8c00 0x562d25484680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.013+0000 7f975b0b6640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x562d26362c00 0x562d25792000 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x562d2544f500 tx=0x562d262e2f00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.014+0000 7f975a0b4640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x562d262e8c00 0x562d25484680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.014+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.5 v2:172.21.15.189:6802/1246927196 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv25 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x562d26182000 con 0x562d262e8c00 2024-04-25T02:15:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.014+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x562d262e8400 0x562d25484100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.014+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:2 12.1f 12:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x562d26363c00 con 0x562d262e8400 2024-04-25T02:15:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.014+0000 7f975b0b6640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x562d262e8400 0x562d25484100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.015+0000 7f975b0b6640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x562d262e8400 0x562d25484100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.015+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.015+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x562d257ae000 0x562d25483080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.015+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:3 13.0 13:00000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257ae400 con 0x562d257ae000 2024-04-25T02:15:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.015+0000 7f975a8b5640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x562d257ae000 0x562d25483080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.016+0000 7f975a8b5640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x562d257ae000 0x562d25483080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.016+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.016+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:4 13.20 13:04000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b8000 con 0x562d262e8400 2024-04-25T02:15:05.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.016+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.016+0000 7f97560ac640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x562d257b8400 0x562d25792580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.016+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:5 13.10 13:08000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b8800 con 0x562d257b8400 2024-04-25T02:15:05.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.017+0000 7f975a0b4640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x562d257b8400 0x562d25792580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.017+0000 7f975a0b4640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x562d257b8400 0x562d25792580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.017+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.017+0000 7f97558ab640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x562d257b9000 0x562d25792b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.017+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:6 13.30 13:0c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b9400 con 0x562d257b9000 2024-04-25T02:15:05.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.017+0000 7f975b0b6640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x562d257b9000 0x562d25792b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.018+0000 7f975b0b6640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x562d257b9000 0x562d25792b00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.018+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.018+0000 7f97560ac640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x562d257b8c00 0x562d25793080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.018+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:7 13.8 13:10000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b9800 con 0x562d257b8c00 2024-04-25T02:15:05.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.018+0000 7f975a8b5640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x562d257b8c00 0x562d25793080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.019+0000 7f975a8b5640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x562d257b8c00 0x562d25793080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.019+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 1 ==== osd_op_reply(7 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.019+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:8 13.28 13:14000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6000 con 0x562d257b8c00 2024-04-25T02:15:05.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.019+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.019+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:9 13.18 13:18000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b9c00 con 0x562d257ae000 2024-04-25T02:15:05.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.019+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 2 ==== osd_op_reply(9 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.019+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:10 13.38 13:1c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6400 con 0x562d262e8c00 2024-04-25T02:15:05.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.020+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.5 v2:172.21.15.189:6802/1246927196 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d262e8c00 2024-04-25T02:15:05.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.020+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:11 13.4 13:20000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6000 con 0x562d262e8400 2024-04-25T02:15:05.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.020+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 3 ==== osd_op_reply(11 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.020+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:12 13.24 13:24000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6800 con 0x562d262e8400 2024-04-25T02:15:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.020+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 4 ==== osd_op_reply(12 [pgnls-filter start_epoch 90 out=49b] v86'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.020+0000 7f97560ac640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x562d257b9800 0x562d25793600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.020+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:13 13.14 13:28000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b9c00 con 0x562d257b9800 2024-04-25T02:15:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.021+0000 7f975a0b4640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x562d257b9800 0x562d25793600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.021+0000 7f975a0b4640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x562d257b9800 0x562d25793600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.021+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.0 v2:172.21.15.79:6802/1526100659 1 ==== osd_op_reply(13 [pgnls-filter start_epoch 90 out=49b] v86'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b9800 2024-04-25T02:15:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.021+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:14 13.34 13:2c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d26363800 con 0x562d262e8400 2024-04-25T02:15:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.021+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 5 ==== osd_op_reply(14 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.021+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:15 13.c 13:30000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257ae400 con 0x562d257b8400 2024-04-25T02:15:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.022+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 2 ==== osd_op_reply(15 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.022+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:16 13.2c 13:34000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d262e9800 con 0x562d257b8c00 2024-04-25T02:15:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.022+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 3 ==== osd_op_reply(16 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.022+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:17 13.1c 13:38000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b8800 con 0x562d262e8400 2024-04-25T02:15:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.022+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 6 ==== osd_op_reply(17 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.022+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:18 13.3c 13:3c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d262e9c00 con 0x562d257b8c00 2024-04-25T02:15:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.023+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 4 ==== osd_op_reply(18 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.023+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:19 13.2 13:40000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b9c00 con 0x562d262e8c00 2024-04-25T02:15:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.023+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.5 v2:172.21.15.189:6802/1246927196 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d262e8c00 2024-04-25T02:15:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.023+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:20 13.22 13:44000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d262e8800 con 0x562d257b8400 2024-04-25T02:15:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.023+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.023+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:21 13.12 13:48000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b8000 con 0x562d257b9800 2024-04-25T02:15:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.024+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.0 v2:172.21.15.79:6802/1526100659 2 ==== osd_op_reply(21 [pgnls-filter start_epoch 90 out=49b] v86'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b9800 2024-04-25T02:15:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.024+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:22 13.32 13:4c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6400 con 0x562d257b8c00 2024-04-25T02:15:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.024+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 5 ==== osd_op_reply(22 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.024+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:23 13.a 13:50000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b9400 con 0x562d257b8c00 2024-04-25T02:15:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.024+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 6 ==== osd_op_reply(23 [pgnls-filter start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.024+0000 7f97558ab640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x562d257c6000 0x562d25793b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.024+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:24 13.2a 13:54000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6c00 con 0x562d257c6000 2024-04-25T02:15:05.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.024+0000 7f975b0b6640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x562d257c6000 0x562d25793b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.024+0000 7f975b0b6640 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x562d257c6000 0x562d25793b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.025+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.3 v2:172.21.15.79:6817/3072297369 1 ==== osd_op_reply(24 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257c6000 2024-04-25T02:15:05.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.025+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:25 13.1a 13:58000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d26363c00 con 0x562d257b8400 2024-04-25T02:15:05.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.025+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 4 ==== osd_op_reply(25 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.025+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:26 13.3a 13:5c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7000 con 0x562d262e8c00 2024-04-25T02:15:05.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.025+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.5 v2:172.21.15.189:6802/1246927196 4 ==== osd_op_reply(26 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d262e8c00 2024-04-25T02:15:05.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.025+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:27 13.6 13:60000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7800 con 0x562d257b9000 2024-04-25T02:15:05.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.026+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 2 ==== osd_op_reply(27 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.026+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:28 13.26 13:64000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7400 con 0x562d257ae000 2024-04-25T02:15:05.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.026+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 3 ==== osd_op_reply(28 [pgnls-filter start_epoch 90 out=49b] v86'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.026+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:29 13.16 13:68000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7c00 con 0x562d257c6000 2024-04-25T02:15:05.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.027+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.3 v2:172.21.15.79:6817/3072297369 2 ==== osd_op_reply(29 [pgnls-filter start_epoch 90 out=49b] v86'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257c6000 2024-04-25T02:15:05.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.027+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:30 13.36 13:6c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6800 con 0x562d262e8400 2024-04-25T02:15:05.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.027+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 7 ==== osd_op_reply(30 [pgnls-filter start_epoch 90 out=49b] v86'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.027+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:31 13.e 13:70000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6c00 con 0x562d257ae000 2024-04-25T02:15:05.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.027+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 4 ==== osd_op_reply(31 [pgnls-filter start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.027+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:32 13.2e 13:74000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b8800 con 0x562d257b8c00 2024-04-25T02:15:05.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.028+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 7 ==== osd_op_reply(32 [pgnls-filter start_epoch 90 out=49b] v86'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.028+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:33 13.1e 13:78000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7800 con 0x562d257b9000 2024-04-25T02:15:05.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.028+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 3 ==== osd_op_reply(33 [pgnls-filter start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.028+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:34 13.3e 13:7c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b9400 con 0x562d257b8400 2024-04-25T02:15:05.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.028+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 5 ==== osd_op_reply(34 [pgnls-filter start_epoch 90 out=49b] v86'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.028+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:35 13.1 13:80000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7c00 con 0x562d262e8400 2024-04-25T02:15:05.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.028+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 8 ==== osd_op_reply(35 [pgnls-filter start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.028+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:36 13.21 13:84000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d262e9800 con 0x562d257b9000 2024-04-25T02:15:05.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.029+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 90 out=49b] v86'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.029+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:37 13.11 13:88000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6400 con 0x562d257b8400 2024-04-25T02:15:05.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.029+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 6 ==== osd_op_reply(37 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.029+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:38 13.31 13:8c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d262e9c00 con 0x562d257c6000 2024-04-25T02:15:05.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.030+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.3 v2:172.21.15.79:6817/3072297369 3 ==== osd_op_reply(38 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257c6000 2024-04-25T02:15:05.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.030+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:39 13.9 13:90000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7400 con 0x562d262e8c00 2024-04-25T02:15:05.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.030+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.5 v2:172.21.15.189:6802/1246927196 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 90 out=49b] v86'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d262e8c00 2024-04-25T02:15:05.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.030+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:40 13.29 13:94000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d26363800 con 0x562d262e8400 2024-04-25T02:15:05.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.030+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 9 ==== osd_op_reply(40 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.030+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:41 13.19 13:98000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b9c00 con 0x562d257c6000 2024-04-25T02:15:05.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.030+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.3 v2:172.21.15.79:6817/3072297369 4 ==== osd_op_reply(41 [pgnls-filter start_epoch 90 out=49b] v86'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257c6000 2024-04-25T02:15:05.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.031+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:42 13.39 13:9c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b9c00 con 0x562d257b8c00 2024-04-25T02:15:05.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.031+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 8 ==== osd_op_reply(42 [pgnls-filter start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.031+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:43 13.5 13:a0000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b8000 con 0x562d257b9000 2024-04-25T02:15:05.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.031+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 5 ==== osd_op_reply(43 [pgnls-filter start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.031+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:44 13.25 13:a4000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d26363800 con 0x562d257b9000 2024-04-25T02:15:05.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.031+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 6 ==== osd_op_reply(44 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.031+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:45 13.15 13:a8000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b9400 con 0x562d257b9000 2024-04-25T02:15:05.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.032+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 7 ==== osd_op_reply(45 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.032+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:46 13.35 13:ac000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d262e9800 con 0x562d257b8400 2024-04-25T02:15:05.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.032+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 7 ==== osd_op_reply(46 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.032+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:47 13.d 13:b0000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7000 con 0x562d257b9000 2024-04-25T02:15:05.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.032+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 8 ==== osd_op_reply(47 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.032+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:48 13.2d 13:b4000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d262e9c00 con 0x562d257b9800 2024-04-25T02:15:05.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.032+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.0 v2:172.21.15.79:6802/1526100659 3 ==== osd_op_reply(48 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b9800 2024-04-25T02:15:05.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.032+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:49 13.1d 13:b8000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d26363c00 con 0x562d257ae000 2024-04-25T02:15:05.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.033+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 5 ==== osd_op_reply(49 [pgnls-filter start_epoch 90 out=49b] v86'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.033+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:50 13.3d 13:bc000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6800 con 0x562d257ae000 2024-04-25T02:15:05.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.033+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 6 ==== osd_op_reply(50 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.033+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:51 13.3 13:c0000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d262e8800 con 0x562d257b9800 2024-04-25T02:15:05.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.033+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.0 v2:172.21.15.79:6802/1526100659 4 ==== osd_op_reply(51 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b9800 2024-04-25T02:15:05.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.033+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:52 13.23 13:c4000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7800 con 0x562d257b8400 2024-04-25T02:15:05.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.034+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 8 ==== osd_op_reply(52 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.034+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:53 13.13 13:c8000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257ae400 con 0x562d257ae000 2024-04-25T02:15:05.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.034+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 7 ==== osd_op_reply(53 [pgnls-filter start_epoch 90 out=49b] v86'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.034+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:54 13.33 13:cc000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7c00 con 0x562d257ae000 2024-04-25T02:15:05.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.034+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 8 ==== osd_op_reply(54 [pgnls-filter start_epoch 90 out=49b] v86'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.034+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:55 13.b 13:d0000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257ae400 con 0x562d262e8c00 2024-04-25T02:15:05.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.035+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.5 v2:172.21.15.189:6802/1246927196 6 ==== osd_op_reply(55 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d262e8c00 2024-04-25T02:15:05.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.035+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:56 13.2b 13:d4000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257da000 con 0x562d257b8c00 2024-04-25T02:15:05.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.035+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 9 ==== osd_op_reply(56 [pgnls-filter start_epoch 90 out=49b] v86'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.035+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:57 13.1b 13:d8000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6c00 con 0x562d257b9000 2024-04-25T02:15:05.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.035+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 9 ==== osd_op_reply(57 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.035+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:58 13.3b 13:dc000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257da400 con 0x562d257b9000 2024-04-25T02:15:05.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.035+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 10 ==== osd_op_reply(58 [pgnls-filter start_epoch 90 out=49b] v86'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.036+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:59 13.7 13:e0000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6800 con 0x562d257ae000 2024-04-25T02:15:05.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.036+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 9 ==== osd_op_reply(59 [pgnls-filter start_epoch 90 out=81b] v90'7 uv7 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.036+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:60 13.0 13:00000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257ae800 con 0x562d257ae000 2024-04-25T02:15:05.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.036+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 10 ==== osd_op_reply(60 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.036+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:61 13.20 13:04000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d26363c00 con 0x562d262e8400 2024-04-25T02:15:05.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.037+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 10 ==== osd_op_reply(61 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.037+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:62 13.10 13:08000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257da800 con 0x562d257b8400 2024-04-25T02:15:05.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.037+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 9 ==== osd_op_reply(62 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.037+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:63 13.30 13:0c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b8800 con 0x562d257b9000 2024-04-25T02:15:05.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.037+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 11 ==== osd_op_reply(63 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.037+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:64 13.8 13:10000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257dac00 con 0x562d257b8c00 2024-04-25T02:15:05.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.037+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 10 ==== osd_op_reply(64 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.037+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:65 13.28 13:14000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b9c00 con 0x562d257b8c00 2024-04-25T02:15:05.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.038+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 11 ==== osd_op_reply(65 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.038+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:66 13.18 13:18000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257db000 con 0x562d257ae000 2024-04-25T02:15:05.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.038+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 11 ==== osd_op_reply(66 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.038+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:67 13.38 13:1c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7c00 con 0x562d262e8c00 2024-04-25T02:15:05.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.038+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.5 v2:172.21.15.189:6802/1246927196 7 ==== osd_op_reply(67 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d262e8c00 2024-04-25T02:15:05.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.038+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:68 13.4 13:20000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257db400 con 0x562d262e8400 2024-04-25T02:15:05.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.039+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 11 ==== osd_op_reply(68 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.039+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:69 13.24 13:24000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d262e9800 con 0x562d262e8400 2024-04-25T02:15:05.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.039+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 12 ==== osd_op_reply(69 [pgnls-filter start_epoch 90 out=49b] v86'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.039+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:70 13.14 13:28000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257db800 con 0x562d257b9800 2024-04-25T02:15:05.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.039+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.0 v2:172.21.15.79:6802/1526100659 5 ==== osd_op_reply(70 [pgnls-filter start_epoch 90 out=49b] v86'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b9800 2024-04-25T02:15:05.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.039+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:71 13.34 13:2c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d262e9c00 con 0x562d262e8400 2024-04-25T02:15:05.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.040+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 13 ==== osd_op_reply(71 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.040+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:72 13.c 13:30000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257dbc00 con 0x562d257b8400 2024-04-25T02:15:05.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.040+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 10 ==== osd_op_reply(72 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.040+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:73 13.2c 13:34000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d262e8800 con 0x562d257b8c00 2024-04-25T02:15:05.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.040+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 12 ==== osd_op_reply(73 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.040+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:74 13.1c 13:38000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257da000 con 0x562d262e8400 2024-04-25T02:15:05.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.040+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 14 ==== osd_op_reply(74 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.040+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:75 13.3c 13:3c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b9c00 con 0x562d257b8c00 2024-04-25T02:15:05.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.041+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 13 ==== osd_op_reply(75 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.041+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:76 13.2 13:40000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257ae800 con 0x562d262e8c00 2024-04-25T02:15:05.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.041+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.5 v2:172.21.15.189:6802/1246927196 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d262e8c00 2024-04-25T02:15:05.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.041+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:77 13.22 13:44000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b8000 con 0x562d257b8400 2024-04-25T02:15:05.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.041+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 11 ==== osd_op_reply(77 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.041+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:78 13.12 13:48000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257ae400 con 0x562d257b9800 2024-04-25T02:15:05.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.041+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.0 v2:172.21.15.79:6802/1526100659 6 ==== osd_op_reply(78 [pgnls-filter start_epoch 90 out=49b] v86'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b9800 2024-04-25T02:15:05.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.042+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:79 13.32 13:4c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b9400 con 0x562d257b8c00 2024-04-25T02:15:05.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.042+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 14 ==== osd_op_reply(79 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.042+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:80 13.a 13:50000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6800 con 0x562d257b8c00 2024-04-25T02:15:05.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.042+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 15 ==== osd_op_reply(80 [pgnls-filter start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.042+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:81 13.2a 13:54000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b8800 con 0x562d257c6000 2024-04-25T02:15:05.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.042+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.3 v2:172.21.15.79:6817/3072297369 5 ==== osd_op_reply(81 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257c6000 2024-04-25T02:15:05.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.042+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:82 13.1a 13:58000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7000 con 0x562d257b8400 2024-04-25T02:15:05.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.042+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 12 ==== osd_op_reply(82 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.042+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:83 13.3a 13:5c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d26363800 con 0x562d262e8c00 2024-04-25T02:15:05.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.043+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.5 v2:172.21.15.189:6802/1246927196 9 ==== osd_op_reply(83 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d262e8c00 2024-04-25T02:15:05.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.043+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:84 13.6 13:60000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6c00 con 0x562d257b9000 2024-04-25T02:15:05.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.043+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 12 ==== osd_op_reply(84 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.043+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:85 13.26 13:64000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d26363c00 con 0x562d257ae000 2024-04-25T02:15:05.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.044+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 12 ==== osd_op_reply(85 [pgnls-filter start_epoch 90 out=49b] v86'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.044+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:86 13.16 13:68000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6400 con 0x562d257c6000 2024-04-25T02:15:05.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.044+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.3 v2:172.21.15.79:6817/3072297369 6 ==== osd_op_reply(86 [pgnls-filter start_epoch 90 out=49b] v86'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257c6000 2024-04-25T02:15:05.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.044+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:87 13.36 13:6c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257dac00 con 0x562d262e8400 2024-04-25T02:15:05.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.045+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 15 ==== osd_op_reply(87 [pgnls-filter start_epoch 90 out=49b] v86'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.045+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:88 13.e 13:70000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7400 con 0x562d257ae000 2024-04-25T02:15:05.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.045+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 13 ==== osd_op_reply(88 [pgnls-filter start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.045+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:89 13.2e 13:74000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257db000 con 0x562d257b8c00 2024-04-25T02:15:05.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.045+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 16 ==== osd_op_reply(89 [pgnls-filter start_epoch 90 out=49b] v86'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.045+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:90 13.1e 13:78000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7800 con 0x562d257b9000 2024-04-25T02:15:05.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.046+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 13 ==== osd_op_reply(90 [pgnls-filter start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.046+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:91 13.3e 13:7c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257da400 con 0x562d257b8400 2024-04-25T02:15:05.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.046+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 13 ==== osd_op_reply(91 [pgnls-filter start_epoch 90 out=49b] v86'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.046+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:92 13.1 13:80000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257db800 con 0x562d262e8400 2024-04-25T02:15:05.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.046+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 16 ==== osd_op_reply(92 [pgnls-filter start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.046+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:93 13.21 13:84000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257da800 con 0x562d257b9000 2024-04-25T02:15:05.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.047+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 14 ==== osd_op_reply(93 [pgnls-filter start_epoch 90 out=49b] v86'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.047+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:94 13.11 13:88000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257dbc00 con 0x562d257b8400 2024-04-25T02:15:05.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.047+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 14 ==== osd_op_reply(94 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.047+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:95 13.31 13:8c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7c00 con 0x562d257c6000 2024-04-25T02:15:05.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.047+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.3 v2:172.21.15.79:6817/3072297369 7 ==== osd_op_reply(95 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257c6000 2024-04-25T02:15:05.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.047+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:96 13.9 13:90000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257da400 con 0x562d262e8c00 2024-04-25T02:15:05.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.048+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.5 v2:172.21.15.189:6802/1246927196 10 ==== osd_op_reply(96 [pgnls-filter start_epoch 90 out=49b] v86'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d262e8c00 2024-04-25T02:15:05.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.048+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:97 13.29 13:94000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7000 con 0x562d262e8400 2024-04-25T02:15:05.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.048+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 17 ==== osd_op_reply(97 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.048+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:98 13.19 13:98000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b8000 con 0x562d257c6000 2024-04-25T02:15:05.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.049+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.3 v2:172.21.15.79:6817/3072297369 8 ==== osd_op_reply(98 [pgnls-filter start_epoch 90 out=49b] v86'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257c6000 2024-04-25T02:15:05.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.049+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:99 13.39 13:9c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6c00 con 0x562d257b8c00 2024-04-25T02:15:05.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.049+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 17 ==== osd_op_reply(99 [pgnls-filter start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.049+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:100 13.5 13:a0000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b8800 con 0x562d257b9000 2024-04-25T02:15:05.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.049+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 15 ==== osd_op_reply(100 [pgnls-filter start_epoch 90 out=49b] v86'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.049+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:101 13.25 13:a4000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6400 con 0x562d257b9000 2024-04-25T02:15:05.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.049+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 16 ==== osd_op_reply(101 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.049+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:102 13.15 13:a8000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d262e9800 con 0x562d257b9000 2024-04-25T02:15:05.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.050+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 17 ==== osd_op_reply(102 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.050+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:103 13.35 13:ac000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7800 con 0x562d257b8400 2024-04-25T02:15:05.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.050+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 15 ==== osd_op_reply(103 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.050+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:104 13.d 13:b0000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d262e9c00 con 0x562d257b9000 2024-04-25T02:15:05.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.050+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 18 ==== osd_op_reply(104 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.050+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:105 13.2d 13:b4000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257db400 con 0x562d257b9800 2024-04-25T02:15:05.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.050+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.0 v2:172.21.15.79:6802/1526100659 7 ==== osd_op_reply(105 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b9800 2024-04-25T02:15:05.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.051+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:106 13.1d 13:b8000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d26363800 con 0x562d257ae000 2024-04-25T02:15:05.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.051+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 14 ==== osd_op_reply(106 [pgnls-filter start_epoch 90 out=49b] v86'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.051+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:107 13.3d 13:bc000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257da000 con 0x562d257ae000 2024-04-25T02:15:05.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.051+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 15 ==== osd_op_reply(107 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.051+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:108 13.3 13:c0000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257ae800 con 0x562d257b9800 2024-04-25T02:15:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.051+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.0 v2:172.21.15.79:6802/1526100659 8 ==== osd_op_reply(108 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b9800 2024-04-25T02:15:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.051+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:109 13.23 13:c4000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257dac00 con 0x562d257b8400 2024-04-25T02:15:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.052+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 16 ==== osd_op_reply(109 [pgnls-filter start_epoch 90 out=49b] v86'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.052+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:110 13.13 13:c8000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257ae400 con 0x562d257ae000 2024-04-25T02:15:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.052+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 16 ==== osd_op_reply(110 [pgnls-filter start_epoch 90 out=49b] v86'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.052+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:111 13.33 13:cc000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6800 con 0x562d257ae000 2024-04-25T02:15:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.052+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 17 ==== osd_op_reply(111 [pgnls-filter start_epoch 90 out=49b] v86'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.052+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:112 13.b 13:d0000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257ea000 con 0x562d262e8c00 2024-04-25T02:15:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.053+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.5 v2:172.21.15.189:6802/1246927196 11 ==== osd_op_reply(112 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d262e8c00 2024-04-25T02:15:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.053+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:113 13.2b 13:d4000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c7400 con 0x562d257b8c00 2024-04-25T02:15:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.053+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.2 v2:172.21.15.79:6800/3397511354 18 ==== osd_op_reply(113 [pgnls-filter start_epoch 90 out=49b] v86'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182780 con 0x562d257b8c00 2024-04-25T02:15:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.053+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:114 13.1b 13:d8000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257ea400 con 0x562d257b9000 2024-04-25T02:15:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.053+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 19 ==== osd_op_reply(114 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.053+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:115 13.3b 13:dc000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257c6c00 con 0x562d257b9000 2024-04-25T02:15:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.053+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 20 ==== osd_op_reply(115 [pgnls-filter start_epoch 90 out=49b] v86'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.053+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:116 13.7 13:e0000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257ea800 con 0x562d257ae000 2024-04-25T02:15:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.054+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 18 ==== osd_op_reply(116 [pgnls-filter start_epoch 90 out=81b] v90'7 uv7 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.054+0000 7f975cc13740 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-04-25T02:15:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.054+0000 7f975cc13740 10 datascan.operator(): handling object 10000000001.0 2024-04-25T02:15:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.054+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:117 13.7 13:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x562d257af000 con 0x562d257ae000 2024-04-25T02:15:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.054+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 <== osd.7 v2:172.21.15.189:6824/3421948491 19 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) ==== 416+0+157 (crc 0 0 0) 0x562d26182780 con 0x562d257ae000 2024-04-25T02:15:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.054+0000 7f975cc13740 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-04-25T02:15:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.054+0000 7f975cc13740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/file 2024-04-25T02:15:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.054+0000 7f975cc13740 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=file 2024-04-25T02:15:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.054+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:118 12.10 12:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x562d257af400 con 0x562d257b9800 2024-04-25T02:15:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.055+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.0 v2:172.21.15.79:6802/1526100659 9 ==== osd_op_reply(118 10000000000.00000000 [getxattr (59) out=59b] v0'0 uv17 ondisk = 0) ==== 164+0+59 (crc 0 0 0) 0x562d26182000 con 0x562d257b9800 2024-04-25T02:15:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.055+0000 7f975cc13740 20 datascan.get_frag_of: got backtrace parent 0x1/dir 2024-04-25T02:15:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.055+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x562d257af800 con 0x562d262e8400 2024-04-25T02:15:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.055+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 18 ==== osd_op_reply(119 1.00000000 [omap-get-vals-by-keys out=581b] v0'0 uv9 ondisk = 0) ==== 154+0+581 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.055+0000 7f975cc13740 20 datascan.read_dentry: oid=1.00000000 dname=dir frag=*, r=0 2024-04-25T02:15:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.055+0000 7f975cc13740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*) 2024-04-25T02:15:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.055+0000 7f975cc13740 20 datascan.get_frag_of: frag is * 2024-04-25T02:15:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.055+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:120 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x562d257afc00 con 0x562d257b9800 2024-04-25T02:15:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.055+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.0 v2:172.21.15.79:6802/1526100659 10 ==== osd_op_reply(120 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562d26182000 con 0x562d257b9800 2024-04-25T02:15:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.055+0000 7f975cc13740 10 datascan.find_or_create_dirfrag: read_version = 17 2024-04-25T02:15:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.055+0000 7f975cc13740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2024-04-25T02:15:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.055+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:121 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x562d257ea400 con 0x562d257b9800 2024-04-25T02:15:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.056+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.0 v2:172.21.15.79:6802/1526100659 11 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562d26182000 con 0x562d257b9800 2024-04-25T02:15:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.056+0000 7f975cc13740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T02:15:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.056+0000 7f975cc13740 20 datascan.read_dentry: file_head not found in result 2024-04-25T02:15:05.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.056+0000 7f975cc13740 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/file with size=0 bytes 2024-04-25T02:15:05.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.056+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:122 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x562d262e9800 con 0x562d257b9800 2024-04-25T02:15:05.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.057+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.0 v2:172.21.15.79:6802/1526100659 12 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v90'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562d26182000 con 0x562d257b9800 2024-04-25T02:15:05.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.057+0000 7f975cc13740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T02:15:05.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.057+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:123 13.27 13:e4000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d262e9c00 con 0x562d257b8400 2024-04-25T02:15:05.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.057+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.1 v2:172.21.15.79:6816/2311596149 17 ==== osd_op_reply(123 [pgnls-filter start_epoch 90 out=49b] v86'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d257b8400 2024-04-25T02:15:05.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.057+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:124 13.17 13:e8000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257eac00 con 0x562d262e8c00 2024-04-25T02:15:05.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.057+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.5 v2:172.21.15.189:6802/1246927196 12 ==== osd_op_reply(124 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d262e8c00 2024-04-25T02:15:05.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.057+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:125 13.37 13:ec000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257db000 con 0x562d262e8c00 2024-04-25T02:15:05.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.058+0000 7f975a0b4640 1 -- 172.21.15.79:0/2813842765 <== osd.5 v2:172.21.15.189:6802/1246927196 13 ==== osd_op_reply(125 [pgnls-filter start_epoch 90 out=49b] v86'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182000 con 0x562d262e8c00 2024-04-25T02:15:05.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.058+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:126 13.f 13:f0000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257eb000 con 0x562d262e8400 2024-04-25T02:15:05.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.058+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 19 ==== osd_op_reply(126 [pgnls-filter start_epoch 90 out=49b] v86'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.058+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:127 13.2f 13:f4000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d26363c00 con 0x562d257b9000 2024-04-25T02:15:05.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.058+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.4 v2:172.21.15.189:6800/1910571406 21 ==== osd_op_reply(127 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d257b9000 2024-04-25T02:15:05.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.058+0000 7f97558ab640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:128 13.1f 13:f8000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257eb400 con 0x562d262e8400 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 20 ==== osd_op_reply(128 [pgnls-filter start_epoch 90 out=49b] v86'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f97560ac640 1 -- 172.21.15.79:0/2813842765 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:129 13.3f 13:fc000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x562d257b9c00 con 0x562d262e8400 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975b0b6640 1 -- 172.21.15.79:0/2813842765 <== osd.6 v2:172.21.15.189:6816/1254358257 21 ==== osd_op_reply(129 [pgnls-filter start_epoch 90 out=49b] v86'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562d26182500 con 0x562d262e8400 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x562d257b9800 msgr2=0x562d25793600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x562d257b9800 0x562d25793600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x562d257b8400 msgr2=0x562d25792580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x562d257b8400 0x562d25792580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x562d257b8c00 msgr2=0x562d25793080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x562d257b8c00 0x562d25793080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x562d257c6000 msgr2=0x562d25793b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x562d257c6000 0x562d25793b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x562d257b9000 msgr2=0x562d25792b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x562d257b9000 0x562d25792b00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 reap_dead start 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x562d262e8c00 msgr2=0x562d25484680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x562d262e8c00 0x562d25484680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x562d262e8400 msgr2=0x562d25484100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x562d262e8400 0x562d25484100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 reap_dead start 2024-04-25T02:15:05.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975a8b5640 1 -- 172.21.15.79:0/2813842765 reap_dead start 2024-04-25T02:15:05.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x562d257ae000 msgr2=0x562d25483080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x562d257ae000 0x562d25483080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x562d26362c00 msgr2=0x562d25792000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x562d26362c00 0x562d25792000 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x562d2544f500 tx=0x562d262e2f00 comp rx=0 tx=0).stop 2024-04-25T02:15:05.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d262e9400 msgr2=0x562d25485180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d262e9400 0x562d25485180 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x562d262e1c50 tx=0x562d262e2c00 comp rx=0 tx=0).stop 2024-04-25T02:15:05.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 shutdown_connections 2024-04-25T02:15:05.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x562d257ae000 0x562d25483080 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x562d26362c00 0x562d25792000 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 --2- 172.21.15.79:0/2813842765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d262e9400 0x562d25485180 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.059+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 >> 172.21.15.79:0/2813842765 conn(0x562d261ebc00 msgr2=0x562d25517000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:05.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.060+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 shutdown_connections 2024-04-25T02:15:05.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.060+0000 7f975cc13740 1 -- 172.21.15.79:0/2813842765 wait complete. 2024-04-25T02:15:05.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.060+0000 7f975cc13740 1 -- 172.21.15.79:0/689991167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d261eb000 msgr2=0x562d25482b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.060+0000 7f975cc13740 1 --2- 172.21.15.79:0/689991167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d261eb000 0x562d25482b00 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x562d26233110 tx=0x562d261ac1e0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.060+0000 7f975cc13740 1 -- 172.21.15.79:0/689991167 shutdown_connections 2024-04-25T02:15:05.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.060+0000 7f975cc13740 1 --2- 172.21.15.79:0/689991167 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d261eb400 0x562d25483b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.060+0000 7f975cc13740 1 --2- 172.21.15.79:0/689991167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d261eb000 0x562d25482b00 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.060+0000 7f975cc13740 1 --2- 172.21.15.79:0/689991167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d261ea400 0x562d25483600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.060+0000 7f975cc13740 1 -- 172.21.15.79:0/689991167 >> 172.21.15.79:0/689991167 conn(0x562d2540f000 msgr2=0x562d25516000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:05.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.060+0000 7f975cc13740 1 -- 172.21.15.79:0/689991167 shutdown_connections 2024-04-25T02:15:05.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.060+0000 7f975cc13740 1 -- 172.21.15.79:0/689991167 wait complete. 2024-04-25T02:15:05.084 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', 'cephfs_data'] in time 0:00:00.147876, result: 2024-04-25T02:15:05.084 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-25T02:15:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.146+0000 7fb8bde2f740 1 -- start start 2024-04-25T02:15:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.146+0000 7fb8bde2f740 1 Processor -- start 2024-04-25T02:15:05.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8bde2f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef85f60c00 0x55ef85fd4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8bde2f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef85f61800 0x55ef85fd4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8bde2f740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef85f61c00 0x55ef85fd5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8bde2f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ef86cf8780 con 0x55ef85f61800 2024-04-25T02:15:05.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8bde2f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ef86cf8600 con 0x55ef85f60c00 2024-04-25T02:15:05.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8bde2f740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ef86cf8480 con 0x55ef85f61c00 2024-04-25T02:15:05.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8baf59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef85f61800 0x55ef85fd4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8bb75a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef85f60c00 0x55ef85fd4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8baf59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef85f61800 0x55ef85fd4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33148/0 (socket says 172.21.15.79:33148) 2024-04-25T02:15:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8baf59640 1 -- 172.21.15.79:0/3517777236 learned_addr learned my addr 172.21.15.79:0/3517777236 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8bbf5b640 1 --2- 172.21.15.79:0/3517777236 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef85f61c00 0x55ef85fd5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8baf59640 1 -- 172.21.15.79:0/3517777236 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef85f61c00 msgr2=0x55ef85fd5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8baf59640 1 --2- 172.21.15.79:0/3517777236 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef85f61c00 0x55ef85fd5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8baf59640 1 -- 172.21.15.79:0/3517777236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef85f60c00 msgr2=0x55ef85fd4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8baf59640 1 --2- 172.21.15.79:0/3517777236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef85f60c00 0x55ef85fd4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8baf59640 1 -- 172.21.15.79:0/3517777236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef85f8d680 con 0x55ef85f61800 2024-04-25T02:15:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8bb75a640 1 --2- 172.21.15.79:0/3517777236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef85f60c00 0x55ef85fd4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:15:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8baf59640 1 --2- 172.21.15.79:0/3517777236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef85f61800 0x55ef85fd4b00 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x55ef86d83cb0 tx=0x55ef86cfe180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766b5c3dab3e25a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8b8f55640 1 -- 172.21.15.79:0/3517777236 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ef85f86680 con 0x55ef85f61800 2024-04-25T02:15:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8b8f55640 1 -- 172.21.15.79:0/3517777236 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55ef85faa540 con 0x55ef85f61800 2024-04-25T02:15:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8b8f55640 1 -- 172.21.15.79:0/3517777236 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ef85f86b60 con 0x55ef85f61800 2024-04-25T02:15:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8bde2f740 1 -- 172.21.15.79:0/3517777236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef85f8d860 con 0x55ef85f61800 2024-04-25T02:15:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8bde2f740 1 -- 172.21.15.79:0/3517777236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55ef85f8d2c0 con 0x55ef85f61800 2024-04-25T02:15:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8bde2f740 4 waiting for MDS map... 2024-04-25T02:15:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.147+0000 7fb8b8f55640 1 -- 172.21.15.79:0/3517777236 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x55ef86e46600 con 0x55ef85f61800 2024-04-25T02:15:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.148+0000 7fb8b8f55640 1 -- 172.21.15.79:0/3517777236 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) ==== 2885+0+0 (secure 0 0 0) 0x55ef85fb9180 con 0x55ef85f61800 2024-04-25T02:15:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.148+0000 7fb8bde2f740 4 Got MDS map 56 2024-04-25T02:15:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.148+0000 7fb8bde2f740 4 datascan.main: Using metadata pool output 2024-04-25T02:15:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.148+0000 7fb8bde2f740 4 datascan.main: connecting to RADOS... 2024-04-25T02:15:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.148+0000 7fb8bde2f740 1 Processor -- start 2024-04-25T02:15:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.148+0000 7fb8bde2f740 1 -- start start 2024-04-25T02:15:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bde2f740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef86e3b400 0x55ef85fd5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bde2f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86e3b800 0x55ef85fd5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bde2f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef86e3bc00 0x55ef85fd6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bde2f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ef86cf8300 con 0x55ef86e3b800 2024-04-25T02:15:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bde2f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ef86cf8000 con 0x55ef86e3bc00 2024-04-25T02:15:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bde2f740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ef85fc0900 con 0x55ef86e3b400 2024-04-25T02:15:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bb75a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86e3b800 0x55ef85fd5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bb75a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86e3b800 0x55ef85fd5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33162/0 (socket says 172.21.15.79:33162) 2024-04-25T02:15:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bb75a640 1 -- 172.21.15.79:0/1955847859 learned_addr learned my addr 172.21.15.79:0/1955847859 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8baf59640 1 --2- 172.21.15.79:0/1955847859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef86e3bc00 0x55ef85fd6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bbf5b640 1 --2- 172.21.15.79:0/1955847859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef86e3b400 0x55ef85fd5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bb75a640 1 -- 172.21.15.79:0/1955847859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef86e3b400 msgr2=0x55ef85fd5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bb75a640 1 --2- 172.21.15.79:0/1955847859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef86e3b400 0x55ef85fd5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bb75a640 1 -- 172.21.15.79:0/1955847859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef86e3bc00 msgr2=0x55ef85fd6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bb75a640 1 --2- 172.21.15.79:0/1955847859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef86e3bc00 0x55ef85fd6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bb75a640 1 -- 172.21.15.79:0/1955847859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef85f8d4a0 con 0x55ef86e3b800 2024-04-25T02:15:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8bb75a640 1 --2- 172.21.15.79:0/1955847859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86e3b800 0x55ef85fd5b80 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x55ef86d83200 tx=0x55ef86cfe240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4099d01f6233509 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8b6f51640 1 -- 172.21.15.79:0/1955847859 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ef85f869c0 con 0x55ef86e3b800 2024-04-25T02:15:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8b6f51640 1 -- 172.21.15.79:0/1955847859 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55ef85faae00 con 0x55ef86e3b800 2024-04-25T02:15:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.149+0000 7fb8b6f51640 1 -- 172.21.15.79:0/1955847859 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ef85f86680 con 0x55ef86e3b800 2024-04-25T02:15:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.150+0000 7fb8bde2f740 1 -- 172.21.15.79:0/1955847859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86e3b800 msgr2=0x55ef85fd5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.150+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/1955847859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86e3b800 0x55ef85fd5b80 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x55ef86d83200 tx=0x55ef86cfe240 comp rx=0 tx=0).stop 2024-04-25T02:15:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.150+0000 7fb8bde2f740 1 -- 172.21.15.79:0/1955847859 shutdown_connections 2024-04-25T02:15:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.150+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/1955847859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef86e3bc00 0x55ef85fd6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.150+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/1955847859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86e3b800 0x55ef85fd5b80 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.150+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/1955847859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef86e3b400 0x55ef85fd5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.150+0000 7fb8bde2f740 1 -- 172.21.15.79:0/1955847859 >> 172.21.15.79:0/1955847859 conn(0x55ef86e3b000 msgr2=0x55ef86069000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.150+0000 7fb8bde2f740 1 -- 172.21.15.79:0/1955847859 shutdown_connections 2024-04-25T02:15:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.150+0000 7fb8bde2f740 1 -- 172.21.15.79:0/1955847859 wait complete. 2024-04-25T02:15:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.150+0000 7fb8bde2f740 1 Processor -- start 2024-04-25T02:15:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.150+0000 7fb8bde2f740 1 -- start start 2024-04-25T02:15:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8bde2f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef86e3b400 0x55ef85fd7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8bde2f740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef86e3b800 0x55ef85fd6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8bde2f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86e3bc00 0x55ef85fd6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8bde2f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ef86cf9380 con 0x55ef86e3bc00 2024-04-25T02:15:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8bde2f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ef86cf8000 con 0x55ef86e3b400 2024-04-25T02:15:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8bde2f740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ef86cf9500 con 0x55ef86e3b800 2024-04-25T02:15:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8baf59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86e3bc00 0x55ef85fd6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8baf59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86e3bc00 0x55ef85fd6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33172/0 (socket says 172.21.15.79:33172) 2024-04-25T02:15:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 learned_addr learned my addr 172.21.15.79:0/232159523 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8bbf5b640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef86e3b400 0x55ef85fd7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8bb75a640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef86e3b800 0x55ef85fd6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef86e3b800 msgr2=0x55ef85fd6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8baf59640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef86e3b800 0x55ef85fd6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef86e3b400 msgr2=0x55ef85fd7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8baf59640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef86e3b400 0x55ef85fd7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef85f8d680 con 0x55ef86e3bc00 2024-04-25T02:15:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.151+0000 7fb8bbf5b640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef86e3b400 0x55ef85fd7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.152+0000 7fb8baf59640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86e3bc00 0x55ef85fd6680 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x55ef86e37ef0 tx=0x55ef86cfe360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.152+0000 7fb8b574e640 1 -- 172.21.15.79:0/232159523 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ef85f86820 con 0x55ef86e3bc00 2024-04-25T02:15:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.152+0000 7fb8b574e640 1 -- 172.21.15.79:0/232159523 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55ef85faaa80 con 0x55ef86e3bc00 2024-04-25T02:15:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.152+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef85f8d860 con 0x55ef86e3bc00 2024-04-25T02:15:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.152+0000 7fb8b574e640 1 -- 172.21.15.79:0/232159523 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ef85f869c0 con 0x55ef86e3bc00 2024-04-25T02:15:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.152+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef85f8d0e0 con 0x55ef86e3bc00 2024-04-25T02:15:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.152+0000 7fb8bde2f740 4 datascan.init: resolving metadata pool 12 2024-04-25T02:15:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.153+0000 7fb8b574e640 1 -- 172.21.15.79:0/232159523 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55ef86d62c00 con 0x55ef86e3bc00 2024-04-25T02:15:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.153+0000 7fb8b574e640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55ef86d69000 0x55ef85fd7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.153+0000 7fb8b574e640 1 -- 172.21.15.79:0/232159523 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x55ef86d66600 con 0x55ef86e3bc00 2024-04-25T02:15:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.153+0000 7fb8bde2f740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T02:15:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.153+0000 7fb8bde2f740 4 datascan.main: resolving metadata pool 12 2024-04-25T02:15:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.153+0000 7fb8bbf5b640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55ef86d69000 0x55ef85fd7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.153+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55ef86d69400 0x55ef85fd6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.153+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:1 12.0 12:00000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d69800 con 0x55ef86d69400 2024-04-25T02:15:05.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.154+0000 7fb8bb75a640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55ef86d69400 0x55ef85fd6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.154+0000 7fb8bbf5b640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55ef86d69000 0x55ef85fd7700 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55ef86cfced0 tx=0x55ef8626e720 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.154+0000 7fb8bb75a640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55ef86d69400 0x55ef85fd6100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.154+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.4 v2:172.21.15.189:6800/1910571406 1 ==== osd_op_reply(1 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d69400 2024-04-25T02:15:05.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.154+0000 7fb8bb75a640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55ef86d69800 0x55ef862ea000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.154+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:2 12.10 12:08000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d4b000 con 0x55ef86d69800 2024-04-25T02:15:05.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.154+0000 7fb8bbf5b640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55ef86d69800 0x55ef862ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.155+0000 7fb8bbf5b640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55ef86d69800 0x55ef862ea000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.155+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 1 ==== osd_op_reply(2 [pgnls start_epoch 90 out=177b] v90'18 uv18 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.155+0000 7fb8bbf5b640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55ef86d4b000 0x55ef862ea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.155+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:3 12.8 12:10000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e8800 con 0x55ef86d4b000 2024-04-25T02:15:05.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.155+0000 7fb8bb75a640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55ef86d4b000 0x55ef862ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.155+0000 7fb8bb75a640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55ef86d4b000 0x55ef862ea580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.156+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.3 v2:172.21.15.79:6817/3072297369 1 ==== osd_op_reply(3 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d4b000 2024-04-25T02:15:05.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.156+0000 7fb8bb75a640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55ef862e8800 0x55ef862eab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.156+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:4 12.18 12:18000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d4a800 con 0x55ef862e8800 2024-04-25T02:15:05.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.156+0000 7fb8baf59640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55ef862e8800 0x55ef862eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.156+0000 7fb8baf59640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55ef862e8800 0x55ef862eab00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.156+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.1 v2:172.21.15.79:6816/2311596149 1 ==== osd_op_reply(4 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8800 2024-04-25T02:15:05.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.156+0000 7fb8baf59640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55ef86d4a800 0x55ef862eb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.156+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:5 12.4 12:20000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d68800 con 0x55ef86d4a800 2024-04-25T02:15:05.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.157+0000 7fb8bbf5b640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55ef86d4a800 0x55ef862eb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.157+0000 7fb8bbf5b640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55ef86d4a800 0x55ef862eb600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.157+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 1 ==== osd_op_reply(5 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.157+0000 7fb8bbf5b640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55ef86d68800 0x55ef862ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.157+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:6 12.14 12:28000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e8c00 con 0x55ef86d68800 2024-04-25T02:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.158+0000 7fb8bb75a640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55ef86d68800 0x55ef862ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.158+0000 7fb8bb75a640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55ef86d68800 0x55ef862ebb80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.158+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.5 v2:172.21.15.189:6802/1246927196 1 ==== osd_op_reply(6 [pgnls start_epoch 90 out=149b] v89'28 uv28 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d68800 2024-04-25T02:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.158+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:7 12.c 12:30000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e8c00 con 0x55ef86d69800 2024-04-25T02:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.158+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 2 ==== osd_op_reply(7 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.158+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:8 12.1c 12:38000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e8c00 con 0x55ef86d69800 2024-04-25T02:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.159+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 3 ==== osd_op_reply(8 [pgnls start_epoch 90 out=73b] v89'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.159+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:9 12.2 12:40000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e8c00 con 0x55ef86d69400 2024-04-25T02:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.159+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.4 v2:172.21.15.189:6800/1910571406 2 ==== osd_op_reply(9 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d69400 2024-04-25T02:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.159+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:10 12.12 12:48000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e8c00 con 0x55ef86d4b000 2024-04-25T02:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.159+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.3 v2:172.21.15.79:6817/3072297369 2 ==== osd_op_reply(10 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d4b000 2024-04-25T02:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.159+0000 7fb8bb75a640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x55ef862e8c00 0x55ef862eb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.159+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:11 12.a 12:50000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d4b400 con 0x55ef862e8c00 2024-04-25T02:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.159+0000 7fb8baf59640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x55ef862e8c00 0x55ef862eb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.160+0000 7fb8baf59640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x55ef862e8c00 0x55ef862eb080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.160+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.2 v2:172.21.15.79:6800/3397511354 1 ==== osd_op_reply(11 [pgnls start_epoch 90 out=81b] v89'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8c00 2024-04-25T02:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.160+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:12 12.1a 12:58000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d4b400 con 0x55ef86d69400 2024-04-25T02:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.160+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.4 v2:172.21.15.189:6800/1910571406 3 ==== osd_op_reply(12 [pgnls start_epoch 90 out=49b] v87'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d69400 2024-04-25T02:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.160+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:13 12.6 12:60000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d4b400 con 0x55ef862e8800 2024-04-25T02:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.160+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.1 v2:172.21.15.79:6816/2311596149 2 ==== osd_op_reply(13 [pgnls start_epoch 90 out=77b] v89'7 uv7 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8800 2024-04-25T02:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.160+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:14 12.16 12:68000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d4b400 con 0x55ef86d4a800 2024-04-25T02:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.161+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 2 ==== osd_op_reply(14 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.161+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:15 12.e 12:70000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d4b400 con 0x55ef86d69800 2024-04-25T02:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.161+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 4 ==== osd_op_reply(15 [pgnls start_epoch 90 out=73b] v89'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.161+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:16 12.1e 12:78000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d4b400 con 0x55ef86d69400 2024-04-25T02:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.161+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.4 v2:172.21.15.189:6800/1910571406 4 ==== osd_op_reply(16 [pgnls start_epoch 90 out=49b] v87'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d69400 2024-04-25T02:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.161+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:17 12.1 12:80000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d4b400 con 0x55ef86d4a800 2024-04-25T02:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.162+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 3 ==== osd_op_reply(17 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.162+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:18 12.11 12:88000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d4b400 con 0x55ef86d68800 2024-04-25T02:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.162+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.5 v2:172.21.15.189:6802/1246927196 2 ==== osd_op_reply(18 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d68800 2024-04-25T02:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.162+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:19 12.9 12:90000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d4b400 con 0x55ef862e8c00 2024-04-25T02:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.162+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.2 v2:172.21.15.79:6800/3397511354 2 ==== osd_op_reply(19 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8c00 2024-04-25T02:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.162+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:20 12.19 12:98000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d4b400 con 0x55ef86d69800 2024-04-25T02:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.162+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 5 ==== osd_op_reply(20 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.162+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:21 12.5 12:a0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d4b400 con 0x55ef86d4a800 2024-04-25T02:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.163+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 4 ==== osd_op_reply(21 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.163+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:22 12.15 12:a8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d4b400 con 0x55ef86d4a800 2024-04-25T02:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.163+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 5 ==== osd_op_reply(22 [pgnls start_epoch 90 out=97b] v89'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.163+0000 7fb8bbf5b640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x55ef86d4b400 0x55ef862ec100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.163+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:23 12.d 12:b0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9000 con 0x55ef86d4b400 2024-04-25T02:15:05.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.163+0000 7fb8bbf5b640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x55ef86d4b400 0x55ef862ec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.164+0000 7fb8bbf5b640 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x55ef86d4b400 0x55ef862ec100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.164+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.7 v2:172.21.15.189:6824/3421948491 1 ==== osd_op_reply(23 [pgnls start_epoch 90 out=74b] v85'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4b400 2024-04-25T02:15:05.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.164+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:24 12.1d 12:b8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9000 con 0x55ef86d69800 2024-04-25T02:15:05.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.164+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 6 ==== osd_op_reply(24 [pgnls start_epoch 90 out=73b] v89'5 uv5 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.164+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:25 12.3 12:c0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9000 con 0x55ef86d69800 2024-04-25T02:15:05.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.164+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 7 ==== osd_op_reply(25 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.164+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:26 12.13 12:c8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9000 con 0x55ef862e8800 2024-04-25T02:15:05.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.165+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.1 v2:172.21.15.79:6816/2311596149 3 ==== osd_op_reply(26 [pgnls start_epoch 90 out=98b] v89'4 uv4 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8800 2024-04-25T02:15:05.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.165+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:27 12.b 12:d0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9000 con 0x55ef86d4b000 2024-04-25T02:15:05.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.165+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.3 v2:172.21.15.79:6817/3072297369 3 ==== osd_op_reply(27 [pgnls start_epoch 90 out=76b] v89'6 uv6 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d4b000 2024-04-25T02:15:05.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.165+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:28 12.1b 12:d8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9000 con 0x55ef86d69400 2024-04-25T02:15:05.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.165+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.4 v2:172.21.15.189:6800/1910571406 5 ==== osd_op_reply(28 [pgnls start_epoch 90 out=73b] v89'10 uv10 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d69400 2024-04-25T02:15:05.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.165+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:29 12.7 12:e0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9000 con 0x55ef862e8800 2024-04-25T02:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.166+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.1 v2:172.21.15.79:6816/2311596149 4 ==== osd_op_reply(29 [pgnls start_epoch 90 out=73b] v89'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8800 2024-04-25T02:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.166+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:30 12.17 12:e8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9000 con 0x55ef86d4a800 2024-04-25T02:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.166+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 6 ==== osd_op_reply(30 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.166+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:31 12.f 12:f0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9000 con 0x55ef86d4a800 2024-04-25T02:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.166+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 7 ==== osd_op_reply(31 [pgnls start_epoch 90 out=73b] v85'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.166+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:32 12.1f 12:f8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9000 con 0x55ef86d4a800 2024-04-25T02:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.167+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 8 ==== osd_op_reply(32 [pgnls start_epoch 90 out=101b] v89'9 uv9 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.167+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-25T02:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.167+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:33 12.10 12:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d69c00 con 0x55ef86d69800 2024-04-25T02:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.167+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 8 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.167+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-25T02:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.167+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:34 12.10 12:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9800 con 0x55ef86d69800 2024-04-25T02:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.167+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 9 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.167+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-25T02:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.167+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:35 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9c00 con 0x55ef86d69800 2024-04-25T02:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.167+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 10 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.167+0000 7fb8bde2f740 20 datascan.scan_links: injected ino detected 2024-04-25T02:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.167+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-25T02:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.167+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:36 12.10 12:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9400 con 0x55ef86d69800 2024-04-25T02:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 11 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-25T02:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:37 12.10 12:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9000 con 0x55ef86d69800 2024-04-25T02:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 12 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-25T02:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T02:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-25T02:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T02:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-25T02:15:05.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T02:15:05.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-25T02:15:05.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:38 12.14 12:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9800 con 0x55ef86d68800 2024-04-25T02:15:05.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.5 v2:172.21.15.189:6802/1246927196 3 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d68800 2024-04-25T02:15:05.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-25T02:15:05.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:39 12.1c 12:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9c00 con 0x55ef86d69800 2024-04-25T02:15:05.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 13 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 100000001f6.00000000 2024-04-25T02:15:05.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.168+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:40 12.a 12:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d69c00 con 0x55ef862e8c00 2024-04-25T02:15:05.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.169+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.2 v2:172.21.15.79:6800/3397511354 3 ==== osd_op_reply(40 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) ==== 164+0+54 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8c00 2024-04-25T02:15:05.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.169+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-25T02:15:05.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.169+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T02:15:05.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.169+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-25T02:15:05.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.169+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:41 12.e 12:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86310000 con 0x55ef86d69800 2024-04-25T02:15:05.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.169+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 14 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.169+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-25T02:15:05.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.169+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:42 12.15 12:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86310400 con 0x55ef86d4a800 2024-04-25T02:15:05.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.169+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 9 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.169+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-25T02:15:05.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.169+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T02:15:05.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.169+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-25T02:15:05.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.169+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T02:15:05.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.169+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-25T02:15:05.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.169+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:43 12.1d 12:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86310800 con 0x55ef86d69800 2024-04-25T02:15:05.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 15 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-25T02:15:05.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T02:15:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-25T02:15:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:44 12.13 12:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86310c00 con 0x55ef862e8800 2024-04-25T02:15:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.1 v2:172.21.15.79:6816/2311596149 5 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8800 2024-04-25T02:15:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-25T02:15:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T02:15:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 200.00000002 2024-04-25T02:15:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-25T02:15:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-25T02:15:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:45 12.7 12:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311000 con 0x55ef862e8800 2024-04-25T02:15:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.1 v2:172.21.15.79:6816/2311596149 6 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8800 2024-04-25T02:15:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-25T02:15:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T02:15:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-25T02:15:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T02:15:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-25T02:15:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.170+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:46 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311400 con 0x55ef86d4a800 2024-04-25T02:15:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.171+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 10 ==== osd_op_reply(46 1.00000000 [omap-get-vals out=1163b] v0'0 uv9 ondisk = 0) ==== 154+0+1163 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.171+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:47 12.0 12:00000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d69400 2024-04-25T02:15:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.171+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.4 v2:172.21.15.189:6800/1910571406 6 ==== osd_op_reply(47 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d69400 2024-04-25T02:15:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.171+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:48 12.10 12:08000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d69800 2024-04-25T02:15:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.171+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 16 ==== osd_op_reply(48 [pgnls start_epoch 90 out=177b] v90'18 uv18 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.171+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:49 12.8 12:10000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d4b000 2024-04-25T02:15:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.171+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.3 v2:172.21.15.79:6817/3072297369 4 ==== osd_op_reply(49 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d4b000 2024-04-25T02:15:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.171+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:50 12.18 12:18000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef862e8800 2024-04-25T02:15:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.172+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.1 v2:172.21.15.79:6816/2311596149 7 ==== osd_op_reply(50 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8800 2024-04-25T02:15:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.172+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:51 12.4 12:20000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d4a800 2024-04-25T02:15:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.172+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 11 ==== osd_op_reply(51 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.172+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:52 12.14 12:28000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d68800 2024-04-25T02:15:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.172+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.5 v2:172.21.15.189:6802/1246927196 4 ==== osd_op_reply(52 [pgnls start_epoch 90 out=149b] v89'28 uv28 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d68800 2024-04-25T02:15:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.172+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:53 12.c 12:30000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d69800 2024-04-25T02:15:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.173+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 17 ==== osd_op_reply(53 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.173+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:54 12.1c 12:38000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d69800 2024-04-25T02:15:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.173+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 18 ==== osd_op_reply(54 [pgnls start_epoch 90 out=73b] v89'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.173+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:55 12.2 12:40000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d69400 2024-04-25T02:15:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.174+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.4 v2:172.21.15.189:6800/1910571406 7 ==== osd_op_reply(55 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d69400 2024-04-25T02:15:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.174+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:56 12.12 12:48000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d4b000 2024-04-25T02:15:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.174+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.3 v2:172.21.15.79:6817/3072297369 5 ==== osd_op_reply(56 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d4b000 2024-04-25T02:15:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.174+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:57 12.a 12:50000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef862e8c00 2024-04-25T02:15:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.174+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.2 v2:172.21.15.79:6800/3397511354 4 ==== osd_op_reply(57 [pgnls start_epoch 90 out=81b] v89'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8c00 2024-04-25T02:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.174+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:58 12.1a 12:58000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d69400 2024-04-25T02:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.174+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.4 v2:172.21.15.189:6800/1910571406 8 ==== osd_op_reply(58 [pgnls start_epoch 90 out=49b] v87'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d69400 2024-04-25T02:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.174+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:59 12.6 12:60000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef862e8800 2024-04-25T02:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.175+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.1 v2:172.21.15.79:6816/2311596149 8 ==== osd_op_reply(59 [pgnls start_epoch 90 out=77b] v89'7 uv7 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8800 2024-04-25T02:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.175+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:60 12.16 12:68000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d4a800 2024-04-25T02:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.175+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 12 ==== osd_op_reply(60 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.175+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:61 12.e 12:70000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d69800 2024-04-25T02:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.175+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 19 ==== osd_op_reply(61 [pgnls start_epoch 90 out=73b] v89'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.175+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:62 12.1e 12:78000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d69400 2024-04-25T02:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.176+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.4 v2:172.21.15.189:6800/1910571406 9 ==== osd_op_reply(62 [pgnls start_epoch 90 out=49b] v87'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d69400 2024-04-25T02:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.176+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:63 12.1 12:80000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d4a800 2024-04-25T02:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.176+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 13 ==== osd_op_reply(63 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.176+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:64 12.11 12:88000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d68800 2024-04-25T02:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.176+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.5 v2:172.21.15.189:6802/1246927196 5 ==== osd_op_reply(64 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d68800 2024-04-25T02:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.176+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:65 12.9 12:90000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef862e8c00 2024-04-25T02:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.177+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.2 v2:172.21.15.79:6800/3397511354 5 ==== osd_op_reply(65 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8c00 2024-04-25T02:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.177+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:66 12.19 12:98000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d69800 2024-04-25T02:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.177+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 20 ==== osd_op_reply(66 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.177+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:67 12.5 12:a0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d4a800 2024-04-25T02:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.178+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 14 ==== osd_op_reply(67 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.178+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:68 12.15 12:a8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d4a800 2024-04-25T02:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.178+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 15 ==== osd_op_reply(68 [pgnls start_epoch 90 out=97b] v89'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.178+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:69 12.d 12:b0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d4b400 2024-04-25T02:15:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.178+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.7 v2:172.21.15.189:6824/3421948491 2 ==== osd_op_reply(69 [pgnls start_epoch 90 out=74b] v85'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4b400 2024-04-25T02:15:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.178+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:70 12.1d 12:b8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d69800 2024-04-25T02:15:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.178+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 21 ==== osd_op_reply(70 [pgnls start_epoch 90 out=73b] v89'5 uv5 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.178+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:71 12.3 12:c0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d69800 2024-04-25T02:15:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.179+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 22 ==== osd_op_reply(71 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.179+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:72 12.13 12:c8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef862e8800 2024-04-25T02:15:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.179+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.1 v2:172.21.15.79:6816/2311596149 9 ==== osd_op_reply(72 [pgnls start_epoch 90 out=98b] v89'4 uv4 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8800 2024-04-25T02:15:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.179+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:73 12.b 12:d0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d4b000 2024-04-25T02:15:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.179+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.3 v2:172.21.15.79:6817/3072297369 6 ==== osd_op_reply(73 [pgnls start_epoch 90 out=76b] v89'6 uv6 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d4b000 2024-04-25T02:15:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.179+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:74 12.1b 12:d8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d69400 2024-04-25T02:15:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.179+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.4 v2:172.21.15.189:6800/1910571406 10 ==== osd_op_reply(74 [pgnls start_epoch 90 out=73b] v89'10 uv10 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d69400 2024-04-25T02:15:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.179+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:75 12.7 12:e0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef862e8800 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.180+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.1 v2:172.21.15.79:6816/2311596149 10 ==== osd_op_reply(75 [pgnls start_epoch 90 out=73b] v89'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8800 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.180+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:76 12.17 12:e8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d4a800 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.180+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 16 ==== osd_op_reply(76 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.180+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:77 12.f 12:f0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d4a800 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.180+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 17 ==== osd_op_reply(77 [pgnls start_epoch 90 out=73b] v85'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.180+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:78 12.1f 12:f8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d4a800 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.181+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 18 ==== osd_op_reply(78 [pgnls start_epoch 90 out=101b] v89'9 uv9 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.181+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.181+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:79 12.10 12:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311c00 con 0x55ef86d69800 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.181+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 23 ==== osd_op_reply(79 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.181+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.181+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:80 12.10 12:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86310000 con 0x55ef86d69800 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.181+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 24 ==== osd_op_reply(80 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.181+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.181+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:81 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86310400 con 0x55ef86d69800 2024-04-25T02:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.181+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 25 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.181+0000 7fb8bde2f740 20 datascan.scan_links: injected ino detected 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.181+0000 7fb8bde2f740 -1 datascan.scan_links: Bad nlink on 0x10000000001 expected 2 has 1 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.181+0000 7fb8bde2f740 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.181+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.181+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:82 12.10 12:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86310800 con 0x55ef86d69800 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.182+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 26 ==== osd_op_reply(82 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.182+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.182+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:83 12.10 12:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9400 con 0x55ef86d69800 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.182+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 27 ==== osd_op_reply(83 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.182+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.182+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.182+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.182+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.182+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.182+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.182+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-25T02:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.182+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:84 12.14 12:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9000 con 0x55ef86d68800 2024-04-25T02:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.182+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 <== osd.5 v2:172.21.15.189:6802/1246927196 6 ==== osd_op_reply(84 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4000 con 0x55ef86d68800 2024-04-25T02:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.182+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-25T02:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.182+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:85 12.1c 12:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9c00 con 0x55ef86d69800 2024-04-25T02:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.183+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 28 ==== osd_op_reply(85 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.183+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 100000001f6.00000000 2024-04-25T02:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.183+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:86 12.a 12:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9400 con 0x55ef862e8c00 2024-04-25T02:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.183+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.2 v2:172.21.15.79:6800/3397511354 6 ==== osd_op_reply(86 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) ==== 164+0+54 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8c00 2024-04-25T02:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.183+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-25T02:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.183+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T02:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.183+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-25T02:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.183+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:87 12.e 12:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311400 con 0x55ef86d69800 2024-04-25T02:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.183+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 29 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.183+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-25T02:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.183+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:88 12.15 12:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311800 con 0x55ef86d4a800 2024-04-25T02:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 19 ==== osd_op_reply(88 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-25T02:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T02:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-25T02:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T02:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-25T02:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311c00 con 0x55ef86d69800 2024-04-25T02:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 30 ==== osd_op_reply(89 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-25T02:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T02:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-25T02:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:90 12.13 12:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86310000 con 0x55ef862e8800 2024-04-25T02:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.1 v2:172.21.15.79:6816/2311596149 11 ==== osd_op_reply(90 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8800 2024-04-25T02:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-25T02:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 200.00000002 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.184+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:91 12.7 12:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86310400 con 0x55ef862e8800 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.1 v2:172.21.15.79:6816/2311596149 12 ==== osd_op_reply(91 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8800 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8bde2f740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8bde2f740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:92 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86310800 con 0x55ef86d4a800 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.6 v2:172.21.15.189:6816/1254358257 20 ==== osd_op_reply(92 1.00000000 [omap-get-vals out=1163b] v0'0 uv9 ondisk = 0) ==== 154+0+1163 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d4a800 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8bde2f740 10 datascan.scan_links: processing 0 dup_primaries, 1 remote_links 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8bde2f740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8bde2f740 10 datascan.scan_links: processing 1 bad_nlink_inos 2024-04-25T02:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8bde2f740 10 datascan.scan_links: handling bad_nlink_ino 0x10000000001 2024-04-25T02:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:93 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86310c00 con 0x55ef86d69800 2024-04-25T02:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 31 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv18 ondisk = 0) ==== 164+0+505 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8bde2f740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T02:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.185+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:94 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311000 con 0x55ef86d69800 2024-04-25T02:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.186+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 32 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v90'19 uv19 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.187+0000 7fb8bde2f740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T02:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.187+0000 7fb8bde2f740 10 datascan.scan_links: processing 1 injected_inos 2024-04-25T02:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.187+0000 7fb8bde2f740 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-04-25T02:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.187+0000 7fb8bde2f740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:file 2024-04-25T02:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.187+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:95 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86310000 con 0x55ef86d69800 2024-04-25T02:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.187+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 33 ==== osd_op_reply(95 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv19 ondisk = 0) ==== 164+0+505 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.187+0000 7fb8bde2f740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T02:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.187+0000 7fb8bde2f740 20 datascan.scan_links: first is now 2 2024-04-25T02:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.187+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:96 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x55ef862e9400 con 0x55ef86d69800 2024-04-25T02:15:05.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.188+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.0 v2:172.21.15.79:6802/1526100659 34 ==== osd_op_reply(96 10000000000.00000000 [omap-set-vals] v90'20 uv20 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55ef860d4500 con 0x55ef86d69800 2024-04-25T02:15:05.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.188+0000 7fb8bde2f740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T02:15:05.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.188+0000 7fb8bde2f740 10 datascan.scan_links: updating inotable 2024-04-25T02:15:05.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.188+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:97 12.13 12:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d68c00 con 0x55ef862e8800 2024-04-25T02:15:05.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.188+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.1 v2:172.21.15.79:6816/2311596149 13 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv3 ondisk = 0) ==== 157+0+50 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8800 2024-04-25T02:15:05.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.188+0000 7fb8bde2f740 10 mds.0.inotable: skip_inos was [0x10000000002~0x1f4,0x100000001f7~0xfffffffe09] 2024-04-25T02:15:05.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.188+0000 7fb8bde2f740 10 mds.0.inotable: skip_inos now [0x100000001f7~0xfffffffe09] 2024-04-25T02:15:05.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.188+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:98 12.13 12:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x55ef86d69c00 con 0x55ef862e8800 2024-04-25T02:15:05.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8baf59640 1 -- 172.21.15.79:0/232159523 <== osd.1 v2:172.21.15.79:6816/2311596149 14 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v90'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x55ef860d4780 con 0x55ef862e8800 2024-04-25T02:15:05.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 10 datascan.scan_links: updating snaptable 2024-04-25T02:15:05.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:99 12.d 12:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55ef86311400 con 0x55ef86d4b400 2024-04-25T02:15:05.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bbf5b640 1 -- 172.21.15.79:0/232159523 <== osd.7 v2:172.21.15.189:6824/3421948491 3 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x55ef860d4280 con 0x55ef86d4b400 2024-04-25T02:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55ef86d69800 msgr2=0x55ef862ea000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55ef86d69800 0x55ef862ea000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55ef862e8800 msgr2=0x55ef862eab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55ef862e8800 0x55ef862eab00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x55ef862e8c00 msgr2=0x55ef862eb080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x55ef862e8c00 0x55ef862eb080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55ef86d4b000 msgr2=0x55ef862ea580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55ef86d4b000 0x55ef862ea580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55ef86d69400 msgr2=0x55ef85fd6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 reap_dead start 2024-04-25T02:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55ef86d69400 0x55ef85fd6100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 reap_dead start 2024-04-25T02:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55ef86d68800 msgr2=0x55ef862ebb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55ef86d68800 0x55ef862ebb80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55ef86d4a800 msgr2=0x55ef862eb600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55ef86d4a800 0x55ef862eb600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x55ef86d4b400 msgr2=0x55ef862ec100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x55ef86d4b400 0x55ef862ec100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55ef86d69000 msgr2=0x55ef85fd7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55ef86d69000 0x55ef85fd7700 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55ef86cfced0 tx=0x55ef8626e720 comp rx=0 tx=0).stop 2024-04-25T02:15:05.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86e3bc00 msgr2=0x55ef85fd6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/232159523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86e3bc00 0x55ef85fd6680 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x55ef86e37ef0 tx=0x55ef86cfe360 comp rx=0 tx=0).stop 2024-04-25T02:15:05.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bb75a640 1 -- 172.21.15.79:0/232159523 reap_dead start 2024-04-25T02:15:05.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 shutdown_connections 2024-04-25T02:15:05.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 >> 172.21.15.79:0/232159523 conn(0x55ef86e3b000 msgr2=0x55ef86069000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:05.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 shutdown_connections 2024-04-25T02:15:05.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.190+0000 7fb8bde2f740 1 -- 172.21.15.79:0/232159523 wait complete. 2024-04-25T02:15:05.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.191+0000 7fb8bde2f740 1 -- 172.21.15.79:0/3517777236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef85f61800 msgr2=0x55ef85fd4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.191+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/3517777236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef85f61800 0x55ef85fd4b00 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x55ef86d83cb0 tx=0x55ef86cfe180 comp rx=0 tx=0).stop 2024-04-25T02:15:05.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.191+0000 7fb8bde2f740 1 -- 172.21.15.79:0/3517777236 shutdown_connections 2024-04-25T02:15:05.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.191+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/3517777236 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef85f61c00 0x55ef85fd5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.191+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/3517777236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef85f61800 0x55ef85fd4b00 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.191+0000 7fb8bde2f740 1 --2- 172.21.15.79:0/3517777236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef85f60c00 0x55ef85fd4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.191+0000 7fb8bde2f740 1 -- 172.21.15.79:0/3517777236 >> 172.21.15.79:0/3517777236 conn(0x55ef85f61000 msgr2=0x55ef86068800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:05.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.191+0000 7fb8bde2f740 1 -- 172.21.15.79:0/3517777236 shutdown_connections 2024-04-25T02:15:05.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.191+0000 7fb8bde2f740 1 -- 172.21.15.79:0/3517777236 wait complete. 2024-04-25T02:15:05.219 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.135567, result: 2024-04-25T02:15:05.220 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T02:15:05.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.350+0000 7f968e6d4640 1 Processor -- start 2024-04-25T02:15:05.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.350+0000 7f968e6d4640 1 -- start start 2024-04-25T02:15:05.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f968e6d4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f968806b2f0 0x7f96880b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f968e6d4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96880cf7a0 0x7f968806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f968e6d4640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f968806e6b0 0x7f96880cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f968e6d4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f968815f830 con 0x7f968806b2f0 2024-04-25T02:15:05.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f968e6d4640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f968806bc10 con 0x7f968806e6b0 2024-04-25T02:15:05.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f968e6d4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f968815ec20 con 0x7f96880cf7a0 2024-04-25T02:15:05.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f9687fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f968806b2f0 0x7f96880b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f9687fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f968806b2f0 0x7f96880b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33178/0 (socket says 172.21.15.79:33178) 2024-04-25T02:15:05.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f9687fff640 1 -- 172.21.15.79:0/3201356960 learned_addr learned my addr 172.21.15.79:0/3201356960 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:05.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f96877fe640 1 --2- 172.21.15.79:0/3201356960 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96880cf7a0 0x7f968806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f968cc71640 1 --2- 172.21.15.79:0/3201356960 >> v2:172.21.15.189:3300/0 conn(0x7f968806e6b0 0x7f96880cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f9687fff640 1 -- 172.21.15.79:0/3201356960 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96880cf7a0 msgr2=0x7f968806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:05.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f9687fff640 1 --2- 172.21.15.79:0/3201356960 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96880cf7a0 0x7f968806b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f9687fff640 1 -- 172.21.15.79:0/3201356960 >> v2:172.21.15.189:3300/0 conn(0x7f968806e6b0 msgr2=0x7f96880cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:05.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f9687fff640 1 --2- 172.21.15.79:0/3201356960 >> v2:172.21.15.189:3300/0 conn(0x7f968806e6b0 0x7f96880cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.351+0000 7f9687fff640 1 -- 172.21.15.79:0/3201356960 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968815ef00 con 0x7f968806b2f0 2024-04-25T02:15:05.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.352+0000 7f9687fff640 1 --2- 172.21.15.79:0/3201356960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f968806b2f0 0x7f96880b4b50 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f9688070d00 tx=0x7f967802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6d381211442b75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.352+0000 7f9686ffd640 1 -- 172.21.15.79:0/3201356960 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678037070 con 0x7f968806b2f0 2024-04-25T02:15:05.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.352+0000 7f9686ffd640 1 -- 172.21.15.79:0/3201356960 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9678032440 con 0x7f968806b2f0 2024-04-25T02:15:05.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.352+0000 7f9686ffd640 1 -- 172.21.15.79:0/3201356960 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678032810 con 0x7f968806b2f0 2024-04-25T02:15:05.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.353+0000 7f968e6d4640 1 -- 172.21.15.79:0/3201356960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f968806b2f0 msgr2=0x7f96880b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.353+0000 7f968e6d4640 1 --2- 172.21.15.79:0/3201356960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f968806b2f0 0x7f96880b4b50 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f9688070d00 tx=0x7f967802a140 comp rx=0 tx=0).stop 2024-04-25T02:15:05.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.353+0000 7f968e6d4640 1 -- 172.21.15.79:0/3201356960 shutdown_connections 2024-04-25T02:15:05.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.353+0000 7f968e6d4640 1 --2- 172.21.15.79:0/3201356960 >> v2:172.21.15.189:3300/0 conn(0x7f968806e6b0 0x7f96880cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.353+0000 7f968e6d4640 1 --2- 172.21.15.79:0/3201356960 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96880cf7a0 0x7f968806b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.353+0000 7f968e6d4640 1 --2- 172.21.15.79:0/3201356960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f968806b2f0 0x7f96880b4b50 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.353+0000 7f968e6d4640 1 -- 172.21.15.79:0/3201356960 >> 172.21.15.79:0/3201356960 conn(0x7f96880b1cd0 msgr2=0x7f96880b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.353+0000 7f968e6d4640 1 -- 172.21.15.79:0/3201356960 shutdown_connections 2024-04-25T02:15:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.353+0000 7f968e6d4640 1 -- 172.21.15.79:0/3201356960 wait complete. 2024-04-25T02:15:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.354+0000 7f968e6d4640 1 Processor -- start 2024-04-25T02:15:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.354+0000 7f968e6d4640 1 -- start start 2024-04-25T02:15:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f968e6d4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f968806b2f0 0x7f968814c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f968e6d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f968806e6b0 0x7f9688158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f968e6d4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96880cf7a0 0x7f968809cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f968e6d4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f968806cfe0 con 0x7f968806e6b0 2024-04-25T02:15:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f968e6d4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f968815f4c0 con 0x7f968806b2f0 2024-04-25T02:15:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f968e6d4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f968806d160 con 0x7f96880cf7a0 2024-04-25T02:15:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f96877fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f968806e6b0 0x7f9688158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f96877fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f968806e6b0 0x7f9688158020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33186/0 (socket says 172.21.15.79:33186) 2024-04-25T02:15:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f96877fe640 1 -- 172.21.15.79:0/3345590048 learned_addr learned my addr 172.21.15.79:0/3345590048 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f968cc71640 1 --2- 172.21.15.79:0/3345590048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96880cf7a0 0x7f968809cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f9687fff640 1 --2- 172.21.15.79:0/3345590048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f968806b2f0 0x7f968814c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f96877fe640 1 -- 172.21.15.79:0/3345590048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96880cf7a0 msgr2=0x7f968809cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f96877fe640 1 --2- 172.21.15.79:0/3345590048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96880cf7a0 0x7f968809cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f96877fe640 1 -- 172.21.15.79:0/3345590048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f968806b2f0 msgr2=0x7f968814c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f96877fe640 1 --2- 172.21.15.79:0/3345590048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f968806b2f0 0x7f968814c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f96877fe640 1 -- 172.21.15.79:0/3345590048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9688158af0 con 0x7f968806e6b0 2024-04-25T02:15:05.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f96877fe640 1 --2- 172.21.15.79:0/3345590048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f968806e6b0 0x7f9688158020 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f967c00e8a0 tx=0x7f967c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f9684ff9640 1 -- 172.21.15.79:0/3345590048 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c017070 con 0x7f968806e6b0 2024-04-25T02:15:05.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f9684ff9640 1 -- 172.21.15.79:0/3345590048 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967c00c940 con 0x7f968806e6b0 2024-04-25T02:15:05.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f9684ff9640 1 -- 172.21.15.79:0/3345590048 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c00cd30 con 0x7f968806e6b0 2024-04-25T02:15:05.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f968e6d4640 1 -- 172.21.15.79:0/3345590048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9688158dd0 con 0x7f968806e6b0 2024-04-25T02:15:05.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.355+0000 7f968e6d4640 1 -- 172.21.15.79:0/3345590048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9688159670 con 0x7f968806e6b0 2024-04-25T02:15:05.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.356+0000 7f968e6d4640 1 -- 172.21.15.79:0/3345590048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96880690a0 con 0x7f968806e6b0 2024-04-25T02:15:05.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.357+0000 7f9684ff9640 1 -- 172.21.15.79:0/3345590048 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f967c01a070 con 0x7f968806e6b0 2024-04-25T02:15:05.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.357+0000 7f9684ff9640 1 --2- 172.21.15.79:0/3345590048 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f967406be30 0x7f967406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.357+0000 7f9684ff9640 1 -- 172.21.15.79:0/3345590048 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f967c08b0f0 con 0x7f968806e6b0 2024-04-25T02:15:05.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.357+0000 7f9687fff640 1 --2- 172.21.15.79:0/3345590048 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f967406be30 0x7f967406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.358+0000 7f9687fff640 1 --2- 172.21.15.79:0/3345590048 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f967406be30 0x7f967406e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9678034000 tx=0x7f967802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.362+0000 7f9684ff9640 1 -- 172.21.15.79:0/3345590048 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f967c0599d0 con 0x7f968806e6b0 2024-04-25T02:15:05.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.570+0000 7f968e6d4640 1 -- 172.21.15.79:0/3345590048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f96880cf4f0 con 0x7f968806e6b0 2024-04-25T02:15:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.835+0000 7f9684ff9640 1 -- 172.21.15.79:0/3345590048 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v57) ==== 162+0+0 (secure 0 0 0) 0x7f967c0592d0 con 0x7f968806e6b0 2024-04-25T02:15:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T02:15:05.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.838+0000 7f968e6d4640 1 -- 172.21.15.79:0/3345590048 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f967406be30 msgr2=0x7f967406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.838+0000 7f968e6d4640 1 --2- 172.21.15.79:0/3345590048 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f967406be30 0x7f967406e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9678034000 tx=0x7f967802e000 comp rx=0 tx=0).stop 2024-04-25T02:15:05.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.838+0000 7f968e6d4640 1 -- 172.21.15.79:0/3345590048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f968806e6b0 msgr2=0x7f9688158020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.838+0000 7f968e6d4640 1 --2- 172.21.15.79:0/3345590048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f968806e6b0 0x7f9688158020 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f967c00e8a0 tx=0x7f967c00ed60 comp rx=0 tx=0).stop 2024-04-25T02:15:05.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.838+0000 7f968e6d4640 1 -- 172.21.15.79:0/3345590048 shutdown_connections 2024-04-25T02:15:05.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.838+0000 7f968e6d4640 1 --2- 172.21.15.79:0/3345590048 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f967406be30 0x7f967406e2f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.838+0000 7f968e6d4640 1 --2- 172.21.15.79:0/3345590048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f96880cf7a0 0x7f968809cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.838+0000 7f968e6d4640 1 --2- 172.21.15.79:0/3345590048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f968806e6b0 0x7f9688158020 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.838+0000 7f968e6d4640 1 --2- 172.21.15.79:0/3345590048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f968806b2f0 0x7f968814c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.838+0000 7f968e6d4640 1 -- 172.21.15.79:0/3345590048 >> 172.21.15.79:0/3345590048 conn(0x7f96880b1cd0 msgr2=0x7f9688155fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:05.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.838+0000 7f968e6d4640 1 -- 172.21.15.79:0/3345590048 shutdown_connections 2024-04-25T02:15:05.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.838+0000 7f968e6d4640 1 -- 172.21.15.79:0/3345590048 wait complete. 2024-04-25T02:15:05.856 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:15:05.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.947+0000 7f20b5f70640 1 Processor -- start 2024-04-25T02:15:05.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.947+0000 7f20b5f70640 1 -- start start 2024-04-25T02:15:05.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.948+0000 7f20b5f70640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f20b006e3e0 0x7f20b0071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.948+0000 7f20b5f70640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b0070d90 con 0x7f20b0144cb0 2024-04-25T02:15:05.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.948+0000 7f20b5f70640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b00cf130 con 0x7f20b006df50 2024-04-25T02:15:05.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.948+0000 7f20b5f70640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f20b00cf410 con 0x7f20b006e3e0 2024-04-25T02:15:05.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.948+0000 7f20af7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f20b0144cb0 0x7f20b00b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48118/0 (socket says 172.21.15.79:48118) 2024-04-25T02:15:05.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.948+0000 7f20af7fe640 1 -- 172.21.15.79:0/1151048775 learned_addr learned my addr 172.21.15.79:0/1151048775 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:05.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.948+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1151048775 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2761343387 0 0) 0x7f20b0070d90 con 0x7f20b0144cb0 2024-04-25T02:15:05.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.948+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1151048775 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2098003520 con 0x7f20b0144cb0 2024-04-25T02:15:05.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.948+0000 7f20affff640 1 --2- 172.21.15.79:0/1151048775 >> v2:172.21.15.189:3300/0 conn(0x7f20b006e3e0 0x7f20b0071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1151048775 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1910173361 0 0) 0x7f2098003520 con 0x7f20b0144cb0 2024-04-25T02:15:05.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1151048775 >> v2:172.21.15.189:3300/0 conn(0x7f20b006e3e0 msgr2=0x7f20b0071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:05.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20ae7fc640 1 --2- 172.21.15.79:0/1151048775 >> v2:172.21.15.189:3300/0 conn(0x7f20b006e3e0 0x7f20b0071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1151048775 >> v1:172.21.15.189:6789/0 conn(0x7f20b006df50 legacy=0x7f20b0071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1151048775 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b00cf6f0 con 0x7f20b0144cb0 2024-04-25T02:15:05.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1151048775 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f20a0001670 con 0x7f20b0144cb0 2024-04-25T02:15:05.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1151048775 >> v1:172.21.15.79:6789/0 conn(0x7f20b0144cb0 legacy=0x7f20b00b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20ae7fc640 1 --2- 172.21.15.79:0/1151048775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2098003a00 0x7f2098003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20ae7fc640 1 --2- 172.21.15.79:0/1151048775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2098004800 0x7f2098004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20ae7fc640 1 --2- 172.21.15.79:0/1151048775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f20980052e0 0x7f209800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1151048775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f20b00cf410 con 0x7f2098004800 2024-04-25T02:15:05.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1151048775 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f209800c1e0 con 0x7f2098003a00 2024-04-25T02:15:05.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1151048775 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f209800c3e0 con 0x7f20980052e0 2024-04-25T02:15:05.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20aeffd640 1 --2- 172.21.15.79:0/1151048775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2098004800 0x7f2098004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20af7fe640 1 --2- 172.21.15.79:0/1151048775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2098003a00 0x7f2098003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20affff640 1 --2- 172.21.15.79:0/1151048775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f20980052e0 0x7f209800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20aeffd640 1 -- 172.21.15.79:0/1151048775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f20980052e0 msgr2=0x7f209800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:05.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20aeffd640 1 --2- 172.21.15.79:0/1151048775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f20980052e0 0x7f209800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20aeffd640 1 -- 172.21.15.79:0/1151048775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2098003a00 msgr2=0x7f2098003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:05.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20aeffd640 1 --2- 172.21.15.79:0/1151048775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2098003a00 0x7f2098003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20affff640 1 -- 172.21.15.79:0/1151048775 reap_dead start 2024-04-25T02:15:05.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.949+0000 7f20aeffd640 1 -- 172.21.15.79:0/1151048775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2098003520 con 0x7f2098004800 2024-04-25T02:15:05.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.950+0000 7f20aeffd640 1 --2- 172.21.15.79:0/1151048775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2098004800 0x7f2098004c80 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f20a4001750 tx=0x7f2098005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503e62fe9eb231f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.950+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1151048775 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4001370 con 0x7f2098004800 2024-04-25T02:15:05.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.950+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1151048775 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a40052d0 con 0x7f2098004800 2024-04-25T02:15:05.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.950+0000 7f20ae7fc640 1 -- 172.21.15.79:0/1151048775 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a402abc0 con 0x7f2098004800 2024-04-25T02:15:05.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.950+0000 7f20b5f70640 1 -- 172.21.15.79:0/1151048775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2098004800 msgr2=0x7f2098004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.950+0000 7f20b5f70640 1 --2- 172.21.15.79:0/1151048775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2098004800 0x7f2098004c80 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f20a4001750 tx=0x7f2098005830 comp rx=0 tx=0).stop 2024-04-25T02:15:05.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.951+0000 7f20b5f70640 1 -- 172.21.15.79:0/1151048775 shutdown_connections 2024-04-25T02:15:05.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.951+0000 7f20b5f70640 1 --2- 172.21.15.79:0/1151048775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2098004800 0x7f2098004c80 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.951+0000 7f20b5f70640 1 -- 172.21.15.79:0/1151048775 >> 172.21.15.79:0/1151048775 conn(0x7f20b00cfc80 msgr2=0x7f20b00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:05.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.951+0000 7f20b5f70640 1 -- 172.21.15.79:0/1151048775 shutdown_connections 2024-04-25T02:15:05.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.951+0000 7f20b5f70640 1 -- 172.21.15.79:0/1151048775 wait complete. 2024-04-25T02:15:05.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.952+0000 7f20b5f70640 1 Processor -- start 2024-04-25T02:15:05.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.952+0000 7f20b5f70640 1 -- start start 2024-04-25T02:15:05.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.952+0000 7f20b5f70640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2098004800 0x7f20b015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20b5f70640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20b012fed0 0x7f20b0130350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20b5f70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b015bf90 0x7f20b015c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20b5f70640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f20b0145090 con 0x7f20b015bf90 2024-04-25T02:15:05.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20b5f70640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f20b00cf9d0 con 0x7f20b012fed0 2024-04-25T02:15:05.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20b5f70640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f20b0145ab0 con 0x7f2098004800 2024-04-25T02:15:05.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20affff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b015bf90 0x7f20b015c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20affff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b015bf90 0x7f20b015c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33212/0 (socket says 172.21.15.79:33212) 2024-04-25T02:15:05.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20affff640 1 -- 172.21.15.79:0/2066827127 learned_addr learned my addr 172.21.15.79:0/2066827127 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:05.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20af7fe640 1 --2- 172.21.15.79:0/2066827127 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2098004800 0x7f20b015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20aeffd640 1 --2- 172.21.15.79:0/2066827127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20b012fed0 0x7f20b0130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20affff640 1 -- 172.21.15.79:0/2066827127 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2098004800 msgr2=0x7f20b015e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20affff640 1 --2- 172.21.15.79:0/2066827127 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2098004800 0x7f20b015e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20affff640 1 -- 172.21.15.79:0/2066827127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20b012fed0 msgr2=0x7f20b0130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20affff640 1 --2- 172.21.15.79:0/2066827127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20b012fed0 0x7f20b0130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20affff640 1 -- 172.21.15.79:0/2066827127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b015a520 con 0x7f20b015bf90 2024-04-25T02:15:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20affff640 1 --2- 172.21.15.79:0/2066827127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b015bf90 0x7f20b015c410 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f20b00ce0c0 tx=0x7f20a800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f2097fff640 1 -- 172.21.15.79:0/2066827127 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a800fde0 con 0x7f20b015bf90 2024-04-25T02:15:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f2097fff640 1 -- 172.21.15.79:0/2066827127 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a801d070 con 0x7f20b015bf90 2024-04-25T02:15:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f2097fff640 1 -- 172.21.15.79:0/2066827127 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8015670 con 0x7f20b015bf90 2024-04-25T02:15:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20b5f70640 1 -- 172.21.15.79:0/2066827127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b015a800 con 0x7f20b015bf90 2024-04-25T02:15:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.953+0000 7f20b5f70640 1 -- 172.21.15.79:0/2066827127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b015e8f0 con 0x7f20b015bf90 2024-04-25T02:15:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.954+0000 7f20b5f70640 1 -- 172.21.15.79:0/2066827127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b00690a0 con 0x7f20b015bf90 2024-04-25T02:15:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.955+0000 7f2097fff640 1 -- 172.21.15.79:0/2066827127 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f20a8015810 con 0x7f20b015bf90 2024-04-25T02:15:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.955+0000 7f2097fff640 1 --2- 172.21.15.79:0/2066827127 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f209c06be30 0x7f209c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.955+0000 7f2097fff640 1 -- 172.21.15.79:0/2066827127 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f20a808b8e0 con 0x7f20b015bf90 2024-04-25T02:15:05.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.955+0000 7f20af7fe640 1 --2- 172.21.15.79:0/2066827127 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f209c06be30 0x7f209c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:05.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.955+0000 7f20af7fe640 1 --2- 172.21.15.79:0/2066827127 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f209c06be30 0x7f209c06e2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f20a0000c00 tx=0x7f20a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:05.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:05.959+0000 7f2097fff640 1 -- 172.21.15.79:0/2066827127 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f20a8010040 con 0x7f20b015bf90 2024-04-25T02:15:06.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:06.172+0000 7f20b5f70640 1 -- 172.21.15.79:0/2066827127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20b00d0b90 con 0x7f20b015bf90 2024-04-25T02:15:06.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:06.172+0000 7f2097fff640 1 -- 172.21.15.79:0/2066827127 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5183 (secure 0 0 0) 0x7f20a805a1c0 con 0x7f20b015bf90 2024-04-25T02:15:06.178 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:15:05.838635+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7896},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7896":{"gid":7896,"name":"a","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.79:6837/1474949173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1474949173},{"type":"v1","addr":"172.21.15.79:6837","nonce":1474949173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-04-25T02:15:06.178 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 58 2024-04-25T02:15:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:06.174+0000 7f20b5f70640 1 -- 172.21.15.79:0/2066827127 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f209c06be30 msgr2=0x7f209c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:06.174+0000 7f20b5f70640 1 --2- 172.21.15.79:0/2066827127 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f209c06be30 0x7f209c06e2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f20a0000c00 tx=0x7f20a0009040 comp rx=0 tx=0).stop 2024-04-25T02:15:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:06.174+0000 7f20b5f70640 1 -- 172.21.15.79:0/2066827127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b015bf90 msgr2=0x7f20b015c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:06.174+0000 7f20b5f70640 1 --2- 172.21.15.79:0/2066827127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b015bf90 0x7f20b015c410 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f20b00ce0c0 tx=0x7f20a800f580 comp rx=0 tx=0).stop 2024-04-25T02:15:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:06.174+0000 7f20b5f70640 1 -- 172.21.15.79:0/2066827127 shutdown_connections 2024-04-25T02:15:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:06.174+0000 7f20b5f70640 1 --2- 172.21.15.79:0/2066827127 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f209c06be30 0x7f209c06e2f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:06.174+0000 7f20b5f70640 1 --2- 172.21.15.79:0/2066827127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b015bf90 0x7f20b015c410 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:06.174+0000 7f20b5f70640 1 --2- 172.21.15.79:0/2066827127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20b012fed0 0x7f20b0130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:06.174+0000 7f20b5f70640 1 --2- 172.21.15.79:0/2066827127 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2098004800 0x7f20b015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:06.174+0000 7f20b5f70640 1 -- 172.21.15.79:0/2066827127 >> 172.21.15.79:0/2066827127 conn(0x7f20b00cfc80 msgr2=0x7f20b00b0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:06.174+0000 7f20b5f70640 1 -- 172.21.15.79:0/2066827127 shutdown_connections 2024-04-25T02:15:06.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:06.174+0000 7f20b5f70640 1 -- 172.21.15.79:0/2066827127 wait complete. 2024-04-25T02:15:06.593 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:13:43.382458+0000', 'modified': '2024-04-25T02:15:05.838635+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 90, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7896}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7896': {'gid': 7896, 'name': 'a', 'rank': 0, 'incarnation': 58, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.79:6837/1474949173', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 1474949173}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 1474949173}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T02:15:06.593 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7896:up:replay 2024-04-25T02:15:07.594 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:15:07.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.697+0000 7f205c26b640 1 Processor -- start 2024-04-25T02:15:07.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.697+0000 7f205c26b640 1 -- start start 2024-04-25T02:15:07.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.698+0000 7f205c26b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2054144cb0 0x7f20540b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:07.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.698+0000 7f205c26b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2054070d90 con 0x7f205406e660 2024-04-25T02:15:07.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.698+0000 7f205c26b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20540cf130 con 0x7f20540b5580 2024-04-25T02:15:07.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.698+0000 7f205c26b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f20540cf410 con 0x7f2054144cb0 2024-04-25T02:15:07.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.698+0000 7f205a007640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2054144cb0 0x7f20540b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:07.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.698+0000 7f205a808640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f205406e660 0x7f2054071240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48120/0 (socket says 172.21.15.79:48120) 2024-04-25T02:15:07.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.698+0000 7f205a808640 1 -- 172.21.15.79:0/4279751379 learned_addr learned my addr 172.21.15.79:0/4279751379 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:07.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.698+0000 7f205a007640 1 -- 172.21.15.79:0/4279751379 >> v1:172.21.15.189:6789/0 conn(0x7f20540b5580 legacy=0x7f205406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:07.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.699+0000 7f205a007640 1 -- 172.21.15.79:0/4279751379 >> v1:172.21.15.79:6789/0 conn(0x7f205406e660 legacy=0x7f2054071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:07.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.699+0000 7f205a007640 1 -- 172.21.15.79:0/4279751379 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20540cf6f0 con 0x7f2054144cb0 2024-04-25T02:15:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.699+0000 7f205a007640 1 --2- 172.21.15.79:0/4279751379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2054144cb0 0x7f20540b5040 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f2050009dc0 tx=0x7f205002a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97c615bc3ca0aa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.699+0000 7f2059005640 1 -- 172.21.15.79:0/4279751379 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2050007740 con 0x7f2054144cb0 2024-04-25T02:15:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.699+0000 7f2059005640 1 -- 172.21.15.79:0/4279751379 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20500078e0 con 0x7f2054144cb0 2024-04-25T02:15:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.699+0000 7f2059005640 1 -- 172.21.15.79:0/4279751379 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2050007cb0 con 0x7f2054144cb0 2024-04-25T02:15:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.700+0000 7f205c26b640 1 -- 172.21.15.79:0/4279751379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2054144cb0 msgr2=0x7f20540b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.700+0000 7f205c26b640 1 --2- 172.21.15.79:0/4279751379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2054144cb0 0x7f20540b5040 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f2050009dc0 tx=0x7f205002a5b0 comp rx=0 tx=0).stop 2024-04-25T02:15:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.700+0000 7f205c26b640 1 -- 172.21.15.79:0/4279751379 shutdown_connections 2024-04-25T02:15:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.700+0000 7f205c26b640 1 --2- 172.21.15.79:0/4279751379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2054144cb0 0x7f20540b5040 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.700+0000 7f205c26b640 1 -- 172.21.15.79:0/4279751379 >> 172.21.15.79:0/4279751379 conn(0x7f20540cfc80 msgr2=0x7f20540d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.700+0000 7f205c26b640 1 -- 172.21.15.79:0/4279751379 shutdown_connections 2024-04-25T02:15:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.700+0000 7f205c26b640 1 -- 172.21.15.79:0/4279751379 wait complete. 2024-04-25T02:15:07.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.701+0000 7f205c26b640 1 Processor -- start 2024-04-25T02:15:07.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.701+0000 7f205c26b640 1 -- start start 2024-04-25T02:15:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.702+0000 7f205c26b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f205406e660 0x7f20541f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.702+0000 7f205c26b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20540b5580 0x7f20541f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.702+0000 7f205c26b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2054144cb0 0x7f20540b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.702+0000 7f205c26b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2054145ab0 con 0x7f20540b5580 2024-04-25T02:15:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.702+0000 7f205c26b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2054145090 con 0x7f205406e660 2024-04-25T02:15:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.702+0000 7f205c26b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2054145c30 con 0x7f2054144cb0 2024-04-25T02:15:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.702+0000 7f2059806640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20540b5580 0x7f20541f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.702+0000 7f2059806640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20540b5580 0x7f20541f7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33234/0 (socket says 172.21.15.79:33234) 2024-04-25T02:15:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.702+0000 7f2059806640 1 -- 172.21.15.79:0/665404098 learned_addr learned my addr 172.21.15.79:0/665404098 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.702+0000 7f2059806640 1 -- 172.21.15.79:0/665404098 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2054144cb0 msgr2=0x7f20540b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.702+0000 7f2059806640 1 --2- 172.21.15.79:0/665404098 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2054144cb0 0x7f20540b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.702+0000 7f2059806640 1 -- 172.21.15.79:0/665404098 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f205406e660 msgr2=0x7f20541f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.702+0000 7f205a007640 1 --2- 172.21.15.79:0/665404098 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f205406e660 0x7f20541f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.702+0000 7f2059806640 1 --2- 172.21.15.79:0/665404098 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f205406e660 0x7f20541f4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:07.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.702+0000 7f2059806640 1 -- 172.21.15.79:0/665404098 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2054142360 con 0x7f20540b5580 2024-04-25T02:15:07.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.703+0000 7f2059806640 1 --2- 172.21.15.79:0/665404098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20540b5580 0x7f20541f7900 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f204400c400 tx=0x7f204400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:07.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.703+0000 7f204affd640 1 -- 172.21.15.79:0/665404098 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044011790 con 0x7f20540b5580 2024-04-25T02:15:07.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.703+0000 7f204affd640 1 -- 172.21.15.79:0/665404098 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2044017070 con 0x7f20540b5580 2024-04-25T02:15:07.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.703+0000 7f205c26b640 1 -- 172.21.15.79:0/665404098 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2054142640 con 0x7f20540b5580 2024-04-25T02:15:07.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.703+0000 7f204affd640 1 -- 172.21.15.79:0/665404098 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044011bb0 con 0x7f20540b5580 2024-04-25T02:15:07.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.703+0000 7f205c26b640 1 -- 172.21.15.79:0/665404098 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2054142c00 con 0x7f20540b5580 2024-04-25T02:15:07.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.704+0000 7f205c26b640 1 -- 172.21.15.79:0/665404098 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2054142e00 con 0x7f20540b5580 2024-04-25T02:15:07.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.704+0000 7f204affd640 1 -- 172.21.15.79:0/665404098 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f204401c460 con 0x7f20540b5580 2024-04-25T02:15:07.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.705+0000 7f204affd640 1 --2- 172.21.15.79:0/665404098 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f203806be30 0x7f203806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:07.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.705+0000 7f204affd640 1 -- 172.21.15.79:0/665404098 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f204408ae00 con 0x7f20540b5580 2024-04-25T02:15:07.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.705+0000 7f205a007640 1 --2- 172.21.15.79:0/665404098 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f203806be30 0x7f203806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:07.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.705+0000 7f205a007640 1 --2- 172.21.15.79:0/665404098 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f203806be30 0x7f203806e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2050034000 tx=0x7f205002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:07.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.709+0000 7f204affd640 1 -- 172.21.15.79:0/665404098 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2054142e00 con 0x7f20540b5580 2024-04-25T02:15:07.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.919+0000 7f205c26b640 1 -- 172.21.15.79:0/665404098 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20540690a0 con 0x7f20540b5580 2024-04-25T02:15:07.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.919+0000 7f204affd640 1 -- 172.21.15.79:0/665404098 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5183 (secure 0 0 0) 0x7f20440596e0 con 0x7f20540b5580 2024-04-25T02:15:07.925 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:07.925 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:15:06.849714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7896},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7896":{"gid":7896,"name":"a","rank":0,"incarnation":58,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.79:6837/1474949173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1474949173},{"type":"v1","addr":"172.21.15.79:6837","nonce":1474949173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-04-25T02:15:07.925 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 60 2024-04-25T02:15:07.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.921+0000 7f205c26b640 1 -- 172.21.15.79:0/665404098 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f203806be30 msgr2=0x7f203806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:07.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.921+0000 7f205c26b640 1 --2- 172.21.15.79:0/665404098 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f203806be30 0x7f203806e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2050034000 tx=0x7f205002f000 comp rx=0 tx=0).stop 2024-04-25T02:15:07.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.921+0000 7f205c26b640 1 -- 172.21.15.79:0/665404098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20540b5580 msgr2=0x7f20541f7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:07.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.921+0000 7f205c26b640 1 --2- 172.21.15.79:0/665404098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20540b5580 0x7f20541f7900 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f204400c400 tx=0x7f204400c8c0 comp rx=0 tx=0).stop 2024-04-25T02:15:07.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.921+0000 7f205c26b640 1 -- 172.21.15.79:0/665404098 shutdown_connections 2024-04-25T02:15:07.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.921+0000 7f205c26b640 1 --2- 172.21.15.79:0/665404098 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f203806be30 0x7f203806e2f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:07.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.921+0000 7f205c26b640 1 --2- 172.21.15.79:0/665404098 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2054144cb0 0x7f20540b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:07.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.922+0000 7f205c26b640 1 --2- 172.21.15.79:0/665404098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20540b5580 0x7f20541f7900 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:07.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.922+0000 7f205c26b640 1 --2- 172.21.15.79:0/665404098 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f205406e660 0x7f20541f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:07.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.922+0000 7f205c26b640 1 -- 172.21.15.79:0/665404098 >> 172.21.15.79:0/665404098 conn(0x7f20540cfc80 msgr2=0x7f20540aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:07.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.922+0000 7f205c26b640 1 -- 172.21.15.79:0/665404098 shutdown_connections 2024-04-25T02:15:07.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:07.922+0000 7f205c26b640 1 -- 172.21.15.79:0/665404098 wait complete. 2024-04-25T02:15:08.340 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:13:43.382458+0000', 'modified': '2024-04-25T02:15:06.849714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 90, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7896}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7896': {'gid': 7896, 'name': 'a', 'rank': 0, 'incarnation': 58, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.79:6837/1474949173', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 1474949173}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 1474949173}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T02:15:08.340 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7896:up:rejoin 2024-04-25T02:15:09.341 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:15:09.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.444+0000 7fcd93a64640 1 Processor -- start 2024-04-25T02:15:09.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.444+0000 7fcd93a64640 1 -- start start 2024-04-25T02:15:09.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.445+0000 7fcd93a64640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd8c143bc0 0x7fcd8c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:09.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.445+0000 7fcd93a64640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c15fa40 con 0x7fcd8c06df50 2024-04-25T02:15:09.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.445+0000 7fcd93a64640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c0b5700 con 0x7fcd8c0b3d40 2024-04-25T02:15:09.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.445+0000 7fcd93a64640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcd8c072cb0 con 0x7fcd8c143bc0 2024-04-25T02:15:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.445+0000 7fcd90fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcd8c06df50 0x7fcd8c0b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48124/0 (socket says 172.21.15.79:48124) 2024-04-25T02:15:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.445+0000 7fcd90fff640 1 -- 172.21.15.79:0/4180687193 learned_addr learned my addr 172.21.15.79:0/4180687193 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd91800640 1 --2- 172.21.15.79:0/4180687193 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd8c143bc0 0x7fcd8c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 863173999 0 0) 0x7fcd7c001110 con 0x7fcd8c06df50 2024-04-25T02:15:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd78003520 con 0x7fcd8c06df50 2024-04-25T02:15:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168475978 0 0) 0x7fcd8c0b5700 con 0x7fcd8c0b3d40 2024-04-25T02:15:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd7c001110 con 0x7fcd8c0b3d40 2024-04-25T02:15:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2104329141 0 0) 0x7fcd78003520 con 0x7fcd8c06df50 2024-04-25T02:15:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd8c143bc0 msgr2=0x7fcd8c15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 --2- 172.21.15.79:0/4180687193 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd8c143bc0 0x7fcd8c15f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 >> v1:172.21.15.189:6789/0 conn(0x7fcd8c0b3d40 legacy=0x7fcd8c0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c071e00 con 0x7fcd8c06df50 2024-04-25T02:15:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fcd7c001840 con 0x7fcd8c06df50 2024-04-25T02:15:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 >> v1:172.21.15.79:6789/0 conn(0x7fcd8c06df50 legacy=0x7fcd8c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 --2- 172.21.15.79:0/4180687193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd78003b70 0x7fcd78003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 --2- 172.21.15.79:0/4180687193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd78004800 0x7fcd78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 --2- 172.21.15.79:0/4180687193 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd8c143bc0 0x7fcd78005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c072cb0 con 0x7fcd78003b70 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7800b9c0 con 0x7fcd78004800 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcd7800bbc0 con 0x7fcd8c143bc0 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd91800640 1 --2- 172.21.15.79:0/4180687193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd78003b70 0x7fcd78003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd90fff640 1 --2- 172.21.15.79:0/4180687193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd78004800 0x7fcd78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd92001640 1 --2- 172.21.15.79:0/4180687193 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd8c143bc0 0x7fcd78005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd91800640 1 -- 172.21.15.79:0/4180687193 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd8c143bc0 msgr2=0x7fcd78005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd91800640 1 --2- 172.21.15.79:0/4180687193 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd8c143bc0 0x7fcd78005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd91800640 1 -- 172.21.15.79:0/4180687193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd78004800 msgr2=0x7fcd78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd91800640 1 --2- 172.21.15.79:0/4180687193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd78004800 0x7fcd78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd91800640 1 -- 172.21.15.79:0/4180687193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd78003520 con 0x7fcd78003b70 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.446+0000 7fcd90fff640 1 --2- 172.21.15.79:0/4180687193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd78004800 0x7fcd78004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.447+0000 7fcd91800640 1 --2- 172.21.15.79:0/4180687193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd78003b70 0x7fcd78003f70 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009ac0 tx=0x7fcd78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53a47fd15b1fcce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:09.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.447+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88036070 con 0x7fcd78003b70 2024-04-25T02:15:09.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.447+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd88031400 con 0x7fcd78003b70 2024-04-25T02:15:09.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.447+0000 7fcd83fff640 1 -- 172.21.15.79:0/4180687193 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88009690 con 0x7fcd78003b70 2024-04-25T02:15:09.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.448+0000 7fcd93a64640 1 -- 172.21.15.79:0/4180687193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd78003b70 msgr2=0x7fcd78003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:09.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.448+0000 7fcd93a64640 1 --2- 172.21.15.79:0/4180687193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd78003b70 0x7fcd78003f70 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009ac0 tx=0x7fcd78005830 comp rx=0 tx=0).stop 2024-04-25T02:15:09.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.448+0000 7fcd92001640 1 -- 172.21.15.79:0/4180687193 reap_dead start 2024-04-25T02:15:09.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.448+0000 7fcd93a64640 1 -- 172.21.15.79:0/4180687193 shutdown_connections 2024-04-25T02:15:09.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.448+0000 7fcd93a64640 1 -- 172.21.15.79:0/4180687193 >> 172.21.15.79:0/4180687193 conn(0x7fcd8c0cfc80 msgr2=0x7fcd8c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:09.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.448+0000 7fcd93a64640 1 -- 172.21.15.79:0/4180687193 shutdown_connections 2024-04-25T02:15:09.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.448+0000 7fcd93a64640 1 -- 172.21.15.79:0/4180687193 wait complete. 2024-04-25T02:15:09.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.449+0000 7fcd93a64640 1 Processor -- start 2024-04-25T02:15:09.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.449+0000 7fcd93a64640 1 -- start start 2024-04-25T02:15:09.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.450+0000 7fcd93a64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd78003b70 0x7fcd8c13f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:09.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.450+0000 7fcd93a64640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd8c0ad8b0 0x7fcd8c0add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:09.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.450+0000 7fcd93a64640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd8c141fe0 0x7fcd8c142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:09.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.450+0000 7fcd93a64640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c072660 con 0x7fcd78003b70 2024-04-25T02:15:09.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.450+0000 7fcd93a64640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c072380 con 0x7fcd8c0ad8b0 2024-04-25T02:15:09.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.450+0000 7fcd93a64640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcd8c072940 con 0x7fcd8c141fe0 2024-04-25T02:15:09.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.450+0000 7fcd91800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd78003b70 0x7fcd8c13f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:09.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.450+0000 7fcd91800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd78003b70 0x7fcd8c13f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33250/0 (socket says 172.21.15.79:33250) 2024-04-25T02:15:09.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.450+0000 7fcd91800640 1 -- 172.21.15.79:0/4092759107 learned_addr learned my addr 172.21.15.79:0/4092759107 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.450+0000 7fcd91800640 1 -- 172.21.15.79:0/4092759107 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd8c141fe0 msgr2=0x7fcd8c142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.450+0000 7fcd91800640 1 --2- 172.21.15.79:0/4092759107 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd8c141fe0 0x7fcd8c142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.450+0000 7fcd91800640 1 -- 172.21.15.79:0/4092759107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd8c0ad8b0 msgr2=0x7fcd8c0add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.450+0000 7fcd91800640 1 --2- 172.21.15.79:0/4092759107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd8c0ad8b0 0x7fcd8c0add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.450+0000 7fcd91800640 1 -- 172.21.15.79:0/4092759107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c0ae400 con 0x7fcd78003b70 2024-04-25T02:15:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.450+0000 7fcd91800640 1 --2- 172.21.15.79:0/4092759107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd78003b70 0x7fcd8c13f7a0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009ac0 tx=0x7fcd88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.451+0000 7fcd81ffb640 1 -- 172.21.15.79:0/4092759107 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88036050 con 0x7fcd78003b70 2024-04-25T02:15:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.451+0000 7fcd81ffb640 1 -- 172.21.15.79:0/4092759107 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd88042070 con 0x7fcd78003b70 2024-04-25T02:15:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.451+0000 7fcd81ffb640 1 -- 172.21.15.79:0/4092759107 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd880044e0 con 0x7fcd78003b70 2024-04-25T02:15:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.451+0000 7fcd93a64640 1 -- 172.21.15.79:0/4092759107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8c0ae6e0 con 0x7fcd78003b70 2024-04-25T02:15:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.451+0000 7fcd93a64640 1 -- 172.21.15.79:0/4092759107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd8c0aeca0 con 0x7fcd78003b70 2024-04-25T02:15:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.452+0000 7fcd93a64640 1 -- 172.21.15.79:0/4092759107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd8c0690a0 con 0x7fcd78003b70 2024-04-25T02:15:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.452+0000 7fcd81ffb640 1 -- 172.21.15.79:0/4092759107 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd88047460 con 0x7fcd78003b70 2024-04-25T02:15:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.453+0000 7fcd81ffb640 1 --2- 172.21.15.79:0/4092759107 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcd7006be60 0x7fcd7006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.453+0000 7fcd81ffb640 1 -- 172.21.15.79:0/4092759107 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7fcd880ab660 con 0x7fcd78003b70 2024-04-25T02:15:09.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.453+0000 7fcd90fff640 1 --2- 172.21.15.79:0/4092759107 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcd7006be60 0x7fcd7006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:09.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.453+0000 7fcd90fff640 1 --2- 172.21.15.79:0/4092759107 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcd7006be60 0x7fcd7006e320 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0013d0 tx=0x7fcd7c0012e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:09.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.457+0000 7fcd81ffb640 1 -- 172.21.15.79:0/4092759107 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcd8804c020 con 0x7fcd78003b70 2024-04-25T02:15:09.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.666+0000 7fcd93a64640 1 -- 172.21.15.79:0/4092759107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd8c0d01e0 con 0x7fcd78003b70 2024-04-25T02:15:09.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.666+0000 7fcd81ffb640 1 -- 172.21.15.79:0/4092759107 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5190 (secure 0 0 0) 0x7fcd88079f40 con 0x7fcd78003b70 2024-04-25T02:15:09.672 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:09.672 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:15:08.854388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7896},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7896":{"gid":7896,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/1474949173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1474949173},{"type":"v1","addr":"172.21.15.79:6837","nonce":1474949173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7896,"qdb_cluster":[7896]},"id":6}]} 2024-04-25T02:15:09.672 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 61 2024-04-25T02:15:09.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.668+0000 7fcd93a64640 1 -- 172.21.15.79:0/4092759107 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcd7006be60 msgr2=0x7fcd7006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:09.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.668+0000 7fcd93a64640 1 --2- 172.21.15.79:0/4092759107 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcd7006be60 0x7fcd7006e320 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0013d0 tx=0x7fcd7c0012e0 comp rx=0 tx=0).stop 2024-04-25T02:15:09.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.668+0000 7fcd93a64640 1 -- 172.21.15.79:0/4092759107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd78003b70 msgr2=0x7fcd8c13f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:09.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.668+0000 7fcd93a64640 1 --2- 172.21.15.79:0/4092759107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd78003b70 0x7fcd8c13f7a0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009ac0 tx=0x7fcd88004730 comp rx=0 tx=0).stop 2024-04-25T02:15:09.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.669+0000 7fcd93a64640 1 -- 172.21.15.79:0/4092759107 shutdown_connections 2024-04-25T02:15:09.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.669+0000 7fcd93a64640 1 --2- 172.21.15.79:0/4092759107 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcd7006be60 0x7fcd7006e320 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:09.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.669+0000 7fcd93a64640 1 --2- 172.21.15.79:0/4092759107 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd8c141fe0 0x7fcd8c142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:09.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.669+0000 7fcd93a64640 1 --2- 172.21.15.79:0/4092759107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd8c0ad8b0 0x7fcd8c0add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:09.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.669+0000 7fcd93a64640 1 --2- 172.21.15.79:0/4092759107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd78003b70 0x7fcd8c13f7a0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:09.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.669+0000 7fcd93a64640 1 -- 172.21.15.79:0/4092759107 >> 172.21.15.79:0/4092759107 conn(0x7fcd8c0cfc80 msgr2=0x7fcd8c0cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:09.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.669+0000 7fcd93a64640 1 -- 172.21.15.79:0/4092759107 shutdown_connections 2024-04-25T02:15:09.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:09.669+0000 7fcd93a64640 1 -- 172.21.15.79:0/4092759107 wait complete. 2024-04-25T02:15:10.087 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:13:43.382458+0000', 'modified': '2024-04-25T02:15:08.854388+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 90, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7896}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7896': {'gid': 7896, 'name': 'a', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.79:6837/1474949173', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 1474949173}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 1474949173}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7896, 'qdb_cluster': [7896]} 2024-04-25T02:15:10.087 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:15:10.087 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T02:15:10.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.180+0000 7fd340b63640 1 Processor -- start 2024-04-25T02:15:10.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.180+0000 7fd340b63640 1 -- start start 2024-04-25T02:15:10.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.181+0000 7fd340b63640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd33c144cb0 0x7fd33c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.181+0000 7fd340b63640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd33c0b5580 0x7fd33c06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.181+0000 7fd340b63640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd33c070d90 con 0x7fd33c06e490 2024-04-25T02:15:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.181+0000 7fd340b63640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd33c06e8c0 con 0x7fd33c144cb0 2024-04-25T02:15:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.181+0000 7fd340b63640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd33c0cf130 con 0x7fd33c0b5580 2024-04-25T02:15:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.181+0000 7fd33a59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd33c144cb0 0x7fd33c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.181+0000 7fd33ad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd33c06e490 0x7fd33c15fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48130/0 (socket says 172.21.15.79:48130) 2024-04-25T02:15:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.181+0000 7fd33ad9d640 1 -- 172.21.15.79:0/3984652014 learned_addr learned my addr 172.21.15.79:0/3984652014 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.181+0000 7fd333fff640 1 --2- 172.21.15.79:0/3984652014 >> v2:172.21.15.189:3300/0 conn(0x7fd33c0b5580 0x7fd33c06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.181+0000 7fd33a59c640 1 -- 172.21.15.79:0/3984652014 >> v2:172.21.15.189:3300/0 conn(0x7fd33c0b5580 msgr2=0x7fd33c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.181+0000 7fd33a59c640 1 --2- 172.21.15.79:0/3984652014 >> v2:172.21.15.189:3300/0 conn(0x7fd33c0b5580 0x7fd33c06df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.181+0000 7fd33a59c640 1 -- 172.21.15.79:0/3984652014 >> v1:172.21.15.79:6789/0 conn(0x7fd33c06e490 legacy=0x7fd33c15fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.181+0000 7fd33a59c640 1 -- 172.21.15.79:0/3984652014 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33c0cf410 con 0x7fd33c144cb0 2024-04-25T02:15:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.181+0000 7fd339d9b640 1 -- 172.21.15.79:0/3984652014 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 408574235 0 0) 0x7fd33c070d90 con 0x7fd33c06e490 2024-04-25T02:15:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.181+0000 7fd333fff640 1 --2- 172.21.15.79:0/3984652014 >> v2:172.21.15.189:3300/0 conn(0x7fd33c0b5580 0x7fd33c06df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.182+0000 7fd33a59c640 1 --2- 172.21.15.79:0/3984652014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd33c144cb0 0x7fd33c0b5040 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0097a0 tx=0x7fd32c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed95d401d8d0146b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.182+0000 7fd339d9b640 1 -- 172.21.15.79:0/3984652014 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c037070 con 0x7fd33c144cb0 2024-04-25T02:15:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.182+0000 7fd339d9b640 1 -- 172.21.15.79:0/3984652014 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32c02adc0 con 0x7fd33c144cb0 2024-04-25T02:15:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.182+0000 7fd339d9b640 1 -- 172.21.15.79:0/3984652014 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c032660 con 0x7fd33c144cb0 2024-04-25T02:15:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.182+0000 7fd340b63640 1 -- 172.21.15.79:0/3984652014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd33c144cb0 msgr2=0x7fd33c0b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.182+0000 7fd340b63640 1 --2- 172.21.15.79:0/3984652014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd33c144cb0 0x7fd33c0b5040 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0097a0 tx=0x7fd32c02a0b0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.182+0000 7fd340b63640 1 -- 172.21.15.79:0/3984652014 shutdown_connections 2024-04-25T02:15:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.182+0000 7fd340b63640 1 --2- 172.21.15.79:0/3984652014 >> v2:172.21.15.189:3300/0 conn(0x7fd33c0b5580 0x7fd33c06df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.182+0000 7fd340b63640 1 --2- 172.21.15.79:0/3984652014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd33c144cb0 0x7fd33c0b5040 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.182+0000 7fd340b63640 1 -- 172.21.15.79:0/3984652014 >> 172.21.15.79:0/3984652014 conn(0x7fd33c0cfc80 msgr2=0x7fd33c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.182+0000 7fd340b63640 1 -- 172.21.15.79:0/3984652014 shutdown_connections 2024-04-25T02:15:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.182+0000 7fd340b63640 1 -- 172.21.15.79:0/3984652014 wait complete. 2024-04-25T02:15:10.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.184+0000 7fd340b63640 1 Processor -- start 2024-04-25T02:15:10.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.184+0000 7fd340b63640 1 -- start start 2024-04-25T02:15:10.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.184+0000 7fd340b63640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd33c06e490 0x7fd33c1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.184+0000 7fd340b63640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd33c0b5580 0x7fd33c131650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.184+0000 7fd340b63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd33c144cb0 0x7fd33c1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.184+0000 7fd340b63640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd33c145090 con 0x7fd33c144cb0 2024-04-25T02:15:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.184+0000 7fd340b63640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd33c0cf9d0 con 0x7fd33c06e490 2024-04-25T02:15:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.184+0000 7fd340b63640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd33c145ab0 con 0x7fd33c0b5580 2024-04-25T02:15:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.184+0000 7fd33ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd33c144cb0 0x7fd33c1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.184+0000 7fd33ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd33c144cb0 0x7fd33c1550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33254/0 (socket says 172.21.15.79:33254) 2024-04-25T02:15:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.184+0000 7fd33ad9d640 1 -- 172.21.15.79:0/3341715785 learned_addr learned my addr 172.21.15.79:0/3341715785 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.185+0000 7fd33a59c640 1 --2- 172.21.15.79:0/3341715785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd33c06e490 0x7fd33c1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.185+0000 7fd333fff640 1 --2- 172.21.15.79:0/3341715785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd33c0b5580 0x7fd33c131650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.185+0000 7fd33ad9d640 1 -- 172.21.15.79:0/3341715785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd33c0b5580 msgr2=0x7fd33c131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.185+0000 7fd33ad9d640 1 --2- 172.21.15.79:0/3341715785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd33c0b5580 0x7fd33c131650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.185+0000 7fd33ad9d640 1 -- 172.21.15.79:0/3341715785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd33c06e490 msgr2=0x7fd33c1579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.185+0000 7fd33ad9d640 1 --2- 172.21.15.79:0/3341715785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd33c06e490 0x7fd33c1579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.185+0000 7fd33ad9d640 1 -- 172.21.15.79:0/3341715785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33c132030 con 0x7fd33c144cb0 2024-04-25T02:15:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.185+0000 7fd333fff640 1 --2- 172.21.15.79:0/3341715785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd33c0b5580 0x7fd33c131650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.185+0000 7fd33ad9d640 1 --2- 172.21.15.79:0/3341715785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd33c144cb0 0x7fd33c1550f0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fd33400c7a0 tx=0x7fd33400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:10.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.185+0000 7fd332ffd640 1 -- 172.21.15.79:0/3341715785 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd334018070 con 0x7fd33c144cb0 2024-04-25T02:15:10.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.185+0000 7fd332ffd640 1 -- 172.21.15.79:0/3341715785 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33400a640 con 0x7fd33c144cb0 2024-04-25T02:15:10.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.185+0000 7fd332ffd640 1 -- 172.21.15.79:0/3341715785 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33400aab0 con 0x7fd33c144cb0 2024-04-25T02:15:10.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.185+0000 7fd340b63640 1 -- 172.21.15.79:0/3341715785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd33c132310 con 0x7fd33c144cb0 2024-04-25T02:15:10.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.185+0000 7fd340b63640 1 -- 172.21.15.79:0/3341715785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd33c1425d0 con 0x7fd33c144cb0 2024-04-25T02:15:10.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.187+0000 7fd332ffd640 1 -- 172.21.15.79:0/3341715785 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd33400ac50 con 0x7fd33c144cb0 2024-04-25T02:15:10.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.187+0000 7fd332ffd640 1 --2- 172.21.15.79:0/3341715785 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd31c06be30 0x7fd31c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.187+0000 7fd332ffd640 1 -- 172.21.15.79:0/3341715785 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7fd33408a500 con 0x7fd33c144cb0 2024-04-25T02:15:10.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.187+0000 7fd33a59c640 1 --2- 172.21.15.79:0/3341715785 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd31c06be30 0x7fd31c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.188+0000 7fd33a59c640 1 --2- 172.21.15.79:0/3341715785 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd31c06be30 0x7fd31c06e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd32c034000 tx=0x7fd32c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.188+0000 7fd34386a740 1 Processor -- start 2024-04-25T02:15:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.188+0000 7fd34386a740 1 -- start start 2024-04-25T02:15:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd34386a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cf5b60 0x55f520ca84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd34386a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cd8c80 0x55f520cd8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd34386a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cd8540 0x55f520cad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd34386a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f520c10f00 con 0x55f520cf5b60 2024-04-25T02:15:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd34386a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f520bb9750 con 0x55f520cd8540 2024-04-25T02:15:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd34386a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55f520c0cec0 con 0x55f520cd8c80 2024-04-25T02:15:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd33a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cf5b60 0x55f520ca84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd33a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cf5b60 0x55f520ca84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33256/0 (socket says 172.21.15.79:33256) 2024-04-25T02:15:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd33a59c640 1 -- 172.21.15.79:0/2990683383 learned_addr learned my addr 172.21.15.79:0/2990683383 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd33a59c640 1 -- 172.21.15.79:0/2990683383 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cd8c80 msgr2=0x55f520cd8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd33a59c640 1 --2- 172.21.15.79:0/2990683383 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cd8c80 0x55f520cd8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd33ad9d640 1 --2- 172.21.15.79:0/2990683383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cd8540 0x55f520cad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd33a59c640 1 -- 172.21.15.79:0/2990683383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cd8540 msgr2=0x55f520cad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd33a59c640 1 --2- 172.21.15.79:0/2990683383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cd8540 0x55f520cad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd33a59c640 1 -- 172.21.15.79:0/2990683383 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5209252d0 con 0x55f520cf5b60 2024-04-25T02:15:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd33ad9d640 1 --2- 172.21.15.79:0/2990683383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cd8540 0x55f520cad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.189+0000 7fd33a59c640 1 --2- 172.21.15.79:0/2990683383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cf5b60 0x55f520ca84f0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fd32c03c540 tx=0x7fd32c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a66b1412e79256 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.190+0000 7fd31bfff640 1 -- 172.21.15.79:0/2990683383 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c04e070 con 0x55f520cf5b60 2024-04-25T02:15:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.190+0000 7fd31bfff640 1 -- 172.21.15.79:0/2990683383 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32c03ca60 con 0x55f520cf5b60 2024-04-25T02:15:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.190+0000 7fd31bfff640 1 -- 172.21.15.79:0/2990683383 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c037040 con 0x55f520cf5b60 2024-04-25T02:15:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.190+0000 7fd34386a740 1 -- 172.21.15.79:0/2990683383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cf5b60 msgr2=0x55f520ca84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:10.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.190+0000 7fd34386a740 1 --2- 172.21.15.79:0/2990683383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cf5b60 0x55f520ca84f0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fd32c03c540 tx=0x7fd32c02c000 comp rx=0 tx=0).stop 2024-04-25T02:15:10.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.190+0000 7fd34386a740 1 -- 172.21.15.79:0/2990683383 shutdown_connections 2024-04-25T02:15:10.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.190+0000 7fd34386a740 1 --2- 172.21.15.79:0/2990683383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cd8540 0x55f520cad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.190+0000 7fd34386a740 1 --2- 172.21.15.79:0/2990683383 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cd8c80 0x55f520cd8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.190+0000 7fd34386a740 1 --2- 172.21.15.79:0/2990683383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cf5b60 0x55f520ca84f0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.190+0000 7fd34386a740 1 -- 172.21.15.79:0/2990683383 >> 172.21.15.79:0/2990683383 conn(0x55f520caa760 msgr2=0x55f520cf3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:10.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.190+0000 7fd34386a740 1 -- 172.21.15.79:0/2990683383 shutdown_connections 2024-04-25T02:15:10.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.190+0000 7fd34386a740 1 -- 172.21.15.79:0/2990683383 wait complete. 2024-04-25T02:15:10.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.191+0000 7fd34386a740 1 -- start start 2024-04-25T02:15:10.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.191+0000 7fd34386a740 1 Processor -- start 2024-04-25T02:15:10.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd34386a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cd8c80 0x55f520cea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd34386a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cf5b60 0x55f520cad260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd34386a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cc8f70 0x55f520cad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd34386a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f520cac910 con 0x55f520cd8c80 2024-04-25T02:15:10.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd34386a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f520bcccf0 con 0x55f520cf5b60 2024-04-25T02:15:10.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd34386a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55f520cabd00 con 0x55f520cc8f70 2024-04-25T02:15:10.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd34386a740 10 client.0 _ll_register_callbacks cb 0x55f520bcc6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:15:10.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd33a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cd8c80 0x55f520cea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd33a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cd8c80 0x55f520cea6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33264/0 (socket says 172.21.15.79:33264) 2024-04-25T02:15:10.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd33a59c640 1 -- 172.21.15.79:0/3023099980 learned_addr learned my addr 172.21.15.79:0/3023099980 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:10.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd33ad9d640 1 --2- 172.21.15.79:0/3023099980 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cc8f70 0x55f520cad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd333fff640 1 --2- 172.21.15.79:0/3023099980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cf5b60 0x55f520cad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd33a59c640 1 -- 172.21.15.79:0/3023099980 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cc8f70 msgr2=0x55f520cad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:10.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd33a59c640 1 --2- 172.21.15.79:0/3023099980 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cc8f70 0x55f520cad7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd33a59c640 1 -- 172.21.15.79:0/3023099980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cf5b60 msgr2=0x55f520cad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd33a59c640 1 --2- 172.21.15.79:0/3023099980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cf5b60 0x55f520cad260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd33a59c640 1 -- 172.21.15.79:0/3023099980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5209ef6b0 con 0x55f520cd8c80 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd33a59c640 1 --2- 172.21.15.79:0/3023099980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cd8c80 0x55f520cea6d0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fd32c02a6a0 tx=0x7fd32c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5999a3a98619b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd3197fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.192+0000 7fd3197fa640 1 -- 172.21.15.79:0/3023099980 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c059060 con 0x55f520cd8c80 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd3197fa640 1 -- 172.21.15.79:0/3023099980 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7fd32c032b70 con 0x55f520cd8c80 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd34386a740 1 -- 172.21.15.79:0/3023099980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd32c03ca60 con 0x55f520cd8c80 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd3197fa640 1 -- 172.21.15.79:0/3023099980 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fd32c05f050 con 0x55f520cd8c80 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd34386a740 10 client.7974 fetch_fsmap learned FSMap version 61 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd34386a740 1 -- 172.21.15.79:0/3023099980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55f520ceb9c0 con 0x55f520cd8c80 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd3197fa640 1 -- 172.21.15.79:0/3023099980 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32c03ca60 con 0x55f520cd8c80 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd3197fa640 1 -- 172.21.15.79:0/3023099980 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7fd32c062020 con 0x55f520cd8c80 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd34386a740 10 client.7974 fetch_fsmap finished waiting for FSMap version 61 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd34386a740 10 client.7974 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:15:10.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd34386a740 20 client.7974 populate_metadata read hostname 'smithi079' 2024-04-25T02:15:10.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd34386a740 1 --2- 172.21.15.79:0/3023099980 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55f520cd95a0 0x55f520cd9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd34386a740 4 client.7974 mds_command: new command op to 7896 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:15:10.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd34386a740 1 -- 172.21.15.79:0/3023099980 --> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f520c1e440 con 0x55f520cd95a0 2024-04-25T02:15:10.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd333fff640 1 --2- 172.21.15.79:0/3023099980 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55f520cd95a0 0x55f520cd9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd333fff640 1 --2- 172.21.15.79:0/3023099980 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55f520cd95a0 0x55f520cd9980 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a34466ba3259946d server_cookie=1e5e1fcbf17af5c5 in_seq=0 out_seq=0 2024-04-25T02:15:10.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.193+0000 7fd3197fa640 10 client.7974 ms_handle_connect on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:10.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.194+0000 7fd3197fa640 1 -- 172.21.15.79:0/3023099980 <== mds.0 v2:172.21.15.79:6836/1474949173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f520c1e440 con 0x55f520cd95a0 2024-04-25T02:15:10.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.194+0000 7fd3197fa640 10 client.7974 handle_command_reply: tid=0 2024-04-25T02:15:10.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.194+0000 7fd34386a740 1 client.7974 shutdown 2024-04-25T02:15:10.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.194+0000 7fd34386a740 1 -- 172.21.15.79:0/3023099980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cd8c80 msgr2=0x55f520cea6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:10.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.194+0000 7fd34386a740 1 --2- 172.21.15.79:0/3023099980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cd8c80 0x55f520cea6d0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fd32c02a6a0 tx=0x7fd32c004730 comp rx=0 tx=0).stop 2024-04-25T02:15:10.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.194+0000 7fd34386a740 1 -- 172.21.15.79:0/3023099980 shutdown_connections 2024-04-25T02:15:10.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.194+0000 7fd34386a740 1 --2- 172.21.15.79:0/3023099980 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55f520cd95a0 0x55f520cd9980 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.194+0000 7fd34386a740 1 --2- 172.21.15.79:0/3023099980 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cc8f70 0x55f520cad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.194+0000 7fd3197fa640 0 client.7974 ms_handle_reset on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:10.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.194+0000 7fd34386a740 1 --2- 172.21.15.79:0/3023099980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cf5b60 0x55f520cad260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.194+0000 7fd34386a740 1 --2- 172.21.15.79:0/3023099980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cd8c80 0x55f520cea6d0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.194+0000 7fd34386a740 1 -- 172.21.15.79:0/3023099980 >> 172.21.15.79:0/3023099980 conn(0x55f520cd8540 msgr2=0x55f520ca9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:10.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.194+0000 7fd34386a740 1 -- 172.21.15.79:0/3023099980 shutdown_connections 2024-04-25T02:15:10.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.194+0000 7fd34386a740 1 -- 172.21.15.79:0/3023099980 wait complete. 2024-04-25T02:15:10.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.194+0000 7fd34386a740 20 client.7974 trim_cache size 0 max 16384 2024-04-25T02:15:10.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.213+0000 7fd34386a740 1 Processor -- start 2024-04-25T02:15:10.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.213+0000 7fd34386a740 1 -- start start 2024-04-25T02:15:10.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.213+0000 7fd34386a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cc8f70 0x55f520cf32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.213+0000 7fd34386a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cd8c80 0x55f520ca7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.213+0000 7fd34386a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cf5b60 0x55f520ca7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.213+0000 7fd34386a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd33c1fd6c0 con 0x55f520cf5b60 2024-04-25T02:15:10.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.213+0000 7fd34386a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd33c1f5f10 con 0x55f520cd8c80 2024-04-25T02:15:10.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.213+0000 7fd34386a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd33c1435a0 con 0x55f520cc8f70 2024-04-25T02:15:10.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.213+0000 7fd33ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cf5b60 0x55f520ca7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.213+0000 7fd33ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cf5b60 0x55f520ca7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33270/0 (socket says 172.21.15.79:33270) 2024-04-25T02:15:10.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.213+0000 7fd33ad9d640 1 -- 172.21.15.79:0/4041707197 learned_addr learned my addr 172.21.15.79:0/4041707197 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:10.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.214+0000 7fd333fff640 1 --2- 172.21.15.79:0/4041707197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cd8c80 0x55f520ca7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.214+0000 7fd33a59c640 1 --2- 172.21.15.79:0/4041707197 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cc8f70 0x55f520cf32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.214+0000 7fd33ad9d640 1 -- 172.21.15.79:0/4041707197 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cc8f70 msgr2=0x55f520cf32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:10.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.214+0000 7fd33ad9d640 1 --2- 172.21.15.79:0/4041707197 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cc8f70 0x55f520cf32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.214+0000 7fd33ad9d640 1 -- 172.21.15.79:0/4041707197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cd8c80 msgr2=0x55f520ca7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:10.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.214+0000 7fd33ad9d640 1 --2- 172.21.15.79:0/4041707197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cd8c80 0x55f520ca7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.214+0000 7fd33ad9d640 1 -- 172.21.15.79:0/4041707197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f520cebd10 con 0x55f520cf5b60 2024-04-25T02:15:10.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.214+0000 7fd333fff640 1 --2- 172.21.15.79:0/4041707197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cd8c80 0x55f520ca7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:10.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.214+0000 7fd33a59c640 1 --2- 172.21.15.79:0/4041707197 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cc8f70 0x55f520cf32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:10.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.214+0000 7fd33ad9d640 1 --2- 172.21.15.79:0/4041707197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cf5b60 0x55f520ca7790 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fd3340888d0 tx=0x7fd334009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee56eee9618287f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:10.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.214+0000 7fd31b7fe640 1 -- 172.21.15.79:0/4041707197 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33405ca90 con 0x55f520cf5b60 2024-04-25T02:15:10.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.214+0000 7fd31b7fe640 1 -- 172.21.15.79:0/4041707197 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3340612c0 con 0x55f520cf5b60 2024-04-25T02:15:10.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.214+0000 7fd31b7fe640 1 -- 172.21.15.79:0/4041707197 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd334054e00 con 0x55f520cf5b60 2024-04-25T02:15:10.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.215+0000 7fd34386a740 1 -- 172.21.15.79:0/4041707197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cf5b60 msgr2=0x55f520ca7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:10.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.215+0000 7fd34386a740 1 --2- 172.21.15.79:0/4041707197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cf5b60 0x55f520ca7790 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fd3340888d0 tx=0x7fd334009040 comp rx=0 tx=0).stop 2024-04-25T02:15:10.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.215+0000 7fd34386a740 1 -- 172.21.15.79:0/4041707197 shutdown_connections 2024-04-25T02:15:10.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.215+0000 7fd34386a740 1 --2- 172.21.15.79:0/4041707197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cf5b60 0x55f520ca7790 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.215+0000 7fd34386a740 1 --2- 172.21.15.79:0/4041707197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cd8c80 0x55f520ca7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.215+0000 7fd34386a740 1 --2- 172.21.15.79:0/4041707197 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cc8f70 0x55f520cf32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.215+0000 7fd34386a740 1 -- 172.21.15.79:0/4041707197 >> 172.21.15.79:0/4041707197 conn(0x55f520cd8540 msgr2=0x55f520ca3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:10.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.215+0000 7fd34386a740 1 -- 172.21.15.79:0/4041707197 shutdown_connections 2024-04-25T02:15:10.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.215+0000 7fd34386a740 1 -- 172.21.15.79:0/4041707197 wait complete. 2024-04-25T02:15:10.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.215+0000 7fd34386a740 1 -- start start 2024-04-25T02:15:10.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.215+0000 7fd34386a740 1 Processor -- start 2024-04-25T02:15:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd34386a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cc8f70 0x55f520cf6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd34386a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cd8c80 0x55f520d741e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd34386a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cf5b60 0x55f520ca7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd34386a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f520cdb120 con 0x55f520cc8f70 2024-04-25T02:15:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd34386a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f520cac910 con 0x55f520cf5b60 2024-04-25T02:15:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd34386a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55f520cc6820 con 0x55f520cd8c80 2024-04-25T02:15:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd34386a740 10 client.0 _ll_register_callbacks cb 0x7fd32c04c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:15:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd33a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cc8f70 0x55f520cf6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd33a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cc8f70 0x55f520cf6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33276/0 (socket says 172.21.15.79:33276) 2024-04-25T02:15:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd33a59c640 1 -- 172.21.15.79:0/4110568001 learned_addr learned my addr 172.21.15.79:0/4110568001 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd33ad9d640 1 --2- 172.21.15.79:0/4110568001 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cf5b60 0x55f520ca7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd333fff640 1 --2- 172.21.15.79:0/4110568001 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cd8c80 0x55f520d741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd33a59c640 1 -- 172.21.15.79:0/4110568001 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cd8c80 msgr2=0x55f520d741e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd33a59c640 1 --2- 172.21.15.79:0/4110568001 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cd8c80 0x55f520d741e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd33a59c640 1 -- 172.21.15.79:0/4110568001 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cf5b60 msgr2=0x55f520ca7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd33a59c640 1 --2- 172.21.15.79:0/4110568001 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cf5b60 0x55f520ca7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.216+0000 7fd33a59c640 1 -- 172.21.15.79:0/4110568001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f520d15850 con 0x55f520cc8f70 2024-04-25T02:15:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd33a59c640 1 --2- 172.21.15.79:0/4110568001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cc8f70 0x55f520cf6280 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fd32c03b7c0 tx=0x7fd32c008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df965fa4146c48e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd3197fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:15:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd3197fa640 1 -- 172.21.15.79:0/4110568001 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c04e030 con 0x55f520cc8f70 2024-04-25T02:15:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd3197fa640 1 -- 172.21.15.79:0/4110568001 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7fd32c03b9a0 con 0x55f520cc8f70 2024-04-25T02:15:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd34386a740 1 -- 172.21.15.79:0/4110568001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3340612c0 con 0x55f520cc8f70 2024-04-25T02:15:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd3197fa640 1 -- 172.21.15.79:0/4110568001 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fd32c06d050 con 0x55f520cc8f70 2024-04-25T02:15:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd34386a740 10 client.7980 fetch_fsmap learned FSMap version 61 2024-04-25T02:15:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd34386a740 1 -- 172.21.15.79:0/4110568001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55f520cad8f0 con 0x55f520cc8f70 2024-04-25T02:15:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd3197fa640 1 -- 172.21.15.79:0/4110568001 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3340612c0 con 0x55f520cc8f70 2024-04-25T02:15:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd3197fa640 1 -- 172.21.15.79:0/4110568001 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7fd32c070020 con 0x55f520cc8f70 2024-04-25T02:15:10.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd34386a740 10 client.7980 fetch_fsmap finished waiting for FSMap version 61 2024-04-25T02:15:10.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd34386a740 10 client.7980 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:15:10.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd34386a740 20 client.7980 populate_metadata read hostname 'smithi079' 2024-04-25T02:15:10.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd34386a740 1 --2- 172.21.15.79:0/4110568001 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55f520cc7560 0x55f520d04f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd34386a740 4 client.7980 mds_command: new command op to 7896 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:15:10.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd34386a740 1 -- 172.21.15.79:0/4110568001 --> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] -- command(tid 0: {"prefix": "status"}) -- 0x55f520c18790 con 0x55f520cc7560 2024-04-25T02:15:10.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd333fff640 1 --2- 172.21.15.79:0/4110568001 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55f520cc7560 0x55f520d04f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.217+0000 7fd3197fa640 10 client.7980 ms_handle_connect on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:10.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd333fff640 1 --2- 172.21.15.79:0/4110568001 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55f520cc7560 0x55f520d04f50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7325460d5ba0e6d server_cookie=3d4805c391c5b8d1 in_seq=0 out_seq=0 2024-04-25T02:15:10.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd3197fa640 1 -- 172.21.15.79:0/4110568001 <== mds.0 v2:172.21.15.79:6836/1474949173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55f520c18790 con 0x55f520cc7560 2024-04-25T02:15:10.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd3197fa640 10 client.7980 handle_command_reply: tid=0 2024-04-25T02:15:10.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd34386a740 1 client.7980 shutdown 2024-04-25T02:15:10.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd34386a740 1 -- 172.21.15.79:0/4110568001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cc8f70 msgr2=0x55f520cf6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:10.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd34386a740 1 --2- 172.21.15.79:0/4110568001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cc8f70 0x55f520cf6280 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fd32c03b7c0 tx=0x7fd32c008030 comp rx=0 tx=0).stop 2024-04-25T02:15:10.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd34386a740 1 -- 172.21.15.79:0/4110568001 shutdown_connections 2024-04-25T02:15:10.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd34386a740 1 --2- 172.21.15.79:0/4110568001 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55f520cc7560 0x55f520d04f50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd34386a740 1 --2- 172.21.15.79:0/4110568001 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f520cf5b60 0x55f520ca7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd34386a740 1 --2- 172.21.15.79:0/4110568001 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f520cd8c80 0x55f520d741e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd34386a740 1 --2- 172.21.15.79:0/4110568001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f520cc8f70 0x55f520cf6280 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd3197fa640 0 client.7980 ms_handle_reset on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:10.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd34386a740 1 -- 172.21.15.79:0/4110568001 >> 172.21.15.79:0/4110568001 conn(0x55f520cd8540 msgr2=0x55f520cabf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:10.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd34386a740 1 -- 172.21.15.79:0/4110568001 shutdown_connections 2024-04-25T02:15:10.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd34386a740 1 -- 172.21.15.79:0/4110568001 wait complete. 2024-04-25T02:15:10.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.218+0000 7fd34386a740 20 client.7980 trim_cache size 0 max 16384 2024-04-25T02:15:10.230 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:15:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "696648c4-3e52-400b-a780-2e8863c56c42", 2024-04-25T02:15:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-04-25T02:15:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7896, 2024-04-25T02:15:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-04-25T02:15:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-04-25T02:15:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-04-25T02:15:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.3762710880000002, 2024-04-25T02:15:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 61, 2024-04-25T02:15:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 90, 2024-04-25T02:15:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 90, 2024-04-25T02:15:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 5.3534125579999996 2024-04-25T02:15:10.231 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:15:10.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.219+0000 7fd340b63640 1 -- 172.21.15.79:0/3341715785 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd31c06be30 msgr2=0x7fd31c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:10.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.219+0000 7fd340b63640 1 --2- 172.21.15.79:0/3341715785 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd31c06be30 0x7fd31c06e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd32c034000 tx=0x7fd32c02e000 comp rx=0 tx=0).stop 2024-04-25T02:15:10.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.219+0000 7fd340b63640 1 -- 172.21.15.79:0/3341715785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd33c144cb0 msgr2=0x7fd33c1550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:10.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.219+0000 7fd340b63640 1 --2- 172.21.15.79:0/3341715785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd33c144cb0 0x7fd33c1550f0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fd33400c7a0 tx=0x7fd33400cc60 comp rx=0 tx=0).stop 2024-04-25T02:15:10.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.219+0000 7fd340b63640 1 -- 172.21.15.79:0/3341715785 shutdown_connections 2024-04-25T02:15:10.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.219+0000 7fd340b63640 1 --2- 172.21.15.79:0/3341715785 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd31c06be30 0x7fd31c06e2f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.219+0000 7fd340b63640 1 --2- 172.21.15.79:0/3341715785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd33c144cb0 0x7fd33c1550f0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.219+0000 7fd340b63640 1 --2- 172.21.15.79:0/3341715785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd33c0b5580 0x7fd33c131650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.219+0000 7fd340b63640 1 --2- 172.21.15.79:0/3341715785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd33c06e490 0x7fd33c1579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.219+0000 7fd340b63640 1 -- 172.21.15.79:0/3341715785 >> 172.21.15.79:0/3341715785 conn(0x7fd33c0cfc80 msgr2=0x7fd33c15fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:10.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.219+0000 7fd340b63640 1 -- 172.21.15.79:0/3341715785 shutdown_connections 2024-04-25T02:15:10.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.219+0000 7fd340b63640 1 -- 172.21.15.79:0/3341715785 wait complete. 2024-04-25T02:15:10.235 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:15:10.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.326+0000 7f85e26a5640 1 Processor -- start 2024-04-25T02:15:10.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.326+0000 7f85e26a5640 1 -- start start 2024-04-25T02:15:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.326+0000 7f85e26a5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85dc06df50 0x7f85dc06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.326+0000 7f85e26a5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85dc0b2d30 0x7f85dc0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.326+0000 7f85e26a5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85dc071e00 con 0x7f85dc143bc0 2024-04-25T02:15:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.326+0000 7f85e26a5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f85dc06e8f0 con 0x7f85dc06df50 2024-04-25T02:15:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.326+0000 7f85e26a5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f85dc072cb0 con 0x7f85dc0b2d30 2024-04-25T02:15:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.327+0000 7f85db7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85dc06df50 0x7f85dc06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.327+0000 7f85db7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85dc06df50 0x7f85dc06e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33286/0 (socket says 172.21.15.79:33286) 2024-04-25T02:15:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.327+0000 7f85db7fe640 1 -- 172.21.15.79:0/3538658124 learned_addr learned my addr 172.21.15.79:0/3538658124 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.327+0000 7f85e0c42640 1 --2- 172.21.15.79:0/3538658124 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85dc0b2d30 0x7f85dc0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.327+0000 7f85db7fe640 1 -- 172.21.15.79:0/3538658124 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85dc0b2d30 msgr2=0x7f85dc0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:10.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.327+0000 7f85db7fe640 1 --2- 172.21.15.79:0/3538658124 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85dc0b2d30 0x7f85dc0b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.327+0000 7f85db7fe640 1 -- 172.21.15.79:0/3538658124 >> v1:172.21.15.189:6789/0 conn(0x7f85dc143bc0 legacy=0x7f85dc15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:10.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.327+0000 7f85db7fe640 1 -- 172.21.15.79:0/3538658124 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85dc0720a0 con 0x7f85dc06df50 2024-04-25T02:15:10.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.327+0000 7f85db7fe640 1 --2- 172.21.15.79:0/3538658124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc06df50 0x7f85dc06e3b0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009870 tx=0x7f85cc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6e1101c0886226 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:10.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.328+0000 7f85daffd640 1 -- 172.21.15.79:0/3538658124 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc037070 con 0x7f85dc06df50 2024-04-25T02:15:10.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.328+0000 7f85daffd640 1 -- 172.21.15.79:0/3538658124 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85cc032440 con 0x7f85dc06df50 2024-04-25T02:15:10.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.328+0000 7f85daffd640 1 -- 172.21.15.79:0/3538658124 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc032810 con 0x7f85dc06df50 2024-04-25T02:15:10.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.328+0000 7f85e26a5640 1 -- 172.21.15.79:0/3538658124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc06df50 msgr2=0x7f85dc06e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:10.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.328+0000 7f85e26a5640 1 --2- 172.21.15.79:0/3538658124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc06df50 0x7f85dc06e3b0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009870 tx=0x7f85cc02a180 comp rx=0 tx=0).stop 2024-04-25T02:15:10.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.328+0000 7f85e26a5640 1 -- 172.21.15.79:0/3538658124 shutdown_connections 2024-04-25T02:15:10.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.328+0000 7f85e26a5640 1 --2- 172.21.15.79:0/3538658124 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85dc0b2d30 0x7f85dc0b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.328+0000 7f85e26a5640 1 --2- 172.21.15.79:0/3538658124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc06df50 0x7f85dc06e3b0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.328+0000 7f85e26a5640 1 -- 172.21.15.79:0/3538658124 >> 172.21.15.79:0/3538658124 conn(0x7f85dc0cfc80 msgr2=0x7f85dc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:10.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.328+0000 7f85e26a5640 1 -- 172.21.15.79:0/3538658124 shutdown_connections 2024-04-25T02:15:10.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.328+0000 7f85e26a5640 1 -- 172.21.15.79:0/3538658124 wait complete. 2024-04-25T02:15:10.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.329+0000 7f85e26a5640 1 Processor -- start 2024-04-25T02:15:10.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.330+0000 7f85e26a5640 1 -- start start 2024-04-25T02:15:10.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.330+0000 7f85e26a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc06df50 0x7f85dc141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.330+0000 7f85e26a5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85dc0b2d30 0x7f85dc0a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.330+0000 7f85e26a5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85dc143bc0 0x7f85dc13f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.330+0000 7f85e26a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc072940 con 0x7f85dc06df50 2024-04-25T02:15:10.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.330+0000 7f85e26a5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc072660 con 0x7f85dc0b2d30 2024-04-25T02:15:10.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.330+0000 7f85e26a5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f85dc143fa0 con 0x7f85dc143bc0 2024-04-25T02:15:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.330+0000 7f85dbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc06df50 0x7f85dc141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.330+0000 7f85dbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc06df50 0x7f85dc141cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33298/0 (socket says 172.21.15.79:33298) 2024-04-25T02:15:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.330+0000 7f85dbfff640 1 -- 172.21.15.79:0/1264893660 learned_addr learned my addr 172.21.15.79:0/1264893660 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.331+0000 7f85dbfff640 1 -- 172.21.15.79:0/1264893660 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85dc143bc0 msgr2=0x7f85dc13f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.331+0000 7f85dbfff640 1 --2- 172.21.15.79:0/1264893660 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85dc143bc0 0x7f85dc13f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.331+0000 7f85dbfff640 1 -- 172.21.15.79:0/1264893660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85dc0b2d30 msgr2=0x7f85dc0a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.331+0000 7f85dbfff640 1 --2- 172.21.15.79:0/1264893660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85dc0b2d30 0x7f85dc0a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.331+0000 7f85dbfff640 1 -- 172.21.15.79:0/1264893660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85dc0a9fe0 con 0x7f85dc06df50 2024-04-25T02:15:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.331+0000 7f85dbfff640 1 --2- 172.21.15.79:0/1264893660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc06df50 0x7f85dc141cf0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f85d000c460 tx=0x7f85d000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.331+0000 7f85d8ff9640 1 -- 172.21.15.79:0/1264893660 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d0016020 con 0x7f85dc06df50 2024-04-25T02:15:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.331+0000 7f85d8ff9640 1 -- 172.21.15.79:0/1264893660 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d0012870 con 0x7f85dc06df50 2024-04-25T02:15:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.331+0000 7f85e26a5640 1 -- 172.21.15.79:0/1264893660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85dc0aa280 con 0x7f85dc06df50 2024-04-25T02:15:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.331+0000 7f85d8ff9640 1 -- 172.21.15.79:0/1264893660 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d0012c60 con 0x7f85dc06df50 2024-04-25T02:15:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.331+0000 7f85e26a5640 1 -- 172.21.15.79:0/1264893660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85dc0aa840 con 0x7f85dc06df50 2024-04-25T02:15:10.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.332+0000 7f85e26a5640 1 -- 172.21.15.79:0/1264893660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85dc0ac420 con 0x7f85dc06df50 2024-04-25T02:15:10.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.332+0000 7f85d8ff9640 1 -- 172.21.15.79:0/1264893660 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85d0019020 con 0x7f85dc06df50 2024-04-25T02:15:10.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.333+0000 7f85d8ff9640 1 --2- 172.21.15.79:0/1264893660 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85c806be30 0x7f85c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:10.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.333+0000 7f85d8ff9640 1 -- 172.21.15.79:0/1264893660 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f85d008aa10 con 0x7f85dc06df50 2024-04-25T02:15:10.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.333+0000 7f85db7fe640 1 --2- 172.21.15.79:0/1264893660 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85c806be30 0x7f85c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:10.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.333+0000 7f85db7fe640 1 --2- 172.21.15.79:0/1264893660 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85c806be30 0x7f85c806e2f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f85cc034000 tx=0x7f85cc02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:10.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.337+0000 7f85d8ff9640 1 -- 172.21.15.79:0/1264893660 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f85d0020070 con 0x7f85dc06df50 2024-04-25T02:15:10.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.545+0000 7f85e26a5640 1 -- 172.21.15.79:0/1264893660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f85dc0b4030 con 0x7f85dc06df50 2024-04-25T02:15:10.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.546+0000 7f85d8ff9640 1 -- 172.21.15.79:0/1264893660 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v61) ==== 53+0+73 (secure 0 0 0) 0x7f85d00592f0 con 0x7f85dc06df50 2024-04-25T02:15:10.551 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:15:10.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.548+0000 7f85e26a5640 1 -- 172.21.15.79:0/1264893660 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85c806be30 msgr2=0x7f85c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:10.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.548+0000 7f85e26a5640 1 --2- 172.21.15.79:0/1264893660 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85c806be30 0x7f85c806e2f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f85cc034000 tx=0x7f85cc02c000 comp rx=0 tx=0).stop 2024-04-25T02:15:10.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.548+0000 7f85e26a5640 1 -- 172.21.15.79:0/1264893660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc06df50 msgr2=0x7f85dc141cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:10.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.548+0000 7f85e26a5640 1 --2- 172.21.15.79:0/1264893660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc06df50 0x7f85dc141cf0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f85d000c460 tx=0x7f85d000c920 comp rx=0 tx=0).stop 2024-04-25T02:15:10.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.548+0000 7f85e26a5640 1 -- 172.21.15.79:0/1264893660 shutdown_connections 2024-04-25T02:15:10.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.548+0000 7f85e26a5640 1 --2- 172.21.15.79:0/1264893660 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85c806be30 0x7f85c806e2f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.548+0000 7f85e26a5640 1 --2- 172.21.15.79:0/1264893660 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85dc143bc0 0x7f85dc13f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.548+0000 7f85e26a5640 1 --2- 172.21.15.79:0/1264893660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85dc0b2d30 0x7f85dc0a9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.548+0000 7f85e26a5640 1 --2- 172.21.15.79:0/1264893660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85dc06df50 0x7f85dc141cf0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:10.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.548+0000 7f85e26a5640 1 -- 172.21.15.79:0/1264893660 >> 172.21.15.79:0/1264893660 conn(0x7f85dc0cfc80 msgr2=0x7f85dc142270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:10.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.548+0000 7f85e26a5640 1 -- 172.21.15.79:0/1264893660 shutdown_connections 2024-04-25T02:15:10.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10.548+0000 7f85e26a5640 1 -- 172.21.15.79:0/1264893660 wait complete. 2024-04-25T02:15:10.564 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:15:10.564 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:15:10.564 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:15:10.564 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:15:10.564 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:15:10.564 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:15:10.564 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:15:10.564 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:15:10.565 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:15:10.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:15:10.565 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:15:10.580 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:15:10.580 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:15:10.580 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:15:10.580 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:15:10.580 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:15:10.581 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:15:10.581 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:15:10.581 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:15:10.581 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:15:10.581 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:15:10.581 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:15:10.581 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:15:10.581 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:15:10.581 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:15:10.581 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:15:10.582 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:15:10.582 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:15:10.582 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42295sec preferred_lft 42295sec 2024-04-25T02:15:10.582 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:15:10.582 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:15:10.582 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:15:10.582 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:15:10.582 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:15:10.582 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:15:10.582 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:15:10.583 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:15:10.583 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:15:10.583 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:15:10.583 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link 2024-04-25T02:15:10.583 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:15:10.583 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:15:10.583 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:15:10.583 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::4c:adff:fe56:7194/64 scope link 2024-04-25T02:15:10.583 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:15:10.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:15:10.584 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:15:10.642 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:15:10.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:15:10.644 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:15:10.700 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:15:10.700 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:15:10.700 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:15:10.700 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:15:10.700 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:15:10.700 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:15:10.701 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:15:10.701 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:15:10.701 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:15:10.701 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:15:10.701 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:15:10.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:15:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:15:10.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:15:10.823 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:15:10.838 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:15:10.838 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:15:10.838 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:15:10.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:15:10.838 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:15:10.846 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-04-25T02:15:10.841+0000 7fef52e36640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:15:10.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:15:10.869 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:15:10.924 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:15:10.924 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:15:10.924 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:15:10.978 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:15:10.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:15:10.978 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:15:11.059 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:15:11.059 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:15:11.059 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:15:11.067 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:15:11.068 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:15:11.068 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:15:11.068 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:15:11.068 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:15:11.072 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:15:11.072 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:15:11.072 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:15:11.072 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:15:11.072 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:15:11.072 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:15:11.073 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:15:11.073 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:15:11.073 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:15:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:15:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:15:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:15:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:15:11.075 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:15:11.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:15:11.075 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:15:11.139 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:15:11.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:15:11.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:15:11.235 INFO:teuthology.orchestra.run.smithi079.stdout:client7989 2024-04-25T02:15:11.236 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:15:11.236 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:15:11.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:15:11.251 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-25T02:15:11.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.386+0000 7f8e46e9a640 1 Processor -- start 2024-04-25T02:15:11.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.386+0000 7f8e46e9a640 1 -- start start 2024-04-25T02:15:11.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.387+0000 7f8e46e9a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8e400d25a0 0x7f8e400cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.387+0000 7f8e46e9a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e4015d7a0 con 0x7f8e4015c180 2024-04-25T02:15:11.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.387+0000 7f8e46e9a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e4015d4c0 con 0x7f8e400d2b10 2024-04-25T02:15:11.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.387+0000 7f8e46e9a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8e400d0340 con 0x7f8e400d25a0 2024-04-25T02:15:11.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.387+0000 7f8e37fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8e400d25a0 0x7f8e400cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.387+0000 7f8e44c36640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8e4015c180 0x7f8e400d1e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48134/0 (socket says 172.21.15.79:48134) 2024-04-25T02:15:11.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.387+0000 7f8e44c36640 1 -- 172.21.15.79:0/1275313824 learned_addr learned my addr 172.21.15.79:0/1275313824 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:11.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.388+0000 7f8e37fff640 1 -- 172.21.15.79:0/1275313824 >> v1:172.21.15.189:6789/0 conn(0x7f8e400d2b10 legacy=0x7f8e400af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.388+0000 7f8e37fff640 1 -- 172.21.15.79:0/1275313824 >> v1:172.21.15.79:6789/0 conn(0x7f8e4015c180 legacy=0x7f8e400d1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.388+0000 7f8e37fff640 1 -- 172.21.15.79:0/1275313824 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e400aedf0 con 0x7f8e400d25a0 2024-04-25T02:15:11.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.388+0000 7f8e377fe640 1 -- 172.21.15.79:0/1275313824 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 557327870 0 0) 0x7f8e4015d7a0 con 0x7f8e4015c180 2024-04-25T02:15:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.388+0000 7f8e37fff640 1 --2- 172.21.15.79:0/1275313824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e400d25a0 0x7f8e400cfe00 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f8e300097a0 tx=0x7f8e3002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b36e494550f4b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.388+0000 7f8e377fe640 1 -- 172.21.15.79:0/1275313824 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e30037070 con 0x7f8e400d25a0 2024-04-25T02:15:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.388+0000 7f8e377fe640 1 -- 172.21.15.79:0/1275313824 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e30032440 con 0x7f8e400d25a0 2024-04-25T02:15:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.388+0000 7f8e377fe640 1 -- 172.21.15.79:0/1275313824 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e30032810 con 0x7f8e400d25a0 2024-04-25T02:15:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.389+0000 7f8e46e9a640 1 -- 172.21.15.79:0/1275313824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e400d25a0 msgr2=0x7f8e400cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.389+0000 7f8e46e9a640 1 --2- 172.21.15.79:0/1275313824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e400d25a0 0x7f8e400cfe00 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f8e300097a0 tx=0x7f8e3002a1e0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.389+0000 7f8e46e9a640 1 -- 172.21.15.79:0/1275313824 shutdown_connections 2024-04-25T02:15:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.389+0000 7f8e46e9a640 1 --2- 172.21.15.79:0/1275313824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e400d25a0 0x7f8e400cfe00 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.389+0000 7f8e46e9a640 1 -- 172.21.15.79:0/1275313824 >> 172.21.15.79:0/1275313824 conn(0x7f8e4009aa70 msgr2=0x7f8e4009ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.389+0000 7f8e46e9a640 1 -- 172.21.15.79:0/1275313824 shutdown_connections 2024-04-25T02:15:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.389+0000 7f8e46e9a640 1 -- 172.21.15.79:0/1275313824 wait complete. 2024-04-25T02:15:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.390+0000 7f8e46e9a640 1 Processor -- start 2024-04-25T02:15:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.390+0000 7f8e46e9a640 1 -- start start 2024-04-25T02:15:11.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.391+0000 7f8e46e9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e400d25a0 0x7f8e400c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.391+0000 7f8e46e9a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e400d2b10 0x7f8e4009ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.391+0000 7f8e46e9a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e4015c180 0x7f8e400cf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.391+0000 7f8e46e9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e400af3b0 con 0x7f8e400d25a0 2024-04-25T02:15:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.391+0000 7f8e46e9a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4015d270 con 0x7f8e4015c180 2024-04-25T02:15:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.391+0000 7f8e46e9a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4015c560 con 0x7f8e400d2b10 2024-04-25T02:15:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.391+0000 7f8e44c36640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e400d25a0 0x7f8e400c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.391+0000 7f8e44c36640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e400d25a0 0x7f8e400c7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33304/0 (socket says 172.21.15.79:33304) 2024-04-25T02:15:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.391+0000 7f8e44c36640 1 -- 172.21.15.79:0/654607549 learned_addr learned my addr 172.21.15.79:0/654607549 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.391+0000 7f8e44c36640 1 -- 172.21.15.79:0/654607549 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e400d2b10 msgr2=0x7f8e4009ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.391+0000 7f8e44c36640 1 --2- 172.21.15.79:0/654607549 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e400d2b10 0x7f8e4009ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.391+0000 7f8e44c36640 1 -- 172.21.15.79:0/654607549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e4015c180 msgr2=0x7f8e400cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.391+0000 7f8e44c36640 1 --2- 172.21.15.79:0/654607549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e4015c180 0x7f8e400cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.391+0000 7f8e44c36640 1 -- 172.21.15.79:0/654607549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4009f9a0 con 0x7f8e400d25a0 2024-04-25T02:15:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.392+0000 7f8e44c36640 1 --2- 172.21.15.79:0/654607549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e400d25a0 0x7f8e400c7dd0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00c890 tx=0x7f8e3c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.392+0000 7f8e357fa640 1 -- 172.21.15.79:0/654607549 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c018070 con 0x7f8e400d25a0 2024-04-25T02:15:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.392+0000 7f8e357fa640 1 -- 172.21.15.79:0/654607549 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e3c00a640 con 0x7f8e400d25a0 2024-04-25T02:15:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.392+0000 7f8e46e9a640 1 -- 172.21.15.79:0/654607549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e4009fc80 con 0x7f8e400d25a0 2024-04-25T02:15:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.392+0000 7f8e357fa640 1 -- 172.21.15.79:0/654607549 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00aa30 con 0x7f8e400d25a0 2024-04-25T02:15:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.392+0000 7f8e46e9a640 1 -- 172.21.15.79:0/654607549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e4009c2e0 con 0x7f8e400d25a0 2024-04-25T02:15:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.393+0000 7f8e357fa640 1 -- 172.21.15.79:0/654607549 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e3c01b070 con 0x7f8e400d25a0 2024-04-25T02:15:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.393+0000 7f8e357fa640 1 --2- 172.21.15.79:0/654607549 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8e2c06be30 0x7f8e2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.394+0000 7f8e357fa640 1 -- 172.21.15.79:0/654607549 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f8e3c08a670 con 0x7f8e400d25a0 2024-04-25T02:15:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.394+0000 7f8e37fff640 1 --2- 172.21.15.79:0/654607549 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8e2c06be30 0x7f8e2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.394+0000 7f8e37fff640 1 --2- 172.21.15.79:0/654607549 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8e2c06be30 0x7f8e2c06e2f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8e30034000 tx=0x7f8e3002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:11.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.394+0000 7f8e49ba6740 1 Processor -- start 2024-04-25T02:15:11.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.395+0000 7f8e49ba6740 1 -- start start 2024-04-25T02:15:11.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.395+0000 7f8e49ba6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eb2280 0x562d13eb43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.395+0000 7f8e49ba6740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eee950 0x562d13eb2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.395+0000 7f8e49ba6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13edcd40 0x562d13edd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.395+0000 7f8e49ba6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562d13e152c0 con 0x562d13edcd40 2024-04-25T02:15:11.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.395+0000 7f8e49ba6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562d13dbd910 con 0x562d13eb2280 2024-04-25T02:15:11.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.395+0000 7f8e49ba6740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x562d13e11280 con 0x562d13eee950 2024-04-25T02:15:11.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.395+0000 7f8e45437640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13edcd40 0x562d13edd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.395+0000 7f8e45437640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13edcd40 0x562d13edd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33312/0 (socket says 172.21.15.79:33312) 2024-04-25T02:15:11.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.395+0000 7f8e45437640 1 -- 172.21.15.79:0/626934736 learned_addr learned my addr 172.21.15.79:0/626934736 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:11.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e37fff640 1 --2- 172.21.15.79:0/626934736 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eee950 0x562d13eb2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e44c36640 1 --2- 172.21.15.79:0/626934736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eb2280 0x562d13eb43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e45437640 1 -- 172.21.15.79:0/626934736 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eee950 msgr2=0x562d13eb2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e45437640 1 --2- 172.21.15.79:0/626934736 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eee950 0x562d13eb2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e45437640 1 -- 172.21.15.79:0/626934736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eb2280 msgr2=0x562d13eb43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e45437640 1 --2- 172.21.15.79:0/626934736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eb2280 0x562d13eb43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e45437640 1 -- 172.21.15.79:0/626934736 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d13dcefb0 con 0x562d13edcd40 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e37fff640 1 --2- 172.21.15.79:0/626934736 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eee950 0x562d13eb2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e44c36640 1 --2- 172.21.15.79:0/626934736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eb2280 0x562d13eb43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e45437640 1 --2- 172.21.15.79:0/626934736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13edcd40 0x562d13edd1c0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f8e380015f0 tx=0x7f8e38001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca51ad18476ca58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e267fc640 1 -- 172.21.15.79:0/626934736 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e38017070 con 0x562d13edcd40 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e267fc640 1 -- 172.21.15.79:0/626934736 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e38001d00 con 0x562d13edcd40 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e267fc640 1 -- 172.21.15.79:0/626934736 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3800c8a0 con 0x562d13edcd40 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e49ba6740 1 -- 172.21.15.79:0/626934736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13edcd40 msgr2=0x562d13edd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/626934736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13edcd40 0x562d13edd1c0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f8e380015f0 tx=0x7f8e38001ab0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e49ba6740 1 -- 172.21.15.79:0/626934736 shutdown_connections 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/626934736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13edcd40 0x562d13edd1c0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/626934736 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eee950 0x562d13eb2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/626934736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eb2280 0x562d13eb43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.396+0000 7f8e49ba6740 1 -- 172.21.15.79:0/626934736 >> 172.21.15.79:0/626934736 conn(0x562d13e79950 msgr2=0x562d13ef7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:11.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.397+0000 7f8e49ba6740 1 -- 172.21.15.79:0/626934736 shutdown_connections 2024-04-25T02:15:11.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.397+0000 7f8e49ba6740 1 -- 172.21.15.79:0/626934736 wait complete. 2024-04-25T02:15:11.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.397+0000 7f8e49ba6740 1 -- start start 2024-04-25T02:15:11.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.397+0000 7f8e49ba6740 1 Processor -- start 2024-04-25T02:15:11.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e49ba6740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eb2280 0x562d13ef8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e49ba6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13edcd40 0x562d13edff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e49ba6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eee950 0x562d13ef2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e49ba6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562d13dd0e90 con 0x562d13edcd40 2024-04-25T02:15:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e49ba6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562d13eda890 con 0x562d13eee950 2024-04-25T02:15:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e49ba6740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x562d13ee0a40 con 0x562d13eb2280 2024-04-25T02:15:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e49ba6740 10 client.0 _ll_register_callbacks cb 0x562d13e0c970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:15:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e37fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13edcd40 0x562d13edff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e37fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13edcd40 0x562d13edff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33328/0 (socket says 172.21.15.79:33328) 2024-04-25T02:15:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e37fff640 1 -- 172.21.15.79:0/789562971 learned_addr learned my addr 172.21.15.79:0/789562971 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e44c36640 1 --2- 172.21.15.79:0/789562971 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eb2280 0x562d13ef8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e45437640 1 --2- 172.21.15.79:0/789562971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eee950 0x562d13ef2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e37fff640 1 -- 172.21.15.79:0/789562971 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eb2280 msgr2=0x562d13ef8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e37fff640 1 --2- 172.21.15.79:0/789562971 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eb2280 0x562d13ef8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e37fff640 1 -- 172.21.15.79:0/789562971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eee950 msgr2=0x562d13ef2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e37fff640 1 --2- 172.21.15.79:0/789562971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eee950 0x562d13ef2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.398+0000 7f8e37fff640 1 -- 172.21.15.79:0/789562971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d13bf17e0 con 0x562d13edcd40 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e37fff640 1 --2- 172.21.15.79:0/789562971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13edcd40 0x562d13edff30 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f8e3002a220 tx=0x7f8e30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75274eebfac154a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e1f7fe640 1 -- 172.21.15.79:0/789562971 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3004c070 con 0x562d13edcd40 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e1f7fe640 1 -- 172.21.15.79:0/789562971 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f8e3003da40 con 0x562d13edcd40 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e49ba6740 1 -- 172.21.15.79:0/789562971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e38001d00 con 0x562d13edcd40 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e1f7fe640 1 -- 172.21.15.79:0/789562971 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f8e30057050 con 0x562d13edcd40 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e49ba6740 10 client.8004 fetch_fsmap learned FSMap version 61 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e49ba6740 1 -- 172.21.15.79:0/789562971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x562d13c51f70 con 0x562d13edcd40 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e1f7fe640 1 -- 172.21.15.79:0/789562971 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e38001d00 con 0x562d13edcd40 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e1f7fe640 1 -- 172.21.15.79:0/789562971 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f8e3005a020 con 0x562d13edcd40 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e49ba6740 10 client.8004 fetch_fsmap finished waiting for FSMap version 61 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e49ba6740 10 client.8004 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e49ba6740 20 client.8004 populate_metadata read hostname 'smithi079' 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/789562971 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x562d13ecb0a0 0x562d13ecb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e49ba6740 4 client.8004 mds_command: new command op to 7896 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:15:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e49ba6740 1 -- 172.21.15.79:0/789562971 --> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d13de95a0 con 0x562d13ecb0a0 2024-04-25T02:15:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.399+0000 7f8e44c36640 1 --2- 172.21.15.79:0/789562971 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x562d13ecb0a0 0x562d13ecb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.400+0000 7f8e1f7fe640 10 client.8004 ms_handle_connect on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.400+0000 7f8e44c36640 1 --2- 172.21.15.79:0/789562971 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x562d13ecb0a0 0x562d13ecb4d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83f3258f10835b3a server_cookie=740573e5d3e3f1bd in_seq=0 out_seq=0 2024-04-25T02:15:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.400+0000 7f8e1f7fe640 1 -- 172.21.15.79:0/789562971 <== mds.0 v2:172.21.15.79:6836/1474949173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562d13de95a0 con 0x562d13ecb0a0 2024-04-25T02:15:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.400+0000 7f8e1f7fe640 10 client.8004 handle_command_reply: tid=0 2024-04-25T02:15:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.400+0000 7f8e49ba6740 1 client.8004 shutdown 2024-04-25T02:15:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.400+0000 7f8e49ba6740 1 -- 172.21.15.79:0/789562971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13edcd40 msgr2=0x562d13edff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.400+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/789562971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13edcd40 0x562d13edff30 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f8e3002a220 tx=0x7f8e30004730 comp rx=0 tx=0).stop 2024-04-25T02:15:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.400+0000 7f8e49ba6740 1 -- 172.21.15.79:0/789562971 shutdown_connections 2024-04-25T02:15:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.400+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/789562971 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x562d13ecb0a0 0x562d13ecb4d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.400+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/789562971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eee950 0x562d13ef2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.400+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/789562971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13edcd40 0x562d13edff30 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.400+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/789562971 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eb2280 0x562d13ef8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.400+0000 7f8e49ba6740 1 -- 172.21.15.79:0/789562971 >> 172.21.15.79:0/789562971 conn(0x562d13e79950 msgr2=0x562d13efb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.400+0000 7f8e1f7fe640 0 client.8004 ms_handle_reset on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.401+0000 7f8e49ba6740 1 -- 172.21.15.79:0/789562971 shutdown_connections 2024-04-25T02:15:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.401+0000 7f8e49ba6740 1 -- 172.21.15.79:0/789562971 wait complete. 2024-04-25T02:15:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.401+0000 7f8e49ba6740 20 client.8004 trim_cache size 0 max 16384 2024-04-25T02:15:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.418+0000 7f8e49ba6740 1 Processor -- start 2024-04-25T02:15:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.418+0000 7f8e49ba6740 1 -- start start 2024-04-25T02:15:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.418+0000 7f8e49ba6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eb2280 0x562d13ea8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.418+0000 7f8e49ba6740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13edcd40 0x562d13f1ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e49ba6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13eee950 0x562d13edfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e49ba6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e401fe610 con 0x562d13eee950 2024-04-25T02:15:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e49ba6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8e401fd670 con 0x562d13eb2280 2024-04-25T02:15:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e49ba6740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4009d2b0 con 0x562d13edcd40 2024-04-25T02:15:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e45437640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13eee950 0x562d13edfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e45437640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13eee950 0x562d13edfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33334/0 (socket says 172.21.15.79:33334) 2024-04-25T02:15:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e45437640 1 -- 172.21.15.79:0/3927547262 learned_addr learned my addr 172.21.15.79:0/3927547262 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e37fff640 1 --2- 172.21.15.79:0/3927547262 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13edcd40 0x562d13f1ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e44c36640 1 --2- 172.21.15.79:0/3927547262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eb2280 0x562d13ea8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e45437640 1 -- 172.21.15.79:0/3927547262 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13edcd40 msgr2=0x562d13f1ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e45437640 1 --2- 172.21.15.79:0/3927547262 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13edcd40 0x562d13f1ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e45437640 1 -- 172.21.15.79:0/3927547262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eb2280 msgr2=0x562d13ea8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e45437640 1 --2- 172.21.15.79:0/3927547262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eb2280 0x562d13ea8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e45437640 1 -- 172.21.15.79:0/3927547262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d13eb05e0 con 0x562d13eee950 2024-04-25T02:15:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e45437640 1 --2- 172.21.15.79:0/3927547262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13eee950 0x562d13edfa90 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f8e38007fd0 tx=0x7f8e3800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5633b365dfc06c81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e25ffb640 1 -- 172.21.15.79:0/3927547262 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e38017070 con 0x562d13eee950 2024-04-25T02:15:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e25ffb640 1 -- 172.21.15.79:0/3927547262 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e380053a0 con 0x562d13eee950 2024-04-25T02:15:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.419+0000 7f8e25ffb640 1 -- 172.21.15.79:0/3927547262 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e38007260 con 0x562d13eee950 2024-04-25T02:15:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.420+0000 7f8e49ba6740 1 -- 172.21.15.79:0/3927547262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13eee950 msgr2=0x562d13edfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.420+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/3927547262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13eee950 0x562d13edfa90 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f8e38007fd0 tx=0x7f8e3800f000 comp rx=0 tx=0).stop 2024-04-25T02:15:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.420+0000 7f8e49ba6740 1 -- 172.21.15.79:0/3927547262 shutdown_connections 2024-04-25T02:15:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.420+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/3927547262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13eee950 0x562d13edfa90 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.420+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/3927547262 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13edcd40 0x562d13f1ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.420+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/3927547262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13eb2280 0x562d13ea8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.420+0000 7f8e49ba6740 1 -- 172.21.15.79:0/3927547262 >> 172.21.15.79:0/3927547262 conn(0x562d13e79950 msgr2=0x562d13ef3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.420+0000 7f8e49ba6740 1 -- 172.21.15.79:0/3927547262 shutdown_connections 2024-04-25T02:15:11.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.420+0000 7f8e49ba6740 1 -- 172.21.15.79:0/3927547262 wait complete. 2024-04-25T02:15:11.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.420+0000 7f8e49ba6740 1 -- start start 2024-04-25T02:15:11.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.421+0000 7f8e49ba6740 1 Processor -- start 2024-04-25T02:15:11.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.421+0000 7f8e49ba6740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eb2280 0x562d13f75bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.421+0000 7f8e49ba6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13edcd40 0x562d13eed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.421+0000 7f8e49ba6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13eee950 0x562d13ef1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.421+0000 7f8e49ba6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4009d900 con 0x562d13eee950 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.421+0000 7f8e49ba6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562d13f118c0 con 0x562d13edcd40 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.421+0000 7f8e49ba6740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x562d13eee2e0 con 0x562d13eb2280 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.421+0000 7f8e49ba6740 10 client.0 _ll_register_callbacks cb 0x7f8e30035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.421+0000 7f8e45437640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13eee950 0x562d13ef1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.421+0000 7f8e45437640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13eee950 0x562d13ef1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33348/0 (socket says 172.21.15.79:33348) 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.421+0000 7f8e45437640 1 -- 172.21.15.79:0/2335506615 learned_addr learned my addr 172.21.15.79:0/2335506615 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.421+0000 7f8e37fff640 1 --2- 172.21.15.79:0/2335506615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13edcd40 0x562d13eed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.421+0000 7f8e44c36640 1 --2- 172.21.15.79:0/2335506615 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eb2280 0x562d13f75bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e45437640 1 -- 172.21.15.79:0/2335506615 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eb2280 msgr2=0x562d13f75bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e45437640 1 --2- 172.21.15.79:0/2335506615 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eb2280 0x562d13f75bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e45437640 1 -- 172.21.15.79:0/2335506615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13edcd40 msgr2=0x562d13eed6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e45437640 1 --2- 172.21.15.79:0/2335506615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13edcd40 0x562d13eed6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e45437640 1 -- 172.21.15.79:0/2335506615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d13ae9170 con 0x562d13eee950 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e37fff640 1 --2- 172.21.15.79:0/2335506615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13edcd40 0x562d13eed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e45437640 1 --2- 172.21.15.79:0/2335506615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13eee950 0x562d13ef1f30 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f8e38001af0 tx=0x7f8e38001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867aa63da287dbc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:11.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:15:11.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e1f7fe640 1 -- 172.21.15.79:0/2335506615 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3802c020 con 0x562d13eee950 2024-04-25T02:15:11.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e1f7fe640 1 -- 172.21.15.79:0/2335506615 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f8e38007230 con 0x562d13eee950 2024-04-25T02:15:11.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e49ba6740 1 -- 172.21.15.79:0/2335506615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e380053a0 con 0x562d13eee950 2024-04-25T02:15:11.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e1f7fe640 1 -- 172.21.15.79:0/2335506615 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f8e38036050 con 0x562d13eee950 2024-04-25T02:15:11.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e49ba6740 10 client.8010 fetch_fsmap learned FSMap version 61 2024-04-25T02:15:11.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e49ba6740 1 -- 172.21.15.79:0/2335506615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x562d13eee020 con 0x562d13eee950 2024-04-25T02:15:11.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e1f7fe640 1 -- 172.21.15.79:0/2335506615 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e380053a0 con 0x562d13eee950 2024-04-25T02:15:11.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e1f7fe640 1 -- 172.21.15.79:0/2335506615 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f8e38039020 con 0x562d13eee950 2024-04-25T02:15:11.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e49ba6740 10 client.8010 fetch_fsmap finished waiting for FSMap version 61 2024-04-25T02:15:11.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e49ba6740 10 client.8010 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:15:11.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e49ba6740 20 client.8010 populate_metadata read hostname 'smithi079' 2024-04-25T02:15:11.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/2335506615 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x562d13eedc10 0x562d13ef2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e49ba6740 4 client.8010 mds_command: new command op to 7896 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-25T02:15:11.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e49ba6740 1 -- 172.21.15.79:0/2335506615 --> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) -- 0x562d13e22800 con 0x562d13eedc10 2024-04-25T02:15:11.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.422+0000 7f8e44c36640 1 --2- 172.21.15.79:0/2335506615 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x562d13eedc10 0x562d13ef2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.423+0000 7f8e1f7fe640 10 client.8010 ms_handle_connect on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:11.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.423+0000 7f8e44c36640 1 --2- 172.21.15.79:0/2335506615 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x562d13eedc10 0x562d13ef2470 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8475c932903bbe3 server_cookie=e55d89742a63d4f0 in_seq=0 out_seq=0 2024-04-25T02:15:11.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.423+0000 7f8e1f7fe640 1 -- 172.21.15.79:0/2335506615 <== mds.0 v2:172.21.15.79:6836/1474949173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562d13e22800 con 0x562d13eedc10 2024-04-25T02:15:11.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.423+0000 7f8e1f7fe640 10 client.8010 handle_command_reply: tid=0 2024-04-25T02:15:11.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.423+0000 7f8e49ba6740 1 client.8010 shutdown 2024-04-25T02:15:11.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.423+0000 7f8e49ba6740 1 -- 172.21.15.79:0/2335506615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13eee950 msgr2=0x562d13ef1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.423+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/2335506615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13eee950 0x562d13ef1f30 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f8e38001af0 tx=0x7f8e38001090 comp rx=0 tx=0).stop 2024-04-25T02:15:11.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.423+0000 7f8e49ba6740 1 -- 172.21.15.79:0/2335506615 shutdown_connections 2024-04-25T02:15:11.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.423+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/2335506615 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x562d13eedc10 0x562d13ef2470 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.423+0000 7f8e1f7fe640 0 client.8010 ms_handle_reset on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:11.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.423+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/2335506615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d13eee950 0x562d13ef1f30 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.423+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/2335506615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d13edcd40 0x562d13eed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.423+0000 7f8e49ba6740 1 --2- 172.21.15.79:0/2335506615 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562d13eb2280 0x562d13f75bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.423+0000 7f8e49ba6740 1 -- 172.21.15.79:0/2335506615 >> 172.21.15.79:0/2335506615 conn(0x562d13e79950 msgr2=0x562d13ef3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:11.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.424+0000 7f8e49ba6740 1 -- 172.21.15.79:0/2335506615 shutdown_connections 2024-04-25T02:15:11.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.424+0000 7f8e49ba6740 1 -- 172.21.15.79:0/2335506615 wait complete. 2024-04-25T02:15:11.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.424+0000 7f8e49ba6740 20 client.8010 trim_cache size 0 max 16384 2024-04-25T02:15:11.436 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:15:11.436 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-04-25T02:15:11.436 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "c8bfed9f-4963-47b5-beb5-3157b6a1097b", 2024-04-25T02:15:11.436 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-04-25T02:15:11.436 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:15:11.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.424+0000 7f8e46e9a640 1 -- 172.21.15.79:0/654607549 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8e2c06be30 msgr2=0x7f8e2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.424+0000 7f8e46e9a640 1 --2- 172.21.15.79:0/654607549 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8e2c06be30 0x7f8e2c06e2f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8e30034000 tx=0x7f8e3002c000 comp rx=0 tx=0).stop 2024-04-25T02:15:11.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.424+0000 7f8e46e9a640 1 -- 172.21.15.79:0/654607549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e400d25a0 msgr2=0x7f8e400c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.424+0000 7f8e46e9a640 1 --2- 172.21.15.79:0/654607549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e400d25a0 0x7f8e400c7dd0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00c890 tx=0x7f8e3c00cd50 comp rx=0 tx=0).stop 2024-04-25T02:15:11.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.424+0000 7f8e46e9a640 1 -- 172.21.15.79:0/654607549 shutdown_connections 2024-04-25T02:15:11.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.424+0000 7f8e46e9a640 1 --2- 172.21.15.79:0/654607549 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8e2c06be30 0x7f8e2c06e2f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.424+0000 7f8e46e9a640 1 --2- 172.21.15.79:0/654607549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e4015c180 0x7f8e400cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.424+0000 7f8e46e9a640 1 --2- 172.21.15.79:0/654607549 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8e400d2b10 0x7f8e4009ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.424+0000 7f8e46e9a640 1 --2- 172.21.15.79:0/654607549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e400d25a0 0x7f8e400c7dd0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.424+0000 7f8e46e9a640 1 -- 172.21.15.79:0/654607549 >> 172.21.15.79:0/654607549 conn(0x7f8e4009aa70 msgr2=0x7f8e4015f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:11.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.424+0000 7f8e46e9a640 1 -- 172.21.15.79:0/654607549 shutdown_connections 2024-04-25T02:15:11.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.424+0000 7f8e46e9a640 1 -- 172.21.15.79:0/654607549 wait complete. 2024-04-25T02:15:11.438 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-04-25T02:15:11.425+0000 7fef4ee2e640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() | dirtyparent=1 authpin=1 scrubqueue=0 0x559eedad1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(13)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(13)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:15:11.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:15:11.440 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T02:15:11.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.538+0000 7f6c83dc1640 1 Processor -- start 2024-04-25T02:15:11.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.538+0000 7f6c83dc1640 1 -- start start 2024-04-25T02:15:11.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.539+0000 7f6c83dc1640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6c7c0cf7a0 0x7f6c7c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.539+0000 7f6c83dc1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c7c15ec20 con 0x7f6c7c06b2f0 2024-04-25T02:15:11.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.539+0000 7f6c83dc1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c7c15ef00 con 0x7f6c7c06e6b0 2024-04-25T02:15:11.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.539+0000 7f6c83dc1640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6c7c15f830 con 0x7f6c7c0cf7a0 2024-04-25T02:15:11.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.539+0000 7f6c81b5d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6c7c06b2f0 0x7f6c7c06b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48150/0 (socket says 172.21.15.79:48150) 2024-04-25T02:15:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.539+0000 7f6c81b5d640 1 -- 172.21.15.79:0/3423340246 learned_addr learned my addr 172.21.15.79:0/3423340246 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.539+0000 7f6c80b5b640 1 -- 172.21.15.79:0/3423340246 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1110272184 0 0) 0x7f6c7c15ec20 con 0x7f6c7c06b2f0 2024-04-25T02:15:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.539+0000 7f6c80b5b640 1 -- 172.21.15.79:0/3423340246 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c68003520 con 0x7f6c7c06b2f0 2024-04-25T02:15:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.539+0000 7f6c8135c640 1 --2- 172.21.15.79:0/3423340246 >> v2:172.21.15.189:3300/0 conn(0x7f6c7c0cf7a0 0x7f6c7c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.539+0000 7f6c80b5b640 1 -- 172.21.15.79:0/3423340246 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3086128310 0 0) 0x7f6c68003520 con 0x7f6c7c06b2f0 2024-04-25T02:15:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.539+0000 7f6c80b5b640 1 -- 172.21.15.79:0/3423340246 >> v2:172.21.15.189:3300/0 conn(0x7f6c7c0cf7a0 msgr2=0x7f6c7c0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.539+0000 7f6c80b5b640 1 --2- 172.21.15.79:0/3423340246 >> v2:172.21.15.189:3300/0 conn(0x7f6c7c0cf7a0 0x7f6c7c0b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.539+0000 7f6c80b5b640 1 -- 172.21.15.79:0/3423340246 >> v1:172.21.15.189:6789/0 conn(0x7f6c7c06e6b0 legacy=0x7f6c7c15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.539+0000 7f6c80b5b640 1 -- 172.21.15.79:0/3423340246 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7c15f1e0 con 0x7f6c7c06b2f0 2024-04-25T02:15:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.539+0000 7f6c80b5b640 1 -- 172.21.15.79:0/3423340246 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f6c78001670 con 0x7f6c7c06b2f0 2024-04-25T02:15:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c80b5b640 1 -- 172.21.15.79:0/3423340246 >> v1:172.21.15.79:6789/0 conn(0x7f6c7c06b2f0 legacy=0x7f6c7c06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c80b5b640 1 --2- 172.21.15.79:0/3423340246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c680039b0 0x7f6c68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c80b5b640 1 --2- 172.21.15.79:0/3423340246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c68004800 0x7f6c68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c80b5b640 1 --2- 172.21.15.79:0/3423340246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c680051c0 0x7f6c6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c80b5b640 1 -- 172.21.15.79:0/3423340246 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c15f830 con 0x7f6c68004800 2024-04-25T02:15:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c80b5b640 1 -- 172.21.15.79:0/3423340246 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6800c160 con 0x7f6c680051c0 2024-04-25T02:15:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c80b5b640 1 -- 172.21.15.79:0/3423340246 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6800c360 con 0x7f6c680039b0 2024-04-25T02:15:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c8135c640 1 --2- 172.21.15.79:0/3423340246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c68004800 0x7f6c68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c81b5d640 1 --2- 172.21.15.79:0/3423340246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c680039b0 0x7f6c68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c8235e640 1 --2- 172.21.15.79:0/3423340246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c680051c0 0x7f6c6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c8135c640 1 -- 172.21.15.79:0/3423340246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c680039b0 msgr2=0x7f6c68003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c8135c640 1 --2- 172.21.15.79:0/3423340246 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c680039b0 0x7f6c68003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c8135c640 1 -- 172.21.15.79:0/3423340246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c680051c0 msgr2=0x7f6c6800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c8135c640 1 --2- 172.21.15.79:0/3423340246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c680051c0 0x7f6c6800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c8135c640 1 -- 172.21.15.79:0/3423340246 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c68003520 con 0x7f6c68004800 2024-04-25T02:15:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c8235e640 1 --2- 172.21.15.79:0/3423340246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c680051c0 0x7f6c6800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.540+0000 7f6c8235e640 1 -- 172.21.15.79:0/3423340246 reap_dead start 2024-04-25T02:15:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.541+0000 7f6c8135c640 1 --2- 172.21.15.79:0/3423340246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c68004800 0x7f6c68004c80 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009ac0 tx=0x7f6c68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7501739d9096c44a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.541+0000 7f6c80b5b640 1 -- 172.21.15.79:0/3423340246 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c036070 con 0x7f6c68004800 2024-04-25T02:15:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.541+0000 7f6c80b5b640 1 -- 172.21.15.79:0/3423340246 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c6c031400 con 0x7f6c68004800 2024-04-25T02:15:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.541+0000 7f6c80b5b640 1 -- 172.21.15.79:0/3423340246 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c009690 con 0x7f6c68004800 2024-04-25T02:15:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.541+0000 7f6c83dc1640 1 -- 172.21.15.79:0/3423340246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c68004800 msgr2=0x7f6c68004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.541+0000 7f6c83dc1640 1 --2- 172.21.15.79:0/3423340246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c68004800 0x7f6c68004c80 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009ac0 tx=0x7f6c68005830 comp rx=0 tx=0).stop 2024-04-25T02:15:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.541+0000 7f6c83dc1640 1 -- 172.21.15.79:0/3423340246 shutdown_connections 2024-04-25T02:15:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.541+0000 7f6c83dc1640 1 --2- 172.21.15.79:0/3423340246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c68004800 0x7f6c68004c80 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.541+0000 7f6c83dc1640 1 -- 172.21.15.79:0/3423340246 >> 172.21.15.79:0/3423340246 conn(0x7f6c7c0b1cd0 msgr2=0x7f6c7c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:11.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.541+0000 7f6c83dc1640 1 -- 172.21.15.79:0/3423340246 shutdown_connections 2024-04-25T02:15:11.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.541+0000 7f6c83dc1640 1 -- 172.21.15.79:0/3423340246 wait complete. 2024-04-25T02:15:11.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.542+0000 7f6c83dc1640 1 Processor -- start 2024-04-25T02:15:11.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.543+0000 7f6c83dc1640 1 -- start start 2024-04-25T02:15:11.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.543+0000 7f6c83dc1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c68004800 0x7f6c7c1486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.543+0000 7f6c83dc1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c7c072510 0x7f6c7c072990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.543+0000 7f6c83dc1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c7c15c4b0 0x7f6c7c15c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.543+0000 7f6c83dc1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c06d160 con 0x7f6c68004800 2024-04-25T02:15:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.543+0000 7f6c83dc1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c06cfe0 con 0x7f6c7c072510 2024-04-25T02:15:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.543+0000 7f6c83dc1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7c0b4b50 con 0x7f6c7c15c4b0 2024-04-25T02:15:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.543+0000 7f6c81b5d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c68004800 0x7f6c7c1486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.543+0000 7f6c81b5d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c68004800 0x7f6c7c1486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33370/0 (socket says 172.21.15.79:33370) 2024-04-25T02:15:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.543+0000 7f6c81b5d640 1 -- 172.21.15.79:0/1062554387 learned_addr learned my addr 172.21.15.79:0/1062554387 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.544+0000 7f6c81b5d640 1 -- 172.21.15.79:0/1062554387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c7c15c4b0 msgr2=0x7f6c7c15c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.544+0000 7f6c81b5d640 1 --2- 172.21.15.79:0/1062554387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c7c15c4b0 0x7f6c7c15c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.544+0000 7f6c81b5d640 1 -- 172.21.15.79:0/1062554387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c7c072510 msgr2=0x7f6c7c072990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.544+0000 7f6c81b5d640 1 --2- 172.21.15.79:0/1062554387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c7c072510 0x7f6c7c072990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.544+0000 7f6c81b5d640 1 -- 172.21.15.79:0/1062554387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7c148c30 con 0x7f6c68004800 2024-04-25T02:15:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.544+0000 7f6c81b5d640 1 --2- 172.21.15.79:0/1062554387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c68004800 0x7f6c7c1486f0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f6c780072f0 tx=0x7f6c780077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.544+0000 7f6c727fc640 1 -- 172.21.15.79:0/1062554387 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7801a070 con 0x7f6c68004800 2024-04-25T02:15:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.544+0000 7f6c727fc640 1 -- 172.21.15.79:0/1062554387 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c7800f940 con 0x7f6c68004800 2024-04-25T02:15:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.544+0000 7f6c727fc640 1 -- 172.21.15.79:0/1062554387 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7800fd30 con 0x7f6c68004800 2024-04-25T02:15:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.544+0000 7f6c83dc1640 1 -- 172.21.15.79:0/1062554387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7c09ac10 con 0x7f6c68004800 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.544+0000 7f6c83dc1640 1 -- 172.21.15.79:0/1062554387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7c09b1d0 con 0x7f6c68004800 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.545+0000 7f6c727fc640 1 -- 172.21.15.79:0/1062554387 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c7801d070 con 0x7f6c68004800 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.546+0000 7f6c727fc640 1 --2- 172.21.15.79:0/1062554387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6c6006be60 0x7f6c6006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.546+0000 7f6c8135c640 1 --2- 172.21.15.79:0/1062554387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6c6006be60 0x7f6c6006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.546+0000 7f6c727fc640 1 -- 172.21.15.79:0/1062554387 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f6c7808a970 con 0x7f6c68004800 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.546+0000 7f6c8135c640 1 --2- 172.21.15.79:0/1062554387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6c6006be60 0x7f6c6006e320 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c033000 tx=0x7f6c6c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.547+0000 7f6c86bae740 1 Processor -- start 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.547+0000 7f6c86bae740 1 -- start start 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.547+0000 7f6c86bae740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd5310 0x55cde5bad970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.547+0000 7f6c86bae740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bd56f0 0x55cde5bd7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.547+0000 7f6c86bae740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bd80b0 0x55cde5bab910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.547+0000 7f6c86bae740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cde5b116b0 con 0x55cde5bd80b0 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.547+0000 7f6c86bae740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cde5ab9880 con 0x55cde5bd5310 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.547+0000 7f6c86bae740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55cde5b0d670 con 0x55cde5bd56f0 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.548+0000 7f6c8235e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bd80b0 0x55cde5bab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.548+0000 7f6c8235e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bd80b0 0x55cde5bab910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33372/0 (socket says 172.21.15.79:33372) 2024-04-25T02:15:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.548+0000 7f6c8235e640 1 -- 172.21.15.79:0/3827561063 learned_addr learned my addr 172.21.15.79:0/3827561063 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.548+0000 7f6c81b5d640 1 --2- 172.21.15.79:0/3827561063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd5310 0x55cde5bad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.548+0000 7f6c8135c640 1 --2- 172.21.15.79:0/3827561063 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bd56f0 0x55cde5bd7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.548+0000 7f6c8235e640 1 -- 172.21.15.79:0/3827561063 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bd56f0 msgr2=0x55cde5bd7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.548+0000 7f6c8235e640 1 --2- 172.21.15.79:0/3827561063 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bd56f0 0x55cde5bd7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.548+0000 7f6c8235e640 1 -- 172.21.15.79:0/3827561063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd5310 msgr2=0x55cde5bad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.548+0000 7f6c8235e640 1 --2- 172.21.15.79:0/3827561063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd5310 0x55cde5bad970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.548+0000 7f6c8235e640 1 -- 172.21.15.79:0/3827561063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cde58ef7d0 con 0x55cde5bd80b0 2024-04-25T02:15:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.548+0000 7f6c8235e640 1 --2- 172.21.15.79:0/3827561063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bd80b0 0x55cde5bab910 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c09e0f0 tx=0x7f6c74001f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4099ae3f5097e412 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.548+0000 7f6c5f7fe640 1 -- 172.21.15.79:0/3827561063 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c74003d80 con 0x55cde5bd80b0 2024-04-25T02:15:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.548+0000 7f6c5f7fe640 1 -- 172.21.15.79:0/3827561063 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c74017070 con 0x55cde5bd80b0 2024-04-25T02:15:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.548+0000 7f6c5f7fe640 1 -- 172.21.15.79:0/3827561063 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7400ea90 con 0x55cde5bd80b0 2024-04-25T02:15:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.549+0000 7f6c86bae740 1 -- 172.21.15.79:0/3827561063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bd80b0 msgr2=0x55cde5bab910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.549+0000 7f6c86bae740 1 --2- 172.21.15.79:0/3827561063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bd80b0 0x55cde5bab910 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c09e0f0 tx=0x7f6c74001f80 comp rx=0 tx=0).stop 2024-04-25T02:15:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.549+0000 7f6c86bae740 1 -- 172.21.15.79:0/3827561063 shutdown_connections 2024-04-25T02:15:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.549+0000 7f6c86bae740 1 --2- 172.21.15.79:0/3827561063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bd80b0 0x55cde5bab910 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.549+0000 7f6c86bae740 1 --2- 172.21.15.79:0/3827561063 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bd56f0 0x55cde5bd7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.549+0000 7f6c86bae740 1 --2- 172.21.15.79:0/3827561063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd5310 0x55cde5bad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.549+0000 7f6c86bae740 1 -- 172.21.15.79:0/3827561063 >> 172.21.15.79:0/3827561063 conn(0x55cde5baa600 msgr2=0x55cde5bf2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.549+0000 7f6c86bae740 1 -- 172.21.15.79:0/3827561063 shutdown_connections 2024-04-25T02:15:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.549+0000 7f6c86bae740 1 -- 172.21.15.79:0/3827561063 wait complete. 2024-04-25T02:15:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.549+0000 7f6c86bae740 1 -- start start 2024-04-25T02:15:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.550+0000 7f6c86bae740 1 Processor -- start 2024-04-25T02:15:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.550+0000 7f6c86bae740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 0x55cde5be9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.550+0000 7f6c86bae740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bd80b0 0x55cde5bf1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.550+0000 7f6c86bae740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bf1bc0 0x55cde5bda250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.550+0000 7f6c86bae740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cde5accf50 con 0x55cde5bf1bc0 2024-04-25T02:15:11.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.550+0000 7f6c86bae740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cde5bf0870 con 0x55cde5bd56f0 2024-04-25T02:15:11.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.550+0000 7f6c86bae740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55cde5bdb590 con 0x55cde5bd80b0 2024-04-25T02:15:11.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c86bae740 10 client.0 _ll_register_callbacks cb 0x55cde5b08000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:15:11.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c8235e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bf1bc0 0x55cde5bda250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c8235e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bf1bc0 0x55cde5bda250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33374/0 (socket says 172.21.15.79:33374) 2024-04-25T02:15:11.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c8235e640 1 -- 172.21.15.79:0/4069908949 learned_addr learned my addr 172.21.15.79:0/4069908949 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:11.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c81b5d640 1 --2- 172.21.15.79:0/4069908949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 0x55cde5be9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c8135c640 1 --2- 172.21.15.79:0/4069908949 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bd80b0 0x55cde5bf1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c8235e640 1 -- 172.21.15.79:0/4069908949 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bd80b0 msgr2=0x55cde5bf1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c8235e640 1 --2- 172.21.15.79:0/4069908949 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bd80b0 0x55cde5bf1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c8235e640 1 -- 172.21.15.79:0/4069908949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 msgr2=0x55cde5be9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c8235e640 1 --2- 172.21.15.79:0/4069908949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 0x55cde5be9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c8235e640 1 -- 172.21.15.79:0/4069908949 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cde58253f0 con 0x55cde5bf1bc0 2024-04-25T02:15:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c8235e640 1 --2- 172.21.15.79:0/4069908949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bf1bc0 0x55cde5bda250 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400e6c0 tx=0x7f6c74000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61e907e88c9ec30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:15:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c5cff9640 1 -- 172.21.15.79:0/4069908949 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7400e850 con 0x55cde5bf1bc0 2024-04-25T02:15:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c5cff9640 1 -- 172.21.15.79:0/4069908949 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f6c7400e9f0 con 0x55cde5bf1bc0 2024-04-25T02:15:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c86bae740 1 -- 172.21.15.79:0/4069908949 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c74017070 con 0x55cde5bf1bc0 2024-04-25T02:15:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c5cff9640 1 -- 172.21.15.79:0/4069908949 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f6c7402f050 con 0x55cde5bf1bc0 2024-04-25T02:15:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c86bae740 10 client.8022 fetch_fsmap learned FSMap version 61 2024-04-25T02:15:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c86bae740 1 -- 172.21.15.79:0/4069908949 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55cde57e50f0 con 0x55cde5bf1bc0 2024-04-25T02:15:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.551+0000 7f6c5cff9640 1 -- 172.21.15.79:0/4069908949 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c74017070 con 0x55cde5bf1bc0 2024-04-25T02:15:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.552+0000 7f6c5cff9640 1 -- 172.21.15.79:0/4069908949 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f6c74032020 con 0x55cde5bf1bc0 2024-04-25T02:15:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.552+0000 7f6c86bae740 10 client.8022 fetch_fsmap finished waiting for FSMap version 61 2024-04-25T02:15:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.552+0000 7f6c86bae740 10 client.8022 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:15:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.552+0000 7f6c86bae740 20 client.8022 populate_metadata read hostname 'smithi079' 2024-04-25T02:15:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.552+0000 7f6c86bae740 1 --2- 172.21.15.79:0/4069908949 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55cde5c12c50 0x55cde5c15040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.552+0000 7f6c86bae740 4 client.8022 mds_command: new command op to 7896 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:15:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.552+0000 7f6c86bae740 1 -- 172.21.15.79:0/4069908949 --> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cde5b1ebf0 con 0x55cde5c12c50 2024-04-25T02:15:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.552+0000 7f6c81b5d640 1 --2- 172.21.15.79:0/4069908949 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55cde5c12c50 0x55cde5c15040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.552+0000 7f6c5cff9640 10 client.8022 ms_handle_connect on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.552+0000 7f6c81b5d640 1 --2- 172.21.15.79:0/4069908949 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55cde5c12c50 0x55cde5c15040 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f470993e471efb4 server_cookie=e739f1d87d857166 in_seq=0 out_seq=0 2024-04-25T02:15:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.553+0000 7f6c5cff9640 1 -- 172.21.15.79:0/4069908949 <== mds.0 v2:172.21.15.79:6836/1474949173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cde5b1ebf0 con 0x55cde5c12c50 2024-04-25T02:15:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.553+0000 7f6c5cff9640 10 client.8022 handle_command_reply: tid=0 2024-04-25T02:15:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.553+0000 7f6c86bae740 1 client.8022 shutdown 2024-04-25T02:15:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.553+0000 7f6c86bae740 1 -- 172.21.15.79:0/4069908949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bf1bc0 msgr2=0x55cde5bda250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.553+0000 7f6c86bae740 1 --2- 172.21.15.79:0/4069908949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bf1bc0 0x55cde5bda250 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400e6c0 tx=0x7f6c74000f40 comp rx=0 tx=0).stop 2024-04-25T02:15:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.553+0000 7f6c86bae740 1 -- 172.21.15.79:0/4069908949 shutdown_connections 2024-04-25T02:15:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.553+0000 7f6c86bae740 1 --2- 172.21.15.79:0/4069908949 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55cde5c12c50 0x55cde5c15040 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.553+0000 7f6c86bae740 1 --2- 172.21.15.79:0/4069908949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bf1bc0 0x55cde5bda250 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.553+0000 7f6c86bae740 1 --2- 172.21.15.79:0/4069908949 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bd80b0 0x55cde5bf1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.553+0000 7f6c5cff9640 0 client.8022 ms_handle_reset on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.553+0000 7f6c86bae740 1 --2- 172.21.15.79:0/4069908949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 0x55cde5be9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.553+0000 7f6c86bae740 1 -- 172.21.15.79:0/4069908949 >> 172.21.15.79:0/4069908949 conn(0x55cde5bd5310 msgr2=0x55cde5bd84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.553+0000 7f6c86bae740 1 -- 172.21.15.79:0/4069908949 shutdown_connections 2024-04-25T02:15:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.553+0000 7f6c86bae740 1 -- 172.21.15.79:0/4069908949 wait complete. 2024-04-25T02:15:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.553+0000 7f6c86bae740 20 client.8022 trim_cache size 0 max 16384 2024-04-25T02:15:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.570+0000 7f6c86bae740 1 Processor -- start 2024-04-25T02:15:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.570+0000 7f6c86bae740 1 -- start start 2024-04-25T02:15:11.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.571+0000 7f6c86bae740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 0x55cde5c18260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.571+0000 7f6c86bae740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bd80b0 0x55cde5bf5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.571+0000 7f6c86bae740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bf1bc0 0x55cde5bf6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.571+0000 7f6c86bae740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c1fcbc0 con 0x55cde5bf1bc0 2024-04-25T02:15:11.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.571+0000 7f6c86bae740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c1fbbf0 con 0x55cde5bd56f0 2024-04-25T02:15:11.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.571+0000 7f6c86bae740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7c1f0b50 con 0x55cde5bd80b0 2024-04-25T02:15:11.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.571+0000 7f6c81b5d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 0x55cde5c18260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.571+0000 7f6c8235e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bf1bc0 0x55cde5bf6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.571+0000 7f6c81b5d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 0x55cde5c18260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:54078/0 (socket says 172.21.15.79:54078) 2024-04-25T02:15:11.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.571+0000 7f6c81b5d640 1 -- 172.21.15.79:0/1484282225 learned_addr learned my addr 172.21.15.79:0/1484282225 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:11.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.571+0000 7f6c8135c640 1 --2- 172.21.15.79:0/1484282225 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bd80b0 0x55cde5bf5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.572+0000 7f6c8235e640 1 -- 172.21.15.79:0/1484282225 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bd80b0 msgr2=0x55cde5bf5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.572+0000 7f6c8235e640 1 --2- 172.21.15.79:0/1484282225 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bd80b0 0x55cde5bf5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.572+0000 7f6c8235e640 1 -- 172.21.15.79:0/1484282225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 msgr2=0x55cde5c18260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.572+0000 7f6c8235e640 1 --2- 172.21.15.79:0/1484282225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 0x55cde5c18260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.572+0000 7f6c8235e640 1 -- 172.21.15.79:0/1484282225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cde5b9a090 con 0x55cde5bf1bc0 2024-04-25T02:15:11.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.572+0000 7f6c8235e640 1 --2- 172.21.15.79:0/1484282225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bf1bc0 0x55cde5bf6430 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400e6c0 tx=0x7f6c74020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e808be138e12be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:11.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.572+0000 7f6c5effd640 1 -- 172.21.15.79:0/1484282225 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c74038070 con 0x55cde5bf1bc0 2024-04-25T02:15:11.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.572+0000 7f6c5effd640 1 -- 172.21.15.79:0/1484282225 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c74017070 con 0x55cde5bf1bc0 2024-04-25T02:15:11.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.572+0000 7f6c5effd640 1 -- 172.21.15.79:0/1484282225 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7400ea50 con 0x55cde5bf1bc0 2024-04-25T02:15:11.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.572+0000 7f6c86bae740 1 -- 172.21.15.79:0/1484282225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bf1bc0 msgr2=0x55cde5bf6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.572+0000 7f6c86bae740 1 --2- 172.21.15.79:0/1484282225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bf1bc0 0x55cde5bf6430 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400e6c0 tx=0x7f6c74020070 comp rx=0 tx=0).stop 2024-04-25T02:15:11.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.573+0000 7f6c86bae740 1 -- 172.21.15.79:0/1484282225 shutdown_connections 2024-04-25T02:15:11.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.573+0000 7f6c86bae740 1 --2- 172.21.15.79:0/1484282225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bf1bc0 0x55cde5bf6430 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.573+0000 7f6c86bae740 1 --2- 172.21.15.79:0/1484282225 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bd80b0 0x55cde5bf5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.573+0000 7f6c86bae740 1 --2- 172.21.15.79:0/1484282225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 0x55cde5c18260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.573+0000 7f6c86bae740 1 -- 172.21.15.79:0/1484282225 >> 172.21.15.79:0/1484282225 conn(0x55cde5bd5310 msgr2=0x55cde5bd8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:11.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.573+0000 7f6c86bae740 1 -- 172.21.15.79:0/1484282225 shutdown_connections 2024-04-25T02:15:11.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.573+0000 7f6c86bae740 1 -- 172.21.15.79:0/1484282225 wait complete. 2024-04-25T02:15:11.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.573+0000 7f6c86bae740 1 -- start start 2024-04-25T02:15:11.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.573+0000 7f6c86bae740 1 Processor -- start 2024-04-25T02:15:11.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c86bae740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 0x55cde5bdb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c86bae740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bd80b0 0x55cde5bdba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c86bae740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bf1bc0 0x55cde5ba7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c86bae740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cde5bf6b50 con 0x55cde5bd80b0 2024-04-25T02:15:11.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c86bae740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c1f11a0 con 0x55cde5bd56f0 2024-04-25T02:15:11.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c86bae740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55cde5bd9ab0 con 0x55cde5bf1bc0 2024-04-25T02:15:11.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c86bae740 10 client.0 _ll_register_callbacks cb 0x7f6c74001a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:15:11.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c8135c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bd80b0 0x55cde5bdba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c8135c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bd80b0 0x55cde5bdba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33392/0 (socket says 172.21.15.79:33392) 2024-04-25T02:15:11.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c8135c640 1 -- 172.21.15.79:0/1347038511 learned_addr learned my addr 172.21.15.79:0/1347038511 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:11.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c8235e640 1 --2- 172.21.15.79:0/1347038511 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bf1bc0 0x55cde5ba7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c81b5d640 1 --2- 172.21.15.79:0/1347038511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 0x55cde5bdb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c8135c640 1 -- 172.21.15.79:0/1347038511 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bf1bc0 msgr2=0x55cde5ba7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c8135c640 1 --2- 172.21.15.79:0/1347038511 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bf1bc0 0x55cde5ba7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c8135c640 1 -- 172.21.15.79:0/1347038511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 msgr2=0x55cde5bdb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:11.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c8135c640 1 --2- 172.21.15.79:0/1347038511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 0x55cde5bdb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.574+0000 7f6c8135c640 1 -- 172.21.15.79:0/1347038511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cde5bdabc0 con 0x55cde5bd80b0 2024-04-25T02:15:11.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c8135c640 1 --2- 172.21.15.79:0/1347038511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bd80b0 0x55cde5bdba90 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009be0 tx=0x7f6c6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6565b526db1ac0e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:11.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:15:11.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c5cff9640 1 -- 172.21.15.79:0/1347038511 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c04b660 con 0x55cde5bd80b0 2024-04-25T02:15:11.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c5cff9640 1 -- 172.21.15.79:0/1347038511 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f6c6c04b800 con 0x55cde5bd80b0 2024-04-25T02:15:11.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c86bae740 1 -- 172.21.15.79:0/1347038511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c74017070 con 0x55cde5bd80b0 2024-04-25T02:15:11.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c5cff9640 1 -- 172.21.15.79:0/1347038511 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f6c6c04ba00 con 0x55cde5bd80b0 2024-04-25T02:15:11.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c86bae740 10 client.8028 fetch_fsmap learned FSMap version 61 2024-04-25T02:15:11.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c86bae740 1 -- 172.21.15.79:0/1347038511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55cde5c71440 con 0x55cde5bd80b0 2024-04-25T02:15:11.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c5cff9640 1 -- 172.21.15.79:0/1347038511 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c74017070 con 0x55cde5bd80b0 2024-04-25T02:15:11.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c5cff9640 1 -- 172.21.15.79:0/1347038511 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f6c6c04bba0 con 0x55cde5bd80b0 2024-04-25T02:15:11.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c86bae740 10 client.8028 fetch_fsmap finished waiting for FSMap version 61 2024-04-25T02:15:11.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c86bae740 10 client.8028 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:15:11.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c86bae740 20 client.8028 populate_metadata read hostname 'smithi079' 2024-04-25T02:15:11.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c86bae740 1 --2- 172.21.15.79:0/1347038511 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55cde5bf6210 0x55cde5ba77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:11.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c86bae740 4 client.8028 mds_command: new command op to 7896 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:15:11.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c86bae740 1 -- 172.21.15.79:0/1347038511 --> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cde5b18f40 con 0x55cde5bf6210 2024-04-25T02:15:11.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c81b5d640 1 --2- 172.21.15.79:0/1347038511 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55cde5bf6210 0x55cde5ba77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:11.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.575+0000 7f6c5cff9640 10 client.8028 ms_handle_connect on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:11.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c81b5d640 1 --2- 172.21.15.79:0/1347038511 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55cde5bf6210 0x55cde5ba77a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e65b293dbc7822b3 server_cookie=96011ce46e1dacf6 in_seq=0 out_seq=0 2024-04-25T02:15:11.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c5cff9640 1 -- 172.21.15.79:0/1347038511 <== mds.0 v2:172.21.15.79:6836/1474949173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+263 (crc 0 0 0) 0x55cde5b18f40 con 0x55cde5bf6210 2024-04-25T02:15:11.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c5cff9640 10 client.8028 handle_command_reply: tid=0 2024-04-25T02:15:11.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c86bae740 1 client.8028 shutdown 2024-04-25T02:15:11.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c86bae740 1 -- 172.21.15.79:0/1347038511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bd80b0 msgr2=0x55cde5bdba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c86bae740 1 --2- 172.21.15.79:0/1347038511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bd80b0 0x55cde5bdba90 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009be0 tx=0x7f6c6c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c86bae740 1 -- 172.21.15.79:0/1347038511 shutdown_connections 2024-04-25T02:15:11.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c86bae740 1 --2- 172.21.15.79:0/1347038511 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55cde5bf6210 0x55cde5ba77a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c86bae740 1 --2- 172.21.15.79:0/1347038511 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55cde5bf1bc0 0x55cde5ba7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c86bae740 1 --2- 172.21.15.79:0/1347038511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cde5bd80b0 0x55cde5bdba90 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c5cff9640 0 client.8028 ms_handle_reset on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:11.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c86bae740 1 --2- 172.21.15.79:0/1347038511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cde5bd56f0 0x55cde5bdb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c86bae740 1 -- 172.21.15.79:0/1347038511 >> 172.21.15.79:0/1347038511 conn(0x55cde5bd5310 msgr2=0x55cde5bd8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:11.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c86bae740 1 -- 172.21.15.79:0/1347038511 shutdown_connections 2024-04-25T02:15:11.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c86bae740 1 -- 172.21.15.79:0/1347038511 wait complete. 2024-04-25T02:15:11.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.576+0000 7f6c86bae740 20 client.8028 trim_cache size 0 max 16384 2024-04-25T02:15:11.589 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:15:11.590 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T02:15:11.590 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-04-25T02:15:11.590 INFO:teuthology.orchestra.run.smithi079.stdout: "c8bfed9f-4963-47b5-beb5-3157b6a1097b": { 2024-04-25T02:15:11.590 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/dir", 2024-04-25T02:15:11.590 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "c8bfed9f-4963-47b5-beb5-3157b6a1097b", 2024-04-25T02:15:11.590 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,repair" 2024-04-25T02:15:11.590 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:11.590 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:11.590 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:15:11.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.577+0000 7f6c83dc1640 1 -- 172.21.15.79:0/1062554387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6c6006be60 msgr2=0x7f6c6006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.577+0000 7f6c83dc1640 1 --2- 172.21.15.79:0/1062554387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6c6006be60 0x7f6c6006e320 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c033000 tx=0x7f6c6c02e000 comp rx=0 tx=0).stop 2024-04-25T02:15:11.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.577+0000 7f6c83dc1640 1 -- 172.21.15.79:0/1062554387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c68004800 msgr2=0x7f6c7c1486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:11.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.577+0000 7f6c83dc1640 1 --2- 172.21.15.79:0/1062554387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c68004800 0x7f6c7c1486f0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f6c780072f0 tx=0x7f6c780077b0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.577+0000 7f6c83dc1640 1 -- 172.21.15.79:0/1062554387 shutdown_connections 2024-04-25T02:15:11.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.577+0000 7f6c83dc1640 1 --2- 172.21.15.79:0/1062554387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6c6006be60 0x7f6c6006e320 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.577+0000 7f6c83dc1640 1 --2- 172.21.15.79:0/1062554387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c7c15c4b0 0x7f6c7c15c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.577+0000 7f6c83dc1640 1 --2- 172.21.15.79:0/1062554387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c7c072510 0x7f6c7c072990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.577+0000 7f6c83dc1640 1 --2- 172.21.15.79:0/1062554387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c68004800 0x7f6c7c1486f0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:11.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.577+0000 7f6c83dc1640 1 -- 172.21.15.79:0/1062554387 >> 172.21.15.79:0/1062554387 conn(0x7f6c7c0b1cd0 msgr2=0x7f6c7c06b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:11.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.577+0000 7f6c83dc1640 1 -- 172.21.15.79:0/1062554387 shutdown_connections 2024-04-25T02:15:11.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:11.577+0000 7f6c83dc1640 1 -- 172.21.15.79:0/1062554387 wait complete. 2024-04-25T02:15:11.593 INFO:tasks.cephfs.filesystem:scrub status for tag:c8bfed9f-4963-47b5-beb5-3157b6a1097b - {'path': '/dir', 'tag': 'c8bfed9f-4963-47b5-beb5-3157b6a1097b', 'options': 'recursive,repair'} 2024-04-25T02:15:31.364 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:15:31.367 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:15:41.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:15:41.594 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T02:15:41.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.698+0000 7f07f3514640 1 Processor -- start 2024-04-25T02:15:41.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.699+0000 7f07f3514640 1 -- start start 2024-04-25T02:15:41.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.699+0000 7f07f3514640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f07ec15e4f0 0x7f07ec0d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.699+0000 7f07f3514640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f07ec0cf7f0 0x7f07ec0d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.699+0000 7f07f3514640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07ec0d1ee0 con 0x7f07ec0cfc50 2024-04-25T02:15:41.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.699+0000 7f07f3514640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f07ec0d21c0 con 0x7f07ec15e4f0 2024-04-25T02:15:41.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.699+0000 7f07f3514640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f07ec0d24a0 con 0x7f07ec0cf7f0 2024-04-25T02:15:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.700+0000 7f07f0aaf640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f07ec0cf7f0 0x7f07ec0d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.700+0000 7f07f12b0640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f07ec15e4f0 0x7f07ec0d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.700+0000 7f07f12b0640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f07ec15e4f0 0x7f07ec0d2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:43776/0 (socket says 172.21.15.79:43776) 2024-04-25T02:15:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.700+0000 7f07f0aaf640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f07ec0cf7f0 0x7f07ec0d09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:52454/0 (socket says 172.21.15.79:52454) 2024-04-25T02:15:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.700+0000 7f07f12b0640 1 -- 172.21.15.79:0/1607595860 learned_addr learned my addr 172.21.15.79:0/1607595860 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.700+0000 7f07f0aaf640 1 -- 172.21.15.79:0/1607595860 >> v2:172.21.15.189:3300/0 conn(0x7f07ec15e4f0 msgr2=0x7f07ec0d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.700+0000 7f07f0aaf640 1 --2- 172.21.15.79:0/1607595860 >> v2:172.21.15.189:3300/0 conn(0x7f07ec15e4f0 0x7f07ec0d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.700+0000 7f07f0aaf640 1 -- 172.21.15.79:0/1607595860 >> v1:172.21.15.189:6789/0 conn(0x7f07ec0cfc50 legacy=0x7f07ec06bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.700+0000 7f07f0aaf640 1 -- 172.21.15.79:0/1607595860 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ec0d2780 con 0x7f07ec0cf7f0 2024-04-25T02:15:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.700+0000 7f07f12b0640 1 --2- 172.21.15.79:0/1607595860 >> v2:172.21.15.189:3300/0 conn(0x7f07ec15e4f0 0x7f07ec0d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:15:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.701+0000 7f07f0aaf640 1 --2- 172.21.15.79:0/1607595860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f07ec0cf7f0 0x7f07ec0d09b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0097d0 tx=0x7f07dc02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5083828b91d27802 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.701+0000 7f07e3fff640 1 -- 172.21.15.79:0/1607595860 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc037070 con 0x7f07ec0cf7f0 2024-04-25T02:15:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.701+0000 7f07e3fff640 1 -- 172.21.15.79:0/1607595860 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07dc032440 con 0x7f07ec0cf7f0 2024-04-25T02:15:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.701+0000 7f07e3fff640 1 -- 172.21.15.79:0/1607595860 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc032810 con 0x7f07ec0cf7f0 2024-04-25T02:15:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.702+0000 7f07f3514640 1 -- 172.21.15.79:0/1607595860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f07ec0cf7f0 msgr2=0x7f07ec0d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.702+0000 7f07f3514640 1 --2- 172.21.15.79:0/1607595860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f07ec0cf7f0 0x7f07ec0d09b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0097d0 tx=0x7f07dc02a1c0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.702+0000 7f07f3514640 1 -- 172.21.15.79:0/1607595860 shutdown_connections 2024-04-25T02:15:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.702+0000 7f07f3514640 1 --2- 172.21.15.79:0/1607595860 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f07ec0cf7f0 0x7f07ec0d09b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.702+0000 7f07f3514640 1 --2- 172.21.15.79:0/1607595860 >> v2:172.21.15.189:3300/0 conn(0x7f07ec15e4f0 0x7f07ec0d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.702+0000 7f07f3514640 1 -- 172.21.15.79:0/1607595860 >> 172.21.15.79:0/1607595860 conn(0x7f07ec09d4a0 msgr2=0x7f07ec0d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.702+0000 7f07f3514640 1 -- 172.21.15.79:0/1607595860 shutdown_connections 2024-04-25T02:15:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.702+0000 7f07f3514640 1 -- 172.21.15.79:0/1607595860 wait complete. 2024-04-25T02:15:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.703+0000 7f07f3514640 1 Processor -- start 2024-04-25T02:15:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.703+0000 7f07f3514640 1 -- start start 2024-04-25T02:15:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f3514640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07ec0cf7f0 0x7f07ec1f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f3514640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f07ec0cfc50 0x7f07ec0c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f3514640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07ec15e4f0 0x7f07ec150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f3514640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec0d0ef0 con 0x7f07ec0cf7f0 2024-04-25T02:15:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f3514640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec0d50f0 con 0x7f07ec15e4f0 2024-04-25T02:15:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f3514640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f07ec0d1070 con 0x7f07ec0cfc50 2024-04-25T02:15:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f12b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07ec0cf7f0 0x7f07ec1f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f12b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07ec0cf7f0 0x7f07ec1f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57634/0 (socket says 172.21.15.79:57634) 2024-04-25T02:15:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f12b0640 1 -- 172.21.15.79:0/745178423 learned_addr learned my addr 172.21.15.79:0/745178423 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f0aaf640 1 --2- 172.21.15.79:0/745178423 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f07ec0cfc50 0x7f07ec0c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f1ab1640 1 --2- 172.21.15.79:0/745178423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07ec15e4f0 0x7f07ec150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f12b0640 1 -- 172.21.15.79:0/745178423 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f07ec0cfc50 msgr2=0x7f07ec0c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f12b0640 1 --2- 172.21.15.79:0/745178423 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f07ec0cfc50 0x7f07ec0c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f12b0640 1 -- 172.21.15.79:0/745178423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07ec15e4f0 msgr2=0x7f07ec150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f12b0640 1 --2- 172.21.15.79:0/745178423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07ec15e4f0 0x7f07ec150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f12b0640 1 -- 172.21.15.79:0/745178423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ec0c95d0 con 0x7f07ec0cf7f0 2024-04-25T02:15:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f12b0640 1 --2- 172.21.15.79:0/745178423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07ec0cf7f0 0x7f07ec1f4b90 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f07e800efc0 tx=0x7f07e800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07e1ffb640 1 -- 172.21.15.79:0/745178423 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e800ce60 con 0x7f07ec0cf7f0 2024-04-25T02:15:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07e1ffb640 1 -- 172.21.15.79:0/745178423 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e8019070 con 0x7f07ec0cf7f0 2024-04-25T02:15:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07f3514640 1 -- 172.21.15.79:0/745178423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07ec0c98b0 con 0x7f07ec0cf7f0 2024-04-25T02:15:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.704+0000 7f07e1ffb640 1 -- 172.21.15.79:0/745178423 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e8014680 con 0x7f07ec0cf7f0 2024-04-25T02:15:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.705+0000 7f07f3514640 1 -- 172.21.15.79:0/745178423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07ec0c9e70 con 0x7f07ec0cf7f0 2024-04-25T02:15:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.706+0000 7f07e1ffb640 1 -- 172.21.15.79:0/745178423 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f07e8005d10 con 0x7f07ec0cf7f0 2024-04-25T02:15:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.706+0000 7f07e1ffb640 1 --2- 172.21.15.79:0/745178423 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f07d006be30 0x7f07d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.706+0000 7f07e1ffb640 1 -- 172.21.15.79:0/745178423 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f07e808b2b0 con 0x7f07ec0cf7f0 2024-04-25T02:15:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.706+0000 7f07f0aaf640 1 --2- 172.21.15.79:0/745178423 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f07d006be30 0x7f07d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.707+0000 7f07f0aaf640 1 --2- 172.21.15.79:0/745178423 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f07d006be30 0x7f07d006e2f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f07dc034000 tx=0x7f07dc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.707+0000 7f07f6225740 1 Processor -- start 2024-04-25T02:15:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.708+0000 7f07f6225740 1 -- start start 2024-04-25T02:15:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.708+0000 7f07f6225740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc60d60 0x55c3ebc61140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.708+0000 7f07f6225740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc7e600 0x55c3ebc7eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.708+0000 7f07f6225740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc36a40 0x55c3ebc7ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.708+0000 7f07f6225740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c3ebb9a6b0 con 0x55c3ebc36a40 2024-04-25T02:15:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.708+0000 7f07f6225740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c3ebb42880 con 0x55c3ebc60d60 2024-04-25T02:15:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.708+0000 7f07f6225740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55c3ebb96670 con 0x55c3ebc7e600 2024-04-25T02:15:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.708+0000 7f07f1ab1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc36a40 0x55c3ebc7ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.708+0000 7f07f1ab1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc36a40 0x55c3ebc7ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57646/0 (socket says 172.21.15.79:57646) 2024-04-25T02:15:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.708+0000 7f07f1ab1640 1 -- 172.21.15.79:0/805933990 learned_addr learned my addr 172.21.15.79:0/805933990 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.709+0000 7f07f12b0640 1 --2- 172.21.15.79:0/805933990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc60d60 0x55c3ebc61140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.709+0000 7f07f0aaf640 1 --2- 172.21.15.79:0/805933990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc7e600 0x55c3ebc7eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.709+0000 7f07f1ab1640 1 -- 172.21.15.79:0/805933990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc7e600 msgr2=0x55c3ebc7eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.709+0000 7f07f1ab1640 1 --2- 172.21.15.79:0/805933990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc7e600 0x55c3ebc7eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.709+0000 7f07f1ab1640 1 -- 172.21.15.79:0/805933990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc60d60 msgr2=0x55c3ebc61140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.709+0000 7f07f1ab1640 1 --2- 172.21.15.79:0/805933990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc60d60 0x55c3ebc61140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.709+0000 7f07f1ab1640 1 -- 172.21.15.79:0/805933990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3eb9787d0 con 0x55c3ebc36a40 2024-04-25T02:15:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.709+0000 7f07f12b0640 1 --2- 172.21.15.79:0/805933990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc60d60 0x55c3ebc61140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.709+0000 7f07f1ab1640 1 --2- 172.21.15.79:0/805933990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc36a40 0x55c3ebc7ccc0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f07e40017f0 tx=0x7f07e4007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ed243b50175441 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.709+0000 7f07d6ffd640 1 -- 172.21.15.79:0/805933990 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e40052e0 con 0x55c3ebc36a40 2024-04-25T02:15:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.709+0000 7f07d6ffd640 1 -- 172.21.15.79:0/805933990 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e4018070 con 0x55c3ebc36a40 2024-04-25T02:15:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.709+0000 7f07d6ffd640 1 -- 172.21.15.79:0/805933990 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e400f9b0 con 0x55c3ebc36a40 2024-04-25T02:15:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.710+0000 7f07f6225740 1 -- 172.21.15.79:0/805933990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc36a40 msgr2=0x55c3ebc7ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.710+0000 7f07f6225740 1 --2- 172.21.15.79:0/805933990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc36a40 0x55c3ebc7ccc0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f07e40017f0 tx=0x7f07e4007db0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.710+0000 7f07f6225740 1 -- 172.21.15.79:0/805933990 shutdown_connections 2024-04-25T02:15:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.710+0000 7f07f6225740 1 --2- 172.21.15.79:0/805933990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc36a40 0x55c3ebc7ccc0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.710+0000 7f07f6225740 1 --2- 172.21.15.79:0/805933990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc7e600 0x55c3ebc7eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.710+0000 7f07f6225740 1 --2- 172.21.15.79:0/805933990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc60d60 0x55c3ebc61140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.710+0000 7f07f6225740 1 -- 172.21.15.79:0/805933990 >> 172.21.15.79:0/805933990 conn(0x55c3ebc33600 msgr2=0x55c3ebc7bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.710+0000 7f07f6225740 1 -- 172.21.15.79:0/805933990 shutdown_connections 2024-04-25T02:15:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.710+0000 7f07f6225740 1 -- 172.21.15.79:0/805933990 wait complete. 2024-04-25T02:15:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.710+0000 7f07f6225740 1 -- start start 2024-04-25T02:15:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.710+0000 7f07f6225740 1 Processor -- start 2024-04-25T02:15:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.711+0000 7f07f6225740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc60d60 0x55c3ebc5d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.711+0000 7f07f6225740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc7e600 0x55c3ebc74950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.711+0000 7f07f6225740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc8cba0 0x55c3ebc7caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.711+0000 7f07f6225740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c3ebc377e0 con 0x55c3ebc60d60 2024-04-25T02:15:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.711+0000 7f07f6225740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c3ebb55f50 con 0x55c3ebc8cba0 2024-04-25T02:15:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.711+0000 7f07f6225740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55c3ebc31530 con 0x55c3ebc7e600 2024-04-25T02:15:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.711+0000 7f07f6225740 10 client.0 _ll_register_callbacks cb 0x55c3ebb91000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:15:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.711+0000 7f07f12b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc60d60 0x55c3ebc5d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.711+0000 7f07f12b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc60d60 0x55c3ebc5d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57656/0 (socket says 172.21.15.79:57656) 2024-04-25T02:15:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.711+0000 7f07f12b0640 1 -- 172.21.15.79:0/1392099306 learned_addr learned my addr 172.21.15.79:0/1392099306 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.711+0000 7f07f1ab1640 1 --2- 172.21.15.79:0/1392099306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc8cba0 0x55c3ebc7caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.711+0000 7f07f0aaf640 1 --2- 172.21.15.79:0/1392099306 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc7e600 0x55c3ebc74950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f12b0640 1 -- 172.21.15.79:0/1392099306 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc7e600 msgr2=0x55c3ebc74950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f12b0640 1 --2- 172.21.15.79:0/1392099306 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc7e600 0x55c3ebc74950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f12b0640 1 -- 172.21.15.79:0/1392099306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc8cba0 msgr2=0x55c3ebc7caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f12b0640 1 --2- 172.21.15.79:0/1392099306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc8cba0 0x55c3ebc7caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f12b0640 1 -- 172.21.15.79:0/1392099306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3eb8ae3f0 con 0x55c3ebc60d60 2024-04-25T02:15:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f0aaf640 1 --2- 172.21.15.79:0/1392099306 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc7e600 0x55c3ebc74950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f12b0640 1 --2- 172.21.15.79:0/1392099306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc60d60 0x55c3ebc5d570 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f07e800c990 tx=0x7f07e8058f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46ea020a3eea758 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:15:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07cbfff640 1 -- 172.21.15.79:0/1392099306 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e8062070 con 0x55c3ebc60d60 2024-04-25T02:15:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07cbfff640 1 -- 172.21.15.79:0/1392099306 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f07e8089b30 con 0x55c3ebc60d60 2024-04-25T02:15:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f6225740 1 -- 172.21.15.79:0/1392099306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07e4018070 con 0x55c3ebc60d60 2024-04-25T02:15:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07cbfff640 1 -- 172.21.15.79:0/1392099306 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f07e8089d30 con 0x55c3ebc60d60 2024-04-25T02:15:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f6225740 10 client.8037 fetch_fsmap learned FSMap version 61 2024-04-25T02:15:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f6225740 1 -- 172.21.15.79:0/1392099306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55c3eb86e0f0 con 0x55c3ebc60d60 2024-04-25T02:15:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07cbfff640 1 -- 172.21.15.79:0/1392099306 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e4018070 con 0x55c3ebc60d60 2024-04-25T02:15:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07cbfff640 1 -- 172.21.15.79:0/1392099306 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f07e8058990 con 0x55c3ebc60d60 2024-04-25T02:15:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f6225740 10 client.8037 fetch_fsmap finished waiting for FSMap version 61 2024-04-25T02:15:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f6225740 10 client.8037 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:15:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f6225740 20 client.8037 populate_metadata read hostname 'smithi079' 2024-04-25T02:15:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f6225740 1 --2- 172.21.15.79:0/1392099306 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c3ebc72c20 0x55c3ebc73040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f6225740 4 client.8037 mds_command: new command op to 7896 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:15:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.712+0000 7f07f6225740 1 -- 172.21.15.79:0/1392099306 --> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3ebba7bf0 con 0x55c3ebc72c20 2024-04-25T02:15:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.713+0000 7f07f0aaf640 1 --2- 172.21.15.79:0/1392099306 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c3ebc72c20 0x55c3ebc73040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.713+0000 7f07cbfff640 10 client.8037 ms_handle_connect on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.713+0000 7f07f0aaf640 1 --2- 172.21.15.79:0/1392099306 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c3ebc72c20 0x55c3ebc73040 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bedc91dd0a69537f server_cookie=f08d609f6153557d in_seq=0 out_seq=0 2024-04-25T02:15:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.713+0000 7f07cbfff640 1 -- 172.21.15.79:0/1392099306 <== mds.0 v2:172.21.15.79:6836/1474949173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c3ebba7bf0 con 0x55c3ebc72c20 2024-04-25T02:15:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.713+0000 7f07cbfff640 10 client.8037 handle_command_reply: tid=0 2024-04-25T02:15:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.714+0000 7f07f6225740 1 client.8037 shutdown 2024-04-25T02:15:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.714+0000 7f07f6225740 1 -- 172.21.15.79:0/1392099306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc60d60 msgr2=0x55c3ebc5d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.714+0000 7f07f6225740 1 --2- 172.21.15.79:0/1392099306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc60d60 0x55c3ebc5d570 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f07e800c990 tx=0x7f07e8058f60 comp rx=0 tx=0).stop 2024-04-25T02:15:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.714+0000 7f07f6225740 1 -- 172.21.15.79:0/1392099306 shutdown_connections 2024-04-25T02:15:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.714+0000 7f07f6225740 1 --2- 172.21.15.79:0/1392099306 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c3ebc72c20 0x55c3ebc73040 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.714+0000 7f07f6225740 1 --2- 172.21.15.79:0/1392099306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc8cba0 0x55c3ebc7caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.714+0000 7f07f6225740 1 --2- 172.21.15.79:0/1392099306 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc7e600 0x55c3ebc74950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.714+0000 7f07cbfff640 0 client.8037 ms_handle_reset on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.714+0000 7f07f6225740 1 --2- 172.21.15.79:0/1392099306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc60d60 0x55c3ebc5d570 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.714+0000 7f07f6225740 1 -- 172.21.15.79:0/1392099306 >> 172.21.15.79:0/1392099306 conn(0x55c3ebc36a40 msgr2=0x55c3ebc7f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.714+0000 7f07f6225740 1 -- 172.21.15.79:0/1392099306 shutdown_connections 2024-04-25T02:15:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.714+0000 7f07f6225740 1 -- 172.21.15.79:0/1392099306 wait complete. 2024-04-25T02:15:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.714+0000 7f07f6225740 20 client.8037 trim_cache size 0 max 16384 2024-04-25T02:15:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.731+0000 7f07f6225740 1 Processor -- start 2024-04-25T02:15:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.731+0000 7f07f6225740 1 -- start start 2024-04-25T02:15:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f6225740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc60d60 0x55c3ebc37010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f6225740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc7e600 0x55c3ebc64560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f6225740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc8cba0 0x55c3ebc64aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f6225740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec200840 con 0x55c3ebc8cba0 2024-04-25T02:15:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f6225740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec1ffa50 con 0x55c3ebc7e600 2024-04-25T02:15:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f6225740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f07ec1f8310 con 0x55c3ebc60d60 2024-04-25T02:15:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f1ab1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc8cba0 0x55c3ebc64aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f1ab1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc8cba0 0x55c3ebc64aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57662/0 (socket says 172.21.15.79:57662) 2024-04-25T02:15:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f1ab1640 1 -- 172.21.15.79:0/2943762400 learned_addr learned my addr 172.21.15.79:0/2943762400 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f1ab1640 1 -- 172.21.15.79:0/2943762400 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc60d60 msgr2=0x55c3ebc37010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f1ab1640 1 --2- 172.21.15.79:0/2943762400 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc60d60 0x55c3ebc37010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f1ab1640 1 -- 172.21.15.79:0/2943762400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc7e600 msgr2=0x55c3ebc64560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f0aaf640 1 --2- 172.21.15.79:0/2943762400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc7e600 0x55c3ebc64560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f1ab1640 1 --2- 172.21.15.79:0/2943762400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc7e600 0x55c3ebc64560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f1ab1640 1 -- 172.21.15.79:0/2943762400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3ebc23090 con 0x55c3ebc8cba0 2024-04-25T02:15:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.732+0000 7f07f0aaf640 1 --2- 172.21.15.79:0/2943762400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc7e600 0x55c3ebc64560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.733+0000 7f07f1ab1640 1 --2- 172.21.15.79:0/2943762400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc8cba0 0x55c3ebc64aa0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f07e4000f60 tx=0x7f07e400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba049d7221e9e699 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.733+0000 7f07d67fc640 1 -- 172.21.15.79:0/2943762400 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e40067d0 con 0x55c3ebc8cba0 2024-04-25T02:15:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.733+0000 7f07d67fc640 1 -- 172.21.15.79:0/2943762400 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e4018040 con 0x55c3ebc8cba0 2024-04-25T02:15:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.733+0000 7f07d67fc640 1 -- 172.21.15.79:0/2943762400 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e4006b90 con 0x55c3ebc8cba0 2024-04-25T02:15:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.733+0000 7f07f6225740 1 -- 172.21.15.79:0/2943762400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc8cba0 msgr2=0x55c3ebc64aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.733+0000 7f07f6225740 1 --2- 172.21.15.79:0/2943762400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc8cba0 0x55c3ebc64aa0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f07e4000f60 tx=0x7f07e400a000 comp rx=0 tx=0).stop 2024-04-25T02:15:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.733+0000 7f07f6225740 1 -- 172.21.15.79:0/2943762400 shutdown_connections 2024-04-25T02:15:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.733+0000 7f07f6225740 1 --2- 172.21.15.79:0/2943762400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc8cba0 0x55c3ebc64aa0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.733+0000 7f07f6225740 1 --2- 172.21.15.79:0/2943762400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc7e600 0x55c3ebc64560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.733+0000 7f07f6225740 1 --2- 172.21.15.79:0/2943762400 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc60d60 0x55c3ebc37010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.733+0000 7f07f6225740 1 -- 172.21.15.79:0/2943762400 >> 172.21.15.79:0/2943762400 conn(0x55c3ebc36a40 msgr2=0x55c3ebc31860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:41.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.733+0000 7f07f6225740 1 -- 172.21.15.79:0/2943762400 shutdown_connections 2024-04-25T02:15:41.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.733+0000 7f07f6225740 1 -- 172.21.15.79:0/2943762400 wait complete. 2024-04-25T02:15:41.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.734+0000 7f07f6225740 1 -- start start 2024-04-25T02:15:41.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.734+0000 7f07f6225740 1 Processor -- start 2024-04-25T02:15:41.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f6225740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc60d60 0x55c3ebcf9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f6225740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc7e600 0x55c3ebcf56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f6225740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc8cba0 0x55c3ebc79530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f6225740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c3ebc64fe0 con 0x55c3ebc7e600 2024-04-25T02:15:41.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f6225740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec159d70 con 0x55c3ebc60d60 2024-04-25T02:15:41.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f6225740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55c3ebc7e060 con 0x55c3ebc8cba0 2024-04-25T02:15:41.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f6225740 10 client.0 _ll_register_callbacks cb 0x7f07e80092e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:15:41.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f0aaf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc7e600 0x55c3ebcf56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f0aaf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc7e600 0x55c3ebcf56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57678/0 (socket says 172.21.15.79:57678) 2024-04-25T02:15:41.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f0aaf640 1 -- 172.21.15.79:0/3592271365 learned_addr learned my addr 172.21.15.79:0/3592271365 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:41.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f1ab1640 1 --2- 172.21.15.79:0/3592271365 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc8cba0 0x55c3ebc79530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f12b0640 1 --2- 172.21.15.79:0/3592271365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc60d60 0x55c3ebcf9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f0aaf640 1 -- 172.21.15.79:0/3592271365 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc8cba0 msgr2=0x55c3ebc79530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:41.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f0aaf640 1 --2- 172.21.15.79:0/3592271365 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc8cba0 0x55c3ebc79530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f0aaf640 1 -- 172.21.15.79:0/3592271365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc60d60 msgr2=0x55c3ebcf9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:41.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f0aaf640 1 --2- 172.21.15.79:0/3592271365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc60d60 0x55c3ebcf9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f0aaf640 1 -- 172.21.15.79:0/3592271365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3ebc8a6d0 con 0x55c3ebc7e600 2024-04-25T02:15:41.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07f0aaf640 1 --2- 172.21.15.79:0/3592271365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc7e600 0x55c3ebcf56e0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0329f0 tx=0x7f07dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9f77a2de52b8dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:41.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.735+0000 7f07cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:15:41.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07cbfff640 1 -- 172.21.15.79:0/3592271365 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc037040 con 0x55c3ebc7e600 2024-04-25T02:15:41.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07cbfff640 1 -- 172.21.15.79:0/3592271365 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f07dc032ca0 con 0x55c3ebc7e600 2024-04-25T02:15:41.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07f6225740 1 -- 172.21.15.79:0/3592271365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07e4018040 con 0x55c3ebc7e600 2024-04-25T02:15:41.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07cbfff640 1 -- 172.21.15.79:0/3592271365 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f07dc05e050 con 0x55c3ebc7e600 2024-04-25T02:15:41.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07f6225740 10 client.8043 fetch_fsmap learned FSMap version 61 2024-04-25T02:15:41.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07f6225740 1 -- 172.21.15.79:0/3592271365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55c3ebc78e20 con 0x55c3ebc7e600 2024-04-25T02:15:41.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07cbfff640 1 -- 172.21.15.79:0/3592271365 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e4018040 con 0x55c3ebc7e600 2024-04-25T02:15:41.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07cbfff640 1 -- 172.21.15.79:0/3592271365 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f07dc061020 con 0x55c3ebc7e600 2024-04-25T02:15:41.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07f6225740 10 client.8043 fetch_fsmap finished waiting for FSMap version 61 2024-04-25T02:15:41.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07f6225740 10 client.8043 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T02:15:41.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07f6225740 20 client.8043 populate_metadata read hostname 'smithi079' 2024-04-25T02:15:41.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07f6225740 1 --2- 172.21.15.79:0/3592271365 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c3ebc38410 0x55c3ebc642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07f6225740 4 client.8043 mds_command: new command op to 7896 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:15:41.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07f6225740 1 -- 172.21.15.79:0/3592271365 --> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c3ebba1f40 con 0x55c3ebc38410 2024-04-25T02:15:41.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07f12b0640 1 --2- 172.21.15.79:0/3592271365 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c3ebc38410 0x55c3ebc642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07cbfff640 10 client.8043 ms_handle_connect on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:41.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.736+0000 7f07f12b0640 1 --2- 172.21.15.79:0/3592271365 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c3ebc38410 0x55c3ebc642e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea754f074d5d2fa7 server_cookie=6f6f23b51567abde in_seq=0 out_seq=0 2024-04-25T02:15:41.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.737+0000 7f07cbfff640 1 -- 172.21.15.79:0/3592271365 <== mds.0 v2:172.21.15.79:6836/1474949173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c3ebba1f40 con 0x55c3ebc38410 2024-04-25T02:15:41.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.737+0000 7f07cbfff640 10 client.8043 handle_command_reply: tid=0 2024-04-25T02:15:41.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.737+0000 7f07f6225740 1 client.8043 shutdown 2024-04-25T02:15:41.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.737+0000 7f07f6225740 1 -- 172.21.15.79:0/3592271365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc7e600 msgr2=0x55c3ebcf56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:41.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.737+0000 7f07f6225740 1 --2- 172.21.15.79:0/3592271365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc7e600 0x55c3ebcf56e0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0329f0 tx=0x7f07dc004730 comp rx=0 tx=0).stop 2024-04-25T02:15:41.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.737+0000 7f07f6225740 1 -- 172.21.15.79:0/3592271365 shutdown_connections 2024-04-25T02:15:41.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.737+0000 7f07f6225740 1 --2- 172.21.15.79:0/3592271365 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c3ebc38410 0x55c3ebc642e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.737+0000 7f07f6225740 1 --2- 172.21.15.79:0/3592271365 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c3ebc8cba0 0x55c3ebc79530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.737+0000 7f07f6225740 1 --2- 172.21.15.79:0/3592271365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3ebc7e600 0x55c3ebcf56e0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.737+0000 7f07cbfff640 0 client.8043 ms_handle_reset on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:41.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.737+0000 7f07f6225740 1 --2- 172.21.15.79:0/3592271365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c3ebc60d60 0x55c3ebcf9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.737+0000 7f07f6225740 1 -- 172.21.15.79:0/3592271365 >> 172.21.15.79:0/3592271365 conn(0x55c3ebc36a40 msgr2=0x55c3ebc31860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:41.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.737+0000 7f07f6225740 1 -- 172.21.15.79:0/3592271365 shutdown_connections 2024-04-25T02:15:41.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.737+0000 7f07f6225740 1 -- 172.21.15.79:0/3592271365 wait complete. 2024-04-25T02:15:41.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.737+0000 7f07f6225740 20 client.8043 trim_cache size 0 max 16384 2024-04-25T02:15:41.748 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:15:41.749 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-04-25T02:15:41.749 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-04-25T02:15:41.749 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:15:41.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.738+0000 7f07f3514640 1 -- 172.21.15.79:0/745178423 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f07d006be30 msgr2=0x7f07d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:41.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.738+0000 7f07f3514640 1 --2- 172.21.15.79:0/745178423 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f07d006be30 0x7f07d006e2f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f07dc034000 tx=0x7f07dc02e000 comp rx=0 tx=0).stop 2024-04-25T02:15:41.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.738+0000 7f07f3514640 1 -- 172.21.15.79:0/745178423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07ec0cf7f0 msgr2=0x7f07ec1f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:41.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.738+0000 7f07f3514640 1 --2- 172.21.15.79:0/745178423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07ec0cf7f0 0x7f07ec1f4b90 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f07e800efc0 tx=0x7f07e800c490 comp rx=0 tx=0).stop 2024-04-25T02:15:41.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.738+0000 7f07f3514640 1 -- 172.21.15.79:0/745178423 shutdown_connections 2024-04-25T02:15:41.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.738+0000 7f07f3514640 1 --2- 172.21.15.79:0/745178423 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f07d006be30 0x7f07d006e2f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.738+0000 7f07f3514640 1 --2- 172.21.15.79:0/745178423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07ec15e4f0 0x7f07ec150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.738+0000 7f07f3514640 1 --2- 172.21.15.79:0/745178423 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f07ec0cfc50 0x7f07ec0c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.738+0000 7f07f3514640 1 --2- 172.21.15.79:0/745178423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07ec0cf7f0 0x7f07ec1f4b90 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.738+0000 7f07f3514640 1 -- 172.21.15.79:0/745178423 >> 172.21.15.79:0/745178423 conn(0x7f07ec09d4a0 msgr2=0x7f07ec157230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:41.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.738+0000 7f07f3514640 1 -- 172.21.15.79:0/745178423 shutdown_connections 2024-04-25T02:15:41.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.738+0000 7f07f3514640 1 -- 172.21.15.79:0/745178423 wait complete. 2024-04-25T02:15:41.753 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T02:15:41.754 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:15:41.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.846+0000 7ff665410640 1 Processor -- start 2024-04-25T02:15:41.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.846+0000 7ff665410640 1 -- start start 2024-04-25T02:15:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.846+0000 7ff665410640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6600b3570 0x7ff6600d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.846+0000 7ff665410640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff6600b3020 0x7ff6600d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.846+0000 7ff665410640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff66006c380 con 0x7ff66015e4d0 2024-04-25T02:15:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.846+0000 7ff665410640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff6600d1660 con 0x7ff6600b3020 2024-04-25T02:15:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.846+0000 7ff665410640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff6600d1380 con 0x7ff6600b3570 2024-04-25T02:15:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.846+0000 7ff65effd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff66015e4d0 0x7ff66006bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58520/0 (socket says 172.21.15.79:58520) 2024-04-25T02:15:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.846+0000 7ff65effd640 1 -- 172.21.15.79:0/236236311 learned_addr learned my addr 172.21.15.79:0/236236311 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 -- 172.21.15.79:0/236236311 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 94486096 0 0) 0x7ff66006c380 con 0x7ff66015e4d0 2024-04-25T02:15:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65e7fc640 1 --2- 172.21.15.79:0/236236311 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6600b3570 0x7ff6600d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 -- 172.21.15.79:0/236236311 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff64c003520 con 0x7ff66015e4d0 2024-04-25T02:15:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65f7fe640 1 --2- 172.21.15.79:0/236236311 >> v2:172.21.15.189:3300/0 conn(0x7ff6600b3020 0x7ff6600d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 -- 172.21.15.79:0/236236311 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 57988087 0 0) 0x7ff64c003520 con 0x7ff66015e4d0 2024-04-25T02:15:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 -- 172.21.15.79:0/236236311 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6600b3570 msgr2=0x7ff6600d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 --2- 172.21.15.79:0/236236311 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6600b3570 0x7ff6600d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 -- 172.21.15.79:0/236236311 >> v2:172.21.15.189:3300/0 conn(0x7ff6600b3020 msgr2=0x7ff6600d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 --2- 172.21.15.79:0/236236311 >> v2:172.21.15.189:3300/0 conn(0x7ff6600b3020 0x7ff6600d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 -- 172.21.15.79:0/236236311 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6600cede0 con 0x7ff66015e4d0 2024-04-25T02:15:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 -- 172.21.15.79:0/236236311 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7ff6580019f0 con 0x7ff66015e4d0 2024-04-25T02:15:41.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 -- 172.21.15.79:0/236236311 >> v1:172.21.15.79:6789/0 conn(0x7ff66015e4d0 legacy=0x7ff66006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:41.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 --2- 172.21.15.79:0/236236311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff64c0039b0 0x7ff64c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 --2- 172.21.15.79:0/236236311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c004800 0x7ff64c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 --2- 172.21.15.79:0/236236311 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6600b3570 0x7ff64c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 -- 172.21.15.79:0/236236311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff6600d1660 con 0x7ff64c004800 2024-04-25T02:15:41.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 -- 172.21.15.79:0/236236311 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff6600d1380 con 0x7ff64c0039b0 2024-04-25T02:15:41.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65dffb640 1 -- 172.21.15.79:0/236236311 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff64c00b9c0 con 0x7ff6600b3570 2024-04-25T02:15:41.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65e7fc640 1 --2- 172.21.15.79:0/236236311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c004800 0x7ff64c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65effd640 1 --2- 172.21.15.79:0/236236311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff64c0039b0 0x7ff64c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65f7fe640 1 --2- 172.21.15.79:0/236236311 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6600b3570 0x7ff64c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65e7fc640 1 -- 172.21.15.79:0/236236311 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6600b3570 msgr2=0x7ff64c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:41.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.847+0000 7ff65e7fc640 1 --2- 172.21.15.79:0/236236311 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6600b3570 0x7ff64c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.848+0000 7ff65e7fc640 1 -- 172.21.15.79:0/236236311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff64c0039b0 msgr2=0x7ff64c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:41.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.848+0000 7ff65e7fc640 1 --2- 172.21.15.79:0/236236311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff64c0039b0 0x7ff64c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.848+0000 7ff65e7fc640 1 -- 172.21.15.79:0/236236311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64c003520 con 0x7ff64c004800 2024-04-25T02:15:41.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.848+0000 7ff65e7fc640 1 --2- 172.21.15.79:0/236236311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c004800 0x7ff64c004c80 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7ff648009ac0 tx=0x7ff64c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e0619d0cd153a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:41.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.848+0000 7ff65dffb640 1 -- 172.21.15.79:0/236236311 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff648036070 con 0x7ff64c004800 2024-04-25T02:15:41.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.848+0000 7ff65dffb640 1 -- 172.21.15.79:0/236236311 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff648031400 con 0x7ff64c004800 2024-04-25T02:15:41.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.848+0000 7ff65dffb640 1 -- 172.21.15.79:0/236236311 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff648009690 con 0x7ff64c004800 2024-04-25T02:15:41.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.849+0000 7ff665410640 1 -- 172.21.15.79:0/236236311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c004800 msgr2=0x7ff64c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:41.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.849+0000 7ff665410640 1 --2- 172.21.15.79:0/236236311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c004800 0x7ff64c004c80 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7ff648009ac0 tx=0x7ff64c005830 comp rx=0 tx=0).stop 2024-04-25T02:15:41.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.849+0000 7ff65f7fe640 1 -- 172.21.15.79:0/236236311 reap_dead start 2024-04-25T02:15:41.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.849+0000 7ff665410640 1 -- 172.21.15.79:0/236236311 shutdown_connections 2024-04-25T02:15:41.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.849+0000 7ff665410640 1 -- 172.21.15.79:0/236236311 >> 172.21.15.79:0/236236311 conn(0x7ff66009d460 msgr2=0x7ff6600d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:41.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.849+0000 7ff665410640 1 -- 172.21.15.79:0/236236311 shutdown_connections 2024-04-25T02:15:41.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.849+0000 7ff665410640 1 -- 172.21.15.79:0/236236311 wait complete. 2024-04-25T02:15:41.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.850+0000 7ff665410640 1 Processor -- start 2024-04-25T02:15:41.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.850+0000 7ff665410640 1 -- start start 2024-04-25T02:15:41.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff665410640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c004800 0x7ff6601595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff665410640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6601f4e70 0x7ff6601f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff665410640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff660156730 0x7ff6600cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff665410640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff6600d20d0 con 0x7ff64c004800 2024-04-25T02:15:41.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff665410640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff66015e8b0 con 0x7ff6601f4e70 2024-04-25T02:15:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff665410640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff6600d2250 con 0x7ff660156730 2024-04-25T02:15:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff65effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c004800 0x7ff6601595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff65effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c004800 0x7ff6601595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57698/0 (socket says 172.21.15.79:57698) 2024-04-25T02:15:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff65effd640 1 -- 172.21.15.79:0/807690998 learned_addr learned my addr 172.21.15.79:0/807690998 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff65f7fe640 1 --2- 172.21.15.79:0/807690998 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff660156730 0x7ff6600cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff65effd640 1 -- 172.21.15.79:0/807690998 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff660156730 msgr2=0x7ff6600cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff65effd640 1 --2- 172.21.15.79:0/807690998 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff660156730 0x7ff6600cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff65e7fc640 1 --2- 172.21.15.79:0/807690998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6601f4e70 0x7ff6601f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff65effd640 1 -- 172.21.15.79:0/807690998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6601f4e70 msgr2=0x7ff6601f15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff65effd640 1 --2- 172.21.15.79:0/807690998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6601f4e70 0x7ff6601f15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff65effd640 1 -- 172.21.15.79:0/807690998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff660157080 con 0x7ff64c004800 2024-04-25T02:15:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff65effd640 1 --2- 172.21.15.79:0/807690998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c004800 0x7ff6601595a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7ff6580079f0 tx=0x7ff65800a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff6577fe640 1 -- 172.21.15.79:0/807690998 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658017020 con 0x7ff64c004800 2024-04-25T02:15:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff6577fe640 1 -- 172.21.15.79:0/807690998 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65800ae00 con 0x7ff64c004800 2024-04-25T02:15:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.851+0000 7ff665410640 1 -- 172.21.15.79:0/807690998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff660158ac0 con 0x7ff64c004800 2024-04-25T02:15:41.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.852+0000 7ff6577fe640 1 -- 172.21.15.79:0/807690998 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658013820 con 0x7ff64c004800 2024-04-25T02:15:41.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.852+0000 7ff665410640 1 -- 172.21.15.79:0/807690998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff660159080 con 0x7ff64c004800 2024-04-25T02:15:41.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.852+0000 7ff665410640 1 -- 172.21.15.79:0/807690998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6600690a0 con 0x7ff64c004800 2024-04-25T02:15:41.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.853+0000 7ff6577fe640 1 -- 172.21.15.79:0/807690998 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff65801a020 con 0x7ff64c004800 2024-04-25T02:15:41.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.853+0000 7ff6577fe640 1 --2- 172.21.15.79:0/807690998 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64006be60 0x7ff64006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:41.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.853+0000 7ff65e7fc640 1 --2- 172.21.15.79:0/807690998 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64006be60 0x7ff64006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:41.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.853+0000 7ff6577fe640 1 -- 172.21.15.79:0/807690998 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7ff65808ba40 con 0x7ff64c004800 2024-04-25T02:15:41.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.854+0000 7ff65e7fc640 1 --2- 172.21.15.79:0/807690998 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64006be60 0x7ff64006e320 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff648033000 tx=0x7ff648008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:41.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:41.858+0000 7ff6577fe640 1 -- 172.21.15.79:0/807690998 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff658021020 con 0x7ff64c004800 2024-04-25T02:15:42.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.067+0000 7ff665410640 1 -- 172.21.15.79:0/807690998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6600d1920 con 0x7ff64c004800 2024-04-25T02:15:42.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.067+0000 7ff6577fe640 1 -- 172.21.15.79:0/807690998 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5190 (secure 0 0 0) 0x7ff65808be20 con 0x7ff64c004800 2024-04-25T02:15:42.072 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:42.073 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:15:08.854388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7896},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7896":{"gid":7896,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/1474949173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1474949173},{"type":"v1","addr":"172.21.15.79:6837","nonce":1474949173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7896,"qdb_cluster":[7896]},"id":6}]} 2024-04-25T02:15:42.073 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 61 2024-04-25T02:15:42.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.069+0000 7ff665410640 1 -- 172.21.15.79:0/807690998 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64006be60 msgr2=0x7ff64006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.069+0000 7ff665410640 1 --2- 172.21.15.79:0/807690998 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64006be60 0x7ff64006e320 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff648033000 tx=0x7ff648008030 comp rx=0 tx=0).stop 2024-04-25T02:15:42.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.069+0000 7ff665410640 1 -- 172.21.15.79:0/807690998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c004800 msgr2=0x7ff6601595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.069+0000 7ff665410640 1 --2- 172.21.15.79:0/807690998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c004800 0x7ff6601595a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7ff6580079f0 tx=0x7ff65800a750 comp rx=0 tx=0).stop 2024-04-25T02:15:42.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.069+0000 7ff665410640 1 -- 172.21.15.79:0/807690998 shutdown_connections 2024-04-25T02:15:42.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.069+0000 7ff665410640 1 --2- 172.21.15.79:0/807690998 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64006be60 0x7ff64006e320 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.069+0000 7ff665410640 1 --2- 172.21.15.79:0/807690998 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff660156730 0x7ff6600cfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.069+0000 7ff665410640 1 --2- 172.21.15.79:0/807690998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6601f4e70 0x7ff6601f15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.069+0000 7ff665410640 1 --2- 172.21.15.79:0/807690998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c004800 0x7ff6601595a0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.069+0000 7ff665410640 1 -- 172.21.15.79:0/807690998 >> 172.21.15.79:0/807690998 conn(0x7ff66009d460 msgr2=0x7ff6600b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:42.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.069+0000 7ff665410640 1 -- 172.21.15.79:0/807690998 shutdown_connections 2024-04-25T02:15:42.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.069+0000 7ff665410640 1 -- 172.21.15.79:0/807690998 wait complete. 2024-04-25T02:15:42.085 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T02:15:42.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.178+0000 7f389f01c640 1 Processor -- start 2024-04-25T02:15:42.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.179+0000 7f389f01c640 1 -- start start 2024-04-25T02:15:42.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.179+0000 7f389f01c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f38980d10c0 0x7f389806bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.179+0000 7f389f01c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38980d1ee0 con 0x7f389815e4f0 2024-04-25T02:15:42.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.179+0000 7f389f01c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38980d21c0 con 0x7f38980d2ca0 2024-04-25T02:15:42.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.179+0000 7f389f01c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f38980d3130 con 0x7f38980d10c0 2024-04-25T02:15:42.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.179+0000 7f389cdb8640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f389815e4f0 0x7f38980cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58532/0 (socket says 172.21.15.79:58532) 2024-04-25T02:15:42.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.179+0000 7f389cdb8640 1 -- 172.21.15.79:0/3378004958 learned_addr learned my addr 172.21.15.79:0/3378004958 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f389d5b9640 1 --2- 172.21.15.79:0/3378004958 >> v2:172.21.15.189:3300/0 conn(0x7f38980d10c0 0x7f389806bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f38977fe640 1 -- 172.21.15.79:0/3378004958 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3346503923 0 0) 0x7f38980d1ee0 con 0x7f389815e4f0 2024-04-25T02:15:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f38977fe640 1 -- 172.21.15.79:0/3378004958 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3880003520 con 0x7f389815e4f0 2024-04-25T02:15:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f38977fe640 1 -- 172.21.15.79:0/3378004958 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4287271928 0 0) 0x7f3880003520 con 0x7f389815e4f0 2024-04-25T02:15:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f38977fe640 1 -- 172.21.15.79:0/3378004958 >> v2:172.21.15.189:3300/0 conn(0x7f38980d10c0 msgr2=0x7f389806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f38977fe640 1 --2- 172.21.15.79:0/3378004958 >> v2:172.21.15.189:3300/0 conn(0x7f38980d10c0 0x7f389806bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f38977fe640 1 -- 172.21.15.79:0/3378004958 >> v1:172.21.15.189:6789/0 conn(0x7f38980d2ca0 legacy=0x7f38980d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f38977fe640 1 -- 172.21.15.79:0/3378004958 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38980d24a0 con 0x7f389815e4f0 2024-04-25T02:15:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f38977fe640 1 -- 172.21.15.79:0/3378004958 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f3888001670 con 0x7f389815e4f0 2024-04-25T02:15:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f38977fe640 1 -- 172.21.15.79:0/3378004958 >> v1:172.21.15.79:6789/0 conn(0x7f389815e4f0 legacy=0x7f38980cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f38977fe640 1 --2- 172.21.15.79:0/3378004958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38800039b0 0x7f3880003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f38977fe640 1 --2- 172.21.15.79:0/3378004958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3880004800 0x7f3880004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f38977fe640 1 --2- 172.21.15.79:0/3378004958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800051c0 0x7f388000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f38977fe640 1 -- 172.21.15.79:0/3378004958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f388000c030 con 0x7f38800051c0 2024-04-25T02:15:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f38977fe640 1 -- 172.21.15.79:0/3378004958 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f388000c1e0 con 0x7f3880004800 2024-04-25T02:15:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f38977fe640 1 -- 172.21.15.79:0/3378004958 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f388000c3e0 con 0x7f38800039b0 2024-04-25T02:15:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f389d5b9640 1 --2- 172.21.15.79:0/3378004958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800051c0 0x7f388000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f3897fff640 1 --2- 172.21.15.79:0/3378004958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3880004800 0x7f3880004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f389cdb8640 1 --2- 172.21.15.79:0/3378004958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38800039b0 0x7f3880003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f389d5b9640 1 -- 172.21.15.79:0/3378004958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38800039b0 msgr2=0x7f3880003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f389d5b9640 1 --2- 172.21.15.79:0/3378004958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38800039b0 0x7f3880003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f389d5b9640 1 -- 172.21.15.79:0/3378004958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3880004800 msgr2=0x7f3880004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f389d5b9640 1 --2- 172.21.15.79:0/3378004958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3880004800 0x7f3880004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.180+0000 7f389d5b9640 1 -- 172.21.15.79:0/3378004958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3880003520 con 0x7f38800051c0 2024-04-25T02:15:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.181+0000 7f389d5b9640 1 -- 172.21.15.79:0/3378004958 reap_dead start 2024-04-25T02:15:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.181+0000 7f389d5b9640 1 --2- 172.21.15.79:0/3378004958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800051c0 0x7f388000b9c0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f3890009fc0 tx=0x7f3880005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477b9b12ea16dc6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.181+0000 7f38977fe640 1 -- 172.21.15.79:0/3378004958 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3890035020 con 0x7f38800051c0 2024-04-25T02:15:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.181+0000 7f38977fe640 1 -- 172.21.15.79:0/3378004958 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3890003bd0 con 0x7f38800051c0 2024-04-25T02:15:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.181+0000 7f38977fe640 1 -- 172.21.15.79:0/3378004958 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3890009c10 con 0x7f38800051c0 2024-04-25T02:15:42.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.182+0000 7f389f01c640 1 -- 172.21.15.79:0/3378004958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800051c0 msgr2=0x7f388000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.182+0000 7f389f01c640 1 --2- 172.21.15.79:0/3378004958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800051c0 0x7f388000b9c0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f3890009fc0 tx=0x7f3880005830 comp rx=0 tx=0).stop 2024-04-25T02:15:42.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.182+0000 7f389f01c640 1 -- 172.21.15.79:0/3378004958 shutdown_connections 2024-04-25T02:15:42.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.182+0000 7f389f01c640 1 --2- 172.21.15.79:0/3378004958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800051c0 0x7f388000b9c0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.182+0000 7f389f01c640 1 -- 172.21.15.79:0/3378004958 >> 172.21.15.79:0/3378004958 conn(0x7f389809d4a0 msgr2=0x7f38980d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:42.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.182+0000 7f389f01c640 1 -- 172.21.15.79:0/3378004958 shutdown_connections 2024-04-25T02:15:42.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.182+0000 7f389f01c640 1 -- 172.21.15.79:0/3378004958 wait complete. 2024-04-25T02:15:42.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.183+0000 7f389f01c640 1 Processor -- start 2024-04-25T02:15:42.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.183+0000 7f389f01c640 1 -- start start 2024-04-25T02:15:42.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389f01c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38800051c0 0x7f38980ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389f01c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389814d8a0 0x7f389814cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389f01c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f389814dd20 0x7f389814d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389f01c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f38980d5060 con 0x7f389814dd20 2024-04-25T02:15:42.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389f01c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f38980d4ee0 con 0x7f389814d8a0 2024-04-25T02:15:42.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389f01c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f38980d09b0 con 0x7f38800051c0 2024-04-25T02:15:42.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389d5b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f389814dd20 0x7f389814d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389d5b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f389814dd20 0x7f389814d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57730/0 (socket says 172.21.15.79:57730) 2024-04-25T02:15:42.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389d5b9640 1 -- 172.21.15.79:0/3951303352 learned_addr learned my addr 172.21.15.79:0/3951303352 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:42.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f3897fff640 1 --2- 172.21.15.79:0/3951303352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389814d8a0 0x7f389814cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389cdb8640 1 --2- 172.21.15.79:0/3951303352 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38800051c0 0x7f38980ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389d5b9640 1 -- 172.21.15.79:0/3951303352 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38800051c0 msgr2=0x7f38980ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389d5b9640 1 --2- 172.21.15.79:0/3951303352 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38800051c0 0x7f38980ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389d5b9640 1 -- 172.21.15.79:0/3951303352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389814d8a0 msgr2=0x7f389814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389d5b9640 1 --2- 172.21.15.79:0/3951303352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389814d8a0 0x7f389814cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389d5b9640 1 -- 172.21.15.79:0/3951303352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38980ccf20 con 0x7f389814dd20 2024-04-25T02:15:42.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.184+0000 7f389d5b9640 1 --2- 172.21.15.79:0/3951303352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f389814dd20 0x7f389814d040 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f389002af10 tx=0x7f3890009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:42.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.185+0000 7f38957fa640 1 -- 172.21.15.79:0/3951303352 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3890040070 con 0x7f389814dd20 2024-04-25T02:15:42.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.185+0000 7f38957fa640 1 -- 172.21.15.79:0/3951303352 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3890032e80 con 0x7f389814dd20 2024-04-25T02:15:42.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.185+0000 7f389f01c640 1 -- 172.21.15.79:0/3951303352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38980cc160 con 0x7f389814dd20 2024-04-25T02:15:42.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.185+0000 7f38957fa640 1 -- 172.21.15.79:0/3951303352 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3890035030 con 0x7f389814dd20 2024-04-25T02:15:42.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.185+0000 7f389f01c640 1 -- 172.21.15.79:0/3951303352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38980cc720 con 0x7f389814dd20 2024-04-25T02:15:42.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.186+0000 7f38957fa640 1 -- 172.21.15.79:0/3951303352 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3890043070 con 0x7f389814dd20 2024-04-25T02:15:42.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.186+0000 7f38957fa640 1 --2- 172.21.15.79:0/3951303352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f388406be30 0x7f388406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.186+0000 7f38957fa640 1 -- 172.21.15.79:0/3951303352 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f38900abeb0 con 0x7f389814dd20 2024-04-25T02:15:42.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.186+0000 7f389cdb8640 1 --2- 172.21.15.79:0/3951303352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f388406be30 0x7f388406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.187+0000 7f389cdb8640 1 --2- 172.21.15.79:0/3951303352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f388406be30 0x7f388406e2f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3888001050 tx=0x7f3888009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:42.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.187+0000 7f38a1e06740 1 Processor -- start 2024-04-25T02:15:42.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.187+0000 7f38a1e06740 1 -- start start 2024-04-25T02:15:42.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.188+0000 7f38a1e06740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c0b330 0x55c580c0eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.188+0000 7f38a1e06740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c0eff0 0x55c580c2af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.188+0000 7f38a1e06740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c2b470 0x55c580c2b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.188+0000 7f38a1e06740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c580b47520 con 0x55c580c0b330 2024-04-25T02:15:42.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.188+0000 7f38a1e06740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c580ae5ae0 con 0x55c580c0eff0 2024-04-25T02:15:42.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.188+0000 7f38a1e06740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55c580b434e0 con 0x55c580c2b470 2024-04-25T02:15:42.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.188+0000 7f389cdb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c0b330 0x55c580c0eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.188+0000 7f389cdb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c0b330 0x55c580c0eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57738/0 (socket says 172.21.15.79:57738) 2024-04-25T02:15:42.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.188+0000 7f389cdb8640 1 -- 172.21.15.79:0/2350219865 learned_addr learned my addr 172.21.15.79:0/2350219865 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:42.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.188+0000 7f389cdb8640 1 -- 172.21.15.79:0/2350219865 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c2b470 msgr2=0x55c580c2b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.188+0000 7f389cdb8640 1 --2- 172.21.15.79:0/2350219865 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c2b470 0x55c580c2b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.188+0000 7f389cdb8640 1 -- 172.21.15.79:0/2350219865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c0eff0 msgr2=0x55c580c2af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.188+0000 7f389cdb8640 1 --2- 172.21.15.79:0/2350219865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c0eff0 0x55c580c2af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.188+0000 7f389cdb8640 1 -- 172.21.15.79:0/2350219865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c580b0b240 con 0x55c580c0b330 2024-04-25T02:15:42.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.189+0000 7f389cdb8640 1 --2- 172.21.15.79:0/2350219865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c0b330 0x55c580c0eab0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f38880077e0 tx=0x7f3888014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2039c858623995ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:42.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.189+0000 7f387e7fc640 1 -- 172.21.15.79:0/2350219865 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888015e40 con 0x55c580c0b330 2024-04-25T02:15:42.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.189+0000 7f387e7fc640 1 -- 172.21.15.79:0/2350219865 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3888026070 con 0x55c580c0b330 2024-04-25T02:15:42.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.189+0000 7f387e7fc640 1 -- 172.21.15.79:0/2350219865 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888021650 con 0x55c580c0b330 2024-04-25T02:15:42.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.189+0000 7f38a1e06740 1 -- 172.21.15.79:0/2350219865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c0b330 msgr2=0x55c580c0eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.189+0000 7f38a1e06740 1 --2- 172.21.15.79:0/2350219865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c0b330 0x55c580c0eab0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f38880077e0 tx=0x7f3888014000 comp rx=0 tx=0).stop 2024-04-25T02:15:42.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.189+0000 7f38a1e06740 1 -- 172.21.15.79:0/2350219865 shutdown_connections 2024-04-25T02:15:42.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.189+0000 7f38a1e06740 1 --2- 172.21.15.79:0/2350219865 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c2b470 0x55c580c2b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.189+0000 7f38a1e06740 1 --2- 172.21.15.79:0/2350219865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c0eff0 0x55c580c2af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.189+0000 7f38a1e06740 1 --2- 172.21.15.79:0/2350219865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c0b330 0x55c580c0eab0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.189+0000 7f38a1e06740 1 -- 172.21.15.79:0/2350219865 >> 172.21.15.79:0/2350219865 conn(0x55c580be1310 msgr2=0x55c580be2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:42.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.189+0000 7f38a1e06740 1 -- 172.21.15.79:0/2350219865 shutdown_connections 2024-04-25T02:15:42.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.189+0000 7f38a1e06740 1 -- 172.21.15.79:0/2350219865 wait complete. 2024-04-25T02:15:42.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.190+0000 7f38a1e06740 1 -- start start 2024-04-25T02:15:42.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.190+0000 7f38a1e06740 1 Processor -- start 2024-04-25T02:15:42.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f38a1e06740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c0eff0 0x55c580bf6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f38a1e06740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c2b470 0x55c580c09e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f38a1e06740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c07db0 0x55c580c08230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f38a1e06740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c580bdf140 con 0x55c580c0eff0 2024-04-25T02:15:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f38a1e06740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c580ae3470 con 0x55c580c07db0 2024-04-25T02:15:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f38a1e06740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55c580bdf420 con 0x55c580c2b470 2024-04-25T02:15:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f38a1e06740 10 client.0 _ll_register_callbacks cb 0x55c580b07dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:15:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f389cdb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c0eff0 0x55c580bf6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f389cdb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c0eff0 0x55c580bf6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57746/0 (socket says 172.21.15.79:57746) 2024-04-25T02:15:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f389cdb8640 1 -- 172.21.15.79:0/1694065170 learned_addr learned my addr 172.21.15.79:0/1694065170 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f3897fff640 1 --2- 172.21.15.79:0/1694065170 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c2b470 0x55c580c09e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f389d5b9640 1 --2- 172.21.15.79:0/1694065170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c07db0 0x55c580c08230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f389cdb8640 1 -- 172.21.15.79:0/1694065170 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c2b470 msgr2=0x55c580c09e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f389cdb8640 1 --2- 172.21.15.79:0/1694065170 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c2b470 0x55c580c09e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f389cdb8640 1 -- 172.21.15.79:0/1694065170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c07db0 msgr2=0x55c580c08230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f389cdb8640 1 --2- 172.21.15.79:0/1694065170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c07db0 0x55c580c08230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f389cdb8640 1 -- 172.21.15.79:0/1694065170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c580afabf0 con 0x55c580c0eff0 2024-04-25T02:15:42.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f389cdb8640 1 --2- 172.21.15.79:0/1694065170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c0eff0 0x55c580bf6860 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f3888022000 tx=0x7f38980d20b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1037eb4950ccbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:42.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.191+0000 7f38777fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:15:42.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f38777fe640 1 -- 172.21.15.79:0/1694065170 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388802b600 con 0x55c580c0eff0 2024-04-25T02:15:42.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f38777fe640 1 -- 172.21.15.79:0/1694065170 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f388802b7a0 con 0x55c580c0eff0 2024-04-25T02:15:42.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f38a1e06740 1 -- 172.21.15.79:0/1694065170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3888026070 con 0x55c580c0eff0 2024-04-25T02:15:42.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f38777fe640 1 -- 172.21.15.79:0/1694065170 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f388803b050 con 0x55c580c0eff0 2024-04-25T02:15:42.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f38a1e06740 10 client.8061 fetch_fsmap learned FSMap version 61 2024-04-25T02:15:42.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f38a1e06740 1 -- 172.21.15.79:0/1694065170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55c5809277c0 con 0x55c580c0eff0 2024-04-25T02:15:42.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f38777fe640 1 -- 172.21.15.79:0/1694065170 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3888026070 con 0x55c580c0eff0 2024-04-25T02:15:42.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f38777fe640 1 -- 172.21.15.79:0/1694065170 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f388803e020 con 0x55c580c0eff0 2024-04-25T02:15:42.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f38a1e06740 10 client.8061 fetch_fsmap finished waiting for FSMap version 61 2024-04-25T02:15:42.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f38a1e06740 10 client.8061 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:15:42.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f38a1e06740 20 client.8061 populate_metadata read hostname 'smithi079' 2024-04-25T02:15:42.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f38a1e06740 1 --2- 172.21.15.79:0/1694065170 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c580c115a0 0x55c580c119a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f38a1e06740 4 client.8061 mds_command: new command op to 7896 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:15:42.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f38a1e06740 1 -- 172.21.15.79:0/1694065170 --> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c580b5ad50 con 0x55c580c115a0 2024-04-25T02:15:42.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f3897fff640 1 --2- 172.21.15.79:0/1694065170 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c580c115a0 0x55c580c119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f38777fe640 10 client.8061 ms_handle_connect on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:42.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.192+0000 7f3897fff640 1 --2- 172.21.15.79:0/1694065170 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c580c115a0 0x55c580c119a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6557f4bf4dd7830 server_cookie=187622f6060a57da in_seq=0 out_seq=0 2024-04-25T02:15:42.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.193+0000 7f38777fe640 1 -- 172.21.15.79:0/1694065170 <== mds.0 v2:172.21.15.79:6836/1474949173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c580b5ad50 con 0x55c580c115a0 2024-04-25T02:15:42.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.193+0000 7f38777fe640 10 client.8061 handle_command_reply: tid=0 2024-04-25T02:15:42.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.193+0000 7f38a1e06740 1 client.8061 shutdown 2024-04-25T02:15:42.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.193+0000 7f38a1e06740 1 -- 172.21.15.79:0/1694065170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c0eff0 msgr2=0x55c580bf6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.193+0000 7f38a1e06740 1 --2- 172.21.15.79:0/1694065170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c0eff0 0x55c580bf6860 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f3888022000 tx=0x7f38980d20b0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.193+0000 7f38a1e06740 1 -- 172.21.15.79:0/1694065170 shutdown_connections 2024-04-25T02:15:42.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.193+0000 7f38a1e06740 1 --2- 172.21.15.79:0/1694065170 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c580c115a0 0x55c580c119a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.193+0000 7f38a1e06740 1 --2- 172.21.15.79:0/1694065170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c07db0 0x55c580c08230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.193+0000 7f38777fe640 0 client.8061 ms_handle_reset on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:42.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.193+0000 7f38a1e06740 1 --2- 172.21.15.79:0/1694065170 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c2b470 0x55c580c09e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.193+0000 7f38a1e06740 1 --2- 172.21.15.79:0/1694065170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c0eff0 0x55c580bf6860 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.193+0000 7f38a1e06740 1 -- 172.21.15.79:0/1694065170 >> 172.21.15.79:0/1694065170 conn(0x55c580c0b330 msgr2=0x55c580c29a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:42.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.193+0000 7f38a1e06740 1 -- 172.21.15.79:0/1694065170 shutdown_connections 2024-04-25T02:15:42.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.193+0000 7f38a1e06740 1 -- 172.21.15.79:0/1694065170 wait complete. 2024-04-25T02:15:42.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.193+0000 7f38a1e06740 20 client.8061 trim_cache size 0 max 16384 2024-04-25T02:15:42.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.206+0000 7f38a1e06740 1 Processor -- start 2024-04-25T02:15:42.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.206+0000 7f38a1e06740 1 -- start start 2024-04-25T02:15:42.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.207+0000 7f38a1e06740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c07db0 0x55c580c2a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.207+0000 7f38a1e06740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c0eff0 0x55c580bf5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.207+0000 7f38a1e06740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c2b470 0x55c580bf5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.207+0000 7f38a1e06740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3898200ef0 con 0x55c580c07db0 2024-04-25T02:15:42.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.207+0000 7f38a1e06740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f38981fff70 con 0x55c580c0eff0 2024-04-25T02:15:42.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.207+0000 7f38a1e06740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f38980b9970 con 0x55c580c2b470 2024-04-25T02:15:42.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.207+0000 7f389cdb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c07db0 0x55c580c2a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.207+0000 7f389cdb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c07db0 0x55c580c2a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57748/0 (socket says 172.21.15.79:57748) 2024-04-25T02:15:42.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.207+0000 7f389cdb8640 1 -- 172.21.15.79:0/40285142 learned_addr learned my addr 172.21.15.79:0/40285142 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:42.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f389cdb8640 1 -- 172.21.15.79:0/40285142 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c2b470 msgr2=0x55c580bf5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f389cdb8640 1 --2- 172.21.15.79:0/40285142 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c2b470 0x55c580bf5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f389cdb8640 1 -- 172.21.15.79:0/40285142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c0eff0 msgr2=0x55c580bf5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f389cdb8640 1 --2- 172.21.15.79:0/40285142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c0eff0 0x55c580bf5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f389cdb8640 1 -- 172.21.15.79:0/40285142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c580987f50 con 0x55c580c07db0 2024-04-25T02:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f389cdb8640 1 --2- 172.21.15.79:0/40285142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c07db0 0x55c580c2a150 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f3888015ea0 tx=0x7f388802e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89c8d44798daddb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f387dffb640 1 -- 172.21.15.79:0/40285142 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888035620 con 0x55c580c07db0 2024-04-25T02:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f387dffb640 1 -- 172.21.15.79:0/40285142 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3888026070 con 0x55c580c07db0 2024-04-25T02:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f387dffb640 1 -- 172.21.15.79:0/40285142 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38880359e0 con 0x55c580c07db0 2024-04-25T02:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f38a1e06740 1 -- 172.21.15.79:0/40285142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c07db0 msgr2=0x55c580c2a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f38a1e06740 1 --2- 172.21.15.79:0/40285142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c07db0 0x55c580c2a150 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f3888015ea0 tx=0x7f388802e040 comp rx=0 tx=0).stop 2024-04-25T02:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f38a1e06740 1 -- 172.21.15.79:0/40285142 shutdown_connections 2024-04-25T02:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f38a1e06740 1 --2- 172.21.15.79:0/40285142 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c2b470 0x55c580bf5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f38a1e06740 1 --2- 172.21.15.79:0/40285142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c0eff0 0x55c580bf5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f38a1e06740 1 --2- 172.21.15.79:0/40285142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c07db0 0x55c580c2a150 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f38a1e06740 1 -- 172.21.15.79:0/40285142 >> 172.21.15.79:0/40285142 conn(0x55c580c0b330 msgr2=0x55c580c0f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f38a1e06740 1 -- 172.21.15.79:0/40285142 shutdown_connections 2024-04-25T02:15:42.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.208+0000 7f38a1e06740 1 -- 172.21.15.79:0/40285142 wait complete. 2024-04-25T02:15:42.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.209+0000 7f38a1e06740 1 -- start start 2024-04-25T02:15:42.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.209+0000 7f38a1e06740 1 Processor -- start 2024-04-25T02:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f38a1e06740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c07db0 0x55c580be0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f38a1e06740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c0eff0 0x55c580c0de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f38a1e06740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c2b470 0x55c580c0e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f38a1e06740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c580bdf140 con 0x55c580c07db0 2024-04-25T02:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f38a1e06740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f38981ff920 con 0x55c580c2b470 2024-04-25T02:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f38a1e06740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55c580c0a8d0 con 0x55c580c0eff0 2024-04-25T02:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f38a1e06740 10 client.0 _ll_register_callbacks cb 0x7f3888007ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f389cdb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c07db0 0x55c580be0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f389cdb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c07db0 0x55c580be0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57750/0 (socket says 172.21.15.79:57750) 2024-04-25T02:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f389cdb8640 1 -- 172.21.15.79:0/2457858270 learned_addr learned my addr 172.21.15.79:0/2457858270 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f389cdb8640 1 -- 172.21.15.79:0/2457858270 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c0eff0 msgr2=0x55c580c0de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f389cdb8640 1 --2- 172.21.15.79:0/2457858270 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c0eff0 0x55c580c0de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f389cdb8640 1 -- 172.21.15.79:0/2457858270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c2b470 msgr2=0x55c580c0e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f389cdb8640 1 --2- 172.21.15.79:0/2457858270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c2b470 0x55c580c0e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f389cdb8640 1 -- 172.21.15.79:0/2457858270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c58081b0b0 con 0x55c580c07db0 2024-04-25T02:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f389cdb8640 1 --2- 172.21.15.79:0/2457858270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c07db0 0x55c580be0580 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f3888001b90 tx=0x7f388800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6679bfd76c5e6c27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.210+0000 7f38777fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f38777fe640 1 -- 172.21.15.79:0/2457858270 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888035ac0 con 0x55c580c07db0 2024-04-25T02:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f38777fe640 1 -- 172.21.15.79:0/2457858270 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f3888035c60 con 0x55c580c07db0 2024-04-25T02:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f38a1e06740 1 -- 172.21.15.79:0/2457858270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3888026070 con 0x55c580c07db0 2024-04-25T02:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f38777fe640 1 -- 172.21.15.79:0/2457858270 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f388802b400 con 0x55c580c07db0 2024-04-25T02:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f38a1e06740 10 client.8067 fetch_fsmap learned FSMap version 61 2024-04-25T02:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f38a1e06740 1 -- 172.21.15.79:0/2457858270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55c580ad4780 con 0x55c580c07db0 2024-04-25T02:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f38777fe640 1 -- 172.21.15.79:0/2457858270 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3888026070 con 0x55c580c07db0 2024-04-25T02:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f38777fe640 1 -- 172.21.15.79:0/2457858270 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f388803e040 con 0x55c580c07db0 2024-04-25T02:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f38a1e06740 10 client.8067 fetch_fsmap finished waiting for FSMap version 61 2024-04-25T02:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f38a1e06740 10 client.8067 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f38a1e06740 20 client.8067 populate_metadata read hostname 'smithi079' 2024-04-25T02:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f38a1e06740 1 --2- 172.21.15.79:0/2457858270 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c580c39100 0x55c580c394e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f38a1e06740 4 client.8067 mds_command: new command op to 7896 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T02:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f38a1e06740 1 -- 172.21.15.79:0/2457858270 --> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55c580b54a60 con 0x55c580c39100 2024-04-25T02:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f3897fff640 1 --2- 172.21.15.79:0/2457858270 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c580c39100 0x55c580c394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f38777fe640 10 client.8067 ms_handle_connect on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.211+0000 7f3897fff640 1 --2- 172.21.15.79:0/2457858270 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c580c39100 0x55c580c394e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf86ec0967cd313 server_cookie=dc527512e1c202fa in_seq=0 out_seq=0 2024-04-25T02:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f38777fe640 1 -- 172.21.15.79:0/2457858270 <== mds.0 v2:172.21.15.79:6836/1474949173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c580b54a60 con 0x55c580c39100 2024-04-25T02:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f38777fe640 10 client.8067 handle_command_reply: tid=0 2024-04-25T02:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f38a1e06740 1 client.8067 shutdown 2024-04-25T02:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f38a1e06740 1 -- 172.21.15.79:0/2457858270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c07db0 msgr2=0x55c580be0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f38a1e06740 1 --2- 172.21.15.79:0/2457858270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c07db0 0x55c580be0580 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f3888001b90 tx=0x7f388800c000 comp rx=0 tx=0).stop 2024-04-25T02:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f38a1e06740 1 -- 172.21.15.79:0/2457858270 shutdown_connections 2024-04-25T02:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f38a1e06740 1 --2- 172.21.15.79:0/2457858270 >> [v2:172.21.15.79:6836/1474949173,v1:172.21.15.79:6837/1474949173] conn(0x55c580c39100 0x55c580c394e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f38a1e06740 1 --2- 172.21.15.79:0/2457858270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c580c2b470 0x55c580c0e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f38777fe640 0 client.8067 ms_handle_reset on v2:172.21.15.79:6836/1474949173 2024-04-25T02:15:42.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f38a1e06740 1 --2- 172.21.15.79:0/2457858270 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55c580c0eff0 0x55c580c0de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f38a1e06740 1 --2- 172.21.15.79:0/2457858270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c580c07db0 0x55c580be0580 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f38a1e06740 1 -- 172.21.15.79:0/2457858270 >> 172.21.15.79:0/2457858270 conn(0x55c580c0b330 msgr2=0x55c580c2a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:42.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f38a1e06740 1 -- 172.21.15.79:0/2457858270 shutdown_connections 2024-04-25T02:15:42.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f38a1e06740 1 -- 172.21.15.79:0/2457858270 wait complete. 2024-04-25T02:15:42.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f38a1e06740 20 client.8067 trim_cache size 0 max 16384 2024-04-25T02:15:42.223 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:42.223 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-04-25T02:15:42.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f389f01c640 1 -- 172.21.15.79:0/3951303352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f388406be30 msgr2=0x7f388406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f389f01c640 1 --2- 172.21.15.79:0/3951303352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f388406be30 0x7f388406e2f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3888001050 tx=0x7f3888009040 comp rx=0 tx=0).stop 2024-04-25T02:15:42.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f389f01c640 1 -- 172.21.15.79:0/3951303352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f389814dd20 msgr2=0x7f389814d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.212+0000 7f389f01c640 1 --2- 172.21.15.79:0/3951303352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f389814dd20 0x7f389814d040 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f389002af10 tx=0x7f3890009750 comp rx=0 tx=0).stop 2024-04-25T02:15:42.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.213+0000 7f389f01c640 1 -- 172.21.15.79:0/3951303352 shutdown_connections 2024-04-25T02:15:42.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.213+0000 7f389f01c640 1 --2- 172.21.15.79:0/3951303352 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f388406be30 0x7f388406e2f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.213+0000 7f389f01c640 1 --2- 172.21.15.79:0/3951303352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f389814dd20 0x7f389814d040 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.213+0000 7f389f01c640 1 --2- 172.21.15.79:0/3951303352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389814d8a0 0x7f389814cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.213+0000 7f389f01c640 1 --2- 172.21.15.79:0/3951303352 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38800051c0 0x7f38980ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.213+0000 7f389f01c640 1 -- 172.21.15.79:0/3951303352 >> 172.21.15.79:0/3951303352 conn(0x7f389809d4a0 msgr2=0x7f38980d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:42.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.213+0000 7f389f01c640 1 -- 172.21.15.79:0/3951303352 shutdown_connections 2024-04-25T02:15:42.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.213+0000 7f389f01c640 1 -- 172.21.15.79:0/3951303352 wait complete. 2024-04-25T02:15:42.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T02:15:42.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.318+0000 7fde6ac8c640 1 Processor -- start 2024-04-25T02:15:42.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.319+0000 7fde6ac8c640 1 -- start start 2024-04-25T02:15:42.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.319+0000 7fde6ac8c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde640b9a80 0x7fde640cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.319+0000 7fde6ac8c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fde640d1e30 0x7fde640d2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.319+0000 7fde6ac8c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde64161e50 con 0x7fde640d2ac0 2024-04-25T02:15:42.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.319+0000 7fde6ac8c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fde640b9e60 con 0x7fde640d1e30 2024-04-25T02:15:42.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.319+0000 7fde6ac8c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fde640d0030 con 0x7fde640b9a80 2024-04-25T02:15:42.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.319+0000 7fde69229640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fde640d2ac0 0x7fde640d05d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58540/0 (socket says 172.21.15.79:58540) 2024-04-25T02:15:42.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.319+0000 7fde69229640 1 -- 172.21.15.79:0/1216217214 learned_addr learned my addr 172.21.15.79:0/1216217214 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:42.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde63fff640 1 --2- 172.21.15.79:0/1216217214 >> v2:172.21.15.189:3300/0 conn(0x7fde640d1e30 0x7fde640d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde68a28640 1 --2- 172.21.15.79:0/1216217214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde640b9a80 0x7fde640cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 -- 172.21.15.79:0/1216217214 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1937778199 0 0) 0x7fde64161e50 con 0x7fde640d2ac0 2024-04-25T02:15:42.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 -- 172.21.15.79:0/1216217214 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde50003520 con 0x7fde640d2ac0 2024-04-25T02:15:42.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 -- 172.21.15.79:0/1216217214 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1531631751 0 0) 0x7fde50003520 con 0x7fde640d2ac0 2024-04-25T02:15:42.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 -- 172.21.15.79:0/1216217214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde640b9a80 msgr2=0x7fde640cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 --2- 172.21.15.79:0/1216217214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde640b9a80 0x7fde640cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 -- 172.21.15.79:0/1216217214 >> v2:172.21.15.189:3300/0 conn(0x7fde640d1e30 msgr2=0x7fde640d2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 --2- 172.21.15.79:0/1216217214 >> v2:172.21.15.189:3300/0 conn(0x7fde640d1e30 0x7fde640d2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 -- 172.21.15.79:0/1216217214 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde640b6e90 con 0x7fde640d2ac0 2024-04-25T02:15:42.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 -- 172.21.15.79:0/1216217214 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fde54001670 con 0x7fde640d2ac0 2024-04-25T02:15:42.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 -- 172.21.15.79:0/1216217214 >> v1:172.21.15.79:6789/0 conn(0x7fde640d2ac0 legacy=0x7fde640d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 --2- 172.21.15.79:0/1216217214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde640b9a80 0x7fde500039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 --2- 172.21.15.79:0/1216217214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde50003f30 0x7fde50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 --2- 172.21.15.79:0/1216217214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde50004d40 0x7fde500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 -- 172.21.15.79:0/1216217214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde640b9e60 con 0x7fde50004d40 2024-04-25T02:15:42.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 -- 172.21.15.79:0/1216217214 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fde640d0030 con 0x7fde50003f30 2024-04-25T02:15:42.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde637fe640 1 -- 172.21.15.79:0/1216217214 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fde5000b9c0 con 0x7fde640b9a80 2024-04-25T02:15:42.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde69229640 1 --2- 172.21.15.79:0/1216217214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde50004d40 0x7fde500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde68a28640 1 --2- 172.21.15.79:0/1216217214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde640b9a80 0x7fde500039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde63fff640 1 --2- 172.21.15.79:0/1216217214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde50003f30 0x7fde50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde69229640 1 -- 172.21.15.79:0/1216217214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde640b9a80 msgr2=0x7fde500039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde69229640 1 --2- 172.21.15.79:0/1216217214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde640b9a80 0x7fde500039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde69229640 1 -- 172.21.15.79:0/1216217214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde50003f30 msgr2=0x7fde50004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde69229640 1 --2- 172.21.15.79:0/1216217214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde50003f30 0x7fde50004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.320+0000 7fde69229640 1 -- 172.21.15.79:0/1216217214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde50003520 con 0x7fde50004d40 2024-04-25T02:15:42.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.321+0000 7fde69229640 1 --2- 172.21.15.79:0/1216217214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde50004d40 0x7fde500051c0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fde54007fd0 tx=0x7fde50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9bcebf43d5ccbd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:42.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.321+0000 7fde637fe640 1 -- 172.21.15.79:0/1216217214 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde54007d50 con 0x7fde50004d40 2024-04-25T02:15:42.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.321+0000 7fde637fe640 1 -- 172.21.15.79:0/1216217214 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde54005ad0 con 0x7fde50004d40 2024-04-25T02:15:42.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.321+0000 7fde637fe640 1 -- 172.21.15.79:0/1216217214 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde54007070 con 0x7fde50004d40 2024-04-25T02:15:42.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.322+0000 7fde6ac8c640 1 -- 172.21.15.79:0/1216217214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde50004d40 msgr2=0x7fde500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.322+0000 7fde6ac8c640 1 --2- 172.21.15.79:0/1216217214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde50004d40 0x7fde500051c0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fde54007fd0 tx=0x7fde50005830 comp rx=0 tx=0).stop 2024-04-25T02:15:42.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.322+0000 7fde69229640 1 -- 172.21.15.79:0/1216217214 reap_dead start 2024-04-25T02:15:42.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.322+0000 7fde6ac8c640 1 -- 172.21.15.79:0/1216217214 shutdown_connections 2024-04-25T02:15:42.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.322+0000 7fde6ac8c640 1 -- 172.21.15.79:0/1216217214 >> 172.21.15.79:0/1216217214 conn(0x7fde640d3fa0 msgr2=0x7fde640d43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:42.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.322+0000 7fde6ac8c640 1 -- 172.21.15.79:0/1216217214 shutdown_connections 2024-04-25T02:15:42.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.322+0000 7fde6ac8c640 1 -- 172.21.15.79:0/1216217214 wait complete. 2024-04-25T02:15:42.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.323+0000 7fde6ac8c640 1 Processor -- start 2024-04-25T02:15:42.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.323+0000 7fde6ac8c640 1 -- start start 2024-04-25T02:15:42.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde6ac8c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde50004d40 0x7fde641600b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde6ac8c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde640b1f90 0x7fde640a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde6ac8c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde640a1250 0x7fde640ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde6ac8c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde640b7730 con 0x7fde640b1f90 2024-04-25T02:15:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde6ac8c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fde640b7450 con 0x7fde50004d40 2024-04-25T02:15:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde6ac8c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fde640b8c60 con 0x7fde640a1250 2024-04-25T02:15:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde63fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde640b1f90 0x7fde640a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde63fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde640b1f90 0x7fde640a0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57770/0 (socket says 172.21.15.79:57770) 2024-04-25T02:15:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde63fff640 1 -- 172.21.15.79:0/1190518595 learned_addr learned my addr 172.21.15.79:0/1190518595 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde68a28640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde50004d40 0x7fde641600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde69229640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde640a1250 0x7fde640ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde63fff640 1 -- 172.21.15.79:0/1190518595 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde640a1250 msgr2=0x7fde640ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde63fff640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde640a1250 0x7fde640ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde63fff640 1 -- 172.21.15.79:0/1190518595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde50004d40 msgr2=0x7fde641600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde63fff640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde50004d40 0x7fde641600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde63fff640 1 -- 172.21.15.79:0/1190518595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6409ea00 con 0x7fde640b1f90 2024-04-25T02:15:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde68a28640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde50004d40 0x7fde641600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.324+0000 7fde69229640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde640a1250 0x7fde640ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.325+0000 7fde63fff640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde640b1f90 0x7fde640a0d10 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fde4c011960 tx=0x7fde4c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.325+0000 7fde617fa640 1 -- 172.21.15.79:0/1190518595 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c019070 con 0x7fde640b1f90 2024-04-25T02:15:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.325+0000 7fde617fa640 1 -- 172.21.15.79:0/1190518595 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4c004240 con 0x7fde640b1f90 2024-04-25T02:15:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.325+0000 7fde6ac8c640 1 -- 172.21.15.79:0/1190518595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde640cd800 con 0x7fde640b1f90 2024-04-25T02:15:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.325+0000 7fde617fa640 1 -- 172.21.15.79:0/1190518595 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c00f880 con 0x7fde640b1f90 2024-04-25T02:15:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.325+0000 7fde6ac8c640 1 -- 172.21.15.79:0/1190518595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde6409efa0 con 0x7fde640b1f90 2024-04-25T02:15:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.326+0000 7fde6ac8c640 1 -- 172.21.15.79:0/1190518595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde640a1660 con 0x7fde640b1f90 2024-04-25T02:15:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.326+0000 7fde617fa640 1 -- 172.21.15.79:0/1190518595 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde4c01c070 con 0x7fde640b1f90 2024-04-25T02:15:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.327+0000 7fde617fa640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fde4406be30 0x7fde4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.327+0000 7fde617fa640 1 -- 172.21.15.79:0/1190518595 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7fde4c08b6b0 con 0x7fde640b1f90 2024-04-25T02:15:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.327+0000 7fde68a28640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fde4406be30 0x7fde4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.327+0000 7fde68a28640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fde4406be30 0x7fde4406e2f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fde5c007440 tx=0x7fde5c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:42.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.331+0000 7fde617fa640 1 -- 172.21.15.79:0/1190518595 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fde640a1660 con 0x7fde640b1f90 2024-04-25T02:15:42.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.539+0000 7fde6ac8c640 1 -- 172.21.15.79:0/1190518595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fde640690a0 con 0x7fde640b1f90 2024-04-25T02:15:42.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.539+0000 7fde617fa640 1 -- 172.21.15.79:0/1190518595 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fde4c05a020 con 0x7fde640b1f90 2024-04-25T02:15:42.545 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:42.545 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T02:15:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.541+0000 7fde6ac8c640 1 -- 172.21.15.79:0/1190518595 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fde4406be30 msgr2=0x7fde4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.541+0000 7fde6ac8c640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fde4406be30 0x7fde4406e2f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fde5c007440 tx=0x7fde5c00b040 comp rx=0 tx=0).stop 2024-04-25T02:15:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.541+0000 7fde6ac8c640 1 -- 172.21.15.79:0/1190518595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde640b1f90 msgr2=0x7fde640a0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.541+0000 7fde6ac8c640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde640b1f90 0x7fde640a0d10 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fde4c011960 tx=0x7fde4c011e20 comp rx=0 tx=0).stop 2024-04-25T02:15:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.541+0000 7fde6ac8c640 1 -- 172.21.15.79:0/1190518595 shutdown_connections 2024-04-25T02:15:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.541+0000 7fde6ac8c640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fde4406be30 0x7fde4406e2f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.541+0000 7fde6ac8c640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde640a1250 0x7fde640ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.541+0000 7fde6ac8c640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde640b1f90 0x7fde640a0d10 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.541+0000 7fde6ac8c640 1 --2- 172.21.15.79:0/1190518595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde50004d40 0x7fde641600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.541+0000 7fde6ac8c640 1 -- 172.21.15.79:0/1190518595 >> 172.21.15.79:0/1190518595 conn(0x7fde640d3fa0 msgr2=0x7fde640d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.541+0000 7fde6ac8c640 1 -- 172.21.15.79:0/1190518595 shutdown_connections 2024-04-25T02:15:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.541+0000 7fde6ac8c640 1 -- 172.21.15.79:0/1190518595 wait complete. 2024-04-25T02:15:42.558 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T02:15:42.558 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:15:42.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:15:42.595 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:15:42.638 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:15:42.639 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:15:42.639 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:15:42.639 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:15:42.654 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:15:42.655 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:15:42.710 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:15:42.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.841+0000 7f3a365a2640 1 Processor -- start 2024-04-25T02:15:42.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.841+0000 7f3a365a2640 1 -- start start 2024-04-25T02:15:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.842+0000 7f3a365a2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a30143bc0 0x7f3a3015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.842+0000 7f3a365a2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a3006df50 0x7f3a3006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.842+0000 7f3a365a2640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f3a300b48e0 0x7f3a300b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.842+0000 7f3a365a2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3a3006e8f0 con 0x7f3a3006df50 2024-04-25T02:15:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.842+0000 7f3a365a2640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3a30072cb0 con 0x7f3a300b48e0 2024-04-25T02:15:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.842+0000 7f3a365a2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3015fa40 con 0x7f3a30143bc0 2024-04-25T02:15:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.842+0000 7f3a2f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a3006df50 0x7f3a3006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.842+0000 7f3a2f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a3006df50 0x7f3a3006e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57772/0 (socket says 172.21.15.79:57772) 2024-04-25T02:15:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.842+0000 7f3a2f7fe640 1 -- 172.21.15.79:0/2994522780 learned_addr learned my addr 172.21.15.79:0/2994522780 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.843+0000 7f3a2f7fe640 1 -- 172.21.15.79:0/2994522780 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a30143bc0 msgr2=0x7f3a3015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.843+0000 7f3a2f7fe640 1 --2- 172.21.15.79:0/2994522780 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a30143bc0 0x7f3a3015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.843+0000 7f3a2f7fe640 1 -- 172.21.15.79:0/2994522780 >> v2:172.21.15.189:3300/0 conn(0x7f3a300b48e0 msgr2=0x7f3a300b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:42.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.843+0000 7f3a2f7fe640 1 --2- 172.21.15.79:0/2994522780 >> v2:172.21.15.189:3300/0 conn(0x7f3a300b48e0 0x7f3a300b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.843+0000 7f3a2f7fe640 1 -- 172.21.15.79:0/2994522780 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a30071e00 con 0x7f3a3006df50 2024-04-25T02:15:42.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.843+0000 7f3a2f7fe640 1 --2- 172.21.15.79:0/2994522780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a3006df50 0x7f3a3006e3b0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f3a30144de0 tx=0x7f3a2402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11ad67d6d88023a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:42.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.843+0000 7f3a2effd640 1 -- 172.21.15.79:0/2994522780 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24037070 con 0x7f3a3006df50 2024-04-25T02:15:42.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.843+0000 7f3a2effd640 1 -- 172.21.15.79:0/2994522780 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a24032440 con 0x7f3a3006df50 2024-04-25T02:15:42.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.843+0000 7f3a2effd640 1 -- 172.21.15.79:0/2994522780 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24032810 con 0x7f3a3006df50 2024-04-25T02:15:42.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.844+0000 7f3a365a2640 1 -- 172.21.15.79:0/2994522780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a3006df50 msgr2=0x7f3a3006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.844+0000 7f3a365a2640 1 --2- 172.21.15.79:0/2994522780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a3006df50 0x7f3a3006e3b0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f3a30144de0 tx=0x7f3a2402a140 comp rx=0 tx=0).stop 2024-04-25T02:15:42.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.844+0000 7f3a365a2640 1 -- 172.21.15.79:0/2994522780 shutdown_connections 2024-04-25T02:15:42.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.844+0000 7f3a365a2640 1 --2- 172.21.15.79:0/2994522780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a3006df50 0x7f3a3006e3b0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.844+0000 7f3a365a2640 1 --2- 172.21.15.79:0/2994522780 >> v2:172.21.15.189:3300/0 conn(0x7f3a300b48e0 0x7f3a300b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.844+0000 7f3a365a2640 1 --2- 172.21.15.79:0/2994522780 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a30143bc0 0x7f3a3015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.844+0000 7f3a365a2640 1 -- 172.21.15.79:0/2994522780 >> 172.21.15.79:0/2994522780 conn(0x7f3a300cfc80 msgr2=0x7f3a300d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:42.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.844+0000 7f3a365a2640 1 -- 172.21.15.79:0/2994522780 shutdown_connections 2024-04-25T02:15:42.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.844+0000 7f3a365a2640 1 -- 172.21.15.79:0/2994522780 wait complete. 2024-04-25T02:15:42.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.845+0000 7f3a365a2640 1 Processor -- start 2024-04-25T02:15:42.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.845+0000 7f3a365a2640 1 -- start start 2024-04-25T02:15:42.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a365a2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a3006df50 0x7f3a301578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a365a2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300b48e0 0x7f3a3013f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a365a2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a30143bc0 0x7f3a301f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a365a2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3a30072660 con 0x7f3a300b48e0 2024-04-25T02:15:42.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a365a2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3a30072380 con 0x7f3a3006df50 2024-04-25T02:15:42.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a365a2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3a30072940 con 0x7f3a30143bc0 2024-04-25T02:15:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a2f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300b48e0 0x7f3a3013f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a2f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300b48e0 0x7f3a3013f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57786/0 (socket says 172.21.15.79:57786) 2024-04-25T02:15:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a2f7fe640 1 -- 172.21.15.79:0/3730909313 learned_addr learned my addr 172.21.15.79:0/3730909313 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a2ffff640 1 --2- 172.21.15.79:0/3730909313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a3006df50 0x7f3a301578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a34b3f640 1 --2- 172.21.15.79:0/3730909313 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a30143bc0 0x7f3a301f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a2f7fe640 1 -- 172.21.15.79:0/3730909313 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a30143bc0 msgr2=0x7f3a301f1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a2f7fe640 1 --2- 172.21.15.79:0/3730909313 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a30143bc0 0x7f3a301f1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a2f7fe640 1 -- 172.21.15.79:0/3730909313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a3006df50 msgr2=0x7f3a301578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a2f7fe640 1 --2- 172.21.15.79:0/3730909313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a3006df50 0x7f3a301578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a2f7fe640 1 -- 172.21.15.79:0/3730909313 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a30157df0 con 0x7f3a300b48e0 2024-04-25T02:15:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.846+0000 7f3a2ffff640 1 --2- 172.21.15.79:0/3730909313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a3006df50 0x7f3a301578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.847+0000 7f3a2f7fe640 1 --2- 172.21.15.79:0/3730909313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300b48e0 0x7f3a3013f010 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f3a24000c00 tx=0x7f3a240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.847+0000 7f3a2cff9640 1 -- 172.21.15.79:0/3730909313 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24041070 con 0x7f3a300b48e0 2024-04-25T02:15:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.847+0000 7f3a2cff9640 1 -- 172.21.15.79:0/3730909313 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a2403c870 con 0x7f3a300b48e0 2024-04-25T02:15:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.847+0000 7f3a365a2640 1 -- 172.21.15.79:0/3730909313 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a30141310 con 0x7f3a300b48e0 2024-04-25T02:15:42.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.847+0000 7f3a2cff9640 1 -- 172.21.15.79:0/3730909313 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24037040 con 0x7f3a300b48e0 2024-04-25T02:15:42.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.847+0000 7f3a365a2640 1 -- 172.21.15.79:0/3730909313 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a301418d0 con 0x7f3a300b48e0 2024-04-25T02:15:42.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.848+0000 7f3a365a2640 1 -- 172.21.15.79:0/3730909313 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a300690a0 con 0x7f3a300b48e0 2024-04-25T02:15:42.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.848+0000 7f3a2cff9640 1 -- 172.21.15.79:0/3730909313 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a24044070 con 0x7f3a300b48e0 2024-04-25T02:15:42.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.848+0000 7f3a2cff9640 1 --2- 172.21.15.79:0/3730909313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a1c06be30 0x7f3a1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:42.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.849+0000 7f3a2cff9640 1 -- 172.21.15.79:0/3730909313 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f3a240abcc0 con 0x7f3a300b48e0 2024-04-25T02:15:42.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.849+0000 7f3a2ffff640 1 --2- 172.21.15.79:0/3730909313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a1c06be30 0x7f3a1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:42.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.849+0000 7f3a2ffff640 1 --2- 172.21.15.79:0/3730909313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a1c06be30 0x7f3a1c06e2f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009930 tx=0x7f3a20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:42.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:42.853+0000 7f3a2cff9640 1 -- 172.21.15.79:0/3730909313 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3a2407a750 con 0x7f3a300b48e0 2024-04-25T02:15:43.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.027+0000 7f3a365a2640 1 -- 172.21.15.79:0/3730909313 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a300b4180 con 0x7f3a300b48e0 2024-04-25T02:15:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.028+0000 7f3a2cff9640 1 -- 172.21.15.79:0/3730909313 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+16979 (secure 0 0 0) 0x7f3a2407a050 con 0x7f3a300b48e0 2024-04-25T02:15:43.034 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:43.034 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":90,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:15:04.828059+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:13:41.594939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T02:13:42.348770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.2a","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/630320044":"2024-04-26T02:15:04.828036+0000","172.21.15.79:6836/630320044":"2024-04-26T02:15:04.828036+0000","172.21.15.79:6837/2290864495":"2024-04-26T02:13:53.595807+0000","172.21.15.79:6836/2290864495":"2024-04-26T02:13:53.595807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:15:43.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.030+0000 7f3a365a2640 1 -- 172.21.15.79:0/3730909313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a1c06be30 msgr2=0x7f3a1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.030+0000 7f3a365a2640 1 --2- 172.21.15.79:0/3730909313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a1c06be30 0x7f3a1c06e2f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009930 tx=0x7f3a20008040 comp rx=0 tx=0).stop 2024-04-25T02:15:43.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.030+0000 7f3a365a2640 1 -- 172.21.15.79:0/3730909313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300b48e0 msgr2=0x7f3a3013f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.030+0000 7f3a365a2640 1 --2- 172.21.15.79:0/3730909313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300b48e0 0x7f3a3013f010 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f3a24000c00 tx=0x7f3a240046c0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.030+0000 7f3a365a2640 1 -- 172.21.15.79:0/3730909313 shutdown_connections 2024-04-25T02:15:43.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.030+0000 7f3a365a2640 1 --2- 172.21.15.79:0/3730909313 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3a1c06be30 0x7f3a1c06e2f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.030+0000 7f3a365a2640 1 --2- 172.21.15.79:0/3730909313 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3a30143bc0 0x7f3a301f1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.030+0000 7f3a365a2640 1 --2- 172.21.15.79:0/3730909313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300b48e0 0x7f3a3013f010 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.030+0000 7f3a365a2640 1 --2- 172.21.15.79:0/3730909313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a3006df50 0x7f3a301578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.030+0000 7f3a365a2640 1 -- 172.21.15.79:0/3730909313 >> 172.21.15.79:0/3730909313 conn(0x7f3a300cfc80 msgr2=0x7f3a300ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:43.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.030+0000 7f3a365a2640 1 -- 172.21.15.79:0/3730909313 shutdown_connections 2024-04-25T02:15:43.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.030+0000 7f3a365a2640 1 -- 172.21.15.79:0/3730909313 wait complete. 2024-04-25T02:15:43.046 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:13:41.594939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:13:42.348770+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:15:43.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:15:43.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.142+0000 7f0019fed640 1 Processor -- start 2024-04-25T02:15:43.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.143+0000 7f0019fed640 1 -- start start 2024-04-25T02:15:43.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.143+0000 7f0019fed640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f00140d2ca0 0x7f00140d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.143+0000 7f0019fed640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f00140d0ef0 0x7f001406bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.143+0000 7f0019fed640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00140d1ee0 con 0x7f001415e4f0 2024-04-25T02:15:43.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.143+0000 7f0019fed640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f00140d3130 con 0x7f00140d0ef0 2024-04-25T02:15:43.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.143+0000 7f0019fed640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f00140d21c0 con 0x7f00140d2ca0 2024-04-25T02:15:43.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.143+0000 7f00137fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f001415e4f0 0x7f00140cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58544/0 (socket says 172.21.15.79:58544) 2024-04-25T02:15:43.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.143+0000 7f00137fe640 1 -- 172.21.15.79:0/4088843886 learned_addr learned my addr 172.21.15.79:0/4088843886 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:43.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.143+0000 7f0013fff640 1 --2- 172.21.15.79:0/4088843886 >> v2:172.21.15.79:3300/0 conn(0x7f00140d0ef0 0x7f001406bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.144+0000 7f000affd640 1 --2- 172.21.15.79:0/4088843886 >> v2:172.21.15.189:3300/0 conn(0x7f00140d2ca0 0x7f00140d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.144+0000 7f0013fff640 1 -- 172.21.15.79:0/4088843886 >> v2:172.21.15.189:3300/0 conn(0x7f00140d2ca0 msgr2=0x7f00140d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.144+0000 7f0013fff640 1 --2- 172.21.15.79:0/4088843886 >> v2:172.21.15.189:3300/0 conn(0x7f00140d2ca0 0x7f00140d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.144+0000 7f0013fff640 1 -- 172.21.15.79:0/4088843886 >> v1:172.21.15.79:6789/0 conn(0x7f001415e4f0 legacy=0x7f00140cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.144+0000 7f0013fff640 1 -- 172.21.15.79:0/4088843886 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00140d24a0 con 0x7f00140d0ef0 2024-04-25T02:15:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.144+0000 7f0012ffd640 1 -- 172.21.15.79:0/4088843886 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 730177023 0 0) 0x7f00140d1ee0 con 0x7f001415e4f0 2024-04-25T02:15:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.144+0000 7f0013fff640 1 --2- 172.21.15.79:0/4088843886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00140d0ef0 0x7f001406bc30 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f000c009d90 tx=0x7f000c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edbb15b8f435b877 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.145+0000 7f0012ffd640 1 -- 172.21.15.79:0/4088843886 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c007740 con 0x7f00140d0ef0 2024-04-25T02:15:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.145+0000 7f0012ffd640 1 -- 172.21.15.79:0/4088843886 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c0078e0 con 0x7f00140d0ef0 2024-04-25T02:15:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.145+0000 7f0012ffd640 1 -- 172.21.15.79:0/4088843886 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c007cb0 con 0x7f00140d0ef0 2024-04-25T02:15:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.145+0000 7f0019fed640 1 -- 172.21.15.79:0/4088843886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00140d0ef0 msgr2=0x7f001406bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.145+0000 7f0019fed640 1 --2- 172.21.15.79:0/4088843886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00140d0ef0 0x7f001406bc30 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f000c009d90 tx=0x7f000c02a6a0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.145+0000 7f0019fed640 1 -- 172.21.15.79:0/4088843886 shutdown_connections 2024-04-25T02:15:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.145+0000 7f0019fed640 1 --2- 172.21.15.79:0/4088843886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00140d0ef0 0x7f001406bc30 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.145+0000 7f0019fed640 1 --2- 172.21.15.79:0/4088843886 >> v2:172.21.15.189:3300/0 conn(0x7f00140d2ca0 0x7f00140d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.145+0000 7f0019fed640 1 -- 172.21.15.79:0/4088843886 >> 172.21.15.79:0/4088843886 conn(0x7f001409d4a0 msgr2=0x7f00140d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.145+0000 7f0019fed640 1 -- 172.21.15.79:0/4088843886 shutdown_connections 2024-04-25T02:15:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.145+0000 7f0019fed640 1 -- 172.21.15.79:0/4088843886 wait complete. 2024-04-25T02:15:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.146+0000 7f0019fed640 1 Processor -- start 2024-04-25T02:15:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.147+0000 7f0019fed640 1 -- start start 2024-04-25T02:15:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.147+0000 7f0019fed640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f00140d0ef0 0x7f00140c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.147+0000 7f0019fed640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00140d2ca0 0x7f0014154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.147+0000 7f0019fed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001415e4f0 0x7f00140cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.147+0000 7f0019fed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f00140d4ee0 con 0x7f001415e4f0 2024-04-25T02:15:43.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.147+0000 7f0019fed640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f00140cff00 con 0x7f00140d2ca0 2024-04-25T02:15:43.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.147+0000 7f0019fed640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f00140d5060 con 0x7f00140d0ef0 2024-04-25T02:15:43.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.147+0000 7f0013fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001415e4f0 0x7f00140cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.147+0000 7f0013fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001415e4f0 0x7f00140cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57806/0 (socket says 172.21.15.79:57806) 2024-04-25T02:15:43.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.147+0000 7f0013fff640 1 -- 172.21.15.79:0/3477647356 learned_addr learned my addr 172.21.15.79:0/3477647356 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:43.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.148+0000 7f000affd640 1 --2- 172.21.15.79:0/3477647356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00140d2ca0 0x7f0014154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.148+0000 7f00137fe640 1 --2- 172.21.15.79:0/3477647356 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f00140d0ef0 0x7f00140c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.148+0000 7f0013fff640 1 -- 172.21.15.79:0/3477647356 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f00140d0ef0 msgr2=0x7f00140c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.148+0000 7f0013fff640 1 --2- 172.21.15.79:0/3477647356 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f00140d0ef0 0x7f00140c7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.148+0000 7f0013fff640 1 -- 172.21.15.79:0/3477647356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00140d2ca0 msgr2=0x7f0014154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.148+0000 7f0013fff640 1 --2- 172.21.15.79:0/3477647356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00140d2ca0 0x7f0014154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.148+0000 7f0013fff640 1 -- 172.21.15.79:0/3477647356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00140c81e0 con 0x7f001415e4f0 2024-04-25T02:15:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.148+0000 7f0013fff640 1 --2- 172.21.15.79:0/3477647356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001415e4f0 0x7f00140cc5d0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f000c009eb0 tx=0x7f000c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.148+0000 7f0010ff9640 1 -- 172.21.15.79:0/3477647356 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c040070 con 0x7f001415e4f0 2024-04-25T02:15:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.148+0000 7f0010ff9640 1 -- 172.21.15.79:0/3477647356 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c031bc0 con 0x7f001415e4f0 2024-04-25T02:15:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.148+0000 7f0019fed640 1 -- 172.21.15.79:0/3477647356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00140c94d0 con 0x7f001415e4f0 2024-04-25T02:15:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.148+0000 7f0010ff9640 1 -- 172.21.15.79:0/3477647356 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c045460 con 0x7f001415e4f0 2024-04-25T02:15:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.148+0000 7f0019fed640 1 -- 172.21.15.79:0/3477647356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00140c8f10 con 0x7f001415e4f0 2024-04-25T02:15:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.149+0000 7f0019fed640 1 -- 172.21.15.79:0/3477647356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00140686c0 con 0x7f001415e4f0 2024-04-25T02:15:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.149+0000 7f0010ff9640 1 -- 172.21.15.79:0/3477647356 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f000c039040 con 0x7f001415e4f0 2024-04-25T02:15:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.150+0000 7f0010ff9640 1 --2- 172.21.15.79:0/3477647356 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efff406be30 0x7efff406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.150+0000 7f0010ff9640 1 -- 172.21.15.79:0/3477647356 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f000c0ac770 con 0x7f001415e4f0 2024-04-25T02:15:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.150+0000 7f00137fe640 1 --2- 172.21.15.79:0/3477647356 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efff406be30 0x7efff406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.150+0000 7f00137fe640 1 --2- 172.21.15.79:0/3477647356 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efff406be30 0x7efff406e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0004007fd0 tx=0x7f0004009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.154+0000 7f0010ff9640 1 -- 172.21.15.79:0/3477647356 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f000c07b0e0 con 0x7f001415e4f0 2024-04-25T02:15:43.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.326+0000 7f0019fed640 1 -- 172.21.15.79:0/3477647356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f00140690d0 con 0x7f001415e4f0 2024-04-25T02:15:43.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.326+0000 7f0010ff9640 1 -- 172.21.15.79:0/3477647356 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f00140690d0 con 0x7f001415e4f0 2024-04-25T02:15:43.332 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:15:43.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.328+0000 7f0019fed640 1 -- 172.21.15.79:0/3477647356 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efff406be30 msgr2=0x7efff406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.328+0000 7f0019fed640 1 --2- 172.21.15.79:0/3477647356 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efff406be30 0x7efff406e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0004007fd0 tx=0x7f0004009040 comp rx=0 tx=0).stop 2024-04-25T02:15:43.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.328+0000 7f0019fed640 1 -- 172.21.15.79:0/3477647356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001415e4f0 msgr2=0x7f00140cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.328+0000 7f0019fed640 1 --2- 172.21.15.79:0/3477647356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001415e4f0 0x7f00140cc5d0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f000c009eb0 tx=0x7f000c004a40 comp rx=0 tx=0).stop 2024-04-25T02:15:43.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.328+0000 7f0019fed640 1 -- 172.21.15.79:0/3477647356 shutdown_connections 2024-04-25T02:15:43.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.328+0000 7f0019fed640 1 --2- 172.21.15.79:0/3477647356 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efff406be30 0x7efff406e2f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.328+0000 7f0019fed640 1 --2- 172.21.15.79:0/3477647356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f001415e4f0 0x7f00140cc5d0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.328+0000 7f0019fed640 1 --2- 172.21.15.79:0/3477647356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00140d2ca0 0x7f0014154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.328+0000 7f0019fed640 1 --2- 172.21.15.79:0/3477647356 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f00140d0ef0 0x7f00140c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.328+0000 7f0019fed640 1 -- 172.21.15.79:0/3477647356 >> 172.21.15.79:0/3477647356 conn(0x7f001409d4a0 msgr2=0x7f00140d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:43.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.328+0000 7f0019fed640 1 -- 172.21.15.79:0/3477647356 shutdown_connections 2024-04-25T02:15:43.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.328+0000 7f0019fed640 1 -- 172.21.15.79:0/3477647356 wait complete. 2024-04-25T02:15:43.345 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:15:43.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.439+0000 7f7f81b70640 1 Processor -- start 2024-04-25T02:15:43.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.439+0000 7f7f81b70640 1 -- start start 2024-04-25T02:15:43.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f81b70640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7f7c0cf7a0 0x7f7f7c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f81b70640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f7c15ec20 con 0x7f7f7c06e6b0 2024-04-25T02:15:43.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f81b70640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f7c15ef00 con 0x7f7f7c06b2f0 2024-04-25T02:15:43.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f81b70640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f7f7c15f830 con 0x7f7f7c0cf7a0 2024-04-25T02:15:43.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7f7c06e6b0 0x7f7f7c15b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58554/0 (socket says 172.21.15.79:58554) 2024-04-25T02:15:43.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7bfff640 1 -- 172.21.15.79:0/3669846140 learned_addr learned my addr 172.21.15.79:0/3669846140 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:43.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7affd640 1 --2- 172.21.15.79:0/3669846140 >> v2:172.21.15.189:3300/0 conn(0x7f7f7c0cf7a0 0x7f7f7c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7a7fc640 1 -- 172.21.15.79:0/3669846140 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701976190 0 0) 0x7f7f7c15ec20 con 0x7f7f7c06e6b0 2024-04-25T02:15:43.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7a7fc640 1 -- 172.21.15.79:0/3669846140 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f64003520 con 0x7f7f7c06e6b0 2024-04-25T02:15:43.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7a7fc640 1 -- 172.21.15.79:0/3669846140 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2408310826 0 0) 0x7f7f64003520 con 0x7f7f7c06e6b0 2024-04-25T02:15:43.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7a7fc640 1 -- 172.21.15.79:0/3669846140 >> v2:172.21.15.189:3300/0 conn(0x7f7f7c0cf7a0 msgr2=0x7f7f7c0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:43.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7a7fc640 1 --2- 172.21.15.79:0/3669846140 >> v2:172.21.15.189:3300/0 conn(0x7f7f7c0cf7a0 0x7f7f7c0b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7a7fc640 1 -- 172.21.15.79:0/3669846140 >> v1:172.21.15.189:6789/0 conn(0x7f7f7c06b2f0 legacy=0x7f7f7c06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7a7fc640 1 -- 172.21.15.79:0/3669846140 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7c15f1e0 con 0x7f7f7c06e6b0 2024-04-25T02:15:43.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7a7fc640 1 -- 172.21.15.79:0/3669846140 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f7f740019f0 con 0x7f7f7c06e6b0 2024-04-25T02:15:43.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7a7fc640 1 -- 172.21.15.79:0/3669846140 >> v1:172.21.15.79:6789/0 conn(0x7f7f7c06e6b0 legacy=0x7f7f7c15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7a7fc640 1 --2- 172.21.15.79:0/3669846140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f640039b0 0x7f7f64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7a7fc640 1 --2- 172.21.15.79:0/3669846140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f64004800 0x7f7f64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7a7fc640 1 --2- 172.21.15.79:0/3669846140 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f640052e0 0x7f7f6400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7a7fc640 1 -- 172.21.15.79:0/3669846140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c15f830 con 0x7f7f640039b0 2024-04-25T02:15:43.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7a7fc640 1 -- 172.21.15.79:0/3669846140 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6400c1b0 con 0x7f7f64004800 2024-04-25T02:15:43.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7a7fc640 1 -- 172.21.15.79:0/3669846140 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7f6400c3b0 con 0x7f7f640052e0 2024-04-25T02:15:43.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7affd640 1 --2- 172.21.15.79:0/3669846140 >> v2:172.21.15.189:3300/0 conn(0x7f7f7c0cf7a0 0x7f7f7c0b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:43.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.440+0000 7f7f7b7fe640 1 --2- 172.21.15.79:0/3669846140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f640039b0 0x7f7f64003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.441+0000 7f7f7bfff640 1 --2- 172.21.15.79:0/3669846140 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f640052e0 0x7f7f6400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.441+0000 7f7f7affd640 1 --2- 172.21.15.79:0/3669846140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f64004800 0x7f7f64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.441+0000 7f7f7b7fe640 1 -- 172.21.15.79:0/3669846140 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f640052e0 msgr2=0x7f7f6400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:43.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.441+0000 7f7f7b7fe640 1 --2- 172.21.15.79:0/3669846140 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f640052e0 0x7f7f6400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.441+0000 7f7f7b7fe640 1 -- 172.21.15.79:0/3669846140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f64004800 msgr2=0x7f7f64004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:43.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.441+0000 7f7f7b7fe640 1 --2- 172.21.15.79:0/3669846140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f64004800 0x7f7f64004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.441+0000 7f7f7b7fe640 1 -- 172.21.15.79:0/3669846140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f64003520 con 0x7f7f640039b0 2024-04-25T02:15:43.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.441+0000 7f7f7bfff640 1 -- 172.21.15.79:0/3669846140 reap_dead start 2024-04-25T02:15:43.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.441+0000 7f7f7b7fe640 1 --2- 172.21.15.79:0/3669846140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f640039b0 0x7f7f64003dd0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c001720 tx=0x7f7f64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0aa1051b785c22c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:43.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.441+0000 7f7f7a7fc640 1 -- 172.21.15.79:0/3669846140 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c001370 con 0x7f7f640039b0 2024-04-25T02:15:43.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.442+0000 7f7f7a7fc640 1 -- 172.21.15.79:0/3669846140 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6c0052d0 con 0x7f7f640039b0 2024-04-25T02:15:43.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.442+0000 7f7f7a7fc640 1 -- 172.21.15.79:0/3669846140 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c02ab70 con 0x7f7f640039b0 2024-04-25T02:15:43.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.442+0000 7f7f81b70640 1 -- 172.21.15.79:0/3669846140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f640039b0 msgr2=0x7f7f64003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.442+0000 7f7f81b70640 1 --2- 172.21.15.79:0/3669846140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f640039b0 0x7f7f64003dd0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c001720 tx=0x7f7f64005830 comp rx=0 tx=0).stop 2024-04-25T02:15:43.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.442+0000 7f7f81b70640 1 -- 172.21.15.79:0/3669846140 shutdown_connections 2024-04-25T02:15:43.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.442+0000 7f7f81b70640 1 --2- 172.21.15.79:0/3669846140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f640039b0 0x7f7f64003dd0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.442+0000 7f7f81b70640 1 -- 172.21.15.79:0/3669846140 >> 172.21.15.79:0/3669846140 conn(0x7f7f7c0b1cd0 msgr2=0x7f7f7c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:43.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.442+0000 7f7f81b70640 1 -- 172.21.15.79:0/3669846140 shutdown_connections 2024-04-25T02:15:43.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.442+0000 7f7f81b70640 1 -- 172.21.15.79:0/3669846140 wait complete. 2024-04-25T02:15:43.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.443+0000 7f7f81b70640 1 Processor -- start 2024-04-25T02:15:43.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.443+0000 7f7f81b70640 1 -- start start 2024-04-25T02:15:43.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f81b70640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f640039b0 0x7f7f7c145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f81b70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7c1458d0 0x7f7f7c15b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f81b70640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f7c15b810 0x7f7f7c147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f81b70640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c06d160 con 0x7f7f7c1458d0 2024-04-25T02:15:43.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f81b70640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c06cfe0 con 0x7f7f7c15b810 2024-04-25T02:15:43.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f81b70640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7f7c0b4b50 con 0x7f7f640039b0 2024-04-25T02:15:43.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f7affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7c1458d0 0x7f7f7c15b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f7affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7c1458d0 0x7f7f7c15b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57832/0 (socket says 172.21.15.79:57832) 2024-04-25T02:15:43.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f7affd640 1 -- 172.21.15.79:0/2601111674 learned_addr learned my addr 172.21.15.79:0/2601111674 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:43.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f7bfff640 1 --2- 172.21.15.79:0/2601111674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f7c15b810 0x7f7f7c147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f7b7fe640 1 --2- 172.21.15.79:0/2601111674 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f640039b0 0x7f7f7c145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f7affd640 1 -- 172.21.15.79:0/2601111674 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f640039b0 msgr2=0x7f7f7c145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f7affd640 1 --2- 172.21.15.79:0/2601111674 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f640039b0 0x7f7f7c145060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f7affd640 1 -- 172.21.15.79:0/2601111674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f7c15b810 msgr2=0x7f7f7c147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f7affd640 1 --2- 172.21.15.79:0/2601111674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f7c15b810 0x7f7f7c147920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.444+0000 7f7f7affd640 1 -- 172.21.15.79:0/2601111674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7c15d140 con 0x7f7f7c1458d0 2024-04-25T02:15:43.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.445+0000 7f7f7affd640 1 --2- 172.21.15.79:0/2601111674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7c1458d0 0x7f7f7c15b2d0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f7f700107b0 tx=0x7f7f70010c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:43.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.445+0000 7f7f63fff640 1 -- 172.21.15.79:0/2601111674 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7001a020 con 0x7f7f7c1458d0 2024-04-25T02:15:43.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.445+0000 7f7f63fff640 1 -- 172.21.15.79:0/2601111674 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f7000eb60 con 0x7f7f7c1458d0 2024-04-25T02:15:43.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.445+0000 7f7f81b70640 1 -- 172.21.15.79:0/2601111674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7c15d3c0 con 0x7f7f7c1458d0 2024-04-25T02:15:43.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.445+0000 7f7f63fff640 1 -- 172.21.15.79:0/2601111674 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000f040 con 0x7f7f7c1458d0 2024-04-25T02:15:43.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.445+0000 7f7f81b70640 1 -- 172.21.15.79:0/2601111674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f7c148690 con 0x7f7f7c1458d0 2024-04-25T02:15:43.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.446+0000 7f7f81b70640 1 -- 172.21.15.79:0/2601111674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f7c0690a0 con 0x7f7f7c1458d0 2024-04-25T02:15:43.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.446+0000 7f7f63fff640 1 -- 172.21.15.79:0/2601111674 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f7001d020 con 0x7f7f7c1458d0 2024-04-25T02:15:43.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.447+0000 7f7f63fff640 1 --2- 172.21.15.79:0/2601111674 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7f6806be60 0x7f7f6806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.447+0000 7f7f63fff640 1 -- 172.21.15.79:0/2601111674 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f7f7008b7a0 con 0x7f7f7c1458d0 2024-04-25T02:15:43.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.447+0000 7f7f7b7fe640 1 --2- 172.21.15.79:0/2601111674 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7f6806be60 0x7f7f6806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.447+0000 7f7f7b7fe640 1 --2- 172.21.15.79:0/2601111674 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7f6806be60 0x7f7f6806e320 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c032000 tx=0x7f7f6c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:43.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.451+0000 7f7f63fff640 1 -- 172.21.15.79:0/2601111674 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7f70024020 con 0x7f7f7c1458d0 2024-04-25T02:15:43.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.623+0000 7f7f81b70640 1 -- 172.21.15.79:0/2601111674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7f7c0cf4f0 con 0x7f7f7c1458d0 2024-04-25T02:15:43.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.624+0000 7f7f63fff640 1 -- 172.21.15.79:0/2601111674 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f7f7c15d140 con 0x7f7f7c1458d0 2024-04-25T02:15:43.629 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:15:43.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.625+0000 7f7f81b70640 1 -- 172.21.15.79:0/2601111674 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7f6806be60 msgr2=0x7f7f6806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.625+0000 7f7f81b70640 1 --2- 172.21.15.79:0/2601111674 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7f6806be60 0x7f7f6806e320 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c032000 tx=0x7f7f6c02e000 comp rx=0 tx=0).stop 2024-04-25T02:15:43.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.625+0000 7f7f81b70640 1 -- 172.21.15.79:0/2601111674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7c1458d0 msgr2=0x7f7f7c15b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.625+0000 7f7f81b70640 1 --2- 172.21.15.79:0/2601111674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7c1458d0 0x7f7f7c15b2d0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f7f700107b0 tx=0x7f7f70010c70 comp rx=0 tx=0).stop 2024-04-25T02:15:43.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.626+0000 7f7f81b70640 1 -- 172.21.15.79:0/2601111674 shutdown_connections 2024-04-25T02:15:43.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.626+0000 7f7f81b70640 1 --2- 172.21.15.79:0/2601111674 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7f6806be60 0x7f7f6806e320 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.626+0000 7f7f81b70640 1 --2- 172.21.15.79:0/2601111674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f7c15b810 0x7f7f7c147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.626+0000 7f7f81b70640 1 --2- 172.21.15.79:0/2601111674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7c1458d0 0x7f7f7c15b2d0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.626+0000 7f7f81b70640 1 --2- 172.21.15.79:0/2601111674 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f640039b0 0x7f7f7c145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.626+0000 7f7f81b70640 1 -- 172.21.15.79:0/2601111674 >> 172.21.15.79:0/2601111674 conn(0x7f7f7c0b1cd0 msgr2=0x7f7f7c1552b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:43.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.626+0000 7f7f81b70640 1 -- 172.21.15.79:0/2601111674 shutdown_connections 2024-04-25T02:15:43.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.626+0000 7f7f81b70640 1 -- 172.21.15.79:0/2601111674 wait complete. 2024-04-25T02:15:43.642 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:15:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.736+0000 7fc513bab640 1 Processor -- start 2024-04-25T02:15:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.736+0000 7fc513bab640 1 -- start start 2024-04-25T02:15:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc513bab640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc50c0b41b0 0x7fc50c1605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc513bab640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc50c06b2f0 0x7fc50c06b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc513bab640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc50c155f00 0x7fc50c156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc513bab640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc50c071cd0 con 0x7fc50c0b41b0 2024-04-25T02:15:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc513bab640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc50c071fb0 con 0x7fc50c155f00 2024-04-25T02:15:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc513bab640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc50c072290 con 0x7fc50c06b2f0 2024-04-25T02:15:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc511947640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc50c0b41b0 0x7fc50c1605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc511947640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc50c0b41b0 0x7fc50c1605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51532/0 (socket says 172.21.15.79:51532) 2024-04-25T02:15:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc511947640 1 -- 172.21.15.79:0/3894267379 learned_addr learned my addr 172.21.15.79:0/3894267379 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc511146640 1 --2- 172.21.15.79:0/3894267379 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc50c06b2f0 0x7fc50c06b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc512148640 1 --2- 172.21.15.79:0/3894267379 >> v2:172.21.15.189:3300/0 conn(0x7fc50c155f00 0x7fc50c156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc511947640 1 -- 172.21.15.79:0/3894267379 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc50c06b2f0 msgr2=0x7fc50c06b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc511947640 1 --2- 172.21.15.79:0/3894267379 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc50c06b2f0 0x7fc50c06b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc511947640 1 -- 172.21.15.79:0/3894267379 >> v2:172.21.15.189:3300/0 conn(0x7fc50c155f00 msgr2=0x7fc50c156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc511947640 1 --2- 172.21.15.79:0/3894267379 >> v2:172.21.15.189:3300/0 conn(0x7fc50c155f00 0x7fc50c156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.737+0000 7fc511947640 1 -- 172.21.15.79:0/3894267379 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c072570 con 0x7fc50c0b41b0 2024-04-25T02:15:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.738+0000 7fc511947640 1 --2- 172.21.15.79:0/3894267379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc50c0b41b0 0x7fc50c1605d0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fc50c06f240 tx=0x7fc50802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ae0387101bd462 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.738+0000 7fc510945640 1 -- 172.21.15.79:0/3894267379 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc508037070 con 0x7fc50c0b41b0 2024-04-25T02:15:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.738+0000 7fc510945640 1 -- 172.21.15.79:0/3894267379 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc508032440 con 0x7fc50c0b41b0 2024-04-25T02:15:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.738+0000 7fc510945640 1 -- 172.21.15.79:0/3894267379 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc508032810 con 0x7fc50c0b41b0 2024-04-25T02:15:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.738+0000 7fc513bab640 1 -- 172.21.15.79:0/3894267379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc50c0b41b0 msgr2=0x7fc50c1605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.738+0000 7fc513bab640 1 --2- 172.21.15.79:0/3894267379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc50c0b41b0 0x7fc50c1605d0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fc50c06f240 tx=0x7fc50802a1e0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.739+0000 7fc513bab640 1 -- 172.21.15.79:0/3894267379 shutdown_connections 2024-04-25T02:15:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.739+0000 7fc513bab640 1 --2- 172.21.15.79:0/3894267379 >> v2:172.21.15.189:3300/0 conn(0x7fc50c155f00 0x7fc50c156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.739+0000 7fc513bab640 1 --2- 172.21.15.79:0/3894267379 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc50c06b2f0 0x7fc50c06b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.739+0000 7fc513bab640 1 --2- 172.21.15.79:0/3894267379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc50c0b41b0 0x7fc50c1605d0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.739+0000 7fc513bab640 1 -- 172.21.15.79:0/3894267379 >> 172.21.15.79:0/3894267379 conn(0x7fc50c0b1cd0 msgr2=0x7fc50c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.739+0000 7fc513bab640 1 -- 172.21.15.79:0/3894267379 shutdown_connections 2024-04-25T02:15:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.739+0000 7fc513bab640 1 -- 172.21.15.79:0/3894267379 wait complete. 2024-04-25T02:15:43.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.740+0000 7fc513bab640 1 Processor -- start 2024-04-25T02:15:43.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.740+0000 7fc513bab640 1 -- start start 2024-04-25T02:15:43.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.740+0000 7fc513bab640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc50c06b2f0 0x7fc50c14fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.740+0000 7fc513bab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc50c0b41b0 0x7fc50c14f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.740+0000 7fc513bab640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc50c155f00 0x7fc50c0d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.740+0000 7fc513bab640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c15c870 con 0x7fc50c0b41b0 2024-04-25T02:15:43.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.740+0000 7fc513bab640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c072d70 con 0x7fc50c155f00 2024-04-25T02:15:43.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc513bab640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc50c0b4590 con 0x7fc50c06b2f0 2024-04-25T02:15:43.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc511146640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc50c0b41b0 0x7fc50c14f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc511146640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc50c0b41b0 0x7fc50c14f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51540/0 (socket says 172.21.15.79:51540) 2024-04-25T02:15:43.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc511146640 1 -- 172.21.15.79:0/668391467 learned_addr learned my addr 172.21.15.79:0/668391467 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:43.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc511947640 1 --2- 172.21.15.79:0/668391467 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc50c06b2f0 0x7fc50c14fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc512148640 1 --2- 172.21.15.79:0/668391467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc50c155f00 0x7fc50c0d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc511146640 1 -- 172.21.15.79:0/668391467 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc50c06b2f0 msgr2=0x7fc50c14fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc511146640 1 --2- 172.21.15.79:0/668391467 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc50c06b2f0 0x7fc50c14fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc511146640 1 -- 172.21.15.79:0/668391467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc50c155f00 msgr2=0x7fc50c0d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc511146640 1 --2- 172.21.15.79:0/668391467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc50c155f00 0x7fc50c0d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc511146640 1 -- 172.21.15.79:0/668391467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c0cf5f0 con 0x7fc50c0b41b0 2024-04-25T02:15:43.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc511146640 1 --2- 172.21.15.79:0/668391467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc50c0b41b0 0x7fc50c14f4c0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00d830 tx=0x7fc4fc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:43.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc5027fc640 1 -- 172.21.15.79:0/668391467 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc00b6c0 con 0x7fc50c0b41b0 2024-04-25T02:15:43.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc5027fc640 1 -- 172.21.15.79:0/668391467 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4fc019070 con 0x7fc50c0b41b0 2024-04-25T02:15:43.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc513bab640 1 -- 172.21.15.79:0/668391467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50c0cf8d0 con 0x7fc50c0b41b0 2024-04-25T02:15:43.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc5027fc640 1 -- 172.21.15.79:0/668391467 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc00ba80 con 0x7fc50c0b41b0 2024-04-25T02:15:43.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.741+0000 7fc513bab640 1 -- 172.21.15.79:0/668391467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50c0d08f0 con 0x7fc50c0b41b0 2024-04-25T02:15:43.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.742+0000 7fc513bab640 1 -- 172.21.15.79:0/668391467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc50c0690a0 con 0x7fc50c0b41b0 2024-04-25T02:15:43.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.743+0000 7fc5027fc640 1 -- 172.21.15.79:0/668391467 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4fc01e460 con 0x7fc50c0b41b0 2024-04-25T02:15:43.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.743+0000 7fc5027fc640 1 --2- 172.21.15.79:0/668391467 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc4f006be60 0x7fc4f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:43.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.743+0000 7fc5027fc640 1 -- 172.21.15.79:0/668391467 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7fc4fc08b4c0 con 0x7fc50c0b41b0 2024-04-25T02:15:43.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.743+0000 7fc511947640 1 --2- 172.21.15.79:0/668391467 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc4f006be60 0x7fc4f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:43.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.744+0000 7fc511947640 1 --2- 172.21.15.79:0/668391467 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc4f006be60 0x7fc4f006e320 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc508034000 tx=0x7fc50802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:43.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.747+0000 7fc5027fc640 1 -- 172.21.15.79:0/668391467 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc4fc059e30 con 0x7fc50c0b41b0 2024-04-25T02:15:43.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.921+0000 7fc513bab640 1 -- 172.21.15.79:0/668391467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc50c0cc460 con 0x7fc50c0b41b0 2024-04-25T02:15:43.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.921+0000 7fc5027fc640 1 -- 172.21.15.79:0/668391467 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7fc4fc059730 con 0x7fc50c0b41b0 2024-04-25T02:15:43.928 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:15:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.923+0000 7fc513bab640 1 -- 172.21.15.79:0/668391467 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc4f006be60 msgr2=0x7fc4f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.923+0000 7fc513bab640 1 --2- 172.21.15.79:0/668391467 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc4f006be60 0x7fc4f006e320 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc508034000 tx=0x7fc50802e000 comp rx=0 tx=0).stop 2024-04-25T02:15:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.923+0000 7fc513bab640 1 -- 172.21.15.79:0/668391467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc50c0b41b0 msgr2=0x7fc50c14f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.923+0000 7fc513bab640 1 --2- 172.21.15.79:0/668391467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc50c0b41b0 0x7fc50c14f4c0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00d830 tx=0x7fc4fc00dcf0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.923+0000 7fc513bab640 1 -- 172.21.15.79:0/668391467 shutdown_connections 2024-04-25T02:15:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.923+0000 7fc513bab640 1 --2- 172.21.15.79:0/668391467 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc4f006be60 0x7fc4f006e320 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.923+0000 7fc513bab640 1 --2- 172.21.15.79:0/668391467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc50c155f00 0x7fc50c0d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.923+0000 7fc513bab640 1 --2- 172.21.15.79:0/668391467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc50c0b41b0 0x7fc50c14f4c0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.923+0000 7fc513bab640 1 --2- 172.21.15.79:0/668391467 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc50c06b2f0 0x7fc50c14fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:43.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.923+0000 7fc513bab640 1 -- 172.21.15.79:0/668391467 >> 172.21.15.79:0/668391467 conn(0x7fc50c0b1cd0 msgr2=0x7fc50c0b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:43.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.923+0000 7fc513bab640 1 -- 172.21.15.79:0/668391467 shutdown_connections 2024-04-25T02:15:43.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:43.923+0000 7fc513bab640 1 -- 172.21.15.79:0/668391467 wait complete. 2024-04-25T02:15:43.939 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:15:44.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.040+0000 7f5cefcb3640 1 Processor -- start 2024-04-25T02:15:44.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.040+0000 7f5cefcb3640 1 -- start start 2024-04-25T02:15:44.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5cefcb3640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ce806e3b0 0x7f5ce80b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5cefcb3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ce8071e00 con 0x7f5ce806df50 2024-04-25T02:15:44.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5cefcb3640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ce80720a0 con 0x7f5ce8143bc0 2024-04-25T02:15:44.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5cefcb3640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce8072cb0 con 0x7f5ce806e3b0 2024-04-25T02:15:44.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ced24e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5ce806df50 0x7f5ce80b2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60550/0 (socket says 172.21.15.79:60550) 2024-04-25T02:15:44.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ced24e640 1 -- 172.21.15.79:0/3528333942 learned_addr learned my addr 172.21.15.79:0/3528333942 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:44.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5cee250640 1 --2- 172.21.15.79:0/3528333942 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ce806e3b0 0x7f5ce80b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceca4d640 1 -- 172.21.15.79:0/3528333942 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2056625703 0 0) 0x7f5ce8071e00 con 0x7f5ce806df50 2024-04-25T02:15:44.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceca4d640 1 -- 172.21.15.79:0/3528333942 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cd4003520 con 0x7f5ce806df50 2024-04-25T02:15:44.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceca4d640 1 -- 172.21.15.79:0/3528333942 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3713097070 0 0) 0x7f5cd4003520 con 0x7f5ce806df50 2024-04-25T02:15:44.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceca4d640 1 -- 172.21.15.79:0/3528333942 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ce806e3b0 msgr2=0x7f5ce80b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:44.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceca4d640 1 --2- 172.21.15.79:0/3528333942 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ce806e3b0 0x7f5ce80b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceca4d640 1 -- 172.21.15.79:0/3528333942 >> v1:172.21.15.189:6789/0 conn(0x7f5ce8143bc0 legacy=0x7f5ce815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceca4d640 1 -- 172.21.15.79:0/3528333942 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce8072380 con 0x7f5ce806df50 2024-04-25T02:15:44.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceca4d640 1 -- 172.21.15.79:0/3528333942 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f5cd8001670 con 0x7f5ce806df50 2024-04-25T02:15:44.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceca4d640 1 -- 172.21.15.79:0/3528333942 >> v1:172.21.15.79:6789/0 conn(0x7f5ce806df50 legacy=0x7f5ce80b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceca4d640 1 --2- 172.21.15.79:0/3528333942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cd40039e0 0x7f5cd4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceca4d640 1 --2- 172.21.15.79:0/3528333942 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ce806e3b0 0x7f5cd4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceca4d640 1 --2- 172.21.15.79:0/3528333942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cd4004d40 0x7f5cd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceca4d640 1 -- 172.21.15.79:0/3528333942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce8072cb0 con 0x7f5cd40039e0 2024-04-25T02:15:44.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceca4d640 1 -- 172.21.15.79:0/3528333942 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd400baa0 con 0x7f5cd4004d40 2024-04-25T02:15:44.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceca4d640 1 -- 172.21.15.79:0/3528333942 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5cd400deb0 con 0x7f5ce806e3b0 2024-04-25T02:15:44.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.041+0000 7f5ceda4f640 1 --2- 172.21.15.79:0/3528333942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cd40039e0 0x7f5cd4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.042+0000 7f5cee250640 1 --2- 172.21.15.79:0/3528333942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cd4004d40 0x7f5cd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.042+0000 7f5ced24e640 1 --2- 172.21.15.79:0/3528333942 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ce806e3b0 0x7f5cd4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.042+0000 7f5ceda4f640 1 -- 172.21.15.79:0/3528333942 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ce806e3b0 msgr2=0x7f5cd4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:44.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.042+0000 7f5ceda4f640 1 --2- 172.21.15.79:0/3528333942 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ce806e3b0 0x7f5cd4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.042+0000 7f5ceda4f640 1 -- 172.21.15.79:0/3528333942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cd4004d40 msgr2=0x7f5cd40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:44.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.042+0000 7f5ceda4f640 1 --2- 172.21.15.79:0/3528333942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cd4004d40 0x7f5cd40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.042+0000 7f5ceda4f640 1 -- 172.21.15.79:0/3528333942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd4003520 con 0x7f5cd40039e0 2024-04-25T02:15:44.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.042+0000 7f5ceda4f640 1 --2- 172.21.15.79:0/3528333942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cd40039e0 0x7f5cd4003dc0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4001860 tx=0x7f5cd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84df25f09926ce2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:44.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.042+0000 7f5ceca4d640 1 -- 172.21.15.79:0/3528333942 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4037070 con 0x7f5cd40039e0 2024-04-25T02:15:44.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.043+0000 7f5ceca4d640 1 -- 172.21.15.79:0/3528333942 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce402ac30 con 0x7f5cd40039e0 2024-04-25T02:15:44.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.043+0000 7f5ceca4d640 1 -- 172.21.15.79:0/3528333942 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4001430 con 0x7f5cd40039e0 2024-04-25T02:15:44.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.043+0000 7f5cefcb3640 1 -- 172.21.15.79:0/3528333942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cd40039e0 msgr2=0x7f5cd4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.043+0000 7f5cefcb3640 1 --2- 172.21.15.79:0/3528333942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cd40039e0 0x7f5cd4003dc0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4001860 tx=0x7f5cd4005830 comp rx=0 tx=0).stop 2024-04-25T02:15:44.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.043+0000 7f5cee250640 1 -- 172.21.15.79:0/3528333942 reap_dead start 2024-04-25T02:15:44.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.043+0000 7f5cefcb3640 1 -- 172.21.15.79:0/3528333942 shutdown_connections 2024-04-25T02:15:44.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.043+0000 7f5cefcb3640 1 -- 172.21.15.79:0/3528333942 >> 172.21.15.79:0/3528333942 conn(0x7f5ce80cfc80 msgr2=0x7f5ce80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:44.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.043+0000 7f5cefcb3640 1 -- 172.21.15.79:0/3528333942 shutdown_connections 2024-04-25T02:15:44.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.043+0000 7f5cefcb3640 1 -- 172.21.15.79:0/3528333942 wait complete. 2024-04-25T02:15:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.044+0000 7f5cefcb3640 1 Processor -- start 2024-04-25T02:15:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.044+0000 7f5cefcb3640 1 -- start start 2024-04-25T02:15:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5cefcb3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cd40039e0 0x7f5ce813f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5cefcb3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ce81f0380 0x7f5ce8158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5cefcb3640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ce80b4ab0 0x7f5ce80b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5cefcb3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce806e840 con 0x7f5cd40039e0 2024-04-25T02:15:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5cefcb3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce8072940 con 0x7f5ce81f0380 2024-04-25T02:15:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5cefcb3640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce8143fa0 con 0x7f5ce80b4ab0 2024-04-25T02:15:44.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5ceda4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cd40039e0 0x7f5ce813f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5ceda4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cd40039e0 0x7f5ce813f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51554/0 (socket says 172.21.15.79:51554) 2024-04-25T02:15:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5ceda4f640 1 -- 172.21.15.79:0/1892780132 learned_addr learned my addr 172.21.15.79:0/1892780132 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5ceda4f640 1 -- 172.21.15.79:0/1892780132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ce80b4ab0 msgr2=0x7f5ce80b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5ced24e640 1 --2- 172.21.15.79:0/1892780132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ce81f0380 0x7f5ce8158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5cee250640 1 --2- 172.21.15.79:0/1892780132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ce80b4ab0 0x7f5ce80b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5ceda4f640 1 --2- 172.21.15.79:0/1892780132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ce80b4ab0 0x7f5ce80b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5ceda4f640 1 -- 172.21.15.79:0/1892780132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ce81f0380 msgr2=0x7f5ce8158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5ceda4f640 1 --2- 172.21.15.79:0/1892780132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ce81f0380 0x7f5ce8158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5ceda4f640 1 -- 172.21.15.79:0/1892780132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce8140090 con 0x7f5cd40039e0 2024-04-25T02:15:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.045+0000 7f5ceda4f640 1 --2- 172.21.15.79:0/1892780132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cd40039e0 0x7f5ce813f7a0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4000c00 tx=0x7f5ce4001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.046+0000 7f5cde7fc640 1 -- 172.21.15.79:0/1892780132 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4040020 con 0x7f5cd40039e0 2024-04-25T02:15:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.046+0000 7f5cde7fc640 1 -- 172.21.15.79:0/1892780132 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce4005270 con 0x7f5cd40039e0 2024-04-25T02:15:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.046+0000 7f5cefcb3640 1 -- 172.21.15.79:0/1892780132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce8159800 con 0x7f5cd40039e0 2024-04-25T02:15:44.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.046+0000 7f5cde7fc640 1 -- 172.21.15.79:0/1892780132 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4037040 con 0x7f5cd40039e0 2024-04-25T02:15:44.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.046+0000 7f5cefcb3640 1 -- 172.21.15.79:0/1892780132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce8159dc0 con 0x7f5cd40039e0 2024-04-25T02:15:44.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.047+0000 7f5cefcb3640 1 -- 172.21.15.79:0/1892780132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce80690a0 con 0x7f5cd40039e0 2024-04-25T02:15:44.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.047+0000 7f5cde7fc640 1 -- 172.21.15.79:0/1892780132 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ce4043020 con 0x7f5cd40039e0 2024-04-25T02:15:44.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.047+0000 7f5cde7fc640 1 --2- 172.21.15.79:0/1892780132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5ccc06be30 0x7f5ccc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.047+0000 7f5cde7fc640 1 -- 172.21.15.79:0/1892780132 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f5ce40aafe0 con 0x7f5cd40039e0 2024-04-25T02:15:44.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.047+0000 7f5ced24e640 1 --2- 172.21.15.79:0/1892780132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5ccc06be30 0x7f5ccc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.048+0000 7f5ced24e640 1 --2- 172.21.15.79:0/1892780132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5ccc06be30 0x7f5ccc06e2f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8001eb0 tx=0x7f5cd8001da0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:44.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.052+0000 7f5cde7fc640 1 -- 172.21.15.79:0/1892780132 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5ce404a030 con 0x7f5cd40039e0 2024-04-25T02:15:44.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.239+0000 7f5cefcb3640 1 -- 172.21.15.79:0/1892780132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5ce815e1f0 con 0x7f5cd40039e0 2024-04-25T02:15:44.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.240+0000 7f5cde7fc640 1 -- 172.21.15.79:0/1892780132 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v90) ==== 80+0+242 (secure 0 0 0) 0x7f5ce4079950 con 0x7f5cd40039e0 2024-04-25T02:15:44.245 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6837/630320044 2024-04-26T02:15:04.828036+0000 2024-04-25T02:15:44.245 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6836/630320044 2024-04-26T02:15:04.828036+0000 2024-04-25T02:15:44.245 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6837/2290864495 2024-04-26T02:13:53.595807+0000 2024-04-25T02:15:44.245 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6836/2290864495 2024-04-26T02:13:53.595807+0000 2024-04-25T02:15:44.246 INFO:teuthology.orchestra.run.smithi079.stderr:listed 4 entries 2024-04-25T02:15:44.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.242+0000 7f5cefcb3640 1 -- 172.21.15.79:0/1892780132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5ccc06be30 msgr2=0x7f5ccc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.242+0000 7f5cefcb3640 1 --2- 172.21.15.79:0/1892780132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5ccc06be30 0x7f5ccc06e2f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8001eb0 tx=0x7f5cd8001da0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.242+0000 7f5cefcb3640 1 -- 172.21.15.79:0/1892780132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cd40039e0 msgr2=0x7f5ce813f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.242+0000 7f5cefcb3640 1 --2- 172.21.15.79:0/1892780132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cd40039e0 0x7f5ce813f7a0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4000c00 tx=0x7f5ce4001230 comp rx=0 tx=0).stop 2024-04-25T02:15:44.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.242+0000 7f5cefcb3640 1 -- 172.21.15.79:0/1892780132 shutdown_connections 2024-04-25T02:15:44.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.242+0000 7f5cefcb3640 1 --2- 172.21.15.79:0/1892780132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5ccc06be30 0x7f5ccc06e2f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.242+0000 7f5cefcb3640 1 --2- 172.21.15.79:0/1892780132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ce80b4ab0 0x7f5ce80b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.242+0000 7f5cefcb3640 1 --2- 172.21.15.79:0/1892780132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ce81f0380 0x7f5ce8158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.242+0000 7f5cefcb3640 1 --2- 172.21.15.79:0/1892780132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cd40039e0 0x7f5ce813f7a0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.242+0000 7f5cefcb3640 1 -- 172.21.15.79:0/1892780132 >> 172.21.15.79:0/1892780132 conn(0x7f5ce80cfc80 msgr2=0x7f5ce8070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:44.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.242+0000 7f5cefcb3640 1 -- 172.21.15.79:0/1892780132 shutdown_connections 2024-04-25T02:15:44.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.242+0000 7f5cefcb3640 1 -- 172.21.15.79:0/1892780132 wait complete. 2024-04-25T02:15:44.258 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:15:44.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:15:44.258 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:15:44.294 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:15:44.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:15:44.294 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:15:44.355 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:15:44.355 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:15:44.356 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:15:44.381 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:15:44.381 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:15:44.381 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:15:44.381 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:15:44.421 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:15:44.421 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:15:44.421 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:15:44.421 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:15:44.443 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:15:44.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:15:44.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.555+0000 7faeec638640 1 Processor -- start 2024-04-25T02:15:44.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.555+0000 7faeec638640 1 -- start start 2024-04-25T02:15:44.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.556+0000 7faeec638640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faee406df50 0x7faee406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.556+0000 7faeec638640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee40b2d30 0x7faee40b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.556+0000 7faeec638640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faee4071e00 con 0x7faee4143bc0 2024-04-25T02:15:44.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.556+0000 7faeec638640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7faee406e8f0 con 0x7faee406df50 2024-04-25T02:15:44.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.556+0000 7faeec638640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faee4072cb0 con 0x7faee40b2d30 2024-04-25T02:15:44.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.556+0000 7faee9bd3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faee406df50 0x7faee406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.556+0000 7faeea3d4640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faee4143bc0 0x7faee415f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60566/0 (socket says 172.21.15.79:60566) 2024-04-25T02:15:44.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.556+0000 7faeea3d4640 1 -- 172.21.15.79:0/235273426 learned_addr learned my addr 172.21.15.79:0/235273426 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:44.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.556+0000 7faee9bd3640 1 -- 172.21.15.79:0/235273426 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee40b2d30 msgr2=0x7faee40b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:44.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.556+0000 7faeeabd5640 1 --2- 172.21.15.79:0/235273426 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee40b2d30 0x7faee40b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.556+0000 7faee9bd3640 1 --2- 172.21.15.79:0/235273426 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee40b2d30 0x7faee40b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.556+0000 7faee9bd3640 1 -- 172.21.15.79:0/235273426 >> v1:172.21.15.79:6789/0 conn(0x7faee4143bc0 legacy=0x7faee415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.556+0000 7faee93d2640 1 -- 172.21.15.79:0/235273426 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 673539273 0 0) 0x7faee4071e00 con 0x7faee4143bc0 2024-04-25T02:15:44.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.556+0000 7faee9bd3640 1 -- 172.21.15.79:0/235273426 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee40720a0 con 0x7faee406df50 2024-04-25T02:15:44.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.556+0000 7faeeabd5640 1 --2- 172.21.15.79:0/235273426 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee40b2d30 0x7faee40b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:44.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.557+0000 7faee9bd3640 1 --2- 172.21.15.79:0/235273426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee406df50 0x7faee406e3b0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7faee00097a0 tx=0x7faee002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51809f7ae0cb64c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:44.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.557+0000 7faee93d2640 1 -- 172.21.15.79:0/235273426 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0037070 con 0x7faee406df50 2024-04-25T02:15:44.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.557+0000 7faee93d2640 1 -- 172.21.15.79:0/235273426 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee002ae50 con 0x7faee406df50 2024-04-25T02:15:44.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.557+0000 7faee93d2640 1 -- 172.21.15.79:0/235273426 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0032660 con 0x7faee406df50 2024-04-25T02:15:44.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.557+0000 7faeec638640 1 -- 172.21.15.79:0/235273426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee406df50 msgr2=0x7faee406e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.557+0000 7faeec638640 1 --2- 172.21.15.79:0/235273426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee406df50 0x7faee406e3b0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7faee00097a0 tx=0x7faee002a100 comp rx=0 tx=0).stop 2024-04-25T02:15:44.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.557+0000 7faeec638640 1 -- 172.21.15.79:0/235273426 shutdown_connections 2024-04-25T02:15:44.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.557+0000 7faeec638640 1 --2- 172.21.15.79:0/235273426 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee40b2d30 0x7faee40b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.557+0000 7faeec638640 1 --2- 172.21.15.79:0/235273426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee406df50 0x7faee406e3b0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.557+0000 7faeec638640 1 -- 172.21.15.79:0/235273426 >> 172.21.15.79:0/235273426 conn(0x7faee40cfc80 msgr2=0x7faee40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:44.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.558+0000 7faeec638640 1 -- 172.21.15.79:0/235273426 shutdown_connections 2024-04-25T02:15:44.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.558+0000 7faeec638640 1 -- 172.21.15.79:0/235273426 wait complete. 2024-04-25T02:15:44.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.559+0000 7faeec638640 1 Processor -- start 2024-04-25T02:15:44.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.559+0000 7faeec638640 1 -- start start 2024-04-25T02:15:44.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.559+0000 7faeec638640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee406df50 0x7faee413e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.559+0000 7faeec638640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee40b2d30 0x7faee40aa110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.559+0000 7faeec638640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee4143bc0 0x7faee40aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.559+0000 7faeec638640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faee4072940 con 0x7faee40b2d30 2024-04-25T02:15:44.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.559+0000 7faeec638640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faee4072660 con 0x7faee406df50 2024-04-25T02:15:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.559+0000 7faeec638640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faee4143fa0 con 0x7faee4143bc0 2024-04-25T02:15:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.559+0000 7faee9bd3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee40b2d30 0x7faee40aa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.559+0000 7faee9bd3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee40b2d30 0x7faee40aa110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51580/0 (socket says 172.21.15.79:51580) 2024-04-25T02:15:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.559+0000 7faee9bd3640 1 -- 172.21.15.79:0/2889329014 learned_addr learned my addr 172.21.15.79:0/2889329014 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.560+0000 7faeeabd5640 1 --2- 172.21.15.79:0/2889329014 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee4143bc0 0x7faee40aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.560+0000 7faee9bd3640 1 -- 172.21.15.79:0/2889329014 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee4143bc0 msgr2=0x7faee40aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.560+0000 7faeea3d4640 1 --2- 172.21.15.79:0/2889329014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee406df50 0x7faee413e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.560+0000 7faee9bd3640 1 --2- 172.21.15.79:0/2889329014 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee4143bc0 0x7faee40aa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.560+0000 7faee9bd3640 1 -- 172.21.15.79:0/2889329014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee406df50 msgr2=0x7faee413e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.560+0000 7faee9bd3640 1 --2- 172.21.15.79:0/2889329014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee406df50 0x7faee413e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.560+0000 7faee9bd3640 1 -- 172.21.15.79:0/2889329014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee415d050 con 0x7faee40b2d30 2024-04-25T02:15:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.560+0000 7faeeabd5640 1 --2- 172.21.15.79:0/2889329014 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee4143bc0 0x7faee40aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.560+0000 7faee9bd3640 1 --2- 172.21.15.79:0/2889329014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee40b2d30 0x7faee40aa110 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7faee0000c00 tx=0x7faee00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.560+0000 7faedaffd640 1 -- 172.21.15.79:0/2889329014 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0042070 con 0x7faee40b2d30 2024-04-25T02:15:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.560+0000 7faedaffd640 1 -- 172.21.15.79:0/2889329014 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee003e670 con 0x7faee40b2d30 2024-04-25T02:15:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.560+0000 7faedaffd640 1 -- 172.21.15.79:0/2889329014 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0037040 con 0x7faee40b2d30 2024-04-25T02:15:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.560+0000 7faeec638640 1 -- 172.21.15.79:0/2889329014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee415d330 con 0x7faee40b2d30 2024-04-25T02:15:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.560+0000 7faeec638640 1 -- 172.21.15.79:0/2889329014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee415d8f0 con 0x7faee40b2d30 2024-04-25T02:15:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.561+0000 7faeec638640 1 -- 172.21.15.79:0/2889329014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee40690a0 con 0x7faee40b2d30 2024-04-25T02:15:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.562+0000 7faedaffd640 1 -- 172.21.15.79:0/2889329014 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faee0045070 con 0x7faee40b2d30 2024-04-25T02:15:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.562+0000 7faedaffd640 1 --2- 172.21.15.79:0/2889329014 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faec806be30 0x7faec806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.562+0000 7faedaffd640 1 -- 172.21.15.79:0/2889329014 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7faee00ab8a0 con 0x7faee40b2d30 2024-04-25T02:15:44.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.562+0000 7faeea3d4640 1 --2- 172.21.15.79:0/2889329014 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faec806be30 0x7faec806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.562+0000 7faeea3d4640 1 --2- 172.21.15.79:0/2889329014 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faec806be30 0x7faec806e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7faed4000f60 tx=0x7faed4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:44.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.566+0000 7faedaffd640 1 -- 172.21.15.79:0/2889329014 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faee007a2a0 con 0x7faee40b2d30 2024-04-25T02:15:44.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.775+0000 7faeec638640 1 -- 172.21.15.79:0/2889329014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faee40cf6d0 con 0x7faee40b2d30 2024-04-25T02:15:44.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.776+0000 7faedaffd640 1 -- 172.21.15.79:0/2889329014 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5190 (secure 0 0 0) 0x7faee0079ba0 con 0x7faee40b2d30 2024-04-25T02:15:44.782 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:44.782 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:15:08.854388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7896},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7896":{"gid":7896,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/1474949173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1474949173},{"type":"v1","addr":"172.21.15.79:6837","nonce":1474949173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7896,"qdb_cluster":[7896]},"id":6}]} 2024-04-25T02:15:44.782 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 61 2024-04-25T02:15:44.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.778+0000 7faeec638640 1 -- 172.21.15.79:0/2889329014 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faec806be30 msgr2=0x7faec806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.778+0000 7faeec638640 1 --2- 172.21.15.79:0/2889329014 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faec806be30 0x7faec806e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7faed4000f60 tx=0x7faed4009040 comp rx=0 tx=0).stop 2024-04-25T02:15:44.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.778+0000 7faeec638640 1 -- 172.21.15.79:0/2889329014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee40b2d30 msgr2=0x7faee40aa110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.778+0000 7faeec638640 1 --2- 172.21.15.79:0/2889329014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee40b2d30 0x7faee40aa110 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7faee0000c00 tx=0x7faee00046c0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.778+0000 7faeec638640 1 -- 172.21.15.79:0/2889329014 shutdown_connections 2024-04-25T02:15:44.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.778+0000 7faeec638640 1 --2- 172.21.15.79:0/2889329014 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faec806be30 0x7faec806e2f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.778+0000 7faeec638640 1 --2- 172.21.15.79:0/2889329014 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee4143bc0 0x7faee40aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.778+0000 7faeec638640 1 --2- 172.21.15.79:0/2889329014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee40b2d30 0x7faee40aa110 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.778+0000 7faeec638640 1 --2- 172.21.15.79:0/2889329014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee406df50 0x7faee413e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.778+0000 7faeec638640 1 -- 172.21.15.79:0/2889329014 >> 172.21.15.79:0/2889329014 conn(0x7faee40cfc80 msgr2=0x7faee4070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:44.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.778+0000 7faeec638640 1 -- 172.21.15.79:0/2889329014 shutdown_connections 2024-04-25T02:15:44.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.778+0000 7faeec638640 1 -- 172.21.15.79:0/2889329014 wait complete. 2024-04-25T02:15:44.794 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:15:44.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.885+0000 7f9e7ee3f640 1 Processor -- start 2024-04-25T02:15:44.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.885+0000 7f9e7ee3f640 1 -- start start 2024-04-25T02:15:44.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.886+0000 7f9e7ee3f640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9e7815e4d0 0x7f9e7806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.886+0000 7f9e7ee3f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e780d2e20 0x7f9e780cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.886+0000 7f9e7ee3f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e780d1660 con 0x7f9e780b3570 2024-04-25T02:15:44.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.886+0000 7f9e7ee3f640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f9e780d1380 con 0x7f9e7815e4d0 2024-04-25T02:15:44.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.886+0000 7f9e7ee3f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9e780cede0 con 0x7f9e780d2e20 2024-04-25T02:15:44.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.886+0000 7f9e77fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9e780b3570 0x7f9e780d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60582/0 (socket says 172.21.15.79:60582) 2024-04-25T02:15:44.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.886+0000 7f9e77fff640 1 -- 172.21.15.79:0/51714546 learned_addr learned my addr 172.21.15.79:0/51714546 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:44.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e7d3dc640 1 --2- 172.21.15.79:0/51714546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e780d2e20 0x7f9e780cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e7cbdb640 1 --2- 172.21.15.79:0/51714546 >> v2:172.21.15.189:3300/0 conn(0x7f9e7815e4d0 0x7f9e7806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 -- 172.21.15.79:0/51714546 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1011867915 0 0) 0x7f9e780d1660 con 0x7f9e780b3570 2024-04-25T02:15:44.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 -- 172.21.15.79:0/51714546 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e64003520 con 0x7f9e780b3570 2024-04-25T02:15:44.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 -- 172.21.15.79:0/51714546 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3536295401 0 0) 0x7f9e64003520 con 0x7f9e780b3570 2024-04-25T02:15:44.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 -- 172.21.15.79:0/51714546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e780d2e20 msgr2=0x7f9e780cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:44.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 --2- 172.21.15.79:0/51714546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e780d2e20 0x7f9e780cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 -- 172.21.15.79:0/51714546 >> v2:172.21.15.189:3300/0 conn(0x7f9e7815e4d0 msgr2=0x7f9e7806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:44.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 --2- 172.21.15.79:0/51714546 >> v2:172.21.15.189:3300/0 conn(0x7f9e7815e4d0 0x7f9e7806bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 -- 172.21.15.79:0/51714546 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e780cf0c0 con 0x7f9e780b3570 2024-04-25T02:15:44.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 -- 172.21.15.79:0/51714546 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f9e68001670 con 0x7f9e780b3570 2024-04-25T02:15:44.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 -- 172.21.15.79:0/51714546 >> v1:172.21.15.79:6789/0 conn(0x7f9e780b3570 legacy=0x7f9e780d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 --2- 172.21.15.79:0/51714546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e780d2e20 0x7f9e640039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 --2- 172.21.15.79:0/51714546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e64003f30 0x7f9e64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 --2- 172.21.15.79:0/51714546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e64004d40 0x7f9e640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 -- 172.21.15.79:0/51714546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9e780d1380 con 0x7f9e64004d40 2024-04-25T02:15:44.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 -- 172.21.15.79:0/51714546 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9e780cede0 con 0x7f9e64003f30 2024-04-25T02:15:44.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e777fe640 1 -- 172.21.15.79:0/51714546 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6400b9c0 con 0x7f9e780d2e20 2024-04-25T02:15:44.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e7d3dc640 1 --2- 172.21.15.79:0/51714546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e64004d40 0x7f9e640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e7cbdb640 1 --2- 172.21.15.79:0/51714546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e780d2e20 0x7f9e640039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e77fff640 1 --2- 172.21.15.79:0/51714546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e64003f30 0x7f9e64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e7d3dc640 1 -- 172.21.15.79:0/51714546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e780d2e20 msgr2=0x7f9e640039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e7d3dc640 1 --2- 172.21.15.79:0/51714546 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e780d2e20 0x7f9e640039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e7d3dc640 1 -- 172.21.15.79:0/51714546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e64003f30 msgr2=0x7f9e64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e7d3dc640 1 --2- 172.21.15.79:0/51714546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e64003f30 0x7f9e64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.887+0000 7f9e7d3dc640 1 -- 172.21.15.79:0/51714546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e64003520 con 0x7f9e64004d40 2024-04-25T02:15:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.888+0000 7f9e7d3dc640 1 --2- 172.21.15.79:0/51714546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e64004d40 0x7f9e640051c0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f9e7808c7d0 tx=0x7f9e64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594c4fa65cd29bd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.888+0000 7f9e777fe640 1 -- 172.21.15.79:0/51714546 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60036070 con 0x7f9e64004d40 2024-04-25T02:15:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.888+0000 7f9e777fe640 1 -- 172.21.15.79:0/51714546 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e60031400 con 0x7f9e64004d40 2024-04-25T02:15:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.888+0000 7f9e777fe640 1 -- 172.21.15.79:0/51714546 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60009690 con 0x7f9e64004d40 2024-04-25T02:15:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.889+0000 7f9e7ee3f640 1 -- 172.21.15.79:0/51714546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e64004d40 msgr2=0x7f9e640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.889+0000 7f9e7ee3f640 1 --2- 172.21.15.79:0/51714546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e64004d40 0x7f9e640051c0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f9e7808c7d0 tx=0x7f9e64005830 comp rx=0 tx=0).stop 2024-04-25T02:15:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.889+0000 7f9e7d3dc640 1 -- 172.21.15.79:0/51714546 reap_dead start 2024-04-25T02:15:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.889+0000 7f9e7ee3f640 1 -- 172.21.15.79:0/51714546 shutdown_connections 2024-04-25T02:15:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.889+0000 7f9e7ee3f640 1 -- 172.21.15.79:0/51714546 >> 172.21.15.79:0/51714546 conn(0x7f9e7809d460 msgr2=0x7f9e780d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.889+0000 7f9e7ee3f640 1 -- 172.21.15.79:0/51714546 shutdown_connections 2024-04-25T02:15:44.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.889+0000 7f9e7ee3f640 1 -- 172.21.15.79:0/51714546 wait complete. 2024-04-25T02:15:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.890+0000 7f9e7ee3f640 1 Processor -- start 2024-04-25T02:15:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.890+0000 7f9e7ee3f640 1 -- start start 2024-04-25T02:15:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7ee3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e64004d40 0x7f9e78159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7ee3f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e7815fc40 0x7f9e781600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7ee3f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e780a0ff0 0x7f9e780a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7ee3f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9e780d2250 con 0x7f9e64004d40 2024-04-25T02:15:44.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7ee3f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9e780d20d0 con 0x7f9e780a0ff0 2024-04-25T02:15:44.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7ee3f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9e7806c1b0 con 0x7f9e7815fc40 2024-04-25T02:15:44.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7cbdb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e64004d40 0x7f9e78159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7cbdb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e64004d40 0x7f9e78159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51608/0 (socket says 172.21.15.79:51608) 2024-04-25T02:15:44.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7cbdb640 1 -- 172.21.15.79:0/3466093068 learned_addr learned my addr 172.21.15.79:0/3466093068 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:44.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7d3dc640 1 --2- 172.21.15.79:0/3466093068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e780a0ff0 0x7f9e780a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e77fff640 1 --2- 172.21.15.79:0/3466093068 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e7815fc40 0x7f9e781600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7cbdb640 1 -- 172.21.15.79:0/3466093068 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e7815fc40 msgr2=0x7f9e781600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7cbdb640 1 --2- 172.21.15.79:0/3466093068 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e7815fc40 0x7f9e781600c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7cbdb640 1 -- 172.21.15.79:0/3466093068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e780a0ff0 msgr2=0x7f9e780a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:44.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7cbdb640 1 --2- 172.21.15.79:0/3466093068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e780a0ff0 0x7f9e780a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:44.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7cbdb640 1 -- 172.21.15.79:0/3466093068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e780a1cb0 con 0x7f9e64004d40 2024-04-25T02:15:44.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7cbdb640 1 --2- 172.21.15.79:0/3466093068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e64004d40 0x7f9e78159500 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f9e70011e30 tx=0x7f9e7000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e757fa640 1 -- 172.21.15.79:0/3466093068 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70015630 con 0x7f9e64004d40 2024-04-25T02:15:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e757fa640 1 -- 172.21.15.79:0/3466093068 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e700157d0 con 0x7f9e64004d40 2024-04-25T02:15:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e757fa640 1 -- 172.21.15.79:0/3466093068 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70015ba0 con 0x7f9e64004d40 2024-04-25T02:15:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.891+0000 7f9e7ee3f640 1 -- 172.21.15.79:0/3466093068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e780cc4d0 con 0x7f9e64004d40 2024-04-25T02:15:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.892+0000 7f9e7ee3f640 1 -- 172.21.15.79:0/3466093068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e780cca90 con 0x7f9e64004d40 2024-04-25T02:15:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.892+0000 7f9e7ee3f640 1 -- 172.21.15.79:0/3466093068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e780690a0 con 0x7f9e64004d40 2024-04-25T02:15:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.893+0000 7f9e757fa640 1 -- 172.21.15.79:0/3466093068 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e7001d400 con 0x7f9e64004d40 2024-04-25T02:15:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.893+0000 7f9e757fa640 1 --2- 172.21.15.79:0/3466093068 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9e5806be30 0x7f9e5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.893+0000 7f9e757fa640 1 -- 172.21.15.79:0/3466093068 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f9e7008c1d0 con 0x7f9e64004d40 2024-04-25T02:15:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.893+0000 7f9e77fff640 1 --2- 172.21.15.79:0/3466093068 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9e5806be30 0x7f9e5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.894+0000 7f9e77fff640 1 --2- 172.21.15.79:0/3466093068 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9e5806be30 0x7f9e5806e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9e68001050 tx=0x7f9e68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:44.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:44.898+0000 7f9e757fa640 1 -- 172.21.15.79:0/3466093068 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9e70019030 con 0x7f9e64004d40 2024-04-25T02:15:45.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.075+0000 7f9e7ee3f640 1 -- 172.21.15.79:0/3466093068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e780d1660 con 0x7f9e64004d40 2024-04-25T02:15:45.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.077+0000 7f9e757fa640 1 -- 172.21.15.79:0/3466093068 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+16979 (secure 0 0 0) 0x7f9e70010040 con 0x7f9e64004d40 2024-04-25T02:15:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:45.082 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":90,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:15:04.828059+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:13:41.594939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T02:13:42.348770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.2a","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/630320044":"2024-04-26T02:15:04.828036+0000","172.21.15.79:6836/630320044":"2024-04-26T02:15:04.828036+0000","172.21.15.79:6837/2290864495":"2024-04-26T02:13:53.595807+0000","172.21.15.79:6836/2290864495":"2024-04-26T02:13:53.595807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:15:45.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.078+0000 7f9e7ee3f640 1 -- 172.21.15.79:0/3466093068 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9e5806be30 msgr2=0x7f9e5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.078+0000 7f9e7ee3f640 1 --2- 172.21.15.79:0/3466093068 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9e5806be30 0x7f9e5806e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9e68001050 tx=0x7f9e68009040 comp rx=0 tx=0).stop 2024-04-25T02:15:45.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.078+0000 7f9e7ee3f640 1 -- 172.21.15.79:0/3466093068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e64004d40 msgr2=0x7f9e78159500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.078+0000 7f9e7ee3f640 1 --2- 172.21.15.79:0/3466093068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e64004d40 0x7f9e78159500 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f9e70011e30 tx=0x7f9e7000f580 comp rx=0 tx=0).stop 2024-04-25T02:15:45.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.079+0000 7f9e7ee3f640 1 -- 172.21.15.79:0/3466093068 shutdown_connections 2024-04-25T02:15:45.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.079+0000 7f9e7ee3f640 1 --2- 172.21.15.79:0/3466093068 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9e5806be30 0x7f9e5806e2f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.079+0000 7f9e7ee3f640 1 --2- 172.21.15.79:0/3466093068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e780a0ff0 0x7f9e780a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.079+0000 7f9e7ee3f640 1 --2- 172.21.15.79:0/3466093068 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e7815fc40 0x7f9e781600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.079+0000 7f9e7ee3f640 1 --2- 172.21.15.79:0/3466093068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e64004d40 0x7f9e78159500 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.079+0000 7f9e7ee3f640 1 -- 172.21.15.79:0/3466093068 >> 172.21.15.79:0/3466093068 conn(0x7f9e7809d460 msgr2=0x7f9e780ca6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:45.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.079+0000 7f9e7ee3f640 1 -- 172.21.15.79:0/3466093068 shutdown_connections 2024-04-25T02:15:45.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.079+0000 7f9e7ee3f640 1 -- 172.21.15.79:0/3466093068 wait complete. 2024-04-25T02:15:45.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:13:41.594939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:13:42.348770+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:15:45.095 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:15:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.190+0000 7f2a3509e640 1 Processor -- start 2024-04-25T02:15:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.190+0000 7f2a3509e640 1 -- start start 2024-04-25T02:15:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.191+0000 7f2a3509e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a3006b2f0 0x7f2a300b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.191+0000 7f2a3509e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2a300cf7a0 0x7f2a3006b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.191+0000 7f2a3509e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a3006bc10 con 0x7f2a3006e6b0 2024-04-25T02:15:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.191+0000 7f2a3509e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2a3015f830 con 0x7f2a300cf7a0 2024-04-25T02:15:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.191+0000 7f2a3509e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2a3015ec20 con 0x7f2a3006b2f0 2024-04-25T02:15:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.191+0000 7f2a27fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2a300cf7a0 0x7f2a3006b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.191+0000 7f2a27fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2a300cf7a0 0x7f2a3006b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51620/0 (socket says 172.21.15.79:51620) 2024-04-25T02:15:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.191+0000 7f2a27fff640 1 -- 172.21.15.79:0/4093974591 learned_addr learned my addr 172.21.15.79:0/4093974591 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.191+0000 7f2a27fff640 1 -- 172.21.15.79:0/4093974591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a3006b2f0 msgr2=0x7f2a300b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.191+0000 7f2a27fff640 1 --2- 172.21.15.79:0/4093974591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a3006b2f0 0x7f2a300b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.191+0000 7f2a27fff640 1 -- 172.21.15.79:0/4093974591 >> v1:172.21.15.189:6789/0 conn(0x7f2a3006e6b0 legacy=0x7f2a300cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.191+0000 7f2a27fff640 1 -- 172.21.15.79:0/4093974591 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3015ef00 con 0x7f2a300cf7a0 2024-04-25T02:15:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.192+0000 7f2a27fff640 1 --2- 172.21.15.79:0/4093974591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a300cf7a0 0x7f2a3006b6d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800bb10 tx=0x7f2a1802c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8675402ae1be63 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.192+0000 7f2a2e59c640 1 -- 172.21.15.79:0/4093974591 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1803a070 con 0x7f2a300cf7a0 2024-04-25T02:15:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.192+0000 7f2a2e59c640 1 -- 172.21.15.79:0/4093974591 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a180326f0 con 0x7f2a300cf7a0 2024-04-25T02:15:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.192+0000 7f2a2e59c640 1 -- 172.21.15.79:0/4093974591 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a18032ac0 con 0x7f2a300cf7a0 2024-04-25T02:15:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.192+0000 7f2a3509e640 1 -- 172.21.15.79:0/4093974591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a300cf7a0 msgr2=0x7f2a3006b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.192+0000 7f2a3509e640 1 --2- 172.21.15.79:0/4093974591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a300cf7a0 0x7f2a3006b6d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800bb10 tx=0x7f2a1802c830 comp rx=0 tx=0).stop 2024-04-25T02:15:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.193+0000 7f2a3509e640 1 -- 172.21.15.79:0/4093974591 shutdown_connections 2024-04-25T02:15:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.193+0000 7f2a3509e640 1 --2- 172.21.15.79:0/4093974591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a300cf7a0 0x7f2a3006b6d0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.193+0000 7f2a3509e640 1 --2- 172.21.15.79:0/4093974591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a3006b2f0 0x7f2a300b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.193+0000 7f2a3509e640 1 -- 172.21.15.79:0/4093974591 >> 172.21.15.79:0/4093974591 conn(0x7f2a300b1cd0 msgr2=0x7f2a300b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.193+0000 7f2a3509e640 1 -- 172.21.15.79:0/4093974591 shutdown_connections 2024-04-25T02:15:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.193+0000 7f2a3509e640 1 -- 172.21.15.79:0/4093974591 wait complete. 2024-04-25T02:15:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.194+0000 7f2a3509e640 1 Processor -- start 2024-04-25T02:15:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.194+0000 7f2a3509e640 1 -- start start 2024-04-25T02:15:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a3509e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a3006b2f0 0x7f2a30155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a3509e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3006e6b0 0x7f2a301474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a3509e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a300cf7a0 0x7f2a30156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a3509e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3006cfe0 con 0x7f2a3006e6b0 2024-04-25T02:15:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a3509e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3015f4c0 con 0x7f2a3006b2f0 2024-04-25T02:15:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a3509e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2a3006d160 con 0x7f2a300cf7a0 2024-04-25T02:15:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3006e6b0 0x7f2a301474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3006e6b0 0x7f2a301474d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51626/0 (socket says 172.21.15.79:51626) 2024-04-25T02:15:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a27fff640 1 -- 172.21.15.79:0/1768604213 learned_addr learned my addr 172.21.15.79:0/1768604213 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a2f59e640 1 --2- 172.21.15.79:0/1768604213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a300cf7a0 0x7f2a30156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a2ed9d640 1 --2- 172.21.15.79:0/1768604213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a3006b2f0 0x7f2a30155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a27fff640 1 -- 172.21.15.79:0/1768604213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a300cf7a0 msgr2=0x7f2a30156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a27fff640 1 --2- 172.21.15.79:0/1768604213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a300cf7a0 0x7f2a30156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a27fff640 1 -- 172.21.15.79:0/1768604213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a3006b2f0 msgr2=0x7f2a30155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a27fff640 1 --2- 172.21.15.79:0/1768604213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a3006b2f0 0x7f2a30155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a27fff640 1 -- 172.21.15.79:0/1768604213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a30155880 con 0x7f2a3006e6b0 2024-04-25T02:15:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a27fff640 1 --2- 172.21.15.79:0/1768604213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3006e6b0 0x7f2a301474d0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f2a1802c870 tx=0x7f2a180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a277fe640 1 -- 172.21.15.79:0/1768604213 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a18045070 con 0x7f2a3006e6b0 2024-04-25T02:15:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a277fe640 1 -- 172.21.15.79:0/1768604213 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a18035680 con 0x7f2a3006e6b0 2024-04-25T02:15:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a277fe640 1 -- 172.21.15.79:0/1768604213 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1803a040 con 0x7f2a3006e6b0 2024-04-25T02:15:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a3509e640 1 -- 172.21.15.79:0/1768604213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a30071800 con 0x7f2a3006e6b0 2024-04-25T02:15:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.195+0000 7f2a3509e640 1 -- 172.21.15.79:0/1768604213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a30071dc0 con 0x7f2a3006e6b0 2024-04-25T02:15:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.196+0000 7f2a3509e640 1 -- 172.21.15.79:0/1768604213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a300722a0 con 0x7f2a3006e6b0 2024-04-25T02:15:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.197+0000 7f2a277fe640 1 -- 172.21.15.79:0/1768604213 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a18048070 con 0x7f2a3006e6b0 2024-04-25T02:15:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.197+0000 7f2a277fe640 1 --2- 172.21.15.79:0/1768604213 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a1006be30 0x7f2a1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.197+0000 7f2a277fe640 1 -- 172.21.15.79:0/1768604213 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f2a180adee0 con 0x7f2a3006e6b0 2024-04-25T02:15:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.197+0000 7f2a2ed9d640 1 --2- 172.21.15.79:0/1768604213 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a1006be30 0x7f2a1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.198+0000 7f2a2ed9d640 1 --2- 172.21.15.79:0/1768604213 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a1006be30 0x7f2a1006e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2a20009890 tx=0x7f2a20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.201+0000 7f2a277fe640 1 -- 172.21.15.79:0/1768604213 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2a300722a0 con 0x7f2a3006e6b0 2024-04-25T02:15:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.375+0000 7f2a3509e640 1 -- 172.21.15.79:0/1768604213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2a300690a0 con 0x7f2a3006e6b0 2024-04-25T02:15:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.375+0000 7f2a277fe640 1 -- 172.21.15.79:0/1768604213 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f2a1807c8e0 con 0x7f2a3006e6b0 2024-04-25T02:15:45.380 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:15:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.377+0000 7f2a3509e640 1 -- 172.21.15.79:0/1768604213 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a1006be30 msgr2=0x7f2a1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.377+0000 7f2a3509e640 1 --2- 172.21.15.79:0/1768604213 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a1006be30 0x7f2a1006e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2a20009890 tx=0x7f2a20008040 comp rx=0 tx=0).stop 2024-04-25T02:15:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.377+0000 7f2a3509e640 1 -- 172.21.15.79:0/1768604213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3006e6b0 msgr2=0x7f2a301474d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.377+0000 7f2a3509e640 1 --2- 172.21.15.79:0/1768604213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3006e6b0 0x7f2a301474d0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f2a1802c870 tx=0x7f2a180046c0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.377+0000 7f2a3509e640 1 -- 172.21.15.79:0/1768604213 shutdown_connections 2024-04-25T02:15:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.377+0000 7f2a3509e640 1 --2- 172.21.15.79:0/1768604213 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a1006be30 0x7f2a1006e2f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.377+0000 7f2a3509e640 1 --2- 172.21.15.79:0/1768604213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a300cf7a0 0x7f2a30156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.377+0000 7f2a3509e640 1 --2- 172.21.15.79:0/1768604213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3006e6b0 0x7f2a301474d0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.377+0000 7f2a3509e640 1 --2- 172.21.15.79:0/1768604213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a3006b2f0 0x7f2a30155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.377+0000 7f2a3509e640 1 -- 172.21.15.79:0/1768604213 >> 172.21.15.79:0/1768604213 conn(0x7f2a300b1cd0 msgr2=0x7f2a300b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.377+0000 7f2a3509e640 1 -- 172.21.15.79:0/1768604213 shutdown_connections 2024-04-25T02:15:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.377+0000 7f2a3509e640 1 -- 172.21.15.79:0/1768604213 wait complete. 2024-04-25T02:15:45.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:15:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.488+0000 7f6a6c190640 1 Processor -- start 2024-04-25T02:15:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.488+0000 7f6a6c190640 1 -- start start 2024-04-25T02:15:45.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a6c190640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6a640cf7a0 0x7f6a640b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a6c190640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6415ec20 con 0x7f6a6406b2f0 2024-04-25T02:15:45.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a6c190640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6415ef00 con 0x7f6a6406e6b0 2024-04-25T02:15:45.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a6c190640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6415f830 con 0x7f6a640cf7a0 2024-04-25T02:15:45.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a69f2c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6a6406b2f0 0x7f6a6406b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60590/0 (socket says 172.21.15.79:60590) 2024-04-25T02:15:45.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a69f2c640 1 -- 172.21.15.79:0/3959474466 learned_addr learned my addr 172.21.15.79:0/3959474466 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:45.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a6972b640 1 --2- 172.21.15.79:0/3959474466 >> v2:172.21.15.189:3300/0 conn(0x7f6a640cf7a0 0x7f6a640b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a68f2a640 1 -- 172.21.15.79:0/3959474466 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 890541278 0 0) 0x7f6a6415ec20 con 0x7f6a6406b2f0 2024-04-25T02:15:45.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a68f2a640 1 -- 172.21.15.79:0/3959474466 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a50003520 con 0x7f6a6406b2f0 2024-04-25T02:15:45.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a68f2a640 1 -- 172.21.15.79:0/3959474466 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4146023987 0 0) 0x7f6a50003520 con 0x7f6a6406b2f0 2024-04-25T02:15:45.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a68f2a640 1 -- 172.21.15.79:0/3959474466 >> v2:172.21.15.189:3300/0 conn(0x7f6a640cf7a0 msgr2=0x7f6a640b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:45.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a68f2a640 1 --2- 172.21.15.79:0/3959474466 >> v2:172.21.15.189:3300/0 conn(0x7f6a640cf7a0 0x7f6a640b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a68f2a640 1 -- 172.21.15.79:0/3959474466 >> v1:172.21.15.189:6789/0 conn(0x7f6a6406e6b0 legacy=0x7f6a6415b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a68f2a640 1 -- 172.21.15.79:0/3959474466 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6415f1e0 con 0x7f6a6406b2f0 2024-04-25T02:15:45.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a68f2a640 1 -- 172.21.15.79:0/3959474466 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f6a60001670 con 0x7f6a6406b2f0 2024-04-25T02:15:45.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a68f2a640 1 -- 172.21.15.79:0/3959474466 >> v1:172.21.15.79:6789/0 conn(0x7f6a6406b2f0 legacy=0x7f6a6406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a68f2a640 1 --2- 172.21.15.79:0/3959474466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a500039b0 0x7f6a50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a68f2a640 1 --2- 172.21.15.79:0/3959474466 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a50004800 0x7f6a50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a68f2a640 1 --2- 172.21.15.79:0/3959474466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a500051c0 0x7f6a5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a68f2a640 1 -- 172.21.15.79:0/3959474466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6415f830 con 0x7f6a500039b0 2024-04-25T02:15:45.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a68f2a640 1 -- 172.21.15.79:0/3959474466 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5000c160 con 0x7f6a500051c0 2024-04-25T02:15:45.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a68f2a640 1 -- 172.21.15.79:0/3959474466 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5000c360 con 0x7f6a50004800 2024-04-25T02:15:45.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.489+0000 7f6a69f2c640 1 --2- 172.21.15.79:0/3959474466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a500039b0 0x7f6a50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.490+0000 7f6a6a72d640 1 --2- 172.21.15.79:0/3959474466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a500051c0 0x7f6a5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.490+0000 7f6a6972b640 1 --2- 172.21.15.79:0/3959474466 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a50004800 0x7f6a50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.490+0000 7f6a69f2c640 1 -- 172.21.15.79:0/3959474466 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a50004800 msgr2=0x7f6a50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:45.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.490+0000 7f6a69f2c640 1 --2- 172.21.15.79:0/3959474466 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a50004800 0x7f6a50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.490+0000 7f6a69f2c640 1 -- 172.21.15.79:0/3959474466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a500051c0 msgr2=0x7f6a5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.490+0000 7f6a69f2c640 1 --2- 172.21.15.79:0/3959474466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a500051c0 0x7f6a5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.490+0000 7f6a69f2c640 1 -- 172.21.15.79:0/3959474466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a50003520 con 0x7f6a500039b0 2024-04-25T02:15:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.490+0000 7f6a6a72d640 1 --2- 172.21.15.79:0/3959474466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a500051c0 0x7f6a5000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.490+0000 7f6a6a72d640 1 -- 172.21.15.79:0/3959474466 reap_dead start 2024-04-25T02:15:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.490+0000 7f6a69f2c640 1 --2- 172.21.15.79:0/3959474466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a500039b0 0x7f6a50003dd0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000c240 tx=0x7f6a50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945f2d9797da1807 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.491+0000 7f6a68f2a640 1 -- 172.21.15.79:0/3959474466 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a60007cf0 con 0x7f6a500039b0 2024-04-25T02:15:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.491+0000 7f6a68f2a640 1 -- 172.21.15.79:0/3959474466 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a600058d0 con 0x7f6a500039b0 2024-04-25T02:15:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.491+0000 7f6a68f2a640 1 -- 172.21.15.79:0/3959474466 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a60005d20 con 0x7f6a500039b0 2024-04-25T02:15:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.491+0000 7f6a6c190640 1 -- 172.21.15.79:0/3959474466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a500039b0 msgr2=0x7f6a50003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.491+0000 7f6a6c190640 1 --2- 172.21.15.79:0/3959474466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a500039b0 0x7f6a50003dd0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000c240 tx=0x7f6a50005830 comp rx=0 tx=0).stop 2024-04-25T02:15:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.491+0000 7f6a6c190640 1 -- 172.21.15.79:0/3959474466 shutdown_connections 2024-04-25T02:15:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.491+0000 7f6a6c190640 1 --2- 172.21.15.79:0/3959474466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a500039b0 0x7f6a50003dd0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.491+0000 7f6a6c190640 1 -- 172.21.15.79:0/3959474466 >> 172.21.15.79:0/3959474466 conn(0x7f6a640b1cd0 msgr2=0x7f6a640b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.491+0000 7f6a6c190640 1 -- 172.21.15.79:0/3959474466 shutdown_connections 2024-04-25T02:15:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.491+0000 7f6a6c190640 1 -- 172.21.15.79:0/3959474466 wait complete. 2024-04-25T02:15:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.492+0000 7f6a6c190640 1 Processor -- start 2024-04-25T02:15:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.492+0000 7f6a6c190640 1 -- start start 2024-04-25T02:15:45.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a6c190640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a500039b0 0x7f6a64153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a6c190640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a641efd40 0x7f6a641564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a6c190640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a64156a30 0x7f6a64157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a6c190640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6406d160 con 0x7f6a64156a30 2024-04-25T02:15:45.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a6c190640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6406cfe0 con 0x7f6a500039b0 2024-04-25T02:15:45.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a6c190640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6a640b4b50 con 0x7f6a641efd40 2024-04-25T02:15:45.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a6a72d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a64156a30 0x7f6a64157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a6a72d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a64156a30 0x7f6a64157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51634/0 (socket says 172.21.15.79:51634) 2024-04-25T02:15:45.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a6a72d640 1 -- 172.21.15.79:0/1106495215 learned_addr learned my addr 172.21.15.79:0/1106495215 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:45.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a6972b640 1 --2- 172.21.15.79:0/1106495215 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a641efd40 0x7f6a641564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a69f2c640 1 --2- 172.21.15.79:0/1106495215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a500039b0 0x7f6a64153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a6a72d640 1 -- 172.21.15.79:0/1106495215 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a641efd40 msgr2=0x7f6a641564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a6a72d640 1 --2- 172.21.15.79:0/1106495215 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a641efd40 0x7f6a641564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a6a72d640 1 -- 172.21.15.79:0/1106495215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a500039b0 msgr2=0x7f6a64153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a6a72d640 1 --2- 172.21.15.79:0/1106495215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a500039b0 0x7f6a64153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.493+0000 7f6a6a72d640 1 -- 172.21.15.79:0/1106495215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a64153790 con 0x7f6a64156a30 2024-04-25T02:15:45.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.494+0000 7f6a6a72d640 1 --2- 172.21.15.79:0/1106495215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a64156a30 0x7f6a64157e60 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f6a6406f230 tx=0x7f6a5c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:45.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.494+0000 7f6a5a7fc640 1 -- 172.21.15.79:0/1106495215 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c003970 con 0x7f6a64156a30 2024-04-25T02:15:45.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.494+0000 7f6a5a7fc640 1 -- 172.21.15.79:0/1106495215 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c018070 con 0x7f6a64156a30 2024-04-25T02:15:45.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.494+0000 7f6a6c190640 1 -- 172.21.15.79:0/1106495215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6415c7b0 con 0x7f6a64156a30 2024-04-25T02:15:45.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.494+0000 7f6a5a7fc640 1 -- 172.21.15.79:0/1106495215 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c003d50 con 0x7f6a64156a30 2024-04-25T02:15:45.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.494+0000 7f6a6c190640 1 -- 172.21.15.79:0/1106495215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6415cd70 con 0x7f6a64156a30 2024-04-25T02:15:45.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.495+0000 7f6a6c190640 1 -- 172.21.15.79:0/1106495215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a640690a0 con 0x7f6a64156a30 2024-04-25T02:15:45.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.495+0000 7f6a5a7fc640 1 -- 172.21.15.79:0/1106495215 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a5c0050d0 con 0x7f6a64156a30 2024-04-25T02:15:45.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.495+0000 7f6a5a7fc640 1 --2- 172.21.15.79:0/1106495215 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a4806be60 0x7f6a4806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.496+0000 7f6a5a7fc640 1 -- 172.21.15.79:0/1106495215 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f6a5c08ab40 con 0x7f6a64156a30 2024-04-25T02:15:45.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.496+0000 7f6a69f2c640 1 --2- 172.21.15.79:0/1106495215 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a4806be60 0x7f6a4806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.496+0000 7f6a69f2c640 1 --2- 172.21.15.79:0/1106495215 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a4806be60 0x7f6a4806e320 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6a60033000 tx=0x7f6a60009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:45.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.500+0000 7f6a5a7fc640 1 -- 172.21.15.79:0/1106495215 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6a5c0594e0 con 0x7f6a64156a30 2024-04-25T02:15:45.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.671+0000 7f6a6c190640 1 -- 172.21.15.79:0/1106495215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6a640cf4f0 con 0x7f6a64156a30 2024-04-25T02:15:45.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.671+0000 7f6a5a7fc640 1 -- 172.21.15.79:0/1106495215 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f6a5c058de0 con 0x7f6a64156a30 2024-04-25T02:15:45.677 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:15:45.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.673+0000 7f6a6c190640 1 -- 172.21.15.79:0/1106495215 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a4806be60 msgr2=0x7f6a4806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.673+0000 7f6a6c190640 1 --2- 172.21.15.79:0/1106495215 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a4806be60 0x7f6a4806e320 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6a60033000 tx=0x7f6a60009030 comp rx=0 tx=0).stop 2024-04-25T02:15:45.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.673+0000 7f6a6c190640 1 -- 172.21.15.79:0/1106495215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a64156a30 msgr2=0x7f6a64157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.673+0000 7f6a6c190640 1 --2- 172.21.15.79:0/1106495215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a64156a30 0x7f6a64157e60 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f6a6406f230 tx=0x7f6a5c00eb90 comp rx=0 tx=0).stop 2024-04-25T02:15:45.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.673+0000 7f6a6c190640 1 -- 172.21.15.79:0/1106495215 shutdown_connections 2024-04-25T02:15:45.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.673+0000 7f6a6c190640 1 --2- 172.21.15.79:0/1106495215 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a4806be60 0x7f6a4806e320 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.673+0000 7f6a6c190640 1 --2- 172.21.15.79:0/1106495215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a64156a30 0x7f6a64157e60 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.673+0000 7f6a6c190640 1 --2- 172.21.15.79:0/1106495215 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a641efd40 0x7f6a641564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.673+0000 7f6a6c190640 1 --2- 172.21.15.79:0/1106495215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a500039b0 0x7f6a64153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.673+0000 7f6a6c190640 1 -- 172.21.15.79:0/1106495215 >> 172.21.15.79:0/1106495215 conn(0x7f6a640b1cd0 msgr2=0x7f6a6406d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:45.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.673+0000 7f6a6c190640 1 -- 172.21.15.79:0/1106495215 shutdown_connections 2024-04-25T02:15:45.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.673+0000 7f6a6c190640 1 -- 172.21.15.79:0/1106495215 wait complete. 2024-04-25T02:15:45.689 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:15:45.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.784+0000 7f086f22a640 1 Processor -- start 2024-04-25T02:15:45.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.784+0000 7f086f22a640 1 -- start start 2024-04-25T02:15:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.784+0000 7f086f22a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f086815c100 0x7f086806f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.785+0000 7f086f22a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f08680721a0 0x7f086806c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.785+0000 7f086f22a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f086806c600 0x7f086815fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.785+0000 7f086f22a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f08680ce110 con 0x7f086815c100 2024-04-25T02:15:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.785+0000 7f086f22a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f086815c4e0 con 0x7f08680721a0 2024-04-25T02:15:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.785+0000 7f086f22a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f086806ff40 con 0x7f086806c600 2024-04-25T02:15:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.785+0000 7f086cfc6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f086815c100 0x7f086806f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.785+0000 7f086cfc6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f086815c100 0x7f086806f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51640/0 (socket says 172.21.15.79:51640) 2024-04-25T02:15:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.785+0000 7f086cfc6640 1 -- 172.21.15.79:0/1414293672 learned_addr learned my addr 172.21.15.79:0/1414293672 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.785+0000 7f086cfc6640 1 -- 172.21.15.79:0/1414293672 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f086806c600 msgr2=0x7f086815fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.785+0000 7f086cfc6640 1 --2- 172.21.15.79:0/1414293672 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f086806c600 0x7f086815fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.785+0000 7f086cfc6640 1 -- 172.21.15.79:0/1414293672 >> v2:172.21.15.189:3300/0 conn(0x7f08680721a0 msgr2=0x7f086806c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.785+0000 7f086cfc6640 1 --2- 172.21.15.79:0/1414293672 >> v2:172.21.15.189:3300/0 conn(0x7f08680721a0 0x7f086806c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.785+0000 7f086cfc6640 1 -- 172.21.15.79:0/1414293672 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08680ce360 con 0x7f086815c100 2024-04-25T02:15:45.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.786+0000 7f086cfc6640 1 --2- 172.21.15.79:0/1414293672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f086815c100 0x7f086806f880 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f0868074ac0 tx=0x7f085002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27011a87d6e5acf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:45.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.786+0000 7f08677fe640 1 -- 172.21.15.79:0/1414293672 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0850037070 con 0x7f086815c100 2024-04-25T02:15:45.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.786+0000 7f08677fe640 1 -- 172.21.15.79:0/1414293672 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0850032440 con 0x7f086815c100 2024-04-25T02:15:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.786+0000 7f08677fe640 1 -- 172.21.15.79:0/1414293672 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0850032810 con 0x7f086815c100 2024-04-25T02:15:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.786+0000 7f086f22a640 1 -- 172.21.15.79:0/1414293672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f086815c100 msgr2=0x7f086806f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.786+0000 7f086f22a640 1 --2- 172.21.15.79:0/1414293672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f086815c100 0x7f086806f880 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f0868074ac0 tx=0x7f085002a1e0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.786+0000 7f086f22a640 1 -- 172.21.15.79:0/1414293672 shutdown_connections 2024-04-25T02:15:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.786+0000 7f086f22a640 1 --2- 172.21.15.79:0/1414293672 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f086806c600 0x7f086815fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.786+0000 7f086f22a640 1 --2- 172.21.15.79:0/1414293672 >> v2:172.21.15.189:3300/0 conn(0x7f08680721a0 0x7f086806c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.786+0000 7f086f22a640 1 --2- 172.21.15.79:0/1414293672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f086815c100 0x7f086806f880 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.786+0000 7f086f22a640 1 -- 172.21.15.79:0/1414293672 >> 172.21.15.79:0/1414293672 conn(0x7f08680716b0 msgr2=0x7f0868071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.786+0000 7f086f22a640 1 -- 172.21.15.79:0/1414293672 shutdown_connections 2024-04-25T02:15:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.786+0000 7f086f22a640 1 -- 172.21.15.79:0/1414293672 wait complete. 2024-04-25T02:15:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.787+0000 7f086f22a640 1 Processor -- start 2024-04-25T02:15:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.788+0000 7f086f22a640 1 -- start start 2024-04-25T02:15:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.788+0000 7f086f22a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f086806c600 0x7f08681428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.788+0000 7f086f22a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08680721a0 0x7f086815e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.788+0000 7f086f22a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f086815c100 0x7f08681f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.788+0000 7f086f22a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f08680afd40 con 0x7f08680721a0 2024-04-25T02:15:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.788+0000 7f086f22a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08680ce920 con 0x7f086806c600 2024-04-25T02:15:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.788+0000 7f086f22a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0868160130 con 0x7f086815c100 2024-04-25T02:15:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.788+0000 7f0867fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08680721a0 0x7f086815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f0867fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08680721a0 0x7f086815e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51648/0 (socket says 172.21.15.79:51648) 2024-04-25T02:15:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f0867fff640 1 -- 172.21.15.79:0/2526138089 learned_addr learned my addr 172.21.15.79:0/2526138089 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f086cfc6640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f086806c600 0x7f08681428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f086d7c7640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f086815c100 0x7f08681f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f0867fff640 1 -- 172.21.15.79:0/2526138089 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f086815c100 msgr2=0x7f08681f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f0867fff640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f086815c100 0x7f08681f5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f0867fff640 1 -- 172.21.15.79:0/2526138089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f086806c600 msgr2=0x7f08681428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f0867fff640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f086806c600 0x7f08681428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f0867fff640 1 -- 172.21.15.79:0/2526138089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0868142df0 con 0x7f08680721a0 2024-04-25T02:15:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f086cfc6640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f086806c600 0x7f08681428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f086d7c7640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f086815c100 0x7f08681f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f0867fff640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08680721a0 0x7f086815e080 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f085800b4a0 tx=0x7f085800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f08657fa640 1 -- 172.21.15.79:0/2526138089 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0858014070 con 0x7f08680721a0 2024-04-25T02:15:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f08657fa640 1 -- 172.21.15.79:0/2526138089 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0858010610 con 0x7f08680721a0 2024-04-25T02:15:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f08657fa640 1 -- 172.21.15.79:0/2526138089 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0858010a00 con 0x7f08680721a0 2024-04-25T02:15:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f086f22a640 1 -- 172.21.15.79:0/2526138089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08681430c0 con 0x7f08680721a0 2024-04-25T02:15:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.789+0000 7f086f22a640 1 -- 172.21.15.79:0/2526138089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0868143680 con 0x7f08680721a0 2024-04-25T02:15:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.790+0000 7f086f22a640 1 -- 172.21.15.79:0/2526138089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08680690a0 con 0x7f08680721a0 2024-04-25T02:15:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.790+0000 7f08657fa640 1 -- 172.21.15.79:0/2526138089 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0858017070 con 0x7f08680721a0 2024-04-25T02:15:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.791+0000 7f08657fa640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f084806be60 0x7f084806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.791+0000 7f08657fa640 1 -- 172.21.15.79:0/2526138089 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f085808a870 con 0x7f08680721a0 2024-04-25T02:15:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.791+0000 7f086cfc6640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f084806be60 0x7f084806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.791+0000 7f086cfc6640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f084806be60 0x7f084806e320 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0850034000 tx=0x7f085002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:45.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.795+0000 7f08657fa640 1 -- 172.21.15.79:0/2526138089 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f08580591e0 con 0x7f08680721a0 2024-04-25T02:15:45.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.970+0000 7f086f22a640 1 -- 172.21.15.79:0/2526138089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0868066f70 con 0x7f08680721a0 2024-04-25T02:15:45.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.970+0000 7f08657fa640 1 -- 172.21.15.79:0/2526138089 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f0858058ae0 con 0x7f08680721a0 2024-04-25T02:15:45.976 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:15:45.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.972+0000 7f086f22a640 1 -- 172.21.15.79:0/2526138089 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f084806be60 msgr2=0x7f084806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.972+0000 7f086f22a640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f084806be60 0x7f084806e320 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0850034000 tx=0x7f085002e000 comp rx=0 tx=0).stop 2024-04-25T02:15:45.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.972+0000 7f086f22a640 1 -- 172.21.15.79:0/2526138089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08680721a0 msgr2=0x7f086815e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:45.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.972+0000 7f086f22a640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08680721a0 0x7f086815e080 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f085800b4a0 tx=0x7f085800b960 comp rx=0 tx=0).stop 2024-04-25T02:15:45.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.972+0000 7f086f22a640 1 -- 172.21.15.79:0/2526138089 shutdown_connections 2024-04-25T02:15:45.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.972+0000 7f086f22a640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f084806be60 0x7f084806e320 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.972+0000 7f086f22a640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f086815c100 0x7f08681f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.972+0000 7f086f22a640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08680721a0 0x7f086815e080 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.972+0000 7f086f22a640 1 --2- 172.21.15.79:0/2526138089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f086806c600 0x7f08681428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:45.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.972+0000 7f086f22a640 1 -- 172.21.15.79:0/2526138089 >> 172.21.15.79:0/2526138089 conn(0x7f08680716b0 msgr2=0x7f08680b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:45.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.972+0000 7f086f22a640 1 -- 172.21.15.79:0/2526138089 shutdown_connections 2024-04-25T02:15:45.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:45.972+0000 7f086f22a640 1 -- 172.21.15.79:0/2526138089 wait complete. 2024-04-25T02:15:45.988 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:15:46.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.080+0000 7fc6b8c12640 1 Processor -- start 2024-04-25T02:15:46.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.080+0000 7fc6b8c12640 1 -- start start 2024-04-25T02:15:46.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b8c12640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc6b406df50 0x7fc6b406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b8c12640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b4070d90 con 0x7fc6b4144cb0 2024-04-25T02:15:46.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b8c12640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b40cf130 con 0x7fc6b4071240 2024-04-25T02:15:46.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b8c12640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc6b40cf410 con 0x7fc6b406df50 2024-04-25T02:15:46.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b259c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc6b4144cb0 0x7fc6b40b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60604/0 (socket says 172.21.15.79:60604) 2024-04-25T02:15:46.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b259c640 1 -- 172.21.15.79:0/4201849962 learned_addr learned my addr 172.21.15.79:0/4201849962 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b1d9b640 1 -- 172.21.15.79:0/4201849962 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1723730149 0 0) 0x7fc6b4070d90 con 0x7fc6b4144cb0 2024-04-25T02:15:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b1d9b640 1 -- 172.21.15.79:0/4201849962 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6a0003520 con 0x7fc6b4144cb0 2024-04-25T02:15:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6abfff640 1 --2- 172.21.15.79:0/4201849962 >> v2:172.21.15.189:3300/0 conn(0x7fc6b406df50 0x7fc6b406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b1d9b640 1 -- 172.21.15.79:0/4201849962 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1196519306 0 0) 0x7fc6a0003520 con 0x7fc6b4144cb0 2024-04-25T02:15:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b1d9b640 1 -- 172.21.15.79:0/4201849962 >> v2:172.21.15.189:3300/0 conn(0x7fc6b406df50 msgr2=0x7fc6b406e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b1d9b640 1 --2- 172.21.15.79:0/4201849962 >> v2:172.21.15.189:3300/0 conn(0x7fc6b406df50 0x7fc6b406e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b1d9b640 1 -- 172.21.15.79:0/4201849962 >> v1:172.21.15.189:6789/0 conn(0x7fc6b4071240 legacy=0x7fc6b4071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b1d9b640 1 -- 172.21.15.79:0/4201849962 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b40cf6f0 con 0x7fc6b4144cb0 2024-04-25T02:15:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b1d9b640 1 -- 172.21.15.79:0/4201849962 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fc6a4001670 con 0x7fc6b4144cb0 2024-04-25T02:15:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b1d9b640 1 -- 172.21.15.79:0/4201849962 >> v1:172.21.15.79:6789/0 conn(0x7fc6b4144cb0 legacy=0x7fc6b40b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.081+0000 7fc6b1d9b640 1 --2- 172.21.15.79:0/4201849962 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6a00039b0 0x7fc6a0003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.082+0000 7fc6b1d9b640 1 --2- 172.21.15.79:0/4201849962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6a0004800 0x7fc6a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.082+0000 7fc6b1d9b640 1 --2- 172.21.15.79:0/4201849962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00052e0 0x7fc6a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.082+0000 7fc6b1d9b640 1 -- 172.21.15.79:0/4201849962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b40cf410 con 0x7fc6a00052e0 2024-04-25T02:15:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.082+0000 7fc6b1d9b640 1 -- 172.21.15.79:0/4201849962 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a000c230 con 0x7fc6a0004800 2024-04-25T02:15:46.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.082+0000 7fc6b1d9b640 1 -- 172.21.15.79:0/4201849962 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc6a000c430 con 0x7fc6a00039b0 2024-04-25T02:15:46.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.082+0000 7fc6b2d9d640 1 --2- 172.21.15.79:0/4201849962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00052e0 0x7fc6a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.082+0000 7fc6abfff640 1 --2- 172.21.15.79:0/4201849962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6a0004800 0x7fc6a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.082+0000 7fc6b259c640 1 --2- 172.21.15.79:0/4201849962 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6a00039b0 0x7fc6a0003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.082+0000 7fc6b2d9d640 1 -- 172.21.15.79:0/4201849962 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6a00039b0 msgr2=0x7fc6a0003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:46.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.082+0000 7fc6b2d9d640 1 --2- 172.21.15.79:0/4201849962 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6a00039b0 0x7fc6a0003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.082+0000 7fc6b2d9d640 1 -- 172.21.15.79:0/4201849962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6a0004800 msgr2=0x7fc6a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:46.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.082+0000 7fc6b2d9d640 1 --2- 172.21.15.79:0/4201849962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6a0004800 0x7fc6a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.082+0000 7fc6b2d9d640 1 -- 172.21.15.79:0/4201849962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a0003520 con 0x7fc6a00052e0 2024-04-25T02:15:46.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.082+0000 7fc6abfff640 1 --2- 172.21.15.79:0/4201849962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6a0004800 0x7fc6a0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:46.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.082+0000 7fc6b2d9d640 1 -- 172.21.15.79:0/4201849962 reap_dead start 2024-04-25T02:15:46.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.083+0000 7fc6b2d9d640 1 --2- 172.21.15.79:0/4201849962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00052e0 0x7fc6a000b9c0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac004480 tx=0x7fc6a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c54b514e93d382 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:46.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.083+0000 7fc6b1d9b640 1 -- 172.21.15.79:0/4201849962 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac004080 con 0x7fc6a00052e0 2024-04-25T02:15:46.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.083+0000 7fc6b1d9b640 1 -- 172.21.15.79:0/4201849962 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ac02ad80 con 0x7fc6a00052e0 2024-04-25T02:15:46.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.083+0000 7fc6b1d9b640 1 -- 172.21.15.79:0/4201849962 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac006d90 con 0x7fc6a00052e0 2024-04-25T02:15:46.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.083+0000 7fc6b8c12640 1 -- 172.21.15.79:0/4201849962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00052e0 msgr2=0x7fc6a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.083+0000 7fc6b8c12640 1 --2- 172.21.15.79:0/4201849962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00052e0 0x7fc6a000b9c0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac004480 tx=0x7fc6a0005830 comp rx=0 tx=0).stop 2024-04-25T02:15:46.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.083+0000 7fc6b8c12640 1 -- 172.21.15.79:0/4201849962 shutdown_connections 2024-04-25T02:15:46.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.083+0000 7fc6b8c12640 1 --2- 172.21.15.79:0/4201849962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00052e0 0x7fc6a000b9c0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.083+0000 7fc6b8c12640 1 -- 172.21.15.79:0/4201849962 >> 172.21.15.79:0/4201849962 conn(0x7fc6b40cfc80 msgr2=0x7fc6b40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:46.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.083+0000 7fc6b8c12640 1 -- 172.21.15.79:0/4201849962 shutdown_connections 2024-04-25T02:15:46.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.083+0000 7fc6b8c12640 1 -- 172.21.15.79:0/4201849962 wait complete. 2024-04-25T02:15:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.085+0000 7fc6b8c12640 1 Processor -- start 2024-04-25T02:15:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.085+0000 7fc6b8c12640 1 -- start start 2024-04-25T02:15:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.085+0000 7fc6b8c12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00052e0 0x7fc6b413d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.085+0000 7fc6b8c12640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6b41f1860 0x7fc6b4158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.085+0000 7fc6b8c12640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6b4159460 0x7fc6b415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.085+0000 7fc6b8c12640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b4145ab0 con 0x7fc6a00052e0 2024-04-25T02:15:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.085+0000 7fc6b8c12640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b4145090 con 0x7fc6b4159460 2024-04-25T02:15:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.085+0000 7fc6b8c12640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc6b4145c30 con 0x7fc6b41f1860 2024-04-25T02:15:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.085+0000 7fc6b259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00052e0 0x7fc6b413d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.085+0000 7fc6b259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00052e0 0x7fc6b413d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51668/0 (socket says 172.21.15.79:51668) 2024-04-25T02:15:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.085+0000 7fc6b259c640 1 -- 172.21.15.79:0/2807524663 learned_addr learned my addr 172.21.15.79:0/2807524663 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.086+0000 7fc6b259c640 1 -- 172.21.15.79:0/2807524663 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6b41f1860 msgr2=0x7fc6b4158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.086+0000 7fc6b259c640 1 --2- 172.21.15.79:0/2807524663 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6b41f1860 0x7fc6b4158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.086+0000 7fc6b259c640 1 -- 172.21.15.79:0/2807524663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6b4159460 msgr2=0x7fc6b415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.086+0000 7fc6b259c640 1 --2- 172.21.15.79:0/2807524663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6b4159460 0x7fc6b415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.086+0000 7fc6b259c640 1 -- 172.21.15.79:0/2807524663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b413da00 con 0x7fc6a00052e0 2024-04-25T02:15:46.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.086+0000 7fc6b259c640 1 --2- 172.21.15.79:0/2807524663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00052e0 0x7fc6b413d4c0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400e730 tx=0x7fc6a400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:46.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.086+0000 7fc6aaffd640 1 -- 172.21.15.79:0/2807524663 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a400c6c0 con 0x7fc6a00052e0 2024-04-25T02:15:46.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.086+0000 7fc6aaffd640 1 -- 172.21.15.79:0/2807524663 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a4018070 con 0x7fc6a00052e0 2024-04-25T02:15:46.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.086+0000 7fc6aaffd640 1 -- 172.21.15.79:0/2807524663 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a400cac0 con 0x7fc6a00052e0 2024-04-25T02:15:46.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.086+0000 7fc6b8c12640 1 -- 172.21.15.79:0/2807524663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b413e340 con 0x7fc6a00052e0 2024-04-25T02:15:46.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.086+0000 7fc6b8c12640 1 -- 172.21.15.79:0/2807524663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b413e900 con 0x7fc6a00052e0 2024-04-25T02:15:46.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.087+0000 7fc6b8c12640 1 -- 172.21.15.79:0/2807524663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b40690a0 con 0x7fc6a00052e0 2024-04-25T02:15:46.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.087+0000 7fc6aaffd640 1 -- 172.21.15.79:0/2807524663 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc6a400cc60 con 0x7fc6a00052e0 2024-04-25T02:15:46.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.088+0000 7fc6aaffd640 1 --2- 172.21.15.79:0/2807524663 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc69406be60 0x7fc69406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.088+0000 7fc6aaffd640 1 -- 172.21.15.79:0/2807524663 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7fc6a408ac40 con 0x7fc6a00052e0 2024-04-25T02:15:46.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.088+0000 7fc6abfff640 1 --2- 172.21.15.79:0/2807524663 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc69406be60 0x7fc69406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.088+0000 7fc6abfff640 1 --2- 172.21.15.79:0/2807524663 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc69406be60 0x7fc69406e320 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc69c006f00 tx=0x7fc69c006e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:46.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.092+0000 7fc6aaffd640 1 -- 172.21.15.79:0/2807524663 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc6a40595b0 con 0x7fc6a00052e0 2024-04-25T02:15:46.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.300+0000 7fc6b8c12640 1 -- 172.21.15.79:0/2807524663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6b40d08e0 con 0x7fc6a00052e0 2024-04-25T02:15:46.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.301+0000 7fc6aaffd640 1 -- 172.21.15.79:0/2807524663 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5190 (secure 0 0 0) 0x7fc6a4058eb0 con 0x7fc6a00052e0 2024-04-25T02:15:46.306 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:46.307 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:15:08.854388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7896},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7896":{"gid":7896,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/1474949173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1474949173},{"type":"v1","addr":"172.21.15.79:6837","nonce":1474949173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7896,"qdb_cluster":[7896]},"id":6}]} 2024-04-25T02:15:46.307 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 61 2024-04-25T02:15:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.303+0000 7fc6b8c12640 1 -- 172.21.15.79:0/2807524663 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc69406be60 msgr2=0x7fc69406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.303+0000 7fc6b8c12640 1 --2- 172.21.15.79:0/2807524663 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc69406be60 0x7fc69406e320 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc69c006f00 tx=0x7fc69c006e90 comp rx=0 tx=0).stop 2024-04-25T02:15:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.303+0000 7fc6b8c12640 1 -- 172.21.15.79:0/2807524663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00052e0 msgr2=0x7fc6b413d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.303+0000 7fc6b8c12640 1 --2- 172.21.15.79:0/2807524663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00052e0 0x7fc6b413d4c0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400e730 tx=0x7fc6a400ebf0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.303+0000 7fc6b8c12640 1 -- 172.21.15.79:0/2807524663 shutdown_connections 2024-04-25T02:15:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.303+0000 7fc6b8c12640 1 --2- 172.21.15.79:0/2807524663 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc69406be60 0x7fc69406e320 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.303+0000 7fc6b8c12640 1 --2- 172.21.15.79:0/2807524663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6b4159460 0x7fc6b415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.303+0000 7fc6b8c12640 1 --2- 172.21.15.79:0/2807524663 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6b41f1860 0x7fc6b4158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.303+0000 7fc6b8c12640 1 --2- 172.21.15.79:0/2807524663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00052e0 0x7fc6b413d4c0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.303+0000 7fc6b8c12640 1 -- 172.21.15.79:0/2807524663 >> 172.21.15.79:0/2807524663 conn(0x7fc6b40cfc80 msgr2=0x7fc6b415fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.303+0000 7fc6b8c12640 1 -- 172.21.15.79:0/2807524663 shutdown_connections 2024-04-25T02:15:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.303+0000 7fc6b8c12640 1 -- 172.21.15.79:0/2807524663 wait complete. 2024-04-25T02:15:46.319 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:15:46.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.413+0000 7f1206c2a640 1 Processor -- start 2024-04-25T02:15:46.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.414+0000 7f1206c2a640 1 -- start start 2024-04-25T02:15:46.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.414+0000 7f1206c2a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f120006df50 0x7f120006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.414+0000 7f1206c2a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1200071e00 con 0x7f12000b2d30 2024-04-25T02:15:46.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.414+0000 7f1206c2a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12000720a0 con 0x7f1200143bc0 2024-04-25T02:15:46.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.414+0000 7f1206c2a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f120006e8f0 con 0x7f120006df50 2024-04-25T02:15:46.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f12051c7640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f12000b2d30 0x7f12000b31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60612/0 (socket says 172.21.15.79:60612) 2024-04-25T02:15:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f12051c7640 1 -- 172.21.15.79:0/1370100120 learned_addr learned my addr 172.21.15.79:0/1370100120 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11fffff640 1 --2- 172.21.15.79:0/1370100120 >> v2:172.21.15.189:3300/0 conn(0x7f120006df50 0x7f120006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11ff7fe640 1 -- 172.21.15.79:0/1370100120 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991658782 0 0) 0x7f1200071e00 con 0x7f12000b2d30 2024-04-25T02:15:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11ff7fe640 1 -- 172.21.15.79:0/1370100120 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11f0003520 con 0x7f12000b2d30 2024-04-25T02:15:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11ff7fe640 1 -- 172.21.15.79:0/1370100120 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 151395998 0 0) 0x7f11f0003520 con 0x7f12000b2d30 2024-04-25T02:15:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11ff7fe640 1 -- 172.21.15.79:0/1370100120 >> v2:172.21.15.189:3300/0 conn(0x7f120006df50 msgr2=0x7f120006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11ff7fe640 1 --2- 172.21.15.79:0/1370100120 >> v2:172.21.15.189:3300/0 conn(0x7f120006df50 0x7f120006e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11ff7fe640 1 -- 172.21.15.79:0/1370100120 >> v1:172.21.15.189:6789/0 conn(0x7f1200143bc0 legacy=0x7f120015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11ff7fe640 1 -- 172.21.15.79:0/1370100120 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1200072380 con 0x7f12000b2d30 2024-04-25T02:15:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11ff7fe640 1 -- 172.21.15.79:0/1370100120 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f11f80019f0 con 0x7f12000b2d30 2024-04-25T02:15:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11ff7fe640 1 -- 172.21.15.79:0/1370100120 >> v1:172.21.15.79:6789/0 conn(0x7f12000b2d30 legacy=0x7f12000b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11ff7fe640 1 --2- 172.21.15.79:0/1370100120 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f11f00039b0 0x7f11f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11ff7fe640 1 --2- 172.21.15.79:0/1370100120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f0004800 0x7f11f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11ff7fe640 1 --2- 172.21.15.79:0/1370100120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f00051c0 0x7f11f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11ff7fe640 1 -- 172.21.15.79:0/1370100120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f11f000c130 con 0x7f11f00051c0 2024-04-25T02:15:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11ff7fe640 1 -- 172.21.15.79:0/1370100120 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f11f000c2e0 con 0x7f11f0004800 2024-04-25T02:15:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11ff7fe640 1 -- 172.21.15.79:0/1370100120 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f11f000c4e0 con 0x7f11f00039b0 2024-04-25T02:15:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f12051c7640 1 --2- 172.21.15.79:0/1370100120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f00051c0 0x7f11f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f11fffff640 1 --2- 172.21.15.79:0/1370100120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f0004800 0x7f11f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f12049c6640 1 --2- 172.21.15.79:0/1370100120 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f11f00039b0 0x7f11f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f12051c7640 1 -- 172.21.15.79:0/1370100120 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f11f00039b0 msgr2=0x7f11f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.415+0000 7f12051c7640 1 --2- 172.21.15.79:0/1370100120 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f11f00039b0 0x7f11f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.416+0000 7f12051c7640 1 -- 172.21.15.79:0/1370100120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f0004800 msgr2=0x7f11f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.416+0000 7f12051c7640 1 --2- 172.21.15.79:0/1370100120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f0004800 0x7f11f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.416+0000 7f12051c7640 1 -- 172.21.15.79:0/1370100120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f0003520 con 0x7f11f00051c0 2024-04-25T02:15:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.416+0000 7f12051c7640 1 -- 172.21.15.79:0/1370100120 reap_dead start 2024-04-25T02:15:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.416+0000 7f12051c7640 1 --2- 172.21.15.79:0/1370100120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f00051c0 0x7f11f000b9c0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f11f800a860 tx=0x7f11f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a5e0ade5ec617d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:46.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.416+0000 7f11ff7fe640 1 -- 172.21.15.79:0/1370100120 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f800a480 con 0x7f11f00051c0 2024-04-25T02:15:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.416+0000 7f11ff7fe640 1 -- 172.21.15.79:0/1370100120 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f802f070 con 0x7f11f00051c0 2024-04-25T02:15:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.416+0000 7f11ff7fe640 1 -- 172.21.15.79:0/1370100120 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f802bcc0 con 0x7f11f00051c0 2024-04-25T02:15:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.417+0000 7f1206c2a640 1 -- 172.21.15.79:0/1370100120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f00051c0 msgr2=0x7f11f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.417+0000 7f1206c2a640 1 --2- 172.21.15.79:0/1370100120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f00051c0 0x7f11f000b9c0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f11f800a860 tx=0x7f11f0005830 comp rx=0 tx=0).stop 2024-04-25T02:15:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.417+0000 7f1206c2a640 1 -- 172.21.15.79:0/1370100120 shutdown_connections 2024-04-25T02:15:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.417+0000 7f1206c2a640 1 --2- 172.21.15.79:0/1370100120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f00051c0 0x7f11f000b9c0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.417+0000 7f1206c2a640 1 -- 172.21.15.79:0/1370100120 >> 172.21.15.79:0/1370100120 conn(0x7f12000cfc80 msgr2=0x7f12000d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.417+0000 7f1206c2a640 1 -- 172.21.15.79:0/1370100120 shutdown_connections 2024-04-25T02:15:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.417+0000 7f1206c2a640 1 -- 172.21.15.79:0/1370100120 wait complete. 2024-04-25T02:15:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.418+0000 7f1206c2a640 1 Processor -- start 2024-04-25T02:15:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.418+0000 7f1206c2a640 1 -- start start 2024-04-25T02:15:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f1206c2a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f00051c0 0x7f120013f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f1206c2a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12001f42d0 0x7f12000cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f1206c2a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12001f4750 0x7f12000cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f1206c2a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1200072940 con 0x7f12001f4750 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f1206c2a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1200072cb0 con 0x7f11f00051c0 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f1206c2a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1200143fa0 con 0x7f12001f42d0 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f12051c7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12001f4750 0x7f12000cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f12051c7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12001f4750 0x7f12000cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51692/0 (socket says 172.21.15.79:51692) 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f12051c7640 1 -- 172.21.15.79:0/2219594384 learned_addr learned my addr 172.21.15.79:0/2219594384 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f12049c6640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f00051c0 0x7f120013f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f11fffff640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12001f42d0 0x7f12000cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f12051c7640 1 -- 172.21.15.79:0/2219594384 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12001f42d0 msgr2=0x7f12000cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f12051c7640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12001f42d0 0x7f12000cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f12051c7640 1 -- 172.21.15.79:0/2219594384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f00051c0 msgr2=0x7f120013f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f12051c7640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f00051c0 0x7f120013f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f12051c7640 1 -- 172.21.15.79:0/2219594384 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12001e40c0 con 0x7f12001f4750 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f12049c6640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f00051c0 0x7f120013f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f11fffff640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12001f42d0 0x7f12000cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.419+0000 7f12051c7640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12001f4750 0x7f12000cd9f0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f11f800a980 tx=0x7f12000b4420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:46.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.420+0000 7f11fd7fa640 1 -- 172.21.15.79:0/2219594384 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8044070 con 0x7f12001f4750 2024-04-25T02:15:46.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.420+0000 7f11fd7fa640 1 -- 172.21.15.79:0/2219594384 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f802bdc0 con 0x7f12001f4750 2024-04-25T02:15:46.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.420+0000 7f1206c2a640 1 -- 172.21.15.79:0/2219594384 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12001e1770 con 0x7f12001f4750 2024-04-25T02:15:46.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.420+0000 7f11fd7fa640 1 -- 172.21.15.79:0/2219594384 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f800a480 con 0x7f12001f4750 2024-04-25T02:15:46.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.420+0000 7f1206c2a640 1 -- 172.21.15.79:0/2219594384 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f120013f8b0 con 0x7f12001f4750 2024-04-25T02:15:46.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.421+0000 7f1206c2a640 1 -- 172.21.15.79:0/2219594384 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12001e1560 con 0x7f12001f4750 2024-04-25T02:15:46.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.421+0000 7f11fd7fa640 1 -- 172.21.15.79:0/2219594384 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11f8047070 con 0x7f12001f4750 2024-04-25T02:15:46.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.422+0000 7f11fd7fa640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11e406be60 0x7f11e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.422+0000 7f12049c6640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11e406be60 0x7f11e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.422+0000 7f11fd7fa640 1 -- 172.21.15.79:0/2219594384 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f11f80aa870 con 0x7f12001f4750 2024-04-25T02:15:46.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.422+0000 7f12049c6640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11e406be60 0x7f11e406e320 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f11f4005580 tx=0x7f11f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:46.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.426+0000 7f11fd7fa640 1 -- 172.21.15.79:0/2219594384 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f11f8078b90 con 0x7f12001f4750 2024-04-25T02:15:46.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.601+0000 7f1206c2a640 1 -- 172.21.15.79:0/2219594384 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12000690a0 con 0x7f12001f4750 2024-04-25T02:15:46.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.602+0000 7f11fd7fa640 1 -- 172.21.15.79:0/2219594384 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+16979 (secure 0 0 0) 0x7f11f807ce90 con 0x7f12001f4750 2024-04-25T02:15:46.611 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:46.611 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":90,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:15:04.828059+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:13:41.594939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T02:13:42.348770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.2a","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/630320044":"2024-04-26T02:15:04.828036+0000","172.21.15.79:6836/630320044":"2024-04-26T02:15:04.828036+0000","172.21.15.79:6837/2290864495":"2024-04-26T02:13:53.595807+0000","172.21.15.79:6836/2290864495":"2024-04-26T02:13:53.595807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:15:46.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.604+0000 7f1206c2a640 1 -- 172.21.15.79:0/2219594384 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11e406be60 msgr2=0x7f11e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.604+0000 7f1206c2a640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11e406be60 0x7f11e406e320 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f11f4005580 tx=0x7f11f4009040 comp rx=0 tx=0).stop 2024-04-25T02:15:46.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.604+0000 7f1206c2a640 1 -- 172.21.15.79:0/2219594384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12001f4750 msgr2=0x7f12000cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.604+0000 7f1206c2a640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12001f4750 0x7f12000cd9f0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f11f800a980 tx=0x7f12000b4420 comp rx=0 tx=0).stop 2024-04-25T02:15:46.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.604+0000 7f1206c2a640 1 -- 172.21.15.79:0/2219594384 shutdown_connections 2024-04-25T02:15:46.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.604+0000 7f1206c2a640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11e406be60 0x7f11e406e320 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.604+0000 7f1206c2a640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12001f4750 0x7f12000cd9f0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.604+0000 7f1206c2a640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12001f42d0 0x7f12000cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.604+0000 7f1206c2a640 1 --2- 172.21.15.79:0/2219594384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f00051c0 0x7f120013f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.604+0000 7f1206c2a640 1 -- 172.21.15.79:0/2219594384 >> 172.21.15.79:0/2219594384 conn(0x7f12000cfc80 msgr2=0x7f12000d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:46.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.604+0000 7f1206c2a640 1 -- 172.21.15.79:0/2219594384 shutdown_connections 2024-04-25T02:15:46.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.604+0000 7f1206c2a640 1 -- 172.21.15.79:0/2219594384 wait complete. 2024-04-25T02:15:46.622 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:15:46.623 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:15:46.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.717+0000 7f082f1d5640 1 Processor -- start 2024-04-25T02:15:46.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.717+0000 7f082f1d5640 1 -- start start 2024-04-25T02:15:46.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.717+0000 7f082f1d5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f082815e4d0 0x7f082806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.717+0000 7f082f1d5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08280d1660 con 0x7f08280b3570 2024-04-25T02:15:46.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.717+0000 7f082f1d5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08280d1380 con 0x7f08280d2e20 2024-04-25T02:15:46.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.717+0000 7f082f1d5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f08280cede0 con 0x7f082815e4d0 2024-04-25T02:15:46.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f0827fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f08280b3570 0x7f08280d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60624/0 (socket says 172.21.15.79:60624) 2024-04-25T02:15:46.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f0827fff640 1 -- 172.21.15.79:0/3811976170 learned_addr learned my addr 172.21.15.79:0/3811976170 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:46.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f082cf71640 1 --2- 172.21.15.79:0/3811976170 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f082815e4d0 0x7f082806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 416673225 0 0) 0x7f08280d1660 con 0x7f08280b3570 2024-04-25T02:15:46.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0818003520 con 0x7f08280b3570 2024-04-25T02:15:46.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3600582798 0 0) 0x7f08280d1380 con 0x7f08280d2e20 2024-04-25T02:15:46.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08280d1660 con 0x7f08280d2e20 2024-04-25T02:15:46.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2066825640 0 0) 0x7f0818003520 con 0x7f08280b3570 2024-04-25T02:15:46.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f082815e4d0 msgr2=0x7f082806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:46.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 --2- 172.21.15.79:0/3811976170 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f082815e4d0 0x7f082806bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 >> v1:172.21.15.189:6789/0 conn(0x7f08280d2e20 legacy=0x7f08280cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08280cf0c0 con 0x7f08280b3570 2024-04-25T02:15:46.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f0814001670 con 0x7f08280b3570 2024-04-25T02:15:46.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 >> v1:172.21.15.79:6789/0 conn(0x7f08280b3570 legacy=0x7f08280d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 --2- 172.21.15.79:0/3811976170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0818003b70 0x7f0818003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 --2- 172.21.15.79:0/3811976170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0818004800 0x7f0818004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 --2- 172.21.15.79:0/3811976170 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08180051c0 0x7f081800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f08280cede0 con 0x7f0818004800 2024-04-25T02:15:46.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f081800bfb0 con 0x7f0818003b70 2024-04-25T02:15:46.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f081800c1b0 con 0x7f08180051c0 2024-04-25T02:15:46.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f082cf71640 1 --2- 172.21.15.79:0/3811976170 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f082815e4d0 0x7f082806bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:15:46.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f0827fff640 1 --2- 172.21.15.79:0/3811976170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0818004800 0x7f0818004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f082d772640 1 --2- 172.21.15.79:0/3811976170 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08180051c0 0x7f081800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f082cf71640 1 --2- 172.21.15.79:0/3811976170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0818003b70 0x7f0818003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f0827fff640 1 -- 172.21.15.79:0/3811976170 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08180051c0 msgr2=0x7f081800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:46.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f0827fff640 1 --2- 172.21.15.79:0/3811976170 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08180051c0 0x7f081800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f0827fff640 1 -- 172.21.15.79:0/3811976170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0818003b70 msgr2=0x7f0818003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:46.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f0827fff640 1 --2- 172.21.15.79:0/3811976170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0818003b70 0x7f0818003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.718+0000 7f0827fff640 1 -- 172.21.15.79:0/3811976170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0818003520 con 0x7f0818004800 2024-04-25T02:15:46.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.719+0000 7f082d772640 1 --2- 172.21.15.79:0/3811976170 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08180051c0 0x7f081800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:46.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.719+0000 7f0827fff640 1 --2- 172.21.15.79:0/3811976170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0818004800 0x7f0818004c80 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f081400c190 tx=0x7f0818005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2040995361226f5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:46.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.719+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814007cc0 con 0x7f0818004800 2024-04-25T02:15:46.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.719+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0814005af0 con 0x7f0818004800 2024-04-25T02:15:46.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.719+0000 7f08277fe640 1 -- 172.21.15.79:0/3811976170 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814007070 con 0x7f0818004800 2024-04-25T02:15:46.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.720+0000 7f082f1d5640 1 -- 172.21.15.79:0/3811976170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0818004800 msgr2=0x7f0818004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.720+0000 7f082f1d5640 1 --2- 172.21.15.79:0/3811976170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0818004800 0x7f0818004c80 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f081400c190 tx=0x7f0818005830 comp rx=0 tx=0).stop 2024-04-25T02:15:46.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.720+0000 7f082d772640 1 -- 172.21.15.79:0/3811976170 reap_dead start 2024-04-25T02:15:46.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.720+0000 7f082f1d5640 1 -- 172.21.15.79:0/3811976170 shutdown_connections 2024-04-25T02:15:46.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.720+0000 7f082f1d5640 1 -- 172.21.15.79:0/3811976170 >> 172.21.15.79:0/3811976170 conn(0x7f082809d460 msgr2=0x7f08280d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:46.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.720+0000 7f082f1d5640 1 -- 172.21.15.79:0/3811976170 shutdown_connections 2024-04-25T02:15:46.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.720+0000 7f082f1d5640 1 -- 172.21.15.79:0/3811976170 wait complete. 2024-04-25T02:15:46.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.721+0000 7f082f1d5640 1 Processor -- start 2024-04-25T02:15:46.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.721+0000 7f082f1d5640 1 -- start start 2024-04-25T02:15:46.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f082f1d5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0818004800 0x7f0828160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f082f1d5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0828151090 0x7f0828151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f082f1d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08281f42d0 0x7f08281f4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f082f1d5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f08280d2250 con 0x7f08281f42d0 2024-04-25T02:15:46.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f082f1d5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08280d20d0 con 0x7f0828151090 2024-04-25T02:15:46.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f082f1d5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f08280cfcf0 con 0x7f0818004800 2024-04-25T02:15:46.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f082d772640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08281f42d0 0x7f08281f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f082d772640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08281f42d0 0x7f08281f4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51720/0 (socket says 172.21.15.79:51720) 2024-04-25T02:15:46.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f082d772640 1 -- 172.21.15.79:0/1763041586 learned_addr learned my addr 172.21.15.79:0/1763041586 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:46.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f082cf71640 1 --2- 172.21.15.79:0/1763041586 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0818004800 0x7f0828160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f0827fff640 1 --2- 172.21.15.79:0/1763041586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0828151090 0x7f0828151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f082d772640 1 -- 172.21.15.79:0/1763041586 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0818004800 msgr2=0x7f0828160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f082d772640 1 --2- 172.21.15.79:0/1763041586 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0818004800 0x7f0828160d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f082d772640 1 -- 172.21.15.79:0/1763041586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0828151090 msgr2=0x7f0828151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f082d772640 1 --2- 172.21.15.79:0/1763041586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0828151090 0x7f0828151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.722+0000 7f082d772640 1 -- 172.21.15.79:0/1763041586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08281f5390 con 0x7f08281f42d0 2024-04-25T02:15:46.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.723+0000 7f082d772640 1 --2- 172.21.15.79:0/1763041586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08281f42d0 0x7f08281f4760 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f0820001330 tx=0x7f082000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:46.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.723+0000 7f08257fa640 1 -- 172.21.15.79:0/1763041586 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082000ee50 con 0x7f08281f42d0 2024-04-25T02:15:46.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.723+0000 7f08257fa640 1 -- 172.21.15.79:0/1763041586 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0820003b80 con 0x7f08281f42d0 2024-04-25T02:15:46.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.723+0000 7f082f1d5640 1 -- 172.21.15.79:0/1763041586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08281f5670 con 0x7f08281f42d0 2024-04-25T02:15:46.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.723+0000 7f08257fa640 1 -- 172.21.15.79:0/1763041586 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820003d70 con 0x7f08281f42d0 2024-04-25T02:15:46.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.723+0000 7f082f1d5640 1 -- 172.21.15.79:0/1763041586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08281f5c30 con 0x7f08281f42d0 2024-04-25T02:15:46.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.724+0000 7f082f1d5640 1 -- 172.21.15.79:0/1763041586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08280690a0 con 0x7f08281f42d0 2024-04-25T02:15:46.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.724+0000 7f08257fa640 1 -- 172.21.15.79:0/1763041586 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f082001a020 con 0x7f08281f42d0 2024-04-25T02:15:46.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.725+0000 7f08257fa640 1 --2- 172.21.15.79:0/1763041586 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f080c06be60 0x7f080c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:46.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.725+0000 7f08257fa640 1 -- 172.21.15.79:0/1763041586 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f082008a420 con 0x7f08281f42d0 2024-04-25T02:15:46.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.725+0000 7f082cf71640 1 --2- 172.21.15.79:0/1763041586 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f080c06be60 0x7f080c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:46.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.725+0000 7f082cf71640 1 --2- 172.21.15.79:0/1763041586 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f080c06be60 0x7f080c06e320 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0828161b80 tx=0x7f081c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:46.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.729+0000 7f08257fa640 1 -- 172.21.15.79:0/1763041586 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0820021020 con 0x7f08281f42d0 2024-04-25T02:15:46.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.936+0000 7f082f1d5640 1 -- 172.21.15.79:0/1763041586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08280d1920 con 0x7f08281f42d0 2024-04-25T02:15:46.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.937+0000 7f08257fa640 1 -- 172.21.15.79:0/1763041586 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5190 (secure 0 0 0) 0x7f0820058d00 con 0x7f08281f42d0 2024-04-25T02:15:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:46.943 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:15:08.854388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7896},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7896":{"gid":7896,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/1474949173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1474949173},{"type":"v1","addr":"172.21.15.79:6837","nonce":1474949173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7896,"qdb_cluster":[7896]},"id":6}]} 2024-04-25T02:15:46.943 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 61 2024-04-25T02:15:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.939+0000 7f082f1d5640 1 -- 172.21.15.79:0/1763041586 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f080c06be60 msgr2=0x7f080c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.939+0000 7f082f1d5640 1 --2- 172.21.15.79:0/1763041586 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f080c06be60 0x7f080c06e320 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0828161b80 tx=0x7f081c008040 comp rx=0 tx=0).stop 2024-04-25T02:15:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.939+0000 7f082f1d5640 1 -- 172.21.15.79:0/1763041586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08281f42d0 msgr2=0x7f08281f4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.939+0000 7f082f1d5640 1 --2- 172.21.15.79:0/1763041586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08281f42d0 0x7f08281f4760 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f0820001330 tx=0x7f082000ec00 comp rx=0 tx=0).stop 2024-04-25T02:15:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.939+0000 7f082f1d5640 1 -- 172.21.15.79:0/1763041586 shutdown_connections 2024-04-25T02:15:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.939+0000 7f082f1d5640 1 --2- 172.21.15.79:0/1763041586 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f080c06be60 0x7f080c06e320 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.939+0000 7f082f1d5640 1 --2- 172.21.15.79:0/1763041586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08281f42d0 0x7f08281f4760 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.939+0000 7f082f1d5640 1 --2- 172.21.15.79:0/1763041586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0828151090 0x7f0828151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.939+0000 7f082f1d5640 1 --2- 172.21.15.79:0/1763041586 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0818004800 0x7f0828160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.939+0000 7f082f1d5640 1 -- 172.21.15.79:0/1763041586 >> 172.21.15.79:0/1763041586 conn(0x7f082809d460 msgr2=0x7f08280b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.939+0000 7f082f1d5640 1 -- 172.21.15.79:0/1763041586 shutdown_connections 2024-04-25T02:15:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:46.939+0000 7f082f1d5640 1 -- 172.21.15.79:0/1763041586 wait complete. 2024-04-25T02:15:46.955 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:15:47.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.047+0000 7fa8e0a07640 1 Processor -- start 2024-04-25T02:15:47.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.047+0000 7fa8e0a07640 1 -- start start 2024-04-25T02:15:47.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.048+0000 7fa8e0a07640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa8dc06df50 0x7fa8dc06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.048+0000 7fa8e0a07640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa8dc0b2d30 0x7fa8dc0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.048+0000 7fa8e0a07640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8dc071e00 con 0x7fa8dc143bc0 2024-04-25T02:15:47.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.048+0000 7fa8e0a07640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa8dc06e8f0 con 0x7fa8dc06df50 2024-04-25T02:15:47.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.048+0000 7fa8e0a07640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fa8dc072cb0 con 0x7fa8dc0b2d30 2024-04-25T02:15:47.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.048+0000 7fa8d9d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa8dc06df50 0x7fa8dc06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.048+0000 7fa8d9d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa8dc06df50 0x7fa8dc06e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51736/0 (socket says 172.21.15.79:51736) 2024-04-25T02:15:47.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.048+0000 7fa8d9d9b640 1 -- 172.21.15.79:0/1035518639 learned_addr learned my addr 172.21.15.79:0/1035518639 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.048+0000 7fa8dad9d640 1 --2- 172.21.15.79:0/1035518639 >> v2:172.21.15.189:3300/0 conn(0x7fa8dc0b2d30 0x7fa8dc0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.048+0000 7fa8d9d9b640 1 -- 172.21.15.79:0/1035518639 >> v2:172.21.15.189:3300/0 conn(0x7fa8dc0b2d30 msgr2=0x7fa8dc0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.048+0000 7fa8d9d9b640 1 --2- 172.21.15.79:0/1035518639 >> v2:172.21.15.189:3300/0 conn(0x7fa8dc0b2d30 0x7fa8dc0b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.048+0000 7fa8d9d9b640 1 -- 172.21.15.79:0/1035518639 >> v1:172.21.15.189:6789/0 conn(0x7fa8dc143bc0 legacy=0x7fa8dc15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.048+0000 7fa8d9d9b640 1 -- 172.21.15.79:0/1035518639 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc0720a0 con 0x7fa8dc06df50 2024-04-25T02:15:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.048+0000 7fa8dad9d640 1 --2- 172.21.15.79:0/1035518639 >> v2:172.21.15.189:3300/0 conn(0x7fa8dc0b2d30 0x7fa8dc0b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:47.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.049+0000 7fa8d9d9b640 1 --2- 172.21.15.79:0/1035518639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc06df50 0x7fa8dc06e3b0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc144d00 tx=0x7fa8d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfd50e74ba24705 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:47.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.049+0000 7fa8d959a640 1 -- 172.21.15.79:0/1035518639 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0037070 con 0x7fa8dc06df50 2024-04-25T02:15:47.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.049+0000 7fa8d959a640 1 -- 172.21.15.79:0/1035518639 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d0032440 con 0x7fa8dc06df50 2024-04-25T02:15:47.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.049+0000 7fa8d959a640 1 -- 172.21.15.79:0/1035518639 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0032810 con 0x7fa8dc06df50 2024-04-25T02:15:47.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.050+0000 7fa8e0a07640 1 -- 172.21.15.79:0/1035518639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc06df50 msgr2=0x7fa8dc06e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.050+0000 7fa8e0a07640 1 --2- 172.21.15.79:0/1035518639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc06df50 0x7fa8dc06e3b0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc144d00 tx=0x7fa8d002a1a0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.050+0000 7fa8e0a07640 1 -- 172.21.15.79:0/1035518639 shutdown_connections 2024-04-25T02:15:47.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.050+0000 7fa8e0a07640 1 --2- 172.21.15.79:0/1035518639 >> v2:172.21.15.189:3300/0 conn(0x7fa8dc0b2d30 0x7fa8dc0b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.050+0000 7fa8e0a07640 1 --2- 172.21.15.79:0/1035518639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc06df50 0x7fa8dc06e3b0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.050+0000 7fa8e0a07640 1 -- 172.21.15.79:0/1035518639 >> 172.21.15.79:0/1035518639 conn(0x7fa8dc0cfc80 msgr2=0x7fa8dc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:47.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.050+0000 7fa8e0a07640 1 -- 172.21.15.79:0/1035518639 shutdown_connections 2024-04-25T02:15:47.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.050+0000 7fa8e0a07640 1 -- 172.21.15.79:0/1035518639 wait complete. 2024-04-25T02:15:47.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.051+0000 7fa8e0a07640 1 Processor -- start 2024-04-25T02:15:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.051+0000 7fa8e0a07640 1 -- start start 2024-04-25T02:15:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8e0a07640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc06df50 0x7fa8dc1532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8e0a07640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8dc0b2d30 0x7fa8dc158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8e0a07640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8dc143bc0 0x7fa8dc1549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8e0a07640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc072940 con 0x7fa8dc06df50 2024-04-25T02:15:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8e0a07640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc072660 con 0x7fa8dc143bc0 2024-04-25T02:15:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8e0a07640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa8dc143fa0 con 0x7fa8dc0b2d30 2024-04-25T02:15:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8da59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc06df50 0x7fa8dc1532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8da59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc06df50 0x7fa8dc1532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51750/0 (socket says 172.21.15.79:51750) 2024-04-25T02:15:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8da59c640 1 -- 172.21.15.79:0/2753251832 learned_addr learned my addr 172.21.15.79:0/2753251832 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8d9d9b640 1 --2- 172.21.15.79:0/2753251832 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8dc0b2d30 0x7fa8dc158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8dad9d640 1 --2- 172.21.15.79:0/2753251832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8dc143bc0 0x7fa8dc1549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8da59c640 1 -- 172.21.15.79:0/2753251832 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8dc0b2d30 msgr2=0x7fa8dc158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8da59c640 1 --2- 172.21.15.79:0/2753251832 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8dc0b2d30 0x7fa8dc158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8da59c640 1 -- 172.21.15.79:0/2753251832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8dc143bc0 msgr2=0x7fa8dc1549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8da59c640 1 --2- 172.21.15.79:0/2753251832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8dc143bc0 0x7fa8dc1549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8da59c640 1 -- 172.21.15.79:0/2753251832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc153910 con 0x7fa8dc06df50 2024-04-25T02:15:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.052+0000 7fa8da59c640 1 --2- 172.21.15.79:0/2753251832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc06df50 0x7fa8dc1532a0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00c7c0 tx=0x7fa8cc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.053+0000 7fa8caffd640 1 -- 172.21.15.79:0/2753251832 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc016020 con 0x7fa8dc06df50 2024-04-25T02:15:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.053+0000 7fa8caffd640 1 -- 172.21.15.79:0/2753251832 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8cc00aa50 con 0x7fa8dc06df50 2024-04-25T02:15:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.053+0000 7fa8caffd640 1 -- 172.21.15.79:0/2753251832 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc012420 con 0x7fa8dc06df50 2024-04-25T02:15:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.053+0000 7fa8e0a07640 1 -- 172.21.15.79:0/2753251832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8dc153bf0 con 0x7fa8dc06df50 2024-04-25T02:15:47.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.053+0000 7fa8e0a07640 1 -- 172.21.15.79:0/2753251832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8dc1541b0 con 0x7fa8dc06df50 2024-04-25T02:15:47.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.054+0000 7fa8e0a07640 1 -- 172.21.15.79:0/2753251832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8dc0690a0 con 0x7fa8dc06df50 2024-04-25T02:15:47.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.054+0000 7fa8caffd640 1 -- 172.21.15.79:0/2753251832 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa8cc019020 con 0x7fa8dc06df50 2024-04-25T02:15:47.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.054+0000 7fa8caffd640 1 --2- 172.21.15.79:0/2753251832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa8bc06be60 0x7fa8bc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.054+0000 7fa8caffd640 1 -- 172.21.15.79:0/2753251832 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7fa8cc08ab80 con 0x7fa8dc06df50 2024-04-25T02:15:47.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.054+0000 7fa8d9d9b640 1 --2- 172.21.15.79:0/2753251832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa8bc06be60 0x7fa8bc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.055+0000 7fa8d9d9b640 1 --2- 172.21.15.79:0/2753251832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa8bc06be60 0x7fa8bc06e320 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0034000 tx=0x7fa8d002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:47.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.059+0000 7fa8caffd640 1 -- 172.21.15.79:0/2753251832 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa8cc020070 con 0x7fa8dc06df50 2024-04-25T02:15:47.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.265+0000 7fa8e0a07640 1 -- 172.21.15.79:0/2753251832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8dc0cf7e0 con 0x7fa8dc06df50 2024-04-25T02:15:47.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.266+0000 7fa8caffd640 1 -- 172.21.15.79:0/2753251832 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5190 (secure 0 0 0) 0x7fa8cc0594f0 con 0x7fa8dc06df50 2024-04-25T02:15:47.271 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:47.272 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:13:43.382458+0000","modified":"2024-04-25T02:15:08.854388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7896},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7896":{"gid":7896,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/1474949173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1474949173},{"type":"v1","addr":"172.21.15.79:6837","nonce":1474949173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7896,"qdb_cluster":[7896]},"id":6}]} 2024-04-25T02:15:47.273 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 61 2024-04-25T02:15:47.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.267+0000 7fa8e0a07640 1 -- 172.21.15.79:0/2753251832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa8bc06be60 msgr2=0x7fa8bc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.267+0000 7fa8e0a07640 1 --2- 172.21.15.79:0/2753251832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa8bc06be60 0x7fa8bc06e320 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0034000 tx=0x7fa8d002e000 comp rx=0 tx=0).stop 2024-04-25T02:15:47.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.267+0000 7fa8e0a07640 1 -- 172.21.15.79:0/2753251832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc06df50 msgr2=0x7fa8dc1532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.267+0000 7fa8e0a07640 1 --2- 172.21.15.79:0/2753251832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc06df50 0x7fa8dc1532a0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00c7c0 tx=0x7fa8cc00cc80 comp rx=0 tx=0).stop 2024-04-25T02:15:47.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.267+0000 7fa8e0a07640 1 -- 172.21.15.79:0/2753251832 shutdown_connections 2024-04-25T02:15:47.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.267+0000 7fa8e0a07640 1 --2- 172.21.15.79:0/2753251832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa8bc06be60 0x7fa8bc06e320 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.267+0000 7fa8e0a07640 1 --2- 172.21.15.79:0/2753251832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8dc143bc0 0x7fa8dc1549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.267+0000 7fa8e0a07640 1 --2- 172.21.15.79:0/2753251832 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8dc0b2d30 0x7fa8dc158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.267+0000 7fa8e0a07640 1 --2- 172.21.15.79:0/2753251832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8dc06df50 0x7fa8dc1532a0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.267+0000 7fa8e0a07640 1 -- 172.21.15.79:0/2753251832 >> 172.21.15.79:0/2753251832 conn(0x7fa8dc0cfc80 msgr2=0x7fa8dc0cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:47.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.268+0000 7fa8e0a07640 1 -- 172.21.15.79:0/2753251832 shutdown_connections 2024-04-25T02:15:47.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.268+0000 7fa8e0a07640 1 -- 172.21.15.79:0/2753251832 wait complete. 2024-04-25T02:15:47.284 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:15:47.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.377+0000 7f72b54d4640 1 Processor -- start 2024-04-25T02:15:47.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.377+0000 7f72b54d4640 1 -- start start 2024-04-25T02:15:47.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.377+0000 7f72b54d4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f72b015e4d0 0x7f72b006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.377+0000 7f72b54d4640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f72b00b3570 0x7f72b00d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.377+0000 7f72b54d4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72b00d1660 con 0x7f72b00b3020 2024-04-25T02:15:47.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.377+0000 7f72b54d4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f72b00d1380 con 0x7f72b015e4d0 2024-04-25T02:15:47.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.377+0000 7f72b54d4640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f72b00cede0 con 0x7f72b00b3570 2024-04-25T02:15:47.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.378+0000 7f72aeffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f72b015e4d0 0x7f72b006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.378+0000 7f72af7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f72b00b3020 0x7f72b00cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60632/0 (socket says 172.21.15.79:60632) 2024-04-25T02:15:47.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.378+0000 7f72af7fe640 1 -- 172.21.15.79:0/1890131321 learned_addr learned my addr 172.21.15.79:0/1890131321 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:47.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.378+0000 7f72ae7fc640 1 --2- 172.21.15.79:0/1890131321 >> v2:172.21.15.189:3300/0 conn(0x7f72b00b3570 0x7f72b00d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.378+0000 7f72aeffd640 1 -- 172.21.15.79:0/1890131321 >> v2:172.21.15.189:3300/0 conn(0x7f72b00b3570 msgr2=0x7f72b00d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:47.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.378+0000 7f72aeffd640 1 --2- 172.21.15.79:0/1890131321 >> v2:172.21.15.189:3300/0 conn(0x7f72b00b3570 0x7f72b00d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.378+0000 7f72aeffd640 1 -- 172.21.15.79:0/1890131321 >> v1:172.21.15.79:6789/0 conn(0x7f72b00b3020 legacy=0x7f72b00cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.378+0000 7f72aeffd640 1 -- 172.21.15.79:0/1890131321 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b00cf0c0 con 0x7f72b015e4d0 2024-04-25T02:15:47.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.378+0000 7f72adffb640 1 -- 172.21.15.79:0/1890131321 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1454445879 0 0) 0x7f72b00d1660 con 0x7f72b00b3020 2024-04-25T02:15:47.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.378+0000 7f72aeffd640 1 --2- 172.21.15.79:0/1890131321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72b015e4d0 0x7f72b006bc70 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009d90 tx=0x7f72a802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb326319854a12ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:47.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.379+0000 7f72adffb640 1 -- 172.21.15.79:0/1890131321 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8007740 con 0x7f72b015e4d0 2024-04-25T02:15:47.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.379+0000 7f72adffb640 1 -- 172.21.15.79:0/1890131321 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a80078e0 con 0x7f72b015e4d0 2024-04-25T02:15:47.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.379+0000 7f72adffb640 1 -- 172.21.15.79:0/1890131321 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8007cb0 con 0x7f72b015e4d0 2024-04-25T02:15:47.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.379+0000 7f72b54d4640 1 -- 172.21.15.79:0/1890131321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72b015e4d0 msgr2=0x7f72b006bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.379+0000 7f72b54d4640 1 --2- 172.21.15.79:0/1890131321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72b015e4d0 0x7f72b006bc70 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009d90 tx=0x7f72a802a6a0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.379+0000 7f72b54d4640 1 -- 172.21.15.79:0/1890131321 shutdown_connections 2024-04-25T02:15:47.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.379+0000 7f72b54d4640 1 --2- 172.21.15.79:0/1890131321 >> v2:172.21.15.189:3300/0 conn(0x7f72b00b3570 0x7f72b00d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.379+0000 7f72b54d4640 1 --2- 172.21.15.79:0/1890131321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72b015e4d0 0x7f72b006bc70 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.379+0000 7f72b54d4640 1 -- 172.21.15.79:0/1890131321 >> 172.21.15.79:0/1890131321 conn(0x7f72b009d460 msgr2=0x7f72b00d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:47.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.379+0000 7f72b54d4640 1 -- 172.21.15.79:0/1890131321 shutdown_connections 2024-04-25T02:15:47.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.379+0000 7f72b54d4640 1 -- 172.21.15.79:0/1890131321 wait complete. 2024-04-25T02:15:47.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.380+0000 7f72b54d4640 1 Processor -- start 2024-04-25T02:15:47.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.381+0000 7f72b54d4640 1 -- start start 2024-04-25T02:15:47.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.381+0000 7f72b54d4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72b00b3020 0x7f72b01f3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.381+0000 7f72b54d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72b00b3570 0x7f72b00b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.381+0000 7f72b54d4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72b015e4d0 0x7f72b00b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.381+0000 7f72b54d4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f72b00d2250 con 0x7f72b00b3570 2024-04-25T02:15:47.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.381+0000 7f72b54d4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f72b00d20d0 con 0x7f72b015e4d0 2024-04-25T02:15:47.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.381+0000 7f72b54d4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f72b006c1b0 con 0x7f72b00b3020 2024-04-25T02:15:47.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.381+0000 7f72ae7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72b00b3570 0x7f72b00b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.381+0000 7f72ae7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72b00b3570 0x7f72b00b6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51770/0 (socket says 172.21.15.79:51770) 2024-04-25T02:15:47.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.381+0000 7f72ae7fc640 1 -- 172.21.15.79:0/1038244417 learned_addr learned my addr 172.21.15.79:0/1038244417 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:47.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.382+0000 7f72ae7fc640 1 -- 172.21.15.79:0/1038244417 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72b00b3020 msgr2=0x7f72b01f3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.382+0000 7f72ae7fc640 1 --2- 172.21.15.79:0/1038244417 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72b00b3020 0x7f72b01f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.382+0000 7f72ae7fc640 1 -- 172.21.15.79:0/1038244417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72b015e4d0 msgr2=0x7f72b00b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.382+0000 7f72ae7fc640 1 --2- 172.21.15.79:0/1038244417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72b015e4d0 0x7f72b00b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.382+0000 7f72ae7fc640 1 -- 172.21.15.79:0/1038244417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b00b95e0 con 0x7f72b00b3570 2024-04-25T02:15:47.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.382+0000 7f72ae7fc640 1 --2- 172.21.15.79:0/1038244417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72b00b3570 0x7f72b00b6d20 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f729800d800 tx=0x7f729800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:47.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.382+0000 7f72a77fe640 1 -- 172.21.15.79:0/1038244417 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729800b6c0 con 0x7f72b00b3570 2024-04-25T02:15:47.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.382+0000 7f72a77fe640 1 -- 172.21.15.79:0/1038244417 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7298019070 con 0x7f72b00b3570 2024-04-25T02:15:47.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.382+0000 7f72b54d4640 1 -- 172.21.15.79:0/1038244417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b00b98c0 con 0x7f72b00b3570 2024-04-25T02:15:47.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.382+0000 7f72a77fe640 1 -- 172.21.15.79:0/1038244417 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729800ba80 con 0x7f72b00b3570 2024-04-25T02:15:47.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.382+0000 7f72b54d4640 1 -- 172.21.15.79:0/1038244417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b0150bd0 con 0x7f72b00b3570 2024-04-25T02:15:47.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.383+0000 7f72b54d4640 1 -- 172.21.15.79:0/1038244417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b00690a0 con 0x7f72b00b3570 2024-04-25T02:15:47.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.383+0000 7f72a77fe640 1 -- 172.21.15.79:0/1038244417 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f729800bc20 con 0x7f72b00b3570 2024-04-25T02:15:47.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.384+0000 7f72a77fe640 1 --2- 172.21.15.79:0/1038244417 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f729006be60 0x7f729006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.384+0000 7f72aeffd640 1 --2- 172.21.15.79:0/1038244417 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f729006be60 0x7f729006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.384+0000 7f72a77fe640 1 -- 172.21.15.79:0/1038244417 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f729808b310 con 0x7f72b00b3570 2024-04-25T02:15:47.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.384+0000 7f72aeffd640 1 --2- 172.21.15.79:0/1038244417 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f729006be60 0x7f729006e320 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f72a8034000 tx=0x7f72a802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:47.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.388+0000 7f72a77fe640 1 -- 172.21.15.79:0/1038244417 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7298059c80 con 0x7f72b00b3570 2024-04-25T02:15:47.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.564+0000 7f72b54d4640 1 -- 172.21.15.79:0/1038244417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72b00d1920 con 0x7f72b00b3570 2024-04-25T02:15:47.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.565+0000 7f72a77fe640 1 -- 172.21.15.79:0/1038244417 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+16979 (secure 0 0 0) 0x7f7298059580 con 0x7f72b00b3570 2024-04-25T02:15:47.570 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:47.571 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":90,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:15:04.828059+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:13:41.594939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T02:13:42.348770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.2a","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/630320044":"2024-04-26T02:15:04.828036+0000","172.21.15.79:6836/630320044":"2024-04-26T02:15:04.828036+0000","172.21.15.79:6837/2290864495":"2024-04-26T02:13:53.595807+0000","172.21.15.79:6836/2290864495":"2024-04-26T02:13:53.595807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:15:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.567+0000 7f72b54d4640 1 -- 172.21.15.79:0/1038244417 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f729006be60 msgr2=0x7f729006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.567+0000 7f72b54d4640 1 --2- 172.21.15.79:0/1038244417 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f729006be60 0x7f729006e320 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f72a8034000 tx=0x7f72a802e000 comp rx=0 tx=0).stop 2024-04-25T02:15:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.567+0000 7f72b54d4640 1 -- 172.21.15.79:0/1038244417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72b00b3570 msgr2=0x7f72b00b6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.567+0000 7f72b54d4640 1 --2- 172.21.15.79:0/1038244417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72b00b3570 0x7f72b00b6d20 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f729800d800 tx=0x7f729800dcc0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.567+0000 7f72b54d4640 1 -- 172.21.15.79:0/1038244417 shutdown_connections 2024-04-25T02:15:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.567+0000 7f72b54d4640 1 --2- 172.21.15.79:0/1038244417 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f729006be60 0x7f729006e320 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.567+0000 7f72b54d4640 1 --2- 172.21.15.79:0/1038244417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72b015e4d0 0x7f72b00b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.567+0000 7f72b54d4640 1 --2- 172.21.15.79:0/1038244417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72b00b3570 0x7f72b00b6d20 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.567+0000 7f72b54d4640 1 --2- 172.21.15.79:0/1038244417 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72b00b3020 0x7f72b01f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.567+0000 7f72b54d4640 1 -- 172.21.15.79:0/1038244417 >> 172.21.15.79:0/1038244417 conn(0x7f72b009d460 msgr2=0x7f72b015d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.567+0000 7f72b54d4640 1 -- 172.21.15.79:0/1038244417 shutdown_connections 2024-04-25T02:15:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.567+0000 7f72b54d4640 1 -- 172.21.15.79:0/1038244417 wait complete. 2024-04-25T02:15:47.584 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:15:47.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.676+0000 7f3e71302640 1 Processor -- start 2024-04-25T02:15:47.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.676+0000 7f3e71302640 1 -- start start 2024-04-25T02:15:47.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.676+0000 7f3e71302640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f3e6c0cc100 0x7f3e6c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.676+0000 7f3e71302640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3e6c06b5f0 0x7f3e6c06e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.676+0000 7f3e71302640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e6c0b04c0 con 0x7f3e6c0b00e0 2024-04-25T02:15:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.676+0000 7f3e71302640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3e6c06ba20 con 0x7f3e6c06b5f0 2024-04-25T02:15:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.676+0000 7f3e71302640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3e6c0d02b0 con 0x7f3e6c0cc100 2024-04-25T02:15:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.677+0000 7f3e6b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3e6c06b5f0 0x7f3e6c06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.677+0000 7f3e6affd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3e6c0b00e0 0x7f3e6c0cfa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60638/0 (socket says 172.21.15.79:60638) 2024-04-25T02:15:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.677+0000 7f3e6affd640 1 -- 172.21.15.79:0/2812142300 learned_addr learned my addr 172.21.15.79:0/2812142300 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.677+0000 7f3e6a7fc640 1 --2- 172.21.15.79:0/2812142300 >> v2:172.21.15.189:3300/0 conn(0x7f3e6c0cc100 0x7f3e6c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.677+0000 7f3e6b7fe640 1 -- 172.21.15.79:0/2812142300 >> v2:172.21.15.189:3300/0 conn(0x7f3e6c0cc100 msgr2=0x7f3e6c06b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.677+0000 7f3e6b7fe640 1 --2- 172.21.15.79:0/2812142300 >> v2:172.21.15.189:3300/0 conn(0x7f3e6c0cc100 0x7f3e6c06b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.677+0000 7f3e6b7fe640 1 -- 172.21.15.79:0/2812142300 >> v1:172.21.15.79:6789/0 conn(0x7f3e6c0b00e0 legacy=0x7f3e6c0cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.677+0000 7f3e6b7fe640 1 -- 172.21.15.79:0/2812142300 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6c0d0590 con 0x7f3e6c06b5f0 2024-04-25T02:15:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.677+0000 7f3e69ffb640 1 -- 172.21.15.79:0/2812142300 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3574363683 0 0) 0x7f3e6c0b04c0 con 0x7f3e6c0b00e0 2024-04-25T02:15:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.678+0000 7f3e6b7fe640 1 --2- 172.21.15.79:0/2812142300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c06b5f0 0x7f3e6c06e800 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0b3810 tx=0x7f3e6402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af15bfd3bd756e6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.678+0000 7f3e69ffb640 1 -- 172.21.15.79:0/2812142300 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64007740 con 0x7f3e6c06b5f0 2024-04-25T02:15:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.678+0000 7f3e69ffb640 1 -- 172.21.15.79:0/2812142300 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e640078e0 con 0x7f3e6c06b5f0 2024-04-25T02:15:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.678+0000 7f3e69ffb640 1 -- 172.21.15.79:0/2812142300 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64007cb0 con 0x7f3e6c06b5f0 2024-04-25T02:15:47.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.678+0000 7f3e71302640 1 -- 172.21.15.79:0/2812142300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c06b5f0 msgr2=0x7f3e6c06e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.678+0000 7f3e71302640 1 --2- 172.21.15.79:0/2812142300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c06b5f0 0x7f3e6c06e800 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0b3810 tx=0x7f3e6402a710 comp rx=0 tx=0).stop 2024-04-25T02:15:47.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.678+0000 7f3e71302640 1 -- 172.21.15.79:0/2812142300 shutdown_connections 2024-04-25T02:15:47.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.678+0000 7f3e71302640 1 --2- 172.21.15.79:0/2812142300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c06b5f0 0x7f3e6c06e800 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.678+0000 7f3e71302640 1 --2- 172.21.15.79:0/2812142300 >> v2:172.21.15.189:3300/0 conn(0x7f3e6c0cc100 0x7f3e6c06b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.678+0000 7f3e71302640 1 -- 172.21.15.79:0/2812142300 >> 172.21.15.79:0/2812142300 conn(0x7f3e6c0cd770 msgr2=0x7f3e6c0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.678+0000 7f3e71302640 1 -- 172.21.15.79:0/2812142300 shutdown_connections 2024-04-25T02:15:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.678+0000 7f3e71302640 1 -- 172.21.15.79:0/2812142300 wait complete. 2024-04-25T02:15:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.680+0000 7f3e71302640 1 Processor -- start 2024-04-25T02:15:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.680+0000 7f3e71302640 1 -- start start 2024-04-25T02:15:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.680+0000 7f3e71302640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e6c06b5f0 0x7f3e6c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.680+0000 7f3e71302640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e6c0b00e0 0x7f3e6c1f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.680+0000 7f3e71302640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c0cc100 0x7f3e6c0ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.680+0000 7f3e71302640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c06dfd0 con 0x7f3e6c0cc100 2024-04-25T02:15:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.680+0000 7f3e71302640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c06e2e0 con 0x7f3e6c06b5f0 2024-04-25T02:15:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.680+0000 7f3e71302640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3e6c06ed40 con 0x7f3e6c0b00e0 2024-04-25T02:15:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.680+0000 7f3e6b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c0cc100 0x7f3e6c0ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.680+0000 7f3e6b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c0cc100 0x7f3e6c0ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51778/0 (socket says 172.21.15.79:51778) 2024-04-25T02:15:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.680+0000 7f3e6b7fe640 1 -- 172.21.15.79:0/2825448436 learned_addr learned my addr 172.21.15.79:0/2825448436 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.681+0000 7f3e6affd640 1 --2- 172.21.15.79:0/2825448436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e6c06b5f0 0x7f3e6c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.681+0000 7f3e6a7fc640 1 --2- 172.21.15.79:0/2825448436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e6c0b00e0 0x7f3e6c1f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.681+0000 7f3e6b7fe640 1 -- 172.21.15.79:0/2825448436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e6c0b00e0 msgr2=0x7f3e6c1f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.681+0000 7f3e6b7fe640 1 --2- 172.21.15.79:0/2825448436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e6c0b00e0 0x7f3e6c1f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.681+0000 7f3e6b7fe640 1 -- 172.21.15.79:0/2825448436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e6c06b5f0 msgr2=0x7f3e6c15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.681+0000 7f3e6b7fe640 1 --2- 172.21.15.79:0/2825448436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e6c06b5f0 0x7f3e6c15c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.681+0000 7f3e6b7fe640 1 -- 172.21.15.79:0/2825448436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6c15c620 con 0x7f3e6c0cc100 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.681+0000 7f3e6a7fc640 1 --2- 172.21.15.79:0/2825448436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e6c0b00e0 0x7f3e6c1f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.681+0000 7f3e6b7fe640 1 --2- 172.21.15.79:0/2825448436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c0cc100 0x7f3e6c0ae990 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009e50 tx=0x7f3e64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.681+0000 7f3e537fe640 1 -- 172.21.15.79:0/2825448436 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64040070 con 0x7f3e6c0cc100 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.681+0000 7f3e537fe640 1 -- 172.21.15.79:0/2825448436 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e64031bf0 con 0x7f3e6c0cc100 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.681+0000 7f3e71302640 1 -- 172.21.15.79:0/2825448436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6c0c95d0 con 0x7f3e6c0cc100 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.681+0000 7f3e537fe640 1 -- 172.21.15.79:0/2825448436 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64045460 con 0x7f3e6c0cc100 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.681+0000 7f3e71302640 1 -- 172.21.15.79:0/2825448436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e6c0c9b90 con 0x7f3e6c0cc100 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.682+0000 7f3e71302640 1 -- 172.21.15.79:0/2825448436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e6c0690a0 con 0x7f3e6c0cc100 2024-04-25T02:15:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.682+0000 7f3e537fe640 1 -- 172.21.15.79:0/2825448436 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e64039040 con 0x7f3e6c0cc100 2024-04-25T02:15:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.683+0000 7f3e537fe640 1 --2- 172.21.15.79:0/2825448436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3e5806be30 0x7f3e5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.683+0000 7f3e537fe640 1 -- 172.21.15.79:0/2825448436 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5910+0+0 (secure 0 0 0) 0x7f3e640ac790 con 0x7f3e6c0cc100 2024-04-25T02:15:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.683+0000 7f3e6affd640 1 --2- 172.21.15.79:0/2825448436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3e5806be30 0x7f3e5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.683+0000 7f3e6affd640 1 --2- 172.21.15.79:0/2825448436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3e5806be30 0x7f3e5806e2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c000f60 tx=0x7f3e5c007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:47.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.687+0000 7f3e537fe640 1 -- 172.21.15.79:0/2825448436 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3e6407b1a0 con 0x7f3e6c0cc100 2024-04-25T02:15:47.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.898+0000 7f3e71302640 1 -- 172.21.15.79:0/2825448436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3e6c0cbce0 con 0x7f3e6c0cc100 2024-04-25T02:15:47.903 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:15:47.898+0000 7fb0c50c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:15:47.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.900+0000 7f3e537fe640 1 -- 172.21.15.79:0/2825448436 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) ==== 161+0+0 (secure 0 0 0) 0x7f3e6407aaa0 con 0x7f3e6c0cc100 2024-04-25T02:15:47.905 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:15:47.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.903+0000 7f3e71302640 1 -- 172.21.15.79:0/2825448436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3e5806be30 msgr2=0x7f3e5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.903+0000 7f3e71302640 1 --2- 172.21.15.79:0/2825448436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3e5806be30 0x7f3e5806e2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c000f60 tx=0x7f3e5c007d50 comp rx=0 tx=0).stop 2024-04-25T02:15:47.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.903+0000 7f3e71302640 1 -- 172.21.15.79:0/2825448436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c0cc100 msgr2=0x7f3e6c0ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:47.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.903+0000 7f3e71302640 1 --2- 172.21.15.79:0/2825448436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c0cc100 0x7f3e6c0ae990 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009e50 tx=0x7f3e64004a40 comp rx=0 tx=0).stop 2024-04-25T02:15:47.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.903+0000 7f3e71302640 1 -- 172.21.15.79:0/2825448436 shutdown_connections 2024-04-25T02:15:47.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.903+0000 7f3e71302640 1 --2- 172.21.15.79:0/2825448436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3e5806be30 0x7f3e5806e2f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.903+0000 7f3e71302640 1 --2- 172.21.15.79:0/2825448436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c0cc100 0x7f3e6c0ae990 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.903+0000 7f3e71302640 1 --2- 172.21.15.79:0/2825448436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e6c0b00e0 0x7f3e6c1f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.903+0000 7f3e71302640 1 --2- 172.21.15.79:0/2825448436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e6c06b5f0 0x7f3e6c15c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:47.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.903+0000 7f3e71302640 1 -- 172.21.15.79:0/2825448436 >> 172.21.15.79:0/2825448436 conn(0x7f3e6c0cd770 msgr2=0x7f3e6c0b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:47.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.903+0000 7f3e71302640 1 -- 172.21.15.79:0/2825448436 shutdown_connections 2024-04-25T02:15:47.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:47.903+0000 7f3e71302640 1 -- 172.21.15.79:0/2825448436 wait complete. 2024-04-25T02:15:47.909 INFO:tasks.ceph.mds.a.smithi079.stderr: -2359> 2024-04-25T02:15:10.841+0000 7fef52e36640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:15:47.909 INFO:tasks.ceph.mds.a.smithi079.stderr: -1904> 2024-04-25T02:15:11.425+0000 7fef4ee2e640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() | dirtyparent=1 authpin=1 scrubqueue=0 0x559eedad1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(13)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(13)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:15:47.919 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T02:15:47.936 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:15:48.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.014+0000 7f48d2a7d640 1 Processor -- start 2024-04-25T02:15:48.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.014+0000 7f48d2a7d640 1 -- start start 2024-04-25T02:15:48.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.014+0000 7f48d2a7d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f48cc0d10c0 0x7f48cc06bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:48.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.014+0000 7f48d2a7d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48cc0d1ee0 con 0x7f48cc15e4f0 2024-04-25T02:15:48.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.014+0000 7f48d2a7d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48cc0d21c0 con 0x7f48cc0d2ca0 2024-04-25T02:15:48.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.014+0000 7f48d2a7d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f48cc0d3130 con 0x7f48cc0d10c0 2024-04-25T02:15:48.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.015+0000 7f48d101a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f48cc0d10c0 0x7f48cc06bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:48.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.015+0000 7f48d0819640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f48cc15e4f0 0x7f48cc0cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60640/0 (socket says 172.21.15.79:60640) 2024-04-25T02:15:48.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.015+0000 7f48d0819640 1 -- 172.21.15.79:0/1074770049 learned_addr learned my addr 172.21.15.79:0/1074770049 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.015+0000 7f48d101a640 1 -- 172.21.15.79:0/1074770049 >> v1:172.21.15.189:6789/0 conn(0x7f48cc0d2ca0 legacy=0x7f48cc0d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.015+0000 7f48d101a640 1 -- 172.21.15.79:0/1074770049 >> v1:172.21.15.79:6789/0 conn(0x7f48cc15e4f0 legacy=0x7f48cc0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.015+0000 7f48d101a640 1 -- 172.21.15.79:0/1074770049 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc0d24a0 con 0x7f48cc0d10c0 2024-04-25T02:15:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.015+0000 7f48cb7fe640 1 -- 172.21.15.79:0/1074770049 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1316961493 0 0) 0x7f48cc0d1ee0 con 0x7f48cc15e4f0 2024-04-25T02:15:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.015+0000 7f48d101a640 1 --2- 172.21.15.79:0/1074770049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48cc0d10c0 0x7f48cc06bc30 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009dc0 tx=0x7f48c402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07f93212d2d1c5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.016+0000 7f48cb7fe640 1 -- 172.21.15.79:0/1074770049 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4007740 con 0x7f48cc0d10c0 2024-04-25T02:15:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.016+0000 7f48cb7fe640 1 -- 172.21.15.79:0/1074770049 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c40078e0 con 0x7f48cc0d10c0 2024-04-25T02:15:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.016+0000 7f48cb7fe640 1 -- 172.21.15.79:0/1074770049 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4007cb0 con 0x7f48cc0d10c0 2024-04-25T02:15:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.016+0000 7f48d2a7d640 1 -- 172.21.15.79:0/1074770049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48cc0d10c0 msgr2=0x7f48cc06bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.016+0000 7f48d2a7d640 1 --2- 172.21.15.79:0/1074770049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48cc0d10c0 0x7f48cc06bc30 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009dc0 tx=0x7f48c402a6d0 comp rx=0 tx=0).stop 2024-04-25T02:15:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.016+0000 7f48d2a7d640 1 -- 172.21.15.79:0/1074770049 shutdown_connections 2024-04-25T02:15:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.016+0000 7f48d2a7d640 1 --2- 172.21.15.79:0/1074770049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48cc0d10c0 0x7f48cc06bc30 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.016+0000 7f48d2a7d640 1 -- 172.21.15.79:0/1074770049 >> 172.21.15.79:0/1074770049 conn(0x7f48cc09d4a0 msgr2=0x7f48cc0d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.016+0000 7f48d2a7d640 1 -- 172.21.15.79:0/1074770049 shutdown_connections 2024-04-25T02:15:48.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.016+0000 7f48d2a7d640 1 -- 172.21.15.79:0/1074770049 wait complete. 2024-04-25T02:15:48.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.017+0000 7f48d2a7d640 1 Processor -- start 2024-04-25T02:15:48.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.017+0000 7f48d2a7d640 1 -- start start 2024-04-25T02:15:48.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.018+0000 7f48d2a7d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f48cc0d10c0 0x7f48cc1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:48.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.018+0000 7f48d2a7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48cc0d2ca0 0x7f48cc0b98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.018+0000 7f48d2a7d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48cc15e4f0 0x7f48cc1f7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.018+0000 7f48d2a7d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc0d4ee0 con 0x7f48cc0d2ca0 2024-04-25T02:15:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.018+0000 7f48d2a7d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc0cff00 con 0x7f48cc15e4f0 2024-04-25T02:15:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.018+0000 7f48d2a7d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f48cc0d5060 con 0x7f48cc0d10c0 2024-04-25T02:15:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.018+0000 7f48cbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48cc0d2ca0 0x7f48cc0b98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.018+0000 7f48cbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48cc0d2ca0 0x7f48cc0b98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51822/0 (socket says 172.21.15.79:51822) 2024-04-25T02:15:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.018+0000 7f48cbfff640 1 -- 172.21.15.79:0/1249281731 learned_addr learned my addr 172.21.15.79:0/1249281731 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.018+0000 7f48cbfff640 1 -- 172.21.15.79:0/1249281731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f48cc0d10c0 msgr2=0x7f48cc1579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.018+0000 7f48cbfff640 1 --2- 172.21.15.79:0/1249281731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f48cc0d10c0 0x7f48cc1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.019+0000 7f48cbfff640 1 -- 172.21.15.79:0/1249281731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48cc15e4f0 msgr2=0x7f48cc1f7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.019+0000 7f48d101a640 1 --2- 172.21.15.79:0/1249281731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48cc15e4f0 0x7f48cc1f7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.019+0000 7f48cbfff640 1 --2- 172.21.15.79:0/1249281731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48cc15e4f0 0x7f48cc1f7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.019+0000 7f48cbfff640 1 -- 172.21.15.79:0/1249281731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc158030 con 0x7f48cc0d2ca0 2024-04-25T02:15:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.019+0000 7f48cbfff640 1 --2- 172.21.15.79:0/1249281731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48cc0d2ca0 0x7f48cc0b98d0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f48b800c460 tx=0x7f48b800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.019+0000 7f48c97fa640 1 -- 172.21.15.79:0/1249281731 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8011790 con 0x7f48cc0d2ca0 2024-04-25T02:15:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.019+0000 7f48c97fa640 1 -- 172.21.15.79:0/1249281731 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b8017070 con 0x7f48cc0d2ca0 2024-04-25T02:15:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.019+0000 7f48d2a7d640 1 -- 172.21.15.79:0/1249281731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48cc15a450 con 0x7f48cc0d2ca0 2024-04-25T02:15:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.019+0000 7f48c97fa640 1 -- 172.21.15.79:0/1249281731 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8011bb0 con 0x7f48cc0d2ca0 2024-04-25T02:15:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.019+0000 7f48d2a7d640 1 -- 172.21.15.79:0/1249281731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48cc15a120 con 0x7f48cc0d2ca0 2024-04-25T02:15:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.020+0000 7f48d2a7d640 1 -- 172.21.15.79:0/1249281731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48cc0686c0 con 0x7f48cc0d2ca0 2024-04-25T02:15:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.020+0000 7f48c97fa640 1 -- 172.21.15.79:0/1249281731 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48b801c460 con 0x7f48cc0d2ca0 2024-04-25T02:15:48.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.021+0000 7f48c97fa640 1 --2- 172.21.15.79:0/1249281731 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f48b006be30 0x7f48b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:48.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.021+0000 7f48c97fa640 1 -- 172.21.15.79:0/1249281731 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5996+0+0 (secure 0 0 0) 0x7f48b808ad60 con 0x7f48cc0d2ca0 2024-04-25T02:15:48.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.021+0000 7f48d0819640 1 --2- 172.21.15.79:0/1249281731 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f48b006be30 0x7f48b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:48.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.021+0000 7f48d0819640 1 --2- 172.21.15.79:0/1249281731 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f48b006be30 0x7f48b006e2f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f48c0007fd0 tx=0x7f48c0007960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:48.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.025+0000 7f48c97fa640 1 -- 172.21.15.79:0/1249281731 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f48b80595f0 con 0x7f48cc0d2ca0 2024-04-25T02:15:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.237+0000 7f48d2a7d640 1 -- 172.21.15.79:0/1249281731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f48cc0690a0 con 0x7f48cc0d2ca0 2024-04-25T02:15:48.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.933+0000 7f48c97fa640 1 -- 172.21.15.79:0/1249281731 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) ==== 104+0+0 (secure 0 0 0) 0x7f48b8058ef0 con 0x7f48cc0d2ca0 2024-04-25T02:15:48.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.936+0000 7f48d2a7d640 1 -- 172.21.15.79:0/1249281731 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f48b006be30 msgr2=0x7f48b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:48.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.936+0000 7f48d2a7d640 1 --2- 172.21.15.79:0/1249281731 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f48b006be30 0x7f48b006e2f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f48c0007fd0 tx=0x7f48c0007960 comp rx=0 tx=0).stop 2024-04-25T02:15:48.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.936+0000 7f48d2a7d640 1 -- 172.21.15.79:0/1249281731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48cc0d2ca0 msgr2=0x7f48cc0b98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:48.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.936+0000 7f48d2a7d640 1 --2- 172.21.15.79:0/1249281731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48cc0d2ca0 0x7f48cc0b98d0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f48b800c460 tx=0x7f48b800c920 comp rx=0 tx=0).stop 2024-04-25T02:15:48.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.936+0000 7f48d2a7d640 1 -- 172.21.15.79:0/1249281731 shutdown_connections 2024-04-25T02:15:48.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.936+0000 7f48d2a7d640 1 --2- 172.21.15.79:0/1249281731 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f48b006be30 0x7f48b006e2f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:48.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.936+0000 7f48d2a7d640 1 --2- 172.21.15.79:0/1249281731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48cc15e4f0 0x7f48cc1f7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:48.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.936+0000 7f48d2a7d640 1 --2- 172.21.15.79:0/1249281731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48cc0d2ca0 0x7f48cc0b98d0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:48.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.936+0000 7f48d2a7d640 1 --2- 172.21.15.79:0/1249281731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f48cc0d10c0 0x7f48cc1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:48.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.936+0000 7f48d2a7d640 1 -- 172.21.15.79:0/1249281731 >> 172.21.15.79:0/1249281731 conn(0x7f48cc09d4a0 msgr2=0x7f48cc0b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:48.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.936+0000 7f48d2a7d640 1 -- 172.21.15.79:0/1249281731 shutdown_connections 2024-04-25T02:15:48.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:48.936+0000 7f48d2a7d640 1 -- 172.21.15.79:0/1249281731 wait complete. 2024-04-25T02:15:48.955 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T02:15:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.095+0000 7fe257ebd640 1 Processor -- start 2024-04-25T02:15:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.096+0000 7fe257ebd640 1 -- start start 2024-04-25T02:15:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.096+0000 7fe257ebd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe250151780 0x7fe25015b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.096+0000 7fe257ebd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe2500b4e10 0x7fe25006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.096+0000 7fe257ebd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe25006e4a0 con 0x7fe25006e0c0 2024-04-25T02:15:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.096+0000 7fe257ebd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe2500b3e40 con 0x7fe2500b4e10 2024-04-25T02:15:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.096+0000 7fe257ebd640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe2500b5280 con 0x7fe250151780 2024-04-25T02:15:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.097+0000 7fe255458640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe2500b4e10 0x7fe25006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.097+0000 7fe25645a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe25006e0c0 0x7fe25015e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60650/0 (socket says 172.21.15.79:60650) 2024-04-25T02:15:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.097+0000 7fe25645a640 1 -- 172.21.15.79:0/4112953719 learned_addr learned my addr 172.21.15.79:0/4112953719 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.097+0000 7fe255c59640 1 --2- 172.21.15.79:0/4112953719 >> v2:172.21.15.189:3300/0 conn(0x7fe250151780 0x7fe25015b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.097+0000 7fe255458640 1 -- 172.21.15.79:0/4112953719 >> v2:172.21.15.189:3300/0 conn(0x7fe250151780 msgr2=0x7fe25015b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.097+0000 7fe255458640 1 --2- 172.21.15.79:0/4112953719 >> v2:172.21.15.189:3300/0 conn(0x7fe250151780 0x7fe25015b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.097+0000 7fe255458640 1 -- 172.21.15.79:0/4112953719 >> v1:172.21.15.79:6789/0 conn(0x7fe25006e0c0 legacy=0x7fe25015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.097+0000 7fe254c57640 1 -- 172.21.15.79:0/4112953719 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3957410814 0 0) 0x7fe25006e4a0 con 0x7fe25006e0c0 2024-04-25T02:15:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.097+0000 7fe255458640 1 -- 172.21.15.79:0/4112953719 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2500b2da0 con 0x7fe2500b4e10 2024-04-25T02:15:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.097+0000 7fe255c59640 1 --2- 172.21.15.79:0/4112953719 >> v2:172.21.15.189:3300/0 conn(0x7fe250151780 0x7fe25015b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.098+0000 7fe255458640 1 --2- 172.21.15.79:0/4112953719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2500b4e10 0x7fe25006db80 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fe25006f140 tx=0x7fe24c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187fbc2672347169 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.098+0000 7fe254c57640 1 -- 172.21.15.79:0/4112953719 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c037070 con 0x7fe2500b4e10 2024-04-25T02:15:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.098+0000 7fe254c57640 1 -- 172.21.15.79:0/4112953719 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe24c032440 con 0x7fe2500b4e10 2024-04-25T02:15:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.098+0000 7fe254c57640 1 -- 172.21.15.79:0/4112953719 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c032810 con 0x7fe2500b4e10 2024-04-25T02:15:49.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.098+0000 7fe257ebd640 1 -- 172.21.15.79:0/4112953719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2500b4e10 msgr2=0x7fe25006db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.098+0000 7fe257ebd640 1 --2- 172.21.15.79:0/4112953719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2500b4e10 0x7fe25006db80 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fe25006f140 tx=0x7fe24c02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:15:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.098+0000 7fe257ebd640 1 -- 172.21.15.79:0/4112953719 shutdown_connections 2024-04-25T02:15:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.098+0000 7fe257ebd640 1 --2- 172.21.15.79:0/4112953719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2500b4e10 0x7fe25006db80 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.098+0000 7fe257ebd640 1 --2- 172.21.15.79:0/4112953719 >> v2:172.21.15.189:3300/0 conn(0x7fe250151780 0x7fe25015b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.098+0000 7fe257ebd640 1 -- 172.21.15.79:0/4112953719 >> 172.21.15.79:0/4112953719 conn(0x7fe25006b4a0 msgr2=0x7fe25006b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.098+0000 7fe257ebd640 1 -- 172.21.15.79:0/4112953719 shutdown_connections 2024-04-25T02:15:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.098+0000 7fe257ebd640 1 -- 172.21.15.79:0/4112953719 wait complete. 2024-04-25T02:15:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.099+0000 7fe257ebd640 1 Processor -- start 2024-04-25T02:15:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.099+0000 7fe257ebd640 1 -- start start 2024-04-25T02:15:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.100+0000 7fe257ebd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe25006e0c0 0x7fe25014e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.100+0000 7fe257ebd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2500b4e10 0x7fe250153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.100+0000 7fe257ebd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe250151780 0x7fe250151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.100+0000 7fe257ebd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe2500b3640 con 0x7fe2500b4e10 2024-04-25T02:15:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.100+0000 7fe257ebd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe2500b3360 con 0x7fe250151780 2024-04-25T02:15:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.100+0000 7fe257ebd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe2500b3920 con 0x7fe25006e0c0 2024-04-25T02:15:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.100+0000 7fe255458640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2500b4e10 0x7fe250153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.100+0000 7fe255458640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2500b4e10 0x7fe250153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51840/0 (socket says 172.21.15.79:51840) 2024-04-25T02:15:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.100+0000 7fe255458640 1 -- 172.21.15.79:0/3761187020 learned_addr learned my addr 172.21.15.79:0/3761187020 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.100+0000 7fe255458640 1 -- 172.21.15.79:0/3761187020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe25006e0c0 msgr2=0x7fe25014e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.100+0000 7fe255458640 1 --2- 172.21.15.79:0/3761187020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe25006e0c0 0x7fe25014e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.100+0000 7fe255458640 1 -- 172.21.15.79:0/3761187020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe250151780 msgr2=0x7fe250151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.100+0000 7fe255458640 1 --2- 172.21.15.79:0/3761187020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe250151780 0x7fe250151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.100+0000 7fe255458640 1 -- 172.21.15.79:0/3761187020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe250146430 con 0x7fe2500b4e10 2024-04-25T02:15:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.101+0000 7fe255458640 1 --2- 172.21.15.79:0/3761187020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2500b4e10 0x7fe250153e40 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0098c0 tx=0x7fe24c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.101+0000 7fe2467fc640 1 -- 172.21.15.79:0/3761187020 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c037040 con 0x7fe2500b4e10 2024-04-25T02:15:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.101+0000 7fe2467fc640 1 -- 172.21.15.79:0/3761187020 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe24c030770 con 0x7fe2500b4e10 2024-04-25T02:15:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.101+0000 7fe257ebd640 1 -- 172.21.15.79:0/3761187020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe250145e70 con 0x7fe2500b4e10 2024-04-25T02:15:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.101+0000 7fe2467fc640 1 -- 172.21.15.79:0/3761187020 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c030b40 con 0x7fe2500b4e10 2024-04-25T02:15:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.101+0000 7fe257ebd640 1 -- 172.21.15.79:0/3761187020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe250142d80 con 0x7fe2500b4e10 2024-04-25T02:15:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.102+0000 7fe257ebd640 1 -- 172.21.15.79:0/3761187020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2500690a0 con 0x7fe2500b4e10 2024-04-25T02:15:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.102+0000 7fe2467fc640 1 -- 172.21.15.79:0/3761187020 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe24c044020 con 0x7fe2500b4e10 2024-04-25T02:15:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.102+0000 7fe2467fc640 1 --2- 172.21.15.79:0/3761187020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe23406be30 0x7fe23406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.103+0000 7fe2467fc640 1 -- 172.21.15.79:0/3761187020 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5996+0+0 (secure 0 0 0) 0x7fe24c0ab530 con 0x7fe2500b4e10 2024-04-25T02:15:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.103+0000 7fe255c59640 1 --2- 172.21.15.79:0/3761187020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe23406be30 0x7fe23406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.103+0000 7fe255c59640 1 --2- 172.21.15.79:0/3761187020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe23406be30 0x7fe23406e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe240006fd0 tx=0x7fe240008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.107+0000 7fe2467fc640 1 -- 172.21.15.79:0/3761187020 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe24c032e20 con 0x7fe2500b4e10 2024-04-25T02:15:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.279+0000 7fe257ebd640 1 -- 172.21.15.79:0/3761187020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe2500b46e0 con 0x7fe2500b4e10 2024-04-25T02:15:49.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.949+0000 7fe2467fc640 1 -- 172.21.15.79:0/3761187020 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) ==== 181+0+0 (secure 0 0 0) 0x7fe24c0313a0 con 0x7fe2500b4e10 2024-04-25T02:15:49.954 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-04-25T02:15:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.953+0000 7fe257ebd640 1 -- 172.21.15.79:0/3761187020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe23406be30 msgr2=0x7fe23406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.953+0000 7fe257ebd640 1 --2- 172.21.15.79:0/3761187020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe23406be30 0x7fe23406e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe240006fd0 tx=0x7fe240008040 comp rx=0 tx=0).stop 2024-04-25T02:15:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.953+0000 7fe257ebd640 1 -- 172.21.15.79:0/3761187020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2500b4e10 msgr2=0x7fe250153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.953+0000 7fe257ebd640 1 --2- 172.21.15.79:0/3761187020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2500b4e10 0x7fe250153e40 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0098c0 tx=0x7fe24c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:15:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.953+0000 7fe257ebd640 1 -- 172.21.15.79:0/3761187020 shutdown_connections 2024-04-25T02:15:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.953+0000 7fe257ebd640 1 --2- 172.21.15.79:0/3761187020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe23406be30 0x7fe23406e2f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.953+0000 7fe257ebd640 1 --2- 172.21.15.79:0/3761187020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe250151780 0x7fe250151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.953+0000 7fe257ebd640 1 --2- 172.21.15.79:0/3761187020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2500b4e10 0x7fe250153e40 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.953+0000 7fe257ebd640 1 --2- 172.21.15.79:0/3761187020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe25006e0c0 0x7fe25014e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.953+0000 7fe257ebd640 1 -- 172.21.15.79:0/3761187020 >> 172.21.15.79:0/3761187020 conn(0x7fe25006b4a0 msgr2=0x7fe2500cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.953+0000 7fe257ebd640 1 -- 172.21.15.79:0/3761187020 shutdown_connections 2024-04-25T02:15:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:49.953+0000 7fe257ebd640 1 -- 172.21.15.79:0/3761187020 wait complete. 2024-04-25T02:15:49.972 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T02:15:50.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.070+0000 7fcdd515a640 1 Processor -- start 2024-04-25T02:15:50.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.070+0000 7fcdd515a640 1 -- start start 2024-04-25T02:15:50.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.071+0000 7fcdd515a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcdd015e250 0x7fcdd00d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:50.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.071+0000 7fcdd515a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcdd00d1ca0 0x7fcdd00cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:50.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.071+0000 7fcdd515a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdd00d2310 con 0x7fcdd00d2690 2024-04-25T02:15:50.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.071+0000 7fcdd515a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd00d4b30 con 0x7fcdd00d1ca0 2024-04-25T02:15:50.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.071+0000 7fcdd515a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd00cef30 con 0x7fcdd015e250 2024-04-25T02:15:50.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.071+0000 7fcdce59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcdd00d1ca0 0x7fcdd00cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:50.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.071+0000 7fcdcf59e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcdd00d2690 0x7fcdd006bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60654/0 (socket says 172.21.15.79:60654) 2024-04-25T02:15:50.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.071+0000 7fcdcf59e640 1 -- 172.21.15.79:0/3654060713 learned_addr learned my addr 172.21.15.79:0/3654060713 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:50.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.071+0000 7fcdce59c640 1 -- 172.21.15.79:0/3654060713 >> v2:172.21.15.189:3300/0 conn(0x7fcdd015e250 msgr2=0x7fcdd00d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.071+0000 7fcdce59c640 1 --2- 172.21.15.79:0/3654060713 >> v2:172.21.15.189:3300/0 conn(0x7fcdd015e250 0x7fcdd00d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.071+0000 7fcdce59c640 1 -- 172.21.15.79:0/3654060713 >> v1:172.21.15.79:6789/0 conn(0x7fcdd00d2690 legacy=0x7fcdd006bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.071+0000 7fcdcdd9b640 1 -- 172.21.15.79:0/3654060713 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2083817858 0 0) 0x7fcdd00d2310 con 0x7fcdd00d2690 2024-04-25T02:15:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.071+0000 7fcdce59c640 1 -- 172.21.15.79:0/3654060713 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd00cf210 con 0x7fcdd00d1ca0 2024-04-25T02:15:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.072+0000 7fcdce59c640 1 --2- 172.21.15.79:0/3654060713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdd00d1ca0 0x7fcdd00cfa10 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0067b60 tx=0x7fcdc402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7aa1126fe26b22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.072+0000 7fcdcdd9b640 1 -- 172.21.15.79:0/3654060713 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4037070 con 0x7fcdd00d1ca0 2024-04-25T02:15:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.072+0000 7fcdcdd9b640 1 -- 172.21.15.79:0/3654060713 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc4032440 con 0x7fcdd00d1ca0 2024-04-25T02:15:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.072+0000 7fcdcdd9b640 1 -- 172.21.15.79:0/3654060713 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc402ae60 con 0x7fcdd00d1ca0 2024-04-25T02:15:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.073+0000 7fcdd515a640 1 -- 172.21.15.79:0/3654060713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdd00d1ca0 msgr2=0x7fcdd00cfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.073+0000 7fcdd515a640 1 --2- 172.21.15.79:0/3654060713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdd00d1ca0 0x7fcdd00cfa10 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0067b60 tx=0x7fcdc402a110 comp rx=0 tx=0).stop 2024-04-25T02:15:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.073+0000 7fcdd515a640 1 -- 172.21.15.79:0/3654060713 shutdown_connections 2024-04-25T02:15:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.073+0000 7fcdd515a640 1 --2- 172.21.15.79:0/3654060713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdd00d1ca0 0x7fcdd00cfa10 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.073+0000 7fcdd515a640 1 --2- 172.21.15.79:0/3654060713 >> v2:172.21.15.189:3300/0 conn(0x7fcdd015e250 0x7fcdd00d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.073+0000 7fcdd515a640 1 -- 172.21.15.79:0/3654060713 >> 172.21.15.79:0/3654060713 conn(0x7fcdd009d460 msgr2=0x7fcdd00d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:50.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.073+0000 7fcdd515a640 1 -- 172.21.15.79:0/3654060713 shutdown_connections 2024-04-25T02:15:50.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.073+0000 7fcdd515a640 1 -- 172.21.15.79:0/3654060713 wait complete. 2024-04-25T02:15:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.074+0000 7fcdd515a640 1 Processor -- start 2024-04-25T02:15:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.074+0000 7fcdd515a640 1 -- start start 2024-04-25T02:15:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.075+0000 7fcdd515a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcdd00d1ca0 0x7fcdd0157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.075+0000 7fcdd515a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdd00d2690 0x7fcdd00ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.075+0000 7fcdd515a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdd015e250 0x7fcdd00ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.075+0000 7fcdd515a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd00cebe0 con 0x7fcdd015e250 2024-04-25T02:15:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.075+0000 7fcdd515a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd00cff50 con 0x7fcdd00d2690 2024-04-25T02:15:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.075+0000 7fcdd515a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd015e630 con 0x7fcdd00d1ca0 2024-04-25T02:15:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.075+0000 7fcdcf59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdd015e250 0x7fcdd00ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.075+0000 7fcdcf59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdd015e250 0x7fcdd00ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51862/0 (socket says 172.21.15.79:51862) 2024-04-25T02:15:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.075+0000 7fcdcf59e640 1 -- 172.21.15.79:0/2313571296 learned_addr learned my addr 172.21.15.79:0/2313571296 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.075+0000 7fcdcf59e640 1 -- 172.21.15.79:0/2313571296 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcdd00d1ca0 msgr2=0x7fcdd0157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.075+0000 7fcdcf59e640 1 --2- 172.21.15.79:0/2313571296 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcdd00d1ca0 0x7fcdd0157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.075+0000 7fcdcf59e640 1 -- 172.21.15.79:0/2313571296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdd00d2690 msgr2=0x7fcdd00ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.075+0000 7fcdcf59e640 1 --2- 172.21.15.79:0/2313571296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdd00d2690 0x7fcdd00ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.075+0000 7fcdcf59e640 1 -- 172.21.15.79:0/2313571296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd00c8770 con 0x7fcdd015e250 2024-04-25T02:15:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.076+0000 7fcdcf59e640 1 --2- 172.21.15.79:0/2313571296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdd015e250 0x7fcdd00ca670 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800c440 tx=0x7fcdc800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.076+0000 7fcdb77fe640 1 -- 172.21.15.79:0/2313571296 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80074e0 con 0x7fcdd015e250 2024-04-25T02:15:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.076+0000 7fcdb77fe640 1 -- 172.21.15.79:0/2313571296 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc80047e0 con 0x7fcdd015e250 2024-04-25T02:15:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.076+0000 7fcdd515a640 1 -- 172.21.15.79:0/2313571296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd00c8a50 con 0x7fcdd015e250 2024-04-25T02:15:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.076+0000 7fcdb77fe640 1 -- 172.21.15.79:0/2313571296 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8004bd0 con 0x7fcdd015e250 2024-04-25T02:15:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.076+0000 7fcdd515a640 1 -- 172.21.15.79:0/2313571296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd00c9010 con 0x7fcdd015e250 2024-04-25T02:15:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.077+0000 7fcdd515a640 1 -- 172.21.15.79:0/2313571296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd00690a0 con 0x7fcdd015e250 2024-04-25T02:15:50.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.077+0000 7fcdb77fe640 1 -- 172.21.15.79:0/2313571296 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcdc8011070 con 0x7fcdd015e250 2024-04-25T02:15:50.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.077+0000 7fcdb77fe640 1 --2- 172.21.15.79:0/2313571296 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdbc06be30 0x7fcdbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:50.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.078+0000 7fcdb77fe640 1 -- 172.21.15.79:0/2313571296 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5558+0+0 (secure 0 0 0) 0x7fcdc808a9a0 con 0x7fcdd015e250 2024-04-25T02:15:50.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.078+0000 7fcdced9d640 1 --2- 172.21.15.79:0/2313571296 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdbc06be30 0x7fcdbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:50.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.078+0000 7fcdced9d640 1 --2- 172.21.15.79:0/2313571296 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdbc06be30 0x7fcdbc06e2f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000ab90 tx=0x7fcdc0009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:50.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.082+0000 7fcdb77fe640 1 -- 172.21.15.79:0/2313571296 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcdc801a2b0 con 0x7fcdd015e250 2024-04-25T02:15:50.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.261+0000 7fcdd515a640 1 -- 172.21.15.79:0/2313571296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcdd015d930 con 0x7fcdd015e250 2024-04-25T02:15:50.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.950+0000 7fcdb77fe640 1 -- 172.21.15.79:0/2313571296 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) ==== 169+0+0 (secure 0 0 0) 0x7fcdc80593e0 con 0x7fcdd015e250 2024-04-25T02:15:50.956 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-04-25T02:15:50.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.953+0000 7fcdd515a640 1 -- 172.21.15.79:0/2313571296 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdbc06be30 msgr2=0x7fcdbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.953+0000 7fcdd515a640 1 --2- 172.21.15.79:0/2313571296 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdbc06be30 0x7fcdbc06e2f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000ab90 tx=0x7fcdc0009250 comp rx=0 tx=0).stop 2024-04-25T02:15:50.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.953+0000 7fcdd515a640 1 -- 172.21.15.79:0/2313571296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdd015e250 msgr2=0x7fcdd00ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.953+0000 7fcdd515a640 1 --2- 172.21.15.79:0/2313571296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdd015e250 0x7fcdd00ca670 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800c440 tx=0x7fcdc800c900 comp rx=0 tx=0).stop 2024-04-25T02:15:50.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.953+0000 7fcdd515a640 1 -- 172.21.15.79:0/2313571296 shutdown_connections 2024-04-25T02:15:50.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.953+0000 7fcdd515a640 1 --2- 172.21.15.79:0/2313571296 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcdbc06be30 0x7fcdbc06e2f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.953+0000 7fcdd515a640 1 --2- 172.21.15.79:0/2313571296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdd015e250 0x7fcdd00ca670 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.953+0000 7fcdd515a640 1 --2- 172.21.15.79:0/2313571296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdd00d2690 0x7fcdd00ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.953+0000 7fcdd515a640 1 --2- 172.21.15.79:0/2313571296 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcdd00d1ca0 0x7fcdd0157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.953+0000 7fcdd515a640 1 -- 172.21.15.79:0/2313571296 >> 172.21.15.79:0/2313571296 conn(0x7fcdd009d460 msgr2=0x7fcdd00b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:50.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.953+0000 7fcdd515a640 1 -- 172.21.15.79:0/2313571296 shutdown_connections 2024-04-25T02:15:50.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:50.953+0000 7fcdd515a640 1 -- 172.21.15.79:0/2313571296 wait complete. 2024-04-25T02:15:50.977 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T02:15:51.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.080+0000 7f9a76e38640 1 Processor -- start 2024-04-25T02:15:51.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.080+0000 7f9a76e38640 1 -- start start 2024-04-25T02:15:51.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.081+0000 7f9a76e38640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9a700b41b0 0x7f9a701605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.081+0000 7f9a76e38640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a7006b2f0 0x7f9a7006b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.081+0000 7f9a76e38640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a70071cd0 con 0x7f9a70155f00 2024-04-25T02:15:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.081+0000 7f9a76e38640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f9a70071fb0 con 0x7f9a700b41b0 2024-04-25T02:15:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.081+0000 7f9a76e38640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9a70072290 con 0x7f9a7006b2f0 2024-04-25T02:15:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.081+0000 7f9a74bd4640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9a700b41b0 0x7f9a701605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.081+0000 7f9a6ffff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a7006b2f0 0x7f9a7006b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.081+0000 7f9a74bd4640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9a700b41b0 0x7f9a701605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:40282/0 (socket says 172.21.15.79:40282) 2024-04-25T02:15:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.081+0000 7f9a74bd4640 1 -- 172.21.15.79:0/3553516781 learned_addr learned my addr 172.21.15.79:0/3553516781 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.081+0000 7f9a6ffff640 1 --2- 172.21.15.79:0/3553516781 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a7006b2f0 0x7f9a7006b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:39386/0 (socket says 172.21.15.79:39386) 2024-04-25T02:15:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.082+0000 7f9a6ffff640 1 -- 172.21.15.79:0/3553516781 >> v2:172.21.15.189:3300/0 conn(0x7f9a700b41b0 msgr2=0x7f9a701605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.082+0000 7f9a6ffff640 1 --2- 172.21.15.79:0/3553516781 >> v2:172.21.15.189:3300/0 conn(0x7f9a700b41b0 0x7f9a701605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.082+0000 7f9a6ffff640 1 -- 172.21.15.79:0/3553516781 >> v1:172.21.15.189:6789/0 conn(0x7f9a70155f00 legacy=0x7f9a70156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.082+0000 7f9a6ffff640 1 -- 172.21.15.79:0/3553516781 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a70072570 con 0x7f9a7006b2f0 2024-04-25T02:15:51.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.082+0000 7f9a74bd4640 1 --2- 172.21.15.79:0/3553516781 >> v2:172.21.15.189:3300/0 conn(0x7f9a700b41b0 0x7f9a701605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:15:51.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.082+0000 7f9a6ffff640 1 --2- 172.21.15.79:0/3553516781 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a7006b2f0 0x7f9a7006b770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9a600097a0 tx=0x7f9a6002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cdcbf21cd9f0bae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:51.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.082+0000 7f9a6f7fe640 1 -- 172.21.15.79:0/3553516781 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60037070 con 0x7f9a7006b2f0 2024-04-25T02:15:51.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.083+0000 7f9a6f7fe640 1 -- 172.21.15.79:0/3553516781 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a60032440 con 0x7f9a7006b2f0 2024-04-25T02:15:51.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.083+0000 7f9a6f7fe640 1 -- 172.21.15.79:0/3553516781 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60032810 con 0x7f9a7006b2f0 2024-04-25T02:15:51.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.083+0000 7f9a76e38640 1 -- 172.21.15.79:0/3553516781 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a7006b2f0 msgr2=0x7f9a7006b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.083+0000 7f9a76e38640 1 --2- 172.21.15.79:0/3553516781 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a7006b2f0 0x7f9a7006b770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9a600097a0 tx=0x7f9a6002a180 comp rx=0 tx=0).stop 2024-04-25T02:15:51.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.083+0000 7f9a76e38640 1 -- 172.21.15.79:0/3553516781 shutdown_connections 2024-04-25T02:15:51.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.083+0000 7f9a76e38640 1 --2- 172.21.15.79:0/3553516781 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a7006b2f0 0x7f9a7006b770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.083+0000 7f9a76e38640 1 --2- 172.21.15.79:0/3553516781 >> v2:172.21.15.189:3300/0 conn(0x7f9a700b41b0 0x7f9a701605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.083+0000 7f9a76e38640 1 -- 172.21.15.79:0/3553516781 >> 172.21.15.79:0/3553516781 conn(0x7f9a700b1cd0 msgr2=0x7f9a700b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:51.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.083+0000 7f9a76e38640 1 -- 172.21.15.79:0/3553516781 shutdown_connections 2024-04-25T02:15:51.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.083+0000 7f9a76e38640 1 -- 172.21.15.79:0/3553516781 wait complete. 2024-04-25T02:15:51.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.084+0000 7f9a76e38640 1 Processor -- start 2024-04-25T02:15:51.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.084+0000 7f9a76e38640 1 -- start start 2024-04-25T02:15:51.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a76e38640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a7006b2f0 0x7f9a7015f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a76e38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a700b41b0 0x7f9a7015fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a76e38640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a70155f00 0x7f9a701f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a76e38640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9a70072d70 con 0x7f9a700b41b0 2024-04-25T02:15:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a76e38640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9a70156a80 con 0x7f9a7006b2f0 2024-04-25T02:15:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a76e38640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7015c870 con 0x7f9a70155f00 2024-04-25T02:15:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a6ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a700b41b0 0x7f9a7015fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a6ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a700b41b0 0x7f9a7015fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51878/0 (socket says 172.21.15.79:51878) 2024-04-25T02:15:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a6ffff640 1 -- 172.21.15.79:0/2217807943 learned_addr learned my addr 172.21.15.79:0/2217807943 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a753d5640 1 --2- 172.21.15.79:0/2217807943 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a70155f00 0x7f9a701f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a74bd4640 1 --2- 172.21.15.79:0/2217807943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a7006b2f0 0x7f9a7015f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a6ffff640 1 -- 172.21.15.79:0/2217807943 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a70155f00 msgr2=0x7f9a701f5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a6ffff640 1 --2- 172.21.15.79:0/2217807943 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a70155f00 0x7f9a701f5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a6ffff640 1 -- 172.21.15.79:0/2217807943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a7006b2f0 msgr2=0x7f9a7015f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a6ffff640 1 --2- 172.21.15.79:0/2217807943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a7006b2f0 0x7f9a7015f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.085+0000 7f9a6ffff640 1 -- 172.21.15.79:0/2217807943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7014fc40 con 0x7f9a700b41b0 2024-04-25T02:15:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.086+0000 7f9a6ffff640 1 --2- 172.21.15.79:0/2217807943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a700b41b0 0x7f9a7015fa90 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f9a60035040 tx=0x7f9a600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.086+0000 7f9a6d7fa640 1 -- 172.21.15.79:0/2217807943 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60037040 con 0x7f9a700b41b0 2024-04-25T02:15:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.086+0000 7f9a6d7fa640 1 -- 172.21.15.79:0/2217807943 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a60030500 con 0x7f9a700b41b0 2024-04-25T02:15:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.086+0000 7f9a76e38640 1 -- 172.21.15.79:0/2217807943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a70160230 con 0x7f9a700b41b0 2024-04-25T02:15:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.086+0000 7f9a6d7fa640 1 -- 172.21.15.79:0/2217807943 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60030910 con 0x7f9a700b41b0 2024-04-25T02:15:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.086+0000 7f9a76e38640 1 -- 172.21.15.79:0/2217807943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a700ce640 con 0x7f9a700b41b0 2024-04-25T02:15:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.087+0000 7f9a76e38640 1 -- 172.21.15.79:0/2217807943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a700690a0 con 0x7f9a700b41b0 2024-04-25T02:15:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.087+0000 7f9a6d7fa640 1 -- 172.21.15.79:0/2217807943 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a60044020 con 0x7f9a700b41b0 2024-04-25T02:15:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.088+0000 7f9a6d7fa640 1 --2- 172.21.15.79:0/2217807943 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9a5006be30 0x7f9a5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.088+0000 7f9a6d7fa640 1 -- 172.21.15.79:0/2217807943 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5115+0+0 (secure 0 0 0) 0x7f9a600aaca0 con 0x7f9a700b41b0 2024-04-25T02:15:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.088+0000 7f9a74bd4640 1 --2- 172.21.15.79:0/2217807943 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9a5006be30 0x7f9a5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.088+0000 7f9a74bd4640 1 --2- 172.21.15.79:0/2217807943 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9a5006be30 0x7f9a5006e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9a680072c0 tx=0x7f9a6800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:51.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.092+0000 7f9a6d7fa640 1 -- 172.21.15.79:0/2217807943 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9a600792e0 con 0x7f9a700b41b0 2024-04-25T02:15:51.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.269+0000 7f9a76e38640 1 -- 172.21.15.79:0/2217807943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f9a700ce280 con 0x7f9a700b41b0 2024-04-25T02:15:51.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.272+0000 7f9a6d7fa640 1 -- 172.21.15.79:0/2217807943 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f9a6007d5e0 con 0x7f9a700b41b0 2024-04-25T02:15:51.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.274+0000 7f9a76e38640 1 -- 172.21.15.79:0/2217807943 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9a5006be30 msgr2=0x7f9a5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.274+0000 7f9a76e38640 1 --2- 172.21.15.79:0/2217807943 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9a5006be30 0x7f9a5006e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9a680072c0 tx=0x7f9a6800b040 comp rx=0 tx=0).stop 2024-04-25T02:15:51.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.274+0000 7f9a76e38640 1 -- 172.21.15.79:0/2217807943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a700b41b0 msgr2=0x7f9a7015fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.274+0000 7f9a76e38640 1 --2- 172.21.15.79:0/2217807943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a700b41b0 0x7f9a7015fa90 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f9a60035040 tx=0x7f9a600046c0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.274+0000 7f9a76e38640 1 -- 172.21.15.79:0/2217807943 shutdown_connections 2024-04-25T02:15:51.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.274+0000 7f9a76e38640 1 --2- 172.21.15.79:0/2217807943 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9a5006be30 0x7f9a5006e2f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.274+0000 7f9a76e38640 1 --2- 172.21.15.79:0/2217807943 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a70155f00 0x7f9a701f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.274+0000 7f9a76e38640 1 --2- 172.21.15.79:0/2217807943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a700b41b0 0x7f9a7015fa90 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.274+0000 7f9a76e38640 1 --2- 172.21.15.79:0/2217807943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a7006b2f0 0x7f9a7015f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.274+0000 7f9a76e38640 1 -- 172.21.15.79:0/2217807943 >> 172.21.15.79:0/2217807943 conn(0x7f9a700b1cd0 msgr2=0x7f9a7006b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:51.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.274+0000 7f9a76e38640 1 -- 172.21.15.79:0/2217807943 shutdown_connections 2024-04-25T02:15:51.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.274+0000 7f9a76e38640 1 -- 172.21.15.79:0/2217807943 wait complete. 2024-04-25T02:15:51.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-25T02:15:51.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.382+0000 7faa92f09640 1 Processor -- start 2024-04-25T02:15:51.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.382+0000 7faa92f09640 1 -- start start 2024-04-25T02:15:51.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.383+0000 7faa92f09640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7faa8c15e4d0 0x7faa8c06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.383+0000 7faa92f09640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa8c0d1660 con 0x7faa8c0b3570 2024-04-25T02:15:51.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.383+0000 7faa92f09640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa8c0d1380 con 0x7faa8c0d2e20 2024-04-25T02:15:51.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.383+0000 7faa92f09640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7faa8c0cede0 con 0x7faa8c15e4d0 2024-04-25T02:15:51.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.383+0000 7faa8bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faa8c0b3570 0x7faa8c0d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60666/0 (socket says 172.21.15.79:60666) 2024-04-25T02:15:51.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.383+0000 7faa8bfff640 1 -- 172.21.15.79:0/225444838 learned_addr learned my addr 172.21.15.79:0/225444838 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:51.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.383+0000 7faa8b7fe640 1 -- 172.21.15.79:0/225444838 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4038163426 0 0) 0x7faa8c0d1660 con 0x7faa8c0b3570 2024-04-25T02:15:51.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.383+0000 7faa8b7fe640 1 -- 172.21.15.79:0/225444838 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa74003520 con 0x7faa8c0b3570 2024-04-25T02:15:51.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.383+0000 7faa90ca5640 1 --2- 172.21.15.79:0/225444838 >> v2:172.21.15.189:3300/0 conn(0x7faa8c15e4d0 0x7faa8c06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa8b7fe640 1 -- 172.21.15.79:0/225444838 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1907483270 0 0) 0x7faa74003520 con 0x7faa8c0b3570 2024-04-25T02:15:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa8b7fe640 1 -- 172.21.15.79:0/225444838 >> v2:172.21.15.189:3300/0 conn(0x7faa8c15e4d0 msgr2=0x7faa8c06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa8b7fe640 1 --2- 172.21.15.79:0/225444838 >> v2:172.21.15.189:3300/0 conn(0x7faa8c15e4d0 0x7faa8c06bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa8b7fe640 1 -- 172.21.15.79:0/225444838 >> v1:172.21.15.189:6789/0 conn(0x7faa8c0d2e20 legacy=0x7faa8c0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa8b7fe640 1 -- 172.21.15.79:0/225444838 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8c0cf0c0 con 0x7faa8c0b3570 2024-04-25T02:15:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa8b7fe640 1 -- 172.21.15.79:0/225444838 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7faa80001670 con 0x7faa8c0b3570 2024-04-25T02:15:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa8b7fe640 1 -- 172.21.15.79:0/225444838 >> v1:172.21.15.79:6789/0 conn(0x7faa8c0b3570 legacy=0x7faa8c0d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa8b7fe640 1 --2- 172.21.15.79:0/225444838 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa740039b0 0x7faa74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa8b7fe640 1 --2- 172.21.15.79:0/225444838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa74004800 0x7faa74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa8b7fe640 1 --2- 172.21.15.79:0/225444838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa740051c0 0x7faa7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa8b7fe640 1 -- 172.21.15.79:0/225444838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c0cede0 con 0x7faa740051c0 2024-04-25T02:15:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa8b7fe640 1 -- 172.21.15.79:0/225444838 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faa7400c060 con 0x7faa74004800 2024-04-25T02:15:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa8b7fe640 1 -- 172.21.15.79:0/225444838 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faa7400c260 con 0x7faa740039b0 2024-04-25T02:15:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa914a6640 1 --2- 172.21.15.79:0/225444838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa740051c0 0x7faa7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa8bfff640 1 --2- 172.21.15.79:0/225444838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa74004800 0x7faa74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa90ca5640 1 --2- 172.21.15.79:0/225444838 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa740039b0 0x7faa74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa914a6640 1 -- 172.21.15.79:0/225444838 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa740039b0 msgr2=0x7faa74003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:51.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa914a6640 1 --2- 172.21.15.79:0/225444838 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa740039b0 0x7faa74003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa914a6640 1 -- 172.21.15.79:0/225444838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa74004800 msgr2=0x7faa74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:51.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa914a6640 1 --2- 172.21.15.79:0/225444838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa74004800 0x7faa74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa914a6640 1 -- 172.21.15.79:0/225444838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa74003520 con 0x7faa740051c0 2024-04-25T02:15:51.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.384+0000 7faa90ca5640 1 --2- 172.21.15.79:0/225444838 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa740039b0 0x7faa74003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:51.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.385+0000 7faa914a6640 1 -- 172.21.15.79:0/225444838 reap_dead start 2024-04-25T02:15:51.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.385+0000 7faa914a6640 1 --2- 172.21.15.79:0/225444838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa740051c0 0x7faa7400b9c0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0679f0 tx=0x7faa74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270b057fed00c259 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:51.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.385+0000 7faa8b7fe640 1 -- 172.21.15.79:0/225444838 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84001a70 con 0x7faa740051c0 2024-04-25T02:15:51.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.385+0000 7faa8b7fe640 1 -- 172.21.15.79:0/225444838 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8402ae10 con 0x7faa740051c0 2024-04-25T02:15:51.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.385+0000 7faa8b7fe640 1 -- 172.21.15.79:0/225444838 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84003bb0 con 0x7faa740051c0 2024-04-25T02:15:51.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.385+0000 7faa92f09640 1 -- 172.21.15.79:0/225444838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa740051c0 msgr2=0x7faa7400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.385+0000 7faa92f09640 1 --2- 172.21.15.79:0/225444838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa740051c0 0x7faa7400b9c0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0679f0 tx=0x7faa74005830 comp rx=0 tx=0).stop 2024-04-25T02:15:51.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.385+0000 7faa92f09640 1 -- 172.21.15.79:0/225444838 shutdown_connections 2024-04-25T02:15:51.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.385+0000 7faa92f09640 1 --2- 172.21.15.79:0/225444838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa740051c0 0x7faa7400b9c0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.385+0000 7faa92f09640 1 -- 172.21.15.79:0/225444838 >> 172.21.15.79:0/225444838 conn(0x7faa8c09d460 msgr2=0x7faa8c0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:51.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.385+0000 7faa92f09640 1 -- 172.21.15.79:0/225444838 shutdown_connections 2024-04-25T02:15:51.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.385+0000 7faa92f09640 1 -- 172.21.15.79:0/225444838 wait complete. 2024-04-25T02:15:51.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.387+0000 7faa92f09640 1 Processor -- start 2024-04-25T02:15:51.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.387+0000 7faa92f09640 1 -- start start 2024-04-25T02:15:51.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.387+0000 7faa92f09640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa740051c0 0x7faa8c1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.387+0000 7faa92f09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa8c15fb10 0x7faa8c153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.387+0000 7faa92f09640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa8c1559e0 0x7faa8c155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.387+0000 7faa92f09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c0d2250 con 0x7faa8c15fb10 2024-04-25T02:15:51.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.387+0000 7faa92f09640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c0d20d0 con 0x7faa740051c0 2024-04-25T02:15:51.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.387+0000 7faa92f09640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faa8c0b3020 con 0x7faa8c1559e0 2024-04-25T02:15:51.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa8bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa8c15fb10 0x7faa8c153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa8bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa8c15fb10 0x7faa8c153420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51896/0 (socket says 172.21.15.79:51896) 2024-04-25T02:15:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa8bfff640 1 -- 172.21.15.79:0/3599548666 learned_addr learned my addr 172.21.15.79:0/3599548666 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa90ca5640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa740051c0 0x7faa8c1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa914a6640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa8c1559e0 0x7faa8c155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa8bfff640 1 -- 172.21.15.79:0/3599548666 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa8c1559e0 msgr2=0x7faa8c155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa8bfff640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa8c1559e0 0x7faa8c155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa8bfff640 1 -- 172.21.15.79:0/3599548666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa740051c0 msgr2=0x7faa8c1551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa8bfff640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa740051c0 0x7faa8c1551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa8bfff640 1 -- 172.21.15.79:0/3599548666 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8c1563a0 con 0x7faa8c15fb10 2024-04-25T02:15:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa90ca5640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa740051c0 0x7faa8c1551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa914a6640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa8c1559e0 0x7faa8c155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa8bfff640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa8c15fb10 0x7faa8c153420 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7faa800072c0 tx=0x7faa80007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa897fa640 1 -- 172.21.15.79:0/3599548666 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8000f8e0 con 0x7faa8c15fb10 2024-04-25T02:15:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa897fa640 1 -- 172.21.15.79:0/3599548666 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa80018070 con 0x7faa8c15fb10 2024-04-25T02:15:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa897fa640 1 -- 172.21.15.79:0/3599548666 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8000fce0 con 0x7faa8c15fb10 2024-04-25T02:15:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa92f09640 1 -- 172.21.15.79:0/3599548666 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8c1602f0 con 0x7faa8c15fb10 2024-04-25T02:15:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.388+0000 7faa92f09640 1 -- 172.21.15.79:0/3599548666 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa8c1608b0 con 0x7faa8c15fb10 2024-04-25T02:15:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.389+0000 7faa92f09640 1 -- 172.21.15.79:0/3599548666 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa8c160ec0 con 0x7faa8c15fb10 2024-04-25T02:15:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.390+0000 7faa897fa640 1 -- 172.21.15.79:0/3599548666 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa8001d460 con 0x7faa8c15fb10 2024-04-25T02:15:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.390+0000 7faa897fa640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa7806be30 0x7faa7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.390+0000 7faa897fa640 1 -- 172.21.15.79:0/3599548666 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5115+0+0 (secure 0 0 0) 0x7faa8008ad70 con 0x7faa8c15fb10 2024-04-25T02:15:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.390+0000 7faa90ca5640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa7806be30 0x7faa7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.390+0000 7faa90ca5640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa7806be30 0x7faa7806e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009990 tx=0x7faa7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:51.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.394+0000 7faa897fa640 1 -- 172.21.15.79:0/3599548666 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faa800593e0 con 0x7faa8c15fb10 2024-04-25T02:15:51.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.633+0000 7faa92f09640 1 -- 172.21.15.79:0/3599548666 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) -- 0x7faa8c0690a0 con 0x7faa8c15fb10 2024-04-25T02:15:51.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.961+0000 7faa897fa640 1 -- 172.21.15.79:0/3599548666 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v374) ==== 167+0+0 (secure 0 0 0) 0x7faa8005d6e0 con 0x7faa8c15fb10 2024-04-25T02:15:51.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.963+0000 7faa92f09640 1 -- 172.21.15.79:0/3599548666 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa7806be30 msgr2=0x7faa7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.963+0000 7faa92f09640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa7806be30 0x7faa7806e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009990 tx=0x7faa7c008040 comp rx=0 tx=0).stop 2024-04-25T02:15:51.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.963+0000 7faa92f09640 1 -- 172.21.15.79:0/3599548666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa8c15fb10 msgr2=0x7faa8c153420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.963+0000 7faa92f09640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa8c15fb10 0x7faa8c153420 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7faa800072c0 tx=0x7faa80007780 comp rx=0 tx=0).stop 2024-04-25T02:15:51.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.963+0000 7faa92f09640 1 -- 172.21.15.79:0/3599548666 shutdown_connections 2024-04-25T02:15:51.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.963+0000 7faa92f09640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa7806be30 0x7faa7806e2f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.963+0000 7faa92f09640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa8c1559e0 0x7faa8c155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.963+0000 7faa92f09640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa8c15fb10 0x7faa8c153420 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.963+0000 7faa92f09640 1 --2- 172.21.15.79:0/3599548666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa740051c0 0x7faa8c1551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.963+0000 7faa92f09640 1 -- 172.21.15.79:0/3599548666 >> 172.21.15.79:0/3599548666 conn(0x7faa8c09d460 msgr2=0x7faa8c06cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:51.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.963+0000 7faa92f09640 1 -- 172.21.15.79:0/3599548666 shutdown_connections 2024-04-25T02:15:51.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:51.963+0000 7faa92f09640 1 -- 172.21.15.79:0/3599548666 wait complete. 2024-04-25T02:15:51.981 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T02:15:51.981 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T02:15:51.982 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:15:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.076+0000 7f47fcc9e640 1 Processor -- start 2024-04-25T02:15:52.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.076+0000 7f47fcc9e640 1 -- start start 2024-04-25T02:15:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.077+0000 7f47fcc9e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f80b3570 0x7f47f80d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.077+0000 7f47fcc9e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f47f80b3020 0x7f47f80d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.077+0000 7f47fcc9e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f806c380 con 0x7f47f815e4d0 2024-04-25T02:15:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.077+0000 7f47fcc9e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f47f80d1660 con 0x7f47f80b3020 2024-04-25T02:15:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.077+0000 7f47fcc9e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f47f80d1380 con 0x7f47f80b3570 2024-04-25T02:15:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.077+0000 7f47f659c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f47f815e4d0 0x7f47f806bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60678/0 (socket says 172.21.15.79:60678) 2024-04-25T02:15:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.077+0000 7f47f659c640 1 -- 172.21.15.79:0/3107419670 learned_addr learned my addr 172.21.15.79:0/3107419670 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 -- 172.21.15.79:0/3107419670 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1613757882 0 0) 0x7f47f806c380 con 0x7f47f815e4d0 2024-04-25T02:15:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 -- 172.21.15.79:0/3107419670 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47e4003520 con 0x7f47f815e4d0 2024-04-25T02:15:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f6d9d640 1 --2- 172.21.15.79:0/3107419670 >> v2:172.21.15.189:3300/0 conn(0x7f47f80b3020 0x7f47f80d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47effff640 1 --2- 172.21.15.79:0/3107419670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f80b3570 0x7f47f80d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 -- 172.21.15.79:0/3107419670 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1192600595 0 0) 0x7f47e4003520 con 0x7f47f815e4d0 2024-04-25T02:15:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 -- 172.21.15.79:0/3107419670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f80b3570 msgr2=0x7f47f80d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 --2- 172.21.15.79:0/3107419670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f80b3570 0x7f47f80d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 -- 172.21.15.79:0/3107419670 >> v2:172.21.15.189:3300/0 conn(0x7f47f80b3020 msgr2=0x7f47f80d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 --2- 172.21.15.79:0/3107419670 >> v2:172.21.15.189:3300/0 conn(0x7f47f80b3020 0x7f47f80d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 -- 172.21.15.79:0/3107419670 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f80cede0 con 0x7f47f815e4d0 2024-04-25T02:15:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 -- 172.21.15.79:0/3107419670 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f47e8001670 con 0x7f47f815e4d0 2024-04-25T02:15:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 -- 172.21.15.79:0/3107419670 >> v1:172.21.15.79:6789/0 conn(0x7f47f815e4d0 legacy=0x7f47f806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 --2- 172.21.15.79:0/3107419670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47e40039b0 0x7f47e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 --2- 172.21.15.79:0/3107419670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47e4004800 0x7f47e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 --2- 172.21.15.79:0/3107419670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47e40051c0 0x7f47e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 -- 172.21.15.79:0/3107419670 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f47f80d1660 con 0x7f47e40051c0 2024-04-25T02:15:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 -- 172.21.15.79:0/3107419670 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47f80d1380 con 0x7f47e40039b0 2024-04-25T02:15:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f5d9b640 1 -- 172.21.15.79:0/3107419670 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f47e400bf30 con 0x7f47e4004800 2024-04-25T02:15:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47effff640 1 --2- 172.21.15.79:0/3107419670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f80b3570 0x7f47f80d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f6d9d640 1 --2- 172.21.15.79:0/3107419670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47e40051c0 0x7f47e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f659c640 1 --2- 172.21.15.79:0/3107419670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47e40039b0 0x7f47e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47effff640 1 --2- 172.21.15.79:0/3107419670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47e4004800 0x7f47e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f6d9d640 1 -- 172.21.15.79:0/3107419670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47e4004800 msgr2=0x7f47e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f6d9d640 1 --2- 172.21.15.79:0/3107419670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47e4004800 0x7f47e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f6d9d640 1 -- 172.21.15.79:0/3107419670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47e40039b0 msgr2=0x7f47e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f6d9d640 1 --2- 172.21.15.79:0/3107419670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47e40039b0 0x7f47e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f6d9d640 1 -- 172.21.15.79:0/3107419670 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e4003520 con 0x7f47e40051c0 2024-04-25T02:15:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47effff640 1 --2- 172.21.15.79:0/3107419670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47e4004800 0x7f47e4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.078+0000 7f47f659c640 1 --2- 172.21.15.79:0/3107419670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47e40039b0 0x7f47e4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.079+0000 7f47f6d9d640 1 --2- 172.21.15.79:0/3107419670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47e40051c0 0x7f47e400b9c0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009fc0 tx=0x7f47e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb692c82fe3c802 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.079+0000 7f47f5d9b640 1 -- 172.21.15.79:0/3107419670 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f0009c10 con 0x7f47e40051c0 2024-04-25T02:15:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.079+0000 7f47f5d9b640 1 -- 172.21.15.79:0/3107419670 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f0036070 con 0x7f47e40051c0 2024-04-25T02:15:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.079+0000 7f47f5d9b640 1 -- 172.21.15.79:0/3107419670 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f002d070 con 0x7f47e40051c0 2024-04-25T02:15:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.080+0000 7f47fcc9e640 1 -- 172.21.15.79:0/3107419670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47e40051c0 msgr2=0x7f47e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.080+0000 7f47fcc9e640 1 --2- 172.21.15.79:0/3107419670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47e40051c0 0x7f47e400b9c0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009fc0 tx=0x7f47e4005830 comp rx=0 tx=0).stop 2024-04-25T02:15:52.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.080+0000 7f47f6d9d640 1 -- 172.21.15.79:0/3107419670 reap_dead start 2024-04-25T02:15:52.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.080+0000 7f47fcc9e640 1 -- 172.21.15.79:0/3107419670 shutdown_connections 2024-04-25T02:15:52.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.080+0000 7f47fcc9e640 1 -- 172.21.15.79:0/3107419670 >> 172.21.15.79:0/3107419670 conn(0x7f47f809d460 msgr2=0x7f47f80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:52.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.080+0000 7f47fcc9e640 1 -- 172.21.15.79:0/3107419670 shutdown_connections 2024-04-25T02:15:52.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.080+0000 7f47fcc9e640 1 -- 172.21.15.79:0/3107419670 wait complete. 2024-04-25T02:15:52.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.081+0000 7f47fcc9e640 1 Processor -- start 2024-04-25T02:15:52.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.081+0000 7f47fcc9e640 1 -- start start 2024-04-25T02:15:52.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47fcc9e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f8151f30 0x7f47f81f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47fcc9e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f8157020 0x7f47f81574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47fcc9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47f81603a0 0x7f47f8160820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47fcc9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f47f80d20d0 con 0x7f47f81603a0 2024-04-25T02:15:52.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47fcc9e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47f815e8b0 con 0x7f47f8151f30 2024-04-25T02:15:52.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47fcc9e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f47f80d2250 con 0x7f47f8157020 2024-04-25T02:15:52.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47f6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47f81603a0 0x7f47f8160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47f6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47f81603a0 0x7f47f8160820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51904/0 (socket says 172.21.15.79:51904) 2024-04-25T02:15:52.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47f6d9d640 1 -- 172.21.15.79:0/1313087459 learned_addr learned my addr 172.21.15.79:0/1313087459 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:52.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47f659c640 1 --2- 172.21.15.79:0/1313087459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f8151f30 0x7f47f81f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47f6d9d640 1 -- 172.21.15.79:0/1313087459 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f8157020 msgr2=0x7f47f81574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47effff640 1 --2- 172.21.15.79:0/1313087459 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f8157020 0x7f47f81574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47f6d9d640 1 --2- 172.21.15.79:0/1313087459 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f8157020 0x7f47f81574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47f6d9d640 1 -- 172.21.15.79:0/1313087459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f8151f30 msgr2=0x7f47f81f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47f6d9d640 1 --2- 172.21.15.79:0/1313087459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f8151f30 0x7f47f81f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47f6d9d640 1 -- 172.21.15.79:0/1313087459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f8152310 con 0x7f47f81603a0 2024-04-25T02:15:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47f659c640 1 --2- 172.21.15.79:0/1313087459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f8151f30 0x7f47f81f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47f6d9d640 1 --2- 172.21.15.79:0/1313087459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47f81603a0 0x7f47f8160820 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f47f000e200 tx=0x7f47f0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47eeffd640 1 -- 172.21.15.79:0/1313087459 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f0009c10 con 0x7f47f81603a0 2024-04-25T02:15:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47eeffd640 1 -- 172.21.15.79:0/1313087459 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f0040030 con 0x7f47f81603a0 2024-04-25T02:15:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47eeffd640 1 -- 172.21.15.79:0/1313087459 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f0003df0 con 0x7f47f81603a0 2024-04-25T02:15:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.082+0000 7f47fcc9e640 1 -- 172.21.15.79:0/1313087459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f8154680 con 0x7f47f81603a0 2024-04-25T02:15:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.083+0000 7f47fcc9e640 1 -- 172.21.15.79:0/1313087459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f8154920 con 0x7f47f81603a0 2024-04-25T02:15:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.083+0000 7f47fcc9e640 1 -- 172.21.15.79:0/1313087459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f80690a0 con 0x7f47f81603a0 2024-04-25T02:15:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.084+0000 7f47eeffd640 1 -- 172.21.15.79:0/1313087459 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47f0005d10 con 0x7f47f81603a0 2024-04-25T02:15:52.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.084+0000 7f47eeffd640 1 --2- 172.21.15.79:0/1313087459 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47d806be60 0x7f47d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.084+0000 7f47eeffd640 1 -- 172.21.15.79:0/1313087459 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5115+0+0 (secure 0 0 0) 0x7f47f00ab940 con 0x7f47f81603a0 2024-04-25T02:15:52.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.084+0000 7f47f659c640 1 --2- 172.21.15.79:0/1313087459 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47d806be60 0x7f47d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.085+0000 7f47f659c640 1 --2- 172.21.15.79:0/1313087459 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47d806be60 0x7f47d806e320 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f47e8004840 tx=0x7f47e8000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:52.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.088+0000 7f47eeffd640 1 -- 172.21.15.79:0/1313087459 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f47f8152310 con 0x7f47f81603a0 2024-04-25T02:15:52.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.261+0000 7f47fcc9e640 1 -- 172.21.15.79:0/1313087459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47f80d1920 con 0x7f47f81603a0 2024-04-25T02:15:52.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.262+0000 7f47eeffd640 1 -- 172.21.15.79:0/1313087459 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+13291 (secure 0 0 0) 0x7f47f007a5d0 con 0x7f47f81603a0 2024-04-25T02:15:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:52.267 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":93,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:15:50.950145+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/1474949173":"2024-04-26T02:15:47.899533+0000","172.21.15.79:6837/630320044":"2024-04-26T02:15:04.828036+0000","172.21.15.79:6836/1474949173":"2024-04-26T02:15:47.899533+0000","172.21.15.79:6836/630320044":"2024-04-26T02:15:04.828036+0000","172.21.15.79:6837/2290864495":"2024-04-26T02:13:53.595807+0000","172.21.15.79:6836/2290864495":"2024-04-26T02:13:53.595807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:15:52.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.264+0000 7f47fcc9e640 1 -- 172.21.15.79:0/1313087459 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47d806be60 msgr2=0x7f47d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.264+0000 7f47fcc9e640 1 --2- 172.21.15.79:0/1313087459 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47d806be60 0x7f47d806e320 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f47e8004840 tx=0x7f47e8000ed0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.264+0000 7f47fcc9e640 1 -- 172.21.15.79:0/1313087459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47f81603a0 msgr2=0x7f47f8160820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.264+0000 7f47fcc9e640 1 --2- 172.21.15.79:0/1313087459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47f81603a0 0x7f47f8160820 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f47f000e200 tx=0x7f47f0009750 comp rx=0 tx=0).stop 2024-04-25T02:15:52.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.264+0000 7f47fcc9e640 1 -- 172.21.15.79:0/1313087459 shutdown_connections 2024-04-25T02:15:52.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.264+0000 7f47fcc9e640 1 --2- 172.21.15.79:0/1313087459 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f47d806be60 0x7f47d806e320 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.264+0000 7f47fcc9e640 1 --2- 172.21.15.79:0/1313087459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47f81603a0 0x7f47f8160820 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.264+0000 7f47fcc9e640 1 --2- 172.21.15.79:0/1313087459 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f8157020 0x7f47f81574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.264+0000 7f47fcc9e640 1 --2- 172.21.15.79:0/1313087459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f8151f30 0x7f47f81f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.264+0000 7f47fcc9e640 1 -- 172.21.15.79:0/1313087459 >> 172.21.15.79:0/1313087459 conn(0x7f47f809d460 msgr2=0x7f47f80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:52.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.264+0000 7f47fcc9e640 1 -- 172.21.15.79:0/1313087459 shutdown_connections 2024-04-25T02:15:52.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.264+0000 7f47fcc9e640 1 -- 172.21.15.79:0/1313087459 wait complete. 2024-04-25T02:15:52.281 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:15:52.281 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:15:52.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.374+0000 7f2772ad4640 1 Processor -- start 2024-04-25T02:15:52.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.374+0000 7f2772ad4640 1 -- start start 2024-04-25T02:15:52.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.375+0000 7f2772ad4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f276c0d10c0 0x7f276c06bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.375+0000 7f2772ad4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f276c0d1ee0 con 0x7f276c15e4f0 2024-04-25T02:15:52.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.375+0000 7f2772ad4640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f276c0d21c0 con 0x7f276c0d2ca0 2024-04-25T02:15:52.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.375+0000 7f2772ad4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f276c0d3130 con 0x7f276c0d10c0 2024-04-25T02:15:52.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.375+0000 7f2770870640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f276c15e4f0 0x7f276c0cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60688/0 (socket says 172.21.15.79:60688) 2024-04-25T02:15:52.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.375+0000 7f2770870640 1 -- 172.21.15.79:0/621402939 learned_addr learned my addr 172.21.15.79:0/621402939 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:52.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276b7fe640 1 -- 172.21.15.79:0/621402939 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781600857 0 0) 0x7f276c0d1ee0 con 0x7f276c15e4f0 2024-04-25T02:15:52.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f2771071640 1 --2- 172.21.15.79:0/621402939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f276c0d10c0 0x7f276c06bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276b7fe640 1 -- 172.21.15.79:0/621402939 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2754003520 con 0x7f276c15e4f0 2024-04-25T02:15:52.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276b7fe640 1 -- 172.21.15.79:0/621402939 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 216560565 0 0) 0x7f2754003520 con 0x7f276c15e4f0 2024-04-25T02:15:52.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276b7fe640 1 -- 172.21.15.79:0/621402939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f276c0d10c0 msgr2=0x7f276c06bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:52.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276b7fe640 1 --2- 172.21.15.79:0/621402939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f276c0d10c0 0x7f276c06bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276b7fe640 1 -- 172.21.15.79:0/621402939 >> v1:172.21.15.189:6789/0 conn(0x7f276c0d2ca0 legacy=0x7f276c0d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276b7fe640 1 -- 172.21.15.79:0/621402939 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c0d24a0 con 0x7f276c15e4f0 2024-04-25T02:15:52.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276b7fe640 1 -- 172.21.15.79:0/621402939 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f275c001670 con 0x7f276c15e4f0 2024-04-25T02:15:52.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276b7fe640 1 -- 172.21.15.79:0/621402939 >> v1:172.21.15.79:6789/0 conn(0x7f276c15e4f0 legacy=0x7f276c0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276b7fe640 1 --2- 172.21.15.79:0/621402939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27540039e0 0x7f2754003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276b7fe640 1 --2- 172.21.15.79:0/621402939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754004800 0x7f2754004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276b7fe640 1 --2- 172.21.15.79:0/621402939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f276c0d10c0 0x7f27540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276b7fe640 1 -- 172.21.15.79:0/621402939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f275400ba70 con 0x7f2754004800 2024-04-25T02:15:52.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276b7fe640 1 -- 172.21.15.79:0/621402939 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f275400bc20 con 0x7f27540039e0 2024-04-25T02:15:52.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276b7fe640 1 -- 172.21.15.79:0/621402939 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f275400be20 con 0x7f276c0d10c0 2024-04-25T02:15:52.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276bfff640 1 --2- 172.21.15.79:0/621402939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754004800 0x7f2754004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f2770870640 1 --2- 172.21.15.79:0/621402939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27540039e0 0x7f2754003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f2771071640 1 --2- 172.21.15.79:0/621402939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f276c0d10c0 0x7f27540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276bfff640 1 -- 172.21.15.79:0/621402939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f276c0d10c0 msgr2=0x7f27540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:52.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276bfff640 1 --2- 172.21.15.79:0/621402939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f276c0d10c0 0x7f27540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276bfff640 1 -- 172.21.15.79:0/621402939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27540039e0 msgr2=0x7f2754003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:52.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276bfff640 1 --2- 172.21.15.79:0/621402939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27540039e0 0x7f2754003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f276bfff640 1 -- 172.21.15.79:0/621402939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2754003520 con 0x7f2754004800 2024-04-25T02:15:52.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.376+0000 7f2770870640 1 --2- 172.21.15.79:0/621402939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27540039e0 0x7f2754003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:52.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.377+0000 7f276bfff640 1 --2- 172.21.15.79:0/621402939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754004800 0x7f2754004c80 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f2760001750 tx=0x7f2754005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b3236210e40a4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:52.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.377+0000 7f276b7fe640 1 -- 172.21.15.79:0/621402939 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2760001370 con 0x7f2754004800 2024-04-25T02:15:52.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.377+0000 7f276b7fe640 1 -- 172.21.15.79:0/621402939 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27600052d0 con 0x7f2754004800 2024-04-25T02:15:52.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.377+0000 7f276b7fe640 1 -- 172.21.15.79:0/621402939 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276002abe0 con 0x7f2754004800 2024-04-25T02:15:52.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.378+0000 7f2772ad4640 1 -- 172.21.15.79:0/621402939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754004800 msgr2=0x7f2754004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.378+0000 7f2772ad4640 1 --2- 172.21.15.79:0/621402939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754004800 0x7f2754004c80 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f2760001750 tx=0x7f2754005830 comp rx=0 tx=0).stop 2024-04-25T02:15:52.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.378+0000 7f2771071640 1 -- 172.21.15.79:0/621402939 reap_dead start 2024-04-25T02:15:52.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.378+0000 7f2772ad4640 1 -- 172.21.15.79:0/621402939 shutdown_connections 2024-04-25T02:15:52.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.378+0000 7f2772ad4640 1 -- 172.21.15.79:0/621402939 >> 172.21.15.79:0/621402939 conn(0x7f276c09d4a0 msgr2=0x7f276c0d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:52.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.378+0000 7f2772ad4640 1 -- 172.21.15.79:0/621402939 shutdown_connections 2024-04-25T02:15:52.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.378+0000 7f2772ad4640 1 -- 172.21.15.79:0/621402939 wait complete. 2024-04-25T02:15:52.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.379+0000 7f2772ad4640 1 Processor -- start 2024-04-25T02:15:52.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.379+0000 7f2772ad4640 1 -- start start 2024-04-25T02:15:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2772ad4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754004800 0x7f276c0ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2772ad4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f276c155890 0x7f276c0b7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2772ad4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c0b5eb0 0x7f276c0b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2772ad4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f276c0d4ee0 con 0x7f2754004800 2024-04-25T02:15:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2772ad4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f276c0cff00 con 0x7f276c0b5eb0 2024-04-25T02:15:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2772ad4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f276c0d5060 con 0x7f276c155890 2024-04-25T02:15:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2770870640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754004800 0x7f276c0ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2770870640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754004800 0x7f276c0ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51928/0 (socket says 172.21.15.79:51928) 2024-04-25T02:15:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2770870640 1 -- 172.21.15.79:0/912304610 learned_addr learned my addr 172.21.15.79:0/912304610 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f276bfff640 1 --2- 172.21.15.79:0/912304610 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f276c155890 0x7f276c0b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2771071640 1 --2- 172.21.15.79:0/912304610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c0b5eb0 0x7f276c0b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2770870640 1 -- 172.21.15.79:0/912304610 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f276c155890 msgr2=0x7f276c0b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2770870640 1 --2- 172.21.15.79:0/912304610 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f276c155890 0x7f276c0b7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2770870640 1 -- 172.21.15.79:0/912304610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c0b5eb0 msgr2=0x7f276c0b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2770870640 1 --2- 172.21.15.79:0/912304610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c0b5eb0 0x7f276c0b6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2770870640 1 -- 172.21.15.79:0/912304610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c0cd760 con 0x7f2754004800 2024-04-25T02:15:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2770870640 1 --2- 172.21.15.79:0/912304610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754004800 0x7f276c0ca270 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f275c00e760 tx=0x7f275c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f27697fa640 1 -- 172.21.15.79:0/912304610 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c00ee70 con 0x7f2754004800 2024-04-25T02:15:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f27697fa640 1 -- 172.21.15.79:0/912304610 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275c018070 con 0x7f2754004800 2024-04-25T02:15:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2772ad4640 1 -- 172.21.15.79:0/912304610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276c0ccbe0 con 0x7f2754004800 2024-04-25T02:15:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f27697fa640 1 -- 172.21.15.79:0/912304610 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c00ca90 con 0x7f2754004800 2024-04-25T02:15:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.380+0000 7f2772ad4640 1 -- 172.21.15.79:0/912304610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f276c0cd1a0 con 0x7f2754004800 2024-04-25T02:15:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.381+0000 7f2772ad4640 1 -- 172.21.15.79:0/912304610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f276c0686c0 con 0x7f2754004800 2024-04-25T02:15:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.382+0000 7f27697fa640 1 -- 172.21.15.79:0/912304610 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f275c00cc30 con 0x7f2754004800 2024-04-25T02:15:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.382+0000 7f27697fa640 1 --2- 172.21.15.79:0/912304610 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f275806be30 0x7f275806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.382+0000 7f27697fa640 1 -- 172.21.15.79:0/912304610 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5115+0+0 (secure 0 0 0) 0x7f275c08a980 con 0x7f2754004800 2024-04-25T02:15:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.382+0000 7f276bfff640 1 --2- 172.21.15.79:0/912304610 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f275806be30 0x7f275806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.383+0000 7f276bfff640 1 --2- 172.21.15.79:0/912304610 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f275806be30 0x7f275806e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2760032000 tx=0x7f276002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.387+0000 7f27697fa640 1 -- 172.21.15.79:0/912304610 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f276c0cd760 con 0x7f2754004800 2024-04-25T02:15:52.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.557+0000 7f2772ad4640 1 -- 172.21.15.79:0/912304610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f276c0690a0 con 0x7f2754004800 2024-04-25T02:15:52.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.557+0000 7f27697fa640 1 -- 172.21.15.79:0/912304610 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f275c059610 con 0x7f2754004800 2024-04-25T02:15:52.563 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:15:52.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.559+0000 7f2772ad4640 1 -- 172.21.15.79:0/912304610 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f275806be30 msgr2=0x7f275806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.559+0000 7f2772ad4640 1 --2- 172.21.15.79:0/912304610 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f275806be30 0x7f275806e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2760032000 tx=0x7f276002e000 comp rx=0 tx=0).stop 2024-04-25T02:15:52.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.559+0000 7f2772ad4640 1 -- 172.21.15.79:0/912304610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754004800 msgr2=0x7f276c0ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.559+0000 7f2772ad4640 1 --2- 172.21.15.79:0/912304610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754004800 0x7f276c0ca270 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f275c00e760 tx=0x7f275c00ec20 comp rx=0 tx=0).stop 2024-04-25T02:15:52.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.560+0000 7f2772ad4640 1 -- 172.21.15.79:0/912304610 shutdown_connections 2024-04-25T02:15:52.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.560+0000 7f2772ad4640 1 --2- 172.21.15.79:0/912304610 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f275806be30 0x7f275806e2f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.560+0000 7f2772ad4640 1 --2- 172.21.15.79:0/912304610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c0b5eb0 0x7f276c0b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.560+0000 7f2772ad4640 1 --2- 172.21.15.79:0/912304610 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f276c155890 0x7f276c0b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.560+0000 7f2772ad4640 1 --2- 172.21.15.79:0/912304610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754004800 0x7f276c0ca270 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.560+0000 7f2772ad4640 1 -- 172.21.15.79:0/912304610 >> 172.21.15.79:0/912304610 conn(0x7f276c09d4a0 msgr2=0x7f276c0b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:52.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.560+0000 7f2772ad4640 1 -- 172.21.15.79:0/912304610 shutdown_connections 2024-04-25T02:15:52.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.560+0000 7f2772ad4640 1 -- 172.21.15.79:0/912304610 wait complete. 2024-04-25T02:15:52.576 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-25T02:15:52.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.666+0000 7f9d4c241640 1 Processor -- start 2024-04-25T02:15:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.667+0000 7f9d4c241640 1 -- start start 2024-04-25T02:15:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.667+0000 7f9d4c241640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d440d07a0 0x7f9d440b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.667+0000 7f9d4c241640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9d440b47e0 0x7f9d44070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.667+0000 7f9d4c241640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d4415bb10 con 0x7f9d4415a720 2024-04-25T02:15:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.667+0000 7f9d4c241640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f9d440b2e60 con 0x7f9d440b47e0 2024-04-25T02:15:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.667+0000 7f9d4c241640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9d440b3140 con 0x7f9d440d07a0 2024-04-25T02:15:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d49fdd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9d4415a720 0x7f9d4415ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60704/0 (socket says 172.21.15.79:60704) 2024-04-25T02:15:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d49fdd640 1 -- 172.21.15.79:0/4138568707 learned_addr learned my addr 172.21.15.79:0/4138568707 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d497dc640 1 --2- 172.21.15.79:0/4138568707 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d440d07a0 0x7f9d440b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d4a7de640 1 --2- 172.21.15.79:0/4138568707 >> v2:172.21.15.189:3300/0 conn(0x7f9d440b47e0 0x7f9d44070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 -- 172.21.15.79:0/4138568707 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178975594 0 0) 0x7f9d4415bb10 con 0x7f9d4415a720 2024-04-25T02:15:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 -- 172.21.15.79:0/4138568707 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d2c003520 con 0x7f9d4415a720 2024-04-25T02:15:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 -- 172.21.15.79:0/4138568707 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1659043737 0 0) 0x7f9d2c003520 con 0x7f9d4415a720 2024-04-25T02:15:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 -- 172.21.15.79:0/4138568707 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d440d07a0 msgr2=0x7f9d440b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 --2- 172.21.15.79:0/4138568707 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d440d07a0 0x7f9d440b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 -- 172.21.15.79:0/4138568707 >> v2:172.21.15.189:3300/0 conn(0x7f9d440b47e0 msgr2=0x7f9d44070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 --2- 172.21.15.79:0/4138568707 >> v2:172.21.15.189:3300/0 conn(0x7f9d440b47e0 0x7f9d44070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 -- 172.21.15.79:0/4138568707 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d440b3420 con 0x7f9d4415a720 2024-04-25T02:15:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 -- 172.21.15.79:0/4138568707 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f9d3c001670 con 0x7f9d4415a720 2024-04-25T02:15:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 -- 172.21.15.79:0/4138568707 >> v1:172.21.15.79:6789/0 conn(0x7f9d4415a720 legacy=0x7f9d4415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 --2- 172.21.15.79:0/4138568707 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d440d07a0 0x7f9d2c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 --2- 172.21.15.79:0/4138568707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d2c003f30 0x7f9d2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 --2- 172.21.15.79:0/4138568707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d2c004d40 0x7f9d2c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 -- 172.21.15.79:0/4138568707 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9d440b2e60 con 0x7f9d2c004d40 2024-04-25T02:15:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 -- 172.21.15.79:0/4138568707 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9d440b3140 con 0x7f9d2c003f30 2024-04-25T02:15:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d48fdb640 1 -- 172.21.15.79:0/4138568707 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9d2c005270 con 0x7f9d440d07a0 2024-04-25T02:15:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d4a7de640 1 --2- 172.21.15.79:0/4138568707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d2c004d40 0x7f9d2c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d49fdd640 1 --2- 172.21.15.79:0/4138568707 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d440d07a0 0x7f9d2c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.668+0000 7f9d497dc640 1 --2- 172.21.15.79:0/4138568707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d2c003f30 0x7f9d2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.669+0000 7f9d4a7de640 1 -- 172.21.15.79:0/4138568707 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d440d07a0 msgr2=0x7f9d2c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.669+0000 7f9d4a7de640 1 --2- 172.21.15.79:0/4138568707 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d440d07a0 0x7f9d2c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.669+0000 7f9d4a7de640 1 -- 172.21.15.79:0/4138568707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d2c003f30 msgr2=0x7f9d2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:52.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.669+0000 7f9d4a7de640 1 --2- 172.21.15.79:0/4138568707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d2c003f30 0x7f9d2c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.669+0000 7f9d4a7de640 1 -- 172.21.15.79:0/4138568707 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c003520 con 0x7f9d2c004d40 2024-04-25T02:15:52.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.669+0000 7f9d4a7de640 1 --2- 172.21.15.79:0/4138568707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d2c004d40 0x7f9d2c00b9c0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009fc0 tx=0x7f9d2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119c82f7ae42d5c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:52.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.669+0000 7f9d48fdb640 1 -- 172.21.15.79:0/4138568707 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d34009c10 con 0x7f9d2c004d40 2024-04-25T02:15:52.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.669+0000 7f9d48fdb640 1 -- 172.21.15.79:0/4138568707 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d34036070 con 0x7f9d2c004d40 2024-04-25T02:15:52.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.669+0000 7f9d48fdb640 1 -- 172.21.15.79:0/4138568707 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3402d070 con 0x7f9d2c004d40 2024-04-25T02:15:52.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.670+0000 7f9d4c241640 1 -- 172.21.15.79:0/4138568707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d2c004d40 msgr2=0x7f9d2c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.670+0000 7f9d4c241640 1 --2- 172.21.15.79:0/4138568707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d2c004d40 0x7f9d2c00b9c0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009fc0 tx=0x7f9d2c005830 comp rx=0 tx=0).stop 2024-04-25T02:15:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.670+0000 7f9d4a7de640 1 -- 172.21.15.79:0/4138568707 reap_dead start 2024-04-25T02:15:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.670+0000 7f9d4c241640 1 -- 172.21.15.79:0/4138568707 shutdown_connections 2024-04-25T02:15:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.670+0000 7f9d4c241640 1 -- 172.21.15.79:0/4138568707 >> 172.21.15.79:0/4138568707 conn(0x7f9d440cfc80 msgr2=0x7f9d440d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.670+0000 7f9d4c241640 1 -- 172.21.15.79:0/4138568707 shutdown_connections 2024-04-25T02:15:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.670+0000 7f9d4c241640 1 -- 172.21.15.79:0/4138568707 wait complete. 2024-04-25T02:15:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.671+0000 7f9d4c241640 1 Processor -- start 2024-04-25T02:15:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.671+0000 7f9d4c241640 1 -- start start 2024-04-25T02:15:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d4c241640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d2c004d40 0x7f9d4414d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d4c241640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d441ef660 0x7f9d44150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d4c241640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d44153490 0x7f9d4406d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d4c241640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9d440b42a0 con 0x7f9d441ef660 2024-04-25T02:15:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d4c241640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9d440b39e0 con 0x7f9d2c004d40 2024-04-25T02:15:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d4c241640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9d440b4420 con 0x7f9d44153490 2024-04-25T02:15:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d497dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d441ef660 0x7f9d44150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d497dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d441ef660 0x7f9d44150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51946/0 (socket says 172.21.15.79:51946) 2024-04-25T02:15:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d497dc640 1 -- 172.21.15.79:0/2077386606 learned_addr learned my addr 172.21.15.79:0/2077386606 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d4a7de640 1 --2- 172.21.15.79:0/2077386606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d44153490 0x7f9d4406d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d49fdd640 1 --2- 172.21.15.79:0/2077386606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d2c004d40 0x7f9d4414d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d497dc640 1 -- 172.21.15.79:0/2077386606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d44153490 msgr2=0x7f9d4406d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d497dc640 1 --2- 172.21.15.79:0/2077386606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d44153490 0x7f9d4406d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d497dc640 1 -- 172.21.15.79:0/2077386606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d2c004d40 msgr2=0x7f9d4414d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d497dc640 1 --2- 172.21.15.79:0/2077386606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d2c004d40 0x7f9d4414d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d497dc640 1 -- 172.21.15.79:0/2077386606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d44151510 con 0x7f9d441ef660 2024-04-25T02:15:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d49fdd640 1 --2- 172.21.15.79:0/2077386606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d2c004d40 0x7f9d4414d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.672+0000 7f9d497dc640 1 --2- 172.21.15.79:0/2077386606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d441ef660 0x7f9d44150c10 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f9d38011910 tx=0x7f9d38011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.673+0000 7f9d427fc640 1 -- 172.21.15.79:0/2077386606 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800f9d0 con 0x7f9d441ef660 2024-04-25T02:15:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.673+0000 7f9d427fc640 1 -- 172.21.15.79:0/2077386606 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3800fb70 con 0x7f9d441ef660 2024-04-25T02:15:52.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.673+0000 7f9d427fc640 1 -- 172.21.15.79:0/2077386606 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d38014440 con 0x7f9d441ef660 2024-04-25T02:15:52.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.673+0000 7f9d4c241640 1 -- 172.21.15.79:0/2077386606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d441517f0 con 0x7f9d441ef660 2024-04-25T02:15:52.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.673+0000 7f9d4c241640 1 -- 172.21.15.79:0/2077386606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d44151db0 con 0x7f9d441ef660 2024-04-25T02:15:52.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.674+0000 7f9d4c241640 1 -- 172.21.15.79:0/2077386606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d440690a0 con 0x7f9d441ef660 2024-04-25T02:15:52.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.674+0000 7f9d427fc640 1 -- 172.21.15.79:0/2077386606 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d38012040 con 0x7f9d441ef660 2024-04-25T02:15:52.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.674+0000 7f9d427fc640 1 --2- 172.21.15.79:0/2077386606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9d3006be30 0x7f9d3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.675+0000 7f9d427fc640 1 -- 172.21.15.79:0/2077386606 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5115+0+0 (secure 0 0 0) 0x7f9d3808b110 con 0x7f9d441ef660 2024-04-25T02:15:52.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.675+0000 7f9d49fdd640 1 --2- 172.21.15.79:0/2077386606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9d3006be30 0x7f9d3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.675+0000 7f9d49fdd640 1 --2- 172.21.15.79:0/2077386606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9d3006be30 0x7f9d3006e2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0017e0 tx=0x7f9d3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:52.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.679+0000 7f9d427fc640 1 -- 172.21.15.79:0/2077386606 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9d38019030 con 0x7f9d441ef660 2024-04-25T02:15:52.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.915+0000 7f9d4c241640 1 -- 172.21.15.79:0/2077386606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) -- 0x7f9d44159a90 con 0x7f9d441ef660 2024-04-25T02:15:52.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.962+0000 7f9d427fc640 1 -- 172.21.15.79:0/2077386606 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v375) ==== 149+0+0 (secure 0 0 0) 0x7f9d38059da0 con 0x7f9d441ef660 2024-04-25T02:15:52.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.964+0000 7f9d4c241640 1 -- 172.21.15.79:0/2077386606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9d3006be30 msgr2=0x7f9d3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.964+0000 7f9d4c241640 1 --2- 172.21.15.79:0/2077386606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9d3006be30 0x7f9d3006e2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0017e0 tx=0x7f9d3c009040 comp rx=0 tx=0).stop 2024-04-25T02:15:52.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.964+0000 7f9d4c241640 1 -- 172.21.15.79:0/2077386606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d441ef660 msgr2=0x7f9d44150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.964+0000 7f9d4c241640 1 --2- 172.21.15.79:0/2077386606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d441ef660 0x7f9d44150c10 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f9d38011910 tx=0x7f9d38011dd0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.964+0000 7f9d4c241640 1 -- 172.21.15.79:0/2077386606 shutdown_connections 2024-04-25T02:15:52.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.964+0000 7f9d4c241640 1 --2- 172.21.15.79:0/2077386606 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9d3006be30 0x7f9d3006e2f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.964+0000 7f9d4c241640 1 --2- 172.21.15.79:0/2077386606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d44153490 0x7f9d4406d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.964+0000 7f9d4c241640 1 --2- 172.21.15.79:0/2077386606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d441ef660 0x7f9d44150c10 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.964+0000 7f9d4c241640 1 --2- 172.21.15.79:0/2077386606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d2c004d40 0x7f9d4414d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.964+0000 7f9d4c241640 1 -- 172.21.15.79:0/2077386606 >> 172.21.15.79:0/2077386606 conn(0x7f9d440cfc80 msgr2=0x7f9d44071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:52.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.964+0000 7f9d4c241640 1 -- 172.21.15.79:0/2077386606 shutdown_connections 2024-04-25T02:15:52.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:52.964+0000 7f9d4c241640 1 -- 172.21.15.79:0/2077386606 wait complete. 2024-04-25T02:15:52.981 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T02:15:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.075+0000 7f22c8a64640 1 Processor -- start 2024-04-25T02:15:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.075+0000 7f22c8a64640 1 -- start start 2024-04-25T02:15:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.076+0000 7f22c8a64640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22c40cf7a0 0x7f22c40b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.076+0000 7f22c8a64640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22c406e6b0 0x7f22c415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.076+0000 7f22c8a64640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22c415ec20 con 0x7f22c406b2f0 2024-04-25T02:15:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.076+0000 7f22c8a64640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f22c415f830 con 0x7f22c40cf7a0 2024-04-25T02:15:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.076+0000 7f22c8a64640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f22c415ef00 con 0x7f22c406e6b0 2024-04-25T02:15:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.076+0000 7f22c1d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22c40cf7a0 0x7f22c40b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.076+0000 7f22c259c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f22c406b2f0 0x7f22c406b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60712/0 (socket says 172.21.15.79:60712) 2024-04-25T02:15:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.076+0000 7f22c1d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22c40cf7a0 0x7f22c40b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51960/0 (socket says 172.21.15.79:51960) 2024-04-25T02:15:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.076+0000 7f22c259c640 1 -- 172.21.15.79:0/40610011 learned_addr learned my addr 172.21.15.79:0/40610011 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.076+0000 7f22c2d9d640 1 --2- 172.21.15.79:0/40610011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22c406e6b0 0x7f22c415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.076+0000 7f22c1d9b640 1 -- 172.21.15.79:0/40610011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22c406e6b0 msgr2=0x7f22c415b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.076+0000 7f22c1d9b640 1 --2- 172.21.15.79:0/40610011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22c406e6b0 0x7f22c415b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.076+0000 7f22c1d9b640 1 -- 172.21.15.79:0/40610011 >> v1:172.21.15.79:6789/0 conn(0x7f22c406b2f0 legacy=0x7f22c406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.076+0000 7f22c1d9b640 1 -- 172.21.15.79:0/40610011 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c415f1e0 con 0x7f22c40cf7a0 2024-04-25T02:15:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.076+0000 7f22c159a640 1 -- 172.21.15.79:0/40610011 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373409467 0 0) 0x7f22c415ec20 con 0x7f22c406b2f0 2024-04-25T02:15:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.077+0000 7f22c1d9b640 1 --2- 172.21.15.79:0/40610011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40cf7a0 0x7f22c40b4b50 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f22b80097a0 tx=0x7f22b802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786e1b65a7dae143 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.077+0000 7f22c159a640 1 -- 172.21.15.79:0/40610011 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8037070 con 0x7f22c40cf7a0 2024-04-25T02:15:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.077+0000 7f22c159a640 1 -- 172.21.15.79:0/40610011 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b802ae50 con 0x7f22c40cf7a0 2024-04-25T02:15:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.077+0000 7f22c159a640 1 -- 172.21.15.79:0/40610011 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8032660 con 0x7f22c40cf7a0 2024-04-25T02:15:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.077+0000 7f22c8a64640 1 -- 172.21.15.79:0/40610011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40cf7a0 msgr2=0x7f22c40b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.077+0000 7f22c8a64640 1 --2- 172.21.15.79:0/40610011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40cf7a0 0x7f22c40b4b50 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f22b80097a0 tx=0x7f22b802a100 comp rx=0 tx=0).stop 2024-04-25T02:15:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.078+0000 7f22c8a64640 1 -- 172.21.15.79:0/40610011 shutdown_connections 2024-04-25T02:15:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.078+0000 7f22c8a64640 1 --2- 172.21.15.79:0/40610011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22c406e6b0 0x7f22c415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.078+0000 7f22c8a64640 1 --2- 172.21.15.79:0/40610011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40cf7a0 0x7f22c40b4b50 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.078+0000 7f22c8a64640 1 -- 172.21.15.79:0/40610011 >> 172.21.15.79:0/40610011 conn(0x7f22c40b1cd0 msgr2=0x7f22c40b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.078+0000 7f22c8a64640 1 -- 172.21.15.79:0/40610011 shutdown_connections 2024-04-25T02:15:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.078+0000 7f22c8a64640 1 -- 172.21.15.79:0/40610011 wait complete. 2024-04-25T02:15:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.079+0000 7f22c8a64640 1 Processor -- start 2024-04-25T02:15:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.079+0000 7f22c8a64640 1 -- start start 2024-04-25T02:15:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.079+0000 7f22c8a64640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22c406b2f0 0x7f22c409cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c8a64640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f22c406e6b0 0x7f22c4072b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c8a64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40cf7a0 0x7f22c4159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c8a64640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f22c406d160 con 0x7f22c40cf7a0 2024-04-25T02:15:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c8a64640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f22c406cfe0 con 0x7f22c406e6b0 2024-04-25T02:15:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c8a64640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f22c415b810 con 0x7f22c406b2f0 2024-04-25T02:15:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40cf7a0 0x7f22c4159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40cf7a0 0x7f22c4159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51962/0 (socket says 172.21.15.79:51962) 2024-04-25T02:15:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c2d9d640 1 -- 172.21.15.79:0/1386310101 learned_addr learned my addr 172.21.15.79:0/1386310101 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c1d9b640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f22c406e6b0 0x7f22c4072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c259c640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22c406b2f0 0x7f22c409cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c2d9d640 1 -- 172.21.15.79:0/1386310101 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22c406b2f0 msgr2=0x7f22c409cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c2d9d640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22c406b2f0 0x7f22c409cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c2d9d640 1 -- 172.21.15.79:0/1386310101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f22c406e6b0 msgr2=0x7f22c4072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c2d9d640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f22c406e6b0 0x7f22c4072b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c2d9d640 1 -- 172.21.15.79:0/1386310101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c4073050 con 0x7f22c40cf7a0 2024-04-25T02:15:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c1d9b640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f22c406e6b0 0x7f22c4072b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c259c640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22c406b2f0 0x7f22c409cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c2d9d640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40cf7a0 0x7f22c4159a40 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f22b400d830 tx=0x7f22b400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22b2ffd640 1 -- 172.21.15.79:0/1386310101 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b400b6c0 con 0x7f22c40cf7a0 2024-04-25T02:15:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22b2ffd640 1 -- 172.21.15.79:0/1386310101 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b4019070 con 0x7f22c40cf7a0 2024-04-25T02:15:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c8a64640 1 -- 172.21.15.79:0/1386310101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c409c7b0 con 0x7f22c40cf7a0 2024-04-25T02:15:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22b2ffd640 1 -- 172.21.15.79:0/1386310101 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b400bac0 con 0x7f22c40cf7a0 2024-04-25T02:15:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.080+0000 7f22c8a64640 1 -- 172.21.15.79:0/1386310101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c409b230 con 0x7f22c40cf7a0 2024-04-25T02:15:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.081+0000 7f22c8a64640 1 -- 172.21.15.79:0/1386310101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c40690a0 con 0x7f22c40cf7a0 2024-04-25T02:15:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.082+0000 7f22b2ffd640 1 -- 172.21.15.79:0/1386310101 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22b400bc60 con 0x7f22c40cf7a0 2024-04-25T02:15:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.082+0000 7f22b2ffd640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f22a406be60 0x7f22a406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.082+0000 7f22b2ffd640 1 -- 172.21.15.79:0/1386310101 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5115+0+0 (secure 0 0 0) 0x7f22b408b040 con 0x7f22c40cf7a0 2024-04-25T02:15:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.082+0000 7f22c259c640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f22a406be60 0x7f22a406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.083+0000 7f22c259c640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f22a406be60 0x7f22a406e320 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0012e0 tx=0x7f22bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:53.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.087+0000 7f22b2ffd640 1 -- 172.21.15.79:0/1386310101 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f22c4073050 con 0x7f22c40cf7a0 2024-04-25T02:15:53.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.260+0000 7f22c8a64640 1 -- 172.21.15.79:0/1386310101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f22c40cf4f0 con 0x7f22c40cf7a0 2024-04-25T02:15:53.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.265+0000 7f22b2ffd640 1 -- 172.21.15.79:0/1386310101 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f22b4059c40 con 0x7f22c40cf7a0 2024-04-25T02:15:53.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.267+0000 7f22c8a64640 1 -- 172.21.15.79:0/1386310101 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f22a406be60 msgr2=0x7f22a406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.267+0000 7f22c8a64640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f22a406be60 0x7f22a406e320 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0012e0 tx=0x7f22bc009040 comp rx=0 tx=0).stop 2024-04-25T02:15:53.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.267+0000 7f22c8a64640 1 -- 172.21.15.79:0/1386310101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40cf7a0 msgr2=0x7f22c4159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.267+0000 7f22c8a64640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40cf7a0 0x7f22c4159a40 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f22b400d830 tx=0x7f22b400dcf0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.267+0000 7f22c8a64640 1 -- 172.21.15.79:0/1386310101 shutdown_connections 2024-04-25T02:15:53.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.267+0000 7f22c8a64640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f22a406be60 0x7f22a406e320 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.267+0000 7f22c8a64640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40cf7a0 0x7f22c4159a40 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.267+0000 7f22c8a64640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f22c406e6b0 0x7f22c4072b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.267+0000 7f22c8a64640 1 --2- 172.21.15.79:0/1386310101 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f22c406b2f0 0x7f22c409cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.267+0000 7f22c8a64640 1 -- 172.21.15.79:0/1386310101 >> 172.21.15.79:0/1386310101 conn(0x7f22c40b1cd0 msgr2=0x7f22c40b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:53.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.267+0000 7f22c8a64640 1 -- 172.21.15.79:0/1386310101 shutdown_connections 2024-04-25T02:15:53.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.267+0000 7f22c8a64640 1 -- 172.21.15.79:0/1386310101 wait complete. 2024-04-25T02:15:53.283 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:15:53.284 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:15:53.326 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:15:53.372 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:15:53.372 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:15:53.372 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:15:53.388 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:15:53.388 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:15:53.388 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:15:53.430 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:15:53.430 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:15:53.431 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:15:53.445 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:15:53.446 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:15:53.446 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:15:53.487 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:15:53.488 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T02:15:53.488 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:15:53.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.580+0000 7f83c9fa5640 1 Processor -- start 2024-04-25T02:15:53.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.580+0000 7f83c9fa5640 1 -- start start 2024-04-25T02:15:53.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c9fa5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83c4144cb0 0x7f83c40b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c9fa5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f83c40b5580 0x7f83c406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c9fa5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83c4070d90 con 0x7f83c406e490 2024-04-25T02:15:53.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c9fa5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f83c406e900 con 0x7f83c40b5580 2024-04-25T02:15:53.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c9fa5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f83c40cf130 con 0x7f83c4144cb0 2024-04-25T02:15:53.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c3fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f83c406e490 0x7f83c415fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46634/0 (socket says 172.21.15.79:46634) 2024-04-25T02:15:53.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c3fff640 1 -- 172.21.15.79:0/853015542 learned_addr learned my addr 172.21.15.79:0/853015542 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:53.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c2ffd640 1 --2- 172.21.15.79:0/853015542 >> v2:172.21.15.189:3300/0 conn(0x7f83c40b5580 0x7f83c406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c37fe640 1 --2- 172.21.15.79:0/853015542 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83c4144cb0 0x7f83c40b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c27fc640 1 -- 172.21.15.79:0/853015542 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1528726484 0 0) 0x7f83c4070d90 con 0x7f83c406e490 2024-04-25T02:15:53.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c27fc640 1 -- 172.21.15.79:0/853015542 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83ac003520 con 0x7f83c406e490 2024-04-25T02:15:53.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c27fc640 1 -- 172.21.15.79:0/853015542 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 553502432 0 0) 0x7f83ac003520 con 0x7f83c406e490 2024-04-25T02:15:53.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c27fc640 1 -- 172.21.15.79:0/853015542 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83c4144cb0 msgr2=0x7f83c40b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:53.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c27fc640 1 --2- 172.21.15.79:0/853015542 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83c4144cb0 0x7f83c40b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c27fc640 1 -- 172.21.15.79:0/853015542 >> v2:172.21.15.189:3300/0 conn(0x7f83c40b5580 msgr2=0x7f83c406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:53.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c27fc640 1 --2- 172.21.15.79:0/853015542 >> v2:172.21.15.189:3300/0 conn(0x7f83c40b5580 0x7f83c406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c27fc640 1 -- 172.21.15.79:0/853015542 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c40cf410 con 0x7f83c406e490 2024-04-25T02:15:53.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c27fc640 1 -- 172.21.15.79:0/853015542 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f83bc0019f0 con 0x7f83c406e490 2024-04-25T02:15:53.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.581+0000 7f83c27fc640 1 -- 172.21.15.79:0/853015542 >> v1:172.21.15.79:6789/0 conn(0x7f83c406e490 legacy=0x7f83c415fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c27fc640 1 --2- 172.21.15.79:0/853015542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83ac0039b0 0x7f83ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c27fc640 1 --2- 172.21.15.79:0/853015542 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83c4144cb0 0x7f83ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c27fc640 1 --2- 172.21.15.79:0/853015542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83ac004d40 0x7f83ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c27fc640 1 -- 172.21.15.79:0/853015542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f83c406e900 con 0x7f83ac0039b0 2024-04-25T02:15:53.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c27fc640 1 -- 172.21.15.79:0/853015542 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f83c40cf130 con 0x7f83ac004d40 2024-04-25T02:15:53.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c27fc640 1 -- 172.21.15.79:0/853015542 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f83ac00ba40 con 0x7f83c4144cb0 2024-04-25T02:15:53.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c37fe640 1 --2- 172.21.15.79:0/853015542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83ac0039b0 0x7f83ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c3fff640 1 --2- 172.21.15.79:0/853015542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83ac004d40 0x7f83ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c2ffd640 1 --2- 172.21.15.79:0/853015542 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83c4144cb0 0x7f83ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c37fe640 1 -- 172.21.15.79:0/853015542 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83c4144cb0 msgr2=0x7f83ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:53.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c37fe640 1 --2- 172.21.15.79:0/853015542 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83c4144cb0 0x7f83ac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c37fe640 1 -- 172.21.15.79:0/853015542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83ac004d40 msgr2=0x7f83ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:53.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c37fe640 1 --2- 172.21.15.79:0/853015542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83ac004d40 0x7f83ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c37fe640 1 -- 172.21.15.79:0/853015542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac003520 con 0x7f83ac0039b0 2024-04-25T02:15:53.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c3fff640 1 --2- 172.21.15.79:0/853015542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83ac004d40 0x7f83ac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:53.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.582+0000 7f83c2ffd640 1 --2- 172.21.15.79:0/853015542 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83c4144cb0 0x7f83ac004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:53.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.583+0000 7f83c37fe640 1 --2- 172.21.15.79:0/853015542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83ac0039b0 0x7f83ac003dd0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009ac0 tx=0x7f83ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731f3385be643511 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:53.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.583+0000 7f83c27fc640 1 -- 172.21.15.79:0/853015542 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b4036070 con 0x7f83ac0039b0 2024-04-25T02:15:53.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.583+0000 7f83c27fc640 1 -- 172.21.15.79:0/853015542 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b4031400 con 0x7f83ac0039b0 2024-04-25T02:15:53.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.583+0000 7f83c27fc640 1 -- 172.21.15.79:0/853015542 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b4009690 con 0x7f83ac0039b0 2024-04-25T02:15:53.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.583+0000 7f83c9fa5640 1 -- 172.21.15.79:0/853015542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83ac0039b0 msgr2=0x7f83ac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.583+0000 7f83c9fa5640 1 --2- 172.21.15.79:0/853015542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83ac0039b0 0x7f83ac003dd0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009ac0 tx=0x7f83ac005830 comp rx=0 tx=0).stop 2024-04-25T02:15:53.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.583+0000 7f83c3fff640 1 -- 172.21.15.79:0/853015542 reap_dead start 2024-04-25T02:15:53.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.583+0000 7f83c9fa5640 1 -- 172.21.15.79:0/853015542 shutdown_connections 2024-04-25T02:15:53.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.583+0000 7f83c9fa5640 1 -- 172.21.15.79:0/853015542 >> 172.21.15.79:0/853015542 conn(0x7f83c40cfc80 msgr2=0x7f83c40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:53.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.583+0000 7f83c9fa5640 1 -- 172.21.15.79:0/853015542 shutdown_connections 2024-04-25T02:15:53.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.583+0000 7f83c9fa5640 1 -- 172.21.15.79:0/853015542 wait complete. 2024-04-25T02:15:53.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.584+0000 7f83c9fa5640 1 Processor -- start 2024-04-25T02:15:53.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.585+0000 7f83c9fa5640 1 -- start start 2024-04-25T02:15:53.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.585+0000 7f83c9fa5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83ac0039b0 0x7f83c40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.585+0000 7f83c9fa5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40b2f50 0x7f83c4159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.585+0000 7f83c9fa5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83c40ae1e0 0x7f83c40ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.585+0000 7f83c9fa5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f83c4145090 con 0x7f83c40b2f50 2024-04-25T02:15:53.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.585+0000 7f83c9fa5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f83c40cf9d0 con 0x7f83ac0039b0 2024-04-25T02:15:53.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.585+0000 7f83c9fa5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f83c4145ab0 con 0x7f83c40ae1e0 2024-04-25T02:15:53.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.585+0000 7f83c2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40b2f50 0x7f83c4159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.585+0000 7f83c2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40b2f50 0x7f83c4159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58726/0 (socket says 172.21.15.79:58726) 2024-04-25T02:15:53.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.585+0000 7f83c2ffd640 1 -- 172.21.15.79:0/2016638020 learned_addr learned my addr 172.21.15.79:0/2016638020 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:53.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.586+0000 7f83c2ffd640 1 -- 172.21.15.79:0/2016638020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83c40ae1e0 msgr2=0x7f83c40ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.586+0000 7f83c2ffd640 1 --2- 172.21.15.79:0/2016638020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83c40ae1e0 0x7f83c40ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.586+0000 7f83c2ffd640 1 -- 172.21.15.79:0/2016638020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83ac0039b0 msgr2=0x7f83c40b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.586+0000 7f83c2ffd640 1 --2- 172.21.15.79:0/2016638020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83ac0039b0 0x7f83c40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.586+0000 7f83c2ffd640 1 -- 172.21.15.79:0/2016638020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c415a430 con 0x7f83c40b2f50 2024-04-25T02:15:53.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.586+0000 7f83c2ffd640 1 --2- 172.21.15.79:0/2016638020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40b2f50 0x7f83c4159aa0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f83b8011680 tx=0x7f83b8011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:53.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.586+0000 7f83abfff640 1 -- 172.21.15.79:0/2016638020 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b800f9c0 con 0x7f83c40b2f50 2024-04-25T02:15:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.586+0000 7f83abfff640 1 -- 172.21.15.79:0/2016638020 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b800fb60 con 0x7f83c40b2f50 2024-04-25T02:15:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.586+0000 7f83c9fa5640 1 -- 172.21.15.79:0/2016638020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c415a710 con 0x7f83c40b2f50 2024-04-25T02:15:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.586+0000 7f83abfff640 1 -- 172.21.15.79:0/2016638020 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8015460 con 0x7f83c40b2f50 2024-04-25T02:15:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.586+0000 7f83c9fa5640 1 -- 172.21.15.79:0/2016638020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c415acd0 con 0x7f83c40b2f50 2024-04-25T02:15:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.587+0000 7f83c9fa5640 1 -- 172.21.15.79:0/2016638020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83c40690a0 con 0x7f83c40b2f50 2024-04-25T02:15:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.587+0000 7f83abfff640 1 -- 172.21.15.79:0/2016638020 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83b8015600 con 0x7f83c40b2f50 2024-04-25T02:15:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.588+0000 7f83abfff640 1 --2- 172.21.15.79:0/2016638020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f83b006be60 0x7f83b006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.588+0000 7f83abfff640 1 -- 172.21.15.79:0/2016638020 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5115+0+0 (secure 0 0 0) 0x7f83b808b530 con 0x7f83c40b2f50 2024-04-25T02:15:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.588+0000 7f83c37fe640 1 --2- 172.21.15.79:0/2016638020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f83b006be60 0x7f83b006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.588+0000 7f83c37fe640 1 --2- 172.21.15.79:0/2016638020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f83b006be60 0x7f83b006e320 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f83b4033000 tx=0x7f83b402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:53.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.592+0000 7f83abfff640 1 -- 172.21.15.79:0/2016638020 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f83b8019030 con 0x7f83c40b2f50 2024-04-25T02:15:53.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.798+0000 7f83c9fa5640 1 -- 172.21.15.79:0/2016638020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83c40b5160 con 0x7f83c40b2f50 2024-04-25T02:15:53.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.799+0000 7f83abfff640 1 -- 172.21.15.79:0/2016638020 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+3875 (secure 0 0 0) 0x7f83b805a130 con 0x7f83c40b2f50 2024-04-25T02:15:53.804 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:53.804 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":63,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3521640268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":3521640268},{"type":"v1","addr":"172.21.15.189:6835","nonce":3521640268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1096746575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1096746575},{"type":"v1","addr":"172.21.15.189:6834","nonce":1096746575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2499770632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2499770632},{"type":"v1","addr":"172.21.15.79:6835","nonce":2499770632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":8187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2514945929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2514945929},{"type":"v1","addr":"172.21.15.79:6837","nonce":2514945929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[]} 2024-04-25T02:15:53.805 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 63 2024-04-25T02:15:53.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.801+0000 7f83c9fa5640 1 -- 172.21.15.79:0/2016638020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f83b006be60 msgr2=0x7f83b006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.801+0000 7f83c9fa5640 1 --2- 172.21.15.79:0/2016638020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f83b006be60 0x7f83b006e320 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f83b4033000 tx=0x7f83b402e000 comp rx=0 tx=0).stop 2024-04-25T02:15:53.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.801+0000 7f83c9fa5640 1 -- 172.21.15.79:0/2016638020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40b2f50 msgr2=0x7f83c4159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.801+0000 7f83c9fa5640 1 --2- 172.21.15.79:0/2016638020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40b2f50 0x7f83c4159aa0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f83b8011680 tx=0x7f83b8011b40 comp rx=0 tx=0).stop 2024-04-25T02:15:53.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.801+0000 7f83c9fa5640 1 -- 172.21.15.79:0/2016638020 shutdown_connections 2024-04-25T02:15:53.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.801+0000 7f83c9fa5640 1 --2- 172.21.15.79:0/2016638020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f83b006be60 0x7f83b006e320 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.801+0000 7f83c9fa5640 1 --2- 172.21.15.79:0/2016638020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83c40ae1e0 0x7f83c40ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.801+0000 7f83c9fa5640 1 --2- 172.21.15.79:0/2016638020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40b2f50 0x7f83c4159aa0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.801+0000 7f83c9fa5640 1 --2- 172.21.15.79:0/2016638020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83ac0039b0 0x7f83c40b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.801+0000 7f83c9fa5640 1 -- 172.21.15.79:0/2016638020 >> 172.21.15.79:0/2016638020 conn(0x7f83c40cfc80 msgr2=0x7f83c40afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:53.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.801+0000 7f83c9fa5640 1 -- 172.21.15.79:0/2016638020 shutdown_connections 2024-04-25T02:15:53.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.801+0000 7f83c9fa5640 1 -- 172.21.15.79:0/2016638020 wait complete. 2024-04-25T02:15:53.817 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T02:15:53.817 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T02:15:53.817 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T02:15:53.818 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:15:53.818 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T02:15:53.818 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T02:15:53.818 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T02:15:53.818 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:15:53.818 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T02:15:53.818 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T02:15:53.819 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T02:15:53.819 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:15:53.819 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T02:15:53.819 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T02:15:53.819 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T02:15:53.819 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:15:53.827 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T02:15:53.827 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T02:15:53.828 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T02:15:53.828 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T02:15:53.830 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T02:15:53.830 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T02:15:53.831 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T02:15:53.831 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T02:15:53.869 INFO:tasks.ceph.mds.a:Started 2024-04-25T02:15:53.869 DEBUG:teuthology.parallel:result is None 2024-04-25T02:15:53.870 INFO:tasks.ceph.mds.c:Started 2024-04-25T02:15:53.870 DEBUG:teuthology.parallel:result is None 2024-04-25T02:15:53.873 INFO:tasks.ceph.mds.b:Started 2024-04-25T02:15:53.873 DEBUG:teuthology.parallel:result is None 2024-04-25T02:15:53.874 INFO:tasks.ceph.mds.d:Started 2024-04-25T02:15:53.874 DEBUG:teuthology.parallel:result is None 2024-04-25T02:15:53.874 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T02:15:53.941 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-04-25T02:15:53.942 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:15:53.952 INFO:tasks.ceph.mds.b.smithi189.stdout:starting mds.b at 2024-04-25T02:15:53.952 INFO:tasks.ceph.mds.d.smithi189.stdout:starting mds.d at 2024-04-25T02:15:53.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.971+0000 7f0b0af63640 1 Processor -- start 2024-04-25T02:15:53.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.971+0000 7f0b0af63640 1 -- start start 2024-04-25T02:15:53.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.972+0000 7f0b0af63640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b0415ea60 0x7f0b0415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.972+0000 7f0b0af63640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b040aeda0 con 0x7f0b040d0d50 2024-04-25T02:15:53.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.972+0000 7f0b0af63640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b0415f040 con 0x7f0b040af750 2024-04-25T02:15:53.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.972+0000 7f0b0af63640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0b0415c430 con 0x7f0b0415ea60 2024-04-25T02:15:53.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.972+0000 7f0b09500640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0b040d0d50 0x7f0b040b4e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46662/0 (socket says 172.21.15.79:46662) 2024-04-25T02:15:53.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.972+0000 7f0b09500640 1 -- 172.21.15.79:0/375726732 learned_addr learned my addr 172.21.15.79:0/375726732 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:53.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.973+0000 7f0afbfff640 1 --2- 172.21.15.79:0/375726732 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b0415ea60 0x7f0b0415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.973+0000 7f0afb7fe640 1 -- 172.21.15.79:0/375726732 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023338559 0 0) 0x7f0b040aeda0 con 0x7f0b040d0d50 2024-04-25T02:15:53.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.973+0000 7f0afb7fe640 1 -- 172.21.15.79:0/375726732 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0aec003520 con 0x7f0b040d0d50 2024-04-25T02:15:53.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.973+0000 7f0afbfff640 1 -- 172.21.15.79:0/375726732 >> v1:172.21.15.189:6789/0 conn(0x7f0b040af750 legacy=0x7f0b040ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.973+0000 7f0afbfff640 1 -- 172.21.15.79:0/375726732 >> v1:172.21.15.79:6789/0 conn(0x7f0b040d0d50 legacy=0x7f0b040b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.973+0000 7f0afb7fe640 1 -- 172.21.15.79:0/375726732 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2334866763 0 0) 0x7f0aec003520 con 0x7f0b040d0d50 2024-04-25T02:15:53.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.973+0000 7f0afbfff640 1 -- 172.21.15.79:0/375726732 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0415f320 con 0x7f0b0415ea60 2024-04-25T02:15:53.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.974+0000 7f0afbfff640 1 --2- 172.21.15.79:0/375726732 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b0415ea60 0x7f0b0415bef0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0af40097d0 tx=0x7f0af402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f886b1dfc3f8dbd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:53.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.980+0000 7f0afb7fe640 1 -- 172.21.15.79:0/375726732 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4037070 con 0x7f0b0415ea60 2024-04-25T02:15:53.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.980+0000 7f0afb7fe640 1 -- 172.21.15.79:0/375726732 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af402ac30 con 0x7f0b0415ea60 2024-04-25T02:15:53.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.980+0000 7f0afb7fe640 1 -- 172.21.15.79:0/375726732 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc0019f0 con 0x7f0b0415ea60 2024-04-25T02:15:53.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.981+0000 7f0b0af63640 1 -- 172.21.15.79:0/375726732 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b0415ea60 msgr2=0x7f0b0415bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.981+0000 7f0b0af63640 1 --2- 172.21.15.79:0/375726732 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b0415ea60 0x7f0b0415bef0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0af40097d0 tx=0x7f0af402a1a0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.981+0000 7f0b0af63640 1 -- 172.21.15.79:0/375726732 shutdown_connections 2024-04-25T02:15:53.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.981+0000 7f0b0af63640 1 --2- 172.21.15.79:0/375726732 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b0415ea60 0x7f0b0415bef0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.981+0000 7f0b0af63640 1 -- 172.21.15.79:0/375726732 >> 172.21.15.79:0/375726732 conn(0x7f0b0406c3a0 msgr2=0x7f0b0406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:53.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.981+0000 7f0b0af63640 1 -- 172.21.15.79:0/375726732 shutdown_connections 2024-04-25T02:15:53.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.981+0000 7f0b0af63640 1 -- 172.21.15.79:0/375726732 wait complete. 2024-04-25T02:15:53.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.982+0000 7f0b0af63640 1 Processor -- start 2024-04-25T02:15:53.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.982+0000 7f0b0af63640 1 -- start start 2024-04-25T02:15:53.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.983+0000 7f0b0af63640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b040af750 0x7f0b04140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.983+0000 7f0b0af63640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b040d0d50 0x7f0b040cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.983+0000 7f0b0af63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b0415ea60 0x7f0b04159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.983+0000 7f0b0af63640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b040b48e0 con 0x7f0b0415ea60 2024-04-25T02:15:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.983+0000 7f0b0af63640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0415f8e0 con 0x7f0b040d0d50 2024-04-25T02:15:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.983+0000 7f0b0af63640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0b040b5510 con 0x7f0b040af750 2024-04-25T02:15:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.983+0000 7f0b09500640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b0415ea60 0x7f0b04159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.983+0000 7f0b09500640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b0415ea60 0x7f0b04159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58762/0 (socket says 172.21.15.79:58762) 2024-04-25T02:15:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.983+0000 7f0b09500640 1 -- 172.21.15.79:0/2932831934 learned_addr learned my addr 172.21.15.79:0/2932831934 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.983+0000 7f0b08cff640 1 --2- 172.21.15.79:0/2932831934 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b040af750 0x7f0b04140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.984+0000 7f0afbfff640 1 --2- 172.21.15.79:0/2932831934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b040d0d50 0x7f0b040cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.984+0000 7f0b09500640 1 -- 172.21.15.79:0/2932831934 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b040af750 msgr2=0x7f0b04140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.984+0000 7f0b09500640 1 --2- 172.21.15.79:0/2932831934 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b040af750 0x7f0b04140380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.984+0000 7f0b09500640 1 -- 172.21.15.79:0/2932831934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b040d0d50 msgr2=0x7f0b040cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.984+0000 7f0b09500640 1 --2- 172.21.15.79:0/2932831934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b040d0d50 0x7f0b040cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:53.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.984+0000 7f0b09500640 1 -- 172.21.15.79:0/2932831934 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b040cfe60 con 0x7f0b0415ea60 2024-04-25T02:15:53.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.984+0000 7f0b09500640 1 --2- 172.21.15.79:0/2932831934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b0415ea60 0x7f0b04159600 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f0afc001b60 tx=0x7f0afc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.986+0000 7f0af97fa640 1 -- 172.21.15.79:0/2932831934 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc017070 con 0x7f0b0415ea60 2024-04-25T02:15:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.987+0000 7f0af97fa640 1 -- 172.21.15.79:0/2932831934 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0afc012400 con 0x7f0b0415ea60 2024-04-25T02:15:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.987+0000 7f0b0af63640 1 -- 172.21.15.79:0/2932831934 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b040d0140 con 0x7f0b0415ea60 2024-04-25T02:15:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.987+0000 7f0af97fa640 1 -- 172.21.15.79:0/2932831934 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc0127b0 con 0x7f0b0415ea60 2024-04-25T02:15:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.987+0000 7f0b0af63640 1 -- 172.21.15.79:0/2932831934 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b040d0700 con 0x7f0b0415ea60 2024-04-25T02:15:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.988+0000 7f0b0af63640 1 -- 172.21.15.79:0/2932831934 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b040681e0 con 0x7f0b0415ea60 2024-04-25T02:15:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.988+0000 7f0af97fa640 1 -- 172.21.15.79:0/2932831934 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0afc01a070 con 0x7f0b0415ea60 2024-04-25T02:15:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.988+0000 7f0af97fa640 1 --2- 172.21.15.79:0/2932831934 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0af006be60 0x7f0af006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.989+0000 7f0af97fa640 1 -- 172.21.15.79:0/2932831934 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5115+0+0 (secure 0 0 0) 0x7f0afc08aa00 con 0x7f0b0415ea60 2024-04-25T02:15:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.989+0000 7f0b08cff640 1 --2- 172.21.15.79:0/2932831934 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0af006be60 0x7f0af006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.989+0000 7f0b08cff640 1 --2- 172.21.15.79:0/2932831934 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0af006be60 0x7f0af006e320 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0b00000f60 tx=0x7f0b00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:53.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:53.993+0000 7f0af97fa640 1 -- 172.21.15.79:0/2932831934 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0afc058fb0 con 0x7f0b0415ea60 2024-04-25T02:15:54.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:54.182+0000 7f0b0af63640 1 -- 172.21.15.79:0/2932831934 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f0b040cd5d0 con 0x7f0b0415ea60 2024-04-25T02:15:54.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:54.994+0000 7f0af97fa640 1 -- 172.21.15.79:0/2932831934 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v98) ==== 97+0+0 (secure 0 0 0) 0x7f0afc05d2b0 con 0x7f0b0415ea60 2024-04-25T02:15:54.999 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2024-04-25T02:15:55.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:54.997+0000 7f0b0af63640 1 -- 172.21.15.79:0/2932831934 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0af006be60 msgr2=0x7f0af006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:54.997+0000 7f0b0af63640 1 --2- 172.21.15.79:0/2932831934 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0af006be60 0x7f0af006e320 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0b00000f60 tx=0x7f0b00009040 comp rx=0 tx=0).stop 2024-04-25T02:15:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:54.997+0000 7f0b0af63640 1 -- 172.21.15.79:0/2932831934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b0415ea60 msgr2=0x7f0b04159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:54.997+0000 7f0b0af63640 1 --2- 172.21.15.79:0/2932831934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b0415ea60 0x7f0b04159600 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f0afc001b60 tx=0x7f0afc00a430 comp rx=0 tx=0).stop 2024-04-25T02:15:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:54.997+0000 7f0b0af63640 1 -- 172.21.15.79:0/2932831934 shutdown_connections 2024-04-25T02:15:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:54.997+0000 7f0b0af63640 1 --2- 172.21.15.79:0/2932831934 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0af006be60 0x7f0af006e320 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:54.997+0000 7f0b0af63640 1 --2- 172.21.15.79:0/2932831934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b0415ea60 0x7f0b04159600 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:54.997+0000 7f0b0af63640 1 --2- 172.21.15.79:0/2932831934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b040d0d50 0x7f0b040cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:54.997+0000 7f0b0af63640 1 --2- 172.21.15.79:0/2932831934 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b040af750 0x7f0b04140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:54.997+0000 7f0b0af63640 1 -- 172.21.15.79:0/2932831934 >> 172.21.15.79:0/2932831934 conn(0x7f0b0406c3a0 msgr2=0x7f0b0406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:54.997+0000 7f0b0af63640 1 -- 172.21.15.79:0/2932831934 shutdown_connections 2024-04-25T02:15:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:54.997+0000 7f0b0af63640 1 -- 172.21.15.79:0/2932831934 wait complete. 2024-04-25T02:15:55.015 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T02:15:55.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.110+0000 7febd0df9640 1 Processor -- start 2024-04-25T02:15:55.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.110+0000 7febd0df9640 1 -- start start 2024-04-25T02:15:55.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.111+0000 7febd0df9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7febcc0d2e20 0x7febcc0cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.111+0000 7febd0df9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febcc06c380 con 0x7febcc0b3570 2024-04-25T02:15:55.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.111+0000 7febd0df9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febcc0d1660 con 0x7febcc15e4d0 2024-04-25T02:15:55.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.111+0000 7febd0df9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7febcc0d1380 con 0x7febcc0d2e20 2024-04-25T02:15:55.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.112+0000 7febcad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7febcc0d2e20 0x7febcc0cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:55.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.112+0000 7febc9d9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7febcc0b3570 0x7febcc0d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46670/0 (socket says 172.21.15.79:46670) 2024-04-25T02:15:55.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.112+0000 7febc9d9b640 1 -- 172.21.15.79:0/218728336 learned_addr learned my addr 172.21.15.79:0/218728336 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:55.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.112+0000 7febcad9d640 1 -- 172.21.15.79:0/218728336 >> v1:172.21.15.189:6789/0 conn(0x7febcc15e4d0 legacy=0x7febcc06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:55.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.112+0000 7febcad9d640 1 -- 172.21.15.79:0/218728336 >> v1:172.21.15.79:6789/0 conn(0x7febcc0b3570 legacy=0x7febcc0d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.112+0000 7febcad9d640 1 -- 172.21.15.79:0/218728336 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febcc0cede0 con 0x7febcc0d2e20 2024-04-25T02:15:55.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.112+0000 7febc959a640 1 -- 172.21.15.79:0/218728336 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 854049738 0 0) 0x7febcc06c380 con 0x7febcc0b3570 2024-04-25T02:15:55.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.112+0000 7febcad9d640 1 --2- 172.21.15.79:0/218728336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febcc0d2e20 0x7febcc0cf5e0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7febbc0097d0 tx=0x7febbc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcc65b555250d06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:55.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.113+0000 7febc959a640 1 -- 172.21.15.79:0/218728336 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc037070 con 0x7febcc0d2e20 2024-04-25T02:15:55.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.113+0000 7febc959a640 1 -- 172.21.15.79:0/218728336 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febbc032440 con 0x7febcc0d2e20 2024-04-25T02:15:55.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.113+0000 7febc959a640 1 -- 172.21.15.79:0/218728336 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc032810 con 0x7febcc0d2e20 2024-04-25T02:15:55.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.113+0000 7febd0df9640 1 -- 172.21.15.79:0/218728336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febcc0d2e20 msgr2=0x7febcc0cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.113+0000 7febd0df9640 1 --2- 172.21.15.79:0/218728336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febcc0d2e20 0x7febcc0cf5e0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7febbc0097d0 tx=0x7febbc02a210 comp rx=0 tx=0).stop 2024-04-25T02:15:55.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.113+0000 7febd0df9640 1 -- 172.21.15.79:0/218728336 shutdown_connections 2024-04-25T02:15:55.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.113+0000 7febd0df9640 1 --2- 172.21.15.79:0/218728336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febcc0d2e20 0x7febcc0cf5e0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.113+0000 7febd0df9640 1 -- 172.21.15.79:0/218728336 >> 172.21.15.79:0/218728336 conn(0x7febcc09d460 msgr2=0x7febcc0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:55.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.113+0000 7febd0df9640 1 -- 172.21.15.79:0/218728336 shutdown_connections 2024-04-25T02:15:55.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.113+0000 7febd0df9640 1 -- 172.21.15.79:0/218728336 wait complete. 2024-04-25T02:15:55.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.115+0000 7febd0df9640 1 Processor -- start 2024-04-25T02:15:55.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.115+0000 7febd0df9640 1 -- start start 2024-04-25T02:15:55.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.115+0000 7febd0df9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febcc0b3570 0x7febcc15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.115+0000 7febd0df9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7febcc0d2e20 0x7febcc0ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.115+0000 7febd0df9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febcc15e4d0 0x7febcc0b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.115+0000 7febd0df9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7febcc0d20d0 con 0x7febcc15e4d0 2024-04-25T02:15:55.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.115+0000 7febd0df9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7febcc15e8b0 con 0x7febcc0d2e20 2024-04-25T02:15:55.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.115+0000 7febd0df9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7febcc0d2250 con 0x7febcc0b3570 2024-04-25T02:15:55.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.115+0000 7febcad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febcc15e4d0 0x7febcc0b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:55.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.115+0000 7febcad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febcc15e4d0 0x7febcc0b5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58782/0 (socket says 172.21.15.79:58782) 2024-04-25T02:15:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.115+0000 7febcad9d640 1 -- 172.21.15.79:0/612575825 learned_addr learned my addr 172.21.15.79:0/612575825 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.116+0000 7febcad9d640 1 -- 172.21.15.79:0/612575825 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febcc0b3570 msgr2=0x7febcc15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.116+0000 7febcad9d640 1 --2- 172.21.15.79:0/612575825 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febcc0b3570 0x7febcc15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.116+0000 7febcad9d640 1 -- 172.21.15.79:0/612575825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7febcc0d2e20 msgr2=0x7febcc0ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.116+0000 7febc9d9b640 1 --2- 172.21.15.79:0/612575825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7febcc0d2e20 0x7febcc0ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.116+0000 7febcad9d640 1 --2- 172.21.15.79:0/612575825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7febcc0d2e20 0x7febcc0ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.116+0000 7febcad9d640 1 -- 172.21.15.79:0/612575825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febcc0c8030 con 0x7febcc15e4d0 2024-04-25T02:15:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.116+0000 7febcad9d640 1 --2- 172.21.15.79:0/612575825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febcc15e4d0 0x7febcc0b5cc0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7febbc0097d0 tx=0x7febbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.116+0000 7febc2ffd640 1 -- 172.21.15.79:0/612575825 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc037040 con 0x7febcc15e4d0 2024-04-25T02:15:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.116+0000 7febc2ffd640 1 -- 172.21.15.79:0/612575825 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febbc004230 con 0x7febcc15e4d0 2024-04-25T02:15:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.116+0000 7febd0df9640 1 -- 172.21.15.79:0/612575825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febcc0c8310 con 0x7febcc15e4d0 2024-04-25T02:15:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.116+0000 7febc2ffd640 1 -- 172.21.15.79:0/612575825 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc03c670 con 0x7febcc15e4d0 2024-04-25T02:15:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.116+0000 7febd0df9640 1 -- 172.21.15.79:0/612575825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febcc0c88d0 con 0x7febcc15e4d0 2024-04-25T02:15:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.117+0000 7febd0df9640 1 -- 172.21.15.79:0/612575825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febcc0690a0 con 0x7febcc15e4d0 2024-04-25T02:15:55.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.117+0000 7febc2ffd640 1 -- 172.21.15.79:0/612575825 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febbc03a070 con 0x7febcc15e4d0 2024-04-25T02:15:55.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.118+0000 7febc2ffd640 1 --2- 172.21.15.79:0/612575825 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7febac06be30 0x7febac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.118+0000 7febc2ffd640 1 -- 172.21.15.79:0/612575825 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 4857+0+0 (secure 0 0 0) 0x7febbc0ab3d0 con 0x7febcc15e4d0 2024-04-25T02:15:55.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.118+0000 7febca59c640 1 --2- 172.21.15.79:0/612575825 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7febac06be30 0x7febac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:55.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.118+0000 7febca59c640 1 --2- 172.21.15.79:0/612575825 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7febac06be30 0x7febac06e2f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7febc400abb0 tx=0x7febc4009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:55.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.122+0000 7febc2ffd640 1 -- 172.21.15.79:0/612575825 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7febbc041020 con 0x7febcc15e4d0 2024-04-25T02:15:55.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.366+0000 7febd0df9640 1 -- 172.21.15.79:0/612575825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7febcc0ce330 con 0x7febcc15e4d0 2024-04-25T02:15:55.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.366+0000 7febc2ffd640 1 -- 172.21.15.79:0/612575825 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7febbc07a160 con 0x7febcc15e4d0 2024-04-25T02:15:55.371 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:55.371 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:15:55.372 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2024-04-25T02:15:55.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.372 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2024-04-25T02:15:55.372 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmkSfsJhAAEP9aqirUawsrrvVUkxkO0w==", 2024-04-25T02:15:55.372 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.372 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:15:55.372 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:15:55.372 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:15:55.372 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:15:55.372 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.372 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2024-04-25T02:15:55.373 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilm8wYYMhAA98c3h9c80Y9zYzVv+kY7qQ==", 2024-04-25T02:15:55.373 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.373 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:15:55.373 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:15:55.373 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:15:55.373 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:15:55.373 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.373 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2024-04-25T02:15:55.373 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmiqSiLRAAmCUWUrHC31tkg0dkXS54cA==", 2024-04-25T02:15:55.373 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.373 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:15:55.373 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:15:55.373 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:15:55.374 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:15:55.374 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.374 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2024-04-25T02:15:55.374 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmiPbkOBAA+rBwAypY5jrR3xafG9h1sw==", 2024-04-25T02:15:55.374 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.374 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:15:55.374 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:15:55.374 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:15:55.374 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:15:55.374 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDJuilmP1AdGBAAS0IkH2E3XQvkxA33GInm5w==", 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDMuilm479HFhAA8iIjBC94pqHikS5kPHipCQ==", 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:15:55.375 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:15:55.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.376 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2024-04-25T02:15:55.376 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDPuilmE+k9FBAARX3P/kjt7ybeVHGGyYaWwg==", 2024-04-25T02:15:55.376 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.376 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:15:55.376 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:15:55.376 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:15:55.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.376 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2024-04-25T02:15:55.376 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDSuilmUF41EhAA1HhTXWnhVwETe+4hxmxjFw==", 2024-04-25T02:15:55.376 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.377 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:15:55.377 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:15:55.377 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:15:55.377 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.377 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2024-04-25T02:15:55.377 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDYuilm2pisGRAAFBmWVAGib2guJobYooLQoA==", 2024-04-25T02:15:55.377 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.377 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:15:55.378 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:15:55.378 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:15:55.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.378 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2024-04-25T02:15:55.378 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDbuilm28m9FxAA8GOmzxRAlK6o/RTe+FpL7g==", 2024-04-25T02:15:55.378 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.378 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:15:55.378 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:15:55.378 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:15:55.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.379 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2024-04-25T02:15:55.379 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDeuilmzDRyFRAAKk7JWPVRxxE+B4OCJhaXvg==", 2024-04-25T02:15:55.379 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.379 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:15:55.379 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:15:55.379 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:15:55.379 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.379 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2024-04-25T02:15:55.379 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDhuilmQABhExAA40Inq4eg4oohO3tmNdCyPQ==", 2024-04-25T02:15:55.379 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.379 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:15:55.379 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:15:55.379 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:15:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2024-04-25T02:15:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g==", 2024-04-25T02:15:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:15:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2024-04-25T02:15:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T02:15:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2024-04-25T02:15:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilm8EWZCRAAjRomNRANd7sC+tpYZ1uE6w==", 2024-04-25T02:15:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmHUedBhAA84h2PNUgReBGQ3rubcEDsw==", 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.382 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2024-04-25T02:15:55.382 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmCx4UDxAAZmQdQB8RdTMr2JKr7TMySg==", 2024-04-25T02:15:55.382 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.382 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:15:55.382 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:15:55.382 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:15:55.382 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:15:55.382 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.382 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2024-04-25T02:15:55.383 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmFgdeDBAAu+VeVhknKsm+Gxzh5+qANg==", 2024-04-25T02:15:55.383 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.383 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:15:55.383 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:15:55.383 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:15:55.383 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:15:55.383 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.383 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2024-04-25T02:15:55.383 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmXrLhIxAAiq13px9HksQtu+qjoRi1qQ==", 2024-04-25T02:15:55.383 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.383 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:15:55.384 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-04-25T02:15:55.384 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:15:55.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:15:55.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:55.384 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2024-04-25T02:15:55.384 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmV8dxIBAA8GX2T/ZqZF+3qDjtddh/ZQ==", 2024-04-25T02:15:55.384 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:15:55.384 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:15:55.384 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-04-25T02:15:55.384 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:15:55.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:55.384 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T02:15:55.384 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:15:55.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.368+0000 7febd0df9640 1 -- 172.21.15.79:0/612575825 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7febac06be30 msgr2=0x7febac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.368+0000 7febd0df9640 1 --2- 172.21.15.79:0/612575825 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7febac06be30 0x7febac06e2f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7febc400abb0 tx=0x7febc4009250 comp rx=0 tx=0).stop 2024-04-25T02:15:55.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.368+0000 7febd0df9640 1 -- 172.21.15.79:0/612575825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febcc15e4d0 msgr2=0x7febcc0b5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.368+0000 7febd0df9640 1 --2- 172.21.15.79:0/612575825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febcc15e4d0 0x7febcc0b5cc0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7febbc0097d0 tx=0x7febbc0046c0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.368+0000 7febd0df9640 1 -- 172.21.15.79:0/612575825 shutdown_connections 2024-04-25T02:15:55.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.368+0000 7febd0df9640 1 --2- 172.21.15.79:0/612575825 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7febac06be30 0x7febac06e2f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.368+0000 7febd0df9640 1 --2- 172.21.15.79:0/612575825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febcc15e4d0 0x7febcc0b5cc0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.368+0000 7febd0df9640 1 --2- 172.21.15.79:0/612575825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7febcc0d2e20 0x7febcc0ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.368+0000 7febd0df9640 1 --2- 172.21.15.79:0/612575825 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febcc0b3570 0x7febcc15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.368+0000 7febd0df9640 1 -- 172.21.15.79:0/612575825 >> 172.21.15.79:0/612575825 conn(0x7febcc09d460 msgr2=0x7febcc0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:55.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.368+0000 7febd0df9640 1 -- 172.21.15.79:0/612575825 shutdown_connections 2024-04-25T02:15:55.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.368+0000 7febd0df9640 1 -- 172.21.15.79:0/612575825 wait complete. 2024-04-25T02:15:55.389 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:15:55.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.479+0000 7ff55cff9640 1 Processor -- start 2024-04-25T02:15:55.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.479+0000 7ff55cff9640 1 -- start start 2024-04-25T02:15:55.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.480+0000 7ff55cff9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff558143bc0 0x7ff55815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.480+0000 7ff55cff9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff55806df50 0x7ff55806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.480+0000 7ff55cff9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff55815fa40 con 0x7ff5580b48e0 2024-04-25T02:15:55.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.480+0000 7ff55cff9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff55806e8f0 con 0x7ff558143bc0 2024-04-25T02:15:55.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.480+0000 7ff55cff9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff558072cb0 con 0x7ff55806df50 2024-04-25T02:15:55.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.480+0000 7ff55659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff558143bc0 0x7ff55815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:55.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.481+0000 7ff55659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff558143bc0 0x7ff55815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58796/0 (socket says 172.21.15.79:58796) 2024-04-25T02:15:55.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.481+0000 7ff55659c640 1 -- 172.21.15.79:0/862026521 learned_addr learned my addr 172.21.15.79:0/862026521 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:55.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.481+0000 7ff55659c640 1 -- 172.21.15.79:0/862026521 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff55806df50 msgr2=0x7ff55806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:55.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.481+0000 7ff55659c640 1 --2- 172.21.15.79:0/862026521 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff55806df50 0x7ff55806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.481+0000 7ff55659c640 1 -- 172.21.15.79:0/862026521 >> v1:172.21.15.189:6789/0 conn(0x7ff5580b48e0 legacy=0x7ff5580b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:55.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.481+0000 7ff55659c640 1 -- 172.21.15.79:0/862026521 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff558071e00 con 0x7ff558143bc0 2024-04-25T02:15:55.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.481+0000 7ff55659c640 1 --2- 172.21.15.79:0/862026521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff558143bc0 0x7ff55815f500 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7ff550009e50 tx=0x7ff55002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd3b4f3e0ce9c82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:55.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.482+0000 7ff55559a640 1 -- 172.21.15.79:0/862026521 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff550036070 con 0x7ff558143bc0 2024-04-25T02:15:55.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.482+0000 7ff55559a640 1 -- 172.21.15.79:0/862026521 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff550031600 con 0x7ff558143bc0 2024-04-25T02:15:55.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.482+0000 7ff55559a640 1 -- 172.21.15.79:0/862026521 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5500319d0 con 0x7ff558143bc0 2024-04-25T02:15:55.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.482+0000 7ff55cff9640 1 -- 172.21.15.79:0/862026521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff558143bc0 msgr2=0x7ff55815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.482+0000 7ff55cff9640 1 --2- 172.21.15.79:0/862026521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff558143bc0 0x7ff55815f500 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7ff550009e50 tx=0x7ff55002a630 comp rx=0 tx=0).stop 2024-04-25T02:15:55.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.482+0000 7ff55cff9640 1 -- 172.21.15.79:0/862026521 shutdown_connections 2024-04-25T02:15:55.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.482+0000 7ff55cff9640 1 --2- 172.21.15.79:0/862026521 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff55806df50 0x7ff55806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.482+0000 7ff55cff9640 1 --2- 172.21.15.79:0/862026521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff558143bc0 0x7ff55815f500 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.482+0000 7ff55cff9640 1 -- 172.21.15.79:0/862026521 >> 172.21.15.79:0/862026521 conn(0x7ff5580cfc80 msgr2=0x7ff5580d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:55.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.482+0000 7ff55cff9640 1 -- 172.21.15.79:0/862026521 shutdown_connections 2024-04-25T02:15:55.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.482+0000 7ff55cff9640 1 -- 172.21.15.79:0/862026521 wait complete. 2024-04-25T02:15:55.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.483+0000 7ff55cff9640 1 Processor -- start 2024-04-25T02:15:55.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.484+0000 7ff55cff9640 1 -- start start 2024-04-25T02:15:55.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.484+0000 7ff55cff9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff55806df50 0x7ff5581e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.484+0000 7ff55cff9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff5580b48e0 0x7ff5581e53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.484+0000 7ff55cff9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff558143bc0 0x7ff5581f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.484+0000 7ff55cff9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff558072660 con 0x7ff558143bc0 2024-04-25T02:15:55.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.484+0000 7ff55cff9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff558072380 con 0x7ff5580b48e0 2024-04-25T02:15:55.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.484+0000 7ff55cff9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff558072940 con 0x7ff55806df50 2024-04-25T02:15:55.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.484+0000 7ff556d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff558143bc0 0x7ff5581f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:55.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.484+0000 7ff556d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff558143bc0 0x7ff5581f58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58812/0 (socket says 172.21.15.79:58812) 2024-04-25T02:15:55.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.484+0000 7ff556d9d640 1 -- 172.21.15.79:0/3355215709 learned_addr learned my addr 172.21.15.79:0/3355215709 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:55.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.485+0000 7ff55659c640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff55806df50 0x7ff5581e73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:55.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.485+0000 7ff555d9b640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff5580b48e0 0x7ff5581e53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:55.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.485+0000 7ff556d9d640 1 -- 172.21.15.79:0/3355215709 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff55806df50 msgr2=0x7ff5581e73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.485+0000 7ff556d9d640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff55806df50 0x7ff5581e73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.485+0000 7ff556d9d640 1 -- 172.21.15.79:0/3355215709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff5580b48e0 msgr2=0x7ff5581e53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.485+0000 7ff556d9d640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff5580b48e0 0x7ff5581e53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.485+0000 7ff556d9d640 1 -- 172.21.15.79:0/3355215709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5581e6060 con 0x7ff558143bc0 2024-04-25T02:15:55.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.485+0000 7ff55659c640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff55806df50 0x7ff5581e73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:55.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.485+0000 7ff555d9b640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff5580b48e0 0x7ff5581e53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:55.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.485+0000 7ff556d9d640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff558143bc0 0x7ff5581f58c0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff54800b490 tx=0x7ff54800b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:55.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.485+0000 7ff54effd640 1 -- 172.21.15.79:0/3355215709 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548015020 con 0x7ff558143bc0 2024-04-25T02:15:55.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.485+0000 7ff54effd640 1 -- 172.21.15.79:0/3355215709 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff548011850 con 0x7ff558143bc0 2024-04-25T02:15:55.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.485+0000 7ff55cff9640 1 -- 172.21.15.79:0/3355215709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5581e6340 con 0x7ff558143bc0 2024-04-25T02:15:55.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.485+0000 7ff54effd640 1 -- 172.21.15.79:0/3355215709 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548011c40 con 0x7ff558143bc0 2024-04-25T02:15:55.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.485+0000 7ff55cff9640 1 -- 172.21.15.79:0/3355215709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5581e6be0 con 0x7ff558143bc0 2024-04-25T02:15:55.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.486+0000 7ff55cff9640 1 -- 172.21.15.79:0/3355215709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5580690a0 con 0x7ff558143bc0 2024-04-25T02:15:55.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.487+0000 7ff54effd640 1 -- 172.21.15.79:0/3355215709 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff548018020 con 0x7ff558143bc0 2024-04-25T02:15:55.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.487+0000 7ff54effd640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff53806be30 0x7ff53806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.487+0000 7ff54effd640 1 -- 172.21.15.79:0/3355215709 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 4857+0+0 (secure 0 0 0) 0x7ff54808aa20 con 0x7ff558143bc0 2024-04-25T02:15:55.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.487+0000 7ff55659c640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff53806be30 0x7ff53806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:55.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.487+0000 7ff55659c640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff53806be30 0x7ff53806e2f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff550033000 tx=0x7ff550009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:55.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.491+0000 7ff54effd640 1 -- 172.21.15.79:0/3355215709 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff54801f020 con 0x7ff558143bc0 2024-04-25T02:15:55.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.666+0000 7ff55cff9640 1 -- 172.21.15.79:0/3355215709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5581423a0 con 0x7ff558143bc0 2024-04-25T02:15:55.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.667+0000 7ff54effd640 1 -- 172.21.15.79:0/3355215709 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+12904 (secure 0 0 0) 0x7ff5480172c0 con 0x7ff558143bc0 2024-04-25T02:15:55.672 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:55.672 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":98,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:15:54.994180+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:15:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.669+0000 7ff55cff9640 1 -- 172.21.15.79:0/3355215709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff53806be30 msgr2=0x7ff53806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.669+0000 7ff55cff9640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff53806be30 0x7ff53806e2f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff550033000 tx=0x7ff550009000 comp rx=0 tx=0).stop 2024-04-25T02:15:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.669+0000 7ff55cff9640 1 -- 172.21.15.79:0/3355215709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff558143bc0 msgr2=0x7ff5581f58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.669+0000 7ff55cff9640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff558143bc0 0x7ff5581f58c0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff54800b490 tx=0x7ff54800b950 comp rx=0 tx=0).stop 2024-04-25T02:15:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.669+0000 7ff55cff9640 1 -- 172.21.15.79:0/3355215709 shutdown_connections 2024-04-25T02:15:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.669+0000 7ff55cff9640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff53806be30 0x7ff53806e2f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.669+0000 7ff55cff9640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff558143bc0 0x7ff5581f58c0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.669+0000 7ff55cff9640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff5580b48e0 0x7ff5581e53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.669+0000 7ff55cff9640 1 --2- 172.21.15.79:0/3355215709 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff55806df50 0x7ff5581e73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.669+0000 7ff55cff9640 1 -- 172.21.15.79:0/3355215709 >> 172.21.15.79:0/3355215709 conn(0x7ff5580cfc80 msgr2=0x7ff5580cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.669+0000 7ff55cff9640 1 -- 172.21.15.79:0/3355215709 shutdown_connections 2024-04-25T02:15:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.669+0000 7ff55cff9640 1 -- 172.21.15.79:0/3355215709 wait complete. 2024-04-25T02:15:55.685 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:15:55.685 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:15:55.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.781+0000 7f1b95930640 1 Processor -- start 2024-04-25T02:15:55.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.781+0000 7f1b95930640 1 -- start start 2024-04-25T02:15:55.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.781+0000 7f1b95930640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b900b5610 0x7f1b900d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.781+0000 7f1b95930640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b900d2970 0x7f1b900b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.781+0000 7f1b95930640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b900cf5f0 con 0x7f1b9015e6d0 2024-04-25T02:15:55.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.781+0000 7f1b95930640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1b900cf8d0 con 0x7f1b900d2970 2024-04-25T02:15:55.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.781+0000 7f1b95930640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1b900cfbb0 con 0x7f1b900b5610 2024-04-25T02:15:55.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.782+0000 7f1b8f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b900d2970 0x7f1b900b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:55.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.782+0000 7f1b8effd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1b9015e6d0 0x7f1b900cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46686/0 (socket says 172.21.15.79:46686) 2024-04-25T02:15:55.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.782+0000 7f1b8effd640 1 -- 172.21.15.79:0/2942015565 learned_addr learned my addr 172.21.15.79:0/2942015565 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:55.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.782+0000 7f1b8f7fe640 1 -- 172.21.15.79:0/2942015565 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b900b5610 msgr2=0x7f1b900d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:55.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.782+0000 7f1b8e7fc640 1 --2- 172.21.15.79:0/2942015565 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b900b5610 0x7f1b900d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:55.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.782+0000 7f1b8f7fe640 1 --2- 172.21.15.79:0/2942015565 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b900b5610 0x7f1b900d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.782+0000 7f1b8dffb640 1 -- 172.21.15.79:0/2942015565 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1962093384 0 0) 0x7f1b900cf5f0 con 0x7f1b9015e6d0 2024-04-25T02:15:55.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.782+0000 7f1b8f7fe640 1 -- 172.21.15.79:0/2942015565 >> v1:172.21.15.79:6789/0 conn(0x7f1b9015e6d0 legacy=0x7f1b900cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.782+0000 7f1b8f7fe640 1 -- 172.21.15.79:0/2942015565 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b900cfe90 con 0x7f1b900d2970 2024-04-25T02:15:55.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.782+0000 7f1b8e7fc640 1 --2- 172.21.15.79:0/2942015565 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b900b5610 0x7f1b900d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:55.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.783+0000 7f1b8f7fe640 1 --2- 172.21.15.79:0/2942015565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b900d2970 0x7f1b900b3780 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f1b88009d90 tx=0x7f1b8802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5178f2fe72137d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:55.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.783+0000 7f1b8dffb640 1 -- 172.21.15.79:0/2942015565 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88007740 con 0x7f1b900d2970 2024-04-25T02:15:55.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.783+0000 7f1b8dffb640 1 -- 172.21.15.79:0/2942015565 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b880078e0 con 0x7f1b900d2970 2024-04-25T02:15:55.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.783+0000 7f1b8dffb640 1 -- 172.21.15.79:0/2942015565 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88007cb0 con 0x7f1b900d2970 2024-04-25T02:15:55.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.783+0000 7f1b95930640 1 -- 172.21.15.79:0/2942015565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b900d2970 msgr2=0x7f1b900b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.783+0000 7f1b95930640 1 --2- 172.21.15.79:0/2942015565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b900d2970 0x7f1b900b3780 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f1b88009d90 tx=0x7f1b8802a660 comp rx=0 tx=0).stop 2024-04-25T02:15:55.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.783+0000 7f1b95930640 1 -- 172.21.15.79:0/2942015565 shutdown_connections 2024-04-25T02:15:55.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.783+0000 7f1b95930640 1 --2- 172.21.15.79:0/2942015565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b900d2970 0x7f1b900b3780 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.783+0000 7f1b95930640 1 --2- 172.21.15.79:0/2942015565 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b900b5610 0x7f1b900d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.783+0000 7f1b95930640 1 -- 172.21.15.79:0/2942015565 >> 172.21.15.79:0/2942015565 conn(0x7f1b9009d3e0 msgr2=0x7f1b900d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:55.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.783+0000 7f1b95930640 1 -- 172.21.15.79:0/2942015565 shutdown_connections 2024-04-25T02:15:55.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.783+0000 7f1b95930640 1 -- 172.21.15.79:0/2942015565 wait complete. 2024-04-25T02:15:55.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.784+0000 7f1b95930640 1 Processor -- start 2024-04-25T02:15:55.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.785+0000 7f1b95930640 1 -- start start 2024-04-25T02:15:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.785+0000 7f1b95930640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b900b5610 0x7f1b900ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.785+0000 7f1b95930640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b900d2970 0x7f1b901f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.785+0000 7f1b95930640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9015e6d0 0x7f1b90156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.785+0000 7f1b95930640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b900b3cc0 con 0x7f1b9015e6d0 2024-04-25T02:15:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.785+0000 7f1b95930640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9015eab0 con 0x7f1b900b5610 2024-04-25T02:15:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.785+0000 7f1b95930640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1b900b3e40 con 0x7f1b900d2970 2024-04-25T02:15:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.785+0000 7f1b8f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9015e6d0 0x7f1b90156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.785+0000 7f1b8f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9015e6d0 0x7f1b90156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58830/0 (socket says 172.21.15.79:58830) 2024-04-25T02:15:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.785+0000 7f1b8f7fe640 1 -- 172.21.15.79:0/959496387 learned_addr learned my addr 172.21.15.79:0/959496387 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.786+0000 7f1b8e7fc640 1 --2- 172.21.15.79:0/959496387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b900d2970 0x7f1b901f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.786+0000 7f1b8effd640 1 --2- 172.21.15.79:0/959496387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b900b5610 0x7f1b900ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.786+0000 7f1b8f7fe640 1 -- 172.21.15.79:0/959496387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b900d2970 msgr2=0x7f1b901f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.786+0000 7f1b8f7fe640 1 --2- 172.21.15.79:0/959496387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b900d2970 0x7f1b901f3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.786+0000 7f1b8f7fe640 1 -- 172.21.15.79:0/959496387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b900b5610 msgr2=0x7f1b900ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.786+0000 7f1b8f7fe640 1 --2- 172.21.15.79:0/959496387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b900b5610 0x7f1b900ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.786+0000 7f1b8f7fe640 1 -- 172.21.15.79:0/959496387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b900c7c60 con 0x7f1b9015e6d0 2024-04-25T02:15:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.786+0000 7f1b8f7fe640 1 --2- 172.21.15.79:0/959496387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9015e6d0 0x7f1b90156020 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f1b8802ac50 tx=0x7f1b88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.786+0000 7f1b77fff640 1 -- 172.21.15.79:0/959496387 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88040070 con 0x7f1b9015e6d0 2024-04-25T02:15:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.786+0000 7f1b77fff640 1 -- 172.21.15.79:0/959496387 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b88031c40 con 0x7f1b9015e6d0 2024-04-25T02:15:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.786+0000 7f1b95930640 1 -- 172.21.15.79:0/959496387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b900c7f00 con 0x7f1b9015e6d0 2024-04-25T02:15:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.786+0000 7f1b77fff640 1 -- 172.21.15.79:0/959496387 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88003990 con 0x7f1b9015e6d0 2024-04-25T02:15:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.786+0000 7f1b95930640 1 -- 172.21.15.79:0/959496387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b900c84c0 con 0x7f1b9015e6d0 2024-04-25T02:15:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.787+0000 7f1b95930640 1 -- 172.21.15.79:0/959496387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b900690a0 con 0x7f1b9015e6d0 2024-04-25T02:15:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.787+0000 7f1b77fff640 1 -- 172.21.15.79:0/959496387 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b88039040 con 0x7f1b9015e6d0 2024-04-25T02:15:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.788+0000 7f1b77fff640 1 --2- 172.21.15.79:0/959496387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b7c06be30 0x7f1b7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.788+0000 7f1b77fff640 1 -- 172.21.15.79:0/959496387 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 4857+0+0 (secure 0 0 0) 0x7f1b880abe70 con 0x7f1b9015e6d0 2024-04-25T02:15:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.788+0000 7f1b8effd640 1 --2- 172.21.15.79:0/959496387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b7c06be30 0x7f1b7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:55.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.788+0000 7f1b8effd640 1 --2- 172.21.15.79:0/959496387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b7c06be30 0x7f1b7c06e2f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1b80000f60 tx=0x7f1b80007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:55.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.792+0000 7f1b77fff640 1 -- 172.21.15.79:0/959496387 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1b8807ab70 con 0x7f1b9015e6d0 2024-04-25T02:15:55.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.965+0000 7f1b95930640 1 -- 172.21.15.79:0/959496387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1b900b3110 con 0x7f1b9015e6d0 2024-04-25T02:15:55.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.966+0000 7f1b77fff640 1 -- 172.21.15.79:0/959496387 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) ==== 93+0+10 (secure 0 0 0) 0x7f1b8807a470 con 0x7f1b9015e6d0 2024-04-25T02:15:55.971 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:15:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.967+0000 7f1b95930640 1 -- 172.21.15.79:0/959496387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b7c06be30 msgr2=0x7f1b7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.967+0000 7f1b95930640 1 --2- 172.21.15.79:0/959496387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b7c06be30 0x7f1b7c06e2f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1b80000f60 tx=0x7f1b80007c00 comp rx=0 tx=0).stop 2024-04-25T02:15:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.967+0000 7f1b95930640 1 -- 172.21.15.79:0/959496387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9015e6d0 msgr2=0x7f1b90156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.967+0000 7f1b95930640 1 --2- 172.21.15.79:0/959496387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9015e6d0 0x7f1b90156020 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f1b8802ac50 tx=0x7f1b88004a40 comp rx=0 tx=0).stop 2024-04-25T02:15:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.967+0000 7f1b95930640 1 -- 172.21.15.79:0/959496387 shutdown_connections 2024-04-25T02:15:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.967+0000 7f1b95930640 1 --2- 172.21.15.79:0/959496387 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1b7c06be30 0x7f1b7c06e2f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.967+0000 7f1b95930640 1 --2- 172.21.15.79:0/959496387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9015e6d0 0x7f1b90156020 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.967+0000 7f1b95930640 1 --2- 172.21.15.79:0/959496387 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b900d2970 0x7f1b901f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.967+0000 7f1b95930640 1 --2- 172.21.15.79:0/959496387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b900b5610 0x7f1b900ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.968+0000 7f1b95930640 1 -- 172.21.15.79:0/959496387 >> 172.21.15.79:0/959496387 conn(0x7f1b9009d3e0 msgr2=0x7f1b900b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.968+0000 7f1b95930640 1 -- 172.21.15.79:0/959496387 shutdown_connections 2024-04-25T02:15:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:55.968+0000 7f1b95930640 1 -- 172.21.15.79:0/959496387 wait complete. 2024-04-25T02:15:55.984 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T02:15:56.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.075+0000 7ff6feda2640 1 Processor -- start 2024-04-25T02:15:56.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.075+0000 7ff6feda2640 1 -- start start 2024-04-25T02:15:56.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6feda2640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff6f806df50 0x7ff6f806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:56.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6feda2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6f8070d90 con 0x7ff6f8071240 2024-04-25T02:15:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6feda2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6f80cf130 con 0x7ff6f8144cb0 2024-04-25T02:15:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6feda2640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff6f80cf410 con 0x7ff6f806df50 2024-04-25T02:15:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6fd33f640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff6f8071240 0x7ff6f8071670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46696/0 (socket says 172.21.15.79:46696) 2024-04-25T02:15:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6fd33f640 1 -- 172.21.15.79:0/3579990438 learned_addr learned my addr 172.21.15.79:0/3579990438 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f7fff640 1 --2- 172.21.15.79:0/3579990438 >> v2:172.21.15.189:3300/0 conn(0x7ff6f806df50 0x7ff6f806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f77fe640 1 -- 172.21.15.79:0/3579990438 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4169096284 0 0) 0x7ff6f8070d90 con 0x7ff6f8071240 2024-04-25T02:15:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f77fe640 1 -- 172.21.15.79:0/3579990438 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6e8003520 con 0x7ff6f8071240 2024-04-25T02:15:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f77fe640 1 -- 172.21.15.79:0/3579990438 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4091010200 0 0) 0x7ff6e8003520 con 0x7ff6f8071240 2024-04-25T02:15:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f77fe640 1 -- 172.21.15.79:0/3579990438 >> v2:172.21.15.189:3300/0 conn(0x7ff6f806df50 msgr2=0x7ff6f806e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f77fe640 1 --2- 172.21.15.79:0/3579990438 >> v2:172.21.15.189:3300/0 conn(0x7ff6f806df50 0x7ff6f806e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f77fe640 1 -- 172.21.15.79:0/3579990438 >> v1:172.21.15.189:6789/0 conn(0x7ff6f8144cb0 legacy=0x7ff6f80b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f77fe640 1 -- 172.21.15.79:0/3579990438 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f80cf6f0 con 0x7ff6f8071240 2024-04-25T02:15:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f77fe640 1 -- 172.21.15.79:0/3579990438 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7ff6f00019f0 con 0x7ff6f8071240 2024-04-25T02:15:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f77fe640 1 -- 172.21.15.79:0/3579990438 >> v1:172.21.15.79:6789/0 conn(0x7ff6f8071240 legacy=0x7ff6f8071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f77fe640 1 --2- 172.21.15.79:0/3579990438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e80039b0 0x7ff6e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f77fe640 1 --2- 172.21.15.79:0/3579990438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6e8004800 0x7ff6e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f77fe640 1 --2- 172.21.15.79:0/3579990438 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6e80052e0 0x7ff6e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f77fe640 1 -- 172.21.15.79:0/3579990438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f80cf410 con 0x7ff6e80039b0 2024-04-25T02:15:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f77fe640 1 -- 172.21.15.79:0/3579990438 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e800c1b0 con 0x7ff6e8004800 2024-04-25T02:15:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6f77fe640 1 -- 172.21.15.79:0/3579990438 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e800c3b0 con 0x7ff6e80052e0 2024-04-25T02:15:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.076+0000 7ff6fcb3e640 1 --2- 172.21.15.79:0/3579990438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e80039b0 0x7ff6e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.077+0000 7ff6f7fff640 1 --2- 172.21.15.79:0/3579990438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6e8004800 0x7ff6e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.077+0000 7ff6fd33f640 1 --2- 172.21.15.79:0/3579990438 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6e80052e0 0x7ff6e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.077+0000 7ff6fcb3e640 1 -- 172.21.15.79:0/3579990438 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6e80052e0 msgr2=0x7ff6e800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.077+0000 7ff6fcb3e640 1 --2- 172.21.15.79:0/3579990438 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6e80052e0 0x7ff6e800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.077+0000 7ff6fcb3e640 1 -- 172.21.15.79:0/3579990438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6e8004800 msgr2=0x7ff6e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.077+0000 7ff6fcb3e640 1 --2- 172.21.15.79:0/3579990438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6e8004800 0x7ff6e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.077+0000 7ff6fcb3e640 1 -- 172.21.15.79:0/3579990438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e8003520 con 0x7ff6e80039b0 2024-04-25T02:15:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.077+0000 7ff6fd33f640 1 --2- 172.21.15.79:0/3579990438 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6e80052e0 0x7ff6e800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.077+0000 7ff6fd33f640 1 -- 172.21.15.79:0/3579990438 reap_dead start 2024-04-25T02:15:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.078+0000 7ff6fcb3e640 1 --2- 172.21.15.79:0/3579990438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e80039b0 0x7ff6e8003dd0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec001720 tx=0x7ff6e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331682ba4967f11d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.078+0000 7ff6f77fe640 1 -- 172.21.15.79:0/3579990438 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec001370 con 0x7ff6e80039b0 2024-04-25T02:15:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.078+0000 7ff6f77fe640 1 -- 172.21.15.79:0/3579990438 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ec0052d0 con 0x7ff6e80039b0 2024-04-25T02:15:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.078+0000 7ff6f77fe640 1 -- 172.21.15.79:0/3579990438 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec02ab70 con 0x7ff6e80039b0 2024-04-25T02:15:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.078+0000 7ff6feda2640 1 -- 172.21.15.79:0/3579990438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e80039b0 msgr2=0x7ff6e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.078+0000 7ff6feda2640 1 --2- 172.21.15.79:0/3579990438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e80039b0 0x7ff6e8003dd0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec001720 tx=0x7ff6e8005830 comp rx=0 tx=0).stop 2024-04-25T02:15:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.078+0000 7ff6feda2640 1 -- 172.21.15.79:0/3579990438 shutdown_connections 2024-04-25T02:15:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.078+0000 7ff6feda2640 1 --2- 172.21.15.79:0/3579990438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e80039b0 0x7ff6e8003dd0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.078+0000 7ff6feda2640 1 -- 172.21.15.79:0/3579990438 >> 172.21.15.79:0/3579990438 conn(0x7ff6f80cfc80 msgr2=0x7ff6f80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.078+0000 7ff6feda2640 1 -- 172.21.15.79:0/3579990438 shutdown_connections 2024-04-25T02:15:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.078+0000 7ff6feda2640 1 -- 172.21.15.79:0/3579990438 wait complete. 2024-04-25T02:15:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.079+0000 7ff6feda2640 1 Processor -- start 2024-04-25T02:15:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.079+0000 7ff6feda2640 1 -- start start 2024-04-25T02:15:56.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.080+0000 7ff6feda2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6e80039b0 0x7ff6f8155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:56.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.080+0000 7ff6feda2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6f8133fc0 0x7ff6f80b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:56.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.080+0000 7ff6feda2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f8134420 0x7ff6f80b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:56.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.080+0000 7ff6feda2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f8145ab0 con 0x7ff6f8134420 2024-04-25T02:15:56.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.080+0000 7ff6feda2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f8145090 con 0x7ff6f8133fc0 2024-04-25T02:15:56.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.080+0000 7ff6feda2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f8145c30 con 0x7ff6e80039b0 2024-04-25T02:15:56.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.080+0000 7ff6fd33f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f8134420 0x7ff6f80b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.080+0000 7ff6fd33f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f8134420 0x7ff6f80b1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58856/0 (socket says 172.21.15.79:58856) 2024-04-25T02:15:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.080+0000 7ff6fd33f640 1 -- 172.21.15.79:0/2251571281 learned_addr learned my addr 172.21.15.79:0/2251571281 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.080+0000 7ff6fcb3e640 1 --2- 172.21.15.79:0/2251571281 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6e80039b0 0x7ff6f8155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.081+0000 7ff6f7fff640 1 --2- 172.21.15.79:0/2251571281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6f8133fc0 0x7ff6f80b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.081+0000 7ff6fd33f640 1 -- 172.21.15.79:0/2251571281 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6e80039b0 msgr2=0x7ff6f8155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.081+0000 7ff6fd33f640 1 --2- 172.21.15.79:0/2251571281 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6e80039b0 0x7ff6f8155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.081+0000 7ff6fd33f640 1 -- 172.21.15.79:0/2251571281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6f8133fc0 msgr2=0x7ff6f80b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.081+0000 7ff6fd33f640 1 --2- 172.21.15.79:0/2251571281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6f8133fc0 0x7ff6f80b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.081+0000 7ff6fd33f640 1 -- 172.21.15.79:0/2251571281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f8132f20 con 0x7ff6f8134420 2024-04-25T02:15:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.081+0000 7ff6fd33f640 1 --2- 172.21.15.79:0/2251571281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f8134420 0x7ff6f80b1120 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7ff6f806f8a0 tx=0x7ff6f000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.081+0000 7ff6f57fa640 1 -- 172.21.15.79:0/2251571281 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f000eb90 con 0x7ff6f8134420 2024-04-25T02:15:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.081+0000 7ff6f57fa640 1 -- 172.21.15.79:0/2251571281 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f0018070 con 0x7ff6f8134420 2024-04-25T02:15:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.081+0000 7ff6feda2640 1 -- 172.21.15.79:0/2251571281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f8133200 con 0x7ff6f8134420 2024-04-25T02:15:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.081+0000 7ff6f57fa640 1 -- 172.21.15.79:0/2251571281 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0013420 con 0x7ff6f8134420 2024-04-25T02:15:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.081+0000 7ff6feda2640 1 -- 172.21.15.79:0/2251571281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f81337c0 con 0x7ff6f8134420 2024-04-25T02:15:56.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.082+0000 7ff6feda2640 1 -- 172.21.15.79:0/2251571281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f80690a0 con 0x7ff6f8134420 2024-04-25T02:15:56.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.082+0000 7ff6f57fa640 1 -- 172.21.15.79:0/2251571281 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6f00135c0 con 0x7ff6f8134420 2024-04-25T02:15:56.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.083+0000 7ff6f57fa640 1 --2- 172.21.15.79:0/2251571281 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff6dc06be60 0x7ff6dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:56.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.083+0000 7ff6f57fa640 1 -- 172.21.15.79:0/2251571281 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 4857+0+0 (secure 0 0 0) 0x7ff6f008ad60 con 0x7ff6f8134420 2024-04-25T02:15:56.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.083+0000 7ff6fcb3e640 1 --2- 172.21.15.79:0/2251571281 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff6dc06be60 0x7ff6dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:56.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.083+0000 7ff6fcb3e640 1 --2- 172.21.15.79:0/2251571281 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff6dc06be60 0x7ff6dc06e320 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec032000 tx=0x7ff6ec02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:56.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.087+0000 7ff6f57fa640 1 -- 172.21.15.79:0/2251571281 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff6f0059410 con 0x7ff6f8134420 2024-04-25T02:15:56.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.264+0000 7ff6feda2640 1 -- 172.21.15.79:0/2251571281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff6f80d0b90 con 0x7ff6f8134420 2024-04-25T02:15:56.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.264+0000 7ff6f57fa640 1 -- 172.21.15.79:0/2251571281 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v98) ==== 84+0+65 (secure 0 0 0) 0x7ff6f005d710 con 0x7ff6f8134420 2024-04-25T02:15:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:56.269 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-04-25T02:15:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:15:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-04-25T02:15:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-04-25T02:15:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:15:56.270 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-04-25T02:15:56.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.266+0000 7ff6feda2640 1 -- 172.21.15.79:0/2251571281 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff6dc06be60 msgr2=0x7ff6dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:56.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.266+0000 7ff6feda2640 1 --2- 172.21.15.79:0/2251571281 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff6dc06be60 0x7ff6dc06e320 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec032000 tx=0x7ff6ec02e000 comp rx=0 tx=0).stop 2024-04-25T02:15:56.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.266+0000 7ff6feda2640 1 -- 172.21.15.79:0/2251571281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f8134420 msgr2=0x7ff6f80b1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:56.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.266+0000 7ff6feda2640 1 --2- 172.21.15.79:0/2251571281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f8134420 0x7ff6f80b1120 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7ff6f806f8a0 tx=0x7ff6f000e530 comp rx=0 tx=0).stop 2024-04-25T02:15:56.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.266+0000 7ff6feda2640 1 -- 172.21.15.79:0/2251571281 shutdown_connections 2024-04-25T02:15:56.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.266+0000 7ff6feda2640 1 --2- 172.21.15.79:0/2251571281 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff6dc06be60 0x7ff6dc06e320 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:56.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.266+0000 7ff6feda2640 1 --2- 172.21.15.79:0/2251571281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f8134420 0x7ff6f80b1120 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:56.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.266+0000 7ff6feda2640 1 --2- 172.21.15.79:0/2251571281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6f8133fc0 0x7ff6f80b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:56.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.266+0000 7ff6feda2640 1 --2- 172.21.15.79:0/2251571281 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6e80039b0 0x7ff6f8155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:56.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.266+0000 7ff6feda2640 1 -- 172.21.15.79:0/2251571281 >> 172.21.15.79:0/2251571281 conn(0x7ff6f80cfc80 msgr2=0x7ff6f806e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:56.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.266+0000 7ff6feda2640 1 -- 172.21.15.79:0/2251571281 shutdown_connections 2024-04-25T02:15:56.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.266+0000 7ff6feda2640 1 -- 172.21.15.79:0/2251571281 wait complete. 2024-04-25T02:15:56.282 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T02:15:56.282 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T02:15:56.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.378+0000 7f9e5a81b640 1 Processor -- start 2024-04-25T02:15:56.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.378+0000 7f9e5a81b640 1 -- start start 2024-04-25T02:15:56.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.379+0000 7f9e5a81b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9e5415e440 0x7f9e540cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:56.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.379+0000 7f9e5a81b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e540d1e80 con 0x7f9e540d10a0 2024-04-25T02:15:56.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.379+0000 7f9e5a81b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e540d2160 con 0x7f9e540d2f20 2024-04-25T02:15:56.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.379+0000 7f9e5a81b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9e540d2440 con 0x7f9e5415e440 2024-04-25T02:15:56.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.379+0000 7f9e53fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9e5415e440 0x7f9e540cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:56.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.379+0000 7f9e58db8640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9e540d10a0 0x7f9e540b6ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46710/0 (socket says 172.21.15.79:46710) 2024-04-25T02:15:56.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.379+0000 7f9e58db8640 1 -- 172.21.15.79:0/3585195574 learned_addr learned my addr 172.21.15.79:0/3585195574 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:56.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.380+0000 7f9e53fff640 1 -- 172.21.15.79:0/3585195574 >> v1:172.21.15.189:6789/0 conn(0x7f9e540d2f20 legacy=0x7f9e540d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:56.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.380+0000 7f9e52ffd640 1 -- 172.21.15.79:0/3585195574 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1914309124 0 0) 0x7f9e540d1e80 con 0x7f9e540d10a0 2024-04-25T02:15:56.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.380+0000 7f9e53fff640 1 -- 172.21.15.79:0/3585195574 >> v1:172.21.15.79:6789/0 conn(0x7f9e540d10a0 legacy=0x7f9e540b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:56.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.380+0000 7f9e53fff640 1 -- 172.21.15.79:0/3585195574 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e540d2720 con 0x7f9e5415e440 2024-04-25T02:15:56.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.380+0000 7f9e53fff640 1 --2- 172.21.15.79:0/3585195574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e5415e440 0x7f9e540cf870 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f9e440097a0 tx=0x7f9e4402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a190b065be1dfcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:56.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.380+0000 7f9e52ffd640 1 -- 172.21.15.79:0/3585195574 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44037070 con 0x7f9e5415e440 2024-04-25T02:15:56.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.380+0000 7f9e52ffd640 1 -- 172.21.15.79:0/3585195574 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e44032440 con 0x7f9e5415e440 2024-04-25T02:15:56.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.380+0000 7f9e52ffd640 1 -- 172.21.15.79:0/3585195574 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44032810 con 0x7f9e5415e440 2024-04-25T02:15:56.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.381+0000 7f9e5a81b640 1 -- 172.21.15.79:0/3585195574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e5415e440 msgr2=0x7f9e540cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:56.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.381+0000 7f9e5a81b640 1 --2- 172.21.15.79:0/3585195574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e5415e440 0x7f9e540cf870 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f9e440097a0 tx=0x7f9e4402a1e0 comp rx=0 tx=0).stop 2024-04-25T02:15:56.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.381+0000 7f9e5a81b640 1 -- 172.21.15.79:0/3585195574 shutdown_connections 2024-04-25T02:15:56.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.381+0000 7f9e5a81b640 1 --2- 172.21.15.79:0/3585195574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e5415e440 0x7f9e540cf870 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:56.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.381+0000 7f9e5a81b640 1 -- 172.21.15.79:0/3585195574 >> 172.21.15.79:0/3585195574 conn(0x7f9e5409d450 msgr2=0x7f9e540d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:56.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.381+0000 7f9e5a81b640 1 -- 172.21.15.79:0/3585195574 shutdown_connections 2024-04-25T02:15:56.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.381+0000 7f9e5a81b640 1 -- 172.21.15.79:0/3585195574 wait complete. 2024-04-25T02:15:56.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.382+0000 7f9e5a81b640 1 Processor -- start 2024-04-25T02:15:56.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.382+0000 7f9e5a81b640 1 -- start start 2024-04-25T02:15:56.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.383+0000 7f9e5a81b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e540d10a0 0x7f9e540c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:56.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.383+0000 7f9e5a81b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e540d2f20 0x7f9e54154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:56.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.383+0000 7f9e5a81b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e5415e440 0x7f9e54158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:56.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.383+0000 7f9e5a81b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9e540cff30 con 0x7f9e540d2f20 2024-04-25T02:15:56.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.383+0000 7f9e5a81b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9e540cfdb0 con 0x7f9e540d10a0 2024-04-25T02:15:56.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.383+0000 7f9e5a81b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9e540d00b0 con 0x7f9e5415e440 2024-04-25T02:15:56.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.383+0000 7f9e537fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e540d2f20 0x7f9e54154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:56.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.383+0000 7f9e537fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e540d2f20 0x7f9e54154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58876/0 (socket says 172.21.15.79:58876) 2024-04-25T02:15:56.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.383+0000 7f9e537fe640 1 -- 172.21.15.79:0/3200603749 learned_addr learned my addr 172.21.15.79:0/3200603749 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:56.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.383+0000 7f9e537fe640 1 -- 172.21.15.79:0/3200603749 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e5415e440 msgr2=0x7f9e54158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:56.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.383+0000 7f9e537fe640 1 --2- 172.21.15.79:0/3200603749 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e5415e440 0x7f9e54158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:56.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.383+0000 7f9e537fe640 1 -- 172.21.15.79:0/3200603749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e540d10a0 msgr2=0x7f9e540c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:56.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.383+0000 7f9e537fe640 1 --2- 172.21.15.79:0/3200603749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e540d10a0 0x7f9e540c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:56.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.383+0000 7f9e537fe640 1 -- 172.21.15.79:0/3200603749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e540c8970 con 0x7f9e540d2f20 2024-04-25T02:15:56.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.383+0000 7f9e537fe640 1 --2- 172.21.15.79:0/3200603749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e540d2f20 0x7f9e54154540 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800c430 tx=0x7f9e4800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:56.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.384+0000 7f9e50ff9640 1 -- 172.21.15.79:0/3200603749 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48011790 con 0x7f9e540d2f20 2024-04-25T02:15:56.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.384+0000 7f9e50ff9640 1 -- 172.21.15.79:0/3200603749 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e48017070 con 0x7f9e540d2f20 2024-04-25T02:15:56.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.384+0000 7f9e5a81b640 1 -- 172.21.15.79:0/3200603749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e540b7230 con 0x7f9e540d2f20 2024-04-25T02:15:56.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.384+0000 7f9e50ff9640 1 -- 172.21.15.79:0/3200603749 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48011bb0 con 0x7f9e540d2f20 2024-04-25T02:15:56.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.384+0000 7f9e5a81b640 1 -- 172.21.15.79:0/3200603749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e540b7ad0 con 0x7f9e540d2f20 2024-04-25T02:15:56.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.385+0000 7f9e5a81b640 1 -- 172.21.15.79:0/3200603749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e540690a0 con 0x7f9e540d2f20 2024-04-25T02:15:56.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.385+0000 7f9e50ff9640 1 -- 172.21.15.79:0/3200603749 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e4801c460 con 0x7f9e540d2f20 2024-04-25T02:15:56.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.385+0000 7f9e50ff9640 1 --2- 172.21.15.79:0/3200603749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9e4006be30 0x7f9e4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:56.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.386+0000 7f9e50ff9640 1 -- 172.21.15.79:0/3200603749 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 4857+0+0 (secure 0 0 0) 0x7f9e4808a910 con 0x7f9e540d2f20 2024-04-25T02:15:56.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.386+0000 7f9e53fff640 1 --2- 172.21.15.79:0/3200603749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9e4006be30 0x7f9e4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:56.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.386+0000 7f9e53fff640 1 --2- 172.21.15.79:0/3200603749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9e4006be30 0x7f9e4006e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9e44034000 tx=0x7f9e4402c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:56.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.390+0000 7f9e50ff9640 1 -- 172.21.15.79:0/3200603749 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9e480596a0 con 0x7f9e540d2f20 2024-04-25T02:15:56.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:56.562+0000 7f9e5a81b640 1 -- 172.21.15.79:0/3200603749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9e540c73a0 con 0x7f9e540d2f20 2024-04-25T02:15:57.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.009+0000 7f9e50ff9640 1 -- 172.21.15.79:0/3200603749 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v99) ==== 138+0+0 (secure 0 0 0) 0x7f9e48058fa0 con 0x7f9e540d2f20 2024-04-25T02:15:57.014 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-04-25T02:15:57.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.011+0000 7f9e5a81b640 1 -- 172.21.15.79:0/3200603749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9e4006be30 msgr2=0x7f9e4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:57.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.011+0000 7f9e5a81b640 1 --2- 172.21.15.79:0/3200603749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9e4006be30 0x7f9e4006e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9e44034000 tx=0x7f9e4402c000 comp rx=0 tx=0).stop 2024-04-25T02:15:57.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.011+0000 7f9e5a81b640 1 -- 172.21.15.79:0/3200603749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e540d2f20 msgr2=0x7f9e54154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:57.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.011+0000 7f9e5a81b640 1 --2- 172.21.15.79:0/3200603749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e540d2f20 0x7f9e54154540 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800c430 tx=0x7f9e4800c8f0 comp rx=0 tx=0).stop 2024-04-25T02:15:57.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.011+0000 7f9e5a81b640 1 -- 172.21.15.79:0/3200603749 shutdown_connections 2024-04-25T02:15:57.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.011+0000 7f9e5a81b640 1 --2- 172.21.15.79:0/3200603749 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9e4006be30 0x7f9e4006e2f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:57.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.011+0000 7f9e5a81b640 1 --2- 172.21.15.79:0/3200603749 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e5415e440 0x7f9e54158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:57.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.011+0000 7f9e5a81b640 1 --2- 172.21.15.79:0/3200603749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e540d2f20 0x7f9e54154540 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:57.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.011+0000 7f9e5a81b640 1 --2- 172.21.15.79:0/3200603749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e540d10a0 0x7f9e540c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:57.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.011+0000 7f9e5a81b640 1 -- 172.21.15.79:0/3200603749 >> 172.21.15.79:0/3200603749 conn(0x7f9e5409d450 msgr2=0x7f9e540ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:57.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.011+0000 7f9e5a81b640 1 -- 172.21.15.79:0/3200603749 shutdown_connections 2024-04-25T02:15:57.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.011+0000 7f9e5a81b640 1 -- 172.21.15.79:0/3200603749 wait complete. 2024-04-25T02:15:57.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T02:15:57.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.129+0000 7fe48b461640 1 Processor -- start 2024-04-25T02:15:57.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.130+0000 7fe48b461640 1 -- start start 2024-04-25T02:15:57.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.130+0000 7fe48b461640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe48415a810 0x7fe4840cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:57.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.130+0000 7fe48b461640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe48409dcb0 0x7fe484070d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:57.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.130+0000 7fe48b461640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe48415abf0 con 0x7fe4840ccd60 2024-04-25T02:15:57.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.130+0000 7fe48b461640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe484073050 con 0x7fe48415a810 2024-04-25T02:15:57.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.130+0000 7fe48b461640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe4840cbdd0 con 0x7fe48409dcb0 2024-04-25T02:15:57.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.131+0000 7fe4891fd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe48415a810 0x7fe4840cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:57.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.131+0000 7fe4891fd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe48415a810 0x7fe4840cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58882/0 (socket says 172.21.15.79:58882) 2024-04-25T02:15:57.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.131+0000 7fe4891fd640 1 -- 172.21.15.79:0/3653852540 learned_addr learned my addr 172.21.15.79:0/3653852540 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:57.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.131+0000 7fe4889fc640 1 --2- 172.21.15.79:0/3653852540 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe48409dcb0 0x7fe484070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.131+0000 7fe4891fd640 1 -- 172.21.15.79:0/3653852540 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe48409dcb0 msgr2=0x7fe484070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.131+0000 7fe4891fd640 1 --2- 172.21.15.79:0/3653852540 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe48409dcb0 0x7fe484070d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.131+0000 7fe4891fd640 1 -- 172.21.15.79:0/3653852540 >> v1:172.21.15.189:6789/0 conn(0x7fe4840ccd60 legacy=0x7fe4840b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.131+0000 7fe4891fd640 1 -- 172.21.15.79:0/3653852540 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4840ce580 con 0x7fe48415a810 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.132+0000 7fe4891fd640 1 --2- 172.21.15.79:0/3653852540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48415a810 0x7fe4840cc820 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fe480009e50 tx=0x7fe48002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a087fb53fe0871 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.132+0000 7fe47bfff640 1 -- 172.21.15.79:0/3653852540 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe480036070 con 0x7fe48415a810 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.132+0000 7fe47bfff640 1 -- 172.21.15.79:0/3653852540 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe480031600 con 0x7fe48415a810 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.132+0000 7fe47bfff640 1 -- 172.21.15.79:0/3653852540 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4800319d0 con 0x7fe48415a810 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.132+0000 7fe48b461640 1 -- 172.21.15.79:0/3653852540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48415a810 msgr2=0x7fe4840cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.132+0000 7fe48b461640 1 --2- 172.21.15.79:0/3653852540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48415a810 0x7fe4840cc820 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fe480009e50 tx=0x7fe48002a630 comp rx=0 tx=0).stop 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.132+0000 7fe48b461640 1 -- 172.21.15.79:0/3653852540 shutdown_connections 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.132+0000 7fe48b461640 1 --2- 172.21.15.79:0/3653852540 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe48409dcb0 0x7fe484070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.132+0000 7fe48b461640 1 --2- 172.21.15.79:0/3653852540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48415a810 0x7fe4840cc820 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.132+0000 7fe48b461640 1 -- 172.21.15.79:0/3653852540 >> 172.21.15.79:0/3653852540 conn(0x7fe4840b1cd0 msgr2=0x7fe4840b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.133+0000 7fe48b461640 1 -- 172.21.15.79:0/3653852540 shutdown_connections 2024-04-25T02:15:57.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.133+0000 7fe48b461640 1 -- 172.21.15.79:0/3653852540 wait complete. 2024-04-25T02:15:57.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.134+0000 7fe48b461640 1 Processor -- start 2024-04-25T02:15:57.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.134+0000 7fe48b461640 1 -- start start 2024-04-25T02:15:57.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.134+0000 7fe48b461640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe48409dcb0 0x7fe484147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:57.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.134+0000 7fe48b461640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4840ccd60 0x7fe48414e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:57.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.134+0000 7fe48b461640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48415a810 0x7fe4840b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:57.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.134+0000 7fe48b461640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe4840cc020 con 0x7fe48415a810 2024-04-25T02:15:57.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.134+0000 7fe48b461640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe4840ceb40 con 0x7fe4840ccd60 2024-04-25T02:15:57.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.134+0000 7fe48b461640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe4840cc300 con 0x7fe48409dcb0 2024-04-25T02:15:57.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.134+0000 7fe4899fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48415a810 0x7fe4840b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:57.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.134+0000 7fe4899fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48415a810 0x7fe4840b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58898/0 (socket says 172.21.15.79:58898) 2024-04-25T02:15:57.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.134+0000 7fe4899fe640 1 -- 172.21.15.79:0/1396198051 learned_addr learned my addr 172.21.15.79:0/1396198051 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:57.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.135+0000 7fe4891fd640 1 --2- 172.21.15.79:0/1396198051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe48409dcb0 0x7fe484147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:57.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.135+0000 7fe4889fc640 1 --2- 172.21.15.79:0/1396198051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4840ccd60 0x7fe48414e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:57.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.135+0000 7fe4899fe640 1 -- 172.21.15.79:0/1396198051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe48409dcb0 msgr2=0x7fe484147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:57.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.135+0000 7fe4899fe640 1 --2- 172.21.15.79:0/1396198051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe48409dcb0 0x7fe484147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:57.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.135+0000 7fe4899fe640 1 -- 172.21.15.79:0/1396198051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4840ccd60 msgr2=0x7fe48414e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:57.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.135+0000 7fe4899fe640 1 --2- 172.21.15.79:0/1396198051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4840ccd60 0x7fe48414e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:57.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.135+0000 7fe4899fe640 1 -- 172.21.15.79:0/1396198051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe484070d50 con 0x7fe48415a810 2024-04-25T02:15:57.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.135+0000 7fe4889fc640 1 --2- 172.21.15.79:0/1396198051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4840ccd60 0x7fe48414e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:57.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.135+0000 7fe4899fe640 1 --2- 172.21.15.79:0/1396198051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48415a810 0x7fe4840b4260 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00b410 tx=0x7fe47c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:57.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.135+0000 7fe479ffb640 1 -- 172.21.15.79:0/1396198051 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c015030 con 0x7fe48415a810 2024-04-25T02:15:57.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.135+0000 7fe479ffb640 1 -- 172.21.15.79:0/1396198051 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47c004020 con 0x7fe48415a810 2024-04-25T02:15:57.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.135+0000 7fe479ffb640 1 -- 172.21.15.79:0/1396198051 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c004410 con 0x7fe48415a810 2024-04-25T02:15:57.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.135+0000 7fe48b461640 1 -- 172.21.15.79:0/1396198051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe484070ff0 con 0x7fe48415a810 2024-04-25T02:15:57.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.135+0000 7fe48b461640 1 -- 172.21.15.79:0/1396198051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4840715b0 con 0x7fe48415a810 2024-04-25T02:15:57.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.136+0000 7fe48b461640 1 -- 172.21.15.79:0/1396198051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4840690a0 con 0x7fe48415a810 2024-04-25T02:15:57.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.137+0000 7fe479ffb640 1 -- 172.21.15.79:0/1396198051 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe47c018070 con 0x7fe48415a810 2024-04-25T02:15:57.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.137+0000 7fe479ffb640 1 --2- 172.21.15.79:0/1396198051 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe46806be30 0x7fe46806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:57.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.137+0000 7fe479ffb640 1 -- 172.21.15.79:0/1396198051 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5227+0+0 (secure 0 0 0) 0x7fe47c08a6d0 con 0x7fe48415a810 2024-04-25T02:15:57.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.137+0000 7fe4891fd640 1 --2- 172.21.15.79:0/1396198051 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe46806be30 0x7fe46806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:57.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.138+0000 7fe4891fd640 1 --2- 172.21.15.79:0/1396198051 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe46806be30 0x7fe46806e2f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe480033000 tx=0x7fe480009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:57.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.142+0000 7fe479ffb640 1 -- 172.21.15.79:0/1396198051 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe47c0591e0 con 0x7fe48415a810 2024-04-25T02:15:57.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:57.315+0000 7fe48b461640 1 -- 172.21.15.79:0/1396198051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe48409d400 con 0x7fe48415a810 2024-04-25T02:15:58.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.016+0000 7fe479ffb640 1 -- 172.21.15.79:0/1396198051 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v100) ==== 170+0+0 (secure 0 0 0) 0x7fe47c058ae0 con 0x7fe48415a810 2024-04-25T02:15:58.021 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-04-25T02:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.018+0000 7fe48b461640 1 -- 172.21.15.79:0/1396198051 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe46806be30 msgr2=0x7fe46806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.018+0000 7fe48b461640 1 --2- 172.21.15.79:0/1396198051 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe46806be30 0x7fe46806e2f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe480033000 tx=0x7fe480009000 comp rx=0 tx=0).stop 2024-04-25T02:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.018+0000 7fe48b461640 1 -- 172.21.15.79:0/1396198051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48415a810 msgr2=0x7fe4840b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.018+0000 7fe48b461640 1 --2- 172.21.15.79:0/1396198051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48415a810 0x7fe4840b4260 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00b410 tx=0x7fe47c00b8d0 comp rx=0 tx=0).stop 2024-04-25T02:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.018+0000 7fe48b461640 1 -- 172.21.15.79:0/1396198051 shutdown_connections 2024-04-25T02:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.018+0000 7fe48b461640 1 --2- 172.21.15.79:0/1396198051 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe46806be30 0x7fe46806e2f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.018+0000 7fe48b461640 1 --2- 172.21.15.79:0/1396198051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48415a810 0x7fe4840b4260 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.018+0000 7fe48b461640 1 --2- 172.21.15.79:0/1396198051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4840ccd60 0x7fe48414e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.018+0000 7fe48b461640 1 --2- 172.21.15.79:0/1396198051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe48409dcb0 0x7fe484147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.018+0000 7fe48b461640 1 -- 172.21.15.79:0/1396198051 >> 172.21.15.79:0/1396198051 conn(0x7fe4840b1cd0 msgr2=0x7fe4840cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.018+0000 7fe48b461640 1 -- 172.21.15.79:0/1396198051 shutdown_connections 2024-04-25T02:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.018+0000 7fe48b461640 1 -- 172.21.15.79:0/1396198051 wait complete. 2024-04-25T02:15:58.044 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T02:15:58.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.140+0000 7f4dbd977640 1 Processor -- start 2024-04-25T02:15:58.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.140+0000 7f4dbd977640 1 -- start start 2024-04-25T02:15:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4dbd977640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4db815e4f0 0x7f4db80d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4dbd977640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f4db80cf7f0 0x7f4db80d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4dbd977640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4db80cfc80 0x7f4db80d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4dbd977640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4db80d1ee0 con 0x7f4db815e4f0 2024-04-25T02:15:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4dbd977640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f4db80d21c0 con 0x7f4db80cf7f0 2024-04-25T02:15:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4dbd977640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4db80d24a0 con 0x7f4db80cfc80 2024-04-25T02:15:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4db6ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4db815e4f0 0x7f4db80d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4db6ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4db815e4f0 0x7f4db80d2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58908/0 (socket says 172.21.15.79:58908) 2024-04-25T02:15:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4db6ffd640 1 -- 172.21.15.79:0/1708625762 learned_addr learned my addr 172.21.15.79:0/1708625762 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4daffff640 1 --2- 172.21.15.79:0/1708625762 >> v2:172.21.15.189:3300/0 conn(0x7f4db80cf7f0 0x7f4db80d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4db77fe640 1 --2- 172.21.15.79:0/1708625762 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4db80cfc80 0x7f4db80d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4db6ffd640 1 -- 172.21.15.79:0/1708625762 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4db80cfc80 msgr2=0x7f4db80d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4db6ffd640 1 --2- 172.21.15.79:0/1708625762 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4db80cfc80 0x7f4db80d0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4db6ffd640 1 -- 172.21.15.79:0/1708625762 >> v2:172.21.15.189:3300/0 conn(0x7f4db80cf7f0 msgr2=0x7f4db80d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4db6ffd640 1 --2- 172.21.15.79:0/1708625762 >> v2:172.21.15.189:3300/0 conn(0x7f4db80cf7f0 0x7f4db80d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4db6ffd640 1 -- 172.21.15.79:0/1708625762 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db80d2780 con 0x7f4db815e4f0 2024-04-25T02:15:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.141+0000 7f4db77fe640 1 --2- 172.21.15.79:0/1708625762 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4db80cfc80 0x7f4db80d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.142+0000 7f4db6ffd640 1 --2- 172.21.15.79:0/1708625762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4db815e4f0 0x7f4db80d2ca0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009870 tx=0x7f4da802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfc604d503dec80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.142+0000 7f4db67fc640 1 -- 172.21.15.79:0/1708625762 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8037070 con 0x7f4db815e4f0 2024-04-25T02:15:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.142+0000 7f4db67fc640 1 -- 172.21.15.79:0/1708625762 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da8032440 con 0x7f4db815e4f0 2024-04-25T02:15:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.142+0000 7f4db67fc640 1 -- 172.21.15.79:0/1708625762 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8032810 con 0x7f4db815e4f0 2024-04-25T02:15:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.143+0000 7f4dbd977640 1 -- 172.21.15.79:0/1708625762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4db815e4f0 msgr2=0x7f4db80d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.143+0000 7f4dbd977640 1 --2- 172.21.15.79:0/1708625762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4db815e4f0 0x7f4db80d2ca0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009870 tx=0x7f4da802a210 comp rx=0 tx=0).stop 2024-04-25T02:15:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.143+0000 7f4dbd977640 1 -- 172.21.15.79:0/1708625762 shutdown_connections 2024-04-25T02:15:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.143+0000 7f4dbd977640 1 --2- 172.21.15.79:0/1708625762 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4db80cfc80 0x7f4db80d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.143+0000 7f4dbd977640 1 --2- 172.21.15.79:0/1708625762 >> v2:172.21.15.189:3300/0 conn(0x7f4db80cf7f0 0x7f4db80d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.143+0000 7f4dbd977640 1 --2- 172.21.15.79:0/1708625762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4db815e4f0 0x7f4db80d2ca0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.143+0000 7f4dbd977640 1 -- 172.21.15.79:0/1708625762 >> 172.21.15.79:0/1708625762 conn(0x7f4db809d4a0 msgr2=0x7f4db80d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.143+0000 7f4dbd977640 1 -- 172.21.15.79:0/1708625762 shutdown_connections 2024-04-25T02:15:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.143+0000 7f4dbd977640 1 -- 172.21.15.79:0/1708625762 wait complete. 2024-04-25T02:15:58.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.144+0000 7f4dbd977640 1 Processor -- start 2024-04-25T02:15:58.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.144+0000 7f4dbd977640 1 -- start start 2024-04-25T02:15:58.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4dbd977640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4db80cf7f0 0x7f4db80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:58.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4dbd977640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4db80cfc80 0x7f4db80b9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:58.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4dbd977640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4db815e4f0 0x7f4db81f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:58.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4dbd977640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4db806bc30 con 0x7f4db815e4f0 2024-04-25T02:15:58.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4dbd977640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4db80d50f0 con 0x7f4db80cf7f0 2024-04-25T02:15:58.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4dbd977640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4db806bdb0 con 0x7f4db80cfc80 2024-04-25T02:15:58.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4db77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4db815e4f0 0x7f4db81f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:58.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4db77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4db815e4f0 0x7f4db81f7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58920/0 (socket says 172.21.15.79:58920) 2024-04-25T02:15:58.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4db77fe640 1 -- 172.21.15.79:0/3380530667 learned_addr learned my addr 172.21.15.79:0/3380530667 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:58.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4daffff640 1 --2- 172.21.15.79:0/3380530667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4db80cfc80 0x7f4db80b9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:58.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4db6ffd640 1 --2- 172.21.15.79:0/3380530667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4db80cf7f0 0x7f4db80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:58.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4db77fe640 1 -- 172.21.15.79:0/3380530667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4db80cfc80 msgr2=0x7f4db80b9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:58.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4db77fe640 1 --2- 172.21.15.79:0/3380530667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4db80cfc80 0x7f4db80b9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:58.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4db77fe640 1 -- 172.21.15.79:0/3380530667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4db80cf7f0 msgr2=0x7f4db80b8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:58.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4db77fe640 1 --2- 172.21.15.79:0/3380530667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4db80cf7f0 0x7f4db80b8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:58.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4db77fe640 1 -- 172.21.15.79:0/3380530667 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db80cb570 con 0x7f4db815e4f0 2024-04-25T02:15:58.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4db77fe640 1 --2- 172.21.15.79:0/3380530667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4db815e4f0 0x7f4db81f7b40 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f4db0007e70 tx=0x7f4db000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:58.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4db4ff9640 1 -- 172.21.15.79:0/3380530667 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db001a070 con 0x7f4db815e4f0 2024-04-25T02:15:58.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4db4ff9640 1 -- 172.21.15.79:0/3380530667 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db0015600 con 0x7f4db815e4f0 2024-04-25T02:15:58.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4dbd977640 1 -- 172.21.15.79:0/3380530667 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db80ce250 con 0x7f4db815e4f0 2024-04-25T02:15:58.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4db4ff9640 1 -- 172.21.15.79:0/3380530667 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db00159f0 con 0x7f4db815e4f0 2024-04-25T02:15:58.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.145+0000 7f4dbd977640 1 -- 172.21.15.79:0/3380530667 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db81598d0 con 0x7f4db815e4f0 2024-04-25T02:15:58.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.146+0000 7f4dbd977640 1 -- 172.21.15.79:0/3380530667 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4db80686c0 con 0x7f4db815e4f0 2024-04-25T02:15:58.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.147+0000 7f4db4ff9640 1 -- 172.21.15.79:0/3380530667 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4db001d070 con 0x7f4db815e4f0 2024-04-25T02:15:58.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.147+0000 7f4db4ff9640 1 --2- 172.21.15.79:0/3380530667 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d9806be60 0x7f4d9806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:58.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.147+0000 7f4db6ffd640 1 --2- 172.21.15.79:0/3380530667 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d9806be60 0x7f4d9806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:58.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.147+0000 7f4db4ff9640 1 -- 172.21.15.79:0/3380530667 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5609+0+0 (secure 0 0 0) 0x7f4db008b020 con 0x7f4db815e4f0 2024-04-25T02:15:58.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.148+0000 7f4db6ffd640 1 --2- 172.21.15.79:0/3380530667 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d9806be60 0x7f4d9806e320 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4da8034000 tx=0x7f4da802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:58.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.152+0000 7f4db4ff9640 1 -- 172.21.15.79:0/3380530667 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4db80cb570 con 0x7f4db815e4f0 2024-04-25T02:15:58.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:58.361+0000 7f4dbd977640 1 -- 172.21.15.79:0/3380530667 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4db815dc80 con 0x7f4db815e4f0 2024-04-25T02:15:59.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.017+0000 7f4db4ff9640 1 -- 172.21.15.79:0/3380530667 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v65) ==== 174+0+0 (secure 0 0 0) 0x7f4db815dc80 con 0x7f4db815e4f0 2024-04-25T02:15:59.022 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 14 and data pool 15 2024-04-25T02:15:59.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.021+0000 7f4dbd977640 1 -- 172.21.15.79:0/3380530667 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d9806be60 msgr2=0x7f4d9806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.021+0000 7f4dbd977640 1 --2- 172.21.15.79:0/3380530667 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d9806be60 0x7f4d9806e320 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4da8034000 tx=0x7f4da802e000 comp rx=0 tx=0).stop 2024-04-25T02:15:59.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.021+0000 7f4dbd977640 1 -- 172.21.15.79:0/3380530667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4db815e4f0 msgr2=0x7f4db81f7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.021+0000 7f4dbd977640 1 --2- 172.21.15.79:0/3380530667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4db815e4f0 0x7f4db81f7b40 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f4db0007e70 tx=0x7f4db000d4a0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.022+0000 7f4dbd977640 1 -- 172.21.15.79:0/3380530667 shutdown_connections 2024-04-25T02:15:59.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.022+0000 7f4dbd977640 1 --2- 172.21.15.79:0/3380530667 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4d9806be60 0x7f4d9806e320 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.022+0000 7f4dbd977640 1 --2- 172.21.15.79:0/3380530667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4db815e4f0 0x7f4db81f7b40 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.022+0000 7f4dbd977640 1 --2- 172.21.15.79:0/3380530667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4db80cfc80 0x7f4db80b9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.022+0000 7f4dbd977640 1 --2- 172.21.15.79:0/3380530667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4db80cf7f0 0x7f4db80b8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.022+0000 7f4dbd977640 1 -- 172.21.15.79:0/3380530667 >> 172.21.15.79:0/3380530667 conn(0x7f4db809d4a0 msgr2=0x7f4db806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:59.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.022+0000 7f4dbd977640 1 -- 172.21.15.79:0/3380530667 shutdown_connections 2024-04-25T02:15:59.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.022+0000 7f4dbd977640 1 -- 172.21.15.79:0/3380530667 wait complete. 2024-04-25T02:15:59.055 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:15:59.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.147+0000 7f3e1771b640 1 Processor -- start 2024-04-25T02:15:59.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.147+0000 7f3e1771b640 1 -- start start 2024-04-25T02:15:59.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.148+0000 7f3e1771b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e1006df50 0x7f3e1006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.148+0000 7f3e1771b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3e100b2d30 0x7f3e100b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.148+0000 7f3e1771b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e10071e00 con 0x7f3e10143bc0 2024-04-25T02:15:59.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.148+0000 7f3e1771b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3e1006e8f0 con 0x7f3e100b2d30 2024-04-25T02:15:59.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.148+0000 7f3e1771b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3e10072cb0 con 0x7f3e1006df50 2024-04-25T02:15:59.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.148+0000 7f3e15cb8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3e100b2d30 0x7f3e100b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.148+0000 7f3e154b7640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3e10143bc0 0x7f3e1015f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46726/0 (socket says 172.21.15.79:46726) 2024-04-25T02:15:59.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.148+0000 7f3e154b7640 1 -- 172.21.15.79:0/2770340030 learned_addr learned my addr 172.21.15.79:0/2770340030 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:59.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.148+0000 7f3e14cb6640 1 --2- 172.21.15.79:0/2770340030 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e1006df50 0x7f3e1006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.148+0000 7f3e15cb8640 1 -- 172.21.15.79:0/2770340030 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e1006df50 msgr2=0x7f3e1006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:59.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.148+0000 7f3e15cb8640 1 --2- 172.21.15.79:0/2770340030 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e1006df50 0x7f3e1006e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.148+0000 7f3e15cb8640 1 -- 172.21.15.79:0/2770340030 >> v1:172.21.15.79:6789/0 conn(0x7f3e10143bc0 legacy=0x7f3e1015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.148+0000 7f3e15cb8640 1 -- 172.21.15.79:0/2770340030 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e100720a0 con 0x7f3e100b2d30 2024-04-25T02:15:59.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.148+0000 7f3e14cb6640 1 --2- 172.21.15.79:0/2770340030 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e1006df50 0x7f3e1006e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:59.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.149+0000 7f3e15cb8640 1 --2- 172.21.15.79:0/2770340030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e100b2d30 0x7f3e100b3190 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009d90 tx=0x7f3e0802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668df9fb4bf764fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:59.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.149+0000 7f3e07fff640 1 -- 172.21.15.79:0/2770340030 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08031600 con 0x7f3e100b2d30 2024-04-25T02:15:59.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.149+0000 7f3e07fff640 1 -- 172.21.15.79:0/2770340030 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e080317a0 con 0x7f3e100b2d30 2024-04-25T02:15:59.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.149+0000 7f3e07fff640 1 -- 172.21.15.79:0/2770340030 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08031b70 con 0x7f3e100b2d30 2024-04-25T02:15:59.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.149+0000 7f3e1771b640 1 -- 172.21.15.79:0/2770340030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e100b2d30 msgr2=0x7f3e100b3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.149+0000 7f3e1771b640 1 --2- 172.21.15.79:0/2770340030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e100b2d30 0x7f3e100b3190 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009d90 tx=0x7f3e0802a5d0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.149+0000 7f3e1771b640 1 -- 172.21.15.79:0/2770340030 shutdown_connections 2024-04-25T02:15:59.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.149+0000 7f3e1771b640 1 --2- 172.21.15.79:0/2770340030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e100b2d30 0x7f3e100b3190 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.149+0000 7f3e1771b640 1 --2- 172.21.15.79:0/2770340030 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e1006df50 0x7f3e1006e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.150+0000 7f3e1771b640 1 -- 172.21.15.79:0/2770340030 >> 172.21.15.79:0/2770340030 conn(0x7f3e100cfc80 msgr2=0x7f3e100d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:59.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.150+0000 7f3e1771b640 1 -- 172.21.15.79:0/2770340030 shutdown_connections 2024-04-25T02:15:59.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.150+0000 7f3e1771b640 1 -- 172.21.15.79:0/2770340030 wait complete. 2024-04-25T02:15:59.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.151+0000 7f3e1771b640 1 Processor -- start 2024-04-25T02:15:59.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.151+0000 7f3e1771b640 1 -- start start 2024-04-25T02:15:59.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.151+0000 7f3e1771b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e1006df50 0x7f3e10155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.151+0000 7f3e1771b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e100b2d30 0x7f3e1015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.151+0000 7f3e1771b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e10143bc0 0x7f3e100aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e1771b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10072940 con 0x7f3e100b2d30 2024-04-25T02:15:59.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e1771b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10072660 con 0x7f3e10143bc0 2024-04-25T02:15:59.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e1771b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3e10143fa0 con 0x7f3e1006df50 2024-04-25T02:15:59.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e14cb6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e100b2d30 0x7f3e1015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e14cb6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e100b2d30 0x7f3e1015aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58934/0 (socket says 172.21.15.79:58934) 2024-04-25T02:15:59.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e14cb6640 1 -- 172.21.15.79:0/1484194790 learned_addr learned my addr 172.21.15.79:0/1484194790 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:59.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e154b7640 1 --2- 172.21.15.79:0/1484194790 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e1006df50 0x7f3e10155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e15cb8640 1 --2- 172.21.15.79:0/1484194790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e10143bc0 0x7f3e100aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e14cb6640 1 -- 172.21.15.79:0/1484194790 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e1006df50 msgr2=0x7f3e10155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e14cb6640 1 --2- 172.21.15.79:0/1484194790 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e1006df50 0x7f3e10155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e14cb6640 1 -- 172.21.15.79:0/1484194790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e10143bc0 msgr2=0x7f3e100aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e14cb6640 1 --2- 172.21.15.79:0/1484194790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e10143bc0 0x7f3e100aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e14cb6640 1 -- 172.21.15.79:0/1484194790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e100af2d0 con 0x7f3e100b2d30 2024-04-25T02:15:59.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e15cb8640 1 --2- 172.21.15.79:0/1484194790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e10143bc0 0x7f3e100aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:15:59.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e14cb6640 1 --2- 172.21.15.79:0/1484194790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e100b2d30 0x7f3e1015aba0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000c7f0 tx=0x7f3e0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:59.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e05ffb640 1 -- 172.21.15.79:0/1484194790 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00015070 con 0x7f3e100b2d30 2024-04-25T02:15:59.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e05ffb640 1 -- 172.21.15.79:0/1484194790 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e00007820 con 0x7f3e100b2d30 2024-04-25T02:15:59.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e1771b640 1 -- 172.21.15.79:0/1484194790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1015b310 con 0x7f3e100b2d30 2024-04-25T02:15:59.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.152+0000 7f3e05ffb640 1 -- 172.21.15.79:0/1484194790 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00007bd0 con 0x7f3e100b2d30 2024-04-25T02:15:59.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.153+0000 7f3e1771b640 1 -- 172.21.15.79:0/1484194790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1015b8d0 con 0x7f3e100b2d30 2024-04-25T02:15:59.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.153+0000 7f3e1771b640 1 -- 172.21.15.79:0/1484194790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e100690a0 con 0x7f3e100b2d30 2024-04-25T02:15:59.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.154+0000 7f3e05ffb640 1 -- 172.21.15.79:0/1484194790 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e00018070 con 0x7f3e100b2d30 2024-04-25T02:15:59.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.154+0000 7f3e05ffb640 1 --2- 172.21.15.79:0/1484194790 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3df406be30 0x7f3df406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.154+0000 7f3e05ffb640 1 -- 172.21.15.79:0/1484194790 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f3e0008af10 con 0x7f3e100b2d30 2024-04-25T02:15:59.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.154+0000 7f3e154b7640 1 --2- 172.21.15.79:0/1484194790 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3df406be30 0x7f3df406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.154+0000 7f3e154b7640 1 --2- 172.21.15.79:0/1484194790 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3df406be30 0x7f3df406e2f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3e101eb070 tx=0x7f3e0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:59.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.158+0000 7f3e05ffb640 1 -- 172.21.15.79:0/1484194790 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3e00059950 con 0x7f3e100b2d30 2024-04-25T02:15:59.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.334+0000 7f3e1771b640 1 -- 172.21.15.79:0/1484194790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e100b5c80 con 0x7f3e100b2d30 2024-04-25T02:15:59.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.335+0000 7f3e05ffb640 1 -- 172.21.15.79:0/1484194790 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16644 (secure 0 0 0) 0x7f3e00059250 con 0x7f3e100b2d30 2024-04-25T02:15:59.340 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:59.340 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":101,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:15:58.363133+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:15:56.581482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T02:15:57.334060+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:15:59.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.337+0000 7f3e1771b640 1 -- 172.21.15.79:0/1484194790 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3df406be30 msgr2=0x7f3df406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.337+0000 7f3e1771b640 1 --2- 172.21.15.79:0/1484194790 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3df406be30 0x7f3df406e2f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3e101eb070 tx=0x7f3e0c009040 comp rx=0 tx=0).stop 2024-04-25T02:15:59.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.337+0000 7f3e1771b640 1 -- 172.21.15.79:0/1484194790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e100b2d30 msgr2=0x7f3e1015aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.337+0000 7f3e1771b640 1 --2- 172.21.15.79:0/1484194790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e100b2d30 0x7f3e1015aba0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000c7f0 tx=0x7f3e0000ccb0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.337+0000 7f3e1771b640 1 -- 172.21.15.79:0/1484194790 shutdown_connections 2024-04-25T02:15:59.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.337+0000 7f3e1771b640 1 --2- 172.21.15.79:0/1484194790 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3df406be30 0x7f3df406e2f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.337+0000 7f3e1771b640 1 --2- 172.21.15.79:0/1484194790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e10143bc0 0x7f3e100aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.337+0000 7f3e1771b640 1 --2- 172.21.15.79:0/1484194790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e100b2d30 0x7f3e1015aba0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.337+0000 7f3e1771b640 1 --2- 172.21.15.79:0/1484194790 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e1006df50 0x7f3e10155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.337+0000 7f3e1771b640 1 -- 172.21.15.79:0/1484194790 >> 172.21.15.79:0/1484194790 conn(0x7f3e100cfc80 msgr2=0x7f3e100cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:59.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.337+0000 7f3e1771b640 1 -- 172.21.15.79:0/1484194790 shutdown_connections 2024-04-25T02:15:59.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.337+0000 7f3e1771b640 1 -- 172.21.15.79:0/1484194790 wait complete. 2024-04-25T02:15:59.353 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:15:59.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.444+0000 7fbbf4e72640 1 Processor -- start 2024-04-25T02:15:59.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.444+0000 7fbbf4e72640 1 -- start start 2024-04-25T02:15:59.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.445+0000 7fbbf4e72640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbbf0143bc0 0x7fbbf015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.445+0000 7fbbf4e72640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbbf006df50 0x7fbbf006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.445+0000 7fbbf4e72640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbf00b48e0 0x7fbbf00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.445+0000 7fbbf4e72640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbbf006e8f0 con 0x7fbbf00b48e0 2024-04-25T02:15:59.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.445+0000 7fbbf4e72640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fbbf0072cb0 con 0x7fbbf0143bc0 2024-04-25T02:15:59.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.445+0000 7fbbf4e72640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf015fa40 con 0x7fbbf006df50 2024-04-25T02:15:59.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.446+0000 7fbbeed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbf00b48e0 0x7fbbf00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.446+0000 7fbbeed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbf00b48e0 0x7fbbf00b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58936/0 (socket says 172.21.15.79:58936) 2024-04-25T02:15:59.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.446+0000 7fbbeed9d640 1 -- 172.21.15.79:0/1887424540 learned_addr learned my addr 172.21.15.79:0/1887424540 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:59.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.446+0000 7fbbeed9d640 1 -- 172.21.15.79:0/1887424540 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbbf006df50 msgr2=0x7fbbf006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:59.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.446+0000 7fbbee59c640 1 --2- 172.21.15.79:0/1887424540 >> v2:172.21.15.189:3300/0 conn(0x7fbbf0143bc0 0x7fbbf015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.446+0000 7fbbedd9b640 1 --2- 172.21.15.79:0/1887424540 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbbf006df50 0x7fbbf006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.446+0000 7fbbeed9d640 1 --2- 172.21.15.79:0/1887424540 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbbf006df50 0x7fbbf006e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.446+0000 7fbbeed9d640 1 -- 172.21.15.79:0/1887424540 >> v2:172.21.15.189:3300/0 conn(0x7fbbf0143bc0 msgr2=0x7fbbf015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:59.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.446+0000 7fbbeed9d640 1 --2- 172.21.15.79:0/1887424540 >> v2:172.21.15.189:3300/0 conn(0x7fbbf0143bc0 0x7fbbf015f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.446+0000 7fbbeed9d640 1 -- 172.21.15.79:0/1887424540 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf0071e00 con 0x7fbbf00b48e0 2024-04-25T02:15:59.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.447+0000 7fbbeed9d640 1 --2- 172.21.15.79:0/1887424540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf00b48e0 0x7fbbf00b4d40 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0067b50 tx=0x7fbbe002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639261b830531591 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:59.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.447+0000 7fbbed59a640 1 -- 172.21.15.79:0/1887424540 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0037070 con 0x7fbbf00b48e0 2024-04-25T02:15:59.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.447+0000 7fbbed59a640 1 -- 172.21.15.79:0/1887424540 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe0032440 con 0x7fbbf00b48e0 2024-04-25T02:15:59.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.447+0000 7fbbed59a640 1 -- 172.21.15.79:0/1887424540 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0032810 con 0x7fbbf00b48e0 2024-04-25T02:15:59.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.447+0000 7fbbf4e72640 1 -- 172.21.15.79:0/1887424540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf00b48e0 msgr2=0x7fbbf00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.447+0000 7fbbf4e72640 1 --2- 172.21.15.79:0/1887424540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf00b48e0 0x7fbbf00b4d40 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0067b50 tx=0x7fbbe002a140 comp rx=0 tx=0).stop 2024-04-25T02:15:59.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.447+0000 7fbbf4e72640 1 -- 172.21.15.79:0/1887424540 shutdown_connections 2024-04-25T02:15:59.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.447+0000 7fbbf4e72640 1 --2- 172.21.15.79:0/1887424540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf00b48e0 0x7fbbf00b4d40 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.447+0000 7fbbf4e72640 1 --2- 172.21.15.79:0/1887424540 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbbf006df50 0x7fbbf006e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.447+0000 7fbbf4e72640 1 --2- 172.21.15.79:0/1887424540 >> v2:172.21.15.189:3300/0 conn(0x7fbbf0143bc0 0x7fbbf015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.447+0000 7fbbf4e72640 1 -- 172.21.15.79:0/1887424540 >> 172.21.15.79:0/1887424540 conn(0x7fbbf00cfc80 msgr2=0x7fbbf00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:59.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.447+0000 7fbbf4e72640 1 -- 172.21.15.79:0/1887424540 shutdown_connections 2024-04-25T02:15:59.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.447+0000 7fbbf4e72640 1 -- 172.21.15.79:0/1887424540 wait complete. 2024-04-25T02:15:59.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.449+0000 7fbbf4e72640 1 Processor -- start 2024-04-25T02:15:59.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.449+0000 7fbbf4e72640 1 -- start start 2024-04-25T02:15:59.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.449+0000 7fbbf4e72640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbbf006df50 0x7fbbf0156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.449+0000 7fbbf4e72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf00b48e0 0x7fbbf015aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.449+0000 7fbbf4e72640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbf0143bc0 0x7fbbf015b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.449+0000 7fbbf4e72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0072660 con 0x7fbbf00b48e0 2024-04-25T02:15:59.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.449+0000 7fbbf4e72640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0072380 con 0x7fbbf0143bc0 2024-04-25T02:15:59.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.449+0000 7fbbf4e72640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf0072940 con 0x7fbbf006df50 2024-04-25T02:15:59.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.449+0000 7fbbedd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf00b48e0 0x7fbbf015aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.449+0000 7fbbedd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf00b48e0 0x7fbbf015aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58942/0 (socket says 172.21.15.79:58942) 2024-04-25T02:15:59.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.449+0000 7fbbedd9b640 1 -- 172.21.15.79:0/2478844109 learned_addr learned my addr 172.21.15.79:0/2478844109 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:59.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.450+0000 7fbbeed9d640 1 --2- 172.21.15.79:0/2478844109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbf0143bc0 0x7fbbf015b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.450+0000 7fbbee59c640 1 --2- 172.21.15.79:0/2478844109 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbbf006df50 0x7fbbf0156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.450+0000 7fbbedd9b640 1 -- 172.21.15.79:0/2478844109 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbbf006df50 msgr2=0x7fbbf0156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.450+0000 7fbbedd9b640 1 --2- 172.21.15.79:0/2478844109 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbbf006df50 0x7fbbf0156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.450+0000 7fbbedd9b640 1 -- 172.21.15.79:0/2478844109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbf0143bc0 msgr2=0x7fbbf015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.450+0000 7fbbedd9b640 1 --2- 172.21.15.79:0/2478844109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbf0143bc0 0x7fbbf015b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.450+0000 7fbbedd9b640 1 -- 172.21.15.79:0/2478844109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf00afa40 con 0x7fbbf00b48e0 2024-04-25T02:15:59.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.450+0000 7fbbedd9b640 1 --2- 172.21.15.79:0/2478844109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf00b48e0 0x7fbbf015aac0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400c5a0 tx=0x7fbbe400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:59.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.450+0000 7fbbdeffd640 1 -- 172.21.15.79:0/2478844109 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4015070 con 0x7fbbf00b48e0 2024-04-25T02:15:59.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.450+0000 7fbbdeffd640 1 -- 172.21.15.79:0/2478844109 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe4004220 con 0x7fbbf00b48e0 2024-04-25T02:15:59.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.450+0000 7fbbf4e72640 1 -- 172.21.15.79:0/2478844109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf00afd20 con 0x7fbbf00b48e0 2024-04-25T02:15:59.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.450+0000 7fbbdeffd640 1 -- 172.21.15.79:0/2478844109 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4003610 con 0x7fbbf00b48e0 2024-04-25T02:15:59.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.450+0000 7fbbf4e72640 1 -- 172.21.15.79:0/2478844109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf00b02e0 con 0x7fbbf00b48e0 2024-04-25T02:15:59.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.451+0000 7fbbf4e72640 1 -- 172.21.15.79:0/2478844109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf00690a0 con 0x7fbbf00b48e0 2024-04-25T02:15:59.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.451+0000 7fbbdeffd640 1 -- 172.21.15.79:0/2478844109 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbbe40037b0 con 0x7fbbf00b48e0 2024-04-25T02:15:59.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.452+0000 7fbbdeffd640 1 --2- 172.21.15.79:0/2478844109 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbbd006be30 0x7fbbd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.452+0000 7fbbee59c640 1 --2- 172.21.15.79:0/2478844109 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbbd006be30 0x7fbbd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.452+0000 7fbbdeffd640 1 -- 172.21.15.79:0/2478844109 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7fbbe408ac20 con 0x7fbbf00b48e0 2024-04-25T02:15:59.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.452+0000 7fbbee59c640 1 --2- 172.21.15.79:0/2478844109 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbbd006be30 0x7fbbd006e2f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8008ef0 tx=0x7fbbe8008440 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:59.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.456+0000 7fbbdeffd640 1 -- 172.21.15.79:0/2478844109 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbbe40595d0 con 0x7fbbf00b48e0 2024-04-25T02:15:59.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.629+0000 7fbbf4e72640 1 -- 172.21.15.79:0/2478844109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbf01441f0 con 0x7fbbf00b48e0 2024-04-25T02:15:59.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.630+0000 7fbbdeffd640 1 -- 172.21.15.79:0/2478844109 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16644 (secure 0 0 0) 0x7fbbe4058ed0 con 0x7fbbf00b48e0 2024-04-25T02:15:59.635 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:15:59.635 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":101,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:15:58.363133+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:15:56.581482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T02:15:57.334060+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:15:59.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.632+0000 7fbbf4e72640 1 -- 172.21.15.79:0/2478844109 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbbd006be30 msgr2=0x7fbbd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.632+0000 7fbbf4e72640 1 --2- 172.21.15.79:0/2478844109 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbbd006be30 0x7fbbd006e2f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8008ef0 tx=0x7fbbe8008440 comp rx=0 tx=0).stop 2024-04-25T02:15:59.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.632+0000 7fbbf4e72640 1 -- 172.21.15.79:0/2478844109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf00b48e0 msgr2=0x7fbbf015aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.632+0000 7fbbf4e72640 1 --2- 172.21.15.79:0/2478844109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf00b48e0 0x7fbbf015aac0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400c5a0 tx=0x7fbbe400ca60 comp rx=0 tx=0).stop 2024-04-25T02:15:59.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.632+0000 7fbbf4e72640 1 -- 172.21.15.79:0/2478844109 shutdown_connections 2024-04-25T02:15:59.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.632+0000 7fbbf4e72640 1 --2- 172.21.15.79:0/2478844109 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbbd006be30 0x7fbbd006e2f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.632+0000 7fbbf4e72640 1 --2- 172.21.15.79:0/2478844109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbf0143bc0 0x7fbbf015b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.632+0000 7fbbf4e72640 1 --2- 172.21.15.79:0/2478844109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf00b48e0 0x7fbbf015aac0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.632+0000 7fbbf4e72640 1 --2- 172.21.15.79:0/2478844109 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbbf006df50 0x7fbbf0156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.632+0000 7fbbf4e72640 1 -- 172.21.15.79:0/2478844109 >> 172.21.15.79:0/2478844109 conn(0x7fbbf00cfc80 msgr2=0x7fbbf00b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:59.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.632+0000 7fbbf4e72640 1 -- 172.21.15.79:0/2478844109 shutdown_connections 2024-04-25T02:15:59.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.632+0000 7fbbf4e72640 1 -- 172.21.15.79:0/2478844109 wait complete. 2024-04-25T02:15:59.648 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T02:15:59.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.743+0000 7f2c2af5a640 1 Processor -- start 2024-04-25T02:15:59.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.743+0000 7f2c2af5a640 1 -- start start 2024-04-25T02:15:59.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c2af5a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c2406b2f0 0x7f2c240b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c2af5a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2c240cf7a0 0x7f2c2406b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c2af5a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c2406bc10 con 0x7f2c2406e6b0 2024-04-25T02:15:59.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c2af5a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f2c2415f830 con 0x7f2c240cf7a0 2024-04-25T02:15:59.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c2af5a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2415ec20 con 0x7f2c2406b2f0 2024-04-25T02:15:59.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c294f7640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2c2406e6b0 0x7f2c240cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46734/0 (socket says 172.21.15.79:46734) 2024-04-25T02:15:59.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c294f7640 1 -- 172.21.15.79:0/1833700084 learned_addr learned my addr 172.21.15.79:0/1833700084 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:15:59.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 -- 172.21.15.79:0/1833700084 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863792444 0 0) 0x7f2c2406bc10 con 0x7f2c2406e6b0 2024-04-25T02:15:59.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c23fff640 1 --2- 172.21.15.79:0/1833700084 >> v2:172.21.15.189:3300/0 conn(0x7f2c240cf7a0 0x7f2c2406b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 -- 172.21.15.79:0/1833700084 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c14003520 con 0x7f2c2406e6b0 2024-04-25T02:15:59.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c28cf6640 1 --2- 172.21.15.79:0/1833700084 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c2406b2f0 0x7f2c240b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 -- 172.21.15.79:0/1833700084 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 499249914 0 0) 0x7f2c14003520 con 0x7f2c2406e6b0 2024-04-25T02:15:59.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 -- 172.21.15.79:0/1833700084 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c2406b2f0 msgr2=0x7f2c240b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:59.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 --2- 172.21.15.79:0/1833700084 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c2406b2f0 0x7f2c240b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 -- 172.21.15.79:0/1833700084 >> v2:172.21.15.189:3300/0 conn(0x7f2c240cf7a0 msgr2=0x7f2c2406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:59.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 --2- 172.21.15.79:0/1833700084 >> v2:172.21.15.189:3300/0 conn(0x7f2c240cf7a0 0x7f2c2406b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 -- 172.21.15.79:0/1833700084 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2415ef00 con 0x7f2c2406e6b0 2024-04-25T02:15:59.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 -- 172.21.15.79:0/1833700084 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f2c1c0019f0 con 0x7f2c2406e6b0 2024-04-25T02:15:59.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c28cf6640 1 --2- 172.21.15.79:0/1833700084 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c2406b2f0 0x7f2c240b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:59.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 -- 172.21.15.79:0/1833700084 >> v1:172.21.15.79:6789/0 conn(0x7f2c2406e6b0 legacy=0x7f2c240cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 --2- 172.21.15.79:0/1833700084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c140039b0 0x7f2c14003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 --2- 172.21.15.79:0/1833700084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c14004800 0x7f2c14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 --2- 172.21.15.79:0/1833700084 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c2406b2f0 0x7f2c140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 -- 172.21.15.79:0/1833700084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2415f830 con 0x7f2c140039b0 2024-04-25T02:15:59.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 -- 172.21.15.79:0/1833700084 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2415ec20 con 0x7f2c14004800 2024-04-25T02:15:59.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.744+0000 7f2c237fe640 1 -- 172.21.15.79:0/1833700084 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1400ba70 con 0x7f2c2406b2f0 2024-04-25T02:15:59.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.745+0000 7f2c28cf6640 1 --2- 172.21.15.79:0/1833700084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c140039b0 0x7f2c14003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.745+0000 7f2c23fff640 1 --2- 172.21.15.79:0/1833700084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c14004800 0x7f2c14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.745+0000 7f2c294f7640 1 --2- 172.21.15.79:0/1833700084 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c2406b2f0 0x7f2c140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.745+0000 7f2c28cf6640 1 -- 172.21.15.79:0/1833700084 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c2406b2f0 msgr2=0x7f2c140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:59.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.745+0000 7f2c28cf6640 1 --2- 172.21.15.79:0/1833700084 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c2406b2f0 0x7f2c140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.745+0000 7f2c28cf6640 1 -- 172.21.15.79:0/1833700084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c14004800 msgr2=0x7f2c14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:15:59.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.745+0000 7f2c28cf6640 1 --2- 172.21.15.79:0/1833700084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c14004800 0x7f2c14004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.745+0000 7f2c28cf6640 1 -- 172.21.15.79:0/1833700084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c14003520 con 0x7f2c140039b0 2024-04-25T02:15:59.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.745+0000 7f2c28cf6640 1 --2- 172.21.15.79:0/1833700084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c140039b0 0x7f2c14003dd0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f2c18006fd0 tx=0x7f2c14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6fa754d8e706060 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:59.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.746+0000 7f2c237fe640 1 -- 172.21.15.79:0/1833700084 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1800f040 con 0x7f2c140039b0 2024-04-25T02:15:59.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.746+0000 7f2c237fe640 1 -- 172.21.15.79:0/1833700084 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c1802ac70 con 0x7f2c140039b0 2024-04-25T02:15:59.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.746+0000 7f2c237fe640 1 -- 172.21.15.79:0/1833700084 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c18004250 con 0x7f2c140039b0 2024-04-25T02:15:59.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.746+0000 7f2c2af5a640 1 -- 172.21.15.79:0/1833700084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c140039b0 msgr2=0x7f2c14003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.746+0000 7f2c2af5a640 1 --2- 172.21.15.79:0/1833700084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c140039b0 0x7f2c14003dd0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f2c18006fd0 tx=0x7f2c14005830 comp rx=0 tx=0).stop 2024-04-25T02:15:59.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.746+0000 7f2c294f7640 1 -- 172.21.15.79:0/1833700084 reap_dead start 2024-04-25T02:15:59.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.746+0000 7f2c2af5a640 1 -- 172.21.15.79:0/1833700084 shutdown_connections 2024-04-25T02:15:59.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.746+0000 7f2c2af5a640 1 -- 172.21.15.79:0/1833700084 >> 172.21.15.79:0/1833700084 conn(0x7f2c240b1cd0 msgr2=0x7f2c240b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:59.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.746+0000 7f2c2af5a640 1 -- 172.21.15.79:0/1833700084 shutdown_connections 2024-04-25T02:15:59.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.746+0000 7f2c2af5a640 1 -- 172.21.15.79:0/1833700084 wait complete. 2024-04-25T02:15:59.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.747+0000 7f2c2af5a640 1 Processor -- start 2024-04-25T02:15:59.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.747+0000 7f2c2af5a640 1 -- start start 2024-04-25T02:15:59.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.748+0000 7f2c2af5a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c140039b0 0x7f2c24154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.748+0000 7f2c2af5a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c241486a0 0x7f2c2415d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.748+0000 7f2c2af5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c24155010 0x7f2c24155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.748+0000 7f2c2af5a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2406cfe0 con 0x7f2c24155010 2024-04-25T02:15:59.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.748+0000 7f2c2af5a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2415f4c0 con 0x7f2c241486a0 2024-04-25T02:15:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.748+0000 7f2c2af5a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2406d160 con 0x7f2c140039b0 2024-04-25T02:15:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.748+0000 7f2c294f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c24155010 0x7f2c24155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.748+0000 7f2c294f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c24155010 0x7f2c24155490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58960/0 (socket says 172.21.15.79:58960) 2024-04-25T02:15:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.748+0000 7f2c294f7640 1 -- 172.21.15.79:0/480663267 learned_addr learned my addr 172.21.15.79:0/480663267 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:15:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.749+0000 7f2c28cf6640 1 --2- 172.21.15.79:0/480663267 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c140039b0 0x7f2c24154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.749+0000 7f2c23fff640 1 --2- 172.21.15.79:0/480663267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c241486a0 0x7f2c2415d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.749+0000 7f2c294f7640 1 -- 172.21.15.79:0/480663267 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c140039b0 msgr2=0x7f2c24154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.749+0000 7f2c294f7640 1 --2- 172.21.15.79:0/480663267 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c140039b0 0x7f2c24154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.749+0000 7f2c294f7640 1 -- 172.21.15.79:0/480663267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c241486a0 msgr2=0x7f2c2415d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.749+0000 7f2c294f7640 1 --2- 172.21.15.79:0/480663267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c241486a0 0x7f2c2415d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.749+0000 7f2c294f7640 1 -- 172.21.15.79:0/480663267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2409cd20 con 0x7f2c24155010 2024-04-25T02:15:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.749+0000 7f2c294f7640 1 --2- 172.21.15.79:0/480663267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c24155010 0x7f2c24155490 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f2c2406efa0 tx=0x7f2c1c00a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.749+0000 7f2c217fa640 1 -- 172.21.15.79:0/480663267 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c00acd0 con 0x7f2c24155010 2024-04-25T02:15:59.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.749+0000 7f2c217fa640 1 -- 172.21.15.79:0/480663267 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c1c018070 con 0x7f2c24155010 2024-04-25T02:15:59.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.749+0000 7f2c2af5a640 1 -- 172.21.15.79:0/480663267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c2409d000 con 0x7f2c24155010 2024-04-25T02:15:59.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.749+0000 7f2c217fa640 1 -- 172.21.15.79:0/480663267 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c013610 con 0x7f2c24155010 2024-04-25T02:15:59.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.749+0000 7f2c2af5a640 1 -- 172.21.15.79:0/480663267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c2409d5c0 con 0x7f2c24155010 2024-04-25T02:15:59.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.750+0000 7f2c2af5a640 1 -- 172.21.15.79:0/480663267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c240690a0 con 0x7f2c24155010 2024-04-25T02:15:59.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.750+0000 7f2c217fa640 1 -- 172.21.15.79:0/480663267 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c1c0137b0 con 0x7f2c24155010 2024-04-25T02:15:59.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.751+0000 7f2c217fa640 1 --2- 172.21.15.79:0/480663267 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2c0806be30 0x7f2c0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:59.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.751+0000 7f2c217fa640 1 -- 172.21.15.79:0/480663267 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f2c1c08b510 con 0x7f2c24155010 2024-04-25T02:15:59.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.751+0000 7f2c28cf6640 1 --2- 172.21.15.79:0/480663267 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2c0806be30 0x7f2c0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:59.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.751+0000 7f2c28cf6640 1 --2- 172.21.15.79:0/480663267 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2c0806be30 0x7f2c0806e2f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2c18033000 tx=0x7f2c1802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:59.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.755+0000 7f2c217fa640 1 -- 172.21.15.79:0/480663267 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2c1c059ec0 con 0x7f2c24155010 2024-04-25T02:15:59.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:15:59.965+0000 7f2c2af5a640 1 -- 172.21.15.79:0/480663267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2c240cf4f0 con 0x7f2c24155010 2024-04-25T02:16:00.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:00.904+0000 7f2c217fa640 1 -- 172.21.15.79:0/480663267 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) ==== 118+0+0 (secure 0 0 0) 0x7f2c1c0597c0 con 0x7f2c24155010 2024-04-25T02:16:00.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:00.907+0000 7f2c2af5a640 1 -- 172.21.15.79:0/480663267 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2c0806be30 msgr2=0x7f2c0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:00.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:00.907+0000 7f2c2af5a640 1 --2- 172.21.15.79:0/480663267 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2c0806be30 0x7f2c0806e2f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2c18033000 tx=0x7f2c1802e000 comp rx=0 tx=0).stop 2024-04-25T02:16:00.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:00.907+0000 7f2c2af5a640 1 -- 172.21.15.79:0/480663267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c24155010 msgr2=0x7f2c24155490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:00.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:00.907+0000 7f2c2af5a640 1 --2- 172.21.15.79:0/480663267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c24155010 0x7f2c24155490 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f2c2406efa0 tx=0x7f2c1c00a6a0 comp rx=0 tx=0).stop 2024-04-25T02:16:00.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:00.907+0000 7f2c2af5a640 1 -- 172.21.15.79:0/480663267 shutdown_connections 2024-04-25T02:16:00.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:00.907+0000 7f2c2af5a640 1 --2- 172.21.15.79:0/480663267 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2c0806be30 0x7f2c0806e2f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:00.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:00.907+0000 7f2c2af5a640 1 --2- 172.21.15.79:0/480663267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c24155010 0x7f2c24155490 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:00.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:00.907+0000 7f2c2af5a640 1 --2- 172.21.15.79:0/480663267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c241486a0 0x7f2c2415d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:00.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:00.907+0000 7f2c2af5a640 1 --2- 172.21.15.79:0/480663267 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c140039b0 0x7f2c24154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:00.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:00.907+0000 7f2c2af5a640 1 -- 172.21.15.79:0/480663267 >> 172.21.15.79:0/480663267 conn(0x7f2c240b1cd0 msgr2=0x7f2c240ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:00.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:00.907+0000 7f2c2af5a640 1 -- 172.21.15.79:0/480663267 shutdown_connections 2024-04-25T02:16:00.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:00.907+0000 7f2c2af5a640 1 -- 172.21.15.79:0/480663267 wait complete. 2024-04-25T02:16:00.925 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T02:16:00.926 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T02:16:01.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.030+0000 7fce2a5e7640 1 Processor -- start 2024-04-25T02:16:01.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.030+0000 7fce2a5e7640 1 -- start start 2024-04-25T02:16:01.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.031+0000 7fce2a5e7640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fce2415e3b0 0x7fce240721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:01.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.031+0000 7fce2a5e7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce2406c7d0 0x7fce240c9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:01.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.031+0000 7fce2a5e7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce2415e790 con 0x7fce2406fdd0 2024-04-25T02:16:01.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.031+0000 7fce2a5e7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fce24161e80 con 0x7fce2406c7d0 2024-04-25T02:16:01.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.031+0000 7fce2a5e7640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fce241620d0 con 0x7fce2415e3b0 2024-04-25T02:16:01.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.031+0000 7fce28b84640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce2406c7d0 0x7fce240c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:01.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.031+0000 7fce237fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fce2406fdd0 0x7fce2406c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46744/0 (socket says 172.21.15.79:46744) 2024-04-25T02:16:01.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.031+0000 7fce237fe640 1 -- 172.21.15.79:0/937421718 learned_addr learned my addr 172.21.15.79:0/937421718 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:01.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.031+0000 7fce23fff640 1 --2- 172.21.15.79:0/937421718 >> v2:172.21.15.189:3300/0 conn(0x7fce2415e3b0 0x7fce240721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:01.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.031+0000 7fce28b84640 1 -- 172.21.15.79:0/937421718 >> v2:172.21.15.189:3300/0 conn(0x7fce2415e3b0 msgr2=0x7fce240721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:01.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.031+0000 7fce28b84640 1 --2- 172.21.15.79:0/937421718 >> v2:172.21.15.189:3300/0 conn(0x7fce2415e3b0 0x7fce240721a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:01.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.031+0000 7fce28b84640 1 -- 172.21.15.79:0/937421718 >> v1:172.21.15.79:6789/0 conn(0x7fce2406fdd0 legacy=0x7fce2406c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:01.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.031+0000 7fce28b84640 1 -- 172.21.15.79:0/937421718 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce241623b0 con 0x7fce2406c7d0 2024-04-25T02:16:01.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.032+0000 7fce28b84640 1 --2- 172.21.15.79:0/937421718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce2406c7d0 0x7fce240c9890 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fce24072e80 tx=0x7fce1c02a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996f7096e0d63994 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:01.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.034+0000 7fce22ffd640 1 -- 172.21.15.79:0/937421718 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c007740 con 0x7fce2406c7d0 2024-04-25T02:16:01.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.034+0000 7fce22ffd640 1 -- 172.21.15.79:0/937421718 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1c0078e0 con 0x7fce2406c7d0 2024-04-25T02:16:01.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.034+0000 7fce22ffd640 1 -- 172.21.15.79:0/937421718 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c007cb0 con 0x7fce2406c7d0 2024-04-25T02:16:01.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.035+0000 7fce2a5e7640 1 -- 172.21.15.79:0/937421718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce2406c7d0 msgr2=0x7fce240c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:01.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.035+0000 7fce2a5e7640 1 --2- 172.21.15.79:0/937421718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce2406c7d0 0x7fce240c9890 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fce24072e80 tx=0x7fce1c02a560 comp rx=0 tx=0).stop 2024-04-25T02:16:01.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.035+0000 7fce2a5e7640 1 -- 172.21.15.79:0/937421718 shutdown_connections 2024-04-25T02:16:01.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.035+0000 7fce2a5e7640 1 --2- 172.21.15.79:0/937421718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce2406c7d0 0x7fce240c9890 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:01.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.035+0000 7fce2a5e7640 1 --2- 172.21.15.79:0/937421718 >> v2:172.21.15.189:3300/0 conn(0x7fce2415e3b0 0x7fce240721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:01.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.035+0000 7fce2a5e7640 1 -- 172.21.15.79:0/937421718 >> 172.21.15.79:0/937421718 conn(0x7fce240716b0 msgr2=0x7fce24071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:01.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.035+0000 7fce2a5e7640 1 -- 172.21.15.79:0/937421718 shutdown_connections 2024-04-25T02:16:01.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.035+0000 7fce2a5e7640 1 -- 172.21.15.79:0/937421718 wait complete. 2024-04-25T02:16:01.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.036+0000 7fce2a5e7640 1 Processor -- start 2024-04-25T02:16:01.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.036+0000 7fce2a5e7640 1 -- start start 2024-04-25T02:16:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce2a5e7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2406c7d0 0x7fce24143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce2a5e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce2406fdd0 0x7fce2406f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce2a5e7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce2415e3b0 0x7fce2415cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce2a5e7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce240cf150 con 0x7fce2406fdd0 2024-04-25T02:16:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce2a5e7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce24162970 con 0x7fce2406c7d0 2024-04-25T02:16:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce2a5e7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fce240cf2d0 con 0x7fce2415e3b0 2024-04-25T02:16:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce237fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce2406fdd0 0x7fce2406f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce237fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce2406fdd0 0x7fce2406f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58980/0 (socket says 172.21.15.79:58980) 2024-04-25T02:16:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce237fe640 1 -- 172.21.15.79:0/4284649965 learned_addr learned my addr 172.21.15.79:0/4284649965 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce28b84640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce2415e3b0 0x7fce2415cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce23fff640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2406c7d0 0x7fce24143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce237fe640 1 -- 172.21.15.79:0/4284649965 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce2415e3b0 msgr2=0x7fce2415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce237fe640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce2415e3b0 0x7fce2415cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce237fe640 1 -- 172.21.15.79:0/4284649965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2406c7d0 msgr2=0x7fce24143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce237fe640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2406c7d0 0x7fce24143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce237fe640 1 -- 172.21.15.79:0/4284649965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2414d2d0 con 0x7fce2406fdd0 2024-04-25T02:16:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce23fff640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2406c7d0 0x7fce24143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.037+0000 7fce28b84640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce2415e3b0 0x7fce2415cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.038+0000 7fce237fe640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce2406fdd0 0x7fce2406f360 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fce1800c430 tx=0x7fce1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.038+0000 7fce20ff9640 1 -- 172.21.15.79:0/4284649965 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18017070 con 0x7fce2406fdd0 2024-04-25T02:16:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.038+0000 7fce20ff9640 1 -- 172.21.15.79:0/4284649965 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce18005ce0 con 0x7fce2406fdd0 2024-04-25T02:16:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.038+0000 7fce20ff9640 1 -- 172.21.15.79:0/4284649965 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce180072f0 con 0x7fce2406fdd0 2024-04-25T02:16:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.038+0000 7fce2a5e7640 1 -- 172.21.15.79:0/4284649965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce240b3630 con 0x7fce2406fdd0 2024-04-25T02:16:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.038+0000 7fce2a5e7640 1 -- 172.21.15.79:0/4284649965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce240b3bf0 con 0x7fce2406fdd0 2024-04-25T02:16:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.039+0000 7fce2a5e7640 1 -- 172.21.15.79:0/4284649965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce240690a0 con 0x7fce2406fdd0 2024-04-25T02:16:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.039+0000 7fce20ff9640 1 -- 172.21.15.79:0/4284649965 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce1801a070 con 0x7fce2406fdd0 2024-04-25T02:16:01.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.040+0000 7fce20ff9640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce1006be30 0x7fce1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:01.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.040+0000 7fce20ff9640 1 -- 172.21.15.79:0/4284649965 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7fce1808a1d0 con 0x7fce2406fdd0 2024-04-25T02:16:01.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.040+0000 7fce23fff640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce1006be30 0x7fce1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:01.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.040+0000 7fce23fff640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce1006be30 0x7fce1006e2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fce14006fd0 tx=0x7fce14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:01.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.044+0000 7fce20ff9640 1 -- 172.21.15.79:0/4284649965 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fce18058c10 con 0x7fce2406fdd0 2024-04-25T02:16:01.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:01.254+0000 7fce2a5e7640 1 -- 172.21.15.79:0/4284649965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fce2406bda0 con 0x7fce2406fdd0 2024-04-25T02:16:01.528 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:16:01.531 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:16:02.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.038+0000 7fce20ff9640 1 -- 172.21.15.79:0/4284649965 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) ==== 122+0+0 (secure 0 0 0) 0x7fce18058510 con 0x7fce2406fdd0 2024-04-25T02:16:02.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.041+0000 7fce2a5e7640 1 -- 172.21.15.79:0/4284649965 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce1006be30 msgr2=0x7fce1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.041+0000 7fce2a5e7640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce1006be30 0x7fce1006e2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fce14006fd0 tx=0x7fce14008040 comp rx=0 tx=0).stop 2024-04-25T02:16:02.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.041+0000 7fce2a5e7640 1 -- 172.21.15.79:0/4284649965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce2406fdd0 msgr2=0x7fce2406f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.041+0000 7fce2a5e7640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce2406fdd0 0x7fce2406f360 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fce1800c430 tx=0x7fce1800c8f0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.041+0000 7fce2a5e7640 1 -- 172.21.15.79:0/4284649965 shutdown_connections 2024-04-25T02:16:02.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.041+0000 7fce2a5e7640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce1006be30 0x7fce1006e2f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.041+0000 7fce2a5e7640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce2415e3b0 0x7fce2415cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.041+0000 7fce2a5e7640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce2406fdd0 0x7fce2406f360 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.041+0000 7fce2a5e7640 1 --2- 172.21.15.79:0/4284649965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2406c7d0 0x7fce24143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.041+0000 7fce2a5e7640 1 -- 172.21.15.79:0/4284649965 >> 172.21.15.79:0/4284649965 conn(0x7fce240716b0 msgr2=0x7fce2406b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.041+0000 7fce2a5e7640 1 -- 172.21.15.79:0/4284649965 shutdown_connections 2024-04-25T02:16:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.041+0000 7fce2a5e7640 1 -- 172.21.15.79:0/4284649965 wait complete. 2024-04-25T02:16:02.057 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T02:16:02.057 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:16:02.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.149+0000 7fc64fa1b640 1 Processor -- start 2024-04-25T02:16:02.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.150+0000 7fc64fa1b640 1 -- start start 2024-04-25T02:16:02.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.150+0000 7fc64fa1b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc64815e4d0 0x7fc64806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.150+0000 7fc64fa1b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6480d2e20 0x7fc6480cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.150+0000 7fc64fa1b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6480d1660 con 0x7fc6480b3570 2024-04-25T02:16:02.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.150+0000 7fc64fa1b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc6480d1380 con 0x7fc64815e4d0 2024-04-25T02:16:02.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.150+0000 7fc64fa1b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc6480cede0 con 0x7fc6480d2e20 2024-04-25T02:16:02.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.151+0000 7fc64d7b7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc64815e4d0 0x7fc64806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:02.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.151+0000 7fc64cfb6640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc6480b3570 0x7fc6480d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46758/0 (socket says 172.21.15.79:46758) 2024-04-25T02:16:02.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.151+0000 7fc64cfb6640 1 -- 172.21.15.79:0/3380870279 learned_addr learned my addr 172.21.15.79:0/3380870279 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:02.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.151+0000 7fc64d7b7640 1 -- 172.21.15.79:0/3380870279 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6480d2e20 msgr2=0x7fc6480cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:02.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.151+0000 7fc64d7b7640 1 --2- 172.21.15.79:0/3380870279 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6480d2e20 0x7fc6480cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.151+0000 7fc64d7b7640 1 -- 172.21.15.79:0/3380870279 >> v1:172.21.15.79:6789/0 conn(0x7fc6480b3570 legacy=0x7fc6480d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.151+0000 7fc64d7b7640 1 -- 172.21.15.79:0/3380870279 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6480cf0c0 con 0x7fc64815e4d0 2024-04-25T02:16:02.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.151+0000 7fc64d7b7640 1 --2- 172.21.15.79:0/3380870279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc64815e4d0 0x7fc64806bc70 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fc6380097d0 tx=0x7fc63802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d81397387c31294 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:02.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.152+0000 7fc63ffff640 1 -- 172.21.15.79:0/3380870279 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638037070 con 0x7fc64815e4d0 2024-04-25T02:16:02.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.152+0000 7fc63ffff640 1 -- 172.21.15.79:0/3380870279 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc638032440 con 0x7fc64815e4d0 2024-04-25T02:16:02.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.152+0000 7fc63ffff640 1 -- 172.21.15.79:0/3380870279 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638032810 con 0x7fc64815e4d0 2024-04-25T02:16:02.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.152+0000 7fc64fa1b640 1 -- 172.21.15.79:0/3380870279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc64815e4d0 msgr2=0x7fc64806bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.152+0000 7fc64fa1b640 1 --2- 172.21.15.79:0/3380870279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc64815e4d0 0x7fc64806bc70 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fc6380097d0 tx=0x7fc63802a1e0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.152+0000 7fc64fa1b640 1 -- 172.21.15.79:0/3380870279 shutdown_connections 2024-04-25T02:16:02.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.152+0000 7fc64fa1b640 1 --2- 172.21.15.79:0/3380870279 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6480d2e20 0x7fc6480cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.152+0000 7fc64fa1b640 1 --2- 172.21.15.79:0/3380870279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc64815e4d0 0x7fc64806bc70 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.152+0000 7fc64fa1b640 1 -- 172.21.15.79:0/3380870279 >> 172.21.15.79:0/3380870279 conn(0x7fc64809d460 msgr2=0x7fc6480d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:02.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.152+0000 7fc64fa1b640 1 -- 172.21.15.79:0/3380870279 shutdown_connections 2024-04-25T02:16:02.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.152+0000 7fc64fa1b640 1 -- 172.21.15.79:0/3380870279 wait complete. 2024-04-25T02:16:02.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.153+0000 7fc64fa1b640 1 Processor -- start 2024-04-25T02:16:02.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.153+0000 7fc64fa1b640 1 -- start start 2024-04-25T02:16:02.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.154+0000 7fc64fa1b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6480b3570 0x7fc64814e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.154+0000 7fc64fa1b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6480d2e20 0x7fc6480b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.154+0000 7fc64fa1b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc64815e4d0 0x7fc6480b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.154+0000 7fc64fa1b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6480d2250 con 0x7fc6480b3570 2024-04-25T02:16:02.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.154+0000 7fc64fa1b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc6480d20d0 con 0x7fc6480d2e20 2024-04-25T02:16:02.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.154+0000 7fc64fa1b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc64806c1b0 con 0x7fc64815e4d0 2024-04-25T02:16:02.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.154+0000 7fc64d7b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6480b3570 0x7fc64814e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:02.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.154+0000 7fc64d7b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6480b3570 0x7fc64814e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59012/0 (socket says 172.21.15.79:59012) 2024-04-25T02:16:02.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.154+0000 7fc64d7b7640 1 -- 172.21.15.79:0/947009358 learned_addr learned my addr 172.21.15.79:0/947009358 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.154+0000 7fc64dfb8640 1 --2- 172.21.15.79:0/947009358 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc64815e4d0 0x7fc6480b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.154+0000 7fc64d7b7640 1 -- 172.21.15.79:0/947009358 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc64815e4d0 msgr2=0x7fc6480b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.154+0000 7fc64d7b7640 1 --2- 172.21.15.79:0/947009358 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc64815e4d0 0x7fc6480b5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.154+0000 7fc64d7b7640 1 -- 172.21.15.79:0/947009358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6480d2e20 msgr2=0x7fc6480b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.154+0000 7fc64d7b7640 1 --2- 172.21.15.79:0/947009358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6480d2e20 0x7fc6480b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.154+0000 7fc64d7b7640 1 -- 172.21.15.79:0/947009358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6480b3c60 con 0x7fc6480b3570 2024-04-25T02:16:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.155+0000 7fc64d7b7640 1 --2- 172.21.15.79:0/947009358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6480b3570 0x7fc64814e670 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fc6380097d0 tx=0x7fc6380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.155+0000 7fc63dffb640 1 -- 172.21.15.79:0/947009358 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638041070 con 0x7fc6480b3570 2024-04-25T02:16:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.155+0000 7fc63dffb640 1 -- 172.21.15.79:0/947009358 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63803c890 con 0x7fc6480b3570 2024-04-25T02:16:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.155+0000 7fc64fa1b640 1 -- 172.21.15.79:0/947009358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6480b3f40 con 0x7fc6480b3570 2024-04-25T02:16:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.155+0000 7fc63dffb640 1 -- 172.21.15.79:0/947009358 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638037040 con 0x7fc6480b3570 2024-04-25T02:16:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.155+0000 7fc64fa1b640 1 -- 172.21.15.79:0/947009358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6480b4500 con 0x7fc6480b3570 2024-04-25T02:16:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.156+0000 7fc64fa1b640 1 -- 172.21.15.79:0/947009358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6480690a0 con 0x7fc6480b3570 2024-04-25T02:16:02.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.156+0000 7fc63dffb640 1 -- 172.21.15.79:0/947009358 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc638044070 con 0x7fc6480b3570 2024-04-25T02:16:02.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.157+0000 7fc63dffb640 1 --2- 172.21.15.79:0/947009358 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc62c06be60 0x7fc62c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.157+0000 7fc63dffb640 1 -- 172.21.15.79:0/947009358 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7fc6380ab990 con 0x7fc6480b3570 2024-04-25T02:16:02.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.157+0000 7fc64cfb6640 1 --2- 172.21.15.79:0/947009358 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc62c06be60 0x7fc62c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:02.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.157+0000 7fc64cfb6640 1 --2- 172.21.15.79:0/947009358 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc62c06be60 0x7fc62c06e320 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc644000f60 tx=0x7fc644007a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:02.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.161+0000 7fc63dffb640 1 -- 172.21.15.79:0/947009358 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc63807a3d0 con 0x7fc6480b3570 2024-04-25T02:16:02.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.368+0000 7fc64fa1b640 1 -- 172.21.15.79:0/947009358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc648162e20 con 0x7fc6480b3570 2024-04-25T02:16:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.369+0000 7fc63dffb640 1 -- 172.21.15.79:0/947009358 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5189 (secure 0 0 0) 0x7fc638079cd0 con 0x7fc6480b3570 2024-04-25T02:16:02.374 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:02.374 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1086166830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1086166830},{"type":"v1","addr":"172.21.15.189:6834","nonce":1086166830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2468340230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2468340230},{"type":"v1","addr":"172.21.15.189:6835","nonce":2468340230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3582530322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3582530322},{"type":"v1","addr":"172.21.15.79:6836","nonce":3582530322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:15:58.363457+0000","modified":"2024-04-25T02:16:01.255271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8271":{"gid":8271,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2774759267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2774759267},{"type":"v1","addr":"172.21.15.79:6837","nonce":2774759267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8271,"qdb_cluster":[8271]},"id":7}]} 2024-04-25T02:16:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 68 2024-04-25T02:16:02.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.371+0000 7fc64fa1b640 1 -- 172.21.15.79:0/947009358 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc62c06be60 msgr2=0x7fc62c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.371+0000 7fc64fa1b640 1 --2- 172.21.15.79:0/947009358 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc62c06be60 0x7fc62c06e320 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc644000f60 tx=0x7fc644007a80 comp rx=0 tx=0).stop 2024-04-25T02:16:02.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.371+0000 7fc64fa1b640 1 -- 172.21.15.79:0/947009358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6480b3570 msgr2=0x7fc64814e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.371+0000 7fc64fa1b640 1 --2- 172.21.15.79:0/947009358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6480b3570 0x7fc64814e670 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fc6380097d0 tx=0x7fc6380046c0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.371+0000 7fc64fa1b640 1 -- 172.21.15.79:0/947009358 shutdown_connections 2024-04-25T02:16:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.371+0000 7fc64fa1b640 1 --2- 172.21.15.79:0/947009358 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc62c06be60 0x7fc62c06e320 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.371+0000 7fc64fa1b640 1 --2- 172.21.15.79:0/947009358 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc64815e4d0 0x7fc6480b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.371+0000 7fc64fa1b640 1 --2- 172.21.15.79:0/947009358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6480d2e20 0x7fc6480b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.371+0000 7fc64fa1b640 1 --2- 172.21.15.79:0/947009358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6480b3570 0x7fc64814e670 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.371+0000 7fc64fa1b640 1 -- 172.21.15.79:0/947009358 >> 172.21.15.79:0/947009358 conn(0x7fc64809d460 msgr2=0x7fc6480b6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.371+0000 7fc64fa1b640 1 -- 172.21.15.79:0/947009358 shutdown_connections 2024-04-25T02:16:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.371+0000 7fc64fa1b640 1 -- 172.21.15.79:0/947009358 wait complete. 2024-04-25T02:16:02.387 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:16:02.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.478+0000 7f158789e640 1 Processor -- start 2024-04-25T02:16:02.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.479+0000 7f158789e640 1 -- start start 2024-04-25T02:16:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.479+0000 7f158789e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15800d2e20 0x7f15800cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.479+0000 7f158789e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158006c380 con 0x7f158015e4d0 2024-04-25T02:16:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.479+0000 7f158789e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15800d1660 con 0x7f15800b3570 2024-04-25T02:16:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.479+0000 7f158789e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f15800d1380 con 0x7f15800d2e20 2024-04-25T02:16:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.480+0000 7f1585e3b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15800d2e20 0x7f15800cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.480+0000 7f158563a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f158015e4d0 0x7f158006bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46764/0 (socket says 172.21.15.79:46764) 2024-04-25T02:16:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.480+0000 7f158563a640 1 -- 172.21.15.79:0/1317086860 learned_addr learned my addr 172.21.15.79:0/1317086860 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.480+0000 7f1585e3b640 1 -- 172.21.15.79:0/1317086860 >> v1:172.21.15.189:6789/0 conn(0x7f15800b3570 legacy=0x7f15800d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.480+0000 7f1585e3b640 1 -- 172.21.15.79:0/1317086860 >> v1:172.21.15.79:6789/0 conn(0x7f158015e4d0 legacy=0x7f158006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.480+0000 7f1577fff640 1 -- 172.21.15.79:0/1317086860 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1951240976 0 0) 0x7f158006c380 con 0x7f158015e4d0 2024-04-25T02:16:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.480+0000 7f1585e3b640 1 -- 172.21.15.79:0/1317086860 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15800cede0 con 0x7f15800d2e20 2024-04-25T02:16:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.481+0000 7f1585e3b640 1 --2- 172.21.15.79:0/1317086860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15800d2e20 0x7f15800cf5e0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f1578009dc0 tx=0x7f157802a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573c8bec331bd7f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.481+0000 7f1577fff640 1 -- 172.21.15.79:0/1317086860 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578007740 con 0x7f15800d2e20 2024-04-25T02:16:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.481+0000 7f1577fff640 1 -- 172.21.15.79:0/1317086860 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15780078e0 con 0x7f15800d2e20 2024-04-25T02:16:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.481+0000 7f1577fff640 1 -- 172.21.15.79:0/1317086860 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578007cb0 con 0x7f15800d2e20 2024-04-25T02:16:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.481+0000 7f158789e640 1 -- 172.21.15.79:0/1317086860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15800d2e20 msgr2=0x7f15800cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.481+0000 7f158789e640 1 --2- 172.21.15.79:0/1317086860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15800d2e20 0x7f15800cf5e0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f1578009dc0 tx=0x7f157802a6d0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.481+0000 7f158789e640 1 -- 172.21.15.79:0/1317086860 shutdown_connections 2024-04-25T02:16:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.481+0000 7f158789e640 1 --2- 172.21.15.79:0/1317086860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15800d2e20 0x7f15800cf5e0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.481+0000 7f158789e640 1 -- 172.21.15.79:0/1317086860 >> 172.21.15.79:0/1317086860 conn(0x7f158009d460 msgr2=0x7f15800d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.481+0000 7f158789e640 1 -- 172.21.15.79:0/1317086860 shutdown_connections 2024-04-25T02:16:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.481+0000 7f158789e640 1 -- 172.21.15.79:0/1317086860 wait complete. 2024-04-25T02:16:02.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.482+0000 7f158789e640 1 Processor -- start 2024-04-25T02:16:02.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.482+0000 7f158789e640 1 -- start start 2024-04-25T02:16:02.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.483+0000 7f158789e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15800b3570 0x7f15801555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.483+0000 7f158789e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15800d2e20 0x7f15800b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.483+0000 7f158789e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f158015e4d0 0x7f15800b91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.483+0000 7f158789e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15800d20d0 con 0x7f158015e4d0 2024-04-25T02:16:02.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.483+0000 7f158789e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f158015e8b0 con 0x7f15800b3570 2024-04-25T02:16:02.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.483+0000 7f158789e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f15800d2250 con 0x7f15800d2e20 2024-04-25T02:16:02.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.483+0000 7f1585e3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f158015e4d0 0x7f15800b91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:02.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.483+0000 7f1585e3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f158015e4d0 0x7f15800b91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59032/0 (socket says 172.21.15.79:59032) 2024-04-25T02:16:02.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.483+0000 7f1585e3b640 1 -- 172.21.15.79:0/1975486035 learned_addr learned my addr 172.21.15.79:0/1975486035 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:02.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.483+0000 7f1585e3b640 1 -- 172.21.15.79:0/1975486035 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15800d2e20 msgr2=0x7f15800b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.483+0000 7f1585e3b640 1 --2- 172.21.15.79:0/1975486035 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15800d2e20 0x7f15800b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.483+0000 7f1585e3b640 1 -- 172.21.15.79:0/1975486035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15800b3570 msgr2=0x7f15801555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.483+0000 7f1585e3b640 1 --2- 172.21.15.79:0/1975486035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15800b3570 0x7f15801555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.483+0000 7f1585e3b640 1 -- 172.21.15.79:0/1975486035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15800b7620 con 0x7f158015e4d0 2024-04-25T02:16:02.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.484+0000 7f1585e3b640 1 --2- 172.21.15.79:0/1975486035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f158015e4d0 0x7f15800b91a0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f1578009ee0 tx=0x7f1578004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:02.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.484+0000 7f1575ffb640 1 -- 172.21.15.79:0/1975486035 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578040070 con 0x7f158015e4d0 2024-04-25T02:16:02.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.484+0000 7f1575ffb640 1 -- 172.21.15.79:0/1975486035 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1578031c40 con 0x7f158015e4d0 2024-04-25T02:16:02.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.484+0000 7f158789e640 1 -- 172.21.15.79:0/1975486035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15800b7900 con 0x7f158015e4d0 2024-04-25T02:16:02.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.484+0000 7f1575ffb640 1 -- 172.21.15.79:0/1975486035 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157803c420 con 0x7f158015e4d0 2024-04-25T02:16:02.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.484+0000 7f158789e640 1 -- 172.21.15.79:0/1975486035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15800b7ec0 con 0x7f158015e4d0 2024-04-25T02:16:02.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.485+0000 7f158789e640 1 -- 172.21.15.79:0/1975486035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15800690a0 con 0x7f158015e4d0 2024-04-25T02:16:02.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.485+0000 7f1575ffb640 1 -- 172.21.15.79:0/1975486035 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1578039040 con 0x7f158015e4d0 2024-04-25T02:16:02.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.486+0000 7f1575ffb640 1 --2- 172.21.15.79:0/1975486035 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f156406be30 0x7f156406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.486+0000 7f158563a640 1 --2- 172.21.15.79:0/1975486035 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f156406be30 0x7f156406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:02.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.486+0000 7f1575ffb640 1 -- 172.21.15.79:0/1975486035 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f15780ac4f0 con 0x7f158015e4d0 2024-04-25T02:16:02.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.486+0000 7f158563a640 1 --2- 172.21.15.79:0/1975486035 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f156406be30 0x7f156406e2f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1570007fd0 tx=0x7f1570007960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:02.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.490+0000 7f1575ffb640 1 -- 172.21.15.79:0/1975486035 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f157807ae10 con 0x7f158015e4d0 2024-04-25T02:16:02.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.664+0000 7f158789e640 1 -- 172.21.15.79:0/1975486035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f158006d5f0 con 0x7f158015e4d0 2024-04-25T02:16:02.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.665+0000 7f1575ffb640 1 -- 172.21.15.79:0/1975486035 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16631 (secure 0 0 0) 0x7f157807a710 con 0x7f158015e4d0 2024-04-25T02:16:02.670 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:02.670 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":102,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:16:00.025323+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:15:56.581482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T02:15:57.334060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:16:02.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.667+0000 7f158789e640 1 -- 172.21.15.79:0/1975486035 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f156406be30 msgr2=0x7f156406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.667+0000 7f158789e640 1 --2- 172.21.15.79:0/1975486035 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f156406be30 0x7f156406e2f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1570007fd0 tx=0x7f1570007960 comp rx=0 tx=0).stop 2024-04-25T02:16:02.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.667+0000 7f158789e640 1 -- 172.21.15.79:0/1975486035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f158015e4d0 msgr2=0x7f15800b91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.667+0000 7f158789e640 1 --2- 172.21.15.79:0/1975486035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f158015e4d0 0x7f15800b91a0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f1578009ee0 tx=0x7f1578004a40 comp rx=0 tx=0).stop 2024-04-25T02:16:02.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.667+0000 7f158789e640 1 -- 172.21.15.79:0/1975486035 shutdown_connections 2024-04-25T02:16:02.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.667+0000 7f158789e640 1 --2- 172.21.15.79:0/1975486035 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f156406be30 0x7f156406e2f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.667+0000 7f158789e640 1 --2- 172.21.15.79:0/1975486035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f158015e4d0 0x7f15800b91a0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.667+0000 7f158789e640 1 --2- 172.21.15.79:0/1975486035 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15800d2e20 0x7f15800b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.667+0000 7f158789e640 1 --2- 172.21.15.79:0/1975486035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15800b3570 0x7f15801555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.667+0000 7f158789e640 1 -- 172.21.15.79:0/1975486035 >> 172.21.15.79:0/1975486035 conn(0x7f158009d460 msgr2=0x7f158015c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:02.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.667+0000 7f158789e640 1 -- 172.21.15.79:0/1975486035 shutdown_connections 2024-04-25T02:16:02.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.667+0000 7f158789e640 1 -- 172.21.15.79:0/1975486035 wait complete. 2024-04-25T02:16:02.684 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T02:16:02.684 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:16:02.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.775+0000 7f6c7b912640 1 Processor -- start 2024-04-25T02:16:02.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.776+0000 7f6c7b912640 1 -- start start 2024-04-25T02:16:02.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.776+0000 7f6c7b912640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6c740d2e20 0x7f6c740cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.776+0000 7f6c7b912640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c7406c380 con 0x7f6c7415e4d0 2024-04-25T02:16:02.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c7b912640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c740d1660 con 0x7f6c740b3570 2024-04-25T02:16:02.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c7b912640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6c740d1380 con 0x7f6c740d2e20 2024-04-25T02:16:02.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c796ae640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6c7415e4d0 0x7f6c7406bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46772/0 (socket says 172.21.15.79:46772) 2024-04-25T02:16:02.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c796ae640 1 -- 172.21.15.79:0/470055003 learned_addr learned my addr 172.21.15.79:0/470055003 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:02.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c6bfff640 1 -- 172.21.15.79:0/470055003 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2200617688 0 0) 0x7f6c7406c380 con 0x7f6c7415e4d0 2024-04-25T02:16:02.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c79eaf640 1 --2- 172.21.15.79:0/470055003 >> v2:172.21.15.189:3300/0 conn(0x7f6c740d2e20 0x7f6c740cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:02.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c6bfff640 1 -- 172.21.15.79:0/470055003 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c60003520 con 0x7f6c7415e4d0 2024-04-25T02:16:02.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c6bfff640 1 -- 172.21.15.79:0/470055003 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2759160636 0 0) 0x7f6c60003520 con 0x7f6c7415e4d0 2024-04-25T02:16:02.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c6bfff640 1 -- 172.21.15.79:0/470055003 >> v2:172.21.15.189:3300/0 conn(0x7f6c740d2e20 msgr2=0x7f6c740cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:02.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c6bfff640 1 --2- 172.21.15.79:0/470055003 >> v2:172.21.15.189:3300/0 conn(0x7f6c740d2e20 0x7f6c740cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c6bfff640 1 -- 172.21.15.79:0/470055003 >> v1:172.21.15.189:6789/0 conn(0x7f6c740b3570 legacy=0x7f6c740d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c6bfff640 1 -- 172.21.15.79:0/470055003 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c740cede0 con 0x7f6c7415e4d0 2024-04-25T02:16:02.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c6bfff640 1 -- 172.21.15.79:0/470055003 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f6c64001670 con 0x7f6c7415e4d0 2024-04-25T02:16:02.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c6bfff640 1 -- 172.21.15.79:0/470055003 >> v1:172.21.15.79:6789/0 conn(0x7f6c7415e4d0 legacy=0x7f6c7406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c6bfff640 1 --2- 172.21.15.79:0/470055003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c600039b0 0x7f6c60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c6bfff640 1 --2- 172.21.15.79:0/470055003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c60004800 0x7f6c60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c6bfff640 1 --2- 172.21.15.79:0/470055003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c600051c0 0x7f6c6000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c6bfff640 1 -- 172.21.15.79:0/470055003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c740d1380 con 0x7f6c600039b0 2024-04-25T02:16:02.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c6bfff640 1 -- 172.21.15.79:0/470055003 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6000c060 con 0x7f6c600051c0 2024-04-25T02:16:02.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c6bfff640 1 -- 172.21.15.79:0/470055003 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6000c260 con 0x7f6c60004800 2024-04-25T02:16:02.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c796ae640 1 --2- 172.21.15.79:0/470055003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c600039b0 0x7f6c60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:02.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c79eaf640 1 --2- 172.21.15.79:0/470055003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c600051c0 0x7f6c6000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:02.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c796ae640 1 -- 172.21.15.79:0/470055003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c60004800 msgr2=0x7f6c60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:02.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.777+0000 7f6c78ead640 1 --2- 172.21.15.79:0/470055003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c60004800 0x7f6c60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:02.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.778+0000 7f6c796ae640 1 --2- 172.21.15.79:0/470055003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c60004800 0x7f6c60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.778+0000 7f6c796ae640 1 -- 172.21.15.79:0/470055003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c600051c0 msgr2=0x7f6c6000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:02.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.778+0000 7f6c796ae640 1 --2- 172.21.15.79:0/470055003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c600051c0 0x7f6c6000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.778+0000 7f6c796ae640 1 -- 172.21.15.79:0/470055003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c60003520 con 0x7f6c600039b0 2024-04-25T02:16:02.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.778+0000 7f6c79eaf640 1 --2- 172.21.15.79:0/470055003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c600051c0 0x7f6c6000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:02.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.778+0000 7f6c78ead640 1 --2- 172.21.15.79:0/470055003 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c60004800 0x7f6c60004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:02.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.778+0000 7f6c79eaf640 1 -- 172.21.15.79:0/470055003 reap_dead start 2024-04-25T02:16:02.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.778+0000 7f6c796ae640 1 --2- 172.21.15.79:0/470055003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c600039b0 0x7f6c60003dd0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400c240 tx=0x7f6c60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed91803220ac6a46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:02.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.778+0000 7f6c6bfff640 1 -- 172.21.15.79:0/470055003 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64007d10 con 0x7f6c600039b0 2024-04-25T02:16:02.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.778+0000 7f6c6bfff640 1 -- 172.21.15.79:0/470055003 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c640058d0 con 0x7f6c600039b0 2024-04-25T02:16:02.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.778+0000 7f6c6bfff640 1 -- 172.21.15.79:0/470055003 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64005d40 con 0x7f6c600039b0 2024-04-25T02:16:02.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.779+0000 7f6c7b912640 1 -- 172.21.15.79:0/470055003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c600039b0 msgr2=0x7f6c60003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.779+0000 7f6c7b912640 1 --2- 172.21.15.79:0/470055003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c600039b0 0x7f6c60003dd0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400c240 tx=0x7f6c60005830 comp rx=0 tx=0).stop 2024-04-25T02:16:02.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.779+0000 7f6c7b912640 1 -- 172.21.15.79:0/470055003 shutdown_connections 2024-04-25T02:16:02.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.779+0000 7f6c7b912640 1 --2- 172.21.15.79:0/470055003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c600039b0 0x7f6c60003dd0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.779+0000 7f6c7b912640 1 -- 172.21.15.79:0/470055003 >> 172.21.15.79:0/470055003 conn(0x7f6c7409d460 msgr2=0x7f6c740d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:02.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.779+0000 7f6c7b912640 1 -- 172.21.15.79:0/470055003 shutdown_connections 2024-04-25T02:16:02.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.779+0000 7f6c7b912640 1 -- 172.21.15.79:0/470055003 wait complete. 2024-04-25T02:16:02.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.780+0000 7f6c7b912640 1 Processor -- start 2024-04-25T02:16:02.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.780+0000 7f6c7b912640 1 -- start start 2024-04-25T02:16:02.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c7b912640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c600039b0 0x7f6c74147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c7b912640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c741627f0 0x7f6c741f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c7b912640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c74162c70 0x7f6c741f7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c7b912640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c740d20d0 con 0x7f6c741627f0 2024-04-25T02:16:02.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c7b912640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7415e8b0 con 0x7f6c74162c70 2024-04-25T02:16:02.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c7b912640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6c740d2250 con 0x7f6c600039b0 2024-04-25T02:16:02.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c78ead640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c741627f0 0x7f6c741f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:02.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c78ead640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c741627f0 0x7f6c741f7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59056/0 (socket says 172.21.15.79:59056) 2024-04-25T02:16:02.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c78ead640 1 -- 172.21.15.79:0/2557125639 learned_addr learned my addr 172.21.15.79:0/2557125639 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:02.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c796ae640 1 --2- 172.21.15.79:0/2557125639 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c600039b0 0x7f6c74147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c79eaf640 1 --2- 172.21.15.79:0/2557125639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c74162c70 0x7f6c741f7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c78ead640 1 -- 172.21.15.79:0/2557125639 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c600039b0 msgr2=0x7f6c74147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c78ead640 1 --2- 172.21.15.79:0/2557125639 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c600039b0 0x7f6c74147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c78ead640 1 -- 172.21.15.79:0/2557125639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c74162c70 msgr2=0x7f6c741f7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c78ead640 1 --2- 172.21.15.79:0/2557125639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c74162c70 0x7f6c741f7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c78ead640 1 -- 172.21.15.79:0/2557125639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c741f7da0 con 0x7f6c741627f0 2024-04-25T02:16:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c78ead640 1 --2- 172.21.15.79:0/2557125639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c741627f0 0x7f6c741f7230 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000d500 tx=0x7f6c7000d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.781+0000 7f6c69ffb640 1 -- 172.21.15.79:0/2557125639 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70019070 con 0x7f6c741627f0 2024-04-25T02:16:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.782+0000 7f6c69ffb640 1 -- 172.21.15.79:0/2557125639 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c70007030 con 0x7f6c741627f0 2024-04-25T02:16:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.782+0000 7f6c7b912640 1 -- 172.21.15.79:0/2557125639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c741f8080 con 0x7f6c741627f0 2024-04-25T02:16:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.782+0000 7f6c69ffb640 1 -- 172.21.15.79:0/2557125639 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70007400 con 0x7f6c741627f0 2024-04-25T02:16:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.782+0000 7f6c7b912640 1 -- 172.21.15.79:0/2557125639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c74147450 con 0x7f6c741627f0 2024-04-25T02:16:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.783+0000 7f6c7b912640 1 -- 172.21.15.79:0/2557125639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c740690a0 con 0x7f6c741627f0 2024-04-25T02:16:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.783+0000 7f6c69ffb640 1 -- 172.21.15.79:0/2557125639 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c7001c070 con 0x7f6c741627f0 2024-04-25T02:16:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.783+0000 7f6c69ffb640 1 --2- 172.21.15.79:0/2557125639 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6c5806be30 0x7f6c5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:02.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.783+0000 7f6c69ffb640 1 -- 172.21.15.79:0/2557125639 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f6c7008a590 con 0x7f6c741627f0 2024-04-25T02:16:02.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.783+0000 7f6c796ae640 1 --2- 172.21.15.79:0/2557125639 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6c5806be30 0x7f6c5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:02.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.784+0000 7f6c796ae640 1 --2- 172.21.15.79:0/2557125639 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6c5806be30 0x7f6c5806e2f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6c64033000 tx=0x7f6c6402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:02.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.788+0000 7f6c69ffb640 1 -- 172.21.15.79:0/2557125639 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6c70058f70 con 0x7f6c741627f0 2024-04-25T02:16:02.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.955+0000 7f6c7b912640 1 -- 172.21.15.79:0/2557125639 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c7414b390 con 0x7f6c5806be30 2024-04-25T02:16:02.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.960+0000 7f6c69ffb640 1 -- 172.21.15.79:0/2557125639 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252381 (secure 0 0 0) 0x7f6c7414b390 con 0x7f6c5806be30 2024-04-25T02:16:02.968 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:02.969 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:16:02.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.963+0000 7f6c7b912640 1 -- 172.21.15.79:0/2557125639 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6c5806be30 msgr2=0x7f6c5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.963+0000 7f6c7b912640 1 --2- 172.21.15.79:0/2557125639 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6c5806be30 0x7f6c5806e2f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6c64033000 tx=0x7f6c6402e000 comp rx=0 tx=0).stop 2024-04-25T02:16:02.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.963+0000 7f6c7b912640 1 -- 172.21.15.79:0/2557125639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c741627f0 msgr2=0x7f6c741f7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:02.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.963+0000 7f6c7b912640 1 --2- 172.21.15.79:0/2557125639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c741627f0 0x7f6c741f7230 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000d500 tx=0x7f6c7000d9c0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.963+0000 7f6c7b912640 1 -- 172.21.15.79:0/2557125639 shutdown_connections 2024-04-25T02:16:02.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.963+0000 7f6c7b912640 1 --2- 172.21.15.79:0/2557125639 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6c5806be30 0x7f6c5806e2f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.963+0000 7f6c7b912640 1 --2- 172.21.15.79:0/2557125639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c74162c70 0x7f6c741f7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.963+0000 7f6c7b912640 1 --2- 172.21.15.79:0/2557125639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c741627f0 0x7f6c741f7230 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.963+0000 7f6c7b912640 1 --2- 172.21.15.79:0/2557125639 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c600039b0 0x7f6c74147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:02.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.963+0000 7f6c7b912640 1 -- 172.21.15.79:0/2557125639 >> 172.21.15.79:0/2557125639 conn(0x7f6c7409d460 msgr2=0x7f6c7415c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:02.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.963+0000 7f6c7b912640 1 -- 172.21.15.79:0/2557125639 shutdown_connections 2024-04-25T02:16:02.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:02.963+0000 7f6c7b912640 1 -- 172.21.15.79:0/2557125639 wait complete. 2024-04-25T02:16:02.979 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-04-25T02:16:01.280913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260500,"kb_used_data":11020,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714220,"statfs":{"total":773094113280,"available":772827361280,"internally_reserved":0,"allocated":11284480,"data_stored":5506128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.270570"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038041+0000","last_change":"2024-04-25T02:15:59.048033+0000","last_active":"2024-04-25T02:16:00.038041+0000","last_peered":"2024-04-25T02:16:00.038041+0000","last_clean":"2024-04-25T02:16:00.038041+0000","last_became_active":"2024-04-25T02:15:59.047758+0000","last_became_peered":"2024-04-25T02:15:59.047758+0000","last_unstale":"2024-04-25T02:16:00.038041+0000","last_undegraded":"2024-04-25T02:16:00.038041+0000","last_fullsized":"2024-04-25T02:16:00.038041+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:38.306079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039285+0000","last_change":"2024-04-25T02:15:59.044721+0000","last_active":"2024-04-25T02:16:00.039285+0000","last_peered":"2024-04-25T02:16:00.039285+0000","last_clean":"2024-04-25T02:16:00.039285+0000","last_became_active":"2024-04-25T02:15:59.044417+0000","last_became_peered":"2024-04-25T02:15:59.044417+0000","last_unstale":"2024-04-25T02:16:00.039285+0000","last_undegraded":"2024-04-25T02:16:00.039285+0000","last_fullsized":"2024-04-25T02:16:00.039285+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:30.757022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038079+0000","last_change":"2024-04-25T02:15:59.047345+0000","last_active":"2024-04-25T02:16:00.038079+0000","last_peered":"2024-04-25T02:16:00.038079+0000","last_clean":"2024-04-25T02:16:00.038079+0000","last_became_active":"2024-04-25T02:15:59.047108+0000","last_became_peered":"2024-04-25T02:15:59.047108+0000","last_unstale":"2024-04-25T02:16:00.038079+0000","last_undegraded":"2024-04-25T02:16:00.038079+0000","last_fullsized":"2024-04-25T02:16:00.038079+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:09:58.426518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.050207+0000","last_change":"2024-04-25T02:15:59.045300+0000","last_active":"2024-04-25T02:15:59.050207+0000","last_peered":"2024-04-25T02:15:59.050207+0000","last_clean":"2024-04-25T02:15:59.050207+0000","last_became_active":"2024-04-25T02:15:59.045054+0000","last_became_peered":"2024-04-25T02:15:59.045054+0000","last_unstale":"2024-04-25T02:15:59.050207+0000","last_undegraded":"2024-04-25T02:15:59.050207+0000","last_fullsized":"2024-04-25T02:15:59.050207+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:07.876840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045168+0000","last_change":"2024-04-25T02:15:59.041682+0000","last_active":"2024-04-25T02:15:59.045168+0000","last_peered":"2024-04-25T02:15:59.045168+0000","last_clean":"2024-04-25T02:15:59.045168+0000","last_became_active":"2024-04-25T02:15:59.038653+0000","last_became_peered":"2024-04-25T02:15:59.038653+0000","last_unstale":"2024-04-25T02:15:59.045168+0000","last_undegraded":"2024-04-25T02:15:59.045168+0000","last_fullsized":"2024-04-25T02:15:59.045168+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:24:53.391121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.028449+0000","last_change":"2024-04-25T02:15:59.027739+0000","last_active":"2024-04-25T02:15:59.028449+0000","last_peered":"2024-04-25T02:15:59.028449+0000","last_clean":"2024-04-25T02:15:59.028449+0000","last_became_active":"2024-04-25T02:15:59.027472+0000","last_became_peered":"2024-04-25T02:15:59.027472+0000","last_unstale":"2024-04-25T02:15:59.028449+0000","last_undegraded":"2024-04-25T02:15:59.028449+0000","last_fullsized":"2024-04-25T02:15:59.028449+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.283124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.029697+0000","last_change":"2024-04-25T02:15:59.028458+0000","last_active":"2024-04-25T02:15:59.029697+0000","last_peered":"2024-04-25T02:15:59.029697+0000","last_clean":"2024-04-25T02:15:59.029697+0000","last_became_active":"2024-04-25T02:15:59.028186+0000","last_became_peered":"2024-04-25T02:15:59.028186+0000","last_unstale":"2024-04-25T02:15:59.029697+0000","last_undegraded":"2024-04-25T02:15:59.029697+0000","last_fullsized":"2024-04-25T02:15:59.029697+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:08.605733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039021+0000","last_change":"2024-04-25T02:15:59.039255+0000","last_active":"2024-04-25T02:16:00.039021+0000","last_peered":"2024-04-25T02:16:00.039021+0000","last_clean":"2024-04-25T02:16:00.039021+0000","last_became_active":"2024-04-25T02:15:59.039016+0000","last_became_peered":"2024-04-25T02:15:59.039016+0000","last_unstale":"2024-04-25T02:16:00.039021+0000","last_undegraded":"2024-04-25T02:16:00.039021+0000","last_fullsized":"2024-04-25T02:16:00.039021+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:02.257677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041650+0000","last_change":"2024-04-25T02:15:59.044333+0000","last_active":"2024-04-25T02:16:00.041650+0000","last_peered":"2024-04-25T02:16:00.041650+0000","last_clean":"2024-04-25T02:16:00.041650+0000","last_became_active":"2024-04-25T02:15:59.043804+0000","last_became_peered":"2024-04-25T02:15:59.043804+0000","last_unstale":"2024-04-25T02:16:00.041650+0000","last_undegraded":"2024-04-25T02:16:00.041650+0000","last_fullsized":"2024-04-25T02:16:00.041650+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:24:53.391121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045135+0000","last_change":"2024-04-25T02:15:59.041794+0000","last_active":"2024-04-25T02:15:59.045135+0000","last_peered":"2024-04-25T02:15:59.045135+0000","last_clean":"2024-04-25T02:15:59.045135+0000","last_became_active":"2024-04-25T02:15:59.039322+0000","last_became_peered":"2024-04-25T02:15:59.039322+0000","last_unstale":"2024-04-25T02:15:59.045135+0000","last_undegraded":"2024-04-25T02:15:59.045135+0000","last_fullsized":"2024-04-25T02:15:59.045135+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:50:48.642656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045054+0000","last_change":"2024-04-25T02:15:59.042534+0000","last_active":"2024-04-25T02:15:59.045054+0000","last_peered":"2024-04-25T02:15:59.045054+0000","last_clean":"2024-04-25T02:15:59.045054+0000","last_became_active":"2024-04-25T02:15:59.042258+0000","last_became_peered":"2024-04-25T02:15:59.042258+0000","last_unstale":"2024-04-25T02:15:59.045054+0000","last_undegraded":"2024-04-25T02:15:59.045054+0000","last_fullsized":"2024-04-25T02:15:59.045054+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:53.017869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041444+0000","last_change":"2024-04-25T02:15:59.043022+0000","last_active":"2024-04-25T02:16:00.041444+0000","last_peered":"2024-04-25T02:16:00.041444+0000","last_clean":"2024-04-25T02:16:00.041444+0000","last_became_active":"2024-04-25T02:15:59.042707+0000","last_became_peered":"2024-04-25T02:15:59.042707+0000","last_unstale":"2024-04-25T02:16:00.041444+0000","last_undegraded":"2024-04-25T02:16:00.041444+0000","last_fullsized":"2024-04-25T02:16:00.041444+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:48.634681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.050001+0000","last_change":"2024-04-25T02:15:59.044732+0000","last_active":"2024-04-25T02:15:59.050001+0000","last_peered":"2024-04-25T02:15:59.050001+0000","last_clean":"2024-04-25T02:15:59.050001+0000","last_became_active":"2024-04-25T02:15:59.044475+0000","last_became_peered":"2024-04-25T02:15:59.044475+0000","last_unstale":"2024-04-25T02:15:59.050001+0000","last_undegraded":"2024-04-25T02:15:59.050001+0000","last_fullsized":"2024-04-25T02:15:59.050001+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:04:48.608142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.046436+0000","last_change":"2024-04-25T02:15:59.037369+0000","last_active":"2024-04-25T02:15:59.046436+0000","last_peered":"2024-04-25T02:15:59.046436+0000","last_clean":"2024-04-25T02:15:59.046436+0000","last_became_active":"2024-04-25T02:15:59.037100+0000","last_became_peered":"2024-04-25T02:15:59.037100+0000","last_unstale":"2024-04-25T02:15:59.046436+0000","last_undegraded":"2024-04-25T02:15:59.046436+0000","last_fullsized":"2024-04-25T02:15:59.046436+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:16.797911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.042990+0000","last_change":"2024-04-25T02:15:59.038862+0000","last_active":"2024-04-25T02:15:59.042990+0000","last_peered":"2024-04-25T02:15:59.042990+0000","last_clean":"2024-04-25T02:15:59.042990+0000","last_became_active":"2024-04-25T02:15:59.037854+0000","last_became_peered":"2024-04-25T02:15:59.037854+0000","last_unstale":"2024-04-25T02:15:59.042990+0000","last_undegraded":"2024-04-25T02:15:59.042990+0000","last_fullsized":"2024-04-25T02:15:59.042990+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:41.962957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.044794+0000","last_change":"2024-04-25T02:15:59.038569+0000","last_active":"2024-04-25T02:15:59.044794+0000","last_peered":"2024-04-25T02:15:59.044794+0000","last_clean":"2024-04-25T02:15:59.044794+0000","last_became_active":"2024-04-25T02:15:59.033083+0000","last_became_peered":"2024-04-25T02:15:59.033083+0000","last_unstale":"2024-04-25T02:15:59.044794+0000","last_undegraded":"2024-04-25T02:15:59.044794+0000","last_fullsized":"2024-04-25T02:15:59.044794+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:41:15.598384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039434+0000","last_change":"2024-04-25T02:15:59.043429+0000","last_active":"2024-04-25T02:16:00.039434+0000","last_peered":"2024-04-25T02:16:00.039434+0000","last_clean":"2024-04-25T02:16:00.039434+0000","last_became_active":"2024-04-25T02:15:59.043180+0000","last_became_peered":"2024-04-25T02:15:59.043180+0000","last_unstale":"2024-04-25T02:16:00.039434+0000","last_undegraded":"2024-04-25T02:16:00.039434+0000","last_fullsized":"2024-04-25T02:16:00.039434+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:37.281738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.049985+0000","last_change":"2024-04-25T02:15:59.044695+0000","last_active":"2024-04-25T02:15:59.049985+0000","last_peered":"2024-04-25T02:15:59.049985+0000","last_clean":"2024-04-25T02:15:59.049985+0000","last_became_active":"2024-04-25T02:15:59.044434+0000","last_became_peered":"2024-04-25T02:15:59.044434+0000","last_unstale":"2024-04-25T02:15:59.049985+0000","last_undegraded":"2024-04-25T02:15:59.049985+0000","last_fullsized":"2024-04-25T02:15:59.049985+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:12.552054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.046174+0000","last_change":"2024-04-25T02:15:59.037405+0000","last_active":"2024-04-25T02:15:59.046174+0000","last_peered":"2024-04-25T02:15:59.046174+0000","last_clean":"2024-04-25T02:15:59.046174+0000","last_became_active":"2024-04-25T02:15:59.037133+0000","last_became_peered":"2024-04-25T02:15:59.037133+0000","last_unstale":"2024-04-25T02:15:59.046174+0000","last_undegraded":"2024-04-25T02:15:59.046174+0000","last_fullsized":"2024-04-25T02:15:59.046174+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:30:57.967762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041589+0000","last_change":"2024-04-25T02:15:59.049501+0000","last_active":"2024-04-25T02:16:00.041589+0000","last_peered":"2024-04-25T02:16:00.041589+0000","last_clean":"2024-04-25T02:16:00.041589+0000","last_became_active":"2024-04-25T02:15:59.049228+0000","last_became_peered":"2024-04-25T02:15:59.049228+0000","last_unstale":"2024-04-25T02:16:00.041589+0000","last_undegraded":"2024-04-25T02:16:00.041589+0000","last_fullsized":"2024-04-25T02:16:00.041589+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:06.603227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045999+0000","last_change":"2024-04-25T02:15:59.040087+0000","last_active":"2024-04-25T02:15:59.045999+0000","last_peered":"2024-04-25T02:15:59.045999+0000","last_clean":"2024-04-25T02:15:59.045999+0000","last_became_active":"2024-04-25T02:15:59.039798+0000","last_became_peered":"2024-04-25T02:15:59.039798+0000","last_unstale":"2024-04-25T02:15:59.045999+0000","last_undegraded":"2024-04-25T02:15:59.045999+0000","last_fullsized":"2024-04-25T02:15:59.045999+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:43.563899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038981+0000","last_change":"2024-04-25T02:15:59.045331+0000","last_active":"2024-04-25T02:16:00.038981+0000","last_peered":"2024-04-25T02:16:00.038981+0000","last_clean":"2024-04-25T02:16:00.038981+0000","last_became_active":"2024-04-25T02:15:59.045094+0000","last_became_peered":"2024-04-25T02:15:59.045094+0000","last_unstale":"2024-04-25T02:16:00.038981+0000","last_undegraded":"2024-04-25T02:16:00.038981+0000","last_fullsized":"2024-04-25T02:16:00.038981+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:06:18.213481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038989+0000","last_change":"2024-04-25T02:15:59.045951+0000","last_active":"2024-04-25T02:16:00.038989+0000","last_peered":"2024-04-25T02:16:00.038989+0000","last_clean":"2024-04-25T02:16:00.038989+0000","last_became_active":"2024-04-25T02:15:59.045706+0000","last_became_peered":"2024-04-25T02:15:59.045706+0000","last_unstale":"2024-04-25T02:16:00.038989+0000","last_undegraded":"2024-04-25T02:16:00.038989+0000","last_fullsized":"2024-04-25T02:16:00.038989+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:58:48.604054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.044771+0000","last_change":"2024-04-25T02:15:59.038359+0000","last_active":"2024-04-25T02:15:59.044771+0000","last_peered":"2024-04-25T02:15:59.044771+0000","last_clean":"2024-04-25T02:15:59.044771+0000","last_became_active":"2024-04-25T02:15:59.037519+0000","last_became_peered":"2024-04-25T02:15:59.037519+0000","last_unstale":"2024-04-25T02:15:59.044771+0000","last_undegraded":"2024-04-25T02:15:59.044771+0000","last_fullsized":"2024-04-25T02:15:59.044771+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:16.534422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.043933+0000","last_change":"2024-04-25T02:15:59.038529+0000","last_active":"2024-04-25T02:15:59.043933+0000","last_peered":"2024-04-25T02:15:59.043933+0000","last_clean":"2024-04-25T02:15:59.043933+0000","last_became_active":"2024-04-25T02:15:59.038230+0000","last_became_peered":"2024-04-25T02:15:59.038230+0000","last_unstale":"2024-04-25T02:15:59.043933+0000","last_undegraded":"2024-04-25T02:15:59.043933+0000","last_fullsized":"2024-04-25T02:15:59.043933+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:35.514243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039289+0000","last_change":"2024-04-25T02:15:59.039384+0000","last_active":"2024-04-25T02:16:00.039289+0000","last_peered":"2024-04-25T02:16:00.039289+0000","last_clean":"2024-04-25T02:16:00.039289+0000","last_became_active":"2024-04-25T02:15:59.038618+0000","last_became_peered":"2024-04-25T02:15:59.038618+0000","last_unstale":"2024-04-25T02:16:00.039289+0000","last_undegraded":"2024-04-25T02:16:00.039289+0000","last_fullsized":"2024-04-25T02:16:00.039289+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:25:47.867915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045035+0000","last_change":"2024-04-25T02:15:59.041240+0000","last_active":"2024-04-25T02:15:59.045035+0000","last_peered":"2024-04-25T02:15:59.045035+0000","last_clean":"2024-04-25T02:15:59.045035+0000","last_became_active":"2024-04-25T02:15:59.040963+0000","last_became_peered":"2024-04-25T02:15:59.040963+0000","last_unstale":"2024-04-25T02:15:59.045035+0000","last_undegraded":"2024-04-25T02:15:59.045035+0000","last_fullsized":"2024-04-25T02:15:59.045035+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:35.514243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045119+0000","last_change":"2024-04-25T02:15:59.042599+0000","last_active":"2024-04-25T02:15:59.045119+0000","last_peered":"2024-04-25T02:15:59.045119+0000","last_clean":"2024-04-25T02:15:59.045119+0000","last_became_active":"2024-04-25T02:15:59.041862+0000","last_became_peered":"2024-04-25T02:15:59.041862+0000","last_unstale":"2024-04-25T02:15:59.045119+0000","last_undegraded":"2024-04-25T02:15:59.045119+0000","last_fullsized":"2024-04-25T02:15:59.045119+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:12.552054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039030+0000","last_change":"2024-04-25T02:15:59.039475+0000","last_active":"2024-04-25T02:16:00.039030+0000","last_peered":"2024-04-25T02:16:00.039030+0000","last_clean":"2024-04-25T02:16:00.039030+0000","last_became_active":"2024-04-25T02:15:59.038059+0000","last_became_peered":"2024-04-25T02:15:59.038059+0000","last_unstale":"2024-04-25T02:16:00.039030+0000","last_undegraded":"2024-04-25T02:16:00.039030+0000","last_fullsized":"2024-04-25T02:16:00.039030+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:26.157441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.039998+0000","last_change":"2024-04-25T02:15:59.035093+0000","last_active":"2024-04-25T02:15:59.039998+0000","last_peered":"2024-04-25T02:15:59.039998+0000","last_clean":"2024-04-25T02:15:59.039998+0000","last_became_active":"2024-04-25T02:15:59.034842+0000","last_became_peered":"2024-04-25T02:15:59.034842+0000","last_unstale":"2024-04-25T02:15:59.039998+0000","last_undegraded":"2024-04-25T02:15:59.039998+0000","last_fullsized":"2024-04-25T02:15:59.039998+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:02.281037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.038758+0000","last_change":"2024-04-25T02:15:59.031374+0000","last_active":"2024-04-25T02:15:59.038758+0000","last_peered":"2024-04-25T02:15:59.038758+0000","last_clean":"2024-04-25T02:15:59.038758+0000","last_became_active":"2024-04-25T02:15:59.031072+0000","last_became_peered":"2024-04-25T02:15:59.031072+0000","last_unstale":"2024-04-25T02:15:59.038758+0000","last_undegraded":"2024-04-25T02:15:59.038758+0000","last_fullsized":"2024-04-25T02:15:59.038758+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:24:53.391121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.037801+0000","last_change":"2024-04-25T02:15:59.042015+0000","last_active":"2024-04-25T02:16:00.037801+0000","last_peered":"2024-04-25T02:16:00.037801+0000","last_clean":"2024-04-25T02:16:00.037801+0000","last_became_active":"2024-04-25T02:15:59.041757+0000","last_became_peered":"2024-04-25T02:15:59.041757+0000","last_unstale":"2024-04-25T02:16:00.037801+0000","last_undegraded":"2024-04-25T02:16:00.037801+0000","last_fullsized":"2024-04-25T02:16:00.037801+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:00:24.970582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.046405+0000","last_change":"2024-04-25T02:15:59.039766+0000","last_active":"2024-04-25T02:15:59.046405+0000","last_peered":"2024-04-25T02:15:59.046405+0000","last_clean":"2024-04-25T02:15:59.046405+0000","last_became_active":"2024-04-25T02:15:59.038539+0000","last_became_peered":"2024-04-25T02:15:59.038539+0000","last_unstale":"2024-04-25T02:15:59.046405+0000","last_undegraded":"2024-04-25T02:15:59.046405+0000","last_fullsized":"2024-04-25T02:15:59.046405+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:25.005076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"101'4","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039432+0000","last_change":"2024-04-25T02:15:58.035881+0000","last_active":"2024-04-25T02:16:00.039432+0000","last_peered":"2024-04-25T02:16:00.039432+0000","last_clean":"2024-04-25T02:16:00.039432+0000","last_became_active":"2024-04-25T02:15:58.035611+0000","last_became_peered":"2024-04-25T02:15:58.035611+0000","last_unstale":"2024-04-25T02:16:00.039432+0000","last_undegraded":"2024-04-25T02:16:00.039432+0000","last_fullsized":"2024-04-25T02:16:00.039432+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:52.010155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.038718+0000","last_change":"2024-04-25T02:15:59.030776+0000","last_active":"2024-04-25T02:15:59.038718+0000","last_peered":"2024-04-25T02:15:59.038718+0000","last_clean":"2024-04-25T02:15:59.038718+0000","last_became_active":"2024-04-25T02:15:59.030407+0000","last_became_peered":"2024-04-25T02:15:59.030407+0000","last_unstale":"2024-04-25T02:15:59.038718+0000","last_undegraded":"2024-04-25T02:15:59.038718+0000","last_fullsized":"2024-04-25T02:15:59.038718+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:06.603227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"101'1","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.037626+0000","last_change":"2024-04-25T02:15:58.038169+0000","last_active":"2024-04-25T02:15:59.037626+0000","last_peered":"2024-04-25T02:15:59.037626+0000","last_clean":"2024-04-25T02:15:59.037626+0000","last_became_active":"2024-04-25T02:15:58.037913+0000","last_became_peered":"2024-04-25T02:15:58.037913+0000","last_unstale":"2024-04-25T02:15:59.037626+0000","last_undegraded":"2024-04-25T02:15:59.037626+0000","last_fullsized":"2024-04-25T02:15:59.037626+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:42.612755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038041+0000","last_change":"2024-04-25T02:15:59.042791+0000","last_active":"2024-04-25T02:16:00.038041+0000","last_peered":"2024-04-25T02:16:00.038041+0000","last_clean":"2024-04-25T02:16:00.038041+0000","last_became_active":"2024-04-25T02:15:59.042493+0000","last_became_peered":"2024-04-25T02:15:59.042493+0000","last_unstale":"2024-04-25T02:16:00.038041+0000","last_undegraded":"2024-04-25T02:16:00.038041+0000","last_fullsized":"2024-04-25T02:16:00.038041+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:18.822329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039187+0000","last_change":"2024-04-25T02:15:58.035375+0000","last_active":"2024-04-25T02:16:00.039187+0000","last_peered":"2024-04-25T02:16:00.039187+0000","last_clean":"2024-04-25T02:16:00.039187+0000","last_became_active":"2024-04-25T02:15:58.035123+0000","last_became_peered":"2024-04-25T02:15:58.035123+0000","last_unstale":"2024-04-25T02:16:00.039187+0000","last_undegraded":"2024-04-25T02:16:00.039187+0000","last_fullsized":"2024-04-25T02:16:00.039187+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:40.955244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041934+0000","last_change":"2024-04-25T02:15:59.045816+0000","last_active":"2024-04-25T02:16:00.041934+0000","last_peered":"2024-04-25T02:16:00.041934+0000","last_clean":"2024-04-25T02:16:00.041934+0000","last_became_active":"2024-04-25T02:15:59.045546+0000","last_became_peered":"2024-04-25T02:15:59.045546+0000","last_unstale":"2024-04-25T02:16:00.041934+0000","last_undegraded":"2024-04-25T02:16:00.041934+0000","last_fullsized":"2024-04-25T02:16:00.041934+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:41.962957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039133+0000","last_change":"2024-04-25T02:15:58.042061+0000","last_active":"2024-04-25T02:16:00.039133+0000","last_peered":"2024-04-25T02:16:00.039133+0000","last_clean":"2024-04-25T02:16:00.039133+0000","last_became_active":"2024-04-25T02:15:58.041778+0000","last_became_peered":"2024-04-25T02:15:58.041778+0000","last_unstale":"2024-04-25T02:16:00.039133+0000","last_undegraded":"2024-04-25T02:16:00.039133+0000","last_fullsized":"2024-04-25T02:16:00.039133+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:41:14.590670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.044767+0000","last_change":"2024-04-25T02:15:59.042406+0000","last_active":"2024-04-25T02:15:59.044767+0000","last_peered":"2024-04-25T02:15:59.044767+0000","last_clean":"2024-04-25T02:15:59.044767+0000","last_became_active":"2024-04-25T02:15:59.042130+0000","last_became_peered":"2024-04-25T02:15:59.042130+0000","last_unstale":"2024-04-25T02:15:59.044767+0000","last_undegraded":"2024-04-25T02:15:59.044767+0000","last_fullsized":"2024-04-25T02:15:59.044767+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:41.024740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038107+0000","last_change":"2024-04-25T02:15:58.033210+0000","last_active":"2024-04-25T02:16:00.038107+0000","last_peered":"2024-04-25T02:16:00.038107+0000","last_clean":"2024-04-25T02:16:00.038107+0000","last_became_active":"2024-04-25T02:15:58.032918+0000","last_became_peered":"2024-04-25T02:15:58.032918+0000","last_unstale":"2024-04-25T02:16:00.038107+0000","last_undegraded":"2024-04-25T02:16:00.038107+0000","last_fullsized":"2024-04-25T02:16:00.038107+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:38.452114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.044487+0000","last_change":"2024-04-25T02:15:59.033187+0000","last_active":"2024-04-25T02:15:59.044487+0000","last_peered":"2024-04-25T02:15:59.044487+0000","last_clean":"2024-04-25T02:15:59.044487+0000","last_became_active":"2024-04-25T02:15:59.032115+0000","last_became_peered":"2024-04-25T02:15:59.032115+0000","last_unstale":"2024-04-25T02:15:59.044487+0000","last_undegraded":"2024-04-25T02:15:59.044487+0000","last_fullsized":"2024-04-25T02:15:59.044487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:47.780456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038957+0000","last_change":"2024-04-25T02:15:58.037083+0000","last_active":"2024-04-25T02:16:00.038957+0000","last_peered":"2024-04-25T02:16:00.038957+0000","last_clean":"2024-04-25T02:16:00.038957+0000","last_became_active":"2024-04-25T02:15:58.036837+0000","last_became_peered":"2024-04-25T02:15:58.036837+0000","last_unstale":"2024-04-25T02:16:00.038957+0000","last_undegraded":"2024-04-25T02:16:00.038957+0000","last_fullsized":"2024-04-25T02:16:00.038957+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:24:52.383408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.042805+0000","last_change":"2024-04-25T02:15:59.038470+0000","last_active":"2024-04-25T02:15:59.042805+0000","last_peered":"2024-04-25T02:15:59.042805+0000","last_clean":"2024-04-25T02:15:59.042805+0000","last_became_active":"2024-04-25T02:15:59.038193+0000","last_became_peered":"2024-04-25T02:15:59.038193+0000","last_unstale":"2024-04-25T02:15:59.042805+0000","last_undegraded":"2024-04-25T02:15:59.042805+0000","last_fullsized":"2024-04-25T02:15:59.042805+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:50:48.642656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.027552+0000","last_change":"2024-04-25T02:15:58.036097+0000","last_active":"2024-04-25T02:15:59.027552+0000","last_peered":"2024-04-25T02:15:59.027552+0000","last_clean":"2024-04-25T02:15:59.027552+0000","last_became_active":"2024-04-25T02:15:58.035821+0000","last_became_peered":"2024-04-25T02:15:58.035821+0000","last_unstale":"2024-04-25T02:15:59.027552+0000","last_undegraded":"2024-04-25T02:15:59.027552+0000","last_fullsized":"2024-04-25T02:15:59.027552+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:15.526709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041214+0000","last_change":"2024-04-25T02:15:59.045435+0000","last_active":"2024-04-25T02:16:00.041214+0000","last_peered":"2024-04-25T02:16:00.041214+0000","last_clean":"2024-04-25T02:16:00.041214+0000","last_became_active":"2024-04-25T02:15:59.044925+0000","last_became_peered":"2024-04-25T02:15:59.044925+0000","last_unstale":"2024-04-25T02:16:00.041214+0000","last_undegraded":"2024-04-25T02:16:00.041214+0000","last_fullsized":"2024-04-25T02:16:00.041214+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:53.275987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.037781+0000","last_change":"2024-04-25T02:15:58.036867+0000","last_active":"2024-04-25T02:16:00.037781+0000","last_peered":"2024-04-25T02:16:00.037781+0000","last_clean":"2024-04-25T02:16:00.037781+0000","last_became_active":"2024-04-25T02:15:58.036638+0000","last_became_peered":"2024-04-25T02:15:58.036638+0000","last_unstale":"2024-04-25T02:16:00.037781+0000","last_undegraded":"2024-04-25T02:16:00.037781+0000","last_fullsized":"2024-04-25T02:16:00.037781+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:34.422022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039431+0000","last_change":"2024-04-25T02:15:59.042417+0000","last_active":"2024-04-25T02:16:00.039431+0000","last_peered":"2024-04-25T02:16:00.039431+0000","last_clean":"2024-04-25T02:16:00.039431+0000","last_became_active":"2024-04-25T02:15:59.042164+0000","last_became_peered":"2024-04-25T02:15:59.042164+0000","last_unstale":"2024-04-25T02:16:00.039431+0000","last_undegraded":"2024-04-25T02:16:00.039431+0000","last_fullsized":"2024-04-25T02:16:00.039431+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:36.029935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038136+0000","last_change":"2024-04-25T02:15:58.027761+0000","last_active":"2024-04-25T02:16:00.038136+0000","last_peered":"2024-04-25T02:16:00.038136+0000","last_clean":"2024-04-25T02:16:00.038136+0000","last_became_active":"2024-04-25T02:15:58.027480+0000","last_became_peered":"2024-04-25T02:15:58.027480+0000","last_unstale":"2024-04-25T02:16:00.038136+0000","last_undegraded":"2024-04-25T02:16:00.038136+0000","last_fullsized":"2024-04-25T02:16:00.038136+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:15.982357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041787+0000","last_change":"2024-04-25T02:15:59.038080+0000","last_active":"2024-04-25T02:16:00.041787+0000","last_peered":"2024-04-25T02:16:00.041787+0000","last_clean":"2024-04-25T02:16:00.041787+0000","last_became_active":"2024-04-25T02:15:59.037574+0000","last_became_peered":"2024-04-25T02:15:59.037574+0000","last_unstale":"2024-04-25T02:16:00.041787+0000","last_undegraded":"2024-04-25T02:16:00.041787+0000","last_fullsized":"2024-04-25T02:16:00.041787+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:50:48.642656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.022293+0000","last_change":"2024-04-25T02:15:58.036738+0000","last_active":"2024-04-25T02:15:59.022293+0000","last_peered":"2024-04-25T02:15:59.022293+0000","last_clean":"2024-04-25T02:15:59.022293+0000","last_became_active":"2024-04-25T02:15:58.036474+0000","last_became_peered":"2024-04-25T02:15:58.036474+0000","last_unstale":"2024-04-25T02:15:59.022293+0000","last_undegraded":"2024-04-25T02:15:59.022293+0000","last_fullsized":"2024-04-25T02:15:59.022293+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:52.010155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.036768+0000","last_change":"2024-04-25T02:15:59.032480+0000","last_active":"2024-04-25T02:15:59.036768+0000","last_peered":"2024-04-25T02:15:59.036768+0000","last_clean":"2024-04-25T02:15:59.036768+0000","last_became_active":"2024-04-25T02:15:59.032048+0000","last_became_peered":"2024-04-25T02:15:59.032048+0000","last_unstale":"2024-04-25T02:15:59.036768+0000","last_undegraded":"2024-04-25T02:15:59.036768+0000","last_fullsized":"2024-04-25T02:15:59.036768+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:53.275987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"101'3","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.044365+0000","last_change":"2024-04-25T02:15:58.042185+0000","last_active":"2024-04-25T02:15:59.044365+0000","last_peered":"2024-04-25T02:15:59.044365+0000","last_clean":"2024-04-25T02:15:59.044365+0000","last_became_active":"2024-04-25T02:15:58.041880+0000","last_became_peered":"2024-04-25T02:15:58.041880+0000","last_unstale":"2024-04-25T02:15:59.044365+0000","last_undegraded":"2024-04-25T02:15:59.044365+0000","last_fullsized":"2024-04-25T02:15:59.044365+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:08.126815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.037104+0000","last_change":"2024-04-25T02:15:59.033345+0000","last_active":"2024-04-25T02:15:59.037104+0000","last_peered":"2024-04-25T02:15:59.037104+0000","last_clean":"2024-04-25T02:15:59.037104+0000","last_became_active":"2024-04-25T02:15:59.033043+0000","last_became_peered":"2024-04-25T02:15:59.033043+0000","last_unstale":"2024-04-25T02:15:59.037104+0000","last_undegraded":"2024-04-25T02:15:59.037104+0000","last_fullsized":"2024-04-25T02:15:59.037104+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:23:11.826390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"101'6","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041529+0000","last_change":"2024-04-25T02:15:58.033667+0000","last_active":"2024-04-25T02:16:00.041529+0000","last_peered":"2024-04-25T02:16:00.041529+0000","last_clean":"2024-04-25T02:16:00.041529+0000","last_became_active":"2024-04-25T02:15:58.032494+0000","last_became_peered":"2024-04-25T02:15:58.032494+0000","last_unstale":"2024-04-25T02:16:00.041529+0000","last_undegraded":"2024-04-25T02:16:00.041529+0000","last_fullsized":"2024-04-25T02:16:00.041529+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:45.640956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.030750+0000","last_change":"2024-04-25T02:15:59.026111+0000","last_active":"2024-04-25T02:15:59.030750+0000","last_peered":"2024-04-25T02:15:59.030750+0000","last_clean":"2024-04-25T02:15:59.030750+0000","last_became_active":"2024-04-25T02:15:59.025833+0000","last_became_peered":"2024-04-25T02:15:59.025833+0000","last_unstale":"2024-04-25T02:15:59.030750+0000","last_undegraded":"2024-04-25T02:15:59.030750+0000","last_fullsized":"2024-04-25T02:15:59.030750+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:48.634681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"101'2","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.046243+0000","last_change":"2024-04-25T02:15:58.028180+0000","last_active":"2024-04-25T02:15:59.046243+0000","last_peered":"2024-04-25T02:15:59.046243+0000","last_clean":"2024-04-25T02:15:59.046243+0000","last_became_active":"2024-04-25T02:15:58.027801+0000","last_became_peered":"2024-04-25T02:15:58.027801+0000","last_unstale":"2024-04-25T02:15:59.046243+0000","last_undegraded":"2024-04-25T02:15:59.046243+0000","last_fullsized":"2024-04-25T02:15:59.046243+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:19.956284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.037994+0000","last_change":"2024-04-25T02:15:59.045705+0000","last_active":"2024-04-25T02:16:00.037994+0000","last_peered":"2024-04-25T02:16:00.037994+0000","last_clean":"2024-04-25T02:16:00.037994+0000","last_became_active":"2024-04-25T02:15:59.045464+0000","last_became_peered":"2024-04-25T02:15:59.045464+0000","last_unstale":"2024-04-25T02:16:00.037994+0000","last_undegraded":"2024-04-25T02:16:00.037994+0000","last_fullsized":"2024-04-25T02:16:00.037994+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:31:09.477781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.024735+0000","last_change":"2024-04-25T02:15:58.030658+0000","last_active":"2024-04-25T02:15:59.024735+0000","last_peered":"2024-04-25T02:15:59.024735+0000","last_clean":"2024-04-25T02:15:59.024735+0000","last_became_active":"2024-04-25T02:15:58.030285+0000","last_became_peered":"2024-04-25T02:15:58.030285+0000","last_unstale":"2024-04-25T02:15:59.024735+0000","last_undegraded":"2024-04-25T02:15:59.024735+0000","last_fullsized":"2024-04-25T02:15:59.024735+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:15:10.911635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041263+0000","last_change":"2024-04-25T02:15:59.045257+0000","last_active":"2024-04-25T02:16:00.041263+0000","last_peered":"2024-04-25T02:16:00.041263+0000","last_clean":"2024-04-25T02:16:00.041263+0000","last_became_active":"2024-04-25T02:15:59.044034+0000","last_became_peered":"2024-04-25T02:15:59.044034+0000","last_unstale":"2024-04-25T02:16:00.041263+0000","last_undegraded":"2024-04-25T02:16:00.041263+0000","last_fullsized":"2024-04-25T02:16:00.041263+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:35.514243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041325+0000","last_change":"2024-04-25T02:15:58.034151+0000","last_active":"2024-04-25T02:16:00.041325+0000","last_peered":"2024-04-25T02:16:00.041325+0000","last_clean":"2024-04-25T02:16:00.041325+0000","last_became_active":"2024-04-25T02:15:58.033556+0000","last_became_peered":"2024-04-25T02:15:58.033556+0000","last_unstale":"2024-04-25T02:16:00.041325+0000","last_undegraded":"2024-04-25T02:16:00.041325+0000","last_fullsized":"2024-04-25T02:16:00.041325+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:34.555904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.049722+0000","last_change":"2024-04-25T02:15:59.043460+0000","last_active":"2024-04-25T02:15:59.049722+0000","last_peered":"2024-04-25T02:15:59.049722+0000","last_clean":"2024-04-25T02:15:59.049722+0000","last_became_active":"2024-04-25T02:15:59.043197+0000","last_became_peered":"2024-04-25T02:15:59.043197+0000","last_unstale":"2024-04-25T02:15:59.049722+0000","last_undegraded":"2024-04-25T02:15:59.049722+0000","last_fullsized":"2024-04-25T02:15:59.049722+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:51.861998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"101'8","reported_seq":22,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.037875+0000","last_change":"2024-04-25T02:15:58.035608+0000","last_active":"2024-04-25T02:16:00.037875+0000","last_peered":"2024-04-25T02:16:00.037875+0000","last_clean":"2024-04-25T02:16:00.037875+0000","last_became_active":"2024-04-25T02:15:58.034901+0000","last_became_peered":"2024-04-25T02:15:58.034901+0000","last_unstale":"2024-04-25T02:16:00.037875+0000","last_undegraded":"2024-04-25T02:16:00.037875+0000","last_fullsized":"2024-04-25T02:16:00.037875+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:52.361232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045197+0000","last_change":"2024-04-25T02:15:59.042586+0000","last_active":"2024-04-25T02:15:59.045197+0000","last_peered":"2024-04-25T02:15:59.045197+0000","last_clean":"2024-04-25T02:15:59.045197+0000","last_became_active":"2024-04-25T02:15:59.042289+0000","last_became_peered":"2024-04-25T02:15:59.042289+0000","last_unstale":"2024-04-25T02:15:59.045197+0000","last_undegraded":"2024-04-25T02:15:59.045197+0000","last_fullsized":"2024-04-25T02:15:59.045197+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:41.962957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041648+0000","last_change":"2024-04-25T02:15:58.035548+0000","last_active":"2024-04-25T02:16:00.041648+0000","last_peered":"2024-04-25T02:16:00.041648+0000","last_clean":"2024-04-25T02:16:00.041648+0000","last_became_active":"2024-04-25T02:15:58.035287+0000","last_became_peered":"2024-04-25T02:15:58.035287+0000","last_unstale":"2024-04-25T02:16:00.041648+0000","last_undegraded":"2024-04-25T02:16:00.041648+0000","last_fullsized":"2024-04-25T02:16:00.041648+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:55.455321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.036786+0000","last_change":"2024-04-25T02:15:59.030773+0000","last_active":"2024-04-25T02:15:59.036786+0000","last_peered":"2024-04-25T02:15:59.036786+0000","last_clean":"2024-04-25T02:15:59.036786+0000","last_became_active":"2024-04-25T02:15:59.030515+0000","last_became_peered":"2024-04-25T02:15:59.030515+0000","last_unstale":"2024-04-25T02:15:59.036786+0000","last_undegraded":"2024-04-25T02:15:59.036786+0000","last_fullsized":"2024-04-25T02:15:59.036786+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:09:58.426518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"101'1","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045051+0000","last_change":"2024-04-25T02:15:58.034418+0000","last_active":"2024-04-25T02:15:59.045051+0000","last_peered":"2024-04-25T02:15:59.045051+0000","last_clean":"2024-04-25T02:15:59.045051+0000","last_became_active":"2024-04-25T02:15:58.034118+0000","last_became_peered":"2024-04-25T02:15:58.034118+0000","last_unstale":"2024-04-25T02:15:59.045051+0000","last_undegraded":"2024-04-25T02:15:59.045051+0000","last_fullsized":"2024-04-25T02:15:59.045051+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:41:14.590670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.044762+0000","last_change":"2024-04-25T02:15:59.040402+0000","last_active":"2024-04-25T02:15:59.044762+0000","last_peered":"2024-04-25T02:15:59.044762+0000","last_clean":"2024-04-25T02:15:59.044762+0000","last_became_active":"2024-04-25T02:15:59.040129+0000","last_became_peered":"2024-04-25T02:15:59.040129+0000","last_unstale":"2024-04-25T02:15:59.044762+0000","last_undegraded":"2024-04-25T02:15:59.044762+0000","last_fullsized":"2024-04-25T02:15:59.044762+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:53.275987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039116+0000","last_change":"2024-04-25T02:15:58.042065+0000","last_active":"2024-04-25T02:16:00.039116+0000","last_peered":"2024-04-25T02:16:00.039116+0000","last_clean":"2024-04-25T02:16:00.039116+0000","last_became_active":"2024-04-25T02:15:58.041819+0000","last_became_peered":"2024-04-25T02:15:58.041819+0000","last_unstale":"2024-04-25T02:16:00.039116+0000","last_undegraded":"2024-04-25T02:16:00.039116+0000","last_fullsized":"2024-04-25T02:16:00.039116+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:52.268273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.038041+0000","last_change":"2024-04-25T02:15:59.031910+0000","last_active":"2024-04-25T02:15:59.038041+0000","last_peered":"2024-04-25T02:15:59.038041+0000","last_clean":"2024-04-25T02:15:59.038041+0000","last_became_active":"2024-04-25T02:15:59.031598+0000","last_became_peered":"2024-04-25T02:15:59.031598+0000","last_unstale":"2024-04-25T02:15:59.038041+0000","last_undegraded":"2024-04-25T02:15:59.038041+0000","last_fullsized":"2024-04-25T02:15:59.038041+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:02.659511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039114+0000","last_change":"2024-04-25T02:15:58.037417+0000","last_active":"2024-04-25T02:16:00.039114+0000","last_peered":"2024-04-25T02:16:00.039114+0000","last_clean":"2024-04-25T02:16:00.039114+0000","last_became_active":"2024-04-25T02:15:58.035672+0000","last_became_peered":"2024-04-25T02:15:58.035672+0000","last_unstale":"2024-04-25T02:16:00.039114+0000","last_undegraded":"2024-04-25T02:16:00.039114+0000","last_fullsized":"2024-04-25T02:16:00.039114+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:47.626967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045978+0000","last_change":"2024-04-25T02:15:59.038602+0000","last_active":"2024-04-25T02:15:59.045978+0000","last_peered":"2024-04-25T02:15:59.045978+0000","last_clean":"2024-04-25T02:15:59.045978+0000","last_became_active":"2024-04-25T02:15:59.038345+0000","last_became_peered":"2024-04-25T02:15:59.038345+0000","last_unstale":"2024-04-25T02:15:59.045978+0000","last_undegraded":"2024-04-25T02:15:59.045978+0000","last_fullsized":"2024-04-25T02:15:59.045978+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:48.564363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.022489+0000","last_change":"2024-04-25T02:15:58.027970+0000","last_active":"2024-04-25T02:15:59.022489+0000","last_peered":"2024-04-25T02:15:59.022489+0000","last_clean":"2024-04-25T02:15:59.022489+0000","last_became_active":"2024-04-25T02:15:58.027680+0000","last_became_peered":"2024-04-25T02:15:58.027680+0000","last_unstale":"2024-04-25T02:15:59.022489+0000","last_undegraded":"2024-04-25T02:15:59.022489+0000","last_fullsized":"2024-04-25T02:15:59.022489+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:37.298365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.046272+0000","last_change":"2024-04-25T02:15:59.039022+0000","last_active":"2024-04-25T02:15:59.046272+0000","last_peered":"2024-04-25T02:15:59.046272+0000","last_clean":"2024-04-25T02:15:59.046272+0000","last_became_active":"2024-04-25T02:15:59.037654+0000","last_became_peered":"2024-04-25T02:15:59.037654+0000","last_unstale":"2024-04-25T02:15:59.046272+0000","last_undegraded":"2024-04-25T02:15:59.046272+0000","last_fullsized":"2024-04-25T02:15:59.046272+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:16.606164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.022636+0000","last_change":"2024-04-25T02:15:58.032648+0000","last_active":"2024-04-25T02:15:59.022636+0000","last_peered":"2024-04-25T02:15:59.022636+0000","last_clean":"2024-04-25T02:15:59.022636+0000","last_became_active":"2024-04-25T02:15:58.032373+0000","last_became_peered":"2024-04-25T02:15:58.032373+0000","last_unstale":"2024-04-25T02:15:59.022636+0000","last_undegraded":"2024-04-25T02:15:59.022636+0000","last_fullsized":"2024-04-25T02:15:59.022636+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:17.814615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045193+0000","last_change":"2024-04-25T02:15:59.041502+0000","last_active":"2024-04-25T02:15:59.045193+0000","last_peered":"2024-04-25T02:15:59.045193+0000","last_clean":"2024-04-25T02:15:59.045193+0000","last_became_active":"2024-04-25T02:15:59.041237+0000","last_became_peered":"2024-04-25T02:15:59.041237+0000","last_unstale":"2024-04-25T02:15:59.045193+0000","last_undegraded":"2024-04-25T02:15:59.045193+0000","last_fullsized":"2024-04-25T02:15:59.045193+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:48.634681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038917+0000","last_change":"2024-04-25T02:15:58.041456+0000","last_active":"2024-04-25T02:16:00.038917+0000","last_peered":"2024-04-25T02:16:00.038917+0000","last_clean":"2024-04-25T02:16:00.038917+0000","last_became_active":"2024-04-25T02:15:58.041131+0000","last_became_peered":"2024-04-25T02:15:58.041131+0000","last_unstale":"2024-04-25T02:16:00.038917+0000","last_undegraded":"2024-04-25T02:16:00.038917+0000","last_fullsized":"2024-04-25T02:16:00.038917+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:50:47.634942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039454+0000","last_change":"2024-04-25T02:15:59.044246+0000","last_active":"2024-04-25T02:16:00.039454+0000","last_peered":"2024-04-25T02:16:00.039454+0000","last_clean":"2024-04-25T02:16:00.039454+0000","last_became_active":"2024-04-25T02:15:59.043859+0000","last_became_peered":"2024-04-25T02:15:59.043859+0000","last_unstale":"2024-04-25T02:16:00.039454+0000","last_undegraded":"2024-04-25T02:16:00.039454+0000","last_fullsized":"2024-04-25T02:16:00.039454+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:58.463417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"101'2","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.044711+0000","last_change":"2024-04-25T02:15:58.027500+0000","last_active":"2024-04-25T02:15:59.044711+0000","last_peered":"2024-04-25T02:15:59.044711+0000","last_clean":"2024-04-25T02:15:59.044711+0000","last_became_active":"2024-04-25T02:15:58.027220+0000","last_became_peered":"2024-04-25T02:15:58.027220+0000","last_unstale":"2024-04-25T02:15:59.044711+0000","last_undegraded":"2024-04-25T02:15:59.044711+0000","last_fullsized":"2024-04-25T02:15:59.044711+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:31:08.470067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038149+0000","last_change":"2024-04-25T02:15:59.046783+0000","last_active":"2024-04-25T02:16:00.038149+0000","last_peered":"2024-04-25T02:16:00.038149+0000","last_clean":"2024-04-25T02:16:00.038149+0000","last_became_active":"2024-04-25T02:15:59.046532+0000","last_became_peered":"2024-04-25T02:15:59.046532+0000","last_unstale":"2024-04-25T02:16:00.038149+0000","last_undegraded":"2024-04-25T02:16:00.038149+0000","last_fullsized":"2024-04-25T02:16:00.038149+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:41.024740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039524+0000","last_change":"2024-04-25T02:15:58.036542+0000","last_active":"2024-04-25T02:16:00.039524+0000","last_peered":"2024-04-25T02:16:00.039524+0000","last_clean":"2024-04-25T02:16:00.039524+0000","last_became_active":"2024-04-25T02:15:58.036291+0000","last_became_peered":"2024-04-25T02:15:58.036291+0000","last_unstale":"2024-04-25T02:16:00.039524+0000","last_undegraded":"2024-04-25T02:16:00.039524+0000","last_fullsized":"2024-04-25T02:16:00.039524+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:34.506529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038197+0000","last_change":"2024-04-25T02:15:59.038842+0000","last_active":"2024-04-25T02:16:00.038197+0000","last_peered":"2024-04-25T02:16:00.038197+0000","last_clean":"2024-04-25T02:16:00.038197+0000","last_became_active":"2024-04-25T02:15:59.038590+0000","last_became_peered":"2024-04-25T02:15:59.038590+0000","last_unstale":"2024-04-25T02:16:00.038197+0000","last_undegraded":"2024-04-25T02:16:00.038197+0000","last_fullsized":"2024-04-25T02:16:00.038197+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:10.233714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039261+0000","last_change":"2024-04-25T02:15:58.042108+0000","last_active":"2024-04-25T02:16:00.039261+0000","last_peered":"2024-04-25T02:16:00.039261+0000","last_clean":"2024-04-25T02:16:00.039261+0000","last_became_active":"2024-04-25T02:15:58.041821+0000","last_became_peered":"2024-04-25T02:15:58.041821+0000","last_unstale":"2024-04-25T02:16:00.039261+0000","last_undegraded":"2024-04-25T02:16:00.039261+0000","last_fullsized":"2024-04-25T02:16:00.039261+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:11.544340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.043952+0000","last_change":"2024-04-25T02:15:59.039757+0000","last_active":"2024-04-25T02:15:59.043952+0000","last_peered":"2024-04-25T02:15:59.043952+0000","last_clean":"2024-04-25T02:15:59.043952+0000","last_became_active":"2024-04-25T02:15:59.039022+0000","last_became_peered":"2024-04-25T02:15:59.039022+0000","last_unstale":"2024-04-25T02:15:59.043952+0000","last_undegraded":"2024-04-25T02:15:59.043952+0000","last_fullsized":"2024-04-25T02:15:59.043952+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:53.017869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.027409+0000","last_change":"2024-04-25T02:15:58.034330+0000","last_active":"2024-04-25T02:15:59.027409+0000","last_peered":"2024-04-25T02:15:59.027409+0000","last_clean":"2024-04-25T02:15:59.027409+0000","last_became_active":"2024-04-25T02:15:58.033960+0000","last_became_peered":"2024-04-25T02:15:58.033960+0000","last_unstale":"2024-04-25T02:15:59.027409+0000","last_undegraded":"2024-04-25T02:15:59.027409+0000","last_fullsized":"2024-04-25T02:15:59.027409+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:23:10.818677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.049839+0000","last_change":"2024-04-25T02:15:59.044711+0000","last_active":"2024-04-25T02:15:59.049839+0000","last_peered":"2024-04-25T02:15:59.049839+0000","last_clean":"2024-04-25T02:15:59.049839+0000","last_became_active":"2024-04-25T02:15:59.044440+0000","last_became_peered":"2024-04-25T02:15:59.044440+0000","last_unstale":"2024-04-25T02:15:59.049839+0000","last_undegraded":"2024-04-25T02:15:59.049839+0000","last_fullsized":"2024-04-25T02:15:59.049839+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:00.728913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039126+0000","last_change":"2024-04-25T02:15:58.039240+0000","last_active":"2024-04-25T02:16:00.039126+0000","last_peered":"2024-04-25T02:16:00.039126+0000","last_clean":"2024-04-25T02:16:00.039126+0000","last_became_active":"2024-04-25T02:15:58.038867+0000","last_became_peered":"2024-04-25T02:15:58.038867+0000","last_unstale":"2024-04-25T02:16:00.039126+0000","last_undegraded":"2024-04-25T02:16:00.039126+0000","last_fullsized":"2024-04-25T02:16:00.039126+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:05.595513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041324+0000","last_change":"2024-04-25T02:15:59.045518+0000","last_active":"2024-04-25T02:16:00.041324+0000","last_peered":"2024-04-25T02:16:00.041324+0000","last_clean":"2024-04-25T02:16:00.041324+0000","last_became_active":"2024-04-25T02:15:59.044977+0000","last_became_peered":"2024-04-25T02:15:59.044977+0000","last_unstale":"2024-04-25T02:16:00.041324+0000","last_undegraded":"2024-04-25T02:16:00.041324+0000","last_fullsized":"2024-04-25T02:16:00.041324+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:53.017869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.027382+0000","last_change":"2024-04-25T02:15:58.035074+0000","last_active":"2024-04-25T02:15:59.027382+0000","last_peered":"2024-04-25T02:15:59.027382+0000","last_clean":"2024-04-25T02:15:59.027382+0000","last_became_active":"2024-04-25T02:15:58.034772+0000","last_became_peered":"2024-04-25T02:15:58.034772+0000","last_unstale":"2024-04-25T02:15:59.027382+0000","last_undegraded":"2024-04-25T02:15:59.027382+0000","last_fullsized":"2024-04-25T02:15:59.027382+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:46.772742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.049777+0000","last_change":"2024-04-25T02:15:59.044090+0000","last_active":"2024-04-25T02:15:59.049777+0000","last_peered":"2024-04-25T02:15:59.049777+0000","last_clean":"2024-04-25T02:15:59.049777+0000","last_became_active":"2024-04-25T02:15:59.043835+0000","last_became_peered":"2024-04-25T02:15:59.043835+0000","last_unstale":"2024-04-25T02:15:59.049777+0000","last_undegraded":"2024-04-25T02:15:59.049777+0000","last_fullsized":"2024-04-25T02:15:59.049777+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:46.958987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.021739+0000","last_change":"2024-04-25T02:15:58.037409+0000","last_active":"2024-04-25T02:15:59.021739+0000","last_peered":"2024-04-25T02:15:59.021739+0000","last_clean":"2024-04-25T02:15:59.021739+0000","last_became_active":"2024-04-25T02:15:58.037146+0000","last_became_peered":"2024-04-25T02:15:58.037146+0000","last_unstale":"2024-04-25T02:15:59.021739+0000","last_undegraded":"2024-04-25T02:15:59.021739+0000","last_fullsized":"2024-04-25T02:15:59.021739+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:34.506529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045213+0000","last_change":"2024-04-25T02:15:59.041580+0000","last_active":"2024-04-25T02:15:59.045213+0000","last_peered":"2024-04-25T02:15:59.045213+0000","last_clean":"2024-04-25T02:15:59.045213+0000","last_became_active":"2024-04-25T02:15:59.039938+0000","last_became_peered":"2024-04-25T02:15:59.039938+0000","last_unstale":"2024-04-25T02:15:59.045213+0000","last_undegraded":"2024-04-25T02:15:59.045213+0000","last_fullsized":"2024-04-25T02:15:59.045213+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:06.603227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.026451+0000","last_change":"2024-04-25T02:15:58.037863+0000","last_active":"2024-04-25T02:15:59.026451+0000","last_peered":"2024-04-25T02:15:59.026451+0000","last_clean":"2024-04-25T02:15:59.026451+0000","last_became_active":"2024-04-25T02:15:58.037602+0000","last_became_peered":"2024-04-25T02:15:58.037602+0000","last_unstale":"2024-04-25T02:15:59.026451+0000","last_undegraded":"2024-04-25T02:15:59.026451+0000","last_fullsized":"2024-04-25T02:15:59.026451+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:27:09.111661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.049744+0000","last_change":"2024-04-25T02:15:59.043336+0000","last_active":"2024-04-25T02:15:59.049744+0000","last_peered":"2024-04-25T02:15:59.049744+0000","last_clean":"2024-04-25T02:15:59.049744+0000","last_became_active":"2024-04-25T02:15:59.043067+0000","last_became_peered":"2024-04-25T02:15:59.043067+0000","last_unstale":"2024-04-25T02:15:59.049744+0000","last_undegraded":"2024-04-25T02:15:59.049744+0000","last_fullsized":"2024-04-25T02:15:59.049744+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:00.549213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"101'1","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.048774+0000","last_change":"2024-04-25T02:15:58.039104+0000","last_active":"2024-04-25T02:15:59.048774+0000","last_peered":"2024-04-25T02:15:59.048774+0000","last_clean":"2024-04-25T02:15:59.048774+0000","last_became_active":"2024-04-25T02:15:58.038878+0000","last_became_peered":"2024-04-25T02:15:58.038878+0000","last_unstale":"2024-04-25T02:15:59.048774+0000","last_undegraded":"2024-04-25T02:15:59.048774+0000","last_fullsized":"2024-04-25T02:15:59.048774+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:27:09.546078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":317,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.022261+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:15:59.022261+0000","last_peered":"2024-04-25T02:15:59.022261+0000","last_clean":"2024-04-25T02:15:59.022261+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:15:59.022261+0000","last_undegraded":"2024-04-25T02:15:59.022261+0000","last_fullsized":"2024-04-25T02:15:59.022261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574950,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32992,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338848,"statfs":{"total":96636764160,"available":96602980352,"internally_reserved":0,"allocated":1851392,"data_stored":1128189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1257472,"data_stored":538361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":537779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1282048,"data_stored":545745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":539343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574950,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":537743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1261568,"data_stored":544009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33004,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338836,"statfs":{"total":96636764160,"available":96602968064,"internally_reserved":0,"allocated":1859584,"data_stored":1134959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:16:03.015 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:16:03.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.111+0000 7f1fc9aca640 1 Processor -- start 2024-04-25T02:16:03.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.111+0000 7f1fc9aca640 1 -- start start 2024-04-25T02:16:03.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.112+0000 7f1fc9aca640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc40b00e0 0x7f1fc40cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.112+0000 7f1fc9aca640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc40b04c0 con 0x7f1fc406b7c0 2024-04-25T02:16:03.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.112+0000 7f1fc9aca640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc40d02b0 con 0x7f1fc40cc100 2024-04-25T02:16:03.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.112+0000 7f1fc9aca640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc40d0590 con 0x7f1fc40b00e0 2024-04-25T02:16:03.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.112+0000 7f1fc3fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1fc406b7c0 0x7f1fc406e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46780/0 (socket says 172.21.15.79:46780) 2024-04-25T02:16:03.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.112+0000 7f1fc3fff640 1 -- 172.21.15.79:0/3393896502 learned_addr learned my addr 172.21.15.79:0/3393896502 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:03.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.112+0000 7f1fc2ffd640 1 -- 172.21.15.79:0/3393896502 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1597589089 0 0) 0x7f1fc40b04c0 con 0x7f1fc406b7c0 2024-04-25T02:16:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.112+0000 7f1fc2ffd640 1 -- 172.21.15.79:0/3393896502 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fb0003520 con 0x7f1fc406b7c0 2024-04-25T02:16:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.112+0000 7f1fc37fe640 1 --2- 172.21.15.79:0/3393896502 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc40b00e0 0x7f1fc40cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.112+0000 7f1fc2ffd640 1 -- 172.21.15.79:0/3393896502 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1404833699 0 0) 0x7f1fb0003520 con 0x7f1fc406b7c0 2024-04-25T02:16:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.112+0000 7f1fc2ffd640 1 -- 172.21.15.79:0/3393896502 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc40b00e0 msgr2=0x7f1fc40cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.112+0000 7f1fc2ffd640 1 --2- 172.21.15.79:0/3393896502 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc40b00e0 0x7f1fc40cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.112+0000 7f1fc2ffd640 1 -- 172.21.15.79:0/3393896502 >> v1:172.21.15.189:6789/0 conn(0x7f1fc40cc100 legacy=0x7f1fc406b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc2ffd640 1 -- 172.21.15.79:0/3393896502 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc40d0870 con 0x7f1fc406b7c0 2024-04-25T02:16:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc2ffd640 1 -- 172.21.15.79:0/3393896502 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f1fbc0019f0 con 0x7f1fc406b7c0 2024-04-25T02:16:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc2ffd640 1 -- 172.21.15.79:0/3393896502 >> v1:172.21.15.79:6789/0 conn(0x7f1fc406b7c0 legacy=0x7f1fc406e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc2ffd640 1 --2- 172.21.15.79:0/3393896502 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc40b00e0 0x7f1fb00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc2ffd640 1 --2- 172.21.15.79:0/3393896502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb0004010 0x7f1fb0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc2ffd640 1 --2- 172.21.15.79:0/3393896502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fb0004d40 0x7f1fb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc2ffd640 1 -- 172.21.15.79:0/3393896502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc40d0590 con 0x7f1fb0004d40 2024-04-25T02:16:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc2ffd640 1 -- 172.21.15.79:0/3393896502 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb000bc10 con 0x7f1fb0004010 2024-04-25T02:16:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc2ffd640 1 -- 172.21.15.79:0/3393896502 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb000be10 con 0x7f1fc40b00e0 2024-04-25T02:16:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc3fff640 1 --2- 172.21.15.79:0/3393896502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fb0004d40 0x7f1fb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fbbfff640 1 --2- 172.21.15.79:0/3393896502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb0004010 0x7f1fb0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc37fe640 1 --2- 172.21.15.79:0/3393896502 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc40b00e0 0x7f1fb00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc3fff640 1 -- 172.21.15.79:0/3393896502 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc40b00e0 msgr2=0x7f1fb00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc3fff640 1 --2- 172.21.15.79:0/3393896502 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc40b00e0 0x7f1fb00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc3fff640 1 -- 172.21.15.79:0/3393896502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb0004010 msgr2=0x7f1fb0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc3fff640 1 --2- 172.21.15.79:0/3393896502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb0004010 0x7f1fb0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fc3fff640 1 -- 172.21.15.79:0/3393896502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb0003520 con 0x7f1fb0004d40 2024-04-25T02:16:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.113+0000 7f1fbbfff640 1 --2- 172.21.15.79:0/3393896502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb0004010 0x7f1fb0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.114+0000 7f1fc3fff640 1 --2- 172.21.15.79:0/3393896502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fb0004d40 0x7f1fb00051c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40b3830 tx=0x7f1fb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9c7c96f702ec9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.114+0000 7f1fc2ffd640 1 -- 172.21.15.79:0/3393896502 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc00a460 con 0x7f1fb0004d40 2024-04-25T02:16:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.114+0000 7f1fc2ffd640 1 -- 172.21.15.79:0/3393896502 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fbc02f070 con 0x7f1fb0004d40 2024-04-25T02:16:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.114+0000 7f1fc2ffd640 1 -- 172.21.15.79:0/3393896502 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc02bc90 con 0x7f1fb0004d40 2024-04-25T02:16:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.114+0000 7f1fc9aca640 1 -- 172.21.15.79:0/3393896502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fb0004d40 msgr2=0x7f1fb00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.114+0000 7f1fc9aca640 1 --2- 172.21.15.79:0/3393896502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fb0004d40 0x7f1fb00051c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40b3830 tx=0x7f1fb0005830 comp rx=0 tx=0).stop 2024-04-25T02:16:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.114+0000 7f1fc3fff640 1 -- 172.21.15.79:0/3393896502 reap_dead start 2024-04-25T02:16:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.114+0000 7f1fc9aca640 1 -- 172.21.15.79:0/3393896502 shutdown_connections 2024-04-25T02:16:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.114+0000 7f1fc9aca640 1 -- 172.21.15.79:0/3393896502 >> 172.21.15.79:0/3393896502 conn(0x7f1fc40cd770 msgr2=0x7f1fc40cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.114+0000 7f1fc9aca640 1 -- 172.21.15.79:0/3393896502 shutdown_connections 2024-04-25T02:16:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.114+0000 7f1fc9aca640 1 -- 172.21.15.79:0/3393896502 wait complete. 2024-04-25T02:16:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.116+0000 7f1fc9aca640 1 Processor -- start 2024-04-25T02:16:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.116+0000 7f1fc9aca640 1 -- start start 2024-04-25T02:16:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.116+0000 7f1fc9aca640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb0004d40 0x7f1fc415ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.116+0000 7f1fc9aca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc40b4bd0 0x7f1fc40c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.116+0000 7f1fc9aca640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc40c5400 0x7f1fc40c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.116+0000 7f1fc9aca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc40cfa60 con 0x7f1fc40b4bd0 2024-04-25T02:16:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.116+0000 7f1fc9aca640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc406dfd0 con 0x7f1fb0004d40 2024-04-25T02:16:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.116+0000 7f1fc9aca640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc40cfbe0 con 0x7f1fc40c5400 2024-04-25T02:16:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.116+0000 7f1fbbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc40b4bd0 0x7f1fc40c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.116+0000 7f1fbbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc40b4bd0 0x7f1fc40c4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59080/0 (socket says 172.21.15.79:59080) 2024-04-25T02:16:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.116+0000 7f1fbbfff640 1 -- 172.21.15.79:0/3963103026 learned_addr learned my addr 172.21.15.79:0/3963103026 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.117+0000 7f1fc37fe640 1 --2- 172.21.15.79:0/3963103026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb0004d40 0x7f1fc415ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.117+0000 7f1fc3fff640 1 --2- 172.21.15.79:0/3963103026 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc40c5400 0x7f1fc40c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.117+0000 7f1fbbfff640 1 -- 172.21.15.79:0/3963103026 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc40c5400 msgr2=0x7f1fc40c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.117+0000 7f1fbbfff640 1 --2- 172.21.15.79:0/3963103026 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc40c5400 0x7f1fc40c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.117+0000 7f1fbbfff640 1 -- 172.21.15.79:0/3963103026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb0004d40 msgr2=0x7f1fc415ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.117+0000 7f1fbbfff640 1 --2- 172.21.15.79:0/3963103026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb0004d40 0x7f1fc415ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.117+0000 7f1fbbfff640 1 -- 172.21.15.79:0/3963103026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc40c58d0 con 0x7f1fc40b4bd0 2024-04-25T02:16:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.117+0000 7f1fbbfff640 1 --2- 172.21.15.79:0/3963103026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc40b4bd0 0x7f1fc40c4ec0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00e550 tx=0x7f1fac00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.117+0000 7f1fc0ff9640 1 -- 172.21.15.79:0/3963103026 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0052e0 con 0x7f1fc40b4bd0 2024-04-25T02:16:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.117+0000 7f1fc0ff9640 1 -- 172.21.15.79:0/3963103026 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fac018070 con 0x7f1fc40b4bd0 2024-04-25T02:16:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.117+0000 7f1fc9aca640 1 -- 172.21.15.79:0/3963103026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc40c8010 con 0x7f1fc40b4bd0 2024-04-25T02:16:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.117+0000 7f1fc0ff9640 1 -- 172.21.15.79:0/3963103026 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac003830 con 0x7f1fc40b4bd0 2024-04-25T02:16:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.117+0000 7f1fc9aca640 1 -- 172.21.15.79:0/3963103026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc40caa20 con 0x7f1fc40b4bd0 2024-04-25T02:16:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.118+0000 7f1fc9aca640 1 -- 172.21.15.79:0/3963103026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc40690a0 con 0x7f1fc40b4bd0 2024-04-25T02:16:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.118+0000 7f1fc0ff9640 1 -- 172.21.15.79:0/3963103026 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fac0039d0 con 0x7f1fc40b4bd0 2024-04-25T02:16:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.119+0000 7f1fc0ff9640 1 --2- 172.21.15.79:0/3963103026 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa406be30 0x7f1fa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.119+0000 7f1fc37fe640 1 --2- 172.21.15.79:0/3963103026 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa406be30 0x7f1fa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.119+0000 7f1fc0ff9640 1 -- 172.21.15.79:0/3963103026 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f1fac08aac0 con 0x7f1fc40b4bd0 2024-04-25T02:16:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.119+0000 7f1fc37fe640 1 --2- 172.21.15.79:0/3963103026 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa406be30 0x7f1fa406e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4006fd0 tx=0x7f1fb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.123+0000 7f1fc0ff9640 1 -- 172.21.15.79:0/3963103026 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1fac059500 con 0x7f1fc40b4bd0 2024-04-25T02:16:03.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.295+0000 7f1fc9aca640 1 -- 172.21.15.79:0/3963103026 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1fc415b190 con 0x7f1fa406be30 2024-04-25T02:16:03.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.300+0000 7f1fc0ff9640 1 -- 172.21.15.79:0/3963103026 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252381 (secure 0 0 0) 0x7f1fb400b740 con 0x7f1fa406be30 2024-04-25T02:16:03.308 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:03.309 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:16:03.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.304+0000 7f1fc9aca640 1 -- 172.21.15.79:0/3963103026 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa406be30 msgr2=0x7f1fa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.304+0000 7f1fc9aca640 1 --2- 172.21.15.79:0/3963103026 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa406be30 0x7f1fa406e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4006fd0 tx=0x7f1fb4008040 comp rx=0 tx=0).stop 2024-04-25T02:16:03.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.304+0000 7f1fc9aca640 1 -- 172.21.15.79:0/3963103026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc40b4bd0 msgr2=0x7f1fc40c4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.304+0000 7f1fc9aca640 1 --2- 172.21.15.79:0/3963103026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc40b4bd0 0x7f1fc40c4ec0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00e550 tx=0x7f1fac00ea10 comp rx=0 tx=0).stop 2024-04-25T02:16:03.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.304+0000 7f1fc9aca640 1 -- 172.21.15.79:0/3963103026 shutdown_connections 2024-04-25T02:16:03.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.304+0000 7f1fc9aca640 1 --2- 172.21.15.79:0/3963103026 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f1fa406be30 0x7f1fa406e2f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.304+0000 7f1fc9aca640 1 --2- 172.21.15.79:0/3963103026 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1fc40c5400 0x7f1fc40c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.304+0000 7f1fc9aca640 1 --2- 172.21.15.79:0/3963103026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fc40b4bd0 0x7f1fc40c4ec0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.304+0000 7f1fc9aca640 1 --2- 172.21.15.79:0/3963103026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb0004d40 0x7f1fc415ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.304+0000 7f1fc9aca640 1 -- 172.21.15.79:0/3963103026 >> 172.21.15.79:0/3963103026 conn(0x7f1fc40cd770 msgr2=0x7f1fc40700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:03.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.304+0000 7f1fc9aca640 1 -- 172.21.15.79:0/3963103026 shutdown_connections 2024-04-25T02:16:03.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.304+0000 7f1fc9aca640 1 -- 172.21.15.79:0/3963103026 wait complete. 2024-04-25T02:16:03.320 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-04-25T02:16:03.281296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260500,"kb_used_data":11020,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714220,"statfs":{"total":773094113280,"available":772827361280,"internally_reserved":0,"allocated":11284480,"data_stored":5506128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000955"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038041+0000","last_change":"2024-04-25T02:15:59.048033+0000","last_active":"2024-04-25T02:16:00.038041+0000","last_peered":"2024-04-25T02:16:00.038041+0000","last_clean":"2024-04-25T02:16:00.038041+0000","last_became_active":"2024-04-25T02:15:59.047758+0000","last_became_peered":"2024-04-25T02:15:59.047758+0000","last_unstale":"2024-04-25T02:16:00.038041+0000","last_undegraded":"2024-04-25T02:16:00.038041+0000","last_fullsized":"2024-04-25T02:16:00.038041+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:38.306079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039285+0000","last_change":"2024-04-25T02:15:59.044721+0000","last_active":"2024-04-25T02:16:00.039285+0000","last_peered":"2024-04-25T02:16:00.039285+0000","last_clean":"2024-04-25T02:16:00.039285+0000","last_became_active":"2024-04-25T02:15:59.044417+0000","last_became_peered":"2024-04-25T02:15:59.044417+0000","last_unstale":"2024-04-25T02:16:00.039285+0000","last_undegraded":"2024-04-25T02:16:00.039285+0000","last_fullsized":"2024-04-25T02:16:00.039285+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:30.757022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038079+0000","last_change":"2024-04-25T02:15:59.047345+0000","last_active":"2024-04-25T02:16:00.038079+0000","last_peered":"2024-04-25T02:16:00.038079+0000","last_clean":"2024-04-25T02:16:00.038079+0000","last_became_active":"2024-04-25T02:15:59.047108+0000","last_became_peered":"2024-04-25T02:15:59.047108+0000","last_unstale":"2024-04-25T02:16:00.038079+0000","last_undegraded":"2024-04-25T02:16:00.038079+0000","last_fullsized":"2024-04-25T02:16:00.038079+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:09:58.426518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.050207+0000","last_change":"2024-04-25T02:15:59.045300+0000","last_active":"2024-04-25T02:15:59.050207+0000","last_peered":"2024-04-25T02:15:59.050207+0000","last_clean":"2024-04-25T02:15:59.050207+0000","last_became_active":"2024-04-25T02:15:59.045054+0000","last_became_peered":"2024-04-25T02:15:59.045054+0000","last_unstale":"2024-04-25T02:15:59.050207+0000","last_undegraded":"2024-04-25T02:15:59.050207+0000","last_fullsized":"2024-04-25T02:15:59.050207+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:07.876840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045168+0000","last_change":"2024-04-25T02:15:59.041682+0000","last_active":"2024-04-25T02:15:59.045168+0000","last_peered":"2024-04-25T02:15:59.045168+0000","last_clean":"2024-04-25T02:15:59.045168+0000","last_became_active":"2024-04-25T02:15:59.038653+0000","last_became_peered":"2024-04-25T02:15:59.038653+0000","last_unstale":"2024-04-25T02:15:59.045168+0000","last_undegraded":"2024-04-25T02:15:59.045168+0000","last_fullsized":"2024-04-25T02:15:59.045168+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:24:53.391121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.028449+0000","last_change":"2024-04-25T02:15:59.027739+0000","last_active":"2024-04-25T02:15:59.028449+0000","last_peered":"2024-04-25T02:15:59.028449+0000","last_clean":"2024-04-25T02:15:59.028449+0000","last_became_active":"2024-04-25T02:15:59.027472+0000","last_became_peered":"2024-04-25T02:15:59.027472+0000","last_unstale":"2024-04-25T02:15:59.028449+0000","last_undegraded":"2024-04-25T02:15:59.028449+0000","last_fullsized":"2024-04-25T02:15:59.028449+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.283124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.029697+0000","last_change":"2024-04-25T02:15:59.028458+0000","last_active":"2024-04-25T02:15:59.029697+0000","last_peered":"2024-04-25T02:15:59.029697+0000","last_clean":"2024-04-25T02:15:59.029697+0000","last_became_active":"2024-04-25T02:15:59.028186+0000","last_became_peered":"2024-04-25T02:15:59.028186+0000","last_unstale":"2024-04-25T02:15:59.029697+0000","last_undegraded":"2024-04-25T02:15:59.029697+0000","last_fullsized":"2024-04-25T02:15:59.029697+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:08.605733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039021+0000","last_change":"2024-04-25T02:15:59.039255+0000","last_active":"2024-04-25T02:16:00.039021+0000","last_peered":"2024-04-25T02:16:00.039021+0000","last_clean":"2024-04-25T02:16:00.039021+0000","last_became_active":"2024-04-25T02:15:59.039016+0000","last_became_peered":"2024-04-25T02:15:59.039016+0000","last_unstale":"2024-04-25T02:16:00.039021+0000","last_undegraded":"2024-04-25T02:16:00.039021+0000","last_fullsized":"2024-04-25T02:16:00.039021+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:02.257677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041650+0000","last_change":"2024-04-25T02:15:59.044333+0000","last_active":"2024-04-25T02:16:00.041650+0000","last_peered":"2024-04-25T02:16:00.041650+0000","last_clean":"2024-04-25T02:16:00.041650+0000","last_became_active":"2024-04-25T02:15:59.043804+0000","last_became_peered":"2024-04-25T02:15:59.043804+0000","last_unstale":"2024-04-25T02:16:00.041650+0000","last_undegraded":"2024-04-25T02:16:00.041650+0000","last_fullsized":"2024-04-25T02:16:00.041650+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:24:53.391121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045135+0000","last_change":"2024-04-25T02:15:59.041794+0000","last_active":"2024-04-25T02:15:59.045135+0000","last_peered":"2024-04-25T02:15:59.045135+0000","last_clean":"2024-04-25T02:15:59.045135+0000","last_became_active":"2024-04-25T02:15:59.039322+0000","last_became_peered":"2024-04-25T02:15:59.039322+0000","last_unstale":"2024-04-25T02:15:59.045135+0000","last_undegraded":"2024-04-25T02:15:59.045135+0000","last_fullsized":"2024-04-25T02:15:59.045135+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:50:48.642656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045054+0000","last_change":"2024-04-25T02:15:59.042534+0000","last_active":"2024-04-25T02:15:59.045054+0000","last_peered":"2024-04-25T02:15:59.045054+0000","last_clean":"2024-04-25T02:15:59.045054+0000","last_became_active":"2024-04-25T02:15:59.042258+0000","last_became_peered":"2024-04-25T02:15:59.042258+0000","last_unstale":"2024-04-25T02:15:59.045054+0000","last_undegraded":"2024-04-25T02:15:59.045054+0000","last_fullsized":"2024-04-25T02:15:59.045054+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:53.017869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041444+0000","last_change":"2024-04-25T02:15:59.043022+0000","last_active":"2024-04-25T02:16:00.041444+0000","last_peered":"2024-04-25T02:16:00.041444+0000","last_clean":"2024-04-25T02:16:00.041444+0000","last_became_active":"2024-04-25T02:15:59.042707+0000","last_became_peered":"2024-04-25T02:15:59.042707+0000","last_unstale":"2024-04-25T02:16:00.041444+0000","last_undegraded":"2024-04-25T02:16:00.041444+0000","last_fullsized":"2024-04-25T02:16:00.041444+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:48.634681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.050001+0000","last_change":"2024-04-25T02:15:59.044732+0000","last_active":"2024-04-25T02:15:59.050001+0000","last_peered":"2024-04-25T02:15:59.050001+0000","last_clean":"2024-04-25T02:15:59.050001+0000","last_became_active":"2024-04-25T02:15:59.044475+0000","last_became_peered":"2024-04-25T02:15:59.044475+0000","last_unstale":"2024-04-25T02:15:59.050001+0000","last_undegraded":"2024-04-25T02:15:59.050001+0000","last_fullsized":"2024-04-25T02:15:59.050001+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:04:48.608142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.046436+0000","last_change":"2024-04-25T02:15:59.037369+0000","last_active":"2024-04-25T02:15:59.046436+0000","last_peered":"2024-04-25T02:15:59.046436+0000","last_clean":"2024-04-25T02:15:59.046436+0000","last_became_active":"2024-04-25T02:15:59.037100+0000","last_became_peered":"2024-04-25T02:15:59.037100+0000","last_unstale":"2024-04-25T02:15:59.046436+0000","last_undegraded":"2024-04-25T02:15:59.046436+0000","last_fullsized":"2024-04-25T02:15:59.046436+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:16.797911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.042990+0000","last_change":"2024-04-25T02:15:59.038862+0000","last_active":"2024-04-25T02:15:59.042990+0000","last_peered":"2024-04-25T02:15:59.042990+0000","last_clean":"2024-04-25T02:15:59.042990+0000","last_became_active":"2024-04-25T02:15:59.037854+0000","last_became_peered":"2024-04-25T02:15:59.037854+0000","last_unstale":"2024-04-25T02:15:59.042990+0000","last_undegraded":"2024-04-25T02:15:59.042990+0000","last_fullsized":"2024-04-25T02:15:59.042990+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:41.962957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.044794+0000","last_change":"2024-04-25T02:15:59.038569+0000","last_active":"2024-04-25T02:15:59.044794+0000","last_peered":"2024-04-25T02:15:59.044794+0000","last_clean":"2024-04-25T02:15:59.044794+0000","last_became_active":"2024-04-25T02:15:59.033083+0000","last_became_peered":"2024-04-25T02:15:59.033083+0000","last_unstale":"2024-04-25T02:15:59.044794+0000","last_undegraded":"2024-04-25T02:15:59.044794+0000","last_fullsized":"2024-04-25T02:15:59.044794+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:41:15.598384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039434+0000","last_change":"2024-04-25T02:15:59.043429+0000","last_active":"2024-04-25T02:16:00.039434+0000","last_peered":"2024-04-25T02:16:00.039434+0000","last_clean":"2024-04-25T02:16:00.039434+0000","last_became_active":"2024-04-25T02:15:59.043180+0000","last_became_peered":"2024-04-25T02:15:59.043180+0000","last_unstale":"2024-04-25T02:16:00.039434+0000","last_undegraded":"2024-04-25T02:16:00.039434+0000","last_fullsized":"2024-04-25T02:16:00.039434+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:37.281738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.049985+0000","last_change":"2024-04-25T02:15:59.044695+0000","last_active":"2024-04-25T02:15:59.049985+0000","last_peered":"2024-04-25T02:15:59.049985+0000","last_clean":"2024-04-25T02:15:59.049985+0000","last_became_active":"2024-04-25T02:15:59.044434+0000","last_became_peered":"2024-04-25T02:15:59.044434+0000","last_unstale":"2024-04-25T02:15:59.049985+0000","last_undegraded":"2024-04-25T02:15:59.049985+0000","last_fullsized":"2024-04-25T02:15:59.049985+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:12.552054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.046174+0000","last_change":"2024-04-25T02:15:59.037405+0000","last_active":"2024-04-25T02:15:59.046174+0000","last_peered":"2024-04-25T02:15:59.046174+0000","last_clean":"2024-04-25T02:15:59.046174+0000","last_became_active":"2024-04-25T02:15:59.037133+0000","last_became_peered":"2024-04-25T02:15:59.037133+0000","last_unstale":"2024-04-25T02:15:59.046174+0000","last_undegraded":"2024-04-25T02:15:59.046174+0000","last_fullsized":"2024-04-25T02:15:59.046174+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:30:57.967762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041589+0000","last_change":"2024-04-25T02:15:59.049501+0000","last_active":"2024-04-25T02:16:00.041589+0000","last_peered":"2024-04-25T02:16:00.041589+0000","last_clean":"2024-04-25T02:16:00.041589+0000","last_became_active":"2024-04-25T02:15:59.049228+0000","last_became_peered":"2024-04-25T02:15:59.049228+0000","last_unstale":"2024-04-25T02:16:00.041589+0000","last_undegraded":"2024-04-25T02:16:00.041589+0000","last_fullsized":"2024-04-25T02:16:00.041589+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:06.603227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045999+0000","last_change":"2024-04-25T02:15:59.040087+0000","last_active":"2024-04-25T02:15:59.045999+0000","last_peered":"2024-04-25T02:15:59.045999+0000","last_clean":"2024-04-25T02:15:59.045999+0000","last_became_active":"2024-04-25T02:15:59.039798+0000","last_became_peered":"2024-04-25T02:15:59.039798+0000","last_unstale":"2024-04-25T02:15:59.045999+0000","last_undegraded":"2024-04-25T02:15:59.045999+0000","last_fullsized":"2024-04-25T02:15:59.045999+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:43.563899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038981+0000","last_change":"2024-04-25T02:15:59.045331+0000","last_active":"2024-04-25T02:16:00.038981+0000","last_peered":"2024-04-25T02:16:00.038981+0000","last_clean":"2024-04-25T02:16:00.038981+0000","last_became_active":"2024-04-25T02:15:59.045094+0000","last_became_peered":"2024-04-25T02:15:59.045094+0000","last_unstale":"2024-04-25T02:16:00.038981+0000","last_undegraded":"2024-04-25T02:16:00.038981+0000","last_fullsized":"2024-04-25T02:16:00.038981+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:06:18.213481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038989+0000","last_change":"2024-04-25T02:15:59.045951+0000","last_active":"2024-04-25T02:16:00.038989+0000","last_peered":"2024-04-25T02:16:00.038989+0000","last_clean":"2024-04-25T02:16:00.038989+0000","last_became_active":"2024-04-25T02:15:59.045706+0000","last_became_peered":"2024-04-25T02:15:59.045706+0000","last_unstale":"2024-04-25T02:16:00.038989+0000","last_undegraded":"2024-04-25T02:16:00.038989+0000","last_fullsized":"2024-04-25T02:16:00.038989+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:58:48.604054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.044771+0000","last_change":"2024-04-25T02:15:59.038359+0000","last_active":"2024-04-25T02:15:59.044771+0000","last_peered":"2024-04-25T02:15:59.044771+0000","last_clean":"2024-04-25T02:15:59.044771+0000","last_became_active":"2024-04-25T02:15:59.037519+0000","last_became_peered":"2024-04-25T02:15:59.037519+0000","last_unstale":"2024-04-25T02:15:59.044771+0000","last_undegraded":"2024-04-25T02:15:59.044771+0000","last_fullsized":"2024-04-25T02:15:59.044771+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:16.534422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.043933+0000","last_change":"2024-04-25T02:15:59.038529+0000","last_active":"2024-04-25T02:15:59.043933+0000","last_peered":"2024-04-25T02:15:59.043933+0000","last_clean":"2024-04-25T02:15:59.043933+0000","last_became_active":"2024-04-25T02:15:59.038230+0000","last_became_peered":"2024-04-25T02:15:59.038230+0000","last_unstale":"2024-04-25T02:15:59.043933+0000","last_undegraded":"2024-04-25T02:15:59.043933+0000","last_fullsized":"2024-04-25T02:15:59.043933+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:35.514243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039289+0000","last_change":"2024-04-25T02:15:59.039384+0000","last_active":"2024-04-25T02:16:00.039289+0000","last_peered":"2024-04-25T02:16:00.039289+0000","last_clean":"2024-04-25T02:16:00.039289+0000","last_became_active":"2024-04-25T02:15:59.038618+0000","last_became_peered":"2024-04-25T02:15:59.038618+0000","last_unstale":"2024-04-25T02:16:00.039289+0000","last_undegraded":"2024-04-25T02:16:00.039289+0000","last_fullsized":"2024-04-25T02:16:00.039289+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:25:47.867915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045035+0000","last_change":"2024-04-25T02:15:59.041240+0000","last_active":"2024-04-25T02:15:59.045035+0000","last_peered":"2024-04-25T02:15:59.045035+0000","last_clean":"2024-04-25T02:15:59.045035+0000","last_became_active":"2024-04-25T02:15:59.040963+0000","last_became_peered":"2024-04-25T02:15:59.040963+0000","last_unstale":"2024-04-25T02:15:59.045035+0000","last_undegraded":"2024-04-25T02:15:59.045035+0000","last_fullsized":"2024-04-25T02:15:59.045035+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:35.514243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045119+0000","last_change":"2024-04-25T02:15:59.042599+0000","last_active":"2024-04-25T02:15:59.045119+0000","last_peered":"2024-04-25T02:15:59.045119+0000","last_clean":"2024-04-25T02:15:59.045119+0000","last_became_active":"2024-04-25T02:15:59.041862+0000","last_became_peered":"2024-04-25T02:15:59.041862+0000","last_unstale":"2024-04-25T02:15:59.045119+0000","last_undegraded":"2024-04-25T02:15:59.045119+0000","last_fullsized":"2024-04-25T02:15:59.045119+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:12.552054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039030+0000","last_change":"2024-04-25T02:15:59.039475+0000","last_active":"2024-04-25T02:16:00.039030+0000","last_peered":"2024-04-25T02:16:00.039030+0000","last_clean":"2024-04-25T02:16:00.039030+0000","last_became_active":"2024-04-25T02:15:59.038059+0000","last_became_peered":"2024-04-25T02:15:59.038059+0000","last_unstale":"2024-04-25T02:16:00.039030+0000","last_undegraded":"2024-04-25T02:16:00.039030+0000","last_fullsized":"2024-04-25T02:16:00.039030+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:26.157441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.039998+0000","last_change":"2024-04-25T02:15:59.035093+0000","last_active":"2024-04-25T02:15:59.039998+0000","last_peered":"2024-04-25T02:15:59.039998+0000","last_clean":"2024-04-25T02:15:59.039998+0000","last_became_active":"2024-04-25T02:15:59.034842+0000","last_became_peered":"2024-04-25T02:15:59.034842+0000","last_unstale":"2024-04-25T02:15:59.039998+0000","last_undegraded":"2024-04-25T02:15:59.039998+0000","last_fullsized":"2024-04-25T02:15:59.039998+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:02.281037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.038758+0000","last_change":"2024-04-25T02:15:59.031374+0000","last_active":"2024-04-25T02:15:59.038758+0000","last_peered":"2024-04-25T02:15:59.038758+0000","last_clean":"2024-04-25T02:15:59.038758+0000","last_became_active":"2024-04-25T02:15:59.031072+0000","last_became_peered":"2024-04-25T02:15:59.031072+0000","last_unstale":"2024-04-25T02:15:59.038758+0000","last_undegraded":"2024-04-25T02:15:59.038758+0000","last_fullsized":"2024-04-25T02:15:59.038758+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:24:53.391121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.037801+0000","last_change":"2024-04-25T02:15:59.042015+0000","last_active":"2024-04-25T02:16:00.037801+0000","last_peered":"2024-04-25T02:16:00.037801+0000","last_clean":"2024-04-25T02:16:00.037801+0000","last_became_active":"2024-04-25T02:15:59.041757+0000","last_became_peered":"2024-04-25T02:15:59.041757+0000","last_unstale":"2024-04-25T02:16:00.037801+0000","last_undegraded":"2024-04-25T02:16:00.037801+0000","last_fullsized":"2024-04-25T02:16:00.037801+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:00:24.970582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.046405+0000","last_change":"2024-04-25T02:15:59.039766+0000","last_active":"2024-04-25T02:15:59.046405+0000","last_peered":"2024-04-25T02:15:59.046405+0000","last_clean":"2024-04-25T02:15:59.046405+0000","last_became_active":"2024-04-25T02:15:59.038539+0000","last_became_peered":"2024-04-25T02:15:59.038539+0000","last_unstale":"2024-04-25T02:15:59.046405+0000","last_undegraded":"2024-04-25T02:15:59.046405+0000","last_fullsized":"2024-04-25T02:15:59.046405+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:25.005076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"101'4","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039432+0000","last_change":"2024-04-25T02:15:58.035881+0000","last_active":"2024-04-25T02:16:00.039432+0000","last_peered":"2024-04-25T02:16:00.039432+0000","last_clean":"2024-04-25T02:16:00.039432+0000","last_became_active":"2024-04-25T02:15:58.035611+0000","last_became_peered":"2024-04-25T02:15:58.035611+0000","last_unstale":"2024-04-25T02:16:00.039432+0000","last_undegraded":"2024-04-25T02:16:00.039432+0000","last_fullsized":"2024-04-25T02:16:00.039432+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:52.010155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.038718+0000","last_change":"2024-04-25T02:15:59.030776+0000","last_active":"2024-04-25T02:15:59.038718+0000","last_peered":"2024-04-25T02:15:59.038718+0000","last_clean":"2024-04-25T02:15:59.038718+0000","last_became_active":"2024-04-25T02:15:59.030407+0000","last_became_peered":"2024-04-25T02:15:59.030407+0000","last_unstale":"2024-04-25T02:15:59.038718+0000","last_undegraded":"2024-04-25T02:15:59.038718+0000","last_fullsized":"2024-04-25T02:15:59.038718+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:06.603227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"101'1","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.037626+0000","last_change":"2024-04-25T02:15:58.038169+0000","last_active":"2024-04-25T02:15:59.037626+0000","last_peered":"2024-04-25T02:15:59.037626+0000","last_clean":"2024-04-25T02:15:59.037626+0000","last_became_active":"2024-04-25T02:15:58.037913+0000","last_became_peered":"2024-04-25T02:15:58.037913+0000","last_unstale":"2024-04-25T02:15:59.037626+0000","last_undegraded":"2024-04-25T02:15:59.037626+0000","last_fullsized":"2024-04-25T02:15:59.037626+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:42.612755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038041+0000","last_change":"2024-04-25T02:15:59.042791+0000","last_active":"2024-04-25T02:16:00.038041+0000","last_peered":"2024-04-25T02:16:00.038041+0000","last_clean":"2024-04-25T02:16:00.038041+0000","last_became_active":"2024-04-25T02:15:59.042493+0000","last_became_peered":"2024-04-25T02:15:59.042493+0000","last_unstale":"2024-04-25T02:16:00.038041+0000","last_undegraded":"2024-04-25T02:16:00.038041+0000","last_fullsized":"2024-04-25T02:16:00.038041+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:18.822329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039187+0000","last_change":"2024-04-25T02:15:58.035375+0000","last_active":"2024-04-25T02:16:00.039187+0000","last_peered":"2024-04-25T02:16:00.039187+0000","last_clean":"2024-04-25T02:16:00.039187+0000","last_became_active":"2024-04-25T02:15:58.035123+0000","last_became_peered":"2024-04-25T02:15:58.035123+0000","last_unstale":"2024-04-25T02:16:00.039187+0000","last_undegraded":"2024-04-25T02:16:00.039187+0000","last_fullsized":"2024-04-25T02:16:00.039187+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:40.955244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041934+0000","last_change":"2024-04-25T02:15:59.045816+0000","last_active":"2024-04-25T02:16:00.041934+0000","last_peered":"2024-04-25T02:16:00.041934+0000","last_clean":"2024-04-25T02:16:00.041934+0000","last_became_active":"2024-04-25T02:15:59.045546+0000","last_became_peered":"2024-04-25T02:15:59.045546+0000","last_unstale":"2024-04-25T02:16:00.041934+0000","last_undegraded":"2024-04-25T02:16:00.041934+0000","last_fullsized":"2024-04-25T02:16:00.041934+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:41.962957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039133+0000","last_change":"2024-04-25T02:15:58.042061+0000","last_active":"2024-04-25T02:16:00.039133+0000","last_peered":"2024-04-25T02:16:00.039133+0000","last_clean":"2024-04-25T02:16:00.039133+0000","last_became_active":"2024-04-25T02:15:58.041778+0000","last_became_peered":"2024-04-25T02:15:58.041778+0000","last_unstale":"2024-04-25T02:16:00.039133+0000","last_undegraded":"2024-04-25T02:16:00.039133+0000","last_fullsized":"2024-04-25T02:16:00.039133+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:41:14.590670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.044767+0000","last_change":"2024-04-25T02:15:59.042406+0000","last_active":"2024-04-25T02:15:59.044767+0000","last_peered":"2024-04-25T02:15:59.044767+0000","last_clean":"2024-04-25T02:15:59.044767+0000","last_became_active":"2024-04-25T02:15:59.042130+0000","last_became_peered":"2024-04-25T02:15:59.042130+0000","last_unstale":"2024-04-25T02:15:59.044767+0000","last_undegraded":"2024-04-25T02:15:59.044767+0000","last_fullsized":"2024-04-25T02:15:59.044767+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:41.024740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038107+0000","last_change":"2024-04-25T02:15:58.033210+0000","last_active":"2024-04-25T02:16:00.038107+0000","last_peered":"2024-04-25T02:16:00.038107+0000","last_clean":"2024-04-25T02:16:00.038107+0000","last_became_active":"2024-04-25T02:15:58.032918+0000","last_became_peered":"2024-04-25T02:15:58.032918+0000","last_unstale":"2024-04-25T02:16:00.038107+0000","last_undegraded":"2024-04-25T02:16:00.038107+0000","last_fullsized":"2024-04-25T02:16:00.038107+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:38.452114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.044487+0000","last_change":"2024-04-25T02:15:59.033187+0000","last_active":"2024-04-25T02:15:59.044487+0000","last_peered":"2024-04-25T02:15:59.044487+0000","last_clean":"2024-04-25T02:15:59.044487+0000","last_became_active":"2024-04-25T02:15:59.032115+0000","last_became_peered":"2024-04-25T02:15:59.032115+0000","last_unstale":"2024-04-25T02:15:59.044487+0000","last_undegraded":"2024-04-25T02:15:59.044487+0000","last_fullsized":"2024-04-25T02:15:59.044487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:47.780456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038957+0000","last_change":"2024-04-25T02:15:58.037083+0000","last_active":"2024-04-25T02:16:00.038957+0000","last_peered":"2024-04-25T02:16:00.038957+0000","last_clean":"2024-04-25T02:16:00.038957+0000","last_became_active":"2024-04-25T02:15:58.036837+0000","last_became_peered":"2024-04-25T02:15:58.036837+0000","last_unstale":"2024-04-25T02:16:00.038957+0000","last_undegraded":"2024-04-25T02:16:00.038957+0000","last_fullsized":"2024-04-25T02:16:00.038957+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:24:52.383408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.042805+0000","last_change":"2024-04-25T02:15:59.038470+0000","last_active":"2024-04-25T02:15:59.042805+0000","last_peered":"2024-04-25T02:15:59.042805+0000","last_clean":"2024-04-25T02:15:59.042805+0000","last_became_active":"2024-04-25T02:15:59.038193+0000","last_became_peered":"2024-04-25T02:15:59.038193+0000","last_unstale":"2024-04-25T02:15:59.042805+0000","last_undegraded":"2024-04-25T02:15:59.042805+0000","last_fullsized":"2024-04-25T02:15:59.042805+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:50:48.642656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.027552+0000","last_change":"2024-04-25T02:15:58.036097+0000","last_active":"2024-04-25T02:15:59.027552+0000","last_peered":"2024-04-25T02:15:59.027552+0000","last_clean":"2024-04-25T02:15:59.027552+0000","last_became_active":"2024-04-25T02:15:58.035821+0000","last_became_peered":"2024-04-25T02:15:58.035821+0000","last_unstale":"2024-04-25T02:15:59.027552+0000","last_undegraded":"2024-04-25T02:15:59.027552+0000","last_fullsized":"2024-04-25T02:15:59.027552+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:15.526709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041214+0000","last_change":"2024-04-25T02:15:59.045435+0000","last_active":"2024-04-25T02:16:00.041214+0000","last_peered":"2024-04-25T02:16:00.041214+0000","last_clean":"2024-04-25T02:16:00.041214+0000","last_became_active":"2024-04-25T02:15:59.044925+0000","last_became_peered":"2024-04-25T02:15:59.044925+0000","last_unstale":"2024-04-25T02:16:00.041214+0000","last_undegraded":"2024-04-25T02:16:00.041214+0000","last_fullsized":"2024-04-25T02:16:00.041214+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:53.275987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.037781+0000","last_change":"2024-04-25T02:15:58.036867+0000","last_active":"2024-04-25T02:16:00.037781+0000","last_peered":"2024-04-25T02:16:00.037781+0000","last_clean":"2024-04-25T02:16:00.037781+0000","last_became_active":"2024-04-25T02:15:58.036638+0000","last_became_peered":"2024-04-25T02:15:58.036638+0000","last_unstale":"2024-04-25T02:16:00.037781+0000","last_undegraded":"2024-04-25T02:16:00.037781+0000","last_fullsized":"2024-04-25T02:16:00.037781+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:34.422022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039431+0000","last_change":"2024-04-25T02:15:59.042417+0000","last_active":"2024-04-25T02:16:00.039431+0000","last_peered":"2024-04-25T02:16:00.039431+0000","last_clean":"2024-04-25T02:16:00.039431+0000","last_became_active":"2024-04-25T02:15:59.042164+0000","last_became_peered":"2024-04-25T02:15:59.042164+0000","last_unstale":"2024-04-25T02:16:00.039431+0000","last_undegraded":"2024-04-25T02:16:00.039431+0000","last_fullsized":"2024-04-25T02:16:00.039431+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:36.029935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038136+0000","last_change":"2024-04-25T02:15:58.027761+0000","last_active":"2024-04-25T02:16:00.038136+0000","last_peered":"2024-04-25T02:16:00.038136+0000","last_clean":"2024-04-25T02:16:00.038136+0000","last_became_active":"2024-04-25T02:15:58.027480+0000","last_became_peered":"2024-04-25T02:15:58.027480+0000","last_unstale":"2024-04-25T02:16:00.038136+0000","last_undegraded":"2024-04-25T02:16:00.038136+0000","last_fullsized":"2024-04-25T02:16:00.038136+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:15.982357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041787+0000","last_change":"2024-04-25T02:15:59.038080+0000","last_active":"2024-04-25T02:16:00.041787+0000","last_peered":"2024-04-25T02:16:00.041787+0000","last_clean":"2024-04-25T02:16:00.041787+0000","last_became_active":"2024-04-25T02:15:59.037574+0000","last_became_peered":"2024-04-25T02:15:59.037574+0000","last_unstale":"2024-04-25T02:16:00.041787+0000","last_undegraded":"2024-04-25T02:16:00.041787+0000","last_fullsized":"2024-04-25T02:16:00.041787+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:50:48.642656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.022293+0000","last_change":"2024-04-25T02:15:58.036738+0000","last_active":"2024-04-25T02:15:59.022293+0000","last_peered":"2024-04-25T02:15:59.022293+0000","last_clean":"2024-04-25T02:15:59.022293+0000","last_became_active":"2024-04-25T02:15:58.036474+0000","last_became_peered":"2024-04-25T02:15:58.036474+0000","last_unstale":"2024-04-25T02:15:59.022293+0000","last_undegraded":"2024-04-25T02:15:59.022293+0000","last_fullsized":"2024-04-25T02:15:59.022293+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:52.010155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.036768+0000","last_change":"2024-04-25T02:15:59.032480+0000","last_active":"2024-04-25T02:15:59.036768+0000","last_peered":"2024-04-25T02:15:59.036768+0000","last_clean":"2024-04-25T02:15:59.036768+0000","last_became_active":"2024-04-25T02:15:59.032048+0000","last_became_peered":"2024-04-25T02:15:59.032048+0000","last_unstale":"2024-04-25T02:15:59.036768+0000","last_undegraded":"2024-04-25T02:15:59.036768+0000","last_fullsized":"2024-04-25T02:15:59.036768+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:53.275987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"101'3","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.044365+0000","last_change":"2024-04-25T02:15:58.042185+0000","last_active":"2024-04-25T02:15:59.044365+0000","last_peered":"2024-04-25T02:15:59.044365+0000","last_clean":"2024-04-25T02:15:59.044365+0000","last_became_active":"2024-04-25T02:15:58.041880+0000","last_became_peered":"2024-04-25T02:15:58.041880+0000","last_unstale":"2024-04-25T02:15:59.044365+0000","last_undegraded":"2024-04-25T02:15:59.044365+0000","last_fullsized":"2024-04-25T02:15:59.044365+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:08.126815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.037104+0000","last_change":"2024-04-25T02:15:59.033345+0000","last_active":"2024-04-25T02:15:59.037104+0000","last_peered":"2024-04-25T02:15:59.037104+0000","last_clean":"2024-04-25T02:15:59.037104+0000","last_became_active":"2024-04-25T02:15:59.033043+0000","last_became_peered":"2024-04-25T02:15:59.033043+0000","last_unstale":"2024-04-25T02:15:59.037104+0000","last_undegraded":"2024-04-25T02:15:59.037104+0000","last_fullsized":"2024-04-25T02:15:59.037104+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:23:11.826390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"101'6","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041529+0000","last_change":"2024-04-25T02:15:58.033667+0000","last_active":"2024-04-25T02:16:00.041529+0000","last_peered":"2024-04-25T02:16:00.041529+0000","last_clean":"2024-04-25T02:16:00.041529+0000","last_became_active":"2024-04-25T02:15:58.032494+0000","last_became_peered":"2024-04-25T02:15:58.032494+0000","last_unstale":"2024-04-25T02:16:00.041529+0000","last_undegraded":"2024-04-25T02:16:00.041529+0000","last_fullsized":"2024-04-25T02:16:00.041529+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:45.640956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.030750+0000","last_change":"2024-04-25T02:15:59.026111+0000","last_active":"2024-04-25T02:15:59.030750+0000","last_peered":"2024-04-25T02:15:59.030750+0000","last_clean":"2024-04-25T02:15:59.030750+0000","last_became_active":"2024-04-25T02:15:59.025833+0000","last_became_peered":"2024-04-25T02:15:59.025833+0000","last_unstale":"2024-04-25T02:15:59.030750+0000","last_undegraded":"2024-04-25T02:15:59.030750+0000","last_fullsized":"2024-04-25T02:15:59.030750+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:48.634681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"101'2","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.046243+0000","last_change":"2024-04-25T02:15:58.028180+0000","last_active":"2024-04-25T02:15:59.046243+0000","last_peered":"2024-04-25T02:15:59.046243+0000","last_clean":"2024-04-25T02:15:59.046243+0000","last_became_active":"2024-04-25T02:15:58.027801+0000","last_became_peered":"2024-04-25T02:15:58.027801+0000","last_unstale":"2024-04-25T02:15:59.046243+0000","last_undegraded":"2024-04-25T02:15:59.046243+0000","last_fullsized":"2024-04-25T02:15:59.046243+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:19.956284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.037994+0000","last_change":"2024-04-25T02:15:59.045705+0000","last_active":"2024-04-25T02:16:00.037994+0000","last_peered":"2024-04-25T02:16:00.037994+0000","last_clean":"2024-04-25T02:16:00.037994+0000","last_became_active":"2024-04-25T02:15:59.045464+0000","last_became_peered":"2024-04-25T02:15:59.045464+0000","last_unstale":"2024-04-25T02:16:00.037994+0000","last_undegraded":"2024-04-25T02:16:00.037994+0000","last_fullsized":"2024-04-25T02:16:00.037994+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:31:09.477781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.024735+0000","last_change":"2024-04-25T02:15:58.030658+0000","last_active":"2024-04-25T02:15:59.024735+0000","last_peered":"2024-04-25T02:15:59.024735+0000","last_clean":"2024-04-25T02:15:59.024735+0000","last_became_active":"2024-04-25T02:15:58.030285+0000","last_became_peered":"2024-04-25T02:15:58.030285+0000","last_unstale":"2024-04-25T02:15:59.024735+0000","last_undegraded":"2024-04-25T02:15:59.024735+0000","last_fullsized":"2024-04-25T02:15:59.024735+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:15:10.911635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041263+0000","last_change":"2024-04-25T02:15:59.045257+0000","last_active":"2024-04-25T02:16:00.041263+0000","last_peered":"2024-04-25T02:16:00.041263+0000","last_clean":"2024-04-25T02:16:00.041263+0000","last_became_active":"2024-04-25T02:15:59.044034+0000","last_became_peered":"2024-04-25T02:15:59.044034+0000","last_unstale":"2024-04-25T02:16:00.041263+0000","last_undegraded":"2024-04-25T02:16:00.041263+0000","last_fullsized":"2024-04-25T02:16:00.041263+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:35.514243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041325+0000","last_change":"2024-04-25T02:15:58.034151+0000","last_active":"2024-04-25T02:16:00.041325+0000","last_peered":"2024-04-25T02:16:00.041325+0000","last_clean":"2024-04-25T02:16:00.041325+0000","last_became_active":"2024-04-25T02:15:58.033556+0000","last_became_peered":"2024-04-25T02:15:58.033556+0000","last_unstale":"2024-04-25T02:16:00.041325+0000","last_undegraded":"2024-04-25T02:16:00.041325+0000","last_fullsized":"2024-04-25T02:16:00.041325+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:34.555904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.049722+0000","last_change":"2024-04-25T02:15:59.043460+0000","last_active":"2024-04-25T02:15:59.049722+0000","last_peered":"2024-04-25T02:15:59.049722+0000","last_clean":"2024-04-25T02:15:59.049722+0000","last_became_active":"2024-04-25T02:15:59.043197+0000","last_became_peered":"2024-04-25T02:15:59.043197+0000","last_unstale":"2024-04-25T02:15:59.049722+0000","last_undegraded":"2024-04-25T02:15:59.049722+0000","last_fullsized":"2024-04-25T02:15:59.049722+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:51.861998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"101'8","reported_seq":22,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.037875+0000","last_change":"2024-04-25T02:15:58.035608+0000","last_active":"2024-04-25T02:16:00.037875+0000","last_peered":"2024-04-25T02:16:00.037875+0000","last_clean":"2024-04-25T02:16:00.037875+0000","last_became_active":"2024-04-25T02:15:58.034901+0000","last_became_peered":"2024-04-25T02:15:58.034901+0000","last_unstale":"2024-04-25T02:16:00.037875+0000","last_undegraded":"2024-04-25T02:16:00.037875+0000","last_fullsized":"2024-04-25T02:16:00.037875+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:52.361232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045197+0000","last_change":"2024-04-25T02:15:59.042586+0000","last_active":"2024-04-25T02:15:59.045197+0000","last_peered":"2024-04-25T02:15:59.045197+0000","last_clean":"2024-04-25T02:15:59.045197+0000","last_became_active":"2024-04-25T02:15:59.042289+0000","last_became_peered":"2024-04-25T02:15:59.042289+0000","last_unstale":"2024-04-25T02:15:59.045197+0000","last_undegraded":"2024-04-25T02:15:59.045197+0000","last_fullsized":"2024-04-25T02:15:59.045197+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:41.962957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041648+0000","last_change":"2024-04-25T02:15:58.035548+0000","last_active":"2024-04-25T02:16:00.041648+0000","last_peered":"2024-04-25T02:16:00.041648+0000","last_clean":"2024-04-25T02:16:00.041648+0000","last_became_active":"2024-04-25T02:15:58.035287+0000","last_became_peered":"2024-04-25T02:15:58.035287+0000","last_unstale":"2024-04-25T02:16:00.041648+0000","last_undegraded":"2024-04-25T02:16:00.041648+0000","last_fullsized":"2024-04-25T02:16:00.041648+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:55.455321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.036786+0000","last_change":"2024-04-25T02:15:59.030773+0000","last_active":"2024-04-25T02:15:59.036786+0000","last_peered":"2024-04-25T02:15:59.036786+0000","last_clean":"2024-04-25T02:15:59.036786+0000","last_became_active":"2024-04-25T02:15:59.030515+0000","last_became_peered":"2024-04-25T02:15:59.030515+0000","last_unstale":"2024-04-25T02:15:59.036786+0000","last_undegraded":"2024-04-25T02:15:59.036786+0000","last_fullsized":"2024-04-25T02:15:59.036786+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:09:58.426518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"101'1","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045051+0000","last_change":"2024-04-25T02:15:58.034418+0000","last_active":"2024-04-25T02:15:59.045051+0000","last_peered":"2024-04-25T02:15:59.045051+0000","last_clean":"2024-04-25T02:15:59.045051+0000","last_became_active":"2024-04-25T02:15:58.034118+0000","last_became_peered":"2024-04-25T02:15:58.034118+0000","last_unstale":"2024-04-25T02:15:59.045051+0000","last_undegraded":"2024-04-25T02:15:59.045051+0000","last_fullsized":"2024-04-25T02:15:59.045051+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:41:14.590670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.044762+0000","last_change":"2024-04-25T02:15:59.040402+0000","last_active":"2024-04-25T02:15:59.044762+0000","last_peered":"2024-04-25T02:15:59.044762+0000","last_clean":"2024-04-25T02:15:59.044762+0000","last_became_active":"2024-04-25T02:15:59.040129+0000","last_became_peered":"2024-04-25T02:15:59.040129+0000","last_unstale":"2024-04-25T02:15:59.044762+0000","last_undegraded":"2024-04-25T02:15:59.044762+0000","last_fullsized":"2024-04-25T02:15:59.044762+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:53.275987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039116+0000","last_change":"2024-04-25T02:15:58.042065+0000","last_active":"2024-04-25T02:16:00.039116+0000","last_peered":"2024-04-25T02:16:00.039116+0000","last_clean":"2024-04-25T02:16:00.039116+0000","last_became_active":"2024-04-25T02:15:58.041819+0000","last_became_peered":"2024-04-25T02:15:58.041819+0000","last_unstale":"2024-04-25T02:16:00.039116+0000","last_undegraded":"2024-04-25T02:16:00.039116+0000","last_fullsized":"2024-04-25T02:16:00.039116+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:52.268273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.038041+0000","last_change":"2024-04-25T02:15:59.031910+0000","last_active":"2024-04-25T02:15:59.038041+0000","last_peered":"2024-04-25T02:15:59.038041+0000","last_clean":"2024-04-25T02:15:59.038041+0000","last_became_active":"2024-04-25T02:15:59.031598+0000","last_became_peered":"2024-04-25T02:15:59.031598+0000","last_unstale":"2024-04-25T02:15:59.038041+0000","last_undegraded":"2024-04-25T02:15:59.038041+0000","last_fullsized":"2024-04-25T02:15:59.038041+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:02.659511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039114+0000","last_change":"2024-04-25T02:15:58.037417+0000","last_active":"2024-04-25T02:16:00.039114+0000","last_peered":"2024-04-25T02:16:00.039114+0000","last_clean":"2024-04-25T02:16:00.039114+0000","last_became_active":"2024-04-25T02:15:58.035672+0000","last_became_peered":"2024-04-25T02:15:58.035672+0000","last_unstale":"2024-04-25T02:16:00.039114+0000","last_undegraded":"2024-04-25T02:16:00.039114+0000","last_fullsized":"2024-04-25T02:16:00.039114+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:47.626967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045978+0000","last_change":"2024-04-25T02:15:59.038602+0000","last_active":"2024-04-25T02:15:59.045978+0000","last_peered":"2024-04-25T02:15:59.045978+0000","last_clean":"2024-04-25T02:15:59.045978+0000","last_became_active":"2024-04-25T02:15:59.038345+0000","last_became_peered":"2024-04-25T02:15:59.038345+0000","last_unstale":"2024-04-25T02:15:59.045978+0000","last_undegraded":"2024-04-25T02:15:59.045978+0000","last_fullsized":"2024-04-25T02:15:59.045978+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:48.564363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.022489+0000","last_change":"2024-04-25T02:15:58.027970+0000","last_active":"2024-04-25T02:15:59.022489+0000","last_peered":"2024-04-25T02:15:59.022489+0000","last_clean":"2024-04-25T02:15:59.022489+0000","last_became_active":"2024-04-25T02:15:58.027680+0000","last_became_peered":"2024-04-25T02:15:58.027680+0000","last_unstale":"2024-04-25T02:15:59.022489+0000","last_undegraded":"2024-04-25T02:15:59.022489+0000","last_fullsized":"2024-04-25T02:15:59.022489+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:37.298365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.046272+0000","last_change":"2024-04-25T02:15:59.039022+0000","last_active":"2024-04-25T02:15:59.046272+0000","last_peered":"2024-04-25T02:15:59.046272+0000","last_clean":"2024-04-25T02:15:59.046272+0000","last_became_active":"2024-04-25T02:15:59.037654+0000","last_became_peered":"2024-04-25T02:15:59.037654+0000","last_unstale":"2024-04-25T02:15:59.046272+0000","last_undegraded":"2024-04-25T02:15:59.046272+0000","last_fullsized":"2024-04-25T02:15:59.046272+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:16.606164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.022636+0000","last_change":"2024-04-25T02:15:58.032648+0000","last_active":"2024-04-25T02:15:59.022636+0000","last_peered":"2024-04-25T02:15:59.022636+0000","last_clean":"2024-04-25T02:15:59.022636+0000","last_became_active":"2024-04-25T02:15:58.032373+0000","last_became_peered":"2024-04-25T02:15:58.032373+0000","last_unstale":"2024-04-25T02:15:59.022636+0000","last_undegraded":"2024-04-25T02:15:59.022636+0000","last_fullsized":"2024-04-25T02:15:59.022636+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:17.814615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045193+0000","last_change":"2024-04-25T02:15:59.041502+0000","last_active":"2024-04-25T02:15:59.045193+0000","last_peered":"2024-04-25T02:15:59.045193+0000","last_clean":"2024-04-25T02:15:59.045193+0000","last_became_active":"2024-04-25T02:15:59.041237+0000","last_became_peered":"2024-04-25T02:15:59.041237+0000","last_unstale":"2024-04-25T02:15:59.045193+0000","last_undegraded":"2024-04-25T02:15:59.045193+0000","last_fullsized":"2024-04-25T02:15:59.045193+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:48.634681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038917+0000","last_change":"2024-04-25T02:15:58.041456+0000","last_active":"2024-04-25T02:16:00.038917+0000","last_peered":"2024-04-25T02:16:00.038917+0000","last_clean":"2024-04-25T02:16:00.038917+0000","last_became_active":"2024-04-25T02:15:58.041131+0000","last_became_peered":"2024-04-25T02:15:58.041131+0000","last_unstale":"2024-04-25T02:16:00.038917+0000","last_undegraded":"2024-04-25T02:16:00.038917+0000","last_fullsized":"2024-04-25T02:16:00.038917+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:50:47.634942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039454+0000","last_change":"2024-04-25T02:15:59.044246+0000","last_active":"2024-04-25T02:16:00.039454+0000","last_peered":"2024-04-25T02:16:00.039454+0000","last_clean":"2024-04-25T02:16:00.039454+0000","last_became_active":"2024-04-25T02:15:59.043859+0000","last_became_peered":"2024-04-25T02:15:59.043859+0000","last_unstale":"2024-04-25T02:16:00.039454+0000","last_undegraded":"2024-04-25T02:16:00.039454+0000","last_fullsized":"2024-04-25T02:16:00.039454+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:58.463417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"101'2","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.044711+0000","last_change":"2024-04-25T02:15:58.027500+0000","last_active":"2024-04-25T02:15:59.044711+0000","last_peered":"2024-04-25T02:15:59.044711+0000","last_clean":"2024-04-25T02:15:59.044711+0000","last_became_active":"2024-04-25T02:15:58.027220+0000","last_became_peered":"2024-04-25T02:15:58.027220+0000","last_unstale":"2024-04-25T02:15:59.044711+0000","last_undegraded":"2024-04-25T02:15:59.044711+0000","last_fullsized":"2024-04-25T02:15:59.044711+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:31:08.470067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038149+0000","last_change":"2024-04-25T02:15:59.046783+0000","last_active":"2024-04-25T02:16:00.038149+0000","last_peered":"2024-04-25T02:16:00.038149+0000","last_clean":"2024-04-25T02:16:00.038149+0000","last_became_active":"2024-04-25T02:15:59.046532+0000","last_became_peered":"2024-04-25T02:15:59.046532+0000","last_unstale":"2024-04-25T02:16:00.038149+0000","last_undegraded":"2024-04-25T02:16:00.038149+0000","last_fullsized":"2024-04-25T02:16:00.038149+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:41.024740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039524+0000","last_change":"2024-04-25T02:15:58.036542+0000","last_active":"2024-04-25T02:16:00.039524+0000","last_peered":"2024-04-25T02:16:00.039524+0000","last_clean":"2024-04-25T02:16:00.039524+0000","last_became_active":"2024-04-25T02:15:58.036291+0000","last_became_peered":"2024-04-25T02:15:58.036291+0000","last_unstale":"2024-04-25T02:16:00.039524+0000","last_undegraded":"2024-04-25T02:16:00.039524+0000","last_fullsized":"2024-04-25T02:16:00.039524+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:34.506529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.038197+0000","last_change":"2024-04-25T02:15:59.038842+0000","last_active":"2024-04-25T02:16:00.038197+0000","last_peered":"2024-04-25T02:16:00.038197+0000","last_clean":"2024-04-25T02:16:00.038197+0000","last_became_active":"2024-04-25T02:15:59.038590+0000","last_became_peered":"2024-04-25T02:15:59.038590+0000","last_unstale":"2024-04-25T02:16:00.038197+0000","last_undegraded":"2024-04-25T02:16:00.038197+0000","last_fullsized":"2024-04-25T02:16:00.038197+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:10.233714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039261+0000","last_change":"2024-04-25T02:15:58.042108+0000","last_active":"2024-04-25T02:16:00.039261+0000","last_peered":"2024-04-25T02:16:00.039261+0000","last_clean":"2024-04-25T02:16:00.039261+0000","last_became_active":"2024-04-25T02:15:58.041821+0000","last_became_peered":"2024-04-25T02:15:58.041821+0000","last_unstale":"2024-04-25T02:16:00.039261+0000","last_undegraded":"2024-04-25T02:16:00.039261+0000","last_fullsized":"2024-04-25T02:16:00.039261+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:11.544340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.043952+0000","last_change":"2024-04-25T02:15:59.039757+0000","last_active":"2024-04-25T02:15:59.043952+0000","last_peered":"2024-04-25T02:15:59.043952+0000","last_clean":"2024-04-25T02:15:59.043952+0000","last_became_active":"2024-04-25T02:15:59.039022+0000","last_became_peered":"2024-04-25T02:15:59.039022+0000","last_unstale":"2024-04-25T02:15:59.043952+0000","last_undegraded":"2024-04-25T02:15:59.043952+0000","last_fullsized":"2024-04-25T02:15:59.043952+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:53.017869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.027409+0000","last_change":"2024-04-25T02:15:58.034330+0000","last_active":"2024-04-25T02:15:59.027409+0000","last_peered":"2024-04-25T02:15:59.027409+0000","last_clean":"2024-04-25T02:15:59.027409+0000","last_became_active":"2024-04-25T02:15:58.033960+0000","last_became_peered":"2024-04-25T02:15:58.033960+0000","last_unstale":"2024-04-25T02:15:59.027409+0000","last_undegraded":"2024-04-25T02:15:59.027409+0000","last_fullsized":"2024-04-25T02:15:59.027409+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:23:10.818677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.049839+0000","last_change":"2024-04-25T02:15:59.044711+0000","last_active":"2024-04-25T02:15:59.049839+0000","last_peered":"2024-04-25T02:15:59.049839+0000","last_clean":"2024-04-25T02:15:59.049839+0000","last_became_active":"2024-04-25T02:15:59.044440+0000","last_became_peered":"2024-04-25T02:15:59.044440+0000","last_unstale":"2024-04-25T02:15:59.049839+0000","last_undegraded":"2024-04-25T02:15:59.049839+0000","last_fullsized":"2024-04-25T02:15:59.049839+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:00.728913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.039126+0000","last_change":"2024-04-25T02:15:58.039240+0000","last_active":"2024-04-25T02:16:00.039126+0000","last_peered":"2024-04-25T02:16:00.039126+0000","last_clean":"2024-04-25T02:16:00.039126+0000","last_became_active":"2024-04-25T02:15:58.038867+0000","last_became_peered":"2024-04-25T02:15:58.038867+0000","last_unstale":"2024-04-25T02:16:00.039126+0000","last_undegraded":"2024-04-25T02:16:00.039126+0000","last_fullsized":"2024-04-25T02:16:00.039126+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:05.595513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T02:16:00.041324+0000","last_change":"2024-04-25T02:15:59.045518+0000","last_active":"2024-04-25T02:16:00.041324+0000","last_peered":"2024-04-25T02:16:00.041324+0000","last_clean":"2024-04-25T02:16:00.041324+0000","last_became_active":"2024-04-25T02:15:59.044977+0000","last_became_peered":"2024-04-25T02:15:59.044977+0000","last_unstale":"2024-04-25T02:16:00.041324+0000","last_undegraded":"2024-04-25T02:16:00.041324+0000","last_fullsized":"2024-04-25T02:16:00.041324+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:53.017869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.027382+0000","last_change":"2024-04-25T02:15:58.035074+0000","last_active":"2024-04-25T02:15:59.027382+0000","last_peered":"2024-04-25T02:15:59.027382+0000","last_clean":"2024-04-25T02:15:59.027382+0000","last_became_active":"2024-04-25T02:15:58.034772+0000","last_became_peered":"2024-04-25T02:15:58.034772+0000","last_unstale":"2024-04-25T02:15:59.027382+0000","last_undegraded":"2024-04-25T02:15:59.027382+0000","last_fullsized":"2024-04-25T02:15:59.027382+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:46.772742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.049777+0000","last_change":"2024-04-25T02:15:59.044090+0000","last_active":"2024-04-25T02:15:59.049777+0000","last_peered":"2024-04-25T02:15:59.049777+0000","last_clean":"2024-04-25T02:15:59.049777+0000","last_became_active":"2024-04-25T02:15:59.043835+0000","last_became_peered":"2024-04-25T02:15:59.043835+0000","last_unstale":"2024-04-25T02:15:59.049777+0000","last_undegraded":"2024-04-25T02:15:59.049777+0000","last_fullsized":"2024-04-25T02:15:59.049777+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:46.958987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.021739+0000","last_change":"2024-04-25T02:15:58.037409+0000","last_active":"2024-04-25T02:15:59.021739+0000","last_peered":"2024-04-25T02:15:59.021739+0000","last_clean":"2024-04-25T02:15:59.021739+0000","last_became_active":"2024-04-25T02:15:58.037146+0000","last_became_peered":"2024-04-25T02:15:58.037146+0000","last_unstale":"2024-04-25T02:15:59.021739+0000","last_undegraded":"2024-04-25T02:15:59.021739+0000","last_fullsized":"2024-04-25T02:15:59.021739+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:34.506529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.045213+0000","last_change":"2024-04-25T02:15:59.041580+0000","last_active":"2024-04-25T02:15:59.045213+0000","last_peered":"2024-04-25T02:15:59.045213+0000","last_clean":"2024-04-25T02:15:59.045213+0000","last_became_active":"2024-04-25T02:15:59.039938+0000","last_became_peered":"2024-04-25T02:15:59.039938+0000","last_unstale":"2024-04-25T02:15:59.045213+0000","last_undegraded":"2024-04-25T02:15:59.045213+0000","last_fullsized":"2024-04-25T02:15:59.045213+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:06.603227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.026451+0000","last_change":"2024-04-25T02:15:58.037863+0000","last_active":"2024-04-25T02:15:59.026451+0000","last_peered":"2024-04-25T02:15:59.026451+0000","last_clean":"2024-04-25T02:15:59.026451+0000","last_became_active":"2024-04-25T02:15:58.037602+0000","last_became_peered":"2024-04-25T02:15:58.037602+0000","last_unstale":"2024-04-25T02:15:59.026451+0000","last_undegraded":"2024-04-25T02:15:59.026451+0000","last_fullsized":"2024-04-25T02:15:59.026451+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:27:09.111661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.049744+0000","last_change":"2024-04-25T02:15:59.043336+0000","last_active":"2024-04-25T02:15:59.049744+0000","last_peered":"2024-04-25T02:15:59.049744+0000","last_clean":"2024-04-25T02:15:59.049744+0000","last_became_active":"2024-04-25T02:15:59.043067+0000","last_became_peered":"2024-04-25T02:15:59.043067+0000","last_unstale":"2024-04-25T02:15:59.049744+0000","last_undegraded":"2024-04-25T02:15:59.049744+0000","last_fullsized":"2024-04-25T02:15:59.049744+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:58.010231+0000","last_clean_scrub_stamp":"2024-04-25T02:15:58.010231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:00.549213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"101'1","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.048774+0000","last_change":"2024-04-25T02:15:58.039104+0000","last_active":"2024-04-25T02:15:59.048774+0000","last_peered":"2024-04-25T02:15:59.048774+0000","last_clean":"2024-04-25T02:15:59.048774+0000","last_became_active":"2024-04-25T02:15:58.038878+0000","last_became_peered":"2024-04-25T02:15:58.038878+0000","last_unstale":"2024-04-25T02:15:59.048774+0000","last_undegraded":"2024-04-25T02:15:59.048774+0000","last_fullsized":"2024-04-25T02:15:59.048774+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:15:57.002517+0000","last_clean_scrub_stamp":"2024-04-25T02:15:57.002517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:27:09.546078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":317,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T02:15:59.022261+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:15:59.022261+0000","last_peered":"2024-04-25T02:15:59.022261+0000","last_clean":"2024-04-25T02:15:59.022261+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:15:59.022261+0000","last_undegraded":"2024-04-25T02:15:59.022261+0000","last_fullsized":"2024-04-25T02:15:59.022261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574950,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32992,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338848,"statfs":{"total":96636764160,"available":96602980352,"internally_reserved":0,"allocated":1851392,"data_stored":1128189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1257472,"data_stored":538361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":537779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1282048,"data_stored":545745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":539343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574950,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":537743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1261568,"data_stored":544009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33004,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338836,"statfs":{"total":96636764160,"available":96602968064,"internally_reserved":0,"allocated":1859584,"data_stored":1134959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:16:03.324 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T02:16:03.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T02:16:03.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.460+0000 7f083cdee640 1 Processor -- start 2024-04-25T02:16:03.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.460+0000 7f083cdee640 1 -- start start 2024-04-25T02:16:03.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.460+0000 7f083cdee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f083815e4f0 0x7f08380d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.460+0000 7f083cdee640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f08380cf7f0 0x7f08380d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.460+0000 7f083cdee640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08380d1ee0 con 0x7f08380cfc50 2024-04-25T02:16:03.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.460+0000 7f083cdee640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f08380d21c0 con 0x7f08380cf7f0 2024-04-25T02:16:03.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.460+0000 7f083cdee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f08380d24a0 con 0x7f083815e4f0 2024-04-25T02:16:03.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.460+0000 7f0836d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f08380cfc50 0x7f083806bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46796/0 (socket says 172.21.15.79:46796) 2024-04-25T02:16:03.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0836d9d640 1 -- 172.21.15.79:0/1586227433 learned_addr learned my addr 172.21.15.79:0/1586227433 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:03.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f083659c640 1 --2- 172.21.15.79:0/1586227433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f083815e4f0 0x7f08380d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f082ffff640 1 --2- 172.21.15.79:0/1586227433 >> v2:172.21.15.189:3300/0 conn(0x7f08380cf7f0 0x7f08380d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 -- 172.21.15.79:0/1586227433 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3765965724 0 0) 0x7f08380d1ee0 con 0x7f08380cfc50 2024-04-25T02:16:03.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 -- 172.21.15.79:0/1586227433 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0824003520 con 0x7f08380cfc50 2024-04-25T02:16:03.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 -- 172.21.15.79:0/1586227433 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3858368482 0 0) 0x7f0824003520 con 0x7f08380cfc50 2024-04-25T02:16:03.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 -- 172.21.15.79:0/1586227433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f083815e4f0 msgr2=0x7f08380d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:03.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 --2- 172.21.15.79:0/1586227433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f083815e4f0 0x7f08380d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 -- 172.21.15.79:0/1586227433 >> v2:172.21.15.189:3300/0 conn(0x7f08380cf7f0 msgr2=0x7f08380d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:03.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 --2- 172.21.15.79:0/1586227433 >> v2:172.21.15.189:3300/0 conn(0x7f08380cf7f0 0x7f08380d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 -- 172.21.15.79:0/1586227433 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08380d2780 con 0x7f08380cfc50 2024-04-25T02:16:03.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 -- 172.21.15.79:0/1586227433 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f08300019f0 con 0x7f08380cfc50 2024-04-25T02:16:03.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 -- 172.21.15.79:0/1586227433 >> v1:172.21.15.79:6789/0 conn(0x7f08380cfc50 legacy=0x7f083806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 --2- 172.21.15.79:0/1586227433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08240039b0 0x7f0824003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 --2- 172.21.15.79:0/1586227433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0824004800 0x7f0824004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 --2- 172.21.15.79:0/1586227433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f083815e4f0 0x7f08240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 -- 172.21.15.79:0/1586227433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f08380d21c0 con 0x7f08240039b0 2024-04-25T02:16:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 -- 172.21.15.79:0/1586227433 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08380d24a0 con 0x7f0824004800 2024-04-25T02:16:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0835d9b640 1 -- 172.21.15.79:0/1586227433 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f082400b9c0 con 0x7f083815e4f0 2024-04-25T02:16:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f083659c640 1 --2- 172.21.15.79:0/1586227433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08240039b0 0x7f0824003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f082ffff640 1 --2- 172.21.15.79:0/1586227433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0824004800 0x7f0824004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0836d9d640 1 --2- 172.21.15.79:0/1586227433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f083815e4f0 0x7f08240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f083659c640 1 -- 172.21.15.79:0/1586227433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f083815e4f0 msgr2=0x7f08240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f083659c640 1 --2- 172.21.15.79:0/1586227433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f083815e4f0 0x7f08240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f083659c640 1 -- 172.21.15.79:0/1586227433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0824004800 msgr2=0x7f0824004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f083659c640 1 --2- 172.21.15.79:0/1586227433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0824004800 0x7f0824004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f083659c640 1 -- 172.21.15.79:0/1586227433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0824003520 con 0x7f08240039b0 2024-04-25T02:16:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.461+0000 7f0836d9d640 1 --2- 172.21.15.79:0/1586227433 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f083815e4f0 0x7f08240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.462+0000 7f083659c640 1 --2- 172.21.15.79:0/1586227433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08240039b0 0x7f0824003dd0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f0828009ac0 tx=0x7f0824005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0905ca64961ea5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.462+0000 7f0835d9b640 1 -- 172.21.15.79:0/1586227433 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828036070 con 0x7f08240039b0 2024-04-25T02:16:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.462+0000 7f0835d9b640 1 -- 172.21.15.79:0/1586227433 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0828031400 con 0x7f08240039b0 2024-04-25T02:16:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.462+0000 7f0835d9b640 1 -- 172.21.15.79:0/1586227433 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828009690 con 0x7f08240039b0 2024-04-25T02:16:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.463+0000 7f083cdee640 1 -- 172.21.15.79:0/1586227433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08240039b0 msgr2=0x7f0824003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.463+0000 7f083cdee640 1 --2- 172.21.15.79:0/1586227433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08240039b0 0x7f0824003dd0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f0828009ac0 tx=0x7f0824005830 comp rx=0 tx=0).stop 2024-04-25T02:16:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.463+0000 7f0836d9d640 1 -- 172.21.15.79:0/1586227433 reap_dead start 2024-04-25T02:16:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.463+0000 7f083cdee640 1 -- 172.21.15.79:0/1586227433 shutdown_connections 2024-04-25T02:16:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.463+0000 7f083cdee640 1 -- 172.21.15.79:0/1586227433 >> 172.21.15.79:0/1586227433 conn(0x7f083809d4a0 msgr2=0x7f08380d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.463+0000 7f083cdee640 1 -- 172.21.15.79:0/1586227433 shutdown_connections 2024-04-25T02:16:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.463+0000 7f083cdee640 1 -- 172.21.15.79:0/1586227433 wait complete. 2024-04-25T02:16:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.464+0000 7f083cdee640 1 Processor -- start 2024-04-25T02:16:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.464+0000 7f083cdee640 1 -- start start 2024-04-25T02:16:03.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f083cdee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08240039b0 0x7f0838151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f083cdee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08380cb240 0x7f08381f7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f083cdee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08381f7c90 0x7f08381f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f083cdee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f08380d0ef0 con 0x7f08381f7c90 2024-04-25T02:16:03.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f083cdee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08380d50f0 con 0x7f08380cb240 2024-04-25T02:16:03.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f083cdee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f08380d1070 con 0x7f08240039b0 2024-04-25T02:16:03.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f0836d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08381f7c90 0x7f08381f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f0836d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08381f7c90 0x7f08381f4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59102/0 (socket says 172.21.15.79:59102) 2024-04-25T02:16:03.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f0836d9d640 1 -- 172.21.15.79:0/2261157591 learned_addr learned my addr 172.21.15.79:0/2261157591 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:03.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f0836d9d640 1 -- 172.21.15.79:0/2261157591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08240039b0 msgr2=0x7f0838151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f083659c640 1 --2- 172.21.15.79:0/2261157591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08240039b0 0x7f0838151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f082ffff640 1 --2- 172.21.15.79:0/2261157591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08380cb240 0x7f08381f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f0836d9d640 1 --2- 172.21.15.79:0/2261157591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08240039b0 0x7f0838151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f0836d9d640 1 -- 172.21.15.79:0/2261157591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08380cb240 msgr2=0x7f08381f7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f0836d9d640 1 --2- 172.21.15.79:0/2261157591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08380cb240 0x7f08381f7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f0836d9d640 1 -- 172.21.15.79:0/2261157591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08380ce350 con 0x7f08381f7c90 2024-04-25T02:16:03.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f0836d9d640 1 --2- 172.21.15.79:0/2261157591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08381f7c90 0x7f08381f4160 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f083808e9c0 tx=0x7f083000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:03.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.465+0000 7f082effd640 1 -- 172.21.15.79:0/2261157591 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083000eda0 con 0x7f08381f7c90 2024-04-25T02:16:03.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.466+0000 7f082effd640 1 -- 172.21.15.79:0/2261157591 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0830014430 con 0x7f08381f7c90 2024-04-25T02:16:03.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.466+0000 7f083cdee640 1 -- 172.21.15.79:0/2261157591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08380cdab0 con 0x7f08381f7c90 2024-04-25T02:16:03.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.466+0000 7f082effd640 1 -- 172.21.15.79:0/2261157591 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830014820 con 0x7f08381f7c90 2024-04-25T02:16:03.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.466+0000 7f083cdee640 1 -- 172.21.15.79:0/2261157591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08380ce070 con 0x7f08381f7c90 2024-04-25T02:16:03.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.466+0000 7f083cdee640 1 -- 172.21.15.79:0/2261157591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08380686c0 con 0x7f08381f7c90 2024-04-25T02:16:03.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.467+0000 7f082effd640 1 -- 172.21.15.79:0/2261157591 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08300149c0 con 0x7f08381f7c90 2024-04-25T02:16:03.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.467+0000 7f082effd640 1 --2- 172.21.15.79:0/2261157591 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f081806be60 0x7f081806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.468+0000 7f083659c640 1 --2- 172.21.15.79:0/2261157591 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f081806be60 0x7f081806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.468+0000 7f082effd640 1 -- 172.21.15.79:0/2261157591 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f083008ad60 con 0x7f08381f7c90 2024-04-25T02:16:03.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.468+0000 7f083659c640 1 --2- 172.21.15.79:0/2261157591 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f081806be60 0x7f081806e320 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0828033000 tx=0x7f0828008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:03.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.472+0000 7f082effd640 1 -- 172.21.15.79:0/2261157591 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0830059710 con 0x7f08381f7c90 2024-04-25T02:16:03.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.711+0000 7f083cdee640 1 -- 172.21.15.79:0/2261157591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f083806d1d0 con 0x7f08381f7c90 2024-04-25T02:16:03.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.714+0000 7f082effd640 1 -- 172.21.15.79:0/2261157591 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f083806d1d0 con 0x7f08381f7c90 2024-04-25T02:16:03.719 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-04-25T02:16:03.719 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g== 2024-04-25T02:16:03.719 INFO:teuthology.orchestra.run.smithi079.stdout: caps mds = "allow" 2024-04-25T02:16:03.719 INFO:teuthology.orchestra.run.smithi079.stdout: caps mon = "allow r" 2024-04-25T02:16:03.719 INFO:teuthology.orchestra.run.smithi079.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T02:16:03.719 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2024-04-25T02:16:03.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.716+0000 7f083cdee640 1 -- 172.21.15.79:0/2261157591 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f081806be60 msgr2=0x7f081806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.716+0000 7f083cdee640 1 --2- 172.21.15.79:0/2261157591 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f081806be60 0x7f081806e320 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0828033000 tx=0x7f0828008030 comp rx=0 tx=0).stop 2024-04-25T02:16:03.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.716+0000 7f083cdee640 1 -- 172.21.15.79:0/2261157591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08381f7c90 msgr2=0x7f08381f4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.716+0000 7f083cdee640 1 --2- 172.21.15.79:0/2261157591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08381f7c90 0x7f08381f4160 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f083808e9c0 tx=0x7f083000e530 comp rx=0 tx=0).stop 2024-04-25T02:16:03.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.716+0000 7f083cdee640 1 -- 172.21.15.79:0/2261157591 shutdown_connections 2024-04-25T02:16:03.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.716+0000 7f083cdee640 1 --2- 172.21.15.79:0/2261157591 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f081806be60 0x7f081806e320 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.716+0000 7f083cdee640 1 --2- 172.21.15.79:0/2261157591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08381f7c90 0x7f08381f4160 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.716+0000 7f083cdee640 1 --2- 172.21.15.79:0/2261157591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08380cb240 0x7f08381f7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.716+0000 7f083cdee640 1 --2- 172.21.15.79:0/2261157591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08240039b0 0x7f0838151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.716+0000 7f083cdee640 1 -- 172.21.15.79:0/2261157591 >> 172.21.15.79:0/2261157591 conn(0x7f083809d4a0 msgr2=0x7f083806bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:03.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.716+0000 7f083cdee640 1 -- 172.21.15.79:0/2261157591 shutdown_connections 2024-04-25T02:16:03.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.716+0000 7f083cdee640 1 -- 172.21.15.79:0/2261157591 wait complete. 2024-04-25T02:16:03.732 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:16:03.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.824+0000 7fdc53d1b640 1 Processor -- start 2024-04-25T02:16:03.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.824+0000 7fdc53d1b640 1 -- start start 2024-04-25T02:16:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.825+0000 7fdc53d1b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc4c143bc0 0x7fdc4c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.825+0000 7fdc53d1b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fdc4c0b3d40 0x7fdc4c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.825+0000 7fdc53d1b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc4c15fa40 con 0x7fdc4c06df50 2024-04-25T02:16:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.825+0000 7fdc53d1b640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fdc4c06e8f0 con 0x7fdc4c0b3d40 2024-04-25T02:16:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.825+0000 7fdc53d1b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4c072cb0 con 0x7fdc4c143bc0 2024-04-25T02:16:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.825+0000 7fdc522b8640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fdc4c0b3d40 0x7fdc4c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.825+0000 7fdc51ab7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc4c143bc0 0x7fdc4c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.825+0000 7fdc512b6640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fdc4c06df50 0x7fdc4c0b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:54182/0 (socket says 172.21.15.79:54182) 2024-04-25T02:16:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.825+0000 7fdc512b6640 1 -- 172.21.15.79:0/1618854939 learned_addr learned my addr 172.21.15.79:0/1618854939 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.825+0000 7fdc51ab7640 1 -- 172.21.15.79:0/1618854939 >> v2:172.21.15.189:3300/0 conn(0x7fdc4c0b3d40 msgr2=0x7fdc4c06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.825+0000 7fdc51ab7640 1 --2- 172.21.15.79:0/1618854939 >> v2:172.21.15.189:3300/0 conn(0x7fdc4c0b3d40 0x7fdc4c06e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.825+0000 7fdc51ab7640 1 -- 172.21.15.79:0/1618854939 >> v1:172.21.15.189:6789/0 conn(0x7fdc4c06df50 legacy=0x7fdc4c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.825+0000 7fdc51ab7640 1 -- 172.21.15.79:0/1618854939 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4c071e00 con 0x7fdc4c143bc0 2024-04-25T02:16:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.825+0000 7fdc522b8640 1 --2- 172.21.15.79:0/1618854939 >> v2:172.21.15.189:3300/0 conn(0x7fdc4c0b3d40 0x7fdc4c06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:16:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.826+0000 7fdc51ab7640 1 --2- 172.21.15.79:0/1618854939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc4c143bc0 0x7fdc4c15f500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc480097a0 tx=0x7fdc4802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd0bf87f45a1e276 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.826+0000 7fdc50ab5640 1 -- 172.21.15.79:0/1618854939 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48037070 con 0x7fdc4c143bc0 2024-04-25T02:16:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.826+0000 7fdc50ab5640 1 -- 172.21.15.79:0/1618854939 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4802ae50 con 0x7fdc4c143bc0 2024-04-25T02:16:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.826+0000 7fdc50ab5640 1 -- 172.21.15.79:0/1618854939 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48032660 con 0x7fdc4c143bc0 2024-04-25T02:16:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.827+0000 7fdc53d1b640 1 -- 172.21.15.79:0/1618854939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc4c143bc0 msgr2=0x7fdc4c15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.827+0000 7fdc53d1b640 1 --2- 172.21.15.79:0/1618854939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc4c143bc0 0x7fdc4c15f500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc480097a0 tx=0x7fdc4802a100 comp rx=0 tx=0).stop 2024-04-25T02:16:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.827+0000 7fdc53d1b640 1 -- 172.21.15.79:0/1618854939 shutdown_connections 2024-04-25T02:16:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.827+0000 7fdc53d1b640 1 --2- 172.21.15.79:0/1618854939 >> v2:172.21.15.189:3300/0 conn(0x7fdc4c0b3d40 0x7fdc4c06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.827+0000 7fdc53d1b640 1 --2- 172.21.15.79:0/1618854939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc4c143bc0 0x7fdc4c15f500 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.827+0000 7fdc53d1b640 1 -- 172.21.15.79:0/1618854939 >> 172.21.15.79:0/1618854939 conn(0x7fdc4c0cfc80 msgr2=0x7fdc4c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.827+0000 7fdc53d1b640 1 -- 172.21.15.79:0/1618854939 shutdown_connections 2024-04-25T02:16:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.827+0000 7fdc53d1b640 1 -- 172.21.15.79:0/1618854939 wait complete. 2024-04-25T02:16:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.828+0000 7fdc53d1b640 1 Processor -- start 2024-04-25T02:16:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.828+0000 7fdc53d1b640 1 -- start start 2024-04-25T02:16:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc53d1b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4c06df50 0x7fdc4c142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc53d1b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc4c0b3d40 0x7fdc4c0abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc53d1b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc4c143bc0 0x7fdc4c159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc53d1b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c072660 con 0x7fdc4c06df50 2024-04-25T02:16:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc53d1b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c072380 con 0x7fdc4c143bc0 2024-04-25T02:16:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc53d1b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4c072940 con 0x7fdc4c0b3d40 2024-04-25T02:16:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc51ab7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4c06df50 0x7fdc4c142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc51ab7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4c06df50 0x7fdc4c142960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41402/0 (socket says 172.21.15.79:41402) 2024-04-25T02:16:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc51ab7640 1 -- 172.21.15.79:0/459696020 learned_addr learned my addr 172.21.15.79:0/459696020 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc522b8640 1 --2- 172.21.15.79:0/459696020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc4c143bc0 0x7fdc4c159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc512b6640 1 --2- 172.21.15.79:0/459696020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc4c0b3d40 0x7fdc4c0abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc51ab7640 1 -- 172.21.15.79:0/459696020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc4c0b3d40 msgr2=0x7fdc4c0abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc51ab7640 1 --2- 172.21.15.79:0/459696020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc4c0b3d40 0x7fdc4c0abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc51ab7640 1 -- 172.21.15.79:0/459696020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc4c143bc0 msgr2=0x7fdc4c159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc51ab7640 1 --2- 172.21.15.79:0/459696020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc4c143bc0 0x7fdc4c159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc51ab7640 1 -- 172.21.15.79:0/459696020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4c1572a0 con 0x7fdc4c06df50 2024-04-25T02:16:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc51ab7640 1 --2- 172.21.15.79:0/459696020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4c06df50 0x7fdc4c142960 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fdc4802a140 tx=0x7fdc480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc427fc640 1 -- 172.21.15.79:0/459696020 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48041070 con 0x7fdc4c06df50 2024-04-25T02:16:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc427fc640 1 -- 172.21.15.79:0/459696020 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4803c670 con 0x7fdc4c06df50 2024-04-25T02:16:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc427fc640 1 -- 172.21.15.79:0/459696020 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48037040 con 0x7fdc4c06df50 2024-04-25T02:16:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.829+0000 7fdc53d1b640 1 -- 172.21.15.79:0/459696020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc4c157580 con 0x7fdc4c06df50 2024-04-25T02:16:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.830+0000 7fdc53d1b640 1 -- 172.21.15.79:0/459696020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc4c157b40 con 0x7fdc4c06df50 2024-04-25T02:16:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.830+0000 7fdc53d1b640 1 -- 172.21.15.79:0/459696020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc4c157d40 con 0x7fdc4c06df50 2024-04-25T02:16:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.831+0000 7fdc427fc640 1 -- 172.21.15.79:0/459696020 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc48044070 con 0x7fdc4c06df50 2024-04-25T02:16:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.831+0000 7fdc427fc640 1 --2- 172.21.15.79:0/459696020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc3006be30 0x7fdc3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.831+0000 7fdc427fc640 1 -- 172.21.15.79:0/459696020 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7fdc480ab490 con 0x7fdc4c06df50 2024-04-25T02:16:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.831+0000 7fdc512b6640 1 --2- 172.21.15.79:0/459696020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc3006be30 0x7fdc3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.832+0000 7fdc512b6640 1 --2- 172.21.15.79:0/459696020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc3006be30 0x7fdc3006e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0b3bf0 tx=0x7fdc3c007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:03.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:03.835+0000 7fdc427fc640 1 -- 172.21.15.79:0/459696020 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdc4c157d40 con 0x7fdc4c06df50 2024-04-25T02:16:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.046+0000 7fdc53d1b640 1 -- 172.21.15.79:0/459696020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc4c0690a0 con 0x7fdc4c06df50 2024-04-25T02:16:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.047+0000 7fdc427fc640 1 -- 172.21.15.79:0/459696020 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5189 (secure 0 0 0) 0x7fdc480799a0 con 0x7fdc4c06df50 2024-04-25T02:16:04.052 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:04.052 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1086166830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1086166830},{"type":"v1","addr":"172.21.15.189:6834","nonce":1086166830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2468340230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2468340230},{"type":"v1","addr":"172.21.15.189:6835","nonce":2468340230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3582530322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3582530322},{"type":"v1","addr":"172.21.15.79:6836","nonce":3582530322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:15:58.363457+0000","modified":"2024-04-25T02:16:01.255271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8271":{"gid":8271,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2774759267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2774759267},{"type":"v1","addr":"172.21.15.79:6837","nonce":2774759267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8271,"qdb_cluster":[8271]},"id":7}]} 2024-04-25T02:16:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 68 2024-04-25T02:16:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.049+0000 7fdc53d1b640 1 -- 172.21.15.79:0/459696020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc3006be30 msgr2=0x7fdc3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.049+0000 7fdc53d1b640 1 --2- 172.21.15.79:0/459696020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc3006be30 0x7fdc3006e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0b3bf0 tx=0x7fdc3c007e80 comp rx=0 tx=0).stop 2024-04-25T02:16:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.049+0000 7fdc53d1b640 1 -- 172.21.15.79:0/459696020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4c06df50 msgr2=0x7fdc4c142960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.049+0000 7fdc53d1b640 1 --2- 172.21.15.79:0/459696020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4c06df50 0x7fdc4c142960 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fdc4802a140 tx=0x7fdc480046c0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.049+0000 7fdc53d1b640 1 -- 172.21.15.79:0/459696020 shutdown_connections 2024-04-25T02:16:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.049+0000 7fdc53d1b640 1 --2- 172.21.15.79:0/459696020 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fdc3006be30 0x7fdc3006e2f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.049+0000 7fdc53d1b640 1 --2- 172.21.15.79:0/459696020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc4c143bc0 0x7fdc4c159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.049+0000 7fdc53d1b640 1 --2- 172.21.15.79:0/459696020 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc4c0b3d40 0x7fdc4c0abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.049+0000 7fdc53d1b640 1 --2- 172.21.15.79:0/459696020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4c06df50 0x7fdc4c142960 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.049+0000 7fdc53d1b640 1 -- 172.21.15.79:0/459696020 >> 172.21.15.79:0/459696020 conn(0x7fdc4c0cfc80 msgr2=0x7fdc4c0ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:04.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.049+0000 7fdc53d1b640 1 -- 172.21.15.79:0/459696020 shutdown_connections 2024-04-25T02:16:04.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.049+0000 7fdc53d1b640 1 -- 172.21.15.79:0/459696020 wait complete. 2024-04-25T02:16:04.278 INFO:tasks.ceph.mds.c.smithi079.stderr:2024-04-25T02:16:04.274+0000 7f615581d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:16:04.467 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:15:58.363457+0000', 'modified': '2024-04-25T02:16:01.255271+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8271}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8271': {'gid': 8271, 'name': 'c', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6837/2774759267', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 2774759267}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 2774759267}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8271, 'qdb_cluster': [8271]} 2024-04-25T02:16:04.467 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:16:04.467 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T02:16:04.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.561+0000 7f6058cd4640 1 Processor -- start 2024-04-25T02:16:04.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.561+0000 7f6058cd4640 1 -- start start 2024-04-25T02:16:04.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.562+0000 7f6058cd4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f605415e4d0 0x7f605406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.562+0000 7f6058cd4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60540d1660 con 0x7f60540d2e20 2024-04-25T02:16:04.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.562+0000 7f6058cd4640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60540d1380 con 0x7f60540b3570 2024-04-25T02:16:04.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.562+0000 7f6058cd4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f60540cede0 con 0x7f605415e4d0 2024-04-25T02:16:04.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f6052d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f60540d2e20 0x7f60540cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49144/0 (socket says 172.21.15.79:49144) 2024-04-25T02:16:04.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f6052d9d640 1 -- 172.21.15.79:0/4270139325 learned_addr learned my addr 172.21.15.79:0/4270139325 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:04.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605159a640 1 -- 172.21.15.79:0/4270139325 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 565523301 0 0) 0x7f60540d1660 con 0x7f60540d2e20 2024-04-25T02:16:04.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605159a640 1 -- 172.21.15.79:0/4270139325 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f603c003520 con 0x7f60540d2e20 2024-04-25T02:16:04.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605259c640 1 --2- 172.21.15.79:0/4270139325 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f605415e4d0 0x7f605406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605159a640 1 -- 172.21.15.79:0/4270139325 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3033632421 0 0) 0x7f603c003520 con 0x7f60540d2e20 2024-04-25T02:16:04.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605159a640 1 -- 172.21.15.79:0/4270139325 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f605415e4d0 msgr2=0x7f605406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:04.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605159a640 1 --2- 172.21.15.79:0/4270139325 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f605415e4d0 0x7f605406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605159a640 1 -- 172.21.15.79:0/4270139325 >> v1:172.21.15.189:6789/0 conn(0x7f60540b3570 legacy=0x7f60540d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605159a640 1 -- 172.21.15.79:0/4270139325 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60540cf0c0 con 0x7f60540d2e20 2024-04-25T02:16:04.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605159a640 1 -- 172.21.15.79:0/4270139325 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f6044001670 con 0x7f60540d2e20 2024-04-25T02:16:04.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605159a640 1 -- 172.21.15.79:0/4270139325 >> v1:172.21.15.79:6789/0 conn(0x7f60540d2e20 legacy=0x7f60540cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605159a640 1 --2- 172.21.15.79:0/4270139325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f603c0039e0 0x7f603c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605159a640 1 --2- 172.21.15.79:0/4270139325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c004800 0x7f603c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605159a640 1 --2- 172.21.15.79:0/4270139325 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f605415e4d0 0x7f603c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605159a640 1 -- 172.21.15.79:0/4270139325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f60540cede0 con 0x7f603c004800 2024-04-25T02:16:04.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605159a640 1 -- 172.21.15.79:0/4270139325 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f603c00baf0 con 0x7f603c0039e0 2024-04-25T02:16:04.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605159a640 1 -- 172.21.15.79:0/4270139325 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f603c00bcf0 con 0x7f605415e4d0 2024-04-25T02:16:04.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f6051d9b640 1 --2- 172.21.15.79:0/4270139325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c004800 0x7f603c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f605259c640 1 --2- 172.21.15.79:0/4270139325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f603c0039e0 0x7f603c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f6052d9d640 1 --2- 172.21.15.79:0/4270139325 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f605415e4d0 0x7f603c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f6051d9b640 1 -- 172.21.15.79:0/4270139325 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f605415e4d0 msgr2=0x7f603c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:04.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f6051d9b640 1 --2- 172.21.15.79:0/4270139325 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f605415e4d0 0x7f603c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f6051d9b640 1 -- 172.21.15.79:0/4270139325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f603c0039e0 msgr2=0x7f603c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:04.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f6051d9b640 1 --2- 172.21.15.79:0/4270139325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f603c0039e0 0x7f603c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.563+0000 7f6051d9b640 1 -- 172.21.15.79:0/4270139325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603c003520 con 0x7f603c004800 2024-04-25T02:16:04.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.564+0000 7f6051d9b640 1 --2- 172.21.15.79:0/4270139325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c004800 0x7f603c004c80 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f6048001e50 tx=0x7f603c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6aac1956e99b5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:04.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.564+0000 7f605159a640 1 -- 172.21.15.79:0/4270139325 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048001a70 con 0x7f603c004800 2024-04-25T02:16:04.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.564+0000 7f605159a640 1 -- 172.21.15.79:0/4270139325 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6048003970 con 0x7f603c004800 2024-04-25T02:16:04.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.564+0000 7f605159a640 1 -- 172.21.15.79:0/4270139325 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048003d60 con 0x7f603c004800 2024-04-25T02:16:04.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.565+0000 7f6058cd4640 1 -- 172.21.15.79:0/4270139325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c004800 msgr2=0x7f603c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.565+0000 7f6058cd4640 1 --2- 172.21.15.79:0/4270139325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c004800 0x7f603c004c80 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f6048001e50 tx=0x7f603c005830 comp rx=0 tx=0).stop 2024-04-25T02:16:04.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.565+0000 7f6052d9d640 1 -- 172.21.15.79:0/4270139325 reap_dead start 2024-04-25T02:16:04.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.565+0000 7f6058cd4640 1 -- 172.21.15.79:0/4270139325 shutdown_connections 2024-04-25T02:16:04.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.565+0000 7f6058cd4640 1 -- 172.21.15.79:0/4270139325 >> 172.21.15.79:0/4270139325 conn(0x7f605409d460 msgr2=0x7f60540d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:04.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.565+0000 7f6058cd4640 1 -- 172.21.15.79:0/4270139325 shutdown_connections 2024-04-25T02:16:04.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.565+0000 7f6058cd4640 1 -- 172.21.15.79:0/4270139325 wait complete. 2024-04-25T02:16:04.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.566+0000 7f6058cd4640 1 Processor -- start 2024-04-25T02:16:04.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.566+0000 7f6058cd4640 1 -- start start 2024-04-25T02:16:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.567+0000 7f6058cd4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c004800 0x7f60540b9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.567+0000 7f6058cd4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60540a0590 0x7f60540a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.567+0000 7f6058cd4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60540cc1e0 0x7f60540cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.567+0000 7f6058cd4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f60540d2250 con 0x7f603c004800 2024-04-25T02:16:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.567+0000 7f6058cd4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f60540d20d0 con 0x7f60540a0590 2024-04-25T02:16:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.567+0000 7f6058cd4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f60540cfcf0 con 0x7f60540cc1e0 2024-04-25T02:16:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.567+0000 7f605259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c004800 0x7f60540b9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.567+0000 7f605259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c004800 0x7f60540b9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41428/0 (socket says 172.21.15.79:41428) 2024-04-25T02:16:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.567+0000 7f605259c640 1 -- 172.21.15.79:0/943742036 learned_addr learned my addr 172.21.15.79:0/943742036 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.567+0000 7f605259c640 1 -- 172.21.15.79:0/943742036 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60540cc1e0 msgr2=0x7f60540cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.567+0000 7f605259c640 1 --2- 172.21.15.79:0/943742036 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60540cc1e0 0x7f60540cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.567+0000 7f605259c640 1 -- 172.21.15.79:0/943742036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60540a0590 msgr2=0x7f60540a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.567+0000 7f605259c640 1 --2- 172.21.15.79:0/943742036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60540a0590 0x7f60540a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.567+0000 7f605259c640 1 -- 172.21.15.79:0/943742036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605409ded0 con 0x7f603c004800 2024-04-25T02:16:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.567+0000 7f605259c640 1 --2- 172.21.15.79:0/943742036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c004800 0x7f60540b9720 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f604c00b850 tx=0x7f604c00bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.568+0000 7f6042ffd640 1 -- 172.21.15.79:0/943742036 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c018070 con 0x7f603c004800 2024-04-25T02:16:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.568+0000 7f6042ffd640 1 -- 172.21.15.79:0/943742036 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f604c00be40 con 0x7f603c004800 2024-04-25T02:16:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.568+0000 7f6042ffd640 1 -- 172.21.15.79:0/943742036 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c010c60 con 0x7f603c004800 2024-04-25T02:16:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.568+0000 7f6058cd4640 1 -- 172.21.15.79:0/943742036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60540a0f30 con 0x7f603c004800 2024-04-25T02:16:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.568+0000 7f6058cd4640 1 -- 172.21.15.79:0/943742036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f605414b740 con 0x7f603c004800 2024-04-25T02:16:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.569+0000 7f6042ffd640 1 -- 172.21.15.79:0/943742036 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f604c01b070 con 0x7f603c004800 2024-04-25T02:16:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.570+0000 7f6042ffd640 1 --2- 172.21.15.79:0/943742036 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f603406be30 0x7f603406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.570+0000 7f6042ffd640 1 -- 172.21.15.79:0/943742036 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f604c08b2a0 con 0x7f603c004800 2024-04-25T02:16:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.570+0000 7f6051d9b640 1 --2- 172.21.15.79:0/943742036 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f603406be30 0x7f603406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.570+0000 7f6051d9b640 1 --2- 172.21.15.79:0/943742036 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f603406be30 0x7f603406e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6048032000 tx=0x7f604802c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.571+0000 7f605b9e8740 1 Processor -- start 2024-04-25T02:16:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.571+0000 7f605b9e8740 1 -- start start 2024-04-25T02:16:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f605b9e8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446cab60 0x56434467d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f605b9e8740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446adc80 0x5643446ad000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f605b9e8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446ad540 0x564344682350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f605b9e8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5643445e5f00 con 0x5643446cab60 2024-04-25T02:16:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f605b9e8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56434458e750 con 0x5643446ad540 2024-04-25T02:16:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f605b9e8740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5643445e1ec0 con 0x5643446adc80 2024-04-25T02:16:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f605259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446cab60 0x56434467d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f605259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446cab60 0x56434467d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41432/0 (socket says 172.21.15.79:41432) 2024-04-25T02:16:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f605259c640 1 -- 172.21.15.79:0/3818679983 learned_addr learned my addr 172.21.15.79:0/3818679983 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f6052d9d640 1 --2- 172.21.15.79:0/3818679983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446ad540 0x564344682350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f6051d9b640 1 --2- 172.21.15.79:0/3818679983 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446adc80 0x5643446ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f605259c640 1 -- 172.21.15.79:0/3818679983 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446adc80 msgr2=0x5643446ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f605259c640 1 --2- 172.21.15.79:0/3818679983 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446adc80 0x5643446ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f605259c640 1 -- 172.21.15.79:0/3818679983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446ad540 msgr2=0x564344682350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f605259c640 1 --2- 172.21.15.79:0/3818679983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446ad540 0x564344682350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f605259c640 1 -- 172.21.15.79:0/3818679983 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643442fa2d0 con 0x5643446cab60 2024-04-25T02:16:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f6052d9d640 1 --2- 172.21.15.79:0/3818679983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446ad540 0x564344682350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f605259c640 1 --2- 172.21.15.79:0/3818679983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446cab60 0x56434467d4f0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f604c089710 tx=0x7f604c058fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17402e689077cee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f6033fff640 1 -- 172.21.15.79:0/3818679983 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c022040 con 0x5643446cab60 2024-04-25T02:16:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f6033fff640 1 -- 172.21.15.79:0/3818679983 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f604c085070 con 0x5643446cab60 2024-04-25T02:16:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.572+0000 7f6033fff640 1 -- 172.21.15.79:0/3818679983 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c08b0c0 con 0x5643446cab60 2024-04-25T02:16:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.573+0000 7f605b9e8740 1 -- 172.21.15.79:0/3818679983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446cab60 msgr2=0x56434467d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.573+0000 7f605b9e8740 1 --2- 172.21.15.79:0/3818679983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446cab60 0x56434467d4f0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f604c089710 tx=0x7f604c058fb0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.573+0000 7f605b9e8740 1 -- 172.21.15.79:0/3818679983 shutdown_connections 2024-04-25T02:16:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.573+0000 7f605b9e8740 1 --2- 172.21.15.79:0/3818679983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446ad540 0x564344682350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.573+0000 7f605b9e8740 1 --2- 172.21.15.79:0/3818679983 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446adc80 0x5643446ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.573+0000 7f605b9e8740 1 --2- 172.21.15.79:0/3818679983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446cab60 0x56434467d4f0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.573+0000 7f605b9e8740 1 -- 172.21.15.79:0/3818679983 >> 172.21.15.79:0/3818679983 conn(0x56434467f760 msgr2=0x5643446c8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:04.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.573+0000 7f605b9e8740 1 -- 172.21.15.79:0/3818679983 shutdown_connections 2024-04-25T02:16:04.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.573+0000 7f605b9e8740 1 -- 172.21.15.79:0/3818679983 wait complete. 2024-04-25T02:16:04.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.574+0000 7f605b9e8740 1 -- start start 2024-04-25T02:16:04.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.574+0000 7f605b9e8740 1 Processor -- start 2024-04-25T02:16:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.574+0000 7f605b9e8740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446adc80 0x5643446a8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.574+0000 7f605b9e8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446cab60 0x5643446dbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.574+0000 7f605b9e8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446b0430 0x5643446b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.574+0000 7f605b9e8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564344681910 con 0x5643446cab60 2024-04-25T02:16:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f605b9e8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5643445a1cf0 con 0x5643446b0430 2024-04-25T02:16:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f605b9e8740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x564344680d00 con 0x5643446adc80 2024-04-25T02:16:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f605b9e8740 10 client.0 _ll_register_callbacks cb 0x5643445a16e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:16:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f6051d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446cab60 0x5643446dbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f6051d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446cab60 0x5643446dbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41444/0 (socket says 172.21.15.79:41444) 2024-04-25T02:16:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f6051d9b640 1 -- 172.21.15.79:0/1819294775 learned_addr learned my addr 172.21.15.79:0/1819294775 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f605259c640 1 --2- 172.21.15.79:0/1819294775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446adc80 0x5643446a8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f6052d9d640 1 --2- 172.21.15.79:0/1819294775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446b0430 0x5643446b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f6051d9b640 1 -- 172.21.15.79:0/1819294775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446adc80 msgr2=0x5643446a8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f6051d9b640 1 --2- 172.21.15.79:0/1819294775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446adc80 0x5643446a8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f6051d9b640 1 -- 172.21.15.79:0/1819294775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446b0430 msgr2=0x5643446b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f6051d9b640 1 --2- 172.21.15.79:0/1819294775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446b0430 0x5643446b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f6051d9b640 1 -- 172.21.15.79:0/1819294775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643443c46b0 con 0x5643446cab60 2024-04-25T02:16:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f6051d9b640 1 --2- 172.21.15.79:0/1819294775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446cab60 0x5643446dbb50 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f6048005040 tx=0x7f604802c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be12106eafa45d3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f60317fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:16:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f60317fa640 1 -- 172.21.15.79:0/1819294775 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048037040 con 0x5643446cab60 2024-04-25T02:16:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f60317fa640 1 -- 172.21.15.79:0/1819294775 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f60480050d0 con 0x5643446cab60 2024-04-25T02:16:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f605b9e8740 1 -- 172.21.15.79:0/1819294775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f604c085070 con 0x5643446cab60 2024-04-25T02:16:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f60317fa640 1 -- 172.21.15.79:0/1819294775 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f6048056050 con 0x5643446cab60 2024-04-25T02:16:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f605b9e8740 10 client.8421 fetch_fsmap learned FSMap version 68 2024-04-25T02:16:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f605b9e8740 1 -- 172.21.15.79:0/1819294775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x5643446bef60 con 0x5643446cab60 2024-04-25T02:16:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.575+0000 7f60317fa640 1 -- 172.21.15.79:0/1819294775 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f604c085070 con 0x5643446cab60 2024-04-25T02:16:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.576+0000 7f60317fa640 1 -- 172.21.15.79:0/1819294775 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7f6048059020 con 0x5643446cab60 2024-04-25T02:16:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.576+0000 7f605b9e8740 10 client.8421 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T02:16:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.576+0000 7f605b9e8740 10 client.8421 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T02:16:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.576+0000 7f605b9e8740 20 client.8421 populate_metadata read hostname 'smithi079' 2024-04-25T02:16:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.576+0000 7f605b9e8740 1 --2- 172.21.15.79:0/1819294775 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x5643446d8a00 0x5643446d8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.576+0000 7f605b9e8740 4 client.8421 mds_command: new command op to 8271 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:16:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.576+0000 7f605b9e8740 1 -- 172.21.15.79:0/1819294775 --> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643445f3440 con 0x5643446d8a00 2024-04-25T02:16:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.576+0000 7f605259c640 1 --2- 172.21.15.79:0/1819294775 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x5643446d8a00 0x5643446d8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.576+0000 7f60317fa640 10 client.8421 ms_handle_connect on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.576+0000 7f605259c640 1 --2- 172.21.15.79:0/1819294775 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x5643446d8a00 0x5643446d8de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5947b423802144b server_cookie=a1b40e0b613e633c in_seq=0 out_seq=0 2024-04-25T02:16:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.577+0000 7f60317fa640 1 -- 172.21.15.79:0/1819294775 <== mds.0 v2:172.21.15.79:6834/2774759267 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5643445f3440 con 0x5643446d8a00 2024-04-25T02:16:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.577+0000 7f60317fa640 10 client.8421 handle_command_reply: tid=0 2024-04-25T02:16:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.577+0000 7f605b9e8740 1 client.8421 shutdown 2024-04-25T02:16:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.577+0000 7f605b9e8740 1 -- 172.21.15.79:0/1819294775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446cab60 msgr2=0x5643446dbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.577+0000 7f605b9e8740 1 --2- 172.21.15.79:0/1819294775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446cab60 0x5643446dbb50 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f6048005040 tx=0x7f604802c070 comp rx=0 tx=0).stop 2024-04-25T02:16:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.577+0000 7f605b9e8740 1 -- 172.21.15.79:0/1819294775 shutdown_connections 2024-04-25T02:16:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.577+0000 7f605b9e8740 1 --2- 172.21.15.79:0/1819294775 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x5643446d8a00 0x5643446d8de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.577+0000 7f605b9e8740 1 --2- 172.21.15.79:0/1819294775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446b0430 0x5643446b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.577+0000 7f605b9e8740 1 --2- 172.21.15.79:0/1819294775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446cab60 0x5643446dbb50 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.577+0000 7f60317fa640 0 client.8421 ms_handle_reset on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.577+0000 7f605b9e8740 1 --2- 172.21.15.79:0/1819294775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446adc80 0x5643446a8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.577+0000 7f605b9e8740 1 -- 172.21.15.79:0/1819294775 >> 172.21.15.79:0/1819294775 conn(0x5643446ad540 msgr2=0x56434467c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.577+0000 7f605b9e8740 1 -- 172.21.15.79:0/1819294775 shutdown_connections 2024-04-25T02:16:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.577+0000 7f605b9e8740 1 -- 172.21.15.79:0/1819294775 wait complete. 2024-04-25T02:16:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.577+0000 7f605b9e8740 20 client.8421 trim_cache size 0 max 16384 2024-04-25T02:16:04.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.595+0000 7f605b9e8740 1 Processor -- start 2024-04-25T02:16:04.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.595+0000 7f605b9e8740 1 -- start start 2024-04-25T02:16:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f605b9e8740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446adc80 0x5643446d7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f605b9e8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446b0430 0x5643446dadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f605b9e8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446cab60 0x5643446db330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f605b9e8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6054200020 con 0x5643446b0430 2024-04-25T02:16:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f605b9e8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f605414cb80 con 0x5643446cab60 2024-04-25T02:16:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f605b9e8740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f605414d1d0 con 0x5643446adc80 2024-04-25T02:16:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f6051d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446b0430 0x5643446dadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f6051d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446b0430 0x5643446dadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41456/0 (socket says 172.21.15.79:41456) 2024-04-25T02:16:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f6051d9b640 1 -- 172.21.15.79:0/2786436597 learned_addr learned my addr 172.21.15.79:0/2786436597 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f605259c640 1 --2- 172.21.15.79:0/2786436597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446adc80 0x5643446d7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f6052d9d640 1 --2- 172.21.15.79:0/2786436597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446cab60 0x5643446db330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f6051d9b640 1 -- 172.21.15.79:0/2786436597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446adc80 msgr2=0x5643446d7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f6051d9b640 1 --2- 172.21.15.79:0/2786436597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446adc80 0x5643446d7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f6051d9b640 1 -- 172.21.15.79:0/2786436597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446cab60 msgr2=0x5643446db330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f6051d9b640 1 --2- 172.21.15.79:0/2786436597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446cab60 0x5643446db330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f6051d9b640 1 -- 172.21.15.79:0/2786436597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564344680890 con 0x5643446b0430 2024-04-25T02:16:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f6052d9d640 1 --2- 172.21.15.79:0/2786436597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446cab60 0x5643446db330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f6051d9b640 1 --2- 172.21.15.79:0/2786436597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446b0430 0x5643446dadf0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f6048003e30 tx=0x7f6048039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee929e15fe497 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f60337fe640 1 -- 172.21.15.79:0/2786436597 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048037030 con 0x5643446b0430 2024-04-25T02:16:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f60337fe640 1 -- 172.21.15.79:0/2786436597 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f604804e070 con 0x5643446b0430 2024-04-25T02:16:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.596+0000 7f60337fe640 1 -- 172.21.15.79:0/2786436597 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604803d440 con 0x5643446b0430 2024-04-25T02:16:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.597+0000 7f605b9e8740 1 -- 172.21.15.79:0/2786436597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446b0430 msgr2=0x5643446dadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.597+0000 7f605b9e8740 1 --2- 172.21.15.79:0/2786436597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446b0430 0x5643446dadf0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f6048003e30 tx=0x7f6048039000 comp rx=0 tx=0).stop 2024-04-25T02:16:04.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.597+0000 7f605b9e8740 1 -- 172.21.15.79:0/2786436597 shutdown_connections 2024-04-25T02:16:04.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.597+0000 7f605b9e8740 1 --2- 172.21.15.79:0/2786436597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446cab60 0x5643446db330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.597+0000 7f605b9e8740 1 --2- 172.21.15.79:0/2786436597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446b0430 0x5643446dadf0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.597+0000 7f605b9e8740 1 --2- 172.21.15.79:0/2786436597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446adc80 0x5643446d7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.597+0000 7f605b9e8740 1 -- 172.21.15.79:0/2786436597 >> 172.21.15.79:0/2786436597 conn(0x5643446ad540 msgr2=0x56434467c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:04.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.597+0000 7f605b9e8740 1 -- 172.21.15.79:0/2786436597 shutdown_connections 2024-04-25T02:16:04.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.597+0000 7f605b9e8740 1 -- 172.21.15.79:0/2786436597 wait complete. 2024-04-25T02:16:04.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.598+0000 7f605b9e8740 1 -- start start 2024-04-25T02:16:04.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.598+0000 7f605b9e8740 1 Processor -- start 2024-04-25T02:16:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.598+0000 7f605b9e8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446adc80 0x5643446eafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.598+0000 7f605b9e8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446b0430 0x5643446c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.598+0000 7f605b9e8740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446cab60 0x5643446c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.598+0000 7f605b9e8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5643446dc090 con 0x5643446adc80 2024-04-25T02:16:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.598+0000 7f605b9e8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5643446ae380 con 0x5643446b0430 2024-04-25T02:16:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.598+0000 7f605b9e8740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5643446bfe10 con 0x5643446cab60 2024-04-25T02:16:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f605b9e8740 10 client.0 _ll_register_callbacks cb 0x7f603c005760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:16:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f605259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446adc80 0x5643446eafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f605259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446adc80 0x5643446eafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41460/0 (socket says 172.21.15.79:41460) 2024-04-25T02:16:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f605259c640 1 -- 172.21.15.79:0/2878827270 learned_addr learned my addr 172.21.15.79:0/2878827270 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f6051d9b640 1 --2- 172.21.15.79:0/2878827270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446b0430 0x5643446c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f6052d9d640 1 --2- 172.21.15.79:0/2878827270 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446cab60 0x5643446c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f605259c640 1 -- 172.21.15.79:0/2878827270 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446cab60 msgr2=0x5643446c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f605259c640 1 --2- 172.21.15.79:0/2878827270 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446cab60 0x5643446c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f605259c640 1 -- 172.21.15.79:0/2878827270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446b0430 msgr2=0x5643446c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f605259c640 1 --2- 172.21.15.79:0/2878827270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446b0430 0x5643446c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f605259c640 1 -- 172.21.15.79:0/2878827270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643446c8680 con 0x5643446adc80 2024-04-25T02:16:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f605259c640 1 --2- 172.21.15.79:0/2878827270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446adc80 0x5643446eafe0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f604c089820 tx=0x7f604c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16c1dd31c865b2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f60317fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:16:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f60317fa640 1 -- 172.21.15.79:0/2878827270 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c022040 con 0x5643446adc80 2024-04-25T02:16:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f60317fa640 1 -- 172.21.15.79:0/2878827270 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f604c00e040 con 0x5643446adc80 2024-04-25T02:16:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f605b9e8740 1 -- 172.21.15.79:0/2878827270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f604804e070 con 0x5643446adc80 2024-04-25T02:16:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f60317fa640 1 -- 172.21.15.79:0/2878827270 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f604c07e050 con 0x5643446adc80 2024-04-25T02:16:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f605b9e8740 10 client.8427 fetch_fsmap learned FSMap version 68 2024-04-25T02:16:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f605b9e8740 1 -- 172.21.15.79:0/2878827270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x5643446a9ca0 con 0x5643446adc80 2024-04-25T02:16:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f60317fa640 1 -- 172.21.15.79:0/2878827270 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f604804e070 con 0x5643446adc80 2024-04-25T02:16:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f60317fa640 1 -- 172.21.15.79:0/2878827270 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7f604c081020 con 0x5643446adc80 2024-04-25T02:16:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.599+0000 7f605b9e8740 10 client.8427 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T02:16:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 10 client.8427 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T02:16:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 20 client.8427 populate_metadata read hostname 'smithi079' 2024-04-25T02:16:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 1 --2- 172.21.15.79:0/2878827270 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x5643446d7b00 0x5643446d7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 4 client.8427 mds_command: new command op to 8271 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:16:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 1 -- 172.21.15.79:0/2878827270 --> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] -- command(tid 0: {"prefix": "status"}) -- 0x5643445ed790 con 0x5643446d7b00 2024-04-25T02:16:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f6051d9b640 1 --2- 172.21.15.79:0/2878827270 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x5643446d7b00 0x5643446d7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f60317fa640 10 client.8427 ms_handle_connect on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f6051d9b640 1 --2- 172.21.15.79:0/2878827270 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x5643446d7b00 0x5643446d7ee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=184835c0f861a759 server_cookie=31fa1309ea085574 in_seq=0 out_seq=0 2024-04-25T02:16:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f60317fa640 1 -- 172.21.15.79:0/2878827270 <== mds.0 v2:172.21.15.79:6834/2774759267 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5643445ed790 con 0x5643446d7b00 2024-04-25T02:16:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f60317fa640 10 client.8427 handle_command_reply: tid=0 2024-04-25T02:16:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 1 client.8427 shutdown 2024-04-25T02:16:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 1 -- 172.21.15.79:0/2878827270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446adc80 msgr2=0x5643446eafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 1 --2- 172.21.15.79:0/2878827270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446adc80 0x5643446eafe0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f604c089820 tx=0x7f604c01e000 comp rx=0 tx=0).stop 2024-04-25T02:16:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 1 -- 172.21.15.79:0/2878827270 shutdown_connections 2024-04-25T02:16:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 1 --2- 172.21.15.79:0/2878827270 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x5643446d7b00 0x5643446d7ee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 1 --2- 172.21.15.79:0/2878827270 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5643446cab60 0x5643446c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 1 --2- 172.21.15.79:0/2878827270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643446b0430 0x5643446c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 1 --2- 172.21.15.79:0/2878827270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643446adc80 0x5643446eafe0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f60317fa640 0 client.8427 ms_handle_reset on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 1 -- 172.21.15.79:0/2878827270 >> 172.21.15.79:0/2878827270 conn(0x5643446ad540 msgr2=0x5643446dadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 1 -- 172.21.15.79:0/2878827270 shutdown_connections 2024-04-25T02:16:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 1 -- 172.21.15.79:0/2878827270 wait complete. 2024-04-25T02:16:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.600+0000 7f605b9e8740 20 client.8427 trim_cache size 0 max 16384 2024-04-25T02:16:04.613 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:16:04.613 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "696648c4-3e52-400b-a780-2e8863c56c42", 2024-04-25T02:16:04.613 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-04-25T02:16:04.613 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 8271, 2024-04-25T02:16:04.613 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-04-25T02:16:04.613 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-04-25T02:16:04.613 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-04-25T02:16:04.613 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 5.5823320409999999, 2024-04-25T02:16:04.613 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 68, 2024-04-25T02:16:04.613 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 102, 2024-04-25T02:16:04.614 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 102, 2024-04-25T02:16:04.614 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 10.66228797 2024-04-25T02:16:04.614 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:16:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.601+0000 7f6058cd4640 1 -- 172.21.15.79:0/943742036 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f603406be30 msgr2=0x7f603406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.601+0000 7f6058cd4640 1 --2- 172.21.15.79:0/943742036 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f603406be30 0x7f603406e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6048032000 tx=0x7f604802c000 comp rx=0 tx=0).stop 2024-04-25T02:16:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.601+0000 7f6058cd4640 1 -- 172.21.15.79:0/943742036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c004800 msgr2=0x7f60540b9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.601+0000 7f6058cd4640 1 --2- 172.21.15.79:0/943742036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c004800 0x7f60540b9720 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f604c00b850 tx=0x7f604c00bd10 comp rx=0 tx=0).stop 2024-04-25T02:16:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.601+0000 7f6058cd4640 1 -- 172.21.15.79:0/943742036 shutdown_connections 2024-04-25T02:16:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.601+0000 7f6058cd4640 1 --2- 172.21.15.79:0/943742036 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f603406be30 0x7f603406e2f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.601+0000 7f6058cd4640 1 --2- 172.21.15.79:0/943742036 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60540cc1e0 0x7f60540cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.601+0000 7f6058cd4640 1 --2- 172.21.15.79:0/943742036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60540a0590 0x7f60540a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.601+0000 7f6058cd4640 1 --2- 172.21.15.79:0/943742036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c004800 0x7f60540b9720 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.601+0000 7f6058cd4640 1 -- 172.21.15.79:0/943742036 >> 172.21.15.79:0/943742036 conn(0x7f605409d460 msgr2=0x7f60540caa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.601+0000 7f6058cd4640 1 -- 172.21.15.79:0/943742036 shutdown_connections 2024-04-25T02:16:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.601+0000 7f6058cd4640 1 -- 172.21.15.79:0/943742036 wait complete. 2024-04-25T02:16:04.616 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:16:04.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.708+0000 7f57815a9640 1 Processor -- start 2024-04-25T02:16:04.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.708+0000 7f57815a9640 1 -- start start 2024-04-25T02:16:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.709+0000 7f57815a9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f577c06e8c0 0x7f577c15c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.709+0000 7f57815a9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f577c0cb340 0x7f577c0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.709+0000 7f57815a9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577c15cce0 con 0x7f577c0cd170 2024-04-25T02:16:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.709+0000 7f57815a9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f577c06eca0 con 0x7f577c06e8c0 2024-04-25T02:16:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.709+0000 7f57815a9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f577c15cf80 con 0x7f577c0cb340 2024-04-25T02:16:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.709+0000 7f577affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f577c06e8c0 0x7f577c15c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.709+0000 7f577affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f577c06e8c0 0x7f577c15c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41472/0 (socket says 172.21.15.79:41472) 2024-04-25T02:16:04.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.709+0000 7f577affd640 1 -- 172.21.15.79:0/2311065773 learned_addr learned my addr 172.21.15.79:0/2311065773 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:04.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.709+0000 7f577affd640 1 -- 172.21.15.79:0/2311065773 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f577c0cb340 msgr2=0x7f577c0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:04.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.709+0000 7f577affd640 1 --2- 172.21.15.79:0/2311065773 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f577c0cb340 0x7f577c0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.709+0000 7f577affd640 1 -- 172.21.15.79:0/2311065773 >> v1:172.21.15.189:6789/0 conn(0x7f577c0cd170 legacy=0x7f577c160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:04.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.709+0000 7f577affd640 1 -- 172.21.15.79:0/2311065773 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577c15d260 con 0x7f577c06e8c0 2024-04-25T02:16:04.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.710+0000 7f577affd640 1 --2- 172.21.15.79:0/2311065773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c06e8c0 0x7f577c15c7a0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f576c0098a0 tx=0x7f576c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558224cb507423a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:04.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.710+0000 7f5779ffb640 1 -- 172.21.15.79:0/2311065773 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c037070 con 0x7f577c06e8c0 2024-04-25T02:16:04.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.710+0000 7f5779ffb640 1 -- 172.21.15.79:0/2311065773 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c032440 con 0x7f577c06e8c0 2024-04-25T02:16:04.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.710+0000 7f5779ffb640 1 -- 172.21.15.79:0/2311065773 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c032810 con 0x7f577c06e8c0 2024-04-25T02:16:04.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.711+0000 7f57815a9640 1 -- 172.21.15.79:0/2311065773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c06e8c0 msgr2=0x7f577c15c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.711+0000 7f57815a9640 1 --2- 172.21.15.79:0/2311065773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c06e8c0 0x7f577c15c7a0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f576c0098a0 tx=0x7f576c02a250 comp rx=0 tx=0).stop 2024-04-25T02:16:04.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.711+0000 7f57815a9640 1 -- 172.21.15.79:0/2311065773 shutdown_connections 2024-04-25T02:16:04.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.711+0000 7f57815a9640 1 --2- 172.21.15.79:0/2311065773 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f577c0cb340 0x7f577c0cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.711+0000 7f57815a9640 1 --2- 172.21.15.79:0/2311065773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c06e8c0 0x7f577c15c7a0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.711+0000 7f57815a9640 1 -- 172.21.15.79:0/2311065773 >> 172.21.15.79:0/2311065773 conn(0x7f577c0cd770 msgr2=0x7f577c0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:04.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.711+0000 7f57815a9640 1 -- 172.21.15.79:0/2311065773 shutdown_connections 2024-04-25T02:16:04.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.711+0000 7f57815a9640 1 -- 172.21.15.79:0/2311065773 wait complete. 2024-04-25T02:16:04.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.712+0000 7f57815a9640 1 Processor -- start 2024-04-25T02:16:04.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.712+0000 7f57815a9640 1 -- start start 2024-04-25T02:16:04.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f57815a9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f577c06e8c0 0x7f577c14d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f57815a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c0cb340 0x7f577c0ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f57815a9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f577c0cd170 0x7f577c0c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f57815a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f577c160b80 con 0x7f577c0cb340 2024-04-25T02:16:04.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f57815a9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f577c15ff50 con 0x7f577c0cd170 2024-04-25T02:16:04.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f57815a9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f577c160d00 con 0x7f577c06e8c0 2024-04-25T02:16:04.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f577a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c0cb340 0x7f577c0ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f577a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c0cb340 0x7f577c0ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41486/0 (socket says 172.21.15.79:41486) 2024-04-25T02:16:04.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f577a7fc640 1 -- 172.21.15.79:0/1047857322 learned_addr learned my addr 172.21.15.79:0/1047857322 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:04.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f577affd640 1 --2- 172.21.15.79:0/1047857322 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f577c06e8c0 0x7f577c14d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f577b7fe640 1 --2- 172.21.15.79:0/1047857322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f577c0cd170 0x7f577c0c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f577a7fc640 1 -- 172.21.15.79:0/1047857322 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f577c06e8c0 msgr2=0x7f577c14d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f577a7fc640 1 --2- 172.21.15.79:0/1047857322 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f577c06e8c0 0x7f577c14d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f577a7fc640 1 -- 172.21.15.79:0/1047857322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f577c0cd170 msgr2=0x7f577c0c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f577a7fc640 1 --2- 172.21.15.79:0/1047857322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f577c0cd170 0x7f577c0c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f577a7fc640 1 -- 172.21.15.79:0/1047857322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577c14d790 con 0x7f577c0cb340 2024-04-25T02:16:04.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f577a7fc640 1 --2- 172.21.15.79:0/1047857322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c0cb340 0x7f577c0ca580 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f577000b3c0 tx=0x7f577000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:04.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f57637fe640 1 -- 172.21.15.79:0/1047857322 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770011830 con 0x7f577c0cb340 2024-04-25T02:16:04.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f57637fe640 1 -- 172.21.15.79:0/1047857322 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5770016070 con 0x7f577c0cb340 2024-04-25T02:16:04.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f57637fe640 1 -- 172.21.15.79:0/1047857322 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770011c30 con 0x7f577c0cb340 2024-04-25T02:16:04.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f57815a9640 1 -- 172.21.15.79:0/1047857322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f577c0c94e0 con 0x7f577c0cb340 2024-04-25T02:16:04.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.713+0000 7f57815a9640 1 -- 172.21.15.79:0/1047857322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f577c0c9aa0 con 0x7f577c0cb340 2024-04-25T02:16:04.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.714+0000 7f57815a9640 1 -- 172.21.15.79:0/1047857322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f577c0690a0 con 0x7f577c0cb340 2024-04-25T02:16:04.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.715+0000 7f57637fe640 1 -- 172.21.15.79:0/1047857322 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f577001b460 con 0x7f577c0cb340 2024-04-25T02:16:04.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.715+0000 7f57637fe640 1 --2- 172.21.15.79:0/1047857322 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f576806be30 0x7f576806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:04.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.715+0000 7f57637fe640 1 -- 172.21.15.79:0/1047857322 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f577008aab0 con 0x7f577c0cb340 2024-04-25T02:16:04.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.715+0000 7f577affd640 1 --2- 172.21.15.79:0/1047857322 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f576806be30 0x7f576806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:04.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.716+0000 7f577affd640 1 --2- 172.21.15.79:0/1047857322 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f576806be30 0x7f576806e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f576c034000 tx=0x7f576c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:04.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.719+0000 7f57637fe640 1 -- 172.21.15.79:0/1047857322 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f577c14d790 con 0x7f577c0cb340 2024-04-25T02:16:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.929+0000 7f57815a9640 1 -- 172.21.15.79:0/1047857322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f577c0b6970 con 0x7f577c0cb340 2024-04-25T02:16:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.929+0000 7f57637fe640 1 -- 172.21.15.79:0/1047857322 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7f5770059470 con 0x7f577c0cb340 2024-04-25T02:16:04.934 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:16:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.931+0000 7f57815a9640 1 -- 172.21.15.79:0/1047857322 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f576806be30 msgr2=0x7f576806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.931+0000 7f57815a9640 1 --2- 172.21.15.79:0/1047857322 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f576806be30 0x7f576806e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f576c034000 tx=0x7f576c02e000 comp rx=0 tx=0).stop 2024-04-25T02:16:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.931+0000 7f57815a9640 1 -- 172.21.15.79:0/1047857322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c0cb340 msgr2=0x7f577c0ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.931+0000 7f57815a9640 1 --2- 172.21.15.79:0/1047857322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c0cb340 0x7f577c0ca580 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f577000b3c0 tx=0x7f577000b880 comp rx=0 tx=0).stop 2024-04-25T02:16:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.932+0000 7f57815a9640 1 -- 172.21.15.79:0/1047857322 shutdown_connections 2024-04-25T02:16:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.932+0000 7f57815a9640 1 --2- 172.21.15.79:0/1047857322 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f576806be30 0x7f576806e2f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.932+0000 7f57815a9640 1 --2- 172.21.15.79:0/1047857322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f577c0cd170 0x7f577c0c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.932+0000 7f57815a9640 1 --2- 172.21.15.79:0/1047857322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c0cb340 0x7f577c0ca580 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.932+0000 7f57815a9640 1 --2- 172.21.15.79:0/1047857322 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f577c06e8c0 0x7f577c14d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.932+0000 7f57815a9640 1 -- 172.21.15.79:0/1047857322 >> 172.21.15.79:0/1047857322 conn(0x7f577c0cd770 msgr2=0x7f577c06b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.932+0000 7f57815a9640 1 -- 172.21.15.79:0/1047857322 shutdown_connections 2024-04-25T02:16:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:04.932+0000 7f57815a9640 1 -- 172.21.15.79:0/1047857322 wait complete. 2024-04-25T02:16:04.947 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:16:04.947 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:16:04.947 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:16:04.948 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:16:04.948 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:16:04.948 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:16:04.948 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:16:04.948 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:16:04.948 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:16:04.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:04.948 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:16:04.963 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:16:04.963 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:16:04.963 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:16:04.963 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:16:04.963 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:16:04.963 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42241sec preferred_lft 42241sec 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:16:04.964 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:16:04.965 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:16:04.965 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:16:04.965 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:16:04.965 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:16:04.965 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:16:04.965 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:16:04.965 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link 2024-04-25T02:16:04.965 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:16:04.965 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:16:04.965 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:16:04.965 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::4c:adff:fe56:7194/64 scope link 2024-04-25T02:16:04.965 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:16:04.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:04.966 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:16:05.025 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:16:05.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:05.027 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:16:05.082 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:16:05.082 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:16:05.082 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:16:05.082 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:16:05.082 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:16:05.082 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:16:05.083 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:16:05.083 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:16:05.083 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:16:05.083 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:16:05.083 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:16:05.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:16:05.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:16:05.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:05.205 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:16:05.220 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:16:05.220 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:16:05.220 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:16:05.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:05.220 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:16:05.283 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:16:05.284 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:16:05.338 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:16:05.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:16:05.339 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:16:05.393 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:16:05.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:05.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:16:05.473 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:16:05.473 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:16:05.473 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:16:05.481 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:16:05.481 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:16:05.481 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:16:05.482 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:16:05.482 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:16:05.489 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:16:05.490 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:16:05.490 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:16:05.490 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:16:05.490 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:16:05.490 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:16:05.490 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:16:05.490 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:16:05.490 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:16:05.491 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:16:05.491 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:16:05.491 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:16:05.491 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:16:05.492 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:16:05.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:05.492 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:16:05.556 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:16:05.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:16:05.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:16:05.656 INFO:teuthology.orchestra.run.smithi079.stdout:client6787 2024-04-25T02:16:05.656 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:16:05.656 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:16:05.672 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:16:05.672 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:16:05.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:05.727 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T02:16:05.826 INFO:teuthology.orchestra.run.smithi079.stderr:6+0 records in 2024-04-25T02:16:05.827 INFO:teuthology.orchestra.run.smithi079.stderr:6+0 records out 2024-04-25T02:16:05.827 INFO:teuthology.orchestra.run.smithi079.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0409206 s, 154 MB/s 2024-04-25T02:16:05.827 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:16:05.827 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:16:05.843 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:16:05.843 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:16:05.898 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:16:06.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.029+0000 7f050075a640 1 Processor -- start 2024-04-25T02:16:06.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.029+0000 7f050075a640 1 -- start start 2024-04-25T02:16:06.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.030+0000 7f050075a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04f815e4d0 0x7f04f806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.030+0000 7f050075a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f04f80d2e20 0x7f04f80cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.030+0000 7f050075a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04f80d1660 con 0x7f04f80b3570 2024-04-25T02:16:06.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.030+0000 7f050075a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f04f80d1380 con 0x7f04f815e4d0 2024-04-25T02:16:06.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.030+0000 7f050075a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f04f80cede0 con 0x7f04f80d2e20 2024-04-25T02:16:06.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.030+0000 7f04fe4f6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04f815e4d0 0x7f04f806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.030+0000 7f04fe4f6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04f815e4d0 0x7f04f806bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41490/0 (socket says 172.21.15.79:41490) 2024-04-25T02:16:06.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.030+0000 7f04fe4f6640 1 -- 172.21.15.79:0/990468299 learned_addr learned my addr 172.21.15.79:0/990468299 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:06.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.030+0000 7f04fe4f6640 1 -- 172.21.15.79:0/990468299 >> v2:172.21.15.189:3300/0 conn(0x7f04f80d2e20 msgr2=0x7f04f80cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:06.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.030+0000 7f04fe4f6640 1 --2- 172.21.15.79:0/990468299 >> v2:172.21.15.189:3300/0 conn(0x7f04f80d2e20 0x7f04f80cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.030+0000 7f04fe4f6640 1 -- 172.21.15.79:0/990468299 >> v1:172.21.15.189:6789/0 conn(0x7f04f80b3570 legacy=0x7f04f80d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:06.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.030+0000 7f04fe4f6640 1 -- 172.21.15.79:0/990468299 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f80cf0c0 con 0x7f04f815e4d0 2024-04-25T02:16:06.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.031+0000 7f04fe4f6640 1 --2- 172.21.15.79:0/990468299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f815e4d0 0x7f04f806bc70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009870 tx=0x7f04f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8bc908c84a23b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:06.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.031+0000 7f04fd4f4640 1 -- 172.21.15.79:0/990468299 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4037070 con 0x7f04f815e4d0 2024-04-25T02:16:06.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.031+0000 7f04fd4f4640 1 -- 172.21.15.79:0/990468299 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f4032440 con 0x7f04f815e4d0 2024-04-25T02:16:06.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.031+0000 7f04fd4f4640 1 -- 172.21.15.79:0/990468299 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4032810 con 0x7f04f815e4d0 2024-04-25T02:16:06.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.032+0000 7f050075a640 1 -- 172.21.15.79:0/990468299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f815e4d0 msgr2=0x7f04f806bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.032+0000 7f050075a640 1 --2- 172.21.15.79:0/990468299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f815e4d0 0x7f04f806bc70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009870 tx=0x7f04f402a270 comp rx=0 tx=0).stop 2024-04-25T02:16:06.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.032+0000 7f050075a640 1 -- 172.21.15.79:0/990468299 shutdown_connections 2024-04-25T02:16:06.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.032+0000 7f050075a640 1 --2- 172.21.15.79:0/990468299 >> v2:172.21.15.189:3300/0 conn(0x7f04f80d2e20 0x7f04f80cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.032+0000 7f050075a640 1 --2- 172.21.15.79:0/990468299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f815e4d0 0x7f04f806bc70 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.032+0000 7f050075a640 1 -- 172.21.15.79:0/990468299 >> 172.21.15.79:0/990468299 conn(0x7f04f809d460 msgr2=0x7f04f80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:06.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.032+0000 7f050075a640 1 -- 172.21.15.79:0/990468299 shutdown_connections 2024-04-25T02:16:06.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.032+0000 7f050075a640 1 -- 172.21.15.79:0/990468299 wait complete. 2024-04-25T02:16:06.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.033+0000 7f050075a640 1 Processor -- start 2024-04-25T02:16:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.033+0000 7f050075a640 1 -- start start 2024-04-25T02:16:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.034+0000 7f050075a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f80b3570 0x7f04f81f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.034+0000 7f050075a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04f80d2e20 0x7f04f80cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.034+0000 7f050075a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04f815e4d0 0x7f04f8157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.034+0000 7f050075a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f04f80d2250 con 0x7f04f80b3570 2024-04-25T02:16:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.034+0000 7f050075a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f04f80d20d0 con 0x7f04f80d2e20 2024-04-25T02:16:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.034+0000 7f050075a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f04f806c1b0 con 0x7f04f815e4d0 2024-04-25T02:16:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.034+0000 7f04fe4f6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f80b3570 0x7f04f81f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.034+0000 7f04fe4f6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f80b3570 0x7f04f81f76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41494/0 (socket says 172.21.15.79:41494) 2024-04-25T02:16:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.034+0000 7f04fe4f6640 1 -- 172.21.15.79:0/3080041709 learned_addr learned my addr 172.21.15.79:0/3080041709 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.034+0000 7f04fdcf5640 1 --2- 172.21.15.79:0/3080041709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04f80d2e20 0x7f04f80cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.034+0000 7f04fecf7640 1 --2- 172.21.15.79:0/3080041709 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04f815e4d0 0x7f04f8157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.034+0000 7f04fe4f6640 1 -- 172.21.15.79:0/3080041709 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04f815e4d0 msgr2=0x7f04f8157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.034+0000 7f04fe4f6640 1 --2- 172.21.15.79:0/3080041709 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04f815e4d0 0x7f04f8157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.034+0000 7f04fe4f6640 1 -- 172.21.15.79:0/3080041709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04f80d2e20 msgr2=0x7f04f80cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.035+0000 7f04fe4f6640 1 --2- 172.21.15.79:0/3080041709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04f80d2e20 0x7f04f80cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.035+0000 7f04fe4f6640 1 -- 172.21.15.79:0/3080041709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f81f7db0 con 0x7f04f80b3570 2024-04-25T02:16:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.035+0000 7f04fe4f6640 1 --2- 172.21.15.79:0/3080041709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f80b3570 0x7f04f81f76f0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009870 tx=0x7f04f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.035+0000 7f04eeffd640 1 -- 172.21.15.79:0/3080041709 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4037040 con 0x7f04f80b3570 2024-04-25T02:16:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.035+0000 7f04eeffd640 1 -- 172.21.15.79:0/3080041709 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f4004250 con 0x7f04f80b3570 2024-04-25T02:16:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.035+0000 7f050075a640 1 -- 172.21.15.79:0/3080041709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f81f8090 con 0x7f04f80b3570 2024-04-25T02:16:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.035+0000 7f04eeffd640 1 -- 172.21.15.79:0/3080041709 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f403c670 con 0x7f04f80b3570 2024-04-25T02:16:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.035+0000 7f050075a640 1 -- 172.21.15.79:0/3080041709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f80b7de0 con 0x7f04f80b3570 2024-04-25T02:16:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.036+0000 7f050075a640 1 -- 172.21.15.79:0/3080041709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f81f85b0 con 0x7f04f80b3570 2024-04-25T02:16:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.037+0000 7f04eeffd640 1 -- 172.21.15.79:0/3080041709 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04f403a070 con 0x7f04f80b3570 2024-04-25T02:16:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.037+0000 7f04eeffd640 1 --2- 172.21.15.79:0/3080041709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04dc06be30 0x7f04dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.037+0000 7f04eeffd640 1 -- 172.21.15.79:0/3080041709 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f04f40ab7c0 con 0x7f04f80b3570 2024-04-25T02:16:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.037+0000 7f04fdcf5640 1 --2- 172.21.15.79:0/3080041709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04dc06be30 0x7f04dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.037+0000 7f04fdcf5640 1 --2- 172.21.15.79:0/3080041709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04dc06be30 0x7f04dc06e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f04f80ccc90 tx=0x7f04e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:06.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.041+0000 7f04eeffd640 1 -- 172.21.15.79:0/3080041709 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f04f4041020 con 0x7f04f80b3570 2024-04-25T02:16:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.217+0000 7f050075a640 1 -- 172.21.15.79:0/3080041709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04f80690a0 con 0x7f04f80b3570 2024-04-25T02:16:06.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.218+0000 7f04eeffd640 1 -- 172.21.15.79:0/3080041709 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16631 (secure 0 0 0) 0x7f04f4079a80 con 0x7f04f80b3570 2024-04-25T02:16:06.223 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:06.223 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":102,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:16:00.025323+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:15:56.581482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T02:15:57.334060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:16:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.220+0000 7f050075a640 1 -- 172.21.15.79:0/3080041709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04dc06be30 msgr2=0x7f04dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.220+0000 7f050075a640 1 --2- 172.21.15.79:0/3080041709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04dc06be30 0x7f04dc06e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f04f80ccc90 tx=0x7f04e8009040 comp rx=0 tx=0).stop 2024-04-25T02:16:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.220+0000 7f050075a640 1 -- 172.21.15.79:0/3080041709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f80b3570 msgr2=0x7f04f81f76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.220+0000 7f050075a640 1 --2- 172.21.15.79:0/3080041709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f80b3570 0x7f04f81f76f0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009870 tx=0x7f04f40046c0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.220+0000 7f050075a640 1 -- 172.21.15.79:0/3080041709 shutdown_connections 2024-04-25T02:16:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.220+0000 7f050075a640 1 --2- 172.21.15.79:0/3080041709 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04dc06be30 0x7f04dc06e2f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.220+0000 7f050075a640 1 --2- 172.21.15.79:0/3080041709 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04f815e4d0 0x7f04f8157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.220+0000 7f050075a640 1 --2- 172.21.15.79:0/3080041709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04f80d2e20 0x7f04f80cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.220+0000 7f050075a640 1 --2- 172.21.15.79:0/3080041709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f80b3570 0x7f04f81f76f0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.220+0000 7f050075a640 1 -- 172.21.15.79:0/3080041709 >> 172.21.15.79:0/3080041709 conn(0x7f04f809d460 msgr2=0x7f04f80d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.220+0000 7f050075a640 1 -- 172.21.15.79:0/3080041709 shutdown_connections 2024-04-25T02:16:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.220+0000 7f050075a640 1 -- 172.21.15.79:0/3080041709 wait complete. 2024-04-25T02:16:06.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:15:56.581482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:15:57.334060+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:16:06.236 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:16:06.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.330+0000 7f24f73ab640 1 Processor -- start 2024-04-25T02:16:06.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.331+0000 7f24f73ab640 1 -- start start 2024-04-25T02:16:06.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.331+0000 7f24f73ab640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24f006b2f0 0x7f24f006b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.331+0000 7f24f73ab640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24f0071cd0 con 0x7f24f0155f00 2024-04-25T02:16:06.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.331+0000 7f24f73ab640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24f0071fb0 con 0x7f24f00b41b0 2024-04-25T02:16:06.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.331+0000 7f24f73ab640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f24f0072290 con 0x7f24f006b2f0 2024-04-25T02:16:06.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.331+0000 7f24f5948640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f24f0155f00 0x7f24f0156370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49148/0 (socket says 172.21.15.79:49148) 2024-04-25T02:16:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24f5948640 1 -- 172.21.15.79:0/646631447 learned_addr learned my addr 172.21.15.79:0/646631447 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24f4946640 1 --2- 172.21.15.79:0/646631447 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24f006b2f0 0x7f24f006b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088743327 0 0) 0x7f24f0071cd0 con 0x7f24f0155f00 2024-04-25T02:16:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24dc003520 con 0x7f24f0155f00 2024-04-25T02:16:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 577191005 0 0) 0x7f24f0071fb0 con 0x7f24f00b41b0 2024-04-25T02:16:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24f0071cd0 con 0x7f24f00b41b0 2024-04-25T02:16:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1160104716 0 0) 0x7f24dc003520 con 0x7f24f0155f00 2024-04-25T02:16:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24f006b2f0 msgr2=0x7f24f006b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 --2- 172.21.15.79:0/646631447 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24f006b2f0 0x7f24f006b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 >> v1:172.21.15.189:6789/0 conn(0x7f24f00b41b0 legacy=0x7f24f01605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f0072570 con 0x7f24f0155f00 2024-04-25T02:16:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f24e80015f0 con 0x7f24f0155f00 2024-04-25T02:16:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24f4946640 1 --2- 172.21.15.79:0/646631447 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24f006b2f0 0x7f24f006b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:16:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 >> v1:172.21.15.79:6789/0 conn(0x7f24f0155f00 legacy=0x7f24f0156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 --2- 172.21.15.79:0/646631447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc003b70 0x7f24dc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 --2- 172.21.15.79:0/646631447 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24f006b2f0 0x7f24dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 --2- 172.21.15.79:0/646631447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24dc004d40 0x7f24dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f24f0072290 con 0x7f24dc003b70 2024-04-25T02:16:06.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc00ba70 con 0x7f24dc004d40 2024-04-25T02:16:06.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f24dc00bc70 con 0x7f24f006b2f0 2024-04-25T02:16:06.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24f5147640 1 --2- 172.21.15.79:0/646631447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc003b70 0x7f24dc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24f4946640 1 --2- 172.21.15.79:0/646631447 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24f006b2f0 0x7f24dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24f5948640 1 --2- 172.21.15.79:0/646631447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24dc004d40 0x7f24dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24f5147640 1 -- 172.21.15.79:0/646631447 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24f006b2f0 msgr2=0x7f24dc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:06.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24f5147640 1 --2- 172.21.15.79:0/646631447 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24f006b2f0 0x7f24dc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24f5147640 1 -- 172.21.15.79:0/646631447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24dc004d40 msgr2=0x7f24dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:06.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24f5147640 1 --2- 172.21.15.79:0/646631447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24dc004d40 0x7f24dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.332+0000 7f24f5147640 1 -- 172.21.15.79:0/646631447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24dc003520 con 0x7f24dc003b70 2024-04-25T02:16:06.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.333+0000 7f24f5147640 1 --2- 172.21.15.79:0/646631447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc003b70 0x7f24dc003f70 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f24ec001fd0 tx=0x7f24dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a1af81d58d9be9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:06.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.333+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec001bf0 con 0x7f24dc003b70 2024-04-25T02:16:06.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.333+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec003b70 con 0x7f24dc003b70 2024-04-25T02:16:06.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.333+0000 7f24e7fff640 1 -- 172.21.15.79:0/646631447 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec0050d0 con 0x7f24dc003b70 2024-04-25T02:16:06.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.334+0000 7f24f73ab640 1 -- 172.21.15.79:0/646631447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc003b70 msgr2=0x7f24dc003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.334+0000 7f24f73ab640 1 --2- 172.21.15.79:0/646631447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc003b70 0x7f24dc003f70 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f24ec001fd0 tx=0x7f24dc005830 comp rx=0 tx=0).stop 2024-04-25T02:16:06.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.334+0000 7f24f5948640 1 -- 172.21.15.79:0/646631447 reap_dead start 2024-04-25T02:16:06.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.334+0000 7f24f73ab640 1 -- 172.21.15.79:0/646631447 shutdown_connections 2024-04-25T02:16:06.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.334+0000 7f24f73ab640 1 -- 172.21.15.79:0/646631447 >> 172.21.15.79:0/646631447 conn(0x7f24f00b1cd0 msgr2=0x7f24f00b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:06.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.334+0000 7f24f73ab640 1 -- 172.21.15.79:0/646631447 shutdown_connections 2024-04-25T02:16:06.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.334+0000 7f24f73ab640 1 -- 172.21.15.79:0/646631447 wait complete. 2024-04-25T02:16:06.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.335+0000 7f24f73ab640 1 Processor -- start 2024-04-25T02:16:06.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.335+0000 7f24f73ab640 1 -- start start 2024-04-25T02:16:06.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f73ab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc003b70 0x7f24f01422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f73ab640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24f0156ce0 0x7f24f0157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f73ab640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24f00ad040 0x7f24f00ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f73ab640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f24f00cf4b0 con 0x7f24dc003b70 2024-04-25T02:16:06.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f73ab640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f24f0072d70 con 0x7f24f00ad040 2024-04-25T02:16:06.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f73ab640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f24f015c870 con 0x7f24f0156ce0 2024-04-25T02:16:06.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f5147640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc003b70 0x7f24f01422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f5147640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc003b70 0x7f24f01422f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41516/0 (socket says 172.21.15.79:41516) 2024-04-25T02:16:06.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f5147640 1 -- 172.21.15.79:0/2257923696 learned_addr learned my addr 172.21.15.79:0/2257923696 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:06.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f5948640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24f00ad040 0x7f24f00ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f4946640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24f0156ce0 0x7f24f0157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f5147640 1 -- 172.21.15.79:0/2257923696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24f0156ce0 msgr2=0x7f24f0157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f5147640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24f0156ce0 0x7f24f0157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f5147640 1 -- 172.21.15.79:0/2257923696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24f00ad040 msgr2=0x7f24f00ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f5147640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24f00ad040 0x7f24f00ad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f5147640 1 -- 172.21.15.79:0/2257923696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f0142830 con 0x7f24dc003b70 2024-04-25T02:16:06.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f5948640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24f00ad040 0x7f24f00ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:06.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f4946640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24f0156ce0 0x7f24f0157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:06.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f5147640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc003b70 0x7f24f01422f0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f24ec005040 tx=0x7f24ec001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:06.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24e5ffb640 1 -- 172.21.15.79:0/2257923696 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec040070 con 0x7f24dc003b70 2024-04-25T02:16:06.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24e5ffb640 1 -- 172.21.15.79:0/2257923696 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec003970 con 0x7f24dc003b70 2024-04-25T02:16:06.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24f73ab640 1 -- 172.21.15.79:0/2257923696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f00addb0 con 0x7f24dc003b70 2024-04-25T02:16:06.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.336+0000 7f24e5ffb640 1 -- 172.21.15.79:0/2257923696 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec03c430 con 0x7f24dc003b70 2024-04-25T02:16:06.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.337+0000 7f24f73ab640 1 -- 172.21.15.79:0/2257923696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f00ae370 con 0x7f24dc003b70 2024-04-25T02:16:06.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.337+0000 7f24f73ab640 1 -- 172.21.15.79:0/2257923696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f00690a0 con 0x7f24dc003b70 2024-04-25T02:16:06.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.338+0000 7f24e5ffb640 1 -- 172.21.15.79:0/2257923696 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24ec043070 con 0x7f24dc003b70 2024-04-25T02:16:06.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.338+0000 7f24e5ffb640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f24d406be30 0x7f24d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.338+0000 7f24e5ffb640 1 -- 172.21.15.79:0/2257923696 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f24ec0aba30 con 0x7f24dc003b70 2024-04-25T02:16:06.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.338+0000 7f24f4946640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f24d406be30 0x7f24d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.339+0000 7f24f4946640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f24d406be30 0x7f24d406e2f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f24f00cc930 tx=0x7f24e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:06.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.343+0000 7f24e5ffb640 1 -- 172.21.15.79:0/2257923696 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f24ec07a3e0 con 0x7f24dc003b70 2024-04-25T02:16:06.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.513+0000 7f24f73ab640 1 -- 172.21.15.79:0/2257923696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f24f00ce280 con 0x7f24dc003b70 2024-04-25T02:16:06.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.513+0000 7f24e5ffb640 1 -- 172.21.15.79:0/2257923696 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) ==== 93+0+10 (secure 0 0 0) 0x7f24ec079ce0 con 0x7f24dc003b70 2024-04-25T02:16:06.518 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:16:06.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.515+0000 7f24f73ab640 1 -- 172.21.15.79:0/2257923696 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f24d406be30 msgr2=0x7f24d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.515+0000 7f24f73ab640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f24d406be30 0x7f24d406e2f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f24f00cc930 tx=0x7f24e0008040 comp rx=0 tx=0).stop 2024-04-25T02:16:06.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.515+0000 7f24f73ab640 1 -- 172.21.15.79:0/2257923696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc003b70 msgr2=0x7f24f01422f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.515+0000 7f24f73ab640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc003b70 0x7f24f01422f0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f24ec005040 tx=0x7f24ec001650 comp rx=0 tx=0).stop 2024-04-25T02:16:06.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.515+0000 7f24f73ab640 1 -- 172.21.15.79:0/2257923696 shutdown_connections 2024-04-25T02:16:06.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.515+0000 7f24f73ab640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f24d406be30 0x7f24d406e2f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.515+0000 7f24f73ab640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24f00ad040 0x7f24f00ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.515+0000 7f24f73ab640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24f0156ce0 0x7f24f0157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.515+0000 7f24f73ab640 1 --2- 172.21.15.79:0/2257923696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24dc003b70 0x7f24f01422f0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.515+0000 7f24f73ab640 1 -- 172.21.15.79:0/2257923696 >> 172.21.15.79:0/2257923696 conn(0x7f24f00b1cd0 msgr2=0x7f24f00afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:06.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.515+0000 7f24f73ab640 1 -- 172.21.15.79:0/2257923696 shutdown_connections 2024-04-25T02:16:06.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.515+0000 7f24f73ab640 1 -- 172.21.15.79:0/2257923696 wait complete. 2024-04-25T02:16:06.531 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:16:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.625+0000 7f89e7a31640 1 Processor -- start 2024-04-25T02:16:06.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.626+0000 7f89e7a31640 1 -- start start 2024-04-25T02:16:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.627+0000 7f89e7a31640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89e00d10c0 0x7f89e006bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.627+0000 7f89e7a31640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e00d1ee0 con 0x7f89e015e4f0 2024-04-25T02:16:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.627+0000 7f89e7a31640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e00d21c0 con 0x7f89e00d2ca0 2024-04-25T02:16:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.627+0000 7f89e7a31640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f89e00d3130 con 0x7f89e00d10c0 2024-04-25T02:16:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.627+0000 7f89e5fce640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89e00d10c0 0x7f89e006bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.627+0000 7f89e57cd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f89e015e4f0 0x7f89e00cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49164/0 (socket says 172.21.15.79:49164) 2024-04-25T02:16:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.627+0000 7f89e57cd640 1 -- 172.21.15.79:0/2323979322 learned_addr learned my addr 172.21.15.79:0/2323979322 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.627+0000 7f89e5fce640 1 -- 172.21.15.79:0/2323979322 >> v1:172.21.15.189:6789/0 conn(0x7f89e00d2ca0 legacy=0x7f89e00d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.627+0000 7f89e5fce640 1 -- 172.21.15.79:0/2323979322 >> v1:172.21.15.79:6789/0 conn(0x7f89e015e4f0 legacy=0x7f89e00cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.627+0000 7f89e5fce640 1 -- 172.21.15.79:0/2323979322 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e00d24a0 con 0x7f89e00d10c0 2024-04-25T02:16:06.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.628+0000 7f89e5fce640 1 --2- 172.21.15.79:0/2323979322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e00d10c0 0x7f89e006bc30 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009dc0 tx=0x7f89d802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1fd02e5cba4915 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:06.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.628+0000 7f89d7fff640 1 -- 172.21.15.79:0/2323979322 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8007740 con 0x7f89e00d10c0 2024-04-25T02:16:06.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.628+0000 7f89d7fff640 1 -- 172.21.15.79:0/2323979322 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d80078e0 con 0x7f89e00d10c0 2024-04-25T02:16:06.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.628+0000 7f89d7fff640 1 -- 172.21.15.79:0/2323979322 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8007cb0 con 0x7f89e00d10c0 2024-04-25T02:16:06.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.628+0000 7f89e7a31640 1 -- 172.21.15.79:0/2323979322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e00d10c0 msgr2=0x7f89e006bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.628+0000 7f89e7a31640 1 --2- 172.21.15.79:0/2323979322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e00d10c0 0x7f89e006bc30 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009dc0 tx=0x7f89d802a730 comp rx=0 tx=0).stop 2024-04-25T02:16:06.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.628+0000 7f89e7a31640 1 -- 172.21.15.79:0/2323979322 shutdown_connections 2024-04-25T02:16:06.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.628+0000 7f89e7a31640 1 --2- 172.21.15.79:0/2323979322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e00d10c0 0x7f89e006bc30 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.628+0000 7f89e7a31640 1 -- 172.21.15.79:0/2323979322 >> 172.21.15.79:0/2323979322 conn(0x7f89e009d4a0 msgr2=0x7f89e00d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:06.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.628+0000 7f89e7a31640 1 -- 172.21.15.79:0/2323979322 shutdown_connections 2024-04-25T02:16:06.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.628+0000 7f89e7a31640 1 -- 172.21.15.79:0/2323979322 wait complete. 2024-04-25T02:16:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.629+0000 7f89e7a31640 1 Processor -- start 2024-04-25T02:16:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.630+0000 7f89e7a31640 1 -- start start 2024-04-25T02:16:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.630+0000 7f89e7a31640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89e00d10c0 0x7f89e00b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.630+0000 7f89e7a31640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e00d2ca0 0x7f89e00b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.630+0000 7f89e7a31640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89e015e4f0 0x7f89e00b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.630+0000 7f89e7a31640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f89e00d4ee0 con 0x7f89e00d2ca0 2024-04-25T02:16:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.630+0000 7f89e7a31640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f89e00cff00 con 0x7f89e015e4f0 2024-04-25T02:16:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.630+0000 7f89e7a31640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f89e00d5060 con 0x7f89e00d10c0 2024-04-25T02:16:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.630+0000 7f89e4fcc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e00d2ca0 0x7f89e00b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.630+0000 7f89e4fcc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e00d2ca0 0x7f89e00b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41534/0 (socket says 172.21.15.79:41534) 2024-04-25T02:16:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.630+0000 7f89e4fcc640 1 -- 172.21.15.79:0/1805546146 learned_addr learned my addr 172.21.15.79:0/1805546146 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.631+0000 7f89e57cd640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89e00d10c0 0x7f89e00b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.631+0000 7f89e5fce640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89e015e4f0 0x7f89e00b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.631+0000 7f89e4fcc640 1 -- 172.21.15.79:0/1805546146 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89e00d10c0 msgr2=0x7f89e00b80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.631+0000 7f89e4fcc640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89e00d10c0 0x7f89e00b80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.631+0000 7f89e4fcc640 1 -- 172.21.15.79:0/1805546146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89e015e4f0 msgr2=0x7f89e00b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.631+0000 7f89e4fcc640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89e015e4f0 0x7f89e00b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.631+0000 7f89e4fcc640 1 -- 172.21.15.79:0/1805546146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e01f47c0 con 0x7f89e00d2ca0 2024-04-25T02:16:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.631+0000 7f89e57cd640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89e00d10c0 0x7f89e00b80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.631+0000 7f89e5fce640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89e015e4f0 0x7f89e00b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.631+0000 7f89e4fcc640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e00d2ca0 0x7f89e00b1f50 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00c400 tx=0x7f89dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.631+0000 7f89d5ffb640 1 -- 172.21.15.79:0/1805546146 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc0052d0 con 0x7f89e00d2ca0 2024-04-25T02:16:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.631+0000 7f89d5ffb640 1 -- 172.21.15.79:0/1805546146 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89dc005490 con 0x7f89e00d2ca0 2024-04-25T02:16:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.631+0000 7f89e7a31640 1 -- 172.21.15.79:0/1805546146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e01f4aa0 con 0x7f89e00d2ca0 2024-04-25T02:16:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.631+0000 7f89d5ffb640 1 -- 172.21.15.79:0/1805546146 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc007260 con 0x7f89e00d2ca0 2024-04-25T02:16:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.631+0000 7f89e7a31640 1 -- 172.21.15.79:0/1805546146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e01f5060 con 0x7f89e00d2ca0 2024-04-25T02:16:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.632+0000 7f89e7a31640 1 -- 172.21.15.79:0/1805546146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e00686c0 con 0x7f89e00d2ca0 2024-04-25T02:16:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.632+0000 7f89d5ffb640 1 -- 172.21.15.79:0/1805546146 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89dc007400 con 0x7f89e00d2ca0 2024-04-25T02:16:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.633+0000 7f89d5ffb640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f89c406be30 0x7f89c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.633+0000 7f89d5ffb640 1 -- 172.21.15.79:0/1805546146 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f89dc08a310 con 0x7f89e00d2ca0 2024-04-25T02:16:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.633+0000 7f89e57cd640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f89c406be30 0x7f89c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.633+0000 7f89e57cd640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f89c406be30 0x7f89c406e2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f89d0007fd0 tx=0x7f89d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:06.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.637+0000 7f89d5ffb640 1 -- 172.21.15.79:0/1805546146 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f89dc058d50 con 0x7f89e00d2ca0 2024-04-25T02:16:06.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.807+0000 7f89e7a31640 1 -- 172.21.15.79:0/1805546146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f89e00690a0 con 0x7f89e00d2ca0 2024-04-25T02:16:06.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.808+0000 7f89d5ffb640 1 -- 172.21.15.79:0/1805546146 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) ==== 104+0+11 (secure 0 0 0) 0x7f89dc058650 con 0x7f89e00d2ca0 2024-04-25T02:16:06.813 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:16:06.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.810+0000 7f89e7a31640 1 -- 172.21.15.79:0/1805546146 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f89c406be30 msgr2=0x7f89c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.810+0000 7f89e7a31640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f89c406be30 0x7f89c406e2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f89d0007fd0 tx=0x7f89d0009040 comp rx=0 tx=0).stop 2024-04-25T02:16:06.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.810+0000 7f89e7a31640 1 -- 172.21.15.79:0/1805546146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e00d2ca0 msgr2=0x7f89e00b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.810+0000 7f89e7a31640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e00d2ca0 0x7f89e00b1f50 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00c400 tx=0x7f89dc00c8c0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.810+0000 7f89e7a31640 1 -- 172.21.15.79:0/1805546146 shutdown_connections 2024-04-25T02:16:06.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.810+0000 7f89e7a31640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f89c406be30 0x7f89c406e2f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.810+0000 7f89e7a31640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89e015e4f0 0x7f89e00b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.810+0000 7f89e7a31640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e00d2ca0 0x7f89e00b1f50 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.810+0000 7f89e7a31640 1 --2- 172.21.15.79:0/1805546146 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89e00d10c0 0x7f89e00b80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.810+0000 7f89e7a31640 1 -- 172.21.15.79:0/1805546146 >> 172.21.15.79:0/1805546146 conn(0x7f89e009d4a0 msgr2=0x7f89e00d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:06.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.810+0000 7f89e7a31640 1 -- 172.21.15.79:0/1805546146 shutdown_connections 2024-04-25T02:16:06.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.810+0000 7f89e7a31640 1 -- 172.21.15.79:0/1805546146 wait complete. 2024-04-25T02:16:06.825 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:16:06.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.919+0000 7f9fa94e1640 1 Processor -- start 2024-04-25T02:16:06.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.919+0000 7f9fa94e1640 1 -- start start 2024-04-25T02:16:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.920+0000 7f9fa94e1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9fa40b8e20 0x7f9fa40d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.920+0000 7f9fa94e1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa40b7050 con 0x7f9fa415e250 2024-04-25T02:16:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.920+0000 7f9fa94e1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa40b7330 con 0x7f9fa40d0a10 2024-04-25T02:16:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.920+0000 7f9fa94e1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa40d00b0 con 0x7f9fa40b8e20 2024-04-25T02:16:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.920+0000 7f9fa2ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9fa415e250 0x7f9fa40cf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49172/0 (socket says 172.21.15.79:49172) 2024-04-25T02:16:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.920+0000 7f9fa2ffd640 1 -- 172.21.15.79:0/2993763496 learned_addr learned my addr 172.21.15.79:0/2993763496 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa37fe640 1 --2- 172.21.15.79:0/2993763496 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9fa40b8e20 0x7f9fa40d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa1ffb640 1 -- 172.21.15.79:0/2993763496 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3846993449 0 0) 0x7f9fa40b7050 con 0x7f9fa415e250 2024-04-25T02:16:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa1ffb640 1 -- 172.21.15.79:0/2993763496 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f8c003520 con 0x7f9fa415e250 2024-04-25T02:16:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa1ffb640 1 -- 172.21.15.79:0/2993763496 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2350441537 0 0) 0x7f9f8c003520 con 0x7f9fa415e250 2024-04-25T02:16:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa1ffb640 1 -- 172.21.15.79:0/2993763496 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9fa40b8e20 msgr2=0x7f9fa40d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa1ffb640 1 --2- 172.21.15.79:0/2993763496 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9fa40b8e20 0x7f9fa40d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa1ffb640 1 -- 172.21.15.79:0/2993763496 >> v1:172.21.15.189:6789/0 conn(0x7f9fa40d0a10 legacy=0x7f9fa40b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa1ffb640 1 -- 172.21.15.79:0/2993763496 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa40b7610 con 0x7f9fa415e250 2024-04-25T02:16:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa1ffb640 1 -- 172.21.15.79:0/2993763496 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f9f940019f0 con 0x7f9fa415e250 2024-04-25T02:16:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa1ffb640 1 -- 172.21.15.79:0/2993763496 >> v1:172.21.15.79:6789/0 conn(0x7f9fa415e250 legacy=0x7f9fa40cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa1ffb640 1 --2- 172.21.15.79:0/2993763496 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9fa40b8e20 0x7f9f8c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa1ffb640 1 --2- 172.21.15.79:0/2993763496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f8c003f60 0x7f9f8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa1ffb640 1 --2- 172.21.15.79:0/2993763496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f8c004d40 0x7f9f8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa1ffb640 1 -- 172.21.15.79:0/2993763496 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa40d00b0 con 0x7f9f8c004d40 2024-04-25T02:16:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa1ffb640 1 -- 172.21.15.79:0/2993763496 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8c00bb50 con 0x7f9f8c003f60 2024-04-25T02:16:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa1ffb640 1 -- 172.21.15.79:0/2993763496 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9f8c00bd50 con 0x7f9fa40b8e20 2024-04-25T02:16:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa37fe640 1 --2- 172.21.15.79:0/2993763496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f8c004d40 0x7f9f8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa2ffd640 1 --2- 172.21.15.79:0/2993763496 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9fa40b8e20 0x7f9f8c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa27fc640 1 --2- 172.21.15.79:0/2993763496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f8c003f60 0x7f9f8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa37fe640 1 -- 172.21.15.79:0/2993763496 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9fa40b8e20 msgr2=0x7f9f8c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa37fe640 1 --2- 172.21.15.79:0/2993763496 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9fa40b8e20 0x7f9f8c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa37fe640 1 -- 172.21.15.79:0/2993763496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f8c003f60 msgr2=0x7f9f8c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa37fe640 1 --2- 172.21.15.79:0/2993763496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f8c003f60 0x7f9f8c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.921+0000 7f9fa37fe640 1 -- 172.21.15.79:0/2993763496 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8c003520 con 0x7f9f8c004d40 2024-04-25T02:16:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.922+0000 7f9fa37fe640 1 --2- 172.21.15.79:0/2993763496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f8c004d40 0x7f9f8c0051c0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009a90 tx=0x7f9f8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a89b06d413cb1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.922+0000 7f9fa1ffb640 1 -- 172.21.15.79:0/2993763496 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c036070 con 0x7f9f8c004d40 2024-04-25T02:16:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.922+0000 7f9fa1ffb640 1 -- 172.21.15.79:0/2993763496 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f9c031400 con 0x7f9f8c004d40 2024-04-25T02:16:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.922+0000 7f9fa1ffb640 1 -- 172.21.15.79:0/2993763496 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c009690 con 0x7f9f8c004d40 2024-04-25T02:16:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.923+0000 7f9fa94e1640 1 -- 172.21.15.79:0/2993763496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f8c004d40 msgr2=0x7f9f8c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.923+0000 7f9fa94e1640 1 --2- 172.21.15.79:0/2993763496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f8c004d40 0x7f9f8c0051c0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009a90 tx=0x7f9f8c005830 comp rx=0 tx=0).stop 2024-04-25T02:16:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.923+0000 7f9fa37fe640 1 -- 172.21.15.79:0/2993763496 reap_dead start 2024-04-25T02:16:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.923+0000 7f9fa94e1640 1 -- 172.21.15.79:0/2993763496 shutdown_connections 2024-04-25T02:16:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.923+0000 7f9fa94e1640 1 -- 172.21.15.79:0/2993763496 >> 172.21.15.79:0/2993763496 conn(0x7f9fa409d3a0 msgr2=0x7f9fa40d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.923+0000 7f9fa94e1640 1 -- 172.21.15.79:0/2993763496 shutdown_connections 2024-04-25T02:16:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.923+0000 7f9fa94e1640 1 -- 172.21.15.79:0/2993763496 wait complete. 2024-04-25T02:16:06.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.924+0000 7f9fa94e1640 1 Processor -- start 2024-04-25T02:16:06.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.924+0000 7f9fa94e1640 1 -- start start 2024-04-25T02:16:06.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa94e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa41f1170 0x7f9fa409de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa94e1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41f46f0 0x7f9fa409fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa94e1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9fa409ff50 0x7f9fa40c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa94e1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa415e630 con 0x7f9fa41f1170 2024-04-25T02:16:06.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa94e1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa40cfd90 con 0x7f9fa41f46f0 2024-04-25T02:16:06.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa94e1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa415e7b0 con 0x7f9fa409ff50 2024-04-25T02:16:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa41f1170 0x7f9fa409de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa41f1170 0x7f9fa409de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41554/0 (socket says 172.21.15.79:41554) 2024-04-25T02:16:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa2ffd640 1 -- 172.21.15.79:0/3514849273 learned_addr learned my addr 172.21.15.79:0/3514849273 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa27fc640 1 --2- 172.21.15.79:0/3514849273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41f46f0 0x7f9fa409fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa37fe640 1 --2- 172.21.15.79:0/3514849273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9fa409ff50 0x7f9fa40c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa2ffd640 1 -- 172.21.15.79:0/3514849273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9fa409ff50 msgr2=0x7f9fa40c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa2ffd640 1 --2- 172.21.15.79:0/3514849273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9fa409ff50 0x7f9fa40c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa2ffd640 1 -- 172.21.15.79:0/3514849273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41f46f0 msgr2=0x7f9fa409fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa2ffd640 1 --2- 172.21.15.79:0/3514849273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41f46f0 0x7f9fa409fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa2ffd640 1 -- 172.21.15.79:0/3514849273 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa41f4b70 con 0x7f9fa41f1170 2024-04-25T02:16:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa37fe640 1 --2- 172.21.15.79:0/3514849273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9fa409ff50 0x7f9fa40c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa2ffd640 1 --2- 172.21.15.79:0/3514849273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa41f1170 0x7f9fa409de10 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f9f94001f00 tx=0x7f9f9400a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9f8b7fe640 1 -- 172.21.15.79:0/3514849273 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94017020 con 0x7f9fa41f1170 2024-04-25T02:16:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9f8b7fe640 1 -- 172.21.15.79:0/3514849273 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f940133f0 con 0x7f9fa41f1170 2024-04-25T02:16:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa94e1640 1 -- 172.21.15.79:0/3514849273 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa40c8490 con 0x7f9fa41f1170 2024-04-25T02:16:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9f8b7fe640 1 -- 172.21.15.79:0/3514849273 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f940137e0 con 0x7f9fa41f1170 2024-04-25T02:16:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.925+0000 7f9fa94e1640 1 -- 172.21.15.79:0/3514849273 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa40c8a50 con 0x7f9fa41f1170 2024-04-25T02:16:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.926+0000 7f9fa94e1640 1 -- 172.21.15.79:0/3514849273 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa40681e0 con 0x7f9fa41f1170 2024-04-25T02:16:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.927+0000 7f9f8b7fe640 1 -- 172.21.15.79:0/3514849273 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f9401a020 con 0x7f9fa41f1170 2024-04-25T02:16:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.927+0000 7f9f8b7fe640 1 --2- 172.21.15.79:0/3514849273 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9f9006be60 0x7f9f9006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.927+0000 7f9fa27fc640 1 --2- 172.21.15.79:0/3514849273 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9f9006be60 0x7f9f9006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.927+0000 7f9f8b7fe640 1 -- 172.21.15.79:0/3514849273 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f9f9408b950 con 0x7f9fa41f1170 2024-04-25T02:16:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.928+0000 7f9fa27fc640 1 --2- 172.21.15.79:0/3514849273 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9f9006be60 0x7f9f9006e320 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40a1eb0 tx=0x7f9f98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:06.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:06.931+0000 7f9f8b7fe640 1 -- 172.21.15.79:0/3514849273 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9f94021020 con 0x7f9fa41f1170 2024-04-25T02:16:07.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.108+0000 7f9fa94e1640 1 -- 172.21.15.79:0/3514849273 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9fa40d0fe0 con 0x7f9fa41f1170 2024-04-25T02:16:07.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.109+0000 7f9f8b7fe640 1 -- 172.21.15.79:0/3514849273 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) ==== 100+0+11 (secure 0 0 0) 0x7f9f9405a390 con 0x7f9fa41f1170 2024-04-25T02:16:07.114 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:16:07.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.110+0000 7f9fa94e1640 1 -- 172.21.15.79:0/3514849273 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9f9006be60 msgr2=0x7f9f9006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:07.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.110+0000 7f9fa94e1640 1 --2- 172.21.15.79:0/3514849273 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9f9006be60 0x7f9f9006e320 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40a1eb0 tx=0x7f9f98009040 comp rx=0 tx=0).stop 2024-04-25T02:16:07.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.110+0000 7f9fa94e1640 1 -- 172.21.15.79:0/3514849273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa41f1170 msgr2=0x7f9fa409de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:07.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.110+0000 7f9fa94e1640 1 --2- 172.21.15.79:0/3514849273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa41f1170 0x7f9fa409de10 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f9f94001f00 tx=0x7f9f9400a730 comp rx=0 tx=0).stop 2024-04-25T02:16:07.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.111+0000 7f9fa94e1640 1 -- 172.21.15.79:0/3514849273 shutdown_connections 2024-04-25T02:16:07.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.111+0000 7f9fa94e1640 1 --2- 172.21.15.79:0/3514849273 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9f9006be60 0x7f9f9006e320 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.111+0000 7f9fa94e1640 1 --2- 172.21.15.79:0/3514849273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9fa409ff50 0x7f9fa40c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.111+0000 7f9fa94e1640 1 --2- 172.21.15.79:0/3514849273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41f46f0 0x7f9fa409fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.111+0000 7f9fa94e1640 1 --2- 172.21.15.79:0/3514849273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa41f1170 0x7f9fa409de10 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.111+0000 7f9fa94e1640 1 -- 172.21.15.79:0/3514849273 >> 172.21.15.79:0/3514849273 conn(0x7f9fa409d3a0 msgr2=0x7f9fa40d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:07.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.111+0000 7f9fa94e1640 1 -- 172.21.15.79:0/3514849273 shutdown_connections 2024-04-25T02:16:07.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.111+0000 7f9fa94e1640 1 -- 172.21.15.79:0/3514849273 wait complete. 2024-04-25T02:16:07.126 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:16:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.219+0000 7fc11cc3f640 1 Processor -- start 2024-04-25T02:16:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.219+0000 7fc11cc3f640 1 -- start start 2024-04-25T02:16:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11cc3f640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc11806df50 0x7fc11806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11cc3f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc118071240 0x7fc118071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11cc3f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc118070d90 con 0x7fc118144cb0 2024-04-25T02:16:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11cc3f640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc1180cf130 con 0x7fc11806df50 2024-04-25T02:16:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11cc3f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc1180cf410 con 0x7fc118071240 2024-04-25T02:16:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11659c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc118144cb0 0x7fc1180b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49186/0 (socket says 172.21.15.79:49186) 2024-04-25T02:16:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11659c640 1 -- 172.21.15.79:0/445701070 learned_addr learned my addr 172.21.15.79:0/445701070 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 -- 172.21.15.79:0/445701070 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2079275683 0 0) 0x7fc118070d90 con 0x7fc118144cb0 2024-04-25T02:16:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc115d9b640 1 --2- 172.21.15.79:0/445701070 >> v2:172.21.15.189:3300/0 conn(0x7fc11806df50 0x7fc11806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 -- 172.21.15.79:0/445701070 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc100003520 con 0x7fc118144cb0 2024-04-25T02:16:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc116d9d640 1 --2- 172.21.15.79:0/445701070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc118071240 0x7fc118071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 -- 172.21.15.79:0/445701070 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1964121660 0 0) 0x7fc100003520 con 0x7fc118144cb0 2024-04-25T02:16:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 -- 172.21.15.79:0/445701070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc118071240 msgr2=0x7fc118071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 --2- 172.21.15.79:0/445701070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc118071240 0x7fc118071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 -- 172.21.15.79:0/445701070 >> v2:172.21.15.189:3300/0 conn(0x7fc11806df50 msgr2=0x7fc11806e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 --2- 172.21.15.79:0/445701070 >> v2:172.21.15.189:3300/0 conn(0x7fc11806df50 0x7fc11806e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 -- 172.21.15.79:0/445701070 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1180cf6f0 con 0x7fc118144cb0 2024-04-25T02:16:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 -- 172.21.15.79:0/445701070 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fc108001670 con 0x7fc118144cb0 2024-04-25T02:16:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 -- 172.21.15.79:0/445701070 >> v1:172.21.15.79:6789/0 conn(0x7fc118144cb0 legacy=0x7fc1180b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 --2- 172.21.15.79:0/445701070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1000039b0 0x7fc100003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 --2- 172.21.15.79:0/445701070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc118071240 0x7fc100004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 --2- 172.21.15.79:0/445701070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc100004d40 0x7fc1000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 -- 172.21.15.79:0/445701070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc1180cf130 con 0x7fc1000039b0 2024-04-25T02:16:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 -- 172.21.15.79:0/445701070 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc1180cf410 con 0x7fc100004d40 2024-04-25T02:16:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.220+0000 7fc11559a640 1 -- 172.21.15.79:0/445701070 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc10000ba40 con 0x7fc118071240 2024-04-25T02:16:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.221+0000 7fc11659c640 1 --2- 172.21.15.79:0/445701070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1000039b0 0x7fc100003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.221+0000 7fc115d9b640 1 --2- 172.21.15.79:0/445701070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc118071240 0x7fc100004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.221+0000 7fc116d9d640 1 --2- 172.21.15.79:0/445701070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc100004d40 0x7fc1000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.221+0000 7fc11659c640 1 -- 172.21.15.79:0/445701070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc118071240 msgr2=0x7fc100004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.221+0000 7fc11659c640 1 --2- 172.21.15.79:0/445701070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc118071240 0x7fc100004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.221+0000 7fc11659c640 1 -- 172.21.15.79:0/445701070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc100004d40 msgr2=0x7fc1000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.221+0000 7fc11659c640 1 --2- 172.21.15.79:0/445701070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc100004d40 0x7fc1000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.221+0000 7fc11659c640 1 -- 172.21.15.79:0/445701070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc100003520 con 0x7fc1000039b0 2024-04-25T02:16:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.221+0000 7fc115d9b640 1 --2- 172.21.15.79:0/445701070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc118071240 0x7fc100004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.221+0000 7fc116d9d640 1 --2- 172.21.15.79:0/445701070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc100004d40 0x7fc1000051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.221+0000 7fc11659c640 1 --2- 172.21.15.79:0/445701070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1000039b0 0x7fc100003dd0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fc108007fd0 tx=0x7fc100005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09a7dcf1b0c0d2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.222+0000 7fc11559a640 1 -- 172.21.15.79:0/445701070 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108007d50 con 0x7fc1000039b0 2024-04-25T02:16:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.222+0000 7fc11559a640 1 -- 172.21.15.79:0/445701070 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc108005ad0 con 0x7fc1000039b0 2024-04-25T02:16:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.222+0000 7fc11559a640 1 -- 172.21.15.79:0/445701070 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108007070 con 0x7fc1000039b0 2024-04-25T02:16:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.222+0000 7fc11cc3f640 1 -- 172.21.15.79:0/445701070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1000039b0 msgr2=0x7fc100003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.222+0000 7fc11cc3f640 1 --2- 172.21.15.79:0/445701070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1000039b0 0x7fc100003dd0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fc108007fd0 tx=0x7fc100005830 comp rx=0 tx=0).stop 2024-04-25T02:16:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.222+0000 7fc116d9d640 1 -- 172.21.15.79:0/445701070 reap_dead start 2024-04-25T02:16:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.222+0000 7fc11cc3f640 1 -- 172.21.15.79:0/445701070 shutdown_connections 2024-04-25T02:16:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.222+0000 7fc11cc3f640 1 -- 172.21.15.79:0/445701070 >> 172.21.15.79:0/445701070 conn(0x7fc1180cfc80 msgr2=0x7fc1180d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.222+0000 7fc11cc3f640 1 -- 172.21.15.79:0/445701070 shutdown_connections 2024-04-25T02:16:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.222+0000 7fc11cc3f640 1 -- 172.21.15.79:0/445701070 wait complete. 2024-04-25T02:16:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.224+0000 7fc11cc3f640 1 Processor -- start 2024-04-25T02:16:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.224+0000 7fc11cc3f640 1 -- start start 2024-04-25T02:16:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.224+0000 7fc11cc3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1000039b0 0x7fc118155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.224+0000 7fc11cc3f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc118155c10 0x7fc1181f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.224+0000 7fc11cc3f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc118142150 0x7fc1181425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.224+0000 7fc11cc3f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc118145090 con 0x7fc1000039b0 2024-04-25T02:16:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.224+0000 7fc11cc3f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc1180cf9d0 con 0x7fc118142150 2024-04-25T02:16:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.224+0000 7fc11cc3f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc118145ab0 con 0x7fc118155c10 2024-04-25T02:16:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.224+0000 7fc11659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1000039b0 0x7fc118155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.224+0000 7fc11659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1000039b0 0x7fc118155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41572/0 (socket says 172.21.15.79:41572) 2024-04-25T02:16:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.224+0000 7fc11659c640 1 -- 172.21.15.79:0/2193754512 learned_addr learned my addr 172.21.15.79:0/2193754512 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.225+0000 7fc11659c640 1 -- 172.21.15.79:0/2193754512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc118155c10 msgr2=0x7fc1181f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.225+0000 7fc11659c640 1 --2- 172.21.15.79:0/2193754512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc118155c10 0x7fc1181f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.225+0000 7fc11659c640 1 -- 172.21.15.79:0/2193754512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc118142150 msgr2=0x7fc1181425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.225+0000 7fc11659c640 1 --2- 172.21.15.79:0/2193754512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc118142150 0x7fc1181425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.225+0000 7fc11659c640 1 -- 172.21.15.79:0/2193754512 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc118155880 con 0x7fc1000039b0 2024-04-25T02:16:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.225+0000 7fc11659c640 1 --2- 172.21.15.79:0/2193754512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1000039b0 0x7fc118155210 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fc10800c300 tx=0x7fc118067ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.225+0000 7fc106ffd640 1 -- 172.21.15.79:0/2193754512 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108042020 con 0x7fc1000039b0 2024-04-25T02:16:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.225+0000 7fc106ffd640 1 -- 172.21.15.79:0/2193754512 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc108004bf0 con 0x7fc1000039b0 2024-04-25T02:16:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.225+0000 7fc11cc3f640 1 -- 172.21.15.79:0/2193754512 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc118159240 con 0x7fc1000039b0 2024-04-25T02:16:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.225+0000 7fc106ffd640 1 -- 172.21.15.79:0/2193754512 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108001cb0 con 0x7fc1000039b0 2024-04-25T02:16:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.225+0000 7fc11cc3f640 1 -- 172.21.15.79:0/2193754512 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc118159800 con 0x7fc1000039b0 2024-04-25T02:16:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.226+0000 7fc11cc3f640 1 -- 172.21.15.79:0/2193754512 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1180690a0 con 0x7fc1000039b0 2024-04-25T02:16:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.226+0000 7fc106ffd640 1 -- 172.21.15.79:0/2193754512 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc108045020 con 0x7fc1000039b0 2024-04-25T02:16:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.227+0000 7fc106ffd640 1 --2- 172.21.15.79:0/2193754512 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc0f806be60 0x7fc0f806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.227+0000 7fc115d9b640 1 --2- 172.21.15.79:0/2193754512 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc0f806be60 0x7fc0f806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.227+0000 7fc106ffd640 1 -- 172.21.15.79:0/2193754512 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7fc1080ab040 con 0x7fc1000039b0 2024-04-25T02:16:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.227+0000 7fc115d9b640 1 --2- 172.21.15.79:0/2193754512 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc0f806be60 0x7fc0f806e320 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc118068550 tx=0x7fc10c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:07.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.231+0000 7fc106ffd640 1 -- 172.21.15.79:0/2193754512 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc108079a80 con 0x7fc1000039b0 2024-04-25T02:16:07.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.415+0000 7fc11cc3f640 1 -- 172.21.15.79:0/2193754512 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc1180d0b90 con 0x7fc1000039b0 2024-04-25T02:16:07.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.416+0000 7fc106ffd640 1 -- 172.21.15.79:0/2193754512 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v102) ==== 80+0+0 (secure 0 0 0) 0x7fc108079380 con 0x7fc1000039b0 2024-04-25T02:16:07.421 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-04-25T02:16:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.418+0000 7fc11cc3f640 1 -- 172.21.15.79:0/2193754512 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc0f806be60 msgr2=0x7fc0f806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.418+0000 7fc11cc3f640 1 --2- 172.21.15.79:0/2193754512 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc0f806be60 0x7fc0f806e320 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc118068550 tx=0x7fc10c008040 comp rx=0 tx=0).stop 2024-04-25T02:16:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.418+0000 7fc11cc3f640 1 -- 172.21.15.79:0/2193754512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1000039b0 msgr2=0x7fc118155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.418+0000 7fc11cc3f640 1 --2- 172.21.15.79:0/2193754512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1000039b0 0x7fc118155210 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fc10800c300 tx=0x7fc118067ae0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.418+0000 7fc11cc3f640 1 -- 172.21.15.79:0/2193754512 shutdown_connections 2024-04-25T02:16:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.418+0000 7fc11cc3f640 1 --2- 172.21.15.79:0/2193754512 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc0f806be60 0x7fc0f806e320 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.418+0000 7fc11cc3f640 1 --2- 172.21.15.79:0/2193754512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc118142150 0x7fc1181425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.418+0000 7fc11cc3f640 1 --2- 172.21.15.79:0/2193754512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc118155c10 0x7fc1181f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.418+0000 7fc11cc3f640 1 --2- 172.21.15.79:0/2193754512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1000039b0 0x7fc118155210 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.418+0000 7fc11cc3f640 1 -- 172.21.15.79:0/2193754512 >> 172.21.15.79:0/2193754512 conn(0x7fc1180cfc80 msgr2=0x7fc1180ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.418+0000 7fc11cc3f640 1 -- 172.21.15.79:0/2193754512 shutdown_connections 2024-04-25T02:16:07.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.418+0000 7fc11cc3f640 1 -- 172.21.15.79:0/2193754512 wait complete. 2024-04-25T02:16:07.434 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:16:07.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:07.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:16:07.466 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:16:07.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:07.466 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:16:07.521 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:16:07.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.652+0000 7f38407b7640 1 Processor -- start 2024-04-25T02:16:07.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.652+0000 7f38407b7640 1 -- start start 2024-04-25T02:16:07.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.653+0000 7f38407b7640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f383806df50 0x7f383806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:07.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.653+0000 7f38407b7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38380b2d30 0x7f38380b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:07.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.653+0000 7f38407b7640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3838071e00 con 0x7f3838143bc0 2024-04-25T02:16:07.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.653+0000 7f38407b7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f383806e8f0 con 0x7f38380b2d30 2024-04-25T02:16:07.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.653+0000 7f38407b7640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3838072cb0 con 0x7f383806df50 2024-04-25T02:16:07.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.653+0000 7f383ed54640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38380b2d30 0x7f38380b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:07.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.654+0000 7f383ed54640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38380b2d30 0x7f38380b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41576/0 (socket says 172.21.15.79:41576) 2024-04-25T02:16:07.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.654+0000 7f383ed54640 1 -- 172.21.15.79:0/929564556 learned_addr learned my addr 172.21.15.79:0/929564556 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:07.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.654+0000 7f383dd52640 1 --2- 172.21.15.79:0/929564556 >> v2:172.21.15.189:3300/0 conn(0x7f383806df50 0x7f383806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:07.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.654+0000 7f383ed54640 1 -- 172.21.15.79:0/929564556 >> v2:172.21.15.189:3300/0 conn(0x7f383806df50 msgr2=0x7f383806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:07.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.654+0000 7f383ed54640 1 --2- 172.21.15.79:0/929564556 >> v2:172.21.15.189:3300/0 conn(0x7f383806df50 0x7f383806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.654+0000 7f383ed54640 1 -- 172.21.15.79:0/929564556 >> v1:172.21.15.189:6789/0 conn(0x7f3838143bc0 legacy=0x7f383815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:07.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.654+0000 7f383ed54640 1 -- 172.21.15.79:0/929564556 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38380720a0 con 0x7f38380b2d30 2024-04-25T02:16:07.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.655+0000 7f383ed54640 1 --2- 172.21.15.79:0/929564556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38380b2d30 0x7f38380b31c0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f38380cf960 tx=0x7f383002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f8d3294bfc043c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:07.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.655+0000 7f383d551640 1 -- 172.21.15.79:0/929564556 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830036070 con 0x7f38380b2d30 2024-04-25T02:16:07.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.655+0000 7f383d551640 1 -- 172.21.15.79:0/929564556 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3830031600 con 0x7f38380b2d30 2024-04-25T02:16:07.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.655+0000 7f383d551640 1 -- 172.21.15.79:0/929564556 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38300319d0 con 0x7f38380b2d30 2024-04-25T02:16:07.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.655+0000 7f38407b7640 1 -- 172.21.15.79:0/929564556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38380b2d30 msgr2=0x7f38380b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:07.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.655+0000 7f38407b7640 1 --2- 172.21.15.79:0/929564556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38380b2d30 0x7f38380b31c0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f38380cf960 tx=0x7f383002a6a0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.655+0000 7f38407b7640 1 -- 172.21.15.79:0/929564556 shutdown_connections 2024-04-25T02:16:07.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.655+0000 7f38407b7640 1 --2- 172.21.15.79:0/929564556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38380b2d30 0x7f38380b31c0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.655+0000 7f38407b7640 1 --2- 172.21.15.79:0/929564556 >> v2:172.21.15.189:3300/0 conn(0x7f383806df50 0x7f383806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.655+0000 7f38407b7640 1 -- 172.21.15.79:0/929564556 >> 172.21.15.79:0/929564556 conn(0x7f38380cfc80 msgr2=0x7f38380d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:07.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.655+0000 7f38407b7640 1 -- 172.21.15.79:0/929564556 shutdown_connections 2024-04-25T02:16:07.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.655+0000 7f38407b7640 1 -- 172.21.15.79:0/929564556 wait complete. 2024-04-25T02:16:07.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.656+0000 7f38407b7640 1 Processor -- start 2024-04-25T02:16:07.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.656+0000 7f38407b7640 1 -- start start 2024-04-25T02:16:07.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.657+0000 7f38407b7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f383806df50 0x7f3838154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:07.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.657+0000 7f38407b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38380b2d30 0x7f38381f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:07.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.657+0000 7f38407b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3838143bc0 0x7f38381f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:07.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.657+0000 7f38407b7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3838072940 con 0x7f38380b2d30 2024-04-25T02:16:07.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.657+0000 7f38407b7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3838072660 con 0x7f3838143bc0 2024-04-25T02:16:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.657+0000 7f38407b7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3838143fa0 con 0x7f383806df50 2024-04-25T02:16:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.657+0000 7f383dd52640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38380b2d30 0x7f38381f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.657+0000 7f383dd52640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38380b2d30 0x7f38381f5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41584/0 (socket says 172.21.15.79:41584) 2024-04-25T02:16:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.657+0000 7f383dd52640 1 -- 172.21.15.79:0/556173571 learned_addr learned my addr 172.21.15.79:0/556173571 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.657+0000 7f383dd52640 1 -- 172.21.15.79:0/556173571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f383806df50 msgr2=0x7f3838154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.657+0000 7f383dd52640 1 --2- 172.21.15.79:0/556173571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f383806df50 0x7f3838154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.657+0000 7f383dd52640 1 -- 172.21.15.79:0/556173571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3838143bc0 msgr2=0x7f38381f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.657+0000 7f383dd52640 1 --2- 172.21.15.79:0/556173571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3838143bc0 0x7f38381f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.657+0000 7f383dd52640 1 -- 172.21.15.79:0/556173571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38381547d0 con 0x7f38380b2d30 2024-04-25T02:16:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.658+0000 7f383dd52640 1 --2- 172.21.15.79:0/556173571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38380b2d30 0x7f38381f5670 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f382800d620 tx=0x7f382800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.658+0000 7f382effd640 1 -- 172.21.15.79:0/556173571 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382800b620 con 0x7f38380b2d30 2024-04-25T02:16:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.658+0000 7f382effd640 1 -- 172.21.15.79:0/556173571 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3828019070 con 0x7f38380b2d30 2024-04-25T02:16:07.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.658+0000 7f382effd640 1 -- 172.21.15.79:0/556173571 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382800ba00 con 0x7f38380b2d30 2024-04-25T02:16:07.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.658+0000 7f38407b7640 1 -- 172.21.15.79:0/556173571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38381f5ec0 con 0x7f38380b2d30 2024-04-25T02:16:07.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.658+0000 7f38407b7640 1 -- 172.21.15.79:0/556173571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38381f6480 con 0x7f38380b2d30 2024-04-25T02:16:07.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.659+0000 7f38407b7640 1 -- 172.21.15.79:0/556173571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f383815caa0 con 0x7f38380b2d30 2024-04-25T02:16:07.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.659+0000 7f382effd640 1 -- 172.21.15.79:0/556173571 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f382800bba0 con 0x7f38380b2d30 2024-04-25T02:16:07.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.660+0000 7f382effd640 1 --2- 172.21.15.79:0/556173571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f381c06be30 0x7f381c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:07.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.660+0000 7f382effd640 1 -- 172.21.15.79:0/556173571 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f382808b1e0 con 0x7f38380b2d30 2024-04-25T02:16:07.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.660+0000 7f383e553640 1 --2- 172.21.15.79:0/556173571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f381c06be30 0x7f381c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:07.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.660+0000 7f383e553640 1 --2- 172.21.15.79:0/556173571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f381c06be30 0x7f381c06e2f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3834001580 tx=0x7f3834007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:07.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.664+0000 7f382effd640 1 -- 172.21.15.79:0/556173571 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f383815caa0 con 0x7f38380b2d30 2024-04-25T02:16:07.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.871+0000 7f38407b7640 1 -- 172.21.15.79:0/556173571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38381f24f0 con 0x7f38380b2d30 2024-04-25T02:16:07.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.872+0000 7f382effd640 1 -- 172.21.15.79:0/556173571 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5189 (secure 0 0 0) 0x7f38381547d0 con 0x7f38380b2d30 2024-04-25T02:16:07.877 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:07.877 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1086166830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1086166830},{"type":"v1","addr":"172.21.15.189:6834","nonce":1086166830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2468340230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2468340230},{"type":"v1","addr":"172.21.15.189:6835","nonce":2468340230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3582530322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3582530322},{"type":"v1","addr":"172.21.15.79:6836","nonce":3582530322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:15:58.363457+0000","modified":"2024-04-25T02:16:01.255271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8271":{"gid":8271,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2774759267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2774759267},{"type":"v1","addr":"172.21.15.79:6837","nonce":2774759267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8271,"qdb_cluster":[8271]},"id":7}]} 2024-04-25T02:16:07.878 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 68 2024-04-25T02:16:07.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.874+0000 7f38407b7640 1 -- 172.21.15.79:0/556173571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f381c06be30 msgr2=0x7f381c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:07.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.874+0000 7f38407b7640 1 --2- 172.21.15.79:0/556173571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f381c06be30 0x7f381c06e2f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3834001580 tx=0x7f3834007970 comp rx=0 tx=0).stop 2024-04-25T02:16:07.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.874+0000 7f38407b7640 1 -- 172.21.15.79:0/556173571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38380b2d30 msgr2=0x7f38381f5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:07.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.874+0000 7f38407b7640 1 --2- 172.21.15.79:0/556173571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38380b2d30 0x7f38381f5670 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f382800d620 tx=0x7f382800dae0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.874+0000 7f38407b7640 1 -- 172.21.15.79:0/556173571 shutdown_connections 2024-04-25T02:16:07.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.874+0000 7f38407b7640 1 --2- 172.21.15.79:0/556173571 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f381c06be30 0x7f381c06e2f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.874+0000 7f38407b7640 1 --2- 172.21.15.79:0/556173571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3838143bc0 0x7f38381f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.874+0000 7f38407b7640 1 --2- 172.21.15.79:0/556173571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38380b2d30 0x7f38381f5670 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.874+0000 7f38407b7640 1 --2- 172.21.15.79:0/556173571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f383806df50 0x7f3838154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:07.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.874+0000 7f38407b7640 1 -- 172.21.15.79:0/556173571 >> 172.21.15.79:0/556173571 conn(0x7f38380cfc80 msgr2=0x7f38380cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:07.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.874+0000 7f38407b7640 1 -- 172.21.15.79:0/556173571 shutdown_connections 2024-04-25T02:16:07.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:07.874+0000 7f38407b7640 1 -- 172.21.15.79:0/556173571 wait complete. 2024-04-25T02:16:07.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T02:16:08.016 INFO:teuthology.orchestra.run.smithi079.stdout:{"message":"","return_code":0} 2024-04-25T02:16:08.016 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T02:16:08.017 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:16:08.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.109+0000 7faecf3a0640 1 Processor -- start 2024-04-25T02:16:08.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.109+0000 7faecf3a0640 1 -- start start 2024-04-25T02:16:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.110+0000 7faecf3a0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faec813eea0 0x7faec80ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.110+0000 7faecf3a0640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faec8141ce0 0x7faec806cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.110+0000 7faecf3a0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec80ceb60 con 0x7faec80ce550 2024-04-25T02:16:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.110+0000 7faecf3a0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7faec813f280 con 0x7faec813eea0 2024-04-25T02:16:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.110+0000 7faecf3a0640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faec80cee40 con 0x7faec8141ce0 2024-04-25T02:16:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.110+0000 7faece39e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faec813eea0 0x7faec80ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.110+0000 7faecdb9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faec80ce550 0x7faec81415d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49188/0 (socket says 172.21.15.79:49188) 2024-04-25T02:16:08.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.110+0000 7faecdb9d640 1 -- 172.21.15.79:0/254282493 learned_addr learned my addr 172.21.15.79:0/254282493 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:08.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.110+0000 7faece39e640 1 -- 172.21.15.79:0/254282493 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faec8141ce0 msgr2=0x7faec806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:08.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.110+0000 7faece39e640 1 --2- 172.21.15.79:0/254282493 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faec8141ce0 0x7faec806cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.110+0000 7faecd39c640 1 -- 172.21.15.79:0/254282493 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1233504932 0 0) 0x7faec80ceb60 con 0x7faec80ce550 2024-04-25T02:16:08.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.110+0000 7faece39e640 1 -- 172.21.15.79:0/254282493 >> v1:172.21.15.79:6789/0 conn(0x7faec80ce550 legacy=0x7faec81415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.110+0000 7faece39e640 1 -- 172.21.15.79:0/254282493 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec80cf120 con 0x7faec813eea0 2024-04-25T02:16:08.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.111+0000 7faece39e640 1 --2- 172.21.15.79:0/254282493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faec813eea0 0x7faec80ce010 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7faec4009d90 tx=0x7faec402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b899e5fc22dbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:08.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.111+0000 7faecd39c640 1 -- 172.21.15.79:0/254282493 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4007740 con 0x7faec813eea0 2024-04-25T02:16:08.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.111+0000 7faecd39c640 1 -- 172.21.15.79:0/254282493 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec40078e0 con 0x7faec813eea0 2024-04-25T02:16:08.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.111+0000 7faecd39c640 1 -- 172.21.15.79:0/254282493 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4007cb0 con 0x7faec813eea0 2024-04-25T02:16:08.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.112+0000 7faecf3a0640 1 -- 172.21.15.79:0/254282493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faec813eea0 msgr2=0x7faec80ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.112+0000 7faecf3a0640 1 --2- 172.21.15.79:0/254282493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faec813eea0 0x7faec80ce010 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7faec4009d90 tx=0x7faec402a660 comp rx=0 tx=0).stop 2024-04-25T02:16:08.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.112+0000 7faecf3a0640 1 -- 172.21.15.79:0/254282493 shutdown_connections 2024-04-25T02:16:08.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.112+0000 7faecf3a0640 1 --2- 172.21.15.79:0/254282493 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faec8141ce0 0x7faec806cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.112+0000 7faecf3a0640 1 --2- 172.21.15.79:0/254282493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faec813eea0 0x7faec80ce010 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.112+0000 7faecf3a0640 1 -- 172.21.15.79:0/254282493 >> 172.21.15.79:0/254282493 conn(0x7faec80b18b0 msgr2=0x7faec80b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:08.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.112+0000 7faecf3a0640 1 -- 172.21.15.79:0/254282493 shutdown_connections 2024-04-25T02:16:08.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.112+0000 7faecf3a0640 1 -- 172.21.15.79:0/254282493 wait complete. 2024-04-25T02:16:08.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.113+0000 7faecf3a0640 1 Processor -- start 2024-04-25T02:16:08.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.113+0000 7faecf3a0640 1 -- start start 2024-04-25T02:16:08.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faecf3a0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faec80ce550 0x7faec80b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faecf3a0640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faec813eea0 0x7faec80b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faecf3a0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faec8141ce0 0x7faec815ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faecf3a0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faec81422b0 con 0x7faec8141ce0 2024-04-25T02:16:08.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faecf3a0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faec80cf6e0 con 0x7faec80ce550 2024-04-25T02:16:08.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faecf3a0640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faec8142430 con 0x7faec813eea0 2024-04-25T02:16:08.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faeceb9f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faec8141ce0 0x7faec815ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faeceb9f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faec8141ce0 0x7faec815ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41612/0 (socket says 172.21.15.79:41612) 2024-04-25T02:16:08.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faeceb9f640 1 -- 172.21.15.79:0/587969586 learned_addr learned my addr 172.21.15.79:0/587969586 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faece39e640 1 --2- 172.21.15.79:0/587969586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faec80ce550 0x7faec80b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faecdb9d640 1 --2- 172.21.15.79:0/587969586 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faec813eea0 0x7faec80b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faeceb9f640 1 -- 172.21.15.79:0/587969586 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faec813eea0 msgr2=0x7faec80b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faeceb9f640 1 --2- 172.21.15.79:0/587969586 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faec813eea0 0x7faec80b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faeceb9f640 1 -- 172.21.15.79:0/587969586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faec80ce550 msgr2=0x7faec80b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faeceb9f640 1 --2- 172.21.15.79:0/587969586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faec80ce550 0x7faec80b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faeceb9f640 1 -- 172.21.15.79:0/587969586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec80b31f0 con 0x7faec8141ce0 2024-04-25T02:16:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faeceb9f640 1 --2- 172.21.15.79:0/587969586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faec8141ce0 0x7faec815ae80 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7faec000b410 tx=0x7faec000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faebeffd640 1 -- 172.21.15.79:0/587969586 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0015020 con 0x7faec8141ce0 2024-04-25T02:16:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faebeffd640 1 -- 172.21.15.79:0/587969586 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec0011850 con 0x7faec8141ce0 2024-04-25T02:16:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faecf3a0640 1 -- 172.21.15.79:0/587969586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec81f7600 con 0x7faec8141ce0 2024-04-25T02:16:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faebeffd640 1 -- 172.21.15.79:0/587969586 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0011c40 con 0x7faec8141ce0 2024-04-25T02:16:08.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.114+0000 7faecf3a0640 1 -- 172.21.15.79:0/587969586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec81f7bc0 con 0x7faec8141ce0 2024-04-25T02:16:08.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.115+0000 7faecf3a0640 1 -- 172.21.15.79:0/587969586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec806def0 con 0x7faec8141ce0 2024-04-25T02:16:08.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.116+0000 7faebeffd640 1 -- 172.21.15.79:0/587969586 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faec0018020 con 0x7faec8141ce0 2024-04-25T02:16:08.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.116+0000 7faebeffd640 1 --2- 172.21.15.79:0/587969586 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faeac06be30 0x7faeac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.116+0000 7faebeffd640 1 -- 172.21.15.79:0/587969586 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7faec008ad50 con 0x7faec8141ce0 2024-04-25T02:16:08.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.116+0000 7faece39e640 1 --2- 172.21.15.79:0/587969586 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faeac06be30 0x7faeac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.117+0000 7faece39e640 1 --2- 172.21.15.79:0/587969586 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faeac06be30 0x7faeac06e2f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7faec4034000 tx=0x7faec402f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:08.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.121+0000 7faebeffd640 1 -- 172.21.15.79:0/587969586 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faec001f020 con 0x7faec8141ce0 2024-04-25T02:16:08.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.332+0000 7faecf3a0640 1 -- 172.21.15.79:0/587969586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faec804f5e0 con 0x7faec8141ce0 2024-04-25T02:16:08.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.333+0000 7faebeffd640 1 -- 172.21.15.79:0/587969586 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5189 (secure 0 0 0) 0x7faec00172c0 con 0x7faec8141ce0 2024-04-25T02:16:08.338 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:08.338 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1086166830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1086166830},{"type":"v1","addr":"172.21.15.189:6834","nonce":1086166830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2468340230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2468340230},{"type":"v1","addr":"172.21.15.189:6835","nonce":2468340230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3582530322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3582530322},{"type":"v1","addr":"172.21.15.79:6836","nonce":3582530322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:15:58.363457+0000","modified":"2024-04-25T02:16:01.255271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8271":{"gid":8271,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2774759267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2774759267},{"type":"v1","addr":"172.21.15.79:6837","nonce":2774759267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8271,"qdb_cluster":[8271]},"id":7}]} 2024-04-25T02:16:08.338 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 68 2024-04-25T02:16:08.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.335+0000 7faecf3a0640 1 -- 172.21.15.79:0/587969586 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faeac06be30 msgr2=0x7faeac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.335+0000 7faecf3a0640 1 --2- 172.21.15.79:0/587969586 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faeac06be30 0x7faeac06e2f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7faec4034000 tx=0x7faec402f000 comp rx=0 tx=0).stop 2024-04-25T02:16:08.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.335+0000 7faecf3a0640 1 -- 172.21.15.79:0/587969586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faec8141ce0 msgr2=0x7faec815ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.335+0000 7faecf3a0640 1 --2- 172.21.15.79:0/587969586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faec8141ce0 0x7faec815ae80 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7faec000b410 tx=0x7faec000b8d0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.335+0000 7faecf3a0640 1 -- 172.21.15.79:0/587969586 shutdown_connections 2024-04-25T02:16:08.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.335+0000 7faecf3a0640 1 --2- 172.21.15.79:0/587969586 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faeac06be30 0x7faeac06e2f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.335+0000 7faecf3a0640 1 --2- 172.21.15.79:0/587969586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faec8141ce0 0x7faec815ae80 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.335+0000 7faecf3a0640 1 --2- 172.21.15.79:0/587969586 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faec813eea0 0x7faec80b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.335+0000 7faecf3a0640 1 --2- 172.21.15.79:0/587969586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faec80ce550 0x7faec80b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.335+0000 7faecf3a0640 1 -- 172.21.15.79:0/587969586 >> 172.21.15.79:0/587969586 conn(0x7faec80b18b0 msgr2=0x7faec8141410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:08.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.335+0000 7faecf3a0640 1 -- 172.21.15.79:0/587969586 shutdown_connections 2024-04-25T02:16:08.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.335+0000 7faecf3a0640 1 -- 172.21.15.79:0/587969586 wait complete. 2024-04-25T02:16:08.351 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2024-04-25T02:16:08.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.387+0000 7faf25fc2f40 1 Processor -- start 2024-04-25T02:16:08.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.387+0000 7faf25fc2f40 1 -- start start 2024-04-25T02:16:08.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf25fc2f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56463122ba60 0x56463134b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf25fc2f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646311e5eb0 0x56463134bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf25fc2f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56463122be40 0x56463134c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf25fc2f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56463122d610 con 0x56463122ba60 2024-04-25T02:16:08.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf25fc2f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564631189640 con 0x5646311e5eb0 2024-04-25T02:16:08.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf25fc2f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5646312bb1b0 con 0x56463122be40 2024-04-25T02:16:08.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf23ac3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56463122ba60 0x56463134b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf23ac3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56463122ba60 0x56463134b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41622/0 (socket says 172.21.15.79:41622) 2024-04-25T02:16:08.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf23ac3640 1 -- 172.21.15.79:0/344913571 learned_addr learned my addr 172.21.15.79:0/344913571 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:08.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf232c2640 1 --2- 172.21.15.79:0/344913571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646311e5eb0 0x56463134bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf23ac3640 1 -- 172.21.15.79:0/344913571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56463122be40 msgr2=0x56463134c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:08.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf242c4640 1 --2- 172.21.15.79:0/344913571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56463122be40 0x56463134c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf23ac3640 1 --2- 172.21.15.79:0/344913571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56463122be40 0x56463134c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf23ac3640 1 -- 172.21.15.79:0/344913571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646311e5eb0 msgr2=0x56463134bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:08.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf23ac3640 1 --2- 172.21.15.79:0/344913571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646311e5eb0 0x56463134bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf23ac3640 1 -- 172.21.15.79:0/344913571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646312b25a0 con 0x56463122ba60 2024-04-25T02:16:08.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf232c2640 1 --2- 172.21.15.79:0/344913571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646311e5eb0 0x56463134bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:08.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.388+0000 7faf242c4640 1 --2- 172.21.15.79:0/344913571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56463122be40 0x56463134c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:08.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.389+0000 7faf23ac3640 1 --2- 172.21.15.79:0/344913571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56463122ba60 0x56463134b9b0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7faf140027c0 tx=0x7faf14002c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118f3d30dfb816d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:08.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.389+0000 7faf222c0640 1 -- 172.21.15.79:0/344913571 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf14017070 con 0x56463122ba60 2024-04-25T02:16:08.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.389+0000 7faf222c0640 1 -- 172.21.15.79:0/344913571 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1400f9e0 con 0x56463122ba60 2024-04-25T02:16:08.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.389+0000 7faf222c0640 1 -- 172.21.15.79:0/344913571 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1400fd90 con 0x56463122ba60 2024-04-25T02:16:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.389+0000 7faf25fc2f40 1 -- 172.21.15.79:0/344913571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56463122ba60 msgr2=0x56463134b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.389+0000 7faf25fc2f40 1 --2- 172.21.15.79:0/344913571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56463122ba60 0x56463134b9b0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7faf140027c0 tx=0x7faf14002c80 comp rx=0 tx=0).stop 2024-04-25T02:16:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.389+0000 7faf25fc2f40 1 -- 172.21.15.79:0/344913571 shutdown_connections 2024-04-25T02:16:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.389+0000 7faf25fc2f40 1 --2- 172.21.15.79:0/344913571 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56463122be40 0x56463134c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.389+0000 7faf25fc2f40 1 --2- 172.21.15.79:0/344913571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646311e5eb0 0x56463134bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.389+0000 7faf25fc2f40 1 --2- 172.21.15.79:0/344913571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56463122ba60 0x56463134b9b0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.389+0000 7faf25fc2f40 1 -- 172.21.15.79:0/344913571 >> 172.21.15.79:0/344913571 conn(0x56463120d990 msgr2=0x5646312bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.389+0000 7faf25fc2f40 1 -- 172.21.15.79:0/344913571 shutdown_connections 2024-04-25T02:16:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.389+0000 7faf25fc2f40 1 -- 172.21.15.79:0/344913571 wait complete. 2024-04-25T02:16:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.390+0000 7faf25fc2f40 1 Processor -- start 2024-04-25T02:16:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.390+0000 7faf25fc2f40 1 -- start start 2024-04-25T02:16:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.390+0000 7faf25fc2f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56463122ba60 0x5646312b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.390+0000 7faf25fc2f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56463122be40 0x564631347b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.390+0000 7faf25fc2f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646311e2d80 0x5646311e41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.390+0000 7faf25fc2f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5646312b2810 con 0x5646311e2d80 2024-04-25T02:16:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.390+0000 7faf25fc2f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564631212380 con 0x56463122be40 2024-04-25T02:16:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.390+0000 7faf25fc2f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56463122c4d0 con 0x56463122ba60 2024-04-25T02:16:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf242c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646311e2d80 0x5646311e41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf242c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646311e2d80 0x5646311e41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41626/0 (socket says 172.21.15.79:41626) 2024-04-25T02:16:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf242c4640 1 -- 172.21.15.79:0/358346010 learned_addr learned my addr 172.21.15.79:0/358346010 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf232c2640 1 --2- 172.21.15.79:0/358346010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56463122be40 0x564631347b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf23ac3640 1 --2- 172.21.15.79:0/358346010 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56463122ba60 0x5646312b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf242c4640 1 -- 172.21.15.79:0/358346010 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56463122ba60 msgr2=0x5646312b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf242c4640 1 --2- 172.21.15.79:0/358346010 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56463122ba60 0x5646312b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf242c4640 1 -- 172.21.15.79:0/358346010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56463122be40 msgr2=0x564631347b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf242c4640 1 --2- 172.21.15.79:0/358346010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56463122be40 0x564631347b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf242c4640 1 -- 172.21.15.79:0/358346010 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646311e5750 con 0x5646311e2d80 2024-04-25T02:16:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf242c4640 1 --2- 172.21.15.79:0/358346010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646311e2d80 0x5646311e41f0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0018e0 tx=0x7faf1c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf212be640 1 -- 172.21.15.79:0/358346010 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c009760 con 0x5646311e2d80 2024-04-25T02:16:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf212be640 1 -- 172.21.15.79:0/358346010 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1c068070 con 0x5646311e2d80 2024-04-25T02:16:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf25fc2f40 1 -- 172.21.15.79:0/358346010 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646312b1290 con 0x5646311e2d80 2024-04-25T02:16:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf212be640 1 -- 172.21.15.79:0/358346010 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c061840 con 0x5646311e2d80 2024-04-25T02:16:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.391+0000 7faf25fc2f40 1 -- 172.21.15.79:0/358346010 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646312b1850 con 0x5646311e2d80 2024-04-25T02:16:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.393+0000 7faf212be640 1 -- 172.21.15.79:0/358346010 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf1c05e040 con 0x5646311e2d80 2024-04-25T02:16:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.393+0000 7faf212be640 1 --2- 172.21.15.79:0/358346010 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf0406a810 0x7faf0406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.393+0000 7faf212be640 1 -- 172.21.15.79:0/358346010 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7faf1c0ce210 con 0x5646311e2d80 2024-04-25T02:16:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.393+0000 7faf23ac3640 1 --2- 172.21.15.79:0/358346010 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf0406a810 0x7faf0406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.393+0000 7faf25fc2f40 1 --2- 172.21.15.79:0/358346010 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5646312bd470 0x5646312bd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.393+0000 7faf25fc2f40 1 -- 172.21.15.79:0/358346010 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e102) -- 0x564631229a10 con 0x5646312bd470 2024-04-25T02:16:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.393+0000 7faf232c2640 1 --2- 172.21.15.79:0/358346010 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5646312bd470 0x5646312bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.393+0000 7faf23ac3640 1 --2- 172.21.15.79:0/358346010 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf0406a810 0x7faf0406ccd0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7faf140027c0 tx=0x7faf1401f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.393+0000 7faf232c2640 1 --2- 172.21.15.79:0/358346010 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5646312bd470 0x5646312bd850 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.394+0000 7faf232c2640 1 -- 172.21.15.79:0/358346010 <== osd.2 v2:172.21.15.79:6800/3397511354 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x7faf0c007950 con 0x5646312bd470 2024-04-25T02:16:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.394+0000 7faf25fc2f40 1 -- 172.21.15.79:0/358346010 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5646312bd470 msgr2=0x5646312bd850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.394+0000 7faf25fc2f40 1 --2- 172.21.15.79:0/358346010 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5646312bd470 0x5646312bd850 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.394+0000 7faf25fc2f40 1 -- 172.21.15.79:0/358346010 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf0406a810 msgr2=0x7faf0406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.394+0000 7faf25fc2f40 1 --2- 172.21.15.79:0/358346010 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf0406a810 0x7faf0406ccd0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7faf140027c0 tx=0x7faf1401f040 comp rx=0 tx=0).stop 2024-04-25T02:16:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.394+0000 7faf25fc2f40 1 -- 172.21.15.79:0/358346010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646311e2d80 msgr2=0x5646311e41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.394+0000 7faf25fc2f40 1 --2- 172.21.15.79:0/358346010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646311e2d80 0x5646311e41f0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0018e0 tx=0x7faf1c001a40 comp rx=0 tx=0).stop 2024-04-25T02:16:08.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.394+0000 7faf242c4640 1 -- 172.21.15.79:0/358346010 reap_dead start 2024-04-25T02:16:08.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.394+0000 7faf25fc2f40 1 -- 172.21.15.79:0/358346010 shutdown_connections 2024-04-25T02:16:08.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.394+0000 7faf25fc2f40 1 -- 172.21.15.79:0/358346010 >> 172.21.15.79:0/358346010 conn(0x56463120d990 msgr2=0x56463134c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:08.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.394+0000 7faf25fc2f40 1 -- 172.21.15.79:0/358346010 shutdown_connections 2024-04-25T02:16:08.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.394+0000 7faf25fc2f40 1 -- 172.21.15.79:0/358346010 wait complete. 2024-04-25T02:16:08.408 INFO:teuthology.orchestra.run.smithi079.stdout:����� 2024-04-25T02:16:08.408 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:16:08.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.541+0000 7f4f605a9640 1 Processor -- start 2024-04-25T02:16:08.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.541+0000 7f4f605a9640 1 -- start start 2024-04-25T02:16:08.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f605a9640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f4f58143bc0 0x7f4f5815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f605a9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f5806df50 0x7f4f5806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f605a9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5815fa40 con 0x7f4f580b48e0 2024-04-25T02:16:08.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f605a9640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f4f5806e8f0 con 0x7f4f58143bc0 2024-04-25T02:16:08.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f605a9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4f58072cb0 con 0x7f4f5806df50 2024-04-25T02:16:08.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f5e345640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f4f58143bc0 0x7f4f5815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f5db44640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f5806df50 0x7f4f5806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f5eb46640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f4f580b48e0 0x7f4f580b4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:54248/0 (socket says 172.21.15.79:54248) 2024-04-25T02:16:08.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f5eb46640 1 -- 172.21.15.79:0/1191622762 learned_addr learned my addr 172.21.15.79:0/1191622762 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:08.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f5d343640 1 -- 172.21.15.79:0/1191622762 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3254665567 0 0) 0x7f4f50001490 con 0x7f4f580b48e0 2024-04-25T02:16:08.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f5d343640 1 -- 172.21.15.79:0/1191622762 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f44003520 con 0x7f4f580b48e0 2024-04-25T02:16:08.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f5db44640 1 -- 172.21.15.79:0/1191622762 >> v2:172.21.15.189:3300/0 conn(0x7f4f58143bc0 msgr2=0x7f4f5815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:08.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f5db44640 1 --2- 172.21.15.79:0/1191622762 >> v2:172.21.15.189:3300/0 conn(0x7f4f58143bc0 0x7f4f5815f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f5db44640 1 -- 172.21.15.79:0/1191622762 >> v1:172.21.15.189:6789/0 conn(0x7f4f580b48e0 legacy=0x7f4f580b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f5db44640 1 -- 172.21.15.79:0/1191622762 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f58071e00 con 0x7f4f5806df50 2024-04-25T02:16:08.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.542+0000 7f4f5e345640 1 --2- 172.21.15.79:0/1191622762 >> v2:172.21.15.189:3300/0 conn(0x7f4f58143bc0 0x7f4f5815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:16:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.543+0000 7f4f5db44640 1 --2- 172.21.15.79:0/1191622762 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f5806df50 0x7f4f5806e3b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4f480097a0 tx=0x7f4f4802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ee0bcae6d864474 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.543+0000 7f4f5d343640 1 -- 172.21.15.79:0/1191622762 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f48037070 con 0x7f4f5806df50 2024-04-25T02:16:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.543+0000 7f4f5d343640 1 -- 172.21.15.79:0/1191622762 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f4802ae50 con 0x7f4f5806df50 2024-04-25T02:16:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.543+0000 7f4f5d343640 1 -- 172.21.15.79:0/1191622762 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f48032640 con 0x7f4f5806df50 2024-04-25T02:16:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.544+0000 7f4f605a9640 1 -- 172.21.15.79:0/1191622762 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f5806df50 msgr2=0x7f4f5806e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.544+0000 7f4f605a9640 1 --2- 172.21.15.79:0/1191622762 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f5806df50 0x7f4f5806e3b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4f480097a0 tx=0x7f4f4802a100 comp rx=0 tx=0).stop 2024-04-25T02:16:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.544+0000 7f4f605a9640 1 -- 172.21.15.79:0/1191622762 shutdown_connections 2024-04-25T02:16:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.544+0000 7f4f605a9640 1 --2- 172.21.15.79:0/1191622762 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f5806df50 0x7f4f5806e3b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.544+0000 7f4f605a9640 1 --2- 172.21.15.79:0/1191622762 >> v2:172.21.15.189:3300/0 conn(0x7f4f58143bc0 0x7f4f5815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.544+0000 7f4f605a9640 1 -- 172.21.15.79:0/1191622762 >> 172.21.15.79:0/1191622762 conn(0x7f4f580cfc80 msgr2=0x7f4f580d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:08.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.544+0000 7f4f605a9640 1 -- 172.21.15.79:0/1191622762 shutdown_connections 2024-04-25T02:16:08.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.544+0000 7f4f605a9640 1 -- 172.21.15.79:0/1191622762 wait complete. 2024-04-25T02:16:08.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.545+0000 7f4f605a9640 1 Processor -- start 2024-04-25T02:16:08.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.545+0000 7f4f605a9640 1 -- start start 2024-04-25T02:16:08.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f605a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5806df50 0x7f4f580c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f605a9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f580b48e0 0x7f4f58070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f605a9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f58143bc0 0x7f4f58071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f605a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4f58072660 con 0x7f4f5806df50 2024-04-25T02:16:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f605a9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4f58072380 con 0x7f4f580b48e0 2024-04-25T02:16:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f605a9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4f58072940 con 0x7f4f58143bc0 2024-04-25T02:16:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f5e345640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5806df50 0x7f4f580c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f5e345640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5806df50 0x7f4f580c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41640/0 (socket says 172.21.15.79:41640) 2024-04-25T02:16:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f5e345640 1 -- 172.21.15.79:0/1608743202 learned_addr learned my addr 172.21.15.79:0/1608743202 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f5db44640 1 --2- 172.21.15.79:0/1608743202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f580b48e0 0x7f4f58070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f5eb46640 1 --2- 172.21.15.79:0/1608743202 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f58143bc0 0x7f4f58071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f5e345640 1 -- 172.21.15.79:0/1608743202 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f58143bc0 msgr2=0x7f4f58071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f5e345640 1 --2- 172.21.15.79:0/1608743202 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f58143bc0 0x7f4f58071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f5e345640 1 -- 172.21.15.79:0/1608743202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f580b48e0 msgr2=0x7f4f58070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f5e345640 1 --2- 172.21.15.79:0/1608743202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f580b48e0 0x7f4f58070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f5e345640 1 -- 172.21.15.79:0/1608743202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f580acb30 con 0x7f4f5806df50 2024-04-25T02:16:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f5e345640 1 --2- 172.21.15.79:0/1608743202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5806df50 0x7f4f580c5360 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400ebe0 tx=0x7f4f5400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.546+0000 7f4f4effd640 1 -- 172.21.15.79:0/1608743202 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54017070 con 0x7f4f5806df50 2024-04-25T02:16:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.547+0000 7f4f4effd640 1 -- 172.21.15.79:0/1608743202 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f5400cc30 con 0x7f4f5806df50 2024-04-25T02:16:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.547+0000 7f4f605a9640 1 -- 172.21.15.79:0/1608743202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f580ac560 con 0x7f4f5806df50 2024-04-25T02:16:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.547+0000 7f4f4effd640 1 -- 172.21.15.79:0/1608743202 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54013470 con 0x7f4f5806df50 2024-04-25T02:16:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.547+0000 7f4f605a9640 1 -- 172.21.15.79:0/1608743202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f5814df80 con 0x7f4f5806df50 2024-04-25T02:16:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.547+0000 7f4f605a9640 1 -- 172.21.15.79:0/1608743202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f580690a0 con 0x7f4f5806df50 2024-04-25T02:16:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.548+0000 7f4f4effd640 1 -- 172.21.15.79:0/1608743202 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f5401a070 con 0x7f4f5806df50 2024-04-25T02:16:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.548+0000 7f4f4effd640 1 --2- 172.21.15.79:0/1608743202 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f3c06be30 0x7f4f3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:08.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.548+0000 7f4f4effd640 1 -- 172.21.15.79:0/1608743202 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f4f5408ad30 con 0x7f4f5806df50 2024-04-25T02:16:08.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.548+0000 7f4f5db44640 1 --2- 172.21.15.79:0/1608743202 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f3c06be30 0x7f4f3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:08.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.549+0000 7f4f5db44640 1 --2- 172.21.15.79:0/1608743202 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f3c06be30 0x7f4f3c06e2f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4f48034000 tx=0x7f4f4802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:08.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.553+0000 7f4f4effd640 1 -- 172.21.15.79:0/1608743202 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4f580acb30 con 0x7f4f5806df50 2024-04-25T02:16:08.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.762+0000 7f4f605a9640 1 -- 172.21.15.79:0/1608743202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4f5806dd10 con 0x7f4f5806df50 2024-04-25T02:16:08.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.762+0000 7f4f4effd640 1 -- 172.21.15.79:0/1608743202 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7f4f54059770 con 0x7f4f5806df50 2024-04-25T02:16:08.768 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:16:08.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.764+0000 7f4f605a9640 1 -- 172.21.15.79:0/1608743202 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f3c06be30 msgr2=0x7f4f3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.764+0000 7f4f605a9640 1 --2- 172.21.15.79:0/1608743202 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f3c06be30 0x7f4f3c06e2f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4f48034000 tx=0x7f4f4802e000 comp rx=0 tx=0).stop 2024-04-25T02:16:08.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.764+0000 7f4f605a9640 1 -- 172.21.15.79:0/1608743202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5806df50 msgr2=0x7f4f580c5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:08.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.764+0000 7f4f605a9640 1 --2- 172.21.15.79:0/1608743202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5806df50 0x7f4f580c5360 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400ebe0 tx=0x7f4f5400c520 comp rx=0 tx=0).stop 2024-04-25T02:16:08.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.764+0000 7f4f605a9640 1 -- 172.21.15.79:0/1608743202 shutdown_connections 2024-04-25T02:16:08.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.764+0000 7f4f605a9640 1 --2- 172.21.15.79:0/1608743202 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4f3c06be30 0x7f4f3c06e2f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.764+0000 7f4f605a9640 1 --2- 172.21.15.79:0/1608743202 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f58143bc0 0x7f4f58071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.764+0000 7f4f605a9640 1 --2- 172.21.15.79:0/1608743202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f580b48e0 0x7f4f58070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.764+0000 7f4f605a9640 1 --2- 172.21.15.79:0/1608743202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5806df50 0x7f4f580c5360 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:08.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.764+0000 7f4f605a9640 1 -- 172.21.15.79:0/1608743202 >> 172.21.15.79:0/1608743202 conn(0x7f4f580cfc80 msgr2=0x7f4f580ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:08.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.764+0000 7f4f605a9640 1 -- 172.21.15.79:0/1608743202 shutdown_connections 2024-04-25T02:16:08.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08.764+0000 7f4f605a9640 1 -- 172.21.15.79:0/1608743202 wait complete. 2024-04-25T02:16:08.780 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:16:08.780 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:16:08.780 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:16:08.780 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:16:08.780 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:16:08.780 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:16:08.780 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:16:08.780 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:16:08.780 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:16:08.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:08.781 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:16:08.795 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:16:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:16:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:16:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:16:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:16:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:16:08.796 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:16:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:16:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:16:08.796 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:16:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:16:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:16:08.796 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:16:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:16:08.796 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:16:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:16:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:16:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42237sec preferred_lft 42237sec 2024-04-25T02:16:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:16:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:16:08.797 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:16:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:16:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:16:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:16:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:16:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:16:08.797 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:16:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:16:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link 2024-04-25T02:16:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:16:08.797 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:16:08.798 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:16:08.798 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::4c:adff:fe56:7194/64 scope link 2024-04-25T02:16:08.798 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:16:08.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:08.798 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:16:08.858 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:16:08.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:08.859 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:16:08.915 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:16:08.915 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:16:08.915 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:16:08.915 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:16:08.916 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:16:08.916 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:16:08.916 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:16:08.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:16:08.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:16:08.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:16:08.916 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:16:09.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:16:09.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:16:09.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:09.039 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:16:09.054 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:16:09.054 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:16:09.054 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:16:09.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:09.054 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:16:09.118 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:16:09.118 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:16:09.173 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:16:09.174 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:16:09.174 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:16:09.228 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:16:09.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:09.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:16:09.310 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:16:09.311 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:16:09.311 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:16:09.319 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:16:09.319 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:16:09.319 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:16:09.319 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:16:09.319 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:16:09.329 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:16:09.330 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:16:09.330 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:16:09.330 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:16:09.330 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:16:09.330 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:16:09.330 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:16:09.330 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:16:09.330 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:16:09.331 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:16:09.331 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:16:09.331 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:16:09.331 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:16:09.332 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:16:09.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:09.332 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:16:09.398 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:16:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:16:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:16:09.492 INFO:teuthology.orchestra.run.smithi079.stdout:client6248 2024-04-25T02:16:09.492 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:16:09.492 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:16:09.507 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:16:09.507 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:16:09.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:09.563 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T02:16:09.656 INFO:teuthology.orchestra.run.smithi079.stderr:6+0 records in 2024-04-25T02:16:09.656 INFO:teuthology.orchestra.run.smithi079.stderr:6+0 records out 2024-04-25T02:16:09.656 INFO:teuthology.orchestra.run.smithi079.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0366366 s, 172 MB/s 2024-04-25T02:16:09.657 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:16:09.657 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:16:09.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:09.672 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T02:16:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:6+0 records in 2024-04-25T02:16:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:6+0 records out 2024-04-25T02:16:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0335794 s, 187 MB/s 2024-04-25T02:16:09.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:09.762 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T02:16:09.778 INFO:teuthology.orchestra.run.smithi079.stdout:./ 2024-04-25T02:16:09.778 INFO:teuthology.orchestra.run.smithi079.stdout:./file2_sixmegs 2024-04-25T02:16:09.778 INFO:teuthology.orchestra.run.smithi079.stdout:./file3_sixmegs 2024-04-25T02:16:09.778 INFO:teuthology.orchestra.run.smithi079.stdout:./file1_sixmegs 2024-04-25T02:16:09.778 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:16:09.778 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:16:09.778 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:16:09.779 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:16:09.779 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T02:16:09.779 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:16:09.882 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:16:09.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:16:09.890 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:16:09.891 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:16:09.891 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:16:09.891 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:16:09.891 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2024-04-25T02:16:09.891 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:16:09.995 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627777 2024-04-25T02:16:09.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:16:10.004 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:16:10.004 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:16:10.004 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:16:10.004 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:16:10.004 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2024-04-25T02:16:10.004 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:16:10.110 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627778 2024-04-25T02:16:10.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:16:10.119 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:16:10.119 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:16:10.119 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:16:10.119 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:16:10.119 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2024-04-25T02:16:10.119 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:16:10.224 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627776 2024-04-25T02:16:10.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:16:10.233 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:16:10.233 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:16:10.289 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:16:10.289 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:16:10.345 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:16:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.475+0000 7fe147342640 1 Processor -- start 2024-04-25T02:16:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.475+0000 7fe147342640 1 -- start start 2024-04-25T02:16:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.476+0000 7fe147342640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe14006df50 0x7fe14006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.476+0000 7fe147342640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe1400b2d30 0x7fe1400b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.476+0000 7fe147342640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe140071e00 con 0x7fe140143bc0 2024-04-25T02:16:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.476+0000 7fe147342640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe14006e8f0 con 0x7fe14006df50 2024-04-25T02:16:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.476+0000 7fe147342640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe140072cb0 con 0x7fe1400b2d30 2024-04-25T02:16:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.476+0000 7fe1448dd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe14006df50 0x7fe14006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.476+0000 7fe1448dd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe14006df50 0x7fe14006e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41642/0 (socket says 172.21.15.79:41642) 2024-04-25T02:16:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.476+0000 7fe1448dd640 1 -- 172.21.15.79:0/1941857988 learned_addr learned my addr 172.21.15.79:0/1941857988 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.476+0000 7fe1458df640 1 --2- 172.21.15.79:0/1941857988 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe1400b2d30 0x7fe1400b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.476+0000 7fe1448dd640 1 -- 172.21.15.79:0/1941857988 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe1400b2d30 msgr2=0x7fe1400b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.476+0000 7fe1448dd640 1 --2- 172.21.15.79:0/1941857988 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe1400b2d30 0x7fe1400b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.476+0000 7fe1448dd640 1 -- 172.21.15.79:0/1941857988 >> v1:172.21.15.189:6789/0 conn(0x7fe140143bc0 legacy=0x7fe14015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.476+0000 7fe1448dd640 1 -- 172.21.15.79:0/1941857988 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1400720a0 con 0x7fe14006df50 2024-04-25T02:16:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.477+0000 7fe1448dd640 1 --2- 172.21.15.79:0/1941857988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14006df50 0x7fe14006e3b0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fe130009870 tx=0x7fe13002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5374ccd2e4948a32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.477+0000 7fe137fff640 1 -- 172.21.15.79:0/1941857988 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130037070 con 0x7fe14006df50 2024-04-25T02:16:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.477+0000 7fe137fff640 1 -- 172.21.15.79:0/1941857988 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe130032440 con 0x7fe14006df50 2024-04-25T02:16:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.477+0000 7fe137fff640 1 -- 172.21.15.79:0/1941857988 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130032810 con 0x7fe14006df50 2024-04-25T02:16:10.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.478+0000 7fe147342640 1 -- 172.21.15.79:0/1941857988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14006df50 msgr2=0x7fe14006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:10.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.478+0000 7fe147342640 1 --2- 172.21.15.79:0/1941857988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14006df50 0x7fe14006e3b0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fe130009870 tx=0x7fe13002a1c0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.478+0000 7fe147342640 1 -- 172.21.15.79:0/1941857988 shutdown_connections 2024-04-25T02:16:10.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.478+0000 7fe147342640 1 --2- 172.21.15.79:0/1941857988 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe1400b2d30 0x7fe1400b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.478+0000 7fe147342640 1 --2- 172.21.15.79:0/1941857988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14006df50 0x7fe14006e3b0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.478+0000 7fe147342640 1 -- 172.21.15.79:0/1941857988 >> 172.21.15.79:0/1941857988 conn(0x7fe1400cfc80 msgr2=0x7fe1400d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:10.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.478+0000 7fe147342640 1 -- 172.21.15.79:0/1941857988 shutdown_connections 2024-04-25T02:16:10.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.478+0000 7fe147342640 1 -- 172.21.15.79:0/1941857988 wait complete. 2024-04-25T02:16:10.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.479+0000 7fe147342640 1 Processor -- start 2024-04-25T02:16:10.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.479+0000 7fe147342640 1 -- start start 2024-04-25T02:16:10.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe147342640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe14006df50 0x7fe140157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:10.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe147342640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1400b2d30 0x7fe14013e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:10.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe147342640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe140143bc0 0x7fe140140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:10.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe147342640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe140072940 con 0x7fe1400b2d30 2024-04-25T02:16:10.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe147342640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe140072660 con 0x7fe14006df50 2024-04-25T02:16:10.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe147342640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe140143fa0 con 0x7fe140143bc0 2024-04-25T02:16:10.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe1448dd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1400b2d30 0x7fe14013e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:10.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe1448dd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1400b2d30 0x7fe14013e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41658/0 (socket says 172.21.15.79:41658) 2024-04-25T02:16:10.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe1448dd640 1 -- 172.21.15.79:0/2364947416 learned_addr learned my addr 172.21.15.79:0/2364947416 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:10.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe1448dd640 1 -- 172.21.15.79:0/2364947416 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe140143bc0 msgr2=0x7fe140140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:10.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe1448dd640 1 --2- 172.21.15.79:0/2364947416 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe140143bc0 0x7fe140140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe1448dd640 1 -- 172.21.15.79:0/2364947416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe14006df50 msgr2=0x7fe140157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:10.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe1448dd640 1 --2- 172.21.15.79:0/2364947416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe14006df50 0x7fe140157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe1448dd640 1 -- 172.21.15.79:0/2364947416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe140157c60 con 0x7fe1400b2d30 2024-04-25T02:16:10.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe1448dd640 1 --2- 172.21.15.79:0/2364947416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1400b2d30 0x7fe14013e180 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fe130000c00 tx=0x7fe1300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:10.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe135ffb640 1 -- 172.21.15.79:0/2364947416 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130041020 con 0x7fe1400b2d30 2024-04-25T02:16:10.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe135ffb640 1 -- 172.21.15.79:0/2364947416 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1300306c0 con 0x7fe1400b2d30 2024-04-25T02:16:10.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe135ffb640 1 -- 172.21.15.79:0/2364947416 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130037040 con 0x7fe1400b2d30 2024-04-25T02:16:10.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.480+0000 7fe147342640 1 -- 172.21.15.79:0/2364947416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14013ea80 con 0x7fe1400b2d30 2024-04-25T02:16:10.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.481+0000 7fe147342640 1 -- 172.21.15.79:0/2364947416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe14013f040 con 0x7fe1400b2d30 2024-04-25T02:16:10.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.482+0000 7fe147342640 1 -- 172.21.15.79:0/2364947416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1400690a0 con 0x7fe1400b2d30 2024-04-25T02:16:10.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.482+0000 7fe135ffb640 1 -- 172.21.15.79:0/2364947416 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe130044020 con 0x7fe1400b2d30 2024-04-25T02:16:10.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.483+0000 7fe135ffb640 1 --2- 172.21.15.79:0/2364947416 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe12406be30 0x7fe12406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:10.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.483+0000 7fe1450de640 1 --2- 172.21.15.79:0/2364947416 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe12406be30 0x7fe12406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:10.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.483+0000 7fe135ffb640 1 -- 172.21.15.79:0/2364947416 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7fe1300ab680 con 0x7fe1400b2d30 2024-04-25T02:16:10.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.483+0000 7fe1450de640 1 --2- 172.21.15.79:0/2364947416 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe12406be30 0x7fe12406e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe13c000f60 tx=0x7fe13c0079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:10.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.487+0000 7fe135ffb640 1 -- 172.21.15.79:0/2364947416 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe13004b030 con 0x7fe1400b2d30 2024-04-25T02:16:10.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.660+0000 7fe147342640 1 -- 172.21.15.79:0/2364947416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1400cef50 con 0x7fe1400b2d30 2024-04-25T02:16:10.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.661+0000 7fe135ffb640 1 -- 172.21.15.79:0/2364947416 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16631 (secure 0 0 0) 0x7fe13007a030 con 0x7fe1400b2d30 2024-04-25T02:16:10.666 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:10.666 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":102,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:16:00.025323+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:15:56.581482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T02:15:57.334060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:16:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.663+0000 7fe147342640 1 -- 172.21.15.79:0/2364947416 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe12406be30 msgr2=0x7fe12406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.663+0000 7fe147342640 1 --2- 172.21.15.79:0/2364947416 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe12406be30 0x7fe12406e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe13c000f60 tx=0x7fe13c0079d0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.663+0000 7fe147342640 1 -- 172.21.15.79:0/2364947416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1400b2d30 msgr2=0x7fe14013e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.663+0000 7fe147342640 1 --2- 172.21.15.79:0/2364947416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1400b2d30 0x7fe14013e180 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fe130000c00 tx=0x7fe1300046c0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.663+0000 7fe147342640 1 -- 172.21.15.79:0/2364947416 shutdown_connections 2024-04-25T02:16:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.663+0000 7fe147342640 1 --2- 172.21.15.79:0/2364947416 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe12406be30 0x7fe12406e2f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.663+0000 7fe147342640 1 --2- 172.21.15.79:0/2364947416 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe140143bc0 0x7fe140140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.663+0000 7fe147342640 1 --2- 172.21.15.79:0/2364947416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1400b2d30 0x7fe14013e180 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.663+0000 7fe147342640 1 --2- 172.21.15.79:0/2364947416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe14006df50 0x7fe140157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.663+0000 7fe147342640 1 -- 172.21.15.79:0/2364947416 >> 172.21.15.79:0/2364947416 conn(0x7fe1400cfc80 msgr2=0x7fe1400d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.663+0000 7fe147342640 1 -- 172.21.15.79:0/2364947416 shutdown_connections 2024-04-25T02:16:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.663+0000 7fe147342640 1 -- 172.21.15.79:0/2364947416 wait complete. 2024-04-25T02:16:10.679 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:15:56.581482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:15:57.334060+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:16:10.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:16:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.773+0000 7f0e3b590640 1 Processor -- start 2024-04-25T02:16:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.773+0000 7f0e3b590640 1 -- start start 2024-04-25T02:16:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.774+0000 7f0e3b590640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e340b41b0 0x7f0e341605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.774+0000 7f0e3b590640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f0e3406b2f0 0x7f0e3406b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.774+0000 7f0e3b590640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e34071cd0 con 0x7f0e34155f00 2024-04-25T02:16:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.774+0000 7f0e3b590640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f0e34071fb0 con 0x7f0e3406b2f0 2024-04-25T02:16:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.774+0000 7f0e3b590640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0e34072290 con 0x7f0e340b41b0 2024-04-25T02:16:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.774+0000 7f0e39b2d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0e34155f00 0x7f0e34156370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49208/0 (socket says 172.21.15.79:49208) 2024-04-25T02:16:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.774+0000 7f0e39b2d640 1 -- 172.21.15.79:0/512465037 learned_addr learned my addr 172.21.15.79:0/512465037 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.774+0000 7f0e2bfff640 1 -- 172.21.15.79:0/512465037 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4123170623 0 0) 0x7f0e34071cd0 con 0x7f0e34155f00 2024-04-25T02:16:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.774+0000 7f0e2bfff640 1 -- 172.21.15.79:0/512465037 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e20003520 con 0x7f0e34155f00 2024-04-25T02:16:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e3932c640 1 --2- 172.21.15.79:0/512465037 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e340b41b0 0x7f0e341605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e38b2b640 1 --2- 172.21.15.79:0/512465037 >> v2:172.21.15.189:3300/0 conn(0x7f0e3406b2f0 0x7f0e3406b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e2bfff640 1 -- 172.21.15.79:0/512465037 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2256691181 0 0) 0x7f0e20003520 con 0x7f0e34155f00 2024-04-25T02:16:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e2bfff640 1 -- 172.21.15.79:0/512465037 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e340b41b0 msgr2=0x7f0e341605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e2bfff640 1 --2- 172.21.15.79:0/512465037 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e340b41b0 0x7f0e341605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e2bfff640 1 -- 172.21.15.79:0/512465037 >> v2:172.21.15.189:3300/0 conn(0x7f0e3406b2f0 msgr2=0x7f0e3406b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e2bfff640 1 --2- 172.21.15.79:0/512465037 >> v2:172.21.15.189:3300/0 conn(0x7f0e3406b2f0 0x7f0e3406b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e2bfff640 1 -- 172.21.15.79:0/512465037 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e34072570 con 0x7f0e34155f00 2024-04-25T02:16:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e2bfff640 1 -- 172.21.15.79:0/512465037 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f0e2c0019f0 con 0x7f0e34155f00 2024-04-25T02:16:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e3932c640 1 --2- 172.21.15.79:0/512465037 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e340b41b0 0x7f0e341605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e2bfff640 1 -- 172.21.15.79:0/512465037 >> v1:172.21.15.79:6789/0 conn(0x7f0e34155f00 legacy=0x7f0e34156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e2bfff640 1 --2- 172.21.15.79:0/512465037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e200039b0 0x7f0e20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e2bfff640 1 --2- 172.21.15.79:0/512465037 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e340b41b0 0x7f0e20004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e2bfff640 1 --2- 172.21.15.79:0/512465037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e20004d40 0x7f0e200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e2bfff640 1 -- 172.21.15.79:0/512465037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0e34071fb0 con 0x7f0e200039b0 2024-04-25T02:16:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e2bfff640 1 -- 172.21.15.79:0/512465037 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0e34072290 con 0x7f0e20004d40 2024-04-25T02:16:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e2bfff640 1 -- 172.21.15.79:0/512465037 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0e2000ba40 con 0x7f0e340b41b0 2024-04-25T02:16:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e3932c640 1 --2- 172.21.15.79:0/512465037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e200039b0 0x7f0e20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e38b2b640 1 --2- 172.21.15.79:0/512465037 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e340b41b0 0x7f0e20004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e39b2d640 1 --2- 172.21.15.79:0/512465037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e20004d40 0x7f0e200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e3932c640 1 -- 172.21.15.79:0/512465037 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e340b41b0 msgr2=0x7f0e20004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e3932c640 1 --2- 172.21.15.79:0/512465037 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e340b41b0 0x7f0e20004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e3932c640 1 -- 172.21.15.79:0/512465037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e20004d40 msgr2=0x7f0e200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e3932c640 1 --2- 172.21.15.79:0/512465037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e20004d40 0x7f0e200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.775+0000 7f0e3932c640 1 -- 172.21.15.79:0/512465037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e20003520 con 0x7f0e200039b0 2024-04-25T02:16:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.776+0000 7f0e3932c640 1 --2- 172.21.15.79:0/512465037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e200039b0 0x7f0e20003dd0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f0e300098a0 tx=0x7f0e20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380023c14257172d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.776+0000 7f0e2bfff640 1 -- 172.21.15.79:0/512465037 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000f040 con 0x7f0e200039b0 2024-04-25T02:16:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.776+0000 7f0e2bfff640 1 -- 172.21.15.79:0/512465037 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e3002ace0 con 0x7f0e200039b0 2024-04-25T02:16:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.776+0000 7f0e2bfff640 1 -- 172.21.15.79:0/512465037 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e30004250 con 0x7f0e200039b0 2024-04-25T02:16:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.776+0000 7f0e3b590640 1 -- 172.21.15.79:0/512465037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e200039b0 msgr2=0x7f0e20003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.776+0000 7f0e3b590640 1 --2- 172.21.15.79:0/512465037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e200039b0 0x7f0e20003dd0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f0e300098a0 tx=0x7f0e20005830 comp rx=0 tx=0).stop 2024-04-25T02:16:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.776+0000 7f0e39b2d640 1 -- 172.21.15.79:0/512465037 reap_dead start 2024-04-25T02:16:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.777+0000 7f0e3b590640 1 -- 172.21.15.79:0/512465037 shutdown_connections 2024-04-25T02:16:10.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.777+0000 7f0e3b590640 1 -- 172.21.15.79:0/512465037 >> 172.21.15.79:0/512465037 conn(0x7f0e340b1cd0 msgr2=0x7f0e340b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:10.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.777+0000 7f0e3b590640 1 -- 172.21.15.79:0/512465037 shutdown_connections 2024-04-25T02:16:10.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.777+0000 7f0e3b590640 1 -- 172.21.15.79:0/512465037 wait complete. 2024-04-25T02:16:10.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.778+0000 7f0e3b590640 1 Processor -- start 2024-04-25T02:16:10.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.778+0000 7f0e3b590640 1 -- start start 2024-04-25T02:16:10.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.778+0000 7f0e3b590640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e200039b0 0x7f0e341f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:10.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.778+0000 7f0e3b590640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e3414da00 0x7f0e340c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:10.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.778+0000 7f0e3b590640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e340ad250 0x7f0e340cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:10.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.778+0000 7f0e3b590640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3415c870 con 0x7f0e3414da00 2024-04-25T02:16:10.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.778+0000 7f0e3b590640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0e34072d70 con 0x7f0e200039b0 2024-04-25T02:16:10.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.778+0000 7f0e3b590640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0e340b4590 con 0x7f0e340ad250 2024-04-25T02:16:10.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e38b2b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e3414da00 0x7f0e340c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:10.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e38b2b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e3414da00 0x7f0e340c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41680/0 (socket says 172.21.15.79:41680) 2024-04-25T02:16:10.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e38b2b640 1 -- 172.21.15.79:0/1803932235 learned_addr learned my addr 172.21.15.79:0/1803932235 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:10.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e39b2d640 1 --2- 172.21.15.79:0/1803932235 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e340ad250 0x7f0e340cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:10.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e3932c640 1 --2- 172.21.15.79:0/1803932235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e200039b0 0x7f0e341f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:10.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e38b2b640 1 -- 172.21.15.79:0/1803932235 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e340ad250 msgr2=0x7f0e340cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:10.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e38b2b640 1 --2- 172.21.15.79:0/1803932235 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e340ad250 0x7f0e340cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e38b2b640 1 -- 172.21.15.79:0/1803932235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e200039b0 msgr2=0x7f0e341f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:10.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e38b2b640 1 --2- 172.21.15.79:0/1803932235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e200039b0 0x7f0e341f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e38b2b640 1 -- 172.21.15.79:0/1803932235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e340aef00 con 0x7f0e3414da00 2024-04-25T02:16:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e38b2b640 1 --2- 172.21.15.79:0/1803932235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e3414da00 0x7f0e340c8f60 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f0e2400b820 tx=0x7f0e2400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e29ffb640 1 -- 172.21.15.79:0/1803932235 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e24018070 con 0x7f0e3414da00 2024-04-25T02:16:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e29ffb640 1 -- 172.21.15.79:0/1803932235 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e2400be10 con 0x7f0e3414da00 2024-04-25T02:16:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e3b590640 1 -- 172.21.15.79:0/1803932235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3414de80 con 0x7f0e3414da00 2024-04-25T02:16:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e29ffb640 1 -- 172.21.15.79:0/1803932235 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e24010c60 con 0x7f0e3414da00 2024-04-25T02:16:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.779+0000 7f0e3b590640 1 -- 172.21.15.79:0/1803932235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e340af480 con 0x7f0e3414da00 2024-04-25T02:16:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.780+0000 7f0e3b590640 1 -- 172.21.15.79:0/1803932235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e340690a0 con 0x7f0e3414da00 2024-04-25T02:16:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.781+0000 7f0e29ffb640 1 -- 172.21.15.79:0/1803932235 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e2401b070 con 0x7f0e3414da00 2024-04-25T02:16:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.781+0000 7f0e29ffb640 1 --2- 172.21.15.79:0/1803932235 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0e1806be30 0x7f0e1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.781+0000 7f0e29ffb640 1 -- 172.21.15.79:0/1803932235 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f0e2408b170 con 0x7f0e3414da00 2024-04-25T02:16:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.781+0000 7f0e3932c640 1 --2- 172.21.15.79:0/1803932235 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0e1806be30 0x7f0e1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.782+0000 7f0e3932c640 1 --2- 172.21.15.79:0/1803932235 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0e1806be30 0x7f0e1806e2f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0e30033000 tx=0x7f0e3002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:10.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.785+0000 7f0e29ffb640 1 -- 172.21.15.79:0/1803932235 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0e240594d0 con 0x7f0e3414da00 2024-04-25T02:16:10.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.957+0000 7f0e3b590640 1 -- 172.21.15.79:0/1803932235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0e340ce280 con 0x7f0e3414da00 2024-04-25T02:16:10.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.957+0000 7f0e29ffb640 1 -- 172.21.15.79:0/1803932235 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) ==== 93+0+10 (secure 0 0 0) 0x7f0e2405d7d0 con 0x7f0e3414da00 2024-04-25T02:16:10.962 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:16:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.959+0000 7f0e3b590640 1 -- 172.21.15.79:0/1803932235 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0e1806be30 msgr2=0x7f0e1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.959+0000 7f0e3b590640 1 --2- 172.21.15.79:0/1803932235 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0e1806be30 0x7f0e1806e2f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0e30033000 tx=0x7f0e3002e000 comp rx=0 tx=0).stop 2024-04-25T02:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.959+0000 7f0e3b590640 1 -- 172.21.15.79:0/1803932235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e3414da00 msgr2=0x7f0e340c8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.959+0000 7f0e3b590640 1 --2- 172.21.15.79:0/1803932235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e3414da00 0x7f0e340c8f60 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f0e2400b820 tx=0x7f0e2400bce0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.959+0000 7f0e3b590640 1 -- 172.21.15.79:0/1803932235 shutdown_connections 2024-04-25T02:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.959+0000 7f0e3b590640 1 --2- 172.21.15.79:0/1803932235 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0e1806be30 0x7f0e1806e2f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.959+0000 7f0e3b590640 1 --2- 172.21.15.79:0/1803932235 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e340ad250 0x7f0e340cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.959+0000 7f0e3b590640 1 --2- 172.21.15.79:0/1803932235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e3414da00 0x7f0e340c8f60 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.959+0000 7f0e3b590640 1 --2- 172.21.15.79:0/1803932235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e200039b0 0x7f0e341f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.959+0000 7f0e3b590640 1 -- 172.21.15.79:0/1803932235 >> 172.21.15.79:0/1803932235 conn(0x7f0e340b1cd0 msgr2=0x7f0e3415b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.959+0000 7f0e3b590640 1 -- 172.21.15.79:0/1803932235 shutdown_connections 2024-04-25T02:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:10.959+0000 7f0e3b590640 1 -- 172.21.15.79:0/1803932235 wait complete. 2024-04-25T02:16:10.975 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:16:11.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.071+0000 7f02667d5640 1 Processor -- start 2024-04-25T02:16:11.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.071+0000 7f02667d5640 1 -- start start 2024-04-25T02:16:11.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.071+0000 7f02667d5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f026015e5a0 0x7f02600d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.071+0000 7f02667d5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f026006c3d0 0x7f026006c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.071+0000 7f02667d5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f026006d200 con 0x7f026006cd50 2024-04-25T02:16:11.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.071+0000 7f02667d5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f02600cc6c0 con 0x7f026006c3d0 2024-04-25T02:16:11.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.071+0000 7f02667d5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f02600d1460 con 0x7f026015e5a0 2024-04-25T02:16:11.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.072+0000 7f0264d72640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f026006cd50 0x7f02600ce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49216/0 (socket says 172.21.15.79:49216) 2024-04-25T02:16:11.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.072+0000 7f0264d72640 1 -- 172.21.15.79:0/3475182764 learned_addr learned my addr 172.21.15.79:0/3475182764 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:11.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.072+0000 7f025f7fe640 1 --2- 172.21.15.79:0/3475182764 >> v2:172.21.15.79:3300/0 conn(0x7f026006c3d0 0x7f026006c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.072+0000 7f025effd640 1 -- 172.21.15.79:0/3475182764 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1022727981 0 0) 0x7f0258001490 con 0x7f026006cd50 2024-04-25T02:16:11.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.072+0000 7f025ffff640 1 --2- 172.21.15.79:0/3475182764 >> v2:172.21.15.189:3300/0 conn(0x7f026015e5a0 0x7f02600d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.072+0000 7f025effd640 1 -- 172.21.15.79:0/3475182764 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0248003520 con 0x7f026006cd50 2024-04-25T02:16:11.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.072+0000 7f025f7fe640 1 -- 172.21.15.79:0/3475182764 >> v2:172.21.15.189:3300/0 conn(0x7f026015e5a0 msgr2=0x7f02600d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:11.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.072+0000 7f025f7fe640 1 --2- 172.21.15.79:0/3475182764 >> v2:172.21.15.189:3300/0 conn(0x7f026015e5a0 0x7f02600d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.072+0000 7f025f7fe640 1 -- 172.21.15.79:0/3475182764 >> v1:172.21.15.79:6789/0 conn(0x7f026006cd50 legacy=0x7f02600ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.072+0000 7f025f7fe640 1 -- 172.21.15.79:0/3475182764 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02600d0bc0 con 0x7f026006c3d0 2024-04-25T02:16:11.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.073+0000 7f025f7fe640 1 --2- 172.21.15.79:0/3475182764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f026006c3d0 0x7f026006c810 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f0260072950 tx=0x7f025402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1566dcff52d2f7f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:11.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.073+0000 7f025effd640 1 -- 172.21.15.79:0/3475182764 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0254037070 con 0x7f026006c3d0 2024-04-25T02:16:11.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.073+0000 7f025effd640 1 -- 172.21.15.79:0/3475182764 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0254032440 con 0x7f026006c3d0 2024-04-25T02:16:11.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.073+0000 7f025effd640 1 -- 172.21.15.79:0/3475182764 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0254032810 con 0x7f026006c3d0 2024-04-25T02:16:11.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.073+0000 7f02667d5640 1 -- 172.21.15.79:0/3475182764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f026006c3d0 msgr2=0x7f026006c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.073+0000 7f02667d5640 1 --2- 172.21.15.79:0/3475182764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f026006c3d0 0x7f026006c810 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f0260072950 tx=0x7f025402a1a0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.073+0000 7f02667d5640 1 -- 172.21.15.79:0/3475182764 shutdown_connections 2024-04-25T02:16:11.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.073+0000 7f02667d5640 1 --2- 172.21.15.79:0/3475182764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f026006c3d0 0x7f026006c810 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.073+0000 7f02667d5640 1 --2- 172.21.15.79:0/3475182764 >> v2:172.21.15.189:3300/0 conn(0x7f026015e5a0 0x7f02600d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.073+0000 7f02667d5640 1 -- 172.21.15.79:0/3475182764 >> 172.21.15.79:0/3475182764 conn(0x7f02600d1f40 msgr2=0x7f02600d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:11.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.073+0000 7f02667d5640 1 -- 172.21.15.79:0/3475182764 shutdown_connections 2024-04-25T02:16:11.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.073+0000 7f02667d5640 1 -- 172.21.15.79:0/3475182764 wait complete. 2024-04-25T02:16:11.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.074+0000 7f02667d5640 1 Processor -- start 2024-04-25T02:16:11.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.075+0000 7f02667d5640 1 -- start start 2024-04-25T02:16:11.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.075+0000 7f02667d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f026006c3d0 0x7f02601548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.075+0000 7f02667d5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f026006cd50 0x7f026009eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.075+0000 7f02667d5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f026015e5a0 0x7f0260070780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.075+0000 7f02667d5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f026015e980 con 0x7f026006c3d0 2024-04-25T02:16:11.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.075+0000 7f02667d5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f02600d1180 con 0x7f026006cd50 2024-04-25T02:16:11.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.075+0000 7f02667d5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f026015eb00 con 0x7f026015e5a0 2024-04-25T02:16:11.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.075+0000 7f025ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f026006c3d0 0x7f02601548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.075+0000 7f025ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f026006c3d0 0x7f02601548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41698/0 (socket says 172.21.15.79:41698) 2024-04-25T02:16:11.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.075+0000 7f025ffff640 1 -- 172.21.15.79:0/1074539852 learned_addr learned my addr 172.21.15.79:0/1074539852 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:11.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.076+0000 7f025ffff640 1 -- 172.21.15.79:0/1074539852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f026015e5a0 msgr2=0x7f0260070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.076+0000 7f025f7fe640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f026006cd50 0x7f026009eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.076+0000 7f0264d72640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f026015e5a0 0x7f0260070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.076+0000 7f025ffff640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f026015e5a0 0x7f0260070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.076+0000 7f025ffff640 1 -- 172.21.15.79:0/1074539852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f026006cd50 msgr2=0x7f026009eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.076+0000 7f025ffff640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f026006cd50 0x7f026009eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.076+0000 7f025ffff640 1 -- 172.21.15.79:0/1074539852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026009f070 con 0x7f026006c3d0 2024-04-25T02:16:11.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.076+0000 7f025f7fe640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f026006cd50 0x7f026009eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:11.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.076+0000 7f0264d72640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f026015e5a0 0x7f0260070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:11.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.076+0000 7f025ffff640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f026006c3d0 0x7f02601548e0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f025000d5f0 tx=0x7f025000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:11.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.076+0000 7f025cff9640 1 -- 172.21.15.79:0/1074539852 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02500125f0 con 0x7f026006c3d0 2024-04-25T02:16:11.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.076+0000 7f025cff9640 1 -- 172.21.15.79:0/1074539852 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0250019070 con 0x7f026006c3d0 2024-04-25T02:16:11.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.076+0000 7f02667d5640 1 -- 172.21.15.79:0/1074539852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0260070cc0 con 0x7f026006c3d0 2024-04-25T02:16:11.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.076+0000 7f025cff9640 1 -- 172.21.15.79:0/1074539852 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02500129d0 con 0x7f026006c3d0 2024-04-25T02:16:11.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.076+0000 7f02667d5640 1 -- 172.21.15.79:0/1074539852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026009c1c0 con 0x7f026006c3d0 2024-04-25T02:16:11.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.077+0000 7f02667d5640 1 -- 172.21.15.79:0/1074539852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02600690a0 con 0x7f026006c3d0 2024-04-25T02:16:11.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.077+0000 7f025cff9640 1 -- 172.21.15.79:0/1074539852 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0250012b70 con 0x7f026006c3d0 2024-04-25T02:16:11.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.078+0000 7f025cff9640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f024c06be30 0x7f024c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.078+0000 7f025cff9640 1 -- 172.21.15.79:0/1074539852 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f025008b1e0 con 0x7f026006c3d0 2024-04-25T02:16:11.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.078+0000 7f025f7fe640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f024c06be30 0x7f024c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.078+0000 7f025f7fe640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f024c06be30 0x7f024c06e2f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0254034000 tx=0x7f025402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:11.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.082+0000 7f025cff9640 1 -- 172.21.15.79:0/1074539852 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0250059c20 con 0x7f026006c3d0 2024-04-25T02:16:11.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.255+0000 7f02667d5640 1 -- 172.21.15.79:0/1074539852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f02600c8090 con 0x7f026006c3d0 2024-04-25T02:16:11.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.255+0000 7f025cff9640 1 -- 172.21.15.79:0/1074539852 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) ==== 104+0+11 (secure 0 0 0) 0x7f0250059520 con 0x7f026006c3d0 2024-04-25T02:16:11.260 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:16:11.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.257+0000 7f02667d5640 1 -- 172.21.15.79:0/1074539852 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f024c06be30 msgr2=0x7f024c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.257+0000 7f02667d5640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f024c06be30 0x7f024c06e2f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0254034000 tx=0x7f025402e000 comp rx=0 tx=0).stop 2024-04-25T02:16:11.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.257+0000 7f02667d5640 1 -- 172.21.15.79:0/1074539852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f026006c3d0 msgr2=0x7f02601548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.257+0000 7f02667d5640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f026006c3d0 0x7f02601548e0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f025000d5f0 tx=0x7f025000dab0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.257+0000 7f02667d5640 1 -- 172.21.15.79:0/1074539852 shutdown_connections 2024-04-25T02:16:11.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.257+0000 7f02667d5640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f024c06be30 0x7f024c06e2f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.257+0000 7f02667d5640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f026015e5a0 0x7f0260070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.257+0000 7f02667d5640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f026006cd50 0x7f026009eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.257+0000 7f02667d5640 1 --2- 172.21.15.79:0/1074539852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f026006c3d0 0x7f02601548e0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.257+0000 7f02667d5640 1 -- 172.21.15.79:0/1074539852 >> 172.21.15.79:0/1074539852 conn(0x7f02600d1f40 msgr2=0x7f02600cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:11.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.257+0000 7f02667d5640 1 -- 172.21.15.79:0/1074539852 shutdown_connections 2024-04-25T02:16:11.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.257+0000 7f02667d5640 1 -- 172.21.15.79:0/1074539852 wait complete. 2024-04-25T02:16:11.273 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:16:11.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.368+0000 7faadc84d640 1 Processor -- start 2024-04-25T02:16:11.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.368+0000 7faadc84d640 1 -- start start 2024-04-25T02:16:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.369+0000 7faadc84d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7faad80b41b0 0x7faad81605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.369+0000 7faadc84d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faad806b2f0 0x7faad806b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.369+0000 7faadc84d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faad8071cd0 con 0x7faad8155f00 2024-04-25T02:16:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.369+0000 7faadc84d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7faad8071fb0 con 0x7faad806b2f0 2024-04-25T02:16:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.369+0000 7faadc84d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7faad8072290 con 0x7faad80b41b0 2024-04-25T02:16:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.369+0000 7faacffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faad806b2f0 0x7faad806b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.369+0000 7faad6d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faad8155f00 0x7faad8156310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49230/0 (socket says 172.21.15.79:49230) 2024-04-25T02:16:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.369+0000 7faad6d9d640 1 -- 172.21.15.79:0/1085205595 learned_addr learned my addr 172.21.15.79:0/1085205595 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.369+0000 7faad659c640 1 --2- 172.21.15.79:0/1085205595 >> v2:172.21.15.189:3300/0 conn(0x7faad80b41b0 0x7faad81605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.369+0000 7faacffff640 1 -- 172.21.15.79:0/1085205595 >> v2:172.21.15.189:3300/0 conn(0x7faad80b41b0 msgr2=0x7faad81605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:11.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.369+0000 7faacffff640 1 --2- 172.21.15.79:0/1085205595 >> v2:172.21.15.189:3300/0 conn(0x7faad80b41b0 0x7faad81605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.369+0000 7faacffff640 1 -- 172.21.15.79:0/1085205595 >> v1:172.21.15.79:6789/0 conn(0x7faad8155f00 legacy=0x7faad8156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.369+0000 7faad5d9b640 1 -- 172.21.15.79:0/1085205595 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459729584 0 0) 0x7faad8071cd0 con 0x7faad8155f00 2024-04-25T02:16:11.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.369+0000 7faacffff640 1 -- 172.21.15.79:0/1085205595 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad8072570 con 0x7faad806b2f0 2024-04-25T02:16:11.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.370+0000 7faacffff640 1 --2- 172.21.15.79:0/1085205595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faad806b2f0 0x7faad806b770 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7faad80cdfb0 tx=0x7faac002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ca08c1ace23992 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:11.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.370+0000 7faad5d9b640 1 -- 172.21.15.79:0/1085205595 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac0037070 con 0x7faad806b2f0 2024-04-25T02:16:11.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.370+0000 7faad5d9b640 1 -- 172.21.15.79:0/1085205595 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac0032440 con 0x7faad806b2f0 2024-04-25T02:16:11.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.370+0000 7faad5d9b640 1 -- 172.21.15.79:0/1085205595 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac0032810 con 0x7faad806b2f0 2024-04-25T02:16:11.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.371+0000 7faadc84d640 1 -- 172.21.15.79:0/1085205595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faad806b2f0 msgr2=0x7faad806b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.371+0000 7faadc84d640 1 --2- 172.21.15.79:0/1085205595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faad806b2f0 0x7faad806b770 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7faad80cdfb0 tx=0x7faac002a1a0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.371+0000 7faadc84d640 1 -- 172.21.15.79:0/1085205595 shutdown_connections 2024-04-25T02:16:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.371+0000 7faadc84d640 1 --2- 172.21.15.79:0/1085205595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faad806b2f0 0x7faad806b770 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.371+0000 7faadc84d640 1 --2- 172.21.15.79:0/1085205595 >> v2:172.21.15.189:3300/0 conn(0x7faad80b41b0 0x7faad81605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.371+0000 7faadc84d640 1 -- 172.21.15.79:0/1085205595 >> 172.21.15.79:0/1085205595 conn(0x7faad80b1cd0 msgr2=0x7faad80b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.371+0000 7faadc84d640 1 -- 172.21.15.79:0/1085205595 shutdown_connections 2024-04-25T02:16:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.371+0000 7faadc84d640 1 -- 172.21.15.79:0/1085205595 wait complete. 2024-04-25T02:16:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.372+0000 7faadc84d640 1 Processor -- start 2024-04-25T02:16:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.372+0000 7faadc84d640 1 -- start start 2024-04-25T02:16:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faadc84d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faad806b2f0 0x7faad8160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faadc84d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faad80b41b0 0x7faad8154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faadc84d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faad8155f00 0x7faad806cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faadc84d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faad815c870 con 0x7faad8155f00 2024-04-25T02:16:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faadc84d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faad8072d70 con 0x7faad806b2f0 2024-04-25T02:16:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faadc84d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faad8156a20 con 0x7faad80b41b0 2024-04-25T02:16:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faad6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faad8155f00 0x7faad806cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faad6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faad8155f00 0x7faad806cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41714/0 (socket says 172.21.15.79:41714) 2024-04-25T02:16:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faad6d9d640 1 -- 172.21.15.79:0/1507049307 learned_addr learned my addr 172.21.15.79:0/1507049307 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faacffff640 1 --2- 172.21.15.79:0/1507049307 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faad80b41b0 0x7faad8154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faad659c640 1 --2- 172.21.15.79:0/1507049307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faad806b2f0 0x7faad8160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faad6d9d640 1 -- 172.21.15.79:0/1507049307 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faad80b41b0 msgr2=0x7faad8154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faad6d9d640 1 --2- 172.21.15.79:0/1507049307 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faad80b41b0 0x7faad8154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faad6d9d640 1 -- 172.21.15.79:0/1507049307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faad806b2f0 msgr2=0x7faad8160430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faad6d9d640 1 --2- 172.21.15.79:0/1507049307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faad806b2f0 0x7faad8160430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faad6d9d640 1 -- 172.21.15.79:0/1507049307 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad80cab90 con 0x7faad8155f00 2024-04-25T02:16:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faad659c640 1 --2- 172.21.15.79:0/1507049307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faad806b2f0 0x7faad8160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faad6d9d640 1 --2- 172.21.15.79:0/1507049307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faad8155f00 0x7faad806cad0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7faad000c780 tx=0x7faad000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faaceffd640 1 -- 172.21.15.79:0/1507049307 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad0018070 con 0x7faad8155f00 2024-04-25T02:16:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faaceffd640 1 -- 172.21.15.79:0/1507049307 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad000a640 con 0x7faad8155f00 2024-04-25T02:16:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faadc84d640 1 -- 172.21.15.79:0/1507049307 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad80c91b0 con 0x7faad8155f00 2024-04-25T02:16:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faaceffd640 1 -- 172.21.15.79:0/1507049307 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad000aa30 con 0x7faad8155f00 2024-04-25T02:16:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.373+0000 7faadc84d640 1 -- 172.21.15.79:0/1507049307 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad81547a0 con 0x7faad8155f00 2024-04-25T02:16:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.374+0000 7faadc84d640 1 -- 172.21.15.79:0/1507049307 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad80690a0 con 0x7faad8155f00 2024-04-25T02:16:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.375+0000 7faaceffd640 1 -- 172.21.15.79:0/1507049307 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faad001b070 con 0x7faad8155f00 2024-04-25T02:16:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.375+0000 7faaceffd640 1 --2- 172.21.15.79:0/1507049307 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faab806be30 0x7faab806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.375+0000 7faaceffd640 1 -- 172.21.15.79:0/1507049307 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7faad008a320 con 0x7faad8155f00 2024-04-25T02:16:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.375+0000 7faad659c640 1 --2- 172.21.15.79:0/1507049307 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faab806be30 0x7faab806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.376+0000 7faad659c640 1 --2- 172.21.15.79:0/1507049307 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faab806be30 0x7faab806e2f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7faac8006fd0 tx=0x7faac8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:11.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.380+0000 7faaceffd640 1 -- 172.21.15.79:0/1507049307 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faad0058710 con 0x7faad8155f00 2024-04-25T02:16:11.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.551+0000 7faadc84d640 1 -- 172.21.15.79:0/1507049307 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faad80ccdd0 con 0x7faad8155f00 2024-04-25T02:16:11.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.551+0000 7faaceffd640 1 -- 172.21.15.79:0/1507049307 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) ==== 100+0+11 (secure 0 0 0) 0x7faad005ca10 con 0x7faad8155f00 2024-04-25T02:16:11.557 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:16:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.553+0000 7faadc84d640 1 -- 172.21.15.79:0/1507049307 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faab806be30 msgr2=0x7faab806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.553+0000 7faadc84d640 1 --2- 172.21.15.79:0/1507049307 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faab806be30 0x7faab806e2f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7faac8006fd0 tx=0x7faac8008040 comp rx=0 tx=0).stop 2024-04-25T02:16:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.553+0000 7faadc84d640 1 -- 172.21.15.79:0/1507049307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faad8155f00 msgr2=0x7faad806cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.553+0000 7faadc84d640 1 --2- 172.21.15.79:0/1507049307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faad8155f00 0x7faad806cad0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7faad000c780 tx=0x7faad000cc40 comp rx=0 tx=0).stop 2024-04-25T02:16:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.553+0000 7faadc84d640 1 -- 172.21.15.79:0/1507049307 shutdown_connections 2024-04-25T02:16:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.553+0000 7faadc84d640 1 --2- 172.21.15.79:0/1507049307 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faab806be30 0x7faab806e2f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.553+0000 7faadc84d640 1 --2- 172.21.15.79:0/1507049307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faad8155f00 0x7faad806cad0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.553+0000 7faadc84d640 1 --2- 172.21.15.79:0/1507049307 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faad80b41b0 0x7faad8154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.553+0000 7faadc84d640 1 --2- 172.21.15.79:0/1507049307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faad806b2f0 0x7faad8160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.553+0000 7faadc84d640 1 -- 172.21.15.79:0/1507049307 >> 172.21.15.79:0/1507049307 conn(0x7faad80b1cd0 msgr2=0x7faad80b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.554+0000 7faadc84d640 1 -- 172.21.15.79:0/1507049307 shutdown_connections 2024-04-25T02:16:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.554+0000 7faadc84d640 1 -- 172.21.15.79:0/1507049307 wait complete. 2024-04-25T02:16:11.570 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:16:11.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.662+0000 7f74379f9640 1 Processor -- start 2024-04-25T02:16:11.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.663+0000 7f74379f9640 1 -- start start 2024-04-25T02:16:11.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.663+0000 7f74379f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74300b3570 0x7f74300d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.663+0000 7f74379f9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f743006c380 con 0x7f743015e4d0 2024-04-25T02:16:11.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.663+0000 7f74379f9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74300d1660 con 0x7f74300b3020 2024-04-25T02:16:11.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.663+0000 7f74379f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f74300d1380 con 0x7f74300b3570 2024-04-25T02:16:11.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.663+0000 7f7435795640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f743015e4d0 0x7f743006bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49242/0 (socket says 172.21.15.79:49242) 2024-04-25T02:16:11.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7435795640 1 -- 172.21.15.79:0/1810165537 learned_addr learned my addr 172.21.15.79:0/1810165537 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:11.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7434f94640 1 --2- 172.21.15.79:0/1810165537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74300b3570 0x7f74300d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7427fff640 1 -- 172.21.15.79:0/1810165537 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2661724838 0 0) 0x7f743006c380 con 0x7f743015e4d0 2024-04-25T02:16:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7427fff640 1 -- 172.21.15.79:0/1810165537 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f741c003520 con 0x7f743015e4d0 2024-04-25T02:16:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7427fff640 1 -- 172.21.15.79:0/1810165537 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3467422972 0 0) 0x7f741c003520 con 0x7f743015e4d0 2024-04-25T02:16:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7427fff640 1 -- 172.21.15.79:0/1810165537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74300b3570 msgr2=0x7f74300d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7427fff640 1 --2- 172.21.15.79:0/1810165537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74300b3570 0x7f74300d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7427fff640 1 -- 172.21.15.79:0/1810165537 >> v1:172.21.15.189:6789/0 conn(0x7f74300b3020 legacy=0x7f74300cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7427fff640 1 -- 172.21.15.79:0/1810165537 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74300cede0 con 0x7f743015e4d0 2024-04-25T02:16:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7427fff640 1 -- 172.21.15.79:0/1810165537 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f7420001670 con 0x7f743015e4d0 2024-04-25T02:16:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7427fff640 1 -- 172.21.15.79:0/1810165537 >> v1:172.21.15.79:6789/0 conn(0x7f743015e4d0 legacy=0x7f743006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7427fff640 1 --2- 172.21.15.79:0/1810165537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74300b3570 0x7f741c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7427fff640 1 --2- 172.21.15.79:0/1810165537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f741c003f20 0x7f741c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7427fff640 1 --2- 172.21.15.79:0/1810165537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f741c004d40 0x7f741c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7427fff640 1 -- 172.21.15.79:0/1810165537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f74300d1380 con 0x7f741c003f20 2024-04-25T02:16:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7427fff640 1 -- 172.21.15.79:0/1810165537 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f741c00ba20 con 0x7f741c004d40 2024-04-25T02:16:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7427fff640 1 -- 172.21.15.79:0/1810165537 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f741c00bc20 con 0x7f74300b3570 2024-04-25T02:16:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7434f94640 1 --2- 172.21.15.79:0/1810165537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f741c003f20 0x7f741c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7435795640 1 --2- 172.21.15.79:0/1810165537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74300b3570 0x7f741c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7435f96640 1 --2- 172.21.15.79:0/1810165537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f741c004d40 0x7f741c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7434f94640 1 -- 172.21.15.79:0/1810165537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74300b3570 msgr2=0x7f741c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7434f94640 1 --2- 172.21.15.79:0/1810165537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74300b3570 0x7f741c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7434f94640 1 -- 172.21.15.79:0/1810165537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f741c004d40 msgr2=0x7f741c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7434f94640 1 --2- 172.21.15.79:0/1810165537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f741c004d40 0x7f741c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.664+0000 7f7434f94640 1 -- 172.21.15.79:0/1810165537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c003520 con 0x7f741c003f20 2024-04-25T02:16:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.665+0000 7f7434f94640 1 --2- 172.21.15.79:0/1810165537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f741c003f20 0x7f741c004800 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f742c009ac0 tx=0x7f741c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4f718756129a24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.665+0000 7f7427fff640 1 -- 172.21.15.79:0/1810165537 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c036070 con 0x7f741c003f20 2024-04-25T02:16:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.665+0000 7f7427fff640 1 -- 172.21.15.79:0/1810165537 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742c031400 con 0x7f741c003f20 2024-04-25T02:16:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.665+0000 7f7427fff640 1 -- 172.21.15.79:0/1810165537 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c009690 con 0x7f741c003f20 2024-04-25T02:16:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.666+0000 7f74379f9640 1 -- 172.21.15.79:0/1810165537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f741c003f20 msgr2=0x7f741c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.666+0000 7f74379f9640 1 --2- 172.21.15.79:0/1810165537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f741c003f20 0x7f741c004800 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f742c009ac0 tx=0x7f741c005830 comp rx=0 tx=0).stop 2024-04-25T02:16:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.666+0000 7f7435f96640 1 -- 172.21.15.79:0/1810165537 reap_dead start 2024-04-25T02:16:11.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.666+0000 7f74379f9640 1 -- 172.21.15.79:0/1810165537 shutdown_connections 2024-04-25T02:16:11.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.666+0000 7f74379f9640 1 -- 172.21.15.79:0/1810165537 >> 172.21.15.79:0/1810165537 conn(0x7f743009d460 msgr2=0x7f74300d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:11.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.666+0000 7f74379f9640 1 -- 172.21.15.79:0/1810165537 shutdown_connections 2024-04-25T02:16:11.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.666+0000 7f74379f9640 1 -- 172.21.15.79:0/1810165537 wait complete. 2024-04-25T02:16:11.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.667+0000 7f74379f9640 1 Processor -- start 2024-04-25T02:16:11.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.667+0000 7f74379f9640 1 -- start start 2024-04-25T02:16:11.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f74379f9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f741c003f20 0x7f7430151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f74379f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7430152320 0x7f7430160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f74379f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7430152f60 0x7f74301533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f74379f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f74300d20d0 con 0x7f7430152f60 2024-04-25T02:16:11.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f74379f9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f743015e8b0 con 0x7f741c003f20 2024-04-25T02:16:11.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f74379f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f74300d2250 con 0x7f7430152320 2024-04-25T02:16:11.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f7435f96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7430152f60 0x7f74301533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f7435f96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7430152f60 0x7f74301533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41726/0 (socket says 172.21.15.79:41726) 2024-04-25T02:16:11.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f7435f96640 1 -- 172.21.15.79:0/1072822277 learned_addr learned my addr 172.21.15.79:0/1072822277 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:11.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f7434f94640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7430152320 0x7f7430160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f7435795640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f741c003f20 0x7f7430151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f7435f96640 1 -- 172.21.15.79:0/1072822277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7430152320 msgr2=0x7f7430160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f7435f96640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7430152320 0x7f7430160440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f7435f96640 1 -- 172.21.15.79:0/1072822277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f741c003f20 msgr2=0x7f7430151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f7435f96640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f741c003f20 0x7f7430151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f7435f96640 1 -- 172.21.15.79:0/1072822277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7430160cc0 con 0x7f7430152f60 2024-04-25T02:16:11.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f7434f94640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7430152320 0x7f7430160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:11.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f7435795640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f741c003f20 0x7f7430151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:11.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f7435f96640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7430152f60 0x7f74301533c0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f743008c190 tx=0x7f742800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:11.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.668+0000 7f7425ffb640 1 -- 172.21.15.79:0/1072822277 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428003970 con 0x7f7430152f60 2024-04-25T02:16:11.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.669+0000 7f7425ffb640 1 -- 172.21.15.79:0/1072822277 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7428018070 con 0x7f7430152f60 2024-04-25T02:16:11.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.669+0000 7f74379f9640 1 -- 172.21.15.79:0/1072822277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7430160fa0 con 0x7f7430152f60 2024-04-25T02:16:11.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.669+0000 7f7425ffb640 1 -- 172.21.15.79:0/1072822277 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428003d50 con 0x7f7430152f60 2024-04-25T02:16:11.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.669+0000 7f74379f9640 1 -- 172.21.15.79:0/1072822277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74300cc140 con 0x7f7430152f60 2024-04-25T02:16:11.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.670+0000 7f74379f9640 1 -- 172.21.15.79:0/1072822277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74300cc340 con 0x7f7430152f60 2024-04-25T02:16:11.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.670+0000 7f7425ffb640 1 -- 172.21.15.79:0/1072822277 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f74280050d0 con 0x7f7430152f60 2024-04-25T02:16:11.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.670+0000 7f7425ffb640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f741406be30 0x7f741406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:11.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.670+0000 7f7425ffb640 1 -- 172.21.15.79:0/1072822277 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f742808acf0 con 0x7f7430152f60 2024-04-25T02:16:11.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.670+0000 7f7435795640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f741406be30 0x7f741406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:11.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.671+0000 7f7435795640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f741406be30 0x7f741406e2f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7420001050 tx=0x7f7420009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:11.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.675+0000 7f7425ffb640 1 -- 172.21.15.79:0/1072822277 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f74300cc340 con 0x7f7430152f60 2024-04-25T02:16:11.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.858+0000 7f74379f9640 1 -- 172.21.15.79:0/1072822277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f74300690a0 con 0x7f7430152f60 2024-04-25T02:16:11.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.858+0000 7f7425ffb640 1 -- 172.21.15.79:0/1072822277 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v102) ==== 80+0+0 (secure 0 0 0) 0x7f742808f070 con 0x7f7430152f60 2024-04-25T02:16:11.863 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-04-25T02:16:11.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.860+0000 7f74379f9640 1 -- 172.21.15.79:0/1072822277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f741406be30 msgr2=0x7f741406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.860+0000 7f74379f9640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f741406be30 0x7f741406e2f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7420001050 tx=0x7f7420009040 comp rx=0 tx=0).stop 2024-04-25T02:16:11.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.860+0000 7f74379f9640 1 -- 172.21.15.79:0/1072822277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7430152f60 msgr2=0x7f74301533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:11.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.860+0000 7f74379f9640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7430152f60 0x7f74301533c0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f743008c190 tx=0x7f742800eb90 comp rx=0 tx=0).stop 2024-04-25T02:16:11.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.860+0000 7f74379f9640 1 -- 172.21.15.79:0/1072822277 shutdown_connections 2024-04-25T02:16:11.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.860+0000 7f74379f9640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f741406be30 0x7f741406e2f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.860+0000 7f74379f9640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7430152f60 0x7f74301533c0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.860+0000 7f74379f9640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7430152320 0x7f7430160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.860+0000 7f74379f9640 1 --2- 172.21.15.79:0/1072822277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f741c003f20 0x7f7430151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:11.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.860+0000 7f74379f9640 1 -- 172.21.15.79:0/1072822277 >> 172.21.15.79:0/1072822277 conn(0x7f743009d460 msgr2=0x7f74300d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:11.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.860+0000 7f74379f9640 1 -- 172.21.15.79:0/1072822277 shutdown_connections 2024-04-25T02:16:11.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:11.860+0000 7f74379f9640 1 -- 172.21.15.79:0/1072822277 wait complete. 2024-04-25T02:16:11.876 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:16:11.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:11.876 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:16:11.917 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:16:11.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:11.917 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:16:11.973 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:16:12.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.105+0000 7f6f890da640 1 Processor -- start 2024-04-25T02:16:12.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.105+0000 7f6f890da640 1 -- start start 2024-04-25T02:16:12.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.106+0000 7f6f890da640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f8415a720 0x7f6f8415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.106+0000 7f6f890da640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6f840b49b0 0x7f6f84070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.106+0000 7f6f890da640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8415f1c0 con 0x7f6f840d07a0 2024-04-25T02:16:12.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.106+0000 7f6f890da640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6f8415bb10 con 0x7f6f840b49b0 2024-04-25T02:16:12.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.106+0000 7f6f890da640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6f840b2e60 con 0x7f6f8415a720 2024-04-25T02:16:12.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.106+0000 7f6f8359e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6f840b49b0 0x7f6f84070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.106+0000 7f6f82d9d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f8415a720 0x7f6f8415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.106+0000 7f6f7bfff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f6f840d07a0 0x7f6f840b42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:54274/0 (socket says 172.21.15.79:54274) 2024-04-25T02:16:12.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.106+0000 7f6f8359e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6f840b49b0 0x7f6f84070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:50380/0 (socket says 172.21.15.79:50380) 2024-04-25T02:16:12.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.106+0000 7f6f7bfff640 1 -- 172.21.15.79:0/1348936694 learned_addr learned my addr 172.21.15.79:0/1348936694 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:12.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.106+0000 7f6f82d9d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f8415a720 0x7f6f8415ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:56210/0 (socket says 172.21.15.79:56210) 2024-04-25T02:16:12.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.107+0000 7f6f82d9d640 1 -- 172.21.15.79:0/1348936694 >> v2:172.21.15.189:3300/0 conn(0x7f6f840b49b0 msgr2=0x7f6f84070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.107+0000 7f6f82d9d640 1 --2- 172.21.15.79:0/1348936694 >> v2:172.21.15.189:3300/0 conn(0x7f6f840b49b0 0x7f6f84070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.107+0000 7f6f82d9d640 1 -- 172.21.15.79:0/1348936694 >> v1:172.21.15.189:6789/0 conn(0x7f6f840d07a0 legacy=0x7f6f840b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.107+0000 7f6f82d9d640 1 -- 172.21.15.79:0/1348936694 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f840b3140 con 0x7f6f8415a720 2024-04-25T02:16:12.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.107+0000 7f6f8359e640 1 --2- 172.21.15.79:0/1348936694 >> v2:172.21.15.189:3300/0 conn(0x7f6f840b49b0 0x7f6f84070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:16:12.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.107+0000 7f6f82d9d640 1 --2- 172.21.15.79:0/1348936694 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f8415a720 0x7f6f8415ec80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6f740097a0 tx=0x7f6f7402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49ab461df064f0d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.107+0000 7f6f8259c640 1 -- 172.21.15.79:0/1348936694 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74037070 con 0x7f6f8415a720 2024-04-25T02:16:12.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.107+0000 7f6f8259c640 1 -- 172.21.15.79:0/1348936694 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f7402ae50 con 0x7f6f8415a720 2024-04-25T02:16:12.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.107+0000 7f6f8259c640 1 -- 172.21.15.79:0/1348936694 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74032660 con 0x7f6f8415a720 2024-04-25T02:16:12.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.108+0000 7f6f890da640 1 -- 172.21.15.79:0/1348936694 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f8415a720 msgr2=0x7f6f8415ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.108+0000 7f6f890da640 1 --2- 172.21.15.79:0/1348936694 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f8415a720 0x7f6f8415ec80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6f740097a0 tx=0x7f6f7402a100 comp rx=0 tx=0).stop 2024-04-25T02:16:12.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.108+0000 7f6f890da640 1 -- 172.21.15.79:0/1348936694 shutdown_connections 2024-04-25T02:16:12.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.108+0000 7f6f890da640 1 --2- 172.21.15.79:0/1348936694 >> v2:172.21.15.189:3300/0 conn(0x7f6f840b49b0 0x7f6f84070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.108+0000 7f6f890da640 1 --2- 172.21.15.79:0/1348936694 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f8415a720 0x7f6f8415ec80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.108+0000 7f6f890da640 1 -- 172.21.15.79:0/1348936694 >> 172.21.15.79:0/1348936694 conn(0x7f6f840cfc80 msgr2=0x7f6f840d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:12.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.108+0000 7f6f890da640 1 -- 172.21.15.79:0/1348936694 shutdown_connections 2024-04-25T02:16:12.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.108+0000 7f6f890da640 1 -- 172.21.15.79:0/1348936694 wait complete. 2024-04-25T02:16:12.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.109+0000 7f6f890da640 1 Processor -- start 2024-04-25T02:16:12.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.109+0000 7f6f890da640 1 -- start start 2024-04-25T02:16:12.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.110+0000 7f6f890da640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f840b49b0 0x7f6f8414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.110+0000 7f6f890da640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f840d07a0 0x7f6f84156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.110+0000 7f6f890da640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f8415a720 0x7f6f84154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.110+0000 7f6f890da640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6f840b39e0 con 0x7f6f840b49b0 2024-04-25T02:16:12.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.110+0000 7f6f890da640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6f840b3700 con 0x7f6f8415a720 2024-04-25T02:16:12.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.110+0000 7f6f890da640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6f8406df50 con 0x7f6f840d07a0 2024-04-25T02:16:12.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.110+0000 7f6f82d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f840b49b0 0x7f6f8414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.110+0000 7f6f82d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f840b49b0 0x7f6f8414d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41730/0 (socket says 172.21.15.79:41730) 2024-04-25T02:16:12.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.110+0000 7f6f82d9d640 1 -- 172.21.15.79:0/3724852742 learned_addr learned my addr 172.21.15.79:0/3724852742 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:12.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.110+0000 7f6f8359e640 1 --2- 172.21.15.79:0/3724852742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f8415a720 0x7f6f84154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.110+0000 7f6f82d9d640 1 -- 172.21.15.79:0/3724852742 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f840d07a0 msgr2=0x7f6f84156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.110+0000 7f6f82d9d640 1 --2- 172.21.15.79:0/3724852742 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f840d07a0 0x7f6f84156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.110+0000 7f6f82d9d640 1 -- 172.21.15.79:0/3724852742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f8415a720 msgr2=0x7f6f84154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.110+0000 7f6f82d9d640 1 --2- 172.21.15.79:0/3724852742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f8415a720 0x7f6f84154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.110+0000 7f6f82d9d640 1 -- 172.21.15.79:0/3724852742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f84152d50 con 0x7f6f840b49b0 2024-04-25T02:16:12.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.111+0000 7f6f82d9d640 1 --2- 172.21.15.79:0/3724852742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f840b49b0 0x7f6f8414d3e0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f6f7402a140 tx=0x7f6f740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.111+0000 7f6f7b7fe640 1 -- 172.21.15.79:0/3724852742 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74041070 con 0x7f6f840b49b0 2024-04-25T02:16:12.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.111+0000 7f6f7b7fe640 1 -- 172.21.15.79:0/3724852742 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f7403c670 con 0x7f6f840b49b0 2024-04-25T02:16:12.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.111+0000 7f6f7b7fe640 1 -- 172.21.15.79:0/3724852742 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74037040 con 0x7f6f840b49b0 2024-04-25T02:16:12.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.111+0000 7f6f890da640 1 -- 172.21.15.79:0/3724852742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f84152ff0 con 0x7f6f840b49b0 2024-04-25T02:16:12.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.111+0000 7f6f890da640 1 -- 172.21.15.79:0/3724852742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f8414ff90 con 0x7f6f840b49b0 2024-04-25T02:16:12.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.112+0000 7f6f890da640 1 -- 172.21.15.79:0/3724852742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f840690a0 con 0x7f6f840b49b0 2024-04-25T02:16:12.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.112+0000 7f6f7b7fe640 1 -- 172.21.15.79:0/3724852742 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f74044070 con 0x7f6f840b49b0 2024-04-25T02:16:12.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.113+0000 7f6f7b7fe640 1 --2- 172.21.15.79:0/3724852742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6f6406be30 0x7f6f6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.113+0000 7f6f7b7fe640 1 -- 172.21.15.79:0/3724852742 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f6f740ab4c0 con 0x7f6f840b49b0 2024-04-25T02:16:12.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.113+0000 7f6f7bfff640 1 --2- 172.21.15.79:0/3724852742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6f6406be30 0x7f6f6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.113+0000 7f6f7bfff640 1 --2- 172.21.15.79:0/3724852742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6f6406be30 0x7f6f6406e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c000f60 tx=0x7f6f6c007a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.117+0000 7f6f7b7fe640 1 -- 172.21.15.79:0/3724852742 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6f74079e70 con 0x7f6f840b49b0 2024-04-25T02:16:12.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.328+0000 7f6f890da640 1 -- 172.21.15.79:0/3724852742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f8414db90 con 0x7f6f840b49b0 2024-04-25T02:16:12.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.329+0000 7f6f7b7fe640 1 -- 172.21.15.79:0/3724852742 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5189 (secure 0 0 0) 0x7f6f74079770 con 0x7f6f840b49b0 2024-04-25T02:16:12.334 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:12.334 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1086166830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1086166830},{"type":"v1","addr":"172.21.15.189:6834","nonce":1086166830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2468340230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2468340230},{"type":"v1","addr":"172.21.15.189:6835","nonce":2468340230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3582530322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3582530322},{"type":"v1","addr":"172.21.15.79:6836","nonce":3582530322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:15:58.363457+0000","modified":"2024-04-25T02:16:01.255271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8271":{"gid":8271,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2774759267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2774759267},{"type":"v1","addr":"172.21.15.79:6837","nonce":2774759267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8271,"qdb_cluster":[8271]},"id":7}]} 2024-04-25T02:16:12.335 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 68 2024-04-25T02:16:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.331+0000 7f6f890da640 1 -- 172.21.15.79:0/3724852742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6f6406be30 msgr2=0x7f6f6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.331+0000 7f6f890da640 1 --2- 172.21.15.79:0/3724852742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6f6406be30 0x7f6f6406e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c000f60 tx=0x7f6f6c007a80 comp rx=0 tx=0).stop 2024-04-25T02:16:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.331+0000 7f6f890da640 1 -- 172.21.15.79:0/3724852742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f840b49b0 msgr2=0x7f6f8414d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.331+0000 7f6f890da640 1 --2- 172.21.15.79:0/3724852742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f840b49b0 0x7f6f8414d3e0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f6f7402a140 tx=0x7f6f740046c0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.331+0000 7f6f890da640 1 -- 172.21.15.79:0/3724852742 shutdown_connections 2024-04-25T02:16:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.331+0000 7f6f890da640 1 --2- 172.21.15.79:0/3724852742 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6f6406be30 0x7f6f6406e2f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.331+0000 7f6f890da640 1 --2- 172.21.15.79:0/3724852742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f8415a720 0x7f6f84154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.331+0000 7f6f890da640 1 --2- 172.21.15.79:0/3724852742 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6f840d07a0 0x7f6f84156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.331+0000 7f6f890da640 1 --2- 172.21.15.79:0/3724852742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f840b49b0 0x7f6f8414d3e0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.331+0000 7f6f890da640 1 -- 172.21.15.79:0/3724852742 >> 172.21.15.79:0/3724852742 conn(0x7f6f840cfc80 msgr2=0x7f6f84154f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.331+0000 7f6f890da640 1 -- 172.21.15.79:0/3724852742 shutdown_connections 2024-04-25T02:16:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.331+0000 7f6f890da640 1 -- 172.21.15.79:0/3724852742 wait complete. 2024-04-25T02:16:12.347 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T02:16:12.466 INFO:teuthology.orchestra.run.smithi079.stdout:{"message":"","return_code":0} 2024-04-25T02:16:12.466 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T02:16:12.466 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:16:12.466 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:16:12.482 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:16:12.482 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:16:12.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:12.482 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:16:12.536 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:16:12.536 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T02:16:12.536 DEBUG:teuthology.orchestra.run.smithi079:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T02:16:12.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:12.579 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-25T02:16:12.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.676+0000 7fd0eeaa5640 1 Processor -- start 2024-04-25T02:16:12.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.676+0000 7fd0eeaa5640 1 -- start start 2024-04-25T02:16:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.677+0000 7fd0eeaa5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0e815e440 0x7fd0e80cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.677+0000 7fd0eeaa5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0e80d10a0 0x7fd0e80cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.677+0000 7fd0eeaa5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e80d1e80 con 0x7fd0e80d2f20 2024-04-25T02:16:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.677+0000 7fd0eeaa5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd0e80d2160 con 0x7fd0e80d10a0 2024-04-25T02:16:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.677+0000 7fd0eeaa5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e80d2440 con 0x7fd0e815e440 2024-04-25T02:16:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.677+0000 7fd0ed042640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0e80d10a0 0x7fd0e80cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.677+0000 7fd0ed042640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0e80d10a0 0x7fd0e80cfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41732/0 (socket says 172.21.15.79:41732) 2024-04-25T02:16:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.677+0000 7fd0ed042640 1 -- 172.21.15.79:0/2992432503 learned_addr learned my addr 172.21.15.79:0/2992432503 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.677+0000 7fd0ed042640 1 -- 172.21.15.79:0/2992432503 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0e815e440 msgr2=0x7fd0e80cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.677+0000 7fd0ec841640 1 --2- 172.21.15.79:0/2992432503 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0e815e440 0x7fd0e80cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.677+0000 7fd0ed042640 1 --2- 172.21.15.79:0/2992432503 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0e815e440 0x7fd0e80cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.677+0000 7fd0ed042640 1 -- 172.21.15.79:0/2992432503 >> v1:172.21.15.189:6789/0 conn(0x7fd0e80d2f20 legacy=0x7fd0e80d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.677+0000 7fd0ed042640 1 -- 172.21.15.79:0/2992432503 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e80d2720 con 0x7fd0e80d10a0 2024-04-25T02:16:12.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.677+0000 7fd0ec841640 1 --2- 172.21.15.79:0/2992432503 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0e815e440 0x7fd0e80cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:12.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.678+0000 7fd0ed042640 1 --2- 172.21.15.79:0/2992432503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0e80d10a0 0x7fd0e80cfdb0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009e50 tx=0x7fd0e002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed411c49e64fd0e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.678+0000 7fd0e77fe640 1 -- 172.21.15.79:0/2992432503 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0036070 con 0x7fd0e80d10a0 2024-04-25T02:16:12.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.678+0000 7fd0e77fe640 1 -- 172.21.15.79:0/2992432503 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e0031600 con 0x7fd0e80d10a0 2024-04-25T02:16:12.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.678+0000 7fd0e77fe640 1 -- 172.21.15.79:0/2992432503 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00319d0 con 0x7fd0e80d10a0 2024-04-25T02:16:12.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.679+0000 7fd0eeaa5640 1 -- 172.21.15.79:0/2992432503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0e80d10a0 msgr2=0x7fd0e80cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.679+0000 7fd0eeaa5640 1 --2- 172.21.15.79:0/2992432503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0e80d10a0 0x7fd0e80cfdb0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009e50 tx=0x7fd0e002a6c0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.679+0000 7fd0eeaa5640 1 -- 172.21.15.79:0/2992432503 shutdown_connections 2024-04-25T02:16:12.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.679+0000 7fd0eeaa5640 1 --2- 172.21.15.79:0/2992432503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0e80d10a0 0x7fd0e80cfdb0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.679+0000 7fd0eeaa5640 1 --2- 172.21.15.79:0/2992432503 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0e815e440 0x7fd0e80cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.679+0000 7fd0eeaa5640 1 -- 172.21.15.79:0/2992432503 >> 172.21.15.79:0/2992432503 conn(0x7fd0e809d450 msgr2=0x7fd0e80d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:12.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.679+0000 7fd0eeaa5640 1 -- 172.21.15.79:0/2992432503 shutdown_connections 2024-04-25T02:16:12.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.679+0000 7fd0eeaa5640 1 -- 172.21.15.79:0/2992432503 wait complete. 2024-04-25T02:16:12.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.681+0000 7fd0eeaa5640 1 Processor -- start 2024-04-25T02:16:12.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.681+0000 7fd0eeaa5640 1 -- start start 2024-04-25T02:16:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.682+0000 7fd0eeaa5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0e80d10a0 0x7fd0e80cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.682+0000 7fd0eeaa5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0e80d2f20 0x7fd0e80cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.682+0000 7fd0eeaa5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0e815e440 0x7fd0e80cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.682+0000 7fd0eeaa5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e80b7070 con 0x7fd0e80d2f20 2024-04-25T02:16:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.682+0000 7fd0eeaa5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e80b6ef0 con 0x7fd0e80d10a0 2024-04-25T02:16:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.682+0000 7fd0eeaa5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e80b71f0 con 0x7fd0e815e440 2024-04-25T02:16:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.682+0000 7fd0e7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0e80d2f20 0x7fd0e80cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.682+0000 7fd0e7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0e80d2f20 0x7fd0e80cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41734/0 (socket says 172.21.15.79:41734) 2024-04-25T02:16:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.682+0000 7fd0e7fff640 1 -- 172.21.15.79:0/1362844310 learned_addr learned my addr 172.21.15.79:0/1362844310 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.682+0000 7fd0ed042640 1 --2- 172.21.15.79:0/1362844310 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0e815e440 0x7fd0e80cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.682+0000 7fd0ec841640 1 --2- 172.21.15.79:0/1362844310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0e80d10a0 0x7fd0e80cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.682+0000 7fd0e7fff640 1 -- 172.21.15.79:0/1362844310 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0e815e440 msgr2=0x7fd0e80cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.683+0000 7fd0e7fff640 1 --2- 172.21.15.79:0/1362844310 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0e815e440 0x7fd0e80cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.683+0000 7fd0e7fff640 1 -- 172.21.15.79:0/1362844310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0e80d10a0 msgr2=0x7fd0e80cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.683+0000 7fd0e7fff640 1 --2- 172.21.15.79:0/1362844310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0e80d10a0 0x7fd0e80cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.683+0000 7fd0e7fff640 1 -- 172.21.15.79:0/1362844310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e81f53f0 con 0x7fd0e80d2f20 2024-04-25T02:16:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.683+0000 7fd0e7fff640 1 --2- 172.21.15.79:0/1362844310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0e80d2f20 0x7fd0e80cd650 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400c430 tx=0x7fd0d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.683+0000 7fd0e57fa640 1 -- 172.21.15.79:0/1362844310 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4011790 con 0x7fd0e80d2f20 2024-04-25T02:16:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.683+0000 7fd0e57fa640 1 -- 172.21.15.79:0/1362844310 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d4017070 con 0x7fd0e80d2f20 2024-04-25T02:16:12.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.683+0000 7fd0eeaa5640 1 -- 172.21.15.79:0/1362844310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e81573d0 con 0x7fd0e80d2f20 2024-04-25T02:16:12.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.683+0000 7fd0e57fa640 1 -- 172.21.15.79:0/1362844310 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4011bb0 con 0x7fd0e80d2f20 2024-04-25T02:16:12.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.683+0000 7fd0eeaa5640 1 -- 172.21.15.79:0/1362844310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e815f3b0 con 0x7fd0e80d2f20 2024-04-25T02:16:12.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.684+0000 7fd0e57fa640 1 -- 172.21.15.79:0/1362844310 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd0d401c460 con 0x7fd0e80d2f20 2024-04-25T02:16:12.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.685+0000 7fd0e57fa640 1 --2- 172.21.15.79:0/1362844310 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd0cc06be30 0x7fd0cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.685+0000 7fd0e57fa640 1 -- 172.21.15.79:0/1362844310 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7fd0d408ad40 con 0x7fd0e80d2f20 2024-04-25T02:16:12.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.685+0000 7fd0ec841640 1 --2- 172.21.15.79:0/1362844310 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd0cc06be30 0x7fd0cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.685+0000 7fd0ec841640 1 --2- 172.21.15.79:0/1362844310 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd0cc06be30 0x7fd0cc06e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00a950 tx=0x7fd0dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.686+0000 7fd0f17b5740 1 Processor -- start 2024-04-25T02:16:12.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.686+0000 7fd0f17b5740 1 -- start start 2024-04-25T02:16:12.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.686+0000 7fd0f17b5740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d35f2280 0x55f2d35f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.686+0000 7fd0f17b5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d362e950 0x55f2d35f2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.686+0000 7fd0f17b5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 0x55f2d361d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.686+0000 7fd0f17b5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f2d35552c0 con 0x55f2d362e950 2024-04-25T02:16:12.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.686+0000 7fd0f17b5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f2d34fd910 con 0x55f2d361cd40 2024-04-25T02:16:12.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.686+0000 7fd0f17b5740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55f2d3551280 con 0x55f2d35f2280 2024-04-25T02:16:12.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.686+0000 7fd0e7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d362e950 0x55f2d35f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.686+0000 7fd0e7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d362e950 0x55f2d35f2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41742/0 (socket says 172.21.15.79:41742) 2024-04-25T02:16:12.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.687+0000 7fd0e7fff640 1 -- 172.21.15.79:0/3530536516 learned_addr learned my addr 172.21.15.79:0/3530536516 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:12.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.687+0000 7fd0e7fff640 1 -- 172.21.15.79:0/3530536516 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d35f2280 msgr2=0x55f2d35f43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.687+0000 7fd0e7fff640 1 --2- 172.21.15.79:0/3530536516 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d35f2280 0x55f2d35f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.687+0000 7fd0e7fff640 1 -- 172.21.15.79:0/3530536516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 msgr2=0x55f2d361d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.687+0000 7fd0e7fff640 1 --2- 172.21.15.79:0/3530536516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 0x55f2d361d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.687+0000 7fd0e7fff640 1 -- 172.21.15.79:0/3530536516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2d350efb0 con 0x55f2d362e950 2024-04-25T02:16:12.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.687+0000 7fd0e7fff640 1 --2- 172.21.15.79:0/3530536516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d362e950 0x55f2d35f2660 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400a040 tx=0x7fd0d4058a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a51bb060e55d709 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.687+0000 7fd0d27fc640 1 -- 172.21.15.79:0/3530536516 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4071020 con 0x55f2d362e950 2024-04-25T02:16:12.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.687+0000 7fd0d27fc640 1 -- 172.21.15.79:0/3530536516 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d40572f0 con 0x55f2d362e950 2024-04-25T02:16:12.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.687+0000 7fd0d27fc640 1 -- 172.21.15.79:0/3530536516 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4055660 con 0x55f2d362e950 2024-04-25T02:16:12.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.688+0000 7fd0f17b5740 1 -- 172.21.15.79:0/3530536516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d362e950 msgr2=0x55f2d35f2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.688+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/3530536516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d362e950 0x55f2d35f2660 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400a040 tx=0x7fd0d4058a80 comp rx=0 tx=0).stop 2024-04-25T02:16:12.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.688+0000 7fd0f17b5740 1 -- 172.21.15.79:0/3530536516 shutdown_connections 2024-04-25T02:16:12.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.688+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/3530536516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 0x55f2d361d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.688+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/3530536516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d362e950 0x55f2d35f2660 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.688+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/3530536516 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d35f2280 0x55f2d35f43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.688+0000 7fd0f17b5740 1 -- 172.21.15.79:0/3530536516 >> 172.21.15.79:0/3530536516 conn(0x55f2d35b9950 msgr2=0x55f2d3637d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:12.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.688+0000 7fd0f17b5740 1 -- 172.21.15.79:0/3530536516 shutdown_connections 2024-04-25T02:16:12.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.688+0000 7fd0f17b5740 1 -- 172.21.15.79:0/3530536516 wait complete. 2024-04-25T02:16:12.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.689+0000 7fd0f17b5740 1 -- start start 2024-04-25T02:16:12.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.689+0000 7fd0f17b5740 1 Processor -- start 2024-04-25T02:16:12.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.690+0000 7fd0f17b5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d3647a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.690+0000 7fd0f17b5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 0x55f2d3632070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.690+0000 7fd0f17b5740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d362e950 0x55f2d361ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.690+0000 7fd0f17b5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f2d3510e90 con 0x55f2d35f2280 2024-04-25T02:16:12.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.690+0000 7fd0f17b5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f2d361a890 con 0x55f2d361cd40 2024-04-25T02:16:12.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.690+0000 7fd0f17b5740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55f2d361e270 con 0x55f2d362e950 2024-04-25T02:16:12.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.690+0000 7fd0f17b5740 10 client.0 _ll_register_callbacks cb 0x55f2d354c970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:16:12.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.690+0000 7fd0ec841640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d3647a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.690+0000 7fd0ec841640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d3647a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41756/0 (socket says 172.21.15.79:41756) 2024-04-25T02:16:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.690+0000 7fd0ec841640 1 -- 172.21.15.79:0/1648890200 learned_addr learned my addr 172.21.15.79:0/1648890200 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.690+0000 7fd0ed042640 1 --2- 172.21.15.79:0/1648890200 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d362e950 0x55f2d361ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.690+0000 7fd0e7fff640 1 --2- 172.21.15.79:0/1648890200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 0x55f2d3632070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0ec841640 1 -- 172.21.15.79:0/1648890200 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d362e950 msgr2=0x55f2d361ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0ec841640 1 --2- 172.21.15.79:0/1648890200 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d362e950 0x55f2d361ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0ec841640 1 -- 172.21.15.79:0/1648890200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 msgr2=0x55f2d3632070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0ec841640 1 --2- 172.21.15.79:0/1648890200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 0x55f2d3632070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0ec841640 1 -- 172.21.15.79:0/1648890200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2d33317e0 con 0x55f2d35f2280 2024-04-25T02:16:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0e7fff640 1 --2- 172.21.15.79:0/1648890200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 0x55f2d3632070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0ec841640 1 --2- 172.21.15.79:0/1648890200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d3647a90 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00afd0 tx=0x7fd0dc013aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1348cc8ed3b8a3c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:16:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0c77fe640 1 -- 172.21.15.79:0/1648890200 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc024060 con 0x55f2d35f2280 2024-04-25T02:16:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0c77fe640 1 -- 172.21.15.79:0/1648890200 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7fd0dc014750 con 0x55f2d35f2280 2024-04-25T02:16:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0f17b5740 1 -- 172.21.15.79:0/1648890200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0d40572f0 con 0x55f2d35f2280 2024-04-25T02:16:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0c77fe640 1 -- 172.21.15.79:0/1648890200 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fd0dc005990 con 0x55f2d35f2280 2024-04-25T02:16:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0f17b5740 10 client.8544 fetch_fsmap learned FSMap version 68 2024-04-25T02:16:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0f17b5740 1 -- 172.21.15.79:0/1648890200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55f2d3391f70 con 0x55f2d35f2280 2024-04-25T02:16:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0c77fe640 1 -- 172.21.15.79:0/1648890200 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d40572f0 con 0x55f2d35f2280 2024-04-25T02:16:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0c77fe640 1 -- 172.21.15.79:0/1648890200 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7fd0dc005b30 con 0x55f2d35f2280 2024-04-25T02:16:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0f17b5740 10 client.8544 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T02:16:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0f17b5740 10 client.8544 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T02:16:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0f17b5740 20 client.8544 populate_metadata read hostname 'smithi079' 2024-04-25T02:16:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/1648890200 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x55f2d3639ab0 0x55f2d3639eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0f17b5740 4 client.8544 mds_command: new command op to 8271 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:16:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.691+0000 7fd0f17b5740 1 -- 172.21.15.79:0/1648890200 --> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2d35295a0 con 0x55f2d3639ab0 2024-04-25T02:16:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.692+0000 7fd0e7fff640 1 --2- 172.21.15.79:0/1648890200 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x55f2d3639ab0 0x55f2d3639eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.692+0000 7fd0c77fe640 10 client.8544 ms_handle_connect on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.692+0000 7fd0e7fff640 1 --2- 172.21.15.79:0/1648890200 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x55f2d3639ab0 0x55f2d3639eb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c5a9ce5507b8c0c server_cookie=4465cd9d5da61323 in_seq=0 out_seq=0 2024-04-25T02:16:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.693+0000 7fd0c77fe640 1 -- 172.21.15.79:0/1648890200 <== mds.0 v2:172.21.15.79:6834/2774759267 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f2d35295a0 con 0x55f2d3639ab0 2024-04-25T02:16:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.693+0000 7fd0c77fe640 10 client.8544 handle_command_reply: tid=0 2024-04-25T02:16:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.693+0000 7fd0f17b5740 1 client.8544 shutdown 2024-04-25T02:16:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.693+0000 7fd0f17b5740 1 -- 172.21.15.79:0/1648890200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 msgr2=0x55f2d3647a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.693+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/1648890200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d3647a90 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00afd0 tx=0x7fd0dc013aa0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.693+0000 7fd0f17b5740 1 -- 172.21.15.79:0/1648890200 shutdown_connections 2024-04-25T02:16:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.693+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/1648890200 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x55f2d3639ab0 0x55f2d3639eb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.693+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/1648890200 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d362e950 0x55f2d361ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.693+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/1648890200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 0x55f2d3632070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.693+0000 7fd0c77fe640 0 client.8544 ms_handle_reset on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.693+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/1648890200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d3647a90 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.693+0000 7fd0f17b5740 1 -- 172.21.15.79:0/1648890200 >> 172.21.15.79:0/1648890200 conn(0x55f2d35b9950 msgr2=0x55f2d3619e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.693+0000 7fd0f17b5740 1 -- 172.21.15.79:0/1648890200 shutdown_connections 2024-04-25T02:16:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.693+0000 7fd0f17b5740 1 -- 172.21.15.79:0/1648890200 wait complete. 2024-04-25T02:16:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.693+0000 7fd0f17b5740 20 client.8544 trim_cache size 0 max 16384 2024-04-25T02:16:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.697+0000 7fb7da963640 1 Processor -- start 2024-04-25T02:16:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.697+0000 7fb7da963640 1 -- start start 2024-04-25T02:16:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.697+0000 7fb7da963640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb7d415c2e0 0x7fb7d40d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.697+0000 7fb7da963640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7d40cd450 0x7fb7d40d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.697+0000 7fb7da963640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb7d40d0950 0x7fb7d40b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.697+0000 7fb7da963640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb7d40c5980 con 0x7fb7d415c2e0 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.697+0000 7fb7da963640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb7d415c6c0 con 0x7fb7d40d0950 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.697+0000 7fb7da963640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d40cdbc0 con 0x7fb7d40cd450 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.697+0000 7fb7d3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb7d415c2e0 0x7fb7d40d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.697+0000 7fb7d3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb7d415c2e0 0x7fb7d40d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41766/0 (socket says 172.21.15.79:41766) 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.697+0000 7fb7d3fff640 1 -- 172.21.15.79:0/772277065 learned_addr learned my addr 172.21.15.79:0/772277065 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.698+0000 7fb7d8f00640 1 --2- 172.21.15.79:0/772277065 >> v2:172.21.15.189:3300/0 conn(0x7fb7d40d0950 0x7fb7d40b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.698+0000 7fb7d37fe640 1 --2- 172.21.15.79:0/772277065 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7d40cd450 0x7fb7d40d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.698+0000 7fb7d3fff640 1 -- 172.21.15.79:0/772277065 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7d40cd450 msgr2=0x7fb7d40d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.698+0000 7fb7d3fff640 1 --2- 172.21.15.79:0/772277065 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7d40cd450 0x7fb7d40d0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.698+0000 7fb7d3fff640 1 -- 172.21.15.79:0/772277065 >> v2:172.21.15.189:3300/0 conn(0x7fb7d40d0950 msgr2=0x7fb7d40b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.698+0000 7fb7d3fff640 1 --2- 172.21.15.79:0/772277065 >> v2:172.21.15.189:3300/0 conn(0x7fb7d40d0950 0x7fb7d40b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.698+0000 7fb7d3fff640 1 -- 172.21.15.79:0/772277065 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d40c5bd0 con 0x7fb7d415c2e0 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.698+0000 7fb7d3fff640 1 --2- 172.21.15.79:0/772277065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7d415c2e0 0x7fb7d40d2950 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fb7d40ce0a0 tx=0x7fb7c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dda9adfde73c1cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.699+0000 7fb7d2ffd640 1 -- 172.21.15.79:0/772277065 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4037070 con 0x7fb7d415c2e0 2024-04-25T02:16:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.699+0000 7fb7d2ffd640 1 -- 172.21.15.79:0/772277065 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c4032440 con 0x7fb7d415c2e0 2024-04-25T02:16:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.699+0000 7fb7d2ffd640 1 -- 172.21.15.79:0/772277065 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4032810 con 0x7fb7d415c2e0 2024-04-25T02:16:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.699+0000 7fb7da963640 1 -- 172.21.15.79:0/772277065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7d415c2e0 msgr2=0x7fb7d40d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.699+0000 7fb7da963640 1 --2- 172.21.15.79:0/772277065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7d415c2e0 0x7fb7d40d2950 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fb7d40ce0a0 tx=0x7fb7c402a1e0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.699+0000 7fb7da963640 1 -- 172.21.15.79:0/772277065 shutdown_connections 2024-04-25T02:16:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.699+0000 7fb7da963640 1 --2- 172.21.15.79:0/772277065 >> v2:172.21.15.189:3300/0 conn(0x7fb7d40d0950 0x7fb7d40b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.699+0000 7fb7da963640 1 --2- 172.21.15.79:0/772277065 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7d40cd450 0x7fb7d40d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.699+0000 7fb7da963640 1 --2- 172.21.15.79:0/772277065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7d415c2e0 0x7fb7d40d2950 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.699+0000 7fb7da963640 1 -- 172.21.15.79:0/772277065 >> 172.21.15.79:0/772277065 conn(0x7fb7d40d1e30 msgr2=0x7fb7d40d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.699+0000 7fb7da963640 1 -- 172.21.15.79:0/772277065 shutdown_connections 2024-04-25T02:16:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.699+0000 7fb7da963640 1 -- 172.21.15.79:0/772277065 wait complete. 2024-04-25T02:16:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.701+0000 7fb7da963640 1 Processor -- start 2024-04-25T02:16:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.701+0000 7fb7da963640 1 -- start start 2024-04-25T02:16:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.702+0000 7fb7da963640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7d40cd450 0x7fb7d409ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.702+0000 7fb7da963640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7d40d0950 0x7fb7d414afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.702+0000 7fb7da963640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7d415c2e0 0x7fb7d415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.702+0000 7fb7da963640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d40c6190 con 0x7fb7d415c2e0 2024-04-25T02:16:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.702+0000 7fb7da963640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d40c5eb0 con 0x7fb7d40cd450 2024-04-25T02:16:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.702+0000 7fb7da963640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d40cd8b0 con 0x7fb7d40d0950 2024-04-25T02:16:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7d8f00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7d415c2e0 0x7fb7d415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7d8f00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7d415c2e0 0x7fb7d415ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41768/0 (socket says 172.21.15.79:41768) 2024-04-25T02:16:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7d8f00640 1 -- 172.21.15.79:0/2028695835 learned_addr learned my addr 172.21.15.79:0/2028695835 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7d37fe640 1 --2- 172.21.15.79:0/2028695835 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7d40d0950 0x7fb7d414afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7d3fff640 1 --2- 172.21.15.79:0/2028695835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7d40cd450 0x7fb7d409ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7d8f00640 1 -- 172.21.15.79:0/2028695835 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7d40d0950 msgr2=0x7fb7d414afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7d8f00640 1 --2- 172.21.15.79:0/2028695835 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7d40d0950 0x7fb7d414afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7d8f00640 1 -- 172.21.15.79:0/2028695835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7d40cd450 msgr2=0x7fb7d409ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7d8f00640 1 --2- 172.21.15.79:0/2028695835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7d40cd450 0x7fb7d409ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7d8f00640 1 -- 172.21.15.79:0/2028695835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d414bef0 con 0x7fb7d415c2e0 2024-04-25T02:16:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7d8f00640 1 --2- 172.21.15.79:0/2028695835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7d415c2e0 0x7fb7d415ea10 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc007e90 tx=0x7fb7cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7d0ff9640 1 -- 172.21.15.79:0/2028695835 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc014420 con 0x7fb7d415c2e0 2024-04-25T02:16:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7d0ff9640 1 -- 172.21.15.79:0/2028695835 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7cc019070 con 0x7fb7d415c2e0 2024-04-25T02:16:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7d0ff9640 1 -- 172.21.15.79:0/2028695835 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc014800 con 0x7fb7d415c2e0 2024-04-25T02:16:12.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7da963640 1 -- 172.21.15.79:0/2028695835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d414b930 con 0x7fb7d415c2e0 2024-04-25T02:16:12.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.703+0000 7fb7da963640 1 -- 172.21.15.79:0/2028695835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d4149060 con 0x7fb7d415c2e0 2024-04-25T02:16:12.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.704+0000 7fb7da963640 1 -- 172.21.15.79:0/2028695835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fb7d40690a0 con 0x7fb7d415c2e0 2024-04-25T02:16:12.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.705+0000 7fb7d0ff9640 1 -- 172.21.15.79:0/2028695835 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7cc0149a0 con 0x7fb7d415c2e0 2024-04-25T02:16:12.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.705+0000 7fb7d0ff9640 1 --2- 172.21.15.79:0/2028695835 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7c006be60 0x7fb7c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.705+0000 7fb7d0ff9640 1 -- 172.21.15.79:0/2028695835 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7fb7cc08b440 con 0x7fb7d415c2e0 2024-04-25T02:16:12.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.705+0000 7fb7d3fff640 1 --2- 172.21.15.79:0/2028695835 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7c006be60 0x7fb7c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.705+0000 7fb7d0ff9640 1 -- 172.21.15.79:0/2028695835 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+511 (secure 0 0 0) 0x7fb7cc08dac0 con 0x7fb7d415c2e0 2024-04-25T02:16:12.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.706+0000 7fb7da963640 1 -- 172.21.15.79:0/2028695835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7fb7d40c77f0 con 0x7fb7d415c2e0 2024-04-25T02:16:12.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.706+0000 7fb7d3fff640 1 --2- 172.21.15.79:0/2028695835 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7c006be60 0x7fb7c006e320 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4034000 tx=0x7fb7c402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.714+0000 7fd0f17b5740 1 Processor -- start 2024-04-25T02:16:12.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.714+0000 7fd0f17b5740 1 -- start start 2024-04-25T02:16:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.714+0000 7fd0f17b5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d361fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.714+0000 7fd0f17b5740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d361cd40 0x55f2d363a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.714+0000 7fd0f17b5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d362e950 0x55f2d3646440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.714+0000 7fd0f17b5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8200910 con 0x55f2d35f2280 2024-04-25T02:16:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.714+0000 7fd0f17b5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e81f87f0 con 0x55f2d362e950 2024-04-25T02:16:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.714+0000 7fd0f17b5740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e81f7b50 con 0x55f2d361cd40 2024-04-25T02:16:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.714+0000 7fd0ec841640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d361fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.714+0000 7fd0ec841640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d361fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41776/0 (socket says 172.21.15.79:41776) 2024-04-25T02:16:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.714+0000 7fd0ec841640 1 -- 172.21.15.79:0/2747017191 learned_addr learned my addr 172.21.15.79:0/2747017191 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.715+0000 7fd0ec841640 1 -- 172.21.15.79:0/2747017191 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d361cd40 msgr2=0x55f2d363a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.715+0000 7fd0ec841640 1 --2- 172.21.15.79:0/2747017191 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d361cd40 0x55f2d363a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.715+0000 7fd0ec841640 1 -- 172.21.15.79:0/2747017191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d362e950 msgr2=0x55f2d3646440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.715+0000 7fd0ec841640 1 --2- 172.21.15.79:0/2747017191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d362e950 0x55f2d3646440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.715+0000 7fd0ec841640 1 -- 172.21.15.79:0/2747017191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2d3229170 con 0x55f2d35f2280 2024-04-25T02:16:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.715+0000 7fd0ec841640 1 --2- 172.21.15.79:0/2747017191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d361fe00 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00eec0 tx=0x7fd0dc01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a7f8364494032e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.715+0000 7fd0d1ffb640 1 -- 172.21.15.79:0/2747017191 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc014bd0 con 0x55f2d35f2280 2024-04-25T02:16:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.715+0000 7fd0d1ffb640 1 -- 172.21.15.79:0/2747017191 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc014d70 con 0x55f2d35f2280 2024-04-25T02:16:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.715+0000 7fd0d1ffb640 1 -- 172.21.15.79:0/2747017191 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc014990 con 0x55f2d35f2280 2024-04-25T02:16:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.716+0000 7fd0f17b5740 1 -- 172.21.15.79:0/2747017191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 msgr2=0x55f2d361fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.716+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/2747017191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d361fe00 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00eec0 tx=0x7fd0dc01d000 comp rx=0 tx=0).stop 2024-04-25T02:16:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.716+0000 7fd0f17b5740 1 -- 172.21.15.79:0/2747017191 shutdown_connections 2024-04-25T02:16:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.716+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/2747017191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d362e950 0x55f2d3646440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.716+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/2747017191 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d361cd40 0x55f2d363a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.716+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/2747017191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d361fe00 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.716+0000 7fd0f17b5740 1 -- 172.21.15.79:0/2747017191 >> 172.21.15.79:0/2747017191 conn(0x55f2d35b9950 msgr2=0x55f2d3620a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.716+0000 7fd0f17b5740 1 -- 172.21.15.79:0/2747017191 shutdown_connections 2024-04-25T02:16:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.716+0000 7fd0f17b5740 1 -- 172.21.15.79:0/2747017191 wait complete. 2024-04-25T02:16:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.716+0000 7fd0f17b5740 1 -- start start 2024-04-25T02:16:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.717+0000 7fd0f17b5740 1 Processor -- start 2024-04-25T02:16:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.717+0000 7fd0f17b5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d361f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.717+0000 7fd0f17b5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 0x55f2d361fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.717+0000 7fd0f17b5740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d362e950 0x55f2d35f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.717+0000 7fd0f17b5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e81f81a0 con 0x55f2d35f2280 2024-04-25T02:16:12.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.717+0000 7fd0f17b5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f2d35e9080 con 0x55f2d361cd40 2024-04-25T02:16:12.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.717+0000 7fd0f17b5740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55f2d364e380 con 0x55f2d362e950 2024-04-25T02:16:12.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.717+0000 7fd0ec841640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d361f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.717+0000 7fd0f17b5740 10 client.0 _ll_register_callbacks cb 0x7fd0dc00a130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:16:12.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.717+0000 7fd0ec841640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d361f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41782/0 (socket says 172.21.15.79:41782) 2024-04-25T02:16:12.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.717+0000 7fd0ec841640 1 -- 172.21.15.79:0/2892167192 learned_addr learned my addr 172.21.15.79:0/2892167192 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:12.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0ed042640 1 --2- 172.21.15.79:0/2892167192 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d362e950 0x55f2d35f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0e7fff640 1 --2- 172.21.15.79:0/2892167192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 0x55f2d361fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0ec841640 1 -- 172.21.15.79:0/2892167192 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d362e950 msgr2=0x55f2d35f0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0ec841640 1 --2- 172.21.15.79:0/2892167192 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d362e950 0x55f2d35f0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0ec841640 1 -- 172.21.15.79:0/2892167192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 msgr2=0x55f2d361fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0ec841640 1 --2- 172.21.15.79:0/2892167192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 0x55f2d361fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0ec841640 1 -- 172.21.15.79:0/2892167192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2d35f0270 con 0x55f2d35f2280 2024-04-25T02:16:12.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0e7fff640 1 --2- 172.21.15.79:0/2892167192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 0x55f2d361fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:12.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0ec841640 1 --2- 172.21.15.79:0/2892167192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d361f760 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00a250 tx=0x7fd0dc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c41643f816f873 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:16:12.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0c77fe640 1 -- 172.21.15.79:0/2892167192 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc0061e0 con 0x55f2d35f2280 2024-04-25T02:16:12.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0c77fe640 1 -- 172.21.15.79:0/2892167192 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7fd0dc006380 con 0x55f2d35f2280 2024-04-25T02:16:12.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0f17b5740 1 -- 172.21.15.79:0/2892167192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0dc014d70 con 0x55f2d35f2280 2024-04-25T02:16:12.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0c77fe640 1 -- 172.21.15.79:0/2892167192 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fd0dc04a050 con 0x55f2d35f2280 2024-04-25T02:16:12.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0f17b5740 10 client.8556 fetch_fsmap learned FSMap version 68 2024-04-25T02:16:12.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0f17b5740 1 -- 172.21.15.79:0/2892167192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55f2d364e120 con 0x55f2d35f2280 2024-04-25T02:16:12.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0c77fe640 1 -- 172.21.15.79:0/2892167192 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc014d70 con 0x55f2d35f2280 2024-04-25T02:16:12.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0c77fe640 1 -- 172.21.15.79:0/2892167192 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7fd0dc04d020 con 0x55f2d35f2280 2024-04-25T02:16:12.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0f17b5740 10 client.8556 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T02:16:12.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0f17b5740 10 client.8556 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T02:16:12.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0f17b5740 20 client.8556 populate_metadata read hostname 'smithi079' 2024-04-25T02:16:12.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/2892167192 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x55f2d3639ab0 0x55f2d35f1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0f17b5740 4 client.8556 mds_command: new command op to 8271 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T02:16:12.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.718+0000 7fd0f17b5740 1 -- 172.21.15.79:0/2892167192 --> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x55f2d3562800 con 0x55f2d3639ab0 2024-04-25T02:16:12.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.719+0000 7fd0e7fff640 1 --2- 172.21.15.79:0/2892167192 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x55f2d3639ab0 0x55f2d35f1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.719+0000 7fd0c77fe640 10 client.8556 ms_handle_connect on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:12.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.719+0000 7fd0e7fff640 1 --2- 172.21.15.79:0/2892167192 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x55f2d3639ab0 0x55f2d35f1360 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d099ee159157392d server_cookie=70c99fe3c71b9fd8 in_seq=0 out_seq=0 2024-04-25T02:16:12.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.720+0000 7fd0c77fe640 1 -- 172.21.15.79:0/2892167192 <== mds.0 v2:172.21.15.79:6834/2774759267 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f2d3562800 con 0x55f2d3639ab0 2024-04-25T02:16:12.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.720+0000 7fd0c77fe640 10 client.8556 handle_command_reply: tid=0 2024-04-25T02:16:12.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.720+0000 7fd0f17b5740 1 client.8556 shutdown 2024-04-25T02:16:12.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.720+0000 7fd0f17b5740 1 -- 172.21.15.79:0/2892167192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 msgr2=0x55f2d361f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.720+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/2892167192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d361f760 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00a250 tx=0x7fd0dc014000 comp rx=0 tx=0).stop 2024-04-25T02:16:12.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.720+0000 7fd0f17b5740 1 -- 172.21.15.79:0/2892167192 shutdown_connections 2024-04-25T02:16:12.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.720+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/2892167192 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x55f2d3639ab0 0x55f2d35f1360 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.720+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/2892167192 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55f2d362e950 0x55f2d35f0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.720+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/2892167192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2d361cd40 0x55f2d361fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.720+0000 7fd0f17b5740 1 --2- 172.21.15.79:0/2892167192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2d35f2280 0x55f2d361f760 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.720+0000 7fd0f17b5740 1 -- 172.21.15.79:0/2892167192 >> 172.21.15.79:0/2892167192 conn(0x55f2d35b9950 msgr2=0x55f2d363a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:12.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.720+0000 7fd0c77fe640 0 client.8556 ms_handle_reset on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:12.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.720+0000 7fd0f17b5740 1 -- 172.21.15.79:0/2892167192 shutdown_connections 2024-04-25T02:16:12.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.720+0000 7fd0f17b5740 1 -- 172.21.15.79:0/2892167192 wait complete. 2024-04-25T02:16:12.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.720+0000 7fd0f17b5740 20 client.8556 trim_cache size 0 max 16384 2024-04-25T02:16:12.731 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:16:12.731 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-04-25T02:16:12.731 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "bebd21a7-b1db-48bc-beb5-b1fd40c150f8", 2024-04-25T02:16:12.732 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-04-25T02:16:12.732 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:16:12.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.721+0000 7fd0eeaa5640 1 -- 172.21.15.79:0/1362844310 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd0cc06be30 msgr2=0x7fd0cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.721+0000 7fd0eeaa5640 1 --2- 172.21.15.79:0/1362844310 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd0cc06be30 0x7fd0cc06e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00a950 tx=0x7fd0dc008040 comp rx=0 tx=0).stop 2024-04-25T02:16:12.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.721+0000 7fd0eeaa5640 1 -- 172.21.15.79:0/1362844310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0e80d2f20 msgr2=0x7fd0e80cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.721+0000 7fd0eeaa5640 1 --2- 172.21.15.79:0/1362844310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0e80d2f20 0x7fd0e80cd650 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400c430 tx=0x7fd0d400c8f0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.721+0000 7fd0eeaa5640 1 -- 172.21.15.79:0/1362844310 shutdown_connections 2024-04-25T02:16:12.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.721+0000 7fd0eeaa5640 1 --2- 172.21.15.79:0/1362844310 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd0cc06be30 0x7fd0cc06e2f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.721+0000 7fd0eeaa5640 1 --2- 172.21.15.79:0/1362844310 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0e815e440 0x7fd0e80cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.721+0000 7fd0eeaa5640 1 --2- 172.21.15.79:0/1362844310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0e80d2f20 0x7fd0e80cd650 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.721+0000 7fd0eeaa5640 1 --2- 172.21.15.79:0/1362844310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0e80d10a0 0x7fd0e80cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.721+0000 7fd0eeaa5640 1 -- 172.21.15.79:0/1362844310 >> 172.21.15.79:0/1362844310 conn(0x7fd0e809d450 msgr2=0x7fd0e80d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:12.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.721+0000 7fd0eeaa5640 1 -- 172.21.15.79:0/1362844310 shutdown_connections 2024-04-25T02:16:12.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.721+0000 7fd0eeaa5640 1 -- 172.21.15.79:0/1362844310 wait complete. 2024-04-25T02:16:12.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:12.736 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T02:16:12.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.830+0000 7ffb00db6640 1 Processor -- start 2024-04-25T02:16:12.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.830+0000 7ffb00db6640 1 -- start start 2024-04-25T02:16:12.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.831+0000 7ffb00db6640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffafc06b2f0 0x7ffafc0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.831+0000 7ffb00db6640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ffafc0cf7a0 0x7ffafc06b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.831+0000 7ffb00db6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffafc06e6b0 0x7ffafc0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.831+0000 7ffb00db6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ffafc15f830 con 0x7ffafc06e6b0 2024-04-25T02:16:12.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.831+0000 7ffb00db6640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ffafc06bc10 con 0x7ffafc0cf7a0 2024-04-25T02:16:12.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.831+0000 7ffb00db6640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffafc15ec20 con 0x7ffafc06b2f0 2024-04-25T02:16:12.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.831+0000 7ffafad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffafc06e6b0 0x7ffafc0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.831+0000 7ffafad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffafc06e6b0 0x7ffafc0cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41786/0 (socket says 172.21.15.79:41786) 2024-04-25T02:16:12.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.831+0000 7ffafad9d640 1 -- 172.21.15.79:0/1143764637 learned_addr learned my addr 172.21.15.79:0/1143764637 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:12.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.831+0000 7ffafad9d640 1 -- 172.21.15.79:0/1143764637 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffafc06b2f0 msgr2=0x7ffafc0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.831+0000 7ffafad9d640 1 --2- 172.21.15.79:0/1143764637 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffafc06b2f0 0x7ffafc0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.831+0000 7ffaf9d9b640 1 --2- 172.21.15.79:0/1143764637 >> v2:172.21.15.189:3300/0 conn(0x7ffafc0cf7a0 0x7ffafc06b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.831+0000 7ffafad9d640 1 -- 172.21.15.79:0/1143764637 >> v2:172.21.15.189:3300/0 conn(0x7ffafc0cf7a0 msgr2=0x7ffafc06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.831+0000 7ffafad9d640 1 --2- 172.21.15.79:0/1143764637 >> v2:172.21.15.189:3300/0 conn(0x7ffafc0cf7a0 0x7ffafc06b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.831+0000 7ffafad9d640 1 -- 172.21.15.79:0/1143764637 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffafc15ef00 con 0x7ffafc06e6b0 2024-04-25T02:16:12.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.832+0000 7ffafad9d640 1 --2- 172.21.15.79:0/1143764637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffafc06e6b0 0x7ffafc0cdb70 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7ffafc0cd910 tx=0x7ffaf402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1da407ff8548b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.832+0000 7ffaf959a640 1 -- 172.21.15.79:0/1143764637 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4036070 con 0x7ffafc06e6b0 2024-04-25T02:16:12.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.832+0000 7ffaf959a640 1 -- 172.21.15.79:0/1143764637 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf4031600 con 0x7ffafc06e6b0 2024-04-25T02:16:12.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.832+0000 7ffaf959a640 1 -- 172.21.15.79:0/1143764637 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40319d0 con 0x7ffafc06e6b0 2024-04-25T02:16:12.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.833+0000 7ffb00db6640 1 -- 172.21.15.79:0/1143764637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffafc06e6b0 msgr2=0x7ffafc0cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.833+0000 7ffb00db6640 1 --2- 172.21.15.79:0/1143764637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffafc06e6b0 0x7ffafc0cdb70 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7ffafc0cd910 tx=0x7ffaf402a610 comp rx=0 tx=0).stop 2024-04-25T02:16:12.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.833+0000 7ffb00db6640 1 -- 172.21.15.79:0/1143764637 shutdown_connections 2024-04-25T02:16:12.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.833+0000 7ffb00db6640 1 --2- 172.21.15.79:0/1143764637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffafc06e6b0 0x7ffafc0cdb70 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.833+0000 7ffb00db6640 1 --2- 172.21.15.79:0/1143764637 >> v2:172.21.15.189:3300/0 conn(0x7ffafc0cf7a0 0x7ffafc06b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.833+0000 7ffb00db6640 1 --2- 172.21.15.79:0/1143764637 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffafc06b2f0 0x7ffafc0b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.833+0000 7ffb00db6640 1 -- 172.21.15.79:0/1143764637 >> 172.21.15.79:0/1143764637 conn(0x7ffafc0b1cd0 msgr2=0x7ffafc0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:12.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.833+0000 7ffb00db6640 1 -- 172.21.15.79:0/1143764637 shutdown_connections 2024-04-25T02:16:12.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.833+0000 7ffb00db6640 1 -- 172.21.15.79:0/1143764637 wait complete. 2024-04-25T02:16:12.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.834+0000 7ffb00db6640 1 Processor -- start 2024-04-25T02:16:12.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.834+0000 7ffb00db6640 1 -- start start 2024-04-25T02:16:12.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.835+0000 7ffb00db6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffafc06b2f0 0x7ffafc072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.835+0000 7ffb00db6640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffafc06e6b0 0x7ffafc147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.835+0000 7ffb00db6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffafc0cf7a0 0x7ffafc156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.835+0000 7ffb00db6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc06cfe0 con 0x7ffafc0cf7a0 2024-04-25T02:16:12.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.835+0000 7ffb00db6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc15f4c0 con 0x7ffafc06b2f0 2024-04-25T02:16:12.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.835+0000 7ffb00db6640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffafc06d160 con 0x7ffafc06e6b0 2024-04-25T02:16:12.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.835+0000 7ffafad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffafc0cf7a0 0x7ffafc156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.835+0000 7ffafad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffafc0cf7a0 0x7ffafc156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41796/0 (socket says 172.21.15.79:41796) 2024-04-25T02:16:12.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.835+0000 7ffafad9d640 1 -- 172.21.15.79:0/2647420067 learned_addr learned my addr 172.21.15.79:0/2647420067 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:12.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.835+0000 7ffafad9d640 1 -- 172.21.15.79:0/2647420067 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffafc06e6b0 msgr2=0x7ffafc147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.835+0000 7ffafad9d640 1 --2- 172.21.15.79:0/2647420067 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffafc06e6b0 0x7ffafc147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.835+0000 7ffafad9d640 1 -- 172.21.15.79:0/2647420067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffafc06b2f0 msgr2=0x7ffafc072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.835+0000 7ffafad9d640 1 --2- 172.21.15.79:0/2647420067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffafc06b2f0 0x7ffafc072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.835+0000 7ffafad9d640 1 -- 172.21.15.79:0/2647420067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffafc156c50 con 0x7ffafc0cf7a0 2024-04-25T02:16:12.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.835+0000 7ffafad9d640 1 --2- 172.21.15.79:0/2647420067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffafc0cf7a0 0x7ffafc156710 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009f40 tx=0x7ffaf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.836+0000 7ffaeaffd640 1 -- 172.21.15.79:0/2647420067 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4036050 con 0x7ffafc0cf7a0 2024-04-25T02:16:12.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.836+0000 7ffaeaffd640 1 -- 172.21.15.79:0/2647420067 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf4042070 con 0x7ffafc0cf7a0 2024-04-25T02:16:12.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.836+0000 7ffb00db6640 1 -- 172.21.15.79:0/2647420067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffafc0726f0 con 0x7ffafc0cf7a0 2024-04-25T02:16:12.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.836+0000 7ffaeaffd640 1 -- 172.21.15.79:0/2647420067 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4009510 con 0x7ffafc0cf7a0 2024-04-25T02:16:12.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.836+0000 7ffb00db6640 1 -- 172.21.15.79:0/2647420067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffafc072cb0 con 0x7ffafc0cf7a0 2024-04-25T02:16:12.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.837+0000 7ffaeaffd640 1 -- 172.21.15.79:0/2647420067 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffaf4007bd0 con 0x7ffafc0cf7a0 2024-04-25T02:16:12.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.837+0000 7ffaeaffd640 1 --2- 172.21.15.79:0/2647420067 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffadc06be30 0x7ffadc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.838+0000 7ffaeaffd640 1 -- 172.21.15.79:0/2647420067 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7ffaf40abe20 con 0x7ffafc0cf7a0 2024-04-25T02:16:12.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.838+0000 7ffafa59c640 1 --2- 172.21.15.79:0/2647420067 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffadc06be30 0x7ffadc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.838+0000 7ffafa59c640 1 --2- 172.21.15.79:0/2647420067 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffadc06be30 0x7ffadc06e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009710 tx=0x7ffaec006c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.838+0000 7ffb03b9c740 1 Processor -- start 2024-04-25T02:16:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.839+0000 7ffb03b9c740 1 -- start start 2024-04-25T02:16:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.839+0000 7ffb03b9c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb24d60 0x555a2eb25140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.839+0000 7ffb03b9c740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb42600 0x555a2eb42b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.839+0000 7ffb03b9c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eafaa40 0x555a2eb40cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.839+0000 7ffb03b9c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555a2ea5e6b0 con 0x555a2eb24d60 2024-04-25T02:16:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.839+0000 7ffb03b9c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555a2ea06880 con 0x555a2eafaa40 2024-04-25T02:16:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.839+0000 7ffb03b9c740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x555a2ea5a670 con 0x555a2eb42600 2024-04-25T02:16:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.839+0000 7ffafa59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb24d60 0x555a2eb25140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.840+0000 7ffafa59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb24d60 0x555a2eb25140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41800/0 (socket says 172.21.15.79:41800) 2024-04-25T02:16:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.840+0000 7ffafa59c640 1 -- 172.21.15.79:0/3188821806 learned_addr learned my addr 172.21.15.79:0/3188821806 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.840+0000 7ffafa59c640 1 -- 172.21.15.79:0/3188821806 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb42600 msgr2=0x555a2eb42b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.840+0000 7ffafa59c640 1 --2- 172.21.15.79:0/3188821806 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb42600 0x555a2eb42b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.840+0000 7ffafa59c640 1 -- 172.21.15.79:0/3188821806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eafaa40 msgr2=0x555a2eb40cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.840+0000 7ffafa59c640 1 --2- 172.21.15.79:0/3188821806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eafaa40 0x555a2eb40cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.840+0000 7ffafa59c640 1 -- 172.21.15.79:0/3188821806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2e83c7d0 con 0x555a2eb24d60 2024-04-25T02:16:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.840+0000 7ffafa59c640 1 --2- 172.21.15.79:0/3188821806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb24d60 0x555a2eb25140 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7ffaec015890 tx=0x7ffaec00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef0a2cd34dfb04c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.840+0000 7ffadbfff640 1 -- 172.21.15.79:0/3188821806 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec023070 con 0x555a2eb24d60 2024-04-25T02:16:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.840+0000 7ffadbfff640 1 -- 172.21.15.79:0/3188821806 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaec0152e0 con 0x555a2eb24d60 2024-04-25T02:16:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.840+0000 7ffadbfff640 1 -- 172.21.15.79:0/3188821806 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec00bb80 con 0x555a2eb24d60 2024-04-25T02:16:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.841+0000 7ffb03b9c740 1 -- 172.21.15.79:0/3188821806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb24d60 msgr2=0x555a2eb25140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.841+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/3188821806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb24d60 0x555a2eb25140 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7ffaec015890 tx=0x7ffaec00e000 comp rx=0 tx=0).stop 2024-04-25T02:16:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.841+0000 7ffb03b9c740 1 -- 172.21.15.79:0/3188821806 shutdown_connections 2024-04-25T02:16:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.841+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/3188821806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eafaa40 0x555a2eb40cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.841+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/3188821806 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb42600 0x555a2eb42b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.841+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/3188821806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb24d60 0x555a2eb25140 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.841+0000 7ffb03b9c740 1 -- 172.21.15.79:0/3188821806 >> 172.21.15.79:0/3188821806 conn(0x555a2eaf7600 msgr2=0x555a2eb3fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.841+0000 7ffb03b9c740 1 -- 172.21.15.79:0/3188821806 shutdown_connections 2024-04-25T02:16:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.841+0000 7ffb03b9c740 1 -- 172.21.15.79:0/3188821806 wait complete. 2024-04-25T02:16:12.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.841+0000 7ffb03b9c740 1 -- start start 2024-04-25T02:16:12.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.841+0000 7ffb03b9c740 1 Processor -- start 2024-04-25T02:16:12.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.842+0000 7ffb03b9c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eb24d60 0x555a2eb28280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.842+0000 7ffb03b9c740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb42600 0x555a2eb46660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.842+0000 7ffb03b9c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb13040 0x555a2eb13480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.842+0000 7ffb03b9c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555a2eafb7e0 con 0x555a2eb13040 2024-04-25T02:16:12.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.842+0000 7ffb03b9c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555a2ea19f50 con 0x555a2eb24d60 2024-04-25T02:16:12.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.842+0000 7ffb03b9c740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x555a2eaf5530 con 0x555a2eb42600 2024-04-25T02:16:12.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.842+0000 7ffb03b9c740 10 client.0 _ll_register_callbacks cb 0x555a2ea55000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:16:12.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.842+0000 7ffafad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb13040 0x555a2eb13480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.842+0000 7ffafad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb13040 0x555a2eb13480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41802/0 (socket says 172.21.15.79:41802) 2024-04-25T02:16:12.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.842+0000 7ffafad9d640 1 -- 172.21.15.79:0/3412618927 learned_addr learned my addr 172.21.15.79:0/3412618927 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:12.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffafa59c640 1 --2- 172.21.15.79:0/3412618927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eb24d60 0x555a2eb28280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffaf9d9b640 1 --2- 172.21.15.79:0/3412618927 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb42600 0x555a2eb46660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffafad9d640 1 -- 172.21.15.79:0/3412618927 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb42600 msgr2=0x555a2eb46660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffafad9d640 1 --2- 172.21.15.79:0/3412618927 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb42600 0x555a2eb46660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffafad9d640 1 -- 172.21.15.79:0/3412618927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eb24d60 msgr2=0x555a2eb28280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffafad9d640 1 --2- 172.21.15.79:0/3412618927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eb24d60 0x555a2eb28280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffafad9d640 1 -- 172.21.15.79:0/3412618927 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a2e7723f0 con 0x555a2eb13040 2024-04-25T02:16:12.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffafad9d640 1 --2- 172.21.15.79:0/3412618927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb13040 0x555a2eb13480 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4034040 tx=0x7ffaf40763f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fbcdc5cb16d8f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffad97fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:16:12.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffad97fa640 1 -- 172.21.15.79:0/3412618927 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40a8060 con 0x555a2eb13040 2024-04-25T02:16:12.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffad97fa640 1 -- 172.21.15.79:0/3412618927 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7ffaf407e110 con 0x555a2eb13040 2024-04-25T02:16:12.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffb03b9c740 1 -- 172.21.15.79:0/3412618927 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaec0152e0 con 0x555a2eb13040 2024-04-25T02:16:12.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffad97fa640 1 -- 172.21.15.79:0/3412618927 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7ffaf407a040 con 0x555a2eb13040 2024-04-25T02:16:12.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffb03b9c740 10 client.8568 fetch_fsmap learned FSMap version 68 2024-04-25T02:16:12.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffb03b9c740 1 -- 172.21.15.79:0/3412618927 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x555a2e7320f0 con 0x555a2eb13040 2024-04-25T02:16:12.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffad97fa640 1 -- 172.21.15.79:0/3412618927 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaec0152e0 con 0x555a2eb13040 2024-04-25T02:16:12.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffad97fa640 1 -- 172.21.15.79:0/3412618927 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7ffaf4079490 con 0x555a2eb13040 2024-04-25T02:16:12.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffb03b9c740 10 client.8568 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T02:16:12.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffb03b9c740 10 client.8568 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T02:16:12.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffb03b9c740 20 client.8568 populate_metadata read hostname 'smithi079' 2024-04-25T02:16:12.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/3412618927 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x555a2eb22990 0x555a2eb22da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffb03b9c740 4 client.8568 mds_command: new command op to 8271 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:16:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.843+0000 7ffb03b9c740 1 -- 172.21.15.79:0/3412618927 --> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a2ea6bbf0 con 0x555a2eb22990 2024-04-25T02:16:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.844+0000 7ffafa59c640 1 --2- 172.21.15.79:0/3412618927 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x555a2eb22990 0x555a2eb22da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.844+0000 7ffad97fa640 10 client.8568 ms_handle_connect on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.844+0000 7ffafa59c640 1 --2- 172.21.15.79:0/3412618927 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x555a2eb22990 0x555a2eb22da0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1cb799b040e3b5e server_cookie=f8e6645a57f7231b in_seq=0 out_seq=0 2024-04-25T02:16:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.844+0000 7ffad97fa640 1 -- 172.21.15.79:0/3412618927 <== mds.0 v2:172.21.15.79:6834/2774759267 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555a2ea6bbf0 con 0x555a2eb22990 2024-04-25T02:16:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.844+0000 7ffad97fa640 10 client.8568 handle_command_reply: tid=0 2024-04-25T02:16:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.844+0000 7ffb03b9c740 1 client.8568 shutdown 2024-04-25T02:16:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.844+0000 7ffb03b9c740 1 -- 172.21.15.79:0/3412618927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb13040 msgr2=0x555a2eb13480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.844+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/3412618927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb13040 0x555a2eb13480 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4034040 tx=0x7ffaf40763f0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.845+0000 7ffb03b9c740 1 -- 172.21.15.79:0/3412618927 shutdown_connections 2024-04-25T02:16:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.845+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/3412618927 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x555a2eb22990 0x555a2eb22da0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.845+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/3412618927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb13040 0x555a2eb13480 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.845+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/3412618927 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb42600 0x555a2eb46660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.845+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/3412618927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eb24d60 0x555a2eb28280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.845+0000 7ffad97fa640 0 client.8568 ms_handle_reset on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:12.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.845+0000 7ffb03b9c740 1 -- 172.21.15.79:0/3412618927 >> 172.21.15.79:0/3412618927 conn(0x555a2eafaa40 msgr2=0x555a2eb430f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:12.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.845+0000 7ffb03b9c740 1 -- 172.21.15.79:0/3412618927 shutdown_connections 2024-04-25T02:16:12.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.845+0000 7ffb03b9c740 1 -- 172.21.15.79:0/3412618927 wait complete. 2024-04-25T02:16:12.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.845+0000 7ffb03b9c740 20 client.8568 trim_cache size 0 max 16384 2024-04-25T02:16:12.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.862+0000 7ffb03b9c740 1 Processor -- start 2024-04-25T02:16:12.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.862+0000 7ffb03b9c740 1 -- start start 2024-04-25T02:16:12.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffb03b9c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb13040 0x555a2eaf9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffb03b9c740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb24d60 0x555a2eb41f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffb03b9c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eb42600 0x555a2eb41360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffb03b9c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc1fe540 con 0x555a2eb13040 2024-04-25T02:16:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffb03b9c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc1fd560 con 0x555a2eb42600 2024-04-25T02:16:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffb03b9c740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffafc1fc960 con 0x555a2eb24d60 2024-04-25T02:16:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffafa59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb13040 0x555a2eaf9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffafa59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb13040 0x555a2eaf9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41810/0 (socket says 172.21.15.79:41810) 2024-04-25T02:16:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffafa59c640 1 -- 172.21.15.79:0/1712488748 learned_addr learned my addr 172.21.15.79:0/1712488748 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffafa59c640 1 -- 172.21.15.79:0/1712488748 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb24d60 msgr2=0x555a2eb41f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffafa59c640 1 --2- 172.21.15.79:0/1712488748 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb24d60 0x555a2eb41f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffafa59c640 1 -- 172.21.15.79:0/1712488748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eb42600 msgr2=0x555a2eb41360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffafa59c640 1 --2- 172.21.15.79:0/1712488748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eb42600 0x555a2eb41360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffafa59c640 1 -- 172.21.15.79:0/1712488748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2eb42b80 con 0x555a2eb13040 2024-04-25T02:16:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffafa59c640 1 --2- 172.21.15.79:0/1712488748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb13040 0x555a2eaf9360 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7ffaec021040 tx=0x7ffaec010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9130723c42785b76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffadb7fe640 1 -- 172.21.15.79:0/1712488748 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec023040 con 0x555a2eb13040 2024-04-25T02:16:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffadb7fe640 1 -- 172.21.15.79:0/1712488748 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaec00bc60 con 0x555a2eb13040 2024-04-25T02:16:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.863+0000 7ffadb7fe640 1 -- 172.21.15.79:0/1712488748 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec02b170 con 0x555a2eb13040 2024-04-25T02:16:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.864+0000 7ffb03b9c740 1 -- 172.21.15.79:0/1712488748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb13040 msgr2=0x555a2eaf9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.864+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/1712488748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb13040 0x555a2eaf9360 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7ffaec021040 tx=0x7ffaec010000 comp rx=0 tx=0).stop 2024-04-25T02:16:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.864+0000 7ffb03b9c740 1 -- 172.21.15.79:0/1712488748 shutdown_connections 2024-04-25T02:16:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.864+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/1712488748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eb42600 0x555a2eb41360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.864+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/1712488748 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb24d60 0x555a2eb41f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.864+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/1712488748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb13040 0x555a2eaf9360 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.864+0000 7ffb03b9c740 1 -- 172.21.15.79:0/1712488748 >> 172.21.15.79:0/1712488748 conn(0x555a2eafaa40 msgr2=0x555a2eb22d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.864+0000 7ffb03b9c740 1 -- 172.21.15.79:0/1712488748 shutdown_connections 2024-04-25T02:16:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.864+0000 7ffb03b9c740 1 -- 172.21.15.79:0/1712488748 wait complete. 2024-04-25T02:16:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.865+0000 7ffb03b9c740 1 -- start start 2024-04-25T02:16:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.865+0000 7ffb03b9c740 1 Processor -- start 2024-04-25T02:16:12.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.865+0000 7ffb03b9c740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb13040 0x555a2eb27110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.865+0000 7ffb03b9c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eb24d60 0x555a2eb35500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.865+0000 7ffb03b9c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb42600 0x555a2eb35a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.865+0000 7ffb03b9c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc1fcf10 con 0x555a2eb42600 2024-04-25T02:16:12.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.865+0000 7ffb03b9c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555a2eb24af0 con 0x555a2eb24d60 2024-04-25T02:16:12.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.865+0000 7ffb03b9c740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x555a2ebb9e70 con 0x555a2eb13040 2024-04-25T02:16:12.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffb03b9c740 10 client.0 _ll_register_callbacks cb 0x7ffaf40092e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:16:12.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffafad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb42600 0x555a2eb35a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffafad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb42600 0x555a2eb35a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41818/0 (socket says 172.21.15.79:41818) 2024-04-25T02:16:12.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffafad9d640 1 -- 172.21.15.79:0/4029217319 learned_addr learned my addr 172.21.15.79:0/4029217319 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:12.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffaf9d9b640 1 --2- 172.21.15.79:0/4029217319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eb24d60 0x555a2eb35500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffafad9d640 1 -- 172.21.15.79:0/4029217319 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb13040 msgr2=0x555a2eb27110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffafa59c640 1 --2- 172.21.15.79:0/4029217319 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb13040 0x555a2eb27110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffafad9d640 1 --2- 172.21.15.79:0/4029217319 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb13040 0x555a2eb27110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffafad9d640 1 -- 172.21.15.79:0/4029217319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eb24d60 msgr2=0x555a2eb35500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:12.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffafad9d640 1 --2- 172.21.15.79:0/4029217319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eb24d60 0x555a2eb35500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffafad9d640 1 -- 172.21.15.79:0/4029217319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a2eb3dfe0 con 0x555a2eb42600 2024-04-25T02:16:12.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffaf9d9b640 1 --2- 172.21.15.79:0/4029217319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eb24d60 0x555a2eb35500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:12.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffafad9d640 1 --2- 172.21.15.79:0/4029217319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb42600 0x555a2eb35a40 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7ffaf402a650 tx=0x7ffaf4009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45bc6d93948b7544 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:12.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffad97fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:16:12.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffad97fa640 1 -- 172.21.15.79:0/4029217319 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf409d030 con 0x555a2eb42600 2024-04-25T02:16:12.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffad97fa640 1 -- 172.21.15.79:0/4029217319 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7ffaf40920d0 con 0x555a2eb42600 2024-04-25T02:16:12.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffb03b9c740 1 -- 172.21.15.79:0/4029217319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaec00bc60 con 0x555a2eb42600 2024-04-25T02:16:12.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffad97fa640 1 -- 172.21.15.79:0/4029217319 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7ffaf40a8070 con 0x555a2eb42600 2024-04-25T02:16:12.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffb03b9c740 10 client.8574 fetch_fsmap learned FSMap version 68 2024-04-25T02:16:12.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffb03b9c740 1 -- 172.21.15.79:0/4029217319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x555a2eb3dfe0 con 0x555a2eb42600 2024-04-25T02:16:12.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffad97fa640 1 -- 172.21.15.79:0/4029217319 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaec00bc60 con 0x555a2eb42600 2024-04-25T02:16:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.866+0000 7ffad97fa640 1 -- 172.21.15.79:0/4029217319 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7ffaf4079110 con 0x555a2eb42600 2024-04-25T02:16:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 10 client.8574 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T02:16:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 10 client.8574 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T02:16:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 20 client.8574 populate_metadata read hostname 'smithi079' 2024-04-25T02:16:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/4029217319 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x555a2ebb9920 0x555a2eb4f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 4 client.8574 mds_command: new command op to 8271 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:16:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 1 -- 172.21.15.79:0/4029217319 --> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555a2ea65f40 con 0x555a2ebb9920 2024-04-25T02:16:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffafa59c640 1 --2- 172.21.15.79:0/4029217319 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x555a2ebb9920 0x555a2eb4f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffad97fa640 10 client.8574 ms_handle_connect on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffafa59c640 1 --2- 172.21.15.79:0/4029217319 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x555a2ebb9920 0x555a2eb4f610 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87dfe5e0d95cab4f server_cookie=36d8a280b5cacbb in_seq=0 out_seq=0 2024-04-25T02:16:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffad97fa640 1 -- 172.21.15.79:0/4029217319 <== mds.0 v2:172.21.15.79:6834/2774759267 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x555a2ea65f40 con 0x555a2ebb9920 2024-04-25T02:16:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffad97fa640 10 client.8574 handle_command_reply: tid=0 2024-04-25T02:16:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 1 client.8574 shutdown 2024-04-25T02:16:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 1 -- 172.21.15.79:0/4029217319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb42600 msgr2=0x555a2eb35a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/4029217319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb42600 0x555a2eb35a40 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7ffaf402a650 tx=0x7ffaf4009810 comp rx=0 tx=0).stop 2024-04-25T02:16:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 1 -- 172.21.15.79:0/4029217319 shutdown_connections 2024-04-25T02:16:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/4029217319 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x555a2ebb9920 0x555a2eb4f610 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/4029217319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a2eb42600 0x555a2eb35a40 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffad97fa640 0 client.8574 ms_handle_reset on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/4029217319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a2eb24d60 0x555a2eb35500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 1 --2- 172.21.15.79:0/4029217319 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555a2eb13040 0x555a2eb27110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 1 -- 172.21.15.79:0/4029217319 >> 172.21.15.79:0/4029217319 conn(0x555a2eafaa40 msgr2=0x555a2eaf9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 1 -- 172.21.15.79:0/4029217319 shutdown_connections 2024-04-25T02:16:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.867+0000 7ffb03b9c740 1 -- 172.21.15.79:0/4029217319 wait complete. 2024-04-25T02:16:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.868+0000 7ffb03b9c740 20 client.8574 trim_cache size 0 max 16384 2024-04-25T02:16:12.881 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:16:12.881 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T02:16:12.881 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-04-25T02:16:12.881 INFO:teuthology.orchestra.run.smithi079.stdout: "bebd21a7-b1db-48bc-beb5-b1fd40c150f8": { 2024-04-25T02:16:12.881 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-04-25T02:16:12.881 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "bebd21a7-b1db-48bc-beb5-b1fd40c150f8", 2024-04-25T02:16:12.881 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,repair" 2024-04-25T02:16:12.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:16:12.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:16:12.881 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:16:12.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.868+0000 7ffb00db6640 1 -- 172.21.15.79:0/2647420067 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffadc06be30 msgr2=0x7ffadc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.868+0000 7ffb00db6640 1 --2- 172.21.15.79:0/2647420067 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffadc06be30 0x7ffadc06e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009710 tx=0x7ffaec006c90 comp rx=0 tx=0).stop 2024-04-25T02:16:12.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.868+0000 7ffb00db6640 1 -- 172.21.15.79:0/2647420067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffafc0cf7a0 msgr2=0x7ffafc156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:12.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.868+0000 7ffb00db6640 1 --2- 172.21.15.79:0/2647420067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffafc0cf7a0 0x7ffafc156710 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009f40 tx=0x7ffaf4004a40 comp rx=0 tx=0).stop 2024-04-25T02:16:12.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.868+0000 7ffb00db6640 1 -- 172.21.15.79:0/2647420067 shutdown_connections 2024-04-25T02:16:12.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.868+0000 7ffb00db6640 1 --2- 172.21.15.79:0/2647420067 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffadc06be30 0x7ffadc06e2f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.868+0000 7ffb00db6640 1 --2- 172.21.15.79:0/2647420067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffafc0cf7a0 0x7ffafc156710 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.868+0000 7ffb00db6640 1 --2- 172.21.15.79:0/2647420067 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffafc06e6b0 0x7ffafc147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.868+0000 7ffb00db6640 1 --2- 172.21.15.79:0/2647420067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffafc06b2f0 0x7ffafc072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.868+0000 7ffb00db6640 1 -- 172.21.15.79:0/2647420067 >> 172.21.15.79:0/2647420067 conn(0x7ffafc0b1cd0 msgr2=0x7ffafc0ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.868+0000 7ffb00db6640 1 -- 172.21.15.79:0/2647420067 shutdown_connections 2024-04-25T02:16:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:12.868+0000 7ffb00db6640 1 -- 172.21.15.79:0/2647420067 wait complete. 2024-04-25T02:16:12.884 INFO:tasks.cephfs.filesystem:scrub status for tag:bebd21a7-b1db-48bc-beb5-b1fd40c150f8 - {'path': '/', 'tag': 'bebd21a7-b1db-48bc-beb5-b1fd40c150f8', 'options': 'recursive,repair'} 2024-04-25T02:16:13.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:13.067+0000 7fb7d0ff9640 1 -- 172.21.15.79:0/2028695835 <== mon.0 v2:172.21.15.79:3300/0 7 ==== log(4 entries from seq 1 at 2024-04-25T02:16:12.720582+0000) ==== 695+0+0 (secure 0 0 0) 0x7fb7cc089a80 con 0x7fb7d415c2e0 2024-04-25T02:16:13.073 INFO:teuthology.orchestra.run.smithi079.stdout: cluster: 2024-04-25T02:16:13.073 INFO:teuthology.orchestra.run.smithi079.stdout: id: 696648c4-3e52-400b-a780-2e8863c56c42 2024-04-25T02:16:13.073 INFO:teuthology.orchestra.run.smithi079.stdout: health: HEALTH_OK 2024-04-25T02:16:13.073 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:13.073 INFO:teuthology.orchestra.run.smithi079.stdout: services: 2024-04-25T02:16:13.073 INFO:teuthology.orchestra.run.smithi079.stdout: mon: 3 daemons, quorum a,b,c (age 8m) 2024-04-25T02:16:13.073 INFO:teuthology.orchestra.run.smithi079.stdout: mgr: y(active, since 8m), standbys: x 2024-04-25T02:16:13.073 INFO:teuthology.orchestra.run.smithi079.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T02:16:13.073 INFO:teuthology.orchestra.run.smithi079.stdout: osd: 8 osds: 8 up (since 8m), 8 in (since 8m) 2024-04-25T02:16:13.073 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:13.073 INFO:teuthology.orchestra.run.smithi079.stdout: data: 2024-04-25T02:16:13.074 INFO:teuthology.orchestra.run.smithi079.stdout: volumes: 1/1 healthy 2024-04-25T02:16:13.074 INFO:teuthology.orchestra.run.smithi079.stdout: pools: 3 pools, 97 pgs 2024-04-25T02:16:13.074 INFO:teuthology.orchestra.run.smithi079.stdout: objects: 30 objects, 19 MiB 2024-04-25T02:16:13.074 INFO:teuthology.orchestra.run.smithi079.stdout: usage: 290 MiB used, 720 GiB / 720 GiB avail 2024-04-25T02:16:13.074 INFO:teuthology.orchestra.run.smithi079.stdout: pgs: 97 active+clean 2024-04-25T02:16:13.074 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:13.074 INFO:teuthology.orchestra.run.smithi079.stdout: io: 2024-04-25T02:16:13.074 INFO:teuthology.orchestra.run.smithi079.stdout: client: 91 B/s rd, 1.6 MiB/s wr, 0 op/s rd, 7 op/s wr 2024-04-25T02:16:13.074 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:13.074 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:13.074 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:12.720582+0000 mds.c [INF] scrub queued for path: / 2024-04-25T02:16:13.074 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:12.720586+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-25T02:16:13.074 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:12.720590+0000 mds.c [INF] scrub summary: active paths [/] 2024-04-25T02:16:13.074 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:12.721763+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-25T02:16:15.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:15.068+0000 7fb7d0ff9640 1 -- 172.21.15.79:0/2028695835 <== mon.0 v2:172.21.15.79:3300/0 8 ==== log(1 entries from seq 5 at 2024-04-25T02:16:13.941783+0000) ==== 189+0+0 (secure 0 0 0) 0x7fb7cc0578d0 con 0x7fb7d415c2e0 2024-04-25T02:16:15.073 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:13.941783+0000 mds.c [INF] scrub summary: idle 2024-04-25T02:16:31.649 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:16:31.652 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:16:42.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:42.885 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T02:16:42.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.991+0000 7fb113883640 1 Processor -- start 2024-04-25T02:16:42.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.991+0000 7fb113883640 1 -- start start 2024-04-25T02:16:42.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb113883640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb10c06b2f0 0x7fb10c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:42.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb113883640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb10c0cf7a0 0x7fb10c06b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:42.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb113883640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10c06e6b0 0x7fb10c0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:42.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb113883640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb10c15f830 con 0x7fb10c0cf7a0 2024-04-25T02:16:42.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb113883640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb10c06bc10 con 0x7fb10c06b2f0 2024-04-25T02:16:42.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb113883640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb10c15ec20 con 0x7fb10c06e6b0 2024-04-25T02:16:42.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb110e1e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb10c0cf7a0 0x7fb10c06b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:42.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb110e1e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb10c0cf7a0 0x7fb10c06b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46540/0 (socket says 172.21.15.79:46540) 2024-04-25T02:16:42.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb110e1e640 1 -- 172.21.15.79:0/3312770979 learned_addr learned my addr 172.21.15.79:0/3312770979 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:42.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb111e20640 1 --2- 172.21.15.79:0/3312770979 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10c06e6b0 0x7fb10c0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:42.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb11161f640 1 --2- 172.21.15.79:0/3312770979 >> v2:172.21.15.189:3300/0 conn(0x7fb10c06b2f0 0x7fb10c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:42.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb110e1e640 1 -- 172.21.15.79:0/3312770979 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10c06e6b0 msgr2=0x7fb10c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:42.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb110e1e640 1 --2- 172.21.15.79:0/3312770979 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10c06e6b0 0x7fb10c0cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:42.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb110e1e640 1 -- 172.21.15.79:0/3312770979 >> v2:172.21.15.189:3300/0 conn(0x7fb10c06b2f0 msgr2=0x7fb10c0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:42.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb110e1e640 1 --2- 172.21.15.79:0/3312770979 >> v2:172.21.15.189:3300/0 conn(0x7fb10c06b2f0 0x7fb10c0b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:42.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb110e1e640 1 -- 172.21.15.79:0/3312770979 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10c15ef00 con 0x7fb10c0cf7a0 2024-04-25T02:16:42.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.992+0000 7fb11161f640 1 --2- 172.21.15.79:0/3312770979 >> v2:172.21.15.189:3300/0 conn(0x7fb10c06b2f0 0x7fb10c0b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:42.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.993+0000 7fb110e1e640 1 --2- 172.21.15.79:0/3312770979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb10c0cf7a0 0x7fb10c06b6d0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fb10c06efd0 tx=0x7fb0fc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b26cfedf5a0282 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:42.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.993+0000 7fb103fff640 1 -- 172.21.15.79:0/3312770979 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc037070 con 0x7fb10c0cf7a0 2024-04-25T02:16:42.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.993+0000 7fb103fff640 1 -- 172.21.15.79:0/3312770979 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0fc032440 con 0x7fb10c0cf7a0 2024-04-25T02:16:42.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.993+0000 7fb103fff640 1 -- 172.21.15.79:0/3312770979 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc032810 con 0x7fb10c0cf7a0 2024-04-25T02:16:43.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.994+0000 7fb113883640 1 -- 172.21.15.79:0/3312770979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb10c0cf7a0 msgr2=0x7fb10c06b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.994+0000 7fb113883640 1 --2- 172.21.15.79:0/3312770979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb10c0cf7a0 0x7fb10c06b6d0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fb10c06efd0 tx=0x7fb0fc02a140 comp rx=0 tx=0).stop 2024-04-25T02:16:43.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.994+0000 7fb113883640 1 -- 172.21.15.79:0/3312770979 shutdown_connections 2024-04-25T02:16:43.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.994+0000 7fb113883640 1 --2- 172.21.15.79:0/3312770979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb10c0cf7a0 0x7fb10c06b6d0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.994+0000 7fb113883640 1 --2- 172.21.15.79:0/3312770979 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10c06e6b0 0x7fb10c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.994+0000 7fb113883640 1 --2- 172.21.15.79:0/3312770979 >> v2:172.21.15.189:3300/0 conn(0x7fb10c06b2f0 0x7fb10c0b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.994+0000 7fb113883640 1 -- 172.21.15.79:0/3312770979 >> 172.21.15.79:0/3312770979 conn(0x7fb10c0b1cd0 msgr2=0x7fb10c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.994+0000 7fb113883640 1 -- 172.21.15.79:0/3312770979 shutdown_connections 2024-04-25T02:16:43.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.994+0000 7fb113883640 1 -- 172.21.15.79:0/3312770979 wait complete. 2024-04-25T02:16:43.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.995+0000 7fb113883640 1 Processor -- start 2024-04-25T02:16:43.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.995+0000 7fb113883640 1 -- start start 2024-04-25T02:16:43.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb113883640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb10c06b2f0 0x7fb10c148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb113883640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10c06e6b0 0x7fb10c15b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb113883640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb10c0cf7a0 0x7fb10c1e6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb113883640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c06cfe0 con 0x7fb10c0cf7a0 2024-04-25T02:16:43.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb113883640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c15f4c0 con 0x7fb10c06b2f0 2024-04-25T02:16:43.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb113883640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb10c06d160 con 0x7fb10c06e6b0 2024-04-25T02:16:43.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb111e20640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb10c0cf7a0 0x7fb10c1e6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb111e20640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb10c0cf7a0 0x7fb10c1e6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46548/0 (socket says 172.21.15.79:46548) 2024-04-25T02:16:43.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb111e20640 1 -- 172.21.15.79:0/1886321265 learned_addr learned my addr 172.21.15.79:0/1886321265 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb11161f640 1 --2- 172.21.15.79:0/1886321265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb10c06b2f0 0x7fb10c148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb110e1e640 1 --2- 172.21.15.79:0/1886321265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10c06e6b0 0x7fb10c15b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb111e20640 1 -- 172.21.15.79:0/1886321265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10c06e6b0 msgr2=0x7fb10c15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb111e20640 1 --2- 172.21.15.79:0/1886321265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10c06e6b0 0x7fb10c15b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb111e20640 1 -- 172.21.15.79:0/1886321265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb10c06b2f0 msgr2=0x7fb10c148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb111e20640 1 --2- 172.21.15.79:0/1886321265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb10c06b2f0 0x7fb10c148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.996+0000 7fb111e20640 1 -- 172.21.15.79:0/1886321265 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10c15b810 con 0x7fb10c0cf7a0 2024-04-25T02:16:43.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.997+0000 7fb111e20640 1 --2- 172.21.15.79:0/1886321265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb10c0cf7a0 0x7fb10c1e6bd0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fb10400cd90 tx=0x7fb10400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.997+0000 7fb101ffb640 1 -- 172.21.15.79:0/1886321265 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb104003b90 con 0x7fb10c0cf7a0 2024-04-25T02:16:43.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.997+0000 7fb101ffb640 1 -- 172.21.15.79:0/1886321265 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb104003d50 con 0x7fb10c0cf7a0 2024-04-25T02:16:43.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.997+0000 7fb113883640 1 -- 172.21.15.79:0/1886321265 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb10c1e74f0 con 0x7fb10c0cf7a0 2024-04-25T02:16:43.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.997+0000 7fb101ffb640 1 -- 172.21.15.79:0/1886321265 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb104004260 con 0x7fb10c0cf7a0 2024-04-25T02:16:43.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.997+0000 7fb113883640 1 -- 172.21.15.79:0/1886321265 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb10c1565e0 con 0x7fb10c0cf7a0 2024-04-25T02:16:43.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.998+0000 7fb101ffb640 1 -- 172.21.15.79:0/1886321265 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb104004400 con 0x7fb10c0cf7a0 2024-04-25T02:16:43.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.999+0000 7fb101ffb640 1 --2- 172.21.15.79:0/1886321265 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb0f006be60 0x7fb0f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.999+0000 7fb101ffb640 1 -- 172.21.15.79:0/1886321265 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7fb10408b840 con 0x7fb10c0cf7a0 2024-04-25T02:16:43.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.999+0000 7fb11161f640 1 --2- 172.21.15.79:0/1886321265 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb0f006be60 0x7fb0f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:42.999+0000 7fb11161f640 1 --2- 172.21.15.79:0/1886321265 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb0f006be60 0x7fb0f006e320 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0cc190 tx=0x7fb108008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.000+0000 7fb11658b740 1 Processor -- start 2024-04-25T02:16:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.000+0000 7fb11658b740 1 -- start start 2024-04-25T02:16:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.000+0000 7fb11658b740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56219998fd60 0x562199990140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.000+0000 7fb11658b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621999ad600 0x5621999adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.000+0000 7fb11658b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562199965a40 0x5621999abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.000+0000 7fb11658b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5621998c96b0 con 0x5621999ad600 2024-04-25T02:16:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.000+0000 7fb11658b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562199871880 con 0x562199965a40 2024-04-25T02:16:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.000+0000 7fb11658b740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5621998c5670 con 0x56219998fd60 2024-04-25T02:16:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb110e1e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621999ad600 0x5621999adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb110e1e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621999ad600 0x5621999adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46558/0 (socket says 172.21.15.79:46558) 2024-04-25T02:16:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb110e1e640 1 -- 172.21.15.79:0/3165978272 learned_addr learned my addr 172.21.15.79:0/3165978272 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb111e20640 1 --2- 172.21.15.79:0/3165978272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562199965a40 0x5621999abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb11161f640 1 --2- 172.21.15.79:0/3165978272 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56219998fd60 0x562199990140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb110e1e640 1 -- 172.21.15.79:0/3165978272 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56219998fd60 msgr2=0x562199990140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb110e1e640 1 --2- 172.21.15.79:0/3165978272 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56219998fd60 0x562199990140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb110e1e640 1 -- 172.21.15.79:0/3165978272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562199965a40 msgr2=0x5621999abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb110e1e640 1 --2- 172.21.15.79:0/3165978272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562199965a40 0x5621999abcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb110e1e640 1 -- 172.21.15.79:0/3165978272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621996a77d0 con 0x5621999ad600 2024-04-25T02:16:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb11161f640 1 --2- 172.21.15.79:0/3165978272 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56219998fd60 0x562199990140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb111e20640 1 --2- 172.21.15.79:0/3165978272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562199965a40 0x5621999abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb110e1e640 1 --2- 172.21.15.79:0/3165978272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621999ad600 0x5621999adb50 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc000c00 tx=0x7fb0fc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7a9ab742a01337 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb0f6ffd640 1 -- 172.21.15.79:0/3165978272 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc037040 con 0x5621999ad600 2024-04-25T02:16:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb0f6ffd640 1 -- 172.21.15.79:0/3165978272 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0fc0326c0 con 0x5621999ad600 2024-04-25T02:16:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.001+0000 7fb0f6ffd640 1 -- 172.21.15.79:0/3165978272 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc032ab0 con 0x5621999ad600 2024-04-25T02:16:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.002+0000 7fb11658b740 1 -- 172.21.15.79:0/3165978272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621999ad600 msgr2=0x5621999adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.002+0000 7fb11658b740 1 --2- 172.21.15.79:0/3165978272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621999ad600 0x5621999adb50 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc000c00 tx=0x7fb0fc02c000 comp rx=0 tx=0).stop 2024-04-25T02:16:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.002+0000 7fb11658b740 1 -- 172.21.15.79:0/3165978272 shutdown_connections 2024-04-25T02:16:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.002+0000 7fb11658b740 1 --2- 172.21.15.79:0/3165978272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562199965a40 0x5621999abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.002+0000 7fb11658b740 1 --2- 172.21.15.79:0/3165978272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621999ad600 0x5621999adb50 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.002+0000 7fb11658b740 1 --2- 172.21.15.79:0/3165978272 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56219998fd60 0x562199990140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.002+0000 7fb11658b740 1 -- 172.21.15.79:0/3165978272 >> 172.21.15.79:0/3165978272 conn(0x562199962600 msgr2=0x5621999aab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.002+0000 7fb11658b740 1 -- 172.21.15.79:0/3165978272 shutdown_connections 2024-04-25T02:16:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.002+0000 7fb11658b740 1 -- 172.21.15.79:0/3165978272 wait complete. 2024-04-25T02:16:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.002+0000 7fb11658b740 1 -- start start 2024-04-25T02:16:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.003+0000 7fb11658b740 1 Processor -- start 2024-04-25T02:16:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.003+0000 7fb11658b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56219998fd60 0x56219998c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.003+0000 7fb11658b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621999ad600 0x5621999a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.003+0000 7fb11658b740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5621999a2280 0x562199993590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.003+0000 7fb11658b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5621999667e0 con 0x56219998fd60 2024-04-25T02:16:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.003+0000 7fb11658b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562199884f50 con 0x5621999ad600 2024-04-25T02:16:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.003+0000 7fb11658b740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x562199960530 con 0x5621999a2280 2024-04-25T02:16:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.003+0000 7fb11658b740 10 client.0 _ll_register_callbacks cb 0x5621998c0000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:16:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb11161f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56219998fd60 0x56219998c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb11161f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56219998fd60 0x56219998c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46562/0 (socket says 172.21.15.79:46562) 2024-04-25T02:16:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb11161f640 1 -- 172.21.15.79:0/450479109 learned_addr learned my addr 172.21.15.79:0/450479109 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb110e1e640 1 --2- 172.21.15.79:0/450479109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621999ad600 0x5621999a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb111e20640 1 --2- 172.21.15.79:0/450479109 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5621999a2280 0x562199993590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb11161f640 1 -- 172.21.15.79:0/450479109 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5621999a2280 msgr2=0x562199993590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb11161f640 1 --2- 172.21.15.79:0/450479109 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5621999a2280 0x562199993590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb11161f640 1 -- 172.21.15.79:0/450479109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621999ad600 msgr2=0x5621999a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb11161f640 1 --2- 172.21.15.79:0/450479109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621999ad600 0x5621999a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb11161f640 1 -- 172.21.15.79:0/450479109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621995dd3f0 con 0x56219998fd60 2024-04-25T02:16:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb11161f640 1 --2- 172.21.15.79:0/450479109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56219998fd60 0x56219998c800 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fb108014530 tx=0x7fb108004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e31dc64de3216e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb0ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:16:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb0ebfff640 1 -- 172.21.15.79:0/450479109 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108005990 con 0x56219998fd60 2024-04-25T02:16:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb0ebfff640 1 -- 172.21.15.79:0/450479109 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7fb108005b30 con 0x56219998fd60 2024-04-25T02:16:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb11658b740 1 -- 172.21.15.79:0/450479109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0fc0326c0 con 0x56219998fd60 2024-04-25T02:16:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb0ebfff640 1 -- 172.21.15.79:0/450479109 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fb10802d050 con 0x56219998fd60 2024-04-25T02:16:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb11658b740 10 client.8586 fetch_fsmap learned FSMap version 68 2024-04-25T02:16:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb11658b740 1 -- 172.21.15.79:0/450479109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x56219959d0f0 con 0x56219998fd60 2024-04-25T02:16:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.004+0000 7fb0ebfff640 1 -- 172.21.15.79:0/450479109 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0fc0326c0 con 0x56219998fd60 2024-04-25T02:16:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.005+0000 7fb0ebfff640 1 -- 172.21.15.79:0/450479109 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7fb108030020 con 0x56219998fd60 2024-04-25T02:16:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.005+0000 7fb11658b740 10 client.8586 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T02:16:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.005+0000 7fb11658b740 10 client.8586 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T02:16:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.005+0000 7fb11658b740 20 client.8586 populate_metadata read hostname 'smithi079' 2024-04-25T02:16:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.005+0000 7fb11658b740 1 --2- 172.21.15.79:0/450479109 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x562199991f10 0x5621999be730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.005+0000 7fb11658b740 4 client.8586 mds_command: new command op to 8271 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:16:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.005+0000 7fb11658b740 1 -- 172.21.15.79:0/450479109 --> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621998d6bf0 con 0x562199991f10 2024-04-25T02:16:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.005+0000 7fb110e1e640 1 --2- 172.21.15.79:0/450479109 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x562199991f10 0x5621999be730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.005+0000 7fb0ebfff640 10 client.8586 ms_handle_connect on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.005+0000 7fb110e1e640 1 --2- 172.21.15.79:0/450479109 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x562199991f10 0x5621999be730 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10fd1433ea7ec61c server_cookie=7637e52bc66f843a in_seq=0 out_seq=0 2024-04-25T02:16:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.006+0000 7fb0ebfff640 1 -- 172.21.15.79:0/450479109 <== mds.0 v2:172.21.15.79:6834/2774759267 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5621998d6bf0 con 0x562199991f10 2024-04-25T02:16:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.006+0000 7fb0ebfff640 10 client.8586 handle_command_reply: tid=0 2024-04-25T02:16:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.006+0000 7fb11658b740 1 client.8586 shutdown 2024-04-25T02:16:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.006+0000 7fb11658b740 1 -- 172.21.15.79:0/450479109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56219998fd60 msgr2=0x56219998c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.006+0000 7fb11658b740 1 --2- 172.21.15.79:0/450479109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56219998fd60 0x56219998c800 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fb108014530 tx=0x7fb108004730 comp rx=0 tx=0).stop 2024-04-25T02:16:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.006+0000 7fb11658b740 1 -- 172.21.15.79:0/450479109 shutdown_connections 2024-04-25T02:16:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.006+0000 7fb11658b740 1 --2- 172.21.15.79:0/450479109 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x562199991f10 0x5621999be730 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.006+0000 7fb0ebfff640 0 client.8586 ms_handle_reset on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.006+0000 7fb11658b740 1 --2- 172.21.15.79:0/450479109 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5621999a2280 0x562199993590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.006+0000 7fb11658b740 1 --2- 172.21.15.79:0/450479109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621999ad600 0x5621999a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.006+0000 7fb11658b740 1 --2- 172.21.15.79:0/450479109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56219998fd60 0x56219998c800 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.006+0000 7fb11658b740 1 -- 172.21.15.79:0/450479109 >> 172.21.15.79:0/450479109 conn(0x562199965a40 msgr2=0x5621999aa410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.006+0000 7fb11658b740 1 -- 172.21.15.79:0/450479109 shutdown_connections 2024-04-25T02:16:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.006+0000 7fb11658b740 1 -- 172.21.15.79:0/450479109 wait complete. 2024-04-25T02:16:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.006+0000 7fb11658b740 20 client.8586 trim_cache size 0 max 16384 2024-04-25T02:16:43.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.023+0000 7fb11658b740 1 Processor -- start 2024-04-25T02:16:43.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.023+0000 7fb11658b740 1 -- start start 2024-04-25T02:16:43.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb11658b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56219998fd60 0x5621999cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb11658b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621999a2280 0x5621999a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb11658b740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5621999ad600 0x562199a1e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb11658b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c1fe500 con 0x56219998fd60 2024-04-25T02:16:43.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb11658b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c0cd390 con 0x5621999a2280 2024-04-25T02:16:43.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb11658b740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb10c0cc6f0 con 0x5621999ad600 2024-04-25T02:16:43.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb11161f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56219998fd60 0x5621999cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb11161f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56219998fd60 0x5621999cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46574/0 (socket says 172.21.15.79:46574) 2024-04-25T02:16:43.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb11161f640 1 -- 172.21.15.79:0/3740966489 learned_addr learned my addr 172.21.15.79:0/3740966489 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb110e1e640 1 --2- 172.21.15.79:0/3740966489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621999a2280 0x5621999a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb11161f640 1 -- 172.21.15.79:0/3740966489 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5621999ad600 msgr2=0x562199a1e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb111e20640 1 --2- 172.21.15.79:0/3740966489 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5621999ad600 0x562199a1e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb11161f640 1 --2- 172.21.15.79:0/3740966489 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5621999ad600 0x562199a1e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb11161f640 1 -- 172.21.15.79:0/3740966489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621999a2280 msgr2=0x5621999a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb11161f640 1 --2- 172.21.15.79:0/3740966489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621999a2280 0x5621999a9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb11161f640 1 -- 172.21.15.79:0/3740966489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621999a4490 con 0x56219998fd60 2024-04-25T02:16:43.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.024+0000 7fb110e1e640 1 --2- 172.21.15.79:0/3740966489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621999a2280 0x5621999a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:43.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.025+0000 7fb11161f640 1 --2- 172.21.15.79:0/3740966489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56219998fd60 0x5621999cf120 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fb108006fb0 tx=0x7fb108020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d26c152a23a8a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.025+0000 7fb0f67fc640 1 -- 172.21.15.79:0/3740966489 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108005990 con 0x56219998fd60 2024-04-25T02:16:43.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.025+0000 7fb0f67fc640 1 -- 172.21.15.79:0/3740966489 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb108005b30 con 0x56219998fd60 2024-04-25T02:16:43.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.025+0000 7fb0f67fc640 1 -- 172.21.15.79:0/3740966489 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108015920 con 0x56219998fd60 2024-04-25T02:16:43.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.025+0000 7fb11658b740 1 -- 172.21.15.79:0/3740966489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56219998fd60 msgr2=0x5621999cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.025+0000 7fb11658b740 1 --2- 172.21.15.79:0/3740966489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56219998fd60 0x5621999cf120 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fb108006fb0 tx=0x7fb108020000 comp rx=0 tx=0).stop 2024-04-25T02:16:43.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.025+0000 7fb11658b740 1 -- 172.21.15.79:0/3740966489 shutdown_connections 2024-04-25T02:16:43.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.025+0000 7fb11658b740 1 --2- 172.21.15.79:0/3740966489 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5621999ad600 0x562199a1e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.025+0000 7fb11658b740 1 --2- 172.21.15.79:0/3740966489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621999a2280 0x5621999a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.025+0000 7fb11658b740 1 --2- 172.21.15.79:0/3740966489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56219998fd60 0x5621999cf120 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.025+0000 7fb11658b740 1 -- 172.21.15.79:0/3740966489 >> 172.21.15.79:0/3740966489 conn(0x562199965a40 msgr2=0x5621999bde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.025+0000 7fb11658b740 1 -- 172.21.15.79:0/3740966489 shutdown_connections 2024-04-25T02:16:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.025+0000 7fb11658b740 1 -- 172.21.15.79:0/3740966489 wait complete. 2024-04-25T02:16:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.026+0000 7fb11658b740 1 -- start start 2024-04-25T02:16:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.026+0000 7fb11658b740 1 Processor -- start 2024-04-25T02:16:43.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb11658b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56219998fd60 0x562199a249d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb11658b740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5621999a2280 0x5621999a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb11658b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621999ad600 0x5621999a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb11658b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c0ccd40 con 0x5621999ad600 2024-04-25T02:16:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb11658b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5621999a5130 con 0x56219998fd60 2024-04-25T02:16:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb11658b740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5621999b3ef0 con 0x5621999a2280 2024-04-25T02:16:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb11658b740 10 client.0 _ll_register_callbacks cb 0x7fb10800a660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:16:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb111e20640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621999ad600 0x5621999a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb111e20640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621999ad600 0x5621999a0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46588/0 (socket says 172.21.15.79:46588) 2024-04-25T02:16:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb111e20640 1 -- 172.21.15.79:0/2093477143 learned_addr learned my addr 172.21.15.79:0/2093477143 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb11161f640 1 --2- 172.21.15.79:0/2093477143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56219998fd60 0x562199a249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb110e1e640 1 --2- 172.21.15.79:0/2093477143 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5621999a2280 0x5621999a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb111e20640 1 -- 172.21.15.79:0/2093477143 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5621999a2280 msgr2=0x5621999a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb111e20640 1 --2- 172.21.15.79:0/2093477143 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5621999a2280 0x5621999a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb111e20640 1 -- 172.21.15.79:0/2093477143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56219998fd60 msgr2=0x562199a249d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb111e20640 1 --2- 172.21.15.79:0/2093477143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56219998fd60 0x562199a249d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb111e20640 1 -- 172.21.15.79:0/2093477143 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56219998f590 con 0x5621999ad600 2024-04-25T02:16:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb111e20640 1 --2- 172.21.15.79:0/2093477143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621999ad600 0x5621999a0fe0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fb104055fe0 tx=0x7fb1040594e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579848d93f4dbbd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.027+0000 7fb0ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:16:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb0ebfff640 1 -- 172.21.15.79:0/2093477143 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb104076060 con 0x5621999ad600 2024-04-25T02:16:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb0ebfff640 1 -- 172.21.15.79:0/2093477143 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7fb1040622d0 con 0x5621999ad600 2024-04-25T02:16:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb11658b740 1 -- 172.21.15.79:0/2093477143 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb108005b30 con 0x5621999ad600 2024-04-25T02:16:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb0ebfff640 1 -- 172.21.15.79:0/2093477143 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fb104089070 con 0x5621999ad600 2024-04-25T02:16:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb11658b740 10 client.8592 fetch_fsmap learned FSMap version 68 2024-04-25T02:16:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb11658b740 1 -- 172.21.15.79:0/2093477143 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x5621999b3c90 con 0x5621999ad600 2024-04-25T02:16:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb0ebfff640 1 -- 172.21.15.79:0/2093477143 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb108005b30 con 0x5621999ad600 2024-04-25T02:16:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb0ebfff640 1 -- 172.21.15.79:0/2093477143 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7fb104058fd0 con 0x5621999ad600 2024-04-25T02:16:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb11658b740 10 client.8592 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T02:16:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb11658b740 10 client.8592 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T02:16:43.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb11658b740 20 client.8592 populate_metadata read hostname 'smithi079' 2024-04-25T02:16:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb11658b740 1 --2- 172.21.15.79:0/2093477143 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x562199967480 0x5621999cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb11658b740 4 client.8592 mds_command: new command op to 8271 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:16:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb11658b740 1 -- 172.21.15.79:0/2093477143 --> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5621998d0f40 con 0x562199967480 2024-04-25T02:16:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb11161f640 1 --2- 172.21.15.79:0/2093477143 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x562199967480 0x5621999cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb0ebfff640 10 client.8592 ms_handle_connect on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.028+0000 7fb11161f640 1 --2- 172.21.15.79:0/2093477143 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x562199967480 0x5621999cdbc0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e5433733aac0f2f server_cookie=20ed91da164f5c17 in_seq=0 out_seq=0 2024-04-25T02:16:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb0ebfff640 1 -- 172.21.15.79:0/2093477143 <== mds.0 v2:172.21.15.79:6834/2774759267 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5621998d0f40 con 0x562199967480 2024-04-25T02:16:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb0ebfff640 10 client.8592 handle_command_reply: tid=0 2024-04-25T02:16:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb11658b740 1 client.8592 shutdown 2024-04-25T02:16:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb11658b740 1 -- 172.21.15.79:0/2093477143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621999ad600 msgr2=0x5621999a0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb11658b740 1 --2- 172.21.15.79:0/2093477143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621999ad600 0x5621999a0fe0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fb104055fe0 tx=0x7fb1040594e0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb11658b740 1 -- 172.21.15.79:0/2093477143 shutdown_connections 2024-04-25T02:16:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb11658b740 1 --2- 172.21.15.79:0/2093477143 >> [v2:172.21.15.79:6834/2774759267,v1:172.21.15.79:6837/2774759267] conn(0x562199967480 0x5621999cdbc0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb11658b740 1 --2- 172.21.15.79:0/2093477143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621999ad600 0x5621999a0fe0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb11658b740 1 --2- 172.21.15.79:0/2093477143 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5621999a2280 0x5621999a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb11658b740 1 --2- 172.21.15.79:0/2093477143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56219998fd60 0x562199a249d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb0ebfff640 0 client.8592 ms_handle_reset on v2:172.21.15.79:6834/2774759267 2024-04-25T02:16:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb11658b740 1 -- 172.21.15.79:0/2093477143 >> 172.21.15.79:0/2093477143 conn(0x562199965a40 msgr2=0x5621999a9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb11658b740 1 -- 172.21.15.79:0/2093477143 shutdown_connections 2024-04-25T02:16:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb11658b740 1 -- 172.21.15.79:0/2093477143 wait complete. 2024-04-25T02:16:43.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb11658b740 20 client.8592 trim_cache size 0 max 16384 2024-04-25T02:16:43.043 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:16:43.043 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-04-25T02:16:43.043 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-04-25T02:16:43.043 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:16:43.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb113883640 1 -- 172.21.15.79:0/1886321265 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb0f006be60 msgr2=0x7fb0f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb113883640 1 --2- 172.21.15.79:0/1886321265 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb0f006be60 0x7fb0f006e320 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0cc190 tx=0x7fb108008040 comp rx=0 tx=0).stop 2024-04-25T02:16:43.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb113883640 1 -- 172.21.15.79:0/1886321265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb10c0cf7a0 msgr2=0x7fb10c1e6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb113883640 1 --2- 172.21.15.79:0/1886321265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb10c0cf7a0 0x7fb10c1e6bd0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fb10400cd90 tx=0x7fb10400a660 comp rx=0 tx=0).stop 2024-04-25T02:16:43.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb113883640 1 -- 172.21.15.79:0/1886321265 shutdown_connections 2024-04-25T02:16:43.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb113883640 1 --2- 172.21.15.79:0/1886321265 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb0f006be60 0x7fb0f006e320 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb113883640 1 --2- 172.21.15.79:0/1886321265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb10c0cf7a0 0x7fb10c1e6bd0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb113883640 1 --2- 172.21.15.79:0/1886321265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10c06e6b0 0x7fb10c15b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.029+0000 7fb113883640 1 --2- 172.21.15.79:0/1886321265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb10c06b2f0 0x7fb10c148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.030+0000 7fb113883640 1 -- 172.21.15.79:0/1886321265 >> 172.21.15.79:0/1886321265 conn(0x7fb10c0b1cd0 msgr2=0x7fb10c158f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.030+0000 7fb113883640 1 -- 172.21.15.79:0/1886321265 shutdown_connections 2024-04-25T02:16:43.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.030+0000 7fb113883640 1 -- 172.21.15.79:0/1886321265 wait complete. 2024-04-25T02:16:43.046 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T02:16:43.147 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:16:43.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.240+0000 7f41fdc8c640 1 Processor -- start 2024-04-25T02:16:43.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.240+0000 7f41fdc8c640 1 -- start start 2024-04-25T02:16:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.241+0000 7f41fdc8c640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f41f80b3570 0x7f41f80d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.241+0000 7f41fdc8c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41f80b3020 0x7f41f80d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.241+0000 7f41fdc8c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f806c380 con 0x7f41f815e4d0 2024-04-25T02:16:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.241+0000 7f41fdc8c640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f41f80d1660 con 0x7f41f80b3570 2024-04-25T02:16:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.241+0000 7f41fdc8c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f41f80d1380 con 0x7f41f80b3020 2024-04-25T02:16:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.242+0000 7f41eeffd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f41f80b3570 0x7f41f80d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.242+0000 7f41f7fff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41f80b3020 0x7f41f80d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.242+0000 7f41f77fe640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f41f815e4d0 0x7f41f806bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:35008/0 (socket says 172.21.15.79:35008) 2024-04-25T02:16:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.242+0000 7f41f77fe640 1 -- 172.21.15.79:0/897725528 learned_addr learned my addr 172.21.15.79:0/897725528 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.242+0000 7f41f6ffd640 1 -- 172.21.15.79:0/897725528 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4291949279 0 0) 0x7f41f806c380 con 0x7f41f815e4d0 2024-04-25T02:16:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.242+0000 7f41f6ffd640 1 -- 172.21.15.79:0/897725528 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41e4003520 con 0x7f41f815e4d0 2024-04-25T02:16:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.242+0000 7f41eeffd640 1 -- 172.21.15.79:0/897725528 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41f80b3020 msgr2=0x7f41f80d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.242+0000 7f41eeffd640 1 --2- 172.21.15.79:0/897725528 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41f80b3020 0x7f41f80d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.242+0000 7f41eeffd640 1 -- 172.21.15.79:0/897725528 >> v1:172.21.15.189:6789/0 conn(0x7f41f815e4d0 legacy=0x7f41f806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.242+0000 7f41eeffd640 1 -- 172.21.15.79:0/897725528 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f80cede0 con 0x7f41f80b3570 2024-04-25T02:16:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.242+0000 7f41f7fff640 1 --2- 172.21.15.79:0/897725528 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41f80b3020 0x7f41f80d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:16:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.243+0000 7f41eeffd640 1 --2- 172.21.15.79:0/897725528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41f80b3570 0x7f41f80d2710 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f41e00097d0 tx=0x7f41e002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70ffd7ff957dea82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.243+0000 7f41f6ffd640 1 -- 172.21.15.79:0/897725528 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0037070 con 0x7f41f80b3570 2024-04-25T02:16:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.243+0000 7f41f6ffd640 1 -- 172.21.15.79:0/897725528 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e0032440 con 0x7f41f80b3570 2024-04-25T02:16:43.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.243+0000 7f41f6ffd640 1 -- 172.21.15.79:0/897725528 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e00327f0 con 0x7f41f80b3570 2024-04-25T02:16:43.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.243+0000 7f41fdc8c640 1 -- 172.21.15.79:0/897725528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41f80b3570 msgr2=0x7f41f80d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.243+0000 7f41fdc8c640 1 --2- 172.21.15.79:0/897725528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41f80b3570 0x7f41f80d2710 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f41e00097d0 tx=0x7f41e002a1c0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.243+0000 7f41fdc8c640 1 -- 172.21.15.79:0/897725528 shutdown_connections 2024-04-25T02:16:43.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.243+0000 7f41fdc8c640 1 --2- 172.21.15.79:0/897725528 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41f80b3020 0x7f41f80d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.243+0000 7f41fdc8c640 1 --2- 172.21.15.79:0/897725528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41f80b3570 0x7f41f80d2710 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.243+0000 7f41fdc8c640 1 -- 172.21.15.79:0/897725528 >> 172.21.15.79:0/897725528 conn(0x7f41f809d460 msgr2=0x7f41f80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.243+0000 7f41fdc8c640 1 -- 172.21.15.79:0/897725528 shutdown_connections 2024-04-25T02:16:43.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.243+0000 7f41fdc8c640 1 -- 172.21.15.79:0/897725528 wait complete. 2024-04-25T02:16:43.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.244+0000 7f41fdc8c640 1 Processor -- start 2024-04-25T02:16:43.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.245+0000 7f41fdc8c640 1 -- start start 2024-04-25T02:16:43.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.245+0000 7f41fdc8c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41f80b3020 0x7f41f814d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.245+0000 7f41fdc8c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41f80b3570 0x7f41f814ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.245+0000 7f41fdc8c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f815e4d0 0x7f41f80b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.245+0000 7f41fdc8c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f41f80d20d0 con 0x7f41f815e4d0 2024-04-25T02:16:43.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.245+0000 7f41fdc8c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f41f815e8b0 con 0x7f41f80b3020 2024-04-25T02:16:43.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.245+0000 7f41fdc8c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f41f80d2250 con 0x7f41f80b3570 2024-04-25T02:16:43.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41f7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f815e4d0 0x7f41f80b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41f7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f815e4d0 0x7f41f80b3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46594/0 (socket says 172.21.15.79:46594) 2024-04-25T02:16:43.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41f7fff640 1 -- 172.21.15.79:0/3254485224 learned_addr learned my addr 172.21.15.79:0/3254485224 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41eeffd640 1 --2- 172.21.15.79:0/3254485224 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41f80b3570 0x7f41f814ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41f77fe640 1 --2- 172.21.15.79:0/3254485224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41f80b3020 0x7f41f814d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41f7fff640 1 -- 172.21.15.79:0/3254485224 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41f80b3570 msgr2=0x7f41f814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41f7fff640 1 --2- 172.21.15.79:0/3254485224 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41f80b3570 0x7f41f814ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41f7fff640 1 -- 172.21.15.79:0/3254485224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41f80b3020 msgr2=0x7f41f814d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41f7fff640 1 --2- 172.21.15.79:0/3254485224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41f80b3020 0x7f41f814d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41f7fff640 1 -- 172.21.15.79:0/3254485224 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f814b190 con 0x7f41f815e4d0 2024-04-25T02:16:43.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41f7fff640 1 --2- 172.21.15.79:0/3254485224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f815e4d0 0x7f41f80b3ea0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f41f000efc0 tx=0x7f41f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41f4ff9640 1 -- 172.21.15.79:0/3254485224 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f0018030 con 0x7f41f815e4d0 2024-04-25T02:16:43.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41f4ff9640 1 -- 172.21.15.79:0/3254485224 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f000cdf0 con 0x7f41f815e4d0 2024-04-25T02:16:43.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41f4ff9640 1 -- 172.21.15.79:0/3254485224 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f0003bb0 con 0x7f41f815e4d0 2024-04-25T02:16:43.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41fdc8c640 1 -- 172.21.15.79:0/3254485224 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f814dc20 con 0x7f41f815e4d0 2024-04-25T02:16:43.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.246+0000 7f41fdc8c640 1 -- 172.21.15.79:0/3254485224 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f814e1e0 con 0x7f41f815e4d0 2024-04-25T02:16:43.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.247+0000 7f41fdc8c640 1 -- 172.21.15.79:0/3254485224 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f80690a0 con 0x7f41f815e4d0 2024-04-25T02:16:43.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.248+0000 7f41f4ff9640 1 -- 172.21.15.79:0/3254485224 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41f0005d10 con 0x7f41f815e4d0 2024-04-25T02:16:43.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.248+0000 7f41f4ff9640 1 --2- 172.21.15.79:0/3254485224 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41d806be30 0x7f41d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.248+0000 7f41f77fe640 1 --2- 172.21.15.79:0/3254485224 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41d806be30 0x7f41d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.248+0000 7f41f4ff9640 1 -- 172.21.15.79:0/3254485224 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f41f008b630 con 0x7f41f815e4d0 2024-04-25T02:16:43.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.249+0000 7f41f77fe640 1 --2- 172.21.15.79:0/3254485224 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41d806be30 0x7f41d806e2f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f41e8005880 tx=0x7f41e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.253+0000 7f41f4ff9640 1 -- 172.21.15.79:0/3254485224 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f41f0022070 con 0x7f41f815e4d0 2024-04-25T02:16:43.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.460+0000 7f41fdc8c640 1 -- 172.21.15.79:0/3254485224 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f41f80d1920 con 0x7f41f815e4d0 2024-04-25T02:16:43.465 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:16:43.460+0000 7fb0c50c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:16:43.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.461+0000 7f41f4ff9640 1 -- 172.21.15.79:0/3254485224 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) ==== 161+0+0 (secure 0 0 0) 0x7f41f0010040 con 0x7f41f815e4d0 2024-04-25T02:16:43.466 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:16:43.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.465+0000 7f41fdc8c640 1 -- 172.21.15.79:0/3254485224 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41d806be30 msgr2=0x7f41d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.465+0000 7f41fdc8c640 1 --2- 172.21.15.79:0/3254485224 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41d806be30 0x7f41d806e2f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f41e8005880 tx=0x7f41e8009040 comp rx=0 tx=0).stop 2024-04-25T02:16:43.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.465+0000 7f41fdc8c640 1 -- 172.21.15.79:0/3254485224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f815e4d0 msgr2=0x7f41f80b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.465+0000 7f41fdc8c640 1 --2- 172.21.15.79:0/3254485224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f815e4d0 0x7f41f80b3ea0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f41f000efc0 tx=0x7f41f000c490 comp rx=0 tx=0).stop 2024-04-25T02:16:43.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.465+0000 7f41fdc8c640 1 -- 172.21.15.79:0/3254485224 shutdown_connections 2024-04-25T02:16:43.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.465+0000 7f41fdc8c640 1 --2- 172.21.15.79:0/3254485224 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41d806be30 0x7f41d806e2f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.465+0000 7f41fdc8c640 1 --2- 172.21.15.79:0/3254485224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41f815e4d0 0x7f41f80b3ea0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.465+0000 7f41fdc8c640 1 --2- 172.21.15.79:0/3254485224 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41f80b3570 0x7f41f814ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.465+0000 7f41fdc8c640 1 --2- 172.21.15.79:0/3254485224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41f80b3020 0x7f41f814d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.465+0000 7f41fdc8c640 1 -- 172.21.15.79:0/3254485224 >> 172.21.15.79:0/3254485224 conn(0x7f41f809d460 msgr2=0x7f41f80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.465+0000 7f41fdc8c640 1 -- 172.21.15.79:0/3254485224 shutdown_connections 2024-04-25T02:16:43.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.465+0000 7f41fdc8c640 1 -- 172.21.15.79:0/3254485224 wait complete. 2024-04-25T02:16:43.472 INFO:tasks.ceph.mds.c.smithi079.stderr: -7025> 2024-04-25T02:16:04.274+0000 7f615581d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:16:43.481 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2024-04-25T02:16:43.504 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-04-25T02:16:43.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.519+0000 7fad6de19280 1 -- start start 2024-04-25T02:16:43.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.519+0000 7fad6de19280 1 Processor -- start 2024-04-25T02:16:43.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6de19280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d9a8284c00 0x55d9a82f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6de19280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d9a8285800 0x55d9a82f5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6de19280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a8285c00 0x55d9a82f5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6de19280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d9a9066180 con 0x55d9a8285c00 2024-04-25T02:16:43.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6de19280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d9a82e6900 con 0x55d9a8284c00 2024-04-25T02:16:43.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6de19280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55d9a82e6480 con 0x55d9a8285800 2024-04-25T02:16:43.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6c154640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a8285c00 0x55d9a82f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6c154640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a8285c00 0x55d9a82f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35480/0 (socket says 172.21.15.79:35480) 2024-04-25T02:16:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6c154640 1 -- 172.21.15.79:0/1676032869 learned_addr learned my addr 172.21.15.79:0/1676032869 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6b152640 1 --2- 172.21.15.79:0/1676032869 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d9a8285800 0x55d9a82f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6b953640 1 --2- 172.21.15.79:0/1676032869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d9a8284c00 0x55d9a82f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6c154640 1 -- 172.21.15.79:0/1676032869 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d9a8285800 msgr2=0x55d9a82f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6c154640 1 --2- 172.21.15.79:0/1676032869 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d9a8285800 0x55d9a82f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6c154640 1 -- 172.21.15.79:0/1676032869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d9a8284c00 msgr2=0x55d9a82f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6c154640 1 --2- 172.21.15.79:0/1676032869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d9a8284c00 0x55d9a82f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6c154640 1 -- 172.21.15.79:0/1676032869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9a82ba780 con 0x55d9a8285c00 2024-04-25T02:16:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6c154640 1 --2- 172.21.15.79:0/1676032869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a8285c00 0x55d9a82f5080 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x55d9a90a5380 tx=0x55d9a901a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617dae607e9175a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6914e640 1 -- 172.21.15.79:0/1676032869 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d9a82aa680 con 0x55d9a8285c00 2024-04-25T02:16:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6914e640 1 -- 172.21.15.79:0/1676032869 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d9a82b0700 con 0x55d9a8285c00 2024-04-25T02:16:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6914e640 1 -- 172.21.15.79:0/1676032869 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d9a82aab60 con 0x55d9a8285c00 2024-04-25T02:16:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6de19280 1 -- 172.21.15.79:0/1676032869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9a82bb4a0 con 0x55d9a8285c00 2024-04-25T02:16:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6de19280 1 -- 172.21.15.79:0/1676032869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55d9a82ba000 con 0x55d9a8285c00 2024-04-25T02:16:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6de19280 4 waiting for MDS map... 2024-04-25T02:16:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.520+0000 7fad6914e640 1 -- 172.21.15.79:0/1676032869 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x55d9a9146a00 con 0x55d9a8285c00 2024-04-25T02:16:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.521+0000 7fad6914e640 1 -- 172.21.15.79:0/1676032869 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 2885+0+0 (secure 0 0 0) 0x55d9a82df180 con 0x55d9a8285c00 2024-04-25T02:16:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.521+0000 7fad6de19280 4 Got MDS map 69 2024-04-25T02:16:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.521+0000 7fad6de19280 10 main: JournalTool::main 2024-04-25T02:16:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.521+0000 7fad6de19280 4 main: JournalTool: connecting to RADOS... 2024-04-25T02:16:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.521+0000 7fad6de19280 1 Processor -- start 2024-04-25T02:16:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.521+0000 7fad6de19280 1 -- start start 2024-04-25T02:16:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6de19280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a9143400 0x55d9a82f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6de19280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d9a9143800 0x55d9a82f4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6de19280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d9a9143c00 0x55d9a82f6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6de19280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d9a82e6180 con 0x55d9a9143400 2024-04-25T02:16:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6de19280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d9a9066d80 con 0x55d9a9143800 2024-04-25T02:16:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6de19280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55d9a9066f00 con 0x55d9a9143c00 2024-04-25T02:16:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6b152640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a9143400 0x55d9a82f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6b152640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a9143400 0x55d9a82f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35494/0 (socket says 172.21.15.79:35494) 2024-04-25T02:16:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6b152640 1 -- 172.21.15.79:0/884197213 learned_addr learned my addr 172.21.15.79:0/884197213 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6b953640 1 --2- 172.21.15.79:0/884197213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d9a9143800 0x55d9a82f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6b152640 1 --2- 172.21.15.79:0/884197213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d9a9143c00 0x55d9a82f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6b152640 1 -- 172.21.15.79:0/884197213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d9a9143c00 msgr2=0x55d9a82f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6b152640 1 --2- 172.21.15.79:0/884197213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d9a9143c00 0x55d9a82f6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6b152640 1 -- 172.21.15.79:0/884197213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d9a9143800 msgr2=0x55d9a82f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6b152640 1 --2- 172.21.15.79:0/884197213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d9a9143800 0x55d9a82f4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6b152640 1 -- 172.21.15.79:0/884197213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9a82ba3c0 con 0x55d9a9143400 2024-04-25T02:16:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6b953640 1 --2- 172.21.15.79:0/884197213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d9a9143800 0x55d9a82f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6b152640 1 --2- 172.21.15.79:0/884197213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a9143400 0x55d9a82f4b00 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x55d9a9158660 tx=0x55d9a9018b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b04ab5b930aae7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6714a640 1 -- 172.21.15.79:0/884197213 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d9a82aa9c0 con 0x55d9a9143400 2024-04-25T02:16:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6714a640 1 -- 172.21.15.79:0/884197213 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d9a82b0fc0 con 0x55d9a9143400 2024-04-25T02:16:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.522+0000 7fad6714a640 1 -- 172.21.15.79:0/884197213 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d9a82aa680 con 0x55d9a9143400 2024-04-25T02:16:43.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.523+0000 7fad6de19280 1 -- 172.21.15.79:0/884197213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a9143400 msgr2=0x55d9a82f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.523+0000 7fad6de19280 1 --2- 172.21.15.79:0/884197213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a9143400 0x55d9a82f4b00 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x55d9a9158660 tx=0x55d9a9018b40 comp rx=0 tx=0).stop 2024-04-25T02:16:43.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.523+0000 7fad6de19280 1 -- 172.21.15.79:0/884197213 shutdown_connections 2024-04-25T02:16:43.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.523+0000 7fad6de19280 1 --2- 172.21.15.79:0/884197213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d9a9143c00 0x55d9a82f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.523+0000 7fad6de19280 1 --2- 172.21.15.79:0/884197213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d9a9143800 0x55d9a82f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.523+0000 7fad6de19280 1 --2- 172.21.15.79:0/884197213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a9143400 0x55d9a82f4b00 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.523+0000 7fad6de19280 1 -- 172.21.15.79:0/884197213 >> 172.21.15.79:0/884197213 conn(0x55d9a9143000 msgr2=0x55d9a8371000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.523+0000 7fad6de19280 1 -- 172.21.15.79:0/884197213 shutdown_connections 2024-04-25T02:16:43.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.523+0000 7fad6de19280 1 -- 172.21.15.79:0/884197213 wait complete. 2024-04-25T02:16:43.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.523+0000 7fad6de19280 1 Processor -- start 2024-04-25T02:16:43.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.523+0000 7fad6de19280 1 -- start start 2024-04-25T02:16:43.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6de19280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a9143400 0x55d9a82f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6de19280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d9a9143800 0x55d9a82f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6de19280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d9a9143c00 0x55d9a82f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6de19280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d9a9067200 con 0x55d9a9143400 2024-04-25T02:16:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6de19280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d9a9067080 con 0x55d9a9143800 2024-04-25T02:16:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6de19280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55d9a9067380 con 0x55d9a9143c00 2024-04-25T02:16:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6b152640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a9143400 0x55d9a82f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6b152640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a9143400 0x55d9a82f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35510/0 (socket says 172.21.15.79:35510) 2024-04-25T02:16:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6b152640 1 -- 172.21.15.79:0/2555390079 learned_addr learned my addr 172.21.15.79:0/2555390079 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6b152640 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d9a9143c00 0x55d9a82f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6b953640 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d9a9143800 0x55d9a82f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6b152640 1 -- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d9a9143c00 msgr2=0x55d9a82f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6b152640 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d9a9143c00 0x55d9a82f6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6b152640 1 -- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d9a9143800 msgr2=0x55d9a82f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6b152640 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d9a9143800 0x55d9a82f4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6b152640 1 -- 172.21.15.79:0/2555390079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9a82ba780 con 0x55d9a9143400 2024-04-25T02:16:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad6b152640 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a9143400 0x55d9a82f4b00 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x55d9a9159320 tx=0x55d9a901a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad65947640 1 -- 172.21.15.79:0/2555390079 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d9a82aab60 con 0x55d9a9143400 2024-04-25T02:16:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.524+0000 7fad65947640 1 -- 172.21.15.79:0/2555390079 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d9a82b0e00 con 0x55d9a9143400 2024-04-25T02:16:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.525+0000 7fad6de19280 1 -- 172.21.15.79:0/2555390079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9a82bb4a0 con 0x55d9a9143400 2024-04-25T02:16:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.525+0000 7fad65947640 1 -- 172.21.15.79:0/2555390079 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d9a82aa4e0 con 0x55d9a9143400 2024-04-25T02:16:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.525+0000 7fad6de19280 1 -- 172.21.15.79:0/2555390079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9a82ba960 con 0x55d9a9143400 2024-04-25T02:16:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.525+0000 7fad6de19280 4 main: JournalTool: resolving pool 14 2024-04-25T02:16:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.526+0000 7fad65947640 1 -- 172.21.15.79:0/2555390079 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55d9a904ac00 con 0x55d9a9143400 2024-04-25T02:16:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.526+0000 7fad65947640 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55d9a85f4000 0x55d9a85fa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.526+0000 7fad65947640 1 -- 172.21.15.79:0/2555390079 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x55d9a91cc600 con 0x55d9a9143400 2024-04-25T02:16:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.526+0000 7fad6b953640 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55d9a85f4000 0x55d9a85fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.526+0000 7fad6de19280 4 main: JournalTool: creating IoCtx.. 2024-04-25T02:16:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.526+0000 7fad6de19280 4 main: Executing for rank 0 2024-04-25T02:16:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.526+0000 7fad6de19280 4 Filtering by inode '1099511627777' 2024-04-25T02:16:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.526+0000 7fad6de19280 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x55d9a85f4400 0x55d9a82f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.526+0000 7fad6de19280 1 -- 172.21.15.79:0/2555390079 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) -- 0x55d9a85f4800 con 0x55d9a85f4400 2024-04-25T02:16:43.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.526+0000 7fad6b152640 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x55d9a85f4400 0x55d9a82f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.526+0000 7fad6b953640 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55d9a85f4000 0x55d9a85fa000 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x55d9a83886f0 tx=0x55d9a915b1a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.527+0000 7fad6b152640 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x55d9a85f4400 0x55d9a82f6680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.529+0000 7fad6b152640 1 -- 172.21.15.79:0/2555390079 <== osd.7 v2:172.21.15.189:6824/3421948491 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55d9a8386000 con 0x55d9a85f4400 2024-04-25T02:16:43.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.529+0000 7fad6de19280 4 Pointer 400.00000000 is readable 2024-04-25T02:16:43.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.529+0000 7fad6de19280 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-25T02:16:43.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.529+0000 7fad6de19280 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55d9a85f4c00 0x55d9a82f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.529+0000 7fad6de19280 1 -- 172.21.15.79:0/2555390079 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:2 14.14 14:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) -- 0x55d9a85f5000 con 0x55d9a85f4c00 2024-04-25T02:16:43.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.530+0000 7fad6c154640 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55d9a85f4c00 0x55d9a82f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.530+0000 7fad6c154640 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55d9a85f4c00 0x55d9a82f6c00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.530+0000 7fad6c154640 1 -- 172.21.15.79:0/2555390079 <== osd.4 v2:172.21.15.189:6800/1910571406 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55d9a8386500 con 0x55d9a85f4c00 2024-04-25T02:16:43.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.530+0000 7fad6de19280 10 Header 0x400000 0x407d21 0x40809d 2024-04-25T02:16:43.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.531+0000 7fad6de19280 10 Starting journal scan from offset 0x407d21 2024-04-25T02:16:43.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.531+0000 7fad6de19280 1 -- 172.21.15.79:0/2555390079 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:3 14.14 14:2e2fa760:::200.00000001:head [read 32033~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) -- 0x55d9a85f5400 con 0x55d9a85f4c00 2024-04-25T02:16:43.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.531+0000 7fad6c154640 1 -- 172.21.15.79:0/2555390079 <== osd.4 v2:172.21.15.189:6800/1910571406 2 ==== osd_op_reply(3 200.00000001 [read 32033~892 out=892b] v0'0 uv28 ondisk = 0) ==== 156+0+892 (crc 0 0 0) 0x55d9a8386500 con 0x55d9a85f4c00 2024-04-25T02:16:43.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.531+0000 7fad6de19280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-25T02:16:43.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.531+0000 7fad6de19280 10 Parsing data, 0x37c bytes available 2024-04-25T02:16:43.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.531+0000 7fad6de19280 10 Attempting decode at 0x407d21 2024-04-25T02:16:43.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.531+0000 7fad6de19280 10 Consumed 0x37c bytes 2024-04-25T02:16:43.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.531+0000 7fad6de19280 10 Valid entry at 0x407d21 2024-04-25T02:16:43.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.531+0000 7fad6de19280 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55d9a860e000 0x55d9a82f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.531+0000 7fad6de19280 1 -- 172.21.15.79:0/2555390079 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:4 14.1b 14:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) -- 0x55d9a860e400 con 0x55d9a860e000 2024-04-25T02:16:43.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.531+0000 7fad6b953640 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55d9a860e000 0x55d9a82f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6b953640 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55d9a860e000 0x55d9a82f7180 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6b953640 1 -- 172.21.15.79:0/2555390079 <== osd.1 v2:172.21.15.79:6816/2311596149 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55d9a8386780 con 0x55d9a860e000 2024-04-25T02:16:43.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 4 Reached end of journal objects 2024-04-25T02:16:43.543 INFO:teuthology.orchestra.run.smithi079.stdout:Events by type: 2024-04-25T02:16:43.543 INFO:teuthology.orchestra.run.smithi079.stdout:Errors: 0 2024-04-25T02:16:43.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 4 Scanned objects, 0 missing, 1 valid 2024-04-25T02:16:43.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 4 Events scanned, 0 gaps 2024-04-25T02:16:43.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 4 Found 1 valid events 2024-04-25T02:16:43.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 4 Selected 0 events events for processing 2024-04-25T02:16:43.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 4 0 events 2024-04-25T02:16:43.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 -- 172.21.15.79:0/2555390079 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55d9a860e000 msgr2=0x55d9a82f7180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55d9a860e000 0x55d9a82f7180 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 -- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55d9a85f4c00 msgr2=0x55d9a82f6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55d9a85f4c00 0x55d9a82f6c00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 -- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x55d9a85f4400 msgr2=0x55d9a82f6680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x55d9a85f4400 0x55d9a82f6680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6b953640 1 -- 172.21.15.79:0/2555390079 reap_dead start 2024-04-25T02:16:43.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 -- 172.21.15.79:0/2555390079 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55d9a85f4000 msgr2=0x55d9a85fa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55d9a85f4000 0x55d9a85fa000 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x55d9a83886f0 tx=0x55d9a915b1a0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 -- 172.21.15.79:0/2555390079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a9143400 msgr2=0x55d9a82f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a9143400 0x55d9a82f4b00 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x55d9a9159320 tx=0x55d9a901a180 comp rx=0 tx=0).stop 2024-04-25T02:16:43.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 -- 172.21.15.79:0/2555390079 shutdown_connections 2024-04-25T02:16:43.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55d9a85f4000 0x55d9a85fa000 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 --2- 172.21.15.79:0/2555390079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a9143400 0x55d9a82f4b00 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 -- 172.21.15.79:0/2555390079 >> 172.21.15.79:0/2555390079 conn(0x55d9a9143000 msgr2=0x55d9a8371000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 -- 172.21.15.79:0/2555390079 shutdown_connections 2024-04-25T02:16:43.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 -- 172.21.15.79:0/2555390079 wait complete. 2024-04-25T02:16:43.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 -- 172.21.15.79:0/1676032869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a8285c00 msgr2=0x55d9a82f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 --2- 172.21.15.79:0/1676032869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a8285c00 0x55d9a82f5080 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x55d9a90a5380 tx=0x55d9a901a120 comp rx=0 tx=0).stop 2024-04-25T02:16:43.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 -- 172.21.15.79:0/1676032869 shutdown_connections 2024-04-25T02:16:43.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 --2- 172.21.15.79:0/1676032869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9a8285c00 0x55d9a82f5080 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 --2- 172.21.15.79:0/1676032869 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d9a8285800 0x55d9a82f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 --2- 172.21.15.79:0/1676032869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d9a8284c00 0x55d9a82f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 -- 172.21.15.79:0/1676032869 >> 172.21.15.79:0/1676032869 conn(0x55d9a8285000 msgr2=0x55d9a8370800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 -- 172.21.15.79:0/1676032869 shutdown_connections 2024-04-25T02:16:43.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.532+0000 7fad6de19280 1 -- 172.21.15.79:0/1676032869 wait complete. 2024-04-25T02:16:43.549 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.067620, result: Events by type: Errors: 0 2024-04-25T02:16:43.549 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2024-04-25T02:16:43.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.624+0000 7f570bf10280 1 -- start start 2024-04-25T02:16:43.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.624+0000 7f570bf10280 1 Processor -- start 2024-04-25T02:16:43.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.624+0000 7f570bf10280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6788c800 0x562b66b2eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.624+0000 7f570bf10280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562b6788dc00 0x562b66b2fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.624+0000 7f570bf10280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6788d400 0x562b66b2f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.624+0000 7f570bf10280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562b66c32000 con 0x562b6788d400 2024-04-25T02:16:43.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.624+0000 7f570bf10280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562b66c32180 con 0x562b6788c800 2024-04-25T02:16:43.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.624+0000 7f570bf10280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x562b66c32300 con 0x562b6788dc00 2024-04-25T02:16:43.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.624+0000 7f570aebf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6788d400 0x562b66b2f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.624+0000 7f570aebf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6788d400 0x562b66b2f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35526/0 (socket says 172.21.15.79:35526) 2024-04-25T02:16:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.624+0000 7f570aebf640 1 -- 172.21.15.79:0/2096316463 learned_addr learned my addr 172.21.15.79:0/2096316463 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f570a6be640 1 --2- 172.21.15.79:0/2096316463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6788c800 0x562b66b2eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f5709ebd640 1 --2- 172.21.15.79:0/2096316463 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562b6788dc00 0x562b66b2fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f570aebf640 1 -- 172.21.15.79:0/2096316463 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562b6788dc00 msgr2=0x562b66b2fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f570aebf640 1 --2- 172.21.15.79:0/2096316463 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562b6788dc00 0x562b66b2fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f570aebf640 1 -- 172.21.15.79:0/2096316463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6788c800 msgr2=0x562b66b2eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f570aebf640 1 --2- 172.21.15.79:0/2096316463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6788c800 0x562b66b2eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f570aebf640 1 -- 172.21.15.79:0/2096316463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b66af4780 con 0x562b6788d400 2024-04-25T02:16:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f570aebf640 1 --2- 172.21.15.79:0/2096316463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6788d400 0x562b66b2f080 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x562b66bc2030 tx=0x562b678540c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d8276584a610dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f5707eb9640 1 -- 172.21.15.79:0/2096316463 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562b66ae4b60 con 0x562b6788d400 2024-04-25T02:16:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f5707eb9640 1 -- 172.21.15.79:0/2096316463 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562b66aeaa80 con 0x562b6788d400 2024-04-25T02:16:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f5707eb9640 1 -- 172.21.15.79:0/2096316463 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562b66ae4d00 con 0x562b6788d400 2024-04-25T02:16:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f570bf10280 1 -- 172.21.15.79:0/2096316463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b66af4000 con 0x562b6788d400 2024-04-25T02:16:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f570bf10280 1 -- 172.21.15.79:0/2096316463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x562b66af5a40 con 0x562b6788d400 2024-04-25T02:16:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f570bf10280 4 waiting for MDS map... 2024-04-25T02:16:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f5707eb9640 1 -- 172.21.15.79:0/2096316463 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x562b67986800 con 0x562b6788d400 2024-04-25T02:16:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f5707eb9640 1 -- 172.21.15.79:0/2096316463 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 2885+0+0 (secure 0 0 0) 0x562b66b19180 con 0x562b6788d400 2024-04-25T02:16:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f570bf10280 4 Got MDS map 69 2024-04-25T02:16:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.625+0000 7f570bf10280 10 main: JournalTool::main 2024-04-25T02:16:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.626+0000 7f570bf10280 4 main: JournalTool: connecting to RADOS... 2024-04-25T02:16:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.626+0000 7f570bf10280 1 Processor -- start 2024-04-25T02:16:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.626+0000 7f570bf10280 1 -- start start 2024-04-25T02:16:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.626+0000 7f570bf10280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b67978400 0x562b66b2e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f570bf10280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562b67978800 0x562b66b30100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f570bf10280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b67978c00 0x562b66b30680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f570bf10280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562b66c32480 con 0x562b67978400 2024-04-25T02:16:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f570bf10280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562b66c32600 con 0x562b67978c00 2024-04-25T02:16:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f570bf10280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x562b66c32780 con 0x562b67978800 2024-04-25T02:16:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f5709ebd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b67978400 0x562b66b2e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f5709ebd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b67978400 0x562b66b2e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35538/0 (socket says 172.21.15.79:35538) 2024-04-25T02:16:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f5709ebd640 1 -- 172.21.15.79:0/1963305835 learned_addr learned my addr 172.21.15.79:0/1963305835 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f570a6be640 1 --2- 172.21.15.79:0/1963305835 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562b67978800 0x562b66b30100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f5709ebd640 1 --2- 172.21.15.79:0/1963305835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b67978c00 0x562b66b30680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f5709ebd640 1 -- 172.21.15.79:0/1963305835 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562b67978800 msgr2=0x562b66b30100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f5709ebd640 1 --2- 172.21.15.79:0/1963305835 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562b67978800 0x562b66b30100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f5709ebd640 1 -- 172.21.15.79:0/1963305835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b67978c00 msgr2=0x562b66b30680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f5709ebd640 1 --2- 172.21.15.79:0/1963305835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b67978c00 0x562b66b30680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f5709ebd640 1 -- 172.21.15.79:0/1963305835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b66af5860 con 0x562b67978400 2024-04-25T02:16:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f5709ebd640 1 --2- 172.21.15.79:0/1963305835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b67978400 0x562b66b2e580 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x562b67994630 tx=0x562b67996c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4bc4786772d1d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f5705eb5640 1 -- 172.21.15.79:0/1963305835 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562b66ae4b60 con 0x562b67978400 2024-04-25T02:16:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f5705eb5640 1 -- 172.21.15.79:0/1963305835 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562b66aeae00 con 0x562b67978400 2024-04-25T02:16:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.627+0000 7f5705eb5640 1 -- 172.21.15.79:0/1963305835 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562b66ae4d00 con 0x562b67978400 2024-04-25T02:16:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.628+0000 7f570bf10280 1 -- 172.21.15.79:0/1963305835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b67978400 msgr2=0x562b66b2e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.628+0000 7f570bf10280 1 --2- 172.21.15.79:0/1963305835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b67978400 0x562b66b2e580 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x562b67994630 tx=0x562b67996c60 comp rx=0 tx=0).stop 2024-04-25T02:16:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.628+0000 7f570bf10280 1 -- 172.21.15.79:0/1963305835 shutdown_connections 2024-04-25T02:16:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.628+0000 7f570bf10280 1 --2- 172.21.15.79:0/1963305835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b67978c00 0x562b66b30680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.628+0000 7f570bf10280 1 --2- 172.21.15.79:0/1963305835 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562b67978800 0x562b66b30100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.628+0000 7f570bf10280 1 --2- 172.21.15.79:0/1963305835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b67978400 0x562b66b2e580 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.628+0000 7f570bf10280 1 -- 172.21.15.79:0/1963305835 >> 172.21.15.79:0/1963305835 conn(0x562b6788d800 msgr2=0x562b66bab800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.628+0000 7f570bf10280 1 -- 172.21.15.79:0/1963305835 shutdown_connections 2024-04-25T02:16:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.628+0000 7f570bf10280 1 -- 172.21.15.79:0/1963305835 wait complete. 2024-04-25T02:16:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.628+0000 7f570bf10280 1 Processor -- start 2024-04-25T02:16:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.628+0000 7f570bf10280 1 -- start start 2024-04-25T02:16:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f570bf10280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562b67978400 0x562b66b2e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f570bf10280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b67978800 0x562b66b30100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f570bf10280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b67978c00 0x562b66b30680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f570bf10280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562b66c33e00 con 0x562b67978c00 2024-04-25T02:16:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f570bf10280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562b66c33c80 con 0x562b67978800 2024-04-25T02:16:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f570bf10280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x562b66c33b00 con 0x562b67978400 2024-04-25T02:16:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f5709ebd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b67978c00 0x562b66b30680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f5709ebd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b67978c00 0x562b66b30680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35544/0 (socket says 172.21.15.79:35544) 2024-04-25T02:16:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f5709ebd640 1 -- 172.21.15.79:0/1526657292 learned_addr learned my addr 172.21.15.79:0/1526657292 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f570a6be640 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b67978800 0x562b66b30100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f5709ebd640 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562b67978400 0x562b66b2e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f5709ebd640 1 -- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562b67978400 msgr2=0x562b66b2e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f5709ebd640 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562b67978400 0x562b66b2e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f5709ebd640 1 -- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b67978800 msgr2=0x562b66b30100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f5709ebd640 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b67978800 0x562b66b30100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f5709ebd640 1 -- 172.21.15.79:0/1526657292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b66af5680 con 0x562b67978c00 2024-04-25T02:16:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f5709ebd640 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b67978c00 0x562b66b30680 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x562b679958f0 tx=0x562b67852660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f57046b2640 1 -- 172.21.15.79:0/1526657292 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562b66ae4b60 con 0x562b67978c00 2024-04-25T02:16:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f57046b2640 1 -- 172.21.15.79:0/1526657292 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562b66aeac40 con 0x562b67978c00 2024-04-25T02:16:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f570bf10280 1 -- 172.21.15.79:0/1526657292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b66af43c0 con 0x562b67978c00 2024-04-25T02:16:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.629+0000 7f57046b2640 1 -- 172.21.15.79:0/1526657292 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562b66ae4d00 con 0x562b67978c00 2024-04-25T02:16:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.630+0000 7f570bf10280 1 -- 172.21.15.79:0/1526657292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b66af5c20 con 0x562b67978c00 2024-04-25T02:16:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.630+0000 7f570bf10280 4 main: JournalTool: resolving pool 14 2024-04-25T02:16:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.631+0000 7f57046b2640 1 -- 172.21.15.79:0/1526657292 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x562b679f8c00 con 0x562b67978c00 2024-04-25T02:16:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.631+0000 7f57046b2640 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x562b67a12c00 0x562b66b31700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.631+0000 7f57046b2640 1 -- 172.21.15.79:0/1526657292 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x562b66c34200 con 0x562b67978c00 2024-04-25T02:16:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.631+0000 7f570bf10280 4 main: JournalTool: creating IoCtx.. 2024-04-25T02:16:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.631+0000 7f570bf10280 4 main: Executing for rank 0 2024-04-25T02:16:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.631+0000 7f570bf10280 4 Filtering by inode '1099511627778' 2024-04-25T02:16:43.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.631+0000 7f570a6be640 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x562b67a12c00 0x562b66b31700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.631+0000 7f570bf10280 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x562b67979000 0x562b66b30c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.631+0000 7f570bf10280 1 -- 172.21.15.79:0/1526657292 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) -- 0x562b67979400 con 0x562b67979000 2024-04-25T02:16:43.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.631+0000 7f570a6be640 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x562b67a12c00 0x562b66b31700 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x562b66bc2780 tx=0x562b67996ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.631+0000 7f5709ebd640 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x562b67979000 0x562b66b30c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.632+0000 7f5709ebd640 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x562b67979000 0x562b66b30c00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.632+0000 7f5709ebd640 1 -- 172.21.15.79:0/1526657292 <== osd.7 v2:172.21.15.189:6824/3421948491 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x562b66bc0000 con 0x562b67979000 2024-04-25T02:16:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.632+0000 7f570bf10280 4 Pointer 400.00000000 is readable 2024-04-25T02:16:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.632+0000 7f570bf10280 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-25T02:16:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.632+0000 7f570bf10280 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x562b67a13c00 0x562b66b31180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.632+0000 7f570bf10280 1 -- 172.21.15.79:0/1526657292 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:2 14.14 14:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) -- 0x562b66e48000 con 0x562b67a13c00 2024-04-25T02:16:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.632+0000 7f570aebf640 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x562b67a13c00 0x562b66b31180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.633+0000 7f570aebf640 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x562b67a13c00 0x562b66b31180 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.633+0000 7f570aebf640 1 -- 172.21.15.79:0/1526657292 <== osd.4 v2:172.21.15.189:6800/1910571406 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x562b66bc0500 con 0x562b67a13c00 2024-04-25T02:16:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.633+0000 7f570bf10280 10 Header 0x400000 0x407d21 0x40809d 2024-04-25T02:16:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.633+0000 7f570bf10280 10 Starting journal scan from offset 0x407d21 2024-04-25T02:16:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.633+0000 7f570bf10280 1 -- 172.21.15.79:0/1526657292 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:3 14.14 14:2e2fa760:::200.00000001:head [read 32033~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) -- 0x562b66e48400 con 0x562b67a13c00 2024-04-25T02:16:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.633+0000 7f570aebf640 1 -- 172.21.15.79:0/1526657292 <== osd.4 v2:172.21.15.189:6800/1910571406 2 ==== osd_op_reply(3 200.00000001 [read 32033~892 out=892b] v0'0 uv28 ondisk = 0) ==== 156+0+892 (crc 0 0 0) 0x562b66bc0500 con 0x562b67a13c00 2024-04-25T02:16:43.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.633+0000 7f570bf10280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-25T02:16:43.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.633+0000 7f570bf10280 10 Parsing data, 0x37c bytes available 2024-04-25T02:16:43.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.633+0000 7f570bf10280 10 Attempting decode at 0x407d21 2024-04-25T02:16:43.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.633+0000 7f570bf10280 10 Consumed 0x37c bytes 2024-04-25T02:16:43.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.633+0000 7f570bf10280 10 Valid entry at 0x407d21 2024-04-25T02:16:43.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.633+0000 7f570bf10280 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x562b66e48800 0x562b66e52000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.633+0000 7f570bf10280 1 -- 172.21.15.79:0/1526657292 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:4 14.1b 14:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) -- 0x562b66e48c00 con 0x562b66e48800 2024-04-25T02:16:43.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.633+0000 7f570a6be640 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x562b66e48800 0x562b66e52000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570a6be640 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x562b66e48800 0x562b66e52000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570a6be640 1 -- 172.21.15.79:0/1526657292 <== osd.1 v2:172.21.15.79:6816/2311596149 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x562b66bc0780 con 0x562b66e48800 2024-04-25T02:16:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 4 Reached end of journal objects 2024-04-25T02:16:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 4 Scanned objects, 0 missing, 1 valid 2024-04-25T02:16:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 4 Events scanned, 0 gaps 2024-04-25T02:16:43.648 INFO:teuthology.orchestra.run.smithi079.stdout:Events by type: 2024-04-25T02:16:43.648 INFO:teuthology.orchestra.run.smithi079.stdout:Errors: 0 2024-04-25T02:16:43.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 4 Found 1 valid events 2024-04-25T02:16:43.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 4 Selected 0 events events for processing 2024-04-25T02:16:43.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 4 0 events 2024-04-25T02:16:43.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 -- 172.21.15.79:0/1526657292 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x562b66e48800 msgr2=0x562b66e52000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x562b66e48800 0x562b66e52000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 -- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x562b67a13c00 msgr2=0x562b66b31180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x562b67a13c00 0x562b66b31180 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 -- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x562b67979000 msgr2=0x562b66b30c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x562b67979000 0x562b66b30c00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570a6be640 1 -- 172.21.15.79:0/1526657292 reap_dead start 2024-04-25T02:16:43.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 -- 172.21.15.79:0/1526657292 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x562b67a12c00 msgr2=0x562b66b31700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x562b67a12c00 0x562b66b31700 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x562b66bc2780 tx=0x562b67996ea0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 -- 172.21.15.79:0/1526657292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b67978c00 msgr2=0x562b66b30680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b67978c00 0x562b66b30680 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x562b679958f0 tx=0x562b67852660 comp rx=0 tx=0).stop 2024-04-25T02:16:43.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 -- 172.21.15.79:0/1526657292 shutdown_connections 2024-04-25T02:16:43.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x562b67a12c00 0x562b66b31700 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 --2- 172.21.15.79:0/1526657292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b67978c00 0x562b66b30680 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 -- 172.21.15.79:0/1526657292 >> 172.21.15.79:0/1526657292 conn(0x562b6788d800 msgr2=0x562b66bab800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 -- 172.21.15.79:0/1526657292 shutdown_connections 2024-04-25T02:16:43.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 -- 172.21.15.79:0/1526657292 wait complete. 2024-04-25T02:16:43.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 -- 172.21.15.79:0/2096316463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6788d400 msgr2=0x562b66b2f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 --2- 172.21.15.79:0/2096316463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6788d400 0x562b66b2f080 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x562b66bc2030 tx=0x562b678540c0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 -- 172.21.15.79:0/2096316463 shutdown_connections 2024-04-25T02:16:43.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 --2- 172.21.15.79:0/2096316463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6788d400 0x562b66b2f080 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 --2- 172.21.15.79:0/2096316463 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562b6788dc00 0x562b66b2fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 --2- 172.21.15.79:0/2096316463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6788c800 0x562b66b2eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 -- 172.21.15.79:0/2096316463 >> 172.21.15.79:0/2096316463 conn(0x562b66abf000 msgr2=0x562b66baa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 -- 172.21.15.79:0/2096316463 shutdown_connections 2024-04-25T02:16:43.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.634+0000 7f570bf10280 1 -- 172.21.15.79:0/2096316463 wait complete. 2024-04-25T02:16:43.657 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.107724, result: Events by type: Errors: 0 2024-04-25T02:16:43.657 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2024-04-25T02:16:43.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.728+0000 7ff228ef2f40 1 Processor -- start 2024-04-25T02:16:43.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.728+0000 7ff228ef2f40 1 -- start start 2024-04-25T02:16:43.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.729+0000 7ff228ef2f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562669137320 0x56266915e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.729+0000 7ff228ef2f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626691f2ca0 0x562669162c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.729+0000 7ff228ef2f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5626691f3080 0x562669208890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.729+0000 7ff228ef2f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562669137790 con 0x5626691f2ca0 2024-04-25T02:16:43.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.729+0000 7ff228ef2f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5626690dc640 con 0x5626691f3080 2024-04-25T02:16:43.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.729+0000 7ff228ef2f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56266917cdc0 con 0x562669137320 2024-04-25T02:16:43.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.729+0000 7ff2261f2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626691f2ca0 0x562669162c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.729+0000 7ff2261f2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626691f2ca0 0x562669162c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35564/0 (socket says 172.21.15.79:35564) 2024-04-25T02:16:43.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.729+0000 7ff2261f2640 1 -- 172.21.15.79:0/3233780291 learned_addr learned my addr 172.21.15.79:0/3233780291 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.729+0000 7ff2261f2640 1 -- 172.21.15.79:0/3233780291 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562669137320 msgr2=0x56266915e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.729+0000 7ff2261f2640 1 --2- 172.21.15.79:0/3233780291 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562669137320 0x56266915e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.729+0000 7ff2261f2640 1 -- 172.21.15.79:0/3233780291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5626691f3080 msgr2=0x562669208890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.729+0000 7ff2261f2640 1 --2- 172.21.15.79:0/3233780291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5626691f3080 0x562669208890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.729+0000 7ff2261f2640 1 -- 172.21.15.79:0/3233780291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56266915ebf0 con 0x5626691f2ca0 2024-04-25T02:16:43.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.729+0000 7ff2261f2640 1 --2- 172.21.15.79:0/3233780291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626691f2ca0 0x562669162c90 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7ff21c025d20 tx=0x7ff21c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ad211f700118bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.730+0000 7ff2251f0640 1 -- 172.21.15.79:0/3233780291 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c053a90 con 0x5626691f2ca0 2024-04-25T02:16:43.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.730+0000 7ff2251f0640 1 -- 172.21.15.79:0/3233780291 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21c063070 con 0x5626691f2ca0 2024-04-25T02:16:43.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.730+0000 7ff2251f0640 1 -- 172.21.15.79:0/3233780291 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c053e50 con 0x5626691f2ca0 2024-04-25T02:16:43.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.730+0000 7ff228ef2f40 1 -- 172.21.15.79:0/3233780291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626691f2ca0 msgr2=0x562669162c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.730+0000 7ff228ef2f40 1 --2- 172.21.15.79:0/3233780291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626691f2ca0 0x562669162c90 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7ff21c025d20 tx=0x7ff21c051000 comp rx=0 tx=0).stop 2024-04-25T02:16:43.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.730+0000 7ff228ef2f40 1 -- 172.21.15.79:0/3233780291 shutdown_connections 2024-04-25T02:16:43.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.730+0000 7ff228ef2f40 1 --2- 172.21.15.79:0/3233780291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5626691f3080 0x562669208890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.730+0000 7ff228ef2f40 1 --2- 172.21.15.79:0/3233780291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626691f2ca0 0x562669162c90 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.730+0000 7ff228ef2f40 1 --2- 172.21.15.79:0/3233780291 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x562669137320 0x56266915e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.730+0000 7ff228ef2f40 1 -- 172.21.15.79:0/3233780291 >> 172.21.15.79:0/3233780291 conn(0x56266915f000 msgr2=0x5626691366c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.730+0000 7ff228ef2f40 1 -- 172.21.15.79:0/3233780291 shutdown_connections 2024-04-25T02:16:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.730+0000 7ff228ef2f40 1 -- 172.21.15.79:0/3233780291 wait complete. 2024-04-25T02:16:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.731+0000 7ff228ef2f40 1 Processor -- start 2024-04-25T02:16:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.731+0000 7ff228ef2f40 1 -- start start 2024-04-25T02:16:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.731+0000 7ff228ef2f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562669137320 0x5626691788d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.731+0000 7ff228ef2f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5626691f2ca0 0x56266917acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.731+0000 7ff228ef2f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5626691f3080 0x5626691ef070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.731+0000 7ff228ef2f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5626692079f0 con 0x562669137320 2024-04-25T02:16:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.731+0000 7ff228ef2f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562669207ff0 con 0x5626691f2ca0 2024-04-25T02:16:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.731+0000 7ff228ef2f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5626692039b0 con 0x5626691f3080 2024-04-25T02:16:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.731+0000 7ff2269f3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562669137320 0x5626691788d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.731+0000 7ff2269f3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562669137320 0x5626691788d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35568/0 (socket says 172.21.15.79:35568) 2024-04-25T02:16:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.731+0000 7ff2269f3640 1 -- 172.21.15.79:0/3054124067 learned_addr learned my addr 172.21.15.79:0/3054124067 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.732+0000 7ff2261f2640 1 --2- 172.21.15.79:0/3054124067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5626691f2ca0 0x56266917acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.732+0000 7ff2271f4640 1 --2- 172.21.15.79:0/3054124067 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5626691f3080 0x5626691ef070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.732+0000 7ff2269f3640 1 -- 172.21.15.79:0/3054124067 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5626691f3080 msgr2=0x5626691ef070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.732+0000 7ff2269f3640 1 --2- 172.21.15.79:0/3054124067 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5626691f3080 0x5626691ef070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.732+0000 7ff2269f3640 1 -- 172.21.15.79:0/3054124067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5626691f2ca0 msgr2=0x56266917acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.732+0000 7ff2269f3640 1 --2- 172.21.15.79:0/3054124067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5626691f2ca0 0x56266917acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.732+0000 7ff2269f3640 1 -- 172.21.15.79:0/3054124067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56266917a280 con 0x562669137320 2024-04-25T02:16:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.732+0000 7ff2271f4640 1 --2- 172.21.15.79:0/3054124067 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5626691f3080 0x5626691ef070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.732+0000 7ff2269f3640 1 --2- 172.21.15.79:0/3054124067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562669137320 0x5626691788d0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7ff218008110 tx=0x7ff2180085d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.732+0000 7ff20ffff640 1 -- 172.21.15.79:0/3054124067 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21800f5b0 con 0x562669137320 2024-04-25T02:16:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.732+0000 7ff20ffff640 1 -- 172.21.15.79:0/3054124067 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff218015070 con 0x562669137320 2024-04-25T02:16:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.732+0000 7ff228ef2f40 1 -- 172.21.15.79:0/3054124067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626691ef8a0 con 0x562669137320 2024-04-25T02:16:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.732+0000 7ff20ffff640 1 -- 172.21.15.79:0/3054124067 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21800f990 con 0x562669137320 2024-04-25T02:16:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.732+0000 7ff228ef2f40 1 -- 172.21.15.79:0/3054124067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56266917a7d0 con 0x562669137320 2024-04-25T02:16:43.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.733+0000 7ff20ffff640 1 -- 172.21.15.79:0/3054124067 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff21800fb30 con 0x562669137320 2024-04-25T02:16:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.734+0000 7ff20ffff640 1 --2- 172.21.15.79:0/3054124067 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff21406a840 0x7ff21406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.734+0000 7ff20ffff640 1 -- 172.21.15.79:0/3054124067 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7ff218089970 con 0x562669137320 2024-04-25T02:16:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.734+0000 7ff2261f2640 1 --2- 172.21.15.79:0/3054124067 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff21406a840 0x7ff21406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.734+0000 7ff228ef2f40 1 --2- 172.21.15.79:0/3054124067 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5626691e88a0 0x56266920c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.734+0000 7ff228ef2f40 1 -- 172.21.15.79:0/3054124067 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x5626691f0280 con 0x5626691e88a0 2024-04-25T02:16:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.734+0000 7ff2271f4640 1 --2- 172.21.15.79:0/3054124067 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5626691e88a0 0x56266920c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.734+0000 7ff2261f2640 1 --2- 172.21.15.79:0/3054124067 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff21406a840 0x7ff21406cd00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff21c000c00 tx=0x7ff21c053000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.734+0000 7ff2271f4640 1 --2- 172.21.15.79:0/3054124067 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5626691e88a0 0x56266920c640 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.738+0000 7ff2271f4640 1 -- 172.21.15.79:0/3054124067 <== osd.2 v2:172.21.15.79:6800/3397511354 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v103'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ff22000c570 con 0x5626691e88a0 2024-04-25T02:16:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.738+0000 7ff228ef2f40 1 -- 172.21.15.79:0/3054124067 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5626691e88a0 msgr2=0x56266920c640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.738+0000 7ff228ef2f40 1 --2- 172.21.15.79:0/3054124067 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5626691e88a0 0x56266920c640 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.738+0000 7ff228ef2f40 1 -- 172.21.15.79:0/3054124067 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff21406a840 msgr2=0x7ff21406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.738+0000 7ff228ef2f40 1 --2- 172.21.15.79:0/3054124067 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff21406a840 0x7ff21406cd00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff21c000c00 tx=0x7ff21c053000 comp rx=0 tx=0).stop 2024-04-25T02:16:43.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.738+0000 7ff228ef2f40 1 -- 172.21.15.79:0/3054124067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562669137320 msgr2=0x5626691788d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.738+0000 7ff228ef2f40 1 --2- 172.21.15.79:0/3054124067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562669137320 0x5626691788d0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7ff218008110 tx=0x7ff2180085d0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.738+0000 7ff2271f4640 1 -- 172.21.15.79:0/3054124067 reap_dead start 2024-04-25T02:16:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.738+0000 7ff228ef2f40 1 -- 172.21.15.79:0/3054124067 shutdown_connections 2024-04-25T02:16:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.738+0000 7ff228ef2f40 1 -- 172.21.15.79:0/3054124067 >> 172.21.15.79:0/3054124067 conn(0x56266915f000 msgr2=0x562669208850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.738+0000 7ff228ef2f40 1 -- 172.21.15.79:0/3054124067 shutdown_connections 2024-04-25T02:16:43.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.738+0000 7ff228ef2f40 1 -- 172.21.15.79:0/3054124067 wait complete. 2024-04-25T02:16:43.746 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T02:16:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.882+0000 7f97a11b7640 1 Processor -- start 2024-04-25T02:16:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.882+0000 7f97a11b7640 1 -- start start 2024-04-25T02:16:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.882+0000 7f97a11b7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f979c06b2f0 0x7f979c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.883+0000 7f97a11b7640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f979c0cf7a0 0x7f979c06b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.883+0000 7f97a11b7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f979c06e6b0 0x7f979c0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.883+0000 7f97a11b7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f979c15f830 con 0x7f979c06e6b0 2024-04-25T02:16:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.883+0000 7f97a11b7640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f979c06bc10 con 0x7f979c0cf7a0 2024-04-25T02:16:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.883+0000 7f97a11b7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f979c15ec20 con 0x7f979c06b2f0 2024-04-25T02:16:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.883+0000 7f979b59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f979c06e6b0 0x7f979c0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.883+0000 7f979b59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f979c06e6b0 0x7f979c0cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35572/0 (socket says 172.21.15.79:35572) 2024-04-25T02:16:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.883+0000 7f979b59e640 1 -- 172.21.15.79:0/1887715411 learned_addr learned my addr 172.21.15.79:0/1887715411 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.883+0000 7f979ad9d640 1 --2- 172.21.15.79:0/1887715411 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f979c06b2f0 0x7f979c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.883+0000 7f979a59c640 1 --2- 172.21.15.79:0/1887715411 >> v2:172.21.15.189:3300/0 conn(0x7f979c0cf7a0 0x7f979c06b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.883+0000 7f979b59e640 1 -- 172.21.15.79:0/1887715411 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f979c06b2f0 msgr2=0x7f979c0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.883+0000 7f979b59e640 1 --2- 172.21.15.79:0/1887715411 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f979c06b2f0 0x7f979c0b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.883+0000 7f979b59e640 1 -- 172.21.15.79:0/1887715411 >> v2:172.21.15.189:3300/0 conn(0x7f979c0cf7a0 msgr2=0x7f979c06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.883+0000 7f979b59e640 1 --2- 172.21.15.79:0/1887715411 >> v2:172.21.15.189:3300/0 conn(0x7f979c0cf7a0 0x7f979c06b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.883+0000 7f979b59e640 1 -- 172.21.15.79:0/1887715411 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c15ef00 con 0x7f979c06e6b0 2024-04-25T02:16:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.884+0000 7f979b59e640 1 --2- 172.21.15.79:0/1887715411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f979c06e6b0 0x7f979c0cdb70 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f979c0cd910 tx=0x7f979402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea79c3b0167b7ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.884+0000 7f9799d9b640 1 -- 172.21.15.79:0/1887715411 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794036070 con 0x7f979c06e6b0 2024-04-25T02:16:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.884+0000 7f9799d9b640 1 -- 172.21.15.79:0/1887715411 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9794031600 con 0x7f979c06e6b0 2024-04-25T02:16:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.884+0000 7f9799d9b640 1 -- 172.21.15.79:0/1887715411 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97940319d0 con 0x7f979c06e6b0 2024-04-25T02:16:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.884+0000 7f97a11b7640 1 -- 172.21.15.79:0/1887715411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f979c06e6b0 msgr2=0x7f979c0cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.884+0000 7f97a11b7640 1 --2- 172.21.15.79:0/1887715411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f979c06e6b0 0x7f979c0cdb70 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f979c0cd910 tx=0x7f979402a610 comp rx=0 tx=0).stop 2024-04-25T02:16:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.884+0000 7f97a11b7640 1 -- 172.21.15.79:0/1887715411 shutdown_connections 2024-04-25T02:16:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.884+0000 7f97a11b7640 1 --2- 172.21.15.79:0/1887715411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f979c06e6b0 0x7f979c0cdb70 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.884+0000 7f97a11b7640 1 --2- 172.21.15.79:0/1887715411 >> v2:172.21.15.189:3300/0 conn(0x7f979c0cf7a0 0x7f979c06b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.884+0000 7f97a11b7640 1 --2- 172.21.15.79:0/1887715411 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f979c06b2f0 0x7f979c0b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.884+0000 7f97a11b7640 1 -- 172.21.15.79:0/1887715411 >> 172.21.15.79:0/1887715411 conn(0x7f979c0b1cd0 msgr2=0x7f979c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.884+0000 7f97a11b7640 1 -- 172.21.15.79:0/1887715411 shutdown_connections 2024-04-25T02:16:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.884+0000 7f97a11b7640 1 -- 172.21.15.79:0/1887715411 wait complete. 2024-04-25T02:16:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.886+0000 7f97a11b7640 1 Processor -- start 2024-04-25T02:16:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.886+0000 7f97a11b7640 1 -- start start 2024-04-25T02:16:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.886+0000 7f97a11b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f979c06b2f0 0x7f979c159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.886+0000 7f97a11b7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f979c06e6b0 0x7f979c0cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f97a11b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f979c0cf7a0 0x7f979c152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f97a11b7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f979c06cfe0 con 0x7f979c06b2f0 2024-04-25T02:16:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f97a11b7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f979c15f4c0 con 0x7f979c0cf7a0 2024-04-25T02:16:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f97a11b7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f979c06d160 con 0x7f979c06e6b0 2024-04-25T02:16:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f979ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f979c06b2f0 0x7f979c159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f979ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f979c06b2f0 0x7f979c159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35582/0 (socket says 172.21.15.79:35582) 2024-04-25T02:16:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f979ad9d640 1 -- 172.21.15.79:0/2307189015 learned_addr learned my addr 172.21.15.79:0/2307189015 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f979b59e640 1 --2- 172.21.15.79:0/2307189015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f979c0cf7a0 0x7f979c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f979ad9d640 1 -- 172.21.15.79:0/2307189015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f979c06e6b0 msgr2=0x7f979c0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f979a59c640 1 --2- 172.21.15.79:0/2307189015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f979c06e6b0 0x7f979c0cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f979ad9d640 1 --2- 172.21.15.79:0/2307189015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f979c06e6b0 0x7f979c0cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f979ad9d640 1 -- 172.21.15.79:0/2307189015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f979c0cf7a0 msgr2=0x7f979c152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f979ad9d640 1 --2- 172.21.15.79:0/2307189015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f979c0cf7a0 0x7f979c152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f979ad9d640 1 -- 172.21.15.79:0/2307189015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c1581b0 con 0x7f979c06b2f0 2024-04-25T02:16:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f979ad9d640 1 --2- 172.21.15.79:0/2307189015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f979c06b2f0 0x7f979c159910 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f978c00d800 tx=0x7f978c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f97837fe640 1 -- 172.21.15.79:0/2307189015 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c00b660 con 0x7f979c06b2f0 2024-04-25T02:16:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f97837fe640 1 -- 172.21.15.79:0/2307189015 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978c019070 con 0x7f979c06b2f0 2024-04-25T02:16:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f97a11b7640 1 -- 172.21.15.79:0/2307189015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979c157910 con 0x7f979c06b2f0 2024-04-25T02:16:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f97837fe640 1 -- 172.21.15.79:0/2307189015 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c00ba20 con 0x7f979c06b2f0 2024-04-25T02:16:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.887+0000 7f97a11b7640 1 -- 172.21.15.79:0/2307189015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f979c157ed0 con 0x7f979c06b2f0 2024-04-25T02:16:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.888+0000 7f97a11b7640 1 -- 172.21.15.79:0/2307189015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f979c0690a0 con 0x7f979c06b2f0 2024-04-25T02:16:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.889+0000 7f97837fe640 1 -- 172.21.15.79:0/2307189015 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f978c00bbc0 con 0x7f979c06b2f0 2024-04-25T02:16:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.889+0000 7f97837fe640 1 --2- 172.21.15.79:0/2307189015 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f978806be30 0x7f978806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.889+0000 7f97837fe640 1 -- 172.21.15.79:0/2307189015 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7f978c08b290 con 0x7f979c06b2f0 2024-04-25T02:16:43.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.889+0000 7f979a59c640 1 --2- 172.21.15.79:0/2307189015 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f978806be30 0x7f978806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:43.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.890+0000 7f979a59c640 1 --2- 172.21.15.79:0/2307189015 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f978806be30 0x7f978806e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9790006fd0 tx=0x7f9790008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:43.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:43.893+0000 7f97837fe640 1 -- 172.21.15.79:0/2307189015 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f978c01c360 con 0x7f979c06b2f0 2024-04-25T02:16:44.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.100+0000 7f97a11b7640 1 -- 172.21.15.79:0/2307189015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f979c09ded0 con 0x7f979c06b2f0 2024-04-25T02:16:44.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.463+0000 7f97837fe640 1 -- 172.21.15.79:0/2307189015 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v70) ==== 162+0+0 (secure 0 0 0) 0x7f978c059c70 con 0x7f979c06b2f0 2024-04-25T02:16:44.472 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T02:16:44.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.465+0000 7f97a11b7640 1 -- 172.21.15.79:0/2307189015 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f978806be30 msgr2=0x7f978806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:44.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.465+0000 7f97a11b7640 1 --2- 172.21.15.79:0/2307189015 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f978806be30 0x7f978806e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9790006fd0 tx=0x7f9790008040 comp rx=0 tx=0).stop 2024-04-25T02:16:44.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.465+0000 7f97a11b7640 1 -- 172.21.15.79:0/2307189015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f979c06b2f0 msgr2=0x7f979c159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:44.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.465+0000 7f97a11b7640 1 --2- 172.21.15.79:0/2307189015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f979c06b2f0 0x7f979c159910 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f978c00d800 tx=0x7f978c00dcc0 comp rx=0 tx=0).stop 2024-04-25T02:16:44.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.465+0000 7f97a11b7640 1 -- 172.21.15.79:0/2307189015 shutdown_connections 2024-04-25T02:16:44.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.465+0000 7f97a11b7640 1 --2- 172.21.15.79:0/2307189015 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f978806be30 0x7f978806e2f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:44.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.465+0000 7f97a11b7640 1 --2- 172.21.15.79:0/2307189015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f979c0cf7a0 0x7f979c152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:44.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.465+0000 7f97a11b7640 1 --2- 172.21.15.79:0/2307189015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f979c06e6b0 0x7f979c0cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:44.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.465+0000 7f97a11b7640 1 --2- 172.21.15.79:0/2307189015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f979c06b2f0 0x7f979c159910 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:44.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.465+0000 7f97a11b7640 1 -- 172.21.15.79:0/2307189015 >> 172.21.15.79:0/2307189015 conn(0x7f979c0b1cd0 msgr2=0x7f979c0b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:44.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.465+0000 7f97a11b7640 1 -- 172.21.15.79:0/2307189015 shutdown_connections 2024-04-25T02:16:44.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.465+0000 7f97a11b7640 1 -- 172.21.15.79:0/2307189015 wait complete. 2024-04-25T02:16:44.484 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:16:44.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.574+0000 7f4427f70640 1 Processor -- start 2024-04-25T02:16:44.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.574+0000 7f4427f70640 1 -- start start 2024-04-25T02:16:44.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.575+0000 7f4427f70640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f44200d07a0 0x7f44200b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:44.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.575+0000 7f4427f70640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f44200b47e0 0x7f4420070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:44.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.575+0000 7f4427f70640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f442015bb10 con 0x7f442015a720 2024-04-25T02:16:44.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.575+0000 7f4427f70640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f44200b2e60 con 0x7f44200b47e0 2024-04-25T02:16:44.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.575+0000 7f4427f70640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f44200b3140 con 0x7f44200d07a0 2024-04-25T02:16:44.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.575+0000 7f442650d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f44200b47e0 0x7f4420070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:44.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.575+0000 7f4425d0c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f442015a720 0x7f442015ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34910/0 (socket says 172.21.15.79:34910) 2024-04-25T02:16:44.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.575+0000 7f4425d0c640 1 -- 172.21.15.79:0/72835577 learned_addr learned my addr 172.21.15.79:0/72835577 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:44.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.575+0000 7f442650d640 1 -- 172.21.15.79:0/72835577 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f44200d07a0 msgr2=0x7f44200b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:44.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.575+0000 7f442650d640 1 --2- 172.21.15.79:0/72835577 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f44200d07a0 0x7f44200b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:44.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.575+0000 7f442650d640 1 -- 172.21.15.79:0/72835577 >> v1:172.21.15.79:6789/0 conn(0x7f442015a720 legacy=0x7f442015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:44.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.575+0000 7f442650d640 1 -- 172.21.15.79:0/72835577 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44200b3420 con 0x7f44200b47e0 2024-04-25T02:16:44.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.575+0000 7f4424d0a640 1 -- 172.21.15.79:0/72835577 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2622606294 0 0) 0x7f442015bb10 con 0x7f442015a720 2024-04-25T02:16:44.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.576+0000 7f442650d640 1 --2- 172.21.15.79:0/72835577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44200b47e0 0x7f4420070cf0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f44180097d0 tx=0x7f441802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81bade5e1ffc086 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:44.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.576+0000 7f4424d0a640 1 -- 172.21.15.79:0/72835577 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4418037070 con 0x7f44200b47e0 2024-04-25T02:16:44.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.576+0000 7f4424d0a640 1 -- 172.21.15.79:0/72835577 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f441802ae40 con 0x7f44200b47e0 2024-04-25T02:16:44.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.576+0000 7f4424d0a640 1 -- 172.21.15.79:0/72835577 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4418032660 con 0x7f44200b47e0 2024-04-25T02:16:44.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.577+0000 7f4427f70640 1 -- 172.21.15.79:0/72835577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44200b47e0 msgr2=0x7f4420070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:44.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.577+0000 7f4427f70640 1 --2- 172.21.15.79:0/72835577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44200b47e0 0x7f4420070cf0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f44180097d0 tx=0x7f441802a130 comp rx=0 tx=0).stop 2024-04-25T02:16:44.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.577+0000 7f4427f70640 1 -- 172.21.15.79:0/72835577 shutdown_connections 2024-04-25T02:16:44.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.577+0000 7f4427f70640 1 --2- 172.21.15.79:0/72835577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44200b47e0 0x7f4420070cf0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:44.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.577+0000 7f4427f70640 1 --2- 172.21.15.79:0/72835577 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f44200d07a0 0x7f44200b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:44.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.577+0000 7f4427f70640 1 -- 172.21.15.79:0/72835577 >> 172.21.15.79:0/72835577 conn(0x7f44200cfc80 msgr2=0x7f44200d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:44.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.577+0000 7f4427f70640 1 -- 172.21.15.79:0/72835577 shutdown_connections 2024-04-25T02:16:44.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.577+0000 7f4427f70640 1 -- 172.21.15.79:0/72835577 wait complete. 2024-04-25T02:16:44.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.578+0000 7f4427f70640 1 Processor -- start 2024-04-25T02:16:44.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.578+0000 7f4427f70640 1 -- start start 2024-04-25T02:16:44.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4427f70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44200b47e0 0x7f44201540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:44.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4427f70640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44200d07a0 0x7f4420154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:44.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4427f70640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f442015a720 0x7f44201f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:44.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4427f70640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f442006df50 con 0x7f44200b47e0 2024-04-25T02:16:44.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4427f70640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f44200b39e0 con 0x7f44200d07a0 2024-04-25T02:16:44.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4427f70640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f442006e0d0 con 0x7f442015a720 2024-04-25T02:16:44.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4425d0c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44200b47e0 0x7f44201540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4425d0c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44200b47e0 0x7f44201540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35608/0 (socket says 172.21.15.79:35608) 2024-04-25T02:16:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4425d0c640 1 -- 172.21.15.79:0/350010070 learned_addr learned my addr 172.21.15.79:0/350010070 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f442550b640 1 --2- 172.21.15.79:0/350010070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44200d07a0 0x7f4420154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f442650d640 1 --2- 172.21.15.79:0/350010070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f442015a720 0x7f44201f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4425d0c640 1 -- 172.21.15.79:0/350010070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f442015a720 msgr2=0x7f44201f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4425d0c640 1 --2- 172.21.15.79:0/350010070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f442015a720 0x7f44201f56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4425d0c640 1 -- 172.21.15.79:0/350010070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44200d07a0 msgr2=0x7f4420154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4425d0c640 1 --2- 172.21.15.79:0/350010070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44200d07a0 0x7f4420154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4425d0c640 1 -- 172.21.15.79:0/350010070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4420154c60 con 0x7f44200b47e0 2024-04-25T02:16:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4425d0c640 1 --2- 172.21.15.79:0/350010070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44200b47e0 0x7f44201540c0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c7c0 tx=0x7f441c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f44167fc640 1 -- 172.21.15.79:0/350010070 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c018070 con 0x7f44200b47e0 2024-04-25T02:16:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f44167fc640 1 -- 172.21.15.79:0/350010070 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f441c00a640 con 0x7f44200b47e0 2024-04-25T02:16:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f44167fc640 1 -- 172.21.15.79:0/350010070 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c00aa30 con 0x7f44200b47e0 2024-04-25T02:16:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4427f70640 1 -- 172.21.15.79:0/350010070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4420154f40 con 0x7f44200b47e0 2024-04-25T02:16:44.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.579+0000 7f4427f70640 1 -- 172.21.15.79:0/350010070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44201567f0 con 0x7f44200b47e0 2024-04-25T02:16:44.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.580+0000 7f4427f70640 1 -- 172.21.15.79:0/350010070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44201569f0 con 0x7f44200b47e0 2024-04-25T02:16:44.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.581+0000 7f44167fc640 1 -- 172.21.15.79:0/350010070 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f441c01b070 con 0x7f44200b47e0 2024-04-25T02:16:44.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.581+0000 7f44167fc640 1 --2- 172.21.15.79:0/350010070 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f440406be30 0x7f440406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:44.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.581+0000 7f44167fc640 1 -- 172.21.15.79:0/350010070 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7f441c08a550 con 0x7f44200b47e0 2024-04-25T02:16:44.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.581+0000 7f442550b640 1 --2- 172.21.15.79:0/350010070 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f440406be30 0x7f440406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:44.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.582+0000 7f442550b640 1 --2- 172.21.15.79:0/350010070 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f440406be30 0x7f440406e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f44200cf280 tx=0x7f4410008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:44.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.586+0000 7f44167fc640 1 -- 172.21.15.79:0/350010070 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f44201569f0 con 0x7f44200b47e0 2024-04-25T02:16:44.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.793+0000 7f4427f70640 1 -- 172.21.15.79:0/350010070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44200690a0 con 0x7f44200b47e0 2024-04-25T02:16:44.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.793+0000 7f44167fc640 1 -- 172.21.15.79:0/350010070 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5184 (secure 0 0 0) 0x7f441c058ea0 con 0x7f44200b47e0 2024-04-25T02:16:44.798 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:44.798 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":71,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1086166830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1086166830},{"type":"v1","addr":"172.21.15.189:6834","nonce":1086166830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2468340230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2468340230},{"type":"v1","addr":"172.21.15.189:6835","nonce":2468340230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3582530322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3582530322},{"type":"v1","addr":"172.21.15.79:6836","nonce":3582530322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:15:58.363457+0000","modified":"2024-04-25T02:16:44.465952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8601":{"gid":8601,"name":"c","rank":0,"incarnation":71,"state":"up:replay","state_seq":1,"addr":"172.21.15.79:6837/2550458851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550458851},{"type":"v1","addr":"172.21.15.79:6837","nonce":2550458851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-25T02:16:44.798 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 71 2024-04-25T02:16:44.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.795+0000 7f4427f70640 1 -- 172.21.15.79:0/350010070 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f440406be30 msgr2=0x7f440406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:44.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.795+0000 7f4427f70640 1 --2- 172.21.15.79:0/350010070 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f440406be30 0x7f440406e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f44200cf280 tx=0x7f4410008040 comp rx=0 tx=0).stop 2024-04-25T02:16:44.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.795+0000 7f4427f70640 1 -- 172.21.15.79:0/350010070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44200b47e0 msgr2=0x7f44201540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:44.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.795+0000 7f4427f70640 1 --2- 172.21.15.79:0/350010070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44200b47e0 0x7f44201540c0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c7c0 tx=0x7f441c00cc80 comp rx=0 tx=0).stop 2024-04-25T02:16:44.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.795+0000 7f4427f70640 1 -- 172.21.15.79:0/350010070 shutdown_connections 2024-04-25T02:16:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.795+0000 7f4427f70640 1 --2- 172.21.15.79:0/350010070 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f440406be30 0x7f440406e2f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.795+0000 7f4427f70640 1 --2- 172.21.15.79:0/350010070 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f442015a720 0x7f44201f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.795+0000 7f4427f70640 1 --2- 172.21.15.79:0/350010070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44200d07a0 0x7f4420154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.795+0000 7f4427f70640 1 --2- 172.21.15.79:0/350010070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44200b47e0 0x7f44201540c0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.795+0000 7f4427f70640 1 -- 172.21.15.79:0/350010070 >> 172.21.15.79:0/350010070 conn(0x7f44200cfc80 msgr2=0x7f442015c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.795+0000 7f4427f70640 1 -- 172.21.15.79:0/350010070 shutdown_connections 2024-04-25T02:16:44.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:44.795+0000 7f4427f70640 1 -- 172.21.15.79:0/350010070 wait complete. 2024-04-25T02:16:45.215 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:15:58.363457+0000', 'modified': '2024-04-25T02:16:44.465952+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 103, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8601}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8601': {'gid': 8601, 'name': 'c', 'rank': 0, 'incarnation': 71, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.79:6837/2550458851', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 2550458851}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 2550458851}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T02:16:45.215 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8601:up:replay 2024-04-25T02:16:46.216 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:16:46.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.316+0000 7fbea3fc8640 1 Processor -- start 2024-04-25T02:16:46.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.316+0000 7fbea3fc8640 1 -- start start 2024-04-25T02:16:46.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.317+0000 7fbea3fc8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbe9c06df50 0x7fbe9c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:46.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.317+0000 7fbea3fc8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe9c071e00 con 0x7fbe9c0b2d30 2024-04-25T02:16:46.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.317+0000 7fbea3fc8640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe9c0720a0 con 0x7fbe9c143bc0 2024-04-25T02:16:46.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.317+0000 7fbea3fc8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbe9c06e8f0 con 0x7fbe9c06df50 2024-04-25T02:16:46.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.317+0000 7fbea1563640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbe9c06df50 0x7fbe9c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:46.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.317+0000 7fbea2565640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbe9c0b2d30 0x7fbe9c0b31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34924/0 (socket says 172.21.15.79:34924) 2024-04-25T02:16:46.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.317+0000 7fbea2565640 1 -- 172.21.15.79:0/58629642 learned_addr learned my addr 172.21.15.79:0/58629642 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:46.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.318+0000 7fbea1563640 1 -- 172.21.15.79:0/58629642 >> v1:172.21.15.189:6789/0 conn(0x7fbe9c143bc0 legacy=0x7fbe9c15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:46.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.318+0000 7fbea1563640 1 -- 172.21.15.79:0/58629642 >> v1:172.21.15.79:6789/0 conn(0x7fbe9c0b2d30 legacy=0x7fbe9c0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:46.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.318+0000 7fbea1563640 1 -- 172.21.15.79:0/58629642 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c072380 con 0x7fbe9c06df50 2024-04-25T02:16:46.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.318+0000 7fbea1563640 1 --2- 172.21.15.79:0/58629642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe9c06df50 0x7fbe9c06e3b0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0097a0 tx=0x7fbe8c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220992ce3ce47fc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:46.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.318+0000 7fbea0d62640 1 -- 172.21.15.79:0/58629642 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c037070 con 0x7fbe9c06df50 2024-04-25T02:16:46.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.318+0000 7fbea0d62640 1 -- 172.21.15.79:0/58629642 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8c02ae50 con 0x7fbe9c06df50 2024-04-25T02:16:46.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.318+0000 7fbea0d62640 1 -- 172.21.15.79:0/58629642 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c032660 con 0x7fbe9c06df50 2024-04-25T02:16:46.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.319+0000 7fbea3fc8640 1 -- 172.21.15.79:0/58629642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe9c06df50 msgr2=0x7fbe9c06e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:46.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.319+0000 7fbea3fc8640 1 --2- 172.21.15.79:0/58629642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe9c06df50 0x7fbe9c06e3b0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0097a0 tx=0x7fbe8c02a140 comp rx=0 tx=0).stop 2024-04-25T02:16:46.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.319+0000 7fbea3fc8640 1 -- 172.21.15.79:0/58629642 shutdown_connections 2024-04-25T02:16:46.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.319+0000 7fbea3fc8640 1 --2- 172.21.15.79:0/58629642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe9c06df50 0x7fbe9c06e3b0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:46.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.319+0000 7fbea3fc8640 1 -- 172.21.15.79:0/58629642 >> 172.21.15.79:0/58629642 conn(0x7fbe9c0cfc80 msgr2=0x7fbe9c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:46.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.319+0000 7fbea3fc8640 1 -- 172.21.15.79:0/58629642 shutdown_connections 2024-04-25T02:16:46.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.319+0000 7fbea3fc8640 1 -- 172.21.15.79:0/58629642 wait complete. 2024-04-25T02:16:46.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.320+0000 7fbea3fc8640 1 Processor -- start 2024-04-25T02:16:46.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.320+0000 7fbea3fc8640 1 -- start start 2024-04-25T02:16:46.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea3fc8640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbe9c06df50 0x7fbe9c139d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:46.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea3fc8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe9c0b2d30 0x7fbe9c13a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:46.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea3fc8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe9c143bc0 0x7fbe9c159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:46.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea3fc8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c072940 con 0x7fbe9c0b2d30 2024-04-25T02:16:46.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea3fc8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c072cb0 con 0x7fbe9c143bc0 2024-04-25T02:16:46.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea3fc8640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9c143fa0 con 0x7fbe9c06df50 2024-04-25T02:16:46.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea1563640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe9c0b2d30 0x7fbe9c13a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:46.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea1563640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe9c0b2d30 0x7fbe9c13a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35638/0 (socket says 172.21.15.79:35638) 2024-04-25T02:16:46.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea1563640 1 -- 172.21.15.79:0/3673743802 learned_addr learned my addr 172.21.15.79:0/3673743802 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:46.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea2565640 1 --2- 172.21.15.79:0/3673743802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe9c143bc0 0x7fbe9c159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:46.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea1d64640 1 --2- 172.21.15.79:0/3673743802 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbe9c06df50 0x7fbe9c139d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:46.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea1563640 1 -- 172.21.15.79:0/3673743802 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbe9c06df50 msgr2=0x7fbe9c139d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:46.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea1563640 1 --2- 172.21.15.79:0/3673743802 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbe9c06df50 0x7fbe9c139d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:46.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea1563640 1 -- 172.21.15.79:0/3673743802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe9c143bc0 msgr2=0x7fbe9c159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:46.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea1563640 1 --2- 172.21.15.79:0/3673743802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe9c143bc0 0x7fbe9c159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:46.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea1563640 1 -- 172.21.15.79:0/3673743802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c158c70 con 0x7fbe9c0b2d30 2024-04-25T02:16:46.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.321+0000 7fbea1563640 1 --2- 172.21.15.79:0/3673743802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe9c0b2d30 0x7fbe9c13a2a0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0098c0 tx=0x7fbe8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:46.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.322+0000 7fbe927fc640 1 -- 172.21.15.79:0/3673743802 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c042070 con 0x7fbe9c0b2d30 2024-04-25T02:16:46.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.322+0000 7fbe927fc640 1 -- 172.21.15.79:0/3673743802 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8c03e670 con 0x7fbe9c0b2d30 2024-04-25T02:16:46.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.322+0000 7fbea3fc8640 1 -- 172.21.15.79:0/3673743802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9c158f50 con 0x7fbe9c0b2d30 2024-04-25T02:16:46.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.322+0000 7fbe927fc640 1 -- 172.21.15.79:0/3673743802 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c037040 con 0x7fbe9c0b2d30 2024-04-25T02:16:46.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.322+0000 7fbea3fc8640 1 -- 172.21.15.79:0/3673743802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9c13f200 con 0x7fbe9c0b2d30 2024-04-25T02:16:46.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.323+0000 7fbea3fc8640 1 -- 172.21.15.79:0/3673743802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe9c0690a0 con 0x7fbe9c0b2d30 2024-04-25T02:16:46.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.323+0000 7fbe927fc640 1 -- 172.21.15.79:0/3673743802 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe8c045070 con 0x7fbe9c0b2d30 2024-04-25T02:16:46.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.324+0000 7fbe927fc640 1 --2- 172.21.15.79:0/3673743802 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbe8006be30 0x7fbe8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:46.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.324+0000 7fbe927fc640 1 -- 172.21.15.79:0/3673743802 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7fbe8c0ab740 con 0x7fbe9c0b2d30 2024-04-25T02:16:46.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.324+0000 7fbea1d64640 1 --2- 172.21.15.79:0/3673743802 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbe8006be30 0x7fbe8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:46.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.324+0000 7fbea1d64640 1 --2- 172.21.15.79:0/3673743802 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbe8006be30 0x7fbe8006e2f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbe98006fd0 tx=0x7fbe98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:46.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.328+0000 7fbe927fc640 1 -- 172.21.15.79:0/3673743802 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbe8c07a240 con 0x7fbe9c0b2d30 2024-04-25T02:16:46.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.536+0000 7fbea3fc8640 1 -- 172.21.15.79:0/3673743802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe9c0b3540 con 0x7fbe9c0b2d30 2024-04-25T02:16:46.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.537+0000 7fbe927fc640 1 -- 172.21.15.79:0/3673743802 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5184 (secure 0 0 0) 0x7fbe8c079b40 con 0x7fbe9c0b2d30 2024-04-25T02:16:46.542 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:46.542 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":73,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1086166830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1086166830},{"type":"v1","addr":"172.21.15.189:6834","nonce":1086166830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2468340230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2468340230},{"type":"v1","addr":"172.21.15.189:6835","nonce":2468340230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3582530322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3582530322},{"type":"v1","addr":"172.21.15.79:6836","nonce":3582530322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:15:58.363457+0000","modified":"2024-04-25T02:16:45.474781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8601":{"gid":8601,"name":"c","rank":0,"incarnation":71,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.79:6837/2550458851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550458851},{"type":"v1","addr":"172.21.15.79:6837","nonce":2550458851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-25T02:16:46.542 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 73 2024-04-25T02:16:46.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.539+0000 7fbea3fc8640 1 -- 172.21.15.79:0/3673743802 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbe8006be30 msgr2=0x7fbe8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:46.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.539+0000 7fbea3fc8640 1 --2- 172.21.15.79:0/3673743802 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbe8006be30 0x7fbe8006e2f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbe98006fd0 tx=0x7fbe98008040 comp rx=0 tx=0).stop 2024-04-25T02:16:46.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.539+0000 7fbea3fc8640 1 -- 172.21.15.79:0/3673743802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe9c0b2d30 msgr2=0x7fbe9c13a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:46.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.539+0000 7fbea3fc8640 1 --2- 172.21.15.79:0/3673743802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe9c0b2d30 0x7fbe9c13a2a0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0098c0 tx=0x7fbe8c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:16:46.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.539+0000 7fbea3fc8640 1 -- 172.21.15.79:0/3673743802 shutdown_connections 2024-04-25T02:16:46.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.539+0000 7fbea3fc8640 1 --2- 172.21.15.79:0/3673743802 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbe8006be30 0x7fbe8006e2f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:46.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.539+0000 7fbea3fc8640 1 --2- 172.21.15.79:0/3673743802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe9c143bc0 0x7fbe9c159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:46.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.539+0000 7fbea3fc8640 1 --2- 172.21.15.79:0/3673743802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe9c0b2d30 0x7fbe9c13a2a0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:46.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.539+0000 7fbea3fc8640 1 --2- 172.21.15.79:0/3673743802 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbe9c06df50 0x7fbe9c139d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:46.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.539+0000 7fbea3fc8640 1 -- 172.21.15.79:0/3673743802 >> 172.21.15.79:0/3673743802 conn(0x7fbe9c0cfc80 msgr2=0x7fbe9c0b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:46.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.539+0000 7fbea3fc8640 1 -- 172.21.15.79:0/3673743802 shutdown_connections 2024-04-25T02:16:46.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:46.539+0000 7fbea3fc8640 1 -- 172.21.15.79:0/3673743802 wait complete. 2024-04-25T02:16:46.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:15:58.363457+0000', 'modified': '2024-04-25T02:16:45.474781+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 103, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8601}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8601': {'gid': 8601, 'name': 'c', 'rank': 0, 'incarnation': 71, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.79:6837/2550458851', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 2550458851}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 2550458851}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T02:16:46.958 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8601:up:rejoin 2024-04-25T02:16:47.959 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:16:48.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.062+0000 7f36ca415640 1 Processor -- start 2024-04-25T02:16:48.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.062+0000 7f36ca415640 1 -- start start 2024-04-25T02:16:48.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.062+0000 7f36ca415640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36c415a720 0x7f36c415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.062+0000 7f36ca415640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36c415f1c0 con 0x7f36c40b49b0 2024-04-25T02:16:48.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.062+0000 7f36ca415640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36c415bb10 con 0x7f36c40d07a0 2024-04-25T02:16:48.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.062+0000 7f36ca415640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f36c40b2e60 con 0x7f36c415a720 2024-04-25T02:16:48.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c89b2640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f36c40b49b0 0x7f36c4070cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34926/0 (socket says 172.21.15.79:34926) 2024-04-25T02:16:48.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c89b2640 1 -- 172.21.15.79:0/4186454753 learned_addr learned my addr 172.21.15.79:0/4186454753 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:16:48.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c3fff640 1 --2- 172.21.15.79:0/4186454753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36c415a720 0x7f36c415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c2ffd640 1 -- 172.21.15.79:0/4186454753 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2358152606 0 0) 0x7f36bc001490 con 0x7f36c40b49b0 2024-04-25T02:16:48.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c2ffd640 1 -- 172.21.15.79:0/4186454753 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36ac003520 con 0x7f36c40b49b0 2024-04-25T02:16:48.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c2ffd640 1 -- 172.21.15.79:0/4186454753 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3108504261 0 0) 0x7f36ac003520 con 0x7f36c40b49b0 2024-04-25T02:16:48.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c2ffd640 1 -- 172.21.15.79:0/4186454753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36c415a720 msgr2=0x7f36c415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c2ffd640 1 --2- 172.21.15.79:0/4186454753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36c415a720 0x7f36c415ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c2ffd640 1 -- 172.21.15.79:0/4186454753 >> v1:172.21.15.189:6789/0 conn(0x7f36c40d07a0 legacy=0x7f36c40b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c2ffd640 1 -- 172.21.15.79:0/4186454753 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c40b3140 con 0x7f36c40b49b0 2024-04-25T02:16:48.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c2ffd640 1 -- 172.21.15.79:0/4186454753 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f36bc001bc0 con 0x7f36c40b49b0 2024-04-25T02:16:48.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c2ffd640 1 -- 172.21.15.79:0/4186454753 >> v1:172.21.15.79:6789/0 conn(0x7f36c40b49b0 legacy=0x7f36c4070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c2ffd640 1 --2- 172.21.15.79:0/4186454753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac0039e0 0x7f36ac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c2ffd640 1 --2- 172.21.15.79:0/4186454753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36ac004800 0x7f36ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c2ffd640 1 --2- 172.21.15.79:0/4186454753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36c415a720 0x7f36ac005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c2ffd640 1 -- 172.21.15.79:0/4186454753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f36c40b2e60 con 0x7f36ac0039e0 2024-04-25T02:16:48.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c2ffd640 1 -- 172.21.15.79:0/4186454753 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac00cc00 con 0x7f36ac004800 2024-04-25T02:16:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c2ffd640 1 -- 172.21.15.79:0/4186454753 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f36ac00ce00 con 0x7f36c415a720 2024-04-25T02:16:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c3fff640 1 --2- 172.21.15.79:0/4186454753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac0039e0 0x7f36ac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.063+0000 7f36c37fe640 1 --2- 172.21.15.79:0/4186454753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36ac004800 0x7f36ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.064+0000 7f36c89b2640 1 --2- 172.21.15.79:0/4186454753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36c415a720 0x7f36ac005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.064+0000 7f36c3fff640 1 -- 172.21.15.79:0/4186454753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36c415a720 msgr2=0x7f36ac005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.064+0000 7f36c3fff640 1 --2- 172.21.15.79:0/4186454753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36c415a720 0x7f36ac005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.064+0000 7f36c3fff640 1 -- 172.21.15.79:0/4186454753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36ac004800 msgr2=0x7f36ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.064+0000 7f36c3fff640 1 --2- 172.21.15.79:0/4186454753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36ac004800 0x7f36ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.064+0000 7f36c3fff640 1 -- 172.21.15.79:0/4186454753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac003520 con 0x7f36ac0039e0 2024-04-25T02:16:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.064+0000 7f36c3fff640 1 --2- 172.21.15.79:0/4186454753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac0039e0 0x7f36ac003e00 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009ac0 tx=0x7f36ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b096fa18515f64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.064+0000 7f36c2ffd640 1 -- 172.21.15.79:0/4186454753 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4036070 con 0x7f36ac0039e0 2024-04-25T02:16:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.065+0000 7f36c2ffd640 1 -- 172.21.15.79:0/4186454753 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b4031400 con 0x7f36ac0039e0 2024-04-25T02:16:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.065+0000 7f36c2ffd640 1 -- 172.21.15.79:0/4186454753 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4009690 con 0x7f36ac0039e0 2024-04-25T02:16:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.065+0000 7f36ca415640 1 -- 172.21.15.79:0/4186454753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac0039e0 msgr2=0x7f36ac003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.065+0000 7f36ca415640 1 --2- 172.21.15.79:0/4186454753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac0039e0 0x7f36ac003e00 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009ac0 tx=0x7f36ac005830 comp rx=0 tx=0).stop 2024-04-25T02:16:48.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.065+0000 7f36c89b2640 1 -- 172.21.15.79:0/4186454753 reap_dead start 2024-04-25T02:16:48.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.065+0000 7f36ca415640 1 -- 172.21.15.79:0/4186454753 shutdown_connections 2024-04-25T02:16:48.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.065+0000 7f36ca415640 1 -- 172.21.15.79:0/4186454753 >> 172.21.15.79:0/4186454753 conn(0x7f36c40cfc80 msgr2=0x7f36c40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:48.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.065+0000 7f36ca415640 1 -- 172.21.15.79:0/4186454753 shutdown_connections 2024-04-25T02:16:48.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.065+0000 7f36ca415640 1 -- 172.21.15.79:0/4186454753 wait complete. 2024-04-25T02:16:48.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.066+0000 7f36ca415640 1 Processor -- start 2024-04-25T02:16:48.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.066+0000 7f36ca415640 1 -- start start 2024-04-25T02:16:48.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.067+0000 7f36ca415640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac0039e0 0x7f36c414a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.067+0000 7f36ca415640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36c4144d80 0x7f36c41f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.067+0000 7f36ca415640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36c406e130 0x7f36c406e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.067+0000 7f36ca415640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f36c40b39e0 con 0x7f36ac0039e0 2024-04-25T02:16:48.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.067+0000 7f36ca415640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f36c40b3700 con 0x7f36c406e130 2024-04-25T02:16:48.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.067+0000 7f36ca415640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f36c415ec80 con 0x7f36c4144d80 2024-04-25T02:16:48.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.067+0000 7f36c3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac0039e0 0x7f36c414a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.067+0000 7f36c3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac0039e0 0x7f36c414a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35648/0 (socket says 172.21.15.79:35648) 2024-04-25T02:16:48.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.067+0000 7f36c3fff640 1 -- 172.21.15.79:0/377498214 learned_addr learned my addr 172.21.15.79:0/377498214 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:48.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.068+0000 7f36c3fff640 1 -- 172.21.15.79:0/377498214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36c4144d80 msgr2=0x7f36c41f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.068+0000 7f36c3fff640 1 --2- 172.21.15.79:0/377498214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36c4144d80 0x7f36c41f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.068+0000 7f36c3fff640 1 -- 172.21.15.79:0/377498214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36c406e130 msgr2=0x7f36c406e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.068+0000 7f36c89b2640 1 --2- 172.21.15.79:0/377498214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36c406e130 0x7f36c406e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.068+0000 7f36c3fff640 1 --2- 172.21.15.79:0/377498214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36c406e130 0x7f36c406e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.068+0000 7f36c3fff640 1 -- 172.21.15.79:0/377498214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c4145200 con 0x7f36ac0039e0 2024-04-25T02:16:48.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.068+0000 7f36c3fff640 1 --2- 172.21.15.79:0/377498214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac0039e0 0x7f36c414a480 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f36b4034040 tx=0x7f36b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.068+0000 7f36c0ff9640 1 -- 172.21.15.79:0/377498214 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4040020 con 0x7f36ac0039e0 2024-04-25T02:16:48.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.068+0000 7f36c0ff9640 1 -- 172.21.15.79:0/377498214 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b4003940 con 0x7f36ac0039e0 2024-04-25T02:16:48.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.068+0000 7f36c0ff9640 1 -- 172.21.15.79:0/377498214 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4036040 con 0x7f36ac0039e0 2024-04-25T02:16:48.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.068+0000 7f36ca415640 1 -- 172.21.15.79:0/377498214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c4145480 con 0x7f36ac0039e0 2024-04-25T02:16:48.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.068+0000 7f36ca415640 1 -- 172.21.15.79:0/377498214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c4145a40 con 0x7f36ac0039e0 2024-04-25T02:16:48.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.069+0000 7f36ca415640 1 -- 172.21.15.79:0/377498214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36c40ca240 con 0x7f36ac0039e0 2024-04-25T02:16:48.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.069+0000 7f36c0ff9640 1 -- 172.21.15.79:0/377498214 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36b4043020 con 0x7f36ac0039e0 2024-04-25T02:16:48.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.070+0000 7f36c0ff9640 1 --2- 172.21.15.79:0/377498214 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f36b006be60 0x7f36b006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.070+0000 7f36c37fe640 1 --2- 172.21.15.79:0/377498214 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f36b006be60 0x7f36b006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.070+0000 7f36c0ff9640 1 -- 172.21.15.79:0/377498214 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7f36b40aaa10 con 0x7f36ac0039e0 2024-04-25T02:16:48.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.070+0000 7f36c37fe640 1 --2- 172.21.15.79:0/377498214 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f36b006be60 0x7f36b006e320 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f36c4158bc0 tx=0x7f36b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.074+0000 7f36c0ff9640 1 -- 172.21.15.79:0/377498214 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f36c40ca240 con 0x7f36ac0039e0 2024-04-25T02:16:48.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.286+0000 7f36ca415640 1 -- 172.21.15.79:0/377498214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36c40690a0 con 0x7f36ac0039e0 2024-04-25T02:16:48.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.286+0000 7f36c0ff9640 1 -- 172.21.15.79:0/377498214 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5191 (secure 0 0 0) 0x7f36c4145200 con 0x7f36ac0039e0 2024-04-25T02:16:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:48.291 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1086166830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1086166830},{"type":"v1","addr":"172.21.15.189:6834","nonce":1086166830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2468340230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2468340230},{"type":"v1","addr":"172.21.15.189:6835","nonce":2468340230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3582530322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3582530322},{"type":"v1","addr":"172.21.15.79:6836","nonce":3582530322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:15:58.363457+0000","modified":"2024-04-25T02:16:47.478594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8601":{"gid":8601,"name":"c","rank":0,"incarnation":71,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/2550458851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2550458851},{"type":"v1","addr":"172.21.15.79:6837","nonce":2550458851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8601,"qdb_cluster":[8601]},"id":7}]} 2024-04-25T02:16:48.291 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 74 2024-04-25T02:16:48.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.288+0000 7f36ca415640 1 -- 172.21.15.79:0/377498214 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f36b006be60 msgr2=0x7f36b006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.288+0000 7f36ca415640 1 --2- 172.21.15.79:0/377498214 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f36b006be60 0x7f36b006e320 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f36c4158bc0 tx=0x7f36b8009040 comp rx=0 tx=0).stop 2024-04-25T02:16:48.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.288+0000 7f36ca415640 1 -- 172.21.15.79:0/377498214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac0039e0 msgr2=0x7f36c414a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.288+0000 7f36ca415640 1 --2- 172.21.15.79:0/377498214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac0039e0 0x7f36c414a480 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f36b4034040 tx=0x7f36b4004730 comp rx=0 tx=0).stop 2024-04-25T02:16:48.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.288+0000 7f36ca415640 1 -- 172.21.15.79:0/377498214 shutdown_connections 2024-04-25T02:16:48.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.288+0000 7f36ca415640 1 --2- 172.21.15.79:0/377498214 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f36b006be60 0x7f36b006e320 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.288+0000 7f36ca415640 1 --2- 172.21.15.79:0/377498214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36c406e130 0x7f36c406e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.288+0000 7f36ca415640 1 --2- 172.21.15.79:0/377498214 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f36c4144d80 0x7f36c41f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.288+0000 7f36ca415640 1 --2- 172.21.15.79:0/377498214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac0039e0 0x7f36c414a480 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.288+0000 7f36ca415640 1 -- 172.21.15.79:0/377498214 >> 172.21.15.79:0/377498214 conn(0x7f36c40cfc80 msgr2=0x7f36c4153c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:48.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.288+0000 7f36ca415640 1 -- 172.21.15.79:0/377498214 shutdown_connections 2024-04-25T02:16:48.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.288+0000 7f36ca415640 1 -- 172.21.15.79:0/377498214 wait complete. 2024-04-25T02:16:48.707 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:15:58.363457+0000', 'modified': '2024-04-25T02:16:47.478594+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 103, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8601}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8601': {'gid': 8601, 'name': 'c', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.79:6837/2550458851', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 2550458851}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 2550458851}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8601, 'qdb_cluster': [8601]} 2024-04-25T02:16:48.707 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:16:48.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T02:16:48.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.801+0000 7fc6fd97e640 1 Processor -- start 2024-04-25T02:16:48.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.801+0000 7fc6fd97e640 1 -- start start 2024-04-25T02:16:48.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6fd97e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6f815e4d0 0x7fc6f806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6fd97e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6f80b3570 0x7fc6f80d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6fd97e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc6f80b3020 0x7fc6f80d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6fd97e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc6f80d1660 con 0x7fc6f80b3570 2024-04-25T02:16:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6fd97e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc6f80d1380 con 0x7fc6f80b3020 2024-04-25T02:16:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6fd97e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f80cede0 con 0x7fc6f815e4d0 2024-04-25T02:16:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6f67fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6f80b3570 0x7fc6f80d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6f67fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6f80b3570 0x7fc6f80d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35664/0 (socket says 172.21.15.79:35664) 2024-04-25T02:16:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6f67fc640 1 -- 172.21.15.79:0/2014688023 learned_addr learned my addr 172.21.15.79:0/2014688023 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6f6ffd640 1 --2- 172.21.15.79:0/2014688023 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6f815e4d0 0x7fc6f806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6f77fe640 1 --2- 172.21.15.79:0/2014688023 >> v2:172.21.15.189:3300/0 conn(0x7fc6f80b3020 0x7fc6f80d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6f67fc640 1 -- 172.21.15.79:0/2014688023 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6f815e4d0 msgr2=0x7fc6f806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6f67fc640 1 --2- 172.21.15.79:0/2014688023 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6f815e4d0 0x7fc6f806bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6f67fc640 1 -- 172.21.15.79:0/2014688023 >> v2:172.21.15.189:3300/0 conn(0x7fc6f80b3020 msgr2=0x7fc6f80d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6f67fc640 1 --2- 172.21.15.79:0/2014688023 >> v2:172.21.15.189:3300/0 conn(0x7fc6f80b3020 0x7fc6f80d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.802+0000 7fc6f67fc640 1 -- 172.21.15.79:0/2014688023 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f80cf0c0 con 0x7fc6f80b3570 2024-04-25T02:16:48.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.803+0000 7fc6f67fc640 1 --2- 172.21.15.79:0/2014688023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f80b3570 0x7fc6f80d2710 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80679d0 tx=0x7fc6ec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982d1ff59468451a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.803+0000 7fc6f5ffb640 1 -- 172.21.15.79:0/2014688023 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec037070 con 0x7fc6f80b3570 2024-04-25T02:16:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.803+0000 7fc6f5ffb640 1 -- 172.21.15.79:0/2014688023 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ec032440 con 0x7fc6f80b3570 2024-04-25T02:16:48.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.803+0000 7fc6f5ffb640 1 -- 172.21.15.79:0/2014688023 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec032810 con 0x7fc6f80b3570 2024-04-25T02:16:48.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.803+0000 7fc6fd97e640 1 -- 172.21.15.79:0/2014688023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f80b3570 msgr2=0x7fc6f80d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.803+0000 7fc6fd97e640 1 --2- 172.21.15.79:0/2014688023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f80b3570 0x7fc6f80d2710 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80679d0 tx=0x7fc6ec02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.804+0000 7fc6fd97e640 1 -- 172.21.15.79:0/2014688023 shutdown_connections 2024-04-25T02:16:48.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.804+0000 7fc6fd97e640 1 --2- 172.21.15.79:0/2014688023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f80b3570 0x7fc6f80d2710 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.804+0000 7fc6fd97e640 1 --2- 172.21.15.79:0/2014688023 >> v2:172.21.15.189:3300/0 conn(0x7fc6f80b3020 0x7fc6f80d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.804+0000 7fc6fd97e640 1 --2- 172.21.15.79:0/2014688023 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6f815e4d0 0x7fc6f806bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.804+0000 7fc6fd97e640 1 -- 172.21.15.79:0/2014688023 >> 172.21.15.79:0/2014688023 conn(0x7fc6f809d460 msgr2=0x7fc6f80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:48.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.804+0000 7fc6fd97e640 1 -- 172.21.15.79:0/2014688023 shutdown_connections 2024-04-25T02:16:48.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.804+0000 7fc6fd97e640 1 -- 172.21.15.79:0/2014688023 wait complete. 2024-04-25T02:16:48.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.805+0000 7fc6fd97e640 1 Processor -- start 2024-04-25T02:16:48.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.805+0000 7fc6fd97e640 1 -- start start 2024-04-25T02:16:48.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6fd97e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f80b3020 0x7fc6f80b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6fd97e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6f80b3570 0x7fc6f8157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6fd97e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6f815e4d0 0x7fc6f80cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6fd97e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f80d2250 con 0x7fc6f80b3020 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6fd97e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f80d20d0 con 0x7fc6f80b3570 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6fd97e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f806c1b0 con 0x7fc6f815e4d0 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6f6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f80b3020 0x7fc6f80b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6f6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f80b3020 0x7fc6f80b5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35668/0 (socket says 172.21.15.79:35668) 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6f6ffd640 1 -- 172.21.15.79:0/3289352642 learned_addr learned my addr 172.21.15.79:0/3289352642 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6f67fc640 1 --2- 172.21.15.79:0/3289352642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6f80b3570 0x7fc6f8157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6f77fe640 1 --2- 172.21.15.79:0/3289352642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6f815e4d0 0x7fc6f80cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6f6ffd640 1 -- 172.21.15.79:0/3289352642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6f815e4d0 msgr2=0x7fc6f80cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6f6ffd640 1 --2- 172.21.15.79:0/3289352642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6f815e4d0 0x7fc6f80cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6f6ffd640 1 -- 172.21.15.79:0/3289352642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6f80b3570 msgr2=0x7fc6f8157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6f6ffd640 1 --2- 172.21.15.79:0/3289352642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6f80b3570 0x7fc6f8157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6f6ffd640 1 -- 172.21.15.79:0/3289352642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f80cbbf0 con 0x7fc6f80b3020 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6f6ffd640 1 --2- 172.21.15.79:0/3289352642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f80b3020 0x7fc6f80b5830 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800e9e0 tx=0x7fc6e800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6dffff640 1 -- 172.21.15.79:0/3289352642 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8017070 con 0x7fc6f80b3020 2024-04-25T02:16:48.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6dffff640 1 -- 172.21.15.79:0/3289352642 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e800c9d0 con 0x7fc6f80b3020 2024-04-25T02:16:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6fd97e640 1 -- 172.21.15.79:0/3289352642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f80cb4b0 con 0x7fc6f80b3020 2024-04-25T02:16:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6dffff640 1 -- 172.21.15.79:0/3289352642 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e800cdc0 con 0x7fc6f80b3020 2024-04-25T02:16:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.806+0000 7fc6fd97e640 1 -- 172.21.15.79:0/3289352642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f80b6f70 con 0x7fc6f80b3020 2024-04-25T02:16:48.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.808+0000 7fc6dffff640 1 -- 172.21.15.79:0/3289352642 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc6e801a070 con 0x7fc6f80b3020 2024-04-25T02:16:48.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.808+0000 7fc6dffff640 1 --2- 172.21.15.79:0/3289352642 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc6e406be60 0x7fc6e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.809+0000 7fc6dffff640 1 -- 172.21.15.79:0/3289352642 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7fc6e808ae40 con 0x7fc6f80b3020 2024-04-25T02:16:48.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.809+0000 7fc6f67fc640 1 --2- 172.21.15.79:0/3289352642 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc6e406be60 0x7fc6e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.809+0000 7fc6f67fc640 1 --2- 172.21.15.79:0/3289352642 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc6e406be60 0x7fc6e406e320 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec034000 tx=0x7fc6ec02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.809+0000 7fc70076a740 1 Processor -- start 2024-04-25T02:16:48.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.809+0000 7fc70076a740 1 -- start start 2024-04-25T02:16:48.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.810+0000 7fc70076a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae0947db60 0x55ae094304f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.810+0000 7fc70076a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09460c80 0x55ae09460000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.810+0000 7fc70076a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09460540 0x55ae09435350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.810+0000 7fc70076a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ae09398f00 con 0x55ae09460540 2024-04-25T02:16:48.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.810+0000 7fc70076a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ae09341750 con 0x55ae0947db60 2024-04-25T02:16:48.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.810+0000 7fc70076a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ae09394ec0 con 0x55ae09460c80 2024-04-25T02:16:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.810+0000 7fc6f77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09460540 0x55ae09435350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.810+0000 7fc6f77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09460540 0x55ae09435350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35670/0 (socket says 172.21.15.79:35670) 2024-04-25T02:16:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.810+0000 7fc6f77fe640 1 -- 172.21.15.79:0/696890607 learned_addr learned my addr 172.21.15.79:0/696890607 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.811+0000 7fc6f77fe640 1 -- 172.21.15.79:0/696890607 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09460c80 msgr2=0x55ae09460000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.811+0000 7fc6f77fe640 1 --2- 172.21.15.79:0/696890607 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09460c80 0x55ae09460000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.811+0000 7fc6f77fe640 1 -- 172.21.15.79:0/696890607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae0947db60 msgr2=0x55ae094304f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.811+0000 7fc6f77fe640 1 --2- 172.21.15.79:0/696890607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae0947db60 0x55ae094304f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.811+0000 7fc6f77fe640 1 -- 172.21.15.79:0/696890607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae090ad2d0 con 0x55ae09460540 2024-04-25T02:16:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.811+0000 7fc6f77fe640 1 --2- 172.21.15.79:0/696890607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09460540 0x55ae09435350 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0011310 tx=0x7fc6f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43be5aacfd6e0918 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.811+0000 7fc6dd7fa640 1 -- 172.21.15.79:0/696890607 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f001a070 con 0x55ae09460540 2024-04-25T02:16:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.811+0000 7fc6dd7fa640 1 -- 172.21.15.79:0/696890607 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f0016860 con 0x55ae09460540 2024-04-25T02:16:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.811+0000 7fc6dd7fa640 1 -- 172.21.15.79:0/696890607 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0016c10 con 0x55ae09460540 2024-04-25T02:16:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.811+0000 7fc70076a740 1 -- 172.21.15.79:0/696890607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09460540 msgr2=0x55ae09435350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.811+0000 7fc70076a740 1 --2- 172.21.15.79:0/696890607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09460540 0x55ae09435350 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0011310 tx=0x7fc6f000b040 comp rx=0 tx=0).stop 2024-04-25T02:16:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.812+0000 7fc70076a740 1 -- 172.21.15.79:0/696890607 shutdown_connections 2024-04-25T02:16:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.812+0000 7fc70076a740 1 --2- 172.21.15.79:0/696890607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09460540 0x55ae09435350 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.812+0000 7fc70076a740 1 --2- 172.21.15.79:0/696890607 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09460c80 0x55ae09460000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.812+0000 7fc70076a740 1 --2- 172.21.15.79:0/696890607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae0947db60 0x55ae094304f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.812+0000 7fc70076a740 1 -- 172.21.15.79:0/696890607 >> 172.21.15.79:0/696890607 conn(0x55ae09432760 msgr2=0x55ae0947b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.812+0000 7fc70076a740 1 -- 172.21.15.79:0/696890607 shutdown_connections 2024-04-25T02:16:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.812+0000 7fc70076a740 1 -- 172.21.15.79:0/696890607 wait complete. 2024-04-25T02:16:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.812+0000 7fc70076a740 1 -- start start 2024-04-25T02:16:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.812+0000 7fc70076a740 1 Processor -- start 2024-04-25T02:16:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc70076a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09460c80 0x55ae0944cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc70076a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae0947db60 0x55ae0944ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc70076a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09450d10 0x55ae0947c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc70076a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ae09434910 con 0x55ae09460c80 2024-04-25T02:16:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc70076a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ae09354cf0 con 0x55ae0947db60 2024-04-25T02:16:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc70076a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ae09433d00 con 0x55ae09450d10 2024-04-25T02:16:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc70076a740 10 client.0 _ll_register_callbacks cb 0x55ae093546e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:16:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc6f6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09460c80 0x55ae0944cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc6f6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09460c80 0x55ae0944cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35678/0 (socket says 172.21.15.79:35678) 2024-04-25T02:16:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc6f6ffd640 1 -- 172.21.15.79:0/2267111473 learned_addr learned my addr 172.21.15.79:0/2267111473 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc6f6ffd640 1 -- 172.21.15.79:0/2267111473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09450d10 msgr2=0x55ae0947c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc6f6ffd640 1 --2- 172.21.15.79:0/2267111473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09450d10 0x55ae0947c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc6f6ffd640 1 -- 172.21.15.79:0/2267111473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae0947db60 msgr2=0x55ae0944ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc6f6ffd640 1 --2- 172.21.15.79:0/2267111473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae0947db60 0x55ae0944ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc6f6ffd640 1 -- 172.21.15.79:0/2267111473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae091776b0 con 0x55ae09460c80 2024-04-25T02:16:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc6f6ffd640 1 --2- 172.21.15.79:0/2267111473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09460c80 0x55ae0944cd00 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80617b0 tx=0x7fc6e8058e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcb0050c9d9a3b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.813+0000 7fc6d67fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:16:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc6d67fc640 1 -- 172.21.15.79:0/2267111473 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8021040 con 0x55ae09460c80 2024-04-25T02:16:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc6d67fc640 1 -- 172.21.15.79:0/2267111473 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7fc6e8058600 con 0x55ae09460c80 2024-04-25T02:16:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc70076a740 1 -- 172.21.15.79:0/2267111473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6f0016860 con 0x55ae09460c80 2024-04-25T02:16:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc6d67fc640 1 -- 172.21.15.79:0/2267111473 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fc6e8089120 con 0x55ae09460c80 2024-04-25T02:16:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc70076a740 10 client.8676 fetch_fsmap learned FSMap version 74 2024-04-25T02:16:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc70076a740 1 -- 172.21.15.79:0/2267111473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55ae0944b2b0 con 0x55ae09460c80 2024-04-25T02:16:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc6d67fc640 1 -- 172.21.15.79:0/2267111473 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f0016860 con 0x55ae09460c80 2024-04-25T02:16:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc6d67fc640 1 -- 172.21.15.79:0/2267111473 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7fc6e8082ce0 con 0x55ae09460c80 2024-04-25T02:16:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc70076a740 10 client.8676 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T02:16:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc70076a740 10 client.8676 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T02:16:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc70076a740 20 client.8676 populate_metadata read hostname 'smithi079' 2024-04-25T02:16:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc70076a740 1 --2- 172.21.15.79:0/2267111473 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55ae09479930 0x55ae0944a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc70076a740 4 client.8676 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:16:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc70076a740 1 -- 172.21.15.79:0/2267111473 --> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae093a6440 con 0x55ae09479930 2024-04-25T02:16:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc6f67fc640 1 --2- 172.21.15.79:0/2267111473 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55ae09479930 0x55ae0944a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc6f67fc640 1 --2- 172.21.15.79:0/2267111473 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55ae09479930 0x55ae0944a0d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ada309b99f1d7b6b server_cookie=db08a93b3f1dcedd in_seq=0 out_seq=0 2024-04-25T02:16:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.814+0000 7fc6d67fc640 10 client.8676 ms_handle_connect on v2:172.21.15.79:6834/2550458851 2024-04-25T02:16:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.815+0000 7fc6d67fc640 1 -- 172.21.15.79:0/2267111473 <== mds.0 v2:172.21.15.79:6834/2550458851 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ae093a6440 con 0x55ae09479930 2024-04-25T02:16:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.815+0000 7fc6d67fc640 10 client.8676 handle_command_reply: tid=0 2024-04-25T02:16:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.815+0000 7fc70076a740 1 client.8676 shutdown 2024-04-25T02:16:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.815+0000 7fc70076a740 1 -- 172.21.15.79:0/2267111473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09460c80 msgr2=0x55ae0944cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.815+0000 7fc70076a740 1 --2- 172.21.15.79:0/2267111473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09460c80 0x55ae0944cd00 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80617b0 tx=0x7fc6e8058e10 comp rx=0 tx=0).stop 2024-04-25T02:16:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.815+0000 7fc70076a740 1 -- 172.21.15.79:0/2267111473 shutdown_connections 2024-04-25T02:16:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.815+0000 7fc70076a740 1 --2- 172.21.15.79:0/2267111473 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55ae09479930 0x55ae0944a0d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.815+0000 7fc70076a740 1 --2- 172.21.15.79:0/2267111473 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09450d10 0x55ae0947c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.815+0000 7fc6d67fc640 0 client.8676 ms_handle_reset on v2:172.21.15.79:6834/2550458851 2024-04-25T02:16:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.815+0000 7fc70076a740 1 --2- 172.21.15.79:0/2267111473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae0947db60 0x55ae0944ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.815+0000 7fc70076a740 1 --2- 172.21.15.79:0/2267111473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09460c80 0x55ae0944cd00 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.815+0000 7fc70076a740 1 -- 172.21.15.79:0/2267111473 >> 172.21.15.79:0/2267111473 conn(0x55ae09460540 msgr2=0x55ae0942f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.815+0000 7fc70076a740 1 -- 172.21.15.79:0/2267111473 shutdown_connections 2024-04-25T02:16:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.815+0000 7fc70076a740 1 -- 172.21.15.79:0/2267111473 wait complete. 2024-04-25T02:16:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.815+0000 7fc70076a740 20 client.8676 trim_cache size 0 max 16384 2024-04-25T02:16:48.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.833+0000 7fc70076a740 1 Processor -- start 2024-04-25T02:16:48.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.833+0000 7fc70076a740 1 -- start start 2024-04-25T02:16:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.834+0000 7fc70076a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09450d10 0x55ae0949ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.834+0000 7fc70076a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae09460c80 0x55ae0944fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.834+0000 7fc70076a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae0947db60 0x55ae09450380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.834+0000 7fc70076a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f81f85b0 con 0x55ae0947db60 2024-04-25T02:16:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.834+0000 7fc70076a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f81f7910 con 0x55ae09460c80 2024-04-25T02:16:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.834+0000 7fc70076a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f81f7f60 con 0x55ae09450d10 2024-04-25T02:16:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.834+0000 7fc6f77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae0947db60 0x55ae09450380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.834+0000 7fc6f77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae0947db60 0x55ae09450380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35690/0 (socket says 172.21.15.79:35690) 2024-04-25T02:16:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.834+0000 7fc6f77fe640 1 -- 172.21.15.79:0/3739639637 learned_addr learned my addr 172.21.15.79:0/3739639637 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.834+0000 7fc6f77fe640 1 -- 172.21.15.79:0/3739639637 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09450d10 msgr2=0x55ae0949ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.834+0000 7fc6f77fe640 1 --2- 172.21.15.79:0/3739639637 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09450d10 0x55ae0949ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.834+0000 7fc6f77fe640 1 -- 172.21.15.79:0/3739639637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae09460c80 msgr2=0x55ae0944fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.834+0000 7fc6f77fe640 1 --2- 172.21.15.79:0/3739639637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae09460c80 0x55ae0944fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.834+0000 7fc6f77fe640 1 -- 172.21.15.79:0/3739639637 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae09464550 con 0x55ae0947db60 2024-04-25T02:16:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.834+0000 7fc6f77fe640 1 --2- 172.21.15.79:0/3739639637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae0947db60 0x55ae09450380 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0019000 tx=0x7fc6f0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be963d6278d9f6a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.835+0000 7fc6dcff9640 1 -- 172.21.15.79:0/3739639637 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f001a070 con 0x55ae0947db60 2024-04-25T02:16:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.835+0000 7fc6dcff9640 1 -- 172.21.15.79:0/3739639637 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f0003b90 con 0x55ae0947db60 2024-04-25T02:16:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.835+0000 7fc6dcff9640 1 -- 172.21.15.79:0/3739639637 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0016660 con 0x55ae0947db60 2024-04-25T02:16:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.835+0000 7fc70076a740 1 -- 172.21.15.79:0/3739639637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae0947db60 msgr2=0x55ae09450380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.835+0000 7fc70076a740 1 --2- 172.21.15.79:0/3739639637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae0947db60 0x55ae09450380 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0019000 tx=0x7fc6f0004ab0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.835+0000 7fc70076a740 1 -- 172.21.15.79:0/3739639637 shutdown_connections 2024-04-25T02:16:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.835+0000 7fc70076a740 1 --2- 172.21.15.79:0/3739639637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae0947db60 0x55ae09450380 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.835+0000 7fc70076a740 1 --2- 172.21.15.79:0/3739639637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae09460c80 0x55ae0944fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.835+0000 7fc70076a740 1 --2- 172.21.15.79:0/3739639637 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09450d10 0x55ae0949ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.835+0000 7fc70076a740 1 -- 172.21.15.79:0/3739639637 >> 172.21.15.79:0/3739639637 conn(0x55ae09460540 msgr2=0x55ae0942f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.835+0000 7fc70076a740 1 -- 172.21.15.79:0/3739639637 shutdown_connections 2024-04-25T02:16:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.835+0000 7fc70076a740 1 -- 172.21.15.79:0/3739639637 wait complete. 2024-04-25T02:16:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.836+0000 7fc70076a740 1 -- start start 2024-04-25T02:16:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.836+0000 7fc70076a740 1 Processor -- start 2024-04-25T02:16:48.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc70076a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09450d10 0x55ae0947abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc70076a740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09460c80 0x55ae0947b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc70076a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae0947db60 0x55ae09477b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc70076a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ae094797b0 con 0x55ae09450d10 2024-04-25T02:16:48.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc70076a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ae0947c860 con 0x55ae0947db60 2024-04-25T02:16:48.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc70076a740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ae09463710 con 0x55ae09460c80 2024-04-25T02:16:48.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc70076a740 10 client.0 _ll_register_callbacks cb 0x7fc6e8058b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:16:48.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6f6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09450d10 0x55ae0947abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6f6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09450d10 0x55ae0947abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35704/0 (socket says 172.21.15.79:35704) 2024-04-25T02:16:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6f6ffd640 1 -- 172.21.15.79:0/2556511379 learned_addr learned my addr 172.21.15.79:0/2556511379 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6f77fe640 1 --2- 172.21.15.79:0/2556511379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae0947db60 0x55ae09477b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6f67fc640 1 --2- 172.21.15.79:0/2556511379 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09460c80 0x55ae0947b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6f6ffd640 1 -- 172.21.15.79:0/2556511379 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09460c80 msgr2=0x55ae0947b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6f6ffd640 1 --2- 172.21.15.79:0/2556511379 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09460c80 0x55ae0947b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6f6ffd640 1 -- 172.21.15.79:0/2556511379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae0947db60 msgr2=0x55ae09477b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6f6ffd640 1 --2- 172.21.15.79:0/2556511379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae0947db60 0x55ae09477b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6f6ffd640 1 -- 172.21.15.79:0/2556511379 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae0944b480 con 0x55ae09450d10 2024-04-25T02:16:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6f6ffd640 1 --2- 172.21.15.79:0/2556511379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09450d10 0x55ae0947abf0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8089660 tx=0x7fc6e8009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2573ae25858e310e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6d67fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:16:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6d67fc640 1 -- 172.21.15.79:0/2556511379 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8021030 con 0x55ae09450d10 2024-04-25T02:16:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6d67fc640 1 -- 172.21.15.79:0/2556511379 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7fc6e8054f00 con 0x55ae09450d10 2024-04-25T02:16:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc70076a740 1 -- 172.21.15.79:0/2556511379 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6f0003b90 con 0x55ae09450d10 2024-04-25T02:16:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6d67fc640 1 -- 172.21.15.79:0/2556511379 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fc6e8080050 con 0x55ae09450d10 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc70076a740 10 client.8682 fetch_fsmap learned FSMap version 74 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc70076a740 1 -- 172.21.15.79:0/2556511379 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55ae09477660 con 0x55ae09450d10 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.837+0000 7fc6d67fc640 1 -- 172.21.15.79:0/2556511379 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f0003b90 con 0x55ae09450d10 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc6d67fc640 1 -- 172.21.15.79:0/2556511379 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7fc6e8082ce0 con 0x55ae09450d10 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 10 client.8682 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 10 client.8682 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 20 client.8682 populate_metadata read hostname 'smithi079' 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 1 --2- 172.21.15.79:0/2556511379 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55ae0948d130 0x55ae0948d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 4 client.8682 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 1 -- 172.21.15.79:0/2556511379 --> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] -- command(tid 0: {"prefix": "status"}) -- 0x55ae093a0790 con 0x55ae0948d130 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc6f67fc640 1 --2- 172.21.15.79:0/2556511379 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55ae0948d130 0x55ae0948d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc6d67fc640 10 client.8682 ms_handle_connect on v2:172.21.15.79:6834/2550458851 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc6f67fc640 1 --2- 172.21.15.79:0/2556511379 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55ae0948d130 0x55ae0948d510 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=888f7410e1e0632 server_cookie=eab1ac64c29a194 in_seq=0 out_seq=0 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc6d67fc640 1 -- 172.21.15.79:0/2556511379 <== mds.0 v2:172.21.15.79:6834/2550458851 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55ae093a0790 con 0x55ae0948d130 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc6d67fc640 10 client.8682 handle_command_reply: tid=0 2024-04-25T02:16:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 1 client.8682 shutdown 2024-04-25T02:16:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 1 -- 172.21.15.79:0/2556511379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09450d10 msgr2=0x55ae0947abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 1 --2- 172.21.15.79:0/2556511379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09450d10 0x55ae0947abf0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8089660 tx=0x7fc6e8009200 comp rx=0 tx=0).stop 2024-04-25T02:16:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 1 -- 172.21.15.79:0/2556511379 shutdown_connections 2024-04-25T02:16:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 1 --2- 172.21.15.79:0/2556511379 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55ae0948d130 0x55ae0948d510 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 1 --2- 172.21.15.79:0/2556511379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ae0947db60 0x55ae09477b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 1 --2- 172.21.15.79:0/2556511379 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ae09460c80 0x55ae0947b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc6d67fc640 0 client.8682 ms_handle_reset on v2:172.21.15.79:6834/2550458851 2024-04-25T02:16:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 1 --2- 172.21.15.79:0/2556511379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae09450d10 0x55ae0947abf0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 1 -- 172.21.15.79:0/2556511379 >> 172.21.15.79:0/2556511379 conn(0x55ae09460540 msgr2=0x55ae0949fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 1 -- 172.21.15.79:0/2556511379 shutdown_connections 2024-04-25T02:16:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 1 -- 172.21.15.79:0/2556511379 wait complete. 2024-04-25T02:16:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.838+0000 7fc70076a740 20 client.8682 trim_cache size 0 max 16384 2024-04-25T02:16:48.850 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:16:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "696648c4-3e52-400b-a780-2e8863c56c42", 2024-04-25T02:16:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-04-25T02:16:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 8601, 2024-04-25T02:16:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-04-25T02:16:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-04-25T02:16:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-04-25T02:16:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.3675841550000003, 2024-04-25T02:16:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 74, 2024-04-25T02:16:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 103, 2024-04-25T02:16:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 103, 2024-04-25T02:16:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 5.3375017539999998 2024-04-25T02:16:48.850 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:16:48.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.839+0000 7fc6fd97e640 1 -- 172.21.15.79:0/3289352642 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc6e406be60 msgr2=0x7fc6e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.839+0000 7fc6fd97e640 1 --2- 172.21.15.79:0/3289352642 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc6e406be60 0x7fc6e406e320 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec034000 tx=0x7fc6ec02e000 comp rx=0 tx=0).stop 2024-04-25T02:16:48.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.839+0000 7fc6fd97e640 1 -- 172.21.15.79:0/3289352642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f80b3020 msgr2=0x7fc6f80b5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.839+0000 7fc6fd97e640 1 --2- 172.21.15.79:0/3289352642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f80b3020 0x7fc6f80b5830 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800e9e0 tx=0x7fc6e800eea0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.839+0000 7fc6fd97e640 1 -- 172.21.15.79:0/3289352642 shutdown_connections 2024-04-25T02:16:48.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.839+0000 7fc6fd97e640 1 --2- 172.21.15.79:0/3289352642 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc6e406be60 0x7fc6e406e320 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.839+0000 7fc6fd97e640 1 --2- 172.21.15.79:0/3289352642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6f815e4d0 0x7fc6f80cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.839+0000 7fc6fd97e640 1 --2- 172.21.15.79:0/3289352642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6f80b3570 0x7fc6f8157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.839+0000 7fc6fd97e640 1 --2- 172.21.15.79:0/3289352642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f80b3020 0x7fc6f80b5830 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.839+0000 7fc6fd97e640 1 -- 172.21.15.79:0/3289352642 >> 172.21.15.79:0/3289352642 conn(0x7fc6f809d460 msgr2=0x7fc6f80cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:48.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.839+0000 7fc6fd97e640 1 -- 172.21.15.79:0/3289352642 shutdown_connections 2024-04-25T02:16:48.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.839+0000 7fc6fd97e640 1 -- 172.21.15.79:0/3289352642 wait complete. 2024-04-25T02:16:48.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T02:16:48.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:48.857 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-25T02:16:48.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.954+0000 7f5c129d5640 1 Processor -- start 2024-04-25T02:16:48.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.954+0000 7f5c129d5640 1 -- start start 2024-04-25T02:16:48.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.955+0000 7f5c129d5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5c0c15e440 0x7f5c0c0cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.955+0000 7f5c129d5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c0c0d2f20 0x7f5c0c0cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.955+0000 7f5c129d5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c0c0d1e80 con 0x7f5c0c0d0990 2024-04-25T02:16:48.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.955+0000 7f5c129d5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5c0c0d2160 con 0x7f5c0c0d2f20 2024-04-25T02:16:48.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.955+0000 7f5c129d5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f5c0c0d2440 con 0x7f5c0c15e440 2024-04-25T02:16:48.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.955+0000 7f5c0b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c0c0d2f20 0x7f5c0c0cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.955+0000 7f5c0b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c0c0d2f20 0x7f5c0c0cfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35712/0 (socket says 172.21.15.79:35712) 2024-04-25T02:16:48.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.955+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/3262326543 learned_addr learned my addr 172.21.15.79:0/3262326543 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:48.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.955+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/3262326543 >> v2:172.21.15.189:3300/0 conn(0x7f5c0c15e440 msgr2=0x7f5c0c0cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.955+0000 7f5c0b7fe640 1 --2- 172.21.15.79:0/3262326543 >> v2:172.21.15.189:3300/0 conn(0x7f5c0c15e440 0x7f5c0c0cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.955+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/3262326543 >> v1:172.21.15.189:6789/0 conn(0x7f5c0c0d0990 legacy=0x7f5c0c161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.955+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/3262326543 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0c0d2720 con 0x7f5c0c0d2f20 2024-04-25T02:16:48.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.956+0000 7f5c0b7fe640 1 --2- 172.21.15.79:0/3262326543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c0c0d2f20 0x7f5c0c0cfdb0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0d4000 tx=0x7f5bfc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d794034e8e7d8dcf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.956+0000 7f5c0affd640 1 -- 172.21.15.79:0/3262326543 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc037070 con 0x7f5c0c0d2f20 2024-04-25T02:16:48.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.956+0000 7f5c0affd640 1 -- 172.21.15.79:0/3262326543 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bfc032440 con 0x7f5c0c0d2f20 2024-04-25T02:16:48.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.956+0000 7f5c0affd640 1 -- 172.21.15.79:0/3262326543 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc032810 con 0x7f5c0c0d2f20 2024-04-25T02:16:48.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.957+0000 7f5c129d5640 1 -- 172.21.15.79:0/3262326543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c0c0d2f20 msgr2=0x7f5c0c0cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.957+0000 7f5c129d5640 1 --2- 172.21.15.79:0/3262326543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c0c0d2f20 0x7f5c0c0cfdb0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0d4000 tx=0x7f5bfc02a230 comp rx=0 tx=0).stop 2024-04-25T02:16:48.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.957+0000 7f5c129d5640 1 -- 172.21.15.79:0/3262326543 shutdown_connections 2024-04-25T02:16:48.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.957+0000 7f5c129d5640 1 --2- 172.21.15.79:0/3262326543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c0c0d2f20 0x7f5c0c0cfdb0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.957+0000 7f5c129d5640 1 --2- 172.21.15.79:0/3262326543 >> v2:172.21.15.189:3300/0 conn(0x7f5c0c15e440 0x7f5c0c0cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.957+0000 7f5c129d5640 1 -- 172.21.15.79:0/3262326543 >> 172.21.15.79:0/3262326543 conn(0x7f5c0c09d450 msgr2=0x7f5c0c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:48.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.957+0000 7f5c129d5640 1 -- 172.21.15.79:0/3262326543 shutdown_connections 2024-04-25T02:16:48.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.957+0000 7f5c129d5640 1 -- 172.21.15.79:0/3262326543 wait complete. 2024-04-25T02:16:48.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.958+0000 7f5c129d5640 1 Processor -- start 2024-04-25T02:16:48.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.958+0000 7f5c129d5640 1 -- start start 2024-04-25T02:16:48.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c129d5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c0c0d0990 0x7f5c0c0c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c129d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c0c0d2f20 0x7f5c0c152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c129d5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c0c15e440 0x7f5c0c15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c129d5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c0d0fa0 con 0x7f5c0c0d2f20 2024-04-25T02:16:48.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c129d5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c0d0e20 con 0x7f5c0c0d0990 2024-04-25T02:16:48.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c129d5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0c0d1120 con 0x7f5c0c15e440 2024-04-25T02:16:48.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c0b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c0c0d2f20 0x7f5c0c152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c0b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c0c0d2f20 0x7f5c0c152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35720/0 (socket says 172.21.15.79:35720) 2024-04-25T02:16:48.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/1302454484 learned_addr learned my addr 172.21.15.79:0/1302454484 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:48.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c10f72640 1 --2- 172.21.15.79:0/1302454484 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c0c15e440 0x7f5c0c15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c0bfff640 1 --2- 172.21.15.79:0/1302454484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c0c0d0990 0x7f5c0c0c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/1302454484 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c0c15e440 msgr2=0x7f5c0c15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c0b7fe640 1 --2- 172.21.15.79:0/1302454484 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c0c15e440 0x7f5c0c15a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/1302454484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c0c0d0990 msgr2=0x7f5c0c0c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c0b7fe640 1 --2- 172.21.15.79:0/1302454484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c0c0d0990 0x7f5c0c0c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/1302454484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0c0c8980 con 0x7f5c0c0d2f20 2024-04-25T02:16:48.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c0bfff640 1 --2- 172.21.15.79:0/1302454484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c0c0d0990 0x7f5c0c0c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:48.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.959+0000 7f5c0b7fe640 1 --2- 172.21.15.79:0/1302454484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c0c0d2f20 0x7f5c0c152eb0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc000c00 tx=0x7f5bfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.960+0000 7f5c08ff9640 1 -- 172.21.15.79:0/1302454484 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc041070 con 0x7f5c0c0d2f20 2024-04-25T02:16:48.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.960+0000 7f5c08ff9640 1 -- 172.21.15.79:0/1302454484 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bfc03c870 con 0x7f5c0c0d2f20 2024-04-25T02:16:48.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.960+0000 7f5c08ff9640 1 -- 172.21.15.79:0/1302454484 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc037040 con 0x7f5c0c0d2f20 2024-04-25T02:16:48.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.960+0000 7f5c129d5640 1 -- 172.21.15.79:0/1302454484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0c157e80 con 0x7f5c0c0d2f20 2024-04-25T02:16:48.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.960+0000 7f5c129d5640 1 -- 172.21.15.79:0/1302454484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c0c158440 con 0x7f5c0c0d2f20 2024-04-25T02:16:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.962+0000 7f5c08ff9640 1 -- 172.21.15.79:0/1302454484 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5bfc044070 con 0x7f5c0c0d2f20 2024-04-25T02:16:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.962+0000 7f5c08ff9640 1 --2- 172.21.15.79:0/1302454484 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5bf806be30 0x7f5bf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.962+0000 7f5c08ff9640 1 -- 172.21.15.79:0/1302454484 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7f5bfc0aba00 con 0x7f5c0c0d2f20 2024-04-25T02:16:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.962+0000 7f5c0bfff640 1 --2- 172.21.15.79:0/1302454484 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5bf806be30 0x7f5bf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.962+0000 7f5c157c0740 1 Processor -- start 2024-04-25T02:16:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.962+0000 7f5c157c0740 1 -- start start 2024-04-25T02:16:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.963+0000 7f5c0bfff640 1 --2- 172.21.15.79:0/1302454484 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5bf806be30 0x7f5bf806e2f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009890 tx=0x7f5c00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.963+0000 7f5c157c0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc18280 0x55fbfcc1a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.963+0000 7f5c157c0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc18660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.963+0000 7f5c157c0740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc42d40 0x55fbfcc431c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.963+0000 7f5c157c0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fbfcb7b2c0 con 0x55fbfcc54950 2024-04-25T02:16:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.963+0000 7f5c157c0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fbfcb23910 con 0x55fbfcc18280 2024-04-25T02:16:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.963+0000 7f5c157c0740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55fbfcb77280 con 0x55fbfcc42d40 2024-04-25T02:16:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.963+0000 7f5c0b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc18660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.963+0000 7f5c0b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc18660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35730/0 (socket says 172.21.15.79:35730) 2024-04-25T02:16:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.963+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/2810096700 learned_addr learned my addr 172.21.15.79:0/2810096700 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.963+0000 7f5c0bfff640 1 --2- 172.21.15.79:0/2810096700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc18280 0x55fbfcc1a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.963+0000 7f5c10f72640 1 --2- 172.21.15.79:0/2810096700 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc42d40 0x55fbfcc431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.964+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/2810096700 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc42d40 msgr2=0x55fbfcc431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.964+0000 7f5c0b7fe640 1 --2- 172.21.15.79:0/2810096700 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc42d40 0x55fbfcc431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.964+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/2810096700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc18280 msgr2=0x55fbfcc1a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.964+0000 7f5c0b7fe640 1 --2- 172.21.15.79:0/2810096700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc18280 0x55fbfcc1a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.964+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/2810096700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbfcb34fb0 con 0x55fbfcc54950 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.964+0000 7f5c0b7fe640 1 --2- 172.21.15.79:0/2810096700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc18660 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc0a9ef0 tx=0x7f5bfc079c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00cb82845ed6b84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.964+0000 7f5bf1ffb640 1 -- 172.21.15.79:0/2810096700 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc04b040 con 0x55fbfcc54950 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.964+0000 7f5bf1ffb640 1 -- 172.21.15.79:0/2810096700 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bfc082830 con 0x55fbfcc54950 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.964+0000 7f5bf1ffb640 1 -- 172.21.15.79:0/2810096700 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc03cd80 con 0x55fbfcc54950 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.965+0000 7f5c157c0740 1 -- 172.21.15.79:0/2810096700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 msgr2=0x55fbfcc18660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.965+0000 7f5c157c0740 1 --2- 172.21.15.79:0/2810096700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc18660 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc0a9ef0 tx=0x7f5bfc079c00 comp rx=0 tx=0).stop 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.965+0000 7f5c157c0740 1 -- 172.21.15.79:0/2810096700 shutdown_connections 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.965+0000 7f5c157c0740 1 --2- 172.21.15.79:0/2810096700 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc42d40 0x55fbfcc431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.965+0000 7f5c157c0740 1 --2- 172.21.15.79:0/2810096700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc18660 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.965+0000 7f5c157c0740 1 --2- 172.21.15.79:0/2810096700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc18280 0x55fbfcc1a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.965+0000 7f5c157c0740 1 -- 172.21.15.79:0/2810096700 >> 172.21.15.79:0/2810096700 conn(0x55fbfcbdf950 msgr2=0x55fbfcc5dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.965+0000 7f5c157c0740 1 -- 172.21.15.79:0/2810096700 shutdown_connections 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.965+0000 7f5c157c0740 1 -- 172.21.15.79:0/2810096700 wait complete. 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.965+0000 7f5c157c0740 1 -- start start 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.966+0000 7f5c157c0740 1 Processor -- start 2024-04-25T02:16:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.966+0000 7f5c157c0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc18280 0x55fbfcc40390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.966+0000 7f5c157c0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc42d40 0x55fbfcc59020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.966+0000 7f5c157c0740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc54950 0x55fbfcc570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.966+0000 7f5c157c0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fbfcb7b2c0 con 0x55fbfcc42d40 2024-04-25T02:16:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.966+0000 7f5c157c0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fbfcb36e90 con 0x55fbfcc18280 2024-04-25T02:16:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.966+0000 7f5c157c0740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55fbfcc6f260 con 0x55fbfcc54950 2024-04-25T02:16:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.966+0000 7f5c157c0740 10 client.0 _ll_register_callbacks cb 0x55fbfcb72970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:16:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.966+0000 7f5c0b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc42d40 0x55fbfcc59020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.966+0000 7f5c0b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc42d40 0x55fbfcc59020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35736/0 (socket says 172.21.15.79:35736) 2024-04-25T02:16:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.966+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/1770009972 learned_addr learned my addr 172.21.15.79:0/1770009972 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c10f72640 1 --2- 172.21.15.79:0/1770009972 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc54950 0x55fbfcc570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c0bfff640 1 --2- 172.21.15.79:0/1770009972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc18280 0x55fbfcc40390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/1770009972 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc54950 msgr2=0x55fbfcc570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c0b7fe640 1 --2- 172.21.15.79:0/1770009972 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc54950 0x55fbfcc570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/1770009972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc18280 msgr2=0x55fbfcc40390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c0b7fe640 1 --2- 172.21.15.79:0/1770009972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc18280 0x55fbfcc40390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c0b7fe640 1 -- 172.21.15.79:0/1770009972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbfc9577e0 con 0x55fbfcc42d40 2024-04-25T02:16:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c0b7fe640 1 --2- 172.21.15.79:0/1770009972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc42d40 0x55fbfcc59020 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc02a270 tx=0x7f5bfc007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e54aa0d7795f87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5beaffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:16:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5beaffd640 1 -- 172.21.15.79:0/1770009972 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc04b040 con 0x55fbfcc42d40 2024-04-25T02:16:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5beaffd640 1 -- 172.21.15.79:0/1770009972 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7f5bfc0823a0 con 0x55fbfcc42d40 2024-04-25T02:16:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c157c0740 1 -- 172.21.15.79:0/1770009972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bfc082830 con 0x55fbfcc42d40 2024-04-25T02:16:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5beaffd640 1 -- 172.21.15.79:0/1770009972 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f5bfc09f050 con 0x55fbfcc42d40 2024-04-25T02:16:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c157c0740 10 client.8694 fetch_fsmap learned FSMap version 74 2024-04-25T02:16:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c157c0740 1 -- 172.21.15.79:0/1770009972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55fbfc9b7f70 con 0x55fbfcc42d40 2024-04-25T02:16:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5beaffd640 1 -- 172.21.15.79:0/1770009972 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bfc082830 con 0x55fbfcc42d40 2024-04-25T02:16:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5beaffd640 1 -- 172.21.15.79:0/1770009972 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f5bfc0a2020 con 0x55fbfcc42d40 2024-04-25T02:16:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c157c0740 10 client.8694 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T02:16:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c157c0740 10 client.8694 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T02:16:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c157c0740 20 client.8694 populate_metadata read hostname 'smithi079' 2024-04-25T02:16:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c157c0740 1 --2- 172.21.15.79:0/1770009972 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55fbfcc45c80 0x55fbfcc46080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c157c0740 4 client.8694 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:16:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c157c0740 1 -- 172.21.15.79:0/1770009972 --> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbfcb4f5a0 con 0x55fbfcc45c80 2024-04-25T02:16:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.967+0000 7f5c0bfff640 1 --2- 172.21.15.79:0/1770009972 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55fbfcc45c80 0x55fbfcc46080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.968+0000 7f5beaffd640 10 client.8694 ms_handle_connect on v2:172.21.15.79:6834/2550458851 2024-04-25T02:16:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.968+0000 7f5c0bfff640 1 --2- 172.21.15.79:0/1770009972 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55fbfcc45c80 0x55fbfcc46080 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72807a7157cd3701 server_cookie=f45dc72c200ae383 in_seq=0 out_seq=0 2024-04-25T02:16:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.968+0000 7f5beaffd640 1 -- 172.21.15.79:0/1770009972 <== mds.0 v2:172.21.15.79:6834/2550458851 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fbfcb4f5a0 con 0x55fbfcc45c80 2024-04-25T02:16:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.968+0000 7f5beaffd640 10 client.8694 handle_command_reply: tid=0 2024-04-25T02:16:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.968+0000 7f5c157c0740 1 client.8694 shutdown 2024-04-25T02:16:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.969+0000 7f5c157c0740 1 -- 172.21.15.79:0/1770009972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc42d40 msgr2=0x55fbfcc59020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.969+0000 7f5c157c0740 1 --2- 172.21.15.79:0/1770009972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc42d40 0x55fbfcc59020 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc02a270 tx=0x7f5bfc007000 comp rx=0 tx=0).stop 2024-04-25T02:16:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.969+0000 7f5c157c0740 1 -- 172.21.15.79:0/1770009972 shutdown_connections 2024-04-25T02:16:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.969+0000 7f5c157c0740 1 --2- 172.21.15.79:0/1770009972 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55fbfcc45c80 0x55fbfcc46080 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.969+0000 7f5c157c0740 1 --2- 172.21.15.79:0/1770009972 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc54950 0x55fbfcc570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.969+0000 7f5c157c0740 1 --2- 172.21.15.79:0/1770009972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc42d40 0x55fbfcc59020 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.969+0000 7f5c157c0740 1 --2- 172.21.15.79:0/1770009972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc18280 0x55fbfcc40390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.969+0000 7f5beaffd640 0 client.8694 ms_handle_reset on v2:172.21.15.79:6834/2550458851 2024-04-25T02:16:48.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.969+0000 7f5c157c0740 1 -- 172.21.15.79:0/1770009972 >> 172.21.15.79:0/1770009972 conn(0x55fbfcbdf950 msgr2=0x55fbfcc120c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:48.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.969+0000 7f5c157c0740 1 -- 172.21.15.79:0/1770009972 shutdown_connections 2024-04-25T02:16:48.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.969+0000 7f5c157c0740 1 -- 172.21.15.79:0/1770009972 wait complete. 2024-04-25T02:16:48.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.969+0000 7f5c157c0740 20 client.8694 trim_cache size 0 max 16384 2024-04-25T02:16:48.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.974+0000 7fbfeeb84640 1 Processor -- start 2024-04-25T02:16:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.974+0000 7fbfeeb84640 1 -- start start 2024-04-25T02:16:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfeeb84640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbfe815c380 0x7fbfe80ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfeeb84640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbfe80d0490 0x7fbfe80d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfeeb84640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbfe80b2390 0x7fbfe80b2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfeeb84640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe815c760 con 0x7fbfe815c380 2024-04-25T02:16:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfeeb84640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe80cff90 con 0x7fbfe80d0490 2024-04-25T02:16:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfeeb84640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe80d2a70 con 0x7fbfe80b2390 2024-04-25T02:16:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfec920640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbfe815c380 0x7fbfe80ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfec920640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbfe815c380 0x7fbfe80ceec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35738/0 (socket says 172.21.15.79:35738) 2024-04-25T02:16:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfec920640 1 -- 172.21.15.79:0/4080207111 learned_addr learned my addr 172.21.15.79:0/4080207111 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfed121640 1 --2- 172.21.15.79:0/4080207111 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbfe80b2390 0x7fbfe80b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfe7fff640 1 --2- 172.21.15.79:0/4080207111 >> v2:172.21.15.189:3300/0 conn(0x7fbfe80d0490 0x7fbfe80d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfec920640 1 -- 172.21.15.79:0/4080207111 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbfe80b2390 msgr2=0x7fbfe80b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfec920640 1 --2- 172.21.15.79:0/4080207111 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbfe80b2390 0x7fbfe80b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfec920640 1 -- 172.21.15.79:0/4080207111 >> v2:172.21.15.189:3300/0 conn(0x7fbfe80d0490 msgr2=0x7fbfe80d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfec920640 1 --2- 172.21.15.79:0/4080207111 >> v2:172.21.15.189:3300/0 conn(0x7fbfe80d0490 0x7fbfe80d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.975+0000 7fbfec920640 1 -- 172.21.15.79:0/4080207111 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe80d2d50 con 0x7fbfe815c380 2024-04-25T02:16:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.976+0000 7fbfec920640 1 --2- 172.21.15.79:0/4080207111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfe815c380 0x7fbfe80ceec0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fbfe815fd60 tx=0x7fbfdc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cafd74a86001c95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.976+0000 7fbfe77fe640 1 -- 172.21.15.79:0/4080207111 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc004030 con 0x7fbfe815c380 2024-04-25T02:16:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.976+0000 7fbfe77fe640 1 -- 172.21.15.79:0/4080207111 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfdc0041d0 con 0x7fbfe815c380 2024-04-25T02:16:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.976+0000 7fbfe77fe640 1 -- 172.21.15.79:0/4080207111 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc003610 con 0x7fbfe815c380 2024-04-25T02:16:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.977+0000 7fbfeeb84640 1 -- 172.21.15.79:0/4080207111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfe815c380 msgr2=0x7fbfe80ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.977+0000 7fbfeeb84640 1 --2- 172.21.15.79:0/4080207111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfe815c380 0x7fbfe80ceec0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fbfe815fd60 tx=0x7fbfdc02a1c0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.977+0000 7fbfeeb84640 1 -- 172.21.15.79:0/4080207111 shutdown_connections 2024-04-25T02:16:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.977+0000 7fbfeeb84640 1 --2- 172.21.15.79:0/4080207111 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbfe80b2390 0x7fbfe80b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.977+0000 7fbfeeb84640 1 --2- 172.21.15.79:0/4080207111 >> v2:172.21.15.189:3300/0 conn(0x7fbfe80d0490 0x7fbfe80d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.977+0000 7fbfeeb84640 1 --2- 172.21.15.79:0/4080207111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfe815c380 0x7fbfe80ceec0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.977+0000 7fbfeeb84640 1 -- 172.21.15.79:0/4080207111 >> 172.21.15.79:0/4080207111 conn(0x7fbfe80d1eb0 msgr2=0x7fbfe80d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:48.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.977+0000 7fbfeeb84640 1 -- 172.21.15.79:0/4080207111 shutdown_connections 2024-04-25T02:16:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.977+0000 7fbfeeb84640 1 -- 172.21.15.79:0/4080207111 wait complete. 2024-04-25T02:16:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.978+0000 7fbfeeb84640 1 Processor -- start 2024-04-25T02:16:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.978+0000 7fbfeeb84640 1 -- start start 2024-04-25T02:16:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfeeb84640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbfe80b2390 0x7fbfe815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfeeb84640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfe80d0490 0x7fbfe809ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfeeb84640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfe815c380 0x7fbfe80b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfeeb84640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe80b1b90 con 0x7fbfe815c380 2024-04-25T02:16:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfeeb84640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe80b18b0 con 0x7fbfe80d0490 2024-04-25T02:16:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfeeb84640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe80b1e70 con 0x7fbfe80b2390 2024-04-25T02:16:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfed121640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfe815c380 0x7fbfe80b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfed121640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfe815c380 0x7fbfe80b3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35748/0 (socket says 172.21.15.79:35748) 2024-04-25T02:16:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfed121640 1 -- 172.21.15.79:0/993865604 learned_addr learned my addr 172.21.15.79:0/993865604 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfed121640 1 -- 172.21.15.79:0/993865604 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbfe80b2390 msgr2=0x7fbfe815ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfed121640 1 --2- 172.21.15.79:0/993865604 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbfe80b2390 0x7fbfe815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfed121640 1 -- 172.21.15.79:0/993865604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfe80d0490 msgr2=0x7fbfe809ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfe7fff640 1 --2- 172.21.15.79:0/993865604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfe80d0490 0x7fbfe809ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfed121640 1 --2- 172.21.15.79:0/993865604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfe80d0490 0x7fbfe809ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfed121640 1 -- 172.21.15.79:0/993865604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe809f750 con 0x7fbfe815c380 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfed121640 1 --2- 172.21.15.79:0/993865604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfe815c380 0x7fbfe80b3210 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0007d20 tx=0x7fbfe000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.979+0000 7fbfe57fa640 1 -- 172.21.15.79:0/993865604 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0014420 con 0x7fbfe815c380 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.980+0000 7fbfe57fa640 1 -- 172.21.15.79:0/993865604 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe0019070 con 0x7fbfe815c380 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.980+0000 7fbfeeb84640 1 -- 172.21.15.79:0/993865604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe809fa30 con 0x7fbfe815c380 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.980+0000 7fbfe57fa640 1 -- 172.21.15.79:0/993865604 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0014820 con 0x7fbfe815c380 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.980+0000 7fbfeeb84640 1 -- 172.21.15.79:0/993865604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe815b3b0 con 0x7fbfe815c380 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.980+0000 7fbfeeb84640 1 -- 172.21.15.79:0/993865604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fbfe80681e0 con 0x7fbfe815c380 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.981+0000 7fbfe57fa640 1 -- 172.21.15.79:0/993865604 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbfe00149c0 con 0x7fbfe815c380 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.982+0000 7fbfe57fa640 1 --2- 172.21.15.79:0/993865604 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbfcc06be30 0x7fbfcc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.982+0000 7fbfe57fa640 1 -- 172.21.15.79:0/993865604 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7fbfe008c120 con 0x7fbfe815c380 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.982+0000 7fbfec920640 1 --2- 172.21.15.79:0/993865604 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbfcc06be30 0x7fbfcc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.982+0000 7fbfe57fa640 1 -- 172.21.15.79:0/993865604 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+512 (secure 0 0 0) 0x7fbfe008c5b0 con 0x7fbfe815c380 2024-04-25T02:16:48.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.982+0000 7fbfeeb84640 1 -- 172.21.15.79:0/993865604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7fbfe80cd810 con 0x7fbfe815c380 2024-04-25T02:16:48.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.982+0000 7fbfec920640 1 --2- 172.21.15.79:0/993865604 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbfcc06be30 0x7fbfcc06e2f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc033000 tx=0x7fbfdc02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:48.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.982+0000 7fbfe57fa640 1 -- 172.21.15.79:0/993865604 <== mon.0 v2:172.21.15.79:3300/0 7 ==== log(2 entries from seq 1117 at 2024-04-25T02:16:47.478654+0000) ==== 389+0+0 (secure 0 0 0) 0x7fbfe0027e70 con 0x7fbfe815c380 2024-04-25T02:16:48.992 INFO:teuthology.orchestra.run.smithi079.stdout: cluster: 2024-04-25T02:16:48.992 INFO:teuthology.orchestra.run.smithi079.stdout: id: 696648c4-3e52-400b-a780-2e8863c56c42 2024-04-25T02:16:48.992 INFO:teuthology.orchestra.run.smithi079.stdout: health: HEALTH_OK 2024-04-25T02:16:48.992 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:48.992 INFO:teuthology.orchestra.run.smithi079.stdout: services: 2024-04-25T02:16:48.992 INFO:teuthology.orchestra.run.smithi079.stdout: mon: 3 daemons, quorum a,b,c (age 9m) 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout: mgr: y(active, since 9m), standbys: x 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout: data: 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout: volumes: 1/1 healthy 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout: pools: 3 pools, 97 pgs 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout: objects: 30 objects, 19 MiB 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout: usage: 291 MiB used, 720 GiB / 720 GiB avail 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout: pgs: 97 active+clean 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout: io: 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout: client: 1.8 KiB/s rd, 102 B/s wr, 1 op/s rd, 0 op/s wr 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:16:48.993 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:47.478654+0000 mon.a [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T02:16:48.994 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:47.478676+0000 mon.a [INF] Cluster is now healthy 2024-04-25T02:16:48.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.988+0000 7f5c157c0740 1 Processor -- start 2024-04-25T02:16:48.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.988+0000 7f5c157c0740 1 -- start start 2024-04-25T02:16:48.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c157c0740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc18280 0x55fbfcc5e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:48.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c157c0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc42d40 0x55fbfcc0e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c157c0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc122b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c157c0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c200810 con 0x55fbfcc54950 2024-04-25T02:16:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c157c0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c1ff870 con 0x55fbfcc42d40 2024-04-25T02:16:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c157c0740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0c1febd0 con 0x55fbfcc18280 2024-04-25T02:16:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c10f72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c10f72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc122b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35750/0 (socket says 172.21.15.79:35750) 2024-04-25T02:16:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c10f72640 1 -- 172.21.15.79:0/1867931093 learned_addr learned my addr 172.21.15.79:0/1867931093 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c0bfff640 1 --2- 172.21.15.79:0/1867931093 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc18280 0x55fbfcc5e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c10f72640 1 -- 172.21.15.79:0/1867931093 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc18280 msgr2=0x55fbfcc5e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c0b7fe640 1 --2- 172.21.15.79:0/1867931093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc42d40 0x55fbfcc0e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c10f72640 1 --2- 172.21.15.79:0/1867931093 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc18280 0x55fbfcc5e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c10f72640 1 -- 172.21.15.79:0/1867931093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc42d40 msgr2=0x55fbfcc0e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c10f72640 1 --2- 172.21.15.79:0/1867931093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc42d40 0x55fbfcc0e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c10f72640 1 -- 172.21.15.79:0/1867931093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbfc84f170 con 0x55fbfcc54950 2024-04-25T02:16:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c0b7fe640 1 --2- 172.21.15.79:0/1867931093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc42d40 0x55fbfcc0e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5c10f72640 1 --2- 172.21.15.79:0/1867931093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc122b0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f5c04003d50 tx=0x7f5c040015d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cc4f434fa24140 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5bf17fa640 1 -- 172.21.15.79:0/1867931093 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04006d20 con 0x55fbfcc54950 2024-04-25T02:16:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5bf17fa640 1 -- 172.21.15.79:0/1867931093 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c04007050 con 0x55fbfcc54950 2024-04-25T02:16:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.989+0000 7f5bf17fa640 1 -- 172.21.15.79:0/1867931093 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04007240 con 0x55fbfcc54950 2024-04-25T02:16:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.990+0000 7f5c157c0740 1 -- 172.21.15.79:0/1867931093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 msgr2=0x55fbfcc122b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.990+0000 7f5c157c0740 1 --2- 172.21.15.79:0/1867931093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc122b0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f5c04003d50 tx=0x7f5c040015d0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.990+0000 7f5c157c0740 1 -- 172.21.15.79:0/1867931093 shutdown_connections 2024-04-25T02:16:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.990+0000 7f5c157c0740 1 --2- 172.21.15.79:0/1867931093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc122b0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.990+0000 7f5c157c0740 1 --2- 172.21.15.79:0/1867931093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc42d40 0x55fbfcc0e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.990+0000 7f5c157c0740 1 --2- 172.21.15.79:0/1867931093 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc18280 0x55fbfcc5e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.990+0000 7f5c157c0740 1 -- 172.21.15.79:0/1867931093 >> 172.21.15.79:0/1867931093 conn(0x55fbfcbdf950 msgr2=0x55fbfcc59cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.990+0000 7f5c157c0740 1 -- 172.21.15.79:0/1867931093 shutdown_connections 2024-04-25T02:16:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.990+0000 7f5c157c0740 1 -- 172.21.15.79:0/1867931093 wait complete. 2024-04-25T02:16:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.991+0000 7f5c157c0740 1 -- start start 2024-04-25T02:16:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.991+0000 7f5c157c0740 1 Processor -- start 2024-04-25T02:16:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.991+0000 7f5c157c0740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc18280 0x55fbfcc16cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.991+0000 7f5c157c0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc42d40 0x55fbfcc3e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c157c0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc3e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c157c0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fbfcc46fc0 con 0x55fbfcc54950 2024-04-25T02:16:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c157c0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c1ff220 con 0x55fbfcc42d40 2024-04-25T02:16:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c157c0740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55fbfcb36e90 con 0x55fbfcc18280 2024-04-25T02:16:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c157c0740 10 client.0 _ll_register_callbacks cb 0x7f5c00009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:16:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c10f72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc3e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c10f72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc3e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35756/0 (socket says 172.21.15.79:35756) 2024-04-25T02:16:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c10f72640 1 -- 172.21.15.79:0/3979662862 learned_addr learned my addr 172.21.15.79:0/3979662862 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c0bfff640 1 --2- 172.21.15.79:0/3979662862 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc18280 0x55fbfcc16cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c0b7fe640 1 --2- 172.21.15.79:0/3979662862 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc42d40 0x55fbfcc3e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c10f72640 1 -- 172.21.15.79:0/3979662862 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc18280 msgr2=0x55fbfcc16cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c10f72640 1 --2- 172.21.15.79:0/3979662862 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc18280 0x55fbfcc16cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c10f72640 1 -- 172.21.15.79:0/3979662862 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc42d40 msgr2=0x55fbfcc3e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:49.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c10f72640 1 --2- 172.21.15.79:0/3979662862 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc42d40 0x55fbfcc3e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c10f72640 1 -- 172.21.15.79:0/3979662862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbfcc17710 con 0x55fbfcc54950 2024-04-25T02:16:49.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c10f72640 1 --2- 172.21.15.79:0/3979662862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc3e8c0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009010 tx=0x7f5c04001330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fc894edd46dffc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:49.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5beaffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:16:49.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5beaffd640 1 -- 172.21.15.79:0/3979662862 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04006d20 con 0x55fbfcc54950 2024-04-25T02:16:49.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5beaffd640 1 -- 172.21.15.79:0/3979662862 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7f5c04007200 con 0x55fbfcc54950 2024-04-25T02:16:49.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c157c0740 1 -- 172.21.15.79:0/3979662862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c04007050 con 0x55fbfcc54950 2024-04-25T02:16:49.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5beaffd640 1 -- 172.21.15.79:0/3979662862 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f5c0402e050 con 0x55fbfcc54950 2024-04-25T02:16:49.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c157c0740 10 client.8706 fetch_fsmap learned FSMap version 74 2024-04-25T02:16:49.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.992+0000 7f5c157c0740 1 -- 172.21.15.79:0/3979662862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55fbfcc3eec0 con 0x55fbfcc54950 2024-04-25T02:16:49.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.993+0000 7f5beaffd640 1 -- 172.21.15.79:0/3979662862 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c04007050 con 0x55fbfcc54950 2024-04-25T02:16:49.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.993+0000 7f5beaffd640 1 -- 172.21.15.79:0/3979662862 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f5c04031020 con 0x55fbfcc54950 2024-04-25T02:16:49.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.993+0000 7f5c157c0740 10 client.8706 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T02:16:49.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.993+0000 7f5c157c0740 10 client.8706 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T02:16:49.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.993+0000 7f5c157c0740 20 client.8706 populate_metadata read hostname 'smithi079' 2024-04-25T02:16:49.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.993+0000 7f5c157c0740 1 --2- 172.21.15.79:0/3979662862 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55fbfcc171f0 0x55fbfcc80530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.993+0000 7f5c157c0740 4 client.8706 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T02:16:49.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.993+0000 7f5c157c0740 1 -- 172.21.15.79:0/3979662862 --> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x55fbfcb88800 con 0x55fbfcc171f0 2024-04-25T02:16:49.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.993+0000 7f5c0bfff640 1 --2- 172.21.15.79:0/3979662862 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55fbfcc171f0 0x55fbfcc80530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.993+0000 7f5beaffd640 10 client.8706 ms_handle_connect on v2:172.21.15.79:6834/2550458851 2024-04-25T02:16:49.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.993+0000 7f5c0bfff640 1 --2- 172.21.15.79:0/3979662862 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55fbfcc171f0 0x55fbfcc80530 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f46c82862e34900 server_cookie=125a986aaa2ee2c3 in_seq=0 out_seq=0 2024-04-25T02:16:49.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f5beaffd640 1 -- 172.21.15.79:0/3979662862 <== mds.0 v2:172.21.15.79:6834/2550458851 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fbfcb88800 con 0x55fbfcc171f0 2024-04-25T02:16:49.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f5beaffd640 10 client.8706 handle_command_reply: tid=0 2024-04-25T02:16:49.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f5c157c0740 1 client.8706 shutdown 2024-04-25T02:16:49.004 INFO:tasks.ceph.mds.c.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f813be23640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-25T02:16:49.005 INFO:tasks.ceph.mds.c.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f813be23640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-25T02:16:49.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f5c157c0740 1 -- 172.21.15.79:0/3979662862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 msgr2=0x55fbfcc3e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:49.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f5c157c0740 1 --2- 172.21.15.79:0/3979662862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc3e8c0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009010 tx=0x7f5c04001330 comp rx=0 tx=0).stop 2024-04-25T02:16:49.005 INFO:tasks.ceph.mds.c.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f813be23640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-25T02:16:49.005 INFO:tasks.ceph.mds.c.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f813be23640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-25T02:16:49.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f5c157c0740 1 -- 172.21.15.79:0/3979662862 shutdown_connections 2024-04-25T02:16:49.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f5c157c0740 1 --2- 172.21.15.79:0/3979662862 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55fbfcc171f0 0x55fbfcc80530 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f5c157c0740 1 --2- 172.21.15.79:0/3979662862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbfcc54950 0x55fbfcc3e8c0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f5c157c0740 1 --2- 172.21.15.79:0/3979662862 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbfcc42d40 0x55fbfcc3e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f5c157c0740 1 --2- 172.21.15.79:0/3979662862 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55fbfcc18280 0x55fbfcc16cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f5c157c0740 1 -- 172.21.15.79:0/3979662862 >> 172.21.15.79:0/3979662862 conn(0x55fbfcbdf950 msgr2=0x55fbfcc59cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.994+0000 7f5beaffd640 0 client.8706 ms_handle_reset on v2:172.21.15.79:6834/2550458851 2024-04-25T02:16:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.995+0000 7f5c157c0740 1 -- 172.21.15.79:0/3979662862 shutdown_connections 2024-04-25T02:16:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.995+0000 7f5c157c0740 1 -- 172.21.15.79:0/3979662862 wait complete. 2024-04-25T02:16:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.995+0000 7f5c157c0740 20 client.8706 trim_cache size 0 max 16384 2024-04-25T02:16:49.007 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:16:49.007 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-04-25T02:16:49.007 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "52f8bc92-50a8-45d6-99d5-b0ea88456399", 2024-04-25T02:16:49.007 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-04-25T02:16:49.007 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:16:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.995+0000 7f5c129d5640 1 -- 172.21.15.79:0/1302454484 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5bf806be30 msgr2=0x7f5bf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.995+0000 7f5c129d5640 1 --2- 172.21.15.79:0/1302454484 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5bf806be30 0x7f5bf806e2f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009890 tx=0x7f5c00008040 comp rx=0 tx=0).stop 2024-04-25T02:16:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.995+0000 7f5c129d5640 1 -- 172.21.15.79:0/1302454484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c0c0d2f20 msgr2=0x7f5c0c152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.995+0000 7f5c129d5640 1 --2- 172.21.15.79:0/1302454484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c0c0d2f20 0x7f5c0c152eb0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc000c00 tx=0x7f5bfc0046c0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.995+0000 7f5c129d5640 1 -- 172.21.15.79:0/1302454484 shutdown_connections 2024-04-25T02:16:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.995+0000 7f5c129d5640 1 --2- 172.21.15.79:0/1302454484 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5bf806be30 0x7f5bf806e2f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.995+0000 7f5c129d5640 1 --2- 172.21.15.79:0/1302454484 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c0c15e440 0x7f5c0c15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.995+0000 7f5c129d5640 1 --2- 172.21.15.79:0/1302454484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c0c0d2f20 0x7f5c0c152eb0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.995+0000 7f5c129d5640 1 --2- 172.21.15.79:0/1302454484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c0c0d0990 0x7f5c0c0c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.995+0000 7f5c129d5640 1 -- 172.21.15.79:0/1302454484 >> 172.21.15.79:0/1302454484 conn(0x7f5c0c09d450 msgr2=0x7f5c0c0ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.995+0000 7f5c129d5640 1 -- 172.21.15.79:0/1302454484 shutdown_connections 2024-04-25T02:16:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:48.996+0000 7f5c129d5640 1 -- 172.21.15.79:0/1302454484 wait complete. 2024-04-25T02:16:49.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:16:49.011 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T02:16:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.105+0000 7f99ce189640 1 Processor -- start 2024-04-25T02:16:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.105+0000 7f99ce189640 1 -- start start 2024-04-25T02:16:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.106+0000 7f99ce189640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f99c806b2f0 0x7f99c80b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.106+0000 7f99ce189640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99c80cf7a0 0x7f99c806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.106+0000 7f99ce189640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99c806e6b0 0x7f99c80cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.106+0000 7f99ce189640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f99c815f830 con 0x7f99c80cf7a0 2024-04-25T02:16:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.106+0000 7f99ce189640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f99c806bc10 con 0x7f99c806b2f0 2024-04-25T02:16:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.106+0000 7f99ce189640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f99c815ec20 con 0x7f99c806e6b0 2024-04-25T02:16:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.106+0000 7f99c6ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99c80cf7a0 0x7f99c806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.106+0000 7f99c6ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99c80cf7a0 0x7f99c806b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35766/0 (socket says 172.21.15.79:35766) 2024-04-25T02:16:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.106+0000 7f99c6ffd640 1 -- 172.21.15.79:0/4206201054 learned_addr learned my addr 172.21.15.79:0/4206201054 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.106+0000 7f99c6ffd640 1 -- 172.21.15.79:0/4206201054 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99c806e6b0 msgr2=0x7f99c80cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.106+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/4206201054 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99c806e6b0 0x7f99c80cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.106+0000 7f99c6ffd640 1 -- 172.21.15.79:0/4206201054 >> v2:172.21.15.189:3300/0 conn(0x7f99c806b2f0 msgr2=0x7f99c80b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.106+0000 7f99c77fe640 1 --2- 172.21.15.79:0/4206201054 >> v2:172.21.15.189:3300/0 conn(0x7f99c806b2f0 0x7f99c80b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.106+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/4206201054 >> v2:172.21.15.189:3300/0 conn(0x7f99c806b2f0 0x7f99c80b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.107+0000 7f99c6ffd640 1 -- 172.21.15.79:0/4206201054 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c815ef00 con 0x7f99c80cf7a0 2024-04-25T02:16:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.107+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/4206201054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c80cf7a0 0x7f99c806b6d0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f99c806efd0 tx=0x7f99bc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de95effe112a0fe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.107+0000 7f99c67fc640 1 -- 172.21.15.79:0/4206201054 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc037070 con 0x7f99c80cf7a0 2024-04-25T02:16:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.107+0000 7f99c67fc640 1 -- 172.21.15.79:0/4206201054 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99bc032440 con 0x7f99c80cf7a0 2024-04-25T02:16:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.107+0000 7f99c67fc640 1 -- 172.21.15.79:0/4206201054 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc032810 con 0x7f99c80cf7a0 2024-04-25T02:16:49.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.108+0000 7f99ce189640 1 -- 172.21.15.79:0/4206201054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c80cf7a0 msgr2=0x7f99c806b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:49.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.108+0000 7f99ce189640 1 --2- 172.21.15.79:0/4206201054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c80cf7a0 0x7f99c806b6d0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f99c806efd0 tx=0x7f99bc02a140 comp rx=0 tx=0).stop 2024-04-25T02:16:49.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.108+0000 7f99ce189640 1 -- 172.21.15.79:0/4206201054 shutdown_connections 2024-04-25T02:16:49.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.108+0000 7f99ce189640 1 --2- 172.21.15.79:0/4206201054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c80cf7a0 0x7f99c806b6d0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.108+0000 7f99ce189640 1 --2- 172.21.15.79:0/4206201054 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99c806e6b0 0x7f99c80cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.108+0000 7f99ce189640 1 --2- 172.21.15.79:0/4206201054 >> v2:172.21.15.189:3300/0 conn(0x7f99c806b2f0 0x7f99c80b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.108+0000 7f99ce189640 1 -- 172.21.15.79:0/4206201054 >> 172.21.15.79:0/4206201054 conn(0x7f99c80b1cd0 msgr2=0x7f99c80b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:49.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.108+0000 7f99ce189640 1 -- 172.21.15.79:0/4206201054 shutdown_connections 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.108+0000 7f99ce189640 1 -- 172.21.15.79:0/4206201054 wait complete. 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.109+0000 7f99ce189640 1 Processor -- start 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.109+0000 7f99ce189640 1 -- start start 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99ce189640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99c806b2f0 0x7f99c8145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99ce189640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c806e6b0 0x7f99c80af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99ce189640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99c80cf7a0 0x7f99c80afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99ce189640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99c806cfe0 con 0x7f99c806e6b0 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99ce189640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99c815f4c0 con 0x7f99c80cf7a0 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99ce189640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f99c806d160 con 0x7f99c806b2f0 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99c6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c806e6b0 0x7f99c80af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99c6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c806e6b0 0x7f99c80af8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35780/0 (socket says 172.21.15.79:35780) 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99c6ffd640 1 -- 172.21.15.79:0/768675436 learned_addr learned my addr 172.21.15.79:0/768675436 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99c7fff640 1 --2- 172.21.15.79:0/768675436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99c80cf7a0 0x7f99c80afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99c77fe640 1 --2- 172.21.15.79:0/768675436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99c806b2f0 0x7f99c8145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99c6ffd640 1 -- 172.21.15.79:0/768675436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99c806b2f0 msgr2=0x7f99c8145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/768675436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99c806b2f0 0x7f99c8145730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99c6ffd640 1 -- 172.21.15.79:0/768675436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99c80cf7a0 msgr2=0x7f99c80afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:49.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/768675436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99c80cf7a0 0x7f99c80afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99c6ffd640 1 -- 172.21.15.79:0/768675436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c8155b60 con 0x7f99c806e6b0 2024-04-25T02:16:49.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99c7fff640 1 --2- 172.21.15.79:0/768675436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99c80cf7a0 0x7f99c80afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:49.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.110+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/768675436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c806e6b0 0x7f99c80af8c0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f99bc000c00 tx=0x7f99bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:49.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.111+0000 7f99affff640 1 -- 172.21.15.79:0/768675436 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc041020 con 0x7f99c806e6b0 2024-04-25T02:16:49.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.111+0000 7f99affff640 1 -- 172.21.15.79:0/768675436 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99bc030970 con 0x7f99c806e6b0 2024-04-25T02:16:49.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.111+0000 7f99ce189640 1 -- 172.21.15.79:0/768675436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c8155e40 con 0x7f99c806e6b0 2024-04-25T02:16:49.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.111+0000 7f99affff640 1 -- 172.21.15.79:0/768675436 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc037040 con 0x7f99c806e6b0 2024-04-25T02:16:49.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.111+0000 7f99ce189640 1 -- 172.21.15.79:0/768675436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c8156400 con 0x7f99c806e6b0 2024-04-25T02:16:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.113+0000 7f99affff640 1 -- 172.21.15.79:0/768675436 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99bc044020 con 0x7f99c806e6b0 2024-04-25T02:16:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.113+0000 7f99affff640 1 --2- 172.21.15.79:0/768675436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f99b406be30 0x7f99b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.113+0000 7f99affff640 1 -- 172.21.15.79:0/768675436 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7f99bc0ab870 con 0x7f99c806e6b0 2024-04-25T02:16:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.113+0000 7f99c77fe640 1 --2- 172.21.15.79:0/768675436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f99b406be30 0x7f99b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.113+0000 7f99c77fe640 1 --2- 172.21.15.79:0/768675436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f99b406be30 0x7f99b406e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f99b800a970 tx=0x7f99b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.114+0000 7f99d0f74740 1 Processor -- start 2024-04-25T02:16:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.114+0000 7f99d0f74740 1 -- start start 2024-04-25T02:16:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.114+0000 7f99d0f74740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a770310 0x55909a748970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.114+0000 7f99d0f74740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7706f0 0x55909a772b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.114+0000 7f99d0f74740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a7730b0 0x55909a746910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99d0f74740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55909a6ac6b0 con 0x55909a7706f0 2024-04-25T02:16:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99d0f74740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55909a654880 con 0x55909a770310 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99d0f74740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55909a6a8670 con 0x55909a7730b0 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99c6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7706f0 0x55909a772b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99c6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7706f0 0x55909a772b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35794/0 (socket says 172.21.15.79:35794) 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99c6ffd640 1 -- 172.21.15.79:0/897885891 learned_addr learned my addr 172.21.15.79:0/897885891 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99c77fe640 1 --2- 172.21.15.79:0/897885891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a770310 0x55909a748970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99c7fff640 1 --2- 172.21.15.79:0/897885891 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a7730b0 0x55909a746910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99c6ffd640 1 -- 172.21.15.79:0/897885891 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a7730b0 msgr2=0x55909a746910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/897885891 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a7730b0 0x55909a746910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99c6ffd640 1 -- 172.21.15.79:0/897885891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a770310 msgr2=0x55909a748970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/897885891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a770310 0x55909a748970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99c6ffd640 1 -- 172.21.15.79:0/897885891 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55909a48a7d0 con 0x55909a7706f0 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/897885891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7706f0 0x55909a772b70 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0a9df0 tx=0x7f99bc079750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21b04d82f4da880 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99ad7fa640 1 -- 172.21.15.79:0/897885891 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc079b50 con 0x55909a7706f0 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99ad7fa640 1 -- 172.21.15.79:0/897885891 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99bc07df00 con 0x55909a7706f0 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.115+0000 7f99ad7fa640 1 -- 172.21.15.79:0/897885891 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc082730 con 0x55909a7706f0 2024-04-25T02:16:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.116+0000 7f99d0f74740 1 -- 172.21.15.79:0/897885891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7706f0 msgr2=0x55909a772b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.116+0000 7f99d0f74740 1 --2- 172.21.15.79:0/897885891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7706f0 0x55909a772b70 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0a9df0 tx=0x7f99bc079750 comp rx=0 tx=0).stop 2024-04-25T02:16:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.116+0000 7f99d0f74740 1 -- 172.21.15.79:0/897885891 shutdown_connections 2024-04-25T02:16:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.116+0000 7f99d0f74740 1 --2- 172.21.15.79:0/897885891 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a7730b0 0x55909a746910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.116+0000 7f99d0f74740 1 --2- 172.21.15.79:0/897885891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7706f0 0x55909a772b70 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.116+0000 7f99d0f74740 1 --2- 172.21.15.79:0/897885891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a770310 0x55909a748970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.116+0000 7f99d0f74740 1 -- 172.21.15.79:0/897885891 >> 172.21.15.79:0/897885891 conn(0x55909a745600 msgr2=0x55909a78db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.116+0000 7f99d0f74740 1 -- 172.21.15.79:0/897885891 shutdown_connections 2024-04-25T02:16:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.116+0000 7f99d0f74740 1 -- 172.21.15.79:0/897885891 wait complete. 2024-04-25T02:16:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.117+0000 7f99d0f74740 1 -- start start 2024-04-25T02:16:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.117+0000 7f99d0f74740 1 Processor -- start 2024-04-25T02:16:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.117+0000 7f99d0f74740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a7706f0 0x55909a770b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.117+0000 7f99d0f74740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7730b0 0x55909a784be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.117+0000 7f99d0f74740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a785120 0x55909a76f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.117+0000 7f99d0f74740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55909a654880 con 0x55909a7730b0 2024-04-25T02:16:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.117+0000 7f99d0f74740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55909a667f50 con 0x55909a785120 2024-04-25T02:16:49.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.117+0000 7f99d0f74740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55909a6ac6b0 con 0x55909a7706f0 2024-04-25T02:16:49.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.117+0000 7f99d0f74740 10 client.0 _ll_register_callbacks cb 0x55909a6a3000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:16:49.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.117+0000 7f99c6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7730b0 0x55909a784be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.117+0000 7f99c6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7730b0 0x55909a784be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35808/0 (socket says 172.21.15.79:35808) 2024-04-25T02:16:49.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.117+0000 7f99c6ffd640 1 -- 172.21.15.79:0/2545633293 learned_addr learned my addr 172.21.15.79:0/2545633293 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:49.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99c7fff640 1 --2- 172.21.15.79:0/2545633293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a785120 0x55909a76f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99c77fe640 1 --2- 172.21.15.79:0/2545633293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a7706f0 0x55909a770b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99c6ffd640 1 -- 172.21.15.79:0/2545633293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a7706f0 msgr2=0x55909a770b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:49.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/2545633293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a7706f0 0x55909a770b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99c6ffd640 1 -- 172.21.15.79:0/2545633293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a785120 msgr2=0x55909a76f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:49.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/2545633293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a785120 0x55909a76f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99c6ffd640 1 -- 172.21.15.79:0/2545633293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55909a3c03f0 con 0x55909a7730b0 2024-04-25T02:16:49.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/2545633293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7730b0 0x55909a784be0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f99bc008010 tx=0x7f99bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff370d2ef1d57aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:49.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:16:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99a67fc640 1 -- 172.21.15.79:0/2545633293 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc082730 con 0x55909a7730b0 2024-04-25T02:16:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99a67fc640 1 -- 172.21.15.79:0/2545633293 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7f99bc030d60 con 0x55909a7730b0 2024-04-25T02:16:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99d0f74740 1 -- 172.21.15.79:0/2545633293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99bc07df00 con 0x55909a7730b0 2024-04-25T02:16:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99a67fc640 1 -- 172.21.15.79:0/2545633293 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f99bc09f050 con 0x55909a7730b0 2024-04-25T02:16:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99d0f74740 10 client.8718 fetch_fsmap learned FSMap version 74 2024-04-25T02:16:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99d0f74740 1 -- 172.21.15.79:0/2545633293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55909a3800f0 con 0x55909a7730b0 2024-04-25T02:16:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99a67fc640 1 -- 172.21.15.79:0/2545633293 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99bc07df00 con 0x55909a7730b0 2024-04-25T02:16:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99a67fc640 1 -- 172.21.15.79:0/2545633293 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f99bc0a2020 con 0x55909a7730b0 2024-04-25T02:16:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99d0f74740 10 client.8718 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T02:16:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99d0f74740 10 client.8718 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T02:16:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99d0f74740 20 client.8718 populate_metadata read hostname 'smithi079' 2024-04-25T02:16:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99d0f74740 1 --2- 172.21.15.79:0/2545633293 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55909a774ae0 0x55909a774ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99d0f74740 4 client.8718 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:16:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99d0f74740 1 -- 172.21.15.79:0/2545633293 --> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55909a6b9bf0 con 0x55909a774ae0 2024-04-25T02:16:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.118+0000 7f99c77fe640 1 --2- 172.21.15.79:0/2545633293 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55909a774ae0 0x55909a774ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.119+0000 7f99a67fc640 10 client.8718 ms_handle_connect on v2:172.21.15.79:6834/2550458851 2024-04-25T02:16:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.119+0000 7f99c77fe640 1 --2- 172.21.15.79:0/2545633293 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55909a774ae0 0x55909a774ec0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad9429d07e3c8702 server_cookie=cf8e5f4b59ee93b7 in_seq=0 out_seq=0 2024-04-25T02:16:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.119+0000 7f99a67fc640 1 -- 172.21.15.79:0/2545633293 <== mds.0 v2:172.21.15.79:6834/2550458851 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55909a6b9bf0 con 0x55909a774ae0 2024-04-25T02:16:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.119+0000 7f99a67fc640 10 client.8718 handle_command_reply: tid=0 2024-04-25T02:16:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.119+0000 7f99d0f74740 1 client.8718 shutdown 2024-04-25T02:16:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.119+0000 7f99d0f74740 1 -- 172.21.15.79:0/2545633293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7730b0 msgr2=0x55909a784be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.119+0000 7f99d0f74740 1 --2- 172.21.15.79:0/2545633293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7730b0 0x55909a784be0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f99bc008010 tx=0x7f99bc008040 comp rx=0 tx=0).stop 2024-04-25T02:16:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.119+0000 7f99d0f74740 1 -- 172.21.15.79:0/2545633293 shutdown_connections 2024-04-25T02:16:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.119+0000 7f99d0f74740 1 --2- 172.21.15.79:0/2545633293 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55909a774ae0 0x55909a774ec0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.119+0000 7f99d0f74740 1 --2- 172.21.15.79:0/2545633293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a785120 0x55909a76f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.119+0000 7f99a67fc640 0 client.8718 ms_handle_reset on v2:172.21.15.79:6834/2550458851 2024-04-25T02:16:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.119+0000 7f99d0f74740 1 --2- 172.21.15.79:0/2545633293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7730b0 0x55909a784be0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.119+0000 7f99d0f74740 1 --2- 172.21.15.79:0/2545633293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a7706f0 0x55909a770b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.120+0000 7f99d0f74740 1 -- 172.21.15.79:0/2545633293 >> 172.21.15.79:0/2545633293 conn(0x55909a770310 msgr2=0x55909a78e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:49.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.120+0000 7f99d0f74740 1 -- 172.21.15.79:0/2545633293 shutdown_connections 2024-04-25T02:16:49.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.120+0000 7f99d0f74740 1 -- 172.21.15.79:0/2545633293 wait complete. 2024-04-25T02:16:49.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.120+0000 7f99d0f74740 20 client.8718 trim_cache size 0 max 16384 2024-04-25T02:16:49.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.137+0000 7f99d0f74740 1 Processor -- start 2024-04-25T02:16:49.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.137+0000 7f99d0f74740 1 -- start start 2024-04-25T02:16:49.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99d0f74740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a7706f0 0x55909a7767e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99d0f74740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a7730b0 0x55909a7910f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99d0f74740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a785120 0x55909a791630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99d0f74740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99c8157930 con 0x55909a785120 2024-04-25T02:16:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99d0f74740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99c815a860 con 0x55909a7730b0 2024-04-25T02:16:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99d0f74740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f99c8159bc0 con 0x55909a7706f0 2024-04-25T02:16:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99c7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a785120 0x55909a791630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99c7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a785120 0x55909a791630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35812/0 (socket says 172.21.15.79:35812) 2024-04-25T02:16:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99c7fff640 1 -- 172.21.15.79:0/30143132 learned_addr learned my addr 172.21.15.79:0/30143132 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99c77fe640 1 --2- 172.21.15.79:0/30143132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a7706f0 0x55909a7767e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/30143132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a7730b0 0x55909a7910f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99c7fff640 1 -- 172.21.15.79:0/30143132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a7706f0 msgr2=0x55909a7767e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99c7fff640 1 --2- 172.21.15.79:0/30143132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a7706f0 0x55909a7767e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99c7fff640 1 -- 172.21.15.79:0/30143132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a7730b0 msgr2=0x55909a7910f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99c7fff640 1 --2- 172.21.15.79:0/30143132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a7730b0 0x55909a7910f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99c7fff640 1 -- 172.21.15.79:0/30143132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55909a669260 con 0x55909a785120 2024-04-25T02:16:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/30143132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a7730b0 0x55909a7910f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99c7fff640 1 --2- 172.21.15.79:0/30143132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a785120 0x55909a791630 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f99c000a430 tx=0x7f99c0009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd93277fd9c35ec5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99acff9640 1 -- 172.21.15.79:0/30143132 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c001d070 con 0x55909a785120 2024-04-25T02:16:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99acff9640 1 -- 172.21.15.79:0/30143132 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c0007780 con 0x55909a785120 2024-04-25T02:16:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.138+0000 7f99acff9640 1 -- 172.21.15.79:0/30143132 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0007b70 con 0x55909a785120 2024-04-25T02:16:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.139+0000 7f99d0f74740 1 -- 172.21.15.79:0/30143132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a785120 msgr2=0x55909a791630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.139+0000 7f99d0f74740 1 --2- 172.21.15.79:0/30143132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a785120 0x55909a791630 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f99c000a430 tx=0x7f99c0009870 comp rx=0 tx=0).stop 2024-04-25T02:16:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.139+0000 7f99d0f74740 1 -- 172.21.15.79:0/30143132 shutdown_connections 2024-04-25T02:16:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.139+0000 7f99d0f74740 1 --2- 172.21.15.79:0/30143132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a785120 0x55909a791630 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.139+0000 7f99d0f74740 1 --2- 172.21.15.79:0/30143132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a7730b0 0x55909a7910f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.139+0000 7f99d0f74740 1 --2- 172.21.15.79:0/30143132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a7706f0 0x55909a7767e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.139+0000 7f99d0f74740 1 -- 172.21.15.79:0/30143132 >> 172.21.15.79:0/30143132 conn(0x55909a770310 msgr2=0x55909a78dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.139+0000 7f99d0f74740 1 -- 172.21.15.79:0/30143132 shutdown_connections 2024-04-25T02:16:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.139+0000 7f99d0f74740 1 -- 172.21.15.79:0/30143132 wait complete. 2024-04-25T02:16:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.140+0000 7f99d0f74740 1 -- start start 2024-04-25T02:16:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.140+0000 7f99d0f74740 1 Processor -- start 2024-04-25T02:16:49.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.140+0000 7f99d0f74740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7706f0 0x55909a8056c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.140+0000 7f99d0f74740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a7730b0 0x55909a7838f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.140+0000 7f99d0f74740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a785120 0x55909a80bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.140+0000 7f99d0f74740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99c815a210 con 0x55909a7706f0 2024-04-25T02:16:49.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.140+0000 7f99d0f74740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55909a78b830 con 0x55909a7730b0 2024-04-25T02:16:49.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.140+0000 7f99d0f74740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55909a7843a0 con 0x55909a785120 2024-04-25T02:16:49.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.140+0000 7f99d0f74740 10 client.0 _ll_register_callbacks cb 0x7f99bc091070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:16:49.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.140+0000 7f99c77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7706f0 0x55909a8056c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.140+0000 7f99c77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7706f0 0x55909a8056c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35824/0 (socket says 172.21.15.79:35824) 2024-04-25T02:16:49.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.140+0000 7f99c77fe640 1 -- 172.21.15.79:0/2601079642 learned_addr learned my addr 172.21.15.79:0/2601079642 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:16:49.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/2601079642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a7730b0 0x55909a7838f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99c7fff640 1 --2- 172.21.15.79:0/2601079642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a785120 0x55909a80bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99c77fe640 1 -- 172.21.15.79:0/2601079642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a785120 msgr2=0x55909a80bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:49.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99c77fe640 1 --2- 172.21.15.79:0/2601079642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a785120 0x55909a80bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99c77fe640 1 -- 172.21.15.79:0/2601079642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a7730b0 msgr2=0x55909a7838f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:16:49.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99c77fe640 1 --2- 172.21.15.79:0/2601079642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a7730b0 0x55909a7838f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99c77fe640 1 -- 172.21.15.79:0/2601079642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55909a3800f0 con 0x55909a7706f0 2024-04-25T02:16:49.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/2601079642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a7730b0 0x55909a7838f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:49.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99c7fff640 1 --2- 172.21.15.79:0/2601079642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a785120 0x55909a80bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:49.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99c77fe640 1 --2- 172.21.15.79:0/2601079642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7706f0 0x55909a8056c0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x55909a654940 tx=0x7f99b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65c57c7579eec5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:49.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:16:49.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99a67fc640 1 -- 172.21.15.79:0/2601079642 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b801a040 con 0x55909a7706f0 2024-04-25T02:16:49.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99a67fc640 1 -- 172.21.15.79:0/2601079642 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7f99b8013660 con 0x55909a7706f0 2024-04-25T02:16:49.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99d0f74740 1 -- 172.21.15.79:0/2601079642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99c0007780 con 0x55909a7706f0 2024-04-25T02:16:49.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99a67fc640 1 -- 172.21.15.79:0/2601079642 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f99b8037050 con 0x55909a7706f0 2024-04-25T02:16:49.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99d0f74740 10 client.8724 fetch_fsmap learned FSMap version 74 2024-04-25T02:16:49.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99d0f74740 1 -- 172.21.15.79:0/2601079642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55909a7840e0 con 0x55909a7706f0 2024-04-25T02:16:49.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99a67fc640 1 -- 172.21.15.79:0/2601079642 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c0007780 con 0x55909a7706f0 2024-04-25T02:16:49.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99a67fc640 1 -- 172.21.15.79:0/2601079642 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f99b803a020 con 0x55909a7706f0 2024-04-25T02:16:49.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99d0f74740 10 client.8724 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T02:16:49.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99d0f74740 10 client.8724 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T02:16:49.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99d0f74740 20 client.8724 populate_metadata read hostname 'smithi079' 2024-04-25T02:16:49.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99d0f74740 1 --2- 172.21.15.79:0/2601079642 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55909a790c80 0x55909a748c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:49.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99d0f74740 4 client.8724 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:16:49.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99d0f74740 1 -- 172.21.15.79:0/2601079642 --> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55909a744a50 con 0x55909a790c80 2024-04-25T02:16:49.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.141+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/2601079642 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55909a790c80 0x55909a748c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:49.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99a67fc640 10 client.8724 ms_handle_connect on v2:172.21.15.79:6834/2550458851 2024-04-25T02:16:49.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99c6ffd640 1 --2- 172.21.15.79:0/2601079642 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55909a790c80 0x55909a748c00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3cf2a7f9ca4e0b2 server_cookie=a255428e8db6dc65 in_seq=0 out_seq=0 2024-04-25T02:16:49.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99a67fc640 1 -- 172.21.15.79:0/2601079642 <== mds.0 v2:172.21.15.79:6834/2550458851 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x55909a744a50 con 0x55909a790c80 2024-04-25T02:16:49.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99a67fc640 10 client.8724 handle_command_reply: tid=0 2024-04-25T02:16:49.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99d0f74740 1 client.8724 shutdown 2024-04-25T02:16:49.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99d0f74740 1 -- 172.21.15.79:0/2601079642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7706f0 msgr2=0x55909a8056c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:49.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99d0f74740 1 --2- 172.21.15.79:0/2601079642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7706f0 0x55909a8056c0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x55909a654940 tx=0x7f99b8004730 comp rx=0 tx=0).stop 2024-04-25T02:16:49.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99d0f74740 1 -- 172.21.15.79:0/2601079642 shutdown_connections 2024-04-25T02:16:49.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99d0f74740 1 --2- 172.21.15.79:0/2601079642 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x55909a790c80 0x55909a748c00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99d0f74740 1 --2- 172.21.15.79:0/2601079642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55909a785120 0x55909a80bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99d0f74740 1 --2- 172.21.15.79:0/2601079642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55909a7730b0 0x55909a7838f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99a67fc640 0 client.8724 ms_handle_reset on v2:172.21.15.79:6834/2550458851 2024-04-25T02:16:49.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99d0f74740 1 --2- 172.21.15.79:0/2601079642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55909a7706f0 0x55909a8056c0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99d0f74740 1 -- 172.21.15.79:0/2601079642 >> 172.21.15.79:0/2601079642 conn(0x55909a770310 msgr2=0x55909a742260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:49.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99d0f74740 1 -- 172.21.15.79:0/2601079642 shutdown_connections 2024-04-25T02:16:49.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99d0f74740 1 -- 172.21.15.79:0/2601079642 wait complete. 2024-04-25T02:16:49.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.142+0000 7f99d0f74740 20 client.8724 trim_cache size 0 max 16384 2024-04-25T02:16:49.155 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:16:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T02:16:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-04-25T02:16:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: "52f8bc92-50a8-45d6-99d5-b0ea88456399": { 2024-04-25T02:16:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-04-25T02:16:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "52f8bc92-50a8-45d6-99d5-b0ea88456399", 2024-04-25T02:16:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,repair" 2024-04-25T02:16:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:16:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:16:49.155 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:16:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.143+0000 7f99ce189640 1 -- 172.21.15.79:0/768675436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f99b406be30 msgr2=0x7f99b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.143+0000 7f99ce189640 1 --2- 172.21.15.79:0/768675436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f99b406be30 0x7f99b406e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f99b800a970 tx=0x7f99b8008040 comp rx=0 tx=0).stop 2024-04-25T02:16:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.143+0000 7f99ce189640 1 -- 172.21.15.79:0/768675436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c806e6b0 msgr2=0x7f99c80af8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.143+0000 7f99ce189640 1 --2- 172.21.15.79:0/768675436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c806e6b0 0x7f99c80af8c0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f99bc000c00 tx=0x7f99bc0046c0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.143+0000 7f99ce189640 1 -- 172.21.15.79:0/768675436 shutdown_connections 2024-04-25T02:16:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.143+0000 7f99ce189640 1 --2- 172.21.15.79:0/768675436 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f99b406be30 0x7f99b406e2f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.143+0000 7f99ce189640 1 --2- 172.21.15.79:0/768675436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99c80cf7a0 0x7f99c80afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.143+0000 7f99ce189640 1 --2- 172.21.15.79:0/768675436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c806e6b0 0x7f99c80af8c0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.143+0000 7f99ce189640 1 --2- 172.21.15.79:0/768675436 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99c806b2f0 0x7f99c8145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:49.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.143+0000 7f99ce189640 1 -- 172.21.15.79:0/768675436 >> 172.21.15.79:0/768675436 conn(0x7f99c80b1cd0 msgr2=0x7f99c80cfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:49.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.143+0000 7f99ce189640 1 -- 172.21.15.79:0/768675436 shutdown_connections 2024-04-25T02:16:49.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:49.143+0000 7f99ce189640 1 -- 172.21.15.79:0/768675436 wait complete. 2024-04-25T02:16:49.158 INFO:tasks.cephfs.filesystem:scrub status for tag:52f8bc92-50a8-45d6-99d5-b0ea88456399 - {'path': '/', 'tag': '52f8bc92-50a8-45d6-99d5-b0ea88456399', 'options': 'recursive,repair'} 2024-04-25T02:16:49.474 INFO:tasks.ceph.mds.c.smithi079.stderr:2024-04-25T02:16:49.469+0000 7f813fe2b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:16:50.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:50.489+0000 7fbfe57fa640 1 -- 172.21.15.79:0/993865604 <== mon.0 v2:172.21.15.79:3300/0 8 ==== log(8 entries from seq 1 at 2024-04-25T02:16:48.994874+0000) ==== 1407+0+0 (secure 0 0 0) 0x7fbfe008a700 con 0x7fbfe815c380 2024-04-25T02:16:50.494 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:48.994874+0000 mds.c [INF] scrub queued for path: / 2024-04-25T02:16:50.494 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:48.994877+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-25T02:16:50.494 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:48.994881+0000 mds.c [INF] scrub summary: active paths [/] 2024-04-25T02:16:50.494 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:48.995588+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000002 2024-04-25T02:16:50.494 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:48.995595+0000 mds.c [ERR] inode table repaired for inode: 0x10000000002 2024-04-25T02:16:50.494 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:48.995715+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000001 2024-04-25T02:16:50.494 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:48.995721+0000 mds.c [ERR] inode table repaired for inode: 0x10000000001 2024-04-25T02:16:50.494 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:48.996156+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-25T02:16:55.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:16:55.503+0000 7fbfe57fa640 1 -- 172.21.15.79:0/993865604 <== mon.0 v2:172.21.15.79:3300/0 9 ==== log(1 entries from seq 9 at 2024-04-25T02:16:53.503618+0000) ==== 189+0+0 (secure 0 0 0) 0x7fbfe0058410 con 0x7fbfe815c380 2024-04-25T02:16:55.509 INFO:teuthology.orchestra.run.smithi079.stdout:2024-04-25T02:16:53.503618+0000 mds.c [INF] scrub summary: idle 2024-04-25T02:17:01.706 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:17:01.709 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:17:19.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:19.159 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T02:17:19.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.265+0000 7fc0c7fed640 1 Processor -- start 2024-04-25T02:17:19.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.265+0000 7fc0c7fed640 1 -- start start 2024-04-25T02:17:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.266+0000 7fc0c7fed640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc0c00b41b0 0x7fc0c01605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.266+0000 7fc0c7fed640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0c0071cd0 con 0x7fc0c006b2f0 2024-04-25T02:17:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.266+0000 7fc0c7fed640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0c0071fb0 con 0x7fc0c006b770 2024-04-25T02:17:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.266+0000 7fc0c7fed640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc0c0072290 con 0x7fc0c00b41b0 2024-04-25T02:17:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.266+0000 7fc0c5d89640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc0c00b41b0 0x7fc0c01605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.266+0000 7fc0c5588640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc0c006b2f0 0x7fc0c0155f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54440/0 (socket says 172.21.15.79:54440) 2024-04-25T02:17:19.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.266+0000 7fc0c5588640 1 -- 172.21.15.79:0/185263190 learned_addr learned my addr 172.21.15.79:0/185263190 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:19.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.266+0000 7fc0c5d89640 1 -- 172.21.15.79:0/185263190 >> v1:172.21.15.189:6789/0 conn(0x7fc0c006b770 legacy=0x7fc0c00ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:19.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.266+0000 7fc0c5d89640 1 -- 172.21.15.79:0/185263190 >> v1:172.21.15.79:6789/0 conn(0x7fc0c006b2f0 legacy=0x7fc0c0155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.266+0000 7fc0c5d89640 1 -- 172.21.15.79:0/185263190 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c0072570 con 0x7fc0c00b41b0 2024-04-25T02:17:19.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.266+0000 7fc0c4d87640 1 -- 172.21.15.79:0/185263190 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073485510 0 0) 0x7fc0c0071cd0 con 0x7fc0c006b2f0 2024-04-25T02:17:19.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.267+0000 7fc0c5d89640 1 --2- 172.21.15.79:0/185263190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0c00b41b0 0x7fc0c01605d0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00097a0 tx=0x7fc0b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1f39e919aab294 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:19.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.267+0000 7fc0c4d87640 1 -- 172.21.15.79:0/185263190 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0037070 con 0x7fc0c00b41b0 2024-04-25T02:17:19.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.267+0000 7fc0c4d87640 1 -- 172.21.15.79:0/185263190 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b0032440 con 0x7fc0c00b41b0 2024-04-25T02:17:19.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.267+0000 7fc0c4d87640 1 -- 172.21.15.79:0/185263190 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0032810 con 0x7fc0c00b41b0 2024-04-25T02:17:19.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.268+0000 7fc0c7fed640 1 -- 172.21.15.79:0/185263190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0c00b41b0 msgr2=0x7fc0c01605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.268+0000 7fc0c7fed640 1 --2- 172.21.15.79:0/185263190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0c00b41b0 0x7fc0c01605d0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00097a0 tx=0x7fc0b002a1e0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.268+0000 7fc0c7fed640 1 -- 172.21.15.79:0/185263190 shutdown_connections 2024-04-25T02:17:19.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.268+0000 7fc0c7fed640 1 --2- 172.21.15.79:0/185263190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0c00b41b0 0x7fc0c01605d0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.268+0000 7fc0c7fed640 1 -- 172.21.15.79:0/185263190 >> 172.21.15.79:0/185263190 conn(0x7fc0c00b1cd0 msgr2=0x7fc0c00b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:19.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.268+0000 7fc0c7fed640 1 -- 172.21.15.79:0/185263190 shutdown_connections 2024-04-25T02:17:19.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.268+0000 7fc0c7fed640 1 -- 172.21.15.79:0/185263190 wait complete. 2024-04-25T02:17:19.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.269+0000 7fc0c7fed640 1 Processor -- start 2024-04-25T02:17:19.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.269+0000 7fc0c7fed640 1 -- start start 2024-04-25T02:17:19.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0c7fed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0c006b2f0 0x7fc0c01487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0c7fed640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0c006b770 0x7fc0c015ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0c7fed640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0c00b41b0 0x7fc0c00acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0c7fed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c006bb80 con 0x7fc0c006b2f0 2024-04-25T02:17:19.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0c7fed640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c0072d70 con 0x7fc0c00b41b0 2024-04-25T02:17:19.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0c7fed640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c015c870 con 0x7fc0c006b770 2024-04-25T02:17:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0c5d89640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0c006b2f0 0x7fc0c01487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0c5d89640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0c006b2f0 0x7fc0c01487a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42048/0 (socket says 172.21.15.79:42048) 2024-04-25T02:17:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0c5d89640 1 -- 172.21.15.79:0/431848566 learned_addr learned my addr 172.21.15.79:0/431848566 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0c5d89640 1 -- 172.21.15.79:0/431848566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0c006b770 msgr2=0x7fc0c015ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0c5d89640 1 --2- 172.21.15.79:0/431848566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0c006b770 0x7fc0c015ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0c5d89640 1 -- 172.21.15.79:0/431848566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0c00b41b0 msgr2=0x7fc0c00acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0c5d89640 1 --2- 172.21.15.79:0/431848566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0c00b41b0 0x7fc0c00acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0c5d89640 1 -- 172.21.15.79:0/431848566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c009d200 con 0x7fc0c006b2f0 2024-04-25T02:17:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0c5d89640 1 --2- 172.21.15.79:0/431848566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0c006b2f0 0x7fc0c01487a0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00097a0 tx=0x7fc0b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.270+0000 7fc0b67fc640 1 -- 172.21.15.79:0/431848566 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0041070 con 0x7fc0c006b2f0 2024-04-25T02:17:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.271+0000 7fc0b67fc640 1 -- 172.21.15.79:0/431848566 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b003c870 con 0x7fc0c006b2f0 2024-04-25T02:17:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.271+0000 7fc0c7fed640 1 -- 172.21.15.79:0/431848566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c009d4e0 con 0x7fc0c006b2f0 2024-04-25T02:17:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.271+0000 7fc0b67fc640 1 -- 172.21.15.79:0/431848566 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0037040 con 0x7fc0c006b2f0 2024-04-25T02:17:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.271+0000 7fc0c7fed640 1 -- 172.21.15.79:0/431848566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c015d860 con 0x7fc0c006b2f0 2024-04-25T02:17:19.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.272+0000 7fc0b67fc640 1 -- 172.21.15.79:0/431848566 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc0b0044070 con 0x7fc0c006b2f0 2024-04-25T02:17:19.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.272+0000 7fc0b67fc640 1 --2- 172.21.15.79:0/431848566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc0a406be30 0x7fc0a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.272+0000 7fc0b67fc640 1 -- 172.21.15.79:0/431848566 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7fc0b00aba60 con 0x7fc0c006b2f0 2024-04-25T02:17:19.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.273+0000 7fc0c5588640 1 --2- 172.21.15.79:0/431848566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc0a406be30 0x7fc0a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.273+0000 7fc0c5588640 1 --2- 172.21.15.79:0/431848566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc0a406be30 0x7fc0a406e2f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc007fd0 tx=0x7fc0bc007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:19.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.274+0000 7fc0cadd0740 1 Processor -- start 2024-04-25T02:17:19.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.274+0000 7fc0cadd0740 1 -- start start 2024-04-25T02:17:19.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.274+0000 7fc0cadd0740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b111310 0x56203b0e9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.274+0000 7fc0cadd0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 0x56203b113b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.274+0000 7fc0cadd0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b1140b0 0x56203b0e7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.274+0000 7fc0cadd0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56203b04d6b0 con 0x56203b1140b0 2024-04-25T02:17:19.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.274+0000 7fc0cadd0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56203aff5880 con 0x56203b1116f0 2024-04-25T02:17:19.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.274+0000 7fc0cadd0740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56203b049670 con 0x56203b111310 2024-04-25T02:17:19.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.274+0000 7fc0c658a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b1140b0 0x56203b0e7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.275+0000 7fc0c658a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b1140b0 0x56203b0e7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42056/0 (socket says 172.21.15.79:42056) 2024-04-25T02:17:19.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.275+0000 7fc0c658a640 1 -- 172.21.15.79:0/3347550727 learned_addr learned my addr 172.21.15.79:0/3347550727 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:19.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.275+0000 7fc0c5588640 1 --2- 172.21.15.79:0/3347550727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 0x56203b113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.275+0000 7fc0c5d89640 1 --2- 172.21.15.79:0/3347550727 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b111310 0x56203b0e9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.275+0000 7fc0c658a640 1 -- 172.21.15.79:0/3347550727 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b111310 msgr2=0x56203b0e9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:19.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.275+0000 7fc0c658a640 1 --2- 172.21.15.79:0/3347550727 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b111310 0x56203b0e9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.275+0000 7fc0c658a640 1 -- 172.21.15.79:0/3347550727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 msgr2=0x56203b113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:19.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.275+0000 7fc0c658a640 1 --2- 172.21.15.79:0/3347550727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 0x56203b113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.275+0000 7fc0c658a640 1 -- 172.21.15.79:0/3347550727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56203ae2b7d0 con 0x56203b1140b0 2024-04-25T02:17:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.275+0000 7fc0c5d89640 1 --2- 172.21.15.79:0/3347550727 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b111310 0x56203b0e9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.275+0000 7fc0c5588640 1 --2- 172.21.15.79:0/3347550727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 0x56203b113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.275+0000 7fc0c658a640 1 --2- 172.21.15.79:0/3347550727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b1140b0 0x56203b0e7910 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8001d20 tx=0x7fc0b80021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d277be459cfdf8f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.275+0000 7fc0a37fe640 1 -- 172.21.15.79:0/3347550727 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8017070 con 0x56203b1140b0 2024-04-25T02:17:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.275+0000 7fc0a37fe640 1 -- 172.21.15.79:0/3347550727 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b8003d80 con 0x56203b1140b0 2024-04-25T02:17:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.275+0000 7fc0a37fe640 1 -- 172.21.15.79:0/3347550727 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b800cae0 con 0x56203b1140b0 2024-04-25T02:17:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.276+0000 7fc0cadd0740 1 -- 172.21.15.79:0/3347550727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b1140b0 msgr2=0x56203b0e7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.276+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/3347550727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b1140b0 0x56203b0e7910 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8001d20 tx=0x7fc0b80021e0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.276+0000 7fc0cadd0740 1 -- 172.21.15.79:0/3347550727 shutdown_connections 2024-04-25T02:17:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.276+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/3347550727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b1140b0 0x56203b0e7910 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.276+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/3347550727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 0x56203b113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.276+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/3347550727 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b111310 0x56203b0e9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.276+0000 7fc0cadd0740 1 -- 172.21.15.79:0/3347550727 >> 172.21.15.79:0/3347550727 conn(0x56203b0e6600 msgr2=0x56203b12eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:19.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.276+0000 7fc0cadd0740 1 -- 172.21.15.79:0/3347550727 shutdown_connections 2024-04-25T02:17:19.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.276+0000 7fc0cadd0740 1 -- 172.21.15.79:0/3347550727 wait complete. 2024-04-25T02:17:19.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.276+0000 7fc0cadd0740 1 -- start start 2024-04-25T02:17:19.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.276+0000 7fc0cadd0740 1 Processor -- start 2024-04-25T02:17:19.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.277+0000 7fc0cadd0740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1116f0 0x56203b110890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.277+0000 7fc0cadd0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1140b0 0x56203b115e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.277+0000 7fc0cadd0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b12e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.277+0000 7fc0cadd0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56203b008f50 con 0x56203b12df40 2024-04-25T02:17:19.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.277+0000 7fc0cadd0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56203b12c870 con 0x56203b1140b0 2024-04-25T02:17:19.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.277+0000 7fc0cadd0740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56203b1295f0 con 0x56203b1116f0 2024-04-25T02:17:19.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.277+0000 7fc0cadd0740 10 client.0 _ll_register_callbacks cb 0x56203b044000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:17:19.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.277+0000 7fc0c658a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b12e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.277+0000 7fc0c658a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b12e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42066/0 (socket says 172.21.15.79:42066) 2024-04-25T02:17:19.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.277+0000 7fc0c658a640 1 -- 172.21.15.79:0/654924293 learned_addr learned my addr 172.21.15.79:0/654924293 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:19.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0c5588640 1 --2- 172.21.15.79:0/654924293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1140b0 0x56203b115e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0c5d89640 1 --2- 172.21.15.79:0/654924293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1116f0 0x56203b110890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0c658a640 1 -- 172.21.15.79:0/654924293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1116f0 msgr2=0x56203b110890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:19.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0c658a640 1 --2- 172.21.15.79:0/654924293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1116f0 0x56203b110890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0c658a640 1 -- 172.21.15.79:0/654924293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1140b0 msgr2=0x56203b115e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0c658a640 1 --2- 172.21.15.79:0/654924293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1140b0 0x56203b115e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0c658a640 1 -- 172.21.15.79:0/654924293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56203ad613f0 con 0x56203b12df40 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0c658a640 1 --2- 172.21.15.79:0/654924293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b12e3a0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800c570 tx=0x7fc0b8001410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6c9228c42ffbfc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0a0ff9640 1 -- 172.21.15.79:0/654924293 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8022070 con 0x56203b12df40 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0a0ff9640 1 -- 172.21.15.79:0/654924293 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7fc0b80050d0 con 0x56203b12df40 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0cadd0740 1 -- 172.21.15.79:0/654924293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0b8003d80 con 0x56203b12df40 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0a0ff9640 1 -- 172.21.15.79:0/654924293 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fc0b8017040 con 0x56203b12df40 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0cadd0740 10 client.8739 fetch_fsmap learned FSMap version 74 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0cadd0740 1 -- 172.21.15.79:0/654924293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x56203ad210f0 con 0x56203b12df40 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0a0ff9640 1 -- 172.21.15.79:0/654924293 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b8003d80 con 0x56203b12df40 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0a0ff9640 1 -- 172.21.15.79:0/654924293 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7fc0b801d040 con 0x56203b12df40 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0cadd0740 10 client.8739 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.278+0000 7fc0cadd0740 10 client.8739 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T02:17:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.279+0000 7fc0cadd0740 20 client.8739 populate_metadata read hostname 'smithi079' 2024-04-25T02:17:19.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.279+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/654924293 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x56203b128780 0x56203b128b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.279+0000 7fc0cadd0740 4 client.8739 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:17:19.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.279+0000 7fc0cadd0740 1 -- 172.21.15.79:0/654924293 --> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56203b05abf0 con 0x56203b128780 2024-04-25T02:17:19.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.279+0000 7fc0c5d89640 1 --2- 172.21.15.79:0/654924293 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x56203b128780 0x56203b128b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.279+0000 7fc0c5d89640 1 --2- 172.21.15.79:0/654924293 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x56203b128780 0x56203b128b60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d9193080a544721 server_cookie=24623f374ac01384 in_seq=0 out_seq=0 2024-04-25T02:17:19.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.279+0000 7fc0a0ff9640 10 client.8739 ms_handle_connect on v2:172.21.15.79:6834/2550458851 2024-04-25T02:17:19.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.279+0000 7fc0a0ff9640 1 -- 172.21.15.79:0/654924293 <== mds.0 v2:172.21.15.79:6834/2550458851 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56203b05abf0 con 0x56203b128780 2024-04-25T02:17:19.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.279+0000 7fc0a0ff9640 10 client.8739 handle_command_reply: tid=0 2024-04-25T02:17:19.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.279+0000 7fc0cadd0740 1 client.8739 shutdown 2024-04-25T02:17:19.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.280+0000 7fc0cadd0740 1 -- 172.21.15.79:0/654924293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 msgr2=0x56203b12e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.280+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/654924293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b12e3a0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800c570 tx=0x7fc0b8001410 comp rx=0 tx=0).stop 2024-04-25T02:17:19.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.280+0000 7fc0cadd0740 1 -- 172.21.15.79:0/654924293 shutdown_connections 2024-04-25T02:17:19.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.280+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/654924293 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x56203b128780 0x56203b128b60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.280+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/654924293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b12e3a0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.280+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/654924293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1140b0 0x56203b115e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.280+0000 7fc0a0ff9640 0 client.8739 ms_handle_reset on v2:172.21.15.79:6834/2550458851 2024-04-25T02:17:19.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.280+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/654924293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1116f0 0x56203b110890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.280+0000 7fc0cadd0740 1 -- 172.21.15.79:0/654924293 >> 172.21.15.79:0/654924293 conn(0x56203b111310 msgr2=0x56203b0e7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:19.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.280+0000 7fc0cadd0740 1 -- 172.21.15.79:0/654924293 shutdown_connections 2024-04-25T02:17:19.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.280+0000 7fc0cadd0740 1 -- 172.21.15.79:0/654924293 wait complete. 2024-04-25T02:17:19.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.280+0000 7fc0cadd0740 20 client.8739 trim_cache size 0 max 16384 2024-04-25T02:17:19.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.297+0000 7fc0cadd0740 1 Processor -- start 2024-04-25T02:17:19.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.297+0000 7fc0cadd0740 1 -- start start 2024-04-25T02:17:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0cadd0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 0x56203b117170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0cadd0740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1140b0 0x56203b12e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0cadd0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b0e7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0cadd0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c006e870 con 0x56203b12df40 2024-04-25T02:17:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0cadd0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c006d890 con 0x56203b1116f0 2024-04-25T02:17:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0cadd0740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c006cbf0 con 0x56203b1140b0 2024-04-25T02:17:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0c658a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b0e7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0c658a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b0e7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42082/0 (socket says 172.21.15.79:42082) 2024-04-25T02:17:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0c658a640 1 -- 172.21.15.79:0/2800790092 learned_addr learned my addr 172.21.15.79:0/2800790092 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0c5588640 1 --2- 172.21.15.79:0/2800790092 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1140b0 0x56203b12e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0c5d89640 1 --2- 172.21.15.79:0/2800790092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 0x56203b117170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0c658a640 1 -- 172.21.15.79:0/2800790092 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1140b0 msgr2=0x56203b12e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0c658a640 1 --2- 172.21.15.79:0/2800790092 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1140b0 0x56203b12e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0c658a640 1 -- 172.21.15.79:0/2800790092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 msgr2=0x56203b117170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0c658a640 1 --2- 172.21.15.79:0/2800790092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 0x56203b117170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.298+0000 7fc0c658a640 1 -- 172.21.15.79:0/2800790092 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56203b1161d0 con 0x56203b12df40 2024-04-25T02:17:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.299+0000 7fc0c5588640 1 --2- 172.21.15.79:0/2800790092 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1140b0 0x56203b12e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.299+0000 7fc0c5d89640 1 --2- 172.21.15.79:0/2800790092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 0x56203b117170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.299+0000 7fc0c658a640 1 --2- 172.21.15.79:0/2800790092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b0e7910 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8007b50 tx=0x7fc0b801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63475c50371a8a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.299+0000 7fc0a2ffd640 1 -- 172.21.15.79:0/2800790092 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8022040 con 0x56203b12df40 2024-04-25T02:17:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.299+0000 7fc0a2ffd640 1 -- 172.21.15.79:0/2800790092 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b8003b80 con 0x56203b12df40 2024-04-25T02:17:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.299+0000 7fc0a2ffd640 1 -- 172.21.15.79:0/2800790092 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80054b0 con 0x56203b12df40 2024-04-25T02:17:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.299+0000 7fc0cadd0740 1 -- 172.21.15.79:0/2800790092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 msgr2=0x56203b0e7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.299+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/2800790092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b0e7910 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8007b50 tx=0x7fc0b801e000 comp rx=0 tx=0).stop 2024-04-25T02:17:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.299+0000 7fc0cadd0740 1 -- 172.21.15.79:0/2800790092 shutdown_connections 2024-04-25T02:17:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.299+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/2800790092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b0e7910 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.299+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/2800790092 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1140b0 0x56203b12e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.299+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/2800790092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 0x56203b117170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.299+0000 7fc0cadd0740 1 -- 172.21.15.79:0/2800790092 >> 172.21.15.79:0/2800790092 conn(0x56203b111310 msgr2=0x56203b1145a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.300+0000 7fc0cadd0740 1 -- 172.21.15.79:0/2800790092 shutdown_connections 2024-04-25T02:17:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.300+0000 7fc0cadd0740 1 -- 172.21.15.79:0/2800790092 wait complete. 2024-04-25T02:17:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.300+0000 7fc0cadd0740 1 -- start start 2024-04-25T02:17:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.300+0000 7fc0cadd0740 1 Processor -- start 2024-04-25T02:17:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0cadd0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 0x56203b115570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0cadd0740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1140b0 0x56203b115ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0cadd0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b1b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0cadd0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56203b126240 con 0x56203b12df40 2024-04-25T02:17:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0cadd0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c006d240 con 0x56203b1116f0 2024-04-25T02:17:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0cadd0740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56203b01af30 con 0x56203b1140b0 2024-04-25T02:17:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0cadd0740 10 client.0 _ll_register_callbacks cb 0x7fc0b8015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:17:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0c658a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b1b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0c658a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b1b05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42094/0 (socket says 172.21.15.79:42094) 2024-04-25T02:17:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0c658a640 1 -- 172.21.15.79:0/1191119443 learned_addr learned my addr 172.21.15.79:0/1191119443 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0c5d89640 1 --2- 172.21.15.79:0/1191119443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 0x56203b115570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0c5588640 1 --2- 172.21.15.79:0/1191119443 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1140b0 0x56203b115ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0c658a640 1 -- 172.21.15.79:0/1191119443 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1140b0 msgr2=0x56203b115ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0c658a640 1 --2- 172.21.15.79:0/1191119443 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1140b0 0x56203b115ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0c658a640 1 -- 172.21.15.79:0/1191119443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 msgr2=0x56203b115570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.301+0000 7fc0c658a640 1 --2- 172.21.15.79:0/1191119443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 0x56203b115570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0c658a640 1 -- 172.21.15.79:0/1191119443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56203b1290f0 con 0x56203b12df40 2024-04-25T02:17:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0c658a640 1 --2- 172.21.15.79:0/1191119443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b1b05f0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fc0b802a040 tx=0x7fc0b8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f2203b4a7e3769 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:17:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0a0ff9640 1 -- 172.21.15.79:0/1191119443 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8022040 con 0x56203b12df40 2024-04-25T02:17:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0a0ff9640 1 -- 172.21.15.79:0/1191119443 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7fc0b8027640 con 0x56203b12df40 2024-04-25T02:17:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0cadd0740 1 -- 172.21.15.79:0/1191119443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0b8003b80 con 0x56203b12df40 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0a0ff9640 1 -- 172.21.15.79:0/1191119443 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fc0b8043050 con 0x56203b12df40 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0cadd0740 10 client.8745 fetch_fsmap learned FSMap version 74 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0cadd0740 1 -- 172.21.15.79:0/1191119443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x56203b12d560 con 0x56203b12df40 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0a0ff9640 1 -- 172.21.15.79:0/1191119443 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b8003b80 con 0x56203b12df40 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0a0ff9640 1 -- 172.21.15.79:0/1191119443 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7fc0b8046020 con 0x56203b12df40 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0cadd0740 10 client.8745 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0cadd0740 10 client.8745 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0cadd0740 20 client.8745 populate_metadata read hostname 'smithi079' 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/1191119443 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x56203b0e8890 0x56203b1b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0cadd0740 4 client.8745 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0cadd0740 1 -- 172.21.15.79:0/1191119443 --> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56203b054f40 con 0x56203b0e8890 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.302+0000 7fc0c5d89640 1 --2- 172.21.15.79:0/1191119443 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x56203b0e8890 0x56203b1b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0a0ff9640 10 client.8745 ms_handle_connect on v2:172.21.15.79:6834/2550458851 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0c5d89640 1 --2- 172.21.15.79:0/1191119443 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x56203b0e8890 0x56203b1b0b30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b14f136db7cf6937 server_cookie=a6471b74f39d8692 in_seq=0 out_seq=0 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0a0ff9640 1 -- 172.21.15.79:0/1191119443 <== mds.0 v2:172.21.15.79:6834/2550458851 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56203b054f40 con 0x56203b0e8890 2024-04-25T02:17:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0a0ff9640 10 client.8745 handle_command_reply: tid=0 2024-04-25T02:17:19.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0cadd0740 1 client.8745 shutdown 2024-04-25T02:17:19.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0cadd0740 1 -- 172.21.15.79:0/1191119443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 msgr2=0x56203b1b05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/1191119443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b1b05f0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fc0b802a040 tx=0x7fc0b8001670 comp rx=0 tx=0).stop 2024-04-25T02:17:19.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0cadd0740 1 -- 172.21.15.79:0/1191119443 shutdown_connections 2024-04-25T02:17:19.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/1191119443 >> [v2:172.21.15.79:6834/2550458851,v1:172.21.15.79:6837/2550458851] conn(0x56203b0e8890 0x56203b1b0b30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/1191119443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56203b12df40 0x56203b1b05f0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/1191119443 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56203b1140b0 0x56203b115ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0a0ff9640 0 client.8745 ms_handle_reset on v2:172.21.15.79:6834/2550458851 2024-04-25T02:17:19.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0cadd0740 1 --2- 172.21.15.79:0/1191119443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56203b1116f0 0x56203b115570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0cadd0740 1 -- 172.21.15.79:0/1191119443 >> 172.21.15.79:0/1191119443 conn(0x56203b111310 msgr2=0x56203b0e7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:19.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0cadd0740 1 -- 172.21.15.79:0/1191119443 shutdown_connections 2024-04-25T02:17:19.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0cadd0740 1 -- 172.21.15.79:0/1191119443 wait complete. 2024-04-25T02:17:19.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.303+0000 7fc0cadd0740 20 client.8745 trim_cache size 0 max 16384 2024-04-25T02:17:19.318 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:17:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-04-25T02:17:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-04-25T02:17:19.318 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:17:19.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.304+0000 7fc0c7fed640 1 -- 172.21.15.79:0/431848566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc0a406be30 msgr2=0x7fc0a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.304+0000 7fc0c7fed640 1 --2- 172.21.15.79:0/431848566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc0a406be30 0x7fc0a406e2f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc007fd0 tx=0x7fc0bc007920 comp rx=0 tx=0).stop 2024-04-25T02:17:19.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.304+0000 7fc0c7fed640 1 -- 172.21.15.79:0/431848566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0c006b2f0 msgr2=0x7fc0c01487a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.304+0000 7fc0c7fed640 1 --2- 172.21.15.79:0/431848566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0c006b2f0 0x7fc0c01487a0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00097a0 tx=0x7fc0b00046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.304+0000 7fc0c7fed640 1 -- 172.21.15.79:0/431848566 shutdown_connections 2024-04-25T02:17:19.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.304+0000 7fc0c7fed640 1 --2- 172.21.15.79:0/431848566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc0a406be30 0x7fc0a406e2f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.304+0000 7fc0c7fed640 1 --2- 172.21.15.79:0/431848566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0c00b41b0 0x7fc0c00acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.304+0000 7fc0c7fed640 1 --2- 172.21.15.79:0/431848566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0c006b770 0x7fc0c015ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.304+0000 7fc0c7fed640 1 --2- 172.21.15.79:0/431848566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0c006b2f0 0x7fc0c01487a0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.304+0000 7fc0c7fed640 1 -- 172.21.15.79:0/431848566 >> 172.21.15.79:0/431848566 conn(0x7fc0c00b1cd0 msgr2=0x7fc0c015cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:19.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.304+0000 7fc0c7fed640 1 -- 172.21.15.79:0/431848566 shutdown_connections 2024-04-25T02:17:19.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.304+0000 7fc0c7fed640 1 -- 172.21.15.79:0/431848566 wait complete. 2024-04-25T02:17:19.321 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T02:17:19.422 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:17:19.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.516+0000 7f2782753640 1 Processor -- start 2024-04-25T02:17:19.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.516+0000 7f2782753640 1 -- start start 2024-04-25T02:17:19.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.517+0000 7f2782753640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f277c144cb0 0x7f277c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.517+0000 7f2782753640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f277c0b5580 0x7f277c06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.517+0000 7f2782753640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f277c070d90 con 0x7f277c06e490 2024-04-25T02:17:19.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.517+0000 7f2782753640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f277c06e8c0 con 0x7f277c144cb0 2024-04-25T02:17:19.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.517+0000 7f2782753640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f277c0cf130 con 0x7f277c0b5580 2024-04-25T02:17:19.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.517+0000 7f277bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f277c144cb0 0x7f277c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.517+0000 7f2780cf0640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f277c06e490 0x7f277c15fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54442/0 (socket says 172.21.15.79:54442) 2024-04-25T02:17:19.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.517+0000 7f2780cf0640 1 -- 172.21.15.79:0/1538946955 learned_addr learned my addr 172.21.15.79:0/1538946955 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:19.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.517+0000 7f277bfff640 1 -- 172.21.15.79:0/1538946955 >> v2:172.21.15.189:3300/0 conn(0x7f277c0b5580 msgr2=0x7f277c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:19.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.517+0000 7f277bfff640 1 --2- 172.21.15.79:0/1538946955 >> v2:172.21.15.189:3300/0 conn(0x7f277c0b5580 0x7f277c06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.517+0000 7f277bfff640 1 -- 172.21.15.79:0/1538946955 >> v1:172.21.15.79:6789/0 conn(0x7f277c06e490 legacy=0x7f277c15fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.517+0000 7f277affd640 1 -- 172.21.15.79:0/1538946955 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 564088251 0 0) 0x7f277c070d90 con 0x7f277c06e490 2024-04-25T02:17:19.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.517+0000 7f277bfff640 1 -- 172.21.15.79:0/1538946955 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277c0cf410 con 0x7f277c144cb0 2024-04-25T02:17:19.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.518+0000 7f277bfff640 1 --2- 172.21.15.79:0/1538946955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f277c144cb0 0x7f277c0b5040 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f276c0097a0 tx=0x7f276c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76912d19900cd7bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:19.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.518+0000 7f277affd640 1 -- 172.21.15.79:0/1538946955 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c037070 con 0x7f277c144cb0 2024-04-25T02:17:19.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.518+0000 7f277affd640 1 -- 172.21.15.79:0/1538946955 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276c02adc0 con 0x7f277c144cb0 2024-04-25T02:17:19.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.518+0000 7f277affd640 1 -- 172.21.15.79:0/1538946955 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c032660 con 0x7f277c144cb0 2024-04-25T02:17:19.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.518+0000 7f2782753640 1 -- 172.21.15.79:0/1538946955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f277c144cb0 msgr2=0x7f277c0b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.518+0000 7f2782753640 1 --2- 172.21.15.79:0/1538946955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f277c144cb0 0x7f277c0b5040 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f276c0097a0 tx=0x7f276c02a0b0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.518+0000 7f2782753640 1 -- 172.21.15.79:0/1538946955 shutdown_connections 2024-04-25T02:17:19.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.518+0000 7f2782753640 1 --2- 172.21.15.79:0/1538946955 >> v2:172.21.15.189:3300/0 conn(0x7f277c0b5580 0x7f277c06df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.518+0000 7f2782753640 1 --2- 172.21.15.79:0/1538946955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f277c144cb0 0x7f277c0b5040 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.518+0000 7f2782753640 1 -- 172.21.15.79:0/1538946955 >> 172.21.15.79:0/1538946955 conn(0x7f277c0cfc80 msgr2=0x7f277c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:19.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.519+0000 7f2782753640 1 -- 172.21.15.79:0/1538946955 shutdown_connections 2024-04-25T02:17:19.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.519+0000 7f2782753640 1 -- 172.21.15.79:0/1538946955 wait complete. 2024-04-25T02:17:19.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.520+0000 7f2782753640 1 Processor -- start 2024-04-25T02:17:19.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.520+0000 7f2782753640 1 -- start start 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.520+0000 7f2782753640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f277c06e490 0x7f277c159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.520+0000 7f2782753640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f277c0b5580 0x7f277c0aa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.520+0000 7f2782753640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f277c144cb0 0x7f277c1422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.520+0000 7f2782753640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f277c145090 con 0x7f277c144cb0 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.520+0000 7f2782753640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f277c0cf9d0 con 0x7f277c0b5580 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.520+0000 7f2782753640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f277c145ab0 con 0x7f277c06e490 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f2780cf0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f277c144cb0 0x7f277c1422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f2780cf0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f277c144cb0 0x7f277c1422c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42114/0 (socket says 172.21.15.79:42114) 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f2780cf0640 1 -- 172.21.15.79:0/992527776 learned_addr learned my addr 172.21.15.79:0/992527776 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f277bfff640 1 --2- 172.21.15.79:0/992527776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f277c06e490 0x7f277c159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f277b7fe640 1 --2- 172.21.15.79:0/992527776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f277c0b5580 0x7f277c0aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f2780cf0640 1 -- 172.21.15.79:0/992527776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f277c06e490 msgr2=0x7f277c159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f2780cf0640 1 --2- 172.21.15.79:0/992527776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f277c06e490 0x7f277c159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f2780cf0640 1 -- 172.21.15.79:0/992527776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f277c0b5580 msgr2=0x7f277c0aa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f2780cf0640 1 --2- 172.21.15.79:0/992527776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f277c0b5580 0x7f277c0aa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f2780cf0640 1 -- 172.21.15.79:0/992527776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277c15a670 con 0x7f277c144cb0 2024-04-25T02:17:19.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f277bfff640 1 --2- 172.21.15.79:0/992527776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f277c06e490 0x7f277c159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:19.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f2780cf0640 1 --2- 172.21.15.79:0/992527776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f277c144cb0 0x7f277c1422c0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f277400c7d0 tx=0x7f277400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:19.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f2778ff9640 1 -- 172.21.15.79:0/992527776 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774018070 con 0x7f277c144cb0 2024-04-25T02:17:19.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f2778ff9640 1 -- 172.21.15.79:0/992527776 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277400a640 con 0x7f277c144cb0 2024-04-25T02:17:19.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f2782753640 1 -- 172.21.15.79:0/992527776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f277c15a9b0 con 0x7f277c144cb0 2024-04-25T02:17:19.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f2778ff9640 1 -- 172.21.15.79:0/992527776 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277400aa70 con 0x7f277c144cb0 2024-04-25T02:17:19.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.521+0000 7f2782753640 1 -- 172.21.15.79:0/992527776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f277c15b1f0 con 0x7f277c144cb0 2024-04-25T02:17:19.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.522+0000 7f2782753640 1 -- 172.21.15.79:0/992527776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f277c0690a0 con 0x7f277c144cb0 2024-04-25T02:17:19.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.523+0000 7f2778ff9640 1 -- 172.21.15.79:0/992527776 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f277401b070 con 0x7f277c144cb0 2024-04-25T02:17:19.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.523+0000 7f2778ff9640 1 --2- 172.21.15.79:0/992527776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f276806be30 0x7f276806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.523+0000 7f2778ff9640 1 -- 172.21.15.79:0/992527776 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5795+0+0 (secure 0 0 0) 0x7f277408a580 con 0x7f277c144cb0 2024-04-25T02:17:19.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.523+0000 7f277bfff640 1 --2- 172.21.15.79:0/992527776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f276806be30 0x7f276806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.523+0000 7f277bfff640 1 --2- 172.21.15.79:0/992527776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f276806be30 0x7f276806e2f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f276c034000 tx=0x7f276c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:19.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.527+0000 7f2778ff9640 1 -- 172.21.15.79:0/992527776 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f277c15a9b0 con 0x7f277c144cb0 2024-04-25T02:17:19.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.738+0000 7f2782753640 1 -- 172.21.15.79:0/992527776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f277c0d0b90 con 0x7f277c144cb0 2024-04-25T02:17:19.743 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:17:19.739+0000 7fb0c50c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:17:19.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.740+0000 7f2778ff9640 1 -- 172.21.15.79:0/992527776 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) ==== 161+0+0 (secure 0 0 0) 0x7f2774058e40 con 0x7f277c144cb0 2024-04-25T02:17:19.744 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:17:19.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.742+0000 7f2782753640 1 -- 172.21.15.79:0/992527776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f276806be30 msgr2=0x7f276806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.742+0000 7f2782753640 1 --2- 172.21.15.79:0/992527776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f276806be30 0x7f276806e2f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f276c034000 tx=0x7f276c02e000 comp rx=0 tx=0).stop 2024-04-25T02:17:19.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.742+0000 7f2782753640 1 -- 172.21.15.79:0/992527776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f277c144cb0 msgr2=0x7f277c1422c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.742+0000 7f2782753640 1 --2- 172.21.15.79:0/992527776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f277c144cb0 0x7f277c1422c0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f277400c7d0 tx=0x7f277400cc90 comp rx=0 tx=0).stop 2024-04-25T02:17:19.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.742+0000 7f2782753640 1 -- 172.21.15.79:0/992527776 shutdown_connections 2024-04-25T02:17:19.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.742+0000 7f2782753640 1 --2- 172.21.15.79:0/992527776 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f276806be30 0x7f276806e2f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.742+0000 7f2782753640 1 --2- 172.21.15.79:0/992527776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f277c144cb0 0x7f277c1422c0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.742+0000 7f2782753640 1 --2- 172.21.15.79:0/992527776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f277c0b5580 0x7f277c0aa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.742+0000 7f2782753640 1 --2- 172.21.15.79:0/992527776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f277c06e490 0x7f277c159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.742+0000 7f2782753640 1 -- 172.21.15.79:0/992527776 >> 172.21.15.79:0/992527776 conn(0x7f277c0cfc80 msgr2=0x7f277c0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:19.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.742+0000 7f2782753640 1 -- 172.21.15.79:0/992527776 shutdown_connections 2024-04-25T02:17:19.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.742+0000 7f2782753640 1 -- 172.21.15.79:0/992527776 wait complete. 2024-04-25T02:17:19.749 INFO:tasks.ceph.mds.c.smithi079.stderr: -1154> 2024-04-25T02:16:48.994+0000 7f813be23640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-25T02:17:19.749 INFO:tasks.ceph.mds.c.smithi079.stderr: -1151> 2024-04-25T02:16:48.994+0000 7f813be23640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-25T02:17:19.749 INFO:tasks.ceph.mds.c.smithi079.stderr: -1134> 2024-04-25T02:16:48.994+0000 7f813be23640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-25T02:17:19.749 INFO:tasks.ceph.mds.c.smithi079.stderr: -1131> 2024-04-25T02:16:48.994+0000 7f813be23640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-25T02:17:19.749 INFO:tasks.ceph.mds.c.smithi079.stderr: -1003> 2024-04-25T02:16:49.469+0000 7f813fe2b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:17:19.759 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show inode 2024-04-25T02:17:19.774 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-04-25T02:17:19.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.794+0000 7fca1611f280 1 -- start start 2024-04-25T02:17:19.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.794+0000 7fca1611f280 1 Processor -- start 2024-04-25T02:17:19.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.794+0000 7fca1611f280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471630cc00 0x56471637c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.794+0000 7fca1611f280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56471630d800 0x56471637cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.794+0000 7fca1611f280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56471630dc00 0x56471637d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.794+0000 7fca1611f280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5647170e6180 con 0x56471630dc00 2024-04-25T02:17:19.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.794+0000 7fca1611f280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5647170e6300 con 0x56471630cc00 2024-04-25T02:17:19.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.794+0000 7fca1611f280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5647170e6480 con 0x56471630d800 2024-04-25T02:17:19.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.794+0000 7fca14686640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56471630dc00 0x56471637d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.794+0000 7fca14686640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56471630dc00 0x56471637d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42150/0 (socket says 172.21.15.79:42150) 2024-04-25T02:17:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.794+0000 7fca14686640 1 -- 172.21.15.79:0/1834750301 learned_addr learned my addr 172.21.15.79:0/1834750301 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.794+0000 7fca13684640 1 --2- 172.21.15.79:0/1834750301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56471630d800 0x56471637cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.794+0000 7fca13e85640 1 --2- 172.21.15.79:0/1834750301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471630cc00 0x56471637c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca14686640 1 -- 172.21.15.79:0/1834750301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56471630d800 msgr2=0x56471637cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca14686640 1 --2- 172.21.15.79:0/1834750301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56471630d800 0x56471637cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca14686640 1 -- 172.21.15.79:0/1834750301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471630cc00 msgr2=0x56471637c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca14686640 1 --2- 172.21.15.79:0/1834750301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471630cc00 0x56471637c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca14686640 1 -- 172.21.15.79:0/1834750301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564716342780 con 0x56471630dc00 2024-04-25T02:17:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca13e85640 1 --2- 172.21.15.79:0/1834750301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471630cc00 0x56471637c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca14686640 1 --2- 172.21.15.79:0/1834750301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56471630dc00 0x56471637d080 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x5647171271a0 tx=0x5647170a2180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f88ee638f932b71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca11680640 1 -- 172.21.15.79:0/1834750301 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564716332680 con 0x56471630dc00 2024-04-25T02:17:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca11680640 1 -- 172.21.15.79:0/1834750301 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564716338fc0 con 0x56471630dc00 2024-04-25T02:17:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca11680640 1 -- 172.21.15.79:0/1834750301 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564716332b60 con 0x56471630dc00 2024-04-25T02:17:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca1611f280 1 -- 172.21.15.79:0/1834750301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647163434a0 con 0x56471630dc00 2024-04-25T02:17:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca1611f280 1 -- 172.21.15.79:0/1834750301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x564716342000 con 0x56471630dc00 2024-04-25T02:17:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca1611f280 4 waiting for MDS map... 2024-04-25T02:17:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca11680640 1 -- 172.21.15.79:0/1834750301 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x5647171e4600 con 0x56471630dc00 2024-04-25T02:17:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca11680640 1 -- 172.21.15.79:0/1834750301 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 75) ==== 2885+0+0 (secure 0 0 0) 0x564716367180 con 0x56471630dc00 2024-04-25T02:17:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca1611f280 4 Got MDS map 75 2024-04-25T02:17:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca1611f280 10 main: main 2024-04-25T02:17:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.795+0000 7fca1611f280 4 main: connecting to RADOS... 2024-04-25T02:17:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.796+0000 7fca1611f280 1 Processor -- start 2024-04-25T02:17:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.796+0000 7fca1611f280 1 -- start start 2024-04-25T02:17:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.796+0000 7fca1611f280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647171c9400 0x56471637d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.796+0000 7fca1611f280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647171c9800 0x56471637db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.796+0000 7fca1611f280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647171c9c00 0x56471637e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.796+0000 7fca1611f280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5647170e6600 con 0x5647171c9c00 2024-04-25T02:17:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.796+0000 7fca1611f280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5647170e6780 con 0x5647171c9800 2024-04-25T02:17:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.796+0000 7fca1611f280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5647170e6900 con 0x5647171c9400 2024-04-25T02:17:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.796+0000 7fca13684640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647171c9c00 0x56471637e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca13684640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647171c9c00 0x56471637e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42160/0 (socket says 172.21.15.79:42160) 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca13684640 1 -- 172.21.15.79:0/3867418900 learned_addr learned my addr 172.21.15.79:0/3867418900 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca13e85640 1 --2- 172.21.15.79:0/3867418900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647171c9800 0x56471637db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca13684640 1 --2- 172.21.15.79:0/3867418900 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647171c9400 0x56471637d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca13684640 1 -- 172.21.15.79:0/3867418900 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647171c9400 msgr2=0x56471637d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca13684640 1 --2- 172.21.15.79:0/3867418900 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647171c9400 0x56471637d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca13684640 1 -- 172.21.15.79:0/3867418900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647171c9800 msgr2=0x56471637db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca13684640 1 --2- 172.21.15.79:0/3867418900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647171c9800 0x56471637db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca13684640 1 -- 172.21.15.79:0/3867418900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647163423c0 con 0x5647171c9c00 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca13684640 1 --2- 172.21.15.79:0/3867418900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647171c9c00 0x56471637e100 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x56471724c090 tx=0x5647171f2cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d95f695aab5397 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca0f67c640 1 -- 172.21.15.79:0/3867418900 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564716332680 con 0x5647171c9c00 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca0f67c640 1 -- 172.21.15.79:0/3867418900 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564716338a80 con 0x5647171c9c00 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca0f67c640 1 -- 172.21.15.79:0/3867418900 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564716332b60 con 0x5647171c9c00 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca1611f280 1 -- 172.21.15.79:0/3867418900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647171c9c00 msgr2=0x56471637e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca1611f280 1 --2- 172.21.15.79:0/3867418900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647171c9c00 0x56471637e100 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x56471724c090 tx=0x5647171f2cc0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca1611f280 1 -- 172.21.15.79:0/3867418900 shutdown_connections 2024-04-25T02:17:19.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca1611f280 1 --2- 172.21.15.79:0/3867418900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647171c9c00 0x56471637e100 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca1611f280 1 --2- 172.21.15.79:0/3867418900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647171c9800 0x56471637db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca1611f280 1 --2- 172.21.15.79:0/3867418900 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647171c9400 0x56471637d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.797+0000 7fca1611f280 1 -- 172.21.15.79:0/3867418900 >> 172.21.15.79:0/3867418900 conn(0x5647171c9000 msgr2=0x5647163f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:19.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.798+0000 7fca1611f280 1 -- 172.21.15.79:0/3867418900 shutdown_connections 2024-04-25T02:17:19.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.798+0000 7fca1611f280 1 -- 172.21.15.79:0/3867418900 wait complete. 2024-04-25T02:17:19.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.798+0000 7fca1611f280 1 Processor -- start 2024-04-25T02:17:19.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.798+0000 7fca1611f280 1 -- start start 2024-04-25T02:17:19.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca1611f280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647171c9400 0x56471637f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca1611f280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647171c9800 0x56471637ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca1611f280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647171c9c00 0x56471637e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca1611f280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5647170e7b00 con 0x5647171c9c00 2024-04-25T02:17:19.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca1611f280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5647170e7980 con 0x5647171c9400 2024-04-25T02:17:19.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca1611f280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5647170e7800 con 0x5647171c9800 2024-04-25T02:17:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca13684640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647171c9c00 0x56471637e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca13684640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647171c9c00 0x56471637e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42176/0 (socket says 172.21.15.79:42176) 2024-04-25T02:17:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca13684640 1 -- 172.21.15.79:0/3668812045 learned_addr learned my addr 172.21.15.79:0/3668812045 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca13e85640 1 --2- 172.21.15.79:0/3668812045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647171c9800 0x56471637ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca13684640 1 --2- 172.21.15.79:0/3668812045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647171c9400 0x56471637f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca13684640 1 -- 172.21.15.79:0/3668812045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647171c9800 msgr2=0x56471637ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca13684640 1 --2- 172.21.15.79:0/3668812045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5647171c9800 0x56471637ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca13684640 1 -- 172.21.15.79:0/3668812045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647171c9400 msgr2=0x56471637f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca13684640 1 --2- 172.21.15.79:0/3668812045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647171c9400 0x56471637f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca13684640 1 -- 172.21.15.79:0/3668812045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564716342780 con 0x5647171c9c00 2024-04-25T02:17:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca13684640 1 --2- 172.21.15.79:0/3668812045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647171c9c00 0x56471637e680 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x56471724d350 tx=0x5647170a2300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca0de79640 1 -- 172.21.15.79:0/3668812045 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5647163324e0 con 0x5647171c9c00 2024-04-25T02:17:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca0de79640 1 -- 172.21.15.79:0/3668812045 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564716338a80 con 0x5647171c9c00 2024-04-25T02:17:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca1611f280 1 -- 172.21.15.79:0/3668812045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647163434a0 con 0x5647171c9c00 2024-04-25T02:17:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca0de79640 1 -- 172.21.15.79:0/3668812045 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564716332680 con 0x5647171c9c00 2024-04-25T02:17:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca1611f280 1 -- 172.21.15.79:0/3668812045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564716342960 con 0x5647171c9c00 2024-04-25T02:17:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.799+0000 7fca1611f280 4 main: resolving pool 14 2024-04-25T02:17:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.800+0000 7fca0de79640 1 -- 172.21.15.79:0/3668812045 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x564717106c00 con 0x5647171c9c00 2024-04-25T02:17:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.801+0000 7fca0de79640 1 --2- 172.21.15.79:0/3668812045 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x5647170fec00 0x56471637f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.801+0000 7fca0de79640 1 -- 172.21.15.79:0/3668812045 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x564717104a00 con 0x5647171c9c00 2024-04-25T02:17:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.801+0000 7fca1611f280 4 main: creating IoCtx.. 2024-04-25T02:17:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.801+0000 7fca13e85640 1 --2- 172.21.15.79:0/3668812045 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x5647170fec00 0x56471637f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.801+0000 7fca1611f280 1 --2- 172.21.15.79:0/3668812045 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5647170ff000 0x56471637e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.801+0000 7fca1611f280 1 -- 172.21.15.79:0/3668812045 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) -- 0x5647170ff400 con 0x5647170ff000 2024-04-25T02:17:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.801+0000 7fca13684640 1 --2- 172.21.15.79:0/3668812045 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5647170ff000 0x56471637e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.801+0000 7fca13e85640 1 --2- 172.21.15.79:0/3668812045 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x5647170fec00 0x56471637f700 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x56471633f950 tx=0x5647170a0480 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.801+0000 7fca13684640 1 --2- 172.21.15.79:0/3668812045 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5647170ff000 0x56471637e100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:19.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca13684640 1 -- 172.21.15.79:0/3668812045 <== osd.2 v2:172.21.15.79:6800/3397511354 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv7 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x56471708a000 con 0x5647170ff000 2024-04-25T02:17:19.813 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:17:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "0": { 2024-04-25T02:17:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "data": { 2024-04-25T02:17:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 5, 2024-04-25T02:17:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "inotable": { 2024-04-25T02:17:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "projected_free": [ 2024-04-25T02:17:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "start": 1099511627779, 2024-04-25T02:17:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "len": 1099511627773 2024-04-25T02:17:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-04-25T02:17:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "free": [ 2024-04-25T02:17:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "start": 1099511627779, 2024-04-25T02:17:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "len": 1099511627773 2024-04-25T02:17:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T02:17:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "result": 0 2024-04-25T02:17:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:19.815 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:17:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:19.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 -- 172.21.15.79:0/3668812045 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5647170ff000 msgr2=0x56471637e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 --2- 172.21.15.79:0/3668812045 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x5647170ff000 0x56471637e100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 -- 172.21.15.79:0/3668812045 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x5647170fec00 msgr2=0x56471637f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 --2- 172.21.15.79:0/3668812045 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x5647170fec00 0x56471637f700 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x56471633f950 tx=0x5647170a0480 comp rx=0 tx=0).stop 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 -- 172.21.15.79:0/3668812045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647171c9c00 msgr2=0x56471637e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 --2- 172.21.15.79:0/3668812045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647171c9c00 0x56471637e680 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x56471724d350 tx=0x5647170a2300 comp rx=0 tx=0).stop 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca13e85640 1 -- 172.21.15.79:0/3668812045 reap_dead start 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 -- 172.21.15.79:0/3668812045 shutdown_connections 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 -- 172.21.15.79:0/3668812045 >> 172.21.15.79:0/3668812045 conn(0x5647171c9000 msgr2=0x5647163f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 -- 172.21.15.79:0/3668812045 shutdown_connections 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 -- 172.21.15.79:0/3668812045 wait complete. 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 -- 172.21.15.79:0/1834750301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56471630dc00 msgr2=0x56471637d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 --2- 172.21.15.79:0/1834750301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56471630dc00 0x56471637d080 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x5647171271a0 tx=0x5647170a2180 comp rx=0 tx=0).stop 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 -- 172.21.15.79:0/1834750301 shutdown_connections 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 --2- 172.21.15.79:0/1834750301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56471630dc00 0x56471637d080 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 --2- 172.21.15.79:0/1834750301 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x56471630d800 0x56471637cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 --2- 172.21.15.79:0/1834750301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471630cc00 0x56471637c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:19.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 -- 172.21.15.79:0/1834750301 >> 172.21.15.79:0/1834750301 conn(0x56471630d000 msgr2=0x5647163f8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:19.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 -- 172.21.15.79:0/1834750301 shutdown_connections 2024-04-25T02:17:19.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:19.804+0000 7fca1611f280 1 -- 172.21.15.79:0/1834750301 wait complete. 2024-04-25T02:17:19.818 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'inode'] in time 0:00:00.058944, result: { "0": { "data": { "version": 5, "inotable": { "projected_free": [ { "start": 1099511627779, "len": 1099511627773 } ], "free": [ { "start": 1099511627779, "len": 1099511627773 } ] } }, "result": 0 } } 2024-04-25T02:17:19.818 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:17:19.818 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:17:19.899 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:17:19.940 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:17:19.940 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:17:19.940 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:17:19.940 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:19.955 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:17:19.955 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:17:19.955 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:17:19.956 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:19.998 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:17:19.998 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:17:19.998 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:17:19.998 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:20.013 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:17:20.013 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:17:20.013 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:17:20.013 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:20.055 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:17:20.055 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:17:20.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.148+0000 7f6b1c714640 1 Processor -- start 2024-04-25T02:17:20.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.148+0000 7f6b1c714640 1 -- start start 2024-04-25T02:17:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.149+0000 7f6b1c714640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b1406c3d0 0x7f6b14161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.149+0000 7f6b1c714640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6b140d00d0 0x7f6b140d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.149+0000 7f6b1c714640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b140b1d20 con 0x7f6b1406cbd0 2024-04-25T02:17:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.149+0000 7f6b1c714640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6b14162620 con 0x7f6b1406c3d0 2024-04-25T02:17:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.149+0000 7f6b1c714640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6b14162900 con 0x7f6b140d00d0 2024-04-25T02:17:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.149+0000 7f6b19caf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b1406c3d0 0x7f6b14161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.149+0000 7f6b19caf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b1406c3d0 0x7f6b14161df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42186/0 (socket says 172.21.15.79:42186) 2024-04-25T02:17:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.149+0000 7f6b19caf640 1 -- 172.21.15.79:0/1744147803 learned_addr learned my addr 172.21.15.79:0/1744147803 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.150+0000 7f6b1acb1640 1 --2- 172.21.15.79:0/1744147803 >> v2:172.21.15.189:3300/0 conn(0x7f6b140d00d0 0x7f6b140d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.150+0000 7f6b19caf640 1 -- 172.21.15.79:0/1744147803 >> v2:172.21.15.189:3300/0 conn(0x7f6b140d00d0 msgr2=0x7f6b140d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.150+0000 7f6b19caf640 1 --2- 172.21.15.79:0/1744147803 >> v2:172.21.15.189:3300/0 conn(0x7f6b140d00d0 0x7f6b140d0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.150+0000 7f6b19caf640 1 -- 172.21.15.79:0/1744147803 >> v1:172.21.15.189:6789/0 conn(0x7f6b1406cbd0 legacy=0x7f6b1406cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:20.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.150+0000 7f6b19caf640 1 -- 172.21.15.79:0/1744147803 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b14162be0 con 0x7f6b1406c3d0 2024-04-25T02:17:20.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.150+0000 7f6b19caf640 1 --2- 172.21.15.79:0/1744147803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b1406c3d0 0x7f6b14161df0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f6b140cfaa0 tx=0x7f6b0402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6405192d86ec44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:20.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.150+0000 7f6b194ae640 1 -- 172.21.15.79:0/1744147803 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04037070 con 0x7f6b1406c3d0 2024-04-25T02:17:20.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.150+0000 7f6b194ae640 1 -- 172.21.15.79:0/1744147803 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b04032440 con 0x7f6b1406c3d0 2024-04-25T02:17:20.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.150+0000 7f6b194ae640 1 -- 172.21.15.79:0/1744147803 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04032810 con 0x7f6b1406c3d0 2024-04-25T02:17:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.151+0000 7f6b1c714640 1 -- 172.21.15.79:0/1744147803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b1406c3d0 msgr2=0x7f6b14161df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.151+0000 7f6b1c714640 1 --2- 172.21.15.79:0/1744147803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b1406c3d0 0x7f6b14161df0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f6b140cfaa0 tx=0x7f6b0402a1a0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.151+0000 7f6b1c714640 1 -- 172.21.15.79:0/1744147803 shutdown_connections 2024-04-25T02:17:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.151+0000 7f6b1c714640 1 --2- 172.21.15.79:0/1744147803 >> v2:172.21.15.189:3300/0 conn(0x7f6b140d00d0 0x7f6b140d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.151+0000 7f6b1c714640 1 --2- 172.21.15.79:0/1744147803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b1406c3d0 0x7f6b14161df0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.151+0000 7f6b1c714640 1 -- 172.21.15.79:0/1744147803 >> 172.21.15.79:0/1744147803 conn(0x7f6b1409aa70 msgr2=0x7f6b1409ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.151+0000 7f6b1c714640 1 -- 172.21.15.79:0/1744147803 shutdown_connections 2024-04-25T02:17:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.151+0000 7f6b1c714640 1 -- 172.21.15.79:0/1744147803 wait complete. 2024-04-25T02:17:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.152+0000 7f6b1c714640 1 Processor -- start 2024-04-25T02:17:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.152+0000 7f6b1c714640 1 -- start start 2024-04-25T02:17:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b1c714640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b1406c3d0 0x7f6b141f1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b1c714640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b1406cbd0 0x7f6b140701e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b1c714640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b140d00d0 0x7f6b140aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b1c714640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1415e600 con 0x7f6b140d00d0 2024-04-25T02:17:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b1c714640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b14162330 con 0x7f6b1406cbd0 2024-04-25T02:17:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b1c714640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6b140b2500 con 0x7f6b1406c3d0 2024-04-25T02:17:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b1acb1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b140d00d0 0x7f6b140aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b1acb1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b140d00d0 0x7f6b140aff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42194/0 (socket says 172.21.15.79:42194) 2024-04-25T02:17:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b1acb1640 1 -- 172.21.15.79:0/2855972439 learned_addr learned my addr 172.21.15.79:0/2855972439 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b19caf640 1 --2- 172.21.15.79:0/2855972439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b1406cbd0 0x7f6b140701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b1a4b0640 1 --2- 172.21.15.79:0/2855972439 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b1406c3d0 0x7f6b141f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b1acb1640 1 -- 172.21.15.79:0/2855972439 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b1406c3d0 msgr2=0x7f6b141f1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b1acb1640 1 --2- 172.21.15.79:0/2855972439 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b1406c3d0 0x7f6b141f1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b1acb1640 1 -- 172.21.15.79:0/2855972439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b1406cbd0 msgr2=0x7f6b140701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b1acb1640 1 --2- 172.21.15.79:0/2855972439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b1406cbd0 0x7f6b140701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.153+0000 7f6b1acb1640 1 -- 172.21.15.79:0/2855972439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b1406f160 con 0x7f6b140d00d0 2024-04-25T02:17:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.154+0000 7f6b1acb1640 1 --2- 172.21.15.79:0/2855972439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b140d00d0 0x7f6b140aff50 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c007e60 tx=0x7f6b0c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.154+0000 7f6b0affd640 1 -- 172.21.15.79:0/2855972439 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c014420 con 0x7f6b140d00d0 2024-04-25T02:17:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.154+0000 7f6b0affd640 1 -- 172.21.15.79:0/2855972439 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b0c019070 con 0x7f6b140d00d0 2024-04-25T02:17:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.154+0000 7f6b1c714640 1 -- 172.21.15.79:0/2855972439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b1406f440 con 0x7f6b140d00d0 2024-04-25T02:17:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.154+0000 7f6b0affd640 1 -- 172.21.15.79:0/2855972439 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c014820 con 0x7f6b140d00d0 2024-04-25T02:17:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.154+0000 7f6b1c714640 1 -- 172.21.15.79:0/2855972439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b1406fa00 con 0x7f6b140d00d0 2024-04-25T02:17:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.155+0000 7f6b1c714640 1 -- 172.21.15.79:0/2855972439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b140690a0 con 0x7f6b140d00d0 2024-04-25T02:17:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.155+0000 7f6b0affd640 1 -- 172.21.15.79:0/2855972439 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b0c0149c0 con 0x7f6b140d00d0 2024-04-25T02:17:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.156+0000 7f6b0affd640 1 --2- 172.21.15.79:0/2855972439 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6af806be60 0x7f6af806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.156+0000 7f6b1a4b0640 1 --2- 172.21.15.79:0/2855972439 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6af806be60 0x7f6af806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.156+0000 7f6b0affd640 1 -- 172.21.15.79:0/2855972439 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x7f6b0c08b720 con 0x7f6b140d00d0 2024-04-25T02:17:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.156+0000 7f6b1a4b0640 1 --2- 172.21.15.79:0/2855972439 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6af806be60 0x7f6af806e320 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6b10004ea0 tx=0x7f6b10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:20.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.160+0000 7f6b0affd640 1 -- 172.21.15.79:0/2855972439 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6b0c05a020 con 0x7f6b140d00d0 2024-04-25T02:17:20.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.369+0000 7f6b1c714640 1 -- 172.21.15.79:0/2855972439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b140aee70 con 0x7f6b140d00d0 2024-04-25T02:17:20.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.370+0000 7f6b0affd640 1 -- 172.21.15.79:0/2855972439 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+4351 (secure 0 0 0) 0x7f6b0c059920 con 0x7f6b140d00d0 2024-04-25T02:17:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:20.375 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":75,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1086166830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1086166830},{"type":"v1","addr":"172.21.15.189:6834","nonce":1086166830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2468340230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2468340230},{"type":"v1","addr":"172.21.15.189:6835","nonce":2468340230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3582530322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3582530322},{"type":"v1","addr":"172.21.15.79:6836","nonce":3582530322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":75,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:15:58.363457+0000","modified":"2024-04-25T02:17:19.739878+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-25T02:17:20.375 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 75 2024-04-25T02:17:20.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.372+0000 7f6b1c714640 1 -- 172.21.15.79:0/2855972439 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6af806be60 msgr2=0x7f6af806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.372+0000 7f6b1c714640 1 --2- 172.21.15.79:0/2855972439 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6af806be60 0x7f6af806e320 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6b10004ea0 tx=0x7f6b10009040 comp rx=0 tx=0).stop 2024-04-25T02:17:20.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.372+0000 7f6b1c714640 1 -- 172.21.15.79:0/2855972439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b140d00d0 msgr2=0x7f6b140aff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.372+0000 7f6b1c714640 1 --2- 172.21.15.79:0/2855972439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b140d00d0 0x7f6b140aff50 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c007e60 tx=0x7f6b0c00e4b0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.372+0000 7f6b1c714640 1 -- 172.21.15.79:0/2855972439 shutdown_connections 2024-04-25T02:17:20.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.372+0000 7f6b1c714640 1 --2- 172.21.15.79:0/2855972439 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6af806be60 0x7f6af806e320 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.372+0000 7f6b1c714640 1 --2- 172.21.15.79:0/2855972439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b140d00d0 0x7f6b140aff50 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.372+0000 7f6b1c714640 1 --2- 172.21.15.79:0/2855972439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b1406cbd0 0x7f6b140701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.372+0000 7f6b1c714640 1 --2- 172.21.15.79:0/2855972439 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b1406c3d0 0x7f6b141f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.372+0000 7f6b1c714640 1 -- 172.21.15.79:0/2855972439 >> 172.21.15.79:0/2855972439 conn(0x7f6b1409aa70 msgr2=0x7f6b1406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:20.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.372+0000 7f6b1c714640 1 -- 172.21.15.79:0/2855972439 shutdown_connections 2024-04-25T02:17:20.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.372+0000 7f6b1c714640 1 -- 172.21.15.79:0/2855972439 wait complete. 2024-04-25T02:17:20.388 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:17:20.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.479+0000 7ff0a5eba640 1 Processor -- start 2024-04-25T02:17:20.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.479+0000 7ff0a5eba640 1 -- start start 2024-04-25T02:17:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff0a5eba640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff0a0143bc0 0x7ff0a015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff0a5eba640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0a00b3d40 0x7ff0a006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff0a5eba640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0a015fa40 con 0x7ff0a006df50 2024-04-25T02:17:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff0a5eba640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a006e8f0 con 0x7ff0a0143bc0 2024-04-25T02:17:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff0a5eba640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a0072cb0 con 0x7ff0a00b3d40 2024-04-25T02:17:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09effd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff0a006df50 0x7ff0a00b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54472/0 (socket says 172.21.15.79:54472) 2024-04-25T02:17:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09effd640 1 -- 172.21.15.79:0/2562129096 learned_addr learned my addr 172.21.15.79:0/2562129096 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 -- 172.21.15.79:0/2562129096 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4294439005 0 0) 0x7ff090001110 con 0x7ff0a006df50 2024-04-25T02:17:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09ffff640 1 --2- 172.21.15.79:0/2562129096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0a00b3d40 0x7ff0a006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09f7fe640 1 --2- 172.21.15.79:0/2562129096 >> v2:172.21.15.189:3300/0 conn(0x7ff0a0143bc0 0x7ff0a015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 -- 172.21.15.79:0/2562129096 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff088003520 con 0x7ff0a006df50 2024-04-25T02:17:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 -- 172.21.15.79:0/2562129096 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1342264245 0 0) 0x7ff088003520 con 0x7ff0a006df50 2024-04-25T02:17:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 -- 172.21.15.79:0/2562129096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0a00b3d40 msgr2=0x7ff0a006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 --2- 172.21.15.79:0/2562129096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0a00b3d40 0x7ff0a006e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 -- 172.21.15.79:0/2562129096 >> v2:172.21.15.189:3300/0 conn(0x7ff0a0143bc0 msgr2=0x7ff0a015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 --2- 172.21.15.79:0/2562129096 >> v2:172.21.15.189:3300/0 conn(0x7ff0a0143bc0 0x7ff0a015f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 -- 172.21.15.79:0/2562129096 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a0071e00 con 0x7ff0a006df50 2024-04-25T02:17:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 -- 172.21.15.79:0/2562129096 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7ff090001840 con 0x7ff0a006df50 2024-04-25T02:17:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 -- 172.21.15.79:0/2562129096 >> v1:172.21.15.79:6789/0 conn(0x7ff0a006df50 legacy=0x7ff0a00b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 --2- 172.21.15.79:0/2562129096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0880039b0 0x7ff088003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 --2- 172.21.15.79:0/2562129096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0a00b3d40 0x7ff088004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 --2- 172.21.15.79:0/2562129096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff088004d40 0x7ff0880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 -- 172.21.15.79:0/2562129096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a0072cb0 con 0x7ff088004d40 2024-04-25T02:17:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 -- 172.21.15.79:0/2562129096 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff08800b9c0 con 0x7ff0880039b0 2024-04-25T02:17:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.480+0000 7ff09e7fc640 1 -- 172.21.15.79:0/2562129096 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff08800bb70 con 0x7ff0a00b3d40 2024-04-25T02:17:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.481+0000 7ff09ffff640 1 --2- 172.21.15.79:0/2562129096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff088004d40 0x7ff0880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.481+0000 7ff09f7fe640 1 --2- 172.21.15.79:0/2562129096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0880039b0 0x7ff088003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.481+0000 7ff09effd640 1 --2- 172.21.15.79:0/2562129096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0a00b3d40 0x7ff088004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.481+0000 7ff09ffff640 1 -- 172.21.15.79:0/2562129096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0a00b3d40 msgr2=0x7ff088004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.481+0000 7ff09ffff640 1 --2- 172.21.15.79:0/2562129096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0a00b3d40 0x7ff088004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.481+0000 7ff09ffff640 1 -- 172.21.15.79:0/2562129096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0880039b0 msgr2=0x7ff088003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.481+0000 7ff09ffff640 1 --2- 172.21.15.79:0/2562129096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0880039b0 0x7ff088003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.481+0000 7ff09ffff640 1 -- 172.21.15.79:0/2562129096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff088003520 con 0x7ff088004d40 2024-04-25T02:17:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.481+0000 7ff09ffff640 1 --2- 172.21.15.79:0/2562129096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff088004d40 0x7ff0880051c0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7ff098009f90 tx=0x7ff088005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d11eb7a72b01d28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.481+0000 7ff09e7fc640 1 -- 172.21.15.79:0/2562129096 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098009c10 con 0x7ff088004d40 2024-04-25T02:17:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.482+0000 7ff09e7fc640 1 -- 172.21.15.79:0/2562129096 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff098036070 con 0x7ff088004d40 2024-04-25T02:17:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.482+0000 7ff09e7fc640 1 -- 172.21.15.79:0/2562129096 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098031810 con 0x7ff088004d40 2024-04-25T02:17:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.482+0000 7ff0a5eba640 1 -- 172.21.15.79:0/2562129096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff088004d40 msgr2=0x7ff0880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.482+0000 7ff0a5eba640 1 --2- 172.21.15.79:0/2562129096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff088004d40 0x7ff0880051c0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7ff098009f90 tx=0x7ff088005830 comp rx=0 tx=0).stop 2024-04-25T02:17:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.482+0000 7ff09ffff640 1 -- 172.21.15.79:0/2562129096 reap_dead start 2024-04-25T02:17:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.482+0000 7ff0a5eba640 1 -- 172.21.15.79:0/2562129096 shutdown_connections 2024-04-25T02:17:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.482+0000 7ff0a5eba640 1 -- 172.21.15.79:0/2562129096 >> 172.21.15.79:0/2562129096 conn(0x7ff0a00cfc80 msgr2=0x7ff0a00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.482+0000 7ff0a5eba640 1 -- 172.21.15.79:0/2562129096 shutdown_connections 2024-04-25T02:17:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.482+0000 7ff0a5eba640 1 -- 172.21.15.79:0/2562129096 wait complete. 2024-04-25T02:17:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.483+0000 7ff0a5eba640 1 Processor -- start 2024-04-25T02:17:20.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.483+0000 7ff0a5eba640 1 -- start start 2024-04-25T02:17:20.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff0a5eba640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0a0132620 0x7ff0a0132a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff0a5eba640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0a00aea90 0x7ff0a00aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff0a5eba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a00ce550 0x7ff0a00ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff0a5eba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a0072660 con 0x7ff0a00ce550 2024-04-25T02:17:20.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff0a5eba640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a0072380 con 0x7ff0a00aea90 2024-04-25T02:17:20.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff0a5eba640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a0072940 con 0x7ff0a0132620 2024-04-25T02:17:20.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff09ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a00ce550 0x7ff0a00ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff09ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a00ce550 0x7ff0a00ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42202/0 (socket says 172.21.15.79:42202) 2024-04-25T02:17:20.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff09ffff640 1 -- 172.21.15.79:0/2289062803 learned_addr learned my addr 172.21.15.79:0/2289062803 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff09effd640 1 --2- 172.21.15.79:0/2289062803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0a00aea90 0x7ff0a00aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff09f7fe640 1 --2- 172.21.15.79:0/2289062803 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0a0132620 0x7ff0a0132a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff09ffff640 1 -- 172.21.15.79:0/2289062803 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0a0132620 msgr2=0x7ff0a0132a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff09ffff640 1 --2- 172.21.15.79:0/2289062803 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0a0132620 0x7ff0a0132a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff09ffff640 1 -- 172.21.15.79:0/2289062803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0a00aea90 msgr2=0x7ff0a00aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff09ffff640 1 --2- 172.21.15.79:0/2289062803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0a00aea90 0x7ff0a00aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.484+0000 7ff09ffff640 1 -- 172.21.15.79:0/2289062803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a0133140 con 0x7ff0a00ce550 2024-04-25T02:17:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.485+0000 7ff09ffff640 1 --2- 172.21.15.79:0/2289062803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a00ce550 0x7ff0a00ce9d0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7ff098009f90 tx=0x7ff098009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.485+0000 7ff087fff640 1 -- 172.21.15.79:0/2289062803 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098009c10 con 0x7ff0a00ce550 2024-04-25T02:17:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.485+0000 7ff087fff640 1 -- 172.21.15.79:0/2289062803 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff098045430 con 0x7ff0a00ce550 2024-04-25T02:17:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.485+0000 7ff0a5eba640 1 -- 172.21.15.79:0/2289062803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a0133420 con 0x7ff0a00ce550 2024-04-25T02:17:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.485+0000 7ff087fff640 1 -- 172.21.15.79:0/2289062803 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098045820 con 0x7ff0a00ce550 2024-04-25T02:17:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.485+0000 7ff0a5eba640 1 -- 172.21.15.79:0/2289062803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a01339e0 con 0x7ff0a00ce550 2024-04-25T02:17:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.486+0000 7ff0a5eba640 1 -- 172.21.15.79:0/2289062803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a00690a0 con 0x7ff0a00ce550 2024-04-25T02:17:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.486+0000 7ff087fff640 1 -- 172.21.15.79:0/2289062803 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff098005d10 con 0x7ff0a00ce550 2024-04-25T02:17:20.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.487+0000 7ff087fff640 1 --2- 172.21.15.79:0/2289062803 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff08c06bda0 0x7ff08c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.487+0000 7ff087fff640 1 -- 172.21.15.79:0/2289062803 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x7ff0980ac1a0 con 0x7ff0a00ce550 2024-04-25T02:17:20.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.487+0000 7ff09f7fe640 1 --2- 172.21.15.79:0/2289062803 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff08c06bda0 0x7ff08c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.487+0000 7ff09f7fe640 1 --2- 172.21.15.79:0/2289062803 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff08c06bda0 0x7ff08c06e260 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff094009b80 tx=0x7ff094008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:20.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.491+0000 7ff087fff640 1 -- 172.21.15.79:0/2289062803 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff09804b060 con 0x7ff0a00ce550 2024-04-25T02:17:20.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.667+0000 7ff0a5eba640 1 -- 172.21.15.79:0/2289062803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0a00683e0 con 0x7ff0a00ce550 2024-04-25T02:17:20.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.668+0000 7ff087fff640 1 -- 172.21.15.79:0/2289062803 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16890 (secure 0 0 0) 0x7ff09802e050 con 0x7ff0a00ce550 2024-04-25T02:17:20.673 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:20.673 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":104,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:17:19.739710+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:15:56.581482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T02:15:57.334060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/2550458851":"2024-04-26T02:17:19.739687+0000","172.21.15.79:6834/2550458851":"2024-04-26T02:17:19.739687+0000","172.21.15.79:6837/2774759267":"2024-04-26T02:16:43.461186+0000","172.21.15.79:6834/2774759267":"2024-04-26T02:16:43.461186+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:17:20.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.670+0000 7ff0a5eba640 1 -- 172.21.15.79:0/2289062803 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff08c06bda0 msgr2=0x7ff08c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.670+0000 7ff0a5eba640 1 --2- 172.21.15.79:0/2289062803 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff08c06bda0 0x7ff08c06e260 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff094009b80 tx=0x7ff094008040 comp rx=0 tx=0).stop 2024-04-25T02:17:20.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.670+0000 7ff0a5eba640 1 -- 172.21.15.79:0/2289062803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a00ce550 msgr2=0x7ff0a00ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.670+0000 7ff0a5eba640 1 --2- 172.21.15.79:0/2289062803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a00ce550 0x7ff0a00ce9d0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7ff098009f90 tx=0x7ff098009750 comp rx=0 tx=0).stop 2024-04-25T02:17:20.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.670+0000 7ff0a5eba640 1 -- 172.21.15.79:0/2289062803 shutdown_connections 2024-04-25T02:17:20.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.670+0000 7ff0a5eba640 1 --2- 172.21.15.79:0/2289062803 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff08c06bda0 0x7ff08c06e260 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.670+0000 7ff0a5eba640 1 --2- 172.21.15.79:0/2289062803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a00ce550 0x7ff0a00ce9d0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.670+0000 7ff0a5eba640 1 --2- 172.21.15.79:0/2289062803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0a00aea90 0x7ff0a00aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.670+0000 7ff0a5eba640 1 --2- 172.21.15.79:0/2289062803 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0a0132620 0x7ff0a0132a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.670+0000 7ff0a5eba640 1 -- 172.21.15.79:0/2289062803 >> 172.21.15.79:0/2289062803 conn(0x7ff0a00cfc80 msgr2=0x7ff0a00b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:20.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.670+0000 7ff0a5eba640 1 -- 172.21.15.79:0/2289062803 shutdown_connections 2024-04-25T02:17:20.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.670+0000 7ff0a5eba640 1 -- 172.21.15.79:0/2289062803 wait complete. 2024-04-25T02:17:20.686 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:15:56.581482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:15:57.334060+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:17:20.687 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:17:20.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.782+0000 7f5b57c29640 1 Processor -- start 2024-04-25T02:17:20.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.782+0000 7f5b57c29640 1 -- start start 2024-04-25T02:17:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.783+0000 7f5b57c29640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b500706d0 0x7f5b5006dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.783+0000 7f5b57c29640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b5006b7c0 con 0x7f5b50159d30 2024-04-25T02:17:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.783+0000 7f5b57c29640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b5015c6d0 con 0x7f5b5006e1d0 2024-04-25T02:17:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.783+0000 7f5b57c29640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5b5015c990 con 0x7f5b500706d0 2024-04-25T02:17:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.783+0000 7f5b559c5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5b50159d30 0x7f5b5006b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54484/0 (socket says 172.21.15.79:54484) 2024-04-25T02:17:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.783+0000 7f5b559c5640 1 -- 172.21.15.79:0/3819258530 learned_addr learned my addr 172.21.15.79:0/3819258530 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.783+0000 7f5b551c4640 1 --2- 172.21.15.79:0/3819258530 >> v2:172.21.15.79:3300/0 conn(0x7f5b500706d0 0x7f5b5006dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.784+0000 7f5b549c3640 1 -- 172.21.15.79:0/3819258530 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3351609549 0 0) 0x7f5b5006b7c0 con 0x7f5b50159d30 2024-04-25T02:17:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.784+0000 7f5b549c3640 1 -- 172.21.15.79:0/3819258530 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b3c003520 con 0x7f5b50159d30 2024-04-25T02:17:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.784+0000 7f5b551c4640 1 -- 172.21.15.79:0/3819258530 >> v1:172.21.15.189:6789/0 conn(0x7f5b5006e1d0 legacy=0x7f5b500addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.784+0000 7f5b551c4640 1 -- 172.21.15.79:0/3819258530 >> v1:172.21.15.79:6789/0 conn(0x7f5b50159d30 legacy=0x7f5b5006b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.784+0000 7f5b551c4640 1 -- 172.21.15.79:0/3819258530 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5015cc70 con 0x7f5b500706d0 2024-04-25T02:17:20.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.784+0000 7f5b551c4640 1 --2- 172.21.15.79:0/3819258530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b500706d0 0x7f5b5006dc90 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0097a0 tx=0x7f5b4c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4897aa6f180f6225 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:20.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.785+0000 7f5b549c3640 1 -- 172.21.15.79:0/3819258530 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c037070 con 0x7f5b500706d0 2024-04-25T02:17:20.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.785+0000 7f5b549c3640 1 -- 172.21.15.79:0/3819258530 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b4c032440 con 0x7f5b500706d0 2024-04-25T02:17:20.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.785+0000 7f5b549c3640 1 -- 172.21.15.79:0/3819258530 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0327f0 con 0x7f5b500706d0 2024-04-25T02:17:20.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.785+0000 7f5b57c29640 1 -- 172.21.15.79:0/3819258530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b500706d0 msgr2=0x7f5b5006dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.785+0000 7f5b57c29640 1 --2- 172.21.15.79:0/3819258530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b500706d0 0x7f5b5006dc90 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0097a0 tx=0x7f5b4c02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.785+0000 7f5b57c29640 1 -- 172.21.15.79:0/3819258530 shutdown_connections 2024-04-25T02:17:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.785+0000 7f5b57c29640 1 --2- 172.21.15.79:0/3819258530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b500706d0 0x7f5b5006dc90 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.785+0000 7f5b57c29640 1 -- 172.21.15.79:0/3819258530 >> 172.21.15.79:0/3819258530 conn(0x7f5b500d0e00 msgr2=0x7f5b500d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.785+0000 7f5b57c29640 1 -- 172.21.15.79:0/3819258530 shutdown_connections 2024-04-25T02:17:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.785+0000 7f5b57c29640 1 -- 172.21.15.79:0/3819258530 wait complete. 2024-04-25T02:17:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.786+0000 7f5b57c29640 1 Processor -- start 2024-04-25T02:17:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.786+0000 7f5b57c29640 1 -- start start 2024-04-25T02:17:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.787+0000 7f5b57c29640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5b5006e1d0 0x7f5b500cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.787+0000 7f5b57c29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b500706d0 0x7f5b501499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.787+0000 7f5b57c29640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b50159d30 0x7f5b50156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.787+0000 7f5b57c29640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5015d470 con 0x7f5b500706d0 2024-04-25T02:17:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.787+0000 7f5b57c29640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5006ba50 con 0x7f5b50159d30 2024-04-25T02:17:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.787+0000 7f5b57c29640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5b500ae4c0 con 0x7f5b5006e1d0 2024-04-25T02:17:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.787+0000 7f5b551c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b500706d0 0x7f5b501499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.787+0000 7f5b551c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b500706d0 0x7f5b501499a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42230/0 (socket says 172.21.15.79:42230) 2024-04-25T02:17:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.787+0000 7f5b551c4640 1 -- 172.21.15.79:0/84858063 learned_addr learned my addr 172.21.15.79:0/84858063 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:20.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.787+0000 7f5b551c4640 1 -- 172.21.15.79:0/84858063 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5b5006e1d0 msgr2=0x7f5b500cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.787+0000 7f5b551c4640 1 --2- 172.21.15.79:0/84858063 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5b5006e1d0 0x7f5b500cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.787+0000 7f5b551c4640 1 -- 172.21.15.79:0/84858063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b50159d30 msgr2=0x7f5b50156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.787+0000 7f5b551c4640 1 --2- 172.21.15.79:0/84858063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b50159d30 0x7f5b50156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.787+0000 7f5b551c4640 1 -- 172.21.15.79:0/84858063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b501571c0 con 0x7f5b500706d0 2024-04-25T02:17:20.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.788+0000 7f5b551c4640 1 --2- 172.21.15.79:0/84858063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b500706d0 0x7f5b501499a0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0097a0 tx=0x7f5b4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:20.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.788+0000 7f5b467fc640 1 -- 172.21.15.79:0/84858063 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c041070 con 0x7f5b500706d0 2024-04-25T02:17:20.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.788+0000 7f5b467fc640 1 -- 172.21.15.79:0/84858063 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b4c03c870 con 0x7f5b500706d0 2024-04-25T02:17:20.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.788+0000 7f5b57c29640 1 -- 172.21.15.79:0/84858063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b501574a0 con 0x7f5b500706d0 2024-04-25T02:17:20.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.788+0000 7f5b467fc640 1 -- 172.21.15.79:0/84858063 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c037040 con 0x7f5b500706d0 2024-04-25T02:17:20.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.788+0000 7f5b57c29640 1 -- 172.21.15.79:0/84858063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b50157a60 con 0x7f5b500706d0 2024-04-25T02:17:20.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.789+0000 7f5b57c29640 1 -- 172.21.15.79:0/84858063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b500690a0 con 0x7f5b500706d0 2024-04-25T02:17:20.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.789+0000 7f5b467fc640 1 -- 172.21.15.79:0/84858063 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b4c044070 con 0x7f5b500706d0 2024-04-25T02:17:20.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.790+0000 7f5b467fc640 1 --2- 172.21.15.79:0/84858063 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5b3406be30 0x7f5b3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:20.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.790+0000 7f5b467fc640 1 -- 172.21.15.79:0/84858063 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x7f5b4c0abb90 con 0x7f5b500706d0 2024-04-25T02:17:20.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.790+0000 7f5b559c5640 1 --2- 172.21.15.79:0/84858063 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5b3406be30 0x7f5b3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:20.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.790+0000 7f5b559c5640 1 --2- 172.21.15.79:0/84858063 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5b3406be30 0x7f5b3406e2f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5b40000f60 tx=0x7f5b400078f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:20.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.794+0000 7f5b467fc640 1 -- 172.21.15.79:0/84858063 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5b4c07a640 con 0x7f5b500706d0 2024-04-25T02:17:20.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.964+0000 7f5b57c29640 1 -- 172.21.15.79:0/84858063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5b5015c000 con 0x7f5b500706d0 2024-04-25T02:17:20.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.965+0000 7f5b467fc640 1 -- 172.21.15.79:0/84858063 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) ==== 93+0+10 (secure 0 0 0) 0x7f5b4c079f40 con 0x7f5b500706d0 2024-04-25T02:17:20.969 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:17:20.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.966+0000 7f5b57c29640 1 -- 172.21.15.79:0/84858063 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5b3406be30 msgr2=0x7f5b3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.966+0000 7f5b57c29640 1 --2- 172.21.15.79:0/84858063 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5b3406be30 0x7f5b3406e2f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5b40000f60 tx=0x7f5b400078f0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.966+0000 7f5b57c29640 1 -- 172.21.15.79:0/84858063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b500706d0 msgr2=0x7f5b501499a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.966+0000 7f5b57c29640 1 --2- 172.21.15.79:0/84858063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b500706d0 0x7f5b501499a0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0097a0 tx=0x7f5b4c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.967+0000 7f5b57c29640 1 -- 172.21.15.79:0/84858063 shutdown_connections 2024-04-25T02:17:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.967+0000 7f5b57c29640 1 --2- 172.21.15.79:0/84858063 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5b3406be30 0x7f5b3406e2f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.967+0000 7f5b57c29640 1 --2- 172.21.15.79:0/84858063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b50159d30 0x7f5b50156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.967+0000 7f5b57c29640 1 --2- 172.21.15.79:0/84858063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b500706d0 0x7f5b501499a0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.967+0000 7f5b57c29640 1 --2- 172.21.15.79:0/84858063 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5b5006e1d0 0x7f5b500cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.967+0000 7f5b57c29640 1 -- 172.21.15.79:0/84858063 >> 172.21.15.79:0/84858063 conn(0x7f5b500d0e00 msgr2=0x7f5b500d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.967+0000 7f5b57c29640 1 -- 172.21.15.79:0/84858063 shutdown_connections 2024-04-25T02:17:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:20.967+0000 7f5b57c29640 1 -- 172.21.15.79:0/84858063 wait complete. 2024-04-25T02:17:20.982 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:17:21.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.076+0000 7f2d8bbed640 1 Processor -- start 2024-04-25T02:17:21.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.077+0000 7f2d8bbed640 1 -- start start 2024-04-25T02:17:21.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.077+0000 7f2d8bbed640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2d8415a810 0x7f2d840cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.077+0000 7f2d8bbed640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2d84071460 0x7f2d840b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.077+0000 7f2d8bbed640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d8415abf0 con 0x7f2d8409dcb0 2024-04-25T02:17:21.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.078+0000 7f2d8bbed640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2d84073050 con 0x7f2d84071460 2024-04-25T02:17:21.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.078+0000 7f2d8bbed640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f2d840cbdd0 con 0x7f2d8415a810 2024-04-25T02:17:21.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.078+0000 7f2d8a18a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2d84071460 0x7f2d840b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.078+0000 7f2d89188640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2d8409dcb0 0x7f2d84070d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54492/0 (socket says 172.21.15.79:54492) 2024-04-25T02:17:21.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.078+0000 7f2d89188640 1 -- 172.21.15.79:0/4294458351 learned_addr learned my addr 172.21.15.79:0/4294458351 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:21.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.078+0000 7f2d89989640 1 --2- 172.21.15.79:0/4294458351 >> v2:172.21.15.189:3300/0 conn(0x7f2d8415a810 0x7f2d840cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.078+0000 7f2d8a18a640 1 -- 172.21.15.79:0/4294458351 >> v2:172.21.15.189:3300/0 conn(0x7f2d8415a810 msgr2=0x7f2d840cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:21.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.078+0000 7f2d8a18a640 1 --2- 172.21.15.79:0/4294458351 >> v2:172.21.15.189:3300/0 conn(0x7f2d8415a810 0x7f2d840cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.078+0000 7f2d8a18a640 1 -- 172.21.15.79:0/4294458351 >> v1:172.21.15.79:6789/0 conn(0x7f2d8409dcb0 legacy=0x7f2d84070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.078+0000 7f2d88987640 1 -- 172.21.15.79:0/4294458351 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1428155286 0 0) 0x7f2d8415abf0 con 0x7f2d8409dcb0 2024-04-25T02:17:21.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.078+0000 7f2d8a18a640 1 -- 172.21.15.79:0/4294458351 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d840ce580 con 0x7f2d84071460 2024-04-25T02:17:21.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.078+0000 7f2d89989640 1 --2- 172.21.15.79:0/4294458351 >> v2:172.21.15.189:3300/0 conn(0x7f2d8415a810 0x7f2d840cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:21.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.079+0000 7f2d8a18a640 1 --2- 172.21.15.79:0/4294458351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d84071460 0x7f2d840b42a0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f2d840d0d40 tx=0x7f2d7c02b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbb7b66be59cd16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:21.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.079+0000 7f2d88987640 1 -- 172.21.15.79:0/4294458351 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c037070 con 0x7f2d84071460 2024-04-25T02:17:21.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.079+0000 7f2d88987640 1 -- 172.21.15.79:0/4294458351 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d7c008640 con 0x7f2d84071460 2024-04-25T02:17:21.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.079+0000 7f2d88987640 1 -- 172.21.15.79:0/4294458351 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c008a10 con 0x7f2d84071460 2024-04-25T02:17:21.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.079+0000 7f2d8bbed640 1 -- 172.21.15.79:0/4294458351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d84071460 msgr2=0x7f2d840b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.079+0000 7f2d8bbed640 1 --2- 172.21.15.79:0/4294458351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d84071460 0x7f2d840b42a0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f2d840d0d40 tx=0x7f2d7c02b6f0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.079+0000 7f2d8bbed640 1 -- 172.21.15.79:0/4294458351 shutdown_connections 2024-04-25T02:17:21.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.079+0000 7f2d8bbed640 1 --2- 172.21.15.79:0/4294458351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d84071460 0x7f2d840b42a0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.079+0000 7f2d8bbed640 1 --2- 172.21.15.79:0/4294458351 >> v2:172.21.15.189:3300/0 conn(0x7f2d8415a810 0x7f2d840cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.079+0000 7f2d8bbed640 1 -- 172.21.15.79:0/4294458351 >> 172.21.15.79:0/4294458351 conn(0x7f2d840b1cd0 msgr2=0x7f2d840b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:21.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.079+0000 7f2d8bbed640 1 -- 172.21.15.79:0/4294458351 shutdown_connections 2024-04-25T02:17:21.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.079+0000 7f2d8bbed640 1 -- 172.21.15.79:0/4294458351 wait complete. 2024-04-25T02:17:21.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.081+0000 7f2d8bbed640 1 Processor -- start 2024-04-25T02:17:21.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.081+0000 7f2d8bbed640 1 -- start start 2024-04-25T02:17:21.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.081+0000 7f2d8bbed640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d8409dcb0 0x7f2d841f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.081+0000 7f2d8bbed640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d8415a810 0x7f2d840cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.081+0000 7f2d8bbed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d8406dee0 0x7f2d8414f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.081+0000 7f2d8bbed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2d840cc020 con 0x7f2d8406dee0 2024-04-25T02:17:21.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.081+0000 7f2d8bbed640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2d840ceb40 con 0x7f2d8409dcb0 2024-04-25T02:17:21.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.081+0000 7f2d8bbed640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2d840cc300 con 0x7f2d8415a810 2024-04-25T02:17:21.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.081+0000 7f2d8a18a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d8406dee0 0x7f2d8414f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.081+0000 7f2d8a18a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d8406dee0 0x7f2d8414f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42248/0 (socket says 172.21.15.79:42248) 2024-04-25T02:17:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.081+0000 7f2d8a18a640 1 -- 172.21.15.79:0/4065706730 learned_addr learned my addr 172.21.15.79:0/4065706730 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.082+0000 7f2d89989640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d8409dcb0 0x7f2d841f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.082+0000 7f2d89188640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d8415a810 0x7f2d840cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.082+0000 7f2d8a18a640 1 -- 172.21.15.79:0/4065706730 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d8415a810 msgr2=0x7f2d840cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.082+0000 7f2d8a18a640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d8415a810 0x7f2d840cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.082+0000 7f2d8a18a640 1 -- 172.21.15.79:0/4065706730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d8409dcb0 msgr2=0x7f2d841f48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.082+0000 7f2d8a18a640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d8409dcb0 0x7f2d841f48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.082+0000 7f2d8a18a640 1 -- 172.21.15.79:0/4065706730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8414fa00 con 0x7f2d8406dee0 2024-04-25T02:17:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.082+0000 7f2d89188640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d8415a810 0x7f2d840cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.082+0000 7f2d89989640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d8409dcb0 0x7f2d841f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.082+0000 7f2d8a18a640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d8406dee0 0x7f2d8414f000 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00af90 tx=0x7f2d7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.082+0000 7f2d7a7fc640 1 -- 172.21.15.79:0/4065706730 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c041020 con 0x7f2d8406dee0 2024-04-25T02:17:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.082+0000 7f2d7a7fc640 1 -- 172.21.15.79:0/4065706730 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d7c0337c0 con 0x7f2d8406dee0 2024-04-25T02:17:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.082+0000 7f2d8bbed640 1 -- 172.21.15.79:0/4065706730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d841f3e10 con 0x7f2d8406dee0 2024-04-25T02:17:21.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.082+0000 7f2d7a7fc640 1 -- 172.21.15.79:0/4065706730 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c037040 con 0x7f2d8406dee0 2024-04-25T02:17:21.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.082+0000 7f2d8bbed640 1 -- 172.21.15.79:0/4065706730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d841f43d0 con 0x7f2d8406dee0 2024-04-25T02:17:21.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.083+0000 7f2d8bbed640 1 -- 172.21.15.79:0/4065706730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d840b38c0 con 0x7f2d8406dee0 2024-04-25T02:17:21.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.084+0000 7f2d7a7fc640 1 -- 172.21.15.79:0/4065706730 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d7c044020 con 0x7f2d8406dee0 2024-04-25T02:17:21.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.084+0000 7f2d7a7fc640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2d6806be30 0x7f2d6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.084+0000 7f2d7a7fc640 1 -- 172.21.15.79:0/4065706730 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x7f2d7c0abc00 con 0x7f2d8406dee0 2024-04-25T02:17:21.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.084+0000 7f2d89989640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2d6806be30 0x7f2d6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.085+0000 7f2d89989640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2d6806be30 0x7f2d6806e2f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2d80006fd0 tx=0x7f2d80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:21.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.088+0000 7f2d7a7fc640 1 -- 172.21.15.79:0/4065706730 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2d840b38c0 con 0x7f2d8406dee0 2024-04-25T02:17:21.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.266+0000 7f2d8bbed640 1 -- 172.21.15.79:0/4065706730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2d840cbbd0 con 0x7f2d8406dee0 2024-04-25T02:17:21.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.266+0000 7f2d7a7fc640 1 -- 172.21.15.79:0/4065706730 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v104) ==== 104+0+11 (secure 0 0 0) 0x7f2d7c0b2080 con 0x7f2d8406dee0 2024-04-25T02:17:21.270 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:17:21.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.268+0000 7f2d8bbed640 1 -- 172.21.15.79:0/4065706730 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2d6806be30 msgr2=0x7f2d6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.268+0000 7f2d8bbed640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2d6806be30 0x7f2d6806e2f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2d80006fd0 tx=0x7f2d80008040 comp rx=0 tx=0).stop 2024-04-25T02:17:21.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.268+0000 7f2d8bbed640 1 -- 172.21.15.79:0/4065706730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d8406dee0 msgr2=0x7f2d8414f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.268+0000 7f2d8bbed640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d8406dee0 0x7f2d8414f000 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00af90 tx=0x7f2d7c004a40 comp rx=0 tx=0).stop 2024-04-25T02:17:21.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.268+0000 7f2d8bbed640 1 -- 172.21.15.79:0/4065706730 shutdown_connections 2024-04-25T02:17:21.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.268+0000 7f2d8bbed640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2d6806be30 0x7f2d6806e2f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.268+0000 7f2d8bbed640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d8406dee0 0x7f2d8414f000 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.268+0000 7f2d8bbed640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d8415a810 0x7f2d840cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.268+0000 7f2d8bbed640 1 --2- 172.21.15.79:0/4065706730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d8409dcb0 0x7f2d841f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.268+0000 7f2d8bbed640 1 -- 172.21.15.79:0/4065706730 >> 172.21.15.79:0/4065706730 conn(0x7f2d840b1cd0 msgr2=0x7f2d840cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:21.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.268+0000 7f2d8bbed640 1 -- 172.21.15.79:0/4065706730 shutdown_connections 2024-04-25T02:17:21.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.268+0000 7f2d8bbed640 1 -- 172.21.15.79:0/4065706730 wait complete. 2024-04-25T02:17:21.284 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:17:21.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.380+0000 7f85cab09640 1 Processor -- start 2024-04-25T02:17:21.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.380+0000 7f85cab09640 1 -- start start 2024-04-25T02:17:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85cab09640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85c40b41b0 0x7f85c41605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85cab09640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f85c406b2f0 0x7f85c406b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85cab09640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85c4071cd0 con 0x7f85c4155f00 2024-04-25T02:17:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85cab09640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f85c4071fb0 con 0x7f85c406b2f0 2024-04-25T02:17:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85cab09640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f85c4072290 con 0x7f85c40b41b0 2024-04-25T02:17:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85c90a6640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f85c4155f00 0x7f85c4156370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54500/0 (socket says 172.21.15.79:54500) 2024-04-25T02:17:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85c90a6640 1 -- 172.21.15.79:0/1061304866 learned_addr learned my addr 172.21.15.79:0/1061304866 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 -- 172.21.15.79:0/1061304866 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1634987037 0 0) 0x7f85c4071cd0 con 0x7f85c4155f00 2024-04-25T02:17:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 -- 172.21.15.79:0/1061304866 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85ac003520 con 0x7f85c4155f00 2024-04-25T02:17:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85c88a5640 1 --2- 172.21.15.79:0/1061304866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85c40b41b0 0x7f85c41605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bbfff640 1 --2- 172.21.15.79:0/1061304866 >> v2:172.21.15.189:3300/0 conn(0x7f85c406b2f0 0x7f85c406b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 -- 172.21.15.79:0/1061304866 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 700194952 0 0) 0x7f85ac003520 con 0x7f85c4155f00 2024-04-25T02:17:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 -- 172.21.15.79:0/1061304866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85c40b41b0 msgr2=0x7f85c41605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 --2- 172.21.15.79:0/1061304866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85c40b41b0 0x7f85c41605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 -- 172.21.15.79:0/1061304866 >> v2:172.21.15.189:3300/0 conn(0x7f85c406b2f0 msgr2=0x7f85c406b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 --2- 172.21.15.79:0/1061304866 >> v2:172.21.15.189:3300/0 conn(0x7f85c406b2f0 0x7f85c406b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 -- 172.21.15.79:0/1061304866 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c4072570 con 0x7f85c4155f00 2024-04-25T02:17:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 -- 172.21.15.79:0/1061304866 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f85bc0019f0 con 0x7f85c4155f00 2024-04-25T02:17:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 -- 172.21.15.79:0/1061304866 >> v1:172.21.15.79:6789/0 conn(0x7f85c4155f00 legacy=0x7f85c4156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 --2- 172.21.15.79:0/1061304866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85c40b41b0 0x7f85ac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 --2- 172.21.15.79:0/1061304866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85ac003fe0 0x7f85ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 --2- 172.21.15.79:0/1061304866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85ac004d40 0x7f85ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 -- 172.21.15.79:0/1061304866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f85c4071fb0 con 0x7f85ac004d40 2024-04-25T02:17:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 -- 172.21.15.79:0/1061304866 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f85c4072290 con 0x7f85ac003fe0 2024-04-25T02:17:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85bb7fe640 1 -- 172.21.15.79:0/1061304866 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f85ac00bac0 con 0x7f85c40b41b0 2024-04-25T02:17:21.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.381+0000 7f85c90a6640 1 --2- 172.21.15.79:0/1061304866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85ac004d40 0x7f85ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.382+0000 7f85c88a5640 1 --2- 172.21.15.79:0/1061304866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85c40b41b0 0x7f85ac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.382+0000 7f85bbfff640 1 --2- 172.21.15.79:0/1061304866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85ac003fe0 0x7f85ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.382+0000 7f85c90a6640 1 -- 172.21.15.79:0/1061304866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85c40b41b0 msgr2=0x7f85ac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:21.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.382+0000 7f85c90a6640 1 --2- 172.21.15.79:0/1061304866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85c40b41b0 0x7f85ac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.382+0000 7f85c90a6640 1 -- 172.21.15.79:0/1061304866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85ac003fe0 msgr2=0x7f85ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:21.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.382+0000 7f85c90a6640 1 --2- 172.21.15.79:0/1061304866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85ac003fe0 0x7f85ac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.382+0000 7f85c90a6640 1 -- 172.21.15.79:0/1061304866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac003520 con 0x7f85ac004d40 2024-04-25T02:17:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.382+0000 7f85bbfff640 1 --2- 172.21.15.79:0/1061304866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85ac003fe0 0x7f85ac004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.382+0000 7f85c88a5640 1 --2- 172.21.15.79:0/1061304866 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85c40b41b0 0x7f85ac0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.382+0000 7f85c90a6640 1 --2- 172.21.15.79:0/1061304866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85ac004d40 0x7f85ac0051c0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00a880 tx=0x7f85ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e78346b51c1368 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.382+0000 7f85bb7fe640 1 -- 172.21.15.79:0/1061304866 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc00a4a0 con 0x7f85ac004d40 2024-04-25T02:17:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.382+0000 7f85bb7fe640 1 -- 172.21.15.79:0/1061304866 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc02f070 con 0x7f85ac004d40 2024-04-25T02:17:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.382+0000 7f85bb7fe640 1 -- 172.21.15.79:0/1061304866 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc02bd00 con 0x7f85ac004d40 2024-04-25T02:17:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.383+0000 7f85cab09640 1 -- 172.21.15.79:0/1061304866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85ac004d40 msgr2=0x7f85ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.383+0000 7f85cab09640 1 --2- 172.21.15.79:0/1061304866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85ac004d40 0x7f85ac0051c0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00a880 tx=0x7f85ac005830 comp rx=0 tx=0).stop 2024-04-25T02:17:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.383+0000 7f85c90a6640 1 -- 172.21.15.79:0/1061304866 reap_dead start 2024-04-25T02:17:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.383+0000 7f85cab09640 1 -- 172.21.15.79:0/1061304866 shutdown_connections 2024-04-25T02:17:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.383+0000 7f85cab09640 1 -- 172.21.15.79:0/1061304866 >> 172.21.15.79:0/1061304866 conn(0x7f85c40b1cd0 msgr2=0x7f85c40b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.383+0000 7f85cab09640 1 -- 172.21.15.79:0/1061304866 shutdown_connections 2024-04-25T02:17:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.383+0000 7f85cab09640 1 -- 172.21.15.79:0/1061304866 wait complete. 2024-04-25T02:17:21.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.384+0000 7f85cab09640 1 Processor -- start 2024-04-25T02:17:21.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.384+0000 7f85cab09640 1 -- start start 2024-04-25T02:17:21.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.385+0000 7f85cab09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c41f3cc0 0x7f85c4153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.385+0000 7f85cab09640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85c41f40a0 0x7f85c40cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.385+0000 7f85cab09640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85c4156ce0 0x7f85c40cf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.385+0000 7f85cab09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f85c415c870 con 0x7f85c41f3cc0 2024-04-25T02:17:21.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.385+0000 7f85cab09640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f85c4072d70 con 0x7f85c4156ce0 2024-04-25T02:17:21.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.385+0000 7f85cab09640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f85c40b4590 con 0x7f85c41f40a0 2024-04-25T02:17:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.385+0000 7f85c88a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c41f3cc0 0x7f85c4153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.385+0000 7f85c88a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c41f3cc0 0x7f85c4153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42274/0 (socket says 172.21.15.79:42274) 2024-04-25T02:17:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.385+0000 7f85c88a5640 1 -- 172.21.15.79:0/4196764168 learned_addr learned my addr 172.21.15.79:0/4196764168 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.385+0000 7f85c90a6640 1 --2- 172.21.15.79:0/4196764168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85c4156ce0 0x7f85c40cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.385+0000 7f85c88a5640 1 -- 172.21.15.79:0/4196764168 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85c41f40a0 msgr2=0x7f85c40cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.385+0000 7f85c88a5640 1 --2- 172.21.15.79:0/4196764168 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85c41f40a0 0x7f85c40cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.385+0000 7f85c88a5640 1 -- 172.21.15.79:0/4196764168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85c4156ce0 msgr2=0x7f85c40cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.385+0000 7f85c88a5640 1 --2- 172.21.15.79:0/4196764168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85c4156ce0 0x7f85c40cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.385+0000 7f85c88a5640 1 -- 172.21.15.79:0/4196764168 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c406ce50 con 0x7f85c41f3cc0 2024-04-25T02:17:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.386+0000 7f85c88a5640 1 --2- 172.21.15.79:0/4196764168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c41f3cc0 0x7f85c4153470 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f85c000e810 tx=0x7f85c000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.386+0000 7f85b97fa640 1 -- 172.21.15.79:0/4196764168 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c0017070 con 0x7f85c41f3cc0 2024-04-25T02:17:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.386+0000 7f85b97fa640 1 -- 172.21.15.79:0/4196764168 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85c000c6d0 con 0x7f85c41f3cc0 2024-04-25T02:17:21.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.386+0000 7f85b97fa640 1 -- 172.21.15.79:0/4196764168 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c000f040 con 0x7f85c41f3cc0 2024-04-25T02:17:21.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.386+0000 7f85cab09640 1 -- 172.21.15.79:0/4196764168 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c406d130 con 0x7f85c41f3cc0 2024-04-25T02:17:21.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.386+0000 7f85cab09640 1 -- 172.21.15.79:0/4196764168 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c406d6f0 con 0x7f85c41f3cc0 2024-04-25T02:17:21.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.387+0000 7f85cab09640 1 -- 172.21.15.79:0/4196764168 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c40690a0 con 0x7f85c41f3cc0 2024-04-25T02:17:21.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.387+0000 7f85b97fa640 1 -- 172.21.15.79:0/4196764168 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85c001a070 con 0x7f85c41f3cc0 2024-04-25T02:17:21.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.388+0000 7f85b97fa640 1 --2- 172.21.15.79:0/4196764168 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85b006be60 0x7f85b006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.388+0000 7f85bbfff640 1 --2- 172.21.15.79:0/4196764168 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85b006be60 0x7f85b006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.388+0000 7f85b97fa640 1 -- 172.21.15.79:0/4196764168 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x7f85c008ab20 con 0x7f85c41f3cc0 2024-04-25T02:17:21.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.388+0000 7f85bbfff640 1 --2- 172.21.15.79:0/4196764168 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85b006be60 0x7f85b006e320 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f85c41f4480 tx=0x7f85b40093d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:21.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.392+0000 7f85b97fa640 1 -- 172.21.15.79:0/4196764168 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f85c0059420 con 0x7f85c41f3cc0 2024-04-25T02:17:21.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.563+0000 7f85cab09640 1 -- 172.21.15.79:0/4196764168 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f85c40cc460 con 0x7f85c41f3cc0 2024-04-25T02:17:21.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.564+0000 7f85b97fa640 1 -- 172.21.15.79:0/4196764168 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v104) ==== 100+0+11 (secure 0 0 0) 0x7f85c0058d20 con 0x7f85c41f3cc0 2024-04-25T02:17:21.568 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:17:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.566+0000 7f85cab09640 1 -- 172.21.15.79:0/4196764168 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85b006be60 msgr2=0x7f85b006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.566+0000 7f85cab09640 1 --2- 172.21.15.79:0/4196764168 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85b006be60 0x7f85b006e320 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f85c41f4480 tx=0x7f85b40093d0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.566+0000 7f85cab09640 1 -- 172.21.15.79:0/4196764168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c41f3cc0 msgr2=0x7f85c4153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.566+0000 7f85cab09640 1 --2- 172.21.15.79:0/4196764168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c41f3cc0 0x7f85c4153470 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f85c000e810 tx=0x7f85c000ecd0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.566+0000 7f85cab09640 1 -- 172.21.15.79:0/4196764168 shutdown_connections 2024-04-25T02:17:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.566+0000 7f85cab09640 1 --2- 172.21.15.79:0/4196764168 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85b006be60 0x7f85b006e320 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.566+0000 7f85cab09640 1 --2- 172.21.15.79:0/4196764168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85c4156ce0 0x7f85c40cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.566+0000 7f85cab09640 1 --2- 172.21.15.79:0/4196764168 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85c41f40a0 0x7f85c40cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.566+0000 7f85cab09640 1 --2- 172.21.15.79:0/4196764168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c41f3cc0 0x7f85c4153470 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.566+0000 7f85cab09640 1 -- 172.21.15.79:0/4196764168 >> 172.21.15.79:0/4196764168 conn(0x7f85c40b1cd0 msgr2=0x7f85c4155540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.566+0000 7f85cab09640 1 -- 172.21.15.79:0/4196764168 shutdown_connections 2024-04-25T02:17:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.566+0000 7f85cab09640 1 -- 172.21.15.79:0/4196764168 wait complete. 2024-04-25T02:17:21.583 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:17:21.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.674+0000 7fd3b03a5640 1 Processor -- start 2024-04-25T02:17:21.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.674+0000 7fd3b03a5640 1 -- start start 2024-04-25T02:17:21.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.675+0000 7fd3b03a5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd3a80b3570 0x7fd3a80d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.675+0000 7fd3b03a5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd3a80b3020 0x7fd3a80d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.675+0000 7fd3b03a5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3a806c380 con 0x7fd3a815e4d0 2024-04-25T02:17:21.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.675+0000 7fd3b03a5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd3a80d1660 con 0x7fd3a80b3570 2024-04-25T02:17:21.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.675+0000 7fd3b03a5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd3a80d1380 con 0x7fd3a80b3020 2024-04-25T02:17:21.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.675+0000 7fd3ad940640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd3a80b3570 0x7fd3a80d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.675+0000 7fd3ad940640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd3a80b3570 0x7fd3a80d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42286/0 (socket says 172.21.15.79:42286) 2024-04-25T02:17:21.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.675+0000 7fd3ad940640 1 -- 172.21.15.79:0/826227528 learned_addr learned my addr 172.21.15.79:0/826227528 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:21.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.676+0000 7fd3ae942640 1 --2- 172.21.15.79:0/826227528 >> v2:172.21.15.189:3300/0 conn(0x7fd3a80b3020 0x7fd3a80d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.676+0000 7fd3ad940640 1 -- 172.21.15.79:0/826227528 >> v2:172.21.15.189:3300/0 conn(0x7fd3a80b3020 msgr2=0x7fd3a80d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:21.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.676+0000 7fd3ad940640 1 --2- 172.21.15.79:0/826227528 >> v2:172.21.15.189:3300/0 conn(0x7fd3a80b3020 0x7fd3a80d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.676+0000 7fd3ad940640 1 -- 172.21.15.79:0/826227528 >> v1:172.21.15.189:6789/0 conn(0x7fd3a815e4d0 legacy=0x7fd3a806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:21.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.676+0000 7fd3ad940640 1 -- 172.21.15.79:0/826227528 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a80cede0 con 0x7fd3a80b3570 2024-04-25T02:17:21.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.676+0000 7fd3ae942640 1 --2- 172.21.15.79:0/826227528 >> v2:172.21.15.189:3300/0 conn(0x7fd3a80b3020 0x7fd3a80d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.676+0000 7fd3ad940640 1 --2- 172.21.15.79:0/826227528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80b3570 0x7fd3a80d2710 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fd398009870 tx=0x7fd39802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77edcbc75a05c16e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.677+0000 7fd3ad13f640 1 -- 172.21.15.79:0/826227528 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398037070 con 0x7fd3a80b3570 2024-04-25T02:17:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.677+0000 7fd3ad13f640 1 -- 172.21.15.79:0/826227528 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd398032440 con 0x7fd3a80b3570 2024-04-25T02:17:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.677+0000 7fd3ad13f640 1 -- 172.21.15.79:0/826227528 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398032810 con 0x7fd3a80b3570 2024-04-25T02:17:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.677+0000 7fd3b03a5640 1 -- 172.21.15.79:0/826227528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80b3570 msgr2=0x7fd3a80d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.677+0000 7fd3b03a5640 1 --2- 172.21.15.79:0/826227528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80b3570 0x7fd3a80d2710 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fd398009870 tx=0x7fd39802a250 comp rx=0 tx=0).stop 2024-04-25T02:17:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.677+0000 7fd3b03a5640 1 -- 172.21.15.79:0/826227528 shutdown_connections 2024-04-25T02:17:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.677+0000 7fd3b03a5640 1 --2- 172.21.15.79:0/826227528 >> v2:172.21.15.189:3300/0 conn(0x7fd3a80b3020 0x7fd3a80d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.677+0000 7fd3b03a5640 1 --2- 172.21.15.79:0/826227528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80b3570 0x7fd3a80d2710 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.677+0000 7fd3b03a5640 1 -- 172.21.15.79:0/826227528 >> 172.21.15.79:0/826227528 conn(0x7fd3a809d460 msgr2=0x7fd3a80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.677+0000 7fd3b03a5640 1 -- 172.21.15.79:0/826227528 shutdown_connections 2024-04-25T02:17:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.677+0000 7fd3b03a5640 1 -- 172.21.15.79:0/826227528 wait complete. 2024-04-25T02:17:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.678+0000 7fd3b03a5640 1 Processor -- start 2024-04-25T02:17:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.678+0000 7fd3b03a5640 1 -- start start 2024-04-25T02:17:21.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.679+0000 7fd3b03a5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd3a80b3020 0x7fd3a80b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.679+0000 7fd3b03a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80b3570 0x7fd3a80caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.679+0000 7fd3b03a5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3a815e4d0 0x7fd3a815b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.679+0000 7fd3b03a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a80d20d0 con 0x7fd3a80b3570 2024-04-25T02:17:21.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.679+0000 7fd3b03a5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a815e8b0 con 0x7fd3a815e4d0 2024-04-25T02:17:21.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.679+0000 7fd3b03a5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a80d2250 con 0x7fd3a80b3020 2024-04-25T02:17:21.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.679+0000 7fd3ad940640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80b3570 0x7fd3a80caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.679+0000 7fd3ad940640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80b3570 0x7fd3a80caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42302/0 (socket says 172.21.15.79:42302) 2024-04-25T02:17:21.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.679+0000 7fd3ad940640 1 -- 172.21.15.79:0/2660245458 learned_addr learned my addr 172.21.15.79:0/2660245458 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:21.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.679+0000 7fd3ad940640 1 -- 172.21.15.79:0/2660245458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd3a80b3020 msgr2=0x7fd3a80b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.679+0000 7fd3ad940640 1 --2- 172.21.15.79:0/2660245458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd3a80b3020 0x7fd3a80b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.679+0000 7fd3ad940640 1 -- 172.21.15.79:0/2660245458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3a815e4d0 msgr2=0x7fd3a815b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.679+0000 7fd3ad940640 1 --2- 172.21.15.79:0/2660245458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3a815e4d0 0x7fd3a815b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.679+0000 7fd3ad940640 1 -- 172.21.15.79:0/2660245458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a815bb30 con 0x7fd3a80b3570 2024-04-25T02:17:21.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.680+0000 7fd3ad940640 1 --2- 172.21.15.79:0/2660245458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80b3570 0x7fd3a80caaf0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fd398000c00 tx=0x7fd3980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:21.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.680+0000 7fd39effd640 1 -- 172.21.15.79:0/2660245458 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398037040 con 0x7fd3a80b3570 2024-04-25T02:17:21.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.680+0000 7fd39effd640 1 -- 172.21.15.79:0/2660245458 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd398004250 con 0x7fd3a80b3570 2024-04-25T02:17:21.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.680+0000 7fd3b03a5640 1 -- 172.21.15.79:0/2660245458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a80b6920 con 0x7fd3a80b3570 2024-04-25T02:17:21.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.680+0000 7fd39effd640 1 -- 172.21.15.79:0/2660245458 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398030770 con 0x7fd3a80b3570 2024-04-25T02:17:21.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.680+0000 7fd3b03a5640 1 -- 172.21.15.79:0/2660245458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a815a850 con 0x7fd3a80b3570 2024-04-25T02:17:21.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.681+0000 7fd3b03a5640 1 -- 172.21.15.79:0/2660245458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a80690a0 con 0x7fd3a80b3570 2024-04-25T02:17:21.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.681+0000 7fd39effd640 1 -- 172.21.15.79:0/2660245458 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd398030910 con 0x7fd3a80b3570 2024-04-25T02:17:21.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.681+0000 7fd39effd640 1 --2- 172.21.15.79:0/2660245458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd38c06be30 0x7fd38c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:21.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.682+0000 7fd39effd640 1 -- 172.21.15.79:0/2660245458 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x7fd3980abdb0 con 0x7fd3a80b3570 2024-04-25T02:17:21.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.682+0000 7fd3ae141640 1 --2- 172.21.15.79:0/2660245458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd38c06be30 0x7fd38c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:21.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.682+0000 7fd3ae141640 1 --2- 172.21.15.79:0/2660245458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd38c06be30 0x7fd38c06e2f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4006fd0 tx=0x7fd3a4006bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:21.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.686+0000 7fd39effd640 1 -- 172.21.15.79:0/2660245458 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd398045e50 con 0x7fd3a80b3570 2024-04-25T02:17:21.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.895+0000 7fd3b03a5640 1 -- 172.21.15.79:0/2660245458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3a80d1920 con 0x7fd3a80b3570 2024-04-25T02:17:21.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.895+0000 7fd39effd640 1 -- 172.21.15.79:0/2660245458 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5176 (secure 0 0 0) 0x7fd39807a740 con 0x7fd3a80b3570 2024-04-25T02:17:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:21.900 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":76,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1086166830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1086166830},{"type":"v1","addr":"172.21.15.189:6834","nonce":1086166830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2468340230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2468340230},{"type":"v1","addr":"172.21.15.189:6835","nonce":2468340230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3582530322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3582530322},{"type":"v1","addr":"172.21.15.79:6836","nonce":3582530322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8763,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2101809080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2101809080},{"type":"v1","addr":"172.21.15.79:6837","nonce":2101809080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":75,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:15:58.363457+0000","modified":"2024-04-25T02:17:19.739878+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-25T02:17:21.901 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 76 2024-04-25T02:17:21.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.897+0000 7fd3b03a5640 1 -- 172.21.15.79:0/2660245458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd38c06be30 msgr2=0x7fd38c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.897+0000 7fd3b03a5640 1 --2- 172.21.15.79:0/2660245458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd38c06be30 0x7fd38c06e2f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4006fd0 tx=0x7fd3a4006bc0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.897+0000 7fd3b03a5640 1 -- 172.21.15.79:0/2660245458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80b3570 msgr2=0x7fd3a80caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:21.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.897+0000 7fd3b03a5640 1 --2- 172.21.15.79:0/2660245458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80b3570 0x7fd3a80caaf0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fd398000c00 tx=0x7fd3980046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.897+0000 7fd3b03a5640 1 -- 172.21.15.79:0/2660245458 shutdown_connections 2024-04-25T02:17:21.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.897+0000 7fd3b03a5640 1 --2- 172.21.15.79:0/2660245458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd38c06be30 0x7fd38c06e2f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.897+0000 7fd3b03a5640 1 --2- 172.21.15.79:0/2660245458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3a815e4d0 0x7fd3a815b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.897+0000 7fd3b03a5640 1 --2- 172.21.15.79:0/2660245458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80b3570 0x7fd3a80caaf0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.897+0000 7fd3b03a5640 1 --2- 172.21.15.79:0/2660245458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd3a80b3020 0x7fd3a80b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:21.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.897+0000 7fd3b03a5640 1 -- 172.21.15.79:0/2660245458 >> 172.21.15.79:0/2660245458 conn(0x7fd3a809d460 msgr2=0x7fd3a815d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:21.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.898+0000 7fd3b03a5640 1 -- 172.21.15.79:0/2660245458 shutdown_connections 2024-04-25T02:17:21.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:21.898+0000 7fd3b03a5640 1 -- 172.21.15.79:0/2660245458 wait complete. 2024-04-25T02:17:21.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:17:22.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.005+0000 7fafbc71b640 1 Processor -- start 2024-04-25T02:17:22.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.005+0000 7fafbc71b640 1 -- start start 2024-04-25T02:17:22.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.006+0000 7fafbc71b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fafb415e4d0 0x7fafb406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.006+0000 7fafbc71b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fafb40d2e20 0x7fafb40cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.006+0000 7fafbc71b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb40d1660 con 0x7fafb40b3570 2024-04-25T02:17:22.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.006+0000 7fafbc71b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fafb40d1380 con 0x7fafb415e4d0 2024-04-25T02:17:22.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.006+0000 7fafbc71b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fafb40cede0 con 0x7fafb40d2e20 2024-04-25T02:17:22.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.006+0000 7fafba4b7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fafb415e4d0 0x7fafb406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.007+0000 7fafba4b7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fafb415e4d0 0x7fafb406bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42304/0 (socket says 172.21.15.79:42304) 2024-04-25T02:17:22.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.007+0000 7fafba4b7640 1 -- 172.21.15.79:0/1351288185 learned_addr learned my addr 172.21.15.79:0/1351288185 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:22.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.007+0000 7fafbacb8640 1 --2- 172.21.15.79:0/1351288185 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fafb40d2e20 0x7fafb40cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.007+0000 7fafba4b7640 1 -- 172.21.15.79:0/1351288185 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fafb40d2e20 msgr2=0x7fafb40cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:22.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.007+0000 7fafba4b7640 1 --2- 172.21.15.79:0/1351288185 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fafb40d2e20 0x7fafb40cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.007+0000 7fafba4b7640 1 -- 172.21.15.79:0/1351288185 >> v1:172.21.15.189:6789/0 conn(0x7fafb40b3570 legacy=0x7fafb40d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.007+0000 7fafba4b7640 1 -- 172.21.15.79:0/1351288185 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb40cf0c0 con 0x7fafb415e4d0 2024-04-25T02:17:22.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.007+0000 7fafba4b7640 1 --2- 172.21.15.79:0/1351288185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb415e4d0 0x7fafb406bc70 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fafb00098a0 tx=0x7fafb002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6da745404af549f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:22.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.008+0000 7fafb94b5640 1 -- 172.21.15.79:0/1351288185 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0037070 con 0x7fafb415e4d0 2024-04-25T02:17:22.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.008+0000 7fafb94b5640 1 -- 172.21.15.79:0/1351288185 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0032440 con 0x7fafb415e4d0 2024-04-25T02:17:22.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.008+0000 7fafb94b5640 1 -- 172.21.15.79:0/1351288185 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0032810 con 0x7fafb415e4d0 2024-04-25T02:17:22.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.008+0000 7fafbc71b640 1 -- 172.21.15.79:0/1351288185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb415e4d0 msgr2=0x7fafb406bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.008+0000 7fafbc71b640 1 --2- 172.21.15.79:0/1351288185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb415e4d0 0x7fafb406bc70 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fafb00098a0 tx=0x7fafb002a290 comp rx=0 tx=0).stop 2024-04-25T02:17:22.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.008+0000 7fafbc71b640 1 -- 172.21.15.79:0/1351288185 shutdown_connections 2024-04-25T02:17:22.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.008+0000 7fafbc71b640 1 --2- 172.21.15.79:0/1351288185 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fafb40d2e20 0x7fafb40cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.008+0000 7fafbc71b640 1 --2- 172.21.15.79:0/1351288185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb415e4d0 0x7fafb406bc70 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.008+0000 7fafbc71b640 1 -- 172.21.15.79:0/1351288185 >> 172.21.15.79:0/1351288185 conn(0x7fafb409d460 msgr2=0x7fafb40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:22.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.008+0000 7fafbc71b640 1 -- 172.21.15.79:0/1351288185 shutdown_connections 2024-04-25T02:17:22.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.008+0000 7fafbc71b640 1 -- 172.21.15.79:0/1351288185 wait complete. 2024-04-25T02:17:22.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.009+0000 7fafbc71b640 1 Processor -- start 2024-04-25T02:17:22.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.009+0000 7fafbc71b640 1 -- start start 2024-04-25T02:17:22.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.010+0000 7fafbc71b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fafb40b3570 0x7fafb4160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.010+0000 7fafbc71b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fafb40d2e20 0x7fafb414f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.010+0000 7fafbc71b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb415e4d0 0x7fafb40b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.010+0000 7fafbc71b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fafb40d2250 con 0x7fafb415e4d0 2024-04-25T02:17:22.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.010+0000 7fafbc71b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fafb40d20d0 con 0x7fafb40d2e20 2024-04-25T02:17:22.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.010+0000 7fafbc71b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fafb406c1b0 con 0x7fafb40b3570 2024-04-25T02:17:22.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.010+0000 7fafbacb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb415e4d0 0x7fafb40b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.010+0000 7fafbacb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb415e4d0 0x7fafb40b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42310/0 (socket says 172.21.15.79:42310) 2024-04-25T02:17:22.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.010+0000 7fafbacb8640 1 -- 172.21.15.79:0/2396654920 learned_addr learned my addr 172.21.15.79:0/2396654920 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:22.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.010+0000 7fafbacb8640 1 -- 172.21.15.79:0/2396654920 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fafb40b3570 msgr2=0x7fafb4160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.010+0000 7fafbacb8640 1 --2- 172.21.15.79:0/2396654920 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fafb40b3570 0x7fafb4160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.010+0000 7fafbacb8640 1 -- 172.21.15.79:0/2396654920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fafb40d2e20 msgr2=0x7fafb414f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.010+0000 7fafb9cb6640 1 --2- 172.21.15.79:0/2396654920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fafb40d2e20 0x7fafb414f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.011+0000 7fafbacb8640 1 --2- 172.21.15.79:0/2396654920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fafb40d2e20 0x7fafb414f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.011+0000 7fafbacb8640 1 -- 172.21.15.79:0/2396654920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb40b3f30 con 0x7fafb415e4d0 2024-04-25T02:17:22.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.011+0000 7fafbacb8640 1 --2- 172.21.15.79:0/2396654920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb415e4d0 0x7fafb40b4720 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fafac007e60 tx=0x7fafac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:22.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.011+0000 7fafaaffd640 1 -- 172.21.15.79:0/2396654920 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac014620 con 0x7fafb415e4d0 2024-04-25T02:17:22.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.011+0000 7fafaaffd640 1 -- 172.21.15.79:0/2396654920 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafac019070 con 0x7fafb415e4d0 2024-04-25T02:17:22.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.011+0000 7fafbc71b640 1 -- 172.21.15.79:0/2396654920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb40cbcb0 con 0x7fafb415e4d0 2024-04-25T02:17:22.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.011+0000 7fafaaffd640 1 -- 172.21.15.79:0/2396654920 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac014a20 con 0x7fafb415e4d0 2024-04-25T02:17:22.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.011+0000 7fafbc71b640 1 -- 172.21.15.79:0/2396654920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb40cc270 con 0x7fafb415e4d0 2024-04-25T02:17:22.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.012+0000 7fafbc71b640 1 -- 172.21.15.79:0/2396654920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb409d840 con 0x7fafb415e4d0 2024-04-25T02:17:22.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.012+0000 7fafaaffd640 1 -- 172.21.15.79:0/2396654920 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fafac014bc0 con 0x7fafb415e4d0 2024-04-25T02:17:22.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.013+0000 7fafaaffd640 1 --2- 172.21.15.79:0/2396654920 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf9806be30 0x7faf9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.013+0000 7fafba4b7640 1 --2- 172.21.15.79:0/2396654920 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf9806be30 0x7faf9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.013+0000 7fafaaffd640 1 -- 172.21.15.79:0/2396654920 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x7fafac08b750 con 0x7fafb415e4d0 2024-04-25T02:17:22.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.013+0000 7fafba4b7640 1 --2- 172.21.15.79:0/2396654920 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf9806be30 0x7faf9806e2f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fafb0034000 tx=0x7fafb002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:22.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.017+0000 7fafaaffd640 1 -- 172.21.15.79:0/2396654920 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fafb409d840 con 0x7fafb415e4d0 2024-04-25T02:17:22.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.193+0000 7fafbc71b640 1 -- 172.21.15.79:0/2396654920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fafb40d1920 con 0x7fafb415e4d0 2024-04-25T02:17:22.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.194+0000 7fafaaffd640 1 -- 172.21.15.79:0/2396654920 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16890 (secure 0 0 0) 0x7fafac059a00 con 0x7fafb415e4d0 2024-04-25T02:17:22.199 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:22.199 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":104,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:17:19.739710+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:15:56.581482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T02:15:57.334060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/2550458851":"2024-04-26T02:17:19.739687+0000","172.21.15.79:6834/2550458851":"2024-04-26T02:17:19.739687+0000","172.21.15.79:6837/2774759267":"2024-04-26T02:16:43.461186+0000","172.21.15.79:6834/2774759267":"2024-04-26T02:16:43.461186+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:17:22.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.196+0000 7fafbc71b640 1 -- 172.21.15.79:0/2396654920 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf9806be30 msgr2=0x7faf9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.196+0000 7fafbc71b640 1 --2- 172.21.15.79:0/2396654920 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf9806be30 0x7faf9806e2f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fafb0034000 tx=0x7fafb002c000 comp rx=0 tx=0).stop 2024-04-25T02:17:22.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.196+0000 7fafbc71b640 1 -- 172.21.15.79:0/2396654920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb415e4d0 msgr2=0x7fafb40b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.196+0000 7fafbc71b640 1 --2- 172.21.15.79:0/2396654920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb415e4d0 0x7fafb40b4720 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fafac007e60 tx=0x7fafac00e4b0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.196+0000 7fafbc71b640 1 -- 172.21.15.79:0/2396654920 shutdown_connections 2024-04-25T02:17:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.196+0000 7fafbc71b640 1 --2- 172.21.15.79:0/2396654920 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf9806be30 0x7faf9806e2f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.196+0000 7fafbc71b640 1 --2- 172.21.15.79:0/2396654920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb415e4d0 0x7fafb40b4720 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.196+0000 7fafbc71b640 1 --2- 172.21.15.79:0/2396654920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fafb40d2e20 0x7fafb414f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.196+0000 7fafbc71b640 1 --2- 172.21.15.79:0/2396654920 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fafb40b3570 0x7fafb4160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.196+0000 7fafbc71b640 1 -- 172.21.15.79:0/2396654920 >> 172.21.15.79:0/2396654920 conn(0x7fafb409d460 msgr2=0x7fafb40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.196+0000 7fafbc71b640 1 -- 172.21.15.79:0/2396654920 shutdown_connections 2024-04-25T02:17:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.196+0000 7fafbc71b640 1 -- 172.21.15.79:0/2396654920 wait complete. 2024-04-25T02:17:22.212 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:17:22.212 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:17:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.304+0000 7f4385977640 1 Processor -- start 2024-04-25T02:17:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.304+0000 7f4385977640 1 -- start start 2024-04-25T02:17:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.305+0000 7f4385977640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800d4740 0x7f43800cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.305+0000 7f4385977640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f43800cf5d0 0x7f43800b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.305+0000 7f4385977640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43800cfdc0 con 0x7f438015e440 2024-04-25T02:17:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.305+0000 7f4385977640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f43800d00a0 con 0x7f43800cf5d0 2024-04-25T02:17:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.305+0000 7f4385977640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f43800d0380 con 0x7f43800d4740 2024-04-25T02:17:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.305+0000 7f437f7fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f43800cf5d0 0x7f43800b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.305+0000 7f437e7fc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800d4740 0x7f43800cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.305+0000 7f437effd640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f438015e440 0x7f43800d4030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:50256/0 (socket says 172.21.15.79:50256) 2024-04-25T02:17:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.305+0000 7f437f7fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f43800cf5d0 0x7f43800b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:58556/0 (socket says 172.21.15.79:58556) 2024-04-25T02:17:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.305+0000 7f437effd640 1 -- 172.21.15.79:0/1544259175 learned_addr learned my addr 172.21.15.79:0/1544259175 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.306+0000 7f437f7fe640 1 -- 172.21.15.79:0/1544259175 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800d4740 msgr2=0x7f43800cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.306+0000 7f437f7fe640 1 --2- 172.21.15.79:0/1544259175 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800d4740 0x7f43800cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.306+0000 7f437f7fe640 1 -- 172.21.15.79:0/1544259175 >> v1:172.21.15.189:6789/0 conn(0x7f438015e440 legacy=0x7f43800d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.306+0000 7f437f7fe640 1 -- 172.21.15.79:0/1544259175 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43800d0660 con 0x7f43800cf5d0 2024-04-25T02:17:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.306+0000 7f437e7fc640 1 --2- 172.21.15.79:0/1544259175 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800d4740 0x7f43800cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:17:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.306+0000 7f437f7fe640 1 --2- 172.21.15.79:0/1544259175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43800cf5d0 0x7f43800b3940 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4378009d90 tx=0x7f437802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3542a3b1ff082162 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.306+0000 7f437dffb640 1 -- 172.21.15.79:0/1544259175 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378007740 con 0x7f43800cf5d0 2024-04-25T02:17:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.306+0000 7f437dffb640 1 -- 172.21.15.79:0/1544259175 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43780078e0 con 0x7f43800cf5d0 2024-04-25T02:17:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.306+0000 7f437dffb640 1 -- 172.21.15.79:0/1544259175 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378007cb0 con 0x7f43800cf5d0 2024-04-25T02:17:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.307+0000 7f4385977640 1 -- 172.21.15.79:0/1544259175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43800cf5d0 msgr2=0x7f43800b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.307+0000 7f4385977640 1 --2- 172.21.15.79:0/1544259175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43800cf5d0 0x7f43800b3940 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4378009d90 tx=0x7f437802a660 comp rx=0 tx=0).stop 2024-04-25T02:17:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.307+0000 7f4385977640 1 -- 172.21.15.79:0/1544259175 shutdown_connections 2024-04-25T02:17:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.307+0000 7f4385977640 1 --2- 172.21.15.79:0/1544259175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43800cf5d0 0x7f43800b3940 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.307+0000 7f4385977640 1 --2- 172.21.15.79:0/1544259175 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800d4740 0x7f43800cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.307+0000 7f4385977640 1 -- 172.21.15.79:0/1544259175 >> 172.21.15.79:0/1544259175 conn(0x7f438008db50 msgr2=0x7f438009d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.307+0000 7f4385977640 1 -- 172.21.15.79:0/1544259175 shutdown_connections 2024-04-25T02:17:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.307+0000 7f4385977640 1 -- 172.21.15.79:0/1544259175 wait complete. 2024-04-25T02:17:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.308+0000 7f4385977640 1 Processor -- start 2024-04-25T02:17:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.308+0000 7f4385977640 1 -- start start 2024-04-25T02:17:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f4385977640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43800cf5d0 0x7f438014db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f4385977640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800d4740 0x7f43800cd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f4385977640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f438015e440 0x7f43800cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f4385977640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43800b3e80 con 0x7f43800cf5d0 2024-04-25T02:17:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f4385977640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f43800cfa40 con 0x7f438015e440 2024-04-25T02:17:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f4385977640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f43800b4000 con 0x7f43800d4740 2024-04-25T02:17:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f437effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43800cf5d0 0x7f438014db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f437effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43800cf5d0 0x7f438014db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42316/0 (socket says 172.21.15.79:42316) 2024-04-25T02:17:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f437effd640 1 -- 172.21.15.79:0/2505797012 learned_addr learned my addr 172.21.15.79:0/2505797012 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f437e7fc640 1 --2- 172.21.15.79:0/2505797012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800d4740 0x7f43800cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f437effd640 1 -- 172.21.15.79:0/2505797012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800d4740 msgr2=0x7f43800cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f437effd640 1 --2- 172.21.15.79:0/2505797012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800d4740 0x7f43800cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f437effd640 1 -- 172.21.15.79:0/2505797012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f438015e440 msgr2=0x7f43800cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f437effd640 1 --2- 172.21.15.79:0/2505797012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f438015e440 0x7f43800cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f437effd640 1 -- 172.21.15.79:0/2505797012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43800cdb90 con 0x7f43800cf5d0 2024-04-25T02:17:22.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.309+0000 7f437e7fc640 1 --2- 172.21.15.79:0/2505797012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800d4740 0x7f43800cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:22.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.310+0000 7f437effd640 1 --2- 172.21.15.79:0/2505797012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43800cf5d0 0x7f438014db20 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f437000c3c0 tx=0x7f437000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:22.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.310+0000 7f4367fff640 1 -- 172.21.15.79:0/2505797012 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4370017070 con 0x7f43800cf5d0 2024-04-25T02:17:22.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.310+0000 7f4367fff640 1 -- 172.21.15.79:0/2505797012 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4370005ce0 con 0x7f43800cf5d0 2024-04-25T02:17:22.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.310+0000 7f4385977640 1 -- 172.21.15.79:0/2505797012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43800cde70 con 0x7f43800cf5d0 2024-04-25T02:17:22.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.310+0000 7f4367fff640 1 -- 172.21.15.79:0/2505797012 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43700072f0 con 0x7f43800cf5d0 2024-04-25T02:17:22.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.310+0000 7f4385977640 1 -- 172.21.15.79:0/2505797012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43800ce430 con 0x7f43800cf5d0 2024-04-25T02:17:22.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.311+0000 7f4385977640 1 -- 172.21.15.79:0/2505797012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43800c8cb0 con 0x7f43800cf5d0 2024-04-25T02:17:22.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.311+0000 7f4367fff640 1 -- 172.21.15.79:0/2505797012 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f437001a070 con 0x7f43800cf5d0 2024-04-25T02:17:22.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.312+0000 7f4367fff640 1 --2- 172.21.15.79:0/2505797012 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f436c06be30 0x7f436c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.312+0000 7f437e7fc640 1 --2- 172.21.15.79:0/2505797012 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f436c06be30 0x7f436c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.312+0000 7f4367fff640 1 -- 172.21.15.79:0/2505797012 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x7f437008a270 con 0x7f43800cf5d0 2024-04-25T02:17:22.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.312+0000 7f437e7fc640 1 --2- 172.21.15.79:0/2505797012 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f436c06be30 0x7f436c06e2f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f438015f000 tx=0x7f4374008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:22.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.316+0000 7f4367fff640 1 -- 172.21.15.79:0/2505797012 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4370058b70 con 0x7f43800cf5d0 2024-04-25T02:17:22.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.525+0000 7f4385977640 1 -- 172.21.15.79:0/2505797012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43800690a0 con 0x7f43800cf5d0 2024-04-25T02:17:22.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.525+0000 7f4367fff640 1 -- 172.21.15.79:0/2505797012 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5176 (secure 0 0 0) 0x7f4370058470 con 0x7f43800cf5d0 2024-04-25T02:17:22.530 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:22.530 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":76,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1086166830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1086166830},{"type":"v1","addr":"172.21.15.189:6834","nonce":1086166830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2468340230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2468340230},{"type":"v1","addr":"172.21.15.189:6835","nonce":2468340230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3582530322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3582530322},{"type":"v1","addr":"172.21.15.79:6836","nonce":3582530322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8763,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2101809080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2101809080},{"type":"v1","addr":"172.21.15.79:6837","nonce":2101809080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":75,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:15:58.363457+0000","modified":"2024-04-25T02:17:19.739878+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-25T02:17:22.531 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 76 2024-04-25T02:17:22.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.528+0000 7f4385977640 1 -- 172.21.15.79:0/2505797012 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f436c06be30 msgr2=0x7f436c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.528+0000 7f4385977640 1 --2- 172.21.15.79:0/2505797012 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f436c06be30 0x7f436c06e2f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f438015f000 tx=0x7f4374008040 comp rx=0 tx=0).stop 2024-04-25T02:17:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.528+0000 7f4385977640 1 -- 172.21.15.79:0/2505797012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43800cf5d0 msgr2=0x7f438014db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.528+0000 7f4385977640 1 --2- 172.21.15.79:0/2505797012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43800cf5d0 0x7f438014db20 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f437000c3c0 tx=0x7f437000c880 comp rx=0 tx=0).stop 2024-04-25T02:17:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.528+0000 7f4385977640 1 -- 172.21.15.79:0/2505797012 shutdown_connections 2024-04-25T02:17:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.528+0000 7f4385977640 1 --2- 172.21.15.79:0/2505797012 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f436c06be30 0x7f436c06e2f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.528+0000 7f4385977640 1 --2- 172.21.15.79:0/2505797012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f438015e440 0x7f43800cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.528+0000 7f4385977640 1 --2- 172.21.15.79:0/2505797012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43800d4740 0x7f43800cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.528+0000 7f4385977640 1 --2- 172.21.15.79:0/2505797012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43800cf5d0 0x7f438014db20 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.528+0000 7f4385977640 1 -- 172.21.15.79:0/2505797012 >> 172.21.15.79:0/2505797012 conn(0x7f438008db50 msgr2=0x7f43800b4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.528+0000 7f4385977640 1 -- 172.21.15.79:0/2505797012 shutdown_connections 2024-04-25T02:17:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.528+0000 7f4385977640 1 -- 172.21.15.79:0/2505797012 wait complete. 2024-04-25T02:17:22.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:17:22.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.637+0000 7f3885a31640 1 Processor -- start 2024-04-25T02:17:22.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.637+0000 7f3885a31640 1 -- start start 2024-04-25T02:17:22.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.637+0000 7f3885a31640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38800d00d0 0x7f38800d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.637+0000 7f3885a31640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38800b1d20 con 0x7f388006cbd0 2024-04-25T02:17:22.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.637+0000 7f3885a31640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3880162620 con 0x7f388006c3d0 2024-04-25T02:17:22.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.637+0000 7f3885a31640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3880162900 con 0x7f38800d00d0 2024-04-25T02:17:22.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.638+0000 7f387f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38800d00d0 0x7f38800d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.638+0000 7f387effd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f388006cbd0 0x7f388006cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54514/0 (socket says 172.21.15.79:54514) 2024-04-25T02:17:22.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.638+0000 7f387effd640 1 -- 172.21.15.79:0/4162121977 learned_addr learned my addr 172.21.15.79:0/4162121977 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:22.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.638+0000 7f387f7fe640 1 -- 172.21.15.79:0/4162121977 >> v1:172.21.15.189:6789/0 conn(0x7f388006c3d0 legacy=0x7f3880161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.638+0000 7f387f7fe640 1 -- 172.21.15.79:0/4162121977 >> v1:172.21.15.79:6789/0 conn(0x7f388006cbd0 legacy=0x7f388006cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.638+0000 7f387dffb640 1 -- 172.21.15.79:0/4162121977 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3557902815 0 0) 0x7f38800b1d20 con 0x7f388006cbd0 2024-04-25T02:17:22.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.638+0000 7f387f7fe640 1 -- 172.21.15.79:0/4162121977 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3880162be0 con 0x7f38800d00d0 2024-04-25T02:17:22.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.639+0000 7f387f7fe640 1 --2- 172.21.15.79:0/4162121977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800d00d0 0x7f38800d0580 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f3878009d90 tx=0x7f387802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599c2c2b51c06997 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:22.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.639+0000 7f387dffb640 1 -- 172.21.15.79:0/4162121977 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878007740 con 0x7f38800d00d0 2024-04-25T02:17:22.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.639+0000 7f387dffb640 1 -- 172.21.15.79:0/4162121977 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38780078e0 con 0x7f38800d00d0 2024-04-25T02:17:22.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.639+0000 7f387dffb640 1 -- 172.21.15.79:0/4162121977 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878007cb0 con 0x7f38800d00d0 2024-04-25T02:17:22.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.639+0000 7f3885a31640 1 -- 172.21.15.79:0/4162121977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800d00d0 msgr2=0x7f38800d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.639+0000 7f3885a31640 1 --2- 172.21.15.79:0/4162121977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800d00d0 0x7f38800d0580 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f3878009d90 tx=0x7f387802a660 comp rx=0 tx=0).stop 2024-04-25T02:17:22.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.639+0000 7f3885a31640 1 -- 172.21.15.79:0/4162121977 shutdown_connections 2024-04-25T02:17:22.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.639+0000 7f3885a31640 1 --2- 172.21.15.79:0/4162121977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800d00d0 0x7f38800d0580 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.639+0000 7f3885a31640 1 -- 172.21.15.79:0/4162121977 >> 172.21.15.79:0/4162121977 conn(0x7f388009aa70 msgr2=0x7f388009ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:22.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.639+0000 7f3885a31640 1 -- 172.21.15.79:0/4162121977 shutdown_connections 2024-04-25T02:17:22.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.639+0000 7f3885a31640 1 -- 172.21.15.79:0/4162121977 wait complete. 2024-04-25T02:17:22.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.640+0000 7f3885a31640 1 Processor -- start 2024-04-25T02:17:22.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.641+0000 7f3885a31640 1 -- start start 2024-04-25T02:17:22.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.641+0000 7f3885a31640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f388006c3d0 0x7f38801561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.641+0000 7f3885a31640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f388006cbd0 0x7f388015c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.641+0000 7f3885a31640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800d00d0 0x7f388015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.641+0000 7f3885a31640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f38800b2500 con 0x7f38800d00d0 2024-04-25T02:17:22.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.641+0000 7f3885a31640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f388015e600 con 0x7f388006cbd0 2024-04-25T02:17:22.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.641+0000 7f3885a31640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f38800b2680 con 0x7f388006c3d0 2024-04-25T02:17:22.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.641+0000 7f387f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800d00d0 0x7f388015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.641+0000 7f387f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800d00d0 0x7f388015cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42330/0 (socket says 172.21.15.79:42330) 2024-04-25T02:17:22.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.641+0000 7f387f7fe640 1 -- 172.21.15.79:0/2912908071 learned_addr learned my addr 172.21.15.79:0/2912908071 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:22.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.642+0000 7f387f7fe640 1 -- 172.21.15.79:0/2912908071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f388006c3d0 msgr2=0x7f38801561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.642+0000 7f387effd640 1 --2- 172.21.15.79:0/2912908071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f388006c3d0 0x7f38801561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.642+0000 7f387e7fc640 1 --2- 172.21.15.79:0/2912908071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f388006cbd0 0x7f388015c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.642+0000 7f387f7fe640 1 --2- 172.21.15.79:0/2912908071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f388006c3d0 0x7f38801561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.642+0000 7f387f7fe640 1 -- 172.21.15.79:0/2912908071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f388006cbd0 msgr2=0x7f388015c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.642+0000 7f387f7fe640 1 --2- 172.21.15.79:0/2912908071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f388006cbd0 0x7f388015c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.642+0000 7f387f7fe640 1 -- 172.21.15.79:0/2912908071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3880157cc0 con 0x7f38800d00d0 2024-04-25T02:17:22.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.642+0000 7f387f7fe640 1 --2- 172.21.15.79:0/2912908071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800d00d0 0x7f388015cbd0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f3878009eb0 tx=0x7f3878004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:22.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.642+0000 7f3867fff640 1 -- 172.21.15.79:0/2912908071 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387803f070 con 0x7f38800d00d0 2024-04-25T02:17:22.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.642+0000 7f3867fff640 1 -- 172.21.15.79:0/2912908071 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3878031c90 con 0x7f38800d00d0 2024-04-25T02:17:22.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.642+0000 7f3867fff640 1 -- 172.21.15.79:0/2912908071 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878044680 con 0x7f38800d00d0 2024-04-25T02:17:22.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.642+0000 7f3885a31640 1 -- 172.21.15.79:0/2912908071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3880157fa0 con 0x7f38800d00d0 2024-04-25T02:17:22.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.642+0000 7f3885a31640 1 -- 172.21.15.79:0/2912908071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3880158560 con 0x7f38800d00d0 2024-04-25T02:17:22.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.643+0000 7f3885a31640 1 -- 172.21.15.79:0/2912908071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38800690a0 con 0x7f38800d00d0 2024-04-25T02:17:22.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.643+0000 7f3867fff640 1 -- 172.21.15.79:0/2912908071 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f387803b410 con 0x7f38800d00d0 2024-04-25T02:17:22.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.644+0000 7f3867fff640 1 --2- 172.21.15.79:0/2912908071 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f386c06be30 0x7f386c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.644+0000 7f3867fff640 1 -- 172.21.15.79:0/2912908071 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x7f38780ac7a0 con 0x7f38800d00d0 2024-04-25T02:17:22.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.644+0000 7f387effd640 1 --2- 172.21.15.79:0/2912908071 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f386c06be30 0x7f386c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.644+0000 7f387effd640 1 --2- 172.21.15.79:0/2912908071 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f386c06be30 0x7f386c06e2f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3870007fd0 tx=0x7f3870009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:22.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.648+0000 7f3867fff640 1 -- 172.21.15.79:0/2912908071 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f387807aba0 con 0x7f38800d00d0 2024-04-25T02:17:22.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.856+0000 7f3885a31640 1 -- 172.21.15.79:0/2912908071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38800b1d20 con 0x7f38800d00d0 2024-04-25T02:17:22.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.857+0000 7f3867fff640 1 -- 172.21.15.79:0/2912908071 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5176 (secure 0 0 0) 0x7f387807eea0 con 0x7f38800d00d0 2024-04-25T02:17:22.861 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:22.861 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":76,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1086166830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1086166830},{"type":"v1","addr":"172.21.15.189:6834","nonce":1086166830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2468340230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2468340230},{"type":"v1","addr":"172.21.15.189:6835","nonce":2468340230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3582530322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3582530322},{"type":"v1","addr":"172.21.15.79:6836","nonce":3582530322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8763,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2101809080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2101809080},{"type":"v1","addr":"172.21.15.79:6837","nonce":2101809080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":75,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:15:58.363457+0000","modified":"2024-04-25T02:17:19.739878+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-25T02:17:22.862 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 76 2024-04-25T02:17:22.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.858+0000 7f3885a31640 1 -- 172.21.15.79:0/2912908071 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f386c06be30 msgr2=0x7f386c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.858+0000 7f3885a31640 1 --2- 172.21.15.79:0/2912908071 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f386c06be30 0x7f386c06e2f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3870007fd0 tx=0x7f3870009040 comp rx=0 tx=0).stop 2024-04-25T02:17:22.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.858+0000 7f3885a31640 1 -- 172.21.15.79:0/2912908071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800d00d0 msgr2=0x7f388015cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.858+0000 7f3885a31640 1 --2- 172.21.15.79:0/2912908071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800d00d0 0x7f388015cbd0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f3878009eb0 tx=0x7f3878004a40 comp rx=0 tx=0).stop 2024-04-25T02:17:22.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.859+0000 7f3885a31640 1 -- 172.21.15.79:0/2912908071 shutdown_connections 2024-04-25T02:17:22.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.859+0000 7f3885a31640 1 --2- 172.21.15.79:0/2912908071 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f386c06be30 0x7f386c06e2f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.859+0000 7f3885a31640 1 --2- 172.21.15.79:0/2912908071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38800d00d0 0x7f388015cbd0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.859+0000 7f3885a31640 1 --2- 172.21.15.79:0/2912908071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f388006cbd0 0x7f388015c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.859+0000 7f3885a31640 1 --2- 172.21.15.79:0/2912908071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f388006c3d0 0x7f38801561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.859+0000 7f3885a31640 1 -- 172.21.15.79:0/2912908071 >> 172.21.15.79:0/2912908071 conn(0x7f388009aa70 msgr2=0x7f38800d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:22.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.859+0000 7f3885a31640 1 -- 172.21.15.79:0/2912908071 shutdown_connections 2024-04-25T02:17:22.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.859+0000 7f3885a31640 1 -- 172.21.15.79:0/2912908071 wait complete. 2024-04-25T02:17:22.874 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:17:22.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.967+0000 7f8979309640 1 Processor -- start 2024-04-25T02:17:22.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.967+0000 7f8979309640 1 -- start start 2024-04-25T02:17:22.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.968+0000 7f8979309640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f897415e4d0 0x7f897406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.968+0000 7f8979309640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89740d2e20 0x7f89740cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.968+0000 7f8979309640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89740d1660 con 0x7f89740b3570 2024-04-25T02:17:22.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.968+0000 7f8979309640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f89740d1380 con 0x7f897415e4d0 2024-04-25T02:17:22.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.968+0000 7f8979309640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f89740cede0 con 0x7f89740d2e20 2024-04-25T02:17:22.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.968+0000 7f8972ffd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f897415e4d0 0x7f897406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.968+0000 7f89737fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89740d2e20 0x7f89740cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.968+0000 7f896bfff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f89740b3570 0x7f89740d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:50272/0 (socket says 172.21.15.79:50272) 2024-04-25T02:17:22.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.968+0000 7f896bfff640 1 -- 172.21.15.79:0/335538335 learned_addr learned my addr 172.21.15.79:0/335538335 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:22.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.968+0000 7f89737fe640 1 -- 172.21.15.79:0/335538335 >> v2:172.21.15.189:3300/0 conn(0x7f897415e4d0 msgr2=0x7f897406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:22.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.968+0000 7f89737fe640 1 --2- 172.21.15.79:0/335538335 >> v2:172.21.15.189:3300/0 conn(0x7f897415e4d0 0x7f897406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.968+0000 7f89737fe640 1 -- 172.21.15.79:0/335538335 >> v1:172.21.15.189:6789/0 conn(0x7f89740b3570 legacy=0x7f89740d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.968+0000 7f89737fe640 1 -- 172.21.15.79:0/335538335 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89740cf0c0 con 0x7f89740d2e20 2024-04-25T02:17:22.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.968+0000 7f8972ffd640 1 --2- 172.21.15.79:0/335538335 >> v2:172.21.15.189:3300/0 conn(0x7f897415e4d0 0x7f897406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:17:22.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.969+0000 7f89737fe640 1 --2- 172.21.15.79:0/335538335 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89740d2e20 0x7f89740cf5e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f896c009dc0 tx=0x7f896c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34d3797efc4dd532 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:22.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.969+0000 7f89727fc640 1 -- 172.21.15.79:0/335538335 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c02ae60 con 0x7f89740d2e20 2024-04-25T02:17:22.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.969+0000 7f89727fc640 1 -- 172.21.15.79:0/335538335 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896c007740 con 0x7f89740d2e20 2024-04-25T02:17:22.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.969+0000 7f89727fc640 1 -- 172.21.15.79:0/335538335 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c007b10 con 0x7f89740d2e20 2024-04-25T02:17:22.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.970+0000 7f8979309640 1 -- 172.21.15.79:0/335538335 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89740d2e20 msgr2=0x7f89740cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.970+0000 7f8979309640 1 --2- 172.21.15.79:0/335538335 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89740d2e20 0x7f89740cf5e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f896c009dc0 tx=0x7f896c02a680 comp rx=0 tx=0).stop 2024-04-25T02:17:22.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.970+0000 7f8979309640 1 -- 172.21.15.79:0/335538335 shutdown_connections 2024-04-25T02:17:22.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.970+0000 7f8979309640 1 --2- 172.21.15.79:0/335538335 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89740d2e20 0x7f89740cf5e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.970+0000 7f8979309640 1 --2- 172.21.15.79:0/335538335 >> v2:172.21.15.189:3300/0 conn(0x7f897415e4d0 0x7f897406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.970+0000 7f8979309640 1 -- 172.21.15.79:0/335538335 >> 172.21.15.79:0/335538335 conn(0x7f897409d460 msgr2=0x7f89740d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:22.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.970+0000 7f8979309640 1 -- 172.21.15.79:0/335538335 shutdown_connections 2024-04-25T02:17:22.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.970+0000 7f8979309640 1 -- 172.21.15.79:0/335538335 wait complete. 2024-04-25T02:17:22.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.971+0000 7f8979309640 1 Processor -- start 2024-04-25T02:17:22.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.971+0000 7f8979309640 1 -- start start 2024-04-25T02:17:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f8979309640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89740b3570 0x7f89741490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f8979309640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89740d2e20 0x7f89740b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f8979309640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f897415e4d0 0x7f8974160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f8979309640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f89740d2250 con 0x7f89740d2e20 2024-04-25T02:17:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f8979309640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f89740d20d0 con 0x7f89740b3570 2024-04-25T02:17:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f8979309640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f897406c1b0 con 0x7f897415e4d0 2024-04-25T02:17:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f896bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89740d2e20 0x7f89740b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f896bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89740d2e20 0x7f89740b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42332/0 (socket says 172.21.15.79:42332) 2024-04-25T02:17:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f896bfff640 1 -- 172.21.15.79:0/365945766 learned_addr learned my addr 172.21.15.79:0/365945766 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f89737fe640 1 --2- 172.21.15.79:0/365945766 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f897415e4d0 0x7f8974160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f8972ffd640 1 --2- 172.21.15.79:0/365945766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89740b3570 0x7f89741490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f896bfff640 1 -- 172.21.15.79:0/365945766 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f897415e4d0 msgr2=0x7f8974160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f896bfff640 1 --2- 172.21.15.79:0/365945766 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f897415e4d0 0x7f8974160ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f896bfff640 1 -- 172.21.15.79:0/365945766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89740b3570 msgr2=0x7f89741490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f896bfff640 1 --2- 172.21.15.79:0/365945766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89740b3570 0x7f89741490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f896bfff640 1 -- 172.21.15.79:0/365945766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89740b5ae0 con 0x7f89740d2e20 2024-04-25T02:17:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.972+0000 7f896bfff640 1 --2- 172.21.15.79:0/365945766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89740d2e20 0x7f89740b44d0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f895c00c400 tx=0x7f895c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.973+0000 7f896b7fe640 1 -- 172.21.15.79:0/365945766 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c017070 con 0x7f89740d2e20 2024-04-25T02:17:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.973+0000 7f896b7fe640 1 -- 172.21.15.79:0/365945766 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895c005ce0 con 0x7f89740d2e20 2024-04-25T02:17:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.973+0000 7f8979309640 1 -- 172.21.15.79:0/365945766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89740b5dc0 con 0x7f89740d2e20 2024-04-25T02:17:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.973+0000 7f896b7fe640 1 -- 172.21.15.79:0/365945766 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c0072f0 con 0x7f89740d2e20 2024-04-25T02:17:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.973+0000 7f8979309640 1 -- 172.21.15.79:0/365945766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89740b6380 con 0x7f89740d2e20 2024-04-25T02:17:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.974+0000 7f8979309640 1 -- 172.21.15.79:0/365945766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89740690a0 con 0x7f89740d2e20 2024-04-25T02:17:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.974+0000 7f896b7fe640 1 -- 172.21.15.79:0/365945766 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f895c01a070 con 0x7f89740d2e20 2024-04-25T02:17:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.974+0000 7f896b7fe640 1 --2- 172.21.15.79:0/365945766 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f895406be30 0x7f895406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:22.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.975+0000 7f896b7fe640 1 -- 172.21.15.79:0/365945766 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x7f895c08a290 con 0x7f89740d2e20 2024-04-25T02:17:22.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.975+0000 7f8972ffd640 1 --2- 172.21.15.79:0/365945766 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f895406be30 0x7f895406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:22.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.975+0000 7f8972ffd640 1 --2- 172.21.15.79:0/365945766 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f895406be30 0x7f895406e2f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8964009560 tx=0x7f8964009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:22.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:22.979+0000 7f896b7fe640 1 -- 172.21.15.79:0/365945766 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f895c058540 con 0x7f89740d2e20 2024-04-25T02:17:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.152+0000 7f8979309640 1 -- 172.21.15.79:0/365945766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89740d1920 con 0x7f89740d2e20 2024-04-25T02:17:23.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.154+0000 7f896b7fe640 1 -- 172.21.15.79:0/365945766 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16890 (secure 0 0 0) 0x7f895c05c840 con 0x7f89740d2e20 2024-04-25T02:17:23.158 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:23.158 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":104,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:17:19.739710+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:15:56.581482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T02:15:57.334060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/2550458851":"2024-04-26T02:17:19.739687+0000","172.21.15.79:6834/2550458851":"2024-04-26T02:17:19.739687+0000","172.21.15.79:6837/2774759267":"2024-04-26T02:16:43.461186+0000","172.21.15.79:6834/2774759267":"2024-04-26T02:16:43.461186+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:17:23.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.155+0000 7f8979309640 1 -- 172.21.15.79:0/365945766 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f895406be30 msgr2=0x7f895406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:23.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.155+0000 7f8979309640 1 --2- 172.21.15.79:0/365945766 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f895406be30 0x7f895406e2f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8964009560 tx=0x7f8964009190 comp rx=0 tx=0).stop 2024-04-25T02:17:23.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.155+0000 7f8979309640 1 -- 172.21.15.79:0/365945766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89740d2e20 msgr2=0x7f89740b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:23.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.155+0000 7f8979309640 1 --2- 172.21.15.79:0/365945766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89740d2e20 0x7f89740b44d0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f895c00c400 tx=0x7f895c00c8c0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.156+0000 7f8979309640 1 -- 172.21.15.79:0/365945766 shutdown_connections 2024-04-25T02:17:23.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.156+0000 7f8979309640 1 --2- 172.21.15.79:0/365945766 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f895406be30 0x7f895406e2f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.156+0000 7f8979309640 1 --2- 172.21.15.79:0/365945766 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f897415e4d0 0x7f8974160ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.156+0000 7f8979309640 1 --2- 172.21.15.79:0/365945766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89740d2e20 0x7f89740b44d0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.156+0000 7f8979309640 1 --2- 172.21.15.79:0/365945766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89740b3570 0x7f89741490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.156+0000 7f8979309640 1 -- 172.21.15.79:0/365945766 >> 172.21.15.79:0/365945766 conn(0x7f897409d460 msgr2=0x7f89740cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:23.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.156+0000 7f8979309640 1 -- 172.21.15.79:0/365945766 shutdown_connections 2024-04-25T02:17:23.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.156+0000 7f8979309640 1 -- 172.21.15.79:0/365945766 wait complete. 2024-04-25T02:17:23.171 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:17:23.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.263+0000 7fb801bce640 1 Processor -- start 2024-04-25T02:17:23.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.263+0000 7fb801bce640 1 -- start start 2024-04-25T02:17:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.264+0000 7fb801bce640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7fc143bc0 0x7fb7fc15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.264+0000 7fb801bce640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb7fc0b3d40 0x7fb7fc06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.264+0000 7fb801bce640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7fc15fa40 con 0x7fb7fc06df50 2024-04-25T02:17:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.264+0000 7fb801bce640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb7fc06e8f0 con 0x7fb7fc0b3d40 2024-04-25T02:17:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.264+0000 7fb801bce640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb7fc072cb0 con 0x7fb7fc143bc0 2024-04-25T02:17:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.264+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7fc143bc0 0x7fb7fc15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.264+0000 7fb7fbfff640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb7fc0b3d40 0x7fb7fc06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.264+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7fc143bc0 0x7fb7fc15f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:42536/0 (socket says 172.21.15.79:42536) 2024-04-25T02:17:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.264+0000 7fb7faffd640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fb7fc06df50 0x7fb7fc0b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:50274/0 (socket says 172.21.15.79:50274) 2024-04-25T02:17:23.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.264+0000 7fb7fb7fe640 1 -- 172.21.15.79:0/3635549867 learned_addr learned my addr 172.21.15.79:0/3635549867 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:23.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.264+0000 7fb7fbfff640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb7fc0b3d40 0x7fb7fc06e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:58590/0 (socket says 172.21.15.79:58590) 2024-04-25T02:17:23.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.265+0000 7fb7fb7fe640 1 -- 172.21.15.79:0/3635549867 >> v2:172.21.15.189:3300/0 conn(0x7fb7fc0b3d40 msgr2=0x7fb7fc06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:23.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.265+0000 7fb7fb7fe640 1 --2- 172.21.15.79:0/3635549867 >> v2:172.21.15.189:3300/0 conn(0x7fb7fc0b3d40 0x7fb7fc06e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.265+0000 7fb7fb7fe640 1 -- 172.21.15.79:0/3635549867 >> v1:172.21.15.189:6789/0 conn(0x7fb7fc06df50 legacy=0x7fb7fc0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:23.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.265+0000 7fb7fb7fe640 1 -- 172.21.15.79:0/3635549867 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7fc071e00 con 0x7fb7fc143bc0 2024-04-25T02:17:23.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.265+0000 7fb7fbfff640 1 --2- 172.21.15.79:0/3635549867 >> v2:172.21.15.189:3300/0 conn(0x7fb7fc0b3d40 0x7fb7fc06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:17:23.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.265+0000 7fb7fb7fe640 1 --2- 172.21.15.79:0/3635549867 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7fc143bc0 0x7fb7fc15f500 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009870 tx=0x7fb7ec02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=746ceb8764042b56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.266+0000 7fb7fa7fc640 1 -- 172.21.15.79:0/3635549867 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec037070 con 0x7fb7fc143bc0 2024-04-25T02:17:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.266+0000 7fb7fa7fc640 1 -- 172.21.15.79:0/3635549867 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec032440 con 0x7fb7fc143bc0 2024-04-25T02:17:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.266+0000 7fb7fa7fc640 1 -- 172.21.15.79:0/3635549867 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec032810 con 0x7fb7fc143bc0 2024-04-25T02:17:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.266+0000 7fb801bce640 1 -- 172.21.15.79:0/3635549867 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7fc143bc0 msgr2=0x7fb7fc15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.266+0000 7fb801bce640 1 --2- 172.21.15.79:0/3635549867 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7fc143bc0 0x7fb7fc15f500 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009870 tx=0x7fb7ec02a1c0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.266+0000 7fb801bce640 1 -- 172.21.15.79:0/3635549867 shutdown_connections 2024-04-25T02:17:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.266+0000 7fb801bce640 1 --2- 172.21.15.79:0/3635549867 >> v2:172.21.15.189:3300/0 conn(0x7fb7fc0b3d40 0x7fb7fc06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.266+0000 7fb801bce640 1 --2- 172.21.15.79:0/3635549867 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7fc143bc0 0x7fb7fc15f500 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.266+0000 7fb801bce640 1 -- 172.21.15.79:0/3635549867 >> 172.21.15.79:0/3635549867 conn(0x7fb7fc0cfc80 msgr2=0x7fb7fc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.266+0000 7fb801bce640 1 -- 172.21.15.79:0/3635549867 shutdown_connections 2024-04-25T02:17:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.266+0000 7fb801bce640 1 -- 172.21.15.79:0/3635549867 wait complete. 2024-04-25T02:17:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.267+0000 7fb801bce640 1 Processor -- start 2024-04-25T02:17:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.267+0000 7fb801bce640 1 -- start start 2024-04-25T02:17:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.268+0000 7fb801bce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7fc06df50 0x7fb7fc142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.268+0000 7fb801bce640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7fc0b3d40 0x7fb7fc0abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.268+0000 7fb801bce640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7fc143bc0 0x7fb7fc159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.268+0000 7fb801bce640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc072660 con 0x7fb7fc06df50 2024-04-25T02:17:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.268+0000 7fb801bce640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc072380 con 0x7fb7fc0b3d40 2024-04-25T02:17:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.268+0000 7fb801bce640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb7fc072940 con 0x7fb7fc143bc0 2024-04-25T02:17:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.268+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7fc06df50 0x7fb7fc142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.268+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7fc06df50 0x7fb7fc142960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42340/0 (socket says 172.21.15.79:42340) 2024-04-25T02:17:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.268+0000 7fb7fb7fe640 1 -- 172.21.15.79:0/3362535535 learned_addr learned my addr 172.21.15.79:0/3362535535 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.269+0000 7fb7fb7fe640 1 -- 172.21.15.79:0/3362535535 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7fc143bc0 msgr2=0x7fb7fc159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.269+0000 7fb7fb7fe640 1 --2- 172.21.15.79:0/3362535535 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7fc143bc0 0x7fb7fc159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.269+0000 7fb7fb7fe640 1 -- 172.21.15.79:0/3362535535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7fc0b3d40 msgr2=0x7fb7fc0abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.269+0000 7fb7fb7fe640 1 --2- 172.21.15.79:0/3362535535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7fc0b3d40 0x7fb7fc0abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.269+0000 7fb7fb7fe640 1 -- 172.21.15.79:0/3362535535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7fc1572a0 con 0x7fb7fc06df50 2024-04-25T02:17:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.269+0000 7fb7fb7fe640 1 --2- 172.21.15.79:0/3362535535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7fc06df50 0x7fb7fc142960 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec000c00 tx=0x7fb7ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.269+0000 7fb7e3fff640 1 -- 172.21.15.79:0/3362535535 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec037040 con 0x7fb7fc06df50 2024-04-25T02:17:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.269+0000 7fb7e3fff640 1 -- 172.21.15.79:0/3362535535 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec042070 con 0x7fb7fc06df50 2024-04-25T02:17:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.269+0000 7fb801bce640 1 -- 172.21.15.79:0/3362535535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7fc157580 con 0x7fb7fc06df50 2024-04-25T02:17:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.269+0000 7fb7e3fff640 1 -- 172.21.15.79:0/3362535535 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec03b850 con 0x7fb7fc06df50 2024-04-25T02:17:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.269+0000 7fb801bce640 1 -- 172.21.15.79:0/3362535535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7fc157b40 con 0x7fb7fc06df50 2024-04-25T02:17:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.270+0000 7fb801bce640 1 -- 172.21.15.79:0/3362535535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7fc0690a0 con 0x7fb7fc06df50 2024-04-25T02:17:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.270+0000 7fb7e3fff640 1 -- 172.21.15.79:0/3362535535 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7ec02ad10 con 0x7fb7fc06df50 2024-04-25T02:17:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.271+0000 7fb7e3fff640 1 --2- 172.21.15.79:0/3362535535 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7e806be30 0x7fb7e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.271+0000 7fb7e3fff640 1 -- 172.21.15.79:0/3362535535 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x7fb7ec0ab390 con 0x7fb7fc06df50 2024-04-25T02:17:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.271+0000 7fb7faffd640 1 --2- 172.21.15.79:0/3362535535 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7e806be30 0x7fb7e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:23.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.271+0000 7fb7faffd640 1 --2- 172.21.15.79:0/3362535535 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7e806be30 0x7fb7e806e2f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0000f60 tx=0x7fb7f0007a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:23.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.275+0000 7fb7e3fff640 1 -- 172.21.15.79:0/3362535535 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb7ec079d20 con 0x7fb7fc06df50 2024-04-25T02:17:23.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.483+0000 7fb801bce640 1 -- 172.21.15.79:0/3362535535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb7fc0d02b0 con 0x7fb7fc06df50 2024-04-25T02:17:23.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.554+0000 7fb7e3fff640 1 -- 172.21.15.79:0/3362535535 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) ==== 161+0+0 (secure 0 0 0) 0x7fb7ec079620 con 0x7fb7fc06df50 2024-04-25T02:17:23.559 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:17:23.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.556+0000 7fb801bce640 1 -- 172.21.15.79:0/3362535535 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7e806be30 msgr2=0x7fb7e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:23.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.557+0000 7fb801bce640 1 --2- 172.21.15.79:0/3362535535 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7e806be30 0x7fb7e806e2f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0000f60 tx=0x7fb7f0007a00 comp rx=0 tx=0).stop 2024-04-25T02:17:23.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.557+0000 7fb801bce640 1 -- 172.21.15.79:0/3362535535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7fc06df50 msgr2=0x7fb7fc142960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:23.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.557+0000 7fb801bce640 1 --2- 172.21.15.79:0/3362535535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7fc06df50 0x7fb7fc142960 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec000c00 tx=0x7fb7ec0046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.557+0000 7fb801bce640 1 -- 172.21.15.79:0/3362535535 shutdown_connections 2024-04-25T02:17:23.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.557+0000 7fb801bce640 1 --2- 172.21.15.79:0/3362535535 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7e806be30 0x7fb7e806e2f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.557+0000 7fb801bce640 1 --2- 172.21.15.79:0/3362535535 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb7fc143bc0 0x7fb7fc159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.557+0000 7fb801bce640 1 --2- 172.21.15.79:0/3362535535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7fc0b3d40 0x7fb7fc0abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.557+0000 7fb801bce640 1 --2- 172.21.15.79:0/3362535535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7fc06df50 0x7fb7fc142960 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.557+0000 7fb801bce640 1 -- 172.21.15.79:0/3362535535 >> 172.21.15.79:0/3362535535 conn(0x7fb7fc0cfc80 msgr2=0x7fb7fc0ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:23.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.557+0000 7fb801bce640 1 -- 172.21.15.79:0/3362535535 shutdown_connections 2024-04-25T02:17:23.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.557+0000 7fb801bce640 1 -- 172.21.15.79:0/3362535535 wait complete. 2024-04-25T02:17:23.572 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T02:17:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.666+0000 7f1561142640 1 Processor -- start 2024-04-25T02:17:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.667+0000 7f1561142640 1 -- start start 2024-04-25T02:17:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.667+0000 7f1561142640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f155c06b2f0 0x7f155c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.667+0000 7f1561142640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f155c0cf7a0 0x7f155c06b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.667+0000 7f1561142640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f155c06bc10 con 0x7f155c06e6b0 2024-04-25T02:17:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.667+0000 7f1561142640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f155c15f830 con 0x7f155c06b2f0 2024-04-25T02:17:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.667+0000 7f1561142640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f155c15ec20 con 0x7f155c0cf7a0 2024-04-25T02:17:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.667+0000 7f155ad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f155c06b2f0 0x7f155c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.667+0000 7f155ad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f155c06b2f0 0x7f155c0b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50138/0 (socket says 172.21.15.79:50138) 2024-04-25T02:17:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.667+0000 7f155ad9d640 1 -- 172.21.15.79:0/3594085285 learned_addr learned my addr 172.21.15.79:0/3594085285 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.668+0000 7f155a59c640 1 --2- 172.21.15.79:0/3594085285 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f155c0cf7a0 0x7f155c06b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.668+0000 7f155ad9d640 1 -- 172.21.15.79:0/3594085285 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f155c0cf7a0 msgr2=0x7f155c06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.668+0000 7f155ad9d640 1 --2- 172.21.15.79:0/3594085285 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f155c0cf7a0 0x7f155c06b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.668+0000 7f155ad9d640 1 -- 172.21.15.79:0/3594085285 >> v1:172.21.15.189:6789/0 conn(0x7f155c06e6b0 legacy=0x7f155c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.668+0000 7f155ad9d640 1 -- 172.21.15.79:0/3594085285 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155c15ef00 con 0x7f155c06b2f0 2024-04-25T02:17:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.668+0000 7f155a59c640 1 --2- 172.21.15.79:0/3594085285 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f155c0cf7a0 0x7f155c06b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.668+0000 7f155ad9d640 1 --2- 172.21.15.79:0/3594085285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f155c06b2f0 0x7f155c0b4b50 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f154c009e50 tx=0x7f154c02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21deac9cbcf06e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.669+0000 7f1559d9b640 1 -- 172.21.15.79:0/3594085285 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c036070 con 0x7f155c06b2f0 2024-04-25T02:17:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.669+0000 7f1559d9b640 1 -- 172.21.15.79:0/3594085285 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f154c031600 con 0x7f155c06b2f0 2024-04-25T02:17:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.669+0000 7f1559d9b640 1 -- 172.21.15.79:0/3594085285 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c0319d0 con 0x7f155c06b2f0 2024-04-25T02:17:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.669+0000 7f1561142640 1 -- 172.21.15.79:0/3594085285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f155c06b2f0 msgr2=0x7f155c0b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.669+0000 7f1561142640 1 --2- 172.21.15.79:0/3594085285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f155c06b2f0 0x7f155c0b4b50 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f154c009e50 tx=0x7f154c02a630 comp rx=0 tx=0).stop 2024-04-25T02:17:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.669+0000 7f1561142640 1 -- 172.21.15.79:0/3594085285 shutdown_connections 2024-04-25T02:17:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.669+0000 7f1561142640 1 --2- 172.21.15.79:0/3594085285 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f155c0cf7a0 0x7f155c06b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.669+0000 7f1561142640 1 --2- 172.21.15.79:0/3594085285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f155c06b2f0 0x7f155c0b4b50 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.669+0000 7f1561142640 1 -- 172.21.15.79:0/3594085285 >> 172.21.15.79:0/3594085285 conn(0x7f155c0b1cd0 msgr2=0x7f155c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.669+0000 7f1561142640 1 -- 172.21.15.79:0/3594085285 shutdown_connections 2024-04-25T02:17:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.669+0000 7f1561142640 1 -- 172.21.15.79:0/3594085285 wait complete. 2024-04-25T02:17:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.670+0000 7f1561142640 1 Processor -- start 2024-04-25T02:17:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.671+0000 7f1561142640 1 -- start start 2024-04-25T02:17:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.671+0000 7f1561142640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f155c06b2f0 0x7f155c09d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.671+0000 7f1561142640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f155c06e6b0 0x7f155c1452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.671+0000 7f1561142640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f155c0cf7a0 0x7f155c0ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.671+0000 7f1561142640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f155c06cfe0 con 0x7f155c06b2f0 2024-04-25T02:17:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.671+0000 7f1561142640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f155c15f4c0 con 0x7f155c06e6b0 2024-04-25T02:17:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.671+0000 7f1561142640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f155c06d160 con 0x7f155c0cf7a0 2024-04-25T02:17:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.671+0000 7f155ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f155c06b2f0 0x7f155c09d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.671+0000 7f155ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f155c06b2f0 0x7f155c09d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50152/0 (socket says 172.21.15.79:50152) 2024-04-25T02:17:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.671+0000 7f155ad9d640 1 -- 172.21.15.79:0/3129300892 learned_addr learned my addr 172.21.15.79:0/3129300892 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.672+0000 7f155b59e640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f155c0cf7a0 0x7f155c0ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.672+0000 7f155ad9d640 1 -- 172.21.15.79:0/3129300892 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f155c0cf7a0 msgr2=0x7f155c0ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.672+0000 7f155a59c640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f155c06e6b0 0x7f155c1452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.672+0000 7f155ad9d640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f155c0cf7a0 0x7f155c0ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.672+0000 7f155ad9d640 1 -- 172.21.15.79:0/3129300892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f155c06e6b0 msgr2=0x7f155c1452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.672+0000 7f155ad9d640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f155c06e6b0 0x7f155c1452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.672+0000 7f155ad9d640 1 -- 172.21.15.79:0/3129300892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155c09c530 con 0x7f155c06b2f0 2024-04-25T02:17:23.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.672+0000 7f155b59e640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f155c0cf7a0 0x7f155c0ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:23.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.672+0000 7f155a59c640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f155c06e6b0 0x7f155c1452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:23.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.672+0000 7f155ad9d640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f155c06b2f0 0x7f155c09d2f0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f154c009e50 tx=0x7f154c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:23.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.672+0000 7f15437fe640 1 -- 172.21.15.79:0/3129300892 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c036050 con 0x7f155c06b2f0 2024-04-25T02:17:23.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.672+0000 7f15437fe640 1 -- 172.21.15.79:0/3129300892 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f154c042070 con 0x7f155c06b2f0 2024-04-25T02:17:23.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.672+0000 7f1561142640 1 -- 172.21.15.79:0/3129300892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f155c09c810 con 0x7f155c06b2f0 2024-04-25T02:17:23.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.672+0000 7f15437fe640 1 -- 172.21.15.79:0/3129300892 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c009510 con 0x7f155c06b2f0 2024-04-25T02:17:23.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.672+0000 7f1561142640 1 -- 172.21.15.79:0/3129300892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f155c09d830 con 0x7f155c06b2f0 2024-04-25T02:17:23.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.673+0000 7f1561142640 1 -- 172.21.15.79:0/3129300892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f155c0690a0 con 0x7f155c06b2f0 2024-04-25T02:17:23.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.673+0000 7f15437fe640 1 -- 172.21.15.79:0/3129300892 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f154c007c50 con 0x7f155c06b2f0 2024-04-25T02:17:23.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.674+0000 7f15437fe640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f154806be30 0x7f154806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:23.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.674+0000 7f15437fe640 1 -- 172.21.15.79:0/3129300892 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x7f154c0abec0 con 0x7f155c06b2f0 2024-04-25T02:17:23.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.674+0000 7f155a59c640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f154806be30 0x7f154806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:23.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.674+0000 7f155a59c640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f154806be30 0x7f154806e2f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1550006fd0 tx=0x7f1550008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:23.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.678+0000 7f15437fe640 1 -- 172.21.15.79:0/3129300892 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f154c07a7c0 con 0x7f155c06b2f0 2024-04-25T02:17:23.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:23.889+0000 7f1561142640 1 -- 172.21.15.79:0/3129300892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f155c0cc460 con 0x7f155c06b2f0 2024-04-25T02:17:24.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.563+0000 7f15437fe640 1 -- 172.21.15.79:0/3129300892 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) ==== 104+0+0 (secure 0 0 0) 0x7f154c07a0c0 con 0x7f155c06b2f0 2024-04-25T02:17:24.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.566+0000 7f1561142640 1 -- 172.21.15.79:0/3129300892 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f154806be30 msgr2=0x7f154806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:24.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.566+0000 7f1561142640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f154806be30 0x7f154806e2f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1550006fd0 tx=0x7f1550008040 comp rx=0 tx=0).stop 2024-04-25T02:17:24.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.566+0000 7f1561142640 1 -- 172.21.15.79:0/3129300892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f155c06b2f0 msgr2=0x7f155c09d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:24.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.566+0000 7f1561142640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f155c06b2f0 0x7f155c09d2f0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f154c009e50 tx=0x7f154c004a40 comp rx=0 tx=0).stop 2024-04-25T02:17:24.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.566+0000 7f1561142640 1 -- 172.21.15.79:0/3129300892 shutdown_connections 2024-04-25T02:17:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.566+0000 7f1561142640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f154806be30 0x7f154806e2f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.566+0000 7f1561142640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f155c0cf7a0 0x7f155c0ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.566+0000 7f1561142640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f155c06e6b0 0x7f155c1452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.566+0000 7f1561142640 1 --2- 172.21.15.79:0/3129300892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f155c06b2f0 0x7f155c09d2f0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.566+0000 7f1561142640 1 -- 172.21.15.79:0/3129300892 >> 172.21.15.79:0/3129300892 conn(0x7f155c0b1cd0 msgr2=0x7f155c072400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.566+0000 7f1561142640 1 -- 172.21.15.79:0/3129300892 shutdown_connections 2024-04-25T02:17:24.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.566+0000 7f1561142640 1 -- 172.21.15.79:0/3129300892 wait complete. 2024-04-25T02:17:24.584 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T02:17:24.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.684+0000 7f4a844ee640 1 Processor -- start 2024-04-25T02:17:24.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.684+0000 7f4a844ee640 1 -- start start 2024-04-25T02:17:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.685+0000 7f4a844ee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a7c15e440 0x7f4a7c0cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.685+0000 7f4a844ee640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f4a7c0d10a0 0x7f4a7c0cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.685+0000 7f4a844ee640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a7c0d1e80 con 0x7f4a7c0d2f20 2024-04-25T02:17:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.685+0000 7f4a844ee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4a7c0d2160 con 0x7f4a7c15e440 2024-04-25T02:17:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.685+0000 7f4a844ee640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f4a7c0d2440 con 0x7f4a7c0d10a0 2024-04-25T02:17:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.685+0000 7f4a8228a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a7c15e440 0x7f4a7c0cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.685+0000 7f4a8228a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a7c15e440 0x7f4a7c0cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50154/0 (socket says 172.21.15.79:50154) 2024-04-25T02:17:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.685+0000 7f4a8228a640 1 -- 172.21.15.79:0/3462162637 learned_addr learned my addr 172.21.15.79:0/3462162637 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.686+0000 7f4a8228a640 1 -- 172.21.15.79:0/3462162637 >> v2:172.21.15.189:3300/0 conn(0x7f4a7c0d10a0 msgr2=0x7f4a7c0cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:24.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.686+0000 7f4a82a8b640 1 --2- 172.21.15.79:0/3462162637 >> v2:172.21.15.189:3300/0 conn(0x7f4a7c0d10a0 0x7f4a7c0cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.686+0000 7f4a8228a640 1 --2- 172.21.15.79:0/3462162637 >> v2:172.21.15.189:3300/0 conn(0x7f4a7c0d10a0 0x7f4a7c0cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.686+0000 7f4a8228a640 1 -- 172.21.15.79:0/3462162637 >> v1:172.21.15.189:6789/0 conn(0x7f4a7c0d2f20 legacy=0x7f4a7c0d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.686+0000 7f4a8228a640 1 -- 172.21.15.79:0/3462162637 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c0d2720 con 0x7f4a7c15e440 2024-04-25T02:17:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.686+0000 7f4a82a8b640 1 --2- 172.21.15.79:0/3462162637 >> v2:172.21.15.189:3300/0 conn(0x7f4a7c0d10a0 0x7f4a7c0cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.686+0000 7f4a8228a640 1 --2- 172.21.15.79:0/3462162637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c15e440 0x7f4a7c0cf870 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0d33a0 tx=0x7f4a7802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f087c8f10333a88 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.687+0000 7f4a81288640 1 -- 172.21.15.79:0/3462162637 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78036070 con 0x7f4a7c15e440 2024-04-25T02:17:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.687+0000 7f4a81288640 1 -- 172.21.15.79:0/3462162637 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a78031600 con 0x7f4a7c15e440 2024-04-25T02:17:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.687+0000 7f4a81288640 1 -- 172.21.15.79:0/3462162637 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a780319d0 con 0x7f4a7c15e440 2024-04-25T02:17:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.687+0000 7f4a844ee640 1 -- 172.21.15.79:0/3462162637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c15e440 msgr2=0x7f4a7c0cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.687+0000 7f4a844ee640 1 --2- 172.21.15.79:0/3462162637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c15e440 0x7f4a7c0cf870 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0d33a0 tx=0x7f4a7802a6f0 comp rx=0 tx=0).stop 2024-04-25T02:17:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.687+0000 7f4a844ee640 1 -- 172.21.15.79:0/3462162637 shutdown_connections 2024-04-25T02:17:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.687+0000 7f4a844ee640 1 --2- 172.21.15.79:0/3462162637 >> v2:172.21.15.189:3300/0 conn(0x7f4a7c0d10a0 0x7f4a7c0cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:24.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.687+0000 7f4a844ee640 1 --2- 172.21.15.79:0/3462162637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c15e440 0x7f4a7c0cf870 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:24.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.687+0000 7f4a844ee640 1 -- 172.21.15.79:0/3462162637 >> 172.21.15.79:0/3462162637 conn(0x7f4a7c09d450 msgr2=0x7f4a7c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:24.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.687+0000 7f4a844ee640 1 -- 172.21.15.79:0/3462162637 shutdown_connections 2024-04-25T02:17:24.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.687+0000 7f4a844ee640 1 -- 172.21.15.79:0/3462162637 wait complete. 2024-04-25T02:17:24.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.688+0000 7f4a844ee640 1 Processor -- start 2024-04-25T02:17:24.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.688+0000 7f4a844ee640 1 -- start start 2024-04-25T02:17:24.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.689+0000 7f4a844ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c0d10a0 0x7f4a7c156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:24.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.689+0000 7f4a844ee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a7c0d2f20 0x7f4a7c15ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:24.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.689+0000 7f4a844ee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4a7c15e440 0x7f4a7c0ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:24.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.689+0000 7f4a844ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c0b7070 con 0x7f4a7c0d10a0 2024-04-25T02:17:24.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.689+0000 7f4a844ee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c0b6ef0 con 0x7f4a7c0d2f20 2024-04-25T02:17:24.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.689+0000 7f4a844ee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4a7c0b71f0 con 0x7f4a7c15e440 2024-04-25T02:17:24.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.689+0000 7f4a8228a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c0d10a0 0x7f4a7c156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:24.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.689+0000 7f4a8228a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c0d10a0 0x7f4a7c156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50168/0 (socket says 172.21.15.79:50168) 2024-04-25T02:17:24.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.689+0000 7f4a8228a640 1 -- 172.21.15.79:0/3291563322 learned_addr learned my addr 172.21.15.79:0/3291563322 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:24.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.689+0000 7f4a82a8b640 1 --2- 172.21.15.79:0/3291563322 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4a7c15e440 0x7f4a7c0ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:24.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.689+0000 7f4a81a89640 1 --2- 172.21.15.79:0/3291563322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a7c0d2f20 0x7f4a7c15ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:24.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.689+0000 7f4a8228a640 1 -- 172.21.15.79:0/3291563322 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4a7c15e440 msgr2=0x7f4a7c0ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:24.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.690+0000 7f4a8228a640 1 --2- 172.21.15.79:0/3291563322 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4a7c15e440 0x7f4a7c0ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.690+0000 7f4a8228a640 1 -- 172.21.15.79:0/3291563322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a7c0d2f20 msgr2=0x7f4a7c15ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.690+0000 7f4a8228a640 1 --2- 172.21.15.79:0/3291563322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a7c0d2f20 0x7f4a7c15ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.690+0000 7f4a8228a640 1 -- 172.21.15.79:0/3291563322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c157060 con 0x7f4a7c0d10a0 2024-04-25T02:17:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.690+0000 7f4a8228a640 1 --2- 172.21.15.79:0/3291563322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c0d10a0 0x7f4a7c156b20 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f4a780093e0 tx=0x7f4a78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.690+0000 7f4a72ffd640 1 -- 172.21.15.79:0/3291563322 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78041020 con 0x7f4a7c0d10a0 2024-04-25T02:17:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.690+0000 7f4a72ffd640 1 -- 172.21.15.79:0/3291563322 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a78007820 con 0x7f4a7c0d10a0 2024-04-25T02:17:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.690+0000 7f4a72ffd640 1 -- 172.21.15.79:0/3291563322 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78036040 con 0x7f4a7c0d10a0 2024-04-25T02:17:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.690+0000 7f4a844ee640 1 -- 172.21.15.79:0/3291563322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7c0c8fb0 con 0x7f4a7c0d10a0 2024-04-25T02:17:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.690+0000 7f4a844ee640 1 -- 172.21.15.79:0/3291563322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7c0c9570 con 0x7f4a7c0d10a0 2024-04-25T02:17:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.691+0000 7f4a844ee640 1 -- 172.21.15.79:0/3291563322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a7c0690a0 con 0x7f4a7c0d10a0 2024-04-25T02:17:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.691+0000 7f4a72ffd640 1 -- 172.21.15.79:0/3291563322 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a78044020 con 0x7f4a7c0d10a0 2024-04-25T02:17:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.692+0000 7f4a72ffd640 1 --2- 172.21.15.79:0/3291563322 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4a6006be30 0x7f4a6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.692+0000 7f4a72ffd640 1 -- 172.21.15.79:0/3291563322 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x7f4a780abdc0 con 0x7f4a7c0d10a0 2024-04-25T02:17:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.692+0000 7f4a81a89640 1 --2- 172.21.15.79:0/3291563322 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4a6006be30 0x7f4a6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:24.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.692+0000 7f4a81a89640 1 --2- 172.21.15.79:0/3291563322 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4a6006be30 0x7f4a6006e2f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c161910 tx=0x7f4a6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:24.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.696+0000 7f4a72ffd640 1 -- 172.21.15.79:0/3291563322 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4a7804b030 con 0x7f4a7c0d10a0 2024-04-25T02:17:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:24.868+0000 7f4a844ee640 1 -- 172.21.15.79:0/3291563322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4a7c0d1720 con 0x7f4a7c0d10a0 2024-04-25T02:17:25.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.568+0000 7f4a72ffd640 1 -- 172.21.15.79:0/3291563322 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) ==== 181+0+0 (secure 0 0 0) 0x7f4a7807a6c0 con 0x7f4a7c0d10a0 2024-04-25T02:17:25.573 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-04-25T02:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.572+0000 7f4a844ee640 1 -- 172.21.15.79:0/3291563322 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4a6006be30 msgr2=0x7f4a6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.572+0000 7f4a844ee640 1 --2- 172.21.15.79:0/3291563322 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4a6006be30 0x7f4a6006e2f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c161910 tx=0x7f4a6c009040 comp rx=0 tx=0).stop 2024-04-25T02:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.572+0000 7f4a844ee640 1 -- 172.21.15.79:0/3291563322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c0d10a0 msgr2=0x7f4a7c156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.572+0000 7f4a844ee640 1 --2- 172.21.15.79:0/3291563322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c0d10a0 0x7f4a7c156b20 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f4a780093e0 tx=0x7f4a78004a40 comp rx=0 tx=0).stop 2024-04-25T02:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.572+0000 7f4a844ee640 1 -- 172.21.15.79:0/3291563322 shutdown_connections 2024-04-25T02:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.572+0000 7f4a844ee640 1 --2- 172.21.15.79:0/3291563322 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4a6006be30 0x7f4a6006e2f0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.572+0000 7f4a844ee640 1 --2- 172.21.15.79:0/3291563322 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4a7c15e440 0x7f4a7c0ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.572+0000 7f4a844ee640 1 --2- 172.21.15.79:0/3291563322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a7c0d2f20 0x7f4a7c15ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.572+0000 7f4a844ee640 1 --2- 172.21.15.79:0/3291563322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c0d10a0 0x7f4a7c156b20 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.572+0000 7f4a844ee640 1 -- 172.21.15.79:0/3291563322 >> 172.21.15.79:0/3291563322 conn(0x7f4a7c09d450 msgr2=0x7f4a7c0b7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.572+0000 7f4a844ee640 1 -- 172.21.15.79:0/3291563322 shutdown_connections 2024-04-25T02:17:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.572+0000 7f4a844ee640 1 -- 172.21.15.79:0/3291563322 wait complete. 2024-04-25T02:17:25.591 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T02:17:25.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.689+0000 7f121df14640 1 Processor -- start 2024-04-25T02:17:25.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.689+0000 7f121df14640 1 -- start start 2024-04-25T02:17:25.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f121df14640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f121806e290 0x7f121815b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:25.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f121df14640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12180b2da0 con 0x7f12180b4e10 2024-04-25T02:17:25.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f121df14640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12180b3080 con 0x7f1218151780 2024-04-25T02:17:25.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f121df14640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f12180b3e40 con 0x7f121806e290 2024-04-25T02:17:25.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1217fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f12180b4e10 0x7f12180cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49374/0 (socket says 172.21.15.79:49374) 2024-04-25T02:17:25.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1217fff640 1 -- 172.21.15.79:0/3566520454 learned_addr learned my addr 172.21.15.79:0/3566520454 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:25.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f120ffff640 1 --2- 172.21.15.79:0/3566520454 >> v2:172.21.15.189:3300/0 conn(0x7f121806e290 0x7f121815b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:25.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1216ffd640 1 -- 172.21.15.79:0/3566520454 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2937279643 0 0) 0x7f12180b2da0 con 0x7f12180b4e10 2024-04-25T02:17:25.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1216ffd640 1 -- 172.21.15.79:0/3566520454 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11f8003520 con 0x7f12180b4e10 2024-04-25T02:17:25.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1216ffd640 1 -- 172.21.15.79:0/3566520454 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2551944499 0 0) 0x7f11f8003520 con 0x7f12180b4e10 2024-04-25T02:17:25.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1216ffd640 1 -- 172.21.15.79:0/3566520454 >> v2:172.21.15.189:3300/0 conn(0x7f121806e290 msgr2=0x7f121815b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:25.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1216ffd640 1 --2- 172.21.15.79:0/3566520454 >> v2:172.21.15.189:3300/0 conn(0x7f121806e290 0x7f121815b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:25.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1216ffd640 1 -- 172.21.15.79:0/3566520454 >> v1:172.21.15.189:6789/0 conn(0x7f1218151780 legacy=0x7f121806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:25.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1216ffd640 1 -- 172.21.15.79:0/3566520454 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12180b3360 con 0x7f12180b4e10 2024-04-25T02:17:25.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1216ffd640 1 -- 172.21.15.79:0/3566520454 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f12100019f0 con 0x7f12180b4e10 2024-04-25T02:17:25.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1216ffd640 1 -- 172.21.15.79:0/3566520454 >> v1:172.21.15.79:6789/0 conn(0x7f12180b4e10 legacy=0x7f12180cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:25.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1216ffd640 1 --2- 172.21.15.79:0/3566520454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f80039b0 0x7f11f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:25.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1216ffd640 1 --2- 172.21.15.79:0/3566520454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f11f8004800 0x7f11f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:25.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1216ffd640 1 --2- 172.21.15.79:0/3566520454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f80051c0 0x7f11f800cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:25.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1216ffd640 1 -- 172.21.15.79:0/3566520454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f12180b3e40 con 0x7f11f80039b0 2024-04-25T02:17:25.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1216ffd640 1 -- 172.21.15.79:0/3566520454 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f11f800d170 con 0x7f11f80051c0 2024-04-25T02:17:25.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f1216ffd640 1 -- 172.21.15.79:0/3566520454 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f11f800d370 con 0x7f11f8004800 2024-04-25T02:17:25.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.690+0000 7f12177fe640 1 --2- 172.21.15.79:0/3566520454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f80039b0 0x7f11f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:25.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.691+0000 7f1217fff640 1 --2- 172.21.15.79:0/3566520454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f80051c0 0x7f11f800cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.691+0000 7f120ffff640 1 --2- 172.21.15.79:0/3566520454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f11f8004800 0x7f11f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.691+0000 7f12177fe640 1 -- 172.21.15.79:0/3566520454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f11f8004800 msgr2=0x7f11f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.691+0000 7f12177fe640 1 --2- 172.21.15.79:0/3566520454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f11f8004800 0x7f11f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.691+0000 7f12177fe640 1 -- 172.21.15.79:0/3566520454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f80051c0 msgr2=0x7f11f800cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.691+0000 7f12177fe640 1 --2- 172.21.15.79:0/3566520454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f80051c0 0x7f11f800cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.691+0000 7f12177fe640 1 -- 172.21.15.79:0/3566520454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f8003520 con 0x7f11f80039b0 2024-04-25T02:17:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.691+0000 7f1217fff640 1 --2- 172.21.15.79:0/3566520454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f80051c0 0x7f11f800cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.691+0000 7f1217fff640 1 -- 172.21.15.79:0/3566520454 reap_dead start 2024-04-25T02:17:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.691+0000 7f12177fe640 1 --2- 172.21.15.79:0/3566520454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f80039b0 0x7f11f8003dd0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f1208001750 tx=0x7f11f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386051a995a4e6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.692+0000 7f1216ffd640 1 -- 172.21.15.79:0/3566520454 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1208001370 con 0x7f11f80039b0 2024-04-25T02:17:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.692+0000 7f1216ffd640 1 -- 172.21.15.79:0/3566520454 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12080052d0 con 0x7f11f80039b0 2024-04-25T02:17:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.692+0000 7f1216ffd640 1 -- 172.21.15.79:0/3566520454 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120802abc0 con 0x7f11f80039b0 2024-04-25T02:17:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.692+0000 7f121df14640 1 -- 172.21.15.79:0/3566520454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f80039b0 msgr2=0x7f11f8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:25.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.692+0000 7f121df14640 1 --2- 172.21.15.79:0/3566520454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f80039b0 0x7f11f8003dd0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f1208001750 tx=0x7f11f8005830 comp rx=0 tx=0).stop 2024-04-25T02:17:25.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.692+0000 7f121df14640 1 -- 172.21.15.79:0/3566520454 shutdown_connections 2024-04-25T02:17:25.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.692+0000 7f121df14640 1 --2- 172.21.15.79:0/3566520454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f80039b0 0x7f11f8003dd0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:25.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.692+0000 7f121df14640 1 -- 172.21.15.79:0/3566520454 >> 172.21.15.79:0/3566520454 conn(0x7f121806b4a0 msgr2=0x7f121806b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:25.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.692+0000 7f121df14640 1 -- 172.21.15.79:0/3566520454 shutdown_connections 2024-04-25T02:17:25.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.692+0000 7f121df14640 1 -- 172.21.15.79:0/3566520454 wait complete. 2024-04-25T02:17:25.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.693+0000 7f121df14640 1 Processor -- start 2024-04-25T02:17:25.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.693+0000 7f121df14640 1 -- start start 2024-04-25T02:17:25.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.694+0000 7f121df14640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f80039b0 0x7f12180cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:25.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.694+0000 7f121df14640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1218154860 0x7f1218151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:25.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.694+0000 7f121df14640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12181522b0 0x7f1218070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:25.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.694+0000 7f121df14640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1218151b60 con 0x7f1218154860 2024-04-25T02:17:25.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.694+0000 7f121df14640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f12180b3920 con 0x7f11f80039b0 2024-04-25T02:17:25.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.694+0000 7f121df14640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f12180b5240 con 0x7f12181522b0 2024-04-25T02:17:25.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.694+0000 7f120ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1218154860 0x7f1218151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:25.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.694+0000 7f120ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1218154860 0x7f1218151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50194/0 (socket says 172.21.15.79:50194) 2024-04-25T02:17:25.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.694+0000 7f120ffff640 1 -- 172.21.15.79:0/1487309199 learned_addr learned my addr 172.21.15.79:0/1487309199 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:25.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.694+0000 7f120ffff640 1 -- 172.21.15.79:0/1487309199 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12181522b0 msgr2=0x7f1218070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:25.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.694+0000 7f120ffff640 1 --2- 172.21.15.79:0/1487309199 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12181522b0 0x7f1218070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:25.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.694+0000 7f120ffff640 1 -- 172.21.15.79:0/1487309199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f80039b0 msgr2=0x7f12180cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:25.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.694+0000 7f120ffff640 1 --2- 172.21.15.79:0/1487309199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f80039b0 0x7f12180cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:25.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.694+0000 7f120ffff640 1 -- 172.21.15.79:0/1487309199 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1218152730 con 0x7f1218154860 2024-04-25T02:17:25.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.694+0000 7f120ffff640 1 --2- 172.21.15.79:0/1487309199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1218154860 0x7f1218151d70 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f1200011700 tx=0x7f1200011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:25.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.695+0000 7f1214ff9640 1 -- 172.21.15.79:0/1487309199 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120000f8e0 con 0x7f1218154860 2024-04-25T02:17:25.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.695+0000 7f1214ff9640 1 -- 172.21.15.79:0/1487309199 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120000fa80 con 0x7f1218154860 2024-04-25T02:17:25.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.695+0000 7f121df14640 1 -- 172.21.15.79:0/1487309199 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1218152cf0 con 0x7f1218154860 2024-04-25T02:17:25.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.695+0000 7f1214ff9640 1 -- 172.21.15.79:0/1487309199 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120000fe30 con 0x7f1218154860 2024-04-25T02:17:25.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.695+0000 7f121df14640 1 -- 172.21.15.79:0/1487309199 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12181532b0 con 0x7f1218154860 2024-04-25T02:17:25.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.696+0000 7f121df14640 1 -- 172.21.15.79:0/1487309199 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12180690a0 con 0x7f1218154860 2024-04-25T02:17:25.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.696+0000 7f1214ff9640 1 -- 172.21.15.79:0/1487309199 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1200015460 con 0x7f1218154860 2024-04-25T02:17:25.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.696+0000 7f1214ff9640 1 --2- 172.21.15.79:0/1487309199 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11fc06be30 0x7f11fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:25.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.696+0000 7f1214ff9640 1 -- 172.21.15.79:0/1487309199 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5443+0+0 (secure 0 0 0) 0x7f120008b5e0 con 0x7f1218154860 2024-04-25T02:17:25.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.696+0000 7f12177fe640 1 --2- 172.21.15.79:0/1487309199 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11fc06be30 0x7f11fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:25.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.697+0000 7f12177fe640 1 --2- 172.21.15.79:0/1487309199 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11fc06be30 0x7f11fc06e2f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1208032000 tx=0x7f120802c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:25.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.701+0000 7f1214ff9640 1 -- 172.21.15.79:0/1487309199 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1200019030 con 0x7f1218154860 2024-04-25T02:17:25.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:25.876+0000 7f121df14640 1 -- 172.21.15.79:0/1487309199 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f12180b46e0 con 0x7f1218154860 2024-04-25T02:17:26.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.575+0000 7f1214ff9640 1 -- 172.21.15.79:0/1487309199 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) ==== 169+0+0 (secure 0 0 0) 0x7f1200059a40 con 0x7f1218154860 2024-04-25T02:17:26.580 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-04-25T02:17:26.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.580+0000 7f121df14640 1 -- 172.21.15.79:0/1487309199 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11fc06be30 msgr2=0x7f11fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.580+0000 7f121df14640 1 --2- 172.21.15.79:0/1487309199 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11fc06be30 0x7f11fc06e2f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1208032000 tx=0x7f120802c000 comp rx=0 tx=0).stop 2024-04-25T02:17:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.580+0000 7f121df14640 1 -- 172.21.15.79:0/1487309199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1218154860 msgr2=0x7f1218151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.580+0000 7f121df14640 1 --2- 172.21.15.79:0/1487309199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1218154860 0x7f1218151d70 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f1200011700 tx=0x7f1200011bc0 comp rx=0 tx=0).stop 2024-04-25T02:17:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.580+0000 7f121df14640 1 -- 172.21.15.79:0/1487309199 shutdown_connections 2024-04-25T02:17:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.580+0000 7f121df14640 1 --2- 172.21.15.79:0/1487309199 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11fc06be30 0x7f11fc06e2f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.580+0000 7f121df14640 1 --2- 172.21.15.79:0/1487309199 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12181522b0 0x7f1218070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.580+0000 7f121df14640 1 --2- 172.21.15.79:0/1487309199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1218154860 0x7f1218151d70 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.580+0000 7f121df14640 1 --2- 172.21.15.79:0/1487309199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f80039b0 0x7f12180cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.580+0000 7f121df14640 1 -- 172.21.15.79:0/1487309199 >> 172.21.15.79:0/1487309199 conn(0x7f121806b4a0 msgr2=0x7f121815c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.580+0000 7f121df14640 1 -- 172.21.15.79:0/1487309199 shutdown_connections 2024-04-25T02:17:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.580+0000 7f121df14640 1 -- 172.21.15.79:0/1487309199 wait complete. 2024-04-25T02:17:26.602 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T02:17:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.701+0000 7fb81d2bd640 1 Processor -- start 2024-04-25T02:17:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.701+0000 7fb81d2bd640 1 -- start start 2024-04-25T02:17:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.702+0000 7fb81d2bd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8180706d0 0x7fb81806dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.702+0000 7fb81d2bd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb81806e1d0 0x7fb8180addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.702+0000 7fb81d2bd640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81806b7c0 con 0x7fb818159d30 2024-04-25T02:17:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.702+0000 7fb81d2bd640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb81815c6d0 con 0x7fb81806e1d0 2024-04-25T02:17:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.702+0000 7fb81d2bd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb81815c990 con 0x7fb8180706d0 2024-04-25T02:17:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.702+0000 7fb8177fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb81806e1d0 0x7fb8180addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.702+0000 7fb80ffff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8180706d0 0x7fb81806dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.702+0000 7fb816ffd640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fb818159d30 0x7fb81806b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:35014/0 (socket says 172.21.15.79:35014) 2024-04-25T02:17:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.702+0000 7fb816ffd640 1 -- 172.21.15.79:0/3227417048 learned_addr learned my addr 172.21.15.79:0/3227417048 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.703+0000 7fb8177fe640 1 -- 172.21.15.79:0/3227417048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8180706d0 msgr2=0x7fb81806dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.703+0000 7fb8177fe640 1 --2- 172.21.15.79:0/3227417048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8180706d0 0x7fb81806dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.703+0000 7fb8177fe640 1 -- 172.21.15.79:0/3227417048 >> v1:172.21.15.189:6789/0 conn(0x7fb818159d30 legacy=0x7fb81806b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.703+0000 7fb8177fe640 1 -- 172.21.15.79:0/3227417048 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81815cc70 con 0x7fb81806e1d0 2024-04-25T02:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.703+0000 7fb80ffff640 1 --2- 172.21.15.79:0/3227417048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8180706d0 0x7fb81806dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.703+0000 7fb8177fe640 1 --2- 172.21.15.79:0/3227417048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb81806e1d0 0x7fb8180addb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb810009d90 tx=0x7fb81002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a16807bae4104ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.704+0000 7fb8167fc640 1 -- 172.21.15.79:0/3227417048 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb810007740 con 0x7fb81806e1d0 2024-04-25T02:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.704+0000 7fb8167fc640 1 -- 172.21.15.79:0/3227417048 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8100078e0 con 0x7fb81806e1d0 2024-04-25T02:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.704+0000 7fb8167fc640 1 -- 172.21.15.79:0/3227417048 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb810007cb0 con 0x7fb81806e1d0 2024-04-25T02:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.704+0000 7fb81d2bd640 1 -- 172.21.15.79:0/3227417048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb81806e1d0 msgr2=0x7fb8180addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.704+0000 7fb81d2bd640 1 --2- 172.21.15.79:0/3227417048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb81806e1d0 0x7fb8180addb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb810009d90 tx=0x7fb81002a660 comp rx=0 tx=0).stop 2024-04-25T02:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.704+0000 7fb81d2bd640 1 -- 172.21.15.79:0/3227417048 shutdown_connections 2024-04-25T02:17:26.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.704+0000 7fb81d2bd640 1 --2- 172.21.15.79:0/3227417048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb81806e1d0 0x7fb8180addb0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:26.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.704+0000 7fb81d2bd640 1 --2- 172.21.15.79:0/3227417048 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8180706d0 0x7fb81806dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:26.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.704+0000 7fb81d2bd640 1 -- 172.21.15.79:0/3227417048 >> 172.21.15.79:0/3227417048 conn(0x7fb8180d0e00 msgr2=0x7fb8180d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:26.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.704+0000 7fb81d2bd640 1 -- 172.21.15.79:0/3227417048 shutdown_connections 2024-04-25T02:17:26.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.704+0000 7fb81d2bd640 1 -- 172.21.15.79:0/3227417048 wait complete. 2024-04-25T02:17:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.705+0000 7fb81d2bd640 1 Processor -- start 2024-04-25T02:17:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.705+0000 7fb81d2bd640 1 -- start start 2024-04-25T02:17:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.706+0000 7fb81d2bd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb81806e1d0 0x7fb818156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.706+0000 7fb81d2bd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8180706d0 0x7fb81815b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.706+0000 7fb81d2bd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb818159d30 0x7fb8180cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.706+0000 7fb81d2bd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb81815d470 con 0x7fb8180706d0 2024-04-25T02:17:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.706+0000 7fb81d2bd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb81806ba50 con 0x7fb818159d30 2024-04-25T02:17:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.706+0000 7fb81d2bd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb8180ae2f0 con 0x7fb81806e1d0 2024-04-25T02:17:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.706+0000 7fb80ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8180706d0 0x7fb81815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.706+0000 7fb80ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8180706d0 0x7fb81815b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50196/0 (socket says 172.21.15.79:50196) 2024-04-25T02:17:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.706+0000 7fb80ffff640 1 -- 172.21.15.79:0/836147954 learned_addr learned my addr 172.21.15.79:0/836147954 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.706+0000 7fb816ffd640 1 --2- 172.21.15.79:0/836147954 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb81806e1d0 0x7fb818156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.706+0000 7fb8177fe640 1 --2- 172.21.15.79:0/836147954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb818159d30 0x7fb8180cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.707+0000 7fb80ffff640 1 -- 172.21.15.79:0/836147954 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb81806e1d0 msgr2=0x7fb818156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.707+0000 7fb80ffff640 1 --2- 172.21.15.79:0/836147954 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb81806e1d0 0x7fb818156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.707+0000 7fb80ffff640 1 -- 172.21.15.79:0/836147954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb818159d30 msgr2=0x7fb8180cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.707+0000 7fb80ffff640 1 --2- 172.21.15.79:0/836147954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb818159d30 0x7fb8180cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.707+0000 7fb80ffff640 1 -- 172.21.15.79:0/836147954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8180d0440 con 0x7fb8180706d0 2024-04-25T02:17:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.707+0000 7fb80ffff640 1 --2- 172.21.15.79:0/836147954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8180706d0 0x7fb81815b500 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fb80000ebe0 tx=0x7fb80000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.707+0000 7fb80f7fe640 1 -- 172.21.15.79:0/836147954 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb800017070 con 0x7fb8180706d0 2024-04-25T02:17:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.707+0000 7fb80f7fe640 1 -- 172.21.15.79:0/836147954 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb80000cbd0 con 0x7fb8180706d0 2024-04-25T02:17:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.707+0000 7fb80f7fe640 1 -- 172.21.15.79:0/836147954 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb800013470 con 0x7fb8180706d0 2024-04-25T02:17:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.707+0000 7fb81d2bd640 1 -- 172.21.15.79:0/836147954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8180d0720 con 0x7fb8180706d0 2024-04-25T02:17:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.707+0000 7fb81d2bd640 1 -- 172.21.15.79:0/836147954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb818155d20 con 0x7fb8180706d0 2024-04-25T02:17:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.708+0000 7fb81d2bd640 1 -- 172.21.15.79:0/836147954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8180690a0 con 0x7fb8180706d0 2024-04-25T02:17:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.708+0000 7fb80f7fe640 1 -- 172.21.15.79:0/836147954 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb80001a070 con 0x7fb8180706d0 2024-04-25T02:17:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.709+0000 7fb80f7fe640 1 --2- 172.21.15.79:0/836147954 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7f806be30 0x7fb7f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.709+0000 7fb80f7fe640 1 -- 172.21.15.79:0/836147954 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5029+0+0 (secure 0 0 0) 0x7fb80008ad60 con 0x7fb8180706d0 2024-04-25T02:17:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.709+0000 7fb816ffd640 1 --2- 172.21.15.79:0/836147954 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7f806be30 0x7fb7f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.709+0000 7fb816ffd640 1 --2- 172.21.15.79:0/836147954 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7f806be30 0x7fb7f806e2f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb808007fd0 tx=0x7fb808007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.713+0000 7fb80f7fe640 1 -- 172.21.15.79:0/836147954 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb8000593f0 con 0x7fb8180706d0 2024-04-25T02:17:26.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.888+0000 7fb81d2bd640 1 -- 172.21.15.79:0/836147954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fb818156120 con 0x7fb8180706d0 2024-04-25T02:17:26.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.891+0000 7fb80f7fe640 1 -- 172.21.15.79:0/836147954 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7fb80005d6f0 con 0x7fb8180706d0 2024-04-25T02:17:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.893+0000 7fb81d2bd640 1 -- 172.21.15.79:0/836147954 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7f806be30 msgr2=0x7fb7f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.893+0000 7fb81d2bd640 1 --2- 172.21.15.79:0/836147954 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7f806be30 0x7fb7f806e2f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb808007fd0 tx=0x7fb808007e80 comp rx=0 tx=0).stop 2024-04-25T02:17:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.893+0000 7fb81d2bd640 1 -- 172.21.15.79:0/836147954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8180706d0 msgr2=0x7fb81815b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.893+0000 7fb81d2bd640 1 --2- 172.21.15.79:0/836147954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8180706d0 0x7fb81815b500 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fb80000ebe0 tx=0x7fb80000c520 comp rx=0 tx=0).stop 2024-04-25T02:17:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.893+0000 7fb81d2bd640 1 -- 172.21.15.79:0/836147954 shutdown_connections 2024-04-25T02:17:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.893+0000 7fb81d2bd640 1 --2- 172.21.15.79:0/836147954 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb7f806be30 0x7fb7f806e2f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.893+0000 7fb81d2bd640 1 --2- 172.21.15.79:0/836147954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb818159d30 0x7fb8180cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.893+0000 7fb81d2bd640 1 --2- 172.21.15.79:0/836147954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8180706d0 0x7fb81815b500 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.893+0000 7fb81d2bd640 1 --2- 172.21.15.79:0/836147954 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb81806e1d0 0x7fb818156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.893+0000 7fb81d2bd640 1 -- 172.21.15.79:0/836147954 >> 172.21.15.79:0/836147954 conn(0x7fb8180d0e00 msgr2=0x7fb818154b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.893+0000 7fb81d2bd640 1 -- 172.21.15.79:0/836147954 shutdown_connections 2024-04-25T02:17:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:26.893+0000 7fb81d2bd640 1 -- 172.21.15.79:0/836147954 wait complete. 2024-04-25T02:17:26.908 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-25T02:17:27.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.001+0000 7f64d03fb640 1 Processor -- start 2024-04-25T02:17:27.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.001+0000 7f64d03fb640 1 -- start start 2024-04-25T02:17:27.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.002+0000 7f64d03fb640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f64c815a720 0x7f64c815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.002+0000 7f64d03fb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64c80b49b0 0x7f64c8070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.002+0000 7f64d03fb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64c815f1c0 con 0x7f64c80d07a0 2024-04-25T02:17:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.002+0000 7f64d03fb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f64c815bb10 con 0x7f64c80b49b0 2024-04-25T02:17:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.002+0000 7f64d03fb640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f64c80b2e60 con 0x7f64c815a720 2024-04-25T02:17:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.002+0000 7f64ce998640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64c80b49b0 0x7f64c8070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.002+0000 7f64cd996640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f64c80d07a0 0x7f64c80b42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49382/0 (socket says 172.21.15.79:49382) 2024-04-25T02:17:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.002+0000 7f64cd996640 1 -- 172.21.15.79:0/1492280560 learned_addr learned my addr 172.21.15.79:0/1492280560 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.002+0000 7f64ce197640 1 --2- 172.21.15.79:0/1492280560 >> v2:172.21.15.189:3300/0 conn(0x7f64c815a720 0x7f64c815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.002+0000 7f64ce998640 1 -- 172.21.15.79:0/1492280560 >> v2:172.21.15.189:3300/0 conn(0x7f64c815a720 msgr2=0x7f64c815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.002+0000 7f64ce998640 1 --2- 172.21.15.79:0/1492280560 >> v2:172.21.15.189:3300/0 conn(0x7f64c815a720 0x7f64c815ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.002+0000 7f64ce998640 1 -- 172.21.15.79:0/1492280560 >> v1:172.21.15.79:6789/0 conn(0x7f64c80d07a0 legacy=0x7f64c80b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.002+0000 7f64ce998640 1 -- 172.21.15.79:0/1492280560 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c80b3140 con 0x7f64c80b49b0 2024-04-25T02:17:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.002+0000 7f64cd195640 1 -- 172.21.15.79:0/1492280560 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1669464855 0 0) 0x7f64c4001110 con 0x7f64c80d07a0 2024-04-25T02:17:27.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.003+0000 7f64ce998640 1 --2- 172.21.15.79:0/1492280560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c80b49b0 0x7f64c8070cf0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f64c8074d80 tx=0x7f64c002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0961e693cffef5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:27.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.003+0000 7f64cd195640 1 -- 172.21.15.79:0/1492280560 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0007740 con 0x7f64c80b49b0 2024-04-25T02:17:27.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.003+0000 7f64cd195640 1 -- 172.21.15.79:0/1492280560 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64c00078e0 con 0x7f64c80b49b0 2024-04-25T02:17:27.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.003+0000 7f64cd195640 1 -- 172.21.15.79:0/1492280560 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0007cb0 con 0x7f64c80b49b0 2024-04-25T02:17:27.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.003+0000 7f64d03fb640 1 -- 172.21.15.79:0/1492280560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c80b49b0 msgr2=0x7f64c8070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.003+0000 7f64d03fb640 1 --2- 172.21.15.79:0/1492280560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c80b49b0 0x7f64c8070cf0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f64c8074d80 tx=0x7f64c002a5f0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.003+0000 7f64d03fb640 1 -- 172.21.15.79:0/1492280560 shutdown_connections 2024-04-25T02:17:27.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.003+0000 7f64d03fb640 1 --2- 172.21.15.79:0/1492280560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c80b49b0 0x7f64c8070cf0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.003+0000 7f64d03fb640 1 --2- 172.21.15.79:0/1492280560 >> v2:172.21.15.189:3300/0 conn(0x7f64c815a720 0x7f64c815ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.003+0000 7f64d03fb640 1 -- 172.21.15.79:0/1492280560 >> 172.21.15.79:0/1492280560 conn(0x7f64c80cfc80 msgr2=0x7f64c80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:27.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.004+0000 7f64d03fb640 1 -- 172.21.15.79:0/1492280560 shutdown_connections 2024-04-25T02:17:27.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.004+0000 7f64d03fb640 1 -- 172.21.15.79:0/1492280560 wait complete. 2024-04-25T02:17:27.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.005+0000 7f64d03fb640 1 Processor -- start 2024-04-25T02:17:27.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.005+0000 7f64d03fb640 1 -- start start 2024-04-25T02:17:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.005+0000 7f64d03fb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c80b49b0 0x7f64c81f4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.005+0000 7f64d03fb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64c80d07a0 0x7f64c8156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.005+0000 7f64d03fb640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f64c815a720 0x7f64c8166400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.005+0000 7f64d03fb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f64c80b39e0 con 0x7f64c80b49b0 2024-04-25T02:17:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.005+0000 7f64d03fb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f64c80b3700 con 0x7f64c80d07a0 2024-04-25T02:17:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.005+0000 7f64d03fb640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f64c806df50 con 0x7f64c815a720 2024-04-25T02:17:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.005+0000 7f64ce197640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c80b49b0 0x7f64c81f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.005+0000 7f64ce197640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c80b49b0 0x7f64c81f4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50228/0 (socket says 172.21.15.79:50228) 2024-04-25T02:17:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.005+0000 7f64ce197640 1 -- 172.21.15.79:0/21699852 learned_addr learned my addr 172.21.15.79:0/21699852 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.006+0000 7f64ce998640 1 --2- 172.21.15.79:0/21699852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f64c815a720 0x7f64c8166400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.006+0000 7f64cd996640 1 --2- 172.21.15.79:0/21699852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64c80d07a0 0x7f64c8156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.006+0000 7f64ce197640 1 -- 172.21.15.79:0/21699852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f64c815a720 msgr2=0x7f64c8166400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.006+0000 7f64ce197640 1 --2- 172.21.15.79:0/21699852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f64c815a720 0x7f64c8166400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.006+0000 7f64ce197640 1 -- 172.21.15.79:0/21699852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64c80d07a0 msgr2=0x7f64c8156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.006+0000 7f64ce197640 1 --2- 172.21.15.79:0/21699852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64c80d07a0 0x7f64c8156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.006+0000 7f64ce197640 1 -- 172.21.15.79:0/21699852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c81f4dd0 con 0x7f64c80b49b0 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.006+0000 7f64ce998640 1 --2- 172.21.15.79:0/21699852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f64c815a720 0x7f64c8166400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.006+0000 7f64ce197640 1 --2- 172.21.15.79:0/21699852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c80b49b0 0x7f64c81f4890 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f64b800d620 tx=0x7f64b800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.006+0000 7f64beffd640 1 -- 172.21.15.79:0/21699852 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b800b620 con 0x7f64c80b49b0 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.006+0000 7f64beffd640 1 -- 172.21.15.79:0/21699852 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b8019070 con 0x7f64c80b49b0 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.006+0000 7f64beffd640 1 -- 172.21.15.79:0/21699852 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b800ba00 con 0x7f64c80b49b0 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.006+0000 7f64d03fb640 1 -- 172.21.15.79:0/21699852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c81575d0 con 0x7f64c80b49b0 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.006+0000 7f64d03fb640 1 -- 172.21.15.79:0/21699852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c8157b90 con 0x7f64c80b49b0 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.007+0000 7f64d03fb640 1 -- 172.21.15.79:0/21699852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c80690a0 con 0x7f64c80b49b0 2024-04-25T02:17:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.007+0000 7f64beffd640 1 -- 172.21.15.79:0/21699852 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f64b800bba0 con 0x7f64c80b49b0 2024-04-25T02:17:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.008+0000 7f64beffd640 1 --2- 172.21.15.79:0/21699852 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f64ac06be60 0x7f64ac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.008+0000 7f64cd996640 1 --2- 172.21.15.79:0/21699852 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f64ac06be60 0x7f64ac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.008+0000 7f64beffd640 1 -- 172.21.15.79:0/21699852 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5029+0+0 (secure 0 0 0) 0x7f64b808b020 con 0x7f64c80b49b0 2024-04-25T02:17:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.008+0000 7f64cd996640 1 --2- 172.21.15.79:0/21699852 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f64ac06be60 0x7f64ac06e320 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f64c814f340 tx=0x7f64c4007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:27.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.012+0000 7f64beffd640 1 -- 172.21.15.79:0/21699852 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f64b8059be0 con 0x7f64c80b49b0 2024-04-25T02:17:27.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.255+0000 7f64d03fb640 1 -- 172.21.15.79:0/21699852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) -- 0x7f64c806c0c0 con 0x7f64c80b49b0 2024-04-25T02:17:27.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.577+0000 7f64beffd640 1 -- 172.21.15.79:0/21699852 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v438) ==== 146+0+0 (secure 0 0 0) 0x7f64b80594e0 con 0x7f64c80b49b0 2024-04-25T02:17:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.579+0000 7f64d03fb640 1 -- 172.21.15.79:0/21699852 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f64ac06be60 msgr2=0x7f64ac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.579+0000 7f64d03fb640 1 --2- 172.21.15.79:0/21699852 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f64ac06be60 0x7f64ac06e320 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f64c814f340 tx=0x7f64c4007970 comp rx=0 tx=0).stop 2024-04-25T02:17:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.579+0000 7f64d03fb640 1 -- 172.21.15.79:0/21699852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c80b49b0 msgr2=0x7f64c81f4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.579+0000 7f64d03fb640 1 --2- 172.21.15.79:0/21699852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c80b49b0 0x7f64c81f4890 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f64b800d620 tx=0x7f64b800dae0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.579+0000 7f64d03fb640 1 -- 172.21.15.79:0/21699852 shutdown_connections 2024-04-25T02:17:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.579+0000 7f64d03fb640 1 --2- 172.21.15.79:0/21699852 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f64ac06be60 0x7f64ac06e320 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.579+0000 7f64d03fb640 1 --2- 172.21.15.79:0/21699852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f64c815a720 0x7f64c8166400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.579+0000 7f64d03fb640 1 --2- 172.21.15.79:0/21699852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64c80d07a0 0x7f64c8156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.579+0000 7f64d03fb640 1 --2- 172.21.15.79:0/21699852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c80b49b0 0x7f64c81f4890 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.579+0000 7f64d03fb640 1 -- 172.21.15.79:0/21699852 >> 172.21.15.79:0/21699852 conn(0x7f64c80cfc80 msgr2=0x7f64c8070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.579+0000 7f64d03fb640 1 -- 172.21.15.79:0/21699852 shutdown_connections 2024-04-25T02:17:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.579+0000 7f64d03fb640 1 -- 172.21.15.79:0/21699852 wait complete. 2024-04-25T02:17:27.595 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T02:17:27.595 INFO:tasks.cephfs_test_runner:Starting test: test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T02:17:27.595 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:17:27.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.688+0000 7ffbbb753640 1 Processor -- start 2024-04-25T02:17:27.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.688+0000 7ffbbb753640 1 -- start start 2024-04-25T02:17:27.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.689+0000 7ffbbb753640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffbb406e3e0 0x7ffbb4071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.689+0000 7ffbbb753640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb4070d90 con 0x7ffbb406df50 2024-04-25T02:17:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.689+0000 7ffbbb753640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb40cf130 con 0x7ffbb4144cb0 2024-04-25T02:17:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.689+0000 7ffbbb753640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ffbb40cf410 con 0x7ffbb406e3e0 2024-04-25T02:17:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.689+0000 7ffbb9cf0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffbb406e3e0 0x7ffbb4071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.689+0000 7ffbb8cee640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ffbb406df50 0x7ffbb4071240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49392/0 (socket says 172.21.15.79:49392) 2024-04-25T02:17:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.689+0000 7ffbb8cee640 1 -- 172.21.15.79:0/1832005377 learned_addr learned my addr 172.21.15.79:0/1832005377 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.689+0000 7ffbb9cf0640 1 -- 172.21.15.79:0/1832005377 >> v1:172.21.15.189:6789/0 conn(0x7ffbb4144cb0 legacy=0x7ffbb40b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.689+0000 7ffbb9cf0640 1 -- 172.21.15.79:0/1832005377 >> v1:172.21.15.79:6789/0 conn(0x7ffbb406df50 legacy=0x7ffbb4071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.689+0000 7ffbb9cf0640 1 -- 172.21.15.79:0/1832005377 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb40cf6f0 con 0x7ffbb406e3e0 2024-04-25T02:17:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.689+0000 7ffbabfff640 1 -- 172.21.15.79:0/1832005377 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721461917 0 0) 0x7ffbb4070d90 con 0x7ffbb406df50 2024-04-25T02:17:27.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.690+0000 7ffbb9cf0640 1 --2- 172.21.15.79:0/1832005377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbb406e3e0 0x7ffbb4071950 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009d90 tx=0x7ffbac02a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfbd34e0bec33de8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.690+0000 7ffbabfff640 1 -- 172.21.15.79:0/1832005377 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac007740 con 0x7ffbb406e3e0 2024-04-25T02:17:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.690+0000 7ffbabfff640 1 -- 172.21.15.79:0/1832005377 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbac0078e0 con 0x7ffbb406e3e0 2024-04-25T02:17:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.690+0000 7ffbabfff640 1 -- 172.21.15.79:0/1832005377 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac007cb0 con 0x7ffbb406e3e0 2024-04-25T02:17:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.690+0000 7ffbbb753640 1 -- 172.21.15.79:0/1832005377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbb406e3e0 msgr2=0x7ffbb4071950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.690+0000 7ffbbb753640 1 --2- 172.21.15.79:0/1832005377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbb406e3e0 0x7ffbb4071950 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009d90 tx=0x7ffbac02a580 comp rx=0 tx=0).stop 2024-04-25T02:17:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.690+0000 7ffbbb753640 1 -- 172.21.15.79:0/1832005377 shutdown_connections 2024-04-25T02:17:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.690+0000 7ffbbb753640 1 --2- 172.21.15.79:0/1832005377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbb406e3e0 0x7ffbb4071950 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.691+0000 7ffbbb753640 1 -- 172.21.15.79:0/1832005377 >> 172.21.15.79:0/1832005377 conn(0x7ffbb40cfc80 msgr2=0x7ffbb40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.691+0000 7ffbbb753640 1 -- 172.21.15.79:0/1832005377 shutdown_connections 2024-04-25T02:17:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.691+0000 7ffbbb753640 1 -- 172.21.15.79:0/1832005377 wait complete. 2024-04-25T02:17:27.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.692+0000 7ffbbb753640 1 Processor -- start 2024-04-25T02:17:27.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.692+0000 7ffbbb753640 1 -- start start 2024-04-25T02:17:27.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.692+0000 7ffbbb753640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbb406df50 0x7ffbb415c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.692+0000 7ffbbb753640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbb406e3e0 0x7ffbb40ab840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.692+0000 7ffbbb753640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffbb4144cb0 0x7ffbb40abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.692+0000 7ffbbb753640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb40cf9d0 con 0x7ffbb406df50 2024-04-25T02:17:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.692+0000 7ffbbb753640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb40b5750 con 0x7ffbb406e3e0 2024-04-25T02:17:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.692+0000 7ffbbb753640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffbb4145090 con 0x7ffbb4144cb0 2024-04-25T02:17:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffbb94ef640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbb406df50 0x7ffbb415c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffbb94ef640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbb406df50 0x7ffbb415c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50254/0 (socket says 172.21.15.79:50254) 2024-04-25T02:17:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffbb94ef640 1 -- 172.21.15.79:0/1754576789 learned_addr learned my addr 172.21.15.79:0/1754576789 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffbb8cee640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbb406e3e0 0x7ffbb40ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffbb9cf0640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffbb4144cb0 0x7ffbb40abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffbb94ef640 1 -- 172.21.15.79:0/1754576789 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffbb4144cb0 msgr2=0x7ffbb40abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffbb94ef640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffbb4144cb0 0x7ffbb40abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffbb94ef640 1 -- 172.21.15.79:0/1754576789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbb406e3e0 msgr2=0x7ffbb40ab840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffbb94ef640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbb406e3e0 0x7ffbb40ab840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffbb94ef640 1 -- 172.21.15.79:0/1754576789 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb40aa240 con 0x7ffbb406df50 2024-04-25T02:17:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffbb9cf0640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffbb4144cb0 0x7ffbb40abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:27.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffbb8cee640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbb406e3e0 0x7ffbb40ab840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:27.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffbb94ef640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbb406df50 0x7ffbb415c890 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000b3f0 tx=0x7ffbb000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:27.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffba9ffb640 1 -- 172.21.15.79:0/1754576789 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0015020 con 0x7ffbb406df50 2024-04-25T02:17:27.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffba9ffb640 1 -- 172.21.15.79:0/1754576789 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb0011830 con 0x7ffbb406df50 2024-04-25T02:17:27.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffba9ffb640 1 -- 172.21.15.79:0/1754576789 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0011c20 con 0x7ffbb406df50 2024-04-25T02:17:27.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffbbb753640 1 -- 172.21.15.79:0/1754576789 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb40aa520 con 0x7ffbb406df50 2024-04-25T02:17:27.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.693+0000 7ffbbb753640 1 -- 172.21.15.79:0/1754576789 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb40aaae0 con 0x7ffbb406df50 2024-04-25T02:17:27.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.694+0000 7ffbbb753640 1 -- 172.21.15.79:0/1754576789 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbb40690a0 con 0x7ffbb406df50 2024-04-25T02:17:27.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.695+0000 7ffba9ffb640 1 -- 172.21.15.79:0/1754576789 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffbb0018020 con 0x7ffbb406df50 2024-04-25T02:17:27.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.695+0000 7ffba9ffb640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffb9806be30 0x7ffb9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.695+0000 7ffba9ffb640 1 -- 172.21.15.79:0/1754576789 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5029+0+0 (secure 0 0 0) 0x7ffbb008a860 con 0x7ffbb406df50 2024-04-25T02:17:27.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.695+0000 7ffbb8cee640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffb9806be30 0x7ffb9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.696+0000 7ffbb8cee640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffb9806be30 0x7ffb9806e2f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ffba4000f60 tx=0x7ffba4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:27.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.700+0000 7ffba9ffb640 1 -- 172.21.15.79:0/1754576789 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffbb001f030 con 0x7ffbb406df50 2024-04-25T02:17:27.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.876+0000 7ffbbb753640 1 -- 172.21.15.79:0/1754576789 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffbb40d0b90 con 0x7ffbb406df50 2024-04-25T02:17:27.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.877+0000 7ffba9ffb640 1 -- 172.21.15.79:0/1754576789 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+13172 (secure 0 0 0) 0x7ffbb00172c0 con 0x7ffbb406df50 2024-04-25T02:17:27.881 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:27.881 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":106,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:17:26.569345+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/2550458851":"2024-04-26T02:17:19.739687+0000","172.21.15.79:6834/2550458851":"2024-04-26T02:17:19.739687+0000","172.21.15.79:6837/2774759267":"2024-04-26T02:16:43.461186+0000","172.21.15.79:6834/2774759267":"2024-04-26T02:16:43.461186+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:17:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.879+0000 7ffbbb753640 1 -- 172.21.15.79:0/1754576789 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffb9806be30 msgr2=0x7ffb9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.879+0000 7ffbbb753640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffb9806be30 0x7ffb9806e2f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ffba4000f60 tx=0x7ffba4009040 comp rx=0 tx=0).stop 2024-04-25T02:17:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.879+0000 7ffbbb753640 1 -- 172.21.15.79:0/1754576789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbb406df50 msgr2=0x7ffbb415c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.879+0000 7ffbbb753640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbb406df50 0x7ffbb415c890 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000b3f0 tx=0x7ffbb000b8b0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.879+0000 7ffbbb753640 1 -- 172.21.15.79:0/1754576789 shutdown_connections 2024-04-25T02:17:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.879+0000 7ffbbb753640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffb9806be30 0x7ffb9806e2f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.879+0000 7ffbbb753640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffbb4144cb0 0x7ffbb40abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.879+0000 7ffbbb753640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbb406e3e0 0x7ffbb40ab840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.879+0000 7ffbbb753640 1 --2- 172.21.15.79:0/1754576789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbb406df50 0x7ffbb415c890 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.879+0000 7ffbbb753640 1 -- 172.21.15.79:0/1754576789 >> 172.21.15.79:0/1754576789 conn(0x7ffbb40cfc80 msgr2=0x7ffbb40718a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.879+0000 7ffbbb753640 1 -- 172.21.15.79:0/1754576789 shutdown_connections 2024-04-25T02:17:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.879+0000 7ffbbb753640 1 -- 172.21.15.79:0/1754576789 wait complete. 2024-04-25T02:17:27.894 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:17:27.894 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:17:27.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.989+0000 7fb75ca76640 1 Processor -- start 2024-04-25T02:17:27.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.989+0000 7fb75ca76640 1 -- start start 2024-04-25T02:17:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.990+0000 7fb75ca76640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb75806b2f0 0x7fb7580b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.990+0000 7fb75ca76640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb75806e6b0 0x7fb75815b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.990+0000 7fb75ca76640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb75815ec20 con 0x7fb7580cf7a0 2024-04-25T02:17:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.990+0000 7fb75ca76640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb75815f830 con 0x7fb75806b2f0 2024-04-25T02:17:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.990+0000 7fb75ca76640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb75815ef00 con 0x7fb75806e6b0 2024-04-25T02:17:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.990+0000 7fb755d9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb7580cf7a0 0x7fb75806b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49394/0 (socket says 172.21.15.79:49394) 2024-04-25T02:17:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.990+0000 7fb755d9b640 1 -- 172.21.15.79:0/4287859112 learned_addr learned my addr 172.21.15.79:0/4287859112 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.990+0000 7fb75559a640 1 -- 172.21.15.79:0/4287859112 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1311027851 0 0) 0x7fb75815ec20 con 0x7fb7580cf7a0 2024-04-25T02:17:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75559a640 1 -- 172.21.15.79:0/4287859112 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb740003520 con 0x7fb7580cf7a0 2024-04-25T02:17:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb756d9d640 1 --2- 172.21.15.79:0/4287859112 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb75806e6b0 0x7fb75815b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75659c640 1 --2- 172.21.15.79:0/4287859112 >> v2:172.21.15.189:3300/0 conn(0x7fb75806b2f0 0x7fb7580b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75559a640 1 -- 172.21.15.79:0/4287859112 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2937452558 0 0) 0x7fb740003520 con 0x7fb7580cf7a0 2024-04-25T02:17:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75559a640 1 -- 172.21.15.79:0/4287859112 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb75806e6b0 msgr2=0x7fb75815b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75559a640 1 --2- 172.21.15.79:0/4287859112 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb75806e6b0 0x7fb75815b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75559a640 1 -- 172.21.15.79:0/4287859112 >> v2:172.21.15.189:3300/0 conn(0x7fb75806b2f0 msgr2=0x7fb7580b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75559a640 1 --2- 172.21.15.79:0/4287859112 >> v2:172.21.15.189:3300/0 conn(0x7fb75806b2f0 0x7fb7580b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75559a640 1 -- 172.21.15.79:0/4287859112 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75815f1e0 con 0x7fb7580cf7a0 2024-04-25T02:17:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75559a640 1 -- 172.21.15.79:0/4287859112 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fb74c001670 con 0x7fb7580cf7a0 2024-04-25T02:17:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75559a640 1 -- 172.21.15.79:0/4287859112 >> v1:172.21.15.79:6789/0 conn(0x7fb7580cf7a0 legacy=0x7fb75806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75559a640 1 --2- 172.21.15.79:0/4287859112 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb75806e6b0 0x7fb7400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75559a640 1 --2- 172.21.15.79:0/4287859112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb740003fe0 0x7fb740004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75559a640 1 --2- 172.21.15.79:0/4287859112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb740004d40 0x7fb7400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75559a640 1 -- 172.21.15.79:0/4287859112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb75815f830 con 0x7fb740004d40 2024-04-25T02:17:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75559a640 1 -- 172.21.15.79:0/4287859112 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb75815ef00 con 0x7fb740003fe0 2024-04-25T02:17:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75559a640 1 -- 172.21.15.79:0/4287859112 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb74000bb80 con 0x7fb75806e6b0 2024-04-25T02:17:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb756d9d640 1 --2- 172.21.15.79:0/4287859112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb740004d40 0x7fb7400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb75659c640 1 --2- 172.21.15.79:0/4287859112 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb75806e6b0 0x7fb7400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb755d9b640 1 --2- 172.21.15.79:0/4287859112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb740003fe0 0x7fb740004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb756d9d640 1 -- 172.21.15.79:0/4287859112 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb75806e6b0 msgr2=0x7fb7400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb756d9d640 1 --2- 172.21.15.79:0/4287859112 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb75806e6b0 0x7fb7400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb756d9d640 1 -- 172.21.15.79:0/4287859112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb740003fe0 msgr2=0x7fb740004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb756d9d640 1 --2- 172.21.15.79:0/4287859112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb740003fe0 0x7fb740004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.991+0000 7fb756d9d640 1 -- 172.21.15.79:0/4287859112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb740003520 con 0x7fb740004d40 2024-04-25T02:17:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.992+0000 7fb756d9d640 1 --2- 172.21.15.79:0/4287859112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb740004d40 0x7fb7400051c0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fb75000ba30 tx=0x7fb740005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942d43f67edf2c4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.992+0000 7fb75559a640 1 -- 172.21.15.79:0/4287859112 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750030070 con 0x7fb740004d40 2024-04-25T02:17:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.992+0000 7fb75559a640 1 -- 172.21.15.79:0/4287859112 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb75002ade0 con 0x7fb740004d40 2024-04-25T02:17:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.992+0000 7fb75559a640 1 -- 172.21.15.79:0/4287859112 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75000b600 con 0x7fb740004d40 2024-04-25T02:17:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.993+0000 7fb75ca76640 1 -- 172.21.15.79:0/4287859112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb740004d40 msgr2=0x7fb7400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.993+0000 7fb75ca76640 1 --2- 172.21.15.79:0/4287859112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb740004d40 0x7fb7400051c0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fb75000ba30 tx=0x7fb740005830 comp rx=0 tx=0).stop 2024-04-25T02:17:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.993+0000 7fb756d9d640 1 -- 172.21.15.79:0/4287859112 reap_dead start 2024-04-25T02:17:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.993+0000 7fb75ca76640 1 -- 172.21.15.79:0/4287859112 shutdown_connections 2024-04-25T02:17:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.993+0000 7fb75ca76640 1 -- 172.21.15.79:0/4287859112 >> 172.21.15.79:0/4287859112 conn(0x7fb7580b1cd0 msgr2=0x7fb7580b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.993+0000 7fb75ca76640 1 -- 172.21.15.79:0/4287859112 shutdown_connections 2024-04-25T02:17:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.993+0000 7fb75ca76640 1 -- 172.21.15.79:0/4287859112 wait complete. 2024-04-25T02:17:28.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.994+0000 7fb75ca76640 1 Processor -- start 2024-04-25T02:17:28.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.994+0000 7fb75ca76640 1 -- start start 2024-04-25T02:17:28.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb75ca76640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb740004d40 0x7fb75809b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb75ca76640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb75809ca40 0x7fb758156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb75ca76640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7581efd00 0x7fb7581e5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb75ca76640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb75806d160 con 0x7fb75809ca40 2024-04-25T02:17:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb75ca76640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb75806cfe0 con 0x7fb7581efd00 2024-04-25T02:17:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb75ca76640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb7580cc6f0 con 0x7fb740004d40 2024-04-25T02:17:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb755d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb75809ca40 0x7fb758156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb755d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb75809ca40 0x7fb758156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50272/0 (socket says 172.21.15.79:50272) 2024-04-25T02:17:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb755d9b640 1 -- 172.21.15.79:0/3267028146 learned_addr learned my addr 172.21.15.79:0/3267028146 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb75659c640 1 --2- 172.21.15.79:0/3267028146 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb740004d40 0x7fb75809b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb755d9b640 1 -- 172.21.15.79:0/3267028146 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb740004d40 msgr2=0x7fb75809b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb755d9b640 1 --2- 172.21.15.79:0/3267028146 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb740004d40 0x7fb75809b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb755d9b640 1 -- 172.21.15.79:0/3267028146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7581efd00 msgr2=0x7fb7581e5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb755d9b640 1 --2- 172.21.15.79:0/3267028146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7581efd00 0x7fb7581e5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb755d9b640 1 -- 172.21.15.79:0/3267028146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75809b9c0 con 0x7fb75809ca40 2024-04-25T02:17:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb75659c640 1 --2- 172.21.15.79:0/3267028146 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb740004d40 0x7fb75809b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb755d9b640 1 --2- 172.21.15.79:0/3267028146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb75809ca40 0x7fb758156780 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fb74c001a70 tx=0x7fb74c0077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb746ffd640 1 -- 172.21.15.79:0/3267028146 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c00f940 con 0x7fb75809ca40 2024-04-25T02:17:28.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb746ffd640 1 -- 172.21.15.79:0/3267028146 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb74c018070 con 0x7fb75809ca40 2024-04-25T02:17:28.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb75ca76640 1 -- 172.21.15.79:0/3267028146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7581572d0 con 0x7fb75809ca40 2024-04-25T02:17:28.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb746ffd640 1 -- 172.21.15.79:0/3267028146 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c00fd20 con 0x7fb75809ca40 2024-04-25T02:17:28.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.995+0000 7fb75ca76640 1 -- 172.21.15.79:0/3267028146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb758157890 con 0x7fb75809ca40 2024-04-25T02:17:28.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.996+0000 7fb75ca76640 1 -- 172.21.15.79:0/3267028146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7580690a0 con 0x7fb75809ca40 2024-04-25T02:17:28.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.997+0000 7fb746ffd640 1 -- 172.21.15.79:0/3267028146 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb74c01d460 con 0x7fb75809ca40 2024-04-25T02:17:28.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.997+0000 7fb746ffd640 1 --2- 172.21.15.79:0/3267028146 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb73806bdd0 0x7fb73806e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.997+0000 7fb746ffd640 1 -- 172.21.15.79:0/3267028146 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5029+0+0 (secure 0 0 0) 0x7fb74c08ad50 con 0x7fb75809ca40 2024-04-25T02:17:28.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.997+0000 7fb75659c640 1 --2- 172.21.15.79:0/3267028146 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb73806bdd0 0x7fb73806e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:27.998+0000 7fb75659c640 1 --2- 172.21.15.79:0/3267028146 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb73806bdd0 0x7fb73806e290 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb748003b80 tx=0x7fb748009760 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:28.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.002+0000 7fb746ffd640 1 -- 172.21.15.79:0/3267028146 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb74c08e030 con 0x7fb75809ca40 2024-04-25T02:17:28.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.174+0000 7fb75ca76640 1 -- 172.21.15.79:0/3267028146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb7580cc460 con 0x7fb75809ca40 2024-04-25T02:17:28.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.174+0000 7fb746ffd640 1 -- 172.21.15.79:0/3267028146 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) ==== 93+0+10 (secure 0 0 0) 0x7fb75809b9c0 con 0x7fb75809ca40 2024-04-25T02:17:28.179 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:17:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.176+0000 7fb75ca76640 1 -- 172.21.15.79:0/3267028146 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb73806bdd0 msgr2=0x7fb73806e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.176+0000 7fb75ca76640 1 --2- 172.21.15.79:0/3267028146 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb73806bdd0 0x7fb73806e290 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb748003b80 tx=0x7fb748009760 comp rx=0 tx=0).stop 2024-04-25T02:17:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.176+0000 7fb75ca76640 1 -- 172.21.15.79:0/3267028146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb75809ca40 msgr2=0x7fb758156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.176+0000 7fb75ca76640 1 --2- 172.21.15.79:0/3267028146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb75809ca40 0x7fb758156780 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fb74c001a70 tx=0x7fb74c0077a0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.176+0000 7fb75ca76640 1 -- 172.21.15.79:0/3267028146 shutdown_connections 2024-04-25T02:17:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.176+0000 7fb75ca76640 1 --2- 172.21.15.79:0/3267028146 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb73806bdd0 0x7fb73806e290 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.176+0000 7fb75ca76640 1 --2- 172.21.15.79:0/3267028146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7581efd00 0x7fb7581e5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.176+0000 7fb75ca76640 1 --2- 172.21.15.79:0/3267028146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb75809ca40 0x7fb758156780 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.176+0000 7fb75ca76640 1 --2- 172.21.15.79:0/3267028146 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb740004d40 0x7fb75809b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.176+0000 7fb75ca76640 1 -- 172.21.15.79:0/3267028146 >> 172.21.15.79:0/3267028146 conn(0x7fb7580b1cd0 msgr2=0x7fb7580b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.176+0000 7fb75ca76640 1 -- 172.21.15.79:0/3267028146 shutdown_connections 2024-04-25T02:17:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.176+0000 7fb75ca76640 1 -- 172.21.15.79:0/3267028146 wait complete. 2024-04-25T02:17:28.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-25T02:17:28.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.284+0000 7f990f453640 1 Processor -- start 2024-04-25T02:17:28.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.284+0000 7f990f453640 1 -- start start 2024-04-25T02:17:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.285+0000 7f990f453640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f990806e3b0 0x7f99080b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.285+0000 7f990f453640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9908071e00 con 0x7f990806df50 2024-04-25T02:17:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.285+0000 7f990f453640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99080720a0 con 0x7f9908143bc0 2024-04-25T02:17:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.285+0000 7f990f453640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9908072cb0 con 0x7f990806e3b0 2024-04-25T02:17:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.285+0000 7f990d9f0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f990806e3b0 0x7f99080b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.285+0000 7f990c9ee640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f990806df50 0x7f99080b2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49406/0 (socket says 172.21.15.79:49406) 2024-04-25T02:17:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.285+0000 7f990c9ee640 1 -- 172.21.15.79:0/1753887557 learned_addr learned my addr 172.21.15.79:0/1753887557 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:28.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.285+0000 7f990d9f0640 1 -- 172.21.15.79:0/1753887557 >> v1:172.21.15.189:6789/0 conn(0x7f9908143bc0 legacy=0x7f990815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:28.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.285+0000 7f990d9f0640 1 -- 172.21.15.79:0/1753887557 >> v1:172.21.15.79:6789/0 conn(0x7f990806df50 legacy=0x7f99080b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.285+0000 7f990d9f0640 1 -- 172.21.15.79:0/1753887557 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9908072380 con 0x7f990806e3b0 2024-04-25T02:17:28.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.286+0000 7f990d9f0640 1 --2- 172.21.15.79:0/1753887557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990806e3b0 0x7f99080b3440 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f9900009d90 tx=0x7f990002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a2f0c51a5097b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:28.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.286+0000 7f98fffff640 1 -- 172.21.15.79:0/1753887557 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900031600 con 0x7f990806e3b0 2024-04-25T02:17:28.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.286+0000 7f98fffff640 1 -- 172.21.15.79:0/1753887557 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99000317a0 con 0x7f990806e3b0 2024-04-25T02:17:28.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.286+0000 7f98fffff640 1 -- 172.21.15.79:0/1753887557 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900031b70 con 0x7f990806e3b0 2024-04-25T02:17:28.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.286+0000 7f990f453640 1 -- 172.21.15.79:0/1753887557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990806e3b0 msgr2=0x7f99080b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.286+0000 7f990f453640 1 --2- 172.21.15.79:0/1753887557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990806e3b0 0x7f99080b3440 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f9900009d90 tx=0x7f990002a610 comp rx=0 tx=0).stop 2024-04-25T02:17:28.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.287+0000 7f990f453640 1 -- 172.21.15.79:0/1753887557 shutdown_connections 2024-04-25T02:17:28.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.287+0000 7f990f453640 1 --2- 172.21.15.79:0/1753887557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990806e3b0 0x7f99080b3440 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.287+0000 7f990f453640 1 -- 172.21.15.79:0/1753887557 >> 172.21.15.79:0/1753887557 conn(0x7f99080cfc80 msgr2=0x7f99080d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:28.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.287+0000 7f990f453640 1 -- 172.21.15.79:0/1753887557 shutdown_connections 2024-04-25T02:17:28.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.287+0000 7f990f453640 1 -- 172.21.15.79:0/1753887557 wait complete. 2024-04-25T02:17:28.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.288+0000 7f990f453640 1 Processor -- start 2024-04-25T02:17:28.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.288+0000 7f990f453640 1 -- start start 2024-04-25T02:17:28.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.288+0000 7f990f453640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f990806df50 0x7f9908159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.288+0000 7f990f453640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990806e3b0 0x7f99081404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.288+0000 7f990f453640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9908143bc0 0x7f99080b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.288+0000 7f990f453640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f990806e840 con 0x7f990806e3b0 2024-04-25T02:17:28.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.288+0000 7f990f453640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9908072940 con 0x7f9908143bc0 2024-04-25T02:17:28.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.288+0000 7f990f453640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9908143fa0 con 0x7f990806df50 2024-04-25T02:17:28.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f990c9ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990806e3b0 0x7f99081404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f990c9ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990806e3b0 0x7f99081404f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50288/0 (socket says 172.21.15.79:50288) 2024-04-25T02:17:28.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f990c9ee640 1 -- 172.21.15.79:0/717321259 learned_addr learned my addr 172.21.15.79:0/717321259 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:28.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f990d9f0640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9908143bc0 0x7f99080b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f990d1ef640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f990806df50 0x7f9908159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f990c9ee640 1 -- 172.21.15.79:0/717321259 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f990806df50 msgr2=0x7f9908159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f990c9ee640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f990806df50 0x7f9908159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f990c9ee640 1 -- 172.21.15.79:0/717321259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9908143bc0 msgr2=0x7f99080b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f990c9ee640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9908143bc0 0x7f99080b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f990c9ee640 1 -- 172.21.15.79:0/717321259 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990815a090 con 0x7f990806e3b0 2024-04-25T02:17:28.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f990d9f0640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9908143bc0 0x7f99080b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:28.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f990d1ef640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f990806df50 0x7f9908159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:28.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f990c9ee640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990806e3b0 0x7f99081404f0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c3c0 tx=0x7f98f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:28.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f98fdffb640 1 -- 172.21.15.79:0/717321259 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8017070 con 0x7f990806e3b0 2024-04-25T02:17:28.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f98fdffb640 1 -- 172.21.15.79:0/717321259 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f8005ce0 con 0x7f990806e3b0 2024-04-25T02:17:28.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f990f453640 1 -- 172.21.15.79:0/717321259 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9908140e50 con 0x7f990806e3b0 2024-04-25T02:17:28.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f98fdffb640 1 -- 172.21.15.79:0/717321259 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f80072f0 con 0x7f990806e3b0 2024-04-25T02:17:28.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.289+0000 7f990f453640 1 -- 172.21.15.79:0/717321259 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9908141690 con 0x7f990806e3b0 2024-04-25T02:17:28.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.290+0000 7f990f453640 1 -- 172.21.15.79:0/717321259 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99080690a0 con 0x7f990806e3b0 2024-04-25T02:17:28.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.291+0000 7f98fdffb640 1 -- 172.21.15.79:0/717321259 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98f801a070 con 0x7f990806e3b0 2024-04-25T02:17:28.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.291+0000 7f98fdffb640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98ec06be30 0x7f98ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.291+0000 7f98fdffb640 1 -- 172.21.15.79:0/717321259 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5029+0+0 (secure 0 0 0) 0x7f98f8089e90 con 0x7f990806e3b0 2024-04-25T02:17:28.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.291+0000 7f990d1ef640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98ec06be30 0x7f98ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.291+0000 7f990d1ef640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98ec06be30 0x7f98ec06e2f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9904003eb0 tx=0x7f9904009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:28.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.295+0000 7f98fdffb640 1 -- 172.21.15.79:0/717321259 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9908140e50 con 0x7f990806e3b0 2024-04-25T02:17:28.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.534+0000 7f990f453640 1 -- 172.21.15.79:0/717321259 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) -- 0x7f9908140a30 con 0x7f990806e3b0 2024-04-25T02:17:28.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.578+0000 7f98fdffb640 1 -- 172.21.15.79:0/717321259 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v439) ==== 147+0+0 (secure 0 0 0) 0x7f98f8058b70 con 0x7f990806e3b0 2024-04-25T02:17:28.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.580+0000 7f990f453640 1 -- 172.21.15.79:0/717321259 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98ec06be30 msgr2=0x7f98ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.580+0000 7f990f453640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98ec06be30 0x7f98ec06e2f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9904003eb0 tx=0x7f9904009040 comp rx=0 tx=0).stop 2024-04-25T02:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.580+0000 7f990f453640 1 -- 172.21.15.79:0/717321259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990806e3b0 msgr2=0x7f99081404f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.580+0000 7f990f453640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990806e3b0 0x7f99081404f0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c3c0 tx=0x7f98f800c880 comp rx=0 tx=0).stop 2024-04-25T02:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.580+0000 7f990f453640 1 -- 172.21.15.79:0/717321259 shutdown_connections 2024-04-25T02:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.580+0000 7f990f453640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f98ec06be30 0x7f98ec06e2f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.580+0000 7f990f453640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9908143bc0 0x7f99080b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.580+0000 7f990f453640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990806e3b0 0x7f99081404f0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.580+0000 7f990f453640 1 --2- 172.21.15.79:0/717321259 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f990806df50 0x7f9908159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.580+0000 7f990f453640 1 -- 172.21.15.79:0/717321259 >> 172.21.15.79:0/717321259 conn(0x7f99080cfc80 msgr2=0x7f9908071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.580+0000 7f990f453640 1 -- 172.21.15.79:0/717321259 shutdown_connections 2024-04-25T02:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.580+0000 7f990f453640 1 -- 172.21.15.79:0/717321259 wait complete. 2024-04-25T02:17:28.595 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T02:17:28.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.690+0000 7fa87e93b640 1 Processor -- start 2024-04-25T02:17:28.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.690+0000 7fa87e93b640 1 -- start start 2024-04-25T02:17:28.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.691+0000 7fa87e93b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa87806e6b0 0x7fa8780b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.691+0000 7fa87e93b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87815ec20 con 0x7fa8780cf7a0 2024-04-25T02:17:28.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.691+0000 7fa87e93b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87815ef00 con 0x7fa87806b2f0 2024-04-25T02:17:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.691+0000 7fa87e93b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa87815f830 con 0x7fa87806e6b0 2024-04-25T02:17:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.691+0000 7fa87ced8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa87806e6b0 0x7fa8780b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.691+0000 7fa8777fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa8780cf7a0 0x7fa87815b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49408/0 (socket says 172.21.15.79:49408) 2024-04-25T02:17:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.691+0000 7fa87ced8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa87806e6b0 0x7fa8780b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50290/0 (socket says 172.21.15.79:50290) 2024-04-25T02:17:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.691+0000 7fa8777fe640 1 -- 172.21.15.79:0/30362562 learned_addr learned my addr 172.21.15.79:0/30362562 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.691+0000 7fa87ced8640 1 -- 172.21.15.79:0/30362562 >> v1:172.21.15.189:6789/0 conn(0x7fa87806b2f0 legacy=0x7fa87806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.691+0000 7fa87ced8640 1 -- 172.21.15.79:0/30362562 >> v1:172.21.15.79:6789/0 conn(0x7fa8780cf7a0 legacy=0x7fa87815b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.691+0000 7fa876ffd640 1 -- 172.21.15.79:0/30362562 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2478610685 0 0) 0x7fa87815ec20 con 0x7fa8780cf7a0 2024-04-25T02:17:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.691+0000 7fa87ced8640 1 -- 172.21.15.79:0/30362562 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87815f1e0 con 0x7fa87806e6b0 2024-04-25T02:17:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.692+0000 7fa87ced8640 1 --2- 172.21.15.79:0/30362562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87806e6b0 0x7fa8780b4b50 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fa870009d90 tx=0x7fa87002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443fcf0b6165c6c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.692+0000 7fa876ffd640 1 -- 172.21.15.79:0/30362562 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa870031600 con 0x7fa87806e6b0 2024-04-25T02:17:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.692+0000 7fa876ffd640 1 -- 172.21.15.79:0/30362562 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8700317a0 con 0x7fa87806e6b0 2024-04-25T02:17:28.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.692+0000 7fa876ffd640 1 -- 172.21.15.79:0/30362562 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa870031b70 con 0x7fa87806e6b0 2024-04-25T02:17:28.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.692+0000 7fa87e93b640 1 -- 172.21.15.79:0/30362562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87806e6b0 msgr2=0x7fa8780b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.692+0000 7fa87e93b640 1 --2- 172.21.15.79:0/30362562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87806e6b0 0x7fa8780b4b50 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fa870009d90 tx=0x7fa87002a610 comp rx=0 tx=0).stop 2024-04-25T02:17:28.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.693+0000 7fa87e93b640 1 -- 172.21.15.79:0/30362562 shutdown_connections 2024-04-25T02:17:28.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.693+0000 7fa87e93b640 1 --2- 172.21.15.79:0/30362562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87806e6b0 0x7fa8780b4b50 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.693+0000 7fa87e93b640 1 -- 172.21.15.79:0/30362562 >> 172.21.15.79:0/30362562 conn(0x7fa8780b1cd0 msgr2=0x7fa8780b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:28.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.693+0000 7fa87e93b640 1 -- 172.21.15.79:0/30362562 shutdown_connections 2024-04-25T02:17:28.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.693+0000 7fa87e93b640 1 -- 172.21.15.79:0/30362562 wait complete. 2024-04-25T02:17:28.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.694+0000 7fa87e93b640 1 Processor -- start 2024-04-25T02:17:28.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.694+0000 7fa87e93b640 1 -- start start 2024-04-25T02:17:28.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa87e93b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa87806b2f0 0x7fa878140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa87e93b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87806e6b0 0x7fa878143650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa87e93b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8780cf7a0 0x7fa8780b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa87e93b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa87806d160 con 0x7fa87806e6b0 2024-04-25T02:17:28.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa87e93b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa87806cfe0 con 0x7fa87806b2f0 2024-04-25T02:17:28.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa87e93b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa87815b9e0 con 0x7fa8780cf7a0 2024-04-25T02:17:28.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa8777fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87806e6b0 0x7fa878143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa8777fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87806e6b0 0x7fa878143650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50306/0 (socket says 172.21.15.79:50306) 2024-04-25T02:17:28.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa8777fe640 1 -- 172.21.15.79:0/1379175793 learned_addr learned my addr 172.21.15.79:0/1379175793 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:28.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa87ced8640 1 --2- 172.21.15.79:0/1379175793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8780cf7a0 0x7fa8780b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa877fff640 1 --2- 172.21.15.79:0/1379175793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa87806b2f0 0x7fa878140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa8777fe640 1 -- 172.21.15.79:0/1379175793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8780cf7a0 msgr2=0x7fa8780b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa8777fe640 1 --2- 172.21.15.79:0/1379175793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8780cf7a0 0x7fa8780b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa8777fe640 1 -- 172.21.15.79:0/1379175793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa87806b2f0 msgr2=0x7fa878140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa8777fe640 1 --2- 172.21.15.79:0/1379175793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa87806b2f0 0x7fa878140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa8777fe640 1 -- 172.21.15.79:0/1379175793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8781412f0 con 0x7fa87806e6b0 2024-04-25T02:17:28.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa8777fe640 1 --2- 172.21.15.79:0/1379175793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87806e6b0 0x7fa878143650 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00c430 tx=0x7fa86c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:28.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa874ff9640 1 -- 172.21.15.79:0/1379175793 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c0074e0 con 0x7fa87806e6b0 2024-04-25T02:17:28.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa874ff9640 1 -- 172.21.15.79:0/1379175793 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa86c0047e0 con 0x7fa87806e6b0 2024-04-25T02:17:28.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa874ff9640 1 -- 172.21.15.79:0/1379175793 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c004bd0 con 0x7fa87806e6b0 2024-04-25T02:17:28.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa87e93b640 1 -- 172.21.15.79:0/1379175793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa878143fc0 con 0x7fa87806e6b0 2024-04-25T02:17:28.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.695+0000 7fa87e93b640 1 -- 172.21.15.79:0/1379175793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8781416f0 con 0x7fa87806e6b0 2024-04-25T02:17:28.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.696+0000 7fa87e93b640 1 -- 172.21.15.79:0/1379175793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8780690a0 con 0x7fa87806e6b0 2024-04-25T02:17:28.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.697+0000 7fa874ff9640 1 -- 172.21.15.79:0/1379175793 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa86c011070 con 0x7fa87806e6b0 2024-04-25T02:17:28.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.697+0000 7fa874ff9640 1 --2- 172.21.15.79:0/1379175793 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa86406be30 0x7fa86406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.697+0000 7fa874ff9640 1 -- 172.21.15.79:0/1379175793 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5029+0+0 (secure 0 0 0) 0x7fa86c08a830 con 0x7fa87806e6b0 2024-04-25T02:17:28.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.697+0000 7fa877fff640 1 --2- 172.21.15.79:0/1379175793 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa86406be30 0x7fa86406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.698+0000 7fa877fff640 1 --2- 172.21.15.79:0/1379175793 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa86406be30 0x7fa86406e2f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa868004ea0 tx=0x7fa868009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:28.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.701+0000 7fa874ff9640 1 -- 172.21.15.79:0/1379175793 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa86c059480 con 0x7fa87806e6b0 2024-04-25T02:17:28.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.875+0000 7fa87e93b640 1 -- 172.21.15.79:0/1379175793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa8780cf4f0 con 0x7fa87806e6b0 2024-04-25T02:17:28.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.878+0000 7fa874ff9640 1 -- 172.21.15.79:0/1379175793 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7fa86c058d80 con 0x7fa87806e6b0 2024-04-25T02:17:28.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.880+0000 7fa87e93b640 1 -- 172.21.15.79:0/1379175793 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa86406be30 msgr2=0x7fa86406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.880+0000 7fa87e93b640 1 --2- 172.21.15.79:0/1379175793 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa86406be30 0x7fa86406e2f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa868004ea0 tx=0x7fa868009040 comp rx=0 tx=0).stop 2024-04-25T02:17:28.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.880+0000 7fa87e93b640 1 -- 172.21.15.79:0/1379175793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87806e6b0 msgr2=0x7fa878143650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.880+0000 7fa87e93b640 1 --2- 172.21.15.79:0/1379175793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87806e6b0 0x7fa878143650 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00c430 tx=0x7fa86c00c8f0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.880+0000 7fa87e93b640 1 -- 172.21.15.79:0/1379175793 shutdown_connections 2024-04-25T02:17:28.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.880+0000 7fa87e93b640 1 --2- 172.21.15.79:0/1379175793 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa86406be30 0x7fa86406e2f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.880+0000 7fa87e93b640 1 --2- 172.21.15.79:0/1379175793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa8780cf7a0 0x7fa8780b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.880+0000 7fa87e93b640 1 --2- 172.21.15.79:0/1379175793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87806e6b0 0x7fa878143650 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.880+0000 7fa87e93b640 1 --2- 172.21.15.79:0/1379175793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa87806b2f0 0x7fa878140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.880+0000 7fa87e93b640 1 -- 172.21.15.79:0/1379175793 >> 172.21.15.79:0/1379175793 conn(0x7fa8780b1cd0 msgr2=0x7fa87815b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:28.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.880+0000 7fa87e93b640 1 -- 172.21.15.79:0/1379175793 shutdown_connections 2024-04-25T02:17:28.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:28.880+0000 7fa87e93b640 1 -- 172.21.15.79:0/1379175793 wait complete. 2024-04-25T02:17:28.895 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:17:28.896 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:17:28.941 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:17:28.990 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:17:28.990 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:17:28.990 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:29.005 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:17:29.006 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:17:29.006 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:29.023 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:17:29.023 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:17:29.023 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:29.061 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:17:29.061 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:17:29.061 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:29.080 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:17:29.080 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T02:17:29.080 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:17:29.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.193+0000 7f818625d640 1 Processor -- start 2024-04-25T02:17:29.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.193+0000 7f818625d640 1 -- start start 2024-04-25T02:17:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.194+0000 7f818625d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f818015a720 0x7f818015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.194+0000 7f818625d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f81800d07a0 0x7f81800b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.194+0000 7f818625d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f818015f1c0 con 0x7f81800b47e0 2024-04-25T02:17:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.194+0000 7f818625d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f81800b2e60 con 0x7f81800d07a0 2024-04-25T02:17:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.194+0000 7f818625d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f81800b3140 con 0x7f818015a720 2024-04-25T02:17:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.194+0000 7f817effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f81800d07a0 0x7f81800b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.194+0000 7f817effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f81800d07a0 0x7f81800b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50320/0 (socket says 172.21.15.79:50320) 2024-04-25T02:17:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.194+0000 7f817effd640 1 -- 172.21.15.79:0/1477315958 learned_addr learned my addr 172.21.15.79:0/1477315958 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.195+0000 7f817effd640 1 -- 172.21.15.79:0/1477315958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f818015a720 msgr2=0x7f818015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.195+0000 7f817effd640 1 --2- 172.21.15.79:0/1477315958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f818015a720 0x7f818015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.195+0000 7f817effd640 1 -- 172.21.15.79:0/1477315958 >> v1:172.21.15.189:6789/0 conn(0x7f81800b47e0 legacy=0x7f818015ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.195+0000 7f817effd640 1 -- 172.21.15.79:0/1477315958 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81800b3420 con 0x7f81800d07a0 2024-04-25T02:17:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.195+0000 7f817effd640 1 --2- 172.21.15.79:0/1477315958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81800d07a0 0x7f81800b42a0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f817400aa10 tx=0x7f817402b530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e0ea0cbec90b60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.195+0000 7f817e7fc640 1 -- 172.21.15.79:0/1477315958 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817400b040 con 0x7f81800d07a0 2024-04-25T02:17:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.195+0000 7f817e7fc640 1 -- 172.21.15.79:0/1477315958 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8174030710 con 0x7f81800d07a0 2024-04-25T02:17:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.195+0000 7f817e7fc640 1 -- 172.21.15.79:0/1477315958 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8174030ae0 con 0x7f81800d07a0 2024-04-25T02:17:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.196+0000 7f818625d640 1 -- 172.21.15.79:0/1477315958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81800d07a0 msgr2=0x7f81800b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.196+0000 7f818625d640 1 --2- 172.21.15.79:0/1477315958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81800d07a0 0x7f81800b42a0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f817400aa10 tx=0x7f817402b530 comp rx=0 tx=0).stop 2024-04-25T02:17:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.196+0000 7f818625d640 1 -- 172.21.15.79:0/1477315958 shutdown_connections 2024-04-25T02:17:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.196+0000 7f818625d640 1 --2- 172.21.15.79:0/1477315958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81800d07a0 0x7f81800b42a0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.196+0000 7f818625d640 1 --2- 172.21.15.79:0/1477315958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f818015a720 0x7f818015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.196+0000 7f818625d640 1 -- 172.21.15.79:0/1477315958 >> 172.21.15.79:0/1477315958 conn(0x7f81800cfc80 msgr2=0x7f81800d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.196+0000 7f818625d640 1 -- 172.21.15.79:0/1477315958 shutdown_connections 2024-04-25T02:17:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.196+0000 7f818625d640 1 -- 172.21.15.79:0/1477315958 wait complete. 2024-04-25T02:17:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.197+0000 7f818625d640 1 Processor -- start 2024-04-25T02:17:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.197+0000 7f818625d640 1 -- start start 2024-04-25T02:17:29.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.198+0000 7f818625d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81800b47e0 0x7f81800c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.198+0000 7f818625d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81800d07a0 0x7f818015b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.198+0000 7f818625d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f818015a720 0x7f81800aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.198+0000 7f818625d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8180071d00 con 0x7f81800b47e0 2024-04-25T02:17:29.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.198+0000 7f818625d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f81800b39e0 con 0x7f81800d07a0 2024-04-25T02:17:29.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.198+0000 7f818625d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8180071e80 con 0x7f818015a720 2024-04-25T02:17:29.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.198+0000 7f817f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81800b47e0 0x7f81800c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.198+0000 7f817f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81800b47e0 0x7f81800c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50334/0 (socket says 172.21.15.79:50334) 2024-04-25T02:17:29.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.198+0000 7f817f7fe640 1 -- 172.21.15.79:0/4117249132 learned_addr learned my addr 172.21.15.79:0/4117249132 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:29.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.198+0000 7f817f7fe640 1 -- 172.21.15.79:0/4117249132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f818015a720 msgr2=0x7f81800aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.198+0000 7f817f7fe640 1 --2- 172.21.15.79:0/4117249132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f818015a720 0x7f81800aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.198+0000 7f817f7fe640 1 -- 172.21.15.79:0/4117249132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81800d07a0 msgr2=0x7f818015b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.198+0000 7f817f7fe640 1 --2- 172.21.15.79:0/4117249132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81800d07a0 0x7f818015b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.198+0000 7f817f7fe640 1 -- 172.21.15.79:0/4117249132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818014b1e0 con 0x7f81800b47e0 2024-04-25T02:17:29.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.199+0000 7f817f7fe640 1 --2- 172.21.15.79:0/4117249132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81800b47e0 0x7f81800c4ca0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f817000b4a0 tx=0x7f817000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:29.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.199+0000 7f8167fff640 1 -- 172.21.15.79:0/4117249132 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170014070 con 0x7f81800b47e0 2024-04-25T02:17:29.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.199+0000 7f8167fff640 1 -- 172.21.15.79:0/4117249132 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8170010610 con 0x7f81800b47e0 2024-04-25T02:17:29.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.199+0000 7f8167fff640 1 -- 172.21.15.79:0/4117249132 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170010a00 con 0x7f81800b47e0 2024-04-25T02:17:29.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.199+0000 7f818625d640 1 -- 172.21.15.79:0/4117249132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818014b4c0 con 0x7f81800b47e0 2024-04-25T02:17:29.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.199+0000 7f818625d640 1 -- 172.21.15.79:0/4117249132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f818014ba80 con 0x7f81800b47e0 2024-04-25T02:17:29.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.200+0000 7f818625d640 1 -- 172.21.15.79:0/4117249132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81800690a0 con 0x7f81800b47e0 2024-04-25T02:17:29.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.200+0000 7f8167fff640 1 -- 172.21.15.79:0/4117249132 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8170017070 con 0x7f81800b47e0 2024-04-25T02:17:29.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.201+0000 7f8167fff640 1 --2- 172.21.15.79:0/4117249132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f816c06be30 0x7f816c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.201+0000 7f8167fff640 1 -- 172.21.15.79:0/4117249132 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5029+0+0 (secure 0 0 0) 0x7f817008a6f0 con 0x7f81800b47e0 2024-04-25T02:17:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.201+0000 7f817effd640 1 --2- 172.21.15.79:0/4117249132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f816c06be30 0x7f816c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.201+0000 7f817effd640 1 --2- 172.21.15.79:0/4117249132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f816c06be30 0x7f816c06e2f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8174035000 tx=0x7f817402f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.205+0000 7f8167fff640 1 -- 172.21.15.79:0/4117249132 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f81700592b0 con 0x7f81800b47e0 2024-04-25T02:17:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.415+0000 7f818625d640 1 -- 172.21.15.79:0/4117249132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81800b5280 con 0x7f81800b47e0 2024-04-25T02:17:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.416+0000 7f8167fff640 1 -- 172.21.15.79:0/4117249132 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+3875 (secure 0 0 0) 0x7f8170058bb0 con 0x7f81800b47e0 2024-04-25T02:17:29.420 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:29.421 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":78,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/1086166830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1086166830},{"type":"v1","addr":"172.21.15.189:6834","nonce":1086166830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2468340230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2468340230},{"type":"v1","addr":"172.21.15.189:6835","nonce":2468340230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3582530322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3582530322},{"type":"v1","addr":"172.21.15.79:6836","nonce":3582530322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8763,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2101809080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2101809080},{"type":"v1","addr":"172.21.15.79:6837","nonce":2101809080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[]} 2024-04-25T02:17:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 78 2024-04-25T02:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.418+0000 7f818625d640 1 -- 172.21.15.79:0/4117249132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f816c06be30 msgr2=0x7f816c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.418+0000 7f818625d640 1 --2- 172.21.15.79:0/4117249132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f816c06be30 0x7f816c06e2f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8174035000 tx=0x7f817402f000 comp rx=0 tx=0).stop 2024-04-25T02:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.418+0000 7f818625d640 1 -- 172.21.15.79:0/4117249132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81800b47e0 msgr2=0x7f81800c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.418+0000 7f818625d640 1 --2- 172.21.15.79:0/4117249132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81800b47e0 0x7f81800c4ca0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f817000b4a0 tx=0x7f817000b960 comp rx=0 tx=0).stop 2024-04-25T02:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.418+0000 7f818625d640 1 -- 172.21.15.79:0/4117249132 shutdown_connections 2024-04-25T02:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.418+0000 7f818625d640 1 --2- 172.21.15.79:0/4117249132 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f816c06be30 0x7f816c06e2f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.418+0000 7f818625d640 1 --2- 172.21.15.79:0/4117249132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f818015a720 0x7f81800aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.418+0000 7f818625d640 1 --2- 172.21.15.79:0/4117249132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81800d07a0 0x7f818015b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.418+0000 7f818625d640 1 --2- 172.21.15.79:0/4117249132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81800b47e0 0x7f81800c4ca0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.418+0000 7f818625d640 1 -- 172.21.15.79:0/4117249132 >> 172.21.15.79:0/4117249132 conn(0x7f81800cfc80 msgr2=0x7f818015bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.418+0000 7f818625d640 1 -- 172.21.15.79:0/4117249132 shutdown_connections 2024-04-25T02:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.418+0000 7f818625d640 1 -- 172.21.15.79:0/4117249132 wait complete. 2024-04-25T02:17:29.433 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T02:17:29.433 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T02:17:29.434 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T02:17:29.434 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:17:29.434 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T02:17:29.434 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T02:17:29.434 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T02:17:29.434 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:17:29.434 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T02:17:29.435 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T02:17:29.435 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T02:17:29.435 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:17:29.435 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T02:17:29.435 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T02:17:29.435 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T02:17:29.435 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:17:29.445 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T02:17:29.445 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T02:17:29.446 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T02:17:29.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T02:17:29.447 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T02:17:29.447 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T02:17:29.447 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T02:17:29.448 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T02:17:29.487 INFO:tasks.ceph.mds.a:Started 2024-04-25T02:17:29.488 DEBUG:teuthology.parallel:result is None 2024-04-25T02:17:29.489 INFO:tasks.ceph.mds.c:Started 2024-04-25T02:17:29.489 DEBUG:teuthology.parallel:result is None 2024-04-25T02:17:29.490 INFO:tasks.ceph.mds.d:Started 2024-04-25T02:17:29.490 DEBUG:teuthology.parallel:result is None 2024-04-25T02:17:29.490 INFO:tasks.ceph.mds.b:Started 2024-04-25T02:17:29.491 DEBUG:teuthology.parallel:result is None 2024-04-25T02:17:29.491 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T02:17:29.561 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-04-25T02:17:29.561 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:17:29.569 INFO:tasks.ceph.mds.d.smithi189.stdout:starting mds.d at 2024-04-25T02:17:29.569 INFO:tasks.ceph.mds.b.smithi189.stdout:starting mds.b at 2024-04-25T02:17:29.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.590+0000 7efeeb476640 1 Processor -- start 2024-04-25T02:17:29.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.590+0000 7efeeb476640 1 -- start start 2024-04-25T02:17:29.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.591+0000 7efeeb476640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efee415e4d0 0x7efee406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.591+0000 7efeeb476640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7efee40b3570 0x7efee40d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.591+0000 7efeeb476640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efee40b3020 0x7efee40d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.591+0000 7efeeb476640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7efee40d1660 con 0x7efee415e4d0 2024-04-25T02:17:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.591+0000 7efeeb476640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7efee40d1380 con 0x7efee40b3570 2024-04-25T02:17:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.591+0000 7efeeb476640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efee40cede0 con 0x7efee40b3020 2024-04-25T02:17:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.591+0000 7efee9212640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efee415e4d0 0x7efee406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.591+0000 7efee9212640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efee415e4d0 0x7efee406bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50368/0 (socket says 172.21.15.79:50368) 2024-04-25T02:17:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.591+0000 7efee9212640 1 -- 172.21.15.79:0/2903387599 learned_addr learned my addr 172.21.15.79:0/2903387599 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.592+0000 7efee8a11640 1 --2- 172.21.15.79:0/2903387599 >> v2:172.21.15.189:3300/0 conn(0x7efee40b3570 0x7efee40d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.592+0000 7efee9a13640 1 --2- 172.21.15.79:0/2903387599 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efee40b3020 0x7efee40d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.592+0000 7efee9212640 1 -- 172.21.15.79:0/2903387599 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efee40b3020 msgr2=0x7efee40d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.592+0000 7efee9212640 1 --2- 172.21.15.79:0/2903387599 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efee40b3020 0x7efee40d2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.592+0000 7efee9212640 1 -- 172.21.15.79:0/2903387599 >> v2:172.21.15.189:3300/0 conn(0x7efee40b3570 msgr2=0x7efee40d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.592+0000 7efee9212640 1 --2- 172.21.15.79:0/2903387599 >> v2:172.21.15.189:3300/0 conn(0x7efee40b3570 0x7efee40d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.592+0000 7efee9212640 1 -- 172.21.15.79:0/2903387599 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee40cf0c0 con 0x7efee415e4d0 2024-04-25T02:17:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.592+0000 7efee8a11640 1 --2- 172.21.15.79:0/2903387599 >> v2:172.21.15.189:3300/0 conn(0x7efee40b3570 0x7efee40d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:29.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.593+0000 7efee9212640 1 --2- 172.21.15.79:0/2903387599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee415e4d0 0x7efee406bc70 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7efee0009870 tx=0x7efee002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9c788d0cec6453 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:29.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.593+0000 7efedbfff640 1 -- 172.21.15.79:0/2903387599 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee0037070 con 0x7efee415e4d0 2024-04-25T02:17:29.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.593+0000 7efedbfff640 1 -- 172.21.15.79:0/2903387599 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee0032440 con 0x7efee415e4d0 2024-04-25T02:17:29.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.593+0000 7efedbfff640 1 -- 172.21.15.79:0/2903387599 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee0032810 con 0x7efee415e4d0 2024-04-25T02:17:29.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.593+0000 7efeeb476640 1 -- 172.21.15.79:0/2903387599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee415e4d0 msgr2=0x7efee406bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.593+0000 7efeeb476640 1 --2- 172.21.15.79:0/2903387599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee415e4d0 0x7efee406bc70 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7efee0009870 tx=0x7efee002a210 comp rx=0 tx=0).stop 2024-04-25T02:17:29.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.593+0000 7efeeb476640 1 -- 172.21.15.79:0/2903387599 shutdown_connections 2024-04-25T02:17:29.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.593+0000 7efeeb476640 1 --2- 172.21.15.79:0/2903387599 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efee40b3020 0x7efee40d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.593+0000 7efeeb476640 1 --2- 172.21.15.79:0/2903387599 >> v2:172.21.15.189:3300/0 conn(0x7efee40b3570 0x7efee40d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.593+0000 7efeeb476640 1 --2- 172.21.15.79:0/2903387599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee415e4d0 0x7efee406bc70 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.593+0000 7efeeb476640 1 -- 172.21.15.79:0/2903387599 >> 172.21.15.79:0/2903387599 conn(0x7efee409d460 msgr2=0x7efee40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:29.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.594+0000 7efeeb476640 1 -- 172.21.15.79:0/2903387599 shutdown_connections 2024-04-25T02:17:29.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.594+0000 7efeeb476640 1 -- 172.21.15.79:0/2903387599 wait complete. 2024-04-25T02:17:29.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.595+0000 7efeeb476640 1 Processor -- start 2024-04-25T02:17:29.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.595+0000 7efeeb476640 1 -- start start 2024-04-25T02:17:29.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.595+0000 7efeeb476640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee40b3020 0x7efee414f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.595+0000 7efeeb476640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efee40b3570 0x7efee415fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.595+0000 7efeeb476640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efee415e4d0 0x7efee4160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.595+0000 7efeeb476640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efee40d2250 con 0x7efee40b3020 2024-04-25T02:17:29.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.595+0000 7efeeb476640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efee40d20d0 con 0x7efee415e4d0 2024-04-25T02:17:29.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.595+0000 7efeeb476640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efee406c1b0 con 0x7efee40b3570 2024-04-25T02:17:29.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efee9212640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee40b3020 0x7efee414f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efee9212640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee40b3020 0x7efee414f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50372/0 (socket says 172.21.15.79:50372) 2024-04-25T02:17:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efee9212640 1 -- 172.21.15.79:0/1429852604 learned_addr learned my addr 172.21.15.79:0/1429852604 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efee8a11640 1 --2- 172.21.15.79:0/1429852604 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efee40b3570 0x7efee415fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efee9a13640 1 --2- 172.21.15.79:0/1429852604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efee415e4d0 0x7efee4160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efee9212640 1 -- 172.21.15.79:0/1429852604 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efee40b3570 msgr2=0x7efee415fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efee9212640 1 --2- 172.21.15.79:0/1429852604 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efee40b3570 0x7efee415fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efee9212640 1 -- 172.21.15.79:0/1429852604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efee415e4d0 msgr2=0x7efee4160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efee9212640 1 --2- 172.21.15.79:0/1429852604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efee415e4d0 0x7efee4160050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efee9212640 1 -- 172.21.15.79:0/1429852604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee40b3d10 con 0x7efee40b3020 2024-04-25T02:17:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efee9212640 1 --2- 172.21.15.79:0/1429852604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee40b3020 0x7efee414f710 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7efee0000c00 tx=0x7efee00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efed9ffb640 1 -- 172.21.15.79:0/1429852604 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee0037040 con 0x7efee40b3020 2024-04-25T02:17:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efed9ffb640 1 -- 172.21.15.79:0/1429852604 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee0042070 con 0x7efee40b3020 2024-04-25T02:17:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efeeb476640 1 -- 172.21.15.79:0/1429852604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee40b3ff0 con 0x7efee40b3020 2024-04-25T02:17:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efed9ffb640 1 -- 172.21.15.79:0/1429852604 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee0030bd0 con 0x7efee40b3020 2024-04-25T02:17:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.596+0000 7efeeb476640 1 -- 172.21.15.79:0/1429852604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee40b4ad0 con 0x7efee40b3020 2024-04-25T02:17:29.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.598+0000 7efeeb476640 1 -- 172.21.15.79:0/1429852604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee40690a0 con 0x7efee40b3020 2024-04-25T02:17:29.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.598+0000 7efed9ffb640 1 -- 172.21.15.79:0/1429852604 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efee0047460 con 0x7efee40b3020 2024-04-25T02:17:29.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.598+0000 7efed9ffb640 1 --2- 172.21.15.79:0/1429852604 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efec806be30 0x7efec806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.598+0000 7efed9ffb640 1 -- 172.21.15.79:0/1429852604 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5029+0+0 (secure 0 0 0) 0x7efee00ab6b0 con 0x7efee40b3020 2024-04-25T02:17:29.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.598+0000 7efee8a11640 1 --2- 172.21.15.79:0/1429852604 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efec806be30 0x7efec806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.599+0000 7efee8a11640 1 --2- 172.21.15.79:0/1429852604 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efec806be30 0x7efec806e2f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7efee41606d0 tx=0x7efed4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:29.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.603+0000 7efed9ffb640 1 -- 172.21.15.79:0/1429852604 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efee0079cb0 con 0x7efee40b3020 2024-04-25T02:17:29.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:29.786+0000 7efeeb476640 1 -- 172.21.15.79:0/1429852604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7efee40d1920 con 0x7efee40b3020 2024-04-25T02:17:30.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.592+0000 7efed9ffb640 1 -- 172.21.15.79:0/1429852604 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v111) ==== 97+0+0 (secure 0 0 0) 0x7efee007dfb0 con 0x7efee40b3020 2024-04-25T02:17:30.596 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2024-04-25T02:17:30.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.594+0000 7efeeb476640 1 -- 172.21.15.79:0/1429852604 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efec806be30 msgr2=0x7efec806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:30.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.594+0000 7efeeb476640 1 --2- 172.21.15.79:0/1429852604 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efec806be30 0x7efec806e2f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7efee41606d0 tx=0x7efed4008040 comp rx=0 tx=0).stop 2024-04-25T02:17:30.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.595+0000 7efeeb476640 1 -- 172.21.15.79:0/1429852604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee40b3020 msgr2=0x7efee414f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:30.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.595+0000 7efeeb476640 1 --2- 172.21.15.79:0/1429852604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee40b3020 0x7efee414f710 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7efee0000c00 tx=0x7efee00046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:30.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.595+0000 7efeeb476640 1 -- 172.21.15.79:0/1429852604 shutdown_connections 2024-04-25T02:17:30.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.595+0000 7efeeb476640 1 --2- 172.21.15.79:0/1429852604 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efec806be30 0x7efec806e2f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:30.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.595+0000 7efeeb476640 1 --2- 172.21.15.79:0/1429852604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efee415e4d0 0x7efee4160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:30.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.595+0000 7efeeb476640 1 --2- 172.21.15.79:0/1429852604 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efee40b3570 0x7efee415fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:30.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.595+0000 7efeeb476640 1 --2- 172.21.15.79:0/1429852604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee40b3020 0x7efee414f710 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:30.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.595+0000 7efeeb476640 1 -- 172.21.15.79:0/1429852604 >> 172.21.15.79:0/1429852604 conn(0x7efee409d460 msgr2=0x7efee415c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:30.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.595+0000 7efeeb476640 1 -- 172.21.15.79:0/1429852604 shutdown_connections 2024-04-25T02:17:30.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.595+0000 7efeeb476640 1 -- 172.21.15.79:0/1429852604 wait complete. 2024-04-25T02:17:30.612 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T02:17:30.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.706+0000 7fe7b3029640 1 Processor -- start 2024-04-25T02:17:30.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.706+0000 7fe7b3029640 1 -- start start 2024-04-25T02:17:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.707+0000 7fe7b3029640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe7ac143bc0 0x7fe7ac15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.707+0000 7fe7b3029640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe7ac06df50 0x7fe7ac06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.707+0000 7fe7b3029640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7ac15fa40 con 0x7fe7ac0b48e0 2024-04-25T02:17:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.707+0000 7fe7b3029640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ac06e8f0 con 0x7fe7ac06df50 2024-04-25T02:17:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.707+0000 7fe7b3029640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ac072cb0 con 0x7fe7ac143bc0 2024-04-25T02:17:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.707+0000 7fe7abfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe7ac06df50 0x7fe7ac06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.707+0000 7fe7b15c6640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe7ac0b48e0 0x7fe7ac0b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49432/0 (socket says 172.21.15.79:49432) 2024-04-25T02:17:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.707+0000 7fe7b15c6640 1 -- 172.21.15.79:0/3261152669 learned_addr learned my addr 172.21.15.79:0/3261152669 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.707+0000 7fe7b0dc5640 1 --2- 172.21.15.79:0/3261152669 >> v2:172.21.15.189:3300/0 conn(0x7fe7ac143bc0 0x7fe7ac15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.707+0000 7fe7abfff640 1 -- 172.21.15.79:0/3261152669 >> v2:172.21.15.189:3300/0 conn(0x7fe7ac143bc0 msgr2=0x7fe7ac15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.707+0000 7fe7abfff640 1 --2- 172.21.15.79:0/3261152669 >> v2:172.21.15.189:3300/0 conn(0x7fe7ac143bc0 0x7fe7ac15f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:30.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.707+0000 7fe7abfff640 1 -- 172.21.15.79:0/3261152669 >> v1:172.21.15.79:6789/0 conn(0x7fe7ac0b48e0 legacy=0x7fe7ac0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:30.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.707+0000 7fe7abfff640 1 -- 172.21.15.79:0/3261152669 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac071e00 con 0x7fe7ac06df50 2024-04-25T02:17:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.708+0000 7fe7abfff640 1 --2- 172.21.15.79:0/3261152669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac06df50 0x7fe7ac06e3b0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac067b50 tx=0x7fe79802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62178979e628967b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.708+0000 7fe7ab7fe640 1 -- 172.21.15.79:0/3261152669 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe798037070 con 0x7fe7ac06df50 2024-04-25T02:17:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.708+0000 7fe7ab7fe640 1 -- 172.21.15.79:0/3261152669 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe798032440 con 0x7fe7ac06df50 2024-04-25T02:17:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.708+0000 7fe7ab7fe640 1 -- 172.21.15.79:0/3261152669 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79802ae60 con 0x7fe7ac06df50 2024-04-25T02:17:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.709+0000 7fe7b3029640 1 -- 172.21.15.79:0/3261152669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac06df50 msgr2=0x7fe7ac06e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.709+0000 7fe7b3029640 1 --2- 172.21.15.79:0/3261152669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac06df50 0x7fe7ac06e3b0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac067b50 tx=0x7fe79802a110 comp rx=0 tx=0).stop 2024-04-25T02:17:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.709+0000 7fe7b3029640 1 -- 172.21.15.79:0/3261152669 shutdown_connections 2024-04-25T02:17:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.709+0000 7fe7b3029640 1 --2- 172.21.15.79:0/3261152669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac06df50 0x7fe7ac06e3b0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.709+0000 7fe7b3029640 1 --2- 172.21.15.79:0/3261152669 >> v2:172.21.15.189:3300/0 conn(0x7fe7ac143bc0 0x7fe7ac15f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.709+0000 7fe7b3029640 1 -- 172.21.15.79:0/3261152669 >> 172.21.15.79:0/3261152669 conn(0x7fe7ac0cfc80 msgr2=0x7fe7ac0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.709+0000 7fe7b3029640 1 -- 172.21.15.79:0/3261152669 shutdown_connections 2024-04-25T02:17:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.709+0000 7fe7b3029640 1 -- 172.21.15.79:0/3261152669 wait complete. 2024-04-25T02:17:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.710+0000 7fe7b3029640 1 Processor -- start 2024-04-25T02:17:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.710+0000 7fe7b3029640 1 -- start start 2024-04-25T02:17:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7b3029640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7ac06df50 0x7fe7ac1599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7b3029640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac0b48e0 0x7fe7ac0adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7b3029640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7ac143bc0 0x7fe7ac141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7b3029640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac072660 con 0x7fe7ac0b48e0 2024-04-25T02:17:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7b3029640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac072380 con 0x7fe7ac143bc0 2024-04-25T02:17:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7b3029640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ac072940 con 0x7fe7ac06df50 2024-04-25T02:17:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7abfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac0b48e0 0x7fe7ac0adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7abfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac0b48e0 0x7fe7ac0adb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50388/0 (socket says 172.21.15.79:50388) 2024-04-25T02:17:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7abfff640 1 -- 172.21.15.79:0/3454148076 learned_addr learned my addr 172.21.15.79:0/3454148076 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7abfff640 1 -- 172.21.15.79:0/3454148076 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7ac06df50 msgr2=0x7fe7ac1599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7abfff640 1 --2- 172.21.15.79:0/3454148076 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7ac06df50 0x7fe7ac1599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7abfff640 1 -- 172.21.15.79:0/3454148076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7ac143bc0 msgr2=0x7fe7ac141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7b15c6640 1 --2- 172.21.15.79:0/3454148076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7ac143bc0 0x7fe7ac141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7abfff640 1 --2- 172.21.15.79:0/3454148076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7ac143bc0 0x7fe7ac141020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7abfff640 1 -- 172.21.15.79:0/3454148076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac0ae600 con 0x7fe7ac0b48e0 2024-04-25T02:17:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7abfff640 1 --2- 172.21.15.79:0/3454148076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac0b48e0 0x7fe7ac0adb40 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fe798000c00 tx=0x7fe7980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7a97fa640 1 -- 172.21.15.79:0/3454148076 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe798037040 con 0x7fe7ac0b48e0 2024-04-25T02:17:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7a97fa640 1 -- 172.21.15.79:0/3454148076 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe798042070 con 0x7fe7ac0b48e0 2024-04-25T02:17:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7b3029640 1 -- 172.21.15.79:0/3454148076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ac0ae8e0 con 0x7fe7ac0b48e0 2024-04-25T02:17:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7a97fa640 1 -- 172.21.15.79:0/3454148076 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe798030bd0 con 0x7fe7ac0b48e0 2024-04-25T02:17:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.711+0000 7fe7b3029640 1 -- 172.21.15.79:0/3454148076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ac0aeea0 con 0x7fe7ac0b48e0 2024-04-25T02:17:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.712+0000 7fe7b3029640 1 -- 172.21.15.79:0/3454148076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ac0d06c0 con 0x7fe7ac0b48e0 2024-04-25T02:17:30.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.713+0000 7fe7a97fa640 1 -- 172.21.15.79:0/3454148076 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe798047460 con 0x7fe7ac0b48e0 2024-04-25T02:17:30.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.713+0000 7fe7a97fa640 1 --2- 172.21.15.79:0/3454148076 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe79006be60 0x7fe79006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:30.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.713+0000 7fe7a97fa640 1 -- 172.21.15.79:0/3454148076 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4857+0+0 (secure 0 0 0) 0x7fe7980ab770 con 0x7fe7ac0b48e0 2024-04-25T02:17:30.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.713+0000 7fe7b0dc5640 1 --2- 172.21.15.79:0/3454148076 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe79006be60 0x7fe79006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:30.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.714+0000 7fe7b0dc5640 1 --2- 172.21.15.79:0/3454148076 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe79006be60 0x7fe79006e320 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00098f0 tx=0x7fe7a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:30.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.718+0000 7fe7a97fa640 1 -- 172.21.15.79:0/3454148076 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe7ac0d06c0 con 0x7fe7ac0b48e0 2024-04-25T02:17:30.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.955+0000 7fe7b3029640 1 -- 172.21.15.79:0/3454148076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe7ac068a10 con 0x7fe7ac0b48e0 2024-04-25T02:17:30.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.956+0000 7fe7a97fa640 1 -- 172.21.15.79:0/3454148076 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fe7ac068a10 con 0x7fe7ac0b48e0 2024-04-25T02:17:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:30.960 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:17:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2024-04-25T02:17:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2024-04-25T02:17:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmkSfsJhAAEP9aqirUawsrrvVUkxkO0w==", 2024-04-25T02:17:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:17:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:17:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:17:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:17:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2024-04-25T02:17:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilm8wYYMhAA98c3h9c80Y9zYzVv+kY7qQ==", 2024-04-25T02:17:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:17:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:17:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:17:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:17:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2024-04-25T02:17:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmiqSiLRAAmCUWUrHC31tkg0dkXS54cA==", 2024-04-25T02:17:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:17:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:17:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:17:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:17:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2024-04-25T02:17:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmiPbkOBAA+rBwAypY5jrR3xafG9h1sw==", 2024-04-25T02:17:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:17:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:17:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:17:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:17:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2024-04-25T02:17:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDJuilmP1AdGBAAS0IkH2E3XQvkxA33GInm5w==", 2024-04-25T02:17:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.964 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:17:30.964 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:17:30.964 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:17:30.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.964 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2024-04-25T02:17:30.964 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDMuilm479HFhAA8iIjBC94pqHikS5kPHipCQ==", 2024-04-25T02:17:30.964 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.964 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:17:30.964 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:17:30.964 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:17:30.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.965 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2024-04-25T02:17:30.965 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDPuilmE+k9FBAARX3P/kjt7ybeVHGGyYaWwg==", 2024-04-25T02:17:30.965 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.965 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:17:30.965 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:17:30.965 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:17:30.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.965 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2024-04-25T02:17:30.965 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDSuilmUF41EhAA1HhTXWnhVwETe+4hxmxjFw==", 2024-04-25T02:17:30.965 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.965 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:17:30.965 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:17:30.966 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:17:30.966 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.966 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2024-04-25T02:17:30.966 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDYuilm2pisGRAAFBmWVAGib2guJobYooLQoA==", 2024-04-25T02:17:30.966 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.966 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:17:30.966 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:17:30.966 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:17:30.966 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.966 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2024-04-25T02:17:30.966 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDbuilm28m9FxAA8GOmzxRAlK6o/RTe+FpL7g==", 2024-04-25T02:17:30.967 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.967 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:17:30.967 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:17:30.967 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:17:30.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.967 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2024-04-25T02:17:30.967 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDeuilmzDRyFRAAKk7JWPVRxxE+B4OCJhaXvg==", 2024-04-25T02:17:30.967 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.967 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:17:30.967 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:17:30.967 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:17:30.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.968 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2024-04-25T02:17:30.968 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDhuilmQABhExAA40Inq4eg4oohO3tmNdCyPQ==", 2024-04-25T02:17:30.968 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.968 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-04-25T02:17:30.968 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-04-25T02:17:30.968 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:17:30.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.968 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2024-04-25T02:17:30.968 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g==", 2024-04-25T02:17:30.968 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.968 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:17:30.968 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2024-04-25T02:17:30.969 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T02:17:30.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.969 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2024-04-25T02:17:30.969 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilm8EWZCRAAjRomNRANd7sC+tpYZ1uE6w==", 2024-04-25T02:17:30.969 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.969 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:17:30.969 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:17:30.969 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:17:30.969 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:17:30.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.970 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2024-04-25T02:17:30.970 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmHUedBhAA84h2PNUgReBGQ3rubcEDsw==", 2024-04-25T02:17:30.970 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.970 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:17:30.970 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:17:30.970 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:17:30.970 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:17:30.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.970 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2024-04-25T02:17:30.970 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDGuilmCx4UDxAAZmQdQB8RdTMr2JKr7TMySg==", 2024-04-25T02:17:30.970 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.970 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-04-25T02:17:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-04-25T02:17:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-04-25T02:17:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-04-25T02:17:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2024-04-25T02:17:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmFgdeDBAAu+VeVhknKsm+Gxzh5+qANg==", 2024-04-25T02:17:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:17:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-04-25T02:17:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-04-25T02:17:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:17:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2024-04-25T02:17:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmXrLhIxAAiq13px9HksQtu+qjoRi1qQ==", 2024-04-25T02:17:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:17:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-04-25T02:17:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:17:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T02:17:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2024-04-25T02:17:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDFuilmV8dxIBAA8GX2T/ZqZF+3qDjtddh/ZQ==", 2024-04-25T02:17:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-04-25T02:17:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-04-25T02:17:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-04-25T02:17:30.973 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-04-25T02:17:30.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:30.973 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T02:17:30.973 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:17:30.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.958+0000 7fe7b3029640 1 -- 172.21.15.79:0/3454148076 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe79006be60 msgr2=0x7fe79006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:30.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.958+0000 7fe7b3029640 1 --2- 172.21.15.79:0/3454148076 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe79006be60 0x7fe79006e320 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00098f0 tx=0x7fe7a0008040 comp rx=0 tx=0).stop 2024-04-25T02:17:30.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.958+0000 7fe7b3029640 1 -- 172.21.15.79:0/3454148076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac0b48e0 msgr2=0x7fe7ac0adb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:30.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.958+0000 7fe7b3029640 1 --2- 172.21.15.79:0/3454148076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac0b48e0 0x7fe7ac0adb40 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fe798000c00 tx=0x7fe7980046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:30.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.958+0000 7fe7b3029640 1 -- 172.21.15.79:0/3454148076 shutdown_connections 2024-04-25T02:17:30.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.958+0000 7fe7b3029640 1 --2- 172.21.15.79:0/3454148076 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe79006be60 0x7fe79006e320 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:30.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.958+0000 7fe7b3029640 1 --2- 172.21.15.79:0/3454148076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7ac143bc0 0x7fe7ac141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:30.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.958+0000 7fe7b3029640 1 --2- 172.21.15.79:0/3454148076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac0b48e0 0x7fe7ac0adb40 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:30.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.958+0000 7fe7b3029640 1 --2- 172.21.15.79:0/3454148076 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7ac06df50 0x7fe7ac1599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:30.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.958+0000 7fe7b3029640 1 -- 172.21.15.79:0/3454148076 >> 172.21.15.79:0/3454148076 conn(0x7fe7ac0cfc80 msgr2=0x7fe7ac071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:30.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.958+0000 7fe7b3029640 1 -- 172.21.15.79:0/3454148076 shutdown_connections 2024-04-25T02:17:30.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:30.958+0000 7fe7b3029640 1 -- 172.21.15.79:0/3454148076 wait complete. 2024-04-25T02:17:30.976 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:17:31.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.068+0000 7f6a59734640 1 Processor -- start 2024-04-25T02:17:31.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.068+0000 7f6a59734640 1 -- start start 2024-04-25T02:17:31.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.068+0000 7f6a59734640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a5406e8c0 0x7f6a5415c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.068+0000 7f6a59734640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a540cd170 0x7f6a54160470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.068+0000 7f6a59734640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a5415cce0 con 0x7f6a541609b0 2024-04-25T02:17:31.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.068+0000 7f6a59734640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6a5406eca0 con 0x7f6a5406e8c0 2024-04-25T02:17:31.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.069+0000 7f6a59734640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5415cf80 con 0x7f6a540cd170 2024-04-25T02:17:31.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.069+0000 7f6a52ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a5406e8c0 0x7f6a5415c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:31.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.069+0000 7f6a52ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a5406e8c0 0x7f6a5415c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50390/0 (socket says 172.21.15.79:50390) 2024-04-25T02:17:31.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.069+0000 7f6a52ffd640 1 -- 172.21.15.79:0/966478354 learned_addr learned my addr 172.21.15.79:0/966478354 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:31.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.069+0000 7f6a52ffd640 1 -- 172.21.15.79:0/966478354 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a540cd170 msgr2=0x7f6a54160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:31.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.069+0000 7f6a52ffd640 1 --2- 172.21.15.79:0/966478354 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a540cd170 0x7f6a54160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.069+0000 7f6a52ffd640 1 -- 172.21.15.79:0/966478354 >> v1:172.21.15.189:6789/0 conn(0x7f6a541609b0 legacy=0x7f6a540cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:31.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.069+0000 7f6a52ffd640 1 -- 172.21.15.79:0/966478354 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5415d260 con 0x7f6a5406e8c0 2024-04-25T02:17:31.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.070+0000 7f6a52ffd640 1 --2- 172.21.15.79:0/966478354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a5406e8c0 0x7f6a5415c7a0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009870 tx=0x7f6a4402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8bc22870c1988f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:31.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.070+0000 7f6a527fc640 1 -- 172.21.15.79:0/966478354 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44037070 con 0x7f6a5406e8c0 2024-04-25T02:17:31.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.070+0000 7f6a527fc640 1 -- 172.21.15.79:0/966478354 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44032440 con 0x7f6a5406e8c0 2024-04-25T02:17:31.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.070+0000 7f6a527fc640 1 -- 172.21.15.79:0/966478354 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44032810 con 0x7f6a5406e8c0 2024-04-25T02:17:31.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.070+0000 7f6a59734640 1 -- 172.21.15.79:0/966478354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a5406e8c0 msgr2=0x7f6a5415c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.070+0000 7f6a59734640 1 --2- 172.21.15.79:0/966478354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a5406e8c0 0x7f6a5415c7a0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009870 tx=0x7f6a4402a210 comp rx=0 tx=0).stop 2024-04-25T02:17:31.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.070+0000 7f6a59734640 1 -- 172.21.15.79:0/966478354 shutdown_connections 2024-04-25T02:17:31.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.070+0000 7f6a59734640 1 --2- 172.21.15.79:0/966478354 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a540cd170 0x7f6a54160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.070+0000 7f6a59734640 1 --2- 172.21.15.79:0/966478354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a5406e8c0 0x7f6a5415c7a0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.070+0000 7f6a59734640 1 -- 172.21.15.79:0/966478354 >> 172.21.15.79:0/966478354 conn(0x7f6a540cd770 msgr2=0x7f6a540cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.070+0000 7f6a59734640 1 -- 172.21.15.79:0/966478354 shutdown_connections 2024-04-25T02:17:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.070+0000 7f6a59734640 1 -- 172.21.15.79:0/966478354 wait complete. 2024-04-25T02:17:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.071+0000 7f6a59734640 1 Processor -- start 2024-04-25T02:17:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.072+0000 7f6a59734640 1 -- start start 2024-04-25T02:17:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.072+0000 7f6a59734640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a5406e8c0 0x7f6a540caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.072+0000 7f6a59734640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a540cd170 0x7f6a540c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.072+0000 7f6a59734640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a541609b0 0x7f6a540c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.072+0000 7f6a59734640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6a540cba50 con 0x7f6a5406e8c0 2024-04-25T02:17:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.072+0000 7f6a59734640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5415ff50 con 0x7f6a541609b0 2024-04-25T02:17:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.072+0000 7f6a59734640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6a540cbbd0 con 0x7f6a540cd170 2024-04-25T02:17:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.072+0000 7f6a52ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a5406e8c0 0x7f6a540caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.072+0000 7f6a52ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a5406e8c0 0x7f6a540caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50406/0 (socket says 172.21.15.79:50406) 2024-04-25T02:17:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.072+0000 7f6a52ffd640 1 -- 172.21.15.79:0/1100890658 learned_addr learned my addr 172.21.15.79:0/1100890658 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.073+0000 7f6a52ffd640 1 -- 172.21.15.79:0/1100890658 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a540cd170 msgr2=0x7f6a540c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.073+0000 7f6a52ffd640 1 --2- 172.21.15.79:0/1100890658 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a540cd170 0x7f6a540c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.073+0000 7f6a537fe640 1 --2- 172.21.15.79:0/1100890658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a541609b0 0x7f6a540c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:31.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.073+0000 7f6a52ffd640 1 -- 172.21.15.79:0/1100890658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a541609b0 msgr2=0x7f6a540c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.073+0000 7f6a52ffd640 1 --2- 172.21.15.79:0/1100890658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a541609b0 0x7f6a540c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.073+0000 7f6a52ffd640 1 -- 172.21.15.79:0/1100890658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a540c88d0 con 0x7f6a5406e8c0 2024-04-25T02:17:31.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.073+0000 7f6a537fe640 1 --2- 172.21.15.79:0/1100890658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a541609b0 0x7f6a540c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:31.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.073+0000 7f6a52ffd640 1 --2- 172.21.15.79:0/1100890658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a5406e8c0 0x7f6a540caae0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009870 tx=0x7f6a440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:31.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.073+0000 7f6a4b7fe640 1 -- 172.21.15.79:0/1100890658 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44041070 con 0x7f6a5406e8c0 2024-04-25T02:17:31.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.073+0000 7f6a4b7fe640 1 -- 172.21.15.79:0/1100890658 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a4403c870 con 0x7f6a5406e8c0 2024-04-25T02:17:31.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.073+0000 7f6a59734640 1 -- 172.21.15.79:0/1100890658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a540c5740 con 0x7f6a5406e8c0 2024-04-25T02:17:31.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.073+0000 7f6a4b7fe640 1 -- 172.21.15.79:0/1100890658 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44037040 con 0x7f6a5406e8c0 2024-04-25T02:17:31.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.073+0000 7f6a59734640 1 -- 172.21.15.79:0/1100890658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a540c5d00 con 0x7f6a5406e8c0 2024-04-25T02:17:31.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.074+0000 7f6a59734640 1 -- 172.21.15.79:0/1100890658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a540ce4c0 con 0x7f6a5406e8c0 2024-04-25T02:17:31.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.074+0000 7f6a4b7fe640 1 -- 172.21.15.79:0/1100890658 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a44044070 con 0x7f6a5406e8c0 2024-04-25T02:17:31.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.075+0000 7f6a4b7fe640 1 --2- 172.21.15.79:0/1100890658 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a3406be60 0x7f6a3406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.075+0000 7f6a4b7fe640 1 -- 172.21.15.79:0/1100890658 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4857+0+0 (secure 0 0 0) 0x7f6a440ab660 con 0x7f6a5406e8c0 2024-04-25T02:17:31.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.075+0000 7f6a4bfff640 1 --2- 172.21.15.79:0/1100890658 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a3406be60 0x7f6a3406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:31.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.075+0000 7f6a4bfff640 1 --2- 172.21.15.79:0/1100890658 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a3406be60 0x7f6a3406e320 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6a5415d8a0 tx=0x7f6a3c006c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:31.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.079+0000 7f6a4b7fe640 1 -- 172.21.15.79:0/1100890658 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6a540ce4c0 con 0x7f6a5406e8c0 2024-04-25T02:17:31.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.252+0000 7f6a59734640 1 -- 172.21.15.79:0/1100890658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a540690a0 con 0x7f6a5406e8c0 2024-04-25T02:17:31.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.253+0000 7f6a4b7fe640 1 -- 172.21.15.79:0/1100890658 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) ==== 74+0+12913 (secure 0 0 0) 0x7f6a4407a360 con 0x7f6a5406e8c0 2024-04-25T02:17:31.258 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:31.258 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":111,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:17:30.591635+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:17:31.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.255+0000 7f6a59734640 1 -- 172.21.15.79:0/1100890658 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a3406be60 msgr2=0x7f6a3406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.255+0000 7f6a59734640 1 --2- 172.21.15.79:0/1100890658 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a3406be60 0x7f6a3406e320 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6a5415d8a0 tx=0x7f6a3c006c90 comp rx=0 tx=0).stop 2024-04-25T02:17:31.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.255+0000 7f6a59734640 1 -- 172.21.15.79:0/1100890658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a5406e8c0 msgr2=0x7f6a540caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.255+0000 7f6a59734640 1 --2- 172.21.15.79:0/1100890658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a5406e8c0 0x7f6a540caae0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009870 tx=0x7f6a440046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.255+0000 7f6a59734640 1 -- 172.21.15.79:0/1100890658 shutdown_connections 2024-04-25T02:17:31.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.255+0000 7f6a59734640 1 --2- 172.21.15.79:0/1100890658 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6a3406be60 0x7f6a3406e320 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.255+0000 7f6a59734640 1 --2- 172.21.15.79:0/1100890658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a541609b0 0x7f6a540c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.255+0000 7f6a59734640 1 --2- 172.21.15.79:0/1100890658 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a540cd170 0x7f6a540c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.255+0000 7f6a59734640 1 --2- 172.21.15.79:0/1100890658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a5406e8c0 0x7f6a540caae0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.255+0000 7f6a59734640 1 -- 172.21.15.79:0/1100890658 >> 172.21.15.79:0/1100890658 conn(0x7f6a540cd770 msgr2=0x7f6a5415f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:31.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.255+0000 7f6a59734640 1 -- 172.21.15.79:0/1100890658 shutdown_connections 2024-04-25T02:17:31.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.255+0000 7f6a59734640 1 -- 172.21.15.79:0/1100890658 wait complete. 2024-04-25T02:17:31.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:17:31.271 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:17:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.368+0000 7ff2d3728640 1 Processor -- start 2024-04-25T02:17:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.368+0000 7ff2d3728640 1 -- start start 2024-04-25T02:17:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.369+0000 7ff2d3728640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2cc0cf7a0 0x7ff2cc0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.369+0000 7ff2d3728640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff2cc06e6b0 0x7ff2cc15b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.369+0000 7ff2d3728640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2cc15ec20 con 0x7ff2cc06b2f0 2024-04-25T02:17:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.369+0000 7ff2d3728640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff2cc15f830 con 0x7ff2cc0cf7a0 2024-04-25T02:17:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.369+0000 7ff2d3728640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff2cc15ef00 con 0x7ff2cc06e6b0 2024-04-25T02:17:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.369+0000 7ff2d0cc3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2cc0cf7a0 0x7ff2cc0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.369+0000 7ff2d0cc3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2cc0cf7a0 0x7ff2cc0b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50418/0 (socket says 172.21.15.79:50418) 2024-04-25T02:17:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.369+0000 7ff2d0cc3640 1 -- 172.21.15.79:0/494105495 learned_addr learned my addr 172.21.15.79:0/494105495 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.369+0000 7ff2d0cc3640 1 -- 172.21.15.79:0/494105495 >> v2:172.21.15.189:3300/0 conn(0x7ff2cc06e6b0 msgr2=0x7ff2cc15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.369+0000 7ff2d0cc3640 1 --2- 172.21.15.79:0/494105495 >> v2:172.21.15.189:3300/0 conn(0x7ff2cc06e6b0 0x7ff2cc15b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.369+0000 7ff2d0cc3640 1 -- 172.21.15.79:0/494105495 >> v1:172.21.15.189:6789/0 conn(0x7ff2cc06b2f0 legacy=0x7ff2cc06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.369+0000 7ff2d0cc3640 1 -- 172.21.15.79:0/494105495 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2cc15f1e0 con 0x7ff2cc0cf7a0 2024-04-25T02:17:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.370+0000 7ff2d0cc3640 1 --2- 172.21.15.79:0/494105495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc0cf7a0 0x7ff2cc0b4b50 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc15f9b0 tx=0x7ff2bc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e209ea1069af027 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.370+0000 7ff2c3fff640 1 -- 172.21.15.79:0/494105495 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc037070 con 0x7ff2cc0cf7a0 2024-04-25T02:17:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.370+0000 7ff2c3fff640 1 -- 172.21.15.79:0/494105495 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2bc032440 con 0x7ff2cc0cf7a0 2024-04-25T02:17:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.370+0000 7ff2c3fff640 1 -- 172.21.15.79:0/494105495 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc032810 con 0x7ff2cc0cf7a0 2024-04-25T02:17:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.371+0000 7ff2d3728640 1 -- 172.21.15.79:0/494105495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc0cf7a0 msgr2=0x7ff2cc0b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.371+0000 7ff2d3728640 1 --2- 172.21.15.79:0/494105495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc0cf7a0 0x7ff2cc0b4b50 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc15f9b0 tx=0x7ff2bc02a180 comp rx=0 tx=0).stop 2024-04-25T02:17:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.371+0000 7ff2d3728640 1 -- 172.21.15.79:0/494105495 shutdown_connections 2024-04-25T02:17:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.371+0000 7ff2d3728640 1 --2- 172.21.15.79:0/494105495 >> v2:172.21.15.189:3300/0 conn(0x7ff2cc06e6b0 0x7ff2cc15b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.371+0000 7ff2d3728640 1 --2- 172.21.15.79:0/494105495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc0cf7a0 0x7ff2cc0b4b50 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.371+0000 7ff2d3728640 1 -- 172.21.15.79:0/494105495 >> 172.21.15.79:0/494105495 conn(0x7ff2cc0b1cd0 msgr2=0x7ff2cc0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.371+0000 7ff2d3728640 1 -- 172.21.15.79:0/494105495 shutdown_connections 2024-04-25T02:17:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.371+0000 7ff2d3728640 1 -- 172.21.15.79:0/494105495 wait complete. 2024-04-25T02:17:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.372+0000 7ff2d3728640 1 Processor -- start 2024-04-25T02:17:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.372+0000 7ff2d3728640 1 -- start start 2024-04-25T02:17:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.372+0000 7ff2d3728640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc06b2f0 0x7ff2cc071c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.372+0000 7ff2d3728640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2cc06e6b0 0x7ff2cc14b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d3728640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2cc0cf7a0 0x7ff2cc0afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d3728640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc06d160 con 0x7ff2cc06b2f0 2024-04-25T02:17:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d3728640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc06cfe0 con 0x7ff2cc06e6b0 2024-04-25T02:17:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d3728640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff2cc15b810 con 0x7ff2cc0cf7a0 2024-04-25T02:17:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d14c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc06b2f0 0x7ff2cc071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d14c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc06b2f0 0x7ff2cc071c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50424/0 (socket says 172.21.15.79:50424) 2024-04-25T02:17:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d14c4640 1 -- 172.21.15.79:0/2559281160 learned_addr learned my addr 172.21.15.79:0/2559281160 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d0cc3640 1 --2- 172.21.15.79:0/2559281160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2cc06e6b0 0x7ff2cc14b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d1cc5640 1 --2- 172.21.15.79:0/2559281160 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2cc0cf7a0 0x7ff2cc0afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d14c4640 1 -- 172.21.15.79:0/2559281160 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2cc0cf7a0 msgr2=0x7ff2cc0afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d14c4640 1 --2- 172.21.15.79:0/2559281160 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2cc0cf7a0 0x7ff2cc0afe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d14c4640 1 -- 172.21.15.79:0/2559281160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2cc06e6b0 msgr2=0x7ff2cc14b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d14c4640 1 --2- 172.21.15.79:0/2559281160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2cc06e6b0 0x7ff2cc14b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d14c4640 1 -- 172.21.15.79:0/2559281160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2cc070ed0 con 0x7ff2cc06b2f0 2024-04-25T02:17:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d0cc3640 1 --2- 172.21.15.79:0/2559281160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2cc06e6b0 0x7ff2cc14b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d14c4640 1 --2- 172.21.15.79:0/2559281160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc06b2f0 0x7ff2cc071c90 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800c410 tx=0x7ff2c800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2c1ffb640 1 -- 172.21.15.79:0/2559281160 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8017070 con 0x7ff2cc06b2f0 2024-04-25T02:17:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2c1ffb640 1 -- 172.21.15.79:0/2559281160 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c80035f0 con 0x7ff2cc06b2f0 2024-04-25T02:17:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d3728640 1 -- 172.21.15.79:0/2559281160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2cc0711b0 con 0x7ff2cc06b2f0 2024-04-25T02:17:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2c1ffb640 1 -- 172.21.15.79:0/2559281160 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c80039e0 con 0x7ff2cc06b2f0 2024-04-25T02:17:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.373+0000 7ff2d3728640 1 -- 172.21.15.79:0/2559281160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2cc071770 con 0x7ff2cc06b2f0 2024-04-25T02:17:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.375+0000 7ff2c1ffb640 1 -- 172.21.15.79:0/2559281160 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2c8003b80 con 0x7ff2cc06b2f0 2024-04-25T02:17:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.374+0000 7ff2d3728640 1 -- 172.21.15.79:0/2559281160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2cc0690a0 con 0x7ff2cc06b2f0 2024-04-25T02:17:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.375+0000 7ff2c1ffb640 1 --2- 172.21.15.79:0/2559281160 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2b006be30 0x7ff2b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.375+0000 7ff2d0cc3640 1 --2- 172.21.15.79:0/2559281160 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2b006be30 0x7ff2b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.375+0000 7ff2c1ffb640 1 -- 172.21.15.79:0/2559281160 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4857+0+0 (secure 0 0 0) 0x7ff2c8089f90 con 0x7ff2cc06b2f0 2024-04-25T02:17:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.375+0000 7ff2d0cc3640 1 --2- 172.21.15.79:0/2559281160 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2b006be30 0x7ff2b006e2f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc034000 tx=0x7ff2bc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.379+0000 7ff2c1ffb640 1 -- 172.21.15.79:0/2559281160 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff2c8058c10 con 0x7ff2cc06b2f0 2024-04-25T02:17:31.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.550+0000 7ff2d3728640 1 -- 172.21.15.79:0/2559281160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff2cc0cf4f0 con 0x7ff2cc06b2f0 2024-04-25T02:17:31.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.551+0000 7ff2c1ffb640 1 -- 172.21.15.79:0/2559281160 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) ==== 93+0+10 (secure 0 0 0) 0x7ff2c80770a0 con 0x7ff2cc06b2f0 2024-04-25T02:17:31.556 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:17:31.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.553+0000 7ff2d3728640 1 -- 172.21.15.79:0/2559281160 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2b006be30 msgr2=0x7ff2b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.553+0000 7ff2d3728640 1 --2- 172.21.15.79:0/2559281160 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2b006be30 0x7ff2b006e2f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc034000 tx=0x7ff2bc02e000 comp rx=0 tx=0).stop 2024-04-25T02:17:31.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.553+0000 7ff2d3728640 1 -- 172.21.15.79:0/2559281160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc06b2f0 msgr2=0x7ff2cc071c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.553+0000 7ff2d3728640 1 --2- 172.21.15.79:0/2559281160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc06b2f0 0x7ff2cc071c90 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800c410 tx=0x7ff2c800c8d0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.553+0000 7ff2d3728640 1 -- 172.21.15.79:0/2559281160 shutdown_connections 2024-04-25T02:17:31.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.553+0000 7ff2d3728640 1 --2- 172.21.15.79:0/2559281160 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2b006be30 0x7ff2b006e2f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.553+0000 7ff2d3728640 1 --2- 172.21.15.79:0/2559281160 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2cc0cf7a0 0x7ff2cc0afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.553+0000 7ff2d3728640 1 --2- 172.21.15.79:0/2559281160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2cc06e6b0 0x7ff2cc14b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.553+0000 7ff2d3728640 1 --2- 172.21.15.79:0/2559281160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc06b2f0 0x7ff2cc071c90 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.553+0000 7ff2d3728640 1 -- 172.21.15.79:0/2559281160 >> 172.21.15.79:0/2559281160 conn(0x7ff2cc0b1cd0 msgr2=0x7ff2cc06b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:31.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.553+0000 7ff2d3728640 1 -- 172.21.15.79:0/2559281160 shutdown_connections 2024-04-25T02:17:31.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.553+0000 7ff2d3728640 1 -- 172.21.15.79:0/2559281160 wait complete. 2024-04-25T02:17:31.568 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T02:17:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.660+0000 7f2a767f9640 1 Processor -- start 2024-04-25T02:17:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.660+0000 7f2a767f9640 1 -- start start 2024-04-25T02:17:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.661+0000 7f2a767f9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2a7006df50 0x7f2a7006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.661+0000 7f2a767f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a700b2d30 0x7f2a700b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.661+0000 7f2a767f9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a70071e00 con 0x7f2a70143bc0 2024-04-25T02:17:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.661+0000 7f2a767f9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2a7006e8f0 con 0x7f2a7006df50 2024-04-25T02:17:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.661+0000 7f2a767f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2a70072cb0 con 0x7f2a700b2d30 2024-04-25T02:17:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.661+0000 7f2a6ffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2a70143bc0 0x7f2a7015f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49448/0 (socket says 172.21.15.79:49448) 2024-04-25T02:17:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.661+0000 7f2a6ffff640 1 -- 172.21.15.79:0/3672719988 learned_addr learned my addr 172.21.15.79:0/3672719988 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.661+0000 7f2a6f7fe640 1 --2- 172.21.15.79:0/3672719988 >> v2:172.21.15.79:3300/0 conn(0x7f2a7006df50 0x7f2a7006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.661+0000 7f2a6effd640 1 -- 172.21.15.79:0/3672719988 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7778712 0 0) 0x7f2a70071e00 con 0x7f2a70143bc0 2024-04-25T02:17:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.661+0000 7f2a6effd640 1 -- 172.21.15.79:0/3672719988 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a58003520 con 0x7f2a70143bc0 2024-04-25T02:17:31.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.661+0000 7f2a74d96640 1 --2- 172.21.15.79:0/3672719988 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a700b2d30 0x7f2a700b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:31.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.662+0000 7f2a6f7fe640 1 -- 172.21.15.79:0/3672719988 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a700b2d30 msgr2=0x7f2a700b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:31.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.662+0000 7f2a6f7fe640 1 --2- 172.21.15.79:0/3672719988 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a700b2d30 0x7f2a700b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.662+0000 7f2a6f7fe640 1 -- 172.21.15.79:0/3672719988 >> v1:172.21.15.79:6789/0 conn(0x7f2a70143bc0 legacy=0x7f2a7015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.662+0000 7f2a6f7fe640 1 -- 172.21.15.79:0/3672719988 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a700720a0 con 0x7f2a7006df50 2024-04-25T02:17:31.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.662+0000 7f2a6f7fe640 1 --2- 172.21.15.79:0/3672719988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a7006df50 0x7f2a7006e3b0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f2a640097a0 tx=0x7f2a6402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e4b9d43537e99c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:31.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.662+0000 7f2a6effd640 1 -- 172.21.15.79:0/3672719988 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a64037070 con 0x7f2a7006df50 2024-04-25T02:17:31.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.662+0000 7f2a6effd640 1 -- 172.21.15.79:0/3672719988 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a6402ae50 con 0x7f2a7006df50 2024-04-25T02:17:31.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.662+0000 7f2a6effd640 1 -- 172.21.15.79:0/3672719988 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a64032660 con 0x7f2a7006df50 2024-04-25T02:17:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.663+0000 7f2a767f9640 1 -- 172.21.15.79:0/3672719988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a7006df50 msgr2=0x7f2a7006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.663+0000 7f2a767f9640 1 --2- 172.21.15.79:0/3672719988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a7006df50 0x7f2a7006e3b0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f2a640097a0 tx=0x7f2a6402a100 comp rx=0 tx=0).stop 2024-04-25T02:17:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.663+0000 7f2a767f9640 1 -- 172.21.15.79:0/3672719988 shutdown_connections 2024-04-25T02:17:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.663+0000 7f2a767f9640 1 --2- 172.21.15.79:0/3672719988 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a700b2d30 0x7f2a700b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.663+0000 7f2a767f9640 1 --2- 172.21.15.79:0/3672719988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a7006df50 0x7f2a7006e3b0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.663+0000 7f2a767f9640 1 -- 172.21.15.79:0/3672719988 >> 172.21.15.79:0/3672719988 conn(0x7f2a700cfc80 msgr2=0x7f2a700d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.663+0000 7f2a767f9640 1 -- 172.21.15.79:0/3672719988 shutdown_connections 2024-04-25T02:17:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.663+0000 7f2a767f9640 1 -- 172.21.15.79:0/3672719988 wait complete. 2024-04-25T02:17:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.664+0000 7f2a767f9640 1 Processor -- start 2024-04-25T02:17:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.664+0000 7f2a767f9640 1 -- start start 2024-04-25T02:17:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a767f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a7006df50 0x7f2a7013fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a767f9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a700b2d30 0x7f2a70141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a767f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a70143bc0 0x7f2a700b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a767f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2a70072940 con 0x7f2a7006df50 2024-04-25T02:17:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a767f9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2a70072660 con 0x7f2a700b2d30 2024-04-25T02:17:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a767f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2a70143fa0 con 0x7f2a70143bc0 2024-04-25T02:17:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a6ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a7006df50 0x7f2a7013fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a6ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a7006df50 0x7f2a7013fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50432/0 (socket says 172.21.15.79:50432) 2024-04-25T02:17:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a6ffff640 1 -- 172.21.15.79:0/3431813318 learned_addr learned my addr 172.21.15.79:0/3431813318 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a74d96640 1 --2- 172.21.15.79:0/3431813318 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a70143bc0 0x7f2a700b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a6f7fe640 1 --2- 172.21.15.79:0/3431813318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a700b2d30 0x7f2a70141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a6ffff640 1 -- 172.21.15.79:0/3431813318 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a70143bc0 msgr2=0x7f2a700b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a6ffff640 1 --2- 172.21.15.79:0/3431813318 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a70143bc0 0x7f2a700b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a6ffff640 1 -- 172.21.15.79:0/3431813318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a700b2d30 msgr2=0x7f2a70141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a6ffff640 1 --2- 172.21.15.79:0/3431813318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a700b2d30 0x7f2a70141f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a6ffff640 1 -- 172.21.15.79:0/3431813318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a701405a0 con 0x7f2a7006df50 2024-04-25T02:17:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a6f7fe640 1 --2- 172.21.15.79:0/3431813318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a700b2d30 0x7f2a70141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.665+0000 7f2a6ffff640 1 --2- 172.21.15.79:0/3431813318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a7006df50 0x7f2a7013fe30 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000c430 tx=0x7f2a6000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.666+0000 7f2a6cff9640 1 -- 172.21.15.79:0/3431813318 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60017070 con 0x7f2a7006df50 2024-04-25T02:17:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.666+0000 7f2a6cff9640 1 -- 172.21.15.79:0/3431813318 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a60005ce0 con 0x7f2a7006df50 2024-04-25T02:17:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.666+0000 7f2a767f9640 1 -- 172.21.15.79:0/3431813318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a70140880 con 0x7f2a7006df50 2024-04-25T02:17:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.666+0000 7f2a6cff9640 1 -- 172.21.15.79:0/3431813318 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a600072f0 con 0x7f2a7006df50 2024-04-25T02:17:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.666+0000 7f2a767f9640 1 -- 172.21.15.79:0/3431813318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a70140e40 con 0x7f2a7006df50 2024-04-25T02:17:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.667+0000 7f2a767f9640 1 -- 172.21.15.79:0/3431813318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a700690a0 con 0x7f2a7006df50 2024-04-25T02:17:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.667+0000 7f2a6cff9640 1 -- 172.21.15.79:0/3431813318 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a6001a070 con 0x7f2a7006df50 2024-04-25T02:17:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.667+0000 7f2a6cff9640 1 --2- 172.21.15.79:0/3431813318 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a5c06be30 0x7f2a5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:31.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.667+0000 7f2a6cff9640 1 -- 172.21.15.79:0/3431813318 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4857+0+0 (secure 0 0 0) 0x7f2a6008a010 con 0x7f2a7006df50 2024-04-25T02:17:31.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.667+0000 7f2a6f7fe640 1 --2- 172.21.15.79:0/3431813318 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a5c06be30 0x7f2a5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:31.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.668+0000 7f2a6f7fe640 1 --2- 172.21.15.79:0/3431813318 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a5c06be30 0x7f2a5c06e2f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2a64034000 tx=0x7f2a6402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:31.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.672+0000 7f2a6cff9640 1 -- 172.21.15.79:0/3431813318 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2a60058d10 con 0x7f2a7006df50 2024-04-25T02:17:31.851 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:17:31.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.846+0000 7f2a767f9640 1 -- 172.21.15.79:0/3431813318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2a70073000 con 0x7f2a7006df50 2024-04-25T02:17:31.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.847+0000 7f2a6cff9640 1 -- 172.21.15.79:0/3431813318 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v111) ==== 84+0+65 (secure 0 0 0) 0x7f2a60058610 con 0x7f2a7006df50 2024-04-25T02:17:31.852 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:31.852 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-04-25T02:17:31.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T02:17:31.852 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-04-25T02:17:31.853 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-04-25T02:17:31.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T02:17:31.853 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-04-25T02:17:31.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.849+0000 7f2a767f9640 1 -- 172.21.15.79:0/3431813318 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a5c06be30 msgr2=0x7f2a5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.849+0000 7f2a767f9640 1 --2- 172.21.15.79:0/3431813318 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a5c06be30 0x7f2a5c06e2f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2a64034000 tx=0x7f2a6402e000 comp rx=0 tx=0).stop 2024-04-25T02:17:31.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.849+0000 7f2a767f9640 1 -- 172.21.15.79:0/3431813318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a7006df50 msgr2=0x7f2a7013fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:31.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.849+0000 7f2a767f9640 1 --2- 172.21.15.79:0/3431813318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a7006df50 0x7f2a7013fe30 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000c430 tx=0x7f2a6000c8f0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.849+0000 7f2a767f9640 1 -- 172.21.15.79:0/3431813318 shutdown_connections 2024-04-25T02:17:31.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.849+0000 7f2a767f9640 1 --2- 172.21.15.79:0/3431813318 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2a5c06be30 0x7f2a5c06e2f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.849+0000 7f2a767f9640 1 --2- 172.21.15.79:0/3431813318 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2a70143bc0 0x7f2a700b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.849+0000 7f2a767f9640 1 --2- 172.21.15.79:0/3431813318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a700b2d30 0x7f2a70141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.849+0000 7f2a767f9640 1 --2- 172.21.15.79:0/3431813318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a7006df50 0x7f2a7013fe30 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.849+0000 7f2a767f9640 1 -- 172.21.15.79:0/3431813318 >> 172.21.15.79:0/3431813318 conn(0x7f2a700cfc80 msgr2=0x7f2a7006d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.849+0000 7f2a767f9640 1 -- 172.21.15.79:0/3431813318 shutdown_connections 2024-04-25T02:17:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:31.849+0000 7f2a767f9640 1 -- 172.21.15.79:0/3431813318 wait complete. 2024-04-25T02:17:31.855 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:17:31.864 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T02:17:31.865 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T02:17:32.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.001+0000 7f491b15a640 1 Processor -- start 2024-04-25T02:17:32.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.001+0000 7f491b15a640 1 -- start start 2024-04-25T02:17:32.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.002+0000 7f491b15a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4914151780 0x7f491415b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.002+0000 7f491b15a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49140b4e10 0x7f491406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.002+0000 7f491b15a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f491406e0c0 0x7f491415e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.002+0000 7f491b15a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f491406e510 con 0x7f4914151780 2024-04-25T02:17:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.002+0000 7f491b15a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f49140b3e40 con 0x7f491406e0c0 2024-04-25T02:17:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.002+0000 7f491b15a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f49140b2da0 con 0x7f49140b4e10 2024-04-25T02:17:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.002+0000 7f4918ef6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4914151780 0x7f491415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.002+0000 7f4918ef6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4914151780 0x7f491415b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50442/0 (socket says 172.21.15.79:50442) 2024-04-25T02:17:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.002+0000 7f4918ef6640 1 -- 172.21.15.79:0/223332518 learned_addr learned my addr 172.21.15.79:0/223332518 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.002+0000 7f4913fff640 1 --2- 172.21.15.79:0/223332518 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49140b4e10 0x7f491406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.003+0000 7f4918ef6640 1 -- 172.21.15.79:0/223332518 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49140b4e10 msgr2=0x7f491406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.002+0000 7f49196f7640 1 --2- 172.21.15.79:0/223332518 >> v2:172.21.15.189:3300/0 conn(0x7f491406e0c0 0x7f491415e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.003+0000 7f4918ef6640 1 --2- 172.21.15.79:0/223332518 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49140b4e10 0x7f491406db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.003+0000 7f4918ef6640 1 -- 172.21.15.79:0/223332518 >> v2:172.21.15.189:3300/0 conn(0x7f491406e0c0 msgr2=0x7f491415e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.003+0000 7f4918ef6640 1 --2- 172.21.15.79:0/223332518 >> v2:172.21.15.189:3300/0 conn(0x7f491406e0c0 0x7f491415e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.003+0000 7f4918ef6640 1 -- 172.21.15.79:0/223332518 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49140b3080 con 0x7f4914151780 2024-04-25T02:17:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.003+0000 7f4913fff640 1 --2- 172.21.15.79:0/223332518 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49140b4e10 0x7f491406db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.003+0000 7f49196f7640 1 --2- 172.21.15.79:0/223332518 >> v2:172.21.15.189:3300/0 conn(0x7f491406e0c0 0x7f491415e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.003+0000 7f4918ef6640 1 --2- 172.21.15.79:0/223332518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4914151780 0x7f491415b720 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f49140cf410 tx=0x7f490402b2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550d45806068367c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.003+0000 7f49137fe640 1 -- 172.21.15.79:0/223332518 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904038070 con 0x7f4914151780 2024-04-25T02:17:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.003+0000 7f49137fe640 1 -- 172.21.15.79:0/223332518 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4904033640 con 0x7f4914151780 2024-04-25T02:17:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.003+0000 7f49137fe640 1 -- 172.21.15.79:0/223332518 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904033a10 con 0x7f4914151780 2024-04-25T02:17:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.004+0000 7f491b15a640 1 -- 172.21.15.79:0/223332518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4914151780 msgr2=0x7f491415b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.004+0000 7f491b15a640 1 --2- 172.21.15.79:0/223332518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4914151780 0x7f491415b720 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f49140cf410 tx=0x7f490402b2f0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.004+0000 7f491b15a640 1 -- 172.21.15.79:0/223332518 shutdown_connections 2024-04-25T02:17:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.004+0000 7f491b15a640 1 --2- 172.21.15.79:0/223332518 >> v2:172.21.15.189:3300/0 conn(0x7f491406e0c0 0x7f491415e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.004+0000 7f491b15a640 1 --2- 172.21.15.79:0/223332518 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49140b4e10 0x7f491406db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.004+0000 7f491b15a640 1 --2- 172.21.15.79:0/223332518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4914151780 0x7f491415b720 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.004+0000 7f491b15a640 1 -- 172.21.15.79:0/223332518 >> 172.21.15.79:0/223332518 conn(0x7f491406b4a0 msgr2=0x7f491406b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.004+0000 7f491b15a640 1 -- 172.21.15.79:0/223332518 shutdown_connections 2024-04-25T02:17:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.004+0000 7f491b15a640 1 -- 172.21.15.79:0/223332518 wait complete. 2024-04-25T02:17:32.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.005+0000 7f491b15a640 1 Processor -- start 2024-04-25T02:17:32.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.005+0000 7f491b15a640 1 -- start start 2024-04-25T02:17:32.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.006+0000 7f491b15a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f491406e0c0 0x7f4914153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.006+0000 7f491b15a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49140b4e10 0x7f49140cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.006+0000 7f491b15a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4914151780 0x7f49140cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.006+0000 7f491b15a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f49140b3920 con 0x7f4914151780 2024-04-25T02:17:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.006+0000 7f491b15a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f49140b3640 con 0x7f49140b4e10 2024-04-25T02:17:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.006+0000 7f491b15a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f49140b5250 con 0x7f491406e0c0 2024-04-25T02:17:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.006+0000 7f49196f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4914151780 0x7f49140cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.006+0000 7f49196f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4914151780 0x7f49140cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50452/0 (socket says 172.21.15.79:50452) 2024-04-25T02:17:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.006+0000 7f49196f7640 1 -- 172.21.15.79:0/901020060 learned_addr learned my addr 172.21.15.79:0/901020060 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.006+0000 7f49196f7640 1 -- 172.21.15.79:0/901020060 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f491406e0c0 msgr2=0x7f4914153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.006+0000 7f49196f7640 1 --2- 172.21.15.79:0/901020060 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f491406e0c0 0x7f4914153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.006+0000 7f4913fff640 1 --2- 172.21.15.79:0/901020060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49140b4e10 0x7f49140cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.006+0000 7f49196f7640 1 -- 172.21.15.79:0/901020060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49140b4e10 msgr2=0x7f49140cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.006+0000 7f49196f7640 1 --2- 172.21.15.79:0/901020060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49140b4e10 0x7f49140cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.006+0000 7f49196f7640 1 -- 172.21.15.79:0/901020060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49141f4d30 con 0x7f4914151780 2024-04-25T02:17:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.007+0000 7f49196f7640 1 --2- 172.21.15.79:0/901020060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4914151780 0x7f49140cbae0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f490c00cd40 tx=0x7f490c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:32.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.007+0000 7f49117fa640 1 -- 172.21.15.79:0/901020060 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c00f680 con 0x7f4914151780 2024-04-25T02:17:32.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.007+0000 7f49117fa640 1 -- 172.21.15.79:0/901020060 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490c00f840 con 0x7f4914151780 2024-04-25T02:17:32.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.007+0000 7f49117fa640 1 -- 172.21.15.79:0/901020060 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c00fc30 con 0x7f4914151780 2024-04-25T02:17:32.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.007+0000 7f491b15a640 1 -- 172.21.15.79:0/901020060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4914151d00 con 0x7f4914151780 2024-04-25T02:17:32.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.007+0000 7f491b15a640 1 -- 172.21.15.79:0/901020060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49141522c0 con 0x7f4914151780 2024-04-25T02:17:32.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.008+0000 7f491b15a640 1 -- 172.21.15.79:0/901020060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49140690a0 con 0x7f4914151780 2024-04-25T02:17:32.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.008+0000 7f49117fa640 1 -- 172.21.15.79:0/901020060 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f490c0213f0 con 0x7f4914151780 2024-04-25T02:17:32.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.009+0000 7f49117fa640 1 --2- 172.21.15.79:0/901020060 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f490006be30 0x7f490006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.009+0000 7f49117fa640 1 -- 172.21.15.79:0/901020060 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4857+0+0 (secure 0 0 0) 0x7f490c08b8f0 con 0x7f4914151780 2024-04-25T02:17:32.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.009+0000 7f4918ef6640 1 --2- 172.21.15.79:0/901020060 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f490006be30 0x7f490006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:32.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.009+0000 7f4918ef6640 1 --2- 172.21.15.79:0/901020060 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f490006be30 0x7f490006e2f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4904035000 tx=0x7f490402d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:32.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.013+0000 7f49117fa640 1 -- 172.21.15.79:0/901020060 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f490c014030 con 0x7f4914151780 2024-04-25T02:17:32.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.188+0000 7f491b15a640 1 -- 172.21.15.79:0/901020060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f49140b46e0 con 0x7f4914151780 2024-04-25T02:17:32.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.603+0000 7f49117fa640 1 -- 172.21.15.79:0/901020060 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v112) ==== 138+0+0 (secure 0 0 0) 0x7f490c059fa0 con 0x7f4914151780 2024-04-25T02:17:32.608 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-04-25T02:17:32.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.606+0000 7f491b15a640 1 -- 172.21.15.79:0/901020060 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f490006be30 msgr2=0x7f490006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:32.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.606+0000 7f491b15a640 1 --2- 172.21.15.79:0/901020060 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f490006be30 0x7f490006e2f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4904035000 tx=0x7f490402d000 comp rx=0 tx=0).stop 2024-04-25T02:17:32.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.606+0000 7f491b15a640 1 -- 172.21.15.79:0/901020060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4914151780 msgr2=0x7f49140cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:32.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.606+0000 7f491b15a640 1 --2- 172.21.15.79:0/901020060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4914151780 0x7f49140cbae0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f490c00cd40 tx=0x7f490c00a650 comp rx=0 tx=0).stop 2024-04-25T02:17:32.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.606+0000 7f491b15a640 1 -- 172.21.15.79:0/901020060 shutdown_connections 2024-04-25T02:17:32.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.606+0000 7f491b15a640 1 --2- 172.21.15.79:0/901020060 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f490006be30 0x7f490006e2f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.606+0000 7f491b15a640 1 --2- 172.21.15.79:0/901020060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4914151780 0x7f49140cbae0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.606+0000 7f491b15a640 1 --2- 172.21.15.79:0/901020060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49140b4e10 0x7f49140cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.606+0000 7f491b15a640 1 --2- 172.21.15.79:0/901020060 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f491406e0c0 0x7f4914153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.606+0000 7f491b15a640 1 -- 172.21.15.79:0/901020060 >> 172.21.15.79:0/901020060 conn(0x7f491406b4a0 msgr2=0x7f491414e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:32.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.607+0000 7f491b15a640 1 -- 172.21.15.79:0/901020060 shutdown_connections 2024-04-25T02:17:32.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.607+0000 7f491b15a640 1 -- 172.21.15.79:0/901020060 wait complete. 2024-04-25T02:17:32.625 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T02:17:32.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.724+0000 7f192cb63640 1 Processor -- start 2024-04-25T02:17:32.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.724+0000 7f192cb63640 1 -- start start 2024-04-25T02:17:32.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.725+0000 7f192cb63640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f192815e4f0 0x7f19280d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.725+0000 7f192cb63640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f19280cf7f0 0x7f19280d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.725+0000 7f192cb63640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19280d1ee0 con 0x7f19280cfc50 2024-04-25T02:17:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.725+0000 7f192cb63640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f19280d21c0 con 0x7f19280cf7f0 2024-04-25T02:17:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.725+0000 7f192cb63640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f19280d24a0 con 0x7f192815e4f0 2024-04-25T02:17:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.725+0000 7f1926d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f19280cfc50 0x7f192806bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49450/0 (socket says 172.21.15.79:49450) 2024-04-25T02:17:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.725+0000 7f1926d9d640 1 -- 172.21.15.79:0/2670360727 learned_addr learned my addr 172.21.15.79:0/2670360727 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 -- 172.21.15.79:0/2670360727 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1114378969 0 0) 0x7f19280d1ee0 con 0x7f19280cfc50 2024-04-25T02:17:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 -- 172.21.15.79:0/2670360727 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1914003520 con 0x7f19280cfc50 2024-04-25T02:17:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f1925d9b640 1 --2- 172.21.15.79:0/2670360727 >> v2:172.21.15.189:3300/0 conn(0x7f19280cf7f0 0x7f19280d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192659c640 1 --2- 172.21.15.79:0/2670360727 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f192815e4f0 0x7f19280d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 -- 172.21.15.79:0/2670360727 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3551478943 0 0) 0x7f1914003520 con 0x7f19280cfc50 2024-04-25T02:17:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 -- 172.21.15.79:0/2670360727 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f192815e4f0 msgr2=0x7f19280d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 --2- 172.21.15.79:0/2670360727 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f192815e4f0 0x7f19280d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 -- 172.21.15.79:0/2670360727 >> v2:172.21.15.189:3300/0 conn(0x7f19280cf7f0 msgr2=0x7f19280d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 --2- 172.21.15.79:0/2670360727 >> v2:172.21.15.189:3300/0 conn(0x7f19280cf7f0 0x7f19280d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 -- 172.21.15.79:0/2670360727 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19280d2780 con 0x7f19280cfc50 2024-04-25T02:17:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 -- 172.21.15.79:0/2670360727 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f1920001670 con 0x7f19280cfc50 2024-04-25T02:17:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 -- 172.21.15.79:0/2670360727 >> v1:172.21.15.79:6789/0 conn(0x7f19280cfc50 legacy=0x7f192806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 --2- 172.21.15.79:0/2670360727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19140039b0 0x7f1914003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 --2- 172.21.15.79:0/2670360727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1914004800 0x7f1914004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 --2- 172.21.15.79:0/2670360727 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f192815e4f0 0x7f19140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 -- 172.21.15.79:0/2670360727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f19280d21c0 con 0x7f19140039b0 2024-04-25T02:17:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 -- 172.21.15.79:0/2670360727 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f19280d24a0 con 0x7f1914004800 2024-04-25T02:17:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192559a640 1 -- 172.21.15.79:0/2670360727 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f191400b9c0 con 0x7f192815e4f0 2024-04-25T02:17:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192659c640 1 --2- 172.21.15.79:0/2670360727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19140039b0 0x7f1914003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f1925d9b640 1 --2- 172.21.15.79:0/2670360727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1914004800 0x7f1914004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f1926d9d640 1 --2- 172.21.15.79:0/2670360727 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f192815e4f0 0x7f19140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192659c640 1 -- 172.21.15.79:0/2670360727 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f192815e4f0 msgr2=0x7f19140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192659c640 1 --2- 172.21.15.79:0/2670360727 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f192815e4f0 0x7f19140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192659c640 1 -- 172.21.15.79:0/2670360727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1914004800 msgr2=0x7f1914004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192659c640 1 --2- 172.21.15.79:0/2670360727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1914004800 0x7f1914004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f192659c640 1 -- 172.21.15.79:0/2670360727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1914003520 con 0x7f19140039b0 2024-04-25T02:17:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.726+0000 7f1925d9b640 1 --2- 172.21.15.79:0/2670360727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1914004800 0x7f1914004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.727+0000 7f192659c640 1 --2- 172.21.15.79:0/2670360727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19140039b0 0x7f1914003dd0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f1918009fc0 tx=0x7f1914005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba222f0dcbf8902a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.727+0000 7f192559a640 1 -- 172.21.15.79:0/2670360727 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1918034020 con 0x7f19140039b0 2024-04-25T02:17:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.727+0000 7f192559a640 1 -- 172.21.15.79:0/2670360727 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19180305f0 con 0x7f19140039b0 2024-04-25T02:17:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.727+0000 7f192559a640 1 -- 172.21.15.79:0/2670360727 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1918009c10 con 0x7f19140039b0 2024-04-25T02:17:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.728+0000 7f192cb63640 1 -- 172.21.15.79:0/2670360727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19140039b0 msgr2=0x7f1914003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.728+0000 7f192cb63640 1 --2- 172.21.15.79:0/2670360727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19140039b0 0x7f1914003dd0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f1918009fc0 tx=0x7f1914005830 comp rx=0 tx=0).stop 2024-04-25T02:17:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.728+0000 7f1926d9d640 1 -- 172.21.15.79:0/2670360727 reap_dead start 2024-04-25T02:17:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.728+0000 7f192cb63640 1 -- 172.21.15.79:0/2670360727 shutdown_connections 2024-04-25T02:17:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.728+0000 7f192cb63640 1 -- 172.21.15.79:0/2670360727 >> 172.21.15.79:0/2670360727 conn(0x7f192809d4a0 msgr2=0x7f19280d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.728+0000 7f192cb63640 1 -- 172.21.15.79:0/2670360727 shutdown_connections 2024-04-25T02:17:32.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.728+0000 7f192cb63640 1 -- 172.21.15.79:0/2670360727 wait complete. 2024-04-25T02:17:32.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.729+0000 7f192cb63640 1 Processor -- start 2024-04-25T02:17:32.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.729+0000 7f192cb63640 1 -- start start 2024-04-25T02:17:32.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f192cb63640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f19140039b0 0x7f192814e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f192cb63640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1928154ac0 0x7f19281f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f192cb63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19281f7ac0 0x7f19281f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f192cb63640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f19280d0ef0 con 0x7f19281f7ac0 2024-04-25T02:17:32.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f192cb63640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f19280d50f0 con 0x7f1928154ac0 2024-04-25T02:17:32.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f192cb63640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f19280d1070 con 0x7f19140039b0 2024-04-25T02:17:32.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f1926d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19281f7ac0 0x7f19281f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:32.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f1926d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19281f7ac0 0x7f19281f7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50468/0 (socket says 172.21.15.79:50468) 2024-04-25T02:17:32.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f1926d9d640 1 -- 172.21.15.79:0/4178455448 learned_addr learned my addr 172.21.15.79:0/4178455448 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:32.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f1925d9b640 1 --2- 172.21.15.79:0/4178455448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1928154ac0 0x7f19281f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:32.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f192659c640 1 --2- 172.21.15.79:0/4178455448 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f19140039b0 0x7f192814e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:32.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f1926d9d640 1 -- 172.21.15.79:0/4178455448 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f19140039b0 msgr2=0x7f192814e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:32.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f1926d9d640 1 --2- 172.21.15.79:0/4178455448 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f19140039b0 0x7f192814e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f1926d9d640 1 -- 172.21.15.79:0/4178455448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1928154ac0 msgr2=0x7f19281f7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f1926d9d640 1 --2- 172.21.15.79:0/4178455448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1928154ac0 0x7f19281f7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f1926d9d640 1 -- 172.21.15.79:0/4178455448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f192814e6a0 con 0x7f19281f7ac0 2024-04-25T02:17:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f1926d9d640 1 --2- 172.21.15.79:0/4178455448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19281f7ac0 0x7f19281f7f40 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f1920001970 tx=0x7f192000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f191effd640 1 -- 172.21.15.79:0/4178455448 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1920019070 con 0x7f19281f7ac0 2024-04-25T02:17:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.730+0000 7f191effd640 1 -- 172.21.15.79:0/4178455448 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f192000c610 con 0x7f19281f7ac0 2024-04-25T02:17:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.731+0000 7f192cb63640 1 -- 172.21.15.79:0/4178455448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19280b9080 con 0x7f19281f7ac0 2024-04-25T02:17:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.731+0000 7f191effd640 1 -- 172.21.15.79:0/4178455448 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192000c9e0 con 0x7f19281f7ac0 2024-04-25T02:17:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.731+0000 7f192cb63640 1 -- 172.21.15.79:0/4178455448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19280b9640 con 0x7f19281f7ac0 2024-04-25T02:17:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.731+0000 7f192cb63640 1 -- 172.21.15.79:0/4178455448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19280686c0 con 0x7f19281f7ac0 2024-04-25T02:17:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.732+0000 7f191effd640 1 -- 172.21.15.79:0/4178455448 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f192001c070 con 0x7f19281f7ac0 2024-04-25T02:17:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.733+0000 7f191effd640 1 --2- 172.21.15.79:0/4178455448 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f190806be30 0x7f190806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.733+0000 7f191effd640 1 -- 172.21.15.79:0/4178455448 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5227+0+0 (secure 0 0 0) 0x7f192008a140 con 0x7f19281f7ac0 2024-04-25T02:17:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.733+0000 7f192659c640 1 --2- 172.21.15.79:0/4178455448 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f190806be30 0x7f190806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.733+0000 7f192659c640 1 --2- 172.21.15.79:0/4178455448 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f190806be30 0x7f190806e2f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1918035000 tx=0x7f191802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:32.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.737+0000 7f191effd640 1 -- 172.21.15.79:0/4178455448 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1920058cd0 con 0x7f19281f7ac0 2024-04-25T02:17:32.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:32.910+0000 7f192cb63640 1 -- 172.21.15.79:0/4178455448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f19280d3500 con 0x7f19281f7ac0 2024-04-25T02:17:33.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.609+0000 7f191effd640 1 -- 172.21.15.79:0/4178455448 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v113) ==== 170+0+0 (secure 0 0 0) 0x7f19200585d0 con 0x7f19281f7ac0 2024-04-25T02:17:33.613 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-04-25T02:17:33.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.612+0000 7f192cb63640 1 -- 172.21.15.79:0/4178455448 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f190806be30 msgr2=0x7f190806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:33.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.612+0000 7f192cb63640 1 --2- 172.21.15.79:0/4178455448 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f190806be30 0x7f190806e2f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1918035000 tx=0x7f191802f000 comp rx=0 tx=0).stop 2024-04-25T02:17:33.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.612+0000 7f192cb63640 1 -- 172.21.15.79:0/4178455448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19281f7ac0 msgr2=0x7f19281f7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:33.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.612+0000 7f192cb63640 1 --2- 172.21.15.79:0/4178455448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19281f7ac0 0x7f19281f7f40 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f1920001970 tx=0x7f192000eb90 comp rx=0 tx=0).stop 2024-04-25T02:17:33.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.612+0000 7f192cb63640 1 -- 172.21.15.79:0/4178455448 shutdown_connections 2024-04-25T02:17:33.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.612+0000 7f192cb63640 1 --2- 172.21.15.79:0/4178455448 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f190806be30 0x7f190806e2f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:33.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.612+0000 7f192cb63640 1 --2- 172.21.15.79:0/4178455448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19281f7ac0 0x7f19281f7f40 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:33.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.612+0000 7f192cb63640 1 --2- 172.21.15.79:0/4178455448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1928154ac0 0x7f19281f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:33.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.612+0000 7f192cb63640 1 --2- 172.21.15.79:0/4178455448 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f19140039b0 0x7f192814e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:33.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.612+0000 7f192cb63640 1 -- 172.21.15.79:0/4178455448 >> 172.21.15.79:0/4178455448 conn(0x7f192809d4a0 msgr2=0x7f19280d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:33.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.612+0000 7f192cb63640 1 -- 172.21.15.79:0/4178455448 shutdown_connections 2024-04-25T02:17:33.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.613+0000 7f192cb63640 1 -- 172.21.15.79:0/4178455448 wait complete. 2024-04-25T02:17:33.639 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T02:17:33.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.736+0000 7f9a18390640 1 Processor -- start 2024-04-25T02:17:33.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.736+0000 7f9a18390640 1 -- start start 2024-04-25T02:17:33.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.737+0000 7f9a18390640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9a100b41b0 0x7f9a101605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:33.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.737+0000 7f9a18390640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9a1006b2f0 0x7f9a1006b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.737+0000 7f9a18390640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a10071cd0 con 0x7f9a10155f00 2024-04-25T02:17:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.737+0000 7f9a18390640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9a10071fb0 con 0x7f9a1006b2f0 2024-04-25T02:17:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.737+0000 7f9a18390640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f9a10072290 con 0x7f9a100b41b0 2024-04-25T02:17:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.737+0000 7f9a1592b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9a1006b2f0 0x7f9a1006b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.737+0000 7f9a1592b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9a1006b2f0 0x7f9a1006b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48034/0 (socket says 172.21.15.79:48034) 2024-04-25T02:17:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.737+0000 7f9a1592b640 1 -- 172.21.15.79:0/3906549130 learned_addr learned my addr 172.21.15.79:0/3906549130 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.737+0000 7f9a1612c640 1 --2- 172.21.15.79:0/3906549130 >> v2:172.21.15.189:3300/0 conn(0x7f9a100b41b0 0x7f9a101605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.737+0000 7f9a1592b640 1 -- 172.21.15.79:0/3906549130 >> v2:172.21.15.189:3300/0 conn(0x7f9a100b41b0 msgr2=0x7f9a101605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.737+0000 7f9a1592b640 1 --2- 172.21.15.79:0/3906549130 >> v2:172.21.15.189:3300/0 conn(0x7f9a100b41b0 0x7f9a101605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.737+0000 7f9a1592b640 1 -- 172.21.15.79:0/3906549130 >> v1:172.21.15.189:6789/0 conn(0x7f9a10155f00 legacy=0x7f9a10156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.737+0000 7f9a1592b640 1 -- 172.21.15.79:0/3906549130 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a10072570 con 0x7f9a1006b2f0 2024-04-25T02:17:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.738+0000 7f9a1592b640 1 --2- 172.21.15.79:0/3906549130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a1006b2f0 0x7f9a1006b770 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f9a100cdfb0 tx=0x7f9a0002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30022e0c7e3269a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.738+0000 7f9a1512a640 1 -- 172.21.15.79:0/3906549130 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00037070 con 0x7f9a1006b2f0 2024-04-25T02:17:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.738+0000 7f9a1512a640 1 -- 172.21.15.79:0/3906549130 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a00032440 con 0x7f9a1006b2f0 2024-04-25T02:17:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.738+0000 7f9a1512a640 1 -- 172.21.15.79:0/3906549130 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00032810 con 0x7f9a1006b2f0 2024-04-25T02:17:33.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.739+0000 7f9a18390640 1 -- 172.21.15.79:0/3906549130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a1006b2f0 msgr2=0x7f9a1006b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:33.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.739+0000 7f9a18390640 1 --2- 172.21.15.79:0/3906549130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a1006b2f0 0x7f9a1006b770 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f9a100cdfb0 tx=0x7f9a0002a230 comp rx=0 tx=0).stop 2024-04-25T02:17:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.739+0000 7f9a18390640 1 -- 172.21.15.79:0/3906549130 shutdown_connections 2024-04-25T02:17:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.739+0000 7f9a18390640 1 --2- 172.21.15.79:0/3906549130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a1006b2f0 0x7f9a1006b770 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.739+0000 7f9a18390640 1 --2- 172.21.15.79:0/3906549130 >> v2:172.21.15.189:3300/0 conn(0x7f9a100b41b0 0x7f9a101605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.739+0000 7f9a18390640 1 -- 172.21.15.79:0/3906549130 >> 172.21.15.79:0/3906549130 conn(0x7f9a100b1cd0 msgr2=0x7f9a100b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.739+0000 7f9a18390640 1 -- 172.21.15.79:0/3906549130 shutdown_connections 2024-04-25T02:17:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.739+0000 7f9a18390640 1 -- 172.21.15.79:0/3906549130 wait complete. 2024-04-25T02:17:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.740+0000 7f9a18390640 1 Processor -- start 2024-04-25T02:17:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.740+0000 7f9a18390640 1 -- start start 2024-04-25T02:17:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a18390640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a1006b2f0 0x7f9a101426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a18390640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a100b41b0 0x7f9a10155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a18390640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a10155f00 0x7f9a100b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a18390640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1015c870 con 0x7f9a100b41b0 2024-04-25T02:17:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a18390640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10072d70 con 0x7f9a10155f00 2024-04-25T02:17:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a18390640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9a10156a20 con 0x7f9a1006b2f0 2024-04-25T02:17:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a1592b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a100b41b0 0x7f9a10155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a1592b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a100b41b0 0x7f9a10155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48040/0 (socket says 172.21.15.79:48040) 2024-04-25T02:17:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a1592b640 1 -- 172.21.15.79:0/2103136566 learned_addr learned my addr 172.21.15.79:0/2103136566 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a1612c640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a1006b2f0 0x7f9a101426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a1692d640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a10155f00 0x7f9a100b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a1592b640 1 -- 172.21.15.79:0/2103136566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a1006b2f0 msgr2=0x7f9a101426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a1592b640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a1006b2f0 0x7f9a101426b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a1592b640 1 -- 172.21.15.79:0/2103136566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a10155f00 msgr2=0x7f9a100b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a1592b640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a10155f00 0x7f9a100b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a1592b640 1 -- 172.21.15.79:0/2103136566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a10142bf0 con 0x7f9a100b41b0 2024-04-25T02:17:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a1692d640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a10155f00 0x7f9a100b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a1612c640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a1006b2f0 0x7f9a101426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a1592b640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a100b41b0 0x7f9a10155500 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f9a0002a270 tx=0x7f9a000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a06ffd640 1 -- 172.21.15.79:0/2103136566 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00041020 con 0x7f9a100b41b0 2024-04-25T02:17:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a06ffd640 1 -- 172.21.15.79:0/2103136566 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a000306c0 con 0x7f9a100b41b0 2024-04-25T02:17:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a18390640 1 -- 172.21.15.79:0/2103136566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1009c9b0 con 0x7f9a100b41b0 2024-04-25T02:17:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a06ffd640 1 -- 172.21.15.79:0/2103136566 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00037040 con 0x7f9a100b41b0 2024-04-25T02:17:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.741+0000 7f9a18390640 1 -- 172.21.15.79:0/2103136566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a1009cf70 con 0x7f9a100b41b0 2024-04-25T02:17:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.742+0000 7f9a18390640 1 -- 172.21.15.79:0/2103136566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a100690a0 con 0x7f9a100b41b0 2024-04-25T02:17:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.743+0000 7f9a06ffd640 1 -- 172.21.15.79:0/2103136566 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a00044020 con 0x7f9a100b41b0 2024-04-25T02:17:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.743+0000 7f9a06ffd640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f99f406be30 0x7f99f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:33.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.744+0000 7f9a1612c640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f99f406be30 0x7f99f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:33.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.744+0000 7f9a06ffd640 1 -- 172.21.15.79:0/2103136566 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5609+0+0 (secure 0 0 0) 0x7f9a000ab5f0 con 0x7f9a100b41b0 2024-04-25T02:17:33.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.744+0000 7f9a1612c640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f99f406be30 0x7f99f406e2f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c006fd0 tx=0x7f9a0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.748+0000 7f9a06ffd640 1 -- 172.21.15.79:0/2103136566 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9a0004b030 con 0x7f9a100b41b0 2024-04-25T02:17:33.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:33.958+0000 7f9a18390640 1 -- 172.21.15.79:0/2103136566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9a10155a40 con 0x7f9a100b41b0 2024-04-25T02:17:34.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.611+0000 7f9a06ffd640 1 -- 172.21.15.79:0/2103136566 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v80) ==== 174+0+0 (secure 0 0 0) 0x7f9a10142bf0 con 0x7f9a100b41b0 2024-04-25T02:17:34.615 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 16 and data pool 17 2024-04-25T02:17:34.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.613+0000 7f9a18390640 1 -- 172.21.15.79:0/2103136566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f99f406be30 msgr2=0x7f99f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:34.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.613+0000 7f9a18390640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f99f406be30 0x7f99f406e2f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c006fd0 tx=0x7f9a0c008040 comp rx=0 tx=0).stop 2024-04-25T02:17:34.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.613+0000 7f9a18390640 1 -- 172.21.15.79:0/2103136566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a100b41b0 msgr2=0x7f9a10155500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:34.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.613+0000 7f9a18390640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a100b41b0 0x7f9a10155500 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f9a0002a270 tx=0x7f9a000046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:34.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.613+0000 7f9a18390640 1 -- 172.21.15.79:0/2103136566 shutdown_connections 2024-04-25T02:17:34.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.613+0000 7f9a18390640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f99f406be30 0x7f99f406e2f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:34.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.613+0000 7f9a18390640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a10155f00 0x7f9a100b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:34.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.613+0000 7f9a18390640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a100b41b0 0x7f9a10155500 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:34.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.613+0000 7f9a18390640 1 --2- 172.21.15.79:0/2103136566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a1006b2f0 0x7f9a101426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:34.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.613+0000 7f9a18390640 1 -- 172.21.15.79:0/2103136566 >> 172.21.15.79:0/2103136566 conn(0x7f9a100b1cd0 msgr2=0x7f9a100b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:34.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.613+0000 7f9a18390640 1 -- 172.21.15.79:0/2103136566 shutdown_connections 2024-04-25T02:17:34.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.613+0000 7f9a18390640 1 -- 172.21.15.79:0/2103136566 wait complete. 2024-04-25T02:17:34.642 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:17:34.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.738+0000 7f5d6ac3f640 1 Processor -- start 2024-04-25T02:17:34.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.738+0000 7f5d6ac3f640 1 -- start start 2024-04-25T02:17:34.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.739+0000 7f5d6ac3f640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5d640d07a0 0x7f5d6415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.739+0000 7f5d6ac3f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6406e3d0 0x7f5d6415b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.739+0000 7f5d6ac3f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d6415f1c0 con 0x7f5d6406df50 2024-04-25T02:17:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.739+0000 7f5d6ac3f640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f5d640b2e60 con 0x7f5d640d07a0 2024-04-25T02:17:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.739+0000 7f5d6ac3f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5d640b3140 con 0x7f5d6406e3d0 2024-04-25T02:17:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.740+0000 7f5d691dc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6406e3d0 0x7f5d6415b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.740+0000 7f5d689db640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5d640d07a0 0x7f5d6415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.740+0000 7f5d63fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f5d6406df50 0x7f5d640b42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:40252/0 (socket says 172.21.15.79:40252) 2024-04-25T02:17:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.740+0000 7f5d691dc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6406e3d0 0x7f5d6415b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:57164/0 (socket says 172.21.15.79:57164) 2024-04-25T02:17:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.740+0000 7f5d689db640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5d640d07a0 0x7f5d6415ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:43444/0 (socket says 172.21.15.79:43444) 2024-04-25T02:17:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.740+0000 7f5d63fff640 1 -- 172.21.15.79:0/2034654071 learned_addr learned my addr 172.21.15.79:0/2034654071 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.740+0000 7f5d691dc640 1 -- 172.21.15.79:0/2034654071 >> v2:172.21.15.189:3300/0 conn(0x7f5d640d07a0 msgr2=0x7f5d6415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.740+0000 7f5d691dc640 1 --2- 172.21.15.79:0/2034654071 >> v2:172.21.15.189:3300/0 conn(0x7f5d640d07a0 0x7f5d6415ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.740+0000 7f5d691dc640 1 -- 172.21.15.79:0/2034654071 >> v1:172.21.15.189:6789/0 conn(0x7f5d6406df50 legacy=0x7f5d640b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:34.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.740+0000 7f5d691dc640 1 -- 172.21.15.79:0/2034654071 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d640b3420 con 0x7f5d6406e3d0 2024-04-25T02:17:34.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.740+0000 7f5d689db640 1 --2- 172.21.15.79:0/2034654071 >> v2:172.21.15.189:3300/0 conn(0x7f5d640d07a0 0x7f5d6415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:17:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.741+0000 7f5d691dc640 1 --2- 172.21.15.79:0/2034654071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6406e3d0 0x7f5d6415b730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00bfa0 tx=0x7f5d5c02c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c7a7fa0aaba0f78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.741+0000 7f5d637fe640 1 -- 172.21.15.79:0/2034654071 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c038070 con 0x7f5d6406e3d0 2024-04-25T02:17:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.741+0000 7f5d637fe640 1 -- 172.21.15.79:0/2034654071 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d5c009540 con 0x7f5d6406e3d0 2024-04-25T02:17:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.741+0000 7f5d637fe640 1 -- 172.21.15.79:0/2034654071 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c009910 con 0x7f5d6406e3d0 2024-04-25T02:17:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.741+0000 7f5d6ac3f640 1 -- 172.21.15.79:0/2034654071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6406e3d0 msgr2=0x7f5d6415b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.741+0000 7f5d6ac3f640 1 --2- 172.21.15.79:0/2034654071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6406e3d0 0x7f5d6415b730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00bfa0 tx=0x7f5d5c02c7e0 comp rx=0 tx=0).stop 2024-04-25T02:17:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.741+0000 7f5d6ac3f640 1 -- 172.21.15.79:0/2034654071 shutdown_connections 2024-04-25T02:17:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.742+0000 7f5d6ac3f640 1 --2- 172.21.15.79:0/2034654071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6406e3d0 0x7f5d6415b730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.742+0000 7f5d6ac3f640 1 --2- 172.21.15.79:0/2034654071 >> v2:172.21.15.189:3300/0 conn(0x7f5d640d07a0 0x7f5d6415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.742+0000 7f5d6ac3f640 1 -- 172.21.15.79:0/2034654071 >> 172.21.15.79:0/2034654071 conn(0x7f5d640cfc80 msgr2=0x7f5d640d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.742+0000 7f5d6ac3f640 1 -- 172.21.15.79:0/2034654071 shutdown_connections 2024-04-25T02:17:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.742+0000 7f5d6ac3f640 1 -- 172.21.15.79:0/2034654071 wait complete. 2024-04-25T02:17:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.743+0000 7f5d6ac3f640 1 Processor -- start 2024-04-25T02:17:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.743+0000 7f5d6ac3f640 1 -- start start 2024-04-25T02:17:34.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.743+0000 7f5d6ac3f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6406df50 0x7f5d641f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d6ac3f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d6406e3d0 0x7f5d64157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d6ac3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d640d07a0 0x7f5d64157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d6ac3f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d640b49b0 con 0x7f5d640d07a0 2024-04-25T02:17:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d6ac3f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5d640b39e0 con 0x7f5d6406e3d0 2024-04-25T02:17:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d6ac3f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5d640b4b30 con 0x7f5d6406df50 2024-04-25T02:17:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d691dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d640d07a0 0x7f5d64157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d691dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d640d07a0 0x7f5d64157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48046/0 (socket says 172.21.15.79:48046) 2024-04-25T02:17:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d691dc640 1 -- 172.21.15.79:0/1254460649 learned_addr learned my addr 172.21.15.79:0/1254460649 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d689db640 1 --2- 172.21.15.79:0/1254460649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6406df50 0x7f5d641f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d63fff640 1 --2- 172.21.15.79:0/1254460649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d6406e3d0 0x7f5d64157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d691dc640 1 -- 172.21.15.79:0/1254460649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6406df50 msgr2=0x7f5d641f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d691dc640 1 --2- 172.21.15.79:0/1254460649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6406df50 0x7f5d641f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d691dc640 1 -- 172.21.15.79:0/1254460649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d6406e3d0 msgr2=0x7f5d64157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d691dc640 1 --2- 172.21.15.79:0/1254460649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d6406e3d0 0x7f5d64157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d691dc640 1 -- 172.21.15.79:0/1254460649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d641f2d00 con 0x7f5d640d07a0 2024-04-25T02:17:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d691dc640 1 --2- 172.21.15.79:0/1254460649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d640d07a0 0x7f5d64157f80 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00bfa0 tx=0x7f5d5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d617fa640 1 -- 172.21.15.79:0/1254460649 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c038050 con 0x7f5d640d07a0 2024-04-25T02:17:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d617fa640 1 -- 172.21.15.79:0/1254460649 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d5c044070 con 0x7f5d640d07a0 2024-04-25T02:17:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d6ac3f640 1 -- 172.21.15.79:0/1254460649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d641f2f90 con 0x7f5d640d07a0 2024-04-25T02:17:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d617fa640 1 -- 172.21.15.79:0/1254460649 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c03da70 con 0x7f5d640d07a0 2024-04-25T02:17:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.744+0000 7f5d6ac3f640 1 -- 172.21.15.79:0/1254460649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d641f3550 con 0x7f5d640d07a0 2024-04-25T02:17:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.745+0000 7f5d6ac3f640 1 -- 172.21.15.79:0/1254460649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d640690a0 con 0x7f5d640d07a0 2024-04-25T02:17:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.746+0000 7f5d617fa640 1 -- 172.21.15.79:0/1254460649 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d5c03dc10 con 0x7f5d640d07a0 2024-04-25T02:17:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.746+0000 7f5d617fa640 1 --2- 172.21.15.79:0/1254460649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d5006be30 0x7f5d5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.746+0000 7f5d689db640 1 --2- 172.21.15.79:0/1254460649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d5006be30 0x7f5d5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.746+0000 7f5d617fa640 1 -- 172.21.15.79:0/1254460649 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7f5d5c0adcc0 con 0x7f5d640d07a0 2024-04-25T02:17:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.747+0000 7f5d689db640 1 --2- 172.21.15.79:0/1254460649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d5006be30 0x7f5d5006e2f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009a30 tx=0x7f5d54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.751+0000 7f5d617fa640 1 -- 172.21.15.79:0/1254460649 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5d5c07c700 con 0x7f5d640d07a0 2024-04-25T02:17:34.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.925+0000 7f5d6ac3f640 1 -- 172.21.15.79:0/1254460649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d64072ab0 con 0x7f5d640d07a0 2024-04-25T02:17:34.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.926+0000 7f5d617fa640 1 -- 172.21.15.79:0/1254460649 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+16652 (secure 0 0 0) 0x7f5d5c07c000 con 0x7f5d640d07a0 2024-04-25T02:17:34.931 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:34.931 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":114,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:17:33.959857+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:17:32.207579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T02:17:32.929915+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:17:34.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.928+0000 7f5d6ac3f640 1 -- 172.21.15.79:0/1254460649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d5006be30 msgr2=0x7f5d5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:34.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.928+0000 7f5d6ac3f640 1 --2- 172.21.15.79:0/1254460649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d5006be30 0x7f5d5006e2f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009a30 tx=0x7f5d54008040 comp rx=0 tx=0).stop 2024-04-25T02:17:34.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.928+0000 7f5d6ac3f640 1 -- 172.21.15.79:0/1254460649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d640d07a0 msgr2=0x7f5d64157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:34.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.928+0000 7f5d6ac3f640 1 --2- 172.21.15.79:0/1254460649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d640d07a0 0x7f5d64157f80 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00bfa0 tx=0x7f5d5c004a40 comp rx=0 tx=0).stop 2024-04-25T02:17:34.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.928+0000 7f5d6ac3f640 1 -- 172.21.15.79:0/1254460649 shutdown_connections 2024-04-25T02:17:34.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.928+0000 7f5d6ac3f640 1 --2- 172.21.15.79:0/1254460649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5d5006be30 0x7f5d5006e2f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:34.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.928+0000 7f5d6ac3f640 1 --2- 172.21.15.79:0/1254460649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d640d07a0 0x7f5d64157f80 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:34.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.928+0000 7f5d6ac3f640 1 --2- 172.21.15.79:0/1254460649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d6406e3d0 0x7f5d64157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:34.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.928+0000 7f5d6ac3f640 1 --2- 172.21.15.79:0/1254460649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d6406df50 0x7f5d641f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:34.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.928+0000 7f5d6ac3f640 1 -- 172.21.15.79:0/1254460649 >> 172.21.15.79:0/1254460649 conn(0x7f5d640cfc80 msgr2=0x7f5d64070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:34.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.928+0000 7f5d6ac3f640 1 -- 172.21.15.79:0/1254460649 shutdown_connections 2024-04-25T02:17:34.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:34.928+0000 7f5d6ac3f640 1 -- 172.21.15.79:0/1254460649 wait complete. 2024-04-25T02:17:34.944 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:17:35.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.036+0000 7f8116161640 1 Processor -- start 2024-04-25T02:17:35.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.036+0000 7f8116161640 1 -- start start 2024-04-25T02:17:35.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.037+0000 7f8116161640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f811015e4d0 0x7f811006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:35.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.037+0000 7f8116161640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81100d2e20 0x7f81100cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.037+0000 7f8116161640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81100d1660 con 0x7f81100b3570 2024-04-25T02:17:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.037+0000 7f8116161640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f81100d1380 con 0x7f811015e4d0 2024-04-25T02:17:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.037+0000 7f8116161640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f81100cede0 con 0x7f81100d2e20 2024-04-25T02:17:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.037+0000 7f810f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f811015e4d0 0x7f811006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.037+0000 7f810f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f811015e4d0 0x7f811006bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48048/0 (socket says 172.21.15.79:48048) 2024-04-25T02:17:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.037+0000 7f810f7fe640 1 -- 172.21.15.79:0/3943397768 learned_addr learned my addr 172.21.15.79:0/3943397768 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.037+0000 7f810ffff640 1 --2- 172.21.15.79:0/3943397768 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81100d2e20 0x7f81100cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.037+0000 7f810f7fe640 1 -- 172.21.15.79:0/3943397768 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81100d2e20 msgr2=0x7f81100cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.037+0000 7f810f7fe640 1 --2- 172.21.15.79:0/3943397768 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81100d2e20 0x7f81100cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.037+0000 7f810f7fe640 1 -- 172.21.15.79:0/3943397768 >> v1:172.21.15.189:6789/0 conn(0x7f81100b3570 legacy=0x7f81100d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.037+0000 7f810f7fe640 1 -- 172.21.15.79:0/3943397768 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81100cf0c0 con 0x7f811015e4d0 2024-04-25T02:17:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.038+0000 7f810f7fe640 1 --2- 172.21.15.79:0/3943397768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f811015e4d0 0x7f811006bc70 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f81000098a0 tx=0x7f810002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8da36b51925206 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.038+0000 7f810e7fc640 1 -- 172.21.15.79:0/3943397768 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8100037070 con 0x7f811015e4d0 2024-04-25T02:17:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.038+0000 7f810e7fc640 1 -- 172.21.15.79:0/3943397768 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8100032440 con 0x7f811015e4d0 2024-04-25T02:17:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.038+0000 7f810e7fc640 1 -- 172.21.15.79:0/3943397768 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8100032810 con 0x7f811015e4d0 2024-04-25T02:17:35.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.039+0000 7f8116161640 1 -- 172.21.15.79:0/3943397768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f811015e4d0 msgr2=0x7f811006bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:35.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.039+0000 7f8116161640 1 --2- 172.21.15.79:0/3943397768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f811015e4d0 0x7f811006bc70 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f81000098a0 tx=0x7f810002a250 comp rx=0 tx=0).stop 2024-04-25T02:17:35.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.039+0000 7f8116161640 1 -- 172.21.15.79:0/3943397768 shutdown_connections 2024-04-25T02:17:35.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.039+0000 7f8116161640 1 --2- 172.21.15.79:0/3943397768 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81100d2e20 0x7f81100cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.039+0000 7f8116161640 1 --2- 172.21.15.79:0/3943397768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f811015e4d0 0x7f811006bc70 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.039+0000 7f8116161640 1 -- 172.21.15.79:0/3943397768 >> 172.21.15.79:0/3943397768 conn(0x7f811009d460 msgr2=0x7f81100d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:35.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.039+0000 7f8116161640 1 -- 172.21.15.79:0/3943397768 shutdown_connections 2024-04-25T02:17:35.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.039+0000 7f8116161640 1 -- 172.21.15.79:0/3943397768 wait complete. 2024-04-25T02:17:35.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.040+0000 7f8116161640 1 Processor -- start 2024-04-25T02:17:35.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.040+0000 7f8116161640 1 -- start start 2024-04-25T02:17:35.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f8116161640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81100b3570 0x7f811015d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:35.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f8116161640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100d2e20 0x7f81100b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:35.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f8116161640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f811015e4d0 0x7f81100b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:35.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f8116161640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f81100d2250 con 0x7f81100d2e20 2024-04-25T02:17:35.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f8116161640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f81100d20d0 con 0x7f811015e4d0 2024-04-25T02:17:35.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f8116161640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f811006c1b0 con 0x7f81100b3570 2024-04-25T02:17:35.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f810effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100d2e20 0x7f81100b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:35.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f810effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100d2e20 0x7f81100b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48052/0 (socket says 172.21.15.79:48052) 2024-04-25T02:17:35.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f810effd640 1 -- 172.21.15.79:0/22320096 learned_addr learned my addr 172.21.15.79:0/22320096 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:35.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f810f7fe640 1 --2- 172.21.15.79:0/22320096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81100b3570 0x7f811015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:35.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f810ffff640 1 --2- 172.21.15.79:0/22320096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f811015e4d0 0x7f81100b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:35.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f810effd640 1 -- 172.21.15.79:0/22320096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81100b3570 msgr2=0x7f811015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:35.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f810effd640 1 --2- 172.21.15.79:0/22320096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81100b3570 0x7f811015d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f810effd640 1 -- 172.21.15.79:0/22320096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f811015e4d0 msgr2=0x7f81100b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:35.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f810effd640 1 --2- 172.21.15.79:0/22320096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f811015e4d0 0x7f81100b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f810effd640 1 -- 172.21.15.79:0/22320096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81100b8300 con 0x7f81100d2e20 2024-04-25T02:17:35.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f810f7fe640 1 --2- 172.21.15.79:0/22320096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81100b3570 0x7f811015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:35.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f810effd640 1 --2- 172.21.15.79:0/22320096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100d2e20 0x7f81100b5c90 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f810400c430 tx=0x7f810400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:35.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f80f7fff640 1 -- 172.21.15.79:0/22320096 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104011790 con 0x7f81100d2e20 2024-04-25T02:17:35.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f80f7fff640 1 -- 172.21.15.79:0/22320096 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8104017070 con 0x7f81100d2e20 2024-04-25T02:17:35.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f8116161640 1 -- 172.21.15.79:0/22320096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81100b85e0 con 0x7f81100d2e20 2024-04-25T02:17:35.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.041+0000 7f80f7fff640 1 -- 172.21.15.79:0/22320096 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104011b70 con 0x7f81100d2e20 2024-04-25T02:17:35.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.042+0000 7f8116161640 1 -- 172.21.15.79:0/22320096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81100cced0 con 0x7f81100d2e20 2024-04-25T02:17:35.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.043+0000 7f8116161640 1 -- 172.21.15.79:0/22320096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81100690a0 con 0x7f81100d2e20 2024-04-25T02:17:35.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.043+0000 7f80f7fff640 1 -- 172.21.15.79:0/22320096 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8104011d10 con 0x7f81100d2e20 2024-04-25T02:17:35.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.043+0000 7f80f7fff640 1 --2- 172.21.15.79:0/22320096 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f80fc06be30 0x7f80fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:35.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.043+0000 7f80f7fff640 1 -- 172.21.15.79:0/22320096 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7f810408ac40 con 0x7f81100d2e20 2024-04-25T02:17:35.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.043+0000 7f810f7fe640 1 --2- 172.21.15.79:0/22320096 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f80fc06be30 0x7f80fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:35.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.044+0000 7f810f7fe640 1 --2- 172.21.15.79:0/22320096 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f80fc06be30 0x7f80fc06e2f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8100034000 tx=0x7f810002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:35.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.048+0000 7f80f7fff640 1 -- 172.21.15.79:0/22320096 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8104059680 con 0x7f81100d2e20 2024-04-25T02:17:35.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.225+0000 7f8116161640 1 -- 172.21.15.79:0/22320096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81100d1920 con 0x7f81100d2e20 2024-04-25T02:17:35.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.226+0000 7f80f7fff640 1 -- 172.21.15.79:0/22320096 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+16652 (secure 0 0 0) 0x7f8104058f80 con 0x7f81100d2e20 2024-04-25T02:17:35.231 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:35.231 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":114,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:17:33.959857+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:17:32.207579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T02:17:32.929915+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:17:35.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.228+0000 7f8116161640 1 -- 172.21.15.79:0/22320096 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f80fc06be30 msgr2=0x7f80fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:35.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.228+0000 7f8116161640 1 --2- 172.21.15.79:0/22320096 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f80fc06be30 0x7f80fc06e2f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8100034000 tx=0x7f810002e000 comp rx=0 tx=0).stop 2024-04-25T02:17:35.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.228+0000 7f8116161640 1 -- 172.21.15.79:0/22320096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100d2e20 msgr2=0x7f81100b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:35.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.228+0000 7f8116161640 1 --2- 172.21.15.79:0/22320096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100d2e20 0x7f81100b5c90 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f810400c430 tx=0x7f810400c8f0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.228+0000 7f8116161640 1 -- 172.21.15.79:0/22320096 shutdown_connections 2024-04-25T02:17:35.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.228+0000 7f8116161640 1 --2- 172.21.15.79:0/22320096 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f80fc06be30 0x7f80fc06e2f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.228+0000 7f8116161640 1 --2- 172.21.15.79:0/22320096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f811015e4d0 0x7f81100b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.228+0000 7f8116161640 1 --2- 172.21.15.79:0/22320096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81100d2e20 0x7f81100b5c90 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.228+0000 7f8116161640 1 --2- 172.21.15.79:0/22320096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81100b3570 0x7f811015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.228+0000 7f8116161640 1 -- 172.21.15.79:0/22320096 >> 172.21.15.79:0/22320096 conn(0x7f811009d460 msgr2=0x7f81100d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:35.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.228+0000 7f8116161640 1 -- 172.21.15.79:0/22320096 shutdown_connections 2024-04-25T02:17:35.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.228+0000 7f8116161640 1 -- 172.21.15.79:0/22320096 wait complete. 2024-04-25T02:17:35.244 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T02:17:35.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.339+0000 7ff26273b640 1 Processor -- start 2024-04-25T02:17:35.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.339+0000 7ff26273b640 1 -- start start 2024-04-25T02:17:35.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff26273b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff25c0b41b0 0x7ff25c1605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:35.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff26273b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff25c06b2f0 0x7ff25c06b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:35.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff26273b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff25c155f00 0x7ff25c156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff26273b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff25c071cd0 con 0x7ff25c155f00 2024-04-25T02:17:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff26273b640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff25c071fb0 con 0x7ff25c0b41b0 2024-04-25T02:17:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff26273b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff25c072290 con 0x7ff25c06b2f0 2024-04-25T02:17:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff260cd8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff25c155f00 0x7ff25c156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff260cd8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff25c155f00 0x7ff25c156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48068/0 (socket says 172.21.15.79:48068) 2024-04-25T02:17:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff260cd8640 1 -- 172.21.15.79:0/3073660101 learned_addr learned my addr 172.21.15.79:0/3073660101 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff25bfff640 1 --2- 172.21.15.79:0/3073660101 >> v2:172.21.15.189:3300/0 conn(0x7ff25c0b41b0 0x7ff25c1605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff25b7fe640 1 --2- 172.21.15.79:0/3073660101 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff25c06b2f0 0x7ff25c06b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff260cd8640 1 -- 172.21.15.79:0/3073660101 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff25c06b2f0 msgr2=0x7ff25c06b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff260cd8640 1 --2- 172.21.15.79:0/3073660101 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff25c06b2f0 0x7ff25c06b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff260cd8640 1 -- 172.21.15.79:0/3073660101 >> v2:172.21.15.189:3300/0 conn(0x7ff25c0b41b0 msgr2=0x7ff25c1605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff260cd8640 1 --2- 172.21.15.79:0/3073660101 >> v2:172.21.15.189:3300/0 conn(0x7ff25c0b41b0 0x7ff25c1605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.340+0000 7ff260cd8640 1 -- 172.21.15.79:0/3073660101 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25c072570 con 0x7ff25c155f00 2024-04-25T02:17:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.341+0000 7ff260cd8640 1 --2- 172.21.15.79:0/3073660101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff25c155f00 0x7ff25c156370 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0cdfb0 tx=0x7ff25402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe1523ec43bdbd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:35.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.341+0000 7ff25affd640 1 -- 172.21.15.79:0/3073660101 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff254036070 con 0x7ff25c155f00 2024-04-25T02:17:35.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.341+0000 7ff25affd640 1 -- 172.21.15.79:0/3073660101 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff254031600 con 0x7ff25c155f00 2024-04-25T02:17:35.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.341+0000 7ff25affd640 1 -- 172.21.15.79:0/3073660101 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2540319d0 con 0x7ff25c155f00 2024-04-25T02:17:35.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.342+0000 7ff26273b640 1 -- 172.21.15.79:0/3073660101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff25c155f00 msgr2=0x7ff25c156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:35.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.342+0000 7ff26273b640 1 --2- 172.21.15.79:0/3073660101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff25c155f00 0x7ff25c156370 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0cdfb0 tx=0x7ff25402a6a0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.342+0000 7ff26273b640 1 -- 172.21.15.79:0/3073660101 shutdown_connections 2024-04-25T02:17:35.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.342+0000 7ff26273b640 1 --2- 172.21.15.79:0/3073660101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff25c155f00 0x7ff25c156370 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.342+0000 7ff26273b640 1 --2- 172.21.15.79:0/3073660101 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff25c06b2f0 0x7ff25c06b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.342+0000 7ff26273b640 1 --2- 172.21.15.79:0/3073660101 >> v2:172.21.15.189:3300/0 conn(0x7ff25c0b41b0 0x7ff25c1605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.342+0000 7ff26273b640 1 -- 172.21.15.79:0/3073660101 >> 172.21.15.79:0/3073660101 conn(0x7ff25c0b1cd0 msgr2=0x7ff25c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:35.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.342+0000 7ff26273b640 1 -- 172.21.15.79:0/3073660101 shutdown_connections 2024-04-25T02:17:35.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.342+0000 7ff26273b640 1 -- 172.21.15.79:0/3073660101 wait complete. 2024-04-25T02:17:35.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.343+0000 7ff26273b640 1 Processor -- start 2024-04-25T02:17:35.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.343+0000 7ff26273b640 1 -- start start 2024-04-25T02:17:35.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff26273b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff25c06b2f0 0x7ff25c15f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:35.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff26273b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff25c0b41b0 0x7ff25c15fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:35.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff26273b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff25c155f00 0x7ff25c15dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:35.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff26273b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c15c870 con 0x7ff25c06b2f0 2024-04-25T02:17:35.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff26273b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c072d70 con 0x7ff25c155f00 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff26273b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff25c0b4590 con 0x7ff25c0b41b0 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff25bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff25c06b2f0 0x7ff25c15f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff25bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff25c06b2f0 0x7ff25c15f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48080/0 (socket says 172.21.15.79:48080) 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff25bfff640 1 -- 172.21.15.79:0/4105348971 learned_addr learned my addr 172.21.15.79:0/4105348971 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff25b7fe640 1 --2- 172.21.15.79:0/4105348971 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff25c0b41b0 0x7ff25c15fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff260cd8640 1 --2- 172.21.15.79:0/4105348971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff25c155f00 0x7ff25c15dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff25bfff640 1 -- 172.21.15.79:0/4105348971 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff25c0b41b0 msgr2=0x7ff25c15fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff25bfff640 1 --2- 172.21.15.79:0/4105348971 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff25c0b41b0 0x7ff25c15fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff25bfff640 1 -- 172.21.15.79:0/4105348971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff25c155f00 msgr2=0x7ff25c15dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff25bfff640 1 --2- 172.21.15.79:0/4105348971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff25c155f00 0x7ff25c15dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff25bfff640 1 -- 172.21.15.79:0/4105348971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25c1e6ef0 con 0x7ff25c06b2f0 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff260cd8640 1 --2- 172.21.15.79:0/4105348971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff25c155f00 0x7ff25c15dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff25bfff640 1 --2- 172.21.15.79:0/4105348971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff25c06b2f0 0x7ff25c15f800 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00d800 tx=0x7ff24c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff258ff9640 1 -- 172.21.15.79:0/4105348971 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c00b6c0 con 0x7ff25c06b2f0 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff258ff9640 1 -- 172.21.15.79:0/4105348971 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff24c019070 con 0x7ff25c06b2f0 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff26273b640 1 -- 172.21.15.79:0/4105348971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25c1e71d0 con 0x7ff25c06b2f0 2024-04-25T02:17:35.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff258ff9640 1 -- 172.21.15.79:0/4105348971 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c00ba80 con 0x7ff25c06b2f0 2024-04-25T02:17:35.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.344+0000 7ff26273b640 1 -- 172.21.15.79:0/4105348971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff25c157ac0 con 0x7ff25c06b2f0 2024-04-25T02:17:35.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.345+0000 7ff26273b640 1 -- 172.21.15.79:0/4105348971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff25c0690a0 con 0x7ff25c06b2f0 2024-04-25T02:17:35.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.346+0000 7ff258ff9640 1 -- 172.21.15.79:0/4105348971 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff24c00bc20 con 0x7ff25c06b2f0 2024-04-25T02:17:35.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.346+0000 7ff258ff9640 1 --2- 172.21.15.79:0/4105348971 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff24806be60 0x7ff24806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:35.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.346+0000 7ff258ff9640 1 -- 172.21.15.79:0/4105348971 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7ff24c08b110 con 0x7ff25c06b2f0 2024-04-25T02:17:35.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.346+0000 7ff25b7fe640 1 --2- 172.21.15.79:0/4105348971 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff24806be60 0x7ff24806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:35.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.347+0000 7ff25b7fe640 1 --2- 172.21.15.79:0/4105348971 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff24806be60 0x7ff24806e320 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff25c160910 tx=0x7ff250008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:35.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.351+0000 7ff258ff9640 1 -- 172.21.15.79:0/4105348971 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff24c059b50 con 0x7ff25c06b2f0 2024-04-25T02:17:35.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.562+0000 7ff26273b640 1 -- 172.21.15.79:0/4105348971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff25c15da70 con 0x7ff25c06b2f0 2024-04-25T02:17:35.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.928+0000 7ff258ff9640 1 -- 172.21.15.79:0/4105348971 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) ==== 118+0+0 (secure 0 0 0) 0x7ff24c059450 con 0x7ff25c06b2f0 2024-04-25T02:17:35.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.931+0000 7ff26273b640 1 -- 172.21.15.79:0/4105348971 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff24806be60 msgr2=0x7ff24806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:35.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.931+0000 7ff26273b640 1 --2- 172.21.15.79:0/4105348971 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff24806be60 0x7ff24806e320 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff25c160910 tx=0x7ff250008040 comp rx=0 tx=0).stop 2024-04-25T02:17:35.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.931+0000 7ff26273b640 1 -- 172.21.15.79:0/4105348971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff25c06b2f0 msgr2=0x7ff25c15f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:35.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.931+0000 7ff26273b640 1 --2- 172.21.15.79:0/4105348971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff25c06b2f0 0x7ff25c15f800 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00d800 tx=0x7ff24c00dcc0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.931+0000 7ff26273b640 1 -- 172.21.15.79:0/4105348971 shutdown_connections 2024-04-25T02:17:35.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.931+0000 7ff26273b640 1 --2- 172.21.15.79:0/4105348971 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff24806be60 0x7ff24806e320 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.931+0000 7ff26273b640 1 --2- 172.21.15.79:0/4105348971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff25c155f00 0x7ff25c15dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.931+0000 7ff26273b640 1 --2- 172.21.15.79:0/4105348971 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff25c0b41b0 0x7ff25c15fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.931+0000 7ff26273b640 1 --2- 172.21.15.79:0/4105348971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff25c06b2f0 0x7ff25c15f800 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:35.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.931+0000 7ff26273b640 1 -- 172.21.15.79:0/4105348971 >> 172.21.15.79:0/4105348971 conn(0x7ff25c0b1cd0 msgr2=0x7ff25c0b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:35.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.931+0000 7ff26273b640 1 -- 172.21.15.79:0/4105348971 shutdown_connections 2024-04-25T02:17:35.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:35.931+0000 7ff26273b640 1 -- 172.21.15.79:0/4105348971 wait complete. 2024-04-25T02:17:35.947 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T02:17:35.947 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T02:17:36.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.043+0000 7ff83a76a640 1 Processor -- start 2024-04-25T02:17:36.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.043+0000 7ff83a76a640 1 -- start start 2024-04-25T02:17:36.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.044+0000 7ff83a76a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff8340b41b0 0x7ff8341605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:36.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.044+0000 7ff83a76a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff83406b770 0x7ff834156610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:36.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.044+0000 7ff83a76a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff834071cd0 con 0x7ff83406b2f0 2024-04-25T02:17:36.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.044+0000 7ff83a76a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff834156b50 con 0x7ff83406b770 2024-04-25T02:17:36.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.044+0000 7ff83a76a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff834071fb0 con 0x7ff8340b41b0 2024-04-25T02:17:36.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.044+0000 7ff838d07640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff83406b770 0x7ff834156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:36.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.044+0000 7ff838d07640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff83406b770 0x7ff834156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48084/0 (socket says 172.21.15.79:48084) 2024-04-25T02:17:36.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.044+0000 7ff838d07640 1 -- 172.21.15.79:0/3935766377 learned_addr learned my addr 172.21.15.79:0/3935766377 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:36.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.044+0000 7ff833fff640 1 --2- 172.21.15.79:0/3935766377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff8340b41b0 0x7ff8341605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:36.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.044+0000 7ff838d07640 1 -- 172.21.15.79:0/3935766377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff8340b41b0 msgr2=0x7ff8341605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:36.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.044+0000 7ff838d07640 1 --2- 172.21.15.79:0/3935766377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff8340b41b0 0x7ff8341605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:36.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.044+0000 7ff838d07640 1 -- 172.21.15.79:0/3935766377 >> v1:172.21.15.189:6789/0 conn(0x7ff83406b2f0 legacy=0x7ff834155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:36.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.044+0000 7ff838d07640 1 -- 172.21.15.79:0/3935766377 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff834072290 con 0x7ff83406b770 2024-04-25T02:17:36.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.045+0000 7ff838d07640 1 --2- 172.21.15.79:0/3935766377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83406b770 0x7ff834156610 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009e50 tx=0x7ff82c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c9166d729c03a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:36.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.045+0000 7ff832ffd640 1 -- 172.21.15.79:0/3935766377 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c036070 con 0x7ff83406b770 2024-04-25T02:17:36.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.045+0000 7ff832ffd640 1 -- 172.21.15.79:0/3935766377 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff82c031600 con 0x7ff83406b770 2024-04-25T02:17:36.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.045+0000 7ff832ffd640 1 -- 172.21.15.79:0/3935766377 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0319d0 con 0x7ff83406b770 2024-04-25T02:17:36.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.046+0000 7ff83a76a640 1 -- 172.21.15.79:0/3935766377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83406b770 msgr2=0x7ff834156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:36.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.046+0000 7ff83a76a640 1 --2- 172.21.15.79:0/3935766377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83406b770 0x7ff834156610 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009e50 tx=0x7ff82c02a6c0 comp rx=0 tx=0).stop 2024-04-25T02:17:36.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.046+0000 7ff83a76a640 1 -- 172.21.15.79:0/3935766377 shutdown_connections 2024-04-25T02:17:36.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.046+0000 7ff83a76a640 1 --2- 172.21.15.79:0/3935766377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83406b770 0x7ff834156610 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:36.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.046+0000 7ff83a76a640 1 --2- 172.21.15.79:0/3935766377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff8340b41b0 0x7ff8341605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:36.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.046+0000 7ff83a76a640 1 -- 172.21.15.79:0/3935766377 >> 172.21.15.79:0/3935766377 conn(0x7ff8340b1cd0 msgr2=0x7ff8340b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:36.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.046+0000 7ff83a76a640 1 -- 172.21.15.79:0/3935766377 shutdown_connections 2024-04-25T02:17:36.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.046+0000 7ff83a76a640 1 -- 172.21.15.79:0/3935766377 wait complete. 2024-04-25T02:17:36.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.047+0000 7ff83a76a640 1 Processor -- start 2024-04-25T02:17:36.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.047+0000 7ff83a76a640 1 -- start start 2024-04-25T02:17:36.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff83a76a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff83406b2f0 0x7ff834159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:36.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff83a76a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83406b770 0x7ff834154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:36.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff83a76a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8340b41b0 0x7ff83415a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:36.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff83a76a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff834160b10 con 0x7ff83406b770 2024-04-25T02:17:36.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff83a76a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff83406bbe0 con 0x7ff8340b41b0 2024-04-25T02:17:36.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff83a76a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff834072d70 con 0x7ff83406b2f0 2024-04-25T02:17:36.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff8337fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83406b770 0x7ff834154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:36.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff8337fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83406b770 0x7ff834154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48098/0 (socket says 172.21.15.79:48098) 2024-04-25T02:17:36.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff8337fe640 1 -- 172.21.15.79:0/2336948319 learned_addr learned my addr 172.21.15.79:0/2336948319 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:36.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff838d07640 1 --2- 172.21.15.79:0/2336948319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8340b41b0 0x7ff83415a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:36.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff8337fe640 1 -- 172.21.15.79:0/2336948319 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff83406b2f0 msgr2=0x7ff834159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:36.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff8337fe640 1 --2- 172.21.15.79:0/2336948319 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff83406b2f0 0x7ff834159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:36.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff8337fe640 1 -- 172.21.15.79:0/2336948319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8340b41b0 msgr2=0x7ff83415a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:36.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff8337fe640 1 --2- 172.21.15.79:0/2336948319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8340b41b0 0x7ff83415a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:36.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff8337fe640 1 -- 172.21.15.79:0/2336948319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8340cac60 con 0x7ff83406b770 2024-04-25T02:17:36.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff8337fe640 1 --2- 172.21.15.79:0/2336948319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83406b770 0x7ff834154380 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7ff82800c430 tx=0x7ff82800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:36.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff830ff9640 1 -- 172.21.15.79:0/2336948319 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828011790 con 0x7ff83406b770 2024-04-25T02:17:36.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff830ff9640 1 -- 172.21.15.79:0/2336948319 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff828017070 con 0x7ff83406b770 2024-04-25T02:17:36.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff83a76a640 1 -- 172.21.15.79:0/2336948319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8340caf00 con 0x7ff83406b770 2024-04-25T02:17:36.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff830ff9640 1 -- 172.21.15.79:0/2336948319 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828011bb0 con 0x7ff83406b770 2024-04-25T02:17:36.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.048+0000 7ff83a76a640 1 -- 172.21.15.79:0/2336948319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8341548c0 con 0x7ff83406b770 2024-04-25T02:17:36.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.049+0000 7ff83a76a640 1 -- 172.21.15.79:0/2336948319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8340cb620 con 0x7ff83406b770 2024-04-25T02:17:36.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.050+0000 7ff830ff9640 1 -- 172.21.15.79:0/2336948319 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff82801c460 con 0x7ff83406b770 2024-04-25T02:17:36.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.050+0000 7ff830ff9640 1 --2- 172.21.15.79:0/2336948319 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff82006be30 0x7ff82006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:36.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.050+0000 7ff830ff9640 1 -- 172.21.15.79:0/2336948319 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7ff82808ad30 con 0x7ff83406b770 2024-04-25T02:17:36.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.050+0000 7ff833fff640 1 --2- 172.21.15.79:0/2336948319 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff82006be30 0x7ff82006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:36.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.051+0000 7ff833fff640 1 --2- 172.21.15.79:0/2336948319 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff82006be30 0x7ff82006e2f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff8340b14e0 tx=0x7ff824008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:36.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.054+0000 7ff830ff9640 1 -- 172.21.15.79:0/2336948319 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff8280596e0 con 0x7ff83406b770 2024-04-25T02:17:36.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.265+0000 7ff83a76a640 1 -- 172.21.15.79:0/2336948319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff8340ce280 con 0x7ff83406b770 2024-04-25T02:17:36.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.930+0000 7ff830ff9640 1 -- 172.21.15.79:0/2336948319 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v83) ==== 122+0+0 (secure 0 0 0) 0x7ff828058fe0 con 0x7ff83406b770 2024-04-25T02:17:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.933+0000 7ff83a76a640 1 -- 172.21.15.79:0/2336948319 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff82006be30 msgr2=0x7ff82006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.933+0000 7ff83a76a640 1 --2- 172.21.15.79:0/2336948319 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff82006be30 0x7ff82006e2f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff8340b14e0 tx=0x7ff824008040 comp rx=0 tx=0).stop 2024-04-25T02:17:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.933+0000 7ff83a76a640 1 -- 172.21.15.79:0/2336948319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83406b770 msgr2=0x7ff834154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.933+0000 7ff83a76a640 1 --2- 172.21.15.79:0/2336948319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83406b770 0x7ff834154380 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7ff82800c430 tx=0x7ff82800c8f0 comp rx=0 tx=0).stop 2024-04-25T02:17:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.933+0000 7ff83a76a640 1 -- 172.21.15.79:0/2336948319 shutdown_connections 2024-04-25T02:17:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.933+0000 7ff83a76a640 1 --2- 172.21.15.79:0/2336948319 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff82006be30 0x7ff82006e2f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.933+0000 7ff83a76a640 1 --2- 172.21.15.79:0/2336948319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8340b41b0 0x7ff83415a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.933+0000 7ff83a76a640 1 --2- 172.21.15.79:0/2336948319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83406b770 0x7ff834154380 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.933+0000 7ff83a76a640 1 --2- 172.21.15.79:0/2336948319 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff83406b2f0 0x7ff834159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.933+0000 7ff83a76a640 1 -- 172.21.15.79:0/2336948319 >> 172.21.15.79:0/2336948319 conn(0x7ff8340b1cd0 msgr2=0x7ff83415ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.933+0000 7ff83a76a640 1 -- 172.21.15.79:0/2336948319 shutdown_connections 2024-04-25T02:17:36.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:36.933+0000 7ff83a76a640 1 -- 172.21.15.79:0/2336948319 wait complete. 2024-04-25T02:17:36.949 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T02:17:36.949 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:17:37.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.043+0000 7fcd9f0a5640 1 Processor -- start 2024-04-25T02:17:37.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.043+0000 7fcd9f0a5640 1 -- start start 2024-04-25T02:17:37.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.044+0000 7fcd9f0a5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd9806df50 0x7fcd9806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.044+0000 7fcd9f0a5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd98071e00 con 0x7fcd980b2d30 2024-04-25T02:17:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.044+0000 7fcd9f0a5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd980720a0 con 0x7fcd98143bc0 2024-04-25T02:17:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.044+0000 7fcd9f0a5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcd9806e8f0 con 0x7fcd9806df50 2024-04-25T02:17:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.044+0000 7fcd9d642640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcd980b2d30 0x7fcd980b3190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57706/0 (socket says 172.21.15.79:57706) 2024-04-25T02:17:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.044+0000 7fcd9d642640 1 -- 172.21.15.79:0/2016077877 learned_addr learned my addr 172.21.15.79:0/2016077877 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.044+0000 7fcd97fff640 1 --2- 172.21.15.79:0/2016077877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd9806df50 0x7fcd9806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.044+0000 7fcd977fe640 1 -- 172.21.15.79:0/2016077877 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2427914417 0 0) 0x7fcd98071e00 con 0x7fcd980b2d30 2024-04-25T02:17:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.044+0000 7fcd977fe640 1 -- 172.21.15.79:0/2016077877 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd88003520 con 0x7fcd980b2d30 2024-04-25T02:17:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.044+0000 7fcd977fe640 1 -- 172.21.15.79:0/2016077877 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1553967258 0 0) 0x7fcd980720a0 con 0x7fcd98143bc0 2024-04-25T02:17:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.044+0000 7fcd977fe640 1 -- 172.21.15.79:0/2016077877 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd98071e00 con 0x7fcd98143bc0 2024-04-25T02:17:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.044+0000 7fcd97fff640 1 -- 172.21.15.79:0/2016077877 >> v1:172.21.15.189:6789/0 conn(0x7fcd98143bc0 legacy=0x7fcd9815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.044+0000 7fcd97fff640 1 -- 172.21.15.79:0/2016077877 >> v1:172.21.15.79:6789/0 conn(0x7fcd980b2d30 legacy=0x7fcd980b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.044+0000 7fcd97fff640 1 -- 172.21.15.79:0/2016077877 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd98072380 con 0x7fcd9806df50 2024-04-25T02:17:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.045+0000 7fcd97fff640 1 --2- 172.21.15.79:0/2016077877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd9806df50 0x7fcd9806e3b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcd840097d0 tx=0x7fcd8402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86a4a12f2a13fa3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.045+0000 7fcd977fe640 1 -- 172.21.15.79:0/2016077877 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd84037070 con 0x7fcd9806df50 2024-04-25T02:17:37.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.045+0000 7fcd977fe640 1 -- 172.21.15.79:0/2016077877 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd84032440 con 0x7fcd9806df50 2024-04-25T02:17:37.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.045+0000 7fcd977fe640 1 -- 172.21.15.79:0/2016077877 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd840327f0 con 0x7fcd9806df50 2024-04-25T02:17:37.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.046+0000 7fcd9f0a5640 1 -- 172.21.15.79:0/2016077877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd9806df50 msgr2=0x7fcd9806e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.046+0000 7fcd9f0a5640 1 --2- 172.21.15.79:0/2016077877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd9806df50 0x7fcd9806e3b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcd840097d0 tx=0x7fcd8402a180 comp rx=0 tx=0).stop 2024-04-25T02:17:37.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.046+0000 7fcd9f0a5640 1 -- 172.21.15.79:0/2016077877 shutdown_connections 2024-04-25T02:17:37.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.046+0000 7fcd9f0a5640 1 --2- 172.21.15.79:0/2016077877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd9806df50 0x7fcd9806e3b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.046+0000 7fcd9f0a5640 1 -- 172.21.15.79:0/2016077877 >> 172.21.15.79:0/2016077877 conn(0x7fcd980cfc80 msgr2=0x7fcd980d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:37.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.046+0000 7fcd9f0a5640 1 -- 172.21.15.79:0/2016077877 shutdown_connections 2024-04-25T02:17:37.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.046+0000 7fcd9f0a5640 1 -- 172.21.15.79:0/2016077877 wait complete. 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.047+0000 7fcd9f0a5640 1 Processor -- start 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.047+0000 7fcd9f0a5640 1 -- start start 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9f0a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd9806df50 0x7fcd9813fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9f0a5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd980b2d30 0x7fcd980cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9f0a5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd98143bc0 0x7fcd9813f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9f0a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd98072940 con 0x7fcd9806df50 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9f0a5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcd98072cb0 con 0x7fcd980b2d30 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9f0a5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcd98143fa0 con 0x7fcd98143bc0 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9ce41640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd9806df50 0x7fcd9813fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9ce41640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd9806df50 0x7fcd9813fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48104/0 (socket says 172.21.15.79:48104) 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9ce41640 1 -- 172.21.15.79:0/446054775 learned_addr learned my addr 172.21.15.79:0/446054775 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9d642640 1 --2- 172.21.15.79:0/446054775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd98143bc0 0x7fcd9813f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd97fff640 1 --2- 172.21.15.79:0/446054775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd980b2d30 0x7fcd980cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9ce41640 1 -- 172.21.15.79:0/446054775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd98143bc0 msgr2=0x7fcd9813f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9ce41640 1 --2- 172.21.15.79:0/446054775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd98143bc0 0x7fcd9813f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9ce41640 1 -- 172.21.15.79:0/446054775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd980b2d30 msgr2=0x7fcd980cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9ce41640 1 --2- 172.21.15.79:0/446054775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd980b2d30 0x7fcd980cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9ce41640 1 -- 172.21.15.79:0/446054775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd98140430 con 0x7fcd9806df50 2024-04-25T02:17:37.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd97fff640 1 --2- 172.21.15.79:0/446054775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd980b2d30 0x7fcd980cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:37.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9ce41640 1 --2- 172.21.15.79:0/446054775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd9806df50 0x7fcd9813fe50 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00c530 tx=0x7fcd8c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:37.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd957fa640 1 -- 172.21.15.79:0/446054775 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0052d0 con 0x7fcd9806df50 2024-04-25T02:17:37.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd957fa640 1 -- 172.21.15.79:0/446054775 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8c005490 con 0x7fcd9806df50 2024-04-25T02:17:37.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9f0a5640 1 -- 172.21.15.79:0/446054775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd98140710 con 0x7fcd9806df50 2024-04-25T02:17:37.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd957fa640 1 -- 172.21.15.79:0/446054775 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c012870 con 0x7fcd9806df50 2024-04-25T02:17:37.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.048+0000 7fcd9f0a5640 1 -- 172.21.15.79:0/446054775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd98140cd0 con 0x7fcd9806df50 2024-04-25T02:17:37.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.049+0000 7fcd9f0a5640 1 -- 172.21.15.79:0/446054775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd980690a0 con 0x7fcd9806df50 2024-04-25T02:17:37.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.050+0000 7fcd957fa640 1 -- 172.21.15.79:0/446054775 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd8c012a10 con 0x7fcd9806df50 2024-04-25T02:17:37.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.050+0000 7fcd957fa640 1 --2- 172.21.15.79:0/446054775 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcd7c06be30 0x7fcd7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.050+0000 7fcd97fff640 1 --2- 172.21.15.79:0/446054775 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcd7c06be30 0x7fcd7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.050+0000 7fcd957fa640 1 -- 172.21.15.79:0/446054775 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7fcd8c08aaa0 con 0x7fcd9806df50 2024-04-25T02:17:37.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.051+0000 7fcd97fff640 1 --2- 172.21.15.79:0/446054775 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcd7c06be30 0x7fcd7c06e2f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcd84034000 tx=0x7fcd8402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:37.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.055+0000 7fcd957fa640 1 -- 172.21.15.79:0/446054775 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcd8c059460 con 0x7fcd9806df50 2024-04-25T02:17:37.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.263+0000 7fcd9f0a5640 1 -- 172.21.15.79:0/446054775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd9815e360 con 0x7fcd9806df50 2024-04-25T02:17:37.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.263+0000 7fcd957fa640 1 -- 172.21.15.79:0/446054775 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5186 (secure 0 0 0) 0x7fcd8c058d60 con 0x7fcd9806df50 2024-04-25T02:17:37.268 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:37.268 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":83,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3866997901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3866997901},{"type":"v1","addr":"172.21.15.189:6834","nonce":3866997901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/167225705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":167225705},{"type":"v1","addr":"172.21.15.189:6835","nonce":167225705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8916,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3734112703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3734112703},{"type":"v1","addr":"172.21.15.79:6835","nonce":3734112703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:17:33.960191+0000","modified":"2024-04-25T02:17:36.267031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8919},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8919":{"gid":8919,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2134535107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2134535107},{"type":"v1","addr":"172.21.15.79:6837","nonce":2134535107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8919,"qdb_cluster":[8919]},"id":8}]} 2024-04-25T02:17:37.269 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 83 2024-04-25T02:17:37.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.265+0000 7fcd9f0a5640 1 -- 172.21.15.79:0/446054775 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcd7c06be30 msgr2=0x7fcd7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.265+0000 7fcd9f0a5640 1 --2- 172.21.15.79:0/446054775 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcd7c06be30 0x7fcd7c06e2f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcd84034000 tx=0x7fcd8402e000 comp rx=0 tx=0).stop 2024-04-25T02:17:37.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.265+0000 7fcd9f0a5640 1 -- 172.21.15.79:0/446054775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd9806df50 msgr2=0x7fcd9813fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.265+0000 7fcd9f0a5640 1 --2- 172.21.15.79:0/446054775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd9806df50 0x7fcd9813fe50 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00c530 tx=0x7fcd8c00c9f0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.266+0000 7fcd9f0a5640 1 -- 172.21.15.79:0/446054775 shutdown_connections 2024-04-25T02:17:37.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.266+0000 7fcd9f0a5640 1 --2- 172.21.15.79:0/446054775 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcd7c06be30 0x7fcd7c06e2f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.266+0000 7fcd9f0a5640 1 --2- 172.21.15.79:0/446054775 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcd98143bc0 0x7fcd9813f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.266+0000 7fcd9f0a5640 1 --2- 172.21.15.79:0/446054775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd980b2d30 0x7fcd980cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.266+0000 7fcd9f0a5640 1 --2- 172.21.15.79:0/446054775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd9806df50 0x7fcd9813fe50 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.266+0000 7fcd9f0a5640 1 -- 172.21.15.79:0/446054775 >> 172.21.15.79:0/446054775 conn(0x7fcd980cfc80 msgr2=0x7fcd980afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:37.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.266+0000 7fcd9f0a5640 1 -- 172.21.15.79:0/446054775 shutdown_connections 2024-04-25T02:17:37.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.266+0000 7fcd9f0a5640 1 -- 172.21.15.79:0/446054775 wait complete. 2024-04-25T02:17:37.281 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:17:37.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.374+0000 7f89296da640 1 Processor -- start 2024-04-25T02:17:37.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.374+0000 7f89296da640 1 -- start start 2024-04-25T02:17:37.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.375+0000 7f89296da640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f892415e4d0 0x7f892406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.375+0000 7f89296da640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89240b3570 0x7f89240d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.375+0000 7f89296da640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89240d1660 con 0x7f89240b3020 2024-04-25T02:17:37.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.375+0000 7f89296da640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f89240d1380 con 0x7f89240b3570 2024-04-25T02:17:37.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.375+0000 7f89296da640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f89240cede0 con 0x7f892415e4d0 2024-04-25T02:17:37.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.375+0000 7f89227fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89240b3570 0x7f89240d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.375+0000 7f89237fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f89240b3020 0x7f89240cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57716/0 (socket says 172.21.15.79:57716) 2024-04-25T02:17:37.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.375+0000 7f89237fe640 1 -- 172.21.15.79:0/3833697895 learned_addr learned my addr 172.21.15.79:0/3833697895 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:37.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.375+0000 7f89227fc640 1 -- 172.21.15.79:0/3833697895 >> v2:172.21.15.189:3300/0 conn(0x7f892415e4d0 msgr2=0x7f892406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:37.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.375+0000 7f8922ffd640 1 --2- 172.21.15.79:0/3833697895 >> v2:172.21.15.189:3300/0 conn(0x7f892415e4d0 0x7f892406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.375+0000 7f8921ffb640 1 -- 172.21.15.79:0/3833697895 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 931259480 0 0) 0x7f89240d1660 con 0x7f89240b3020 2024-04-25T02:17:37.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.375+0000 7f89227fc640 1 --2- 172.21.15.79:0/3833697895 >> v2:172.21.15.189:3300/0 conn(0x7f892415e4d0 0x7f892406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.375+0000 7f89227fc640 1 -- 172.21.15.79:0/3833697895 >> v1:172.21.15.79:6789/0 conn(0x7f89240b3020 legacy=0x7f89240cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.375+0000 7f89227fc640 1 -- 172.21.15.79:0/3833697895 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89240cf0c0 con 0x7f89240b3570 2024-04-25T02:17:37.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.375+0000 7f8922ffd640 1 --2- 172.21.15.79:0/3833697895 >> v2:172.21.15.189:3300/0 conn(0x7f892415e4d0 0x7f892406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:37.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.376+0000 7f89227fc640 1 --2- 172.21.15.79:0/3833697895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89240b3570 0x7f89240d2710 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f89180097a0 tx=0x7f891802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98d561cf5ef8d7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:37.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.376+0000 7f8921ffb640 1 -- 172.21.15.79:0/3833697895 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918037070 con 0x7f89240b3570 2024-04-25T02:17:37.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.376+0000 7f8921ffb640 1 -- 172.21.15.79:0/3833697895 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8918032440 con 0x7f89240b3570 2024-04-25T02:17:37.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.376+0000 7f8921ffb640 1 -- 172.21.15.79:0/3833697895 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918032810 con 0x7f89240b3570 2024-04-25T02:17:37.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.376+0000 7f89296da640 1 -- 172.21.15.79:0/3833697895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89240b3570 msgr2=0x7f89240d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.376+0000 7f89296da640 1 --2- 172.21.15.79:0/3833697895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89240b3570 0x7f89240d2710 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f89180097a0 tx=0x7f891802a1e0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.377+0000 7f89296da640 1 -- 172.21.15.79:0/3833697895 shutdown_connections 2024-04-25T02:17:37.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.377+0000 7f89296da640 1 --2- 172.21.15.79:0/3833697895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89240b3570 0x7f89240d2710 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.377+0000 7f89296da640 1 --2- 172.21.15.79:0/3833697895 >> v2:172.21.15.189:3300/0 conn(0x7f892415e4d0 0x7f892406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.377+0000 7f89296da640 1 -- 172.21.15.79:0/3833697895 >> 172.21.15.79:0/3833697895 conn(0x7f892409d460 msgr2=0x7f89240d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:37.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.377+0000 7f89296da640 1 -- 172.21.15.79:0/3833697895 shutdown_connections 2024-04-25T02:17:37.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.377+0000 7f89296da640 1 -- 172.21.15.79:0/3833697895 wait complete. 2024-04-25T02:17:37.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.378+0000 7f89296da640 1 Processor -- start 2024-04-25T02:17:37.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.378+0000 7f89296da640 1 -- start start 2024-04-25T02:17:37.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f89296da640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89240b3020 0x7f89241f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f89296da640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89240b3570 0x7f89240cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f89296da640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f892415e4d0 0x7f89240b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f89296da640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f89240d2250 con 0x7f89240b3020 2024-04-25T02:17:37.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f89296da640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f89240d20d0 con 0x7f892415e4d0 2024-04-25T02:17:37.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f89296da640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f892406c1b0 con 0x7f89240b3570 2024-04-25T02:17:37.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f8922ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89240b3020 0x7f89241f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f8922ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89240b3020 0x7f89241f72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48118/0 (socket says 172.21.15.79:48118) 2024-04-25T02:17:37.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f8922ffd640 1 -- 172.21.15.79:0/1323416294 learned_addr learned my addr 172.21.15.79:0/1323416294 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:37.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f8922ffd640 1 -- 172.21.15.79:0/1323416294 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89240b3570 msgr2=0x7f89240cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f89227fc640 1 --2- 172.21.15.79:0/1323416294 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89240b3570 0x7f89240cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f89237fe640 1 --2- 172.21.15.79:0/1323416294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f892415e4d0 0x7f89240b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f8922ffd640 1 --2- 172.21.15.79:0/1323416294 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89240b3570 0x7f89240cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f8922ffd640 1 -- 172.21.15.79:0/1323416294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f892415e4d0 msgr2=0x7f89240b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f8922ffd640 1 --2- 172.21.15.79:0/1323416294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f892415e4d0 0x7f89240b0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f8922ffd640 1 -- 172.21.15.79:0/1323416294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89241f7bd0 con 0x7f89240b3020 2024-04-25T02:17:37.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f89227fc640 1 --2- 172.21.15.79:0/1323416294 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89240b3570 0x7f89240cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:37.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f8922ffd640 1 --2- 172.21.15.79:0/1323416294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89240b3020 0x7f89241f72d0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f891400c7f0 tx=0x7f891400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:37.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f890b7fe640 1 -- 172.21.15.79:0/1323416294 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914015070 con 0x7f89240b3020 2024-04-25T02:17:37.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f890b7fe640 1 -- 172.21.15.79:0/1323416294 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8914007820 con 0x7f89240b3020 2024-04-25T02:17:37.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f89296da640 1 -- 172.21.15.79:0/1323416294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89241f7eb0 con 0x7f89240b3020 2024-04-25T02:17:37.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f890b7fe640 1 -- 172.21.15.79:0/1323416294 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914007bd0 con 0x7f89240b3020 2024-04-25T02:17:37.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.379+0000 7f89296da640 1 -- 172.21.15.79:0/1323416294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89240cd8a0 con 0x7f89240b3020 2024-04-25T02:17:37.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.380+0000 7f89296da640 1 -- 172.21.15.79:0/1323416294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89240b9f60 con 0x7f89240b3020 2024-04-25T02:17:37.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.381+0000 7f890b7fe640 1 -- 172.21.15.79:0/1323416294 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8914018070 con 0x7f89240b3020 2024-04-25T02:17:37.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.381+0000 7f890b7fe640 1 --2- 172.21.15.79:0/1323416294 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f891006be30 0x7f891006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.381+0000 7f890b7fe640 1 -- 172.21.15.79:0/1323416294 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f891408afd0 con 0x7f89240b3020 2024-04-25T02:17:37.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.381+0000 7f89227fc640 1 --2- 172.21.15.79:0/1323416294 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f891006be30 0x7f891006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.382+0000 7f89227fc640 1 --2- 172.21.15.79:0/1323416294 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f891006be30 0x7f891006e2f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8918034000 tx=0x7f891802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:37.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.385+0000 7f890b7fe640 1 -- 172.21.15.79:0/1323416294 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f89240b9f60 con 0x7f89240b3020 2024-04-25T02:17:37.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.562+0000 7f89296da640 1 -- 172.21.15.79:0/1323416294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89240690a0 con 0x7f89240b3020 2024-04-25T02:17:37.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.563+0000 7f890b7fe640 1 -- 172.21.15.79:0/1323416294 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16639 (secure 0 0 0) 0x7f8914059980 con 0x7f89240b3020 2024-04-25T02:17:37.568 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:37.568 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":115,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:17:35.622563+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:17:32.207579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T02:17:32.929915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:17:37.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.565+0000 7f89296da640 1 -- 172.21.15.79:0/1323416294 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f891006be30 msgr2=0x7f891006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.565+0000 7f89296da640 1 --2- 172.21.15.79:0/1323416294 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f891006be30 0x7f891006e2f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8918034000 tx=0x7f891802e000 comp rx=0 tx=0).stop 2024-04-25T02:17:37.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.565+0000 7f89296da640 1 -- 172.21.15.79:0/1323416294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89240b3020 msgr2=0x7f89241f72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.565+0000 7f89296da640 1 --2- 172.21.15.79:0/1323416294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89240b3020 0x7f89241f72d0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f891400c7f0 tx=0x7f891400ccb0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.565+0000 7f89296da640 1 -- 172.21.15.79:0/1323416294 shutdown_connections 2024-04-25T02:17:37.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.565+0000 7f89296da640 1 --2- 172.21.15.79:0/1323416294 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f891006be30 0x7f891006e2f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.565+0000 7f89296da640 1 --2- 172.21.15.79:0/1323416294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f892415e4d0 0x7f89240b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.565+0000 7f89296da640 1 --2- 172.21.15.79:0/1323416294 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f89240b3570 0x7f89240cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.565+0000 7f89296da640 1 --2- 172.21.15.79:0/1323416294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89240b3020 0x7f89241f72d0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.565+0000 7f89296da640 1 -- 172.21.15.79:0/1323416294 >> 172.21.15.79:0/1323416294 conn(0x7f892409d460 msgr2=0x7f8924161dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:37.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.565+0000 7f89296da640 1 -- 172.21.15.79:0/1323416294 shutdown_connections 2024-04-25T02:17:37.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.565+0000 7f89296da640 1 -- 172.21.15.79:0/1323416294 wait complete. 2024-04-25T02:17:37.581 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T02:17:37.581 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:17:37.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.674+0000 7ff2c2732640 1 Processor -- start 2024-04-25T02:17:37.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.674+0000 7ff2c2732640 1 -- start start 2024-04-25T02:17:37.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.675+0000 7ff2c2732640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2bc071d00 0x7ff2bc1653f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.675+0000 7ff2c2732640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc15bb10 con 0x7ff2bc15a720 2024-04-25T02:17:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.675+0000 7ff2c2732640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc0b2e60 con 0x7ff2bc0d07a0 2024-04-25T02:17:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.675+0000 7ff2c2732640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff2bc0b3140 con 0x7ff2bc071d00 2024-04-25T02:17:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.675+0000 7ff2c0ccf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2bc071d00 0x7ff2bc1653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.675+0000 7ff2bbfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff2bc15a720 0x7ff2bc15ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57722/0 (socket says 172.21.15.79:57722) 2024-04-25T02:17:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.675+0000 7ff2bbfff640 1 -- 172.21.15.79:0/3728454838 learned_addr learned my addr 172.21.15.79:0/3728454838 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.675+0000 7ff2c0ccf640 1 -- 172.21.15.79:0/3728454838 >> v1:172.21.15.189:6789/0 conn(0x7ff2bc0d07a0 legacy=0x7ff2bc0b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.675+0000 7ff2c0ccf640 1 -- 172.21.15.79:0/3728454838 >> v1:172.21.15.79:6789/0 conn(0x7ff2bc15a720 legacy=0x7ff2bc15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.675+0000 7ff2baffd640 1 -- 172.21.15.79:0/3728454838 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013079069 0 0) 0x7ff2bc15bb10 con 0x7ff2bc15a720 2024-04-25T02:17:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.675+0000 7ff2c0ccf640 1 -- 172.21.15.79:0/3728454838 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc0b3420 con 0x7ff2bc071d00 2024-04-25T02:17:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.676+0000 7ff2c0ccf640 1 --2- 172.21.15.79:0/3728454838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc071d00 0x7ff2bc1653f0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009d90 tx=0x7ff2b402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fc5e2469229c87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.676+0000 7ff2baffd640 1 -- 172.21.15.79:0/3728454838 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4007740 con 0x7ff2bc071d00 2024-04-25T02:17:37.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.676+0000 7ff2baffd640 1 -- 172.21.15.79:0/3728454838 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b40078e0 con 0x7ff2bc071d00 2024-04-25T02:17:37.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.676+0000 7ff2baffd640 1 -- 172.21.15.79:0/3728454838 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4007cb0 con 0x7ff2bc071d00 2024-04-25T02:17:37.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.676+0000 7ff2c2732640 1 -- 172.21.15.79:0/3728454838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc071d00 msgr2=0x7ff2bc1653f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.676+0000 7ff2c2732640 1 --2- 172.21.15.79:0/3728454838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc071d00 0x7ff2bc1653f0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009d90 tx=0x7ff2b402a660 comp rx=0 tx=0).stop 2024-04-25T02:17:37.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.676+0000 7ff2c2732640 1 -- 172.21.15.79:0/3728454838 shutdown_connections 2024-04-25T02:17:37.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.676+0000 7ff2c2732640 1 --2- 172.21.15.79:0/3728454838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc071d00 0x7ff2bc1653f0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.676+0000 7ff2c2732640 1 -- 172.21.15.79:0/3728454838 >> 172.21.15.79:0/3728454838 conn(0x7ff2bc0cfc80 msgr2=0x7ff2bc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:37.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.677+0000 7ff2c2732640 1 -- 172.21.15.79:0/3728454838 shutdown_connections 2024-04-25T02:17:37.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.677+0000 7ff2c2732640 1 -- 172.21.15.79:0/3728454838 wait complete. 2024-04-25T02:17:37.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.678+0000 7ff2c2732640 1 Processor -- start 2024-04-25T02:17:37.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.678+0000 7ff2c2732640 1 -- start start 2024-04-25T02:17:37.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.678+0000 7ff2c2732640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc071d00 0x7ff2bc153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.678+0000 7ff2c2732640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc0d07a0 0x7ff2bc1599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.678+0000 7ff2c2732640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2bc15a720 0x7ff2bc15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.678+0000 7ff2c2732640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc0b49b0 con 0x7ff2bc0d07a0 2024-04-25T02:17:37.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.678+0000 7ff2c2732640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc0b39e0 con 0x7ff2bc15a720 2024-04-25T02:17:37.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2c2732640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff2bc0b4b30 con 0x7ff2bc071d00 2024-04-25T02:17:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2bb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc0d07a0 0x7ff2bc1599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2bb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc0d07a0 0x7ff2bc1599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48146/0 (socket says 172.21.15.79:48146) 2024-04-25T02:17:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2bb7fe640 1 -- 172.21.15.79:0/3962025456 learned_addr learned my addr 172.21.15.79:0/3962025456 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2bb7fe640 1 -- 172.21.15.79:0/3962025456 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc071d00 msgr2=0x7ff2bc153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2bbfff640 1 --2- 172.21.15.79:0/3962025456 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc071d00 0x7ff2bc153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2c0ccf640 1 --2- 172.21.15.79:0/3962025456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2bc15a720 0x7ff2bc15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2bb7fe640 1 --2- 172.21.15.79:0/3962025456 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc071d00 0x7ff2bc153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2bb7fe640 1 -- 172.21.15.79:0/3962025456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2bc15a720 msgr2=0x7ff2bc15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2bb7fe640 1 --2- 172.21.15.79:0/3962025456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2bc15a720 0x7ff2bc15ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2bb7fe640 1 -- 172.21.15.79:0/3962025456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc156780 con 0x7ff2bc0d07a0 2024-04-25T02:17:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2bbfff640 1 --2- 172.21.15.79:0/3962025456 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc071d00 0x7ff2bc153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2bb7fe640 1 --2- 172.21.15.79:0/3962025456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc0d07a0 0x7ff2bc1599f0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000c450 tx=0x7ff2b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2b8ff9640 1 -- 172.21.15.79:0/3962025456 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00052d0 con 0x7ff2bc0d07a0 2024-04-25T02:17:37.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2b8ff9640 1 -- 172.21.15.79:0/3962025456 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b0005470 con 0x7ff2bc0d07a0 2024-04-25T02:17:37.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2c2732640 1 -- 172.21.15.79:0/3962025456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc159f30 con 0x7ff2bc0d07a0 2024-04-25T02:17:37.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2b8ff9640 1 -- 172.21.15.79:0/3962025456 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0012870 con 0x7ff2bc0d07a0 2024-04-25T02:17:37.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.679+0000 7ff2c2732640 1 -- 172.21.15.79:0/3962025456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2bc154570 con 0x7ff2bc0d07a0 2024-04-25T02:17:37.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.680+0000 7ff2c2732640 1 -- 172.21.15.79:0/3962025456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2bc0690a0 con 0x7ff2bc0d07a0 2024-04-25T02:17:37.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.681+0000 7ff2b8ff9640 1 -- 172.21.15.79:0/3962025456 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2b0012a10 con 0x7ff2bc0d07a0 2024-04-25T02:17:37.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.681+0000 7ff2b8ff9640 1 --2- 172.21.15.79:0/3962025456 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2a806be60 0x7ff2a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:37.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.681+0000 7ff2b8ff9640 1 -- 172.21.15.79:0/3962025456 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7ff2b008aa20 con 0x7ff2bc0d07a0 2024-04-25T02:17:37.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.681+0000 7ff2bbfff640 1 --2- 172.21.15.79:0/3962025456 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2a806be60 0x7ff2a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:37.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.681+0000 7ff2bbfff640 1 --2- 172.21.15.79:0/3962025456 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2a806be60 0x7ff2a806e320 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac000f60 tx=0x7ff2ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:37.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.685+0000 7ff2b8ff9640 1 -- 172.21.15.79:0/3962025456 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff2b00593d0 con 0x7ff2bc0d07a0 2024-04-25T02:17:37.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.856+0000 7ff2c2732640 1 -- 172.21.15.79:0/3962025456 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2bc15b7d0 con 0x7ff2a806be60 2024-04-25T02:17:37.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.862+0000 7ff2b8ff9640 1 -- 172.21.15.79:0/3962025456 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252446 (secure 0 0 0) 0x7ff2bc15b7d0 con 0x7ff2a806be60 2024-04-25T02:17:37.869 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:37.871 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:17:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.866+0000 7ff2c2732640 1 -- 172.21.15.79:0/3962025456 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2a806be60 msgr2=0x7ff2a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.866+0000 7ff2c2732640 1 --2- 172.21.15.79:0/3962025456 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2a806be60 0x7ff2a806e320 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac000f60 tx=0x7ff2ac009040 comp rx=0 tx=0).stop 2024-04-25T02:17:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.866+0000 7ff2c2732640 1 -- 172.21.15.79:0/3962025456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc0d07a0 msgr2=0x7ff2bc1599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.866+0000 7ff2c2732640 1 --2- 172.21.15.79:0/3962025456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc0d07a0 0x7ff2bc1599f0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000c450 tx=0x7ff2b000c910 comp rx=0 tx=0).stop 2024-04-25T02:17:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.866+0000 7ff2c2732640 1 -- 172.21.15.79:0/3962025456 shutdown_connections 2024-04-25T02:17:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.866+0000 7ff2c2732640 1 --2- 172.21.15.79:0/3962025456 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff2a806be60 0x7ff2a806e320 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.866+0000 7ff2c2732640 1 --2- 172.21.15.79:0/3962025456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2bc15a720 0x7ff2bc15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.866+0000 7ff2c2732640 1 --2- 172.21.15.79:0/3962025456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2bc0d07a0 0x7ff2bc1599f0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.866+0000 7ff2c2732640 1 --2- 172.21.15.79:0/3962025456 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff2bc071d00 0x7ff2bc153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.866+0000 7ff2c2732640 1 -- 172.21.15.79:0/3962025456 >> 172.21.15.79:0/3962025456 conn(0x7ff2bc0cfc80 msgr2=0x7ff2bc072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.866+0000 7ff2c2732640 1 -- 172.21.15.79:0/3962025456 shutdown_connections 2024-04-25T02:17:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:37.866+0000 7ff2c2732640 1 -- 172.21.15.79:0/3962025456 wait complete. 2024-04-25T02:17:37.881 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":404,"stamp":"2024-04-25T02:17:37.303270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261792,"kb_used_data":12332,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712928,"statfs":{"total":773094113280,"available":772826038272,"internally_reserved":0,"allocated":12627968,"data_stored":6108272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.698065"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.652725+0000","last_change":"2024-04-25T02:17:34.647385+0000","last_active":"2024-04-25T02:17:34.652725+0000","last_peered":"2024-04-25T02:17:34.652725+0000","last_clean":"2024-04-25T02:17:34.652725+0000","last_became_active":"2024-04-25T02:17:34.646884+0000","last_became_peered":"2024-04-25T02:17:34.646884+0000","last_unstale":"2024-04-25T02:17:34.652725+0000","last_undegraded":"2024-04-25T02:17:34.652725+0000","last_fullsized":"2024-04-25T02:17:34.652725+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:21.036012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631532+0000","last_change":"2024-04-25T02:17:34.632316+0000","last_active":"2024-04-25T02:17:35.631532+0000","last_peered":"2024-04-25T02:17:35.631532+0000","last_clean":"2024-04-25T02:17:35.631532+0000","last_became_active":"2024-04-25T02:17:34.631583+0000","last_became_peered":"2024-04-25T02:17:34.631583+0000","last_unstale":"2024-04-25T02:17:35.631532+0000","last_undegraded":"2024-04-25T02:17:35.631532+0000","last_fullsized":"2024-04-25T02:17:35.631532+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:15.544599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832217+0000","last_change":"2024-04-25T02:17:34.636042+0000","last_active":"2024-04-25T02:17:35.832217+0000","last_peered":"2024-04-25T02:17:35.832217+0000","last_clean":"2024-04-25T02:17:35.832217+0000","last_became_active":"2024-04-25T02:17:34.635187+0000","last_became_peered":"2024-04-25T02:17:34.635187+0000","last_unstale":"2024-04-25T02:17:35.832217+0000","last_undegraded":"2024-04-25T02:17:35.832217+0000","last_fullsized":"2024-04-25T02:17:35.832217+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:03.216864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647507+0000","last_change":"2024-04-25T02:17:34.641094+0000","last_active":"2024-04-25T02:17:34.647507+0000","last_peered":"2024-04-25T02:17:34.647507+0000","last_clean":"2024-04-25T02:17:34.647507+0000","last_became_active":"2024-04-25T02:17:34.640738+0000","last_became_peered":"2024-04-25T02:17:34.640738+0000","last_unstale":"2024-04-25T02:17:34.647507+0000","last_undegraded":"2024-04-25T02:17:34.647507+0000","last_fullsized":"2024-04-25T02:17:34.647507+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:56.249428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626281+0000","last_change":"2024-04-25T02:17:34.625750+0000","last_active":"2024-04-25T02:17:35.626281+0000","last_peered":"2024-04-25T02:17:35.626281+0000","last_clean":"2024-04-25T02:17:35.626281+0000","last_became_active":"2024-04-25T02:17:34.625323+0000","last_became_peered":"2024-04-25T02:17:34.625323+0000","last_unstale":"2024-04-25T02:17:35.626281+0000","last_undegraded":"2024-04-25T02:17:35.626281+0000","last_fullsized":"2024-04-25T02:17:35.626281+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:54.939558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.627902+0000","last_change":"2024-04-25T02:17:34.626086+0000","last_active":"2024-04-25T02:17:34.627902+0000","last_peered":"2024-04-25T02:17:34.627902+0000","last_clean":"2024-04-25T02:17:34.627902+0000","last_became_active":"2024-04-25T02:17:34.625819+0000","last_became_peered":"2024-04-25T02:17:34.625819+0000","last_unstale":"2024-04-25T02:17:34.627902+0000","last_undegraded":"2024-04-25T02:17:34.627902+0000","last_fullsized":"2024-04-25T02:17:34.627902+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:12.876906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630361+0000","last_change":"2024-04-25T02:17:34.625112+0000","last_active":"2024-04-25T02:17:35.630361+0000","last_peered":"2024-04-25T02:17:35.630361+0000","last_clean":"2024-04-25T02:17:35.630361+0000","last_became_active":"2024-04-25T02:17:34.624713+0000","last_became_peered":"2024-04-25T02:17:34.624713+0000","last_unstale":"2024-04-25T02:17:35.630361+0000","last_undegraded":"2024-04-25T02:17:35.630361+0000","last_fullsized":"2024-04-25T02:17:35.630361+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:38.679764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832131+0000","last_change":"2024-04-25T02:17:34.631993+0000","last_active":"2024-04-25T02:17:35.832131+0000","last_peered":"2024-04-25T02:17:35.832131+0000","last_clean":"2024-04-25T02:17:35.832131+0000","last_became_active":"2024-04-25T02:17:34.631666+0000","last_became_peered":"2024-04-25T02:17:34.631666+0000","last_unstale":"2024-04-25T02:17:35.832131+0000","last_undegraded":"2024-04-25T02:17:35.832131+0000","last_fullsized":"2024-04-25T02:17:35.832131+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:15.684872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.652681+0000","last_change":"2024-04-25T02:17:34.647119+0000","last_active":"2024-04-25T02:17:34.652681+0000","last_peered":"2024-04-25T02:17:34.652681+0000","last_clean":"2024-04-25T02:17:34.652681+0000","last_became_active":"2024-04-25T02:17:34.646617+0000","last_became_peered":"2024-04-25T02:17:34.646617+0000","last_unstale":"2024-04-25T02:17:34.652681+0000","last_undegraded":"2024-04-25T02:17:34.652681+0000","last_fullsized":"2024-04-25T02:17:34.652681+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:13.067710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.650151+0000","last_change":"2024-04-25T02:17:34.645388+0000","last_active":"2024-04-25T02:17:34.650151+0000","last_peered":"2024-04-25T02:17:34.650151+0000","last_clean":"2024-04-25T02:17:34.650151+0000","last_became_active":"2024-04-25T02:17:34.644999+0000","last_became_peered":"2024-04-25T02:17:34.644999+0000","last_unstale":"2024-04-25T02:17:34.650151+0000","last_undegraded":"2024-04-25T02:17:34.650151+0000","last_fullsized":"2024-04-25T02:17:34.650151+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:49:44.765303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631455+0000","last_change":"2024-04-25T02:17:34.633182+0000","last_active":"2024-04-25T02:17:35.631455+0000","last_peered":"2024-04-25T02:17:35.631455+0000","last_clean":"2024-04-25T02:17:35.631455+0000","last_became_active":"2024-04-25T02:17:34.632889+0000","last_became_peered":"2024-04-25T02:17:34.632889+0000","last_unstale":"2024-04-25T02:17:35.631455+0000","last_undegraded":"2024-04-25T02:17:35.631455+0000","last_fullsized":"2024-04-25T02:17:35.631455+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:29:46.553410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647525+0000","last_change":"2024-04-25T02:17:34.642050+0000","last_active":"2024-04-25T02:17:34.647525+0000","last_peered":"2024-04-25T02:17:34.647525+0000","last_clean":"2024-04-25T02:17:34.647525+0000","last_became_active":"2024-04-25T02:17:34.641759+0000","last_became_peered":"2024-04-25T02:17:34.641759+0000","last_unstale":"2024-04-25T02:17:34.647525+0000","last_undegraded":"2024-04-25T02:17:34.647525+0000","last_fullsized":"2024-04-25T02:17:34.647525+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:19:27.046272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832095+0000","last_change":"2024-04-25T02:17:34.637512+0000","last_active":"2024-04-25T02:17:35.832095+0000","last_peered":"2024-04-25T02:17:35.832095+0000","last_clean":"2024-04-25T02:17:35.832095+0000","last_became_active":"2024-04-25T02:17:34.637171+0000","last_became_peered":"2024-04-25T02:17:34.637171+0000","last_unstale":"2024-04-25T02:17:35.832095+0000","last_undegraded":"2024-04-25T02:17:35.832095+0000","last_fullsized":"2024-04-25T02:17:35.832095+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:25.490834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.831920+0000","last_change":"2024-04-25T02:17:34.634642+0000","last_active":"2024-04-25T02:17:35.831920+0000","last_peered":"2024-04-25T02:17:35.831920+0000","last_clean":"2024-04-25T02:17:35.831920+0000","last_became_active":"2024-04-25T02:17:34.634332+0000","last_became_peered":"2024-04-25T02:17:34.634332+0000","last_unstale":"2024-04-25T02:17:35.831920+0000","last_undegraded":"2024-04-25T02:17:35.831920+0000","last_fullsized":"2024-04-25T02:17:35.831920+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:15.544599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.642662+0000","last_change":"2024-04-25T02:17:34.638776+0000","last_active":"2024-04-25T02:17:34.642662+0000","last_peered":"2024-04-25T02:17:34.642662+0000","last_clean":"2024-04-25T02:17:34.642662+0000","last_became_active":"2024-04-25T02:17:34.638457+0000","last_became_peered":"2024-04-25T02:17:34.638457+0000","last_unstale":"2024-04-25T02:17:34.642662+0000","last_undegraded":"2024-04-25T02:17:34.642662+0000","last_fullsized":"2024-04-25T02:17:34.642662+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:02.647111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.650113+0000","last_change":"2024-04-25T02:17:34.645506+0000","last_active":"2024-04-25T02:17:34.650113+0000","last_peered":"2024-04-25T02:17:34.650113+0000","last_clean":"2024-04-25T02:17:34.650113+0000","last_became_active":"2024-04-25T02:17:34.645038+0000","last_became_peered":"2024-04-25T02:17:34.645038+0000","last_unstale":"2024-04-25T02:17:34.650113+0000","last_undegraded":"2024-04-25T02:17:34.650113+0000","last_fullsized":"2024-04-25T02:17:34.650113+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:47.410031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631594+0000","last_change":"2024-04-25T02:17:34.634800+0000","last_active":"2024-04-25T02:17:35.631594+0000","last_peered":"2024-04-25T02:17:35.631594+0000","last_clean":"2024-04-25T02:17:35.631594+0000","last_became_active":"2024-04-25T02:17:34.634551+0000","last_became_peered":"2024-04-25T02:17:34.634551+0000","last_unstale":"2024-04-25T02:17:35.631594+0000","last_undegraded":"2024-04-25T02:17:35.631594+0000","last_fullsized":"2024-04-25T02:17:35.631594+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:19.203503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.639601+0000","last_change":"2024-04-25T02:17:34.638731+0000","last_active":"2024-04-25T02:17:34.639601+0000","last_peered":"2024-04-25T02:17:34.639601+0000","last_clean":"2024-04-25T02:17:34.639601+0000","last_became_active":"2024-04-25T02:17:34.637119+0000","last_became_peered":"2024-04-25T02:17:34.637119+0000","last_unstale":"2024-04-25T02:17:34.639601+0000","last_undegraded":"2024-04-25T02:17:34.639601+0000","last_fullsized":"2024-04-25T02:17:34.639601+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:46.502887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832351+0000","last_change":"2024-04-25T02:17:34.636868+0000","last_active":"2024-04-25T02:17:35.832351+0000","last_peered":"2024-04-25T02:17:35.832351+0000","last_clean":"2024-04-25T02:17:35.832351+0000","last_became_active":"2024-04-25T02:17:34.636609+0000","last_became_peered":"2024-04-25T02:17:34.636609+0000","last_unstale":"2024-04-25T02:17:35.832351+0000","last_undegraded":"2024-04-25T02:17:35.832351+0000","last_fullsized":"2024-04-25T02:17:35.832351+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:20.830323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631610+0000","last_change":"2024-04-25T02:17:34.630501+0000","last_active":"2024-04-25T02:17:35.631610+0000","last_peered":"2024-04-25T02:17:35.631610+0000","last_clean":"2024-04-25T02:17:35.631610+0000","last_became_active":"2024-04-25T02:17:34.630233+0000","last_became_peered":"2024-04-25T02:17:34.630233+0000","last_unstale":"2024-04-25T02:17:35.631610+0000","last_undegraded":"2024-04-25T02:17:35.631610+0000","last_fullsized":"2024-04-25T02:17:35.631610+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:02.174445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631783+0000","last_change":"2024-04-25T02:17:34.629075+0000","last_active":"2024-04-25T02:17:35.631783+0000","last_peered":"2024-04-25T02:17:35.631783+0000","last_clean":"2024-04-25T02:17:35.631783+0000","last_became_active":"2024-04-25T02:17:34.628498+0000","last_became_peered":"2024-04-25T02:17:34.628498+0000","last_unstale":"2024-04-25T02:17:35.631783+0000","last_undegraded":"2024-04-25T02:17:35.631783+0000","last_fullsized":"2024-04-25T02:17:35.631783+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:43.811948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.639184+0000","last_change":"2024-04-25T02:17:34.635681+0000","last_active":"2024-04-25T02:17:34.639184+0000","last_peered":"2024-04-25T02:17:34.639184+0000","last_clean":"2024-04-25T02:17:34.639184+0000","last_became_active":"2024-04-25T02:17:34.635414+0000","last_became_peered":"2024-04-25T02:17:34.635414+0000","last_unstale":"2024-04-25T02:17:34.639184+0000","last_undegraded":"2024-04-25T02:17:34.639184+0000","last_fullsized":"2024-04-25T02:17:34.639184+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:15.684872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631204+0000","last_change":"2024-04-25T02:17:34.629783+0000","last_active":"2024-04-25T02:17:35.631204+0000","last_peered":"2024-04-25T02:17:35.631204+0000","last_clean":"2024-04-25T02:17:35.631204+0000","last_became_active":"2024-04-25T02:17:34.629408+0000","last_became_peered":"2024-04-25T02:17:34.629408+0000","last_unstale":"2024-04-25T02:17:35.631204+0000","last_undegraded":"2024-04-25T02:17:35.631204+0000","last_fullsized":"2024-04-25T02:17:35.631204+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:59.772980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.636290+0000","last_change":"2024-04-25T02:17:34.634029+0000","last_active":"2024-04-25T02:17:34.636290+0000","last_peered":"2024-04-25T02:17:34.636290+0000","last_clean":"2024-04-25T02:17:34.636290+0000","last_became_active":"2024-04-25T02:17:34.633697+0000","last_became_peered":"2024-04-25T02:17:34.633697+0000","last_unstale":"2024-04-25T02:17:34.636290+0000","last_undegraded":"2024-04-25T02:17:34.636290+0000","last_fullsized":"2024-04-25T02:17:34.636290+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:36:38.389254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631720+0000","last_change":"2024-04-25T02:17:34.634249+0000","last_active":"2024-04-25T02:17:35.631720+0000","last_peered":"2024-04-25T02:17:35.631720+0000","last_clean":"2024-04-25T02:17:35.631720+0000","last_became_active":"2024-04-25T02:17:34.633985+0000","last_became_peered":"2024-04-25T02:17:34.633985+0000","last_unstale":"2024-04-25T02:17:35.631720+0000","last_undegraded":"2024-04-25T02:17:35.631720+0000","last_fullsized":"2024-04-25T02:17:35.631720+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:15.684872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647329+0000","last_change":"2024-04-25T02:17:34.639912+0000","last_active":"2024-04-25T02:17:34.647329+0000","last_peered":"2024-04-25T02:17:34.647329+0000","last_clean":"2024-04-25T02:17:34.647329+0000","last_became_active":"2024-04-25T02:17:34.639665+0000","last_became_peered":"2024-04-25T02:17:34.639665+0000","last_unstale":"2024-04-25T02:17:34.647329+0000","last_undegraded":"2024-04-25T02:17:34.647329+0000","last_fullsized":"2024-04-25T02:17:34.647329+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:20.830323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.652690+0000","last_change":"2024-04-25T02:17:34.646380+0000","last_active":"2024-04-25T02:17:34.652690+0000","last_peered":"2024-04-25T02:17:34.652690+0000","last_clean":"2024-04-25T02:17:34.652690+0000","last_became_active":"2024-04-25T02:17:34.646103+0000","last_became_peered":"2024-04-25T02:17:34.646103+0000","last_unstale":"2024-04-25T02:17:34.652690+0000","last_undegraded":"2024-04-25T02:17:34.652690+0000","last_fullsized":"2024-04-25T02:17:34.652690+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:24:25.441243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.650225+0000","last_change":"2024-04-25T02:17:34.643163+0000","last_active":"2024-04-25T02:17:34.650225+0000","last_peered":"2024-04-25T02:17:34.650225+0000","last_clean":"2024-04-25T02:17:34.650225+0000","last_became_active":"2024-04-25T02:17:34.642907+0000","last_became_peered":"2024-04-25T02:17:34.642907+0000","last_unstale":"2024-04-25T02:17:34.650225+0000","last_undegraded":"2024-04-25T02:17:34.650225+0000","last_fullsized":"2024-04-25T02:17:34.650225+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:03.216864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631498+0000","last_change":"2024-04-25T02:17:34.629314+0000","last_active":"2024-04-25T02:17:35.631498+0000","last_peered":"2024-04-25T02:17:35.631498+0000","last_clean":"2024-04-25T02:17:35.631498+0000","last_became_active":"2024-04-25T02:17:34.628882+0000","last_became_peered":"2024-04-25T02:17:34.628882+0000","last_unstale":"2024-04-25T02:17:35.631498+0000","last_undegraded":"2024-04-25T02:17:35.631498+0000","last_fullsized":"2024-04-25T02:17:35.631498+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:00.226145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630367+0000","last_change":"2024-04-25T02:17:34.629958+0000","last_active":"2024-04-25T02:17:35.630367+0000","last_peered":"2024-04-25T02:17:35.630367+0000","last_clean":"2024-04-25T02:17:35.630367+0000","last_became_active":"2024-04-25T02:17:34.629635+0000","last_became_peered":"2024-04-25T02:17:34.629635+0000","last_unstale":"2024-04-25T02:17:35.630367+0000","last_undegraded":"2024-04-25T02:17:35.630367+0000","last_fullsized":"2024-04-25T02:17:35.630367+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:10.623773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647457+0000","last_change":"2024-04-25T02:17:34.640937+0000","last_active":"2024-04-25T02:17:34.647457+0000","last_peered":"2024-04-25T02:17:34.647457+0000","last_clean":"2024-04-25T02:17:34.647457+0000","last_became_active":"2024-04-25T02:17:34.640309+0000","last_became_peered":"2024-04-25T02:17:34.640309+0000","last_unstale":"2024-04-25T02:17:34.647457+0000","last_undegraded":"2024-04-25T02:17:34.647457+0000","last_fullsized":"2024-04-25T02:17:34.647457+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:08.680050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.627689+0000","last_change":"2024-04-25T02:17:34.625611+0000","last_active":"2024-04-25T02:17:34.627689+0000","last_peered":"2024-04-25T02:17:34.627689+0000","last_clean":"2024-04-25T02:17:34.627689+0000","last_became_active":"2024-04-25T02:17:34.625356+0000","last_became_peered":"2024-04-25T02:17:34.625356+0000","last_unstale":"2024-04-25T02:17:34.627689+0000","last_undegraded":"2024-04-25T02:17:34.627689+0000","last_fullsized":"2024-04-25T02:17:34.627689+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:27:23.463083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.630199+0000","last_change":"2024-04-25T02:17:34.627802+0000","last_active":"2024-04-25T02:17:34.630199+0000","last_peered":"2024-04-25T02:17:34.630199+0000","last_clean":"2024-04-25T02:17:34.630199+0000","last_became_active":"2024-04-25T02:17:34.627477+0000","last_became_peered":"2024-04-25T02:17:34.627477+0000","last_unstale":"2024-04-25T02:17:34.630199+0000","last_undegraded":"2024-04-25T02:17:34.630199+0000","last_fullsized":"2024-04-25T02:17:34.630199+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:11.625103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"114'4","reported_seq":18,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630354+0000","last_change":"2024-04-25T02:17:33.623117+0000","last_active":"2024-04-25T02:17:35.630354+0000","last_peered":"2024-04-25T02:17:35.630354+0000","last_clean":"2024-04-25T02:17:35.630354+0000","last_became_active":"2024-04-25T02:17:33.622690+0000","last_became_peered":"2024-04-25T02:17:33.622690+0000","last_unstale":"2024-04-25T02:17:35.630354+0000","last_undegraded":"2024-04-25T02:17:35.630354+0000","last_fullsized":"2024-04-25T02:17:35.630354+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:33.051294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.633591+0000","last_change":"2024-04-25T02:17:34.632297+0000","last_active":"2024-04-25T02:17:34.633591+0000","last_peered":"2024-04-25T02:17:34.633591+0000","last_clean":"2024-04-25T02:17:34.633591+0000","last_became_active":"2024-04-25T02:17:34.632032+0000","last_became_peered":"2024-04-25T02:17:34.632032+0000","last_unstale":"2024-04-25T02:17:34.633591+0000","last_undegraded":"2024-04-25T02:17:34.633591+0000","last_fullsized":"2024-04-25T02:17:34.633591+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:59.772980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832092+0000","last_change":"2024-04-25T02:17:33.627622+0000","last_active":"2024-04-25T02:17:35.832092+0000","last_peered":"2024-04-25T02:17:35.832092+0000","last_clean":"2024-04-25T02:17:35.832092+0000","last_became_active":"2024-04-25T02:17:33.627296+0000","last_became_peered":"2024-04-25T02:17:33.627296+0000","last_unstale":"2024-04-25T02:17:35.832092+0000","last_undegraded":"2024-04-25T02:17:35.832092+0000","last_fullsized":"2024-04-25T02:17:35.832092+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:49.051553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.630235+0000","last_change":"2024-04-25T02:17:34.628360+0000","last_active":"2024-04-25T02:17:34.630235+0000","last_peered":"2024-04-25T02:17:34.630235+0000","last_clean":"2024-04-25T02:17:34.630235+0000","last_became_active":"2024-04-25T02:17:34.628104+0000","last_became_peered":"2024-04-25T02:17:34.628104+0000","last_unstale":"2024-04-25T02:17:34.630235+0000","last_undegraded":"2024-04-25T02:17:34.630235+0000","last_fullsized":"2024-04-25T02:17:34.630235+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:34.058584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626260+0000","last_change":"2024-04-25T02:17:33.626397+0000","last_active":"2024-04-25T02:17:35.626260+0000","last_peered":"2024-04-25T02:17:35.626260+0000","last_clean":"2024-04-25T02:17:35.626260+0000","last_became_active":"2024-04-25T02:17:33.626114+0000","last_became_peered":"2024-04-25T02:17:33.626114+0000","last_unstale":"2024-04-25T02:17:35.626260+0000","last_undegraded":"2024-04-25T02:17:35.626260+0000","last_fullsized":"2024-04-25T02:17:35.626260+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:23.196019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832318+0000","last_change":"2024-04-25T02:17:34.638317+0000","last_active":"2024-04-25T02:17:35.832318+0000","last_peered":"2024-04-25T02:17:35.832318+0000","last_clean":"2024-04-25T02:17:35.832318+0000","last_became_active":"2024-04-25T02:17:34.637799+0000","last_became_peered":"2024-04-25T02:17:34.637799+0000","last_unstale":"2024-04-25T02:17:35.832318+0000","last_undegraded":"2024-04-25T02:17:35.832318+0000","last_fullsized":"2024-04-25T02:17:35.832318+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:20.759237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626117+0000","last_change":"2024-04-25T02:17:33.626195+0000","last_active":"2024-04-25T02:17:35.626117+0000","last_peered":"2024-04-25T02:17:35.626117+0000","last_clean":"2024-04-25T02:17:35.626117+0000","last_became_active":"2024-04-25T02:17:33.625881+0000","last_became_peered":"2024-04-25T02:17:33.625881+0000","last_unstale":"2024-04-25T02:17:35.626117+0000","last_undegraded":"2024-04-25T02:17:35.626117+0000","last_fullsized":"2024-04-25T02:17:35.626117+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:26:27.978999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647258+0000","last_change":"2024-04-25T02:17:34.640582+0000","last_active":"2024-04-25T02:17:34.647258+0000","last_peered":"2024-04-25T02:17:34.647258+0000","last_clean":"2024-04-25T02:17:34.647258+0000","last_became_active":"2024-04-25T02:17:34.640315+0000","last_became_peered":"2024-04-25T02:17:34.640315+0000","last_unstale":"2024-04-25T02:17:34.647258+0000","last_undegraded":"2024-04-25T02:17:34.647258+0000","last_fullsized":"2024-04-25T02:17:34.647258+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:50.531665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630073+0000","last_change":"2024-04-25T02:17:33.625581+0000","last_active":"2024-04-25T02:17:35.630073+0000","last_peered":"2024-04-25T02:17:35.630073+0000","last_clean":"2024-04-25T02:17:35.630073+0000","last_became_active":"2024-04-25T02:17:33.625316+0000","last_became_peered":"2024-04-25T02:17:33.625316+0000","last_unstale":"2024-04-25T02:17:35.630073+0000","last_undegraded":"2024-04-25T02:17:35.630073+0000","last_fullsized":"2024-04-25T02:17:35.630073+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:10.617813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631557+0000","last_change":"2024-04-25T02:17:34.628243+0000","last_active":"2024-04-25T02:17:35.631557+0000","last_peered":"2024-04-25T02:17:35.631557+0000","last_clean":"2024-04-25T02:17:35.631557+0000","last_became_active":"2024-04-25T02:17:34.627965+0000","last_became_peered":"2024-04-25T02:17:34.627965+0000","last_unstale":"2024-04-25T02:17:35.631557+0000","last_undegraded":"2024-04-25T02:17:35.631557+0000","last_fullsized":"2024-04-25T02:17:35.631557+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:36:38.389254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.635156+0000","last_change":"2024-04-25T02:17:33.626960+0000","last_active":"2024-04-25T02:17:34.635156+0000","last_peered":"2024-04-25T02:17:34.635156+0000","last_clean":"2024-04-25T02:17:34.635156+0000","last_became_active":"2024-04-25T02:17:33.626654+0000","last_became_peered":"2024-04-25T02:17:33.626654+0000","last_unstale":"2024-04-25T02:17:34.635156+0000","last_undegraded":"2024-04-25T02:17:34.635156+0000","last_fullsized":"2024-04-25T02:17:34.635156+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:45.495597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.650072+0000","last_change":"2024-04-25T02:17:34.645297+0000","last_active":"2024-04-25T02:17:34.650072+0000","last_peered":"2024-04-25T02:17:34.650072+0000","last_clean":"2024-04-25T02:17:34.650072+0000","last_became_active":"2024-04-25T02:17:34.644734+0000","last_became_peered":"2024-04-25T02:17:34.644734+0000","last_unstale":"2024-04-25T02:17:34.650072+0000","last_undegraded":"2024-04-25T02:17:34.650072+0000","last_fullsized":"2024-04-25T02:17:34.650072+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:09:10.886175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631209+0000","last_change":"2024-04-25T02:17:33.621812+0000","last_active":"2024-04-25T02:17:35.631209+0000","last_peered":"2024-04-25T02:17:35.631209+0000","last_clean":"2024-04-25T02:17:35.631209+0000","last_became_active":"2024-04-25T02:17:33.621492+0000","last_became_peered":"2024-04-25T02:17:33.621492+0000","last_unstale":"2024-04-25T02:17:35.631209+0000","last_undegraded":"2024-04-25T02:17:35.631209+0000","last_fullsized":"2024-04-25T02:17:35.631209+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:11:31.491809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630012+0000","last_change":"2024-04-25T02:17:34.633152+0000","last_active":"2024-04-25T02:17:35.630012+0000","last_peered":"2024-04-25T02:17:35.630012+0000","last_clean":"2024-04-25T02:17:35.630012+0000","last_became_active":"2024-04-25T02:17:34.632882+0000","last_became_peered":"2024-04-25T02:17:34.632882+0000","last_unstale":"2024-04-25T02:17:35.630012+0000","last_undegraded":"2024-04-25T02:17:35.630012+0000","last_fullsized":"2024-04-25T02:17:35.630012+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:11.331429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.640093+0000","last_change":"2024-04-25T02:17:33.630852+0000","last_active":"2024-04-25T02:17:34.640093+0000","last_peered":"2024-04-25T02:17:34.640093+0000","last_clean":"2024-04-25T02:17:34.640093+0000","last_became_active":"2024-04-25T02:17:33.630371+0000","last_became_peered":"2024-04-25T02:17:33.630371+0000","last_unstale":"2024-04-25T02:17:34.640093+0000","last_undegraded":"2024-04-25T02:17:34.640093+0000","last_fullsized":"2024-04-25T02:17:34.640093+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:14:08.779058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630426+0000","last_change":"2024-04-25T02:17:34.629365+0000","last_active":"2024-04-25T02:17:35.630426+0000","last_peered":"2024-04-25T02:17:35.630426+0000","last_clean":"2024-04-25T02:17:35.630426+0000","last_became_active":"2024-04-25T02:17:34.628728+0000","last_became_peered":"2024-04-25T02:17:34.628728+0000","last_unstale":"2024-04-25T02:17:35.630426+0000","last_undegraded":"2024-04-25T02:17:35.630426+0000","last_fullsized":"2024-04-25T02:17:35.630426+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:40:22.632491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626131+0000","last_change":"2024-04-25T02:17:33.626189+0000","last_active":"2024-04-25T02:17:35.626131+0000","last_peered":"2024-04-25T02:17:35.626131+0000","last_clean":"2024-04-25T02:17:35.626131+0000","last_became_active":"2024-04-25T02:17:33.625840+0000","last_became_peered":"2024-04-25T02:17:33.625840+0000","last_unstale":"2024-04-25T02:17:35.626131+0000","last_undegraded":"2024-04-25T02:17:35.626131+0000","last_fullsized":"2024-04-25T02:17:35.626131+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:52:23.230533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.649424+0000","last_change":"2024-04-25T02:17:34.648125+0000","last_active":"2024-04-25T02:17:34.649424+0000","last_peered":"2024-04-25T02:17:34.649424+0000","last_clean":"2024-04-25T02:17:34.649424+0000","last_became_active":"2024-04-25T02:17:34.647834+0000","last_became_peered":"2024-04-25T02:17:34.647834+0000","last_unstale":"2024-04-25T02:17:34.649424+0000","last_undegraded":"2024-04-25T02:17:34.649424+0000","last_fullsized":"2024-04-25T02:17:34.649424+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:15.544599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.621847+0000","last_change":"2024-04-25T02:17:33.627691+0000","last_active":"2024-04-25T02:17:34.621847+0000","last_peered":"2024-04-25T02:17:34.621847+0000","last_clean":"2024-04-25T02:17:34.621847+0000","last_became_active":"2024-04-25T02:17:33.627122+0000","last_became_peered":"2024-04-25T02:17:33.627122+0000","last_unstale":"2024-04-25T02:17:34.621847+0000","last_undegraded":"2024-04-25T02:17:34.621847+0000","last_fullsized":"2024-04-25T02:17:34.621847+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:29:45.546120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.636255+0000","last_change":"2024-04-25T02:17:34.635045+0000","last_active":"2024-04-25T02:17:34.636255+0000","last_peered":"2024-04-25T02:17:34.636255+0000","last_clean":"2024-04-25T02:17:34.636255+0000","last_became_active":"2024-04-25T02:17:34.634758+0000","last_became_peered":"2024-04-25T02:17:34.634758+0000","last_unstale":"2024-04-25T02:17:34.636255+0000","last_undegraded":"2024-04-25T02:17:34.636255+0000","last_fullsized":"2024-04-25T02:17:34.636255+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:02.174445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"114'3","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.644932+0000","last_change":"2024-04-25T02:17:33.633145+0000","last_active":"2024-04-25T02:17:34.644932+0000","last_peered":"2024-04-25T02:17:34.644932+0000","last_clean":"2024-04-25T02:17:34.644932+0000","last_became_active":"2024-04-25T02:17:33.632837+0000","last_became_peered":"2024-04-25T02:17:33.632837+0000","last_unstale":"2024-04-25T02:17:34.644932+0000","last_undegraded":"2024-04-25T02:17:34.644932+0000","last_fullsized":"2024-04-25T02:17:34.644932+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:42.804658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630382+0000","last_change":"2024-04-25T02:17:34.627888+0000","last_active":"2024-04-25T02:17:35.630382+0000","last_peered":"2024-04-25T02:17:35.630382+0000","last_clean":"2024-04-25T02:17:35.630382+0000","last_became_active":"2024-04-25T02:17:34.627600+0000","last_became_peered":"2024-04-25T02:17:34.627600+0000","last_unstale":"2024-04-25T02:17:35.630382+0000","last_undegraded":"2024-04-25T02:17:35.630382+0000","last_fullsized":"2024-04-25T02:17:35.630382+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:01.963854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"114'6","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.655560+0000","last_change":"2024-04-25T02:17:33.633110+0000","last_active":"2024-04-25T02:17:34.655560+0000","last_peered":"2024-04-25T02:17:34.655560+0000","last_clean":"2024-04-25T02:17:34.655560+0000","last_became_active":"2024-04-25T02:17:33.632822+0000","last_became_peered":"2024-04-25T02:17:33.632822+0000","last_unstale":"2024-04-25T02:17:34.655560+0000","last_undegraded":"2024-04-25T02:17:34.655560+0000","last_fullsized":"2024-04-25T02:17:34.655560+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:14.677581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.633527+0000","last_change":"2024-04-25T02:17:34.631821+0000","last_active":"2024-04-25T02:17:34.633527+0000","last_peered":"2024-04-25T02:17:34.633527+0000","last_clean":"2024-04-25T02:17:34.633527+0000","last_became_active":"2024-04-25T02:17:34.631520+0000","last_became_peered":"2024-04-25T02:17:34.631520+0000","last_unstale":"2024-04-25T02:17:34.633527+0000","last_undegraded":"2024-04-25T02:17:34.633527+0000","last_fullsized":"2024-04-25T02:17:34.633527+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:00.226145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.637681+0000","last_change":"2024-04-25T02:17:33.628046+0000","last_active":"2024-04-25T02:17:34.637681+0000","last_peered":"2024-04-25T02:17:34.637681+0000","last_clean":"2024-04-25T02:17:34.637681+0000","last_became_active":"2024-04-25T02:17:33.627792+0000","last_became_peered":"2024-04-25T02:17:33.627792+0000","last_unstale":"2024-04-25T02:17:34.637681+0000","last_undegraded":"2024-04-25T02:17:34.637681+0000","last_fullsized":"2024-04-25T02:17:34.637681+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:36.845554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.636016+0000","last_change":"2024-04-25T02:17:34.632894+0000","last_active":"2024-04-25T02:17:34.636016+0000","last_peered":"2024-04-25T02:17:34.636016+0000","last_clean":"2024-04-25T02:17:34.636016+0000","last_became_active":"2024-04-25T02:17:34.632573+0000","last_became_peered":"2024-04-25T02:17:34.632573+0000","last_unstale":"2024-04-25T02:17:34.636016+0000","last_undegraded":"2024-04-25T02:17:34.636016+0000","last_fullsized":"2024-04-25T02:17:34.636016+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:15.544599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.624154+0000","last_change":"2024-04-25T02:17:33.634694+0000","last_active":"2024-04-25T02:17:34.624154+0000","last_peered":"2024-04-25T02:17:34.624154+0000","last_clean":"2024-04-25T02:17:34.624154+0000","last_became_active":"2024-04-25T02:17:33.634387+0000","last_became_peered":"2024-04-25T02:17:33.634387+0000","last_unstale":"2024-04-25T02:17:34.624154+0000","last_undegraded":"2024-04-25T02:17:34.624154+0000","last_fullsized":"2024-04-25T02:17:34.624154+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:07.526435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.636225+0000","last_change":"2024-04-25T02:17:34.635173+0000","last_active":"2024-04-25T02:17:34.636225+0000","last_peered":"2024-04-25T02:17:34.636225+0000","last_clean":"2024-04-25T02:17:34.636225+0000","last_became_active":"2024-04-25T02:17:34.634895+0000","last_became_peered":"2024-04-25T02:17:34.634895+0000","last_unstale":"2024-04-25T02:17:34.636225+0000","last_undegraded":"2024-04-25T02:17:34.636225+0000","last_fullsized":"2024-04-25T02:17:34.636225+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:25.490834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"114'8","reported_seq":22,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626127+0000","last_change":"2024-04-25T02:17:33.634110+0000","last_active":"2024-04-25T02:17:35.626127+0000","last_peered":"2024-04-25T02:17:35.626127+0000","last_clean":"2024-04-25T02:17:35.626127+0000","last_became_active":"2024-04-25T02:17:33.633751+0000","last_became_peered":"2024-04-25T02:17:33.633751+0000","last_unstale":"2024-04-25T02:17:35.626127+0000","last_undegraded":"2024-04-25T02:17:35.626127+0000","last_fullsized":"2024-04-25T02:17:35.626127+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:47.139932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626356+0000","last_change":"2024-04-25T02:17:34.645944+0000","last_active":"2024-04-25T02:17:35.626356+0000","last_peered":"2024-04-25T02:17:35.626356+0000","last_clean":"2024-04-25T02:17:35.626356+0000","last_became_active":"2024-04-25T02:17:34.645677+0000","last_became_peered":"2024-04-25T02:17:34.645677+0000","last_unstale":"2024-04-25T02:17:35.626356+0000","last_undegraded":"2024-04-25T02:17:35.626356+0000","last_fullsized":"2024-04-25T02:17:35.626356+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:06.199916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647390+0000","last_change":"2024-04-25T02:17:33.634731+0000","last_active":"2024-04-25T02:17:34.647390+0000","last_peered":"2024-04-25T02:17:34.647390+0000","last_clean":"2024-04-25T02:17:34.647390+0000","last_became_active":"2024-04-25T02:17:33.634355+0000","last_became_peered":"2024-04-25T02:17:33.634355+0000","last_unstale":"2024-04-25T02:17:34.647390+0000","last_undegraded":"2024-04-25T02:17:34.647390+0000","last_fullsized":"2024-04-25T02:17:34.647390+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:19.751946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.652754+0000","last_change":"2024-04-25T02:17:34.648422+0000","last_active":"2024-04-25T02:17:34.652754+0000","last_peered":"2024-04-25T02:17:34.652754+0000","last_clean":"2024-04-25T02:17:34.652754+0000","last_became_active":"2024-04-25T02:17:34.648157+0000","last_became_peered":"2024-04-25T02:17:34.648157+0000","last_unstale":"2024-04-25T02:17:34.652754+0000","last_undegraded":"2024-04-25T02:17:34.652754+0000","last_fullsized":"2024-04-25T02:17:34.652754+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:52.582756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626396+0000","last_change":"2024-04-25T02:17:33.627854+0000","last_active":"2024-04-25T02:17:35.626396+0000","last_peered":"2024-04-25T02:17:35.626396+0000","last_clean":"2024-04-25T02:17:35.626396+0000","last_became_active":"2024-04-25T02:17:33.627456+0000","last_became_peered":"2024-04-25T02:17:33.627456+0000","last_unstale":"2024-04-25T02:17:35.626396+0000","last_undegraded":"2024-04-25T02:17:35.626396+0000","last_fullsized":"2024-04-25T02:17:35.626396+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:42.464717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832085+0000","last_change":"2024-04-25T02:17:34.645130+0000","last_active":"2024-04-25T02:17:35.832085+0000","last_peered":"2024-04-25T02:17:35.832085+0000","last_clean":"2024-04-25T02:17:35.832085+0000","last_became_active":"2024-04-25T02:17:34.644785+0000","last_became_peered":"2024-04-25T02:17:34.644785+0000","last_unstale":"2024-04-25T02:17:35.832085+0000","last_undegraded":"2024-04-25T02:17:35.832085+0000","last_fullsized":"2024-04-25T02:17:35.832085+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:02.174445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.635380+0000","last_change":"2024-04-25T02:17:33.624984+0000","last_active":"2024-04-25T02:17:34.635380+0000","last_peered":"2024-04-25T02:17:34.635380+0000","last_clean":"2024-04-25T02:17:34.635380+0000","last_became_active":"2024-04-25T02:17:33.624661+0000","last_became_peered":"2024-04-25T02:17:33.624661+0000","last_unstale":"2024-04-25T02:17:34.635380+0000","last_undegraded":"2024-04-25T02:17:34.635380+0000","last_fullsized":"2024-04-25T02:17:34.635380+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:08.908005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832404+0000","last_change":"2024-04-25T02:17:34.634858+0000","last_active":"2024-04-25T02:17:35.832404+0000","last_peered":"2024-04-25T02:17:35.832404+0000","last_clean":"2024-04-25T02:17:35.832404+0000","last_became_active":"2024-04-25T02:17:34.634560+0000","last_became_peered":"2024-04-25T02:17:34.634560+0000","last_unstale":"2024-04-25T02:17:35.832404+0000","last_undegraded":"2024-04-25T02:17:35.832404+0000","last_fullsized":"2024-04-25T02:17:35.832404+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:31.575299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630274+0000","last_change":"2024-04-25T02:17:33.634891+0000","last_active":"2024-04-25T02:17:35.630274+0000","last_peered":"2024-04-25T02:17:35.630274+0000","last_clean":"2024-04-25T02:17:35.630274+0000","last_became_active":"2024-04-25T02:17:33.634519+0000","last_became_peered":"2024-04-25T02:17:33.634519+0000","last_unstale":"2024-04-25T02:17:35.630274+0000","last_undegraded":"2024-04-25T02:17:35.630274+0000","last_fullsized":"2024-04-25T02:17:35.630274+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:01.639820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832010+0000","last_change":"2024-04-25T02:17:34.634120+0000","last_active":"2024-04-25T02:17:35.832010+0000","last_peered":"2024-04-25T02:17:35.832010+0000","last_clean":"2024-04-25T02:17:35.832010+0000","last_became_active":"2024-04-25T02:17:34.633824+0000","last_became_peered":"2024-04-25T02:17:34.633824+0000","last_unstale":"2024-04-25T02:17:35.832010+0000","last_undegraded":"2024-04-25T02:17:35.832010+0000","last_fullsized":"2024-04-25T02:17:35.832010+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:19.203503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.639192+0000","last_change":"2024-04-25T02:17:33.624328+0000","last_active":"2024-04-25T02:17:34.639192+0000","last_peered":"2024-04-25T02:17:34.639192+0000","last_clean":"2024-04-25T02:17:34.639192+0000","last_became_active":"2024-04-25T02:17:33.624045+0000","last_became_peered":"2024-04-25T02:17:33.624045+0000","last_unstale":"2024-04-25T02:17:34.639192+0000","last_undegraded":"2024-04-25T02:17:34.639192+0000","last_fullsized":"2024-04-25T02:17:34.639192+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:19:05.344900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647302+0000","last_change":"2024-04-25T02:17:34.639936+0000","last_active":"2024-04-25T02:17:34.647302+0000","last_peered":"2024-04-25T02:17:34.647302+0000","last_clean":"2024-04-25T02:17:34.647302+0000","last_became_active":"2024-04-25T02:17:34.639708+0000","last_became_peered":"2024-04-25T02:17:34.639708+0000","last_unstale":"2024-04-25T02:17:34.647302+0000","last_undegraded":"2024-04-25T02:17:34.647302+0000","last_fullsized":"2024-04-25T02:17:34.647302+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:31.575299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626062+0000","last_change":"2024-04-25T02:17:33.626112+0000","last_active":"2024-04-25T02:17:35.626062+0000","last_peered":"2024-04-25T02:17:35.626062+0000","last_clean":"2024-04-25T02:17:35.626062+0000","last_became_active":"2024-04-25T02:17:33.625765+0000","last_became_peered":"2024-04-25T02:17:33.625765+0000","last_unstale":"2024-04-25T02:17:35.626062+0000","last_undegraded":"2024-04-25T02:17:35.626062+0000","last_fullsized":"2024-04-25T02:17:35.626062+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:41.191104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832038+0000","last_change":"2024-04-25T02:17:34.637519+0000","last_active":"2024-04-25T02:17:35.832038+0000","last_peered":"2024-04-25T02:17:35.832038+0000","last_clean":"2024-04-25T02:17:35.832038+0000","last_became_active":"2024-04-25T02:17:34.637143+0000","last_became_peered":"2024-04-25T02:17:34.637143+0000","last_unstale":"2024-04-25T02:17:35.832038+0000","last_undegraded":"2024-04-25T02:17:35.832038+0000","last_fullsized":"2024-04-25T02:17:35.832038+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:36:38.389254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.622046+0000","last_change":"2024-04-25T02:17:33.622908+0000","last_active":"2024-04-25T02:17:34.622046+0000","last_peered":"2024-04-25T02:17:34.622046+0000","last_clean":"2024-04-25T02:17:34.622046+0000","last_became_active":"2024-04-25T02:17:33.622645+0000","last_became_peered":"2024-04-25T02:17:33.622645+0000","last_unstale":"2024-04-25T02:17:34.622046+0000","last_undegraded":"2024-04-25T02:17:34.622046+0000","last_fullsized":"2024-04-25T02:17:34.622046+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:00.745318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.649727+0000","last_change":"2024-04-25T02:17:34.641191+0000","last_active":"2024-04-25T02:17:34.649727+0000","last_peered":"2024-04-25T02:17:34.649727+0000","last_clean":"2024-04-25T02:17:34.649727+0000","last_became_active":"2024-04-25T02:17:34.640934+0000","last_became_peered":"2024-04-25T02:17:34.640934+0000","last_unstale":"2024-04-25T02:17:34.649727+0000","last_undegraded":"2024-04-25T02:17:34.649727+0000","last_fullsized":"2024-04-25T02:17:34.649727+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:43.811948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.640270+0000","last_change":"2024-04-25T02:17:33.630382+0000","last_active":"2024-04-25T02:17:34.640270+0000","last_peered":"2024-04-25T02:17:34.640270+0000","last_clean":"2024-04-25T02:17:34.640270+0000","last_became_active":"2024-04-25T02:17:33.630094+0000","last_became_peered":"2024-04-25T02:17:33.630094+0000","last_unstale":"2024-04-25T02:17:34.640270+0000","last_undegraded":"2024-04-25T02:17:34.640270+0000","last_fullsized":"2024-04-25T02:17:34.640270+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:11.383230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.646808+0000","last_change":"2024-04-25T02:17:34.646013+0000","last_active":"2024-04-25T02:17:34.646808+0000","last_peered":"2024-04-25T02:17:34.646808+0000","last_clean":"2024-04-25T02:17:34.646808+0000","last_became_active":"2024-04-25T02:17:34.645712+0000","last_became_peered":"2024-04-25T02:17:34.645712+0000","last_unstale":"2024-04-25T02:17:34.646808+0000","last_undegraded":"2024-04-25T02:17:34.646808+0000","last_fullsized":"2024-04-25T02:17:34.646808+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:00.226145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.641570+0000","last_change":"2024-04-25T02:17:33.633743+0000","last_active":"2024-04-25T02:17:34.641570+0000","last_peered":"2024-04-25T02:17:34.641570+0000","last_clean":"2024-04-25T02:17:34.641570+0000","last_became_active":"2024-04-25T02:17:33.633469+0000","last_became_peered":"2024-04-25T02:17:33.633469+0000","last_unstale":"2024-04-25T02:17:34.641570+0000","last_undegraded":"2024-04-25T02:17:34.641570+0000","last_fullsized":"2024-04-25T02:17:34.641570+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:07.526435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.652706+0000","last_change":"2024-04-25T02:17:34.647128+0000","last_active":"2024-04-25T02:17:34.652706+0000","last_peered":"2024-04-25T02:17:34.652706+0000","last_clean":"2024-04-25T02:17:34.652706+0000","last_became_active":"2024-04-25T02:17:34.645807+0000","last_became_peered":"2024-04-25T02:17:34.645807+0000","last_unstale":"2024-04-25T02:17:34.652706+0000","last_undegraded":"2024-04-25T02:17:34.652706+0000","last_fullsized":"2024-04-25T02:17:34.652706+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:21.075200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.616948+0000","last_change":"2024-04-25T02:17:33.627054+0000","last_active":"2024-04-25T02:17:35.616948+0000","last_peered":"2024-04-25T02:17:35.616948+0000","last_clean":"2024-04-25T02:17:35.616948+0000","last_became_active":"2024-04-25T02:17:33.626678+0000","last_became_peered":"2024-04-25T02:17:33.626678+0000","last_unstale":"2024-04-25T02:17:35.616948+0000","last_undegraded":"2024-04-25T02:17:35.616948+0000","last_fullsized":"2024-04-25T02:17:35.616948+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:06.224109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647560+0000","last_change":"2024-04-25T02:17:34.644075+0000","last_active":"2024-04-25T02:17:34.647560+0000","last_peered":"2024-04-25T02:17:34.647560+0000","last_clean":"2024-04-25T02:17:34.647560+0000","last_became_active":"2024-04-25T02:17:34.643618+0000","last_became_peered":"2024-04-25T02:17:34.643618+0000","last_unstale":"2024-04-25T02:17:34.647560+0000","last_undegraded":"2024-04-25T02:17:34.647560+0000","last_fullsized":"2024-04-25T02:17:34.647560+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:41.931220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.636846+0000","last_change":"2024-04-25T02:17:33.633635+0000","last_active":"2024-04-25T02:17:34.636846+0000","last_peered":"2024-04-25T02:17:34.636846+0000","last_clean":"2024-04-25T02:17:34.636846+0000","last_became_active":"2024-04-25T02:17:33.633387+0000","last_became_peered":"2024-04-25T02:17:33.633387+0000","last_unstale":"2024-04-25T02:17:34.636846+0000","last_undegraded":"2024-04-25T02:17:34.636846+0000","last_fullsized":"2024-04-25T02:17:34.636846+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:02.209573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.645967+0000","last_change":"2024-04-25T02:17:34.645273+0000","last_active":"2024-04-25T02:17:34.645967+0000","last_peered":"2024-04-25T02:17:34.645967+0000","last_clean":"2024-04-25T02:17:34.645967+0000","last_became_active":"2024-04-25T02:17:34.644956+0000","last_became_peered":"2024-04-25T02:17:34.644956+0000","last_unstale":"2024-04-25T02:17:34.645967+0000","last_undegraded":"2024-04-25T02:17:34.645967+0000","last_fullsized":"2024-04-25T02:17:34.645967+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:29:46.553410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.621577+0000","last_change":"2024-04-25T02:17:33.626409+0000","last_active":"2024-04-25T02:17:34.621577+0000","last_peered":"2024-04-25T02:17:34.621577+0000","last_clean":"2024-04-25T02:17:34.621577+0000","last_became_active":"2024-04-25T02:17:33.626169+0000","last_became_peered":"2024-04-25T02:17:33.626169+0000","last_unstale":"2024-04-25T02:17:34.621577+0000","last_undegraded":"2024-04-25T02:17:34.621577+0000","last_fullsized":"2024-04-25T02:17:34.621577+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:58.765689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631274+0000","last_change":"2024-04-25T02:17:34.628443+0000","last_active":"2024-04-25T02:17:35.631274+0000","last_peered":"2024-04-25T02:17:35.631274+0000","last_clean":"2024-04-25T02:17:35.631274+0000","last_became_active":"2024-04-25T02:17:34.628068+0000","last_became_peered":"2024-04-25T02:17:34.628068+0000","last_unstale":"2024-04-25T02:17:35.631274+0000","last_undegraded":"2024-04-25T02:17:35.631274+0000","last_fullsized":"2024-04-25T02:17:35.631274+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:46.502887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630186+0000","last_change":"2024-04-25T02:17:33.625108+0000","last_active":"2024-04-25T02:17:35.630186+0000","last_peered":"2024-04-25T02:17:35.630186+0000","last_clean":"2024-04-25T02:17:35.630186+0000","last_became_active":"2024-04-25T02:17:33.624774+0000","last_became_peered":"2024-04-25T02:17:33.624774+0000","last_unstale":"2024-04-25T02:17:35.630186+0000","last_undegraded":"2024-04-25T02:17:35.630186+0000","last_fullsized":"2024-04-25T02:17:35.630186+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:11.869616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631670+0000","last_change":"2024-04-25T02:17:34.622618+0000","last_active":"2024-04-25T02:17:35.631670+0000","last_peered":"2024-04-25T02:17:35.631670+0000","last_clean":"2024-04-25T02:17:35.631670+0000","last_became_active":"2024-04-25T02:17:34.622332+0000","last_became_peered":"2024-04-25T02:17:34.622332+0000","last_unstale":"2024-04-25T02:17:35.631670+0000","last_undegraded":"2024-04-25T02:17:35.631670+0000","last_fullsized":"2024-04-25T02:17:35.631670+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:25.490834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631253+0000","last_change":"2024-04-25T02:17:33.620935+0000","last_active":"2024-04-25T02:17:35.631253+0000","last_peered":"2024-04-25T02:17:35.631253+0000","last_clean":"2024-04-25T02:17:35.631253+0000","last_became_active":"2024-04-25T02:17:33.620625+0000","last_became_peered":"2024-04-25T02:17:33.620625+0000","last_unstale":"2024-04-25T02:17:35.631253+0000","last_undegraded":"2024-04-25T02:17:35.631253+0000","last_fullsized":"2024-04-25T02:17:35.631253+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:16.457015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832203+0000","last_change":"2024-04-25T02:17:34.635006+0000","last_active":"2024-04-25T02:17:35.832203+0000","last_peered":"2024-04-25T02:17:35.832203+0000","last_clean":"2024-04-25T02:17:35.832203+0000","last_became_active":"2024-04-25T02:17:34.634686+0000","last_became_peered":"2024-04-25T02:17:34.634686+0000","last_unstale":"2024-04-25T02:17:35.832203+0000","last_undegraded":"2024-04-25T02:17:35.832203+0000","last_fullsized":"2024-04-25T02:17:35.832203+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:43.811948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626026+0000","last_change":"2024-04-25T02:17:33.625519+0000","last_active":"2024-04-25T02:17:35.626026+0000","last_peered":"2024-04-25T02:17:35.626026+0000","last_clean":"2024-04-25T02:17:35.626026+0000","last_became_active":"2024-04-25T02:17:33.625139+0000","last_became_peered":"2024-04-25T02:17:33.625139+0000","last_unstale":"2024-04-25T02:17:35.626026+0000","last_undegraded":"2024-04-25T02:17:35.626026+0000","last_fullsized":"2024-04-25T02:17:35.626026+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:16.550835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647478+0000","last_change":"2024-04-25T02:17:34.642325+0000","last_active":"2024-04-25T02:17:34.647478+0000","last_peered":"2024-04-25T02:17:34.647478+0000","last_clean":"2024-04-25T02:17:34.647478+0000","last_became_active":"2024-04-25T02:17:34.640692+0000","last_became_peered":"2024-04-25T02:17:34.640692+0000","last_unstale":"2024-04-25T02:17:34.647478+0000","last_undegraded":"2024-04-25T02:17:34.647478+0000","last_fullsized":"2024-04-25T02:17:34.647478+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:48:28.907889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.642543+0000","last_change":"2024-04-25T02:17:33.629768+0000","last_active":"2024-04-25T02:17:34.642543+0000","last_peered":"2024-04-25T02:17:34.642543+0000","last_clean":"2024-04-25T02:17:34.642543+0000","last_became_active":"2024-04-25T02:17:33.629432+0000","last_became_peered":"2024-04-25T02:17:33.629432+0000","last_unstale":"2024-04-25T02:17:34.642543+0000","last_undegraded":"2024-04-25T02:17:34.642543+0000","last_fullsized":"2024-04-25T02:17:34.642543+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:11.695562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.636310+0000","last_change":"2024-04-25T02:17:34.634263+0000","last_active":"2024-04-25T02:17:34.636310+0000","last_peered":"2024-04-25T02:17:34.636310+0000","last_clean":"2024-04-25T02:17:34.636310+0000","last_became_active":"2024-04-25T02:17:34.633728+0000","last_became_peered":"2024-04-25T02:17:34.633728+0000","last_unstale":"2024-04-25T02:17:34.636310+0000","last_undegraded":"2024-04-25T02:17:34.636310+0000","last_fullsized":"2024-04-25T02:17:34.636310+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:19.203503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630145+0000","last_change":"2024-04-25T02:17:33.634765+0000","last_active":"2024-04-25T02:17:35.630145+0000","last_peered":"2024-04-25T02:17:35.630145+0000","last_clean":"2024-04-25T02:17:35.630145+0000","last_became_active":"2024-04-25T02:17:33.634386+0000","last_became_peered":"2024-04-25T02:17:33.634386+0000","last_unstale":"2024-04-25T02:17:35.630145+0000","last_undegraded":"2024-04-25T02:17:35.630145+0000","last_fullsized":"2024-04-25T02:17:35.630145+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:27:22.455792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":343,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832247+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:17:35.832247+0000","last_peered":"2024-04-25T02:17:35.832247+0000","last_clean":"2024-04-25T02:17:35.832247+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:17:35.832247+0000","last_undegraded":"2024-04-25T02:17:35.832247+0000","last_fullsized":"2024-04-25T02:17:35.832247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574969,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2031616,"data_stored":1210261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574969,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1421312,"data_stored":613047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574969,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1437696,"data_stored":619881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574970,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1417216,"data_stored":612977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":614659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574969,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1429504,"data_stored":619277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1425408,"data_stored":613101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574969,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2031616,"data_stored":1205069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:17:37.886 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:17:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.013+0000 7fd2db49a640 1 Processor -- start 2024-04-25T02:17:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.014+0000 7fd2db49a640 1 -- start start 2024-04-25T02:17:38.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.014+0000 7fd2db49a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd2d4143bc0 0x7fd2d415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.014+0000 7fd2db49a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2d40b3d40 0x7fd2d406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.014+0000 7fd2db49a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d415fa40 con 0x7fd2d406df50 2024-04-25T02:17:38.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.014+0000 7fd2db49a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd2d406e8f0 con 0x7fd2d4143bc0 2024-04-25T02:17:38.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.014+0000 7fd2db49a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d4072cb0 con 0x7fd2d40b3d40 2024-04-25T02:17:38.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d8a35640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd2d406df50 0x7fd2d40b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57734/0 (socket says 172.21.15.79:57734) 2024-04-25T02:17:38.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d8a35640 1 -- 172.21.15.79:0/186480327 learned_addr learned my addr 172.21.15.79:0/186480327 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:38.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 -- 172.21.15.79:0/186480327 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 621418152 0 0) 0x7fd2c8001110 con 0x7fd2d406df50 2024-04-25T02:17:38.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 -- 172.21.15.79:0/186480327 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2bc003520 con 0x7fd2d406df50 2024-04-25T02:17:38.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d9236640 1 --2- 172.21.15.79:0/186480327 >> v2:172.21.15.189:3300/0 conn(0x7fd2d4143bc0 0x7fd2d415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d9a37640 1 --2- 172.21.15.79:0/186480327 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2d40b3d40 0x7fd2d406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 -- 172.21.15.79:0/186480327 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 981732253 0 0) 0x7fd2bc003520 con 0x7fd2d406df50 2024-04-25T02:17:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 -- 172.21.15.79:0/186480327 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2d40b3d40 msgr2=0x7fd2d406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 --2- 172.21.15.79:0/186480327 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2d40b3d40 0x7fd2d406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 -- 172.21.15.79:0/186480327 >> v2:172.21.15.189:3300/0 conn(0x7fd2d4143bc0 msgr2=0x7fd2d415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 --2- 172.21.15.79:0/186480327 >> v2:172.21.15.189:3300/0 conn(0x7fd2d4143bc0 0x7fd2d415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 -- 172.21.15.79:0/186480327 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d4071e00 con 0x7fd2d406df50 2024-04-25T02:17:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 -- 172.21.15.79:0/186480327 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fd2c8001840 con 0x7fd2d406df50 2024-04-25T02:17:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 -- 172.21.15.79:0/186480327 >> v1:172.21.15.79:6789/0 conn(0x7fd2d406df50 legacy=0x7fd2d40b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 --2- 172.21.15.79:0/186480327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2bc0039b0 0x7fd2bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 --2- 172.21.15.79:0/186480327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2bc004800 0x7fd2bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 --2- 172.21.15.79:0/186480327 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2d40b3d40 0x7fd2bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 -- 172.21.15.79:0/186480327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d4072cb0 con 0x7fd2bc004800 2024-04-25T02:17:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 -- 172.21.15.79:0/186480327 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc00b9c0 con 0x7fd2bc0039b0 2024-04-25T02:17:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d3fff640 1 -- 172.21.15.79:0/186480327 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd2bc00bbc0 con 0x7fd2d40b3d40 2024-04-25T02:17:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d8a35640 1 --2- 172.21.15.79:0/186480327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2bc004800 0x7fd2bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d9236640 1 --2- 172.21.15.79:0/186480327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2bc0039b0 0x7fd2bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.015+0000 7fd2d9a37640 1 --2- 172.21.15.79:0/186480327 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2d40b3d40 0x7fd2bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.016+0000 7fd2d8a35640 1 -- 172.21.15.79:0/186480327 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2d40b3d40 msgr2=0x7fd2bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.016+0000 7fd2d8a35640 1 --2- 172.21.15.79:0/186480327 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2d40b3d40 0x7fd2bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.016+0000 7fd2d8a35640 1 -- 172.21.15.79:0/186480327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2bc0039b0 msgr2=0x7fd2bc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.016+0000 7fd2d8a35640 1 --2- 172.21.15.79:0/186480327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2bc0039b0 0x7fd2bc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.016+0000 7fd2d8a35640 1 -- 172.21.15.79:0/186480327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc003520 con 0x7fd2bc004800 2024-04-25T02:17:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.016+0000 7fd2d8a35640 1 --2- 172.21.15.79:0/186480327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2bc004800 0x7fd2bc004c80 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c320 tx=0x7fd2bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458c40a75fa17335 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.016+0000 7fd2d3fff640 1 -- 172.21.15.79:0/186480327 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8007e60 con 0x7fd2bc004800 2024-04-25T02:17:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.016+0000 7fd2d3fff640 1 -- 172.21.15.79:0/186480327 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c8034070 con 0x7fd2bc004800 2024-04-25T02:17:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.016+0000 7fd2d3fff640 1 -- 172.21.15.79:0/186480327 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8005d10 con 0x7fd2bc004800 2024-04-25T02:17:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.017+0000 7fd2db49a640 1 -- 172.21.15.79:0/186480327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2bc004800 msgr2=0x7fd2bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.017+0000 7fd2db49a640 1 --2- 172.21.15.79:0/186480327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2bc004800 0x7fd2bc004c80 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c320 tx=0x7fd2bc005830 comp rx=0 tx=0).stop 2024-04-25T02:17:38.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.017+0000 7fd2d9a37640 1 -- 172.21.15.79:0/186480327 reap_dead start 2024-04-25T02:17:38.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.017+0000 7fd2db49a640 1 -- 172.21.15.79:0/186480327 shutdown_connections 2024-04-25T02:17:38.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.017+0000 7fd2db49a640 1 -- 172.21.15.79:0/186480327 >> 172.21.15.79:0/186480327 conn(0x7fd2d40cfc80 msgr2=0x7fd2d40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:38.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.017+0000 7fd2db49a640 1 -- 172.21.15.79:0/186480327 shutdown_connections 2024-04-25T02:17:38.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.017+0000 7fd2db49a640 1 -- 172.21.15.79:0/186480327 wait complete. 2024-04-25T02:17:38.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.018+0000 7fd2db49a640 1 Processor -- start 2024-04-25T02:17:38.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.018+0000 7fd2db49a640 1 -- start start 2024-04-25T02:17:38.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2db49a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2bc004800 0x7fd2d413f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2db49a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2d41412d0 0x7fd2d4141750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2db49a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2d40b4430 0x7fd2d40b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2db49a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d4072660 con 0x7fd2d41412d0 2024-04-25T02:17:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2db49a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d4072380 con 0x7fd2bc004800 2024-04-25T02:17:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2db49a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d4072940 con 0x7fd2d40b4430 2024-04-25T02:17:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2d8a35640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2d41412d0 0x7fd2d4141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2d8a35640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2d41412d0 0x7fd2d4141750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48166/0 (socket says 172.21.15.79:48166) 2024-04-25T02:17:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2d8a35640 1 -- 172.21.15.79:0/3115793754 learned_addr learned my addr 172.21.15.79:0/3115793754 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2d9a37640 1 --2- 172.21.15.79:0/3115793754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2d40b4430 0x7fd2d40b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2d9236640 1 --2- 172.21.15.79:0/3115793754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2bc004800 0x7fd2d413f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2d8a35640 1 -- 172.21.15.79:0/3115793754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2d40b4430 msgr2=0x7fd2d40b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2d8a35640 1 --2- 172.21.15.79:0/3115793754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2d40b4430 0x7fd2d40b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2d8a35640 1 -- 172.21.15.79:0/3115793754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2bc004800 msgr2=0x7fd2d413f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2d8a35640 1 --2- 172.21.15.79:0/3115793754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2bc004800 0x7fd2d413f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2d8a35640 1 -- 172.21.15.79:0/3115793754 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d40ae910 con 0x7fd2d41412d0 2024-04-25T02:17:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2d9a37640 1 --2- 172.21.15.79:0/3115793754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2d40b4430 0x7fd2d40b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:38.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2d8a35640 1 --2- 172.21.15.79:0/3115793754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2d41412d0 0x7fd2d4141750 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c410 tx=0x7fd2c8001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:38.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2d1ffb640 1 -- 172.21.15.79:0/3115793754 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8007e60 con 0x7fd2d41412d0 2024-04-25T02:17:38.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2d1ffb640 1 -- 172.21.15.79:0/3115793754 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c8007480 con 0x7fd2d41412d0 2024-04-25T02:17:38.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.019+0000 7fd2d1ffb640 1 -- 172.21.15.79:0/3115793754 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c803b420 con 0x7fd2d41412d0 2024-04-25T02:17:38.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.020+0000 7fd2db49a640 1 -- 172.21.15.79:0/3115793754 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d40aebf0 con 0x7fd2d41412d0 2024-04-25T02:17:38.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.020+0000 7fd2db49a640 1 -- 172.21.15.79:0/3115793754 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d40af1b0 con 0x7fd2d41412d0 2024-04-25T02:17:38.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.021+0000 7fd2db49a640 1 -- 172.21.15.79:0/3115793754 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d40690a0 con 0x7fd2d41412d0 2024-04-25T02:17:38.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.021+0000 7fd2d1ffb640 1 -- 172.21.15.79:0/3115793754 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2c803b5c0 con 0x7fd2d41412d0 2024-04-25T02:17:38.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.021+0000 7fd2d1ffb640 1 --2- 172.21.15.79:0/3115793754 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd2c006be30 0x7fd2c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.022+0000 7fd2d1ffb640 1 -- 172.21.15.79:0/3115793754 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7fd2c80abde0 con 0x7fd2d41412d0 2024-04-25T02:17:38.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.022+0000 7fd2d9236640 1 --2- 172.21.15.79:0/3115793754 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd2c006be30 0x7fd2c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.022+0000 7fd2d9236640 1 --2- 172.21.15.79:0/3115793754 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd2c006be30 0x7fd2c006e2f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc009fd0 tx=0x7fd2cc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:38.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.026+0000 7fd2d1ffb640 1 -- 172.21.15.79:0/3115793754 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd2c8049030 con 0x7fd2d41412d0 2024-04-25T02:17:38.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.196+0000 7fd2db49a640 1 -- 172.21.15.79:0/3115793754 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2d40b3990 con 0x7fd2c006be30 2024-04-25T02:17:38.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.202+0000 7fd2d1ffb640 1 -- 172.21.15.79:0/3115793754 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252446 (secure 0 0 0) 0x7fd2d40b3990 con 0x7fd2c006be30 2024-04-25T02:17:38.209 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:38.210 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:17:38.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.205+0000 7fd2db49a640 1 -- 172.21.15.79:0/3115793754 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd2c006be30 msgr2=0x7fd2c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.205+0000 7fd2db49a640 1 --2- 172.21.15.79:0/3115793754 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd2c006be30 0x7fd2c006e2f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc009fd0 tx=0x7fd2cc00b040 comp rx=0 tx=0).stop 2024-04-25T02:17:38.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.205+0000 7fd2db49a640 1 -- 172.21.15.79:0/3115793754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2d41412d0 msgr2=0x7fd2d4141750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.205+0000 7fd2db49a640 1 --2- 172.21.15.79:0/3115793754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2d41412d0 0x7fd2d4141750 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c410 tx=0x7fd2c8001b40 comp rx=0 tx=0).stop 2024-04-25T02:17:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.205+0000 7fd2db49a640 1 -- 172.21.15.79:0/3115793754 shutdown_connections 2024-04-25T02:17:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.205+0000 7fd2db49a640 1 --2- 172.21.15.79:0/3115793754 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd2c006be30 0x7fd2c006e2f0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.205+0000 7fd2db49a640 1 --2- 172.21.15.79:0/3115793754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2d40b4430 0x7fd2d40b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.205+0000 7fd2db49a640 1 --2- 172.21.15.79:0/3115793754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2d41412d0 0x7fd2d4141750 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.205+0000 7fd2db49a640 1 --2- 172.21.15.79:0/3115793754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2bc004800 0x7fd2d413f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.205+0000 7fd2db49a640 1 -- 172.21.15.79:0/3115793754 >> 172.21.15.79:0/3115793754 conn(0x7fd2d40cfc80 msgr2=0x7fd2d4142cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.205+0000 7fd2db49a640 1 -- 172.21.15.79:0/3115793754 shutdown_connections 2024-04-25T02:17:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.205+0000 7fd2db49a640 1 -- 172.21.15.79:0/3115793754 wait complete. 2024-04-25T02:17:38.220 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":404,"stamp":"2024-04-25T02:17:37.303270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261792,"kb_used_data":12332,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712928,"statfs":{"total":773094113280,"available":772826038272,"internally_reserved":0,"allocated":12627968,"data_stored":6108272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.698065"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.652725+0000","last_change":"2024-04-25T02:17:34.647385+0000","last_active":"2024-04-25T02:17:34.652725+0000","last_peered":"2024-04-25T02:17:34.652725+0000","last_clean":"2024-04-25T02:17:34.652725+0000","last_became_active":"2024-04-25T02:17:34.646884+0000","last_became_peered":"2024-04-25T02:17:34.646884+0000","last_unstale":"2024-04-25T02:17:34.652725+0000","last_undegraded":"2024-04-25T02:17:34.652725+0000","last_fullsized":"2024-04-25T02:17:34.652725+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:21.036012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631532+0000","last_change":"2024-04-25T02:17:34.632316+0000","last_active":"2024-04-25T02:17:35.631532+0000","last_peered":"2024-04-25T02:17:35.631532+0000","last_clean":"2024-04-25T02:17:35.631532+0000","last_became_active":"2024-04-25T02:17:34.631583+0000","last_became_peered":"2024-04-25T02:17:34.631583+0000","last_unstale":"2024-04-25T02:17:35.631532+0000","last_undegraded":"2024-04-25T02:17:35.631532+0000","last_fullsized":"2024-04-25T02:17:35.631532+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:15.544599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832217+0000","last_change":"2024-04-25T02:17:34.636042+0000","last_active":"2024-04-25T02:17:35.832217+0000","last_peered":"2024-04-25T02:17:35.832217+0000","last_clean":"2024-04-25T02:17:35.832217+0000","last_became_active":"2024-04-25T02:17:34.635187+0000","last_became_peered":"2024-04-25T02:17:34.635187+0000","last_unstale":"2024-04-25T02:17:35.832217+0000","last_undegraded":"2024-04-25T02:17:35.832217+0000","last_fullsized":"2024-04-25T02:17:35.832217+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:03.216864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647507+0000","last_change":"2024-04-25T02:17:34.641094+0000","last_active":"2024-04-25T02:17:34.647507+0000","last_peered":"2024-04-25T02:17:34.647507+0000","last_clean":"2024-04-25T02:17:34.647507+0000","last_became_active":"2024-04-25T02:17:34.640738+0000","last_became_peered":"2024-04-25T02:17:34.640738+0000","last_unstale":"2024-04-25T02:17:34.647507+0000","last_undegraded":"2024-04-25T02:17:34.647507+0000","last_fullsized":"2024-04-25T02:17:34.647507+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:56.249428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626281+0000","last_change":"2024-04-25T02:17:34.625750+0000","last_active":"2024-04-25T02:17:35.626281+0000","last_peered":"2024-04-25T02:17:35.626281+0000","last_clean":"2024-04-25T02:17:35.626281+0000","last_became_active":"2024-04-25T02:17:34.625323+0000","last_became_peered":"2024-04-25T02:17:34.625323+0000","last_unstale":"2024-04-25T02:17:35.626281+0000","last_undegraded":"2024-04-25T02:17:35.626281+0000","last_fullsized":"2024-04-25T02:17:35.626281+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:54.939558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.627902+0000","last_change":"2024-04-25T02:17:34.626086+0000","last_active":"2024-04-25T02:17:34.627902+0000","last_peered":"2024-04-25T02:17:34.627902+0000","last_clean":"2024-04-25T02:17:34.627902+0000","last_became_active":"2024-04-25T02:17:34.625819+0000","last_became_peered":"2024-04-25T02:17:34.625819+0000","last_unstale":"2024-04-25T02:17:34.627902+0000","last_undegraded":"2024-04-25T02:17:34.627902+0000","last_fullsized":"2024-04-25T02:17:34.627902+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:12.876906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630361+0000","last_change":"2024-04-25T02:17:34.625112+0000","last_active":"2024-04-25T02:17:35.630361+0000","last_peered":"2024-04-25T02:17:35.630361+0000","last_clean":"2024-04-25T02:17:35.630361+0000","last_became_active":"2024-04-25T02:17:34.624713+0000","last_became_peered":"2024-04-25T02:17:34.624713+0000","last_unstale":"2024-04-25T02:17:35.630361+0000","last_undegraded":"2024-04-25T02:17:35.630361+0000","last_fullsized":"2024-04-25T02:17:35.630361+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:38.679764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832131+0000","last_change":"2024-04-25T02:17:34.631993+0000","last_active":"2024-04-25T02:17:35.832131+0000","last_peered":"2024-04-25T02:17:35.832131+0000","last_clean":"2024-04-25T02:17:35.832131+0000","last_became_active":"2024-04-25T02:17:34.631666+0000","last_became_peered":"2024-04-25T02:17:34.631666+0000","last_unstale":"2024-04-25T02:17:35.832131+0000","last_undegraded":"2024-04-25T02:17:35.832131+0000","last_fullsized":"2024-04-25T02:17:35.832131+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:15.684872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.652681+0000","last_change":"2024-04-25T02:17:34.647119+0000","last_active":"2024-04-25T02:17:34.652681+0000","last_peered":"2024-04-25T02:17:34.652681+0000","last_clean":"2024-04-25T02:17:34.652681+0000","last_became_active":"2024-04-25T02:17:34.646617+0000","last_became_peered":"2024-04-25T02:17:34.646617+0000","last_unstale":"2024-04-25T02:17:34.652681+0000","last_undegraded":"2024-04-25T02:17:34.652681+0000","last_fullsized":"2024-04-25T02:17:34.652681+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:13.067710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.650151+0000","last_change":"2024-04-25T02:17:34.645388+0000","last_active":"2024-04-25T02:17:34.650151+0000","last_peered":"2024-04-25T02:17:34.650151+0000","last_clean":"2024-04-25T02:17:34.650151+0000","last_became_active":"2024-04-25T02:17:34.644999+0000","last_became_peered":"2024-04-25T02:17:34.644999+0000","last_unstale":"2024-04-25T02:17:34.650151+0000","last_undegraded":"2024-04-25T02:17:34.650151+0000","last_fullsized":"2024-04-25T02:17:34.650151+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:49:44.765303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631455+0000","last_change":"2024-04-25T02:17:34.633182+0000","last_active":"2024-04-25T02:17:35.631455+0000","last_peered":"2024-04-25T02:17:35.631455+0000","last_clean":"2024-04-25T02:17:35.631455+0000","last_became_active":"2024-04-25T02:17:34.632889+0000","last_became_peered":"2024-04-25T02:17:34.632889+0000","last_unstale":"2024-04-25T02:17:35.631455+0000","last_undegraded":"2024-04-25T02:17:35.631455+0000","last_fullsized":"2024-04-25T02:17:35.631455+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:29:46.553410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647525+0000","last_change":"2024-04-25T02:17:34.642050+0000","last_active":"2024-04-25T02:17:34.647525+0000","last_peered":"2024-04-25T02:17:34.647525+0000","last_clean":"2024-04-25T02:17:34.647525+0000","last_became_active":"2024-04-25T02:17:34.641759+0000","last_became_peered":"2024-04-25T02:17:34.641759+0000","last_unstale":"2024-04-25T02:17:34.647525+0000","last_undegraded":"2024-04-25T02:17:34.647525+0000","last_fullsized":"2024-04-25T02:17:34.647525+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:19:27.046272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832095+0000","last_change":"2024-04-25T02:17:34.637512+0000","last_active":"2024-04-25T02:17:35.832095+0000","last_peered":"2024-04-25T02:17:35.832095+0000","last_clean":"2024-04-25T02:17:35.832095+0000","last_became_active":"2024-04-25T02:17:34.637171+0000","last_became_peered":"2024-04-25T02:17:34.637171+0000","last_unstale":"2024-04-25T02:17:35.832095+0000","last_undegraded":"2024-04-25T02:17:35.832095+0000","last_fullsized":"2024-04-25T02:17:35.832095+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:25.490834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.831920+0000","last_change":"2024-04-25T02:17:34.634642+0000","last_active":"2024-04-25T02:17:35.831920+0000","last_peered":"2024-04-25T02:17:35.831920+0000","last_clean":"2024-04-25T02:17:35.831920+0000","last_became_active":"2024-04-25T02:17:34.634332+0000","last_became_peered":"2024-04-25T02:17:34.634332+0000","last_unstale":"2024-04-25T02:17:35.831920+0000","last_undegraded":"2024-04-25T02:17:35.831920+0000","last_fullsized":"2024-04-25T02:17:35.831920+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:15.544599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.642662+0000","last_change":"2024-04-25T02:17:34.638776+0000","last_active":"2024-04-25T02:17:34.642662+0000","last_peered":"2024-04-25T02:17:34.642662+0000","last_clean":"2024-04-25T02:17:34.642662+0000","last_became_active":"2024-04-25T02:17:34.638457+0000","last_became_peered":"2024-04-25T02:17:34.638457+0000","last_unstale":"2024-04-25T02:17:34.642662+0000","last_undegraded":"2024-04-25T02:17:34.642662+0000","last_fullsized":"2024-04-25T02:17:34.642662+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:02.647111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.650113+0000","last_change":"2024-04-25T02:17:34.645506+0000","last_active":"2024-04-25T02:17:34.650113+0000","last_peered":"2024-04-25T02:17:34.650113+0000","last_clean":"2024-04-25T02:17:34.650113+0000","last_became_active":"2024-04-25T02:17:34.645038+0000","last_became_peered":"2024-04-25T02:17:34.645038+0000","last_unstale":"2024-04-25T02:17:34.650113+0000","last_undegraded":"2024-04-25T02:17:34.650113+0000","last_fullsized":"2024-04-25T02:17:34.650113+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:47.410031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631594+0000","last_change":"2024-04-25T02:17:34.634800+0000","last_active":"2024-04-25T02:17:35.631594+0000","last_peered":"2024-04-25T02:17:35.631594+0000","last_clean":"2024-04-25T02:17:35.631594+0000","last_became_active":"2024-04-25T02:17:34.634551+0000","last_became_peered":"2024-04-25T02:17:34.634551+0000","last_unstale":"2024-04-25T02:17:35.631594+0000","last_undegraded":"2024-04-25T02:17:35.631594+0000","last_fullsized":"2024-04-25T02:17:35.631594+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:19.203503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.639601+0000","last_change":"2024-04-25T02:17:34.638731+0000","last_active":"2024-04-25T02:17:34.639601+0000","last_peered":"2024-04-25T02:17:34.639601+0000","last_clean":"2024-04-25T02:17:34.639601+0000","last_became_active":"2024-04-25T02:17:34.637119+0000","last_became_peered":"2024-04-25T02:17:34.637119+0000","last_unstale":"2024-04-25T02:17:34.639601+0000","last_undegraded":"2024-04-25T02:17:34.639601+0000","last_fullsized":"2024-04-25T02:17:34.639601+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:46.502887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832351+0000","last_change":"2024-04-25T02:17:34.636868+0000","last_active":"2024-04-25T02:17:35.832351+0000","last_peered":"2024-04-25T02:17:35.832351+0000","last_clean":"2024-04-25T02:17:35.832351+0000","last_became_active":"2024-04-25T02:17:34.636609+0000","last_became_peered":"2024-04-25T02:17:34.636609+0000","last_unstale":"2024-04-25T02:17:35.832351+0000","last_undegraded":"2024-04-25T02:17:35.832351+0000","last_fullsized":"2024-04-25T02:17:35.832351+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:20.830323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631610+0000","last_change":"2024-04-25T02:17:34.630501+0000","last_active":"2024-04-25T02:17:35.631610+0000","last_peered":"2024-04-25T02:17:35.631610+0000","last_clean":"2024-04-25T02:17:35.631610+0000","last_became_active":"2024-04-25T02:17:34.630233+0000","last_became_peered":"2024-04-25T02:17:34.630233+0000","last_unstale":"2024-04-25T02:17:35.631610+0000","last_undegraded":"2024-04-25T02:17:35.631610+0000","last_fullsized":"2024-04-25T02:17:35.631610+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:02.174445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631783+0000","last_change":"2024-04-25T02:17:34.629075+0000","last_active":"2024-04-25T02:17:35.631783+0000","last_peered":"2024-04-25T02:17:35.631783+0000","last_clean":"2024-04-25T02:17:35.631783+0000","last_became_active":"2024-04-25T02:17:34.628498+0000","last_became_peered":"2024-04-25T02:17:34.628498+0000","last_unstale":"2024-04-25T02:17:35.631783+0000","last_undegraded":"2024-04-25T02:17:35.631783+0000","last_fullsized":"2024-04-25T02:17:35.631783+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:43.811948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.639184+0000","last_change":"2024-04-25T02:17:34.635681+0000","last_active":"2024-04-25T02:17:34.639184+0000","last_peered":"2024-04-25T02:17:34.639184+0000","last_clean":"2024-04-25T02:17:34.639184+0000","last_became_active":"2024-04-25T02:17:34.635414+0000","last_became_peered":"2024-04-25T02:17:34.635414+0000","last_unstale":"2024-04-25T02:17:34.639184+0000","last_undegraded":"2024-04-25T02:17:34.639184+0000","last_fullsized":"2024-04-25T02:17:34.639184+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:15.684872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631204+0000","last_change":"2024-04-25T02:17:34.629783+0000","last_active":"2024-04-25T02:17:35.631204+0000","last_peered":"2024-04-25T02:17:35.631204+0000","last_clean":"2024-04-25T02:17:35.631204+0000","last_became_active":"2024-04-25T02:17:34.629408+0000","last_became_peered":"2024-04-25T02:17:34.629408+0000","last_unstale":"2024-04-25T02:17:35.631204+0000","last_undegraded":"2024-04-25T02:17:35.631204+0000","last_fullsized":"2024-04-25T02:17:35.631204+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:59.772980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.636290+0000","last_change":"2024-04-25T02:17:34.634029+0000","last_active":"2024-04-25T02:17:34.636290+0000","last_peered":"2024-04-25T02:17:34.636290+0000","last_clean":"2024-04-25T02:17:34.636290+0000","last_became_active":"2024-04-25T02:17:34.633697+0000","last_became_peered":"2024-04-25T02:17:34.633697+0000","last_unstale":"2024-04-25T02:17:34.636290+0000","last_undegraded":"2024-04-25T02:17:34.636290+0000","last_fullsized":"2024-04-25T02:17:34.636290+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:36:38.389254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631720+0000","last_change":"2024-04-25T02:17:34.634249+0000","last_active":"2024-04-25T02:17:35.631720+0000","last_peered":"2024-04-25T02:17:35.631720+0000","last_clean":"2024-04-25T02:17:35.631720+0000","last_became_active":"2024-04-25T02:17:34.633985+0000","last_became_peered":"2024-04-25T02:17:34.633985+0000","last_unstale":"2024-04-25T02:17:35.631720+0000","last_undegraded":"2024-04-25T02:17:35.631720+0000","last_fullsized":"2024-04-25T02:17:35.631720+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:15.684872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647329+0000","last_change":"2024-04-25T02:17:34.639912+0000","last_active":"2024-04-25T02:17:34.647329+0000","last_peered":"2024-04-25T02:17:34.647329+0000","last_clean":"2024-04-25T02:17:34.647329+0000","last_became_active":"2024-04-25T02:17:34.639665+0000","last_became_peered":"2024-04-25T02:17:34.639665+0000","last_unstale":"2024-04-25T02:17:34.647329+0000","last_undegraded":"2024-04-25T02:17:34.647329+0000","last_fullsized":"2024-04-25T02:17:34.647329+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:20.830323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.652690+0000","last_change":"2024-04-25T02:17:34.646380+0000","last_active":"2024-04-25T02:17:34.652690+0000","last_peered":"2024-04-25T02:17:34.652690+0000","last_clean":"2024-04-25T02:17:34.652690+0000","last_became_active":"2024-04-25T02:17:34.646103+0000","last_became_peered":"2024-04-25T02:17:34.646103+0000","last_unstale":"2024-04-25T02:17:34.652690+0000","last_undegraded":"2024-04-25T02:17:34.652690+0000","last_fullsized":"2024-04-25T02:17:34.652690+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:24:25.441243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.650225+0000","last_change":"2024-04-25T02:17:34.643163+0000","last_active":"2024-04-25T02:17:34.650225+0000","last_peered":"2024-04-25T02:17:34.650225+0000","last_clean":"2024-04-25T02:17:34.650225+0000","last_became_active":"2024-04-25T02:17:34.642907+0000","last_became_peered":"2024-04-25T02:17:34.642907+0000","last_unstale":"2024-04-25T02:17:34.650225+0000","last_undegraded":"2024-04-25T02:17:34.650225+0000","last_fullsized":"2024-04-25T02:17:34.650225+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:03.216864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631498+0000","last_change":"2024-04-25T02:17:34.629314+0000","last_active":"2024-04-25T02:17:35.631498+0000","last_peered":"2024-04-25T02:17:35.631498+0000","last_clean":"2024-04-25T02:17:35.631498+0000","last_became_active":"2024-04-25T02:17:34.628882+0000","last_became_peered":"2024-04-25T02:17:34.628882+0000","last_unstale":"2024-04-25T02:17:35.631498+0000","last_undegraded":"2024-04-25T02:17:35.631498+0000","last_fullsized":"2024-04-25T02:17:35.631498+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:00.226145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630367+0000","last_change":"2024-04-25T02:17:34.629958+0000","last_active":"2024-04-25T02:17:35.630367+0000","last_peered":"2024-04-25T02:17:35.630367+0000","last_clean":"2024-04-25T02:17:35.630367+0000","last_became_active":"2024-04-25T02:17:34.629635+0000","last_became_peered":"2024-04-25T02:17:34.629635+0000","last_unstale":"2024-04-25T02:17:35.630367+0000","last_undegraded":"2024-04-25T02:17:35.630367+0000","last_fullsized":"2024-04-25T02:17:35.630367+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:10.623773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647457+0000","last_change":"2024-04-25T02:17:34.640937+0000","last_active":"2024-04-25T02:17:34.647457+0000","last_peered":"2024-04-25T02:17:34.647457+0000","last_clean":"2024-04-25T02:17:34.647457+0000","last_became_active":"2024-04-25T02:17:34.640309+0000","last_became_peered":"2024-04-25T02:17:34.640309+0000","last_unstale":"2024-04-25T02:17:34.647457+0000","last_undegraded":"2024-04-25T02:17:34.647457+0000","last_fullsized":"2024-04-25T02:17:34.647457+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:08.680050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.627689+0000","last_change":"2024-04-25T02:17:34.625611+0000","last_active":"2024-04-25T02:17:34.627689+0000","last_peered":"2024-04-25T02:17:34.627689+0000","last_clean":"2024-04-25T02:17:34.627689+0000","last_became_active":"2024-04-25T02:17:34.625356+0000","last_became_peered":"2024-04-25T02:17:34.625356+0000","last_unstale":"2024-04-25T02:17:34.627689+0000","last_undegraded":"2024-04-25T02:17:34.627689+0000","last_fullsized":"2024-04-25T02:17:34.627689+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:27:23.463083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.630199+0000","last_change":"2024-04-25T02:17:34.627802+0000","last_active":"2024-04-25T02:17:34.630199+0000","last_peered":"2024-04-25T02:17:34.630199+0000","last_clean":"2024-04-25T02:17:34.630199+0000","last_became_active":"2024-04-25T02:17:34.627477+0000","last_became_peered":"2024-04-25T02:17:34.627477+0000","last_unstale":"2024-04-25T02:17:34.630199+0000","last_undegraded":"2024-04-25T02:17:34.630199+0000","last_fullsized":"2024-04-25T02:17:34.630199+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:11.625103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"114'4","reported_seq":18,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630354+0000","last_change":"2024-04-25T02:17:33.623117+0000","last_active":"2024-04-25T02:17:35.630354+0000","last_peered":"2024-04-25T02:17:35.630354+0000","last_clean":"2024-04-25T02:17:35.630354+0000","last_became_active":"2024-04-25T02:17:33.622690+0000","last_became_peered":"2024-04-25T02:17:33.622690+0000","last_unstale":"2024-04-25T02:17:35.630354+0000","last_undegraded":"2024-04-25T02:17:35.630354+0000","last_fullsized":"2024-04-25T02:17:35.630354+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:33.051294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.633591+0000","last_change":"2024-04-25T02:17:34.632297+0000","last_active":"2024-04-25T02:17:34.633591+0000","last_peered":"2024-04-25T02:17:34.633591+0000","last_clean":"2024-04-25T02:17:34.633591+0000","last_became_active":"2024-04-25T02:17:34.632032+0000","last_became_peered":"2024-04-25T02:17:34.632032+0000","last_unstale":"2024-04-25T02:17:34.633591+0000","last_undegraded":"2024-04-25T02:17:34.633591+0000","last_fullsized":"2024-04-25T02:17:34.633591+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:59.772980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832092+0000","last_change":"2024-04-25T02:17:33.627622+0000","last_active":"2024-04-25T02:17:35.832092+0000","last_peered":"2024-04-25T02:17:35.832092+0000","last_clean":"2024-04-25T02:17:35.832092+0000","last_became_active":"2024-04-25T02:17:33.627296+0000","last_became_peered":"2024-04-25T02:17:33.627296+0000","last_unstale":"2024-04-25T02:17:35.832092+0000","last_undegraded":"2024-04-25T02:17:35.832092+0000","last_fullsized":"2024-04-25T02:17:35.832092+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:49.051553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.630235+0000","last_change":"2024-04-25T02:17:34.628360+0000","last_active":"2024-04-25T02:17:34.630235+0000","last_peered":"2024-04-25T02:17:34.630235+0000","last_clean":"2024-04-25T02:17:34.630235+0000","last_became_active":"2024-04-25T02:17:34.628104+0000","last_became_peered":"2024-04-25T02:17:34.628104+0000","last_unstale":"2024-04-25T02:17:34.630235+0000","last_undegraded":"2024-04-25T02:17:34.630235+0000","last_fullsized":"2024-04-25T02:17:34.630235+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:34.058584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626260+0000","last_change":"2024-04-25T02:17:33.626397+0000","last_active":"2024-04-25T02:17:35.626260+0000","last_peered":"2024-04-25T02:17:35.626260+0000","last_clean":"2024-04-25T02:17:35.626260+0000","last_became_active":"2024-04-25T02:17:33.626114+0000","last_became_peered":"2024-04-25T02:17:33.626114+0000","last_unstale":"2024-04-25T02:17:35.626260+0000","last_undegraded":"2024-04-25T02:17:35.626260+0000","last_fullsized":"2024-04-25T02:17:35.626260+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:23.196019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832318+0000","last_change":"2024-04-25T02:17:34.638317+0000","last_active":"2024-04-25T02:17:35.832318+0000","last_peered":"2024-04-25T02:17:35.832318+0000","last_clean":"2024-04-25T02:17:35.832318+0000","last_became_active":"2024-04-25T02:17:34.637799+0000","last_became_peered":"2024-04-25T02:17:34.637799+0000","last_unstale":"2024-04-25T02:17:35.832318+0000","last_undegraded":"2024-04-25T02:17:35.832318+0000","last_fullsized":"2024-04-25T02:17:35.832318+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:20.759237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626117+0000","last_change":"2024-04-25T02:17:33.626195+0000","last_active":"2024-04-25T02:17:35.626117+0000","last_peered":"2024-04-25T02:17:35.626117+0000","last_clean":"2024-04-25T02:17:35.626117+0000","last_became_active":"2024-04-25T02:17:33.625881+0000","last_became_peered":"2024-04-25T02:17:33.625881+0000","last_unstale":"2024-04-25T02:17:35.626117+0000","last_undegraded":"2024-04-25T02:17:35.626117+0000","last_fullsized":"2024-04-25T02:17:35.626117+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:26:27.978999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647258+0000","last_change":"2024-04-25T02:17:34.640582+0000","last_active":"2024-04-25T02:17:34.647258+0000","last_peered":"2024-04-25T02:17:34.647258+0000","last_clean":"2024-04-25T02:17:34.647258+0000","last_became_active":"2024-04-25T02:17:34.640315+0000","last_became_peered":"2024-04-25T02:17:34.640315+0000","last_unstale":"2024-04-25T02:17:34.647258+0000","last_undegraded":"2024-04-25T02:17:34.647258+0000","last_fullsized":"2024-04-25T02:17:34.647258+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:50.531665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630073+0000","last_change":"2024-04-25T02:17:33.625581+0000","last_active":"2024-04-25T02:17:35.630073+0000","last_peered":"2024-04-25T02:17:35.630073+0000","last_clean":"2024-04-25T02:17:35.630073+0000","last_became_active":"2024-04-25T02:17:33.625316+0000","last_became_peered":"2024-04-25T02:17:33.625316+0000","last_unstale":"2024-04-25T02:17:35.630073+0000","last_undegraded":"2024-04-25T02:17:35.630073+0000","last_fullsized":"2024-04-25T02:17:35.630073+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:10.617813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631557+0000","last_change":"2024-04-25T02:17:34.628243+0000","last_active":"2024-04-25T02:17:35.631557+0000","last_peered":"2024-04-25T02:17:35.631557+0000","last_clean":"2024-04-25T02:17:35.631557+0000","last_became_active":"2024-04-25T02:17:34.627965+0000","last_became_peered":"2024-04-25T02:17:34.627965+0000","last_unstale":"2024-04-25T02:17:35.631557+0000","last_undegraded":"2024-04-25T02:17:35.631557+0000","last_fullsized":"2024-04-25T02:17:35.631557+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:36:38.389254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.635156+0000","last_change":"2024-04-25T02:17:33.626960+0000","last_active":"2024-04-25T02:17:34.635156+0000","last_peered":"2024-04-25T02:17:34.635156+0000","last_clean":"2024-04-25T02:17:34.635156+0000","last_became_active":"2024-04-25T02:17:33.626654+0000","last_became_peered":"2024-04-25T02:17:33.626654+0000","last_unstale":"2024-04-25T02:17:34.635156+0000","last_undegraded":"2024-04-25T02:17:34.635156+0000","last_fullsized":"2024-04-25T02:17:34.635156+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:45.495597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.650072+0000","last_change":"2024-04-25T02:17:34.645297+0000","last_active":"2024-04-25T02:17:34.650072+0000","last_peered":"2024-04-25T02:17:34.650072+0000","last_clean":"2024-04-25T02:17:34.650072+0000","last_became_active":"2024-04-25T02:17:34.644734+0000","last_became_peered":"2024-04-25T02:17:34.644734+0000","last_unstale":"2024-04-25T02:17:34.650072+0000","last_undegraded":"2024-04-25T02:17:34.650072+0000","last_fullsized":"2024-04-25T02:17:34.650072+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:09:10.886175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631209+0000","last_change":"2024-04-25T02:17:33.621812+0000","last_active":"2024-04-25T02:17:35.631209+0000","last_peered":"2024-04-25T02:17:35.631209+0000","last_clean":"2024-04-25T02:17:35.631209+0000","last_became_active":"2024-04-25T02:17:33.621492+0000","last_became_peered":"2024-04-25T02:17:33.621492+0000","last_unstale":"2024-04-25T02:17:35.631209+0000","last_undegraded":"2024-04-25T02:17:35.631209+0000","last_fullsized":"2024-04-25T02:17:35.631209+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:11:31.491809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630012+0000","last_change":"2024-04-25T02:17:34.633152+0000","last_active":"2024-04-25T02:17:35.630012+0000","last_peered":"2024-04-25T02:17:35.630012+0000","last_clean":"2024-04-25T02:17:35.630012+0000","last_became_active":"2024-04-25T02:17:34.632882+0000","last_became_peered":"2024-04-25T02:17:34.632882+0000","last_unstale":"2024-04-25T02:17:35.630012+0000","last_undegraded":"2024-04-25T02:17:35.630012+0000","last_fullsized":"2024-04-25T02:17:35.630012+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:11.331429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.640093+0000","last_change":"2024-04-25T02:17:33.630852+0000","last_active":"2024-04-25T02:17:34.640093+0000","last_peered":"2024-04-25T02:17:34.640093+0000","last_clean":"2024-04-25T02:17:34.640093+0000","last_became_active":"2024-04-25T02:17:33.630371+0000","last_became_peered":"2024-04-25T02:17:33.630371+0000","last_unstale":"2024-04-25T02:17:34.640093+0000","last_undegraded":"2024-04-25T02:17:34.640093+0000","last_fullsized":"2024-04-25T02:17:34.640093+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:14:08.779058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630426+0000","last_change":"2024-04-25T02:17:34.629365+0000","last_active":"2024-04-25T02:17:35.630426+0000","last_peered":"2024-04-25T02:17:35.630426+0000","last_clean":"2024-04-25T02:17:35.630426+0000","last_became_active":"2024-04-25T02:17:34.628728+0000","last_became_peered":"2024-04-25T02:17:34.628728+0000","last_unstale":"2024-04-25T02:17:35.630426+0000","last_undegraded":"2024-04-25T02:17:35.630426+0000","last_fullsized":"2024-04-25T02:17:35.630426+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:40:22.632491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626131+0000","last_change":"2024-04-25T02:17:33.626189+0000","last_active":"2024-04-25T02:17:35.626131+0000","last_peered":"2024-04-25T02:17:35.626131+0000","last_clean":"2024-04-25T02:17:35.626131+0000","last_became_active":"2024-04-25T02:17:33.625840+0000","last_became_peered":"2024-04-25T02:17:33.625840+0000","last_unstale":"2024-04-25T02:17:35.626131+0000","last_undegraded":"2024-04-25T02:17:35.626131+0000","last_fullsized":"2024-04-25T02:17:35.626131+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:52:23.230533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.649424+0000","last_change":"2024-04-25T02:17:34.648125+0000","last_active":"2024-04-25T02:17:34.649424+0000","last_peered":"2024-04-25T02:17:34.649424+0000","last_clean":"2024-04-25T02:17:34.649424+0000","last_became_active":"2024-04-25T02:17:34.647834+0000","last_became_peered":"2024-04-25T02:17:34.647834+0000","last_unstale":"2024-04-25T02:17:34.649424+0000","last_undegraded":"2024-04-25T02:17:34.649424+0000","last_fullsized":"2024-04-25T02:17:34.649424+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:15.544599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.621847+0000","last_change":"2024-04-25T02:17:33.627691+0000","last_active":"2024-04-25T02:17:34.621847+0000","last_peered":"2024-04-25T02:17:34.621847+0000","last_clean":"2024-04-25T02:17:34.621847+0000","last_became_active":"2024-04-25T02:17:33.627122+0000","last_became_peered":"2024-04-25T02:17:33.627122+0000","last_unstale":"2024-04-25T02:17:34.621847+0000","last_undegraded":"2024-04-25T02:17:34.621847+0000","last_fullsized":"2024-04-25T02:17:34.621847+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:29:45.546120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.636255+0000","last_change":"2024-04-25T02:17:34.635045+0000","last_active":"2024-04-25T02:17:34.636255+0000","last_peered":"2024-04-25T02:17:34.636255+0000","last_clean":"2024-04-25T02:17:34.636255+0000","last_became_active":"2024-04-25T02:17:34.634758+0000","last_became_peered":"2024-04-25T02:17:34.634758+0000","last_unstale":"2024-04-25T02:17:34.636255+0000","last_undegraded":"2024-04-25T02:17:34.636255+0000","last_fullsized":"2024-04-25T02:17:34.636255+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:02.174445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"114'3","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.644932+0000","last_change":"2024-04-25T02:17:33.633145+0000","last_active":"2024-04-25T02:17:34.644932+0000","last_peered":"2024-04-25T02:17:34.644932+0000","last_clean":"2024-04-25T02:17:34.644932+0000","last_became_active":"2024-04-25T02:17:33.632837+0000","last_became_peered":"2024-04-25T02:17:33.632837+0000","last_unstale":"2024-04-25T02:17:34.644932+0000","last_undegraded":"2024-04-25T02:17:34.644932+0000","last_fullsized":"2024-04-25T02:17:34.644932+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:42.804658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630382+0000","last_change":"2024-04-25T02:17:34.627888+0000","last_active":"2024-04-25T02:17:35.630382+0000","last_peered":"2024-04-25T02:17:35.630382+0000","last_clean":"2024-04-25T02:17:35.630382+0000","last_became_active":"2024-04-25T02:17:34.627600+0000","last_became_peered":"2024-04-25T02:17:34.627600+0000","last_unstale":"2024-04-25T02:17:35.630382+0000","last_undegraded":"2024-04-25T02:17:35.630382+0000","last_fullsized":"2024-04-25T02:17:35.630382+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:01.963854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"114'6","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.655560+0000","last_change":"2024-04-25T02:17:33.633110+0000","last_active":"2024-04-25T02:17:34.655560+0000","last_peered":"2024-04-25T02:17:34.655560+0000","last_clean":"2024-04-25T02:17:34.655560+0000","last_became_active":"2024-04-25T02:17:33.632822+0000","last_became_peered":"2024-04-25T02:17:33.632822+0000","last_unstale":"2024-04-25T02:17:34.655560+0000","last_undegraded":"2024-04-25T02:17:34.655560+0000","last_fullsized":"2024-04-25T02:17:34.655560+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:14.677581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.633527+0000","last_change":"2024-04-25T02:17:34.631821+0000","last_active":"2024-04-25T02:17:34.633527+0000","last_peered":"2024-04-25T02:17:34.633527+0000","last_clean":"2024-04-25T02:17:34.633527+0000","last_became_active":"2024-04-25T02:17:34.631520+0000","last_became_peered":"2024-04-25T02:17:34.631520+0000","last_unstale":"2024-04-25T02:17:34.633527+0000","last_undegraded":"2024-04-25T02:17:34.633527+0000","last_fullsized":"2024-04-25T02:17:34.633527+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:00.226145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.637681+0000","last_change":"2024-04-25T02:17:33.628046+0000","last_active":"2024-04-25T02:17:34.637681+0000","last_peered":"2024-04-25T02:17:34.637681+0000","last_clean":"2024-04-25T02:17:34.637681+0000","last_became_active":"2024-04-25T02:17:33.627792+0000","last_became_peered":"2024-04-25T02:17:33.627792+0000","last_unstale":"2024-04-25T02:17:34.637681+0000","last_undegraded":"2024-04-25T02:17:34.637681+0000","last_fullsized":"2024-04-25T02:17:34.637681+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:36.845554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.636016+0000","last_change":"2024-04-25T02:17:34.632894+0000","last_active":"2024-04-25T02:17:34.636016+0000","last_peered":"2024-04-25T02:17:34.636016+0000","last_clean":"2024-04-25T02:17:34.636016+0000","last_became_active":"2024-04-25T02:17:34.632573+0000","last_became_peered":"2024-04-25T02:17:34.632573+0000","last_unstale":"2024-04-25T02:17:34.636016+0000","last_undegraded":"2024-04-25T02:17:34.636016+0000","last_fullsized":"2024-04-25T02:17:34.636016+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:15.544599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.624154+0000","last_change":"2024-04-25T02:17:33.634694+0000","last_active":"2024-04-25T02:17:34.624154+0000","last_peered":"2024-04-25T02:17:34.624154+0000","last_clean":"2024-04-25T02:17:34.624154+0000","last_became_active":"2024-04-25T02:17:33.634387+0000","last_became_peered":"2024-04-25T02:17:33.634387+0000","last_unstale":"2024-04-25T02:17:34.624154+0000","last_undegraded":"2024-04-25T02:17:34.624154+0000","last_fullsized":"2024-04-25T02:17:34.624154+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:07.526435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.636225+0000","last_change":"2024-04-25T02:17:34.635173+0000","last_active":"2024-04-25T02:17:34.636225+0000","last_peered":"2024-04-25T02:17:34.636225+0000","last_clean":"2024-04-25T02:17:34.636225+0000","last_became_active":"2024-04-25T02:17:34.634895+0000","last_became_peered":"2024-04-25T02:17:34.634895+0000","last_unstale":"2024-04-25T02:17:34.636225+0000","last_undegraded":"2024-04-25T02:17:34.636225+0000","last_fullsized":"2024-04-25T02:17:34.636225+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:25.490834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"114'8","reported_seq":22,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626127+0000","last_change":"2024-04-25T02:17:33.634110+0000","last_active":"2024-04-25T02:17:35.626127+0000","last_peered":"2024-04-25T02:17:35.626127+0000","last_clean":"2024-04-25T02:17:35.626127+0000","last_became_active":"2024-04-25T02:17:33.633751+0000","last_became_peered":"2024-04-25T02:17:33.633751+0000","last_unstale":"2024-04-25T02:17:35.626127+0000","last_undegraded":"2024-04-25T02:17:35.626127+0000","last_fullsized":"2024-04-25T02:17:35.626127+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:47.139932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626356+0000","last_change":"2024-04-25T02:17:34.645944+0000","last_active":"2024-04-25T02:17:35.626356+0000","last_peered":"2024-04-25T02:17:35.626356+0000","last_clean":"2024-04-25T02:17:35.626356+0000","last_became_active":"2024-04-25T02:17:34.645677+0000","last_became_peered":"2024-04-25T02:17:34.645677+0000","last_unstale":"2024-04-25T02:17:35.626356+0000","last_undegraded":"2024-04-25T02:17:35.626356+0000","last_fullsized":"2024-04-25T02:17:35.626356+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:06.199916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647390+0000","last_change":"2024-04-25T02:17:33.634731+0000","last_active":"2024-04-25T02:17:34.647390+0000","last_peered":"2024-04-25T02:17:34.647390+0000","last_clean":"2024-04-25T02:17:34.647390+0000","last_became_active":"2024-04-25T02:17:33.634355+0000","last_became_peered":"2024-04-25T02:17:33.634355+0000","last_unstale":"2024-04-25T02:17:34.647390+0000","last_undegraded":"2024-04-25T02:17:34.647390+0000","last_fullsized":"2024-04-25T02:17:34.647390+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:19.751946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.652754+0000","last_change":"2024-04-25T02:17:34.648422+0000","last_active":"2024-04-25T02:17:34.652754+0000","last_peered":"2024-04-25T02:17:34.652754+0000","last_clean":"2024-04-25T02:17:34.652754+0000","last_became_active":"2024-04-25T02:17:34.648157+0000","last_became_peered":"2024-04-25T02:17:34.648157+0000","last_unstale":"2024-04-25T02:17:34.652754+0000","last_undegraded":"2024-04-25T02:17:34.652754+0000","last_fullsized":"2024-04-25T02:17:34.652754+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:52.582756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626396+0000","last_change":"2024-04-25T02:17:33.627854+0000","last_active":"2024-04-25T02:17:35.626396+0000","last_peered":"2024-04-25T02:17:35.626396+0000","last_clean":"2024-04-25T02:17:35.626396+0000","last_became_active":"2024-04-25T02:17:33.627456+0000","last_became_peered":"2024-04-25T02:17:33.627456+0000","last_unstale":"2024-04-25T02:17:35.626396+0000","last_undegraded":"2024-04-25T02:17:35.626396+0000","last_fullsized":"2024-04-25T02:17:35.626396+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:42.464717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832085+0000","last_change":"2024-04-25T02:17:34.645130+0000","last_active":"2024-04-25T02:17:35.832085+0000","last_peered":"2024-04-25T02:17:35.832085+0000","last_clean":"2024-04-25T02:17:35.832085+0000","last_became_active":"2024-04-25T02:17:34.644785+0000","last_became_peered":"2024-04-25T02:17:34.644785+0000","last_unstale":"2024-04-25T02:17:35.832085+0000","last_undegraded":"2024-04-25T02:17:35.832085+0000","last_fullsized":"2024-04-25T02:17:35.832085+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:02.174445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.635380+0000","last_change":"2024-04-25T02:17:33.624984+0000","last_active":"2024-04-25T02:17:34.635380+0000","last_peered":"2024-04-25T02:17:34.635380+0000","last_clean":"2024-04-25T02:17:34.635380+0000","last_became_active":"2024-04-25T02:17:33.624661+0000","last_became_peered":"2024-04-25T02:17:33.624661+0000","last_unstale":"2024-04-25T02:17:34.635380+0000","last_undegraded":"2024-04-25T02:17:34.635380+0000","last_fullsized":"2024-04-25T02:17:34.635380+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:08.908005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832404+0000","last_change":"2024-04-25T02:17:34.634858+0000","last_active":"2024-04-25T02:17:35.832404+0000","last_peered":"2024-04-25T02:17:35.832404+0000","last_clean":"2024-04-25T02:17:35.832404+0000","last_became_active":"2024-04-25T02:17:34.634560+0000","last_became_peered":"2024-04-25T02:17:34.634560+0000","last_unstale":"2024-04-25T02:17:35.832404+0000","last_undegraded":"2024-04-25T02:17:35.832404+0000","last_fullsized":"2024-04-25T02:17:35.832404+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:31.575299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630274+0000","last_change":"2024-04-25T02:17:33.634891+0000","last_active":"2024-04-25T02:17:35.630274+0000","last_peered":"2024-04-25T02:17:35.630274+0000","last_clean":"2024-04-25T02:17:35.630274+0000","last_became_active":"2024-04-25T02:17:33.634519+0000","last_became_peered":"2024-04-25T02:17:33.634519+0000","last_unstale":"2024-04-25T02:17:35.630274+0000","last_undegraded":"2024-04-25T02:17:35.630274+0000","last_fullsized":"2024-04-25T02:17:35.630274+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:01.639820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832010+0000","last_change":"2024-04-25T02:17:34.634120+0000","last_active":"2024-04-25T02:17:35.832010+0000","last_peered":"2024-04-25T02:17:35.832010+0000","last_clean":"2024-04-25T02:17:35.832010+0000","last_became_active":"2024-04-25T02:17:34.633824+0000","last_became_peered":"2024-04-25T02:17:34.633824+0000","last_unstale":"2024-04-25T02:17:35.832010+0000","last_undegraded":"2024-04-25T02:17:35.832010+0000","last_fullsized":"2024-04-25T02:17:35.832010+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:19.203503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.639192+0000","last_change":"2024-04-25T02:17:33.624328+0000","last_active":"2024-04-25T02:17:34.639192+0000","last_peered":"2024-04-25T02:17:34.639192+0000","last_clean":"2024-04-25T02:17:34.639192+0000","last_became_active":"2024-04-25T02:17:33.624045+0000","last_became_peered":"2024-04-25T02:17:33.624045+0000","last_unstale":"2024-04-25T02:17:34.639192+0000","last_undegraded":"2024-04-25T02:17:34.639192+0000","last_fullsized":"2024-04-25T02:17:34.639192+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:19:05.344900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647302+0000","last_change":"2024-04-25T02:17:34.639936+0000","last_active":"2024-04-25T02:17:34.647302+0000","last_peered":"2024-04-25T02:17:34.647302+0000","last_clean":"2024-04-25T02:17:34.647302+0000","last_became_active":"2024-04-25T02:17:34.639708+0000","last_became_peered":"2024-04-25T02:17:34.639708+0000","last_unstale":"2024-04-25T02:17:34.647302+0000","last_undegraded":"2024-04-25T02:17:34.647302+0000","last_fullsized":"2024-04-25T02:17:34.647302+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:31.575299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626062+0000","last_change":"2024-04-25T02:17:33.626112+0000","last_active":"2024-04-25T02:17:35.626062+0000","last_peered":"2024-04-25T02:17:35.626062+0000","last_clean":"2024-04-25T02:17:35.626062+0000","last_became_active":"2024-04-25T02:17:33.625765+0000","last_became_peered":"2024-04-25T02:17:33.625765+0000","last_unstale":"2024-04-25T02:17:35.626062+0000","last_undegraded":"2024-04-25T02:17:35.626062+0000","last_fullsized":"2024-04-25T02:17:35.626062+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:41.191104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832038+0000","last_change":"2024-04-25T02:17:34.637519+0000","last_active":"2024-04-25T02:17:35.832038+0000","last_peered":"2024-04-25T02:17:35.832038+0000","last_clean":"2024-04-25T02:17:35.832038+0000","last_became_active":"2024-04-25T02:17:34.637143+0000","last_became_peered":"2024-04-25T02:17:34.637143+0000","last_unstale":"2024-04-25T02:17:35.832038+0000","last_undegraded":"2024-04-25T02:17:35.832038+0000","last_fullsized":"2024-04-25T02:17:35.832038+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:36:38.389254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.622046+0000","last_change":"2024-04-25T02:17:33.622908+0000","last_active":"2024-04-25T02:17:34.622046+0000","last_peered":"2024-04-25T02:17:34.622046+0000","last_clean":"2024-04-25T02:17:34.622046+0000","last_became_active":"2024-04-25T02:17:33.622645+0000","last_became_peered":"2024-04-25T02:17:33.622645+0000","last_unstale":"2024-04-25T02:17:34.622046+0000","last_undegraded":"2024-04-25T02:17:34.622046+0000","last_fullsized":"2024-04-25T02:17:34.622046+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:00.745318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.649727+0000","last_change":"2024-04-25T02:17:34.641191+0000","last_active":"2024-04-25T02:17:34.649727+0000","last_peered":"2024-04-25T02:17:34.649727+0000","last_clean":"2024-04-25T02:17:34.649727+0000","last_became_active":"2024-04-25T02:17:34.640934+0000","last_became_peered":"2024-04-25T02:17:34.640934+0000","last_unstale":"2024-04-25T02:17:34.649727+0000","last_undegraded":"2024-04-25T02:17:34.649727+0000","last_fullsized":"2024-04-25T02:17:34.649727+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:43.811948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.640270+0000","last_change":"2024-04-25T02:17:33.630382+0000","last_active":"2024-04-25T02:17:34.640270+0000","last_peered":"2024-04-25T02:17:34.640270+0000","last_clean":"2024-04-25T02:17:34.640270+0000","last_became_active":"2024-04-25T02:17:33.630094+0000","last_became_peered":"2024-04-25T02:17:33.630094+0000","last_unstale":"2024-04-25T02:17:34.640270+0000","last_undegraded":"2024-04-25T02:17:34.640270+0000","last_fullsized":"2024-04-25T02:17:34.640270+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:11.383230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.646808+0000","last_change":"2024-04-25T02:17:34.646013+0000","last_active":"2024-04-25T02:17:34.646808+0000","last_peered":"2024-04-25T02:17:34.646808+0000","last_clean":"2024-04-25T02:17:34.646808+0000","last_became_active":"2024-04-25T02:17:34.645712+0000","last_became_peered":"2024-04-25T02:17:34.645712+0000","last_unstale":"2024-04-25T02:17:34.646808+0000","last_undegraded":"2024-04-25T02:17:34.646808+0000","last_fullsized":"2024-04-25T02:17:34.646808+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:00.226145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.641570+0000","last_change":"2024-04-25T02:17:33.633743+0000","last_active":"2024-04-25T02:17:34.641570+0000","last_peered":"2024-04-25T02:17:34.641570+0000","last_clean":"2024-04-25T02:17:34.641570+0000","last_became_active":"2024-04-25T02:17:33.633469+0000","last_became_peered":"2024-04-25T02:17:33.633469+0000","last_unstale":"2024-04-25T02:17:34.641570+0000","last_undegraded":"2024-04-25T02:17:34.641570+0000","last_fullsized":"2024-04-25T02:17:34.641570+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:07.526435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.652706+0000","last_change":"2024-04-25T02:17:34.647128+0000","last_active":"2024-04-25T02:17:34.652706+0000","last_peered":"2024-04-25T02:17:34.652706+0000","last_clean":"2024-04-25T02:17:34.652706+0000","last_became_active":"2024-04-25T02:17:34.645807+0000","last_became_peered":"2024-04-25T02:17:34.645807+0000","last_unstale":"2024-04-25T02:17:34.652706+0000","last_undegraded":"2024-04-25T02:17:34.652706+0000","last_fullsized":"2024-04-25T02:17:34.652706+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:21.075200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.616948+0000","last_change":"2024-04-25T02:17:33.627054+0000","last_active":"2024-04-25T02:17:35.616948+0000","last_peered":"2024-04-25T02:17:35.616948+0000","last_clean":"2024-04-25T02:17:35.616948+0000","last_became_active":"2024-04-25T02:17:33.626678+0000","last_became_peered":"2024-04-25T02:17:33.626678+0000","last_unstale":"2024-04-25T02:17:35.616948+0000","last_undegraded":"2024-04-25T02:17:35.616948+0000","last_fullsized":"2024-04-25T02:17:35.616948+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:06.224109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647560+0000","last_change":"2024-04-25T02:17:34.644075+0000","last_active":"2024-04-25T02:17:34.647560+0000","last_peered":"2024-04-25T02:17:34.647560+0000","last_clean":"2024-04-25T02:17:34.647560+0000","last_became_active":"2024-04-25T02:17:34.643618+0000","last_became_peered":"2024-04-25T02:17:34.643618+0000","last_unstale":"2024-04-25T02:17:34.647560+0000","last_undegraded":"2024-04-25T02:17:34.647560+0000","last_fullsized":"2024-04-25T02:17:34.647560+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:41.931220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.636846+0000","last_change":"2024-04-25T02:17:33.633635+0000","last_active":"2024-04-25T02:17:34.636846+0000","last_peered":"2024-04-25T02:17:34.636846+0000","last_clean":"2024-04-25T02:17:34.636846+0000","last_became_active":"2024-04-25T02:17:33.633387+0000","last_became_peered":"2024-04-25T02:17:33.633387+0000","last_unstale":"2024-04-25T02:17:34.636846+0000","last_undegraded":"2024-04-25T02:17:34.636846+0000","last_fullsized":"2024-04-25T02:17:34.636846+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:02.209573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.645967+0000","last_change":"2024-04-25T02:17:34.645273+0000","last_active":"2024-04-25T02:17:34.645967+0000","last_peered":"2024-04-25T02:17:34.645967+0000","last_clean":"2024-04-25T02:17:34.645967+0000","last_became_active":"2024-04-25T02:17:34.644956+0000","last_became_peered":"2024-04-25T02:17:34.644956+0000","last_unstale":"2024-04-25T02:17:34.645967+0000","last_undegraded":"2024-04-25T02:17:34.645967+0000","last_fullsized":"2024-04-25T02:17:34.645967+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:29:46.553410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.621577+0000","last_change":"2024-04-25T02:17:33.626409+0000","last_active":"2024-04-25T02:17:34.621577+0000","last_peered":"2024-04-25T02:17:34.621577+0000","last_clean":"2024-04-25T02:17:34.621577+0000","last_became_active":"2024-04-25T02:17:33.626169+0000","last_became_peered":"2024-04-25T02:17:33.626169+0000","last_unstale":"2024-04-25T02:17:34.621577+0000","last_undegraded":"2024-04-25T02:17:34.621577+0000","last_fullsized":"2024-04-25T02:17:34.621577+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:58.765689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631274+0000","last_change":"2024-04-25T02:17:34.628443+0000","last_active":"2024-04-25T02:17:35.631274+0000","last_peered":"2024-04-25T02:17:35.631274+0000","last_clean":"2024-04-25T02:17:35.631274+0000","last_became_active":"2024-04-25T02:17:34.628068+0000","last_became_peered":"2024-04-25T02:17:34.628068+0000","last_unstale":"2024-04-25T02:17:35.631274+0000","last_undegraded":"2024-04-25T02:17:35.631274+0000","last_fullsized":"2024-04-25T02:17:35.631274+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:46.502887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630186+0000","last_change":"2024-04-25T02:17:33.625108+0000","last_active":"2024-04-25T02:17:35.630186+0000","last_peered":"2024-04-25T02:17:35.630186+0000","last_clean":"2024-04-25T02:17:35.630186+0000","last_became_active":"2024-04-25T02:17:33.624774+0000","last_became_peered":"2024-04-25T02:17:33.624774+0000","last_unstale":"2024-04-25T02:17:35.630186+0000","last_undegraded":"2024-04-25T02:17:35.630186+0000","last_fullsized":"2024-04-25T02:17:35.630186+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:11.869616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631670+0000","last_change":"2024-04-25T02:17:34.622618+0000","last_active":"2024-04-25T02:17:35.631670+0000","last_peered":"2024-04-25T02:17:35.631670+0000","last_clean":"2024-04-25T02:17:35.631670+0000","last_became_active":"2024-04-25T02:17:34.622332+0000","last_became_peered":"2024-04-25T02:17:34.622332+0000","last_unstale":"2024-04-25T02:17:35.631670+0000","last_undegraded":"2024-04-25T02:17:35.631670+0000","last_fullsized":"2024-04-25T02:17:35.631670+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:25.490834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.631253+0000","last_change":"2024-04-25T02:17:33.620935+0000","last_active":"2024-04-25T02:17:35.631253+0000","last_peered":"2024-04-25T02:17:35.631253+0000","last_clean":"2024-04-25T02:17:35.631253+0000","last_became_active":"2024-04-25T02:17:33.620625+0000","last_became_peered":"2024-04-25T02:17:33.620625+0000","last_unstale":"2024-04-25T02:17:35.631253+0000","last_undegraded":"2024-04-25T02:17:35.631253+0000","last_fullsized":"2024-04-25T02:17:35.631253+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:16.457015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832203+0000","last_change":"2024-04-25T02:17:34.635006+0000","last_active":"2024-04-25T02:17:35.832203+0000","last_peered":"2024-04-25T02:17:35.832203+0000","last_clean":"2024-04-25T02:17:35.832203+0000","last_became_active":"2024-04-25T02:17:34.634686+0000","last_became_peered":"2024-04-25T02:17:34.634686+0000","last_unstale":"2024-04-25T02:17:35.832203+0000","last_undegraded":"2024-04-25T02:17:35.832203+0000","last_fullsized":"2024-04-25T02:17:35.832203+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:43.811948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.626026+0000","last_change":"2024-04-25T02:17:33.625519+0000","last_active":"2024-04-25T02:17:35.626026+0000","last_peered":"2024-04-25T02:17:35.626026+0000","last_clean":"2024-04-25T02:17:35.626026+0000","last_became_active":"2024-04-25T02:17:33.625139+0000","last_became_peered":"2024-04-25T02:17:33.625139+0000","last_unstale":"2024-04-25T02:17:35.626026+0000","last_undegraded":"2024-04-25T02:17:35.626026+0000","last_fullsized":"2024-04-25T02:17:35.626026+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:16.550835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.647478+0000","last_change":"2024-04-25T02:17:34.642325+0000","last_active":"2024-04-25T02:17:34.647478+0000","last_peered":"2024-04-25T02:17:34.647478+0000","last_clean":"2024-04-25T02:17:34.647478+0000","last_became_active":"2024-04-25T02:17:34.640692+0000","last_became_peered":"2024-04-25T02:17:34.640692+0000","last_unstale":"2024-04-25T02:17:34.647478+0000","last_undegraded":"2024-04-25T02:17:34.647478+0000","last_fullsized":"2024-04-25T02:17:34.647478+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:48:28.907889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.642543+0000","last_change":"2024-04-25T02:17:33.629768+0000","last_active":"2024-04-25T02:17:34.642543+0000","last_peered":"2024-04-25T02:17:34.642543+0000","last_clean":"2024-04-25T02:17:34.642543+0000","last_became_active":"2024-04-25T02:17:33.629432+0000","last_became_peered":"2024-04-25T02:17:33.629432+0000","last_unstale":"2024-04-25T02:17:34.642543+0000","last_undegraded":"2024-04-25T02:17:34.642543+0000","last_fullsized":"2024-04-25T02:17:34.642543+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:11.695562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T02:17:34.636310+0000","last_change":"2024-04-25T02:17:34.634263+0000","last_active":"2024-04-25T02:17:34.636310+0000","last_peered":"2024-04-25T02:17:34.636310+0000","last_clean":"2024-04-25T02:17:34.636310+0000","last_became_active":"2024-04-25T02:17:34.633728+0000","last_became_peered":"2024-04-25T02:17:34.633728+0000","last_unstale":"2024-04-25T02:17:34.636310+0000","last_undegraded":"2024-04-25T02:17:34.636310+0000","last_fullsized":"2024-04-25T02:17:34.636310+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:33.605399+0000","last_clean_scrub_stamp":"2024-04-25T02:17:33.605399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:19.203503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.630145+0000","last_change":"2024-04-25T02:17:33.634765+0000","last_active":"2024-04-25T02:17:35.630145+0000","last_peered":"2024-04-25T02:17:35.630145+0000","last_clean":"2024-04-25T02:17:35.630145+0000","last_became_active":"2024-04-25T02:17:33.634386+0000","last_became_peered":"2024-04-25T02:17:33.634386+0000","last_unstale":"2024-04-25T02:17:35.630145+0000","last_undegraded":"2024-04-25T02:17:35.630145+0000","last_fullsized":"2024-04-25T02:17:35.630145+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:17:32.598108+0000","last_clean_scrub_stamp":"2024-04-25T02:17:32.598108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:27:22.455792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":343,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T02:17:35.832247+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:17:35.832247+0000","last_peered":"2024-04-25T02:17:35.832247+0000","last_clean":"2024-04-25T02:17:35.832247+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:17:35.832247+0000","last_undegraded":"2024-04-25T02:17:35.832247+0000","last_fullsized":"2024-04-25T02:17:35.832247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574969,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2031616,"data_stored":1210261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574969,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1421312,"data_stored":613047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574969,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1437696,"data_stored":619881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574970,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1417216,"data_stored":612977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":614659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574969,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1429504,"data_stored":619277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1425408,"data_stored":613101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574969,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2031616,"data_stored":1205069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:17:38.224 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T02:17:38.224 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T02:17:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.359+0000 7fe0e7e4d640 1 Processor -- start 2024-04-25T02:17:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.359+0000 7fe0e7e4d640 1 -- start start 2024-04-25T02:17:38.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.360+0000 7fe0e7e4d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe0e006b2f0 0x7fe0e00b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.360+0000 7fe0e7e4d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe0e006e6b0 0x7fe0e015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.360+0000 7fe0e7e4d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e015ec20 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.360+0000 7fe0e7e4d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e015f830 con 0x7fe0e006b2f0 2024-04-25T02:17:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.360+0000 7fe0e7e4d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e015ef00 con 0x7fe0e006e6b0 2024-04-25T02:17:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.360+0000 7fe0e53e8640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe0e00cf7a0 0x7fe0e006b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57736/0 (socket says 172.21.15.79:57736) 2024-04-25T02:17:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.360+0000 7fe0e53e8640 1 -- 172.21.15.79:0/4293793930 learned_addr learned my addr 172.21.15.79:0/4293793930 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.360+0000 7fe0e5be9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe0e006b2f0 0x7fe0e00b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.361+0000 7fe0e63ea640 1 --2- 172.21.15.79:0/4293793930 >> v2:172.21.15.189:3300/0 conn(0x7fe0e006e6b0 0x7fe0e015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.361+0000 7fe0e4be7640 1 -- 172.21.15.79:0/4293793930 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 525381119 0 0) 0x7fe0e015ec20 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.361+0000 7fe0e4be7640 1 -- 172.21.15.79:0/4293793930 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0cc003520 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.361+0000 7fe0e5be9640 1 -- 172.21.15.79:0/4293793930 >> v2:172.21.15.189:3300/0 conn(0x7fe0e006e6b0 msgr2=0x7fe0e015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.361+0000 7fe0e5be9640 1 --2- 172.21.15.79:0/4293793930 >> v2:172.21.15.189:3300/0 conn(0x7fe0e006e6b0 0x7fe0e015b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.361+0000 7fe0e5be9640 1 -- 172.21.15.79:0/4293793930 >> v1:172.21.15.79:6789/0 conn(0x7fe0e00cf7a0 legacy=0x7fe0e006b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.361+0000 7fe0e5be9640 1 -- 172.21.15.79:0/4293793930 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e015f1e0 con 0x7fe0e006b2f0 2024-04-25T02:17:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.361+0000 7fe0e5be9640 1 --2- 172.21.15.79:0/4293793930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e006b2f0 0x7fe0e00b4b50 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fe0e015f9b0 tx=0x7fe0d002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef18dd62d6a427f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.362+0000 7fe0e4be7640 1 -- 172.21.15.79:0/4293793930 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0037070 con 0x7fe0e006b2f0 2024-04-25T02:17:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.362+0000 7fe0e4be7640 1 -- 172.21.15.79:0/4293793930 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d0032440 con 0x7fe0e006b2f0 2024-04-25T02:17:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.362+0000 7fe0e4be7640 1 -- 172.21.15.79:0/4293793930 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d002ae60 con 0x7fe0e006b2f0 2024-04-25T02:17:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.362+0000 7fe0e7e4d640 1 -- 172.21.15.79:0/4293793930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e006b2f0 msgr2=0x7fe0e00b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.362+0000 7fe0e7e4d640 1 --2- 172.21.15.79:0/4293793930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e006b2f0 0x7fe0e00b4b50 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fe0e015f9b0 tx=0x7fe0d002a110 comp rx=0 tx=0).stop 2024-04-25T02:17:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.362+0000 7fe0e7e4d640 1 -- 172.21.15.79:0/4293793930 shutdown_connections 2024-04-25T02:17:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.362+0000 7fe0e7e4d640 1 --2- 172.21.15.79:0/4293793930 >> v2:172.21.15.189:3300/0 conn(0x7fe0e006e6b0 0x7fe0e015b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.362+0000 7fe0e7e4d640 1 --2- 172.21.15.79:0/4293793930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e006b2f0 0x7fe0e00b4b50 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.362+0000 7fe0e7e4d640 1 -- 172.21.15.79:0/4293793930 >> 172.21.15.79:0/4293793930 conn(0x7fe0e00b1cd0 msgr2=0x7fe0e00b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.362+0000 7fe0e7e4d640 1 -- 172.21.15.79:0/4293793930 shutdown_connections 2024-04-25T02:17:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.362+0000 7fe0e7e4d640 1 -- 172.21.15.79:0/4293793930 wait complete. 2024-04-25T02:17:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.363+0000 7fe0e7e4d640 1 Processor -- start 2024-04-25T02:17:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.363+0000 7fe0e7e4d640 1 -- start start 2024-04-25T02:17:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e7e4d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0e006b2f0 0x7fe0e01f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e7e4d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0e006e6b0 0x7fe0e014a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e7e4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e00cf7a0 0x7fe0e00aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e7e4d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e006d160 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e7e4d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e006cfe0 con 0x7fe0e006e6b0 2024-04-25T02:17:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e7e4d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e015b810 con 0x7fe0e006b2f0 2024-04-25T02:17:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e63ea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e00cf7a0 0x7fe0e00aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e63ea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e00cf7a0 0x7fe0e00aed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48182/0 (socket says 172.21.15.79:48182) 2024-04-25T02:17:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e63ea640 1 -- 172.21.15.79:0/3543159004 learned_addr learned my addr 172.21.15.79:0/3543159004 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e5be9640 1 --2- 172.21.15.79:0/3543159004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0e006b2f0 0x7fe0e01f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e53e8640 1 --2- 172.21.15.79:0/3543159004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0e006e6b0 0x7fe0e014a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e63ea640 1 -- 172.21.15.79:0/3543159004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0e006b2f0 msgr2=0x7fe0e01f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e63ea640 1 --2- 172.21.15.79:0/3543159004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0e006b2f0 0x7fe0e01f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e63ea640 1 -- 172.21.15.79:0/3543159004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0e006e6b0 msgr2=0x7fe0e014a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e63ea640 1 --2- 172.21.15.79:0/3543159004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0e006e6b0 0x7fe0e014a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.364+0000 7fe0e63ea640 1 -- 172.21.15.79:0/3543159004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e01f27d0 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.365+0000 7fe0e63ea640 1 --2- 172.21.15.79:0/3543159004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e00cf7a0 0x7fe0e00aed70 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800efc0 tx=0x7fe0d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.365+0000 7fe0d67fc640 1 -- 172.21.15.79:0/3543159004 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8018020 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.365+0000 7fe0d67fc640 1 -- 172.21.15.79:0/3543159004 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d8014480 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.365+0000 7fe0e7e4d640 1 -- 172.21.15.79:0/3543159004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e01f2ab0 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.365+0000 7fe0d67fc640 1 -- 172.21.15.79:0/3543159004 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8014870 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.365+0000 7fe0e7e4d640 1 -- 172.21.15.79:0/3543159004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e01f3070 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.366+0000 7fe0e7e4d640 1 -- 172.21.15.79:0/3543159004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e00690a0 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.366+0000 7fe0d67fc640 1 -- 172.21.15.79:0/3543159004 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0d8005d10 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.367+0000 7fe0d67fc640 1 --2- 172.21.15.79:0/3543159004 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe0c406be30 0x7fe0c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.367+0000 7fe0d67fc640 1 -- 172.21.15.79:0/3543159004 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7fe0d808bc30 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.367+0000 7fe0e5be9640 1 --2- 172.21.15.79:0/3543159004 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe0c406be30 0x7fe0c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.367+0000 7fe0e5be9640 1 --2- 172.21.15.79:0/3543159004 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe0c406be30 0x7fe0c406e2f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0034000 tx=0x7fe0d002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.371+0000 7fe0d67fc640 1 -- 172.21.15.79:0/3543159004 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe0d8022030 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.608+0000 7fe0e7e4d640 1 -- 172.21.15.79:0/3543159004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe0e00cf4f0 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.610+0000 7fe0d67fc640 1 -- 172.21.15.79:0/3543159004 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7fe0d8010040 con 0x7fe0e00cf7a0 2024-04-25T02:17:38.614 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-04-25T02:17:38.614 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDGuilmQOwkARAAfUmFgfepalkWRbBYiqBD2g== 2024-04-25T02:17:38.615 INFO:teuthology.orchestra.run.smithi079.stdout: caps mds = "allow" 2024-04-25T02:17:38.615 INFO:teuthology.orchestra.run.smithi079.stdout: caps mon = "allow r" 2024-04-25T02:17:38.615 INFO:teuthology.orchestra.run.smithi079.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T02:17:38.615 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2024-04-25T02:17:38.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.612+0000 7fe0e7e4d640 1 -- 172.21.15.79:0/3543159004 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe0c406be30 msgr2=0x7fe0c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.612+0000 7fe0e7e4d640 1 --2- 172.21.15.79:0/3543159004 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe0c406be30 0x7fe0c406e2f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0034000 tx=0x7fe0d002e000 comp rx=0 tx=0).stop 2024-04-25T02:17:38.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.612+0000 7fe0e7e4d640 1 -- 172.21.15.79:0/3543159004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e00cf7a0 msgr2=0x7fe0e00aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.612+0000 7fe0e7e4d640 1 --2- 172.21.15.79:0/3543159004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e00cf7a0 0x7fe0e00aed70 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800efc0 tx=0x7fe0d800c490 comp rx=0 tx=0).stop 2024-04-25T02:17:38.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.612+0000 7fe0e7e4d640 1 -- 172.21.15.79:0/3543159004 shutdown_connections 2024-04-25T02:17:38.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.612+0000 7fe0e7e4d640 1 --2- 172.21.15.79:0/3543159004 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe0c406be30 0x7fe0c406e2f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.612+0000 7fe0e7e4d640 1 --2- 172.21.15.79:0/3543159004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e00cf7a0 0x7fe0e00aed70 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.612+0000 7fe0e7e4d640 1 --2- 172.21.15.79:0/3543159004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0e006e6b0 0x7fe0e014a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.612+0000 7fe0e7e4d640 1 --2- 172.21.15.79:0/3543159004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0e006b2f0 0x7fe0e01f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.612+0000 7fe0e7e4d640 1 -- 172.21.15.79:0/3543159004 >> 172.21.15.79:0/3543159004 conn(0x7fe0e00b1cd0 msgr2=0x7fe0e0070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:38.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.612+0000 7fe0e7e4d640 1 -- 172.21.15.79:0/3543159004 shutdown_connections 2024-04-25T02:17:38.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.612+0000 7fe0e7e4d640 1 -- 172.21.15.79:0/3543159004 wait complete. 2024-04-25T02:17:38.627 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:17:38.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.719+0000 7f6b5b309640 1 Processor -- start 2024-04-25T02:17:38.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.719+0000 7f6b5b309640 1 -- start start 2024-04-25T02:17:38.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.720+0000 7f6b5b309640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b5406df50 0x7f6b5406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.720+0000 7f6b5b309640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6b540b2d30 0x7f6b540b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.720+0000 7f6b5b309640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b54071e00 con 0x7f6b54143bc0 2024-04-25T02:17:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.720+0000 7f6b5b309640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6b5406e8f0 con 0x7f6b5406df50 2024-04-25T02:17:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.720+0000 7f6b5b309640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6b54072cb0 con 0x7f6b540b2d30 2024-04-25T02:17:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.720+0000 7f6b588a4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b5406df50 0x7f6b5406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.720+0000 7f6b588a4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b5406df50 0x7f6b5406e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48190/0 (socket says 172.21.15.79:48190) 2024-04-25T02:17:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.720+0000 7f6b588a4640 1 -- 172.21.15.79:0/2412378443 learned_addr learned my addr 172.21.15.79:0/2412378443 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.720+0000 7f6b598a6640 1 --2- 172.21.15.79:0/2412378443 >> v2:172.21.15.189:3300/0 conn(0x7f6b540b2d30 0x7f6b540b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.720+0000 7f6b588a4640 1 -- 172.21.15.79:0/2412378443 >> v2:172.21.15.189:3300/0 conn(0x7f6b540b2d30 msgr2=0x7f6b540b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.720+0000 7f6b588a4640 1 --2- 172.21.15.79:0/2412378443 >> v2:172.21.15.189:3300/0 conn(0x7f6b540b2d30 0x7f6b540b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.720+0000 7f6b588a4640 1 -- 172.21.15.79:0/2412378443 >> v1:172.21.15.189:6789/0 conn(0x7f6b54143bc0 legacy=0x7f6b5415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.720+0000 7f6b588a4640 1 -- 172.21.15.79:0/2412378443 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b540720a0 con 0x7f6b5406df50 2024-04-25T02:17:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.721+0000 7f6b588a4640 1 --2- 172.21.15.79:0/2412378443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b5406df50 0x7f6b5406e3b0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f6b54144d00 tx=0x7f6b4802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cacd0d6f8d42b47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.721+0000 7f6b53fff640 1 -- 172.21.15.79:0/2412378443 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48037070 con 0x7f6b5406df50 2024-04-25T02:17:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.721+0000 7f6b53fff640 1 -- 172.21.15.79:0/2412378443 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b48032440 con 0x7f6b5406df50 2024-04-25T02:17:38.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.721+0000 7f6b53fff640 1 -- 172.21.15.79:0/2412378443 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48032810 con 0x7f6b5406df50 2024-04-25T02:17:38.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.722+0000 7f6b5b309640 1 -- 172.21.15.79:0/2412378443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b5406df50 msgr2=0x7f6b5406e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.722+0000 7f6b5b309640 1 --2- 172.21.15.79:0/2412378443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b5406df50 0x7f6b5406e3b0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f6b54144d00 tx=0x7f6b4802a1a0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.722+0000 7f6b5b309640 1 -- 172.21.15.79:0/2412378443 shutdown_connections 2024-04-25T02:17:38.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.722+0000 7f6b5b309640 1 --2- 172.21.15.79:0/2412378443 >> v2:172.21.15.189:3300/0 conn(0x7f6b540b2d30 0x7f6b540b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.722+0000 7f6b5b309640 1 --2- 172.21.15.79:0/2412378443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b5406df50 0x7f6b5406e3b0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.722+0000 7f6b5b309640 1 -- 172.21.15.79:0/2412378443 >> 172.21.15.79:0/2412378443 conn(0x7f6b540cfc80 msgr2=0x7f6b540d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:38.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.722+0000 7f6b5b309640 1 -- 172.21.15.79:0/2412378443 shutdown_connections 2024-04-25T02:17:38.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.722+0000 7f6b5b309640 1 -- 172.21.15.79:0/2412378443 wait complete. 2024-04-25T02:17:38.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.723+0000 7f6b5b309640 1 Processor -- start 2024-04-25T02:17:38.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.723+0000 7f6b5b309640 1 -- start start 2024-04-25T02:17:38.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b5b309640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b5406df50 0x7f6b5413f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b5b309640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b540b2d30 0x7f6b54070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b5b309640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b54143bc0 0x7f6b54071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b5b309640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6b54072940 con 0x7f6b540b2d30 2024-04-25T02:17:38.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b5b309640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b54072660 con 0x7f6b5406df50 2024-04-25T02:17:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b5b309640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6b54143fa0 con 0x7f6b54143bc0 2024-04-25T02:17:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b588a4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b540b2d30 0x7f6b54070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b588a4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b540b2d30 0x7f6b54070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48198/0 (socket says 172.21.15.79:48198) 2024-04-25T02:17:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b588a4640 1 -- 172.21.15.79:0/3215950870 learned_addr learned my addr 172.21.15.79:0/3215950870 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b590a5640 1 --2- 172.21.15.79:0/3215950870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b5406df50 0x7f6b5413f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b598a6640 1 --2- 172.21.15.79:0/3215950870 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b54143bc0 0x7f6b54071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b588a4640 1 -- 172.21.15.79:0/3215950870 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b54143bc0 msgr2=0x7f6b54071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b588a4640 1 --2- 172.21.15.79:0/3215950870 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b54143bc0 0x7f6b54071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b588a4640 1 -- 172.21.15.79:0/3215950870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b5406df50 msgr2=0x7f6b5413f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b588a4640 1 --2- 172.21.15.79:0/3215950870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b5406df50 0x7f6b5413f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b588a4640 1 -- 172.21.15.79:0/3215950870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b541d5ff0 con 0x7f6b540b2d30 2024-04-25T02:17:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b590a5640 1 --2- 172.21.15.79:0/3215950870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b5406df50 0x7f6b5413f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b588a4640 1 --2- 172.21.15.79:0/3215950870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b540b2d30 0x7f6b54070cf0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f6b48000c00 tx=0x7f6b480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:38.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b51ffb640 1 -- 172.21.15.79:0/3215950870 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48041020 con 0x7f6b540b2d30 2024-04-25T02:17:38.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b51ffb640 1 -- 172.21.15.79:0/3215950870 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b480306c0 con 0x7f6b540b2d30 2024-04-25T02:17:38.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b5b309640 1 -- 172.21.15.79:0/3215950870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b541d62c0 con 0x7f6b540b2d30 2024-04-25T02:17:38.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.724+0000 7f6b51ffb640 1 -- 172.21.15.79:0/3215950870 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48037040 con 0x7f6b540b2d30 2024-04-25T02:17:38.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.725+0000 7f6b5b309640 1 -- 172.21.15.79:0/3215950870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b541d6880 con 0x7f6b540b2d30 2024-04-25T02:17:38.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.725+0000 7f6b5b309640 1 -- 172.21.15.79:0/3215950870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b540690a0 con 0x7f6b540b2d30 2024-04-25T02:17:38.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.726+0000 7f6b51ffb640 1 -- 172.21.15.79:0/3215950870 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b48044020 con 0x7f6b540b2d30 2024-04-25T02:17:38.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.726+0000 7f6b51ffb640 1 --2- 172.21.15.79:0/3215950870 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b4006be30 0x7f6b4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:38.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.727+0000 7f6b51ffb640 1 -- 172.21.15.79:0/3215950870 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f6b480ab660 con 0x7f6b540b2d30 2024-04-25T02:17:38.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.727+0000 7f6b590a5640 1 --2- 172.21.15.79:0/3215950870 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b4006be30 0x7f6b4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:38.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.727+0000 7f6b590a5640 1 --2- 172.21.15.79:0/3215950870 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b4006be30 0x7f6b4006e2f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6b440045b0 tx=0x7f6b44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:38.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.731+0000 7f6b51ffb640 1 -- 172.21.15.79:0/3215950870 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6b4804b030 con 0x7f6b540b2d30 2024-04-25T02:17:38.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.938+0000 7f6b5b309640 1 -- 172.21.15.79:0/3215950870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b540d0100 con 0x7f6b540b2d30 2024-04-25T02:17:38.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.938+0000 7f6b51ffb640 1 -- 172.21.15.79:0/3215950870 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5186 (secure 0 0 0) 0x7f6b4807a0a0 con 0x7f6b540b2d30 2024-04-25T02:17:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:38.943 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":83,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3866997901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3866997901},{"type":"v1","addr":"172.21.15.189:6834","nonce":3866997901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/167225705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":167225705},{"type":"v1","addr":"172.21.15.189:6835","nonce":167225705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8916,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3734112703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3734112703},{"type":"v1","addr":"172.21.15.79:6835","nonce":3734112703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:17:33.960191+0000","modified":"2024-04-25T02:17:36.267031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8919},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8919":{"gid":8919,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2134535107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2134535107},{"type":"v1","addr":"172.21.15.79:6837","nonce":2134535107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8919,"qdb_cluster":[8919]},"id":8}]} 2024-04-25T02:17:38.943 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 83 2024-04-25T02:17:38.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.941+0000 7f6b5b309640 1 -- 172.21.15.79:0/3215950870 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b4006be30 msgr2=0x7f6b4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.941+0000 7f6b5b309640 1 --2- 172.21.15.79:0/3215950870 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b4006be30 0x7f6b4006e2f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6b440045b0 tx=0x7f6b44009040 comp rx=0 tx=0).stop 2024-04-25T02:17:38.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.941+0000 7f6b5b309640 1 -- 172.21.15.79:0/3215950870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b540b2d30 msgr2=0x7f6b54070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:38.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.941+0000 7f6b5b309640 1 --2- 172.21.15.79:0/3215950870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b540b2d30 0x7f6b54070cf0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f6b48000c00 tx=0x7f6b480046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.941+0000 7f6b5b309640 1 -- 172.21.15.79:0/3215950870 shutdown_connections 2024-04-25T02:17:38.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.941+0000 7f6b5b309640 1 --2- 172.21.15.79:0/3215950870 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f6b4006be30 0x7f6b4006e2f0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.941+0000 7f6b5b309640 1 --2- 172.21.15.79:0/3215950870 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6b54143bc0 0x7f6b54071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.941+0000 7f6b5b309640 1 --2- 172.21.15.79:0/3215950870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b540b2d30 0x7f6b54070cf0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.941+0000 7f6b5b309640 1 --2- 172.21.15.79:0/3215950870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b5406df50 0x7f6b5413f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:38.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.941+0000 7f6b5b309640 1 -- 172.21.15.79:0/3215950870 >> 172.21.15.79:0/3215950870 conn(0x7f6b540cfc80 msgr2=0x7f6b540b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:38.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.941+0000 7f6b5b309640 1 -- 172.21.15.79:0/3215950870 shutdown_connections 2024-04-25T02:17:38.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:38.941+0000 7f6b5b309640 1 -- 172.21.15.79:0/3215950870 wait complete. 2024-04-25T02:17:39.359 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:17:33.960191+0000', 'modified': '2024-04-25T02:17:36.267031+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8919}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8919': {'gid': 8919, 'name': 'a', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6837/2134535107', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 2134535107}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 2134535107}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8919, 'qdb_cluster': [8919]} 2024-04-25T02:17:39.359 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:17:39.359 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T02:17:39.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.454+0000 7f05daa3f640 1 Processor -- start 2024-04-25T02:17:39.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.454+0000 7f05daa3f640 1 -- start start 2024-04-25T02:17:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.455+0000 7f05daa3f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f05d4143bc0 0x7f05d415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.455+0000 7f05daa3f640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f05d406df50 0x7f05d406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.455+0000 7f05daa3f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05d415fa40 con 0x7f05d40b48e0 2024-04-25T02:17:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.455+0000 7f05daa3f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f05d406e8f0 con 0x7f05d4143bc0 2024-04-25T02:17:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.455+0000 7f05daa3f640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f05d4072cb0 con 0x7f05d406df50 2024-04-25T02:17:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.455+0000 7f05d3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f05d4143bc0 0x7f05d415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.455+0000 7f05d8fdc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f05d40b48e0 0x7f05d40b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57746/0 (socket says 172.21.15.79:57746) 2024-04-25T02:17:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.455+0000 7f05d8fdc640 1 -- 172.21.15.79:0/1955604168 learned_addr learned my addr 172.21.15.79:0/1955604168 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.455+0000 7f05d37fe640 1 --2- 172.21.15.79:0/1955604168 >> v2:172.21.15.189:3300/0 conn(0x7f05d406df50 0x7f05d406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.455+0000 7f05d2ffd640 1 -- 172.21.15.79:0/1955604168 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459250782 0 0) 0x7f05cc001490 con 0x7f05d40b48e0 2024-04-25T02:17:39.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.455+0000 7f05d2ffd640 1 -- 172.21.15.79:0/1955604168 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05bc003520 con 0x7f05d40b48e0 2024-04-25T02:17:39.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.455+0000 7f05d3fff640 1 -- 172.21.15.79:0/1955604168 >> v2:172.21.15.189:3300/0 conn(0x7f05d406df50 msgr2=0x7f05d406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:39.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.455+0000 7f05d3fff640 1 --2- 172.21.15.79:0/1955604168 >> v2:172.21.15.189:3300/0 conn(0x7f05d406df50 0x7f05d406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.455+0000 7f05d3fff640 1 -- 172.21.15.79:0/1955604168 >> v1:172.21.15.79:6789/0 conn(0x7f05d40b48e0 legacy=0x7f05d40b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.455+0000 7f05d3fff640 1 -- 172.21.15.79:0/1955604168 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d40720a0 con 0x7f05d4143bc0 2024-04-25T02:17:39.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.456+0000 7f05d3fff640 1 --2- 172.21.15.79:0/1955604168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05d4143bc0 0x7f05d415f500 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f05d40cf960 tx=0x7f05c402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150e0355c1c2501c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:39.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.456+0000 7f05d2ffd640 1 -- 172.21.15.79:0/1955604168 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c4037070 con 0x7f05d4143bc0 2024-04-25T02:17:39.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.456+0000 7f05d2ffd640 1 -- 172.21.15.79:0/1955604168 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c4032440 con 0x7f05d4143bc0 2024-04-25T02:17:39.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.456+0000 7f05d2ffd640 1 -- 172.21.15.79:0/1955604168 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c402ae60 con 0x7f05d4143bc0 2024-04-25T02:17:39.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.457+0000 7f05daa3f640 1 -- 172.21.15.79:0/1955604168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05d4143bc0 msgr2=0x7f05d415f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.457+0000 7f05daa3f640 1 --2- 172.21.15.79:0/1955604168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05d4143bc0 0x7f05d415f500 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f05d40cf960 tx=0x7f05c402a110 comp rx=0 tx=0).stop 2024-04-25T02:17:39.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.457+0000 7f05daa3f640 1 -- 172.21.15.79:0/1955604168 shutdown_connections 2024-04-25T02:17:39.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.457+0000 7f05daa3f640 1 --2- 172.21.15.79:0/1955604168 >> v2:172.21.15.189:3300/0 conn(0x7f05d406df50 0x7f05d406e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.457+0000 7f05daa3f640 1 --2- 172.21.15.79:0/1955604168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05d4143bc0 0x7f05d415f500 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.457+0000 7f05daa3f640 1 -- 172.21.15.79:0/1955604168 >> 172.21.15.79:0/1955604168 conn(0x7f05d40cfc80 msgr2=0x7f05d40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:39.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.457+0000 7f05daa3f640 1 -- 172.21.15.79:0/1955604168 shutdown_connections 2024-04-25T02:17:39.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.457+0000 7f05daa3f640 1 -- 172.21.15.79:0/1955604168 wait complete. 2024-04-25T02:17:39.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.458+0000 7f05daa3f640 1 Processor -- start 2024-04-25T02:17:39.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.458+0000 7f05daa3f640 1 -- start start 2024-04-25T02:17:39.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05daa3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05d406df50 0x7f05d413f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05daa3f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05d40b48e0 0x7f05d4142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05daa3f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05d4143bc0 0x7f05d41429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05daa3f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4072940 con 0x7f05d406df50 2024-04-25T02:17:39.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05daa3f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4072660 con 0x7f05d4143bc0 2024-04-25T02:17:39.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05daa3f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f05d4143fa0 con 0x7f05d40b48e0 2024-04-25T02:17:39.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05d406df50 0x7f05d413f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05d406df50 0x7f05d413f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48222/0 (socket says 172.21.15.79:48222) 2024-04-25T02:17:39.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05d3fff640 1 -- 172.21.15.79:0/291910340 learned_addr learned my addr 172.21.15.79:0/291910340 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:39.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05d3fff640 1 -- 172.21.15.79:0/291910340 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05d40b48e0 msgr2=0x7f05d4142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05d3fff640 1 --2- 172.21.15.79:0/291910340 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05d40b48e0 0x7f05d4142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05d3fff640 1 -- 172.21.15.79:0/291910340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05d4143bc0 msgr2=0x7f05d41429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05d8fdc640 1 --2- 172.21.15.79:0/291910340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05d4143bc0 0x7f05d41429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05d3fff640 1 --2- 172.21.15.79:0/291910340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05d4143bc0 0x7f05d41429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05d3fff640 1 -- 172.21.15.79:0/291910340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d40aebb0 con 0x7f05d406df50 2024-04-25T02:17:39.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05d8fdc640 1 --2- 172.21.15.79:0/291910340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05d4143bc0 0x7f05d41429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:39.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.459+0000 7f05d3fff640 1 --2- 172.21.15.79:0/291910340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05d406df50 0x7f05d413f570 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f05c4009890 tx=0x7f05c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:39.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.460+0000 7f05d0ff9640 1 -- 172.21.15.79:0/291910340 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c4037040 con 0x7f05d406df50 2024-04-25T02:17:39.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.460+0000 7f05d0ff9640 1 -- 172.21.15.79:0/291910340 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c4042070 con 0x7f05d406df50 2024-04-25T02:17:39.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.460+0000 7f05daa3f640 1 -- 172.21.15.79:0/291910340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d40aee90 con 0x7f05d406df50 2024-04-25T02:17:39.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.460+0000 7f05d0ff9640 1 -- 172.21.15.79:0/291910340 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c4030960 con 0x7f05d406df50 2024-04-25T02:17:39.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.460+0000 7f05daa3f640 1 -- 172.21.15.79:0/291910340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d40ade30 con 0x7f05d406df50 2024-04-25T02:17:39.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.461+0000 7f05d0ff9640 1 -- 172.21.15.79:0/291910340 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05c4030b00 con 0x7f05d406df50 2024-04-25T02:17:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.461+0000 7f05d0ff9640 1 --2- 172.21.15.79:0/291910340 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f05c006be30 0x7f05c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.462+0000 7f05d0ff9640 1 -- 172.21.15.79:0/291910340 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f05c40ab740 con 0x7f05d406df50 2024-04-25T02:17:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.462+0000 7f05d37fe640 1 --2- 172.21.15.79:0/291910340 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f05c006be30 0x7f05c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.462+0000 7f05d37fe640 1 --2- 172.21.15.79:0/291910340 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f05c006be30 0x7f05c006e2f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f05c8006fd0 tx=0x7f05c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.462+0000 7f05dd82d740 1 Processor -- start 2024-04-25T02:17:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.463+0000 7f05dd82d740 1 -- start start 2024-04-25T02:17:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.463+0000 7f05dd82d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7844b60 0x555fb77f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.463+0000 7f05dd82d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 0x555fb7827000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.463+0000 7f05dd82d740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb7827540 0x555fb77fc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.463+0000 7f05dd82d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555fb775ff00 con 0x555fb7844b60 2024-04-25T02:17:39.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.463+0000 7f05dd82d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555fb7708750 con 0x555fb7827c80 2024-04-25T02:17:39.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.463+0000 7f05dd82d740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x555fb775bec0 con 0x555fb7827540 2024-04-25T02:17:39.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.463+0000 7f05d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7844b60 0x555fb77f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.463+0000 7f05d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7844b60 0x555fb77f74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48232/0 (socket says 172.21.15.79:48232) 2024-04-25T02:17:39.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.463+0000 7f05d3fff640 1 -- 172.21.15.79:0/62992731 learned_addr learned my addr 172.21.15.79:0/62992731 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.463+0000 7f05d37fe640 1 --2- 172.21.15.79:0/62992731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 0x555fb7827000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.463+0000 7f05d8fdc640 1 --2- 172.21.15.79:0/62992731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb7827540 0x555fb77fc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.463+0000 7f05d3fff640 1 -- 172.21.15.79:0/62992731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb7827540 msgr2=0x555fb77fc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05d3fff640 1 --2- 172.21.15.79:0/62992731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb7827540 0x555fb77fc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05d3fff640 1 -- 172.21.15.79:0/62992731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 msgr2=0x555fb7827000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05d3fff640 1 --2- 172.21.15.79:0/62992731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 0x555fb7827000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05d3fff640 1 -- 172.21.15.79:0/62992731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb74742d0 con 0x555fb7844b60 2024-04-25T02:17:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05d37fe640 1 --2- 172.21.15.79:0/62992731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 0x555fb7827000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05d3fff640 1 --2- 172.21.15.79:0/62992731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7844b60 0x555fb77f74f0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f05c40a9c10 tx=0x7f05c4079530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6955a026c3b5b2eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05b9ffb640 1 -- 172.21.15.79:0/62992731 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c4091030 con 0x555fb7844b60 2024-04-25T02:17:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05b9ffb640 1 -- 172.21.15.79:0/62992731 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c407a0f0 con 0x555fb7844b60 2024-04-25T02:17:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05b9ffb640 1 -- 172.21.15.79:0/62992731 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c40799f0 con 0x555fb7844b60 2024-04-25T02:17:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05dd82d740 1 -- 172.21.15.79:0/62992731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7844b60 msgr2=0x555fb77f74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05dd82d740 1 --2- 172.21.15.79:0/62992731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7844b60 0x555fb77f74f0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f05c40a9c10 tx=0x7f05c4079530 comp rx=0 tx=0).stop 2024-04-25T02:17:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05dd82d740 1 -- 172.21.15.79:0/62992731 shutdown_connections 2024-04-25T02:17:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05dd82d740 1 --2- 172.21.15.79:0/62992731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb7827540 0x555fb77fc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05dd82d740 1 --2- 172.21.15.79:0/62992731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 0x555fb7827000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05dd82d740 1 --2- 172.21.15.79:0/62992731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7844b60 0x555fb77f74f0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05dd82d740 1 -- 172.21.15.79:0/62992731 >> 172.21.15.79:0/62992731 conn(0x555fb77f9760 msgr2=0x555fb7842000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05dd82d740 1 -- 172.21.15.79:0/62992731 shutdown_connections 2024-04-25T02:17:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.464+0000 7f05dd82d740 1 -- 172.21.15.79:0/62992731 wait complete. 2024-04-25T02:17:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.465+0000 7f05dd82d740 1 -- start start 2024-04-25T02:17:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.465+0000 7f05dd82d740 1 Processor -- start 2024-04-25T02:17:39.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05dd82d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 0x555fb78291c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05dd82d740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb7844b60 0x555fb7829700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05dd82d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb782af70 0x555fb77f6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05dd82d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555fb775ff00 con 0x555fb782af70 2024-04-25T02:17:39.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05dd82d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555fb771bcf0 con 0x555fb7827c80 2024-04-25T02:17:39.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05dd82d740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x555fb77fb910 con 0x555fb7844b60 2024-04-25T02:17:39.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05dd82d740 10 client.0 _ll_register_callbacks cb 0x555fb771b6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:17:39.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05d8fdc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb782af70 0x555fb77f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05d8fdc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb782af70 0x555fb77f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48242/0 (socket says 172.21.15.79:48242) 2024-04-25T02:17:39.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05d8fdc640 1 -- 172.21.15.79:0/2678227450 learned_addr learned my addr 172.21.15.79:0/2678227450 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:39.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05d3fff640 1 --2- 172.21.15.79:0/2678227450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 0x555fb78291c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05d8fdc640 1 -- 172.21.15.79:0/2678227450 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb7844b60 msgr2=0x555fb7829700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:39.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05d8fdc640 1 --2- 172.21.15.79:0/2678227450 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb7844b60 0x555fb7829700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05d8fdc640 1 -- 172.21.15.79:0/2678227450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 msgr2=0x555fb78291c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:39.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05d8fdc640 1 --2- 172.21.15.79:0/2678227450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 0x555fb78291c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05d8fdc640 1 -- 172.21.15.79:0/2678227450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fb753e6b0 con 0x555fb782af70 2024-04-25T02:17:39.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05d8fdc640 1 --2- 172.21.15.79:0/2678227450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb782af70 0x555fb77f6250 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00e840 tx=0x7f05cc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a415387a4dc672 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:39.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.466+0000 7f05b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:17:39.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05b2ffd640 1 -- 172.21.15.79:0/2678227450 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc005dd0 con 0x555fb782af70 2024-04-25T02:17:39.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05b2ffd640 1 -- 172.21.15.79:0/2678227450 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f05cc00c720 con 0x555fb782af70 2024-04-25T02:17:39.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05dd82d740 1 -- 172.21.15.79:0/2678227450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05c407a0f0 con 0x555fb782af70 2024-04-25T02:17:39.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05b2ffd640 1 -- 172.21.15.79:0/2678227450 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f05cc020050 con 0x555fb782af70 2024-04-25T02:17:39.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05dd82d740 10 client.9072 fetch_fsmap learned FSMap version 83 2024-04-25T02:17:39.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05dd82d740 1 -- 172.21.15.79:0/2678227450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x555fb782aa50 con 0x555fb782af70 2024-04-25T02:17:39.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05b2ffd640 1 -- 172.21.15.79:0/2678227450 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c407a0f0 con 0x555fb782af70 2024-04-25T02:17:39.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05b2ffd640 1 -- 172.21.15.79:0/2678227450 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7f05cc023020 con 0x555fb782af70 2024-04-25T02:17:39.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05dd82d740 10 client.9072 fetch_fsmap finished waiting for FSMap version 83 2024-04-25T02:17:39.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05dd82d740 10 client.9072 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:17:39.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05dd82d740 20 client.9072 populate_metadata read hostname 'smithi079' 2024-04-25T02:17:39.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05dd82d740 1 --2- 172.21.15.79:0/2678227450 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x555fb7815830 0x555fb7839690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05dd82d740 4 client.9072 mds_command: new command op to 8919 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:17:39.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05dd82d740 1 -- 172.21.15.79:0/2678227450 --> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fb776d440 con 0x555fb7815830 2024-04-25T02:17:39.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05d3fff640 1 --2- 172.21.15.79:0/2678227450 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x555fb7815830 0x555fb7839690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05b2ffd640 10 client.9072 ms_handle_connect on v2:172.21.15.79:6836/2134535107 2024-04-25T02:17:39.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.467+0000 7f05d3fff640 1 --2- 172.21.15.79:0/2678227450 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x555fb7815830 0x555fb7839690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e16ad850d5b42ac server_cookie=b718bfe7175d76c6 in_seq=0 out_seq=0 2024-04-25T02:17:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.468+0000 7f05b2ffd640 1 -- 172.21.15.79:0/2678227450 <== mds.0 v2:172.21.15.79:6836/2134535107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555fb776d440 con 0x555fb7815830 2024-04-25T02:17:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.468+0000 7f05b2ffd640 10 client.9072 handle_command_reply: tid=0 2024-04-25T02:17:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.468+0000 7f05dd82d740 1 client.9072 shutdown 2024-04-25T02:17:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.468+0000 7f05dd82d740 1 -- 172.21.15.79:0/2678227450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb782af70 msgr2=0x555fb77f6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.468+0000 7f05dd82d740 1 --2- 172.21.15.79:0/2678227450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb782af70 0x555fb77f6250 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00e840 tx=0x7f05cc00ed00 comp rx=0 tx=0).stop 2024-04-25T02:17:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.468+0000 7f05dd82d740 1 -- 172.21.15.79:0/2678227450 shutdown_connections 2024-04-25T02:17:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.468+0000 7f05dd82d740 1 --2- 172.21.15.79:0/2678227450 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x555fb7815830 0x555fb7839690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.468+0000 7f05dd82d740 1 --2- 172.21.15.79:0/2678227450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb782af70 0x555fb77f6250 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.468+0000 7f05dd82d740 1 --2- 172.21.15.79:0/2678227450 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb7844b60 0x555fb7829700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.468+0000 7f05dd82d740 1 --2- 172.21.15.79:0/2678227450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 0x555fb78291c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.468+0000 7f05b2ffd640 0 client.9072 ms_handle_reset on v2:172.21.15.79:6836/2134535107 2024-04-25T02:17:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.468+0000 7f05dd82d740 1 -- 172.21.15.79:0/2678227450 >> 172.21.15.79:0/2678227450 conn(0x555fb7827540 msgr2=0x555fb7842890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:39.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.468+0000 7f05dd82d740 1 -- 172.21.15.79:0/2678227450 shutdown_connections 2024-04-25T02:17:39.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.468+0000 7f05dd82d740 1 -- 172.21.15.79:0/2678227450 wait complete. 2024-04-25T02:17:39.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.468+0000 7f05dd82d740 20 client.9072 trim_cache size 0 max 16384 2024-04-25T02:17:39.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.486+0000 7f05dd82d740 1 Processor -- start 2024-04-25T02:17:39.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.486+0000 7f05dd82d740 1 -- start start 2024-04-25T02:17:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05dd82d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7827c80 0x555fb780ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05dd82d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb782af70 0x555fb780f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05dd82d740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb7844b60 0x555fb785b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05dd82d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05d41fb770 con 0x555fb7827c80 2024-04-25T02:17:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05dd82d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f05d40b07a0 con 0x555fb782af70 2024-04-25T02:17:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05dd82d740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f05d40aa9b0 con 0x555fb7844b60 2024-04-25T02:17:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7827c80 0x555fb780ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7827c80 0x555fb780ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48252/0 (socket says 172.21.15.79:48252) 2024-04-25T02:17:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05d3fff640 1 -- 172.21.15.79:0/3664530551 learned_addr learned my addr 172.21.15.79:0/3664530551 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05d37fe640 1 --2- 172.21.15.79:0/3664530551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb782af70 0x555fb780f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05d8fdc640 1 --2- 172.21.15.79:0/3664530551 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb7844b60 0x555fb785b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05d3fff640 1 -- 172.21.15.79:0/3664530551 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb7844b60 msgr2=0x555fb785b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05d3fff640 1 --2- 172.21.15.79:0/3664530551 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb7844b60 0x555fb785b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05d3fff640 1 -- 172.21.15.79:0/3664530551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb782af70 msgr2=0x555fb780f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05d3fff640 1 --2- 172.21.15.79:0/3664530551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb782af70 0x555fb780f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05d3fff640 1 -- 172.21.15.79:0/3664530551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb77f65c0 con 0x555fb7827c80 2024-04-25T02:17:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05d37fe640 1 --2- 172.21.15.79:0/3664530551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb782af70 0x555fb780f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.487+0000 7f05d3fff640 1 --2- 172.21.15.79:0/3664530551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7827c80 0x555fb780ee50 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f05c40325c0 tx=0x7f05c408e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e082f8816b0990b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.488+0000 7f05b97fa640 1 -- 172.21.15.79:0/3664530551 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c4091040 con 0x555fb7827c80 2024-04-25T02:17:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.488+0000 7f05b97fa640 1 -- 172.21.15.79:0/3664530551 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c407a0f0 con 0x555fb7827c80 2024-04-25T02:17:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.488+0000 7f05b97fa640 1 -- 172.21.15.79:0/3664530551 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c40825d0 con 0x555fb7827c80 2024-04-25T02:17:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.488+0000 7f05dd82d740 1 -- 172.21.15.79:0/3664530551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7827c80 msgr2=0x555fb780ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.488+0000 7f05dd82d740 1 --2- 172.21.15.79:0/3664530551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7827c80 0x555fb780ee50 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f05c40325c0 tx=0x7f05c408e000 comp rx=0 tx=0).stop 2024-04-25T02:17:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.488+0000 7f05dd82d740 1 -- 172.21.15.79:0/3664530551 shutdown_connections 2024-04-25T02:17:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.488+0000 7f05dd82d740 1 --2- 172.21.15.79:0/3664530551 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb7844b60 0x555fb785b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.488+0000 7f05dd82d740 1 --2- 172.21.15.79:0/3664530551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb782af70 0x555fb780f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.488+0000 7f05dd82d740 1 --2- 172.21.15.79:0/3664530551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7827c80 0x555fb780ee50 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.488+0000 7f05dd82d740 1 -- 172.21.15.79:0/3664530551 >> 172.21.15.79:0/3664530551 conn(0x555fb7827540 msgr2=0x555fb77f2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:39.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.488+0000 7f05dd82d740 1 -- 172.21.15.79:0/3664530551 shutdown_connections 2024-04-25T02:17:39.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.488+0000 7f05dd82d740 1 -- 172.21.15.79:0/3664530551 wait complete. 2024-04-25T02:17:39.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.489+0000 7f05dd82d740 1 -- start start 2024-04-25T02:17:39.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.489+0000 7f05dd82d740 1 Processor -- start 2024-04-25T02:17:39.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05dd82d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 0x555fb78416e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05dd82d740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb782af70 0x555fb780ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05dd82d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7844b60 0x555fb780f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05dd82d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555fb78156b0 con 0x555fb7844b60 2024-04-25T02:17:39.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05dd82d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555fb7816030 con 0x555fb7827c80 2024-04-25T02:17:39.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05dd82d740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x555fb7815cd0 con 0x555fb782af70 2024-04-25T02:17:39.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05dd82d740 10 client.0 _ll_register_callbacks cb 0x7f05cc00e3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:17:39.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05d8fdc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7844b60 0x555fb780f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05d8fdc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7844b60 0x555fb780f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48258/0 (socket says 172.21.15.79:48258) 2024-04-25T02:17:39.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05d8fdc640 1 -- 172.21.15.79:0/795082413 learned_addr learned my addr 172.21.15.79:0/795082413 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:39.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05d37fe640 1 --2- 172.21.15.79:0/795082413 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb782af70 0x555fb780ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05d3fff640 1 --2- 172.21.15.79:0/795082413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 0x555fb78416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05d8fdc640 1 -- 172.21.15.79:0/795082413 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb782af70 msgr2=0x555fb780ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:39.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05d8fdc640 1 --2- 172.21.15.79:0/795082413 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb782af70 0x555fb780ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05d8fdc640 1 -- 172.21.15.79:0/795082413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 msgr2=0x555fb78416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05d8fdc640 1 --2- 172.21.15.79:0/795082413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 0x555fb78416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05d8fdc640 1 -- 172.21.15.79:0/795082413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fb7813f10 con 0x555fb7844b60 2024-04-25T02:17:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05d37fe640 1 --2- 172.21.15.79:0/795082413 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb782af70 0x555fb780ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05d8fdc640 1 --2- 172.21.15.79:0/795082413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7844b60 0x555fb780f390 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00e840 tx=0x7f05cc0016a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835b6c2440c600b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:17:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05b2ffd640 1 -- 172.21.15.79:0/795082413 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc013680 con 0x555fb7844b60 2024-04-25T02:17:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05b2ffd640 1 -- 172.21.15.79:0/795082413 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f05cc02eaf0 con 0x555fb7844b60 2024-04-25T02:17:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.490+0000 7f05dd82d740 1 -- 172.21.15.79:0/795082413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05c407a0f0 con 0x555fb7844b60 2024-04-25T02:17:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05b2ffd640 1 -- 172.21.15.79:0/795082413 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f05cc02ecf0 con 0x555fb7844b60 2024-04-25T02:17:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05dd82d740 10 client.9078 fetch_fsmap learned FSMap version 83 2024-04-25T02:17:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05dd82d740 1 -- 172.21.15.79:0/795082413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x555fb78bc6c0 con 0x555fb7844b60 2024-04-25T02:17:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05b2ffd640 1 -- 172.21.15.79:0/795082413 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c407a0f0 con 0x555fb7844b60 2024-04-25T02:17:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05b2ffd640 1 -- 172.21.15.79:0/795082413 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7f05cc02b070 con 0x555fb7844b60 2024-04-25T02:17:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05dd82d740 10 client.9078 fetch_fsmap finished waiting for FSMap version 83 2024-04-25T02:17:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05dd82d740 10 client.9078 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:17:39.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05dd82d740 20 client.9078 populate_metadata read hostname 'smithi079' 2024-04-25T02:17:39.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05dd82d740 1 --2- 172.21.15.79:0/795082413 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x555fb7837990 0x555fb7837d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05dd82d740 4 client.9078 mds_command: new command op to 8919 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:17:39.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05dd82d740 1 -- 172.21.15.79:0/795082413 --> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] -- command(tid 0: {"prefix": "status"}) -- 0x555fb7767790 con 0x555fb7837990 2024-04-25T02:17:39.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05d3fff640 1 --2- 172.21.15.79:0/795082413 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x555fb7837990 0x555fb7837d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05b2ffd640 10 client.9078 ms_handle_connect on v2:172.21.15.79:6836/2134535107 2024-04-25T02:17:39.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05d3fff640 1 --2- 172.21.15.79:0/795082413 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x555fb7837990 0x555fb7837d70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8445e4e2007e656 server_cookie=f042debf2b53e8cb in_seq=0 out_seq=0 2024-04-25T02:17:39.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05b2ffd640 1 -- 172.21.15.79:0/795082413 <== mds.0 v2:172.21.15.79:6836/2134535107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x555fb7767790 con 0x555fb7837990 2024-04-25T02:17:39.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05b2ffd640 10 client.9078 handle_command_reply: tid=0 2024-04-25T02:17:39.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.491+0000 7f05dd82d740 1 client.9078 shutdown 2024-04-25T02:17:39.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05dd82d740 1 -- 172.21.15.79:0/795082413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7844b60 msgr2=0x555fb780f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05dd82d740 1 --2- 172.21.15.79:0/795082413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7844b60 0x555fb780f390 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00e840 tx=0x7f05cc0016a0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05dd82d740 1 -- 172.21.15.79:0/795082413 shutdown_connections 2024-04-25T02:17:39.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05dd82d740 1 --2- 172.21.15.79:0/795082413 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x555fb7837990 0x555fb7837d70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05dd82d740 1 --2- 172.21.15.79:0/795082413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fb7844b60 0x555fb780f390 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05dd82d740 1 --2- 172.21.15.79:0/795082413 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x555fb782af70 0x555fb780ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05b2ffd640 0 client.9078 ms_handle_reset on v2:172.21.15.79:6836/2134535107 2024-04-25T02:17:39.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05dd82d740 1 --2- 172.21.15.79:0/795082413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fb7827c80 0x555fb78416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05dd82d740 1 -- 172.21.15.79:0/795082413 >> 172.21.15.79:0/795082413 conn(0x555fb7827540 msgr2=0x555fb7829640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:39.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05dd82d740 1 -- 172.21.15.79:0/795082413 shutdown_connections 2024-04-25T02:17:39.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05dd82d740 1 -- 172.21.15.79:0/795082413 wait complete. 2024-04-25T02:17:39.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05dd82d740 20 client.9078 trim_cache size 0 max 16384 2024-04-25T02:17:39.507 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:17:39.507 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "696648c4-3e52-400b-a780-2e8863c56c42", 2024-04-25T02:17:39.507 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-04-25T02:17:39.507 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 8919, 2024-04-25T02:17:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-04-25T02:17:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-04-25T02:17:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-04-25T02:17:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.8802774900000001, 2024-04-25T02:17:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 83, 2024-04-25T02:17:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 115, 2024-04-25T02:17:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 115, 2024-04-25T02:17:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 9.9326824429999991 2024-04-25T02:17:39.508 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:17:39.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05daa3f640 1 -- 172.21.15.79:0/291910340 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f05c006be30 msgr2=0x7f05c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05daa3f640 1 --2- 172.21.15.79:0/291910340 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f05c006be30 0x7f05c006e2f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f05c8006fd0 tx=0x7f05c8008040 comp rx=0 tx=0).stop 2024-04-25T02:17:39.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05daa3f640 1 -- 172.21.15.79:0/291910340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05d406df50 msgr2=0x7f05d413f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05daa3f640 1 --2- 172.21.15.79:0/291910340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05d406df50 0x7f05d413f570 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f05c4009890 tx=0x7f05c40046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05daa3f640 1 -- 172.21.15.79:0/291910340 shutdown_connections 2024-04-25T02:17:39.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05daa3f640 1 --2- 172.21.15.79:0/291910340 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f05c006be30 0x7f05c006e2f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05daa3f640 1 --2- 172.21.15.79:0/291910340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05d4143bc0 0x7f05d41429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05daa3f640 1 --2- 172.21.15.79:0/291910340 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05d40b48e0 0x7f05d4142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05daa3f640 1 --2- 172.21.15.79:0/291910340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05d406df50 0x7f05d413f570 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05daa3f640 1 -- 172.21.15.79:0/291910340 >> 172.21.15.79:0/291910340 conn(0x7f05d40cfc80 msgr2=0x7f05d40cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:39.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05daa3f640 1 -- 172.21.15.79:0/291910340 shutdown_connections 2024-04-25T02:17:39.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.492+0000 7f05daa3f640 1 -- 172.21.15.79:0/291910340 wait complete. 2024-04-25T02:17:39.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:17:39.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.603+0000 7faa791fb640 1 Processor -- start 2024-04-25T02:17:39.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.603+0000 7faa791fb640 1 -- start start 2024-04-25T02:17:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa791fb640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa7406df50 0x7faa7406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa791fb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa74070d90 con 0x7faa74144cb0 2024-04-25T02:17:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa791fb640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa740cf130 con 0x7faa74071240 2024-04-25T02:17:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa791fb640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faa7406e8f0 con 0x7faa7406df50 2024-04-25T02:17:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa72d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faa74144cb0 0x7faa740b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57752/0 (socket says 172.21.15.79:57752) 2024-04-25T02:17:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa72d9d640 1 -- 172.21.15.79:0/3482638136 learned_addr learned my addr 172.21.15.79:0/3482638136 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa7259c640 1 -- 172.21.15.79:0/3482638136 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2807397144 0 0) 0x7faa74070d90 con 0x7faa74144cb0 2024-04-25T02:17:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa6bfff640 1 --2- 172.21.15.79:0/3482638136 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa7406df50 0x7faa7406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa7259c640 1 -- 172.21.15.79:0/3482638136 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa60003520 con 0x7faa74144cb0 2024-04-25T02:17:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa7259c640 1 -- 172.21.15.79:0/3482638136 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3958846221 0 0) 0x7faa60003520 con 0x7faa74144cb0 2024-04-25T02:17:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa7259c640 1 -- 172.21.15.79:0/3482638136 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa7406df50 msgr2=0x7faa7406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa7259c640 1 --2- 172.21.15.79:0/3482638136 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa7406df50 0x7faa7406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa7259c640 1 -- 172.21.15.79:0/3482638136 >> v1:172.21.15.189:6789/0 conn(0x7faa74071240 legacy=0x7faa740716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa7259c640 1 -- 172.21.15.79:0/3482638136 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa740cf410 con 0x7faa74144cb0 2024-04-25T02:17:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa7259c640 1 -- 172.21.15.79:0/3482638136 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7faa64001670 con 0x7faa74144cb0 2024-04-25T02:17:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.604+0000 7faa7259c640 1 -- 172.21.15.79:0/3482638136 >> v1:172.21.15.79:6789/0 conn(0x7faa74144cb0 legacy=0x7faa740b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.605+0000 7faa7259c640 1 --2- 172.21.15.79:0/3482638136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa600039e0 0x7faa60003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.605+0000 7faa7259c640 1 --2- 172.21.15.79:0/3482638136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa60004800 0x7faa60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.605+0000 7faa7259c640 1 --2- 172.21.15.79:0/3482638136 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa7406df50 0x7faa6000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.605+0000 7faa7259c640 1 -- 172.21.15.79:0/3482638136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faa60005570 con 0x7faa60004800 2024-04-25T02:17:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.605+0000 7faa7259c640 1 -- 172.21.15.79:0/3482638136 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faa6000bf00 con 0x7faa600039e0 2024-04-25T02:17:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.605+0000 7faa7259c640 1 -- 172.21.15.79:0/3482638136 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faa6000c080 con 0x7faa7406df50 2024-04-25T02:17:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.605+0000 7faa6bfff640 1 --2- 172.21.15.79:0/3482638136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa60004800 0x7faa60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.605+0000 7faa72d9d640 1 --2- 172.21.15.79:0/3482638136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa600039e0 0x7faa60003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.605+0000 7faa7359e640 1 --2- 172.21.15.79:0/3482638136 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa7406df50 0x7faa6000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.605+0000 7faa6bfff640 1 -- 172.21.15.79:0/3482638136 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa7406df50 msgr2=0x7faa6000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.605+0000 7faa6bfff640 1 --2- 172.21.15.79:0/3482638136 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa7406df50 0x7faa6000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.605+0000 7faa6bfff640 1 -- 172.21.15.79:0/3482638136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa600039e0 msgr2=0x7faa60003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.605+0000 7faa6bfff640 1 --2- 172.21.15.79:0/3482638136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa600039e0 0x7faa60003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.605+0000 7faa6bfff640 1 -- 172.21.15.79:0/3482638136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa60003520 con 0x7faa60004800 2024-04-25T02:17:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.606+0000 7faa6bfff640 1 --2- 172.21.15.79:0/3482638136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa60004800 0x7faa60004c80 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00ba30 tx=0x7faa60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a5447447cf7c36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.606+0000 7faa7259c640 1 -- 172.21.15.79:0/3482638136 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c030070 con 0x7faa60004800 2024-04-25T02:17:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.606+0000 7faa7259c640 1 -- 172.21.15.79:0/3482638136 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa5c02ade0 con 0x7faa60004800 2024-04-25T02:17:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.606+0000 7faa7259c640 1 -- 172.21.15.79:0/3482638136 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00b600 con 0x7faa60004800 2024-04-25T02:17:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.606+0000 7faa791fb640 1 -- 172.21.15.79:0/3482638136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa60004800 msgr2=0x7faa60004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.606+0000 7faa791fb640 1 --2- 172.21.15.79:0/3482638136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa60004800 0x7faa60004c80 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00ba30 tx=0x7faa60005830 comp rx=0 tx=0).stop 2024-04-25T02:17:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.606+0000 7faa7359e640 1 -- 172.21.15.79:0/3482638136 reap_dead start 2024-04-25T02:17:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.606+0000 7faa791fb640 1 -- 172.21.15.79:0/3482638136 shutdown_connections 2024-04-25T02:17:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.606+0000 7faa791fb640 1 -- 172.21.15.79:0/3482638136 >> 172.21.15.79:0/3482638136 conn(0x7faa740cfc80 msgr2=0x7faa740d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.606+0000 7faa791fb640 1 -- 172.21.15.79:0/3482638136 shutdown_connections 2024-04-25T02:17:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.606+0000 7faa791fb640 1 -- 172.21.15.79:0/3482638136 wait complete. 2024-04-25T02:17:39.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.608+0000 7faa791fb640 1 Processor -- start 2024-04-25T02:17:39.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.608+0000 7faa791fb640 1 -- start start 2024-04-25T02:17:39.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.608+0000 7faa791fb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa60004800 0x7faa74140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.608+0000 7faa791fb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa740adf40 0x7faa740ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.608+0000 7faa791fb640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa740a9f00 0x7faa740aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.608+0000 7faa791fb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faa740cf9d0 con 0x7faa740adf40 2024-04-25T02:17:39.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.608+0000 7faa791fb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faa740b5750 con 0x7faa60004800 2024-04-25T02:17:39.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.608+0000 7faa791fb640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faa74145090 con 0x7faa740a9f00 2024-04-25T02:17:39.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.608+0000 7faa6bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa740adf40 0x7faa740ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.608+0000 7faa6bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa740adf40 0x7faa740ae3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48272/0 (socket says 172.21.15.79:48272) 2024-04-25T02:17:39.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.608+0000 7faa6bfff640 1 -- 172.21.15.79:0/1184879896 learned_addr learned my addr 172.21.15.79:0/1184879896 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:39.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.609+0000 7faa6bfff640 1 -- 172.21.15.79:0/1184879896 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa740a9f00 msgr2=0x7faa740aa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.609+0000 7faa7359e640 1 --2- 172.21.15.79:0/1184879896 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa740a9f00 0x7faa740aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.609+0000 7faa72d9d640 1 --2- 172.21.15.79:0/1184879896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa60004800 0x7faa74140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.609+0000 7faa6bfff640 1 --2- 172.21.15.79:0/1184879896 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa740a9f00 0x7faa740aa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.609+0000 7faa6bfff640 1 -- 172.21.15.79:0/1184879896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa60004800 msgr2=0x7faa74140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.609+0000 7faa6bfff640 1 --2- 172.21.15.79:0/1184879896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa60004800 0x7faa74140720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.609+0000 7faa6bfff640 1 -- 172.21.15.79:0/1184879896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa740ae900 con 0x7faa740adf40 2024-04-25T02:17:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.609+0000 7faa6bfff640 1 --2- 172.21.15.79:0/1184879896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa740adf40 0x7faa740ae3c0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7faa5c02a8d0 tx=0x7faa5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.609+0000 7faa6b7fe640 1 -- 172.21.15.79:0/1184879896 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c043030 con 0x7faa740adf40 2024-04-25T02:17:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.609+0000 7faa6b7fe640 1 -- 172.21.15.79:0/1184879896 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa5c02abe0 con 0x7faa740adf40 2024-04-25T02:17:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.609+0000 7faa791fb640 1 -- 172.21.15.79:0/1184879896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa740aacc0 con 0x7faa740adf40 2024-04-25T02:17:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.609+0000 7faa6b7fe640 1 -- 172.21.15.79:0/1184879896 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00b600 con 0x7faa740adf40 2024-04-25T02:17:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.609+0000 7faa791fb640 1 -- 172.21.15.79:0/1184879896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa7414c810 con 0x7faa740adf40 2024-04-25T02:17:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.610+0000 7faa791fb640 1 -- 172.21.15.79:0/1184879896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa740690a0 con 0x7faa740adf40 2024-04-25T02:17:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.610+0000 7faa6b7fe640 1 -- 172.21.15.79:0/1184879896 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa5c046070 con 0x7faa740adf40 2024-04-25T02:17:39.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.611+0000 7faa6b7fe640 1 --2- 172.21.15.79:0/1184879896 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa5406be30 0x7faa5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:39.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.611+0000 7faa6b7fe640 1 -- 172.21.15.79:0/1184879896 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7faa5c0ab980 con 0x7faa740adf40 2024-04-25T02:17:39.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.611+0000 7faa72d9d640 1 --2- 172.21.15.79:0/1184879896 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa5406be30 0x7faa5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:39.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.611+0000 7faa72d9d640 1 --2- 172.21.15.79:0/1184879896 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa5406be30 0x7faa5406e2f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7faa7414c260 tx=0x7faa64009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:39.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.615+0000 7faa6b7fe640 1 -- 172.21.15.79:0/1184879896 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faa740ae900 con 0x7faa740adf40 2024-04-25T02:17:39.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.828+0000 7faa791fb640 1 -- 172.21.15.79:0/1184879896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7faa740d0b90 con 0x7faa740adf40 2024-04-25T02:17:39.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.829+0000 7faa6b7fe640 1 -- 172.21.15.79:0/1184879896 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) ==== 53+0+73 (secure 0 0 0) 0x7faa5c07a2a0 con 0x7faa740adf40 2024-04-25T02:17:39.833 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:17:39.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.831+0000 7faa791fb640 1 -- 172.21.15.79:0/1184879896 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa5406be30 msgr2=0x7faa5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.831+0000 7faa791fb640 1 --2- 172.21.15.79:0/1184879896 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa5406be30 0x7faa5406e2f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7faa7414c260 tx=0x7faa64009040 comp rx=0 tx=0).stop 2024-04-25T02:17:39.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.831+0000 7faa791fb640 1 -- 172.21.15.79:0/1184879896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa740adf40 msgr2=0x7faa740ae3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:39.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.831+0000 7faa791fb640 1 --2- 172.21.15.79:0/1184879896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa740adf40 0x7faa740ae3c0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7faa5c02a8d0 tx=0x7faa5c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.831+0000 7faa791fb640 1 -- 172.21.15.79:0/1184879896 shutdown_connections 2024-04-25T02:17:39.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.831+0000 7faa791fb640 1 --2- 172.21.15.79:0/1184879896 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faa5406be30 0x7faa5406e2f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.831+0000 7faa791fb640 1 --2- 172.21.15.79:0/1184879896 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faa740a9f00 0x7faa740aa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.831+0000 7faa791fb640 1 --2- 172.21.15.79:0/1184879896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa740adf40 0x7faa740ae3c0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.831+0000 7faa791fb640 1 --2- 172.21.15.79:0/1184879896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa60004800 0x7faa74140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:39.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.831+0000 7faa791fb640 1 -- 172.21.15.79:0/1184879896 >> 172.21.15.79:0/1184879896 conn(0x7faa740cfc80 msgr2=0x7faa740b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:39.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.831+0000 7faa791fb640 1 -- 172.21.15.79:0/1184879896 shutdown_connections 2024-04-25T02:17:39.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:39.831+0000 7faa791fb640 1 -- 172.21.15.79:0/1184879896 wait complete. 2024-04-25T02:17:39.846 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:17:39.846 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:17:39.846 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:17:39.846 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:17:39.846 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:17:39.846 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:17:39.846 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:17:39.846 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:17:39.846 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:17:39.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:39.847 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:17:39.863 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:17:39.863 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:17:39.863 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:17:39.863 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:39.863 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:17:39.863 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:39.864 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:17:39.864 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:17:39.864 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:17:39.864 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:17:39.864 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:17:39.864 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:17:39.864 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:17:39.865 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:17:39.865 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:17:39.865 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:17:39.865 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:17:39.865 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42146sec preferred_lft 42146sec 2024-04-25T02:17:39.865 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:17:39.866 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:39.866 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:17:39.866 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:17:39.866 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:17:39.866 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:39.866 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:17:39.866 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:39.867 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:17:39.867 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:17:39.867 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link 2024-04-25T02:17:39.867 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:39.867 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:17:39.867 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:17:39.868 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::4c:adff:fe56:7194/64 scope link 2024-04-25T02:17:39.868 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:39.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:39.869 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:17:39.892 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-04-25T02:17:39.888+0000 7fb171fa5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:17:39.913 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:17:39.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:39.915 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:17:39.971 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:17:39.971 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:17:39.971 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:17:39.971 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:17:39.971 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:17:39.972 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:17:39.972 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:17:39.972 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:17:39.972 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:17:39.972 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:17:39.972 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:17:40.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:17:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:40.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:40.094 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:17:40.109 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:17:40.109 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:17:40.109 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:17:40.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:40.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:17:40.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:17:40.173 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:17:40.228 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:17:40.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:17:40.228 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:17:40.283 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:17:40.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:40.283 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:17:40.364 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:17:40.364 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:17:40.365 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:17:40.373 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:17:40.373 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:17:40.373 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:17:40.373 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:17:40.373 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:17:40.377 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:17:40.378 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:17:40.378 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:17:40.378 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:17:40.378 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:17:40.378 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:17:40.378 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:17:40.378 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:17:40.378 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:17:40.379 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:17:40.379 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:17:40.379 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:17:40.379 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:17:40.381 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:17:40.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:40.381 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:17:40.445 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:17:40.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:17:40.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:40.543 INFO:teuthology.orchestra.run.smithi079.stdout:client6533 2024-04-25T02:17:40.544 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:17:40.544 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:40.561 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:40.561 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:40.561 DEBUG:teuthology.orchestra.run.smithi079:> mount_point = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T02:17:40.561 DEBUG:teuthology.orchestra.run.smithi079:> parent = os.path.join(mount_point, "parent") 2024-04-25T02:17:40.561 DEBUG:teuthology.orchestra.run.smithi079:> os.mkdir(parent) 2024-04-25T02:17:40.561 DEBUG:teuthology.orchestra.run.smithi079:> flushed = os.path.join(parent, "flushed") 2024-04-25T02:17:40.561 DEBUG:teuthology.orchestra.run.smithi079:> os.mkdir(flushed) 2024-04-25T02:17:40.561 DEBUG:teuthology.orchestra.run.smithi079:> for f in ["alpha", "bravo", "charlie"]: 2024-04-25T02:17:40.561 DEBUG:teuthology.orchestra.run.smithi079:> open(os.path.join(flushed, f), '"'"'w'"'"').write(f) 2024-04-25T02:17:40.562 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:40.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:40.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:40.683 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T02:17:40.745 INFO:teuthology.orchestra.run.smithi079.stdout:./ 2024-04-25T02:17:40.745 INFO:teuthology.orchestra.run.smithi079.stdout:./parent 2024-04-25T02:17:40.745 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed 2024-04-25T02:17:40.745 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/charlie 2024-04-25T02:17:40.745 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/alpha 2024-04-25T02:17:40.746 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/bravo 2024-04-25T02:17:40.746 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:40.746 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:40.746 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:17:40.746 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:17:40.746 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T02:17:40.746 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:40.849 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:17:40.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:40.858 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:40.858 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:40.858 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:17:40.858 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:17:40.858 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T02:17:40.858 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:40.963 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627776 2024-04-25T02:17:40.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:40.972 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:40.972 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:40.972 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:17:40.972 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:17:40.972 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T02:17:40.972 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:41.076 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627777 2024-04-25T02:17:41.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:41.085 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:41.085 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:41.085 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:17:41.085 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:17:41.086 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T02:17:41.086 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:41.189 INFO:teuthology.orchestra.run.smithi079.stdout:1099511628280 2024-04-25T02:17:41.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:41.198 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:41.198 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:41.198 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:17:41.198 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:17:41.198 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T02:17:41.198 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:41.303 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627778 2024-04-25T02:17:41.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:41.313 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:41.313 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:41.313 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:17:41.313 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:17:41.313 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-25T02:17:41.313 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:41.417 INFO:teuthology.orchestra.run.smithi079.stdout:1099511628279 2024-04-25T02:17:41.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:41.426 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:17:41.426 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:41.481 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:17:41.481 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:41.537 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:17:41.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.672+0000 7f2ecde76640 1 Processor -- start 2024-04-25T02:17:41.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.672+0000 7f2ecde76640 1 -- start start 2024-04-25T02:17:41.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.672+0000 7f2ecde76640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2ec8144cb0 0x7f2ec80b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:41.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.672+0000 7f2ecde76640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec8070d90 con 0x7f2ec80b5580 2024-04-25T02:17:41.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.672+0000 7f2ecde76640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec80cf130 con 0x7f2ec806e660 2024-04-25T02:17:41.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.672+0000 7f2ecde76640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec80cf410 con 0x7f2ec8144cb0 2024-04-25T02:17:41.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.673+0000 7f2ec77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2ec8144cb0 0x7f2ec80b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:41.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.673+0000 7f2ec6ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2ec80b5580 0x7f2ec806df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57754/0 (socket says 172.21.15.79:57754) 2024-04-25T02:17:41.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.673+0000 7f2ec6ffd640 1 -- 172.21.15.79:0/3348037460 learned_addr learned my addr 172.21.15.79:0/3348037460 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:41.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.673+0000 7f2ec77fe640 1 -- 172.21.15.79:0/3348037460 >> v1:172.21.15.189:6789/0 conn(0x7f2ec806e660 legacy=0x7f2ec8071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:41.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.673+0000 7f2ec77fe640 1 -- 172.21.15.79:0/3348037460 >> v1:172.21.15.79:6789/0 conn(0x7f2ec80b5580 legacy=0x7f2ec806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:41.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.673+0000 7f2ec67fc640 1 -- 172.21.15.79:0/3348037460 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3283913671 0 0) 0x7f2ec8070d90 con 0x7f2ec80b5580 2024-04-25T02:17:41.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.673+0000 7f2ec77fe640 1 -- 172.21.15.79:0/3348037460 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec80cf6f0 con 0x7f2ec8144cb0 2024-04-25T02:17:41.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.673+0000 7f2ec77fe640 1 --2- 172.21.15.79:0/3348037460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ec8144cb0 0x7f2ec80b5040 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0097d0 tx=0x7f2ebc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594d2b474d757b5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:41.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.674+0000 7f2ec67fc640 1 -- 172.21.15.79:0/3348037460 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc037070 con 0x7f2ec8144cb0 2024-04-25T02:17:41.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.674+0000 7f2ec67fc640 1 -- 172.21.15.79:0/3348037460 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc02ae10 con 0x7f2ec8144cb0 2024-04-25T02:17:41.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.674+0000 7f2ec67fc640 1 -- 172.21.15.79:0/3348037460 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc032660 con 0x7f2ec8144cb0 2024-04-25T02:17:41.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.674+0000 7f2ecde76640 1 -- 172.21.15.79:0/3348037460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ec8144cb0 msgr2=0x7f2ec80b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:41.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.674+0000 7f2ecde76640 1 --2- 172.21.15.79:0/3348037460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ec8144cb0 0x7f2ec80b5040 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0097d0 tx=0x7f2ebc02a100 comp rx=0 tx=0).stop 2024-04-25T02:17:41.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.674+0000 7f2ecde76640 1 -- 172.21.15.79:0/3348037460 shutdown_connections 2024-04-25T02:17:41.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.674+0000 7f2ecde76640 1 --2- 172.21.15.79:0/3348037460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ec8144cb0 0x7f2ec80b5040 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:41.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.674+0000 7f2ecde76640 1 -- 172.21.15.79:0/3348037460 >> 172.21.15.79:0/3348037460 conn(0x7f2ec80cfc80 msgr2=0x7f2ec80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:41.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.674+0000 7f2ecde76640 1 -- 172.21.15.79:0/3348037460 shutdown_connections 2024-04-25T02:17:41.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.674+0000 7f2ecde76640 1 -- 172.21.15.79:0/3348037460 wait complete. 2024-04-25T02:17:41.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.675+0000 7f2ecde76640 1 Processor -- start 2024-04-25T02:17:41.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.676+0000 7f2ecde76640 1 -- start start 2024-04-25T02:17:41.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.676+0000 7f2ecde76640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ec806e660 0x7f2ec8154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:41.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.676+0000 7f2ecde76640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ec80b5580 0x7f2ec8157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:41.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.676+0000 7f2ecde76640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ec8144cb0 0x7f2ec8142150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:41.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.676+0000 7f2ecde76640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec8145ab0 con 0x7f2ec80b5580 2024-04-25T02:17:41.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.676+0000 7f2ecde76640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec8145090 con 0x7f2ec8144cb0 2024-04-25T02:17:41.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.676+0000 7f2ecde76640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec8145c30 con 0x7f2ec806e660 2024-04-25T02:17:41.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.676+0000 7f2ec6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ec80b5580 0x7f2ec8157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:41.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.676+0000 7f2ec6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ec80b5580 0x7f2ec8157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48290/0 (socket says 172.21.15.79:48290) 2024-04-25T02:17:41.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.676+0000 7f2ec6ffd640 1 -- 172.21.15.79:0/2947812425 learned_addr learned my addr 172.21.15.79:0/2947812425 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:41.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.677+0000 7f2ec7fff640 1 --2- 172.21.15.79:0/2947812425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ec8144cb0 0x7f2ec8142150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:41.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.677+0000 7f2ec6ffd640 1 -- 172.21.15.79:0/2947812425 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ec806e660 msgr2=0x7f2ec8154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:41.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.677+0000 7f2ec6ffd640 1 --2- 172.21.15.79:0/2947812425 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ec806e660 0x7f2ec8154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:41.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.677+0000 7f2ec6ffd640 1 -- 172.21.15.79:0/2947812425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ec8144cb0 msgr2=0x7f2ec8142150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:41.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.677+0000 7f2ec6ffd640 1 --2- 172.21.15.79:0/2947812425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ec8144cb0 0x7f2ec8142150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:41.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.677+0000 7f2ec6ffd640 1 -- 172.21.15.79:0/2947812425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec8132010 con 0x7f2ec80b5580 2024-04-25T02:17:41.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.677+0000 7f2ec7fff640 1 --2- 172.21.15.79:0/2947812425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ec8144cb0 0x7f2ec8142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:41.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.677+0000 7f2ec6ffd640 1 --2- 172.21.15.79:0/2947812425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ec80b5580 0x7f2ec8157bd0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c4e0 tx=0x7f2eb800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:41.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.677+0000 7f2eaffff640 1 -- 172.21.15.79:0/2947812425 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8018070 con 0x7f2ec80b5580 2024-04-25T02:17:41.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.677+0000 7f2eaffff640 1 -- 172.21.15.79:0/2947812425 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb8007500 con 0x7f2ec80b5580 2024-04-25T02:17:41.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.677+0000 7f2ecde76640 1 -- 172.21.15.79:0/2947812425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec81322f0 con 0x7f2ec80b5580 2024-04-25T02:17:41.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.677+0000 7f2eaffff640 1 -- 172.21.15.79:0/2947812425 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8004a20 con 0x7f2ec80b5580 2024-04-25T02:17:41.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.677+0000 7f2ecde76640 1 -- 172.21.15.79:0/2947812425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec81328b0 con 0x7f2ec80b5580 2024-04-25T02:17:41.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.678+0000 7f2ecde76640 1 -- 172.21.15.79:0/2947812425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec80690a0 con 0x7f2ec80b5580 2024-04-25T02:17:41.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.678+0000 7f2eaffff640 1 -- 172.21.15.79:0/2947812425 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2eb801b070 con 0x7f2ec80b5580 2024-04-25T02:17:41.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.679+0000 7f2eaffff640 1 --2- 172.21.15.79:0/2947812425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2eb406be60 0x7f2eb406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:41.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.679+0000 7f2eaffff640 1 -- 172.21.15.79:0/2947812425 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f2eb808a220 con 0x7f2ec80b5580 2024-04-25T02:17:41.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.679+0000 7f2ec77fe640 1 --2- 172.21.15.79:0/2947812425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2eb406be60 0x7f2eb406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:41.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.679+0000 7f2ec77fe640 1 --2- 172.21.15.79:0/2947812425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2eb406be60 0x7f2eb406e320 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc034000 tx=0x7f2ebc02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:41.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.683+0000 7f2eaffff640 1 -- 172.21.15.79:0/2947812425 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2eb8058c00 con 0x7f2ec80b5580 2024-04-25T02:17:41.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.861+0000 7f2ecde76640 1 -- 172.21.15.79:0/2947812425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ec8144460 con 0x7f2ec80b5580 2024-04-25T02:17:41.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.862+0000 7f2eaffff640 1 -- 172.21.15.79:0/2947812425 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16639 (secure 0 0 0) 0x7f2eb8058500 con 0x7f2ec80b5580 2024-04-25T02:17:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:41.867 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":115,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:17:35.622563+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:17:32.207579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T02:17:32.929915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:17:41.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.864+0000 7f2ecde76640 1 -- 172.21.15.79:0/2947812425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2eb406be60 msgr2=0x7f2eb406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:41.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.864+0000 7f2ecde76640 1 --2- 172.21.15.79:0/2947812425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2eb406be60 0x7f2eb406e320 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc034000 tx=0x7f2ebc02c000 comp rx=0 tx=0).stop 2024-04-25T02:17:41.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.864+0000 7f2ecde76640 1 -- 172.21.15.79:0/2947812425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ec80b5580 msgr2=0x7f2ec8157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:41.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.864+0000 7f2ecde76640 1 --2- 172.21.15.79:0/2947812425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ec80b5580 0x7f2ec8157bd0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c4e0 tx=0x7f2eb800c9a0 comp rx=0 tx=0).stop 2024-04-25T02:17:41.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.865+0000 7f2ecde76640 1 -- 172.21.15.79:0/2947812425 shutdown_connections 2024-04-25T02:17:41.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.865+0000 7f2ecde76640 1 --2- 172.21.15.79:0/2947812425 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2eb406be60 0x7f2eb406e320 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:41.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.865+0000 7f2ecde76640 1 --2- 172.21.15.79:0/2947812425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ec8144cb0 0x7f2ec8142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:41.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.865+0000 7f2ecde76640 1 --2- 172.21.15.79:0/2947812425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ec80b5580 0x7f2ec8157bd0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:41.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.865+0000 7f2ecde76640 1 --2- 172.21.15.79:0/2947812425 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ec806e660 0x7f2ec8154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:41.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.865+0000 7f2ecde76640 1 -- 172.21.15.79:0/2947812425 >> 172.21.15.79:0/2947812425 conn(0x7f2ec80cfc80 msgr2=0x7f2ec8071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:41.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.865+0000 7f2ecde76640 1 -- 172.21.15.79:0/2947812425 shutdown_connections 2024-04-25T02:17:41.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.865+0000 7f2ecde76640 1 -- 172.21.15.79:0/2947812425 wait complete. 2024-04-25T02:17:41.880 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:17:32.207579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:17:32.929915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:17:41.880 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:17:41.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.978+0000 7f2fb6c9a640 1 Processor -- start 2024-04-25T02:17:41.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.978+0000 7f2fb6c9a640 1 -- start start 2024-04-25T02:17:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.978+0000 7f2fb6c9a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2fb015e4f0 0x7f2fb00d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.978+0000 7f2fb6c9a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb00d10c0 0x7f2fb006bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.978+0000 7f2fb6c9a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fb00d1ee0 con 0x7f2fb00cf7f0 2024-04-25T02:17:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.978+0000 7f2fb6c9a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb00d21c0 con 0x7f2fb015e4f0 2024-04-25T02:17:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.978+0000 7f2fb6c9a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb00d24a0 con 0x7f2fb00d10c0 2024-04-25T02:17:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.979+0000 7f2fb4a36640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2fb015e4f0 0x7f2fb00d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.979+0000 7f2faffff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f2fb00cf7f0 0x7f2fb00d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:40324/0 (socket says 172.21.15.79:40324) 2024-04-25T02:17:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.979+0000 7f2faffff640 1 -- 172.21.15.79:0/2398099923 learned_addr learned my addr 172.21.15.79:0/2398099923 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.979+0000 7f2fb5237640 1 --2- 172.21.15.79:0/2398099923 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb00d10c0 0x7f2fb006bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.979+0000 7f2fb4a36640 1 -- 172.21.15.79:0/2398099923 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb00d10c0 msgr2=0x7f2fb006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.979+0000 7f2fb4a36640 1 --2- 172.21.15.79:0/2398099923 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb00d10c0 0x7f2fb006bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:41.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.979+0000 7f2fb4a36640 1 -- 172.21.15.79:0/2398099923 >> v1:172.21.15.189:6789/0 conn(0x7f2fb00cf7f0 legacy=0x7f2fb00d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:41.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.979+0000 7f2fb4a36640 1 -- 172.21.15.79:0/2398099923 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb00d2780 con 0x7f2fb015e4f0 2024-04-25T02:17:41.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.980+0000 7f2fb4a36640 1 --2- 172.21.15.79:0/2398099923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fb015e4f0 0x7f2fb00d2ca0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40097d0 tx=0x7f2fa402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b4dcb0b1365ac9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:41.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.980+0000 7f2faf7fe640 1 -- 172.21.15.79:0/2398099923 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4037070 con 0x7f2fb015e4f0 2024-04-25T02:17:41.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.980+0000 7f2faf7fe640 1 -- 172.21.15.79:0/2398099923 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa4032440 con 0x7f2fb015e4f0 2024-04-25T02:17:41.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.980+0000 7f2faf7fe640 1 -- 172.21.15.79:0/2398099923 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4032810 con 0x7f2fb015e4f0 2024-04-25T02:17:41.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.981+0000 7f2fb6c9a640 1 -- 172.21.15.79:0/2398099923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fb015e4f0 msgr2=0x7f2fb00d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:41.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.981+0000 7f2fb6c9a640 1 --2- 172.21.15.79:0/2398099923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fb015e4f0 0x7f2fb00d2ca0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40097d0 tx=0x7f2fa402a1c0 comp rx=0 tx=0).stop 2024-04-25T02:17:41.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.981+0000 7f2fb6c9a640 1 -- 172.21.15.79:0/2398099923 shutdown_connections 2024-04-25T02:17:41.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.981+0000 7f2fb6c9a640 1 --2- 172.21.15.79:0/2398099923 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb00d10c0 0x7f2fb006bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:41.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.981+0000 7f2fb6c9a640 1 --2- 172.21.15.79:0/2398099923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fb015e4f0 0x7f2fb00d2ca0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:41.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.981+0000 7f2fb6c9a640 1 -- 172.21.15.79:0/2398099923 >> 172.21.15.79:0/2398099923 conn(0x7f2fb009d4a0 msgr2=0x7f2fb00d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:41.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.981+0000 7f2fb6c9a640 1 -- 172.21.15.79:0/2398099923 shutdown_connections 2024-04-25T02:17:41.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.981+0000 7f2fb6c9a640 1 -- 172.21.15.79:0/2398099923 wait complete. 2024-04-25T02:17:41.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.982+0000 7f2fb6c9a640 1 Processor -- start 2024-04-25T02:17:41.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.982+0000 7f2fb6c9a640 1 -- start start 2024-04-25T02:17:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb6c9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb00cf7f0 0x7f2fb0152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb6c9a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fb00d10c0 0x7f2fb0153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb6c9a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb015e4f0 0x7f2fb00b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb6c9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb00cfe00 con 0x7f2fb00cf7f0 2024-04-25T02:17:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb6c9a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb00cfc80 con 0x7f2fb00d10c0 2024-04-25T02:17:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb6c9a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb00cff80 con 0x7f2fb015e4f0 2024-04-25T02:17:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb4a36640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb00cf7f0 0x7f2fb0152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb4a36640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb00cf7f0 0x7f2fb0152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48292/0 (socket says 172.21.15.79:48292) 2024-04-25T02:17:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb4a36640 1 -- 172.21.15.79:0/1374860999 learned_addr learned my addr 172.21.15.79:0/1374860999 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb5237640 1 --2- 172.21.15.79:0/1374860999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb015e4f0 0x7f2fb00b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2faffff640 1 --2- 172.21.15.79:0/1374860999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fb00d10c0 0x7f2fb0153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb4a36640 1 -- 172.21.15.79:0/1374860999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb015e4f0 msgr2=0x7f2fb00b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb4a36640 1 --2- 172.21.15.79:0/1374860999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb015e4f0 0x7f2fb00b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb4a36640 1 -- 172.21.15.79:0/1374860999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fb00d10c0 msgr2=0x7f2fb0153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb4a36640 1 --2- 172.21.15.79:0/1374860999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fb00d10c0 0x7f2fb0153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb4a36640 1 -- 172.21.15.79:0/1374860999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb00b6ec0 con 0x7f2fb00cf7f0 2024-04-25T02:17:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2faffff640 1 --2- 172.21.15.79:0/1374860999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fb00d10c0 0x7f2fb0153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb4a36640 1 --2- 172.21.15.79:0/1374860999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb00cf7f0 0x7f2fb0152d10 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40098f0 tx=0x7f2fa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fad7fa640 1 -- 172.21.15.79:0/1374860999 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4037040 con 0x7f2fb00cf7f0 2024-04-25T02:17:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fad7fa640 1 -- 172.21.15.79:0/1374860999 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa4030500 con 0x7f2fb00cf7f0 2024-04-25T02:17:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fb6c9a640 1 -- 172.21.15.79:0/1374860999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb00b71a0 con 0x7f2fb00cf7f0 2024-04-25T02:17:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.983+0000 7f2fad7fa640 1 -- 172.21.15.79:0/1374860999 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa40308d0 con 0x7f2fb00cf7f0 2024-04-25T02:17:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.984+0000 7f2fb6c9a640 1 -- 172.21.15.79:0/1374860999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb00b7760 con 0x7f2fb00cf7f0 2024-04-25T02:17:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.984+0000 7f2fb6c9a640 1 -- 172.21.15.79:0/1374860999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb00686c0 con 0x7f2fb00cf7f0 2024-04-25T02:17:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.985+0000 7f2fad7fa640 1 -- 172.21.15.79:0/1374860999 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fa4044020 con 0x7f2fb00cf7f0 2024-04-25T02:17:41.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.985+0000 7f2fad7fa640 1 --2- 172.21.15.79:0/1374860999 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2f9406be30 0x7f2f9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:41.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.985+0000 7f2fad7fa640 1 -- 172.21.15.79:0/1374860999 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7f2fa40ab0b0 con 0x7f2fb00cf7f0 2024-04-25T02:17:41.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.985+0000 7f2faffff640 1 --2- 172.21.15.79:0/1374860999 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2f9406be30 0x7f2f9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:41.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.986+0000 7f2faffff640 1 --2- 172.21.15.79:0/1374860999 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2f9406be30 0x7f2f9406e2f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2fb01f8e10 tx=0x7f2f9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:41.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:41.990+0000 7f2fad7fa640 1 -- 172.21.15.79:0/1374860999 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2fa4079ab0 con 0x7f2fb00cf7f0 2024-04-25T02:17:42.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.161+0000 7f2fb6c9a640 1 -- 172.21.15.79:0/1374860999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2fb00690a0 con 0x7f2fb00cf7f0 2024-04-25T02:17:42.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.161+0000 7f2fad7fa640 1 -- 172.21.15.79:0/1374860999 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) ==== 93+0+10 (secure 0 0 0) 0x7f2fa40793b0 con 0x7f2fb00cf7f0 2024-04-25T02:17:42.166 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:17:42.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.163+0000 7f2fb6c9a640 1 -- 172.21.15.79:0/1374860999 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2f9406be30 msgr2=0x7f2f9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.163+0000 7f2fb6c9a640 1 --2- 172.21.15.79:0/1374860999 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2f9406be30 0x7f2f9406e2f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2fb01f8e10 tx=0x7f2f9c009040 comp rx=0 tx=0).stop 2024-04-25T02:17:42.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.163+0000 7f2fb6c9a640 1 -- 172.21.15.79:0/1374860999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb00cf7f0 msgr2=0x7f2fb0152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.163+0000 7f2fb6c9a640 1 --2- 172.21.15.79:0/1374860999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb00cf7f0 0x7f2fb0152d10 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40098f0 tx=0x7f2fa40046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.163+0000 7f2fb6c9a640 1 -- 172.21.15.79:0/1374860999 shutdown_connections 2024-04-25T02:17:42.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.163+0000 7f2fb6c9a640 1 --2- 172.21.15.79:0/1374860999 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2f9406be30 0x7f2f9406e2f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.163+0000 7f2fb6c9a640 1 --2- 172.21.15.79:0/1374860999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2fb015e4f0 0x7f2fb00b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.163+0000 7f2fb6c9a640 1 --2- 172.21.15.79:0/1374860999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fb00d10c0 0x7f2fb0153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.163+0000 7f2fb6c9a640 1 --2- 172.21.15.79:0/1374860999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb00cf7f0 0x7f2fb0152d10 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.163+0000 7f2fb6c9a640 1 -- 172.21.15.79:0/1374860999 >> 172.21.15.79:0/1374860999 conn(0x7f2fb009d4a0 msgr2=0x7f2fb015a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:42.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.163+0000 7f2fb6c9a640 1 -- 172.21.15.79:0/1374860999 shutdown_connections 2024-04-25T02:17:42.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.163+0000 7f2fb6c9a640 1 -- 172.21.15.79:0/1374860999 wait complete. 2024-04-25T02:17:42.178 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:17:42.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.276+0000 7f33d9d90640 1 Processor -- start 2024-04-25T02:17:42.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.276+0000 7f33d9d90640 1 -- start start 2024-04-25T02:17:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.277+0000 7f33d9d90640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33d406b2f0 0x7f33d406b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.277+0000 7f33d9d90640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33d4071cd0 con 0x7f33d4155f00 2024-04-25T02:17:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.277+0000 7f33d9d90640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33d4071fb0 con 0x7f33d40b41b0 2024-04-25T02:17:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.277+0000 7f33d9d90640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f33d4072290 con 0x7f33d406b2f0 2024-04-25T02:17:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.277+0000 7f33d3fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f33d4155f00 0x7f33d4156370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57768/0 (socket says 172.21.15.79:57768) 2024-04-25T02:17:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.277+0000 7f33d3fff640 1 -- 172.21.15.79:0/3038397368 learned_addr learned my addr 172.21.15.79:0/3038397368 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d27fc640 1 -- 172.21.15.79:0/3038397368 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632405432 0 0) 0x7f33d4071cd0 con 0x7f33d4155f00 2024-04-25T02:17:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d27fc640 1 -- 172.21.15.79:0/3038397368 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33bc003520 con 0x7f33d4155f00 2024-04-25T02:17:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d2ffd640 1 --2- 172.21.15.79:0/3038397368 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33d406b2f0 0x7f33d406b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d27fc640 1 -- 172.21.15.79:0/3038397368 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 262195808 0 0) 0x7f33bc003520 con 0x7f33d4155f00 2024-04-25T02:17:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d27fc640 1 -- 172.21.15.79:0/3038397368 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33d406b2f0 msgr2=0x7f33d406b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d27fc640 1 --2- 172.21.15.79:0/3038397368 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33d406b2f0 0x7f33d406b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d27fc640 1 -- 172.21.15.79:0/3038397368 >> v1:172.21.15.189:6789/0 conn(0x7f33d40b41b0 legacy=0x7f33d41605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d27fc640 1 -- 172.21.15.79:0/3038397368 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d4072570 con 0x7f33d4155f00 2024-04-25T02:17:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d27fc640 1 -- 172.21.15.79:0/3038397368 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f33cc0019f0 con 0x7f33d4155f00 2024-04-25T02:17:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d27fc640 1 -- 172.21.15.79:0/3038397368 >> v1:172.21.15.79:6789/0 conn(0x7f33d4155f00 legacy=0x7f33d4156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d27fc640 1 --2- 172.21.15.79:0/3038397368 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33d406b2f0 0x7f33bc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d27fc640 1 --2- 172.21.15.79:0/3038397368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33bc003f60 0x7f33bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d27fc640 1 --2- 172.21.15.79:0/3038397368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33bc004d40 0x7f33bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d27fc640 1 -- 172.21.15.79:0/3038397368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f33d4072290 con 0x7f33bc003f60 2024-04-25T02:17:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d27fc640 1 -- 172.21.15.79:0/3038397368 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc00baa0 con 0x7f33bc004d40 2024-04-25T02:17:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d27fc640 1 -- 172.21.15.79:0/3038397368 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f33bc00bca0 con 0x7f33d406b2f0 2024-04-25T02:17:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d2ffd640 1 --2- 172.21.15.79:0/3038397368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33bc003f60 0x7f33bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d37fe640 1 --2- 172.21.15.79:0/3038397368 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33d406b2f0 0x7f33bc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d3fff640 1 --2- 172.21.15.79:0/3038397368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33bc004d40 0x7f33bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d2ffd640 1 -- 172.21.15.79:0/3038397368 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33d406b2f0 msgr2=0x7f33bc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d2ffd640 1 --2- 172.21.15.79:0/3038397368 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33d406b2f0 0x7f33bc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d2ffd640 1 -- 172.21.15.79:0/3038397368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33bc004d40 msgr2=0x7f33bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d2ffd640 1 --2- 172.21.15.79:0/3038397368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33bc004d40 0x7f33bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.278+0000 7f33d2ffd640 1 -- 172.21.15.79:0/3038397368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33bc003520 con 0x7f33bc003f60 2024-04-25T02:17:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.279+0000 7f33d2ffd640 1 --2- 172.21.15.79:0/3038397368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33bc003f60 0x7f33bc004800 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009ac0 tx=0x7f33bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d16e58d0016d76e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.279+0000 7f33d27fc640 1 -- 172.21.15.79:0/3038397368 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8036070 con 0x7f33bc003f60 2024-04-25T02:17:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.279+0000 7f33d27fc640 1 -- 172.21.15.79:0/3038397368 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c8031400 con 0x7f33bc003f60 2024-04-25T02:17:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.279+0000 7f33d27fc640 1 -- 172.21.15.79:0/3038397368 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8009690 con 0x7f33bc003f60 2024-04-25T02:17:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.280+0000 7f33d9d90640 1 -- 172.21.15.79:0/3038397368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33bc003f60 msgr2=0x7f33bc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.280+0000 7f33d9d90640 1 --2- 172.21.15.79:0/3038397368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33bc003f60 0x7f33bc004800 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009ac0 tx=0x7f33bc005830 comp rx=0 tx=0).stop 2024-04-25T02:17:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.280+0000 7f33d3fff640 1 -- 172.21.15.79:0/3038397368 reap_dead start 2024-04-25T02:17:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.280+0000 7f33d9d90640 1 -- 172.21.15.79:0/3038397368 shutdown_connections 2024-04-25T02:17:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.280+0000 7f33d9d90640 1 -- 172.21.15.79:0/3038397368 >> 172.21.15.79:0/3038397368 conn(0x7f33d40b1cd0 msgr2=0x7f33d40b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.280+0000 7f33d9d90640 1 -- 172.21.15.79:0/3038397368 shutdown_connections 2024-04-25T02:17:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.280+0000 7f33d9d90640 1 -- 172.21.15.79:0/3038397368 wait complete. 2024-04-25T02:17:42.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.281+0000 7f33d9d90640 1 Processor -- start 2024-04-25T02:17:42.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.281+0000 7f33d9d90640 1 -- start start 2024-04-25T02:17:42.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d9d90640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33bc003f60 0x7f33d409cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d9d90640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33d4155660 0x7f33d41485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d9d90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33d41f2b70 0x7f33d40cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d9d90640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f33d40cf4b0 con 0x7f33d41f2b70 2024-04-25T02:17:42.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d9d90640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f33d4072d70 con 0x7f33d4155660 2024-04-25T02:17:42.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d9d90640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f33d415c870 con 0x7f33bc003f60 2024-04-25T02:17:42.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33d41f2b70 0x7f33d40cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33d41f2b70 0x7f33d40cfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48304/0 (socket says 172.21.15.79:48304) 2024-04-25T02:17:42.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d3fff640 1 -- 172.21.15.79:0/2441510840 learned_addr learned my addr 172.21.15.79:0/2441510840 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:42.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d2ffd640 1 --2- 172.21.15.79:0/2441510840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33d4155660 0x7f33d41485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d37fe640 1 --2- 172.21.15.79:0/2441510840 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33bc003f60 0x7f33d409cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d3fff640 1 -- 172.21.15.79:0/2441510840 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33bc003f60 msgr2=0x7f33d409cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d3fff640 1 --2- 172.21.15.79:0/2441510840 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33bc003f60 0x7f33d409cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d3fff640 1 -- 172.21.15.79:0/2441510840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33d4155660 msgr2=0x7f33d41485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d3fff640 1 --2- 172.21.15.79:0/2441510840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33d4155660 0x7f33d41485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d3fff640 1 -- 172.21.15.79:0/2441510840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d409d770 con 0x7f33d41f2b70 2024-04-25T02:17:42.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d2ffd640 1 --2- 172.21.15.79:0/2441510840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33d4155660 0x7f33d41485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:42.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d3fff640 1 --2- 172.21.15.79:0/2441510840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33d41f2b70 0x7f33d40cfb80 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f33d40cc410 tx=0x7f33cc007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:42.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33bbfff640 1 -- 172.21.15.79:0/2441510840 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc00ab80 con 0x7f33d41f2b70 2024-04-25T02:17:42.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33bbfff640 1 -- 172.21.15.79:0/2441510840 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33cc019070 con 0x7f33d41f2b70 2024-04-25T02:17:42.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d9d90640 1 -- 172.21.15.79:0/2441510840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d41f20d0 con 0x7f33d41f2b70 2024-04-25T02:17:42.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33bbfff640 1 -- 172.21.15.79:0/2441510840 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc0133f0 con 0x7f33d41f2b70 2024-04-25T02:17:42.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.282+0000 7f33d9d90640 1 -- 172.21.15.79:0/2441510840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d41f2370 con 0x7f33d41f2b70 2024-04-25T02:17:42.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.283+0000 7f33d9d90640 1 -- 172.21.15.79:0/2441510840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33d40690a0 con 0x7f33d41f2b70 2024-04-25T02:17:42.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.284+0000 7f33bbfff640 1 -- 172.21.15.79:0/2441510840 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f33cc013590 con 0x7f33d41f2b70 2024-04-25T02:17:42.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.284+0000 7f33bbfff640 1 --2- 172.21.15.79:0/2441510840 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f33c006be60 0x7f33c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.284+0000 7f33bbfff640 1 -- 172.21.15.79:0/2441510840 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7f33cc08b430 con 0x7f33d41f2b70 2024-04-25T02:17:42.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.284+0000 7f33d37fe640 1 --2- 172.21.15.79:0/2441510840 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f33c006be60 0x7f33c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.285+0000 7f33d37fe640 1 --2- 172.21.15.79:0/2441510840 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f33c006be60 0x7f33c006e320 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f33c40035f0 tx=0x7f33c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:42.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.289+0000 7f33bbfff640 1 -- 172.21.15.79:0/2441510840 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f33cc059da0 con 0x7f33d41f2b70 2024-04-25T02:17:42.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.463+0000 7f33d9d90640 1 -- 172.21.15.79:0/2441510840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f33d40ce280 con 0x7f33d41f2b70 2024-04-25T02:17:42.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.463+0000 7f33bbfff640 1 -- 172.21.15.79:0/2441510840 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) ==== 104+0+11 (secure 0 0 0) 0x7f33cc0596a0 con 0x7f33d41f2b70 2024-04-25T02:17:42.468 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:17:42.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.465+0000 7f33d9d90640 1 -- 172.21.15.79:0/2441510840 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f33c006be60 msgr2=0x7f33c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.465+0000 7f33d9d90640 1 --2- 172.21.15.79:0/2441510840 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f33c006be60 0x7f33c006e320 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f33c40035f0 tx=0x7f33c4009040 comp rx=0 tx=0).stop 2024-04-25T02:17:42.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.465+0000 7f33d9d90640 1 -- 172.21.15.79:0/2441510840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33d41f2b70 msgr2=0x7f33d40cfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.465+0000 7f33d9d90640 1 --2- 172.21.15.79:0/2441510840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33d41f2b70 0x7f33d40cfb80 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f33d40cc410 tx=0x7f33cc007bd0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.465+0000 7f33d9d90640 1 -- 172.21.15.79:0/2441510840 shutdown_connections 2024-04-25T02:17:42.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.465+0000 7f33d9d90640 1 --2- 172.21.15.79:0/2441510840 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f33c006be60 0x7f33c006e320 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.465+0000 7f33d9d90640 1 --2- 172.21.15.79:0/2441510840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33d41f2b70 0x7f33d40cfb80 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.465+0000 7f33d9d90640 1 --2- 172.21.15.79:0/2441510840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33d4155660 0x7f33d41485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.465+0000 7f33d9d90640 1 --2- 172.21.15.79:0/2441510840 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33bc003f60 0x7f33d409cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.465+0000 7f33d9d90640 1 -- 172.21.15.79:0/2441510840 >> 172.21.15.79:0/2441510840 conn(0x7f33d40b1cd0 msgr2=0x7f33d40b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:42.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.465+0000 7f33d9d90640 1 -- 172.21.15.79:0/2441510840 shutdown_connections 2024-04-25T02:17:42.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.465+0000 7f33d9d90640 1 -- 172.21.15.79:0/2441510840 wait complete. 2024-04-25T02:17:42.481 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:17:42.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.577+0000 7fe333330640 1 Processor -- start 2024-04-25T02:17:42.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.577+0000 7fe333330640 1 -- start start 2024-04-25T02:17:42.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.578+0000 7fe333330640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe32c0b41b0 0x7fe32c1605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.578+0000 7fe333330640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe32c06b2f0 0x7fe32c06b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.578+0000 7fe333330640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe32c071cd0 con 0x7fe32c155f00 2024-04-25T02:17:42.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.578+0000 7fe333330640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe32c071fb0 con 0x7fe32c06b2f0 2024-04-25T02:17:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.578+0000 7fe333330640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe32c072290 con 0x7fe32c0b41b0 2024-04-25T02:17:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.578+0000 7fe3308cb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe32c06b2f0 0x7fe32c06b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.578+0000 7fe3318cd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe32c155f00 0x7fe32c156370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57776/0 (socket says 172.21.15.79:57776) 2024-04-25T02:17:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.578+0000 7fe3318cd640 1 -- 172.21.15.79:0/705502968 learned_addr learned my addr 172.21.15.79:0/705502968 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.578+0000 7fe3310cc640 1 --2- 172.21.15.79:0/705502968 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe32c0b41b0 0x7fe32c1605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.578+0000 7fe3308cb640 1 -- 172.21.15.79:0/705502968 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe32c0b41b0 msgr2=0x7fe32c1605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.578+0000 7fe3308cb640 1 --2- 172.21.15.79:0/705502968 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe32c0b41b0 0x7fe32c1605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.578+0000 7fe3308cb640 1 -- 172.21.15.79:0/705502968 >> v1:172.21.15.79:6789/0 conn(0x7fe32c155f00 legacy=0x7fe32c156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.578+0000 7fe323fff640 1 -- 172.21.15.79:0/705502968 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996582152 0 0) 0x7fe32c071cd0 con 0x7fe32c155f00 2024-04-25T02:17:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.578+0000 7fe3308cb640 1 -- 172.21.15.79:0/705502968 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c072570 con 0x7fe32c06b2f0 2024-04-25T02:17:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.579+0000 7fe3308cb640 1 --2- 172.21.15.79:0/705502968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c06b2f0 0x7fe32c06b770 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0097a0 tx=0x7fe31c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1aa036d3b1e936 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.579+0000 7fe323fff640 1 -- 172.21.15.79:0/705502968 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c037070 con 0x7fe32c06b2f0 2024-04-25T02:17:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.579+0000 7fe323fff640 1 -- 172.21.15.79:0/705502968 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31c032440 con 0x7fe32c06b2f0 2024-04-25T02:17:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.579+0000 7fe323fff640 1 -- 172.21.15.79:0/705502968 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c032810 con 0x7fe32c06b2f0 2024-04-25T02:17:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.579+0000 7fe333330640 1 -- 172.21.15.79:0/705502968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c06b2f0 msgr2=0x7fe32c06b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.579+0000 7fe333330640 1 --2- 172.21.15.79:0/705502968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c06b2f0 0x7fe32c06b770 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0097a0 tx=0x7fe31c02a180 comp rx=0 tx=0).stop 2024-04-25T02:17:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.579+0000 7fe333330640 1 -- 172.21.15.79:0/705502968 shutdown_connections 2024-04-25T02:17:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.579+0000 7fe333330640 1 --2- 172.21.15.79:0/705502968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c06b2f0 0x7fe32c06b770 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.579+0000 7fe333330640 1 --2- 172.21.15.79:0/705502968 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe32c0b41b0 0x7fe32c1605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.579+0000 7fe333330640 1 -- 172.21.15.79:0/705502968 >> 172.21.15.79:0/705502968 conn(0x7fe32c0b1cd0 msgr2=0x7fe32c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.580+0000 7fe333330640 1 -- 172.21.15.79:0/705502968 shutdown_connections 2024-04-25T02:17:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.580+0000 7fe333330640 1 -- 172.21.15.79:0/705502968 wait complete. 2024-04-25T02:17:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.581+0000 7fe333330640 1 Processor -- start 2024-04-25T02:17:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.581+0000 7fe333330640 1 -- start start 2024-04-25T02:17:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.581+0000 7fe333330640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c06b2f0 0x7fe32c09d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.581+0000 7fe333330640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe32c0b41b0 0x7fe32c156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.581+0000 7fe333330640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe32c155f00 0x7fe32c147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.581+0000 7fe333330640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c072d70 con 0x7fe32c06b2f0 2024-04-25T02:17:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.581+0000 7fe333330640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c156a80 con 0x7fe32c155f00 2024-04-25T02:17:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.581+0000 7fe333330640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe32c15c870 con 0x7fe32c0b41b0 2024-04-25T02:17:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.581+0000 7fe3310cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c06b2f0 0x7fe32c09d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.581+0000 7fe3310cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c06b2f0 0x7fe32c09d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48322/0 (socket says 172.21.15.79:48322) 2024-04-25T02:17:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.582+0000 7fe3310cc640 1 -- 172.21.15.79:0/4105044452 learned_addr learned my addr 172.21.15.79:0/4105044452 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.582+0000 7fe3318cd640 1 --2- 172.21.15.79:0/4105044452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe32c155f00 0x7fe32c147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.582+0000 7fe3308cb640 1 --2- 172.21.15.79:0/4105044452 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe32c0b41b0 0x7fe32c156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.582+0000 7fe3310cc640 1 -- 172.21.15.79:0/4105044452 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe32c0b41b0 msgr2=0x7fe32c156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.582+0000 7fe3310cc640 1 --2- 172.21.15.79:0/4105044452 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe32c0b41b0 0x7fe32c156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.582+0000 7fe3310cc640 1 -- 172.21.15.79:0/4105044452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe32c155f00 msgr2=0x7fe32c147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.582+0000 7fe3310cc640 1 --2- 172.21.15.79:0/4105044452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe32c155f00 0x7fe32c147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.582+0000 7fe3310cc640 1 -- 172.21.15.79:0/4105044452 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c1573c0 con 0x7fe32c06b2f0 2024-04-25T02:17:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.582+0000 7fe3310cc640 1 --2- 172.21.15.79:0/4105044452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c06b2f0 0x7fe32c09d460 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fe32800d830 tx=0x7fe32800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.582+0000 7fe321ffb640 1 -- 172.21.15.79:0/4105044452 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32800b660 con 0x7fe32c06b2f0 2024-04-25T02:17:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.582+0000 7fe321ffb640 1 -- 172.21.15.79:0/4105044452 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe328019070 con 0x7fe32c06b2f0 2024-04-25T02:17:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.582+0000 7fe333330640 1 -- 172.21.15.79:0/4105044452 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32c1576a0 con 0x7fe32c06b2f0 2024-04-25T02:17:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.582+0000 7fe321ffb640 1 -- 172.21.15.79:0/4105044452 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32800ba20 con 0x7fe32c06b2f0 2024-04-25T02:17:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.582+0000 7fe333330640 1 -- 172.21.15.79:0/4105044452 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe32c157c60 con 0x7fe32c06b2f0 2024-04-25T02:17:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.583+0000 7fe333330640 1 -- 172.21.15.79:0/4105044452 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe32c0690a0 con 0x7fe32c06b2f0 2024-04-25T02:17:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.584+0000 7fe321ffb640 1 -- 172.21.15.79:0/4105044452 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe32801e460 con 0x7fe32c06b2f0 2024-04-25T02:17:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.584+0000 7fe321ffb640 1 --2- 172.21.15.79:0/4105044452 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe31006be60 0x7fe31006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.584+0000 7fe321ffb640 1 -- 172.21.15.79:0/4105044452 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7fe32808b460 con 0x7fe32c06b2f0 2024-04-25T02:17:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.584+0000 7fe3308cb640 1 --2- 172.21.15.79:0/4105044452 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe31006be60 0x7fe31006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.585+0000 7fe3308cb640 1 --2- 172.21.15.79:0/4105044452 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe31006be60 0x7fe31006e320 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe31c034000 tx=0x7fe31c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.588+0000 7fe321ffb640 1 -- 172.21.15.79:0/4105044452 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe328059e60 con 0x7fe32c06b2f0 2024-04-25T02:17:42.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.766+0000 7fe333330640 1 -- 172.21.15.79:0/4105044452 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe32c0ce280 con 0x7fe32c06b2f0 2024-04-25T02:17:42.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.766+0000 7fe321ffb640 1 -- 172.21.15.79:0/4105044452 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) ==== 100+0+11 (secure 0 0 0) 0x7fe328059760 con 0x7fe32c06b2f0 2024-04-25T02:17:42.771 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:17:42.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.768+0000 7fe333330640 1 -- 172.21.15.79:0/4105044452 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe31006be60 msgr2=0x7fe31006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.768+0000 7fe333330640 1 --2- 172.21.15.79:0/4105044452 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe31006be60 0x7fe31006e320 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe31c034000 tx=0x7fe31c02e000 comp rx=0 tx=0).stop 2024-04-25T02:17:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.768+0000 7fe333330640 1 -- 172.21.15.79:0/4105044452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c06b2f0 msgr2=0x7fe32c09d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.768+0000 7fe333330640 1 --2- 172.21.15.79:0/4105044452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c06b2f0 0x7fe32c09d460 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fe32800d830 tx=0x7fe32800dcf0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.768+0000 7fe333330640 1 -- 172.21.15.79:0/4105044452 shutdown_connections 2024-04-25T02:17:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.768+0000 7fe333330640 1 --2- 172.21.15.79:0/4105044452 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe31006be60 0x7fe31006e320 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.768+0000 7fe333330640 1 --2- 172.21.15.79:0/4105044452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe32c155f00 0x7fe32c147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.768+0000 7fe333330640 1 --2- 172.21.15.79:0/4105044452 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe32c0b41b0 0x7fe32c156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.768+0000 7fe333330640 1 --2- 172.21.15.79:0/4105044452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c06b2f0 0x7fe32c09d460 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.768+0000 7fe333330640 1 -- 172.21.15.79:0/4105044452 >> 172.21.15.79:0/4105044452 conn(0x7fe32c0b1cd0 msgr2=0x7fe32c0b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.768+0000 7fe333330640 1 -- 172.21.15.79:0/4105044452 shutdown_connections 2024-04-25T02:17:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.768+0000 7fe333330640 1 -- 172.21.15.79:0/4105044452 wait complete. 2024-04-25T02:17:42.783 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:17:42.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.879+0000 7f110c35a640 1 Processor -- start 2024-04-25T02:17:42.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.879+0000 7f110c35a640 1 -- start start 2024-04-25T02:17:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.880+0000 7f110c35a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f110406df50 0x7f110406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.880+0000 7f110c35a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f11040b2d30 0x7f11040b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.880+0000 7f110c35a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1104071e00 con 0x7f1104143bc0 2024-04-25T02:17:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.880+0000 7f110c35a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f110406e8f0 con 0x7f110406df50 2024-04-25T02:17:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.880+0000 7f110c35a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1104072cb0 con 0x7f11040b2d30 2024-04-25T02:17:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.880+0000 7f11098f5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f110406df50 0x7f110406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.880+0000 7f11098f5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f110406df50 0x7f110406e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48336/0 (socket says 172.21.15.79:48336) 2024-04-25T02:17:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.880+0000 7f11098f5640 1 -- 172.21.15.79:0/1479531011 learned_addr learned my addr 172.21.15.79:0/1479531011 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.880+0000 7f11098f5640 1 -- 172.21.15.79:0/1479531011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f11040b2d30 msgr2=0x7f11040b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.880+0000 7f11098f5640 1 --2- 172.21.15.79:0/1479531011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f11040b2d30 0x7f11040b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.880+0000 7f11098f5640 1 -- 172.21.15.79:0/1479531011 >> v1:172.21.15.189:6789/0 conn(0x7f1104143bc0 legacy=0x7f110415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.880+0000 7f11098f5640 1 -- 172.21.15.79:0/1479531011 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11040720a0 con 0x7f110406df50 2024-04-25T02:17:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.881+0000 7f11098f5640 1 --2- 172.21.15.79:0/1479531011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f110406df50 0x7f110406e3b0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009870 tx=0x7f10f402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7423ce33e678fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.881+0000 7f11090f4640 1 -- 172.21.15.79:0/1479531011 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4037070 con 0x7f110406df50 2024-04-25T02:17:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.881+0000 7f11090f4640 1 -- 172.21.15.79:0/1479531011 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f4032440 con 0x7f110406df50 2024-04-25T02:17:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.881+0000 7f11090f4640 1 -- 172.21.15.79:0/1479531011 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4032810 con 0x7f110406df50 2024-04-25T02:17:42.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.882+0000 7f110c35a640 1 -- 172.21.15.79:0/1479531011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f110406df50 msgr2=0x7f110406e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.882+0000 7f110c35a640 1 --2- 172.21.15.79:0/1479531011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f110406df50 0x7f110406e3b0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009870 tx=0x7f10f402a180 comp rx=0 tx=0).stop 2024-04-25T02:17:42.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.882+0000 7f110c35a640 1 -- 172.21.15.79:0/1479531011 shutdown_connections 2024-04-25T02:17:42.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.882+0000 7f110c35a640 1 --2- 172.21.15.79:0/1479531011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f11040b2d30 0x7f11040b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.882+0000 7f110c35a640 1 --2- 172.21.15.79:0/1479531011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f110406df50 0x7f110406e3b0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.882+0000 7f110c35a640 1 -- 172.21.15.79:0/1479531011 >> 172.21.15.79:0/1479531011 conn(0x7f11040cfc80 msgr2=0x7f11040d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:42.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.882+0000 7f110c35a640 1 -- 172.21.15.79:0/1479531011 shutdown_connections 2024-04-25T02:17:42.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.882+0000 7f110c35a640 1 -- 172.21.15.79:0/1479531011 wait complete. 2024-04-25T02:17:42.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.883+0000 7f110c35a640 1 Processor -- start 2024-04-25T02:17:42.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.883+0000 7f110c35a640 1 -- start start 2024-04-25T02:17:42.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f110c35a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f110406df50 0x7f11040ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f110c35a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11040b2d30 0x7f11041396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f110c35a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1104143bc0 0x7f1104070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f110c35a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1104072940 con 0x7f11040b2d30 2024-04-25T02:17:42.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f110c35a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1104072660 con 0x7f1104143bc0 2024-04-25T02:17:42.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f110c35a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1104143fa0 con 0x7f110406df50 2024-04-25T02:17:42.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f11098f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11040b2d30 0x7f11041396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f11098f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11040b2d30 0x7f11041396d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48342/0 (socket says 172.21.15.79:48342) 2024-04-25T02:17:42.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f11098f5640 1 -- 172.21.15.79:0/947746956 learned_addr learned my addr 172.21.15.79:0/947746956 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:42.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f11098f5640 1 -- 172.21.15.79:0/947746956 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f110406df50 msgr2=0x7f11040ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f11098f5640 1 --2- 172.21.15.79:0/947746956 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f110406df50 0x7f11040ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f110a8f7640 1 --2- 172.21.15.79:0/947746956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1104143bc0 0x7f1104070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f11098f5640 1 -- 172.21.15.79:0/947746956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1104143bc0 msgr2=0x7f1104070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:42.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f11098f5640 1 --2- 172.21.15.79:0/947746956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1104143bc0 0x7f1104070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:42.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f11098f5640 1 -- 172.21.15.79:0/947746956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11040ae130 con 0x7f11040b2d30 2024-04-25T02:17:42.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f110a8f7640 1 --2- 172.21.15.79:0/947746956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1104143bc0 0x7f1104070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:42.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f11098f5640 1 --2- 172.21.15.79:0/947746956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11040b2d30 0x7f11041396d0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009870 tx=0x7f10f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:42.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.884+0000 7f10faffd640 1 -- 172.21.15.79:0/947746956 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4041070 con 0x7f11040b2d30 2024-04-25T02:17:42.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.885+0000 7f10faffd640 1 -- 172.21.15.79:0/947746956 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f403c870 con 0x7f11040b2d30 2024-04-25T02:17:42.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.885+0000 7f110c35a640 1 -- 172.21.15.79:0/947746956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11040ae410 con 0x7f11040b2d30 2024-04-25T02:17:42.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.885+0000 7f10faffd640 1 -- 172.21.15.79:0/947746956 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4037040 con 0x7f11040b2d30 2024-04-25T02:17:42.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.885+0000 7f110c35a640 1 -- 172.21.15.79:0/947746956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11040aecb0 con 0x7f11040b2d30 2024-04-25T02:17:42.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.886+0000 7f110c35a640 1 -- 172.21.15.79:0/947746956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11040ae800 con 0x7f11040b2d30 2024-04-25T02:17:42.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.886+0000 7f10faffd640 1 -- 172.21.15.79:0/947746956 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f10f4044070 con 0x7f11040b2d30 2024-04-25T02:17:42.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.886+0000 7f10faffd640 1 --2- 172.21.15.79:0/947746956 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f10e806be30 0x7f10e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:42.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.887+0000 7f10faffd640 1 -- 172.21.15.79:0/947746956 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7f10f40ab990 con 0x7f11040b2d30 2024-04-25T02:17:42.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.887+0000 7f110a0f6640 1 --2- 172.21.15.79:0/947746956 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f10e806be30 0x7f10e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:42.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.887+0000 7f110a0f6640 1 --2- 172.21.15.79:0/947746956 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f10e806be30 0x7f10e806e2f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f11000043c0 tx=0x7f1100007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:42.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:42.891+0000 7f10faffd640 1 -- 172.21.15.79:0/947746956 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f10f407a420 con 0x7f11040b2d30 2024-04-25T02:17:43.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.078+0000 7f110c35a640 1 -- 172.21.15.79:0/947746956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f11040ae5e0 con 0x7f11040b2d30 2024-04-25T02:17:43.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.078+0000 7f10faffd640 1 -- 172.21.15.79:0/947746956 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v117) ==== 80+0+0 (secure 0 0 0) 0x7f10f4079d20 con 0x7f11040b2d30 2024-04-25T02:17:43.083 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-04-25T02:17:43.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.080+0000 7f110c35a640 1 -- 172.21.15.79:0/947746956 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f10e806be30 msgr2=0x7f10e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.080+0000 7f110c35a640 1 --2- 172.21.15.79:0/947746956 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f10e806be30 0x7f10e806e2f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f11000043c0 tx=0x7f1100007d30 comp rx=0 tx=0).stop 2024-04-25T02:17:43.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.080+0000 7f110c35a640 1 -- 172.21.15.79:0/947746956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11040b2d30 msgr2=0x7f11041396d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.080+0000 7f110c35a640 1 --2- 172.21.15.79:0/947746956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11040b2d30 0x7f11041396d0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009870 tx=0x7f10f40046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.080+0000 7f110c35a640 1 -- 172.21.15.79:0/947746956 shutdown_connections 2024-04-25T02:17:43.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.080+0000 7f110c35a640 1 --2- 172.21.15.79:0/947746956 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f10e806be30 0x7f10e806e2f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.080+0000 7f110c35a640 1 --2- 172.21.15.79:0/947746956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1104143bc0 0x7f1104070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.080+0000 7f110c35a640 1 --2- 172.21.15.79:0/947746956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11040b2d30 0x7f11041396d0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.080+0000 7f110c35a640 1 --2- 172.21.15.79:0/947746956 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f110406df50 0x7f11040ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.080+0000 7f110c35a640 1 -- 172.21.15.79:0/947746956 >> 172.21.15.79:0/947746956 conn(0x7f11040cfc80 msgr2=0x7f11040afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:43.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.080+0000 7f110c35a640 1 -- 172.21.15.79:0/947746956 shutdown_connections 2024-04-25T02:17:43.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.080+0000 7f110c35a640 1 -- 172.21.15.79:0/947746956 wait complete. 2024-04-25T02:17:43.095 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:17:43.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:43.096 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:17:43.138 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:17:43.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:43.138 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:17:43.193 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-25T02:17:43.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.329+0000 7ff66304d640 1 Processor -- start 2024-04-25T02:17:43.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.329+0000 7ff66304d640 1 -- start start 2024-04-25T02:17:43.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff66304d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0d2ca0 0x7ff65c0d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff66304d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff65c0d1ee0 con 0x7ff65c0d0ef0 2024-04-25T02:17:43.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff66304d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff65c0d21c0 con 0x7ff65c15e4f0 2024-04-25T02:17:43.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff66304d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff65c0d3100 con 0x7ff65c0d2ca0 2024-04-25T02:17:43.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff6615ea640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff65c0d0ef0 0x7ff65c06bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57784/0 (socket says 172.21.15.79:57784) 2024-04-25T02:17:43.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff6615ea640 1 -- 172.21.15.79:0/2993531776 learned_addr learned my addr 172.21.15.79:0/2993531776 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:43.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65bfff640 1 --2- 172.21.15.79:0/2993531776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0d2ca0 0x7ff65c0d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65b7fe640 1 -- 172.21.15.79:0/2993531776 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1317248440 0 0) 0x7ff65c0d1ee0 con 0x7ff65c0d0ef0 2024-04-25T02:17:43.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65b7fe640 1 -- 172.21.15.79:0/2993531776 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff64c003520 con 0x7ff65c0d0ef0 2024-04-25T02:17:43.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65b7fe640 1 -- 172.21.15.79:0/2993531776 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 375575576 0 0) 0x7ff64c003520 con 0x7ff65c0d0ef0 2024-04-25T02:17:43.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65b7fe640 1 -- 172.21.15.79:0/2993531776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0d2ca0 msgr2=0x7ff65c0d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:43.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65b7fe640 1 --2- 172.21.15.79:0/2993531776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0d2ca0 0x7ff65c0d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65b7fe640 1 -- 172.21.15.79:0/2993531776 >> v1:172.21.15.189:6789/0 conn(0x7ff65c15e4f0 legacy=0x7ff65c0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65b7fe640 1 -- 172.21.15.79:0/2993531776 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65c0d24a0 con 0x7ff65c0d0ef0 2024-04-25T02:17:43.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65b7fe640 1 -- 172.21.15.79:0/2993531776 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7ff6540019f0 con 0x7ff65c0d0ef0 2024-04-25T02:17:43.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65b7fe640 1 -- 172.21.15.79:0/2993531776 >> v1:172.21.15.79:6789/0 conn(0x7ff65c0d0ef0 legacy=0x7ff65c06bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65b7fe640 1 --2- 172.21.15.79:0/2993531776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c0039e0 0x7ff64c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65b7fe640 1 --2- 172.21.15.79:0/2993531776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0d2ca0 0x7ff64c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65b7fe640 1 --2- 172.21.15.79:0/2993531776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff64c004d40 0x7ff64c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65b7fe640 1 -- 172.21.15.79:0/2993531776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c0d3100 con 0x7ff64c0039e0 2024-04-25T02:17:43.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65b7fe640 1 -- 172.21.15.79:0/2993531776 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff64c00ba20 con 0x7ff64c004d40 2024-04-25T02:17:43.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65b7fe640 1 -- 172.21.15.79:0/2993531776 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff64c00bc20 con 0x7ff65c0d2ca0 2024-04-25T02:17:43.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff65bfff640 1 --2- 172.21.15.79:0/2993531776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0d2ca0 0x7ff64c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff660de9640 1 --2- 172.21.15.79:0/2993531776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c0039e0 0x7ff64c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.330+0000 7ff6615ea640 1 --2- 172.21.15.79:0/2993531776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff64c004d40 0x7ff64c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.331+0000 7ff660de9640 1 -- 172.21.15.79:0/2993531776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0d2ca0 msgr2=0x7ff64c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.331+0000 7ff660de9640 1 --2- 172.21.15.79:0/2993531776 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0d2ca0 0x7ff64c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.331+0000 7ff660de9640 1 -- 172.21.15.79:0/2993531776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff64c004d40 msgr2=0x7ff64c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.331+0000 7ff660de9640 1 --2- 172.21.15.79:0/2993531776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff64c004d40 0x7ff64c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.331+0000 7ff660de9640 1 -- 172.21.15.79:0/2993531776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64c003520 con 0x7ff64c0039e0 2024-04-25T02:17:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.332+0000 7ff660de9640 1 --2- 172.21.15.79:0/2993531776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c0039e0 0x7ff64c003dc0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7ff650001860 tx=0x7ff64c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b38d409f328fcb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.332+0000 7ff65b7fe640 1 -- 172.21.15.79:0/2993531776 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650037070 con 0x7ff64c0039e0 2024-04-25T02:17:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.332+0000 7ff65b7fe640 1 -- 172.21.15.79:0/2993531776 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65002ab60 con 0x7ff64c0039e0 2024-04-25T02:17:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.332+0000 7ff65b7fe640 1 -- 172.21.15.79:0/2993531776 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650001430 con 0x7ff64c0039e0 2024-04-25T02:17:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.332+0000 7ff66304d640 1 -- 172.21.15.79:0/2993531776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c0039e0 msgr2=0x7ff64c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.332+0000 7ff66304d640 1 --2- 172.21.15.79:0/2993531776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff64c0039e0 0x7ff64c003dc0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7ff650001860 tx=0x7ff64c005830 comp rx=0 tx=0).stop 2024-04-25T02:17:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.332+0000 7ff6615ea640 1 -- 172.21.15.79:0/2993531776 reap_dead start 2024-04-25T02:17:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.332+0000 7ff66304d640 1 -- 172.21.15.79:0/2993531776 shutdown_connections 2024-04-25T02:17:43.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.332+0000 7ff66304d640 1 -- 172.21.15.79:0/2993531776 >> 172.21.15.79:0/2993531776 conn(0x7ff65c09d4a0 msgr2=0x7ff65c0d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:43.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.332+0000 7ff66304d640 1 -- 172.21.15.79:0/2993531776 shutdown_connections 2024-04-25T02:17:43.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.332+0000 7ff66304d640 1 -- 172.21.15.79:0/2993531776 wait complete. 2024-04-25T02:17:43.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.333+0000 7ff66304d640 1 Processor -- start 2024-04-25T02:17:43.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.334+0000 7ff66304d640 1 -- start start 2024-04-25T02:17:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.334+0000 7ff66304d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff64c0039e0 0x7ff65c1f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.334+0000 7ff66304d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff65c156dd0 0x7ff65c0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.334+0000 7ff66304d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd410 0x7ff65c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.334+0000 7ff66304d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c0d4ee0 con 0x7ff65c156dd0 2024-04-25T02:17:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.334+0000 7ff66304d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c0cff00 con 0x7ff64c0039e0 2024-04-25T02:17:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.334+0000 7ff66304d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff65c0d5060 con 0x7ff65c0cd410 2024-04-25T02:17:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.334+0000 7ff65bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff65c156dd0 0x7ff65c0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.334+0000 7ff65bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff65c156dd0 0x7ff65c0c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48366/0 (socket says 172.21.15.79:48366) 2024-04-25T02:17:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.334+0000 7ff65bfff640 1 -- 172.21.15.79:0/1228184777 learned_addr learned my addr 172.21.15.79:0/1228184777 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.335+0000 7ff6615ea640 1 --2- 172.21.15.79:0/1228184777 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd410 0x7ff65c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.335+0000 7ff660de9640 1 --2- 172.21.15.79:0/1228184777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff64c0039e0 0x7ff65c1f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.335+0000 7ff65bfff640 1 -- 172.21.15.79:0/1228184777 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd410 msgr2=0x7ff65c0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.335+0000 7ff65bfff640 1 --2- 172.21.15.79:0/1228184777 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd410 0x7ff65c0cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.335+0000 7ff65bfff640 1 -- 172.21.15.79:0/1228184777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff64c0039e0 msgr2=0x7ff65c1f72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.335+0000 7ff65bfff640 1 --2- 172.21.15.79:0/1228184777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff64c0039e0 0x7ff65c1f72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.335+0000 7ff65bfff640 1 -- 172.21.15.79:0/1228184777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65c0b7130 con 0x7ff65c156dd0 2024-04-25T02:17:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.335+0000 7ff65bfff640 1 --2- 172.21.15.79:0/1228184777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff65c156dd0 0x7ff65c0c86b0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7ff6480119d0 tx=0x7ff648011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.335+0000 7ff6597fa640 1 -- 172.21.15.79:0/1228184777 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64800fb50 con 0x7ff65c156dd0 2024-04-25T02:17:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.335+0000 7ff6597fa640 1 -- 172.21.15.79:0/1228184777 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff64800fcf0 con 0x7ff65c156dd0 2024-04-25T02:17:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.335+0000 7ff66304d640 1 -- 172.21.15.79:0/1228184777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff65c0b7410 con 0x7ff65c156dd0 2024-04-25T02:17:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.335+0000 7ff6597fa640 1 -- 172.21.15.79:0/1228184777 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64800fea0 con 0x7ff65c156dd0 2024-04-25T02:17:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.335+0000 7ff66304d640 1 -- 172.21.15.79:0/1228184777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff65c0b79d0 con 0x7ff65c156dd0 2024-04-25T02:17:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.336+0000 7ff6597fa640 1 -- 172.21.15.79:0/1228184777 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff648012040 con 0x7ff65c156dd0 2024-04-25T02:17:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.337+0000 7ff6597fa640 1 --2- 172.21.15.79:0/1228184777 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64006be30 0x7ff64006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.337+0000 7ff660de9640 1 --2- 172.21.15.79:0/1228184777 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64006be30 0x7ff64006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.337+0000 7ff6597fa640 1 -- 172.21.15.79:0/1228184777 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7ff64808b540 con 0x7ff65c156dd0 2024-04-25T02:17:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.337+0000 7ff660de9640 1 --2- 172.21.15.79:0/1228184777 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64006be30 0x7ff64006e2f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff650034000 tx=0x7ff650009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.338+0000 7ff665e37740 1 Processor -- start 2024-04-25T02:17:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.338+0000 7ff665e37740 1 -- start start 2024-04-25T02:17:43.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff665e37740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fd5d60 0x559695fd6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff665e37740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695ff3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff665e37740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695faba40 0x559695ff1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff665e37740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559695f0f6b0 con 0x559695ff3600 2024-04-25T02:17:43.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff665e37740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559695eb7880 con 0x559695fd5d60 2024-04-25T02:17:43.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff665e37740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x559695f0b670 con 0x559695faba40 2024-04-25T02:17:43.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff65bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695ff3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff65bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695ff3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48368/0 (socket says 172.21.15.79:48368) 2024-04-25T02:17:43.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff65bfff640 1 -- 172.21.15.79:0/2422102478 learned_addr learned my addr 172.21.15.79:0/2422102478 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:43.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff65bfff640 1 -- 172.21.15.79:0/2422102478 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695faba40 msgr2=0x559695ff1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:43.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff65bfff640 1 --2- 172.21.15.79:0/2422102478 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695faba40 0x559695ff1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff660de9640 1 --2- 172.21.15.79:0/2422102478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fd5d60 0x559695fd6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff65bfff640 1 -- 172.21.15.79:0/2422102478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fd5d60 msgr2=0x559695fd6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:43.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff65bfff640 1 --2- 172.21.15.79:0/2422102478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fd5d60 0x559695fd6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff65bfff640 1 -- 172.21.15.79:0/2422102478 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559695ced7d0 con 0x559695ff3600 2024-04-25T02:17:43.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff65bfff640 1 --2- 172.21.15.79:0/2422102478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695ff3b50 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7ff648061dc0 tx=0x7ff648059f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1073f93e1da3d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:43.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff6467fc640 1 -- 172.21.15.79:0/2422102478 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6480622f0 con 0x559695ff3600 2024-04-25T02:17:43.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff6467fc640 1 -- 172.21.15.79:0/2422102478 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6480577b0 con 0x559695ff3600 2024-04-25T02:17:43.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.339+0000 7ff6467fc640 1 -- 172.21.15.79:0/2422102478 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff648055d80 con 0x559695ff3600 2024-04-25T02:17:43.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.340+0000 7ff665e37740 1 -- 172.21.15.79:0/2422102478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 msgr2=0x559695ff3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.340+0000 7ff665e37740 1 --2- 172.21.15.79:0/2422102478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695ff3b50 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7ff648061dc0 tx=0x7ff648059f80 comp rx=0 tx=0).stop 2024-04-25T02:17:43.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.340+0000 7ff665e37740 1 -- 172.21.15.79:0/2422102478 shutdown_connections 2024-04-25T02:17:43.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.340+0000 7ff665e37740 1 --2- 172.21.15.79:0/2422102478 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695faba40 0x559695ff1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.340+0000 7ff665e37740 1 --2- 172.21.15.79:0/2422102478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695ff3b50 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.340+0000 7ff665e37740 1 --2- 172.21.15.79:0/2422102478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fd5d60 0x559695fd6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.340+0000 7ff665e37740 1 -- 172.21.15.79:0/2422102478 >> 172.21.15.79:0/2422102478 conn(0x559695fa8600 msgr2=0x559695ff0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:43.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.340+0000 7ff665e37740 1 -- 172.21.15.79:0/2422102478 shutdown_connections 2024-04-25T02:17:43.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.340+0000 7ff665e37740 1 -- 172.21.15.79:0/2422102478 wait complete. 2024-04-25T02:17:43.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.340+0000 7ff665e37740 1 -- start start 2024-04-25T02:17:43.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.341+0000 7ff665e37740 1 Processor -- start 2024-04-25T02:17:43.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.341+0000 7ff665e37740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fd5d60 0x559695fd9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.341+0000 7ff665e37740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695fe8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.341+0000 7ff665e37740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695fc86b0 0x559695fa5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.341+0000 7ff665e37740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559695fac7e0 con 0x559695ff3600 2024-04-25T02:17:43.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.341+0000 7ff665e37740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559695ecaf50 con 0x559695fd5d60 2024-04-25T02:17:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.341+0000 7ff665e37740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x559695fa6530 con 0x559695fc86b0 2024-04-25T02:17:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.341+0000 7ff665e37740 10 client.0 _ll_register_callbacks cb 0x559695f06000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:17:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.341+0000 7ff65bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695fe8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff65bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695fe8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48370/0 (socket says 172.21.15.79:48370) 2024-04-25T02:17:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff65bfff640 1 -- 172.21.15.79:0/4272077534 learned_addr learned my addr 172.21.15.79:0/4272077534 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff6615ea640 1 --2- 172.21.15.79:0/4272077534 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695fc86b0 0x559695fa5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff660de9640 1 --2- 172.21.15.79:0/4272077534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fd5d60 0x559695fd9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff65bfff640 1 -- 172.21.15.79:0/4272077534 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695fc86b0 msgr2=0x559695fa5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff65bfff640 1 --2- 172.21.15.79:0/4272077534 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695fc86b0 0x559695fa5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff65bfff640 1 -- 172.21.15.79:0/4272077534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fd5d60 msgr2=0x559695fd9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff65bfff640 1 --2- 172.21.15.79:0/4272077534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fd5d60 0x559695fd9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff65bfff640 1 -- 172.21.15.79:0/4272077534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559695c233f0 con 0x559695ff3600 2024-04-25T02:17:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff65bfff640 1 --2- 172.21.15.79:0/4272077534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695fe8e40 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7ff6480598d0 tx=0x7ff648000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258fac66e0c0f2f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff63b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:17:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff63b7fe640 1 -- 172.21.15.79:0/4272077534 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64808b2b0 con 0x559695ff3600 2024-04-25T02:17:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff63b7fe640 1 -- 172.21.15.79:0/4272077534 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7ff648061e60 con 0x559695ff3600 2024-04-25T02:17:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff665e37740 1 -- 172.21.15.79:0/4272077534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6480577b0 con 0x559695ff3600 2024-04-25T02:17:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff63b7fe640 1 -- 172.21.15.79:0/4272077534 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7ff648062060 con 0x559695ff3600 2024-04-25T02:17:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff665e37740 10 client.9129 fetch_fsmap learned FSMap version 83 2024-04-25T02:17:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff665e37740 1 -- 172.21.15.79:0/4272077534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x559695be30f0 con 0x559695ff3600 2024-04-25T02:17:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff63b7fe640 1 -- 172.21.15.79:0/4272077534 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6480577b0 con 0x559695ff3600 2024-04-25T02:17:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff63b7fe640 1 -- 172.21.15.79:0/4272077534 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7ff648084070 con 0x559695ff3600 2024-04-25T02:17:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff665e37740 10 client.9129 fetch_fsmap finished waiting for FSMap version 83 2024-04-25T02:17:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff665e37740 10 client.9129 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-25T02:17:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.342+0000 7ff665e37740 20 client.9129 populate_metadata read hostname 'smithi079' 2024-04-25T02:17:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.343+0000 7ff665e37740 1 --2- 172.21.15.79:0/4272077534 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x5596960016c0 0x559696001ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.343+0000 7ff665e37740 4 client.9129 mds_command: new command op to 8919 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:17:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.343+0000 7ff665e37740 1 -- 172.21.15.79:0/4272077534 --> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559695f1cbf0 con 0x5596960016c0 2024-04-25T02:17:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.343+0000 7ff660de9640 1 --2- 172.21.15.79:0/4272077534 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x5596960016c0 0x559696001ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.343+0000 7ff63b7fe640 10 client.9129 ms_handle_connect on v2:172.21.15.79:6836/2134535107 2024-04-25T02:17:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.343+0000 7ff660de9640 1 --2- 172.21.15.79:0/4272077534 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x5596960016c0 0x559696001ae0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51cfd4e780075bef server_cookie=24d0efae0f0bfb5c in_seq=0 out_seq=0 2024-04-25T02:17:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.343+0000 7ff63b7fe640 1 -- 172.21.15.79:0/4272077534 <== mds.0 v2:172.21.15.79:6836/2134535107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559695f1cbf0 con 0x5596960016c0 2024-04-25T02:17:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.343+0000 7ff63b7fe640 10 client.9129 handle_command_reply: tid=0 2024-04-25T02:17:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.344+0000 7ff665e37740 1 client.9129 shutdown 2024-04-25T02:17:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.344+0000 7ff665e37740 1 -- 172.21.15.79:0/4272077534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 msgr2=0x559695fe8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.344+0000 7ff665e37740 1 --2- 172.21.15.79:0/4272077534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695fe8e40 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7ff6480598d0 tx=0x7ff648000bc0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.344+0000 7ff665e37740 1 -- 172.21.15.79:0/4272077534 shutdown_connections 2024-04-25T02:17:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.344+0000 7ff665e37740 1 --2- 172.21.15.79:0/4272077534 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x5596960016c0 0x559696001ae0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.344+0000 7ff665e37740 1 --2- 172.21.15.79:0/4272077534 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695fc86b0 0x559695fa5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.344+0000 7ff665e37740 1 --2- 172.21.15.79:0/4272077534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695fe8e40 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.344+0000 7ff665e37740 1 --2- 172.21.15.79:0/4272077534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fd5d60 0x559695fd9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.344+0000 7ff63b7fe640 0 client.9129 ms_handle_reset on v2:172.21.15.79:6836/2134535107 2024-04-25T02:17:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.344+0000 7ff665e37740 1 -- 172.21.15.79:0/4272077534 >> 172.21.15.79:0/4272077534 conn(0x559695faba40 msgr2=0x559695ff0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.344+0000 7ff665e37740 1 -- 172.21.15.79:0/4272077534 shutdown_connections 2024-04-25T02:17:43.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.344+0000 7ff665e37740 1 -- 172.21.15.79:0/4272077534 wait complete. 2024-04-25T02:17:43.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.344+0000 7ff665e37740 20 client.9129 trim_cache size 0 max 16384 2024-04-25T02:17:43.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.358+0000 7ff665e37740 1 Processor -- start 2024-04-25T02:17:43.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.359+0000 7ff665e37740 1 -- start start 2024-04-25T02:17:43.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.359+0000 7ff665e37740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695fc86b0 0x559696015310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.359+0000 7ff665e37740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fd5d60 0x559695face10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.359+0000 7ff665e37740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695ff3600 0x559695fd4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.359+0000 7ff665e37740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c200e90 con 0x559695fc86b0 2024-04-25T02:17:43.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.359+0000 7ff665e37740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c1ffef0 con 0x559695fd5d60 2024-04-25T02:17:43.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.359+0000 7ff665e37740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff65c0b8ae0 con 0x559695ff3600 2024-04-25T02:17:43.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.359+0000 7ff660de9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695fc86b0 0x559696015310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.359+0000 7ff660de9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695fc86b0 0x559696015310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48372/0 (socket says 172.21.15.79:48372) 2024-04-25T02:17:43.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.359+0000 7ff660de9640 1 -- 172.21.15.79:0/2580138716 learned_addr learned my addr 172.21.15.79:0/2580138716 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:43.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff660de9640 1 -- 172.21.15.79:0/2580138716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695ff3600 msgr2=0x559695fd4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:43.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff660de9640 1 --2- 172.21.15.79:0/2580138716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695ff3600 0x559695fd4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff660de9640 1 -- 172.21.15.79:0/2580138716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fd5d60 msgr2=0x559695face10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:43.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff660de9640 1 --2- 172.21.15.79:0/2580138716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fd5d60 0x559695face10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff660de9640 1 -- 172.21.15.79:0/2580138716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559695fd64b0 con 0x559695fc86b0 2024-04-25T02:17:43.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff660de9640 1 --2- 172.21.15.79:0/2580138716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695fc86b0 0x559696015310 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7ff650001680 tx=0x7ff65002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e80fd3352dbf2ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:43.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff645ffb640 1 -- 172.21.15.79:0/2580138716 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650054070 con 0x559695fc86b0 2024-04-25T02:17:43.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff645ffb640 1 -- 172.21.15.79:0/2580138716 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff650007690 con 0x559695fc86b0 2024-04-25T02:17:43.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff645ffb640 1 -- 172.21.15.79:0/2580138716 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650037040 con 0x559695fc86b0 2024-04-25T02:17:43.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff665e37740 1 -- 172.21.15.79:0/2580138716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695fc86b0 msgr2=0x559696015310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff665e37740 1 --2- 172.21.15.79:0/2580138716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695fc86b0 0x559696015310 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7ff650001680 tx=0x7ff65002e000 comp rx=0 tx=0).stop 2024-04-25T02:17:43.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff665e37740 1 -- 172.21.15.79:0/2580138716 shutdown_connections 2024-04-25T02:17:43.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff665e37740 1 --2- 172.21.15.79:0/2580138716 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695ff3600 0x559695fd4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff665e37740 1 --2- 172.21.15.79:0/2580138716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fd5d60 0x559695face10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff665e37740 1 --2- 172.21.15.79:0/2580138716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695fc86b0 0x559696015310 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff665e37740 1 -- 172.21.15.79:0/2580138716 >> 172.21.15.79:0/2580138716 conn(0x559695faba40 msgr2=0x559695fead90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:43.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff665e37740 1 -- 172.21.15.79:0/2580138716 shutdown_connections 2024-04-25T02:17:43.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.360+0000 7ff665e37740 1 -- 172.21.15.79:0/2580138716 wait complete. 2024-04-25T02:17:43.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.361+0000 7ff665e37740 1 -- start start 2024-04-25T02:17:43.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.361+0000 7ff665e37740 1 Processor -- start 2024-04-25T02:17:43.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff665e37740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fc86b0 0x5596960537a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff665e37740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695fd5d60 0x559695fd4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff665e37740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695fd54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff665e37740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559695fd9d60 con 0x559695ff3600 2024-04-25T02:17:43.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff665e37740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c0b9130 con 0x559695fc86b0 2024-04-25T02:17:43.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff665e37740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x559695fad700 con 0x559695fd5d60 2024-04-25T02:17:43.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff665e37740 10 client.0 _ll_register_callbacks cb 0x7ff648059e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:17:43.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff6615ea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695fd54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff6615ea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695fd54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48388/0 (socket says 172.21.15.79:48388) 2024-04-25T02:17:43.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff6615ea640 1 -- 172.21.15.79:0/1120604383 learned_addr learned my addr 172.21.15.79:0/1120604383 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:43.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff6615ea640 1 -- 172.21.15.79:0/1120604383 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695fd5d60 msgr2=0x559695fd4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:43.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff6615ea640 1 --2- 172.21.15.79:0/1120604383 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695fd5d60 0x559695fd4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff6615ea640 1 -- 172.21.15.79:0/1120604383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fc86b0 msgr2=0x5596960537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:43.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff6615ea640 1 --2- 172.21.15.79:0/1120604383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fc86b0 0x5596960537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff6615ea640 1 -- 172.21.15.79:0/1120604383 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559695fe67a0 con 0x559695ff3600 2024-04-25T02:17:43.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff6615ea640 1 --2- 172.21.15.79:0/1120604383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695fd54d0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7ff65c08e440 tx=0x7ff654007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7943572983133320 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:43.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.362+0000 7ff63b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:17:43.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff63b7fe640 1 -- 172.21.15.79:0/1120604383 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654019020 con 0x559695ff3600 2024-04-25T02:17:43.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff63b7fe640 1 -- 172.21.15.79:0/1120604383 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7ff65400aab0 con 0x559695ff3600 2024-04-25T02:17:43.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff665e37740 1 -- 172.21.15.79:0/1120604383 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff650007690 con 0x559695ff3600 2024-04-25T02:17:43.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff63b7fe640 1 -- 172.21.15.79:0/1120604383 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7ff654023050 con 0x559695ff3600 2024-04-25T02:17:43.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff665e37740 10 client.9135 fetch_fsmap learned FSMap version 83 2024-04-25T02:17:43.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff665e37740 1 -- 172.21.15.79:0/1120604383 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x559695ff4950 con 0x559695ff3600 2024-04-25T02:17:43.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff63b7fe640 1 -- 172.21.15.79:0/1120604383 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff650007690 con 0x559695ff3600 2024-04-25T02:17:43.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff63b7fe640 1 -- 172.21.15.79:0/1120604383 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7ff654026020 con 0x559695ff3600 2024-04-25T02:17:43.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff665e37740 10 client.9135 fetch_fsmap finished waiting for FSMap version 83 2024-04-25T02:17:43.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff665e37740 10 client.9135 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-25T02:17:43.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff665e37740 20 client.9135 populate_metadata read hostname 'smithi079' 2024-04-25T02:17:43.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff665e37740 1 --2- 172.21.15.79:0/1120604383 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x559695fe6f30 0x559695fee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff665e37740 4 client.9135 mds_command: new command op to 8919 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T02:17:43.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff665e37740 1 -- 172.21.15.79:0/1120604383 --> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559695f16f40 con 0x559695fe6f30 2024-04-25T02:17:43.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff660de9640 1 --2- 172.21.15.79:0/1120604383 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x559695fe6f30 0x559695fee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff63b7fe640 10 client.9135 ms_handle_connect on v2:172.21.15.79:6836/2134535107 2024-04-25T02:17:43.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.363+0000 7ff660de9640 1 --2- 172.21.15.79:0/1120604383 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x559695fe6f30 0x559695fee120 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92188f084c4d135c server_cookie=680f4784e6056e6e in_seq=0 out_seq=0 2024-04-25T02:17:43.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.374+0000 7ff63b7fe640 1 -- 172.21.15.79:0/1120604383 <== mds.0 v2:172.21.15.79:6836/2134535107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559695f16f40 con 0x559695fe6f30 2024-04-25T02:17:43.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.374+0000 7ff63b7fe640 10 client.9135 handle_command_reply: tid=0 2024-04-25T02:17:43.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.374+0000 7ff665e37740 1 client.9135 shutdown 2024-04-25T02:17:43.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.374+0000 7ff665e37740 1 -- 172.21.15.79:0/1120604383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 msgr2=0x559695fd54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.374+0000 7ff665e37740 1 --2- 172.21.15.79:0/1120604383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695fd54d0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7ff65c08e440 tx=0x7ff654007af0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.374+0000 7ff665e37740 1 -- 172.21.15.79:0/1120604383 shutdown_connections 2024-04-25T02:17:43.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.374+0000 7ff665e37740 1 --2- 172.21.15.79:0/1120604383 >> [v2:172.21.15.79:6836/2134535107,v1:172.21.15.79:6837/2134535107] conn(0x559695fe6f30 0x559695fee120 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.374+0000 7ff665e37740 1 --2- 172.21.15.79:0/1120604383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559695ff3600 0x559695fd54d0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.374+0000 7ff665e37740 1 --2- 172.21.15.79:0/1120604383 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559695fd5d60 0x559695fd4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.374+0000 7ff63b7fe640 0 client.9135 ms_handle_reset on v2:172.21.15.79:6836/2134535107 2024-04-25T02:17:43.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.374+0000 7ff665e37740 1 --2- 172.21.15.79:0/1120604383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695fc86b0 0x5596960537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.374+0000 7ff665e37740 1 -- 172.21.15.79:0/1120604383 >> 172.21.15.79:0/1120604383 conn(0x559695faba40 msgr2=0x559695feae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:43.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.374+0000 7ff665e37740 1 -- 172.21.15.79:0/1120604383 shutdown_connections 2024-04-25T02:17:43.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.374+0000 7ff665e37740 1 -- 172.21.15.79:0/1120604383 wait complete. 2024-04-25T02:17:43.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.375+0000 7ff665e37740 20 client.9135 trim_cache size 0 max 16384 2024-04-25T02:17:43.380 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:17:43.380 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "", 2024-04-25T02:17:43.380 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0 2024-04-25T02:17:43.380 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:17:43.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.375+0000 7ff66304d640 1 -- 172.21.15.79:0/1228184777 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64006be30 msgr2=0x7ff64006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.375+0000 7ff66304d640 1 --2- 172.21.15.79:0/1228184777 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64006be30 0x7ff64006e2f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff650034000 tx=0x7ff650009030 comp rx=0 tx=0).stop 2024-04-25T02:17:43.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.375+0000 7ff66304d640 1 -- 172.21.15.79:0/1228184777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff65c156dd0 msgr2=0x7ff65c0c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.375+0000 7ff66304d640 1 --2- 172.21.15.79:0/1228184777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff65c156dd0 0x7ff65c0c86b0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7ff6480119d0 tx=0x7ff648011e90 comp rx=0 tx=0).stop 2024-04-25T02:17:43.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.375+0000 7ff66304d640 1 -- 172.21.15.79:0/1228184777 shutdown_connections 2024-04-25T02:17:43.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.375+0000 7ff66304d640 1 --2- 172.21.15.79:0/1228184777 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff64006be30 0x7ff64006e2f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.375+0000 7ff66304d640 1 --2- 172.21.15.79:0/1228184777 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd410 0x7ff65c0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.375+0000 7ff66304d640 1 --2- 172.21.15.79:0/1228184777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff65c156dd0 0x7ff65c0c86b0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.375+0000 7ff66304d640 1 --2- 172.21.15.79:0/1228184777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff64c0039e0 0x7ff65c1f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.375+0000 7ff66304d640 1 -- 172.21.15.79:0/1228184777 >> 172.21.15.79:0/1228184777 conn(0x7ff65c09d4a0 msgr2=0x7ff65c0d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:43.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.375+0000 7ff66304d640 1 -- 172.21.15.79:0/1228184777 shutdown_connections 2024-04-25T02:17:43.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.375+0000 7ff66304d640 1 -- 172.21.15.79:0/1228184777 wait complete. 2024-04-25T02:17:43.390 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:17:43.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.482+0000 7f059dfaf640 1 Processor -- start 2024-04-25T02:17:43.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.483+0000 7f059dfaf640 1 -- start start 2024-04-25T02:17:43.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.483+0000 7f059dfaf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f059815e4d0 0x7f059806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.483+0000 7f059dfaf640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f05980d2e20 0x7f05980cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.483+0000 7f059dfaf640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05980d1660 con 0x7f05980b3570 2024-04-25T02:17:43.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.483+0000 7f059dfaf640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f05980d1380 con 0x7f059815e4d0 2024-04-25T02:17:43.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.483+0000 7f059dfaf640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f05980cede0 con 0x7f05980d2e20 2024-04-25T02:17:43.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.483+0000 7f05977fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f059815e4d0 0x7f059806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.483+0000 7f05977fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f059815e4d0 0x7f059806bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48400/0 (socket says 172.21.15.79:48400) 2024-04-25T02:17:43.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.483+0000 7f05977fe640 1 -- 172.21.15.79:0/212791824 learned_addr learned my addr 172.21.15.79:0/212791824 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:43.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.484+0000 7f05977fe640 1 -- 172.21.15.79:0/212791824 >> v2:172.21.15.189:3300/0 conn(0x7f05980d2e20 msgr2=0x7f05980cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:43.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.484+0000 7f05977fe640 1 --2- 172.21.15.79:0/212791824 >> v2:172.21.15.189:3300/0 conn(0x7f05980d2e20 0x7f05980cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.484+0000 7f05977fe640 1 -- 172.21.15.79:0/212791824 >> v1:172.21.15.189:6789/0 conn(0x7f05980b3570 legacy=0x7f05980d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:43.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.484+0000 7f05977fe640 1 -- 172.21.15.79:0/212791824 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05980cf0c0 con 0x7f059815e4d0 2024-04-25T02:17:43.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.484+0000 7f05977fe640 1 --2- 172.21.15.79:0/212791824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f059815e4d0 0x7f059806bc70 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f0588009870 tx=0x7f058802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a2565c33205f36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:43.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.484+0000 7f0596ffd640 1 -- 172.21.15.79:0/212791824 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588037070 con 0x7f059815e4d0 2024-04-25T02:17:43.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.484+0000 7f0596ffd640 1 -- 172.21.15.79:0/212791824 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0588032440 con 0x7f059815e4d0 2024-04-25T02:17:43.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.484+0000 7f0596ffd640 1 -- 172.21.15.79:0/212791824 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588032810 con 0x7f059815e4d0 2024-04-25T02:17:43.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.485+0000 7f059dfaf640 1 -- 172.21.15.79:0/212791824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f059815e4d0 msgr2=0x7f059806bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.485+0000 7f059dfaf640 1 --2- 172.21.15.79:0/212791824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f059815e4d0 0x7f059806bc70 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f0588009870 tx=0x7f058802a270 comp rx=0 tx=0).stop 2024-04-25T02:17:43.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.485+0000 7f059dfaf640 1 -- 172.21.15.79:0/212791824 shutdown_connections 2024-04-25T02:17:43.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.485+0000 7f059dfaf640 1 --2- 172.21.15.79:0/212791824 >> v2:172.21.15.189:3300/0 conn(0x7f05980d2e20 0x7f05980cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.485+0000 7f059dfaf640 1 --2- 172.21.15.79:0/212791824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f059815e4d0 0x7f059806bc70 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.485+0000 7f059dfaf640 1 -- 172.21.15.79:0/212791824 >> 172.21.15.79:0/212791824 conn(0x7f059809d460 msgr2=0x7f05980d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:43.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.485+0000 7f059dfaf640 1 -- 172.21.15.79:0/212791824 shutdown_connections 2024-04-25T02:17:43.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.485+0000 7f059dfaf640 1 -- 172.21.15.79:0/212791824 wait complete. 2024-04-25T02:17:43.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.486+0000 7f059dfaf640 1 Processor -- start 2024-04-25T02:17:43.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.486+0000 7f059dfaf640 1 -- start start 2024-04-25T02:17:43.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f059dfaf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05980b3570 0x7f05980cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f059dfaf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05980d2e20 0x7f05980b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f059dfaf640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f059815e4d0 0x7f059814c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f059dfaf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05980d2250 con 0x7f05980d2e20 2024-04-25T02:17:43.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f059dfaf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f05980d20d0 con 0x7f05980b3570 2024-04-25T02:17:43.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f059dfaf640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f059806c1b0 con 0x7f059815e4d0 2024-04-25T02:17:43.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f058effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05980d2e20 0x7f05980b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f058effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05980d2e20 0x7f05980b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48414/0 (socket says 172.21.15.79:48414) 2024-04-25T02:17:43.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f058effd640 1 -- 172.21.15.79:0/2481448051 learned_addr learned my addr 172.21.15.79:0/2481448051 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:43.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f05977fe640 1 --2- 172.21.15.79:0/2481448051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05980b3570 0x7f05980cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f0597fff640 1 --2- 172.21.15.79:0/2481448051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f059815e4d0 0x7f059814c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f058effd640 1 -- 172.21.15.79:0/2481448051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f059815e4d0 msgr2=0x7f059814c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f058effd640 1 --2- 172.21.15.79:0/2481448051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f059815e4d0 0x7f059814c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f058effd640 1 -- 172.21.15.79:0/2481448051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05980b3570 msgr2=0x7f05980cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f058effd640 1 --2- 172.21.15.79:0/2481448051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05980b3570 0x7f05980cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f058effd640 1 -- 172.21.15.79:0/2481448051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059814a130 con 0x7f05980d2e20 2024-04-25T02:17:43.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.487+0000 7f0597fff640 1 --2- 172.21.15.79:0/2481448051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f059815e4d0 0x7f059814c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:43.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.488+0000 7f058effd640 1 --2- 172.21.15.79:0/2481448051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05980d2e20 0x7f05980b44d0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f058000c410 tx=0x7f058000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:43.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.488+0000 7f0594ff9640 1 -- 172.21.15.79:0/2481448051 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0580017070 con 0x7f05980d2e20 2024-04-25T02:17:43.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.488+0000 7f0594ff9640 1 -- 172.21.15.79:0/2481448051 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05800035f0 con 0x7f05980d2e20 2024-04-25T02:17:43.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.488+0000 7f0594ff9640 1 -- 172.21.15.79:0/2481448051 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0580003a20 con 0x7f05980d2e20 2024-04-25T02:17:43.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.488+0000 7f059dfaf640 1 -- 172.21.15.79:0/2481448051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05980b5530 con 0x7f05980d2e20 2024-04-25T02:17:43.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.488+0000 7f059dfaf640 1 -- 172.21.15.79:0/2481448051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05980b4f70 con 0x7f05980d2e20 2024-04-25T02:17:43.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.489+0000 7f059dfaf640 1 -- 172.21.15.79:0/2481448051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f059814a420 con 0x7f05980d2e20 2024-04-25T02:17:43.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.489+0000 7f0594ff9640 1 -- 172.21.15.79:0/2481448051 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f058001a070 con 0x7f05980d2e20 2024-04-25T02:17:43.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.490+0000 7f0594ff9640 1 --2- 172.21.15.79:0/2481448051 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f057806be60 0x7f057806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:43.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.490+0000 7f05977fe640 1 --2- 172.21.15.79:0/2481448051 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f057806be60 0x7f057806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:43.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.490+0000 7f0594ff9640 1 -- 172.21.15.79:0/2481448051 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7f058008a2f0 con 0x7f05980d2e20 2024-04-25T02:17:43.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.490+0000 7f05977fe640 1 --2- 172.21.15.79:0/2481448051 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f057806be60 0x7f057806e320 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0588034000 tx=0x7f058802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:43.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.494+0000 7f0594ff9640 1 -- 172.21.15.79:0/2481448051 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0580058cf0 con 0x7f05980d2e20 2024-04-25T02:17:43.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.704+0000 7f059dfaf640 1 -- 172.21.15.79:0/2481448051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f05980690a0 con 0x7f05980d2e20 2024-04-25T02:17:43.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.705+0000 7f0594ff9640 1 -- 172.21.15.79:0/2481448051 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) ==== 53+0+73 (secure 0 0 0) 0x7f05800010c0 con 0x7f05980d2e20 2024-04-25T02:17:43.709 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:17:43.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.707+0000 7f059dfaf640 1 -- 172.21.15.79:0/2481448051 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f057806be60 msgr2=0x7f057806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.707+0000 7f059dfaf640 1 --2- 172.21.15.79:0/2481448051 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f057806be60 0x7f057806e320 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0588034000 tx=0x7f058802e000 comp rx=0 tx=0).stop 2024-04-25T02:17:43.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.707+0000 7f059dfaf640 1 -- 172.21.15.79:0/2481448051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05980d2e20 msgr2=0x7f05980b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:43.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.707+0000 7f059dfaf640 1 --2- 172.21.15.79:0/2481448051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05980d2e20 0x7f05980b44d0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f058000c410 tx=0x7f058000c8d0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.707+0000 7f059dfaf640 1 -- 172.21.15.79:0/2481448051 shutdown_connections 2024-04-25T02:17:43.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.707+0000 7f059dfaf640 1 --2- 172.21.15.79:0/2481448051 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f057806be60 0x7f057806e320 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.707+0000 7f059dfaf640 1 --2- 172.21.15.79:0/2481448051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f059815e4d0 0x7f059814c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.707+0000 7f059dfaf640 1 --2- 172.21.15.79:0/2481448051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05980d2e20 0x7f05980b44d0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.707+0000 7f059dfaf640 1 --2- 172.21.15.79:0/2481448051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05980b3570 0x7f05980cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:43.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.707+0000 7f059dfaf640 1 -- 172.21.15.79:0/2481448051 >> 172.21.15.79:0/2481448051 conn(0x7f059809d460 msgr2=0x7f059815eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:43.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.707+0000 7f059dfaf640 1 -- 172.21.15.79:0/2481448051 shutdown_connections 2024-04-25T02:17:43.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43.707+0000 7f059dfaf640 1 -- 172.21.15.79:0/2481448051 wait complete. 2024-04-25T02:17:43.722 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:17:43.722 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:17:43.722 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:17:43.722 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:17:43.722 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:17:43.722 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:17:43.722 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:17:43.722 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:17:43.722 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:17:43.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:43.723 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:17:43.738 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:17:43.738 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:17:43.738 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:17:43.738 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:43.738 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:17:43.738 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:43.738 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:17:43.738 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:17:43.738 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:17:43.738 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:17:43.738 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:17:43.738 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:17:43.739 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:17:43.739 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:17:43.739 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:17:43.739 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:17:43.739 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:17:43.739 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42142sec preferred_lft 42142sec 2024-04-25T02:17:43.739 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:17:43.739 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:43.739 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:17:43.739 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:17:43.739 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:17:43.739 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:43.739 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:17:43.739 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:43.739 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:17:43.740 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:17:43.740 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link 2024-04-25T02:17:43.740 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:43.740 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:17:43.740 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:17:43.740 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::4c:adff:fe56:7194/64 scope link 2024-04-25T02:17:43.740 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:43.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:43.740 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:17:43.800 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:17:43.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:43.801 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:17:43.857 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:17:43.858 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:17:43.858 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:17:43.858 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:17:43.858 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:17:43.858 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:17:43.858 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:17:43.858 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:17:43.858 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:17:43.859 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:17:43.859 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:17:43.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:17:43.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:43.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:43.982 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:17:43.997 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:17:43.997 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:17:43.997 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:17:43.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:43.998 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:17:44.061 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:17:44.061 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:17:44.116 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:17:44.116 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:17:44.116 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:17:44.170 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:17:44.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:44.170 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:17:44.251 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:17:44.251 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:17:44.251 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:17:44.259 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:17:44.259 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:17:44.259 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:17:44.259 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:17:44.259 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:17:44.264 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:17:44.264 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:17:44.264 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:17:44.264 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:17:44.264 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:17:44.264 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:17:44.264 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:17:44.265 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:17:44.268 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:17:44.268 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:17:44.268 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:17:44.269 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:17:44.269 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:17:44.269 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:17:44.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:44.269 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:17:44.333 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:17:44.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:17:44.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:44.428 INFO:teuthology.orchestra.run.smithi079.stdout:client7177 2024-04-25T02:17:44.428 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:17:44.428 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:44.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:44.443 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/unflushed) 2024-04-25T02:17:44.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:44.502 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=./parent/unflushed/jfile bs=1M count=8) 2024-04-25T02:17:44.582 INFO:teuthology.orchestra.run.smithi079.stderr:8+0 records in 2024-04-25T02:17:44.582 INFO:teuthology.orchestra.run.smithi079.stderr:8+0 records out 2024-04-25T02:17:44.582 INFO:teuthology.orchestra.run.smithi079.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0243342 s, 345 MB/s 2024-04-25T02:17:44.583 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:44.583 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:44.583 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:17:44.583 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:17:44.583 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T02:17:44.583 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:44.687 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627779 2024-04-25T02:17:44.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:44.696 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:44.696 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:44.696 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:17:44.696 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:17:44.696 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T02:17:44.696 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:44.799 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627780 2024-04-25T02:17:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:44.808 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:17:44.808 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:44.863 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:17:44.863 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:44.919 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:17:45.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.051+0000 7feda2d14640 1 Processor -- start 2024-04-25T02:17:45.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.051+0000 7feda2d14640 1 -- start start 2024-04-25T02:17:45.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7feda2d14640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed9c143bc0 0x7fed9c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7feda2d14640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed9c15fa40 con 0x7fed9c0b3d40 2024-04-25T02:17:45.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7feda2d14640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed9c0b5700 con 0x7fed9c06df50 2024-04-25T02:17:45.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7feda2d14640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fed9c072cb0 con 0x7fed9c143bc0 2024-04-25T02:17:45.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7feda12b1640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fed9c0b3d40 0x7fed9c0b4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38912/0 (socket says 172.21.15.79:38912) 2024-04-25T02:17:45.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7feda12b1640 1 -- 172.21.15.79:0/478061966 learned_addr learned my addr 172.21.15.79:0/478061966 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:45.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7feda0ab0640 1 --2- 172.21.15.79:0/478061966 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed9c143bc0 0x7fed9c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7fed9b7fe640 1 -- 172.21.15.79:0/478061966 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 24496530 0 0) 0x7fed94001490 con 0x7fed9c0b3d40 2024-04-25T02:17:45.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7fed9b7fe640 1 -- 172.21.15.79:0/478061966 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed8c005730 con 0x7fed9c0b3d40 2024-04-25T02:17:45.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7fed9b7fe640 1 -- 172.21.15.79:0/478061966 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3074287377 0 0) 0x7fed8c005730 con 0x7fed9c0b3d40 2024-04-25T02:17:45.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7fed9b7fe640 1 -- 172.21.15.79:0/478061966 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed9c143bc0 msgr2=0x7fed9c15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:45.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7fed9b7fe640 1 --2- 172.21.15.79:0/478061966 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed9c143bc0 0x7fed9c15f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7fed9b7fe640 1 -- 172.21.15.79:0/478061966 >> v1:172.21.15.189:6789/0 conn(0x7fed9c06df50 legacy=0x7fed9c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7fed9b7fe640 1 -- 172.21.15.79:0/478061966 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9c071e00 con 0x7fed9c0b3d40 2024-04-25T02:17:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7fed9b7fe640 1 -- 172.21.15.79:0/478061966 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fed94001bc0 con 0x7fed9c0b3d40 2024-04-25T02:17:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7fed9b7fe640 1 -- 172.21.15.79:0/478061966 >> v1:172.21.15.79:6789/0 conn(0x7fed9c0b3d40 legacy=0x7fed9c0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7fed9b7fe640 1 --2- 172.21.15.79:0/478061966 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed9c143bc0 0x7fed8c005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7fed9b7fe640 1 --2- 172.21.15.79:0/478061966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed8c006130 0x7fed8c006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7fed9b7fe640 1 --2- 172.21.15.79:0/478061966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c006f50 0x7fed8c0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7fed9b7fe640 1 -- 172.21.15.79:0/478061966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c072cb0 con 0x7fed8c006f50 2024-04-25T02:17:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7fed9b7fe640 1 -- 172.21.15.79:0/478061966 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c00dce0 con 0x7fed8c006130 2024-04-25T02:17:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.052+0000 7fed9b7fe640 1 -- 172.21.15.79:0/478061966 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fed8c00dee0 con 0x7fed9c143bc0 2024-04-25T02:17:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.053+0000 7feda12b1640 1 --2- 172.21.15.79:0/478061966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c006f50 0x7fed8c0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.053+0000 7feda0ab0640 1 --2- 172.21.15.79:0/478061966 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed9c143bc0 0x7fed8c005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.053+0000 7fed9bfff640 1 --2- 172.21.15.79:0/478061966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed8c006130 0x7fed8c006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.053+0000 7feda12b1640 1 -- 172.21.15.79:0/478061966 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed9c143bc0 msgr2=0x7fed8c005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.053+0000 7feda12b1640 1 --2- 172.21.15.79:0/478061966 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed9c143bc0 0x7fed8c005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.053+0000 7feda12b1640 1 -- 172.21.15.79:0/478061966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed8c006130 msgr2=0x7fed8c006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:45.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.053+0000 7feda12b1640 1 --2- 172.21.15.79:0/478061966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed8c006130 0x7fed8c006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.053+0000 7feda12b1640 1 -- 172.21.15.79:0/478061966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8c005730 con 0x7fed8c006f50 2024-04-25T02:17:45.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.053+0000 7fed9bfff640 1 --2- 172.21.15.79:0/478061966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed8c006130 0x7fed8c006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:45.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.053+0000 7feda12b1640 1 --2- 172.21.15.79:0/478061966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c006f50 0x7fed8c0073d0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fed9400aa70 tx=0x7fed8c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172f447363b13d52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:45.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.054+0000 7fed9b7fe640 1 -- 172.21.15.79:0/478061966 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9400a690 con 0x7fed8c006f50 2024-04-25T02:17:45.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.054+0000 7fed9b7fe640 1 -- 172.21.15.79:0/478061966 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed9402f070 con 0x7fed8c006f50 2024-04-25T02:17:45.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.054+0000 7fed9b7fe640 1 -- 172.21.15.79:0/478061966 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94034470 con 0x7fed8c006f50 2024-04-25T02:17:45.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.054+0000 7feda2d14640 1 -- 172.21.15.79:0/478061966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c006f50 msgr2=0x7fed8c0073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.054+0000 7feda2d14640 1 --2- 172.21.15.79:0/478061966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c006f50 0x7fed8c0073d0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fed9400aa70 tx=0x7fed8c007a40 comp rx=0 tx=0).stop 2024-04-25T02:17:45.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.054+0000 7feda12b1640 1 -- 172.21.15.79:0/478061966 reap_dead start 2024-04-25T02:17:45.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.054+0000 7feda2d14640 1 -- 172.21.15.79:0/478061966 shutdown_connections 2024-04-25T02:17:45.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.054+0000 7feda2d14640 1 -- 172.21.15.79:0/478061966 >> 172.21.15.79:0/478061966 conn(0x7fed9c0cfc80 msgr2=0x7fed9c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:45.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.054+0000 7feda2d14640 1 -- 172.21.15.79:0/478061966 shutdown_connections 2024-04-25T02:17:45.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.054+0000 7feda2d14640 1 -- 172.21.15.79:0/478061966 wait complete. 2024-04-25T02:17:45.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.055+0000 7feda2d14640 1 Processor -- start 2024-04-25T02:17:45.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.055+0000 7feda2d14640 1 -- start start 2024-04-25T02:17:45.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.056+0000 7feda2d14640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed8c006f50 0x7fed9c1efdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.056+0000 7feda2d14640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed9c158c50 0x7fed9c06d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.056+0000 7feda2d14640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed9c1f2710 0x7fed9c1f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.056+0000 7feda2d14640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c072660 con 0x7fed9c1f2710 2024-04-25T02:17:45.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.056+0000 7feda2d14640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c072380 con 0x7fed9c158c50 2024-04-25T02:17:45.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.056+0000 7feda2d14640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fed9c072940 con 0x7fed8c006f50 2024-04-25T02:17:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.056+0000 7feda12b1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed9c1f2710 0x7fed9c1f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.056+0000 7feda12b1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed9c1f2710 0x7fed9c1f2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36356/0 (socket says 172.21.15.79:36356) 2024-04-25T02:17:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.056+0000 7feda12b1640 1 -- 172.21.15.79:0/2250934642 learned_addr learned my addr 172.21.15.79:0/2250934642 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.056+0000 7feda0ab0640 1 --2- 172.21.15.79:0/2250934642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed8c006f50 0x7fed9c1efdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.056+0000 7fed9bfff640 1 --2- 172.21.15.79:0/2250934642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed9c158c50 0x7fed9c06d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.057+0000 7feda12b1640 1 -- 172.21.15.79:0/2250934642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed8c006f50 msgr2=0x7fed9c1efdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.057+0000 7feda12b1640 1 --2- 172.21.15.79:0/2250934642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed8c006f50 0x7fed9c1efdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.057+0000 7feda12b1640 1 -- 172.21.15.79:0/2250934642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed9c158c50 msgr2=0x7fed9c06d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.057+0000 7feda12b1640 1 --2- 172.21.15.79:0/2250934642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed9c158c50 0x7fed9c06d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.057+0000 7feda12b1640 1 -- 172.21.15.79:0/2250934642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9c1590d0 con 0x7fed9c1f2710 2024-04-25T02:17:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.057+0000 7feda12b1640 1 --2- 172.21.15.79:0/2250934642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed9c1f2710 0x7fed9c1f2b90 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fed94001ec0 tx=0x7fed94001f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.057+0000 7fed997fa640 1 -- 172.21.15.79:0/2250934642 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9400a690 con 0x7fed9c1f2710 2024-04-25T02:17:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.057+0000 7fed997fa640 1 -- 172.21.15.79:0/2250934642 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed9402ba70 con 0x7fed9c1f2710 2024-04-25T02:17:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.057+0000 7feda2d14640 1 -- 172.21.15.79:0/2250934642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9c1f30d0 con 0x7fed9c1f2710 2024-04-25T02:17:45.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.057+0000 7fed997fa640 1 -- 172.21.15.79:0/2250934642 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9402be60 con 0x7fed9c1f2710 2024-04-25T02:17:45.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.057+0000 7feda2d14640 1 -- 172.21.15.79:0/2250934642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed9c1565d0 con 0x7fed9c1f2710 2024-04-25T02:17:45.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.058+0000 7feda2d14640 1 -- 172.21.15.79:0/2250934642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed9c0690a0 con 0x7fed9c1f2710 2024-04-25T02:17:45.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.058+0000 7fed997fa640 1 -- 172.21.15.79:0/2250934642 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed94034470 con 0x7fed9c1f2710 2024-04-25T02:17:45.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.059+0000 7fed997fa640 1 --2- 172.21.15.79:0/2250934642 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fed8006be30 0x7fed8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.059+0000 7fed997fa640 1 -- 172.21.15.79:0/2250934642 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7fed940aa610 con 0x7fed9c1f2710 2024-04-25T02:17:45.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.059+0000 7feda0ab0640 1 --2- 172.21.15.79:0/2250934642 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fed8006be30 0x7fed8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.059+0000 7feda0ab0640 1 --2- 172.21.15.79:0/2250934642 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fed8006be30 0x7fed8006e2f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fed90009bc0 tx=0x7fed90009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:45.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.063+0000 7fed997fa640 1 -- 172.21.15.79:0/2250934642 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fed9c15fa40 con 0x7fed9c1f2710 2024-04-25T02:17:45.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.238+0000 7feda2d14640 1 -- 172.21.15.79:0/2250934642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed9c0b3280 con 0x7fed9c1f2710 2024-04-25T02:17:45.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.239+0000 7fed997fa640 1 -- 172.21.15.79:0/2250934642 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16732 (secure 0 0 0) 0x7fed940788a0 con 0x7fed9c1f2710 2024-04-25T02:17:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:45.244 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":117,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:17:42.954192+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:17:32.207579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T02:17:32.929915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.b","mappings":[{"from":0,"to":2}]},{"pgid":"17.34","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:17:45.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.241+0000 7feda2d14640 1 -- 172.21.15.79:0/2250934642 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fed8006be30 msgr2=0x7fed8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.241+0000 7feda2d14640 1 --2- 172.21.15.79:0/2250934642 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fed8006be30 0x7fed8006e2f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fed90009bc0 tx=0x7fed90009190 comp rx=0 tx=0).stop 2024-04-25T02:17:45.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.241+0000 7feda2d14640 1 -- 172.21.15.79:0/2250934642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed9c1f2710 msgr2=0x7fed9c1f2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.241+0000 7feda2d14640 1 --2- 172.21.15.79:0/2250934642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed9c1f2710 0x7fed9c1f2b90 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fed94001ec0 tx=0x7fed94001f90 comp rx=0 tx=0).stop 2024-04-25T02:17:45.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.242+0000 7feda2d14640 1 -- 172.21.15.79:0/2250934642 shutdown_connections 2024-04-25T02:17:45.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.242+0000 7feda2d14640 1 --2- 172.21.15.79:0/2250934642 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fed8006be30 0x7fed8006e2f0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.242+0000 7feda2d14640 1 --2- 172.21.15.79:0/2250934642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed9c1f2710 0x7fed9c1f2b90 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.242+0000 7feda2d14640 1 --2- 172.21.15.79:0/2250934642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed9c158c50 0x7fed9c06d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.242+0000 7feda2d14640 1 --2- 172.21.15.79:0/2250934642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fed8c006f50 0x7fed9c1efdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.242+0000 7feda2d14640 1 -- 172.21.15.79:0/2250934642 >> 172.21.15.79:0/2250934642 conn(0x7fed9c0cfc80 msgr2=0x7fed9c143fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:45.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.242+0000 7feda2d14640 1 -- 172.21.15.79:0/2250934642 shutdown_connections 2024-04-25T02:17:45.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.242+0000 7feda2d14640 1 -- 172.21.15.79:0/2250934642 wait complete. 2024-04-25T02:17:45.257 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:17:32.207579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:17:32.929915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:17:45.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:17:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.353+0000 7fc62e7f9640 1 Processor -- start 2024-04-25T02:17:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.353+0000 7fc62e7f9640 1 -- start start 2024-04-25T02:17:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc62e7f9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc62806b2f0 0x7fc6280b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc62e7f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6280cf7a0 0x7fc62806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc62e7f9640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc62806e6b0 0x7fc6280cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc62e7f9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc62815f830 con 0x7fc62806b2f0 2024-04-25T02:17:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc62e7f9640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc62806bc10 con 0x7fc62806e6b0 2024-04-25T02:17:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc62e7f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc62815ec20 con 0x7fc6280cf7a0 2024-04-25T02:17:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc627fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc62806b2f0 0x7fc6280b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc627fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc62806b2f0 0x7fc6280b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36358/0 (socket says 172.21.15.79:36358) 2024-04-25T02:17:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc627fff640 1 -- 172.21.15.79:0/2199853602 learned_addr learned my addr 172.21.15.79:0/2199853602 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc6277fe640 1 --2- 172.21.15.79:0/2199853602 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6280cf7a0 0x7fc62806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc627fff640 1 -- 172.21.15.79:0/2199853602 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6280cf7a0 msgr2=0x7fc62806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc62cd96640 1 --2- 172.21.15.79:0/2199853602 >> v2:172.21.15.189:3300/0 conn(0x7fc62806e6b0 0x7fc6280cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc627fff640 1 --2- 172.21.15.79:0/2199853602 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6280cf7a0 0x7fc62806b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc627fff640 1 -- 172.21.15.79:0/2199853602 >> v2:172.21.15.189:3300/0 conn(0x7fc62806e6b0 msgr2=0x7fc6280cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:45.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc627fff640 1 --2- 172.21.15.79:0/2199853602 >> v2:172.21.15.189:3300/0 conn(0x7fc62806e6b0 0x7fc6280cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc627fff640 1 -- 172.21.15.79:0/2199853602 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62815ef00 con 0x7fc62806b2f0 2024-04-25T02:17:45.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc6277fe640 1 --2- 172.21.15.79:0/2199853602 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6280cf7a0 0x7fc62806b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:45.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.354+0000 7fc62cd96640 1 --2- 172.21.15.79:0/2199853602 >> v2:172.21.15.189:3300/0 conn(0x7fc62806e6b0 0x7fc6280cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:45.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.355+0000 7fc627fff640 1 --2- 172.21.15.79:0/2199853602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc62806b2f0 0x7fc6280b4b50 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fc628070d00 tx=0x7fc61c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2cd411f37beb6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:45.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.355+0000 7fc626ffd640 1 -- 172.21.15.79:0/2199853602 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c037070 con 0x7fc62806b2f0 2024-04-25T02:17:45.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.355+0000 7fc626ffd640 1 -- 172.21.15.79:0/2199853602 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61c032440 con 0x7fc62806b2f0 2024-04-25T02:17:45.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.355+0000 7fc626ffd640 1 -- 172.21.15.79:0/2199853602 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c032810 con 0x7fc62806b2f0 2024-04-25T02:17:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.356+0000 7fc62e7f9640 1 -- 172.21.15.79:0/2199853602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc62806b2f0 msgr2=0x7fc6280b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.356+0000 7fc62e7f9640 1 --2- 172.21.15.79:0/2199853602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc62806b2f0 0x7fc6280b4b50 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fc628070d00 tx=0x7fc61c02a140 comp rx=0 tx=0).stop 2024-04-25T02:17:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.356+0000 7fc62e7f9640 1 -- 172.21.15.79:0/2199853602 shutdown_connections 2024-04-25T02:17:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.356+0000 7fc62e7f9640 1 --2- 172.21.15.79:0/2199853602 >> v2:172.21.15.189:3300/0 conn(0x7fc62806e6b0 0x7fc6280cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.356+0000 7fc62e7f9640 1 --2- 172.21.15.79:0/2199853602 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6280cf7a0 0x7fc62806b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.356+0000 7fc62e7f9640 1 --2- 172.21.15.79:0/2199853602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc62806b2f0 0x7fc6280b4b50 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.356+0000 7fc62e7f9640 1 -- 172.21.15.79:0/2199853602 >> 172.21.15.79:0/2199853602 conn(0x7fc6280b1cd0 msgr2=0x7fc6280b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.356+0000 7fc62e7f9640 1 -- 172.21.15.79:0/2199853602 shutdown_connections 2024-04-25T02:17:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.356+0000 7fc62e7f9640 1 -- 172.21.15.79:0/2199853602 wait complete. 2024-04-25T02:17:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.357+0000 7fc62e7f9640 1 Processor -- start 2024-04-25T02:17:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.357+0000 7fc62e7f9640 1 -- start start 2024-04-25T02:17:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc62e7f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc62806b2f0 0x7fc62814d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc62e7f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc62806e6b0 0x7fc628150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc62e7f9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6280cf7a0 0x7fc6280cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc62e7f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc62806cfe0 con 0x7fc62806e6b0 2024-04-25T02:17:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc62e7f9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc62815f4c0 con 0x7fc6280cf7a0 2024-04-25T02:17:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc62e7f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc62806d160 con 0x7fc62806b2f0 2024-04-25T02:17:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc6277fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc62806e6b0 0x7fc628150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc6277fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc62806e6b0 0x7fc628150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36362/0 (socket says 172.21.15.79:36362) 2024-04-25T02:17:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc6277fe640 1 -- 172.21.15.79:0/975598451 learned_addr learned my addr 172.21.15.79:0/975598451 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc627fff640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc62806b2f0 0x7fc62814d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc6277fe640 1 -- 172.21.15.79:0/975598451 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc62806b2f0 msgr2=0x7fc62814d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc62cd96640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6280cf7a0 0x7fc6280cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc6277fe640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc62806b2f0 0x7fc62814d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc6277fe640 1 -- 172.21.15.79:0/975598451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6280cf7a0 msgr2=0x7fc6280cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc6277fe640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6280cf7a0 0x7fc6280cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc6277fe640 1 -- 172.21.15.79:0/975598451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62814dd30 con 0x7fc62806e6b0 2024-04-25T02:17:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc627fff640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc62806b2f0 0x7fc62814d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.358+0000 7fc62cd96640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6280cf7a0 0x7fc6280cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.359+0000 7fc6277fe640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc62806e6b0 0x7fc628150680 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fc61800c7f0 tx=0x7fc61800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.359+0000 7fc624ff9640 1 -- 172.21.15.79:0/975598451 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618015070 con 0x7fc62806e6b0 2024-04-25T02:17:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.359+0000 7fc624ff9640 1 -- 172.21.15.79:0/975598451 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc618007820 con 0x7fc62806e6b0 2024-04-25T02:17:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.359+0000 7fc62e7f9640 1 -- 172.21.15.79:0/975598451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62814f8c0 con 0x7fc62806e6b0 2024-04-25T02:17:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.359+0000 7fc624ff9640 1 -- 172.21.15.79:0/975598451 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618007bd0 con 0x7fc62806e6b0 2024-04-25T02:17:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.359+0000 7fc62e7f9640 1 -- 172.21.15.79:0/975598451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc62814fe80 con 0x7fc62806e6b0 2024-04-25T02:17:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.360+0000 7fc62e7f9640 1 -- 172.21.15.79:0/975598451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6281502e0 con 0x7fc62806e6b0 2024-04-25T02:17:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.360+0000 7fc624ff9640 1 -- 172.21.15.79:0/975598451 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc618018070 con 0x7fc62806e6b0 2024-04-25T02:17:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.361+0000 7fc624ff9640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc61406be30 0x7fc61406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.361+0000 7fc627fff640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc61406be30 0x7fc61406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.361+0000 7fc624ff9640 1 -- 172.21.15.79:0/975598451 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7fc61808ae40 con 0x7fc62806e6b0 2024-04-25T02:17:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.361+0000 7fc627fff640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc61406be30 0x7fc61406e2f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc61c034000 tx=0x7fc61c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.365+0000 7fc624ff9640 1 -- 172.21.15.79:0/975598451 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc618059840 con 0x7fc62806e6b0 2024-04-25T02:17:45.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.538+0000 7fc62e7f9640 1 -- 172.21.15.79:0/975598451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc6280690a0 con 0x7fc62806e6b0 2024-04-25T02:17:45.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.538+0000 7fc624ff9640 1 -- 172.21.15.79:0/975598451 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) ==== 93+0+10 (secure 0 0 0) 0x7fc618059140 con 0x7fc62806e6b0 2024-04-25T02:17:45.543 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:17:45.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.540+0000 7fc62e7f9640 1 -- 172.21.15.79:0/975598451 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc61406be30 msgr2=0x7fc61406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.540+0000 7fc62e7f9640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc61406be30 0x7fc61406e2f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc61c034000 tx=0x7fc61c02e000 comp rx=0 tx=0).stop 2024-04-25T02:17:45.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.540+0000 7fc62e7f9640 1 -- 172.21.15.79:0/975598451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc62806e6b0 msgr2=0x7fc628150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.540+0000 7fc62e7f9640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc62806e6b0 0x7fc628150680 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fc61800c7f0 tx=0x7fc61800ccb0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.540+0000 7fc62e7f9640 1 -- 172.21.15.79:0/975598451 shutdown_connections 2024-04-25T02:17:45.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.540+0000 7fc62e7f9640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc61406be30 0x7fc61406e2f0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.540+0000 7fc62e7f9640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6280cf7a0 0x7fc6280cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.540+0000 7fc62e7f9640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc62806e6b0 0x7fc628150680 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.540+0000 7fc62e7f9640 1 --2- 172.21.15.79:0/975598451 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc62806b2f0 0x7fc62814d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.540+0000 7fc62e7f9640 1 -- 172.21.15.79:0/975598451 >> 172.21.15.79:0/975598451 conn(0x7fc6280b1cd0 msgr2=0x7fc62806d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:45.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.540+0000 7fc62e7f9640 1 -- 172.21.15.79:0/975598451 shutdown_connections 2024-04-25T02:17:45.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.540+0000 7fc62e7f9640 1 -- 172.21.15.79:0/975598451 wait complete. 2024-04-25T02:17:45.555 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:17:45.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.650+0000 7f4352638640 1 Processor -- start 2024-04-25T02:17:45.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.650+0000 7f4352638640 1 -- start start 2024-04-25T02:17:45.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.651+0000 7f4352638640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f434c0b41b0 0x7f434c1605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.651+0000 7f4352638640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f434c06b770 0x7f434c156610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.651+0000 7f4352638640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f434c071cd0 con 0x7f434c06b2f0 2024-04-25T02:17:45.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.651+0000 7f4352638640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f434c156b50 con 0x7f434c0b41b0 2024-04-25T02:17:45.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.651+0000 7f4352638640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f434c071fb0 con 0x7f434c06b770 2024-04-25T02:17:45.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.651+0000 7f4350bd5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f434c06b770 0x7f434c156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.651+0000 7f434bfff640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f434c0b41b0 0x7f434c1605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.651+0000 7f4350bd5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f434c06b770 0x7f434c156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:47586/0 (socket says 172.21.15.79:47586) 2024-04-25T02:17:45.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.651+0000 7f4350bd5640 1 -- 172.21.15.79:0/477615325 learned_addr learned my addr 172.21.15.79:0/477615325 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:45.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.652+0000 7f434bfff640 1 -- 172.21.15.79:0/477615325 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f434c06b770 msgr2=0x7f434c156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:45.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.652+0000 7f434bfff640 1 --2- 172.21.15.79:0/477615325 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f434c06b770 0x7f434c156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.652+0000 7f434bfff640 1 -- 172.21.15.79:0/477615325 >> v1:172.21.15.189:6789/0 conn(0x7f434c06b2f0 legacy=0x7f434c155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.652+0000 7f434bfff640 1 -- 172.21.15.79:0/477615325 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434c072290 con 0x7f434c0b41b0 2024-04-25T02:17:45.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.652+0000 7f434bfff640 1 --2- 172.21.15.79:0/477615325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f434c0b41b0 0x7f434c1605d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f433c0097a0 tx=0x7f433c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b525c7a2b24ab3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:45.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.652+0000 7f434affd640 1 -- 172.21.15.79:0/477615325 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c037070 con 0x7f434c0b41b0 2024-04-25T02:17:45.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.653+0000 7f434affd640 1 -- 172.21.15.79:0/477615325 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f433c032440 con 0x7f434c0b41b0 2024-04-25T02:17:45.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.653+0000 7f434affd640 1 -- 172.21.15.79:0/477615325 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c032810 con 0x7f434c0b41b0 2024-04-25T02:17:45.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.653+0000 7f4352638640 1 -- 172.21.15.79:0/477615325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f434c0b41b0 msgr2=0x7f434c1605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.653+0000 7f4352638640 1 --2- 172.21.15.79:0/477615325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f434c0b41b0 0x7f434c1605d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f433c0097a0 tx=0x7f433c02a180 comp rx=0 tx=0).stop 2024-04-25T02:17:45.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.653+0000 7f4352638640 1 -- 172.21.15.79:0/477615325 shutdown_connections 2024-04-25T02:17:45.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.653+0000 7f4352638640 1 --2- 172.21.15.79:0/477615325 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f434c06b770 0x7f434c156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.653+0000 7f4352638640 1 --2- 172.21.15.79:0/477615325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f434c0b41b0 0x7f434c1605d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.653+0000 7f4352638640 1 -- 172.21.15.79:0/477615325 >> 172.21.15.79:0/477615325 conn(0x7f434c0b1cd0 msgr2=0x7f434c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:45.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.653+0000 7f4352638640 1 -- 172.21.15.79:0/477615325 shutdown_connections 2024-04-25T02:17:45.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.653+0000 7f4352638640 1 -- 172.21.15.79:0/477615325 wait complete. 2024-04-25T02:17:45.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.654+0000 7f4352638640 1 Processor -- start 2024-04-25T02:17:45.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.654+0000 7f4352638640 1 -- start start 2024-04-25T02:17:45.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.655+0000 7f4352638640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f434c06b2f0 0x7f434c09c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.655+0000 7f4352638640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f434c06b770 0x7f434c15d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.655+0000 7f4352638640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f434c0b41b0 0x7f434c155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.655+0000 7f4352638640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f434c06bbc0 con 0x7f434c06b2f0 2024-04-25T02:17:45.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.655+0000 7f4352638640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f434c160b10 con 0x7f434c06b770 2024-04-25T02:17:45.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.655+0000 7f4352638640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f434c072d70 con 0x7f434c0b41b0 2024-04-25T02:17:45.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.655+0000 7f434bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f434c06b2f0 0x7f434c09c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.655+0000 7f434bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f434c06b2f0 0x7f434c09c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36378/0 (socket says 172.21.15.79:36378) 2024-04-25T02:17:45.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.655+0000 7f434bfff640 1 -- 172.21.15.79:0/4194971871 learned_addr learned my addr 172.21.15.79:0/4194971871 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:45.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.655+0000 7f4350bd5640 1 --2- 172.21.15.79:0/4194971871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f434c0b41b0 0x7f434c155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.655+0000 7f434b7fe640 1 --2- 172.21.15.79:0/4194971871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f434c06b770 0x7f434c15d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.656+0000 7f434bfff640 1 -- 172.21.15.79:0/4194971871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f434c0b41b0 msgr2=0x7f434c155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.656+0000 7f434bfff640 1 --2- 172.21.15.79:0/4194971871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f434c0b41b0 0x7f434c155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.656+0000 7f434bfff640 1 -- 172.21.15.79:0/4194971871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f434c06b770 msgr2=0x7f434c15d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.656+0000 7f434bfff640 1 --2- 172.21.15.79:0/4194971871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f434c06b770 0x7f434c15d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.656+0000 7f434bfff640 1 -- 172.21.15.79:0/4194971871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434c15df30 con 0x7f434c06b2f0 2024-04-25T02:17:45.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.656+0000 7f434bfff640 1 --2- 172.21.15.79:0/4194971871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f434c06b2f0 0x7f434c09c540 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f433c035040 tx=0x7f433c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:45.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.656+0000 7f4348ff9640 1 -- 172.21.15.79:0/4194971871 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c037040 con 0x7f434c06b2f0 2024-04-25T02:17:45.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.656+0000 7f4348ff9640 1 -- 172.21.15.79:0/4194971871 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f433c030500 con 0x7f434c06b2f0 2024-04-25T02:17:45.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.656+0000 7f4348ff9640 1 -- 172.21.15.79:0/4194971871 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c030910 con 0x7f434c06b2f0 2024-04-25T02:17:45.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.656+0000 7f4352638640 1 -- 172.21.15.79:0/4194971871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434c15e210 con 0x7f434c06b2f0 2024-04-25T02:17:45.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.656+0000 7f4352638640 1 -- 172.21.15.79:0/4194971871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f434c15e7d0 con 0x7f434c06b2f0 2024-04-25T02:17:45.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.657+0000 7f4352638640 1 -- 172.21.15.79:0/4194971871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f434c0690a0 con 0x7f434c06b2f0 2024-04-25T02:17:45.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.657+0000 7f4348ff9640 1 -- 172.21.15.79:0/4194971871 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f433c044020 con 0x7f434c06b2f0 2024-04-25T02:17:45.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.658+0000 7f4348ff9640 1 --2- 172.21.15.79:0/4194971871 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f433806be30 0x7f433806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.658+0000 7f4348ff9640 1 -- 172.21.15.79:0/4194971871 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7f433c0ab110 con 0x7f434c06b2f0 2024-04-25T02:17:45.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.658+0000 7f434b7fe640 1 --2- 172.21.15.79:0/4194971871 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f433806be30 0x7f433806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.658+0000 7f434b7fe640 1 --2- 172.21.15.79:0/4194971871 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f433806be30 0x7f433806e2f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f434c15c700 tx=0x7f4340009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:45.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.662+0000 7f4348ff9640 1 -- 172.21.15.79:0/4194971871 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f433c079a80 con 0x7f434c06b2f0 2024-04-25T02:17:45.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.834+0000 7f4352638640 1 -- 172.21.15.79:0/4194971871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f434c0af390 con 0x7f434c06b2f0 2024-04-25T02:17:45.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.835+0000 7f4348ff9640 1 -- 172.21.15.79:0/4194971871 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) ==== 104+0+11 (secure 0 0 0) 0x7f433c079380 con 0x7f434c06b2f0 2024-04-25T02:17:45.839 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:17:45.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.836+0000 7f4352638640 1 -- 172.21.15.79:0/4194971871 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f433806be30 msgr2=0x7f433806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.836+0000 7f4352638640 1 --2- 172.21.15.79:0/4194971871 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f433806be30 0x7f433806e2f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f434c15c700 tx=0x7f4340009040 comp rx=0 tx=0).stop 2024-04-25T02:17:45.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.836+0000 7f4352638640 1 -- 172.21.15.79:0/4194971871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f434c06b2f0 msgr2=0x7f434c09c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.836+0000 7f4352638640 1 --2- 172.21.15.79:0/4194971871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f434c06b2f0 0x7f434c09c540 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f433c035040 tx=0x7f433c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.837+0000 7f4352638640 1 -- 172.21.15.79:0/4194971871 shutdown_connections 2024-04-25T02:17:45.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.837+0000 7f4352638640 1 --2- 172.21.15.79:0/4194971871 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f433806be30 0x7f433806e2f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.837+0000 7f4352638640 1 --2- 172.21.15.79:0/4194971871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f434c0b41b0 0x7f434c155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.837+0000 7f4352638640 1 --2- 172.21.15.79:0/4194971871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f434c06b770 0x7f434c15d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.837+0000 7f4352638640 1 --2- 172.21.15.79:0/4194971871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f434c06b2f0 0x7f434c09c540 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.837+0000 7f4352638640 1 -- 172.21.15.79:0/4194971871 >> 172.21.15.79:0/4194971871 conn(0x7f434c0b1cd0 msgr2=0x7f434c15b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:45.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.837+0000 7f4352638640 1 -- 172.21.15.79:0/4194971871 shutdown_connections 2024-04-25T02:17:45.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.837+0000 7f4352638640 1 -- 172.21.15.79:0/4194971871 wait complete. 2024-04-25T02:17:45.852 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:17:45.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.947+0000 7fe73d7a2640 1 Processor -- start 2024-04-25T02:17:45.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.947+0000 7fe73d7a2640 1 -- start start 2024-04-25T02:17:45.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.948+0000 7fe73d7a2640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe73815e5a0 0x7fe7380d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.948+0000 7fe73d7a2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe73806cf20 0x7fe7380ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.948+0000 7fe73d7a2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7380d1460 con 0x7fe73806c3d0 2024-04-25T02:17:45.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.948+0000 7fe73d7a2640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe7380cc6c0 con 0x7fe73815e5a0 2024-04-25T02:17:45.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.948+0000 7fe73d7a2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe7380cf7d0 con 0x7fe73806cf20 2024-04-25T02:17:45.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.948+0000 7fe736ffd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe73815e5a0 0x7fe7380d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.948+0000 7fe7377fe640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe73806cf20 0x7fe7380ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.948+0000 7fe736ffd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe73815e5a0 0x7fe7380d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:55218/0 (socket says 172.21.15.79:55218) 2024-04-25T02:17:45.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.948+0000 7fe736ffd640 1 -- 172.21.15.79:0/1511739904 learned_addr learned my addr 172.21.15.79:0/1511739904 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:45.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.948+0000 7fe72ffff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fe73806c3d0 0x7fe73806c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:59696/0 (socket says 172.21.15.79:59696) 2024-04-25T02:17:45.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.949+0000 7fe736ffd640 1 -- 172.21.15.79:0/1511739904 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe73806cf20 msgr2=0x7fe7380ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:45.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.949+0000 7fe736ffd640 1 --2- 172.21.15.79:0/1511739904 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe73806cf20 0x7fe7380ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.949+0000 7fe736ffd640 1 -- 172.21.15.79:0/1511739904 >> v1:172.21.15.189:6789/0 conn(0x7fe73806c3d0 legacy=0x7fe73806c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.949+0000 7fe736ffd640 1 -- 172.21.15.79:0/1511739904 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7380d0bc0 con 0x7fe73815e5a0 2024-04-25T02:17:45.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.949+0000 7fe736ffd640 1 --2- 172.21.15.79:0/1511739904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe73815e5a0 0x7fe7380d2a60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe728009870 tx=0x7fe72802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9dba84da0a262fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:45.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.949+0000 7fe7367fc640 1 -- 172.21.15.79:0/1511739904 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe728037070 con 0x7fe73815e5a0 2024-04-25T02:17:45.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.950+0000 7fe7367fc640 1 -- 172.21.15.79:0/1511739904 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe728032440 con 0x7fe73815e5a0 2024-04-25T02:17:45.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.950+0000 7fe7367fc640 1 -- 172.21.15.79:0/1511739904 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe728032810 con 0x7fe73815e5a0 2024-04-25T02:17:45.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.950+0000 7fe73d7a2640 1 -- 172.21.15.79:0/1511739904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe73815e5a0 msgr2=0x7fe7380d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.950+0000 7fe73d7a2640 1 --2- 172.21.15.79:0/1511739904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe73815e5a0 0x7fe7380d2a60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe728009870 tx=0x7fe72802a270 comp rx=0 tx=0).stop 2024-04-25T02:17:45.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.950+0000 7fe73d7a2640 1 -- 172.21.15.79:0/1511739904 shutdown_connections 2024-04-25T02:17:45.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.950+0000 7fe73d7a2640 1 --2- 172.21.15.79:0/1511739904 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe73806cf20 0x7fe7380ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.950+0000 7fe73d7a2640 1 --2- 172.21.15.79:0/1511739904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe73815e5a0 0x7fe7380d2a60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.950+0000 7fe73d7a2640 1 -- 172.21.15.79:0/1511739904 >> 172.21.15.79:0/1511739904 conn(0x7fe7380d1f40 msgr2=0x7fe7380d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:45.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.950+0000 7fe73d7a2640 1 -- 172.21.15.79:0/1511739904 shutdown_connections 2024-04-25T02:17:45.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.950+0000 7fe73d7a2640 1 -- 172.21.15.79:0/1511739904 wait complete. 2024-04-25T02:17:45.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.951+0000 7fe73d7a2640 1 Processor -- start 2024-04-25T02:17:45.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.951+0000 7fe73d7a2640 1 -- start start 2024-04-25T02:17:45.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe73d7a2640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe73806c3d0 0x7fe73814e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe73d7a2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe73806cf20 0x7fe7380b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe73d7a2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73815e5a0 0x7fe7381588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe73d7a2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe73815e980 con 0x7fe73815e5a0 2024-04-25T02:17:45.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe73d7a2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe7380d1180 con 0x7fe73806cf20 2024-04-25T02:17:45.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe73d7a2640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe73815eb00 con 0x7fe73806c3d0 2024-04-25T02:17:45.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe7377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73815e5a0 0x7fe7381588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe7377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73815e5a0 0x7fe7381588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36390/0 (socket says 172.21.15.79:36390) 2024-04-25T02:17:45.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe7377fe640 1 -- 172.21.15.79:0/3181289326 learned_addr learned my addr 172.21.15.79:0/3181289326 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:45.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe736ffd640 1 --2- 172.21.15.79:0/3181289326 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe73806c3d0 0x7fe73814e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe72ffff640 1 --2- 172.21.15.79:0/3181289326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe73806cf20 0x7fe7380b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe7377fe640 1 -- 172.21.15.79:0/3181289326 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe73806c3d0 msgr2=0x7fe73814e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe7377fe640 1 --2- 172.21.15.79:0/3181289326 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe73806c3d0 0x7fe73814e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe7377fe640 1 -- 172.21.15.79:0/3181289326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe73806cf20 msgr2=0x7fe7380b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:45.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe7377fe640 1 --2- 172.21.15.79:0/3181289326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe73806cf20 0x7fe7380b6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:45.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.952+0000 7fe7377fe640 1 -- 172.21.15.79:0/3181289326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73814e8e0 con 0x7fe73815e5a0 2024-04-25T02:17:45.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.953+0000 7fe7377fe640 1 --2- 172.21.15.79:0/3181289326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73815e5a0 0x7fe7381588f0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fe73000efc0 tx=0x7fe73000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:45.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.953+0000 7fe72f7fe640 1 -- 172.21.15.79:0/3181289326 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe730018020 con 0x7fe73815e5a0 2024-04-25T02:17:45.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.953+0000 7fe72f7fe640 1 -- 172.21.15.79:0/3181289326 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe730014480 con 0x7fe73815e5a0 2024-04-25T02:17:45.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.953+0000 7fe72f7fe640 1 -- 172.21.15.79:0/3181289326 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe730014870 con 0x7fe73815e5a0 2024-04-25T02:17:45.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.953+0000 7fe73d7a2640 1 -- 172.21.15.79:0/3181289326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7380b5c40 con 0x7fe73815e5a0 2024-04-25T02:17:45.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.953+0000 7fe73d7a2640 1 -- 172.21.15.79:0/3181289326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7380b6200 con 0x7fe73815e5a0 2024-04-25T02:17:45.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.954+0000 7fe73d7a2640 1 -- 172.21.15.79:0/3181289326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7380690a0 con 0x7fe73815e5a0 2024-04-25T02:17:45.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.954+0000 7fe72f7fe640 1 -- 172.21.15.79:0/3181289326 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe730005d10 con 0x7fe73815e5a0 2024-04-25T02:17:45.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.954+0000 7fe72f7fe640 1 --2- 172.21.15.79:0/3181289326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe71806be30 0x7fe71806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:45.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.955+0000 7fe72f7fe640 1 -- 172.21.15.79:0/3181289326 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7fe73008bd60 con 0x7fe73815e5a0 2024-04-25T02:17:45.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.955+0000 7fe736ffd640 1 --2- 172.21.15.79:0/3181289326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe71806be30 0x7fe71806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:45.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.955+0000 7fe736ffd640 1 --2- 172.21.15.79:0/3181289326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe71806be30 0x7fe71806e2f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe728034000 tx=0x7fe72802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:45.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:45.959+0000 7fe72f7fe640 1 -- 172.21.15.79:0/3181289326 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe730022030 con 0x7fe73815e5a0 2024-04-25T02:17:46.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.130+0000 7fe73d7a2640 1 -- 172.21.15.79:0/3181289326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe7380cda00 con 0x7fe73815e5a0 2024-04-25T02:17:46.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.131+0000 7fe72f7fe640 1 -- 172.21.15.79:0/3181289326 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) ==== 100+0+11 (secure 0 0 0) 0x7fe73814e8e0 con 0x7fe73815e5a0 2024-04-25T02:17:46.135 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:17:46.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.133+0000 7fe73d7a2640 1 -- 172.21.15.79:0/3181289326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe71806be30 msgr2=0x7fe71806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:46.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.133+0000 7fe73d7a2640 1 --2- 172.21.15.79:0/3181289326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe71806be30 0x7fe71806e2f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe728034000 tx=0x7fe72802e000 comp rx=0 tx=0).stop 2024-04-25T02:17:46.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.133+0000 7fe73d7a2640 1 -- 172.21.15.79:0/3181289326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73815e5a0 msgr2=0x7fe7381588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:46.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.133+0000 7fe73d7a2640 1 --2- 172.21.15.79:0/3181289326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73815e5a0 0x7fe7381588f0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fe73000efc0 tx=0x7fe73000c490 comp rx=0 tx=0).stop 2024-04-25T02:17:46.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.133+0000 7fe73d7a2640 1 -- 172.21.15.79:0/3181289326 shutdown_connections 2024-04-25T02:17:46.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.133+0000 7fe73d7a2640 1 --2- 172.21.15.79:0/3181289326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe71806be30 0x7fe71806e2f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.133+0000 7fe73d7a2640 1 --2- 172.21.15.79:0/3181289326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73815e5a0 0x7fe7381588f0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.133+0000 7fe73d7a2640 1 --2- 172.21.15.79:0/3181289326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe73806cf20 0x7fe7380b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.133+0000 7fe73d7a2640 1 --2- 172.21.15.79:0/3181289326 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe73806c3d0 0x7fe73814e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.133+0000 7fe73d7a2640 1 -- 172.21.15.79:0/3181289326 >> 172.21.15.79:0/3181289326 conn(0x7fe7380d1f40 msgr2=0x7fe7380ccb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:46.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.133+0000 7fe73d7a2640 1 -- 172.21.15.79:0/3181289326 shutdown_connections 2024-04-25T02:17:46.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.133+0000 7fe73d7a2640 1 -- 172.21.15.79:0/3181289326 wait complete. 2024-04-25T02:17:46.148 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:17:46.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.241+0000 7efedfb3b640 1 Processor -- start 2024-04-25T02:17:46.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.241+0000 7efedfb3b640 1 -- start start 2024-04-25T02:17:46.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.242+0000 7efedfb3b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7efed8143bc0 0x7efed815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:46.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.242+0000 7efedfb3b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efed806df50 0x7efed806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:46.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.242+0000 7efedfb3b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed815fa40 con 0x7efed80b48e0 2024-04-25T02:17:46.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.242+0000 7efedfb3b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7efed806e8f0 con 0x7efed806df50 2024-04-25T02:17:46.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.242+0000 7efedfb3b640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7efed8072cb0 con 0x7efed8143bc0 2024-04-25T02:17:46.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.242+0000 7efedd0d6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efed806df50 0x7efed806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:46.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.242+0000 7efede0d8640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efed80b48e0 0x7efed80b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38924/0 (socket says 172.21.15.79:38924) 2024-04-25T02:17:46.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.242+0000 7efedd0d6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efed806df50 0x7efed806e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36392/0 (socket says 172.21.15.79:36392) 2024-04-25T02:17:46.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.242+0000 7efede0d8640 1 -- 172.21.15.79:0/2380810020 learned_addr learned my addr 172.21.15.79:0/2380810020 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:46.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.242+0000 7efedd0d6640 1 -- 172.21.15.79:0/2380810020 >> v2:172.21.15.189:3300/0 conn(0x7efed8143bc0 msgr2=0x7efed815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:46.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.242+0000 7efedd0d6640 1 --2- 172.21.15.79:0/2380810020 >> v2:172.21.15.189:3300/0 conn(0x7efed8143bc0 0x7efed815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.242+0000 7efedd0d6640 1 -- 172.21.15.79:0/2380810020 >> v1:172.21.15.79:6789/0 conn(0x7efed80b48e0 legacy=0x7efed80b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:46.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.242+0000 7efedd0d6640 1 -- 172.21.15.79:0/2380810020 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed8071e00 con 0x7efed806df50 2024-04-25T02:17:46.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.242+0000 7efedc8d5640 1 -- 172.21.15.79:0/2380810020 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1427347749 0 0) 0x7efed0001490 con 0x7efed80b48e0 2024-04-25T02:17:46.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.243+0000 7efedd0d6640 1 --2- 172.21.15.79:0/2380810020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efed806df50 0x7efed806e3b0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7efed8067b50 tx=0x7efec802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b726aca7bc110a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:46.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.243+0000 7efedc8d5640 1 -- 172.21.15.79:0/2380810020 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec8037070 con 0x7efed806df50 2024-04-25T02:17:46.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.243+0000 7efedc8d5640 1 -- 172.21.15.79:0/2380810020 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efec8032440 con 0x7efed806df50 2024-04-25T02:17:46.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.243+0000 7efedc8d5640 1 -- 172.21.15.79:0/2380810020 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec802ae60 con 0x7efed806df50 2024-04-25T02:17:46.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.244+0000 7efedfb3b640 1 -- 172.21.15.79:0/2380810020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efed806df50 msgr2=0x7efed806e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:46.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.244+0000 7efedfb3b640 1 --2- 172.21.15.79:0/2380810020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efed806df50 0x7efed806e3b0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7efed8067b50 tx=0x7efec802a110 comp rx=0 tx=0).stop 2024-04-25T02:17:46.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.244+0000 7efedfb3b640 1 -- 172.21.15.79:0/2380810020 shutdown_connections 2024-04-25T02:17:46.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.244+0000 7efedfb3b640 1 --2- 172.21.15.79:0/2380810020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efed806df50 0x7efed806e3b0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.244+0000 7efedfb3b640 1 --2- 172.21.15.79:0/2380810020 >> v2:172.21.15.189:3300/0 conn(0x7efed8143bc0 0x7efed815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.244+0000 7efedfb3b640 1 -- 172.21.15.79:0/2380810020 >> 172.21.15.79:0/2380810020 conn(0x7efed80cfc80 msgr2=0x7efed80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:46.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.244+0000 7efedfb3b640 1 -- 172.21.15.79:0/2380810020 shutdown_connections 2024-04-25T02:17:46.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.244+0000 7efedfb3b640 1 -- 172.21.15.79:0/2380810020 wait complete. 2024-04-25T02:17:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.245+0000 7efedfb3b640 1 Processor -- start 2024-04-25T02:17:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.245+0000 7efedfb3b640 1 -- start start 2024-04-25T02:17:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efedfb3b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efed806df50 0x7efed814d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efedfb3b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efed80b48e0 0x7efed814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efedfb3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efed8143bc0 0x7efed81e7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efedfb3b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efed8072660 con 0x7efed8143bc0 2024-04-25T02:17:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efedfb3b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efed8072380 con 0x7efed80b48e0 2024-04-25T02:17:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efedfb3b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efed8072940 con 0x7efed806df50 2024-04-25T02:17:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efede0d8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efed8143bc0 0x7efed81e7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efede0d8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efed8143bc0 0x7efed81e7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36394/0 (socket says 172.21.15.79:36394) 2024-04-25T02:17:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efede0d8640 1 -- 172.21.15.79:0/3728145136 learned_addr learned my addr 172.21.15.79:0/3728145136 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efedd8d7640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efed806df50 0x7efed814d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efedd0d6640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efed80b48e0 0x7efed814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efede0d8640 1 -- 172.21.15.79:0/3728145136 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efed806df50 msgr2=0x7efed814d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efede0d8640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efed806df50 0x7efed814d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efede0d8640 1 -- 172.21.15.79:0/3728145136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efed80b48e0 msgr2=0x7efed814b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efede0d8640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efed80b48e0 0x7efed814b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efede0d8640 1 -- 172.21.15.79:0/3728145136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed814d560 con 0x7efed8143bc0 2024-04-25T02:17:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efedd8d7640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efed806df50 0x7efed814d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efedd0d6640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efed80b48e0 0x7efed814b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efede0d8640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efed8143bc0 0x7efed81e7f20 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7efed000c700 tx=0x7efed000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efece7fc640 1 -- 172.21.15.79:0/3728145136 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed0018070 con 0x7efed8143bc0 2024-04-25T02:17:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efece7fc640 1 -- 172.21.15.79:0/3728145136 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed000ce10 con 0x7efed8143bc0 2024-04-25T02:17:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efedfb3b640 1 -- 172.21.15.79:0/3728145136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed814bf80 con 0x7efed8143bc0 2024-04-25T02:17:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efece7fc640 1 -- 172.21.15.79:0/3728145136 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed000a860 con 0x7efed8143bc0 2024-04-25T02:17:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.246+0000 7efedfb3b640 1 -- 172.21.15.79:0/3728145136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed814c540 con 0x7efed8143bc0 2024-04-25T02:17:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.247+0000 7efedfb3b640 1 -- 172.21.15.79:0/3728145136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efed80690a0 con 0x7efed8143bc0 2024-04-25T02:17:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.248+0000 7efece7fc640 1 -- 172.21.15.79:0/3728145136 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efed001b070 con 0x7efed8143bc0 2024-04-25T02:17:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.248+0000 7efece7fc640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efebc06be30 0x7efebc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.248+0000 7efedd8d7640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efebc06be30 0x7efebc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.248+0000 7efece7fc640 1 -- 172.21.15.79:0/3728145136 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7efed008a470 con 0x7efed8143bc0 2024-04-25T02:17:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.249+0000 7efedd8d7640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efebc06be30 0x7efebc06e2f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efed4006fd0 tx=0x7efed4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:46.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.253+0000 7efece7fc640 1 -- 172.21.15.79:0/3728145136 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efed815fa40 con 0x7efed8143bc0 2024-04-25T02:17:46.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.441+0000 7efedfb3b640 1 -- 172.21.15.79:0/3728145136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efed80ceb60 con 0x7efed8143bc0 2024-04-25T02:17:46.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.441+0000 7efece7fc640 1 -- 172.21.15.79:0/3728145136 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v117) ==== 80+0+0 (secure 0 0 0) 0x7efed0058de0 con 0x7efed8143bc0 2024-04-25T02:17:46.446 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-04-25T02:17:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.443+0000 7efedfb3b640 1 -- 172.21.15.79:0/3728145136 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efebc06be30 msgr2=0x7efebc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.443+0000 7efedfb3b640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efebc06be30 0x7efebc06e2f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efed4006fd0 tx=0x7efed4008040 comp rx=0 tx=0).stop 2024-04-25T02:17:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.443+0000 7efedfb3b640 1 -- 172.21.15.79:0/3728145136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efed8143bc0 msgr2=0x7efed81e7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.443+0000 7efedfb3b640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efed8143bc0 0x7efed81e7f20 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7efed000c700 tx=0x7efed000cbc0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.443+0000 7efedfb3b640 1 -- 172.21.15.79:0/3728145136 shutdown_connections 2024-04-25T02:17:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.443+0000 7efedfb3b640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7efebc06be30 0x7efebc06e2f0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.443+0000 7efedfb3b640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efed8143bc0 0x7efed81e7f20 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.443+0000 7efedfb3b640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efed80b48e0 0x7efed814b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.443+0000 7efedfb3b640 1 --2- 172.21.15.79:0/3728145136 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efed806df50 0x7efed814d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.443+0000 7efedfb3b640 1 -- 172.21.15.79:0/3728145136 >> 172.21.15.79:0/3728145136 conn(0x7efed80cfc80 msgr2=0x7efed80aecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.443+0000 7efedfb3b640 1 -- 172.21.15.79:0/3728145136 shutdown_connections 2024-04-25T02:17:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.443+0000 7efedfb3b640 1 -- 172.21.15.79:0/3728145136 wait complete. 2024-04-25T02:17:46.458 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:17:46.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:46.458 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:17:46.514 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:17:46.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:46.515 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:17:46.541 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:17:46.541 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:46.596 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:17:46.596 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:17:46.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:46.597 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:17:46.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:17:46.651 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T02:17:46.651 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:17:46.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.784+0000 7f3ee8a9a640 1 Processor -- start 2024-04-25T02:17:46.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.784+0000 7f3ee8a9a640 1 -- start start 2024-04-25T02:17:46.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.785+0000 7f3ee8a9a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3ee4143bc0 0x7f3ee415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.785+0000 7f3ee8a9a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f3ee40b3d40 0x7f3ee406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.785+0000 7f3ee8a9a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ee415fa40 con 0x7f3ee406df50 2024-04-25T02:17:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.785+0000 7f3ee8a9a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3ee406e8f0 con 0x7f3ee4143bc0 2024-04-25T02:17:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.785+0000 7f3ee8a9a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3ee4072cb0 con 0x7f3ee40b3d40 2024-04-25T02:17:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.785+0000 7f3ee259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3ee4143bc0 0x7f3ee415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.785+0000 7f3edbfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3ee406df50 0x7f3ee40b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38940/0 (socket says 172.21.15.79:38940) 2024-04-25T02:17:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.785+0000 7f3edbfff640 1 -- 172.21.15.79:0/2280154998 learned_addr learned my addr 172.21.15.79:0/2280154998 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.785+0000 7f3ee2d9d640 1 --2- 172.21.15.79:0/2280154998 >> v2:172.21.15.189:3300/0 conn(0x7f3ee40b3d40 0x7f3ee406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.785+0000 7f3ee259c640 1 -- 172.21.15.79:0/2280154998 >> v2:172.21.15.189:3300/0 conn(0x7f3ee40b3d40 msgr2=0x7f3ee406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.785+0000 7f3ee259c640 1 --2- 172.21.15.79:0/2280154998 >> v2:172.21.15.189:3300/0 conn(0x7f3ee40b3d40 0x7f3ee406e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.785+0000 7f3ee259c640 1 -- 172.21.15.79:0/2280154998 >> v1:172.21.15.79:6789/0 conn(0x7f3ee406df50 legacy=0x7f3ee40b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.785+0000 7f3ee259c640 1 -- 172.21.15.79:0/2280154998 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee4071e00 con 0x7f3ee4143bc0 2024-04-25T02:17:46.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.786+0000 7f3ee259c640 1 --2- 172.21.15.79:0/2280154998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee4143bc0 0x7f3ee415f500 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4144cd0 tx=0x7f3ed402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc5331eda2a552f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:46.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.786+0000 7f3ee1d9b640 1 -- 172.21.15.79:0/2280154998 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4037070 con 0x7f3ee4143bc0 2024-04-25T02:17:46.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.786+0000 7f3ee1d9b640 1 -- 172.21.15.79:0/2280154998 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed4032440 con 0x7f3ee4143bc0 2024-04-25T02:17:46.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.786+0000 7f3ee1d9b640 1 -- 172.21.15.79:0/2280154998 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed402ae60 con 0x7f3ee4143bc0 2024-04-25T02:17:46.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.786+0000 7f3ee8a9a640 1 -- 172.21.15.79:0/2280154998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee4143bc0 msgr2=0x7f3ee415f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:46.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.786+0000 7f3ee8a9a640 1 --2- 172.21.15.79:0/2280154998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee4143bc0 0x7f3ee415f500 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4144cd0 tx=0x7f3ed402a110 comp rx=0 tx=0).stop 2024-04-25T02:17:46.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.786+0000 7f3ee8a9a640 1 -- 172.21.15.79:0/2280154998 shutdown_connections 2024-04-25T02:17:46.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.786+0000 7f3ee8a9a640 1 --2- 172.21.15.79:0/2280154998 >> v2:172.21.15.189:3300/0 conn(0x7f3ee40b3d40 0x7f3ee406e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.786+0000 7f3ee8a9a640 1 --2- 172.21.15.79:0/2280154998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee4143bc0 0x7f3ee415f500 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.786+0000 7f3ee8a9a640 1 -- 172.21.15.79:0/2280154998 >> 172.21.15.79:0/2280154998 conn(0x7f3ee40cfc80 msgr2=0x7f3ee40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:46.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.787+0000 7f3ee8a9a640 1 -- 172.21.15.79:0/2280154998 shutdown_connections 2024-04-25T02:17:46.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.787+0000 7f3ee8a9a640 1 -- 172.21.15.79:0/2280154998 wait complete. 2024-04-25T02:17:46.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.788+0000 7f3ee8a9a640 1 Processor -- start 2024-04-25T02:17:46.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.788+0000 7f3ee8a9a640 1 -- start start 2024-04-25T02:17:46.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.788+0000 7f3ee8a9a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ee406df50 0x7f3ee413d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:46.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.788+0000 7f3ee8a9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee40b3d40 0x7f3ee413ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:46.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.788+0000 7f3ee8a9a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ee4143bc0 0x7f3ee413c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:46.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3ee8a9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee4072660 con 0x7f3ee40b3d40 2024-04-25T02:17:46.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3ee8a9a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee4072380 con 0x7f3ee406df50 2024-04-25T02:17:46.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3ee8a9a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3ee4072940 con 0x7f3ee4143bc0 2024-04-25T02:17:46.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3edbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee40b3d40 0x7f3ee413ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:46.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3edbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee40b3d40 0x7f3ee413ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36412/0 (socket says 172.21.15.79:36412) 2024-04-25T02:17:46.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3edbfff640 1 -- 172.21.15.79:0/2973778262 learned_addr learned my addr 172.21.15.79:0/2973778262 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:46.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3ee259c640 1 --2- 172.21.15.79:0/2973778262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ee406df50 0x7f3ee413d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:46.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3edbfff640 1 -- 172.21.15.79:0/2973778262 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ee4143bc0 msgr2=0x7f3ee413c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:46.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3edbfff640 1 --2- 172.21.15.79:0/2973778262 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ee4143bc0 0x7f3ee413c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3edbfff640 1 -- 172.21.15.79:0/2973778262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ee406df50 msgr2=0x7f3ee413d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:46.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3edbfff640 1 --2- 172.21.15.79:0/2973778262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ee406df50 0x7f3ee413d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:46.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3edbfff640 1 -- 172.21.15.79:0/2973778262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee413e890 con 0x7f3ee40b3d40 2024-04-25T02:17:46.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3ee259c640 1 --2- 172.21.15.79:0/2973778262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ee406df50 0x7f3ee413d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:46.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3edbfff640 1 --2- 172.21.15.79:0/2973778262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee40b3d40 0x7f3ee413ff70 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00c3c0 tx=0x7f3ecc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:46.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3edaffd640 1 -- 172.21.15.79:0/2973778262 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc017070 con 0x7f3ee40b3d40 2024-04-25T02:17:46.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3edaffd640 1 -- 172.21.15.79:0/2973778262 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ecc005ce0 con 0x7f3ee40b3d40 2024-04-25T02:17:46.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3ee8a9a640 1 -- 172.21.15.79:0/2973778262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee413eb00 con 0x7f3ee40b3d40 2024-04-25T02:17:46.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3edaffd640 1 -- 172.21.15.79:0/2973778262 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc0072f0 con 0x7f3ee40b3d40 2024-04-25T02:17:46.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.789+0000 7f3ee8a9a640 1 -- 172.21.15.79:0/2973778262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee413f0c0 con 0x7f3ee40b3d40 2024-04-25T02:17:46.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.790+0000 7f3ee8a9a640 1 -- 172.21.15.79:0/2973778262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee413f2c0 con 0x7f3ee40b3d40 2024-04-25T02:17:46.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.791+0000 7f3edaffd640 1 -- 172.21.15.79:0/2973778262 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ecc01a070 con 0x7f3ee40b3d40 2024-04-25T02:17:46.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.791+0000 7f3edaffd640 1 --2- 172.21.15.79:0/2973778262 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3ec406be60 0x7f3ec406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:46.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.791+0000 7f3edaffd640 1 -- 172.21.15.79:0/2973778262 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7f3ecc08a170 con 0x7f3ee40b3d40 2024-04-25T02:17:46.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.791+0000 7f3ee259c640 1 --2- 172.21.15.79:0/2973778262 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3ec406be60 0x7f3ec406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:46.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.792+0000 7f3ee259c640 1 --2- 172.21.15.79:0/2973778262 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3ec406be60 0x7f3ec406e320 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4034000 tx=0x7f3ed402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:46.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:46.795+0000 7f3edaffd640 1 -- 172.21.15.79:0/2973778262 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3ee413f2c0 con 0x7f3ee40b3d40 2024-04-25T02:17:47.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.005+0000 7f3ee8a9a640 1 -- 172.21.15.79:0/2973778262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3ee40cf4d0 con 0x7f3ee40b3d40 2024-04-25T02:17:47.010 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:17:47.006+0000 7fb0c50c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:17:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.009+0000 7f3edaffd640 1 -- 172.21.15.79:0/2973778262 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) ==== 161+0+0 (secure 0 0 0) 0x7f3ee415fa40 con 0x7f3ee40b3d40 2024-04-25T02:17:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:17:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.011+0000 7f3ee8a9a640 1 -- 172.21.15.79:0/2973778262 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3ec406be60 msgr2=0x7f3ec406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.011+0000 7f3ee8a9a640 1 --2- 172.21.15.79:0/2973778262 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3ec406be60 0x7f3ec406e320 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4034000 tx=0x7f3ed402e000 comp rx=0 tx=0).stop 2024-04-25T02:17:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.011+0000 7f3ee8a9a640 1 -- 172.21.15.79:0/2973778262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee40b3d40 msgr2=0x7f3ee413ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.011+0000 7f3ee8a9a640 1 --2- 172.21.15.79:0/2973778262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee40b3d40 0x7f3ee413ff70 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00c3c0 tx=0x7f3ecc00c880 comp rx=0 tx=0).stop 2024-04-25T02:17:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.011+0000 7f3ee8a9a640 1 -- 172.21.15.79:0/2973778262 shutdown_connections 2024-04-25T02:17:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.011+0000 7f3ee8a9a640 1 --2- 172.21.15.79:0/2973778262 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3ec406be60 0x7f3ec406e320 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.011+0000 7f3ee8a9a640 1 --2- 172.21.15.79:0/2973778262 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ee4143bc0 0x7f3ee413c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.011+0000 7f3ee8a9a640 1 --2- 172.21.15.79:0/2973778262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee40b3d40 0x7f3ee413ff70 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.011+0000 7f3ee8a9a640 1 --2- 172.21.15.79:0/2973778262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ee406df50 0x7f3ee413d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.011+0000 7f3ee8a9a640 1 -- 172.21.15.79:0/2973778262 >> 172.21.15.79:0/2973778262 conn(0x7f3ee40cfc80 msgr2=0x7f3ee40b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.011+0000 7f3ee8a9a640 1 -- 172.21.15.79:0/2973778262 shutdown_connections 2024-04-25T02:17:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.011+0000 7f3ee8a9a640 1 -- 172.21.15.79:0/2973778262 wait complete. 2024-04-25T02:17:47.020 INFO:tasks.ceph.mds.a.smithi079.stderr: -8350> 2024-04-25T02:17:39.888+0000 7fb171fa5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:17:47.029 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:17:47.031 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:17:47.052 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:17:47.070 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-04-25T02:17:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-04-25T02:17:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-04-25T02:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-04-25T02:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-04-25T02:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-04-25T02:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-04-25T02:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-04-25T02:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-04-25T02:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-04-25T02:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-04-25T02:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-04-25T02:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-04-25T02:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-04-25T02:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]" 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on skipped message = False 2024-04-25T02:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 696648c4-3e52-400b-a780-2e8863c56c42 2024-04-25T02:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-04-25T02:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-04-25T02:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-04-25T02:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-04-25T02:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-04-25T02:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-04-25T02:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-04-25T02:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-04-25T02:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-04-25T02:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug trim objects = true 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-04-25T02:17:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: bdev async discard = True 2024-04-25T02:17:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: bdev enable discard = True 2024-04-25T02:17:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore allocator = bitmap 2024-04-25T02:17:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-04-25T02:17:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-04-25T02:17:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 1/20 2024-04-25T02:17:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 1/20 2024-04-25T02:17:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-04-25T02:17:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 4/10 2024-04-25T02:17:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:17:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-04-25T02:17:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:17:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:17:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-04-25T02:17:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-04-25T02:17:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.077 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-04-25T02:17:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-04-25T02:17:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-04-25T02:17:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-04-25T02:17:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-04-25T02:17:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-04-25T02:17:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.077 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-04-25T02:17:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-04-25T02:17:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-04-25T02:17:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-04-25T02:17:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-04-25T02:17:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-04-25T02:17:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-04-25T02:17:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-04-25T02:17:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:17:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:17:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:17:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:17:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:17:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:17:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-04-25T02:17:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:17:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:17:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: mon down mkfs grace = 300 2024-04-25T02:17:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2024-04-25T02:17:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.079 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-04-25T02:17:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-04-25T02:17:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-04-25T02:17:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-04-25T02:17:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:17:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:17:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2024-04-25T02:17:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-04-25T02:17:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = "" 2024-04-25T02:17:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-04-25T02:17:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-04-25T02:17:47.080 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-04-25T02:17:47.080 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2024-04-25T02:17:47.080 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2024-04-25T02:17:47.080 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-04-25T02:17:47.080 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2024-04-25T02:17:47.081 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2024-04-25T02:17:47.081 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2024-04-25T02:17:47.081 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2024-04-25T02:17:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2024-04-25T02:17:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2024-04-25T02:17:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2024-04-25T02:17:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2024-04-25T02:17:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2024-04-25T02:17:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = False 2024-04-25T02:17:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-04-25T02:17:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-04-25T02:17:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-04-25T02:17:47.082 INFO:teuthology.orchestra.run.smithi189.stdout:[global] 2024-04-25T02:17:47.082 INFO:teuthology.orchestra.run.smithi189.stdout: chdir = "" 2024-04-25T02:17:47.082 INFO:teuthology.orchestra.run.smithi189.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:17:47.082 INFO:teuthology.orchestra.run.smithi189.stdout: auth supported = cephx 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: filestore xattr use omap = true 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: mon clock drift allowed = 1.000 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: osd crush chooseleaf type = 0 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: auth debug = true 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on old message = true 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on bug = true 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: mon pg warn max object skew = 0 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:17:47.083 INFO:teuthology.orchestra.run.smithi189.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default size = 2 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow primary affinity = true 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow pg remap = true 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on no sortbitwise = false 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on too few osds = false 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: mon_allow_pool_size_one = true 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:17:47.084 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: osd default data pool replay window = 5 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: mon allow pool delete = true 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: mon cluster log file level = debug 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: debug asserts on shutdown = true 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: mon health detail to clog = false 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: mon host = "172.21.15.79,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]" 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on skipped message = False 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: fsid = 696648c4-3e52-400b-a780-2e8863c56c42 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout:[osd] 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: osd journal size = 100 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub load threshold = 5.0 2024-04-25T02:17:47.085 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub max interval = 600 2024-04-25T02:17:47.086 INFO:teuthology.orchestra.run.smithi189.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:17:47.086 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.086 INFO:teuthology.orchestra.run.smithi189.stdout: osd recover clone overlap = true 2024-04-25T02:17:47.086 INFO:teuthology.orchestra.run.smithi189.stdout: osd recovery max chunk = 1048576 2024-04-25T02:17:47.086 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.086 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug shutdown = true 2024-04-25T02:17:47.086 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug op order = true 2024-04-25T02:17:47.086 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug verify stray on activate = true 2024-04-25T02:17:47.086 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug trim objects = true 2024-04-25T02:17:47.086 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.086 INFO:teuthology.orchestra.run.smithi189.stdout: osd open classes on start = true 2024-04-25T02:17:47.086 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug pg log writeout = true 2024-04-25T02:17:47.086 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.086 INFO:teuthology.orchestra.run.smithi189.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:17:47.086 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.087 INFO:teuthology.orchestra.run.smithi189.stdout: osd map max advance = 10 2024-04-25T02:17:47.087 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.087 INFO:teuthology.orchestra.run.smithi189.stdout: journal zero on create = true 2024-04-25T02:17:47.087 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.087 INFO:teuthology.orchestra.run.smithi189.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:17:47.087 INFO:teuthology.orchestra.run.smithi189.stdout: filestore apply finisher threads = 3 2024-04-25T02:17:47.087 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.087 INFO:teuthology.orchestra.run.smithi189.stdout: bdev debug aio = true 2024-04-25T02:17:47.087 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug misdirected ops = true 2024-04-25T02:17:47.087 INFO:teuthology.orchestra.run.smithi189.stdout: bdev async discard = True 2024-04-25T02:17:47.087 INFO:teuthology.orchestra.run.smithi189.stdout: bdev enable discard = True 2024-04-25T02:17:47.087 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore allocator = bitmap 2024-04-25T02:17:47.087 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore block size = 96636764160 2024-04-25T02:17:47.087 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore fsck on mount = True 2024-04-25T02:17:47.088 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluefs = 1/20 2024-04-25T02:17:47.088 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluestore = 1/20 2024-04-25T02:17:47.088 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:47.088 INFO:teuthology.orchestra.run.smithi189.stdout: debug osd = 20 2024-04-25T02:17:47.088 INFO:teuthology.orchestra.run.smithi189.stdout: debug rocksdb = 4/10 2024-04-25T02:17:47.088 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:17:47.088 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd full ratio = 0.9 2024-04-25T02:17:47.088 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:17:47.088 INFO:teuthology.orchestra.run.smithi189.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:17:47.088 INFO:teuthology.orchestra.run.smithi189.stdout: osd objectstore = bluestore 2024-04-25T02:17:47.088 INFO:teuthology.orchestra.run.smithi189.stdout: osd op complaint time = 180 2024-04-25T02:17:47.088 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.088 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr] 2024-04-25T02:17:47.088 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:47.088 INFO:teuthology.orchestra.run.smithi189.stdout: debug mgr = 20 2024-04-25T02:17:47.089 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-04-25T02:17:47.089 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-04-25T02:17:47.089 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:47.089 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:47.089 INFO:teuthology.orchestra.run.smithi189.stdout: mgr/telemetry/nag = false 2024-04-25T02:17:47.089 INFO:teuthology.orchestra.run.smithi189.stdout: debug client = 20 2024-04-25T02:17:47.089 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.089 INFO:teuthology.orchestra.run.smithi189.stdout:[mon] 2024-04-25T02:17:47.089 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:47.089 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-04-25T02:17:47.089 INFO:teuthology.orchestra.run.smithi189.stdout: debug paxos = 20 2024-04-25T02:17:47.089 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-04-25T02:17:47.089 INFO:teuthology.orchestra.run.smithi189.stdout: mon data avail warn = 5 2024-04-25T02:17:47.089 INFO:teuthology.orchestra.run.smithi189.stdout: mon mgr mkfs grace = 240 2024-04-25T02:17:47.090 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:47.090 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd reporter subtree level = osd 2024-04-25T02:17:47.090 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd prime pg temp = true 2024-04-25T02:17:47.090 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:47.090 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.090 INFO:teuthology.orchestra.run.smithi189.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:17:47.090 INFO:teuthology.orchestra.run.smithi189.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:17:47.090 INFO:teuthology.orchestra.run.smithi189.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:17:47.090 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.090 INFO:teuthology.orchestra.run.smithi189.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:17:47.090 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:17:47.090 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:17:47.090 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.091 INFO:teuthology.orchestra.run.smithi189.stdout: # 1m isn't quite enough 2024-04-25T02:17:47.091 INFO:teuthology.orchestra.run.smithi189.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:17:47.091 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.091 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:17:47.091 INFO:teuthology.orchestra.run.smithi189.stdout: mon down mkfs grace = 300 2024-04-25T02:17:47.091 INFO:teuthology.orchestra.run.smithi189.stdout: mon op complaint time = 120 2024-04-25T02:17:47.091 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.091 INFO:teuthology.orchestra.run.smithi189.stdout:[client] 2024-04-25T02:17:47.091 INFO:teuthology.orchestra.run.smithi189.stdout: rgw cache enabled = true 2024-04-25T02:17:47.091 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable ops log = true 2024-04-25T02:17:47.091 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable usage log = true 2024-04-25T02:17:47.091 INFO:teuthology.orchestra.run.smithi189.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:17:47.091 INFO:teuthology.orchestra.run.smithi189.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:17:47.091 INFO:teuthology.orchestra.run.smithi189.stdout: client mount timeout = 600 2024-04-25T02:17:47.091 INFO:teuthology.orchestra.run.smithi189.stdout: debug client = 20 2024-04-25T02:17:47.092 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:47.092 INFO:teuthology.orchestra.run.smithi189.stdout: pid file = "" 2024-04-25T02:17:47.092 INFO:teuthology.orchestra.run.smithi189.stdout: rados mon op timeout = 900 2024-04-25T02:17:47.092 INFO:teuthology.orchestra.run.smithi189.stdout: rados osd op timeout = 900 2024-04-25T02:17:47.092 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.a] 2024-04-25T02:17:47.092 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.b] 2024-04-25T02:17:47.092 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.c] 2024-04-25T02:17:47.092 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.a] 2024-04-25T02:17:47.092 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.c] 2024-04-25T02:17:47.092 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.b] 2024-04-25T02:17:47.092 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.d] 2024-04-25T02:17:47.092 INFO:teuthology.orchestra.run.smithi189.stdout:[mds] 2024-04-25T02:17:47.092 INFO:teuthology.orchestra.run.smithi189.stdout: debug mds = 20 2024-04-25T02:17:47.092 INFO:teuthology.orchestra.run.smithi189.stdout: debug mds balancer = 20 2024-04-25T02:17:47.092 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:47.093 INFO:teuthology.orchestra.run.smithi189.stdout: mds debug frag = True 2024-04-25T02:17:47.093 INFO:teuthology.orchestra.run.smithi189.stdout: mds debug scatterstat = True 2024-04-25T02:17:47.093 INFO:teuthology.orchestra.run.smithi189.stdout: mds op complaint time = 180 2024-04-25T02:17:47.093 INFO:teuthology.orchestra.run.smithi189.stdout: mds verify scatter = False 2024-04-25T02:17:47.093 INFO:teuthology.orchestra.run.smithi189.stdout: osd op complaint time = 180 2024-04-25T02:17:47.093 INFO:teuthology.orchestra.run.smithi189.stdout: rados mon op timeout = 900 2024-04-25T02:17:47.093 INFO:teuthology.orchestra.run.smithi189.stdout: rados osd op timeout = 900 2024-04-25T02:17:47.095 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:17:47.136 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:17:47.174 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-04-25T02:17:47.174 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-04-25T02:17:47.174 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:17:47.174 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-04-25T02:17:47.174 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.174 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-04-25T02:17:47.174 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.174 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-04-25T02:17:47.174 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.174 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-04-25T02:17:47.174 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-04-25T02:17:47.174 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.174 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-04-25T02:17:47.175 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-04-25T02:17:47.175 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.175 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:17:47.175 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-04-25T02:17:47.175 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.175 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:17:47.175 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:17:47.175 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.175 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-04-25T02:17:47.175 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.175 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-04-25T02:17:47.175 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-04-25T02:17:47.175 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:17:47.175 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:17:47.176 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-04-25T02:17:47.176 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:17:47.176 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-04-25T02:17:47.176 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:17:47.176 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:17:47.176 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-04-25T02:17:47.176 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.176 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:17:47.176 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.176 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-04-25T02:17:47.176 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.176 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-04-25T02:17:47.176 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.176 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-04-25T02:17:47.176 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-04-25T02:17:47.177 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-04-25T02:17:47.177 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]" 2024-04-25T02:17:47.177 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on skipped message = False 2024-04-25T02:17:47.177 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 696648c4-3e52-400b-a780-2e8863c56c42 2024-04-25T02:17:47.177 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.177 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-04-25T02:17:47.177 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-04-25T02:17:47.177 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.177 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-04-25T02:17:47.177 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-04-25T02:17:47.177 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:17:47.177 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.177 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-04-25T02:17:47.177 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-04-25T02:17:47.177 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.178 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-04-25T02:17:47.178 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-04-25T02:17:47.178 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-04-25T02:17:47.178 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug trim objects = true 2024-04-25T02:17:47.178 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.178 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-04-25T02:17:47.178 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-04-25T02:17:47.178 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.178 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:17:47.178 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.178 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-04-25T02:17:47.178 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.178 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-04-25T02:17:47.178 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.178 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:17:47.179 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-04-25T02:17:47.179 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.179 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-04-25T02:17:47.179 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-04-25T02:17:47.179 INFO:teuthology.orchestra.run.smithi079.stdout: bdev async discard = True 2024-04-25T02:17:47.179 INFO:teuthology.orchestra.run.smithi079.stdout: bdev enable discard = True 2024-04-25T02:17:47.179 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore allocator = bitmap 2024-04-25T02:17:47.179 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-04-25T02:17:47.179 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-04-25T02:17:47.179 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 1/20 2024-04-25T02:17:47.179 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 1/20 2024-04-25T02:17:47.179 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:47.179 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-04-25T02:17:47.179 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 4/10 2024-04-25T02:17:47.179 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:17:47.180 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-04-25T02:17:47.180 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:17:47.180 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:17:47.180 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-04-25T02:17:47.180 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-04-25T02:17:47.180 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.180 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-04-25T02:17:47.180 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:47.180 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-04-25T02:17:47.180 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-04-25T02:17:47.180 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-04-25T02:17:47.180 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:47.180 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:47.180 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-04-25T02:17:47.181 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-04-25T02:17:47.181 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.181 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-04-25T02:17:47.181 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:47.181 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-04-25T02:17:47.181 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-04-25T02:17:47.181 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-04-25T02:17:47.181 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-04-25T02:17:47.181 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-04-25T02:17:47.181 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:47.181 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-04-25T02:17:47.181 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-04-25T02:17:47.181 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:47.181 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.181 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:17:47.182 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:17:47.182 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:17:47.182 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.182 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:17:47.182 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:17:47.182 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:17:47.182 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.182 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-04-25T02:17:47.182 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:17:47.182 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.182 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:17:47.182 INFO:teuthology.orchestra.run.smithi079.stdout: mon down mkfs grace = 300 2024-04-25T02:17:47.182 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2024-04-25T02:17:47.182 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:47.182 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-04-25T02:17:47.183 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-04-25T02:17:47.183 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-04-25T02:17:47.183 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-04-25T02:17:47.183 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:17:47.183 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:17:47.183 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2024-04-25T02:17:47.183 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-04-25T02:17:47.183 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:47.183 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = "" 2024-04-25T02:17:47.183 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-04-25T02:17:47.183 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-04-25T02:17:47.183 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-04-25T02:17:47.183 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2024-04-25T02:17:47.184 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2024-04-25T02:17:47.184 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-04-25T02:17:47.184 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2024-04-25T02:17:47.184 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2024-04-25T02:17:47.184 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2024-04-25T02:17:47.184 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2024-04-25T02:17:47.184 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2024-04-25T02:17:47.184 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2024-04-25T02:17:47.184 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:47.184 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2024-04-25T02:17:47.184 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = False 2024-04-25T02:17:47.184 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2024-04-25T02:17:47.184 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = False 2024-04-25T02:17:47.184 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-04-25T02:17:47.185 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-04-25T02:17:47.185 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-04-25T02:17:47.185 INFO:teuthology.orchestra.run.smithi189.stdout:[global] 2024-04-25T02:17:47.185 INFO:teuthology.orchestra.run.smithi189.stdout: chdir = "" 2024-04-25T02:17:47.185 INFO:teuthology.orchestra.run.smithi189.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:17:47.185 INFO:teuthology.orchestra.run.smithi189.stdout: auth supported = cephx 2024-04-25T02:17:47.185 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.186 INFO:teuthology.orchestra.run.smithi189.stdout: filestore xattr use omap = true 2024-04-25T02:17:47.186 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.186 INFO:teuthology.orchestra.run.smithi189.stdout: mon clock drift allowed = 1.000 2024-04-25T02:17:47.186 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.186 INFO:teuthology.orchestra.run.smithi189.stdout: osd crush chooseleaf type = 0 2024-04-25T02:17:47.186 INFO:teuthology.orchestra.run.smithi189.stdout: auth debug = true 2024-04-25T02:17:47.186 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.186 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on old message = true 2024-04-25T02:17:47.186 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on bug = true 2024-04-25T02:17:47.186 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.186 INFO:teuthology.orchestra.run.smithi189.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:17:47.186 INFO:teuthology.orchestra.run.smithi189.stdout: mon pg warn max object skew = 0 2024-04-25T02:17:47.186 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.186 INFO:teuthology.orchestra.run.smithi189.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:17:47.187 INFO:teuthology.orchestra.run.smithi189.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:17:47.187 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.187 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default size = 2 2024-04-25T02:17:47.187 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.187 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow primary affinity = true 2024-04-25T02:17:47.187 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow pg remap = true 2024-04-25T02:17:47.187 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:17:47.187 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:17:47.187 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on no sortbitwise = false 2024-04-25T02:17:47.187 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:17:47.187 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on too few osds = false 2024-04-25T02:17:47.187 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:17:47.187 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:17:47.187 INFO:teuthology.orchestra.run.smithi189.stdout: mon_allow_pool_size_one = true 2024-04-25T02:17:47.188 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.188 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:17:47.188 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.188 INFO:teuthology.orchestra.run.smithi189.stdout: osd default data pool replay window = 5 2024-04-25T02:17:47.188 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.188 INFO:teuthology.orchestra.run.smithi189.stdout: mon allow pool delete = true 2024-04-25T02:17:47.188 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.188 INFO:teuthology.orchestra.run.smithi189.stdout: mon cluster log file level = debug 2024-04-25T02:17:47.188 INFO:teuthology.orchestra.run.smithi189.stdout: debug asserts on shutdown = true 2024-04-25T02:17:47.188 INFO:teuthology.orchestra.run.smithi189.stdout: mon health detail to clog = false 2024-04-25T02:17:47.188 INFO:teuthology.orchestra.run.smithi189.stdout: mon host = "172.21.15.79,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]" 2024-04-25T02:17:47.188 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on skipped message = False 2024-04-25T02:17:47.188 INFO:teuthology.orchestra.run.smithi189.stdout: fsid = 696648c4-3e52-400b-a780-2e8863c56c42 2024-04-25T02:17:47.188 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.189 INFO:teuthology.orchestra.run.smithi189.stdout:[osd] 2024-04-25T02:17:47.189 INFO:teuthology.orchestra.run.smithi189.stdout: osd journal size = 100 2024-04-25T02:17:47.189 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.189 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub load threshold = 5.0 2024-04-25T02:17:47.189 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub max interval = 600 2024-04-25T02:17:47.189 INFO:teuthology.orchestra.run.smithi189.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:17:47.189 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.189 INFO:teuthology.orchestra.run.smithi189.stdout: osd recover clone overlap = true 2024-04-25T02:17:47.189 INFO:teuthology.orchestra.run.smithi189.stdout: osd recovery max chunk = 1048576 2024-04-25T02:17:47.189 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.189 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug shutdown = true 2024-04-25T02:17:47.189 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug op order = true 2024-04-25T02:17:47.189 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug verify stray on activate = true 2024-04-25T02:17:47.189 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug trim objects = true 2024-04-25T02:17:47.190 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.190 INFO:teuthology.orchestra.run.smithi189.stdout: osd open classes on start = true 2024-04-25T02:17:47.190 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug pg log writeout = true 2024-04-25T02:17:47.190 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.190 INFO:teuthology.orchestra.run.smithi189.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:17:47.190 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.190 INFO:teuthology.orchestra.run.smithi189.stdout: osd map max advance = 10 2024-04-25T02:17:47.190 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.190 INFO:teuthology.orchestra.run.smithi189.stdout: journal zero on create = true 2024-04-25T02:17:47.190 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.190 INFO:teuthology.orchestra.run.smithi189.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:17:47.190 INFO:teuthology.orchestra.run.smithi189.stdout: filestore apply finisher threads = 3 2024-04-25T02:17:47.190 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.191 INFO:teuthology.orchestra.run.smithi189.stdout: bdev debug aio = true 2024-04-25T02:17:47.191 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug misdirected ops = true 2024-04-25T02:17:47.191 INFO:teuthology.orchestra.run.smithi189.stdout: bdev async discard = True 2024-04-25T02:17:47.191 INFO:teuthology.orchestra.run.smithi189.stdout: bdev enable discard = True 2024-04-25T02:17:47.191 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore allocator = bitmap 2024-04-25T02:17:47.191 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore block size = 96636764160 2024-04-25T02:17:47.191 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore fsck on mount = True 2024-04-25T02:17:47.191 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluefs = 1/20 2024-04-25T02:17:47.191 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluestore = 1/20 2024-04-25T02:17:47.191 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:47.191 INFO:teuthology.orchestra.run.smithi189.stdout: debug osd = 20 2024-04-25T02:17:47.191 INFO:teuthology.orchestra.run.smithi189.stdout: debug rocksdb = 4/10 2024-04-25T02:17:47.191 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:17:47.192 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd full ratio = 0.9 2024-04-25T02:17:47.192 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:17:47.192 INFO:teuthology.orchestra.run.smithi189.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:17:47.192 INFO:teuthology.orchestra.run.smithi189.stdout: osd objectstore = bluestore 2024-04-25T02:17:47.192 INFO:teuthology.orchestra.run.smithi189.stdout: osd op complaint time = 180 2024-04-25T02:17:47.192 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.192 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr] 2024-04-25T02:17:47.192 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:47.192 INFO:teuthology.orchestra.run.smithi189.stdout: debug mgr = 20 2024-04-25T02:17:47.192 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-04-25T02:17:47.192 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-04-25T02:17:47.192 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:47.192 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:47.192 INFO:teuthology.orchestra.run.smithi189.stdout: mgr/telemetry/nag = false 2024-04-25T02:17:47.192 INFO:teuthology.orchestra.run.smithi189.stdout: debug client = 20 2024-04-25T02:17:47.193 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.193 INFO:teuthology.orchestra.run.smithi189.stdout:[mon] 2024-04-25T02:17:47.193 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:47.193 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-04-25T02:17:47.193 INFO:teuthology.orchestra.run.smithi189.stdout: debug paxos = 20 2024-04-25T02:17:47.193 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-04-25T02:17:47.193 INFO:teuthology.orchestra.run.smithi189.stdout: mon data avail warn = 5 2024-04-25T02:17:47.193 INFO:teuthology.orchestra.run.smithi189.stdout: mon mgr mkfs grace = 240 2024-04-25T02:17:47.193 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:47.193 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd reporter subtree level = osd 2024-04-25T02:17:47.193 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd prime pg temp = true 2024-04-25T02:17:47.193 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:47.193 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.193 INFO:teuthology.orchestra.run.smithi189.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:17:47.193 INFO:teuthology.orchestra.run.smithi189.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:17:47.194 INFO:teuthology.orchestra.run.smithi189.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:17:47.194 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.194 INFO:teuthology.orchestra.run.smithi189.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:17:47.194 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:17:47.194 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:17:47.194 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.194 INFO:teuthology.orchestra.run.smithi189.stdout: # 1m isn't quite enough 2024-04-25T02:17:47.194 INFO:teuthology.orchestra.run.smithi189.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:17:47.194 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.194 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:17:47.194 INFO:teuthology.orchestra.run.smithi189.stdout: mon down mkfs grace = 300 2024-04-25T02:17:47.194 INFO:teuthology.orchestra.run.smithi189.stdout: mon op complaint time = 120 2024-04-25T02:17:47.194 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:47.194 INFO:teuthology.orchestra.run.smithi189.stdout:[client] 2024-04-25T02:17:47.195 INFO:teuthology.orchestra.run.smithi189.stdout: rgw cache enabled = true 2024-04-25T02:17:47.195 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable ops log = true 2024-04-25T02:17:47.195 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable usage log = true 2024-04-25T02:17:47.195 INFO:teuthology.orchestra.run.smithi189.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:17:47.195 INFO:teuthology.orchestra.run.smithi189.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:17:47.195 INFO:teuthology.orchestra.run.smithi189.stdout: client mount timeout = 600 2024-04-25T02:17:47.195 INFO:teuthology.orchestra.run.smithi189.stdout: debug client = 20 2024-04-25T02:17:47.195 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:47.195 INFO:teuthology.orchestra.run.smithi189.stdout: pid file = "" 2024-04-25T02:17:47.195 INFO:teuthology.orchestra.run.smithi189.stdout: rados mon op timeout = 900 2024-04-25T02:17:47.195 INFO:teuthology.orchestra.run.smithi189.stdout: rados osd op timeout = 900 2024-04-25T02:17:47.195 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.a] 2024-04-25T02:17:47.195 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.b] 2024-04-25T02:17:47.195 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.c] 2024-04-25T02:17:47.195 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.a] 2024-04-25T02:17:47.196 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.c] 2024-04-25T02:17:47.196 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.b] 2024-04-25T02:17:47.196 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.d] 2024-04-25T02:17:47.196 INFO:teuthology.orchestra.run.smithi189.stdout:[mds] 2024-04-25T02:17:47.196 INFO:teuthology.orchestra.run.smithi189.stdout: debug mds = 20 2024-04-25T02:17:47.196 INFO:teuthology.orchestra.run.smithi189.stdout: debug mds balancer = 20 2024-04-25T02:17:47.196 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:47.196 INFO:teuthology.orchestra.run.smithi189.stdout: mds debug frag = True 2024-04-25T02:17:47.196 INFO:teuthology.orchestra.run.smithi189.stdout: mds debug scatterstat = False 2024-04-25T02:17:47.196 INFO:teuthology.orchestra.run.smithi189.stdout: mds op complaint time = 180 2024-04-25T02:17:47.196 INFO:teuthology.orchestra.run.smithi189.stdout: mds verify scatter = False 2024-04-25T02:17:47.196 INFO:teuthology.orchestra.run.smithi189.stdout: osd op complaint time = 180 2024-04-25T02:17:47.196 INFO:teuthology.orchestra.run.smithi189.stdout: rados mon op timeout = 900 2024-04-25T02:17:47.196 INFO:teuthology.orchestra.run.smithi189.stdout: rados osd op timeout = 900 2024-04-25T02:17:47.198 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000001.00000000 bravo_head 2024-04-25T02:17:47.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.274+0000 7f67b813ef40 1 Processor -- start 2024-04-25T02:17:47.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.274+0000 7f67b813ef40 1 -- start start 2024-04-25T02:17:47.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b813ef40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef8628f0e0 0x55ef8639fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:47.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b813ef40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86300370 0x55ef863a70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:47.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b813ef40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef86314be0 0x55ef863a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:47.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b813ef40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ef862706c0 con 0x55ef86300370 2024-04-25T02:17:47.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b813ef40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ef861ed640 con 0x55ef8628f0e0 2024-04-25T02:17:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b813ef40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ef86300780 con 0x55ef86314be0 2024-04-25T02:17:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b543e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86300370 0x55ef863a70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b543e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86300370 0x55ef863a70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36440/0 (socket says 172.21.15.79:36440) 2024-04-25T02:17:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b543e640 1 -- 172.21.15.79:0/1346359260 learned_addr learned my addr 172.21.15.79:0/1346359260 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b5c3f640 1 --2- 172.21.15.79:0/1346359260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef8628f0e0 0x55ef8639fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b543e640 1 -- 172.21.15.79:0/1346359260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef86314be0 msgr2=0x55ef863a7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b6440640 1 --2- 172.21.15.79:0/1346359260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef86314be0 0x55ef863a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b543e640 1 --2- 172.21.15.79:0/1346359260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef86314be0 0x55ef863a7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b543e640 1 -- 172.21.15.79:0/1346359260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef8628f0e0 msgr2=0x55ef8639fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b543e640 1 --2- 172.21.15.79:0/1346359260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef8628f0e0 0x55ef8639fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b543e640 1 -- 172.21.15.79:0/1346359260 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef863143f0 con 0x55ef86300370 2024-04-25T02:17:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.275+0000 7f67b543e640 1 --2- 172.21.15.79:0/1346359260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86300370 0x55ef863a70b0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f67ac058040 tx=0x7f67ac051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81901ce9b2762870 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.276+0000 7f67a7fff640 1 -- 172.21.15.79:0/1346359260 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac05a050 con 0x55ef86300370 2024-04-25T02:17:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.276+0000 7f67a7fff640 1 -- 172.21.15.79:0/1346359260 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ac066070 con 0x55ef86300370 2024-04-25T02:17:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.276+0000 7f67a7fff640 1 -- 172.21.15.79:0/1346359260 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac055c80 con 0x55ef86300370 2024-04-25T02:17:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.276+0000 7f67b813ef40 1 -- 172.21.15.79:0/1346359260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86300370 msgr2=0x55ef863a70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.276+0000 7f67b813ef40 1 --2- 172.21.15.79:0/1346359260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86300370 0x55ef863a70b0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f67ac058040 tx=0x7f67ac051000 comp rx=0 tx=0).stop 2024-04-25T02:17:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.276+0000 7f67b813ef40 1 -- 172.21.15.79:0/1346359260 shutdown_connections 2024-04-25T02:17:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.276+0000 7f67b813ef40 1 --2- 172.21.15.79:0/1346359260 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef86314be0 0x55ef863a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.276+0000 7f67b813ef40 1 --2- 172.21.15.79:0/1346359260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86300370 0x55ef863a70b0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.276+0000 7f67b813ef40 1 --2- 172.21.15.79:0/1346359260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef8628f0e0 0x55ef8639fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.276+0000 7f67b813ef40 1 -- 172.21.15.79:0/1346359260 >> 172.21.15.79:0/1346359260 conn(0x55ef86272920 msgr2=0x55ef86317240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.276+0000 7f67b813ef40 1 -- 172.21.15.79:0/1346359260 shutdown_connections 2024-04-25T02:17:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.276+0000 7f67b813ef40 1 -- 172.21.15.79:0/1346359260 wait complete. 2024-04-25T02:17:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.277+0000 7f67b813ef40 1 Processor -- start 2024-04-25T02:17:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.277+0000 7f67b813ef40 1 -- start start 2024-04-25T02:17:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.277+0000 7f67b813ef40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef8628f0e0 0x55ef863a3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.277+0000 7f67b813ef40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86300370 0x55ef863a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.277+0000 7f67b813ef40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef86314be0 0x55ef863a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.277+0000 7f67b813ef40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ef863146d0 con 0x55ef86300370 2024-04-25T02:17:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.277+0000 7f67b813ef40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ef86245090 con 0x55ef86314be0 2024-04-25T02:17:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.277+0000 7f67b813ef40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55ef863a0140 con 0x55ef8628f0e0 2024-04-25T02:17:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67b543e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86300370 0x55ef863a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67b543e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86300370 0x55ef863a7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36442/0 (socket says 172.21.15.79:36442) 2024-04-25T02:17:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67b543e640 1 -- 172.21.15.79:0/3478273525 learned_addr learned my addr 172.21.15.79:0/3478273525 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67b5c3f640 1 --2- 172.21.15.79:0/3478273525 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef8628f0e0 0x55ef863a3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67b6440640 1 --2- 172.21.15.79:0/3478273525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef86314be0 0x55ef863a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67b543e640 1 -- 172.21.15.79:0/3478273525 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef8628f0e0 msgr2=0x55ef863a3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67b543e640 1 --2- 172.21.15.79:0/3478273525 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55ef8628f0e0 0x55ef863a3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67b543e640 1 -- 172.21.15.79:0/3478273525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef86314be0 msgr2=0x55ef863a7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:47.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67b543e640 1 --2- 172.21.15.79:0/3478273525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef86314be0 0x55ef863a7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67b543e640 1 -- 172.21.15.79:0/3478273525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef863a45c0 con 0x55ef86300370 2024-04-25T02:17:47.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67b6440640 1 --2- 172.21.15.79:0/3478273525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ef86314be0 0x55ef863a7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:47.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67b543e640 1 --2- 172.21.15.79:0/3478273525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86300370 0x55ef863a7a60 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f67ac025c10 tx=0x7f67ac003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:47.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67a6ffd640 1 -- 172.21.15.79:0/3478273525 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac055a40 con 0x55ef86300370 2024-04-25T02:17:47.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67a6ffd640 1 -- 172.21.15.79:0/3478273525 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ac05b040 con 0x55ef86300370 2024-04-25T02:17:47.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67b813ef40 1 -- 172.21.15.79:0/3478273525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef863a2510 con 0x55ef86300370 2024-04-25T02:17:47.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67a6ffd640 1 -- 172.21.15.79:0/3478273525 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac055e00 con 0x55ef86300370 2024-04-25T02:17:47.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.278+0000 7f67b813ef40 1 -- 172.21.15.79:0/3478273525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef863a2ad0 con 0x55ef86300370 2024-04-25T02:17:47.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.279+0000 7f67a6ffd640 1 -- 172.21.15.79:0/3478273525 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67ac053070 con 0x55ef86300370 2024-04-25T02:17:47.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.280+0000 7f67a6ffd640 1 --2- 172.21.15.79:0/3478273525 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f679806a810 0x7f679806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:47.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.280+0000 7f67a6ffd640 1 -- 172.21.15.79:0/3478273525 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7f67ac0cf280 con 0x55ef86300370 2024-04-25T02:17:47.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.280+0000 7f67b5c3f640 1 --2- 172.21.15.79:0/3478273525 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f679806a810 0x7f679806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:47.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.280+0000 7f67b813ef40 1 --2- 172.21.15.79:0/3478273525 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55ef863a4120 0x55ef862fd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:47.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.280+0000 7f67b813ef40 1 -- 172.21.15.79:0/3478273525 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:1 16.7 16:e2e07930:::10000000001.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x55ef863a2ff0 con 0x55ef863a4120 2024-04-25T02:17:47.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.280+0000 7f67b6440640 1 --2- 172.21.15.79:0/3478273525 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55ef863a4120 0x55ef862fd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:47.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.280+0000 7f67b5c3f640 1 --2- 172.21.15.79:0/3478273525 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f679806a810 0x7f679806ccd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f67a8000c00 tx=0x7f67a80017e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:47.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.280+0000 7f67b6440640 1 --2- 172.21.15.79:0/3478273525 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55ef863a4120 0x55ef862fd610 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:47.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.282+0000 7f67b6440640 1 -- 172.21.15.79:0/3478273525 <== osd.3 v2:172.21.15.79:6817/3072297369 1 ==== osd_op_reply(1 10000000001.00000000 [omap-rm-keys] v118'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f67b000c7f0 con 0x55ef863a4120 2024-04-25T02:17:47.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.282+0000 7f67b813ef40 1 -- 172.21.15.79:0/3478273525 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55ef863a4120 msgr2=0x55ef862fd610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:47.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.282+0000 7f67b813ef40 1 --2- 172.21.15.79:0/3478273525 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55ef863a4120 0x55ef862fd610 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.282+0000 7f67b813ef40 1 -- 172.21.15.79:0/3478273525 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f679806a810 msgr2=0x7f679806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:47.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.282+0000 7f67b813ef40 1 --2- 172.21.15.79:0/3478273525 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f679806a810 0x7f679806ccd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f67a8000c00 tx=0x7f67a80017e0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.282+0000 7f67b813ef40 1 -- 172.21.15.79:0/3478273525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86300370 msgr2=0x55ef863a7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:47.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.282+0000 7f67b813ef40 1 --2- 172.21.15.79:0/3478273525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef86300370 0x55ef863a7a60 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f67ac025c10 tx=0x7f67ac003020 comp rx=0 tx=0).stop 2024-04-25T02:17:47.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.282+0000 7f67b6440640 1 -- 172.21.15.79:0/3478273525 reap_dead start 2024-04-25T02:17:47.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.282+0000 7f67b813ef40 1 -- 172.21.15.79:0/3478273525 shutdown_connections 2024-04-25T02:17:47.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.282+0000 7f67b813ef40 1 -- 172.21.15.79:0/3478273525 >> 172.21.15.79:0/3478273525 conn(0x55ef86272920 msgr2=0x55ef86290ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:47.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.282+0000 7f67b813ef40 1 -- 172.21.15.79:0/3478273525 shutdown_connections 2024-04-25T02:17:47.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.282+0000 7f67b813ef40 1 -- 172.21.15.79:0/3478273525 wait complete. 2024-04-25T02:17:47.292 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T02:17:47.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.425+0000 7f166f942640 1 Processor -- start 2024-04-25T02:17:47.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.425+0000 7f166f942640 1 -- start start 2024-04-25T02:17:47.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.426+0000 7f166f942640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f166815e4f0 0x7f16680d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:47.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.426+0000 7f166f942640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f16680cf7f0 0x7f16680d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:47.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.426+0000 7f166f942640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16680d1ee0 con 0x7f16680cfc50 2024-04-25T02:17:47.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.426+0000 7f166f942640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f16680d21c0 con 0x7f16680cf7f0 2024-04-25T02:17:47.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.426+0000 7f166f942640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f16680d24a0 con 0x7f166815e4f0 2024-04-25T02:17:47.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.427+0000 7f166cedd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f16680cf7f0 0x7f16680d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.427+0000 7f166d6de640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f166815e4f0 0x7f16680d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.427+0000 7f166dedf640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f16680cfc50 0x7f166806bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:59702/0 (socket says 172.21.15.79:59702) 2024-04-25T02:17:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.427+0000 7f166dedf640 1 -- 172.21.15.79:0/306601187 learned_addr learned my addr 172.21.15.79:0/306601187 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.427+0000 7f166d6de640 1 --2- 172.21.15.79:0/306601187 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f166815e4f0 0x7f16680d2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:47684/0 (socket says 172.21.15.79:47684) 2024-04-25T02:17:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.427+0000 7f166cedd640 1 -- 172.21.15.79:0/306601187 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f166815e4f0 msgr2=0x7f16680d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.427+0000 7f166cedd640 1 --2- 172.21.15.79:0/306601187 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f166815e4f0 0x7f16680d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.427+0000 7f166cedd640 1 -- 172.21.15.79:0/306601187 >> v1:172.21.15.189:6789/0 conn(0x7f16680cfc50 legacy=0x7f166806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.427+0000 7f166cedd640 1 -- 172.21.15.79:0/306601187 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16680d2780 con 0x7f16680cf7f0 2024-04-25T02:17:47.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.428+0000 7f166cedd640 1 --2- 172.21.15.79:0/306601187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16680cf7f0 0x7f16680d09b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f16580097d0 tx=0x7f165802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4769896ba60db7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:47.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.428+0000 7f165ffff640 1 -- 172.21.15.79:0/306601187 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658037070 con 0x7f16680cf7f0 2024-04-25T02:17:47.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.428+0000 7f165ffff640 1 -- 172.21.15.79:0/306601187 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1658032440 con 0x7f16680cf7f0 2024-04-25T02:17:47.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.428+0000 7f165ffff640 1 -- 172.21.15.79:0/306601187 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658032810 con 0x7f16680cf7f0 2024-04-25T02:17:47.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.428+0000 7f166f942640 1 -- 172.21.15.79:0/306601187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16680cf7f0 msgr2=0x7f16680d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:47.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.428+0000 7f166f942640 1 --2- 172.21.15.79:0/306601187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16680cf7f0 0x7f16680d09b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f16580097d0 tx=0x7f165802a1c0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.428+0000 7f166f942640 1 -- 172.21.15.79:0/306601187 shutdown_connections 2024-04-25T02:17:47.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.428+0000 7f166f942640 1 --2- 172.21.15.79:0/306601187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16680cf7f0 0x7f16680d09b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.428+0000 7f166f942640 1 --2- 172.21.15.79:0/306601187 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f166815e4f0 0x7f16680d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.429+0000 7f166f942640 1 -- 172.21.15.79:0/306601187 >> 172.21.15.79:0/306601187 conn(0x7f166809d4a0 msgr2=0x7f16680d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:47.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.429+0000 7f166f942640 1 -- 172.21.15.79:0/306601187 shutdown_connections 2024-04-25T02:17:47.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.429+0000 7f166f942640 1 -- 172.21.15.79:0/306601187 wait complete. 2024-04-25T02:17:47.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.430+0000 7f166f942640 1 Processor -- start 2024-04-25T02:17:47.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.430+0000 7f166f942640 1 -- start start 2024-04-25T02:17:47.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.430+0000 7f166f942640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f16680cf7f0 0x7f16681f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:47.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.430+0000 7f166f942640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16680cfc50 0x7f16680d40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:47.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.430+0000 7f166f942640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f166815e4f0 0x7f16680d4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:47.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.430+0000 7f166f942640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f16680d0ef0 con 0x7f16680cfc50 2024-04-25T02:17:47.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.430+0000 7f166f942640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f16680d50f0 con 0x7f166815e4f0 2024-04-25T02:17:47.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.430+0000 7f166f942640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f16680d1070 con 0x7f16680cf7f0 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.430+0000 7f166cedd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16680cfc50 0x7f16680d40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.431+0000 7f166cedd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16680cfc50 0x7f16680d40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36456/0 (socket says 172.21.15.79:36456) 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.431+0000 7f166cedd640 1 -- 172.21.15.79:0/405183931 learned_addr learned my addr 172.21.15.79:0/405183931 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.431+0000 7f166d6de640 1 --2- 172.21.15.79:0/405183931 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f16680cf7f0 0x7f16681f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.431+0000 7f166dedf640 1 --2- 172.21.15.79:0/405183931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f166815e4f0 0x7f16680d4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.431+0000 7f166cedd640 1 -- 172.21.15.79:0/405183931 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f16680cf7f0 msgr2=0x7f16681f3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.431+0000 7f166cedd640 1 --2- 172.21.15.79:0/405183931 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f16680cf7f0 0x7f16681f3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.431+0000 7f166cedd640 1 -- 172.21.15.79:0/405183931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f166815e4f0 msgr2=0x7f16680d4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.431+0000 7f166cedd640 1 --2- 172.21.15.79:0/405183931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f166815e4f0 0x7f16680d4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.431+0000 7f166cedd640 1 -- 172.21.15.79:0/405183931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16681502b0 con 0x7f16680cfc50 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.431+0000 7f166cedd640 1 --2- 172.21.15.79:0/405183931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16680cfc50 0x7f16680d40c0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f1658035040 tx=0x7f16580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.431+0000 7f165dffb640 1 -- 172.21.15.79:0/405183931 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658037040 con 0x7f16680cfc50 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.431+0000 7f165dffb640 1 -- 172.21.15.79:0/405183931 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1658030500 con 0x7f16680cfc50 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.431+0000 7f166f942640 1 -- 172.21.15.79:0/405183931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1668150590 con 0x7f16680cfc50 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.431+0000 7f165dffb640 1 -- 172.21.15.79:0/405183931 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658030910 con 0x7f16680cfc50 2024-04-25T02:17:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.431+0000 7f166f942640 1 -- 172.21.15.79:0/405183931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16681f7c80 con 0x7f16680cfc50 2024-04-25T02:17:47.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.432+0000 7f166f942640 1 -- 172.21.15.79:0/405183931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16680686c0 con 0x7f16680cfc50 2024-04-25T02:17:47.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.433+0000 7f165dffb640 1 -- 172.21.15.79:0/405183931 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1658044020 con 0x7f16680cfc50 2024-04-25T02:17:47.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.433+0000 7f165dffb640 1 --2- 172.21.15.79:0/405183931 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f164c06be60 0x7f164c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:47.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.433+0000 7f165dffb640 1 -- 172.21.15.79:0/405183931 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7f16580ab210 con 0x7f16680cfc50 2024-04-25T02:17:47.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.433+0000 7f166d6de640 1 --2- 172.21.15.79:0/405183931 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f164c06be60 0x7f164c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:47.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.434+0000 7f166d6de640 1 --2- 172.21.15.79:0/405183931 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f164c06be60 0x7f164c06e320 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f16640073f0 tx=0x7f166400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:47.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.438+0000 7f165dffb640 1 -- 172.21.15.79:0/405183931 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1658079ab0 con 0x7f16680cfc50 2024-04-25T02:17:47.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:47.649+0000 7f166f942640 1 -- 172.21.15.79:0/405183931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f16680690a0 con 0x7f16680cfc50 2024-04-25T02:17:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.019+0000 7f165dffb640 1 -- 172.21.15.79:0/405183931 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v85) ==== 162+0+0 (secure 0 0 0) 0x7f16580793b0 con 0x7f16680cfc50 2024-04-25T02:17:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T02:17:48.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.021+0000 7f166f942640 1 -- 172.21.15.79:0/405183931 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f164c06be60 msgr2=0x7f164c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:48.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.021+0000 7f166f942640 1 --2- 172.21.15.79:0/405183931 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f164c06be60 0x7f164c06e320 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f16640073f0 tx=0x7f166400b040 comp rx=0 tx=0).stop 2024-04-25T02:17:48.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.021+0000 7f166f942640 1 -- 172.21.15.79:0/405183931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16680cfc50 msgr2=0x7f16680d40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:48.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.021+0000 7f166f942640 1 --2- 172.21.15.79:0/405183931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16680cfc50 0x7f16680d40c0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f1658035040 tx=0x7f16580046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:48.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.021+0000 7f166f942640 1 -- 172.21.15.79:0/405183931 shutdown_connections 2024-04-25T02:17:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.021+0000 7f166f942640 1 --2- 172.21.15.79:0/405183931 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f164c06be60 0x7f164c06e320 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.021+0000 7f166f942640 1 --2- 172.21.15.79:0/405183931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f166815e4f0 0x7f16680d4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.021+0000 7f166f942640 1 --2- 172.21.15.79:0/405183931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16680cfc50 0x7f16680d40c0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.021+0000 7f166f942640 1 --2- 172.21.15.79:0/405183931 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f16680cf7f0 0x7f16681f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.021+0000 7f166f942640 1 -- 172.21.15.79:0/405183931 >> 172.21.15.79:0/405183931 conn(0x7f166809d4a0 msgr2=0x7f166815a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.021+0000 7f166f942640 1 -- 172.21.15.79:0/405183931 shutdown_connections 2024-04-25T02:17:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.021+0000 7f166f942640 1 -- 172.21.15.79:0/405183931 wait complete. 2024-04-25T02:17:48.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:17:48.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.129+0000 7fd3234ee640 1 Processor -- start 2024-04-25T02:17:48.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.130+0000 7fd3234ee640 1 -- start start 2024-04-25T02:17:48.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.130+0000 7fd3234ee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd31c06df50 0x7fd31c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:48.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.130+0000 7fd3234ee640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31c071e00 con 0x7fd31c143bc0 2024-04-25T02:17:48.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.130+0000 7fd3234ee640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31c0720a0 con 0x7fd31c0b2d30 2024-04-25T02:17:48.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.131+0000 7fd3234ee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd31c06e8f0 con 0x7fd31c06df50 2024-04-25T02:17:48.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.131+0000 7fd320a89640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd31c06df50 0x7fd31c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:48.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.131+0000 7fd32128a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd31c143bc0 0x7fd31c15f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38960/0 (socket says 172.21.15.79:38960) 2024-04-25T02:17:48.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.131+0000 7fd32128a640 1 -- 172.21.15.79:0/1754950846 learned_addr learned my addr 172.21.15.79:0/1754950846 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:48.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.131+0000 7fd320a89640 1 -- 172.21.15.79:0/1754950846 >> v1:172.21.15.189:6789/0 conn(0x7fd31c0b2d30 legacy=0x7fd31c0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:48.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.131+0000 7fd320a89640 1 -- 172.21.15.79:0/1754950846 >> v1:172.21.15.79:6789/0 conn(0x7fd31c143bc0 legacy=0x7fd31c15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:48.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.131+0000 7fd320a89640 1 -- 172.21.15.79:0/1754950846 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c072380 con 0x7fd31c06df50 2024-04-25T02:17:48.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.131+0000 7fd313fff640 1 -- 172.21.15.79:0/1754950846 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 463732902 0 0) 0x7fd31c071e00 con 0x7fd31c143bc0 2024-04-25T02:17:48.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.132+0000 7fd320a89640 1 --2- 172.21.15.79:0/1754950846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd31c06df50 0x7fd31c06e3b0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fd3180097a0 tx=0x7fd31802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab79b416d85890bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:48.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.132+0000 7fd313fff640 1 -- 172.21.15.79:0/1754950846 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318037070 con 0x7fd31c06df50 2024-04-25T02:17:48.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.132+0000 7fd313fff640 1 -- 172.21.15.79:0/1754950846 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd31802ae50 con 0x7fd31c06df50 2024-04-25T02:17:48.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.132+0000 7fd313fff640 1 -- 172.21.15.79:0/1754950846 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318032660 con 0x7fd31c06df50 2024-04-25T02:17:48.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.132+0000 7fd3234ee640 1 -- 172.21.15.79:0/1754950846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd31c06df50 msgr2=0x7fd31c06e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:48.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.132+0000 7fd3234ee640 1 --2- 172.21.15.79:0/1754950846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd31c06df50 0x7fd31c06e3b0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fd3180097a0 tx=0x7fd31802a140 comp rx=0 tx=0).stop 2024-04-25T02:17:48.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.132+0000 7fd3234ee640 1 -- 172.21.15.79:0/1754950846 shutdown_connections 2024-04-25T02:17:48.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.132+0000 7fd3234ee640 1 --2- 172.21.15.79:0/1754950846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd31c06df50 0x7fd31c06e3b0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:48.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.132+0000 7fd3234ee640 1 -- 172.21.15.79:0/1754950846 >> 172.21.15.79:0/1754950846 conn(0x7fd31c0cfc80 msgr2=0x7fd31c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:48.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.132+0000 7fd3234ee640 1 -- 172.21.15.79:0/1754950846 shutdown_connections 2024-04-25T02:17:48.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.132+0000 7fd3234ee640 1 -- 172.21.15.79:0/1754950846 wait complete. 2024-04-25T02:17:48.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.133+0000 7fd3234ee640 1 Processor -- start 2024-04-25T02:17:48.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.134+0000 7fd3234ee640 1 -- start start 2024-04-25T02:17:48.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.134+0000 7fd3234ee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd31c06df50 0x7fd31c13f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:48.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.134+0000 7fd3234ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd31c0b2d30 0x7fd31c142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:48.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.134+0000 7fd3234ee640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd31c143bc0 0x7fd31c142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:48.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.134+0000 7fd3234ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c072940 con 0x7fd31c0b2d30 2024-04-25T02:17:48.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.134+0000 7fd3234ee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c072cb0 con 0x7fd31c06df50 2024-04-25T02:17:48.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.134+0000 7fd3234ee640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd31c143fa0 con 0x7fd31c143bc0 2024-04-25T02:17:48.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.134+0000 7fd320a89640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd31c0b2d30 0x7fd31c142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:48.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.134+0000 7fd320a89640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd31c0b2d30 0x7fd31c142630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36466/0 (socket says 172.21.15.79:36466) 2024-04-25T02:17:48.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.134+0000 7fd320a89640 1 -- 172.21.15.79:0/2349768677 learned_addr learned my addr 172.21.15.79:0/2349768677 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:48.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.135+0000 7fd321a8b640 1 --2- 172.21.15.79:0/2349768677 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd31c143bc0 0x7fd31c142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:48.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.135+0000 7fd32128a640 1 --2- 172.21.15.79:0/2349768677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd31c06df50 0x7fd31c13f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:48.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.135+0000 7fd320a89640 1 -- 172.21.15.79:0/2349768677 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd31c143bc0 msgr2=0x7fd31c142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:48.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.135+0000 7fd320a89640 1 --2- 172.21.15.79:0/2349768677 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd31c143bc0 0x7fd31c142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:48.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.135+0000 7fd320a89640 1 -- 172.21.15.79:0/2349768677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd31c06df50 msgr2=0x7fd31c13f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:48.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.135+0000 7fd320a89640 1 --2- 172.21.15.79:0/2349768677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd31c06df50 0x7fd31c13f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:48.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.135+0000 7fd320a89640 1 -- 172.21.15.79:0/2349768677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c0ab3f0 con 0x7fd31c0b2d30 2024-04-25T02:17:48.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.135+0000 7fd32128a640 1 --2- 172.21.15.79:0/2349768677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd31c06df50 0x7fd31c13f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:48.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.135+0000 7fd320a89640 1 --2- 172.21.15.79:0/2349768677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd31c0b2d30 0x7fd31c142630 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fd3180097a0 tx=0x7fd318004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:48.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.135+0000 7fd311ffb640 1 -- 172.21.15.79:0/2349768677 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318048070 con 0x7fd31c0b2d30 2024-04-25T02:17:48.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.135+0000 7fd311ffb640 1 -- 172.21.15.79:0/2349768677 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd318039600 con 0x7fd31c0b2d30 2024-04-25T02:17:48.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.135+0000 7fd311ffb640 1 -- 172.21.15.79:0/2349768677 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318037040 con 0x7fd31c0b2d30 2024-04-25T02:17:48.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.135+0000 7fd3234ee640 1 -- 172.21.15.79:0/2349768677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31c0ab690 con 0x7fd31c0b2d30 2024-04-25T02:17:48.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.135+0000 7fd3234ee640 1 -- 172.21.15.79:0/2349768677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31c0abf30 con 0x7fd31c0b2d30 2024-04-25T02:17:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.136+0000 7fd3234ee640 1 -- 172.21.15.79:0/2349768677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31c0690a0 con 0x7fd31c0b2d30 2024-04-25T02:17:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.137+0000 7fd311ffb640 1 -- 172.21.15.79:0/2349768677 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd31804b070 con 0x7fd31c0b2d30 2024-04-25T02:17:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.137+0000 7fd311ffb640 1 --2- 172.21.15.79:0/2349768677 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd30006be30 0x7fd30006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.137+0000 7fd32128a640 1 --2- 172.21.15.79:0/2349768677 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd30006be30 0x7fd30006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.137+0000 7fd311ffb640 1 -- 172.21.15.79:0/2349768677 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7fd3180acb80 con 0x7fd31c0b2d30 2024-04-25T02:17:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.138+0000 7fd32128a640 1 --2- 172.21.15.79:0/2349768677 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd30006be30 0x7fd30006e2f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd30c000f60 tx=0x7fd30c007c30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:48.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.141+0000 7fd311ffb640 1 -- 172.21.15.79:0/2349768677 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd31807af70 con 0x7fd31c0b2d30 2024-04-25T02:17:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.350+0000 7fd3234ee640 1 -- 172.21.15.79:0/2349768677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd31c0ab860 con 0x7fd31c0b2d30 2024-04-25T02:17:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.350+0000 7fd311ffb640 1 -- 172.21.15.79:0/2349768677 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5181 (secure 0 0 0) 0x7fd31807f270 con 0x7fd31c0b2d30 2024-04-25T02:17:48.355 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:48.355 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":86,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3866997901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3866997901},{"type":"v1","addr":"172.21.15.189:6834","nonce":3866997901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/167225705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":167225705},{"type":"v1","addr":"172.21.15.189:6835","nonce":167225705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8916,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3734112703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3734112703},{"type":"v1","addr":"172.21.15.79:6835","nonce":3734112703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:17:33.960191+0000","modified":"2024-04-25T02:17:48.021664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9186":{"gid":9186,"name":"a","rank":0,"incarnation":86,"state":"up:replay","state_seq":1,"addr":"172.21.15.79:6837/3097428733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3097428733},{"type":"v1","addr":"172.21.15.79:6837","nonce":3097428733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-04-25T02:17:48.356 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 86 2024-04-25T02:17:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.352+0000 7fd3234ee640 1 -- 172.21.15.79:0/2349768677 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd30006be30 msgr2=0x7fd30006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.352+0000 7fd3234ee640 1 --2- 172.21.15.79:0/2349768677 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd30006be30 0x7fd30006e2f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd30c000f60 tx=0x7fd30c007c30 comp rx=0 tx=0).stop 2024-04-25T02:17:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.352+0000 7fd3234ee640 1 -- 172.21.15.79:0/2349768677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd31c0b2d30 msgr2=0x7fd31c142630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.352+0000 7fd3234ee640 1 --2- 172.21.15.79:0/2349768677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd31c0b2d30 0x7fd31c142630 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fd3180097a0 tx=0x7fd318004730 comp rx=0 tx=0).stop 2024-04-25T02:17:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.352+0000 7fd3234ee640 1 -- 172.21.15.79:0/2349768677 shutdown_connections 2024-04-25T02:17:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.352+0000 7fd3234ee640 1 --2- 172.21.15.79:0/2349768677 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd30006be30 0x7fd30006e2f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.352+0000 7fd3234ee640 1 --2- 172.21.15.79:0/2349768677 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd31c143bc0 0x7fd31c142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.352+0000 7fd3234ee640 1 --2- 172.21.15.79:0/2349768677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd31c0b2d30 0x7fd31c142630 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.352+0000 7fd3234ee640 1 --2- 172.21.15.79:0/2349768677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd31c06df50 0x7fd31c13f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.352+0000 7fd3234ee640 1 -- 172.21.15.79:0/2349768677 >> 172.21.15.79:0/2349768677 conn(0x7fd31c0cfc80 msgr2=0x7fd31c06d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.352+0000 7fd3234ee640 1 -- 172.21.15.79:0/2349768677 shutdown_connections 2024-04-25T02:17:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:48.353+0000 7fd3234ee640 1 -- 172.21.15.79:0/2349768677 wait complete. 2024-04-25T02:17:48.770 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:17:33.960191+0000', 'modified': '2024-04-25T02:17:48.021664+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 118, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9186': {'gid': 9186, 'name': 'a', 'rank': 0, 'incarnation': 86, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.79:6837/3097428733', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 3097428733}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 3097428733}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T02:17:48.771 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9186:up:replay 2024-04-25T02:17:49.772 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:17:49.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.877+0000 7f8f45e7d640 1 Processor -- start 2024-04-25T02:17:49.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.877+0000 7f8f45e7d640 1 -- start start 2024-04-25T02:17:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f45e7d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8f400d2e20 0x7f8f400cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f45e7d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f4006c380 con 0x7f8f400b3570 2024-04-25T02:17:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f45e7d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f400d1660 con 0x7f8f4015e4d0 2024-04-25T02:17:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f45e7d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f8f400d1380 con 0x7f8f400d2e20 2024-04-25T02:17:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3effd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8f400b3570 0x7f8f400d2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38968/0 (socket says 172.21.15.79:38968) 2024-04-25T02:17:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3effd640 1 -- 172.21.15.79:0/3246763460 learned_addr learned my addr 172.21.15.79:0/3246763460 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3ffff640 1 --2- 172.21.15.79:0/3246763460 >> v2:172.21.15.189:3300/0 conn(0x7f8f400d2e20 0x7f8f400cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3e7fc640 1 -- 172.21.15.79:0/3246763460 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158980975 0 0) 0x7f8f4006c380 con 0x7f8f400b3570 2024-04-25T02:17:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3e7fc640 1 -- 172.21.15.79:0/3246763460 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f28003520 con 0x7f8f400b3570 2024-04-25T02:17:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3e7fc640 1 -- 172.21.15.79:0/3246763460 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1671599527 0 0) 0x7f8f28003520 con 0x7f8f400b3570 2024-04-25T02:17:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3e7fc640 1 -- 172.21.15.79:0/3246763460 >> v2:172.21.15.189:3300/0 conn(0x7f8f400d2e20 msgr2=0x7f8f400cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3e7fc640 1 --2- 172.21.15.79:0/3246763460 >> v2:172.21.15.189:3300/0 conn(0x7f8f400d2e20 0x7f8f400cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3e7fc640 1 -- 172.21.15.79:0/3246763460 >> v1:172.21.15.189:6789/0 conn(0x7f8f4015e4d0 legacy=0x7f8f4006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3e7fc640 1 -- 172.21.15.79:0/3246763460 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f400cede0 con 0x7f8f400b3570 2024-04-25T02:17:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3e7fc640 1 -- 172.21.15.79:0/3246763460 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f8f34001670 con 0x7f8f400b3570 2024-04-25T02:17:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3ffff640 1 --2- 172.21.15.79:0/3246763460 >> v2:172.21.15.189:3300/0 conn(0x7f8f400d2e20 0x7f8f400cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:17:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3e7fc640 1 -- 172.21.15.79:0/3246763460 >> v1:172.21.15.79:6789/0 conn(0x7f8f400b3570 legacy=0x7f8f400d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3e7fc640 1 --2- 172.21.15.79:0/3246763460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f280039b0 0x7f8f28003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3e7fc640 1 --2- 172.21.15.79:0/3246763460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f280043b0 0x7f8f28004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3e7fc640 1 --2- 172.21.15.79:0/3246763460 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f28005080 0x7f8f2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3e7fc640 1 -- 172.21.15.79:0/3246763460 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8f400d1380 con 0x7f8f280043b0 2024-04-25T02:17:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3e7fc640 1 -- 172.21.15.79:0/3246763460 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2800bfe0 con 0x7f8f280039b0 2024-04-25T02:17:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3e7fc640 1 -- 172.21.15.79:0/3246763460 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2800c1e0 con 0x7f8f28005080 2024-04-25T02:17:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.878+0000 7f8f3effd640 1 --2- 172.21.15.79:0/3246763460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f280043b0 0x7f8f28004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.879+0000 7f8f3f7fe640 1 --2- 172.21.15.79:0/3246763460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f280039b0 0x7f8f28003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.879+0000 7f8f3ffff640 1 --2- 172.21.15.79:0/3246763460 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f28005080 0x7f8f2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.879+0000 7f8f3effd640 1 -- 172.21.15.79:0/3246763460 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f28005080 msgr2=0x7f8f2800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.879+0000 7f8f3effd640 1 --2- 172.21.15.79:0/3246763460 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f28005080 0x7f8f2800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.879+0000 7f8f3effd640 1 -- 172.21.15.79:0/3246763460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f280039b0 msgr2=0x7f8f28003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.879+0000 7f8f3effd640 1 --2- 172.21.15.79:0/3246763460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f280039b0 0x7f8f28003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.879+0000 7f8f3effd640 1 -- 172.21.15.79:0/3246763460 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f28003520 con 0x7f8f280043b0 2024-04-25T02:17:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.879+0000 7f8f3ffff640 1 -- 172.21.15.79:0/3246763460 reap_dead start 2024-04-25T02:17:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.879+0000 7f8f3effd640 1 --2- 172.21.15.79:0/3246763460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f280043b0 0x7f8f28004880 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400c240 tx=0x7f8f28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89c2fb349927589 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.880+0000 7f8f3e7fc640 1 -- 172.21.15.79:0/3246763460 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f34007d30 con 0x7f8f280043b0 2024-04-25T02:17:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.880+0000 7f8f3e7fc640 1 -- 172.21.15.79:0/3246763460 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f34005af0 con 0x7f8f280043b0 2024-04-25T02:17:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.880+0000 7f8f3e7fc640 1 -- 172.21.15.79:0/3246763460 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f34007070 con 0x7f8f280043b0 2024-04-25T02:17:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.880+0000 7f8f45e7d640 1 -- 172.21.15.79:0/3246763460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f280043b0 msgr2=0x7f8f28004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.880+0000 7f8f45e7d640 1 --2- 172.21.15.79:0/3246763460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f280043b0 0x7f8f28004880 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400c240 tx=0x7f8f28005830 comp rx=0 tx=0).stop 2024-04-25T02:17:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.880+0000 7f8f45e7d640 1 -- 172.21.15.79:0/3246763460 shutdown_connections 2024-04-25T02:17:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.880+0000 7f8f45e7d640 1 --2- 172.21.15.79:0/3246763460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f280043b0 0x7f8f28004880 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.880+0000 7f8f45e7d640 1 -- 172.21.15.79:0/3246763460 >> 172.21.15.79:0/3246763460 conn(0x7f8f4009d460 msgr2=0x7f8f400d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.880+0000 7f8f45e7d640 1 -- 172.21.15.79:0/3246763460 shutdown_connections 2024-04-25T02:17:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.880+0000 7f8f45e7d640 1 -- 172.21.15.79:0/3246763460 wait complete. 2024-04-25T02:17:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.881+0000 7f8f45e7d640 1 Processor -- start 2024-04-25T02:17:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.882+0000 7f8f45e7d640 1 -- start start 2024-04-25T02:17:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.882+0000 7f8f45e7d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f280043b0 0x7f8f40160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.882+0000 7f8f45e7d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f40159940 0x7f8f4015b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.882+0000 7f8f45e7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f4015b9a0 0x7f8f400c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.882+0000 7f8f45e7d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8f400d20d0 con 0x7f8f4015b9a0 2024-04-25T02:17:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.882+0000 7f8f45e7d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4015e8b0 con 0x7f8f40159940 2024-04-25T02:17:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.882+0000 7f8f45e7d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8f400d2250 con 0x7f8f280043b0 2024-04-25T02:17:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.882+0000 7f8f3ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f4015b9a0 0x7f8f400c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.882+0000 7f8f3ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f4015b9a0 0x7f8f400c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36482/0 (socket says 172.21.15.79:36482) 2024-04-25T02:17:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.882+0000 7f8f3ffff640 1 -- 172.21.15.79:0/1690721644 learned_addr learned my addr 172.21.15.79:0/1690721644 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.883+0000 7f8f3effd640 1 --2- 172.21.15.79:0/1690721644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f40159940 0x7f8f4015b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.883+0000 7f8f3f7fe640 1 --2- 172.21.15.79:0/1690721644 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f280043b0 0x7f8f40160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.883+0000 7f8f3ffff640 1 -- 172.21.15.79:0/1690721644 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f280043b0 msgr2=0x7f8f40160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.883+0000 7f8f3ffff640 1 --2- 172.21.15.79:0/1690721644 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f280043b0 0x7f8f40160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.883+0000 7f8f3ffff640 1 -- 172.21.15.79:0/1690721644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f40159940 msgr2=0x7f8f4015b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.883+0000 7f8f3ffff640 1 --2- 172.21.15.79:0/1690721644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f40159940 0x7f8f4015b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.883+0000 7f8f3ffff640 1 -- 172.21.15.79:0/1690721644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4015be90 con 0x7f8f4015b9a0 2024-04-25T02:17:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.883+0000 7f8f3ffff640 1 --2- 172.21.15.79:0/1690721644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f4015b9a0 0x7f8f400c9a40 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f8f40163140 tx=0x7f8f3800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.883+0000 7f8f27fff640 1 -- 172.21.15.79:0/1690721644 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f38015430 con 0x7f8f4015b9a0 2024-04-25T02:17:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.883+0000 7f8f27fff640 1 -- 172.21.15.79:0/1690721644 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f3801d070 con 0x7f8f4015b9a0 2024-04-25T02:17:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.883+0000 7f8f45e7d640 1 -- 172.21.15.79:0/1690721644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4015c170 con 0x7f8f4015b9a0 2024-04-25T02:17:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.883+0000 7f8f27fff640 1 -- 172.21.15.79:0/1690721644 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f38015830 con 0x7f8f4015b9a0 2024-04-25T02:17:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.883+0000 7f8f45e7d640 1 -- 172.21.15.79:0/1690721644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f4015c730 con 0x7f8f4015b9a0 2024-04-25T02:17:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.884+0000 7f8f45e7d640 1 -- 172.21.15.79:0/1690721644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f400690a0 con 0x7f8f4015b9a0 2024-04-25T02:17:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.885+0000 7f8f27fff640 1 -- 172.21.15.79:0/1690721644 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f380159d0 con 0x7f8f4015b9a0 2024-04-25T02:17:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.885+0000 7f8f27fff640 1 --2- 172.21.15.79:0/1690721644 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f2c06be60 0x7f8f2c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.885+0000 7f8f27fff640 1 -- 172.21.15.79:0/1690721644 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7f8f3808b920 con 0x7f8f4015b9a0 2024-04-25T02:17:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.885+0000 7f8f3f7fe640 1 --2- 172.21.15.79:0/1690721644 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f2c06be60 0x7f8f2c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.885+0000 7f8f3f7fe640 1 --2- 172.21.15.79:0/1690721644 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f2c06be60 0x7f8f2c06e320 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8f30001820 tx=0x7f8f30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:49.889+0000 7f8f27fff640 1 -- 172.21.15.79:0/1690721644 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8f38010040 con 0x7f8f4015b9a0 2024-04-25T02:17:50.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:50.102+0000 7f8f45e7d640 1 -- 172.21.15.79:0/1690721644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f400d1920 con 0x7f8f4015b9a0 2024-04-25T02:17:50.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:50.102+0000 7f8f27fff640 1 -- 172.21.15.79:0/1690721644 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5181 (secure 0 0 0) 0x7f8f3805a240 con 0x7f8f4015b9a0 2024-04-25T02:17:50.107 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:50.107 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3866997901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3866997901},{"type":"v1","addr":"172.21.15.189:6834","nonce":3866997901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/167225705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":167225705},{"type":"v1","addr":"172.21.15.189:6835","nonce":167225705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8916,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3734112703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3734112703},{"type":"v1","addr":"172.21.15.79:6835","nonce":3734112703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:17:33.960191+0000","modified":"2024-04-25T02:17:49.028620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9186":{"gid":9186,"name":"a","rank":0,"incarnation":86,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.79:6837/3097428733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3097428733},{"type":"v1","addr":"172.21.15.79:6837","nonce":3097428733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-04-25T02:17:50.107 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 88 2024-04-25T02:17:50.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:50.104+0000 7f8f45e7d640 1 -- 172.21.15.79:0/1690721644 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f2c06be60 msgr2=0x7f8f2c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:50.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:50.104+0000 7f8f45e7d640 1 --2- 172.21.15.79:0/1690721644 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f2c06be60 0x7f8f2c06e320 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8f30001820 tx=0x7f8f30009040 comp rx=0 tx=0).stop 2024-04-25T02:17:50.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:50.104+0000 7f8f45e7d640 1 -- 172.21.15.79:0/1690721644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f4015b9a0 msgr2=0x7f8f400c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:50.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:50.104+0000 7f8f45e7d640 1 --2- 172.21.15.79:0/1690721644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f4015b9a0 0x7f8f400c9a40 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f8f40163140 tx=0x7f8f3800f580 comp rx=0 tx=0).stop 2024-04-25T02:17:50.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:50.104+0000 7f8f45e7d640 1 -- 172.21.15.79:0/1690721644 shutdown_connections 2024-04-25T02:17:50.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:50.104+0000 7f8f45e7d640 1 --2- 172.21.15.79:0/1690721644 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f2c06be60 0x7f8f2c06e320 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:50.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:50.105+0000 7f8f45e7d640 1 --2- 172.21.15.79:0/1690721644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f4015b9a0 0x7f8f400c9a40 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:50.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:50.105+0000 7f8f45e7d640 1 --2- 172.21.15.79:0/1690721644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f40159940 0x7f8f4015b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:50.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:50.105+0000 7f8f45e7d640 1 --2- 172.21.15.79:0/1690721644 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f280043b0 0x7f8f40160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:50.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:50.105+0000 7f8f45e7d640 1 -- 172.21.15.79:0/1690721644 >> 172.21.15.79:0/1690721644 conn(0x7f8f4009d460 msgr2=0x7f8f4006d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:50.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:50.105+0000 7f8f45e7d640 1 -- 172.21.15.79:0/1690721644 shutdown_connections 2024-04-25T02:17:50.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:50.105+0000 7f8f45e7d640 1 -- 172.21.15.79:0/1690721644 wait complete. 2024-04-25T02:17:50.522 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:17:33.960191+0000', 'modified': '2024-04-25T02:17:49.028620+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 118, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9186': {'gid': 9186, 'name': 'a', 'rank': 0, 'incarnation': 86, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.79:6837/3097428733', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 3097428733}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 3097428733}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T02:17:50.522 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9186:up:rejoin 2024-04-25T02:17:51.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:17:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.627+0000 7fbee065d640 1 Processor -- start 2024-04-25T02:17:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.627+0000 7fbee065d640 1 -- start start 2024-04-25T02:17:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.628+0000 7fbee065d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbed815e4d0 0x7fbed806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.628+0000 7fbee065d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbed80b3570 0x7fbed80d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.628+0000 7fbee065d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbed80d1660 con 0x7fbed80b3020 2024-04-25T02:17:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.628+0000 7fbee065d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbed80d1380 con 0x7fbed815e4d0 2024-04-25T02:17:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.628+0000 7fbee065d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fbed80cede0 con 0x7fbed80b3570 2024-04-25T02:17:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.629+0000 7fbedebfa640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbed80b3020 0x7fbed80cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38980/0 (socket says 172.21.15.79:38980) 2024-04-25T02:17:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.629+0000 7fbede3f9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbed815e4d0 0x7fbed806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.629+0000 7fbedebfa640 1 -- 172.21.15.79:0/3149173959 learned_addr learned my addr 172.21.15.79:0/3149173959 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.629+0000 7fbeddbf8640 1 --2- 172.21.15.79:0/3149173959 >> v2:172.21.15.189:3300/0 conn(0x7fbed80b3570 0x7fbed80d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.629+0000 7fbede3f9640 1 -- 172.21.15.79:0/3149173959 >> v2:172.21.15.189:3300/0 conn(0x7fbed80b3570 msgr2=0x7fbed80d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.629+0000 7fbede3f9640 1 --2- 172.21.15.79:0/3149173959 >> v2:172.21.15.189:3300/0 conn(0x7fbed80b3570 0x7fbed80d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.629+0000 7fbede3f9640 1 -- 172.21.15.79:0/3149173959 >> v1:172.21.15.79:6789/0 conn(0x7fbed80b3020 legacy=0x7fbed80cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.629+0000 7fbedd3f7640 1 -- 172.21.15.79:0/3149173959 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3531590138 0 0) 0x7fbed80d1660 con 0x7fbed80b3020 2024-04-25T02:17:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.629+0000 7fbede3f9640 1 -- 172.21.15.79:0/3149173959 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed80cf0c0 con 0x7fbed815e4d0 2024-04-25T02:17:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.630+0000 7fbede3f9640 1 --2- 172.21.15.79:0/3149173959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed815e4d0 0x7fbed806bc70 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fbed40097a0 tx=0x7fbed402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141fda3e9de367dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.630+0000 7fbedd3f7640 1 -- 172.21.15.79:0/3149173959 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4037070 con 0x7fbed815e4d0 2024-04-25T02:17:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.630+0000 7fbedd3f7640 1 -- 172.21.15.79:0/3149173959 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed4032440 con 0x7fbed815e4d0 2024-04-25T02:17:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.630+0000 7fbedd3f7640 1 -- 172.21.15.79:0/3149173959 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4032810 con 0x7fbed815e4d0 2024-04-25T02:17:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.630+0000 7fbee065d640 1 -- 172.21.15.79:0/3149173959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed815e4d0 msgr2=0x7fbed806bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.630+0000 7fbee065d640 1 --2- 172.21.15.79:0/3149173959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed815e4d0 0x7fbed806bc70 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fbed40097a0 tx=0x7fbed402a1e0 comp rx=0 tx=0).stop 2024-04-25T02:17:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.630+0000 7fbee065d640 1 -- 172.21.15.79:0/3149173959 shutdown_connections 2024-04-25T02:17:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.630+0000 7fbee065d640 1 --2- 172.21.15.79:0/3149173959 >> v2:172.21.15.189:3300/0 conn(0x7fbed80b3570 0x7fbed80d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.630+0000 7fbee065d640 1 --2- 172.21.15.79:0/3149173959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed815e4d0 0x7fbed806bc70 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.630+0000 7fbee065d640 1 -- 172.21.15.79:0/3149173959 >> 172.21.15.79:0/3149173959 conn(0x7fbed809d460 msgr2=0x7fbed80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:51.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.631+0000 7fbee065d640 1 -- 172.21.15.79:0/3149173959 shutdown_connections 2024-04-25T02:17:51.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.631+0000 7fbee065d640 1 -- 172.21.15.79:0/3149173959 wait complete. 2024-04-25T02:17:51.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.632+0000 7fbee065d640 1 Processor -- start 2024-04-25T02:17:51.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.632+0000 7fbee065d640 1 -- start start 2024-04-25T02:17:51.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.632+0000 7fbee065d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed80b3020 0x7fbed81f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:51.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.632+0000 7fbee065d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbed80b3570 0x7fbed8155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:51.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.632+0000 7fbee065d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbed815e4d0 0x7fbed80cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:51.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.632+0000 7fbee065d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbed80d2250 con 0x7fbed80b3020 2024-04-25T02:17:51.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.632+0000 7fbee065d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbed80d20d0 con 0x7fbed815e4d0 2024-04-25T02:17:51.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.632+0000 7fbee065d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbed806c1b0 con 0x7fbed80b3570 2024-04-25T02:17:51.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbede3f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed80b3020 0x7fbed81f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:51.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbede3f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed80b3020 0x7fbed81f49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36502/0 (socket says 172.21.15.79:36502) 2024-04-25T02:17:51.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbede3f9640 1 -- 172.21.15.79:0/3589706602 learned_addr learned my addr 172.21.15.79:0/3589706602 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:51.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbedebfa640 1 --2- 172.21.15.79:0/3589706602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbed815e4d0 0x7fbed80cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:51.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbeddbf8640 1 --2- 172.21.15.79:0/3589706602 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbed80b3570 0x7fbed8155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:51.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbede3f9640 1 -- 172.21.15.79:0/3589706602 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbed80b3570 msgr2=0x7fbed8155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:51.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbede3f9640 1 --2- 172.21.15.79:0/3589706602 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbed80b3570 0x7fbed8155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:51.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbede3f9640 1 -- 172.21.15.79:0/3589706602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbed815e4d0 msgr2=0x7fbed80cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:51.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbede3f9640 1 --2- 172.21.15.79:0/3589706602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbed815e4d0 0x7fbed80cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:51.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbede3f9640 1 -- 172.21.15.79:0/3589706602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed80b99f0 con 0x7fbed80b3020 2024-04-25T02:17:51.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbede3f9640 1 --2- 172.21.15.79:0/3589706602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed80b3020 0x7fbed81f49d0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fbed4035040 tx=0x7fbed40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:51.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbeceffd640 1 -- 172.21.15.79:0/3589706602 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4037040 con 0x7fbed80b3020 2024-04-25T02:17:51.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbeceffd640 1 -- 172.21.15.79:0/3589706602 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed4030500 con 0x7fbed80b3020 2024-04-25T02:17:51.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbee065d640 1 -- 172.21.15.79:0/3589706602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed80cbb80 con 0x7fbed80b3020 2024-04-25T02:17:51.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbeceffd640 1 -- 172.21.15.79:0/3589706602 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed40308d0 con 0x7fbed80b3020 2024-04-25T02:17:51.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.633+0000 7fbee065d640 1 -- 172.21.15.79:0/3589706602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed80cc120 con 0x7fbed80b3020 2024-04-25T02:17:51.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.634+0000 7fbee065d640 1 -- 172.21.15.79:0/3589706602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed80690a0 con 0x7fbed80b3020 2024-04-25T02:17:51.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.635+0000 7fbeceffd640 1 -- 172.21.15.79:0/3589706602 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbed4044020 con 0x7fbed80b3020 2024-04-25T02:17:51.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.635+0000 7fbeceffd640 1 --2- 172.21.15.79:0/3589706602 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbebc06be30 0x7fbebc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:51.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.635+0000 7fbeddbf8640 1 --2- 172.21.15.79:0/3589706602 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbebc06be30 0x7fbebc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:51.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.635+0000 7fbeceffd640 1 -- 172.21.15.79:0/3589706602 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7fbed40ab200 con 0x7fbed80b3020 2024-04-25T02:17:51.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.636+0000 7fbeddbf8640 1 --2- 172.21.15.79:0/3589706602 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbebc06be30 0x7fbebc06e2f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbed8160da0 tx=0x7fbec8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:51.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.640+0000 7fbeceffd640 1 -- 172.21.15.79:0/3589706602 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbed80b99f0 con 0x7fbed80b3020 2024-04-25T02:17:51.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.849+0000 7fbee065d640 1 -- 172.21.15.79:0/3589706602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbed80d1920 con 0x7fbed80b3020 2024-04-25T02:17:51.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.850+0000 7fbeceffd640 1 -- 172.21.15.79:0/3589706602 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5188 (secure 0 0 0) 0x7fbed4079b20 con 0x7fbed80b3020 2024-04-25T02:17:51.854 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:51.854 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":89,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3866997901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3866997901},{"type":"v1","addr":"172.21.15.189:6834","nonce":3866997901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/167225705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":167225705},{"type":"v1","addr":"172.21.15.189:6835","nonce":167225705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8916,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3734112703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3734112703},{"type":"v1","addr":"172.21.15.79:6835","nonce":3734112703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:17:33.960191+0000","modified":"2024-04-25T02:17:51.033162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9186":{"gid":9186,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/3097428733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3097428733},{"type":"v1","addr":"172.21.15.79:6837","nonce":3097428733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9186,"qdb_cluster":[9186]},"id":8}]} 2024-04-25T02:17:51.855 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 89 2024-04-25T02:17:51.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.852+0000 7fbee065d640 1 -- 172.21.15.79:0/3589706602 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbebc06be30 msgr2=0x7fbebc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.852+0000 7fbee065d640 1 --2- 172.21.15.79:0/3589706602 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbebc06be30 0x7fbebc06e2f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbed8160da0 tx=0x7fbec8008040 comp rx=0 tx=0).stop 2024-04-25T02:17:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.852+0000 7fbee065d640 1 -- 172.21.15.79:0/3589706602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed80b3020 msgr2=0x7fbed81f49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.852+0000 7fbee065d640 1 --2- 172.21.15.79:0/3589706602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed80b3020 0x7fbed81f49d0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fbed4035040 tx=0x7fbed40046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.852+0000 7fbee065d640 1 -- 172.21.15.79:0/3589706602 shutdown_connections 2024-04-25T02:17:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.852+0000 7fbee065d640 1 --2- 172.21.15.79:0/3589706602 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbebc06be30 0x7fbebc06e2f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.852+0000 7fbee065d640 1 --2- 172.21.15.79:0/3589706602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbed815e4d0 0x7fbed80cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.852+0000 7fbee065d640 1 --2- 172.21.15.79:0/3589706602 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbed80b3570 0x7fbed8155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.852+0000 7fbee065d640 1 --2- 172.21.15.79:0/3589706602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed80b3020 0x7fbed81f49d0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.852+0000 7fbee065d640 1 -- 172.21.15.79:0/3589706602 >> 172.21.15.79:0/3589706602 conn(0x7fbed809d460 msgr2=0x7fbed815d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.852+0000 7fbee065d640 1 -- 172.21.15.79:0/3589706602 shutdown_connections 2024-04-25T02:17:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:51.852+0000 7fbee065d640 1 -- 172.21.15.79:0/3589706602 wait complete. 2024-04-25T02:17:52.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 89, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:17:33.960191+0000', 'modified': '2024-04-25T02:17:51.033162+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 118, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9186': {'gid': 9186, 'name': 'a', 'rank': 0, 'incarnation': 86, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.79:6837/3097428733', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 3097428733}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 3097428733}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9186, 'qdb_cluster': [9186]} 2024-04-25T02:17:52.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:17:52.272 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T02:17:52.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.368+0000 7f34e4a15640 1 Processor -- start 2024-04-25T02:17:52.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.368+0000 7f34e4a15640 1 -- start start 2024-04-25T02:17:52.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.369+0000 7f34e4a15640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f34e006e3b0 0x7f34e00b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.369+0000 7f34e4a15640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34e0071e00 con 0x7f34e006df50 2024-04-25T02:17:52.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.369+0000 7f34e4a15640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34e00720a0 con 0x7f34e0143bc0 2024-04-25T02:17:52.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.369+0000 7f34e4a15640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f34e0072cb0 con 0x7f34e006e3b0 2024-04-25T02:17:52.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.369+0000 7f34ded9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f34e006e3b0 0x7f34e00b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.369+0000 7f34ded9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f34e006e3b0 0x7f34e00b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36510/0 (socket says 172.21.15.79:36510) 2024-04-25T02:17:52.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.369+0000 7f34ddd9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f34e006df50 0x7f34e00b2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38982/0 (socket says 172.21.15.79:38982) 2024-04-25T02:17:52.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.369+0000 7f34ded9d640 1 -- 172.21.15.79:0/3839732885 learned_addr learned my addr 172.21.15.79:0/3839732885 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:52.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.370+0000 7f34ded9d640 1 -- 172.21.15.79:0/3839732885 >> v1:172.21.15.189:6789/0 conn(0x7f34e0143bc0 legacy=0x7f34e015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.370+0000 7f34ded9d640 1 -- 172.21.15.79:0/3839732885 >> v1:172.21.15.79:6789/0 conn(0x7f34e006df50 legacy=0x7f34e00b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.370+0000 7f34ded9d640 1 -- 172.21.15.79:0/3839732885 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e0072380 con 0x7f34e006e3b0 2024-04-25T02:17:52.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.370+0000 7f34dd59a640 1 -- 172.21.15.79:0/3839732885 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 833899842 0 0) 0x7f34e0071e00 con 0x7f34e006df50 2024-04-25T02:17:52.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.370+0000 7f34ded9d640 1 --2- 172.21.15.79:0/3839732885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34e006e3b0 0x7f34e00b3440 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f34d800bb10 tx=0x7f34d802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b2b1933886d881 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:52.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.370+0000 7f34dd59a640 1 -- 172.21.15.79:0/3839732885 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8036020 con 0x7f34e006e3b0 2024-04-25T02:17:52.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.370+0000 7f34dd59a640 1 -- 172.21.15.79:0/3839732885 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d8032640 con 0x7f34e006e3b0 2024-04-25T02:17:52.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.370+0000 7f34dd59a640 1 -- 172.21.15.79:0/3839732885 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8032a10 con 0x7f34e006e3b0 2024-04-25T02:17:52.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.371+0000 7f34e4a15640 1 -- 172.21.15.79:0/3839732885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34e006e3b0 msgr2=0x7f34e00b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.371+0000 7f34e4a15640 1 --2- 172.21.15.79:0/3839732885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34e006e3b0 0x7f34e00b3440 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f34d800bb10 tx=0x7f34d802c940 comp rx=0 tx=0).stop 2024-04-25T02:17:52.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.371+0000 7f34e4a15640 1 -- 172.21.15.79:0/3839732885 shutdown_connections 2024-04-25T02:17:52.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.371+0000 7f34e4a15640 1 --2- 172.21.15.79:0/3839732885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34e006e3b0 0x7f34e00b3440 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.371+0000 7f34e4a15640 1 -- 172.21.15.79:0/3839732885 >> 172.21.15.79:0/3839732885 conn(0x7f34e00cfc80 msgr2=0x7f34e00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:52.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.371+0000 7f34e4a15640 1 -- 172.21.15.79:0/3839732885 shutdown_connections 2024-04-25T02:17:52.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.371+0000 7f34e4a15640 1 -- 172.21.15.79:0/3839732885 wait complete. 2024-04-25T02:17:52.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.372+0000 7f34e4a15640 1 Processor -- start 2024-04-25T02:17:52.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.372+0000 7f34e4a15640 1 -- start start 2024-04-25T02:17:52.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.373+0000 7f34e4a15640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34e006df50 0x7f34e00cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.373+0000 7f34e4a15640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f34e006e3b0 0x7f34e00ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.373+0000 7f34e4a15640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34e0143bc0 0x7f34e00adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.373+0000 7f34e4a15640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f34e006e840 con 0x7f34e0143bc0 2024-04-25T02:17:52.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.373+0000 7f34e4a15640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f34e0072940 con 0x7f34e006df50 2024-04-25T02:17:52.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.373+0000 7f34e4a15640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f34e0143fa0 con 0x7f34e006e3b0 2024-04-25T02:17:52.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.373+0000 7f34ded9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34e0143bc0 0x7f34e00adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.373+0000 7f34ded9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34e0143bc0 0x7f34e00adbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36526/0 (socket says 172.21.15.79:36526) 2024-04-25T02:17:52.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.373+0000 7f34ded9d640 1 -- 172.21.15.79:0/814346491 learned_addr learned my addr 172.21.15.79:0/814346491 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:52.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.373+0000 7f34ded9d640 1 -- 172.21.15.79:0/814346491 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f34e006e3b0 msgr2=0x7f34e00ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.373+0000 7f34ded9d640 1 --2- 172.21.15.79:0/814346491 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f34e006e3b0 0x7f34e00ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.373+0000 7f34ded9d640 1 -- 172.21.15.79:0/814346491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34e006df50 msgr2=0x7f34e00cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.373+0000 7f34ded9d640 1 --2- 172.21.15.79:0/814346491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34e006df50 0x7f34e00cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.373+0000 7f34ded9d640 1 -- 172.21.15.79:0/814346491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e00cbbe0 con 0x7f34e0143bc0 2024-04-25T02:17:52.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.374+0000 7f34ded9d640 1 --2- 172.21.15.79:0/814346491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34e0143bc0 0x7f34e00adbe0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f34d800bb10 tx=0x7f34d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:52.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.374+0000 7f34ceffd640 1 -- 172.21.15.79:0/814346491 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8036040 con 0x7f34e0143bc0 2024-04-25T02:17:52.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.374+0000 7f34ceffd640 1 -- 172.21.15.79:0/814346491 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d8004250 con 0x7f34e0143bc0 2024-04-25T02:17:52.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.374+0000 7f34e4a15640 1 -- 172.21.15.79:0/814346491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e014fee0 con 0x7f34e0143bc0 2024-04-25T02:17:52.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.374+0000 7f34ceffd640 1 -- 172.21.15.79:0/814346491 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d803b8e0 con 0x7f34e0143bc0 2024-04-25T02:17:52.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.374+0000 7f34e4a15640 1 -- 172.21.15.79:0/814346491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e01504a0 con 0x7f34e0143bc0 2024-04-25T02:17:52.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.375+0000 7f34ceffd640 1 -- 172.21.15.79:0/814346491 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f34d804c060 con 0x7f34e0143bc0 2024-04-25T02:17:52.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.375+0000 7f34ceffd640 1 --2- 172.21.15.79:0/814346491 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f34c006be30 0x7f34c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.376+0000 7f34ceffd640 1 -- 172.21.15.79:0/814346491 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7f34d80addd0 con 0x7f34e0143bc0 2024-04-25T02:17:52.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.376+0000 7f34de59c640 1 --2- 172.21.15.79:0/814346491 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f34c006be30 0x7f34c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.376+0000 7f34de59c640 1 --2- 172.21.15.79:0/814346491 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f34c006be30 0x7f34c006e2f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f34d00012e0 tx=0x7f34d0007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.377+0000 7f34e77fe740 1 Processor -- start 2024-04-25T02:17:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.377+0000 7f34e77fe740 1 -- start start 2024-04-25T02:17:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.377+0000 7f34e77fe740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712ceb60 0x55d4712814f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.377+0000 7f34e77fe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4712b1c80 0x55d4712b1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.377+0000 7f34e77fe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712b1540 0x55d471286350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.377+0000 7f34e77fe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d4711e9f00 con 0x55d4712b1540 2024-04-25T02:17:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.377+0000 7f34e77fe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d471192750 con 0x55d4712b1c80 2024-04-25T02:17:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.377+0000 7f34e77fe740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55d4711e5ec0 con 0x55d4712ceb60 2024-04-25T02:17:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.378+0000 7f34ded9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712b1540 0x55d471286350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.378+0000 7f34ded9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712b1540 0x55d471286350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36532/0 (socket says 172.21.15.79:36532) 2024-04-25T02:17:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.378+0000 7f34ded9d640 1 -- 172.21.15.79:0/2646452675 learned_addr learned my addr 172.21.15.79:0/2646452675 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.378+0000 7f34de59c640 1 --2- 172.21.15.79:0/2646452675 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712ceb60 0x55d4712814f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.378+0000 7f34ded9d640 1 -- 172.21.15.79:0/2646452675 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712ceb60 msgr2=0x55d4712814f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.378+0000 7f34ddd9b640 1 --2- 172.21.15.79:0/2646452675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4712b1c80 0x55d4712b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.378+0000 7f34ded9d640 1 --2- 172.21.15.79:0/2646452675 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712ceb60 0x55d4712814f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.378+0000 7f34ded9d640 1 -- 172.21.15.79:0/2646452675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4712b1c80 msgr2=0x55d4712b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.378+0000 7f34ded9d640 1 --2- 172.21.15.79:0/2646452675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4712b1c80 0x55d4712b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.378+0000 7f34ded9d640 1 -- 172.21.15.79:0/2646452675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d470efe2d0 con 0x55d4712b1540 2024-04-25T02:17:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.378+0000 7f34ddd9b640 1 --2- 172.21.15.79:0/2646452675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4712b1c80 0x55d4712b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.378+0000 7f34ded9d640 1 --2- 172.21.15.79:0/2646452675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712b1540 0x55d471286350 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f34d8078450 tx=0x7f34d807ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c9c2c82303b84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.378+0000 7f34bffff640 1 -- 172.21.15.79:0/2646452675 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8094020 con 0x55d4712b1540 2024-04-25T02:17:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.378+0000 7f34bffff640 1 -- 172.21.15.79:0/2646452675 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d8084bd0 con 0x55d4712b1540 2024-04-25T02:17:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.378+0000 7f34bffff640 1 -- 172.21.15.79:0/2646452675 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8078660 con 0x55d4712b1540 2024-04-25T02:17:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.379+0000 7f34e77fe740 1 -- 172.21.15.79:0/2646452675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712b1540 msgr2=0x55d471286350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.379+0000 7f34e77fe740 1 --2- 172.21.15.79:0/2646452675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712b1540 0x55d471286350 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f34d8078450 tx=0x7f34d807ba10 comp rx=0 tx=0).stop 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.379+0000 7f34e77fe740 1 -- 172.21.15.79:0/2646452675 shutdown_connections 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.379+0000 7f34e77fe740 1 --2- 172.21.15.79:0/2646452675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712b1540 0x55d471286350 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.379+0000 7f34e77fe740 1 --2- 172.21.15.79:0/2646452675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4712b1c80 0x55d4712b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.379+0000 7f34e77fe740 1 --2- 172.21.15.79:0/2646452675 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712ceb60 0x55d4712814f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.379+0000 7f34e77fe740 1 -- 172.21.15.79:0/2646452675 >> 172.21.15.79:0/2646452675 conn(0x55d471283760 msgr2=0x55d4712cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.379+0000 7f34e77fe740 1 -- 172.21.15.79:0/2646452675 shutdown_connections 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.379+0000 7f34e77fe740 1 -- 172.21.15.79:0/2646452675 wait complete. 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.379+0000 7f34e77fe740 1 -- start start 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.379+0000 7f34e77fe740 1 Processor -- start 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.380+0000 7f34e77fe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4712b1c80 0x55d4712a1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.380+0000 7f34e77fe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d4712acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.380+0000 7f34e77fe740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d47129ea10 0x55d4712b2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.380+0000 7f34e77fe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d4711e9f00 con 0x55d4712ceb60 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.380+0000 7f34e77fe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d4711a5cf0 con 0x55d4712b1c80 2024-04-25T02:17:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.380+0000 7f34e77fe740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55d471285910 con 0x55d47129ea10 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.380+0000 7f34e77fe740 10 client.0 _ll_register_callbacks cb 0x55d4711a56e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.380+0000 7f34ddd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d4712acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.380+0000 7f34ddd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d4712acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36546/0 (socket says 172.21.15.79:36546) 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.380+0000 7f34ddd9b640 1 -- 172.21.15.79:0/1933737289 learned_addr learned my addr 172.21.15.79:0/1933737289 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34ded9d640 1 --2- 172.21.15.79:0/1933737289 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d47129ea10 0x55d4712b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34de59c640 1 --2- 172.21.15.79:0/1933737289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4712b1c80 0x55d4712a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34ddd9b640 1 -- 172.21.15.79:0/1933737289 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d47129ea10 msgr2=0x55d4712b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34ddd9b640 1 --2- 172.21.15.79:0/1933737289 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d47129ea10 0x55d4712b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34ddd9b640 1 -- 172.21.15.79:0/1933737289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4712b1c80 msgr2=0x55d4712a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34ddd9b640 1 --2- 172.21.15.79:0/1933737289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4712b1c80 0x55d4712a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34ddd9b640 1 -- 172.21.15.79:0/1933737289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d470fc86b0 con 0x55d4712ceb60 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34ddd9b640 1 --2- 172.21.15.79:0/1933737289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d4712acc20 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f34d4001db0 tx=0x7f34d400d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde131a5bf86403 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34bd7fa640 1 -- 172.21.15.79:0/1933737289 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d400dea0 con 0x55d4712ceb60 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34bd7fa640 1 -- 172.21.15.79:0/1933737289 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7f34d4013b10 con 0x55d4712ceb60 2024-04-25T02:17:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34e77fe740 1 -- 172.21.15.79:0/1933737289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34d8084bd0 con 0x55d4712ceb60 2024-04-25T02:17:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34bd7fa640 1 -- 172.21.15.79:0/1933737289 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f34d4013d10 con 0x55d4712ceb60 2024-04-25T02:17:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34e77fe740 10 client.9240 fetch_fsmap learned FSMap version 89 2024-04-25T02:17:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34e77fe740 1 -- 172.21.15.79:0/1933737289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55d4712a0e50 con 0x55d4712ceb60 2024-04-25T02:17:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34bd7fa640 1 -- 172.21.15.79:0/1933737289 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d8084bd0 con 0x55d4712ceb60 2024-04-25T02:17:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34bd7fa640 1 -- 172.21.15.79:0/1933737289 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7f34d40072d0 con 0x55d4712ceb60 2024-04-25T02:17:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34e77fe740 10 client.9240 fetch_fsmap finished waiting for FSMap version 89 2024-04-25T02:17:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34e77fe740 10 client.9240 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:17:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.381+0000 7f34e77fe740 20 client.9240 populate_metadata read hostname 'smithi079' 2024-04-25T02:17:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.382+0000 7f34e77fe740 1 --2- 172.21.15.79:0/1933737289 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x55d471285e90 0x55d4712e9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.382+0000 7f34e77fe740 4 client.9240 mds_command: new command op to 9186 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:17:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.382+0000 7f34e77fe740 1 -- 172.21.15.79:0/1933737289 --> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4711f7440 con 0x55d471285e90 2024-04-25T02:17:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.382+0000 7f34de59c640 1 --2- 172.21.15.79:0/1933737289 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x55d471285e90 0x55d4712e9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.382+0000 7f34bd7fa640 10 client.9240 ms_handle_connect on v2:172.21.15.79:6836/3097428733 2024-04-25T02:17:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.382+0000 7f34de59c640 1 --2- 172.21.15.79:0/1933737289 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x55d471285e90 0x55d4712e9cd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=770b537c350099d8 server_cookie=461bfa431527eee1 in_seq=0 out_seq=0 2024-04-25T02:17:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.383+0000 7f34bd7fa640 1 -- 172.21.15.79:0/1933737289 <== mds.0 v2:172.21.15.79:6836/3097428733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d4711f7440 con 0x55d471285e90 2024-04-25T02:17:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.383+0000 7f34bd7fa640 10 client.9240 handle_command_reply: tid=0 2024-04-25T02:17:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.383+0000 7f34e77fe740 1 client.9240 shutdown 2024-04-25T02:17:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.383+0000 7f34e77fe740 1 -- 172.21.15.79:0/1933737289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 msgr2=0x55d4712acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.383+0000 7f34e77fe740 1 --2- 172.21.15.79:0/1933737289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d4712acc20 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f34d4001db0 tx=0x7f34d400d520 comp rx=0 tx=0).stop 2024-04-25T02:17:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.383+0000 7f34e77fe740 1 -- 172.21.15.79:0/1933737289 shutdown_connections 2024-04-25T02:17:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.383+0000 7f34e77fe740 1 --2- 172.21.15.79:0/1933737289 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x55d471285e90 0x55d4712e9cd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.383+0000 7f34e77fe740 1 --2- 172.21.15.79:0/1933737289 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d47129ea10 0x55d4712b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.383+0000 7f34e77fe740 1 --2- 172.21.15.79:0/1933737289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d4712acc20 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.383+0000 7f34e77fe740 1 --2- 172.21.15.79:0/1933737289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4712b1c80 0x55d4712a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.383+0000 7f34bd7fa640 0 client.9240 ms_handle_reset on v2:172.21.15.79:6836/3097428733 2024-04-25T02:17:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.383+0000 7f34e77fe740 1 -- 172.21.15.79:0/1933737289 >> 172.21.15.79:0/1933737289 conn(0x55d4712b1540 msgr2=0x55d471284fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.383+0000 7f34e77fe740 1 -- 172.21.15.79:0/1933737289 shutdown_connections 2024-04-25T02:17:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.383+0000 7f34e77fe740 1 -- 172.21.15.79:0/1933737289 wait complete. 2024-04-25T02:17:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.383+0000 7f34e77fe740 20 client.9240 trim_cache size 0 max 16384 2024-04-25T02:17:52.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.401+0000 7f34e77fe740 1 Processor -- start 2024-04-25T02:17:52.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.401+0000 7f34e77fe740 1 -- start start 2024-04-25T02:17:52.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34e77fe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d47129ea10 0x55d4712acc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34e77fe740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712b1c80 0x55d471282230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34e77fe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d471285130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34e77fe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f34e01fb5e0 con 0x55d4712ceb60 2024-04-25T02:17:52.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34e77fe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f34e0151d70 con 0x55d47129ea10 2024-04-25T02:17:52.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34e77fe740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f34e01faf90 con 0x55d4712b1c80 2024-04-25T02:17:52.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34ded9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d471285130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34ded9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d471285130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36558/0 (socket says 172.21.15.79:36558) 2024-04-25T02:17:52.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34ded9d640 1 -- 172.21.15.79:0/1539575217 learned_addr learned my addr 172.21.15.79:0/1539575217 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:52.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34ddd9b640 1 --2- 172.21.15.79:0/1539575217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712b1c80 0x55d471282230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34de59c640 1 --2- 172.21.15.79:0/1539575217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d47129ea10 0x55d4712acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34ded9d640 1 -- 172.21.15.79:0/1539575217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712b1c80 msgr2=0x55d471282230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:52.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34ded9d640 1 --2- 172.21.15.79:0/1539575217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712b1c80 0x55d471282230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34ded9d640 1 -- 172.21.15.79:0/1539575217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d47129ea10 msgr2=0x55d4712acc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:52.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34ded9d640 1 --2- 172.21.15.79:0/1539575217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d47129ea10 0x55d4712acc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34ded9d640 1 -- 172.21.15.79:0/1539575217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4712848a0 con 0x55d4712ceb60 2024-04-25T02:17:52.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34ddd9b640 1 --2- 172.21.15.79:0/1539575217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712b1c80 0x55d471282230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:52.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34de59c640 1 --2- 172.21.15.79:0/1539575217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d47129ea10 0x55d4712acc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:52.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34ded9d640 1 --2- 172.21.15.79:0/1539575217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d471285130 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f34d807bcf0 tx=0x7f34d807f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c241195176f016c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:52.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34bf7fe640 1 -- 172.21.15.79:0/1539575217 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8084bd0 con 0x55d4712ceb60 2024-04-25T02:17:52.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34bf7fe640 1 -- 172.21.15.79:0/1539575217 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d809b080 con 0x55d4712ceb60 2024-04-25T02:17:52.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.402+0000 7f34bf7fe640 1 -- 172.21.15.79:0/1539575217 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8078660 con 0x55d4712ceb60 2024-04-25T02:17:52.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.403+0000 7f34e77fe740 1 -- 172.21.15.79:0/1539575217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 msgr2=0x55d471285130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.403+0000 7f34e77fe740 1 --2- 172.21.15.79:0/1539575217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d471285130 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f34d807bcf0 tx=0x7f34d807f000 comp rx=0 tx=0).stop 2024-04-25T02:17:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.403+0000 7f34e77fe740 1 -- 172.21.15.79:0/1539575217 shutdown_connections 2024-04-25T02:17:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.403+0000 7f34e77fe740 1 --2- 172.21.15.79:0/1539575217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d471285130 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.403+0000 7f34e77fe740 1 --2- 172.21.15.79:0/1539575217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712b1c80 0x55d471282230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.403+0000 7f34e77fe740 1 --2- 172.21.15.79:0/1539575217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d47129ea10 0x55d4712acc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.403+0000 7f34e77fe740 1 -- 172.21.15.79:0/1539575217 >> 172.21.15.79:0/1539575217 conn(0x55d4712b1540 msgr2=0x55d4712cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.403+0000 7f34e77fe740 1 -- 172.21.15.79:0/1539575217 shutdown_connections 2024-04-25T02:17:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.403+0000 7f34e77fe740 1 -- 172.21.15.79:0/1539575217 wait complete. 2024-04-25T02:17:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.404+0000 7f34e77fe740 1 -- start start 2024-04-25T02:17:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.404+0000 7f34e77fe740 1 Processor -- start 2024-04-25T02:17:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.404+0000 7f34e77fe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d47129ea10 0x55d4713491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.404+0000 7f34e77fe740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712b1c80 0x55d4712dea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.404+0000 7f34e77fe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d4712edcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.404+0000 7f34e77fe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d471285d10 con 0x55d4712ceb60 2024-04-25T02:17:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.404+0000 7f34e77fe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d4712a1e20 con 0x55d47129ea10 2024-04-25T02:17:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.404+0000 7f34e77fe740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55d4712862d0 con 0x55d4712b1c80 2024-04-25T02:17:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34e77fe740 10 client.0 _ll_register_callbacks cb 0x7f34d4001940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:17:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34ded9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d4712edcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34ded9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d4712edcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36568/0 (socket says 172.21.15.79:36568) 2024-04-25T02:17:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34ded9d640 1 -- 172.21.15.79:0/2805255069 learned_addr learned my addr 172.21.15.79:0/2805255069 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34ddd9b640 1 --2- 172.21.15.79:0/2805255069 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712b1c80 0x55d4712dea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34de59c640 1 --2- 172.21.15.79:0/2805255069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d47129ea10 0x55d4713491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34ded9d640 1 -- 172.21.15.79:0/2805255069 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712b1c80 msgr2=0x55d4712dea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34ded9d640 1 --2- 172.21.15.79:0/2805255069 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712b1c80 0x55d4712dea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34ded9d640 1 -- 172.21.15.79:0/2805255069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d47129ea10 msgr2=0x55d4713491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34ded9d640 1 --2- 172.21.15.79:0/2805255069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d47129ea10 0x55d4713491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34ded9d640 1 -- 172.21.15.79:0/2805255069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4712eea20 con 0x55d4712ceb60 2024-04-25T02:17:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34de59c640 1 --2- 172.21.15.79:0/2805255069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d47129ea10 0x55d4713491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34ded9d640 1 --2- 172.21.15.79:0/2805255069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d4712edcf0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f34d807bcf0 tx=0x7f34d800b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf049ec7f4d3766 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:17:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34bd7fa640 1 -- 172.21.15.79:0/2805255069 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d800b730 con 0x55d4712ceb60 2024-04-25T02:17:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34bd7fa640 1 -- 172.21.15.79:0/2805255069 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7f34d80a5bd0 con 0x55d4712ceb60 2024-04-25T02:17:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34e77fe740 1 -- 172.21.15.79:0/2805255069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34d809b080 con 0x55d4712ceb60 2024-04-25T02:17:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34bd7fa640 1 -- 172.21.15.79:0/2805255069 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f34d8084bd0 con 0x55d4712ceb60 2024-04-25T02:17:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34e77fe740 10 client.9246 fetch_fsmap learned FSMap version 89 2024-04-25T02:17:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34e77fe740 1 -- 172.21.15.79:0/2805255069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55d4712df000 con 0x55d4712ceb60 2024-04-25T02:17:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34bd7fa640 1 -- 172.21.15.79:0/2805255069 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d809b080 con 0x55d4712ceb60 2024-04-25T02:17:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.405+0000 7f34bd7fa640 1 -- 172.21.15.79:0/2805255069 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7f34d8031070 con 0x55d4712ceb60 2024-04-25T02:17:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 10 client.9246 fetch_fsmap finished waiting for FSMap version 89 2024-04-25T02:17:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 10 client.9246 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:17:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 20 client.9246 populate_metadata read hostname 'smithi079' 2024-04-25T02:17:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 1 --2- 172.21.15.79:0/2805255069 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x55d4712ee2f0 0x55d471285840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 4 client.9246 mds_command: new command op to 9186 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:17:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 1 -- 172.21.15.79:0/2805255069 --> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] -- command(tid 0: {"prefix": "status"}) -- 0x55d4711f1790 con 0x55d4712ee2f0 2024-04-25T02:17:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34de59c640 1 --2- 172.21.15.79:0/2805255069 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x55d4712ee2f0 0x55d471285840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34bd7fa640 10 client.9246 ms_handle_connect on v2:172.21.15.79:6836/3097428733 2024-04-25T02:17:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34de59c640 1 --2- 172.21.15.79:0/2805255069 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x55d4712ee2f0 0x55d471285840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee6f6c31f096a32a server_cookie=b62a16d7b1ddea7c in_seq=0 out_seq=0 2024-04-25T02:17:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34bd7fa640 1 -- 172.21.15.79:0/2805255069 <== mds.0 v2:172.21.15.79:6836/3097428733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55d4711f1790 con 0x55d4712ee2f0 2024-04-25T02:17:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34bd7fa640 10 client.9246 handle_command_reply: tid=0 2024-04-25T02:17:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 1 client.9246 shutdown 2024-04-25T02:17:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 1 -- 172.21.15.79:0/2805255069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 msgr2=0x55d4712edcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 1 --2- 172.21.15.79:0/2805255069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d4712edcf0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f34d807bcf0 tx=0x7f34d800b450 comp rx=0 tx=0).stop 2024-04-25T02:17:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 1 -- 172.21.15.79:0/2805255069 shutdown_connections 2024-04-25T02:17:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 1 --2- 172.21.15.79:0/2805255069 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x55d4712ee2f0 0x55d471285840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 1 --2- 172.21.15.79:0/2805255069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4712ceb60 0x55d4712edcf0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34bd7fa640 0 client.9246 ms_handle_reset on v2:172.21.15.79:6836/3097428733 2024-04-25T02:17:52.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 1 --2- 172.21.15.79:0/2805255069 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55d4712b1c80 0x55d4712dea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 1 --2- 172.21.15.79:0/2805255069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d47129ea10 0x55d4713491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 1 -- 172.21.15.79:0/2805255069 >> 172.21.15.79:0/2805255069 conn(0x55d4712b1540 msgr2=0x55d471285130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:52.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 1 -- 172.21.15.79:0/2805255069 shutdown_connections 2024-04-25T02:17:52.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 1 -- 172.21.15.79:0/2805255069 wait complete. 2024-04-25T02:17:52.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.406+0000 7f34e77fe740 20 client.9246 trim_cache size 0 max 16384 2024-04-25T02:17:52.419 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:17:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "696648c4-3e52-400b-a780-2e8863c56c42", 2024-04-25T02:17:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-04-25T02:17:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 9186, 2024-04-25T02:17:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-04-25T02:17:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-04-25T02:17:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-04-25T02:17:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.3810524060000002, 2024-04-25T02:17:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 89, 2024-04-25T02:17:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 118, 2024-04-25T02:17:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 118, 2024-04-25T02:17:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 5.3566089630000002 2024-04-25T02:17:52.420 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:17:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.407+0000 7f34e4a15640 1 -- 172.21.15.79:0/814346491 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f34c006be30 msgr2=0x7f34c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.407+0000 7f34e4a15640 1 --2- 172.21.15.79:0/814346491 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f34c006be30 0x7f34c006e2f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f34d00012e0 tx=0x7f34d0007d30 comp rx=0 tx=0).stop 2024-04-25T02:17:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.407+0000 7f34e4a15640 1 -- 172.21.15.79:0/814346491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34e0143bc0 msgr2=0x7f34e00adbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.407+0000 7f34e4a15640 1 --2- 172.21.15.79:0/814346491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34e0143bc0 0x7f34e00adbe0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f34d800bb10 tx=0x7f34d80046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.407+0000 7f34e4a15640 1 -- 172.21.15.79:0/814346491 shutdown_connections 2024-04-25T02:17:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.407+0000 7f34e4a15640 1 --2- 172.21.15.79:0/814346491 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f34c006be30 0x7f34c006e2f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.407+0000 7f34e4a15640 1 --2- 172.21.15.79:0/814346491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34e0143bc0 0x7f34e00adbe0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.407+0000 7f34e4a15640 1 --2- 172.21.15.79:0/814346491 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f34e006e3b0 0x7f34e00ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.407+0000 7f34e4a15640 1 --2- 172.21.15.79:0/814346491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34e006df50 0x7f34e00cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.407+0000 7f34e4a15640 1 -- 172.21.15.79:0/814346491 >> 172.21.15.79:0/814346491 conn(0x7f34e00cfc80 msgr2=0x7f34e00d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.407+0000 7f34e4a15640 1 -- 172.21.15.79:0/814346491 shutdown_connections 2024-04-25T02:17:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.407+0000 7f34e4a15640 1 -- 172.21.15.79:0/814346491 wait complete. 2024-04-25T02:17:52.422 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:17:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.514+0000 7f7425ea5640 1 Processor -- start 2024-04-25T02:17:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.514+0000 7f7425ea5640 1 -- start start 2024-04-25T02:17:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.514+0000 7f7425ea5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7420144cb0 0x7f74200b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.514+0000 7f7425ea5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f742006e660 0x7f7420071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.514+0000 7f7425ea5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7420070d90 con 0x7f74200b5580 2024-04-25T02:17:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.514+0000 7f7425ea5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f74200cf130 con 0x7f742006e660 2024-04-25T02:17:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.514+0000 7f7425ea5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f74200cf410 con 0x7f7420144cb0 2024-04-25T02:17:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.515+0000 7f741effd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f74200b5580 0x7f742006df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38996/0 (socket says 172.21.15.79:38996) 2024-04-25T02:17:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.515+0000 7f741ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f742006e660 0x7f7420071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.515+0000 7f741effd640 1 -- 172.21.15.79:0/879940668 learned_addr learned my addr 172.21.15.79:0/879940668 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.515+0000 7f741f7fe640 1 --2- 172.21.15.79:0/879940668 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7420144cb0 0x7f74200b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.515+0000 7f741e7fc640 1 -- 172.21.15.79:0/879940668 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502580600 0 0) 0x7f7420070d90 con 0x7f74200b5580 2024-04-25T02:17:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.515+0000 7f741e7fc640 1 -- 172.21.15.79:0/879940668 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7408003520 con 0x7f74200b5580 2024-04-25T02:17:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.515+0000 7f741ffff640 1 -- 172.21.15.79:0/879940668 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7420144cb0 msgr2=0x7f74200b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.515+0000 7f741ffff640 1 --2- 172.21.15.79:0/879940668 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7420144cb0 0x7f74200b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.515+0000 7f741ffff640 1 -- 172.21.15.79:0/879940668 >> v1:172.21.15.79:6789/0 conn(0x7f74200b5580 legacy=0x7f742006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.515+0000 7f741ffff640 1 -- 172.21.15.79:0/879940668 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74200cf6f0 con 0x7f742006e660 2024-04-25T02:17:52.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.516+0000 7f741ffff640 1 --2- 172.21.15.79:0/879940668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742006e660 0x7f7420071240 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f7418009d90 tx=0x7f741802a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3729cf9e578c80f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:52.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.516+0000 7f741e7fc640 1 -- 172.21.15.79:0/879940668 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418007740 con 0x7f742006e660 2024-04-25T02:17:52.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.516+0000 7f741e7fc640 1 -- 172.21.15.79:0/879940668 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74180078e0 con 0x7f742006e660 2024-04-25T02:17:52.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.516+0000 7f741e7fc640 1 -- 172.21.15.79:0/879940668 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418007cb0 con 0x7f742006e660 2024-04-25T02:17:52.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.516+0000 7f7425ea5640 1 -- 172.21.15.79:0/879940668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742006e660 msgr2=0x7f7420071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.516+0000 7f7425ea5640 1 --2- 172.21.15.79:0/879940668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742006e660 0x7f7420071240 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f7418009d90 tx=0x7f741802a530 comp rx=0 tx=0).stop 2024-04-25T02:17:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.516+0000 7f7425ea5640 1 -- 172.21.15.79:0/879940668 shutdown_connections 2024-04-25T02:17:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.516+0000 7f7425ea5640 1 --2- 172.21.15.79:0/879940668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742006e660 0x7f7420071240 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.516+0000 7f7425ea5640 1 --2- 172.21.15.79:0/879940668 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7420144cb0 0x7f74200b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.516+0000 7f7425ea5640 1 -- 172.21.15.79:0/879940668 >> 172.21.15.79:0/879940668 conn(0x7f74200cfc80 msgr2=0x7f74200d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.516+0000 7f7425ea5640 1 -- 172.21.15.79:0/879940668 shutdown_connections 2024-04-25T02:17:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.516+0000 7f7425ea5640 1 -- 172.21.15.79:0/879940668 wait complete. 2024-04-25T02:17:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.518+0000 7f7425ea5640 1 Processor -- start 2024-04-25T02:17:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.518+0000 7f7425ea5640 1 -- start start 2024-04-25T02:17:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.518+0000 7f7425ea5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742006e660 0x7f74200a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.518+0000 7f7425ea5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74200b5580 0x7f742013a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.518+0000 7f7425ea5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7420144cb0 0x7f742013ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.518+0000 7f7425ea5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7420145ab0 con 0x7f742006e660 2024-04-25T02:17:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.518+0000 7f7425ea5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7420145090 con 0x7f7420144cb0 2024-04-25T02:17:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.518+0000 7f7425ea5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7420145c30 con 0x7f74200b5580 2024-04-25T02:17:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f741f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742006e660 0x7f74200a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f741f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742006e660 0x7f74200a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36586/0 (socket says 172.21.15.79:36586) 2024-04-25T02:17:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f741f7fe640 1 -- 172.21.15.79:0/3104063326 learned_addr learned my addr 172.21.15.79:0/3104063326 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f741effd640 1 --2- 172.21.15.79:0/3104063326 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74200b5580 0x7f742013a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f741ffff640 1 --2- 172.21.15.79:0/3104063326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7420144cb0 0x7f742013ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f741f7fe640 1 -- 172.21.15.79:0/3104063326 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74200b5580 msgr2=0x7f742013a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f741f7fe640 1 --2- 172.21.15.79:0/3104063326 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74200b5580 0x7f742013a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f741f7fe640 1 -- 172.21.15.79:0/3104063326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7420144cb0 msgr2=0x7f742013ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f741f7fe640 1 --2- 172.21.15.79:0/3104063326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7420144cb0 0x7f742013ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f741f7fe640 1 -- 172.21.15.79:0/3104063326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74200a9a10 con 0x7f742006e660 2024-04-25T02:17:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f741effd640 1 --2- 172.21.15.79:0/3104063326 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74200b5580 0x7f742013a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f741f7fe640 1 --2- 172.21.15.79:0/3104063326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742006e660 0x7f74200a94d0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f741000e870 tx=0x7f741000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f7407fff640 1 -- 172.21.15.79:0/3104063326 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410017070 con 0x7f742006e660 2024-04-25T02:17:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f7407fff640 1 -- 172.21.15.79:0/3104063326 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741000c940 con 0x7f742006e660 2024-04-25T02:17:52.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f7425ea5640 1 -- 172.21.15.79:0/3104063326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742013c860 con 0x7f742006e660 2024-04-25T02:17:52.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f7407fff640 1 -- 172.21.15.79:0/3104063326 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741000cd30 con 0x7f742006e660 2024-04-25T02:17:52.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.519+0000 7f7425ea5640 1 -- 172.21.15.79:0/3104063326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742013e970 con 0x7f742006e660 2024-04-25T02:17:52.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.520+0000 7f7425ea5640 1 -- 172.21.15.79:0/3104063326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742013cc50 con 0x7f742006e660 2024-04-25T02:17:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.521+0000 7f7407fff640 1 -- 172.21.15.79:0/3104063326 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f741001a070 con 0x7f742006e660 2024-04-25T02:17:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.521+0000 7f7407fff640 1 --2- 172.21.15.79:0/3104063326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f740c06be60 0x7f740c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.521+0000 7f7407fff640 1 -- 172.21.15.79:0/3104063326 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7f741008ada0 con 0x7f742006e660 2024-04-25T02:17:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.521+0000 7f741effd640 1 --2- 172.21.15.79:0/3104063326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f740c06be60 0x7f740c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.521+0000 7f741effd640 1 --2- 172.21.15.79:0/3104063326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f740c06be60 0x7f740c06e320 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7414007fd0 tx=0x7f7414009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:52.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.525+0000 7f7407fff640 1 -- 172.21.15.79:0/3104063326 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f74100596c0 con 0x7f742006e660 2024-04-25T02:17:52.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.734+0000 7f7425ea5640 1 -- 172.21.15.79:0/3104063326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f74200690a0 con 0x7f742006e660 2024-04-25T02:17:52.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.735+0000 7f7407fff640 1 -- 172.21.15.79:0/3104063326 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v89) ==== 53+0+73 (secure 0 0 0) 0x7f7410058fc0 con 0x7f742006e660 2024-04-25T02:17:52.740 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:17:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.737+0000 7f7425ea5640 1 -- 172.21.15.79:0/3104063326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f740c06be60 msgr2=0x7f740c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.737+0000 7f7425ea5640 1 --2- 172.21.15.79:0/3104063326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f740c06be60 0x7f740c06e320 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7414007fd0 tx=0x7f7414009040 comp rx=0 tx=0).stop 2024-04-25T02:17:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.737+0000 7f7425ea5640 1 -- 172.21.15.79:0/3104063326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742006e660 msgr2=0x7f74200a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.737+0000 7f7425ea5640 1 --2- 172.21.15.79:0/3104063326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742006e660 0x7f74200a94d0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f741000e870 tx=0x7f741000ed30 comp rx=0 tx=0).stop 2024-04-25T02:17:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.737+0000 7f7425ea5640 1 -- 172.21.15.79:0/3104063326 shutdown_connections 2024-04-25T02:17:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.737+0000 7f7425ea5640 1 --2- 172.21.15.79:0/3104063326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f740c06be60 0x7f740c06e320 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.737+0000 7f7425ea5640 1 --2- 172.21.15.79:0/3104063326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7420144cb0 0x7f742013ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.737+0000 7f7425ea5640 1 --2- 172.21.15.79:0/3104063326 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74200b5580 0x7f742013a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.737+0000 7f7425ea5640 1 --2- 172.21.15.79:0/3104063326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742006e660 0x7f74200a94d0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.737+0000 7f7425ea5640 1 -- 172.21.15.79:0/3104063326 >> 172.21.15.79:0/3104063326 conn(0x7f74200cfc80 msgr2=0x7f742006d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.737+0000 7f7425ea5640 1 -- 172.21.15.79:0/3104063326 shutdown_connections 2024-04-25T02:17:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52.737+0000 7f7425ea5640 1 -- 172.21.15.79:0/3104063326 wait complete. 2024-04-25T02:17:52.752 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:17:52.752 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:17:52.752 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:17:52.753 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:17:52.753 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:17:52.753 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:17:52.753 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:17:52.753 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:17:52.753 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:17:52.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:52.753 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:17:52.768 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:17:52.769 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:17:52.769 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:17:52.769 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:52.769 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:17:52.769 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:52.769 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:17:52.769 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:17:52.769 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:17:52.769 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:17:52.769 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:17:52.770 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:17:52.770 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:17:52.770 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:17:52.770 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:17:52.770 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:17:52.770 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:17:52.770 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42133sec preferred_lft 42133sec 2024-04-25T02:17:52.770 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:17:52.770 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:52.770 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:17:52.770 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:17:52.770 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:17:52.770 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:52.770 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:17:52.770 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:52.771 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:17:52.771 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:17:52.771 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link 2024-04-25T02:17:52.771 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:52.771 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:17:52.771 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:17:52.771 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::4c:adff:fe56:7194/64 scope link 2024-04-25T02:17:52.771 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:17:52.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:52.771 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:17:52.831 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:17:52.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:52.832 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:17:52.888 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:17:52.888 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:17:52.888 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:17:52.889 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:17:52.889 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:17:52.889 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:17:52.889 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:17:52.889 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:17:52.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:17:52.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:17:52.890 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:17:52.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:17:53.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:53.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:53.195 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:17:53.195 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-04-25T02:17:53.024+0000 7f2ba98ac640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:17:53.210 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:17:53.210 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:17:53.210 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:17:53.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:53.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:17:53.274 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:17:53.274 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:17:53.328 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:17:53.329 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:17:53.329 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:17:53.383 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:17:53.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:53.384 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:17:53.465 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:17:53.465 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:17:53.465 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:17:53.473 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:17:53.473 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:17:53.473 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:17:53.473 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:17:53.473 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:17:53.478 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:17:53.478 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:17:53.479 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:17:53.479 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:17:53.479 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:17:53.479 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:17:53.479 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:17:53.479 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:17:53.479 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:17:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:17:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:17:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:17:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:17:53.481 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:17:53.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:53.481 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:17:53.544 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:17:53.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:17:53.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:53.640 INFO:teuthology.orchestra.run.smithi079.stdout:client6614 2024-04-25T02:17:53.640 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:17:53.640 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:53.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:53.655 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T02:17:53.712 INFO:teuthology.orchestra.run.smithi079.stdout:./ 2024-04-25T02:17:53.712 INFO:teuthology.orchestra.run.smithi079.stdout:./parent 2024-04-25T02:17:53.713 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed 2024-04-25T02:17:53.713 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/charlie 2024-04-25T02:17:53.713 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/alpha 2024-04-25T02:17:53.713 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/unflushed 2024-04-25T02:17:53.713 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/unflushed/jfile 2024-04-25T02:17:53.714 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:53.714 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:53.714 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:17:53.714 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:17:53.714 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T02:17:53.714 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:53.817 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:17:53.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:53.826 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:53.826 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:53.826 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:17:53.826 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:17:53.826 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T02:17:53.826 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:53.930 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627776 2024-04-25T02:17:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:53.939 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:53.939 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:53.939 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:17:53.939 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:17:53.939 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T02:17:53.939 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:54.043 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627777 2024-04-25T02:17:54.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:54.052 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:54.052 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:54.052 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:17:54.052 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:17:54.053 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T02:17:54.053 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:54.156 INFO:teuthology.orchestra.run.smithi079.stdout:1099511628280 2024-04-25T02:17:54.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:54.165 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:54.165 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:54.165 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:17:54.165 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:17:54.165 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T02:17:54.166 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:54.269 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627778 2024-04-25T02:17:54.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:54.278 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:54.278 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:54.278 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:17:54.278 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:17:54.278 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T02:17:54.278 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:54.382 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627779 2024-04-25T02:17:54.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:54.391 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:17:54.391 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:17:54.391 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:17:54.391 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:17:54.392 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T02:17:54.392 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:17:54.495 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627780 2024-04-25T02:17:54.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:17:54.504 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:17:54.504 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:54.559 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:17:54.559 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:17:54.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:17:54.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.745+0000 7eff6d5db640 1 Processor -- start 2024-04-25T02:17:54.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.745+0000 7eff6d5db640 1 -- start start 2024-04-25T02:17:54.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.746+0000 7eff6d5db640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff68161b90 0x7eff680d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:54.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.746+0000 7eff6d5db640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7eff680d47e0 0x7eff680cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:54.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.746+0000 7eff6d5db640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff680ceed0 con 0x7eff680d0a60 2024-04-25T02:17:54.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.746+0000 7eff6d5db640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7eff680ceca0 con 0x7eff680d47e0 2024-04-25T02:17:54.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.746+0000 7eff6d5db640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7eff680d4f80 con 0x7eff68161b90 2024-04-25T02:17:54.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.746+0000 7eff667fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7eff680d47e0 0x7eff680cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:54.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.746+0000 7eff677fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7eff680d0a60 0x7eff680b3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34488/0 (socket says 172.21.15.79:34488) 2024-04-25T02:17:54.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.746+0000 7eff677fe640 1 -- 172.21.15.79:0/3012884137 learned_addr learned my addr 172.21.15.79:0/3012884137 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.746+0000 7eff667fc640 1 -- 172.21.15.79:0/3012884137 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff68161b90 msgr2=0x7eff680d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.746+0000 7eff66ffd640 1 --2- 172.21.15.79:0/3012884137 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff68161b90 0x7eff680d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.746+0000 7eff65ffb640 1 -- 172.21.15.79:0/3012884137 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 978427617 0 0) 0x7eff680ceed0 con 0x7eff680d0a60 2024-04-25T02:17:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.746+0000 7eff667fc640 1 --2- 172.21.15.79:0/3012884137 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff68161b90 0x7eff680d2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.746+0000 7eff667fc640 1 -- 172.21.15.79:0/3012884137 >> v1:172.21.15.79:6789/0 conn(0x7eff680d0a60 legacy=0x7eff680b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.746+0000 7eff667fc640 1 -- 172.21.15.79:0/3012884137 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff680cf1b0 con 0x7eff680d47e0 2024-04-25T02:17:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.747+0000 7eff667fc640 1 --2- 172.21.15.79:0/3012884137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff680d47e0 0x7eff680cfc90 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0097a0 tx=0x7eff5c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e66867e409cf78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.747+0000 7eff65ffb640 1 -- 172.21.15.79:0/3012884137 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c037070 con 0x7eff680d47e0 2024-04-25T02:17:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.747+0000 7eff65ffb640 1 -- 172.21.15.79:0/3012884137 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff5c032440 con 0x7eff680d47e0 2024-04-25T02:17:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.747+0000 7eff65ffb640 1 -- 172.21.15.79:0/3012884137 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c032810 con 0x7eff680d47e0 2024-04-25T02:17:54.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.748+0000 7eff6d5db640 1 -- 172.21.15.79:0/3012884137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff680d47e0 msgr2=0x7eff680cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:54.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.748+0000 7eff6d5db640 1 --2- 172.21.15.79:0/3012884137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff680d47e0 0x7eff680cfc90 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0097a0 tx=0x7eff5c02a180 comp rx=0 tx=0).stop 2024-04-25T02:17:54.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.748+0000 7eff6d5db640 1 -- 172.21.15.79:0/3012884137 shutdown_connections 2024-04-25T02:17:54.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.748+0000 7eff6d5db640 1 --2- 172.21.15.79:0/3012884137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff680d47e0 0x7eff680cfc90 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:54.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.748+0000 7eff6d5db640 1 --2- 172.21.15.79:0/3012884137 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff68161b90 0x7eff680d2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:54.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.748+0000 7eff6d5db640 1 -- 172.21.15.79:0/3012884137 >> 172.21.15.79:0/3012884137 conn(0x7eff6809d460 msgr2=0x7eff680d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:54.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.748+0000 7eff6d5db640 1 -- 172.21.15.79:0/3012884137 shutdown_connections 2024-04-25T02:17:54.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.748+0000 7eff6d5db640 1 -- 172.21.15.79:0/3012884137 wait complete. 2024-04-25T02:17:54.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.749+0000 7eff6d5db640 1 Processor -- start 2024-04-25T02:17:54.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.749+0000 7eff6d5db640 1 -- start start 2024-04-25T02:17:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff6d5db640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff680d0a60 0x7eff6814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff6d5db640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff680d47e0 0x7eff680cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff6d5db640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff68161b90 0x7eff680cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff6d5db640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7eff680d4c40 con 0x7eff680d47e0 2024-04-25T02:17:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff6d5db640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7eff680cf770 con 0x7eff680d0a60 2024-04-25T02:17:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff6d5db640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7eff680d01d0 con 0x7eff68161b90 2024-04-25T02:17:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff667fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff680d47e0 0x7eff680cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff667fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff680d47e0 0x7eff680cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56484/0 (socket says 172.21.15.79:56484) 2024-04-25T02:17:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff667fc640 1 -- 172.21.15.79:0/3308322465 learned_addr learned my addr 172.21.15.79:0/3308322465 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff667fc640 1 -- 172.21.15.79:0/3308322465 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff68161b90 msgr2=0x7eff680cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff667fc640 1 --2- 172.21.15.79:0/3308322465 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff68161b90 0x7eff680cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff66ffd640 1 --2- 172.21.15.79:0/3308322465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff680d0a60 0x7eff6814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff667fc640 1 -- 172.21.15.79:0/3308322465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff680d0a60 msgr2=0x7eff6814f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff667fc640 1 --2- 172.21.15.79:0/3308322465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff680d0a60 0x7eff6814f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff667fc640 1 -- 172.21.15.79:0/3308322465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff680cbcf0 con 0x7eff680d47e0 2024-04-25T02:17:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff66ffd640 1 --2- 172.21.15.79:0/3308322465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff680d0a60 0x7eff6814f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff667fc640 1 --2- 172.21.15.79:0/3308322465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff680d47e0 0x7eff680cb1a0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7eff5c035040 tx=0x7eff5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff4f7fe640 1 -- 172.21.15.79:0/3308322465 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c037050 con 0x7eff680d47e0 2024-04-25T02:17:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff4f7fe640 1 -- 172.21.15.79:0/3308322465 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff5c038040 con 0x7eff680d47e0 2024-04-25T02:17:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff4f7fe640 1 -- 172.21.15.79:0/3308322465 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c004490 con 0x7eff680d47e0 2024-04-25T02:17:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff6d5db640 1 -- 172.21.15.79:0/3308322465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff680cbfd0 con 0x7eff680d47e0 2024-04-25T02:17:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.750+0000 7eff6d5db640 1 -- 172.21.15.79:0/3308322465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff680cc590 con 0x7eff680d47e0 2024-04-25T02:17:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.752+0000 7eff6d5db640 1 -- 172.21.15.79:0/3308322465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff680690a0 con 0x7eff680d47e0 2024-04-25T02:17:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.752+0000 7eff4f7fe640 1 -- 172.21.15.79:0/3308322465 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff5c030980 con 0x7eff680d47e0 2024-04-25T02:17:54.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.752+0000 7eff4f7fe640 1 --2- 172.21.15.79:0/3308322465 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7eff5406be30 0x7eff5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:54.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.752+0000 7eff4f7fe640 1 -- 172.21.15.79:0/3308322465 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7eff5c0abb50 con 0x7eff680d47e0 2024-04-25T02:17:54.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.752+0000 7eff66ffd640 1 --2- 172.21.15.79:0/3308322465 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7eff5406be30 0x7eff5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:54.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.753+0000 7eff66ffd640 1 --2- 172.21.15.79:0/3308322465 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7eff5406be30 0x7eff5406e2f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7eff5800b820 tx=0x7eff58008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:54.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.757+0000 7eff4f7fe640 1 -- 172.21.15.79:0/3308322465 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7eff5c07a590 con 0x7eff680d47e0 2024-04-25T02:17:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.929+0000 7eff6d5db640 1 -- 172.21.15.79:0/3308322465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff680b0f60 con 0x7eff680d47e0 2024-04-25T02:17:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.930+0000 7eff4f7fe640 1 -- 172.21.15.79:0/3308322465 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16861 (secure 0 0 0) 0x7eff5c079e90 con 0x7eff680d47e0 2024-04-25T02:17:54.935 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:54.935 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":118,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:17:47.006942+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:17:32.207579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T02:17:32.929915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.b","mappings":[{"from":0,"to":2}]},{"pgid":"17.34","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/2134535107":"2024-04-26T02:17:47.006917+0000","172.21.15.79:6836/2134535107":"2024-04-26T02:17:47.006917+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:17:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.932+0000 7eff6d5db640 1 -- 172.21.15.79:0/3308322465 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7eff5406be30 msgr2=0x7eff5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.932+0000 7eff6d5db640 1 --2- 172.21.15.79:0/3308322465 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7eff5406be30 0x7eff5406e2f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7eff5800b820 tx=0x7eff58008040 comp rx=0 tx=0).stop 2024-04-25T02:17:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.932+0000 7eff6d5db640 1 -- 172.21.15.79:0/3308322465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff680d47e0 msgr2=0x7eff680cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.932+0000 7eff6d5db640 1 --2- 172.21.15.79:0/3308322465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff680d47e0 0x7eff680cb1a0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7eff5c035040 tx=0x7eff5c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.932+0000 7eff6d5db640 1 -- 172.21.15.79:0/3308322465 shutdown_connections 2024-04-25T02:17:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.932+0000 7eff6d5db640 1 --2- 172.21.15.79:0/3308322465 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7eff5406be30 0x7eff5406e2f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.932+0000 7eff6d5db640 1 --2- 172.21.15.79:0/3308322465 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff68161b90 0x7eff680cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.932+0000 7eff6d5db640 1 --2- 172.21.15.79:0/3308322465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff680d47e0 0x7eff680cb1a0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.932+0000 7eff6d5db640 1 --2- 172.21.15.79:0/3308322465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff680d0a60 0x7eff6814f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.932+0000 7eff6d5db640 1 -- 172.21.15.79:0/3308322465 >> 172.21.15.79:0/3308322465 conn(0x7eff6809d460 msgr2=0x7eff680d2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.932+0000 7eff6d5db640 1 -- 172.21.15.79:0/3308322465 shutdown_connections 2024-04-25T02:17:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:54.932+0000 7eff6d5db640 1 -- 172.21.15.79:0/3308322465 wait complete. 2024-04-25T02:17:54.948 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:17:32.207579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:17:32.929915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:17:54.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:17:55.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.042+0000 7fc2d0b61640 1 Processor -- start 2024-04-25T02:17:55.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.042+0000 7fc2d0b61640 1 -- start start 2024-04-25T02:17:55.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.043+0000 7fc2d0b61640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2cc0cf7a0 0x7fc2cc0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.043+0000 7fc2d0b61640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2cc06e6b0 0x7fc2cc15b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.043+0000 7fc2d0b61640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2cc15ec20 con 0x7fc2cc06b2f0 2024-04-25T02:17:55.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.043+0000 7fc2d0b61640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc2cc15f830 con 0x7fc2cc06e6b0 2024-04-25T02:17:55.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.043+0000 7fc2d0b61640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc2cc15ef00 con 0x7fc2cc0cf7a0 2024-04-25T02:17:55.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.043+0000 7fc2cad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2cc06e6b0 0x7fc2cc15b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.043+0000 7fc2ca59c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc2cc06b2f0 0x7fc2cc06b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34496/0 (socket says 172.21.15.79:34496) 2024-04-25T02:17:55.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.043+0000 7fc2ca59c640 1 -- 172.21.15.79:0/3268308536 learned_addr learned my addr 172.21.15.79:0/3268308536 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:55.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.043+0000 7fc2c9d9b640 1 --2- 172.21.15.79:0/3268308536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2cc0cf7a0 0x7fc2cc0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.043+0000 7fc2cad9d640 1 -- 172.21.15.79:0/3268308536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2cc0cf7a0 msgr2=0x7fc2cc0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:55.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.043+0000 7fc2cad9d640 1 --2- 172.21.15.79:0/3268308536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2cc0cf7a0 0x7fc2cc0b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.043+0000 7fc2cad9d640 1 -- 172.21.15.79:0/3268308536 >> v1:172.21.15.79:6789/0 conn(0x7fc2cc06b2f0 legacy=0x7fc2cc06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.043+0000 7fc2cad9d640 1 -- 172.21.15.79:0/3268308536 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2cc15f1e0 con 0x7fc2cc06e6b0 2024-04-25T02:17:55.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.044+0000 7fc2cad9d640 1 --2- 172.21.15.79:0/3268308536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2cc06e6b0 0x7fc2cc15b2d0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400bfa0 tx=0x7fc2c402c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa44b0ecfe683e5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:55.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.045+0000 7fc2c959a640 1 -- 172.21.15.79:0/3268308536 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4038070 con 0x7fc2cc06e6b0 2024-04-25T02:17:55.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.045+0000 7fc2c959a640 1 -- 172.21.15.79:0/3268308536 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c4009540 con 0x7fc2cc06e6b0 2024-04-25T02:17:55.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.045+0000 7fc2c959a640 1 -- 172.21.15.79:0/3268308536 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4009910 con 0x7fc2cc06e6b0 2024-04-25T02:17:55.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.046+0000 7fc2d0b61640 1 -- 172.21.15.79:0/3268308536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2cc06e6b0 msgr2=0x7fc2cc15b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.046+0000 7fc2d0b61640 1 --2- 172.21.15.79:0/3268308536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2cc06e6b0 0x7fc2cc15b2d0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400bfa0 tx=0x7fc2c402c7e0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.046+0000 7fc2d0b61640 1 -- 172.21.15.79:0/3268308536 shutdown_connections 2024-04-25T02:17:55.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.046+0000 7fc2d0b61640 1 --2- 172.21.15.79:0/3268308536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2cc06e6b0 0x7fc2cc15b2d0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.046+0000 7fc2d0b61640 1 --2- 172.21.15.79:0/3268308536 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2cc0cf7a0 0x7fc2cc0b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.046+0000 7fc2d0b61640 1 -- 172.21.15.79:0/3268308536 >> 172.21.15.79:0/3268308536 conn(0x7fc2cc0b1cd0 msgr2=0x7fc2cc0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:55.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.046+0000 7fc2d0b61640 1 -- 172.21.15.79:0/3268308536 shutdown_connections 2024-04-25T02:17:55.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.046+0000 7fc2d0b61640 1 -- 172.21.15.79:0/3268308536 wait complete. 2024-04-25T02:17:55.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.047+0000 7fc2d0b61640 1 Processor -- start 2024-04-25T02:17:55.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.047+0000 7fc2d0b61640 1 -- start start 2024-04-25T02:17:55.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2d0b61640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2cc06b2f0 0x7fc2cc1f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2d0b61640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2cc06e6b0 0x7fc2cc0ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2d0b61640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2cc0cf7a0 0x7fc2cc1f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2d0b61640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc06d160 con 0x7fc2cc0cf7a0 2024-04-25T02:17:55.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2d0b61640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc06cfe0 con 0x7fc2cc06b2f0 2024-04-25T02:17:55.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2d0b61640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc2cc15b810 con 0x7fc2cc06e6b0 2024-04-25T02:17:55.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2cad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2cc0cf7a0 0x7fc2cc1f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2cad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2cc0cf7a0 0x7fc2cc1f5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56508/0 (socket says 172.21.15.79:56508) 2024-04-25T02:17:55.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2cad9d640 1 -- 172.21.15.79:0/734706485 learned_addr learned my addr 172.21.15.79:0/734706485 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:55.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2ca59c640 1 --2- 172.21.15.79:0/734706485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2cc06b2f0 0x7fc2cc1f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2c9d9b640 1 --2- 172.21.15.79:0/734706485 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2cc06e6b0 0x7fc2cc0ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2cad9d640 1 -- 172.21.15.79:0/734706485 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2cc06e6b0 msgr2=0x7fc2cc0ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2cad9d640 1 --2- 172.21.15.79:0/734706485 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2cc06e6b0 0x7fc2cc0ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2cad9d640 1 -- 172.21.15.79:0/734706485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2cc06b2f0 msgr2=0x7fc2cc1f53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2cad9d640 1 --2- 172.21.15.79:0/734706485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2cc06b2f0 0x7fc2cc1f53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2cad9d640 1 -- 172.21.15.79:0/734706485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2cc0c9880 con 0x7fc2cc0cf7a0 2024-04-25T02:17:55.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.048+0000 7fc2cad9d640 1 --2- 172.21.15.79:0/734706485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2cc0cf7a0 0x7fc2cc1f5a40 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4036040 tx=0x7fc2c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:55.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.049+0000 7fc2baffd640 1 -- 172.21.15.79:0/734706485 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4038040 con 0x7fc2cc0cf7a0 2024-04-25T02:17:55.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.049+0000 7fc2baffd640 1 -- 172.21.15.79:0/734706485 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c40092b0 con 0x7fc2cc0cf7a0 2024-04-25T02:17:55.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.049+0000 7fc2baffd640 1 -- 172.21.15.79:0/734706485 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c403e870 con 0x7fc2cc0cf7a0 2024-04-25T02:17:55.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.049+0000 7fc2d0b61640 1 -- 172.21.15.79:0/734706485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2cc0ae8a0 con 0x7fc2cc0cf7a0 2024-04-25T02:17:55.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.049+0000 7fc2d0b61640 1 -- 172.21.15.79:0/734706485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2cc0aee60 con 0x7fc2cc0cf7a0 2024-04-25T02:17:55.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.050+0000 7fc2d0b61640 1 -- 172.21.15.79:0/734706485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2cc0690a0 con 0x7fc2cc0cf7a0 2024-04-25T02:17:55.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.050+0000 7fc2baffd640 1 -- 172.21.15.79:0/734706485 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2c403ea10 con 0x7fc2cc0cf7a0 2024-04-25T02:17:55.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.050+0000 7fc2baffd640 1 --2- 172.21.15.79:0/734706485 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2ac06be30 0x7fc2ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.051+0000 7fc2baffd640 1 -- 172.21.15.79:0/734706485 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7fc2c40aba60 con 0x7fc2cc0cf7a0 2024-04-25T02:17:55.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.051+0000 7fc2ca59c640 1 --2- 172.21.15.79:0/734706485 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2ac06be30 0x7fc2ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.051+0000 7fc2ca59c640 1 --2- 172.21.15.79:0/734706485 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2ac06be30 0x7fc2ac06e2f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc007fd0 tx=0x7fc2bc007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:55.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.055+0000 7fc2baffd640 1 -- 172.21.15.79:0/734706485 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc2c403ed00 con 0x7fc2cc0cf7a0 2024-04-25T02:17:55.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.228+0000 7fc2d0b61640 1 -- 172.21.15.79:0/734706485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc2cc0cf4f0 con 0x7fc2cc0cf7a0 2024-04-25T02:17:55.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.228+0000 7fc2baffd640 1 -- 172.21.15.79:0/734706485 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) ==== 93+0+10 (secure 0 0 0) 0x7fc2c4079e60 con 0x7fc2cc0cf7a0 2024-04-25T02:17:55.234 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:17:55.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.230+0000 7fc2d0b61640 1 -- 172.21.15.79:0/734706485 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2ac06be30 msgr2=0x7fc2ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.230+0000 7fc2d0b61640 1 --2- 172.21.15.79:0/734706485 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2ac06be30 0x7fc2ac06e2f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc007fd0 tx=0x7fc2bc007e80 comp rx=0 tx=0).stop 2024-04-25T02:17:55.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.230+0000 7fc2d0b61640 1 -- 172.21.15.79:0/734706485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2cc0cf7a0 msgr2=0x7fc2cc1f5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.230+0000 7fc2d0b61640 1 --2- 172.21.15.79:0/734706485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2cc0cf7a0 0x7fc2cc1f5a40 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4036040 tx=0x7fc2c4004a40 comp rx=0 tx=0).stop 2024-04-25T02:17:55.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.230+0000 7fc2d0b61640 1 -- 172.21.15.79:0/734706485 shutdown_connections 2024-04-25T02:17:55.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.230+0000 7fc2d0b61640 1 --2- 172.21.15.79:0/734706485 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2ac06be30 0x7fc2ac06e2f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.230+0000 7fc2d0b61640 1 --2- 172.21.15.79:0/734706485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2cc0cf7a0 0x7fc2cc1f5a40 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.230+0000 7fc2d0b61640 1 --2- 172.21.15.79:0/734706485 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc2cc06e6b0 0x7fc2cc0ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.230+0000 7fc2d0b61640 1 --2- 172.21.15.79:0/734706485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2cc06b2f0 0x7fc2cc1f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.230+0000 7fc2d0b61640 1 -- 172.21.15.79:0/734706485 >> 172.21.15.79:0/734706485 conn(0x7fc2cc0b1cd0 msgr2=0x7fc2cc1588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:55.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.230+0000 7fc2d0b61640 1 -- 172.21.15.79:0/734706485 shutdown_connections 2024-04-25T02:17:55.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.230+0000 7fc2d0b61640 1 -- 172.21.15.79:0/734706485 wait complete. 2024-04-25T02:17:55.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:17:55.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.340+0000 7f861862a640 1 Processor -- start 2024-04-25T02:17:55.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.340+0000 7f861862a640 1 -- start start 2024-04-25T02:17:55.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.341+0000 7f861862a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f861015e4f0 0x7f86100d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.341+0000 7f861862a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86100d1ee0 con 0x7f86100cf7f0 2024-04-25T02:17:55.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.341+0000 7f861862a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86100d21c0 con 0x7f86100d10c0 2024-04-25T02:17:55.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.341+0000 7f861862a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f86100d24a0 con 0x7f861015e4f0 2024-04-25T02:17:55.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.341+0000 7f8615bc5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f86100cf7f0 0x7f86100d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34500/0 (socket says 172.21.15.79:34500) 2024-04-25T02:17:55.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.341+0000 7f8615bc5640 1 -- 172.21.15.79:0/3010622755 learned_addr learned my addr 172.21.15.79:0/3010622755 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86153c4640 1 -- 172.21.15.79:0/3010622755 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415420838 0 0) 0x7f86100d1ee0 con 0x7f86100cf7f0 2024-04-25T02:17:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86153c4640 1 -- 172.21.15.79:0/3010622755 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85fc003520 con 0x7f86100cf7f0 2024-04-25T02:17:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86163c6640 1 --2- 172.21.15.79:0/3010622755 >> v2:172.21.15.189:3300/0 conn(0x7f861015e4f0 0x7f86100d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86153c4640 1 -- 172.21.15.79:0/3010622755 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3053482642 0 0) 0x7f85fc003520 con 0x7f86100cf7f0 2024-04-25T02:17:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86153c4640 1 -- 172.21.15.79:0/3010622755 >> v2:172.21.15.189:3300/0 conn(0x7f861015e4f0 msgr2=0x7f86100d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86153c4640 1 --2- 172.21.15.79:0/3010622755 >> v2:172.21.15.189:3300/0 conn(0x7f861015e4f0 0x7f86100d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86153c4640 1 -- 172.21.15.79:0/3010622755 >> v1:172.21.15.189:6789/0 conn(0x7f86100d10c0 legacy=0x7f861006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86153c4640 1 -- 172.21.15.79:0/3010622755 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86100d2780 con 0x7f86100cf7f0 2024-04-25T02:17:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86153c4640 1 -- 172.21.15.79:0/3010622755 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f8600001670 con 0x7f86100cf7f0 2024-04-25T02:17:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86153c4640 1 -- 172.21.15.79:0/3010622755 >> v1:172.21.15.79:6789/0 conn(0x7f86100cf7f0 legacy=0x7f86100d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86153c4640 1 --2- 172.21.15.79:0/3010622755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85fc0039b0 0x7f85fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86153c4640 1 --2- 172.21.15.79:0/3010622755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85fc004800 0x7f85fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86153c4640 1 --2- 172.21.15.79:0/3010622755 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85fc0051c0 0x7f85fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86153c4640 1 -- 172.21.15.79:0/3010622755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f86100d24a0 con 0x7f85fc0039b0 2024-04-25T02:17:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86153c4640 1 -- 172.21.15.79:0/3010622755 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc00c110 con 0x7f85fc004800 2024-04-25T02:17:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86153c4640 1 -- 172.21.15.79:0/3010622755 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f85fc00c310 con 0x7f85fc0051c0 2024-04-25T02:17:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86163c6640 1 --2- 172.21.15.79:0/3010622755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85fc0039b0 0x7f85fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f8615bc5640 1 --2- 172.21.15.79:0/3010622755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85fc004800 0x7f85fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f8616bc7640 1 --2- 172.21.15.79:0/3010622755 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85fc0051c0 0x7f85fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86163c6640 1 -- 172.21.15.79:0/3010622755 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85fc0051c0 msgr2=0x7f85fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86163c6640 1 --2- 172.21.15.79:0/3010622755 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85fc0051c0 0x7f85fc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86163c6640 1 -- 172.21.15.79:0/3010622755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85fc004800 msgr2=0x7f85fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86163c6640 1 --2- 172.21.15.79:0/3010622755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85fc004800 0x7f85fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f86163c6640 1 -- 172.21.15.79:0/3010622755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85fc003520 con 0x7f85fc0039b0 2024-04-25T02:17:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.342+0000 7f8616bc7640 1 -- 172.21.15.79:0/3010622755 reap_dead start 2024-04-25T02:17:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.343+0000 7f86163c6640 1 --2- 172.21.15.79:0/3010622755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85fc0039b0 0x7f85fc003dd0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f860c00ba30 tx=0x7f85fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bf2ccba92fbd4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.343+0000 7f86153c4640 1 -- 172.21.15.79:0/3010622755 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c030070 con 0x7f85fc0039b0 2024-04-25T02:17:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.343+0000 7f86153c4640 1 -- 172.21.15.79:0/3010622755 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f860c02ae00 con 0x7f85fc0039b0 2024-04-25T02:17:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.343+0000 7f86153c4640 1 -- 172.21.15.79:0/3010622755 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c00b600 con 0x7f85fc0039b0 2024-04-25T02:17:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.344+0000 7f861862a640 1 -- 172.21.15.79:0/3010622755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85fc0039b0 msgr2=0x7f85fc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.344+0000 7f861862a640 1 --2- 172.21.15.79:0/3010622755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85fc0039b0 0x7f85fc003dd0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f860c00ba30 tx=0x7f85fc005830 comp rx=0 tx=0).stop 2024-04-25T02:17:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.344+0000 7f861862a640 1 -- 172.21.15.79:0/3010622755 shutdown_connections 2024-04-25T02:17:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.344+0000 7f861862a640 1 --2- 172.21.15.79:0/3010622755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85fc0039b0 0x7f85fc003dd0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.344+0000 7f861862a640 1 -- 172.21.15.79:0/3010622755 >> 172.21.15.79:0/3010622755 conn(0x7f861009d4a0 msgr2=0x7f86100d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.344+0000 7f861862a640 1 -- 172.21.15.79:0/3010622755 shutdown_connections 2024-04-25T02:17:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.344+0000 7f861862a640 1 -- 172.21.15.79:0/3010622755 wait complete. 2024-04-25T02:17:55.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.345+0000 7f861862a640 1 Processor -- start 2024-04-25T02:17:55.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.345+0000 7f861862a640 1 -- start start 2024-04-25T02:17:55.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f861862a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85fc0039b0 0x7f8610157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f861862a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86100cdd70 0x7f8610156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f861862a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f861015a4f0 0x7f861015a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f861862a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f86100cfc80 con 0x7f861015a4f0 2024-04-25T02:17:55.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f861862a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f86100d50f0 con 0x7f86100cdd70 2024-04-25T02:17:55.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f861862a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f86100cfe00 con 0x7f85fc0039b0 2024-04-25T02:17:55.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f8616bc7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f861015a4f0 0x7f861015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f8616bc7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f861015a4f0 0x7f861015a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56526/0 (socket says 172.21.15.79:56526) 2024-04-25T02:17:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f8616bc7640 1 -- 172.21.15.79:0/1572408396 learned_addr learned my addr 172.21.15.79:0/1572408396 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f86163c6640 1 --2- 172.21.15.79:0/1572408396 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85fc0039b0 0x7f8610157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f8615bc5640 1 --2- 172.21.15.79:0/1572408396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86100cdd70 0x7f8610156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f8616bc7640 1 -- 172.21.15.79:0/1572408396 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85fc0039b0 msgr2=0x7f8610157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f8616bc7640 1 --2- 172.21.15.79:0/1572408396 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85fc0039b0 0x7f8610157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f8616bc7640 1 -- 172.21.15.79:0/1572408396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86100cdd70 msgr2=0x7f8610156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f8616bc7640 1 --2- 172.21.15.79:0/1572408396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86100cdd70 0x7f8610156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f8616bc7640 1 -- 172.21.15.79:0/1572408396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8610159730 con 0x7f861015a4f0 2024-04-25T02:17:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f8616bc7640 1 --2- 172.21.15.79:0/1572408396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f861015a4f0 0x7f861015a950 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f86100d3ff0 tx=0x7f860800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f8606ffd640 1 -- 172.21.15.79:0/1572408396 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8608006b50 con 0x7f861015a4f0 2024-04-25T02:17:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f8606ffd640 1 -- 172.21.15.79:0/1572408396 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8608006cf0 con 0x7f861015a4f0 2024-04-25T02:17:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f861862a640 1 -- 172.21.15.79:0/1572408396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8610159a10 con 0x7f861015a4f0 2024-04-25T02:17:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f8606ffd640 1 -- 172.21.15.79:0/1572408396 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8608003970 con 0x7f861015a4f0 2024-04-25T02:17:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.346+0000 7f861862a640 1 -- 172.21.15.79:0/1572408396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8610159390 con 0x7f861015a4f0 2024-04-25T02:17:55.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.347+0000 7f861862a640 1 -- 172.21.15.79:0/1572408396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86100686c0 con 0x7f861015a4f0 2024-04-25T02:17:55.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.348+0000 7f8606ffd640 1 -- 172.21.15.79:0/1572408396 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f860801a020 con 0x7f861015a4f0 2024-04-25T02:17:55.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.348+0000 7f8606ffd640 1 --2- 172.21.15.79:0/1572408396 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85f406be30 0x7f85f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.348+0000 7f86163c6640 1 --2- 172.21.15.79:0/1572408396 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85f406be30 0x7f85f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.348+0000 7f8606ffd640 1 -- 172.21.15.79:0/1572408396 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7f860808a440 con 0x7f861015a4f0 2024-04-25T02:17:55.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.349+0000 7f86163c6640 1 --2- 172.21.15.79:0/1572408396 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85f406be30 0x7f85f406e2f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f860c00ba00 tx=0x7f860c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:55.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.353+0000 7f8606ffd640 1 -- 172.21.15.79:0/1572408396 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8608058df0 con 0x7f861015a4f0 2024-04-25T02:17:55.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.524+0000 7f861862a640 1 -- 172.21.15.79:0/1572408396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f861015dd10 con 0x7f861015a4f0 2024-04-25T02:17:55.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.524+0000 7f8606ffd640 1 -- 172.21.15.79:0/1572408396 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v118) ==== 104+0+11 (secure 0 0 0) 0x7f86080586f0 con 0x7f861015a4f0 2024-04-25T02:17:55.530 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:17:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.526+0000 7f861862a640 1 -- 172.21.15.79:0/1572408396 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85f406be30 msgr2=0x7f85f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.526+0000 7f861862a640 1 --2- 172.21.15.79:0/1572408396 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85f406be30 0x7f85f406e2f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f860c00ba00 tx=0x7f860c030000 comp rx=0 tx=0).stop 2024-04-25T02:17:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.526+0000 7f861862a640 1 -- 172.21.15.79:0/1572408396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f861015a4f0 msgr2=0x7f861015a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.526+0000 7f861862a640 1 --2- 172.21.15.79:0/1572408396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f861015a4f0 0x7f861015a950 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f86100d3ff0 tx=0x7f860800eb90 comp rx=0 tx=0).stop 2024-04-25T02:17:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.526+0000 7f861862a640 1 -- 172.21.15.79:0/1572408396 shutdown_connections 2024-04-25T02:17:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.526+0000 7f861862a640 1 --2- 172.21.15.79:0/1572408396 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f85f406be30 0x7f85f406e2f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.526+0000 7f861862a640 1 --2- 172.21.15.79:0/1572408396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f861015a4f0 0x7f861015a950 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.526+0000 7f861862a640 1 --2- 172.21.15.79:0/1572408396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86100cdd70 0x7f8610156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.526+0000 7f861862a640 1 --2- 172.21.15.79:0/1572408396 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f85fc0039b0 0x7f8610157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.526+0000 7f861862a640 1 -- 172.21.15.79:0/1572408396 >> 172.21.15.79:0/1572408396 conn(0x7f861009d4a0 msgr2=0x7f8610157110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.527+0000 7f861862a640 1 -- 172.21.15.79:0/1572408396 shutdown_connections 2024-04-25T02:17:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.527+0000 7f861862a640 1 -- 172.21.15.79:0/1572408396 wait complete. 2024-04-25T02:17:55.542 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:17:55.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.636+0000 7f675bb7d640 1 Processor -- start 2024-04-25T02:17:55.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.636+0000 7f675bb7d640 1 -- start start 2024-04-25T02:17:55.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.637+0000 7f675bb7d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f675409dcb0 0x7f6754070d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.637+0000 7f675bb7d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f675415abf0 con 0x7f675415a810 2024-04-25T02:17:55.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.637+0000 7f675bb7d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67540ce580 con 0x7f67540cf380 2024-04-25T02:17:55.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.637+0000 7f675bb7d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6754073050 con 0x7f675409dcb0 2024-04-25T02:17:55.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.637+0000 7f6759919640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f675415a810 0x7f67540cc820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34516/0 (socket says 172.21.15.79:34516) 2024-04-25T02:17:55.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.637+0000 7f6759919640 1 -- 172.21.15.79:0/561389980 learned_addr learned my addr 172.21.15.79:0/561389980 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:55.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.637+0000 7f6758917640 1 -- 172.21.15.79:0/561389980 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4102345479 0 0) 0x7f675415abf0 con 0x7f675415a810 2024-04-25T02:17:55.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.637+0000 7f6758917640 1 -- 172.21.15.79:0/561389980 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6740003520 con 0x7f675415a810 2024-04-25T02:17:55.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.637+0000 7f6759118640 1 --2- 172.21.15.79:0/561389980 >> v2:172.21.15.189:3300/0 conn(0x7f675409dcb0 0x7f6754070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f6758917640 1 -- 172.21.15.79:0/561389980 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4043704804 0 0) 0x7f6740003520 con 0x7f675415a810 2024-04-25T02:17:55.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f6758917640 1 -- 172.21.15.79:0/561389980 >> v2:172.21.15.189:3300/0 conn(0x7f675409dcb0 msgr2=0x7f6754070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:55.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f6758917640 1 --2- 172.21.15.79:0/561389980 >> v2:172.21.15.189:3300/0 conn(0x7f675409dcb0 0x7f6754070d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f6758917640 1 -- 172.21.15.79:0/561389980 >> v1:172.21.15.189:6789/0 conn(0x7f67540cf380 legacy=0x7f67540b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f6758917640 1 -- 172.21.15.79:0/561389980 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67540ce860 con 0x7f675415a810 2024-04-25T02:17:55.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f6758917640 1 -- 172.21.15.79:0/561389980 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f6750001670 con 0x7f675415a810 2024-04-25T02:17:55.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f6758917640 1 -- 172.21.15.79:0/561389980 >> v1:172.21.15.79:6789/0 conn(0x7f675415a810 legacy=0x7f67540cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f6758917640 1 --2- 172.21.15.79:0/561389980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67400039b0 0x7f6740003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f6758917640 1 --2- 172.21.15.79:0/561389980 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6740004800 0x7f6740004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f6758917640 1 --2- 172.21.15.79:0/561389980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67400053c0 0x7f674000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f6758917640 1 -- 172.21.15.79:0/561389980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f674000c220 con 0x7f67400053c0 2024-04-25T02:17:55.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f6758917640 1 -- 172.21.15.79:0/561389980 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f674000c3d0 con 0x7f67400039b0 2024-04-25T02:17:55.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f6758917640 1 -- 172.21.15.79:0/561389980 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f674000c5d0 con 0x7f6740004800 2024-04-25T02:17:55.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f675a11a640 1 --2- 172.21.15.79:0/561389980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67400053c0 0x7f674000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f6759919640 1 --2- 172.21.15.79:0/561389980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67400039b0 0x7f6740003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f6759118640 1 --2- 172.21.15.79:0/561389980 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6740004800 0x7f6740004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f675a11a640 1 -- 172.21.15.79:0/561389980 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6740004800 msgr2=0x7f6740004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:55.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f675a11a640 1 --2- 172.21.15.79:0/561389980 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6740004800 0x7f6740004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f675a11a640 1 -- 172.21.15.79:0/561389980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67400039b0 msgr2=0x7f6740003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:55.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f675a11a640 1 --2- 172.21.15.79:0/561389980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67400039b0 0x7f6740003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.638+0000 7f675a11a640 1 -- 172.21.15.79:0/561389980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6740003520 con 0x7f67400053c0 2024-04-25T02:17:55.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.639+0000 7f675a11a640 1 -- 172.21.15.79:0/561389980 reap_dead start 2024-04-25T02:17:55.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.639+0000 7f675a11a640 1 --2- 172.21.15.79:0/561389980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67400053c0 0x7f674000b9c0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f674c001e50 tx=0x7f6740005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9863e2c329ebfedf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:55.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.639+0000 7f6758917640 1 -- 172.21.15.79:0/561389980 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c001a70 con 0x7f67400053c0 2024-04-25T02:17:55.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.639+0000 7f6758917640 1 -- 172.21.15.79:0/561389980 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f674c003970 con 0x7f67400053c0 2024-04-25T02:17:55.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.639+0000 7f6758917640 1 -- 172.21.15.79:0/561389980 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c003d60 con 0x7f67400053c0 2024-04-25T02:17:55.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.639+0000 7f675bb7d640 1 -- 172.21.15.79:0/561389980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67400053c0 msgr2=0x7f674000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.639+0000 7f675bb7d640 1 --2- 172.21.15.79:0/561389980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67400053c0 0x7f674000b9c0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f674c001e50 tx=0x7f6740005830 comp rx=0 tx=0).stop 2024-04-25T02:17:55.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.639+0000 7f675bb7d640 1 -- 172.21.15.79:0/561389980 shutdown_connections 2024-04-25T02:17:55.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.639+0000 7f675bb7d640 1 --2- 172.21.15.79:0/561389980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67400053c0 0x7f674000b9c0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.639+0000 7f675bb7d640 1 -- 172.21.15.79:0/561389980 >> 172.21.15.79:0/561389980 conn(0x7f67540b1cd0 msgr2=0x7f67540b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:55.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.640+0000 7f675bb7d640 1 -- 172.21.15.79:0/561389980 shutdown_connections 2024-04-25T02:17:55.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.640+0000 7f675bb7d640 1 -- 172.21.15.79:0/561389980 wait complete. 2024-04-25T02:17:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.641+0000 7f675bb7d640 1 Processor -- start 2024-04-25T02:17:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.641+0000 7f675bb7d640 1 -- start start 2024-04-25T02:17:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.641+0000 7f675bb7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67400053c0 0x7f675406cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.641+0000 7f675bb7d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6754148b10 0x7f6754070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.641+0000 7f675bb7d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6754157e00 0x7f6754141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.641+0000 7f675bb7d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f67540cc020 con 0x7f67400053c0 2024-04-25T02:17:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.641+0000 7f675bb7d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67540cbdd0 con 0x7f6754148b10 2024-04-25T02:17:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.641+0000 7f675bb7d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f67540cc300 con 0x7f6754157e00 2024-04-25T02:17:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.641+0000 7f6759919640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67400053c0 0x7f675406cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.641+0000 7f6759919640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67400053c0 0x7f675406cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56538/0 (socket says 172.21.15.79:56538) 2024-04-25T02:17:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.641+0000 7f6759919640 1 -- 172.21.15.79:0/2488740358 learned_addr learned my addr 172.21.15.79:0/2488740358 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.642+0000 7f6759919640 1 -- 172.21.15.79:0/2488740358 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6754157e00 msgr2=0x7f6754141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.642+0000 7f6759919640 1 --2- 172.21.15.79:0/2488740358 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6754157e00 0x7f6754141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.642+0000 7f6759919640 1 -- 172.21.15.79:0/2488740358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6754148b10 msgr2=0x7f6754070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.642+0000 7f6759919640 1 --2- 172.21.15.79:0/2488740358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6754148b10 0x7f6754070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.642+0000 7f6759919640 1 -- 172.21.15.79:0/2488740358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67541405c0 con 0x7f67400053c0 2024-04-25T02:17:55.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.642+0000 7f6759919640 1 --2- 172.21.15.79:0/2488740358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67400053c0 0x7f675406cd40 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f6750007370 tx=0x7f6750007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:55.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.642+0000 7f674a7fc640 1 -- 172.21.15.79:0/2488740358 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675001a070 con 0x7f67400053c0 2024-04-25T02:17:55.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.642+0000 7f674a7fc640 1 -- 172.21.15.79:0/2488740358 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f675000f940 con 0x7f67400053c0 2024-04-25T02:17:55.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.642+0000 7f674a7fc640 1 -- 172.21.15.79:0/2488740358 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675000fd10 con 0x7f67400053c0 2024-04-25T02:17:55.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.642+0000 7f675bb7d640 1 -- 172.21.15.79:0/2488740358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6754159050 con 0x7f67400053c0 2024-04-25T02:17:55.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.642+0000 7f675bb7d640 1 -- 172.21.15.79:0/2488740358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6754140b40 con 0x7f67400053c0 2024-04-25T02:17:55.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.643+0000 7f675bb7d640 1 -- 172.21.15.79:0/2488740358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67540690a0 con 0x7f67400053c0 2024-04-25T02:17:55.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.643+0000 7f674a7fc640 1 -- 172.21.15.79:0/2488740358 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f675001d070 con 0x7f67400053c0 2024-04-25T02:17:55.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.644+0000 7f674a7fc640 1 --2- 172.21.15.79:0/2488740358 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f673806be60 0x7f673806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.644+0000 7f6759118640 1 --2- 172.21.15.79:0/2488740358 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f673806be60 0x7f673806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.644+0000 7f674a7fc640 1 -- 172.21.15.79:0/2488740358 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7f675008a8b0 con 0x7f67400053c0 2024-04-25T02:17:55.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.644+0000 7f6759118640 1 --2- 172.21.15.79:0/2488740358 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f673806be60 0x7f673806e320 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f6754072da0 tx=0x7f67440040a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:55.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.648+0000 7f674a7fc640 1 -- 172.21.15.79:0/2488740358 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f67500591d0 con 0x7f67400053c0 2024-04-25T02:17:55.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.821+0000 7f675bb7d640 1 -- 172.21.15.79:0/2488740358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f67541578b0 con 0x7f67400053c0 2024-04-25T02:17:55.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.821+0000 7f674a7fc640 1 -- 172.21.15.79:0/2488740358 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v118) ==== 100+0+11 (secure 0 0 0) 0x7f6750058ad0 con 0x7f67400053c0 2024-04-25T02:17:55.827 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:17:55.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.823+0000 7f675bb7d640 1 -- 172.21.15.79:0/2488740358 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f673806be60 msgr2=0x7f673806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.823+0000 7f675bb7d640 1 --2- 172.21.15.79:0/2488740358 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f673806be60 0x7f673806e320 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f6754072da0 tx=0x7f67440040a0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.823+0000 7f675bb7d640 1 -- 172.21.15.79:0/2488740358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67400053c0 msgr2=0x7f675406cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.823+0000 7f675bb7d640 1 --2- 172.21.15.79:0/2488740358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67400053c0 0x7f675406cd40 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f6750007370 tx=0x7f6750007830 comp rx=0 tx=0).stop 2024-04-25T02:17:55.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.823+0000 7f675bb7d640 1 -- 172.21.15.79:0/2488740358 shutdown_connections 2024-04-25T02:17:55.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.823+0000 7f675bb7d640 1 --2- 172.21.15.79:0/2488740358 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f673806be60 0x7f673806e320 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.823+0000 7f675bb7d640 1 --2- 172.21.15.79:0/2488740358 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6754157e00 0x7f6754141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.823+0000 7f675bb7d640 1 --2- 172.21.15.79:0/2488740358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6754148b10 0x7f6754070d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.823+0000 7f675bb7d640 1 --2- 172.21.15.79:0/2488740358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67400053c0 0x7f675406cd40 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.823+0000 7f675bb7d640 1 -- 172.21.15.79:0/2488740358 >> 172.21.15.79:0/2488740358 conn(0x7f67540b1cd0 msgr2=0x7f67540d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:55.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.823+0000 7f675bb7d640 1 -- 172.21.15.79:0/2488740358 shutdown_connections 2024-04-25T02:17:55.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.823+0000 7f675bb7d640 1 -- 172.21.15.79:0/2488740358 wait complete. 2024-04-25T02:17:55.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:17:55.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.931+0000 7f0c58015640 1 Processor -- start 2024-04-25T02:17:55.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.932+0000 7f0c58015640 1 -- start start 2024-04-25T02:17:55.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.932+0000 7f0c58015640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f0c500b3570 0x7f0c500d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.932+0000 7f0c58015640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c5006c380 con 0x7f0c5015e4d0 2024-04-25T02:17:55.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.932+0000 7f0c58015640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c500d1660 con 0x7f0c500b3020 2024-04-25T02:17:55.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c58015640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f0c500d1380 con 0x7f0c500b3570 2024-04-25T02:17:55.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c55db1640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0c5015e4d0 0x7f0c5006bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34518/0 (socket says 172.21.15.79:34518) 2024-04-25T02:17:55.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c55db1640 1 -- 172.21.15.79:0/3279235871 learned_addr learned my addr 172.21.15.79:0/3279235871 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c54daf640 1 -- 172.21.15.79:0/3279235871 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4261346632 0 0) 0x7f0c5006c380 con 0x7f0c5015e4d0 2024-04-25T02:17:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c54daf640 1 -- 172.21.15.79:0/3279235871 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c3c003520 con 0x7f0c5015e4d0 2024-04-25T02:17:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c555b0640 1 --2- 172.21.15.79:0/3279235871 >> v2:172.21.15.189:3300/0 conn(0x7f0c500b3570 0x7f0c500d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c54daf640 1 -- 172.21.15.79:0/3279235871 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 392207039 0 0) 0x7f0c3c003520 con 0x7f0c5015e4d0 2024-04-25T02:17:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c54daf640 1 -- 172.21.15.79:0/3279235871 >> v2:172.21.15.189:3300/0 conn(0x7f0c500b3570 msgr2=0x7f0c500d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c54daf640 1 --2- 172.21.15.79:0/3279235871 >> v2:172.21.15.189:3300/0 conn(0x7f0c500b3570 0x7f0c500d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c54daf640 1 -- 172.21.15.79:0/3279235871 >> v1:172.21.15.189:6789/0 conn(0x7f0c500b3020 legacy=0x7f0c500cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c54daf640 1 -- 172.21.15.79:0/3279235871 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c500cede0 con 0x7f0c5015e4d0 2024-04-25T02:17:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c54daf640 1 -- 172.21.15.79:0/3279235871 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f0c4c001670 con 0x7f0c5015e4d0 2024-04-25T02:17:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c54daf640 1 -- 172.21.15.79:0/3279235871 >> v1:172.21.15.79:6789/0 conn(0x7f0c5015e4d0 legacy=0x7f0c5006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c54daf640 1 --2- 172.21.15.79:0/3279235871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c3c0039e0 0x7f0c3c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c54daf640 1 --2- 172.21.15.79:0/3279235871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c004800 0x7f0c3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c54daf640 1 --2- 172.21.15.79:0/3279235871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c3c005210 0x7f0c3c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c54daf640 1 -- 172.21.15.79:0/3279235871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0c500d1380 con 0x7f0c3c004800 2024-04-25T02:17:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c54daf640 1 -- 172.21.15.79:0/3279235871 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3c00c140 con 0x7f0c3c005210 2024-04-25T02:17:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c54daf640 1 -- 172.21.15.79:0/3279235871 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0c3c00c340 con 0x7f0c3c0039e0 2024-04-25T02:17:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c555b0640 1 --2- 172.21.15.79:0/3279235871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c004800 0x7f0c3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c55db1640 1 --2- 172.21.15.79:0/3279235871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c3c0039e0 0x7f0c3c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.933+0000 7f0c565b2640 1 --2- 172.21.15.79:0/3279235871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c3c005210 0x7f0c3c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.934+0000 7f0c555b0640 1 -- 172.21.15.79:0/3279235871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c3c0039e0 msgr2=0x7f0c3c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.934+0000 7f0c555b0640 1 --2- 172.21.15.79:0/3279235871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c3c0039e0 0x7f0c3c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.934+0000 7f0c555b0640 1 -- 172.21.15.79:0/3279235871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c3c005210 msgr2=0x7f0c3c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.934+0000 7f0c555b0640 1 --2- 172.21.15.79:0/3279235871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c3c005210 0x7f0c3c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.934+0000 7f0c555b0640 1 -- 172.21.15.79:0/3279235871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3c003520 con 0x7f0c3c004800 2024-04-25T02:17:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.934+0000 7f0c565b2640 1 --2- 172.21.15.79:0/3279235871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c3c005210 0x7f0c3c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.934+0000 7f0c565b2640 1 -- 172.21.15.79:0/3279235871 reap_dead start 2024-04-25T02:17:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.934+0000 7f0c555b0640 1 --2- 172.21.15.79:0/3279235871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c004800 0x7f0c3c004c80 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000ba00 tx=0x7f0c3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49bd201f1848107 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.934+0000 7f0c54daf640 1 -- 172.21.15.79:0/3279235871 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40030070 con 0x7f0c3c004800 2024-04-25T02:17:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.934+0000 7f0c54daf640 1 -- 172.21.15.79:0/3279235871 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c4002adb0 con 0x7f0c3c004800 2024-04-25T02:17:55.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.934+0000 7f0c54daf640 1 -- 172.21.15.79:0/3279235871 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4000b600 con 0x7f0c3c004800 2024-04-25T02:17:55.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.935+0000 7f0c58015640 1 -- 172.21.15.79:0/3279235871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c004800 msgr2=0x7f0c3c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.935+0000 7f0c58015640 1 --2- 172.21.15.79:0/3279235871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c004800 0x7f0c3c004c80 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000ba00 tx=0x7f0c3c005830 comp rx=0 tx=0).stop 2024-04-25T02:17:55.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.935+0000 7f0c58015640 1 -- 172.21.15.79:0/3279235871 shutdown_connections 2024-04-25T02:17:55.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.935+0000 7f0c58015640 1 --2- 172.21.15.79:0/3279235871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c004800 0x7f0c3c004c80 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.935+0000 7f0c58015640 1 -- 172.21.15.79:0/3279235871 >> 172.21.15.79:0/3279235871 conn(0x7f0c5009d460 msgr2=0x7f0c500d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:55.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.935+0000 7f0c58015640 1 -- 172.21.15.79:0/3279235871 shutdown_connections 2024-04-25T02:17:55.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.935+0000 7f0c58015640 1 -- 172.21.15.79:0/3279235871 wait complete. 2024-04-25T02:17:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.936+0000 7f0c58015640 1 Processor -- start 2024-04-25T02:17:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.936+0000 7f0c58015640 1 -- start start 2024-04-25T02:17:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c58015640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c3c004800 0x7f0c501f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c58015640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c500a05a0 0x7f0c500d43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c58015640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c500b3b50 0x7f0c5009e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c58015640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0c500d20d0 con 0x7f0c500b3b50 2024-04-25T02:17:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c58015640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5015e8b0 con 0x7f0c500a05a0 2024-04-25T02:17:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c58015640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0c500d2250 con 0x7f0c3c004800 2024-04-25T02:17:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c565b2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c500b3b50 0x7f0c5009e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c565b2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c500b3b50 0x7f0c5009e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56554/0 (socket says 172.21.15.79:56554) 2024-04-25T02:17:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c565b2640 1 -- 172.21.15.79:0/3947169719 learned_addr learned my addr 172.21.15.79:0/3947169719 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c555b0640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c500a05a0 0x7f0c500d43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c55db1640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c3c004800 0x7f0c501f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c565b2640 1 -- 172.21.15.79:0/3947169719 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c3c004800 msgr2=0x7f0c501f7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c565b2640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c3c004800 0x7f0c501f7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c565b2640 1 -- 172.21.15.79:0/3947169719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c500a05a0 msgr2=0x7f0c500d43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c565b2640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c500a05a0 0x7f0c500d43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c565b2640 1 -- 172.21.15.79:0/3947169719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c501f77b0 con 0x7f0c500b3b50 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c55db1640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c3c004800 0x7f0c501f7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c555b0640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c500a05a0 0x7f0c500d43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.937+0000 7f0c565b2640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c500b3b50 0x7f0c5009e600 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f0c500cb190 tx=0x7f0c4800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.938+0000 7f0c467fc640 1 -- 172.21.15.79:0/3947169719 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48003970 con 0x7f0c500b3b50 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.938+0000 7f0c467fc640 1 -- 172.21.15.79:0/3947169719 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c48018070 con 0x7f0c500b3b50 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.938+0000 7f0c58015640 1 -- 172.21.15.79:0/3947169719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c501f7a50 con 0x7f0c500b3b50 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.938+0000 7f0c467fc640 1 -- 172.21.15.79:0/3947169719 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48003d50 con 0x7f0c500b3b50 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.938+0000 7f0c58015640 1 -- 172.21.15.79:0/3947169719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c501f8010 con 0x7f0c500b3b50 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.939+0000 7f0c58015640 1 -- 172.21.15.79:0/3947169719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c500690a0 con 0x7f0c500b3b50 2024-04-25T02:17:55.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.939+0000 7f0c467fc640 1 -- 172.21.15.79:0/3947169719 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c480050d0 con 0x7f0c500b3b50 2024-04-25T02:17:55.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.940+0000 7f0c467fc640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0c3406be60 0x7f0c3406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:55.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.940+0000 7f0c55db1640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0c3406be60 0x7f0c3406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:55.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.940+0000 7f0c467fc640 1 -- 172.21.15.79:0/3947169719 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7f0c4808aa70 con 0x7f0c500b3b50 2024-04-25T02:17:55.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.940+0000 7f0c55db1640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0c3406be60 0x7f0c3406e320 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c000fb0 tx=0x7f0c4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:55.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:55.944+0000 7f0c467fc640 1 -- 172.21.15.79:0/3947169719 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0c48059420 con 0x7f0c500b3b50 2024-04-25T02:17:56.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.132+0000 7f0c58015640 1 -- 172.21.15.79:0/3947169719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0c500d1920 con 0x7f0c500b3b50 2024-04-25T02:17:56.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.132+0000 7f0c467fc640 1 -- 172.21.15.79:0/3947169719 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v118) ==== 80+0+122 (secure 0 0 0) 0x7f0c48058d20 con 0x7f0c500b3b50 2024-04-25T02:17:56.138 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6837/2134535107 2024-04-26T02:17:47.006917+0000 2024-04-25T02:17:56.138 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6836/2134535107 2024-04-26T02:17:47.006917+0000 2024-04-25T02:17:56.138 INFO:teuthology.orchestra.run.smithi079.stderr:listed 2 entries 2024-04-25T02:17:56.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.134+0000 7f0c58015640 1 -- 172.21.15.79:0/3947169719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0c3406be60 msgr2=0x7f0c3406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.134+0000 7f0c58015640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0c3406be60 0x7f0c3406e320 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c000fb0 tx=0x7f0c4c009040 comp rx=0 tx=0).stop 2024-04-25T02:17:56.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.134+0000 7f0c58015640 1 -- 172.21.15.79:0/3947169719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c500b3b50 msgr2=0x7f0c5009e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.134+0000 7f0c58015640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c500b3b50 0x7f0c5009e600 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f0c500cb190 tx=0x7f0c4800eb90 comp rx=0 tx=0).stop 2024-04-25T02:17:56.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.134+0000 7f0c58015640 1 -- 172.21.15.79:0/3947169719 shutdown_connections 2024-04-25T02:17:56.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.134+0000 7f0c58015640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f0c3406be60 0x7f0c3406e320 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.134+0000 7f0c58015640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c500b3b50 0x7f0c5009e600 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.134+0000 7f0c58015640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c500a05a0 0x7f0c500d43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.134+0000 7f0c58015640 1 --2- 172.21.15.79:0/3947169719 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c3c004800 0x7f0c501f7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.134+0000 7f0c58015640 1 -- 172.21.15.79:0/3947169719 >> 172.21.15.79:0/3947169719 conn(0x7f0c5009d460 msgr2=0x7f0c500b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:56.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.134+0000 7f0c58015640 1 -- 172.21.15.79:0/3947169719 shutdown_connections 2024-04-25T02:17:56.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.134+0000 7f0c58015640 1 -- 172.21.15.79:0/3947169719 wait complete. 2024-04-25T02:17:56.150 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:17:56.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:56.151 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:17:56.176 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:17:56.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:17:56.176 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:17:56.231 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:17:56.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.362+0000 7fc858efc640 1 Processor -- start 2024-04-25T02:17:56.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.362+0000 7fc858efc640 1 -- start start 2024-04-25T02:17:56.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.362+0000 7fc858efc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc85415e4d0 0x7fc85406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.362+0000 7fc858efc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc8540b3570 0x7fc8540d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.362+0000 7fc858efc640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8540d1660 con 0x7fc8540b3020 2024-04-25T02:17:56.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.362+0000 7fc858efc640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc8540d1380 con 0x7fc85415e4d0 2024-04-25T02:17:56.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.362+0000 7fc858efc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc8540cede0 con 0x7fc8540b3570 2024-04-25T02:17:56.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.363+0000 7fc85259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc85415e4d0 0x7fc85406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.363+0000 7fc85259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc85415e4d0 0x7fc85406bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56560/0 (socket says 172.21.15.79:56560) 2024-04-25T02:17:56.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.363+0000 7fc85259c640 1 -- 172.21.15.79:0/3095471441 learned_addr learned my addr 172.21.15.79:0/3095471441 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:56.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.363+0000 7fc84bfff640 1 --2- 172.21.15.79:0/3095471441 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc8540b3570 0x7fc8540d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.363+0000 7fc85259c640 1 -- 172.21.15.79:0/3095471441 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc8540b3570 msgr2=0x7fc8540d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:56.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.363+0000 7fc85259c640 1 --2- 172.21.15.79:0/3095471441 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc8540b3570 0x7fc8540d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.363+0000 7fc85259c640 1 -- 172.21.15.79:0/3095471441 >> v1:172.21.15.189:6789/0 conn(0x7fc8540b3020 legacy=0x7fc8540cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:56.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.363+0000 7fc85259c640 1 -- 172.21.15.79:0/3095471441 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8540cf0c0 con 0x7fc85415e4d0 2024-04-25T02:17:56.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.364+0000 7fc85259c640 1 --2- 172.21.15.79:0/3095471441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85415e4d0 0x7fc85406bc70 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fc844009870 tx=0x7fc84402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6430e28efa12595a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:56.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.364+0000 7fc851d9b640 1 -- 172.21.15.79:0/3095471441 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844037070 con 0x7fc85415e4d0 2024-04-25T02:17:56.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.364+0000 7fc851d9b640 1 -- 172.21.15.79:0/3095471441 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc844032440 con 0x7fc85415e4d0 2024-04-25T02:17:56.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.364+0000 7fc851d9b640 1 -- 172.21.15.79:0/3095471441 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844032810 con 0x7fc85415e4d0 2024-04-25T02:17:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.364+0000 7fc858efc640 1 -- 172.21.15.79:0/3095471441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85415e4d0 msgr2=0x7fc85406bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.364+0000 7fc858efc640 1 --2- 172.21.15.79:0/3095471441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85415e4d0 0x7fc85406bc70 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fc844009870 tx=0x7fc84402a210 comp rx=0 tx=0).stop 2024-04-25T02:17:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.364+0000 7fc858efc640 1 -- 172.21.15.79:0/3095471441 shutdown_connections 2024-04-25T02:17:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.364+0000 7fc858efc640 1 --2- 172.21.15.79:0/3095471441 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc8540b3570 0x7fc8540d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.364+0000 7fc858efc640 1 --2- 172.21.15.79:0/3095471441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85415e4d0 0x7fc85406bc70 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.364+0000 7fc858efc640 1 -- 172.21.15.79:0/3095471441 >> 172.21.15.79:0/3095471441 conn(0x7fc85409d460 msgr2=0x7fc8540d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.364+0000 7fc858efc640 1 -- 172.21.15.79:0/3095471441 shutdown_connections 2024-04-25T02:17:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.364+0000 7fc858efc640 1 -- 172.21.15.79:0/3095471441 wait complete. 2024-04-25T02:17:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.366+0000 7fc858efc640 1 Processor -- start 2024-04-25T02:17:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.366+0000 7fc858efc640 1 -- start start 2024-04-25T02:17:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.366+0000 7fc858efc640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc8540b3020 0x7fc85415f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.366+0000 7fc858efc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8540b3570 0x7fc854160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.366+0000 7fc858efc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85415e4d0 0x7fc8541535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.366+0000 7fc858efc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc8540d2250 con 0x7fc85415e4d0 2024-04-25T02:17:56.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.366+0000 7fc858efc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc8540d20d0 con 0x7fc8540b3570 2024-04-25T02:17:56.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.366+0000 7fc858efc640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc85406c1b0 con 0x7fc8540b3020 2024-04-25T02:17:56.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.366+0000 7fc852d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85415e4d0 0x7fc8541535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.366+0000 7fc852d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85415e4d0 0x7fc8541535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56566/0 (socket says 172.21.15.79:56566) 2024-04-25T02:17:56.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.366+0000 7fc852d9d640 1 -- 172.21.15.79:0/2599894558 learned_addr learned my addr 172.21.15.79:0/2599894558 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:56.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.367+0000 7fc85259c640 1 --2- 172.21.15.79:0/2599894558 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc8540b3020 0x7fc85415f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.367+0000 7fc852d9d640 1 -- 172.21.15.79:0/2599894558 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc8540b3020 msgr2=0x7fc85415f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.367+0000 7fc84bfff640 1 --2- 172.21.15.79:0/2599894558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8540b3570 0x7fc854160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.367+0000 7fc852d9d640 1 --2- 172.21.15.79:0/2599894558 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc8540b3020 0x7fc85415f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.367+0000 7fc852d9d640 1 -- 172.21.15.79:0/2599894558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8540b3570 msgr2=0x7fc854160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.367+0000 7fc852d9d640 1 --2- 172.21.15.79:0/2599894558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8540b3570 0x7fc854160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.367+0000 7fc852d9d640 1 -- 172.21.15.79:0/2599894558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc854160af0 con 0x7fc85415e4d0 2024-04-25T02:17:56.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.367+0000 7fc852d9d640 1 --2- 172.21.15.79:0/2599894558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85415e4d0 0x7fc8541535c0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00b970 tx=0x7fc84c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:56.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.367+0000 7fc84affd640 1 -- 172.21.15.79:0/2599894558 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c019070 con 0x7fc85415e4d0 2024-04-25T02:17:56.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.367+0000 7fc84affd640 1 -- 172.21.15.79:0/2599894558 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84c00cb40 con 0x7fc85415e4d0 2024-04-25T02:17:56.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.367+0000 7fc84affd640 1 -- 172.21.15.79:0/2599894558 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c014440 con 0x7fc85415e4d0 2024-04-25T02:17:56.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.367+0000 7fc858efc640 1 -- 172.21.15.79:0/2599894558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc854160dd0 con 0x7fc85415e4d0 2024-04-25T02:17:56.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.367+0000 7fc858efc640 1 -- 172.21.15.79:0/2599894558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc854153b00 con 0x7fc85415e4d0 2024-04-25T02:17:56.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.368+0000 7fc858efc640 1 -- 172.21.15.79:0/2599894558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8540690a0 con 0x7fc85415e4d0 2024-04-25T02:17:56.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.368+0000 7fc84affd640 1 -- 172.21.15.79:0/2599894558 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc84c01c070 con 0x7fc85415e4d0 2024-04-25T02:17:56.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.369+0000 7fc84affd640 1 --2- 172.21.15.79:0/2599894558 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc83406be30 0x7fc83406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.369+0000 7fc85259c640 1 --2- 172.21.15.79:0/2599894558 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc83406be30 0x7fc83406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.369+0000 7fc84affd640 1 -- 172.21.15.79:0/2599894558 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7fc84c08aaa0 con 0x7fc85415e4d0 2024-04-25T02:17:56.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.369+0000 7fc85259c640 1 --2- 172.21.15.79:0/2599894558 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc83406be30 0x7fc83406e2f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc844034000 tx=0x7fc84402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:56.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.373+0000 7fc84affd640 1 -- 172.21.15.79:0/2599894558 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc84c059450 con 0x7fc85415e4d0 2024-04-25T02:17:56.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.580+0000 7fc858efc640 1 -- 172.21.15.79:0/2599894558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8540d1920 con 0x7fc85415e4d0 2024-04-25T02:17:56.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.581+0000 7fc84affd640 1 -- 172.21.15.79:0/2599894558 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5188 (secure 0 0 0) 0x7fc84c058d50 con 0x7fc85415e4d0 2024-04-25T02:17:56.586 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:56.587 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":89,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3866997901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3866997901},{"type":"v1","addr":"172.21.15.189:6834","nonce":3866997901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/167225705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":167225705},{"type":"v1","addr":"172.21.15.189:6835","nonce":167225705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8916,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3734112703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3734112703},{"type":"v1","addr":"172.21.15.79:6835","nonce":3734112703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:17:33.960191+0000","modified":"2024-04-25T02:17:51.033162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9186":{"gid":9186,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/3097428733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3097428733},{"type":"v1","addr":"172.21.15.79:6837","nonce":3097428733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9186,"qdb_cluster":[9186]},"id":8}]} 2024-04-25T02:17:56.587 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 89 2024-04-25T02:17:56.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.583+0000 7fc858efc640 1 -- 172.21.15.79:0/2599894558 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc83406be30 msgr2=0x7fc83406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.583+0000 7fc858efc640 1 --2- 172.21.15.79:0/2599894558 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc83406be30 0x7fc83406e2f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc844034000 tx=0x7fc84402e000 comp rx=0 tx=0).stop 2024-04-25T02:17:56.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.583+0000 7fc858efc640 1 -- 172.21.15.79:0/2599894558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85415e4d0 msgr2=0x7fc8541535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.583+0000 7fc858efc640 1 --2- 172.21.15.79:0/2599894558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85415e4d0 0x7fc8541535c0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00b970 tx=0x7fc84c00be30 comp rx=0 tx=0).stop 2024-04-25T02:17:56.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.583+0000 7fc858efc640 1 -- 172.21.15.79:0/2599894558 shutdown_connections 2024-04-25T02:17:56.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.583+0000 7fc858efc640 1 --2- 172.21.15.79:0/2599894558 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc83406be30 0x7fc83406e2f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.583+0000 7fc858efc640 1 --2- 172.21.15.79:0/2599894558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85415e4d0 0x7fc8541535c0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.583+0000 7fc858efc640 1 --2- 172.21.15.79:0/2599894558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8540b3570 0x7fc854160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.583+0000 7fc858efc640 1 --2- 172.21.15.79:0/2599894558 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc8540b3020 0x7fc85415f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.583+0000 7fc858efc640 1 -- 172.21.15.79:0/2599894558 >> 172.21.15.79:0/2599894558 conn(0x7fc85409d460 msgr2=0x7fc8540d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:56.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.583+0000 7fc858efc640 1 -- 172.21.15.79:0/2599894558 shutdown_connections 2024-04-25T02:17:56.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.583+0000 7fc858efc640 1 -- 172.21.15.79:0/2599894558 wait complete. 2024-04-25T02:17:56.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parent mytag123 2024-04-25T02:17:56.717 INFO:teuthology.orchestra.run.smithi079.stdout:{"return_code":0,"scrub_tag":"mytag123","mode":"asynchronous"} 2024-04-25T02:17:56.718 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag123" } 2024-04-25T02:17:56.718 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-04-25T02:17:56.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.755+0000 7f692a195f40 1 Processor -- start 2024-04-25T02:17:56.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.755+0000 7f692a195f40 1 -- start start 2024-04-25T02:17:56.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f692a195f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f69140030f0 0x55e234cb6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f692a195f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e234d45bc0 0x55e234d47780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f692a195f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e234d446b0 0x55e234d47cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f692a195f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e234c17640 con 0x55e234d45bc0 2024-04-25T02:17:56.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f692a195f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e234c1b680 con 0x55e234d446b0 2024-04-25T02:17:56.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f692a195f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55e234c6e3f0 con 0x7f69140030f0 2024-04-25T02:17:56.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f691f495640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e234d45bc0 0x55e234d47780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f691f495640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e234d45bc0 0x55e234d47780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56588/0 (socket says 172.21.15.79:56588) 2024-04-25T02:17:56.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f691f495640 1 -- 172.21.15.79:0/1043931880 learned_addr learned my addr 172.21.15.79:0/1043931880 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:56.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f6927c96640 1 --2- 172.21.15.79:0/1043931880 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f69140030f0 0x55e234cb6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f6928497640 1 --2- 172.21.15.79:0/1043931880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e234d446b0 0x55e234d47cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f691f495640 1 -- 172.21.15.79:0/1043931880 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f69140030f0 msgr2=0x55e234cb6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:56.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f691f495640 1 --2- 172.21.15.79:0/1043931880 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f69140030f0 0x55e234cb6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f691f495640 1 -- 172.21.15.79:0/1043931880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e234d446b0 msgr2=0x55e234d47cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:56.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f691f495640 1 --2- 172.21.15.79:0/1043931880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e234d446b0 0x55e234d47cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f691f495640 1 -- 172.21.15.79:0/1043931880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e234c6f500 con 0x55e234d45bc0 2024-04-25T02:17:56.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f6927c96640 1 --2- 172.21.15.79:0/1043931880 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f69140030f0 0x55e234cb6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:56.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.756+0000 7f6928497640 1 --2- 172.21.15.79:0/1043931880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e234d446b0 0x55e234d47cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:56.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.757+0000 7f691f495640 1 --2- 172.21.15.79:0/1043931880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e234d45bc0 0x55e234d47780 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f6910000c00 tx=0x7f6910051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3b63baed36e709 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:56.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.757+0000 7f6926c94640 1 -- 172.21.15.79:0/1043931880 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691004f860 con 0x55e234d45bc0 2024-04-25T02:17:56.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.757+0000 7f6926c94640 1 -- 172.21.15.79:0/1043931880 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f691004fa00 con 0x55e234d45bc0 2024-04-25T02:17:56.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.757+0000 7f6926c94640 1 -- 172.21.15.79:0/1043931880 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691004fdd0 con 0x55e234d45bc0 2024-04-25T02:17:56.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.757+0000 7f692a195f40 1 -- 172.21.15.79:0/1043931880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e234d45bc0 msgr2=0x55e234d47780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.757+0000 7f692a195f40 1 --2- 172.21.15.79:0/1043931880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e234d45bc0 0x55e234d47780 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f6910000c00 tx=0x7f6910051000 comp rx=0 tx=0).stop 2024-04-25T02:17:56.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.757+0000 7f692a195f40 1 -- 172.21.15.79:0/1043931880 shutdown_connections 2024-04-25T02:17:56.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.757+0000 7f692a195f40 1 --2- 172.21.15.79:0/1043931880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e234d446b0 0x55e234d47cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.757+0000 7f692a195f40 1 --2- 172.21.15.79:0/1043931880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e234d45bc0 0x55e234d47780 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.757+0000 7f692a195f40 1 --2- 172.21.15.79:0/1043931880 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f69140030f0 0x55e234cb6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.757+0000 7f692a195f40 1 -- 172.21.15.79:0/1043931880 >> 172.21.15.79:0/1043931880 conn(0x55e234c9a880 msgr2=0x55e234d486d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:56.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.757+0000 7f692a195f40 1 -- 172.21.15.79:0/1043931880 shutdown_connections 2024-04-25T02:17:56.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.757+0000 7f692a195f40 1 -- 172.21.15.79:0/1043931880 wait complete. 2024-04-25T02:17:56.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.758+0000 7f692a195f40 1 Processor -- start 2024-04-25T02:17:56.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.758+0000 7f692a195f40 1 -- start start 2024-04-25T02:17:56.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.758+0000 7f692a195f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e234d446b0 0x55e234d3c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.758+0000 7f692a195f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e234d45bc0 0x55e234d3d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.758+0000 7f692a195f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69140030f0 0x55e234d3e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.758+0000 7f692a195f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e234d43e30 con 0x7f69140030f0 2024-04-25T02:17:56.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f692a195f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e234cb61c0 con 0x55e234d446b0 2024-04-25T02:17:56.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f692a195f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55e234c9f2e0 con 0x55e234d45bc0 2024-04-25T02:17:56.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f6928497640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69140030f0 0x55e234d3e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f6928497640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69140030f0 0x55e234d3e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56592/0 (socket says 172.21.15.79:56592) 2024-04-25T02:17:56.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f6928497640 1 -- 172.21.15.79:0/1630026326 learned_addr learned my addr 172.21.15.79:0/1630026326 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:56.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f6927c96640 1 --2- 172.21.15.79:0/1630026326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e234d446b0 0x55e234d3c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f691f495640 1 --2- 172.21.15.79:0/1630026326 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e234d45bc0 0x55e234d3d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f6928497640 1 -- 172.21.15.79:0/1630026326 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e234d45bc0 msgr2=0x55e234d3d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f6928497640 1 --2- 172.21.15.79:0/1630026326 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e234d45bc0 0x55e234d3d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f6928497640 1 -- 172.21.15.79:0/1630026326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e234d446b0 msgr2=0x55e234d3c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f6928497640 1 --2- 172.21.15.79:0/1630026326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e234d446b0 0x55e234d3c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f6928497640 1 -- 172.21.15.79:0/1630026326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e234d485c0 con 0x7f69140030f0 2024-04-25T02:17:56.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f6927c96640 1 --2- 172.21.15.79:0/1630026326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e234d446b0 0x55e234d3c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:56.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f6928497640 1 --2- 172.21.15.79:0/1630026326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69140030f0 0x55e234d3e160 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f6914003070 tx=0x7f692000d590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:56.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f6925c92640 1 -- 172.21.15.79:0/1630026326 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69200032d0 con 0x7f69140030f0 2024-04-25T02:17:56.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f6925c92640 1 -- 172.21.15.79:0/1630026326 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6920003470 con 0x7f69140030f0 2024-04-25T02:17:56.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f6925c92640 1 -- 172.21.15.79:0/1630026326 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6920001830 con 0x7f69140030f0 2024-04-25T02:17:56.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f692a195f40 1 -- 172.21.15.79:0/1630026326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e234d3cbe0 con 0x7f69140030f0 2024-04-25T02:17:56.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.759+0000 7f692a195f40 1 -- 172.21.15.79:0/1630026326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e234d48b40 con 0x7f69140030f0 2024-04-25T02:17:56.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.761+0000 7f6925c92640 1 -- 172.21.15.79:0/1630026326 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69200019d0 con 0x7f69140030f0 2024-04-25T02:17:56.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:17:56.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.761+0000 7f6925c92640 1 --2- 172.21.15.79:0/1630026326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f690806a810 0x7f690806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.761+0000 7f6925c92640 1 -- 172.21.15.79:0/1630026326 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7f6920089890 con 0x7f69140030f0 2024-04-25T02:17:56.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.761+0000 7f6927c96640 1 --2- 172.21.15.79:0/1630026326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f690806a810 0x7f690806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.761+0000 7f692a195f40 1 --2- 172.21.15.79:0/1630026326 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55e234d3c110 0x55e234d46ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.761+0000 7f692a195f40 1 -- 172.21.15.79:0/1630026326 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:1 17.36 17:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118) -- 0x55e234d42c20 con 0x55e234d3c110 2024-04-25T02:17:56.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.761+0000 7f691f495640 1 --2- 172.21.15.79:0/1630026326 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55e234d3c110 0x55e234d46ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.761+0000 7f6927c96640 1 --2- 172.21.15.79:0/1630026326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f690806a810 0x7f690806ccd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f69180017e0 tx=0x7f6918001dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:56.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.762+0000 7f691f495640 1 --2- 172.21.15.79:0/1630026326 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55e234d3c110 0x55e234d46ac0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:56.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.762+0000 7f691f495640 1 -- 172.21.15.79:0/1630026326 <== osd.0 v2:172.21.15.79:6802/1526100659 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7f6910058400 con 0x55e234d3c110 2024-04-25T02:17:56.773 INFO:teuthology.orchestra.run.smithi079.stderr:error getting xattr cephfs_data/100000001f7.00000000/scrub_tag: (61) No data available 2024-04-25T02:17:56.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.762+0000 7f692a195f40 1 -- 172.21.15.79:0/1630026326 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55e234d3c110 msgr2=0x55e234d46ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.762+0000 7f692a195f40 1 --2- 172.21.15.79:0/1630026326 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55e234d3c110 0x55e234d46ac0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.762+0000 7f692a195f40 1 -- 172.21.15.79:0/1630026326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f690806a810 msgr2=0x7f690806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.762+0000 7f692a195f40 1 --2- 172.21.15.79:0/1630026326 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f690806a810 0x7f690806ccd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f69180017e0 tx=0x7f6918001dd0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.762+0000 7f692a195f40 1 -- 172.21.15.79:0/1630026326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69140030f0 msgr2=0x55e234d3e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.762+0000 7f692a195f40 1 --2- 172.21.15.79:0/1630026326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69140030f0 0x55e234d3e160 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f6914003070 tx=0x7f692000d590 comp rx=0 tx=0).stop 2024-04-25T02:17:56.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.762+0000 7f6928497640 1 -- 172.21.15.79:0/1630026326 reap_dead start 2024-04-25T02:17:56.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.762+0000 7f692a195f40 1 -- 172.21.15.79:0/1630026326 shutdown_connections 2024-04-25T02:17:56.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.762+0000 7f692a195f40 1 -- 172.21.15.79:0/1630026326 >> 172.21.15.79:0/1630026326 conn(0x55e234c9a880 msgr2=0x55e234d47630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:56.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.762+0000 7f692a195f40 1 -- 172.21.15.79:0/1630026326 shutdown_connections 2024-04-25T02:17:56.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.762+0000 7f692a195f40 1 -- 172.21.15.79:0/1630026326 wait complete. 2024-04-25T02:17:56.774 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-25T02:17:56.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d451bf40 1 Processor -- start 2024-04-25T02:17:56.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d451bf40 1 -- start start 2024-04-25T02:17:56.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d451bf40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0030f0 0x55e12a4bb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d451bf40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e12a4b3a60 0x55e12a4b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d451bf40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e12a4b4870 0x55e12a3e6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d451bf40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e12a3e53f0 con 0x7fb6bc0030f0 2024-04-25T02:17:56.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d451bf40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e12a38e640 con 0x55e12a4b4870 2024-04-25T02:17:56.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d451bf40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55e12a3e59b0 con 0x55e12a4b3a60 2024-04-25T02:17:56.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d201c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0030f0 0x55e12a4bb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d201c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0030f0 0x55e12a4bb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56604/0 (socket says 172.21.15.79:56604) 2024-04-25T02:17:56.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d201c640 1 -- 172.21.15.79:0/2231135871 learned_addr learned my addr 172.21.15.79:0/2231135871 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:56.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d201c640 1 -- 172.21.15.79:0/2231135871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e12a4b3a60 msgr2=0x55e12a4b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:56.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d201c640 1 --2- 172.21.15.79:0/2231135871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e12a4b3a60 0x55e12a4b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d201c640 1 -- 172.21.15.79:0/2231135871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e12a4b4870 msgr2=0x55e12a3e6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:56.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d201c640 1 --2- 172.21.15.79:0/2231135871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e12a4b4870 0x55e12a3e6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.850+0000 7fb6d201c640 1 -- 172.21.15.79:0/2231135871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e12a42f120 con 0x7fb6bc0030f0 2024-04-25T02:17:56.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.851+0000 7fb6d201c640 1 --2- 172.21.15.79:0/2231135871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0030f0 0x55e12a4bb8d0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400a890 tx=0x7fb6c4005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7fef24485cb8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:56.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.851+0000 7fb6d0819640 1 -- 172.21.15.79:0/2231135871 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4017030 con 0x7fb6bc0030f0 2024-04-25T02:17:56.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.851+0000 7fb6d0819640 1 -- 172.21.15.79:0/2231135871 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c4010a30 con 0x7fb6bc0030f0 2024-04-25T02:17:56.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.851+0000 7fb6d0819640 1 -- 172.21.15.79:0/2231135871 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4010c00 con 0x7fb6bc0030f0 2024-04-25T02:17:56.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.851+0000 7fb6d451bf40 1 -- 172.21.15.79:0/2231135871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0030f0 msgr2=0x55e12a4bb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.851+0000 7fb6d451bf40 1 --2- 172.21.15.79:0/2231135871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0030f0 0x55e12a4bb8d0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400a890 tx=0x7fb6c4005d80 comp rx=0 tx=0).stop 2024-04-25T02:17:56.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.851+0000 7fb6d451bf40 1 -- 172.21.15.79:0/2231135871 shutdown_connections 2024-04-25T02:17:56.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.851+0000 7fb6d451bf40 1 --2- 172.21.15.79:0/2231135871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e12a4b4870 0x55e12a3e6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.851+0000 7fb6d451bf40 1 --2- 172.21.15.79:0/2231135871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e12a4b3a60 0x55e12a4b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.851+0000 7fb6d451bf40 1 --2- 172.21.15.79:0/2231135871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0030f0 0x55e12a4bb8d0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.851+0000 7fb6d451bf40 1 -- 172.21.15.79:0/2231135871 >> 172.21.15.79:0/2231135871 conn(0x55e12a411880 msgr2=0x55e12a4bf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:56.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.851+0000 7fb6d451bf40 1 -- 172.21.15.79:0/2231135871 shutdown_connections 2024-04-25T02:17:56.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.851+0000 7fb6d451bf40 1 -- 172.21.15.79:0/2231135871 wait complete. 2024-04-25T02:17:56.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.852+0000 7fb6d451bf40 1 Processor -- start 2024-04-25T02:17:56.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.852+0000 7fb6d451bf40 1 -- start start 2024-04-25T02:17:56.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.852+0000 7fb6d451bf40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e12a4b3a60 0x55e12a3e7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.852+0000 7fb6d451bf40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e12a4b4870 0x55e12a4b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d451bf40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0030f0 0x55e12a42af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d451bf40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e12a4b4d00 con 0x7fb6bc0030f0 2024-04-25T02:17:56.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d451bf40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e12a4bbe10 con 0x55e12a4b4870 2024-04-25T02:17:56.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d451bf40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55e12a42f600 con 0x55e12a4b3a60 2024-04-25T02:17:56.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d281d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0030f0 0x55e12a42af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d281d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0030f0 0x55e12a42af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56606/0 (socket says 172.21.15.79:56606) 2024-04-25T02:17:56.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d281d640 1 -- 172.21.15.79:0/240084110 learned_addr learned my addr 172.21.15.79:0/240084110 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:56.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d201c640 1 --2- 172.21.15.79:0/240084110 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e12a4b3a60 0x55e12a3e7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d181b640 1 --2- 172.21.15.79:0/240084110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e12a4b4870 0x55e12a4b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d281d640 1 -- 172.21.15.79:0/240084110 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e12a4b3a60 msgr2=0x55e12a3e7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d281d640 1 --2- 172.21.15.79:0/240084110 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55e12a4b3a60 0x55e12a3e7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d281d640 1 -- 172.21.15.79:0/240084110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e12a4b4870 msgr2=0x55e12a4b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d281d640 1 --2- 172.21.15.79:0/240084110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e12a4b4870 0x55e12a4b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d281d640 1 -- 172.21.15.79:0/240084110 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e12a4ba180 con 0x7fb6bc0030f0 2024-04-25T02:17:56.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d281d640 1 --2- 172.21.15.79:0/240084110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0030f0 0x55e12a42af90 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x55e12a3e8d90 tx=0x7fb6cc009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:56.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6c37fe640 1 -- 172.21.15.79:0/240084110 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc008da0 con 0x7fb6bc0030f0 2024-04-25T02:17:56.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6c37fe640 1 -- 172.21.15.79:0/240084110 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6cc019070 con 0x7fb6bc0030f0 2024-04-25T02:17:56.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d451bf40 1 -- 172.21.15.79:0/240084110 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e12a4b40f0 con 0x7fb6bc0030f0 2024-04-25T02:17:56.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6c37fe640 1 -- 172.21.15.79:0/240084110 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc014640 con 0x7fb6bc0030f0 2024-04-25T02:17:56.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.853+0000 7fb6d451bf40 1 -- 172.21.15.79:0/240084110 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e12a4ba720 con 0x7fb6bc0030f0 2024-04-25T02:17:56.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.855+0000 7fb6c37fe640 1 -- 172.21.15.79:0/240084110 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb6cc013070 con 0x7fb6bc0030f0 2024-04-25T02:17:56.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.855+0000 7fb6c37fe640 1 --2- 172.21.15.79:0/240084110 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb6b406a810 0x7fb6b406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.855+0000 7fb6c37fe640 1 -- 172.21.15.79:0/240084110 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7fb6cc089480 con 0x7fb6bc0030f0 2024-04-25T02:17:56.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.855+0000 7fb6d201c640 1 --2- 172.21.15.79:0/240084110 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb6b406a810 0x7fb6b406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.855+0000 7fb6d451bf40 1 --2- 172.21.15.79:0/240084110 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55e12a42b980 0x55e12a4b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.855+0000 7fb6d451bf40 1 -- 172.21.15.79:0/240084110 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:1 17.12 17:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118) -- 0x55e12a4b1950 con 0x55e12a42b980 2024-04-25T02:17:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.855+0000 7fb6d181b640 1 --2- 172.21.15.79:0/240084110 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55e12a42b980 0x55e12a4b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.856+0000 7fb6d201c640 1 --2- 172.21.15.79:0/240084110 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb6b406a810 0x7fb6b406ccd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400a830 tx=0x7fb6c401f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.856+0000 7fb6d181b640 1 --2- 172.21.15.79:0/240084110 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55e12a42b980 0x55e12a4b1410 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.856+0000 7fb6d181b640 1 -- 172.21.15.79:0/240084110 <== osd.3 v2:172.21.15.79:6817/3072297369 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (12) out=12b] v0'0 uv22 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7fb6c80013b0 con 0x55e12a42b980 2024-04-25T02:17:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.856+0000 7fb6d451bf40 1 -- 172.21.15.79:0/240084110 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55e12a42b980 msgr2=0x55e12a4b1410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.856+0000 7fb6d451bf40 1 --2- 172.21.15.79:0/240084110 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55e12a42b980 0x55e12a4b1410 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.856+0000 7fb6d451bf40 1 -- 172.21.15.79:0/240084110 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb6b406a810 msgr2=0x7fb6b406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.856+0000 7fb6d451bf40 1 --2- 172.21.15.79:0/240084110 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb6b406a810 0x7fb6b406ccd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400a830 tx=0x7fb6c401f040 comp rx=0 tx=0).stop 2024-04-25T02:17:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.856+0000 7fb6d451bf40 1 -- 172.21.15.79:0/240084110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0030f0 msgr2=0x55e12a42af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.856+0000 7fb6d451bf40 1 --2- 172.21.15.79:0/240084110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0030f0 0x55e12a42af90 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x55e12a3e8d90 tx=0x7fb6cc009de0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.856+0000 7fb6d281d640 1 -- 172.21.15.79:0/240084110 reap_dead start 2024-04-25T02:17:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.856+0000 7fb6d451bf40 1 -- 172.21.15.79:0/240084110 shutdown_connections 2024-04-25T02:17:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.856+0000 7fb6d451bf40 1 -- 172.21.15.79:0/240084110 >> 172.21.15.79:0/240084110 conn(0x55e12a411880 msgr2=0x55e12a4bca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.856+0000 7fb6d451bf40 1 -- 172.21.15.79:0/240084110 shutdown_connections 2024-04-25T02:17:56.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.856+0000 7fb6d451bf40 1 -- 172.21.15.79:0/240084110 wait complete. 2024-04-25T02:17:56.867 INFO:teuthology.orchestra.run.smithi079.stdout:mytag123 2024-04-25T02:17:56.868 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-04-25T02:17:56.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.945+0000 7fbbc6614f40 1 Processor -- start 2024-04-25T02:17:56.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.945+0000 7fbbc6614f40 1 -- start start 2024-04-25T02:17:56.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.945+0000 7fbbc6614f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55667c0905d0 0x55667c118450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.945+0000 7fbbc6614f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55667c11eef0 0x55667c071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.945+0000 7fbbc6614f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55667c11f810 0x55667c08be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.945+0000 7fbbc6614f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55667c08f100 con 0x55667c11f810 2024-04-25T02:17:56.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.945+0000 7fbbc6614f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55667bfee640 con 0x55667c11eef0 2024-04-25T02:17:56.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.945+0000 7fbbc6614f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55667c076a60 con 0x55667c0905d0 2024-04-25T02:17:56.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.945+0000 7fbbc3ca7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55667c11f810 0x55667c08be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.945+0000 7fbbc3ca7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55667c11f810 0x55667c08be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56618/0 (socket says 172.21.15.79:56618) 2024-04-25T02:17:56.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.945+0000 7fbbc3ca7640 1 -- 172.21.15.79:0/2478531004 learned_addr learned my addr 172.21.15.79:0/2478531004 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:56.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc3ca7640 1 -- 172.21.15.79:0/2478531004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55667c0905d0 msgr2=0x55667c118450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:56.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc3ca7640 1 --2- 172.21.15.79:0/2478531004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55667c0905d0 0x55667c118450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc3ca7640 1 -- 172.21.15.79:0/2478531004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55667c11eef0 msgr2=0x55667c071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:56.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc3ca7640 1 --2- 172.21.15.79:0/2478531004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55667c11eef0 0x55667c071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc3ca7640 1 -- 172.21.15.79:0/2478531004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667c117e60 con 0x55667c11f810 2024-04-25T02:17:56.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc3ca7640 1 --2- 172.21.15.79:0/2478531004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55667c11f810 0x55667c08be40 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc045ff0 tx=0x7fbbbc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51d0ed999035485 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc1ca3640 1 -- 172.21.15.79:0/2478531004 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc0529f0 con 0x55667c11f810 2024-04-25T02:17:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc1ca3640 1 -- 172.21.15.79:0/2478531004 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbbc052b90 con 0x55667c11f810 2024-04-25T02:17:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc1ca3640 1 -- 172.21.15.79:0/2478531004 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc05b450 con 0x55667c11f810 2024-04-25T02:17:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc6614f40 1 -- 172.21.15.79:0/2478531004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55667c11f810 msgr2=0x55667c08be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc6614f40 1 --2- 172.21.15.79:0/2478531004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55667c11f810 0x55667c08be40 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc045ff0 tx=0x7fbbbc051000 comp rx=0 tx=0).stop 2024-04-25T02:17:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc6614f40 1 -- 172.21.15.79:0/2478531004 shutdown_connections 2024-04-25T02:17:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc6614f40 1 --2- 172.21.15.79:0/2478531004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55667c11f810 0x55667c08be40 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc6614f40 1 --2- 172.21.15.79:0/2478531004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55667c11eef0 0x55667c071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc6614f40 1 --2- 172.21.15.79:0/2478531004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55667c0905d0 0x55667c118450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc6614f40 1 -- 172.21.15.79:0/2478531004 >> 172.21.15.79:0/2478531004 conn(0x55667c071000 msgr2=0x55667c116890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc6614f40 1 -- 172.21.15.79:0/2478531004 shutdown_connections 2024-04-25T02:17:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.946+0000 7fbbc6614f40 1 -- 172.21.15.79:0/2478531004 wait complete. 2024-04-25T02:17:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.947+0000 7fbbc6614f40 1 Processor -- start 2024-04-25T02:17:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.947+0000 7fbbc6614f40 1 -- start start 2024-04-25T02:17:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc6614f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55667c0905d0 0x55667c101e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc6614f40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55667c11eef0 0x55667c1131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc6614f40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55667c11f810 0x55667c074180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc6614f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55667c08a9f0 con 0x55667c0905d0 2024-04-25T02:17:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc6614f40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55667c08a710 con 0x55667c11f810 2024-04-25T02:17:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc6614f40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55667c11f460 con 0x55667c11eef0 2024-04-25T02:17:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc34a6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55667c0905d0 0x55667c101e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc34a6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55667c0905d0 0x55667c101e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56624/0 (socket says 172.21.15.79:56624) 2024-04-25T02:17:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc34a6640 1 -- 172.21.15.79:0/722818404 learned_addr learned my addr 172.21.15.79:0/722818404 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc2ca5640 1 --2- 172.21.15.79:0/722818404 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55667c11eef0 0x55667c1131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc3ca7640 1 --2- 172.21.15.79:0/722818404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55667c11f810 0x55667c074180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc34a6640 1 -- 172.21.15.79:0/722818404 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55667c11eef0 msgr2=0x55667c1131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc34a6640 1 --2- 172.21.15.79:0/722818404 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55667c11eef0 0x55667c1131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc34a6640 1 -- 172.21.15.79:0/722818404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55667c11f810 msgr2=0x55667c074180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc34a6640 1 --2- 172.21.15.79:0/722818404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55667c11f810 0x55667c074180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc34a6640 1 -- 172.21.15.79:0/722818404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667c113c90 con 0x55667c0905d0 2024-04-25T02:17:56.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc34a6640 1 --2- 172.21.15.79:0/722818404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55667c0905d0 0x55667c101e20 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4008110 tx=0x7fbbb40085d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:56.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc0ca1640 1 -- 172.21.15.79:0/722818404 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb400f5b0 con 0x55667c0905d0 2024-04-25T02:17:56.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc0ca1640 1 -- 172.21.15.79:0/722818404 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb4015070 con 0x55667c0905d0 2024-04-25T02:17:56.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc6614f40 1 -- 172.21.15.79:0/722818404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55667c113f70 con 0x55667c0905d0 2024-04-25T02:17:56.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc0ca1640 1 -- 172.21.15.79:0/722818404 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb400f990 con 0x55667c0905d0 2024-04-25T02:17:56.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.948+0000 7fbbc6614f40 1 -- 172.21.15.79:0/722818404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55667c114530 con 0x55667c0905d0 2024-04-25T02:17:56.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.950+0000 7fbbc0ca1640 1 -- 172.21.15.79:0/722818404 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbbb400fb30 con 0x55667c0905d0 2024-04-25T02:17:56.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.950+0000 7fbbc0ca1640 1 --2- 172.21.15.79:0/722818404 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbba406a810 0x7fbba406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.950+0000 7fbbc2ca5640 1 --2- 172.21.15.79:0/722818404 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbba406a810 0x7fbba406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.950+0000 7fbbc0ca1640 1 -- 172.21.15.79:0/722818404 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7fbbb4089b00 con 0x55667c0905d0 2024-04-25T02:17:56.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.950+0000 7fbbc6614f40 1 --2- 172.21.15.79:0/722818404 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55667c10ef90 0x55667c10f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:56.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.950+0000 7fbbc6614f40 1 -- 172.21.15.79:0/722818404 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:1 17.19 17:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118) -- 0x55667c10f8b0 con 0x55667c10ef90 2024-04-25T02:17:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.950+0000 7fbbc2ca5640 1 --2- 172.21.15.79:0/722818404 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbba406a810 0x7fbba406ccd0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x55667c048350 tx=0x7fbbac005620 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.951+0000 7fbbc3ca7640 1 --2- 172.21.15.79:0/722818404 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55667c10ef90 0x55667c10f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.951+0000 7fbbc3ca7640 1 --2- 172.21.15.79:0/722818404 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55667c10ef90 0x55667c10f370 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.951+0000 7fbbc3ca7640 1 -- 172.21.15.79:0/722818404 <== osd.5 v2:172.21.15.189:6802/1246927196 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (12) out=12b] v0'0 uv23 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7fbbbc0527f0 con 0x55667c10ef90 2024-04-25T02:17:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.951+0000 7fbbc6614f40 1 -- 172.21.15.79:0/722818404 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55667c10ef90 msgr2=0x55667c10f370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.951+0000 7fbbc6614f40 1 --2- 172.21.15.79:0/722818404 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55667c10ef90 0x55667c10f370 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.951+0000 7fbbc6614f40 1 -- 172.21.15.79:0/722818404 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbba406a810 msgr2=0x7fbba406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.951+0000 7fbbc6614f40 1 --2- 172.21.15.79:0/722818404 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbba406a810 0x7fbba406ccd0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x55667c048350 tx=0x7fbbac005620 comp rx=0 tx=0).stop 2024-04-25T02:17:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.951+0000 7fbbc6614f40 1 -- 172.21.15.79:0/722818404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55667c0905d0 msgr2=0x55667c101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.951+0000 7fbbc6614f40 1 --2- 172.21.15.79:0/722818404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55667c0905d0 0x55667c101e20 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4008110 tx=0x7fbbb40085d0 comp rx=0 tx=0).stop 2024-04-25T02:17:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.951+0000 7fbbc3ca7640 1 -- 172.21.15.79:0/722818404 reap_dead start 2024-04-25T02:17:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.952+0000 7fbbc6614f40 1 -- 172.21.15.79:0/722818404 shutdown_connections 2024-04-25T02:17:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.952+0000 7fbbc6614f40 1 -- 172.21.15.79:0/722818404 >> 172.21.15.79:0/722818404 conn(0x55667c071000 msgr2=0x55667c071ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.952+0000 7fbbc6614f40 1 -- 172.21.15.79:0/722818404 shutdown_connections 2024-04-25T02:17:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:56.952+0000 7fbbc6614f40 1 -- 172.21.15.79:0/722818404 wait complete. 2024-04-25T02:17:56.962 INFO:teuthology.orchestra.run.smithi079.stdout:mytag123 2024-04-25T02:17:56.963 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000004.00000000 scrub_tag 2024-04-25T02:17:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.040+0000 7f498840ef40 1 Processor -- start 2024-04-25T02:17:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.040+0000 7f498840ef40 1 -- start start 2024-04-25T02:17:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f498840ef40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559ba9e87370 0x559ba9e9a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f498840ef40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559ba9e9bbe0 0x559ba9ea0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f498840ef40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ba9ea2650 0x559ba9ea14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f498840ef40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559ba9df76c0 con 0x559ba9e87370 2024-04-25T02:17:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f498840ef40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559ba9d74640 con 0x559ba9ea2650 2024-04-25T02:17:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f498840ef40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x559ba9e87780 con 0x559ba9e9bbe0 2024-04-25T02:17:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f4985f0f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559ba9e87370 0x559ba9e9a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f4985f0f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559ba9e87370 0x559ba9e9a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56630/0 (socket says 172.21.15.79:56630) 2024-04-25T02:17:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f4985f0f640 1 -- 172.21.15.79:0/2996599203 learned_addr learned my addr 172.21.15.79:0/2996599203 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f4986710640 1 --2- 172.21.15.79:0/2996599203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ba9ea2650 0x559ba9ea14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f498570e640 1 --2- 172.21.15.79:0/2996599203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559ba9e9bbe0 0x559ba9ea0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f4985f0f640 1 -- 172.21.15.79:0/2996599203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559ba9e9bbe0 msgr2=0x559ba9ea0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f4985f0f640 1 --2- 172.21.15.79:0/2996599203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559ba9e9bbe0 0x559ba9ea0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f4985f0f640 1 -- 172.21.15.79:0/2996599203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ba9ea2650 msgr2=0x559ba9ea14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f4985f0f640 1 --2- 172.21.15.79:0/2996599203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ba9ea2650 0x559ba9ea14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f4985f0f640 1 -- 172.21.15.79:0/2996599203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ba9dfbbf0 con 0x559ba9e87370 2024-04-25T02:17:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f4986710640 1 --2- 172.21.15.79:0/2996599203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ba9ea2650 0x559ba9ea14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f4985f0f640 1 --2- 172.21.15.79:0/2996599203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559ba9e87370 0x559ba9e9a8a0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f497800a7b0 tx=0x7f4978005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69e59597181fc98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f4977fff640 1 -- 172.21.15.79:0/2996599203 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978017020 con 0x559ba9e87370 2024-04-25T02:17:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f4977fff640 1 -- 172.21.15.79:0/2996599203 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f497800ae50 con 0x559ba9e87370 2024-04-25T02:17:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.041+0000 7f4977fff640 1 -- 172.21.15.79:0/2996599203 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497800dbe0 con 0x559ba9e87370 2024-04-25T02:17:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.042+0000 7f498840ef40 1 -- 172.21.15.79:0/2996599203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559ba9e87370 msgr2=0x559ba9e9a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.042+0000 7f498840ef40 1 --2- 172.21.15.79:0/2996599203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559ba9e87370 0x559ba9e9a8a0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f497800a7b0 tx=0x7f4978005d80 comp rx=0 tx=0).stop 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.042+0000 7f498840ef40 1 -- 172.21.15.79:0/2996599203 shutdown_connections 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.042+0000 7f498840ef40 1 --2- 172.21.15.79:0/2996599203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ba9ea2650 0x559ba9ea14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.042+0000 7f498840ef40 1 --2- 172.21.15.79:0/2996599203 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559ba9e9bbe0 0x559ba9ea0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.042+0000 7f498840ef40 1 --2- 172.21.15.79:0/2996599203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559ba9e87370 0x559ba9e9a8a0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.042+0000 7f498840ef40 1 -- 172.21.15.79:0/2996599203 >> 172.21.15.79:0/2996599203 conn(0x559ba9df9920 msgr2=0x559ba9dcd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.042+0000 7f498840ef40 1 -- 172.21.15.79:0/2996599203 shutdown_connections 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.042+0000 7f498840ef40 1 -- 172.21.15.79:0/2996599203 wait complete. 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.042+0000 7f498840ef40 1 Processor -- start 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.042+0000 7f498840ef40 1 -- start start 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f498840ef40 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ba9e87370 0x559ba9e9a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f498840ef40 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559ba9e9bbe0 0x559ba9dce560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f498840ef40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559ba9ea2650 0x559ba9f313c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f498840ef40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559ba9e81f20 con 0x559ba9ea2650 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f498840ef40 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559ba9e185f0 con 0x559ba9e87370 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f498840ef40 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x559ba9e9b270 con 0x559ba9e9bbe0 2024-04-25T02:17:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f4986710640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559ba9ea2650 0x559ba9f313c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f4986710640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559ba9ea2650 0x559ba9f313c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56636/0 (socket says 172.21.15.79:56636) 2024-04-25T02:17:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f4986710640 1 -- 172.21.15.79:0/2014586520 learned_addr learned my addr 172.21.15.79:0/2014586520 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f4985f0f640 1 --2- 172.21.15.79:0/2014586520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ba9e87370 0x559ba9e9a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f4986710640 1 -- 172.21.15.79:0/2014586520 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559ba9e9bbe0 msgr2=0x559ba9dce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f498570e640 1 --2- 172.21.15.79:0/2014586520 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559ba9e9bbe0 0x559ba9dce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f4986710640 1 --2- 172.21.15.79:0/2014586520 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x559ba9e9bbe0 0x559ba9dce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f4986710640 1 -- 172.21.15.79:0/2014586520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ba9e87370 msgr2=0x559ba9e9a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f4986710640 1 --2- 172.21.15.79:0/2014586520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ba9e87370 0x559ba9e9a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f4986710640 1 -- 172.21.15.79:0/2014586520 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ba9e9ee60 con 0x559ba9ea2650 2024-04-25T02:17:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.043+0000 7f4985f0f640 1 --2- 172.21.15.79:0/2014586520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ba9e87370 0x559ba9e9a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.044+0000 7f4986710640 1 --2- 172.21.15.79:0/2014586520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559ba9ea2650 0x559ba9f313c0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f498000df70 tx=0x7f498000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.044+0000 7f4976ffd640 1 -- 172.21.15.79:0/2014586520 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49800032d0 con 0x559ba9ea2650 2024-04-25T02:17:57.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.044+0000 7f4976ffd640 1 -- 172.21.15.79:0/2014586520 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4980016070 con 0x559ba9ea2650 2024-04-25T02:17:57.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.044+0000 7f4976ffd640 1 -- 172.21.15.79:0/2014586520 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4980001870 con 0x559ba9ea2650 2024-04-25T02:17:57.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.044+0000 7f498840ef40 1 -- 172.21.15.79:0/2014586520 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ba9e9f100 con 0x559ba9ea2650 2024-04-25T02:17:57.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.044+0000 7f498840ef40 1 -- 172.21.15.79:0/2014586520 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ba9e9ffa0 con 0x559ba9ea2650 2024-04-25T02:17:57.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.045+0000 7f4976ffd640 1 -- 172.21.15.79:0/2014586520 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4980001a10 con 0x559ba9ea2650 2024-04-25T02:17:57.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.045+0000 7f4976ffd640 1 --2- 172.21.15.79:0/2014586520 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f496806a840 0x7f496806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.046+0000 7f4985f0f640 1 --2- 172.21.15.79:0/2014586520 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f496806a840 0x7f496806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.046+0000 7f4976ffd640 1 -- 172.21.15.79:0/2014586520 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7f4980089b50 con 0x559ba9ea2650 2024-04-25T02:17:57.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.046+0000 7f498840ef40 1 --2- 172.21.15.79:0/2014586520 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x559ba9dceaa0 0x559ba9e9cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.046+0000 7f498840ef40 1 -- 172.21.15.79:0/2014586520 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:1 17.5 17:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118) -- 0x559ba9e9d4a0 con 0x559ba9dceaa0 2024-04-25T02:17:57.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.046+0000 7f4985f0f640 1 --2- 172.21.15.79:0/2014586520 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f496806a840 0x7f496806cd00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4978005dc0 tx=0x7f4978012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.046+0000 7f498570e640 1 --2- 172.21.15.79:0/2014586520 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x559ba9dceaa0 0x559ba9e9cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.046+0000 7f498570e640 1 --2- 172.21.15.79:0/2014586520 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x559ba9dceaa0 0x559ba9e9cf60 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.047+0000 7f498570e640 1 -- 172.21.15.79:0/2014586520 <== osd.6 v2:172.21.15.189:6816/1254358257 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (12) out=12b] v0'0 uv12 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7f497c054970 con 0x559ba9dceaa0 2024-04-25T02:17:57.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.047+0000 7f498840ef40 1 -- 172.21.15.79:0/2014586520 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x559ba9dceaa0 msgr2=0x559ba9e9cf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.047+0000 7f498840ef40 1 --2- 172.21.15.79:0/2014586520 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x559ba9dceaa0 0x559ba9e9cf60 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.047+0000 7f498840ef40 1 -- 172.21.15.79:0/2014586520 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f496806a840 msgr2=0x7f496806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.047+0000 7f498840ef40 1 --2- 172.21.15.79:0/2014586520 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f496806a840 0x7f496806cd00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4978005dc0 tx=0x7f4978012000 comp rx=0 tx=0).stop 2024-04-25T02:17:57.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.047+0000 7f498840ef40 1 -- 172.21.15.79:0/2014586520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559ba9ea2650 msgr2=0x559ba9f313c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.047+0000 7f498840ef40 1 --2- 172.21.15.79:0/2014586520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559ba9ea2650 0x559ba9f313c0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f498000df70 tx=0x7f498000b5b0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.047+0000 7f4986710640 1 -- 172.21.15.79:0/2014586520 reap_dead start 2024-04-25T02:17:57.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.047+0000 7f498840ef40 1 -- 172.21.15.79:0/2014586520 shutdown_connections 2024-04-25T02:17:57.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.047+0000 7f498840ef40 1 -- 172.21.15.79:0/2014586520 >> 172.21.15.79:0/2014586520 conn(0x559ba9df9920 msgr2=0x559ba9dcce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.047+0000 7f498840ef40 1 -- 172.21.15.79:0/2014586520 shutdown_connections 2024-04-25T02:17:57.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.047+0000 7f498840ef40 1 -- 172.21.15.79:0/2014586520 wait complete. 2024-04-25T02:17:57.058 INFO:teuthology.orchestra.run.smithi079.stdout:mytag123 2024-04-25T02:17:57.058 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-25T02:17:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.191+0000 7fc31503f640 1 Processor -- start 2024-04-25T02:17:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.191+0000 7fc31503f640 1 -- start start 2024-04-25T02:17:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.192+0000 7fc31503f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc31006b770 0x7fc310156610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.192+0000 7fc31503f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc310071cd0 con 0x7fc31006b2f0 2024-04-25T02:17:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.192+0000 7fc31503f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc310071fb0 con 0x7fc3100b41b0 2024-04-25T02:17:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.192+0000 7fc31503f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc310156b50 con 0x7fc31006b770 2024-04-25T02:17:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.192+0000 7fc30f59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc31006b770 0x7fc310156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.192+0000 7fc30e59c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc31006b2f0 0x7fc310155f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34546/0 (socket says 172.21.15.79:34546) 2024-04-25T02:17:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.192+0000 7fc30e59c640 1 -- 172.21.15.79:0/526632256 learned_addr learned my addr 172.21.15.79:0/526632256 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.192+0000 7fc30f59e640 1 -- 172.21.15.79:0/526632256 >> v1:172.21.15.189:6789/0 conn(0x7fc3100b41b0 legacy=0x7fc3101605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.192+0000 7fc30f59e640 1 -- 172.21.15.79:0/526632256 >> v1:172.21.15.79:6789/0 conn(0x7fc31006b2f0 legacy=0x7fc310155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.192+0000 7fc30dd9b640 1 -- 172.21.15.79:0/526632256 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1686033039 0 0) 0x7fc310071cd0 con 0x7fc31006b2f0 2024-04-25T02:17:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.192+0000 7fc30f59e640 1 -- 172.21.15.79:0/526632256 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc310072290 con 0x7fc31006b770 2024-04-25T02:17:57.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.193+0000 7fc30f59e640 1 --2- 172.21.15.79:0/526632256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc31006b770 0x7fc310156610 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fc308009d90 tx=0x7fc30802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52072c8562142f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.193+0000 7fc30dd9b640 1 -- 172.21.15.79:0/526632256 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc308007740 con 0x7fc31006b770 2024-04-25T02:17:57.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.193+0000 7fc30dd9b640 1 -- 172.21.15.79:0/526632256 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3080078e0 con 0x7fc31006b770 2024-04-25T02:17:57.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.193+0000 7fc30dd9b640 1 -- 172.21.15.79:0/526632256 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc308007cb0 con 0x7fc31006b770 2024-04-25T02:17:57.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.194+0000 7fc31503f640 1 -- 172.21.15.79:0/526632256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc31006b770 msgr2=0x7fc310156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.194+0000 7fc31503f640 1 --2- 172.21.15.79:0/526632256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc31006b770 0x7fc310156610 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fc308009d90 tx=0x7fc30802a6a0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.194+0000 7fc31503f640 1 -- 172.21.15.79:0/526632256 shutdown_connections 2024-04-25T02:17:57.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.194+0000 7fc31503f640 1 --2- 172.21.15.79:0/526632256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc31006b770 0x7fc310156610 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.194+0000 7fc31503f640 1 -- 172.21.15.79:0/526632256 >> 172.21.15.79:0/526632256 conn(0x7fc3100b1cd0 msgr2=0x7fc3100b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.194+0000 7fc31503f640 1 -- 172.21.15.79:0/526632256 shutdown_connections 2024-04-25T02:17:57.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.194+0000 7fc31503f640 1 -- 172.21.15.79:0/526632256 wait complete. 2024-04-25T02:17:57.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.195+0000 7fc31503f640 1 Processor -- start 2024-04-25T02:17:57.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.195+0000 7fc31503f640 1 -- start start 2024-04-25T02:17:57.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc31503f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc31006b2f0 0x7fc310160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc31503f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc31006b770 0x7fc31015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc31503f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3100b41b0 0x7fc310156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc31503f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc3100cf4b0 con 0x7fc3100b41b0 2024-04-25T02:17:57.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc31503f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc310072d70 con 0x7fc31006b2f0 2024-04-25T02:17:57.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc31503f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc31006bb80 con 0x7fc31006b770 2024-04-25T02:17:57.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc30f59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3100b41b0 0x7fc310156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc30f59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3100b41b0 0x7fc310156d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56660/0 (socket says 172.21.15.79:56660) 2024-04-25T02:17:57.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc30f59e640 1 -- 172.21.15.79:0/2017658150 learned_addr learned my addr 172.21.15.79:0/2017658150 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc30ed9d640 1 --2- 172.21.15.79:0/2017658150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc31006b2f0 0x7fc310160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc30e59c640 1 --2- 172.21.15.79:0/2017658150 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc31006b770 0x7fc31015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc30f59e640 1 -- 172.21.15.79:0/2017658150 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc31006b770 msgr2=0x7fc31015d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc30f59e640 1 --2- 172.21.15.79:0/2017658150 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc31006b770 0x7fc31015d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc30f59e640 1 -- 172.21.15.79:0/2017658150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc31006b2f0 msgr2=0x7fc310160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc30f59e640 1 --2- 172.21.15.79:0/2017658150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc31006b2f0 0x7fc310160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc30f59e640 1 -- 172.21.15.79:0/2017658150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc310159a80 con 0x7fc3100b41b0 2024-04-25T02:17:57.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc30ed9d640 1 --2- 172.21.15.79:0/2017658150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc31006b2f0 0x7fc310160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:57.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.196+0000 7fc30f59e640 1 --2- 172.21.15.79:0/2017658150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3100b41b0 0x7fc310156d70 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fc30802ac90 tx=0x7fc308004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.197+0000 7fc2f77fe640 1 -- 172.21.15.79:0/2017658150 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc308040070 con 0x7fc3100b41b0 2024-04-25T02:17:57.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.197+0000 7fc2f77fe640 1 -- 172.21.15.79:0/2017658150 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc308031c90 con 0x7fc3100b41b0 2024-04-25T02:17:57.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.197+0000 7fc2f77fe640 1 -- 172.21.15.79:0/2017658150 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc308045680 con 0x7fc3100b41b0 2024-04-25T02:17:57.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.197+0000 7fc31503f640 1 -- 172.21.15.79:0/2017658150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc31009c1e0 con 0x7fc3100b41b0 2024-04-25T02:17:57.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.197+0000 7fc31503f640 1 -- 172.21.15.79:0/2017658150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc31009c7a0 con 0x7fc3100b41b0 2024-04-25T02:17:57.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.198+0000 7fc2f77fe640 1 -- 172.21.15.79:0/2017658150 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc308039040 con 0x7fc3100b41b0 2024-04-25T02:17:57.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.198+0000 7fc2f77fe640 1 --2- 172.21.15.79:0/2017658150 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2fc06be30 0x7fc2fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.199+0000 7fc2f77fe640 1 -- 172.21.15.79:0/2017658150 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7fc3080ac900 con 0x7fc3100b41b0 2024-04-25T02:17:57.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.199+0000 7fc30ed9d640 1 --2- 172.21.15.79:0/2017658150 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2fc06be30 0x7fc2fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.199+0000 7fc30ed9d640 1 --2- 172.21.15.79:0/2017658150 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2fc06be30 0x7fc2fc06e2f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc300006fd0 tx=0x7fc300008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.199+0000 7fc317e2e740 1 Processor -- start 2024-04-25T02:17:57.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.200+0000 7fc317e2e740 1 -- start start 2024-04-25T02:17:57.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.200+0000 7fc317e2e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24a5d60 0x5615e24a6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.200+0000 7fc317e2e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24c3600 0x5615e24c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.200+0000 7fc317e2e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e247ba40 0x5615e24c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.200+0000 7fc317e2e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5615e23df6b0 con 0x5615e24a5d60 2024-04-25T02:17:57.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.200+0000 7fc317e2e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5615e2387880 con 0x5615e247ba40 2024-04-25T02:17:57.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.200+0000 7fc317e2e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5615e23db670 con 0x5615e24c3600 2024-04-25T02:17:57.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.200+0000 7fc30ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24a5d60 0x5615e24a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.200+0000 7fc30ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24a5d60 0x5615e24a6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56664/0 (socket says 172.21.15.79:56664) 2024-04-25T02:17:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.200+0000 7fc30ed9d640 1 -- 172.21.15.79:0/1934384553 learned_addr learned my addr 172.21.15.79:0/1934384553 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.201+0000 7fc30e59c640 1 --2- 172.21.15.79:0/1934384553 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24c3600 0x5615e24c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.201+0000 7fc30ed9d640 1 -- 172.21.15.79:0/1934384553 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24c3600 msgr2=0x5615e24c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.201+0000 7fc30ed9d640 1 --2- 172.21.15.79:0/1934384553 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24c3600 0x5615e24c3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.201+0000 7fc30f59e640 1 --2- 172.21.15.79:0/1934384553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e247ba40 0x5615e24c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.201+0000 7fc30ed9d640 1 -- 172.21.15.79:0/1934384553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e247ba40 msgr2=0x5615e24c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.201+0000 7fc30ed9d640 1 --2- 172.21.15.79:0/1934384553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e247ba40 0x5615e24c1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.201+0000 7fc30ed9d640 1 -- 172.21.15.79:0/1934384553 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615e21bd7d0 con 0x5615e24a5d60 2024-04-25T02:17:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.201+0000 7fc30ed9d640 1 --2- 172.21.15.79:0/1934384553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24a5d60 0x5615e24a6140 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fc30000d8e0 tx=0x7fc300010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300707cbfb065988 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.201+0000 7fc2f4ff9640 1 -- 172.21.15.79:0/1934384553 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300024070 con 0x5615e24a5d60 2024-04-25T02:17:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.201+0000 7fc2f4ff9640 1 -- 172.21.15.79:0/1934384553 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3000149b0 con 0x5615e24a5d60 2024-04-25T02:17:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.201+0000 7fc2f4ff9640 1 -- 172.21.15.79:0/1934384553 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300014d80 con 0x5615e24a5d60 2024-04-25T02:17:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.202+0000 7fc317e2e740 1 -- 172.21.15.79:0/1934384553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24a5d60 msgr2=0x5615e24a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.202+0000 7fc317e2e740 1 --2- 172.21.15.79:0/1934384553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24a5d60 0x5615e24a6140 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fc30000d8e0 tx=0x7fc300010000 comp rx=0 tx=0).stop 2024-04-25T02:17:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.202+0000 7fc317e2e740 1 -- 172.21.15.79:0/1934384553 shutdown_connections 2024-04-25T02:17:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.202+0000 7fc317e2e740 1 --2- 172.21.15.79:0/1934384553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e247ba40 0x5615e24c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.202+0000 7fc317e2e740 1 --2- 172.21.15.79:0/1934384553 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24c3600 0x5615e24c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.202+0000 7fc317e2e740 1 --2- 172.21.15.79:0/1934384553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24a5d60 0x5615e24a6140 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.202+0000 7fc317e2e740 1 -- 172.21.15.79:0/1934384553 >> 172.21.15.79:0/1934384553 conn(0x5615e2478600 msgr2=0x5615e24c0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.202+0000 7fc317e2e740 1 -- 172.21.15.79:0/1934384553 shutdown_connections 2024-04-25T02:17:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.202+0000 7fc317e2e740 1 -- 172.21.15.79:0/1934384553 wait complete. 2024-04-25T02:17:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.202+0000 7fc317e2e740 1 -- start start 2024-04-25T02:17:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.202+0000 7fc317e2e740 1 Processor -- start 2024-04-25T02:17:57.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc317e2e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24a5d60 0x5615e24a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc317e2e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e24c3600 0x5615e24c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc317e2e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24d1de0 0x5615e24c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc317e2e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5615e247c7e0 con 0x5615e24a5d60 2024-04-25T02:17:57.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc317e2e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5615e239af50 con 0x5615e24c3600 2024-04-25T02:17:57.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc317e2e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5615e2476530 con 0x5615e24d1de0 2024-04-25T02:17:57.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc317e2e740 10 client.0 _ll_register_callbacks cb 0x5615e23d6000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:17:57.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc30ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24a5d60 0x5615e24a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc30ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24a5d60 0x5615e24a8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56672/0 (socket says 172.21.15.79:56672) 2024-04-25T02:17:57.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc30ed9d640 1 -- 172.21.15.79:0/796209783 learned_addr learned my addr 172.21.15.79:0/796209783 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc30f59e640 1 --2- 172.21.15.79:0/796209783 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24d1de0 0x5615e24c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc30e59c640 1 --2- 172.21.15.79:0/796209783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e24c3600 0x5615e24c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc30ed9d640 1 -- 172.21.15.79:0/796209783 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24d1de0 msgr2=0x5615e24c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc30ed9d640 1 --2- 172.21.15.79:0/796209783 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24d1de0 0x5615e24c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc30ed9d640 1 -- 172.21.15.79:0/796209783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e24c3600 msgr2=0x5615e24c0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc30ed9d640 1 --2- 172.21.15.79:0/796209783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e24c3600 0x5615e24c0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.203+0000 7fc30ed9d640 1 -- 172.21.15.79:0/796209783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615e20f33f0 con 0x5615e24a5d60 2024-04-25T02:17:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc30ed9d640 1 --2- 172.21.15.79:0/796209783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24a5d60 0x5615e24a8b80 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fc300014e60 tx=0x7fc300004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3b9bf2880adc1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc2edffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:17:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc2edffb640 1 -- 172.21.15.79:0/796209783 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300024070 con 0x5615e24a5d60 2024-04-25T02:17:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc2edffb640 1 -- 172.21.15.79:0/796209783 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7fc30001f950 con 0x5615e24a5d60 2024-04-25T02:17:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc317e2e740 1 -- 172.21.15.79:0/796209783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3000149b0 con 0x5615e24a5d60 2024-04-25T02:17:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc2edffb640 1 -- 172.21.15.79:0/796209783 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fc300034050 con 0x5615e24a5d60 2024-04-25T02:17:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc317e2e740 10 client.9342 fetch_fsmap learned FSMap version 89 2024-04-25T02:17:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc317e2e740 1 -- 172.21.15.79:0/796209783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x5615e20b30f0 con 0x5615e24a5d60 2024-04-25T02:17:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc2edffb640 1 -- 172.21.15.79:0/796209783 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3000149b0 con 0x5615e24a5d60 2024-04-25T02:17:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc2edffb640 1 -- 172.21.15.79:0/796209783 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7fc300037020 con 0x5615e24a5d60 2024-04-25T02:17:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc317e2e740 10 client.9342 fetch_fsmap finished waiting for FSMap version 89 2024-04-25T02:17:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc317e2e740 10 client.9342 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-25T02:17:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc317e2e740 20 client.9342 populate_metadata read hostname 'smithi079' 2024-04-25T02:17:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc317e2e740 1 --2- 172.21.15.79:0/796209783 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x5615e24b9570 0x5615e24a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc317e2e740 4 client.9342 mds_command: new command op to 9186 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:17:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc317e2e740 1 -- 172.21.15.79:0/796209783 --> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615e23ecbf0 con 0x5615e24b9570 2024-04-25T02:17:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc30e59c640 1 --2- 172.21.15.79:0/796209783 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x5615e24b9570 0x5615e24a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc2edffb640 10 client.9342 ms_handle_connect on v2:172.21.15.79:6836/3097428733 2024-04-25T02:17:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.204+0000 7fc30e59c640 1 --2- 172.21.15.79:0/796209783 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x5615e24b9570 0x5615e24a6ce0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a55e95d6b406ca52 server_cookie=c8dffd1d2f485feb in_seq=0 out_seq=0 2024-04-25T02:17:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.205+0000 7fc2edffb640 1 -- 172.21.15.79:0/796209783 <== mds.0 v2:172.21.15.79:6836/3097428733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5615e23ecbf0 con 0x5615e24b9570 2024-04-25T02:17:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.205+0000 7fc2edffb640 10 client.9342 handle_command_reply: tid=0 2024-04-25T02:17:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.205+0000 7fc317e2e740 1 client.9342 shutdown 2024-04-25T02:17:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.205+0000 7fc317e2e740 1 -- 172.21.15.79:0/796209783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24a5d60 msgr2=0x5615e24a8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.205+0000 7fc317e2e740 1 --2- 172.21.15.79:0/796209783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24a5d60 0x5615e24a8b80 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fc300014e60 tx=0x7fc300004680 comp rx=0 tx=0).stop 2024-04-25T02:17:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.205+0000 7fc317e2e740 1 -- 172.21.15.79:0/796209783 shutdown_connections 2024-04-25T02:17:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.205+0000 7fc317e2e740 1 --2- 172.21.15.79:0/796209783 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x5615e24b9570 0x5615e24a6ce0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.205+0000 7fc317e2e740 1 --2- 172.21.15.79:0/796209783 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24d1de0 0x5615e24c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.205+0000 7fc2edffb640 0 client.9342 ms_handle_reset on v2:172.21.15.79:6836/3097428733 2024-04-25T02:17:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.205+0000 7fc317e2e740 1 --2- 172.21.15.79:0/796209783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e24c3600 0x5615e24c0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.205+0000 7fc317e2e740 1 --2- 172.21.15.79:0/796209783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24a5d60 0x5615e24a8b80 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.205+0000 7fc317e2e740 1 -- 172.21.15.79:0/796209783 >> 172.21.15.79:0/796209783 conn(0x5615e247ba40 msgr2=0x5615e24c4980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.205+0000 7fc317e2e740 1 -- 172.21.15.79:0/796209783 shutdown_connections 2024-04-25T02:17:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.205+0000 7fc317e2e740 1 -- 172.21.15.79:0/796209783 wait complete. 2024-04-25T02:17:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.205+0000 7fc317e2e740 20 client.9342 trim_cache size 0 max 16384 2024-04-25T02:17:57.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.220+0000 7fc317e2e740 1 Processor -- start 2024-04-25T02:17:57.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.220+0000 7fc317e2e740 1 -- start start 2024-04-25T02:17:57.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc317e2e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24a5d60 0x5615e24ba030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc317e2e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24c3600 0x5615e2475450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc317e2e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e24d1de0 0x5615e24a9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc317e2e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc3101fe590 con 0x5615e24c3600 2024-04-25T02:17:57.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc317e2e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc31009bb20 con 0x5615e24d1de0 2024-04-25T02:17:57.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc317e2e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc3101598d0 con 0x5615e24a5d60 2024-04-25T02:17:57.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc30e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24c3600 0x5615e2475450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc30e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24c3600 0x5615e2475450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56674/0 (socket says 172.21.15.79:56674) 2024-04-25T02:17:57.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc30e59c640 1 -- 172.21.15.79:0/2329849168 learned_addr learned my addr 172.21.15.79:0/2329849168 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc30ed9d640 1 --2- 172.21.15.79:0/2329849168 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24a5d60 0x5615e24ba030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc30e59c640 1 -- 172.21.15.79:0/2329849168 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24a5d60 msgr2=0x5615e24ba030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc30e59c640 1 --2- 172.21.15.79:0/2329849168 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24a5d60 0x5615e24ba030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc30f59e640 1 --2- 172.21.15.79:0/2329849168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e24d1de0 0x5615e24a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc30e59c640 1 -- 172.21.15.79:0/2329849168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e24d1de0 msgr2=0x5615e24a9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc30e59c640 1 --2- 172.21.15.79:0/2329849168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e24d1de0 0x5615e24a9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc30e59c640 1 -- 172.21.15.79:0/2329849168 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615e24db4b0 con 0x5615e24c3600 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc30ed9d640 1 --2- 172.21.15.79:0/2329849168 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24a5d60 0x5615e24ba030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc30e59c640 1 --2- 172.21.15.79:0/2329849168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24c3600 0x5615e2475450 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fc304007400 tx=0x7fc304007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad5af8bfa9cc304 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc2effff640 1 -- 172.21.15.79:0/2329849168 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30401d020 con 0x5615e24c3600 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc2effff640 1 -- 172.21.15.79:0/2329849168 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc304007650 con 0x5615e24c3600 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.221+0000 7fc2effff640 1 -- 172.21.15.79:0/2329849168 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc304010040 con 0x5615e24c3600 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.222+0000 7fc317e2e740 1 -- 172.21.15.79:0/2329849168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24c3600 msgr2=0x5615e2475450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.222+0000 7fc317e2e740 1 --2- 172.21.15.79:0/2329849168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24c3600 0x5615e2475450 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fc304007400 tx=0x7fc304007c50 comp rx=0 tx=0).stop 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.222+0000 7fc317e2e740 1 -- 172.21.15.79:0/2329849168 shutdown_connections 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.222+0000 7fc317e2e740 1 --2- 172.21.15.79:0/2329849168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e24d1de0 0x5615e24a9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.222+0000 7fc317e2e740 1 --2- 172.21.15.79:0/2329849168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24c3600 0x5615e2475450 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.222+0000 7fc317e2e740 1 --2- 172.21.15.79:0/2329849168 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24a5d60 0x5615e24ba030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.222+0000 7fc317e2e740 1 -- 172.21.15.79:0/2329849168 >> 172.21.15.79:0/2329849168 conn(0x5615e247ba40 msgr2=0x5615e24bf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.222+0000 7fc317e2e740 1 -- 172.21.15.79:0/2329849168 shutdown_connections 2024-04-25T02:17:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.222+0000 7fc317e2e740 1 -- 172.21.15.79:0/2329849168 wait complete. 2024-04-25T02:17:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.222+0000 7fc317e2e740 1 -- start start 2024-04-25T02:17:57.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.222+0000 7fc317e2e740 1 Processor -- start 2024-04-25T02:17:57.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.223+0000 7fc317e2e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e24a5d60 0x5615e2535560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.223+0000 7fc317e2e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24c3600 0x5615e2542040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.223+0000 7fc317e2e740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24d1de0 0x5615e24bf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.223+0000 7fc317e2e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5615e2477720 con 0x5615e24c3600 2024-04-25T02:17:57.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.223+0000 7fc317e2e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc31009b4d0 con 0x5615e24a5d60 2024-04-25T02:17:57.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.223+0000 7fc317e2e740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5615e2542580 con 0x5615e24d1de0 2024-04-25T02:17:57.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.223+0000 7fc317e2e740 10 client.0 _ll_register_callbacks cb 0x7fc300022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:17:57.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.223+0000 7fc30e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24c3600 0x5615e2542040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.223+0000 7fc30e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24c3600 0x5615e2542040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56682/0 (socket says 172.21.15.79:56682) 2024-04-25T02:17:57.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.223+0000 7fc30e59c640 1 -- 172.21.15.79:0/1972228082 learned_addr learned my addr 172.21.15.79:0/1972228082 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.223+0000 7fc30f59e640 1 --2- 172.21.15.79:0/1972228082 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24d1de0 0x5615e24bf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc30ed9d640 1 --2- 172.21.15.79:0/1972228082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e24a5d60 0x5615e2535560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc30e59c640 1 -- 172.21.15.79:0/1972228082 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24d1de0 msgr2=0x5615e24bf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc30e59c640 1 --2- 172.21.15.79:0/1972228082 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24d1de0 0x5615e24bf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc30e59c640 1 -- 172.21.15.79:0/1972228082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e24a5d60 msgr2=0x5615e2535560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc30e59c640 1 --2- 172.21.15.79:0/1972228082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e24a5d60 0x5615e2535560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc30e59c640 1 -- 172.21.15.79:0/1972228082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615e24d0b00 con 0x5615e24c3600 2024-04-25T02:17:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc30f59e640 1 --2- 172.21.15.79:0/1972228082 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24d1de0 0x5615e24bf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc30e59c640 1 --2- 172.21.15.79:0/1972228082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24c3600 0x5615e2542040 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fc304007400 tx=0x7fc304009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14423e644113ccfc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc2edffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:17:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc2edffb640 1 -- 172.21.15.79:0/1972228082 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc304001990 con 0x5615e24c3600 2024-04-25T02:17:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc2edffb640 1 -- 172.21.15.79:0/1972228082 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7fc304001b30 con 0x5615e24c3600 2024-04-25T02:17:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc317e2e740 1 -- 172.21.15.79:0/1972228082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5615e23e6f40 con 0x5615e24c3600 2024-04-25T02:17:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc2edffb640 1 -- 172.21.15.79:0/1972228082 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fc304034050 con 0x5615e24c3600 2024-04-25T02:17:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc317e2e740 10 client.9348 fetch_fsmap learned FSMap version 89 2024-04-25T02:17:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc317e2e740 1 -- 172.21.15.79:0/1972228082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x5615e24c1710 con 0x5615e24c3600 2024-04-25T02:17:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc2edffb640 1 -- 172.21.15.79:0/1972228082 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5615e23e6f40 con 0x5615e24c3600 2024-04-25T02:17:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc2edffb640 1 -- 172.21.15.79:0/1972228082 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7fc304037020 con 0x5615e24c3600 2024-04-25T02:17:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc317e2e740 10 client.9348 fetch_fsmap finished waiting for FSMap version 89 2024-04-25T02:17:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc317e2e740 10 client.9348 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-25T02:17:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc317e2e740 20 client.9348 populate_metadata read hostname 'smithi079' 2024-04-25T02:17:57.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc317e2e740 1 --2- 172.21.15.79:0/1972228082 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x5615e247be20 0x5615e24a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc317e2e740 4 client.9348 mds_command: new command op to 9186 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T02:17:57.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc317e2e740 1 -- 172.21.15.79:0/1972228082 --> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5615e23646f0 con 0x5615e247be20 2024-04-25T02:17:57.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.224+0000 7fc30ed9d640 1 --2- 172.21.15.79:0/1972228082 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x5615e247be20 0x5615e24a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.225+0000 7fc30ed9d640 1 --2- 172.21.15.79:0/1972228082 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x5615e247be20 0x5615e24a47b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bd78529f571ac69 server_cookie=cf06a723bf76df9b in_seq=0 out_seq=0 2024-04-25T02:17:57.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.225+0000 7fc2edffb640 10 client.9348 ms_handle_connect on v2:172.21.15.79:6836/3097428733 2024-04-25T02:17:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.238+0000 7fc2edffb640 1 -- 172.21.15.79:0/1972228082 <== mds.0 v2:172.21.15.79:6836/3097428733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5615e23646f0 con 0x5615e247be20 2024-04-25T02:17:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.238+0000 7fc2edffb640 10 client.9348 handle_command_reply: tid=0 2024-04-25T02:17:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.238+0000 7fc317e2e740 1 client.9348 shutdown 2024-04-25T02:17:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.238+0000 7fc317e2e740 1 -- 172.21.15.79:0/1972228082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24c3600 msgr2=0x5615e2542040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.238+0000 7fc317e2e740 1 --2- 172.21.15.79:0/1972228082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24c3600 0x5615e2542040 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fc304007400 tx=0x7fc304009040 comp rx=0 tx=0).stop 2024-04-25T02:17:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.238+0000 7fc317e2e740 1 -- 172.21.15.79:0/1972228082 shutdown_connections 2024-04-25T02:17:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.238+0000 7fc317e2e740 1 --2- 172.21.15.79:0/1972228082 >> [v2:172.21.15.79:6836/3097428733,v1:172.21.15.79:6837/3097428733] conn(0x5615e247be20 0x5615e24a47b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.238+0000 7fc317e2e740 1 --2- 172.21.15.79:0/1972228082 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5615e24d1de0 0x5615e24bf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.238+0000 7fc317e2e740 1 --2- 172.21.15.79:0/1972228082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615e24c3600 0x5615e2542040 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.238+0000 7fc317e2e740 1 --2- 172.21.15.79:0/1972228082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615e24a5d60 0x5615e2535560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.238+0000 7fc2edffb640 0 client.9348 ms_handle_reset on v2:172.21.15.79:6836/3097428733 2024-04-25T02:17:57.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.238+0000 7fc317e2e740 1 -- 172.21.15.79:0/1972228082 >> 172.21.15.79:0/1972228082 conn(0x5615e247ba40 msgr2=0x5615e2475450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.238+0000 7fc317e2e740 1 -- 172.21.15.79:0/1972228082 shutdown_connections 2024-04-25T02:17:57.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.238+0000 7fc317e2e740 1 -- 172.21.15.79:0/1972228082 wait complete. 2024-04-25T02:17:57.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.238+0000 7fc317e2e740 20 client.9348 trim_cache size 0 max 16384 2024-04-25T02:17:57.245 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:17:57.245 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "", 2024-04-25T02:17:57.245 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0 2024-04-25T02:17:57.245 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:17:57.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.239+0000 7fc31503f640 1 -- 172.21.15.79:0/2017658150 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2fc06be30 msgr2=0x7fc2fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.239+0000 7fc31503f640 1 --2- 172.21.15.79:0/2017658150 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2fc06be30 0x7fc2fc06e2f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc300006fd0 tx=0x7fc300008040 comp rx=0 tx=0).stop 2024-04-25T02:17:57.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.239+0000 7fc31503f640 1 -- 172.21.15.79:0/2017658150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3100b41b0 msgr2=0x7fc310156d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.239+0000 7fc31503f640 1 --2- 172.21.15.79:0/2017658150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3100b41b0 0x7fc310156d70 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fc30802ac90 tx=0x7fc308004a40 comp rx=0 tx=0).stop 2024-04-25T02:17:57.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.239+0000 7fc31503f640 1 -- 172.21.15.79:0/2017658150 shutdown_connections 2024-04-25T02:17:57.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.239+0000 7fc31503f640 1 --2- 172.21.15.79:0/2017658150 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fc2fc06be30 0x7fc2fc06e2f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.239+0000 7fc31503f640 1 --2- 172.21.15.79:0/2017658150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3100b41b0 0x7fc310156d70 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.239+0000 7fc31503f640 1 --2- 172.21.15.79:0/2017658150 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc31006b770 0x7fc31015d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.239+0000 7fc31503f640 1 --2- 172.21.15.79:0/2017658150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc31006b2f0 0x7fc310160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.239+0000 7fc31503f640 1 -- 172.21.15.79:0/2017658150 >> 172.21.15.79:0/2017658150 conn(0x7fc3100b1cd0 msgr2=0x7fc3100b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.239+0000 7fc31503f640 1 -- 172.21.15.79:0/2017658150 shutdown_connections 2024-04-25T02:17:57.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.239+0000 7fc31503f640 1 -- 172.21.15.79:0/2017658150 wait complete. 2024-04-25T02:17:57.255 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:17:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.346+0000 7fb561f3b640 1 Processor -- start 2024-04-25T02:17:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.346+0000 7fb561f3b640 1 -- start start 2024-04-25T02:17:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.347+0000 7fb561f3b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb55c0b00e0 0x7fb55c0cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.347+0000 7fb561f3b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb55c0cc100 0x7fb55c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.347+0000 7fb561f3b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb55c0b04c0 con 0x7fb55c06b5f0 2024-04-25T02:17:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.347+0000 7fb561f3b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb55c06ba20 con 0x7fb55c0b00e0 2024-04-25T02:17:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.347+0000 7fb561f3b640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb55c0d02b0 con 0x7fb55c0cc100 2024-04-25T02:17:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.347+0000 7fb55b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb55c0b00e0 0x7fb55c0cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.347+0000 7fb55bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb55c06b5f0 0x7fb55c071dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34562/0 (socket says 172.21.15.79:34562) 2024-04-25T02:17:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.347+0000 7fb55bfff640 1 -- 172.21.15.79:0/3938590722 learned_addr learned my addr 172.21.15.79:0/3938590722 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.347+0000 7fb55affd640 1 --2- 172.21.15.79:0/3938590722 >> v2:172.21.15.189:3300/0 conn(0x7fb55c0cc100 0x7fb55c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.348+0000 7fb55b7fe640 1 -- 172.21.15.79:0/3938590722 >> v2:172.21.15.189:3300/0 conn(0x7fb55c0cc100 msgr2=0x7fb55c06b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.348+0000 7fb55b7fe640 1 --2- 172.21.15.79:0/3938590722 >> v2:172.21.15.189:3300/0 conn(0x7fb55c0cc100 0x7fb55c06b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.348+0000 7fb55b7fe640 1 -- 172.21.15.79:0/3938590722 >> v1:172.21.15.79:6789/0 conn(0x7fb55c06b5f0 legacy=0x7fb55c071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.348+0000 7fb55b7fe640 1 -- 172.21.15.79:0/3938590722 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55c0d0590 con 0x7fb55c0b00e0 2024-04-25T02:17:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.348+0000 7fb55b7fe640 1 --2- 172.21.15.79:0/3938590722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb55c0b00e0 0x7fb55c0cfa60 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0b3810 tx=0x7fb54c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ecc294e8063d14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.348+0000 7fb55a7fc640 1 -- 172.21.15.79:0/3938590722 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c037070 con 0x7fb55c0b00e0 2024-04-25T02:17:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.348+0000 7fb55a7fc640 1 -- 172.21.15.79:0/3938590722 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54c032440 con 0x7fb55c0b00e0 2024-04-25T02:17:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.348+0000 7fb55a7fc640 1 -- 172.21.15.79:0/3938590722 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c032810 con 0x7fb55c0b00e0 2024-04-25T02:17:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.349+0000 7fb561f3b640 1 -- 172.21.15.79:0/3938590722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb55c0b00e0 msgr2=0x7fb55c0cfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.349+0000 7fb561f3b640 1 --2- 172.21.15.79:0/3938590722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb55c0b00e0 0x7fb55c0cfa60 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0b3810 tx=0x7fb54c02a230 comp rx=0 tx=0).stop 2024-04-25T02:17:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.349+0000 7fb561f3b640 1 -- 172.21.15.79:0/3938590722 shutdown_connections 2024-04-25T02:17:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.349+0000 7fb561f3b640 1 --2- 172.21.15.79:0/3938590722 >> v2:172.21.15.189:3300/0 conn(0x7fb55c0cc100 0x7fb55c06b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.349+0000 7fb561f3b640 1 --2- 172.21.15.79:0/3938590722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb55c0b00e0 0x7fb55c0cfa60 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.349+0000 7fb561f3b640 1 -- 172.21.15.79:0/3938590722 >> 172.21.15.79:0/3938590722 conn(0x7fb55c0cd770 msgr2=0x7fb55c0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.349+0000 7fb561f3b640 1 -- 172.21.15.79:0/3938590722 shutdown_connections 2024-04-25T02:17:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.349+0000 7fb561f3b640 1 -- 172.21.15.79:0/3938590722 wait complete. 2024-04-25T02:17:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.350+0000 7fb561f3b640 1 Processor -- start 2024-04-25T02:17:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.350+0000 7fb561f3b640 1 -- start start 2024-04-25T02:17:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb561f3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb55c06b5f0 0x7fb55c0c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb561f3b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb55c0b00e0 0x7fb55c0c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb561f3b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55c0cc100 0x7fb55c14e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb561f3b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c06dfd0 con 0x7fb55c06b5f0 2024-04-25T02:17:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb561f3b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c06e2e0 con 0x7fb55c0b00e0 2024-04-25T02:17:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb561f3b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb55c0cffa0 con 0x7fb55c0cc100 2024-04-25T02:17:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb55b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb55c06b5f0 0x7fb55c0c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb55b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb55c06b5f0 0x7fb55c0c9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56708/0 (socket says 172.21.15.79:56708) 2024-04-25T02:17:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb55b7fe640 1 -- 172.21.15.79:0/2418221277 learned_addr learned my addr 172.21.15.79:0/2418221277 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb55affd640 1 --2- 172.21.15.79:0/2418221277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb55c0b00e0 0x7fb55c0c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb55bfff640 1 --2- 172.21.15.79:0/2418221277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55c0cc100 0x7fb55c14e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb55b7fe640 1 -- 172.21.15.79:0/2418221277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55c0cc100 msgr2=0x7fb55c14e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb55b7fe640 1 --2- 172.21.15.79:0/2418221277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55c0cc100 0x7fb55c14e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb55b7fe640 1 -- 172.21.15.79:0/2418221277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb55c0b00e0 msgr2=0x7fb55c0c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb55b7fe640 1 --2- 172.21.15.79:0/2418221277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb55c0b00e0 0x7fb55c0c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.351+0000 7fb55b7fe640 1 -- 172.21.15.79:0/2418221277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55c0c4a00 con 0x7fb55c06b5f0 2024-04-25T02:17:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.352+0000 7fb55b7fe640 1 --2- 172.21.15.79:0/2418221277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb55c06b5f0 0x7fb55c0c9820 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fb54c000c00 tx=0x7fb54c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.352+0000 7fb543fff640 1 -- 172.21.15.79:0/2418221277 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c037040 con 0x7fb55c06b5f0 2024-04-25T02:17:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.352+0000 7fb543fff640 1 -- 172.21.15.79:0/2418221277 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54c030770 con 0x7fb55c06b5f0 2024-04-25T02:17:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.352+0000 7fb561f3b640 1 -- 172.21.15.79:0/2418221277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55c0c9eb0 con 0x7fb55c06b5f0 2024-04-25T02:17:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.352+0000 7fb543fff640 1 -- 172.21.15.79:0/2418221277 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c030b40 con 0x7fb55c06b5f0 2024-04-25T02:17:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.352+0000 7fb561f3b640 1 -- 172.21.15.79:0/2418221277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55c0ca470 con 0x7fb55c06b5f0 2024-04-25T02:17:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.353+0000 7fb561f3b640 1 -- 172.21.15.79:0/2418221277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb55c0690a0 con 0x7fb55c06b5f0 2024-04-25T02:17:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.353+0000 7fb543fff640 1 -- 172.21.15.79:0/2418221277 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb54c044020 con 0x7fb55c06b5f0 2024-04-25T02:17:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.353+0000 7fb543fff640 1 --2- 172.21.15.79:0/2418221277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb54806be30 0x7fb54806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.354+0000 7fb543fff640 1 -- 172.21.15.79:0/2418221277 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5853+0+0 (secure 0 0 0) 0x7fb54c0ab410 con 0x7fb55c06b5f0 2024-04-25T02:17:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.354+0000 7fb55affd640 1 --2- 172.21.15.79:0/2418221277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb54806be30 0x7fb54806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.354+0000 7fb55affd640 1 --2- 172.21.15.79:0/2418221277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb54806be30 0x7fb54806e2f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb55c1f7a60 tx=0x7fb550008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.358+0000 7fb543fff640 1 -- 172.21.15.79:0/2418221277 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb54c032e20 con 0x7fb55c06b5f0 2024-04-25T02:17:57.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.567+0000 7fb561f3b640 1 -- 172.21.15.79:0/2418221277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb55c0b1cb0 con 0x7fb55c06b5f0 2024-04-25T02:17:57.573 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:17:57.568+0000 7fb0c50c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:17:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.569+0000 7fb543fff640 1 -- 172.21.15.79:0/2418221277 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v90) ==== 161+0+0 (secure 0 0 0) 0x7fb54c079cb0 con 0x7fb55c06b5f0 2024-04-25T02:17:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:17:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.572+0000 7fb561f3b640 1 -- 172.21.15.79:0/2418221277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb54806be30 msgr2=0x7fb54806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.572+0000 7fb561f3b640 1 --2- 172.21.15.79:0/2418221277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb54806be30 0x7fb54806e2f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb55c1f7a60 tx=0x7fb550008040 comp rx=0 tx=0).stop 2024-04-25T02:17:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.572+0000 7fb561f3b640 1 -- 172.21.15.79:0/2418221277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb55c06b5f0 msgr2=0x7fb55c0c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.572+0000 7fb561f3b640 1 --2- 172.21.15.79:0/2418221277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb55c06b5f0 0x7fb55c0c9820 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fb54c000c00 tx=0x7fb54c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.572+0000 7fb561f3b640 1 -- 172.21.15.79:0/2418221277 shutdown_connections 2024-04-25T02:17:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.572+0000 7fb561f3b640 1 --2- 172.21.15.79:0/2418221277 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb54806be30 0x7fb54806e2f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.572+0000 7fb561f3b640 1 --2- 172.21.15.79:0/2418221277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55c0cc100 0x7fb55c14e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.572+0000 7fb561f3b640 1 --2- 172.21.15.79:0/2418221277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb55c0b00e0 0x7fb55c0c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.572+0000 7fb561f3b640 1 --2- 172.21.15.79:0/2418221277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb55c06b5f0 0x7fb55c0c9820 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.572+0000 7fb561f3b640 1 -- 172.21.15.79:0/2418221277 >> 172.21.15.79:0/2418221277 conn(0x7fb55c0cd770 msgr2=0x7fb55c06e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.572+0000 7fb561f3b640 1 -- 172.21.15.79:0/2418221277 shutdown_connections 2024-04-25T02:17:57.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.572+0000 7fb561f3b640 1 -- 172.21.15.79:0/2418221277 wait complete. 2024-04-25T02:17:57.579 INFO:tasks.ceph.mds.a.smithi079.stderr: -1811> 2024-04-25T02:17:53.024+0000 7f2ba98ac640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:17:57.589 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2024-04-25T02:17:57.605 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:17:57.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.625+0000 7f0dfc11e280 1 -- start start 2024-04-25T02:17:57.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.625+0000 7f0dfc11e280 1 Processor -- start 2024-04-25T02:17:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0dfc11e280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561147b98c00 0x561147c08580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0dfc11e280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561147b99800 0x561147c08b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0dfc11e280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561147b99c00 0x561147c09080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0dfc11e280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56114897a780 con 0x561147b99800 2024-04-25T02:17:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0dfc11e280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56114897a600 con 0x561147b99c00 2024-04-25T02:17:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0dfc11e280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56114897a480 con 0x561147b98c00 2024-04-25T02:17:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0df97a0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561147b99800 0x561147c08b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0df97a0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561147b99800 0x561147c08b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56736/0 (socket says 172.21.15.79:56736) 2024-04-25T02:17:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0df9fa1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561147b98c00 0x561147c08580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0df97a0640 1 -- 172.21.15.79:0/190968024 learned_addr learned my addr 172.21.15.79:0/190968024 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0dfa7a2640 1 --2- 172.21.15.79:0/190968024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561147b99c00 0x561147c09080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0df97a0640 1 -- 172.21.15.79:0/190968024 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561147b98c00 msgr2=0x561147c08580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0df97a0640 1 --2- 172.21.15.79:0/190968024 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561147b98c00 0x561147c08580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0df97a0640 1 -- 172.21.15.79:0/190968024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561147b99c00 msgr2=0x561147c09080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0df97a0640 1 --2- 172.21.15.79:0/190968024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561147b99c00 0x561147c09080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.626+0000 7f0df97a0640 1 -- 172.21.15.79:0/190968024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561147bce780 con 0x561147b99800 2024-04-25T02:17:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.627+0000 7f0df97a0640 1 --2- 172.21.15.79:0/190968024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561147b99800 0x561147c08b00 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x5611489bd320 tx=0x56114892ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec62343f15231bd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.627+0000 7f0df779c640 1 -- 172.21.15.79:0/190968024 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561147bbe9c0 con 0x561147b99800 2024-04-25T02:17:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.627+0000 7f0df779c640 1 -- 172.21.15.79:0/190968024 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561147bc4700 con 0x561147b99800 2024-04-25T02:17:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.627+0000 7f0df779c640 1 -- 172.21.15.79:0/190968024 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561147bbe680 con 0x561147b99800 2024-04-25T02:17:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.627+0000 7f0dfc11e280 1 -- 172.21.15.79:0/190968024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561147bce3c0 con 0x561147b99800 2024-04-25T02:17:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.627+0000 7f0dfc11e280 1 -- 172.21.15.79:0/190968024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x561147bcf680 con 0x561147b99800 2024-04-25T02:17:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.627+0000 7f0dfc11e280 4 waiting for MDS map... 2024-04-25T02:17:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.627+0000 7f0df779c640 1 -- 172.21.15.79:0/190968024 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x561148a74600 con 0x561147b99800 2024-04-25T02:17:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.627+0000 7f0df779c640 1 -- 172.21.15.79:0/190968024 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x561147bf3180 con 0x561147b99800 2024-04-25T02:17:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.627+0000 7f0dfc11e280 4 Got MDS map 90 2024-04-25T02:17:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.627+0000 7f0dfc11e280 10 main: JournalTool::main 2024-04-25T02:17:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.627+0000 7f0dfc11e280 4 main: JournalTool: connecting to RADOS... 2024-04-25T02:17:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.628+0000 7f0dfc11e280 1 Processor -- start 2024-04-25T02:17:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.628+0000 7f0dfc11e280 1 -- start start 2024-04-25T02:17:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.628+0000 7f0dfc11e280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561148ab0000 0x561147c09600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.628+0000 7f0dfc11e280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561148ab0400 0x561147c09b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.628+0000 7f0dfc11e280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ab0800 0x561147c0a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.628+0000 7f0dfc11e280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56114897a300 con 0x561148ab0800 2024-04-25T02:17:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.628+0000 7f0dfc11e280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56114897a000 con 0x561148ab0400 2024-04-25T02:17:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.628+0000 7f0dfc11e280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x561147bfa900 con 0x561148ab0000 2024-04-25T02:17:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.628+0000 7f0df97a0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ab0800 0x561147c0a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.628+0000 7f0df97a0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ab0800 0x561147c0a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56748/0 (socket says 172.21.15.79:56748) 2024-04-25T02:17:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0df97a0640 1 -- 172.21.15.79:0/1032079889 learned_addr learned my addr 172.21.15.79:0/1032079889 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0dfa7a2640 1 --2- 172.21.15.79:0/1032079889 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561148ab0000 0x561147c09600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0df9fa1640 1 --2- 172.21.15.79:0/1032079889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561148ab0400 0x561147c09b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0df97a0640 1 -- 172.21.15.79:0/1032079889 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561148ab0000 msgr2=0x561147c09600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0df97a0640 1 --2- 172.21.15.79:0/1032079889 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561148ab0000 0x561147c09600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0df97a0640 1 -- 172.21.15.79:0/1032079889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561148ab0400 msgr2=0x561147c09b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0df97a0640 1 --2- 172.21.15.79:0/1032079889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561148ab0400 0x561147c09b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0df97a0640 1 -- 172.21.15.79:0/1032079889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561147bcf4a0 con 0x561148ab0800 2024-04-25T02:17:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0df97a0640 1 --2- 172.21.15.79:0/1032079889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ab0800 0x561147c0a100 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x5611489bdbf0 tx=0x561147c4eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8984e8ecc3db378 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0df5798640 1 -- 172.21.15.79:0/1032079889 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561147bbeb60 con 0x561148ab0800 2024-04-25T02:17:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0df5798640 1 -- 172.21.15.79:0/1032079889 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561147bc4fc0 con 0x561148ab0800 2024-04-25T02:17:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0df5798640 1 -- 172.21.15.79:0/1032079889 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561147bbe820 con 0x561148ab0800 2024-04-25T02:17:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1032079889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ab0800 msgr2=0x561147c0a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1032079889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ab0800 0x561147c0a100 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x5611489bdbf0 tx=0x561147c4eba0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1032079889 shutdown_connections 2024-04-25T02:17:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1032079889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ab0800 0x561147c0a100 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1032079889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561148ab0400 0x561147c09b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1032079889 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561148ab0000 0x561147c09600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1032079889 >> 172.21.15.79:0/1032079889 conn(0x56114897dc00 msgr2=0x561148933000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1032079889 shutdown_connections 2024-04-25T02:17:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.629+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1032079889 wait complete. 2024-04-25T02:17:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.630+0000 7f0dfc11e280 1 Processor -- start 2024-04-25T02:17:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.630+0000 7f0dfc11e280 1 -- start start 2024-04-25T02:17:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.630+0000 7f0dfc11e280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ab0000 0x561147c0b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0dfc11e280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561148ab0400 0x561147c0ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0dfc11e280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561148ab0800 0x561147c0a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0dfc11e280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56114897b500 con 0x561148ab0000 2024-04-25T02:17:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0dfc11e280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56114897b380 con 0x561148ab0400 2024-04-25T02:17:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0dfc11e280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56114897b680 con 0x561148ab0800 2024-04-25T02:17:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0dfa7a2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ab0000 0x561147c0b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0dfa7a2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ab0000 0x561147c0b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56750/0 (socket says 172.21.15.79:56750) 2024-04-25T02:17:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0dfa7a2640 1 -- 172.21.15.79:0/2798716255 learned_addr learned my addr 172.21.15.79:0/2798716255 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0df9fa1640 1 --2- 172.21.15.79:0/2798716255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561148ab0400 0x561147c0ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0df97a0640 1 --2- 172.21.15.79:0/2798716255 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561148ab0800 0x561147c0a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0df9fa1640 1 -- 172.21.15.79:0/2798716255 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561148ab0800 msgr2=0x561147c0a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0df9fa1640 1 --2- 172.21.15.79:0/2798716255 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561148ab0800 0x561147c0a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0df9fa1640 1 -- 172.21.15.79:0/2798716255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ab0000 msgr2=0x561147c0b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0df9fa1640 1 --2- 172.21.15.79:0/2798716255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ab0000 0x561147c0b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0df9fa1640 1 -- 172.21.15.79:0/2798716255 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561147bce000 con 0x561148ab0400 2024-04-25T02:17:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0dfa7a2640 1 --2- 172.21.15.79:0/2798716255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ab0000 0x561147c0b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:17:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0df9fa1640 1 --2- 172.21.15.79:0/2798716255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561148ab0400 0x561147c0ac00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x561148a7d680 tx=0x561148a7ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0df3f95640 1 -- 172.21.15.79:0/2798716255 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561147bbeb60 con 0x561148ab0400 2024-04-25T02:17:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0df3f95640 1 -- 172.21.15.79:0/2798716255 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561147bc4e00 con 0x561148ab0400 2024-04-25T02:17:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0dfc11e280 1 -- 172.21.15.79:0/2798716255 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561147bce960 con 0x561148ab0400 2024-04-25T02:17:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.631+0000 7f0df3f95640 1 -- 172.21.15.79:0/2798716255 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561147bbe820 con 0x561148ab0400 2024-04-25T02:17:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.632+0000 7f0dfc11e280 1 -- 172.21.15.79:0/2798716255 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561147bcf860 con 0x561148ab0400 2024-04-25T02:17:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.632+0000 7f0dfc11e280 4 main: JournalTool: resolving pool 16 2024-04-25T02:17:57.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.633+0000 7f0df3f95640 1 -- 172.21.15.79:0/2798716255 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x561148accc00 con 0x561148ab0400 2024-04-25T02:17:57.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.633+0000 7f0df3f95640 1 --2- 172.21.15.79:0/2798716255 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x561148ad2c00 0x561147c0b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.633+0000 7f0df3f95640 1 -- 172.21.15.79:0/2798716255 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x561148ab7000 con 0x561148ab0400 2024-04-25T02:17:57.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.633+0000 7f0dfc11e280 4 main: JournalTool: creating IoCtx.. 2024-04-25T02:17:57.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.633+0000 7f0dfc11e280 4 main: Executing for rank 0 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.633+0000 7f0dfa7a2640 1 --2- 172.21.15.79:0/2798716255 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x561148ad2c00 0x561147c0b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.634+0000 7f0dfa7a2640 1 --2- 172.21.15.79:0/2798716255 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x561148ad2c00 0x561147c0b700 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x561148a7d620 tx=0x561148a7ef00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.634+0000 7f0dfc11e280 1 -- start start 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.634+0000 7f0dfc11e280 1 Processor -- start 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0dfc11e280 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561148ab1000 0x561147c0a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0dfc11e280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ad0400 0x561147c09b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0dfc11e280 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561148ad0800 0x561147c09600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0dfc11e280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56114897b980 con 0x561148ad0400 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0dfc11e280 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56114897bb00 con 0x561148ab1000 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0dfc11e280 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x56114897bc80 con 0x561148ad0800 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0df9fa1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ad0400 0x561147c09b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0df9fa1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ad0400 0x561147c09b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56756/0 (socket says 172.21.15.79:56756) 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0df9fa1640 1 -- 172.21.15.79:0/1078179857 learned_addr learned my addr 172.21.15.79:0/1078179857 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0dfa7a2640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561148ab1000 0x561147c0a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0df97a0640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561148ad0800 0x561147c09600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0df9fa1640 1 -- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561148ad0800 msgr2=0x561147c09600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0df9fa1640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561148ad0800 0x561147c09600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0df9fa1640 1 -- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561148ab1000 msgr2=0x561147c0a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0df9fa1640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561148ab1000 0x561147c0a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0df9fa1640 1 -- 172.21.15.79:0/1078179857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561147bcfa40 con 0x561148ad0400 2024-04-25T02:17:57.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0df97a0640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561148ad0800 0x561147c09600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:57.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0df9fa1640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ad0400 0x561147c09b80 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x561148b036e0 tx=0x561148a7f560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8873e555bfdd62b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0df0f8f640 1 -- 172.21.15.79:0/1078179857 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561147e8e9c0 con 0x561148ad0400 2024-04-25T02:17:57.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0df0f8f640 1 -- 172.21.15.79:0/1078179857 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561147bc4c40 con 0x561148ad0400 2024-04-25T02:17:57.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0df0f8f640 1 -- 172.21.15.79:0/1078179857 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561147e8eb60 con 0x561148ad0400 2024-04-25T02:17:57.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561147bce000 con 0x561148ad0400 2024-04-25T02:17:57.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.635+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x561147bce960 con 0x561148ad0400 2024-04-25T02:17:57.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.636+0000 7f0dfc11e280 4 waiting for MDS map... 2024-04-25T02:17:57.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.636+0000 7f0df0f8f640 1 -- 172.21.15.79:0/1078179857 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x561147f62200 con 0x561148ad0400 2024-04-25T02:17:57.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.636+0000 7f0df0f8f640 1 -- 172.21.15.79:0/1078179857 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x561147bf3500 con 0x561148ad0400 2024-04-25T02:17:57.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.636+0000 7f0dfc11e280 4 Got MDS map 90 2024-04-25T02:17:57.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.636+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x561148ad0c00 0x561147f7a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.636+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:1 16.f 16:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x561148ad1000 con 0x561148ad0c00 2024-04-25T02:17:57.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.636+0000 7f0dfa7a2640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x561148ad0c00 0x561147f7a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.636+0000 7f0dfa7a2640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x561148ad0c00 0x561147f7a000 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=75798cbea829eb4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.640+0000 7f0dfa7a2640 1 -- 172.21.15.79:0/1078179857 <== osd.0 v2:172.21.15.79:6802/1526100659 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v119'2 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56114891c000 con 0x561148ad0c00 2024-04-25T02:17:57.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.640+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:2 16.14 16:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x561148ad3800 con 0x561148ad0c00 2024-04-25T02:17:57.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0dfa7a2640 1 -- 172.21.15.79:0/1078179857 <== osd.0 v2:172.21.15.79:6802/1526100659 2 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v119'39 uv39 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56114891c000 con 0x561148ad0c00 2024-04-25T02:17:57.654 INFO:teuthology.orchestra.run.smithi079.stdout:writing EResetJournal entry 2024-04-25T02:17:57.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:3 16.14 16:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x561148ad3c00 con 0x561148ad0c00 2024-04-25T02:17:57.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x561147f6b800 0x561147f7a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:4 16.1b 16:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x561147f6bc00 con 0x561147f6b800 2024-04-25T02:17:57.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x561147f8a000 0x561147f7ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:5 16.b 16:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x561147f8a400 con 0x561147f8a000 2024-04-25T02:17:57.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:6 16.1f 16:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x561147f8a800 con 0x561147f6b800 2024-04-25T02:17:57.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x561147f8ac00 0x561147f7b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:7 16.1a 16:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x561147f8b000 con 0x561147f8ac00 2024-04-25T02:17:57.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x561147f8b400 0x561147f7b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:8 16.1e 16:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x561147f8b800 con 0x561147f8b400 2024-04-25T02:17:57.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0dfa7a2640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x561147f8a000 0x561147f7ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0df9fa1640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x561147f8ac00 0x561147f7b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0df97a0640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x561147f6b800 0x561147f7a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0df97a0640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x561147f8b400 0x561147f7b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0dfa7a2640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x561147f8a000 0x561147f7ab00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=d554b78d846de2b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0df9fa1640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x561147f8ac00 0x561147f7b080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=420eee673c50e921 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.644+0000 7f0df97a0640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x561147f6b800 0x561147f7a580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=b5d17a3ac01c4dbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.645+0000 7f0df97a0640 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x561147f8b400 0x561147f7b600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=691df616b7985a12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.646+0000 7f0df97a0640 1 -- 172.21.15.79:0/1078179857 <== osd.5 v2:172.21.15.189:6802/1246927196 1 ==== osd_op_reply(6 200.00000004 [delete] v119'9 uv8 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56114891c500 con 0x561147f6b800 2024-04-25T02:17:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.646+0000 7f0df97a0640 1 -- 172.21.15.79:0/1078179857 <== osd.5 v2:172.21.15.189:6802/1246927196 2 ==== osd_op_reply(4 200.00000002 [delete] v119'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56114891c500 con 0x561147f6b800 2024-04-25T02:17:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.647+0000 7f0dfa7a2640 1 -- 172.21.15.79:0/1078179857 <== osd.0 v2:172.21.15.79:6802/1526100659 3 ==== osd_op_reply(3 200.00000001 [delete] v119'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56114891c000 con 0x561148ad0c00 2024-04-25T02:17:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.647+0000 7f0def78c640 1 -- 172.21.15.79:0/1078179857 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:9 16.14 16:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x561148ab1c00 con 0x561148ad0c00 2024-04-25T02:17:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.648+0000 7f0df97a0640 1 -- 172.21.15.79:0/1078179857 <== osd.7 v2:172.21.15.189:6824/3421948491 1 ==== osd_op_reply(8 200.00000006 [delete] v119'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56114891c500 con 0x561147f8b400 2024-04-25T02:17:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.649+0000 7f0df9fa1640 1 -- 172.21.15.79:0/1078179857 <== osd.3 v2:172.21.15.79:6817/3072297369 1 ==== osd_op_reply(7 200.00000005 [delete] v119'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56114891c780 con 0x561147f8ac00 2024-04-25T02:17:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.649+0000 7f0dfa7a2640 1 -- 172.21.15.79:0/1078179857 <== osd.1 v2:172.21.15.79:6816/2311596149 1 ==== osd_op_reply(5 200.00000003 [delete] v119'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56114891c000 con 0x561147f8a000 2024-04-25T02:17:57.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.652+0000 7f0dfa7a2640 1 -- 172.21.15.79:0/1078179857 <== osd.0 v2:172.21.15.79:6802/1526100659 4 ==== osd_op_reply(9 200.00000001 [write 0~48] v119'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56114891c000 con 0x561148ad0c00 2024-04-25T02:17:57.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.652+0000 7f0dfc11e280 4 Successfully wrote new journal pointer and header for rank 8:0 2024-04-25T02:17:57.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.652+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x561148ad0c00 msgr2=0x561147f7a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.652+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x561148ad0c00 0x561147f7a000 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.652+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x561147f8a000 msgr2=0x561147f7ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.652+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x561147f8a000 0x561147f7ab00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.652+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x561147f8ac00 msgr2=0x561147f7b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.652+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x561147f8ac00 0x561147f7b080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.652+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x561147f6b800 msgr2=0x561147f7a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.652+0000 7f0df97a0640 1 -- 172.21.15.79:0/1078179857 reap_dead start 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.652+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x561147f6b800 0x561147f7a580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.652+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x561147f8b400 msgr2=0x561147f7b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.652+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x561147f8b400 0x561147f7b600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ad0400 msgr2=0x561147c09b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ad0400 0x561147c09b80 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x561148b036e0 tx=0x561148a7f560 comp rx=0 tx=0).stop 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 shutdown_connections 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x561147f8b400 0x561147f7b600 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x561147f6b800 0x561147f7a580 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/1078179857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ad0400 0x561147c09b80 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 >> 172.21.15.79:0/1078179857 conn(0x561148ab0c00 msgr2=0x561148933800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 shutdown_connections 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 -- 172.21.15.79:0/1078179857 wait complete. 2024-04-25T02:17:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 -- 172.21.15.79:0/2798716255 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x561148ad2c00 msgr2=0x561147c0b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/2798716255 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x561148ad2c00 0x561147c0b700 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x561148a7d620 tx=0x561148a7ef00 comp rx=0 tx=0).stop 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 -- 172.21.15.79:0/2798716255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561148ab0400 msgr2=0x561147c0ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/2798716255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561148ab0400 0x561147c0ac00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x561148a7d680 tx=0x561148a7ec00 comp rx=0 tx=0).stop 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 -- 172.21.15.79:0/2798716255 shutdown_connections 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/2798716255 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x561148ad2c00 0x561147c0b700 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/2798716255 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561148ab0800 0x561147c0a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/2798716255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561148ab0400 0x561147c0ac00 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/2798716255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561148ab0000 0x561147c0b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 -- 172.21.15.79:0/2798716255 >> 172.21.15.79:0/2798716255 conn(0x56114897dc00 msgr2=0x561148933000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 -- 172.21.15.79:0/2798716255 shutdown_connections 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 -- 172.21.15.79:0/2798716255 wait complete. 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 -- 172.21.15.79:0/190968024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561147b99800 msgr2=0x561147c08b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.653+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/190968024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561147b99800 0x561147c08b00 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x5611489bd320 tx=0x56114892ca80 comp rx=0 tx=0).stop 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.654+0000 7f0dfc11e280 1 -- 172.21.15.79:0/190968024 shutdown_connections 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.654+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/190968024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561147b99c00 0x561147c09080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.654+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/190968024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561147b99800 0x561147c08b00 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.654+0000 7f0dfc11e280 1 --2- 172.21.15.79:0/190968024 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x561147b98c00 0x561147c08580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.654+0000 7f0dfc11e280 1 -- 172.21.15.79:0/190968024 >> 172.21.15.79:0/190968024 conn(0x561147b99000 msgr2=0x561148932800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.654+0000 7f0dfc11e280 1 -- 172.21.15.79:0/190968024 shutdown_connections 2024-04-25T02:17:57.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.654+0000 7f0dfc11e280 1 -- 172.21.15.79:0/190968024 wait complete. 2024-04-25T02:17:57.665 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.076086, result: writing EResetJournal entry 2024-04-25T02:17:57.665 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-25T02:17:57.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.737+0000 7f255a20c740 1 -- start start 2024-04-25T02:17:57.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.737+0000 7f255a20c740 1 Processor -- start 2024-04-25T02:17:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.737+0000 7f255a20c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b45c000 0x557f3a6e7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.737+0000 7f255a20c740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557f3a673c00 0x557f3a6e7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.737+0000 7f255a20c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b45c800 0x557f3a6e7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.737+0000 7f255a20c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557f3b462480 con 0x557f3b45c800 2024-04-25T02:17:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.737+0000 7f255a20c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557f3b462600 con 0x557f3b45c000 2024-04-25T02:17:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.737+0000 7f255a20c740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x557f3b462780 con 0x557f3a673c00 2024-04-25T02:17:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f25585aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b45c800 0x557f3a6e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f25585aa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b45c800 0x557f3a6e7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56770/0 (socket says 172.21.15.79:56770) 2024-04-25T02:17:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f25585aa640 1 -- 172.21.15.79:0/3351786161 learned_addr learned my addr 172.21.15.79:0/3351786161 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f2557da9640 1 --2- 172.21.15.79:0/3351786161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b45c000 0x557f3a6e7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f25575a8640 1 --2- 172.21.15.79:0/3351786161 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557f3a673c00 0x557f3a6e7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f25585aa640 1 -- 172.21.15.79:0/3351786161 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557f3a673c00 msgr2=0x557f3a6e7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f25585aa640 1 --2- 172.21.15.79:0/3351786161 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557f3a673c00 0x557f3a6e7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f25585aa640 1 -- 172.21.15.79:0/3351786161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b45c000 msgr2=0x557f3a6e7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f25585aa640 1 --2- 172.21.15.79:0/3351786161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b45c000 0x557f3a6e7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f25585aa640 1 -- 172.21.15.79:0/3351786161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f3a69f680 con 0x557f3b45c800 2024-04-25T02:17:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f2557da9640 1 --2- 172.21.15.79:0/3351786161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b45c000 0x557f3a6e7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f25585aa640 1 --2- 172.21.15.79:0/3351786161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b45c800 0x557f3a6e7600 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x557f3b497ad0 tx=0x557f3b410180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51b225d3c708e7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f25555a4640 1 -- 172.21.15.79:0/3351786161 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557f3a698d00 con 0x557f3b45c800 2024-04-25T02:17:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f25555a4640 1 -- 172.21.15.79:0/3351786161 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x557f3a6bc1c0 con 0x557f3b45c800 2024-04-25T02:17:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f25555a4640 1 -- 172.21.15.79:0/3351786161 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557f3a698680 con 0x557f3b45c800 2024-04-25T02:17:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f255a20c740 1 -- 172.21.15.79:0/3351786161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f3a69f2c0 con 0x557f3b45c800 2024-04-25T02:17:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f255a20c740 1 -- 172.21.15.79:0/3351786161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x557f3a69fa40 con 0x557f3b45c800 2024-04-25T02:17:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f255a20c740 4 waiting for MDS map... 2024-04-25T02:17:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f25555a4640 1 -- 172.21.15.79:0/3351786161 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x557f3b540400 con 0x557f3b45c800 2024-04-25T02:17:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f25555a4640 1 -- 172.21.15.79:0/3351786161 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x557f3a6cb180 con 0x557f3b45c800 2024-04-25T02:17:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.738+0000 7f255a20c740 4 Got MDS map 90 2024-04-25T02:17:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.739+0000 7f255a20c740 4 datascan.main: Using metadata pool output 2024-04-25T02:17:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.739+0000 7f255a20c740 4 datascan.main: connecting to RADOS... 2024-04-25T02:17:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.739+0000 7f255a20c740 1 Processor -- start 2024-04-25T02:17:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.739+0000 7f255a20c740 1 -- start start 2024-04-25T02:17:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f255a20c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b542c00 0x557f3a6e6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f255a20c740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557f3b543000 0x557f3a6e8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f255a20c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b543400 0x557f3a6e8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f255a20c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557f3a6d2180 con 0x557f3b543400 2024-04-25T02:17:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f255a20c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557f3b462f00 con 0x557f3b542c00 2024-04-25T02:17:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f255a20c740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x557f3b463080 con 0x557f3b543000 2024-04-25T02:17:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f25575a8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b543400 0x557f3a6e8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f25575a8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b543400 0x557f3a6e8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56776/0 (socket says 172.21.15.79:56776) 2024-04-25T02:17:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f25575a8640 1 -- 172.21.15.79:0/3291628584 learned_addr learned my addr 172.21.15.79:0/3291628584 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f25575a8640 1 --2- 172.21.15.79:0/3291628584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b542c00 0x557f3a6e6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f2557da9640 1 --2- 172.21.15.79:0/3291628584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557f3b543000 0x557f3a6e8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f25575a8640 1 -- 172.21.15.79:0/3291628584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557f3b543000 msgr2=0x557f3a6e8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f25575a8640 1 --2- 172.21.15.79:0/3291628584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557f3b543000 0x557f3a6e8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f25575a8640 1 -- 172.21.15.79:0/3291628584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b542c00 msgr2=0x557f3a6e6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f25575a8640 1 --2- 172.21.15.79:0/3291628584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b542c00 0x557f3a6e6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f25575a8640 1 -- 172.21.15.79:0/3291628584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f3a69fc20 con 0x557f3b543400 2024-04-25T02:17:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f2557da9640 1 --2- 172.21.15.79:0/3291628584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557f3b543000 0x557f3a6e8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f25575a8640 1 --2- 172.21.15.79:0/3291628584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b543400 0x557f3a6e8680 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x557f3b54cf60 tx=0x557f3b550c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc80caa0e525ed2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f25535a0640 1 -- 172.21.15.79:0/3291628584 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557f3a698d00 con 0x557f3b543400 2024-04-25T02:17:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f25535a0640 1 -- 172.21.15.79:0/3291628584 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x557f3a6bcc40 con 0x557f3b543400 2024-04-25T02:17:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.740+0000 7f25535a0640 1 -- 172.21.15.79:0/3291628584 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557f3a698680 con 0x557f3b543400 2024-04-25T02:17:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.741+0000 7f255a20c740 1 -- 172.21.15.79:0/3291628584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b543400 msgr2=0x557f3a6e8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.741+0000 7f255a20c740 1 --2- 172.21.15.79:0/3291628584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b543400 0x557f3a6e8680 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x557f3b54cf60 tx=0x557f3b550c60 comp rx=0 tx=0).stop 2024-04-25T02:17:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.741+0000 7f255a20c740 1 -- 172.21.15.79:0/3291628584 shutdown_connections 2024-04-25T02:17:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.741+0000 7f255a20c740 1 --2- 172.21.15.79:0/3291628584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b543400 0x557f3a6e8680 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.741+0000 7f255a20c740 1 --2- 172.21.15.79:0/3291628584 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557f3b543000 0x557f3a6e8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.741+0000 7f255a20c740 1 --2- 172.21.15.79:0/3291628584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b542c00 0x557f3a6e6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.741+0000 7f255a20c740 1 -- 172.21.15.79:0/3291628584 >> 172.21.15.79:0/3291628584 conn(0x557f3b45c400 msgr2=0x557f3b3f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.741+0000 7f255a20c740 1 -- 172.21.15.79:0/3291628584 shutdown_connections 2024-04-25T02:17:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.741+0000 7f255a20c740 1 -- 172.21.15.79:0/3291628584 wait complete. 2024-04-25T02:17:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.741+0000 7f255a20c740 1 Processor -- start 2024-04-25T02:17:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.741+0000 7f255a20c740 1 -- start start 2024-04-25T02:17:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f255a20c740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557f3b542c00 0x557f3a6e6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f255a20c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b543000 0x557f3a6e8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f255a20c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b543400 0x557f3a6e8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f255a20c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557f3b463380 con 0x557f3b543000 2024-04-25T02:17:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f255a20c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557f3b463200 con 0x557f3b543400 2024-04-25T02:17:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f255a20c740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x557f3b463500 con 0x557f3b542c00 2024-04-25T02:17:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f2557da9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b543000 0x557f3a6e8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f2557da9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b543000 0x557f3a6e8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56784/0 (socket says 172.21.15.79:56784) 2024-04-25T02:17:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 learned_addr learned my addr 172.21.15.79:0/3205946184 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f25575a8640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557f3b542c00 0x557f3a6e6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f25575a8640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b543400 0x557f3a6e8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557f3b542c00 msgr2=0x557f3a6e6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f2557da9640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557f3b542c00 0x557f3a6e6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b543400 msgr2=0x557f3a6e8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f2557da9640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b543400 0x557f3a6e8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f3a69f860 con 0x557f3b543000 2024-04-25T02:17:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f25575a8640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b543400 0x557f3a6e8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f2557da9640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b543000 0x557f3a6e8100 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x557f3b497620 tx=0x557f3b410c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f2551d9d640 1 -- 172.21.15.79:0/3205946184 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557f3a698b60 con 0x557f3b543000 2024-04-25T02:17:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f2551d9d640 1 -- 172.21.15.79:0/3205946184 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x557f3a6bca80 con 0x557f3b543000 2024-04-25T02:17:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f3a69f0e0 con 0x557f3b543000 2024-04-25T02:17:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f2551d9d640 1 -- 172.21.15.79:0/3205946184 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557f3a698d00 con 0x557f3b543000 2024-04-25T02:17:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f3a69f680 con 0x557f3b543000 2024-04-25T02:17:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.742+0000 7f255a20c740 4 datascan.init: resolving metadata pool 16 2024-04-25T02:17:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.744+0000 7f2551d9d640 1 -- 172.21.15.79:0/3205946184 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x557f3b5b6c00 con 0x557f3b543000 2024-04-25T02:17:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.744+0000 7f2551d9d640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x557f3b5acc00 0x557f3a6e9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.744+0000 7f2551d9d640 1 -- 172.21.15.79:0/3205946184 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x557f3b5aee00 con 0x557f3b543000 2024-04-25T02:17:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.744+0000 7f25575a8640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x557f3b5acc00 0x557f3a6e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.744+0000 7f255a20c740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T02:17:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.744+0000 7f255a20c740 4 datascan.main: data pool 'cephfs_data' has ID 17 2024-04-25T02:17:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.744+0000 7f255a20c740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T02:17:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.744+0000 7f255a20c740 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x557f3b543800 0x557f3a6e8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.744+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:1 17.0 17:00000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3b543c00 con 0x557f3b543800 2024-04-25T02:17:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.744+0000 7f25575a8640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x557f3b543800 0x557f3a6e8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.744+0000 7f25575a8640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x557f3b5acc00 0x557f3a6e9700 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x557f3b54d0b0 tx=0x557f3b550c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.745+0000 7f25575a8640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x557f3b543800 0x557f3a6e8c00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.745+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.7 v2:172.21.15.189:6824/3421948491 1 ==== osd_op_reply(1 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b543800 2024-04-25T02:17:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.745+0000 7f2552d9f640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x557f3b5ad000 0x557f3aa06000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.745+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:2 17.20 17:04000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3b5ad400 con 0x557f3b5ad000 2024-04-25T02:17:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.745+0000 7f25585aa640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x557f3b5ad000 0x557f3aa06000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.745+0000 7f25585aa640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x557f3b5ad000 0x557f3aa06000 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.746+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.1 v2:172.21.15.79:6816/2311596149 1 ==== osd_op_reply(2 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3b5ad000 2024-04-25T02:17:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.746+0000 7f25535a0640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x557f3b5adc00 0x557f3aa06580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.746+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:3 17.10 17:08000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f8000 con 0x557f3b5adc00 2024-04-25T02:17:57.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.746+0000 7f2557da9640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x557f3b5adc00 0x557f3aa06580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.746+0000 7f2557da9640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x557f3b5adc00 0x557f3aa06580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.746+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.3 v2:172.21.15.79:6817/3072297369 1 ==== osd_op_reply(3 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3b5adc00 2024-04-25T02:17:57.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.746+0000 7f2552d9f640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x557f3b5ad800 0x557f3aa06b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.746+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:4 17.30 17:0c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f8800 con 0x557f3b5ad800 2024-04-25T02:17:57.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.747+0000 7f25575a8640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x557f3b5ad800 0x557f3aa06b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.747+0000 7f25575a8640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x557f3b5ad800 0x557f3aa06b00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.747+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.0 v2:172.21.15.79:6802/1526100659 1 ==== osd_op_reply(4 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad800 2024-04-25T02:17:57.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.747+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:5 17.8 17:10000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f8400 con 0x557f3b543800 2024-04-25T02:17:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.748+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.7 v2:172.21.15.189:6824/3421948491 2 ==== osd_op_reply(5 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b543800 2024-04-25T02:17:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.748+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:6 17.28 17:14000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f8c00 con 0x557f3b5adc00 2024-04-25T02:17:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.748+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.3 v2:172.21.15.79:6817/3072297369 2 ==== osd_op_reply(6 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3b5adc00 2024-04-25T02:17:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.748+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:7 17.18 17:18000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f8800 con 0x557f3b5ad800 2024-04-25T02:17:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.748+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.0 v2:172.21.15.79:6802/1526100659 2 ==== osd_op_reply(7 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad800 2024-04-25T02:17:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.748+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:8 17.38 17:1c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f9000 con 0x557f3b543800 2024-04-25T02:17:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.748+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.7 v2:172.21.15.189:6824/3421948491 3 ==== osd_op_reply(8 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b543800 2024-04-25T02:17:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.748+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:9 17.4 17:20000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3b543c00 con 0x557f3b5ad800 2024-04-25T02:17:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.749+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.0 v2:172.21.15.79:6802/1526100659 3 ==== osd_op_reply(9 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad800 2024-04-25T02:17:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.749+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:10 17.24 17:24000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f8400 con 0x557f3b5adc00 2024-04-25T02:17:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.749+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.3 v2:172.21.15.79:6817/3072297369 3 ==== osd_op_reply(10 [pgnls start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3b5adc00 2024-04-25T02:17:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.749+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:11 17.14 17:28000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3b5ac800 con 0x557f3b5adc00 2024-04-25T02:17:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.749+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.3 v2:172.21.15.79:6817/3072297369 4 ==== osd_op_reply(11 [pgnls start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3b5adc00 2024-04-25T02:17:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.749+0000 7f2552d9f640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x557f3a9f9400 0x557f3aa07080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.749+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:12 17.34 17:2c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f9800 con 0x557f3a9f9400 2024-04-25T02:17:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.749+0000 7f25585aa640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x557f3a9f9400 0x557f3aa07080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.750+0000 7f25585aa640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x557f3a9f9400 0x557f3aa07080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.750+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.5 v2:172.21.15.189:6802/1246927196 1 ==== osd_op_reply(12 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3a9f9400 2024-04-25T02:17:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.750+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:13 17.c 17:30000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa18000 con 0x557f3b543800 2024-04-25T02:17:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.750+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.7 v2:172.21.15.189:6824/3421948491 4 ==== osd_op_reply(13 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b543800 2024-04-25T02:17:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.750+0000 7f2552d9f640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x557f3a9f9c00 0x557f3aa07600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.750+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:14 17.2c 17:34000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa19000 con 0x557f3a9f9c00 2024-04-25T02:17:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.751+0000 7f2557da9640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x557f3a9f9c00 0x557f3aa07600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.751+0000 7f2557da9640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x557f3a9f9c00 0x557f3aa07600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.751+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.4 v2:172.21.15.189:6800/1910571406 1 ==== osd_op_reply(14 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3a9f9c00 2024-04-25T02:17:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.751+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:15 17.1c 17:38000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa18400 con 0x557f3b5ad000 2024-04-25T02:17:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.751+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.1 v2:172.21.15.79:6816/2311596149 2 ==== osd_op_reply(15 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3b5ad000 2024-04-25T02:17:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.752+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:16 17.3c 17:3c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa19400 con 0x557f3b5ad800 2024-04-25T02:17:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.752+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.0 v2:172.21.15.79:6802/1526100659 4 ==== osd_op_reply(16 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad800 2024-04-25T02:17:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.752+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:17 17.2 17:40000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa18800 con 0x557f3a9f9c00 2024-04-25T02:17:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.752+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.4 v2:172.21.15.189:6800/1910571406 2 ==== osd_op_reply(17 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3a9f9c00 2024-04-25T02:17:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.752+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:18 17.22 17:44000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa19800 con 0x557f3a9f9400 2024-04-25T02:17:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.752+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.5 v2:172.21.15.189:6802/1246927196 2 ==== osd_op_reply(18 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3a9f9400 2024-04-25T02:17:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.752+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:19 17.12 17:48000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa18c00 con 0x557f3b5adc00 2024-04-25T02:17:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.753+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.3 v2:172.21.15.79:6817/3072297369 5 ==== osd_op_reply(19 [pgnls start_epoch 119 out=81b] v118'22 uv22 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3b5adc00 2024-04-25T02:17:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.753+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:20 17.12 17:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f9800 con 0x557f3b5adc00 2024-04-25T02:17:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.753+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.3 v2:172.21.15.79:6817/3072297369 6 ==== osd_op_reply(20 10000000002.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3b5adc00 2024-04-25T02:17:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.753+0000 7f255a20c740 10 datascan.operator(): handling object 1099511627778.0 2024-04-25T02:17:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.753+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:21 17.12 17:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f8800 con 0x557f3b5adc00 2024-04-25T02:17:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.754+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.3 v2:172.21.15.79:6817/3072297369 7 ==== osd_op_reply(21 10000000002.00000000 [call] v119'23 uv23 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3b5adc00 2024-04-25T02:17:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.754+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:22 17.32 17:4c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f9000 con 0x557f3b543800 2024-04-25T02:17:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.755+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.7 v2:172.21.15.189:6824/3421948491 5 ==== osd_op_reply(22 [pgnls start_epoch 119 out=49b] v117'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b543800 2024-04-25T02:17:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.755+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:23 17.a 17:50000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa18400 con 0x557f3b543800 2024-04-25T02:17:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.755+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.7 v2:172.21.15.189:6824/3421948491 6 ==== osd_op_reply(23 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b543800 2024-04-25T02:17:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.755+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:24 17.2a 17:54000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa19c00 con 0x557f3b5adc00 2024-04-25T02:17:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.756+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.3 v2:172.21.15.79:6817/3072297369 8 ==== osd_op_reply(24 [pgnls start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3b5adc00 2024-04-25T02:17:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.756+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:25 17.1a 17:58000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa19800 con 0x557f3b5ad800 2024-04-25T02:17:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.756+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.0 v2:172.21.15.79:6802/1526100659 5 ==== osd_op_reply(25 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad800 2024-04-25T02:17:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.756+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:26 17.3a 17:5c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa18000 con 0x557f3b5ad000 2024-04-25T02:17:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.756+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.1 v2:172.21.15.79:6816/2311596149 3 ==== osd_op_reply(26 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3b5ad000 2024-04-25T02:17:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.756+0000 7f25535a0640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x557f3b5ad400 0x557f3aa08680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.756+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:27 17.6 17:60000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3b5ac800 con 0x557f3b5ad400 2024-04-25T02:17:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.756+0000 7f25575a8640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x557f3b5ad400 0x557f3aa08680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.757+0000 7f25575a8640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x557f3b5ad400 0x557f3aa08680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.757+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.6 v2:172.21.15.189:6816/1254358257 1 ==== osd_op_reply(27 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad400 2024-04-25T02:17:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.757+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:28 17.26 17:64000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa19400 con 0x557f3b5ad800 2024-04-25T02:17:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.757+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.0 v2:172.21.15.79:6802/1526100659 6 ==== osd_op_reply(28 [pgnls start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad800 2024-04-25T02:17:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.757+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:29 17.16 17:68000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f8400 con 0x557f3a9f9400 2024-04-25T02:17:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.758+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.5 v2:172.21.15.189:6802/1246927196 3 ==== osd_op_reply(29 [pgnls start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3a9f9400 2024-04-25T02:17:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.758+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:30 17.36 17:6c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa19000 con 0x557f3b5ad800 2024-04-25T02:17:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.758+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.0 v2:172.21.15.79:6802/1526100659 7 ==== osd_op_reply(30 [pgnls start_epoch 119 out=81b] v117'33 uv17 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad800 2024-04-25T02:17:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.758+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:31 17.36 17:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f8000 con 0x557f3b5ad800 2024-04-25T02:17:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.758+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.0 v2:172.21.15.79:6802/1526100659 8 ==== osd_op_reply(31 100000001f7.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad800 2024-04-25T02:17:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.758+0000 7f255a20c740 10 datascan.operator(): handling object 1099511628279.0 2024-04-25T02:17:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.758+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:32 17.36 17:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f8c00 con 0x557f3b5ad800 2024-04-25T02:17:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.759+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.0 v2:172.21.15.79:6802/1526100659 9 ==== osd_op_reply(32 100000001f7.00000000 [call] v119'34 uv34 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad800 2024-04-25T02:17:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.759+0000 7f255a20c740 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x557f3b543c00 0x557f3a6e9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.759+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:33 17.e 17:70000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa18400 con 0x557f3b543c00 2024-04-25T02:17:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.759+0000 7f25585aa640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x557f3b543c00 0x557f3a6e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.760+0000 7f25585aa640 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x557f3b543c00 0x557f3a6e9180 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.760+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.2 v2:172.21.15.79:6800/3397511354 1 ==== osd_op_reply(33 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3b543c00 2024-04-25T02:17:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.760+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:34 17.2e 17:74000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa30000 con 0x557f3b5ad400 2024-04-25T02:17:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.760+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.6 v2:172.21.15.189:6816/1254358257 2 ==== osd_op_reply(34 [pgnls start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad400 2024-04-25T02:17:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.760+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:35 17.1e 17:78000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa31c00 con 0x557f3b5ad000 2024-04-25T02:17:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.761+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.1 v2:172.21.15.79:6816/2311596149 4 ==== osd_op_reply(35 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3b5ad000 2024-04-25T02:17:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.761+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:36 17.3e 17:7c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa30400 con 0x557f3a9f9c00 2024-04-25T02:17:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.761+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.4 v2:172.21.15.189:6800/1910571406 3 ==== osd_op_reply(36 [pgnls start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3a9f9c00 2024-04-25T02:17:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.761+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:37 17.1 17:80000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa30400 con 0x557f3b5ad800 2024-04-25T02:17:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.761+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.0 v2:172.21.15.79:6802/1526100659 10 ==== osd_op_reply(37 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad800 2024-04-25T02:17:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.761+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:38 17.21 17:84000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa30800 con 0x557f3b5ad800 2024-04-25T02:17:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.762+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.0 v2:172.21.15.79:6802/1526100659 11 ==== osd_op_reply(38 [pgnls start_epoch 119 out=49b] v117'24 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad800 2024-04-25T02:17:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.762+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:39 17.11 17:88000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa18800 con 0x557f3b5adc00 2024-04-25T02:17:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.762+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.3 v2:172.21.15.79:6817/3072297369 9 ==== osd_op_reply(39 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3b5adc00 2024-04-25T02:17:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.762+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:40 17.31 17:8c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa30c00 con 0x557f3b5ad000 2024-04-25T02:17:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.762+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.1 v2:172.21.15.79:6816/2311596149 5 ==== osd_op_reply(40 [pgnls start_epoch 119 out=81b] v117'15 uv8 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3b5ad000 2024-04-25T02:17:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.762+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:41 17.31 17:8de29a03:::10000000004.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa19800 con 0x557f3b5ad000 2024-04-25T02:17:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.762+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.1 v2:172.21.15.79:6816/2311596149 6 ==== osd_op_reply(41 10000000004.00000001 [stat out=16b] v0'0 uv8 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3b5ad000 2024-04-25T02:17:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.762+0000 7f255a20c740 10 datascan.operator(): handling object 1099511627780.1 2024-04-25T02:17:57.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.762+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:42 17.5 17:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa19400 con 0x557f3b5ad400 2024-04-25T02:17:57.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.767+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.6 v2:172.21.15.189:6816/1254358257 3 ==== osd_op_reply(42 10000000004.00000000 [call] v119'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad400 2024-04-25T02:17:57.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.767+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:43 17.9 17:90000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa19000 con 0x557f3b5adc00 2024-04-25T02:17:57.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.767+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.3 v2:172.21.15.79:6817/3072297369 10 ==== osd_op_reply(43 [pgnls start_epoch 119 out=49b] v117'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3b5adc00 2024-04-25T02:17:57.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.767+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:44 17.29 17:94000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa31000 con 0x557f3a9f9c00 2024-04-25T02:17:57.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.768+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.4 v2:172.21.15.189:6800/1910571406 4 ==== osd_op_reply(44 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3a9f9c00 2024-04-25T02:17:57.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.768+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:45 17.19 17:98000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa18c00 con 0x557f3a9f9400 2024-04-25T02:17:57.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.768+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.5 v2:172.21.15.189:6802/1246927196 4 ==== osd_op_reply(45 [pgnls start_epoch 119 out=81b] v118'23 uv23 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3a9f9400 2024-04-25T02:17:57.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.768+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:46 17.19 17:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x557f3b5ac800 con 0x557f3a9f9400 2024-04-25T02:17:57.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.768+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.5 v2:172.21.15.189:6802/1246927196 5 ==== osd_op_reply(46 100000001f8.00000000 [stat out=16b] v0'0 uv23 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3a9f9400 2024-04-25T02:17:57.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.768+0000 7f255a20c740 10 datascan.operator(): handling object 1099511628280.0 2024-04-25T02:17:57.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.768+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:47 17.19 17:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f9000 con 0x557f3a9f9400 2024-04-25T02:17:57.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.774+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.5 v2:172.21.15.189:6802/1246927196 6 ==== osd_op_reply(47 100000001f8.00000000 [call] v119'24 uv24 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3a9f9400 2024-04-25T02:17:57.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.774+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:48 17.39 17:9c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa31c00 con 0x557f3a9f9400 2024-04-25T02:17:57.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.774+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.5 v2:172.21.15.189:6802/1246927196 7 ==== osd_op_reply(48 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3a9f9400 2024-04-25T02:17:57.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.774+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:49 17.5 17:a0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa19c00 con 0x557f3b5ad400 2024-04-25T02:17:57.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.775+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.6 v2:172.21.15.189:6816/1254358257 4 ==== osd_op_reply(49 [pgnls start_epoch 119 out=81b] v119'14 uv14 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad400 2024-04-25T02:17:57.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.775+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:50 17.5 17:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa30c00 con 0x557f3b5ad400 2024-04-25T02:17:57.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.775+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.6 v2:172.21.15.189:6816/1254358257 5 ==== osd_op_reply(50 10000000004.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad400 2024-04-25T02:17:57.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.775+0000 7f255a20c740 10 datascan.operator(): handling object 1099511627780.0 2024-04-25T02:17:57.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.775+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:51 17.5 17:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa18000 con 0x557f3b5ad400 2024-04-25T02:17:57.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.775+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.6 v2:172.21.15.189:6816/1254358257 6 ==== osd_op_reply(51 10000000004.00000000 [call] v119'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad400 2024-04-25T02:17:57.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.775+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:52 17.25 17:a4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa18400 con 0x557f3b5ad000 2024-04-25T02:17:57.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.776+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.1 v2:172.21.15.79:6816/2311596149 7 ==== osd_op_reply(52 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3b5ad000 2024-04-25T02:17:57.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.776+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:53 17.15 17:a8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f9800 con 0x557f3a9f9400 2024-04-25T02:17:57.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.776+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.5 v2:172.21.15.189:6802/1246927196 8 ==== osd_op_reply(53 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3a9f9400 2024-04-25T02:17:57.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.776+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:54 17.35 17:ac000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa31400 con 0x557f3a9f9c00 2024-04-25T02:17:57.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.777+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.4 v2:172.21.15.189:6800/1910571406 5 ==== osd_op_reply(54 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3a9f9c00 2024-04-25T02:17:57.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.777+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:55 17.d 17:b0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f8800 con 0x557f3b543800 2024-04-25T02:17:57.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.777+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.7 v2:172.21.15.189:6824/3421948491 7 ==== osd_op_reply(55 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b543800 2024-04-25T02:17:57.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.777+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:56 17.2d 17:b4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa31800 con 0x557f3b543800 2024-04-25T02:17:57.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.777+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.7 v2:172.21.15.189:6824/3421948491 8 ==== osd_op_reply(56 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b543800 2024-04-25T02:17:57.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.777+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:57 17.1d 17:b8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa31c00 con 0x557f3b543800 2024-04-25T02:17:57.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.778+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.7 v2:172.21.15.189:6824/3421948491 9 ==== osd_op_reply(57 [pgnls start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b543800 2024-04-25T02:17:57.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.778+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:58 17.3d 17:bc000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa19800 con 0x557f3b543800 2024-04-25T02:17:57.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.778+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.7 v2:172.21.15.189:6824/3421948491 10 ==== osd_op_reply(58 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b543800 2024-04-25T02:17:57.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.778+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:59 17.3 17:c0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa30000 con 0x557f3a9f9c00 2024-04-25T02:17:57.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.778+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.4 v2:172.21.15.189:6800/1910571406 6 ==== osd_op_reply(59 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3a9f9c00 2024-04-25T02:17:57.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.778+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:60 17.23 17:c4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa18c00 con 0x557f3a9f9c00 2024-04-25T02:17:57.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.779+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.4 v2:172.21.15.189:6800/1910571406 7 ==== osd_op_reply(60 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3a9f9c00 2024-04-25T02:17:57.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.779+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:61 17.13 17:c8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa30400 con 0x557f3b5adc00 2024-04-25T02:17:57.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.779+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.3 v2:172.21.15.79:6817/3072297369 11 ==== osd_op_reply(61 [pgnls start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3b5adc00 2024-04-25T02:17:57.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.779+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:62 17.33 17:cc000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa18400 con 0x557f3b543800 2024-04-25T02:17:57.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.779+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.7 v2:172.21.15.189:6824/3421948491 11 ==== osd_op_reply(62 [pgnls start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b543800 2024-04-25T02:17:57.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.779+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:63 17.b 17:d0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa30800 con 0x557f3b543c00 2024-04-25T02:17:57.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.779+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.2 v2:172.21.15.79:6800/3397511354 2 ==== osd_op_reply(63 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3b543c00 2024-04-25T02:17:57.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.779+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:64 17.2b 17:d4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa19400 con 0x557f3a9f9c00 2024-04-25T02:17:57.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.780+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.4 v2:172.21.15.189:6800/1910571406 8 ==== osd_op_reply(64 [pgnls start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3a9f9c00 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.780+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:65 17.1b 17:d8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f9000 con 0x557f3a9f9c00 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.780+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.4 v2:172.21.15.189:6800/1910571406 9 ==== osd_op_reply(65 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3a9f9c00 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.780+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:66 17.3b 17:dc000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa19c00 con 0x557f3b543c00 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.780+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.2 v2:172.21.15.79:6800/3397511354 3 ==== osd_op_reply(66 [pgnls start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3b543c00 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.780+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:67 17.7 17:e0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f8000 con 0x557f3b5ad800 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.780+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.0 v2:172.21.15.79:6802/1526100659 12 ==== osd_op_reply(67 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad800 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.780+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:68 17.27 17:e4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa30c00 con 0x557f3a9f9c00 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.781+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.4 v2:172.21.15.189:6800/1910571406 10 ==== osd_op_reply(68 [pgnls start_epoch 119 out=49b] v117'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3a9f9c00 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.781+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:69 17.17 17:e8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3a9f8c00 con 0x557f3b5ad400 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.781+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.6 v2:172.21.15.189:6816/1254358257 7 ==== osd_op_reply(69 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad400 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.781+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:70 17.37 17:ec000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa18000 con 0x557f3b5ad800 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.781+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.0 v2:172.21.15.79:6802/1526100659 13 ==== osd_op_reply(70 [pgnls start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad800 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.781+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:71 17.f 17:f0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3b5ac800 con 0x557f3b5ad000 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.782+0000 7f25585aa640 1 -- 172.21.15.79:0/3205946184 <== osd.1 v2:172.21.15.79:6816/2311596149 8 ==== osd_op_reply(71 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6500 con 0x557f3b5ad000 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.782+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:72 17.2f 17:f4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa19800 con 0x557f3a9f9c00 2024-04-25T02:17:57.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.782+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 <== osd.4 v2:172.21.15.189:6800/1910571406 11 ==== osd_op_reply(72 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6780 con 0x557f3a9f9c00 2024-04-25T02:17:57.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.782+0000 7f25535a0640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:73 17.1f 17:f8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa31800 con 0x557f3b5ad400 2024-04-25T02:17:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.6 v2:172.21.15.189:6816/1254358257 8 ==== osd_op_reply(73 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad400 2024-04-25T02:17:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f2552d9f640 1 -- 172.21.15.79:0/3205946184 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:74 17.3f 17:fc000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x557f3aa18400 con 0x557f3b5ad800 2024-04-25T02:17:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f25575a8640 1 -- 172.21.15.79:0/3205946184 <== osd.0 v2:172.21.15.79:6802/1526100659 14 ==== osd_op_reply(74 [pgnls start_epoch 119 out=49b] v117'17 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x557f3b3e6000 con 0x557f3b5ad800 2024-04-25T02:17:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x557f3b5ad800 msgr2=0x557f3aa06b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x557f3b5ad800 0x557f3aa06b00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x557f3b5ad000 msgr2=0x557f3aa06000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x557f3b5ad000 0x557f3aa06000 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x557f3b543c00 msgr2=0x557f3a6e9180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x557f3b543c00 0x557f3a6e9180 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x557f3b5adc00 msgr2=0x557f3aa06580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 reap_dead start 2024-04-25T02:17:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x557f3b5adc00 0x557f3aa06580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x557f3a9f9c00 msgr2=0x557f3aa07600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x557f3a9f9c00 0x557f3aa07600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x557f3a9f9400 msgr2=0x557f3aa07080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x557f3a9f9400 0x557f3aa07080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x557f3b5ad400 msgr2=0x557f3aa08680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x557f3b5ad400 0x557f3aa08680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x557f3b543800 msgr2=0x557f3a6e8c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x557f3b543800 0x557f3a6e8c00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f2557da9640 1 -- 172.21.15.79:0/3205946184 reap_dead start 2024-04-25T02:17:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x557f3b5acc00 msgr2=0x557f3a6e9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x557f3b5acc00 0x557f3a6e9700 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x557f3b54d0b0 tx=0x557f3b550c00 comp rx=0 tx=0).stop 2024-04-25T02:17:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b543000 msgr2=0x557f3a6e8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b543000 0x557f3a6e8100 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x557f3b497620 tx=0x557f3b410c60 comp rx=0 tx=0).stop 2024-04-25T02:17:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 shutdown_connections 2024-04-25T02:17:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x557f3b5acc00 0x557f3a6e9700 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 --2- 172.21.15.79:0/3205946184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b543000 0x557f3a6e8100 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 >> 172.21.15.79:0/3205946184 conn(0x557f3b45c400 msgr2=0x557f3b3f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 shutdown_connections 2024-04-25T02:17:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.783+0000 7f255a20c740 1 -- 172.21.15.79:0/3205946184 wait complete. 2024-04-25T02:17:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.784+0000 7f255a20c740 1 -- 172.21.15.79:0/3351786161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b45c800 msgr2=0x557f3a6e7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.784+0000 7f255a20c740 1 --2- 172.21.15.79:0/3351786161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b45c800 0x557f3a6e7600 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x557f3b497ad0 tx=0x557f3b410180 comp rx=0 tx=0).stop 2024-04-25T02:17:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.784+0000 7f255a20c740 1 -- 172.21.15.79:0/3351786161 shutdown_connections 2024-04-25T02:17:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.784+0000 7f255a20c740 1 --2- 172.21.15.79:0/3351786161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557f3b45c800 0x557f3a6e7600 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.784+0000 7f255a20c740 1 --2- 172.21.15.79:0/3351786161 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x557f3a673c00 0x557f3a6e7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.784+0000 7f255a20c740 1 --2- 172.21.15.79:0/3351786161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557f3b45c000 0x557f3a6e7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.784+0000 7f255a20c740 1 -- 172.21.15.79:0/3351786161 >> 172.21.15.79:0/3351786161 conn(0x557f3a673000 msgr2=0x557f3b3f7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.784+0000 7f255a20c740 1 -- 172.21.15.79:0/3351786161 shutdown_connections 2024-04-25T02:17:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.784+0000 7f255a20c740 1 -- 172.21.15.79:0/3351786161 wait complete. 2024-04-25T02:17:57.795 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.129456, result: 2024-04-25T02:17:57.795 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --filter-tag mytag123 cephfs_data 2024-04-25T02:17:57.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.867+0000 7faa82421740 1 -- start start 2024-04-25T02:17:57.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.867+0000 7faa82421740 1 Processor -- start 2024-04-25T02:17:57.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.867+0000 7faa82421740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55957a22ac00 0x55957a29fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.867+0000 7faa82421740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957a22b800 0x55957a29f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.867+0000 7faa82421740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55957a22bc00 0x55957a29f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.867+0000 7faa82421740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55957b010180 con 0x55957a22b800 2024-04-25T02:17:57.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.867+0000 7faa82421740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55957a28a900 con 0x55957a22ac00 2024-04-25T02:17:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.867+0000 7faa82421740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55957a28a480 con 0x55957a22bc00 2024-04-25T02:17:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa7f8ab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957a22b800 0x55957a29f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa7f8ab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957a22b800 0x55957a29f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56810/0 (socket says 172.21.15.79:56810) 2024-04-25T02:17:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa7f8ab640 1 -- 172.21.15.79:0/2142709416 learned_addr learned my addr 172.21.15.79:0/2142709416 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa800ac640 1 --2- 172.21.15.79:0/2142709416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55957a22ac00 0x55957a29fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa808ad640 1 --2- 172.21.15.79:0/2142709416 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55957a22bc00 0x55957a29f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa7f8ab640 1 -- 172.21.15.79:0/2142709416 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55957a22bc00 msgr2=0x55957a29f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa7f8ab640 1 --2- 172.21.15.79:0/2142709416 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55957a22bc00 0x55957a29f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa7f8ab640 1 -- 172.21.15.79:0/2142709416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55957a22ac00 msgr2=0x55957a29fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa7f8ab640 1 --2- 172.21.15.79:0/2142709416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55957a22ac00 0x55957a29fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa7f8ab640 1 -- 172.21.15.79:0/2142709416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55957a257680 con 0x55957a22b800 2024-04-25T02:17:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa7f8ab640 1 --2- 172.21.15.79:0/2142709416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957a22b800 0x55957a29f600 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x55957b04bc50 tx=0x55957afc8120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f573a51e20efe294 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa7d8a7640 1 -- 172.21.15.79:0/2142709416 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55957a250680 con 0x55957a22b800 2024-04-25T02:17:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa7d8a7640 1 -- 172.21.15.79:0/2142709416 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55957a2741c0 con 0x55957a22b800 2024-04-25T02:17:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa7d8a7640 1 -- 172.21.15.79:0/2142709416 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55957a250b60 con 0x55957a22b800 2024-04-25T02:17:57.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa82421740 1 -- 172.21.15.79:0/2142709416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55957a257860 con 0x55957a22b800 2024-04-25T02:17:57.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa82421740 1 -- 172.21.15.79:0/2142709416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55957a2572c0 con 0x55957a22b800 2024-04-25T02:17:57.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa82421740 4 waiting for MDS map... 2024-04-25T02:17:57.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa7d8a7640 1 -- 172.21.15.79:0/2142709416 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x55957b102600 con 0x55957a22b800 2024-04-25T02:17:57.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa7d8a7640 1 -- 172.21.15.79:0/2142709416 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x55957a283180 con 0x55957a22b800 2024-04-25T02:17:57.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.868+0000 7faa82421740 4 Got MDS map 90 2024-04-25T02:17:57.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.869+0000 7faa82421740 10 datascan.parse_kwarg: Applying tag filter: 'mytag123' 2024-04-25T02:17:57.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.869+0000 7faa82421740 4 datascan.main: Using metadata pool output 2024-04-25T02:17:57.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.869+0000 7faa82421740 4 datascan.main: connecting to RADOS... 2024-04-25T02:17:57.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.869+0000 7faa82421740 1 Processor -- start 2024-04-25T02:17:57.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.869+0000 7faa82421740 1 -- start start 2024-04-25T02:17:57.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa82421740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957b105400 0x55957a29eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa82421740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55957b105800 0x55957a29e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa82421740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55957b105c00 0x55957a2a0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa82421740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55957a28a180 con 0x55957b105400 2024-04-25T02:17:57.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa82421740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55957b010d80 con 0x55957b105c00 2024-04-25T02:17:57.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa82421740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55957b010f00 con 0x55957b105800 2024-04-25T02:17:57.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa808ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957b105400 0x55957a29eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa808ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957b105400 0x55957a29eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56812/0 (socket says 172.21.15.79:56812) 2024-04-25T02:17:57.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa808ad640 1 -- 172.21.15.79:0/672015606 learned_addr learned my addr 172.21.15.79:0/672015606 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa808ad640 1 -- 172.21.15.79:0/672015606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55957b105800 msgr2=0x55957a29e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa800ac640 1 --2- 172.21.15.79:0/672015606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55957b105800 0x55957a29e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa808ad640 1 --2- 172.21.15.79:0/672015606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55957b105800 0x55957a29e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa808ad640 1 -- 172.21.15.79:0/672015606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55957b105c00 msgr2=0x55957a2a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:57.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa808ad640 1 --2- 172.21.15.79:0/672015606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55957b105c00 0x55957a2a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa808ad640 1 -- 172.21.15.79:0/672015606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55957a2574a0 con 0x55957b105400 2024-04-25T02:17:57.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa808ad640 1 --2- 172.21.15.79:0/672015606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957b105400 0x55957a29eb00 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x55957b04b2f0 tx=0x55957afc4c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ecf176aa111f60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa7b8a3640 1 -- 172.21.15.79:0/672015606 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55957a2509c0 con 0x55957b105400 2024-04-25T02:17:57.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa7b8a3640 1 -- 172.21.15.79:0/672015606 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55957a274e00 con 0x55957b105400 2024-04-25T02:17:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.870+0000 7faa7b8a3640 1 -- 172.21.15.79:0/672015606 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55957a250680 con 0x55957b105400 2024-04-25T02:17:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.871+0000 7faa82421740 1 -- 172.21.15.79:0/672015606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957b105400 msgr2=0x55957a29eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.871+0000 7faa82421740 1 --2- 172.21.15.79:0/672015606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957b105400 0x55957a29eb00 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x55957b04b2f0 tx=0x55957afc4c00 comp rx=0 tx=0).stop 2024-04-25T02:17:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.871+0000 7faa82421740 1 -- 172.21.15.79:0/672015606 shutdown_connections 2024-04-25T02:17:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.871+0000 7faa82421740 1 --2- 172.21.15.79:0/672015606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55957b105c00 0x55957a2a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.871+0000 7faa82421740 1 --2- 172.21.15.79:0/672015606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55957b105800 0x55957a29e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.871+0000 7faa82421740 1 --2- 172.21.15.79:0/672015606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957b105400 0x55957a29eb00 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.871+0000 7faa82421740 1 -- 172.21.15.79:0/672015606 >> 172.21.15.79:0/672015606 conn(0x55957b105000 msgr2=0x55957a333000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.871+0000 7faa82421740 1 -- 172.21.15.79:0/672015606 shutdown_connections 2024-04-25T02:17:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.871+0000 7faa82421740 1 -- 172.21.15.79:0/672015606 wait complete. 2024-04-25T02:17:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.871+0000 7faa82421740 1 Processor -- start 2024-04-25T02:17:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.871+0000 7faa82421740 1 -- start start 2024-04-25T02:17:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa82421740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55957b105400 0x55957a29eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa82421740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55957b105800 0x55957a29e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa82421740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957b105c00 0x55957a2a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa82421740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55957b011200 con 0x55957b105c00 2024-04-25T02:17:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa82421740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55957b011080 con 0x55957b105400 2024-04-25T02:17:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa82421740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x55957b011380 con 0x55957b105800 2024-04-25T02:17:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa7f8ab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957b105c00 0x55957a2a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa7f8ab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957b105c00 0x55957a2a0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56828/0 (socket says 172.21.15.79:56828) 2024-04-25T02:17:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 learned_addr learned my addr 172.21.15.79:0/1805927015 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55957b105800 msgr2=0x55957a29e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa7f8ab640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55957b105800 0x55957a29e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55957b105400 msgr2=0x55957a29eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa7f8ab640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55957b105400 0x55957a29eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55957a257680 con 0x55957b105c00 2024-04-25T02:17:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa7f8ab640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957b105c00 0x55957a2a0100 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x55957b009bf0 tx=0x55957afc4a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa7a0a0640 1 -- 172.21.15.79:0/1805927015 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55957a250820 con 0x55957b105c00 2024-04-25T02:17:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa7a0a0640 1 -- 172.21.15.79:0/1805927015 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55957a274540 con 0x55957b105c00 2024-04-25T02:17:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.872+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55957a257860 con 0x55957b105c00 2024-04-25T02:17:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.873+0000 7faa7a0a0640 1 -- 172.21.15.79:0/1805927015 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55957a2509c0 con 0x55957b105c00 2024-04-25T02:17:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.873+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55957a2570e0 con 0x55957b105c00 2024-04-25T02:17:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.873+0000 7faa82421740 4 datascan.init: resolving metadata pool 16 2024-04-25T02:17:57.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.874+0000 7faa7a0a0640 1 -- 172.21.15.79:0/1805927015 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55957b032c00 con 0x55957b105c00 2024-04-25T02:17:57.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.874+0000 7faa7a0a0640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55957b165000 0x55957a598000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.874+0000 7faa7a0a0640 1 -- 172.21.15.79:0/1805927015 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x55957b162600 con 0x55957b105c00 2024-04-25T02:17:57.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.874+0000 7faa82421740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T02:17:57.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.874+0000 7faa82421740 4 datascan.main: data pool 'cephfs_data' has ID 17 2024-04-25T02:17:57.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.874+0000 7faa82421740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T02:17:57.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.874+0000 7faa808ad640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55957b165000 0x55957a598000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.874+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55957b165400 0x55957a2a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.874+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:1 16.14 16:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x55957b165800 con 0x55957b165400 2024-04-25T02:17:57.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.874+0000 7faa800ac640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55957b165400 0x55957a2a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.874+0000 7faa808ad640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55957b165000 0x55957a598000 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x55957b04b2f0 tx=0x55957afc8180 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.875+0000 7faa800ac640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55957b165400 0x55957a2a0680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.875+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv34 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.875+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55957b165c00 0x55957a2a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.875+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:2 16.1f 16:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b0000 con 0x55957b165c00 2024-04-25T02:17:57.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.875+0000 7faa808ad640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55957b165c00 0x55957a2a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.876+0000 7faa808ad640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55957b165c00 0x55957a2a0c00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.876+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.5 v2:172.21.15.189:6802/1246927196 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x55957af9e500 con 0x55957b165c00 2024-04-25T02:17:57.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.876+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x55957a5b0400 0x55957a2a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.876+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:3 17.0 17:00000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b0800 con 0x55957a5b0400 2024-04-25T02:17:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.876+0000 7faa800ac640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x55957a5b0400 0x55957a2a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.877+0000 7faa800ac640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x55957a5b0400 0x55957a2a1180 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.877+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.7 v2:172.21.15.189:6824/3421948491 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b0400 2024-04-25T02:17:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.877+0000 7faa7b0a2640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55957b165800 0x55957a598580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.877+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:4 17.20 17:04000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b0800 con 0x55957b165800 2024-04-25T02:17:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.877+0000 7faa7f8ab640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55957b165800 0x55957a598580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.877+0000 7faa7f8ab640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55957b165800 0x55957a598580 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.878+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 <== osd.1 v2:172.21.15.79:6816/2311596149 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e780 con 0x55957b165800 2024-04-25T02:17:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.878+0000 7faa7b8a3640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55957a5b1c00 0x55957a598b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.878+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:5 17.10 17:08000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6000 con 0x55957a5b1c00 2024-04-25T02:17:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.878+0000 7faa808ad640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55957a5b1c00 0x55957a598b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.878+0000 7faa808ad640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55957a5b1c00 0x55957a598b00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.878+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.878+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:6 17.30 17:0c000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b1800 con 0x55957b165400 2024-04-25T02:17:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.878+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.878+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:7 17.8 17:10000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6400 con 0x55957a5b0400 2024-04-25T02:17:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.879+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.7 v2:172.21.15.189:6824/3421948491 2 ==== osd_op_reply(7 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b0400 2024-04-25T02:17:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.879+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:8 17.28 17:14000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6800 con 0x55957a5b1c00 2024-04-25T02:17:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.879+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.879+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:9 17.18 17:18000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b0000 con 0x55957b165400 2024-04-25T02:17:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.879+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 3 ==== osd_op_reply(9 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.879+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:10 17.38 17:1c000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6c00 con 0x55957a5b0400 2024-04-25T02:17:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.880+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.7 v2:172.21.15.189:6824/3421948491 3 ==== osd_op_reply(10 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b0400 2024-04-25T02:17:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.880+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:11 17.4 17:20000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957b013400 con 0x55957b165400 2024-04-25T02:17:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.880+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 4 ==== osd_op_reply(11 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.880+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:12 17.24 17:24000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b7000 con 0x55957a5b1c00 2024-04-25T02:17:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.880+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 3 ==== osd_op_reply(12 [pgnls-filter start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.880+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:13 17.14 17:28000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957b013000 con 0x55957a5b1c00 2024-04-25T02:17:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.880+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 4 ==== osd_op_reply(13 [pgnls-filter start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.880+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:14 17.34 17:2c000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6400 con 0x55957b165c00 2024-04-25T02:17:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.881+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.5 v2:172.21.15.189:6802/1246927196 2 ==== osd_op_reply(14 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957b165c00 2024-04-25T02:17:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.881+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:15 17.c 17:30000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6800 con 0x55957a5b0400 2024-04-25T02:17:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.881+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.7 v2:172.21.15.189:6824/3421948491 4 ==== osd_op_reply(15 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b0400 2024-04-25T02:17:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.881+0000 7faa7b0a2640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55957a5b6000 0x55957a599080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.881+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:16 17.2c 17:34000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b1800 con 0x55957a5b6000 2024-04-25T02:17:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.881+0000 7faa800ac640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55957a5b6000 0x55957a599080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.882+0000 7faa800ac640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55957a5b6000 0x55957a599080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.882+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.4 v2:172.21.15.189:6800/1910571406 1 ==== osd_op_reply(16 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b6000 2024-04-25T02:17:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.882+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:17 17.1c 17:38000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b7400 con 0x55957b165800 2024-04-25T02:17:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.882+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 <== osd.1 v2:172.21.15.79:6816/2311596149 2 ==== osd_op_reply(17 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e780 con 0x55957b165800 2024-04-25T02:17:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.882+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:18 17.3c 17:3c000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b0000 con 0x55957b165400 2024-04-25T02:17:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.882+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 5 ==== osd_op_reply(18 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.882+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:19 17.2 17:40000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b7800 con 0x55957a5b6000 2024-04-25T02:17:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.883+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.4 v2:172.21.15.189:6800/1910571406 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b6000 2024-04-25T02:17:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.883+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:20 17.22 17:44000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b1800 con 0x55957b165c00 2024-04-25T02:17:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.883+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.5 v2:172.21.15.189:6802/1246927196 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957b165c00 2024-04-25T02:17:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.883+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:21 17.12 17:48000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b7c00 con 0x55957a5b1c00 2024-04-25T02:17:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.883+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 5 ==== osd_op_reply(21 [pgnls-filter start_epoch 119 out=81b] v119'23 uv23 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.883+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:22 17.0 17:00000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b0c00 con 0x55957a5b0400 2024-04-25T02:17:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.884+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.7 v2:172.21.15.189:6824/3421948491 5 ==== osd_op_reply(22 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b0400 2024-04-25T02:17:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.884+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:23 17.20 17:04000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5c4000 con 0x55957b165800 2024-04-25T02:17:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.884+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 <== osd.1 v2:172.21.15.79:6816/2311596149 3 ==== osd_op_reply(23 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e780 con 0x55957b165800 2024-04-25T02:17:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.884+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:24 17.10 17:08000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6c00 con 0x55957a5b1c00 2024-04-25T02:17:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.884+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 6 ==== osd_op_reply(24 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.884+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:25 17.30 17:0c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5c4400 con 0x55957b165400 2024-04-25T02:17:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.884+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 6 ==== osd_op_reply(25 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.884+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:26 17.8 17:10000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6800 con 0x55957a5b0400 2024-04-25T02:17:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.885+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.7 v2:172.21.15.189:6824/3421948491 6 ==== osd_op_reply(26 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b0400 2024-04-25T02:17:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.885+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:27 17.28 17:14000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5c4800 con 0x55957a5b1c00 2024-04-25T02:17:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.885+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 7 ==== osd_op_reply(27 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.885+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:28 17.18 17:18000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957b013400 con 0x55957b165400 2024-04-25T02:17:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.885+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 7 ==== osd_op_reply(28 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.885+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:29 17.38 17:1c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5c4c00 con 0x55957a5b0400 2024-04-25T02:17:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.885+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.7 v2:172.21.15.189:6824/3421948491 7 ==== osd_op_reply(29 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b0400 2024-04-25T02:17:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.885+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:30 17.4 17:20000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b7800 con 0x55957b165400 2024-04-25T02:17:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.885+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 8 ==== osd_op_reply(30 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.885+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:31 17.24 17:24000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5c5000 con 0x55957a5b1c00 2024-04-25T02:17:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.886+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 8 ==== osd_op_reply(31 [pgnls-filter start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.886+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:32 17.14 17:28000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6800 con 0x55957a5b1c00 2024-04-25T02:17:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.886+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 9 ==== osd_op_reply(32 [pgnls-filter start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.886+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:33 17.34 17:2c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5c4400 con 0x55957b165c00 2024-04-25T02:17:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.886+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.5 v2:172.21.15.189:6802/1246927196 4 ==== osd_op_reply(33 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957b165c00 2024-04-25T02:17:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.886+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:34 17.c 17:30000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b0000 con 0x55957a5b0400 2024-04-25T02:17:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.887+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.7 v2:172.21.15.189:6824/3421948491 8 ==== osd_op_reply(34 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b0400 2024-04-25T02:17:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.887+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:35 17.2c 17:34000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5c5400 con 0x55957a5b6000 2024-04-25T02:17:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.887+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.4 v2:172.21.15.189:6800/1910571406 3 ==== osd_op_reply(35 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b6000 2024-04-25T02:17:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.887+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:36 17.1c 17:38000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b0c00 con 0x55957b165800 2024-04-25T02:17:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.887+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 <== osd.1 v2:172.21.15.79:6816/2311596149 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e780 con 0x55957b165800 2024-04-25T02:17:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.887+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:37 17.3c 17:3c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b7000 con 0x55957b165400 2024-04-25T02:17:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.888+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 9 ==== osd_op_reply(37 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.888+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:38 17.2 17:40000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b1800 con 0x55957a5b6000 2024-04-25T02:17:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.888+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.4 v2:172.21.15.189:6800/1910571406 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b6000 2024-04-25T02:17:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.888+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:39 17.22 17:44000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6400 con 0x55957b165c00 2024-04-25T02:17:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.888+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.5 v2:172.21.15.189:6802/1246927196 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957b165c00 2024-04-25T02:17:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.888+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:40 17.12 17:48000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957b013000 con 0x55957a5b1c00 2024-04-25T02:17:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.888+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 10 ==== osd_op_reply(40 [pgnls-filter start_epoch 119 out=49b] v119'23 uv23 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.889+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:41 17.32 17:4c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b7c00 con 0x55957a5b0400 2024-04-25T02:17:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.889+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.7 v2:172.21.15.189:6824/3421948491 9 ==== osd_op_reply(41 [pgnls-filter start_epoch 119 out=49b] v117'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b0400 2024-04-25T02:17:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.889+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:42 17.a 17:50000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b0000 con 0x55957a5b0400 2024-04-25T02:17:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.889+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.7 v2:172.21.15.189:6824/3421948491 10 ==== osd_op_reply(42 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b0400 2024-04-25T02:17:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.889+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:43 17.2a 17:54000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6c00 con 0x55957a5b1c00 2024-04-25T02:17:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.890+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 11 ==== osd_op_reply(43 [pgnls-filter start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.890+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:44 17.1a 17:58000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b7800 con 0x55957b165400 2024-04-25T02:17:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.890+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 10 ==== osd_op_reply(44 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.890+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:45 17.3a 17:5c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b0800 con 0x55957b165800 2024-04-25T02:17:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.890+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 <== osd.1 v2:172.21.15.79:6816/2311596149 5 ==== osd_op_reply(45 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e780 con 0x55957b165800 2024-04-25T02:17:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.890+0000 7faa7b0a2640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55957a5b7000 0x55957a599600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.890+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:46 17.6 17:60000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b7400 con 0x55957a5b7000 2024-04-25T02:17:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.890+0000 7faa7f8ab640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55957a5b7000 0x55957a599600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.891+0000 7faa7f8ab640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55957a5b7000 0x55957a599600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.891+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 <== osd.6 v2:172.21.15.189:6816/1254358257 1 ==== osd_op_reply(46 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e780 con 0x55957a5b7000 2024-04-25T02:17:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.891+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:47 17.26 17:64000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b0c00 con 0x55957b165400 2024-04-25T02:17:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.891+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 11 ==== osd_op_reply(47 [pgnls-filter start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.891+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:48 17.16 17:68000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957b164c00 con 0x55957b165c00 2024-04-25T02:17:57.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.892+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.5 v2:172.21.15.189:6802/1246927196 6 ==== osd_op_reply(48 [pgnls-filter start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957b165c00 2024-04-25T02:17:57.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.892+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:49 17.36 17:6c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6800 con 0x55957b165400 2024-04-25T02:17:57.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.892+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 12 ==== osd_op_reply(49 [pgnls-filter start_epoch 119 out=81b] v119'34 uv34 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.892+0000 7faa82421740 20 datascan.forall_objects: OSD matched oid 100000001f7.00000000 2024-04-25T02:17:57.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.892+0000 7faa82421740 10 datascan.operator(): handling object 100000001f7.0 2024-04-25T02:17:57.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.892+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:50 17.36 17:6fe38dc2:::100000001f7.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b1400 con 0x55957b165400 2024-04-25T02:17:57.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.892+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 13 ==== osd_op_reply(50 100000001f7.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (126) out=126b,getxattr (30) out=30b,getxattr] v0'0 uv34 ondisk = 0) ==== 416+0+194 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.892+0000 7faa82421740 10 datascan.inject_with_backtrace: inode: 0x0x100000001f7 2024-04-25T02:17:57.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.892+0000 7faa82421740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000001/bravo 2024-04-25T02:17:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.892+0000 7faa82421740 20 datascan.get_frag_of: dirino=0x10000000001 target_dname=bravo 2024-04-25T02:17:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.892+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:51 16.7 16:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b1800 con 0x55957a5b1c00 2024-04-25T02:17:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.893+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 12 ==== osd_op_reply(51 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv8 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.893+0000 7faa82421740 20 datascan.get_frag_of: got backtrace parent 0x10000000000/flushed 2024-04-25T02:17:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.893+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x55957a5b0000 0x55957a2a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.893+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:52 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b0c00 con 0x55957a5b0000 2024-04-25T02:17:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.893+0000 7faa808ad640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x55957a5b0000 0x55957a2a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.893+0000 7faa808ad640 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x55957a5b0000 0x55957a2a1700 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.893+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.2 v2:172.21.15.79:6800/3397511354 1 ==== osd_op_reply(52 10000000000.00000000 [omap-get-vals-by-keys out=585b] v0'0 uv12 ondisk = 0) ==== 164+0+585 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b0000 2024-04-25T02:17:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.893+0000 7faa82421740 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed frag=*, r=0 2024-04-25T02:17:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.893+0000 7faa82421740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*) 2024-04-25T02:17:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.893+0000 7faa82421740 20 datascan.get_frag_of: frag is * 2024-04-25T02:17:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.893+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:53 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b1400 con 0x55957a5b1c00 2024-04-25T02:17:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.893+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 13 ==== osd_op_reply(53 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.894+0000 7faa82421740 10 datascan.find_or_create_dirfrag: read_version = 8 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.894+0000 7faa82421740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000001 * 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.894+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:54 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b7c00 con 0x55957a5b1c00 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.894+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 14 ==== osd_op_reply(54 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.894+0000 7faa82421740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.894+0000 7faa82421740 20 datascan.read_dentry: bravo_head not found in result 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.894+0000 7faa82421740 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f7 at 0x0x10000000001/bravo with size=5 bytes 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.894+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:55 16.7 16:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b7800 con 0x55957a5b1c00 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.895+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 15 ==== osd_op_reply(55 10000000001.00000000 [omap-set-vals] v119'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.895+0000 7faa82421740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.895+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:56 17.e 17:70000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6800 con 0x55957a5b0000 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.895+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.2 v2:172.21.15.79:6800/3397511354 2 ==== osd_op_reply(56 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b0000 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.895+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:57 17.2e 17:74000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6400 con 0x55957a5b7000 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.896+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 <== osd.6 v2:172.21.15.189:6816/1254358257 2 ==== osd_op_reply(57 [pgnls-filter start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e780 con 0x55957a5b7000 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.896+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:58 17.1e 17:78000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957b164800 con 0x55957b165800 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.896+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 <== osd.1 v2:172.21.15.79:6816/2311596149 6 ==== osd_op_reply(58 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e780 con 0x55957b165800 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.896+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:59 17.3e 17:7c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6c00 con 0x55957a5b6000 2024-04-25T02:17:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.896+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.4 v2:172.21.15.189:6800/1910571406 5 ==== osd_op_reply(59 [pgnls-filter start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b6000 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.896+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:60 17.1 17:80000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957b013400 con 0x55957b165400 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.897+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 14 ==== osd_op_reply(60 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.897+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:61 17.21 17:84000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957b013000 con 0x55957b165400 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.897+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 15 ==== osd_op_reply(61 [pgnls-filter start_epoch 119 out=49b] v117'24 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.897+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:62 17.11 17:88000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5e6000 con 0x55957a5b1c00 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.897+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 16 ==== osd_op_reply(62 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.897+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:63 17.31 17:8c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5e6000 con 0x55957b165800 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.897+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 <== osd.1 v2:172.21.15.79:6816/2311596149 7 ==== osd_op_reply(63 [pgnls-filter start_epoch 119 out=49b] v117'15 uv8 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e780 con 0x55957b165800 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.897+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:64 17.9 17:90000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5e6400 con 0x55957a5b1c00 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.898+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 17 ==== osd_op_reply(64 [pgnls-filter start_epoch 119 out=49b] v117'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.898+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:65 17.29 17:94000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b7c00 con 0x55957a5b6000 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.898+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.4 v2:172.21.15.189:6800/1910571406 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b6000 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.898+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:66 17.19 17:98000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5e6800 con 0x55957b165c00 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.898+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.5 v2:172.21.15.189:6802/1246927196 7 ==== osd_op_reply(66 [pgnls-filter start_epoch 119 out=49b] v119'24 uv24 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957b165c00 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.898+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:67 17.39 17:9c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b7800 con 0x55957b165c00 2024-04-25T02:17:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.899+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.5 v2:172.21.15.189:6802/1246927196 8 ==== osd_op_reply(67 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957b165c00 2024-04-25T02:17:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.899+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:68 17.5 17:a0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5e6c00 con 0x55957a5b7000 2024-04-25T02:17:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.899+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 <== osd.6 v2:172.21.15.189:6816/1254358257 3 ==== osd_op_reply(68 [pgnls-filter start_epoch 119 out=49b] v119'15 uv15 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e780 con 0x55957a5b7000 2024-04-25T02:17:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.899+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:69 17.25 17:a4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6800 con 0x55957b165800 2024-04-25T02:17:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.899+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 <== osd.1 v2:172.21.15.79:6816/2311596149 8 ==== osd_op_reply(69 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e780 con 0x55957b165800 2024-04-25T02:17:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.899+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:70 17.15 17:a8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5e7000 con 0x55957b165c00 2024-04-25T02:17:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.900+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.5 v2:172.21.15.189:6802/1246927196 9 ==== osd_op_reply(70 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957b165c00 2024-04-25T02:17:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.900+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:71 17.35 17:ac000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b1800 con 0x55957a5b6000 2024-04-25T02:17:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.900+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.4 v2:172.21.15.189:6800/1910571406 7 ==== osd_op_reply(71 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b6000 2024-04-25T02:17:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.900+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:72 17.d 17:b0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5e7400 con 0x55957a5b0400 2024-04-25T02:17:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.900+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.7 v2:172.21.15.189:6824/3421948491 11 ==== osd_op_reply(72 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b0400 2024-04-25T02:17:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.900+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:73 17.2d 17:b4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b0c00 con 0x55957a5b0400 2024-04-25T02:17:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.901+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.7 v2:172.21.15.189:6824/3421948491 12 ==== osd_op_reply(73 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b0400 2024-04-25T02:17:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.901+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:74 17.1d 17:b8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5e7800 con 0x55957a5b0400 2024-04-25T02:17:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.901+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.7 v2:172.21.15.189:6824/3421948491 13 ==== osd_op_reply(74 [pgnls-filter start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b0400 2024-04-25T02:17:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.901+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:75 17.3d 17:bc000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b1400 con 0x55957a5b0400 2024-04-25T02:17:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.901+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.7 v2:172.21.15.189:6824/3421948491 14 ==== osd_op_reply(75 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b0400 2024-04-25T02:17:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.901+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:76 17.3 17:c0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5e7c00 con 0x55957a5b6000 2024-04-25T02:17:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.902+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.4 v2:172.21.15.189:6800/1910571406 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b6000 2024-04-25T02:17:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.902+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:77 17.23 17:c4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957b164c00 con 0x55957a5b6000 2024-04-25T02:17:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.902+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.4 v2:172.21.15.189:6800/1910571406 9 ==== osd_op_reply(77 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b6000 2024-04-25T02:17:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.902+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:78 17.13 17:c8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5e7400 con 0x55957a5b1c00 2024-04-25T02:17:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.902+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.3 v2:172.21.15.79:6817/3072297369 18 ==== osd_op_reply(78 [pgnls-filter start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b1c00 2024-04-25T02:17:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.902+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:79 17.33 17:cc000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6c00 con 0x55957a5b0400 2024-04-25T02:17:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.903+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.7 v2:172.21.15.189:6824/3421948491 15 ==== osd_op_reply(79 [pgnls-filter start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b0400 2024-04-25T02:17:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.903+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:80 17.b 17:d0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5e6000 con 0x55957a5b0000 2024-04-25T02:17:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.903+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.2 v2:172.21.15.79:6800/3397511354 3 ==== osd_op_reply(80 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b0000 2024-04-25T02:17:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.903+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:81 17.2b 17:d4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b7c00 con 0x55957a5b6000 2024-04-25T02:17:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.903+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.4 v2:172.21.15.189:6800/1910571406 10 ==== osd_op_reply(81 [pgnls-filter start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b6000 2024-04-25T02:17:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.903+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:82 17.1b 17:d8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957b164800 con 0x55957a5b6000 2024-04-25T02:17:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.904+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.4 v2:172.21.15.189:6800/1910571406 11 ==== osd_op_reply(82 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b6000 2024-04-25T02:17:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.904+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:83 17.3b 17:dc000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b7400 con 0x55957a5b0000 2024-04-25T02:17:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.904+0000 7faa808ad640 1 -- 172.21.15.79:0/1805927015 <== osd.2 v2:172.21.15.79:6800/3397511354 4 ==== osd_op_reply(83 [pgnls-filter start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e500 con 0x55957a5b0000 2024-04-25T02:17:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.904+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:84 17.7 17:e0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b1000 con 0x55957b165400 2024-04-25T02:17:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.904+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 16 ==== osd_op_reply(84 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.904+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:85 17.27 17:e4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6400 con 0x55957a5b6000 2024-04-25T02:17:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.904+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.4 v2:172.21.15.189:6800/1910571406 12 ==== osd_op_reply(85 [pgnls-filter start_epoch 119 out=49b] v117'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b6000 2024-04-25T02:17:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.904+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:86 17.17 17:e8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b1800 con 0x55957a5b7000 2024-04-25T02:17:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.905+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 <== osd.6 v2:172.21.15.189:6816/1254358257 4 ==== osd_op_reply(86 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e780 con 0x55957a5b7000 2024-04-25T02:17:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.905+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:87 17.37 17:ec000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6800 con 0x55957b165400 2024-04-25T02:17:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.905+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 17 ==== osd_op_reply(87 [pgnls-filter start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.905+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:88 17.f 17:f0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b0c00 con 0x55957b165800 2024-04-25T02:17:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.905+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 <== osd.1 v2:172.21.15.79:6816/2311596149 9 ==== osd_op_reply(88 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e780 con 0x55957b165800 2024-04-25T02:17:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.905+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:89 17.2f 17:f4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5e6c00 con 0x55957a5b6000 2024-04-25T02:17:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.905+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.4 v2:172.21.15.189:6800/1910571406 13 ==== osd_op_reply(89 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957a5b6000 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa7b0a2640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:90 17.1f 17:f8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b0800 con 0x55957a5b7000 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa7f8ab640 1 -- 172.21.15.79:0/1805927015 <== osd.6 v2:172.21.15.189:6816/1254358257 5 ==== osd_op_reply(90 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e780 con 0x55957a5b7000 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa7b8a3640 1 -- 172.21.15.79:0/1805927015 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:91 17.3f 17:fc000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x55957a5b6c00 con 0x55957b165400 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 <== osd.0 v2:172.21.15.79:6802/1526100659 18 ==== osd_op_reply(91 [pgnls-filter start_epoch 119 out=49b] v117'17 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55957af9e000 con 0x55957b165400 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55957b165400 msgr2=0x55957a2a0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x55957b165400 0x55957a2a0680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55957b165800 msgr2=0x55957a598580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x55957b165800 0x55957a598580 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x55957a5b0000 msgr2=0x55957a2a1700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x55957a5b0000 0x55957a2a1700 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55957a5b1c00 msgr2=0x55957a598b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x55957a5b1c00 0x55957a598b00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55957a5b6000 msgr2=0x55957a599080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x55957a5b6000 0x55957a599080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55957b165c00 msgr2=0x55957a2a0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x55957b165c00 0x55957a2a0c00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55957a5b7000 msgr2=0x55957a599600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x55957a5b7000 0x55957a599600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x55957a5b0400 msgr2=0x55957a2a1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x55957a5b0400 0x55957a2a1180 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 reap_dead start 2024-04-25T02:17:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 reap_dead start 2024-04-25T02:17:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 reap_dead start 2024-04-25T02:17:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 reap_dead start 2024-04-25T02:17:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa800ac640 1 -- 172.21.15.79:0/1805927015 reap_dead start 2024-04-25T02:17:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55957b165000 msgr2=0x55957a598000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55957b165000 0x55957a598000 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x55957b04b2f0 tx=0x55957afc8180 comp rx=0 tx=0).stop 2024-04-25T02:17:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957b105c00 msgr2=0x55957a2a0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957b105c00 0x55957a2a0100 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x55957b009bf0 tx=0x55957afc4a20 comp rx=0 tx=0).stop 2024-04-25T02:17:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 shutdown_connections 2024-04-25T02:17:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x55957b165000 0x55957a598000 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 --2- 172.21.15.79:0/1805927015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957b105c00 0x55957a2a0100 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 >> 172.21.15.79:0/1805927015 conn(0x55957b105000 msgr2=0x55957a333000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.906+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 shutdown_connections 2024-04-25T02:17:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.907+0000 7faa82421740 1 -- 172.21.15.79:0/1805927015 wait complete. 2024-04-25T02:17:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.907+0000 7faa82421740 1 -- 172.21.15.79:0/2142709416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957a22b800 msgr2=0x55957a29f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.907+0000 7faa82421740 1 --2- 172.21.15.79:0/2142709416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957a22b800 0x55957a29f600 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x55957b04bc50 tx=0x55957afc8120 comp rx=0 tx=0).stop 2024-04-25T02:17:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.907+0000 7faa82421740 1 -- 172.21.15.79:0/2142709416 shutdown_connections 2024-04-25T02:17:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.907+0000 7faa82421740 1 --2- 172.21.15.79:0/2142709416 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x55957a22bc00 0x55957a29f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.907+0000 7faa82421740 1 --2- 172.21.15.79:0/2142709416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55957a22b800 0x55957a29f600 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.907+0000 7faa82421740 1 --2- 172.21.15.79:0/2142709416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55957a22ac00 0x55957a29fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.907+0000 7faa82421740 1 -- 172.21.15.79:0/2142709416 >> 172.21.15.79:0/2142709416 conn(0x55957a22b000 msgr2=0x55957a332800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.907+0000 7faa82421740 1 -- 172.21.15.79:0/2142709416 shutdown_connections 2024-04-25T02:17:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.907+0000 7faa82421740 1 -- 172.21.15.79:0/2142709416 wait complete. 2024-04-25T02:17:57.927 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--filter-tag', 'mytag123', 'cephfs_data'] in time 0:00:00.131873, result: 2024-04-25T02:17:57.927 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-25T02:17:57.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.990+0000 7efc19e18740 1 -- start start 2024-04-25T02:17:57.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.990+0000 7efc19e18740 1 Processor -- start 2024-04-25T02:17:58.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc19e18740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563485ed0c00 0x563485f44580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc19e18740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563485ed1800 0x563485f44b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc19e18740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563485ed1c00 0x563485f45080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc19e18740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563486cb4600 con 0x563485ed0c00 2024-04-25T02:17:58.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc19e18740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563486cb4480 con 0x563485ed1c00 2024-04-25T02:17:58.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc19e18740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x563486cb4300 con 0x563485ed1800 2024-04-25T02:17:58.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc17ac0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563485ed0c00 0x563485f44580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc17ac0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563485ed0c00 0x563485f44580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56850/0 (socket says 172.21.15.79:56850) 2024-04-25T02:17:58.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc17ac0640 1 -- 172.21.15.79:0/891661110 learned_addr learned my addr 172.21.15.79:0/891661110 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:58.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc182c1640 1 --2- 172.21.15.79:0/891661110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563485ed1c00 0x563485f45080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc17ac0640 1 -- 172.21.15.79:0/891661110 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563485ed1800 msgr2=0x563485f44b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:58.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc17ac0640 1 --2- 172.21.15.79:0/891661110 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563485ed1800 0x563485f44b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc17ac0640 1 -- 172.21.15.79:0/891661110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563485ed1c00 msgr2=0x563485f45080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc17ac0640 1 --2- 172.21.15.79:0/891661110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563485ed1c00 0x563485f45080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc17ac0640 1 -- 172.21.15.79:0/891661110 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563485efd680 con 0x563485ed0c00 2024-04-25T02:17:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc182c1640 1 --2- 172.21.15.79:0/891661110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563485ed1c00 0x563485f45080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc17ac0640 1 --2- 172.21.15.79:0/891661110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563485ed0c00 0x563485f44580 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x563486cefc80 tx=0x563486c6e240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07f360e1d718c47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc152bb640 1 -- 172.21.15.79:0/891661110 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563485ef6680 con 0x563485ed0c00 2024-04-25T02:17:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc152bb640 1 -- 172.21.15.79:0/891661110 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563485f1a540 con 0x563485ed0c00 2024-04-25T02:17:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc152bb640 1 -- 172.21.15.79:0/891661110 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563485ef6b60 con 0x563485ed0c00 2024-04-25T02:17:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc19e18740 1 -- 172.21.15.79:0/891661110 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563485efd4a0 con 0x563485ed0c00 2024-04-25T02:17:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc19e18740 1 -- 172.21.15.79:0/891661110 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x563485efda40 con 0x563485ed0c00 2024-04-25T02:17:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc19e18740 4 waiting for MDS map... 2024-04-25T02:17:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.991+0000 7efc152bb640 1 -- 172.21.15.79:0/891661110 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x563486dae600 con 0x563485ed0c00 2024-04-25T02:17:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.992+0000 7efc152bb640 1 -- 172.21.15.79:0/891661110 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x563485f29180 con 0x563485ed0c00 2024-04-25T02:17:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.992+0000 7efc19e18740 4 Got MDS map 90 2024-04-25T02:17:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.992+0000 7efc19e18740 4 datascan.main: Using metadata pool output 2024-04-25T02:17:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.992+0000 7efc19e18740 4 datascan.main: connecting to RADOS... 2024-04-25T02:17:58.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.992+0000 7efc19e18740 1 Processor -- start 2024-04-25T02:17:58.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.992+0000 7efc19e18740 1 -- start start 2024-04-25T02:17:58.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc19e18740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563486db1400 0x563485f45600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc19e18740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563486db1800 0x563485f45b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc19e18740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563486db1c00 0x563485f46100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc19e18740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563486cb4180 con 0x563486db1c00 2024-04-25T02:17:58.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc19e18740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563485f30480 con 0x563486db1800 2024-04-25T02:17:58.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc19e18740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x563485f30900 con 0x563486db1400 2024-04-25T02:17:58.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc172bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563486db1c00 0x563485f46100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc172bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563486db1c00 0x563485f46100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56854/0 (socket says 172.21.15.79:56854) 2024-04-25T02:17:58.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc172bf640 1 -- 172.21.15.79:0/1667948474 learned_addr learned my addr 172.21.15.79:0/1667948474 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:58.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc172bf640 1 -- 172.21.15.79:0/1667948474 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563486db1400 msgr2=0x563485f45600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:58.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc182c1640 1 --2- 172.21.15.79:0/1667948474 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563486db1400 0x563485f45600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc17ac0640 1 --2- 172.21.15.79:0/1667948474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563486db1800 0x563485f45b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc172bf640 1 --2- 172.21.15.79:0/1667948474 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563486db1400 0x563485f45600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc172bf640 1 -- 172.21.15.79:0/1667948474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563486db1800 msgr2=0x563485f45b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:58.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc172bf640 1 --2- 172.21.15.79:0/1667948474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563486db1800 0x563485f45b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc172bf640 1 -- 172.21.15.79:0/1667948474 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563485efd860 con 0x563486db1c00 2024-04-25T02:17:58.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc172bf640 1 --2- 172.21.15.79:0/1667948474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563486db1c00 0x563485f46100 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x563486dc3110 tx=0x563486dc8d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76b3821e2bb6fc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:58.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc132b7640 1 -- 172.21.15.79:0/1667948474 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563485ef6680 con 0x563486db1c00 2024-04-25T02:17:58.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc132b7640 1 -- 172.21.15.79:0/1667948474 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563485f1a1c0 con 0x563486db1c00 2024-04-25T02:17:58.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.993+0000 7efc132b7640 1 -- 172.21.15.79:0/1667948474 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563485ef6b60 con 0x563486db1c00 2024-04-25T02:17:58.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.994+0000 7efc19e18740 1 -- 172.21.15.79:0/1667948474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563486db1c00 msgr2=0x563485f46100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.994+0000 7efc19e18740 1 --2- 172.21.15.79:0/1667948474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563486db1c00 0x563485f46100 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x563486dc3110 tx=0x563486dc8d20 comp rx=0 tx=0).stop 2024-04-25T02:17:58.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.994+0000 7efc19e18740 1 -- 172.21.15.79:0/1667948474 shutdown_connections 2024-04-25T02:17:58.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.994+0000 7efc19e18740 1 --2- 172.21.15.79:0/1667948474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563486db1c00 0x563485f46100 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.994+0000 7efc19e18740 1 --2- 172.21.15.79:0/1667948474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563486db1800 0x563485f45b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.994+0000 7efc19e18740 1 --2- 172.21.15.79:0/1667948474 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563486db1400 0x563485f45600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.994+0000 7efc19e18740 1 -- 172.21.15.79:0/1667948474 >> 172.21.15.79:0/1667948474 conn(0x563486db1000 msgr2=0x563486c52800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:58.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.994+0000 7efc19e18740 1 -- 172.21.15.79:0/1667948474 shutdown_connections 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.994+0000 7efc19e18740 1 -- 172.21.15.79:0/1667948474 wait complete. 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.994+0000 7efc19e18740 1 Processor -- start 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.994+0000 7efc19e18740 1 -- start start 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc19e18740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563486db1400 0x563485f47180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc19e18740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563486db1800 0x563485f46c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc19e18740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563486db1c00 0x563485f46680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc19e18740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563486cb5380 con 0x563486db1400 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc19e18740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563486cb4180 con 0x563486db1c00 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc19e18740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x563486cb5500 con 0x563486db1800 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc182c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563486db1400 0x563485f47180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc182c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563486db1400 0x563485f47180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56866/0 (socket says 172.21.15.79:56866) 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 learned_addr learned my addr 172.21.15.79:0/3211680933 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc17ac0640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563486db1800 0x563485f46c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc172bf640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563486db1c00 0x563485f46680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563486db1800 msgr2=0x563485f46c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc182c1640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563486db1800 0x563485f46c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563486db1c00 msgr2=0x563485f46680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc182c1640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563486db1c00 0x563485f46680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563485efd680 con 0x563486db1400 2024-04-25T02:17:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc172bf640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563486db1c00 0x563485f46680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:17:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc182c1640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563486db1400 0x563485f47180 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x563486cef1d0 tx=0x563486c6e300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.995+0000 7efc11ab4640 1 -- 172.21.15.79:0/3211680933 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563485ef69c0 con 0x563486db1400 2024-04-25T02:17:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.996+0000 7efc11ab4640 1 -- 172.21.15.79:0/3211680933 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563485f1aa80 con 0x563486db1400 2024-04-25T02:17:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.996+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563485efd4a0 con 0x563486db1400 2024-04-25T02:17:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.996+0000 7efc11ab4640 1 -- 172.21.15.79:0/3211680933 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563485ef6680 con 0x563486db1400 2024-04-25T02:17:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.996+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563485efda40 con 0x563486db1400 2024-04-25T02:17:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.996+0000 7efc19e18740 4 datascan.init: resolving metadata pool 16 2024-04-25T02:17:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.997+0000 7efc11ab4640 1 -- 172.21.15.79:0/3211680933 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x563486e1ec00 con 0x563486db1400 2024-04-25T02:17:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.997+0000 7efc11ab4640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x563486e1ac00 0x563485f47700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.997+0000 7efc11ab4640 1 -- 172.21.15.79:0/3211680933 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x563486e1cc00 con 0x563486db1400 2024-04-25T02:17:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.997+0000 7efc19e18740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.997+0000 7efc17ac0640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x563486e1ac00 0x563485f47700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.997+0000 7efc19e18740 4 datascan.main: resolving metadata pool 16 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.997+0000 7efc19e18740 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x563486e1b000 0x563485f46100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.997+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:1 16.0 16:00000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486e1b400 con 0x563486e1b000 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.997+0000 7efc172bf640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x563486e1b000 0x563485f46100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.997+0000 7efc17ac0640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x563486e1ac00 0x563485f47700 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x563486dc23f0 tx=0x563485f87140 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.998+0000 7efc172bf640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x563486e1b000 0x563485f46100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.998+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 1 ==== osd_op_reply(1 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.998+0000 7efc172bf640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x563486e1a800 0x563486256000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.998+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:2 16.10 16:08000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486e1a000 con 0x563486e1a800 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.998+0000 7efc182c1640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x563486e1a800 0x563486256000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.998+0000 7efc182c1640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x563486e1a800 0x563486256000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.999+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 1 ==== osd_op_reply(2 [pgnls start_epoch 119 out=177b] v118'16 uv16 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.999+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:3 16.8 16:10000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486e1a000 con 0x563486e1b000 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.999+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 2 ==== osd_op_reply(3 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.999+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:4 16.18 16:18000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486e1a000 con 0x563486e1b000 2024-04-25T02:17:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.999+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 3 ==== osd_op_reply(4 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.999+0000 7efc172bf640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x563486e1a000 0x563486256580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.999+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:5 16.4 16:20000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486e1a400 con 0x563486e1a000 2024-04-25T02:17:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.999+0000 7efc17ac0640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x563486e1a000 0x563486256580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:57.999+0000 7efc17ac0640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x563486e1a000 0x563486256580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.000+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.3 v2:172.21.15.79:6817/3072297369 1 ==== osd_op_reply(5 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044780 con 0x563486e1a000 2024-04-25T02:17:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.000+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:6 16.14 16:28000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486e1a400 con 0x563486e1b000 2024-04-25T02:17:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.000+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 4 ==== osd_op_reply(6 [pgnls start_epoch 119 out=149b] v119'41 uv41 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.000+0000 7efc172bf640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x563486e1a400 0x563486256b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.000+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:7 16.c 16:30000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486e1b400 con 0x563486e1a400 2024-04-25T02:17:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.000+0000 7efc172bf640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x563486e1a400 0x563486256b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.001+0000 7efc172bf640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x563486e1a400 0x563486256b00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.001+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.5 v2:172.21.15.189:6802/1246927196 1 ==== osd_op_reply(7 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1a400 2024-04-25T02:17:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.001+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:8 16.1c 16:38000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486e1b400 con 0x563486e1a800 2024-04-25T02:17:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.001+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 2 ==== osd_op_reply(8 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.001+0000 7efc182c1640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x563486e1b400 0x563486257080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.001+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:9 16.2 16:40000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486cb7400 con 0x563486e1b400 2024-04-25T02:17:58.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.001+0000 7efc182c1640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x563486e1b400 0x563486257080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.002+0000 7efc182c1640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x563486e1b400 0x563486257080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.002+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.4 v2:172.21.15.189:6800/1910571406 1 ==== osd_op_reply(9 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044500 con 0x563486e1b400 2024-04-25T02:17:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.002+0000 7efc182c1640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x563486cb7400 0x563486257600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.002+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:10 16.12 16:48000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486251000 con 0x563486cb7400 2024-04-25T02:17:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.002+0000 7efc17ac0640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x563486cb7400 0x563486257600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.003+0000 7efc17ac0640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x563486cb7400 0x563486257600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.003+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.6 v2:172.21.15.189:6816/1254358257 1 ==== osd_op_reply(10 [pgnls start_epoch 119 out=81b] v118'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x563486044780 con 0x563486cb7400 2024-04-25T02:17:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.003+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:11 16.a 16:50000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486251000 con 0x563486e1a800 2024-04-25T02:17:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.003+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 3 ==== osd_op_reply(11 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.003+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:12 16.1a 16:58000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486251000 con 0x563486e1a000 2024-04-25T02:17:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.003+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.3 v2:172.21.15.79:6817/3072297369 2 ==== osd_op_reply(12 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044780 con 0x563486e1a000 2024-04-25T02:17:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.003+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:13 16.6 16:60000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486251000 con 0x563486cb7400 2024-04-25T02:17:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.004+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.6 v2:172.21.15.189:6816/1254358257 2 ==== osd_op_reply(13 [pgnls start_epoch 119 out=77b] v118'9 uv9 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x563486044780 con 0x563486cb7400 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.004+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:14 16.16 16:68000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486251000 con 0x563486e1a000 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.004+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.3 v2:172.21.15.79:6817/3072297369 3 ==== osd_op_reply(14 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044780 con 0x563486e1a000 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.004+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:15 16.e 16:70000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486251000 con 0x563486e1a800 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.004+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 4 ==== osd_op_reply(15 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.004+0000 7efc182c1640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x563486251000 0x563486257b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.004+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:16 16.1e 16:78000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486251400 con 0x563486251000 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.004+0000 7efc172bf640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x563486251000 0x563486257b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.005+0000 7efc172bf640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x563486251000 0x563486257b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.005+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.7 v2:172.21.15.189:6824/3421948491 1 ==== osd_op_reply(16 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486251000 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.005+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:17 16.1 16:80000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486251400 con 0x563486e1a800 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.005+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 5 ==== osd_op_reply(17 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.005+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:18 16.11 16:88000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486251400 con 0x563486e1a400 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.006+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.5 v2:172.21.15.189:6802/1246927196 2 ==== osd_op_reply(18 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1a400 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.006+0000 7efc172bf640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x563486251400 0x563486258100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.006+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:19 16.9 16:90000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486251400 2024-04-25T02:17:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.006+0000 7efc182c1640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x563486251400 0x563486258100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.006+0000 7efc182c1640 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x563486251400 0x563486258100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.006+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.1 v2:172.21.15.79:6816/2311596149 1 ==== osd_op_reply(19 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044500 con 0x563486251400 2024-04-25T02:17:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.006+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:20 16.19 16:98000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486e1b400 2024-04-25T02:17:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.007+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.4 v2:172.21.15.189:6800/1910571406 2 ==== osd_op_reply(20 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044500 con 0x563486e1b400 2024-04-25T02:17:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.007+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:21 16.5 16:a0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486e1b000 2024-04-25T02:17:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.007+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 5 ==== osd_op_reply(21 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.007+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:22 16.15 16:a8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486e1b000 2024-04-25T02:17:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.007+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 6 ==== osd_op_reply(22 [pgnls start_epoch 119 out=97b] v118'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.007+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:23 16.d 16:b0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486cb7400 2024-04-25T02:17:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.007+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.6 v2:172.21.15.189:6816/1254358257 3 ==== osd_op_reply(23 [pgnls start_epoch 119 out=74b] v114'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x563486044780 con 0x563486cb7400 2024-04-25T02:17:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.007+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:24 16.1d 16:b8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486e1a800 2024-04-25T02:17:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.008+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 6 ==== osd_op_reply(24 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.008+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:25 16.3 16:c0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486e1a400 2024-04-25T02:17:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.008+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.5 v2:172.21.15.189:6802/1246927196 3 ==== osd_op_reply(25 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1a400 2024-04-25T02:17:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.008+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:26 16.13 16:c8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486251400 2024-04-25T02:17:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.008+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.1 v2:172.21.15.79:6816/2311596149 2 ==== osd_op_reply(26 [pgnls start_epoch 119 out=98b] v118'5 uv5 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x563486044500 con 0x563486251400 2024-04-25T02:17:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.008+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:27 16.b 16:d0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486251400 2024-04-25T02:17:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.009+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.1 v2:172.21.15.79:6816/2311596149 3 ==== osd_op_reply(27 [pgnls start_epoch 119 out=76b] v119'6 uv5 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x563486044500 con 0x563486251400 2024-04-25T02:17:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.009+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:28 16.1b 16:d8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486e1a400 2024-04-25T02:17:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.009+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.5 v2:172.21.15.189:6802/1246927196 4 ==== osd_op_reply(28 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1a400 2024-04-25T02:17:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.009+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:29 16.7 16:e0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486e1a000 2024-04-25T02:17:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.009+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.3 v2:172.21.15.79:6817/3072297369 4 ==== osd_op_reply(29 [pgnls start_epoch 119 out=105b] v119'9 uv9 ondisk = 1) ==== 144+0+105 (crc 0 0 0) 0x563486044780 con 0x563486e1a000 2024-04-25T02:17:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.009+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:30 16.17 16:e8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486e1a800 2024-04-25T02:17:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.009+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 7 ==== osd_op_reply(30 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.009+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:31 16.f 16:f0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486e1b000 2024-04-25T02:17:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.010+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 7 ==== osd_op_reply(31 [pgnls start_epoch 119 out=73b] v119'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.010+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:32 16.1f 16:f8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486e1a400 2024-04-25T02:17:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.010+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.5 v2:172.21.15.189:6802/1246927196 5 ==== osd_op_reply(32 [pgnls start_epoch 119 out=101b] v119'9 uv8 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x563486044000 con 0x563486e1a400 2024-04-25T02:17:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.010+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-25T02:17:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.010+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:33 16.10 16:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486e1b800 con 0x563486e1a800 2024-04-25T02:17:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.010+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 8 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.010+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-25T02:17:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.010+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:34 16.10 16:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486e1bc00 con 0x563486e1a800 2024-04-25T02:17:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 9 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-25T02:17:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:35 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486279400 con 0x563486e1a800 2024-04-25T02:17:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 10 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=1169b] v0'0 uv12 ondisk = 0) ==== 164+0+1169 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-25T02:17:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:36 16.10 16:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486279800 con 0x563486e1a800 2024-04-25T02:17:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 11 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-25T02:17:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:37 16.10 16:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486279c00 con 0x563486e1a800 2024-04-25T02:17:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 12 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.011+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:38 16.14 16:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486279400 con 0x563486e1b000 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.012+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 8 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.012+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.012+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:39 16.1c 16:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486279800 con 0x563486e1a800 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.012+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 13 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.012+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 10000000003.00000000 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.012+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:40 16.12 16:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486e1b800 con 0x563486cb7400 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.012+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.6 v2:172.21.15.189:6816/1254358257 4 ==== osd_op_reply(40 10000000003.00000000 [omap-get-vals out=584b] v0'0 uv3 ondisk = 0) ==== 164+0+584 (crc 0 0 0) 0x563486044780 con 0x563486cb7400 2024-04-25T02:17:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.012+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-25T02:17:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.012+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T02:17:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.012+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-25T02:17:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.012+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:41 16.e 16:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486e1bc00 con 0x563486e1a800 2024-04-25T02:17:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 14 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-25T02:17:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:42 16.15 16:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486251c00 con 0x563486e1b000 2024-04-25T02:17:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 9 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-25T02:17:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T02:17:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-25T02:17:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T02:17:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-25T02:17:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:43 16.1d 16:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486251800 con 0x563486e1a800 2024-04-25T02:17:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 15 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-25T02:17:58.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T02:17:58.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-25T02:17:58.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:44 16.13 16:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486251c00 con 0x563486251400 2024-04-25T02:17:58.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.013+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.1 v2:172.21.15.79:6816/2311596149 4 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x563486044500 con 0x563486251400 2024-04-25T02:17:58.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.014+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-25T02:17:58.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.014+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T02:17:58.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.014+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-25T02:17:58.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.014+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:45 16.7 16:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486279000 con 0x563486e1a000 2024-04-25T02:17:58.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.014+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.3 v2:172.21.15.79:6817/3072297369 5 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044780 con 0x563486e1a000 2024-04-25T02:17:58.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.014+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 10000000001.00000000 2024-04-25T02:17:58.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.014+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:46 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486278c00 con 0x563486e1a000 2024-04-25T02:17:58.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.014+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.3 v2:172.21.15.79:6817/3072297369 6 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals out=1667b] v0'0 uv9 ondisk = 0) ==== 164+0+1667 (crc 0 0 0) 0x563486044780 con 0x563486e1a000 2024-04-25T02:17:58.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.014+0000 7efc19e18740 20 datascan.scan_links: injected ino detected 2024-04-25T02:17:58.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.014+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-25T02:17:58.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.014+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T02:17:58.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.014+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-25T02:17:58.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.014+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T02:17:58.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.014+0000 7efc19e18740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-25T02:17:58.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.014+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:47 16.1f 16:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486278800 con 0x563486e1a400 2024-04-25T02:17:58.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.5 v2:172.21.15.189:6802/1246927196 6 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=585b] v0'0 uv8 ondisk = 0) ==== 154+0+585 (crc 0 0 0) 0x563486044000 con 0x563486e1a400 2024-04-25T02:17:58.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:48 16.0 16:00000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1b000 2024-04-25T02:17:58.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 10 ==== osd_op_reply(48 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:49 16.10 16:08000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a800 2024-04-25T02:17:58.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 16 ==== osd_op_reply(49 [pgnls start_epoch 119 out=177b] v118'16 uv16 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:50 16.8 16:10000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1b000 2024-04-25T02:17:58.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 11 ==== osd_op_reply(50 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:51 16.18 16:18000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1b000 2024-04-25T02:17:58.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 12 ==== osd_op_reply(51 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:52 16.4 16:20000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a000 2024-04-25T02:17:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.3 v2:172.21.15.79:6817/3072297369 7 ==== osd_op_reply(52 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044780 con 0x563486e1a000 2024-04-25T02:17:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:53 16.14 16:28000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1b000 2024-04-25T02:17:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 13 ==== osd_op_reply(53 [pgnls start_epoch 119 out=149b] v119'41 uv41 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:54 16.c 16:30000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a400 2024-04-25T02:17:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.5 v2:172.21.15.189:6802/1246927196 7 ==== osd_op_reply(54 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1a400 2024-04-25T02:17:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.016+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:55 16.1c 16:38000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a800 2024-04-25T02:17:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.017+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 17 ==== osd_op_reply(55 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.017+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:56 16.2 16:40000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1b400 2024-04-25T02:17:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.017+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.4 v2:172.21.15.189:6800/1910571406 3 ==== osd_op_reply(56 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044500 con 0x563486e1b400 2024-04-25T02:17:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.017+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:57 16.12 16:48000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486cb7400 2024-04-25T02:17:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.017+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.6 v2:172.21.15.189:6816/1254358257 5 ==== osd_op_reply(57 [pgnls start_epoch 119 out=81b] v118'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x563486044780 con 0x563486cb7400 2024-04-25T02:17:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.017+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:58 16.a 16:50000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a800 2024-04-25T02:17:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.018+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 18 ==== osd_op_reply(58 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.018+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:59 16.1a 16:58000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a000 2024-04-25T02:17:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.018+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.3 v2:172.21.15.79:6817/3072297369 8 ==== osd_op_reply(59 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044780 con 0x563486e1a000 2024-04-25T02:17:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.018+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:60 16.6 16:60000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486cb7400 2024-04-25T02:17:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.018+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.6 v2:172.21.15.189:6816/1254358257 6 ==== osd_op_reply(60 [pgnls start_epoch 119 out=77b] v118'9 uv9 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x563486044780 con 0x563486cb7400 2024-04-25T02:17:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.018+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:61 16.16 16:68000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a000 2024-04-25T02:17:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.019+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.3 v2:172.21.15.79:6817/3072297369 9 ==== osd_op_reply(61 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044780 con 0x563486e1a000 2024-04-25T02:17:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.019+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:62 16.e 16:70000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a800 2024-04-25T02:17:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.019+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 19 ==== osd_op_reply(62 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.019+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- osd_op(unknown.0.0:63 16.1e 16:78000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486251000 2024-04-25T02:17:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.019+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.7 v2:172.21.15.189:6824/3421948491 2 ==== osd_op_reply(63 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486251000 2024-04-25T02:17:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.019+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:64 16.1 16:80000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a800 2024-04-25T02:17:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.019+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 20 ==== osd_op_reply(64 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.019+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:65 16.11 16:88000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a400 2024-04-25T02:17:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.020+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.5 v2:172.21.15.189:6802/1246927196 8 ==== osd_op_reply(65 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1a400 2024-04-25T02:17:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.020+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:66 16.9 16:90000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486251400 2024-04-25T02:17:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.020+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.1 v2:172.21.15.79:6816/2311596149 5 ==== osd_op_reply(66 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044500 con 0x563486251400 2024-04-25T02:17:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.020+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- osd_op(unknown.0.0:67 16.19 16:98000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1b400 2024-04-25T02:17:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.020+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.4 v2:172.21.15.189:6800/1910571406 4 ==== osd_op_reply(67 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044500 con 0x563486e1b400 2024-04-25T02:17:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.020+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:68 16.5 16:a0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1b000 2024-04-25T02:17:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.020+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 14 ==== osd_op_reply(68 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.020+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:69 16.15 16:a8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1b000 2024-04-25T02:17:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.021+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 15 ==== osd_op_reply(69 [pgnls start_epoch 119 out=97b] v118'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.021+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:70 16.d 16:b0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486cb7400 2024-04-25T02:17:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.021+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.6 v2:172.21.15.189:6816/1254358257 7 ==== osd_op_reply(70 [pgnls start_epoch 119 out=74b] v114'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x563486044780 con 0x563486cb7400 2024-04-25T02:17:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.021+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:71 16.1d 16:b8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a800 2024-04-25T02:17:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.021+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 21 ==== osd_op_reply(71 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.021+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:72 16.3 16:c0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a400 2024-04-25T02:17:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.022+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.5 v2:172.21.15.189:6802/1246927196 9 ==== osd_op_reply(72 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1a400 2024-04-25T02:17:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.022+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:73 16.13 16:c8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486251400 2024-04-25T02:17:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.022+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.1 v2:172.21.15.79:6816/2311596149 6 ==== osd_op_reply(73 [pgnls start_epoch 119 out=98b] v118'5 uv5 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x563486044500 con 0x563486251400 2024-04-25T02:17:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.022+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:74 16.b 16:d0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486251400 2024-04-25T02:17:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.022+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.1 v2:172.21.15.79:6816/2311596149 7 ==== osd_op_reply(74 [pgnls start_epoch 119 out=76b] v119'6 uv5 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x563486044500 con 0x563486251400 2024-04-25T02:17:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.022+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:75 16.1b 16:d8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a400 2024-04-25T02:17:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.022+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.5 v2:172.21.15.189:6802/1246927196 10 ==== osd_op_reply(75 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044000 con 0x563486e1a400 2024-04-25T02:17:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.022+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:76 16.7 16:e0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a000 2024-04-25T02:17:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.023+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.3 v2:172.21.15.79:6817/3072297369 10 ==== osd_op_reply(76 [pgnls start_epoch 119 out=105b] v119'9 uv9 ondisk = 1) ==== 144+0+105 (crc 0 0 0) 0x563486044780 con 0x563486e1a000 2024-04-25T02:17:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.023+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:77 16.17 16:e8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a800 2024-04-25T02:17:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.023+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 22 ==== osd_op_reply(77 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.023+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:78 16.f 16:f0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1b000 2024-04-25T02:17:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.023+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 16 ==== osd_op_reply(78 [pgnls start_epoch 119 out=73b] v119'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.023+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:79 16.1f 16:f8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x563486278400 con 0x563486e1a400 2024-04-25T02:17:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.024+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.5 v2:172.21.15.189:6802/1246927196 11 ==== osd_op_reply(79 [pgnls start_epoch 119 out=101b] v119'9 uv8 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x563486044000 con 0x563486e1a400 2024-04-25T02:17:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.024+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-25T02:17:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.024+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:80 16.10 16:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486e1a800 2024-04-25T02:17:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.024+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 23 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.024+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-25T02:17:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.024+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:81 16.10 16:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486279400 con 0x563486e1a800 2024-04-25T02:17:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.024+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 24 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.024+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-25T02:17:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.024+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:82 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486279c00 con 0x563486e1a800 2024-04-25T02:17:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.024+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 25 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=1169b] v0'0 uv12 ondisk = 0) ==== 164+0+1169 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.024+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-25T02:17:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.024+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:83 16.10 16:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486279800 con 0x563486e1a800 2024-04-25T02:17:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 26 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-25T02:17:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:84 16.10 16:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486e1bc00 con 0x563486e1a800 2024-04-25T02:17:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 27 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-25T02:17:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T02:17:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-25T02:17:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T02:17:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-25T02:17:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T02:17:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-25T02:17:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:85 16.14 16:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486e1b800 con 0x563486e1b000 2024-04-25T02:17:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 17 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-25T02:17:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:86 16.1c 16:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486251800 con 0x563486e1a800 2024-04-25T02:17:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 28 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 10000000003.00000000 2024-04-25T02:17:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.025+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:87 16.12 16:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486251c00 con 0x563486cb7400 2024-04-25T02:17:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.026+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.6 v2:172.21.15.189:6816/1254358257 8 ==== osd_op_reply(87 10000000003.00000000 [omap-get-vals out=584b] v0'0 uv3 ondisk = 0) ==== 164+0+584 (crc 0 0 0) 0x563486044780 con 0x563486cb7400 2024-04-25T02:17:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.026+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-25T02:17:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.026+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T02:17:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.026+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-25T02:17:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.026+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:88 16.e 16:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486250c00 con 0x563486e1a800 2024-04-25T02:17:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.026+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 29 ==== osd_op_reply(88 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.026+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-25T02:17:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.026+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- osd_op(unknown.0.0:89 16.15 16:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486250800 con 0x563486e1b000 2024-04-25T02:17:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.026+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.0 v2:172.21.15.79:6802/1526100659 18 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044000 con 0x563486e1b000 2024-04-25T02:17:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.026+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-25T02:17:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.026+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T02:17:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.026+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-25T02:17:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.026+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T02:17:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.026+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-25T02:17:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.026+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- osd_op(unknown.0.0:90 16.1d 16:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486250400 con 0x563486e1a800 2024-04-25T02:17:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.2 v2:172.21.15.79:6800/3397511354 30 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044500 con 0x563486e1a800 2024-04-25T02:17:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-25T02:17:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T02:17:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-25T02:17:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:91 16.13 16:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486278000 con 0x563486251400 2024-04-25T02:17:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.1 v2:172.21.15.79:6816/2311596149 8 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x563486044500 con 0x563486251400 2024-04-25T02:17:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-25T02:17:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T02:17:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-25T02:17:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:92 16.7 16:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486279400 con 0x563486e1a000 2024-04-25T02:17:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.3 v2:172.21.15.79:6817/3072297369 11 ==== osd_op_reply(92 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x563486044780 con 0x563486e1a000 2024-04-25T02:17:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 10000000001.00000000 2024-04-25T02:17:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:93 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486279000 con 0x563486e1a000 2024-04-25T02:17:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.3 v2:172.21.15.79:6817/3072297369 12 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals out=1667b] v0'0 uv9 ondisk = 0) ==== 164+0+1667 (crc 0 0 0) 0x563486044780 con 0x563486e1a000 2024-04-25T02:17:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 20 datascan.scan_links: injected ino detected 2024-04-25T02:17:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 20 datascan.scan_links: adding 0x100000001f7 for future processing to fix dnfirst 2024-04-25T02:17:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-25T02:17:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T02:17:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-25T02:17:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T02:17:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-25T02:17:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.027+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- osd_op(unknown.0.0:94 16.1f 16:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x563486278c00 con 0x563486e1a400 2024-04-25T02:17:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.028+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 <== osd.5 v2:172.21.15.189:6802/1246927196 12 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=585b] v0'0 uv8 ondisk = 0) ==== 154+0+585 (crc 0 0 0) 0x563486044000 con 0x563486e1a400 2024-04-25T02:17:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.028+0000 7efc19e18740 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-04-25T02:17:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.028+0000 7efc19e18740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-25T02:17:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.028+0000 7efc19e18740 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-04-25T02:17:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.028+0000 7efc19e18740 10 datascan.scan_links: processing 1 injected_inos 2024-04-25T02:17:58.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.028+0000 7efc19e18740 10 datascan.scan_links: handling injected_ino 0x100000001f7 2024-04-25T02:17:58.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.028+0000 7efc19e18740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000001:bravo 2024-04-25T02:17:58.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.028+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:95 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x56348628e000 con 0x563486e1a000 2024-04-25T02:17:58.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.028+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.3 v2:172.21.15.79:6817/3072297369 13 ==== osd_op_reply(95 10000000001.00000000 [omap-get-vals-by-keys out=506b] v0'0 uv9 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x563486044780 con 0x563486e1a000 2024-04-25T02:17:58.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.028+0000 7efc19e18740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-25T02:17:58.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.028+0000 7efc19e18740 20 datascan.scan_links: first is now 2 2024-04-25T02:17:58.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.028+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- osd_op(unknown.0.0:96 16.7 16:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56348628e400 con 0x563486e1a000 2024-04-25T02:17:58.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.029+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.3 v2:172.21.15.79:6817/3072297369 14 ==== osd_op_reply(96 10000000001.00000000 [omap-set-vals] v119'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x563486044780 con 0x563486e1a000 2024-04-25T02:17:58.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.029+0000 7efc19e18740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-04-25T02:17:58.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.029+0000 7efc19e18740 10 datascan.scan_links: updating inotable 2024-04-25T02:17:58.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.029+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:97 16.13 16:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x56348628e800 con 0x563486251400 2024-04-25T02:17:58.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.030+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.1 v2:172.21.15.79:6816/2311596149 9 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv4 ondisk = 0) ==== 157+0+50 (crc 0 0 0) 0x563486044500 con 0x563486251400 2024-04-25T02:17:58.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.030+0000 7efc19e18740 10 mds.0.inotable: skip_inos was [0x10000000005~0x1f2,0x100000001f9~0xfffffffe07] 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.030+0000 7efc19e18740 10 mds.0.inotable: skip_inos now [0x100000001f9~0xfffffffe07] 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.030+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- osd_op(unknown.0.0:98 16.13 16:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56348628ec00 con 0x563486251400 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc182c1640 1 -- 172.21.15.79:0/3211680933 <== osd.1 v2:172.21.15.79:6816/2311596149 10 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v119'6 uv6 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x563486044500 con 0x563486251400 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 10 datascan.scan_links: updating snaptable 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- osd_op(unknown.0.0:99 16.d 16:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x56348628f000 con 0x563486cb7400 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc17ac0640 1 -- 172.21.15.79:0/3211680933 <== osd.6 v2:172.21.15.189:6816/1254358257 9 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x563486044780 con 0x563486cb7400 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x563486e1b000 msgr2=0x563485f46100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x563486e1b000 0x563485f46100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x563486251400 msgr2=0x563486258100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x563486251400 0x563486258100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x563486e1a800 msgr2=0x563486256000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x563486e1a800 0x563486256000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x563486e1a000 msgr2=0x563486256580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x563486e1a000 0x563486256580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x563486e1b400 msgr2=0x563486257080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x563486e1b400 0x563486257080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x563486e1a400 msgr2=0x563486256b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x563486e1a400 0x563486256b00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 reap_dead start 2024-04-25T02:17:58.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x563486cb7400 msgr2=0x563486257600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc172bf640 1 -- 172.21.15.79:0/3211680933 reap_dead start 2024-04-25T02:17:58.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x563486cb7400 0x563486257600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x563486251000 msgr2=0x563486257b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.031+0000 7efc19e18740 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x563486251000 0x563486257b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x563486e1ac00 msgr2=0x563485f47700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x563486e1ac00 0x563485f47700 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x563486dc23f0 tx=0x563485f87140 comp rx=0 tx=0).stop 2024-04-25T02:17:58.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563486db1400 msgr2=0x563485f47180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563486db1400 0x563485f47180 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x563486cef1d0 tx=0x563486c6e300 comp rx=0 tx=0).stop 2024-04-25T02:17:58.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 shutdown_connections 2024-04-25T02:17:58.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x563486251000 0x563486257b80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x563486e1ac00 0x563485f47700 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x563486cb7400 0x563486257600 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 --2- 172.21.15.79:0/3211680933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563486db1400 0x563485f47180 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 >> 172.21.15.79:0/3211680933 conn(0x563486db1000 msgr2=0x563486c52800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 shutdown_connections 2024-04-25T02:17:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 -- 172.21.15.79:0/3211680933 wait complete. 2024-04-25T02:17:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 -- 172.21.15.79:0/891661110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563485ed0c00 msgr2=0x563485f44580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 --2- 172.21.15.79:0/891661110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563485ed0c00 0x563485f44580 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x563486cefc80 tx=0x563486c6e240 comp rx=0 tx=0).stop 2024-04-25T02:17:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 -- 172.21.15.79:0/891661110 shutdown_connections 2024-04-25T02:17:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 --2- 172.21.15.79:0/891661110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563485ed1c00 0x563485f45080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 --2- 172.21.15.79:0/891661110 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x563485ed1800 0x563485f44b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 --2- 172.21.15.79:0/891661110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563485ed0c00 0x563485f44580 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 -- 172.21.15.79:0/891661110 >> 172.21.15.79:0/891661110 conn(0x563485ed1000 msgr2=0x563486c53000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 -- 172.21.15.79:0/891661110 shutdown_connections 2024-04-25T02:17:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.032+0000 7efc19e18740 1 -- 172.21.15.79:0/891661110 wait complete. 2024-04-25T02:17:58.062 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.134787, result: 2024-04-25T02:17:58.063 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:17:58.082 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:17:58.120 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-04-25T02:17:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-04-25T02:17:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:17:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-04-25T02:17:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-04-25T02:17:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-04-25T02:17:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-04-25T02:17:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-04-25T02:17:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-04-25T02:17:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:17:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-04-25T02:17:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:17:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:17:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-04-25T02:17:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:17:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-04-25T02:17:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-04-25T02:17:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-04-25T02:17:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-04-25T02:17:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]" 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on skipped message = False 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 696648c4-3e52-400b-a780-2e8863c56c42 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-04-25T02:17:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug trim objects = true 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-04-25T02:17:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: bdev async discard = True 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: bdev enable discard = True 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore allocator = bitmap 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 1/20 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 1/20 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 4/10 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-04-25T02:17:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-04-25T02:17:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-04-25T02:17:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:17:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:17:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: mon down mkfs grace = 300 2024-04-25T02:17:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2024-04-25T02:17:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.128 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-04-25T02:17:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-04-25T02:17:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-04-25T02:17:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-04-25T02:17:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:17:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:17:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = "" 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2024-04-25T02:17:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2024-04-25T02:17:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = False 2024-04-25T02:17:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2024-04-25T02:17:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2024-04-25T02:17:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-04-25T02:17:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-04-25T02:17:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-04-25T02:17:58.130 INFO:teuthology.orchestra.run.smithi189.stdout:[global] 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: chdir = "" 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: auth supported = cephx 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: filestore xattr use omap = true 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: mon clock drift allowed = 1.000 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: osd crush chooseleaf type = 0 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: auth debug = true 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on old message = true 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on bug = true 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:17:58.131 INFO:teuthology.orchestra.run.smithi189.stdout: mon pg warn max object skew = 0 2024-04-25T02:17:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:17:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:17:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default size = 2 2024-04-25T02:17:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow primary affinity = true 2024-04-25T02:17:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow pg remap = true 2024-04-25T02:17:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:17:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:17:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on no sortbitwise = false 2024-04-25T02:17:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:17:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on too few osds = false 2024-04-25T02:17:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:17:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: mon_allow_pool_size_one = true 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: osd default data pool replay window = 5 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: mon allow pool delete = true 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: mon cluster log file level = debug 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: debug asserts on shutdown = true 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: mon health detail to clog = false 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: mon host = "172.21.15.79,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]" 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on skipped message = False 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: fsid = 696648c4-3e52-400b-a780-2e8863c56c42 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout:[osd] 2024-04-25T02:17:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: osd journal size = 100 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub load threshold = 5.0 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub max interval = 600 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: osd recover clone overlap = true 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: osd recovery max chunk = 1048576 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug shutdown = true 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug op order = true 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug verify stray on activate = true 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug trim objects = true 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: osd open classes on start = true 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug pg log writeout = true 2024-04-25T02:17:58.134 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.135 INFO:teuthology.orchestra.run.smithi189.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:17:58.135 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.135 INFO:teuthology.orchestra.run.smithi189.stdout: osd map max advance = 10 2024-04-25T02:17:58.135 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.135 INFO:teuthology.orchestra.run.smithi189.stdout: journal zero on create = true 2024-04-25T02:17:58.135 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.135 INFO:teuthology.orchestra.run.smithi189.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:17:58.135 INFO:teuthology.orchestra.run.smithi189.stdout: filestore apply finisher threads = 3 2024-04-25T02:17:58.135 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.135 INFO:teuthology.orchestra.run.smithi189.stdout: bdev debug aio = true 2024-04-25T02:17:58.135 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug misdirected ops = true 2024-04-25T02:17:58.135 INFO:teuthology.orchestra.run.smithi189.stdout: bdev async discard = True 2024-04-25T02:17:58.135 INFO:teuthology.orchestra.run.smithi189.stdout: bdev enable discard = True 2024-04-25T02:17:58.135 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore allocator = bitmap 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore block size = 96636764160 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore fsck on mount = True 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluefs = 1/20 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluestore = 1/20 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout: debug osd = 20 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout: debug rocksdb = 4/10 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd full ratio = 0.9 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout: osd objectstore = bluestore 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout: osd op complaint time = 180 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr] 2024-04-25T02:17:58.136 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout: debug mgr = 20 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout: mgr/telemetry/nag = false 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout: debug client = 20 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout:[mon] 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout: debug paxos = 20 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout: mon data avail warn = 5 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout: mon mgr mkfs grace = 240 2024-04-25T02:17:58.137 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd reporter subtree level = osd 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd prime pg temp = true 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: # 1m isn't quite enough 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:17:58.138 INFO:teuthology.orchestra.run.smithi189.stdout: mon down mkfs grace = 300 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout: mon op complaint time = 120 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout:[client] 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout: rgw cache enabled = true 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable ops log = true 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable usage log = true 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout: client mount timeout = 600 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout: debug client = 20 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout: pid file = "" 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout: rados mon op timeout = 900 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout: rados osd op timeout = 900 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.a] 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.b] 2024-04-25T02:17:58.139 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.c] 2024-04-25T02:17:58.140 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.a] 2024-04-25T02:17:58.140 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.c] 2024-04-25T02:17:58.140 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.b] 2024-04-25T02:17:58.140 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.d] 2024-04-25T02:17:58.140 INFO:teuthology.orchestra.run.smithi189.stdout:[mds] 2024-04-25T02:17:58.140 INFO:teuthology.orchestra.run.smithi189.stdout: debug mds = 20 2024-04-25T02:17:58.140 INFO:teuthology.orchestra.run.smithi189.stdout: debug mds balancer = 20 2024-04-25T02:17:58.140 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:58.140 INFO:teuthology.orchestra.run.smithi189.stdout: mds debug frag = True 2024-04-25T02:17:58.140 INFO:teuthology.orchestra.run.smithi189.stdout: mds debug scatterstat = False 2024-04-25T02:17:58.140 INFO:teuthology.orchestra.run.smithi189.stdout: mds op complaint time = 180 2024-04-25T02:17:58.140 INFO:teuthology.orchestra.run.smithi189.stdout: mds verify scatter = True 2024-04-25T02:17:58.140 INFO:teuthology.orchestra.run.smithi189.stdout: osd op complaint time = 180 2024-04-25T02:17:58.140 INFO:teuthology.orchestra.run.smithi189.stdout: rados mon op timeout = 900 2024-04-25T02:17:58.140 INFO:teuthology.orchestra.run.smithi189.stdout: rados osd op timeout = 900 2024-04-25T02:17:58.142 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:17:58.184 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:17:58.221 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-04-25T02:17:58.221 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-04-25T02:17:58.221 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:17:58.221 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-04-25T02:17:58.221 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.221 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-04-25T02:17:58.221 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.221 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-04-25T02:17:58.221 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.221 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-04-25T02:17:58.222 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-04-25T02:17:58.222 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.222 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-04-25T02:17:58.222 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-04-25T02:17:58.222 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.222 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:17:58.222 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-04-25T02:17:58.222 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.222 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:17:58.222 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:17:58.222 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.222 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-04-25T02:17:58.222 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.222 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-04-25T02:17:58.222 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-04-25T02:17:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:17:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:17:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-04-25T02:17:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:17:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-04-25T02:17:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:17:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:17:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-04-25T02:17:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:17:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-04-25T02:17:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-04-25T02:17:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]" 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on skipped message = False 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 696648c4-3e52-400b-a780-2e8863c56c42 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-04-25T02:17:58.224 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-04-25T02:17:58.225 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.225 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-04-25T02:17:58.225 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-04-25T02:17:58.225 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-04-25T02:17:58.225 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug trim objects = true 2024-04-25T02:17:58.225 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.225 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-04-25T02:17:58.225 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-04-25T02:17:58.225 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.225 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:17:58.225 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.225 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-04-25T02:17:58.225 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.225 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-04-25T02:17:58.225 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.226 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:17:58.226 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-04-25T02:17:58.226 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.226 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-04-25T02:17:58.226 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-04-25T02:17:58.226 INFO:teuthology.orchestra.run.smithi079.stdout: bdev async discard = True 2024-04-25T02:17:58.226 INFO:teuthology.orchestra.run.smithi079.stdout: bdev enable discard = True 2024-04-25T02:17:58.226 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore allocator = bitmap 2024-04-25T02:17:58.226 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-04-25T02:17:58.226 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-04-25T02:17:58.226 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 1/20 2024-04-25T02:17:58.226 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 1/20 2024-04-25T02:17:58.226 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:58.226 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-04-25T02:17:58.227 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 4/10 2024-04-25T02:17:58.227 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:17:58.227 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-04-25T02:17:58.227 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:17:58.227 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:17:58.227 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-04-25T02:17:58.227 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-04-25T02:17:58.227 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.227 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-04-25T02:17:58.227 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:58.227 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-04-25T02:17:58.227 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-04-25T02:17:58.227 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-04-25T02:17:58.227 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:58.227 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.228 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:17:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:17:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:17:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:17:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:17:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:17:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-04-25T02:17:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:17:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:17:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: mon down mkfs grace = 300 2024-04-25T02:17:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2024-04-25T02:17:58.229 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:58.229 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-04-25T02:17:58.230 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-04-25T02:17:58.230 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-04-25T02:17:58.230 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-04-25T02:17:58.230 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:17:58.230 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:17:58.230 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2024-04-25T02:17:58.230 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-04-25T02:17:58.230 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:58.230 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = "" 2024-04-25T02:17:58.230 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-04-25T02:17:58.230 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-04-25T02:17:58.230 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-04-25T02:17:58.230 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2024-04-25T02:17:58.230 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2024-04-25T02:17:58.230 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-04-25T02:17:58.231 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2024-04-25T02:17:58.231 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2024-04-25T02:17:58.231 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2024-04-25T02:17:58.231 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2024-04-25T02:17:58.231 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2024-04-25T02:17:58.231 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2024-04-25T02:17:58.231 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T02:17:58.231 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2024-04-25T02:17:58.231 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2024-04-25T02:17:58.231 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2024-04-25T02:17:58.231 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2024-04-25T02:17:58.231 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-04-25T02:17:58.231 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-04-25T02:17:58.231 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-04-25T02:17:58.232 INFO:teuthology.orchestra.run.smithi189.stdout:[global] 2024-04-25T02:17:58.232 INFO:teuthology.orchestra.run.smithi189.stdout: chdir = "" 2024-04-25T02:17:58.232 INFO:teuthology.orchestra.run.smithi189.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:17:58.232 INFO:teuthology.orchestra.run.smithi189.stdout: auth supported = cephx 2024-04-25T02:17:58.232 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.232 INFO:teuthology.orchestra.run.smithi189.stdout: filestore xattr use omap = true 2024-04-25T02:17:58.232 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.232 INFO:teuthology.orchestra.run.smithi189.stdout: mon clock drift allowed = 1.000 2024-04-25T02:17:58.232 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: osd crush chooseleaf type = 0 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: auth debug = true 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on old message = true 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on bug = true 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: mon pg warn max object skew = 0 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default size = 2 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow primary affinity = true 2024-04-25T02:17:58.233 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow pg remap = true 2024-04-25T02:17:58.234 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:17:58.234 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:17:58.234 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on no sortbitwise = false 2024-04-25T02:17:58.234 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:17:58.234 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on too few osds = false 2024-04-25T02:17:58.234 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:17:58.234 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:17:58.234 INFO:teuthology.orchestra.run.smithi189.stdout: mon_allow_pool_size_one = true 2024-04-25T02:17:58.234 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.234 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:17:58.234 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.234 INFO:teuthology.orchestra.run.smithi189.stdout: osd default data pool replay window = 5 2024-04-25T02:17:58.234 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.234 INFO:teuthology.orchestra.run.smithi189.stdout: mon allow pool delete = true 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout: mon cluster log file level = debug 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout: debug asserts on shutdown = true 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout: mon health detail to clog = false 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout: mon host = "172.21.15.79,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]" 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on skipped message = False 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout: fsid = 696648c4-3e52-400b-a780-2e8863c56c42 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout:[osd] 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout: osd journal size = 100 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub load threshold = 5.0 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub max interval = 600 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.235 INFO:teuthology.orchestra.run.smithi189.stdout: osd recover clone overlap = true 2024-04-25T02:17:58.236 INFO:teuthology.orchestra.run.smithi189.stdout: osd recovery max chunk = 1048576 2024-04-25T02:17:58.236 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.236 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug shutdown = true 2024-04-25T02:17:58.236 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug op order = true 2024-04-25T02:17:58.236 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug verify stray on activate = true 2024-04-25T02:17:58.236 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug trim objects = true 2024-04-25T02:17:58.236 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.236 INFO:teuthology.orchestra.run.smithi189.stdout: osd open classes on start = true 2024-04-25T02:17:58.236 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug pg log writeout = true 2024-04-25T02:17:58.236 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.236 INFO:teuthology.orchestra.run.smithi189.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:17:58.236 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.236 INFO:teuthology.orchestra.run.smithi189.stdout: osd map max advance = 10 2024-04-25T02:17:58.236 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: journal zero on create = true 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: filestore apply finisher threads = 3 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: bdev debug aio = true 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug misdirected ops = true 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: bdev async discard = True 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: bdev enable discard = True 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore allocator = bitmap 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore block size = 96636764160 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore fsck on mount = True 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluefs = 1/20 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluestore = 1/20 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:58.237 INFO:teuthology.orchestra.run.smithi189.stdout: debug osd = 20 2024-04-25T02:17:58.238 INFO:teuthology.orchestra.run.smithi189.stdout: debug rocksdb = 4/10 2024-04-25T02:17:58.238 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:17:58.238 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd full ratio = 0.9 2024-04-25T02:17:58.238 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:17:58.238 INFO:teuthology.orchestra.run.smithi189.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:17:58.238 INFO:teuthology.orchestra.run.smithi189.stdout: osd objectstore = bluestore 2024-04-25T02:17:58.238 INFO:teuthology.orchestra.run.smithi189.stdout: osd op complaint time = 180 2024-04-25T02:17:58.238 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.238 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr] 2024-04-25T02:17:58.238 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:58.238 INFO:teuthology.orchestra.run.smithi189.stdout: debug mgr = 20 2024-04-25T02:17:58.238 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-04-25T02:17:58.238 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-04-25T02:17:58.239 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:58.239 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:58.239 INFO:teuthology.orchestra.run.smithi189.stdout: mgr/telemetry/nag = false 2024-04-25T02:17:58.239 INFO:teuthology.orchestra.run.smithi189.stdout: debug client = 20 2024-04-25T02:17:58.239 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.239 INFO:teuthology.orchestra.run.smithi189.stdout:[mon] 2024-04-25T02:17:58.239 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:58.239 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-04-25T02:17:58.239 INFO:teuthology.orchestra.run.smithi189.stdout: debug paxos = 20 2024-04-25T02:17:58.239 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-04-25T02:17:58.239 INFO:teuthology.orchestra.run.smithi189.stdout: mon data avail warn = 5 2024-04-25T02:17:58.239 INFO:teuthology.orchestra.run.smithi189.stdout: mon mgr mkfs grace = 240 2024-04-25T02:17:58.239 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:17:58.239 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd reporter subtree level = osd 2024-04-25T02:17:58.239 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd prime pg temp = true 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: # 1m isn't quite enough 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: mon down mkfs grace = 300 2024-04-25T02:17:58.240 INFO:teuthology.orchestra.run.smithi189.stdout: mon op complaint time = 120 2024-04-25T02:17:58.241 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-25T02:17:58.241 INFO:teuthology.orchestra.run.smithi189.stdout:[client] 2024-04-25T02:17:58.241 INFO:teuthology.orchestra.run.smithi189.stdout: rgw cache enabled = true 2024-04-25T02:17:58.241 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable ops log = true 2024-04-25T02:17:58.241 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable usage log = true 2024-04-25T02:17:58.241 INFO:teuthology.orchestra.run.smithi189.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:17:58.241 INFO:teuthology.orchestra.run.smithi189.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:17:58.241 INFO:teuthology.orchestra.run.smithi189.stdout: client mount timeout = 600 2024-04-25T02:17:58.241 INFO:teuthology.orchestra.run.smithi189.stdout: debug client = 20 2024-04-25T02:17:58.241 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:58.241 INFO:teuthology.orchestra.run.smithi189.stdout: pid file = "" 2024-04-25T02:17:58.241 INFO:teuthology.orchestra.run.smithi189.stdout: rados mon op timeout = 900 2024-04-25T02:17:58.241 INFO:teuthology.orchestra.run.smithi189.stdout: rados osd op timeout = 900 2024-04-25T02:17:58.241 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.a] 2024-04-25T02:17:58.241 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.b] 2024-04-25T02:17:58.242 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.c] 2024-04-25T02:17:58.242 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.a] 2024-04-25T02:17:58.242 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.c] 2024-04-25T02:17:58.242 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.b] 2024-04-25T02:17:58.242 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.d] 2024-04-25T02:17:58.242 INFO:teuthology.orchestra.run.smithi189.stdout:[mds] 2024-04-25T02:17:58.242 INFO:teuthology.orchestra.run.smithi189.stdout: debug mds = 20 2024-04-25T02:17:58.242 INFO:teuthology.orchestra.run.smithi189.stdout: debug mds balancer = 20 2024-04-25T02:17:58.242 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-25T02:17:58.242 INFO:teuthology.orchestra.run.smithi189.stdout: mds debug frag = True 2024-04-25T02:17:58.242 INFO:teuthology.orchestra.run.smithi189.stdout: mds debug scatterstat = True 2024-04-25T02:17:58.242 INFO:teuthology.orchestra.run.smithi189.stdout: mds op complaint time = 180 2024-04-25T02:17:58.242 INFO:teuthology.orchestra.run.smithi189.stdout: mds verify scatter = True 2024-04-25T02:17:58.242 INFO:teuthology.orchestra.run.smithi189.stdout: osd op complaint time = 180 2024-04-25T02:17:58.243 INFO:teuthology.orchestra.run.smithi189.stdout: rados mon op timeout = 900 2024-04-25T02:17:58.243 INFO:teuthology.orchestra.run.smithi189.stdout: rados osd op timeout = 900 2024-04-25T02:17:58.244 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T02:17:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.378+0000 7f9736676640 1 Processor -- start 2024-04-25T02:17:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.378+0000 7f9736676640 1 -- start start 2024-04-25T02:17:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f9736676640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f973006b770 0x7f9730156610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f9736676640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9730071cd0 con 0x7f97300b41b0 2024-04-25T02:17:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f9736676640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9730071fb0 con 0x7f973006b2f0 2024-04-25T02:17:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f9736676640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9730156b50 con 0x7f973006b770 2024-04-25T02:17:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f9734c13640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f973006b770 0x7f9730156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f972ffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f97300b41b0 0x7f97301605d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34590/0 (socket says 172.21.15.79:34590) 2024-04-25T02:17:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f972ffff640 1 -- 172.21.15.79:0/599369037 learned_addr learned my addr 172.21.15.79:0/599369037 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f9734c13640 1 -- 172.21.15.79:0/599369037 >> v1:172.21.15.189:6789/0 conn(0x7f973006b2f0 legacy=0x7f9730155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f9734c13640 1 -- 172.21.15.79:0/599369037 >> v1:172.21.15.79:6789/0 conn(0x7f97300b41b0 legacy=0x7f97301605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f9734c13640 1 -- 172.21.15.79:0/599369037 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9730072290 con 0x7f973006b770 2024-04-25T02:17:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f972effd640 1 -- 172.21.15.79:0/599369037 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010165135 0 0) 0x7f9730071cd0 con 0x7f97300b41b0 2024-04-25T02:17:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f9734c13640 1 --2- 172.21.15.79:0/599369037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973006b770 0x7f9730156610 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f9728009d90 tx=0x7f972802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4275369c30d4e7dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f972effd640 1 -- 172.21.15.79:0/599369037 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9728007740 con 0x7f973006b770 2024-04-25T02:17:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f972effd640 1 -- 172.21.15.79:0/599369037 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97280078e0 con 0x7f973006b770 2024-04-25T02:17:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f972effd640 1 -- 172.21.15.79:0/599369037 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9728007cb0 con 0x7f973006b770 2024-04-25T02:17:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f9736676640 1 -- 172.21.15.79:0/599369037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973006b770 msgr2=0x7f9730156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f9736676640 1 --2- 172.21.15.79:0/599369037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973006b770 0x7f9730156610 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f9728009d90 tx=0x7f972802a6f0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f9736676640 1 -- 172.21.15.79:0/599369037 shutdown_connections 2024-04-25T02:17:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f9736676640 1 --2- 172.21.15.79:0/599369037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973006b770 0x7f9730156610 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.380+0000 7f9736676640 1 -- 172.21.15.79:0/599369037 >> 172.21.15.79:0/599369037 conn(0x7f97300b1cd0 msgr2=0x7f97300b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.381+0000 7f9736676640 1 -- 172.21.15.79:0/599369037 shutdown_connections 2024-04-25T02:17:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.381+0000 7f9736676640 1 -- 172.21.15.79:0/599369037 wait complete. 2024-04-25T02:17:58.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.382+0000 7f9736676640 1 Processor -- start 2024-04-25T02:17:58.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.382+0000 7f9736676640 1 -- start start 2024-04-25T02:17:58.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f9736676640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f973006b2f0 0x7f973009d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f9736676640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973006b770 0x7f9730158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f9736676640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97300b41b0 0x7f97301590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f9736676640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f97300cf4b0 con 0x7f973006b770 2024-04-25T02:17:58.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f9736676640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9730072d70 con 0x7f973006b2f0 2024-04-25T02:17:58.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f9736676640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f973006bb80 con 0x7f97300b41b0 2024-04-25T02:17:58.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f972f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973006b770 0x7f9730158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f972f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973006b770 0x7f9730158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56878/0 (socket says 172.21.15.79:56878) 2024-04-25T02:17:58.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f972f7fe640 1 -- 172.21.15.79:0/1680362703 learned_addr learned my addr 172.21.15.79:0/1680362703 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:58.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f972ffff640 1 --2- 172.21.15.79:0/1680362703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f973006b2f0 0x7f973009d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f9734c13640 1 --2- 172.21.15.79:0/1680362703 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97300b41b0 0x7f97301590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f972f7fe640 1 -- 172.21.15.79:0/1680362703 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97300b41b0 msgr2=0x7f97301590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f972f7fe640 1 --2- 172.21.15.79:0/1680362703 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97300b41b0 0x7f97301590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f972f7fe640 1 -- 172.21.15.79:0/1680362703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f973006b2f0 msgr2=0x7f973009d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:58.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f972f7fe640 1 --2- 172.21.15.79:0/1680362703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f973006b2f0 0x7f973009d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:58.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f972f7fe640 1 -- 172.21.15.79:0/1680362703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973009b850 con 0x7f973006b770 2024-04-25T02:17:58.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.383+0000 7f972f7fe640 1 --2- 172.21.15.79:0/1680362703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973006b770 0x7f9730158b60 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f972400c450 tx=0x7f972400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:58.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.384+0000 7f972cff9640 1 -- 172.21.15.79:0/1680362703 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97240052d0 con 0x7f973006b770 2024-04-25T02:17:58.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.384+0000 7f972cff9640 1 -- 172.21.15.79:0/1680362703 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9724005470 con 0x7f973006b770 2024-04-25T02:17:58.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.384+0000 7f9736676640 1 -- 172.21.15.79:0/1680362703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973009bb30 con 0x7f973006b770 2024-04-25T02:17:58.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.384+0000 7f972cff9640 1 -- 172.21.15.79:0/1680362703 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724012870 con 0x7f973006b770 2024-04-25T02:17:58.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.384+0000 7f9736676640 1 -- 172.21.15.79:0/1680362703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f973009c0f0 con 0x7f973006b770 2024-04-25T02:17:58.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.385+0000 7f9736676640 1 -- 172.21.15.79:0/1680362703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97300690a0 con 0x7f973006b770 2024-04-25T02:17:58.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.385+0000 7f972cff9640 1 -- 172.21.15.79:0/1680362703 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9724012a10 con 0x7f973006b770 2024-04-25T02:17:58.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.385+0000 7f972cff9640 1 --2- 172.21.15.79:0/1680362703 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f971c06be30 0x7f971c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:58.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.386+0000 7f972cff9640 1 -- 172.21.15.79:0/1680362703 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7f972408aa30 con 0x7f973006b770 2024-04-25T02:17:58.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.386+0000 7f972ffff640 1 --2- 172.21.15.79:0/1680362703 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f971c06be30 0x7f971c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:58.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.386+0000 7f972ffff640 1 --2- 172.21.15.79:0/1680362703 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f971c06be30 0x7f971c06e2f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9720000f60 tx=0x7f9720007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:58.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.390+0000 7f972cff9640 1 -- 172.21.15.79:0/1680362703 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9724058ca0 con 0x7f973006b770 2024-04-25T02:17:58.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:58.599+0000 7f9736676640 1 -- 172.21.15.79:0/1680362703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f973015c300 con 0x7f973006b770 2024-04-25T02:17:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.573+0000 7f972cff9640 1 -- 172.21.15.79:0/1680362703 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v92) ==== 162+0+0 (secure 0 0 0) 0x7f972405cfa0 con 0x7f973006b770 2024-04-25T02:17:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T02:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.577+0000 7f9736676640 1 -- 172.21.15.79:0/1680362703 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f971c06be30 msgr2=0x7f971c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.577+0000 7f9736676640 1 --2- 172.21.15.79:0/1680362703 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f971c06be30 0x7f971c06e2f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9720000f60 tx=0x7f9720007e40 comp rx=0 tx=0).stop 2024-04-25T02:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.577+0000 7f9736676640 1 -- 172.21.15.79:0/1680362703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973006b770 msgr2=0x7f9730158b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.577+0000 7f9736676640 1 --2- 172.21.15.79:0/1680362703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973006b770 0x7f9730158b60 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f972400c450 tx=0x7f972400c910 comp rx=0 tx=0).stop 2024-04-25T02:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.577+0000 7f9736676640 1 -- 172.21.15.79:0/1680362703 shutdown_connections 2024-04-25T02:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.577+0000 7f9736676640 1 --2- 172.21.15.79:0/1680362703 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f971c06be30 0x7f971c06e2f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.577+0000 7f9736676640 1 --2- 172.21.15.79:0/1680362703 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97300b41b0 0x7f97301590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.577+0000 7f9736676640 1 --2- 172.21.15.79:0/1680362703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973006b770 0x7f9730158b60 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.577+0000 7f9736676640 1 --2- 172.21.15.79:0/1680362703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f973006b2f0 0x7f973009d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.577+0000 7f9736676640 1 -- 172.21.15.79:0/1680362703 >> 172.21.15.79:0/1680362703 conn(0x7f97300b1cd0 msgr2=0x7f97300b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.577+0000 7f9736676640 1 -- 172.21.15.79:0/1680362703 shutdown_connections 2024-04-25T02:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.577+0000 7f9736676640 1 -- 172.21.15.79:0/1680362703 wait complete. 2024-04-25T02:17:59.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:17:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.694+0000 7fbc51390640 1 Processor -- start 2024-04-25T02:17:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.694+0000 7fbc51390640 1 -- start start 2024-04-25T02:17:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.695+0000 7fbc51390640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc4c143bc0 0x7fbc4c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.695+0000 7fbc51390640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc4c06df50 0x7fbc4c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.695+0000 7fbc51390640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc4c15fa40 con 0x7fbc4c0b48e0 2024-04-25T02:17:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.695+0000 7fbc51390640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbc4c06e8f0 con 0x7fbc4c143bc0 2024-04-25T02:17:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.695+0000 7fbc51390640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4c072cb0 con 0x7fbc4c06df50 2024-04-25T02:17:59.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.695+0000 7fbc4affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc4c143bc0 0x7fbc4c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:59.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.695+0000 7fbc4b7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbc4c0b48e0 0x7fbc4c0b4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34600/0 (socket says 172.21.15.79:34600) 2024-04-25T02:17:59.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.695+0000 7fbc4b7fe640 1 -- 172.21.15.79:0/2397568787 learned_addr learned my addr 172.21.15.79:0/2397568787 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:17:59.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.695+0000 7fbc4affd640 1 -- 172.21.15.79:0/2397568787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc4c06df50 msgr2=0x7fbc4c06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:17:59.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.695+0000 7fbc4affd640 1 --2- 172.21.15.79:0/2397568787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc4c06df50 0x7fbc4c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.695+0000 7fbc4affd640 1 -- 172.21.15.79:0/2397568787 >> v1:172.21.15.79:6789/0 conn(0x7fbc4c0b48e0 legacy=0x7fbc4c0b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:59.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.695+0000 7fbc4affd640 1 -- 172.21.15.79:0/2397568787 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4c071e00 con 0x7fbc4c143bc0 2024-04-25T02:17:59.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.695+0000 7fbc4a7fc640 1 -- 172.21.15.79:0/2397568787 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 735029002 0 0) 0x7fbc44001490 con 0x7fbc4c0b48e0 2024-04-25T02:17:59.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.696+0000 7fbc4affd640 1 --2- 172.21.15.79:0/2397568787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c143bc0 0x7fbc4c15f500 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0097a0 tx=0x7fbc3c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0cfa5b1fe00f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:59.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.696+0000 7fbc4a7fc640 1 -- 172.21.15.79:0/2397568787 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c037070 con 0x7fbc4c143bc0 2024-04-25T02:17:59.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.696+0000 7fbc4a7fc640 1 -- 172.21.15.79:0/2397568787 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3c02ae50 con 0x7fbc4c143bc0 2024-04-25T02:17:59.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.696+0000 7fbc4a7fc640 1 -- 172.21.15.79:0/2397568787 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c032660 con 0x7fbc4c143bc0 2024-04-25T02:17:59.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.697+0000 7fbc51390640 1 -- 172.21.15.79:0/2397568787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c143bc0 msgr2=0x7fbc4c15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.697+0000 7fbc51390640 1 --2- 172.21.15.79:0/2397568787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c143bc0 0x7fbc4c15f500 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0097a0 tx=0x7fbc3c02a100 comp rx=0 tx=0).stop 2024-04-25T02:17:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.697+0000 7fbc51390640 1 -- 172.21.15.79:0/2397568787 shutdown_connections 2024-04-25T02:17:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.697+0000 7fbc51390640 1 --2- 172.21.15.79:0/2397568787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc4c06df50 0x7fbc4c06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.697+0000 7fbc51390640 1 --2- 172.21.15.79:0/2397568787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c143bc0 0x7fbc4c15f500 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.697+0000 7fbc51390640 1 -- 172.21.15.79:0/2397568787 >> 172.21.15.79:0/2397568787 conn(0x7fbc4c0cfc80 msgr2=0x7fbc4c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.697+0000 7fbc51390640 1 -- 172.21.15.79:0/2397568787 shutdown_connections 2024-04-25T02:17:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.697+0000 7fbc51390640 1 -- 172.21.15.79:0/2397568787 wait complete. 2024-04-25T02:17:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.698+0000 7fbc51390640 1 Processor -- start 2024-04-25T02:17:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.698+0000 7fbc51390640 1 -- start start 2024-04-25T02:17:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc51390640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c06df50 0x7fbc4c0cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc51390640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc4c0b48e0 0x7fbc4c0c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc51390640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc4c143bc0 0x7fbc4c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc51390640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c072660 con 0x7fbc4c06df50 2024-04-25T02:17:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc51390640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c072380 con 0x7fbc4c143bc0 2024-04-25T02:17:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc51390640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4c072940 con 0x7fbc4c0b48e0 2024-04-25T02:17:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc4affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c06df50 0x7fbc4c0cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc4affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c06df50 0x7fbc4c0cc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56896/0 (socket says 172.21.15.79:56896) 2024-04-25T02:17:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc4affd640 1 -- 172.21.15.79:0/970254938 learned_addr learned my addr 172.21.15.79:0/970254938 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:17:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc4affd640 1 -- 172.21.15.79:0/970254938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc4c0b48e0 msgr2=0x7fbc4c0c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc43fff640 1 --2- 172.21.15.79:0/970254938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc4c0b48e0 0x7fbc4c0c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc4b7fe640 1 --2- 172.21.15.79:0/970254938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc4c143bc0 0x7fbc4c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc4affd640 1 --2- 172.21.15.79:0/970254938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc4c0b48e0 0x7fbc4c0c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc4affd640 1 -- 172.21.15.79:0/970254938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc4c143bc0 msgr2=0x7fbc4c071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc4affd640 1 --2- 172.21.15.79:0/970254938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc4c143bc0 0x7fbc4c071170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc4affd640 1 -- 172.21.15.79:0/970254938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4c0ac750 con 0x7fbc4c06df50 2024-04-25T02:17:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc43fff640 1 --2- 172.21.15.79:0/970254938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc4c0b48e0 0x7fbc4c0c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc4affd640 1 --2- 172.21.15.79:0/970254938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c06df50 0x7fbc4c0cc000 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0097a0 tx=0x7fbc3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc437fe640 1 -- 172.21.15.79:0/970254938 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c042070 con 0x7fbc4c06df50 2024-04-25T02:17:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc437fe640 1 -- 172.21.15.79:0/970254938 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3c03e670 con 0x7fbc4c06df50 2024-04-25T02:17:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc51390640 1 -- 172.21.15.79:0/970254938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc4c0ca2f0 con 0x7fbc4c06df50 2024-04-25T02:17:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc437fe640 1 -- 172.21.15.79:0/970254938 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c037040 con 0x7fbc4c06df50 2024-04-25T02:17:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.699+0000 7fbc51390640 1 -- 172.21.15.79:0/970254938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc4c0ca000 con 0x7fbc4c06df50 2024-04-25T02:17:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.700+0000 7fbc51390640 1 -- 172.21.15.79:0/970254938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc4c0cc9d0 con 0x7fbc4c06df50 2024-04-25T02:17:59.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.701+0000 7fbc437fe640 1 -- 172.21.15.79:0/970254938 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc3c045070 con 0x7fbc4c06df50 2024-04-25T02:17:59.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.701+0000 7fbc437fe640 1 --2- 172.21.15.79:0/970254938 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbc2c06be30 0x7fbc2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:59.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.701+0000 7fbc437fe640 1 -- 172.21.15.79:0/970254938 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7fbc3c0ab9f0 con 0x7fbc4c06df50 2024-04-25T02:17:59.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.701+0000 7fbc43fff640 1 --2- 172.21.15.79:0/970254938 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbc2c06be30 0x7fbc2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:59.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.702+0000 7fbc43fff640 1 --2- 172.21.15.79:0/970254938 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbc2c06be30 0x7fbc2c06e2f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0b4850 tx=0x7fbc34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:59.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.706+0000 7fbc437fe640 1 -- 172.21.15.79:0/970254938 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbc4c0cc9d0 con 0x7fbc4c06df50 2024-04-25T02:17:59.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.914+0000 7fbc51390640 1 -- 172.21.15.79:0/970254938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc4c068a10 con 0x7fbc4c06df50 2024-04-25T02:17:59.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.915+0000 7fbc437fe640 1 -- 172.21.15.79:0/970254938 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5178 (secure 0 0 0) 0x7fbc4c068a10 con 0x7fbc4c06df50 2024-04-25T02:17:59.919 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:17:59.919 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":93,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3866997901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3866997901},{"type":"v1","addr":"172.21.15.189:6834","nonce":3866997901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/167225705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":167225705},{"type":"v1","addr":"172.21.15.189:6835","nonce":167225705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8916,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3734112703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3734112703},{"type":"v1","addr":"172.21.15.79:6835","nonce":3734112703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:17:33.960191+0000","modified":"2024-04-25T02:17:59.577788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"a","rank":0,"incarnation":93,"state":"up:replay","state_seq":1,"addr":"172.21.15.79:6837/623571175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":623571175},{"type":"v1","addr":"172.21.15.79:6837","nonce":623571175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-04-25T02:17:59.919 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 93 2024-04-25T02:17:59.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.917+0000 7fbc51390640 1 -- 172.21.15.79:0/970254938 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbc2c06be30 msgr2=0x7fbc2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:59.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.917+0000 7fbc51390640 1 --2- 172.21.15.79:0/970254938 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbc2c06be30 0x7fbc2c06e2f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0b4850 tx=0x7fbc34008040 comp rx=0 tx=0).stop 2024-04-25T02:17:59.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.917+0000 7fbc51390640 1 -- 172.21.15.79:0/970254938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c06df50 msgr2=0x7fbc4c0cc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:59.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.917+0000 7fbc51390640 1 --2- 172.21.15.79:0/970254938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c06df50 0x7fbc4c0cc000 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0097a0 tx=0x7fbc3c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.917+0000 7fbc51390640 1 -- 172.21.15.79:0/970254938 shutdown_connections 2024-04-25T02:17:59.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.917+0000 7fbc51390640 1 --2- 172.21.15.79:0/970254938 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fbc2c06be30 0x7fbc2c06e2f0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.917+0000 7fbc51390640 1 --2- 172.21.15.79:0/970254938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc4c143bc0 0x7fbc4c071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.917+0000 7fbc51390640 1 --2- 172.21.15.79:0/970254938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc4c0b48e0 0x7fbc4c0c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.917+0000 7fbc51390640 1 --2- 172.21.15.79:0/970254938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c06df50 0x7fbc4c0cc000 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.917+0000 7fbc51390640 1 -- 172.21.15.79:0/970254938 >> 172.21.15.79:0/970254938 conn(0x7fbc4c0cfc80 msgr2=0x7fbc4c144030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:59.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.917+0000 7fbc51390640 1 -- 172.21.15.79:0/970254938 shutdown_connections 2024-04-25T02:17:59.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:17:59.917+0000 7fbc51390640 1 -- 172.21.15.79:0/970254938 wait complete. 2024-04-25T02:18:00.335 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:17:33.960191+0000', 'modified': '2024-04-25T02:17:59.577788+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9363}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9363': {'gid': 9363, 'name': 'a', 'rank': 0, 'incarnation': 93, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.79:6837/623571175', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 623571175}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 623571175}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T02:18:00.335 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9363:up:replay 2024-04-25T02:18:01.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:18:01.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.440+0000 7f0661e38640 1 Processor -- start 2024-04-25T02:18:01.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.440+0000 7f0661e38640 1 -- start start 2024-04-25T02:18:01.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f0661e38640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f065c144cb0 0x7f065c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:01.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f0661e38640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f065c06e660 0x7f065c071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:01.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f0661e38640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f065c070d90 con 0x7f065c0b5580 2024-04-25T02:18:01.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f0661e38640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f065c0cf130 con 0x7f065c06e660 2024-04-25T02:18:01.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f0661e38640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f065c0cf410 con 0x7f065c144cb0 2024-04-25T02:18:01.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065affd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f065c0b5580 0x7f065c06df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34616/0 (socket says 172.21.15.79:34616) 2024-04-25T02:18:01.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065affd640 1 -- 172.21.15.79:0/202267744 learned_addr learned my addr 172.21.15.79:0/202267744 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:01.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065bfff640 1 --2- 172.21.15.79:0/202267744 >> v2:172.21.15.189:3300/0 conn(0x7f065c06e660 0x7f065c071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:01.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065b7fe640 1 --2- 172.21.15.79:0/202267744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f065c144cb0 0x7f065c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:01.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065a7fc640 1 -- 172.21.15.79:0/202267744 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970010875 0 0) 0x7f065c070d90 con 0x7f065c0b5580 2024-04-25T02:18:01.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065a7fc640 1 -- 172.21.15.79:0/202267744 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0644003520 con 0x7f065c0b5580 2024-04-25T02:18:01.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065a7fc640 1 -- 172.21.15.79:0/202267744 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2427472473 0 0) 0x7f0644003520 con 0x7f065c0b5580 2024-04-25T02:18:01.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065a7fc640 1 -- 172.21.15.79:0/202267744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f065c144cb0 msgr2=0x7f065c0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:01.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065a7fc640 1 --2- 172.21.15.79:0/202267744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f065c144cb0 0x7f065c0b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065a7fc640 1 -- 172.21.15.79:0/202267744 >> v2:172.21.15.189:3300/0 conn(0x7f065c06e660 msgr2=0x7f065c071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:01.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065a7fc640 1 --2- 172.21.15.79:0/202267744 >> v2:172.21.15.189:3300/0 conn(0x7f065c06e660 0x7f065c071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065a7fc640 1 -- 172.21.15.79:0/202267744 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c0cf6f0 con 0x7f065c0b5580 2024-04-25T02:18:01.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065a7fc640 1 -- 172.21.15.79:0/202267744 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f0650001670 con 0x7f065c0b5580 2024-04-25T02:18:01.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065a7fc640 1 -- 172.21.15.79:0/202267744 >> v1:172.21.15.79:6789/0 conn(0x7f065c0b5580 legacy=0x7f065c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065a7fc640 1 --2- 172.21.15.79:0/202267744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06440039b0 0x7f0644003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:01.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065a7fc640 1 --2- 172.21.15.79:0/202267744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0644004800 0x7f0644004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:01.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.441+0000 7f065a7fc640 1 --2- 172.21.15.79:0/202267744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f065c144cb0 0x7f06440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:01.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.442+0000 7f065a7fc640 1 -- 172.21.15.79:0/202267744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f065c0cf130 con 0x7f06440039b0 2024-04-25T02:18:01.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.442+0000 7f065a7fc640 1 -- 172.21.15.79:0/202267744 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f065c0cf410 con 0x7f0644004800 2024-04-25T02:18:01.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.442+0000 7f065a7fc640 1 -- 172.21.15.79:0/202267744 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f064400ba40 con 0x7f065c144cb0 2024-04-25T02:18:01.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.442+0000 7f065b7fe640 1 --2- 172.21.15.79:0/202267744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06440039b0 0x7f0644003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:01.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.442+0000 7f065affd640 1 --2- 172.21.15.79:0/202267744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0644004800 0x7f0644004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:01.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.442+0000 7f065bfff640 1 --2- 172.21.15.79:0/202267744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f065c144cb0 0x7f06440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:01.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.442+0000 7f065b7fe640 1 -- 172.21.15.79:0/202267744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f065c144cb0 msgr2=0x7f06440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.442+0000 7f065b7fe640 1 --2- 172.21.15.79:0/202267744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f065c144cb0 0x7f06440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.442+0000 7f065b7fe640 1 -- 172.21.15.79:0/202267744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0644004800 msgr2=0x7f0644004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.442+0000 7f065b7fe640 1 --2- 172.21.15.79:0/202267744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0644004800 0x7f0644004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.442+0000 7f065b7fe640 1 -- 172.21.15.79:0/202267744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0644003520 con 0x7f06440039b0 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.442+0000 7f065bfff640 1 --2- 172.21.15.79:0/202267744 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f065c144cb0 0x7f06440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.443+0000 7f065b7fe640 1 --2- 172.21.15.79:0/202267744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06440039b0 0x7f0644003dd0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f064c009ac0 tx=0x7f0644005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62498ed00d5c376 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.443+0000 7f065a7fc640 1 -- 172.21.15.79:0/202267744 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c036070 con 0x7f06440039b0 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.443+0000 7f065a7fc640 1 -- 172.21.15.79:0/202267744 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f064c031400 con 0x7f06440039b0 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.443+0000 7f065a7fc640 1 -- 172.21.15.79:0/202267744 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c009690 con 0x7f06440039b0 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.443+0000 7f0661e38640 1 -- 172.21.15.79:0/202267744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06440039b0 msgr2=0x7f0644003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.443+0000 7f0661e38640 1 --2- 172.21.15.79:0/202267744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06440039b0 0x7f0644003dd0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f064c009ac0 tx=0x7f0644005830 comp rx=0 tx=0).stop 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.443+0000 7f065bfff640 1 -- 172.21.15.79:0/202267744 reap_dead start 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.443+0000 7f0661e38640 1 -- 172.21.15.79:0/202267744 shutdown_connections 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.443+0000 7f0661e38640 1 -- 172.21.15.79:0/202267744 >> 172.21.15.79:0/202267744 conn(0x7f065c0cfc80 msgr2=0x7f065c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.443+0000 7f0661e38640 1 -- 172.21.15.79:0/202267744 shutdown_connections 2024-04-25T02:18:01.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.443+0000 7f0661e38640 1 -- 172.21.15.79:0/202267744 wait complete. 2024-04-25T02:18:01.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.445+0000 7f0661e38640 1 Processor -- start 2024-04-25T02:18:01.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.445+0000 7f0661e38640 1 -- start start 2024-04-25T02:18:01.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.445+0000 7f0661e38640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06440039b0 0x7f065c143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:01.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.445+0000 7f0661e38640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f065c0ae2f0 0x7f065c141630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:01.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.445+0000 7f0661e38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f065c141b70 0x7f065c142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:01.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.445+0000 7f0661e38640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f065c145ab0 con 0x7f065c141b70 2024-04-25T02:18:01.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.445+0000 7f0661e38640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f065c145090 con 0x7f06440039b0 2024-04-25T02:18:01.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.445+0000 7f0661e38640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f065c145c30 con 0x7f065c0ae2f0 2024-04-25T02:18:01.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f065bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f065c141b70 0x7f065c142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:01.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f065bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f065c141b70 0x7f065c142020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56904/0 (socket says 172.21.15.79:56904) 2024-04-25T02:18:01.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f065bfff640 1 -- 172.21.15.79:0/684465925 learned_addr learned my addr 172.21.15.79:0/684465925 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:01.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f065b7fe640 1 --2- 172.21.15.79:0/684465925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06440039b0 0x7f065c143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:01.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f065affd640 1 --2- 172.21.15.79:0/684465925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f065c0ae2f0 0x7f065c141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:01.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f065bfff640 1 -- 172.21.15.79:0/684465925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f065c0ae2f0 msgr2=0x7f065c141630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f065bfff640 1 --2- 172.21.15.79:0/684465925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f065c0ae2f0 0x7f065c141630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f065bfff640 1 -- 172.21.15.79:0/684465925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06440039b0 msgr2=0x7f065c143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f065bfff640 1 --2- 172.21.15.79:0/684465925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06440039b0 0x7f065c143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f065bfff640 1 -- 172.21.15.79:0/684465925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c1f7bc0 con 0x7f065c141b70 2024-04-25T02:18:01.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f065affd640 1 --2- 172.21.15.79:0/684465925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f065c0ae2f0 0x7f065c141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:01.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f065bfff640 1 --2- 172.21.15.79:0/684465925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f065c141b70 0x7f065c142020 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f065c06f090 tx=0x7f06540115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:01.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f0643fff640 1 -- 172.21.15.79:0/684465925 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654016470 con 0x7f065c141b70 2024-04-25T02:18:01.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f0643fff640 1 -- 172.21.15.79:0/684465925 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f065401c070 con 0x7f065c141b70 2024-04-25T02:18:01.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f0661e38640 1 -- 172.21.15.79:0/684465925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065c0ae780 con 0x7f065c141b70 2024-04-25T02:18:01.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f0643fff640 1 -- 172.21.15.79:0/684465925 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654016850 con 0x7f065c141b70 2024-04-25T02:18:01.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.446+0000 7f0661e38640 1 -- 172.21.15.79:0/684465925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f065c0aed40 con 0x7f065c141b70 2024-04-25T02:18:01.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.447+0000 7f0661e38640 1 -- 172.21.15.79:0/684465925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f065c0690a0 con 0x7f065c141b70 2024-04-25T02:18:01.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.448+0000 7f0643fff640 1 -- 172.21.15.79:0/684465925 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0654005d10 con 0x7f065c141b70 2024-04-25T02:18:01.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.448+0000 7f0643fff640 1 --2- 172.21.15.79:0/684465925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f064806be30 0x7f064806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:01.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.448+0000 7f0643fff640 1 -- 172.21.15.79:0/684465925 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7f065408b570 con 0x7f065c141b70 2024-04-25T02:18:01.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.448+0000 7f065b7fe640 1 --2- 172.21.15.79:0/684465925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f064806be30 0x7f064806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:01.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.449+0000 7f065b7fe640 1 --2- 172.21.15.79:0/684465925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f064806be30 0x7f064806e2f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f064c033000 tx=0x7f064c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:01.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.453+0000 7f0643fff640 1 -- 172.21.15.79:0/684465925 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0654059e30 con 0x7f065c141b70 2024-04-25T02:18:01.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.662+0000 7f0661e38640 1 -- 172.21.15.79:0/684465925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f065c0d0b90 con 0x7f065c141b70 2024-04-25T02:18:01.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.662+0000 7f0643fff640 1 -- 172.21.15.79:0/684465925 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5178 (secure 0 0 0) 0x7f0654059730 con 0x7f065c141b70 2024-04-25T02:18:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:01.667 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":95,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3866997901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3866997901},{"type":"v1","addr":"172.21.15.189:6834","nonce":3866997901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/167225705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":167225705},{"type":"v1","addr":"172.21.15.189:6835","nonce":167225705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8916,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3734112703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3734112703},{"type":"v1","addr":"172.21.15.79:6835","nonce":3734112703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:17:33.960191+0000","modified":"2024-04-25T02:18:00.583622+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"a","rank":0,"incarnation":93,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.79:6837/623571175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":623571175},{"type":"v1","addr":"172.21.15.79:6837","nonce":623571175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-04-25T02:18:01.667 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 95 2024-04-25T02:18:01.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.664+0000 7f0661e38640 1 -- 172.21.15.79:0/684465925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f064806be30 msgr2=0x7f064806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.664+0000 7f0661e38640 1 --2- 172.21.15.79:0/684465925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f064806be30 0x7f064806e2f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f064c033000 tx=0x7f064c008030 comp rx=0 tx=0).stop 2024-04-25T02:18:01.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.664+0000 7f0661e38640 1 -- 172.21.15.79:0/684465925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f065c141b70 msgr2=0x7f065c142020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.664+0000 7f0661e38640 1 --2- 172.21.15.79:0/684465925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f065c141b70 0x7f065c142020 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f065c06f090 tx=0x7f06540115a0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.664+0000 7f0661e38640 1 -- 172.21.15.79:0/684465925 shutdown_connections 2024-04-25T02:18:01.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.664+0000 7f0661e38640 1 --2- 172.21.15.79:0/684465925 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f064806be30 0x7f064806e2f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.664+0000 7f0661e38640 1 --2- 172.21.15.79:0/684465925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f065c141b70 0x7f065c142020 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.664+0000 7f0661e38640 1 --2- 172.21.15.79:0/684465925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f065c0ae2f0 0x7f065c141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.664+0000 7f0661e38640 1 --2- 172.21.15.79:0/684465925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06440039b0 0x7f065c143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.664+0000 7f0661e38640 1 -- 172.21.15.79:0/684465925 >> 172.21.15.79:0/684465925 conn(0x7f065c0cfc80 msgr2=0x7f065c0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:01.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.664+0000 7f0661e38640 1 -- 172.21.15.79:0/684465925 shutdown_connections 2024-04-25T02:18:01.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:01.664+0000 7f0661e38640 1 -- 172.21.15.79:0/684465925 wait complete. 2024-04-25T02:18:01.973 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:18:01.977 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:18:02.081 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 95, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:17:33.960191+0000', 'modified': '2024-04-25T02:18:00.583622+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9363}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9363': {'gid': 9363, 'name': 'a', 'rank': 0, 'incarnation': 93, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.79:6837/623571175', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 623571175}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 623571175}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T02:18:02.081 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9363:up:rejoin 2024-04-25T02:18:03.085 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:18:03.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.190+0000 7f02fad12640 1 Processor -- start 2024-04-25T02:18:03.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.190+0000 7f02fad12640 1 -- start start 2024-04-25T02:18:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.191+0000 7f02fad12640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f02f4143bc0 0x7f02f415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.191+0000 7f02fad12640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f02f40b3d40 0x7f02f406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.191+0000 7f02fad12640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f415fa40 con 0x7f02f406df50 2024-04-25T02:18:03.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.191+0000 7f02fad12640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f02f406e8f0 con 0x7f02f4143bc0 2024-04-25T02:18:03.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.191+0000 7f02fad12640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f02f4072cb0 con 0x7f02f40b3d40 2024-04-25T02:18:03.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.191+0000 7f02f8aae640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f02f4143bc0 0x7f02f415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.191+0000 7f02f3fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f02f406df50 0x7f02f40b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34626/0 (socket says 172.21.15.79:34626) 2024-04-25T02:18:03.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.191+0000 7f02f8aae640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f02f4143bc0 0x7f02f415f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56918/0 (socket says 172.21.15.79:56918) 2024-04-25T02:18:03.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.191+0000 7f02f3fff640 1 -- 172.21.15.79:0/467440929 learned_addr learned my addr 172.21.15.79:0/467440929 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:03.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.191+0000 7f02f92af640 1 --2- 172.21.15.79:0/467440929 >> v2:172.21.15.189:3300/0 conn(0x7f02f40b3d40 0x7f02f406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.192+0000 7f02f8aae640 1 -- 172.21.15.79:0/467440929 >> v2:172.21.15.189:3300/0 conn(0x7f02f40b3d40 msgr2=0x7f02f406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:03.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.192+0000 7f02f8aae640 1 --2- 172.21.15.79:0/467440929 >> v2:172.21.15.189:3300/0 conn(0x7f02f40b3d40 0x7f02f406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.192+0000 7f02f8aae640 1 -- 172.21.15.79:0/467440929 >> v1:172.21.15.79:6789/0 conn(0x7f02f406df50 legacy=0x7f02f40b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.192+0000 7f02f8aae640 1 -- 172.21.15.79:0/467440929 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f4071e00 con 0x7f02f4143bc0 2024-04-25T02:18:03.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.192+0000 7f02f37fe640 1 -- 172.21.15.79:0/467440929 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382490974 0 0) 0x7f02e4001490 con 0x7f02f406df50 2024-04-25T02:18:03.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.192+0000 7f02f8aae640 1 --2- 172.21.15.79:0/467440929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02f4143bc0 0x7f02f415f500 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f02f4144cd0 tx=0x7f02dc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780d4a6880ecbf18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.192+0000 7f02f37fe640 1 -- 172.21.15.79:0/467440929 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc037070 con 0x7f02f4143bc0 2024-04-25T02:18:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.192+0000 7f02f37fe640 1 -- 172.21.15.79:0/467440929 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02dc032440 con 0x7f02f4143bc0 2024-04-25T02:18:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.192+0000 7f02f37fe640 1 -- 172.21.15.79:0/467440929 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc02ae60 con 0x7f02f4143bc0 2024-04-25T02:18:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.193+0000 7f02fad12640 1 -- 172.21.15.79:0/467440929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02f4143bc0 msgr2=0x7f02f415f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.193+0000 7f02fad12640 1 --2- 172.21.15.79:0/467440929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02f4143bc0 0x7f02f415f500 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f02f4144cd0 tx=0x7f02dc02a110 comp rx=0 tx=0).stop 2024-04-25T02:18:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.193+0000 7f02fad12640 1 -- 172.21.15.79:0/467440929 shutdown_connections 2024-04-25T02:18:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.193+0000 7f02fad12640 1 --2- 172.21.15.79:0/467440929 >> v2:172.21.15.189:3300/0 conn(0x7f02f40b3d40 0x7f02f406e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.193+0000 7f02fad12640 1 --2- 172.21.15.79:0/467440929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02f4143bc0 0x7f02f415f500 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.193+0000 7f02fad12640 1 -- 172.21.15.79:0/467440929 >> 172.21.15.79:0/467440929 conn(0x7f02f40cfc80 msgr2=0x7f02f40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.193+0000 7f02fad12640 1 -- 172.21.15.79:0/467440929 shutdown_connections 2024-04-25T02:18:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.193+0000 7f02fad12640 1 -- 172.21.15.79:0/467440929 wait complete. 2024-04-25T02:18:03.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.194+0000 7f02fad12640 1 Processor -- start 2024-04-25T02:18:03.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.194+0000 7f02fad12640 1 -- start start 2024-04-25T02:18:03.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.195+0000 7f02fad12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02f406df50 0x7f02f413dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.195+0000 7f02fad12640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02f40b3d40 0x7f02f41564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.195+0000 7f02fad12640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02f4143bc0 0x7f02f41599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.195+0000 7f02fad12640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f02f4072660 con 0x7f02f406df50 2024-04-25T02:18:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.195+0000 7f02fad12640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f02f4072380 con 0x7f02f4143bc0 2024-04-25T02:18:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.195+0000 7f02fad12640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f02f4072940 con 0x7f02f40b3d40 2024-04-25T02:18:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.195+0000 7f02f8aae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02f406df50 0x7f02f413dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.195+0000 7f02f8aae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02f406df50 0x7f02f413dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56934/0 (socket says 172.21.15.79:56934) 2024-04-25T02:18:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.195+0000 7f02f8aae640 1 -- 172.21.15.79:0/2546306028 learned_addr learned my addr 172.21.15.79:0/2546306028 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.195+0000 7f02f92af640 1 --2- 172.21.15.79:0/2546306028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02f4143bc0 0x7f02f41599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.195+0000 7f02f8aae640 1 -- 172.21.15.79:0/2546306028 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02f40b3d40 msgr2=0x7f02f41564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.195+0000 7f02f8aae640 1 --2- 172.21.15.79:0/2546306028 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02f40b3d40 0x7f02f41564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.195+0000 7f02f8aae640 1 -- 172.21.15.79:0/2546306028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02f4143bc0 msgr2=0x7f02f41599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.196+0000 7f02f8aae640 1 --2- 172.21.15.79:0/2546306028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02f4143bc0 0x7f02f41599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.196+0000 7f02f8aae640 1 -- 172.21.15.79:0/2546306028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f41573e0 con 0x7f02f406df50 2024-04-25T02:18:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.196+0000 7f02f8aae640 1 --2- 172.21.15.79:0/2546306028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02f406df50 0x7f02f413dad0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009890 tx=0x7f02dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.196+0000 7f02f17fa640 1 -- 172.21.15.79:0/2546306028 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc037040 con 0x7f02f406df50 2024-04-25T02:18:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.196+0000 7f02f17fa640 1 -- 172.21.15.79:0/2546306028 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02dc042070 con 0x7f02f406df50 2024-04-25T02:18:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.196+0000 7f02fad12640 1 -- 172.21.15.79:0/2546306028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f41576c0 con 0x7f02f406df50 2024-04-25T02:18:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.196+0000 7f02f17fa640 1 -- 172.21.15.79:0/2546306028 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc030bd0 con 0x7f02f406df50 2024-04-25T02:18:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.196+0000 7f02fad12640 1 -- 172.21.15.79:0/2546306028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f4157c80 con 0x7f02f406df50 2024-04-25T02:18:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.197+0000 7f02fad12640 1 -- 172.21.15.79:0/2546306028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f40690a0 con 0x7f02f406df50 2024-04-25T02:18:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.197+0000 7f02f17fa640 1 -- 172.21.15.79:0/2546306028 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02dc047460 con 0x7f02f406df50 2024-04-25T02:18:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.198+0000 7f02f17fa640 1 --2- 172.21.15.79:0/2546306028 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f02d406be30 0x7f02d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.198+0000 7f02f17fa640 1 -- 172.21.15.79:0/2546306028 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7f02dc0abb20 con 0x7f02f406df50 2024-04-25T02:18:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.198+0000 7f02f3fff640 1 --2- 172.21.15.79:0/2546306028 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f02d406be30 0x7f02d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.198+0000 7f02f3fff640 1 --2- 172.21.15.79:0/2546306028 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f02d406be30 0x7f02d406e2f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f02e4007fd0 tx=0x7f02e4007ce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:03.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.202+0000 7f02f17fa640 1 -- 172.21.15.79:0/2546306028 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f02dc032e20 con 0x7f02f406df50 2024-04-25T02:18:03.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.411+0000 7f02fad12640 1 -- 172.21.15.79:0/2546306028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02f40d0060 con 0x7f02f406df50 2024-04-25T02:18:03.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.412+0000 7f02f17fa640 1 -- 172.21.15.79:0/2546306028 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5185 (secure 0 0 0) 0x7f02dc07a3e0 con 0x7f02f406df50 2024-04-25T02:18:03.416 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:03.417 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3866997901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3866997901},{"type":"v1","addr":"172.21.15.189:6834","nonce":3866997901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/167225705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":167225705},{"type":"v1","addr":"172.21.15.189:6835","nonce":167225705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8916,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3734112703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3734112703},{"type":"v1","addr":"172.21.15.79:6835","nonce":3734112703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:17:33.960191+0000","modified":"2024-04-25T02:18:02.586727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"a","rank":0,"incarnation":93,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/623571175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":623571175},{"type":"v1","addr":"172.21.15.79:6837","nonce":623571175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":8}]} 2024-04-25T02:18:03.417 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 96 2024-04-25T02:18:03.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.414+0000 7f02fad12640 1 -- 172.21.15.79:0/2546306028 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f02d406be30 msgr2=0x7f02d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.414+0000 7f02fad12640 1 --2- 172.21.15.79:0/2546306028 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f02d406be30 0x7f02d406e2f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f02e4007fd0 tx=0x7f02e4007ce0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.414+0000 7f02fad12640 1 -- 172.21.15.79:0/2546306028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02f406df50 msgr2=0x7f02f413dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.414+0000 7f02fad12640 1 --2- 172.21.15.79:0/2546306028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02f406df50 0x7f02f413dad0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009890 tx=0x7f02dc0046c0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.414+0000 7f02fad12640 1 -- 172.21.15.79:0/2546306028 shutdown_connections 2024-04-25T02:18:03.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.414+0000 7f02fad12640 1 --2- 172.21.15.79:0/2546306028 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f02d406be30 0x7f02d406e2f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.414+0000 7f02fad12640 1 --2- 172.21.15.79:0/2546306028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02f4143bc0 0x7f02f41599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.414+0000 7f02fad12640 1 --2- 172.21.15.79:0/2546306028 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02f40b3d40 0x7f02f41564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.414+0000 7f02fad12640 1 --2- 172.21.15.79:0/2546306028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02f406df50 0x7f02f413dad0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.414+0000 7f02fad12640 1 -- 172.21.15.79:0/2546306028 >> 172.21.15.79:0/2546306028 conn(0x7f02f40cfc80 msgr2=0x7f02f415f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:03.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.414+0000 7f02fad12640 1 -- 172.21.15.79:0/2546306028 shutdown_connections 2024-04-25T02:18:03.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.414+0000 7f02fad12640 1 -- 172.21.15.79:0/2546306028 wait complete. 2024-04-25T02:18:03.581 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-04-25T02:18:03.577+0000 7fdc3c5a5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:18:03.831 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 96, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:17:33.960191+0000', 'modified': '2024-04-25T02:18:02.586727+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9363}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9363': {'gid': 9363, 'name': 'a', 'rank': 0, 'incarnation': 93, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.79:6837/623571175', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 623571175}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 623571175}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9363, 'qdb_cluster': [9363]} 2024-04-25T02:18:03.831 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:18:03.831 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T02:18:03.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.925+0000 7ff07bfb0640 1 Processor -- start 2024-04-25T02:18:03.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.926+0000 7ff07bfb0640 1 -- start start 2024-04-25T02:18:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.926+0000 7ff07bfb0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0740d2e20 0x7ff0740cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.926+0000 7ff07bfb0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff07406c380 con 0x7ff07415e4d0 2024-04-25T02:18:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.926+0000 7ff07bfb0640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0740d1660 con 0x7ff0740b3570 2024-04-25T02:18:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.926+0000 7ff07bfb0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff0740d1380 con 0x7ff0740d2e20 2024-04-25T02:18:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.927+0000 7ff079d4c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff07415e4d0 0x7ff07406bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36660/0 (socket says 172.21.15.79:36660) 2024-04-25T02:18:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.927+0000 7ff079d4c640 1 -- 172.21.15.79:0/534615887 learned_addr learned my addr 172.21.15.79:0/534615887 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.927+0000 7ff07a54d640 1 --2- 172.21.15.79:0/534615887 >> v2:172.21.15.79:3300/0 conn(0x7ff0740d2e20 0x7ff0740cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.927+0000 7ff078d4a640 1 -- 172.21.15.79:0/534615887 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2666688010 0 0) 0x7ff07406c380 con 0x7ff07415e4d0 2024-04-25T02:18:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.927+0000 7ff078d4a640 1 -- 172.21.15.79:0/534615887 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff05c003520 con 0x7ff07415e4d0 2024-04-25T02:18:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.927+0000 7ff07a54d640 1 -- 172.21.15.79:0/534615887 >> v1:172.21.15.189:6789/0 conn(0x7ff0740b3570 legacy=0x7ff0740d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.927+0000 7ff07a54d640 1 -- 172.21.15.79:0/534615887 >> v1:172.21.15.79:6789/0 conn(0x7ff07415e4d0 legacy=0x7ff07406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.927+0000 7ff07a54d640 1 -- 172.21.15.79:0/534615887 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0740cede0 con 0x7ff0740d2e20 2024-04-25T02:18:03.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.928+0000 7ff07a54d640 1 --2- 172.21.15.79:0/534615887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0740d2e20 0x7ff0740cf5e0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7ff0640097d0 tx=0x7ff06402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07cbb4ad7e94d7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:03.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.928+0000 7ff078d4a640 1 -- 172.21.15.79:0/534615887 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064037070 con 0x7ff0740d2e20 2024-04-25T02:18:03.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.928+0000 7ff078d4a640 1 -- 172.21.15.79:0/534615887 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff064032440 con 0x7ff0740d2e20 2024-04-25T02:18:03.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.928+0000 7ff078d4a640 1 -- 172.21.15.79:0/534615887 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064032810 con 0x7ff0740d2e20 2024-04-25T02:18:03.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.928+0000 7ff07bfb0640 1 -- 172.21.15.79:0/534615887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0740d2e20 msgr2=0x7ff0740cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.928+0000 7ff07bfb0640 1 --2- 172.21.15.79:0/534615887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0740d2e20 0x7ff0740cf5e0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7ff0640097d0 tx=0x7ff06402a270 comp rx=0 tx=0).stop 2024-04-25T02:18:03.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.928+0000 7ff07bfb0640 1 -- 172.21.15.79:0/534615887 shutdown_connections 2024-04-25T02:18:03.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.928+0000 7ff07bfb0640 1 --2- 172.21.15.79:0/534615887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0740d2e20 0x7ff0740cf5e0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.928+0000 7ff07bfb0640 1 -- 172.21.15.79:0/534615887 >> 172.21.15.79:0/534615887 conn(0x7ff07409d460 msgr2=0x7ff0740d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:03.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.928+0000 7ff07bfb0640 1 -- 172.21.15.79:0/534615887 shutdown_connections 2024-04-25T02:18:03.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.928+0000 7ff07bfb0640 1 -- 172.21.15.79:0/534615887 wait complete. 2024-04-25T02:18:03.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.930+0000 7ff07bfb0640 1 Processor -- start 2024-04-25T02:18:03.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.930+0000 7ff07bfb0640 1 -- start start 2024-04-25T02:18:03.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.930+0000 7ff07bfb0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0740b3570 0x7ff0741600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.930+0000 7ff07bfb0640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0740d2e20 0x7ff07414f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.930+0000 7ff07bfb0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff07415e4d0 0x7ff0740cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.930+0000 7ff07bfb0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0740d20d0 con 0x7ff0740b3570 2024-04-25T02:18:03.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.930+0000 7ff07bfb0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff07415e8b0 con 0x7ff07415e4d0 2024-04-25T02:18:03.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.930+0000 7ff07bfb0640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff0740d2250 con 0x7ff0740d2e20 2024-04-25T02:18:03.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.930+0000 7ff079d4c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0740b3570 0x7ff0741600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.930+0000 7ff079d4c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0740b3570 0x7ff0741600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53056/0 (socket says 172.21.15.79:53056) 2024-04-25T02:18:03.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.930+0000 7ff079d4c640 1 -- 172.21.15.79:0/2176660531 learned_addr learned my addr 172.21.15.79:0/2176660531 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:03.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.931+0000 7ff07a54d640 1 --2- 172.21.15.79:0/2176660531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff07415e4d0 0x7ff0740cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.931+0000 7ff07954b640 1 --2- 172.21.15.79:0/2176660531 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0740d2e20 0x7ff07414f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.931+0000 7ff079d4c640 1 -- 172.21.15.79:0/2176660531 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0740d2e20 msgr2=0x7ff07414f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.931+0000 7ff079d4c640 1 --2- 172.21.15.79:0/2176660531 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0740d2e20 0x7ff07414f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.931+0000 7ff079d4c640 1 -- 172.21.15.79:0/2176660531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff07415e4d0 msgr2=0x7ff0740cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.931+0000 7ff079d4c640 1 --2- 172.21.15.79:0/2176660531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff07415e4d0 0x7ff0740cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.931+0000 7ff079d4c640 1 -- 172.21.15.79:0/2176660531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0740b8a50 con 0x7ff0740b3570 2024-04-25T02:18:03.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.931+0000 7ff07954b640 1 --2- 172.21.15.79:0/2176660531 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0740d2e20 0x7ff07414f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:03.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.931+0000 7ff079d4c640 1 --2- 172.21.15.79:0/2176660531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0740b3570 0x7ff0741600c0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00cbc0 tx=0x7ff06c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:03.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.931+0000 7ff0727fc640 1 -- 172.21.15.79:0/2176660531 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c017070 con 0x7ff0740b3570 2024-04-25T02:18:03.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.931+0000 7ff0727fc640 1 -- 172.21.15.79:0/2176660531 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06c00ad40 con 0x7ff0740b3570 2024-04-25T02:18:03.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.931+0000 7ff0727fc640 1 -- 172.21.15.79:0/2176660531 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c012620 con 0x7ff0740b3570 2024-04-25T02:18:03.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.931+0000 7ff07bfb0640 1 -- 172.21.15.79:0/2176660531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0740b8d30 con 0x7ff0740b3570 2024-04-25T02:18:03.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.931+0000 7ff07bfb0640 1 -- 172.21.15.79:0/2176660531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0740b92f0 con 0x7ff0740b3570 2024-04-25T02:18:03.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.933+0000 7ff0727fc640 1 -- 172.21.15.79:0/2176660531 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff06c01a070 con 0x7ff0740b3570 2024-04-25T02:18:03.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.933+0000 7ff0727fc640 1 --2- 172.21.15.79:0/2176660531 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff06006be30 0x7ff06006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.933+0000 7ff0727fc640 1 -- 172.21.15.79:0/2176660531 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7ff06c08ad30 con 0x7ff0740b3570 2024-04-25T02:18:03.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.933+0000 7ff07954b640 1 --2- 172.21.15.79:0/2176660531 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff06006be30 0x7ff06006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.934+0000 7ff07954b640 1 --2- 172.21.15.79:0/2176660531 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff06006be30 0x7ff06006e2f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff07415c4d0 tx=0x7ff068009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:03.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.934+0000 7ff07ed9d740 1 Processor -- start 2024-04-25T02:18:03.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.934+0000 7ff07ed9d740 1 -- start start 2024-04-25T02:18:03.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff07ed9d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006182b60 0x5560061354f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff07ed9d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006165c80 0x556006165000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff07ed9d740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006165540 0x55600613a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff07ed9d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55600609df00 con 0x556006182b60 2024-04-25T02:18:03.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff07ed9d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556006046750 con 0x556006165c80 2024-04-25T02:18:03.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff07ed9d740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x556006099ec0 con 0x556006165540 2024-04-25T02:18:03.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff079d4c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006182b60 0x5560061354f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff079d4c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006182b60 0x5560061354f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53070/0 (socket says 172.21.15.79:53070) 2024-04-25T02:18:03.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff079d4c640 1 -- 172.21.15.79:0/1244433474 learned_addr learned my addr 172.21.15.79:0/1244433474 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:03.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff079d4c640 1 -- 172.21.15.79:0/1244433474 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006165540 msgr2=0x55600613a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:03.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff079d4c640 1 --2- 172.21.15.79:0/1244433474 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006165540 0x55600613a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff079d4c640 1 -- 172.21.15.79:0/1244433474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006165c80 msgr2=0x556006165000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:03.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff079d4c640 1 --2- 172.21.15.79:0/1244433474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006165c80 0x556006165000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff079d4c640 1 -- 172.21.15.79:0/1244433474 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556005db22d0 con 0x556006182b60 2024-04-25T02:18:03.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff079d4c640 1 --2- 172.21.15.79:0/1244433474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006182b60 0x5560061354f0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7ff06c0891a0 tx=0x7ff06c059740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e00e33320a8481 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:03.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.935+0000 7ff05b7fe640 1 -- 172.21.15.79:0/1244433474 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c061b60 con 0x556006182b60 2024-04-25T02:18:03.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.936+0000 7ff05b7fe640 1 -- 172.21.15.79:0/1244433474 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06c057280 con 0x556006182b60 2024-04-25T02:18:03.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.936+0000 7ff05b7fe640 1 -- 172.21.15.79:0/1244433474 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c0616d0 con 0x556006182b60 2024-04-25T02:18:03.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.936+0000 7ff07ed9d740 1 -- 172.21.15.79:0/1244433474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006182b60 msgr2=0x5560061354f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.936+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/1244433474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006182b60 0x5560061354f0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7ff06c0891a0 tx=0x7ff06c059740 comp rx=0 tx=0).stop 2024-04-25T02:18:03.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.936+0000 7ff07ed9d740 1 -- 172.21.15.79:0/1244433474 shutdown_connections 2024-04-25T02:18:03.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.936+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/1244433474 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006165540 0x55600613a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.936+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/1244433474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006165c80 0x556006165000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.936+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/1244433474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006182b60 0x5560061354f0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.936+0000 7ff07ed9d740 1 -- 172.21.15.79:0/1244433474 >> 172.21.15.79:0/1244433474 conn(0x556006137760 msgr2=0x556006180000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:03.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.936+0000 7ff07ed9d740 1 -- 172.21.15.79:0/1244433474 shutdown_connections 2024-04-25T02:18:03.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.936+0000 7ff07ed9d740 1 -- 172.21.15.79:0/1244433474 wait complete. 2024-04-25T02:18:03.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.937+0000 7ff07ed9d740 1 -- start start 2024-04-25T02:18:03.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.937+0000 7ff07ed9d740 1 Processor -- start 2024-04-25T02:18:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07ed9d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006165c80 0x556006168190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07ed9d740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006182b60 0x556006190d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07ed9d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006178ea0 0x556006176cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07ed9d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556006139910 con 0x556006178ea0 2024-04-25T02:18:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07ed9d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556006059cf0 con 0x556006165c80 2024-04-25T02:18:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07ed9d740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x556006138d00 con 0x556006182b60 2024-04-25T02:18:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07ed9d740 10 client.0 _ll_register_callbacks cb 0x5560060596e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:18:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07a54d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006178ea0 0x556006176cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07a54d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006178ea0 0x556006176cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53076/0 (socket says 172.21.15.79:53076) 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07a54d640 1 -- 172.21.15.79:0/3255587973 learned_addr learned my addr 172.21.15.79:0/3255587973 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff079d4c640 1 --2- 172.21.15.79:0/3255587973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006165c80 0x556006168190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07954b640 1 --2- 172.21.15.79:0/3255587973 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006182b60 0x556006190d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07a54d640 1 -- 172.21.15.79:0/3255587973 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006182b60 msgr2=0x556006190d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07a54d640 1 --2- 172.21.15.79:0/3255587973 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006182b60 0x556006190d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07a54d640 1 -- 172.21.15.79:0/3255587973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006165c80 msgr2=0x556006168190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07a54d640 1 --2- 172.21.15.79:0/3255587973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006165c80 0x556006168190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07a54d640 1 -- 172.21.15.79:0/3255587973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556005e7c6b0 con 0x556006178ea0 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07954b640 1 --2- 172.21.15.79:0/3255587973 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006182b60 0x556006190d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07a54d640 1 --2- 172.21.15.79:0/3255587973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006178ea0 0x556006176cc0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7ff064035040 tx=0x7ff064004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f800dc1620ec2de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff058ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff058ff9640 1 -- 172.21.15.79:0/3255587973 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064043060 con 0x556006178ea0 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff058ff9640 1 -- 172.21.15.79:0/3255587973 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7ff06403e650 con 0x556006178ea0 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.938+0000 7ff07ed9d740 1 -- 172.21.15.79:0/3255587973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff06c057280 con 0x556006178ea0 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.939+0000 7ff058ff9640 1 -- 172.21.15.79:0/3255587973 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7ff064049050 con 0x556006178ea0 2024-04-25T02:18:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.939+0000 7ff07ed9d740 10 client.9465 fetch_fsmap learned FSMap version 96 2024-04-25T02:18:03.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.939+0000 7ff07ed9d740 1 -- 172.21.15.79:0/3255587973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x556006190520 con 0x556006178ea0 2024-04-25T02:18:03.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.939+0000 7ff058ff9640 1 -- 172.21.15.79:0/3255587973 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06c057280 con 0x556006178ea0 2024-04-25T02:18:03.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.939+0000 7ff058ff9640 1 -- 172.21.15.79:0/3255587973 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 96) ==== 3494+0+0 (secure 0 0 0) 0x7ff06404c020 con 0x556006178ea0 2024-04-25T02:18:03.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.939+0000 7ff07ed9d740 10 client.9465 fetch_fsmap finished waiting for FSMap version 96 2024-04-25T02:18:03.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.939+0000 7ff07ed9d740 10 client.9465 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:18:03.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.939+0000 7ff07ed9d740 20 client.9465 populate_metadata read hostname 'smithi079' 2024-04-25T02:18:03.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.939+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/3255587973 >> [v2:172.21.15.79:6836/623571175,v1:172.21.15.79:6837/623571175] conn(0x556006177200 0x556006166790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.939+0000 7ff07ed9d740 4 client.9465 mds_command: new command op to 9363 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:18:03.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.939+0000 7ff07ed9d740 1 -- 172.21.15.79:0/3255587973 --> [v2:172.21.15.79:6836/623571175,v1:172.21.15.79:6837/623571175] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560060ab440 con 0x556006177200 2024-04-25T02:18:03.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.939+0000 7ff079d4c640 1 --2- 172.21.15.79:0/3255587973 >> [v2:172.21.15.79:6836/623571175,v1:172.21.15.79:6837/623571175] conn(0x556006177200 0x556006166790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.939+0000 7ff058ff9640 10 client.9465 ms_handle_connect on v2:172.21.15.79:6836/623571175 2024-04-25T02:18:03.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.939+0000 7ff079d4c640 1 --2- 172.21.15.79:0/3255587973 >> [v2:172.21.15.79:6836/623571175,v1:172.21.15.79:6837/623571175] conn(0x556006177200 0x556006166790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6adc7b2a36c3cdff server_cookie=8f50f8c85cb8e202 in_seq=0 out_seq=0 2024-04-25T02:18:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.940+0000 7ff058ff9640 1 -- 172.21.15.79:0/3255587973 <== mds.0 v2:172.21.15.79:6836/623571175 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5560060ab440 con 0x556006177200 2024-04-25T02:18:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.940+0000 7ff058ff9640 10 client.9465 handle_command_reply: tid=0 2024-04-25T02:18:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.940+0000 7ff07ed9d740 1 client.9465 shutdown 2024-04-25T02:18:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.940+0000 7ff07ed9d740 1 -- 172.21.15.79:0/3255587973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006178ea0 msgr2=0x556006176cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.940+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/3255587973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006178ea0 0x556006176cc0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7ff064035040 tx=0x7ff064004730 comp rx=0 tx=0).stop 2024-04-25T02:18:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.940+0000 7ff07ed9d740 1 -- 172.21.15.79:0/3255587973 shutdown_connections 2024-04-25T02:18:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.940+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/3255587973 >> [v2:172.21.15.79:6836/623571175,v1:172.21.15.79:6837/623571175] conn(0x556006177200 0x556006166790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.940+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/3255587973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006178ea0 0x556006176cc0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.940+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/3255587973 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006182b60 0x556006190d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.940+0000 7ff058ff9640 0 client.9465 ms_handle_reset on v2:172.21.15.79:6836/623571175 2024-04-25T02:18:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.940+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/3255587973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006165c80 0x556006168190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.940+0000 7ff07ed9d740 1 -- 172.21.15.79:0/3255587973 >> 172.21.15.79:0/3255587973 conn(0x556006165540 msgr2=0x556006183420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.940+0000 7ff07ed9d740 1 -- 172.21.15.79:0/3255587973 shutdown_connections 2024-04-25T02:18:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.940+0000 7ff07ed9d740 1 -- 172.21.15.79:0/3255587973 wait complete. 2024-04-25T02:18:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.940+0000 7ff07ed9d740 20 client.9465 trim_cache size 0 max 16384 2024-04-25T02:18:03.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.958+0000 7ff07ed9d740 1 Processor -- start 2024-04-25T02:18:03.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.958+0000 7ff07ed9d740 1 -- start start 2024-04-25T02:18:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff07ed9d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006165c80 0x55600617eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff07ed9d740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006178ea0 0x556006166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff07ed9d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006182b60 0x556006166c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff07ed9d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0742009c0 con 0x556006165c80 2024-04-25T02:18:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff07ed9d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff0741ffa50 con 0x556006182b60 2024-04-25T02:18:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff07ed9d740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff0741f49d0 con 0x556006178ea0 2024-04-25T02:18:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff079d4c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006165c80 0x55600617eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff079d4c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006165c80 0x55600617eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53084/0 (socket says 172.21.15.79:53084) 2024-04-25T02:18:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff079d4c640 1 -- 172.21.15.79:0/3686986576 learned_addr learned my addr 172.21.15.79:0/3686986576 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff07954b640 1 --2- 172.21.15.79:0/3686986576 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006178ea0 0x556006166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff07a54d640 1 --2- 172.21.15.79:0/3686986576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006182b60 0x556006166c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff079d4c640 1 -- 172.21.15.79:0/3686986576 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006178ea0 msgr2=0x556006166710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff079d4c640 1 --2- 172.21.15.79:0/3686986576 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006178ea0 0x556006166710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff079d4c640 1 -- 172.21.15.79:0/3686986576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006182b60 msgr2=0x556006166c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff079d4c640 1 --2- 172.21.15.79:0/3686986576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006182b60 0x556006166c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff079d4c640 1 -- 172.21.15.79:0/3686986576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556006183e00 con 0x556006165c80 2024-04-25T02:18:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.959+0000 7ff079d4c640 1 --2- 172.21.15.79:0/3686986576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006165c80 0x55600617eb20 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7ff06c089250 tx=0x7ff06c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f170a02dec89a117 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.960+0000 7ff05affd640 1 -- 172.21.15.79:0/3686986576 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c0616d0 con 0x556006165c80 2024-04-25T02:18:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.960+0000 7ff05affd640 1 -- 172.21.15.79:0/3686986576 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06c061890 con 0x556006165c80 2024-04-25T02:18:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.960+0000 7ff05affd640 1 -- 172.21.15.79:0/3686986576 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c082da0 con 0x556006165c80 2024-04-25T02:18:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.960+0000 7ff07ed9d740 1 -- 172.21.15.79:0/3686986576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006165c80 msgr2=0x55600617eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.960+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/3686986576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006165c80 0x55600617eb20 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7ff06c089250 tx=0x7ff06c01e000 comp rx=0 tx=0).stop 2024-04-25T02:18:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.960+0000 7ff07ed9d740 1 -- 172.21.15.79:0/3686986576 shutdown_connections 2024-04-25T02:18:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.960+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/3686986576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006182b60 0x556006166c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.960+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/3686986576 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006178ea0 0x556006166710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.960+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/3686986576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006165c80 0x55600617eb20 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.960+0000 7ff07ed9d740 1 -- 172.21.15.79:0/3686986576 >> 172.21.15.79:0/3686986576 conn(0x556006165540 msgr2=0x556006178370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.960+0000 7ff07ed9d740 1 -- 172.21.15.79:0/3686986576 shutdown_connections 2024-04-25T02:18:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.960+0000 7ff07ed9d740 1 -- 172.21.15.79:0/3686986576 wait complete. 2024-04-25T02:18:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.961+0000 7ff07ed9d740 1 -- start start 2024-04-25T02:18:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.961+0000 7ff07ed9d740 1 Processor -- start 2024-04-25T02:18:03.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07ed9d740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006165c80 0x5560061345a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07ed9d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006178ea0 0x5560061f99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07ed9d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006182b60 0x55600618f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07ed9d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556006160b40 con 0x556006178ea0 2024-04-25T02:18:03.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07ed9d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff0741f5020 con 0x556006182b60 2024-04-25T02:18:03.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07ed9d740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x556006182090 con 0x556006165c80 2024-04-25T02:18:03.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07ed9d740 10 client.0 _ll_register_callbacks cb 0x7ff064009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:18:03.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07954b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006178ea0 0x5560061f99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07954b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006178ea0 0x5560061f99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53098/0 (socket says 172.21.15.79:53098) 2024-04-25T02:18:03.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07954b640 1 -- 172.21.15.79:0/854709466 learned_addr learned my addr 172.21.15.79:0/854709466 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:03.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff079d4c640 1 --2- 172.21.15.79:0/854709466 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006165c80 0x5560061345a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07a54d640 1 --2- 172.21.15.79:0/854709466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006182b60 0x55600618f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07954b640 1 -- 172.21.15.79:0/854709466 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006165c80 msgr2=0x5560061345a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07954b640 1 --2- 172.21.15.79:0/854709466 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006165c80 0x5560061345a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07954b640 1 -- 172.21.15.79:0/854709466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006182b60 msgr2=0x55600618f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07954b640 1 --2- 172.21.15.79:0/854709466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006182b60 0x55600618f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07954b640 1 -- 172.21.15.79:0/854709466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55600617fdf0 con 0x556006178ea0 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07a54d640 1 --2- 172.21.15.79:0/854709466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006182b60 0x55600618f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07954b640 1 --2- 172.21.15.79:0/854709466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006178ea0 0x5560061f99d0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7ff06800db60 tx=0x7ff068000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c96a78d5b4b3cf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff058ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff058ff9640 1 -- 172.21.15.79:0/854709466 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068014c70 con 0x556006178ea0 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff058ff9640 1 -- 172.21.15.79:0/854709466 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7ff068007050 con 0x556006178ea0 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07ed9d740 1 -- 172.21.15.79:0/854709466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff06c061890 con 0x556006178ea0 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff058ff9640 1 -- 172.21.15.79:0/854709466 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7ff06802e050 con 0x556006178ea0 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07ed9d740 10 client.9471 fetch_fsmap learned FSMap version 96 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.962+0000 7ff07ed9d740 1 -- 172.21.15.79:0/854709466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x556006180b90 con 0x556006178ea0 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff058ff9640 1 -- 172.21.15.79:0/854709466 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06c061890 con 0x556006178ea0 2024-04-25T02:18:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff058ff9640 1 -- 172.21.15.79:0/854709466 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 96) ==== 3494+0+0 (secure 0 0 0) 0x7ff068031020 con 0x556006178ea0 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff07ed9d740 10 client.9471 fetch_fsmap finished waiting for FSMap version 96 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff07ed9d740 10 client.9471 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff07ed9d740 20 client.9471 populate_metadata read hostname 'smithi079' 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/854709466 >> [v2:172.21.15.79:6836/623571175,v1:172.21.15.79:6837/623571175] conn(0x556006175990 0x556006175d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff07ed9d740 4 client.9471 mds_command: new command op to 9363 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff07ed9d740 1 -- 172.21.15.79:0/854709466 --> [v2:172.21.15.79:6836/623571175,v1:172.21.15.79:6837/623571175] -- command(tid 0: {"prefix": "status"}) -- 0x5560060a5790 con 0x556006175990 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff079d4c640 1 --2- 172.21.15.79:0/854709466 >> [v2:172.21.15.79:6836/623571175,v1:172.21.15.79:6837/623571175] conn(0x556006175990 0x556006175d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff058ff9640 10 client.9471 ms_handle_connect on v2:172.21.15.79:6836/623571175 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff079d4c640 1 --2- 172.21.15.79:0/854709466 >> [v2:172.21.15.79:6836/623571175,v1:172.21.15.79:6837/623571175] conn(0x556006175990 0x556006175d70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4259f4923628b2dc server_cookie=68ea56ce3e2a3568 in_seq=0 out_seq=0 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff058ff9640 1 -- 172.21.15.79:0/854709466 <== mds.0 v2:172.21.15.79:6836/623571175 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5560060a5790 con 0x556006175990 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff058ff9640 10 client.9471 handle_command_reply: tid=0 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff07ed9d740 1 client.9471 shutdown 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff07ed9d740 1 -- 172.21.15.79:0/854709466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006178ea0 msgr2=0x5560061f99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/854709466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006178ea0 0x5560061f99d0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7ff06800db60 tx=0x7ff068000ed0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff07ed9d740 1 -- 172.21.15.79:0/854709466 shutdown_connections 2024-04-25T02:18:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/854709466 >> [v2:172.21.15.79:6836/623571175,v1:172.21.15.79:6837/623571175] conn(0x556006175990 0x556006175d70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/854709466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556006182b60 0x55600618f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff058ff9640 0 client.9471 ms_handle_reset on v2:172.21.15.79:6836/623571175 2024-04-25T02:18:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/854709466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556006178ea0 0x5560061f99d0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff07ed9d740 1 --2- 172.21.15.79:0/854709466 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x556006165c80 0x5560061345a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.963+0000 7ff07ed9d740 1 -- 172.21.15.79:0/854709466 >> 172.21.15.79:0/854709466 conn(0x556006165540 msgr2=0x556006183640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.964+0000 7ff07ed9d740 1 -- 172.21.15.79:0/854709466 shutdown_connections 2024-04-25T02:18:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.964+0000 7ff07ed9d740 1 -- 172.21.15.79:0/854709466 wait complete. 2024-04-25T02:18:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.964+0000 7ff07ed9d740 20 client.9471 trim_cache size 0 max 16384 2024-04-25T02:18:03.974 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:18:03.974 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "696648c4-3e52-400b-a780-2e8863c56c42", 2024-04-25T02:18:03.974 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-04-25T02:18:03.974 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 9363, 2024-04-25T02:18:03.975 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-04-25T02:18:03.975 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-04-25T02:18:03.975 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-04-25T02:18:03.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.3851674049999998, 2024-04-25T02:18:03.975 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 96, 2024-04-25T02:18:03.975 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 119, 2024-04-25T02:18:03.975 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 119, 2024-04-25T02:18:03.975 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 6.3606331200000001 2024-04-25T02:18:03.975 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:18:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.964+0000 7ff07bfb0640 1 -- 172.21.15.79:0/2176660531 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff06006be30 msgr2=0x7ff06006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.964+0000 7ff07bfb0640 1 --2- 172.21.15.79:0/2176660531 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff06006be30 0x7ff06006e2f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff07415c4d0 tx=0x7ff068009040 comp rx=0 tx=0).stop 2024-04-25T02:18:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.964+0000 7ff07bfb0640 1 -- 172.21.15.79:0/2176660531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0740b3570 msgr2=0x7ff0741600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.964+0000 7ff07bfb0640 1 --2- 172.21.15.79:0/2176660531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0740b3570 0x7ff0741600c0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00cbc0 tx=0x7ff06c00a430 comp rx=0 tx=0).stop 2024-04-25T02:18:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.964+0000 7ff07bfb0640 1 -- 172.21.15.79:0/2176660531 shutdown_connections 2024-04-25T02:18:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.964+0000 7ff07bfb0640 1 --2- 172.21.15.79:0/2176660531 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff06006be30 0x7ff06006e2f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.964+0000 7ff07bfb0640 1 --2- 172.21.15.79:0/2176660531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff07415e4d0 0x7ff0740cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.964+0000 7ff07bfb0640 1 --2- 172.21.15.79:0/2176660531 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0740d2e20 0x7ff07414f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.964+0000 7ff07bfb0640 1 --2- 172.21.15.79:0/2176660531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0740b3570 0x7ff0741600c0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.964+0000 7ff07bfb0640 1 -- 172.21.15.79:0/2176660531 >> 172.21.15.79:0/2176660531 conn(0x7ff07409d460 msgr2=0x7ff0740b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.964+0000 7ff07bfb0640 1 -- 172.21.15.79:0/2176660531 shutdown_connections 2024-04-25T02:18:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:03.964+0000 7ff07bfb0640 1 -- 172.21.15.79:0/2176660531 wait complete. 2024-04-25T02:18:03.979 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:18:04.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.071+0000 7f5412ce7640 1 Processor -- start 2024-04-25T02:18:04.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.071+0000 7f5412ce7640 1 -- start start 2024-04-25T02:18:04.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.072+0000 7f5412ce7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f540c15e4d0 0x7f540c06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:04.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.072+0000 7f5412ce7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f540c0b3570 0x7f540c0d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:04.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.072+0000 7f5412ce7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f540c0d1660 con 0x7f540c0b3020 2024-04-25T02:18:04.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.072+0000 7f5412ce7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f540c0d1380 con 0x7f540c0b3570 2024-04-25T02:18:04.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.072+0000 7f5412ce7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f540c0cede0 con 0x7f540c15e4d0 2024-04-25T02:18:04.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.072+0000 7f540bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f540c0b3570 0x7f540c0d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:04.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.072+0000 7f5411284640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f540c0b3020 0x7f540c0cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36670/0 (socket says 172.21.15.79:36670) 2024-04-25T02:18:04.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.072+0000 7f5411284640 1 -- 172.21.15.79:0/3303982119 learned_addr learned my addr 172.21.15.79:0/3303982119 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:04.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.073+0000 7f5410a83640 1 --2- 172.21.15.79:0/3303982119 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f540c15e4d0 0x7f540c06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:04.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.073+0000 7f540bfff640 1 -- 172.21.15.79:0/3303982119 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f540c15e4d0 msgr2=0x7f540c06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:04.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.073+0000 7f540bfff640 1 --2- 172.21.15.79:0/3303982119 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f540c15e4d0 0x7f540c06bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:04.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.073+0000 7f540bfff640 1 -- 172.21.15.79:0/3303982119 >> v1:172.21.15.79:6789/0 conn(0x7f540c0b3020 legacy=0x7f540c0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:04.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.073+0000 7f540b7fe640 1 -- 172.21.15.79:0/3303982119 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 791373392 0 0) 0x7f540c0d1660 con 0x7f540c0b3020 2024-04-25T02:18:04.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.073+0000 7f540bfff640 1 -- 172.21.15.79:0/3303982119 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540c0cf0c0 con 0x7f540c0b3570 2024-04-25T02:18:04.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.073+0000 7f540bfff640 1 --2- 172.21.15.79:0/3303982119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f540c0b3570 0x7f540c0d2710 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f54000097a0 tx=0x7f540002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970bc9a3b1999be3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:04.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.074+0000 7f540b7fe640 1 -- 172.21.15.79:0/3303982119 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5400037070 con 0x7f540c0b3570 2024-04-25T02:18:04.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.074+0000 7f540b7fe640 1 -- 172.21.15.79:0/3303982119 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5400032440 con 0x7f540c0b3570 2024-04-25T02:18:04.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.074+0000 7f540b7fe640 1 -- 172.21.15.79:0/3303982119 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5400032810 con 0x7f540c0b3570 2024-04-25T02:18:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.074+0000 7f5412ce7640 1 -- 172.21.15.79:0/3303982119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f540c0b3570 msgr2=0x7f540c0d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.074+0000 7f5412ce7640 1 --2- 172.21.15.79:0/3303982119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f540c0b3570 0x7f540c0d2710 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f54000097a0 tx=0x7f540002a180 comp rx=0 tx=0).stop 2024-04-25T02:18:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.074+0000 7f5412ce7640 1 -- 172.21.15.79:0/3303982119 shutdown_connections 2024-04-25T02:18:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.074+0000 7f5412ce7640 1 --2- 172.21.15.79:0/3303982119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f540c0b3570 0x7f540c0d2710 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.074+0000 7f5412ce7640 1 --2- 172.21.15.79:0/3303982119 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f540c15e4d0 0x7f540c06bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.074+0000 7f5412ce7640 1 -- 172.21.15.79:0/3303982119 >> 172.21.15.79:0/3303982119 conn(0x7f540c09d460 msgr2=0x7f540c0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.074+0000 7f5412ce7640 1 -- 172.21.15.79:0/3303982119 shutdown_connections 2024-04-25T02:18:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.074+0000 7f5412ce7640 1 -- 172.21.15.79:0/3303982119 wait complete. 2024-04-25T02:18:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.075+0000 7f5412ce7640 1 Processor -- start 2024-04-25T02:18:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.075+0000 7f5412ce7640 1 -- start start 2024-04-25T02:18:04.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.076+0000 7f5412ce7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f540c0b3020 0x7f540c0b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:04.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.076+0000 7f5412ce7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f540c0b3570 0x7f540c14ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:04.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.076+0000 7f5412ce7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f540c15e4d0 0x7f540c14bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:04.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.076+0000 7f5412ce7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f540c0d2250 con 0x7f540c0b3570 2024-04-25T02:18:04.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.076+0000 7f5412ce7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f540c0d20d0 con 0x7f540c15e4d0 2024-04-25T02:18:04.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.076+0000 7f5412ce7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f540c06c1b0 con 0x7f540c0b3020 2024-04-25T02:18:04.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.076+0000 7f540bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f540c0b3570 0x7f540c14ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:04.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.076+0000 7f540bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f540c0b3570 0x7f540c14ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53116/0 (socket says 172.21.15.79:53116) 2024-04-25T02:18:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.076+0000 7f540bfff640 1 -- 172.21.15.79:0/567765391 learned_addr learned my addr 172.21.15.79:0/567765391 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.077+0000 7f5410a83640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f540c0b3020 0x7f540c0b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.077+0000 7f5411284640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f540c15e4d0 0x7f540c14bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.077+0000 7f540bfff640 1 -- 172.21.15.79:0/567765391 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f540c0b3020 msgr2=0x7f540c0b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.077+0000 7f540bfff640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f540c0b3020 0x7f540c0b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.077+0000 7f540bfff640 1 -- 172.21.15.79:0/567765391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f540c15e4d0 msgr2=0x7f540c14bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.077+0000 7f540bfff640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f540c15e4d0 0x7f540c14bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.077+0000 7f540bfff640 1 -- 172.21.15.79:0/567765391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540c14c1a0 con 0x7f540c0b3570 2024-04-25T02:18:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.077+0000 7f5410a83640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f540c0b3020 0x7f540c0b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.077+0000 7f5411284640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f540c15e4d0 0x7f540c14bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.077+0000 7f540bfff640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f540c0b3570 0x7f540c14ef50 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f5400035040 tx=0x7f54000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.077+0000 7f54097fa640 1 -- 172.21.15.79:0/567765391 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5400037040 con 0x7f540c0b3570 2024-04-25T02:18:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.077+0000 7f54097fa640 1 -- 172.21.15.79:0/567765391 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5400030500 con 0x7f540c0b3570 2024-04-25T02:18:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.077+0000 7f5412ce7640 1 -- 172.21.15.79:0/567765391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f540c0b5bc0 con 0x7f540c0b3570 2024-04-25T02:18:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.077+0000 7f54097fa640 1 -- 172.21.15.79:0/567765391 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5400030910 con 0x7f540c0b3570 2024-04-25T02:18:04.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.077+0000 7f5412ce7640 1 -- 172.21.15.79:0/567765391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f540c0b6180 con 0x7f540c0b3570 2024-04-25T02:18:04.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.078+0000 7f5412ce7640 1 -- 172.21.15.79:0/567765391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f540c0690a0 con 0x7f540c0b3570 2024-04-25T02:18:04.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.078+0000 7f54097fa640 1 -- 172.21.15.79:0/567765391 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5400044020 con 0x7f540c0b3570 2024-04-25T02:18:04.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.079+0000 7f54097fa640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53f806be30 0x7f53f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:04.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.079+0000 7f54097fa640 1 -- 172.21.15.79:0/567765391 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7f54000ab260 con 0x7f540c0b3570 2024-04-25T02:18:04.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.079+0000 7f5410a83640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53f806be30 0x7f53f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:04.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.079+0000 7f5410a83640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53f806be30 0x7f53f806e2f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009ac0 tx=0x7f53fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.083+0000 7f54097fa640 1 -- 172.21.15.79:0/567765391 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5400079b20 con 0x7f540c0b3570 2024-04-25T02:18:04.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.291+0000 7f5412ce7640 1 -- 172.21.15.79:0/567765391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f540c0d0ed0 con 0x7f540c0b3570 2024-04-25T02:18:04.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.292+0000 7f54097fa640 1 -- 172.21.15.79:0/567765391 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v96) ==== 53+0+73 (secure 0 0 0) 0x7f5400079420 con 0x7f540c0b3570 2024-04-25T02:18:04.296 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:18:04.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.294+0000 7f5412ce7640 1 -- 172.21.15.79:0/567765391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53f806be30 msgr2=0x7f53f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:04.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.294+0000 7f5412ce7640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53f806be30 0x7f53f806e2f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009ac0 tx=0x7f53fc008040 comp rx=0 tx=0).stop 2024-04-25T02:18:04.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.294+0000 7f5412ce7640 1 -- 172.21.15.79:0/567765391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f540c0b3570 msgr2=0x7f540c14ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:04.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.294+0000 7f5412ce7640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f540c0b3570 0x7f540c14ef50 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f5400035040 tx=0x7f54000046c0 comp rx=0 tx=0).stop 2024-04-25T02:18:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.294+0000 7f5412ce7640 1 -- 172.21.15.79:0/567765391 shutdown_connections 2024-04-25T02:18:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.294+0000 7f5412ce7640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f53f806be30 0x7f53f806e2f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.294+0000 7f5412ce7640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f540c15e4d0 0x7f540c14bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.294+0000 7f5412ce7640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f540c0b3570 0x7f540c14ef50 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.294+0000 7f5412ce7640 1 --2- 172.21.15.79:0/567765391 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f540c0b3020 0x7f540c0b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.294+0000 7f5412ce7640 1 -- 172.21.15.79:0/567765391 >> 172.21.15.79:0/567765391 conn(0x7f540c09d460 msgr2=0x7f540c06cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.294+0000 7f5412ce7640 1 -- 172.21.15.79:0/567765391 shutdown_connections 2024-04-25T02:18:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04.294+0000 7f5412ce7640 1 -- 172.21.15.79:0/567765391 wait complete. 2024-04-25T02:18:04.310 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:18:04.311 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:18:04.311 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-04-25T02:18:04.311 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:18:04.311 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:18:04.311 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:18:04.311 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:18:04.311 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:18:04.311 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:18:04.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:04.311 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-04-25T02:18:04.326 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:18:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42122sec preferred_lft 42122sec 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1c7f:8374:48e4:fb88/64 scope link noprefixroute 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::48fa:61ff:fec9:f96e/64 scope link 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether f6:e9:a7:84:e4:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f4e9:a7ff:fe84:e475/64 scope link 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 02:4c:ad:56:71:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::4c:adff:fe56:7194/64 scope link 2024-04-25T02:18:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:18:04.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:04.329 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:18:04.389 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:18:04.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:04.390 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-04-25T02:18:04.445 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-04-25T02:18:04.445 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:18:04.445 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:18:04.446 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:18:04.446 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:18:04.446 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:18:04.446 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-04-25T02:18:04.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:18:04.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:18:04.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:18:04.446 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-04-25T02:18:04.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:18:04.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:18:04.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:04.570 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:18:04.584 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:18:04.584 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:18:04.584 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:18:04.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:04.584 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-04-25T02:18:04.647 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:18:04.647 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:18:04.702 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:18:04.703 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:18:04.703 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:18:04.757 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:18:04.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:04.757 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:18:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:18:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:18:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:18:04.847 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:18:04.847 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:18:04.847 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:18:04.847 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:18:04.847 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:18:04.852 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:18:04.852 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:18:04.852 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-04-25T02:18:04.852 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.189:3300,172.21.15.189:3301" 2024-04-25T02:18:04.852 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:18:04.852 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790" 2024-04-25T02:18:04.852 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.189:6789,172.21.15.189:6790:/ 2024-04-25T02:18:04.852 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=696648c4-3e52-400b-a780-2e8863c56c42" will pass to kernel 2024-04-25T02:18:04.853 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:18:04.853 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:18:04.853 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:18:04.853 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:18:04.853 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:18:04.854 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:18:04.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:04.855 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:18:04.922 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:18:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:18:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:18:05.013 INFO:teuthology.orchestra.run.smithi079.stdout:client6716 2024-04-25T02:18:05.013 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:18:05.013 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:18:05.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:05.028 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T02:18:05.086 INFO:teuthology.orchestra.run.smithi079.stdout:./ 2024-04-25T02:18:05.087 INFO:teuthology.orchestra.run.smithi079.stdout:./parent 2024-04-25T02:18:05.087 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed 2024-04-25T02:18:05.087 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/charlie 2024-04-25T02:18:05.087 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/alpha 2024-04-25T02:18:05.087 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/bravo 2024-04-25T02:18:05.087 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/unflushed 2024-04-25T02:18:05.087 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/unflushed/jfile 2024-04-25T02:18:05.087 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:18:05.087 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:18:05.087 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:18:05.087 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:18:05.087 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T02:18:05.088 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:18:05.192 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-04-25T02:18:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:18:05.200 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:18:05.200 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:18:05.200 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:18:05.200 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:18:05.200 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T02:18:05.200 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:18:05.304 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627776 2024-04-25T02:18:05.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:18:05.313 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:18:05.313 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:18:05.313 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:18:05.313 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:18:05.313 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T02:18:05.313 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:18:05.417 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627777 2024-04-25T02:18:05.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:18:05.426 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:18:05.426 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:18:05.427 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:18:05.427 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:18:05.427 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T02:18:05.427 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:18:05.531 INFO:teuthology.orchestra.run.smithi079.stdout:1099511628280 2024-04-25T02:18:05.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:18:05.540 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:18:05.540 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:18:05.540 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:18:05.540 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:18:05.540 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T02:18:05.540 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:18:05.645 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627778 2024-04-25T02:18:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:18:05.655 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:18:05.655 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:18:05.655 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:18:05.655 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:18:05.655 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-25T02:18:05.655 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:18:05.760 INFO:teuthology.orchestra.run.smithi079.stdout:1099511628279 2024-04-25T02:18:05.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:18:05.769 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:18:05.769 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:18:05.770 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:18:05.770 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:18:05.770 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T02:18:05.770 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:18:05.874 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627779 2024-04-25T02:18:05.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:18:05.883 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-04-25T02:18:05.883 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-04-25T02:18:05.883 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-04-25T02:18:05.883 DEBUG:teuthology.orchestra.run.smithi079:> 2024-04-25T02:18:05.883 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T02:18:05.883 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-04-25T02:18:05.987 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627780 2024-04-25T02:18:05.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:18:05.995 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:18:05.995 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:18:06.071 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:18:06.120 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:18:06.121 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:18:06.121 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:18:06.121 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:18:06.135 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:18:06.136 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:18:06.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:18:06.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.324+0000 7f3823b61640 1 Processor -- start 2024-04-25T02:18:06.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.324+0000 7f3823b61640 1 -- start start 2024-04-25T02:18:06.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.325+0000 7f3823b61640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f381c144cb0 0x7f381c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.325+0000 7f3823b61640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f381c0b5580 0x7f381c06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.325+0000 7f3823b61640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f381c070d90 con 0x7f381c06e490 2024-04-25T02:18:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.325+0000 7f3823b61640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f381c06e8c0 con 0x7f381c0b5580 2024-04-25T02:18:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.325+0000 7f3823b61640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f381c0cf130 con 0x7f381c144cb0 2024-04-25T02:18:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.325+0000 7f38210fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f381c0b5580 0x7f381c06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.325+0000 7f38220fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f381c06e490 0x7f381c15fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36672/0 (socket says 172.21.15.79:36672) 2024-04-25T02:18:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.325+0000 7f38220fe640 1 -- 172.21.15.79:0/3637332876 learned_addr learned my addr 172.21.15.79:0/3637332876 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.325+0000 7f38218fd640 1 --2- 172.21.15.79:0/3637332876 >> v2:172.21.15.189:3300/0 conn(0x7f381c144cb0 0x7f381c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.325+0000 7f38210fc640 1 -- 172.21.15.79:0/3637332876 >> v2:172.21.15.189:3300/0 conn(0x7f381c144cb0 msgr2=0x7f381c0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.325+0000 7f38208fb640 1 -- 172.21.15.79:0/3637332876 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 145763876 0 0) 0x7f381c070d90 con 0x7f381c06e490 2024-04-25T02:18:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.325+0000 7f38210fc640 1 --2- 172.21.15.79:0/3637332876 >> v2:172.21.15.189:3300/0 conn(0x7f381c144cb0 0x7f381c0b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.325+0000 7f38210fc640 1 -- 172.21.15.79:0/3637332876 >> v1:172.21.15.79:6789/0 conn(0x7f381c06e490 legacy=0x7f381c15fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.325+0000 7f38210fc640 1 -- 172.21.15.79:0/3637332876 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381c0cf410 con 0x7f381c0b5580 2024-04-25T02:18:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.325+0000 7f38218fd640 1 --2- 172.21.15.79:0/3637332876 >> v2:172.21.15.189:3300/0 conn(0x7f381c144cb0 0x7f381c0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.326+0000 7f38210fc640 1 --2- 172.21.15.79:0/3637332876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c0b5580 0x7f381c06df50 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f380c0097a0 tx=0x7f380c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2541a140da7d47a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.326+0000 7f38208fb640 1 -- 172.21.15.79:0/3637332876 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c037070 con 0x7f381c0b5580 2024-04-25T02:18:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.326+0000 7f38208fb640 1 -- 172.21.15.79:0/3637332876 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f380c02adc0 con 0x7f381c0b5580 2024-04-25T02:18:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.326+0000 7f38208fb640 1 -- 172.21.15.79:0/3637332876 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c032660 con 0x7f381c0b5580 2024-04-25T02:18:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.326+0000 7f3823b61640 1 -- 172.21.15.79:0/3637332876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c0b5580 msgr2=0x7f381c06df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.326+0000 7f3823b61640 1 --2- 172.21.15.79:0/3637332876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c0b5580 0x7f381c06df50 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f380c0097a0 tx=0x7f380c02a0b0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.326+0000 7f3823b61640 1 -- 172.21.15.79:0/3637332876 shutdown_connections 2024-04-25T02:18:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.326+0000 7f3823b61640 1 --2- 172.21.15.79:0/3637332876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c0b5580 0x7f381c06df50 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.326+0000 7f3823b61640 1 --2- 172.21.15.79:0/3637332876 >> v2:172.21.15.189:3300/0 conn(0x7f381c144cb0 0x7f381c0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.326+0000 7f3823b61640 1 -- 172.21.15.79:0/3637332876 >> 172.21.15.79:0/3637332876 conn(0x7f381c0cfc80 msgr2=0x7f381c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.326+0000 7f3823b61640 1 -- 172.21.15.79:0/3637332876 shutdown_connections 2024-04-25T02:18:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.327+0000 7f3823b61640 1 -- 172.21.15.79:0/3637332876 wait complete. 2024-04-25T02:18:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.328+0000 7f3823b61640 1 Processor -- start 2024-04-25T02:18:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.328+0000 7f3823b61640 1 -- start start 2024-04-25T02:18:06.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.328+0000 7f3823b61640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f381c06e490 0x7f381c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.328+0000 7f3823b61640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c0b5580 0x7f381c1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.328+0000 7f3823b61640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f381c144cb0 0x7f381c1432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.328+0000 7f3823b61640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f381c145090 con 0x7f381c0b5580 2024-04-25T02:18:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.328+0000 7f3823b61640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f381c0cf9d0 con 0x7f381c06e490 2024-04-25T02:18:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.328+0000 7f3823b61640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f381c145ab0 con 0x7f381c144cb0 2024-04-25T02:18:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.328+0000 7f38210fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c0b5580 0x7f381c1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.328+0000 7f38210fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c0b5580 0x7f381c1559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53130/0 (socket says 172.21.15.79:53130) 2024-04-25T02:18:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.328+0000 7f38210fc640 1 -- 172.21.15.79:0/931472916 learned_addr learned my addr 172.21.15.79:0/931472916 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.329+0000 7f38210fc640 1 -- 172.21.15.79:0/931472916 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f381c144cb0 msgr2=0x7f381c1432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.329+0000 7f38210fc640 1 --2- 172.21.15.79:0/931472916 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f381c144cb0 0x7f381c1432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.329+0000 7f38210fc640 1 -- 172.21.15.79:0/931472916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f381c06e490 msgr2=0x7f381c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.329+0000 7f38210fc640 1 --2- 172.21.15.79:0/931472916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f381c06e490 0x7f381c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.329+0000 7f38210fc640 1 -- 172.21.15.79:0/931472916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381c15ac60 con 0x7f381c0b5580 2024-04-25T02:18:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.329+0000 7f38210fc640 1 --2- 172.21.15.79:0/931472916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c0b5580 0x7f381c1559a0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f380c0097a0 tx=0x7f380c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.329+0000 7f38127fc640 1 -- 172.21.15.79:0/931472916 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c037050 con 0x7f381c0b5580 2024-04-25T02:18:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.329+0000 7f38127fc640 1 -- 172.21.15.79:0/931472916 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f380c038040 con 0x7f381c0b5580 2024-04-25T02:18:06.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.329+0000 7f38127fc640 1 -- 172.21.15.79:0/931472916 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c004470 con 0x7f381c0b5580 2024-04-25T02:18:06.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.329+0000 7f3823b61640 1 -- 172.21.15.79:0/931472916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f381c15a980 con 0x7f381c0b5580 2024-04-25T02:18:06.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.329+0000 7f3823b61640 1 -- 172.21.15.79:0/931472916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f381c157a60 con 0x7f381c0b5580 2024-04-25T02:18:06.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.330+0000 7f3823b61640 1 -- 172.21.15.79:0/931472916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f381c0690a0 con 0x7f381c0b5580 2024-04-25T02:18:06.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.330+0000 7f38127fc640 1 -- 172.21.15.79:0/931472916 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f380c02ac80 con 0x7f381c0b5580 2024-04-25T02:18:06.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.331+0000 7f38127fc640 1 --2- 172.21.15.79:0/931472916 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f380006be30 0x7f380006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.331+0000 7f38127fc640 1 -- 172.21.15.79:0/931472916 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7f380c0ab840 con 0x7f381c0b5580 2024-04-25T02:18:06.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.331+0000 7f38218fd640 1 --2- 172.21.15.79:0/931472916 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f380006be30 0x7f380006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.331+0000 7f38218fd640 1 --2- 172.21.15.79:0/931472916 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f380006be30 0x7f380006e2f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3818006fd0 tx=0x7f3818008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:06.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.335+0000 7f38127fc640 1 -- 172.21.15.79:0/931472916 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f380c07a070 con 0x7f381c0b5580 2024-04-25T02:18:06.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.508+0000 7f3823b61640 1 -- 172.21.15.79:0/931472916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f381c0725f0 con 0x7f381c0b5580 2024-04-25T02:18:06.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.509+0000 7f38127fc640 1 -- 172.21.15.79:0/931472916 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16991 (secure 0 0 0) 0x7f380c079970 con 0x7f381c0b5580 2024-04-25T02:18:06.514 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:06.514 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":119,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:17:57.569985+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:17:32.207579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T02:17:32.929915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.b","mappings":[{"from":0,"to":2}]},{"pgid":"17.34","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/3097428733":"2024-04-26T02:17:57.569963+0000","172.21.15.79:6836/3097428733":"2024-04-26T02:17:57.569963+0000","172.21.15.79:6837/2134535107":"2024-04-26T02:17:47.006917+0000","172.21.15.79:6836/2134535107":"2024-04-26T02:17:47.006917+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:18:06.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.511+0000 7f3823b61640 1 -- 172.21.15.79:0/931472916 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f380006be30 msgr2=0x7f380006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:06.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.511+0000 7f3823b61640 1 --2- 172.21.15.79:0/931472916 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f380006be30 0x7f380006e2f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3818006fd0 tx=0x7f3818008040 comp rx=0 tx=0).stop 2024-04-25T02:18:06.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.511+0000 7f3823b61640 1 -- 172.21.15.79:0/931472916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c0b5580 msgr2=0x7f381c1559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:06.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.511+0000 7f3823b61640 1 --2- 172.21.15.79:0/931472916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c0b5580 0x7f381c1559a0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f380c0097a0 tx=0x7f380c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.511+0000 7f3823b61640 1 -- 172.21.15.79:0/931472916 shutdown_connections 2024-04-25T02:18:06.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.511+0000 7f3823b61640 1 --2- 172.21.15.79:0/931472916 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f380006be30 0x7f380006e2f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.511+0000 7f3823b61640 1 --2- 172.21.15.79:0/931472916 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f381c144cb0 0x7f381c1432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.511+0000 7f3823b61640 1 --2- 172.21.15.79:0/931472916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f381c0b5580 0x7f381c1559a0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.511+0000 7f3823b61640 1 --2- 172.21.15.79:0/931472916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f381c06e490 0x7f381c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.511+0000 7f3823b61640 1 -- 172.21.15.79:0/931472916 >> 172.21.15.79:0/931472916 conn(0x7f381c0cfc80 msgr2=0x7f381c0af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:06.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.511+0000 7f3823b61640 1 -- 172.21.15.79:0/931472916 shutdown_connections 2024-04-25T02:18:06.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.511+0000 7f3823b61640 1 -- 172.21.15.79:0/931472916 wait complete. 2024-04-25T02:18:06.526 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:17:32.207579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:17:32.929915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:18:06.527 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:18:06.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.623+0000 7f3898121640 1 Processor -- start 2024-04-25T02:18:06.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.623+0000 7f3898121640 1 -- start start 2024-04-25T02:18:06.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.624+0000 7f3898121640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f389015e4f0 0x7f38900d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.624+0000 7f3898121640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38900cf7f0 0x7f38900d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.624+0000 7f3898121640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38900d1ee0 con 0x7f38900cfc50 2024-04-25T02:18:06.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.624+0000 7f3898121640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f38900d21c0 con 0x7f389015e4f0 2024-04-25T02:18:06.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.624+0000 7f3898121640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f38900d24a0 con 0x7f38900cf7f0 2024-04-25T02:18:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.624+0000 7f3895ebd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f389015e4f0 0x7f38900d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.624+0000 7f38966be640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f38900cfc50 0x7f389006bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36678/0 (socket says 172.21.15.79:36678) 2024-04-25T02:18:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.624+0000 7f38966be640 1 -- 172.21.15.79:0/898633814 learned_addr learned my addr 172.21.15.79:0/898633814 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.624+0000 7f38956bc640 1 --2- 172.21.15.79:0/898633814 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38900cf7f0 0x7f38900d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.625+0000 7f3895ebd640 1 -- 172.21.15.79:0/898633814 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38900cf7f0 msgr2=0x7f38900d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.625+0000 7f3895ebd640 1 --2- 172.21.15.79:0/898633814 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38900cf7f0 0x7f38900d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.625+0000 7f3895ebd640 1 -- 172.21.15.79:0/898633814 >> v1:172.21.15.79:6789/0 conn(0x7f38900cfc50 legacy=0x7f389006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.625+0000 7f3894ebb640 1 -- 172.21.15.79:0/898633814 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 914187875 0 0) 0x7f38900d1ee0 con 0x7f38900cfc50 2024-04-25T02:18:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.625+0000 7f3895ebd640 1 -- 172.21.15.79:0/898633814 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38900d2780 con 0x7f389015e4f0 2024-04-25T02:18:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.626+0000 7f3895ebd640 1 --2- 172.21.15.79:0/898633814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f389015e4f0 0x7f38900d2ca0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f388c009dc0 tx=0x7f388c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106c64b036db7d5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.626+0000 7f3894ebb640 1 -- 172.21.15.79:0/898633814 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c02ae60 con 0x7f389015e4f0 2024-04-25T02:18:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.626+0000 7f3894ebb640 1 -- 172.21.15.79:0/898633814 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388c007740 con 0x7f389015e4f0 2024-04-25T02:18:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.626+0000 7f3894ebb640 1 -- 172.21.15.79:0/898633814 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c007b10 con 0x7f389015e4f0 2024-04-25T02:18:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.626+0000 7f3898121640 1 -- 172.21.15.79:0/898633814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f389015e4f0 msgr2=0x7f38900d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.626+0000 7f3898121640 1 --2- 172.21.15.79:0/898633814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f389015e4f0 0x7f38900d2ca0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f388c009dc0 tx=0x7f388c02a680 comp rx=0 tx=0).stop 2024-04-25T02:18:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.626+0000 7f3898121640 1 -- 172.21.15.79:0/898633814 shutdown_connections 2024-04-25T02:18:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.626+0000 7f3898121640 1 --2- 172.21.15.79:0/898633814 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38900cf7f0 0x7f38900d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.626+0000 7f3898121640 1 --2- 172.21.15.79:0/898633814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f389015e4f0 0x7f38900d2ca0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.626+0000 7f3898121640 1 -- 172.21.15.79:0/898633814 >> 172.21.15.79:0/898633814 conn(0x7f389009d4a0 msgr2=0x7f38900d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.626+0000 7f3898121640 1 -- 172.21.15.79:0/898633814 shutdown_connections 2024-04-25T02:18:06.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.626+0000 7f3898121640 1 -- 172.21.15.79:0/898633814 wait complete. 2024-04-25T02:18:06.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.627+0000 7f3898121640 1 Processor -- start 2024-04-25T02:18:06.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.628+0000 7f3898121640 1 -- start start 2024-04-25T02:18:06.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.628+0000 7f3898121640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38900cf7f0 0x7f38900b9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.628+0000 7f3898121640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38900cfc50 0x7f3890151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.628+0000 7f3898121640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389015e4f0 0x7f38900cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.628+0000 7f3898121640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f38900d0ef0 con 0x7f38900cf7f0 2024-04-25T02:18:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.628+0000 7f3898121640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f38900d50f0 con 0x7f389015e4f0 2024-04-25T02:18:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.628+0000 7f3898121640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f38900d1070 con 0x7f38900cfc50 2024-04-25T02:18:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.628+0000 7f3895ebd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38900cf7f0 0x7f38900b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.628+0000 7f3895ebd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38900cf7f0 0x7f38900b9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53142/0 (socket says 172.21.15.79:53142) 2024-04-25T02:18:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.628+0000 7f3895ebd640 1 -- 172.21.15.79:0/587517828 learned_addr learned my addr 172.21.15.79:0/587517828 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.629+0000 7f38956bc640 1 --2- 172.21.15.79:0/587517828 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38900cfc50 0x7f3890151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.629+0000 7f38966be640 1 --2- 172.21.15.79:0/587517828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389015e4f0 0x7f38900cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.629+0000 7f3895ebd640 1 -- 172.21.15.79:0/587517828 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38900cfc50 msgr2=0x7f3890151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.629+0000 7f3895ebd640 1 --2- 172.21.15.79:0/587517828 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38900cfc50 0x7f3890151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.629+0000 7f3895ebd640 1 -- 172.21.15.79:0/587517828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389015e4f0 msgr2=0x7f38900cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.629+0000 7f3895ebd640 1 --2- 172.21.15.79:0/587517828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389015e4f0 0x7f38900cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.629+0000 7f3895ebd640 1 -- 172.21.15.79:0/587517828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38900b9e40 con 0x7f38900cf7f0 2024-04-25T02:18:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.629+0000 7f3895ebd640 1 --2- 172.21.15.79:0/587517828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38900cf7f0 0x7f38900b9900 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f388c009dc0 tx=0x7f388c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.629+0000 7f38867fc640 1 -- 172.21.15.79:0/587517828 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c03f070 con 0x7f38900cf7f0 2024-04-25T02:18:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.629+0000 7f38867fc640 1 -- 172.21.15.79:0/587517828 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388c02ae60 con 0x7f38900cf7f0 2024-04-25T02:18:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.629+0000 7f3898121640 1 -- 172.21.15.79:0/587517828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389015a440 con 0x7f38900cf7f0 2024-04-25T02:18:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.629+0000 7f38867fc640 1 -- 172.21.15.79:0/587517828 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c031c80 con 0x7f38900cf7f0 2024-04-25T02:18:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.629+0000 7f3898121640 1 -- 172.21.15.79:0/587517828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f389015aa00 con 0x7f38900cf7f0 2024-04-25T02:18:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.630+0000 7f3898121640 1 -- 172.21.15.79:0/587517828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38900686c0 con 0x7f38900cf7f0 2024-04-25T02:18:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.630+0000 7f38867fc640 1 -- 172.21.15.79:0/587517828 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f388c043410 con 0x7f38900cf7f0 2024-04-25T02:18:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.631+0000 7f38867fc640 1 --2- 172.21.15.79:0/587517828 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f387406be60 0x7f387406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.631+0000 7f38956bc640 1 --2- 172.21.15.79:0/587517828 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f387406be60 0x7f387406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.631+0000 7f38867fc640 1 -- 172.21.15.79:0/587517828 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7f388c0ac100 con 0x7f38900cf7f0 2024-04-25T02:18:06.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.631+0000 7f38956bc640 1 --2- 172.21.15.79:0/587517828 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f387406be60 0x7f387406e320 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f38900b9130 tx=0x7f3880008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:06.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.635+0000 7f38867fc640 1 -- 172.21.15.79:0/587517828 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f388c031e20 con 0x7f38900cf7f0 2024-04-25T02:18:06.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.809+0000 7f3898121640 1 -- 172.21.15.79:0/587517828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f38900b1cf0 con 0x7f38900cf7f0 2024-04-25T02:18:06.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.810+0000 7f38867fc640 1 -- 172.21.15.79:0/587517828 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) ==== 93+0+10 (secure 0 0 0) 0x7f388c07aa50 con 0x7f38900cf7f0 2024-04-25T02:18:06.814 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:18:06.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.811+0000 7f3898121640 1 -- 172.21.15.79:0/587517828 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f387406be60 msgr2=0x7f387406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:06.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.811+0000 7f3898121640 1 --2- 172.21.15.79:0/587517828 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f387406be60 0x7f387406e320 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f38900b9130 tx=0x7f3880008040 comp rx=0 tx=0).stop 2024-04-25T02:18:06.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.811+0000 7f3898121640 1 -- 172.21.15.79:0/587517828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38900cf7f0 msgr2=0x7f38900b9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:06.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.811+0000 7f3898121640 1 --2- 172.21.15.79:0/587517828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38900cf7f0 0x7f38900b9900 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f388c009dc0 tx=0x7f388c004a40 comp rx=0 tx=0).stop 2024-04-25T02:18:06.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.812+0000 7f3898121640 1 -- 172.21.15.79:0/587517828 shutdown_connections 2024-04-25T02:18:06.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.812+0000 7f3898121640 1 --2- 172.21.15.79:0/587517828 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f387406be60 0x7f387406e320 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.812+0000 7f3898121640 1 --2- 172.21.15.79:0/587517828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389015e4f0 0x7f38900cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.812+0000 7f3898121640 1 --2- 172.21.15.79:0/587517828 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38900cfc50 0x7f3890151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.812+0000 7f3898121640 1 --2- 172.21.15.79:0/587517828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38900cf7f0 0x7f38900b9900 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.812+0000 7f3898121640 1 -- 172.21.15.79:0/587517828 >> 172.21.15.79:0/587517828 conn(0x7f389009d4a0 msgr2=0x7f389015c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:06.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.812+0000 7f3898121640 1 -- 172.21.15.79:0/587517828 shutdown_connections 2024-04-25T02:18:06.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.812+0000 7f3898121640 1 -- 172.21.15.79:0/587517828 wait complete. 2024-04-25T02:18:06.827 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:18:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.922+0000 7fa33a1c8640 1 Processor -- start 2024-04-25T02:18:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.922+0000 7fa33a1c8640 1 -- start start 2024-04-25T02:18:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa33a1c8640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa3340b41b0 0x7fa3341605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa33a1c8640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa33406b2f0 0x7fa33406b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa33a1c8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa334155f00 0x7fa334156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa33a1c8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa334071cd0 con 0x7fa334155f00 2024-04-25T02:18:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa33a1c8640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fa334071fb0 con 0x7fa3340b41b0 2024-04-25T02:18:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa33a1c8640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa334072290 con 0x7fa33406b2f0 2024-04-25T02:18:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa333fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa334155f00 0x7fa334156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa333fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa334155f00 0x7fa334156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53158/0 (socket says 172.21.15.79:53158) 2024-04-25T02:18:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa333fff640 1 -- 172.21.15.79:0/3259640918 learned_addr learned my addr 172.21.15.79:0/3259640918 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa3337fe640 1 --2- 172.21.15.79:0/3259640918 >> v2:172.21.15.189:3300/0 conn(0x7fa3340b41b0 0x7fa3341605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa332ffd640 1 --2- 172.21.15.79:0/3259640918 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa33406b2f0 0x7fa33406b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa333fff640 1 -- 172.21.15.79:0/3259640918 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa33406b2f0 msgr2=0x7fa33406b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa333fff640 1 --2- 172.21.15.79:0/3259640918 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa33406b2f0 0x7fa33406b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa333fff640 1 -- 172.21.15.79:0/3259640918 >> v2:172.21.15.189:3300/0 conn(0x7fa3340b41b0 msgr2=0x7fa3341605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa333fff640 1 --2- 172.21.15.79:0/3259640918 >> v2:172.21.15.189:3300/0 conn(0x7fa3340b41b0 0x7fa3341605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.923+0000 7fa333fff640 1 -- 172.21.15.79:0/3259640918 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa334072570 con 0x7fa334155f00 2024-04-25T02:18:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.924+0000 7fa333fff640 1 --2- 172.21.15.79:0/3259640918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334155f00 0x7fa334156370 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fa3340cdfb0 tx=0x7fa32c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b71496e87547be5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.924+0000 7fa3327fc640 1 -- 172.21.15.79:0/3259640918 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c036070 con 0x7fa334155f00 2024-04-25T02:18:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.924+0000 7fa3327fc640 1 -- 172.21.15.79:0/3259640918 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa32c031600 con 0x7fa334155f00 2024-04-25T02:18:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.924+0000 7fa3327fc640 1 -- 172.21.15.79:0/3259640918 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0319d0 con 0x7fa334155f00 2024-04-25T02:18:06.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.925+0000 7fa33a1c8640 1 -- 172.21.15.79:0/3259640918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334155f00 msgr2=0x7fa334156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:06.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.925+0000 7fa33a1c8640 1 --2- 172.21.15.79:0/3259640918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334155f00 0x7fa334156370 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fa3340cdfb0 tx=0x7fa32c02a6a0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.925+0000 7fa33a1c8640 1 -- 172.21.15.79:0/3259640918 shutdown_connections 2024-04-25T02:18:06.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.925+0000 7fa33a1c8640 1 --2- 172.21.15.79:0/3259640918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334155f00 0x7fa334156370 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.925+0000 7fa33a1c8640 1 --2- 172.21.15.79:0/3259640918 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa33406b2f0 0x7fa33406b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.925+0000 7fa33a1c8640 1 --2- 172.21.15.79:0/3259640918 >> v2:172.21.15.189:3300/0 conn(0x7fa3340b41b0 0x7fa3341605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.925+0000 7fa33a1c8640 1 -- 172.21.15.79:0/3259640918 >> 172.21.15.79:0/3259640918 conn(0x7fa3340b1cd0 msgr2=0x7fa3340b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:06.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.925+0000 7fa33a1c8640 1 -- 172.21.15.79:0/3259640918 shutdown_connections 2024-04-25T02:18:06.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.925+0000 7fa33a1c8640 1 -- 172.21.15.79:0/3259640918 wait complete. 2024-04-25T02:18:06.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.926+0000 7fa33a1c8640 1 Processor -- start 2024-04-25T02:18:06.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.926+0000 7fa33a1c8640 1 -- start start 2024-04-25T02:18:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa33a1c8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa33406b2f0 0x7fa33415f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa33a1c8640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3340b41b0 0x7fa33415fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa33a1c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334155f00 0x7fa33415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa33a1c8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa33415c870 con 0x7fa334155f00 2024-04-25T02:18:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa33a1c8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa334072d70 con 0x7fa33406b2f0 2024-04-25T02:18:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa33a1c8640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa3340b4590 con 0x7fa3340b41b0 2024-04-25T02:18:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa333fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334155f00 0x7fa33415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa333fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334155f00 0x7fa33415dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53170/0 (socket says 172.21.15.79:53170) 2024-04-25T02:18:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa333fff640 1 -- 172.21.15.79:0/3761154524 learned_addr learned my addr 172.21.15.79:0/3761154524 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa3337fe640 1 --2- 172.21.15.79:0/3761154524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa33406b2f0 0x7fa33415f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa332ffd640 1 --2- 172.21.15.79:0/3761154524 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3340b41b0 0x7fa33415fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa333fff640 1 -- 172.21.15.79:0/3761154524 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3340b41b0 msgr2=0x7fa33415fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa333fff640 1 --2- 172.21.15.79:0/3761154524 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3340b41b0 0x7fa33415fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa333fff640 1 -- 172.21.15.79:0/3761154524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa33406b2f0 msgr2=0x7fa33415f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa333fff640 1 --2- 172.21.15.79:0/3761154524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa33406b2f0 0x7fa33415f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa333fff640 1 -- 172.21.15.79:0/3761154524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3341e6ef0 con 0x7fa334155f00 2024-04-25T02:18:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa3337fe640 1 --2- 172.21.15.79:0/3761154524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa33406b2f0 0x7fa33415f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa333fff640 1 --2- 172.21.15.79:0/3761154524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334155f00 0x7fa33415dc90 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009f40 tx=0x7fa32c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa31bfff640 1 -- 172.21.15.79:0/3761154524 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c036050 con 0x7fa334155f00 2024-04-25T02:18:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa31bfff640 1 -- 172.21.15.79:0/3761154524 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa32c042070 con 0x7fa334155f00 2024-04-25T02:18:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa33a1c8640 1 -- 172.21.15.79:0/3761154524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3341e71d0 con 0x7fa334155f00 2024-04-25T02:18:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa31bfff640 1 -- 172.21.15.79:0/3761154524 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c009510 con 0x7fa334155f00 2024-04-25T02:18:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.927+0000 7fa33a1c8640 1 -- 172.21.15.79:0/3761154524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa334157ac0 con 0x7fa334155f00 2024-04-25T02:18:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.928+0000 7fa33a1c8640 1 -- 172.21.15.79:0/3761154524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3340690a0 con 0x7fa334155f00 2024-04-25T02:18:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.929+0000 7fa31bfff640 1 -- 172.21.15.79:0/3761154524 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa32c007bd0 con 0x7fa334155f00 2024-04-25T02:18:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.929+0000 7fa31bfff640 1 --2- 172.21.15.79:0/3761154524 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa32006be60 0x7fa32006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.929+0000 7fa31bfff640 1 -- 172.21.15.79:0/3761154524 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7fa32c0abdb0 con 0x7fa334155f00 2024-04-25T02:18:06.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.929+0000 7fa3337fe640 1 --2- 172.21.15.79:0/3761154524 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa32006be60 0x7fa32006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:06.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.930+0000 7fa3337fe640 1 --2- 172.21.15.79:0/3761154524 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa32006be60 0x7fa32006e320 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa324006fd0 tx=0x7fa324008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:06.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:06.933+0000 7fa31bfff640 1 -- 172.21.15.79:0/3761154524 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa32c045360 con 0x7fa334155f00 2024-04-25T02:18:07.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.106+0000 7fa33a1c8640 1 -- 172.21.15.79:0/3761154524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa33415da70 con 0x7fa334155f00 2024-04-25T02:18:07.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.107+0000 7fa31bfff640 1 -- 172.21.15.79:0/3761154524 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v119) ==== 104+0+11 (secure 0 0 0) 0x7fa32c07a700 con 0x7fa334155f00 2024-04-25T02:18:07.111 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:18:07.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.109+0000 7fa33a1c8640 1 -- 172.21.15.79:0/3761154524 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa32006be60 msgr2=0x7fa32006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:07.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.109+0000 7fa33a1c8640 1 --2- 172.21.15.79:0/3761154524 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa32006be60 0x7fa32006e320 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa324006fd0 tx=0x7fa324008040 comp rx=0 tx=0).stop 2024-04-25T02:18:07.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.109+0000 7fa33a1c8640 1 -- 172.21.15.79:0/3761154524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334155f00 msgr2=0x7fa33415dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:07.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.109+0000 7fa33a1c8640 1 --2- 172.21.15.79:0/3761154524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334155f00 0x7fa33415dc90 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009f40 tx=0x7fa32c004a40 comp rx=0 tx=0).stop 2024-04-25T02:18:07.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.109+0000 7fa33a1c8640 1 -- 172.21.15.79:0/3761154524 shutdown_connections 2024-04-25T02:18:07.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.109+0000 7fa33a1c8640 1 --2- 172.21.15.79:0/3761154524 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa32006be60 0x7fa32006e320 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.109+0000 7fa33a1c8640 1 --2- 172.21.15.79:0/3761154524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334155f00 0x7fa33415dc90 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.109+0000 7fa33a1c8640 1 --2- 172.21.15.79:0/3761154524 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3340b41b0 0x7fa33415fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.109+0000 7fa33a1c8640 1 --2- 172.21.15.79:0/3761154524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa33406b2f0 0x7fa33415f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.109+0000 7fa33a1c8640 1 -- 172.21.15.79:0/3761154524 >> 172.21.15.79:0/3761154524 conn(0x7fa3340b1cd0 msgr2=0x7fa3340b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:07.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.109+0000 7fa33a1c8640 1 -- 172.21.15.79:0/3761154524 shutdown_connections 2024-04-25T02:18:07.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.109+0000 7fa33a1c8640 1 -- 172.21.15.79:0/3761154524 wait complete. 2024-04-25T02:18:07.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:18:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.220+0000 7f2393ad4640 1 Processor -- start 2024-04-25T02:18:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.220+0000 7f2393ad4640 1 -- start start 2024-04-25T02:18:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.221+0000 7f2393ad4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f238c06b2f0 0x7f238c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.221+0000 7f2393ad4640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f238c0cf7a0 0x7f238c06b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.221+0000 7f2393ad4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238c06bc10 con 0x7f238c06e6b0 2024-04-25T02:18:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.221+0000 7f2393ad4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f238c15f830 con 0x7f238c06b2f0 2024-04-25T02:18:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.221+0000 7f2393ad4640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f238c15ec20 con 0x7f238c0cf7a0 2024-04-25T02:18:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.221+0000 7f2391870640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f238c06b2f0 0x7f238c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.221+0000 7f2392071640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f238c06e6b0 0x7f238c0cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36694/0 (socket says 172.21.15.79:36694) 2024-04-25T02:18:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.221+0000 7f2392071640 1 -- 172.21.15.79:0/1307332508 learned_addr learned my addr 172.21.15.79:0/1307332508 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.221+0000 7f2391870640 1 -- 172.21.15.79:0/1307332508 >> v2:172.21.15.189:3300/0 conn(0x7f238c0cf7a0 msgr2=0x7f238c06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.221+0000 7f239106f640 1 --2- 172.21.15.79:0/1307332508 >> v2:172.21.15.189:3300/0 conn(0x7f238c0cf7a0 0x7f238c06b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.221+0000 7f2391870640 1 --2- 172.21.15.79:0/1307332508 >> v2:172.21.15.189:3300/0 conn(0x7f238c0cf7a0 0x7f238c06b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.221+0000 7f2391870640 1 -- 172.21.15.79:0/1307332508 >> v1:172.21.15.79:6789/0 conn(0x7f238c06e6b0 legacy=0x7f238c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.221+0000 7f239086e640 1 -- 172.21.15.79:0/1307332508 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1490733679 0 0) 0x7f238c06bc10 con 0x7f238c06e6b0 2024-04-25T02:18:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.221+0000 7f2391870640 1 -- 172.21.15.79:0/1307332508 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c15ef00 con 0x7f238c06b2f0 2024-04-25T02:18:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.222+0000 7f2391870640 1 --2- 172.21.15.79:0/1307332508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f238c06b2f0 0x7f238c0b4b50 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f238c0af800 tx=0x7f238802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc29651a32f3f1c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.222+0000 7f239086e640 1 -- 172.21.15.79:0/1307332508 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388037070 con 0x7f238c06b2f0 2024-04-25T02:18:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.222+0000 7f239086e640 1 -- 172.21.15.79:0/1307332508 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2388032440 con 0x7f238c06b2f0 2024-04-25T02:18:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.222+0000 7f239086e640 1 -- 172.21.15.79:0/1307332508 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238802ae60 con 0x7f238c06b2f0 2024-04-25T02:18:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.222+0000 7f2393ad4640 1 -- 172.21.15.79:0/1307332508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f238c06b2f0 msgr2=0x7f238c0b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.222+0000 7f2393ad4640 1 --2- 172.21.15.79:0/1307332508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f238c06b2f0 0x7f238c0b4b50 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f238c0af800 tx=0x7f238802a110 comp rx=0 tx=0).stop 2024-04-25T02:18:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.222+0000 7f2393ad4640 1 -- 172.21.15.79:0/1307332508 shutdown_connections 2024-04-25T02:18:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.222+0000 7f2393ad4640 1 --2- 172.21.15.79:0/1307332508 >> v2:172.21.15.189:3300/0 conn(0x7f238c0cf7a0 0x7f238c06b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.222+0000 7f2393ad4640 1 --2- 172.21.15.79:0/1307332508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f238c06b2f0 0x7f238c0b4b50 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.222+0000 7f2393ad4640 1 -- 172.21.15.79:0/1307332508 >> 172.21.15.79:0/1307332508 conn(0x7f238c0b1cd0 msgr2=0x7f238c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.223+0000 7f2393ad4640 1 -- 172.21.15.79:0/1307332508 shutdown_connections 2024-04-25T02:18:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.223+0000 7f2393ad4640 1 -- 172.21.15.79:0/1307332508 wait complete. 2024-04-25T02:18:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.224+0000 7f2393ad4640 1 Processor -- start 2024-04-25T02:18:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.224+0000 7f2393ad4640 1 -- start start 2024-04-25T02:18:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.224+0000 7f2393ad4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f238c06b2f0 0x7f238c072c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.224+0000 7f2393ad4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f238c06e6b0 0x7f238c0c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.224+0000 7f2393ad4640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f238c0cf7a0 0x7f238c0ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.224+0000 7f2393ad4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f238c06cfe0 con 0x7f238c06b2f0 2024-04-25T02:18:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.224+0000 7f2393ad4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f238c15f4c0 con 0x7f238c06e6b0 2024-04-25T02:18:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.224+0000 7f2393ad4640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f238c06d160 con 0x7f238c0cf7a0 2024-04-25T02:18:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.224+0000 7f2391870640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f238c06b2f0 0x7f238c072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.224+0000 7f2391870640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f238c06b2f0 0x7f238c072c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53198/0 (socket says 172.21.15.79:53198) 2024-04-25T02:18:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.224+0000 7f2391870640 1 -- 172.21.15.79:0/885128791 learned_addr learned my addr 172.21.15.79:0/885128791 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.225+0000 7f2391870640 1 -- 172.21.15.79:0/885128791 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f238c0cf7a0 msgr2=0x7f238c0ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.225+0000 7f2391870640 1 --2- 172.21.15.79:0/885128791 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f238c0cf7a0 0x7f238c0ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.225+0000 7f2391870640 1 -- 172.21.15.79:0/885128791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f238c06e6b0 msgr2=0x7f238c0c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.225+0000 7f2391870640 1 --2- 172.21.15.79:0/885128791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f238c06e6b0 0x7f238c0c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.225+0000 7f2391870640 1 -- 172.21.15.79:0/885128791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c0720a0 con 0x7f238c06b2f0 2024-04-25T02:18:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.225+0000 7f2391870640 1 --2- 172.21.15.79:0/885128791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f238c06b2f0 0x7f238c072c30 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f2388000c00 tx=0x7f23880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.225+0000 7f23827fc640 1 -- 172.21.15.79:0/885128791 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388037040 con 0x7f238c06b2f0 2024-04-25T02:18:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.225+0000 7f23827fc640 1 -- 172.21.15.79:0/885128791 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2388042070 con 0x7f238c06b2f0 2024-04-25T02:18:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.225+0000 7f23827fc640 1 -- 172.21.15.79:0/885128791 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388030a50 con 0x7f238c06b2f0 2024-04-25T02:18:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.225+0000 7f2393ad4640 1 -- 172.21.15.79:0/885128791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238c0c94a0 con 0x7f238c06b2f0 2024-04-25T02:18:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.225+0000 7f2393ad4640 1 -- 172.21.15.79:0/885128791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f238c072620 con 0x7f238c06b2f0 2024-04-25T02:18:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.226+0000 7f2393ad4640 1 -- 172.21.15.79:0/885128791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238c0690a0 con 0x7f238c06b2f0 2024-04-25T02:18:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.226+0000 7f23827fc640 1 -- 172.21.15.79:0/885128791 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2388030bf0 con 0x7f238c06b2f0 2024-04-25T02:18:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.227+0000 7f23827fc640 1 --2- 172.21.15.79:0/885128791 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f237006be30 0x7f237006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.227+0000 7f23827fc640 1 -- 172.21.15.79:0/885128791 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7f23880aba00 con 0x7f238c06b2f0 2024-04-25T02:18:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.227+0000 7f239106f640 1 --2- 172.21.15.79:0/885128791 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f237006be30 0x7f237006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.227+0000 7f239106f640 1 --2- 172.21.15.79:0/885128791 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f237006be30 0x7f237006e2f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f238c14d200 tx=0x7f237c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.231+0000 7f23827fc640 1 -- 172.21.15.79:0/885128791 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f238807a2c0 con 0x7f238c06b2f0 2024-04-25T02:18:07.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.403+0000 7f2393ad4640 1 -- 172.21.15.79:0/885128791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f238c0cf4f0 con 0x7f238c06b2f0 2024-04-25T02:18:07.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.403+0000 7f23827fc640 1 -- 172.21.15.79:0/885128791 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v119) ==== 100+0+11 (secure 0 0 0) 0x7f2388079bc0 con 0x7f238c06b2f0 2024-04-25T02:18:07.407 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:18:07.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.405+0000 7f2393ad4640 1 -- 172.21.15.79:0/885128791 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f237006be30 msgr2=0x7f237006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:07.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.405+0000 7f2393ad4640 1 --2- 172.21.15.79:0/885128791 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f237006be30 0x7f237006e2f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f238c14d200 tx=0x7f237c008040 comp rx=0 tx=0).stop 2024-04-25T02:18:07.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.405+0000 7f2393ad4640 1 -- 172.21.15.79:0/885128791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f238c06b2f0 msgr2=0x7f238c072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:07.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.405+0000 7f2393ad4640 1 --2- 172.21.15.79:0/885128791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f238c06b2f0 0x7f238c072c30 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f2388000c00 tx=0x7f23880046c0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.405+0000 7f2393ad4640 1 -- 172.21.15.79:0/885128791 shutdown_connections 2024-04-25T02:18:07.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.405+0000 7f2393ad4640 1 --2- 172.21.15.79:0/885128791 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f237006be30 0x7f237006e2f0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.405+0000 7f2393ad4640 1 --2- 172.21.15.79:0/885128791 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f238c0cf7a0 0x7f238c0ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.405+0000 7f2393ad4640 1 --2- 172.21.15.79:0/885128791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f238c06e6b0 0x7f238c0c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.405+0000 7f2393ad4640 1 --2- 172.21.15.79:0/885128791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f238c06b2f0 0x7f238c072c30 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.405+0000 7f2393ad4640 1 -- 172.21.15.79:0/885128791 >> 172.21.15.79:0/885128791 conn(0x7f238c0b1cd0 msgr2=0x7f238c0b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:07.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.405+0000 7f2393ad4640 1 -- 172.21.15.79:0/885128791 shutdown_connections 2024-04-25T02:18:07.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.405+0000 7f2393ad4640 1 -- 172.21.15.79:0/885128791 wait complete. 2024-04-25T02:18:07.420 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:18:07.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.513+0000 7f9c6eb14640 1 Processor -- start 2024-04-25T02:18:07.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.513+0000 7f9c6eb14640 1 -- start start 2024-04-25T02:18:07.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.514+0000 7f9c6eb14640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c68144cb0 0x7f9c680b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:07.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.514+0000 7f9c6eb14640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9c680b5580 0x7f9c6806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:07.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.514+0000 7f9c6eb14640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c68070d90 con 0x7f9c6806e490 2024-04-25T02:18:07.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.514+0000 7f9c6eb14640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9c6806e900 con 0x7f9c680b5580 2024-04-25T02:18:07.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.514+0000 7f9c6eb14640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9c680cf130 con 0x7f9c68144cb0 2024-04-25T02:18:07.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.514+0000 7f9c67fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9c680b5580 0x7f9c6806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:07.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.514+0000 7f9c6d0b1640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9c6806e490 0x7f9c6815fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36706/0 (socket says 172.21.15.79:36706) 2024-04-25T02:18:07.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.514+0000 7f9c6d0b1640 1 -- 172.21.15.79:0/486177845 learned_addr learned my addr 172.21.15.79:0/486177845 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:07.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.514+0000 7f9c6c8b0640 1 --2- 172.21.15.79:0/486177845 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c68144cb0 0x7f9c680b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:07.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.514+0000 7f9c67fff640 1 -- 172.21.15.79:0/486177845 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c68144cb0 msgr2=0x7f9c680b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:07.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.514+0000 7f9c67fff640 1 --2- 172.21.15.79:0/486177845 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c68144cb0 0x7f9c680b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.514+0000 7f9c67fff640 1 -- 172.21.15.79:0/486177845 >> v1:172.21.15.79:6789/0 conn(0x7f9c6806e490 legacy=0x7f9c6815fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:07.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.514+0000 7f9c677fe640 1 -- 172.21.15.79:0/486177845 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2140577261 0 0) 0x7f9c68070d90 con 0x7f9c6806e490 2024-04-25T02:18:07.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.514+0000 7f9c67fff640 1 -- 172.21.15.79:0/486177845 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c680cf410 con 0x7f9c680b5580 2024-04-25T02:18:07.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.515+0000 7f9c67fff640 1 --2- 172.21.15.79:0/486177845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c680b5580 0x7f9c6806df50 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f9c540097a0 tx=0x7f9c5402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4981999493b166 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:07.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.515+0000 7f9c677fe640 1 -- 172.21.15.79:0/486177845 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54037070 con 0x7f9c680b5580 2024-04-25T02:18:07.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.515+0000 7f9c677fe640 1 -- 172.21.15.79:0/486177845 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5402adb0 con 0x7f9c680b5580 2024-04-25T02:18:07.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.515+0000 7f9c677fe640 1 -- 172.21.15.79:0/486177845 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54032660 con 0x7f9c680b5580 2024-04-25T02:18:07.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.515+0000 7f9c6eb14640 1 -- 172.21.15.79:0/486177845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c680b5580 msgr2=0x7f9c6806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:07.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.515+0000 7f9c6eb14640 1 --2- 172.21.15.79:0/486177845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c680b5580 0x7f9c6806df50 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f9c540097a0 tx=0x7f9c5402a060 comp rx=0 tx=0).stop 2024-04-25T02:18:07.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.515+0000 7f9c6eb14640 1 -- 172.21.15.79:0/486177845 shutdown_connections 2024-04-25T02:18:07.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.515+0000 7f9c6eb14640 1 --2- 172.21.15.79:0/486177845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c680b5580 0x7f9c6806df50 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.515+0000 7f9c6eb14640 1 --2- 172.21.15.79:0/486177845 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c68144cb0 0x7f9c680b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.515+0000 7f9c6eb14640 1 -- 172.21.15.79:0/486177845 >> 172.21.15.79:0/486177845 conn(0x7f9c680cfc80 msgr2=0x7f9c680d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:07.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.516+0000 7f9c6eb14640 1 -- 172.21.15.79:0/486177845 shutdown_connections 2024-04-25T02:18:07.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.516+0000 7f9c6eb14640 1 -- 172.21.15.79:0/486177845 wait complete. 2024-04-25T02:18:07.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.517+0000 7f9c6eb14640 1 Processor -- start 2024-04-25T02:18:07.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.517+0000 7f9c6eb14640 1 -- start start 2024-04-25T02:18:07.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.517+0000 7f9c6eb14640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c6806e490 0x7f9c6813bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:07.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.517+0000 7f9c6eb14640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c680b5580 0x7f9c6813a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:07.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.517+0000 7f9c6eb14640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c68144cb0 0x7f9c680a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:07.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.517+0000 7f9c6eb14640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9c68145090 con 0x7f9c680b5580 2024-04-25T02:18:07.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.517+0000 7f9c6eb14640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c680cf9d0 con 0x7f9c6806e490 2024-04-25T02:18:07.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.517+0000 7f9c6eb14640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9c68145ab0 con 0x7f9c68144cb0 2024-04-25T02:18:07.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c67fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c680b5580 0x7f9c6813a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:07.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c67fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c680b5580 0x7f9c6813a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53202/0 (socket says 172.21.15.79:53202) 2024-04-25T02:18:07.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c67fff640 1 -- 172.21.15.79:0/1415747288 learned_addr learned my addr 172.21.15.79:0/1415747288 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:07.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c6c8b0640 1 --2- 172.21.15.79:0/1415747288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c6806e490 0x7f9c6813bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:07.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c6d0b1640 1 --2- 172.21.15.79:0/1415747288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c68144cb0 0x7f9c680a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:07.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c67fff640 1 -- 172.21.15.79:0/1415747288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c68144cb0 msgr2=0x7f9c680a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:07.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c67fff640 1 --2- 172.21.15.79:0/1415747288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c68144cb0 0x7f9c680a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c67fff640 1 -- 172.21.15.79:0/1415747288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c6806e490 msgr2=0x7f9c6813bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:07.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c67fff640 1 --2- 172.21.15.79:0/1415747288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c6806e490 0x7f9c6813bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c67fff640 1 -- 172.21.15.79:0/1415747288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6814d440 con 0x7f9c680b5580 2024-04-25T02:18:07.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c67fff640 1 --2- 172.21.15.79:0/1415747288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c680b5580 0x7f9c6813a6e0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f9c54035040 tx=0x7f9c540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:07.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c657fa640 1 -- 172.21.15.79:0/1415747288 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54041070 con 0x7f9c680b5580 2024-04-25T02:18:07.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c657fa640 1 -- 172.21.15.79:0/1415747288 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5403c670 con 0x7f9c680b5580 2024-04-25T02:18:07.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c6eb14640 1 -- 172.21.15.79:0/1415747288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c6814d720 con 0x7f9c680b5580 2024-04-25T02:18:07.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c657fa640 1 -- 172.21.15.79:0/1415747288 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54037040 con 0x7f9c680b5580 2024-04-25T02:18:07.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.518+0000 7f9c6eb14640 1 -- 172.21.15.79:0/1415747288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c6814dce0 con 0x7f9c680b5580 2024-04-25T02:18:07.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.519+0000 7f9c6eb14640 1 -- 172.21.15.79:0/1415747288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c680690a0 con 0x7f9c680b5580 2024-04-25T02:18:07.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.520+0000 7f9c657fa640 1 -- 172.21.15.79:0/1415747288 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c5403a070 con 0x7f9c680b5580 2024-04-25T02:18:07.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.520+0000 7f9c657fa640 1 --2- 172.21.15.79:0/1415747288 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9c4c06be60 0x7f9c4c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:07.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.520+0000 7f9c657fa640 1 -- 172.21.15.79:0/1415747288 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7f9c540ab280 con 0x7f9c680b5580 2024-04-25T02:18:07.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.520+0000 7f9c6c8b0640 1 --2- 172.21.15.79:0/1415747288 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9c4c06be60 0x7f9c4c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:07.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.520+0000 7f9c6c8b0640 1 --2- 172.21.15.79:0/1415747288 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9c4c06be60 0x7f9c4c06e320 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c006fd0 tx=0x7f9c5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:07.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.524+0000 7f9c657fa640 1 -- 172.21.15.79:0/1415747288 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9c54079b50 con 0x7f9c680b5580 2024-04-25T02:18:07.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.713+0000 7f9c6eb14640 1 -- 172.21.15.79:0/1415747288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9c680d0b90 con 0x7f9c680b5580 2024-04-25T02:18:07.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.714+0000 7f9c657fa640 1 -- 172.21.15.79:0/1415747288 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v119) ==== 80+0+244 (secure 0 0 0) 0x7f9c54079450 con 0x7f9c680b5580 2024-04-25T02:18:07.718 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6837/3097428733 2024-04-26T02:17:57.569963+0000 2024-04-25T02:18:07.718 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6836/3097428733 2024-04-26T02:17:57.569963+0000 2024-04-25T02:18:07.719 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6837/2134535107 2024-04-26T02:17:47.006917+0000 2024-04-25T02:18:07.719 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6836/2134535107 2024-04-26T02:17:47.006917+0000 2024-04-25T02:18:07.719 INFO:teuthology.orchestra.run.smithi079.stderr:listed 4 entries 2024-04-25T02:18:07.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.716+0000 7f9c6eb14640 1 -- 172.21.15.79:0/1415747288 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9c4c06be60 msgr2=0x7f9c4c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:07.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.716+0000 7f9c6eb14640 1 --2- 172.21.15.79:0/1415747288 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9c4c06be60 0x7f9c4c06e320 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c006fd0 tx=0x7f9c5c008040 comp rx=0 tx=0).stop 2024-04-25T02:18:07.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.716+0000 7f9c6eb14640 1 -- 172.21.15.79:0/1415747288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c680b5580 msgr2=0x7f9c6813a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:07.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.716+0000 7f9c6eb14640 1 --2- 172.21.15.79:0/1415747288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c680b5580 0x7f9c6813a6e0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f9c54035040 tx=0x7f9c540046c0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.716+0000 7f9c6eb14640 1 -- 172.21.15.79:0/1415747288 shutdown_connections 2024-04-25T02:18:07.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.716+0000 7f9c6eb14640 1 --2- 172.21.15.79:0/1415747288 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9c4c06be60 0x7f9c4c06e320 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.716+0000 7f9c6eb14640 1 --2- 172.21.15.79:0/1415747288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c68144cb0 0x7f9c680a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.716+0000 7f9c6eb14640 1 --2- 172.21.15.79:0/1415747288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c680b5580 0x7f9c6813a6e0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.716+0000 7f9c6eb14640 1 --2- 172.21.15.79:0/1415747288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c6806e490 0x7f9c6813bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:07.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.716+0000 7f9c6eb14640 1 -- 172.21.15.79:0/1415747288 >> 172.21.15.79:0/1415747288 conn(0x7f9c680cfc80 msgr2=0x7f9c68072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:07.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.716+0000 7f9c6eb14640 1 -- 172.21.15.79:0/1415747288 shutdown_connections 2024-04-25T02:18:07.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:07.716+0000 7f9c6eb14640 1 -- 172.21.15.79:0/1415747288 wait complete. 2024-04-25T02:18:07.731 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:18:07.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:07.731 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:18:07.757 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:18:07.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:07.757 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:18:07.812 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:18:07.812 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:18:07.812 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:18:07.831 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:18:07.831 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:18:07.831 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:18:07.831 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:18:07.866 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:18:07.867 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:18:07.867 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:18:07.867 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:18:07.888 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:18:07.889 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:18:08.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.000+0000 7f156d19e640 1 Processor -- start 2024-04-25T02:18:08.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.000+0000 7f156d19e640 1 -- start start 2024-04-25T02:18:08.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156d19e640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f15680d07a0 0x7f15680b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156d19e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f156815bb10 con 0x7f156815a720 2024-04-25T02:18:08.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156d19e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15680b2e60 con 0x7f15680b47e0 2024-04-25T02:18:08.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156d19e640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f15680b4c30 con 0x7f15680d07a0 2024-04-25T02:18:08.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f1566d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f156815a720 0x7f156815ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36708/0 (socket says 172.21.15.79:36708) 2024-04-25T02:18:08.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f1566d9d640 1 -- 172.21.15.79:0/2146123371 learned_addr learned my addr 172.21.15.79:0/2146123371 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:08.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156659c640 1 -- 172.21.15.79:0/2146123371 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1450587453 0 0) 0x7f156815bb10 con 0x7f156815a720 2024-04-25T02:18:08.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f155ffff640 1 --2- 172.21.15.79:0/2146123371 >> v2:172.21.15.189:3300/0 conn(0x7f15680d07a0 0x7f15680b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156659c640 1 -- 172.21.15.79:0/2146123371 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1554005730 con 0x7f156815a720 2024-04-25T02:18:08.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156659c640 1 -- 172.21.15.79:0/2146123371 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2275231964 0 0) 0x7f1554005730 con 0x7f156815a720 2024-04-25T02:18:08.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156659c640 1 -- 172.21.15.79:0/2146123371 >> v2:172.21.15.189:3300/0 conn(0x7f15680d07a0 msgr2=0x7f15680b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:08.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156659c640 1 --2- 172.21.15.79:0/2146123371 >> v2:172.21.15.189:3300/0 conn(0x7f15680d07a0 0x7f15680b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156659c640 1 -- 172.21.15.79:0/2146123371 >> v1:172.21.15.189:6789/0 conn(0x7f15680b47e0 legacy=0x7f1568070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156659c640 1 -- 172.21.15.79:0/2146123371 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15680b3140 con 0x7f156815a720 2024-04-25T02:18:08.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156659c640 1 -- 172.21.15.79:0/2146123371 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f1558001670 con 0x7f156815a720 2024-04-25T02:18:08.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156659c640 1 -- 172.21.15.79:0/2146123371 >> v1:172.21.15.79:6789/0 conn(0x7f156815a720 legacy=0x7f156815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156659c640 1 --2- 172.21.15.79:0/2146123371 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1554005bc0 0x7f1554005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156659c640 1 --2- 172.21.15.79:0/2146123371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1554006a10 0x7f1554006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156659c640 1 --2- 172.21.15.79:0/2146123371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15540073d0 0x7f155400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156659c640 1 -- 172.21.15.79:0/2146123371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15680b4c30 con 0x7f15540073d0 2024-04-25T02:18:08.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156659c640 1 -- 172.21.15.79:0/2146123371 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f155400e370 con 0x7f1554006a10 2024-04-25T02:18:08.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.001+0000 7f156659c640 1 -- 172.21.15.79:0/2146123371 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f155400e570 con 0x7f1554005bc0 2024-04-25T02:18:08.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.002+0000 7f156759e640 1 --2- 172.21.15.79:0/2146123371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15540073d0 0x7f155400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.002+0000 7f155ffff640 1 --2- 172.21.15.79:0/2146123371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1554006a10 0x7f1554006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.002+0000 7f1566d9d640 1 --2- 172.21.15.79:0/2146123371 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1554005bc0 0x7f1554005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.002+0000 7f156759e640 1 -- 172.21.15.79:0/2146123371 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1554005bc0 msgr2=0x7f1554005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:08.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.002+0000 7f156759e640 1 --2- 172.21.15.79:0/2146123371 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1554005bc0 0x7f1554005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.002+0000 7f156759e640 1 -- 172.21.15.79:0/2146123371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1554006a10 msgr2=0x7f1554006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:08.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.002+0000 7f156759e640 1 --2- 172.21.15.79:0/2146123371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1554006a10 0x7f1554006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.002+0000 7f156759e640 1 -- 172.21.15.79:0/2146123371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1554005730 con 0x7f15540073d0 2024-04-25T02:18:08.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.002+0000 7f155ffff640 1 --2- 172.21.15.79:0/2146123371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1554006a10 0x7f1554006e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:08.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.002+0000 7f1566d9d640 1 --2- 172.21.15.79:0/2146123371 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1554005bc0 0x7f1554005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:08.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.002+0000 7f156759e640 1 -- 172.21.15.79:0/2146123371 reap_dead start 2024-04-25T02:18:08.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.002+0000 7f156759e640 1 --2- 172.21.15.79:0/2146123371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15540073d0 0x7f155400dbd0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f1560001e50 tx=0x7f1554007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba737e26fef5c94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:08.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.003+0000 7f156659c640 1 -- 172.21.15.79:0/2146123371 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560001a70 con 0x7f15540073d0 2024-04-25T02:18:08.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.003+0000 7f156659c640 1 -- 172.21.15.79:0/2146123371 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1560003970 con 0x7f15540073d0 2024-04-25T02:18:08.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.003+0000 7f156659c640 1 -- 172.21.15.79:0/2146123371 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560003d60 con 0x7f15540073d0 2024-04-25T02:18:08.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.003+0000 7f156d19e640 1 -- 172.21.15.79:0/2146123371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15540073d0 msgr2=0x7f155400dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.003+0000 7f156d19e640 1 --2- 172.21.15.79:0/2146123371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15540073d0 0x7f155400dbd0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f1560001e50 tx=0x7f1554007a40 comp rx=0 tx=0).stop 2024-04-25T02:18:08.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.003+0000 7f156d19e640 1 -- 172.21.15.79:0/2146123371 shutdown_connections 2024-04-25T02:18:08.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.003+0000 7f156d19e640 1 --2- 172.21.15.79:0/2146123371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15540073d0 0x7f155400dbd0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.003+0000 7f156d19e640 1 -- 172.21.15.79:0/2146123371 >> 172.21.15.79:0/2146123371 conn(0x7f15680cfc80 msgr2=0x7f15680d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:08.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.003+0000 7f156d19e640 1 -- 172.21.15.79:0/2146123371 shutdown_connections 2024-04-25T02:18:08.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.003+0000 7f156d19e640 1 -- 172.21.15.79:0/2146123371 wait complete. 2024-04-25T02:18:08.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.004+0000 7f156d19e640 1 Processor -- start 2024-04-25T02:18:08.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.004+0000 7f156d19e640 1 -- start start 2024-04-25T02:18:08.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.005+0000 7f156d19e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15540073d0 0x7f156814dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.005+0000 7f156d19e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15680cddc0 0x7f15680ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.005+0000 7f156d19e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15680c90b0 0x7f15680c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.005+0000 7f156d19e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15680b39e0 con 0x7f15680c90b0 2024-04-25T02:18:08.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.005+0000 7f156d19e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f15680b3700 con 0x7f15680cddc0 2024-04-25T02:18:08.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.005+0000 7f156d19e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f15680b42a0 con 0x7f15540073d0 2024-04-25T02:18:08.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.005+0000 7f156759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15680c90b0 0x7f15680c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.005+0000 7f156759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15680c90b0 0x7f15680c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53228/0 (socket says 172.21.15.79:53228) 2024-04-25T02:18:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.005+0000 7f156759e640 1 -- 172.21.15.79:0/3513865909 learned_addr learned my addr 172.21.15.79:0/3513865909 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.005+0000 7f155ffff640 1 --2- 172.21.15.79:0/3513865909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15680cddc0 0x7f15680ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.005+0000 7f1566d9d640 1 --2- 172.21.15.79:0/3513865909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15540073d0 0x7f156814dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.006+0000 7f156759e640 1 -- 172.21.15.79:0/3513865909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15540073d0 msgr2=0x7f156814dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.006+0000 7f156759e640 1 --2- 172.21.15.79:0/3513865909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15540073d0 0x7f156814dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.006+0000 7f156759e640 1 -- 172.21.15.79:0/3513865909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15680cddc0 msgr2=0x7f15680ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.006+0000 7f156759e640 1 --2- 172.21.15.79:0/3513865909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15680cddc0 0x7f15680ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.006+0000 7f156759e640 1 -- 172.21.15.79:0/3513865909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1568150610 con 0x7f15680c90b0 2024-04-25T02:18:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.006+0000 7f155ffff640 1 --2- 172.21.15.79:0/3513865909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15680cddc0 0x7f15680ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.006+0000 7f156759e640 1 --2- 172.21.15.79:0/3513865909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15680c90b0 0x7f15680c9530 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f156002a920 tx=0x7f15600014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.006+0000 7f155f7fe640 1 -- 172.21.15.79:0/3513865909 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560001a70 con 0x7f15680c90b0 2024-04-25T02:18:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.006+0000 7f155f7fe640 1 -- 172.21.15.79:0/3513865909 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f156002ac70 con 0x7f15680c90b0 2024-04-25T02:18:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.006+0000 7f156d19e640 1 -- 172.21.15.79:0/3513865909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15680c9da0 con 0x7f15680c90b0 2024-04-25T02:18:08.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.006+0000 7f155f7fe640 1 -- 172.21.15.79:0/3513865909 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560006d70 con 0x7f15680c90b0 2024-04-25T02:18:08.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.006+0000 7f156d19e640 1 -- 172.21.15.79:0/3513865909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15680ca360 con 0x7f15680c90b0 2024-04-25T02:18:08.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.007+0000 7f156d19e640 1 -- 172.21.15.79:0/3513865909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15680690a0 con 0x7f15680c90b0 2024-04-25T02:18:08.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.007+0000 7f155f7fe640 1 -- 172.21.15.79:0/3513865909 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1560007030 con 0x7f15680c90b0 2024-04-25T02:18:08.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.008+0000 7f155f7fe640 1 --2- 172.21.15.79:0/3513865909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f154806be60 0x7f154806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.008+0000 7f1566d9d640 1 --2- 172.21.15.79:0/3513865909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f154806be60 0x7f154806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.008+0000 7f155f7fe640 1 -- 172.21.15.79:0/3513865909 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7f15600aa770 con 0x7f15680c90b0 2024-04-25T02:18:08.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.008+0000 7f1566d9d640 1 --2- 172.21.15.79:0/3513865909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f154806be60 0x7f154806e320 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1558000f60 tx=0x7f1558009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:08.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.012+0000 7f155f7fe640 1 -- 172.21.15.79:0/3513865909 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1560043060 con 0x7f15680c90b0 2024-04-25T02:18:08.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.220+0000 7f156d19e640 1 -- 172.21.15.79:0/3513865909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f156814e1a0 con 0x7f15680c90b0 2024-04-25T02:18:08.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.221+0000 7f155f7fe640 1 -- 172.21.15.79:0/3513865909 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5185 (secure 0 0 0) 0x7f15600790c0 con 0x7f15680c90b0 2024-04-25T02:18:08.225 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:08.225 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3866997901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3866997901},{"type":"v1","addr":"172.21.15.189:6834","nonce":3866997901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/167225705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":167225705},{"type":"v1","addr":"172.21.15.189:6835","nonce":167225705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8916,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3734112703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3734112703},{"type":"v1","addr":"172.21.15.79:6835","nonce":3734112703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:17:33.960191+0000","modified":"2024-04-25T02:18:02.586727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"a","rank":0,"incarnation":93,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/623571175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":623571175},{"type":"v1","addr":"172.21.15.79:6837","nonce":623571175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":8}]} 2024-04-25T02:18:08.226 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 96 2024-04-25T02:18:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.223+0000 7f156d19e640 1 -- 172.21.15.79:0/3513865909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f154806be60 msgr2=0x7f154806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.223+0000 7f156d19e640 1 --2- 172.21.15.79:0/3513865909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f154806be60 0x7f154806e320 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1558000f60 tx=0x7f1558009040 comp rx=0 tx=0).stop 2024-04-25T02:18:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.223+0000 7f156d19e640 1 -- 172.21.15.79:0/3513865909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15680c90b0 msgr2=0x7f15680c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.223+0000 7f156d19e640 1 --2- 172.21.15.79:0/3513865909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15680c90b0 0x7f15680c9530 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f156002a920 tx=0x7f15600014a0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.223+0000 7f156d19e640 1 -- 172.21.15.79:0/3513865909 shutdown_connections 2024-04-25T02:18:08.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.223+0000 7f156d19e640 1 --2- 172.21.15.79:0/3513865909 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f154806be60 0x7f154806e320 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.223+0000 7f156d19e640 1 --2- 172.21.15.79:0/3513865909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15680c90b0 0x7f15680c9530 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.223+0000 7f156d19e640 1 --2- 172.21.15.79:0/3513865909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15680cddc0 0x7f15680ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.223+0000 7f156d19e640 1 --2- 172.21.15.79:0/3513865909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f15540073d0 0x7f156814dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.223+0000 7f156d19e640 1 -- 172.21.15.79:0/3513865909 >> 172.21.15.79:0/3513865909 conn(0x7f15680cfc80 msgr2=0x7f156806cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:08.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.223+0000 7f156d19e640 1 -- 172.21.15.79:0/3513865909 shutdown_connections 2024-04-25T02:18:08.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.223+0000 7f156d19e640 1 -- 172.21.15.79:0/3513865909 wait complete. 2024-04-25T02:18:08.238 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:18:08.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.331+0000 7fd2267ed640 1 Processor -- start 2024-04-25T02:18:08.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.331+0000 7fd2267ed640 1 -- start start 2024-04-25T02:18:08.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.332+0000 7fd2267ed640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd22006df50 0x7fd22006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.332+0000 7fd2267ed640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2200b2d30 0x7fd2200b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.332+0000 7fd2267ed640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd220071e00 con 0x7fd220143bc0 2024-04-25T02:18:08.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.332+0000 7fd2267ed640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd22006e8f0 con 0x7fd22006df50 2024-04-25T02:18:08.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.332+0000 7fd2267ed640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd220072cb0 con 0x7fd2200b2d30 2024-04-25T02:18:08.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.332+0000 7fd21f7fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd22006df50 0x7fd22006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.332+0000 7fd224d8a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2200b2d30 0x7fd2200b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.333+0000 7fd21ffff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fd220143bc0 0x7fd22015f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:34752/0 (socket says 172.21.15.79:34752) 2024-04-25T02:18:08.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.333+0000 7fd21ffff640 1 -- 172.21.15.79:0/260433879 learned_addr learned my addr 172.21.15.79:0/260433879 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:08.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.333+0000 7fd21f7fe640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd22006df50 0x7fd22006e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:48788/0 (socket says 172.21.15.79:48788) 2024-04-25T02:18:08.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.333+0000 7fd21f7fe640 1 -- 172.21.15.79:0/260433879 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2200b2d30 msgr2=0x7fd2200b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:08.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.333+0000 7fd21f7fe640 1 --2- 172.21.15.79:0/260433879 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2200b2d30 0x7fd2200b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.333+0000 7fd21f7fe640 1 -- 172.21.15.79:0/260433879 >> v1:172.21.15.189:6789/0 conn(0x7fd220143bc0 legacy=0x7fd22015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.333+0000 7fd21f7fe640 1 -- 172.21.15.79:0/260433879 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2200720a0 con 0x7fd22006df50 2024-04-25T02:18:08.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.333+0000 7fd224d8a640 1 --2- 172.21.15.79:0/260433879 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2200b2d30 0x7fd2200b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:08.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.334+0000 7fd21f7fe640 1 --2- 172.21.15.79:0/260433879 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd22006df50 0x7fd22006e3b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd2140097a0 tx=0x7fd21402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb7ccaa10dc5c30b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:08.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.334+0000 7fd21effd640 1 -- 172.21.15.79:0/260433879 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214037070 con 0x7fd22006df50 2024-04-25T02:18:08.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.334+0000 7fd21effd640 1 -- 172.21.15.79:0/260433879 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21402ae50 con 0x7fd22006df50 2024-04-25T02:18:08.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.334+0000 7fd21effd640 1 -- 172.21.15.79:0/260433879 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214032660 con 0x7fd22006df50 2024-04-25T02:18:08.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.334+0000 7fd2267ed640 1 -- 172.21.15.79:0/260433879 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd22006df50 msgr2=0x7fd22006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.334+0000 7fd2267ed640 1 --2- 172.21.15.79:0/260433879 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd22006df50 0x7fd22006e3b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd2140097a0 tx=0x7fd21402a100 comp rx=0 tx=0).stop 2024-04-25T02:18:08.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.334+0000 7fd2267ed640 1 -- 172.21.15.79:0/260433879 shutdown_connections 2024-04-25T02:18:08.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.334+0000 7fd2267ed640 1 --2- 172.21.15.79:0/260433879 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2200b2d30 0x7fd2200b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.334+0000 7fd2267ed640 1 --2- 172.21.15.79:0/260433879 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd22006df50 0x7fd22006e3b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.334+0000 7fd2267ed640 1 -- 172.21.15.79:0/260433879 >> 172.21.15.79:0/260433879 conn(0x7fd2200cfc80 msgr2=0x7fd2200d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:08.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.334+0000 7fd2267ed640 1 -- 172.21.15.79:0/260433879 shutdown_connections 2024-04-25T02:18:08.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.334+0000 7fd2267ed640 1 -- 172.21.15.79:0/260433879 wait complete. 2024-04-25T02:18:08.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.335+0000 7fd2267ed640 1 Processor -- start 2024-04-25T02:18:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.336+0000 7fd2267ed640 1 -- start start 2024-04-25T02:18:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.336+0000 7fd2267ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22006df50 0x7fd2201577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.336+0000 7fd2267ed640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2200b2d30 0x7fd220140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.336+0000 7fd2267ed640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd220143bc0 0x7fd2200ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.336+0000 7fd2267ed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd220072940 con 0x7fd22006df50 2024-04-25T02:18:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.336+0000 7fd2267ed640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd220072660 con 0x7fd220143bc0 2024-04-25T02:18:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.336+0000 7fd2267ed640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd220143fa0 con 0x7fd2200b2d30 2024-04-25T02:18:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.336+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22006df50 0x7fd2201577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.336+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22006df50 0x7fd2201577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53236/0 (socket says 172.21.15.79:53236) 2024-04-25T02:18:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.336+0000 7fd21ffff640 1 -- 172.21.15.79:0/540842465 learned_addr learned my addr 172.21.15.79:0/540842465 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.337+0000 7fd21f7fe640 1 --2- 172.21.15.79:0/540842465 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2200b2d30 0x7fd220140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.337+0000 7fd224d8a640 1 --2- 172.21.15.79:0/540842465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd220143bc0 0x7fd2200ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.337+0000 7fd21ffff640 1 -- 172.21.15.79:0/540842465 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2200b2d30 msgr2=0x7fd220140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.337+0000 7fd21ffff640 1 --2- 172.21.15.79:0/540842465 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2200b2d30 0x7fd220140ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.337+0000 7fd21ffff640 1 -- 172.21.15.79:0/540842465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd220143bc0 msgr2=0x7fd2200ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.337+0000 7fd21ffff640 1 --2- 172.21.15.79:0/540842465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd220143bc0 0x7fd2200ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.337+0000 7fd21ffff640 1 -- 172.21.15.79:0/540842465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd220157cf0 con 0x7fd22006df50 2024-04-25T02:18:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.337+0000 7fd224d8a640 1 --2- 172.21.15.79:0/540842465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd220143bc0 0x7fd2200ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.337+0000 7fd21ffff640 1 --2- 172.21.15.79:0/540842465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22006df50 0x7fd2201577b0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fd21000c400 tx=0x7fd21000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.337+0000 7fd21cff9640 1 -- 172.21.15.79:0/540842465 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd210017070 con 0x7fd22006df50 2024-04-25T02:18:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.337+0000 7fd21cff9640 1 -- 172.21.15.79:0/540842465 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd210005ce0 con 0x7fd22006df50 2024-04-25T02:18:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.337+0000 7fd2267ed640 1 -- 172.21.15.79:0/540842465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2200adb30 con 0x7fd22006df50 2024-04-25T02:18:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.337+0000 7fd21cff9640 1 -- 172.21.15.79:0/540842465 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2100072f0 con 0x7fd22006df50 2024-04-25T02:18:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.337+0000 7fd2267ed640 1 -- 172.21.15.79:0/540842465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2200ae0f0 con 0x7fd22006df50 2024-04-25T02:18:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.338+0000 7fd2267ed640 1 -- 172.21.15.79:0/540842465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2200690a0 con 0x7fd22006df50 2024-04-25T02:18:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.338+0000 7fd21cff9640 1 -- 172.21.15.79:0/540842465 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd21001a070 con 0x7fd22006df50 2024-04-25T02:18:08.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.339+0000 7fd21cff9640 1 --2- 172.21.15.79:0/540842465 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd20c06be60 0x7fd20c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.339+0000 7fd21cff9640 1 -- 172.21.15.79:0/540842465 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7fd21008a430 con 0x7fd22006df50 2024-04-25T02:18:08.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.339+0000 7fd21f7fe640 1 --2- 172.21.15.79:0/540842465 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd20c06be60 0x7fd20c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.339+0000 7fd21f7fe640 1 --2- 172.21.15.79:0/540842465 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd20c06be60 0x7fd20c06e320 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd214034000 tx=0x7fd21402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:08.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.343+0000 7fd21cff9640 1 -- 172.21.15.79:0/540842465 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd220157cf0 con 0x7fd22006df50 2024-04-25T02:18:08.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.517+0000 7fd2267ed640 1 -- 172.21.15.79:0/540842465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2200b5be0 con 0x7fd22006df50 2024-04-25T02:18:08.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.518+0000 7fd21cff9640 1 -- 172.21.15.79:0/540842465 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16991 (secure 0 0 0) 0x7fd210058c50 con 0x7fd22006df50 2024-04-25T02:18:08.523 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:08.523 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":119,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:17:57.569985+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:17:32.207579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T02:17:32.929915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.b","mappings":[{"from":0,"to":2}]},{"pgid":"17.34","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/3097428733":"2024-04-26T02:17:57.569963+0000","172.21.15.79:6836/3097428733":"2024-04-26T02:17:57.569963+0000","172.21.15.79:6837/2134535107":"2024-04-26T02:17:47.006917+0000","172.21.15.79:6836/2134535107":"2024-04-26T02:17:47.006917+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:18:08.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.520+0000 7fd2267ed640 1 -- 172.21.15.79:0/540842465 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd20c06be60 msgr2=0x7fd20c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.520+0000 7fd2267ed640 1 --2- 172.21.15.79:0/540842465 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd20c06be60 0x7fd20c06e320 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd214034000 tx=0x7fd21402e000 comp rx=0 tx=0).stop 2024-04-25T02:18:08.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.520+0000 7fd2267ed640 1 -- 172.21.15.79:0/540842465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22006df50 msgr2=0x7fd2201577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.520+0000 7fd2267ed640 1 --2- 172.21.15.79:0/540842465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22006df50 0x7fd2201577b0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fd21000c400 tx=0x7fd21000c8c0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.520+0000 7fd2267ed640 1 -- 172.21.15.79:0/540842465 shutdown_connections 2024-04-25T02:18:08.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.520+0000 7fd2267ed640 1 --2- 172.21.15.79:0/540842465 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fd20c06be60 0x7fd20c06e320 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.520+0000 7fd2267ed640 1 --2- 172.21.15.79:0/540842465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd220143bc0 0x7fd2200ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.520+0000 7fd2267ed640 1 --2- 172.21.15.79:0/540842465 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd2200b2d30 0x7fd220140ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.520+0000 7fd2267ed640 1 --2- 172.21.15.79:0/540842465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22006df50 0x7fd2201577b0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.520+0000 7fd2267ed640 1 -- 172.21.15.79:0/540842465 >> 172.21.15.79:0/540842465 conn(0x7fd2200cfc80 msgr2=0x7fd2200b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:08.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.520+0000 7fd2267ed640 1 -- 172.21.15.79:0/540842465 shutdown_connections 2024-04-25T02:18:08.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.520+0000 7fd2267ed640 1 -- 172.21.15.79:0/540842465 wait complete. 2024-04-25T02:18:08.536 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:07:47.204372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:17:32.207579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:17:32.929915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:18:08.536 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:18:08.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.633+0000 7fe18491b640 1 Processor -- start 2024-04-25T02:18:08.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.633+0000 7fe18491b640 1 -- start start 2024-04-25T02:18:08.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe18491b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe1800cf7a0 0x7fe1800b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe18491b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe18015ec20 con 0x7fe18006b2f0 2024-04-25T02:18:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe18491b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe18015ef00 con 0x7fe18006e6b0 2024-04-25T02:18:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe18491b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe18015f830 con 0x7fe1800cf7a0 2024-04-25T02:18:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe17e59c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe18006b2f0 0x7fe18006b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36710/0 (socket says 172.21.15.79:36710) 2024-04-25T02:18:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe17e59c640 1 -- 172.21.15.79:0/3948903374 learned_addr learned my addr 172.21.15.79:0/3948903374 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe17dd9b640 1 -- 172.21.15.79:0/3948903374 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3700781236 0 0) 0x7fe18015ec20 con 0x7fe18006b2f0 2024-04-25T02:18:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe17dd9b640 1 -- 172.21.15.79:0/3948903374 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe16c003520 con 0x7fe18006b2f0 2024-04-25T02:18:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe177fff640 1 --2- 172.21.15.79:0/3948903374 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe1800cf7a0 0x7fe1800b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe17dd9b640 1 -- 172.21.15.79:0/3948903374 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 291019912 0 0) 0x7fe16c003520 con 0x7fe18006b2f0 2024-04-25T02:18:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe17dd9b640 1 -- 172.21.15.79:0/3948903374 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe1800cf7a0 msgr2=0x7fe1800b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe17dd9b640 1 --2- 172.21.15.79:0/3948903374 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe1800cf7a0 0x7fe1800b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe17dd9b640 1 -- 172.21.15.79:0/3948903374 >> v1:172.21.15.189:6789/0 conn(0x7fe18006e6b0 legacy=0x7fe18015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe17dd9b640 1 -- 172.21.15.79:0/3948903374 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18015f1e0 con 0x7fe18006b2f0 2024-04-25T02:18:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe17dd9b640 1 -- 172.21.15.79:0/3948903374 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fe170001670 con 0x7fe18006b2f0 2024-04-25T02:18:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe17dd9b640 1 -- 172.21.15.79:0/3948903374 >> v1:172.21.15.79:6789/0 conn(0x7fe18006b2f0 legacy=0x7fe18006b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.634+0000 7fe17dd9b640 1 --2- 172.21.15.79:0/3948903374 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe1800cf7a0 0x7fe16c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.635+0000 7fe17dd9b640 1 --2- 172.21.15.79:0/3948903374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe16c003f60 0x7fe16c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.635+0000 7fe17dd9b640 1 --2- 172.21.15.79:0/3948903374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c004d40 0x7fe16c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.635+0000 7fe17dd9b640 1 -- 172.21.15.79:0/3948903374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe18015f830 con 0x7fe16c004d40 2024-04-25T02:18:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.635+0000 7fe17dd9b640 1 -- 172.21.15.79:0/3948903374 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c00bb50 con 0x7fe16c003f60 2024-04-25T02:18:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.635+0000 7fe17dd9b640 1 -- 172.21.15.79:0/3948903374 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe16c00bd50 con 0x7fe1800cf7a0 2024-04-25T02:18:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.635+0000 7fe17ed9d640 1 --2- 172.21.15.79:0/3948903374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c004d40 0x7fe16c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.635+0000 7fe17e59c640 1 --2- 172.21.15.79:0/3948903374 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe1800cf7a0 0x7fe16c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.635+0000 7fe177fff640 1 --2- 172.21.15.79:0/3948903374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe16c003f60 0x7fe16c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.635+0000 7fe17ed9d640 1 -- 172.21.15.79:0/3948903374 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe1800cf7a0 msgr2=0x7fe16c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.635+0000 7fe17ed9d640 1 --2- 172.21.15.79:0/3948903374 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe1800cf7a0 0x7fe16c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.635+0000 7fe17ed9d640 1 -- 172.21.15.79:0/3948903374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe16c003f60 msgr2=0x7fe16c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.635+0000 7fe17ed9d640 1 --2- 172.21.15.79:0/3948903374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe16c003f60 0x7fe16c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.635+0000 7fe17ed9d640 1 -- 172.21.15.79:0/3948903374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c003520 con 0x7fe16c004d40 2024-04-25T02:18:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.636+0000 7fe17ed9d640 1 --2- 172.21.15.79:0/3948903374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c004d40 0x7fe16c0051c0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7fe178001e50 tx=0x7fe16c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4dd8752a44b1c0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.636+0000 7fe17dd9b640 1 -- 172.21.15.79:0/3948903374 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178001a70 con 0x7fe16c004d40 2024-04-25T02:18:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.636+0000 7fe17dd9b640 1 -- 172.21.15.79:0/3948903374 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe178003970 con 0x7fe16c004d40 2024-04-25T02:18:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.636+0000 7fe17dd9b640 1 -- 172.21.15.79:0/3948903374 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178003d60 con 0x7fe16c004d40 2024-04-25T02:18:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.636+0000 7fe18491b640 1 -- 172.21.15.79:0/3948903374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c004d40 msgr2=0x7fe16c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.636+0000 7fe18491b640 1 --2- 172.21.15.79:0/3948903374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c004d40 0x7fe16c0051c0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7fe178001e50 tx=0x7fe16c005830 comp rx=0 tx=0).stop 2024-04-25T02:18:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.636+0000 7fe17ed9d640 1 -- 172.21.15.79:0/3948903374 reap_dead start 2024-04-25T02:18:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.636+0000 7fe18491b640 1 -- 172.21.15.79:0/3948903374 shutdown_connections 2024-04-25T02:18:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.636+0000 7fe18491b640 1 -- 172.21.15.79:0/3948903374 >> 172.21.15.79:0/3948903374 conn(0x7fe1800b1cd0 msgr2=0x7fe1800b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.636+0000 7fe18491b640 1 -- 172.21.15.79:0/3948903374 shutdown_connections 2024-04-25T02:18:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.636+0000 7fe18491b640 1 -- 172.21.15.79:0/3948903374 wait complete. 2024-04-25T02:18:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.638+0000 7fe18491b640 1 Processor -- start 2024-04-25T02:18:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.638+0000 7fe18491b640 1 -- start start 2024-04-25T02:18:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.638+0000 7fe18491b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe16c004d40 0x7fe180148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.638+0000 7fe18491b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe180157be0 0x7fe180158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.638+0000 7fe18491b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe18009c2a0 0x7fe18009c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.638+0000 7fe18491b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe18006d160 con 0x7fe180157be0 2024-04-25T02:18:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.638+0000 7fe18491b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe18006cfe0 con 0x7fe18009c2a0 2024-04-25T02:18:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.638+0000 7fe18491b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe1800b4b50 con 0x7fe16c004d40 2024-04-25T02:18:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.638+0000 7fe177fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe180157be0 0x7fe180158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.639+0000 7fe177fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe180157be0 0x7fe180158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53258/0 (socket says 172.21.15.79:53258) 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.639+0000 7fe177fff640 1 -- 172.21.15.79:0/297724230 learned_addr learned my addr 172.21.15.79:0/297724230 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.639+0000 7fe17e59c640 1 --2- 172.21.15.79:0/297724230 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe16c004d40 0x7fe180148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.639+0000 7fe17ed9d640 1 --2- 172.21.15.79:0/297724230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe18009c2a0 0x7fe18009c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.639+0000 7fe177fff640 1 -- 172.21.15.79:0/297724230 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe16c004d40 msgr2=0x7fe180148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.639+0000 7fe177fff640 1 --2- 172.21.15.79:0/297724230 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe16c004d40 0x7fe180148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.639+0000 7fe177fff640 1 -- 172.21.15.79:0/297724230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe18009c2a0 msgr2=0x7fe18009c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.639+0000 7fe177fff640 1 --2- 172.21.15.79:0/297724230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe18009c2a0 0x7fe18009c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.639+0000 7fe177fff640 1 -- 172.21.15.79:0/297724230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18009d010 con 0x7fe180157be0 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.639+0000 7fe177fff640 1 --2- 172.21.15.79:0/297724230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe180157be0 0x7fe180158060 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fe168011960 tx=0x7fe168011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.639+0000 7fe176ffd640 1 -- 172.21.15.79:0/297724230 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16800faf0 con 0x7fe180157be0 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.639+0000 7fe176ffd640 1 -- 172.21.15.79:0/297724230 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16800fc90 con 0x7fe180157be0 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.639+0000 7fe176ffd640 1 -- 172.21.15.79:0/297724230 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168014440 con 0x7fe180157be0 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.639+0000 7fe18491b640 1 -- 172.21.15.79:0/297724230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18009d2f0 con 0x7fe180157be0 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.639+0000 7fe18491b640 1 -- 172.21.15.79:0/297724230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18009d8b0 con 0x7fe180157be0 2024-04-25T02:18:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.640+0000 7fe18491b640 1 -- 172.21.15.79:0/297724230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1800690a0 con 0x7fe180157be0 2024-04-25T02:18:08.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.640+0000 7fe176ffd640 1 -- 172.21.15.79:0/297724230 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe168012040 con 0x7fe180157be0 2024-04-25T02:18:08.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.641+0000 7fe176ffd640 1 --2- 172.21.15.79:0/297724230 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe16006be60 0x7fe16006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.641+0000 7fe17e59c640 1 --2- 172.21.15.79:0/297724230 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe16006be60 0x7fe16006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.641+0000 7fe176ffd640 1 -- 172.21.15.79:0/297724230 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7fe16808b720 con 0x7fe180157be0 2024-04-25T02:18:08.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.641+0000 7fe17e59c640 1 --2- 172.21.15.79:0/297724230 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe16006be60 0x7fe16006e320 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe170007d90 tx=0x7fe170009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:08.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.645+0000 7fe176ffd640 1 -- 172.21.15.79:0/297724230 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe168019030 con 0x7fe180157be0 2024-04-25T02:18:08.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.817+0000 7fe18491b640 1 -- 172.21.15.79:0/297724230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe1800cf4f0 con 0x7fe180157be0 2024-04-25T02:18:08.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.818+0000 7fe176ffd640 1 -- 172.21.15.79:0/297724230 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) ==== 93+0+10 (secure 0 0 0) 0x7fe168059f40 con 0x7fe180157be0 2024-04-25T02:18:08.822 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-04-25T02:18:08.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.820+0000 7fe18491b640 1 -- 172.21.15.79:0/297724230 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe16006be60 msgr2=0x7fe16006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.820+0000 7fe18491b640 1 --2- 172.21.15.79:0/297724230 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe16006be60 0x7fe16006e320 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe170007d90 tx=0x7fe170009040 comp rx=0 tx=0).stop 2024-04-25T02:18:08.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.820+0000 7fe18491b640 1 -- 172.21.15.79:0/297724230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe180157be0 msgr2=0x7fe180158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.820+0000 7fe18491b640 1 --2- 172.21.15.79:0/297724230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe180157be0 0x7fe180158060 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fe168011960 tx=0x7fe168011e20 comp rx=0 tx=0).stop 2024-04-25T02:18:08.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.820+0000 7fe18491b640 1 -- 172.21.15.79:0/297724230 shutdown_connections 2024-04-25T02:18:08.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.820+0000 7fe18491b640 1 --2- 172.21.15.79:0/297724230 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe16006be60 0x7fe16006e320 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.820+0000 7fe18491b640 1 --2- 172.21.15.79:0/297724230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe18009c2a0 0x7fe18009c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.820+0000 7fe18491b640 1 --2- 172.21.15.79:0/297724230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe180157be0 0x7fe180158060 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.820+0000 7fe18491b640 1 --2- 172.21.15.79:0/297724230 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe16c004d40 0x7fe180148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.820+0000 7fe18491b640 1 -- 172.21.15.79:0/297724230 >> 172.21.15.79:0/297724230 conn(0x7fe1800b1cd0 msgr2=0x7fe1800cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:08.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.820+0000 7fe18491b640 1 -- 172.21.15.79:0/297724230 shutdown_connections 2024-04-25T02:18:08.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.820+0000 7fe18491b640 1 -- 172.21.15.79:0/297724230 wait complete. 2024-04-25T02:18:08.835 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:18:08.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.930+0000 7f09d67c1640 1 Processor -- start 2024-04-25T02:18:08.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.930+0000 7f09d67c1640 1 -- start start 2024-04-25T02:18:08.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09d67c1640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f09d006b2f0 0x7f09d00b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09d67c1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09d00cf7a0 0x7f09d006b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09d67c1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09d006e6b0 0x7f09d00cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09d67c1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f09d015f830 con 0x7f09d006e6b0 2024-04-25T02:18:08.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09d67c1640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f09d006bc10 con 0x7f09d006b2f0 2024-04-25T02:18:08.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09d67c1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f09d015ec20 con 0x7f09d00cf7a0 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09d4d5e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09d006e6b0 0x7f09d00cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09d4d5e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09d006e6b0 0x7f09d00cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53270/0 (socket says 172.21.15.79:53270) 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09d4d5e640 1 -- 172.21.15.79:0/4153890275 learned_addr learned my addr 172.21.15.79:0/4153890275 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09cf7fe640 1 --2- 172.21.15.79:0/4153890275 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09d00cf7a0 0x7f09d006b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09cffff640 1 --2- 172.21.15.79:0/4153890275 >> v2:172.21.15.189:3300/0 conn(0x7f09d006b2f0 0x7f09d00b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09d4d5e640 1 -- 172.21.15.79:0/4153890275 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09d00cf7a0 msgr2=0x7f09d006b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09d4d5e640 1 --2- 172.21.15.79:0/4153890275 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09d00cf7a0 0x7f09d006b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09d4d5e640 1 -- 172.21.15.79:0/4153890275 >> v2:172.21.15.189:3300/0 conn(0x7f09d006b2f0 msgr2=0x7f09d00b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09d4d5e640 1 --2- 172.21.15.79:0/4153890275 >> v2:172.21.15.189:3300/0 conn(0x7f09d006b2f0 0x7f09d00b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09d4d5e640 1 -- 172.21.15.79:0/4153890275 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d015ef00 con 0x7f09d006e6b0 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09cffff640 1 --2- 172.21.15.79:0/4153890275 >> v2:172.21.15.189:3300/0 conn(0x7f09d006b2f0 0x7f09d00b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.931+0000 7f09cf7fe640 1 --2- 172.21.15.79:0/4153890275 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09d00cf7a0 0x7f09d006b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.932+0000 7f09d4d5e640 1 --2- 172.21.15.79:0/4153890275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006e6b0 0x7f09d00cdb70 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f09d006efd0 tx=0x7f09c802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b20f82af68783f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.932+0000 7f09ceffd640 1 -- 172.21.15.79:0/4153890275 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c8036070 con 0x7f09d006e6b0 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.932+0000 7f09ceffd640 1 -- 172.21.15.79:0/4153890275 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c8031600 con 0x7f09d006e6b0 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.932+0000 7f09ceffd640 1 -- 172.21.15.79:0/4153890275 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c80319d0 con 0x7f09d006e6b0 2024-04-25T02:18:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.933+0000 7f09d67c1640 1 -- 172.21.15.79:0/4153890275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006e6b0 msgr2=0x7f09d00cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.933+0000 7f09d67c1640 1 --2- 172.21.15.79:0/4153890275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006e6b0 0x7f09d00cdb70 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f09d006efd0 tx=0x7f09c802a610 comp rx=0 tx=0).stop 2024-04-25T02:18:08.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.933+0000 7f09d67c1640 1 -- 172.21.15.79:0/4153890275 shutdown_connections 2024-04-25T02:18:08.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.933+0000 7f09d67c1640 1 --2- 172.21.15.79:0/4153890275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006e6b0 0x7f09d00cdb70 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.933+0000 7f09d67c1640 1 --2- 172.21.15.79:0/4153890275 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09d00cf7a0 0x7f09d006b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.933+0000 7f09d67c1640 1 --2- 172.21.15.79:0/4153890275 >> v2:172.21.15.189:3300/0 conn(0x7f09d006b2f0 0x7f09d00b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.933+0000 7f09d67c1640 1 -- 172.21.15.79:0/4153890275 >> 172.21.15.79:0/4153890275 conn(0x7f09d00b1cd0 msgr2=0x7f09d00b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:08.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.933+0000 7f09d67c1640 1 -- 172.21.15.79:0/4153890275 shutdown_connections 2024-04-25T02:18:08.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.933+0000 7f09d67c1640 1 -- 172.21.15.79:0/4153890275 wait complete. 2024-04-25T02:18:08.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.934+0000 7f09d67c1640 1 Processor -- start 2024-04-25T02:18:08.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.934+0000 7f09d67c1640 1 -- start start 2024-04-25T02:18:08.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09d67c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006b2f0 0x7f09d01475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09d67c1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09d006e6b0 0x7f09d00aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09d67c1640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09d00cf7a0 0x7f09d00c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09d67c1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f09d006cfe0 con 0x7f09d006b2f0 2024-04-25T02:18:08.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09d67c1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f09d015f4c0 con 0x7f09d006e6b0 2024-04-25T02:18:08.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09d67c1640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f09d006d160 con 0x7f09d00cf7a0 2024-04-25T02:18:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09cffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006b2f0 0x7f09d01475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09cffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006b2f0 0x7f09d01475d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53272/0 (socket says 172.21.15.79:53272) 2024-04-25T02:18:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09cffff640 1 -- 172.21.15.79:0/676356248 learned_addr learned my addr 172.21.15.79:0/676356248 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09cf7fe640 1 --2- 172.21.15.79:0/676356248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09d006e6b0 0x7f09d00aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09d4d5e640 1 --2- 172.21.15.79:0/676356248 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09d00cf7a0 0x7f09d00c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09cffff640 1 -- 172.21.15.79:0/676356248 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09d00cf7a0 msgr2=0x7f09d00c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09cffff640 1 --2- 172.21.15.79:0/676356248 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09d00cf7a0 0x7f09d00c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09cffff640 1 -- 172.21.15.79:0/676356248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09d006e6b0 msgr2=0x7f09d00aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09cffff640 1 --2- 172.21.15.79:0/676356248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09d006e6b0 0x7f09d00aef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09cffff640 1 -- 172.21.15.79:0/676356248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d00ade80 con 0x7f09d006b2f0 2024-04-25T02:18:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.935+0000 7f09cf7fe640 1 --2- 172.21.15.79:0/676356248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09d006e6b0 0x7f09d00aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.936+0000 7f09cffff640 1 --2- 172.21.15.79:0/676356248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006b2f0 0x7f09d01475d0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f09c000c820 tx=0x7f09c000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.936+0000 7f09ccff9640 1 -- 172.21.15.79:0/676356248 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c0015070 con 0x7f09d006b2f0 2024-04-25T02:18:08.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.936+0000 7f09d67c1640 1 -- 172.21.15.79:0/676356248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d00ae160 con 0x7f09d006b2f0 2024-04-25T02:18:08.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.936+0000 7f09ccff9640 1 -- 172.21.15.79:0/676356248 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c0007a30 con 0x7f09d006b2f0 2024-04-25T02:18:08.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.936+0000 7f09ccff9640 1 -- 172.21.15.79:0/676356248 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c0007e00 con 0x7f09d006b2f0 2024-04-25T02:18:08.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.936+0000 7f09d67c1640 1 -- 172.21.15.79:0/676356248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d00ae720 con 0x7f09d006b2f0 2024-04-25T02:18:08.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.937+0000 7f09d67c1640 1 -- 172.21.15.79:0/676356248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d00b5eb0 con 0x7f09d006b2f0 2024-04-25T02:18:08.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.937+0000 7f09ccff9640 1 -- 172.21.15.79:0/676356248 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09c0018070 con 0x7f09d006b2f0 2024-04-25T02:18:08.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.938+0000 7f09ccff9640 1 --2- 172.21.15.79:0/676356248 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f09bc06be30 0x7f09bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:08.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.938+0000 7f09ccff9640 1 -- 172.21.15.79:0/676356248 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7f09c008afb0 con 0x7f09d006b2f0 2024-04-25T02:18:08.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.938+0000 7f09cf7fe640 1 --2- 172.21.15.79:0/676356248 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f09bc06be30 0x7f09bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:08.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.938+0000 7f09cf7fe640 1 --2- 172.21.15.79:0/676356248 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f09bc06be30 0x7f09bc06e2f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f09d009de80 tx=0x7f09c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:08.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:08.942+0000 7f09ccff9640 1 -- 172.21.15.79:0/676356248 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f09d00b5eb0 con 0x7f09d006b2f0 2024-04-25T02:18:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.112+0000 7f09d67c1640 1 -- 172.21.15.79:0/676356248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f09d00cf4f0 con 0x7f09d006b2f0 2024-04-25T02:18:09.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.113+0000 7f09ccff9640 1 -- 172.21.15.79:0/676356248 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v119) ==== 104+0+11 (secure 0 0 0) 0x7f09c00597f0 con 0x7f09d006b2f0 2024-04-25T02:18:09.117 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-04-25T02:18:09.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.115+0000 7f09d67c1640 1 -- 172.21.15.79:0/676356248 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f09bc06be30 msgr2=0x7f09bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.115+0000 7f09d67c1640 1 --2- 172.21.15.79:0/676356248 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f09bc06be30 0x7f09bc06e2f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f09d009de80 tx=0x7f09c4008040 comp rx=0 tx=0).stop 2024-04-25T02:18:09.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.115+0000 7f09d67c1640 1 -- 172.21.15.79:0/676356248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006b2f0 msgr2=0x7f09d01475d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.115+0000 7f09d67c1640 1 --2- 172.21.15.79:0/676356248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006b2f0 0x7f09d01475d0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f09c000c820 tx=0x7f09c000cc20 comp rx=0 tx=0).stop 2024-04-25T02:18:09.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.115+0000 7f09d67c1640 1 -- 172.21.15.79:0/676356248 shutdown_connections 2024-04-25T02:18:09.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.115+0000 7f09d67c1640 1 --2- 172.21.15.79:0/676356248 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f09bc06be30 0x7f09bc06e2f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.115+0000 7f09d67c1640 1 --2- 172.21.15.79:0/676356248 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f09d00cf7a0 0x7f09d00c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.115+0000 7f09d67c1640 1 --2- 172.21.15.79:0/676356248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09d006e6b0 0x7f09d00aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.115+0000 7f09d67c1640 1 --2- 172.21.15.79:0/676356248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d006b2f0 0x7f09d01475d0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.115+0000 7f09d67c1640 1 -- 172.21.15.79:0/676356248 >> 172.21.15.79:0/676356248 conn(0x7f09d00b1cd0 msgr2=0x7f09d01577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:09.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.115+0000 7f09d67c1640 1 -- 172.21.15.79:0/676356248 shutdown_connections 2024-04-25T02:18:09.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.115+0000 7f09d67c1640 1 -- 172.21.15.79:0/676356248 wait complete. 2024-04-25T02:18:09.130 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:18:09.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.225+0000 7fa87842a640 1 Processor -- start 2024-04-25T02:18:09.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.225+0000 7fa87842a640 1 -- start start 2024-04-25T02:18:09.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.226+0000 7fa87842a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa87006b2f0 0x7fa8700b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.226+0000 7fa87842a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87015ec20 con 0x7fa8700cf7a0 2024-04-25T02:18:09.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.226+0000 7fa87842a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87015ef00 con 0x7fa87006e6b0 2024-04-25T02:18:09.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.226+0000 7fa87842a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fa87015f830 con 0x7fa87006b2f0 2024-04-25T02:18:09.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.226+0000 7fa8759c5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa8700cf7a0 0x7fa87006b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36724/0 (socket says 172.21.15.79:36724) 2024-04-25T02:18:09.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.226+0000 7fa8759c5640 1 -- 172.21.15.79:0/109589857 learned_addr learned my addr 172.21.15.79:0/109589857 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.226+0000 7fa8761c6640 1 --2- 172.21.15.79:0/109589857 >> v2:172.21.15.189:3300/0 conn(0x7fa87006b2f0 0x7fa8700b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.226+0000 7fa8751c4640 1 -- 172.21.15.79:0/109589857 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 407113776 0 0) 0x7fa87015ec20 con 0x7fa8700cf7a0 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.226+0000 7fa8751c4640 1 -- 172.21.15.79:0/109589857 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa85c003520 con 0x7fa8700cf7a0 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8751c4640 1 -- 172.21.15.79:0/109589857 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1830164064 0 0) 0x7fa85c003520 con 0x7fa8700cf7a0 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8751c4640 1 -- 172.21.15.79:0/109589857 >> v2:172.21.15.189:3300/0 conn(0x7fa87006b2f0 msgr2=0x7fa8700b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8751c4640 1 --2- 172.21.15.79:0/109589857 >> v2:172.21.15.189:3300/0 conn(0x7fa87006b2f0 0x7fa8700b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8751c4640 1 -- 172.21.15.79:0/109589857 >> v1:172.21.15.189:6789/0 conn(0x7fa87006e6b0 legacy=0x7fa87015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8751c4640 1 -- 172.21.15.79:0/109589857 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87015f1e0 con 0x7fa8700cf7a0 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8751c4640 1 -- 172.21.15.79:0/109589857 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7fa860001670 con 0x7fa8700cf7a0 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8751c4640 1 -- 172.21.15.79:0/109589857 >> v1:172.21.15.79:6789/0 conn(0x7fa8700cf7a0 legacy=0x7fa87006b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8751c4640 1 --2- 172.21.15.79:0/109589857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa85c0039b0 0x7fa85c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8751c4640 1 --2- 172.21.15.79:0/109589857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa85c004800 0x7fa85c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8751c4640 1 --2- 172.21.15.79:0/109589857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa85c0051c0 0x7fa85c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8751c4640 1 -- 172.21.15.79:0/109589857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa87015f830 con 0x7fa85c0051c0 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8751c4640 1 -- 172.21.15.79:0/109589857 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa85c00c160 con 0x7fa85c0039b0 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8751c4640 1 -- 172.21.15.79:0/109589857 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa85c00c360 con 0x7fa85c004800 2024-04-25T02:18:09.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8769c7640 1 --2- 172.21.15.79:0/109589857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa85c0051c0 0x7fa85c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8761c6640 1 --2- 172.21.15.79:0/109589857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa85c0039b0 0x7fa85c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8759c5640 1 --2- 172.21.15.79:0/109589857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa85c004800 0x7fa85c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8769c7640 1 -- 172.21.15.79:0/109589857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa85c004800 msgr2=0x7fa85c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:09.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8769c7640 1 --2- 172.21.15.79:0/109589857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa85c004800 0x7fa85c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8769c7640 1 -- 172.21.15.79:0/109589857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa85c0039b0 msgr2=0x7fa85c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:09.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8769c7640 1 --2- 172.21.15.79:0/109589857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa85c0039b0 0x7fa85c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8769c7640 1 -- 172.21.15.79:0/109589857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85c003520 con 0x7fa85c0051c0 2024-04-25T02:18:09.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8759c5640 1 --2- 172.21.15.79:0/109589857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa85c004800 0x7fa85c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:09.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.227+0000 7fa8761c6640 1 --2- 172.21.15.79:0/109589857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa85c0039b0 0x7fa85c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:09.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.228+0000 7fa8769c7640 1 -- 172.21.15.79:0/109589857 reap_dead start 2024-04-25T02:18:09.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.228+0000 7fa8769c7640 1 --2- 172.21.15.79:0/109589857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa85c0051c0 0x7fa85c00b9c0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fa868001750 tx=0x7fa85c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec343dcb02bc821a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:09.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.228+0000 7fa8751c4640 1 -- 172.21.15.79:0/109589857 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868001370 con 0x7fa85c0051c0 2024-04-25T02:18:09.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.228+0000 7fa8751c4640 1 -- 172.21.15.79:0/109589857 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa868005310 con 0x7fa85c0051c0 2024-04-25T02:18:09.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.228+0000 7fa8751c4640 1 -- 172.21.15.79:0/109589857 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86802abe0 con 0x7fa85c0051c0 2024-04-25T02:18:09.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.228+0000 7fa87842a640 1 -- 172.21.15.79:0/109589857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa85c0051c0 msgr2=0x7fa85c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.228+0000 7fa87842a640 1 --2- 172.21.15.79:0/109589857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa85c0051c0 0x7fa85c00b9c0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fa868001750 tx=0x7fa85c005830 comp rx=0 tx=0).stop 2024-04-25T02:18:09.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.228+0000 7fa87842a640 1 -- 172.21.15.79:0/109589857 shutdown_connections 2024-04-25T02:18:09.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.228+0000 7fa87842a640 1 --2- 172.21.15.79:0/109589857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa85c0051c0 0x7fa85c00b9c0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.228+0000 7fa87842a640 1 -- 172.21.15.79:0/109589857 >> 172.21.15.79:0/109589857 conn(0x7fa8700b1cd0 msgr2=0x7fa8700b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:09.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.228+0000 7fa87842a640 1 -- 172.21.15.79:0/109589857 shutdown_connections 2024-04-25T02:18:09.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.228+0000 7fa87842a640 1 -- 172.21.15.79:0/109589857 wait complete. 2024-04-25T02:18:09.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.230+0000 7fa87842a640 1 Processor -- start 2024-04-25T02:18:09.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.230+0000 7fa87842a640 1 -- start start 2024-04-25T02:18:09.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.230+0000 7fa87842a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa85c0051c0 0x7fa870145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.230+0000 7fa87842a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8700cc6f0 0x7fa8700ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.230+0000 7fa87842a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87015cbf0 0x7fa87015d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.230+0000 7fa87842a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa87006d160 con 0x7fa87015cbf0 2024-04-25T02:18:09.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.230+0000 7fa87842a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa87006cfe0 con 0x7fa8700cc6f0 2024-04-25T02:18:09.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.230+0000 7fa87842a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa8700b4b50 con 0x7fa85c0051c0 2024-04-25T02:18:09.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.230+0000 7fa8769c7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87015cbf0 0x7fa87015d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.230+0000 7fa8769c7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87015cbf0 0x7fa87015d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53288/0 (socket says 172.21.15.79:53288) 2024-04-25T02:18:09.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.230+0000 7fa8769c7640 1 -- 172.21.15.79:0/874766126 learned_addr learned my addr 172.21.15.79:0/874766126 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:09.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.231+0000 7fa8759c5640 1 --2- 172.21.15.79:0/874766126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8700cc6f0 0x7fa8700ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.231+0000 7fa8761c6640 1 --2- 172.21.15.79:0/874766126 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa85c0051c0 0x7fa870145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.231+0000 7fa8769c7640 1 -- 172.21.15.79:0/874766126 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa85c0051c0 msgr2=0x7fa870145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.231+0000 7fa8769c7640 1 --2- 172.21.15.79:0/874766126 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa85c0051c0 0x7fa870145200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.231+0000 7fa8769c7640 1 -- 172.21.15.79:0/874766126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8700cc6f0 msgr2=0x7fa8700ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.231+0000 7fa8769c7640 1 --2- 172.21.15.79:0/874766126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8700cc6f0 0x7fa8700ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.231+0000 7fa8769c7640 1 -- 172.21.15.79:0/874766126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa870145740 con 0x7fa87015cbf0 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.231+0000 7fa8761c6640 1 --2- 172.21.15.79:0/874766126 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa85c0051c0 0x7fa870145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.231+0000 7fa8769c7640 1 --2- 172.21.15.79:0/874766126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87015cbf0 0x7fa87015d070 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fa868001840 tx=0x7fa868001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.231+0000 7fa866ffd640 1 -- 172.21.15.79:0/874766126 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868001370 con 0x7fa87015cbf0 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.231+0000 7fa866ffd640 1 -- 172.21.15.79:0/874766126 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa868000ed0 con 0x7fa87015cbf0 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.231+0000 7fa87842a640 1 -- 172.21.15.79:0/874766126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87015d9b0 con 0x7fa87015cbf0 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.231+0000 7fa866ffd640 1 -- 172.21.15.79:0/874766126 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868007a30 con 0x7fa87015cbf0 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.231+0000 7fa87842a640 1 -- 172.21.15.79:0/874766126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87015df70 con 0x7fa87015cbf0 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.232+0000 7fa87842a640 1 -- 172.21.15.79:0/874766126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8700690a0 con 0x7fa87015cbf0 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.232+0000 7fa866ffd640 1 -- 172.21.15.79:0/874766126 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa86803b030 con 0x7fa87015cbf0 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.233+0000 7fa866ffd640 1 --2- 172.21.15.79:0/874766126 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa85406be60 0x7fa85406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.233+0000 7fa866ffd640 1 -- 172.21.15.79:0/874766126 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7fa8680a9a60 con 0x7fa87015cbf0 2024-04-25T02:18:09.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.233+0000 7fa8761c6640 1 --2- 172.21.15.79:0/874766126 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa85406be60 0x7fa85406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.233+0000 7fa8761c6640 1 --2- 172.21.15.79:0/874766126 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa85406be60 0x7fa85406e320 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa86c007520 tx=0x7fa86c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:09.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.237+0000 7fa866ffd640 1 -- 172.21.15.79:0/874766126 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa86802ae20 con 0x7fa87015cbf0 2024-04-25T02:18:09.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.409+0000 7fa87842a640 1 -- 172.21.15.79:0/874766126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa8700cf4f0 con 0x7fa87015cbf0 2024-04-25T02:18:09.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.409+0000 7fa866ffd640 1 -- 172.21.15.79:0/874766126 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v119) ==== 100+0+11 (secure 0 0 0) 0x7fa868077cd0 con 0x7fa87015cbf0 2024-04-25T02:18:09.414 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-04-25T02:18:09.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.411+0000 7fa87842a640 1 -- 172.21.15.79:0/874766126 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa85406be60 msgr2=0x7fa85406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.411+0000 7fa87842a640 1 --2- 172.21.15.79:0/874766126 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa85406be60 0x7fa85406e320 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa86c007520 tx=0x7fa86c00b040 comp rx=0 tx=0).stop 2024-04-25T02:18:09.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.411+0000 7fa87842a640 1 -- 172.21.15.79:0/874766126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87015cbf0 msgr2=0x7fa87015d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.411+0000 7fa87842a640 1 --2- 172.21.15.79:0/874766126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87015cbf0 0x7fa87015d070 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fa868001840 tx=0x7fa868001120 comp rx=0 tx=0).stop 2024-04-25T02:18:09.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.411+0000 7fa87842a640 1 -- 172.21.15.79:0/874766126 shutdown_connections 2024-04-25T02:18:09.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.411+0000 7fa87842a640 1 --2- 172.21.15.79:0/874766126 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa85406be60 0x7fa85406e320 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.411+0000 7fa87842a640 1 --2- 172.21.15.79:0/874766126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa87015cbf0 0x7fa87015d070 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.411+0000 7fa87842a640 1 --2- 172.21.15.79:0/874766126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8700cc6f0 0x7fa8700ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.411+0000 7fa87842a640 1 --2- 172.21.15.79:0/874766126 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa85c0051c0 0x7fa870145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.411+0000 7fa87842a640 1 -- 172.21.15.79:0/874766126 >> 172.21.15.79:0/874766126 conn(0x7fa8700b1cd0 msgr2=0x7fa8700b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:09.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.411+0000 7fa87842a640 1 -- 172.21.15.79:0/874766126 shutdown_connections 2024-04-25T02:18:09.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.411+0000 7fa87842a640 1 -- 172.21.15.79:0/874766126 wait complete. 2024-04-25T02:18:09.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:18:09.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.519+0000 7f679f963640 1 Processor -- start 2024-04-25T02:18:09.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.519+0000 7f679f963640 1 -- start start 2024-04-25T02:18:09.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.520+0000 7f679f963640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6798143bc0 0x7f679815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.520+0000 7f679f963640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f679806df50 0x7f679806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.520+0000 7f679f963640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f67980b48e0 0x7f67980b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.520+0000 7f679f963640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f679806e8f0 con 0x7f679806df50 2024-04-25T02:18:09.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.520+0000 7f679f963640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6798072cb0 con 0x7f67980b48e0 2024-04-25T02:18:09.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.520+0000 7f679f963640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f679815fa40 con 0x7f6798143bc0 2024-04-25T02:18:09.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.520+0000 7f679cefe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f679806df50 0x7f679806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.520+0000 7f679cefe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f679806df50 0x7f679806e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53290/0 (socket says 172.21.15.79:53290) 2024-04-25T02:18:09.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.520+0000 7f679cefe640 1 -- 172.21.15.79:0/1264137994 learned_addr learned my addr 172.21.15.79:0/1264137994 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:09.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.520+0000 7f679df00640 1 --2- 172.21.15.79:0/1264137994 >> v2:172.21.15.189:3300/0 conn(0x7f67980b48e0 0x7f67980b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.520+0000 7f679d6ff640 1 --2- 172.21.15.79:0/1264137994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6798143bc0 0x7f679815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.521+0000 7f679cefe640 1 -- 172.21.15.79:0/1264137994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6798143bc0 msgr2=0x7f679815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:09.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.521+0000 7f679cefe640 1 --2- 172.21.15.79:0/1264137994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6798143bc0 0x7f679815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.521+0000 7f679cefe640 1 -- 172.21.15.79:0/1264137994 >> v2:172.21.15.189:3300/0 conn(0x7f67980b48e0 msgr2=0x7f67980b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:09.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.521+0000 7f679cefe640 1 --2- 172.21.15.79:0/1264137994 >> v2:172.21.15.189:3300/0 conn(0x7f67980b48e0 0x7f67980b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.521+0000 7f679cefe640 1 -- 172.21.15.79:0/1264137994 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6798071e00 con 0x7f679806df50 2024-04-25T02:18:09.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.521+0000 7f679cefe640 1 --2- 172.21.15.79:0/1264137994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806df50 0x7f679806e3b0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f6798144de0 tx=0x7f678802c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c50b15a9a231d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:09.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.521+0000 7f678ffff640 1 -- 172.21.15.79:0/1264137994 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788032700 con 0x7f679806df50 2024-04-25T02:18:09.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.521+0000 7f678ffff640 1 -- 172.21.15.79:0/1264137994 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67880328a0 con 0x7f679806df50 2024-04-25T02:18:09.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.521+0000 7f678ffff640 1 -- 172.21.15.79:0/1264137994 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788032c70 con 0x7f679806df50 2024-04-25T02:18:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.522+0000 7f679f963640 1 -- 172.21.15.79:0/1264137994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806df50 msgr2=0x7f679806e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.522+0000 7f679f963640 1 --2- 172.21.15.79:0/1264137994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806df50 0x7f679806e3b0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f6798144de0 tx=0x7f678802c800 comp rx=0 tx=0).stop 2024-04-25T02:18:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.522+0000 7f679f963640 1 -- 172.21.15.79:0/1264137994 shutdown_connections 2024-04-25T02:18:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.522+0000 7f679f963640 1 --2- 172.21.15.79:0/1264137994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806df50 0x7f679806e3b0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.522+0000 7f679f963640 1 --2- 172.21.15.79:0/1264137994 >> v2:172.21.15.189:3300/0 conn(0x7f67980b48e0 0x7f67980b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.522+0000 7f679f963640 1 --2- 172.21.15.79:0/1264137994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6798143bc0 0x7f679815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.522+0000 7f679f963640 1 -- 172.21.15.79:0/1264137994 >> 172.21.15.79:0/1264137994 conn(0x7f67980cfc80 msgr2=0x7f67980d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.522+0000 7f679f963640 1 -- 172.21.15.79:0/1264137994 shutdown_connections 2024-04-25T02:18:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.522+0000 7f679f963640 1 -- 172.21.15.79:0/1264137994 wait complete. 2024-04-25T02:18:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.523+0000 7f679f963640 1 Processor -- start 2024-04-25T02:18:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.523+0000 7f679f963640 1 -- start start 2024-04-25T02:18:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f679f963640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806df50 0x7f67980aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f679f963640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67980b48e0 0x7f67981f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f679f963640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6798143bc0 0x7f6798159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f679f963640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6798072660 con 0x7f679806df50 2024-04-25T02:18:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f679f963640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6798072380 con 0x7f67980b48e0 2024-04-25T02:18:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f679f963640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6798072940 con 0x7f6798143bc0 2024-04-25T02:18:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f679d6ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806df50 0x7f67980aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f679d6ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806df50 0x7f67980aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53304/0 (socket says 172.21.15.79:53304) 2024-04-25T02:18:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f679d6ff640 1 -- 172.21.15.79:0/1453585448 learned_addr learned my addr 172.21.15.79:0/1453585448 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f679d6ff640 1 -- 172.21.15.79:0/1453585448 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6798143bc0 msgr2=0x7f6798159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f679d6ff640 1 --2- 172.21.15.79:0/1453585448 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6798143bc0 0x7f6798159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f679d6ff640 1 -- 172.21.15.79:0/1453585448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67980b48e0 msgr2=0x7f67981f3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f679d6ff640 1 --2- 172.21.15.79:0/1453585448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67980b48e0 0x7f67981f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f679d6ff640 1 -- 172.21.15.79:0/1453585448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67981f43a0 con 0x7f679806df50 2024-04-25T02:18:09.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f679d6ff640 1 --2- 172.21.15.79:0/1453585448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806df50 0x7f67980aefd0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f679400ce10 tx=0x7f679400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:09.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.524+0000 7f678dffb640 1 -- 172.21.15.79:0/1453585448 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794003b90 con 0x7f679806df50 2024-04-25T02:18:09.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.525+0000 7f678dffb640 1 -- 172.21.15.79:0/1453585448 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6794003d30 con 0x7f679806df50 2024-04-25T02:18:09.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.525+0000 7f678dffb640 1 -- 172.21.15.79:0/1453585448 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794004240 con 0x7f679806df50 2024-04-25T02:18:09.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.525+0000 7f679f963640 1 -- 172.21.15.79:0/1453585448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67981f4680 con 0x7f679806df50 2024-04-25T02:18:09.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.525+0000 7f679f963640 1 -- 172.21.15.79:0/1453585448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67981f4060 con 0x7f679806df50 2024-04-25T02:18:09.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.526+0000 7f679f963640 1 -- 172.21.15.79:0/1453585448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67980690a0 con 0x7f679806df50 2024-04-25T02:18:09.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.526+0000 7f678dffb640 1 -- 172.21.15.79:0/1453585448 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67940043e0 con 0x7f679806df50 2024-04-25T02:18:09.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.526+0000 7f678dffb640 1 --2- 172.21.15.79:0/1453585448 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f677c06be30 0x7f677c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.527+0000 7f679cefe640 1 --2- 172.21.15.79:0/1453585448 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f677c06be30 0x7f677c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.527+0000 7f678dffb640 1 -- 172.21.15.79:0/1453585448 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7f679408bb20 con 0x7f679806df50 2024-04-25T02:18:09.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.527+0000 7f679cefe640 1 --2- 172.21.15.79:0/1453585448 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f677c06be30 0x7f677c06e2f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6788037000 tx=0x7f6788036040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:09.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.531+0000 7f678dffb640 1 -- 172.21.15.79:0/1453585448 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f679401d340 con 0x7f679806df50 2024-04-25T02:18:09.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.739+0000 7f679f963640 1 -- 172.21.15.79:0/1453585448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67981f7260 con 0x7f679806df50 2024-04-25T02:18:09.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.739+0000 7f678dffb640 1 -- 172.21.15.79:0/1453585448 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5185 (secure 0 0 0) 0x7f679405a3e0 con 0x7f679806df50 2024-04-25T02:18:09.744 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:09.744 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3866997901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3866997901},{"type":"v1","addr":"172.21.15.189:6834","nonce":3866997901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/167225705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":167225705},{"type":"v1","addr":"172.21.15.189:6835","nonce":167225705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8916,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3734112703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3734112703},{"type":"v1","addr":"172.21.15.79:6835","nonce":3734112703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:17:33.960191+0000","modified":"2024-04-25T02:18:02.586727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"a","rank":0,"incarnation":93,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/623571175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":623571175},{"type":"v1","addr":"172.21.15.79:6837","nonce":623571175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":8}]} 2024-04-25T02:18:09.744 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 96 2024-04-25T02:18:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.741+0000 7f679f963640 1 -- 172.21.15.79:0/1453585448 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f677c06be30 msgr2=0x7f677c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.741+0000 7f679f963640 1 --2- 172.21.15.79:0/1453585448 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f677c06be30 0x7f677c06e2f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6788037000 tx=0x7f6788036040 comp rx=0 tx=0).stop 2024-04-25T02:18:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.741+0000 7f679f963640 1 -- 172.21.15.79:0/1453585448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806df50 msgr2=0x7f67980aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.741+0000 7f679f963640 1 --2- 172.21.15.79:0/1453585448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806df50 0x7f67980aefd0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f679400ce10 tx=0x7f679400a660 comp rx=0 tx=0).stop 2024-04-25T02:18:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.741+0000 7f679f963640 1 -- 172.21.15.79:0/1453585448 shutdown_connections 2024-04-25T02:18:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.741+0000 7f679f963640 1 --2- 172.21.15.79:0/1453585448 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f677c06be30 0x7f677c06e2f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.741+0000 7f679f963640 1 --2- 172.21.15.79:0/1453585448 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6798143bc0 0x7f6798159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.741+0000 7f679f963640 1 --2- 172.21.15.79:0/1453585448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67980b48e0 0x7f67981f3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.741+0000 7f679f963640 1 --2- 172.21.15.79:0/1453585448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f679806df50 0x7f67980aefd0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.741+0000 7f679f963640 1 -- 172.21.15.79:0/1453585448 >> 172.21.15.79:0/1453585448 conn(0x7f67980cfc80 msgr2=0x7f679806cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:09.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.741+0000 7f679f963640 1 -- 172.21.15.79:0/1453585448 shutdown_connections 2024-04-25T02:18:09.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.741+0000 7f679f963640 1 -- 172.21.15.79:0/1453585448 wait complete. 2024-04-25T02:18:09.756 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:18:09.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.849+0000 7fa7b5777640 1 Processor -- start 2024-04-25T02:18:09.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.849+0000 7fa7b5777640 1 -- start start 2024-04-25T02:18:09.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.850+0000 7fa7b5777640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa7b006cbd0 0x7fa7b006c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.850+0000 7fa7b5777640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7b006cfb0 0x7fa7b0161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.850+0000 7fa7b5777640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b00b1d20 con 0x7fa7b00d00d0 2024-04-25T02:18:09.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.850+0000 7fa7b5777640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b0162620 con 0x7fa7b006cfb0 2024-04-25T02:18:09.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.850+0000 7fa7b5777640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b0162900 con 0x7fa7b006cbd0 2024-04-25T02:18:09.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.850+0000 7fa7ae7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7b006cfb0 0x7fa7b0161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.850+0000 7fa7ae7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7b006cfb0 0x7fa7b0161df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53312/0 (socket says 172.21.15.79:53312) 2024-04-25T02:18:09.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.850+0000 7fa7ae7fc640 1 -- 172.21.15.79:0/1613680438 learned_addr learned my addr 172.21.15.79:0/1613680438 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:09.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.850+0000 7fa7aeffd640 1 --2- 172.21.15.79:0/1613680438 >> v2:172.21.15.189:3300/0 conn(0x7fa7b006cbd0 0x7fa7b006c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.850+0000 7fa7ae7fc640 1 -- 172.21.15.79:0/1613680438 >> v2:172.21.15.189:3300/0 conn(0x7fa7b006cbd0 msgr2=0x7fa7b006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:09.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.850+0000 7fa7ae7fc640 1 --2- 172.21.15.79:0/1613680438 >> v2:172.21.15.189:3300/0 conn(0x7fa7b006cbd0 0x7fa7b006c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.850+0000 7fa7ae7fc640 1 -- 172.21.15.79:0/1613680438 >> v1:172.21.15.189:6789/0 conn(0x7fa7b00d00d0 legacy=0x7fa7b00b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:09.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.850+0000 7fa7ae7fc640 1 -- 172.21.15.79:0/1613680438 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b0162be0 con 0x7fa7b006cfb0 2024-04-25T02:18:09.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.851+0000 7fa7ae7fc640 1 --2- 172.21.15.79:0/1613680438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b006cfb0 0x7fa7b0161df0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00731c0 tx=0x7fa7a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8266c05648a44e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:09.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.851+0000 7fa7adffb640 1 -- 172.21.15.79:0/1613680438 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4037070 con 0x7fa7b006cfb0 2024-04-25T02:18:09.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.851+0000 7fa7adffb640 1 -- 172.21.15.79:0/1613680438 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a4032440 con 0x7fa7b006cfb0 2024-04-25T02:18:09.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.851+0000 7fa7adffb640 1 -- 172.21.15.79:0/1613680438 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4032810 con 0x7fa7b006cfb0 2024-04-25T02:18:09.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.852+0000 7fa7b5777640 1 -- 172.21.15.79:0/1613680438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b006cfb0 msgr2=0x7fa7b0161df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.852+0000 7fa7b5777640 1 --2- 172.21.15.79:0/1613680438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b006cfb0 0x7fa7b0161df0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00731c0 tx=0x7fa7a402a1a0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.852+0000 7fa7b5777640 1 -- 172.21.15.79:0/1613680438 shutdown_connections 2024-04-25T02:18:09.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.852+0000 7fa7b5777640 1 --2- 172.21.15.79:0/1613680438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b006cfb0 0x7fa7b0161df0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.852+0000 7fa7b5777640 1 --2- 172.21.15.79:0/1613680438 >> v2:172.21.15.189:3300/0 conn(0x7fa7b006cbd0 0x7fa7b006c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.852+0000 7fa7b5777640 1 -- 172.21.15.79:0/1613680438 >> 172.21.15.79:0/1613680438 conn(0x7fa7b009aa70 msgr2=0x7fa7b009ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:09.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.852+0000 7fa7b5777640 1 -- 172.21.15.79:0/1613680438 shutdown_connections 2024-04-25T02:18:09.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.852+0000 7fa7b5777640 1 -- 172.21.15.79:0/1613680438 wait complete. 2024-04-25T02:18:09.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.853+0000 7fa7b5777640 1 Processor -- start 2024-04-25T02:18:09.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.853+0000 7fa7b5777640 1 -- start start 2024-04-25T02:18:09.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7b5777640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7b006cbd0 0x7fa7b0160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7b5777640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa7b006cfb0 0x7fa7b00b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7b5777640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b00d00d0 0x7fa7b00b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7b5777640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b015e600 con 0x7fa7b00d00d0 2024-04-25T02:18:09.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7b5777640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b0162330 con 0x7fa7b006cbd0 2024-04-25T02:18:09.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7b5777640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b006d410 con 0x7fa7b006cfb0 2024-04-25T02:18:09.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7af7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b00d00d0 0x7fa7b00b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7af7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b00d00d0 0x7fa7b00b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53320/0 (socket says 172.21.15.79:53320) 2024-04-25T02:18:09.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7af7fe640 1 -- 172.21.15.79:0/1639822163 learned_addr learned my addr 172.21.15.79:0/1639822163 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:09.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7aeffd640 1 --2- 172.21.15.79:0/1639822163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7b006cbd0 0x7fa7b0160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7ae7fc640 1 --2- 172.21.15.79:0/1639822163 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa7b006cfb0 0x7fa7b00b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7af7fe640 1 -- 172.21.15.79:0/1639822163 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa7b006cfb0 msgr2=0x7fa7b00b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7af7fe640 1 --2- 172.21.15.79:0/1639822163 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa7b006cfb0 0x7fa7b00b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7af7fe640 1 -- 172.21.15.79:0/1639822163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7b006cbd0 msgr2=0x7fa7b0160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:09.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7af7fe640 1 --2- 172.21.15.79:0/1639822163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7b006cbd0 0x7fa7b0160ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:09.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7af7fe640 1 -- 172.21.15.79:0/1639822163 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b01f45d0 con 0x7fa7b00d00d0 2024-04-25T02:18:09.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7aeffd640 1 --2- 172.21.15.79:0/1639822163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7b006cbd0 0x7fa7b0160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:09.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7af7fe640 1 --2- 172.21.15.79:0/1639822163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b00d00d0 0x7fa7b00b2a40 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800c780 tx=0x7fa7a800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:09.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7977fe640 1 -- 172.21.15.79:0/1639822163 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8004b60 con 0x7fa7b00d00d0 2024-04-25T02:18:09.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7977fe640 1 -- 172.21.15.79:0/1639822163 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a8004d00 con 0x7fa7b00d00d0 2024-04-25T02:18:09.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7b5777640 1 -- 172.21.15.79:0/1639822163 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b01f48b0 con 0x7fa7b00d00d0 2024-04-25T02:18:09.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7977fe640 1 -- 172.21.15.79:0/1639822163 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a800aa90 con 0x7fa7b00d00d0 2024-04-25T02:18:09.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.854+0000 7fa7b5777640 1 -- 172.21.15.79:0/1639822163 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b01f4e70 con 0x7fa7b00d00d0 2024-04-25T02:18:09.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.855+0000 7fa7b5777640 1 -- 172.21.15.79:0/1639822163 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b00690a0 con 0x7fa7b00d00d0 2024-04-25T02:18:09.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.856+0000 7fa7977fe640 1 -- 172.21.15.79:0/1639822163 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7a800ac30 con 0x7fa7b00d00d0 2024-04-25T02:18:09.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.856+0000 7fa7977fe640 1 --2- 172.21.15.79:0/1639822163 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa79c06be30 0x7fa79c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:09.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.856+0000 7fa7977fe640 1 -- 172.21.15.79:0/1639822163 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7fa7a808b290 con 0x7fa7b00d00d0 2024-04-25T02:18:09.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.856+0000 7fa7aeffd640 1 --2- 172.21.15.79:0/1639822163 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa79c06be30 0x7fa79c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:09.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.857+0000 7fa7aeffd640 1 --2- 172.21.15.79:0/1639822163 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa79c06be30 0x7fa79c06e2f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0157eb0 tx=0x7fa7a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:09.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:09.861+0000 7fa7977fe640 1 -- 172.21.15.79:0/1639822163 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa7a8020070 con 0x7fa7b00d00d0 2024-04-25T02:18:10.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.037+0000 7fa7b5777640 1 -- 172.21.15.79:0/1639822163 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7b00b7d20 con 0x7fa7b00d00d0 2024-04-25T02:18:10.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.038+0000 7fa7977fe640 1 -- 172.21.15.79:0/1639822163 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16991 (secure 0 0 0) 0x7fa7a8059b50 con 0x7fa7b00d00d0 2024-04-25T02:18:10.043 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:10.043 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":119,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:17:57.569985+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:17:32.207579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T02:17:32.929915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.b","mappings":[{"from":0,"to":2}]},{"pgid":"17.34","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/3097428733":"2024-04-26T02:17:57.569963+0000","172.21.15.79:6836/3097428733":"2024-04-26T02:17:57.569963+0000","172.21.15.79:6837/2134535107":"2024-04-26T02:17:47.006917+0000","172.21.15.79:6836/2134535107":"2024-04-26T02:17:47.006917+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:18:10.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.040+0000 7fa7b5777640 1 -- 172.21.15.79:0/1639822163 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa79c06be30 msgr2=0x7fa79c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.040+0000 7fa7b5777640 1 --2- 172.21.15.79:0/1639822163 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa79c06be30 0x7fa79c06e2f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0157eb0 tx=0x7fa7a0008040 comp rx=0 tx=0).stop 2024-04-25T02:18:10.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.040+0000 7fa7b5777640 1 -- 172.21.15.79:0/1639822163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b00d00d0 msgr2=0x7fa7b00b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.040+0000 7fa7b5777640 1 --2- 172.21.15.79:0/1639822163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b00d00d0 0x7fa7b00b2a40 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800c780 tx=0x7fa7a800cc40 comp rx=0 tx=0).stop 2024-04-25T02:18:10.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.040+0000 7fa7b5777640 1 -- 172.21.15.79:0/1639822163 shutdown_connections 2024-04-25T02:18:10.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.040+0000 7fa7b5777640 1 --2- 172.21.15.79:0/1639822163 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa79c06be30 0x7fa79c06e2f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.040+0000 7fa7b5777640 1 --2- 172.21.15.79:0/1639822163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b00d00d0 0x7fa7b00b2a40 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.040+0000 7fa7b5777640 1 --2- 172.21.15.79:0/1639822163 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa7b006cfb0 0x7fa7b00b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.040+0000 7fa7b5777640 1 --2- 172.21.15.79:0/1639822163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7b006cbd0 0x7fa7b0160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.040+0000 7fa7b5777640 1 -- 172.21.15.79:0/1639822163 >> 172.21.15.79:0/1639822163 conn(0x7fa7b009aa70 msgr2=0x7fa7b00d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:10.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.040+0000 7fa7b5777640 1 -- 172.21.15.79:0/1639822163 shutdown_connections 2024-04-25T02:18:10.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.040+0000 7fa7b5777640 1 -- 172.21.15.79:0/1639822163 wait complete. 2024-04-25T02:18:10.055 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:18:10.056 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:18:10.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.148+0000 7f05b94cd640 1 Processor -- start 2024-04-25T02:18:10.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.148+0000 7f05b94cd640 1 -- start start 2024-04-25T02:18:10.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.149+0000 7f05b94cd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f05b40d2da0 0x7f05b40d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.149+0000 7f05b94cd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05b40d0a60 0x7f05b40d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.149+0000 7f05b94cd640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05b40ceed0 con 0x7f05b4161b90 2024-04-25T02:18:10.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.149+0000 7f05b94cd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f05b40d1410 con 0x7f05b40d2da0 2024-04-25T02:18:10.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.149+0000 7f05b94cd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f05b40ceca0 con 0x7f05b40d0a60 2024-04-25T02:18:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.149+0000 7f05abfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f05b40d2da0 0x7f05b40d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.149+0000 7f05abfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f05b40d2da0 0x7f05b40d47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53324/0 (socket says 172.21.15.79:53324) 2024-04-25T02:18:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.149+0000 7f05abfff640 1 -- 172.21.15.79:0/4293930278 learned_addr learned my addr 172.21.15.79:0/4293930278 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.149+0000 7f05b37fe640 1 --2- 172.21.15.79:0/4293930278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05b40d0a60 0x7f05b40d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.149+0000 7f05abfff640 1 -- 172.21.15.79:0/4293930278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05b40d0a60 msgr2=0x7f05b40d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.149+0000 7f05abfff640 1 --2- 172.21.15.79:0/4293930278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05b40d0a60 0x7f05b40d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.149+0000 7f05abfff640 1 -- 172.21.15.79:0/4293930278 >> v1:172.21.15.189:6789/0 conn(0x7f05b4161b90 legacy=0x7f05b40cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.149+0000 7f05abfff640 1 -- 172.21.15.79:0/4293930278 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b40cf1b0 con 0x7f05b40d2da0 2024-04-25T02:18:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.149+0000 7f05b37fe640 1 --2- 172.21.15.79:0/4293930278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05b40d0a60 0x7f05b40d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.150+0000 7f05abfff640 1 --2- 172.21.15.79:0/4293930278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40d2da0 0x7f05b40d47e0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f059c009870 tx=0x7f059c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d17a9c424b816cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.150+0000 7f05b27fc640 1 -- 172.21.15.79:0/4293930278 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c037070 con 0x7f05b40d2da0 2024-04-25T02:18:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.150+0000 7f05b27fc640 1 -- 172.21.15.79:0/4293930278 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059c032440 con 0x7f05b40d2da0 2024-04-25T02:18:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.150+0000 7f05b27fc640 1 -- 172.21.15.79:0/4293930278 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c032810 con 0x7f05b40d2da0 2024-04-25T02:18:10.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.151+0000 7f05b94cd640 1 -- 172.21.15.79:0/4293930278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40d2da0 msgr2=0x7f05b40d47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.151+0000 7f05b94cd640 1 --2- 172.21.15.79:0/4293930278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40d2da0 0x7f05b40d47e0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f059c009870 tx=0x7f059c02a210 comp rx=0 tx=0).stop 2024-04-25T02:18:10.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.151+0000 7f05b94cd640 1 -- 172.21.15.79:0/4293930278 shutdown_connections 2024-04-25T02:18:10.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.151+0000 7f05b94cd640 1 --2- 172.21.15.79:0/4293930278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05b40d0a60 0x7f05b40d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.151+0000 7f05b94cd640 1 --2- 172.21.15.79:0/4293930278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40d2da0 0x7f05b40d47e0 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.151+0000 7f05b94cd640 1 -- 172.21.15.79:0/4293930278 >> 172.21.15.79:0/4293930278 conn(0x7f05b409d460 msgr2=0x7f05b40d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:10.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.151+0000 7f05b94cd640 1 -- 172.21.15.79:0/4293930278 shutdown_connections 2024-04-25T02:18:10.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.151+0000 7f05b94cd640 1 -- 172.21.15.79:0/4293930278 wait complete. 2024-04-25T02:18:10.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.152+0000 7f05b94cd640 1 Processor -- start 2024-04-25T02:18:10.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.152+0000 7f05b94cd640 1 -- start start 2024-04-25T02:18:10.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05b94cd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05b40d0a60 0x7f05b4151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05b94cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40d2da0 0x7f05b41601d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05b94cd640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05b4161b90 0x7f05b4160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05b94cd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05b40d4d20 con 0x7f05b40d2da0 2024-04-25T02:18:10.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05b94cd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f05b40d4f80 con 0x7f05b40d0a60 2024-04-25T02:18:10.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05b94cd640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f05b40cf770 con 0x7f05b4161b90 2024-04-25T02:18:10.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05abfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40d2da0 0x7f05b41601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05abfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40d2da0 0x7f05b41601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53326/0 (socket says 172.21.15.79:53326) 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05abfff640 1 -- 172.21.15.79:0/4036281538 learned_addr learned my addr 172.21.15.79:0/4036281538 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05b2ffd640 1 --2- 172.21.15.79:0/4036281538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05b40d0a60 0x7f05b4151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05b37fe640 1 --2- 172.21.15.79:0/4036281538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05b4161b90 0x7f05b4160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05abfff640 1 -- 172.21.15.79:0/4036281538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05b4161b90 msgr2=0x7f05b4160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05abfff640 1 --2- 172.21.15.79:0/4036281538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05b4161b90 0x7f05b4160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05abfff640 1 -- 172.21.15.79:0/4036281538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05b40d0a60 msgr2=0x7f05b4151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05abfff640 1 --2- 172.21.15.79:0/4036281538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05b40d0a60 0x7f05b4151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05abfff640 1 -- 172.21.15.79:0/4036281538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b40c7c00 con 0x7f05b40d2da0 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05abfff640 1 --2- 172.21.15.79:0/4036281538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40d2da0 0x7f05b41601d0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f059c009870 tx=0x7f059c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05ab7fe640 1 -- 172.21.15.79:0/4036281538 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c041020 con 0x7f05b40d2da0 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05ab7fe640 1 -- 172.21.15.79:0/4036281538 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059c030970 con 0x7f05b40d2da0 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05b94cd640 1 -- 172.21.15.79:0/4036281538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b40c7ee0 con 0x7f05b40d2da0 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05ab7fe640 1 -- 172.21.15.79:0/4036281538 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c037040 con 0x7f05b40d2da0 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.153+0000 7f05b94cd640 1 -- 172.21.15.79:0/4036281538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b41f4330 con 0x7f05b40d2da0 2024-04-25T02:18:10.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.154+0000 7f05b94cd640 1 -- 172.21.15.79:0/4036281538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b40c8400 con 0x7f05b40d2da0 2024-04-25T02:18:10.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.155+0000 7f05ab7fe640 1 -- 172.21.15.79:0/4036281538 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f059c044020 con 0x7f05b40d2da0 2024-04-25T02:18:10.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.155+0000 7f05ab7fe640 1 --2- 172.21.15.79:0/4036281538 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f059406be30 0x7f059406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.155+0000 7f05ab7fe640 1 -- 172.21.15.79:0/4036281538 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7f059c0ab800 con 0x7f05b40d2da0 2024-04-25T02:18:10.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.155+0000 7f05b2ffd640 1 --2- 172.21.15.79:0/4036281538 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f059406be30 0x7f059406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.156+0000 7f05b2ffd640 1 --2- 172.21.15.79:0/4036281538 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f059406be30 0x7f059406e2f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f05b41615a0 tx=0x7f05a4009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:10.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.160+0000 7f05ab7fe640 1 -- 172.21.15.79:0/4036281538 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f059c04b030 con 0x7f05b40d2da0 2024-04-25T02:18:10.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.367+0000 7f05b94cd640 1 -- 172.21.15.79:0/4036281538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05b40690a0 con 0x7f05b40d2da0 2024-04-25T02:18:10.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.367+0000 7f05ab7fe640 1 -- 172.21.15.79:0/4036281538 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5185 (secure 0 0 0) 0x7f059c07a150 con 0x7f05b40d2da0 2024-04-25T02:18:10.372 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:10.372 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3866997901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3866997901},{"type":"v1","addr":"172.21.15.189:6834","nonce":3866997901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/167225705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":167225705},{"type":"v1","addr":"172.21.15.189:6835","nonce":167225705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8916,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3734112703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3734112703},{"type":"v1","addr":"172.21.15.79:6835","nonce":3734112703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:17:33.960191+0000","modified":"2024-04-25T02:18:02.586727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"a","rank":0,"incarnation":93,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/623571175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":623571175},{"type":"v1","addr":"172.21.15.79:6837","nonce":623571175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":8}]} 2024-04-25T02:18:10.372 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 96 2024-04-25T02:18:10.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.369+0000 7f05b94cd640 1 -- 172.21.15.79:0/4036281538 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f059406be30 msgr2=0x7f059406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.369+0000 7f05b94cd640 1 --2- 172.21.15.79:0/4036281538 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f059406be30 0x7f059406e2f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f05b41615a0 tx=0x7f05a4009060 comp rx=0 tx=0).stop 2024-04-25T02:18:10.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.369+0000 7f05b94cd640 1 -- 172.21.15.79:0/4036281538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40d2da0 msgr2=0x7f05b41601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.369+0000 7f05b94cd640 1 --2- 172.21.15.79:0/4036281538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40d2da0 0x7f05b41601d0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f059c009870 tx=0x7f059c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.370+0000 7f05b94cd640 1 -- 172.21.15.79:0/4036281538 shutdown_connections 2024-04-25T02:18:10.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.370+0000 7f05b94cd640 1 --2- 172.21.15.79:0/4036281538 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f059406be30 0x7f059406e2f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.370+0000 7f05b94cd640 1 --2- 172.21.15.79:0/4036281538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05b4161b90 0x7f05b4160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.370+0000 7f05b94cd640 1 --2- 172.21.15.79:0/4036281538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40d2da0 0x7f05b41601d0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.370+0000 7f05b94cd640 1 --2- 172.21.15.79:0/4036281538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05b40d0a60 0x7f05b4151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.370+0000 7f05b94cd640 1 -- 172.21.15.79:0/4036281538 >> 172.21.15.79:0/4036281538 conn(0x7f05b409d460 msgr2=0x7f05b40b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:10.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.370+0000 7f05b94cd640 1 -- 172.21.15.79:0/4036281538 shutdown_connections 2024-04-25T02:18:10.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.370+0000 7f05b94cd640 1 -- 172.21.15.79:0/4036281538 wait complete. 2024-04-25T02:18:10.385 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:18:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.476+0000 7f2eee08c640 1 Processor -- start 2024-04-25T02:18:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.476+0000 7f2eee08c640 1 -- start start 2024-04-25T02:18:10.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.477+0000 7f2eee08c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee815e140 0x7f2ee8066ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.477+0000 7f2eee08c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2ee806b0b0 0x7f2ee80c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.477+0000 7f2eee08c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee80cea70 con 0x7f2ee815e520 2024-04-25T02:18:10.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.477+0000 7f2eee08c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee8067480 con 0x7f2ee806b0b0 2024-04-25T02:18:10.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.477+0000 7f2eee08c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee80cf3a0 con 0x7f2ee815e140 2024-04-25T02:18:10.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.477+0000 7f2ee7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2ee806b0b0 0x7f2ee80c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.477+0000 7f2ee7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2ee806b0b0 0x7f2ee80c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53342/0 (socket says 172.21.15.79:53342) 2024-04-25T02:18:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.477+0000 7f2ee7fff640 1 -- 172.21.15.79:0/3241815395 learned_addr learned my addr 172.21.15.79:0/3241815395 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.477+0000 7f2ee77fe640 1 --2- 172.21.15.79:0/3241815395 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee815e140 0x7f2ee8066ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.477+0000 7f2ee7fff640 1 -- 172.21.15.79:0/3241815395 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee815e140 msgr2=0x7f2ee8066ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.477+0000 7f2ee7fff640 1 --2- 172.21.15.79:0/3241815395 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee815e140 0x7f2ee8066ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.477+0000 7f2ee7fff640 1 -- 172.21.15.79:0/3241815395 >> v1:172.21.15.189:6789/0 conn(0x7f2ee815e520 legacy=0x7f2ee80af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.477+0000 7f2ee7fff640 1 -- 172.21.15.79:0/3241815395 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee80ced50 con 0x7f2ee806b0b0 2024-04-25T02:18:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.478+0000 7f2ee7fff640 1 --2- 172.21.15.79:0/3241815395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee806b0b0 0x7f2ee80c97b0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009e50 tx=0x7f2ee002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab534deaa6f64236 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.478+0000 7f2ee6ffd640 1 -- 172.21.15.79:0/3241815395 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0036070 con 0x7f2ee806b0b0 2024-04-25T02:18:10.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.478+0000 7f2ee6ffd640 1 -- 172.21.15.79:0/3241815395 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee0031600 con 0x7f2ee806b0b0 2024-04-25T02:18:10.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.478+0000 7f2ee6ffd640 1 -- 172.21.15.79:0/3241815395 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee00319d0 con 0x7f2ee806b0b0 2024-04-25T02:18:10.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.478+0000 7f2eee08c640 1 -- 172.21.15.79:0/3241815395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee806b0b0 msgr2=0x7f2ee80c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.478+0000 7f2eee08c640 1 --2- 172.21.15.79:0/3241815395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee806b0b0 0x7f2ee80c97b0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009e50 tx=0x7f2ee002a630 comp rx=0 tx=0).stop 2024-04-25T02:18:10.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.478+0000 7f2eee08c640 1 -- 172.21.15.79:0/3241815395 shutdown_connections 2024-04-25T02:18:10.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.478+0000 7f2eee08c640 1 --2- 172.21.15.79:0/3241815395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee806b0b0 0x7f2ee80c97b0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.478+0000 7f2eee08c640 1 --2- 172.21.15.79:0/3241815395 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee815e140 0x7f2ee8066ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.478+0000 7f2eee08c640 1 -- 172.21.15.79:0/3241815395 >> 172.21.15.79:0/3241815395 conn(0x7f2ee80ccee0 msgr2=0x7f2ee80cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:10.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.479+0000 7f2eee08c640 1 -- 172.21.15.79:0/3241815395 shutdown_connections 2024-04-25T02:18:10.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.479+0000 7f2eee08c640 1 -- 172.21.15.79:0/3241815395 wait complete. 2024-04-25T02:18:10.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.480+0000 7f2eee08c640 1 Processor -- start 2024-04-25T02:18:10.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.480+0000 7f2eee08c640 1 -- start start 2024-04-25T02:18:10.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.480+0000 7f2eee08c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ee806b0b0 0x7f2ee80b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.480+0000 7f2eee08c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee815e140 0x7f2ee8156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.480+0000 7f2eee08c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee815e520 0x7f2ee8151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.480+0000 7f2eee08c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee806b690 con 0x7f2ee815e520 2024-04-25T02:18:10.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.480+0000 7f2eee08c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee806b510 con 0x7f2ee806b0b0 2024-04-25T02:18:10.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.480+0000 7f2eee08c640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee806b810 con 0x7f2ee815e140 2024-04-25T02:18:10.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee815e520 0x7f2ee8151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee815e520 0x7f2ee8151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53348/0 (socket says 172.21.15.79:53348) 2024-04-25T02:18:10.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2ee7fff640 1 -- 172.21.15.79:0/3798851213 learned_addr learned my addr 172.21.15.79:0/3798851213 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:10.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2ee77fe640 1 --2- 172.21.15.79:0/3798851213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ee806b0b0 0x7f2ee80b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2edeffd640 1 --2- 172.21.15.79:0/3798851213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee815e140 0x7f2ee8156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2ee7fff640 1 -- 172.21.15.79:0/3798851213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee815e140 msgr2=0x7f2ee8156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2ee7fff640 1 --2- 172.21.15.79:0/3798851213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee815e140 0x7f2ee8156f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2ee7fff640 1 -- 172.21.15.79:0/3798851213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ee806b0b0 msgr2=0x7f2ee80b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2ee7fff640 1 --2- 172.21.15.79:0/3798851213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ee806b0b0 0x7f2ee80b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2ee7fff640 1 -- 172.21.15.79:0/3798851213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee8160330 con 0x7f2ee815e520 2024-04-25T02:18:10.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2ee7fff640 1 --2- 172.21.15.79:0/3798851213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee815e520 0x7f2ee8151820 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009f70 tx=0x7f2ee0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:10.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2ee4ff9640 1 -- 172.21.15.79:0/3798851213 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0036050 con 0x7f2ee815e520 2024-04-25T02:18:10.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2ee4ff9640 1 -- 172.21.15.79:0/3798851213 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee0042070 con 0x7f2ee815e520 2024-04-25T02:18:10.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2eee08c640 1 -- 172.21.15.79:0/3798851213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee8160610 con 0x7f2ee815e520 2024-04-25T02:18:10.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2ee4ff9640 1 -- 172.21.15.79:0/3798851213 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0009510 con 0x7f2ee815e520 2024-04-25T02:18:10.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.481+0000 7f2eee08c640 1 -- 172.21.15.79:0/3798851213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee80b35e0 con 0x7f2ee815e520 2024-04-25T02:18:10.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.482+0000 7f2eee08c640 1 -- 172.21.15.79:0/3798851213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee80cda10 con 0x7f2ee815e520 2024-04-25T02:18:10.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.483+0000 7f2ee4ff9640 1 -- 172.21.15.79:0/3798851213 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ee0007bd0 con 0x7f2ee815e520 2024-04-25T02:18:10.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.483+0000 7f2ee4ff9640 1 --2- 172.21.15.79:0/3798851213 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ec806be30 0x7f2ec806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.483+0000 7f2ee77fe640 1 --2- 172.21.15.79:0/3798851213 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ec806be30 0x7f2ec806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.483+0000 7f2ee4ff9640 1 -- 172.21.15.79:0/3798851213 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7f2ee00abdf0 con 0x7f2ee815e520 2024-04-25T02:18:10.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.484+0000 7f2ee77fe640 1 --2- 172.21.15.79:0/3798851213 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ec806be30 0x7f2ec806e2f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8006fd0 tx=0x7f2ed8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:10.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.488+0000 7f2ee4ff9640 1 -- 172.21.15.79:0/3798851213 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2ee80cda10 con 0x7f2ee815e520 2024-04-25T02:18:10.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.698+0000 7f2eee08c640 1 -- 172.21.15.79:0/3798851213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ee80690a0 con 0x7f2ee815e520 2024-04-25T02:18:10.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.699+0000 7f2ee4ff9640 1 -- 172.21.15.79:0/3798851213 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5185 (secure 0 0 0) 0x7f2ee007a740 con 0x7f2ee815e520 2024-04-25T02:18:10.703 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:10.703 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3866997901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3866997901},{"type":"v1","addr":"172.21.15.189:6834","nonce":3866997901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/167225705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":167225705},{"type":"v1","addr":"172.21.15.189:6835","nonce":167225705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8916,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3734112703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3734112703},{"type":"v1","addr":"172.21.15.79:6835","nonce":3734112703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:17:33.960191+0000","modified":"2024-04-25T02:18:02.586727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"a","rank":0,"incarnation":93,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/623571175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":623571175},{"type":"v1","addr":"172.21.15.79:6837","nonce":623571175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":8}]} 2024-04-25T02:18:10.703 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 96 2024-04-25T02:18:10.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.700+0000 7f2eee08c640 1 -- 172.21.15.79:0/3798851213 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ec806be30 msgr2=0x7f2ec806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.700+0000 7f2eee08c640 1 --2- 172.21.15.79:0/3798851213 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ec806be30 0x7f2ec806e2f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8006fd0 tx=0x7f2ed8008040 comp rx=0 tx=0).stop 2024-04-25T02:18:10.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.700+0000 7f2eee08c640 1 -- 172.21.15.79:0/3798851213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee815e520 msgr2=0x7f2ee8151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.700+0000 7f2eee08c640 1 --2- 172.21.15.79:0/3798851213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee815e520 0x7f2ee8151820 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009f70 tx=0x7f2ee0004a40 comp rx=0 tx=0).stop 2024-04-25T02:18:10.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.701+0000 7f2eee08c640 1 -- 172.21.15.79:0/3798851213 shutdown_connections 2024-04-25T02:18:10.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.701+0000 7f2eee08c640 1 --2- 172.21.15.79:0/3798851213 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f2ec806be30 0x7f2ec806e2f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.701+0000 7f2eee08c640 1 --2- 172.21.15.79:0/3798851213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ee815e520 0x7f2ee8151820 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.701+0000 7f2eee08c640 1 --2- 172.21.15.79:0/3798851213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ee815e140 0x7f2ee8156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.701+0000 7f2eee08c640 1 --2- 172.21.15.79:0/3798851213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ee806b0b0 0x7f2ee80b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.701+0000 7f2eee08c640 1 -- 172.21.15.79:0/3798851213 >> 172.21.15.79:0/3798851213 conn(0x7f2ee80ccee0 msgr2=0x7f2ee80cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:10.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.701+0000 7f2eee08c640 1 -- 172.21.15.79:0/3798851213 shutdown_connections 2024-04-25T02:18:10.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.701+0000 7f2eee08c640 1 -- 172.21.15.79:0/3798851213 wait complete. 2024-04-25T02:18:10.716 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:18:10.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.808+0000 7fceb61f9640 1 Processor -- start 2024-04-25T02:18:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.808+0000 7fceb61f9640 1 -- start start 2024-04-25T02:18:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.809+0000 7fceb61f9640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fceb006df50 0x7fceb006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.809+0000 7fceb61f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb00b2d30 0x7fceb00b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.809+0000 7fceb61f9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceb0071e00 con 0x7fceb0143bc0 2024-04-25T02:18:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.809+0000 7fceb61f9640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fceb006e8f0 con 0x7fceb006df50 2024-04-25T02:18:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.809+0000 7fceb61f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fceb0072cb0 con 0x7fceb00b2d30 2024-04-25T02:18:10.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.809+0000 7fceaeffd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fceb006df50 0x7fceb006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.809+0000 7fceaffff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb00b2d30 0x7fceb00b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.810+0000 7fceaeffd640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fceb006df50 0x7fceb006e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:48906/0 (socket says 172.21.15.79:48906) 2024-04-25T02:18:10.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.810+0000 7fceaf7fe640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fceb0143bc0 0x7fceb015f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:34806/0 (socket says 172.21.15.79:34806) 2024-04-25T02:18:10.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.810+0000 7fceaffff640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb00b2d30 0x7fceb00b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:45156/0 (socket says 172.21.15.79:45156) 2024-04-25T02:18:10.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.810+0000 7fceaeffd640 1 -- 172.21.15.79:0/1838173458 learned_addr learned my addr 172.21.15.79:0/1838173458 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:10.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.810+0000 7fceaeffd640 1 -- 172.21.15.79:0/1838173458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb00b2d30 msgr2=0x7fceb00b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:10.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.810+0000 7fceaeffd640 1 --2- 172.21.15.79:0/1838173458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb00b2d30 0x7fceb00b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.810+0000 7fceaeffd640 1 -- 172.21.15.79:0/1838173458 >> v1:172.21.15.189:6789/0 conn(0x7fceb0143bc0 legacy=0x7fceb015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.810+0000 7fceaeffd640 1 -- 172.21.15.79:0/1838173458 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb00720a0 con 0x7fceb006df50 2024-04-25T02:18:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.811+0000 7fceaeffd640 1 --2- 172.21.15.79:0/1838173458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb006df50 0x7fceb006e3b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcea400bb10 tx=0x7fcea402c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9332d44a0f559dec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.811+0000 7fceae7fc640 1 -- 172.21.15.79:0/1838173458 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea4032790 con 0x7fceb006df50 2024-04-25T02:18:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.811+0000 7fceae7fc640 1 -- 172.21.15.79:0/1838173458 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea4038070 con 0x7fceb006df50 2024-04-25T02:18:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.811+0000 7fceae7fc640 1 -- 172.21.15.79:0/1838173458 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea4032b50 con 0x7fceb006df50 2024-04-25T02:18:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.811+0000 7fceb61f9640 1 -- 172.21.15.79:0/1838173458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb006df50 msgr2=0x7fceb006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.811+0000 7fceb61f9640 1 --2- 172.21.15.79:0/1838173458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb006df50 0x7fceb006e3b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcea400bb10 tx=0x7fcea402c890 comp rx=0 tx=0).stop 2024-04-25T02:18:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.811+0000 7fceb61f9640 1 -- 172.21.15.79:0/1838173458 shutdown_connections 2024-04-25T02:18:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.811+0000 7fceb61f9640 1 --2- 172.21.15.79:0/1838173458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb00b2d30 0x7fceb00b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.811+0000 7fceb61f9640 1 --2- 172.21.15.79:0/1838173458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb006df50 0x7fceb006e3b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.811+0000 7fceb61f9640 1 -- 172.21.15.79:0/1838173458 >> 172.21.15.79:0/1838173458 conn(0x7fceb00cfc80 msgr2=0x7fceb00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.811+0000 7fceb61f9640 1 -- 172.21.15.79:0/1838173458 shutdown_connections 2024-04-25T02:18:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.811+0000 7fceb61f9640 1 -- 172.21.15.79:0/1838173458 wait complete. 2024-04-25T02:18:10.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.812+0000 7fceb61f9640 1 Processor -- start 2024-04-25T02:18:10.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.813+0000 7fceb61f9640 1 -- start start 2024-04-25T02:18:10.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.813+0000 7fceb61f9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb006df50 0x7fceb01f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.813+0000 7fceb61f9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb00b2d30 0x7fceb013f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.813+0000 7fceb61f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb0143bc0 0x7fceb015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.813+0000 7fceb61f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fceb0072940 con 0x7fceb0143bc0 2024-04-25T02:18:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.813+0000 7fceb61f9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fceb0072660 con 0x7fceb00b2d30 2024-04-25T02:18:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.813+0000 7fceb61f9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fceb0143fa0 con 0x7fceb006df50 2024-04-25T02:18:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.813+0000 7fceaffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb0143bc0 0x7fceb015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.813+0000 7fceaffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb0143bc0 0x7fceb015a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53352/0 (socket says 172.21.15.79:53352) 2024-04-25T02:18:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.813+0000 7fceaffff640 1 -- 172.21.15.79:0/963825984 learned_addr learned my addr 172.21.15.79:0/963825984 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.814+0000 7fceaf7fe640 1 --2- 172.21.15.79:0/963825984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb006df50 0x7fceb01f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.814+0000 7fceaeffd640 1 --2- 172.21.15.79:0/963825984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb00b2d30 0x7fceb013f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.814+0000 7fceaffff640 1 -- 172.21.15.79:0/963825984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb006df50 msgr2=0x7fceb01f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.814+0000 7fceaffff640 1 --2- 172.21.15.79:0/963825984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb006df50 0x7fceb01f0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.814+0000 7fceaffff640 1 -- 172.21.15.79:0/963825984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb00b2d30 msgr2=0x7fceb013f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.814+0000 7fceaffff640 1 --2- 172.21.15.79:0/963825984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb00b2d30 0x7fceb013f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.814+0000 7fceaffff640 1 -- 172.21.15.79:0/963825984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb0157e70 con 0x7fceb0143bc0 2024-04-25T02:18:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.814+0000 7fceaeffd640 1 --2- 172.21.15.79:0/963825984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb00b2d30 0x7fceb013f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.814+0000 7fceaffff640 1 --2- 172.21.15.79:0/963825984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb0143bc0 0x7fceb015a210 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fcea800efc0 tx=0x7fcea800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.814+0000 7fce97fff640 1 -- 172.21.15.79:0/963825984 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea8018020 con 0x7fceb0143bc0 2024-04-25T02:18:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.814+0000 7fce97fff640 1 -- 172.21.15.79:0/963825984 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea8014480 con 0x7fceb0143bc0 2024-04-25T02:18:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.814+0000 7fceb61f9640 1 -- 172.21.15.79:0/963825984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceb0158110 con 0x7fceb0143bc0 2024-04-25T02:18:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.814+0000 7fce97fff640 1 -- 172.21.15.79:0/963825984 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea8014870 con 0x7fceb0143bc0 2024-04-25T02:18:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.814+0000 7fceb61f9640 1 -- 172.21.15.79:0/963825984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceb01586d0 con 0x7fceb0143bc0 2024-04-25T02:18:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.815+0000 7fceb61f9640 1 -- 172.21.15.79:0/963825984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceb01f1220 con 0x7fceb0143bc0 2024-04-25T02:18:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.815+0000 7fce97fff640 1 -- 172.21.15.79:0/963825984 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcea8005d10 con 0x7fceb0143bc0 2024-04-25T02:18:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.816+0000 7fce97fff640 1 --2- 172.21.15.79:0/963825984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce9c06be30 0x7fce9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.816+0000 7fce97fff640 1 -- 172.21.15.79:0/963825984 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7fcea808bcf0 con 0x7fceb0143bc0 2024-04-25T02:18:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.816+0000 7fceaf7fe640 1 --2- 172.21.15.79:0/963825984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce9c06be30 0x7fce9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.816+0000 7fceaf7fe640 1 --2- 172.21.15.79:0/963825984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce9c06be30 0x7fce9c06e2f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcea0000f60 tx=0x7fcea0007ce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.820+0000 7fce97fff640 1 -- 172.21.15.79:0/963825984 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fceb01f1220 con 0x7fceb0143bc0 2024-04-25T02:18:10.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.994+0000 7fceb61f9640 1 -- 172.21.15.79:0/963825984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fceb00690a0 con 0x7fceb0143bc0 2024-04-25T02:18:10.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.995+0000 7fce97fff640 1 -- 172.21.15.79:0/963825984 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16991 (secure 0 0 0) 0x7fcea8090070 con 0x7fceb0143bc0 2024-04-25T02:18:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:10.999 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":119,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:17:57.569985+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:17:32.207579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T02:17:32.929915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.b","mappings":[{"from":0,"to":2}]},{"pgid":"17.34","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/3097428733":"2024-04-26T02:17:57.569963+0000","172.21.15.79:6836/3097428733":"2024-04-26T02:17:57.569963+0000","172.21.15.79:6837/2134535107":"2024-04-26T02:17:47.006917+0000","172.21.15.79:6836/2134535107":"2024-04-26T02:17:47.006917+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:18:11.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.997+0000 7fceb61f9640 1 -- 172.21.15.79:0/963825984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce9c06be30 msgr2=0x7fce9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:11.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.997+0000 7fceb61f9640 1 --2- 172.21.15.79:0/963825984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce9c06be30 0x7fce9c06e2f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcea0000f60 tx=0x7fcea0007ce0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.997+0000 7fceb61f9640 1 -- 172.21.15.79:0/963825984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb0143bc0 msgr2=0x7fceb015a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.997+0000 7fceb61f9640 1 --2- 172.21.15.79:0/963825984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb0143bc0 0x7fceb015a210 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fcea800efc0 tx=0x7fcea800c490 comp rx=0 tx=0).stop 2024-04-25T02:18:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.997+0000 7fceb61f9640 1 -- 172.21.15.79:0/963825984 shutdown_connections 2024-04-25T02:18:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.997+0000 7fceb61f9640 1 --2- 172.21.15.79:0/963825984 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fce9c06be30 0x7fce9c06e2f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.997+0000 7fceb61f9640 1 --2- 172.21.15.79:0/963825984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb0143bc0 0x7fceb015a210 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.997+0000 7fceb61f9640 1 --2- 172.21.15.79:0/963825984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb00b2d30 0x7fceb013f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.997+0000 7fceb61f9640 1 --2- 172.21.15.79:0/963825984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb006df50 0x7fceb01f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.997+0000 7fceb61f9640 1 -- 172.21.15.79:0/963825984 >> 172.21.15.79:0/963825984 conn(0x7fceb00cfc80 msgr2=0x7fceb00ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.997+0000 7fceb61f9640 1 -- 172.21.15.79:0/963825984 shutdown_connections 2024-04-25T02:18:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:10.997+0000 7fceb61f9640 1 -- 172.21.15.79:0/963825984 wait complete. 2024-04-25T02:18:11.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:18:11.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.105+0000 7ff1cb302640 1 Processor -- start 2024-04-25T02:18:11.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.106+0000 7ff1cb302640 1 -- start start 2024-04-25T02:18:11.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.106+0000 7ff1cb302640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1c415e4d0 0x7ff1c406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:11.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.106+0000 7ff1cb302640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1c40d2e20 0x7ff1c40cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:11.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.106+0000 7ff1cb302640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c40d1660 con 0x7ff1c40b3570 2024-04-25T02:18:11.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.106+0000 7ff1cb302640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c40d1380 con 0x7ff1c40d2e20 2024-04-25T02:18:11.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.106+0000 7ff1cb302640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c40cede0 con 0x7ff1c415e4d0 2024-04-25T02:18:11.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.107+0000 7ff1c989f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1c40d2e20 0x7ff1c40cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:11.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.107+0000 7ff1c989f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1c40d2e20 0x7ff1c40cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53354/0 (socket says 172.21.15.79:53354) 2024-04-25T02:18:11.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.107+0000 7ff1c989f640 1 -- 172.21.15.79:0/1951970383 learned_addr learned my addr 172.21.15.79:0/1951970383 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:11.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.107+0000 7ff1c909e640 1 --2- 172.21.15.79:0/1951970383 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1c415e4d0 0x7ff1c406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:11.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.107+0000 7ff1c989f640 1 -- 172.21.15.79:0/1951970383 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1c415e4d0 msgr2=0x7ff1c406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:11.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.107+0000 7ff1c989f640 1 --2- 172.21.15.79:0/1951970383 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1c415e4d0 0x7ff1c406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.107+0000 7ff1c989f640 1 -- 172.21.15.79:0/1951970383 >> v1:172.21.15.189:6789/0 conn(0x7ff1c40b3570 legacy=0x7ff1c40d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:11.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.107+0000 7ff1c989f640 1 -- 172.21.15.79:0/1951970383 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c40cf0c0 con 0x7ff1c40d2e20 2024-04-25T02:18:11.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.108+0000 7ff1c989f640 1 --2- 172.21.15.79:0/1951970383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c40d2e20 0x7ff1c40cf5e0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009e50 tx=0x7ff1bc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc61fb7a98320fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:11.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.108+0000 7ff1bbfff640 1 -- 172.21.15.79:0/1951970383 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc036070 con 0x7ff1c40d2e20 2024-04-25T02:18:11.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.108+0000 7ff1bbfff640 1 -- 172.21.15.79:0/1951970383 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc031600 con 0x7ff1c40d2e20 2024-04-25T02:18:11.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.108+0000 7ff1bbfff640 1 -- 172.21.15.79:0/1951970383 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0319d0 con 0x7ff1c40d2e20 2024-04-25T02:18:11.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.108+0000 7ff1cb302640 1 -- 172.21.15.79:0/1951970383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c40d2e20 msgr2=0x7ff1c40cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:11.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.108+0000 7ff1cb302640 1 --2- 172.21.15.79:0/1951970383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c40d2e20 0x7ff1c40cf5e0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009e50 tx=0x7ff1bc02a710 comp rx=0 tx=0).stop 2024-04-25T02:18:11.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.108+0000 7ff1cb302640 1 -- 172.21.15.79:0/1951970383 shutdown_connections 2024-04-25T02:18:11.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.108+0000 7ff1cb302640 1 --2- 172.21.15.79:0/1951970383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c40d2e20 0x7ff1c40cf5e0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.108+0000 7ff1cb302640 1 --2- 172.21.15.79:0/1951970383 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1c415e4d0 0x7ff1c406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.108+0000 7ff1cb302640 1 -- 172.21.15.79:0/1951970383 >> 172.21.15.79:0/1951970383 conn(0x7ff1c409d460 msgr2=0x7ff1c40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:11.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.108+0000 7ff1cb302640 1 -- 172.21.15.79:0/1951970383 shutdown_connections 2024-04-25T02:18:11.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.108+0000 7ff1cb302640 1 -- 172.21.15.79:0/1951970383 wait complete. 2024-04-25T02:18:11.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.109+0000 7ff1cb302640 1 Processor -- start 2024-04-25T02:18:11.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.109+0000 7ff1cb302640 1 -- start start 2024-04-25T02:18:11.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.110+0000 7ff1cb302640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c40b3570 0x7ff1c41f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:11.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.110+0000 7ff1cb302640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1c40d2e20 0x7ff1c40b91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:11.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.110+0000 7ff1cb302640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c415e4d0 0x7ff1c40cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:11.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.110+0000 7ff1cb302640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c40d2250 con 0x7ff1c415e4d0 2024-04-25T02:18:11.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.110+0000 7ff1cb302640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c40d20d0 con 0x7ff1c40b3570 2024-04-25T02:18:11.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.110+0000 7ff1cb302640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c406c1b0 con 0x7ff1c40d2e20 2024-04-25T02:18:11.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.110+0000 7ff1c989f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c415e4d0 0x7ff1c40cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:11.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.110+0000 7ff1c989f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c415e4d0 0x7ff1c40cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53370/0 (socket says 172.21.15.79:53370) 2024-04-25T02:18:11.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.110+0000 7ff1c989f640 1 -- 172.21.15.79:0/1397296247 learned_addr learned my addr 172.21.15.79:0/1397296247 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:11.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.110+0000 7ff1c889d640 1 --2- 172.21.15.79:0/1397296247 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1c40d2e20 0x7ff1c40b91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:11.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.110+0000 7ff1c909e640 1 --2- 172.21.15.79:0/1397296247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c40b3570 0x7ff1c41f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:11.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.111+0000 7ff1c989f640 1 -- 172.21.15.79:0/1397296247 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1c40d2e20 msgr2=0x7ff1c40b91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:11.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.111+0000 7ff1c989f640 1 --2- 172.21.15.79:0/1397296247 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1c40d2e20 0x7ff1c40b91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.111+0000 7ff1c989f640 1 -- 172.21.15.79:0/1397296247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c40b3570 msgr2=0x7ff1c41f3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:11.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.111+0000 7ff1c989f640 1 --2- 172.21.15.79:0/1397296247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c40b3570 0x7ff1c41f3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.111+0000 7ff1c989f640 1 -- 172.21.15.79:0/1397296247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c40cb750 con 0x7ff1c415e4d0 2024-04-25T02:18:11.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.111+0000 7ff1c989f640 1 --2- 172.21.15.79:0/1397296247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c415e4d0 0x7ff1c40cc7f0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc034040 tx=0x7ff1bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:11.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.111+0000 7ff1b9ffb640 1 -- 172.21.15.79:0/1397296247 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc036050 con 0x7ff1c415e4d0 2024-04-25T02:18:11.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.111+0000 7ff1b9ffb640 1 -- 172.21.15.79:0/1397296247 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc042070 con 0x7ff1c415e4d0 2024-04-25T02:18:11.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.111+0000 7ff1cb302640 1 -- 172.21.15.79:0/1397296247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c40cba30 con 0x7ff1c415e4d0 2024-04-25T02:18:11.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.111+0000 7ff1b9ffb640 1 -- 172.21.15.79:0/1397296247 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc009510 con 0x7ff1c415e4d0 2024-04-25T02:18:11.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.111+0000 7ff1cb302640 1 -- 172.21.15.79:0/1397296247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c40cbff0 con 0x7ff1c415e4d0 2024-04-25T02:18:11.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.112+0000 7ff1cb302640 1 -- 172.21.15.79:0/1397296247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c40690a0 con 0x7ff1c415e4d0 2024-04-25T02:18:11.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.112+0000 7ff1b9ffb640 1 -- 172.21.15.79:0/1397296247 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1bc007bd0 con 0x7ff1c415e4d0 2024-04-25T02:18:11.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.113+0000 7ff1b9ffb640 1 --2- 172.21.15.79:0/1397296247 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1a806be30 0x7ff1a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:11.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.113+0000 7ff1b9ffb640 1 -- 172.21.15.79:0/1397296247 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5939+0+0 (secure 0 0 0) 0x7ff1bc0abdc0 con 0x7ff1c415e4d0 2024-04-25T02:18:11.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.113+0000 7ff1c909e640 1 --2- 172.21.15.79:0/1397296247 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1a806be30 0x7ff1a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:11.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.113+0000 7ff1c909e640 1 --2- 172.21.15.79:0/1397296247 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1a806be30 0x7ff1a806e2f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4006fd0 tx=0x7ff1b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:11.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.117+0000 7ff1b9ffb640 1 -- 172.21.15.79:0/1397296247 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff1bc07a680 con 0x7ff1c415e4d0 2024-04-25T02:18:11.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.326+0000 7ff1cb302640 1 -- 172.21.15.79:0/1397296247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff1c41617f0 con 0x7ff1c415e4d0 2024-04-25T02:18:11.331 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-04-25T02:18:11.327+0000 7fb0c50c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:18:11.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.328+0000 7ff1b9ffb640 1 -- 172.21.15.79:0/1397296247 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v97) ==== 161+0+0 (secure 0 0 0) 0x7ff1bc079f80 con 0x7ff1c415e4d0 2024-04-25T02:18:11.332 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:18:11.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.331+0000 7ff1cb302640 1 -- 172.21.15.79:0/1397296247 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1a806be30 msgr2=0x7ff1a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:11.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.331+0000 7ff1cb302640 1 --2- 172.21.15.79:0/1397296247 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1a806be30 0x7ff1a806e2f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4006fd0 tx=0x7ff1b4008040 comp rx=0 tx=0).stop 2024-04-25T02:18:11.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.331+0000 7ff1cb302640 1 -- 172.21.15.79:0/1397296247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c415e4d0 msgr2=0x7ff1c40cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:11.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.331+0000 7ff1cb302640 1 --2- 172.21.15.79:0/1397296247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c415e4d0 0x7ff1c40cc7f0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc034040 tx=0x7ff1bc004a40 comp rx=0 tx=0).stop 2024-04-25T02:18:11.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.331+0000 7ff1cb302640 1 -- 172.21.15.79:0/1397296247 shutdown_connections 2024-04-25T02:18:11.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.331+0000 7ff1cb302640 1 --2- 172.21.15.79:0/1397296247 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1a806be30 0x7ff1a806e2f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.331+0000 7ff1cb302640 1 --2- 172.21.15.79:0/1397296247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c415e4d0 0x7ff1c40cc7f0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.331+0000 7ff1cb302640 1 --2- 172.21.15.79:0/1397296247 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1c40d2e20 0x7ff1c40b91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.331+0000 7ff1cb302640 1 --2- 172.21.15.79:0/1397296247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c40b3570 0x7ff1c41f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.331+0000 7ff1cb302640 1 -- 172.21.15.79:0/1397296247 >> 172.21.15.79:0/1397296247 conn(0x7ff1c409d460 msgr2=0x7ff1c406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:11.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.331+0000 7ff1cb302640 1 -- 172.21.15.79:0/1397296247 shutdown_connections 2024-04-25T02:18:11.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.331+0000 7ff1cb302640 1 -- 172.21.15.79:0/1397296247 wait complete. 2024-04-25T02:18:11.336 INFO:tasks.ceph.mds.a.smithi079.stderr: -1339> 2024-04-25T02:18:03.577+0000 7fdc3c5a5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:18:11.347 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T02:18:11.362 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-04-25T02:18:11.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.442+0000 7f051689a640 1 Processor -- start 2024-04-25T02:18:11.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.443+0000 7f051689a640 1 -- start start 2024-04-25T02:18:11.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.443+0000 7f051689a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f051015e4f0 0x7f05100d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:11.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.443+0000 7f051689a640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f05100cf7f0 0x7f05100d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:11.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.443+0000 7f051689a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05100d1ee0 con 0x7f05100cfc80 2024-04-25T02:18:11.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.443+0000 7f051689a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f05100d21c0 con 0x7f051015e4f0 2024-04-25T02:18:11.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.443+0000 7f051689a640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f05100d24a0 con 0x7f05100cf7f0 2024-04-25T02:18:11.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.443+0000 7f050ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f051015e4f0 0x7f05100d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:11.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.443+0000 7f0514e37640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f05100cfc80 0x7f051006bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36738/0 (socket says 172.21.15.79:36738) 2024-04-25T02:18:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.443+0000 7f0514e37640 1 -- 172.21.15.79:0/1245238389 learned_addr learned my addr 172.21.15.79:0/1245238389 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.444+0000 7f050f7fe640 1 --2- 172.21.15.79:0/1245238389 >> v2:172.21.15.189:3300/0 conn(0x7f05100cf7f0 0x7f05100d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.444+0000 7f050ffff640 1 -- 172.21.15.79:0/1245238389 >> v2:172.21.15.189:3300/0 conn(0x7f05100cf7f0 msgr2=0x7f05100d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.444+0000 7f050ffff640 1 --2- 172.21.15.79:0/1245238389 >> v2:172.21.15.189:3300/0 conn(0x7f05100cf7f0 0x7f05100d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.444+0000 7f050ffff640 1 -- 172.21.15.79:0/1245238389 >> v1:172.21.15.79:6789/0 conn(0x7f05100cfc80 legacy=0x7f051006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.444+0000 7f050ffff640 1 -- 172.21.15.79:0/1245238389 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05100d2780 con 0x7f051015e4f0 2024-04-25T02:18:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.444+0000 7f050f7fe640 1 --2- 172.21.15.79:0/1245238389 >> v2:172.21.15.189:3300/0 conn(0x7f05100cf7f0 0x7f05100d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.444+0000 7f050ffff640 1 --2- 172.21.15.79:0/1245238389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f051015e4f0 0x7f05100d2ca0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f05000097a0 tx=0x7f050002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c99aba667443dce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.445+0000 7f050effd640 1 -- 172.21.15.79:0/1245238389 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500037070 con 0x7f051015e4f0 2024-04-25T02:18:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.445+0000 7f050effd640 1 -- 172.21.15.79:0/1245238389 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0500032440 con 0x7f051015e4f0 2024-04-25T02:18:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.445+0000 7f050effd640 1 -- 172.21.15.79:0/1245238389 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500032810 con 0x7f051015e4f0 2024-04-25T02:18:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.445+0000 7f051689a640 1 -- 172.21.15.79:0/1245238389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f051015e4f0 msgr2=0x7f05100d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.445+0000 7f051689a640 1 --2- 172.21.15.79:0/1245238389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f051015e4f0 0x7f05100d2ca0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f05000097a0 tx=0x7f050002a1e0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.445+0000 7f051689a640 1 -- 172.21.15.79:0/1245238389 shutdown_connections 2024-04-25T02:18:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.445+0000 7f051689a640 1 --2- 172.21.15.79:0/1245238389 >> v2:172.21.15.189:3300/0 conn(0x7f05100cf7f0 0x7f05100d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.445+0000 7f051689a640 1 --2- 172.21.15.79:0/1245238389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f051015e4f0 0x7f05100d2ca0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.445+0000 7f051689a640 1 -- 172.21.15.79:0/1245238389 >> 172.21.15.79:0/1245238389 conn(0x7f051009d4a0 msgr2=0x7f05100d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.445+0000 7f051689a640 1 -- 172.21.15.79:0/1245238389 shutdown_connections 2024-04-25T02:18:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.445+0000 7f051689a640 1 -- 172.21.15.79:0/1245238389 wait complete. 2024-04-25T02:18:11.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.446+0000 7f051689a640 1 Processor -- start 2024-04-25T02:18:11.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.447+0000 7f051689a640 1 -- start start 2024-04-25T02:18:11.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.447+0000 7f051689a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05100cf7f0 0x7f0510147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:11.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.447+0000 7f051689a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05100cfc80 0x7f05100b9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:11.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.447+0000 7f051689a640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f051015e4f0 0x7f05100b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:11.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.447+0000 7f051689a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05100d0ef0 con 0x7f05100cfc80 2024-04-25T02:18:11.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.447+0000 7f051689a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f05100d50f0 con 0x7f05100cf7f0 2024-04-25T02:18:11.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.447+0000 7f051689a640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f05100d1070 con 0x7f051015e4f0 2024-04-25T02:18:11.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.447+0000 7f050f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05100cfc80 0x7f05100b9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:11.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.447+0000 7f050f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05100cfc80 0x7f05100b9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53418/0 (socket says 172.21.15.79:53418) 2024-04-25T02:18:11.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.447+0000 7f050f7fe640 1 -- 172.21.15.79:0/1216915672 learned_addr learned my addr 172.21.15.79:0/1216915672 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:11.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.448+0000 7f0514e37640 1 --2- 172.21.15.79:0/1216915672 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f051015e4f0 0x7f05100b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:11.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.448+0000 7f050f7fe640 1 -- 172.21.15.79:0/1216915672 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f051015e4f0 msgr2=0x7f05100b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:11.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.448+0000 7f050ffff640 1 --2- 172.21.15.79:0/1216915672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05100cf7f0 0x7f0510147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:11.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.448+0000 7f050f7fe640 1 --2- 172.21.15.79:0/1216915672 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f051015e4f0 0x7f05100b7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.448+0000 7f050f7fe640 1 -- 172.21.15.79:0/1216915672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05100cf7f0 msgr2=0x7f0510147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:11.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.448+0000 7f050f7fe640 1 --2- 172.21.15.79:0/1216915672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05100cf7f0 0x7f0510147830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:11.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.448+0000 7f050f7fe640 1 -- 172.21.15.79:0/1216915672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05100b7570 con 0x7f05100cfc80 2024-04-25T02:18:11.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.448+0000 7f050f7fe640 1 --2- 172.21.15.79:0/1216915672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05100cfc80 0x7f05100b9510 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f050400e7e0 tx=0x7f050400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:11.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.448+0000 7f050cff9640 1 -- 172.21.15.79:0/1216915672 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050400f040 con 0x7f05100cfc80 2024-04-25T02:18:11.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.448+0000 7f050cff9640 1 -- 172.21.15.79:0/1216915672 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0504004030 con 0x7f05100cfc80 2024-04-25T02:18:11.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.448+0000 7f051689a640 1 -- 172.21.15.79:0/1216915672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05100b9bd0 con 0x7f05100cfc80 2024-04-25T02:18:11.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.448+0000 7f050cff9640 1 -- 172.21.15.79:0/1216915672 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504004400 con 0x7f05100cfc80 2024-04-25T02:18:11.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.448+0000 7f051689a640 1 -- 172.21.15.79:0/1216915672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05100b1410 con 0x7f05100cfc80 2024-04-25T02:18:11.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.449+0000 7f051689a640 1 -- 172.21.15.79:0/1216915672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05100686c0 con 0x7f05100cfc80 2024-04-25T02:18:11.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.449+0000 7f050cff9640 1 -- 172.21.15.79:0/1216915672 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f050400c6d0 con 0x7f05100cfc80 2024-04-25T02:18:11.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.450+0000 7f050cff9640 1 --2- 172.21.15.79:0/1216915672 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04fc06be30 0x7f04fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:11.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.450+0000 7f050cff9640 1 -- 172.21.15.79:0/1216915672 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6025+0+0 (secure 0 0 0) 0x7f050408acd0 con 0x7f05100cfc80 2024-04-25T02:18:11.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.450+0000 7f050ffff640 1 --2- 172.21.15.79:0/1216915672 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04fc06be30 0x7f04fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:11.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.450+0000 7f050ffff640 1 --2- 172.21.15.79:0/1216915672 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04fc06be30 0x7f04fc06e2f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0500034000 tx=0x7f050002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:11.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.454+0000 7f050cff9640 1 -- 172.21.15.79:0/1216915672 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0504017020 con 0x7f05100cfc80 2024-04-25T02:18:11.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:11.666+0000 7f051689a640 1 -- 172.21.15.79:0/1216915672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f05100690a0 con 0x7f05100cfc80 2024-04-25T02:18:12.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.330+0000 7f050cff9640 1 -- 172.21.15.79:0/1216915672 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v98) ==== 104+0+0 (secure 0 0 0) 0x7f05040595d0 con 0x7f05100cfc80 2024-04-25T02:18:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.332+0000 7f051689a640 1 -- 172.21.15.79:0/1216915672 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04fc06be30 msgr2=0x7f04fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.332+0000 7f051689a640 1 --2- 172.21.15.79:0/1216915672 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04fc06be30 0x7f04fc06e2f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0500034000 tx=0x7f050002e000 comp rx=0 tx=0).stop 2024-04-25T02:18:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.332+0000 7f051689a640 1 -- 172.21.15.79:0/1216915672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05100cfc80 msgr2=0x7f05100b9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.332+0000 7f051689a640 1 --2- 172.21.15.79:0/1216915672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05100cfc80 0x7f05100b9510 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f050400e7e0 tx=0x7f050400eca0 comp rx=0 tx=0).stop 2024-04-25T02:18:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.333+0000 7f051689a640 1 -- 172.21.15.79:0/1216915672 shutdown_connections 2024-04-25T02:18:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.333+0000 7f051689a640 1 --2- 172.21.15.79:0/1216915672 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f04fc06be30 0x7f04fc06e2f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:12.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.333+0000 7f051689a640 1 --2- 172.21.15.79:0/1216915672 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f051015e4f0 0x7f05100b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:12.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.333+0000 7f051689a640 1 --2- 172.21.15.79:0/1216915672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05100cfc80 0x7f05100b9510 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:12.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.333+0000 7f051689a640 1 --2- 172.21.15.79:0/1216915672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05100cf7f0 0x7f0510147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:12.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.333+0000 7f051689a640 1 -- 172.21.15.79:0/1216915672 >> 172.21.15.79:0/1216915672 conn(0x7f051009d4a0 msgr2=0x7f05100b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:12.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.333+0000 7f051689a640 1 -- 172.21.15.79:0/1216915672 shutdown_connections 2024-04-25T02:18:12.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.333+0000 7f051689a640 1 -- 172.21.15.79:0/1216915672 wait complete. 2024-04-25T02:18:12.351 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T02:18:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.495+0000 7fe8f27b0640 1 Processor -- start 2024-04-25T02:18:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.495+0000 7fe8f27b0640 1 -- start start 2024-04-25T02:18:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.496+0000 7fe8f27b0640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe8ec0d2f20 0x7fe8ec0d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.496+0000 7fe8f27b0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8ec0d0ed0 0x7fe8ec0b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.496+0000 7fe8f27b0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8ec0d1e80 con 0x7fe8ec15e440 2024-04-25T02:18:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.496+0000 7fe8f27b0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe8ec0d2160 con 0x7fe8ec0d0ed0 2024-04-25T02:18:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.496+0000 7fe8f27b0640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe8ec0d2440 con 0x7fe8ec0d2f20 2024-04-25T02:18:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.496+0000 7fe8f0d4d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8ec0d0ed0 0x7fe8ec0b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.496+0000 7fe8ebfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe8ec15e440 0x7fe8ec0cf870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36740/0 (socket says 172.21.15.79:36740) 2024-04-25T02:18:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.496+0000 7fe8ebfff640 1 -- 172.21.15.79:0/2613868627 learned_addr learned my addr 172.21.15.79:0/2613868627 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.497+0000 7fe8f0d4d640 1 -- 172.21.15.79:0/2613868627 >> v2:172.21.15.189:3300/0 conn(0x7fe8ec0d2f20 msgr2=0x7fe8ec0d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.497+0000 7fe8f0d4d640 1 --2- 172.21.15.79:0/2613868627 >> v2:172.21.15.189:3300/0 conn(0x7fe8ec0d2f20 0x7fe8ec0d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.497+0000 7fe8f0d4d640 1 -- 172.21.15.79:0/2613868627 >> v1:172.21.15.79:6789/0 conn(0x7fe8ec15e440 legacy=0x7fe8ec0cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.497+0000 7fe8eaffd640 1 -- 172.21.15.79:0/2613868627 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1906566466 0 0) 0x7fe8ec0d1e80 con 0x7fe8ec15e440 2024-04-25T02:18:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.497+0000 7fe8f0d4d640 1 -- 172.21.15.79:0/2613868627 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ec0d2720 con 0x7fe8ec0d0ed0 2024-04-25T02:18:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.497+0000 7fe8f0d4d640 1 --2- 172.21.15.79:0/2613868627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec0d0ed0 0x7fe8ec0b6ef0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec08d840 tx=0x7fe8e402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7ec74930a19f46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.497+0000 7fe8eaffd640 1 -- 172.21.15.79:0/2613868627 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4007740 con 0x7fe8ec0d0ed0 2024-04-25T02:18:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.498+0000 7fe8eaffd640 1 -- 172.21.15.79:0/2613868627 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e40078e0 con 0x7fe8ec0d0ed0 2024-04-25T02:18:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.498+0000 7fe8eaffd640 1 -- 172.21.15.79:0/2613868627 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4007cb0 con 0x7fe8ec0d0ed0 2024-04-25T02:18:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.498+0000 7fe8f27b0640 1 -- 172.21.15.79:0/2613868627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec0d0ed0 msgr2=0x7fe8ec0b6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.498+0000 7fe8f27b0640 1 --2- 172.21.15.79:0/2613868627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec0d0ed0 0x7fe8ec0b6ef0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec08d840 tx=0x7fe8e402a680 comp rx=0 tx=0).stop 2024-04-25T02:18:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.498+0000 7fe8f27b0640 1 -- 172.21.15.79:0/2613868627 shutdown_connections 2024-04-25T02:18:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.498+0000 7fe8f27b0640 1 --2- 172.21.15.79:0/2613868627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec0d0ed0 0x7fe8ec0b6ef0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.498+0000 7fe8f27b0640 1 --2- 172.21.15.79:0/2613868627 >> v2:172.21.15.189:3300/0 conn(0x7fe8ec0d2f20 0x7fe8ec0d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.498+0000 7fe8f27b0640 1 -- 172.21.15.79:0/2613868627 >> 172.21.15.79:0/2613868627 conn(0x7fe8ec09d450 msgr2=0x7fe8ec0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.498+0000 7fe8f27b0640 1 -- 172.21.15.79:0/2613868627 shutdown_connections 2024-04-25T02:18:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.498+0000 7fe8f27b0640 1 -- 172.21.15.79:0/2613868627 wait complete. 2024-04-25T02:18:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.499+0000 7fe8f27b0640 1 Processor -- start 2024-04-25T02:18:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.500+0000 7fe8f27b0640 1 -- start start 2024-04-25T02:18:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.500+0000 7fe8f27b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8ec0d0ed0 0x7fe8ec1f42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.500+0000 7fe8f27b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec0d2f20 0x7fe8ec1f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.500+0000 7fe8f27b0640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8ec15e440 0x7fe8ec1f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.500+0000 7fe8f27b0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec0d0100 con 0x7fe8ec0d2f20 2024-04-25T02:18:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.500+0000 7fe8f27b0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec0cff80 con 0x7fe8ec0d0ed0 2024-04-25T02:18:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.500+0000 7fe8f27b0640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ec0b7430 con 0x7fe8ec15e440 2024-04-25T02:18:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.500+0000 7fe8eb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec0d2f20 0x7fe8ec1f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.500+0000 7fe8eb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec0d2f20 0x7fe8ec1f4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53434/0 (socket says 172.21.15.79:53434) 2024-04-25T02:18:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.500+0000 7fe8eb7fe640 1 -- 172.21.15.79:0/1745921738 learned_addr learned my addr 172.21.15.79:0/1745921738 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.500+0000 7fe8ebfff640 1 --2- 172.21.15.79:0/1745921738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8ec0d0ed0 0x7fe8ec1f42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.501+0000 7fe8f0d4d640 1 --2- 172.21.15.79:0/1745921738 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8ec15e440 0x7fe8ec1f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.501+0000 7fe8eb7fe640 1 -- 172.21.15.79:0/1745921738 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8ec15e440 msgr2=0x7fe8ec1f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.501+0000 7fe8eb7fe640 1 --2- 172.21.15.79:0/1745921738 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8ec15e440 0x7fe8ec1f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.501+0000 7fe8eb7fe640 1 -- 172.21.15.79:0/1745921738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8ec0d0ed0 msgr2=0x7fe8ec1f42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.501+0000 7fe8eb7fe640 1 --2- 172.21.15.79:0/1745921738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8ec0d0ed0 0x7fe8ec1f42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.501+0000 7fe8eb7fe640 1 -- 172.21.15.79:0/1745921738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ec0c9970 con 0x7fe8ec0d2f20 2024-04-25T02:18:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.501+0000 7fe8eb7fe640 1 --2- 172.21.15.79:0/1745921738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec0d2f20 0x7fe8ec1f4810 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000b4a0 tx=0x7fe8e000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.501+0000 7fe8e8ff9640 1 -- 172.21.15.79:0/1745921738 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0014070 con 0x7fe8ec0d2f20 2024-04-25T02:18:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.501+0000 7fe8e8ff9640 1 -- 172.21.15.79:0/1745921738 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e0010610 con 0x7fe8ec0d2f20 2024-04-25T02:18:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.501+0000 7fe8f27b0640 1 -- 172.21.15.79:0/1745921738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ec0c9c50 con 0x7fe8ec0d2f20 2024-04-25T02:18:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.501+0000 7fe8e8ff9640 1 -- 172.21.15.79:0/1745921738 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0010a00 con 0x7fe8ec0d2f20 2024-04-25T02:18:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.501+0000 7fe8f27b0640 1 -- 172.21.15.79:0/1745921738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8ec0ca210 con 0x7fe8ec0d2f20 2024-04-25T02:18:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.502+0000 7fe8f27b0640 1 -- 172.21.15.79:0/1745921738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8ec0690a0 con 0x7fe8ec0d2f20 2024-04-25T02:18:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.502+0000 7fe8e8ff9640 1 -- 172.21.15.79:0/1745921738 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8e0017070 con 0x7fe8ec0d2f20 2024-04-25T02:18:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.503+0000 7fe8e8ff9640 1 --2- 172.21.15.79:0/1745921738 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe8d806be30 0x7fe8d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.503+0000 7fe8ebfff640 1 --2- 172.21.15.79:0/1745921738 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe8d806be30 0x7fe8d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.503+0000 7fe8e8ff9640 1 -- 172.21.15.79:0/1745921738 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6025+0+0 (secure 0 0 0) 0x7fe8e008a9c0 con 0x7fe8ec0d2f20 2024-04-25T02:18:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.503+0000 7fe8ebfff640 1 --2- 172.21.15.79:0/1745921738 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe8d806be30 0x7fe8d806e2f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc000f60 tx=0x7fe8dc007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.507+0000 7fe8e8ff9640 1 -- 172.21.15.79:0/1745921738 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe8e008ce20 con 0x7fe8ec0d2f20 2024-04-25T02:18:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:12.685+0000 7fe8f27b0640 1 -- 172.21.15.79:0/1745921738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe8ec0b6840 con 0x7fe8ec0d2f20 2024-04-25T02:18:13.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.622+0000 7fe8e8ff9640 1 -- 172.21.15.79:0/1745921738 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v121) ==== 181+0+0 (secure 0 0 0) 0x7fe8e0059230 con 0x7fe8ec0d2f20 2024-04-25T02:18:13.627 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-04-25T02:18:13.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.626+0000 7fe8f27b0640 1 -- 172.21.15.79:0/1745921738 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe8d806be30 msgr2=0x7fe8d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:13.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.626+0000 7fe8f27b0640 1 --2- 172.21.15.79:0/1745921738 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe8d806be30 0x7fe8d806e2f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc000f60 tx=0x7fe8dc007c00 comp rx=0 tx=0).stop 2024-04-25T02:18:13.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.626+0000 7fe8f27b0640 1 -- 172.21.15.79:0/1745921738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec0d2f20 msgr2=0x7fe8ec1f4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:13.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.626+0000 7fe8f27b0640 1 --2- 172.21.15.79:0/1745921738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec0d2f20 0x7fe8ec1f4810 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000b4a0 tx=0x7fe8e000b960 comp rx=0 tx=0).stop 2024-04-25T02:18:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.628+0000 7fe8f27b0640 1 -- 172.21.15.79:0/1745921738 shutdown_connections 2024-04-25T02:18:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.628+0000 7fe8f27b0640 1 --2- 172.21.15.79:0/1745921738 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fe8d806be30 0x7fe8d806e2f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.628+0000 7fe8f27b0640 1 --2- 172.21.15.79:0/1745921738 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8ec15e440 0x7fe8ec1f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.628+0000 7fe8f27b0640 1 --2- 172.21.15.79:0/1745921738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ec0d2f20 0x7fe8ec1f4810 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.628+0000 7fe8f27b0640 1 --2- 172.21.15.79:0/1745921738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8ec0d0ed0 0x7fe8ec1f42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.628+0000 7fe8f27b0640 1 -- 172.21.15.79:0/1745921738 >> 172.21.15.79:0/1745921738 conn(0x7fe8ec09d450 msgr2=0x7fe8ec0cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.629+0000 7fe8f27b0640 1 -- 172.21.15.79:0/1745921738 shutdown_connections 2024-04-25T02:18:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.629+0000 7fe8f27b0640 1 -- 172.21.15.79:0/1745921738 wait complete. 2024-04-25T02:18:13.650 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T02:18:13.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.751+0000 7fcca5f28640 1 Processor -- start 2024-04-25T02:18:13.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.751+0000 7fcca5f28640 1 -- start start 2024-04-25T02:18:13.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcca5f28640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcca015e440 0x7fcca00cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:13.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcca5f28640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcca00d2f20 0x7fcca00cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:13.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcca5f28640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcca00d0990 0x7fcca00d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:13.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcca5f28640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fcca00d1e80 con 0x7fcca00d0990 2024-04-25T02:18:13.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcca5f28640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fcca00d2160 con 0x7fcca015e440 2024-04-25T02:18:13.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcca5f28640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcca00d2440 con 0x7fcca00d2f20 2024-04-25T02:18:13.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcc9ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcca00d0990 0x7fcca00d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:13.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcc9ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcca00d0990 0x7fcca00d0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39124/0 (socket says 172.21.15.79:39124) 2024-04-25T02:18:13.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcc9ffff640 1 -- 172.21.15.79:0/2130037935 learned_addr learned my addr 172.21.15.79:0/2130037935 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:13.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcc9effd640 1 --2- 172.21.15.79:0/2130037935 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcca00d2f20 0x7fcca00cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:13.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcc9f7fe640 1 --2- 172.21.15.79:0/2130037935 >> v2:172.21.15.189:3300/0 conn(0x7fcca015e440 0x7fcca00cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:13.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcc9ffff640 1 -- 172.21.15.79:0/2130037935 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcca00d2f20 msgr2=0x7fcca00cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:13.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcc9ffff640 1 --2- 172.21.15.79:0/2130037935 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcca00d2f20 0x7fcca00cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:13.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcc9ffff640 1 -- 172.21.15.79:0/2130037935 >> v2:172.21.15.189:3300/0 conn(0x7fcca015e440 msgr2=0x7fcca00cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:13.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcc9ffff640 1 --2- 172.21.15.79:0/2130037935 >> v2:172.21.15.189:3300/0 conn(0x7fcca015e440 0x7fcca00cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:13.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.752+0000 7fcc9ffff640 1 -- 172.21.15.79:0/2130037935 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca00d2720 con 0x7fcca00d0990 2024-04-25T02:18:13.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.753+0000 7fcc9ffff640 1 --2- 172.21.15.79:0/2130037935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca00d0990 0x7fcca00d0e20 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fcca00d4000 tx=0x7fcc9802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d5e8bf7bf2b0a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:13.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.753+0000 7fcc9e7fc640 1 -- 172.21.15.79:0/2130037935 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc98036070 con 0x7fcca00d0990 2024-04-25T02:18:13.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.753+0000 7fcc9e7fc640 1 -- 172.21.15.79:0/2130037935 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc98031600 con 0x7fcca00d0990 2024-04-25T02:18:13.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.753+0000 7fcc9e7fc640 1 -- 172.21.15.79:0/2130037935 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc980319d0 con 0x7fcca00d0990 2024-04-25T02:18:13.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.754+0000 7fcca5f28640 1 -- 172.21.15.79:0/2130037935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca00d0990 msgr2=0x7fcca00d0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:13.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.754+0000 7fcca5f28640 1 --2- 172.21.15.79:0/2130037935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca00d0990 0x7fcca00d0e20 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fcca00d4000 tx=0x7fcc9802a6a0 comp rx=0 tx=0).stop 2024-04-25T02:18:13.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.754+0000 7fcca5f28640 1 -- 172.21.15.79:0/2130037935 shutdown_connections 2024-04-25T02:18:13.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.754+0000 7fcca5f28640 1 --2- 172.21.15.79:0/2130037935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca00d0990 0x7fcca00d0e20 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:13.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.754+0000 7fcca5f28640 1 --2- 172.21.15.79:0/2130037935 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcca00d2f20 0x7fcca00cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:13.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.754+0000 7fcca5f28640 1 --2- 172.21.15.79:0/2130037935 >> v2:172.21.15.189:3300/0 conn(0x7fcca015e440 0x7fcca00cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:13.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.754+0000 7fcca5f28640 1 -- 172.21.15.79:0/2130037935 >> 172.21.15.79:0/2130037935 conn(0x7fcca009d450 msgr2=0x7fcca00d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:13.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.754+0000 7fcca5f28640 1 -- 172.21.15.79:0/2130037935 shutdown_connections 2024-04-25T02:18:13.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.754+0000 7fcca5f28640 1 -- 172.21.15.79:0/2130037935 wait complete. 2024-04-25T02:18:13.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.755+0000 7fcca5f28640 1 Processor -- start 2024-04-25T02:18:13.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.755+0000 7fcca5f28640 1 -- start start 2024-04-25T02:18:13.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcca5f28640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcca00d0990 0x7fcca00b8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:13.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcca5f28640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca00d2f20 0x7fcca00c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:13.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcca5f28640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcca015e440 0x7fcca00b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:13.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcca5f28640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcca0161f90 con 0x7fcca00d2f20 2024-04-25T02:18:13.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcca5f28640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcca0161e10 con 0x7fcca00d0990 2024-04-25T02:18:13.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcca5f28640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcca0162110 con 0x7fcca015e440 2024-04-25T02:18:13.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcc9effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca00d2f20 0x7fcca00c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:13.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcc9effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca00d2f20 0x7fcca00c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39136/0 (socket says 172.21.15.79:39136) 2024-04-25T02:18:13.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcc9effd640 1 -- 172.21.15.79:0/1877074632 learned_addr learned my addr 172.21.15.79:0/1877074632 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:13.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcc9f7fe640 1 --2- 172.21.15.79:0/1877074632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcca00d0990 0x7fcca00b8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:13.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcc9ffff640 1 --2- 172.21.15.79:0/1877074632 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcca015e440 0x7fcca00b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:13.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcc9effd640 1 -- 172.21.15.79:0/1877074632 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcca015e440 msgr2=0x7fcca00b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:13.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcc9effd640 1 --2- 172.21.15.79:0/1877074632 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcca015e440 0x7fcca00b6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:13.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcc9effd640 1 -- 172.21.15.79:0/1877074632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcca00d0990 msgr2=0x7fcca00b8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:13.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcc9effd640 1 --2- 172.21.15.79:0/1877074632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcca00d0990 0x7fcca00b8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:13.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcc9effd640 1 -- 172.21.15.79:0/1877074632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca00c8c10 con 0x7fcca00d2f20 2024-04-25T02:18:13.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcc9effd640 1 --2- 172.21.15.79:0/1877074632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca00d2f20 0x7fcca00c8530 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400d830 tx=0x7fcc9400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:13.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcc87fff640 1 -- 172.21.15.79:0/1877074632 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94018020 con 0x7fcca00d2f20 2024-04-25T02:18:13.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcc87fff640 1 -- 172.21.15.79:0/1877074632 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc94009640 con 0x7fcca00d2f20 2024-04-25T02:18:13.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcca5f28640 1 -- 172.21.15.79:0/1877074632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca00c8ef0 con 0x7fcca00d2f20 2024-04-25T02:18:13.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcc87fff640 1 -- 172.21.15.79:0/1877074632 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94009a10 con 0x7fcca00d2f20 2024-04-25T02:18:13.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.756+0000 7fcca5f28640 1 -- 172.21.15.79:0/1877074632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca00c94b0 con 0x7fcca00d2f20 2024-04-25T02:18:13.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.757+0000 7fcca5f28640 1 -- 172.21.15.79:0/1877074632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca00690a0 con 0x7fcca00d2f20 2024-04-25T02:18:13.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.758+0000 7fcc87fff640 1 -- 172.21.15.79:0/1877074632 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc9401b020 con 0x7fcca00d2f20 2024-04-25T02:18:13.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.758+0000 7fcc87fff640 1 --2- 172.21.15.79:0/1877074632 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc8c06be30 0x7fcc8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:13.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.758+0000 7fcc9f7fe640 1 --2- 172.21.15.79:0/1877074632 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc8c06be30 0x7fcc8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:13.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.758+0000 7fcc87fff640 1 -- 172.21.15.79:0/1877074632 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5587+0+0 (secure 0 0 0) 0x7fcc9408b010 con 0x7fcca00d2f20 2024-04-25T02:18:13.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.759+0000 7fcc9f7fe640 1 --2- 172.21.15.79:0/1877074632 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc8c06be30 0x7fcc8c06e2f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fcc90006fd0 tx=0x7fcc90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:13.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.763+0000 7fcc87fff640 1 -- 172.21.15.79:0/1877074632 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcc94022030 con 0x7fcca00d2f20 2024-04-25T02:18:13.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:13.936+0000 7fcca5f28640 1 -- 172.21.15.79:0/1877074632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcca00d1720 con 0x7fcca00d2f20 2024-04-25T02:18:14.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.624+0000 7fcc87fff640 1 -- 172.21.15.79:0/1877074632 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v122) ==== 169+0+0 (secure 0 0 0) 0x7fcc94059a30 con 0x7fcca00d2f20 2024-04-25T02:18:14.628 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-04-25T02:18:14.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.627+0000 7fcca5f28640 1 -- 172.21.15.79:0/1877074632 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc8c06be30 msgr2=0x7fcc8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:14.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.627+0000 7fcca5f28640 1 --2- 172.21.15.79:0/1877074632 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc8c06be30 0x7fcc8c06e2f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fcc90006fd0 tx=0x7fcc90008040 comp rx=0 tx=0).stop 2024-04-25T02:18:14.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.627+0000 7fcca5f28640 1 -- 172.21.15.79:0/1877074632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca00d2f20 msgr2=0x7fcca00c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:14.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.627+0000 7fcca5f28640 1 --2- 172.21.15.79:0/1877074632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca00d2f20 0x7fcca00c8530 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400d830 tx=0x7fcc9400dcf0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.627+0000 7fcca5f28640 1 -- 172.21.15.79:0/1877074632 shutdown_connections 2024-04-25T02:18:14.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.627+0000 7fcca5f28640 1 --2- 172.21.15.79:0/1877074632 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fcc8c06be30 0x7fcc8c06e2f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.627+0000 7fcca5f28640 1 --2- 172.21.15.79:0/1877074632 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcca015e440 0x7fcca00b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.627+0000 7fcca5f28640 1 --2- 172.21.15.79:0/1877074632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca00d2f20 0x7fcca00c8530 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.627+0000 7fcca5f28640 1 --2- 172.21.15.79:0/1877074632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcca00d0990 0x7fcca00b8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.627+0000 7fcca5f28640 1 -- 172.21.15.79:0/1877074632 >> 172.21.15.79:0/1877074632 conn(0x7fcca009d450 msgr2=0x7fcca00d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:14.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.628+0000 7fcca5f28640 1 -- 172.21.15.79:0/1877074632 shutdown_connections 2024-04-25T02:18:14.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.628+0000 7fcca5f28640 1 -- 172.21.15.79:0/1877074632 wait complete. 2024-04-25T02:18:14.646 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T02:18:14.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.743+0000 7ff22554f640 1 Processor -- start 2024-04-25T02:18:14.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.743+0000 7ff22554f640 1 -- start start 2024-04-25T02:18:14.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.744+0000 7ff22554f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff22006c330 0x7ff2200721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:14.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.744+0000 7ff22554f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2200afb00 0x7ff2200ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:14.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.744+0000 7ff22554f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff22006fa20 con 0x7ff22006c710 2024-04-25T02:18:14.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.744+0000 7ff22554f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff2200ce110 con 0x7ff2200afb00 2024-04-25T02:18:14.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.744+0000 7ff22554f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff22006fc90 con 0x7ff22006c330 2024-04-25T02:18:14.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.744+0000 7ff21e7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2200afb00 0x7ff2200ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.744+0000 7ff21f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff22006c710 0x7ff2200cee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57950/0 (socket says 172.21.15.79:57950) 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.744+0000 7ff21f7fe640 1 -- 172.21.15.79:0/1091035987 learned_addr learned my addr 172.21.15.79:0/1091035987 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.744+0000 7ff21effd640 1 --2- 172.21.15.79:0/1091035987 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff22006c330 0x7ff2200721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.744+0000 7ff21e7fc640 1 -- 172.21.15.79:0/1091035987 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff22006c330 msgr2=0x7ff2200721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.744+0000 7ff21e7fc640 1 --2- 172.21.15.79:0/1091035987 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff22006c330 0x7ff2200721a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.744+0000 7ff21e7fc640 1 -- 172.21.15.79:0/1091035987 >> v1:172.21.15.79:6789/0 conn(0x7ff22006c710 legacy=0x7ff2200cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.744+0000 7ff21dffb640 1 -- 172.21.15.79:0/1091035987 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3838846278 0 0) 0x7ff22006fa20 con 0x7ff22006c710 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.744+0000 7ff21e7fc640 1 -- 172.21.15.79:0/1091035987 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22006ff70 con 0x7ff2200afb00 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.744+0000 7ff21effd640 1 --2- 172.21.15.79:0/1091035987 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff22006c330 0x7ff2200721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.745+0000 7ff21e7fc640 1 --2- 172.21.15.79:0/1091035987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2200afb00 0x7ff2200ce8d0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7ff2140097a0 tx=0x7ff21402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0e088b9e70ec9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.745+0000 7ff21dffb640 1 -- 172.21.15.79:0/1091035987 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214037070 con 0x7ff2200afb00 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.745+0000 7ff21dffb640 1 -- 172.21.15.79:0/1091035987 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21402ae50 con 0x7ff2200afb00 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.745+0000 7ff21dffb640 1 -- 172.21.15.79:0/1091035987 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214032660 con 0x7ff2200afb00 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.746+0000 7ff22554f640 1 -- 172.21.15.79:0/1091035987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2200afb00 msgr2=0x7ff2200ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.746+0000 7ff22554f640 1 --2- 172.21.15.79:0/1091035987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2200afb00 0x7ff2200ce8d0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7ff2140097a0 tx=0x7ff21402a100 comp rx=0 tx=0).stop 2024-04-25T02:18:14.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.746+0000 7ff22554f640 1 -- 172.21.15.79:0/1091035987 shutdown_connections 2024-04-25T02:18:14.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.746+0000 7ff22554f640 1 --2- 172.21.15.79:0/1091035987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2200afb00 0x7ff2200ce8d0 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.746+0000 7ff22554f640 1 --2- 172.21.15.79:0/1091035987 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff22006c330 0x7ff2200721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.746+0000 7ff22554f640 1 -- 172.21.15.79:0/1091035987 >> 172.21.15.79:0/1091035987 conn(0x7ff2200716b0 msgr2=0x7ff220071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:14.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.746+0000 7ff22554f640 1 -- 172.21.15.79:0/1091035987 shutdown_connections 2024-04-25T02:18:14.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.746+0000 7ff22554f640 1 -- 172.21.15.79:0/1091035987 wait complete. 2024-04-25T02:18:14.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.747+0000 7ff22554f640 1 Processor -- start 2024-04-25T02:18:14.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.747+0000 7ff22554f640 1 -- start start 2024-04-25T02:18:14.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff22554f640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff22006c330 0x7ff2201436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:14.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff22554f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22006c710 0x7ff2200b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:14.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff22554f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2200afb00 0x7ff2200b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:14.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff22554f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff220160440 con 0x7ff22006c710 2024-04-25T02:18:14.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff22554f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff220067450 con 0x7ff2200afb00 2024-04-25T02:18:14.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff22554f640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff2201605c0 con 0x7ff22006c330 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff21e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22006c710 0x7ff2200b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff21e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22006c710 0x7ff2200b0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39150/0 (socket says 172.21.15.79:39150) 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff21e7fc640 1 -- 172.21.15.79:0/2516534179 learned_addr learned my addr 172.21.15.79:0/2516534179 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff21e7fc640 1 -- 172.21.15.79:0/2516534179 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff22006c330 msgr2=0x7ff2201436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff21effd640 1 --2- 172.21.15.79:0/2516534179 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff22006c330 0x7ff2201436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff21e7fc640 1 --2- 172.21.15.79:0/2516534179 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff22006c330 0x7ff2201436b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff21f7fe640 1 --2- 172.21.15.79:0/2516534179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2200afb00 0x7ff2200b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff21e7fc640 1 -- 172.21.15.79:0/2516534179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2200afb00 msgr2=0x7ff2200b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff21e7fc640 1 --2- 172.21.15.79:0/2516534179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2200afb00 0x7ff2200b11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff21e7fc640 1 -- 172.21.15.79:0/2516534179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2200b33a0 con 0x7ff22006c710 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.748+0000 7ff21e7fc640 1 --2- 172.21.15.79:0/2516534179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22006c710 0x7ff2200b0c60 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7ff214035040 tx=0x7ff2140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.749+0000 7ff2077fe640 1 -- 172.21.15.79:0/2516534179 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214041070 con 0x7ff22006c710 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.749+0000 7ff2077fe640 1 -- 172.21.15.79:0/2516534179 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21403c670 con 0x7ff22006c710 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.749+0000 7ff22554f640 1 -- 172.21.15.79:0/2516534179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2200b3640 con 0x7ff22006c710 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.749+0000 7ff2077fe640 1 -- 172.21.15.79:0/2516534179 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214037040 con 0x7ff22006c710 2024-04-25T02:18:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.749+0000 7ff22554f640 1 -- 172.21.15.79:0/2516534179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff220145e10 con 0x7ff22006c710 2024-04-25T02:18:14.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.750+0000 7ff22554f640 1 -- 172.21.15.79:0/2516534179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2200690a0 con 0x7ff22006c710 2024-04-25T02:18:14.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.750+0000 7ff2077fe640 1 -- 172.21.15.79:0/2516534179 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff21403a070 con 0x7ff22006c710 2024-04-25T02:18:14.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.750+0000 7ff2077fe640 1 --2- 172.21.15.79:0/2516534179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff20c06be30 0x7ff20c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:14.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.751+0000 7ff21effd640 1 --2- 172.21.15.79:0/2516534179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff20c06be30 0x7ff20c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:14.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.751+0000 7ff2077fe640 1 -- 172.21.15.79:0/2516534179 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7ff2140aafc0 con 0x7ff22006c710 2024-04-25T02:18:14.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.751+0000 7ff21effd640 1 --2- 172.21.15.79:0/2516534179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff20c06be30 0x7ff20c06e2f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff22015fd00 tx=0x7ff2100084f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:14.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.755+0000 7ff2077fe640 1 -- 172.21.15.79:0/2516534179 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff214079c50 con 0x7ff22006c710 2024-04-25T02:18:14.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.927+0000 7ff22554f640 1 -- 172.21.15.79:0/2516534179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ff2200ccda0 con 0x7ff22006c710 2024-04-25T02:18:14.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.930+0000 7ff2077fe640 1 -- 172.21.15.79:0/2516534179 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7ff214079550 con 0x7ff22006c710 2024-04-25T02:18:14.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.932+0000 7ff22554f640 1 -- 172.21.15.79:0/2516534179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff20c06be30 msgr2=0x7ff20c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:14.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.932+0000 7ff22554f640 1 --2- 172.21.15.79:0/2516534179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff20c06be30 0x7ff20c06e2f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff22015fd00 tx=0x7ff2100084f0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.932+0000 7ff22554f640 1 -- 172.21.15.79:0/2516534179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22006c710 msgr2=0x7ff2200b0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:14.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.932+0000 7ff22554f640 1 --2- 172.21.15.79:0/2516534179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22006c710 0x7ff2200b0c60 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7ff214035040 tx=0x7ff2140046c0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.932+0000 7ff22554f640 1 -- 172.21.15.79:0/2516534179 shutdown_connections 2024-04-25T02:18:14.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.932+0000 7ff22554f640 1 --2- 172.21.15.79:0/2516534179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff20c06be30 0x7ff20c06e2f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.932+0000 7ff22554f640 1 --2- 172.21.15.79:0/2516534179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2200afb00 0x7ff2200b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.932+0000 7ff22554f640 1 --2- 172.21.15.79:0/2516534179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22006c710 0x7ff2200b0c60 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.932+0000 7ff22554f640 1 --2- 172.21.15.79:0/2516534179 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff22006c330 0x7ff2201436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:14.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.932+0000 7ff22554f640 1 -- 172.21.15.79:0/2516534179 >> 172.21.15.79:0/2516534179 conn(0x7ff2200716b0 msgr2=0x7ff2200b0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:14.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.932+0000 7ff22554f640 1 -- 172.21.15.79:0/2516534179 shutdown_connections 2024-04-25T02:18:14.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:14.932+0000 7ff22554f640 1 -- 172.21.15.79:0/2516534179 wait complete. 2024-04-25T02:18:14.947 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-25T02:18:15.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.046+0000 7f5a7eb1b640 1 Processor -- start 2024-04-25T02:18:15.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.046+0000 7f5a7eb1b640 1 -- start start 2024-04-25T02:18:15.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.047+0000 7f5a7eb1b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5a7806df50 0x7f5a7806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:15.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.047+0000 7f5a7eb1b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a78070d90 con 0x7f5a78144cb0 2024-04-25T02:18:15.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.047+0000 7f5a7eb1b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a780cf130 con 0x7f5a78071240 2024-04-25T02:18:15.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.047+0000 7f5a7eb1b640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f5a780cf410 con 0x7f5a7806df50 2024-04-25T02:18:15.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.048+0000 7f5a7c8b7640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5a78144cb0 0x7f5a780b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57952/0 (socket says 172.21.15.79:57952) 2024-04-25T02:18:15.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.048+0000 7f5a7c8b7640 1 -- 172.21.15.79:0/1678246483 learned_addr learned my addr 172.21.15.79:0/1678246483 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:15.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.048+0000 7f5a77fff640 1 --2- 172.21.15.79:0/1678246483 >> v2:172.21.15.189:3300/0 conn(0x7f5a7806df50 0x7f5a7806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:15.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.048+0000 7f5a777fe640 1 -- 172.21.15.79:0/1678246483 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 367249737 0 0) 0x7f5a78070d90 con 0x7f5a78144cb0 2024-04-25T02:18:15.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.048+0000 7f5a777fe640 1 -- 172.21.15.79:0/1678246483 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a60007930 con 0x7f5a78144cb0 2024-04-25T02:18:15.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.048+0000 7f5a77fff640 1 -- 172.21.15.79:0/1678246483 >> v1:172.21.15.189:6789/0 conn(0x7f5a78071240 legacy=0x7f5a78071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:15.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.048+0000 7f5a77fff640 1 -- 172.21.15.79:0/1678246483 >> v1:172.21.15.79:6789/0 conn(0x7f5a78144cb0 legacy=0x7f5a780b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:15.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.048+0000 7f5a777fe640 1 -- 172.21.15.79:0/1678246483 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3729223756 0 0) 0x7f5a60007930 con 0x7f5a78144cb0 2024-04-25T02:18:15.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.048+0000 7f5a77fff640 1 -- 172.21.15.79:0/1678246483 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a780cf6f0 con 0x7f5a7806df50 2024-04-25T02:18:15.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.049+0000 7f5a77fff640 1 --2- 172.21.15.79:0/1678246483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a7806df50 0x7f5a7806e3e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0097a0 tx=0x7f5a6c02a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5ee698bd6f09266 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:15.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.050+0000 7f5a777fe640 1 -- 172.21.15.79:0/1678246483 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c037070 con 0x7f5a7806df50 2024-04-25T02:18:15.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.050+0000 7f5a777fe640 1 -- 172.21.15.79:0/1678246483 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c02ab30 con 0x7f5a7806df50 2024-04-25T02:18:15.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.050+0000 7f5a777fe640 1 -- 172.21.15.79:0/1678246483 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68001670 con 0x7f5a7806df50 2024-04-25T02:18:15.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.050+0000 7f5a7eb1b640 1 -- 172.21.15.79:0/1678246483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a7806df50 msgr2=0x7f5a7806e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:15.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.050+0000 7f5a7eb1b640 1 --2- 172.21.15.79:0/1678246483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a7806df50 0x7f5a7806e3e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0097a0 tx=0x7f5a6c02a0a0 comp rx=0 tx=0).stop 2024-04-25T02:18:15.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.050+0000 7f5a7eb1b640 1 -- 172.21.15.79:0/1678246483 shutdown_connections 2024-04-25T02:18:15.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.051+0000 7f5a7eb1b640 1 --2- 172.21.15.79:0/1678246483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a7806df50 0x7f5a7806e3e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:15.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.051+0000 7f5a7eb1b640 1 -- 172.21.15.79:0/1678246483 >> 172.21.15.79:0/1678246483 conn(0x7f5a780cfc80 msgr2=0x7f5a780d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:15.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.051+0000 7f5a7eb1b640 1 -- 172.21.15.79:0/1678246483 shutdown_connections 2024-04-25T02:18:15.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.051+0000 7f5a7eb1b640 1 -- 172.21.15.79:0/1678246483 wait complete. 2024-04-25T02:18:15.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.052+0000 7f5a7eb1b640 1 Processor -- start 2024-04-25T02:18:15.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.052+0000 7f5a7eb1b640 1 -- start start 2024-04-25T02:18:15.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7eb1b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7806df50 0x7f5a78140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:15.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7eb1b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a78071240 0x7f5a78156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:15.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7eb1b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a78144cb0 0x7f5a7815a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:15.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7eb1b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5a78145090 con 0x7f5a7806df50 2024-04-25T02:18:15.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7eb1b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5a780cf9d0 con 0x7f5a78144cb0 2024-04-25T02:18:15.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7eb1b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5a78145ab0 con 0x7f5a78071240 2024-04-25T02:18:15.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7c8b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7806df50 0x7f5a78140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:15.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7c8b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7806df50 0x7f5a78140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39152/0 (socket says 172.21.15.79:39152) 2024-04-25T02:18:15.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7c8b7640 1 -- 172.21.15.79:0/2000213179 learned_addr learned my addr 172.21.15.79:0/2000213179 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:15.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a77fff640 1 --2- 172.21.15.79:0/2000213179 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a78071240 0x7f5a78156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:15.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7d0b8640 1 --2- 172.21.15.79:0/2000213179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a78144cb0 0x7f5a7815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:15.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7c8b7640 1 -- 172.21.15.79:0/2000213179 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a78071240 msgr2=0x7f5a78156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:15.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7c8b7640 1 --2- 172.21.15.79:0/2000213179 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a78071240 0x7f5a78156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:15.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7c8b7640 1 -- 172.21.15.79:0/2000213179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a78144cb0 msgr2=0x7f5a7815a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:15.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7c8b7640 1 --2- 172.21.15.79:0/2000213179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a78144cb0 0x7f5a7815a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:15.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7c8b7640 1 -- 172.21.15.79:0/2000213179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a781573b0 con 0x7f5a7806df50 2024-04-25T02:18:15.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7c8b7640 1 --2- 172.21.15.79:0/2000213179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7806df50 0x7f5a78140a80 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800c750 tx=0x7f5a6800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:15.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a757fa640 1 -- 172.21.15.79:0/2000213179 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68017070 con 0x7f5a7806df50 2024-04-25T02:18:15.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a757fa640 1 -- 172.21.15.79:0/2000213179 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a68005ad0 con 0x7f5a7806df50 2024-04-25T02:18:15.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a7eb1b640 1 -- 172.21.15.79:0/2000213179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a780b3bb0 con 0x7f5a7806df50 2024-04-25T02:18:15.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.053+0000 7f5a757fa640 1 -- 172.21.15.79:0/2000213179 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68007070 con 0x7f5a7806df50 2024-04-25T02:18:15.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.054+0000 7f5a7eb1b640 1 -- 172.21.15.79:0/2000213179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a78157930 con 0x7f5a7806df50 2024-04-25T02:18:15.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.055+0000 7f5a7eb1b640 1 -- 172.21.15.79:0/2000213179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a78157760 con 0x7f5a7806df50 2024-04-25T02:18:15.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.055+0000 7f5a757fa640 1 -- 172.21.15.79:0/2000213179 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a6801a070 con 0x7f5a7806df50 2024-04-25T02:18:15.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.055+0000 7f5a757fa640 1 --2- 172.21.15.79:0/2000213179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5a6406be30 0x7f5a6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:15.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.056+0000 7f5a77fff640 1 --2- 172.21.15.79:0/2000213179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5a6406be30 0x7f5a6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:15.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.056+0000 7f5a757fa640 1 -- 172.21.15.79:0/2000213179 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f5a6808a040 con 0x7f5a7806df50 2024-04-25T02:18:15.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.056+0000 7f5a77fff640 1 --2- 172.21.15.79:0/2000213179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5a6406be30 0x7f5a6406e2f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c034000 tx=0x7f5a6c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:15.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.060+0000 7f5a757fa640 1 -- 172.21.15.79:0/2000213179 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5a680585f0 con 0x7f5a7806df50 2024-04-25T02:18:15.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.299+0000 7f5a7eb1b640 1 -- 172.21.15.79:0/2000213179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) -- 0x7f5a780d0b90 con 0x7f5a7806df50 2024-04-25T02:18:15.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.632+0000 7f5a757fa640 1 -- 172.21.15.79:0/2000213179 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v483) ==== 144+0+0 (secure 0 0 0) 0x7f5a6805c8f0 con 0x7f5a7806df50 2024-04-25T02:18:15.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.635+0000 7f5a7eb1b640 1 -- 172.21.15.79:0/2000213179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5a6406be30 msgr2=0x7f5a6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:15.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.635+0000 7f5a7eb1b640 1 --2- 172.21.15.79:0/2000213179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5a6406be30 0x7f5a6406e2f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c034000 tx=0x7f5a6c02e000 comp rx=0 tx=0).stop 2024-04-25T02:18:15.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.635+0000 7f5a7eb1b640 1 -- 172.21.15.79:0/2000213179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7806df50 msgr2=0x7f5a78140a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:15.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.635+0000 7f5a7eb1b640 1 --2- 172.21.15.79:0/2000213179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7806df50 0x7f5a78140a80 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800c750 tx=0x7f5a6800cc10 comp rx=0 tx=0).stop 2024-04-25T02:18:15.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.635+0000 7f5a7eb1b640 1 -- 172.21.15.79:0/2000213179 shutdown_connections 2024-04-25T02:18:15.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.635+0000 7f5a7eb1b640 1 --2- 172.21.15.79:0/2000213179 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5a6406be30 0x7f5a6406e2f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:15.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.635+0000 7f5a7eb1b640 1 --2- 172.21.15.79:0/2000213179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a78144cb0 0x7f5a7815a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:15.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.635+0000 7f5a7eb1b640 1 --2- 172.21.15.79:0/2000213179 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a78071240 0x7f5a78156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:15.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.635+0000 7f5a7eb1b640 1 --2- 172.21.15.79:0/2000213179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7806df50 0x7f5a78140a80 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:15.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.635+0000 7f5a7eb1b640 1 -- 172.21.15.79:0/2000213179 >> 172.21.15.79:0/2000213179 conn(0x7f5a780cfc80 msgr2=0x7f5a7815fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:15.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.635+0000 7f5a7eb1b640 1 -- 172.21.15.79:0/2000213179 shutdown_connections 2024-04-25T02:18:15.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:15.635+0000 7f5a7eb1b640 1 -- 172.21.15.79:0/2000213179 wait complete. 2024-04-25T02:18:15.650 INFO:tasks.cephfs_test_runner:test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T02:18:15.650 INFO:tasks.cephfs_test_runner: 2024-04-25T02:18:15.651 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T02:18:15.651 INFO:tasks.cephfs_test_runner:Ran 7 tests in 590.740s 2024-04-25T02:18:15.651 INFO:tasks.cephfs_test_runner: 2024-04-25T02:18:15.651 INFO:tasks.cephfs_test_runner:OK 2024-04-25T02:18:15.651 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-25T02:18:15.661 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T02:18:15.669 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T02:18:15.669 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:18:15.669 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:18:15.684 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:18:15.684 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T02:18:15.684 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:18:15.740 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056107,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14487 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:18:15.740 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:18:15.740 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:18:15.759 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:18:15.759 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-25T02:18:15.759 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:18:15.817 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:18:15.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:15.817 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:18:15.832 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:18:15.832 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:18:15.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:15.832 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:18:15.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:15.895 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:18:15.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:15.960 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-04-25T02:18:16.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:16.068 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-04-25T02:18:16.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:16.083 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-04-25T02:18:16.150 INFO:teuthology.orchestra.run.smithi079.stderr:Cannot find device "ceph-brx" 2024-04-25T02:18:16.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:18:16.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:16.152 DEBUG:teuthology.orchestra.run.smithi189:> ip netns list 2024-04-25T02:18:16.171 INFO:teuthology.orchestra.run.smithi189.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T02:18:16.171 INFO:teuthology.orchestra.run.smithi189.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T02:18:16.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:16.172 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T02:18:16.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:16.240 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T02:18:16.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:16.307 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link delete ceph-brx 2024-04-25T02:18:16.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:16.408 DEBUG:teuthology.orchestra.run.smithi189:> ip netns list 2024-04-25T02:18:16.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:16.423 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link delete ceph-brx 2024-04-25T02:18:16.491 INFO:teuthology.orchestra.run.smithi189.stderr:Cannot find device "ceph-brx" 2024-04-25T02:18:16.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:18:16.493 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T02:18:16.503 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T02:18:16.503 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:18:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.598+0000 7f0783b3b640 1 Processor -- start 2024-04-25T02:18:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.598+0000 7f0783b3b640 1 -- start start 2024-04-25T02:18:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.599+0000 7f0783b3b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f077c06df50 0x7f077c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.599+0000 7f0783b3b640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f077c0b2d30 0x7f077c0b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.599+0000 7f0783b3b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077c071e00 con 0x7f077c143bc0 2024-04-25T02:18:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.599+0000 7f0783b3b640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f077c06e8f0 con 0x7f077c0b2d30 2024-04-25T02:18:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.599+0000 7f0783b3b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f077c072cb0 con 0x7f077c06df50 2024-04-25T02:18:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.599+0000 7f07820d8640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f077c0b2d30 0x7f077c0b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.599+0000 7f07810d6640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f077c06df50 0x7f077c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.600+0000 7f07820d8640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f077c0b2d30 0x7f077c0b3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:51732/0 (socket says 172.21.15.79:51732) 2024-04-25T02:18:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.600+0000 7f07820d8640 1 -- 172.21.15.79:0/1614826787 learned_addr learned my addr 172.21.15.79:0/1614826787 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.600+0000 7f07810d6640 1 -- 172.21.15.79:0/1614826787 >> v2:172.21.15.189:3300/0 conn(0x7f077c0b2d30 msgr2=0x7f077c0b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.600+0000 7f07810d6640 1 --2- 172.21.15.79:0/1614826787 >> v2:172.21.15.189:3300/0 conn(0x7f077c0b2d30 0x7f077c0b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:16.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.600+0000 7f07810d6640 1 -- 172.21.15.79:0/1614826787 >> v1:172.21.15.189:6789/0 conn(0x7f077c143bc0 legacy=0x7f077c15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:16.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.600+0000 7f07810d6640 1 -- 172.21.15.79:0/1614826787 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c0720a0 con 0x7f077c06df50 2024-04-25T02:18:16.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.600+0000 7f07820d8640 1 --2- 172.21.15.79:0/1614826787 >> v2:172.21.15.189:3300/0 conn(0x7f077c0b2d30 0x7f077c0b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:16.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.601+0000 7f07810d6640 1 --2- 172.21.15.79:0/1614826787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f077c06df50 0x7f077c06e3b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f076c0097a0 tx=0x7f076c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34a5c7100ccd0b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:16.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.601+0000 7f07808d5640 1 -- 172.21.15.79:0/1614826787 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c037070 con 0x7f077c06df50 2024-04-25T02:18:16.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.601+0000 7f07808d5640 1 -- 172.21.15.79:0/1614826787 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f076c02ae50 con 0x7f077c06df50 2024-04-25T02:18:16.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.601+0000 7f07808d5640 1 -- 172.21.15.79:0/1614826787 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c032660 con 0x7f077c06df50 2024-04-25T02:18:16.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.601+0000 7f0783b3b640 1 -- 172.21.15.79:0/1614826787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f077c06df50 msgr2=0x7f077c06e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:16.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.601+0000 7f0783b3b640 1 --2- 172.21.15.79:0/1614826787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f077c06df50 0x7f077c06e3b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f076c0097a0 tx=0x7f076c02a100 comp rx=0 tx=0).stop 2024-04-25T02:18:16.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.601+0000 7f0783b3b640 1 -- 172.21.15.79:0/1614826787 shutdown_connections 2024-04-25T02:18:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.601+0000 7f0783b3b640 1 --2- 172.21.15.79:0/1614826787 >> v2:172.21.15.189:3300/0 conn(0x7f077c0b2d30 0x7f077c0b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.601+0000 7f0783b3b640 1 --2- 172.21.15.79:0/1614826787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f077c06df50 0x7f077c06e3b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.601+0000 7f0783b3b640 1 -- 172.21.15.79:0/1614826787 >> 172.21.15.79:0/1614826787 conn(0x7f077c0cfc80 msgr2=0x7f077c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.601+0000 7f0783b3b640 1 -- 172.21.15.79:0/1614826787 shutdown_connections 2024-04-25T02:18:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.601+0000 7f0783b3b640 1 -- 172.21.15.79:0/1614826787 wait complete. 2024-04-25T02:18:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.602+0000 7f0783b3b640 1 Processor -- start 2024-04-25T02:18:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.603+0000 7f0783b3b640 1 -- start start 2024-04-25T02:18:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.603+0000 7f0783b3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f077c06df50 0x7f077c1580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.603+0000 7f0783b3b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f077c0b2d30 0x7f077c157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.603+0000 7f0783b3b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f077c143bc0 0x7f077c0cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.603+0000 7f0783b3b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f077c072940 con 0x7f077c06df50 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.603+0000 7f0783b3b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f077c072660 con 0x7f077c0b2d30 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.603+0000 7f0783b3b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f077c143fa0 con 0x7f077c143bc0 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.603+0000 7f07818d7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f077c06df50 0x7f077c1580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.603+0000 7f07818d7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f077c06df50 0x7f077c1580e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39162/0 (socket says 172.21.15.79:39162) 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.603+0000 7f07818d7640 1 -- 172.21.15.79:0/266829302 learned_addr learned my addr 172.21.15.79:0/266829302 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.604+0000 7f07810d6640 1 --2- 172.21.15.79:0/266829302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f077c0b2d30 0x7f077c157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.604+0000 7f07820d8640 1 --2- 172.21.15.79:0/266829302 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f077c143bc0 0x7f077c0cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.604+0000 7f07818d7640 1 -- 172.21.15.79:0/266829302 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f077c143bc0 msgr2=0x7f077c0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.604+0000 7f07818d7640 1 --2- 172.21.15.79:0/266829302 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f077c143bc0 0x7f077c0cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.604+0000 7f07818d7640 1 -- 172.21.15.79:0/266829302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f077c0b2d30 msgr2=0x7f077c157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.604+0000 7f07818d7640 1 --2- 172.21.15.79:0/266829302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f077c0b2d30 0x7f077c157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.604+0000 7f07818d7640 1 -- 172.21.15.79:0/266829302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c158770 con 0x7f077c06df50 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.604+0000 7f07820d8640 1 --2- 172.21.15.79:0/266829302 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f077c143bc0 0x7f077c0cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.604+0000 7f07818d7640 1 --2- 172.21.15.79:0/266829302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f077c06df50 0x7f077c1580e0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f077800c7c0 tx=0x7f077800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.604+0000 7f07727fc640 1 -- 172.21.15.79:0/266829302 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778016020 con 0x7f077c06df50 2024-04-25T02:18:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.604+0000 7f07727fc640 1 -- 172.21.15.79:0/266829302 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0778006d50 con 0x7f077c06df50 2024-04-25T02:18:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.604+0000 7f07727fc640 1 -- 172.21.15.79:0/266829302 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778003bb0 con 0x7f077c06df50 2024-04-25T02:18:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.604+0000 7f0783b3b640 1 -- 172.21.15.79:0/266829302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f077c158a50 con 0x7f077c06df50 2024-04-25T02:18:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.604+0000 7f0783b3b640 1 -- 172.21.15.79:0/266829302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f077c159010 con 0x7f077c06df50 2024-04-25T02:18:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.605+0000 7f0783b3b640 1 -- 172.21.15.79:0/266829302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f077c0690a0 con 0x7f077c06df50 2024-04-25T02:18:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.605+0000 7f07727fc640 1 -- 172.21.15.79:0/266829302 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f077800a850 con 0x7f077c06df50 2024-04-25T02:18:16.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.606+0000 7f07727fc640 1 --2- 172.21.15.79:0/266829302 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f076006be30 0x7f076006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:16.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.606+0000 7f07727fc640 1 -- 172.21.15.79:0/266829302 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f077808a8d0 con 0x7f077c06df50 2024-04-25T02:18:16.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.606+0000 7f07810d6640 1 --2- 172.21.15.79:0/266829302 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f076006be30 0x7f076006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:16.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.606+0000 7f07810d6640 1 --2- 172.21.15.79:0/266829302 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f076006be30 0x7f076006e2f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f076c034000 tx=0x7f076c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:16.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.610+0000 7f07727fc640 1 -- 172.21.15.79:0/266829302 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0778020020 con 0x7f077c06df50 2024-04-25T02:18:16.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.781+0000 7f0783b3b640 1 -- 172.21.15.79:0/266829302 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f077c1593f0 con 0x7f076006be30 2024-04-25T02:18:16.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.782+0000 7f07727fc640 1 -- 172.21.15.79:0/266829302 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13411 (secure 0 0 0) 0x7f076c045480 con 0x7f076006be30 2024-04-25T02:18:16.786 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:16.786 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:18:16.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.784+0000 7f0783b3b640 1 -- 172.21.15.79:0/266829302 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f076006be30 msgr2=0x7f076006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:16.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.784+0000 7f0783b3b640 1 --2- 172.21.15.79:0/266829302 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f076006be30 0x7f076006e2f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f076c034000 tx=0x7f076c02e000 comp rx=0 tx=0).stop 2024-04-25T02:18:16.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.784+0000 7f0783b3b640 1 -- 172.21.15.79:0/266829302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f077c06df50 msgr2=0x7f077c1580e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:16.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.784+0000 7f0783b3b640 1 --2- 172.21.15.79:0/266829302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f077c06df50 0x7f077c1580e0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f077800c7c0 tx=0x7f077800cc80 comp rx=0 tx=0).stop 2024-04-25T02:18:16.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.784+0000 7f0783b3b640 1 -- 172.21.15.79:0/266829302 shutdown_connections 2024-04-25T02:18:16.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.784+0000 7f0783b3b640 1 --2- 172.21.15.79:0/266829302 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f076006be30 0x7f076006e2f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:16.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.784+0000 7f0783b3b640 1 --2- 172.21.15.79:0/266829302 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f077c143bc0 0x7f077c0cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:16.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.784+0000 7f0783b3b640 1 --2- 172.21.15.79:0/266829302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f077c0b2d30 0x7f077c157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:16.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.784+0000 7f0783b3b640 1 --2- 172.21.15.79:0/266829302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f077c06df50 0x7f077c1580e0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:16.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.784+0000 7f0783b3b640 1 -- 172.21.15.79:0/266829302 >> 172.21.15.79:0/266829302 conn(0x7f077c0cfc80 msgr2=0x7f077c070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:16.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.784+0000 7f0783b3b640 1 -- 172.21.15.79:0/266829302 shutdown_connections 2024-04-25T02:18:16.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.784+0000 7f0783b3b640 1 -- 172.21.15.79:0/266829302 wait complete. 2024-04-25T02:18:16.798 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":430,"stamp":"2024-04-25T02:18:15.311505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":278600,"kb_used_data":29184,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754696120,"statfs":{"total":773094113280,"available":772808826880,"internally_reserved":0,"allocated":29884416,"data_stored":23114432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390399,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-172,"num_write_kb":-8302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001151"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":352,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T02:17:57.649423+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:17:57.649423+0000","last_peered":"2024-04-25T02:17:57.649423+0000","last_clean":"2024-04-25T02:17:57.649423+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:17:57.649423+0000","last_undegraded":"2024-04-25T02:17:57.649423+0000","last_fullsized":"2024-04-25T02:17:57.649423+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33208,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338632,"statfs":{"total":96636764160,"available":96602759168,"internally_reserved":0,"allocated":2080768,"data_stored":1234633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574976,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36724,"kb_used_data":5548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335116,"statfs":{"total":96636764160,"available":96599158784,"internally_reserved":0,"allocated":5681152,"data_stored":4838030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574976,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1495040,"data_stored":644265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1478656,"data_stored":643649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36736,"kb_used_data":5560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335104,"statfs":{"total":96636764160,"available":96599146496,"internally_reserved":0,"allocated":5693440,"data_stored":4840857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1482752,"data_stored":643654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36724,"kb_used_data":5548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335116,"statfs":{"total":96636764160,"available":96599158784,"internally_reserved":0,"allocated":5681152,"data_stored":4838077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574976,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37320,"kb_used_data":6144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334520,"statfs":{"total":96636764160,"available":96598548480,"internally_reserved":0,"allocated":6291456,"data_stored":5431267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:18:16.799 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:18:16.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.891+0000 7f912cd09640 1 Processor -- start 2024-04-25T02:18:16.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.891+0000 7f912cd09640 1 -- start start 2024-04-25T02:18:16.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.891+0000 7f912cd09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9128143bc0 0x7f912815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:16.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.892+0000 7f912cd09640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f91280b3d40 0x7f912806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:16.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.892+0000 7f912cd09640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f912815fa40 con 0x7f912806df50 2024-04-25T02:18:16.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.892+0000 7f912cd09640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f912806e8f0 con 0x7f9128143bc0 2024-04-25T02:18:16.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.892+0000 7f912cd09640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f9128072cb0 con 0x7f91280b3d40 2024-04-25T02:18:16.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.892+0000 7f912659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9128143bc0 0x7f912815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:16.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.892+0000 7f912659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9128143bc0 0x7f912815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39178/0 (socket says 172.21.15.79:39178) 2024-04-25T02:18:16.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.892+0000 7f912659c640 1 -- 172.21.15.79:0/1308188111 learned_addr learned my addr 172.21.15.79:0/1308188111 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:16.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.892+0000 7f912659c640 1 -- 172.21.15.79:0/1308188111 >> v2:172.21.15.189:3300/0 conn(0x7f91280b3d40 msgr2=0x7f912806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:16.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.892+0000 7f912659c640 1 --2- 172.21.15.79:0/1308188111 >> v2:172.21.15.189:3300/0 conn(0x7f91280b3d40 0x7f912806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:16.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.892+0000 7f912659c640 1 -- 172.21.15.79:0/1308188111 >> v1:172.21.15.189:6789/0 conn(0x7f912806df50 legacy=0x7f91280b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:16.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.892+0000 7f912659c640 1 -- 172.21.15.79:0/1308188111 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9128071e00 con 0x7f9128143bc0 2024-04-25T02:18:16.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.893+0000 7f912659c640 1 --2- 172.21.15.79:0/1308188111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9128143bc0 0x7f912815f500 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f9128144cd0 tx=0x7f911c02c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83769324ad948871 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:16.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.893+0000 7f912559a640 1 -- 172.21.15.79:0/1308188111 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c032710 con 0x7f9128143bc0 2024-04-25T02:18:16.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.893+0000 7f912559a640 1 -- 172.21.15.79:0/1308188111 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f911c0328b0 con 0x7f9128143bc0 2024-04-25T02:18:16.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.893+0000 7f912559a640 1 -- 172.21.15.79:0/1308188111 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c032ca0 con 0x7f9128143bc0 2024-04-25T02:18:16.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.893+0000 7f912cd09640 1 -- 172.21.15.79:0/1308188111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9128143bc0 msgr2=0x7f912815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:16.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.893+0000 7f912cd09640 1 --2- 172.21.15.79:0/1308188111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9128143bc0 0x7f912815f500 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f9128144cd0 tx=0x7f911c02c850 comp rx=0 tx=0).stop 2024-04-25T02:18:16.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.893+0000 7f912cd09640 1 -- 172.21.15.79:0/1308188111 shutdown_connections 2024-04-25T02:18:16.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.893+0000 7f912cd09640 1 --2- 172.21.15.79:0/1308188111 >> v2:172.21.15.189:3300/0 conn(0x7f91280b3d40 0x7f912806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:16.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.893+0000 7f912cd09640 1 --2- 172.21.15.79:0/1308188111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9128143bc0 0x7f912815f500 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:16.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.893+0000 7f912cd09640 1 -- 172.21.15.79:0/1308188111 >> 172.21.15.79:0/1308188111 conn(0x7f91280cfc80 msgr2=0x7f91280d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:16.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.893+0000 7f912cd09640 1 -- 172.21.15.79:0/1308188111 shutdown_connections 2024-04-25T02:18:16.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.893+0000 7f912cd09640 1 -- 172.21.15.79:0/1308188111 wait complete. 2024-04-25T02:18:16.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.895+0000 7f912cd09640 1 Processor -- start 2024-04-25T02:18:16.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.895+0000 7f912cd09640 1 -- start start 2024-04-25T02:18:16.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.895+0000 7f912cd09640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f912806df50 0x7f9128157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:16.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.895+0000 7f912cd09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280b3d40 0x7f9128141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:16.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.895+0000 7f912cd09640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9128143bc0 0x7f91281422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:16.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.895+0000 7f912cd09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9128072660 con 0x7f91280b3d40 2024-04-25T02:18:16.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.895+0000 7f912cd09640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9128072380 con 0x7f912806df50 2024-04-25T02:18:16.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.895+0000 7f912cd09640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9128072940 con 0x7f9128143bc0 2024-04-25T02:18:16.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.895+0000 7f9125d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280b3d40 0x7f9128141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:16.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.895+0000 7f9125d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280b3d40 0x7f9128141d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39188/0 (socket says 172.21.15.79:39188) 2024-04-25T02:18:16.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.895+0000 7f9125d9b640 1 -- 172.21.15.79:0/1538265650 learned_addr learned my addr 172.21.15.79:0/1538265650 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:16.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.896+0000 7f912659c640 1 --2- 172.21.15.79:0/1538265650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f912806df50 0x7f9128157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:16.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.896+0000 7f9126d9d640 1 --2- 172.21.15.79:0/1538265650 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9128143bc0 0x7f91281422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:16.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.896+0000 7f9125d9b640 1 -- 172.21.15.79:0/1538265650 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9128143bc0 msgr2=0x7f91281422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:16.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.896+0000 7f9125d9b640 1 --2- 172.21.15.79:0/1538265650 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9128143bc0 0x7f91281422d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:16.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.896+0000 7f9125d9b640 1 -- 172.21.15.79:0/1538265650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f912806df50 msgr2=0x7f9128157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:16.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.896+0000 7f9125d9b640 1 --2- 172.21.15.79:0/1538265650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f912806df50 0x7f9128157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:16.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.896+0000 7f9125d9b640 1 -- 172.21.15.79:0/1538265650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9128158dc0 con 0x7f91280b3d40 2024-04-25T02:18:16.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.896+0000 7f9125d9b640 1 --2- 172.21.15.79:0/1538265650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280b3d40 0x7f9128141d90 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f911800b410 tx=0x7f911800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:16.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.896+0000 7f9116ffd640 1 -- 172.21.15.79:0/1538265650 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9118015020 con 0x7f91280b3d40 2024-04-25T02:18:16.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.896+0000 7f9116ffd640 1 -- 172.21.15.79:0/1538265650 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9118011830 con 0x7f91280b3d40 2024-04-25T02:18:16.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.896+0000 7f9116ffd640 1 -- 172.21.15.79:0/1538265650 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9118011c20 con 0x7f91280b3d40 2024-04-25T02:18:16.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.896+0000 7f912cd09640 1 -- 172.21.15.79:0/1538265650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91281590a0 con 0x7f91280b3d40 2024-04-25T02:18:16.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.896+0000 7f912cd09640 1 -- 172.21.15.79:0/1538265650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9128159660 con 0x7f91280b3d40 2024-04-25T02:18:16.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.897+0000 7f912cd09640 1 -- 172.21.15.79:0/1538265650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91280690a0 con 0x7f91280b3d40 2024-04-25T02:18:16.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.898+0000 7f9116ffd640 1 -- 172.21.15.79:0/1538265650 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9118018020 con 0x7f91280b3d40 2024-04-25T02:18:16.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.898+0000 7f9116ffd640 1 --2- 172.21.15.79:0/1538265650 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f910806be30 0x7f910806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:16.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.898+0000 7f9116ffd640 1 -- 172.21.15.79:0/1538265650 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f911808ab00 con 0x7f91280b3d40 2024-04-25T02:18:16.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.898+0000 7f912659c640 1 --2- 172.21.15.79:0/1538265650 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f910806be30 0x7f910806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:16.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.899+0000 7f912659c640 1 --2- 172.21.15.79:0/1538265650 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f910806be30 0x7f910806e2f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f911c037000 tx=0x7f911c032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:16.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:16.902+0000 7f9116ffd640 1 -- 172.21.15.79:0/1538265650 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f911801f020 con 0x7f91280b3d40 2024-04-25T02:18:17.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.070+0000 7f912cd09640 1 -- 172.21.15.79:0/1538265650 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f912815e060 con 0x7f910806be30 2024-04-25T02:18:17.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.071+0000 7f9116ffd640 1 -- 172.21.15.79:0/1538265650 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13411 (secure 0 0 0) 0x7f912815e060 con 0x7f910806be30 2024-04-25T02:18:17.076 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:17.076 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:18:17.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.073+0000 7f912cd09640 1 -- 172.21.15.79:0/1538265650 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f910806be30 msgr2=0x7f910806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.073+0000 7f912cd09640 1 --2- 172.21.15.79:0/1538265650 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f910806be30 0x7f910806e2f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f911c037000 tx=0x7f911c032000 comp rx=0 tx=0).stop 2024-04-25T02:18:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.073+0000 7f912cd09640 1 -- 172.21.15.79:0/1538265650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280b3d40 msgr2=0x7f9128141d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.073+0000 7f912cd09640 1 --2- 172.21.15.79:0/1538265650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280b3d40 0x7f9128141d90 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f911800b410 tx=0x7f911800b8d0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.073+0000 7f912cd09640 1 -- 172.21.15.79:0/1538265650 shutdown_connections 2024-04-25T02:18:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.073+0000 7f912cd09640 1 --2- 172.21.15.79:0/1538265650 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f910806be30 0x7f910806e2f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.073+0000 7f912cd09640 1 --2- 172.21.15.79:0/1538265650 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9128143bc0 0x7f91281422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.073+0000 7f912cd09640 1 --2- 172.21.15.79:0/1538265650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280b3d40 0x7f9128141d90 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.073+0000 7f912cd09640 1 --2- 172.21.15.79:0/1538265650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f912806df50 0x7f9128157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.073+0000 7f912cd09640 1 -- 172.21.15.79:0/1538265650 >> 172.21.15.79:0/1538265650 conn(0x7f91280cfc80 msgr2=0x7f91280ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.073+0000 7f912cd09640 1 -- 172.21.15.79:0/1538265650 shutdown_connections 2024-04-25T02:18:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.073+0000 7f912cd09640 1 -- 172.21.15.79:0/1538265650 wait complete. 2024-04-25T02:18:17.088 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":430,"stamp":"2024-04-25T02:18:15.311505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":278600,"kb_used_data":29184,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754696120,"statfs":{"total":773094113280,"available":772808826880,"internally_reserved":0,"allocated":29884416,"data_stored":23114432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390399,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-172,"num_write_kb":-8302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001151"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":352,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T02:17:57.649423+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:17:57.649423+0000","last_peered":"2024-04-25T02:17:57.649423+0000","last_clean":"2024-04-25T02:17:57.649423+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:17:57.649423+0000","last_undegraded":"2024-04-25T02:17:57.649423+0000","last_fullsized":"2024-04-25T02:17:57.649423+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33208,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338632,"statfs":{"total":96636764160,"available":96602759168,"internally_reserved":0,"allocated":2080768,"data_stored":1234633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574976,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36724,"kb_used_data":5548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335116,"statfs":{"total":96636764160,"available":96599158784,"internally_reserved":0,"allocated":5681152,"data_stored":4838030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574976,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1495040,"data_stored":644265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1478656,"data_stored":643649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36736,"kb_used_data":5560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335104,"statfs":{"total":96636764160,"available":96599146496,"internally_reserved":0,"allocated":5693440,"data_stored":4840857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1482752,"data_stored":643654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36724,"kb_used_data":5548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335116,"statfs":{"total":96636764160,"available":96599158784,"internally_reserved":0,"allocated":5681152,"data_stored":4838077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574976,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37320,"kb_used_data":6144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334520,"statfs":{"total":96636764160,"available":96598548480,"internally_reserved":0,"allocated":6291456,"data_stored":5431267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:18:17.088 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T02:18:17.089 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:18:17.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.181+0000 7f3f25716640 1 Processor -- start 2024-04-25T02:18:17.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.181+0000 7f3f25716640 1 -- start start 2024-04-25T02:18:17.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.182+0000 7f3f25716640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f3f20143bc0 0x7f3f2015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:17.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.182+0000 7f3f25716640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3f2006df50 0x7f3f2006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:17.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.182+0000 7f3f25716640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2015fa40 con 0x7f3f200b48e0 2024-04-25T02:18:17.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.182+0000 7f3f25716640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3f2006e8f0 con 0x7f3f2006df50 2024-04-25T02:18:17.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.182+0000 7f3f25716640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3f20072cb0 con 0x7f3f20143bc0 2024-04-25T02:18:17.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.182+0000 7f3f1e7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3f2006df50 0x7f3f2006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.182+0000 7f3f1f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3f200b48e0 0x7f3f200b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57964/0 (socket says 172.21.15.79:57964) 2024-04-25T02:18:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.182+0000 7f3f1f7fe640 1 -- 172.21.15.79:0/1658233048 learned_addr learned my addr 172.21.15.79:0/1658233048 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.182+0000 7f3f1effd640 1 --2- 172.21.15.79:0/1658233048 >> v2:172.21.15.189:3300/0 conn(0x7f3f20143bc0 0x7f3f2015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.182+0000 7f3f1e7fc640 1 -- 172.21.15.79:0/1658233048 >> v2:172.21.15.189:3300/0 conn(0x7f3f20143bc0 msgr2=0x7f3f2015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.182+0000 7f3f1e7fc640 1 --2- 172.21.15.79:0/1658233048 >> v2:172.21.15.189:3300/0 conn(0x7f3f20143bc0 0x7f3f2015f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.182+0000 7f3f1e7fc640 1 -- 172.21.15.79:0/1658233048 >> v1:172.21.15.79:6789/0 conn(0x7f3f200b48e0 legacy=0x7f3f200b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.182+0000 7f3f1dffb640 1 -- 172.21.15.79:0/1658233048 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481496735 0 0) 0x7f3f18001110 con 0x7f3f200b48e0 2024-04-25T02:18:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.182+0000 7f3f1e7fc640 1 -- 172.21.15.79:0/1658233048 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f20071e00 con 0x7f3f2006df50 2024-04-25T02:18:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.183+0000 7f3f1e7fc640 1 --2- 172.21.15.79:0/1658233048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f2006df50 0x7f3f2006e3b0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f3f20067b50 tx=0x7f3f1402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db453f1651503169 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.183+0000 7f3f1dffb640 1 -- 172.21.15.79:0/1658233048 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14037070 con 0x7f3f2006df50 2024-04-25T02:18:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.183+0000 7f3f1dffb640 1 -- 172.21.15.79:0/1658233048 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f14032440 con 0x7f3f2006df50 2024-04-25T02:18:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.183+0000 7f3f1dffb640 1 -- 172.21.15.79:0/1658233048 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1402ae60 con 0x7f3f2006df50 2024-04-25T02:18:17.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.184+0000 7f3f25716640 1 -- 172.21.15.79:0/1658233048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f2006df50 msgr2=0x7f3f2006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:17.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.184+0000 7f3f25716640 1 --2- 172.21.15.79:0/1658233048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f2006df50 0x7f3f2006e3b0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f3f20067b50 tx=0x7f3f1402a110 comp rx=0 tx=0).stop 2024-04-25T02:18:17.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.184+0000 7f3f25716640 1 -- 172.21.15.79:0/1658233048 shutdown_connections 2024-04-25T02:18:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.184+0000 7f3f25716640 1 --2- 172.21.15.79:0/1658233048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f2006df50 0x7f3f2006e3b0 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.184+0000 7f3f25716640 1 --2- 172.21.15.79:0/1658233048 >> v2:172.21.15.189:3300/0 conn(0x7f3f20143bc0 0x7f3f2015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.184+0000 7f3f25716640 1 -- 172.21.15.79:0/1658233048 >> 172.21.15.79:0/1658233048 conn(0x7f3f200cfc80 msgr2=0x7f3f200d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.184+0000 7f3f25716640 1 -- 172.21.15.79:0/1658233048 shutdown_connections 2024-04-25T02:18:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.184+0000 7f3f25716640 1 -- 172.21.15.79:0/1658233048 wait complete. 2024-04-25T02:18:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.185+0000 7f3f25716640 1 Processor -- start 2024-04-25T02:18:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.185+0000 7f3f25716640 1 -- start start 2024-04-25T02:18:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f25716640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f2006df50 0x7f3f20158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f25716640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3f200b48e0 0x7f3f201587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f25716640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f20143bc0 0x7f3f2015a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f25716640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3f20072660 con 0x7f3f20143bc0 2024-04-25T02:18:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f25716640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3f20072380 con 0x7f3f2006df50 2024-04-25T02:18:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f25716640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3f20072940 con 0x7f3f200b48e0 2024-04-25T02:18:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f1f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f20143bc0 0x7f3f2015a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f1f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f20143bc0 0x7f3f2015a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39200/0 (socket says 172.21.15.79:39200) 2024-04-25T02:18:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f1f7fe640 1 -- 172.21.15.79:0/3764295484 learned_addr learned my addr 172.21.15.79:0/3764295484 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f1effd640 1 --2- 172.21.15.79:0/3764295484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f2006df50 0x7f3f20158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f1e7fc640 1 --2- 172.21.15.79:0/3764295484 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3f200b48e0 0x7f3f201587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f1f7fe640 1 -- 172.21.15.79:0/3764295484 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3f200b48e0 msgr2=0x7f3f201587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f1f7fe640 1 --2- 172.21.15.79:0/3764295484 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3f200b48e0 0x7f3f201587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f1f7fe640 1 -- 172.21.15.79:0/3764295484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f2006df50 msgr2=0x7f3f20158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f1f7fe640 1 --2- 172.21.15.79:0/3764295484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f2006df50 0x7f3f20158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f1f7fe640 1 -- 172.21.15.79:0/3764295484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2015b190 con 0x7f3f20143bc0 2024-04-25T02:18:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f1f7fe640 1 --2- 172.21.15.79:0/3764295484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f20143bc0 0x7f3f2015a3d0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800c410 tx=0x7f3f1800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f077fe640 1 -- 172.21.15.79:0/3764295484 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f180074e0 con 0x7f3f20143bc0 2024-04-25T02:18:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f077fe640 1 -- 172.21.15.79:0/3764295484 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f180047e0 con 0x7f3f20143bc0 2024-04-25T02:18:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f25716640 1 -- 172.21.15.79:0/3764295484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f2015b470 con 0x7f3f20143bc0 2024-04-25T02:18:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f077fe640 1 -- 172.21.15.79:0/3764295484 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18004bd0 con 0x7f3f20143bc0 2024-04-25T02:18:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.186+0000 7f3f25716640 1 -- 172.21.15.79:0/3764295484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f2013d9c0 con 0x7f3f20143bc0 2024-04-25T02:18:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.187+0000 7f3f25716640 1 -- 172.21.15.79:0/3764295484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f2013dbc0 con 0x7f3f20143bc0 2024-04-25T02:18:17.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.188+0000 7f3f077fe640 1 -- 172.21.15.79:0/3764295484 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f18011070 con 0x7f3f20143bc0 2024-04-25T02:18:17.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.188+0000 7f3f077fe640 1 --2- 172.21.15.79:0/3764295484 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3f0c06be30 0x7f3f0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:17.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.188+0000 7f3f1effd640 1 --2- 172.21.15.79:0/3764295484 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3f0c06be30 0x7f3f0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:17.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.188+0000 7f3f077fe640 1 -- 172.21.15.79:0/3764295484 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f3f1808a680 con 0x7f3f20143bc0 2024-04-25T02:18:17.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.189+0000 7f3f1effd640 1 --2- 172.21.15.79:0/3764295484 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3f0c06be30 0x7f3f0c06e2f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000f510 tx=0x7f3f100077b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:17.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.192+0000 7f3f077fe640 1 -- 172.21.15.79:0/3764295484 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3f2013dbc0 con 0x7f3f20143bc0 2024-04-25T02:18:17.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.364+0000 7f3f25716640 1 -- 172.21.15.79:0/3764295484 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3f2013d250 con 0x7f3f0c06be30 2024-04-25T02:18:17.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.365+0000 7f3f077fe640 1 -- 172.21.15.79:0/3764295484 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13517 (secure 0 0 0) 0x7f3f2013d250 con 0x7f3f0c06be30 2024-04-25T02:18:17.369 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:17.370 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:18:17.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.368+0000 7f3f25716640 1 -- 172.21.15.79:0/3764295484 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3f0c06be30 msgr2=0x7f3f0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:17.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.368+0000 7f3f25716640 1 --2- 172.21.15.79:0/3764295484 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3f0c06be30 0x7f3f0c06e2f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000f510 tx=0x7f3f100077b0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.368+0000 7f3f25716640 1 -- 172.21.15.79:0/3764295484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f20143bc0 msgr2=0x7f3f2015a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:17.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.368+0000 7f3f25716640 1 --2- 172.21.15.79:0/3764295484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f20143bc0 0x7f3f2015a3d0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800c410 tx=0x7f3f1800c8d0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.368+0000 7f3f25716640 1 -- 172.21.15.79:0/3764295484 shutdown_connections 2024-04-25T02:18:17.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.368+0000 7f3f25716640 1 --2- 172.21.15.79:0/3764295484 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f3f0c06be30 0x7f3f0c06e2f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.368+0000 7f3f25716640 1 --2- 172.21.15.79:0/3764295484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f20143bc0 0x7f3f2015a3d0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.368+0000 7f3f25716640 1 --2- 172.21.15.79:0/3764295484 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3f200b48e0 0x7f3f201587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.368+0000 7f3f25716640 1 --2- 172.21.15.79:0/3764295484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f2006df50 0x7f3f20158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.368+0000 7f3f25716640 1 -- 172.21.15.79:0/3764295484 >> 172.21.15.79:0/3764295484 conn(0x7f3f200cfc80 msgr2=0x7f3f200b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:17.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.368+0000 7f3f25716640 1 -- 172.21.15.79:0/3764295484 shutdown_connections 2024-04-25T02:18:17.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.368+0000 7f3f25716640 1 -- 172.21.15.79:0/3764295484 wait complete. 2024-04-25T02:18:17.383 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":431,"stamp":"2024-04-25T02:18:17.311754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262512,"kb_used_data":13064,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712208,"statfs":{"total":773094113280,"available":772825300992,"internally_reserved":0,"allocated":13377536,"data_stored":6476448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8392252,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-176,"num_write_kb":-8305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001068"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":357,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T02:18:14.949331+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:18:14.949331+0000","last_peered":"2024-04-25T02:18:14.949331+0000","last_clean":"2024-04-25T02:18:14.949331+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:18:14.949331+0000","last_undegraded":"2024-04-25T02:18:14.949331+0000","last_fullsized":"2024-04-25T02:18:14.949331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574977,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33248,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2117632,"data_stored":1252332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574977,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574978,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574977,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574977,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574977,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33248,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2117632,"data_stored":1252332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:18:17.383 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:18:17.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.475+0000 7f41c8a46640 1 Processor -- start 2024-04-25T02:18:17.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.475+0000 7f41c8a46640 1 -- start start 2024-04-25T02:18:17.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.476+0000 7f41c8a46640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f41c4143bc0 0x7f41c415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:17.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.476+0000 7f41c8a46640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41c40b3d40 0x7f41c406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.476+0000 7f41c8a46640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c415fa40 con 0x7f41c406df50 2024-04-25T02:18:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.476+0000 7f41c8a46640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f41c406e8f0 con 0x7f41c40b3d40 2024-04-25T02:18:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.476+0000 7f41c8a46640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f41c4072cb0 con 0x7f41c4143bc0 2024-04-25T02:18:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.476+0000 7f41c2d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41c40b3d40 0x7f41c406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.476+0000 7f41c1d9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f41c406df50 0x7f41c40b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57978/0 (socket says 172.21.15.79:57978) 2024-04-25T02:18:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.476+0000 7f41c1d9b640 1 -- 172.21.15.79:0/3016351447 learned_addr learned my addr 172.21.15.79:0/3016351447 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.476+0000 7f41c259c640 1 --2- 172.21.15.79:0/3016351447 >> v2:172.21.15.189:3300/0 conn(0x7f41c4143bc0 0x7f41c415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.476+0000 7f41c2d9d640 1 -- 172.21.15.79:0/3016351447 >> v2:172.21.15.189:3300/0 conn(0x7f41c4143bc0 msgr2=0x7f41c415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.476+0000 7f41c2d9d640 1 --2- 172.21.15.79:0/3016351447 >> v2:172.21.15.189:3300/0 conn(0x7f41c4143bc0 0x7f41c415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.476+0000 7f41c2d9d640 1 -- 172.21.15.79:0/3016351447 >> v1:172.21.15.79:6789/0 conn(0x7f41c406df50 legacy=0x7f41c40b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.476+0000 7f41c159a640 1 -- 172.21.15.79:0/3016351447 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1155078044 0 0) 0x7f41b8001110 con 0x7f41c406df50 2024-04-25T02:18:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.476+0000 7f41c2d9d640 1 -- 172.21.15.79:0/3016351447 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c4071e00 con 0x7f41c40b3d40 2024-04-25T02:18:17.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.477+0000 7f41c2d9d640 1 --2- 172.21.15.79:0/3016351447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c40b3d40 0x7f41c406e3b0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f41c4067b50 tx=0x7f41bc02c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66ef8342519b710 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:17.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.477+0000 7f41c159a640 1 -- 172.21.15.79:0/3016351447 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc007740 con 0x7f41c40b3d40 2024-04-25T02:18:17.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.477+0000 7f41c159a640 1 -- 172.21.15.79:0/3016351447 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41bc0078e0 con 0x7f41c40b3d40 2024-04-25T02:18:17.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.477+0000 7f41c159a640 1 -- 172.21.15.79:0/3016351447 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc007cb0 con 0x7f41c40b3d40 2024-04-25T02:18:17.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.478+0000 7f41c8a46640 1 -- 172.21.15.79:0/3016351447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c40b3d40 msgr2=0x7f41c406e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:17.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.478+0000 7f41c8a46640 1 --2- 172.21.15.79:0/3016351447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c40b3d40 0x7f41c406e3b0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f41c4067b50 tx=0x7f41bc02c800 comp rx=0 tx=0).stop 2024-04-25T02:18:17.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.478+0000 7f41c8a46640 1 -- 172.21.15.79:0/3016351447 shutdown_connections 2024-04-25T02:18:17.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.478+0000 7f41c8a46640 1 --2- 172.21.15.79:0/3016351447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c40b3d40 0x7f41c406e3b0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.478+0000 7f41c8a46640 1 --2- 172.21.15.79:0/3016351447 >> v2:172.21.15.189:3300/0 conn(0x7f41c4143bc0 0x7f41c415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.478+0000 7f41c8a46640 1 -- 172.21.15.79:0/3016351447 >> 172.21.15.79:0/3016351447 conn(0x7f41c40cfc80 msgr2=0x7f41c40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:17.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.478+0000 7f41c8a46640 1 -- 172.21.15.79:0/3016351447 shutdown_connections 2024-04-25T02:18:17.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.478+0000 7f41c8a46640 1 -- 172.21.15.79:0/3016351447 wait complete. 2024-04-25T02:18:17.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.479+0000 7f41c8a46640 1 Processor -- start 2024-04-25T02:18:17.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.479+0000 7f41c8a46640 1 -- start start 2024-04-25T02:18:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c8a46640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c406df50 0x7f41c413f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c8a46640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41c40b3d40 0x7f41c4141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c8a46640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41c4143bc0 0x7f41c40cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c8a46640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f41c4072660 con 0x7f41c406df50 2024-04-25T02:18:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c8a46640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f41c4072380 con 0x7f41c40b3d40 2024-04-25T02:18:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c8a46640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f41c4072940 con 0x7f41c4143bc0 2024-04-25T02:18:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c406df50 0x7f41c413f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c406df50 0x7f41c413f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39216/0 (socket says 172.21.15.79:39216) 2024-04-25T02:18:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c259c640 1 -- 172.21.15.79:0/3548139377 learned_addr learned my addr 172.21.15.79:0/3548139377 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c259c640 1 -- 172.21.15.79:0/3548139377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41c4143bc0 msgr2=0x7f41c40cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c259c640 1 --2- 172.21.15.79:0/3548139377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41c4143bc0 0x7f41c40cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c259c640 1 -- 172.21.15.79:0/3548139377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41c40b3d40 msgr2=0x7f41c4141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c259c640 1 --2- 172.21.15.79:0/3548139377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41c40b3d40 0x7f41c4141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c259c640 1 -- 172.21.15.79:0/3548139377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c4142460 con 0x7f41c406df50 2024-04-25T02:18:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c259c640 1 --2- 172.21.15.79:0/3548139377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c406df50 0x7f41c413f7a0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f41b400e9e0 tx=0x7f41b400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41b2ffd640 1 -- 172.21.15.79:0/3548139377 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4017070 con 0x7f41c406df50 2024-04-25T02:18:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41b2ffd640 1 -- 172.21.15.79:0/3548139377 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b400c9d0 con 0x7f41c406df50 2024-04-25T02:18:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c8a46640 1 -- 172.21.15.79:0/3548139377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c4142740 con 0x7f41c406df50 2024-04-25T02:18:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41b2ffd640 1 -- 172.21.15.79:0/3548139377 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b400cdc0 con 0x7f41c406df50 2024-04-25T02:18:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.480+0000 7f41c8a46640 1 -- 172.21.15.79:0/3548139377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c40ac050 con 0x7f41c406df50 2024-04-25T02:18:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.481+0000 7f41c8a46640 1 -- 172.21.15.79:0/3548139377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c4142c60 con 0x7f41c406df50 2024-04-25T02:18:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.482+0000 7f41b2ffd640 1 -- 172.21.15.79:0/3548139377 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41b401a070 con 0x7f41c406df50 2024-04-25T02:18:17.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.482+0000 7f41b2ffd640 1 --2- 172.21.15.79:0/3548139377 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41a406be30 0x7f41a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:17.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.482+0000 7f41b2ffd640 1 -- 172.21.15.79:0/3548139377 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f41b408af30 con 0x7f41c406df50 2024-04-25T02:18:17.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.482+0000 7f41c1d9b640 1 --2- 172.21.15.79:0/3548139377 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41a406be30 0x7f41a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:17.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.483+0000 7f41c1d9b640 1 --2- 172.21.15.79:0/3548139377 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41a406be30 0x7f41a406e2f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f41b8007fd0 tx=0x7f41b8007960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:17.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.487+0000 7f41b2ffd640 1 -- 172.21.15.79:0/3548139377 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f41c4142c60 con 0x7f41c406df50 2024-04-25T02:18:17.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.659+0000 7f41c8a46640 1 -- 172.21.15.79:0/3548139377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41c40690a0 con 0x7f41c406df50 2024-04-25T02:18:17.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.660+0000 7f41b2ffd640 1 -- 172.21.15.79:0/3548139377 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+13300 (secure 0 0 0) 0x7f41b4059bc0 con 0x7f41c406df50 2024-04-25T02:18:17.664 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:17.664 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":122,"fsid":"696648c4-3e52-400b-a780-2e8863c56c42","created":"2024-04-25T02:07:35.048817+0000","modified":"2024-04-25T02:18:14.623722+0000","last_up_change":"2024-04-25T02:07:46.041624+0000","last_in_change":"2024-04-25T02:07:37.143202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:07:47.204372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ebc5722-e360-466e-9772-ea294d40fd42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6804","nonce":1526100659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6808","nonce":1526100659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6815","nonce":1526100659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1526100659},{"type":"v1","addr":"172.21.15.79:6812","nonce":1526100659}]},"public_addr":"172.21.15.79:6804/1526100659","cluster_addr":"172.21.15.79:6808/1526100659","heartbeat_back_addr":"172.21.15.79:6815/1526100659","heartbeat_front_addr":"172.21.15.79:6812/1526100659","state":["exists","up"]},{"osd":1,"uuid":"5fc8e48c-c206-4ce7-99fb-cef1f0d1ffd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6818","nonce":2311596149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6822","nonce":2311596149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6831","nonce":2311596149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2311596149},{"type":"v1","addr":"172.21.15.79:6826","nonce":2311596149}]},"public_addr":"172.21.15.79:6818/2311596149","cluster_addr":"172.21.15.79:6822/2311596149","heartbeat_back_addr":"172.21.15.79:6831/2311596149","heartbeat_front_addr":"172.21.15.79:6826/2311596149","state":["exists","up"]},{"osd":2,"uuid":"9720c83a-6aa9-4956-a0b0-8eb53c39e83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6801","nonce":3397511354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6805","nonce":3397511354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6813","nonce":3397511354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":3397511354},{"type":"v1","addr":"172.21.15.79:6809","nonce":3397511354}]},"public_addr":"172.21.15.79:6801/3397511354","cluster_addr":"172.21.15.79:6805/3397511354","heartbeat_back_addr":"172.21.15.79:6813/3397511354","heartbeat_front_addr":"172.21.15.79:6809/3397511354","state":["exists","up"]},{"osd":3,"uuid":"97df9030-94b6-4d52-85b8-e6f65d28aa94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6819","nonce":3072297369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6823","nonce":3072297369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6830","nonce":3072297369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3072297369},{"type":"v1","addr":"172.21.15.79:6827","nonce":3072297369}]},"public_addr":"172.21.15.79:6819/3072297369","cluster_addr":"172.21.15.79:6823/3072297369","heartbeat_back_addr":"172.21.15.79:6830/3072297369","heartbeat_front_addr":"172.21.15.79:6827/3072297369","state":["exists","up"]},{"osd":4,"uuid":"01998311-0652-4821-9bd0-2b71efbf2374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6801","nonce":1910571406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6803","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6805","nonce":1910571406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6813","nonce":1910571406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6807","nonce":1910571406},{"type":"v1","addr":"172.21.15.189:6809","nonce":1910571406}]},"public_addr":"172.21.15.189:6801/1910571406","cluster_addr":"172.21.15.189:6805/1910571406","heartbeat_back_addr":"172.21.15.189:6813/1910571406","heartbeat_front_addr":"172.21.15.189:6809/1910571406","state":["exists","up"]},{"osd":5,"uuid":"753b1def-8b53-410f-aa76-247b4e9af214","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6804","nonce":1246927196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6808","nonce":1246927196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6815","nonce":1246927196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":1246927196},{"type":"v1","addr":"172.21.15.189:6812","nonce":1246927196}]},"public_addr":"172.21.15.189:6804/1246927196","cluster_addr":"172.21.15.189:6808/1246927196","heartbeat_back_addr":"172.21.15.189:6815/1246927196","heartbeat_front_addr":"172.21.15.189:6812/1246927196","state":["exists","up"]},{"osd":6,"uuid":"7df7d139-c9b1-482d-a2d1-2ef0a2cb098d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6817","nonce":1254358257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6819","nonce":1254358257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6823","nonce":1254358257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1254358257},{"type":"v1","addr":"172.21.15.189:6821","nonce":1254358257}]},"public_addr":"172.21.15.189:6817/1254358257","cluster_addr":"172.21.15.189:6819/1254358257","heartbeat_back_addr":"172.21.15.189:6823/1254358257","heartbeat_front_addr":"172.21.15.189:6821/1254358257","state":["exists","up"]},{"osd":7,"uuid":"42a478b7-1359-452f-970a-77a15f006b84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6825","nonce":3421948491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6827","nonce":3421948491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6831","nonce":3421948491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3421948491},{"type":"v1","addr":"172.21.15.189:6829","nonce":3421948491}]},"public_addr":"172.21.15.189:6825/3421948491","cluster_addr":"172.21.15.189:6827/3421948491","heartbeat_back_addr":"172.21.15.189:6831/3421948491","heartbeat_front_addr":"172.21.15.189:6829/3421948491","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.278046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.308731+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.255766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.284485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.249078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.303872+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.297685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:07:42.352504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/623571175":"2024-04-26T02:18:11.327671+0000","172.21.15.79:6836/623571175":"2024-04-26T02:18:11.327671+0000","172.21.15.79:6837/3097428733":"2024-04-26T02:17:57.569963+0000","172.21.15.79:6836/3097428733":"2024-04-26T02:17:57.569963+0000","172.21.15.79:6837/2134535107":"2024-04-26T02:17:47.006917+0000","172.21.15.79:6836/2134535107":"2024-04-26T02:17:47.006917+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:18:17.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.662+0000 7f41c8a46640 1 -- 172.21.15.79:0/3548139377 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41a406be30 msgr2=0x7f41a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:17.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.662+0000 7f41c8a46640 1 --2- 172.21.15.79:0/3548139377 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41a406be30 0x7f41a406e2f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f41b8007fd0 tx=0x7f41b8007960 comp rx=0 tx=0).stop 2024-04-25T02:18:17.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.662+0000 7f41c8a46640 1 -- 172.21.15.79:0/3548139377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c406df50 msgr2=0x7f41c413f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:17.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.662+0000 7f41c8a46640 1 --2- 172.21.15.79:0/3548139377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c406df50 0x7f41c413f7a0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f41b400e9e0 tx=0x7f41b400eea0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.662+0000 7f41c8a46640 1 -- 172.21.15.79:0/3548139377 shutdown_connections 2024-04-25T02:18:17.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.662+0000 7f41c8a46640 1 --2- 172.21.15.79:0/3548139377 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f41a406be30 0x7f41a406e2f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.662+0000 7f41c8a46640 1 --2- 172.21.15.79:0/3548139377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f41c4143bc0 0x7f41c40cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.662+0000 7f41c8a46640 1 --2- 172.21.15.79:0/3548139377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41c40b3d40 0x7f41c4141ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.662+0000 7f41c8a46640 1 --2- 172.21.15.79:0/3548139377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c406df50 0x7f41c413f7a0 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:17.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.662+0000 7f41c8a46640 1 -- 172.21.15.79:0/3548139377 >> 172.21.15.79:0/3548139377 conn(0x7f41c40cfc80 msgr2=0x7f41c40cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:17.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.662+0000 7f41c8a46640 1 -- 172.21.15.79:0/3548139377 shutdown_connections 2024-04-25T02:18:17.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:17.662+0000 7f41c8a46640 1 -- 172.21.15.79:0/3548139377 wait complete. 2024-04-25T02:18:18.677 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T02:18:18.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:18:18.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.783+0000 7f116466d640 1 Processor -- start 2024-04-25T02:18:18.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.783+0000 7f116466d640 1 -- start start 2024-04-25T02:18:18.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.784+0000 7f116466d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f115c0d2f20 0x7f115c0d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:18.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.784+0000 7f116466d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f115c0d1e80 con 0x7f115c0d0ed0 2024-04-25T02:18:18.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.784+0000 7f116466d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f115c0d2160 con 0x7f115c15e440 2024-04-25T02:18:18.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.784+0000 7f116466d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f115c0d2440 con 0x7f115c0d2f20 2024-04-25T02:18:18.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.785+0000 7f1161c08640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f115c0d2f20 0x7f115c0d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:18.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.785+0000 7f1162c0a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f115c0d0ed0 0x7f115c0b6ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57990/0 (socket says 172.21.15.79:57990) 2024-04-25T02:18:18.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.785+0000 7f1162c0a640 1 -- 172.21.15.79:0/184171381 learned_addr learned my addr 172.21.15.79:0/184171381 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:18.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.785+0000 7f1161c08640 1 -- 172.21.15.79:0/184171381 >> v1:172.21.15.189:6789/0 conn(0x7f115c15e440 legacy=0x7f115c0cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:18.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.785+0000 7f1161c08640 1 -- 172.21.15.79:0/184171381 >> v1:172.21.15.79:6789/0 conn(0x7f115c0d0ed0 legacy=0x7f115c0b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:18.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.785+0000 7f1161407640 1 -- 172.21.15.79:0/184171381 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1497769626 0 0) 0x7f115c0d1e80 con 0x7f115c0d0ed0 2024-04-25T02:18:18.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.785+0000 7f1161c08640 1 -- 172.21.15.79:0/184171381 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c0d2720 con 0x7f115c0d2f20 2024-04-25T02:18:18.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.786+0000 7f1161c08640 1 --2- 172.21.15.79:0/184171381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c0d2f20 0x7f115c0d0990 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f114c0097a0 tx=0x7f114c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97066c4f714a63f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:18.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.786+0000 7f1161407640 1 -- 172.21.15.79:0/184171381 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c037070 con 0x7f115c0d2f20 2024-04-25T02:18:18.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.786+0000 7f1161407640 1 -- 172.21.15.79:0/184171381 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f114c032440 con 0x7f115c0d2f20 2024-04-25T02:18:18.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.786+0000 7f1161407640 1 -- 172.21.15.79:0/184171381 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c032810 con 0x7f115c0d2f20 2024-04-25T02:18:18.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.786+0000 7f116466d640 1 -- 172.21.15.79:0/184171381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c0d2f20 msgr2=0x7f115c0d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:18.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.786+0000 7f116466d640 1 --2- 172.21.15.79:0/184171381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c0d2f20 0x7f115c0d0990 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f114c0097a0 tx=0x7f114c02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:18:18.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.786+0000 7f116466d640 1 -- 172.21.15.79:0/184171381 shutdown_connections 2024-04-25T02:18:18.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.786+0000 7f116466d640 1 --2- 172.21.15.79:0/184171381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c0d2f20 0x7f115c0d0990 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:18.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.786+0000 7f116466d640 1 -- 172.21.15.79:0/184171381 >> 172.21.15.79:0/184171381 conn(0x7f115c09d450 msgr2=0x7f115c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:18.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.786+0000 7f116466d640 1 -- 172.21.15.79:0/184171381 shutdown_connections 2024-04-25T02:18:18.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.786+0000 7f116466d640 1 -- 172.21.15.79:0/184171381 wait complete. 2024-04-25T02:18:18.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.787+0000 7f116466d640 1 Processor -- start 2024-04-25T02:18:18.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.788+0000 7f116466d640 1 -- start start 2024-04-25T02:18:18.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.788+0000 7f116466d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f115c0d0ed0 0x7f115c0ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:18.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.788+0000 7f116466d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f115c0d2f20 0x7f115c0c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:18.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.788+0000 7f116466d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c15e440 0x7f115c1f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:18.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.788+0000 7f116466d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f115c0d0100 con 0x7f115c15e440 2024-04-25T02:18:18.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.788+0000 7f116466d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f115c0cff80 con 0x7f115c0d0ed0 2024-04-25T02:18:18.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.788+0000 7f116466d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f115c0b7600 con 0x7f115c0d2f20 2024-04-25T02:18:18.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.788+0000 7f1162c0a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c15e440 0x7f115c1f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.788+0000 7f1162c0a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c15e440 0x7f115c1f7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39230/0 (socket says 172.21.15.79:39230) 2024-04-25T02:18:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.788+0000 7f1162c0a640 1 -- 172.21.15.79:0/698483869 learned_addr learned my addr 172.21.15.79:0/698483869 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.789+0000 7f1161c08640 1 --2- 172.21.15.79:0/698483869 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f115c0d2f20 0x7f115c0c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.789+0000 7f1162409640 1 --2- 172.21.15.79:0/698483869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f115c0d0ed0 0x7f115c0ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.789+0000 7f1162c0a640 1 -- 172.21.15.79:0/698483869 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f115c0d2f20 msgr2=0x7f115c0c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.789+0000 7f1162c0a640 1 --2- 172.21.15.79:0/698483869 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f115c0d2f20 0x7f115c0c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.789+0000 7f1162c0a640 1 -- 172.21.15.79:0/698483869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f115c0d0ed0 msgr2=0x7f115c0ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.789+0000 7f1162c0a640 1 --2- 172.21.15.79:0/698483869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f115c0d0ed0 0x7f115c0ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.789+0000 7f1162c0a640 1 -- 172.21.15.79:0/698483869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c0ca970 con 0x7f115c15e440 2024-04-25T02:18:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.789+0000 7f1162c0a640 1 --2- 172.21.15.79:0/698483869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c15e440 0x7f115c1f7ef0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f115400c7a0 tx=0x7f115400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.789+0000 7f1152ffd640 1 -- 172.21.15.79:0/698483869 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154018070 con 0x7f115c15e440 2024-04-25T02:18:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.789+0000 7f1152ffd640 1 -- 172.21.15.79:0/698483869 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f115400a5e0 con 0x7f115c15e440 2024-04-25T02:18:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.789+0000 7f116466d640 1 -- 172.21.15.79:0/698483869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115c0ce190 con 0x7f115c15e440 2024-04-25T02:18:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.789+0000 7f1152ffd640 1 -- 172.21.15.79:0/698483869 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115400aa50 con 0x7f115c15e440 2024-04-25T02:18:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.789+0000 7f116466d640 1 -- 172.21.15.79:0/698483869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f115c0cdbd0 con 0x7f115c15e440 2024-04-25T02:18:18.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.790+0000 7f116466d640 1 -- 172.21.15.79:0/698483869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f115c0ce5f0 con 0x7f115c15e440 2024-04-25T02:18:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.790+0000 7f1152ffd640 1 -- 172.21.15.79:0/698483869 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f115401b070 con 0x7f115c15e440 2024-04-25T02:18:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.791+0000 7f1152ffd640 1 --2- 172.21.15.79:0/698483869 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f114006be30 0x7f114006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.791+0000 7f1162409640 1 --2- 172.21.15.79:0/698483869 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f114006be30 0x7f114006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.791+0000 7f1152ffd640 1 -- 172.21.15.79:0/698483869 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f115408a1c0 con 0x7f115c15e440 2024-04-25T02:18:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.791+0000 7f1152ffd640 1 --2- 172.21.15.79:0/698483869 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x7f1140071e30 0x7f1140074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.791+0000 7f1152ffd640 1 -- 172.21.15.79:0/698483869 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1140074900 con 0x7f1140071e30 2024-04-25T02:18:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.791+0000 7f1152ffd640 1 -- 172.21.15.79:0/698483869 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7f1154091050 con 0x7f115c15e440 2024-04-25T02:18:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.791+0000 7f1161c08640 1 --2- 172.21.15.79:0/698483869 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x7f1140071e30 0x7f1140074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.791+0000 7f1162409640 1 --2- 172.21.15.79:0/698483869 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f114006be30 0x7f114006e2f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1158006fd0 tx=0x7f1158008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.791+0000 7f1161c08640 1 --2- 172.21.15.79:0/698483869 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x7f1140071e30 0x7f1140074250 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.792+0000 7f1152ffd640 1 -- 172.21.15.79:0/698483869 <== osd.0 v2:172.21.15.79:6802/1526100659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1140074900 con 0x7f1140071e30 2024-04-25T02:18:18.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.805+0000 7f116466d640 1 -- 172.21.15.79:0/698483869 --> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f115c0690a0 con 0x7f1140071e30 2024-04-25T02:18:18.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.805+0000 7f1152ffd640 1 -- 172.21.15.79:0/698483869 <== osd.0 v2:172.21.15.79:6802/1526100659 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f115c0690a0 con 0x7f1140071e30 2024-04-25T02:18:18.809 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:18:18.810 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:18:18.810 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:18:18.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.806+0000 7f116466d640 1 -- 172.21.15.79:0/698483869 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x7f1140071e30 msgr2=0x7f1140074250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:18.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.806+0000 7f116466d640 1 --2- 172.21.15.79:0/698483869 >> [v2:172.21.15.79:6802/1526100659,v1:172.21.15.79:6804/1526100659] conn(0x7f1140071e30 0x7f1140074250 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:18.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.806+0000 7f116466d640 1 -- 172.21.15.79:0/698483869 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f114006be30 msgr2=0x7f114006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:18.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.806+0000 7f116466d640 1 --2- 172.21.15.79:0/698483869 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f114006be30 0x7f114006e2f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1158006fd0 tx=0x7f1158008040 comp rx=0 tx=0).stop 2024-04-25T02:18:18.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.806+0000 7f116466d640 1 -- 172.21.15.79:0/698483869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c15e440 msgr2=0x7f115c1f7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:18.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.806+0000 7f116466d640 1 --2- 172.21.15.79:0/698483869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c15e440 0x7f115c1f7ef0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f115400c7a0 tx=0x7f115400cc60 comp rx=0 tx=0).stop 2024-04-25T02:18:18.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.806+0000 7f1162c0a640 1 -- 172.21.15.79:0/698483869 reap_dead start 2024-04-25T02:18:18.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.806+0000 7f116466d640 1 -- 172.21.15.79:0/698483869 shutdown_connections 2024-04-25T02:18:18.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.806+0000 7f116466d640 1 -- 172.21.15.79:0/698483869 >> 172.21.15.79:0/698483869 conn(0x7f115c09d450 msgr2=0x7f115c0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:18.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.806+0000 7f116466d640 1 -- 172.21.15.79:0/698483869 shutdown_connections 2024-04-25T02:18:18.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.806+0000 7f116466d640 1 -- 172.21.15.79:0/698483869 wait complete. 2024-04-25T02:18:18.820 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T02:18:18.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.914+0000 7f35eca4d640 1 Processor -- start 2024-04-25T02:18:18.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.914+0000 7f35eca4d640 1 -- start start 2024-04-25T02:18:18.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.914+0000 7f35eca4d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35e8143bc0 0x7f35e815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:18.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.914+0000 7f35eca4d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f35e806df50 0x7f35e806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:18.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.914+0000 7f35eca4d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35e80b48e0 0x7f35e80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:18.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.914+0000 7f35eca4d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f35e806e8f0 con 0x7f35e8143bc0 2024-04-25T02:18:18.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.914+0000 7f35eca4d640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f35e8072cb0 con 0x7f35e806df50 2024-04-25T02:18:18.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.914+0000 7f35eca4d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f35e815fa40 con 0x7f35e80b48e0 2024-04-25T02:18:18.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.915+0000 7f35e659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35e8143bc0 0x7f35e815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:18.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.915+0000 7f35e659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35e8143bc0 0x7f35e815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39236/0 (socket says 172.21.15.79:39236) 2024-04-25T02:18:18.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.915+0000 7f35e659c640 1 -- 172.21.15.79:0/2959839332 learned_addr learned my addr 172.21.15.79:0/2959839332 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:18.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.915+0000 7f35dffff640 1 --2- 172.21.15.79:0/2959839332 >> v2:172.21.15.189:3300/0 conn(0x7f35e806df50 0x7f35e806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:18.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.915+0000 7f35e6d9d640 1 --2- 172.21.15.79:0/2959839332 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35e80b48e0 0x7f35e80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:18.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.915+0000 7f35e659c640 1 -- 172.21.15.79:0/2959839332 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35e80b48e0 msgr2=0x7f35e80b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:18.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.915+0000 7f35e659c640 1 --2- 172.21.15.79:0/2959839332 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35e80b48e0 0x7f35e80b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:18.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.915+0000 7f35e659c640 1 -- 172.21.15.79:0/2959839332 >> v2:172.21.15.189:3300/0 conn(0x7f35e806df50 msgr2=0x7f35e806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:18.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.915+0000 7f35e659c640 1 --2- 172.21.15.79:0/2959839332 >> v2:172.21.15.189:3300/0 conn(0x7f35e806df50 0x7f35e806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:18.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.915+0000 7f35e659c640 1 -- 172.21.15.79:0/2959839332 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e8071e00 con 0x7f35e8143bc0 2024-04-25T02:18:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.916+0000 7f35e659c640 1 --2- 172.21.15.79:0/2959839332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e8143bc0 0x7f35e815f500 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f35e80cf960 tx=0x7f35d802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ecfa26d8835407 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.916+0000 7f35e5d9b640 1 -- 172.21.15.79:0/2959839332 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d8037070 con 0x7f35e8143bc0 2024-04-25T02:18:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.916+0000 7f35e5d9b640 1 -- 172.21.15.79:0/2959839332 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d8032440 con 0x7f35e8143bc0 2024-04-25T02:18:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.916+0000 7f35e5d9b640 1 -- 172.21.15.79:0/2959839332 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d8032810 con 0x7f35e8143bc0 2024-04-25T02:18:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.916+0000 7f35eca4d640 1 -- 172.21.15.79:0/2959839332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e8143bc0 msgr2=0x7f35e815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.916+0000 7f35eca4d640 1 --2- 172.21.15.79:0/2959839332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e8143bc0 0x7f35e815f500 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f35e80cf960 tx=0x7f35d802a140 comp rx=0 tx=0).stop 2024-04-25T02:18:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.916+0000 7f35eca4d640 1 -- 172.21.15.79:0/2959839332 shutdown_connections 2024-04-25T02:18:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.916+0000 7f35eca4d640 1 --2- 172.21.15.79:0/2959839332 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35e80b48e0 0x7f35e80b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.916+0000 7f35eca4d640 1 --2- 172.21.15.79:0/2959839332 >> v2:172.21.15.189:3300/0 conn(0x7f35e806df50 0x7f35e806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.916+0000 7f35eca4d640 1 --2- 172.21.15.79:0/2959839332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e8143bc0 0x7f35e815f500 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.916+0000 7f35eca4d640 1 -- 172.21.15.79:0/2959839332 >> 172.21.15.79:0/2959839332 conn(0x7f35e80cfc80 msgr2=0x7f35e80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.916+0000 7f35eca4d640 1 -- 172.21.15.79:0/2959839332 shutdown_connections 2024-04-25T02:18:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.916+0000 7f35eca4d640 1 -- 172.21.15.79:0/2959839332 wait complete. 2024-04-25T02:18:18.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.918+0000 7f35eca4d640 1 Processor -- start 2024-04-25T02:18:18.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.918+0000 7f35eca4d640 1 -- start start 2024-04-25T02:18:18.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.918+0000 7f35eca4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e806df50 0x7f35e80a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:18.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.918+0000 7f35eca4d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f35e80b48e0 0x7f35e80afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:18.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.918+0000 7f35eca4d640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35e8143bc0 0x7f35e813ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:18.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.918+0000 7f35eca4d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8072660 con 0x7f35e806df50 2024-04-25T02:18:18.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.918+0000 7f35eca4d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8072380 con 0x7f35e80b48e0 2024-04-25T02:18:18.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.918+0000 7f35eca4d640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f35e8072940 con 0x7f35e8143bc0 2024-04-25T02:18:18.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.918+0000 7f35e659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e806df50 0x7f35e80a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:18.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.919+0000 7f35e659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e806df50 0x7f35e80a9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39242/0 (socket says 172.21.15.79:39242) 2024-04-25T02:18:18.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.919+0000 7f35e659c640 1 -- 172.21.15.79:0/1219255291 learned_addr learned my addr 172.21.15.79:0/1219255291 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:18.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.919+0000 7f35e6d9d640 1 --2- 172.21.15.79:0/1219255291 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35e8143bc0 0x7f35e813ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:18.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.919+0000 7f35dffff640 1 --2- 172.21.15.79:0/1219255291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f35e80b48e0 0x7f35e80afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:18.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.919+0000 7f35e659c640 1 -- 172.21.15.79:0/1219255291 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35e8143bc0 msgr2=0x7f35e813ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:18.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.919+0000 7f35e659c640 1 --2- 172.21.15.79:0/1219255291 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35e8143bc0 0x7f35e813ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:18.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.919+0000 7f35e659c640 1 -- 172.21.15.79:0/1219255291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f35e80b48e0 msgr2=0x7f35e80afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:18.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.919+0000 7f35e659c640 1 --2- 172.21.15.79:0/1219255291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f35e80b48e0 0x7f35e80afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:18.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.919+0000 7f35e659c640 1 -- 172.21.15.79:0/1219255291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e8141eb0 con 0x7f35e806df50 2024-04-25T02:18:18.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.919+0000 7f35e659c640 1 --2- 172.21.15.79:0/1219255291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e806df50 0x7f35e80a9dc0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f35d802a180 tx=0x7f35d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:18.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.919+0000 7f35deffd640 1 -- 172.21.15.79:0/1219255291 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d8041020 con 0x7f35e806df50 2024-04-25T02:18:18.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.919+0000 7f35deffd640 1 -- 172.21.15.79:0/1219255291 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d803d620 con 0x7f35e806df50 2024-04-25T02:18:18.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.919+0000 7f35deffd640 1 -- 172.21.15.79:0/1219255291 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d8037040 con 0x7f35e806df50 2024-04-25T02:18:18.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.919+0000 7f35eca4d640 1 -- 172.21.15.79:0/1219255291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e8142190 con 0x7f35e806df50 2024-04-25T02:18:18.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.919+0000 7f35eca4d640 1 -- 172.21.15.79:0/1219255291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e8142750 con 0x7f35e806df50 2024-04-25T02:18:18.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.920+0000 7f35eca4d640 1 -- 172.21.15.79:0/1219255291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e80690a0 con 0x7f35e806df50 2024-04-25T02:18:18.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.920+0000 7f35deffd640 1 -- 172.21.15.79:0/1219255291 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35d8044020 con 0x7f35e806df50 2024-04-25T02:18:18.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.921+0000 7f35deffd640 1 --2- 172.21.15.79:0/1219255291 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f35c806be60 0x7f35c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:18.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.921+0000 7f35deffd640 1 -- 172.21.15.79:0/1219255291 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f35d80ab210 con 0x7f35e806df50 2024-04-25T02:18:18.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.921+0000 7f35dffff640 1 --2- 172.21.15.79:0/1219255291 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f35c806be60 0x7f35c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:18.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.921+0000 7f35dffff640 1 --2- 172.21.15.79:0/1219255291 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f35c806be60 0x7f35c806e320 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f35e81435d0 tx=0x7f35d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:18.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:18.925+0000 7f35deffd640 1 -- 172.21.15.79:0/1219255291 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f35d804b030 con 0x7f35e806df50 2024-04-25T02:18:19.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.097+0000 7f35eca4d640 1 -- 172.21.15.79:0/1219255291 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f35e80b5cb0 con 0x7f35c806be60 2024-04-25T02:18:19.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.097+0000 7f35deffd640 1 -- 172.21.15.79:0/1219255291 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f35e80b5cb0 con 0x7f35c806be60 2024-04-25T02:18:19.101 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T02:18:19.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.099+0000 7f35eca4d640 1 -- 172.21.15.79:0/1219255291 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f35c806be60 msgr2=0x7f35c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.099+0000 7f35eca4d640 1 --2- 172.21.15.79:0/1219255291 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f35c806be60 0x7f35c806e320 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f35e81435d0 tx=0x7f35d0008040 comp rx=0 tx=0).stop 2024-04-25T02:18:19.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.099+0000 7f35eca4d640 1 -- 172.21.15.79:0/1219255291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e806df50 msgr2=0x7f35e80a9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.099+0000 7f35eca4d640 1 --2- 172.21.15.79:0/1219255291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e806df50 0x7f35e80a9dc0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f35d802a180 tx=0x7f35d80046c0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.099+0000 7f35eca4d640 1 -- 172.21.15.79:0/1219255291 shutdown_connections 2024-04-25T02:18:19.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.099+0000 7f35eca4d640 1 --2- 172.21.15.79:0/1219255291 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f35c806be60 0x7f35c806e320 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.099+0000 7f35eca4d640 1 --2- 172.21.15.79:0/1219255291 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35e8143bc0 0x7f35e813ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.099+0000 7f35eca4d640 1 --2- 172.21.15.79:0/1219255291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f35e80b48e0 0x7f35e80afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.099+0000 7f35eca4d640 1 --2- 172.21.15.79:0/1219255291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e806df50 0x7f35e80a9dc0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.099+0000 7f35eca4d640 1 -- 172.21.15.79:0/1219255291 >> 172.21.15.79:0/1219255291 conn(0x7f35e80cfc80 msgr2=0x7f35e8143fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:19.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.099+0000 7f35eca4d640 1 -- 172.21.15.79:0/1219255291 shutdown_connections 2024-04-25T02:18:19.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.099+0000 7f35eca4d640 1 -- 172.21.15.79:0/1219255291 wait complete. 2024-04-25T02:18:19.114 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T02:18:19.114 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:18:19.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.211+0000 7f63daa38640 1 Processor -- start 2024-04-25T02:18:19.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.211+0000 7f63daa38640 1 -- start start 2024-04-25T02:18:19.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.212+0000 7f63daa38640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d406d2f0 0x7f63d406d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.212+0000 7f63daa38640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d40ae610 con 0x7f63d41447b0 2024-04-25T02:18:19.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.212+0000 7f63daa38640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d40ae8f0 con 0x7f63d40b2da0 2024-04-25T02:18:19.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.212+0000 7f63daa38640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f63d406dc90 con 0x7f63d406d2f0 2024-04-25T02:18:19.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.212+0000 7f63d3fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f63d41447b0 0x7f63d4072a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57994/0 (socket says 172.21.15.79:57994) 2024-04-25T02:18:19.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.212+0000 7f63d3fff640 1 -- 172.21.15.79:0/663213837 learned_addr learned my addr 172.21.15.79:0/663213837 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:19.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.212+0000 7f63d37fe640 1 --2- 172.21.15.79:0/663213837 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d406d2f0 0x7f63d406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.212+0000 7f63d2ffd640 1 -- 172.21.15.79:0/663213837 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4269181997 0 0) 0x7f63d40ae610 con 0x7f63d41447b0 2024-04-25T02:18:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.212+0000 7f63d2ffd640 1 -- 172.21.15.79:0/663213837 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63bc003520 con 0x7f63d41447b0 2024-04-25T02:18:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d2ffd640 1 -- 172.21.15.79:0/663213837 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4127527648 0 0) 0x7f63bc003520 con 0x7f63d41447b0 2024-04-25T02:18:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d2ffd640 1 -- 172.21.15.79:0/663213837 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d406d2f0 msgr2=0x7f63d406d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d2ffd640 1 --2- 172.21.15.79:0/663213837 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d406d2f0 0x7f63d406d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d2ffd640 1 -- 172.21.15.79:0/663213837 >> v1:172.21.15.189:6789/0 conn(0x7f63d40b2da0 legacy=0x7f63d40b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d2ffd640 1 -- 172.21.15.79:0/663213837 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d4072260 con 0x7f63d41447b0 2024-04-25T02:18:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d2ffd640 1 -- 172.21.15.79:0/663213837 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f63c4001670 con 0x7f63d41447b0 2024-04-25T02:18:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d2ffd640 1 -- 172.21.15.79:0/663213837 >> v1:172.21.15.79:6789/0 conn(0x7f63d41447b0 legacy=0x7f63d4072a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d2ffd640 1 --2- 172.21.15.79:0/663213837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63bc0039e0 0x7f63bc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d2ffd640 1 --2- 172.21.15.79:0/663213837 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d406d2f0 0x7f63bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d2ffd640 1 --2- 172.21.15.79:0/663213837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63bc004d40 0x7f63bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d2ffd640 1 -- 172.21.15.79:0/663213837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f63bc00b9c0 con 0x7f63bc0039e0 2024-04-25T02:18:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d2ffd640 1 -- 172.21.15.79:0/663213837 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f63bc00bb40 con 0x7f63bc004d40 2024-04-25T02:18:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d2ffd640 1 -- 172.21.15.79:0/663213837 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f63bc00bd40 con 0x7f63d406d2f0 2024-04-25T02:18:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d3fff640 1 --2- 172.21.15.79:0/663213837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63bc0039e0 0x7f63bc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d37fe640 1 --2- 172.21.15.79:0/663213837 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d406d2f0 0x7f63bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d8fd5640 1 --2- 172.21.15.79:0/663213837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63bc004d40 0x7f63bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d3fff640 1 -- 172.21.15.79:0/663213837 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d406d2f0 msgr2=0x7f63bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d3fff640 1 --2- 172.21.15.79:0/663213837 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d406d2f0 0x7f63bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d3fff640 1 -- 172.21.15.79:0/663213837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63bc004d40 msgr2=0x7f63bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d3fff640 1 --2- 172.21.15.79:0/663213837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63bc004d40 0x7f63bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d3fff640 1 -- 172.21.15.79:0/663213837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63bc003520 con 0x7f63bc0039e0 2024-04-25T02:18:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.213+0000 7f63d37fe640 1 --2- 172.21.15.79:0/663213837 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d406d2f0 0x7f63bc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.214+0000 7f63d3fff640 1 --2- 172.21.15.79:0/663213837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63bc0039e0 0x7f63bc003dc0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f63c4007cf0 tx=0x7f63bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2436461e40e62c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.214+0000 7f63d2ffd640 1 -- 172.21.15.79:0/663213837 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c4007d30 con 0x7f63bc0039e0 2024-04-25T02:18:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.214+0000 7f63d2ffd640 1 -- 172.21.15.79:0/663213837 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c4037070 con 0x7f63bc0039e0 2024-04-25T02:18:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.214+0000 7f63d2ffd640 1 -- 172.21.15.79:0/663213837 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c4033d40 con 0x7f63bc0039e0 2024-04-25T02:18:19.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.214+0000 7f63daa38640 1 -- 172.21.15.79:0/663213837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63bc0039e0 msgr2=0x7f63bc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.214+0000 7f63daa38640 1 --2- 172.21.15.79:0/663213837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63bc0039e0 0x7f63bc003dc0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f63c4007cf0 tx=0x7f63bc005830 comp rx=0 tx=0).stop 2024-04-25T02:18:19.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.214+0000 7f63d8fd5640 1 -- 172.21.15.79:0/663213837 reap_dead start 2024-04-25T02:18:19.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.214+0000 7f63daa38640 1 -- 172.21.15.79:0/663213837 shutdown_connections 2024-04-25T02:18:19.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.214+0000 7f63daa38640 1 -- 172.21.15.79:0/663213837 >> 172.21.15.79:0/663213837 conn(0x7f63d406b4a0 msgr2=0x7f63d406b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:19.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.215+0000 7f63daa38640 1 -- 172.21.15.79:0/663213837 shutdown_connections 2024-04-25T02:18:19.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.215+0000 7f63daa38640 1 -- 172.21.15.79:0/663213837 wait complete. 2024-04-25T02:18:19.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.216+0000 7f63daa38640 1 Processor -- start 2024-04-25T02:18:19.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.216+0000 7f63daa38640 1 -- start start 2024-04-25T02:18:19.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.216+0000 7f63daa38640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63bc0039e0 0x7f63d40adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.216+0000 7f63daa38640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d415f380 0x7f63d4162060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.216+0000 7f63daa38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63d413efe0 0x7f63d40cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.216+0000 7f63daa38640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f63d4071e80 con 0x7f63d413efe0 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.216+0000 7f63daa38640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f63d4144b90 con 0x7f63bc0039e0 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.216+0000 7f63daa38640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f63d4072000 con 0x7f63d415f380 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.217+0000 7f63d8fd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63d413efe0 0x7f63d40cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.217+0000 7f63d8fd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63d413efe0 0x7f63d40cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39252/0 (socket says 172.21.15.79:39252) 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.217+0000 7f63d8fd5640 1 -- 172.21.15.79:0/3340220284 learned_addr learned my addr 172.21.15.79:0/3340220284 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.217+0000 7f63d8fd5640 1 -- 172.21.15.79:0/3340220284 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d415f380 msgr2=0x7f63d4162060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.217+0000 7f63d8fd5640 1 --2- 172.21.15.79:0/3340220284 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d415f380 0x7f63d4162060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.217+0000 7f63d8fd5640 1 -- 172.21.15.79:0/3340220284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63bc0039e0 msgr2=0x7f63d40adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.217+0000 7f63d3fff640 1 --2- 172.21.15.79:0/3340220284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63bc0039e0 0x7f63d40adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.217+0000 7f63d8fd5640 1 --2- 172.21.15.79:0/3340220284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63bc0039e0 0x7f63d40adfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.217+0000 7f63d8fd5640 1 -- 172.21.15.79:0/3340220284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d415fb20 con 0x7f63d413efe0 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.217+0000 7f63d8fd5640 1 --2- 172.21.15.79:0/3340220284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63d413efe0 0x7f63d40cd470 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f63d4148000 tx=0x7f63cc00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.217+0000 7f63d0ff9640 1 -- 172.21.15.79:0/3340220284 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc019070 con 0x7f63d413efe0 2024-04-25T02:18:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.217+0000 7f63d0ff9640 1 -- 172.21.15.79:0/3340220284 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63cc006d60 con 0x7f63d413efe0 2024-04-25T02:18:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.217+0000 7f63d0ff9640 1 -- 172.21.15.79:0/3340220284 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc003bb0 con 0x7f63d413efe0 2024-04-25T02:18:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.217+0000 7f63daa38640 1 -- 172.21.15.79:0/3340220284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d4161580 con 0x7f63d413efe0 2024-04-25T02:18:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.217+0000 7f63daa38640 1 -- 172.21.15.79:0/3340220284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d4161b40 con 0x7f63d413efe0 2024-04-25T02:18:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.218+0000 7f63daa38640 1 -- 172.21.15.79:0/3340220284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f63d415f8c0 con 0x7f63d413efe0 2024-04-25T02:18:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.219+0000 7f63d0ff9640 1 -- 172.21.15.79:0/3340220284 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63cc01c070 con 0x7f63d413efe0 2024-04-25T02:18:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.219+0000 7f63d0ff9640 1 --2- 172.21.15.79:0/3340220284 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f63c006be60 0x7f63c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.219+0000 7f63d0ff9640 1 -- 172.21.15.79:0/3340220284 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f63cc08a210 con 0x7f63d413efe0 2024-04-25T02:18:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.219+0000 7f63d3fff640 1 --2- 172.21.15.79:0/3340220284 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f63c006be60 0x7f63c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.219+0000 7f63d0ff9640 1 --2- 172.21.15.79:0/3340220284 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x7f63c0071e60 0x7f63c0074280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.219+0000 7f63d0ff9640 1 -- 172.21.15.79:0/3340220284 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63cc00ce50 con 0x7f63c0071e60 2024-04-25T02:18:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.219+0000 7f63d0ff9640 1 -- 172.21.15.79:0/3340220284 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7f63cc08a6a0 con 0x7f63d413efe0 2024-04-25T02:18:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.219+0000 7f63d37fe640 1 --2- 172.21.15.79:0/3340220284 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x7f63c0071e60 0x7f63c0074280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.220+0000 7f63d3fff640 1 --2- 172.21.15.79:0/3340220284 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f63c006be60 0x7f63c006e320 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f63c403b000 tx=0x7f63c4009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:19.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.220+0000 7f63d37fe640 1 --2- 172.21.15.79:0/3340220284 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x7f63c0071e60 0x7f63c0074280 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:19.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.220+0000 7f63d0ff9640 1 -- 172.21.15.79:0/3340220284 <== osd.1 v2:172.21.15.79:6816/2311596149 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63cc00ce50 con 0x7f63c0071e60 2024-04-25T02:18:19.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.233+0000 7f63daa38640 1 -- 172.21.15.79:0/3340220284 --> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f63d40ae610 con 0x7f63c0071e60 2024-04-25T02:18:19.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.234+0000 7f63d0ff9640 1 -- 172.21.15.79:0/3340220284 <== osd.1 v2:172.21.15.79:6816/2311596149 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f63d40ae610 con 0x7f63c0071e60 2024-04-25T02:18:19.238 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:18:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:18:19.238 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:18:19.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.234+0000 7f63daa38640 1 -- 172.21.15.79:0/3340220284 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x7f63c0071e60 msgr2=0x7f63c0074280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.234+0000 7f63daa38640 1 --2- 172.21.15.79:0/3340220284 >> [v2:172.21.15.79:6816/2311596149,v1:172.21.15.79:6818/2311596149] conn(0x7f63c0071e60 0x7f63c0074280 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.234+0000 7f63daa38640 1 -- 172.21.15.79:0/3340220284 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f63c006be60 msgr2=0x7f63c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.234+0000 7f63daa38640 1 --2- 172.21.15.79:0/3340220284 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f63c006be60 0x7f63c006e320 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f63c403b000 tx=0x7f63c4009030 comp rx=0 tx=0).stop 2024-04-25T02:18:19.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.234+0000 7f63daa38640 1 -- 172.21.15.79:0/3340220284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63d413efe0 msgr2=0x7f63d40cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.234+0000 7f63daa38640 1 --2- 172.21.15.79:0/3340220284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63d413efe0 0x7f63d40cd470 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f63d4148000 tx=0x7f63cc00ff70 comp rx=0 tx=0).stop 2024-04-25T02:18:19.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.234+0000 7f63d8fd5640 1 -- 172.21.15.79:0/3340220284 reap_dead start 2024-04-25T02:18:19.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.234+0000 7f63daa38640 1 -- 172.21.15.79:0/3340220284 shutdown_connections 2024-04-25T02:18:19.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.234+0000 7f63daa38640 1 -- 172.21.15.79:0/3340220284 >> 172.21.15.79:0/3340220284 conn(0x7f63d406b4a0 msgr2=0x7f63d4147340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:19.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.234+0000 7f63daa38640 1 -- 172.21.15.79:0/3340220284 shutdown_connections 2024-04-25T02:18:19.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.234+0000 7f63daa38640 1 -- 172.21.15.79:0/3340220284 wait complete. 2024-04-25T02:18:19.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T02:18:19.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.342+0000 7f4bf3410640 1 Processor -- start 2024-04-25T02:18:19.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.342+0000 7f4bf3410640 1 -- start start 2024-04-25T02:18:19.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.343+0000 7f4bf3410640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4bec0b3570 0x7f4bec0d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.343+0000 7f4bf3410640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4bec0b3020 0x7f4bec0d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.343+0000 7f4bf3410640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bec06c380 con 0x7f4bec15e4d0 2024-04-25T02:18:19.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.343+0000 7f4bf3410640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4bec0d1660 con 0x7f4bec0b3570 2024-04-25T02:18:19.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.343+0000 7f4bf3410640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4bec0d1380 con 0x7f4bec0b3020 2024-04-25T02:18:19.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.343+0000 7f4bf09ab640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4bec0b3570 0x7f4bec0d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.343+0000 7f4bf11ac640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4bec15e4d0 0x7f4bec06bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57998/0 (socket says 172.21.15.79:57998) 2024-04-25T02:18:19.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.343+0000 7f4bf11ac640 1 -- 172.21.15.79:0/2391486721 learned_addr learned my addr 172.21.15.79:0/2391486721 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:19.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.343+0000 7f4bf19ad640 1 --2- 172.21.15.79:0/2391486721 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4bec0b3020 0x7f4bec0d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.343+0000 7f4bf09ab640 1 -- 172.21.15.79:0/2391486721 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4bec0b3020 msgr2=0x7f4bec0d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:19.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.343+0000 7f4bf09ab640 1 --2- 172.21.15.79:0/2391486721 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4bec0b3020 0x7f4bec0d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.343+0000 7f4bf09ab640 1 -- 172.21.15.79:0/2391486721 >> v1:172.21.15.79:6789/0 conn(0x7f4bec15e4d0 legacy=0x7f4bec06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.343+0000 7f4bf09ab640 1 -- 172.21.15.79:0/2391486721 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bec0cede0 con 0x7f4bec0b3570 2024-04-25T02:18:19.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.343+0000 7f4be3fff640 1 -- 172.21.15.79:0/2391486721 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2056629914 0 0) 0x7f4bec06c380 con 0x7f4bec15e4d0 2024-04-25T02:18:19.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.343+0000 7f4bf19ad640 1 --2- 172.21.15.79:0/2391486721 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4bec0b3020 0x7f4bec0d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:19.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.344+0000 7f4bf09ab640 1 --2- 172.21.15.79:0/2391486721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0b3570 0x7f4bec0d2710 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0097d0 tx=0x7f4bdc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ed28913c52f763 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:19.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.344+0000 7f4be3fff640 1 -- 172.21.15.79:0/2391486721 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc037070 con 0x7f4bec0b3570 2024-04-25T02:18:19.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.344+0000 7f4be3fff640 1 -- 172.21.15.79:0/2391486721 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bdc032440 con 0x7f4bec0b3570 2024-04-25T02:18:19.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.344+0000 7f4be3fff640 1 -- 172.21.15.79:0/2391486721 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc032810 con 0x7f4bec0b3570 2024-04-25T02:18:19.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.344+0000 7f4bf3410640 1 -- 172.21.15.79:0/2391486721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0b3570 msgr2=0x7f4bec0d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.344+0000 7f4bf3410640 1 --2- 172.21.15.79:0/2391486721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0b3570 0x7f4bec0d2710 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0097d0 tx=0x7f4bdc02a1c0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.344+0000 7f4bf3410640 1 -- 172.21.15.79:0/2391486721 shutdown_connections 2024-04-25T02:18:19.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.344+0000 7f4bf3410640 1 --2- 172.21.15.79:0/2391486721 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4bec0b3020 0x7f4bec0d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.344+0000 7f4bf3410640 1 --2- 172.21.15.79:0/2391486721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0b3570 0x7f4bec0d2710 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.344+0000 7f4bf3410640 1 -- 172.21.15.79:0/2391486721 >> 172.21.15.79:0/2391486721 conn(0x7f4bec09d460 msgr2=0x7f4bec0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:19.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.344+0000 7f4bf3410640 1 -- 172.21.15.79:0/2391486721 shutdown_connections 2024-04-25T02:18:19.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.345+0000 7f4bf3410640 1 -- 172.21.15.79:0/2391486721 wait complete. 2024-04-25T02:18:19.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.346+0000 7f4bf3410640 1 Processor -- start 2024-04-25T02:18:19.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.346+0000 7f4bf3410640 1 -- start start 2024-04-25T02:18:19.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.346+0000 7f4bf3410640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0b3020 0x7f4bec0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.346+0000 7f4bf3410640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4bec0b3570 0x7f4bec1f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.346+0000 7f4bf3410640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bec15e4d0 0x7f4bec0b8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.346+0000 7f4bf3410640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4bec0d20d0 con 0x7f4bec0b3020 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.346+0000 7f4bf3410640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4bec15e8b0 con 0x7f4bec15e4d0 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.346+0000 7f4bf3410640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4bec0d2250 con 0x7f4bec0b3570 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.346+0000 7f4bf11ac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0b3020 0x7f4bec0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.346+0000 7f4bf11ac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0b3020 0x7f4bec0b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39270/0 (socket says 172.21.15.79:39270) 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.346+0000 7f4bf11ac640 1 -- 172.21.15.79:0/2221979850 learned_addr learned my addr 172.21.15.79:0/2221979850 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.347+0000 7f4bf09ab640 1 --2- 172.21.15.79:0/2221979850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4bec0b3570 0x7f4bec1f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.347+0000 7f4bf19ad640 1 --2- 172.21.15.79:0/2221979850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bec15e4d0 0x7f4bec0b8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.347+0000 7f4bf11ac640 1 -- 172.21.15.79:0/2221979850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4bec0b3570 msgr2=0x7f4bec1f35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.347+0000 7f4bf11ac640 1 --2- 172.21.15.79:0/2221979850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4bec0b3570 0x7f4bec1f35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.347+0000 7f4bf11ac640 1 -- 172.21.15.79:0/2221979850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bec15e4d0 msgr2=0x7f4bec0b8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.347+0000 7f4bf11ac640 1 --2- 172.21.15.79:0/2221979850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bec15e4d0 0x7f4bec0b8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.347+0000 7f4bf11ac640 1 -- 172.21.15.79:0/2221979850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bec0b4380 con 0x7f4bec0b3020 2024-04-25T02:18:19.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.347+0000 7f4bf09ab640 1 --2- 172.21.15.79:0/2221979850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4bec0b3570 0x7f4bec1f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:19.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.347+0000 7f4bf11ac640 1 --2- 172.21.15.79:0/2221979850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0b3020 0x7f4bec0b3ac0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f4be800c4d0 tx=0x7f4be800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:19.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.347+0000 7f4be1ffb640 1 -- 172.21.15.79:0/2221979850 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be8018070 con 0x7f4bec0b3020 2024-04-25T02:18:19.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.347+0000 7f4be1ffb640 1 -- 172.21.15.79:0/2221979850 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4be8007500 con 0x7f4bec0b3020 2024-04-25T02:18:19.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.347+0000 7f4bf3410640 1 -- 172.21.15.79:0/2221979850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bec0b4660 con 0x7f4bec0b3020 2024-04-25T02:18:19.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.347+0000 7f4be1ffb640 1 -- 172.21.15.79:0/2221979850 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be8004a20 con 0x7f4bec0b3020 2024-04-25T02:18:19.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.347+0000 7f4bf3410640 1 -- 172.21.15.79:0/2221979850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bec0b4c20 con 0x7f4bec0b3020 2024-04-25T02:18:19.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.348+0000 7f4bf3410640 1 -- 172.21.15.79:0/2221979850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bec0690a0 con 0x7f4bec0b3020 2024-04-25T02:18:19.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.349+0000 7f4be1ffb640 1 -- 172.21.15.79:0/2221979850 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4be801b070 con 0x7f4bec0b3020 2024-04-25T02:18:19.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.349+0000 7f4be1ffb640 1 --2- 172.21.15.79:0/2221979850 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4bd006be30 0x7f4bd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.349+0000 7f4be1ffb640 1 -- 172.21.15.79:0/2221979850 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f4be8089f90 con 0x7f4bec0b3020 2024-04-25T02:18:19.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.349+0000 7f4bf09ab640 1 --2- 172.21.15.79:0/2221979850 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4bd006be30 0x7f4bd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.349+0000 7f4bf09ab640 1 --2- 172.21.15.79:0/2221979850 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4bd006be30 0x7f4bd006e2f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc034000 tx=0x7f4bdc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:19.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.353+0000 7f4be1ffb640 1 -- 172.21.15.79:0/2221979850 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4be8058b90 con 0x7f4bec0b3020 2024-04-25T02:18:19.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.527+0000 7f4bf3410640 1 -- 172.21.15.79:0/2221979850 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f4bec06d2c0 con 0x7f4bd006be30 2024-04-25T02:18:19.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.527+0000 7f4be1ffb640 1 -- 172.21.15.79:0/2221979850 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4bec06d2c0 con 0x7f4bd006be30 2024-04-25T02:18:19.531 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T02:18:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.529+0000 7f4bf3410640 1 -- 172.21.15.79:0/2221979850 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4bd006be30 msgr2=0x7f4bd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.529+0000 7f4bf3410640 1 --2- 172.21.15.79:0/2221979850 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4bd006be30 0x7f4bd006e2f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc034000 tx=0x7f4bdc02e000 comp rx=0 tx=0).stop 2024-04-25T02:18:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.529+0000 7f4bf3410640 1 -- 172.21.15.79:0/2221979850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0b3020 msgr2=0x7f4bec0b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.529+0000 7f4bf3410640 1 --2- 172.21.15.79:0/2221979850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0b3020 0x7f4bec0b3ac0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f4be800c4d0 tx=0x7f4be800c990 comp rx=0 tx=0).stop 2024-04-25T02:18:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.529+0000 7f4bf3410640 1 -- 172.21.15.79:0/2221979850 shutdown_connections 2024-04-25T02:18:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.529+0000 7f4bf3410640 1 --2- 172.21.15.79:0/2221979850 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f4bd006be30 0x7f4bd006e2f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.529+0000 7f4bf3410640 1 --2- 172.21.15.79:0/2221979850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bec15e4d0 0x7f4bec0b8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.529+0000 7f4bf3410640 1 --2- 172.21.15.79:0/2221979850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4bec0b3570 0x7f4bec1f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.529+0000 7f4bf3410640 1 --2- 172.21.15.79:0/2221979850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0b3020 0x7f4bec0b3ac0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.529+0000 7f4bf3410640 1 -- 172.21.15.79:0/2221979850 >> 172.21.15.79:0/2221979850 conn(0x7f4bec09d460 msgr2=0x7f4bec06c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.529+0000 7f4bf3410640 1 -- 172.21.15.79:0/2221979850 shutdown_connections 2024-04-25T02:18:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.529+0000 7f4bf3410640 1 -- 172.21.15.79:0/2221979850 wait complete. 2024-04-25T02:18:19.544 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T02:18:19.544 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:18:19.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.641+0000 7f8f274a5640 1 Processor -- start 2024-04-25T02:18:19.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.641+0000 7f8f274a5640 1 -- start start 2024-04-25T02:18:19.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f274a5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2006c510 0x7f8f2006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f274a5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f20071d80 0x7f8f200d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f274a5640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8f200c5bd0 0x7f8f2015ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f274a5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8f2015ead0 con 0x7f8f20071d80 2024-04-25T02:18:19.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f274a5640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f8f2006ce30 con 0x7f8f200c5bd0 2024-04-25T02:18:19.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f274a5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8f20072280 con 0x7f8f2006c510 2024-04-25T02:18:19.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f24a40640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f20071d80 0x7f8f200d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f24a40640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f20071d80 0x7f8f200d0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39284/0 (socket says 172.21.15.79:39284) 2024-04-25T02:18:19.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f24a40640 1 -- 172.21.15.79:0/3908630290 learned_addr learned my addr 172.21.15.79:0/3908630290 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:19.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f25241640 1 --2- 172.21.15.79:0/3908630290 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2006c510 0x7f8f2006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f25a42640 1 --2- 172.21.15.79:0/3908630290 >> v2:172.21.15.189:3300/0 conn(0x7f8f200c5bd0 0x7f8f2015ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f24a40640 1 -- 172.21.15.79:0/3908630290 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2006c510 msgr2=0x7f8f2006c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:19.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f24a40640 1 --2- 172.21.15.79:0/3908630290 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2006c510 0x7f8f2006c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f24a40640 1 -- 172.21.15.79:0/3908630290 >> v2:172.21.15.189:3300/0 conn(0x7f8f200c5bd0 msgr2=0x7f8f2015ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:19.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f24a40640 1 --2- 172.21.15.79:0/3908630290 >> v2:172.21.15.189:3300/0 conn(0x7f8f200c5bd0 0x7f8f2015ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.642+0000 7f8f24a40640 1 -- 172.21.15.79:0/3908630290 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f20072560 con 0x7f8f20071d80 2024-04-25T02:18:19.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.643+0000 7f8f24a40640 1 --2- 172.21.15.79:0/3908630290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20071d80 0x7f8f200d0540 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f8f200ce7c0 tx=0x7f8f1002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6f46ce5568ef9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:19.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.643+0000 7f8f17fff640 1 -- 172.21.15.79:0/3908630290 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10037070 con 0x7f8f20071d80 2024-04-25T02:18:19.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.643+0000 7f8f17fff640 1 -- 172.21.15.79:0/3908630290 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f10032440 con 0x7f8f20071d80 2024-04-25T02:18:19.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.643+0000 7f8f17fff640 1 -- 172.21.15.79:0/3908630290 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10032810 con 0x7f8f20071d80 2024-04-25T02:18:19.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.644+0000 7f8f274a5640 1 -- 172.21.15.79:0/3908630290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20071d80 msgr2=0x7f8f200d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.644+0000 7f8f274a5640 1 --2- 172.21.15.79:0/3908630290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20071d80 0x7f8f200d0540 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f8f200ce7c0 tx=0x7f8f1002a140 comp rx=0 tx=0).stop 2024-04-25T02:18:19.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.644+0000 7f8f274a5640 1 -- 172.21.15.79:0/3908630290 shutdown_connections 2024-04-25T02:18:19.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.644+0000 7f8f274a5640 1 --2- 172.21.15.79:0/3908630290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20071d80 0x7f8f200d0540 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.644+0000 7f8f274a5640 1 --2- 172.21.15.79:0/3908630290 >> v2:172.21.15.189:3300/0 conn(0x7f8f200c5bd0 0x7f8f2015ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.644+0000 7f8f274a5640 1 --2- 172.21.15.79:0/3908630290 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2006c510 0x7f8f2006c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.644+0000 7f8f274a5640 1 -- 172.21.15.79:0/3908630290 >> 172.21.15.79:0/3908630290 conn(0x7f8f200cd970 msgr2=0x7f8f200cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:19.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.644+0000 7f8f274a5640 1 -- 172.21.15.79:0/3908630290 shutdown_connections 2024-04-25T02:18:19.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.644+0000 7f8f274a5640 1 -- 172.21.15.79:0/3908630290 wait complete. 2024-04-25T02:18:19.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.645+0000 7f8f274a5640 1 Processor -- start 2024-04-25T02:18:19.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.645+0000 7f8f274a5640 1 -- start start 2024-04-25T02:18:19.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f274a5640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2006c510 0x7f8f2014e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f274a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20071d80 0x7f8f200b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f274a5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f200c5bd0 0x7f8f200aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f274a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8f200d0a80 con 0x7f8f20071d80 2024-04-25T02:18:19.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f274a5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8f20072b20 con 0x7f8f200c5bd0 2024-04-25T02:18:19.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f274a5640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8f200c7850 con 0x7f8f2006c510 2024-04-25T02:18:19.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f24a40640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20071d80 0x7f8f200b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f24a40640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20071d80 0x7f8f200b6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39298/0 (socket says 172.21.15.79:39298) 2024-04-25T02:18:19.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f24a40640 1 -- 172.21.15.79:0/3375572824 learned_addr learned my addr 172.21.15.79:0/3375572824 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:19.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f25a42640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f200c5bd0 0x7f8f200aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f25241640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2006c510 0x7f8f2014e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f24a40640 1 -- 172.21.15.79:0/3375572824 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2006c510 msgr2=0x7f8f2014e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f24a40640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2006c510 0x7f8f2014e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f24a40640 1 -- 172.21.15.79:0/3375572824 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f200c5bd0 msgr2=0x7f8f200aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f24a40640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f200c5bd0 0x7f8f200aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f24a40640 1 -- 172.21.15.79:0/3375572824 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f200b6c10 con 0x7f8f20071d80 2024-04-25T02:18:19.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f25241640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8f2006c510 0x7f8f2014e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:19.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f25a42640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f200c5bd0 0x7f8f200aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:19.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f24a40640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20071d80 0x7f8f200b6190 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f8f1002a180 tx=0x7f8f100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:19.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.646+0000 7f8f15ffb640 1 -- 172.21.15.79:0/3375572824 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10037040 con 0x7f8f20071d80 2024-04-25T02:18:19.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.647+0000 7f8f15ffb640 1 -- 172.21.15.79:0/3375572824 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f10042070 con 0x7f8f20071d80 2024-04-25T02:18:19.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.647+0000 7f8f274a5640 1 -- 172.21.15.79:0/3375572824 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f200ade50 con 0x7f8f20071d80 2024-04-25T02:18:19.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.647+0000 7f8f15ffb640 1 -- 172.21.15.79:0/3375572824 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10030880 con 0x7f8f20071d80 2024-04-25T02:18:19.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.647+0000 7f8f274a5640 1 -- 172.21.15.79:0/3375572824 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f200ae410 con 0x7f8f20071d80 2024-04-25T02:18:19.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.648+0000 7f8f274a5640 1 -- 172.21.15.79:0/3375572824 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f200681e0 con 0x7f8f20071d80 2024-04-25T02:18:19.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.648+0000 7f8f15ffb640 1 -- 172.21.15.79:0/3375572824 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f10030a20 con 0x7f8f20071d80 2024-04-25T02:18:19.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.648+0000 7f8f15ffb640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f0406be60 0x7f8f0406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.649+0000 7f8f15ffb640 1 -- 172.21.15.79:0/3375572824 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f8f100ab4b0 con 0x7f8f20071d80 2024-04-25T02:18:19.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.649+0000 7f8f25241640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f0406be60 0x7f8f0406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.649+0000 7f8f15ffb640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x7f8f04071e60 0x7f8f04074280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.649+0000 7f8f15ffb640 1 -- 172.21.15.79:0/3375572824 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f04074930 con 0x7f8f04071e60 2024-04-25T02:18:19.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.649+0000 7f8f15ffb640 1 -- 172.21.15.79:0/3375572824 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7f8f100b2050 con 0x7f8f20071d80 2024-04-25T02:18:19.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.649+0000 7f8f25a42640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x7f8f04071e60 0x7f8f04074280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.649+0000 7f8f25241640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f0406be60 0x7f8f0406e320 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009a70 tx=0x7f8f1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:19.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.649+0000 7f8f25a42640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x7f8f04071e60 0x7f8f04074280 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:19.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.650+0000 7f8f15ffb640 1 -- 172.21.15.79:0/3375572824 <== osd.2 v2:172.21.15.79:6800/3397511354 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f04074930 con 0x7f8f04071e60 2024-04-25T02:18:19.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.663+0000 7f8f274a5640 1 -- 172.21.15.79:0/3375572824 --> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8f200d01f0 con 0x7f8f04071e60 2024-04-25T02:18:19.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.663+0000 7f8f15ffb640 1 -- 172.21.15.79:0/3375572824 <== osd.2 v2:172.21.15.79:6800/3397511354 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8f200d01f0 con 0x7f8f04071e60 2024-04-25T02:18:19.667 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:18:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:18:19.667 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:18:19.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.663+0000 7f8f274a5640 1 -- 172.21.15.79:0/3375572824 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x7f8f04071e60 msgr2=0x7f8f04074280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.663+0000 7f8f274a5640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.79:6800/3397511354,v1:172.21.15.79:6801/3397511354] conn(0x7f8f04071e60 0x7f8f04074280 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.663+0000 7f8f274a5640 1 -- 172.21.15.79:0/3375572824 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f0406be60 msgr2=0x7f8f0406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.663+0000 7f8f274a5640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f8f0406be60 0x7f8f0406e320 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009a70 tx=0x7f8f1c008040 comp rx=0 tx=0).stop 2024-04-25T02:18:19.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.663+0000 7f8f274a5640 1 -- 172.21.15.79:0/3375572824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20071d80 msgr2=0x7f8f200b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.663+0000 7f8f274a5640 1 --2- 172.21.15.79:0/3375572824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20071d80 0x7f8f200b6190 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f8f1002a180 tx=0x7f8f100046c0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.663+0000 7f8f25a42640 1 -- 172.21.15.79:0/3375572824 reap_dead start 2024-04-25T02:18:19.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.663+0000 7f8f274a5640 1 -- 172.21.15.79:0/3375572824 shutdown_connections 2024-04-25T02:18:19.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.663+0000 7f8f274a5640 1 -- 172.21.15.79:0/3375572824 >> 172.21.15.79:0/3375572824 conn(0x7f8f200cd970 msgr2=0x7f8f2006b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:19.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.663+0000 7f8f274a5640 1 -- 172.21.15.79:0/3375572824 shutdown_connections 2024-04-25T02:18:19.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.663+0000 7f8f274a5640 1 -- 172.21.15.79:0/3375572824 wait complete. 2024-04-25T02:18:19.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T02:18:19.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.770+0000 7f77ea258640 1 Processor -- start 2024-04-25T02:18:19.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.770+0000 7f77ea258640 1 -- start start 2024-04-25T02:18:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.771+0000 7f77ea258640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f77e406df50 0x7f77e406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.771+0000 7f77ea258640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f77e4071240 0x7f77e40716b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.771+0000 7f77ea258640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77e4070d90 con 0x7f77e4144cb0 2024-04-25T02:18:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.771+0000 7f77ea258640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f77e406e8f0 con 0x7f77e4071240 2024-04-25T02:18:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.771+0000 7f77ea258640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f77e40cf130 con 0x7f77e406df50 2024-04-25T02:18:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.771+0000 7f77e3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f77e4071240 0x7f77e40716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.771+0000 7f77e37fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f77e4144cb0 0x7f77e40b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58014/0 (socket says 172.21.15.79:58014) 2024-04-25T02:18:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.771+0000 7f77e37fe640 1 -- 172.21.15.79:0/7210616 learned_addr learned my addr 172.21.15.79:0/7210616 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.771+0000 7f77e2ffd640 1 --2- 172.21.15.79:0/7210616 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f77e406df50 0x7f77e406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.771+0000 7f77e3fff640 1 -- 172.21.15.79:0/7210616 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f77e406df50 msgr2=0x7f77e406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.771+0000 7f77e3fff640 1 --2- 172.21.15.79:0/7210616 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f77e406df50 0x7f77e406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.771+0000 7f77e3fff640 1 -- 172.21.15.79:0/7210616 >> v1:172.21.15.79:6789/0 conn(0x7f77e4144cb0 legacy=0x7f77e40b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.771+0000 7f77e3fff640 1 -- 172.21.15.79:0/7210616 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e40cf410 con 0x7f77e4071240 2024-04-25T02:18:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.771+0000 7f77e27fc640 1 -- 172.21.15.79:0/7210616 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1502056253 0 0) 0x7f77e4070d90 con 0x7f77e4144cb0 2024-04-25T02:18:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.772+0000 7f77e3fff640 1 --2- 172.21.15.79:0/7210616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e4071240 0x7f77e40716b0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f77dc009d90 tx=0x7f77dc02a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab36e7de969bda5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.772+0000 7f77e27fc640 1 -- 172.21.15.79:0/7210616 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc007740 con 0x7f77e4071240 2024-04-25T02:18:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.772+0000 7f77e27fc640 1 -- 172.21.15.79:0/7210616 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77dc0078e0 con 0x7f77e4071240 2024-04-25T02:18:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.772+0000 7f77e27fc640 1 -- 172.21.15.79:0/7210616 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc007cb0 con 0x7f77e4071240 2024-04-25T02:18:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.773+0000 7f77ea258640 1 -- 172.21.15.79:0/7210616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e4071240 msgr2=0x7f77e40716b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.773+0000 7f77ea258640 1 --2- 172.21.15.79:0/7210616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e4071240 0x7f77e40716b0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f77dc009d90 tx=0x7f77dc02a530 comp rx=0 tx=0).stop 2024-04-25T02:18:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.773+0000 7f77ea258640 1 -- 172.21.15.79:0/7210616 shutdown_connections 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.773+0000 7f77ea258640 1 --2- 172.21.15.79:0/7210616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e4071240 0x7f77e40716b0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.773+0000 7f77ea258640 1 --2- 172.21.15.79:0/7210616 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f77e406df50 0x7f77e406e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.773+0000 7f77ea258640 1 -- 172.21.15.79:0/7210616 >> 172.21.15.79:0/7210616 conn(0x7f77e40cfc80 msgr2=0x7f77e40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.773+0000 7f77ea258640 1 -- 172.21.15.79:0/7210616 shutdown_connections 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.773+0000 7f77ea258640 1 -- 172.21.15.79:0/7210616 wait complete. 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.774+0000 7f77ea258640 1 Processor -- start 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.774+0000 7f77ea258640 1 -- start start 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77ea258640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f77e406df50 0x7f77e4140740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77ea258640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e4071240 0x7f77e40ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77ea258640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77e4144cb0 0x7f77e40b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77ea258640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f77e40cf9d0 con 0x7f77e4071240 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77ea258640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f77e40b5750 con 0x7f77e4144cb0 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77ea258640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f77e4145090 con 0x7f77e406df50 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77e2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e4071240 0x7f77e40ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77e2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e4071240 0x7f77e40ae7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39318/0 (socket says 172.21.15.79:39318) 2024-04-25T02:18:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77e2ffd640 1 -- 172.21.15.79:0/102817332 learned_addr learned my addr 172.21.15.79:0/102817332 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77e3fff640 1 --2- 172.21.15.79:0/102817332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77e4144cb0 0x7f77e40b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77e37fe640 1 --2- 172.21.15.79:0/102817332 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f77e406df50 0x7f77e4140740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77e2ffd640 1 -- 172.21.15.79:0/102817332 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f77e406df50 msgr2=0x7f77e4140740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77e2ffd640 1 --2- 172.21.15.79:0/102817332 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f77e406df50 0x7f77e4140740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77e2ffd640 1 -- 172.21.15.79:0/102817332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77e4144cb0 msgr2=0x7f77e40b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77e2ffd640 1 --2- 172.21.15.79:0/102817332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77e4144cb0 0x7f77e40b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77e2ffd640 1 -- 172.21.15.79:0/102817332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e40af090 con 0x7f77e4071240 2024-04-25T02:18:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77e3fff640 1 --2- 172.21.15.79:0/102817332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77e4144cb0 0x7f77e40b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77e2ffd640 1 --2- 172.21.15.79:0/102817332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e4071240 0x7f77e40ae7b0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f77d800d620 tx=0x7f77d800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77cbfff640 1 -- 172.21.15.79:0/102817332 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d800b620 con 0x7f77e4071240 2024-04-25T02:18:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77cbfff640 1 -- 172.21.15.79:0/102817332 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d8019070 con 0x7f77e4071240 2024-04-25T02:18:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77ea258640 1 -- 172.21.15.79:0/102817332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e415a810 con 0x7f77e4071240 2024-04-25T02:18:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.775+0000 7f77cbfff640 1 -- 172.21.15.79:0/102817332 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d800ba00 con 0x7f77e4071240 2024-04-25T02:18:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.776+0000 7f77ea258640 1 -- 172.21.15.79:0/102817332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e415add0 con 0x7f77e4071240 2024-04-25T02:18:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.777+0000 7f77ea258640 1 -- 172.21.15.79:0/102817332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e40690a0 con 0x7f77e4071240 2024-04-25T02:18:19.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.777+0000 7f77cbfff640 1 -- 172.21.15.79:0/102817332 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f77d800bba0 con 0x7f77e4071240 2024-04-25T02:18:19.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.777+0000 7f77cbfff640 1 --2- 172.21.15.79:0/102817332 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f77d006be30 0x7f77d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:19.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.778+0000 7f77e37fe640 1 --2- 172.21.15.79:0/102817332 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f77d006be30 0x7f77d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:19.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.778+0000 7f77cbfff640 1 -- 172.21.15.79:0/102817332 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f77d808af80 con 0x7f77e4071240 2024-04-25T02:18:19.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.778+0000 7f77e37fe640 1 --2- 172.21.15.79:0/102817332 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f77d006be30 0x7f77d006e2f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f77d4000f60 tx=0x7f77d4007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:19.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.782+0000 7f77cbfff640 1 -- 172.21.15.79:0/102817332 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f77d8059c10 con 0x7f77e4071240 2024-04-25T02:18:19.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.956+0000 7f77ea258640 1 -- 172.21.15.79:0/102817332 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f77e40d0b90 con 0x7f77d006be30 2024-04-25T02:18:19.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.957+0000 7f77cbfff640 1 -- 172.21.15.79:0/102817332 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f77e40d0b90 con 0x7f77d006be30 2024-04-25T02:18:19.961 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T02:18:19.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.959+0000 7f77ea258640 1 -- 172.21.15.79:0/102817332 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f77d006be30 msgr2=0x7f77d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.959+0000 7f77ea258640 1 --2- 172.21.15.79:0/102817332 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f77d006be30 0x7f77d006e2f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f77d4000f60 tx=0x7f77d4007b50 comp rx=0 tx=0).stop 2024-04-25T02:18:19.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.959+0000 7f77ea258640 1 -- 172.21.15.79:0/102817332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e4071240 msgr2=0x7f77e40ae7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:19.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.959+0000 7f77ea258640 1 --2- 172.21.15.79:0/102817332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e4071240 0x7f77e40ae7b0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f77d800d620 tx=0x7f77d800dae0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.959+0000 7f77ea258640 1 -- 172.21.15.79:0/102817332 shutdown_connections 2024-04-25T02:18:19.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.959+0000 7f77ea258640 1 --2- 172.21.15.79:0/102817332 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f77d006be30 0x7f77d006e2f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.959+0000 7f77ea258640 1 --2- 172.21.15.79:0/102817332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77e4144cb0 0x7f77e40b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.959+0000 7f77ea258640 1 --2- 172.21.15.79:0/102817332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77e4071240 0x7f77e40ae7b0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.959+0000 7f77ea258640 1 --2- 172.21.15.79:0/102817332 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f77e406df50 0x7f77e4140740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:19.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.959+0000 7f77ea258640 1 -- 172.21.15.79:0/102817332 >> 172.21.15.79:0/102817332 conn(0x7f77e40cfc80 msgr2=0x7f77e40b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:19.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.959+0000 7f77ea258640 1 -- 172.21.15.79:0/102817332 shutdown_connections 2024-04-25T02:18:19.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:19.959+0000 7f77ea258640 1 -- 172.21.15.79:0/102817332 wait complete. 2024-04-25T02:18:19.974 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T02:18:19.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:18:20.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.071+0000 7f9ddb770640 1 Processor -- start 2024-04-25T02:18:20.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.071+0000 7f9ddb770640 1 -- start start 2024-04-25T02:18:20.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.072+0000 7f9ddb770640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9dd40b4470 0x7f9dd40cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.072+0000 7f9ddb770640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd40cf2e0 con 0x7f9dd413de20 2024-04-25T02:18:20.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.072+0000 7f9ddb770640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd40cf5c0 con 0x7f9dd415f0e0 2024-04-25T02:18:20.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.072+0000 7f9ddb770640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd40cf8a0 con 0x7f9dd40b4470 2024-04-25T02:18:20.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.072+0000 7f9dd9d0d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9dd40b4470 0x7f9dd40cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.072+0000 7f9dd950c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9dd413de20 0x7f9dd415e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58022/0 (socket says 172.21.15.79:58022) 2024-04-25T02:18:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.072+0000 7f9dd950c640 1 -- 172.21.15.79:0/740405607 learned_addr learned my addr 172.21.15.79:0/740405607 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.072+0000 7f9dd9d0d640 1 -- 172.21.15.79:0/740405607 >> v1:172.21.15.189:6789/0 conn(0x7f9dd415f0e0 legacy=0x7f9dd40ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.072+0000 7f9dd9d0d640 1 -- 172.21.15.79:0/740405607 >> v1:172.21.15.79:6789/0 conn(0x7f9dd413de20 legacy=0x7f9dd415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.072+0000 7f9dd9d0d640 1 -- 172.21.15.79:0/740405607 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd40b2f40 con 0x7f9dd40b4470 2024-04-25T02:18:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.072+0000 7f9dcbfff640 1 -- 172.21.15.79:0/740405607 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1222479338 0 0) 0x7f9dd40cf2e0 con 0x7f9dd413de20 2024-04-25T02:18:20.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.073+0000 7f9dd9d0d640 1 --2- 172.21.15.79:0/740405607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd40b4470 0x7f9dd40cebe0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009d90 tx=0x7f9dcc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbed55720557fe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.073+0000 7f9dcbfff640 1 -- 172.21.15.79:0/740405607 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc007740 con 0x7f9dd40b4470 2024-04-25T02:18:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.073+0000 7f9dcbfff640 1 -- 172.21.15.79:0/740405607 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dcc0078e0 con 0x7f9dd40b4470 2024-04-25T02:18:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.073+0000 7f9dcbfff640 1 -- 172.21.15.79:0/740405607 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc007cb0 con 0x7f9dd40b4470 2024-04-25T02:18:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.073+0000 7f9ddb770640 1 -- 172.21.15.79:0/740405607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd40b4470 msgr2=0x7f9dd40cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.073+0000 7f9ddb770640 1 --2- 172.21.15.79:0/740405607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd40b4470 0x7f9dd40cebe0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009d90 tx=0x7f9dcc02a660 comp rx=0 tx=0).stop 2024-04-25T02:18:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.073+0000 7f9ddb770640 1 -- 172.21.15.79:0/740405607 shutdown_connections 2024-04-25T02:18:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.073+0000 7f9ddb770640 1 --2- 172.21.15.79:0/740405607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd40b4470 0x7f9dd40cebe0 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.073+0000 7f9ddb770640 1 -- 172.21.15.79:0/740405607 >> 172.21.15.79:0/740405607 conn(0x7f9dd406b4a0 msgr2=0x7f9dd406b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.073+0000 7f9ddb770640 1 -- 172.21.15.79:0/740405607 shutdown_connections 2024-04-25T02:18:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.073+0000 7f9ddb770640 1 -- 172.21.15.79:0/740405607 wait complete. 2024-04-25T02:18:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.074+0000 7f9ddb770640 1 Processor -- start 2024-04-25T02:18:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.075+0000 7f9ddb770640 1 -- start start 2024-04-25T02:18:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.075+0000 7f9ddb770640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dd40b4470 0x7f9dd4152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.075+0000 7f9ddb770640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd413de20 0x7f9dd415ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.075+0000 7f9ddb770640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dd415f0e0 0x7f9dd415db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.075+0000 7f9ddb770640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4165ee0 con 0x7f9dd413de20 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.075+0000 7f9ddb770640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4165d60 con 0x7f9dd415f0e0 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.075+0000 7f9ddb770640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd4166060 con 0x7f9dd40b4470 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.075+0000 7f9dd8d0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd413de20 0x7f9dd415ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.075+0000 7f9dd8d0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd413de20 0x7f9dd415ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39324/0 (socket says 172.21.15.79:39324) 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.075+0000 7f9dd8d0b640 1 -- 172.21.15.79:0/1452108961 learned_addr learned my addr 172.21.15.79:0/1452108961 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.076+0000 7f9dd9d0d640 1 --2- 172.21.15.79:0/1452108961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dd415f0e0 0x7f9dd415db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.076+0000 7f9dd950c640 1 --2- 172.21.15.79:0/1452108961 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dd40b4470 0x7f9dd4152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.076+0000 7f9dd8d0b640 1 -- 172.21.15.79:0/1452108961 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dd40b4470 msgr2=0x7f9dd4152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.076+0000 7f9dd8d0b640 1 --2- 172.21.15.79:0/1452108961 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dd40b4470 0x7f9dd4152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.076+0000 7f9dd8d0b640 1 -- 172.21.15.79:0/1452108961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dd415f0e0 msgr2=0x7f9dd415db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.076+0000 7f9dd8d0b640 1 --2- 172.21.15.79:0/1452108961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dd415f0e0 0x7f9dd415db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.076+0000 7f9dd8d0b640 1 -- 172.21.15.79:0/1452108961 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd41526c0 con 0x7f9dd413de20 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.076+0000 7f9dd950c640 1 --2- 172.21.15.79:0/1452108961 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dd40b4470 0x7f9dd4152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.076+0000 7f9dd8d0b640 1 --2- 172.21.15.79:0/1452108961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd413de20 0x7f9dd415ceb0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400c3f0 tx=0x7f9dc400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.076+0000 7f9dc9ffb640 1 -- 172.21.15.79:0/1452108961 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4017070 con 0x7f9dd413de20 2024-04-25T02:18:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.076+0000 7f9dc9ffb640 1 -- 172.21.15.79:0/1452108961 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc40052f0 con 0x7f9dd413de20 2024-04-25T02:18:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.076+0000 7f9dc9ffb640 1 -- 172.21.15.79:0/1452108961 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4003830 con 0x7f9dd413de20 2024-04-25T02:18:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.076+0000 7f9ddb770640 1 -- 172.21.15.79:0/1452108961 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd41529a0 con 0x7f9dd413de20 2024-04-25T02:18:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.076+0000 7f9ddb770640 1 -- 172.21.15.79:0/1452108961 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd415d3f0 con 0x7f9dd413de20 2024-04-25T02:18:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.077+0000 7f9ddb770640 1 -- 172.21.15.79:0/1452108961 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9dd40690a0 con 0x7f9dd413de20 2024-04-25T02:18:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.077+0000 7f9dc9ffb640 1 -- 172.21.15.79:0/1452108961 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9dc401a070 con 0x7f9dd413de20 2024-04-25T02:18:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.078+0000 7f9dc9ffb640 1 --2- 172.21.15.79:0/1452108961 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9db806be30 0x7f9db806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.078+0000 7f9dc9ffb640 1 -- 172.21.15.79:0/1452108961 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f9dc4089ea0 con 0x7f9dd413de20 2024-04-25T02:18:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.078+0000 7f9dd950c640 1 --2- 172.21.15.79:0/1452108961 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9db806be30 0x7f9db806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.078+0000 7f9dc9ffb640 1 --2- 172.21.15.79:0/1452108961 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x7f9db8071e30 0x7f9db8074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.078+0000 7f9dc9ffb640 1 -- 172.21.15.79:0/1452108961 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9dc40054a0 con 0x7f9db8071e30 2024-04-25T02:18:20.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.078+0000 7f9dc9ffb640 1 -- 172.21.15.79:0/1452108961 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7f9dc408c540 con 0x7f9dd413de20 2024-04-25T02:18:20.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.078+0000 7f9dd9d0d640 1 --2- 172.21.15.79:0/1452108961 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x7f9db8071e30 0x7f9db8074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.078+0000 7f9dd950c640 1 --2- 172.21.15.79:0/1452108961 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9db806be30 0x7f9db806e2f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0000f60 tx=0x7f9dd0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.078+0000 7f9dd9d0d640 1 --2- 172.21.15.79:0/1452108961 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x7f9db8071e30 0x7f9db8074250 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.079+0000 7f9dc9ffb640 1 -- 172.21.15.79:0/1452108961 <== osd.3 v2:172.21.15.79:6817/3072297369 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9dc40054a0 con 0x7f9db8071e30 2024-04-25T02:18:20.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.092+0000 7f9ddb770640 1 -- 172.21.15.79:0/1452108961 --> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9dd4073110 con 0x7f9db8071e30 2024-04-25T02:18:20.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.092+0000 7f9dc9ffb640 1 -- 172.21.15.79:0/1452108961 <== osd.3 v2:172.21.15.79:6817/3072297369 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9dd4073110 con 0x7f9db8071e30 2024-04-25T02:18:20.096 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:18:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:18:20.097 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:18:20.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.092+0000 7f9ddb770640 1 -- 172.21.15.79:0/1452108961 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x7f9db8071e30 msgr2=0x7f9db8074250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.092+0000 7f9ddb770640 1 --2- 172.21.15.79:0/1452108961 >> [v2:172.21.15.79:6817/3072297369,v1:172.21.15.79:6819/3072297369] conn(0x7f9db8071e30 0x7f9db8074250 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.093+0000 7f9ddb770640 1 -- 172.21.15.79:0/1452108961 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9db806be30 msgr2=0x7f9db806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.093+0000 7f9ddb770640 1 --2- 172.21.15.79:0/1452108961 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f9db806be30 0x7f9db806e2f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0000f60 tx=0x7f9dd0009040 comp rx=0 tx=0).stop 2024-04-25T02:18:20.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.093+0000 7f9ddb770640 1 -- 172.21.15.79:0/1452108961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd413de20 msgr2=0x7f9dd415ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.093+0000 7f9ddb770640 1 --2- 172.21.15.79:0/1452108961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dd413de20 0x7f9dd415ceb0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400c3f0 tx=0x7f9dc400c8b0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.093+0000 7f9dd9d0d640 1 -- 172.21.15.79:0/1452108961 reap_dead start 2024-04-25T02:18:20.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.093+0000 7f9ddb770640 1 -- 172.21.15.79:0/1452108961 shutdown_connections 2024-04-25T02:18:20.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.093+0000 7f9ddb770640 1 -- 172.21.15.79:0/1452108961 >> 172.21.15.79:0/1452108961 conn(0x7f9dd406b4a0 msgr2=0x7f9dd406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:20.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.093+0000 7f9ddb770640 1 -- 172.21.15.79:0/1452108961 shutdown_connections 2024-04-25T02:18:20.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.093+0000 7f9ddb770640 1 -- 172.21.15.79:0/1452108961 wait complete. 2024-04-25T02:18:20.107 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T02:18:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.200+0000 7f6a1bb28640 1 Processor -- start 2024-04-25T02:18:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.201+0000 7f6a1bb28640 1 -- start start 2024-04-25T02:18:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.201+0000 7f6a1bb28640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6a1415e4d0 0x7f6a1406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.201+0000 7f6a1bb28640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a140b3570 0x7f6a140d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.201+0000 7f6a1bb28640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a140d1660 con 0x7f6a140b3020 2024-04-25T02:18:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.201+0000 7f6a1bb28640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6a140d1380 con 0x7f6a140b3570 2024-04-25T02:18:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.201+0000 7f6a1bb28640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6a140cede0 con 0x7f6a1415e4d0 2024-04-25T02:18:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.201+0000 7f6a190c3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a140b3570 0x7f6a140d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.201+0000 7f6a1a0c5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6a140b3020 0x7f6a140cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58034/0 (socket says 172.21.15.79:58034) 2024-04-25T02:18:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.201+0000 7f6a1a0c5640 1 -- 172.21.15.79:0/1686330563 learned_addr learned my addr 172.21.15.79:0/1686330563 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.202+0000 7f6a198c4640 1 --2- 172.21.15.79:0/1686330563 >> v2:172.21.15.189:3300/0 conn(0x7f6a1415e4d0 0x7f6a1406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.202+0000 7f6a190c3640 1 -- 172.21.15.79:0/1686330563 >> v2:172.21.15.189:3300/0 conn(0x7f6a1415e4d0 msgr2=0x7f6a1406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.202+0000 7f6a190c3640 1 --2- 172.21.15.79:0/1686330563 >> v2:172.21.15.189:3300/0 conn(0x7f6a1415e4d0 0x7f6a1406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.202+0000 7f6a190c3640 1 -- 172.21.15.79:0/1686330563 >> v1:172.21.15.79:6789/0 conn(0x7f6a140b3020 legacy=0x7f6a140cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.202+0000 7f6a190c3640 1 -- 172.21.15.79:0/1686330563 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a140cf0c0 con 0x7f6a140b3570 2024-04-25T02:18:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.202+0000 7f6a188c2640 1 -- 172.21.15.79:0/1686330563 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1730964038 0 0) 0x7f6a140d1660 con 0x7f6a140b3020 2024-04-25T02:18:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.202+0000 7f6a198c4640 1 --2- 172.21.15.79:0/1686330563 >> v2:172.21.15.189:3300/0 conn(0x7f6a1415e4d0 0x7f6a1406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.202+0000 7f6a190c3640 1 --2- 172.21.15.79:0/1686330563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a140b3570 0x7f6a140d2710 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f6a040097a0 tx=0x7f6a0402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e2329e414c2de3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.203+0000 7f6a188c2640 1 -- 172.21.15.79:0/1686330563 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04037070 con 0x7f6a140b3570 2024-04-25T02:18:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.203+0000 7f6a188c2640 1 -- 172.21.15.79:0/1686330563 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a04032440 con 0x7f6a140b3570 2024-04-25T02:18:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.203+0000 7f6a188c2640 1 -- 172.21.15.79:0/1686330563 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04032810 con 0x7f6a140b3570 2024-04-25T02:18:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.203+0000 7f6a1bb28640 1 -- 172.21.15.79:0/1686330563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a140b3570 msgr2=0x7f6a140d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.203+0000 7f6a1bb28640 1 --2- 172.21.15.79:0/1686330563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a140b3570 0x7f6a140d2710 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f6a040097a0 tx=0x7f6a0402a1e0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.203+0000 7f6a1bb28640 1 -- 172.21.15.79:0/1686330563 shutdown_connections 2024-04-25T02:18:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.203+0000 7f6a1bb28640 1 --2- 172.21.15.79:0/1686330563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a140b3570 0x7f6a140d2710 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.203+0000 7f6a1bb28640 1 --2- 172.21.15.79:0/1686330563 >> v2:172.21.15.189:3300/0 conn(0x7f6a1415e4d0 0x7f6a1406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.203+0000 7f6a1bb28640 1 -- 172.21.15.79:0/1686330563 >> 172.21.15.79:0/1686330563 conn(0x7f6a1409d460 msgr2=0x7f6a140d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.203+0000 7f6a1bb28640 1 -- 172.21.15.79:0/1686330563 shutdown_connections 2024-04-25T02:18:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.203+0000 7f6a1bb28640 1 -- 172.21.15.79:0/1686330563 wait complete. 2024-04-25T02:18:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.204+0000 7f6a1bb28640 1 Processor -- start 2024-04-25T02:18:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.204+0000 7f6a1bb28640 1 -- start start 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.205+0000 7f6a1bb28640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a140b3020 0x7f6a1414a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.205+0000 7f6a1bb28640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a140b3570 0x7f6a140cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.205+0000 7f6a1bb28640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a1415e4d0 0x7f6a14161dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.205+0000 7f6a1bb28640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6a140d2250 con 0x7f6a1415e4d0 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.205+0000 7f6a1bb28640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6a140d20d0 con 0x7f6a140b3570 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.205+0000 7f6a1bb28640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6a1406c1b0 con 0x7f6a140b3020 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.205+0000 7f6a1a0c5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a1415e4d0 0x7f6a14161dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.205+0000 7f6a1a0c5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a1415e4d0 0x7f6a14161dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39342/0 (socket says 172.21.15.79:39342) 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.205+0000 7f6a1a0c5640 1 -- 172.21.15.79:0/1823889755 learned_addr learned my addr 172.21.15.79:0/1823889755 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.205+0000 7f6a198c4640 1 --2- 172.21.15.79:0/1823889755 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a140b3020 0x7f6a1414a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.205+0000 7f6a190c3640 1 --2- 172.21.15.79:0/1823889755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a140b3570 0x7f6a140cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.205+0000 7f6a1a0c5640 1 -- 172.21.15.79:0/1823889755 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a140b3020 msgr2=0x7f6a1414a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.206+0000 7f6a1a0c5640 1 --2- 172.21.15.79:0/1823889755 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a140b3020 0x7f6a1414a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.206+0000 7f6a1a0c5640 1 -- 172.21.15.79:0/1823889755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a140b3570 msgr2=0x7f6a140cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.206+0000 7f6a1a0c5640 1 --2- 172.21.15.79:0/1823889755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a140b3570 0x7f6a140cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.206+0000 7f6a1a0c5640 1 -- 172.21.15.79:0/1823889755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a140cd1f0 con 0x7f6a1415e4d0 2024-04-25T02:18:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.206+0000 7f6a1a0c5640 1 --2- 172.21.15.79:0/1823889755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a1415e4d0 0x7f6a14161dc0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00c480 tx=0x7f6a0c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.206+0000 7f6a0a7fc640 1 -- 172.21.15.79:0/1823889755 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c018070 con 0x7f6a1415e4d0 2024-04-25T02:18:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.206+0000 7f6a0a7fc640 1 -- 172.21.15.79:0/1823889755 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0c007500 con 0x7f6a1415e4d0 2024-04-25T02:18:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.206+0000 7f6a1bb28640 1 -- 172.21.15.79:0/1823889755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1414ad90 con 0x7f6a1415e4d0 2024-04-25T02:18:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.206+0000 7f6a0a7fc640 1 -- 172.21.15.79:0/1823889755 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c004a20 con 0x7f6a1415e4d0 2024-04-25T02:18:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.206+0000 7f6a1bb28640 1 -- 172.21.15.79:0/1823889755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a141f4d90 con 0x7f6a1415e4d0 2024-04-25T02:18:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.207+0000 7f6a1bb28640 1 -- 172.21.15.79:0/1823889755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a140690a0 con 0x7f6a1415e4d0 2024-04-25T02:18:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.207+0000 7f6a0a7fc640 1 -- 172.21.15.79:0/1823889755 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a0c01b070 con 0x7f6a1415e4d0 2024-04-25T02:18:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.208+0000 7f6a0a7fc640 1 --2- 172.21.15.79:0/1823889755 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f69f806be30 0x7f69f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.208+0000 7f6a0a7fc640 1 -- 172.21.15.79:0/1823889755 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f6a0c089da0 con 0x7f6a1415e4d0 2024-04-25T02:18:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.208+0000 7f6a198c4640 1 --2- 172.21.15.79:0/1823889755 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f69f806be30 0x7f69f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.208+0000 7f6a198c4640 1 --2- 172.21.15.79:0/1823889755 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f69f806be30 0x7f69f806e2f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6a140b8f10 tx=0x7f6a100097f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.212+0000 7f6a0a7fc640 1 -- 172.21.15.79:0/1823889755 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6a140cd1f0 con 0x7f6a1415e4d0 2024-04-25T02:18:20.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.386+0000 7f6a1bb28640 1 -- 172.21.15.79:0/1823889755 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f6a140d1920 con 0x7f69f806be30 2024-04-25T02:18:20.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.386+0000 7f6a0a7fc640 1 -- 172.21.15.79:0/1823889755 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6a140d1920 con 0x7f69f806be30 2024-04-25T02:18:20.391 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T02:18:20.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.388+0000 7f6a1bb28640 1 -- 172.21.15.79:0/1823889755 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f69f806be30 msgr2=0x7f69f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.388+0000 7f6a1bb28640 1 --2- 172.21.15.79:0/1823889755 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f69f806be30 0x7f69f806e2f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6a140b8f10 tx=0x7f6a100097f0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.388+0000 7f6a1bb28640 1 -- 172.21.15.79:0/1823889755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a1415e4d0 msgr2=0x7f6a14161dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.388+0000 7f6a1bb28640 1 --2- 172.21.15.79:0/1823889755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a1415e4d0 0x7f6a14161dc0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00c480 tx=0x7f6a0c00c940 comp rx=0 tx=0).stop 2024-04-25T02:18:20.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.388+0000 7f6a1bb28640 1 -- 172.21.15.79:0/1823889755 shutdown_connections 2024-04-25T02:18:20.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.388+0000 7f6a1bb28640 1 --2- 172.21.15.79:0/1823889755 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f69f806be30 0x7f69f806e2f0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.388+0000 7f6a1bb28640 1 --2- 172.21.15.79:0/1823889755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a1415e4d0 0x7f6a14161dc0 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.388+0000 7f6a1bb28640 1 --2- 172.21.15.79:0/1823889755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a140b3570 0x7f6a140cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.388+0000 7f6a1bb28640 1 --2- 172.21.15.79:0/1823889755 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a140b3020 0x7f6a1414a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.388+0000 7f6a1bb28640 1 -- 172.21.15.79:0/1823889755 >> 172.21.15.79:0/1823889755 conn(0x7f6a1409d460 msgr2=0x7f6a140b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:20.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.388+0000 7f6a1bb28640 1 -- 172.21.15.79:0/1823889755 shutdown_connections 2024-04-25T02:18:20.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.388+0000 7f6a1bb28640 1 -- 172.21.15.79:0/1823889755 wait complete. 2024-04-25T02:18:20.403 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T02:18:20.403 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:18:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.502+0000 7ff1367c8640 1 Processor -- start 2024-04-25T02:18:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.502+0000 7ff1367c8640 1 -- start start 2024-04-25T02:18:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.502+0000 7ff1367c8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff13015e250 0x7ff1300d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.502+0000 7ff1367c8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1300d2310 con 0x7ff1300d1ca0 2024-04-25T02:18:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.502+0000 7ff1367c8640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1300cef30 con 0x7ff1300d2690 2024-04-25T02:18:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.502+0000 7ff1367c8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff1300d4b30 con 0x7ff13015e250 2024-04-25T02:18:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.503+0000 7ff12ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff13015e250 0x7ff1300d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.503+0000 7ff12f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff1300d1ca0 0x7ff1300cfa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58048/0 (socket says 172.21.15.79:58048) 2024-04-25T02:18:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.503+0000 7ff12f7fe640 1 -- 172.21.15.79:0/446305704 learned_addr learned my addr 172.21.15.79:0/446305704 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:20.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.503+0000 7ff12ffff640 1 -- 172.21.15.79:0/446305704 >> v1:172.21.15.189:6789/0 conn(0x7ff1300d2690 legacy=0x7ff13006bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.503+0000 7ff12ffff640 1 -- 172.21.15.79:0/446305704 >> v1:172.21.15.79:6789/0 conn(0x7ff1300d1ca0 legacy=0x7ff1300cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.503+0000 7ff12ffff640 1 -- 172.21.15.79:0/446305704 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1300cf210 con 0x7ff13015e250 2024-04-25T02:18:20.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.503+0000 7ff12effd640 1 -- 172.21.15.79:0/446305704 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1513498045 0 0) 0x7ff1300d2310 con 0x7ff1300d1ca0 2024-04-25T02:18:20.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.504+0000 7ff12ffff640 1 --2- 172.21.15.79:0/446305704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff13015e250 0x7ff1300d1320 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7ff1180097a0 tx=0x7ff11802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80cf4f07515fbcb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.504+0000 7ff12effd640 1 -- 172.21.15.79:0/446305704 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118037070 con 0x7ff13015e250 2024-04-25T02:18:20.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.504+0000 7ff12effd640 1 -- 172.21.15.79:0/446305704 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff118032440 con 0x7ff13015e250 2024-04-25T02:18:20.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.504+0000 7ff12effd640 1 -- 172.21.15.79:0/446305704 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11802ae60 con 0x7ff13015e250 2024-04-25T02:18:20.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.504+0000 7ff1367c8640 1 -- 172.21.15.79:0/446305704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff13015e250 msgr2=0x7ff1300d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.504+0000 7ff1367c8640 1 --2- 172.21.15.79:0/446305704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff13015e250 0x7ff1300d1320 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7ff1180097a0 tx=0x7ff11802a110 comp rx=0 tx=0).stop 2024-04-25T02:18:20.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.504+0000 7ff1367c8640 1 -- 172.21.15.79:0/446305704 shutdown_connections 2024-04-25T02:18:20.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.504+0000 7ff1367c8640 1 --2- 172.21.15.79:0/446305704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff13015e250 0x7ff1300d1320 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.504+0000 7ff1367c8640 1 -- 172.21.15.79:0/446305704 >> 172.21.15.79:0/446305704 conn(0x7ff13009d460 msgr2=0x7ff1300d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:20.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.504+0000 7ff1367c8640 1 -- 172.21.15.79:0/446305704 shutdown_connections 2024-04-25T02:18:20.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.504+0000 7ff1367c8640 1 -- 172.21.15.79:0/446305704 wait complete. 2024-04-25T02:18:20.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.505+0000 7ff1367c8640 1 Processor -- start 2024-04-25T02:18:20.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.506+0000 7ff1367c8640 1 -- start start 2024-04-25T02:18:20.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.506+0000 7ff1367c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1300d1ca0 0x7ff130151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.506+0000 7ff1367c8640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1300d2690 0x7ff1300caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.506+0000 7ff1367c8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13015e250 0x7ff1301f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.506+0000 7ff1367c8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff13015e630 con 0x7ff1300d1ca0 2024-04-25T02:18:20.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.506+0000 7ff1367c8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1300cebe0 con 0x7ff13015e250 2024-04-25T02:18:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.506+0000 7ff1367c8640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff13015e7b0 con 0x7ff1300d2690 2024-04-25T02:18:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.506+0000 7ff12ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1300d1ca0 0x7ff130151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.506+0000 7ff12ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1300d1ca0 0x7ff130151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39354/0 (socket says 172.21.15.79:39354) 2024-04-25T02:18:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.506+0000 7ff12ffff640 1 -- 172.21.15.79:0/1481606142 learned_addr learned my addr 172.21.15.79:0/1481606142 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.507+0000 7ff12f7fe640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1300d2690 0x7ff1300caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.507+0000 7ff134d65640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13015e250 0x7ff1301f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.507+0000 7ff12ffff640 1 -- 172.21.15.79:0/1481606142 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1300d2690 msgr2=0x7ff1300caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.507+0000 7ff12ffff640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1300d2690 0x7ff1300caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.507+0000 7ff12ffff640 1 -- 172.21.15.79:0/1481606142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13015e250 msgr2=0x7ff1301f3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.507+0000 7ff12ffff640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13015e250 0x7ff1301f3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.507+0000 7ff12ffff640 1 -- 172.21.15.79:0/1481606142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1301f43a0 con 0x7ff1300d1ca0 2024-04-25T02:18:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.507+0000 7ff12f7fe640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1300d2690 0x7ff1300caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.507+0000 7ff134d65640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13015e250 0x7ff1301f3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.507+0000 7ff12ffff640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1300d1ca0 0x7ff130151d80 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7ff1180098c0 tx=0x7ff1180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.507+0000 7ff12cff9640 1 -- 172.21.15.79:0/1481606142 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118037040 con 0x7ff1300d1ca0 2024-04-25T02:18:20.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.507+0000 7ff12cff9640 1 -- 172.21.15.79:0/1481606142 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff118042070 con 0x7ff1300d1ca0 2024-04-25T02:18:20.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.507+0000 7ff1367c8640 1 -- 172.21.15.79:0/1481606142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff130152480 con 0x7ff1300d1ca0 2024-04-25T02:18:20.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.507+0000 7ff12cff9640 1 -- 172.21.15.79:0/1481606142 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118030c70 con 0x7ff1300d1ca0 2024-04-25T02:18:20.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.507+0000 7ff1367c8640 1 -- 172.21.15.79:0/1481606142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff130152a40 con 0x7ff1300d1ca0 2024-04-25T02:18:20.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.508+0000 7ff1367c8640 1 -- 172.21.15.79:0/1481606142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1300690a0 con 0x7ff1300d1ca0 2024-04-25T02:18:20.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.508+0000 7ff12cff9640 1 -- 172.21.15.79:0/1481606142 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff118047460 con 0x7ff1300d1ca0 2024-04-25T02:18:20.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.509+0000 7ff12cff9640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff11006be30 0x7ff11006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.509+0000 7ff12cff9640 1 -- 172.21.15.79:0/1481606142 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7ff1180ab840 con 0x7ff1300d1ca0 2024-04-25T02:18:20.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.509+0000 7ff12f7fe640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff11006be30 0x7ff11006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.509+0000 7ff12cff9640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x7ff110071e30 0x7ff110074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.509+0000 7ff12cff9640 1 -- 172.21.15.79:0/1481606142 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff118049e70 con 0x7ff110071e30 2024-04-25T02:18:20.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.509+0000 7ff12cff9640 1 -- 172.21.15.79:0/1481606142 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7ff1180b02c0 con 0x7ff1300d1ca0 2024-04-25T02:18:20.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.509+0000 7ff134d65640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x7ff110071e30 0x7ff110074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.509+0000 7ff12f7fe640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff11006be30 0x7ff11006e2f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff1301f7a00 tx=0x7ff120009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.510+0000 7ff134d65640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x7ff110071e30 0x7ff110074250 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.510+0000 7ff12cff9640 1 -- 172.21.15.79:0/1481606142 <== osd.4 v2:172.21.15.189:6800/1910571406 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff118049e70 con 0x7ff110071e30 2024-04-25T02:18:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.537+0000 7ff1367c8640 1 -- 172.21.15.79:0/1481606142 --> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff1300c7340 con 0x7ff110071e30 2024-04-25T02:18:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.538+0000 7ff12cff9640 1 -- 172.21.15.79:0/1481606142 <== osd.4 v2:172.21.15.189:6800/1910571406 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff1300c7340 con 0x7ff110071e30 2024-04-25T02:18:20.542 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:18:20.542 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:18:20.542 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:18:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.538+0000 7ff1367c8640 1 -- 172.21.15.79:0/1481606142 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x7ff110071e30 msgr2=0x7ff110074250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.538+0000 7ff1367c8640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.189:6800/1910571406,v1:172.21.15.189:6801/1910571406] conn(0x7ff110071e30 0x7ff110074250 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.538+0000 7ff1367c8640 1 -- 172.21.15.79:0/1481606142 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff11006be30 msgr2=0x7ff11006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.538+0000 7ff1367c8640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff11006be30 0x7ff11006e2f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff1301f7a00 tx=0x7ff120009040 comp rx=0 tx=0).stop 2024-04-25T02:18:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.538+0000 7ff1367c8640 1 -- 172.21.15.79:0/1481606142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1300d1ca0 msgr2=0x7ff130151d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.539+0000 7ff1367c8640 1 --2- 172.21.15.79:0/1481606142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1300d1ca0 0x7ff130151d80 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7ff1180098c0 tx=0x7ff1180046c0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.539+0000 7ff134d65640 1 -- 172.21.15.79:0/1481606142 reap_dead start 2024-04-25T02:18:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.539+0000 7ff1367c8640 1 -- 172.21.15.79:0/1481606142 shutdown_connections 2024-04-25T02:18:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.539+0000 7ff1367c8640 1 -- 172.21.15.79:0/1481606142 >> 172.21.15.79:0/1481606142 conn(0x7ff13009d460 msgr2=0x7ff1300b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.539+0000 7ff1367c8640 1 -- 172.21.15.79:0/1481606142 shutdown_connections 2024-04-25T02:18:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.539+0000 7ff1367c8640 1 -- 172.21.15.79:0/1481606142 wait complete. 2024-04-25T02:18:20.557 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T02:18:20.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.651+0000 7f7e92adf640 1 Processor -- start 2024-04-25T02:18:20.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.651+0000 7f7e92adf640 1 -- start start 2024-04-25T02:18:20.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.652+0000 7f7e92adf640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7e8c1616b0 0x7f7e8c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.652+0000 7f7e92adf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e8c0b5c30 0x7f7e8c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.652+0000 7f7e92adf640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e8c072620 con 0x7f7e8c0b60c0 2024-04-25T02:18:20.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.652+0000 7f7e92adf640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7e8c072900 con 0x7f7e8c0b5c30 2024-04-25T02:18:20.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.652+0000 7f7e92adf640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f7e8c072be0 con 0x7f7e8c1616b0 2024-04-25T02:18:20.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.652+0000 7f7e8bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e8c0b5c30 0x7f7e8c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.652+0000 7f7e8bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e8c0b5c30 0x7f7e8c06b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39366/0 (socket says 172.21.15.79:39366) 2024-04-25T02:18:20.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.652+0000 7f7e8bfff640 1 -- 172.21.15.79:0/1455917089 learned_addr learned my addr 172.21.15.79:0/1455917089 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:20.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.652+0000 7f7e9087b640 1 --2- 172.21.15.79:0/1455917089 >> v2:172.21.15.189:3300/0 conn(0x7f7e8c1616b0 0x7f7e8c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.652+0000 7f7e8bfff640 1 -- 172.21.15.79:0/1455917089 >> v2:172.21.15.189:3300/0 conn(0x7f7e8c1616b0 msgr2=0x7f7e8c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:20.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.652+0000 7f7e8bfff640 1 --2- 172.21.15.79:0/1455917089 >> v2:172.21.15.189:3300/0 conn(0x7f7e8c1616b0 0x7f7e8c0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.653+0000 7f7e8bfff640 1 -- 172.21.15.79:0/1455917089 >> v1:172.21.15.189:6789/0 conn(0x7f7e8c0b60c0 legacy=0x7f7e8c06dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.653+0000 7f7e8bfff640 1 -- 172.21.15.79:0/1455917089 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c0b3fe0 con 0x7f7e8c0b5c30 2024-04-25T02:18:20.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.653+0000 7f7e8bfff640 1 --2- 172.21.15.79:0/1455917089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e8c0b5c30 0x7f7e8c06b0b0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c072150 tx=0x7f7e7802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d65658a8258e57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.653+0000 7f7e8b7fe640 1 -- 172.21.15.79:0/1455917089 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78037070 con 0x7f7e8c0b5c30 2024-04-25T02:18:20.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.653+0000 7f7e8b7fe640 1 -- 172.21.15.79:0/1455917089 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e78032440 con 0x7f7e8c0b5c30 2024-04-25T02:18:20.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.653+0000 7f7e8b7fe640 1 -- 172.21.15.79:0/1455917089 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78032810 con 0x7f7e8c0b5c30 2024-04-25T02:18:20.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.654+0000 7f7e92adf640 1 -- 172.21.15.79:0/1455917089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e8c0b5c30 msgr2=0x7f7e8c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.654+0000 7f7e92adf640 1 --2- 172.21.15.79:0/1455917089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e8c0b5c30 0x7f7e8c06b0b0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c072150 tx=0x7f7e7802a1e0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.654+0000 7f7e92adf640 1 -- 172.21.15.79:0/1455917089 shutdown_connections 2024-04-25T02:18:20.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.654+0000 7f7e92adf640 1 --2- 172.21.15.79:0/1455917089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e8c0b5c30 0x7f7e8c06b0b0 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.654+0000 7f7e92adf640 1 --2- 172.21.15.79:0/1455917089 >> v2:172.21.15.189:3300/0 conn(0x7f7e8c1616b0 0x7f7e8c0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.654+0000 7f7e92adf640 1 -- 172.21.15.79:0/1455917089 >> 172.21.15.79:0/1455917089 conn(0x7f7e8c06c3a0 msgr2=0x7f7e8c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:20.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.654+0000 7f7e92adf640 1 -- 172.21.15.79:0/1455917089 shutdown_connections 2024-04-25T02:18:20.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.654+0000 7f7e92adf640 1 -- 172.21.15.79:0/1455917089 wait complete. 2024-04-25T02:18:20.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.655+0000 7f7e92adf640 1 Processor -- start 2024-04-25T02:18:20.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.655+0000 7f7e92adf640 1 -- start start 2024-04-25T02:18:20.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.656+0000 7f7e92adf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e8c0b5c30 0x7f7e8c0ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.656+0000 7f7e92adf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e8c0b60c0 0x7f7e8c0cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.656+0000 7f7e92adf640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e8c1616b0 0x7f7e8c0d0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.656+0000 7f7e92adf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c161a90 con 0x7f7e8c0b60c0 2024-04-25T02:18:20.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.656+0000 7f7e92adf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c0d1ae0 con 0x7f7e8c0b5c30 2024-04-25T02:18:20.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.656+0000 7f7e92adf640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8c161c10 con 0x7f7e8c1616b0 2024-04-25T02:18:20.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.656+0000 7f7e8bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e8c0b60c0 0x7f7e8c0cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.656+0000 7f7e8bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e8c0b60c0 0x7f7e8c0cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39368/0 (socket says 172.21.15.79:39368) 2024-04-25T02:18:20.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.656+0000 7f7e8bfff640 1 -- 172.21.15.79:0/3365207046 learned_addr learned my addr 172.21.15.79:0/3365207046 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:20.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.657+0000 7f7e9087b640 1 --2- 172.21.15.79:0/3365207046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e8c0b5c30 0x7f7e8c0ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.657+0000 7f7e9107c640 1 --2- 172.21.15.79:0/3365207046 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e8c1616b0 0x7f7e8c0d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.657+0000 7f7e8bfff640 1 -- 172.21.15.79:0/3365207046 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e8c1616b0 msgr2=0x7f7e8c0d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.657+0000 7f7e8bfff640 1 --2- 172.21.15.79:0/3365207046 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e8c1616b0 0x7f7e8c0d0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.657+0000 7f7e8bfff640 1 -- 172.21.15.79:0/3365207046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e8c0b5c30 msgr2=0x7f7e8c0ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.657+0000 7f7e8bfff640 1 --2- 172.21.15.79:0/3365207046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e8c0b5c30 0x7f7e8c0ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.657+0000 7f7e8bfff640 1 -- 172.21.15.79:0/3365207046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c1f4e30 con 0x7f7e8c0b60c0 2024-04-25T02:18:20.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.657+0000 7f7e8bfff640 1 --2- 172.21.15.79:0/3365207046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e8c0b60c0 0x7f7e8c0cfc00 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f7e7802a220 tx=0x7f7e780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.657+0000 7f7e897fa640 1 -- 172.21.15.79:0/3365207046 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78037040 con 0x7f7e8c0b60c0 2024-04-25T02:18:20.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.657+0000 7f7e897fa640 1 -- 172.21.15.79:0/3365207046 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e78042070 con 0x7f7e8c0b60c0 2024-04-25T02:18:20.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.657+0000 7f7e897fa640 1 -- 172.21.15.79:0/3365207046 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78030880 con 0x7f7e8c0b60c0 2024-04-25T02:18:20.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.657+0000 7f7e92adf640 1 -- 172.21.15.79:0/3365207046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8c0d0770 con 0x7f7e8c0b60c0 2024-04-25T02:18:20.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.657+0000 7f7e92adf640 1 -- 172.21.15.79:0/3365207046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8c1f56b0 con 0x7f7e8c0b60c0 2024-04-25T02:18:20.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.658+0000 7f7e92adf640 1 -- 172.21.15.79:0/3365207046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e8c0681e0 con 0x7f7e8c0b60c0 2024-04-25T02:18:20.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.659+0000 7f7e897fa640 1 -- 172.21.15.79:0/3365207046 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e78030a20 con 0x7f7e8c0b60c0 2024-04-25T02:18:20.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.659+0000 7f7e897fa640 1 --2- 172.21.15.79:0/3365207046 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7e7006be30 0x7f7e7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.659+0000 7f7e897fa640 1 -- 172.21.15.79:0/3365207046 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f7e780ab3c0 con 0x7f7e8c0b60c0 2024-04-25T02:18:20.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.659+0000 7f7e9087b640 1 --2- 172.21.15.79:0/3365207046 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7e7006be30 0x7f7e7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.660+0000 7f7e9087b640 1 --2- 172.21.15.79:0/3365207046 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7e7006be30 0x7f7e7006e2f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009a30 tx=0x7f7e80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.663+0000 7f7e897fa640 1 -- 172.21.15.79:0/3365207046 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7e78079fc0 con 0x7f7e8c0b60c0 2024-04-25T02:18:20.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.843+0000 7f7e92adf640 1 -- 172.21.15.79:0/3365207046 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f7e8c0b1f80 con 0x7f7e7006be30 2024-04-25T02:18:20.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.843+0000 7f7e897fa640 1 -- 172.21.15.79:0/3365207046 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7e8c0b1f80 con 0x7f7e7006be30 2024-04-25T02:18:20.847 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T02:18:20.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.845+0000 7f7e92adf640 1 -- 172.21.15.79:0/3365207046 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7e7006be30 msgr2=0x7f7e7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.845+0000 7f7e92adf640 1 --2- 172.21.15.79:0/3365207046 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7e7006be30 0x7f7e7006e2f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009a30 tx=0x7f7e80008040 comp rx=0 tx=0).stop 2024-04-25T02:18:20.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.845+0000 7f7e92adf640 1 -- 172.21.15.79:0/3365207046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e8c0b60c0 msgr2=0x7f7e8c0cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.845+0000 7f7e92adf640 1 --2- 172.21.15.79:0/3365207046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e8c0b60c0 0x7f7e8c0cfc00 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f7e7802a220 tx=0x7f7e780046c0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.845+0000 7f7e92adf640 1 -- 172.21.15.79:0/3365207046 shutdown_connections 2024-04-25T02:18:20.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.845+0000 7f7e92adf640 1 --2- 172.21.15.79:0/3365207046 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f7e7006be30 0x7f7e7006e2f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.845+0000 7f7e92adf640 1 --2- 172.21.15.79:0/3365207046 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7e8c1616b0 0x7f7e8c0d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.845+0000 7f7e92adf640 1 --2- 172.21.15.79:0/3365207046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e8c0b60c0 0x7f7e8c0cfc00 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.845+0000 7f7e92adf640 1 --2- 172.21.15.79:0/3365207046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e8c0b5c30 0x7f7e8c0ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.845+0000 7f7e92adf640 1 -- 172.21.15.79:0/3365207046 >> 172.21.15.79:0/3365207046 conn(0x7f7e8c06c3a0 msgr2=0x7f7e8c06e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:20.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.845+0000 7f7e92adf640 1 -- 172.21.15.79:0/3365207046 shutdown_connections 2024-04-25T02:18:20.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.845+0000 7f7e92adf640 1 -- 172.21.15.79:0/3365207046 wait complete. 2024-04-25T02:18:20.860 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T02:18:20.860 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:18:20.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.959+0000 7faf21fab640 1 Processor -- start 2024-04-25T02:18:20.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.959+0000 7faf21fab640 1 -- start start 2024-04-25T02:18:20.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.960+0000 7faf21fab640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faf1c0d2f20 0x7faf1c0d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.960+0000 7faf21fab640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf1c0d1e80 con 0x7faf1c0d0ed0 2024-04-25T02:18:20.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.960+0000 7faf21fab640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf1c0d2160 con 0x7faf1c15e440 2024-04-25T02:18:20.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.960+0000 7faf21fab640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faf1c0d2440 con 0x7faf1c0d2f20 2024-04-25T02:18:20.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.960+0000 7faf1bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faf1c0d0ed0 0x7faf1c0b6ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58050/0 (socket says 172.21.15.79:58050) 2024-04-25T02:18:20.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.960+0000 7faf1bfff640 1 -- 172.21.15.79:0/2118329990 learned_addr learned my addr 172.21.15.79:0/2118329990 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:20.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.960+0000 7faf1affd640 1 --2- 172.21.15.79:0/2118329990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faf1c0d2f20 0x7faf1c0d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.960+0000 7faf1a7fc640 1 -- 172.21.15.79:0/2118329990 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4229531556 0 0) 0x7faf1c0d1e80 con 0x7faf1c0d0ed0 2024-04-25T02:18:20.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.960+0000 7faf1a7fc640 1 -- 172.21.15.79:0/2118329990 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf04003520 con 0x7faf1c0d0ed0 2024-04-25T02:18:20.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.960+0000 7faf1a7fc640 1 -- 172.21.15.79:0/2118329990 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3033771494 0 0) 0x7faf1c0d2160 con 0x7faf1c15e440 2024-04-25T02:18:20.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.960+0000 7faf1a7fc640 1 -- 172.21.15.79:0/2118329990 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf1c0d1e80 con 0x7faf1c15e440 2024-04-25T02:18:20.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.960+0000 7faf1affd640 1 -- 172.21.15.79:0/2118329990 >> v1:172.21.15.189:6789/0 conn(0x7faf1c15e440 legacy=0x7faf1c0cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.960+0000 7faf1affd640 1 -- 172.21.15.79:0/2118329990 >> v1:172.21.15.79:6789/0 conn(0x7faf1c0d0ed0 legacy=0x7faf1c0b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.960+0000 7faf1affd640 1 -- 172.21.15.79:0/2118329990 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1c0d2720 con 0x7faf1c0d2f20 2024-04-25T02:18:20.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.961+0000 7faf1affd640 1 --2- 172.21.15.79:0/2118329990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faf1c0d2f20 0x7faf1c0d0990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faf100097d0 tx=0x7faf1002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab286ec42a610d69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.961+0000 7faf1a7fc640 1 -- 172.21.15.79:0/2118329990 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10037070 con 0x7faf1c0d2f20 2024-04-25T02:18:20.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.961+0000 7faf1a7fc640 1 -- 172.21.15.79:0/2118329990 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf10032440 con 0x7faf1c0d2f20 2024-04-25T02:18:20.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.961+0000 7faf1a7fc640 1 -- 172.21.15.79:0/2118329990 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf100327f0 con 0x7faf1c0d2f20 2024-04-25T02:18:20.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.962+0000 7faf21fab640 1 -- 172.21.15.79:0/2118329990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faf1c0d2f20 msgr2=0x7faf1c0d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.962+0000 7faf21fab640 1 --2- 172.21.15.79:0/2118329990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faf1c0d2f20 0x7faf1c0d0990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faf100097d0 tx=0x7faf1002a210 comp rx=0 tx=0).stop 2024-04-25T02:18:20.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.962+0000 7faf21fab640 1 -- 172.21.15.79:0/2118329990 shutdown_connections 2024-04-25T02:18:20.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.962+0000 7faf21fab640 1 --2- 172.21.15.79:0/2118329990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faf1c0d2f20 0x7faf1c0d0990 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.962+0000 7faf21fab640 1 -- 172.21.15.79:0/2118329990 >> 172.21.15.79:0/2118329990 conn(0x7faf1c09d450 msgr2=0x7faf1c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:20.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.962+0000 7faf21fab640 1 -- 172.21.15.79:0/2118329990 shutdown_connections 2024-04-25T02:18:20.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.962+0000 7faf21fab640 1 -- 172.21.15.79:0/2118329990 wait complete. 2024-04-25T02:18:20.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.963+0000 7faf21fab640 1 Processor -- start 2024-04-25T02:18:20.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.963+0000 7faf21fab640 1 -- start start 2024-04-25T02:18:20.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf21fab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf1c0d0ed0 0x7faf1c0cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf21fab640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faf1c0d2f20 0x7faf1c0b9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf21fab640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faf1c15e440 0x7faf1c0b9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf21fab640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c0d0100 con 0x7faf1c0d0ed0 2024-04-25T02:18:20.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf21fab640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c0cff80 con 0x7faf1c0d2f20 2024-04-25T02:18:20.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf21fab640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7faf1c0b7600 con 0x7faf1c15e440 2024-04-25T02:18:20.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf1b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf1c0d0ed0 0x7faf1c0cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf1b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf1c0d0ed0 0x7faf1c0cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39380/0 (socket says 172.21.15.79:39380) 2024-04-25T02:18:20.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf1b7fe640 1 -- 172.21.15.79:0/639290786 learned_addr learned my addr 172.21.15.79:0/639290786 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:20.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf1affd640 1 --2- 172.21.15.79:0/639290786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faf1c0d2f20 0x7faf1c0b9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf1bfff640 1 --2- 172.21.15.79:0/639290786 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faf1c15e440 0x7faf1c0b9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf1b7fe640 1 -- 172.21.15.79:0/639290786 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faf1c15e440 msgr2=0x7faf1c0b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf1b7fe640 1 --2- 172.21.15.79:0/639290786 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faf1c15e440 0x7faf1c0b9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf1b7fe640 1 -- 172.21.15.79:0/639290786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faf1c0d2f20 msgr2=0x7faf1c0b9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf1b7fe640 1 --2- 172.21.15.79:0/639290786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faf1c0d2f20 0x7faf1c0b9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.964+0000 7faf1b7fe640 1 -- 172.21.15.79:0/639290786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1c1f7b00 con 0x7faf1c0d0ed0 2024-04-25T02:18:20.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.965+0000 7faf1b7fe640 1 --2- 172.21.15.79:0/639290786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf1c0d0ed0 0x7faf1c0cdbf0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00c430 tx=0x7faf0c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.965+0000 7faf03fff640 1 -- 172.21.15.79:0/639290786 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c017070 con 0x7faf1c0d0ed0 2024-04-25T02:18:20.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.965+0000 7faf03fff640 1 -- 172.21.15.79:0/639290786 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0c0052f0 con 0x7faf1c0d0ed0 2024-04-25T02:18:20.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.965+0000 7faf21fab640 1 -- 172.21.15.79:0/639290786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf1c1f7da0 con 0x7faf1c0d0ed0 2024-04-25T02:18:20.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.965+0000 7faf03fff640 1 -- 172.21.15.79:0/639290786 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c003830 con 0x7faf1c0d0ed0 2024-04-25T02:18:20.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.965+0000 7faf21fab640 1 -- 172.21.15.79:0/639290786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf1c0c8d90 con 0x7faf1c0d0ed0 2024-04-25T02:18:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.966+0000 7faf21fab640 1 -- 172.21.15.79:0/639290786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf1c0690a0 con 0x7faf1c0d0ed0 2024-04-25T02:18:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.966+0000 7faf03fff640 1 -- 172.21.15.79:0/639290786 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf0c01a070 con 0x7faf1c0d0ed0 2024-04-25T02:18:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.967+0000 7faf03fff640 1 --2- 172.21.15.79:0/639290786 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf0806be30 0x7faf0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.967+0000 7faf03fff640 1 -- 172.21.15.79:0/639290786 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7faf0c089f60 con 0x7faf1c0d0ed0 2024-04-25T02:18:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.967+0000 7faf1affd640 1 --2- 172.21.15.79:0/639290786 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf0806be30 0x7faf0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.967+0000 7faf03fff640 1 --2- 172.21.15.79:0/639290786 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x7faf08071e30 0x7faf08074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.967+0000 7faf03fff640 1 -- 172.21.15.79:0/639290786 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf0c0054a0 con 0x7faf08071e30 2024-04-25T02:18:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.967+0000 7faf03fff640 1 -- 172.21.15.79:0/639290786 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7faf0c08c600 con 0x7faf1c0d0ed0 2024-04-25T02:18:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.967+0000 7faf1bfff640 1 --2- 172.21.15.79:0/639290786 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x7faf08071e30 0x7faf08074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.967+0000 7faf1affd640 1 --2- 172.21.15.79:0/639290786 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf0806be30 0x7faf0806e2f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7faf10034000 tx=0x7faf1002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.968+0000 7faf1bfff640 1 --2- 172.21.15.79:0/639290786 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x7faf08071e30 0x7faf08074250 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:20.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.968+0000 7faf03fff640 1 -- 172.21.15.79:0/639290786 <== osd.5 v2:172.21.15.189:6802/1246927196 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faf0c0054a0 con 0x7faf08071e30 2024-04-25T02:18:20.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.981+0000 7faf21fab640 1 -- 172.21.15.79:0/639290786 --> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faf1c0ce430 con 0x7faf08071e30 2024-04-25T02:18:20.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.982+0000 7faf03fff640 1 -- 172.21.15.79:0/639290786 <== osd.5 v2:172.21.15.189:6802/1246927196 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faf1c0ce430 con 0x7faf08071e30 2024-04-25T02:18:20.986 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:18:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:18:20.986 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:18:20.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.982+0000 7faf21fab640 1 -- 172.21.15.79:0/639290786 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x7faf08071e30 msgr2=0x7faf08074250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.982+0000 7faf21fab640 1 --2- 172.21.15.79:0/639290786 >> [v2:172.21.15.189:6802/1246927196,v1:172.21.15.189:6804/1246927196] conn(0x7faf08071e30 0x7faf08074250 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.982+0000 7faf21fab640 1 -- 172.21.15.79:0/639290786 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf0806be30 msgr2=0x7faf0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.982+0000 7faf21fab640 1 --2- 172.21.15.79:0/639290786 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7faf0806be30 0x7faf0806e2f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7faf10034000 tx=0x7faf1002e000 comp rx=0 tx=0).stop 2024-04-25T02:18:20.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.982+0000 7faf21fab640 1 -- 172.21.15.79:0/639290786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf1c0d0ed0 msgr2=0x7faf1c0cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:20.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.982+0000 7faf21fab640 1 --2- 172.21.15.79:0/639290786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf1c0d0ed0 0x7faf1c0cdbf0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00c430 tx=0x7faf0c00c8f0 comp rx=0 tx=0).stop 2024-04-25T02:18:20.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.982+0000 7faf1bfff640 1 -- 172.21.15.79:0/639290786 reap_dead start 2024-04-25T02:18:20.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.982+0000 7faf21fab640 1 -- 172.21.15.79:0/639290786 shutdown_connections 2024-04-25T02:18:20.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.982+0000 7faf21fab640 1 -- 172.21.15.79:0/639290786 >> 172.21.15.79:0/639290786 conn(0x7faf1c09d450 msgr2=0x7faf1c0b8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:20.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.982+0000 7faf21fab640 1 -- 172.21.15.79:0/639290786 shutdown_connections 2024-04-25T02:18:20.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:20.982+0000 7faf21fab640 1 -- 172.21.15.79:0/639290786 wait complete. 2024-04-25T02:18:20.997 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T02:18:21.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.092+0000 7ff632116640 1 Processor -- start 2024-04-25T02:18:21.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.092+0000 7ff632116640 1 -- start start 2024-04-25T02:18:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.092+0000 7ff632116640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff62c144cb0 0x7ff62c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.092+0000 7ff632116640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff62c070d90 con 0x7ff62c06e660 2024-04-25T02:18:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.092+0000 7ff632116640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff62c0cf130 con 0x7ff62c0b5580 2024-04-25T02:18:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.092+0000 7ff632116640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff62c0cf410 con 0x7ff62c144cb0 2024-04-25T02:18:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.093+0000 7ff62bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff62c06e660 0x7ff62c071240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58066/0 (socket says 172.21.15.79:58066) 2024-04-25T02:18:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.093+0000 7ff62bfff640 1 -- 172.21.15.79:0/1827023015 learned_addr learned my addr 172.21.15.79:0/1827023015 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.093+0000 7ff62b7fe640 1 --2- 172.21.15.79:0/1827023015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff62c144cb0 0x7ff62c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.093+0000 7ff62a7fc640 1 -- 172.21.15.79:0/1827023015 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1304696008 0 0) 0x7ff62c070d90 con 0x7ff62c06e660 2024-04-25T02:18:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.093+0000 7ff62a7fc640 1 -- 172.21.15.79:0/1827023015 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff618003520 con 0x7ff62c06e660 2024-04-25T02:18:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.093+0000 7ff62a7fc640 1 -- 172.21.15.79:0/1827023015 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3835647637 0 0) 0x7ff62c0cf130 con 0x7ff62c0b5580 2024-04-25T02:18:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.093+0000 7ff62a7fc640 1 -- 172.21.15.79:0/1827023015 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff62c070d90 con 0x7ff62c0b5580 2024-04-25T02:18:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.093+0000 7ff62b7fe640 1 -- 172.21.15.79:0/1827023015 >> v1:172.21.15.189:6789/0 conn(0x7ff62c0b5580 legacy=0x7ff62c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.093+0000 7ff62a7fc640 1 -- 172.21.15.79:0/1827023015 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2415046086 0 0) 0x7ff618003520 con 0x7ff62c06e660 2024-04-25T02:18:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.093+0000 7ff62b7fe640 1 -- 172.21.15.79:0/1827023015 >> v1:172.21.15.79:6789/0 conn(0x7ff62c06e660 legacy=0x7ff62c071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.093+0000 7ff62b7fe640 1 -- 172.21.15.79:0/1827023015 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62c0cf6f0 con 0x7ff62c144cb0 2024-04-25T02:18:21.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.094+0000 7ff62b7fe640 1 --2- 172.21.15.79:0/1827023015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff62c144cb0 0x7ff62c0b5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009dc0 tx=0x7ff61c02a540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3c586860af23a53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.094+0000 7ff62a7fc640 1 -- 172.21.15.79:0/1827023015 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624001670 con 0x7ff62c144cb0 2024-04-25T02:18:21.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.094+0000 7ff62a7fc640 1 -- 172.21.15.79:0/1827023015 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff61c007540 con 0x7ff62c144cb0 2024-04-25T02:18:21.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.094+0000 7ff62a7fc640 1 -- 172.21.15.79:0/1827023015 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c007910 con 0x7ff62c144cb0 2024-04-25T02:18:21.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.095+0000 7ff632116640 1 -- 172.21.15.79:0/1827023015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff62c144cb0 msgr2=0x7ff62c0b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.095+0000 7ff632116640 1 --2- 172.21.15.79:0/1827023015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff62c144cb0 0x7ff62c0b5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009dc0 tx=0x7ff61c02a540 comp rx=0 tx=0).stop 2024-04-25T02:18:21.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.095+0000 7ff632116640 1 -- 172.21.15.79:0/1827023015 shutdown_connections 2024-04-25T02:18:21.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.095+0000 7ff632116640 1 --2- 172.21.15.79:0/1827023015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff62c144cb0 0x7ff62c0b5040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.095+0000 7ff632116640 1 -- 172.21.15.79:0/1827023015 >> 172.21.15.79:0/1827023015 conn(0x7ff62c0cfc80 msgr2=0x7ff62c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:21.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.095+0000 7ff632116640 1 -- 172.21.15.79:0/1827023015 shutdown_connections 2024-04-25T02:18:21.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.095+0000 7ff632116640 1 -- 172.21.15.79:0/1827023015 wait complete. 2024-04-25T02:18:21.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.096+0000 7ff632116640 1 Processor -- start 2024-04-25T02:18:21.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.096+0000 7ff632116640 1 -- start start 2024-04-25T02:18:21.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff632116640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff62c06e660 0x7ff62c13f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff632116640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff62c0b5580 0x7ff62c158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff632116640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff62c144cb0 0x7ff62c1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff632116640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff62c145ab0 con 0x7ff62c0b5580 2024-04-25T02:18:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff632116640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff62c145090 con 0x7ff62c06e660 2024-04-25T02:18:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff632116640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff62c145c30 con 0x7ff62c144cb0 2024-04-25T02:18:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff62affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff62c0b5580 0x7ff62c158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff62affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff62c0b5580 0x7ff62c158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39386/0 (socket says 172.21.15.79:39386) 2024-04-25T02:18:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff62affd640 1 -- 172.21.15.79:0/3377425268 learned_addr learned my addr 172.21.15.79:0/3377425268 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff62b7fe640 1 --2- 172.21.15.79:0/3377425268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff62c06e660 0x7ff62c13f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff62bfff640 1 --2- 172.21.15.79:0/3377425268 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff62c144cb0 0x7ff62c1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff62affd640 1 -- 172.21.15.79:0/3377425268 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff62c144cb0 msgr2=0x7ff62c1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff62affd640 1 --2- 172.21.15.79:0/3377425268 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff62c144cb0 0x7ff62c1592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff62affd640 1 -- 172.21.15.79:0/3377425268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff62c06e660 msgr2=0x7ff62c13f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff62affd640 1 --2- 172.21.15.79:0/3377425268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff62c06e660 0x7ff62c13f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff62affd640 1 -- 172.21.15.79:0/3377425268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62c1e7160 con 0x7ff62c0b5580 2024-04-25T02:18:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff62affd640 1 --2- 172.21.15.79:0/3377425268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff62c0b5580 0x7ff62c158900 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7ff61400c4c0 tx=0x7ff61400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff623fff640 1 -- 172.21.15.79:0/3377425268 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6140052d0 con 0x7ff62c0b5580 2024-04-25T02:18:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff623fff640 1 -- 172.21.15.79:0/3377425268 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff614005470 con 0x7ff62c0b5580 2024-04-25T02:18:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.097+0000 7ff632116640 1 -- 172.21.15.79:0/3377425268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff62c1e7440 con 0x7ff62c0b5580 2024-04-25T02:18:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.098+0000 7ff623fff640 1 -- 172.21.15.79:0/3377425268 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614012870 con 0x7ff62c0b5580 2024-04-25T02:18:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.098+0000 7ff632116640 1 -- 172.21.15.79:0/3377425268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff62c1e7a00 con 0x7ff62c0b5580 2024-04-25T02:18:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.098+0000 7ff632116640 1 -- 172.21.15.79:0/3377425268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff62c0690a0 con 0x7ff62c0b5580 2024-04-25T02:18:21.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.099+0000 7ff623fff640 1 -- 172.21.15.79:0/3377425268 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff614012a10 con 0x7ff62c0b5580 2024-04-25T02:18:21.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.099+0000 7ff623fff640 1 --2- 172.21.15.79:0/3377425268 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff60c06be30 0x7ff60c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.099+0000 7ff623fff640 1 -- 172.21.15.79:0/3377425268 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7ff61408a860 con 0x7ff62c0b5580 2024-04-25T02:18:21.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.100+0000 7ff62b7fe640 1 --2- 172.21.15.79:0/3377425268 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff60c06be30 0x7ff60c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.100+0000 7ff62b7fe640 1 --2- 172.21.15.79:0/3377425268 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff60c06be30 0x7ff60c06e2f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff61c034000 tx=0x7ff61c033040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.104+0000 7ff623fff640 1 -- 172.21.15.79:0/3377425268 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff6140594f0 con 0x7ff62c0b5580 2024-04-25T02:18:21.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.286+0000 7ff632116640 1 -- 172.21.15.79:0/3377425268 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ff62c0d08e0 con 0x7ff60c06be30 2024-04-25T02:18:21.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.286+0000 7ff623fff640 1 -- 172.21.15.79:0/3377425268 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff62c0d08e0 con 0x7ff60c06be30 2024-04-25T02:18:21.290 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T02:18:21.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.288+0000 7ff632116640 1 -- 172.21.15.79:0/3377425268 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff60c06be30 msgr2=0x7ff60c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.288+0000 7ff632116640 1 --2- 172.21.15.79:0/3377425268 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff60c06be30 0x7ff60c06e2f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff61c034000 tx=0x7ff61c033040 comp rx=0 tx=0).stop 2024-04-25T02:18:21.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.288+0000 7ff632116640 1 -- 172.21.15.79:0/3377425268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff62c0b5580 msgr2=0x7ff62c158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.288+0000 7ff632116640 1 --2- 172.21.15.79:0/3377425268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff62c0b5580 0x7ff62c158900 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7ff61400c4c0 tx=0x7ff61400c980 comp rx=0 tx=0).stop 2024-04-25T02:18:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.288+0000 7ff632116640 1 -- 172.21.15.79:0/3377425268 shutdown_connections 2024-04-25T02:18:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.288+0000 7ff632116640 1 --2- 172.21.15.79:0/3377425268 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff60c06be30 0x7ff60c06e2f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.288+0000 7ff632116640 1 --2- 172.21.15.79:0/3377425268 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff62c144cb0 0x7ff62c1592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.288+0000 7ff632116640 1 --2- 172.21.15.79:0/3377425268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff62c0b5580 0x7ff62c158900 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.288+0000 7ff632116640 1 --2- 172.21.15.79:0/3377425268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff62c06e660 0x7ff62c13f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.288+0000 7ff632116640 1 -- 172.21.15.79:0/3377425268 >> 172.21.15.79:0/3377425268 conn(0x7ff62c0cfc80 msgr2=0x7ff62c0afcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.288+0000 7ff632116640 1 -- 172.21.15.79:0/3377425268 shutdown_connections 2024-04-25T02:18:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.288+0000 7ff632116640 1 -- 172.21.15.79:0/3377425268 wait complete. 2024-04-25T02:18:21.302 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T02:18:21.303 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:18:21.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.400+0000 7f71bbf70640 1 Processor -- start 2024-04-25T02:18:21.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.401+0000 7f71bbf70640 1 -- start start 2024-04-25T02:18:21.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.401+0000 7f71bbf70640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f71b415e440 0x7f71b40cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.401+0000 7f71bbf70640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71b40d2f20 0x7f71b40cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.401+0000 7f71bbf70640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71b40d1e80 con 0x7f71b40d0990 2024-04-25T02:18:21.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.401+0000 7f71bbf70640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f71b40d2160 con 0x7f71b415e440 2024-04-25T02:18:21.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.401+0000 7f71bbf70640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f71b40d2440 con 0x7f71b40d2f20 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.401+0000 7f71ba50d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f71b40d0990 0x7f71b4161e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58074/0 (socket says 172.21.15.79:58074) 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.401+0000 7f71ba50d640 1 -- 172.21.15.79:0/3784570090 learned_addr learned my addr 172.21.15.79:0/3784570090 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b950b640 1 --2- 172.21.15.79:0/3784570090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71b40d2f20 0x7f71b40cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b9d0c640 1 --2- 172.21.15.79:0/3784570090 >> v2:172.21.15.189:3300/0 conn(0x7f71b415e440 0x7f71b40cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 -- 172.21.15.79:0/3784570090 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1757789751 0 0) 0x7f71b40d1e80 con 0x7f71b40d0990 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 -- 172.21.15.79:0/3784570090 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71a0003520 con 0x7f71b40d0990 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 -- 172.21.15.79:0/3784570090 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1485208738 0 0) 0x7f71a0003520 con 0x7f71b40d0990 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 -- 172.21.15.79:0/3784570090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71b40d2f20 msgr2=0x7f71b40cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 --2- 172.21.15.79:0/3784570090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71b40d2f20 0x7f71b40cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 -- 172.21.15.79:0/3784570090 >> v2:172.21.15.189:3300/0 conn(0x7f71b415e440 msgr2=0x7f71b40cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 --2- 172.21.15.79:0/3784570090 >> v2:172.21.15.189:3300/0 conn(0x7f71b415e440 0x7f71b40cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 -- 172.21.15.79:0/3784570090 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b40d2720 con 0x7f71b40d0990 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 -- 172.21.15.79:0/3784570090 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3863414373 0 0) 0x7f71ac0019f0 con 0x7f71b40d0990 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 -- 172.21.15.79:0/3784570090 >> v1:172.21.15.79:6789/0 conn(0x7f71b40d0990 legacy=0x7f71b4161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 --2- 172.21.15.79:0/3784570090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71a00039b0 0x7f71a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 --2- 172.21.15.79:0/3784570090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71a0004800 0x7f71a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 --2- 172.21.15.79:0/3784570090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71b40d2f20 0x7f71a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 -- 172.21.15.79:0/3784570090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71b40d2160 con 0x7f71a00039b0 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 -- 172.21.15.79:0/3784570090 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f71b40d2440 con 0x7f71a0004800 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b8d0a640 1 -- 172.21.15.79:0/3784570090 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f71a000b9c0 con 0x7f71b40d2f20 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b9d0c640 1 --2- 172.21.15.79:0/3784570090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71a00039b0 0x7f71a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b950b640 1 --2- 172.21.15.79:0/3784570090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71a0004800 0x7f71a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71ba50d640 1 --2- 172.21.15.79:0/3784570090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71b40d2f20 0x7f71a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b9d0c640 1 -- 172.21.15.79:0/3784570090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71b40d2f20 msgr2=0x7f71a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b9d0c640 1 --2- 172.21.15.79:0/3784570090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71b40d2f20 0x7f71a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b9d0c640 1 -- 172.21.15.79:0/3784570090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71a0004800 msgr2=0x7f71a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b9d0c640 1 --2- 172.21.15.79:0/3784570090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71a0004800 0x7f71a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b9d0c640 1 -- 172.21.15.79:0/3784570090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a0003520 con 0x7f71a00039b0 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.402+0000 7f71b950b640 1 --2- 172.21.15.79:0/3784570090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71a0004800 0x7f71a0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.403+0000 7f71b9d0c640 1 --2- 172.21.15.79:0/3784570090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71a00039b0 0x7f71a0003dd0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009ac0 tx=0x7f71a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa695636c994e3e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.403+0000 7f71b8d0a640 1 -- 172.21.15.79:0/3784570090 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0036070 con 0x7f71a00039b0 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.403+0000 7f71b8d0a640 1 -- 172.21.15.79:0/3784570090 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b0031400 con 0x7f71a00039b0 2024-04-25T02:18:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.403+0000 7f71b8d0a640 1 -- 172.21.15.79:0/3784570090 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0009690 con 0x7f71a00039b0 2024-04-25T02:18:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.404+0000 7f71bbf70640 1 -- 172.21.15.79:0/3784570090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71a00039b0 msgr2=0x7f71a0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.404+0000 7f71bbf70640 1 --2- 172.21.15.79:0/3784570090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71a00039b0 0x7f71a0003dd0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009ac0 tx=0x7f71a0005830 comp rx=0 tx=0).stop 2024-04-25T02:18:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.404+0000 7f71ba50d640 1 -- 172.21.15.79:0/3784570090 reap_dead start 2024-04-25T02:18:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.404+0000 7f71bbf70640 1 -- 172.21.15.79:0/3784570090 shutdown_connections 2024-04-25T02:18:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.404+0000 7f71bbf70640 1 -- 172.21.15.79:0/3784570090 >> 172.21.15.79:0/3784570090 conn(0x7f71b409d450 msgr2=0x7f71b40d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.404+0000 7f71bbf70640 1 -- 172.21.15.79:0/3784570090 shutdown_connections 2024-04-25T02:18:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.404+0000 7f71bbf70640 1 -- 172.21.15.79:0/3784570090 wait complete. 2024-04-25T02:18:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.405+0000 7f71bbf70640 1 Processor -- start 2024-04-25T02:18:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.405+0000 7f71bbf70640 1 -- start start 2024-04-25T02:18:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71bbf70640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71a00039b0 0x7f71b40cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71bbf70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b4150320 0x7f71b414d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71bbf70640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71b4160c50 0x7f71b41610b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71bbf70640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71b40cff30 con 0x7f71b4150320 2024-04-25T02:18:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71bbf70640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f71b40cfdb0 con 0x7f71b4160c50 2024-04-25T02:18:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71bbf70640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f71b40d00b0 con 0x7f71a00039b0 2024-04-25T02:18:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71b950b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b4150320 0x7f71b414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71b950b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b4150320 0x7f71b414d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39412/0 (socket says 172.21.15.79:39412) 2024-04-25T02:18:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71b950b640 1 -- 172.21.15.79:0/2243081649 learned_addr learned my addr 172.21.15.79:0/2243081649 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71ba50d640 1 --2- 172.21.15.79:0/2243081649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71b4160c50 0x7f71b41610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71b9d0c640 1 --2- 172.21.15.79:0/2243081649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71a00039b0 0x7f71b40cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71b950b640 1 -- 172.21.15.79:0/2243081649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71a00039b0 msgr2=0x7f71b40cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71b950b640 1 --2- 172.21.15.79:0/2243081649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f71a00039b0 0x7f71b40cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71b950b640 1 -- 172.21.15.79:0/2243081649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71b4160c50 msgr2=0x7f71b41610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71b950b640 1 --2- 172.21.15.79:0/2243081649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71b4160c50 0x7f71b41610b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71b950b640 1 -- 172.21.15.79:0/2243081649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b40cb790 con 0x7f71b4150320 2024-04-25T02:18:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71b950b640 1 --2- 172.21.15.79:0/2243081649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b4150320 0x7f71b414d080 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f71a4011700 tx=0x7f71a4011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71aa7fc640 1 -- 172.21.15.79:0/2243081649 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a400f9c0 con 0x7f71b4150320 2024-04-25T02:18:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71aa7fc640 1 -- 172.21.15.79:0/2243081649 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a400fb60 con 0x7f71b4150320 2024-04-25T02:18:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71bbf70640 1 -- 172.21.15.79:0/2243081649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b40cde20 con 0x7f71b4150320 2024-04-25T02:18:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71aa7fc640 1 -- 172.21.15.79:0/2243081649 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4015460 con 0x7f71b4150320 2024-04-25T02:18:21.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.406+0000 7f71bbf70640 1 -- 172.21.15.79:0/2243081649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b41507a0 con 0x7f71b4150320 2024-04-25T02:18:21.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.407+0000 7f71bbf70640 1 -- 172.21.15.79:0/2243081649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f71b414d5c0 con 0x7f71b4150320 2024-04-25T02:18:21.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.408+0000 7f71aa7fc640 1 -- 172.21.15.79:0/2243081649 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71a4015600 con 0x7f71b4150320 2024-04-25T02:18:21.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.408+0000 7f71aa7fc640 1 --2- 172.21.15.79:0/2243081649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f719806be30 0x7f719806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.408+0000 7f71aa7fc640 1 -- 172.21.15.79:0/2243081649 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f71a408bba0 con 0x7f71b4150320 2024-04-25T02:18:21.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.408+0000 7f71b9d0c640 1 --2- 172.21.15.79:0/2243081649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f719806be30 0x7f719806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.408+0000 7f71aa7fc640 1 --2- 172.21.15.79:0/2243081649 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x7f7198071e30 0x7f7198074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.408+0000 7f71aa7fc640 1 -- 172.21.15.79:0/2243081649 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71a4027e50 con 0x7f7198071e30 2024-04-25T02:18:21.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.408+0000 7f71aa7fc640 1 -- 172.21.15.79:0/2243081649 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7f71a408c030 con 0x7f71b4150320 2024-04-25T02:18:21.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.409+0000 7f71b9d0c640 1 --2- 172.21.15.79:0/2243081649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f719806be30 0x7f719806e2f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f71b0033000 tx=0x7f71b0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.409+0000 7f71ba50d640 1 --2- 172.21.15.79:0/2243081649 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x7f7198071e30 0x7f7198074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.409+0000 7f71ba50d640 1 --2- 172.21.15.79:0/2243081649 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x7f7198071e30 0x7f7198074250 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.410+0000 7f71aa7fc640 1 -- 172.21.15.79:0/2243081649 <== osd.6 v2:172.21.15.189:6816/1254358257 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71a4027e50 con 0x7f7198071e30 2024-04-25T02:18:21.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.423+0000 7f71bbf70640 1 -- 172.21.15.79:0/2243081649 --> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f71b40690a0 con 0x7f7198071e30 2024-04-25T02:18:21.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.423+0000 7f71aa7fc640 1 -- 172.21.15.79:0/2243081649 <== osd.6 v2:172.21.15.189:6816/1254358257 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f71b40690a0 con 0x7f7198071e30 2024-04-25T02:18:21.428 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:18:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:18:21.428 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:18:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.424+0000 7f71bbf70640 1 -- 172.21.15.79:0/2243081649 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x7f7198071e30 msgr2=0x7f7198074250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.424+0000 7f71bbf70640 1 --2- 172.21.15.79:0/2243081649 >> [v2:172.21.15.189:6816/1254358257,v1:172.21.15.189:6817/1254358257] conn(0x7f7198071e30 0x7f7198074250 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.424+0000 7f71bbf70640 1 -- 172.21.15.79:0/2243081649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f719806be30 msgr2=0x7f719806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.424+0000 7f71bbf70640 1 --2- 172.21.15.79:0/2243081649 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f719806be30 0x7f719806e2f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f71b0033000 tx=0x7f71b0008030 comp rx=0 tx=0).stop 2024-04-25T02:18:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.424+0000 7f71bbf70640 1 -- 172.21.15.79:0/2243081649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b4150320 msgr2=0x7f71b414d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.424+0000 7f71bbf70640 1 --2- 172.21.15.79:0/2243081649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b4150320 0x7f71b414d080 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f71a4011700 tx=0x7f71a4011bc0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.424+0000 7f71ba50d640 1 -- 172.21.15.79:0/2243081649 reap_dead start 2024-04-25T02:18:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.424+0000 7f71bbf70640 1 -- 172.21.15.79:0/2243081649 shutdown_connections 2024-04-25T02:18:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.424+0000 7f71bbf70640 1 -- 172.21.15.79:0/2243081649 >> 172.21.15.79:0/2243081649 conn(0x7f71b409d450 msgr2=0x7f71b40d0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.424+0000 7f71bbf70640 1 -- 172.21.15.79:0/2243081649 shutdown_connections 2024-04-25T02:18:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.424+0000 7f71bbf70640 1 -- 172.21.15.79:0/2243081649 wait complete. 2024-04-25T02:18:21.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T02:18:21.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.533+0000 7ffaad963640 1 Processor -- start 2024-04-25T02:18:21.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.533+0000 7ffaad963640 1 -- start start 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaad963640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ffaa815e4d0 0x7ffaa806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaad963640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffaa80b3570 0x7ffaa80d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaad963640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa80b3020 0x7ffaa80d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaad963640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa80d1660 con 0x7ffaa80b3570 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaad963640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa80d1380 con 0x7ffaa815e4d0 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaad963640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa80cede0 con 0x7ffaa80b3020 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaa67fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffaa80b3570 0x7ffaa80d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaa67fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffaa80b3570 0x7ffaa80d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39420/0 (socket says 172.21.15.79:39420) 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaa67fc640 1 -- 172.21.15.79:0/2125512348 learned_addr learned my addr 172.21.15.79:0/2125512348 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaa77fe640 1 --2- 172.21.15.79:0/2125512348 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa80b3020 0x7ffaa80d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaa6ffd640 1 --2- 172.21.15.79:0/2125512348 >> v2:172.21.15.189:3300/0 conn(0x7ffaa815e4d0 0x7ffaa806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaa67fc640 1 -- 172.21.15.79:0/2125512348 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa80b3020 msgr2=0x7ffaa80d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaa67fc640 1 --2- 172.21.15.79:0/2125512348 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa80b3020 0x7ffaa80d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaa67fc640 1 -- 172.21.15.79:0/2125512348 >> v2:172.21.15.189:3300/0 conn(0x7ffaa815e4d0 msgr2=0x7ffaa806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaa67fc640 1 --2- 172.21.15.79:0/2125512348 >> v2:172.21.15.189:3300/0 conn(0x7ffaa815e4d0 0x7ffaa806bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.534+0000 7ffaa67fc640 1 -- 172.21.15.79:0/2125512348 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa80cf0c0 con 0x7ffaa80b3570 2024-04-25T02:18:21.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.535+0000 7ffaa67fc640 1 --2- 172.21.15.79:0/2125512348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa80b3570 0x7ffaa80d2710 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009870 tx=0x7ffa9c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7961fd203adc91a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.535+0000 7ffaa5ffb640 1 -- 172.21.15.79:0/2125512348 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c037070 con 0x7ffaa80b3570 2024-04-25T02:18:21.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.535+0000 7ffaa5ffb640 1 -- 172.21.15.79:0/2125512348 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa9c032440 con 0x7ffaa80b3570 2024-04-25T02:18:21.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.535+0000 7ffaa5ffb640 1 -- 172.21.15.79:0/2125512348 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c032810 con 0x7ffaa80b3570 2024-04-25T02:18:21.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.536+0000 7ffaad963640 1 -- 172.21.15.79:0/2125512348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa80b3570 msgr2=0x7ffaa80d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.536+0000 7ffaad963640 1 --2- 172.21.15.79:0/2125512348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa80b3570 0x7ffaa80d2710 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009870 tx=0x7ffa9c02a210 comp rx=0 tx=0).stop 2024-04-25T02:18:21.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.536+0000 7ffaad963640 1 -- 172.21.15.79:0/2125512348 shutdown_connections 2024-04-25T02:18:21.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.536+0000 7ffaad963640 1 --2- 172.21.15.79:0/2125512348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa80b3570 0x7ffaa80d2710 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.536+0000 7ffaad963640 1 --2- 172.21.15.79:0/2125512348 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa80b3020 0x7ffaa80d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.536+0000 7ffaad963640 1 --2- 172.21.15.79:0/2125512348 >> v2:172.21.15.189:3300/0 conn(0x7ffaa815e4d0 0x7ffaa806bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.536+0000 7ffaad963640 1 -- 172.21.15.79:0/2125512348 >> 172.21.15.79:0/2125512348 conn(0x7ffaa809d460 msgr2=0x7ffaa80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:21.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.536+0000 7ffaad963640 1 -- 172.21.15.79:0/2125512348 shutdown_connections 2024-04-25T02:18:21.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.536+0000 7ffaad963640 1 -- 172.21.15.79:0/2125512348 wait complete. 2024-04-25T02:18:21.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.537+0000 7ffaad963640 1 Processor -- start 2024-04-25T02:18:21.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.537+0000 7ffaad963640 1 -- start start 2024-04-25T02:18:21.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaad963640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa80b3020 0x7ffaa80b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaad963640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa80b3570 0x7ffaa80b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaad963640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa815e4d0 0x7ffaa80b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaad963640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa80d2250 con 0x7ffaa815e4d0 2024-04-25T02:18:21.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaad963640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa80d20d0 con 0x7ffaa80b3020 2024-04-25T02:18:21.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaad963640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa806c1b0 con 0x7ffaa80b3570 2024-04-25T02:18:21.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaa77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa815e4d0 0x7ffaa80b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaa77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa815e4d0 0x7ffaa80b6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39436/0 (socket says 172.21.15.79:39436) 2024-04-25T02:18:21.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaa77fe640 1 -- 172.21.15.79:0/442342458 learned_addr learned my addr 172.21.15.79:0/442342458 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:21.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaa6ffd640 1 --2- 172.21.15.79:0/442342458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa80b3020 0x7ffaa80b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaa67fc640 1 --2- 172.21.15.79:0/442342458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa80b3570 0x7ffaa80b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaa77fe640 1 -- 172.21.15.79:0/442342458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa80b3570 msgr2=0x7ffaa80b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaa77fe640 1 --2- 172.21.15.79:0/442342458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa80b3570 0x7ffaa80b6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaa77fe640 1 -- 172.21.15.79:0/442342458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa80b3020 msgr2=0x7ffaa80b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaa77fe640 1 --2- 172.21.15.79:0/442342458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa80b3020 0x7ffaa80b50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaa77fe640 1 -- 172.21.15.79:0/442342458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa80b65c0 con 0x7ffaa815e4d0 2024-04-25T02:18:21.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaa77fe640 1 --2- 172.21.15.79:0/442342458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa815e4d0 0x7ffaa80b6080 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0007e90 tx=0x7ffaa000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffa8ffff640 1 -- 172.21.15.79:0/442342458 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0014420 con 0x7ffaa815e4d0 2024-04-25T02:18:21.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffa8ffff640 1 -- 172.21.15.79:0/442342458 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa0019070 con 0x7ffaa815e4d0 2024-04-25T02:18:21.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffa8ffff640 1 -- 172.21.15.79:0/442342458 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0014820 con 0x7ffaa815e4d0 2024-04-25T02:18:21.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.538+0000 7ffaad963640 1 -- 172.21.15.79:0/442342458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa80b6880 con 0x7ffaa815e4d0 2024-04-25T02:18:21.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.539+0000 7ffaad963640 1 -- 172.21.15.79:0/442342458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa80cb660 con 0x7ffaa815e4d0 2024-04-25T02:18:21.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.539+0000 7ffaad963640 1 -- 172.21.15.79:0/442342458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa80690a0 con 0x7ffaa815e4d0 2024-04-25T02:18:21.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.540+0000 7ffa8ffff640 1 -- 172.21.15.79:0/442342458 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffaa00149c0 con 0x7ffaa815e4d0 2024-04-25T02:18:21.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.540+0000 7ffa8ffff640 1 --2- 172.21.15.79:0/442342458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa9406be30 0x7ffa9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.540+0000 7ffa8ffff640 1 -- 172.21.15.79:0/442342458 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7ffaa008b310 con 0x7ffaa815e4d0 2024-04-25T02:18:21.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.540+0000 7ffaa6ffd640 1 --2- 172.21.15.79:0/442342458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa9406be30 0x7ffa9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.541+0000 7ffaa6ffd640 1 --2- 172.21.15.79:0/442342458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa9406be30 0x7ffa9406e2f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ffa980079a0 tx=0x7ffa98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.548+0000 7ffa8ffff640 1 -- 172.21.15.79:0/442342458 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffaa00598c0 con 0x7ffaa815e4d0 2024-04-25T02:18:21.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.728+0000 7ffaad963640 1 -- 172.21.15.79:0/442342458 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7ffaa80d1920 con 0x7ffa9406be30 2024-04-25T02:18:21.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.728+0000 7ffa8ffff640 1 -- 172.21.15.79:0/442342458 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ffaa80d1920 con 0x7ffa9406be30 2024-04-25T02:18:21.732 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T02:18:21.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.730+0000 7ffaad963640 1 -- 172.21.15.79:0/442342458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa9406be30 msgr2=0x7ffa9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.730+0000 7ffaad963640 1 --2- 172.21.15.79:0/442342458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa9406be30 0x7ffa9406e2f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ffa980079a0 tx=0x7ffa98008040 comp rx=0 tx=0).stop 2024-04-25T02:18:21.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.730+0000 7ffaad963640 1 -- 172.21.15.79:0/442342458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa815e4d0 msgr2=0x7ffaa80b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.730+0000 7ffaad963640 1 --2- 172.21.15.79:0/442342458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa815e4d0 0x7ffaa80b6080 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0007e90 tx=0x7ffaa000e4b0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.730+0000 7ffaad963640 1 -- 172.21.15.79:0/442342458 shutdown_connections 2024-04-25T02:18:21.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.730+0000 7ffaad963640 1 --2- 172.21.15.79:0/442342458 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ffa9406be30 0x7ffa9406e2f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.730+0000 7ffaad963640 1 --2- 172.21.15.79:0/442342458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa815e4d0 0x7ffaa80b6080 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.730+0000 7ffaad963640 1 --2- 172.21.15.79:0/442342458 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa80b3570 0x7ffaa80b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.730+0000 7ffaad963640 1 --2- 172.21.15.79:0/442342458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa80b3020 0x7ffaa80b50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.730+0000 7ffaad963640 1 -- 172.21.15.79:0/442342458 >> 172.21.15.79:0/442342458 conn(0x7ffaa809d460 msgr2=0x7ffaa80d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:21.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.730+0000 7ffaad963640 1 -- 172.21.15.79:0/442342458 shutdown_connections 2024-04-25T02:18:21.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.730+0000 7ffaad963640 1 -- 172.21.15.79:0/442342458 wait complete. 2024-04-25T02:18:21.745 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T02:18:21.746 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:18:21.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.842+0000 7fb0ad57e640 1 Processor -- start 2024-04-25T02:18:21.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.842+0000 7fb0ad57e640 1 -- start start 2024-04-25T02:18:21.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.843+0000 7fb0ad57e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb0a815f0e0 0x7fb0a80ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.843+0000 7fb0ad57e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a80cea10 0x7fb0a80b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.843+0000 7fb0ad57e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a80cf2e0 con 0x7fb0a813de20 2024-04-25T02:18:21.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.843+0000 7fb0ad57e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb0a80cf5c0 con 0x7fb0a815f0e0 2024-04-25T02:18:21.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.843+0000 7fb0ad57e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a80cf8a0 con 0x7fb0a80cea10 2024-04-25T02:18:21.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.843+0000 7fb0a67fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb0a815f0e0 0x7fb0a80ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.843+0000 7fb0a6ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb0a813de20 0x7fb0a815e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58080/0 (socket says 172.21.15.79:58080) 2024-04-25T02:18:21.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.843+0000 7fb0a6ffd640 1 -- 172.21.15.79:0/1853652763 learned_addr learned my addr 172.21.15.79:0/1853652763 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:21.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.843+0000 7fb0a77fe640 1 --2- 172.21.15.79:0/1853652763 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a80cea10 0x7fb0a80b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.843+0000 7fb0a67fc640 1 -- 172.21.15.79:0/1853652763 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a80cea10 msgr2=0x7fb0a80b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:21.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.843+0000 7fb0a67fc640 1 --2- 172.21.15.79:0/1853652763 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a80cea10 0x7fb0a80b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.843+0000 7fb0a67fc640 1 -- 172.21.15.79:0/1853652763 >> v1:172.21.15.79:6789/0 conn(0x7fb0a813de20 legacy=0x7fb0a815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.843+0000 7fb0a67fc640 1 -- 172.21.15.79:0/1853652763 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a80b2f40 con 0x7fb0a815f0e0 2024-04-25T02:18:21.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.843+0000 7fb0a5ffb640 1 -- 172.21.15.79:0/1853652763 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064627660 0 0) 0x7fb0a80cf2e0 con 0x7fb0a813de20 2024-04-25T02:18:21.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.843+0000 7fb0a77fe640 1 --2- 172.21.15.79:0/1853652763 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a80cea10 0x7fb0a80b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:21.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.844+0000 7fb0a67fc640 1 --2- 172.21.15.79:0/1853652763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a815f0e0 0x7fb0a80ce4d0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00ba40 tx=0x7fb09c02c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30a8a6925e388c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.844+0000 7fb0a5ffb640 1 -- 172.21.15.79:0/1853652763 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c031710 con 0x7fb0a815f0e0 2024-04-25T02:18:21.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.844+0000 7fb0a5ffb640 1 -- 172.21.15.79:0/1853652763 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09c0318b0 con 0x7fb0a815f0e0 2024-04-25T02:18:21.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.844+0000 7fb0a5ffb640 1 -- 172.21.15.79:0/1853652763 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c031c80 con 0x7fb0a815f0e0 2024-04-25T02:18:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.845+0000 7fb0ad57e640 1 -- 172.21.15.79:0/1853652763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a815f0e0 msgr2=0x7fb0a80ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.845+0000 7fb0ad57e640 1 --2- 172.21.15.79:0/1853652763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a815f0e0 0x7fb0a80ce4d0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00ba40 tx=0x7fb09c02c7b0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.845+0000 7fb0ad57e640 1 -- 172.21.15.79:0/1853652763 shutdown_connections 2024-04-25T02:18:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.845+0000 7fb0ad57e640 1 --2- 172.21.15.79:0/1853652763 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a80cea10 0x7fb0a80b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.845+0000 7fb0ad57e640 1 --2- 172.21.15.79:0/1853652763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a815f0e0 0x7fb0a80ce4d0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.845+0000 7fb0ad57e640 1 -- 172.21.15.79:0/1853652763 >> 172.21.15.79:0/1853652763 conn(0x7fb0a806b4a0 msgr2=0x7fb0a806b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.845+0000 7fb0ad57e640 1 -- 172.21.15.79:0/1853652763 shutdown_connections 2024-04-25T02:18:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.845+0000 7fb0ad57e640 1 -- 172.21.15.79:0/1853652763 wait complete. 2024-04-25T02:18:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.846+0000 7fb0ad57e640 1 Processor -- start 2024-04-25T02:18:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.846+0000 7fb0ad57e640 1 -- start start 2024-04-25T02:18:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0ad57e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0a80cea10 0x7fb0a80b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0ad57e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a813de20 0x7fb0a8137da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0ad57e640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a815f0e0 0x7fb0a8070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0ad57e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a80cf000 con 0x7fb0a813de20 2024-04-25T02:18:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0ad57e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a80cee80 con 0x7fb0a80cea10 2024-04-25T02:18:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0ad57e640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a80b39a0 con 0x7fb0a815f0e0 2024-04-25T02:18:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0a67fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a813de20 0x7fb0a8137da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0a67fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a813de20 0x7fb0a8137da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39456/0 (socket says 172.21.15.79:39456) 2024-04-25T02:18:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0a67fc640 1 -- 172.21.15.79:0/4059278258 learned_addr learned my addr 172.21.15.79:0/4059278258 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0a6ffd640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0a80cea10 0x7fb0a80b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0a77fe640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a815f0e0 0x7fb0a8070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0a67fc640 1 -- 172.21.15.79:0/4059278258 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a815f0e0 msgr2=0x7fb0a8070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0a67fc640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a815f0e0 0x7fb0a8070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0a67fc640 1 -- 172.21.15.79:0/4059278258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0a80cea10 msgr2=0x7fb0a80b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0a67fc640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0a80cea10 0x7fb0a80b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0a67fc640 1 -- 172.21.15.79:0/4059278258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a80b1050 con 0x7fb0a813de20 2024-04-25T02:18:21.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0a6ffd640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0a80cea10 0x7fb0a80b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:21.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0a77fe640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a815f0e0 0x7fb0a8070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:21.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0a67fc640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a813de20 0x7fb0a8137da0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00bb30 tx=0x7fb09c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb08f7fe640 1 -- 172.21.15.79:0/4059278258 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c033d80 con 0x7fb0a813de20 2024-04-25T02:18:21.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb08f7fe640 1 -- 172.21.15.79:0/4059278258 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09c03d410 con 0x7fb0a813de20 2024-04-25T02:18:21.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0ad57e640 1 -- 172.21.15.79:0/4059278258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a81387f0 con 0x7fb0a813de20 2024-04-25T02:18:21.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb08f7fe640 1 -- 172.21.15.79:0/4059278258 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c03d800 con 0x7fb0a813de20 2024-04-25T02:18:21.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.847+0000 7fb0ad57e640 1 -- 172.21.15.79:0/4059278258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a8138db0 con 0x7fb0a813de20 2024-04-25T02:18:21.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.848+0000 7fb0ad57e640 1 -- 172.21.15.79:0/4059278258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb0a80690a0 con 0x7fb0a813de20 2024-04-25T02:18:21.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.849+0000 7fb08f7fe640 1 -- 172.21.15.79:0/4059278258 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb09c03d9a0 con 0x7fb0a813de20 2024-04-25T02:18:21.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.849+0000 7fb08f7fe640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb09406be30 0x7fb09406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.849+0000 7fb08f7fe640 1 -- 172.21.15.79:0/4059278258 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7fb09c0ae360 con 0x7fb0a813de20 2024-04-25T02:18:21.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.849+0000 7fb0a6ffd640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb09406be30 0x7fb09406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.849+0000 7fb08f7fe640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x7fb094071e30 0x7fb094074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.849+0000 7fb08f7fe640 1 -- 172.21.15.79:0/4059278258 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb09c04cec0 con 0x7fb094071e30 2024-04-25T02:18:21.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.849+0000 7fb08f7fe640 1 -- 172.21.15.79:0/4059278258 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7fb09c0b5050 con 0x7fb0a813de20 2024-04-25T02:18:21.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.850+0000 7fb0a6ffd640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb09406be30 0x7fb09406e2f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb0980012e0 tx=0x7fb098009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.850+0000 7fb0a77fe640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x7fb094071e30 0x7fb094074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.850+0000 7fb0a77fe640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x7fb094071e30 0x7fb094074250 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.851+0000 7fb08f7fe640 1 -- 172.21.15.79:0/4059278258 <== osd.7 v2:172.21.15.189:6824/3421948491 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb09c04cec0 con 0x7fb094071e30 2024-04-25T02:18:21.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.864+0000 7fb0ad57e640 1 -- 172.21.15.79:0/4059278258 --> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb0a806db50 con 0x7fb094071e30 2024-04-25T02:18:21.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.864+0000 7fb08f7fe640 1 -- 172.21.15.79:0/4059278258 <== osd.7 v2:172.21.15.189:6824/3421948491 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb0a806db50 con 0x7fb094071e30 2024-04-25T02:18:21.868 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T02:18:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:18:21.869 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T02:18:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.865+0000 7fb0ad57e640 1 -- 172.21.15.79:0/4059278258 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x7fb094071e30 msgr2=0x7fb094074250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.865+0000 7fb0ad57e640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.189:6824/3421948491,v1:172.21.15.189:6825/3421948491] conn(0x7fb094071e30 0x7fb094074250 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.865+0000 7fb0ad57e640 1 -- 172.21.15.79:0/4059278258 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb09406be30 msgr2=0x7fb09406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.865+0000 7fb0ad57e640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fb09406be30 0x7fb09406e2f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb0980012e0 tx=0x7fb098009040 comp rx=0 tx=0).stop 2024-04-25T02:18:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.865+0000 7fb0ad57e640 1 -- 172.21.15.79:0/4059278258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a813de20 msgr2=0x7fb0a8137da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.865+0000 7fb0ad57e640 1 --2- 172.21.15.79:0/4059278258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a813de20 0x7fb0a8137da0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00bb30 tx=0x7fb09c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.865+0000 7fb0a77fe640 1 -- 172.21.15.79:0/4059278258 reap_dead start 2024-04-25T02:18:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.865+0000 7fb0ad57e640 1 -- 172.21.15.79:0/4059278258 shutdown_connections 2024-04-25T02:18:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.865+0000 7fb0ad57e640 1 -- 172.21.15.79:0/4059278258 >> 172.21.15.79:0/4059278258 conn(0x7fb0a806b4a0 msgr2=0x7fb0a80b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.865+0000 7fb0ad57e640 1 -- 172.21.15.79:0/4059278258 shutdown_connections 2024-04-25T02:18:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.865+0000 7fb0ad57e640 1 -- 172.21.15.79:0/4059278258 wait complete. 2024-04-25T02:18:21.879 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T02:18:21.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.972+0000 7ff1e0de7640 1 Processor -- start 2024-04-25T02:18:21.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.972+0000 7ff1e0de7640 1 -- start start 2024-04-25T02:18:21.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.972+0000 7ff1e0de7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1dc143bc0 0x7ff1dc15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.972+0000 7ff1e0de7640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff1dc0b3d40 0x7ff1dc06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.972+0000 7ff1e0de7640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1dc15fa40 con 0x7ff1dc06df50 2024-04-25T02:18:21.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.972+0000 7ff1e0de7640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff1dc06e8f0 con 0x7ff1dc0b3d40 2024-04-25T02:18:21.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.972+0000 7ff1e0de7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff1dc072cb0 con 0x7ff1dc143bc0 2024-04-25T02:18:21.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.973+0000 7ff1da59c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1dc143bc0 0x7ff1dc15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.973+0000 7ff1dad9d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff1dc0b3d40 0x7ff1dc06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.973+0000 7ff1dad9d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff1dc0b3d40 0x7ff1dc06e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.79:51992/0 (socket says 172.21.15.79:51992) 2024-04-25T02:18:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.973+0000 7ff1dad9d640 1 -- 172.21.15.79:0/1382384622 learned_addr learned my addr 172.21.15.79:0/1382384622 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.973+0000 7ff1da59c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1dc143bc0 0x7ff1dc15f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:32822/0 (socket says 172.21.15.79:32822) 2024-04-25T02:18:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.973+0000 7ff1d3fff640 1 --1- 172.21.15.79:0/1382384622 >> v1:172.21.15.189:6789/0 conn(0x7ff1dc06df50 0x7ff1dc0b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.79:48274/0 (socket says 172.21.15.79:48274) 2024-04-25T02:18:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.973+0000 7ff1da59c640 1 -- 172.21.15.79:0/1382384622 >> v2:172.21.15.189:3300/0 conn(0x7ff1dc0b3d40 msgr2=0x7ff1dc06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.973+0000 7ff1da59c640 1 --2- 172.21.15.79:0/1382384622 >> v2:172.21.15.189:3300/0 conn(0x7ff1dc0b3d40 0x7ff1dc06e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.973+0000 7ff1da59c640 1 -- 172.21.15.79:0/1382384622 >> v1:172.21.15.189:6789/0 conn(0x7ff1dc06df50 legacy=0x7ff1dc0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.973+0000 7ff1d9d9b640 1 -- 172.21.15.79:0/1382384622 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958937958 0 0) 0x7ff1c4001110 con 0x7ff1dc06df50 2024-04-25T02:18:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.973+0000 7ff1da59c640 1 -- 172.21.15.79:0/1382384622 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1dc071e00 con 0x7ff1dc143bc0 2024-04-25T02:18:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.973+0000 7ff1dad9d640 1 --2- 172.21.15.79:0/1382384622 >> v2:172.21.15.189:3300/0 conn(0x7ff1dc0b3d40 0x7ff1dc06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.974+0000 7ff1da59c640 1 --2- 172.21.15.79:0/1382384622 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1dc143bc0 0x7ff1dc15f500 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0097a0 tx=0x7ff1cc02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87532d292e295f34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.974+0000 7ff1d9d9b640 1 -- 172.21.15.79:0/1382384622 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc037070 con 0x7ff1dc143bc0 2024-04-25T02:18:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.974+0000 7ff1d9d9b640 1 -- 172.21.15.79:0/1382384622 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1cc02ae50 con 0x7ff1dc143bc0 2024-04-25T02:18:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.974+0000 7ff1d9d9b640 1 -- 172.21.15.79:0/1382384622 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc032660 con 0x7ff1dc143bc0 2024-04-25T02:18:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.975+0000 7ff1e0de7640 1 -- 172.21.15.79:0/1382384622 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1dc143bc0 msgr2=0x7ff1dc15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.975+0000 7ff1e0de7640 1 --2- 172.21.15.79:0/1382384622 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1dc143bc0 0x7ff1dc15f500 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0097a0 tx=0x7ff1cc02a100 comp rx=0 tx=0).stop 2024-04-25T02:18:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.975+0000 7ff1e0de7640 1 -- 172.21.15.79:0/1382384622 shutdown_connections 2024-04-25T02:18:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.975+0000 7ff1e0de7640 1 --2- 172.21.15.79:0/1382384622 >> v2:172.21.15.189:3300/0 conn(0x7ff1dc0b3d40 0x7ff1dc06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.975+0000 7ff1e0de7640 1 --2- 172.21.15.79:0/1382384622 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1dc143bc0 0x7ff1dc15f500 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.975+0000 7ff1e0de7640 1 -- 172.21.15.79:0/1382384622 >> 172.21.15.79:0/1382384622 conn(0x7ff1dc0cfc80 msgr2=0x7ff1dc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.975+0000 7ff1e0de7640 1 -- 172.21.15.79:0/1382384622 shutdown_connections 2024-04-25T02:18:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.975+0000 7ff1e0de7640 1 -- 172.21.15.79:0/1382384622 wait complete. 2024-04-25T02:18:21.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.976+0000 7ff1e0de7640 1 Processor -- start 2024-04-25T02:18:21.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.976+0000 7ff1e0de7640 1 -- start start 2024-04-25T02:18:21.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1e0de7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1dc06df50 0x7ff1dc1f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1e0de7640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1dc0b3d40 0x7ff1dc142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1e0de7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1dc143bc0 0x7ff1dc141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1e0de7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc072660 con 0x7ff1dc06df50 2024-04-25T02:18:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1e0de7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc072380 con 0x7ff1dc143bc0 2024-04-25T02:18:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1e0de7640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff1dc072940 con 0x7ff1dc0b3d40 2024-04-25T02:18:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1da59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1dc06df50 0x7ff1dc1f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1da59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1dc06df50 0x7ff1dc1f1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39458/0 (socket says 172.21.15.79:39458) 2024-04-25T02:18:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1da59c640 1 -- 172.21.15.79:0/3085833621 learned_addr learned my addr 172.21.15.79:0/3085833621 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1d3fff640 1 --2- 172.21.15.79:0/3085833621 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1dc0b3d40 0x7ff1dc142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1dad9d640 1 --2- 172.21.15.79:0/3085833621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1dc143bc0 0x7ff1dc141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1da59c640 1 -- 172.21.15.79:0/3085833621 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1dc0b3d40 msgr2=0x7ff1dc142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1da59c640 1 --2- 172.21.15.79:0/3085833621 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1dc0b3d40 0x7ff1dc142cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1da59c640 1 -- 172.21.15.79:0/3085833621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1dc143bc0 msgr2=0x7ff1dc141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1da59c640 1 --2- 172.21.15.79:0/3085833621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1dc143bc0 0x7ff1dc141940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1da59c640 1 -- 172.21.15.79:0/3085833621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1dc1f5040 con 0x7ff1dc06df50 2024-04-25T02:18:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1dad9d640 1 --2- 172.21.15.79:0/3085833621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1dc143bc0 0x7ff1dc141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.977+0000 7ff1da59c640 1 --2- 172.21.15.79:0/3085833621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1dc06df50 0x7ff1dc1f1c20 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0097a0 tx=0x7ff1cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.978+0000 7ff1d2ffd640 1 -- 172.21.15.79:0/3085833621 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc037040 con 0x7ff1dc06df50 2024-04-25T02:18:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.978+0000 7ff1d2ffd640 1 -- 172.21.15.79:0/3085833621 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1cc004030 con 0x7ff1dc06df50 2024-04-25T02:18:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.978+0000 7ff1e0de7640 1 -- 172.21.15.79:0/3085833621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1dc1f2160 con 0x7ff1dc06df50 2024-04-25T02:18:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.978+0000 7ff1d2ffd640 1 -- 172.21.15.79:0/3085833621 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc004420 con 0x7ff1dc06df50 2024-04-25T02:18:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.978+0000 7ff1e0de7640 1 -- 172.21.15.79:0/3085833621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1dc140b80 con 0x7ff1dc06df50 2024-04-25T02:18:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.979+0000 7ff1e0de7640 1 -- 172.21.15.79:0/3085833621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1dc0690a0 con 0x7ff1dc06df50 2024-04-25T02:18:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.979+0000 7ff1d2ffd640 1 -- 172.21.15.79:0/3085833621 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1cc003610 con 0x7ff1dc06df50 2024-04-25T02:18:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.980+0000 7ff1d2ffd640 1 --2- 172.21.15.79:0/3085833621 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1bc06be60 0x7ff1bc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.980+0000 7ff1d2ffd640 1 -- 172.21.15.79:0/3085833621 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7ff1cc0ab7e0 con 0x7ff1dc06df50 2024-04-25T02:18:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.980+0000 7ff1d3fff640 1 --2- 172.21.15.79:0/3085833621 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1bc06be60 0x7ff1bc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.980+0000 7ff1d3fff640 1 --2- 172.21.15.79:0/3085833621 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1bc06be60 0x7ff1bc06e320 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0af200 tx=0x7ff1c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:21.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:21.984+0000 7ff1d2ffd640 1 -- 172.21.15.79:0/3085833621 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff1dc1f5040 con 0x7ff1dc06df50 2024-04-25T02:18:22.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.162+0000 7ff1e0de7640 1 -- 172.21.15.79:0/3085833621 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7ff1dc1441f0 con 0x7ff1bc06be60 2024-04-25T02:18:22.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.163+0000 7ff1d2ffd640 1 -- 172.21.15.79:0/3085833621 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff1dc1441f0 con 0x7ff1bc06be60 2024-04-25T02:18:22.167 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T02:18:22.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.165+0000 7ff1e0de7640 1 -- 172.21.15.79:0/3085833621 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1bc06be60 msgr2=0x7ff1bc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:22.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.165+0000 7ff1e0de7640 1 --2- 172.21.15.79:0/3085833621 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1bc06be60 0x7ff1bc06e320 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0af200 tx=0x7ff1c4009040 comp rx=0 tx=0).stop 2024-04-25T02:18:22.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.165+0000 7ff1e0de7640 1 -- 172.21.15.79:0/3085833621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1dc06df50 msgr2=0x7ff1dc1f1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:22.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.165+0000 7ff1e0de7640 1 --2- 172.21.15.79:0/3085833621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1dc06df50 0x7ff1dc1f1c20 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0097a0 tx=0x7ff1cc0046c0 comp rx=0 tx=0).stop 2024-04-25T02:18:22.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.165+0000 7ff1e0de7640 1 -- 172.21.15.79:0/3085833621 shutdown_connections 2024-04-25T02:18:22.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.165+0000 7ff1e0de7640 1 --2- 172.21.15.79:0/3085833621 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7ff1bc06be60 0x7ff1bc06e320 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:22.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.165+0000 7ff1e0de7640 1 --2- 172.21.15.79:0/3085833621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1dc143bc0 0x7ff1dc141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:22.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.165+0000 7ff1e0de7640 1 --2- 172.21.15.79:0/3085833621 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1dc0b3d40 0x7ff1dc142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:22.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.165+0000 7ff1e0de7640 1 --2- 172.21.15.79:0/3085833621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1dc06df50 0x7ff1dc1f1c20 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:22.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.165+0000 7ff1e0de7640 1 -- 172.21.15.79:0/3085833621 >> 172.21.15.79:0/3085833621 conn(0x7ff1dc0cfc80 msgr2=0x7ff1dc0ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:22.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.165+0000 7ff1e0de7640 1 -- 172.21.15.79:0/3085833621 shutdown_connections 2024-04-25T02:18:22.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.165+0000 7ff1e0de7640 1 -- 172.21.15.79:0/3085833621 wait complete. 2024-04-25T02:18:22.180 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:18:22.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.272+0000 7f17e906b640 1 Processor -- start 2024-04-25T02:18:22.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.272+0000 7f17e906b640 1 -- start start 2024-04-25T02:18:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.273+0000 7f17e906b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f17e40af750 0x7f17e415ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.273+0000 7f17e906b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17e40aeda0 con 0x7f17e40d0d50 2024-04-25T02:18:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.273+0000 7f17e906b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17e415f040 con 0x7f17e415bef0 2024-04-25T02:18:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.273+0000 7f17e906b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f17e415f320 con 0x7f17e40af750 2024-04-25T02:18:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.273+0000 7f17e2d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f17e40af750 0x7f17e415ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.273+0000 7f17e359e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f17e40d0d50 0x7f17e40b4e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58082/0 (socket says 172.21.15.79:58082) 2024-04-25T02:18:22.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.273+0000 7f17e359e640 1 -- 172.21.15.79:0/177558647 learned_addr learned my addr 172.21.15.79:0/177558647 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:22.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.273+0000 7f17e2d9d640 1 -- 172.21.15.79:0/177558647 >> v1:172.21.15.189:6789/0 conn(0x7f17e415bef0 legacy=0x7f17e40ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:22.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.273+0000 7f17e2d9d640 1 -- 172.21.15.79:0/177558647 >> v1:172.21.15.79:6789/0 conn(0x7f17e40d0d50 legacy=0x7f17e40b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:22.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.273+0000 7f17e259c640 1 -- 172.21.15.79:0/177558647 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703472058 0 0) 0x7f17e40aeda0 con 0x7f17e40d0d50 2024-04-25T02:18:22.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.273+0000 7f17e2d9d640 1 -- 172.21.15.79:0/177558647 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e415f600 con 0x7f17e40af750 2024-04-25T02:18:22.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.274+0000 7f17e2d9d640 1 --2- 172.21.15.79:0/177558647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e40af750 0x7f17e415ea60 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f17d40097a0 tx=0x7f17d402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdac94a443f646dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:22.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.274+0000 7f17e259c640 1 -- 172.21.15.79:0/177558647 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d4037070 con 0x7f17e40af750 2024-04-25T02:18:22.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.274+0000 7f17e259c640 1 -- 172.21.15.79:0/177558647 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d4032440 con 0x7f17e40af750 2024-04-25T02:18:22.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.274+0000 7f17e259c640 1 -- 172.21.15.79:0/177558647 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d4032810 con 0x7f17e40af750 2024-04-25T02:18:22.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.274+0000 7f17e906b640 1 -- 172.21.15.79:0/177558647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e40af750 msgr2=0x7f17e415ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.274+0000 7f17e906b640 1 --2- 172.21.15.79:0/177558647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e40af750 0x7f17e415ea60 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f17d40097a0 tx=0x7f17d402a230 comp rx=0 tx=0).stop 2024-04-25T02:18:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.274+0000 7f17e906b640 1 -- 172.21.15.79:0/177558647 shutdown_connections 2024-04-25T02:18:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.274+0000 7f17e906b640 1 --2- 172.21.15.79:0/177558647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e40af750 0x7f17e415ea60 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.274+0000 7f17e906b640 1 -- 172.21.15.79:0/177558647 >> 172.21.15.79:0/177558647 conn(0x7f17e406c3a0 msgr2=0x7f17e406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.274+0000 7f17e906b640 1 -- 172.21.15.79:0/177558647 shutdown_connections 2024-04-25T02:18:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.274+0000 7f17e906b640 1 -- 172.21.15.79:0/177558647 wait complete. 2024-04-25T02:18:22.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.276+0000 7f17e906b640 1 Processor -- start 2024-04-25T02:18:22.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.276+0000 7f17e906b640 1 -- start start 2024-04-25T02:18:22.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.276+0000 7f17e906b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e40af750 0x7f17e4150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:22.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.276+0000 7f17e906b640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f17e40d0d50 0x7f17e40caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:22.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.276+0000 7f17e906b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17e415bef0 0x7f17e40b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:22.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.276+0000 7f17e906b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f17e415c350 con 0x7f17e40af750 2024-04-25T02:18:22.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.276+0000 7f17e906b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f17e40b48e0 con 0x7f17e415bef0 2024-04-25T02:18:22.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.276+0000 7f17e906b640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f17e40b5510 con 0x7f17e40d0d50 2024-04-25T02:18:22.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.276+0000 7f17e2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e40af750 0x7f17e4150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:22.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.277+0000 7f17e2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e40af750 0x7f17e4150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39468/0 (socket says 172.21.15.79:39468) 2024-04-25T02:18:22.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.277+0000 7f17e2d9d640 1 -- 172.21.15.79:0/1829827832 learned_addr learned my addr 172.21.15.79:0/1829827832 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:22.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.277+0000 7f17e2d9d640 1 -- 172.21.15.79:0/1829827832 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f17e40d0d50 msgr2=0x7f17e40caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:22.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.277+0000 7f17e2d9d640 1 --2- 172.21.15.79:0/1829827832 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f17e40d0d50 0x7f17e40caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:22.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.277+0000 7f17e359e640 1 --2- 172.21.15.79:0/1829827832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17e415bef0 0x7f17e40b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:22.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.277+0000 7f17e2d9d640 1 -- 172.21.15.79:0/1829827832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17e415bef0 msgr2=0x7f17e40b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:22.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.277+0000 7f17e2d9d640 1 --2- 172.21.15.79:0/1829827832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17e415bef0 0x7f17e40b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:22.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.277+0000 7f17e2d9d640 1 -- 172.21.15.79:0/1829827832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e41f89c0 con 0x7f17e40af750 2024-04-25T02:18:22.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.277+0000 7f17e2d9d640 1 --2- 172.21.15.79:0/1829827832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e40af750 0x7f17e4150a70 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f17d40098c0 tx=0x7f17d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:22.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.277+0000 7f17db7fe640 1 -- 172.21.15.79:0/1829827832 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d4037040 con 0x7f17e40af750 2024-04-25T02:18:22.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.277+0000 7f17db7fe640 1 -- 172.21.15.79:0/1829827832 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d4042070 con 0x7f17e40af750 2024-04-25T02:18:22.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.277+0000 7f17db7fe640 1 -- 172.21.15.79:0/1829827832 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d4030a70 con 0x7f17e40af750 2024-04-25T02:18:22.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.277+0000 7f17e906b640 1 -- 172.21.15.79:0/1829827832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e41f7e40 con 0x7f17e40af750 2024-04-25T02:18:22.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.277+0000 7f17e906b640 1 -- 172.21.15.79:0/1829827832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e41f8400 con 0x7f17e40af750 2024-04-25T02:18:22.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.278+0000 7f17e906b640 1 -- 172.21.15.79:0/1829827832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17e406bc00 con 0x7f17e40af750 2024-04-25T02:18:22.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.279+0000 7f17db7fe640 1 -- 172.21.15.79:0/1829827832 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f17d4030c10 con 0x7f17e40af750 2024-04-25T02:18:22.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.279+0000 7f17db7fe640 1 --2- 172.21.15.79:0/1829827832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f17c406be30 0x7f17c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:22.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.279+0000 7f17db7fe640 1 -- 172.21.15.79:0/1829827832 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f17d40ab6c0 con 0x7f17e40af750 2024-04-25T02:18:22.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.279+0000 7f17dbfff640 1 --2- 172.21.15.79:0/1829827832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f17c406be30 0x7f17c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:22.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.279+0000 7f17dbfff640 1 --2- 172.21.15.79:0/1829827832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f17c406be30 0x7f17c406e2f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f17cc000f60 tx=0x7f17cc0079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:22.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.283+0000 7f17db7fe640 1 -- 172.21.15.79:0/1829827832 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f17e406bc00 con 0x7f17e40af750 2024-04-25T02:18:22.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.455+0000 7f17e906b640 1 -- 172.21.15.79:0/1829827832 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f17e40ce890 con 0x7f17c406be30 2024-04-25T02:18:22.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.455+0000 7f17db7fe640 1 -- 172.21.15.79:0/1829827832 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13397 (secure 0 0 0) 0x7f17cc005080 con 0x7f17c406be30 2024-04-25T02:18:22.460 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:22.460 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:18:22.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.457+0000 7f17e906b640 1 -- 172.21.15.79:0/1829827832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f17c406be30 msgr2=0x7f17c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:22.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.457+0000 7f17e906b640 1 --2- 172.21.15.79:0/1829827832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f17c406be30 0x7f17c406e2f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f17cc000f60 tx=0x7f17cc0079b0 comp rx=0 tx=0).stop 2024-04-25T02:18:22.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.457+0000 7f17e906b640 1 -- 172.21.15.79:0/1829827832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e40af750 msgr2=0x7f17e4150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:22.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.457+0000 7f17e906b640 1 --2- 172.21.15.79:0/1829827832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e40af750 0x7f17e4150a70 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f17d40098c0 tx=0x7f17d40046c0 comp rx=0 tx=0).stop 2024-04-25T02:18:22.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.457+0000 7f17e906b640 1 -- 172.21.15.79:0/1829827832 shutdown_connections 2024-04-25T02:18:22.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.457+0000 7f17e906b640 1 --2- 172.21.15.79:0/1829827832 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f17c406be30 0x7f17c406e2f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:22.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.457+0000 7f17e906b640 1 --2- 172.21.15.79:0/1829827832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17e415bef0 0x7f17e40b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:22.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.457+0000 7f17e906b640 1 --2- 172.21.15.79:0/1829827832 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f17e40d0d50 0x7f17e40caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:22.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.457+0000 7f17e906b640 1 --2- 172.21.15.79:0/1829827832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e40af750 0x7f17e4150a70 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:22.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.457+0000 7f17e906b640 1 -- 172.21.15.79:0/1829827832 >> 172.21.15.79:0/1829827832 conn(0x7f17e406c3a0 msgr2=0x7f17e406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:22.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.457+0000 7f17e906b640 1 -- 172.21.15.79:0/1829827832 shutdown_connections 2024-04-25T02:18:22.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:22.457+0000 7f17e906b640 1 -- 172.21.15.79:0/1829827832 wait complete. 2024-04-25T02:18:22.472 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":433,"stamp":"2024-04-25T02:18:21.312369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262512,"kb_used_data":13064,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712208,"statfs":{"total":773094113280,"available":772825300992,"internally_reserved":0,"allocated":13377536,"data_stored":6476448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8392252,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-176,"num_write_kb":-8305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001195"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":357,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T02:18:14.949331+0000","last_change":"2024-04-25T02:07:49.140439+0000","last_active":"2024-04-25T02:18:14.949331+0000","last_peered":"2024-04-25T02:18:14.949331+0000","last_clean":"2024-04-25T02:18:14.949331+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:18:14.949331+0000","last_undegraded":"2024-04-25T02:18:14.949331+0000","last_fullsized":"2024-04-25T02:18:14.949331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:48.045212+0000","last_clean_scrub_stamp":"2024-04-25T02:07:48.045212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:18.433858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33248,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2117632,"data_stored":1252332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33248,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2117632,"data_stored":1252332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:18:22.475 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T02:07:48.045212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=7, tm_sec=48, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:18:22.475 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T02:18:32.123 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:18:32.126 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:18:42.476 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:18:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.580+0000 7f121d9a9640 1 Processor -- start 2024-04-25T02:18:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.580+0000 7f121d9a9640 1 -- start start 2024-04-25T02:18:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.581+0000 7f121d9a9640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f121815e440 0x7f12180d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.581+0000 7f121d9a9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f12180d4570 0x7f12180cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.581+0000 7f121d9a9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12180cfdc0 con 0x7f12180cf5d0 2024-04-25T02:18:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.581+0000 7f121d9a9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f12180d49e0 con 0x7f12180d4570 2024-04-25T02:18:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.581+0000 7f121d9a9640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f12180d00a0 con 0x7f121815e440 2024-04-25T02:18:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.581+0000 7f120ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f12180d4570 0x7f12180cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.581+0000 7f12177fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f12180cf5d0 0x7f12180d0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:37010/0 (socket says 172.21.15.79:37010) 2024-04-25T02:18:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.581+0000 7f12177fe640 1 -- 172.21.15.79:0/841947628 learned_addr learned my addr 172.21.15.79:0/841947628 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-04-25T02:18:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.581+0000 7f1216ffd640 1 --2- 172.21.15.79:0/841947628 >> v2:172.21.15.189:3300/0 conn(0x7f121815e440 0x7f12180d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.581+0000 7f120ffff640 1 -- 172.21.15.79:0/841947628 >> v2:172.21.15.189:3300/0 conn(0x7f121815e440 msgr2=0x7f12180d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.581+0000 7f120ffff640 1 --2- 172.21.15.79:0/841947628 >> v2:172.21.15.189:3300/0 conn(0x7f121815e440 0x7f12180d4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.581+0000 7f120ffff640 1 -- 172.21.15.79:0/841947628 >> v1:172.21.15.79:6789/0 conn(0x7f12180cf5d0 legacy=0x7f12180d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.581+0000 7f12167fc640 1 -- 172.21.15.79:0/841947628 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1854735478 0 0) 0x7f12180cfdc0 con 0x7f12180cf5d0 2024-04-25T02:18:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.581+0000 7f120ffff640 1 -- 172.21.15.79:0/841947628 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12180d0380 con 0x7f12180d4570 2024-04-25T02:18:42.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.582+0000 7f120ffff640 1 --2- 172.21.15.79:0/841947628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12180d4570 0x7f12180cf090 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f121808da40 tx=0x7f120002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a18e9a62b0153a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:42.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.582+0000 7f12167fc640 1 -- 172.21.15.79:0/841947628 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1200037070 con 0x7f12180d4570 2024-04-25T02:18:42.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.582+0000 7f12167fc640 1 -- 172.21.15.79:0/841947628 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1200032440 con 0x7f12180d4570 2024-04-25T02:18:42.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.582+0000 7f12167fc640 1 -- 172.21.15.79:0/841947628 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1200032810 con 0x7f12180d4570 2024-04-25T02:18:42.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.583+0000 7f121d9a9640 1 -- 172.21.15.79:0/841947628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12180d4570 msgr2=0x7f12180cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:42.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.583+0000 7f121d9a9640 1 --2- 172.21.15.79:0/841947628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12180d4570 0x7f12180cf090 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f121808da40 tx=0x7f120002a1a0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.583+0000 7f121d9a9640 1 -- 172.21.15.79:0/841947628 shutdown_connections 2024-04-25T02:18:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.583+0000 7f121d9a9640 1 --2- 172.21.15.79:0/841947628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12180d4570 0x7f12180cf090 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.583+0000 7f121d9a9640 1 --2- 172.21.15.79:0/841947628 >> v2:172.21.15.189:3300/0 conn(0x7f121815e440 0x7f12180d4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.583+0000 7f121d9a9640 1 -- 172.21.15.79:0/841947628 >> 172.21.15.79:0/841947628 conn(0x7f121808db50 msgr2=0x7f121809d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.583+0000 7f121d9a9640 1 -- 172.21.15.79:0/841947628 shutdown_connections 2024-04-25T02:18:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.583+0000 7f121d9a9640 1 -- 172.21.15.79:0/841947628 wait complete. 2024-04-25T02:18:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.584+0000 7f121d9a9640 1 Processor -- start 2024-04-25T02:18:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.584+0000 7f121d9a9640 1 -- start start 2024-04-25T02:18:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f121d9a9640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12180cf5d0 0x7f12180cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f121d9a9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12180d4570 0x7f12180b8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f121d9a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815e440 0x7f12180b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f121d9a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f12180cfa00 con 0x7f121815e440 2024-04-25T02:18:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f121d9a9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f121815e820 con 0x7f12180d4570 2024-04-25T02:18:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f121d9a9640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f12180cfb80 con 0x7f12180cf5d0 2024-04-25T02:18:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f12177fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815e440 0x7f12180b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f12177fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815e440 0x7f12180b6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57386/0 (socket says 172.21.15.79:57386) 2024-04-25T02:18:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f12177fe640 1 -- 172.21.15.79:0/2513051424 learned_addr learned my addr 172.21.15.79:0/2513051424 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f120ffff640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12180d4570 0x7f12180b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f1216ffd640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12180cf5d0 0x7f12180cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f12177fe640 1 -- 172.21.15.79:0/2513051424 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12180cf5d0 msgr2=0x7f12180cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f12177fe640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12180cf5d0 0x7f12180cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f12177fe640 1 -- 172.21.15.79:0/2513051424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12180d4570 msgr2=0x7f12180b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f12177fe640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12180d4570 0x7f12180b8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f12177fe640 1 -- 172.21.15.79:0/2513051424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12180b7670 con 0x7f121815e440 2024-04-25T02:18:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f120ffff640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12180d4570 0x7f12180b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f1216ffd640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12180cf5d0 0x7f12180cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f12177fe640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815e440 0x7f12180b6c90 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f121000c7a0 tx=0x7f121000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f1214ff9640 1 -- 172.21.15.79:0/2513051424 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1210018070 con 0x7f121815e440 2024-04-25T02:18:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f1214ff9640 1 -- 172.21.15.79:0/2513051424 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f121000a640 con 0x7f121815e440 2024-04-25T02:18:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f121d9a9640 1 -- 172.21.15.79:0/2513051424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12180b7950 con 0x7f121815e440 2024-04-25T02:18:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f1214ff9640 1 -- 172.21.15.79:0/2513051424 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121000aab0 con 0x7f121815e440 2024-04-25T02:18:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.585+0000 7f121d9a9640 1 -- 172.21.15.79:0/2513051424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12180cbde0 con 0x7f121815e440 2024-04-25T02:18:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.586+0000 7f121d9a9640 1 -- 172.21.15.79:0/2513051424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12180b7b20 con 0x7f121815e440 2024-04-25T02:18:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.587+0000 7f1214ff9640 1 -- 172.21.15.79:0/2513051424 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f121001b070 con 0x7f121815e440 2024-04-25T02:18:42.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.587+0000 7f1214ff9640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11f806be30 0x7f11f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:42.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.587+0000 7f1214ff9640 1 -- 172.21.15.79:0/2513051424 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f121008a260 con 0x7f121815e440 2024-04-25T02:18:42.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.587+0000 7f1216ffd640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11f806be30 0x7f11f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:42.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.588+0000 7f1216ffd640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11f806be30 0x7f11f806e2f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1208006fd0 tx=0x7f1208008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:42.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.592+0000 7f1214ff9640 1 -- 172.21.15.79:0/2513051424 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1210058e60 con 0x7f121815e440 2024-04-25T02:18:42.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.764+0000 7f121d9a9640 1 -- 172.21.15.79:0/2513051424 --> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f12180690a0 con 0x7f11f806be30 2024-04-25T02:18:42.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.765+0000 7f1214ff9640 1 -- 172.21.15.79:0/2513051424 <== mgr.4104 v2:172.21.15.79:6832/73399441 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13379 (secure 0 0 0) 0x7f12180690a0 con 0x7f11f806be30 2024-04-25T02:18:42.771 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:42.771 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-04-25T02:18:42.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.767+0000 7f121d9a9640 1 -- 172.21.15.79:0/2513051424 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11f806be30 msgr2=0x7f11f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:42.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.767+0000 7f121d9a9640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11f806be30 0x7f11f806e2f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1208006fd0 tx=0x7f1208008040 comp rx=0 tx=0).stop 2024-04-25T02:18:42.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.767+0000 7f121d9a9640 1 -- 172.21.15.79:0/2513051424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815e440 msgr2=0x7f12180b6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:42.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.767+0000 7f121d9a9640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815e440 0x7f12180b6c90 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f121000c7a0 tx=0x7f121000cc60 comp rx=0 tx=0).stop 2024-04-25T02:18:42.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.767+0000 7f121d9a9640 1 -- 172.21.15.79:0/2513051424 shutdown_connections 2024-04-25T02:18:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.767+0000 7f121d9a9640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f11f806be30 0x7f11f806e2f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.767+0000 7f121d9a9640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815e440 0x7f12180b6c90 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.767+0000 7f121d9a9640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12180d4570 0x7f12180b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.767+0000 7f121d9a9640 1 --2- 172.21.15.79:0/2513051424 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f12180cf5d0 0x7f12180cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.767+0000 7f121d9a9640 1 -- 172.21.15.79:0/2513051424 >> 172.21.15.79:0/2513051424 conn(0x7f121808db50 msgr2=0x7f121809d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.767+0000 7f121d9a9640 1 -- 172.21.15.79:0/2513051424 shutdown_connections 2024-04-25T02:18:42.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.767+0000 7f121d9a9640 1 -- 172.21.15.79:0/2513051424 wait complete. 2024-04-25T02:18:42.783 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2024-04-25T02:18:41.316604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262504,"kb_used_data":13064,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712216,"statfs":{"total":773094113280,"available":772825309184,"internally_reserved":0,"allocated":13377536,"data_stored":6476448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002590"},"pg_stats":[{"pgid":"1.0","version":"122'119","reported_seq":368,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T02:18:22.862479+0000","last_change":"2024-04-25T02:18:22.862513+0000","last_active":"2024-04-25T02:18:22.862479+0000","last_peered":"2024-04-25T02:18:22.862479+0000","last_clean":"2024-04-25T02:18:22.862479+0000","last_became_active":"2024-04-25T02:07:49.137839+0000","last_became_peered":"2024-04-25T02:07:49.137839+0000","last_unstale":"2024-04-25T02:18:22.862479+0000","last_undegraded":"2024-04-25T02:18:22.862479+0000","last_fullsized":"2024-04-25T02:18:22.862479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"122'119","last_scrub_stamp":"2024-04-25T02:18:22.862395+0000","last_deep_scrub":"122'119","last_deep_scrub_stamp":"2024-04-25T02:18:22.862395+0000","last_clean_scrub_stamp":"2024-04-25T02:18:22.862395+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:10.293009+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2117632,"data_stored":1252332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1523712,"data_stored":661964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574982,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2117632,"data_stored":1252332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:18:42.784 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T02:18:42.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.874+0000 7fa4f7709640 1 Processor -- start 2024-04-25T02:18:42.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.874+0000 7fa4f7709640 1 -- start start 2024-04-25T02:18:42.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.875+0000 7fa4f7709640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa4f006b2f0 0x7fa4f00b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:42.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.875+0000 7fa4f7709640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4f00cf7a0 0x7fa4f006b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:42.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.875+0000 7fa4f7709640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4f006e6b0 0x7fa4f00cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.875+0000 7fa4f7709640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f015f830 con 0x7fa4f00cf7a0 2024-04-25T02:18:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.875+0000 7fa4f7709640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f006bc10 con 0x7fa4f006b2f0 2024-04-25T02:18:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.875+0000 7fa4f7709640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f015ec20 con 0x7fa4f006e6b0 2024-04-25T02:18:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.875+0000 7fa4f4ca4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4f00cf7a0 0x7fa4f006b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.875+0000 7fa4f4ca4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4f00cf7a0 0x7fa4f006b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57394/0 (socket says 172.21.15.79:57394) 2024-04-25T02:18:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.875+0000 7fa4f4ca4640 1 -- 172.21.15.79:0/1209343497 learned_addr learned my addr 172.21.15.79:0/1209343497 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.875+0000 7fa4f5ca6640 1 --2- 172.21.15.79:0/1209343497 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4f006e6b0 0x7fa4f00cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.875+0000 7fa4f54a5640 1 --2- 172.21.15.79:0/1209343497 >> v2:172.21.15.189:3300/0 conn(0x7fa4f006b2f0 0x7fa4f00b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.876+0000 7fa4f4ca4640 1 -- 172.21.15.79:0/1209343497 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4f006e6b0 msgr2=0x7fa4f00cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.876+0000 7fa4f4ca4640 1 --2- 172.21.15.79:0/1209343497 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4f006e6b0 0x7fa4f00cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.876+0000 7fa4f4ca4640 1 -- 172.21.15.79:0/1209343497 >> v2:172.21.15.189:3300/0 conn(0x7fa4f006b2f0 msgr2=0x7fa4f00b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.876+0000 7fa4f4ca4640 1 --2- 172.21.15.79:0/1209343497 >> v2:172.21.15.189:3300/0 conn(0x7fa4f006b2f0 0x7fa4f00b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.876+0000 7fa4f4ca4640 1 -- 172.21.15.79:0/1209343497 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f015ef00 con 0x7fa4f00cf7a0 2024-04-25T02:18:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.876+0000 7fa4f4ca4640 1 --2- 172.21.15.79:0/1209343497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f00cf7a0 0x7fa4f006b6d0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7fa4f006efd0 tx=0x7fa4e002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb57bcb1ed00103 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.876+0000 7fa4e7fff640 1 -- 172.21.15.79:0/1209343497 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0037070 con 0x7fa4f00cf7a0 2024-04-25T02:18:42.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.876+0000 7fa4e7fff640 1 -- 172.21.15.79:0/1209343497 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e0032440 con 0x7fa4f00cf7a0 2024-04-25T02:18:42.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.876+0000 7fa4e7fff640 1 -- 172.21.15.79:0/1209343497 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0032810 con 0x7fa4f00cf7a0 2024-04-25T02:18:42.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.877+0000 7fa4f7709640 1 -- 172.21.15.79:0/1209343497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f00cf7a0 msgr2=0x7fa4f006b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:42.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.877+0000 7fa4f7709640 1 --2- 172.21.15.79:0/1209343497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f00cf7a0 0x7fa4f006b6d0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7fa4f006efd0 tx=0x7fa4e002a140 comp rx=0 tx=0).stop 2024-04-25T02:18:42.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.877+0000 7fa4f7709640 1 -- 172.21.15.79:0/1209343497 shutdown_connections 2024-04-25T02:18:42.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.877+0000 7fa4f7709640 1 --2- 172.21.15.79:0/1209343497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f00cf7a0 0x7fa4f006b6d0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.877+0000 7fa4f7709640 1 --2- 172.21.15.79:0/1209343497 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4f006e6b0 0x7fa4f00cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.877+0000 7fa4f7709640 1 --2- 172.21.15.79:0/1209343497 >> v2:172.21.15.189:3300/0 conn(0x7fa4f006b2f0 0x7fa4f00b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.877+0000 7fa4f7709640 1 -- 172.21.15.79:0/1209343497 >> 172.21.15.79:0/1209343497 conn(0x7fa4f00b1cd0 msgr2=0x7fa4f00b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.877+0000 7fa4f7709640 1 -- 172.21.15.79:0/1209343497 shutdown_connections 2024-04-25T02:18:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.877+0000 7fa4f7709640 1 -- 172.21.15.79:0/1209343497 wait complete. 2024-04-25T02:18:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.878+0000 7fa4f7709640 1 Processor -- start 2024-04-25T02:18:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.878+0000 7fa4f7709640 1 -- start start 2024-04-25T02:18:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f7709640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4f006b2f0 0x7fa4f0154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f7709640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f006e6b0 0x7fa4f0156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f7709640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4f00cf7a0 0x7fa4f009b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f7709640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f006cfe0 con 0x7fa4f006e6b0 2024-04-25T02:18:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f7709640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f015f4c0 con 0x7fa4f006b2f0 2024-04-25T02:18:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f7709640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f006d160 con 0x7fa4f00cf7a0 2024-04-25T02:18:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f4ca4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f006e6b0 0x7fa4f0156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f4ca4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f006e6b0 0x7fa4f0156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57406/0 (socket says 172.21.15.79:57406) 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f4ca4640 1 -- 172.21.15.79:0/4116998012 learned_addr learned my addr 172.21.15.79:0/4116998012 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f4ca4640 1 -- 172.21.15.79:0/4116998012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4f00cf7a0 msgr2=0x7fa4f009b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f54a5640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4f006b2f0 0x7fa4f0154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f5ca6640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4f00cf7a0 0x7fa4f009b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f4ca4640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4f00cf7a0 0x7fa4f009b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f4ca4640 1 -- 172.21.15.79:0/4116998012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4f006b2f0 msgr2=0x7fa4f0154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f4ca4640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4f006b2f0 0x7fa4f0154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f4ca4640 1 -- 172.21.15.79:0/4116998012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f0157ea0 con 0x7fa4f006e6b0 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f54a5640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4f006b2f0 0x7fa4f0154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.879+0000 7fa4f5ca6640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4f00cf7a0 0x7fa4f009b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.880+0000 7fa4f4ca4640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f006e6b0 0x7fa4f0156cd0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0000c00 tx=0x7fa4e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.880+0000 7fa4e5ffb640 1 -- 172.21.15.79:0/4116998012 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0041020 con 0x7fa4f006e6b0 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.880+0000 7fa4e5ffb640 1 -- 172.21.15.79:0/4116998012 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e00306c0 con 0x7fa4f006e6b0 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.880+0000 7fa4f7709640 1 -- 172.21.15.79:0/4116998012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f0154d60 con 0x7fa4f006e6b0 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.880+0000 7fa4e5ffb640 1 -- 172.21.15.79:0/4116998012 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0037040 con 0x7fa4f006e6b0 2024-04-25T02:18:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.880+0000 7fa4f7709640 1 -- 172.21.15.79:0/4116998012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f0157bc0 con 0x7fa4f006e6b0 2024-04-25T02:18:42.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.881+0000 7fa4f7709640 1 -- 172.21.15.79:0/4116998012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f00690a0 con 0x7fa4f006e6b0 2024-04-25T02:18:42.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.881+0000 7fa4e5ffb640 1 -- 172.21.15.79:0/4116998012 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4e0044020 con 0x7fa4f006e6b0 2024-04-25T02:18:42.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.882+0000 7fa4e5ffb640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa4d406be30 0x7fa4d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:42.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.882+0000 7fa4e5ffb640 1 -- 172.21.15.79:0/4116998012 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7fa4e00ab450 con 0x7fa4f006e6b0 2024-04-25T02:18:42.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.882+0000 7fa4f54a5640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa4d406be30 0x7fa4d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:42.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.882+0000 7fa4f54a5640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa4d406be30 0x7fa4d406e2f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec007330 tx=0x7fa4ec00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:42.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:42.886+0000 7fa4e5ffb640 1 -- 172.21.15.79:0/4116998012 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa4e004b030 con 0x7fa4f006e6b0 2024-04-25T02:18:43.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.059+0000 7fa4f7709640 1 -- 172.21.15.79:0/4116998012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa4f00cf4f0 con 0x7fa4f006e6b0 2024-04-25T02:18:43.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.064+0000 7fa4e5ffb640 1 -- 172.21.15.79:0/4116998012 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) ==== 123+0+0 (secure 0 0 0) 0x7fa4e007a050 con 0x7fa4f006e6b0 2024-04-25T02:18:43.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.066+0000 7fa4e5ffb640 1 -- 172.21.15.79:0/4116998012 <== mon.0 v2:172.21.15.79:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa4e0031e80 con 0x7fa4f006e6b0 2024-04-25T02:18:43.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.067+0000 7fa4f7709640 1 -- 172.21.15.79:0/4116998012 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa4d406be30 msgr2=0x7fa4d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:43.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.067+0000 7fa4f7709640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa4d406be30 0x7fa4d406e2f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec007330 tx=0x7fa4ec00b040 comp rx=0 tx=0).stop 2024-04-25T02:18:43.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.067+0000 7fa4f7709640 1 -- 172.21.15.79:0/4116998012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f006e6b0 msgr2=0x7fa4f0156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:43.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.067+0000 7fa4f7709640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f006e6b0 0x7fa4f0156cd0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0000c00 tx=0x7fa4e00046c0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.067+0000 7fa4f7709640 1 -- 172.21.15.79:0/4116998012 shutdown_connections 2024-04-25T02:18:43.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.067+0000 7fa4f7709640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7fa4d406be30 0x7fa4d406e2f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.067+0000 7fa4f7709640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4f00cf7a0 0x7fa4f009b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.067+0000 7fa4f7709640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4f006e6b0 0x7fa4f0156cd0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.067+0000 7fa4f7709640 1 --2- 172.21.15.79:0/4116998012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4f006b2f0 0x7fa4f0154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.067+0000 7fa4f7709640 1 -- 172.21.15.79:0/4116998012 >> 172.21.15.79:0/4116998012 conn(0x7fa4f00b1cd0 msgr2=0x7fa4f006d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:43.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.067+0000 7fa4f7709640 1 -- 172.21.15.79:0/4116998012 shutdown_connections 2024-04-25T02:18:43.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.067+0000 7fa4f7709640 1 -- 172.21.15.79:0/4116998012 wait complete. 2024-04-25T02:18:43.083 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:18:43.083 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:18:43.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.174+0000 7f5e2c9b0640 1 Processor -- start 2024-04-25T02:18:43.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.174+0000 7f5e2c9b0640 1 -- start start 2024-04-25T02:18:43.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.175+0000 7f5e2c9b0640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e28143bc0 0x7f5e2815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:43.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.175+0000 7f5e2c9b0640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5e280b3d40 0x7f5e2806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:43.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.175+0000 7f5e2c9b0640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e2815fa40 con 0x7f5e2806df50 2024-04-25T02:18:43.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.175+0000 7f5e2c9b0640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f5e2806e8f0 con 0x7f5e280b3d40 2024-04-25T02:18:43.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.175+0000 7f5e2c9b0640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5e28072cb0 con 0x7f5e28143bc0 2024-04-25T02:18:43.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.176+0000 7f5e2659c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e28143bc0 0x7f5e2815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:43.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.176+0000 7f5e26d9d640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5e280b3d40 0x7f5e2806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:43.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.176+0000 7f5e2659c640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e28143bc0 0x7f5e2815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.79:35814/0 (socket says 172.21.15.79:35814) 2024-04-25T02:18:43.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.176+0000 7f5e2659c640 1 -- 172.21.15.79:0/918460399 learned_addr learned my addr 172.21.15.79:0/918460399 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:43.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.176+0000 7f5e2659c640 1 -- 172.21.15.79:0/918460399 >> v2:172.21.15.189:3300/0 conn(0x7f5e280b3d40 msgr2=0x7f5e2806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:43.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.176+0000 7f5e2659c640 1 --2- 172.21.15.79:0/918460399 >> v2:172.21.15.189:3300/0 conn(0x7f5e280b3d40 0x7f5e2806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.176+0000 7f5e2659c640 1 -- 172.21.15.79:0/918460399 >> v1:172.21.15.189:6789/0 conn(0x7f5e2806df50 legacy=0x7f5e280b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:43.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.176+0000 7f5e2659c640 1 -- 172.21.15.79:0/918460399 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e28071e00 con 0x7f5e28143bc0 2024-04-25T02:18:43.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.176+0000 7f5e26d9d640 1 --2- 172.21.15.79:0/918460399 >> v2:172.21.15.189:3300/0 conn(0x7f5e280b3d40 0x7f5e2806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:43.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.177+0000 7f5e2659c640 1 --2- 172.21.15.79:0/918460399 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e28143bc0 0x7f5e2815f500 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009870 tx=0x7f5e2002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=516e3d10731e7265 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:43.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.177+0000 7f5e2559a640 1 -- 172.21.15.79:0/918460399 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20037070 con 0x7f5e28143bc0 2024-04-25T02:18:43.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.177+0000 7f5e2559a640 1 -- 172.21.15.79:0/918460399 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5e20032440 con 0x7f5e28143bc0 2024-04-25T02:18:43.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.177+0000 7f5e2559a640 1 -- 172.21.15.79:0/918460399 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20032830 con 0x7f5e28143bc0 2024-04-25T02:18:43.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.177+0000 7f5e2c9b0640 1 -- 172.21.15.79:0/918460399 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e28143bc0 msgr2=0x7f5e2815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:43.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.177+0000 7f5e2c9b0640 1 --2- 172.21.15.79:0/918460399 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e28143bc0 0x7f5e2815f500 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009870 tx=0x7f5e2002a1c0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.178+0000 7f5e2c9b0640 1 -- 172.21.15.79:0/918460399 shutdown_connections 2024-04-25T02:18:43.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.178+0000 7f5e2c9b0640 1 --2- 172.21.15.79:0/918460399 >> v2:172.21.15.189:3300/0 conn(0x7f5e280b3d40 0x7f5e2806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.178+0000 7f5e2c9b0640 1 --2- 172.21.15.79:0/918460399 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e28143bc0 0x7f5e2815f500 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.178+0000 7f5e2c9b0640 1 -- 172.21.15.79:0/918460399 >> 172.21.15.79:0/918460399 conn(0x7f5e280cfc80 msgr2=0x7f5e280d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:43.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.178+0000 7f5e2c9b0640 1 -- 172.21.15.79:0/918460399 shutdown_connections 2024-04-25T02:18:43.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.178+0000 7f5e2c9b0640 1 -- 172.21.15.79:0/918460399 wait complete. 2024-04-25T02:18:43.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.179+0000 7f5e2c9b0640 1 Processor -- start 2024-04-25T02:18:43.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.179+0000 7f5e2c9b0640 1 -- start start 2024-04-25T02:18:43.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e2c9b0640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e2806df50 0x7f5e2813f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:43.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e2c9b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e280b3d40 0x7f5e280a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:43.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e2c9b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e28143bc0 0x7f5e280acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:43.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e2c9b0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5e28072660 con 0x7f5e280b3d40 2024-04-25T02:18:43.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e2c9b0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5e28072380 con 0x7f5e28143bc0 2024-04-25T02:18:43.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e2c9b0640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5e28072940 con 0x7f5e2806df50 2024-04-25T02:18:43.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e25d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e280b3d40 0x7f5e280a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:43.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e25d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e280b3d40 0x7f5e280a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57422/0 (socket says 172.21.15.79:57422) 2024-04-25T02:18:43.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e25d9b640 1 -- 172.21.15.79:0/281963025 learned_addr learned my addr 172.21.15.79:0/281963025 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-04-25T02:18:43.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e2659c640 1 --2- 172.21.15.79:0/281963025 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e2806df50 0x7f5e2813f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:43.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e26d9d640 1 --2- 172.21.15.79:0/281963025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e28143bc0 0x7f5e280acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:43.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e25d9b640 1 -- 172.21.15.79:0/281963025 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e2806df50 msgr2=0x7f5e2813f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:43.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e25d9b640 1 --2- 172.21.15.79:0/281963025 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e2806df50 0x7f5e2813f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e25d9b640 1 -- 172.21.15.79:0/281963025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e28143bc0 msgr2=0x7f5e280acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:43.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e25d9b640 1 --2- 172.21.15.79:0/281963025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e28143bc0 0x7f5e280acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e25d9b640 1 -- 172.21.15.79:0/281963025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2813fb50 con 0x7f5e280b3d40 2024-04-25T02:18:43.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.180+0000 7f5e25d9b640 1 --2- 172.21.15.79:0/281963025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e280b3d40 0x7f5e280a9eb0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00c7c0 tx=0x7f5e1c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:43.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.181+0000 7f5e16ffd640 1 -- 172.21.15.79:0/281963025 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c016020 con 0x7f5e280b3d40 2024-04-25T02:18:43.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.181+0000 7f5e16ffd640 1 -- 172.21.15.79:0/281963025 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5e1c006d50 con 0x7f5e280b3d40 2024-04-25T02:18:43.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.181+0000 7f5e2c9b0640 1 -- 172.21.15.79:0/281963025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e280aa9a0 con 0x7f5e280b3d40 2024-04-25T02:18:43.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.181+0000 7f5e16ffd640 1 -- 172.21.15.79:0/281963025 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c003bd0 con 0x7f5e280b3d40 2024-04-25T02:18:43.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.181+0000 7f5e2c9b0640 1 -- 172.21.15.79:0/281963025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e280aaf60 con 0x7f5e280b3d40 2024-04-25T02:18:43.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.182+0000 7f5e2c9b0640 1 -- 172.21.15.79:0/281963025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e280690a0 con 0x7f5e280b3d40 2024-04-25T02:18:43.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.182+0000 7f5e16ffd640 1 -- 172.21.15.79:0/281963025 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e1c00a850 con 0x7f5e280b3d40 2024-04-25T02:18:43.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.182+0000 7f5e16ffd640 1 --2- 172.21.15.79:0/281963025 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e0806be60 0x7f5e0806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:43.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.182+0000 7f5e16ffd640 1 -- 172.21.15.79:0/281963025 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5115+0+0 (secure 0 0 0) 0x7f5e1c08a7b0 con 0x7f5e280b3d40 2024-04-25T02:18:43.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.182+0000 7f5e2659c640 1 --2- 172.21.15.79:0/281963025 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e0806be60 0x7f5e0806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:43.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.183+0000 7f5e2659c640 1 --2- 172.21.15.79:0/281963025 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e0806be60 0x7f5e0806e320 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5e20034000 tx=0x7f5e2002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:43.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.187+0000 7f5e16ffd640 1 -- 172.21.15.79:0/281963025 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5e1c020020 con 0x7f5e280b3d40 2024-04-25T02:18:43.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.396+0000 7f5e2c9b0640 1 -- 172.21.15.79:0/281963025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e2815b1a0 con 0x7f5e280b3d40 2024-04-25T02:18:43.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.397+0000 7f5e16ffd640 1 -- 172.21.15.79:0/281963025 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+3872 (secure 0 0 0) 0x7f5e2815fa40 con 0x7f5e280b3d40 2024-04-25T02:18:43.402 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T02:18:43.402 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":98,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/3866997901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3866997901},{"type":"v1","addr":"172.21.15.189:6834","nonce":3866997901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/167225705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":167225705},{"type":"v1","addr":"172.21.15.189:6835","nonce":167225705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8916,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3734112703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3734112703},{"type":"v1","addr":"172.21.15.79:6835","nonce":3734112703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":9591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/1936046659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1936046659},{"type":"v1","addr":"172.21.15.79:6837","nonce":1936046659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[]} 2024-04-25T02:18:43.402 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 98 2024-04-25T02:18:43.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.399+0000 7f5e2c9b0640 1 -- 172.21.15.79:0/281963025 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e0806be60 msgr2=0x7f5e0806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:43.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.399+0000 7f5e2c9b0640 1 --2- 172.21.15.79:0/281963025 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e0806be60 0x7f5e0806e320 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5e20034000 tx=0x7f5e2002e000 comp rx=0 tx=0).stop 2024-04-25T02:18:43.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.399+0000 7f5e2c9b0640 1 -- 172.21.15.79:0/281963025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e280b3d40 msgr2=0x7f5e280a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:43.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.399+0000 7f5e2c9b0640 1 --2- 172.21.15.79:0/281963025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e280b3d40 0x7f5e280a9eb0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00c7c0 tx=0x7f5e1c00cbc0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.399+0000 7f5e2c9b0640 1 -- 172.21.15.79:0/281963025 shutdown_connections 2024-04-25T02:18:43.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.399+0000 7f5e2c9b0640 1 --2- 172.21.15.79:0/281963025 >> [v2:172.21.15.79:6832/73399441,v1:172.21.15.79:6833/73399441] conn(0x7f5e0806be60 0x7f5e0806e320 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.399+0000 7f5e2c9b0640 1 --2- 172.21.15.79:0/281963025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e28143bc0 0x7f5e280acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.399+0000 7f5e2c9b0640 1 --2- 172.21.15.79:0/281963025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e280b3d40 0x7f5e280a9eb0 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.399+0000 7f5e2c9b0640 1 --2- 172.21.15.79:0/281963025 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5e2806df50 0x7f5e2813f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:43.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.399+0000 7f5e2c9b0640 1 -- 172.21.15.79:0/281963025 >> 172.21.15.79:0/281963025 conn(0x7f5e280cfc80 msgr2=0x7f5e2815f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:43.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.399+0000 7f5e2c9b0640 1 -- 172.21.15.79:0/281963025 shutdown_connections 2024-04-25T02:18:43.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T02:18:43.399+0000 7f5e2c9b0640 1 -- 172.21.15.79:0/281963025 wait complete. 2024-04-25T02:18:43.415 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-25T02:18:43.415 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T02:18:43.415 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T02:18:43.415 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:43.423 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T02:18:43.424 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T02:18:43.424 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:43.473 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T02:18:43.473 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T02:18:43.473 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:43.485 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T02:18:43.485 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T02:18:43.485 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:43.536 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T02:18:43.536 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T02:18:43.536 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T02:18:43.536 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:43.563 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T02:18:43.563 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T02:18:43.563 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:43.631 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T02:18:43.631 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T02:18:43.631 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:43.701 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T02:18:43.701 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T02:18:43.701 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:43.773 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T02:18:43.773 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T02:18:43.773 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:43.807 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T02:18:43.808 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T02:18:43.808 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:43.878 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T02:18:43.878 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T02:18:43.879 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:43.949 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T02:18:43.949 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T02:18:43.949 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:44.022 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T02:18:44.022 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T02:18:44.023 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T02:18:44.023 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:44.048 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T02:18:44.048 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T02:18:44.048 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:44.093 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T02:18:44.093 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T02:18:44.094 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T02:18:44.094 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:44.104 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T02:18:44.105 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T02:18:44.105 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:44.147 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T02:18:44.192 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T02:18:44.192 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:44.203 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T02:18:44.203 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T02:18:44.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-04-25T02:18:44.233 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:18:44.233 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T02:18:44.495 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:18:44.496 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T02:18:44.576 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:18:44.576 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T02:18:44.627 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:18:44.627 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T02:18:44.682 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-25T02:18:44.683 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T02:18:44.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-25T02:18:44.835 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T02:18:44.906 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-25T02:18:44.906 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T02:18:44.966 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-25T02:18:44.966 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T02:18:45.037 INFO:tasks.ceph:Archiving mon data... 2024-04-25T02:18:45.038 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672374/data/mon.a.tgz 2024-04-25T02:18:45.038 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-04-25T02:18:45.053 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.o6clnHIozo 2024-04-25T02:18:45.054 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.o6clnHIozo 2024-04-25T02:18:45.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.o6clnHIozo 2024-04-25T02:18:45.287 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.o6clnHIozo is 393KB 2024-04-25T02:18:45.355 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.o6clnHIozo 2024-04-25T02:18:45.370 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672374/data/mon.b.tgz 2024-04-25T02:18:45.370 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-04-25T02:18:45.388 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.1SP35fKZYq 2024-04-25T02:18:45.388 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.1SP35fKZYq 2024-04-25T02:18:45.549 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.1SP35fKZYq 2024-04-25T02:18:45.631 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.1SP35fKZYq is 396KB 2024-04-25T02:18:45.727 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.1SP35fKZYq 2024-04-25T02:18:45.742 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672374/data/mon.c.tgz 2024-04-25T02:18:45.742 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-04-25T02:18:45.795 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.zcaKx19LiK 2024-04-25T02:18:45.796 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.zcaKx19LiK 2024-04-25T02:18:45.928 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.zcaKx19LiK 2024-04-25T02:18:46.010 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.zcaKx19LiK is 396KB 2024-04-25T02:18:46.105 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.zcaKx19LiK 2024-04-25T02:18:46.119 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T02:18:46.119 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T02:18:46.122 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T02:18:46.201 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T02:18:46.236 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T02:18:46.236 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T02:18:46.238 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672374/remote/smithi079/crash 2024-04-25T02:18:46.239 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T02:18:46.265 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672374/remote/smithi189/crash 2024-04-25T02:18:46.266 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T02:18:46.299 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T02:18:46.299 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:18:46.310 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:18:46.385 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T02:18:46.409 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T02:18:46.432 INFO:tasks.ceph:Compressing logs... 2024-04-25T02:18:46.432 DEBUG:teuthology.orchestra.run.smithi079:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:18:46.451 DEBUG:teuthology.orchestra.run.smithi189:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:18:46.472 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57313.log 2024-04-25T02:18:46.472 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69678.log 2024-04-25T02:18:46.527 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34744.log 2024-04-25T02:18:46.527 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34824.log 2024-04-25T02:18:46.527 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.34744.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T02:18:46.527 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.34824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34784.log 2024-04-25T02:18:46.527 INFO:teuthology.orchestra.run.smithi189.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34744.log.gz 2024-04-25T02:18:46.527 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34824.log.gz 2024-04-25T02:18:46.527 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T02:18:46.527 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.34784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34533.log 2024-04-25T02:18:46.527 INFO:teuthology.orchestra.run.smithi189.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34784.log.gz 2024-04-25T02:18:46.527 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T02:18:46.527 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.34533.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T02:18:46.527 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-osd.7.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34533.log.gz 2024-04-25T02:18:46.527 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T02:18:46.527 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T02:18:46.528 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34613.log 2024-04-25T02:18:46.528 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34704.log 2024-04-25T02:18:46.528 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.34613.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T02:18:46.528 INFO:teuthology.orchestra.run.smithi189.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.34613.log.gz 2024-04-25T02:18:46.528 INFO:teuthology.orchestra.run.smithi189.stderr:gzip 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T02:18:46.528 INFO:teuthology.orchestra.run.smithi189.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T02:18:46.528 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.34704.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34704.log.gz 2024-04-25T02:18:46.528 INFO:teuthology.orchestra.run.smithi189.stderr: --verbose -- /var/log/ceph/ceph-client.3.41329.log 2024-04-25T02:18:46.528 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T02:18:46.528 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.3.41329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41329.log.gz 2024-04-25T02:18:46.528 INFO:teuthology.orchestra.run.smithi189.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34657.log 2024-04-25T02:18:46.528 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-04-25T02:18:46.528 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-osd.6.log: 94.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T02:18:46.528 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40933.log 2024-04-25T02:18:46.528 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.34657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40928.log 2024-04-25T02:18:46.529 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.1.40933.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34657.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.1.40933.log.gz 2024-04-25T02:18:46.529 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-04-25T02:18:46.529 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41333.log 2024-04-25T02:18:46.529 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.1.40928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40928.log.gz 2024-04-25T02:18:46.529 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T02:18:46.529 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.3.41333.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T02:18:46.529 INFO:teuthology.orchestra.run.smithi189.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41333.log.gz 2024-04-25T02:18:46.532 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34573.log 2024-04-25T02:18:46.545 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.34573.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34573.log.gz 2024-04-25T02:18:46.560 INFO:teuthology.orchestra.run.smithi189.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T02:18:46.600 INFO:teuthology.orchestra.run.smithi189.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T02:18:46.788 INFO:teuthology.orchestra.run.smithi189.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T02:18:46.850 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56973.log 2024-04-25T02:18:46.850 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57313.log.gz 2024-04-25T02:18:46.850 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42578.log 2024-04-25T02:18:46.850 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58439.log 2024-04-25T02:18:46.850 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69678.log.gz 2024-04-25T02:18:46.850 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42578.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.65370.log 2024-04-25T02:18:46.850 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56973.log.gz 2024-04-25T02:18:46.850 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42578.log.gz 2024-04-25T02:18:46.850 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47871.log 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58439.log.gz 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45544.log 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47871.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65370.log.gz 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59701.log 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45544.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47871.log.gz 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47027.log 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59701.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45544.log.gz 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70082.log 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47027.log: gzip -5 --verbose -- 89.0% /var/log/ceph/ceph-client.admin.46468.log 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59701.log.gz 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70082.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.47027.log.gz 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57099.log 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60855.log 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57099.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46468.log.gz 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71075.log 2024-04-25T02:18:46.851 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.70082.log.gz 2024-04-25T02:18:46.852 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57099.log.gz 2024-04-25T02:18:46.852 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44485.log 2024-04-25T02:18:46.852 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71075.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60855.log.gz 2024-04-25T02:18:46.852 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71496.log 2024-04-25T02:18:46.852 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44485.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71075.log.gz 2024-04-25T02:18:46.852 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47787.log 2024-04-25T02:18:46.852 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44485.log.gz 2024-04-25T02:18:46.852 INFO:teuthology.orchestra.run.smithi079.stderr:gzip/var/log/ceph/ceph-client.admin.71496.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57835.log 2024-04-25T02:18:46.852 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49196.log 2024-04-25T02:18:46.852 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71496.log.gz 2024-04-25T02:18:46.852 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48251.log 2024-04-25T02:18:46.852 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47787.log.gz 2024-04-25T02:18:46.852 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77377.log 2024-04-25T02:18:46.852 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.48251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62510.log 2024-04-25T02:18:46.852 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49196.log.gz 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48251.log.gz 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57835.log.gz 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53610.log 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62510.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77377.log.gz -5 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48832.log 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62510.log.gz 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60636.log 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48832.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53610.log.gz 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47913.log 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48832.log.gz 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68039.log 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47913.log: gzip 87.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.60636.log.gz -- 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr: /var/log/ceph/ceph-client.admin.64444.log 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68039.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47913.log.gz 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76454.log 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78177.log 2024-04-25T02:18:46.853 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68039.log.gz 2024-04-25T02:18:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.76454.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64444.log.gz 2024-04-25T02:18:46.854 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.76454.log.gz 2024-04-25T02:18:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74342.log 2024-04-25T02:18:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48897.log 2024-04-25T02:18:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55763.log 2024-04-25T02:18:46.854 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78177.log.gz 2024-04-25T02:18:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48897.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74342.log.gz 2024-04-25T02:18:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42410.log 2024-04-25T02:18:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40695.log 2024-04-25T02:18:46.854 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48897.log.gz 2024-04-25T02:18:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42410.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55763.log.gz 2024-04-25T02:18:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57229.log 2024-04-25T02:18:46.854 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42410.log.gz 2024-04-25T02:18:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69184.log 2024-04-25T02:18:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57229.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40695.log.gz -5 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55941.log 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69184.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57229.log.gzgzip 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65555.log 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69184.log.gz/var/log/ceph/ceph-client.admin.55941.log: 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54271.log 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65555.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55941.log.gz 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74495.log 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78438.log 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63438.log 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.65555.log.gz 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78438.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74495.log.gz 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54271.log.gz 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47451.log 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78438.log.gz 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65424.log 2024-04-25T02:18:46.855 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44779.log 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63438.log.gz 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65424.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47451.log.gz 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61378.log 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65424.log.gz 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72257.log 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46216.log 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44779.log.gz 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61378.log.gz 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50127.log 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46216.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72257.log.gz 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71202.log 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78480.log 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46216.log.gz 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71202.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.72670.log -- replaced with /var/log/ceph/ceph-client.admin.50127.log.gz 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71202.log.gz 2024-04-25T02:18:46.856 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72361.log 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78480.log: /var/log/ceph/ceph-client.admin.72670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45226.log 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78480.log.gz 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72361.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72670.log.gz 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60067.log 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52887.log 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72361.log.gz 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45226.log.gz/var/log/ceph/ceph-client.admin.60067.log: 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71580.log 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50209.log 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60067.log.gz 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71580.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52887.log.gz 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56109.log 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50209.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71580.log.gz 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75183.log 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56109.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50209.log.gz 2024-04-25T02:18:46.857 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46697.log 2024-04-25T02:18:46.858 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60409.log 2024-04-25T02:18:46.858 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56109.log.gz 2024-04-25T02:18:46.858 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54754.log 2024-04-25T02:18:46.858 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75183.log.gz 2024-04-25T02:18:46.858 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46697.log.gz 2024-04-25T02:18:46.858 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.60409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66784.log 2024-04-25T02:18:46.858 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60409.log.gz 2024-04-25T02:18:46.858 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45501.log 2024-04-25T02:18:46.858 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56632.log 2024-04-25T02:18:46.858 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54754.log.gz 2024-04-25T02:18:46.858 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52121.log 2024-04-25T02:18:46.858 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66784.log.gz 2024-04-25T02:18:46.858 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45501.log: /var/log/ceph/ceph-client.admin.56632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72317.log 2024-04-25T02:18:46.858 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45501.log.gz 2024-04-25T02:18:46.858 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52121.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56632.log.gz -5 --verbose 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr: -- /var/log/ceph/ceph-client.admin.58637.log 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72317.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52121.log.gzgzip 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.75267.log 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72317.log.gz 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50047.log 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75267.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58637.log.gz 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40611.log 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65207.log 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75267.log.gz 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40611.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50047.log.gz 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49658.log 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65207.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40611.log.gz 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44569.log 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67349.log 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49658.log.gz 2024-04-25T02:18:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64960.log 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53522.log 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44569.log.gz 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.65207.log.gz 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64960.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67349.log.gz 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46510.log 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53522.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64960.log.gz 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66216.log 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46510.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53522.log.gz 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70413.log 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1%/var/log/ceph/ceph-client.admin.66216.log: -- replaced with /var/log/ceph/ceph-client.admin.46510.log.gz 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75508.log 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70413.log: gzip 89.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.66216.log.gz --verbose 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr: -- /var/log/ceph/ceph-client.admin.78754.log 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75508.log: gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-client.admin.49616.log 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70413.log.gz 2024-04-25T02:18:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77335.log 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.75508.log.gz 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49616.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.78754.log.gz 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49616.log.gz 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52929.log 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72628.log 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77335.log.gz 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58690.log 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44443.log 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52929.log.gz 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58690.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72628.log.gz 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67181.log 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58690.log.gz 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70597.log 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44443.log.gz 2024-04-25T02:18:46.861 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78093.log 2024-04-25T02:18:46.862 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67181.log: /var/log/ceph/ceph-client.admin.70597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41824.log 2024-04-25T02:18:46.862 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67181.log.gz 2024-04-25T02:18:46.862 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71328.log 2024-04-25T02:18:46.862 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41824.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.78093.log.gz 2024-04-25T02:18:46.862 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52037.log 2024-04-25T02:18:46.862 INFO:teuthology.orchestra.run.smithi079.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.70597.log.gz 2024-04-25T02:18:46.862 INFO:teuthology.orchestra.run.smithi079.stderr: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T02:18:46.862 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75428.log 2024-04-25T02:18:46.862 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41824.log.gz 2024-04-25T02:18:46.862 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58778.log 2024-04-25T02:18:46.862 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71328.log.gz 2024-04-25T02:18:46.862 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75428.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52037.log.gz 2024-04-25T02:18:46.862 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77841.log 2024-04-25T02:18:46.862 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75428.log.gz 2024-04-25T02:18:46.862 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70467.log 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50335.log 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58778.log.gz 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70467.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77841.log.gz 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68966.log 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70467.log.gz 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48755.log 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50335.log.gz 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57709.log 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53272.log 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68966.log.gz 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.57709.log: /var/log/ceph/ceph-client.admin.55326.log 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48755.log.gz 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53272.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57709.log.gz 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55326.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53272.log.gz 2024-04-25T02:18:46.863 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55637.log 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58089.log 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55637.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55326.log.gz 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45922.log 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.58089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47493.log 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58089.log.gz 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55637.log.gz 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71748.log 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45922.log.gz 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48971.log 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72754.log 88.6% 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47493.log.gz 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48971.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71748.log.gz 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63637.log 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60762.log 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.48971.log.gz 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69376.log 2024-04-25T02:18:46.864 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72754.log.gz 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60762.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63637.log.gz 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64120.log 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.69376.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60762.log.gz 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49154.log 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69376.log.gz 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41833.log 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67816.log 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41833.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49154.log.gz 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73426.log 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.64120.log.gz 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7%/var/log/ceph/ceph-client.admin.67816.log: -- replaced with /var/log/ceph/ceph-client.admin.41833.log.gz 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61690.log 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67816.log.gz 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50987.log 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72405.log 2024-04-25T02:18:46.865 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73426.log.gz 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50987.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61690.log.gz 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63376.log 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50987.log.gz 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67955.log 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72405.log.gz 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75877.log 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67223.log 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63376.log.gz 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75877.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67955.log.gz 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49490.log 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68229.log 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42662.log 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67223.log.gz 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75638.log 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49490.log.gz 2024-04-25T02:18:46.866 INFO:teuthology.orchestra.run.smithi079.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.75877.log.gz 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42662.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.52593.log -- replaced with /var/log/ceph/ceph-client.admin.68229.log.gz 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.42662.log.gz -5 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr: --verbose -- /var/log/ceph/ceph-client.admin.73629.log 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75638.log: /var/log/ceph/ceph-client.admin.52593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65122.log 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52593.log.gz 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67774.log 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44863.log 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.75638.log.gz 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78524.log 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65122.log.gz 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.73629.log.gz 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49364.log 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44863.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67774.log.gz 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57481.log 2024-04-25T02:18:46.867 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44863.log.gz 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78524.log.gz 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55392.log 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57481.log: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.49364.log.gz -5 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50735.log 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55392.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57481.log.gz 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70555.log 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50735.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55392.log.gz 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65809.log 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70555.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50735.log.gz 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.65809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52299.log 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70555.log.gz 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65809.log.gz 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48934.log 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69636.log 2024-04-25T02:18:46.868 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48934.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52299.log.gz 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65184.log 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58397.log 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48934.log.gz 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69636.log: /var/log/ceph/ceph-client.admin.65184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61065.log 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69636.log.gz 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58397.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65184.log.gz 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50549.log 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58397.log.gz 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62159.log 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61065.log.gz 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47323.log 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50549.log: /var/log/ceph/ceph-client.admin.62159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41823.log 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50549.log.gz 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47323.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62159.log.gz 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53875.log 2024-04-25T02:18:46.869 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47323.log.gz 2024-04-25T02:18:46.870 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51738.log 2024-04-25T02:18:46.870 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41823.log: /var/log/ceph/ceph-client.admin.53875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69720.log 2024-04-25T02:18:46.870 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41823.log.gz 2024-04-25T02:18:46.870 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61606.log 2024-04-25T02:18:46.870 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53875.log.gz 2024-04-25T02:18:46.870 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46258.log 2024-04-25T02:18:46.870 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61606.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69720.log.gz 2024-04-25T02:18:46.870 INFO:teuthology.orchestra.run.smithi079.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.51738.log.gz 2024-04-25T02:18:46.870 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47619.log 2024-04-25T02:18:46.870 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61606.log.gz 2024-04-25T02:18:46.870 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66994.log 2024-04-25T02:18:46.870 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46258.log: /var/log/ceph/ceph-client.admin.47619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61149.log 2024-04-25T02:18:46.870 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46258.log.gz 2024-04-25T02:18:46.870 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72946.log 2024-04-25T02:18:46.870 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66994.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47619.log.gz 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51071.log 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66994.log.gz 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72946.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61149.log.gz 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46943.log 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51071.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72946.log.gz 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54001.log 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46943.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51071.log.gz 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44653.log 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54001.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46943.log.gz 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41500.log 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44653.log: gzip -5 --verbose 87.8% -- -- replaced with /var/log/ceph/ceph-client.admin.54001.log.gz /var/log/ceph/ceph-client.0.54525.log 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44653.log.gz 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51650.log 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.54525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51823.log 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41500.log.gz 2024-04-25T02:18:46.871 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54525.log.gz 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65309.log 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67391.log 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42032.log 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.51650.log.gz 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51823.log.gz 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47577.log 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67391.log.gz 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59484.log 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42032.log: /var/log/ceph/ceph-client.admin.47577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51029.log 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42032.log.gz 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59484.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47577.log.gz 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71244.log 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.65309.log.gz 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55134.log 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51029.log: /var/log/ceph/ceph-client.admin.71244.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.59484.log.gz 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42452.log 2024-04-25T02:18:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55134.log: gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.41494.log 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51029.log.gz 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71244.log.gz 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42452.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55134.log.gz 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66479.log 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42452.log.gz/var/log/ceph/ceph-client.admin.41494.log: 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50777.log 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66479.log: gzip -5 88.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.41494.log.gz 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr: /var/log/ceph/ceph-client.admin.46342.log 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66479.log.gz 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51912.log 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50777.log.gz 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75309.log 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54145.log 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46342.log.gz 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44065.log 2024-04-25T02:18:46.873 INFO:teuthology.orchestra.run.smithi079.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51912.log.gz 2024-04-25T02:18:46.874 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75309.log.gz 2024-04-25T02:18:46.874 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62678.log 2024-04-25T02:18:46.874 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58516.log 2024-04-25T02:18:46.874 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54145.log.gz 2024-04-25T02:18:46.874 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62678.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44065.log.gz 2024-04-25T02:18:46.874 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49448.log 2024-04-25T02:18:46.874 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49045.log 2024-04-25T02:18:46.874 INFO:teuthology.orchestra.run.smithi079.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.62678.log.gz 2024-04-25T02:18:46.874 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49448.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58516.log.gz 2024-04-25T02:18:46.874 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63461.log 2024-04-25T02:18:46.874 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41835.log 2024-04-25T02:18:46.874 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49448.log.gz/var/log/ceph/ceph-client.admin.49045.log: 2024-04-25T02:18:46.874 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59239.log 2024-04-25T02:18:46.874 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49045.log.gz 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41835.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.63461.log.gz 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59239.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41835.log.gz 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62594.log 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59239.log.gz 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41108.log 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.62594.log: /var/log/ceph/ceph.tmp-client.admin.28368.log 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41108.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62594.log.gz 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74745.log 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46132.log 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41108.log.gz 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph.tmp-client.admin.28368.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28368.log.gz 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42536.log 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46132.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74745.log.gz 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62744.log 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53791.log 2024-04-25T02:18:46.875 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46132.log.gz 2024-04-25T02:18:46.876 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42536.log: /var/log/ceph/ceph-client.admin.62744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57667.log 2024-04-25T02:18:46.876 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42536.log.gz 2024-04-25T02:18:46.876 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62744.log.gz 2024-04-25T02:18:46.876 INFO:teuthology.orchestra.run.smithi079.stderr:gzip/var/log/ceph/ceph-client.admin.53791.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56277.log 2024-04-25T02:18:46.876 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70509.log 2024-04-25T02:18:46.876 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53791.log.gz 2024-04-25T02:18:46.876 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56277.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57667.log.gz 2024-04-25T02:18:46.876 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53192.log 2024-04-25T02:18:46.876 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56277.log.gz 2024-04-25T02:18:46.876 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50819.log 2024-04-25T02:18:46.876 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70509.log: /var/log/ceph/ceph-client.admin.53192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62338.log 2024-04-25T02:18:46.876 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70509.log.gz 2024-04-25T02:18:46.876 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50819.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.53192.log.gz 2024-04-25T02:18:46.876 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.70166.log 2024-04-25T02:18:46.876 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50819.log.gz 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42169.log 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62338.log.gz 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56335.log 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70166.log: /var/log/ceph/ceph-client.admin.42169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55679.log 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42169.log.gz 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42788.log 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44905.log 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.70166.log.gz 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55679.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56335.log.gz 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53354.log 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55679.log.gz 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41499.log 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44905.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42788.log.gz 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53354.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44905.log.gz 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40484.log 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55026.log 2024-04-25T02:18:46.877 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6%/var/log/ceph/ceph-client.admin.41499.log: -- replaced with /var/log/ceph/ceph-client.admin.53354.log.gz 2024-04-25T02:18:46.878 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60485.log 2024-04-25T02:18:46.878 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41499.log.gz 2024-04-25T02:18:46.878 INFO:teuthology.orchestra.run.smithi079.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40484.log.gz 2024-04-25T02:18:46.878 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76450.log 2024-04-25T02:18:46.878 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41827.log 2024-04-25T02:18:46.878 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55026.log.gz 2024-04-25T02:18:46.878 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.76450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.76450.log.gz 2024-04-25T02:18:46.878 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62115.log 2024-04-25T02:18:46.878 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60485.log.gz 2024-04-25T02:18:46.878 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72502.log 2024-04-25T02:18:46.878 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62115.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41827.log.gz 2024-04-25T02:18:46.878 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45310.log 2024-04-25T02:18:46.878 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62115.log.gz 2024-04-25T02:18:46.878 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73883.log 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72502.log: /var/log/ceph/ceph-client.admin.45310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66573.log 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72502.log.gz 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.73883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73883.log.gz 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.45310.log.gz -5 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54103.log 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41150.log 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54103.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66573.log.gz 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34711.log 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54103.log.gz 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77083.log 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70315.log 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34711.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41150.log.gz 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77083.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.34711.log.gz --verbose 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr: -- /var/log/ceph/ceph-client.0.51367.log 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56235.log 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70315.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.77083.log.gz 2024-04-25T02:18:46.879 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.51367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55595.log 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51367.log.gz 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56235.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.70315.log.gz 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47703.log 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56235.log.gz 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49868.log 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55595.log: /var/log/ceph/ceph-client.admin.47703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57565.log 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55595.log.gz 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49868.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47703.log.gz 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71117.log 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57565.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49868.log.gz 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 88.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.57565.log.gz 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr: /var/log/ceph/ceph-client.admin.49280.log 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46090.log 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71117.log: /var/log/ceph/ceph-client.admin.49280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53745.log 2024-04-25T02:18:46.880 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71117.log.gz 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49280.log.gz 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56025.log 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53745.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46090.log.gz 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46985.log 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53745.log.gz 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57143.log 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46985.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56025.log.gz 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58581.log 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46985.log.gz 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68355.log 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56380.log 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58581.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57143.log.gz 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47195.log 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58581.log.gz 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76780.log 2024-04-25T02:18:46.881 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68355.log.gz 2024-04-25T02:18:46.882 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56380.log.gz 2024-04-25T02:18:46.882 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55242.log 2024-04-25T02:18:46.882 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40894.log 2024-04-25T02:18:46.882 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76780.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47195.log.gz 2024-04-25T02:18:46.882 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53661.log 2024-04-25T02:18:46.882 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76780.log.gz 2024-04-25T02:18:46.882 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57187.log 2024-04-25T02:18:46.882 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53661.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40894.log.gz 2024-04-25T02:18:46.882 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34445.log 2024-04-25T02:18:46.882 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55242.log.gz 2024-04-25T02:18:46.882 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77925.log 2024-04-25T02:18:46.882 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53661.log.gz 2024-04-25T02:18:46.882 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53097.log 2024-04-25T02:18:46.882 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57187.log.gz 2024-04-25T02:18:46.882 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34445.log.gz 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68463.log 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77925.log: gzip/var/log/ceph/ceph-client.admin.53097.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44947.log 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9%/var/log/ceph/ceph-client.admin.68463.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.77925.log.gz 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52205.log 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53097.log.gz 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44947.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68463.log.gz 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77564.log 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44947.log.gz 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70681.log 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77564.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52205.log.gz 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53013.log 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77564.log.gz 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48874.log 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.53013.log: gzip -5 --verbose 91.1% -- -- replaced with /var/log/ceph/ceph-client.admin.70681.log.gz /var/log/ceph/ceph-client.admin.44737.log 2024-04-25T02:18:46.883 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53013.log.gz 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46859.log 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48874.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44737.log: /var/log/ceph/ceph-client.admin.46859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42494.log 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44737.log.gz 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48874.log.gz 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mgr.y.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46859.log.gz 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52383.log 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65002.log 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42494.log.gz/var/log/ceph/ceph-client.admin.52383.log: 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58820.log 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52383.log.gz 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78609.log 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65002.log.gz/var/log/ceph/ceph-client.admin.58820.log: 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67307.log 2024-04-25T02:18:46.884 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60939.log 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.58820.log.gz 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78609.log.gz 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67307.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr:gzip/var/log/ceph/ceph-client.admin.60939.log: 89.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.53438.log 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67307.log.gz 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60939.log.gz 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49008.log 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52425.log 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49008.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53438.log.gz 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.49008.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42163.log 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69995.log 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42163.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52425.log.gz 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42163.log.gz 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77041.log 2024-04-25T02:18:46.885 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77419.log 2024-04-25T02:18:46.886 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77041.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69995.log.gz 2024-04-25T02:18:46.886 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77041.log.gz 2024-04-25T02:18:46.886 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42830.log 2024-04-25T02:18:46.886 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64504.log 2024-04-25T02:18:46.886 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42830.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77419.log.gz 2024-04-25T02:18:46.886 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42830.log.gz 2024-04-25T02:18:46.886 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76864.log 2024-04-25T02:18:46.886 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45184.log 2024-04-25T02:18:46.886 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76864.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.76864.log.gz 2024-04-25T02:18:46.886 INFO:teuthology.orchestra.run.smithi079.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.64504.log.gz 2024-04-25T02:18:46.886 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45676.log 2024-04-25T02:18:46.886 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71664.log 2024-04-25T02:18:46.886 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45184.log.gz 2024-04-25T02:18:46.886 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45802.log 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71664.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45676.log.gz 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71664.log.gz 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43928.log 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64875.log 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45802.log.gz 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.2.43928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43928.log.gz 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71370.log 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64875.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64875.log.gz 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45268.log 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72456.log 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71370.log.gz 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67997.log 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72456.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45268.log.gz 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72456.log.gz 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52677.log 2024-04-25T02:18:46.887 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66910.log 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.67997.log.gz 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42914.log 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66910.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52677.log.gz 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66910.log.gz 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77293.log 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75704.log 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42914.log.gz 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43136.log 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8%/var/log/ceph/ceph-client.admin.75704.log: -- replaced with /var/log/ceph/ceph-client.admin.77293.log.gz 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75704.log.gz 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76822.log 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.43136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62932.log 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43136.log.gz 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52341.log 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.62932.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.76822.log.gz 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62932.log.gz 2024-04-25T02:18:46.888 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57439.log 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54061.log 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52341.log.gz 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65044.log 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54061.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57439.log.gz 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54061.log.gz 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45586.log 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57523.log 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65044.log.gz 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52761.log 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57523.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45586.log.gz 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57523.log.gz 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49532.log 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58355.log 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52761.log.gz 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44107.log 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58355.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49532.log.gz 2024-04-25T02:18:46.889 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58355.log.gz 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56849.log 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49910.log 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44107.log.gz 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72880.log 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49910.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56849.log.gz 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49910.log.gz 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52719.log 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74933.log 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52719.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.72880.log.gz 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52719.log.gz 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64659.log 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64025.log 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.74933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74933.log.gz 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46426.log 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.64025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64025.log.gz 2024-04-25T02:18:46.890 INFO:teuthology.orchestra.run.smithi079.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.64659.log.gz 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44695.log 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77167.log 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46426.log: /var/log/ceph/ceph-client.admin.44695.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46426.log.gz 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44695.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40825.log 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62936.log 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77167.log: /var/log/ceph/ceph-client.admin.40825.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40825.log.gz 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77167.log.gz 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61275.log 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72796.log 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.62936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62936.log.gz 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65891.log 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61275.log.gz 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71412.log 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65891.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72796.log.gz 2024-04-25T02:18:46.891 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46048.log 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71412.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.65891.log.gz 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71412.log.gz 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50945.log 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51576.log 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46048.log.gz 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77883.log 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51576.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50945.log.gz 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50251.log 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51576.log.gz 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77606.log 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50251.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77883.log.gz 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50251.log.gz 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52467.log 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47955.log 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52467.log: /var/log/ceph/ceph-client.admin.77606.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77606.log.gz 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52467.log.gz 2024-04-25T02:18:46.892 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78794.log 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5/var/log/ceph/ceph-client.admin.47955.log: --verbose -- /var/log/ceph/ceph-client.admin.75225.log 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47955.log.gz 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78794.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.78794.log.gz 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44191.log 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61191.log 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75225.log.gz 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62254.log 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61191.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44191.log.gz 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.61191.log.gz 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77251.log 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64336.log 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62254.log.gz 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74637.log 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64336.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77251.log.gz 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr:gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64336.log.gz 2024-04-25T02:18:46.893 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69994.log 2024-04-25T02:18:46.894 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44317.log 2024-04-25T02:18:46.894 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74637.log: /var/log/ceph/ceph-client.admin.69994.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74637.log.gz 2024-04-25T02:18:46.894 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60897.log 2024-04-25T02:18:46.894 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44317.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.69994.log.gz 2024-04-25T02:18:46.894 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44317.log.gz 2024-04-25T02:18:46.894 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42162.log 2024-04-25T02:18:46.894 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73695.log 2024-04-25T02:18:46.894 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60897.log.gz 2024-04-25T02:18:46.894 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67732.log 2024-04-25T02:18:46.894 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73695.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42162.log.gz 2024-04-25T02:18:46.894 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73695.log.gz 2024-04-25T02:18:46.894 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68145.log 2024-04-25T02:18:46.894 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72173.log 2024-04-25T02:18:46.894 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67732.log.gz 2024-04-25T02:18:46.894 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47279.log 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72173.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68145.log.gz 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72173.log.gz 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69372.log 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75994.log 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47279.log.gz 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.69372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69372.log.gz 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68655.log 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75994.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75994.log.gz 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.68655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68655.log.gz 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46901.log 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66150.log 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46901.log: /var/log/ceph/ceph-mon.a.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46901.log.gz 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61420.log 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66150.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41495.log 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61420.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.66150.log.gz 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61420.log.gz 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57625.log 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54229.log 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41495.log.gz 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59809.log 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57625.log.gz 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41832.log 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54229.log.gz 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42368.log 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0%/var/log/ceph/ceph-client.admin.41832.log: -- replaced with /var/log/ceph/ceph-client.admin.59809.log.gz 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41832.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52845.log 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78219.log 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42368.log: /var/log/ceph/ceph-client.admin.52845.log: 87.5% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42368.log.gz 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52845.log.gz 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50633.log 2024-04-25T02:18:46.896 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66658.log 2024-04-25T02:18:46.897 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78219.log.gz 2024-04-25T02:18:46.897 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71538.log 2024-04-25T02:18:46.897 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66658.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50633.log.gz 2024-04-25T02:18:46.897 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61023.log 2024-04-25T02:18:46.897 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66658.log.gz 2024-04-25T02:18:46.897 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53833.log 2024-04-25T02:18:46.897 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61023.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71538.log.gz 2024-04-25T02:18:46.897 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61023.log.gz 2024-04-25T02:18:46.897 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50591.log 2024-04-25T02:18:46.897 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43932.log 2024-04-25T02:18:46.897 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53833.log.gz 2024-04-25T02:18:46.897 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64918.log 2024-04-25T02:18:46.897 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50591.log.gz 2024-04-25T02:18:46.897 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.2.43932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59323.log 2024-04-25T02:18:46.897 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43932.log.gz 2024-04-25T02:18:46.898 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52803.log 2024-04-25T02:18:46.898 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59323.log: 89.2% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64918.log.gz 2024-04-25T02:18:46.898 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59323.log.gz 2024-04-25T02:18:46.898 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44149.log 2024-04-25T02:18:46.898 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62073.log 2024-04-25T02:18:46.898 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52803.log.gz 2024-04-25T02:18:46.898 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75471.log 2024-04-25T02:18:46.898 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44149.log.gz 2024-04-25T02:18:46.898 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55899.log 2024-04-25T02:18:46.898 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4%/var/log/ceph/ceph-client.admin.75471.log: -- replaced with /var/log/ceph/ceph-client.admin.62073.log.gz 2024-04-25T02:18:46.898 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56548.log 2024-04-25T02:18:46.898 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55899.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.75471.log.gz 2024-04-25T02:18:46.898 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63725.log 2024-04-25T02:18:46.898 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55899.log.gz 2024-04-25T02:18:46.898 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46174.log 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63725.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56548.log.gz 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63725.log.gz 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40569.log 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45031.log 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46174.log.gz/var/log/ceph/ceph-client.admin.40569.log: 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76048.log 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40569.log.gz/var/log/ceph/ceph-client.admin.45031.log: 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49406.log 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45031.log.gz 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72131.log 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76048.log: /var/log/ceph/ceph-client.admin.49406.log: 88.6% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76048.log.gz 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49406.log.gz 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66311.log 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56769.log 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72131.log.gz 2024-04-25T02:18:46.899 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74439.log 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56769.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66311.log.gz 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74937.log 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56769.log.gz 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57751.log 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.74937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74937.log.gz 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.74439.log.gz 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55500.log 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62296.log 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57751.log.gz 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44611.log 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62296.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55500.log.gz 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44527.log 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62296.log.gz 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40526.log 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44527.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44611.log.gz 2024-04-25T02:18:46.900 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44527.log.gz 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59743.log 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56931.log 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40526.log.gz 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74148.log 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56931.log: 89.0% 91.3% -- replaced with /var/log/ceph/ceph-client.admin.59743.log.gz 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56931.log.gz 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45844.log 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58732.log 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74148.log.gz 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48713.log 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58732.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45844.log.gz 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62468.log 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58732.log.gz 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60981.log 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62468.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48713.log.gz 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62468.log.gz 2024-04-25T02:18:46.901 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63131.log 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66395.log 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60981.log.gz 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67265.log 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63131.log.gz 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63833.log 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9%/var/log/ceph/ceph-client.admin.67265.log: -- replaced with /var/log/ceph/ceph-client.admin.66395.log.gz 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49742.log 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63833.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.67265.log.gz 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49952.log 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63833.log.gz 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41234.log 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49952.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49742.log.gz 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49952.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42171.log 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60109.log 2024-04-25T02:18:46.902 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41234.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.42171.log: /var/log/ceph/ceph-client.admin.76154.log 2024-04-25T02:18:46.903 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8%/var/log/ceph/ceph-client.admin.60109.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42171.log.gz 2024-04-25T02:18:46.903 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41234.log.gz 2024-04-25T02:18:46.903 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57271.log 2024-04-25T02:18:46.903 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60109.log.gz 2024-04-25T02:18:46.903 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65466.log 2024-04-25T02:18:46.903 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.76154.log.gz/var/log/ceph/ceph-client.admin.57271.log: 2024-04-25T02:18:46.903 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70769.log 2024-04-25T02:18:46.903 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65466.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57271.log.gz 2024-04-25T02:18:46.903 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66868.log 2024-04-25T02:18:46.903 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65466.log.gz 2024-04-25T02:18:46.903 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41496.log 2024-04-25T02:18:46.903 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66868.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66868.log.gz 2024-04-25T02:18:46.903 INFO:teuthology.orchestra.run.smithi079.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.70769.log.gz 2024-04-25T02:18:46.903 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43490.log 2024-04-25T02:18:46.903 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61785.log 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41496.log.gz 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.43490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43490.log.gz 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78566.log 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71874.log 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61785.log.gz/var/log/ceph/ceph-client.admin.78566.log: 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52163.log 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78566.log.gz 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41276.log 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7%/var/log/ceph/ceph-client.admin.52163.log: -- replaced with /var/log/ceph/ceph-client.admin.71874.log.gz 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52163.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69043.log 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59078.log 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56464.log 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41276.log.gz 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69043.log: /var/log/ceph/ceph-client.0.59078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59078.log.gz 2024-04-25T02:18:46.904 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69043.log.gz 2024-04-25T02:18:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66353.log 2024-04-25T02:18:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63299.log 2024-04-25T02:18:46.905 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56464.log.gz 2024-04-25T02:18:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72838.log 2024-04-25T02:18:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63299.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66353.log.gz 2024-04-25T02:18:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52635.log 2024-04-25T02:18:46.905 INFO:teuthology.orchestra.run.smithi079.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.63299.log.gz 2024-04-25T02:18:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47069.log 2024-04-25T02:18:46.905 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72838.log.gz 2024-04-25T02:18:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46300.log 2024-04-25T02:18:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47069.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52635.log.gz 2024-04-25T02:18:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42746.log 2024-04-25T02:18:46.905 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47069.log.gz 2024-04-25T02:18:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68085.log 2024-04-25T02:18:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42746.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46300.log.gz 2024-04-25T02:18:46.906 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42746.log.gz 2024-04-25T02:18:46.906 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78009.log 2024-04-25T02:18:46.906 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66826.log 2024-04-25T02:18:46.906 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68085.log.gz 2024-04-25T02:18:46.906 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59407.log 2024-04-25T02:18:46.906 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66826.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78009.log.gz 2024-04-25T02:18:46.906 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72544.log 2024-04-25T02:18:46.906 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66826.log.gz 2024-04-25T02:18:46.906 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62384.log 2024-04-25T02:18:46.906 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72544.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59407.log.gz 2024-04-25T02:18:46.906 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72544.log.gzgzip 2024-04-25T02:18:46.906 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44275.log 2024-04-25T02:18:46.906 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5/var/log/ceph/ceph-client.admin.62384.log: --verbose -- /var/log/ceph/ceph-client.admin.68187.log 2024-04-25T02:18:46.906 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62384.log.gz 2024-04-25T02:18:46.906 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51113.log 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68187.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44275.log.gz 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70255.log 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68187.log.gz 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44233.log 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70255.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51113.log.gz 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.70255.log.gz 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70942.log 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73384.log 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44233.log.gz 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59365.log 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73384.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.70942.log.gz 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.73384.log.gz 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40737.log 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71159.log 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40737.log: /var/log/ceph/ceph-client.admin.59365.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59365.log.gz 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40737.log.gz 2024-04-25T02:18:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42704.log 2024-04-25T02:18:46.908 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64270.log 2024-04-25T02:18:46.908 INFO:teuthology.orchestra.run.smithi079.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.71159.log.gz 2024-04-25T02:18:46.908 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77522.log 2024-04-25T02:18:46.908 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64270.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42704.log.gz 2024-04-25T02:18:46.908 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71790.log 2024-04-25T02:18:46.908 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77522.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.64270.log.gz 2024-04-25T02:18:46.908 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77522.log.gz 2024-04-25T02:18:46.908 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78303.log 2024-04-25T02:18:46.908 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78051.log 2024-04-25T02:18:46.908 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71790.log.gz/var/log/ceph/ceph-client.admin.78303.log: 2024-04-25T02:18:46.908 INFO:teuthology.orchestra.run.smithi079.stderr:gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78303.log.gz 2024-04-25T02:18:46.908 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57397.log 2024-04-25T02:18:46.908 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47237.log 2024-04-25T02:18:46.908 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1%/var/log/ceph/ceph-client.admin.57397.log: -- replaced with /var/log/ceph/ceph-client.admin.78051.log.gz 2024-04-25T02:18:46.908 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59634.log 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47237.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57397.log.gz 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73134.log 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47237.log.gz 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61233.log 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.73134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73134.log.gz 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60720.log 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61233.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.59634.log.gz 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69762.log 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61233.log.gz 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50903.log 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69762.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60720.log.gz 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69762.log.gz 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40781.log 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67054.log 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40781.log: /var/log/ceph/ceph-client.admin.50903.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50903.log.gz 2024-04-25T02:18:46.909 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40781.log.gz 2024-04-25T02:18:46.910 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76738.log 2024-04-25T02:18:46.910 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66700.log 2024-04-25T02:18:46.910 INFO:teuthology.orchestra.run.smithi079.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67054.log.gz 2024-04-25T02:18:46.910 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42168.log 2024-04-25T02:18:46.910 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66700.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.76738.log.gz 2024-04-25T02:18:46.910 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47661.log 2024-04-25T02:18:46.910 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66700.log.gz 2024-04-25T02:18:46.910 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45718.log 2024-04-25T02:18:46.910 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47661.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42168.log.gz 2024-04-25T02:18:46.910 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47661.log.gz 2024-04-25T02:18:46.910 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56590.log 2024-04-25T02:18:46.910 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71286.log 2024-04-25T02:18:46.910 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56590.log: /var/log/ceph/ceph-client.admin.45718.log: 88.9% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45718.log.gz 2024-04-25T02:18:46.910 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56590.log.gz 2024-04-25T02:18:46.910 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78346.log 2024-04-25T02:18:46.911 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49784.log 2024-04-25T02:18:46.911 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71286.log.gz 2024-04-25T02:18:46.911 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55068.log 2024-04-25T02:18:46.911 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49784.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78346.log.gz 2024-04-25T02:18:46.911 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71832.log 2024-04-25T02:18:46.911 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49784.log.gz 2024-04-25T02:18:46.911 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65957.log 2024-04-25T02:18:46.911 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71832.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71832.log.gz 2024-04-25T02:18:46.911 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55068.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40936.log 2024-04-25T02:18:46.911 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.911 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54960.log 2024-04-25T02:18:46.911 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78693.log 2024-04-25T02:18:46.911 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54960.log: 91.0%/var/log/ceph/ceph-client.admin.40936.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40936.log.gz 2024-04-25T02:18:46.911 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65957.log.gz 2024-04-25T02:18:46.911 INFO:teuthology.orchestra.run.smithi079.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54960.log.gz 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64021.log 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47367.log 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.78693.log.gz 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.64021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64021.log.gz 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78651.log 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55434.log 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47367.log.gz 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59917.log 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55434.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78651.log.gz 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75793.log 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59917.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55434.log.gz 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65813.log 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.59917.log.gz 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42872.log 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.65813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65813.log.gz 2024-04-25T02:18:46.912 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50693.log 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42872.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.75793.log.gz 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42872.log.gz 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58886.log 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68840.log 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50693.log.gz 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51523.log 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58886.log.gz 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73887.log 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2%/var/log/ceph/ceph-client.admin.51523.log: -- replaced with /var/log/ceph/ceph-client.admin.68840.log.gz 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58093.log 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.73887.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.51523.log.gz 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73887.log.gz 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68397.log 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.58093.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61335.log 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.0.58093.log.gz 2024-04-25T02:18:46.913 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62203.log 2024-04-25T02:18:46.914 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68397.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T02:18:46.914 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61335.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61335.log.gz 2024-04-25T02:18:46.914 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.68397.log.gz 2024-04-25T02:18:46.914 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49700.log 2024-04-25T02:18:46.914 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61989.log 2024-04-25T02:18:46.914 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49700.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62203.log.gz 2024-04-25T02:18:46.914 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66042.log 2024-04-25T02:18:46.914 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5%/var/log/ceph/ceph-client.admin.61989.log: -- replaced with /var/log/ceph/ceph-client.admin.49700.log.gz 2024-04-25T02:18:46.914 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44821.log 2024-04-25T02:18:46.914 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61989.log.gz 2024-04-25T02:18:46.914 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75582.log 2024-04-25T02:18:46.914 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50377.log 2024-04-25T02:18:46.914 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44821.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.66042.log.gz 2024-04-25T02:18:46.914 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45407.log 2024-04-25T02:18:46.914 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44821.log.gz 2024-04-25T02:18:46.915 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50377.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.75582.log.gz 2024-04-25T02:18:46.915 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50377.log.gz 2024-04-25T02:18:46.915 INFO:teuthology.orchestra.run.smithi079.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54187.log 2024-04-25T02:18:46.915 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50421.log 2024-04-25T02:18:46.915 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45407.log.gz 2024-04-25T02:18:46.915 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57793.log 2024-04-25T02:18:46.915 INFO:teuthology.orchestra.run.smithi079.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54187.log.gz 2024-04-25T02:18:46.915 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62636.log 2024-04-25T02:18:46.915 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50421.log: /var/log/ceph/ceph-client.admin.57793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66742.log 2024-04-25T02:18:46.915 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62636.log: 89.1% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57793.log.gz 2024-04-25T02:18:46.915 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50421.log.gz 2024-04-25T02:18:46.915 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69105.log 2024-04-25T02:18:46.915 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62636.log.gz 2024-04-25T02:18:46.915 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40307.log 2024-04-25T02:18:46.915 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57901.log 2024-04-25T02:18:46.916 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66742.log.gz 2024-04-25T02:18:46.916 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69105.log: /var/log/ceph/ceph-client.admin.40307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40403.log 2024-04-25T02:18:46.916 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57901.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69105.log.gz 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40307.log.gz 2024-04-25T02:18:46.916 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.916 INFO:teuthology.orchestra.run.smithi079.stderr:gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57901.log.gz 2024-04-25T02:18:46.916 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69881.log 2024-04-25T02:18:46.916 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78388.log 2024-04-25T02:18:46.916 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40403.log.gz 2024-04-25T02:18:46.916 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42620.log 2024-04-25T02:18:46.916 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69881.log.gz 2024-04-25T02:18:46.916 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70853.log 2024-04-25T02:18:46.916 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78388.log: /var/log/ceph/ceph-client.admin.42620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72049.log 2024-04-25T02:18:46.916 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70853.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42620.log.gz 2024-04-25T02:18:46.916 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78388.log.gz 2024-04-25T02:18:46.916 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61885.log 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72049.log: 90.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56422.log 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70853.log.gz 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72049.log.gz 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66437.log 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78261.log 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56422.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61885.log.gz 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0%/var/log/ceph/ceph-client.admin.66437.log: -- replaced with /var/log/ceph/ceph-client.admin.56422.log.gz 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72586.log 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66437.log.gz 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64378.log 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78261.log.gz 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54337.log 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72586.log.gz 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45142.log 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64378.log: /var/log/ceph/ceph-client.admin.54337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41192.log 2024-04-25T02:18:46.917 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8%/var/log/ceph/ceph-client.admin.45142.log: -- replaced with /var/log/ceph/ceph-client.admin.54337.log.gz 2024-04-25T02:18:46.918 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.64378.log.gz 2024-04-25T02:18:46.918 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45142.log.gz 2024-04-25T02:18:46.918 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76090.log 2024-04-25T02:18:46.918 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59281.log 2024-04-25T02:18:46.918 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76090.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41192.log.gz 2024-04-25T02:18:46.918 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75835.log 2024-04-25T02:18:46.918 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59281.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.76090.log.gz 2024-04-25T02:18:46.918 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48587.log 2024-04-25T02:18:46.918 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.59281.log.gz 2024-04-25T02:18:46.918 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose/var/log/ceph/ceph-client.admin.75835.log: -- /var/log/ceph/ceph-client.admin.58313.log 2024-04-25T02:18:46.918 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56674.log 2024-04-25T02:18:46.918 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48587.log: /var/log/ceph/ceph-client.admin.58313.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48587.log.gz 2024-04-25T02:18:46.918 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58313.log.gz 2024-04-25T02:18:46.918 INFO:teuthology.orchestra.run.smithi079.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.75835.log.gz 2024-04-25T02:18:46.918 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50861.log 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67648.log 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56674.log.gz 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50293.log 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46384.log 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50861.log.gz 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67648.log: /var/log/ceph/ceph-client.admin.50293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54876.log 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67648.log.gz 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4%/var/log/ceph/ceph-client.admin.46384.log: -- replaced with /var/log/ceph/ceph-client.admin.50293.log.gz 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62426.log 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46384.log.gz 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73468.log 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54876.log: /var/log/ceph/ceph-client.admin.62426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74190.log 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73468.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62426.log.gz 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% 91.2% -- replaced with /var/log/ceph/ceph-client.admin.73468.log.gz 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45457.log 2024-04-25T02:18:46.919 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74190.log: -- replaced with /var/log/ceph/ceph-client.admin.54876.log.gz 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64733.log 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74190.log.gz 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70682.log 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45457.log.gz 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68313.log 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64733.log: /var/log/ceph/ceph-client.admin.70682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63679.log 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68313.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70682.log.gz 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64733.log.gz 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68313.log.gz 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr: -- /var/log/ceph/ceph-client.admin.48063.log 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48255.log 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9%/var/log/ceph/ceph-client.admin.48063.log: -- replaced with /var/log/ceph/ceph-client.admin.63679.log.gz 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49574.log 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48063.log.gz 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51371.log 2024-04-25T02:18:46.920 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.48255.log: /var/log/ceph/ceph-client.admin.49574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73552.log 2024-04-25T02:18:46.921 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48255.log.gz 2024-04-25T02:18:46.921 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.51371.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49574.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.0.51371.log.gz 2024-04-25T02:18:46.921 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.921 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64777.log 2024-04-25T02:18:46.921 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41836.log/var/log/ceph/ceph-client.admin.73552.log: 2024-04-25T02:18:46.921 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64777.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40653.log 2024-04-25T02:18:46.921 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73552.log.gz 2024-04-25T02:18:46.921 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66952.log 2024-04-25T02:18:46.921 INFO:teuthology.orchestra.run.smithi079.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.64777.log.gz 2024-04-25T02:18:46.921 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3%/var/log/ceph/ceph-client.admin.40653.log: -- replaced with /var/log/ceph/ceph-client.admin.41836.log.gz 2024-04-25T02:18:46.921 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53566.log 2024-04-25T02:18:46.921 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56506.log 2024-04-25T02:18:46.921 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40653.log.gz 2024-04-25T02:18:46.921 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53566.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59851.log 2024-04-25T02:18:46.921 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66952.log.gz 2024-04-25T02:18:46.922 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53566.log.gz 2024-04-25T02:18:46.922 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60678.log 2024-04-25T02:18:46.922 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56506.log: /var/log/ceph/ceph-client.admin.59851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71454.log 2024-04-25T02:18:46.922 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56506.log.gz 2024-04-25T02:18:46.922 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41318.log 2024-04-25T02:18:46.922 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% 90.7% -- replaced with /var/log/ceph/ceph-client.admin.59851.log.gz 2024-04-25T02:18:46.922 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60678.log.gz 2024-04-25T02:18:46.922 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53396.log 2024-04-25T02:18:46.922 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56067.log 2024-04-25T02:18:46.922 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71454.log.gz 2024-04-25T02:18:46.922 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41318.log: /var/log/ceph/ceph-client.admin.53396.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41318.log.gz 2024-04-25T02:18:46.922 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53396.log.gz 2024-04-25T02:18:46.922 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69804.log 2024-04-25T02:18:46.922 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59074.log 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69804.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56067.log.gz 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72712.log 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2%/var/log/ceph/ceph-client.0.59074.log: -- replaced with /var/log/ceph/ceph-client.admin.69804.log.gz 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63215.log 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.0.59074.log.gz 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71969.log 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72712.log: /var/log/ceph/ceph-client.admin.63215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61947.log 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.72712.log.gz 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63215.log.gz 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71969.log: gzip -5 --verbose 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71969.log.gz 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr: -- /var/log/ceph/ceph-client.admin.52509.log 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44359.log 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61947.log.gz 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66615.log 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52509.log.gz/var/log/ceph/ceph-client.admin.44359.log: 2024-04-25T02:18:46.923 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63257.log 2024-04-25T02:18:46.924 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44359.log.gz 2024-04-25T02:18:46.924 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62552.log 2024-04-25T02:18:46.924 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66615.log.gz/var/log/ceph/ceph-client.admin.63257.log: 2024-04-25T02:18:46.924 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63516.log 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63257.log.gz 2024-04-25T02:18:46.924 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.924 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63173.log 2024-04-25T02:18:46.924 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62552.log.gz/var/log/ceph/ceph-client.admin.63516.log: 2024-04-25T02:18:46.924 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68882.log 2024-04-25T02:18:46.924 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47997.log 2024-04-25T02:18:46.924 INFO:teuthology.orchestra.run.smithi079.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.63516.log.gz 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63173.log.gz 2024-04-25T02:18:46.924 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.924 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67097.log 2024-04-25T02:18:46.924 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47997.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68882.log.gz 2024-04-25T02:18:46.924 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52551.log 2024-04-25T02:18:46.924 INFO:teuthology.orchestra.run.smithi079.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.47997.log.gz 2024-04-25T02:18:46.925 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67904.log 2024-04-25T02:18:46.925 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67097.log.gz 2024-04-25T02:18:46.925 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60405.log 2024-04-25T02:18:46.925 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52551.log: /var/log/ceph/ceph-client.admin.67904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51500.log 2024-04-25T02:18:46.925 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.60405.log: 88.4% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67904.log.gz 2024-04-25T02:18:46.925 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60405.log.gz 2024-04-25T02:18:46.925 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52551.log.gz 2024-04-25T02:18:46.925 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61462.log 2024-04-25T02:18:46.925 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74549.log 2024-04-25T02:18:46.925 INFO:teuthology.orchestra.run.smithi079.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51500.log.gz 2024-04-25T02:18:46.925 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67860.log 2024-04-25T02:18:46.925 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61462.log.gz 2024-04-25T02:18:46.925 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47535.log 2024-04-25T02:18:46.925 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74549.log: /var/log/ceph/ceph-client.admin.67860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70919.log 2024-04-25T02:18:46.925 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47535.log: 87.6% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67860.log.gz 2024-04-25T02:18:46.926 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74549.log.gz 2024-04-25T02:18:46.926 INFO:teuthology.orchestra.run.smithi079.stderr:gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47535.log.gz 2024-04-25T02:18:46.926 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47745.log 2024-04-25T02:18:46.926 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53917.log 2024-04-25T02:18:46.926 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70919.log.gz 2024-04-25T02:18:46.926 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60594.log 2024-04-25T02:18:46.926 INFO:teuthology.orchestra.run.smithi079.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47745.log.gz 2024-04-25T02:18:46.926 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41497.log 2024-04-25T02:18:46.926 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53917.log: /var/log/ceph/ceph-client.admin.60594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58558.log 2024-04-25T02:18:46.926 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41497.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53917.log.gz 2024-04-25T02:18:46.926 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60594.log.gz 2024-04-25T02:18:46.926 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68924.log 2024-04-25T02:18:46.926 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41497.log.gz 2024-04-25T02:18:46.926 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77125.log 2024-04-25T02:18:46.926 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65513.log 2024-04-25T02:18:46.927 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58558.log.gz 2024-04-25T02:18:46.927 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68924.log: /var/log/ceph/ceph-client.admin.77125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54701.log 2024-04-25T02:18:46.927 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68924.log.gz 2024-04-25T02:18:46.927 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65513.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.77125.log.gz 2024-04-25T02:18:46.927 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53703.log 2024-04-25T02:18:46.927 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65513.log.gz 2024-04-25T02:18:46.927 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42170.log 2024-04-25T02:18:46.927 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54701.log: /var/log/ceph/ceph-client.admin.53703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49322.log 2024-04-25T02:18:46.927 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42170.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53703.log.gz 89.8% -- replaced with /var/log/ceph/ceph-client.admin.54701.log.gz 2024-04-25T02:18:46.927 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.927 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42170.log.gz 2024-04-25T02:18:46.927 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63583.log 2024-04-25T02:18:46.927 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47153.log 2024-04-25T02:18:46.927 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49322.log: /var/log/ceph/ceph-client.admin.63583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51651.log 2024-04-25T02:18:46.927 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9%/var/log/ceph/ceph-client.admin.47153.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63583.log.gz 2024-04-25T02:18:46.928 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49322.log.gz 2024-04-25T02:18:46.928 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65267.log 2024-04-25T02:18:46.928 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47153.log.gz 2024-04-25T02:18:46.928 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62031.log 2024-04-25T02:18:46.928 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51651.log.gz 2024-04-25T02:18:46.928 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41834.log 2024-04-25T02:18:46.928 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65267.log: /var/log/ceph/ceph-client.admin.62031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76262.log 2024-04-25T02:18:46.928 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41834.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62031.log.gz 2024-04-25T02:18:46.928 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49238.log 2024-04-25T02:18:46.928 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41834.log.gz 2024-04-25T02:18:46.928 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75351.log 2024-04-25T02:18:46.928 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76262.log.gz/var/log/ceph/ceph-client.admin.49238.log: 2024-04-25T02:18:46.928 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46777.log 2024-04-25T02:18:46.928 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49238.log.gz 2024-04-25T02:18:46.928 INFO:teuthology.orchestra.run.smithi079.stderr: 92.4%/var/log/ceph/ceph-client.admin.75351.log: -- replaced with /var/log/ceph/ceph-client.admin.65267.log.gz 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55176.log 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1%/var/log/ceph/ceph-client.admin.46777.log: -- replaced with /var/log/ceph/ceph-client.admin.75351.log.gz 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53055.log 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46777.log.gz 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52971.log 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55176.log: /var/log/ceph/ceph-client.admin.53055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51179.log 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8%/var/log/ceph/ceph-client.admin.52971.log: -- replaced with /var/log/ceph/ceph-client.admin.53055.log.gz 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.55176.log.gz 89.1% 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52971.log.gz/var/log/ceph/ceph-client.admin.51179.log: 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40978.log 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51179.log.gz 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42956.log 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71622.log 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2%/var/log/ceph/ceph-client.admin.42956.log: -- replaced with /var/log/ceph/ceph-client.admin.40978.log.gz 2024-04-25T02:18:46.929 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47111.log 2024-04-25T02:18:46.930 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42956.log.gz 2024-04-25T02:18:46.930 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71622.log: gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71622.log.gz 2024-04-25T02:18:46.930 INFO:teuthology.orchestra.run.smithi079.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44989.log 2024-04-25T02:18:46.930 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68651.log 2024-04-25T02:18:46.930 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44989.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47111.log.gz 2024-04-25T02:18:46.930 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43485.log 2024-04-25T02:18:46.930 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44989.log.gz/var/log/ceph/ceph-client.0.68651.log: 2024-04-25T02:18:46.930 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68651.log.gz 2024-04-25T02:18:46.930 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76999.log 2024-04-25T02:18:46.930 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77209.log 2024-04-25T02:18:46.930 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.43485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43485.log.gz 2024-04-25T02:18:46.930 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65621.log 2024-04-25T02:18:46.930 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77209.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76999.log.gz 2024-04-25T02:18:46.930 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77209.log.gz 2024-04-25T02:18:46.930 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54529.log 2024-04-25T02:18:46.931 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64186.log 2024-04-25T02:18:46.931 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65621.log: /var/log/ceph/ceph-client.0.54529.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65621.log.gz 2024-04-25T02:18:46.931 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54529.log.gz 2024-04-25T02:18:46.931 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63767.log 2024-04-25T02:18:46.931 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67690.log 2024-04-25T02:18:46.931 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64186.log: /var/log/ceph/ceph-client.admin.63767.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.64186.log.gz 2024-04-25T02:18:46.931 INFO:teuthology.orchestra.run.smithi079.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.63767.log.gz 2024-04-25T02:18:46.931 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76906.log 2024-04-25T02:18:46.931 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72215.log 2024-04-25T02:18:46.931 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67690.log: /var/log/ceph/ceph-client.admin.76906.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67690.log.gz 2024-04-25T02:18:46.931 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76906.log.gz 2024-04-25T02:18:46.931 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41498.log 2024-04-25T02:18:46.931 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40215.log 2024-04-25T02:18:46.931 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72215.log.gz 2024-04-25T02:18:46.931 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48671.log 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40215.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41498.log.gz 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57057.log 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40215.log.gz 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42172.log 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57057.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48671.log.gz 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57057.log.gz 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50507.log 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42172.log: -- /var/log/ceph/ceph-client.admin.45964.log 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42172.log.gz 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57355.log 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8%/var/log/ceph/ceph-client.admin.45964.log: -- replaced with /var/log/ceph/ceph-client.admin.50507.log.gz 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68798.log 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45964.log.gz 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41066.log 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73138.log 2024-04-25T02:18:46.932 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57355.log.gz 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68798.log: /var/log/ceph/ceph-client.admin.41066.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68798.log.gz 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41066.log.gz 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74232.log 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.73138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73138.log.gz 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53480.log 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53959.log 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74232.log: /var/log/ceph/ceph-client.admin.53480.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74232.log.gz 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53480.log.gz 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67486.log 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66108.log 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53959.log.gz 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46552.log 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67486.log.gz 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67139.log 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66108.log.gz/var/log/ceph/ceph-client.admin.46552.log: 2024-04-25T02:18:46.933 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61107.log 2024-04-25T02:18:46.934 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0%/var/log/ceph/ceph-client.admin.67139.log: -- replaced with /var/log/ceph/ceph-client.admin.46552.log.gz 2024-04-25T02:18:46.934 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.67139.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.61648.log 2024-04-25T02:18:46.934 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:46.934 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70357.log 2024-04-25T02:18:46.934 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69128.log 2024-04-25T02:18:46.934 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61107.log.gz 2024-04-25T02:18:46.934 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61648.log: /var/log/ceph/ceph-client.admin.70357.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61648.log.gz 2024-04-25T02:18:46.934 INFO:teuthology.orchestra.run.smithi079.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.70357.log.gz 2024-04-25T02:18:46.934 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54658.log 2024-04-25T02:18:46.934 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41491.log 2024-04-25T02:18:46.934 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54658.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.69128.log.gz 2024-04-25T02:18:46.934 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54658.log.gz 2024-04-25T02:18:46.934 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74591.log 2024-04-25T02:18:46.934 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46006.log 2024-04-25T02:18:46.934 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41491.log.gz 2024-04-25T02:18:46.935 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57015.log 2024-04-25T02:18:46.935 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46006.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.74591.log.gz 2024-04-25T02:18:46.935 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46006.log.gz 2024-04-25T02:18:46.935 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47409.log 2024-04-25T02:18:46.935 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42998.log 2024-04-25T02:18:46.935 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47409.log: /var/log/ceph/ceph-client.admin.57015.log: 87.7% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57015.log.gz 2024-04-25T02:18:46.935 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47409.log.gz 2024-04-25T02:18:46.935 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54810.log 2024-04-25T02:18:46.935 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51889.log 2024-04-25T02:18:46.935 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.42998.log: /var/log/ceph/ceph-client.admin.54810.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42998.log.gz 2024-04-25T02:18:46.935 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54810.log.gz 2024-04-25T02:18:46.935 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64570.log 2024-04-25T02:18:46.935 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5/var/log/ceph/ceph-client.admin.51889.log: --verbose -- /var/log/ceph/ceph-client.admin.48629.log 2024-04-25T02:18:46.935 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51889.log.gz 2024-04-25T02:18:46.935 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74064.log 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48629.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.64570.log.gz 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48629.log.gz 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56151.log 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77479.log 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.74064.log.gz/var/log/ceph/ceph-client.admin.56151.log: 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58271.log 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2%/var/log/ceph/ceph-client.admin.77479.log: -- replaced with /var/log/ceph/ceph-client.admin.56151.log.gz 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44401.log 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77479.log.gz 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60001.log 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58271.log: /var/log/ceph/ceph-client.admin.44401.log: 88.7% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58271.log.gz 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44401.log.gz 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75727.log 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46655.log 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60001.log: /var/log/ceph/ceph-client.admin.75727.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60001.log.gz 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.75727.log.gz 2024-04-25T02:18:46.936 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46612.log 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56193.log 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46655.log.gz/var/log/ceph/ceph-client.admin.46612.log: 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45760.log 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56193.log: -- replaced with /var/log/ceph/ceph-client.admin.46612.log.gz 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78836.log 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56193.log.gz 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73510.log 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78836.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45760.log.gz 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.78836.log.gz 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55857.log 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61564.log 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73510.log: /var/log/ceph/ceph-client.admin.55857.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73510.log.gz 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55857.log.gz 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70232.log 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77648.log 2024-04-25T02:18:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70232.log: /var/log/ceph/ceph-client.admin.61564.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61564.log.gz 2024-04-25T02:18:46.938 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70232.log.gz 2024-04-25T02:18:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74679.log 2024-04-25T02:18:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52079.log 2024-04-25T02:18:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77648.log: /var/log/ceph/ceph-client.admin.74679.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77648.log.gz 2024-04-25T02:18:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43624.log 2024-04-25T02:18:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52079.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.74679.log.gz 2024-04-25T02:18:46.938 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52079.log.gz 2024-04-25T02:18:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49826.log 2024-04-25T02:18:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75545.log 2024-04-25T02:18:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49826.log: /var/log/ceph/ceph-client.admin.43624.log: 88.7% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43624.log.gz 2024-04-25T02:18:46.938 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49826.log.gz 2024-04-25T02:18:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78135.log 2024-04-25T02:18:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41024.log 2024-04-25T02:18:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75545.log: /var/log/ceph/ceph-client.admin.78135.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.75545.log.gz 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.78135.log.gz 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71706.log 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60217.log 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41024.log.gz 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59550.log 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71706.log.gz 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76196.log 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4%/var/log/ceph/ceph-client.admin.59550.log: -- replaced with /var/log/ceph/ceph-client.admin.60217.log.gz 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67566.log 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59550.log.gz 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55983.log 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67566.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67566.log.gz 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.76196.log.gz 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50465.log 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68271.log 2024-04-25T02:18:46.939 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55983.log.gz 2024-04-25T02:18:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55721.log 2024-04-25T02:18:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68271.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50465.log.gz 2024-04-25T02:18:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60175.log 2024-04-25T02:18:46.940 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68271.log.gz 2024-04-25T02:18:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74106.log 2024-04-25T02:18:46.940 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55721.log.gz 2024-04-25T02:18:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34825.log 2024-04-25T02:18:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74106.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60175.log.gz 2024-04-25T02:18:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77967.log 2024-04-25T02:18:46.940 INFO:teuthology.orchestra.run.smithi079.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.74106.log.gz 2024-04-25T02:18:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61504.log 2024-04-25T02:18:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77967.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34825.log.gz 2024-04-25T02:18:46.940 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77967.log.gz 2024-04-25T02:18:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47829.log 2024-04-25T02:18:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61504.log: /var/log/ceph/ceph-client.admin.47829.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61504.log.gz 2024-04-25T02:18:46.941 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47829.log.gz 2024-04-25T02:18:46.941 INFO:teuthology.orchestra.run.smithi189.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T02:18:46.975 INFO:teuthology.orchestra.run.smithi189.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T02:18:46.987 INFO:teuthology.orchestra.run.smithi079.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T02:18:47.081 INFO:teuthology.orchestra.run.smithi189.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T02:18:47.107 INFO:teuthology.orchestra.run.smithi189.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T02:18:47.137 INFO:teuthology.orchestra.run.smithi189.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T02:18:47.140 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-04-25T02:18:47.140 INFO:teuthology.orchestra.run.smithi189.stderr:real 0m0.647s 2024-04-25T02:18:47.140 INFO:teuthology.orchestra.run.smithi189.stderr:user 0m2.943s 2024-04-25T02:18:47.140 INFO:teuthology.orchestra.run.smithi189.stderr:sys 0m0.133s 2024-04-25T02:18:47.145 INFO:teuthology.orchestra.run.smithi079.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T02:18:47.222 INFO:teuthology.orchestra.run.smithi079.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T02:18:47.259 INFO:teuthology.orchestra.run.smithi079.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T02:18:47.276 INFO:teuthology.orchestra.run.smithi079.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T02:18:47.356 INFO:teuthology.orchestra.run.smithi079.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T02:18:47.358 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T02:18:47.358 INFO:teuthology.orchestra.run.smithi079.stderr:real 0m0.895s 2024-04-25T02:18:47.358 INFO:teuthology.orchestra.run.smithi079.stderr:user 0m4.198s 2024-04-25T02:18:47.358 INFO:teuthology.orchestra.run.smithi079.stderr:sys 0m0.519s 2024-04-25T02:18:47.358 INFO:tasks.ceph:Archiving logs... 2024-04-25T02:18:47.359 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672374/remote/smithi079/log 2024-04-25T02:18:47.359 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:18:48.453 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672374/remote/smithi189/log 2024-04-25T02:18:48.454 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:18:48.950 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T02:18:48.959 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T02:18:48.959 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:18:48.962 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:18:49.035 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T02:18:49.044 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T02:18:49.044 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:18:49.047 DEBUG:teuthology.orchestra.run.smithi189:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:18:49.060 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-04-25T02:18:49.063 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-04-25T02:18:49.066 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:18:49.066 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-04-25T02:18:49.066 INFO:teuthology.orchestra.run.smithi079.stdout:^- hv01.front.sepia.ceph.com 2 6 377 1 +1762us[+1762us] +/- 593ms 2024-04-25T02:18:49.066 INFO:teuthology.orchestra.run.smithi079.stdout:^* hv02.front.sepia.ceph.com 3 6 377 2 -299us[ -254us] +/- 65ms 2024-04-25T02:18:49.066 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 +331us[ +331us] +/- 72ms 2024-04-25T02:18:49.066 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:18:49.068 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:18:49.068 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-04-25T02:18:49.068 INFO:teuthology.orchestra.run.smithi189.stdout:^- hv01.front.sepia.ceph.com 2 6 377 1 +1760us[+1760us] +/- 593ms 2024-04-25T02:18:49.068 INFO:teuthology.orchestra.run.smithi189.stdout:^* hv02.front.sepia.ceph.com 3 6 377 63 -293us[ -280us] +/- 65ms 2024-04-25T02:18:49.068 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +351us[ +351us] +/- 72ms 2024-04-25T02:18:49.069 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:18:49.069 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T02:18:49.078 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T02:18:49.079 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T02:18:49.088 DEBUG:teuthology.orchestra.run.smithi079:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:18:49.193 DEBUG:teuthology.orchestra.run.smithi189:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:18:49.259 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T02:18:49.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:18:49.289 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T02:18:49.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:18:49.318 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T02:18:49.327 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T02:18:49.336 INFO:teuthology.task.internal:Duration was 1064.341112 seconds 2024-04-25T02:18:49.336 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T02:18:49.348 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T02:18:49.348 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:18:49.351 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:18:49.386 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:18:49.395 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:18:49.727 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T02:18:49.727 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T02:18:49.728 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:18:49.747 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi189.front.sepia.ceph.com 2024-04-25T02:18:49.747 DEBUG:teuthology.orchestra.run.smithi189:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:18:49.791 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T02:18:49.791 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:18:49.794 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:18:49.857 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T02:18:49.857 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:18:49.860 DEBUG:teuthology.orchestra.run.smithi189:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:18:49.997 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T02:18:50.007 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T02:18:50.008 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:18:50.031 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:18:50.055 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T02:18:50.064 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:18:50.074 DEBUG:teuthology.orchestra.run.smithi189:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:18:50.093 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2024-04-25T02:18:50.116 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = core 2024-04-25T02:18:50.129 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:18:50.159 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:18:50.160 DEBUG:teuthology.orchestra.run.smithi189:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:18:50.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:18:50.179 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T02:18:50.190 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T02:18:50.190 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672374/remote/smithi079 2024-04-25T02:18:50.190 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:18:50.233 DEBUG:teuthology.misc:Transferring archived files from smithi189:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672374/remote/smithi189 2024-04-25T02:18:50.234 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:18:50.266 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T02:18:50.266 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:18:50.270 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:18:50.315 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T02:18:50.326 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T02:18:50.327 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T02:18:50.340 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T02:18:50.341 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:18:50.343 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:18:50.355 INFO:teuthology.orchestra.run.smithi079.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:18 /home/ubuntu/cephtest 2024-04-25T02:18:50.370 INFO:teuthology.orchestra.run.smithi189.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:18 /home/ubuntu/cephtest 2024-04-25T02:18:50.371 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T02:18:50.381 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T02:18:50.404 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} duration: 1064.3411121368408 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-25T02:18:50.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T02:18:50.496 INFO:teuthology.run:pass